2024-09-13T06:25:09.365 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-13T06:25:09.381 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-13T06:25:09.461 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-09-10_22:16:02-rbd-reef-distro-default-smithi/7900868 branch: reef description: rbd/thrash/{base/install clusters/{fixed-2 openstack} conf/{disable-pool-app} msgr-failures/few objectstore/bluestore-low-osd-mem-target supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/rbd_fsx_deep_copy} email: ceph-qa@ceph.com first_in_suite: false job_id: '7900868' kernel: kdb: 1 sha1: distro ktype: distro last_in_suite: false machine_type: smithi name: teuthology-2024-09-10_22:16:02-rbd-reef-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 10 - machine: cpus: 1 disk: 40 ram: 8000 volumes: count: 4 size: 30 os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: reef ceph: conf: global: mon client directed command retry: 5 mon warn on pool no app: false ms inject socket failures: 5000 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd blocked scrub grace period: 3600 osd failsafe full ratio: 0.95 osd max markdown count: 1000 osd memory target: 1610612736 osd objectstore: bluestore osd shutdown pgref assert: true flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(OSD_SLOW_PING_TIME - but it is still running - objects unfound and apparently lost - overall HEALTH_ - \(OSDMAP_FLAGS\) - \(OSD_ - \(PG_ - \(POOL_ - \(CACHE_POOL_ - \(SMALLER_PGP_NUM\) - \(OBJECT_ - \(SLOW_OPS\) - \(REQUEST_SLOW\) - \(TOO_FEW_PGS\) - slow request - timeout on replica - late reservation from sha1: 48a7de7e6e1701a88fd571c7e34908ac4b8ed412 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} install: ceph: flavor: default sha1: 48a7de7e6e1701a88fd571c7e34908ac4b8ed412 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: reef sha1: 7a853b1706d076d58e0da7a5d3b9b9eb36276880 owner: scheduled_teuthology@teuthology priority: 930 repo: https://git.ceph.com/ceph.git roles: - - mon.a - mon.c - mgr.y - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - node-exporter.a - - mon.b - mgr.x - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - prometheus.a - node-exporter.b seed: 248 sha1: 48a7de7e6e1701a88fd571c7e34908ac4b8ed412 sleep_before_teardown: 0 subset: 116/128 suite: rbd suite_branch: reef suite_path: /home/teuthworker/src/git.ceph.com_ceph_7a853b1706d076d58e0da7a5d3b9b9eb36276880/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: 7a853b1706d076d58e0da7a5d3b9b9eb36276880 targets: smithi081.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBElPooAgIvFL8xUBOgKuK1H0GgQdwbrHO4lhN75QkUg8jE0s7S3jh2Qk76mfss66jA6xlyM3CFCxesGkS8CkvGQ= smithi139.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFB96g9CjSfsgKLytE5gx0AlylR0OrS6wKR8a6HYsyPpFm5VCLT5+xA/aYUmfuW5R5/bzi2tm9z5P0N5Dc6kbnw= tasks: - install: null - ceph: null - thrashosds: timeout: 1200 - rbd_fsx: clients: - client.0 deep_copy: true ops: 6000 teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-10_22:16:02 tube: smithi user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-13T06:25:09.462 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_7a853b1706d076d58e0da7a5d3b9b9eb36276880/qa; will attempt to use it 2024-09-13T06:25:09.462 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_7a853b1706d076d58e0da7a5d3b9b9eb36276880/qa/tasks 2024-09-13T06:25:09.463 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-13T06:25:09.464 INFO:teuthology.task.internal:Checking packages... 2024-09-13T06:25:09.486 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash '48a7de7e6e1701a88fd571c7e34908ac4b8ed412' 2024-09-13T06:25:09.486 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-13T06:25:09.486 INFO:teuthology.packaging:ref: None 2024-09-13T06:25:09.486 INFO:teuthology.packaging:tag: None 2024-09-13T06:25:09.486 INFO:teuthology.packaging:branch: reef 2024-09-13T06:25:09.486 INFO:teuthology.packaging:sha1: 48a7de7e6e1701a88fd571c7e34908ac4b8ed412 2024-09-13T06:25:09.486 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=reef 2024-09-13T06:25:09.766 INFO:teuthology.task.internal:Found packages for ceph version 18.2.4-843-g2c01458a-1jammy 2024-09-13T06:25:09.769 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-13T06:25:09.775 INFO:teuthology.task.internal:no buildpackages task found 2024-09-13T06:25:09.775 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-13T06:25:09.934 INFO:teuthology.task.internal:Saving configuration 2024-09-13T06:25:09.946 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-13T06:25:10.038 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-13T06:25:10.069 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi081.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-10_22:16:02-rbd-reef-distro-default-smithi/7900868', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-13 06:19:31.839851', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIIA07PNlHtKrt6QfbS2yTIxYI+wwDmH7b3QYWoJJfLCf'} 2024-09-13T06:25:10.097 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi139.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-10_22:16:02-rbd-reef-distro-default-smithi/7900868', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-13 06:19:31.837957', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIPumodowbI3HJuz5cYpkXp1KGLwIwVRK3J2evjvFCGPl'} 2024-09-13T06:25:10.097 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-13T06:25:10.137 INFO:teuthology.task.internal:roles: ubuntu@smithi081.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2024-09-13T06:25:10.137 INFO:teuthology.task.internal:roles: ubuntu@smithi139.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2024-09-13T06:25:10.137 INFO:teuthology.run_tasks:Running task console_log... 2024-09-13T06:25:10.268 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fd66959d870>, signals=[15]) 2024-09-13T06:25:10.268 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-13T06:25:10.294 INFO:teuthology.task.internal:Opening connections... 2024-09-13T06:25:10.294 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi081.front.sepia.ceph.com 2024-09-13T06:25:10.295 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T06:25:10.390 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi139.front.sepia.ceph.com 2024-09-13T06:25:10.391 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T06:25:10.477 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-13T06:25:10.484 DEBUG:teuthology.orchestra.run.smithi081:> uname -m 2024-09-13T06:25:10.489 INFO:teuthology.orchestra.run.smithi081.stdout:x86_64 2024-09-13T06:25:10.489 DEBUG:teuthology.orchestra.run.smithi081:> cat /etc/os-release 2024-09-13T06:25:10.537 INFO:teuthology.orchestra.run.smithi081.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-09-13T06:25:10.538 INFO:teuthology.orchestra.run.smithi081.stdout:NAME="Ubuntu" 2024-09-13T06:25:10.538 INFO:teuthology.orchestra.run.smithi081.stdout:VERSION_ID="22.04" 2024-09-13T06:25:10.538 INFO:teuthology.orchestra.run.smithi081.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-09-13T06:25:10.538 INFO:teuthology.orchestra.run.smithi081.stdout:VERSION_CODENAME=jammy 2024-09-13T06:25:10.538 INFO:teuthology.orchestra.run.smithi081.stdout:ID=ubuntu 2024-09-13T06:25:10.538 INFO:teuthology.orchestra.run.smithi081.stdout:ID_LIKE=debian 2024-09-13T06:25:10.538 INFO:teuthology.orchestra.run.smithi081.stdout:HOME_URL="https://www.ubuntu.com/" 2024-09-13T06:25:10.538 INFO:teuthology.orchestra.run.smithi081.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-09-13T06:25:10.538 INFO:teuthology.orchestra.run.smithi081.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-09-13T06:25:10.538 INFO:teuthology.orchestra.run.smithi081.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-09-13T06:25:10.538 INFO:teuthology.orchestra.run.smithi081.stdout:UBUNTU_CODENAME=jammy 2024-09-13T06:25:10.539 INFO:teuthology.lock.ops:Updating smithi081.front.sepia.ceph.com on lock server 2024-09-13T06:25:10.564 DEBUG:teuthology.orchestra.run.smithi139:> uname -m 2024-09-13T06:25:10.569 INFO:teuthology.orchestra.run.smithi139.stdout:x86_64 2024-09-13T06:25:10.570 DEBUG:teuthology.orchestra.run.smithi139:> cat /etc/os-release 2024-09-13T06:25:10.615 INFO:teuthology.orchestra.run.smithi139.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-09-13T06:25:10.616 INFO:teuthology.orchestra.run.smithi139.stdout:NAME="Ubuntu" 2024-09-13T06:25:10.616 INFO:teuthology.orchestra.run.smithi139.stdout:VERSION_ID="22.04" 2024-09-13T06:25:10.616 INFO:teuthology.orchestra.run.smithi139.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-09-13T06:25:10.616 INFO:teuthology.orchestra.run.smithi139.stdout:VERSION_CODENAME=jammy 2024-09-13T06:25:10.616 INFO:teuthology.orchestra.run.smithi139.stdout:ID=ubuntu 2024-09-13T06:25:10.616 INFO:teuthology.orchestra.run.smithi139.stdout:ID_LIKE=debian 2024-09-13T06:25:10.616 INFO:teuthology.orchestra.run.smithi139.stdout:HOME_URL="https://www.ubuntu.com/" 2024-09-13T06:25:10.616 INFO:teuthology.orchestra.run.smithi139.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-09-13T06:25:10.616 INFO:teuthology.orchestra.run.smithi139.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-09-13T06:25:10.616 INFO:teuthology.orchestra.run.smithi139.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-09-13T06:25:10.616 INFO:teuthology.orchestra.run.smithi139.stdout:UBUNTU_CODENAME=jammy 2024-09-13T06:25:10.617 INFO:teuthology.lock.ops:Updating smithi139.front.sepia.ceph.com on lock server 2024-09-13T06:25:10.647 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-13T06:25:10.657 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-13T06:25:10.685 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-13T06:25:10.685 DEBUG:teuthology.orchestra.run.smithi081:> test '!' -e /home/ubuntu/cephtest 2024-09-13T06:25:10.688 DEBUG:teuthology.orchestra.run.smithi139:> test '!' -e /home/ubuntu/cephtest 2024-09-13T06:25:10.692 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-13T06:25:10.747 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-13T06:25:10.747 DEBUG:teuthology.orchestra.run.smithi081:> test -z $(ls -A /var/lib/ceph) 2024-09-13T06:25:10.750 DEBUG:teuthology.orchestra.run.smithi139:> test -z $(ls -A /var/lib/ceph) 2024-09-13T06:25:10.770 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-13T06:25:10.897 INFO:teuthology.run_tasks:Running task kernel... 2024-09-13T06:25:10.931 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-09-13T06:25:10.932 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'mon.b': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-09-13T06:25:10.932 DEBUG:teuthology.orchestra.run.smithi081:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-13T06:25:10.932 DEBUG:teuthology.orchestra.run.smithi139:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-13T06:25:10.936 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T06:25:10.937 DEBUG:teuthology.orchestra.run.smithi081:> uname -r 2024-09-13T06:25:10.937 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T06:25:10.938 DEBUG:teuthology.orchestra.run.smithi139:> uname -r 2024-09-13T06:25:10.983 INFO:teuthology.orchestra.run.smithi139.stdout:5.15.0-56-generic 2024-09-13T06:25:10.983 INFO:teuthology.task.kernel:Running kernel on smithi139: 5.15.0-56-generic 2024-09-13T06:25:10.984 DEBUG:teuthology.orchestra.run.smithi139:> sudo apt-get clean 2024-09-13T06:25:10.986 INFO:teuthology.orchestra.run.smithi081.stdout:5.15.0-56-generic 2024-09-13T06:25:10.986 INFO:teuthology.task.kernel:Running kernel on smithi081: 5.15.0-56-generic 2024-09-13T06:25:10.986 DEBUG:teuthology.orchestra.run.smithi081:> sudo apt-get clean 2024-09-13T06:25:11.116 DEBUG:teuthology.orchestra.run.smithi081:> sudo apt-get update 2024-09-13T06:25:11.144 DEBUG:teuthology.orchestra.run.smithi139:> sudo apt-get update 2024-09-13T06:25:20.333 INFO:teuthology.orchestra.run.smithi139.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-13T06:25:20.424 INFO:teuthology.orchestra.run.smithi139.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [128 kB] 2024-09-13T06:25:20.757 INFO:teuthology.orchestra.run.smithi139.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [127 kB] 2024-09-13T06:25:20.891 INFO:teuthology.orchestra.run.smithi139.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [696 kB] 2024-09-13T06:25:21.096 INFO:teuthology.orchestra.run.smithi139.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [2,022 kB] 2024-09-13T06:25:21.244 INFO:teuthology.orchestra.run.smithi139.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [352 kB] 2024-09-13T06:25:21.258 INFO:teuthology.orchestra.run.smithi139.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [17.8 kB] 2024-09-13T06:25:21.259 INFO:teuthology.orchestra.run.smithi139.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [2,437 kB] 2024-09-13T06:25:21.327 INFO:teuthology.orchestra.run.smithi139.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [39.3 kB] 2024-09-13T06:25:21.337 INFO:teuthology.orchestra.run.smithi139.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [419 kB] 2024-09-13T06:25:21.345 INFO:teuthology.orchestra.run.smithi139.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [616 B] 2024-09-13T06:25:21.345 INFO:teuthology.orchestra.run.smithi139.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,124 kB] 2024-09-13T06:25:21.378 INFO:teuthology.orchestra.run.smithi139.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [732 kB] 2024-09-13T06:25:21.397 INFO:teuthology.orchestra.run.smithi139.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [261 kB] 2024-09-13T06:25:21.402 INFO:teuthology.orchestra.run.smithi139.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [26.1 kB] 2024-09-13T06:25:21.410 INFO:teuthology.orchestra.run.smithi139.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [43.3 kB] 2024-09-13T06:25:21.411 INFO:teuthology.orchestra.run.smithi139.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,752 B] 2024-09-13T06:25:21.412 INFO:teuthology.orchestra.run.smithi139.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.8 kB] 2024-09-13T06:25:21.485 INFO:teuthology.orchestra.run.smithi139.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [444 B] 2024-09-13T06:25:21.485 INFO:teuthology.orchestra.run.smithi139.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.9 kB] 2024-09-13T06:25:21.486 INFO:teuthology.orchestra.run.smithi139.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.8 kB] 2024-09-13T06:25:21.488 INFO:teuthology.orchestra.run.smithi139.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.1 kB] 2024-09-13T06:25:21.488 INFO:teuthology.orchestra.run.smithi139.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-09-13T06:25:21.491 INFO:teuthology.orchestra.run.smithi139.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [28.8 kB] 2024-09-13T06:25:21.492 INFO:teuthology.orchestra.run.smithi139.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [17.3 kB] 2024-09-13T06:25:21.573 INFO:teuthology.orchestra.run.smithi139.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.5 kB] 2024-09-13T06:25:21.573 INFO:teuthology.orchestra.run.smithi139.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [672 B] 2024-09-13T06:25:22.962 INFO:teuthology.orchestra.run.smithi081.stdout:Get:1 http://security.ubuntu.com/ubuntu jammy-security InRelease [129 kB] 2024-09-13T06:25:23.384 INFO:teuthology.orchestra.run.smithi081.stdout:Get:2 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,806 kB] 2024-09-13T06:25:23.818 INFO:teuthology.orchestra.run.smithi081.stdout:Get:3 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [539 kB] 2024-09-13T06:25:23.834 INFO:teuthology.orchestra.run.smithi081.stdout:Get:4 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [295 kB] 2024-09-13T06:25:23.843 INFO:teuthology.orchestra.run.smithi081.stdout:Get:5 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [13.3 kB] 2024-09-13T06:25:23.843 INFO:teuthology.orchestra.run.smithi081.stdout:Get:6 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [2,377 kB] 2024-09-13T06:25:23.943 INFO:teuthology.orchestra.run.smithi081.stdout:Get:7 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [37.7 kB] 2024-09-13T06:25:23.943 INFO:teuthology.orchestra.run.smithi081.stdout:Get:8 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [409 kB] 2024-09-13T06:25:23.955 INFO:teuthology.orchestra.run.smithi081.stdout:Get:9 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [584 B] 2024-09-13T06:25:23.955 INFO:teuthology.orchestra.run.smithi081.stdout:Get:10 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [902 kB] 2024-09-13T06:25:24.008 INFO:teuthology.orchestra.run.smithi081.stdout:Get:11 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [627 kB] 2024-09-13T06:25:24.027 INFO:teuthology.orchestra.run.smithi081.stdout:Get:12 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [176 kB] 2024-09-13T06:25:24.030 INFO:teuthology.orchestra.run.smithi081.stdout:Get:13 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [19.2 kB] 2024-09-13T06:25:24.031 INFO:teuthology.orchestra.run.smithi081.stdout:Get:14 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-09-13T06:25:24.032 INFO:teuthology.orchestra.run.smithi081.stdout:Get:15 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-09-13T06:25:24.080 INFO:teuthology.orchestra.run.smithi081.stdout:Get:16 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-09-13T06:25:24.081 INFO:teuthology.orchestra.run.smithi081.stdout:Get:17 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [228 B] 2024-09-13T06:25:46.496 INFO:teuthology.orchestra.run.smithi139.stdout:Get:28 http://security.ubuntu.com/ubuntu jammy-security InRelease [129 kB] 2024-09-13T06:25:46.682 INFO:teuthology.orchestra.run.smithi139.stdout:Get:29 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,806 kB] 2024-09-13T06:25:46.778 INFO:teuthology.orchestra.run.smithi139.stdout:Get:30 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [539 kB] 2024-09-13T06:25:46.806 INFO:teuthology.orchestra.run.smithi139.stdout:Get:31 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [295 kB] 2024-09-13T06:25:46.829 INFO:teuthology.orchestra.run.smithi139.stdout:Get:32 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [13.3 kB] 2024-09-13T06:25:46.847 INFO:teuthology.orchestra.run.smithi139.stdout:Get:33 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [2,377 kB] 2024-09-13T06:25:46.907 INFO:teuthology.orchestra.run.smithi139.stdout:Get:34 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [37.7 kB] 2024-09-13T06:25:46.925 INFO:teuthology.orchestra.run.smithi139.stdout:Get:35 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [409 kB] 2024-09-13T06:25:46.948 INFO:teuthology.orchestra.run.smithi139.stdout:Get:36 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [584 B] 2024-09-13T06:25:46.966 INFO:teuthology.orchestra.run.smithi139.stdout:Get:37 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [902 kB] 2024-09-13T06:25:47.000 INFO:teuthology.orchestra.run.smithi139.stdout:Get:38 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [627 kB] 2024-09-13T06:25:47.028 INFO:teuthology.orchestra.run.smithi139.stdout:Get:39 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [176 kB] 2024-09-13T06:25:47.049 INFO:teuthology.orchestra.run.smithi139.stdout:Get:40 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [19.2 kB] 2024-09-13T06:25:47.067 INFO:teuthology.orchestra.run.smithi139.stdout:Get:41 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-09-13T06:25:47.085 INFO:teuthology.orchestra.run.smithi139.stdout:Get:42 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-09-13T06:25:47.162 INFO:teuthology.orchestra.run.smithi139.stdout:Get:43 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-09-13T06:25:47.180 INFO:teuthology.orchestra.run.smithi139.stdout:Get:44 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [228 B] 2024-09-13T06:25:48.880 INFO:teuthology.orchestra.run.smithi081.stdout:Hit:18 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-13T06:25:48.961 INFO:teuthology.orchestra.run.smithi081.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [128 kB] 2024-09-13T06:25:49.322 INFO:teuthology.orchestra.run.smithi081.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [127 kB] 2024-09-13T06:25:49.459 INFO:teuthology.orchestra.run.smithi081.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [2,022 kB] 2024-09-13T06:25:49.855 INFO:teuthology.orchestra.run.smithi081.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [696 kB] 2024-09-13T06:25:49.956 INFO:teuthology.orchestra.run.smithi081.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [352 kB] 2024-09-13T06:25:50.047 INFO:teuthology.orchestra.run.smithi081.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [17.8 kB] 2024-09-13T06:25:50.129 INFO:teuthology.orchestra.run.smithi081.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [39.3 kB] 2024-09-13T06:25:50.212 INFO:teuthology.orchestra.run.smithi081.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [2,437 kB] 2024-09-13T06:25:50.360 INFO:teuthology.orchestra.run.smithi081.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [419 kB] 2024-09-13T06:25:50.450 INFO:teuthology.orchestra.run.smithi081.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [616 B] 2024-09-13T06:25:50.532 INFO:teuthology.orchestra.run.smithi081.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [732 kB] 2024-09-13T06:25:50.629 INFO:teuthology.orchestra.run.smithi081.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,124 kB] 2024-09-13T06:25:50.734 INFO:teuthology.orchestra.run.smithi081.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [261 kB] 2024-09-13T06:25:50.822 INFO:teuthology.orchestra.run.smithi081.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [26.1 kB] 2024-09-13T06:25:51.032 INFO:teuthology.orchestra.run.smithi081.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [43.3 kB] 2024-09-13T06:25:51.115 INFO:teuthology.orchestra.run.smithi081.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,752 B] 2024-09-13T06:25:51.197 INFO:teuthology.orchestra.run.smithi081.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.8 kB] 2024-09-13T06:25:51.280 INFO:teuthology.orchestra.run.smithi081.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [444 B] 2024-09-13T06:25:51.362 INFO:teuthology.orchestra.run.smithi081.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.8 kB] 2024-09-13T06:25:51.445 INFO:teuthology.orchestra.run.smithi081.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.9 kB] 2024-09-13T06:25:51.528 INFO:teuthology.orchestra.run.smithi081.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.1 kB] 2024-09-13T06:25:51.611 INFO:teuthology.orchestra.run.smithi081.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-09-13T06:25:51.693 INFO:teuthology.orchestra.run.smithi081.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [17.3 kB] 2024-09-13T06:25:51.775 INFO:teuthology.orchestra.run.smithi081.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [28.8 kB] 2024-09-13T06:25:51.858 INFO:teuthology.orchestra.run.smithi081.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.5 kB] 2024-09-13T06:25:51.940 INFO:teuthology.orchestra.run.smithi081.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [672 B] 2024-09-13T06:25:52.615 INFO:teuthology.orchestra.run.smithi139.stdout:Fetched 16.0 MB in 36s (441 kB/s) 2024-09-13T06:25:54.060 INFO:teuthology.orchestra.run.smithi139.stdout:Reading package lists... 2024-09-13T06:25:54.078 DEBUG:teuthology.orchestra.run.smithi139:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-13T06:25:54.143 INFO:teuthology.orchestra.run.smithi139.stdout:Reading package lists... 2024-09-13T06:25:54.353 INFO:teuthology.orchestra.run.smithi139.stdout:Building dependency tree... 2024-09-13T06:25:54.354 INFO:teuthology.orchestra.run.smithi139.stdout:Reading state information... 2024-09-13T06:25:54.542 INFO:teuthology.orchestra.run.smithi139.stdout:The following packages were automatically installed and are no longer required: 2024-09-13T06:25:54.542 INFO:teuthology.orchestra.run.smithi139.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-13T06:25:54.542 INFO:teuthology.orchestra.run.smithi139.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-13T06:25:54.542 INFO:teuthology.orchestra.run.smithi139.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-13T06:25:54.543 INFO:teuthology.orchestra.run.smithi139.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-09-13T06:25:54.543 INFO:teuthology.orchestra.run.smithi139.stdout: python2.7-minimal 2024-09-13T06:25:54.543 INFO:teuthology.orchestra.run.smithi139.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-13T06:25:54.544 INFO:teuthology.orchestra.run.smithi139.stdout:The following additional packages will be installed: 2024-09-13T06:25:54.544 INFO:teuthology.orchestra.run.smithi139.stdout: linux-generic linux-headers-5.15.0-121 linux-headers-5.15.0-121-generic 2024-09-13T06:25:54.544 INFO:teuthology.orchestra.run.smithi139.stdout: linux-headers-generic linux-image-5.15.0-121-generic 2024-09-13T06:25:54.545 INFO:teuthology.orchestra.run.smithi139.stdout: linux-modules-5.15.0-121-generic linux-modules-extra-5.15.0-121-generic 2024-09-13T06:25:54.546 INFO:teuthology.orchestra.run.smithi139.stdout:Suggested packages: 2024-09-13T06:25:54.546 INFO:teuthology.orchestra.run.smithi139.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-09-13T06:25:54.546 INFO:teuthology.orchestra.run.smithi139.stdout:Recommended packages: 2024-09-13T06:25:54.546 INFO:teuthology.orchestra.run.smithi139.stdout: thermald 2024-09-13T06:25:54.592 INFO:teuthology.orchestra.run.smithi139.stdout:The following NEW packages will be installed: 2024-09-13T06:25:54.592 INFO:teuthology.orchestra.run.smithi139.stdout: linux-headers-5.15.0-121 linux-headers-5.15.0-121-generic 2024-09-13T06:25:54.593 INFO:teuthology.orchestra.run.smithi139.stdout: linux-image-5.15.0-121-generic linux-modules-5.15.0-121-generic 2024-09-13T06:25:54.593 INFO:teuthology.orchestra.run.smithi139.stdout: linux-modules-extra-5.15.0-121-generic 2024-09-13T06:25:54.594 INFO:teuthology.orchestra.run.smithi139.stdout:The following packages will be upgraded: 2024-09-13T06:25:54.594 INFO:teuthology.orchestra.run.smithi139.stdout: linux-generic linux-headers-generic linux-image-generic 2024-09-13T06:25:56.446 INFO:teuthology.orchestra.run.smithi081.stdout:Fetched 16.0 MB in 41s (393 kB/s) 2024-09-13T06:25:58.379 INFO:teuthology.orchestra.run.smithi081.stdout:Reading package lists... 2024-09-13T06:25:58.398 DEBUG:teuthology.orchestra.run.smithi081:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-13T06:25:58.464 INFO:teuthology.orchestra.run.smithi081.stdout:Reading package lists... 2024-09-13T06:25:58.650 INFO:teuthology.orchestra.run.smithi081.stdout:Building dependency tree... 2024-09-13T06:25:58.650 INFO:teuthology.orchestra.run.smithi081.stdout:Reading state information... 2024-09-13T06:25:58.816 INFO:teuthology.orchestra.run.smithi081.stdout:The following packages were automatically installed and are no longer required: 2024-09-13T06:25:58.816 INFO:teuthology.orchestra.run.smithi081.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-13T06:25:58.817 INFO:teuthology.orchestra.run.smithi081.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-13T06:25:58.817 INFO:teuthology.orchestra.run.smithi081.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-13T06:25:58.817 INFO:teuthology.orchestra.run.smithi081.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-09-13T06:25:58.817 INFO:teuthology.orchestra.run.smithi081.stdout: python2.7-minimal 2024-09-13T06:25:58.817 INFO:teuthology.orchestra.run.smithi081.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-13T06:25:58.818 INFO:teuthology.orchestra.run.smithi081.stdout:The following additional packages will be installed: 2024-09-13T06:25:58.818 INFO:teuthology.orchestra.run.smithi081.stdout: linux-generic linux-headers-5.15.0-121 linux-headers-5.15.0-121-generic 2024-09-13T06:25:58.818 INFO:teuthology.orchestra.run.smithi081.stdout: linux-headers-generic linux-image-5.15.0-121-generic 2024-09-13T06:25:58.819 INFO:teuthology.orchestra.run.smithi081.stdout: linux-modules-5.15.0-121-generic linux-modules-extra-5.15.0-121-generic 2024-09-13T06:25:58.820 INFO:teuthology.orchestra.run.smithi081.stdout:Suggested packages: 2024-09-13T06:25:58.820 INFO:teuthology.orchestra.run.smithi081.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-09-13T06:25:58.820 INFO:teuthology.orchestra.run.smithi081.stdout:Recommended packages: 2024-09-13T06:25:58.820 INFO:teuthology.orchestra.run.smithi081.stdout: thermald 2024-09-13T06:25:58.869 INFO:teuthology.orchestra.run.smithi081.stdout:The following NEW packages will be installed: 2024-09-13T06:25:58.869 INFO:teuthology.orchestra.run.smithi081.stdout: linux-headers-5.15.0-121 linux-headers-5.15.0-121-generic 2024-09-13T06:25:58.869 INFO:teuthology.orchestra.run.smithi081.stdout: linux-image-5.15.0-121-generic linux-modules-5.15.0-121-generic 2024-09-13T06:25:58.870 INFO:teuthology.orchestra.run.smithi081.stdout: linux-modules-extra-5.15.0-121-generic 2024-09-13T06:25:58.872 INFO:teuthology.orchestra.run.smithi081.stdout:The following packages will be upgraded: 2024-09-13T06:25:58.872 INFO:teuthology.orchestra.run.smithi081.stdout: linux-generic linux-headers-generic linux-image-generic 2024-09-13T06:26:03.757 INFO:teuthology.orchestra.run.smithi081.stdout:3 upgraded, 5 newly installed, 0 to remove and 344 not upgraded. 2024-09-13T06:26:03.757 INFO:teuthology.orchestra.run.smithi081.stdout:Need to get 113 MB of archives. 2024-09-13T06:26:03.757 INFO:teuthology.orchestra.run.smithi081.stdout:After this operation, 584 MB of additional disk space will be used. 2024-09-13T06:26:03.757 INFO:teuthology.orchestra.run.smithi081.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-121-generic amd64 5.15.0-121.131 [22.7 MB] 2024-09-13T06:26:05.175 INFO:teuthology.orchestra.run.smithi081.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-121-generic amd64 5.15.0-121.131 [11.5 MB] 2024-09-13T06:26:05.527 INFO:teuthology.orchestra.run.smithi081.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-121-generic amd64 5.15.0-121.131 [63.9 MB] 2024-09-13T06:26:07.834 INFO:teuthology.orchestra.run.smithi081.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.121.121 [1,694 B] 2024-09-13T06:26:07.845 INFO:teuthology.orchestra.run.smithi081.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.121.121 [2,464 B] 2024-09-13T06:26:07.850 INFO:teuthology.orchestra.run.smithi081.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-121 all 5.15.0-121.131 [12.3 MB] 2024-09-13T06:26:08.195 INFO:teuthology.orchestra.run.smithi081.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-121-generic amd64 5.15.0-121.131 [2,827 kB] 2024-09-13T06:26:08.277 INFO:teuthology.orchestra.run.smithi081.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.121.121 [2,316 B] 2024-09-13T06:26:08.690 INFO:teuthology.orchestra.run.smithi081.stdout:Fetched 113 MB in 9s (12.1 MB/s) 2024-09-13T06:26:08.859 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package linux-modules-5.15.0-121-generic. 2024-09-13T06:26:10.912 INFO:teuthology.orchestra.run.smithi081.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-09-13T06:26:10.917 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../0-linux-modules-5.15.0-121-generic_5.15.0-121.131_amd64.deb ... 2024-09-13T06:26:10.981 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking linux-modules-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-13T06:26:11.640 INFO:teuthology.orchestra.run.smithi139.stdout:3 upgraded, 5 newly installed, 0 to remove and 344 not upgraded. 2024-09-13T06:26:11.641 INFO:teuthology.orchestra.run.smithi139.stdout:Need to get 113 MB of archives. 2024-09-13T06:26:11.641 INFO:teuthology.orchestra.run.smithi139.stdout:After this operation, 584 MB of additional disk space will be used. 2024-09-13T06:26:11.641 INFO:teuthology.orchestra.run.smithi139.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-121-generic amd64 5.15.0-121.131 [22.7 MB] 2024-09-13T06:26:12.596 INFO:teuthology.orchestra.run.smithi139.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-121-generic amd64 5.15.0-121.131 [11.5 MB] 2024-09-13T06:26:12.686 INFO:teuthology.orchestra.run.smithi139.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-121-generic amd64 5.15.0-121.131 [63.9 MB] 2024-09-13T06:26:13.075 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package linux-image-5.15.0-121-generic. 2024-09-13T06:26:13.096 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../1-linux-image-5.15.0-121-generic_5.15.0-121.131_amd64.deb ... 2024-09-13T06:26:13.190 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking linux-image-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-13T06:26:13.502 INFO:teuthology.orchestra.run.smithi139.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.121.121 [1,694 B] 2024-09-13T06:26:13.502 INFO:teuthology.orchestra.run.smithi139.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.121.121 [2,464 B] 2024-09-13T06:26:13.502 INFO:teuthology.orchestra.run.smithi139.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-121 all 5.15.0-121.131 [12.3 MB] 2024-09-13T06:26:13.578 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-121-generic. 2024-09-13T06:26:13.598 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-121-generic_5.15.0-121.131_amd64.deb ... 2024-09-13T06:26:13.626 INFO:teuthology.orchestra.run.smithi139.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-121-generic amd64 5.15.0-121.131 [2,827 kB] 2024-09-13T06:26:13.627 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking linux-modules-extra-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-13T06:26:13.739 INFO:teuthology.orchestra.run.smithi139.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.121.121 [2,316 B] 2024-09-13T06:26:14.144 INFO:teuthology.orchestra.run.smithi139.stdout:Fetched 113 MB in 19s (5,919 kB/s) 2024-09-13T06:26:14.311 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package linux-modules-5.15.0-121-generic. 2024-09-13T06:26:16.275 INFO:teuthology.orchestra.run.smithi139.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-09-13T06:26:16.279 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../0-linux-modules-5.15.0-121-generic_5.15.0-121.131_amd64.deb ... 2024-09-13T06:26:16.416 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking linux-modules-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-13T06:26:19.960 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package linux-image-5.15.0-121-generic. 2024-09-13T06:26:19.981 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../1-linux-image-5.15.0-121-generic_5.15.0-121.131_amd64.deb ... 2024-09-13T06:26:20.063 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../3-linux-generic_5.15.0.121.121_amd64.deb ... 2024-09-13T06:26:20.086 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking linux-image-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-13T06:26:20.190 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking linux-generic (5.15.0.121.121) over (5.15.0.56.54) ... 2024-09-13T06:26:20.489 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.121.121_amd64.deb ... 2024-09-13T06:26:20.570 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-121-generic. 2024-09-13T06:26:20.586 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking linux-image-generic (5.15.0.121.121) over (5.15.0.56.54) ... 2024-09-13T06:26:20.591 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-121-generic_5.15.0-121.131_amd64.deb ... 2024-09-13T06:26:20.628 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking linux-modules-extra-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-13T06:26:20.905 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package linux-headers-5.15.0-121. 2024-09-13T06:26:20.927 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../5-linux-headers-5.15.0-121_5.15.0-121.131_all.deb ... 2024-09-13T06:26:20.972 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking linux-headers-5.15.0-121 (5.15.0-121.131) ... 2024-09-13T06:26:26.921 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package linux-headers-5.15.0-121-generic. 2024-09-13T06:26:26.959 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../6-linux-headers-5.15.0-121-generic_5.15.0-121.131_amd64.deb ... 2024-09-13T06:26:26.996 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking linux-headers-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-13T06:26:28.210 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../3-linux-generic_5.15.0.121.121_amd64.deb ... 2024-09-13T06:26:28.363 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking linux-generic (5.15.0.121.121) over (5.15.0.56.54) ... 2024-09-13T06:26:28.721 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.121.121_amd64.deb ... 2024-09-13T06:26:28.850 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking linux-image-generic (5.15.0.121.121) over (5.15.0.56.54) ... 2024-09-13T06:26:29.170 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package linux-headers-5.15.0-121. 2024-09-13T06:26:29.192 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../5-linux-headers-5.15.0-121_5.15.0-121.131_all.deb ... 2024-09-13T06:26:29.228 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking linux-headers-5.15.0-121 (5.15.0-121.131) ... 2024-09-13T06:26:29.575 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.121.121_amd64.deb ... 2024-09-13T06:26:29.701 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking linux-headers-generic (5.15.0.121.121) over (5.15.0.56.54) ... 2024-09-13T06:26:30.035 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up linux-headers-5.15.0-121 (5.15.0-121.131) ... 2024-09-13T06:26:30.156 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up linux-headers-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-13T06:26:30.282 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up linux-headers-generic (5.15.0.121.121) ... 2024-09-13T06:26:30.410 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up linux-image-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-13T06:26:31.728 INFO:teuthology.orchestra.run.smithi081.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-09-13T06:26:31.728 INFO:teuthology.orchestra.run.smithi081.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-09-13T06:26:31.728 INFO:teuthology.orchestra.run.smithi081.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-121-generic 2024-09-13T06:26:31.728 INFO:teuthology.orchestra.run.smithi081.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-121-generic 2024-09-13T06:26:31.897 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up linux-modules-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-13T06:26:33.281 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up linux-modules-extra-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-13T06:26:34.899 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up linux-image-generic (5.15.0.121.121) ... 2024-09-13T06:26:34.982 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package linux-headers-5.15.0-121-generic. 2024-09-13T06:26:35.021 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../6-linux-headers-5.15.0-121-generic_5.15.0-121.131_amd64.deb ... 2024-09-13T06:26:35.025 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up linux-generic (5.15.0.121.121) ... 2024-09-13T06:26:35.151 INFO:teuthology.orchestra.run.smithi081.stdout:Processing triggers for linux-image-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-13T06:26:35.216 INFO:teuthology.orchestra.run.smithi081.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-09-13T06:26:35.217 INFO:teuthology.orchestra.run.smithi081.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-121-generic 2024-09-13T06:26:35.482 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking linux-headers-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-13T06:26:38.167 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.121.121_amd64.deb ... 2024-09-13T06:26:38.292 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking linux-headers-generic (5.15.0.121.121) over (5.15.0.56.54) ... 2024-09-13T06:26:38.641 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up linux-headers-5.15.0-121 (5.15.0-121.131) ... 2024-09-13T06:26:38.746 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up linux-headers-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-13T06:26:38.872 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up linux-headers-generic (5.15.0.121.121) ... 2024-09-13T06:26:39.025 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up linux-image-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-13T06:26:40.364 INFO:teuthology.orchestra.run.smithi139.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-09-13T06:26:40.364 INFO:teuthology.orchestra.run.smithi139.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-09-13T06:26:40.364 INFO:teuthology.orchestra.run.smithi139.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-121-generic 2024-09-13T06:26:40.364 INFO:teuthology.orchestra.run.smithi139.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-121-generic 2024-09-13T06:26:40.537 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up linux-modules-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-13T06:26:41.945 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up linux-modules-extra-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-13T06:26:43.313 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up linux-image-generic (5.15.0.121.121) ... 2024-09-13T06:26:43.473 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up linux-generic (5.15.0.121.121) ... 2024-09-13T06:26:43.599 INFO:teuthology.orchestra.run.smithi139.stdout:Processing triggers for linux-image-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-13T06:26:43.660 INFO:teuthology.orchestra.run.smithi139.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-09-13T06:26:43.660 INFO:teuthology.orchestra.run.smithi139.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-121-generic 2024-09-13T06:26:48.971 INFO:teuthology.orchestra.run.smithi081.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-09-13T06:26:48.971 INFO:teuthology.orchestra.run.smithi081.stdout:Sourcing file `/etc/default/grub' 2024-09-13T06:26:48.978 INFO:teuthology.orchestra.run.smithi081.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-13T06:26:48.993 INFO:teuthology.orchestra.run.smithi081.stdout:Generating grub configuration file ... 2024-09-13T06:26:49.376 INFO:teuthology.orchestra.run.smithi081.stdout:Found linux image: /boot/vmlinuz-5.15.0-121-generic 2024-09-13T06:26:49.397 INFO:teuthology.orchestra.run.smithi081.stdout:Found initrd image: /boot/initrd.img-5.15.0-121-generic 2024-09-13T06:26:49.817 INFO:teuthology.orchestra.run.smithi081.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-13T06:26:49.823 INFO:teuthology.orchestra.run.smithi081.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-13T06:26:49.888 INFO:teuthology.orchestra.run.smithi081.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-13T06:26:49.894 INFO:teuthology.orchestra.run.smithi081.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-13T06:26:50.073 INFO:teuthology.orchestra.run.smithi081.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-13T06:26:50.073 INFO:teuthology.orchestra.run.smithi081.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-09-13T06:26:50.074 INFO:teuthology.orchestra.run.smithi081.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-13T06:26:50.111 INFO:teuthology.orchestra.run.smithi081.stdout:done 2024-09-13T06:26:50.582 DEBUG:teuthology.orchestra.run.smithi081:> dpkg -s linux-image-generic 2024-09-13T06:26:50.607 INFO:teuthology.orchestra.run.smithi081.stdout:Package: linux-image-generic 2024-09-13T06:26:50.607 INFO:teuthology.orchestra.run.smithi081.stdout:Status: install ok installed 2024-09-13T06:26:50.607 INFO:teuthology.orchestra.run.smithi081.stdout:Priority: optional 2024-09-13T06:26:50.607 INFO:teuthology.orchestra.run.smithi081.stdout:Section: kernel 2024-09-13T06:26:50.607 INFO:teuthology.orchestra.run.smithi081.stdout:Installed-Size: 21 2024-09-13T06:26:50.607 INFO:teuthology.orchestra.run.smithi081.stdout:Maintainer: Ubuntu Kernel Team 2024-09-13T06:26:50.607 INFO:teuthology.orchestra.run.smithi081.stdout:Architecture: amd64 2024-09-13T06:26:50.607 INFO:teuthology.orchestra.run.smithi081.stdout:Source: linux-meta 2024-09-13T06:26:50.608 INFO:teuthology.orchestra.run.smithi081.stdout:Version: 5.15.0.121.121 2024-09-13T06:26:50.608 INFO:teuthology.orchestra.run.smithi081.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-121), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-13T06:26:50.608 INFO:teuthology.orchestra.run.smithi081.stdout:Depends: linux-image-5.15.0-121-generic, linux-modules-extra-5.15.0-121-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-13T06:26:50.608 INFO:teuthology.orchestra.run.smithi081.stdout:Recommends: thermald 2024-09-13T06:26:50.608 INFO:teuthology.orchestra.run.smithi081.stdout:Description: Generic Linux kernel image 2024-09-13T06:26:50.608 INFO:teuthology.orchestra.run.smithi081.stdout: This package will always depend on the latest generic kernel image 2024-09-13T06:26:50.608 INFO:teuthology.orchestra.run.smithi081.stdout: available. 2024-09-13T06:26:50.608 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-121-generic 2024-09-13T06:26:50.609 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-13T06:26:50.609 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-13T06:26:50.609 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-09-13T06:26:50.609 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi081.front.sepia.ceph.com, path=None, version=distro) 2024-09-13T06:26:50.609 DEBUG:teuthology.orchestra.run.smithi081:> sudo apt-get clean 2024-09-13T06:26:50.747 DEBUG:teuthology.orchestra.run.smithi081:> sudo apt-get update 2024-09-13T06:26:51.454 INFO:teuthology.orchestra.run.smithi081.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-13T06:26:51.785 INFO:teuthology.orchestra.run.smithi081.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-13T06:26:51.866 INFO:teuthology.orchestra.run.smithi081.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-13T06:26:51.948 INFO:teuthology.orchestra.run.smithi081.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-13T06:26:53.157 INFO:teuthology.orchestra.run.smithi081.stdout:Reading package lists... 2024-09-13T06:26:53.176 DEBUG:teuthology.orchestra.run.smithi081:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-13T06:26:53.237 INFO:teuthology.orchestra.run.smithi081.stdout:Reading package lists... 2024-09-13T06:26:53.447 INFO:teuthology.orchestra.run.smithi081.stdout:Building dependency tree... 2024-09-13T06:26:53.478 INFO:teuthology.orchestra.run.smithi081.stdout:Reading state information... 2024-09-13T06:26:53.633 INFO:teuthology.orchestra.run.smithi081.stdout:linux-image-generic is already the newest version (5.15.0.121.121). 2024-09-13T06:26:53.633 INFO:teuthology.orchestra.run.smithi081.stdout:The following packages were automatically installed and are no longer required: 2024-09-13T06:26:53.633 INFO:teuthology.orchestra.run.smithi081.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-13T06:26:53.633 INFO:teuthology.orchestra.run.smithi081.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-13T06:26:53.633 INFO:teuthology.orchestra.run.smithi081.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-13T06:26:53.634 INFO:teuthology.orchestra.run.smithi081.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-13T06:26:53.634 INFO:teuthology.orchestra.run.smithi081.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-13T06:26:53.634 INFO:teuthology.orchestra.run.smithi081.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-13T06:26:53.672 INFO:teuthology.orchestra.run.smithi081.stdout:0 upgraded, 0 newly installed, 0 to remove and 344 not upgraded. 2024-09-13T06:26:53.674 DEBUG:teuthology.orchestra.run.smithi081:> dpkg -s linux-image-generic 2024-09-13T06:26:53.689 INFO:teuthology.orchestra.run.smithi081.stdout:Package: linux-image-generic 2024-09-13T06:26:53.689 INFO:teuthology.orchestra.run.smithi081.stdout:Status: install ok installed 2024-09-13T06:26:53.689 INFO:teuthology.orchestra.run.smithi081.stdout:Priority: optional 2024-09-13T06:26:53.689 INFO:teuthology.orchestra.run.smithi081.stdout:Section: kernel 2024-09-13T06:26:53.689 INFO:teuthology.orchestra.run.smithi081.stdout:Installed-Size: 21 2024-09-13T06:26:53.689 INFO:teuthology.orchestra.run.smithi081.stdout:Maintainer: Ubuntu Kernel Team 2024-09-13T06:26:53.689 INFO:teuthology.orchestra.run.smithi081.stdout:Architecture: amd64 2024-09-13T06:26:53.689 INFO:teuthology.orchestra.run.smithi081.stdout:Source: linux-meta 2024-09-13T06:26:53.690 INFO:teuthology.orchestra.run.smithi081.stdout:Version: 5.15.0.121.121 2024-09-13T06:26:53.690 INFO:teuthology.orchestra.run.smithi081.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-121), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-13T06:26:53.690 INFO:teuthology.orchestra.run.smithi081.stdout:Depends: linux-image-5.15.0-121-generic, linux-modules-extra-5.15.0-121-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-13T06:26:53.690 INFO:teuthology.orchestra.run.smithi081.stdout:Recommends: thermald 2024-09-13T06:26:53.690 INFO:teuthology.orchestra.run.smithi081.stdout:Description: Generic Linux kernel image 2024-09-13T06:26:53.690 INFO:teuthology.orchestra.run.smithi081.stdout: This package will always depend on the latest generic kernel image 2024-09-13T06:26:53.690 INFO:teuthology.orchestra.run.smithi081.stdout: available. 2024-09-13T06:26:53.691 DEBUG:teuthology.orchestra.run.smithi081:> mktemp 2024-09-13T06:26:53.740 INFO:teuthology.orchestra.run.smithi081.stdout:/tmp/tmp.KYUqORBPhX 2024-09-13T06:26:53.740 DEBUG:teuthology.orchestra.run.smithi081:> sudo cp /boot/grub/grub.cfg /tmp/tmp.KYUqORBPhX 2024-09-13T06:26:53.796 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod 0666 /tmp/tmp.KYUqORBPhX 2024-09-13T06:26:53.920 DEBUG:teuthology.orchestra.remote:smithi081:/tmp/tmp.KYUqORBPhX is 10KB 2024-09-13T06:26:53.934 DEBUG:teuthology.orchestra.run.smithi081:> rm -fr /tmp/tmp.KYUqORBPhX 2024-09-13T06:26:53.939 DEBUG:teuthology.orchestra.run.smithi081:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-09-13T06:26:53.992 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-13T06:26:53.993 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-09-13T06:26:53.993 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-09-13T06:26:54.069 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-121-generic 2024-09-13T06:26:54.069 DEBUG:teuthology.orchestra.run.smithi081:> sudo update-grub 2024-09-13T06:26:55.305 INFO:teuthology.orchestra.run.smithi081.stderr:Sourcing file `/etc/default/grub' 2024-09-13T06:26:55.306 INFO:teuthology.orchestra.run.smithi081.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-13T06:26:55.307 INFO:teuthology.orchestra.run.smithi081.stderr:Generating grub configuration file ... 2024-09-13T06:26:55.564 INFO:teuthology.orchestra.run.smithi081.stderr:Found linux image: /boot/vmlinuz-5.15.0-121-generic 2024-09-13T06:26:55.570 INFO:teuthology.orchestra.run.smithi081.stderr:Found initrd image: /boot/initrd.img-5.15.0-121-generic 2024-09-13T06:26:55.841 INFO:teuthology.orchestra.run.smithi081.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-13T06:26:55.846 INFO:teuthology.orchestra.run.smithi081.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-13T06:26:55.886 INFO:teuthology.orchestra.run.smithi081.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-13T06:26:55.892 INFO:teuthology.orchestra.run.smithi081.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-13T06:26:56.003 INFO:teuthology.orchestra.run.smithi081.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-13T06:26:56.004 INFO:teuthology.orchestra.run.smithi081.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-09-13T06:26:56.004 INFO:teuthology.orchestra.run.smithi081.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-13T06:26:56.015 INFO:teuthology.orchestra.run.smithi081.stderr:done 2024-09-13T06:26:56.028 DEBUG:teuthology.orchestra.run.smithi081:> sudo shutdown -r now 2024-09-13T06:26:57.305 INFO:teuthology.orchestra.run.smithi139.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-09-13T06:26:57.305 INFO:teuthology.orchestra.run.smithi139.stdout:Sourcing file `/etc/default/grub' 2024-09-13T06:26:57.338 INFO:teuthology.orchestra.run.smithi139.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-13T06:26:57.358 INFO:teuthology.orchestra.run.smithi139.stdout:Generating grub configuration file ... 2024-09-13T06:26:57.657 INFO:teuthology.orchestra.run.smithi139.stdout:Found linux image: /boot/vmlinuz-5.15.0-121-generic 2024-09-13T06:26:57.673 INFO:teuthology.orchestra.run.smithi139.stdout:Found initrd image: /boot/initrd.img-5.15.0-121-generic 2024-09-13T06:26:58.000 INFO:teuthology.orchestra.run.smithi139.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-13T06:26:58.008 INFO:teuthology.orchestra.run.smithi139.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-13T06:26:58.073 INFO:teuthology.orchestra.run.smithi139.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-13T06:26:58.079 INFO:teuthology.orchestra.run.smithi139.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-13T06:26:58.239 INFO:teuthology.orchestra.run.smithi139.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-13T06:26:58.239 INFO:teuthology.orchestra.run.smithi139.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-09-13T06:26:58.240 INFO:teuthology.orchestra.run.smithi139.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-13T06:26:58.288 INFO:teuthology.orchestra.run.smithi139.stdout:done 2024-09-13T06:26:58.805 DEBUG:teuthology.orchestra.run.smithi139:> dpkg -s linux-image-generic 2024-09-13T06:26:58.833 INFO:teuthology.orchestra.run.smithi139.stdout:Package: linux-image-generic 2024-09-13T06:26:58.833 INFO:teuthology.orchestra.run.smithi139.stdout:Status: install ok installed 2024-09-13T06:26:58.833 INFO:teuthology.orchestra.run.smithi139.stdout:Priority: optional 2024-09-13T06:26:58.833 INFO:teuthology.orchestra.run.smithi139.stdout:Section: kernel 2024-09-13T06:26:58.833 INFO:teuthology.orchestra.run.smithi139.stdout:Installed-Size: 21 2024-09-13T06:26:58.834 INFO:teuthology.orchestra.run.smithi139.stdout:Maintainer: Ubuntu Kernel Team 2024-09-13T06:26:58.834 INFO:teuthology.orchestra.run.smithi139.stdout:Architecture: amd64 2024-09-13T06:26:58.834 INFO:teuthology.orchestra.run.smithi139.stdout:Source: linux-meta 2024-09-13T06:26:58.834 INFO:teuthology.orchestra.run.smithi139.stdout:Version: 5.15.0.121.121 2024-09-13T06:26:58.834 INFO:teuthology.orchestra.run.smithi139.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-121), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-13T06:26:58.834 INFO:teuthology.orchestra.run.smithi139.stdout:Depends: linux-image-5.15.0-121-generic, linux-modules-extra-5.15.0-121-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-13T06:26:58.834 INFO:teuthology.orchestra.run.smithi139.stdout:Recommends: thermald 2024-09-13T06:26:58.834 INFO:teuthology.orchestra.run.smithi139.stdout:Description: Generic Linux kernel image 2024-09-13T06:26:58.834 INFO:teuthology.orchestra.run.smithi139.stdout: This package will always depend on the latest generic kernel image 2024-09-13T06:26:58.834 INFO:teuthology.orchestra.run.smithi139.stdout: available. 2024-09-13T06:26:58.834 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-121-generic 2024-09-13T06:26:58.835 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-13T06:26:58.835 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-13T06:26:58.835 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2024-09-13T06:26:58.835 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi139.front.sepia.ceph.com, path=None, version=distro) 2024-09-13T06:26:58.835 DEBUG:teuthology.orchestra.run.smithi139:> sudo apt-get clean 2024-09-13T06:26:58.969 DEBUG:teuthology.orchestra.run.smithi139:> sudo apt-get update 2024-09-13T06:26:59.384 INFO:teuthology.orchestra.run.smithi139.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-13T06:26:59.459 INFO:teuthology.orchestra.run.smithi139.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-13T06:26:59.541 INFO:teuthology.orchestra.run.smithi139.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-13T06:26:59.847 INFO:teuthology.orchestra.run.smithi139.stdout:Hit:4 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-13T06:27:01.049 INFO:teuthology.orchestra.run.smithi139.stdout:Reading package lists... 2024-09-13T06:27:01.069 DEBUG:teuthology.orchestra.run.smithi139:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-13T06:27:01.122 INFO:teuthology.orchestra.run.smithi139.stdout:Reading package lists... 2024-09-13T06:27:01.309 INFO:teuthology.orchestra.run.smithi139.stdout:Building dependency tree... 2024-09-13T06:27:01.310 INFO:teuthology.orchestra.run.smithi139.stdout:Reading state information... 2024-09-13T06:27:01.480 INFO:teuthology.orchestra.run.smithi139.stdout:linux-image-generic is already the newest version (5.15.0.121.121). 2024-09-13T06:27:01.480 INFO:teuthology.orchestra.run.smithi139.stdout:The following packages were automatically installed and are no longer required: 2024-09-13T06:27:01.480 INFO:teuthology.orchestra.run.smithi139.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-13T06:27:01.480 INFO:teuthology.orchestra.run.smithi139.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-13T06:27:01.480 INFO:teuthology.orchestra.run.smithi139.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-13T06:27:01.481 INFO:teuthology.orchestra.run.smithi139.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-13T06:27:01.481 INFO:teuthology.orchestra.run.smithi139.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-13T06:27:01.481 INFO:teuthology.orchestra.run.smithi139.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-13T06:27:01.522 INFO:teuthology.orchestra.run.smithi139.stdout:0 upgraded, 0 newly installed, 0 to remove and 344 not upgraded. 2024-09-13T06:27:01.523 DEBUG:teuthology.orchestra.run.smithi139:> dpkg -s linux-image-generic 2024-09-13T06:27:01.580 INFO:teuthology.orchestra.run.smithi139.stdout:Package: linux-image-generic 2024-09-13T06:27:01.580 INFO:teuthology.orchestra.run.smithi139.stdout:Status: install ok installed 2024-09-13T06:27:01.580 INFO:teuthology.orchestra.run.smithi139.stdout:Priority: optional 2024-09-13T06:27:01.580 INFO:teuthology.orchestra.run.smithi139.stdout:Section: kernel 2024-09-13T06:27:01.580 INFO:teuthology.orchestra.run.smithi139.stdout:Installed-Size: 21 2024-09-13T06:27:01.580 INFO:teuthology.orchestra.run.smithi139.stdout:Maintainer: Ubuntu Kernel Team 2024-09-13T06:27:01.580 INFO:teuthology.orchestra.run.smithi139.stdout:Architecture: amd64 2024-09-13T06:27:01.580 INFO:teuthology.orchestra.run.smithi139.stdout:Source: linux-meta 2024-09-13T06:27:01.581 INFO:teuthology.orchestra.run.smithi139.stdout:Version: 5.15.0.121.121 2024-09-13T06:27:01.581 INFO:teuthology.orchestra.run.smithi139.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-121), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-13T06:27:01.581 INFO:teuthology.orchestra.run.smithi139.stdout:Depends: linux-image-5.15.0-121-generic, linux-modules-extra-5.15.0-121-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-13T06:27:01.581 INFO:teuthology.orchestra.run.smithi139.stdout:Recommends: thermald 2024-09-13T06:27:01.581 INFO:teuthology.orchestra.run.smithi139.stdout:Description: Generic Linux kernel image 2024-09-13T06:27:01.581 INFO:teuthology.orchestra.run.smithi139.stdout: This package will always depend on the latest generic kernel image 2024-09-13T06:27:01.581 INFO:teuthology.orchestra.run.smithi139.stdout: available. 2024-09-13T06:27:01.581 DEBUG:teuthology.orchestra.run.smithi139:> mktemp 2024-09-13T06:27:01.625 INFO:teuthology.orchestra.run.smithi139.stdout:/tmp/tmp.Eafj4x9qyM 2024-09-13T06:27:01.626 DEBUG:teuthology.orchestra.run.smithi139:> sudo cp /boot/grub/grub.cfg /tmp/tmp.Eafj4x9qyM 2024-09-13T06:27:01.699 DEBUG:teuthology.orchestra.run.smithi139:> sudo chmod 0666 /tmp/tmp.Eafj4x9qyM 2024-09-13T06:27:01.824 DEBUG:teuthology.orchestra.remote:smithi139:/tmp/tmp.Eafj4x9qyM is 10KB 2024-09-13T06:27:01.837 DEBUG:teuthology.orchestra.run.smithi139:> rm -fr /tmp/tmp.Eafj4x9qyM 2024-09-13T06:27:01.843 DEBUG:teuthology.orchestra.run.smithi139:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-09-13T06:27:01.898 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2024-09-13T06:27:01.898 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-09-13T06:27:01.898 DEBUG:teuthology.orchestra.run.smithi139:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-09-13T06:27:01.984 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-121-generic 2024-09-13T06:27:01.984 DEBUG:teuthology.orchestra.run.smithi139:> sudo update-grub 2024-09-13T06:27:03.342 INFO:teuthology.orchestra.run.smithi139.stderr:Sourcing file `/etc/default/grub' 2024-09-13T06:27:03.343 INFO:teuthology.orchestra.run.smithi139.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-13T06:27:03.357 INFO:teuthology.orchestra.run.smithi139.stderr:Generating grub configuration file ... 2024-09-13T06:27:03.590 INFO:teuthology.orchestra.run.smithi139.stderr:Found linux image: /boot/vmlinuz-5.15.0-121-generic 2024-09-13T06:27:03.595 INFO:teuthology.orchestra.run.smithi139.stderr:Found initrd image: /boot/initrd.img-5.15.0-121-generic 2024-09-13T06:27:03.885 INFO:teuthology.orchestra.run.smithi139.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-13T06:27:03.890 INFO:teuthology.orchestra.run.smithi139.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-13T06:27:03.931 INFO:teuthology.orchestra.run.smithi139.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-13T06:27:03.936 INFO:teuthology.orchestra.run.smithi139.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-13T06:27:04.069 INFO:teuthology.orchestra.run.smithi139.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-13T06:27:04.069 INFO:teuthology.orchestra.run.smithi139.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-09-13T06:27:04.069 INFO:teuthology.orchestra.run.smithi139.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-13T06:27:04.090 INFO:teuthology.orchestra.run.smithi139.stderr:done 2024-09-13T06:27:04.092 DEBUG:teuthology.orchestra.run.smithi139:> sudo shutdown -r now 2024-09-13T06:27:26.052 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-09-13T06:27:26.053 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi081.front.sepia.ceph.com' 2024-09-13T06:27:26.054 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T06:27:34.145 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-09-13T06:27:34.146 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi139.front.sepia.ceph.com' 2024-09-13T06:27:34.147 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T06:27:44.573 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.81 2024-09-13T06:27:52.509 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.139 2024-09-13T06:27:53.575 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi081.front.sepia.ceph.com' 2024-09-13T06:27:53.576 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T06:27:56.641 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.81 2024-09-13T06:28:01.513 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi139.front.sepia.ceph.com' 2024-09-13T06:28:01.514 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T06:28:04.576 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.139 2024-09-13T06:28:08.645 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi081.front.sepia.ceph.com' 2024-09-13T06:28:08.646 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T06:28:16.586 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi139.front.sepia.ceph.com' 2024-09-13T06:28:16.586 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T06:28:27.069 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.81 2024-09-13T06:28:35.009 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.139 2024-09-13T06:28:42.077 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi081.front.sepia.ceph.com' 2024-09-13T06:28:42.078 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T06:28:42.088 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.81 2024-09-13T06:28:50.017 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi139.front.sepia.ceph.com' 2024-09-13T06:28:50.017 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T06:28:50.329 DEBUG:teuthology.orchestra.run.smithi139:> true 2024-09-13T06:28:50.894 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi139.front.sepia.ceph.com' 2024-09-13T06:28:50.894 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.15.0-121-generic"... 2024-09-13T06:28:50.895 DEBUG:teuthology.orchestra.run.smithi139:> uname -r 2024-09-13T06:28:50.940 INFO:teuthology.orchestra.run.smithi139.stdout:5.15.0-121-generic 2024-09-13T06:28:50.941 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-121-generic vs 5.15.0-121-generic 2024-09-13T06:28:50.941 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-13T06:28:50.941 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-09-13T06:28:51.941 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-09-13T06:28:51.942 DEBUG:teuthology.orchestra.run.smithi139:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-13T06:28:52.026 INFO:teuthology.orchestra.run.smithi139.stdout:ttyS1 2024-09-13T06:28:52.054 DEBUG:teuthology.parallel:result is None 2024-09-13T06:29:00.089 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi081.front.sepia.ceph.com' 2024-09-13T06:29:00.090 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T06:29:00.362 DEBUG:teuthology.orchestra.run.smithi081:> true 2024-09-13T06:29:00.913 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi081.front.sepia.ceph.com' 2024-09-13T06:29:00.913 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-121-generic"... 2024-09-13T06:29:00.914 DEBUG:teuthology.orchestra.run.smithi081:> uname -r 2024-09-13T06:29:00.962 INFO:teuthology.orchestra.run.smithi081.stdout:5.15.0-121-generic 2024-09-13T06:29:00.962 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-121-generic vs 5.15.0-121-generic 2024-09-13T06:29:00.962 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-13T06:29:00.962 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-09-13T06:29:01.963 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-09-13T06:29:01.964 DEBUG:teuthology.orchestra.run.smithi081:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-13T06:29:02.031 INFO:teuthology.orchestra.run.smithi081.stdout:ttyS1 2024-09-13T06:29:02.052 DEBUG:teuthology.parallel:result is None 2024-09-13T06:29:02.052 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-13T06:29:02.064 INFO:teuthology.task.internal:Creating test directory... 2024-09-13T06:29:02.065 DEBUG:teuthology.orchestra.run.smithi081:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-13T06:29:02.068 DEBUG:teuthology.orchestra.run.smithi139:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-13T06:29:02.075 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-13T06:29:02.103 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-13T06:29:02.136 INFO:teuthology.task.internal:Creating archive directory... 2024-09-13T06:29:02.136 DEBUG:teuthology.orchestra.run.smithi081:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-13T06:29:02.139 DEBUG:teuthology.orchestra.run.smithi139:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-13T06:29:02.168 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-13T06:29:02.175 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-13T06:29:02.175 DEBUG:teuthology.orchestra.run.smithi081:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-13T06:29:02.195 DEBUG:teuthology.orchestra.run.smithi139:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-13T06:29:02.215 INFO:teuthology.orchestra.run.smithi081.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-13T06:29:02.224 INFO:teuthology.orchestra.run.smithi081.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-13T06:29:02.227 INFO:teuthology.orchestra.run.smithi139.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-13T06:29:02.235 INFO:teuthology.orchestra.run.smithi139.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-13T06:29:02.237 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-13T06:29:02.244 INFO:teuthology.task.internal:Configuring sudo... 2024-09-13T06:29:02.244 DEBUG:teuthology.orchestra.run.smithi081:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-13T06:29:02.275 DEBUG:teuthology.orchestra.run.smithi139:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-13T06:29:02.289 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-13T06:29:02.298 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-13T06:29:02.299 DEBUG:teuthology.orchestra.run.smithi081:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-13T06:29:02.335 DEBUG:teuthology.orchestra.run.smithi139:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-13T06:29:02.340 DEBUG:teuthology.orchestra.run.smithi081:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-13T06:29:02.386 DEBUG:teuthology.orchestra.run.smithi081:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-13T06:29:02.437 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-13T06:29:02.437 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-13T06:29:02.499 DEBUG:teuthology.orchestra.run.smithi139:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-13T06:29:02.505 DEBUG:teuthology.orchestra.run.smithi139:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-13T06:29:02.552 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2024-09-13T06:29:02.552 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-13T06:29:02.613 DEBUG:teuthology.orchestra.run.smithi081:> sudo service rsyslog restart 2024-09-13T06:29:02.615 DEBUG:teuthology.orchestra.run.smithi139:> sudo service rsyslog restart 2024-09-13T06:29:02.684 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-13T06:29:02.691 INFO:teuthology.task.internal:Starting timer... 2024-09-13T06:29:02.691 INFO:teuthology.run_tasks:Running task pcp... 2024-09-13T06:29:02.722 INFO:teuthology.run_tasks:Running task selinux... 2024-09-13T06:29:02.753 DEBUG:teuthology.task.selinux:Excluding smithi081: OS 'ubuntu' does not support SELinux 2024-09-13T06:29:02.753 DEBUG:teuthology.task.selinux:Excluding smithi139: OS 'ubuntu' does not support SELinux 2024-09-13T06:29:02.754 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-13T06:29:02.754 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2024-09-13T06:29:02.754 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-13T06:29:02.754 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-13T06:29:02.785 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-13T06:29:02.797 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-13T06:29:02.798 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi081.front.sepia.ceph.com,smithi139.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-13T06:36:29.386 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi081.front.sepia.ceph.com'), Remote(name='ubuntu@smithi139.front.sepia.ceph.com')] 2024-09-13T06:36:29.387 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi081.front.sepia.ceph.com' 2024-09-13T06:36:29.389 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T06:36:29.479 DEBUG:teuthology.orchestra.run.smithi081:> true 2024-09-13T06:36:29.568 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi081.front.sepia.ceph.com' 2024-09-13T06:36:29.568 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi139.front.sepia.ceph.com' 2024-09-13T06:36:29.569 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T06:36:29.665 DEBUG:teuthology.orchestra.run.smithi139:> true 2024-09-13T06:36:29.745 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi139.front.sepia.ceph.com' 2024-09-13T06:36:29.745 INFO:teuthology.run_tasks:Running task clock... 2024-09-13T06:36:29.756 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-13T06:36:29.757 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-13T06:36:29.757 DEBUG:teuthology.orchestra.run.smithi081:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-13T06:36:29.759 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-13T06:36:29.760 DEBUG:teuthology.orchestra.run.smithi139:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-13T06:36:29.789 INFO:teuthology.orchestra.run.smithi081.stdout:13 Sep 06:36:29 ntpd[18486]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-09-13T06:36:29.789 INFO:teuthology.orchestra.run.smithi081.stdout:13 Sep 06:36:29 ntpd[18486]: Command line: ntpd -gq 2024-09-13T06:36:29.789 INFO:teuthology.orchestra.run.smithi081.stdout:13 Sep 06:36:29 ntpd[18486]: ---------------------------------------------------- 2024-09-13T06:36:29.789 INFO:teuthology.orchestra.run.smithi081.stdout:13 Sep 06:36:29 ntpd[18486]: ntp-4 is maintained by Network Time Foundation, 2024-09-13T06:36:29.789 INFO:teuthology.orchestra.run.smithi081.stdout:13 Sep 06:36:29 ntpd[18486]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-09-13T06:36:29.790 INFO:teuthology.orchestra.run.smithi081.stdout:13 Sep 06:36:29 ntpd[18486]: corporation. Support and training for ntp-4 are 2024-09-13T06:36:29.790 INFO:teuthology.orchestra.run.smithi081.stdout:13 Sep 06:36:29 ntpd[18486]: available at https://www.nwtime.org/support 2024-09-13T06:36:29.790 INFO:teuthology.orchestra.run.smithi081.stdout:13 Sep 06:36:29 ntpd[18486]: ---------------------------------------------------- 2024-09-13T06:36:29.790 INFO:teuthology.orchestra.run.smithi081.stdout:13 Sep 06:36:29 ntpd[18486]: proto: precision = 0.062 usec (-24) 2024-09-13T06:36:29.790 INFO:teuthology.orchestra.run.smithi081.stdout:13 Sep 06:36:29 ntpd[18486]: basedate set to 2022-02-04 2024-09-13T06:36:29.791 INFO:teuthology.orchestra.run.smithi081.stdout:13 Sep 06:36:29 ntpd[18486]: gps base set to 2022-02-06 (week 2196) 2024-09-13T06:36:29.791 INFO:teuthology.orchestra.run.smithi081.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-13T06:36:29.791 INFO:teuthology.orchestra.run.smithi081.stdout:13 Sep 06:36:29 ntpd[18486]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-13T06:36:29.791 INFO:teuthology.orchestra.run.smithi081.stdout:13 Sep 06:36:29 ntpd[18486]: restrict ::: KOD does nothing without LIMITED. 2024-09-13T06:36:29.792 INFO:teuthology.orchestra.run.smithi081.stderr:restrict ::: KOD does nothing without LIMITED. 2024-09-13T06:36:29.792 INFO:teuthology.orchestra.run.smithi081.stdout:13 Sep 06:36:29 ntpd[18486]: Listen and drop on 0 v6wildcard [::]:123 2024-09-13T06:36:29.793 INFO:teuthology.orchestra.run.smithi081.stdout:13 Sep 06:36:29 ntpd[18486]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-09-13T06:36:29.793 INFO:teuthology.orchestra.run.smithi081.stdout:13 Sep 06:36:29 ntpd[18486]: Listen normally on 2 lo 127.0.0.1:123 2024-09-13T06:36:29.793 INFO:teuthology.orchestra.run.smithi081.stdout:13 Sep 06:36:29 ntpd[18486]: Listen normally on 3 enp3s0f1 172.21.15.81:123 2024-09-13T06:36:29.793 INFO:teuthology.orchestra.run.smithi081.stdout:13 Sep 06:36:29 ntpd[18486]: Listen normally on 4 lo [::1]:123 2024-09-13T06:36:29.793 INFO:teuthology.orchestra.run.smithi081.stdout:13 Sep 06:36:29 ntpd[18486]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:d753%5]:123 2024-09-13T06:36:29.793 INFO:teuthology.orchestra.run.smithi081.stdout:13 Sep 06:36:29 ntpd[18486]: Listening on routing socket on fd #22 for interface updates 2024-09-13T06:36:29.809 INFO:teuthology.orchestra.run.smithi139.stdout:13 Sep 06:36:29 ntpd[18480]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-09-13T06:36:29.809 INFO:teuthology.orchestra.run.smithi139.stdout:13 Sep 06:36:29 ntpd[18480]: Command line: ntpd -gq 2024-09-13T06:36:29.809 INFO:teuthology.orchestra.run.smithi139.stdout:13 Sep 06:36:29 ntpd[18480]: ---------------------------------------------------- 2024-09-13T06:36:29.809 INFO:teuthology.orchestra.run.smithi139.stdout:13 Sep 06:36:29 ntpd[18480]: ntp-4 is maintained by Network Time Foundation, 2024-09-13T06:36:29.810 INFO:teuthology.orchestra.run.smithi139.stdout:13 Sep 06:36:29 ntpd[18480]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-09-13T06:36:29.810 INFO:teuthology.orchestra.run.smithi139.stdout:13 Sep 06:36:29 ntpd[18480]: corporation. Support and training for ntp-4 are 2024-09-13T06:36:29.810 INFO:teuthology.orchestra.run.smithi139.stdout:13 Sep 06:36:29 ntpd[18480]: available at https://www.nwtime.org/support 2024-09-13T06:36:29.810 INFO:teuthology.orchestra.run.smithi139.stdout:13 Sep 06:36:29 ntpd[18480]: ---------------------------------------------------- 2024-09-13T06:36:29.810 INFO:teuthology.orchestra.run.smithi139.stdout:13 Sep 06:36:29 ntpd[18480]: proto: precision = 0.044 usec (-24) 2024-09-13T06:36:29.811 INFO:teuthology.orchestra.run.smithi139.stdout:13 Sep 06:36:29 ntpd[18480]: basedate set to 2022-02-04 2024-09-13T06:36:29.811 INFO:teuthology.orchestra.run.smithi139.stdout:13 Sep 06:36:29 ntpd[18480]: gps base set to 2022-02-06 (week 2196) 2024-09-13T06:36:29.811 INFO:teuthology.orchestra.run.smithi139.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-13T06:36:29.811 INFO:teuthology.orchestra.run.smithi139.stdout:13 Sep 06:36:29 ntpd[18480]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-13T06:36:29.811 INFO:teuthology.orchestra.run.smithi139.stdout:13 Sep 06:36:29 ntpd[18480]: restrict ::: KOD does nothing without LIMITED. 2024-09-13T06:36:29.812 INFO:teuthology.orchestra.run.smithi139.stderr:restrict ::: KOD does nothing without LIMITED. 2024-09-13T06:36:29.813 INFO:teuthology.orchestra.run.smithi139.stdout:13 Sep 06:36:29 ntpd[18480]: Listen and drop on 0 v6wildcard [::]:123 2024-09-13T06:36:29.814 INFO:teuthology.orchestra.run.smithi139.stdout:13 Sep 06:36:29 ntpd[18480]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-09-13T06:36:29.814 INFO:teuthology.orchestra.run.smithi139.stdout:13 Sep 06:36:29 ntpd[18480]: Listen normally on 2 lo 127.0.0.1:123 2024-09-13T06:36:29.814 INFO:teuthology.orchestra.run.smithi139.stdout:13 Sep 06:36:29 ntpd[18480]: Listen normally on 3 enp3s0f1 172.21.15.139:123 2024-09-13T06:36:29.814 INFO:teuthology.orchestra.run.smithi139.stdout:13 Sep 06:36:29 ntpd[18480]: Listen normally on 4 lo [::1]:123 2024-09-13T06:36:29.814 INFO:teuthology.orchestra.run.smithi139.stdout:13 Sep 06:36:29 ntpd[18480]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:7f59%5]:123 2024-09-13T06:36:29.814 INFO:teuthology.orchestra.run.smithi139.stdout:13 Sep 06:36:29 ntpd[18480]: Listening on routing socket on fd #22 for interface updates 2024-09-13T06:36:30.811 INFO:teuthology.orchestra.run.smithi139.stderr:13 Sep 06:36:30 ntpd[18480]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T06:36:30.811 INFO:teuthology.orchestra.run.smithi139.stderr:13 Sep 06:36:30 ntpd[18480]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T06:36:30.811 INFO:teuthology.orchestra.run.smithi139.stderr:13 Sep 06:36:30 ntpd[18480]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T06:36:30.811 INFO:teuthology.orchestra.run.smithi139.stderr:13 Sep 06:36:30 ntpd[18480]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T06:36:30.811 INFO:teuthology.orchestra.run.smithi139.stderr:13 Sep 06:36:30 ntpd[18480]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T06:36:30.811 INFO:teuthology.orchestra.run.smithi139.stderr:13 Sep 06:36:30 ntpd[18480]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T06:36:30.811 INFO:teuthology.orchestra.run.smithi139.stderr:13 Sep 06:36:30 ntpd[18480]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T06:36:30.811 INFO:teuthology.orchestra.run.smithi139.stderr:13 Sep 06:36:30 ntpd[18480]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T06:36:30.811 INFO:teuthology.orchestra.run.smithi139.stderr:13 Sep 06:36:30 ntpd[18480]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T06:36:30.811 INFO:teuthology.orchestra.run.smithi139.stderr:13 Sep 06:36:30 ntpd[18480]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T06:36:30.812 INFO:teuthology.orchestra.run.smithi139.stderr:13 Sep 06:36:30 ntpd[18480]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T06:36:30.812 INFO:teuthology.orchestra.run.smithi139.stderr:13 Sep 06:36:30 ntpd[18480]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T06:36:31.809 INFO:teuthology.orchestra.run.smithi139.stderr:13 Sep 06:36:31 ntpd[18480]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T06:36:31.810 INFO:teuthology.orchestra.run.smithi139.stderr:13 Sep 06:36:31 ntpd[18480]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T06:36:32.790 INFO:teuthology.orchestra.run.smithi081.stderr:13 Sep 06:36:32 ntpd[18486]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T06:36:32.790 INFO:teuthology.orchestra.run.smithi081.stderr:13 Sep 06:36:32 ntpd[18486]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T06:36:32.790 INFO:teuthology.orchestra.run.smithi081.stderr:13 Sep 06:36:32 ntpd[18486]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T06:36:32.791 INFO:teuthology.orchestra.run.smithi081.stderr:13 Sep 06:36:32 ntpd[18486]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T06:36:32.791 INFO:teuthology.orchestra.run.smithi081.stderr:13 Sep 06:36:32 ntpd[18486]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T06:36:32.791 INFO:teuthology.orchestra.run.smithi081.stderr:13 Sep 06:36:32 ntpd[18486]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T06:36:32.791 INFO:teuthology.orchestra.run.smithi081.stderr:13 Sep 06:36:32 ntpd[18486]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T06:36:32.791 INFO:teuthology.orchestra.run.smithi081.stderr:13 Sep 06:36:32 ntpd[18486]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T06:36:32.812 INFO:teuthology.orchestra.run.smithi139.stderr:13 Sep 06:36:32 ntpd[18480]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T06:36:32.812 INFO:teuthology.orchestra.run.smithi139.stderr:13 Sep 06:36:32 ntpd[18480]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T06:36:32.812 INFO:teuthology.orchestra.run.smithi139.stderr:13 Sep 06:36:32 ntpd[18480]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T06:36:32.813 INFO:teuthology.orchestra.run.smithi139.stderr:13 Sep 06:36:32 ntpd[18480]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T06:36:32.813 INFO:teuthology.orchestra.run.smithi139.stderr:13 Sep 06:36:32 ntpd[18480]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T06:36:32.813 INFO:teuthology.orchestra.run.smithi139.stderr:13 Sep 06:36:32 ntpd[18480]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T06:36:32.813 INFO:teuthology.orchestra.run.smithi139.stderr:13 Sep 06:36:32 ntpd[18480]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T06:36:32.814 INFO:teuthology.orchestra.run.smithi139.stderr:13 Sep 06:36:32 ntpd[18480]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T06:36:32.814 INFO:teuthology.orchestra.run.smithi139.stderr:13 Sep 06:36:32 ntpd[18480]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T06:36:32.814 INFO:teuthology.orchestra.run.smithi139.stderr:13 Sep 06:36:32 ntpd[18480]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T06:36:32.814 INFO:teuthology.orchestra.run.smithi139.stderr:13 Sep 06:36:32 ntpd[18480]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T06:36:32.814 INFO:teuthology.orchestra.run.smithi139.stderr:13 Sep 06:36:32 ntpd[18480]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T06:36:33.790 INFO:teuthology.orchestra.run.smithi081.stderr:13 Sep 06:36:33 ntpd[18486]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T06:36:33.790 INFO:teuthology.orchestra.run.smithi081.stderr:13 Sep 06:36:33 ntpd[18486]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T06:36:33.790 INFO:teuthology.orchestra.run.smithi081.stderr:13 Sep 06:36:33 ntpd[18486]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T06:36:33.790 INFO:teuthology.orchestra.run.smithi081.stderr:13 Sep 06:36:33 ntpd[18486]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T06:36:33.790 INFO:teuthology.orchestra.run.smithi081.stderr:13 Sep 06:36:33 ntpd[18486]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T06:36:33.790 INFO:teuthology.orchestra.run.smithi081.stderr:13 Sep 06:36:33 ntpd[18486]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T06:36:34.790 INFO:teuthology.orchestra.run.smithi081.stderr:13 Sep 06:36:34 ntpd[18486]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T06:36:34.790 INFO:teuthology.orchestra.run.smithi081.stderr:13 Sep 06:36:34 ntpd[18486]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T06:36:34.791 INFO:teuthology.orchestra.run.smithi081.stderr:13 Sep 06:36:34 ntpd[18486]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T06:36:34.791 INFO:teuthology.orchestra.run.smithi081.stderr:13 Sep 06:36:34 ntpd[18486]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T06:36:34.791 INFO:teuthology.orchestra.run.smithi081.stderr:13 Sep 06:36:34 ntpd[18486]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T06:36:34.791 INFO:teuthology.orchestra.run.smithi081.stderr:13 Sep 06:36:34 ntpd[18486]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T06:36:34.791 INFO:teuthology.orchestra.run.smithi081.stderr:13 Sep 06:36:34 ntpd[18486]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T06:36:34.791 INFO:teuthology.orchestra.run.smithi081.stderr:13 Sep 06:36:34 ntpd[18486]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T06:36:34.791 INFO:teuthology.orchestra.run.smithi081.stderr:13 Sep 06:36:34 ntpd[18486]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T06:36:34.791 INFO:teuthology.orchestra.run.smithi081.stderr:13 Sep 06:36:34 ntpd[18486]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T06:36:34.791 INFO:teuthology.orchestra.run.smithi081.stderr:13 Sep 06:36:34 ntpd[18486]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T06:36:34.791 INFO:teuthology.orchestra.run.smithi081.stderr:13 Sep 06:36:34 ntpd[18486]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T06:36:34.811 INFO:teuthology.orchestra.run.smithi139.stderr:13 Sep 06:36:34 ntpd[18480]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T06:36:34.811 INFO:teuthology.orchestra.run.smithi139.stderr:13 Sep 06:36:34 ntpd[18480]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T06:36:34.811 INFO:teuthology.orchestra.run.smithi139.stderr:13 Sep 06:36:34 ntpd[18480]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T06:36:34.811 INFO:teuthology.orchestra.run.smithi139.stderr:13 Sep 06:36:34 ntpd[18480]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T06:36:34.812 INFO:teuthology.orchestra.run.smithi139.stderr:13 Sep 06:36:34 ntpd[18480]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T06:36:34.812 INFO:teuthology.orchestra.run.smithi139.stderr:13 Sep 06:36:34 ntpd[18480]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T06:36:34.812 INFO:teuthology.orchestra.run.smithi139.stderr:13 Sep 06:36:34 ntpd[18480]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T06:36:34.812 INFO:teuthology.orchestra.run.smithi139.stderr:13 Sep 06:36:34 ntpd[18480]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T06:36:34.812 INFO:teuthology.orchestra.run.smithi139.stderr:13 Sep 06:36:34 ntpd[18480]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T06:36:34.812 INFO:teuthology.orchestra.run.smithi139.stderr:13 Sep 06:36:34 ntpd[18480]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T06:36:34.812 INFO:teuthology.orchestra.run.smithi139.stderr:13 Sep 06:36:34 ntpd[18480]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T06:36:34.812 INFO:teuthology.orchestra.run.smithi139.stderr:13 Sep 06:36:34 ntpd[18480]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T06:36:34.812 INFO:teuthology.orchestra.run.smithi139.stderr:13 Sep 06:36:34 ntpd[18480]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T06:36:34.812 INFO:teuthology.orchestra.run.smithi139.stderr:13 Sep 06:36:34 ntpd[18480]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T06:36:34.812 INFO:teuthology.orchestra.run.smithi139.stderr:13 Sep 06:36:34 ntpd[18480]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T06:36:34.812 INFO:teuthology.orchestra.run.smithi139.stderr:13 Sep 06:36:34 ntpd[18480]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T06:36:34.812 INFO:teuthology.orchestra.run.smithi139.stderr:13 Sep 06:36:34 ntpd[18480]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T06:36:34.813 INFO:teuthology.orchestra.run.smithi139.stderr:13 Sep 06:36:34 ntpd[18480]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T06:36:35.790 INFO:teuthology.orchestra.run.smithi081.stderr:13 Sep 06:36:35 ntpd[18486]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T06:36:35.790 INFO:teuthology.orchestra.run.smithi081.stderr:13 Sep 06:36:35 ntpd[18486]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T06:36:35.790 INFO:teuthology.orchestra.run.smithi081.stderr:13 Sep 06:36:35 ntpd[18486]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T06:36:35.790 INFO:teuthology.orchestra.run.smithi081.stderr:13 Sep 06:36:35 ntpd[18486]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T06:36:35.790 INFO:teuthology.orchestra.run.smithi081.stderr:13 Sep 06:36:35 ntpd[18486]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T06:36:35.790 INFO:teuthology.orchestra.run.smithi081.stderr:13 Sep 06:36:35 ntpd[18486]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T06:36:36.790 INFO:teuthology.orchestra.run.smithi081.stderr:13 Sep 06:36:36 ntpd[18486]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T06:36:36.791 INFO:teuthology.orchestra.run.smithi081.stderr:13 Sep 06:36:36 ntpd[18486]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T06:36:36.791 INFO:teuthology.orchestra.run.smithi081.stderr:13 Sep 06:36:36 ntpd[18486]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T06:36:36.791 INFO:teuthology.orchestra.run.smithi081.stderr:13 Sep 06:36:36 ntpd[18486]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T06:36:36.791 INFO:teuthology.orchestra.run.smithi081.stderr:13 Sep 06:36:36 ntpd[18486]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T06:36:36.791 INFO:teuthology.orchestra.run.smithi081.stderr:13 Sep 06:36:36 ntpd[18486]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T06:36:36.791 INFO:teuthology.orchestra.run.smithi081.stderr:13 Sep 06:36:36 ntpd[18486]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T06:36:36.791 INFO:teuthology.orchestra.run.smithi081.stderr:13 Sep 06:36:36 ntpd[18486]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T06:36:36.791 INFO:teuthology.orchestra.run.smithi081.stderr:13 Sep 06:36:36 ntpd[18486]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T06:36:36.791 INFO:teuthology.orchestra.run.smithi081.stderr:13 Sep 06:36:36 ntpd[18486]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T06:36:36.792 INFO:teuthology.orchestra.run.smithi081.stderr:13 Sep 06:36:36 ntpd[18486]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T06:36:36.792 INFO:teuthology.orchestra.run.smithi081.stderr:13 Sep 06:36:36 ntpd[18486]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T06:36:36.811 INFO:teuthology.orchestra.run.smithi139.stderr:13 Sep 06:36:36 ntpd[18480]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T06:36:36.811 INFO:teuthology.orchestra.run.smithi139.stderr:13 Sep 06:36:36 ntpd[18480]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T06:36:36.811 INFO:teuthology.orchestra.run.smithi139.stderr:13 Sep 06:36:36 ntpd[18480]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T06:36:36.811 INFO:teuthology.orchestra.run.smithi139.stderr:13 Sep 06:36:36 ntpd[18480]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T06:36:36.811 INFO:teuthology.orchestra.run.smithi139.stderr:13 Sep 06:36:36 ntpd[18480]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T06:36:36.811 INFO:teuthology.orchestra.run.smithi139.stderr:13 Sep 06:36:36 ntpd[18480]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T06:36:36.811 INFO:teuthology.orchestra.run.smithi139.stderr:13 Sep 06:36:36 ntpd[18480]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T06:36:36.811 INFO:teuthology.orchestra.run.smithi139.stderr:13 Sep 06:36:36 ntpd[18480]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T06:36:36.811 INFO:teuthology.orchestra.run.smithi139.stderr:13 Sep 06:36:36 ntpd[18480]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T06:36:36.811 INFO:teuthology.orchestra.run.smithi139.stderr:13 Sep 06:36:36 ntpd[18480]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T06:36:36.811 INFO:teuthology.orchestra.run.smithi139.stderr:13 Sep 06:36:36 ntpd[18480]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T06:36:36.812 INFO:teuthology.orchestra.run.smithi139.stderr:13 Sep 06:36:36 ntpd[18480]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T06:36:36.812 INFO:teuthology.orchestra.run.smithi139.stderr:13 Sep 06:36:36 ntpd[18480]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T06:36:36.812 INFO:teuthology.orchestra.run.smithi139.stderr:13 Sep 06:36:36 ntpd[18480]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T06:36:36.812 INFO:teuthology.orchestra.run.smithi139.stdout:13 Sep 06:36:36 ntpd[18480]: ntpd: time slew +0.000649 s 2024-09-13T06:36:36.812 INFO:teuthology.orchestra.run.smithi139.stdout:ntpd: time slew +0.000649s 2024-09-13T06:36:36.813 INFO:teuthology.orchestra.run.smithi139.stderr:13 Sep 06:36:36 ntpd[18480]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-09-13T06:36:36.813 INFO:teuthology.orchestra.run.smithi139.stderr:13 Sep 06:36:36 ntpd[18480]: can't open /var/log/ntpstats/loopstats.20240913: Permission denied 2024-09-13T06:36:36.862 INFO:teuthology.orchestra.run.smithi139.stdout: remote refid st t when poll reach delay offset jitter 2024-09-13T06:36:36.863 INFO:teuthology.orchestra.run.smithi139.stdout:============================================================================== 2024-09-13T06:36:36.863 INFO:teuthology.orchestra.run.smithi139.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-13T06:36:36.863 INFO:teuthology.orchestra.run.smithi139.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-13T06:36:36.863 INFO:teuthology.orchestra.run.smithi139.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-13T06:36:36.863 INFO:teuthology.orchestra.run.smithi139.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-13T06:36:37.790 INFO:teuthology.orchestra.run.smithi081.stderr:13 Sep 06:36:37 ntpd[18486]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T06:36:37.790 INFO:teuthology.orchestra.run.smithi081.stderr:13 Sep 06:36:37 ntpd[18486]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T06:36:37.790 INFO:teuthology.orchestra.run.smithi081.stderr:13 Sep 06:36:37 ntpd[18486]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T06:36:37.790 INFO:teuthology.orchestra.run.smithi081.stderr:13 Sep 06:36:37 ntpd[18486]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T06:36:37.790 INFO:teuthology.orchestra.run.smithi081.stderr:13 Sep 06:36:37 ntpd[18486]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T06:36:37.790 INFO:teuthology.orchestra.run.smithi081.stderr:13 Sep 06:36:37 ntpd[18486]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T06:36:38.790 INFO:teuthology.orchestra.run.smithi081.stderr:13 Sep 06:36:38 ntpd[18486]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T06:36:38.790 INFO:teuthology.orchestra.run.smithi081.stderr:13 Sep 06:36:38 ntpd[18486]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T06:36:38.790 INFO:teuthology.orchestra.run.smithi081.stderr:13 Sep 06:36:38 ntpd[18486]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T06:36:38.790 INFO:teuthology.orchestra.run.smithi081.stderr:13 Sep 06:36:38 ntpd[18486]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T06:36:38.790 INFO:teuthology.orchestra.run.smithi081.stderr:13 Sep 06:36:38 ntpd[18486]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T06:36:38.790 INFO:teuthology.orchestra.run.smithi081.stderr:13 Sep 06:36:38 ntpd[18486]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T06:36:38.790 INFO:teuthology.orchestra.run.smithi081.stderr:13 Sep 06:36:38 ntpd[18486]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T06:36:38.791 INFO:teuthology.orchestra.run.smithi081.stderr:13 Sep 06:36:38 ntpd[18486]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T06:36:38.791 INFO:teuthology.orchestra.run.smithi081.stdout:13 Sep 06:36:38 ntpd[18486]: ntpd: time slew +0.000783 s 2024-09-13T06:36:38.791 INFO:teuthology.orchestra.run.smithi081.stdout:ntpd: time slew +0.000783s 2024-09-13T06:36:38.791 INFO:teuthology.orchestra.run.smithi081.stderr:13 Sep 06:36:38 ntpd[18486]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-09-13T06:36:38.791 INFO:teuthology.orchestra.run.smithi081.stderr:13 Sep 06:36:38 ntpd[18486]: can't open /var/log/ntpstats/loopstats.20240913: Permission denied 2024-09-13T06:36:38.841 INFO:teuthology.orchestra.run.smithi081.stdout: remote refid st t when poll reach delay offset jitter 2024-09-13T06:36:38.841 INFO:teuthology.orchestra.run.smithi081.stdout:============================================================================== 2024-09-13T06:36:38.841 INFO:teuthology.orchestra.run.smithi081.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-13T06:36:38.841 INFO:teuthology.orchestra.run.smithi081.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-13T06:36:38.841 INFO:teuthology.orchestra.run.smithi081.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-13T06:36:38.841 INFO:teuthology.orchestra.run.smithi081.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-13T06:36:38.842 INFO:teuthology.run_tasks:Running task install... 2024-09-13T06:36:38.853 DEBUG:teuthology.task.install:project ceph 2024-09-13T06:36:38.853 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '48a7de7e6e1701a88fd571c7e34908ac4b8ed412'}} 2024-09-13T06:36:38.853 DEBUG:teuthology.task.install:config {'flavor': 'default', 'sha1': '48a7de7e6e1701a88fd571c7e34908ac4b8ed412'} 2024-09-13T06:36:38.853 INFO:teuthology.task.install:Using flavor: default 2024-09-13T06:36:38.859 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-13T06:36:38.859 INFO:teuthology.task.install:extra packages: [] 2024-09-13T06:36:38.860 DEBUG:teuthology.orchestra.run.smithi081:> sudo apt-key list | grep Ceph 2024-09-13T06:36:38.860 DEBUG:teuthology.orchestra.run.smithi139:> sudo apt-key list | grep Ceph 2024-09-13T06:36:38.926 INFO:teuthology.orchestra.run.smithi139.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-09-13T06:36:38.943 INFO:teuthology.orchestra.run.smithi081.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-09-13T06:36:38.958 INFO:teuthology.orchestra.run.smithi139.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-09-13T06:36:38.958 INFO:teuthology.orchestra.run.smithi139.stdout:uid [ unknown] Ceph.com (release key) 2024-09-13T06:36:38.958 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-09-13T06:36:38.959 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=48a7de7e6e1701a88fd571c7e34908ac4b8ed412 2024-09-13T06:36:38.971 INFO:teuthology.orchestra.run.smithi081.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-09-13T06:36:38.971 INFO:teuthology.orchestra.run.smithi081.stdout:uid [ unknown] Ceph.com (release key) 2024-09-13T06:36:38.972 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-09-13T06:36:38.973 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=48a7de7e6e1701a88fd571c7e34908ac4b8ed412 2024-09-13T06:36:39.109 INFO:teuthology.task.install.deb:Pulling from https://1.chacra.ceph.com/r/ceph/reef/48a7de7e6e1701a88fd571c7e34908ac4b8ed412/ubuntu/jammy/flavors/default/ 2024-09-13T06:36:39.109 INFO:teuthology.task.install.deb:Package version is 18.2.4-820-g48a7de7e-1jammy 2024-09-13T06:36:39.121 INFO:teuthology.task.install.deb:Pulling from https://1.chacra.ceph.com/r/ceph/reef/48a7de7e6e1701a88fd571c7e34908ac4b8ed412/ubuntu/jammy/flavors/default/ 2024-09-13T06:36:39.121 INFO:teuthology.task.install.deb:Package version is 18.2.4-820-g48a7de7e-1jammy 2024-09-13T06:36:39.234 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2024-09-13T06:36:39.234 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-09-13T06:36:39.248 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-13T06:36:39.248 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-09-13T06:36:39.250 DEBUG:teuthology.orchestra.run.smithi139:> sudo apt-get update 2024-09-13T06:36:39.263 DEBUG:teuthology.orchestra.run.smithi081:> sudo apt-get update 2024-09-13T06:36:39.418 INFO:teuthology.orchestra.run.smithi139.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-13T06:36:39.428 INFO:teuthology.orchestra.run.smithi139.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-13T06:36:39.442 INFO:teuthology.orchestra.run.smithi081.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-13T06:36:39.445 INFO:teuthology.orchestra.run.smithi139.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-13T06:36:39.473 INFO:teuthology.orchestra.run.smithi139.stdout:Ign:4 https://1.chacra.ceph.com/r/ceph/reef/48a7de7e6e1701a88fd571c7e34908ac4b8ed412/ubuntu/jammy/flavors/default jammy InRelease 2024-09-13T06:36:39.485 INFO:teuthology.orchestra.run.smithi081.stdout:Ign:2 https://1.chacra.ceph.com/r/ceph/reef/48a7de7e6e1701a88fd571c7e34908ac4b8ed412/ubuntu/jammy/flavors/default jammy InRelease 2024-09-13T06:36:39.494 INFO:teuthology.orchestra.run.smithi139.stdout:Get:5 https://1.chacra.ceph.com/r/ceph/reef/48a7de7e6e1701a88fd571c7e34908ac4b8ed412/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-09-13T06:36:39.507 INFO:teuthology.orchestra.run.smithi081.stdout:Get:3 https://1.chacra.ceph.com/r/ceph/reef/48a7de7e6e1701a88fd571c7e34908ac4b8ed412/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-09-13T06:36:39.516 INFO:teuthology.orchestra.run.smithi139.stdout:Ign:6 https://1.chacra.ceph.com/r/ceph/reef/48a7de7e6e1701a88fd571c7e34908ac4b8ed412/ubuntu/jammy/flavors/default jammy Release.gpg 2024-09-13T06:36:39.529 INFO:teuthology.orchestra.run.smithi081.stdout:Ign:4 https://1.chacra.ceph.com/r/ceph/reef/48a7de7e6e1701a88fd571c7e34908ac4b8ed412/ubuntu/jammy/flavors/default jammy Release.gpg 2024-09-13T06:36:39.537 INFO:teuthology.orchestra.run.smithi139.stdout:Get:7 https://1.chacra.ceph.com/r/ceph/reef/48a7de7e6e1701a88fd571c7e34908ac4b8ed412/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.7 kB] 2024-09-13T06:36:39.550 INFO:teuthology.orchestra.run.smithi081.stdout:Get:5 https://1.chacra.ceph.com/r/ceph/reef/48a7de7e6e1701a88fd571c7e34908ac4b8ed412/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,421 B] 2024-09-13T06:36:39.558 INFO:teuthology.orchestra.run.smithi081.stdout:Hit:6 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-13T06:36:39.559 INFO:teuthology.orchestra.run.smithi139.stdout:Hit:8 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-13T06:36:39.565 INFO:teuthology.orchestra.run.smithi139.stdout:Get:9 https://1.chacra.ceph.com/r/ceph/reef/48a7de7e6e1701a88fd571c7e34908ac4b8ed412/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,421 B] 2024-09-13T06:36:39.580 INFO:teuthology.orchestra.run.smithi081.stdout:Get:7 https://1.chacra.ceph.com/r/ceph/reef/48a7de7e6e1701a88fd571c7e34908ac4b8ed412/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.7 kB] 2024-09-13T06:36:39.635 INFO:teuthology.orchestra.run.smithi081.stdout:Hit:8 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-13T06:36:39.715 INFO:teuthology.orchestra.run.smithi081.stdout:Hit:9 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-13T06:36:39.780 INFO:teuthology.orchestra.run.smithi139.stdout:Fetched 28.8 kB in 0s (82.5 kB/s) 2024-09-13T06:36:39.862 INFO:teuthology.orchestra.run.smithi081.stdout:Fetched 28.8 kB in 0s (69.8 kB/s) 2024-09-13T06:36:40.811 INFO:teuthology.orchestra.run.smithi139.stdout:Reading package lists... 2024-09-13T06:36:40.828 DEBUG:teuthology.orchestra.run.smithi139:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.2.4-820-g48a7de7e-1jammy cephadm=18.2.4-820-g48a7de7e-1jammy ceph-mds=18.2.4-820-g48a7de7e-1jammy ceph-mgr=18.2.4-820-g48a7de7e-1jammy ceph-common=18.2.4-820-g48a7de7e-1jammy ceph-fuse=18.2.4-820-g48a7de7e-1jammy ceph-test=18.2.4-820-g48a7de7e-1jammy ceph-volume=18.2.4-820-g48a7de7e-1jammy radosgw=18.2.4-820-g48a7de7e-1jammy python3-rados=18.2.4-820-g48a7de7e-1jammy python3-rgw=18.2.4-820-g48a7de7e-1jammy python3-cephfs=18.2.4-820-g48a7de7e-1jammy python3-rbd=18.2.4-820-g48a7de7e-1jammy libcephfs2=18.2.4-820-g48a7de7e-1jammy libcephfs-dev=18.2.4-820-g48a7de7e-1jammy librados2=18.2.4-820-g48a7de7e-1jammy librbd1=18.2.4-820-g48a7de7e-1jammy rbd-fuse=18.2.4-820-g48a7de7e-1jammy 2024-09-13T06:36:40.881 INFO:teuthology.orchestra.run.smithi139.stdout:Reading package lists... 2024-09-13T06:36:40.894 INFO:teuthology.orchestra.run.smithi081.stdout:Reading package lists... 2024-09-13T06:36:40.910 DEBUG:teuthology.orchestra.run.smithi081:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.2.4-820-g48a7de7e-1jammy cephadm=18.2.4-820-g48a7de7e-1jammy ceph-mds=18.2.4-820-g48a7de7e-1jammy ceph-mgr=18.2.4-820-g48a7de7e-1jammy ceph-common=18.2.4-820-g48a7de7e-1jammy ceph-fuse=18.2.4-820-g48a7de7e-1jammy ceph-test=18.2.4-820-g48a7de7e-1jammy ceph-volume=18.2.4-820-g48a7de7e-1jammy radosgw=18.2.4-820-g48a7de7e-1jammy python3-rados=18.2.4-820-g48a7de7e-1jammy python3-rgw=18.2.4-820-g48a7de7e-1jammy python3-cephfs=18.2.4-820-g48a7de7e-1jammy python3-rbd=18.2.4-820-g48a7de7e-1jammy libcephfs2=18.2.4-820-g48a7de7e-1jammy libcephfs-dev=18.2.4-820-g48a7de7e-1jammy librados2=18.2.4-820-g48a7de7e-1jammy librbd1=18.2.4-820-g48a7de7e-1jammy rbd-fuse=18.2.4-820-g48a7de7e-1jammy 2024-09-13T06:36:40.973 INFO:teuthology.orchestra.run.smithi081.stdout:Reading package lists... 2024-09-13T06:36:41.067 INFO:teuthology.orchestra.run.smithi139.stdout:Building dependency tree... 2024-09-13T06:36:41.068 INFO:teuthology.orchestra.run.smithi139.stdout:Reading state information... 2024-09-13T06:36:41.182 INFO:teuthology.orchestra.run.smithi081.stdout:Building dependency tree... 2024-09-13T06:36:41.183 INFO:teuthology.orchestra.run.smithi081.stdout:Reading state information... 2024-09-13T06:36:41.253 INFO:teuthology.orchestra.run.smithi139.stdout:The following packages were automatically installed and are no longer required: 2024-09-13T06:36:41.253 INFO:teuthology.orchestra.run.smithi139.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-13T06:36:41.253 INFO:teuthology.orchestra.run.smithi139.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-13T06:36:41.253 INFO:teuthology.orchestra.run.smithi139.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-13T06:36:41.253 INFO:teuthology.orchestra.run.smithi139.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-13T06:36:41.254 INFO:teuthology.orchestra.run.smithi139.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-13T06:36:41.254 INFO:teuthology.orchestra.run.smithi139.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-13T06:36:41.254 INFO:teuthology.orchestra.run.smithi139.stdout:The following additional packages will be installed: 2024-09-13T06:36:41.254 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-09-13T06:36:41.254 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-09-13T06:36:41.255 INFO:teuthology.orchestra.run.smithi139.stdout: libdouble-conversion3 libfmt8 libjq1 liblttng-ust1 liboath0 libonig5 2024-09-13T06:36:41.255 INFO:teuthology.orchestra.run.smithi139.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-09-13T06:36:41.255 INFO:teuthology.orchestra.run.smithi139.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.16.0 nvme-cli 2024-09-13T06:36:41.255 INFO:teuthology.orchestra.run.smithi139.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-09-13T06:36:41.255 INFO:teuthology.orchestra.run.smithi139.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-09-13T06:36:41.255 INFO:teuthology.orchestra.run.smithi139.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-09-13T06:36:41.256 INFO:teuthology.orchestra.run.smithi139.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-09-13T06:36:41.256 INFO:teuthology.orchestra.run.smithi139.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-13T06:36:41.256 INFO:teuthology.orchestra.run.smithi139.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-13T06:36:41.256 INFO:teuthology.orchestra.run.smithi139.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-13T06:36:41.256 INFO:teuthology.orchestra.run.smithi139.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-13T06:36:41.256 INFO:teuthology.orchestra.run.smithi139.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-13T06:36:41.256 INFO:teuthology.orchestra.run.smithi139.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-13T06:36:41.256 INFO:teuthology.orchestra.run.smithi139.stdout: python3-pygments python3-pyinotify python3-pytest python3-repoze.lru 2024-09-13T06:36:41.256 INFO:teuthology.orchestra.run.smithi139.stdout: python3-requests python3-requests-oauthlib python3-routes python3-rsa 2024-09-13T06:36:41.256 INFO:teuthology.orchestra.run.smithi139.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-09-13T06:36:41.256 INFO:teuthology.orchestra.run.smithi139.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-09-13T06:36:41.256 INFO:teuthology.orchestra.run.smithi139.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-09-13T06:36:41.256 INFO:teuthology.orchestra.run.smithi139.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-09-13T06:36:41.257 INFO:teuthology.orchestra.run.smithi139.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n socat xmlstarlet 2024-09-13T06:36:41.257 INFO:teuthology.orchestra.run.smithi139.stdout:Suggested packages: 2024-09-13T06:36:41.257 INFO:teuthology.orchestra.run.smithi139.stdout: python3-influxdb python-jinja2-doc python3-beaker python-mako-doc 2024-09-13T06:36:41.257 INFO:teuthology.orchestra.run.smithi139.stdout: python-natsort-doc python-openssl-doc python3-openssl-dbg httpd-wsgi 2024-09-13T06:36:41.257 INFO:teuthology.orchestra.run.smithi139.stdout: libapache2-mod-python libapache2-mod-scgi libjs-mochikit python-pecan-doc 2024-09-13T06:36:41.257 INFO:teuthology.orchestra.run.smithi139.stdout: python-psutil-doc subversion python-pygments-doc python-pyinotify-doc 2024-09-13T06:36:41.257 INFO:teuthology.orchestra.run.smithi139.stdout: python3-socks python-requests-doc python3-dap python-sklearn-doc ipython3 2024-09-13T06:36:41.257 INFO:teuthology.orchestra.run.smithi139.stdout: python-waitress-doc python-webob-doc python-webtest-doc python-werkzeug-doc 2024-09-13T06:36:41.257 INFO:teuthology.orchestra.run.smithi139.stdout: python3-watchdog 2024-09-13T06:36:41.258 INFO:teuthology.orchestra.run.smithi139.stdout:Recommended packages: 2024-09-13T06:36:41.258 INFO:teuthology.orchestra.run.smithi139.stdout: btrfs-tools 2024-09-13T06:36:41.358 INFO:teuthology.orchestra.run.smithi139.stdout:The following NEW packages will be installed: 2024-09-13T06:36:41.358 INFO:teuthology.orchestra.run.smithi139.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-09-13T06:36:41.358 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-09-13T06:36:41.358 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2024-09-13T06:36:41.359 INFO:teuthology.orchestra.run.smithi139.stdout: libcephfs-dev libcephfs2 libdouble-conversion3 libfmt8 libjq1 liblttng-ust1 2024-09-13T06:36:41.359 INFO:teuthology.orchestra.run.smithi139.stdout: liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 2024-09-13T06:36:41.360 INFO:teuthology.orchestra.run.smithi139.stdout: librados2 libradosstriper1 librbd1 librdkafka1 librgw2 libsqlite3-mod-ceph 2024-09-13T06:36:41.360 INFO:teuthology.orchestra.run.smithi139.stdout: libthrift-0.16.0 nvme-cli python-asyncssh-doc python-babel-localedata 2024-09-13T06:36:41.360 INFO:teuthology.orchestra.run.smithi139.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2024-09-13T06:36:41.360 INFO:teuthology.orchestra.run.smithi139.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2024-09-13T06:36:41.360 INFO:teuthology.orchestra.run.smithi139.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-google-auth 2024-09-13T06:36:41.360 INFO:teuthology.orchestra.run.smithi139.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2024-09-13T06:36:41.360 INFO:teuthology.orchestra.run.smithi139.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2024-09-13T06:36:41.360 INFO:teuthology.orchestra.run.smithi139.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2024-09-13T06:36:41.360 INFO:teuthology.orchestra.run.smithi139.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2024-09-13T06:36:41.360 INFO:teuthology.orchestra.run.smithi139.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2024-09-13T06:36:41.360 INFO:teuthology.orchestra.run.smithi139.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2024-09-13T06:36:41.360 INFO:teuthology.orchestra.run.smithi139.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2024-09-13T06:36:41.361 INFO:teuthology.orchestra.run.smithi139.stdout: python3-pytest python3-rados python3-rbd python3-repoze.lru python3-requests 2024-09-13T06:36:41.361 INFO:teuthology.orchestra.run.smithi139.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2024-09-13T06:36:41.361 INFO:teuthology.orchestra.run.smithi139.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-09-13T06:36:41.361 INFO:teuthology.orchestra.run.smithi139.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-09-13T06:36:41.361 INFO:teuthology.orchestra.run.smithi139.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-09-13T06:36:41.361 INFO:teuthology.orchestra.run.smithi139.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-09-13T06:36:41.361 INFO:teuthology.orchestra.run.smithi139.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2024-09-13T06:36:41.361 INFO:teuthology.orchestra.run.smithi139.stdout: socat xmlstarlet 2024-09-13T06:36:41.374 INFO:teuthology.orchestra.run.smithi081.stdout:The following packages were automatically installed and are no longer required: 2024-09-13T06:36:41.374 INFO:teuthology.orchestra.run.smithi081.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-13T06:36:41.374 INFO:teuthology.orchestra.run.smithi081.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-13T06:36:41.374 INFO:teuthology.orchestra.run.smithi081.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-13T06:36:41.374 INFO:teuthology.orchestra.run.smithi081.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-13T06:36:41.374 INFO:teuthology.orchestra.run.smithi081.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-13T06:36:41.375 INFO:teuthology.orchestra.run.smithi081.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-13T06:36:41.375 INFO:teuthology.orchestra.run.smithi081.stdout:The following additional packages will be installed: 2024-09-13T06:36:41.375 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-09-13T06:36:41.375 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-09-13T06:36:41.376 INFO:teuthology.orchestra.run.smithi081.stdout: libdouble-conversion3 libfmt8 libjq1 liblttng-ust1 liboath0 libonig5 2024-09-13T06:36:41.376 INFO:teuthology.orchestra.run.smithi081.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-09-13T06:36:41.376 INFO:teuthology.orchestra.run.smithi081.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.16.0 nvme-cli 2024-09-13T06:36:41.377 INFO:teuthology.orchestra.run.smithi081.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-09-13T06:36:41.377 INFO:teuthology.orchestra.run.smithi081.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-09-13T06:36:41.377 INFO:teuthology.orchestra.run.smithi081.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-09-13T06:36:41.377 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-09-13T06:36:41.377 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-13T06:36:41.377 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-13T06:36:41.377 INFO:teuthology.orchestra.run.smithi081.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-13T06:36:41.377 INFO:teuthology.orchestra.run.smithi081.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-13T06:36:41.377 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-13T06:36:41.377 INFO:teuthology.orchestra.run.smithi081.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-13T06:36:41.377 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pygments python3-pyinotify python3-pytest python3-repoze.lru 2024-09-13T06:36:41.377 INFO:teuthology.orchestra.run.smithi081.stdout: python3-requests python3-requests-oauthlib python3-routes python3-rsa 2024-09-13T06:36:41.377 INFO:teuthology.orchestra.run.smithi081.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-09-13T06:36:41.378 INFO:teuthology.orchestra.run.smithi081.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-09-13T06:36:41.378 INFO:teuthology.orchestra.run.smithi081.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-09-13T06:36:41.378 INFO:teuthology.orchestra.run.smithi081.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-09-13T06:36:41.378 INFO:teuthology.orchestra.run.smithi081.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n socat xmlstarlet 2024-09-13T06:36:41.378 INFO:teuthology.orchestra.run.smithi081.stdout:Suggested packages: 2024-09-13T06:36:41.378 INFO:teuthology.orchestra.run.smithi081.stdout: python3-influxdb python-jinja2-doc python3-beaker python-mako-doc 2024-09-13T06:36:41.378 INFO:teuthology.orchestra.run.smithi081.stdout: python-natsort-doc python-openssl-doc python3-openssl-dbg httpd-wsgi 2024-09-13T06:36:41.378 INFO:teuthology.orchestra.run.smithi081.stdout: libapache2-mod-python libapache2-mod-scgi libjs-mochikit python-pecan-doc 2024-09-13T06:36:41.378 INFO:teuthology.orchestra.run.smithi081.stdout: python-psutil-doc subversion python-pygments-doc python-pyinotify-doc 2024-09-13T06:36:41.379 INFO:teuthology.orchestra.run.smithi081.stdout: python3-socks python-requests-doc python3-dap python-sklearn-doc ipython3 2024-09-13T06:36:41.379 INFO:teuthology.orchestra.run.smithi081.stdout: python-waitress-doc python-webob-doc python-webtest-doc python-werkzeug-doc 2024-09-13T06:36:41.379 INFO:teuthology.orchestra.run.smithi081.stdout: python3-watchdog 2024-09-13T06:36:41.379 INFO:teuthology.orchestra.run.smithi081.stdout:Recommended packages: 2024-09-13T06:36:41.379 INFO:teuthology.orchestra.run.smithi081.stdout: btrfs-tools 2024-09-13T06:36:41.418 INFO:teuthology.orchestra.run.smithi139.stdout:0 upgraded, 109 newly installed, 0 to remove and 331 not upgraded. 2024-09-13T06:36:41.418 INFO:teuthology.orchestra.run.smithi139.stdout:Need to get 163 MB of archives. 2024-09-13T06:36:41.419 INFO:teuthology.orchestra.run.smithi139.stdout:After this operation, 746 MB of additional disk space will be used. 2024-09-13T06:36:41.419 INFO:teuthology.orchestra.run.smithi139.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libfmt8 amd64 8.1.1+ds1-2 [60.2 kB] 2024-09-13T06:36:41.476 INFO:teuthology.orchestra.run.smithi139.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-09-13T06:36:41.478 INFO:teuthology.orchestra.run.smithi081.stdout:The following NEW packages will be installed: 2024-09-13T06:36:41.479 INFO:teuthology.orchestra.run.smithi081.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-09-13T06:36:41.479 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-09-13T06:36:41.479 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2024-09-13T06:36:41.479 INFO:teuthology.orchestra.run.smithi081.stdout: libcephfs-dev libcephfs2 libdouble-conversion3 libfmt8 libjq1 liblttng-ust1 2024-09-13T06:36:41.479 INFO:teuthology.orchestra.run.smithi081.stdout: liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 2024-09-13T06:36:41.480 INFO:teuthology.orchestra.run.smithi081.stdout: librados2 libradosstriper1 librbd1 librdkafka1 librgw2 libsqlite3-mod-ceph 2024-09-13T06:36:41.480 INFO:teuthology.orchestra.run.smithi081.stdout: libthrift-0.16.0 nvme-cli python-asyncssh-doc python-babel-localedata 2024-09-13T06:36:41.480 INFO:teuthology.orchestra.run.smithi081.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2024-09-13T06:36:41.480 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2024-09-13T06:36:41.481 INFO:teuthology.orchestra.run.smithi081.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-google-auth 2024-09-13T06:36:41.481 INFO:teuthology.orchestra.run.smithi081.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2024-09-13T06:36:41.481 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2024-09-13T06:36:41.481 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2024-09-13T06:36:41.481 INFO:teuthology.orchestra.run.smithi081.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2024-09-13T06:36:41.481 INFO:teuthology.orchestra.run.smithi081.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2024-09-13T06:36:41.481 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2024-09-13T06:36:41.481 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2024-09-13T06:36:41.481 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pytest python3-rados python3-rbd python3-repoze.lru python3-requests 2024-09-13T06:36:41.481 INFO:teuthology.orchestra.run.smithi081.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2024-09-13T06:36:41.481 INFO:teuthology.orchestra.run.smithi081.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-09-13T06:36:41.481 INFO:teuthology.orchestra.run.smithi081.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-09-13T06:36:41.482 INFO:teuthology.orchestra.run.smithi081.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-09-13T06:36:41.482 INFO:teuthology.orchestra.run.smithi081.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-09-13T06:36:41.482 INFO:teuthology.orchestra.run.smithi081.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2024-09-13T06:36:41.482 INFO:teuthology.orchestra.run.smithi081.stdout: socat xmlstarlet 2024-09-13T06:36:41.503 INFO:teuthology.orchestra.run.smithi139.stdout:Get:3 https://1.chacra.ceph.com/r/ceph/reef/48a7de7e6e1701a88fd571c7e34908ac4b8ed412/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 18.2.4-820-g48a7de7e-1jammy [3,451 kB] 2024-09-13T06:36:41.513 INFO:teuthology.orchestra.run.smithi139.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-09-13T06:36:41.516 INFO:teuthology.orchestra.run.smithi139.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-09-13T06:36:41.532 INFO:teuthology.orchestra.run.smithi139.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-09-13T06:36:41.585 INFO:teuthology.orchestra.run.smithi139.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-09-13T06:36:41.589 INFO:teuthology.orchestra.run.smithi139.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-09-13T06:36:41.601 INFO:teuthology.orchestra.run.smithi139.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-09-13T06:36:41.608 INFO:teuthology.orchestra.run.smithi139.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-09-13T06:36:41.609 INFO:teuthology.orchestra.run.smithi139.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-09-13T06:36:41.609 INFO:teuthology.orchestra.run.smithi139.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-09-13T06:36:41.614 INFO:teuthology.orchestra.run.smithi139.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-09-13T06:36:41.615 INFO:teuthology.orchestra.run.smithi139.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-09-13T06:36:41.615 INFO:teuthology.orchestra.run.smithi139.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-09-13T06:36:41.616 INFO:teuthology.orchestra.run.smithi139.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-09-13T06:36:41.623 INFO:teuthology.orchestra.run.smithi139.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-09-13T06:36:41.623 INFO:teuthology.orchestra.run.smithi139.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-09-13T06:36:41.624 INFO:teuthology.orchestra.run.smithi081.stdout:0 upgraded, 109 newly installed, 0 to remove and 331 not upgraded. 2024-09-13T06:36:41.624 INFO:teuthology.orchestra.run.smithi081.stdout:Need to get 163 MB of archives. 2024-09-13T06:36:41.624 INFO:teuthology.orchestra.run.smithi081.stdout:After this operation, 746 MB of additional disk space will be used. 2024-09-13T06:36:41.624 INFO:teuthology.orchestra.run.smithi081.stdout:Get:1 https://1.chacra.ceph.com/r/ceph/reef/48a7de7e6e1701a88fd571c7e34908ac4b8ed412/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 18.2.4-820-g48a7de7e-1jammy [3,451 kB] 2024-09-13T06:36:41.640 INFO:teuthology.orchestra.run.smithi139.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-09-13T06:36:41.640 INFO:teuthology.orchestra.run.smithi139.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-09-13T06:36:41.641 INFO:teuthology.orchestra.run.smithi139.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-09-13T06:36:41.641 INFO:teuthology.orchestra.run.smithi139.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-09-13T06:36:41.644 INFO:teuthology.orchestra.run.smithi139.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-09-13T06:36:41.644 INFO:teuthology.orchestra.run.smithi139.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-09-13T06:36:41.646 INFO:teuthology.orchestra.run.smithi139.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-09-13T06:36:41.646 INFO:teuthology.orchestra.run.smithi139.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-09-13T06:36:41.657 INFO:teuthology.orchestra.run.smithi139.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-09-13T06:36:41.657 INFO:teuthology.orchestra.run.smithi139.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-09-13T06:36:41.669 INFO:teuthology.orchestra.run.smithi081.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libfmt8 amd64 8.1.1+ds1-2 [60.2 kB] 2024-09-13T06:36:41.674 INFO:teuthology.orchestra.run.smithi139.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-webob all 1:1.8.6-1.1ubuntu0.1 [86.7 kB] 2024-09-13T06:36:41.676 INFO:teuthology.orchestra.run.smithi139.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-09-13T06:36:41.676 INFO:teuthology.orchestra.run.smithi139.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-09-13T06:36:41.676 INFO:teuthology.orchestra.run.smithi139.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-09-13T06:36:41.681 INFO:teuthology.orchestra.run.smithi139.stdout:Get:33 https://1.chacra.ceph.com/r/ceph/reef/48a7de7e6e1701a88fd571c7e34908ac4b8ed412/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 18.2.4-820-g48a7de7e-1jammy [3,108 kB] 2024-09-13T06:36:41.682 INFO:teuthology.orchestra.run.smithi139.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-09-13T06:36:41.682 INFO:teuthology.orchestra.run.smithi139.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-09-13T06:36:41.683 INFO:teuthology.orchestra.run.smithi139.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-09-13T06:36:41.683 INFO:teuthology.orchestra.run.smithi139.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-09-13T06:36:41.691 INFO:teuthology.orchestra.run.smithi139.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-09-13T06:36:41.693 INFO:teuthology.orchestra.run.smithi139.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-idna all 3.3-1ubuntu0.1 [52.1 kB] 2024-09-13T06:36:41.702 INFO:teuthology.orchestra.run.smithi139.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-09-13T06:36:41.704 INFO:teuthology.orchestra.run.smithi139.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-09-13T06:36:41.704 INFO:teuthology.orchestra.run.smithi139.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.2 [181 kB] 2024-09-13T06:36:41.707 INFO:teuthology.orchestra.run.smithi139.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-09-13T06:36:41.707 INFO:teuthology.orchestra.run.smithi139.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-09-13T06:36:41.708 INFO:teuthology.orchestra.run.smithi139.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-09-13T06:36:41.711 INFO:teuthology.orchestra.run.smithi139.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-09-13T06:36:41.729 INFO:teuthology.orchestra.run.smithi139.stdout:Get:47 https://1.chacra.ceph.com/r/ceph/reef/48a7de7e6e1701a88fd571c7e34908ac4b8ed412/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 18.2.4-820-g48a7de7e-1jammy [683 kB] 2024-09-13T06:36:41.738 INFO:teuthology.orchestra.run.smithi139.stdout:Get:48 https://1.chacra.ceph.com/r/ceph/reef/48a7de7e6e1701a88fd571c7e34908ac4b8ed412/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 18.2.4-820-g48a7de7e-1jammy [357 kB] 2024-09-13T06:36:41.743 INFO:teuthology.orchestra.run.smithi139.stdout:Get:49 https://1.chacra.ceph.com/r/ceph/reef/48a7de7e6e1701a88fd571c7e34908ac4b8ed412/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 18.2.4-820-g48a7de7e-1jammy [32.8 kB] 2024-09-13T06:36:41.744 INFO:teuthology.orchestra.run.smithi139.stdout:Get:50 https://1.chacra.ceph.com/r/ceph/reef/48a7de7e6e1701a88fd571c7e34908ac4b8ed412/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 18.2.4-820-g48a7de7e-1jammy [180 kB] 2024-09-13T06:36:41.747 INFO:teuthology.orchestra.run.smithi139.stdout:Get:51 https://1.chacra.ceph.com/r/ceph/reef/48a7de7e6e1701a88fd571c7e34908ac4b8ed412/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 18.2.4-820-g48a7de7e-1jammy [63.8 kB] 2024-09-13T06:36:41.748 INFO:teuthology.orchestra.run.smithi139.stdout:Get:52 https://1.chacra.ceph.com/r/ceph/reef/48a7de7e6e1701a88fd571c7e34908ac4b8ed412/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 18.2.4-820-g48a7de7e-1jammy [334 kB] 2024-09-13T06:36:41.758 INFO:teuthology.orchestra.run.smithi139.stdout:Get:53 https://1.chacra.ceph.com/r/ceph/reef/48a7de7e6e1701a88fd571c7e34908ac4b8ed412/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 18.2.4-820-g48a7de7e-1jammy [5,934 kB] 2024-09-13T06:36:41.762 INFO:teuthology.orchestra.run.smithi139.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-09-13T06:36:41.763 INFO:teuthology.orchestra.run.smithi139.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.2 [108 kB] 2024-09-13T06:36:41.764 INFO:teuthology.orchestra.run.smithi139.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-09-13T06:36:41.765 INFO:teuthology.orchestra.run.smithi139.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-09-13T06:36:41.766 INFO:teuthology.orchestra.run.smithi139.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-09-13T06:36:41.766 INFO:teuthology.orchestra.run.smithi139.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-09-13T06:36:41.766 INFO:teuthology.orchestra.run.smithi139.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-09-13T06:36:41.768 INFO:teuthology.orchestra.run.smithi139.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-09-13T06:36:41.769 INFO:teuthology.orchestra.run.smithi139.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-09-13T06:36:41.781 INFO:teuthology.orchestra.run.smithi139.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-09-13T06:36:41.798 INFO:teuthology.orchestra.run.smithi139.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-09-13T06:36:41.800 INFO:teuthology.orchestra.run.smithi139.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-09-13T06:36:41.800 INFO:teuthology.orchestra.run.smithi139.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-09-13T06:36:41.815 INFO:teuthology.orchestra.run.smithi139.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-09-13T06:36:41.815 INFO:teuthology.orchestra.run.smithi139.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-09-13T06:36:41.815 INFO:teuthology.orchestra.run.smithi139.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-09-13T06:36:41.816 INFO:teuthology.orchestra.run.smithi139.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-09-13T06:36:41.816 INFO:teuthology.orchestra.run.smithi139.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-09-13T06:36:41.817 INFO:teuthology.orchestra.run.smithi139.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-09-13T06:36:41.817 INFO:teuthology.orchestra.run.smithi139.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-09-13T06:36:41.834 INFO:teuthology.orchestra.run.smithi139.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-09-13T06:36:41.836 INFO:teuthology.orchestra.run.smithi139.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-09-13T06:36:41.838 INFO:teuthology.orchestra.run.smithi139.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-09-13T06:36:41.839 INFO:teuthology.orchestra.run.smithi139.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-09-13T06:36:41.840 INFO:teuthology.orchestra.run.smithi139.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-09-13T06:36:41.850 INFO:teuthology.orchestra.run.smithi139.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-09-13T06:36:41.853 INFO:teuthology.orchestra.run.smithi139.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.3 [474 kB] 2024-09-13T06:36:41.857 INFO:teuthology.orchestra.run.smithi139.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-09-13T06:36:41.859 INFO:teuthology.orchestra.run.smithi139.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-09-13T06:36:41.860 INFO:teuthology.orchestra.run.smithi139.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-09-13T06:36:41.865 INFO:teuthology.orchestra.run.smithi139.stdout:Get:84 https://1.chacra.ceph.com/r/ceph/reef/48a7de7e6e1701a88fd571c7e34908ac4b8ed412/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 18.2.4-820-g48a7de7e-1jammy [112 kB] 2024-09-13T06:36:41.867 INFO:teuthology.orchestra.run.smithi139.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-09-13T06:36:41.950 INFO:teuthology.orchestra.run.smithi081.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-09-13T06:36:41.963 INFO:teuthology.orchestra.run.smithi139.stdout:Get:86 https://1.chacra.ceph.com/r/ceph/reef/48a7de7e6e1701a88fd571c7e34908ac4b8ed412/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 18.2.4-820-g48a7de7e-1jammy [445 kB] 2024-09-13T06:36:41.963 INFO:teuthology.orchestra.run.smithi139.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-09-13T06:36:41.963 INFO:teuthology.orchestra.run.smithi139.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-09-13T06:36:41.963 INFO:teuthology.orchestra.run.smithi139.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-09-13T06:36:41.969 INFO:teuthology.orchestra.run.smithi139.stdout:Get:90 https://1.chacra.ceph.com/r/ceph/reef/48a7de7e6e1701a88fd571c7e34908ac4b8ed412/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 18.2.4-820-g48a7de7e-1jammy [22.0 MB] 2024-09-13T06:36:42.085 INFO:teuthology.orchestra.run.smithi081.stdout:Get:4 https://1.chacra.ceph.com/r/ceph/reef/48a7de7e6e1701a88fd571c7e34908ac4b8ed412/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 18.2.4-820-g48a7de7e-1jammy [3,108 kB] 2024-09-13T06:36:42.124 INFO:teuthology.orchestra.run.smithi081.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-09-13T06:36:42.138 INFO:teuthology.orchestra.run.smithi081.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-09-13T06:36:42.213 INFO:teuthology.orchestra.run.smithi081.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-09-13T06:36:42.405 INFO:teuthology.orchestra.run.smithi139.stdout:Get:91 https://1.chacra.ceph.com/r/ceph/reef/48a7de7e6e1701a88fd571c7e34908ac4b8ed412/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 18.2.4-820-g48a7de7e-1jammy [5,005 kB] 2024-09-13T06:36:42.406 INFO:teuthology.orchestra.run.smithi081.stdout:Get:8 https://1.chacra.ceph.com/r/ceph/reef/48a7de7e6e1701a88fd571c7e34908ac4b8ed412/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 18.2.4-820-g48a7de7e-1jammy [683 kB] 2024-09-13T06:36:42.407 INFO:teuthology.orchestra.run.smithi081.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-09-13T06:36:42.417 INFO:teuthology.orchestra.run.smithi081.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-09-13T06:36:42.429 INFO:teuthology.orchestra.run.smithi081.stdout:Get:11 https://1.chacra.ceph.com/r/ceph/reef/48a7de7e6e1701a88fd571c7e34908ac4b8ed412/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 18.2.4-820-g48a7de7e-1jammy [357 kB] 2024-09-13T06:36:42.444 INFO:teuthology.orchestra.run.smithi081.stdout:Get:12 https://1.chacra.ceph.com/r/ceph/reef/48a7de7e6e1701a88fd571c7e34908ac4b8ed412/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 18.2.4-820-g48a7de7e-1jammy [32.8 kB] 2024-09-13T06:36:42.445 INFO:teuthology.orchestra.run.smithi081.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-09-13T06:36:42.445 INFO:teuthology.orchestra.run.smithi081.stdout:Get:14 https://1.chacra.ceph.com/r/ceph/reef/48a7de7e6e1701a88fd571c7e34908ac4b8ed412/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 18.2.4-820-g48a7de7e-1jammy [180 kB] 2024-09-13T06:36:42.453 INFO:teuthology.orchestra.run.smithi081.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-09-13T06:36:42.453 INFO:teuthology.orchestra.run.smithi081.stdout:Get:16 https://1.chacra.ceph.com/r/ceph/reef/48a7de7e6e1701a88fd571c7e34908ac4b8ed412/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 18.2.4-820-g48a7de7e-1jammy [63.8 kB] 2024-09-13T06:36:42.454 INFO:teuthology.orchestra.run.smithi081.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-09-13T06:36:42.455 INFO:teuthology.orchestra.run.smithi081.stdout:Get:18 https://1.chacra.ceph.com/r/ceph/reef/48a7de7e6e1701a88fd571c7e34908ac4b8ed412/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 18.2.4-820-g48a7de7e-1jammy [334 kB] 2024-09-13T06:36:42.456 INFO:teuthology.orchestra.run.smithi081.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-09-13T06:36:42.467 INFO:teuthology.orchestra.run.smithi139.stdout:Get:92 https://1.chacra.ceph.com/r/ceph/reef/48a7de7e6e1701a88fd571c7e34908ac4b8ed412/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 18.2.4-820-g48a7de7e-1jammy [241 kB] 2024-09-13T06:36:42.470 INFO:teuthology.orchestra.run.smithi139.stdout:Get:93 https://1.chacra.ceph.com/r/ceph/reef/48a7de7e6e1701a88fd571c7e34908ac4b8ed412/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 18.2.4-820-g48a7de7e-1jammy [130 kB] 2024-09-13T06:36:42.471 INFO:teuthology.orchestra.run.smithi139.stdout:Get:94 https://1.chacra.ceph.com/r/ceph/reef/48a7de7e6e1701a88fd571c7e34908ac4b8ed412/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 18.2.4-820-g48a7de7e-1jammy [1,494 kB] 2024-09-13T06:36:42.473 INFO:teuthology.orchestra.run.smithi081.stdout:Get:20 https://1.chacra.ceph.com/r/ceph/reef/48a7de7e6e1701a88fd571c7e34908ac4b8ed412/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 18.2.4-820-g48a7de7e-1jammy [5,934 kB] 2024-09-13T06:36:42.474 INFO:teuthology.orchestra.run.smithi081.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-09-13T06:36:42.475 INFO:teuthology.orchestra.run.smithi081.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-09-13T06:36:42.476 INFO:teuthology.orchestra.run.smithi081.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-09-13T06:36:42.487 INFO:teuthology.orchestra.run.smithi139.stdout:Get:95 https://1.chacra.ceph.com/r/ceph/reef/48a7de7e6e1701a88fd571c7e34908ac4b8ed412/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 18.2.4-820-g48a7de7e-1jammy [6,085 kB] 2024-09-13T06:36:42.490 INFO:teuthology.orchestra.run.smithi081.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-09-13T06:36:42.560 INFO:teuthology.orchestra.run.smithi081.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-09-13T06:36:42.561 INFO:teuthology.orchestra.run.smithi081.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-09-13T06:36:42.561 INFO:teuthology.orchestra.run.smithi081.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-09-13T06:36:42.562 INFO:teuthology.orchestra.run.smithi081.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-09-13T06:36:42.563 INFO:teuthology.orchestra.run.smithi081.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-09-13T06:36:42.564 INFO:teuthology.orchestra.run.smithi081.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-09-13T06:36:42.572 INFO:teuthology.orchestra.run.smithi081.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-09-13T06:36:42.573 INFO:teuthology.orchestra.run.smithi081.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-09-13T06:36:42.574 INFO:teuthology.orchestra.run.smithi081.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-09-13T06:36:42.611 INFO:teuthology.orchestra.run.smithi139.stdout:Get:96 https://1.chacra.ceph.com/r/ceph/reef/48a7de7e6e1701a88fd571c7e34908ac4b8ed412/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 18.2.4-820-g48a7de7e-1jammy [22.4 MB] 2024-09-13T06:36:42.653 INFO:teuthology.orchestra.run.smithi081.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-09-13T06:36:42.654 INFO:teuthology.orchestra.run.smithi081.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-09-13T06:36:42.655 INFO:teuthology.orchestra.run.smithi081.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-09-13T06:36:42.656 INFO:teuthology.orchestra.run.smithi081.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-webob all 1:1.8.6-1.1ubuntu0.1 [86.7 kB] 2024-09-13T06:36:42.658 INFO:teuthology.orchestra.run.smithi081.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-09-13T06:36:42.660 INFO:teuthology.orchestra.run.smithi081.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-09-13T06:36:42.734 INFO:teuthology.orchestra.run.smithi081.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-09-13T06:36:42.744 INFO:teuthology.orchestra.run.smithi081.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-09-13T06:36:42.745 INFO:teuthology.orchestra.run.smithi081.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-09-13T06:36:42.746 INFO:teuthology.orchestra.run.smithi081.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-09-13T06:36:42.816 INFO:teuthology.orchestra.run.smithi081.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-09-13T06:36:42.818 INFO:teuthology.orchestra.run.smithi081.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-09-13T06:36:42.822 INFO:teuthology.orchestra.run.smithi081.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-idna all 3.3-1ubuntu0.1 [52.1 kB] 2024-09-13T06:36:42.823 INFO:teuthology.orchestra.run.smithi081.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-09-13T06:36:42.826 INFO:teuthology.orchestra.run.smithi081.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-09-13T06:36:42.827 INFO:teuthology.orchestra.run.smithi081.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.2 [181 kB] 2024-09-13T06:36:42.897 INFO:teuthology.orchestra.run.smithi081.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-09-13T06:36:42.898 INFO:teuthology.orchestra.run.smithi081.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-09-13T06:36:42.899 INFO:teuthology.orchestra.run.smithi081.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-09-13T06:36:42.904 INFO:teuthology.orchestra.run.smithi081.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-09-13T06:36:42.962 INFO:teuthology.orchestra.run.smithi081.stdout:Get:54 https://1.chacra.ceph.com/r/ceph/reef/48a7de7e6e1701a88fd571c7e34908ac4b8ed412/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 18.2.4-820-g48a7de7e-1jammy [112 kB] 2024-09-13T06:36:42.965 INFO:teuthology.orchestra.run.smithi081.stdout:Get:55 https://1.chacra.ceph.com/r/ceph/reef/48a7de7e6e1701a88fd571c7e34908ac4b8ed412/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 18.2.4-820-g48a7de7e-1jammy [445 kB] 2024-09-13T06:36:42.999 INFO:teuthology.orchestra.run.smithi081.stdout:Get:56 https://1.chacra.ceph.com/r/ceph/reef/48a7de7e6e1701a88fd571c7e34908ac4b8ed412/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 18.2.4-820-g48a7de7e-1jammy [22.0 MB] 2024-09-13T06:36:43.068 INFO:teuthology.orchestra.run.smithi081.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-09-13T06:36:43.070 INFO:teuthology.orchestra.run.smithi081.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.2 [108 kB] 2024-09-13T06:36:43.073 INFO:teuthology.orchestra.run.smithi081.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-09-13T06:36:43.074 INFO:teuthology.orchestra.run.smithi081.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-09-13T06:36:43.076 INFO:teuthology.orchestra.run.smithi081.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-09-13T06:36:43.076 INFO:teuthology.orchestra.run.smithi081.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-09-13T06:36:43.077 INFO:teuthology.orchestra.run.smithi081.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-09-13T06:36:43.082 INFO:teuthology.orchestra.run.smithi081.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-09-13T06:36:43.083 INFO:teuthology.orchestra.run.smithi081.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-09-13T06:36:43.154 INFO:teuthology.orchestra.run.smithi081.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-09-13T06:36:43.178 INFO:teuthology.orchestra.run.smithi139.stdout:Get:97 https://1.chacra.ceph.com/r/ceph/reef/48a7de7e6e1701a88fd571c7e34908ac4b8ed412/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 18.2.4-820-g48a7de7e-1jammy [14.2 kB] 2024-09-13T06:36:43.178 INFO:teuthology.orchestra.run.smithi139.stdout:Get:98 https://1.chacra.ceph.com/r/ceph/reef/48a7de7e6e1701a88fd571c7e34908ac4b8ed412/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 18.2.4-820-g48a7de7e-1jammy [834 kB] 2024-09-13T06:36:43.192 INFO:teuthology.orchestra.run.smithi139.stdout:Get:99 https://1.chacra.ceph.com/r/ceph/reef/48a7de7e6e1701a88fd571c7e34908ac4b8ed412/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 18.2.4-820-g48a7de7e-1jammy [2,159 kB] 2024-09-13T06:36:43.199 INFO:teuthology.orchestra.run.smithi081.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-09-13T06:36:43.203 INFO:teuthology.orchestra.run.smithi081.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-09-13T06:36:43.204 INFO:teuthology.orchestra.run.smithi081.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-09-13T06:36:43.227 INFO:teuthology.orchestra.run.smithi139.stdout:Get:100 https://1.chacra.ceph.com/r/ceph/reef/48a7de7e6e1701a88fd571c7e34908ac4b8ed412/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 18.2.4-820-g48a7de7e-1jammy [240 kB] 2024-09-13T06:36:43.230 INFO:teuthology.orchestra.run.smithi139.stdout:Get:101 https://1.chacra.ceph.com/r/ceph/reef/48a7de7e6e1701a88fd571c7e34908ac4b8ed412/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 18.2.4-820-g48a7de7e-1jammy [145 kB] 2024-09-13T06:36:43.232 INFO:teuthology.orchestra.run.smithi139.stdout:Get:102 https://1.chacra.ceph.com/r/ceph/reef/48a7de7e6e1701a88fd571c7e34908ac4b8ed412/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 18.2.4-820-g48a7de7e-1jammy [2,233 kB] 2024-09-13T06:36:43.254 INFO:teuthology.orchestra.run.smithi081.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-09-13T06:36:43.254 INFO:teuthology.orchestra.run.smithi081.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-09-13T06:36:43.255 INFO:teuthology.orchestra.run.smithi081.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-09-13T06:36:43.256 INFO:teuthology.orchestra.run.smithi081.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-09-13T06:36:43.257 INFO:teuthology.orchestra.run.smithi081.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-09-13T06:36:43.257 INFO:teuthology.orchestra.run.smithi139.stdout:Get:103 https://1.chacra.ceph.com/r/ceph/reef/48a7de7e6e1701a88fd571c7e34908ac4b8ed412/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 18.2.4-820-g48a7de7e-1jammy [8,625 kB] 2024-09-13T06:36:43.257 INFO:teuthology.orchestra.run.smithi081.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-09-13T06:36:43.316 INFO:teuthology.orchestra.run.smithi081.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-09-13T06:36:43.317 INFO:teuthology.orchestra.run.smithi081.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-09-13T06:36:43.323 INFO:teuthology.orchestra.run.smithi081.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-09-13T06:36:43.397 INFO:teuthology.orchestra.run.smithi081.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-09-13T06:36:43.401 INFO:teuthology.orchestra.run.smithi081.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-09-13T06:36:43.402 INFO:teuthology.orchestra.run.smithi081.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-09-13T06:36:43.410 INFO:teuthology.orchestra.run.smithi081.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-09-13T06:36:43.416 INFO:teuthology.orchestra.run.smithi081.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.3 [474 kB] 2024-09-13T06:36:43.427 INFO:teuthology.orchestra.run.smithi081.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-09-13T06:36:43.434 INFO:teuthology.orchestra.run.smithi081.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-09-13T06:36:43.465 INFO:teuthology.orchestra.run.smithi139.stdout:Get:104 https://1.chacra.ceph.com/r/ceph/reef/48a7de7e6e1701a88fd571c7e34908ac4b8ed412/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 18.2.4-820-g48a7de7e-1jammy [14.3 kB] 2024-09-13T06:36:43.466 INFO:teuthology.orchestra.run.smithi139.stdout:Get:105 https://1.chacra.ceph.com/r/ceph/reef/48a7de7e6e1701a88fd571c7e34908ac4b8ed412/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 18.2.4-820-g48a7de7e-1jammy [42.8 MB] 2024-09-13T06:36:43.478 INFO:teuthology.orchestra.run.smithi081.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-09-13T06:36:43.482 INFO:teuthology.orchestra.run.smithi081.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-09-13T06:36:43.497 INFO:teuthology.orchestra.run.smithi081.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-09-13T06:36:43.560 INFO:teuthology.orchestra.run.smithi081.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-09-13T06:36:43.561 INFO:teuthology.orchestra.run.smithi081.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-09-13T06:36:44.081 INFO:teuthology.orchestra.run.smithi081.stdout:Get:91 https://1.chacra.ceph.com/r/ceph/reef/48a7de7e6e1701a88fd571c7e34908ac4b8ed412/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 18.2.4-820-g48a7de7e-1jammy [5,005 kB] 2024-09-13T06:36:44.176 INFO:teuthology.orchestra.run.smithi081.stdout:Get:92 https://1.chacra.ceph.com/r/ceph/reef/48a7de7e6e1701a88fd571c7e34908ac4b8ed412/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 18.2.4-820-g48a7de7e-1jammy [241 kB] 2024-09-13T06:36:44.181 INFO:teuthology.orchestra.run.smithi081.stdout:Get:93 https://1.chacra.ceph.com/r/ceph/reef/48a7de7e6e1701a88fd571c7e34908ac4b8ed412/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 18.2.4-820-g48a7de7e-1jammy [130 kB] 2024-09-13T06:36:44.203 INFO:teuthology.orchestra.run.smithi081.stdout:Get:94 https://1.chacra.ceph.com/r/ceph/reef/48a7de7e6e1701a88fd571c7e34908ac4b8ed412/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 18.2.4-820-g48a7de7e-1jammy [1,494 kB] 2024-09-13T06:36:44.258 INFO:teuthology.orchestra.run.smithi081.stdout:Get:95 https://1.chacra.ceph.com/r/ceph/reef/48a7de7e6e1701a88fd571c7e34908ac4b8ed412/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 18.2.4-820-g48a7de7e-1jammy [6,085 kB] 2024-09-13T06:36:44.478 INFO:teuthology.orchestra.run.smithi081.stdout:Get:96 https://1.chacra.ceph.com/r/ceph/reef/48a7de7e6e1701a88fd571c7e34908ac4b8ed412/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 18.2.4-820-g48a7de7e-1jammy [22.4 MB] 2024-09-13T06:36:44.790 INFO:teuthology.orchestra.run.smithi139.stdout:Get:106 https://1.chacra.ceph.com/r/ceph/reef/48a7de7e6e1701a88fd571c7e34908ac4b8ed412/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 18.2.4-820-g48a7de7e-1jammy [122 kB] 2024-09-13T06:36:44.859 INFO:teuthology.orchestra.run.smithi139.stdout:Get:107 https://1.chacra.ceph.com/r/ceph/reef/48a7de7e6e1701a88fd571c7e34908ac4b8ed412/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 18.2.4-820-g48a7de7e-1jammy [38.3 kB] 2024-09-13T06:36:44.860 INFO:teuthology.orchestra.run.smithi139.stdout:Get:108 https://1.chacra.ceph.com/r/ceph/reef/48a7de7e6e1701a88fd571c7e34908ac4b8ed412/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 18.2.4-820-g48a7de7e-1jammy [11.7 MB] 2024-09-13T06:36:45.120 INFO:teuthology.orchestra.run.smithi139.stdout:Get:109 https://1.chacra.ceph.com/r/ceph/reef/48a7de7e6e1701a88fd571c7e34908ac4b8ed412/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 18.2.4-820-g48a7de7e-1jammy [93.1 kB] 2024-09-13T06:36:45.237 INFO:teuthology.orchestra.run.smithi081.stdout:Get:97 https://1.chacra.ceph.com/r/ceph/reef/48a7de7e6e1701a88fd571c7e34908ac4b8ed412/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 18.2.4-820-g48a7de7e-1jammy [14.2 kB] 2024-09-13T06:36:45.238 INFO:teuthology.orchestra.run.smithi081.stdout:Get:98 https://1.chacra.ceph.com/r/ceph/reef/48a7de7e6e1701a88fd571c7e34908ac4b8ed412/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 18.2.4-820-g48a7de7e-1jammy [834 kB] 2024-09-13T06:36:45.254 INFO:teuthology.orchestra.run.smithi081.stdout:Get:99 https://1.chacra.ceph.com/r/ceph/reef/48a7de7e6e1701a88fd571c7e34908ac4b8ed412/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 18.2.4-820-g48a7de7e-1jammy [2,159 kB] 2024-09-13T06:36:45.292 INFO:teuthology.orchestra.run.smithi081.stdout:Get:100 https://1.chacra.ceph.com/r/ceph/reef/48a7de7e6e1701a88fd571c7e34908ac4b8ed412/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 18.2.4-820-g48a7de7e-1jammy [240 kB] 2024-09-13T06:36:45.295 INFO:teuthology.orchestra.run.smithi081.stdout:Get:101 https://1.chacra.ceph.com/r/ceph/reef/48a7de7e6e1701a88fd571c7e34908ac4b8ed412/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 18.2.4-820-g48a7de7e-1jammy [145 kB] 2024-09-13T06:36:45.297 INFO:teuthology.orchestra.run.smithi081.stdout:Get:102 https://1.chacra.ceph.com/r/ceph/reef/48a7de7e6e1701a88fd571c7e34908ac4b8ed412/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 18.2.4-820-g48a7de7e-1jammy [2,233 kB] 2024-09-13T06:36:45.321 INFO:teuthology.orchestra.run.smithi081.stdout:Get:103 https://1.chacra.ceph.com/r/ceph/reef/48a7de7e6e1701a88fd571c7e34908ac4b8ed412/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 18.2.4-820-g48a7de7e-1jammy [8,625 kB] 2024-09-13T06:36:45.441 INFO:teuthology.orchestra.run.smithi081.stdout:Get:104 https://1.chacra.ceph.com/r/ceph/reef/48a7de7e6e1701a88fd571c7e34908ac4b8ed412/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 18.2.4-820-g48a7de7e-1jammy [14.3 kB] 2024-09-13T06:36:45.441 INFO:teuthology.orchestra.run.smithi081.stdout:Get:105 https://1.chacra.ceph.com/r/ceph/reef/48a7de7e6e1701a88fd571c7e34908ac4b8ed412/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 18.2.4-820-g48a7de7e-1jammy [42.8 MB] 2024-09-13T06:36:45.694 INFO:teuthology.orchestra.run.smithi139.stdout:Fetched 163 MB in 4s (43.3 MB/s) 2024-09-13T06:36:45.837 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package libfmt8:amd64. 2024-09-13T06:36:45.927 INFO:teuthology.orchestra.run.smithi139.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165990 files and directories currently installed.) 2024-09-13T06:36:45.933 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../000-libfmt8_8.1.1+ds1-2_amd64.deb ... 2024-09-13T06:36:46.019 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking libfmt8:amd64 (8.1.1+ds1-2) ... 2024-09-13T06:36:46.324 INFO:teuthology.orchestra.run.smithi081.stdout:Get:106 https://1.chacra.ceph.com/r/ceph/reef/48a7de7e6e1701a88fd571c7e34908ac4b8ed412/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 18.2.4-820-g48a7de7e-1jammy [122 kB] 2024-09-13T06:36:46.327 INFO:teuthology.orchestra.run.smithi081.stdout:Get:107 https://1.chacra.ceph.com/r/ceph/reef/48a7de7e6e1701a88fd571c7e34908ac4b8ed412/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 18.2.4-820-g48a7de7e-1jammy [38.3 kB] 2024-09-13T06:36:46.328 INFO:teuthology.orchestra.run.smithi081.stdout:Get:108 https://1.chacra.ceph.com/r/ceph/reef/48a7de7e6e1701a88fd571c7e34908ac4b8ed412/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 18.2.4-820-g48a7de7e-1jammy [11.7 MB] 2024-09-13T06:36:46.356 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-09-13T06:36:46.382 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../001-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-09-13T06:36:46.422 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-13T06:36:46.485 INFO:teuthology.orchestra.run.smithi081.stdout:Get:109 https://1.chacra.ceph.com/r/ceph/reef/48a7de7e6e1701a88fd571c7e34908ac4b8ed412/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 18.2.4-820-g48a7de7e-1jammy [93.1 kB] 2024-09-13T06:36:46.751 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-09-13T06:36:46.777 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../002-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-09-13T06:36:46.817 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-13T06:36:47.054 INFO:teuthology.orchestra.run.smithi081.stdout:Fetched 163 MB in 5s (32.6 MB/s) 2024-09-13T06:36:47.103 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-09-13T06:36:47.130 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../003-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-09-13T06:36:47.166 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-13T06:36:47.201 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package libfmt8:amd64. 2024-09-13T06:36:47.300 INFO:teuthology.orchestra.run.smithi081.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165990 files and directories currently installed.) 2024-09-13T06:36:47.305 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../000-libfmt8_8.1.1+ds1-2_amd64.deb ... 2024-09-13T06:36:47.399 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking libfmt8:amd64 (8.1.1+ds1-2) ... 2024-09-13T06:36:47.590 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-09-13T06:36:47.617 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../004-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-13T06:36:47.665 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-13T06:36:47.736 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-09-13T06:36:47.762 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../001-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-09-13T06:36:47.802 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-13T06:36:48.129 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-09-13T06:36:48.153 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../005-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-13T06:36:48.156 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-09-13T06:36:48.182 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../002-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-09-13T06:36:48.193 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-13T06:36:48.222 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-13T06:36:48.480 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-09-13T06:36:48.506 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../006-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-13T06:36:48.534 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-09-13T06:36:48.546 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-13T06:36:48.560 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../003-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-09-13T06:36:48.601 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-13T06:36:48.899 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-09-13T06:36:48.926 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../007-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-09-13T06:36:48.966 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-13T06:36:49.063 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-09-13T06:36:49.089 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../004-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-13T06:36:49.137 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-13T06:36:49.261 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package librados2. 2024-09-13T06:36:49.287 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../008-librados2_18.2.4-820-g48a7de7e-1jammy_amd64.deb ... 2024-09-13T06:36:49.327 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking librados2 (18.2.4-820-g48a7de7e-1jammy) ... 2024-09-13T06:36:49.499 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-09-13T06:36:49.525 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../005-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-13T06:36:49.565 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-13T06:36:49.796 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package librbd1. 2024-09-13T06:36:49.822 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../009-librbd1_18.2.4-820-g48a7de7e-1jammy_amd64.deb ... 2024-09-13T06:36:49.863 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking librbd1 (18.2.4-820-g48a7de7e-1jammy) ... 2024-09-13T06:36:49.911 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-09-13T06:36:49.937 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../006-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-13T06:36:49.977 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-13T06:36:50.330 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-09-13T06:36:50.349 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package libcephfs2. 2024-09-13T06:36:50.357 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../007-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-09-13T06:36:50.375 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../010-libcephfs2_18.2.4-820-g48a7de7e-1jammy_amd64.deb ... 2024-09-13T06:36:50.397 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-13T06:36:50.415 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking libcephfs2 (18.2.4-820-g48a7de7e-1jammy) ... 2024-09-13T06:36:50.685 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-rados. 2024-09-13T06:36:50.700 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package librados2. 2024-09-13T06:36:50.711 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../011-python3-rados_18.2.4-820-g48a7de7e-1jammy_amd64.deb ... 2024-09-13T06:36:50.726 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../008-librados2_18.2.4-820-g48a7de7e-1jammy_amd64.deb ... 2024-09-13T06:36:50.743 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-rados (18.2.4-820-g48a7de7e-1jammy) ... 2024-09-13T06:36:50.758 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking librados2 (18.2.4-820-g48a7de7e-1jammy) ... 2024-09-13T06:36:51.046 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-09-13T06:36:51.072 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../012-python3-ceph-argparse_18.2.4-820-g48a7de7e-1jammy_all.deb ... 2024-09-13T06:36:51.112 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-ceph-argparse (18.2.4-820-g48a7de7e-1jammy) ... 2024-09-13T06:36:51.195 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package librbd1. 2024-09-13T06:36:51.221 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../009-librbd1_18.2.4-820-g48a7de7e-1jammy_amd64.deb ... 2024-09-13T06:36:51.261 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking librbd1 (18.2.4-820-g48a7de7e-1jammy) ... 2024-09-13T06:36:51.389 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-cephfs. 2024-09-13T06:36:51.416 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../013-python3-cephfs_18.2.4-820-g48a7de7e-1jammy_amd64.deb ... 2024-09-13T06:36:51.632 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-cephfs (18.2.4-820-g48a7de7e-1jammy) ... 2024-09-13T06:36:51.681 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package libcephfs2. 2024-09-13T06:36:51.707 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../010-libcephfs2_18.2.4-820-g48a7de7e-1jammy_amd64.deb ... 2024-09-13T06:36:51.747 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking libcephfs2 (18.2.4-820-g48a7de7e-1jammy) ... 2024-09-13T06:36:51.950 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-ceph-common. 2024-09-13T06:36:51.977 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../014-python3-ceph-common_18.2.4-820-g48a7de7e-1jammy_all.deb ... 2024-09-13T06:36:52.008 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-rados. 2024-09-13T06:36:52.017 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-ceph-common (18.2.4-820-g48a7de7e-1jammy) ... 2024-09-13T06:36:52.034 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../011-python3-rados_18.2.4-820-g48a7de7e-1jammy_amd64.deb ... 2024-09-13T06:36:52.075 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-rados (18.2.4-820-g48a7de7e-1jammy) ... 2024-09-13T06:36:52.312 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-wcwidth. 2024-09-13T06:36:52.338 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../015-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-09-13T06:36:52.379 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-13T06:36:52.403 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-09-13T06:36:52.429 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../012-python3-ceph-argparse_18.2.4-820-g48a7de7e-1jammy_all.deb ... 2024-09-13T06:36:52.469 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-ceph-argparse (18.2.4-820-g48a7de7e-1jammy) ... 2024-09-13T06:36:52.673 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-prettytable. 2024-09-13T06:36:52.699 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../016-python3-prettytable_2.5.0-2_all.deb ... 2024-09-13T06:36:52.721 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-cephfs. 2024-09-13T06:36:52.739 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-09-13T06:36:52.744 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../013-python3-cephfs_18.2.4-820-g48a7de7e-1jammy_amd64.deb ... 2024-09-13T06:36:52.788 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-cephfs (18.2.4-820-g48a7de7e-1jammy) ... 2024-09-13T06:36:53.000 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-rbd. 2024-09-13T06:36:53.027 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../017-python3-rbd_18.2.4-820-g48a7de7e-1jammy_amd64.deb ... 2024-09-13T06:36:53.067 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-rbd (18.2.4-820-g48a7de7e-1jammy) ... 2024-09-13T06:36:53.425 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-ceph-common. 2024-09-13T06:36:53.437 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-09-13T06:36:53.451 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../014-python3-ceph-common_18.2.4-820-g48a7de7e-1jammy_all.deb ... 2024-09-13T06:36:53.463 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../018-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-09-13T06:36:53.491 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-ceph-common (18.2.4-820-g48a7de7e-1jammy) ... 2024-09-13T06:36:53.503 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-13T06:36:53.778 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-wcwidth. 2024-09-13T06:36:53.804 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../015-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-09-13T06:36:53.823 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package librgw2. 2024-09-13T06:36:53.836 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-13T06:36:53.849 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../019-librgw2_18.2.4-820-g48a7de7e-1jammy_amd64.deb ... 2024-09-13T06:36:53.881 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking librgw2 (18.2.4-820-g48a7de7e-1jammy) ... 2024-09-13T06:36:54.156 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-prettytable. 2024-09-13T06:36:54.182 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../016-python3-prettytable_2.5.0-2_all.deb ... 2024-09-13T06:36:54.222 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-09-13T06:36:54.358 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-rgw. 2024-09-13T06:36:54.373 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../020-python3-rgw_18.2.4-820-g48a7de7e-1jammy_amd64.deb ... 2024-09-13T06:36:54.416 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-rgw (18.2.4-820-g48a7de7e-1jammy) ... 2024-09-13T06:36:54.483 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-rbd. 2024-09-13T06:36:54.509 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../017-python3-rbd_18.2.4-820-g48a7de7e-1jammy_amd64.deb ... 2024-09-13T06:36:54.558 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-rbd (18.2.4-820-g48a7de7e-1jammy) ... 2024-09-13T06:36:54.778 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package liboath0:amd64. 2024-09-13T06:36:54.804 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../021-liboath0_2.6.7-3build1_amd64.deb ... 2024-09-13T06:36:54.844 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-09-13T06:36:54.869 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-09-13T06:36:54.885 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../018-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-09-13T06:36:54.919 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-13T06:36:55.155 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package libradosstriper1. 2024-09-13T06:36:55.182 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../022-libradosstriper1_18.2.4-820-g48a7de7e-1jammy_amd64.deb ... 2024-09-13T06:36:55.222 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking libradosstriper1 (18.2.4-820-g48a7de7e-1jammy) ... 2024-09-13T06:36:55.222 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package librgw2. 2024-09-13T06:36:55.248 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../019-librgw2_18.2.4-820-g48a7de7e-1jammy_amd64.deb ... 2024-09-13T06:36:55.331 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking librgw2 (18.2.4-820-g48a7de7e-1jammy) ... 2024-09-13T06:36:55.584 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package ceph-common. 2024-09-13T06:36:55.610 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../023-ceph-common_18.2.4-820-g48a7de7e-1jammy_amd64.deb ... 2024-09-13T06:36:55.650 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking ceph-common (18.2.4-820-g48a7de7e-1jammy) ... 2024-09-13T06:36:55.808 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-rgw. 2024-09-13T06:36:55.823 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../020-python3-rgw_18.2.4-820-g48a7de7e-1jammy_amd64.deb ... 2024-09-13T06:36:55.866 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-rgw (18.2.4-820-g48a7de7e-1jammy) ... 2024-09-13T06:36:56.211 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package liboath0:amd64. 2024-09-13T06:36:56.237 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../021-liboath0_2.6.7-3build1_amd64.deb ... 2024-09-13T06:36:56.278 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-09-13T06:36:56.547 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package libradosstriper1. 2024-09-13T06:36:56.574 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../022-libradosstriper1_18.2.4-820-g48a7de7e-1jammy_amd64.deb ... 2024-09-13T06:36:56.605 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking libradosstriper1 (18.2.4-820-g48a7de7e-1jammy) ... 2024-09-13T06:36:57.034 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package ceph-common. 2024-09-13T06:36:57.060 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../023-ceph-common_18.2.4-820-g48a7de7e-1jammy_amd64.deb ... 2024-09-13T06:36:57.100 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking ceph-common (18.2.4-820-g48a7de7e-1jammy) ... 2024-09-13T06:36:57.131 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package ceph-base. 2024-09-13T06:36:57.158 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../024-ceph-base_18.2.4-820-g48a7de7e-1jammy_amd64.deb ... 2024-09-13T06:36:57.207 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking ceph-base (18.2.4-820-g48a7de7e-1jammy) ... 2024-09-13T06:36:57.769 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-09-13T06:36:57.796 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../025-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-09-13T06:36:57.861 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-09-13T06:36:58.164 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-cheroot. 2024-09-13T06:36:58.190 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../026-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-09-13T06:36:58.235 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-13T06:36:58.558 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-09-13T06:36:58.565 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package ceph-base. 2024-09-13T06:36:58.584 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../027-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-09-13T06:36:58.591 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../024-ceph-base_18.2.4-820-g48a7de7e-1jammy_amd64.deb ... 2024-09-13T06:36:58.624 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-09-13T06:36:58.716 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking ceph-base (18.2.4-820-g48a7de7e-1jammy) ... 2024-09-13T06:36:58.927 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-jaraco.text. 2024-09-13T06:36:58.954 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../028-python3-jaraco.text_3.6.0-2_all.deb ... 2024-09-13T06:36:58.994 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-09-13T06:36:59.295 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-09-13T06:36:59.297 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-09-13T06:36:59.321 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../025-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-09-13T06:36:59.323 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../029-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-09-13T06:36:59.353 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-09-13T06:36:59.363 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-09-13T06:36:59.632 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-cheroot. 2024-09-13T06:36:59.657 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../026-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-09-13T06:36:59.666 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-tempora. 2024-09-13T06:36:59.692 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../030-python3-tempora_4.1.2-1_all.deb ... 2024-09-13T06:36:59.697 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-13T06:36:59.733 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-09-13T06:37:00.025 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-09-13T06:37:00.027 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-portend. 2024-09-13T06:37:00.051 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../027-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-09-13T06:37:00.054 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../031-python3-portend_3.0.0-1_all.deb ... 2024-09-13T06:37:00.092 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-09-13T06:37:00.094 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-09-13T06:37:00.372 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-09-13T06:37:00.395 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-jaraco.text. 2024-09-13T06:37:00.398 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../032-python3-zc.lockfile_2.0-1_all.deb ... 2024-09-13T06:37:00.421 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../028-python3-jaraco.text_3.6.0-2_all.deb ... 2024-09-13T06:37:00.438 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-09-13T06:37:00.461 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-09-13T06:37:00.708 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-cherrypy3. 2024-09-13T06:37:00.734 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../033-python3-cherrypy3_18.6.1-4_all.deb ... 2024-09-13T06:37:00.756 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-09-13T06:37:00.774 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-09-13T06:37:00.783 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../029-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-09-13T06:37:00.814 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-09-13T06:37:01.113 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-natsort. 2024-09-13T06:37:01.125 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-tempora. 2024-09-13T06:37:01.139 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../034-python3-natsort_8.0.2-1_all.deb ... 2024-09-13T06:37:01.152 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../030-python3-tempora_4.1.2-1_all.deb ... 2024-09-13T06:37:01.192 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-09-13T06:37:01.196 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-09-13T06:37:01.495 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-portend. 2024-09-13T06:37:01.507 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-logutils. 2024-09-13T06:37:01.522 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../031-python3-portend_3.0.0-1_all.deb ... 2024-09-13T06:37:01.534 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../035-python3-logutils_0.3.3-8_all.deb ... 2024-09-13T06:37:01.562 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-09-13T06:37:01.574 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-09-13T06:37:01.852 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-markupsafe. 2024-09-13T06:37:01.864 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-09-13T06:37:01.878 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../036-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-09-13T06:37:01.891 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../032-python3-zc.lockfile_2.0-1_all.deb ... 2024-09-13T06:37:01.941 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-09-13T06:37:01.956 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-09-13T06:37:02.243 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-cherrypy3. 2024-09-13T06:37:02.269 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../033-python3-cherrypy3_18.6.1-4_all.deb ... 2024-09-13T06:37:02.309 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-09-13T06:37:02.346 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-mako. 2024-09-13T06:37:02.372 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../037-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-09-13T06:37:02.413 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-13T06:37:02.663 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-natsort. 2024-09-13T06:37:02.689 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../034-python3-natsort_8.0.2-1_all.deb ... 2024-09-13T06:37:02.729 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-09-13T06:37:02.741 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-simplegeneric. 2024-09-13T06:37:02.767 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../038-python3-simplegeneric_0.8.1-3_all.deb ... 2024-09-13T06:37:02.807 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-09-13T06:37:03.008 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-logutils. 2024-09-13T06:37:03.034 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../035-python3-logutils_0.3.3-8_all.deb ... 2024-09-13T06:37:03.066 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-09-13T06:37:03.110 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-singledispatch. 2024-09-13T06:37:03.136 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../039-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-09-13T06:37:03.176 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-09-13T06:37:03.344 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-markupsafe. 2024-09-13T06:37:03.370 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../036-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-09-13T06:37:03.410 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-09-13T06:37:03.454 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-webob. 2024-09-13T06:37:03.480 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../040-python3-webob_1%3a1.8.6-1.1ubuntu0.1_all.deb ... 2024-09-13T06:37:03.521 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-13T06:37:03.731 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-mako. 2024-09-13T06:37:03.758 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../037-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-09-13T06:37:03.796 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-13T06:37:03.824 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-waitress. 2024-09-13T06:37:03.839 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../041-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-09-13T06:37:03.877 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-13T06:37:04.108 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-simplegeneric. 2024-09-13T06:37:04.135 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../038-python3-simplegeneric_0.8.1-3_all.deb ... 2024-09-13T06:37:04.175 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-09-13T06:37:04.185 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-tempita. 2024-09-13T06:37:04.211 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../042-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-09-13T06:37:04.251 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-09-13T06:37:04.444 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-singledispatch. 2024-09-13T06:37:04.470 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../039-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-09-13T06:37:04.503 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-09-13T06:37:04.596 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-paste. 2024-09-13T06:37:04.622 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../043-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-09-13T06:37:04.662 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-09-13T06:37:04.781 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-webob. 2024-09-13T06:37:04.807 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../040-python3-webob_1%3a1.8.6-1.1ubuntu0.1_all.deb ... 2024-09-13T06:37:04.847 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-13T06:37:04.949 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-09-13T06:37:04.976 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../044-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-09-13T06:37:05.015 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-09-13T06:37:05.192 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-waitress. 2024-09-13T06:37:05.218 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../041-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-09-13T06:37:05.285 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-pastedeploy. 2024-09-13T06:37:05.286 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-13T06:37:05.311 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../045-python3-pastedeploy_2.1.1-1_all.deb ... 2024-09-13T06:37:05.343 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-09-13T06:37:05.578 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-tempita. 2024-09-13T06:37:05.605 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../042-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-09-13T06:37:05.645 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-09-13T06:37:05.654 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-webtest. 2024-09-13T06:37:05.681 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../046-python3-webtest_2.0.35-1_all.deb ... 2024-09-13T06:37:05.721 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-09-13T06:37:05.923 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-paste. 2024-09-13T06:37:05.939 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../043-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-09-13T06:37:05.973 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-09-13T06:37:06.032 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-pecan. 2024-09-13T06:37:06.060 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../047-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-09-13T06:37:06.098 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-09-13T06:37:06.293 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-09-13T06:37:06.319 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../044-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-09-13T06:37:06.368 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-09-13T06:37:06.444 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-certifi. 2024-09-13T06:37:06.471 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../048-python3-certifi_2020.6.20-1_all.deb ... 2024-09-13T06:37:06.511 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-09-13T06:37:06.645 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-pastedeploy. 2024-09-13T06:37:06.672 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../045-python3-pastedeploy_2.1.1-1_all.deb ... 2024-09-13T06:37:06.712 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-09-13T06:37:06.806 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-idna. 2024-09-13T06:37:06.832 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../049-python3-idna_3.3-1ubuntu0.1_all.deb ... 2024-09-13T06:37:06.863 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-idna (3.3-1ubuntu0.1) ... 2024-09-13T06:37:06.965 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-webtest. 2024-09-13T06:37:06.991 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../046-python3-webtest_2.0.35-1_all.deb ... 2024-09-13T06:37:07.032 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-09-13T06:37:07.175 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-urllib3. 2024-09-13T06:37:07.202 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../050-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-09-13T06:37:07.241 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-13T06:37:07.351 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-pecan. 2024-09-13T06:37:07.378 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../047-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-09-13T06:37:07.418 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-09-13T06:37:07.561 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-requests. 2024-09-13T06:37:07.588 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../051-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-09-13T06:37:07.627 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-13T06:37:07.773 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-certifi. 2024-09-13T06:37:07.800 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../048-python3-certifi_2020.6.20-1_all.deb ... 2024-09-13T06:37:07.839 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-09-13T06:37:07.972 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-werkzeug. 2024-09-13T06:37:07.999 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../052-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.2_all.deb ... 2024-09-13T06:37:08.039 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-13T06:37:08.159 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-idna. 2024-09-13T06:37:08.185 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../049-python3-idna_3.3-1ubuntu0.1_all.deb ... 2024-09-13T06:37:08.225 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-idna (3.3-1ubuntu0.1) ... 2024-09-13T06:37:08.333 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-09-13T06:37:08.349 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../053-ceph-mgr-modules-core_18.2.4-820-g48a7de7e-1jammy_all.deb ... 2024-09-13T06:37:08.391 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking ceph-mgr-modules-core (18.2.4-820-g48a7de7e-1jammy) ... 2024-09-13T06:37:08.495 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-urllib3. 2024-09-13T06:37:08.522 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../050-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-09-13T06:37:08.554 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-13T06:37:08.788 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-09-13T06:37:08.815 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../054-libsqlite3-mod-ceph_18.2.4-820-g48a7de7e-1jammy_amd64.deb ... 2024-09-13T06:37:08.846 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking libsqlite3-mod-ceph (18.2.4-820-g48a7de7e-1jammy) ... 2024-09-13T06:37:08.985 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-requests. 2024-09-13T06:37:09.012 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../051-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-09-13T06:37:09.057 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-13T06:37:09.124 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-bcrypt. 2024-09-13T06:37:09.151 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../055-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-09-13T06:37:09.190 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-09-13T06:37:09.352 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-werkzeug. 2024-09-13T06:37:09.370 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../052-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.2_all.deb ... 2024-09-13T06:37:09.410 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-13T06:37:09.493 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-openssl. 2024-09-13T06:37:09.520 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../056-python3-openssl_21.0.0-1_all.deb ... 2024-09-13T06:37:09.560 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-09-13T06:37:09.705 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-09-13T06:37:09.720 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../053-ceph-mgr-modules-core_18.2.4-820-g48a7de7e-1jammy_all.deb ... 2024-09-13T06:37:09.755 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking ceph-mgr-modules-core (18.2.4-820-g48a7de7e-1jammy) ... 2024-09-13T06:37:09.896 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package ceph-mgr. 2024-09-13T06:37:09.923 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../057-ceph-mgr_18.2.4-820-g48a7de7e-1jammy_amd64.deb ... 2024-09-13T06:37:09.962 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking ceph-mgr (18.2.4-820-g48a7de7e-1jammy) ... 2024-09-13T06:37:10.118 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-09-13T06:37:10.144 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../054-libsqlite3-mod-ceph_18.2.4-820-g48a7de7e-1jammy_amd64.deb ... 2024-09-13T06:37:10.193 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking libsqlite3-mod-ceph (18.2.4-820-g48a7de7e-1jammy) ... 2024-09-13T06:37:10.315 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package ceph-mon. 2024-09-13T06:37:10.342 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../058-ceph-mon_18.2.4-820-g48a7de7e-1jammy_amd64.deb ... 2024-09-13T06:37:10.373 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking ceph-mon (18.2.4-820-g48a7de7e-1jammy) ... 2024-09-13T06:37:10.463 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-bcrypt. 2024-09-13T06:37:10.489 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../055-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-09-13T06:37:10.521 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-09-13T06:37:10.799 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-openssl. 2024-09-13T06:37:10.825 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../056-python3-openssl_21.0.0-1_all.deb ... 2024-09-13T06:37:10.865 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-09-13T06:37:10.969 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package ceph-osd. 2024-09-13T06:37:10.996 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../059-ceph-osd_18.2.4-820-g48a7de7e-1jammy_amd64.deb ... 2024-09-13T06:37:11.035 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking ceph-osd (18.2.4-820-g48a7de7e-1jammy) ... 2024-09-13T06:37:11.202 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package ceph-mgr. 2024-09-13T06:37:11.229 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../057-ceph-mgr_18.2.4-820-g48a7de7e-1jammy_amd64.deb ... 2024-09-13T06:37:11.276 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking ceph-mgr (18.2.4-820-g48a7de7e-1jammy) ... 2024-09-13T06:37:11.613 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package ceph-mon. 2024-09-13T06:37:11.636 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../058-ceph-mon_18.2.4-820-g48a7de7e-1jammy_amd64.deb ... 2024-09-13T06:37:11.680 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking ceph-mon (18.2.4-820-g48a7de7e-1jammy) ... 2024-09-13T06:37:12.138 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package ceph. 2024-09-13T06:37:12.159 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../060-ceph_18.2.4-820-g48a7de7e-1jammy_amd64.deb ... 2024-09-13T06:37:12.292 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package ceph-osd. 2024-09-13T06:37:12.321 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../059-ceph-osd_18.2.4-820-g48a7de7e-1jammy_amd64.deb ... 2024-09-13T06:37:12.338 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking ceph (18.2.4-820-g48a7de7e-1jammy) ... 2024-09-13T06:37:12.358 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking ceph-osd (18.2.4-820-g48a7de7e-1jammy) ... 2024-09-13T06:37:12.649 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package ceph-fuse. 2024-09-13T06:37:12.676 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../061-ceph-fuse_18.2.4-820-g48a7de7e-1jammy_amd64.deb ... 2024-09-13T06:37:13.057 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking ceph-fuse (18.2.4-820-g48a7de7e-1jammy) ... 2024-09-13T06:37:13.412 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package ceph. 2024-09-13T06:37:13.439 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../060-ceph_18.2.4-820-g48a7de7e-1jammy_amd64.deb ... 2024-09-13T06:37:13.478 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking ceph (18.2.4-820-g48a7de7e-1jammy) ... 2024-09-13T06:37:13.731 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package ceph-fuse. 2024-09-13T06:37:13.758 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../061-ceph-fuse_18.2.4-820-g48a7de7e-1jammy_amd64.deb ... 2024-09-13T06:37:13.794 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package ceph-mds. 2024-09-13T06:37:13.797 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking ceph-fuse (18.2.4-820-g48a7de7e-1jammy) ... 2024-09-13T06:37:13.821 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../062-ceph-mds_18.2.4-820-g48a7de7e-1jammy_amd64.deb ... 2024-09-13T06:37:13.861 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking ceph-mds (18.2.4-820-g48a7de7e-1jammy) ... 2024-09-13T06:37:14.177 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package ceph-mds. 2024-09-13T06:37:14.203 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../062-ceph-mds_18.2.4-820-g48a7de7e-1jammy_amd64.deb ... 2024-09-13T06:37:14.243 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking ceph-mds (18.2.4-820-g48a7de7e-1jammy) ... 2024-09-13T06:37:14.255 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package cephadm. 2024-09-13T06:37:14.283 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../063-cephadm_18.2.4-820-g48a7de7e-1jammy_amd64.deb ... 2024-09-13T06:37:14.322 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking cephadm (18.2.4-820-g48a7de7e-1jammy) ... 2024-09-13T06:37:14.646 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package cephadm. 2024-09-13T06:37:14.658 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-asyncssh. 2024-09-13T06:37:14.673 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../063-cephadm_18.2.4-820-g48a7de7e-1jammy_amd64.deb ... 2024-09-13T06:37:14.685 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../064-python3-asyncssh_2.5.0-1_all.deb ... 2024-09-13T06:37:14.713 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking cephadm (18.2.4-820-g48a7de7e-1jammy) ... 2024-09-13T06:37:14.724 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-09-13T06:37:15.028 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python-babel-localedata. 2024-09-13T06:37:15.054 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../065-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-09-13T06:37:15.094 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-13T06:37:15.691 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-asyncssh. 2024-09-13T06:37:15.706 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../064-python3-asyncssh_2.5.0-1_all.deb ... 2024-09-13T06:37:15.749 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-09-13T06:37:16.036 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python-babel-localedata. 2024-09-13T06:37:16.051 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../065-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-09-13T06:37:16.094 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-13T06:37:16.107 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-babel. 2024-09-13T06:37:16.134 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../066-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-09-13T06:37:16.165 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-09-13T06:37:16.476 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-jinja2. 2024-09-13T06:37:16.504 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../067-python3-jinja2_3.0.3-1ubuntu0.2_all.deb ... 2024-09-13T06:37:16.543 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-13T06:37:16.880 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-09-13T06:37:16.907 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../068-ceph-mgr-cephadm_18.2.4-820-g48a7de7e-1jammy_all.deb ... 2024-09-13T06:37:16.946 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking ceph-mgr-cephadm (18.2.4-820-g48a7de7e-1jammy) ... 2024-09-13T06:37:17.116 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-babel. 2024-09-13T06:37:17.143 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../066-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-09-13T06:37:17.182 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-09-13T06:37:17.299 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-pluggy. 2024-09-13T06:37:17.327 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../069-python3-pluggy_0.13.0-7.1_all.deb ... 2024-09-13T06:37:17.366 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-09-13T06:37:17.519 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-jinja2. 2024-09-13T06:37:17.546 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../067-python3-jinja2_3.0.3-1ubuntu0.2_all.deb ... 2024-09-13T06:37:17.585 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-13T06:37:17.677 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-py. 2024-09-13T06:37:17.704 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../070-python3-py_1.10.0-1_all.deb ... 2024-09-13T06:37:17.743 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-py (1.10.0-1) ... 2024-09-13T06:37:17.906 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-09-13T06:37:17.932 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../068-ceph-mgr-cephadm_18.2.4-820-g48a7de7e-1jammy_all.deb ... 2024-09-13T06:37:17.972 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking ceph-mgr-cephadm (18.2.4-820-g48a7de7e-1jammy) ... 2024-09-13T06:37:18.097 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-iniconfig. 2024-09-13T06:37:18.124 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../071-python3-iniconfig_1.1.1-2_all.deb ... 2024-09-13T06:37:18.164 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-09-13T06:37:18.284 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-pluggy. 2024-09-13T06:37:18.310 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../069-python3-pluggy_0.13.0-7.1_all.deb ... 2024-09-13T06:37:18.350 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-09-13T06:37:18.450 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-toml. 2024-09-13T06:37:18.476 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../072-python3-toml_0.10.2-1_all.deb ... 2024-09-13T06:37:18.516 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-09-13T06:37:18.671 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-py. 2024-09-13T06:37:18.697 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../070-python3-py_1.10.0-1_all.deb ... 2024-09-13T06:37:18.737 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-py (1.10.0-1) ... 2024-09-13T06:37:18.836 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-pytest. 2024-09-13T06:37:18.862 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../073-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-09-13T06:37:18.902 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-09-13T06:37:19.057 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-iniconfig. 2024-09-13T06:37:19.086 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../071-python3-iniconfig_1.1.1-2_all.deb ... 2024-09-13T06:37:19.222 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-repoze.lru. 2024-09-13T06:37:19.249 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../074-python3-repoze.lru_0.7-2_all.deb ... 2024-09-13T06:37:19.292 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-09-13T06:37:19.307 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-09-13T06:37:19.592 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-routes. 2024-09-13T06:37:19.610 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-toml. 2024-09-13T06:37:19.619 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../075-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-09-13T06:37:19.637 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../072-python3-toml_0.10.2-1_all.deb ... 2024-09-13T06:37:19.658 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-09-13T06:37:19.685 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-09-13T06:37:19.963 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-pytest. 2024-09-13T06:37:19.979 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../073-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-09-13T06:37:19.995 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-09-13T06:37:20.013 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-09-13T06:37:20.021 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../076-ceph-mgr-dashboard_18.2.4-820-g48a7de7e-1jammy_all.deb ... 2024-09-13T06:37:20.061 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking ceph-mgr-dashboard (18.2.4-820-g48a7de7e-1jammy) ... 2024-09-13T06:37:20.359 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-repoze.lru. 2024-09-13T06:37:20.385 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../074-python3-repoze.lru_0.7-2_all.deb ... 2024-09-13T06:37:20.425 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-09-13T06:37:20.712 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-routes. 2024-09-13T06:37:20.738 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../075-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-09-13T06:37:20.778 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-09-13T06:37:21.107 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-09-13T06:37:21.133 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../076-ceph-mgr-dashboard_18.2.4-820-g48a7de7e-1jammy_all.deb ... 2024-09-13T06:37:21.173 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking ceph-mgr-dashboard (18.2.4-820-g48a7de7e-1jammy) ... 2024-09-13T06:37:21.308 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-09-13T06:37:21.337 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../077-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-09-13T06:37:21.374 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-13T06:37:21.903 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-joblib. 2024-09-13T06:37:21.930 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../078-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-09-13T06:37:21.969 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-09-13T06:37:22.323 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-09-13T06:37:22.350 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../079-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-09-13T06:37:22.389 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-09-13T06:37:22.445 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-09-13T06:37:22.461 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../077-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-09-13T06:37:22.495 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-13T06:37:22.917 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-sklearn. 2024-09-13T06:37:22.944 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../080-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-09-13T06:37:22.966 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-joblib. 2024-09-13T06:37:22.984 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-13T06:37:22.992 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../078-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-09-13T06:37:23.024 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-09-13T06:37:23.377 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-09-13T06:37:23.405 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../079-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-09-13T06:37:23.452 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-09-13T06:37:23.692 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-09-13T06:37:23.714 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-sklearn. 2024-09-13T06:37:23.719 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../081-ceph-mgr-diskprediction-local_18.2.4-820-g48a7de7e-1jammy_all.deb ... 2024-09-13T06:37:23.730 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../080-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-09-13T06:37:23.758 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking ceph-mgr-diskprediction-local (18.2.4-820-g48a7de7e-1jammy) ... 2024-09-13T06:37:23.763 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-13T06:37:24.474 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-09-13T06:37:24.502 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../081-ceph-mgr-diskprediction-local_18.2.4-820-g48a7de7e-1jammy_all.deb ... 2024-09-13T06:37:24.541 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking ceph-mgr-diskprediction-local (18.2.4-820-g48a7de7e-1jammy) ... 2024-09-13T06:37:24.678 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-cachetools. 2024-09-13T06:37:24.705 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../082-python3-cachetools_5.0.0-1_all.deb ... 2024-09-13T06:37:24.736 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-09-13T06:37:25.107 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-pyasn1. 2024-09-13T06:37:25.134 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../083-python3-pyasn1_0.4.8-1_all.deb ... 2024-09-13T06:37:25.174 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-09-13T06:37:25.510 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-09-13T06:37:25.518 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-cachetools. 2024-09-13T06:37:25.538 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../084-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-09-13T06:37:25.546 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../082-python3-cachetools_5.0.0-1_all.deb ... 2024-09-13T06:37:25.577 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-09-13T06:37:25.577 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-09-13T06:37:25.871 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-rsa. 2024-09-13T06:37:25.899 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../085-python3-rsa_4.8-1_all.deb ... 2024-09-13T06:37:25.938 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-rsa (4.8-1) ... 2024-09-13T06:37:25.948 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-pyasn1. 2024-09-13T06:37:25.975 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../083-python3-pyasn1_0.4.8-1_all.deb ... 2024-09-13T06:37:26.015 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-09-13T06:37:26.200 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-google-auth. 2024-09-13T06:37:26.215 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../086-python3-google-auth_1.5.1-3_all.deb ... 2024-09-13T06:37:26.249 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-09-13T06:37:26.327 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-09-13T06:37:26.354 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../084-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-09-13T06:37:26.393 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-09-13T06:37:26.553 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-09-13T06:37:26.580 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../087-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-09-13T06:37:26.619 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-13T06:37:26.704 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-rsa. 2024-09-13T06:37:26.732 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../085-python3-rsa_4.8-1_all.deb ... 2024-09-13T06:37:26.771 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-rsa (4.8-1) ... 2024-09-13T06:37:26.939 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-websocket. 2024-09-13T06:37:26.966 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../088-python3-websocket_1.2.3-1_all.deb ... 2024-09-13T06:37:27.005 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-09-13T06:37:27.041 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-google-auth. 2024-09-13T06:37:27.057 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../086-python3-google-auth_1.5.1-3_all.deb ... 2024-09-13T06:37:27.091 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-09-13T06:37:27.317 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-kubernetes. 2024-09-13T06:37:27.344 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../089-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-09-13T06:37:27.383 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-13T06:37:27.386 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-09-13T06:37:27.414 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../087-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-09-13T06:37:27.453 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-13T06:37:27.765 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-websocket. 2024-09-13T06:37:27.792 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../088-python3-websocket_1.2.3-1_all.deb ... 2024-09-13T06:37:27.831 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-09-13T06:37:27.997 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-09-13T06:37:28.013 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../090-ceph-mgr-k8sevents_18.2.4-820-g48a7de7e-1jammy_all.deb ... 2024-09-13T06:37:28.047 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking ceph-mgr-k8sevents (18.2.4-820-g48a7de7e-1jammy) ... 2024-09-13T06:37:28.143 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-kubernetes. 2024-09-13T06:37:28.170 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../089-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-09-13T06:37:28.209 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-13T06:37:28.333 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package libonig5:amd64. 2024-09-13T06:37:28.360 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../091-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-09-13T06:37:28.399 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-13T06:37:28.735 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package libjq1:amd64. 2024-09-13T06:37:28.762 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../092-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-09-13T06:37:28.802 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-13T06:37:28.882 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-09-13T06:37:28.910 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../090-ceph-mgr-k8sevents_18.2.4-820-g48a7de7e-1jammy_all.deb ... 2024-09-13T06:37:28.948 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking ceph-mgr-k8sevents (18.2.4-820-g48a7de7e-1jammy) ... 2024-09-13T06:37:29.063 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package jq. 2024-09-13T06:37:29.091 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../093-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-09-13T06:37:29.129 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-09-13T06:37:29.260 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package libonig5:amd64. 2024-09-13T06:37:29.287 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../091-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-09-13T06:37:29.326 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-13T06:37:29.332 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package socat. 2024-09-13T06:37:29.348 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../094-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-09-13T06:37:29.382 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-09-13T06:37:29.637 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package libjq1:amd64. 2024-09-13T06:37:29.653 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../092-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-09-13T06:37:29.660 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package xmlstarlet. 2024-09-13T06:37:29.675 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../095-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-09-13T06:37:29.687 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-13T06:37:29.710 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-09-13T06:37:29.925 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package jq. 2024-09-13T06:37:29.951 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../093-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-09-13T06:37:29.990 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-09-13T06:37:30.056 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package ceph-test. 2024-09-13T06:37:30.071 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../096-ceph-test_18.2.4-820-g48a7de7e-1jammy_amd64.deb ... 2024-09-13T06:37:30.114 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking ceph-test (18.2.4-820-g48a7de7e-1jammy) ... 2024-09-13T06:37:30.226 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package socat. 2024-09-13T06:37:30.254 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../094-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-09-13T06:37:30.292 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-09-13T06:37:30.596 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package xmlstarlet. 2024-09-13T06:37:30.623 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../095-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-09-13T06:37:30.662 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-09-13T06:37:30.992 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package ceph-test. 2024-09-13T06:37:31.019 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../096-ceph-test_18.2.4-820-g48a7de7e-1jammy_amd64.deb ... 2024-09-13T06:37:31.058 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking ceph-test (18.2.4-820-g48a7de7e-1jammy) ... 2024-09-13T06:37:31.918 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package ceph-volume. 2024-09-13T06:37:31.945 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../097-ceph-volume_18.2.4-820-g48a7de7e-1jammy_all.deb ... 2024-09-13T06:37:31.984 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking ceph-volume (18.2.4-820-g48a7de7e-1jammy) ... 2024-09-13T06:37:32.279 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package libcephfs-dev. 2024-09-13T06:37:32.295 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../098-libcephfs-dev_18.2.4-820-g48a7de7e-1jammy_amd64.deb ... 2024-09-13T06:37:32.329 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking libcephfs-dev (18.2.4-820-g48a7de7e-1jammy) ... 2024-09-13T06:37:32.640 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package nvme-cli. 2024-09-13T06:37:32.656 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../099-nvme-cli_1.16-3ubuntu0.3_amd64.deb ... 2024-09-13T06:37:32.690 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking nvme-cli (1.16-3ubuntu0.3) ... 2024-09-13T06:37:32.962 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package ceph-volume. 2024-09-13T06:37:32.987 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-09-13T06:37:32.993 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../097-ceph-volume_18.2.4-820-g48a7de7e-1jammy_all.deb ... 2024-09-13T06:37:33.003 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../100-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-09-13T06:37:33.029 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking ceph-volume (18.2.4-820-g48a7de7e-1jammy) ... 2024-09-13T06:37:33.045 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-09-13T06:37:33.308 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package libcephfs-dev. 2024-09-13T06:37:33.324 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../098-libcephfs-dev_18.2.4-820-g48a7de7e-1jammy_amd64.deb ... 2024-09-13T06:37:33.366 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking libcephfs-dev (18.2.4-820-g48a7de7e-1jammy) ... 2024-09-13T06:37:33.681 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-pastescript. 2024-09-13T06:37:33.694 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../101-python3-pastescript_2.0.2-4_all.deb ... 2024-09-13T06:37:33.723 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-09-13T06:37:33.753 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package nvme-cli. 2024-09-13T06:37:33.780 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../099-nvme-cli_1.16-3ubuntu0.3_amd64.deb ... 2024-09-13T06:37:33.819 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking nvme-cli (1.16-3ubuntu0.3) ... 2024-09-13T06:37:34.018 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-psutil. 2024-09-13T06:37:34.045 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../102-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-09-13T06:37:34.084 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-09-13T06:37:34.166 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-09-13T06:37:34.182 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../100-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-09-13T06:37:34.316 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-09-13T06:37:34.520 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-pygments. 2024-09-13T06:37:34.548 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../103-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-09-13T06:37:34.578 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-09-13T06:37:35.036 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-pastescript. 2024-09-13T06:37:35.049 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-pyinotify. 2024-09-13T06:37:35.064 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../101-python3-pastescript_2.0.2-4_all.deb ... 2024-09-13T06:37:35.077 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../104-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-09-13T06:37:35.102 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-09-13T06:37:35.115 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-09-13T06:37:35.427 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-simplejson. 2024-09-13T06:37:35.454 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../105-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-09-13T06:37:35.456 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-psutil. 2024-09-13T06:37:35.484 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../102-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-09-13T06:37:35.493 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-09-13T06:37:35.523 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-09-13T06:37:35.770 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-09-13T06:37:35.786 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../106-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-09-13T06:37:35.829 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-09-13T06:37:35.868 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-pygments. 2024-09-13T06:37:35.895 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../103-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-09-13T06:37:35.942 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-09-13T06:37:36.397 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-pyinotify. 2024-09-13T06:37:36.424 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../104-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-09-13T06:37:36.465 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-09-13T06:37:36.499 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package radosgw. 2024-09-13T06:37:36.527 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../107-radosgw_18.2.4-820-g48a7de7e-1jammy_amd64.deb ... 2024-09-13T06:37:36.566 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking radosgw (18.2.4-820-g48a7de7e-1jammy) ... 2024-09-13T06:37:36.733 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-simplejson. 2024-09-13T06:37:36.760 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../105-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-09-13T06:37:36.799 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-09-13T06:37:37.044 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-09-13T06:37:37.071 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../106-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-09-13T06:37:37.110 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-09-13T06:37:37.252 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package rbd-fuse. 2024-09-13T06:37:37.265 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../108-rbd-fuse_18.2.4-820-g48a7de7e-1jammy_amd64.deb ... 2024-09-13T06:37:37.302 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking rbd-fuse (18.2.4-820-g48a7de7e-1jammy) ... 2024-09-13T06:37:37.599 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-09-13T06:37:37.822 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package radosgw. 2024-09-13T06:37:37.850 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../107-radosgw_18.2.4-820-g48a7de7e-1jammy_amd64.deb ... 2024-09-13T06:37:37.858 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-13T06:37:37.897 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking radosgw (18.2.4-820-g48a7de7e-1jammy) ... 2024-09-13T06:37:37.984 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up nvme-cli (1.16-3ubuntu0.3) ... 2024-09-13T06:37:38.247 INFO:teuthology.orchestra.run.smithi139.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-09-13T06:37:38.603 INFO:teuthology.orchestra.run.smithi139.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-09-13T06:37:38.659 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package rbd-fuse. 2024-09-13T06:37:38.674 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../108-rbd-fuse_18.2.4-820-g48a7de7e-1jammy_amd64.deb ... 2024-09-13T06:37:38.708 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking rbd-fuse (18.2.4-820-g48a7de7e-1jammy) ... 2024-09-13T06:37:39.004 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-09-13T06:37:39.012 INFO:teuthology.orchestra.run.smithi139.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-09-13T06:37:39.077 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up cephadm (18.2.4-820-g48a7de7e-1jammy) ... 2024-09-13T06:37:39.246 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-13T06:37:39.373 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up nvme-cli (1.16-3ubuntu0.3) ... 2024-09-13T06:37:39.577 INFO:teuthology.orchestra.run.smithi139.stdout:Adding system user cephadm....done 2024-09-13T06:37:39.637 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-09-13T06:37:39.700 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-13T06:37:39.967 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-09-13T06:37:39.976 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-09-13T06:37:40.236 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-09-13T06:37:40.337 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-09-13T06:37:40.378 INFO:teuthology.orchestra.run.smithi081.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-09-13T06:37:40.450 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up cephadm (18.2.4-820-g48a7de7e-1jammy) ... 2024-09-13T06:37:40.571 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-09-13T06:37:40.839 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-09-13T06:37:40.965 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-py (1.10.0-1) ... 2024-09-13T06:37:40.983 INFO:teuthology.orchestra.run.smithi081.stdout:Adding system user cephadm....done 2024-09-13T06:37:41.148 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-13T06:37:41.292 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-09-13T06:37:41.424 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-09-13T06:37:41.652 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-09-13T06:37:41.692 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-09-13T06:37:41.793 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-09-13T06:37:41.894 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-09-13T06:37:42.053 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-09-13T06:37:42.145 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-09-13T06:37:42.287 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-09-13T06:37:42.388 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-09-13T06:37:42.413 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-py (1.10.0-1) ... 2024-09-13T06:37:42.640 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-09-13T06:37:42.732 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-09-13T06:37:42.890 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-ceph-argparse (18.2.4-820-g48a7de7e-1jammy) ... 2024-09-13T06:37:43.092 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-09-13T06:37:43.150 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-13T06:37:43.276 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-09-13T06:37:43.335 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-09-13T06:37:43.552 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-13T06:37:43.595 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-09-13T06:37:43.805 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-09-13T06:37:43.829 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-09-13T06:37:44.088 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-09-13T06:37:44.287 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-13T06:37:44.356 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-ceph-argparse (18.2.4-820-g48a7de7e-1jammy) ... 2024-09-13T06:37:44.427 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-09-13T06:37:44.616 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-13T06:37:44.698 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-09-13T06:37:44.833 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-09-13T06:37:44.957 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-09-13T06:37:45.093 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-13T06:37:45.227 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-09-13T06:37:45.258 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-09-13T06:37:45.570 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-13T06:37:45.690 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-09-13T06:37:45.918 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-09-13T06:37:45.956 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-09-13T06:37:46.161 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-09-13T06:37:46.223 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-09-13T06:37:46.270 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-09-13T06:37:46.388 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-13T06:37:46.533 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-09-13T06:37:46.697 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-09-13T06:37:47.098 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-09-13T06:37:47.185 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-09-13T06:37:47.349 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-09-13T06:37:47.445 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-09-13T06:37:47.545 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-09-13T06:37:47.671 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-13T06:37:47.729 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-13T06:37:47.964 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-09-13T06:37:48.044 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-13T06:37:48.349 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-09-13T06:37:48.370 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-09-13T06:37:48.592 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-09-13T06:37:48.596 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-09-13T06:37:48.697 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-ceph-common (18.2.4-820-g48a7de7e-1jammy) ... 2024-09-13T06:37:48.952 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-13T06:37:48.998 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-idna (3.3-1ubuntu0.1) ... 2024-09-13T06:37:49.220 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-13T06:37:49.324 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-13T06:37:49.546 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-09-13T06:37:49.790 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-09-13T06:37:49.915 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-ceph-common (18.2.4-820-g48a7de7e-1jammy) ... 2024-09-13T06:37:50.325 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-idna (3.3-1ubuntu0.1) ... 2024-09-13T06:37:50.513 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-13T06:37:50.643 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-13T06:37:50.656 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-toml (0.10.2-1) ... 2024-09-13T06:37:50.915 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-13T06:37:51.041 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-09-13T06:37:51.192 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-13T06:37:51.493 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-09-13T06:37:51.727 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-09-13T06:37:51.773 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-13T06:37:51.933 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-toml (0.10.2-1) ... 2024-09-13T06:37:51.953 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-13T06:37:52.071 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up libfmt8:amd64 (8.1.1+ds1-2) ... 2024-09-13T06:37:52.192 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-13T06:37:52.205 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-09-13T06:37:52.302 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-09-13T06:37:52.419 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-13T06:37:52.507 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-09-13T06:37:52.721 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-09-13T06:37:52.758 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-09-13T06:37:52.972 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-09-13T06:37:53.034 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-09-13T06:37:53.232 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-13T06:37:53.293 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-09-13T06:37:53.358 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up libfmt8:amd64 (8.1.1+ds1-2) ... 2024-09-13T06:37:53.484 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-09-13T06:37:53.519 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-09-13T06:37:53.762 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-13T06:37:53.785 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-09-13T06:37:53.904 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-09-13T06:37:54.019 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-09-13T06:37:54.270 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-09-13T06:37:54.281 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-13T06:37:54.432 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-13T06:37:54.522 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-09-13T06:37:54.741 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-13T06:37:54.773 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-09-13T06:37:55.032 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-13T06:37:55.034 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-09-13T06:37:55.159 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-09-13T06:37:55.269 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-09-13T06:37:55.460 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-13T06:37:55.569 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-13T06:37:55.693 INFO:teuthology.orchestra.run.smithi139.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-09-13T06:37:55.853 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-13T06:37:55.946 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-13T06:37:56.080 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-09-13T06:37:56.146 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-09-13T06:37:56.406 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-09-13T06:37:56.490 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-09-13T06:37:56.749 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-portend (3.0.0-1) ... 2024-09-13T06:37:56.813 INFO:teuthology.orchestra.run.smithi081.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-09-13T06:37:57.000 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-13T06:37:57.042 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-13T06:37:57.101 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-13T06:37:57.160 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-09-13T06:37:57.394 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-09-13T06:37:57.536 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-09-13T06:37:57.670 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-13T06:37:57.804 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-portend (3.0.0-1) ... 2024-09-13T06:37:57.971 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-09-13T06:37:58.055 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-13T06:37:58.106 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-rsa (4.8-1) ... 2024-09-13T06:37:58.182 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-13T06:37:58.382 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-09-13T06:37:58.524 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-09-13T06:37:58.657 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-13T06:37:58.834 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-13T06:37:58.917 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-09-13T06:37:59.101 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-09-13T06:37:59.219 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-rsa (4.8-1) ... 2024-09-13T06:37:59.285 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-09-13T06:37:59.495 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-09-13T06:37:59.561 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-09-13T06:37:59.763 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-13T06:37:59.888 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-13T06:38:00.014 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up librados2 (18.2.4-820-g48a7de7e-1jammy) ... 2024-09-13T06:38:00.031 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-09-13T06:38:00.140 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up librgw2 (18.2.4-820-g48a7de7e-1jammy) ... 2024-09-13T06:38:00.266 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up libsqlite3-mod-ceph (18.2.4-820-g48a7de7e-1jammy) ... 2024-09-13T06:38:00.367 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up libcephfs2 (18.2.4-820-g48a7de7e-1jammy) ... 2024-09-13T06:38:00.433 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-09-13T06:38:00.468 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up libradosstriper1 (18.2.4-820-g48a7de7e-1jammy) ... 2024-09-13T06:38:00.671 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-09-13T06:38:00.734 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-09-13T06:38:00.964 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up librbd1 (18.2.4-820-g48a7de7e-1jammy) ... 2024-09-13T06:38:01.053 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-13T06:38:01.115 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up ceph-mgr-modules-core (18.2.4-820-g48a7de7e-1jammy) ... 2024-09-13T06:38:01.179 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up librados2 (18.2.4-820-g48a7de7e-1jammy) ... 2024-09-13T06:38:01.241 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up ceph-fuse (18.2.4-820-g48a7de7e-1jammy) ... 2024-09-13T06:38:01.305 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up librgw2 (18.2.4-820-g48a7de7e-1jammy) ... 2024-09-13T06:38:01.445 INFO:teuthology.orchestra.run.smithi139.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-13T06:38:01.445 INFO:teuthology.orchestra.run.smithi139.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-13T06:38:01.448 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up libsqlite3-mod-ceph (18.2.4-820-g48a7de7e-1jammy) ... 2024-09-13T06:38:01.574 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up libcephfs2 (18.2.4-820-g48a7de7e-1jammy) ... 2024-09-13T06:38:01.700 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up libradosstriper1 (18.2.4-820-g48a7de7e-1jammy) ... 2024-09-13T06:38:01.901 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up libcephfs-dev (18.2.4-820-g48a7de7e-1jammy) ... 2024-09-13T06:38:01.928 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-09-13T06:38:02.010 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-rados (18.2.4-820-g48a7de7e-1jammy) ... 2024-09-13T06:38:02.128 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-13T06:38:02.204 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up librbd1 (18.2.4-820-g48a7de7e-1jammy) ... 2024-09-13T06:38:02.330 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up ceph-mgr-modules-core (18.2.4-820-g48a7de7e-1jammy) ... 2024-09-13T06:38:02.465 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up ceph-fuse (18.2.4-820-g48a7de7e-1jammy) ... 2024-09-13T06:38:02.676 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-13T06:38:02.676 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-13T06:38:03.158 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up libcephfs-dev (18.2.4-820-g48a7de7e-1jammy) ... 2024-09-13T06:38:03.257 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-rbd (18.2.4-820-g48a7de7e-1jammy) ... 2024-09-13T06:38:03.259 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-rados (18.2.4-820-g48a7de7e-1jammy) ... 2024-09-13T06:38:03.360 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-13T06:38:03.383 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up rbd-fuse (18.2.4-820-g48a7de7e-1jammy) ... 2024-09-13T06:38:03.501 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-rgw (18.2.4-820-g48a7de7e-1jammy) ... 2024-09-13T06:38:03.601 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-cephfs (18.2.4-820-g48a7de7e-1jammy) ... 2024-09-13T06:38:03.703 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up ceph-common (18.2.4-820-g48a7de7e-1jammy) ... 2024-09-13T06:38:04.213 INFO:teuthology.orchestra.run.smithi139.stdout:Adding group ceph....done 2024-09-13T06:38:04.557 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-rbd (18.2.4-820-g48a7de7e-1jammy) ... 2024-09-13T06:38:04.580 INFO:teuthology.orchestra.run.smithi139.stdout:Adding system user ceph....done 2024-09-13T06:38:04.683 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up rbd-fuse (18.2.4-820-g48a7de7e-1jammy) ... 2024-09-13T06:38:04.699 INFO:teuthology.orchestra.run.smithi139.stdout:Setting system user ceph properties....done 2024-09-13T06:38:04.712 INFO:teuthology.orchestra.run.smithi139.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-09-13T06:38:04.809 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-rgw (18.2.4-820-g48a7de7e-1jammy) ... 2024-09-13T06:38:04.850 INFO:teuthology.orchestra.run.smithi139.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-09-13T06:38:04.918 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-cephfs (18.2.4-820-g48a7de7e-1jammy) ... 2024-09-13T06:38:05.019 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up ceph-common (18.2.4-820-g48a7de7e-1jammy) ... 2024-09-13T06:38:05.162 INFO:teuthology.orchestra.run.smithi139.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-09-13T06:38:05.654 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up ceph-test (18.2.4-820-g48a7de7e-1jammy) ... 2024-09-13T06:38:05.779 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up radosgw (18.2.4-820-g48a7de7e-1jammy) ... 2024-09-13T06:38:05.780 INFO:teuthology.orchestra.run.smithi081.stdout:Adding group ceph....done 2024-09-13T06:38:06.148 INFO:teuthology.orchestra.run.smithi081.stdout:Adding system user ceph....done 2024-09-13T06:38:06.255 INFO:teuthology.orchestra.run.smithi139.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-13T06:38:06.255 INFO:teuthology.orchestra.run.smithi139.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-13T06:38:06.316 INFO:teuthology.orchestra.run.smithi081.stdout:Setting system user ceph properties....done 2024-09-13T06:38:06.331 INFO:teuthology.orchestra.run.smithi081.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-09-13T06:38:06.472 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-09-13T06:38:06.801 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-09-13T06:38:06.807 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up ceph-base (18.2.4-820-g48a7de7e-1jammy) ... 2024-09-13T06:38:07.147 INFO:teuthology.orchestra.run.smithi139.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-09-13T06:38:07.539 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up ceph-test (18.2.4-820-g48a7de7e-1jammy) ... 2024-09-13T06:38:07.644 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up ceph-mds (18.2.4-820-g48a7de7e-1jammy) ... 2024-09-13T06:38:07.674 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up radosgw (18.2.4-820-g48a7de7e-1jammy) ... 2024-09-13T06:38:08.021 INFO:teuthology.orchestra.run.smithi139.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-13T06:38:08.021 INFO:teuthology.orchestra.run.smithi139.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-13T06:38:08.290 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-13T06:38:08.290 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-13T06:38:08.502 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up ceph-mgr (18.2.4-820-g48a7de7e-1jammy) ... 2024-09-13T06:38:08.716 INFO:teuthology.orchestra.run.smithi139.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-13T06:38:08.716 INFO:teuthology.orchestra.run.smithi139.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-13T06:38:08.751 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up ceph-base (18.2.4-820-g48a7de7e-1jammy) ... 2024-09-13T06:38:09.066 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-09-13T06:38:09.229 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up ceph-osd (18.2.4-820-g48a7de7e-1jammy) ... 2024-09-13T06:38:09.501 INFO:teuthology.orchestra.run.smithi139.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-13T06:38:09.501 INFO:teuthology.orchestra.run.smithi139.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-13T06:38:09.528 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up ceph-mds (18.2.4-820-g48a7de7e-1jammy) ... 2024-09-13T06:38:09.741 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-13T06:38:09.741 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-13T06:38:09.997 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up ceph-mgr-k8sevents (18.2.4-820-g48a7de7e-1jammy) ... 2024-09-13T06:38:10.140 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up ceph-mgr-diskprediction-local (18.2.4-820-g48a7de7e-1jammy) ... 2024-09-13T06:38:10.187 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up ceph-mgr (18.2.4-820-g48a7de7e-1jammy) ... 2024-09-13T06:38:10.282 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up ceph-mon (18.2.4-820-g48a7de7e-1jammy) ... 2024-09-13T06:38:10.403 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-13T06:38:10.404 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-13T06:38:10.478 INFO:teuthology.orchestra.run.smithi139.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-13T06:38:10.478 INFO:teuthology.orchestra.run.smithi139.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-13T06:38:10.925 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up ceph-mgr-cephadm (18.2.4-820-g48a7de7e-1jammy) ... 2024-09-13T06:38:11.077 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up ceph-osd (18.2.4-820-g48a7de7e-1jammy) ... 2024-09-13T06:38:11.084 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up ceph (18.2.4-820-g48a7de7e-1jammy) ... 2024-09-13T06:38:11.210 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up ceph-mgr-dashboard (18.2.4-820-g48a7de7e-1jammy) ... 2024-09-13T06:38:11.327 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-13T06:38:11.328 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-13T06:38:11.361 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up ceph-volume (18.2.4-820-g48a7de7e-1jammy) ... 2024-09-13T06:38:11.714 INFO:teuthology.orchestra.run.smithi139.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-13T06:38:11.853 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up ceph-mgr-k8sevents (18.2.4-820-g48a7de7e-1jammy) ... 2024-09-13T06:38:11.979 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up ceph-mgr-diskprediction-local (18.2.4-820-g48a7de7e-1jammy) ... 2024-09-13T06:38:12.130 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up ceph-mon (18.2.4-820-g48a7de7e-1jammy) ... 2024-09-13T06:38:12.351 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-13T06:38:12.351 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-13T06:38:12.523 INFO:teuthology.orchestra.run.smithi139.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-13T06:38:12.824 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up ceph-mgr-cephadm (18.2.4-820-g48a7de7e-1jammy) ... 2024-09-13T06:38:12.975 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up ceph (18.2.4-820-g48a7de7e-1jammy) ... 2024-09-13T06:38:13.001 INFO:teuthology.orchestra.run.smithi139.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-13T06:38:13.007 DEBUG:teuthology.parallel:result is None 2024-09-13T06:38:13.142 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up ceph-mgr-dashboard (18.2.4-820-g48a7de7e-1jammy) ... 2024-09-13T06:38:13.369 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up ceph-volume (18.2.4-820-g48a7de7e-1jammy) ... 2024-09-13T06:38:13.696 INFO:teuthology.orchestra.run.smithi081.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-13T06:38:14.773 INFO:teuthology.orchestra.run.smithi081.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-13T06:38:15.258 INFO:teuthology.orchestra.run.smithi081.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-13T06:38:15.262 DEBUG:teuthology.parallel:result is None 2024-09-13T06:38:15.263 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=48a7de7e6e1701a88fd571c7e34908ac4b8ed412 2024-09-13T06:38:15.421 DEBUG:teuthology.orchestra.run.smithi081:> dpkg-query -W -f '${Version}' ceph 2024-09-13T06:38:15.439 INFO:teuthology.orchestra.run.smithi081.stdout:18.2.4-820-g48a7de7e-1jammy 2024-09-13T06:38:15.439 INFO:teuthology.packaging:The installed version of ceph is 18.2.4-820-g48a7de7e-1jammy 2024-09-13T06:38:15.440 INFO:teuthology.task.install:The correct ceph version 18.2.4-820-g48a7de7e-1jammy is installed. 2024-09-13T06:38:15.442 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=48a7de7e6e1701a88fd571c7e34908ac4b8ed412 2024-09-13T06:38:15.595 DEBUG:teuthology.orchestra.run.smithi139:> dpkg-query -W -f '${Version}' ceph 2024-09-13T06:38:15.614 INFO:teuthology.orchestra.run.smithi139.stdout:18.2.4-820-g48a7de7e-1jammy 2024-09-13T06:38:15.614 INFO:teuthology.packaging:The installed version of ceph is 18.2.4-820-g48a7de7e-1jammy 2024-09-13T06:38:15.614 INFO:teuthology.task.install:The correct ceph version 18.2.4-820-g48a7de7e-1jammy is installed. 2024-09-13T06:38:15.616 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-13T06:38:15.617 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-13T06:38:15.617 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-13T06:38:15.631 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2024-09-13T06:38:15.631 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-13T06:38:15.670 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-13T06:38:15.670 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-13T06:38:15.670 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/usr/bin/daemon-helper 2024-09-13T06:38:15.687 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-13T06:38:15.744 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2024-09-13T06:38:15.745 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd of=/usr/bin/daemon-helper 2024-09-13T06:38:15.758 DEBUG:teuthology.orchestra.run.smithi139:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-13T06:38:15.813 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-13T06:38:15.813 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-13T06:38:15.813 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-13T06:38:15.826 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-13T06:38:15.880 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2024-09-13T06:38:15.880 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-13T06:38:15.893 DEBUG:teuthology.orchestra.run.smithi139:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-13T06:38:15.948 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-13T06:38:15.948 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-13T06:38:15.948 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/usr/bin/stdin-killer 2024-09-13T06:38:15.961 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-13T06:38:16.015 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2024-09-13T06:38:16.015 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd of=/usr/bin/stdin-killer 2024-09-13T06:38:16.027 DEBUG:teuthology.orchestra.run.smithi139:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-13T06:38:16.084 INFO:teuthology.run_tasks:Running task ceph... 2024-09-13T06:38:16.162 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-09-13T06:38:16.162 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod 777 /var/log/ceph 2024-09-13T06:38:16.164 DEBUG:teuthology.orchestra.run.smithi139:> sudo chmod 777 /var/log/ceph 2024-09-13T06:38:16.177 INFO:tasks.ceph:Disabling ceph logrotate... 2024-09-13T06:38:16.177 DEBUG:teuthology.orchestra.run.smithi081:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-13T06:38:16.221 DEBUG:teuthology.orchestra.run.smithi139:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-13T06:38:16.234 INFO:tasks.ceph:Creating extra log directories... 2024-09-13T06:38:16.234 DEBUG:teuthology.orchestra.run.smithi081:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-13T06:38:16.273 DEBUG:teuthology.orchestra.run.smithi139:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-13T06:38:16.300 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-09-13T06:38:16.300 INFO:tasks.ceph:config {'conf': {'global': {'mon client directed command retry': 5, 'mon warn on pool no app': False, 'ms inject socket failures': 5000}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd memory target': 1610612736, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'but it is still running', 'objects unfound and apparently lost', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-09-13T06:38:16.300 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/teuthology-2024-09-10_22:16:02-rbd-reef-distro-default-smithi/7900868', 'branch': 'reef', 'description': 'rbd/thrash/{base/install clusters/{fixed-2 openstack} conf/{disable-pool-app} msgr-failures/few objectstore/bluestore-low-osd-mem-target supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/rbd_fsx_deep_copy}', 'email': 'ceph-qa@ceph.com', 'first_in_suite': False, 'job_id': '7900868', 'kernel': {'kdb': 1, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'teuthology-2024-09-10_22:16:02-rbd-reef-distro-default-smithi', 'no_nested_subset': False, 'openstack': [{'volumes': {'count': 4, 'size': 10}}, {'machine': {'cpus': 1, 'disk': 40, 'ram': 8000}, 'volumes': {'count': 4, 'size': 30}}], 'os_type': 'ubuntu', 'os_version': '22.04', 'overrides': {'admin_socket': {'branch': 'reef'}, 'ceph': {'conf': {'global': {'mon client directed command retry': 5, 'mon warn on pool no app': False, 'ms inject socket failures': 5000}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd memory target': 1610612736, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'but it is still running', 'objects unfound and apparently lost', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from'], 'sha1': '48a7de7e6e1701a88fd571c7e34908ac4b8ed412'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}}}, 'install': {'ceph': {'flavor': 'default', 'sha1': '48a7de7e6e1701a88fd571c7e34908ac4b8ed412'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'reef', 'sha1': '7a853b1706d076d58e0da7a5d3b9b9eb36276880'}}, 'owner': 'scheduled_teuthology@teuthology', 'priority': 930, 'repo': 'https://git.ceph.com/ceph.git', 'roles': [['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'], ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b']], 'seed': 248, 'sha1': '48a7de7e6e1701a88fd571c7e34908ac4b8ed412', 'sleep_before_teardown': 0, 'subset': '116/128', 'suite': 'rbd', 'suite_branch': 'reef', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph_7a853b1706d076d58e0da7a5d3b9b9eb36276880/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph.git', 'suite_sha1': '7a853b1706d076d58e0da7a5d3b9b9eb36276880', 'targets': {'smithi081.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBElPooAgIvFL8xUBOgKuK1H0GgQdwbrHO4lhN75QkUg8jE0s7S3jh2Qk76mfss66jA6xlyM3CFCxesGkS8CkvGQ=', 'smithi139.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFB96g9CjSfsgKLytE5gx0AlylR0OrS6wKR8a6HYsyPpFm5VCLT5+xA/aYUmfuW5R5/bzi2tm9z5P0N5Dc6kbnw='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': None}, {'ceph': None}, {'thrashosds': {'timeout': 1200}}, {'rbd_fsx': {'clients': ['client.0'], 'deep_copy': True, 'ops': 6000}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a', 'timestamp': '2024-09-10_22:16:02', 'tube': 'smithi', 'user': 'teuthology', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856'} 2024-09-13T06:38:16.300 DEBUG:teuthology.orchestra.run.smithi081:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-13T06:38:16.329 DEBUG:teuthology.orchestra.run.smithi139:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-13T06:38:16.337 DEBUG:teuthology.orchestra.run.smithi081:> sudo install -d -m0777 -- /var/run/ceph 2024-09-13T06:38:16.377 DEBUG:teuthology.orchestra.run.smithi139:> sudo install -d -m0777 -- /var/run/ceph 2024-09-13T06:38:16.394 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-13T06:38:16.395 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/scratch_devs of=/dev/stdout 2024-09-13T06:38:16.436 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-13T06:38:16.436 DEBUG:teuthology.orchestra.run.smithi081:> stat /dev/vg_nvme/lv_1 2024-09-13T06:38:16.484 INFO:teuthology.orchestra.run.smithi081.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-13T06:38:16.484 INFO:teuthology.orchestra.run.smithi081.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T06:38:16.485 INFO:teuthology.orchestra.run.smithi081.stdout:Device: 5h/5d Inode: 882 Links: 1 2024-09-13T06:38:16.485 INFO:teuthology.orchestra.run.smithi081.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T06:38:16.485 INFO:teuthology.orchestra.run.smithi081.stdout:Access: 2024-09-13 06:33:01.630608088 +0000 2024-09-13T06:38:16.485 INFO:teuthology.orchestra.run.smithi081.stdout:Modify: 2024-09-13 06:33:01.358610519 +0000 2024-09-13T06:38:16.485 INFO:teuthology.orchestra.run.smithi081.stdout:Change: 2024-09-13 06:33:01.358610519 +0000 2024-09-13T06:38:16.485 INFO:teuthology.orchestra.run.smithi081.stdout: Birth: - 2024-09-13T06:38:16.485 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-13T06:38:16.538 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records in 2024-09-13T06:38:16.539 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records out 2024-09-13T06:38:16.539 INFO:teuthology.orchestra.run.smithi081.stderr:512 bytes copied, 0.000454479 s, 1.1 MB/s 2024-09-13T06:38:16.540 DEBUG:teuthology.orchestra.run.smithi081:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-13T06:38:16.589 DEBUG:teuthology.orchestra.run.smithi081:> stat /dev/vg_nvme/lv_2 2024-09-13T06:38:16.636 INFO:teuthology.orchestra.run.smithi081.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-13T06:38:16.636 INFO:teuthology.orchestra.run.smithi081.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T06:38:16.636 INFO:teuthology.orchestra.run.smithi081.stdout:Device: 5h/5d Inode: 906 Links: 1 2024-09-13T06:38:16.636 INFO:teuthology.orchestra.run.smithi081.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T06:38:16.637 INFO:teuthology.orchestra.run.smithi081.stdout:Access: 2024-09-13 06:33:01.894605731 +0000 2024-09-13T06:38:16.637 INFO:teuthology.orchestra.run.smithi081.stdout:Modify: 2024-09-13 06:33:01.890605766 +0000 2024-09-13T06:38:16.637 INFO:teuthology.orchestra.run.smithi081.stdout:Change: 2024-09-13 06:33:01.890605766 +0000 2024-09-13T06:38:16.637 INFO:teuthology.orchestra.run.smithi081.stdout: Birth: - 2024-09-13T06:38:16.637 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-13T06:38:16.691 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records in 2024-09-13T06:38:16.691 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records out 2024-09-13T06:38:16.691 INFO:teuthology.orchestra.run.smithi081.stderr:512 bytes copied, 0.000377689 s, 1.4 MB/s 2024-09-13T06:38:16.692 DEBUG:teuthology.orchestra.run.smithi081:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-13T06:38:16.742 DEBUG:teuthology.orchestra.run.smithi081:> stat /dev/vg_nvme/lv_3 2024-09-13T06:38:16.788 INFO:teuthology.orchestra.run.smithi081.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-13T06:38:16.788 INFO:teuthology.orchestra.run.smithi081.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T06:38:16.788 INFO:teuthology.orchestra.run.smithi081.stdout:Device: 5h/5d Inode: 920 Links: 1 2024-09-13T06:38:16.788 INFO:teuthology.orchestra.run.smithi081.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T06:38:16.788 INFO:teuthology.orchestra.run.smithi081.stdout:Access: 2024-09-13 06:33:02.634599121 +0000 2024-09-13T06:38:16.788 INFO:teuthology.orchestra.run.smithi081.stdout:Modify: 2024-09-13 06:33:02.394601265 +0000 2024-09-13T06:38:16.788 INFO:teuthology.orchestra.run.smithi081.stdout:Change: 2024-09-13 06:33:02.394601265 +0000 2024-09-13T06:38:16.789 INFO:teuthology.orchestra.run.smithi081.stdout: Birth: - 2024-09-13T06:38:16.789 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-13T06:38:16.844 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records in 2024-09-13T06:38:16.844 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records out 2024-09-13T06:38:16.844 INFO:teuthology.orchestra.run.smithi081.stderr:512 bytes copied, 0.000357542 s, 1.4 MB/s 2024-09-13T06:38:16.846 DEBUG:teuthology.orchestra.run.smithi081:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-13T06:38:16.893 DEBUG:teuthology.orchestra.run.smithi081:> stat /dev/vg_nvme/lv_4 2024-09-13T06:38:16.940 INFO:teuthology.orchestra.run.smithi081.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-13T06:38:16.940 INFO:teuthology.orchestra.run.smithi081.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T06:38:16.940 INFO:teuthology.orchestra.run.smithi081.stdout:Device: 5h/5d Inode: 939 Links: 1 2024-09-13T06:38:16.940 INFO:teuthology.orchestra.run.smithi081.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T06:38:16.940 INFO:teuthology.orchestra.run.smithi081.stdout:Access: 2024-09-13 06:33:03.134594654 +0000 2024-09-13T06:38:16.941 INFO:teuthology.orchestra.run.smithi081.stdout:Modify: 2024-09-13 06:33:02.882596905 +0000 2024-09-13T06:38:16.941 INFO:teuthology.orchestra.run.smithi081.stdout:Change: 2024-09-13 06:33:02.882596905 +0000 2024-09-13T06:38:16.941 INFO:teuthology.orchestra.run.smithi081.stdout: Birth: - 2024-09-13T06:38:16.941 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-13T06:38:16.994 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records in 2024-09-13T06:38:16.995 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records out 2024-09-13T06:38:16.995 INFO:teuthology.orchestra.run.smithi081.stderr:512 bytes copied, 0.000318904 s, 1.6 MB/s 2024-09-13T06:38:16.996 DEBUG:teuthology.orchestra.run.smithi081:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-13T06:38:17.045 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-13T06:38:17.045 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2024-09-13T06:38:17.046 DEBUG:teuthology.orchestra.run.smithi139:> dd if=/scratch_devs of=/dev/stdout 2024-09-13T06:38:17.051 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-13T06:38:17.052 DEBUG:teuthology.orchestra.run.smithi139:> stat /dev/vg_nvme/lv_1 2024-09-13T06:38:17.102 INFO:teuthology.orchestra.run.smithi139.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-13T06:38:17.102 INFO:teuthology.orchestra.run.smithi139.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T06:38:17.102 INFO:teuthology.orchestra.run.smithi139.stdout:Device: 5h/5d Inode: 878 Links: 1 2024-09-13T06:38:17.102 INFO:teuthology.orchestra.run.smithi139.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T06:38:17.102 INFO:teuthology.orchestra.run.smithi139.stdout:Access: 2024-09-13 06:33:00.610005749 +0000 2024-09-13T06:38:17.102 INFO:teuthology.orchestra.run.smithi139.stdout:Modify: 2024-09-13 06:33:00.346008106 +0000 2024-09-13T06:38:17.102 INFO:teuthology.orchestra.run.smithi139.stdout:Change: 2024-09-13 06:33:00.346008106 +0000 2024-09-13T06:38:17.102 INFO:teuthology.orchestra.run.smithi139.stdout: Birth: - 2024-09-13T06:38:17.102 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-13T06:38:17.155 INFO:teuthology.orchestra.run.smithi139.stderr:1+0 records in 2024-09-13T06:38:17.156 INFO:teuthology.orchestra.run.smithi139.stderr:1+0 records out 2024-09-13T06:38:17.156 INFO:teuthology.orchestra.run.smithi139.stderr:512 bytes copied, 0.000404679 s, 1.3 MB/s 2024-09-13T06:38:17.157 DEBUG:teuthology.orchestra.run.smithi139:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-13T06:38:17.206 DEBUG:teuthology.orchestra.run.smithi139:> stat /dev/vg_nvme/lv_2 2024-09-13T06:38:17.253 INFO:teuthology.orchestra.run.smithi139.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-13T06:38:17.253 INFO:teuthology.orchestra.run.smithi139.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T06:38:17.253 INFO:teuthology.orchestra.run.smithi139.stdout:Device: 5h/5d Inode: 900 Links: 1 2024-09-13T06:38:17.253 INFO:teuthology.orchestra.run.smithi139.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T06:38:17.253 INFO:teuthology.orchestra.run.smithi139.stdout:Access: 2024-09-13 06:33:00.830003784 +0000 2024-09-13T06:38:17.253 INFO:teuthology.orchestra.run.smithi139.stdout:Modify: 2024-09-13 06:33:00.826003818 +0000 2024-09-13T06:38:17.254 INFO:teuthology.orchestra.run.smithi139.stdout:Change: 2024-09-13 06:33:00.826003818 +0000 2024-09-13T06:38:17.254 INFO:teuthology.orchestra.run.smithi139.stdout: Birth: - 2024-09-13T06:38:17.254 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-13T06:38:17.307 INFO:teuthology.orchestra.run.smithi139.stderr:1+0 records in 2024-09-13T06:38:17.307 INFO:teuthology.orchestra.run.smithi139.stderr:1+0 records out 2024-09-13T06:38:17.307 INFO:teuthology.orchestra.run.smithi139.stderr:512 bytes copied, 0.000386536 s, 1.3 MB/s 2024-09-13T06:38:17.309 DEBUG:teuthology.orchestra.run.smithi139:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-13T06:38:17.359 DEBUG:teuthology.orchestra.run.smithi139:> stat /dev/vg_nvme/lv_3 2024-09-13T06:38:17.405 INFO:teuthology.orchestra.run.smithi139.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-13T06:38:17.405 INFO:teuthology.orchestra.run.smithi139.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T06:38:17.405 INFO:teuthology.orchestra.run.smithi139.stdout:Device: 5h/5d Inode: 917 Links: 1 2024-09-13T06:38:17.405 INFO:teuthology.orchestra.run.smithi139.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T06:38:17.405 INFO:teuthology.orchestra.run.smithi139.stdout:Access: 2024-09-13 06:33:01.561997246 +0000 2024-09-13T06:38:17.405 INFO:teuthology.orchestra.run.smithi139.stdout:Modify: 2024-09-13 06:33:01.301999568 +0000 2024-09-13T06:38:17.405 INFO:teuthology.orchestra.run.smithi139.stdout:Change: 2024-09-13 06:33:01.301999568 +0000 2024-09-13T06:38:17.405 INFO:teuthology.orchestra.run.smithi139.stdout: Birth: - 2024-09-13T06:38:17.406 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-13T06:38:17.459 INFO:teuthology.orchestra.run.smithi139.stderr:1+0 records in 2024-09-13T06:38:17.460 INFO:teuthology.orchestra.run.smithi139.stderr:1+0 records out 2024-09-13T06:38:17.460 INFO:teuthology.orchestra.run.smithi139.stderr:512 bytes copied, 0.0004186 s, 1.2 MB/s 2024-09-13T06:38:17.461 DEBUG:teuthology.orchestra.run.smithi139:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-13T06:38:17.511 DEBUG:teuthology.orchestra.run.smithi139:> stat /dev/vg_nvme/lv_4 2024-09-13T06:38:17.557 INFO:teuthology.orchestra.run.smithi139.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-13T06:38:17.557 INFO:teuthology.orchestra.run.smithi139.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T06:38:17.557 INFO:teuthology.orchestra.run.smithi139.stdout:Device: 5h/5d Inode: 934 Links: 1 2024-09-13T06:38:17.557 INFO:teuthology.orchestra.run.smithi139.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T06:38:17.557 INFO:teuthology.orchestra.run.smithi139.stdout:Access: 2024-09-13 06:33:02.057992815 +0000 2024-09-13T06:38:17.557 INFO:teuthology.orchestra.run.smithi139.stdout:Modify: 2024-09-13 06:33:01.785995245 +0000 2024-09-13T06:38:17.557 INFO:teuthology.orchestra.run.smithi139.stdout:Change: 2024-09-13 06:33:01.785995245 +0000 2024-09-13T06:38:17.557 INFO:teuthology.orchestra.run.smithi139.stdout: Birth: - 2024-09-13T06:38:17.558 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-13T06:38:17.612 INFO:teuthology.orchestra.run.smithi139.stderr:1+0 records in 2024-09-13T06:38:17.612 INFO:teuthology.orchestra.run.smithi139.stderr:1+0 records out 2024-09-13T06:38:17.612 INFO:teuthology.orchestra.run.smithi139.stderr:512 bytes copied, 0.000389714 s, 1.3 MB/s 2024-09-13T06:38:17.613 DEBUG:teuthology.orchestra.run.smithi139:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-13T06:38:17.662 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-13T06:38:17.663 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi081.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi139.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-13T06:38:17.663 INFO:tasks.ceph:Generating config... 2024-09-13T06:38:17.664 INFO:tasks.ceph:[global] mon client directed command retry = 5 2024-09-13T06:38:17.664 INFO:tasks.ceph:[global] mon warn on pool no app = False 2024-09-13T06:38:17.664 INFO:tasks.ceph:[global] ms inject socket failures = 5000 2024-09-13T06:38:17.664 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-09-13T06:38:17.665 INFO:tasks.ceph:[mgr] debug ms = 1 2024-09-13T06:38:17.665 INFO:tasks.ceph:[mon] debug mon = 20 2024-09-13T06:38:17.665 INFO:tasks.ceph:[mon] debug ms = 1 2024-09-13T06:38:17.665 INFO:tasks.ceph:[mon] debug paxos = 20 2024-09-13T06:38:17.665 INFO:tasks.ceph:[osd] bdev async discard = True 2024-09-13T06:38:17.665 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-09-13T06:38:17.665 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-09-13T06:38:17.665 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-09-13T06:38:17.665 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-09-13T06:38:17.665 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-09-13T06:38:17.665 INFO:tasks.ceph:[osd] debug ms = 1 2024-09-13T06:38:17.665 INFO:tasks.ceph:[osd] debug osd = 20 2024-09-13T06:38:17.666 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-09-13T06:38:17.666 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-09-13T06:38:17.666 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-09-13T06:38:17.666 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-09-13T06:38:17.666 INFO:tasks.ceph:[osd] osd blocked scrub grace period = 3600 2024-09-13T06:38:17.666 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-09-13T06:38:17.666 INFO:tasks.ceph:[osd] osd max markdown count = 1000 2024-09-13T06:38:17.666 INFO:tasks.ceph:[osd] osd memory target = 1610612736 2024-09-13T06:38:17.666 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-09-13T06:38:17.666 INFO:tasks.ceph:[osd] osd shutdown pgref assert = True 2024-09-13T06:38:17.666 INFO:tasks.ceph:Setting up mon.a... 2024-09-13T06:38:17.667 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-09-13T06:38:17.699 INFO:teuthology.orchestra.run.smithi081.stdout:creating /etc/ceph/ceph.keyring 2024-09-13T06:38:17.711 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-09-13T06:38:17.788 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-13T06:38:17.846 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.81'), ('mon.c', '[v2:172.21.15.81:3301,v1:172.21.15.81:6790]'), ('mon.b', '172.21.15.139')] 2024-09-13T06:38:17.846 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.81,[v2:172.21.15.81:3301,v1:172.21.15.81:6790],172.21.15.139', 'mon client directed command retry': 5, 'mon warn on pool no app': False, 'ms inject socket failures': 5000}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd memory target': 1610612736, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false'}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok'}, 'mon.a': {}, 'mon.c': {}, 'mon.b': {}} 2024-09-13T06:38:17.847 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-13T06:38:17.847 DEBUG:teuthology.orchestra.run.smithi081:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-09-13T06:38:17.892 DEBUG:teuthology.orchestra.run.smithi081:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.81 --addv c '[v2:172.21.15.81:3301,v1:172.21.15.81:6790]' --add b 172.21.15.139 --print /home/ubuntu/cephtest/ceph.monmap 2024-09-13T06:38:17.977 INFO:teuthology.orchestra.run.smithi081.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-09-13T06:38:17.977 INFO:teuthology.orchestra.run.smithi081.stdout:monmaptool: generated fsid e5612297-d004-4957-927e-afa37f30d6cf 2024-09-13T06:38:17.978 INFO:teuthology.orchestra.run.smithi081.stdout:setting min_mon_release = pacific 2024-09-13T06:38:17.978 INFO:teuthology.orchestra.run.smithi081.stdout:epoch 0 2024-09-13T06:38:17.978 INFO:teuthology.orchestra.run.smithi081.stdout:fsid e5612297-d004-4957-927e-afa37f30d6cf 2024-09-13T06:38:17.978 INFO:teuthology.orchestra.run.smithi081.stdout:last_changed 2024-09-13T06:38:17.981979+0000 2024-09-13T06:38:17.978 INFO:teuthology.orchestra.run.smithi081.stdout:created 2024-09-13T06:38:17.981979+0000 2024-09-13T06:38:17.978 INFO:teuthology.orchestra.run.smithi081.stdout:min_mon_release 16 (pacific) 2024-09-13T06:38:17.978 INFO:teuthology.orchestra.run.smithi081.stdout:election_strategy: 1 2024-09-13T06:38:17.979 INFO:teuthology.orchestra.run.smithi081.stdout:0: [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] mon.a 2024-09-13T06:38:17.979 INFO:teuthology.orchestra.run.smithi081.stdout:1: [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] mon.b 2024-09-13T06:38:17.979 INFO:teuthology.orchestra.run.smithi081.stdout:2: [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] mon.c 2024-09-13T06:38:17.979 INFO:teuthology.orchestra.run.smithi081.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-09-13T06:38:17.981 DEBUG:teuthology.orchestra.run.smithi081:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-09-13T06:38:18.028 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID e5612297-d004-4957-927e-afa37f30d6cf... 2024-09-13T06:38:18.029 DEBUG:teuthology.orchestra.run.smithi081:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-13T06:38:18.074 DEBUG:teuthology.orchestra.run.smithi139:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-13T06:38:18.104 INFO:teuthology.orchestra.run.smithi081.stdout:[global] 2024-09-13T06:38:18.104 INFO:teuthology.orchestra.run.smithi081.stdout: chdir = "" 2024-09-13T06:38:18.104 INFO:teuthology.orchestra.run.smithi081.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-13T06:38:18.104 INFO:teuthology.orchestra.run.smithi081.stdout: auth supported = cephx 2024-09-13T06:38:18.104 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T06:38:18.105 INFO:teuthology.orchestra.run.smithi081.stdout: filestore xattr use omap = true 2024-09-13T06:38:18.105 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T06:38:18.105 INFO:teuthology.orchestra.run.smithi081.stdout: mon clock drift allowed = 1.000 2024-09-13T06:38:18.105 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T06:38:18.105 INFO:teuthology.orchestra.run.smithi081.stdout: osd crush chooseleaf type = 0 2024-09-13T06:38:18.105 INFO:teuthology.orchestra.run.smithi081.stdout: auth debug = true 2024-09-13T06:38:18.105 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T06:38:18.105 INFO:teuthology.orchestra.run.smithi081.stdout: ms die on old message = true 2024-09-13T06:38:18.106 INFO:teuthology.orchestra.run.smithi081.stdout: ms die on bug = true 2024-09-13T06:38:18.106 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T06:38:18.106 INFO:teuthology.orchestra.run.smithi081.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-13T06:38:18.106 INFO:teuthology.orchestra.run.smithi081.stdout: mon pg warn max object skew = 0 2024-09-13T06:38:18.106 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T06:38:18.106 INFO:teuthology.orchestra.run.smithi081.stdout: # disable pg_autoscaler by default for new pools 2024-09-13T06:38:18.106 INFO:teuthology.orchestra.run.smithi081.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-13T06:38:18.106 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T06:38:18.107 INFO:teuthology.orchestra.run.smithi081.stdout: osd pool default size = 2 2024-09-13T06:38:18.107 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T06:38:18.107 INFO:teuthology.orchestra.run.smithi081.stdout: mon osd allow primary affinity = true 2024-09-13T06:38:18.107 INFO:teuthology.orchestra.run.smithi081.stdout: mon osd allow pg remap = true 2024-09-13T06:38:18.107 INFO:teuthology.orchestra.run.smithi081.stdout: mon warn on legacy crush tunables = false 2024-09-13T06:38:18.107 INFO:teuthology.orchestra.run.smithi081.stdout: mon warn on crush straw calc version zero = false 2024-09-13T06:38:18.107 INFO:teuthology.orchestra.run.smithi081.stdout: mon warn on no sortbitwise = false 2024-09-13T06:38:18.107 INFO:teuthology.orchestra.run.smithi081.stdout: mon warn on osd down out interval zero = false 2024-09-13T06:38:18.108 INFO:teuthology.orchestra.run.smithi081.stdout: mon warn on too few osds = false 2024-09-13T06:38:18.108 INFO:teuthology.orchestra.run.smithi081.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-13T06:38:18.108 INFO:teuthology.orchestra.run.smithi081.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-13T06:38:18.108 INFO:teuthology.orchestra.run.smithi081.stdout: mon_allow_pool_size_one = true 2024-09-13T06:38:18.108 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T06:38:18.108 INFO:teuthology.orchestra.run.smithi081.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-13T06:38:18.109 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T06:38:18.109 INFO:teuthology.orchestra.run.smithi081.stdout: osd default data pool replay window = 5 2024-09-13T06:38:18.109 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T06:38:18.109 INFO:teuthology.orchestra.run.smithi081.stdout: mon allow pool delete = true 2024-09-13T06:38:18.109 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T06:38:18.109 INFO:teuthology.orchestra.run.smithi081.stdout: mon cluster log file level = debug 2024-09-13T06:38:18.109 INFO:teuthology.orchestra.run.smithi081.stdout: debug asserts on shutdown = true 2024-09-13T06:38:18.110 INFO:teuthology.orchestra.run.smithi081.stdout: mon health detail to clog = false 2024-09-13T06:38:18.110 INFO:teuthology.orchestra.run.smithi081.stdout: mon host = "172.21.15.81,[v2:172.21.15.81:3301,v1:172.21.15.81:6790],172.21.15.139" 2024-09-13T06:38:18.110 INFO:teuthology.orchestra.run.smithi081.stdout: mon client directed command retry = 5 2024-09-13T06:38:18.110 INFO:teuthology.orchestra.run.smithi081.stdout: mon warn on pool no app = False 2024-09-13T06:38:18.110 INFO:teuthology.orchestra.run.smithi081.stdout: ms inject socket failures = 5000 2024-09-13T06:38:18.110 INFO:teuthology.orchestra.run.smithi081.stdout: fsid = e5612297-d004-4957-927e-afa37f30d6cf 2024-09-13T06:38:18.110 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T06:38:18.110 INFO:teuthology.orchestra.run.smithi081.stdout:[osd] 2024-09-13T06:38:18.110 INFO:teuthology.orchestra.run.smithi081.stdout: osd journal size = 100 2024-09-13T06:38:18.111 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T06:38:18.111 INFO:teuthology.orchestra.run.smithi081.stdout: osd scrub load threshold = 5.0 2024-09-13T06:38:18.111 INFO:teuthology.orchestra.run.smithi081.stdout: osd scrub max interval = 600 2024-09-13T06:38:18.111 INFO:teuthology.orchestra.run.smithi081.stdout: osd mclock profile = high_recovery_ops 2024-09-13T06:38:18.111 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T06:38:18.111 INFO:teuthology.orchestra.run.smithi081.stdout: osd recover clone overlap = true 2024-09-13T06:38:18.111 INFO:teuthology.orchestra.run.smithi081.stdout: osd recovery max chunk = 1048576 2024-09-13T06:38:18.112 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T06:38:18.112 INFO:teuthology.orchestra.run.smithi081.stdout: osd debug shutdown = true 2024-09-13T06:38:18.112 INFO:teuthology.orchestra.run.smithi081.stdout: osd debug op order = true 2024-09-13T06:38:18.112 INFO:teuthology.orchestra.run.smithi081.stdout: osd debug verify stray on activate = true 2024-09-13T06:38:18.112 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T06:38:18.112 INFO:teuthology.orchestra.run.smithi081.stdout: osd open classes on start = true 2024-09-13T06:38:18.112 INFO:teuthology.orchestra.run.smithi081.stdout: osd debug pg log writeout = true 2024-09-13T06:38:18.113 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T06:38:18.113 INFO:teuthology.orchestra.run.smithi081.stdout: osd deep scrub update digest min age = 30 2024-09-13T06:38:18.113 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T06:38:18.113 INFO:teuthology.orchestra.run.smithi081.stdout: osd map max advance = 10 2024-09-13T06:38:18.113 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T06:38:18.113 INFO:teuthology.orchestra.run.smithi081.stdout: journal zero on create = true 2024-09-13T06:38:18.113 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T06:38:18.113 INFO:teuthology.orchestra.run.smithi081.stdout: filestore ondisk finisher threads = 3 2024-09-13T06:38:18.114 INFO:teuthology.orchestra.run.smithi081.stdout: filestore apply finisher threads = 3 2024-09-13T06:38:18.114 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T06:38:18.114 INFO:teuthology.orchestra.run.smithi081.stdout: bdev debug aio = true 2024-09-13T06:38:18.114 INFO:teuthology.orchestra.run.smithi081.stdout: osd debug misdirected ops = true 2024-09-13T06:38:18.114 INFO:teuthology.orchestra.run.smithi081.stdout: bdev async discard = True 2024-09-13T06:38:18.114 INFO:teuthology.orchestra.run.smithi081.stdout: bdev enable discard = True 2024-09-13T06:38:18.114 INFO:teuthology.orchestra.run.smithi081.stdout: bluestore block size = 96636764160 2024-09-13T06:38:18.114 INFO:teuthology.orchestra.run.smithi081.stdout: bluestore fsck on mount = True 2024-09-13T06:38:18.114 INFO:teuthology.orchestra.run.smithi081.stdout: debug bluefs = 1/20 2024-09-13T06:38:18.115 INFO:teuthology.orchestra.run.smithi081.stdout: debug bluestore = 1/20 2024-09-13T06:38:18.115 INFO:teuthology.orchestra.run.smithi081.stdout: debug ms = 1 2024-09-13T06:38:18.115 INFO:teuthology.orchestra.run.smithi081.stdout: debug osd = 20 2024-09-13T06:38:18.115 INFO:teuthology.orchestra.run.smithi081.stdout: debug rocksdb = 4/10 2024-09-13T06:38:18.115 INFO:teuthology.orchestra.run.smithi081.stdout: mon osd backfillfull_ratio = 0.85 2024-09-13T06:38:18.115 INFO:teuthology.orchestra.run.smithi081.stdout: mon osd full ratio = 0.9 2024-09-13T06:38:18.115 INFO:teuthology.orchestra.run.smithi081.stdout: mon osd nearfull ratio = 0.8 2024-09-13T06:38:18.115 INFO:teuthology.orchestra.run.smithi081.stdout: osd blocked scrub grace period = 3600 2024-09-13T06:38:18.115 INFO:teuthology.orchestra.run.smithi081.stdout: osd failsafe full ratio = 0.95 2024-09-13T06:38:18.115 INFO:teuthology.orchestra.run.smithi081.stdout: osd max markdown count = 1000 2024-09-13T06:38:18.116 INFO:teuthology.orchestra.run.smithi081.stdout: osd memory target = 1610612736 2024-09-13T06:38:18.116 INFO:teuthology.orchestra.run.smithi081.stdout: osd objectstore = bluestore 2024-09-13T06:38:18.116 INFO:teuthology.orchestra.run.smithi081.stdout: osd shutdown pgref assert = True 2024-09-13T06:38:18.116 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T06:38:18.116 INFO:teuthology.orchestra.run.smithi081.stdout:[mgr] 2024-09-13T06:38:18.116 INFO:teuthology.orchestra.run.smithi081.stdout: debug ms = 1 2024-09-13T06:38:18.116 INFO:teuthology.orchestra.run.smithi081.stdout: debug mgr = 20 2024-09-13T06:38:18.116 INFO:teuthology.orchestra.run.smithi081.stdout: debug mon = 20 2024-09-13T06:38:18.116 INFO:teuthology.orchestra.run.smithi081.stdout: debug auth = 20 2024-09-13T06:38:18.116 INFO:teuthology.orchestra.run.smithi081.stdout: mon reweight min pgs per osd = 4 2024-09-13T06:38:18.116 INFO:teuthology.orchestra.run.smithi081.stdout: mon reweight min bytes per osd = 10 2024-09-13T06:38:18.116 INFO:teuthology.orchestra.run.smithi081.stdout: mgr/telemetry/nag = false 2024-09-13T06:38:18.116 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T06:38:18.116 INFO:teuthology.orchestra.run.smithi081.stdout:[mon] 2024-09-13T06:38:18.117 INFO:teuthology.orchestra.run.smithi081.stdout: debug ms = 1 2024-09-13T06:38:18.117 INFO:teuthology.orchestra.run.smithi081.stdout: debug mon = 20 2024-09-13T06:38:18.117 INFO:teuthology.orchestra.run.smithi081.stdout: debug paxos = 20 2024-09-13T06:38:18.117 INFO:teuthology.orchestra.run.smithi081.stdout: debug auth = 20 2024-09-13T06:38:18.117 INFO:teuthology.orchestra.run.smithi081.stdout: mon data avail warn = 5 2024-09-13T06:38:18.117 INFO:teuthology.orchestra.run.smithi081.stdout: mon mgr mkfs grace = 240 2024-09-13T06:38:18.117 INFO:teuthology.orchestra.run.smithi081.stdout: mon reweight min pgs per osd = 4 2024-09-13T06:38:18.117 INFO:teuthology.orchestra.run.smithi081.stdout: mon osd reporter subtree level = osd 2024-09-13T06:38:18.117 INFO:teuthology.orchestra.run.smithi081.stdout: mon osd prime pg temp = true 2024-09-13T06:38:18.117 INFO:teuthology.orchestra.run.smithi081.stdout: mon reweight min bytes per osd = 10 2024-09-13T06:38:18.117 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T06:38:18.117 INFO:teuthology.orchestra.run.smithi081.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-13T06:38:18.118 INFO:teuthology.orchestra.run.smithi081.stdout: auth mon ticket ttl = 660 # 11m 2024-09-13T06:38:18.118 INFO:teuthology.orchestra.run.smithi081.stdout: auth service ticket ttl = 240 # 4m 2024-09-13T06:38:18.118 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T06:38:18.118 INFO:teuthology.orchestra.run.smithi081.stdout: # don't complain about insecure global_id in the test suite 2024-09-13T06:38:18.118 INFO:teuthology.orchestra.run.smithi081.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-13T06:38:18.118 INFO:teuthology.orchestra.run.smithi081.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-13T06:38:18.118 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T06:38:18.118 INFO:teuthology.orchestra.run.smithi081.stdout: # 1m isn't quite enough 2024-09-13T06:38:18.118 INFO:teuthology.orchestra.run.smithi081.stdout: mon_down_mkfs_grace = 2m 2024-09-13T06:38:18.118 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T06:38:18.118 INFO:teuthology.orchestra.run.smithi081.stdout: mon_warn_on_filestore_osds = false 2024-09-13T06:38:18.118 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T06:38:18.118 INFO:teuthology.orchestra.run.smithi081.stdout:[client] 2024-09-13T06:38:18.118 INFO:teuthology.orchestra.run.smithi081.stdout: rgw cache enabled = true 2024-09-13T06:38:18.119 INFO:teuthology.orchestra.run.smithi081.stdout: rgw enable ops log = true 2024-09-13T06:38:18.119 INFO:teuthology.orchestra.run.smithi081.stdout: rgw enable usage log = true 2024-09-13T06:38:18.119 INFO:teuthology.orchestra.run.smithi081.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-13T06:38:18.119 INFO:teuthology.orchestra.run.smithi081.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-13T06:38:18.119 INFO:teuthology.orchestra.run.smithi081.stdout:[mon.a] 2024-09-13T06:38:18.119 INFO:teuthology.orchestra.run.smithi081.stdout:[mon.c] 2024-09-13T06:38:18.119 INFO:teuthology.orchestra.run.smithi081.stdout:[mon.b] 2024-09-13T06:38:18.121 INFO:teuthology.orchestra.run.smithi139.stdout:[global] 2024-09-13T06:38:18.121 INFO:teuthology.orchestra.run.smithi139.stdout: chdir = "" 2024-09-13T06:38:18.121 INFO:teuthology.orchestra.run.smithi139.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-13T06:38:18.121 INFO:teuthology.orchestra.run.smithi139.stdout: auth supported = cephx 2024-09-13T06:38:18.121 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-13T06:38:18.121 INFO:teuthology.orchestra.run.smithi139.stdout: filestore xattr use omap = true 2024-09-13T06:38:18.121 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-13T06:38:18.121 INFO:teuthology.orchestra.run.smithi139.stdout: mon clock drift allowed = 1.000 2024-09-13T06:38:18.122 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-13T06:38:18.122 INFO:teuthology.orchestra.run.smithi139.stdout: osd crush chooseleaf type = 0 2024-09-13T06:38:18.122 INFO:teuthology.orchestra.run.smithi139.stdout: auth debug = true 2024-09-13T06:38:18.122 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-13T06:38:18.122 INFO:teuthology.orchestra.run.smithi139.stdout: ms die on old message = true 2024-09-13T06:38:18.122 INFO:teuthology.orchestra.run.smithi139.stdout: ms die on bug = true 2024-09-13T06:38:18.122 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-13T06:38:18.122 INFO:teuthology.orchestra.run.smithi139.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-13T06:38:18.122 INFO:teuthology.orchestra.run.smithi139.stdout: mon pg warn max object skew = 0 2024-09-13T06:38:18.122 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-13T06:38:18.122 INFO:teuthology.orchestra.run.smithi139.stdout: # disable pg_autoscaler by default for new pools 2024-09-13T06:38:18.122 INFO:teuthology.orchestra.run.smithi139.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-13T06:38:18.122 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-13T06:38:18.122 INFO:teuthology.orchestra.run.smithi139.stdout: osd pool default size = 2 2024-09-13T06:38:18.123 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-13T06:38:18.123 INFO:teuthology.orchestra.run.smithi139.stdout: mon osd allow primary affinity = true 2024-09-13T06:38:18.123 INFO:teuthology.orchestra.run.smithi139.stdout: mon osd allow pg remap = true 2024-09-13T06:38:18.123 INFO:teuthology.orchestra.run.smithi139.stdout: mon warn on legacy crush tunables = false 2024-09-13T06:38:18.123 INFO:teuthology.orchestra.run.smithi139.stdout: mon warn on crush straw calc version zero = false 2024-09-13T06:38:18.123 INFO:teuthology.orchestra.run.smithi139.stdout: mon warn on no sortbitwise = false 2024-09-13T06:38:18.123 INFO:teuthology.orchestra.run.smithi139.stdout: mon warn on osd down out interval zero = false 2024-09-13T06:38:18.123 INFO:teuthology.orchestra.run.smithi139.stdout: mon warn on too few osds = false 2024-09-13T06:38:18.123 INFO:teuthology.orchestra.run.smithi139.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-13T06:38:18.123 INFO:teuthology.orchestra.run.smithi139.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-13T06:38:18.123 INFO:teuthology.orchestra.run.smithi139.stdout: mon_allow_pool_size_one = true 2024-09-13T06:38:18.123 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-13T06:38:18.123 INFO:teuthology.orchestra.run.smithi139.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-13T06:38:18.124 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-13T06:38:18.124 INFO:teuthology.orchestra.run.smithi139.stdout: osd default data pool replay window = 5 2024-09-13T06:38:18.124 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-13T06:38:18.124 INFO:teuthology.orchestra.run.smithi139.stdout: mon allow pool delete = true 2024-09-13T06:38:18.124 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-13T06:38:18.124 INFO:teuthology.orchestra.run.smithi139.stdout: mon cluster log file level = debug 2024-09-13T06:38:18.124 INFO:teuthology.orchestra.run.smithi139.stdout: debug asserts on shutdown = true 2024-09-13T06:38:18.124 INFO:teuthology.orchestra.run.smithi139.stdout: mon health detail to clog = false 2024-09-13T06:38:18.124 INFO:teuthology.orchestra.run.smithi139.stdout: mon host = "172.21.15.81,[v2:172.21.15.81:3301,v1:172.21.15.81:6790],172.21.15.139" 2024-09-13T06:38:18.124 INFO:teuthology.orchestra.run.smithi139.stdout: mon client directed command retry = 5 2024-09-13T06:38:18.124 INFO:teuthology.orchestra.run.smithi139.stdout: mon warn on pool no app = False 2024-09-13T06:38:18.124 INFO:teuthology.orchestra.run.smithi139.stdout: ms inject socket failures = 5000 2024-09-13T06:38:18.124 INFO:teuthology.orchestra.run.smithi139.stdout: fsid = e5612297-d004-4957-927e-afa37f30d6cf 2024-09-13T06:38:18.124 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-13T06:38:18.125 INFO:teuthology.orchestra.run.smithi139.stdout:[osd] 2024-09-13T06:38:18.125 INFO:teuthology.orchestra.run.smithi139.stdout: osd journal size = 100 2024-09-13T06:38:18.125 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-13T06:38:18.125 INFO:teuthology.orchestra.run.smithi139.stdout: osd scrub load threshold = 5.0 2024-09-13T06:38:18.125 INFO:teuthology.orchestra.run.smithi139.stdout: osd scrub max interval = 600 2024-09-13T06:38:18.125 INFO:teuthology.orchestra.run.smithi139.stdout: osd mclock profile = high_recovery_ops 2024-09-13T06:38:18.125 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-13T06:38:18.125 INFO:teuthology.orchestra.run.smithi139.stdout: osd recover clone overlap = true 2024-09-13T06:38:18.125 INFO:teuthology.orchestra.run.smithi139.stdout: osd recovery max chunk = 1048576 2024-09-13T06:38:18.126 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-13T06:38:18.126 INFO:teuthology.orchestra.run.smithi139.stdout: osd debug shutdown = true 2024-09-13T06:38:18.126 INFO:teuthology.orchestra.run.smithi139.stdout: osd debug op order = true 2024-09-13T06:38:18.126 INFO:teuthology.orchestra.run.smithi139.stdout: osd debug verify stray on activate = true 2024-09-13T06:38:18.126 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-13T06:38:18.126 INFO:teuthology.orchestra.run.smithi139.stdout: osd open classes on start = true 2024-09-13T06:38:18.126 INFO:teuthology.orchestra.run.smithi139.stdout: osd debug pg log writeout = true 2024-09-13T06:38:18.126 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-13T06:38:18.126 INFO:teuthology.orchestra.run.smithi139.stdout: osd deep scrub update digest min age = 30 2024-09-13T06:38:18.126 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-13T06:38:18.126 INFO:teuthology.orchestra.run.smithi139.stdout: osd map max advance = 10 2024-09-13T06:38:18.126 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-13T06:38:18.126 INFO:teuthology.orchestra.run.smithi139.stdout: journal zero on create = true 2024-09-13T06:38:18.127 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-13T06:38:18.127 INFO:teuthology.orchestra.run.smithi139.stdout: filestore ondisk finisher threads = 3 2024-09-13T06:38:18.127 INFO:teuthology.orchestra.run.smithi139.stdout: filestore apply finisher threads = 3 2024-09-13T06:38:18.127 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-13T06:38:18.127 INFO:teuthology.orchestra.run.smithi139.stdout: bdev debug aio = true 2024-09-13T06:38:18.127 INFO:teuthology.orchestra.run.smithi139.stdout: osd debug misdirected ops = true 2024-09-13T06:38:18.127 INFO:teuthology.orchestra.run.smithi139.stdout: bdev async discard = True 2024-09-13T06:38:18.127 INFO:teuthology.orchestra.run.smithi139.stdout: bdev enable discard = True 2024-09-13T06:38:18.127 INFO:teuthology.orchestra.run.smithi139.stdout: bluestore block size = 96636764160 2024-09-13T06:38:18.127 INFO:teuthology.orchestra.run.smithi139.stdout: bluestore fsck on mount = True 2024-09-13T06:38:18.127 INFO:teuthology.orchestra.run.smithi139.stdout: debug bluefs = 1/20 2024-09-13T06:38:18.127 INFO:teuthology.orchestra.run.smithi139.stdout: debug bluestore = 1/20 2024-09-13T06:38:18.128 INFO:teuthology.orchestra.run.smithi139.stdout: debug ms = 1 2024-09-13T06:38:18.128 INFO:teuthology.orchestra.run.smithi139.stdout: debug osd = 20 2024-09-13T06:38:18.128 INFO:teuthology.orchestra.run.smithi139.stdout: debug rocksdb = 4/10 2024-09-13T06:38:18.128 INFO:teuthology.orchestra.run.smithi139.stdout: mon osd backfillfull_ratio = 0.85 2024-09-13T06:38:18.128 INFO:teuthology.orchestra.run.smithi139.stdout: mon osd full ratio = 0.9 2024-09-13T06:38:18.128 INFO:teuthology.orchestra.run.smithi139.stdout: mon osd nearfull ratio = 0.8 2024-09-13T06:38:18.128 INFO:teuthology.orchestra.run.smithi139.stdout: osd blocked scrub grace period = 3600 2024-09-13T06:38:18.128 INFO:teuthology.orchestra.run.smithi139.stdout: osd failsafe full ratio = 0.95 2024-09-13T06:38:18.128 INFO:teuthology.orchestra.run.smithi139.stdout: osd max markdown count = 1000 2024-09-13T06:38:18.128 INFO:teuthology.orchestra.run.smithi139.stdout: osd memory target = 1610612736 2024-09-13T06:38:18.128 INFO:teuthology.orchestra.run.smithi139.stdout: osd objectstore = bluestore 2024-09-13T06:38:18.128 INFO:teuthology.orchestra.run.smithi139.stdout: osd shutdown pgref assert = True 2024-09-13T06:38:18.128 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-13T06:38:18.129 INFO:teuthology.orchestra.run.smithi139.stdout:[mgr] 2024-09-13T06:38:18.129 INFO:teuthology.orchestra.run.smithi139.stdout: debug ms = 1 2024-09-13T06:38:18.129 INFO:teuthology.orchestra.run.smithi139.stdout: debug mgr = 20 2024-09-13T06:38:18.129 INFO:teuthology.orchestra.run.smithi139.stdout: debug mon = 20 2024-09-13T06:38:18.129 INFO:teuthology.orchestra.run.smithi139.stdout: debug auth = 20 2024-09-13T06:38:18.129 INFO:teuthology.orchestra.run.smithi139.stdout: mon reweight min pgs per osd = 4 2024-09-13T06:38:18.129 INFO:teuthology.orchestra.run.smithi139.stdout: mon reweight min bytes per osd = 10 2024-09-13T06:38:18.129 INFO:teuthology.orchestra.run.smithi139.stdout: mgr/telemetry/nag = false 2024-09-13T06:38:18.129 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-13T06:38:18.129 INFO:teuthology.orchestra.run.smithi139.stdout:[mon] 2024-09-13T06:38:18.129 INFO:teuthology.orchestra.run.smithi139.stdout: debug ms = 1 2024-09-13T06:38:18.129 INFO:teuthology.orchestra.run.smithi139.stdout: debug mon = 20 2024-09-13T06:38:18.130 INFO:teuthology.orchestra.run.smithi139.stdout: debug paxos = 20 2024-09-13T06:38:18.130 INFO:teuthology.orchestra.run.smithi139.stdout: debug auth = 20 2024-09-13T06:38:18.130 INFO:teuthology.orchestra.run.smithi139.stdout: mon data avail warn = 5 2024-09-13T06:38:18.130 INFO:teuthology.orchestra.run.smithi139.stdout: mon mgr mkfs grace = 240 2024-09-13T06:38:18.130 INFO:teuthology.orchestra.run.smithi139.stdout: mon reweight min pgs per osd = 4 2024-09-13T06:38:18.130 INFO:teuthology.orchestra.run.smithi139.stdout: mon osd reporter subtree level = osd 2024-09-13T06:38:18.130 INFO:teuthology.orchestra.run.smithi139.stdout: mon osd prime pg temp = true 2024-09-13T06:38:18.130 INFO:teuthology.orchestra.run.smithi139.stdout: mon reweight min bytes per osd = 10 2024-09-13T06:38:18.130 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-13T06:38:18.130 INFO:teuthology.orchestra.run.smithi139.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-13T06:38:18.130 INFO:teuthology.orchestra.run.smithi139.stdout: auth mon ticket ttl = 660 # 11m 2024-09-13T06:38:18.130 INFO:teuthology.orchestra.run.smithi139.stdout: auth service ticket ttl = 240 # 4m 2024-09-13T06:38:18.130 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-13T06:38:18.130 INFO:teuthology.orchestra.run.smithi139.stdout: # don't complain about insecure global_id in the test suite 2024-09-13T06:38:18.131 INFO:teuthology.orchestra.run.smithi139.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-13T06:38:18.131 INFO:teuthology.orchestra.run.smithi139.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-13T06:38:18.131 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-13T06:38:18.131 INFO:teuthology.orchestra.run.smithi139.stdout: # 1m isn't quite enough 2024-09-13T06:38:18.131 INFO:teuthology.orchestra.run.smithi139.stdout: mon_down_mkfs_grace = 2m 2024-09-13T06:38:18.131 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-13T06:38:18.131 INFO:teuthology.orchestra.run.smithi139.stdout: mon_warn_on_filestore_osds = false 2024-09-13T06:38:18.131 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-13T06:38:18.131 INFO:teuthology.orchestra.run.smithi139.stdout:[client] 2024-09-13T06:38:18.131 INFO:teuthology.orchestra.run.smithi139.stdout: rgw cache enabled = true 2024-09-13T06:38:18.131 INFO:teuthology.orchestra.run.smithi139.stdout: rgw enable ops log = true 2024-09-13T06:38:18.131 INFO:teuthology.orchestra.run.smithi139.stdout: rgw enable usage log = true 2024-09-13T06:38:18.131 INFO:teuthology.orchestra.run.smithi139.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-13T06:38:18.131 INFO:teuthology.orchestra.run.smithi139.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-13T06:38:18.131 INFO:teuthology.orchestra.run.smithi139.stdout:[mon.a] 2024-09-13T06:38:18.132 INFO:teuthology.orchestra.run.smithi139.stdout:[mon.c] 2024-09-13T06:38:18.132 INFO:teuthology.orchestra.run.smithi139.stdout:[mon.b] 2024-09-13T06:38:18.132 INFO:tasks.ceph:Creating admin key on mon.a... 2024-09-13T06:38:18.132 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-09-13T06:38:18.214 INFO:tasks.ceph:Copying monmap to all nodes... 2024-09-13T06:38:18.214 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-13T06:38:18.214 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-09-13T06:38:18.219 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-13T06:38:18.219 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-09-13T06:38:18.265 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi081.front.sepia.ceph.com 2024-09-13T06:38:18.265 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-13T06:38:18.265 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-13T06:38:18.265 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-13T06:38:18.326 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-13T06:38:18.326 DEBUG:teuthology.orchestra.run.smithi081:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-13T06:38:18.372 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi139.front.sepia.ceph.com 2024-09-13T06:38:18.372 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2024-09-13T06:38:18.372 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-13T06:38:18.373 DEBUG:teuthology.orchestra.run.smithi139:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-13T06:38:18.396 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2024-09-13T06:38:18.396 DEBUG:teuthology.orchestra.run.smithi139:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-13T06:38:18.494 INFO:tasks.ceph:Setting up mon nodes... 2024-09-13T06:38:18.494 INFO:tasks.ceph:Setting up mgr nodes... 2024-09-13T06:38:18.494 DEBUG:teuthology.orchestra.run.smithi081:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-09-13T06:38:18.538 INFO:teuthology.orchestra.run.smithi081.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-09-13T06:38:18.541 DEBUG:teuthology.orchestra.run.smithi139:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-09-13T06:38:18.585 INFO:teuthology.orchestra.run.smithi139.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-09-13T06:38:18.593 INFO:tasks.ceph:Setting up mds nodes... 2024-09-13T06:38:18.593 INFO:tasks.ceph_client:Setting up client nodes... 2024-09-13T06:38:18.593 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-13T06:38:18.628 INFO:teuthology.orchestra.run.smithi081.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-09-13T06:38:18.638 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-09-13T06:38:18.673 INFO:teuthology.orchestra.run.smithi139.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-09-13T06:38:18.684 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-09-13T06:38:18.685 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi081.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi139.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-13T06:38:18.685 DEBUG:teuthology.orchestra.run.smithi081:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-09-13T06:38:18.696 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-13T06:38:18.696 INFO:tasks.ceph:role: osd.0 2024-09-13T06:38:18.696 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi081.front.sepia.ceph.com 2024-09-13T06:38:18.697 DEBUG:teuthology.orchestra.run.smithi081:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-13T06:38:18.759 INFO:teuthology.orchestra.run.smithi081.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-13T06:38:18.759 INFO:teuthology.orchestra.run.smithi081.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-13T06:38:18.759 INFO:teuthology.orchestra.run.smithi081.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-13T06:38:18.759 INFO:teuthology.orchestra.run.smithi081.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-13T06:38:18.760 INFO:teuthology.orchestra.run.smithi081.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-13T06:38:18.760 INFO:teuthology.orchestra.run.smithi081.stdout: = sunit=0 swidth=0 blks 2024-09-13T06:38:18.760 INFO:teuthology.orchestra.run.smithi081.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-13T06:38:18.760 INFO:teuthology.orchestra.run.smithi081.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-13T06:38:18.760 INFO:teuthology.orchestra.run.smithi081.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-13T06:38:18.760 INFO:teuthology.orchestra.run.smithi081.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-13T06:38:19.214 INFO:teuthology.orchestra.run.smithi081.stdout:Discarding blocks...Done. 2024-09-13T06:38:19.216 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi081.front.sepia.ceph.com -o noatime 2024-09-13T06:38:19.216 DEBUG:teuthology.orchestra.run.smithi081:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-09-13T06:38:19.309 DEBUG:teuthology.orchestra.run.smithi081:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-09-13T06:38:19.319 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T06:38:19.319 INFO:teuthology.orchestra.run.smithi081.stderr:sudo: /sbin/restorecon: command not found 2024-09-13T06:38:19.319 DEBUG:teuthology.orchestra.run.smithi081:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-09-13T06:38:19.374 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-13T06:38:19.374 INFO:tasks.ceph:role: osd.1 2024-09-13T06:38:19.374 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi081.front.sepia.ceph.com 2024-09-13T06:38:19.374 DEBUG:teuthology.orchestra.run.smithi081:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-13T06:38:19.435 INFO:teuthology.orchestra.run.smithi081.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-13T06:38:19.435 INFO:teuthology.orchestra.run.smithi081.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-13T06:38:19.435 INFO:teuthology.orchestra.run.smithi081.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-13T06:38:19.435 INFO:teuthology.orchestra.run.smithi081.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-13T06:38:19.435 INFO:teuthology.orchestra.run.smithi081.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-13T06:38:19.435 INFO:teuthology.orchestra.run.smithi081.stdout: = sunit=0 swidth=0 blks 2024-09-13T06:38:19.436 INFO:teuthology.orchestra.run.smithi081.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-13T06:38:19.436 INFO:teuthology.orchestra.run.smithi081.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-13T06:38:19.436 INFO:teuthology.orchestra.run.smithi081.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-13T06:38:19.436 INFO:teuthology.orchestra.run.smithi081.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-13T06:38:19.905 INFO:teuthology.orchestra.run.smithi081.stdout:Discarding blocks...Done. 2024-09-13T06:38:19.907 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi081.front.sepia.ceph.com -o noatime 2024-09-13T06:38:19.907 DEBUG:teuthology.orchestra.run.smithi081:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-09-13T06:38:20.041 DEBUG:teuthology.orchestra.run.smithi081:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-09-13T06:38:20.051 INFO:teuthology.orchestra.run.smithi081.stderr:sudo: /sbin/restorecon: command not found 2024-09-13T06:38:20.052 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T06:38:20.053 DEBUG:teuthology.orchestra.run.smithi081:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-09-13T06:38:20.109 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-13T06:38:20.109 INFO:tasks.ceph:role: osd.2 2024-09-13T06:38:20.109 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi081.front.sepia.ceph.com 2024-09-13T06:38:20.109 DEBUG:teuthology.orchestra.run.smithi081:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-13T06:38:20.173 INFO:teuthology.orchestra.run.smithi081.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-13T06:38:20.173 INFO:teuthology.orchestra.run.smithi081.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-13T06:38:20.173 INFO:teuthology.orchestra.run.smithi081.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-13T06:38:20.173 INFO:teuthology.orchestra.run.smithi081.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-13T06:38:20.173 INFO:teuthology.orchestra.run.smithi081.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-13T06:38:20.173 INFO:teuthology.orchestra.run.smithi081.stdout: = sunit=0 swidth=0 blks 2024-09-13T06:38:20.173 INFO:teuthology.orchestra.run.smithi081.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-13T06:38:20.173 INFO:teuthology.orchestra.run.smithi081.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-13T06:38:20.173 INFO:teuthology.orchestra.run.smithi081.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-13T06:38:20.174 INFO:teuthology.orchestra.run.smithi081.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-13T06:38:20.658 INFO:teuthology.orchestra.run.smithi081.stdout:Discarding blocks...Done. 2024-09-13T06:38:20.660 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi081.front.sepia.ceph.com -o noatime 2024-09-13T06:38:20.660 DEBUG:teuthology.orchestra.run.smithi081:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-09-13T06:38:20.788 DEBUG:teuthology.orchestra.run.smithi081:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-09-13T06:38:20.798 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T06:38:20.798 INFO:teuthology.orchestra.run.smithi081.stderr:sudo: /sbin/restorecon: command not found 2024-09-13T06:38:20.799 DEBUG:teuthology.orchestra.run.smithi081:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-09-13T06:38:20.853 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-13T06:38:20.853 INFO:tasks.ceph:role: osd.3 2024-09-13T06:38:20.853 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi081.front.sepia.ceph.com 2024-09-13T06:38:20.853 DEBUG:teuthology.orchestra.run.smithi081:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-13T06:38:20.916 INFO:teuthology.orchestra.run.smithi081.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-13T06:38:20.916 INFO:teuthology.orchestra.run.smithi081.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-13T06:38:20.916 INFO:teuthology.orchestra.run.smithi081.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-13T06:38:20.916 INFO:teuthology.orchestra.run.smithi081.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-13T06:38:20.916 INFO:teuthology.orchestra.run.smithi081.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-13T06:38:20.916 INFO:teuthology.orchestra.run.smithi081.stdout: = sunit=0 swidth=0 blks 2024-09-13T06:38:20.916 INFO:teuthology.orchestra.run.smithi081.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-13T06:38:20.916 INFO:teuthology.orchestra.run.smithi081.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-13T06:38:20.916 INFO:teuthology.orchestra.run.smithi081.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-13T06:38:20.916 INFO:teuthology.orchestra.run.smithi081.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-13T06:38:21.346 INFO:teuthology.orchestra.run.smithi081.stdout:Discarding blocks...Done. 2024-09-13T06:38:21.348 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi081.front.sepia.ceph.com -o noatime 2024-09-13T06:38:21.348 DEBUG:teuthology.orchestra.run.smithi081:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-09-13T06:38:21.444 DEBUG:teuthology.orchestra.run.smithi081:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-09-13T06:38:21.455 INFO:teuthology.orchestra.run.smithi081.stderr:sudo: /sbin/restorecon: command not found 2024-09-13T06:38:21.456 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T06:38:21.456 DEBUG:teuthology.orchestra.run.smithi081:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-13T06:38:21.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T06:38:21.608+0000 7f6bc462c7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-09-13T06:38:21.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T06:38:21.608+0000 7f6bc462c7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-09-13T06:38:21.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T06:38:21.612+0000 7f6bc462c7c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-09-13T06:38:21.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T06:38:21.612+0000 7f6bc462c7c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-09-13T06:38:21.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T06:38:21.612+0000 7f6bc462c7c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-09-13T06:38:21.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T06:38:21.616+0000 7f6bc462c7c0 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-09-13T06:38:24.578 DEBUG:teuthology.orchestra.run.smithi081:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-13T06:38:24.592 DEBUG:teuthology.orchestra.run.smithi081:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-13T06:38:24.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T06:38:24.680+0000 7f95569097c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-09-13T06:38:24.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T06:38:24.680+0000 7f95569097c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-09-13T06:38:24.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T06:38:24.680+0000 7f95569097c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-09-13T06:38:24.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T06:38:24.680+0000 7f95569097c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-09-13T06:38:24.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T06:38:24.680+0000 7f95569097c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-09-13T06:38:24.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T06:38:24.680+0000 7f95569097c0 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-09-13T06:38:27.654 DEBUG:teuthology.orchestra.run.smithi081:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-13T06:38:27.709 DEBUG:teuthology.orchestra.run.smithi081:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-13T06:38:27.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T06:38:27.792+0000 7f141ae717c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-09-13T06:38:27.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T06:38:27.792+0000 7f141ae717c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-09-13T06:38:27.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T06:38:27.792+0000 7f141ae717c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-09-13T06:38:27.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T06:38:27.792+0000 7f141ae717c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-09-13T06:38:27.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T06:38:27.792+0000 7f141ae717c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-09-13T06:38:27.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T06:38:27.792+0000 7f141ae717c0 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-09-13T06:38:30.760 DEBUG:teuthology.orchestra.run.smithi081:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-13T06:38:30.817 DEBUG:teuthology.orchestra.run.smithi081:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-13T06:38:30.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T06:38:30.900+0000 7fb87a5d97c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-09-13T06:38:30.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T06:38:30.900+0000 7fb87a5d97c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-09-13T06:38:30.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T06:38:30.900+0000 7fb87a5d97c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-09-13T06:38:30.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T06:38:30.900+0000 7fb87a5d97c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-09-13T06:38:30.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T06:38:30.900+0000 7fb87a5d97c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-09-13T06:38:30.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T06:38:30.904+0000 7fb87a5d97c0 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-09-13T06:38:33.874 DEBUG:teuthology.orchestra.run.smithi081:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-13T06:38:33.929 DEBUG:teuthology.orchestra.run.smithi139:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-09-13T06:38:33.944 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-13T06:38:33.944 INFO:tasks.ceph:role: osd.4 2024-09-13T06:38:33.944 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi139.front.sepia.ceph.com 2024-09-13T06:38:33.944 DEBUG:teuthology.orchestra.run.smithi139:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-13T06:38:34.008 INFO:teuthology.orchestra.run.smithi139.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-13T06:38:34.009 INFO:teuthology.orchestra.run.smithi139.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-13T06:38:34.009 INFO:teuthology.orchestra.run.smithi139.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-13T06:38:34.009 INFO:teuthology.orchestra.run.smithi139.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-13T06:38:34.009 INFO:teuthology.orchestra.run.smithi139.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-13T06:38:34.009 INFO:teuthology.orchestra.run.smithi139.stdout: = sunit=0 swidth=0 blks 2024-09-13T06:38:34.009 INFO:teuthology.orchestra.run.smithi139.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-13T06:38:34.009 INFO:teuthology.orchestra.run.smithi139.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-13T06:38:34.009 INFO:teuthology.orchestra.run.smithi139.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-13T06:38:34.009 INFO:teuthology.orchestra.run.smithi139.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-13T06:38:34.463 INFO:teuthology.orchestra.run.smithi139.stdout:Discarding blocks...Done. 2024-09-13T06:38:34.465 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi139.front.sepia.ceph.com -o noatime 2024-09-13T06:38:34.465 DEBUG:teuthology.orchestra.run.smithi139:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-09-13T06:38:34.559 DEBUG:teuthology.orchestra.run.smithi139:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-09-13T06:38:34.569 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T06:38:34.569 INFO:teuthology.orchestra.run.smithi139.stderr:sudo: /sbin/restorecon: command not found 2024-09-13T06:38:34.570 DEBUG:teuthology.orchestra.run.smithi139:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-09-13T06:38:34.623 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-13T06:38:34.623 INFO:tasks.ceph:role: osd.5 2024-09-13T06:38:34.624 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi139.front.sepia.ceph.com 2024-09-13T06:38:34.624 DEBUG:teuthology.orchestra.run.smithi139:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-13T06:38:34.686 INFO:teuthology.orchestra.run.smithi139.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-13T06:38:34.686 INFO:teuthology.orchestra.run.smithi139.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-13T06:38:34.686 INFO:teuthology.orchestra.run.smithi139.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-13T06:38:34.686 INFO:teuthology.orchestra.run.smithi139.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-13T06:38:34.686 INFO:teuthology.orchestra.run.smithi139.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-13T06:38:34.686 INFO:teuthology.orchestra.run.smithi139.stdout: = sunit=0 swidth=0 blks 2024-09-13T06:38:34.686 INFO:teuthology.orchestra.run.smithi139.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-13T06:38:34.686 INFO:teuthology.orchestra.run.smithi139.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-13T06:38:34.686 INFO:teuthology.orchestra.run.smithi139.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-13T06:38:34.686 INFO:teuthology.orchestra.run.smithi139.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-13T06:38:35.154 INFO:teuthology.orchestra.run.smithi139.stdout:Discarding blocks...Done. 2024-09-13T06:38:35.156 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi139.front.sepia.ceph.com -o noatime 2024-09-13T06:38:35.156 DEBUG:teuthology.orchestra.run.smithi139:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-09-13T06:38:35.309 DEBUG:teuthology.orchestra.run.smithi139:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-09-13T06:38:35.320 INFO:teuthology.orchestra.run.smithi139.stderr:sudo: /sbin/restorecon: command not found 2024-09-13T06:38:35.321 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T06:38:35.321 DEBUG:teuthology.orchestra.run.smithi139:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-09-13T06:38:35.377 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-13T06:38:35.377 INFO:tasks.ceph:role: osd.6 2024-09-13T06:38:35.377 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi139.front.sepia.ceph.com 2024-09-13T06:38:35.377 DEBUG:teuthology.orchestra.run.smithi139:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-13T06:38:35.443 INFO:teuthology.orchestra.run.smithi139.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-13T06:38:35.443 INFO:teuthology.orchestra.run.smithi139.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-13T06:38:35.443 INFO:teuthology.orchestra.run.smithi139.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-13T06:38:35.443 INFO:teuthology.orchestra.run.smithi139.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-13T06:38:35.443 INFO:teuthology.orchestra.run.smithi139.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-13T06:38:35.443 INFO:teuthology.orchestra.run.smithi139.stdout: = sunit=0 swidth=0 blks 2024-09-13T06:38:35.443 INFO:teuthology.orchestra.run.smithi139.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-13T06:38:35.444 INFO:teuthology.orchestra.run.smithi139.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-13T06:38:35.444 INFO:teuthology.orchestra.run.smithi139.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-13T06:38:35.444 INFO:teuthology.orchestra.run.smithi139.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-13T06:38:35.901 INFO:teuthology.orchestra.run.smithi139.stdout:Discarding blocks...Done. 2024-09-13T06:38:35.903 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi139.front.sepia.ceph.com -o noatime 2024-09-13T06:38:35.904 DEBUG:teuthology.orchestra.run.smithi139:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-09-13T06:38:36.029 DEBUG:teuthology.orchestra.run.smithi139:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-09-13T06:38:36.040 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T06:38:36.041 INFO:teuthology.orchestra.run.smithi139.stderr:sudo: /sbin/restorecon: command not found 2024-09-13T06:38:36.041 DEBUG:teuthology.orchestra.run.smithi139:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-09-13T06:38:36.096 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-13T06:38:36.096 INFO:tasks.ceph:role: osd.7 2024-09-13T06:38:36.096 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi139.front.sepia.ceph.com 2024-09-13T06:38:36.096 DEBUG:teuthology.orchestra.run.smithi139:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-13T06:38:36.160 INFO:teuthology.orchestra.run.smithi139.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-13T06:38:36.161 INFO:teuthology.orchestra.run.smithi139.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-13T06:38:36.161 INFO:teuthology.orchestra.run.smithi139.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-13T06:38:36.161 INFO:teuthology.orchestra.run.smithi139.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-13T06:38:36.161 INFO:teuthology.orchestra.run.smithi139.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-13T06:38:36.161 INFO:teuthology.orchestra.run.smithi139.stdout: = sunit=0 swidth=0 blks 2024-09-13T06:38:36.161 INFO:teuthology.orchestra.run.smithi139.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-13T06:38:36.161 INFO:teuthology.orchestra.run.smithi139.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-13T06:38:36.161 INFO:teuthology.orchestra.run.smithi139.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-13T06:38:36.161 INFO:teuthology.orchestra.run.smithi139.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-13T06:38:36.590 INFO:teuthology.orchestra.run.smithi139.stdout:Discarding blocks...Done. 2024-09-13T06:38:36.592 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi139.front.sepia.ceph.com -o noatime 2024-09-13T06:38:36.592 DEBUG:teuthology.orchestra.run.smithi139:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-09-13T06:38:36.680 DEBUG:teuthology.orchestra.run.smithi139:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-09-13T06:38:36.733 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T06:38:36.733 INFO:teuthology.orchestra.run.smithi139.stderr:sudo: /sbin/restorecon: command not found 2024-09-13T06:38:36.734 DEBUG:teuthology.orchestra.run.smithi139:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-13T06:38:36.841 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T06:38:36.842+0000 7f73de0ec7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-09-13T06:38:36.842 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T06:38:36.842+0000 7f73de0ec7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-09-13T06:38:36.843 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T06:38:36.842+0000 7f73de0ec7c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-09-13T06:38:36.843 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T06:38:36.842+0000 7f73de0ec7c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-09-13T06:38:36.843 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T06:38:36.842+0000 7f73de0ec7c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-09-13T06:38:36.843 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T06:38:36.842+0000 7f73de0ec7c0 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-09-13T06:38:39.812 DEBUG:teuthology.orchestra.run.smithi139:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-13T06:38:39.826 DEBUG:teuthology.orchestra.run.smithi139:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-13T06:38:39.906 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T06:38:39.906+0000 7f4707dc97c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-09-13T06:38:39.907 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T06:38:39.906+0000 7f4707dc97c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-09-13T06:38:39.907 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T06:38:39.906+0000 7f4707dc97c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-09-13T06:38:39.907 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T06:38:39.906+0000 7f4707dc97c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-09-13T06:38:39.907 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T06:38:39.906+0000 7f4707dc97c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-09-13T06:38:39.908 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T06:38:39.906+0000 7f4707dc97c0 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-09-13T06:38:42.872 DEBUG:teuthology.orchestra.run.smithi139:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-13T06:38:42.929 DEBUG:teuthology.orchestra.run.smithi139:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-13T06:38:43.011 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T06:38:43.010+0000 7f5586fca7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-09-13T06:38:43.011 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T06:38:43.010+0000 7f5586fca7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-09-13T06:38:43.012 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T06:38:43.010+0000 7f5586fca7c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-09-13T06:38:43.012 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T06:38:43.010+0000 7f5586fca7c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-09-13T06:38:43.012 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T06:38:43.010+0000 7f5586fca7c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-09-13T06:38:43.012 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T06:38:43.014+0000 7f5586fca7c0 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-09-13T06:38:46.000 DEBUG:teuthology.orchestra.run.smithi139:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-09-13T06:38:46.057 DEBUG:teuthology.orchestra.run.smithi139:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-13T06:38:46.137 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T06:38:46.138+0000 7fe61091a7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-09-13T06:38:46.137 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T06:38:46.138+0000 7fe61091a7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-09-13T06:38:46.137 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T06:38:46.138+0000 7fe61091a7c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-09-13T06:38:46.137 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T06:38:46.138+0000 7fe61091a7c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-09-13T06:38:46.137 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T06:38:46.138+0000 7fe61091a7c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-09-13T06:38:46.138 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-13T06:38:46.138+0000 7fe61091a7c0 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-09-13T06:38:49.120 DEBUG:teuthology.orchestra.run.smithi139:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-09-13T06:38:49.182 INFO:tasks.ceph:Reading keys from all nodes... 2024-09-13T06:38:49.182 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-13T06:38:49.182 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-09-13T06:38:49.196 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-13T06:38:49.197 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-09-13T06:38:49.250 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-13T06:38:49.251 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-09-13T06:38:49.304 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-13T06:38:49.304 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-09-13T06:38:49.358 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-13T06:38:49.359 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-09-13T06:38:49.413 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2024-09-13T06:38:49.413 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-09-13T06:38:49.427 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2024-09-13T06:38:49.427 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-09-13T06:38:49.482 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2024-09-13T06:38:49.482 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-09-13T06:38:49.536 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2024-09-13T06:38:49.536 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-09-13T06:38:49.593 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2024-09-13T06:38:49.593 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-09-13T06:38:49.648 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-13T06:38:49.648 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-09-13T06:38:49.654 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2024-09-13T06:38:49.654 DEBUG:teuthology.orchestra.run.smithi139:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-09-13T06:38:49.697 INFO:tasks.ceph:Adding keys to all mons... 2024-09-13T06:38:49.697 DEBUG:teuthology.orchestra.run.smithi081:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-13T06:38:49.699 DEBUG:teuthology.orchestra.run.smithi139:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-13T06:38:49.742 INFO:teuthology.orchestra.run.smithi081.stdout:[mgr.y] 2024-09-13T06:38:49.742 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQDa3eNmPM9ZIBAAejiy858eCWNbB6sRNYHKVA== 2024-09-13T06:38:49.743 INFO:teuthology.orchestra.run.smithi081.stdout:[osd.0] 2024-09-13T06:38:49.743 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQDd3eNmF3R1JBAAQMGJJfF8VDBrU6r5ybBPHw== 2024-09-13T06:38:49.743 INFO:teuthology.orchestra.run.smithi081.stdout:[osd.1] 2024-09-13T06:38:49.743 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQDg3eNmtZupKBAAwqIjXoW4iTkyjJaPFmXa8A== 2024-09-13T06:38:49.743 INFO:teuthology.orchestra.run.smithi081.stdout:[osd.2] 2024-09-13T06:38:49.743 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQDj3eNmKCNSLxAAe3ArTLCzp6A7vQBTgltlUw== 2024-09-13T06:38:49.743 INFO:teuthology.orchestra.run.smithi081.stdout:[osd.3] 2024-09-13T06:38:49.743 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQDm3eNmWJDYNRAACAJpLiJrfs3TpcuFg/z2CQ== 2024-09-13T06:38:49.743 INFO:teuthology.orchestra.run.smithi081.stdout:[mgr.x] 2024-09-13T06:38:49.743 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQDa3eNmULcuIxAAayLV6SqH461ZlvwXijPQ7w== 2024-09-13T06:38:49.743 INFO:teuthology.orchestra.run.smithi081.stdout:[osd.4] 2024-09-13T06:38:49.743 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQDs3eNmerlwMhAAg1lO5kxsyVhjltptPFoupw== 2024-09-13T06:38:49.743 INFO:teuthology.orchestra.run.smithi081.stdout:[osd.5] 2024-09-13T06:38:49.743 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQDv3eNmAWlbNhAAsSNBr94u54deW4Ijvs1mZg== 2024-09-13T06:38:49.744 INFO:teuthology.orchestra.run.smithi081.stdout:[osd.6] 2024-09-13T06:38:49.744 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQDz3eNmrDX7ABAAb4RXYECWnNluDSuczWec8A== 2024-09-13T06:38:49.744 INFO:teuthology.orchestra.run.smithi081.stdout:[osd.7] 2024-09-13T06:38:49.744 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQD23eNmurt7CBAAFRu1XK4uoxLYsvuFBWkCAw== 2024-09-13T06:38:49.744 INFO:teuthology.orchestra.run.smithi081.stdout:[client.0] 2024-09-13T06:38:49.744 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQDa3eNmBW65JRAApj4MS3WBEpbS37s+ixWHgQ== 2024-09-13T06:38:49.744 INFO:teuthology.orchestra.run.smithi081.stdout:[client.1] 2024-09-13T06:38:49.744 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQDa3eNmuOVpKBAABn6HmxiGx0U2ExGIQtMaFw== 2024-09-13T06:38:49.750 INFO:teuthology.orchestra.run.smithi139.stdout:[mgr.y] 2024-09-13T06:38:49.750 INFO:teuthology.orchestra.run.smithi139.stdout: key = AQDa3eNmPM9ZIBAAejiy858eCWNbB6sRNYHKVA== 2024-09-13T06:38:49.750 INFO:teuthology.orchestra.run.smithi139.stdout:[osd.0] 2024-09-13T06:38:49.750 INFO:teuthology.orchestra.run.smithi139.stdout: key = AQDd3eNmF3R1JBAAQMGJJfF8VDBrU6r5ybBPHw== 2024-09-13T06:38:49.750 INFO:teuthology.orchestra.run.smithi139.stdout:[osd.1] 2024-09-13T06:38:49.751 INFO:teuthology.orchestra.run.smithi139.stdout: key = AQDg3eNmtZupKBAAwqIjXoW4iTkyjJaPFmXa8A== 2024-09-13T06:38:49.751 INFO:teuthology.orchestra.run.smithi139.stdout:[osd.2] 2024-09-13T06:38:49.751 INFO:teuthology.orchestra.run.smithi139.stdout: key = AQDj3eNmKCNSLxAAe3ArTLCzp6A7vQBTgltlUw== 2024-09-13T06:38:49.751 INFO:teuthology.orchestra.run.smithi139.stdout:[osd.3] 2024-09-13T06:38:49.751 INFO:teuthology.orchestra.run.smithi139.stdout: key = AQDm3eNmWJDYNRAACAJpLiJrfs3TpcuFg/z2CQ== 2024-09-13T06:38:49.751 INFO:teuthology.orchestra.run.smithi139.stdout:[mgr.x] 2024-09-13T06:38:49.751 INFO:teuthology.orchestra.run.smithi139.stdout: key = AQDa3eNmULcuIxAAayLV6SqH461ZlvwXijPQ7w== 2024-09-13T06:38:49.751 INFO:teuthology.orchestra.run.smithi139.stdout:[osd.4] 2024-09-13T06:38:49.751 INFO:teuthology.orchestra.run.smithi139.stdout: key = AQDs3eNmerlwMhAAg1lO5kxsyVhjltptPFoupw== 2024-09-13T06:38:49.751 INFO:teuthology.orchestra.run.smithi139.stdout:[osd.5] 2024-09-13T06:38:49.751 INFO:teuthology.orchestra.run.smithi139.stdout: key = AQDv3eNmAWlbNhAAsSNBr94u54deW4Ijvs1mZg== 2024-09-13T06:38:49.751 INFO:teuthology.orchestra.run.smithi139.stdout:[osd.6] 2024-09-13T06:38:49.751 INFO:teuthology.orchestra.run.smithi139.stdout: key = AQDz3eNmrDX7ABAAb4RXYECWnNluDSuczWec8A== 2024-09-13T06:38:49.751 INFO:teuthology.orchestra.run.smithi139.stdout:[osd.7] 2024-09-13T06:38:49.752 INFO:teuthology.orchestra.run.smithi139.stdout: key = AQD23eNmurt7CBAAFRu1XK4uoxLYsvuFBWkCAw== 2024-09-13T06:38:49.752 INFO:teuthology.orchestra.run.smithi139.stdout:[client.0] 2024-09-13T06:38:49.752 INFO:teuthology.orchestra.run.smithi139.stdout: key = AQDa3eNmBW65JRAApj4MS3WBEpbS37s+ixWHgQ== 2024-09-13T06:38:49.752 INFO:teuthology.orchestra.run.smithi139.stdout:[client.1] 2024-09-13T06:38:49.752 INFO:teuthology.orchestra.run.smithi139.stdout: key = AQDa3eNmuOVpKBAABn6HmxiGx0U2ExGIQtMaFw== 2024-09-13T06:38:49.753 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-13T06:38:49.789 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-13T06:38:49.840 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T06:38:49.877 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T06:38:49.918 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T06:38:49.961 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T06:38:50.001 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T06:38:50.041 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T06:38:50.088 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T06:38:50.121 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T06:38:50.170 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-13T06:38:50.201 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-13T06:38:50.255 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T06:38:50.285 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T06:38:50.344 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T06:38:50.365 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T06:38:50.429 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T06:38:50.449 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T06:38:50.510 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T06:38:50.529 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T06:38:50.590 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-13T06:38:50.613 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-13T06:38:50.678 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-13T06:38:50.701 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-13T06:38:50.748 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-09-13T06:38:50.748 DEBUG:teuthology.orchestra.run.smithi081:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-09-13T06:38:50.792 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-13T06:38:50.877 DEBUG:teuthology.orchestra.run.smithi081:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-09-13T06:38:50.929 DEBUG:teuthology.orchestra.run.smithi081:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-09-13T06:38:50.982 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-13T06:38:51.069 DEBUG:teuthology.orchestra.run.smithi081:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-09-13T06:38:51.079 DEBUG:teuthology.orchestra.run.smithi139:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-09-13T06:38:51.094 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-13T06:38:51.187 DEBUG:teuthology.orchestra.run.smithi139:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-09-13T06:38:51.197 DEBUG:teuthology.orchestra.run.smithi081:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-13T06:38:51.200 DEBUG:teuthology.orchestra.run.smithi139:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-13T06:38:51.244 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-09-13T06:38:51.245 INFO:tasks.ceph.mon.a:Restarting daemon 2024-09-13T06:38:51.245 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-09-13T06:38:51.249 INFO:tasks.ceph.mon.a:Started 2024-09-13T06:38:51.249 INFO:tasks.ceph.mon.c:Restarting daemon 2024-09-13T06:38:51.249 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-09-13T06:38:51.251 INFO:tasks.ceph.mon.c:Started 2024-09-13T06:38:51.251 INFO:tasks.ceph.mon.b:Restarting daemon 2024-09-13T06:38:51.251 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-09-13T06:38:51.289 INFO:tasks.ceph.mon.b:Started 2024-09-13T06:38:51.289 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-09-13T06:38:51.290 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-09-13T06:38:51.290 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-09-13T06:38:51.292 INFO:tasks.ceph.mgr.y:Started 2024-09-13T06:38:51.292 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-09-13T06:38:51.292 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-09-13T06:38:51.294 INFO:tasks.ceph.mgr.x:Started 2024-09-13T06:38:51.294 INFO:tasks.ceph:Setting crush tunables to default 2024-09-13T06:38:51.294 DEBUG:teuthology.orchestra.run.smithi081:> sudo ceph --cluster ceph osd crush tunables default 2024-09-13T06:38:56.967 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-09-13T06:38:56.971+0000 7f7fc27bf180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-13T06:38:57.511 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-09-13T06:38:57.511+0000 7f7fc27bf180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-13T06:38:57.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T06:38:57.623+0000 7f532695c640 0 --2- 172.21.15.81:0/1737742161 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f53201c9ac0 0x7f532013f130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2024-09-13T06:38:57.713 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-09-13T06:38:57.715+0000 7f7fc27bf180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-13T06:38:57.716 INFO:teuthology.orchestra.run.smithi081.stderr:adjusted tunables profile to default 2024-09-13T06:38:57.734 INFO:tasks.ceph:check_enable_crimson: False 2024-09-13T06:38:57.734 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-09-13T06:38:57.734 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-13T06:38:57.734 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-09-13T06:38:57.745 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-13T06:38:57.745 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-09-13T06:38:57.799 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-13T06:38:57.799 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-09-13T06:38:57.855 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-13T06:38:57.855 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-09-13T06:38:57.878 INFO:tasks.ceph.mgr.x.smithi139.stderr:2024-09-13T06:38:57.878+0000 7f93dee55180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-13T06:38:57.910 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2024-09-13T06:38:57.910 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-09-13T06:38:57.924 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2024-09-13T06:38:57.924 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-09-13T06:38:57.980 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2024-09-13T06:38:57.980 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-09-13T06:38:58.035 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2024-09-13T06:38:58.035 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-09-13T06:38:58.087 DEBUG:teuthology.orchestra.run.smithi139:> sudo ceph --cluster ceph osd new 54b0a3e4-58ad-4f95-86dc-29a11c9a1964 0 2024-09-13T06:38:58.247 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-09-13T06:38:58.251+0000 7f7fc27bf180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-13T06:38:58.301 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-09-13T06:38:58.303+0000 7f7fc27bf180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-13T06:38:58.339 INFO:teuthology.orchestra.run.smithi139.stdout:0 2024-09-13T06:38:58.354 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-09-13T06:38:58.355+0000 7f7fc27bf180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-13T06:38:58.357 DEBUG:teuthology.orchestra.run.smithi139:> sudo ceph --cluster ceph osd new a6dba5b9-c833-465e-a8a5-1741528b24c0 1 2024-09-13T06:38:58.431 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-09-13T06:38:58.431+0000 7f7fc27bf180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-13T06:38:58.442 INFO:tasks.ceph.mgr.x.smithi139.stderr:2024-09-13T06:38:58.442+0000 7f93dee55180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-13T06:38:58.481 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-09-13T06:38:58.483+0000 7f7fc27bf180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-13T06:38:58.558 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-09-13T06:38:58.559+0000 7f7fc27bf180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-13T06:38:58.570 INFO:teuthology.orchestra.run.smithi139.stdout:1 2024-09-13T06:38:58.588 DEBUG:teuthology.orchestra.run.smithi139:> sudo ceph --cluster ceph osd new 6c45097e-44a2-454f-80a4-0fe879ccd52f 2 2024-09-13T06:38:58.611 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-09-13T06:38:58.611+0000 7f7fc27bf180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-13T06:38:58.655 INFO:tasks.ceph.mgr.x.smithi139.stderr:2024-09-13T06:38:58.654+0000 7f93dee55180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-13T06:38:58.762 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-09-13T06:38:58.763+0000 7f7fc27bf180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-13T06:38:58.789 INFO:teuthology.orchestra.run.smithi139.stdout:2 2024-09-13T06:38:58.805 DEBUG:teuthology.orchestra.run.smithi139:> sudo ceph --cluster ceph osd new 31952760-06f3-4618-a5c4-f5c4fed3aadb 3 2024-09-13T06:38:58.823 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-09-13T06:38:58.823+0000 7f7fc27bf180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-13T06:38:59.004 INFO:teuthology.orchestra.run.smithi139.stdout:3 2024-09-13T06:38:59.020 DEBUG:teuthology.orchestra.run.smithi139:> sudo ceph --cluster ceph osd new c9bd2751-c836-43dc-b844-e13678cb2fd9 4 2024-09-13T06:38:59.215 INFO:tasks.ceph.mgr.x.smithi139.stderr:2024-09-13T06:38:59.214+0000 7f93dee55180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-13T06:38:59.225 INFO:teuthology.orchestra.run.smithi139.stdout:4 2024-09-13T06:38:59.241 DEBUG:teuthology.orchestra.run.smithi139:> sudo ceph --cluster ceph osd new 2971b93a-6c9f-4b77-b526-4eac788fabf9 5 2024-09-13T06:38:59.272 INFO:tasks.ceph.mgr.x.smithi139.stderr:2024-09-13T06:38:59.270+0000 7f93dee55180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-13T06:38:59.325 INFO:tasks.ceph.mgr.x.smithi139.stderr:2024-09-13T06:38:59.326+0000 7f93dee55180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-13T06:38:59.404 INFO:tasks.ceph.mgr.x.smithi139.stderr:2024-09-13T06:38:59.406+0000 7f93dee55180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-13T06:38:59.439 INFO:teuthology.orchestra.run.smithi139.stdout:5 2024-09-13T06:38:59.455 DEBUG:teuthology.orchestra.run.smithi139:> sudo ceph --cluster ceph osd new e1f786ce-579e-48cc-b212-83f881b94184 6 2024-09-13T06:38:59.458 INFO:tasks.ceph.mgr.x.smithi139.stderr:2024-09-13T06:38:59.458+0000 7f93dee55180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-13T06:38:59.463 INFO:tasks.ceph.mgr.y.smithi081.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-09-13T06:38:59.463 INFO:tasks.ceph.mgr.y.smithi081.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-09-13T06:38:59.463 INFO:tasks.ceph.mgr.y.smithi081.stderr: from numpy import show_config as show_numpy_config 2024-09-13T06:38:59.538 INFO:tasks.ceph.mgr.x.smithi139.stderr:2024-09-13T06:38:59.538+0000 7f93dee55180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-13T06:38:59.539 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-09-13T06:38:59.539+0000 7f7fc27bf180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-13T06:38:59.591 INFO:tasks.ceph.mgr.x.smithi139.stderr:2024-09-13T06:38:59.590+0000 7f93dee55180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-13T06:38:59.656 INFO:teuthology.orchestra.run.smithi139.stdout:6 2024-09-13T06:38:59.673 DEBUG:teuthology.orchestra.run.smithi139:> sudo ceph --cluster ceph osd new a287ddf6-84eb-4225-b267-25eee1657625 7 2024-09-13T06:38:59.725 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-09-13T06:38:59.727+0000 7f7fc27bf180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-13T06:38:59.746 INFO:tasks.ceph.mgr.x.smithi139.stderr:2024-09-13T06:38:59.746+0000 7f93dee55180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-13T06:38:59.808 INFO:tasks.ceph.mgr.x.smithi139.stderr:2024-09-13T06:38:59.806+0000 7f93dee55180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-13T06:38:59.873 INFO:teuthology.orchestra.run.smithi139.stdout:7 2024-09-13T06:38:59.890 INFO:tasks.ceph.osd.0:Restarting daemon 2024-09-13T06:38:59.890 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-09-13T06:38:59.892 INFO:tasks.ceph.osd.0:Started 2024-09-13T06:38:59.892 INFO:tasks.ceph.osd.1:Restarting daemon 2024-09-13T06:38:59.892 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-09-13T06:38:59.895 INFO:tasks.ceph.osd.1:Started 2024-09-13T06:38:59.895 INFO:tasks.ceph.osd.2:Restarting daemon 2024-09-13T06:38:59.895 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-09-13T06:38:59.896 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-09-13T06:38:59.895+0000 7f7fc27bf180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-13T06:38:59.898 INFO:tasks.ceph.osd.2:Started 2024-09-13T06:38:59.898 INFO:tasks.ceph.osd.3:Restarting daemon 2024-09-13T06:38:59.898 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-09-13T06:38:59.900 INFO:tasks.ceph.osd.3:Started 2024-09-13T06:38:59.900 INFO:tasks.ceph.osd.4:Restarting daemon 2024-09-13T06:38:59.900 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-09-13T06:38:59.902 INFO:tasks.ceph.osd.4:Started 2024-09-13T06:38:59.903 INFO:tasks.ceph.osd.5:Restarting daemon 2024-09-13T06:38:59.903 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-09-13T06:38:59.905 INFO:tasks.ceph.osd.5:Started 2024-09-13T06:38:59.905 INFO:tasks.ceph.osd.6:Restarting daemon 2024-09-13T06:38:59.905 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-09-13T06:38:59.909 INFO:tasks.ceph.osd.6:Started 2024-09-13T06:38:59.909 INFO:tasks.ceph.osd.7:Restarting daemon 2024-09-13T06:38:59.909 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-09-13T06:38:59.911 INFO:tasks.ceph.osd.7:Started 2024-09-13T06:38:59.911 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T06:38:59.990 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-09-13T06:38:59.991+0000 7f7fc27bf180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-13T06:39:00.142 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-09-13T06:39:00.143+0000 7f7fc27bf180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-13T06:39:00.149 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T06:39:00.149 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":10,"fsid":"e5612297-d004-4957-927e-afa37f30d6cf","created":"2024-09-13T06:38:56.670231+0000","modified":"2024-09-13T06:38:59.874387+0000","last_up_change":"0.000000","last_in_change":"2024-09-13T06:38:59.874387+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"54b0a3e4-58ad-4f95-86dc-29a11c9a1964","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"a6dba5b9-c833-465e-a8a5-1741528b24c0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"6c45097e-44a2-454f-80a4-0fe879ccd52f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"31952760-06f3-4618-a5c4-f5c4fed3aadb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"c9bd2751-c836-43dc-b844-e13678cb2fd9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"2971b93a-6c9f-4b77-b526-4eac788fabf9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"e1f786ce-579e-48cc-b212-83f881b94184","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"a287ddf6-84eb-4225-b267-25eee1657625","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T06:39:00.166 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-09-13T06:39:00.167 INFO:tasks.ceph:Waiting for OSDs to come up 2024-09-13T06:39:00.423 INFO:tasks.ceph.mgr.x.smithi139.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-09-13T06:39:00.423 INFO:tasks.ceph.mgr.x.smithi139.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-09-13T06:39:00.423 INFO:tasks.ceph.mgr.x.smithi139.stderr: from numpy import show_config as show_numpy_config 2024-09-13T06:39:00.485 INFO:tasks.ceph.mgr.x.smithi139.stderr:2024-09-13T06:39:00.486+0000 7f93dee55180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-13T06:39:00.522 INFO:tasks.ceph.osd.6.smithi139.stderr:2024-09-13T06:39:00.522+0000 7fcd064a07c0 -1 Falling back to public interface 2024-09-13T06:39:00.524 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:39:00.527+0000 7f12ae5e07c0 -1 Falling back to public interface 2024-09-13T06:39:00.532 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:39:00.535+0000 7f1ede0827c0 -1 Falling back to public interface 2024-09-13T06:39:00.536 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-13T06:39:00.538+0000 7f86a974a7c0 -1 Falling back to public interface 2024-09-13T06:39:00.540 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:39:00.543+0000 7f46128017c0 -1 Falling back to public interface 2024-09-13T06:39:00.540 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:39:00.543+0000 7f27c54327c0 -1 Falling back to public interface 2024-09-13T06:39:00.553 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:39:00.554+0000 7f218552e7c0 -1 Falling back to public interface 2024-09-13T06:39:00.553 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:39:00.554+0000 7f77e02167c0 -1 Falling back to public interface 2024-09-13T06:39:00.669 INFO:tasks.ceph.mgr.x.smithi139.stderr:2024-09-13T06:39:00.670+0000 7f93dee55180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-13T06:39:00.775 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-09-13T06:39:00.775+0000 7f7fc27bf180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-13T06:39:00.835 INFO:tasks.ceph.mgr.x.smithi139.stderr:2024-09-13T06:39:00.834+0000 7f93dee55180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-13T06:39:00.850 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-09-13T06:39:00.851+0000 7f7fc27bf180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-13T06:39:00.904 INFO:tasks.ceph.mgr.x.smithi139.stderr:2024-09-13T06:39:00.906+0000 7f93dee55180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-13T06:39:00.973 DEBUG:teuthology.orchestra.run.smithi081:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-13T06:39:01.032 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-09-13T06:39:01.031+0000 7f7fc27bf180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-13T06:39:01.050 INFO:tasks.ceph.mgr.x.smithi139.stderr:2024-09-13T06:39:01.050+0000 7f93dee55180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-13T06:39:01.115 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-09-13T06:39:01.115+0000 7f7fc27bf180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-13T06:39:01.179 INFO:teuthology.misc.health.smithi081.stdout: 2024-09-13T06:39:01.179 INFO:teuthology.misc.health.smithi081.stdout:{"epoch":10,"fsid":"e5612297-d004-4957-927e-afa37f30d6cf","created":"2024-09-13T06:38:56.670231+0000","modified":"2024-09-13T06:38:59.874387+0000","last_up_change":"0.000000","last_in_change":"2024-09-13T06:38:59.874387+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"54b0a3e4-58ad-4f95-86dc-29a11c9a1964","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"a6dba5b9-c833-465e-a8a5-1741528b24c0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"6c45097e-44a2-454f-80a4-0fe879ccd52f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"31952760-06f3-4618-a5c4-f5c4fed3aadb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"c9bd2751-c836-43dc-b844-e13678cb2fd9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"2971b93a-6c9f-4b77-b526-4eac788fabf9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"e1f786ce-579e-48cc-b212-83f881b94184","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"a287ddf6-84eb-4225-b267-25eee1657625","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T06:39:01.194 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-09-13T06:39:01.429 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-09-13T06:39:01.431+0000 7f7fc27bf180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-13T06:39:01.491 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-09-13T06:39:01.495+0000 7f7fc27bf180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-13T06:39:01.677 INFO:tasks.ceph.mgr.x.smithi139.stderr:2024-09-13T06:39:01.678+0000 7f93dee55180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-13T06:39:01.753 INFO:tasks.ceph.mgr.x.smithi139.stderr:2024-09-13T06:39:01.754+0000 7f93dee55180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-13T06:39:01.933 INFO:tasks.ceph.mgr.x.smithi139.stderr:2024-09-13T06:39:01.934+0000 7f93dee55180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-13T06:39:02.005 INFO:tasks.ceph.mgr.x.smithi139.stderr:2024-09-13T06:39:02.006+0000 7f93dee55180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-13T06:39:02.292 INFO:tasks.ceph.mgr.x.smithi139.stderr:2024-09-13T06:39:02.294+0000 7f93dee55180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-13T06:39:02.352 INFO:tasks.ceph.mgr.x.smithi139.stderr:2024-09-13T06:39:02.354+0000 7f93dee55180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-13T06:39:02.538 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-09-13T06:39:02.539+0000 7f7f69d72640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-09-13T06:39:02.538 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-09-13T06:39:02.539+0000 7f7f69d72640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-09-13T06:39:04.295 INFO:tasks.ceph.osd.6.smithi139.stderr:2024-09-13T06:39:04.294+0000 7fcd064a07c0 -1 osd.6 0 log_to_monitors true 2024-09-13T06:39:04.371 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:39:04.375+0000 7f12ae5e07c0 -1 osd.3 0 log_to_monitors true 2024-09-13T06:39:04.388 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:39:04.390+0000 7f77e02167c0 -1 osd.4 0 log_to_monitors true 2024-09-13T06:39:04.467 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:39:04.466+0000 7f218552e7c0 -1 osd.5 0 log_to_monitors true 2024-09-13T06:39:04.482 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-13T06:39:04.482+0000 7f86a974a7c0 -1 osd.7 0 log_to_monitors true 2024-09-13T06:39:04.491 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:39:04.495+0000 7f46128017c0 -1 osd.1 0 log_to_monitors true 2024-09-13T06:39:04.505 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:39:04.507+0000 7f27c54327c0 -1 osd.2 0 log_to_monitors true 2024-09-13T06:39:04.507 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:39:04.507+0000 7f1ede0827c0 -1 osd.0 0 log_to_monitors true 2024-09-13T06:39:08.001 DEBUG:teuthology.orchestra.run.smithi081:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-13T06:39:08.039 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:39:08.031+0000 7f12a9d62640 -1 osd.3 0 waiting for initial osdmap 2024-09-13T06:39:08.080 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:39:08.083+0000 7f12a23a7640 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T06:39:08.100 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:39:08.103+0000 7f1ed9804640 -1 osd.0 0 waiting for initial osdmap 2024-09-13T06:39:08.124 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:39:08.127+0000 7f460df83640 -1 osd.1 0 waiting for initial osdmap 2024-09-13T06:39:08.132 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:39:08.135+0000 7f1ed1e49640 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T06:39:08.147 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:39:08.151+0000 7f27c0bb4640 -1 osd.2 0 waiting for initial osdmap 2024-09-13T06:39:08.149 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-13T06:39:08.150+0000 7f86a4ecc640 -1 osd.7 0 waiting for initial osdmap 2024-09-13T06:39:08.164 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:39:08.167+0000 7f46065c8640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T06:39:08.164 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:39:08.166+0000 7f2180cb0640 -1 osd.5 0 waiting for initial osdmap 2024-09-13T06:39:08.170 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:39:08.170+0000 7f77db998640 -1 osd.4 0 waiting for initial osdmap 2024-09-13T06:39:08.175 INFO:tasks.ceph.osd.6.smithi139.stderr:2024-09-13T06:39:08.174+0000 7fcd01c22640 -1 osd.6 0 waiting for initial osdmap 2024-09-13T06:39:08.176 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-13T06:39:08.178+0000 7f869d511640 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T06:39:08.188 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:39:08.191+0000 7f27b91f9640 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T06:39:08.200 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:39:08.202+0000 7f21792f5640 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T06:39:08.201 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:39:08.202+0000 7f77d3fdd640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T06:39:08.216 INFO:tasks.ceph.osd.6.smithi139.stderr:2024-09-13T06:39:08.218+0000 7fccfa267640 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T06:39:08.331 INFO:teuthology.misc.health.smithi081.stdout: 2024-09-13T06:39:08.331 INFO:teuthology.misc.health.smithi081.stdout:{"epoch":12,"fsid":"e5612297-d004-4957-927e-afa37f30d6cf","created":"2024-09-13T06:38:56.670231+0000","modified":"2024-09-13T06:39:05.708588+0000","last_up_change":"0.000000","last_in_change":"2024-09-13T06:38:59.874387+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"54b0a3e4-58ad-4f95-86dc-29a11c9a1964","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"a6dba5b9-c833-465e-a8a5-1741528b24c0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"6c45097e-44a2-454f-80a4-0fe879ccd52f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"31952760-06f3-4618-a5c4-f5c4fed3aadb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"c9bd2751-c836-43dc-b844-e13678cb2fd9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"2971b93a-6c9f-4b77-b526-4eac788fabf9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"e1f786ce-579e-48cc-b212-83f881b94184","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"a287ddf6-84eb-4225-b267-25eee1657625","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T06:39:08.347 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-09-13T06:39:15.154 DEBUG:teuthology.orchestra.run.smithi081:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-13T06:39:15.451 INFO:teuthology.misc.health.smithi081.stdout: 2024-09-13T06:39:15.451 INFO:teuthology.misc.health.smithi081.stdout:{"epoch":16,"fsid":"e5612297-d004-4957-927e-afa37f30d6cf","created":"2024-09-13T06:38:56.670231+0000","modified":"2024-09-13T06:39:12.135011+0000","last_up_change":"2024-09-13T06:39:09.107597+0000","last_in_change":"2024-09-13T06:38:59.874387+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T06:39:09.600726+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"54b0a3e4-58ad-4f95-86dc-29a11c9a1964","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":1904727940},{"type":"v1","addr":"172.21.15.81:6809","nonce":1904727940}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":1904727940},{"type":"v1","addr":"172.21.15.81:6811","nonce":1904727940}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":1904727940},{"type":"v1","addr":"172.21.15.81:6815","nonce":1904727940}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":1904727940},{"type":"v1","addr":"172.21.15.81:6813","nonce":1904727940}]},"public_addr":"172.21.15.81:6809/1904727940","cluster_addr":"172.21.15.81:6811/1904727940","heartbeat_back_addr":"172.21.15.81:6815/1904727940","heartbeat_front_addr":"172.21.15.81:6813/1904727940","state":["exists","up"]},{"osd":1,"uuid":"a6dba5b9-c833-465e-a8a5-1741528b24c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":738205570},{"type":"v1","addr":"172.21.15.81:6819","nonce":738205570}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":738205570},{"type":"v1","addr":"172.21.15.81:6824","nonce":738205570}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":738205570},{"type":"v1","addr":"172.21.15.81:6831","nonce":738205570}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":738205570},{"type":"v1","addr":"172.21.15.81:6829","nonce":738205570}]},"public_addr":"172.21.15.81:6819/738205570","cluster_addr":"172.21.15.81:6824/738205570","heartbeat_back_addr":"172.21.15.81:6831/738205570","heartbeat_front_addr":"172.21.15.81:6829/738205570","state":["exists","up"]},{"osd":2,"uuid":"6c45097e-44a2-454f-80a4-0fe879ccd52f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":3558674335},{"type":"v1","addr":"172.21.15.81:6818","nonce":3558674335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":3558674335},{"type":"v1","addr":"172.21.15.81:6821","nonce":3558674335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6827","nonce":3558674335},{"type":"v1","addr":"172.21.15.81:6828","nonce":3558674335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6823","nonce":3558674335},{"type":"v1","addr":"172.21.15.81:6825","nonce":3558674335}]},"public_addr":"172.21.15.81:6818/3558674335","cluster_addr":"172.21.15.81:6821/3558674335","heartbeat_back_addr":"172.21.15.81:6828/3558674335","heartbeat_front_addr":"172.21.15.81:6825/3558674335","state":["exists","up"]},{"osd":3,"uuid":"31952760-06f3-4618-a5c4-f5c4fed3aadb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":1886327229},{"type":"v1","addr":"172.21.15.81:6801","nonce":1886327229}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":1886327229},{"type":"v1","addr":"172.21.15.81:6803","nonce":1886327229}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":1886327229},{"type":"v1","addr":"172.21.15.81:6807","nonce":1886327229}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":1886327229},{"type":"v1","addr":"172.21.15.81:6805","nonce":1886327229}]},"public_addr":"172.21.15.81:6801/1886327229","cluster_addr":"172.21.15.81:6803/1886327229","heartbeat_back_addr":"172.21.15.81:6807/1886327229","heartbeat_front_addr":"172.21.15.81:6805/1886327229","state":["exists","up"]},{"osd":4,"uuid":"c9bd2751-c836-43dc-b844-e13678cb2fd9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6817","nonce":2184515621},{"type":"v1","addr":"172.21.15.139:6819","nonce":2184515621}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6820","nonce":2184515621},{"type":"v1","addr":"172.21.15.139:6822","nonce":2184515621}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6827","nonce":2184515621},{"type":"v1","addr":"172.21.15.139:6829","nonce":2184515621}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6824","nonce":2184515621},{"type":"v1","addr":"172.21.15.139:6826","nonce":2184515621}]},"public_addr":"172.21.15.139:6819/2184515621","cluster_addr":"172.21.15.139:6822/2184515621","heartbeat_back_addr":"172.21.15.139:6829/2184515621","heartbeat_front_addr":"172.21.15.139:6826/2184515621","state":["exists","up"]},{"osd":5,"uuid":"2971b93a-6c9f-4b77-b526-4eac788fabf9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6816","nonce":3982901834},{"type":"v1","addr":"172.21.15.139:6818","nonce":3982901834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6821","nonce":3982901834},{"type":"v1","addr":"172.21.15.139:6823","nonce":3982901834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6830","nonce":3982901834},{"type":"v1","addr":"172.21.15.139:6831","nonce":3982901834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6825","nonce":3982901834},{"type":"v1","addr":"172.21.15.139:6828","nonce":3982901834}]},"public_addr":"172.21.15.139:6818/3982901834","cluster_addr":"172.21.15.139:6823/3982901834","heartbeat_back_addr":"172.21.15.139:6831/3982901834","heartbeat_front_addr":"172.21.15.139:6828/3982901834","state":["exists","up"]},{"osd":6,"uuid":"e1f786ce-579e-48cc-b212-83f881b94184","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6800","nonce":2283932666},{"type":"v1","addr":"172.21.15.139:6801","nonce":2283932666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6802","nonce":2283932666},{"type":"v1","addr":"172.21.15.139:6803","nonce":2283932666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6806","nonce":2283932666},{"type":"v1","addr":"172.21.15.139:6807","nonce":2283932666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6804","nonce":2283932666},{"type":"v1","addr":"172.21.15.139:6805","nonce":2283932666}]},"public_addr":"172.21.15.139:6801/2283932666","cluster_addr":"172.21.15.139:6803/2283932666","heartbeat_back_addr":"172.21.15.139:6807/2283932666","heartbeat_front_addr":"172.21.15.139:6805/2283932666","state":["exists","up"]},{"osd":7,"uuid":"a287ddf6-84eb-4225-b267-25eee1657625","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6808","nonce":2348111157},{"type":"v1","addr":"172.21.15.139:6809","nonce":2348111157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6810","nonce":2348111157},{"type":"v1","addr":"172.21.15.139:6811","nonce":2348111157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6814","nonce":2348111157},{"type":"v1","addr":"172.21.15.139:6815","nonce":2348111157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6812","nonce":2348111157},{"type":"v1","addr":"172.21.15.139:6813","nonce":2348111157}]},"public_addr":"172.21.15.139:6809/2348111157","cluster_addr":"172.21.15.139:6811/2348111157","heartbeat_back_addr":"172.21.15.139:6815/2348111157","heartbeat_front_addr":"172.21.15.139:6813/2348111157","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T06:39:05.476871+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T06:39:05.455183+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T06:39:05.504853+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T06:39:05.372429+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T06:39:05.421023+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T06:39:05.477489+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T06:39:05.314700+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T06:39:05.462229+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T06:39:15.468 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-09-13T06:39:15.468 INFO:tasks.ceph:Creating RBD pool 2024-09-13T06:39:15.469 DEBUG:teuthology.orchestra.run.smithi081:> sudo ceph --cluster ceph osd pool create rbd 8 2024-09-13T06:39:16.518 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'rbd' created 2024-09-13T06:39:16.541 DEBUG:teuthology.orchestra.run.smithi081:> rbd --cluster ceph pool init rbd 2024-09-13T06:39:19.584 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-09-13T06:39:19.585 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-13T06:39:19.585 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-09-13T06:39:19.585 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-09-13T06:39:19.585 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-09-13T06:39:19.934 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T06:39:19.952 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":5,"flags":0,"active_gid":4100,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":1379795744},{"type":"v1","addr":"172.21.15.81:6833","nonce":1379795744}]},"active_addr":"172.21.15.81:6833/1379795744","active_change":"2024-09-13T06:39:01.518446+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":4105,"name":"x","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.0.0","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.0.0","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.81:0","nonce":3624020394}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.81:0","nonce":2406930292}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.81:0","nonce":3037253937}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.81:0","nonce":2810536279}]}]} 2024-09-13T06:39:19.956 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-09-13T06:39:19.956 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-13T06:39:19.956 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T06:39:20.247 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T06:39:20.247 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":20,"fsid":"e5612297-d004-4957-927e-afa37f30d6cf","created":"2024-09-13T06:38:56.670231+0000","modified":"2024-09-13T06:39:19.540191+0000","last_up_change":"2024-09-13T06:39:09.107597+0000","last_in_change":"2024-09-13T06:38:59.874387+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T06:39:09.600726+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-13T06:39:15.802118+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":20,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"54b0a3e4-58ad-4f95-86dc-29a11c9a1964","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":1904727940},{"type":"v1","addr":"172.21.15.81:6809","nonce":1904727940}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":1904727940},{"type":"v1","addr":"172.21.15.81:6811","nonce":1904727940}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":1904727940},{"type":"v1","addr":"172.21.15.81:6815","nonce":1904727940}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":1904727940},{"type":"v1","addr":"172.21.15.81:6813","nonce":1904727940}]},"public_addr":"172.21.15.81:6809/1904727940","cluster_addr":"172.21.15.81:6811/1904727940","heartbeat_back_addr":"172.21.15.81:6815/1904727940","heartbeat_front_addr":"172.21.15.81:6813/1904727940","state":["exists","up"]},{"osd":1,"uuid":"a6dba5b9-c833-465e-a8a5-1741528b24c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":738205570},{"type":"v1","addr":"172.21.15.81:6819","nonce":738205570}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":738205570},{"type":"v1","addr":"172.21.15.81:6824","nonce":738205570}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":738205570},{"type":"v1","addr":"172.21.15.81:6831","nonce":738205570}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":738205570},{"type":"v1","addr":"172.21.15.81:6829","nonce":738205570}]},"public_addr":"172.21.15.81:6819/738205570","cluster_addr":"172.21.15.81:6824/738205570","heartbeat_back_addr":"172.21.15.81:6831/738205570","heartbeat_front_addr":"172.21.15.81:6829/738205570","state":["exists","up"]},{"osd":2,"uuid":"6c45097e-44a2-454f-80a4-0fe879ccd52f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":3558674335},{"type":"v1","addr":"172.21.15.81:6818","nonce":3558674335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":3558674335},{"type":"v1","addr":"172.21.15.81:6821","nonce":3558674335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6827","nonce":3558674335},{"type":"v1","addr":"172.21.15.81:6828","nonce":3558674335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6823","nonce":3558674335},{"type":"v1","addr":"172.21.15.81:6825","nonce":3558674335}]},"public_addr":"172.21.15.81:6818/3558674335","cluster_addr":"172.21.15.81:6821/3558674335","heartbeat_back_addr":"172.21.15.81:6828/3558674335","heartbeat_front_addr":"172.21.15.81:6825/3558674335","state":["exists","up"]},{"osd":3,"uuid":"31952760-06f3-4618-a5c4-f5c4fed3aadb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":1886327229},{"type":"v1","addr":"172.21.15.81:6801","nonce":1886327229}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":1886327229},{"type":"v1","addr":"172.21.15.81:6803","nonce":1886327229}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":1886327229},{"type":"v1","addr":"172.21.15.81:6807","nonce":1886327229}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":1886327229},{"type":"v1","addr":"172.21.15.81:6805","nonce":1886327229}]},"public_addr":"172.21.15.81:6801/1886327229","cluster_addr":"172.21.15.81:6803/1886327229","heartbeat_back_addr":"172.21.15.81:6807/1886327229","heartbeat_front_addr":"172.21.15.81:6805/1886327229","state":["exists","up"]},{"osd":4,"uuid":"c9bd2751-c836-43dc-b844-e13678cb2fd9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6817","nonce":2184515621},{"type":"v1","addr":"172.21.15.139:6819","nonce":2184515621}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6820","nonce":2184515621},{"type":"v1","addr":"172.21.15.139:6822","nonce":2184515621}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6827","nonce":2184515621},{"type":"v1","addr":"172.21.15.139:6829","nonce":2184515621}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6824","nonce":2184515621},{"type":"v1","addr":"172.21.15.139:6826","nonce":2184515621}]},"public_addr":"172.21.15.139:6819/2184515621","cluster_addr":"172.21.15.139:6822/2184515621","heartbeat_back_addr":"172.21.15.139:6829/2184515621","heartbeat_front_addr":"172.21.15.139:6826/2184515621","state":["exists","up"]},{"osd":5,"uuid":"2971b93a-6c9f-4b77-b526-4eac788fabf9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6816","nonce":3982901834},{"type":"v1","addr":"172.21.15.139:6818","nonce":3982901834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6821","nonce":3982901834},{"type":"v1","addr":"172.21.15.139:6823","nonce":3982901834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6830","nonce":3982901834},{"type":"v1","addr":"172.21.15.139:6831","nonce":3982901834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6825","nonce":3982901834},{"type":"v1","addr":"172.21.15.139:6828","nonce":3982901834}]},"public_addr":"172.21.15.139:6818/3982901834","cluster_addr":"172.21.15.139:6823/3982901834","heartbeat_back_addr":"172.21.15.139:6831/3982901834","heartbeat_front_addr":"172.21.15.139:6828/3982901834","state":["exists","up"]},{"osd":6,"uuid":"e1f786ce-579e-48cc-b212-83f881b94184","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6800","nonce":2283932666},{"type":"v1","addr":"172.21.15.139:6801","nonce":2283932666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6802","nonce":2283932666},{"type":"v1","addr":"172.21.15.139:6803","nonce":2283932666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6806","nonce":2283932666},{"type":"v1","addr":"172.21.15.139:6807","nonce":2283932666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6804","nonce":2283932666},{"type":"v1","addr":"172.21.15.139:6805","nonce":2283932666}]},"public_addr":"172.21.15.139:6801/2283932666","cluster_addr":"172.21.15.139:6803/2283932666","heartbeat_back_addr":"172.21.15.139:6807/2283932666","heartbeat_front_addr":"172.21.15.139:6805/2283932666","state":["exists","up"]},{"osd":7,"uuid":"a287ddf6-84eb-4225-b267-25eee1657625","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6808","nonce":2348111157},{"type":"v1","addr":"172.21.15.139:6809","nonce":2348111157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6810","nonce":2348111157},{"type":"v1","addr":"172.21.15.139:6811","nonce":2348111157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6814","nonce":2348111157},{"type":"v1","addr":"172.21.15.139:6815","nonce":2348111157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6812","nonce":2348111157},{"type":"v1","addr":"172.21.15.139:6813","nonce":2348111157}]},"public_addr":"172.21.15.139:6809/2348111157","cluster_addr":"172.21.15.139:6811/2348111157","heartbeat_back_addr":"172.21.15.139:6815/2348111157","heartbeat_front_addr":"172.21.15.139:6813/2348111157","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T06:39:05.476871+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T06:39:05.455183+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T06:39:05.504853+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T06:39:05.372429+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T06:39:05.421023+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T06:39:05.477489+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T06:39:05.314700+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T06:39:05.462229+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T06:39:20.265 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-13T06:39:20.265 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T06:39:20.544 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T06:39:20.545 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":20,"fsid":"e5612297-d004-4957-927e-afa37f30d6cf","created":"2024-09-13T06:38:56.670231+0000","modified":"2024-09-13T06:39:19.540191+0000","last_up_change":"2024-09-13T06:39:09.107597+0000","last_in_change":"2024-09-13T06:38:59.874387+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T06:39:09.600726+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-13T06:39:15.802118+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":20,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"54b0a3e4-58ad-4f95-86dc-29a11c9a1964","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":1904727940},{"type":"v1","addr":"172.21.15.81:6809","nonce":1904727940}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":1904727940},{"type":"v1","addr":"172.21.15.81:6811","nonce":1904727940}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":1904727940},{"type":"v1","addr":"172.21.15.81:6815","nonce":1904727940}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":1904727940},{"type":"v1","addr":"172.21.15.81:6813","nonce":1904727940}]},"public_addr":"172.21.15.81:6809/1904727940","cluster_addr":"172.21.15.81:6811/1904727940","heartbeat_back_addr":"172.21.15.81:6815/1904727940","heartbeat_front_addr":"172.21.15.81:6813/1904727940","state":["exists","up"]},{"osd":1,"uuid":"a6dba5b9-c833-465e-a8a5-1741528b24c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":738205570},{"type":"v1","addr":"172.21.15.81:6819","nonce":738205570}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":738205570},{"type":"v1","addr":"172.21.15.81:6824","nonce":738205570}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":738205570},{"type":"v1","addr":"172.21.15.81:6831","nonce":738205570}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":738205570},{"type":"v1","addr":"172.21.15.81:6829","nonce":738205570}]},"public_addr":"172.21.15.81:6819/738205570","cluster_addr":"172.21.15.81:6824/738205570","heartbeat_back_addr":"172.21.15.81:6831/738205570","heartbeat_front_addr":"172.21.15.81:6829/738205570","state":["exists","up"]},{"osd":2,"uuid":"6c45097e-44a2-454f-80a4-0fe879ccd52f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":3558674335},{"type":"v1","addr":"172.21.15.81:6818","nonce":3558674335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":3558674335},{"type":"v1","addr":"172.21.15.81:6821","nonce":3558674335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6827","nonce":3558674335},{"type":"v1","addr":"172.21.15.81:6828","nonce":3558674335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6823","nonce":3558674335},{"type":"v1","addr":"172.21.15.81:6825","nonce":3558674335}]},"public_addr":"172.21.15.81:6818/3558674335","cluster_addr":"172.21.15.81:6821/3558674335","heartbeat_back_addr":"172.21.15.81:6828/3558674335","heartbeat_front_addr":"172.21.15.81:6825/3558674335","state":["exists","up"]},{"osd":3,"uuid":"31952760-06f3-4618-a5c4-f5c4fed3aadb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":1886327229},{"type":"v1","addr":"172.21.15.81:6801","nonce":1886327229}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":1886327229},{"type":"v1","addr":"172.21.15.81:6803","nonce":1886327229}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":1886327229},{"type":"v1","addr":"172.21.15.81:6807","nonce":1886327229}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":1886327229},{"type":"v1","addr":"172.21.15.81:6805","nonce":1886327229}]},"public_addr":"172.21.15.81:6801/1886327229","cluster_addr":"172.21.15.81:6803/1886327229","heartbeat_back_addr":"172.21.15.81:6807/1886327229","heartbeat_front_addr":"172.21.15.81:6805/1886327229","state":["exists","up"]},{"osd":4,"uuid":"c9bd2751-c836-43dc-b844-e13678cb2fd9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6817","nonce":2184515621},{"type":"v1","addr":"172.21.15.139:6819","nonce":2184515621}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6820","nonce":2184515621},{"type":"v1","addr":"172.21.15.139:6822","nonce":2184515621}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6827","nonce":2184515621},{"type":"v1","addr":"172.21.15.139:6829","nonce":2184515621}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6824","nonce":2184515621},{"type":"v1","addr":"172.21.15.139:6826","nonce":2184515621}]},"public_addr":"172.21.15.139:6819/2184515621","cluster_addr":"172.21.15.139:6822/2184515621","heartbeat_back_addr":"172.21.15.139:6829/2184515621","heartbeat_front_addr":"172.21.15.139:6826/2184515621","state":["exists","up"]},{"osd":5,"uuid":"2971b93a-6c9f-4b77-b526-4eac788fabf9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6816","nonce":3982901834},{"type":"v1","addr":"172.21.15.139:6818","nonce":3982901834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6821","nonce":3982901834},{"type":"v1","addr":"172.21.15.139:6823","nonce":3982901834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6830","nonce":3982901834},{"type":"v1","addr":"172.21.15.139:6831","nonce":3982901834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6825","nonce":3982901834},{"type":"v1","addr":"172.21.15.139:6828","nonce":3982901834}]},"public_addr":"172.21.15.139:6818/3982901834","cluster_addr":"172.21.15.139:6823/3982901834","heartbeat_back_addr":"172.21.15.139:6831/3982901834","heartbeat_front_addr":"172.21.15.139:6828/3982901834","state":["exists","up"]},{"osd":6,"uuid":"e1f786ce-579e-48cc-b212-83f881b94184","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6800","nonce":2283932666},{"type":"v1","addr":"172.21.15.139:6801","nonce":2283932666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6802","nonce":2283932666},{"type":"v1","addr":"172.21.15.139:6803","nonce":2283932666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6806","nonce":2283932666},{"type":"v1","addr":"172.21.15.139:6807","nonce":2283932666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6804","nonce":2283932666},{"type":"v1","addr":"172.21.15.139:6805","nonce":2283932666}]},"public_addr":"172.21.15.139:6801/2283932666","cluster_addr":"172.21.15.139:6803/2283932666","heartbeat_back_addr":"172.21.15.139:6807/2283932666","heartbeat_front_addr":"172.21.15.139:6805/2283932666","state":["exists","up"]},{"osd":7,"uuid":"a287ddf6-84eb-4225-b267-25eee1657625","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6808","nonce":2348111157},{"type":"v1","addr":"172.21.15.139:6809","nonce":2348111157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6810","nonce":2348111157},{"type":"v1","addr":"172.21.15.139:6811","nonce":2348111157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6814","nonce":2348111157},{"type":"v1","addr":"172.21.15.139:6815","nonce":2348111157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6812","nonce":2348111157},{"type":"v1","addr":"172.21.15.139:6813","nonce":2348111157}]},"public_addr":"172.21.15.139:6809/2348111157","cluster_addr":"172.21.15.139:6811/2348111157","heartbeat_back_addr":"172.21.15.139:6815/2348111157","heartbeat_front_addr":"172.21.15.139:6813/2348111157","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T06:39:05.476871+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T06:39:05.455183+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T06:39:05.504853+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T06:39:05.372429+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T06:39:05.421023+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T06:39:05.477489+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T06:39:05.314700+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T06:39:05.462229+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T06:39:20.562 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-13T06:39:20.563 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-13T06:39:20.563 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-13T06:39:20.564 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-09-13T06:39:20.564 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-09-13T06:39:20.565 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-09-13T06:39:20.565 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-09-13T06:39:20.566 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-09-13T06:39:20.805 INFO:teuthology.orchestra.run.smithi081.stdout:55834574853 2024-09-13T06:39:20.805 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-13T06:39:20.827 INFO:teuthology.orchestra.run.smithi081.stdout:55834574853 2024-09-13T06:39:20.828 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-13T06:39:20.828 INFO:teuthology.orchestra.run.smithi081.stdout:55834574853 2024-09-13T06:39:20.829 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-13T06:39:20.830 INFO:teuthology.orchestra.run.smithi081.stdout:55834574852 2024-09-13T06:39:20.830 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-13T06:39:20.836 INFO:teuthology.orchestra.run.smithi081.stdout:55834574853 2024-09-13T06:39:20.836 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-13T06:39:20.838 INFO:teuthology.orchestra.run.smithi081.stdout:55834574855 2024-09-13T06:39:20.838 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-13T06:39:20.843 INFO:teuthology.orchestra.run.smithi081.stdout:55834574852 2024-09-13T06:39:20.843 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-13T06:39:20.849 INFO:teuthology.orchestra.run.smithi081.stdout:55834574855 2024-09-13T06:39:20.849 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-13T06:39:21.303 INFO:teuthology.orchestra.run.smithi081.stdout:55834574851 2024-09-13T06:39:21.323 INFO:teuthology.orchestra.run.smithi081.stdout:55834574850 2024-09-13T06:39:21.327 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574851 for osd.1 2024-09-13T06:39:21.339 INFO:teuthology.orchestra.run.smithi081.stdout:55834574851 2024-09-13T06:39:21.349 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574850 for osd.0 2024-09-13T06:39:21.351 INFO:teuthology.orchestra.run.smithi081.stdout:55834574851 2024-09-13T06:39:21.356 INFO:teuthology.orchestra.run.smithi081.stdout:55834574853 2024-09-13T06:39:21.369 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574851 for osd.2 2024-09-13T06:39:21.370 INFO:teuthology.orchestra.run.smithi081.stdout:55834574851 2024-09-13T06:39:21.377 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574851 for osd.5 2024-09-13T06:39:21.383 INFO:teuthology.orchestra.run.smithi081.stdout:55834574853 2024-09-13T06:39:21.384 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574853 for osd.3 2024-09-13T06:39:21.391 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574851 for osd.4 2024-09-13T06:39:21.395 INFO:teuthology.orchestra.run.smithi081.stdout:55834574850 2024-09-13T06:39:21.402 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574853 for osd.7 2024-09-13T06:39:21.412 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574850 for osd.6 2024-09-13T06:39:22.328 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-13T06:39:22.351 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-13T06:39:22.370 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-13T06:39:22.378 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-13T06:39:22.385 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-13T06:39:22.392 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-13T06:39:22.403 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-13T06:39:22.413 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-13T06:39:22.845 INFO:teuthology.orchestra.run.smithi081.stdout:55834574853 2024-09-13T06:39:22.868 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.1 2024-09-13T06:39:22.868 DEBUG:teuthology.parallel:result is None 2024-09-13T06:39:22.887 INFO:teuthology.orchestra.run.smithi081.stdout:55834574852 2024-09-13T06:39:22.892 INFO:teuthology.orchestra.run.smithi081.stdout:55834574853 2024-09-13T06:39:22.908 INFO:teuthology.orchestra.run.smithi081.stdout:55834574853 2024-09-13T06:39:22.915 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574852 for osd.0 2024-09-13T06:39:22.916 DEBUG:teuthology.parallel:result is None 2024-09-13T06:39:22.917 INFO:teuthology.orchestra.run.smithi081.stdout:55834574852 2024-09-13T06:39:22.921 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.2 2024-09-13T06:39:22.921 DEBUG:teuthology.parallel:result is None 2024-09-13T06:39:22.929 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.5 2024-09-13T06:39:22.930 DEBUG:teuthology.parallel:result is None 2024-09-13T06:39:22.941 INFO:teuthology.orchestra.run.smithi081.stdout:55834574855 2024-09-13T06:39:22.942 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574852 for osd.6 2024-09-13T06:39:22.942 INFO:teuthology.orchestra.run.smithi081.stdout:55834574855 2024-09-13T06:39:22.943 DEBUG:teuthology.parallel:result is None 2024-09-13T06:39:22.957 INFO:teuthology.orchestra.run.smithi081.stdout:55834574853 2024-09-13T06:39:22.961 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.7 2024-09-13T06:39:22.961 DEBUG:teuthology.parallel:result is None 2024-09-13T06:39:22.967 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.3 2024-09-13T06:39:22.967 DEBUG:teuthology.parallel:result is None 2024-09-13T06:39:22.977 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.4 2024-09-13T06:39:22.977 DEBUG:teuthology.parallel:result is None 2024-09-13T06:39:22.977 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-13T06:39:22.977 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T06:39:23.283 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T06:39:23.284 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-09-13T06:39:23.300 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":19,"stamp":"2024-09-13T06:39:21.529113+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":161,"num_write_kb":2418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":120,"ondisk_log_size":120,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":218948,"kb_used_data":2768,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755772,"statfs":{"total":773094113280,"available":772869910528,"internally_reserved":0,"allocated":2834432,"data_stored":1731654,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":221236792},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.010406"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T06:39:19.552942+0000","last_change":"2024-09-13T06:39:19.552942+0000","last_active":"2024-09-13T06:39:19.552942+0000","last_peered":"2024-09-13T06:39:19.552942+0000","last_clean":"2024-09-13T06:39:19.552942+0000","last_became_active":"2024-09-13T06:39:17.535105+0000","last_became_peered":"2024-09-13T06:39:17.535105+0000","last_unstale":"2024-09-13T06:39:19.552942+0000","last_undegraded":"2024-09-13T06:39:19.552942+0000","last_fullsized":"2024-09-13T06:39:19.552942+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_clean_scrub_stamp":"2024-09-13T06:39:16.508974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:41:19.857628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00080324699999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T06:39:19.567201+0000","last_change":"2024-09-13T06:39:19.567201+0000","last_active":"2024-09-13T06:39:19.567201+0000","last_peered":"2024-09-13T06:39:19.567201+0000","last_clean":"2024-09-13T06:39:19.567201+0000","last_became_active":"2024-09-13T06:39:17.535411+0000","last_became_peered":"2024-09-13T06:39:17.535411+0000","last_unstale":"2024-09-13T06:39:19.567201+0000","last_undegraded":"2024-09-13T06:39:19.567201+0000","last_fullsized":"2024-09-13T06:39:19.567201+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_clean_scrub_stamp":"2024-09-13T06:39:16.508974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:44:11.617809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00097079800000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T06:39:19.679994+0000","last_change":"2024-09-13T06:39:19.679994+0000","last_active":"2024-09-13T06:39:19.679994+0000","last_peered":"2024-09-13T06:39:19.679994+0000","last_clean":"2024-09-13T06:39:19.679994+0000","last_became_active":"2024-09-13T06:39:17.721806+0000","last_became_peered":"2024-09-13T06:39:17.721806+0000","last_unstale":"2024-09-13T06:39:19.679994+0000","last_undegraded":"2024-09-13T06:39:19.679994+0000","last_fullsized":"2024-09-13T06:39:19.679994+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_clean_scrub_stamp":"2024-09-13T06:39:16.508974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:34:49.893894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00064776899999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T06:39:19.567043+0000","last_change":"2024-09-13T06:39:19.567043+0000","last_active":"2024-09-13T06:39:19.567043+0000","last_peered":"2024-09-13T06:39:19.567043+0000","last_clean":"2024-09-13T06:39:19.567043+0000","last_became_active":"2024-09-13T06:39:17.721287+0000","last_became_peered":"2024-09-13T06:39:17.721287+0000","last_unstale":"2024-09-13T06:39:19.567043+0000","last_undegraded":"2024-09-13T06:39:19.567043+0000","last_fullsized":"2024-09-13T06:39:19.567043+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_clean_scrub_stamp":"2024-09-13T06:39:16.508974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:14:34.131074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000890396,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"20'2","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T06:39:19.565648+0000","last_change":"2024-09-13T06:39:19.564386+0000","last_active":"2024-09-13T06:39:19.565648+0000","last_peered":"2024-09-13T06:39:19.565648+0000","last_clean":"2024-09-13T06:39:19.565648+0000","last_became_active":"2024-09-13T06:39:17.533677+0000","last_became_peered":"2024-09-13T06:39:17.533677+0000","last_unstale":"2024-09-13T06:39:19.565648+0000","last_undegraded":"2024-09-13T06:39:19.565648+0000","last_fullsized":"2024-09-13T06:39:19.565648+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_clean_scrub_stamp":"2024-09-13T06:39:16.508974+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:53:22.714840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001813556,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T06:39:20.303117+0000","last_change":"2024-09-13T06:39:20.303314+0000","last_active":"2024-09-13T06:39:20.303117+0000","last_peered":"2024-09-13T06:39:20.303117+0000","last_clean":"2024-09-13T06:39:20.303117+0000","last_became_active":"2024-09-13T06:39:17.536394+0000","last_became_peered":"2024-09-13T06:39:17.536394+0000","last_unstale":"2024-09-13T06:39:20.303117+0000","last_undegraded":"2024-09-13T06:39:20.303117+0000","last_fullsized":"2024-09-13T06:39:20.303117+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_clean_scrub_stamp":"2024-09-13T06:39:16.508974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:24:30.600904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00033592499999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T06:39:19.679784+0000","last_change":"2024-09-13T06:39:19.679784+0000","last_active":"2024-09-13T06:39:19.679784+0000","last_peered":"2024-09-13T06:39:19.679784+0000","last_clean":"2024-09-13T06:39:19.679784+0000","last_became_active":"2024-09-13T06:39:17.533439+0000","last_became_peered":"2024-09-13T06:39:17.533439+0000","last_unstale":"2024-09-13T06:39:19.679784+0000","last_undegraded":"2024-09-13T06:39:19.679784+0000","last_fullsized":"2024-09-13T06:39:19.679784+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_clean_scrub_stamp":"2024-09-13T06:39:16.508974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:12:49.774540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00061709999999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"18'1","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T06:39:19.563307+0000","last_change":"2024-09-13T06:39:19.563307+0000","last_active":"2024-09-13T06:39:19.563307+0000","last_peered":"2024-09-13T06:39:19.563307+0000","last_clean":"2024-09-13T06:39:19.563307+0000","last_became_active":"2024-09-13T06:39:17.536003+0000","last_became_peered":"2024-09-13T06:39:17.536003+0000","last_unstale":"2024-09-13T06:39:19.563307+0000","last_undegraded":"2024-09-13T06:39:19.563307+0000","last_fullsized":"2024-09-13T06:39:19.563307+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_clean_scrub_stamp":"2024-09-13T06:39:16.508974+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:12:22.307020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000698802,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"16'117","reported_seq":163,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-13T06:39:17.529449+0000","last_change":"2024-09-13T06:39:11.204643+0000","last_active":"2024-09-13T06:39:17.529449+0000","last_peered":"2024-09-13T06:39:17.529449+0000","last_clean":"2024-09-13T06:39:17.529449+0000","last_became_active":"2024-09-13T06:39:11.202831+0000","last_became_peered":"2024-09-13T06:39:11.202831+0000","last_unstale":"2024-09-13T06:39:17.529449+0000","last_undegraded":"2024-09-13T06:39:17.529449+0000","last_fullsized":"2024-09-13T06:39:17.529449+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:10.110558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:10.110558+0000","last_clean_scrub_stamp":"2024-09-13T06:39:10.110558+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:54:11.834414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574855,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27800,"kb_used_data":780,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344040,"statfs":{"total":96636764160,"available":96608296960,"internally_reserved":0,"allocated":798720,"data_stored":659228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.036}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70599999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96699999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92800000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91300000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83999999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0820000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574852,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":204800,"data_stored":68860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91200000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86199999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69099999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71699999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78200000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.131}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0880000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":208896,"data_stored":68879,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97099999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77000000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1559999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93700000000000006}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65600000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0409999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.089}]}]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27220,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":204800,"data_stored":68860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.123}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89600000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.048}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.27}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72099999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0800000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.415}]}]},{"osd":3,"up_from":13,"seq":55834574855,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":204800,"data_stored":68860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76200000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79300000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47899999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69199999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63100000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1719999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.747}]}]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":204800,"data_stored":68860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53200000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71699999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79800000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.139}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0640000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0229999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2490000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574853,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":208896,"data_stored":68879,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55300000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48199999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58199999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68300000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65000000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67100000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92300000000000004}]}]},{"osd":0,"up_from":13,"seq":55834574852,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27800,"kb_used_data":780,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344040,"statfs":{"total":96636764160,"available":96608296960,"internally_reserved":0,"allocated":798720,"data_stored":659228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38200000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42999999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41299999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96599999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81899999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63400000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T06:39:23.301 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T06:39:23.580 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T06:39:23.580 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-09-13T06:39:23.596 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":20,"stamp":"2024-09-13T06:39:23.529706+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":161,"num_write_kb":2418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":120,"ondisk_log_size":120,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":218948,"kb_used_data":2768,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755772,"statfs":{"total":773094113280,"available":772869910528,"internally_reserved":0,"allocated":2834432,"data_stored":1731654,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":221236792},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.004801"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T06:39:19.552942+0000","last_change":"2024-09-13T06:39:19.552942+0000","last_active":"2024-09-13T06:39:19.552942+0000","last_peered":"2024-09-13T06:39:19.552942+0000","last_clean":"2024-09-13T06:39:19.552942+0000","last_became_active":"2024-09-13T06:39:17.535105+0000","last_became_peered":"2024-09-13T06:39:17.535105+0000","last_unstale":"2024-09-13T06:39:19.552942+0000","last_undegraded":"2024-09-13T06:39:19.552942+0000","last_fullsized":"2024-09-13T06:39:19.552942+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_clean_scrub_stamp":"2024-09-13T06:39:16.508974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:41:19.857628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00080324699999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T06:39:19.567201+0000","last_change":"2024-09-13T06:39:19.567201+0000","last_active":"2024-09-13T06:39:19.567201+0000","last_peered":"2024-09-13T06:39:19.567201+0000","last_clean":"2024-09-13T06:39:19.567201+0000","last_became_active":"2024-09-13T06:39:17.535411+0000","last_became_peered":"2024-09-13T06:39:17.535411+0000","last_unstale":"2024-09-13T06:39:19.567201+0000","last_undegraded":"2024-09-13T06:39:19.567201+0000","last_fullsized":"2024-09-13T06:39:19.567201+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_clean_scrub_stamp":"2024-09-13T06:39:16.508974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:44:11.617809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00097079800000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T06:39:19.679994+0000","last_change":"2024-09-13T06:39:19.679994+0000","last_active":"2024-09-13T06:39:19.679994+0000","last_peered":"2024-09-13T06:39:19.679994+0000","last_clean":"2024-09-13T06:39:19.679994+0000","last_became_active":"2024-09-13T06:39:17.721806+0000","last_became_peered":"2024-09-13T06:39:17.721806+0000","last_unstale":"2024-09-13T06:39:19.679994+0000","last_undegraded":"2024-09-13T06:39:19.679994+0000","last_fullsized":"2024-09-13T06:39:19.679994+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_clean_scrub_stamp":"2024-09-13T06:39:16.508974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:34:49.893894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00064776899999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T06:39:19.567043+0000","last_change":"2024-09-13T06:39:19.567043+0000","last_active":"2024-09-13T06:39:19.567043+0000","last_peered":"2024-09-13T06:39:19.567043+0000","last_clean":"2024-09-13T06:39:19.567043+0000","last_became_active":"2024-09-13T06:39:17.721287+0000","last_became_peered":"2024-09-13T06:39:17.721287+0000","last_unstale":"2024-09-13T06:39:19.567043+0000","last_undegraded":"2024-09-13T06:39:19.567043+0000","last_fullsized":"2024-09-13T06:39:19.567043+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_clean_scrub_stamp":"2024-09-13T06:39:16.508974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:14:34.131074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000890396,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"20'2","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T06:39:19.565648+0000","last_change":"2024-09-13T06:39:19.564386+0000","last_active":"2024-09-13T06:39:19.565648+0000","last_peered":"2024-09-13T06:39:19.565648+0000","last_clean":"2024-09-13T06:39:19.565648+0000","last_became_active":"2024-09-13T06:39:17.533677+0000","last_became_peered":"2024-09-13T06:39:17.533677+0000","last_unstale":"2024-09-13T06:39:19.565648+0000","last_undegraded":"2024-09-13T06:39:19.565648+0000","last_fullsized":"2024-09-13T06:39:19.565648+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_clean_scrub_stamp":"2024-09-13T06:39:16.508974+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:53:22.714840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001813556,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T06:39:20.303117+0000","last_change":"2024-09-13T06:39:20.303314+0000","last_active":"2024-09-13T06:39:20.303117+0000","last_peered":"2024-09-13T06:39:20.303117+0000","last_clean":"2024-09-13T06:39:20.303117+0000","last_became_active":"2024-09-13T06:39:17.536394+0000","last_became_peered":"2024-09-13T06:39:17.536394+0000","last_unstale":"2024-09-13T06:39:20.303117+0000","last_undegraded":"2024-09-13T06:39:20.303117+0000","last_fullsized":"2024-09-13T06:39:20.303117+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_clean_scrub_stamp":"2024-09-13T06:39:16.508974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:24:30.600904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00033592499999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T06:39:19.679784+0000","last_change":"2024-09-13T06:39:19.679784+0000","last_active":"2024-09-13T06:39:19.679784+0000","last_peered":"2024-09-13T06:39:19.679784+0000","last_clean":"2024-09-13T06:39:19.679784+0000","last_became_active":"2024-09-13T06:39:17.533439+0000","last_became_peered":"2024-09-13T06:39:17.533439+0000","last_unstale":"2024-09-13T06:39:19.679784+0000","last_undegraded":"2024-09-13T06:39:19.679784+0000","last_fullsized":"2024-09-13T06:39:19.679784+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_clean_scrub_stamp":"2024-09-13T06:39:16.508974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:12:49.774540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00061709999999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"18'1","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T06:39:19.563307+0000","last_change":"2024-09-13T06:39:19.563307+0000","last_active":"2024-09-13T06:39:19.563307+0000","last_peered":"2024-09-13T06:39:19.563307+0000","last_clean":"2024-09-13T06:39:19.563307+0000","last_became_active":"2024-09-13T06:39:17.536003+0000","last_became_peered":"2024-09-13T06:39:17.536003+0000","last_unstale":"2024-09-13T06:39:19.563307+0000","last_undegraded":"2024-09-13T06:39:19.563307+0000","last_fullsized":"2024-09-13T06:39:19.563307+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_clean_scrub_stamp":"2024-09-13T06:39:16.508974+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:12:22.307020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000698802,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"16'117","reported_seq":163,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-13T06:39:17.529449+0000","last_change":"2024-09-13T06:39:11.204643+0000","last_active":"2024-09-13T06:39:17.529449+0000","last_peered":"2024-09-13T06:39:17.529449+0000","last_clean":"2024-09-13T06:39:17.529449+0000","last_became_active":"2024-09-13T06:39:11.202831+0000","last_became_peered":"2024-09-13T06:39:11.202831+0000","last_unstale":"2024-09-13T06:39:17.529449+0000","last_undegraded":"2024-09-13T06:39:17.529449+0000","last_fullsized":"2024-09-13T06:39:17.529449+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:10.110558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:10.110558+0000","last_clean_scrub_stamp":"2024-09-13T06:39:10.110558+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:54:11.834414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574855,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27800,"kb_used_data":780,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344040,"statfs":{"total":96636764160,"available":96608296960,"internally_reserved":0,"allocated":798720,"data_stored":659228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.036}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70599999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96699999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92800000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91300000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83999999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0820000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574852,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":204800,"data_stored":68860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91200000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86199999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69099999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71699999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78200000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.131}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0880000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":208896,"data_stored":68879,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97099999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77000000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1559999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93700000000000006}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65600000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0409999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.089}]}]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27220,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":204800,"data_stored":68860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.123}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89600000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.048}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.27}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72099999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0800000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.415}]}]},{"osd":3,"up_from":13,"seq":55834574855,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":204800,"data_stored":68860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76200000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79300000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47899999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69199999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63100000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1719999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.747}]}]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":204800,"data_stored":68860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53200000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71699999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79800000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.139}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0640000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0229999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2490000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574853,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":208896,"data_stored":68879,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55300000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48199999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58199999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68300000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65000000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67100000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92300000000000004}]}]},{"osd":0,"up_from":13,"seq":55834574852,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27800,"kb_used_data":780,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344040,"statfs":{"total":96636764160,"available":96608296960,"internally_reserved":0,"allocated":798720,"data_stored":659228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38200000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42999999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41299999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96599999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81899999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63400000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T06:39:23.598 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-13T06:39:23.598 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-13T06:39:23.598 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-09-13T06:39:23.598 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-13T06:39:23.900 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T06:39:23.901 INFO:teuthology.orchestra.run.smithi081.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-13T06:39:23.917 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-09-13T06:39:23.918 INFO:teuthology.run_tasks:Running task thrashosds... 2024-09-13T06:39:23.929 INFO:tasks.thrashosds:config is {'timeout': 1200, 'sighup_delay': 0.1, 'optrack_toggle_delay': 2.0, 'dump_ops_enable': 'true', 'noscrub_toggle_delay': 2.0, 'random_eio': 0.0} 2024-09-13T06:39:23.929 INFO:tasks.thrashosds:overrides is {'admin_socket': {'branch': 'reef'}, 'ceph': {'conf': {'global': {'mon client directed command retry': 5, 'mon warn on pool no app': False, 'ms inject socket failures': 5000}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd memory target': 1610612736, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'but it is still running', 'objects unfound and apparently lost', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from'], 'sha1': '48a7de7e6e1701a88fd571c7e34908ac4b8ed412'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}}}, 'install': {'ceph': {'flavor': 'default', 'sha1': '48a7de7e6e1701a88fd571c7e34908ac4b8ed412'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'reef', 'sha1': '7a853b1706d076d58e0da7a5d3b9b9eb36276880'}} 2024-09-13T06:39:23.929 INFO:tasks.thrashosds:config is {'timeout': 1200, 'sighup_delay': 0.1, 'optrack_toggle_delay': 2.0, 'dump_ops_enable': 'true', 'noscrub_toggle_delay': 2.0, 'random_eio': 0.0, 'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5} 2024-09-13T06:39:23.929 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr_debug_aggressive_pg_num_changes true 2024-09-13T06:39:24.233 INFO:tasks.thrashosds:Beginning thrashosds... 2024-09-13T06:39:24.233 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-13T06:39:24.233 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T06:39:24.505 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T06:39:24.506 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-09-13T06:39:24.521 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":20,"stamp":"2024-09-13T06:39:23.529706+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":161,"num_write_kb":2418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":120,"ondisk_log_size":120,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":218948,"kb_used_data":2768,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755772,"statfs":{"total":773094113280,"available":772869910528,"internally_reserved":0,"allocated":2834432,"data_stored":1731654,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":221236792},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.004801"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T06:39:19.552942+0000","last_change":"2024-09-13T06:39:19.552942+0000","last_active":"2024-09-13T06:39:19.552942+0000","last_peered":"2024-09-13T06:39:19.552942+0000","last_clean":"2024-09-13T06:39:19.552942+0000","last_became_active":"2024-09-13T06:39:17.535105+0000","last_became_peered":"2024-09-13T06:39:17.535105+0000","last_unstale":"2024-09-13T06:39:19.552942+0000","last_undegraded":"2024-09-13T06:39:19.552942+0000","last_fullsized":"2024-09-13T06:39:19.552942+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_clean_scrub_stamp":"2024-09-13T06:39:16.508974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:41:19.857628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00080324699999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T06:39:19.567201+0000","last_change":"2024-09-13T06:39:19.567201+0000","last_active":"2024-09-13T06:39:19.567201+0000","last_peered":"2024-09-13T06:39:19.567201+0000","last_clean":"2024-09-13T06:39:19.567201+0000","last_became_active":"2024-09-13T06:39:17.535411+0000","last_became_peered":"2024-09-13T06:39:17.535411+0000","last_unstale":"2024-09-13T06:39:19.567201+0000","last_undegraded":"2024-09-13T06:39:19.567201+0000","last_fullsized":"2024-09-13T06:39:19.567201+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_clean_scrub_stamp":"2024-09-13T06:39:16.508974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:44:11.617809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00097079800000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T06:39:19.679994+0000","last_change":"2024-09-13T06:39:19.679994+0000","last_active":"2024-09-13T06:39:19.679994+0000","last_peered":"2024-09-13T06:39:19.679994+0000","last_clean":"2024-09-13T06:39:19.679994+0000","last_became_active":"2024-09-13T06:39:17.721806+0000","last_became_peered":"2024-09-13T06:39:17.721806+0000","last_unstale":"2024-09-13T06:39:19.679994+0000","last_undegraded":"2024-09-13T06:39:19.679994+0000","last_fullsized":"2024-09-13T06:39:19.679994+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_clean_scrub_stamp":"2024-09-13T06:39:16.508974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:34:49.893894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00064776899999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T06:39:19.567043+0000","last_change":"2024-09-13T06:39:19.567043+0000","last_active":"2024-09-13T06:39:19.567043+0000","last_peered":"2024-09-13T06:39:19.567043+0000","last_clean":"2024-09-13T06:39:19.567043+0000","last_became_active":"2024-09-13T06:39:17.721287+0000","last_became_peered":"2024-09-13T06:39:17.721287+0000","last_unstale":"2024-09-13T06:39:19.567043+0000","last_undegraded":"2024-09-13T06:39:19.567043+0000","last_fullsized":"2024-09-13T06:39:19.567043+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_clean_scrub_stamp":"2024-09-13T06:39:16.508974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:14:34.131074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000890396,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"20'2","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T06:39:19.565648+0000","last_change":"2024-09-13T06:39:19.564386+0000","last_active":"2024-09-13T06:39:19.565648+0000","last_peered":"2024-09-13T06:39:19.565648+0000","last_clean":"2024-09-13T06:39:19.565648+0000","last_became_active":"2024-09-13T06:39:17.533677+0000","last_became_peered":"2024-09-13T06:39:17.533677+0000","last_unstale":"2024-09-13T06:39:19.565648+0000","last_undegraded":"2024-09-13T06:39:19.565648+0000","last_fullsized":"2024-09-13T06:39:19.565648+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_clean_scrub_stamp":"2024-09-13T06:39:16.508974+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:53:22.714840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001813556,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T06:39:20.303117+0000","last_change":"2024-09-13T06:39:20.303314+0000","last_active":"2024-09-13T06:39:20.303117+0000","last_peered":"2024-09-13T06:39:20.303117+0000","last_clean":"2024-09-13T06:39:20.303117+0000","last_became_active":"2024-09-13T06:39:17.536394+0000","last_became_peered":"2024-09-13T06:39:17.536394+0000","last_unstale":"2024-09-13T06:39:20.303117+0000","last_undegraded":"2024-09-13T06:39:20.303117+0000","last_fullsized":"2024-09-13T06:39:20.303117+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_clean_scrub_stamp":"2024-09-13T06:39:16.508974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:24:30.600904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00033592499999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T06:39:19.679784+0000","last_change":"2024-09-13T06:39:19.679784+0000","last_active":"2024-09-13T06:39:19.679784+0000","last_peered":"2024-09-13T06:39:19.679784+0000","last_clean":"2024-09-13T06:39:19.679784+0000","last_became_active":"2024-09-13T06:39:17.533439+0000","last_became_peered":"2024-09-13T06:39:17.533439+0000","last_unstale":"2024-09-13T06:39:19.679784+0000","last_undegraded":"2024-09-13T06:39:19.679784+0000","last_fullsized":"2024-09-13T06:39:19.679784+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_clean_scrub_stamp":"2024-09-13T06:39:16.508974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:12:49.774540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00061709999999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"18'1","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T06:39:19.563307+0000","last_change":"2024-09-13T06:39:19.563307+0000","last_active":"2024-09-13T06:39:19.563307+0000","last_peered":"2024-09-13T06:39:19.563307+0000","last_clean":"2024-09-13T06:39:19.563307+0000","last_became_active":"2024-09-13T06:39:17.536003+0000","last_became_peered":"2024-09-13T06:39:17.536003+0000","last_unstale":"2024-09-13T06:39:19.563307+0000","last_undegraded":"2024-09-13T06:39:19.563307+0000","last_fullsized":"2024-09-13T06:39:19.563307+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_clean_scrub_stamp":"2024-09-13T06:39:16.508974+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:12:22.307020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000698802,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"16'117","reported_seq":163,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-13T06:39:17.529449+0000","last_change":"2024-09-13T06:39:11.204643+0000","last_active":"2024-09-13T06:39:17.529449+0000","last_peered":"2024-09-13T06:39:17.529449+0000","last_clean":"2024-09-13T06:39:17.529449+0000","last_became_active":"2024-09-13T06:39:11.202831+0000","last_became_peered":"2024-09-13T06:39:11.202831+0000","last_unstale":"2024-09-13T06:39:17.529449+0000","last_undegraded":"2024-09-13T06:39:17.529449+0000","last_fullsized":"2024-09-13T06:39:17.529449+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:10.110558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:10.110558+0000","last_clean_scrub_stamp":"2024-09-13T06:39:10.110558+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:54:11.834414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574855,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27800,"kb_used_data":780,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344040,"statfs":{"total":96636764160,"available":96608296960,"internally_reserved":0,"allocated":798720,"data_stored":659228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.036}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70599999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96699999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92800000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91300000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83999999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0820000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574852,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":204800,"data_stored":68860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91200000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86199999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69099999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71699999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78200000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.131}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0880000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":208896,"data_stored":68879,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97099999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77000000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1559999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93700000000000006}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65600000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0409999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.089}]}]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27220,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":204800,"data_stored":68860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.123}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89600000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.048}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.27}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72099999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0800000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.415}]}]},{"osd":3,"up_from":13,"seq":55834574855,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":204800,"data_stored":68860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76200000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79300000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47899999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69199999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63100000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1719999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.747}]}]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":204800,"data_stored":68860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53200000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71699999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79800000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.139}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0640000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0229999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2490000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574853,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":208896,"data_stored":68879,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55300000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48199999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58199999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68300000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65000000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67100000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92300000000000004}]}]},{"osd":0,"up_from":13,"seq":55834574852,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27800,"kb_used_data":780,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344040,"statfs":{"total":96636764160,"available":96608296960,"internally_reserved":0,"allocated":798720,"data_stored":659228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38200000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42999999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41299999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96599999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81899999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63400000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T06:39:24.523 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T06:39:24.794 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T06:39:24.794 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-09-13T06:39:24.810 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":20,"stamp":"2024-09-13T06:39:23.529706+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":161,"num_write_kb":2418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":120,"ondisk_log_size":120,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":218948,"kb_used_data":2768,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755772,"statfs":{"total":773094113280,"available":772869910528,"internally_reserved":0,"allocated":2834432,"data_stored":1731654,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":221236792},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.004801"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T06:39:19.552942+0000","last_change":"2024-09-13T06:39:19.552942+0000","last_active":"2024-09-13T06:39:19.552942+0000","last_peered":"2024-09-13T06:39:19.552942+0000","last_clean":"2024-09-13T06:39:19.552942+0000","last_became_active":"2024-09-13T06:39:17.535105+0000","last_became_peered":"2024-09-13T06:39:17.535105+0000","last_unstale":"2024-09-13T06:39:19.552942+0000","last_undegraded":"2024-09-13T06:39:19.552942+0000","last_fullsized":"2024-09-13T06:39:19.552942+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_clean_scrub_stamp":"2024-09-13T06:39:16.508974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:41:19.857628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00080324699999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T06:39:19.567201+0000","last_change":"2024-09-13T06:39:19.567201+0000","last_active":"2024-09-13T06:39:19.567201+0000","last_peered":"2024-09-13T06:39:19.567201+0000","last_clean":"2024-09-13T06:39:19.567201+0000","last_became_active":"2024-09-13T06:39:17.535411+0000","last_became_peered":"2024-09-13T06:39:17.535411+0000","last_unstale":"2024-09-13T06:39:19.567201+0000","last_undegraded":"2024-09-13T06:39:19.567201+0000","last_fullsized":"2024-09-13T06:39:19.567201+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_clean_scrub_stamp":"2024-09-13T06:39:16.508974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:44:11.617809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00097079800000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T06:39:19.679994+0000","last_change":"2024-09-13T06:39:19.679994+0000","last_active":"2024-09-13T06:39:19.679994+0000","last_peered":"2024-09-13T06:39:19.679994+0000","last_clean":"2024-09-13T06:39:19.679994+0000","last_became_active":"2024-09-13T06:39:17.721806+0000","last_became_peered":"2024-09-13T06:39:17.721806+0000","last_unstale":"2024-09-13T06:39:19.679994+0000","last_undegraded":"2024-09-13T06:39:19.679994+0000","last_fullsized":"2024-09-13T06:39:19.679994+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_clean_scrub_stamp":"2024-09-13T06:39:16.508974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:34:49.893894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00064776899999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T06:39:19.567043+0000","last_change":"2024-09-13T06:39:19.567043+0000","last_active":"2024-09-13T06:39:19.567043+0000","last_peered":"2024-09-13T06:39:19.567043+0000","last_clean":"2024-09-13T06:39:19.567043+0000","last_became_active":"2024-09-13T06:39:17.721287+0000","last_became_peered":"2024-09-13T06:39:17.721287+0000","last_unstale":"2024-09-13T06:39:19.567043+0000","last_undegraded":"2024-09-13T06:39:19.567043+0000","last_fullsized":"2024-09-13T06:39:19.567043+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_clean_scrub_stamp":"2024-09-13T06:39:16.508974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:14:34.131074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000890396,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"20'2","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T06:39:19.565648+0000","last_change":"2024-09-13T06:39:19.564386+0000","last_active":"2024-09-13T06:39:19.565648+0000","last_peered":"2024-09-13T06:39:19.565648+0000","last_clean":"2024-09-13T06:39:19.565648+0000","last_became_active":"2024-09-13T06:39:17.533677+0000","last_became_peered":"2024-09-13T06:39:17.533677+0000","last_unstale":"2024-09-13T06:39:19.565648+0000","last_undegraded":"2024-09-13T06:39:19.565648+0000","last_fullsized":"2024-09-13T06:39:19.565648+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_clean_scrub_stamp":"2024-09-13T06:39:16.508974+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:53:22.714840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001813556,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T06:39:20.303117+0000","last_change":"2024-09-13T06:39:20.303314+0000","last_active":"2024-09-13T06:39:20.303117+0000","last_peered":"2024-09-13T06:39:20.303117+0000","last_clean":"2024-09-13T06:39:20.303117+0000","last_became_active":"2024-09-13T06:39:17.536394+0000","last_became_peered":"2024-09-13T06:39:17.536394+0000","last_unstale":"2024-09-13T06:39:20.303117+0000","last_undegraded":"2024-09-13T06:39:20.303117+0000","last_fullsized":"2024-09-13T06:39:20.303117+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_clean_scrub_stamp":"2024-09-13T06:39:16.508974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:24:30.600904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00033592499999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T06:39:19.679784+0000","last_change":"2024-09-13T06:39:19.679784+0000","last_active":"2024-09-13T06:39:19.679784+0000","last_peered":"2024-09-13T06:39:19.679784+0000","last_clean":"2024-09-13T06:39:19.679784+0000","last_became_active":"2024-09-13T06:39:17.533439+0000","last_became_peered":"2024-09-13T06:39:17.533439+0000","last_unstale":"2024-09-13T06:39:19.679784+0000","last_undegraded":"2024-09-13T06:39:19.679784+0000","last_fullsized":"2024-09-13T06:39:19.679784+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_clean_scrub_stamp":"2024-09-13T06:39:16.508974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:12:49.774540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00061709999999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"18'1","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T06:39:19.563307+0000","last_change":"2024-09-13T06:39:19.563307+0000","last_active":"2024-09-13T06:39:19.563307+0000","last_peered":"2024-09-13T06:39:19.563307+0000","last_clean":"2024-09-13T06:39:19.563307+0000","last_became_active":"2024-09-13T06:39:17.536003+0000","last_became_peered":"2024-09-13T06:39:17.536003+0000","last_unstale":"2024-09-13T06:39:19.563307+0000","last_undegraded":"2024-09-13T06:39:19.563307+0000","last_fullsized":"2024-09-13T06:39:19.563307+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_clean_scrub_stamp":"2024-09-13T06:39:16.508974+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:12:22.307020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000698802,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"16'117","reported_seq":163,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-13T06:39:17.529449+0000","last_change":"2024-09-13T06:39:11.204643+0000","last_active":"2024-09-13T06:39:17.529449+0000","last_peered":"2024-09-13T06:39:17.529449+0000","last_clean":"2024-09-13T06:39:17.529449+0000","last_became_active":"2024-09-13T06:39:11.202831+0000","last_became_peered":"2024-09-13T06:39:11.202831+0000","last_unstale":"2024-09-13T06:39:17.529449+0000","last_undegraded":"2024-09-13T06:39:17.529449+0000","last_fullsized":"2024-09-13T06:39:17.529449+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:10.110558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:10.110558+0000","last_clean_scrub_stamp":"2024-09-13T06:39:10.110558+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:54:11.834414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574855,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27800,"kb_used_data":780,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344040,"statfs":{"total":96636764160,"available":96608296960,"internally_reserved":0,"allocated":798720,"data_stored":659228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.036}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70599999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96699999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92800000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91300000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83999999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0820000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574852,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":204800,"data_stored":68860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91200000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86199999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69099999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71699999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78200000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.131}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0880000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":208896,"data_stored":68879,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97099999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77000000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1559999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93700000000000006}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65600000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0409999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.089}]}]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27220,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":204800,"data_stored":68860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.123}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89600000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.048}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.27}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72099999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0800000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.415}]}]},{"osd":3,"up_from":13,"seq":55834574855,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":204800,"data_stored":68860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76200000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79300000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47899999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69199999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63100000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1719999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.747}]}]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":204800,"data_stored":68860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53200000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71699999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79800000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.139}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0640000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0229999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2490000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574853,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":208896,"data_stored":68879,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55300000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48199999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58199999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68300000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65000000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67100000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92300000000000004}]}]},{"osd":0,"up_from":13,"seq":55834574852,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27800,"kb_used_data":780,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344040,"statfs":{"total":96636764160,"available":96608296960,"internally_reserved":0,"allocated":798720,"data_stored":659228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38200000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42999999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41299999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96599999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81899999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63400000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T06:39:24.811 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-13T06:39:24.812 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump 2024-09-13T06:39:25.078 INFO:teuthology.orchestra.run.smithi081.stdout:epoch 20 2024-09-13T06:39:25.078 INFO:teuthology.orchestra.run.smithi081.stdout:fsid e5612297-d004-4957-927e-afa37f30d6cf 2024-09-13T06:39:25.078 INFO:teuthology.orchestra.run.smithi081.stdout:created 2024-09-13T06:38:56.670231+0000 2024-09-13T06:39:25.078 INFO:teuthology.orchestra.run.smithi081.stdout:modified 2024-09-13T06:39:19.540191+0000 2024-09-13T06:39:25.078 INFO:teuthology.orchestra.run.smithi081.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-09-13T06:39:25.079 INFO:teuthology.orchestra.run.smithi081.stdout:crush_version 4 2024-09-13T06:39:25.079 INFO:teuthology.orchestra.run.smithi081.stdout:full_ratio 0.95 2024-09-13T06:39:25.079 INFO:teuthology.orchestra.run.smithi081.stdout:backfillfull_ratio 0.9 2024-09-13T06:39:25.079 INFO:teuthology.orchestra.run.smithi081.stdout:nearfull_ratio 0.85 2024-09-13T06:39:25.079 INFO:teuthology.orchestra.run.smithi081.stdout:require_min_compat_client luminous 2024-09-13T06:39:25.079 INFO:teuthology.orchestra.run.smithi081.stdout:min_compat_client jewel 2024-09-13T06:39:25.079 INFO:teuthology.orchestra.run.smithi081.stdout:require_osd_release reef 2024-09-13T06:39:25.079 INFO:teuthology.orchestra.run.smithi081.stdout:stretch_mode_enabled false 2024-09-13T06:39:25.079 INFO:teuthology.orchestra.run.smithi081.stdout:pool 1 '.mgr' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 16 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 8.00 2024-09-13T06:39:25.079 INFO:teuthology.orchestra.run.smithi081.stdout:pool 2 'rbd' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 8 pgp_num 8 autoscale_mode off last_change 20 flags hashpspool,selfmanaged_snaps stripe_width 0 application rbd read_balance_score 1.99 2024-09-13T06:39:25.079 INFO:teuthology.orchestra.run.smithi081.stdout: removed_snaps_queue [2~1] 2024-09-13T06:39:25.079 INFO:teuthology.orchestra.run.smithi081.stdout:max_osd 8 2024-09-13T06:39:25.080 INFO:teuthology.orchestra.run.smithi081.stdout:osd.0 up in weight 1 up_from 13 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:172.21.15.81:6808/1904727940,v1:172.21.15.81:6809/1904727940] [v2:172.21.15.81:6810/1904727940,v1:172.21.15.81:6811/1904727940] exists,up 54b0a3e4-58ad-4f95-86dc-29a11c9a1964 2024-09-13T06:39:25.080 INFO:teuthology.orchestra.run.smithi081.stdout:osd.1 up in weight 1 up_from 13 up_thru 17 down_at 0 last_clean_interval [0,0) [v2:172.21.15.81:6817/738205570,v1:172.21.15.81:6819/738205570] [v2:172.21.15.81:6822/738205570,v1:172.21.15.81:6824/738205570] exists,up a6dba5b9-c833-465e-a8a5-1741528b24c0 2024-09-13T06:39:25.080 INFO:teuthology.orchestra.run.smithi081.stdout:osd.2 up in weight 1 up_from 13 up_thru 17 down_at 0 last_clean_interval [0,0) [v2:172.21.15.81:6816/3558674335,v1:172.21.15.81:6818/3558674335] [v2:172.21.15.81:6820/3558674335,v1:172.21.15.81:6821/3558674335] exists,up 6c45097e-44a2-454f-80a4-0fe879ccd52f 2024-09-13T06:39:25.080 INFO:teuthology.orchestra.run.smithi081.stdout:osd.3 up in weight 1 up_from 13 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:172.21.15.81:6800/1886327229,v1:172.21.15.81:6801/1886327229] [v2:172.21.15.81:6802/1886327229,v1:172.21.15.81:6803/1886327229] exists,up 31952760-06f3-4618-a5c4-f5c4fed3aadb 2024-09-13T06:39:25.080 INFO:teuthology.orchestra.run.smithi081.stdout:osd.4 up in weight 1 up_from 13 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:172.21.15.139:6817/2184515621,v1:172.21.15.139:6819/2184515621] [v2:172.21.15.139:6820/2184515621,v1:172.21.15.139:6822/2184515621] exists,up c9bd2751-c836-43dc-b844-e13678cb2fd9 2024-09-13T06:39:25.080 INFO:teuthology.orchestra.run.smithi081.stdout:osd.5 up in weight 1 up_from 13 up_thru 17 down_at 0 last_clean_interval [0,0) [v2:172.21.15.139:6816/3982901834,v1:172.21.15.139:6818/3982901834] [v2:172.21.15.139:6821/3982901834,v1:172.21.15.139:6823/3982901834] exists,up 2971b93a-6c9f-4b77-b526-4eac788fabf9 2024-09-13T06:39:25.080 INFO:teuthology.orchestra.run.smithi081.stdout:osd.6 up in weight 1 up_from 13 up_thru 17 down_at 0 last_clean_interval [0,0) [v2:172.21.15.139:6800/2283932666,v1:172.21.15.139:6801/2283932666] [v2:172.21.15.139:6802/2283932666,v1:172.21.15.139:6803/2283932666] exists,up e1f786ce-579e-48cc-b212-83f881b94184 2024-09-13T06:39:25.080 INFO:teuthology.orchestra.run.smithi081.stdout:osd.7 up in weight 1 up_from 13 up_thru 17 down_at 0 last_clean_interval [0,0) [v2:172.21.15.139:6808/2348111157,v1:172.21.15.139:6809/2348111157] [v2:172.21.15.139:6810/2348111157,v1:172.21.15.139:6811/2348111157] exists,up a287ddf6-84eb-4225-b267-25eee1657625 2024-09-13T06:39:25.095 INFO:tasks.ceph.ceph_manager.ceph:['osd.0 up in weight 1 up_from 13 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:172.21.15.81:6808/1904727940,v1:172.21.15.81:6809/1904727940] [v2:172.21.15.81:6810/1904727940,v1:172.21.15.81:6811/1904727940] exists,up 54b0a3e4-58ad-4f95-86dc-29a11c9a1964', 'osd.1 up in weight 1 up_from 13 up_thru 17 down_at 0 last_clean_interval [0,0) [v2:172.21.15.81:6817/738205570,v1:172.21.15.81:6819/738205570] [v2:172.21.15.81:6822/738205570,v1:172.21.15.81:6824/738205570] exists,up a6dba5b9-c833-465e-a8a5-1741528b24c0', 'osd.2 up in weight 1 up_from 13 up_thru 17 down_at 0 last_clean_interval [0,0) [v2:172.21.15.81:6816/3558674335,v1:172.21.15.81:6818/3558674335] [v2:172.21.15.81:6820/3558674335,v1:172.21.15.81:6821/3558674335] exists,up 6c45097e-44a2-454f-80a4-0fe879ccd52f', 'osd.3 up in weight 1 up_from 13 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:172.21.15.81:6800/1886327229,v1:172.21.15.81:6801/1886327229] [v2:172.21.15.81:6802/1886327229,v1:172.21.15.81:6803/1886327229] exists,up 31952760-06f3-4618-a5c4-f5c4fed3aadb', 'osd.4 up in weight 1 up_from 13 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:172.21.15.139:6817/2184515621,v1:172.21.15.139:6819/2184515621] [v2:172.21.15.139:6820/2184515621,v1:172.21.15.139:6822/2184515621] exists,up c9bd2751-c836-43dc-b844-e13678cb2fd9', 'osd.5 up in weight 1 up_from 13 up_thru 17 down_at 0 last_clean_interval [0,0) [v2:172.21.15.139:6816/3982901834,v1:172.21.15.139:6818/3982901834] [v2:172.21.15.139:6821/3982901834,v1:172.21.15.139:6823/3982901834] exists,up 2971b93a-6c9f-4b77-b526-4eac788fabf9', 'osd.6 up in weight 1 up_from 13 up_thru 17 down_at 0 last_clean_interval [0,0) [v2:172.21.15.139:6800/2283932666,v1:172.21.15.139:6801/2283932666] [v2:172.21.15.139:6802/2283932666,v1:172.21.15.139:6803/2283932666] exists,up e1f786ce-579e-48cc-b212-83f881b94184', 'osd.7 up in weight 1 up_from 13 up_thru 17 down_at 0 last_clean_interval [0,0) [v2:172.21.15.139:6808/2348111157,v1:172.21.15.139:6809/2348111157] [v2:172.21.15.139:6810/2348111157,v1:172.21.15.139:6811/2348111157] exists,up a287ddf6-84eb-4225-b267-25eee1657625'] 2024-09-13T06:39:25.096 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok config show 2024-09-13T06:39:25.199 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:39:25.199 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "mon.a", 2024-09-13T06:39:25.199 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster": "ceph", 2024-09-13T06:39:25.199 INFO:teuthology.orchestra.run.smithi081.stdout: "admin_socket": "/var/run/ceph/ceph-mon.a.asok", 2024-09-13T06:39:25.200 INFO:teuthology.orchestra.run.smithi081.stdout: "admin_socket_mode": "", 2024-09-13T06:39:25.200 INFO:teuthology.orchestra.run.smithi081.stdout: "auth_allow_insecure_global_id_reclaim": "true", 2024-09-13T06:39:25.200 INFO:teuthology.orchestra.run.smithi081.stdout: "auth_client_required": "cephx, none", 2024-09-13T06:39:25.200 INFO:teuthology.orchestra.run.smithi081.stdout: "auth_cluster_required": "cephx", 2024-09-13T06:39:25.200 INFO:teuthology.orchestra.run.smithi081.stdout: "auth_debug": "true", 2024-09-13T06:39:25.200 INFO:teuthology.orchestra.run.smithi081.stdout: "auth_expose_insecure_global_id_reclaim": "true", 2024-09-13T06:39:25.200 INFO:teuthology.orchestra.run.smithi081.stdout: "auth_mon_ticket_ttl": "660.000000", 2024-09-13T06:39:25.200 INFO:teuthology.orchestra.run.smithi081.stdout: "auth_service_required": "cephx", 2024-09-13T06:39:25.200 INFO:teuthology.orchestra.run.smithi081.stdout: "auth_service_ticket_ttl": "240.000000", 2024-09-13T06:39:25.200 INFO:teuthology.orchestra.run.smithi081.stdout: "auth_supported": "cephx", 2024-09-13T06:39:25.200 INFO:teuthology.orchestra.run.smithi081.stdout: "bdev_aio": "true", 2024-09-13T06:39:25.200 INFO:teuthology.orchestra.run.smithi081.stdout: "bdev_aio_max_queue_depth": "1024", 2024-09-13T06:39:25.201 INFO:teuthology.orchestra.run.smithi081.stdout: "bdev_aio_poll_ms": "250", 2024-09-13T06:39:25.201 INFO:teuthology.orchestra.run.smithi081.stdout: "bdev_aio_reap_max": "16", 2024-09-13T06:39:25.201 INFO:teuthology.orchestra.run.smithi081.stdout: "bdev_async_discard": "false", 2024-09-13T06:39:25.201 INFO:teuthology.orchestra.run.smithi081.stdout: "bdev_block_size": "4096", 2024-09-13T06:39:25.201 INFO:teuthology.orchestra.run.smithi081.stdout: "bdev_debug_aio": "false", 2024-09-13T06:39:25.201 INFO:teuthology.orchestra.run.smithi081.stdout: "bdev_debug_aio_log_age": "5.000000", 2024-09-13T06:39:25.201 INFO:teuthology.orchestra.run.smithi081.stdout: "bdev_debug_aio_suicide_timeout": "60.000000", 2024-09-13T06:39:25.201 INFO:teuthology.orchestra.run.smithi081.stdout: "bdev_debug_inflight_ios": "false", 2024-09-13T06:39:25.201 INFO:teuthology.orchestra.run.smithi081.stdout: "bdev_enable_discard": "false", 2024-09-13T06:39:25.201 INFO:teuthology.orchestra.run.smithi081.stdout: "bdev_flock_retry": "3", 2024-09-13T06:39:25.201 INFO:teuthology.orchestra.run.smithi081.stdout: "bdev_flock_retry_interval": "0.100000", 2024-09-13T06:39:25.201 INFO:teuthology.orchestra.run.smithi081.stdout: "bdev_inject_crash": "0", 2024-09-13T06:39:25.201 INFO:teuthology.orchestra.run.smithi081.stdout: "bdev_inject_crash_flush_delay": "2", 2024-09-13T06:39:25.202 INFO:teuthology.orchestra.run.smithi081.stdout: "bdev_ioring": "false", 2024-09-13T06:39:25.202 INFO:teuthology.orchestra.run.smithi081.stdout: "bdev_ioring_hipri": "false", 2024-09-13T06:39:25.202 INFO:teuthology.orchestra.run.smithi081.stdout: "bdev_ioring_sqthread_poll": "false", 2024-09-13T06:39:25.202 INFO:teuthology.orchestra.run.smithi081.stdout: "bdev_nvme_unbind_from_kernel": "false", 2024-09-13T06:39:25.202 INFO:teuthology.orchestra.run.smithi081.stdout: "bdev_read_buffer_alignment": "4096", 2024-09-13T06:39:25.202 INFO:teuthology.orchestra.run.smithi081.stdout: "bdev_read_preallocated_huge_buffers": "", 2024-09-13T06:39:25.202 INFO:teuthology.orchestra.run.smithi081.stdout: "bdev_type": "", 2024-09-13T06:39:25.202 INFO:teuthology.orchestra.run.smithi081.stdout: "bluefs_alloc_size": "1048576", 2024-09-13T06:39:25.202 INFO:teuthology.orchestra.run.smithi081.stdout: "bluefs_allocator": "hybrid", 2024-09-13T06:39:25.202 INFO:teuthology.orchestra.run.smithi081.stdout: "bluefs_buffered_io": "true", 2024-09-13T06:39:25.202 INFO:teuthology.orchestra.run.smithi081.stdout: "bluefs_check_for_zeros": "false", 2024-09-13T06:39:25.203 INFO:teuthology.orchestra.run.smithi081.stdout: "bluefs_check_volume_selector_often": "false", 2024-09-13T06:39:25.203 INFO:teuthology.orchestra.run.smithi081.stdout: "bluefs_check_volume_selector_on_umount": "false", 2024-09-13T06:39:25.203 INFO:teuthology.orchestra.run.smithi081.stdout: "bluefs_compact_log_sync": "false", 2024-09-13T06:39:25.203 INFO:teuthology.orchestra.run.smithi081.stdout: "bluefs_failed_shared_alloc_cooldown": "600.000000", 2024-09-13T06:39:25.203 INFO:teuthology.orchestra.run.smithi081.stdout: "bluefs_log_compact_min_ratio": "5.000000", 2024-09-13T06:39:25.203 INFO:teuthology.orchestra.run.smithi081.stdout: "bluefs_log_compact_min_size": "16777216", 2024-09-13T06:39:25.203 INFO:teuthology.orchestra.run.smithi081.stdout: "bluefs_log_replay_check_allocations": "true", 2024-09-13T06:39:25.203 INFO:teuthology.orchestra.run.smithi081.stdout: "bluefs_max_log_runway": "4194304", 2024-09-13T06:39:25.203 INFO:teuthology.orchestra.run.smithi081.stdout: "bluefs_max_prefetch": "1048576", 2024-09-13T06:39:25.203 INFO:teuthology.orchestra.run.smithi081.stdout: "bluefs_min_flush_size": "524288", 2024-09-13T06:39:25.203 INFO:teuthology.orchestra.run.smithi081.stdout: "bluefs_min_log_runway": "1048576", 2024-09-13T06:39:25.203 INFO:teuthology.orchestra.run.smithi081.stdout: "bluefs_replay_recovery": "false", 2024-09-13T06:39:25.204 INFO:teuthology.orchestra.run.smithi081.stdout: "bluefs_replay_recovery_disable_compact": "false", 2024-09-13T06:39:25.204 INFO:teuthology.orchestra.run.smithi081.stdout: "bluefs_shared_alloc_size": "65536", 2024-09-13T06:39:25.204 INFO:teuthology.orchestra.run.smithi081.stdout: "bluefs_sync_write": "false", 2024-09-13T06:39:25.204 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_2q_cache_kin_ratio": "0.500000", 2024-09-13T06:39:25.204 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_2q_cache_kout_ratio": "0.500000", 2024-09-13T06:39:25.204 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_alloc_stats_dump_interval": "86400.000000", 2024-09-13T06:39:25.204 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_allocation_from_file": "true", 2024-09-13T06:39:25.204 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_allocator": "hybrid", 2024-09-13T06:39:25.204 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_avl_alloc_bf_free_pct": "4", 2024-09-13T06:39:25.204 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_avl_alloc_bf_threshold": "131072", 2024-09-13T06:39:25.204 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_avl_alloc_ff_max_search_bytes": "16777216", 2024-09-13T06:39:25.204 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_avl_alloc_ff_max_search_count": "100", 2024-09-13T06:39:25.205 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_bitmapallocator_blocks_per_zone": "1024", 2024-09-13T06:39:25.205 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_bitmapallocator_span_size": "1024", 2024-09-13T06:39:25.205 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_blobid_prealloc": "10240", 2024-09-13T06:39:25.205 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_block_create": "true", 2024-09-13T06:39:25.205 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_block_db_create": "false", 2024-09-13T06:39:25.205 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_block_db_path": "", 2024-09-13T06:39:25.205 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_block_db_size": "0", 2024-09-13T06:39:25.205 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_block_path": "", 2024-09-13T06:39:25.205 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_block_preallocate_file": "false", 2024-09-13T06:39:25.205 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_block_size": "107374182400", 2024-09-13T06:39:25.205 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_block_wal_create": "false", 2024-09-13T06:39:25.205 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_block_wal_path": "", 2024-09-13T06:39:25.206 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_block_wal_size": "100663296", 2024-09-13T06:39:25.206 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_bluefs": "true", 2024-09-13T06:39:25.206 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_bluefs_alloc_failure_dump_interval": "0.000000", 2024-09-13T06:39:25.206 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_bluefs_env_mirror": "false", 2024-09-13T06:39:25.206 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_bluefs_max_free": "10737418240", 2024-09-13T06:39:25.206 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_age_bin_interval": "1.000000", 2024-09-13T06:39:25.206 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_age_bins_data": "1 2 6 24 120 720 0 0 0 0", 2024-09-13T06:39:25.206 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_age_bins_kv": "1 2 6 24 120 720 0 0 0 0", 2024-09-13T06:39:25.206 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_age_bins_kv_onode": "0 0 0 0 0 0 0 0 0 720", 2024-09-13T06:39:25.206 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_age_bins_meta": "1 2 6 24 120 720 0 0 0 0", 2024-09-13T06:39:25.206 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_autotune": "true", 2024-09-13T06:39:25.206 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_autotune_interval": "5.000000", 2024-09-13T06:39:25.207 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_kv_onode_ratio": "0.040000", 2024-09-13T06:39:25.207 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_kv_ratio": "0.450000", 2024-09-13T06:39:25.207 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_meta_ratio": "0.450000", 2024-09-13T06:39:25.207 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_size": "0", 2024-09-13T06:39:25.207 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_size_hdd": "1073741824", 2024-09-13T06:39:25.207 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_size_ssd": "3221225472", 2024-09-13T06:39:25.207 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_trim_interval": "0.050000", 2024-09-13T06:39:25.207 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_trim_max_skip_pinned": "1000", 2024-09-13T06:39:25.207 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_type": "2q", 2024-09-13T06:39:25.207 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cleaner_sleep_interval": "5.000000", 2024-09-13T06:39:25.207 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_clone_cow": "true", 2024-09-13T06:39:25.207 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_compression_algorithm": "snappy", 2024-09-13T06:39:25.207 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_compression_max_blob_size": "0", 2024-09-13T06:39:25.208 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_compression_max_blob_size_hdd": "65536", 2024-09-13T06:39:25.208 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_compression_max_blob_size_ssd": "65536", 2024-09-13T06:39:25.208 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_compression_min_blob_size": "0", 2024-09-13T06:39:25.208 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_compression_min_blob_size_hdd": "8192", 2024-09-13T06:39:25.208 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_compression_min_blob_size_ssd": "65536", 2024-09-13T06:39:25.208 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_compression_mode": "none", 2024-09-13T06:39:25.208 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_compression_required_ratio": "0.875000", 2024-09-13T06:39:25.208 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_csum_type": "crc32c", 2024-09-13T06:39:25.208 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_debug_enforce_settings": "default", 2024-09-13T06:39:25.208 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_debug_freelist": "false", 2024-09-13T06:39:25.208 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_debug_fsck_abort": "false", 2024-09-13T06:39:25.208 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_debug_inject_allocation_from_file_failure": "0.000000", 2024-09-13T06:39:25.209 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_debug_inject_bug21040": "false", 2024-09-13T06:39:25.209 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_debug_inject_csum_err_probability": "0.000000", 2024-09-13T06:39:25.209 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_debug_inject_read_err": "false", 2024-09-13T06:39:25.209 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_debug_legacy_omap": "false", 2024-09-13T06:39:25.209 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_debug_no_reuse_blocks": "false", 2024-09-13T06:39:25.209 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_debug_omit_block_device_write": "false", 2024-09-13T06:39:25.209 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_debug_omit_kv_commit": "false", 2024-09-13T06:39:25.209 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_debug_permit_any_bdev_label": "false", 2024-09-13T06:39:25.209 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_debug_prefill": "0.000000", 2024-09-13T06:39:25.209 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_debug_prefragment_max": "1048576", 2024-09-13T06:39:25.209 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_debug_random_read_err": "0.000000", 2024-09-13T06:39:25.209 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_debug_randomize_serial_transaction": "0", 2024-09-13T06:39:25.209 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_debug_small_allocations": "0", 2024-09-13T06:39:25.210 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_debug_too_many_blobs_threshold": "24576", 2024-09-13T06:39:25.210 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_default_buffered_read": "true", 2024-09-13T06:39:25.210 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_default_buffered_write": "false", 2024-09-13T06:39:25.210 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_deferred_batch_ops": "0", 2024-09-13T06:39:25.210 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_deferred_batch_ops_hdd": "64", 2024-09-13T06:39:25.210 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_deferred_batch_ops_ssd": "16", 2024-09-13T06:39:25.210 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_extent_map_inline_shard_prealloc_size": "256", 2024-09-13T06:39:25.210 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_extent_map_shard_max_size": "1200", 2024-09-13T06:39:25.210 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_extent_map_shard_min_size": "150", 2024-09-13T06:39:25.210 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_extent_map_shard_target_size": "500", 2024-09-13T06:39:25.210 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_extent_map_shard_target_size_slop": "0.200000", 2024-09-13T06:39:25.210 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_fail_eio": "false", 2024-09-13T06:39:25.210 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_freelist_blocks_per_key": "128", 2024-09-13T06:39:25.210 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_fsck_error_on_no_per_pg_omap": "false", 2024-09-13T06:39:25.211 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_fsck_error_on_no_per_pool_omap": "false", 2024-09-13T06:39:25.211 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_fsck_error_on_no_per_pool_stats": "false", 2024-09-13T06:39:25.211 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_fsck_on_mkfs": "true", 2024-09-13T06:39:25.211 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_fsck_on_mkfs_deep": "false", 2024-09-13T06:39:25.211 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_fsck_on_mount": "false", 2024-09-13T06:39:25.211 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_fsck_on_mount_deep": "false", 2024-09-13T06:39:25.211 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_fsck_on_umount": "false", 2024-09-13T06:39:25.211 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_fsck_on_umount_deep": "false", 2024-09-13T06:39:25.211 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_fsck_quick_fix_on_mount": "false", 2024-09-13T06:39:25.211 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_fsck_quick_fix_threads": "2", 2024-09-13T06:39:25.211 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_fsck_read_bytes_cap": "67108864", 2024-09-13T06:39:25.211 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_fsck_shared_blob_tracker_size": "0.031250", 2024-09-13T06:39:25.211 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_gc_enable_blob_threshold": "0", 2024-09-13T06:39:25.211 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_gc_enable_total_threshold": "0", 2024-09-13T06:39:25.211 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_hybrid_alloc_mem_cap": "67108864", 2024-09-13T06:39:25.212 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_ignore_data_csum": "false", 2024-09-13T06:39:25.212 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_kv_sync_util_logging_s": "10.000000", 2024-09-13T06:39:25.212 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_kvbackend": "rocksdb", 2024-09-13T06:39:25.212 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_log_collection_list_age": "60.000000", 2024-09-13T06:39:25.212 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_log_omap_iterator_age": "5.000000", 2024-09-13T06:39:25.212 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_log_op_age": "5.000000", 2024-09-13T06:39:25.212 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_max_alloc_size": "0", 2024-09-13T06:39:25.212 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_max_blob_size": "0", 2024-09-13T06:39:25.212 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_max_blob_size_hdd": "65536", 2024-09-13T06:39:25.212 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_max_blob_size_ssd": "65536", 2024-09-13T06:39:25.212 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_max_defer_interval": "3.000000", 2024-09-13T06:39:25.212 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_max_deferred_txc": "32", 2024-09-13T06:39:25.213 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_min_alloc_size": "0", 2024-09-13T06:39:25.213 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_min_alloc_size_hdd": "4096", 2024-09-13T06:39:25.213 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_min_alloc_size_ssd": "4096", 2024-09-13T06:39:25.213 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_nid_prealloc": "1024", 2024-09-13T06:39:25.213 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_prefer_deferred_size": "0", 2024-09-13T06:39:25.213 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_prefer_deferred_size_hdd": "65536", 2024-09-13T06:39:25.213 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_prefer_deferred_size_ssd": "0", 2024-09-13T06:39:25.213 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_qfsck_on_mount": "true", 2024-09-13T06:39:25.213 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_retry_disk_reads": "3", 2024-09-13T06:39:25.213 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_rocksdb_cf": "true", 2024-09-13T06:39:25.213 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_rocksdb_cfs": "m(3) p(3,0-12) O(3,0-13)=block_cache={type=binned_lru} L=min_write_buffer_number_to_merge=32 P=min_write_buffer_number_to_merge=32", 2024-09-13T06:39:25.213 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_rocksdb_options": "compression=kLZ4Compression,max_write_buffer_number=64,min_write_buffer_number_to_merge=6,compaction_style=kCompactionStyleLevel,write_buffer_size=16777216,max_background_jobs=4,level0_file_num_compaction_trigger=8,max_bytes_for_level_base=1073741824,max_bytes_for_level_multiplier=8,compaction_readahead_size=2MB,max_total_wal_size=1073741824,writable_file_max_buffer_size=0", 2024-09-13T06:39:25.214 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_rocksdb_options_annex": "", 2024-09-13T06:39:25.214 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_spdk_coremask": "0x1", 2024-09-13T06:39:25.214 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_spdk_io_sleep": "5", 2024-09-13T06:39:25.214 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_spdk_max_io_completion": "0", 2024-09-13T06:39:25.214 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_spdk_mem": "512", 2024-09-13T06:39:25.214 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_sync_submit_transaction": "false", 2024-09-13T06:39:25.214 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_throttle_bytes": "67108864", 2024-09-13T06:39:25.214 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_throttle_cost_per_io": "0", 2024-09-13T06:39:25.214 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_throttle_cost_per_io_hdd": "670000", 2024-09-13T06:39:25.214 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_throttle_cost_per_io_ssd": "4000", 2024-09-13T06:39:25.214 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_throttle_deferred_bytes": "134217728", 2024-09-13T06:39:25.214 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_throttle_trace_rate": "0.000000", 2024-09-13T06:39:25.215 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_tracing": "false", 2024-09-13T06:39:25.215 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_use_optimal_io_size_for_min_alloc_size": "false", 2024-09-13T06:39:25.215 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_volume_selection_policy": "use_some_extra", 2024-09-13T06:39:25.215 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_volume_selection_reserved": "0", 2024-09-13T06:39:25.215 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_volume_selection_reserved_factor": "2.000000", 2024-09-13T06:39:25.215 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_warn_on_bluefs_spillover": "true", 2024-09-13T06:39:25.215 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_warn_on_legacy_statfs": "true", 2024-09-13T06:39:25.215 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_warn_on_no_per_pg_omap": "false", 2024-09-13T06:39:25.215 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_warn_on_no_per_pool_omap": "true", 2024-09-13T06:39:25.215 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_warn_on_spurious_read_errors": "true", 2024-09-13T06:39:25.215 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_zero_block_detection": "false", 2024-09-13T06:39:25.215 INFO:teuthology.orchestra.run.smithi081.stdout: "cephadm_path": "/usr/sbin/cephadm", 2024-09-13T06:39:25.215 INFO:teuthology.orchestra.run.smithi081.stdout: "cephfs_mirror_action_update_interval": "2", 2024-09-13T06:39:25.216 INFO:teuthology.orchestra.run.smithi081.stdout: "cephfs_mirror_directory_scan_interval": "10", 2024-09-13T06:39:25.216 INFO:teuthology.orchestra.run.smithi081.stdout: "cephfs_mirror_max_concurrent_directory_syncs": "3", 2024-09-13T06:39:25.216 INFO:teuthology.orchestra.run.smithi081.stdout: "cephfs_mirror_max_consecutive_failures_per_directory": "10", 2024-09-13T06:39:25.216 INFO:teuthology.orchestra.run.smithi081.stdout: "cephfs_mirror_max_snapshot_sync_per_cycle": "3", 2024-09-13T06:39:25.216 INFO:teuthology.orchestra.run.smithi081.stdout: "cephfs_mirror_mount_timeout": "10", 2024-09-13T06:39:25.216 INFO:teuthology.orchestra.run.smithi081.stdout: "cephfs_mirror_perf_stats_prio": "5", 2024-09-13T06:39:25.216 INFO:teuthology.orchestra.run.smithi081.stdout: "cephfs_mirror_restart_mirror_on_blocklist_interval": "30", 2024-09-13T06:39:25.216 INFO:teuthology.orchestra.run.smithi081.stdout: "cephfs_mirror_restart_mirror_on_failure_interval": "20", 2024-09-13T06:39:25.216 INFO:teuthology.orchestra.run.smithi081.stdout: "cephfs_mirror_retry_failed_directories_interval": "60", 2024-09-13T06:39:25.216 INFO:teuthology.orchestra.run.smithi081.stdout: "cephsqlite_blocklist_dead_locker": "true", 2024-09-13T06:39:25.216 INFO:teuthology.orchestra.run.smithi081.stdout: "cephsqlite_lock_renewal_interval": "2000", 2024-09-13T06:39:25.216 INFO:teuthology.orchestra.run.smithi081.stdout: "cephsqlite_lock_renewal_timeout": "30000", 2024-09-13T06:39:25.216 INFO:teuthology.orchestra.run.smithi081.stdout: "cephx_cluster_require_signatures": "false", 2024-09-13T06:39:25.217 INFO:teuthology.orchestra.run.smithi081.stdout: "cephx_cluster_require_version": "2", 2024-09-13T06:39:25.217 INFO:teuthology.orchestra.run.smithi081.stdout: "cephx_require_signatures": "false", 2024-09-13T06:39:25.217 INFO:teuthology.orchestra.run.smithi081.stdout: "cephx_require_version": "2", 2024-09-13T06:39:25.217 INFO:teuthology.orchestra.run.smithi081.stdout: "cephx_service_require_signatures": "false", 2024-09-13T06:39:25.217 INFO:teuthology.orchestra.run.smithi081.stdout: "cephx_service_require_version": "2", 2024-09-13T06:39:25.217 INFO:teuthology.orchestra.run.smithi081.stdout: "cephx_sign_messages": "true", 2024-09-13T06:39:25.217 INFO:teuthology.orchestra.run.smithi081.stdout: "chdir": "", 2024-09-13T06:39:25.217 INFO:teuthology.orchestra.run.smithi081.stdout: "client_acl_type": "", 2024-09-13T06:39:25.217 INFO:teuthology.orchestra.run.smithi081.stdout: "client_asio_thread_count": "2", 2024-09-13T06:39:25.217 INFO:teuthology.orchestra.run.smithi081.stdout: "client_cache_mid": "0.750000", 2024-09-13T06:39:25.218 INFO:teuthology.orchestra.run.smithi081.stdout: "client_cache_size": "16384", 2024-09-13T06:39:25.218 INFO:teuthology.orchestra.run.smithi081.stdout: "client_caps_release_delay": "5", 2024-09-13T06:39:25.218 INFO:teuthology.orchestra.run.smithi081.stdout: "client_check_pool_perm": "true", 2024-09-13T06:39:25.218 INFO:teuthology.orchestra.run.smithi081.stdout: "client_collect_and_send_global_metrics": "false", 2024-09-13T06:39:25.218 INFO:teuthology.orchestra.run.smithi081.stdout: "client_debug_force_sync_read": "false", 2024-09-13T06:39:25.218 INFO:teuthology.orchestra.run.smithi081.stdout: "client_debug_getattr_caps": "false", 2024-09-13T06:39:25.218 INFO:teuthology.orchestra.run.smithi081.stdout: "client_debug_inject_features": "", 2024-09-13T06:39:25.218 INFO:teuthology.orchestra.run.smithi081.stdout: "client_debug_inject_tick_delay": "0", 2024-09-13T06:39:25.218 INFO:teuthology.orchestra.run.smithi081.stdout: "client_die_on_failed_dentry_invalidate": "true", 2024-09-13T06:39:25.218 INFO:teuthology.orchestra.run.smithi081.stdout: "client_die_on_failed_remount": "false", 2024-09-13T06:39:25.218 INFO:teuthology.orchestra.run.smithi081.stdout: "client_dirsize_rbytes": "true", 2024-09-13T06:39:25.218 INFO:teuthology.orchestra.run.smithi081.stdout: "client_force_lazyio": "false", 2024-09-13T06:39:25.219 INFO:teuthology.orchestra.run.smithi081.stdout: "client_fs": "", 2024-09-13T06:39:25.219 INFO:teuthology.orchestra.run.smithi081.stdout: "client_inject_fixed_oldest_tid": "false", 2024-09-13T06:39:25.219 INFO:teuthology.orchestra.run.smithi081.stdout: "client_inject_release_failure": "false", 2024-09-13T06:39:25.219 INFO:teuthology.orchestra.run.smithi081.stdout: "client_max_inline_size": "4096", 2024-09-13T06:39:25.219 INFO:teuthology.orchestra.run.smithi081.stdout: "client_max_retries_on_remount_failure": "5", 2024-09-13T06:39:25.219 INFO:teuthology.orchestra.run.smithi081.stdout: "client_mds_namespace": "", 2024-09-13T06:39:25.219 INFO:teuthology.orchestra.run.smithi081.stdout: "client_metadata": "", 2024-09-13T06:39:25.219 INFO:teuthology.orchestra.run.smithi081.stdout: "client_mount_gid": "-1", 2024-09-13T06:39:25.220 INFO:teuthology.orchestra.run.smithi081.stdout: "client_mount_timeout": "300", 2024-09-13T06:39:25.220 INFO:teuthology.orchestra.run.smithi081.stdout: "client_mount_uid": "-1", 2024-09-13T06:39:25.220 INFO:teuthology.orchestra.run.smithi081.stdout: "client_mountpoint": "/", 2024-09-13T06:39:25.220 INFO:teuthology.orchestra.run.smithi081.stdout: "client_notify_timeout": "10", 2024-09-13T06:39:25.220 INFO:teuthology.orchestra.run.smithi081.stdout: "client_oc": "true", 2024-09-13T06:39:25.220 INFO:teuthology.orchestra.run.smithi081.stdout: "client_oc_max_dirty": "104857600", 2024-09-13T06:39:25.220 INFO:teuthology.orchestra.run.smithi081.stdout: "client_oc_max_dirty_age": "5.000000", 2024-09-13T06:39:25.220 INFO:teuthology.orchestra.run.smithi081.stdout: "client_oc_max_objects": "1000", 2024-09-13T06:39:25.220 INFO:teuthology.orchestra.run.smithi081.stdout: "client_oc_size": "209715200", 2024-09-13T06:39:25.220 INFO:teuthology.orchestra.run.smithi081.stdout: "client_oc_target_dirty": "8388608", 2024-09-13T06:39:25.220 INFO:teuthology.orchestra.run.smithi081.stdout: "client_permissions": "true", 2024-09-13T06:39:25.220 INFO:teuthology.orchestra.run.smithi081.stdout: "client_quota": "true", 2024-09-13T06:39:25.220 INFO:teuthology.orchestra.run.smithi081.stdout: "client_quota_df": "true", 2024-09-13T06:39:25.221 INFO:teuthology.orchestra.run.smithi081.stdout: "client_readahead_max_bytes": "0", 2024-09-13T06:39:25.221 INFO:teuthology.orchestra.run.smithi081.stdout: "client_readahead_max_periods": "4", 2024-09-13T06:39:25.221 INFO:teuthology.orchestra.run.smithi081.stdout: "client_readahead_min": "131072", 2024-09-13T06:39:25.221 INFO:teuthology.orchestra.run.smithi081.stdout: "client_reconnect_stale": "false", 2024-09-13T06:39:25.221 INFO:teuthology.orchestra.run.smithi081.stdout: "client_shutdown_timeout": "30", 2024-09-13T06:39:25.221 INFO:teuthology.orchestra.run.smithi081.stdout: "client_snapdir": ".snap", 2024-09-13T06:39:25.221 INFO:teuthology.orchestra.run.smithi081.stdout: "client_tick_interval": "1", 2024-09-13T06:39:25.221 INFO:teuthology.orchestra.run.smithi081.stdout: "client_trace": "", 2024-09-13T06:39:25.221 INFO:teuthology.orchestra.run.smithi081.stdout: "client_try_dentry_invalidate": "false", 2024-09-13T06:39:25.221 INFO:teuthology.orchestra.run.smithi081.stdout: "client_use_faked_inos": "false", 2024-09-13T06:39:25.221 INFO:teuthology.orchestra.run.smithi081.stdout: "client_use_random_mds": "false", 2024-09-13T06:39:25.221 INFO:teuthology.orchestra.run.smithi081.stdout: "clog_to_graylog": "false", 2024-09-13T06:39:25.222 INFO:teuthology.orchestra.run.smithi081.stdout: "clog_to_graylog_host": "127.0.0.1", 2024-09-13T06:39:25.222 INFO:teuthology.orchestra.run.smithi081.stdout: "clog_to_graylog_port": "12201", 2024-09-13T06:39:25.222 INFO:teuthology.orchestra.run.smithi081.stdout: "clog_to_monitors": "default=true", 2024-09-13T06:39:25.222 INFO:teuthology.orchestra.run.smithi081.stdout: "clog_to_syslog": "false", 2024-09-13T06:39:25.222 INFO:teuthology.orchestra.run.smithi081.stdout: "clog_to_syslog_facility": "default=daemon audit=local0", 2024-09-13T06:39:25.222 INFO:teuthology.orchestra.run.smithi081.stdout: "clog_to_syslog_level": "info", 2024-09-13T06:39:25.222 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "-", 2024-09-13T06:39:25.222 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_network": "", 2024-09-13T06:39:25.222 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_network_interface": "", 2024-09-13T06:39:25.222 INFO:teuthology.orchestra.run.smithi081.stdout: "compressor_zlib_isal": "false", 2024-09-13T06:39:25.222 INFO:teuthology.orchestra.run.smithi081.stdout: "compressor_zlib_level": "5", 2024-09-13T06:39:25.223 INFO:teuthology.orchestra.run.smithi081.stdout: "compressor_zlib_winsize": "-15", 2024-09-13T06:39:25.223 INFO:teuthology.orchestra.run.smithi081.stdout: "compressor_zstd_level": "1", 2024-09-13T06:39:25.223 INFO:teuthology.orchestra.run.smithi081.stdout: "container_image": "docker.io/ceph/daemon-base:latest-master-devel", 2024-09-13T06:39:25.223 INFO:teuthology.orchestra.run.smithi081.stdout: "crash_dir": "/var/lib/ceph/crash", 2024-09-13T06:39:25.223 INFO:teuthology.orchestra.run.smithi081.stdout: "crimson_alien_op_num_threads": "6", 2024-09-13T06:39:25.223 INFO:teuthology.orchestra.run.smithi081.stdout: "crimson_alien_thread_cpu_cores": "", 2024-09-13T06:39:25.223 INFO:teuthology.orchestra.run.smithi081.stdout: "crimson_osd_obc_lru_size": "10", 2024-09-13T06:39:25.223 INFO:teuthology.orchestra.run.smithi081.stdout: "crimson_osd_scheduler_concurrency": "0", 2024-09-13T06:39:25.223 INFO:teuthology.orchestra.run.smithi081.stdout: "crimson_seastar_smp": "1", 2024-09-13T06:39:25.223 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "", 2024-09-13T06:39:25.223 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location_hook": "", 2024-09-13T06:39:25.224 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location_hook_timeout": "10", 2024-09-13T06:39:25.224 INFO:teuthology.orchestra.run.smithi081.stdout: "daemonize": "false", 2024-09-13T06:39:25.224 INFO:teuthology.orchestra.run.smithi081.stdout: "daos_pool": "tank", 2024-09-13T06:39:25.224 INFO:teuthology.orchestra.run.smithi081.stdout: "dbstore_config_uri": "file:/var/lib/ceph/radosgw/dbstore-config.db", 2024-09-13T06:39:25.224 INFO:teuthology.orchestra.run.smithi081.stdout: "dbstore_db_dir": "/var/lib/ceph/radosgw", 2024-09-13T06:39:25.224 INFO:teuthology.orchestra.run.smithi081.stdout: "dbstore_db_name_prefix": "dbstore", 2024-09-13T06:39:25.224 INFO:teuthology.orchestra.run.smithi081.stdout: "debug_alienstore": "0/5", 2024-09-13T06:39:25.224 INFO:teuthology.orchestra.run.smithi081.stdout: "debug_allow_any_pool_priority": "false", 2024-09-13T06:39:25.224 INFO:teuthology.orchestra.run.smithi081.stdout: "debug_asok": "1/5", 2024-09-13T06:39:25.224 INFO:teuthology.orchestra.run.smithi081.stdout: "debug_asok_assert_abort": "false", 2024-09-13T06:39:25.224 INFO:teuthology.orchestra.run.smithi081.stdout: "debug_asserts_on_shutdown": "true", 2024-09-13T06:39:25.224 INFO:teuthology.orchestra.run.smithi081.stdout: "debug_auth": "20/20", 2024-09-13T06:39:25.224 INFO:teuthology.orchestra.run.smithi081.stdout: "debug_bdev": "1/3", 2024-09-13T06:39:25.225 INFO:teuthology.orchestra.run.smithi081.stdout: "debug_bluefs": "1/5", 2024-09-13T06:39:25.225 INFO:teuthology.orchestra.run.smithi081.stdout: "debug_bluestore": "1/5", 2024-09-13T06:39:25.225 INFO:teuthology.orchestra.run.smithi081.stdout: "debug_buffer": "0/1", 2024-09-13T06:39:25.225 INFO:teuthology.orchestra.run.smithi081.stdout: "debug_ceph_exporter": "1/5", 2024-09-13T06:39:25.225 INFO:teuthology.orchestra.run.smithi081.stdout: "debug_cephfs_mirror": "0/5", 2024-09-13T06:39:25.225 INFO:teuthology.orchestra.run.smithi081.stdout: "debug_cephsqlite": "0/5", 2024-09-13T06:39:25.225 INFO:teuthology.orchestra.run.smithi081.stdout: "debug_client": "0/5", 2024-09-13T06:39:25.225 INFO:teuthology.orchestra.run.smithi081.stdout: "debug_compressor": "1/5", 2024-09-13T06:39:25.225 INFO:teuthology.orchestra.run.smithi081.stdout: "debug_context": "0/1", 2024-09-13T06:39:25.225 INFO:teuthology.orchestra.run.smithi081.stdout: "debug_crush": "1/1", 2024-09-13T06:39:25.225 INFO:teuthology.orchestra.run.smithi081.stdout: "debug_crypto": "1/5", 2024-09-13T06:39:25.225 INFO:teuthology.orchestra.run.smithi081.stdout: "debug_cyanstore": "0/5", 2024-09-13T06:39:25.225 INFO:teuthology.orchestra.run.smithi081.stdout: "debug_deliberately_leak_memory": "false", 2024-09-13T06:39:25.226 INFO:teuthology.orchestra.run.smithi081.stdout: "debug_disable_randomized_ping": "false", 2024-09-13T06:39:25.226 INFO:teuthology.orchestra.run.smithi081.stdout: "debug_dpdk": "1/5", 2024-09-13T06:39:25.226 INFO:teuthology.orchestra.run.smithi081.stdout: "debug_eventtrace": "1/5", 2024-09-13T06:39:25.226 INFO:teuthology.orchestra.run.smithi081.stdout: "debug_filer": "0/1", 2024-09-13T06:39:25.226 INFO:teuthology.orchestra.run.smithi081.stdout: "debug_filestore": "1/3", 2024-09-13T06:39:25.226 INFO:teuthology.orchestra.run.smithi081.stdout: "debug_finisher": "1/1", 2024-09-13T06:39:25.226 INFO:teuthology.orchestra.run.smithi081.stdout: "debug_fuse": "1/5", 2024-09-13T06:39:25.226 INFO:teuthology.orchestra.run.smithi081.stdout: "debug_heartbeat_testing_span": "0", 2024-09-13T06:39:25.226 INFO:teuthology.orchestra.run.smithi081.stdout: "debug_heartbeatmap": "1/5", 2024-09-13T06:39:25.226 INFO:teuthology.orchestra.run.smithi081.stdout: "debug_immutable_obj_cache": "0/5", 2024-09-13T06:39:25.226 INFO:teuthology.orchestra.run.smithi081.stdout: "debug_javaclient": "1/5", 2024-09-13T06:39:25.226 INFO:teuthology.orchestra.run.smithi081.stdout: "debug_journal": "1/3", 2024-09-13T06:39:25.227 INFO:teuthology.orchestra.run.smithi081.stdout: "debug_journaler": "0/5", 2024-09-13T06:39:25.227 INFO:teuthology.orchestra.run.smithi081.stdout: "debug_kstore": "1/5", 2024-09-13T06:39:25.227 INFO:teuthology.orchestra.run.smithi081.stdout: "debug_leveldb": "4/5", 2024-09-13T06:39:25.227 INFO:teuthology.orchestra.run.smithi081.stdout: "debug_lockdep": "0/1", 2024-09-13T06:39:25.227 INFO:teuthology.orchestra.run.smithi081.stdout: "debug_mclock": "1/5", 2024-09-13T06:39:25.227 INFO:teuthology.orchestra.run.smithi081.stdout: "debug_mds": "1/5", 2024-09-13T06:39:25.227 INFO:teuthology.orchestra.run.smithi081.stdout: "debug_mds_balancer": "1/5", 2024-09-13T06:39:25.227 INFO:teuthology.orchestra.run.smithi081.stdout: "debug_mds_locker": "1/5", 2024-09-13T06:39:25.227 INFO:teuthology.orchestra.run.smithi081.stdout: "debug_mds_log": "1/5", 2024-09-13T06:39:25.227 INFO:teuthology.orchestra.run.smithi081.stdout: "debug_mds_log_expire": "1/5", 2024-09-13T06:39:25.227 INFO:teuthology.orchestra.run.smithi081.stdout: "debug_mds_migrator": "1/5", 2024-09-13T06:39:25.227 INFO:teuthology.orchestra.run.smithi081.stdout: "debug_memstore": "1/5", 2024-09-13T06:39:25.227 INFO:teuthology.orchestra.run.smithi081.stdout: "debug_mgr": "2/5", 2024-09-13T06:39:25.227 INFO:teuthology.orchestra.run.smithi081.stdout: "debug_mgrc": "1/5", 2024-09-13T06:39:25.228 INFO:teuthology.orchestra.run.smithi081.stdout: "debug_mon": "20/20", 2024-09-13T06:39:25.228 INFO:teuthology.orchestra.run.smithi081.stdout: "debug_monc": "0/10", 2024-09-13T06:39:25.228 INFO:teuthology.orchestra.run.smithi081.stdout: "debug_ms": "1/1", 2024-09-13T06:39:25.228 INFO:teuthology.orchestra.run.smithi081.stdout: "debug_none": "0/5", 2024-09-13T06:39:25.228 INFO:teuthology.orchestra.run.smithi081.stdout: "debug_objclass": "0/5", 2024-09-13T06:39:25.228 INFO:teuthology.orchestra.run.smithi081.stdout: "debug_objectcacher": "0/5", 2024-09-13T06:39:25.228 INFO:teuthology.orchestra.run.smithi081.stdout: "debug_objecter": "0/1", 2024-09-13T06:39:25.228 INFO:teuthology.orchestra.run.smithi081.stdout: "debug_optracker": "0/5", 2024-09-13T06:39:25.228 INFO:teuthology.orchestra.run.smithi081.stdout: "debug_osd": "1/5", 2024-09-13T06:39:25.228 INFO:teuthology.orchestra.run.smithi081.stdout: "debug_paxos": "20/20", 2024-09-13T06:39:25.228 INFO:teuthology.orchestra.run.smithi081.stdout: "debug_perfcounter": "1/5", 2024-09-13T06:39:25.228 INFO:teuthology.orchestra.run.smithi081.stdout: "debug_prioritycache": "1/5", 2024-09-13T06:39:25.228 INFO:teuthology.orchestra.run.smithi081.stdout: "debug_rados": "0/5", 2024-09-13T06:39:25.229 INFO:teuthology.orchestra.run.smithi081.stdout: "debug_rbd": "0/5", 2024-09-13T06:39:25.229 INFO:teuthology.orchestra.run.smithi081.stdout: "debug_rbd_mirror": "0/5", 2024-09-13T06:39:25.229 INFO:teuthology.orchestra.run.smithi081.stdout: "debug_rbd_pwl": "0/5", 2024-09-13T06:39:25.229 INFO:teuthology.orchestra.run.smithi081.stdout: "debug_rbd_replay": "0/5", 2024-09-13T06:39:25.229 INFO:teuthology.orchestra.run.smithi081.stdout: "debug_refs": "0/0", 2024-09-13T06:39:25.229 INFO:teuthology.orchestra.run.smithi081.stdout: "debug_reserver": "1/1", 2024-09-13T06:39:25.229 INFO:teuthology.orchestra.run.smithi081.stdout: "debug_rgw": "1/5", 2024-09-13T06:39:25.229 INFO:teuthology.orchestra.run.smithi081.stdout: "debug_rgw_access": "1/5", 2024-09-13T06:39:25.229 INFO:teuthology.orchestra.run.smithi081.stdout: "debug_rgw_datacache": "1/5", 2024-09-13T06:39:25.229 INFO:teuthology.orchestra.run.smithi081.stdout: "debug_rgw_dbstore": "1/5", 2024-09-13T06:39:25.229 INFO:teuthology.orchestra.run.smithi081.stdout: "debug_rgw_flight": "1/5", 2024-09-13T06:39:25.229 INFO:teuthology.orchestra.run.smithi081.stdout: "debug_rgw_sync": "1/5", 2024-09-13T06:39:25.230 INFO:teuthology.orchestra.run.smithi081.stdout: "debug_rocksdb": "4/5", 2024-09-13T06:39:25.230 INFO:teuthology.orchestra.run.smithi081.stdout: "debug_seastore": "0/5", 2024-09-13T06:39:25.230 INFO:teuthology.orchestra.run.smithi081.stdout: "debug_seastore_backref": "0/5", 2024-09-13T06:39:25.230 INFO:teuthology.orchestra.run.smithi081.stdout: "debug_seastore_cache": "0/5", 2024-09-13T06:39:25.230 INFO:teuthology.orchestra.run.smithi081.stdout: "debug_seastore_cleaner": "0/5", 2024-09-13T06:39:25.230 INFO:teuthology.orchestra.run.smithi081.stdout: "debug_seastore_device": "0/5", 2024-09-13T06:39:25.230 INFO:teuthology.orchestra.run.smithi081.stdout: "debug_seastore_epm": "0/5", 2024-09-13T06:39:25.230 INFO:teuthology.orchestra.run.smithi081.stdout: "debug_seastore_fixedkv_tree": "0/5", 2024-09-13T06:39:25.230 INFO:teuthology.orchestra.run.smithi081.stdout: "debug_seastore_journal": "0/5", 2024-09-13T06:39:25.230 INFO:teuthology.orchestra.run.smithi081.stdout: "debug_seastore_lba": "0/5", 2024-09-13T06:39:25.230 INFO:teuthology.orchestra.run.smithi081.stdout: "debug_seastore_odata": "0/5", 2024-09-13T06:39:25.230 INFO:teuthology.orchestra.run.smithi081.stdout: "debug_seastore_omap": "0/5", 2024-09-13T06:39:25.230 INFO:teuthology.orchestra.run.smithi081.stdout: "debug_seastore_onode": "0/5", 2024-09-13T06:39:25.230 INFO:teuthology.orchestra.run.smithi081.stdout: "debug_seastore_t": "0/5", 2024-09-13T06:39:25.231 INFO:teuthology.orchestra.run.smithi081.stdout: "debug_seastore_tm": "0/5", 2024-09-13T06:39:25.231 INFO:teuthology.orchestra.run.smithi081.stdout: "debug_striper": "0/1", 2024-09-13T06:39:25.231 INFO:teuthology.orchestra.run.smithi081.stdout: "debug_test": "0/5", 2024-09-13T06:39:25.231 INFO:teuthology.orchestra.run.smithi081.stdout: "debug_throttle": "1/1", 2024-09-13T06:39:25.231 INFO:teuthology.orchestra.run.smithi081.stdout: "debug_timer": "0/1", 2024-09-13T06:39:25.231 INFO:teuthology.orchestra.run.smithi081.stdout: "debug_tp": "0/5", 2024-09-13T06:39:25.231 INFO:teuthology.orchestra.run.smithi081.stdout: "defer_client_eviction_on_laggy_osds": "false", 2024-09-13T06:39:25.231 INFO:teuthology.orchestra.run.smithi081.stdout: "device_failure_prediction_mode": "none", 2024-09-13T06:39:25.231 INFO:teuthology.orchestra.run.smithi081.stdout: "enable_experimental_unrecoverable_data_corrupting_features": "", 2024-09-13T06:39:25.231 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_dir": "/usr/lib/ceph/erasure-code", 2024-09-13T06:39:25.231 INFO:teuthology.orchestra.run.smithi081.stdout: "err_to_graylog": "false", 2024-09-13T06:39:25.232 INFO:teuthology.orchestra.run.smithi081.stdout: "err_to_journald": "false", 2024-09-13T06:39:25.232 INFO:teuthology.orchestra.run.smithi081.stdout: "err_to_stderr": "true", 2024-09-13T06:39:25.232 INFO:teuthology.orchestra.run.smithi081.stdout: "err_to_syslog": "false", 2024-09-13T06:39:25.232 INFO:teuthology.orchestra.run.smithi081.stdout: "event_tracing": "false", 2024-09-13T06:39:25.232 INFO:teuthology.orchestra.run.smithi081.stdout: "exporter_addr": "0.0.0.0", 2024-09-13T06:39:25.232 INFO:teuthology.orchestra.run.smithi081.stdout: "exporter_http_port": "9926", 2024-09-13T06:39:25.232 INFO:teuthology.orchestra.run.smithi081.stdout: "exporter_prio_limit": "5", 2024-09-13T06:39:25.232 INFO:teuthology.orchestra.run.smithi081.stdout: "exporter_sock_dir": "/var/run/ceph/", 2024-09-13T06:39:25.232 INFO:teuthology.orchestra.run.smithi081.stdout: "exporter_sort_metrics": "true", 2024-09-13T06:39:25.232 INFO:teuthology.orchestra.run.smithi081.stdout: "exporter_stats_period": "5", 2024-09-13T06:39:25.232 INFO:teuthology.orchestra.run.smithi081.stdout: "fake_statfs_for_testing": "0", 2024-09-13T06:39:25.232 INFO:teuthology.orchestra.run.smithi081.stdout: "fatal_signal_handlers": "true", 2024-09-13T06:39:25.233 INFO:teuthology.orchestra.run.smithi081.stdout: "filer_max_purge_ops": "10", 2024-09-13T06:39:25.233 INFO:teuthology.orchestra.run.smithi081.stdout: "filer_max_truncate_ops": "128", 2024-09-13T06:39:25.233 INFO:teuthology.orchestra.run.smithi081.stdout: "filestore_apply_finisher_threads": "1", 2024-09-13T06:39:25.233 INFO:teuthology.orchestra.run.smithi081.stdout: "filestore_blackhole": "false", 2024-09-13T06:39:25.233 INFO:teuthology.orchestra.run.smithi081.stdout: "filestore_btrfs_clone_range": "true", 2024-09-13T06:39:25.233 INFO:teuthology.orchestra.run.smithi081.stdout: "filestore_btrfs_snap": "true", 2024-09-13T06:39:25.233 INFO:teuthology.orchestra.run.smithi081.stdout: "filestore_caller_concurrency": "10", 2024-09-13T06:39:25.233 INFO:teuthology.orchestra.run.smithi081.stdout: "filestore_collect_device_partition_information": "true", 2024-09-13T06:39:25.233 INFO:teuthology.orchestra.run.smithi081.stdout: "filestore_commit_timeout": "600.000000", 2024-09-13T06:39:25.233 INFO:teuthology.orchestra.run.smithi081.stdout: "filestore_debug_inject_read_err": "false", 2024-09-13T06:39:25.233 INFO:teuthology.orchestra.run.smithi081.stdout: "filestore_debug_omap_check": "false", 2024-09-13T06:39:25.233 INFO:teuthology.orchestra.run.smithi081.stdout: "filestore_debug_random_read_err": "0.000000", 2024-09-13T06:39:25.233 INFO:teuthology.orchestra.run.smithi081.stdout: "filestore_debug_verify_split": "false", 2024-09-13T06:39:25.234 INFO:teuthology.orchestra.run.smithi081.stdout: "filestore_dump_file": "", 2024-09-13T06:39:25.234 INFO:teuthology.orchestra.run.smithi081.stdout: "filestore_expected_throughput_bytes": "209715200.000000", 2024-09-13T06:39:25.234 INFO:teuthology.orchestra.run.smithi081.stdout: "filestore_expected_throughput_ops": "200.000000", 2024-09-13T06:39:25.234 INFO:teuthology.orchestra.run.smithi081.stdout: "filestore_fadvise": "true", 2024-09-13T06:39:25.234 INFO:teuthology.orchestra.run.smithi081.stdout: "filestore_fail_eio": "true", 2024-09-13T06:39:25.234 INFO:teuthology.orchestra.run.smithi081.stdout: "filestore_fd_cache_shards": "16", 2024-09-13T06:39:25.234 INFO:teuthology.orchestra.run.smithi081.stdout: "filestore_fd_cache_size": "128", 2024-09-13T06:39:25.234 INFO:teuthology.orchestra.run.smithi081.stdout: "filestore_fiemap": "false", 2024-09-13T06:39:25.234 INFO:teuthology.orchestra.run.smithi081.stdout: "filestore_fiemap_threshold": "4096", 2024-09-13T06:39:25.234 INFO:teuthology.orchestra.run.smithi081.stdout: "filestore_fsync_flushes_journal_data": "false", 2024-09-13T06:39:25.234 INFO:teuthology.orchestra.run.smithi081.stdout: "filestore_index_retry_probability": "0.000000", 2024-09-13T06:39:25.234 INFO:teuthology.orchestra.run.smithi081.stdout: "filestore_inject_stall": "0", 2024-09-13T06:39:25.235 INFO:teuthology.orchestra.run.smithi081.stdout: "filestore_journal_parallel": "false", 2024-09-13T06:39:25.235 INFO:teuthology.orchestra.run.smithi081.stdout: "filestore_journal_trailing": "false", 2024-09-13T06:39:25.235 INFO:teuthology.orchestra.run.smithi081.stdout: "filestore_journal_writeahead": "false", 2024-09-13T06:39:25.235 INFO:teuthology.orchestra.run.smithi081.stdout: "filestore_kill_at": "0", 2024-09-13T06:39:25.235 INFO:teuthology.orchestra.run.smithi081.stdout: "filestore_max_alloc_hint_size": "1048576", 2024-09-13T06:39:25.235 INFO:teuthology.orchestra.run.smithi081.stdout: "filestore_max_inline_xattr_size": "0", 2024-09-13T06:39:25.235 INFO:teuthology.orchestra.run.smithi081.stdout: "filestore_max_inline_xattr_size_btrfs": "2048", 2024-09-13T06:39:25.235 INFO:teuthology.orchestra.run.smithi081.stdout: "filestore_max_inline_xattr_size_other": "512", 2024-09-13T06:39:25.235 INFO:teuthology.orchestra.run.smithi081.stdout: "filestore_max_inline_xattr_size_xfs": "65536", 2024-09-13T06:39:25.235 INFO:teuthology.orchestra.run.smithi081.stdout: "filestore_max_inline_xattrs": "0", 2024-09-13T06:39:25.235 INFO:teuthology.orchestra.run.smithi081.stdout: "filestore_max_inline_xattrs_btrfs": "10", 2024-09-13T06:39:25.235 INFO:teuthology.orchestra.run.smithi081.stdout: "filestore_max_inline_xattrs_other": "2", 2024-09-13T06:39:25.235 INFO:teuthology.orchestra.run.smithi081.stdout: "filestore_max_inline_xattrs_xfs": "10", 2024-09-13T06:39:25.235 INFO:teuthology.orchestra.run.smithi081.stdout: "filestore_max_sync_interval": "5.000000", 2024-09-13T06:39:25.236 INFO:teuthology.orchestra.run.smithi081.stdout: "filestore_max_xattr_value_size": "0", 2024-09-13T06:39:25.236 INFO:teuthology.orchestra.run.smithi081.stdout: "filestore_max_xattr_value_size_btrfs": "65536", 2024-09-13T06:39:25.236 INFO:teuthology.orchestra.run.smithi081.stdout: "filestore_max_xattr_value_size_other": "1024", 2024-09-13T06:39:25.236 INFO:teuthology.orchestra.run.smithi081.stdout: "filestore_max_xattr_value_size_xfs": "65536", 2024-09-13T06:39:25.236 INFO:teuthology.orchestra.run.smithi081.stdout: "filestore_merge_threshold": "-10", 2024-09-13T06:39:25.236 INFO:teuthology.orchestra.run.smithi081.stdout: "filestore_min_sync_interval": "0.010000", 2024-09-13T06:39:25.236 INFO:teuthology.orchestra.run.smithi081.stdout: "filestore_odsync_write": "false", 2024-09-13T06:39:25.236 INFO:teuthology.orchestra.run.smithi081.stdout: "filestore_omap_backend": "rocksdb", 2024-09-13T06:39:25.236 INFO:teuthology.orchestra.run.smithi081.stdout: "filestore_omap_backend_path": "", 2024-09-13T06:39:25.236 INFO:teuthology.orchestra.run.smithi081.stdout: "filestore_omap_header_cache_size": "1024", 2024-09-13T06:39:25.236 INFO:teuthology.orchestra.run.smithi081.stdout: "filestore_ondisk_finisher_threads": "1", 2024-09-13T06:39:25.236 INFO:teuthology.orchestra.run.smithi081.stdout: "filestore_op_thread_suicide_timeout": "180", 2024-09-13T06:39:25.237 INFO:teuthology.orchestra.run.smithi081.stdout: "filestore_op_thread_timeout": "60", 2024-09-13T06:39:25.237 INFO:teuthology.orchestra.run.smithi081.stdout: "filestore_op_threads": "2", 2024-09-13T06:39:25.237 INFO:teuthology.orchestra.run.smithi081.stdout: "filestore_punch_hole": "false", 2024-09-13T06:39:25.237 INFO:teuthology.orchestra.run.smithi081.stdout: "filestore_queue_high_delay_multiple": "0.000000", 2024-09-13T06:39:25.237 INFO:teuthology.orchestra.run.smithi081.stdout: "filestore_queue_high_delay_multiple_bytes": "0.000000", 2024-09-13T06:39:25.237 INFO:teuthology.orchestra.run.smithi081.stdout: "filestore_queue_high_delay_multiple_ops": "0.000000", 2024-09-13T06:39:25.237 INFO:teuthology.orchestra.run.smithi081.stdout: "filestore_queue_high_threshhold": "0.900000", 2024-09-13T06:39:25.237 INFO:teuthology.orchestra.run.smithi081.stdout: "filestore_queue_low_threshhold": "0.300000", 2024-09-13T06:39:25.237 INFO:teuthology.orchestra.run.smithi081.stdout: "filestore_queue_max_bytes": "104857600", 2024-09-13T06:39:25.237 INFO:teuthology.orchestra.run.smithi081.stdout: "filestore_queue_max_delay_multiple": "0.000000", 2024-09-13T06:39:25.237 INFO:teuthology.orchestra.run.smithi081.stdout: "filestore_queue_max_delay_multiple_bytes": "0.000000", 2024-09-13T06:39:25.237 INFO:teuthology.orchestra.run.smithi081.stdout: "filestore_queue_max_delay_multiple_ops": "0.000000", 2024-09-13T06:39:25.237 INFO:teuthology.orchestra.run.smithi081.stdout: "filestore_queue_max_ops": "50", 2024-09-13T06:39:25.238 INFO:teuthology.orchestra.run.smithi081.stdout: "filestore_rocksdb_options": "max_background_jobs=10,compaction_readahead_size=2097152,compression=kNoCompression", 2024-09-13T06:39:25.238 INFO:teuthology.orchestra.run.smithi081.stdout: "filestore_seek_data_hole": "false", 2024-09-13T06:39:25.238 INFO:teuthology.orchestra.run.smithi081.stdout: "filestore_sloppy_crc": "false", 2024-09-13T06:39:25.238 INFO:teuthology.orchestra.run.smithi081.stdout: "filestore_sloppy_crc_block_size": "65536", 2024-09-13T06:39:25.238 INFO:teuthology.orchestra.run.smithi081.stdout: "filestore_splice": "false", 2024-09-13T06:39:25.238 INFO:teuthology.orchestra.run.smithi081.stdout: "filestore_split_multiple": "2", 2024-09-13T06:39:25.238 INFO:teuthology.orchestra.run.smithi081.stdout: "filestore_split_rand_factor": "20", 2024-09-13T06:39:25.238 INFO:teuthology.orchestra.run.smithi081.stdout: "filestore_update_to": "1000", 2024-09-13T06:39:25.238 INFO:teuthology.orchestra.run.smithi081.stdout: "filestore_wbthrottle_btrfs_bytes_hard_limit": "419430400", 2024-09-13T06:39:25.238 INFO:teuthology.orchestra.run.smithi081.stdout: "filestore_wbthrottle_btrfs_bytes_start_flusher": "41943040", 2024-09-13T06:39:25.238 INFO:teuthology.orchestra.run.smithi081.stdout: "filestore_wbthrottle_btrfs_inodes_hard_limit": "5000", 2024-09-13T06:39:25.238 INFO:teuthology.orchestra.run.smithi081.stdout: "filestore_wbthrottle_btrfs_inodes_start_flusher": "500", 2024-09-13T06:39:25.238 INFO:teuthology.orchestra.run.smithi081.stdout: "filestore_wbthrottle_btrfs_ios_hard_limit": "5000", 2024-09-13T06:39:25.238 INFO:teuthology.orchestra.run.smithi081.stdout: "filestore_wbthrottle_btrfs_ios_start_flusher": "500", 2024-09-13T06:39:25.238 INFO:teuthology.orchestra.run.smithi081.stdout: "filestore_wbthrottle_enable": "true", 2024-09-13T06:39:25.239 INFO:teuthology.orchestra.run.smithi081.stdout: "filestore_wbthrottle_xfs_bytes_hard_limit": "419430400", 2024-09-13T06:39:25.239 INFO:teuthology.orchestra.run.smithi081.stdout: "filestore_wbthrottle_xfs_bytes_start_flusher": "41943040", 2024-09-13T06:39:25.239 INFO:teuthology.orchestra.run.smithi081.stdout: "filestore_wbthrottle_xfs_inodes_hard_limit": "5000", 2024-09-13T06:39:25.239 INFO:teuthology.orchestra.run.smithi081.stdout: "filestore_wbthrottle_xfs_inodes_start_flusher": "500", 2024-09-13T06:39:25.239 INFO:teuthology.orchestra.run.smithi081.stdout: "filestore_wbthrottle_xfs_ios_hard_limit": "5000", 2024-09-13T06:39:25.239 INFO:teuthology.orchestra.run.smithi081.stdout: "filestore_wbthrottle_xfs_ios_start_flusher": "500", 2024-09-13T06:39:25.239 INFO:teuthology.orchestra.run.smithi081.stdout: "filestore_xfs_extsize": "false", 2024-09-13T06:39:25.239 INFO:teuthology.orchestra.run.smithi081.stdout: "filestore_zfs_snap": "false", 2024-09-13T06:39:25.239 INFO:teuthology.orchestra.run.smithi081.stdout: "fio_dir": "/tmp/fio", 2024-09-13T06:39:25.239 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "e5612297-d004-4957-927e-afa37f30d6cf", 2024-09-13T06:39:25.239 INFO:teuthology.orchestra.run.smithi081.stdout: "fuse_allow_other": "true", 2024-09-13T06:39:25.239 INFO:teuthology.orchestra.run.smithi081.stdout: "fuse_atomic_o_trunc": "true", 2024-09-13T06:39:25.240 INFO:teuthology.orchestra.run.smithi081.stdout: "fuse_big_writes": "true", 2024-09-13T06:39:25.240 INFO:teuthology.orchestra.run.smithi081.stdout: "fuse_debug": "false", 2024-09-13T06:39:25.240 INFO:teuthology.orchestra.run.smithi081.stdout: "fuse_default_permissions": "false", 2024-09-13T06:39:25.240 INFO:teuthology.orchestra.run.smithi081.stdout: "fuse_disable_pagecache": "false", 2024-09-13T06:39:25.240 INFO:teuthology.orchestra.run.smithi081.stdout: "fuse_max_write": "0", 2024-09-13T06:39:25.240 INFO:teuthology.orchestra.run.smithi081.stdout: "fuse_multithreaded": "true", 2024-09-13T06:39:25.240 INFO:teuthology.orchestra.run.smithi081.stdout: "fuse_require_active_mds": "true", 2024-09-13T06:39:25.240 INFO:teuthology.orchestra.run.smithi081.stdout: "fuse_set_user_groups": "true", 2024-09-13T06:39:25.240 INFO:teuthology.orchestra.run.smithi081.stdout: "fuse_splice_move": "true", 2024-09-13T06:39:25.240 INFO:teuthology.orchestra.run.smithi081.stdout: "fuse_splice_read": "true", 2024-09-13T06:39:25.240 INFO:teuthology.orchestra.run.smithi081.stdout: "fuse_splice_write": "true", 2024-09-13T06:39:25.240 INFO:teuthology.orchestra.run.smithi081.stdout: "fuse_syncfs_on_mksnap": "true", 2024-09-13T06:39:25.241 INFO:teuthology.orchestra.run.smithi081.stdout: "fuse_use_invalidate_cb": "true", 2024-09-13T06:39:25.241 INFO:teuthology.orchestra.run.smithi081.stdout: "gss_ktab_client_file": "/var/lib/ceph/mon.a/gss_client_mon.a.ktab", 2024-09-13T06:39:25.241 INFO:teuthology.orchestra.run.smithi081.stdout: "gss_target_name": "ceph", 2024-09-13T06:39:25.241 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_file": "", 2024-09-13T06:39:25.241 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_inject_failure": "0", 2024-09-13T06:39:25.241 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_interval": "5", 2024-09-13T06:39:25.241 INFO:teuthology.orchestra.run.smithi081.stdout: "host": "smithi081", 2024-09-13T06:39:25.241 INFO:teuthology.orchestra.run.smithi081.stdout: "immutable_object_cache_client_dedicated_thread_num": "2", 2024-09-13T06:39:25.241 INFO:teuthology.orchestra.run.smithi081.stdout: "immutable_object_cache_max_inflight_ops": "128", 2024-09-13T06:39:25.241 INFO:teuthology.orchestra.run.smithi081.stdout: "immutable_object_cache_max_size": "1073741824", 2024-09-13T06:39:25.241 INFO:teuthology.orchestra.run.smithi081.stdout: "immutable_object_cache_path": "/tmp/ceph_immutable_object_cache", 2024-09-13T06:39:25.241 INFO:teuthology.orchestra.run.smithi081.stdout: "immutable_object_cache_qos_bps_burst": "0", 2024-09-13T06:39:25.241 INFO:teuthology.orchestra.run.smithi081.stdout: "immutable_object_cache_qos_bps_burst_seconds": "1", 2024-09-13T06:39:25.242 INFO:teuthology.orchestra.run.smithi081.stdout: "immutable_object_cache_qos_bps_limit": "0", 2024-09-13T06:39:25.242 INFO:teuthology.orchestra.run.smithi081.stdout: "immutable_object_cache_qos_iops_burst": "0", 2024-09-13T06:39:25.242 INFO:teuthology.orchestra.run.smithi081.stdout: "immutable_object_cache_qos_iops_burst_seconds": "1", 2024-09-13T06:39:25.242 INFO:teuthology.orchestra.run.smithi081.stdout: "immutable_object_cache_qos_iops_limit": "0", 2024-09-13T06:39:25.242 INFO:teuthology.orchestra.run.smithi081.stdout: "immutable_object_cache_qos_schedule_tick_min": "50", 2024-09-13T06:39:25.242 INFO:teuthology.orchestra.run.smithi081.stdout: "immutable_object_cache_sock": "/var/run/ceph/immutable_object_cache_sock", 2024-09-13T06:39:25.242 INFO:teuthology.orchestra.run.smithi081.stdout: "immutable_object_cache_watermark": "0.900000", 2024-09-13T06:39:25.242 INFO:teuthology.orchestra.run.smithi081.stdout: "inject_early_sigterm": "false", 2024-09-13T06:39:25.242 INFO:teuthology.orchestra.run.smithi081.stdout: "jaeger_agent_port": "6799", 2024-09-13T06:39:25.242 INFO:teuthology.orchestra.run.smithi081.stdout: "jaeger_tracing_enable": "false", 2024-09-13T06:39:25.242 INFO:teuthology.orchestra.run.smithi081.stdout: "journal_aio": "true", 2024-09-13T06:39:25.242 INFO:teuthology.orchestra.run.smithi081.stdout: "journal_align_min_size": "65536", 2024-09-13T06:39:25.242 INFO:teuthology.orchestra.run.smithi081.stdout: "journal_block_align": "true", 2024-09-13T06:39:25.243 INFO:teuthology.orchestra.run.smithi081.stdout: "journal_block_size": "4096", 2024-09-13T06:39:25.243 INFO:teuthology.orchestra.run.smithi081.stdout: "journal_dio": "true", 2024-09-13T06:39:25.243 INFO:teuthology.orchestra.run.smithi081.stdout: "journal_discard": "false", 2024-09-13T06:39:25.243 INFO:teuthology.orchestra.run.smithi081.stdout: "journal_force_aio": "false", 2024-09-13T06:39:25.243 INFO:teuthology.orchestra.run.smithi081.stdout: "journal_ignore_corruption": "false", 2024-09-13T06:39:25.243 INFO:teuthology.orchestra.run.smithi081.stdout: "journal_max_write_bytes": "10485760", 2024-09-13T06:39:25.243 INFO:teuthology.orchestra.run.smithi081.stdout: "journal_max_write_entries": "100", 2024-09-13T06:39:25.243 INFO:teuthology.orchestra.run.smithi081.stdout: "journal_replay_from": "0", 2024-09-13T06:39:25.243 INFO:teuthology.orchestra.run.smithi081.stdout: "journal_throttle_high_multiple": "0.000000", 2024-09-13T06:39:25.243 INFO:teuthology.orchestra.run.smithi081.stdout: "journal_throttle_high_threshhold": "0.900000", 2024-09-13T06:39:25.243 INFO:teuthology.orchestra.run.smithi081.stdout: "journal_throttle_low_threshhold": "0.600000", 2024-09-13T06:39:25.243 INFO:teuthology.orchestra.run.smithi081.stdout: "journal_throttle_max_multiple": "0.000000", 2024-09-13T06:39:25.243 INFO:teuthology.orchestra.run.smithi081.stdout: "journal_write_header_frequency": "0", 2024-09-13T06:39:25.243 INFO:teuthology.orchestra.run.smithi081.stdout: "journal_zero_on_create": "false", 2024-09-13T06:39:25.244 INFO:teuthology.orchestra.run.smithi081.stdout: "journaler_prefetch_periods": "10", 2024-09-13T06:39:25.244 INFO:teuthology.orchestra.run.smithi081.stdout: "journaler_prezero_periods": "5", 2024-09-13T06:39:25.244 INFO:teuthology.orchestra.run.smithi081.stdout: "journaler_write_head_interval": "15", 2024-09-13T06:39:25.244 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "", 2024-09-13T06:39:25.244 INFO:teuthology.orchestra.run.smithi081.stdout: "keyfile": "", 2024-09-13T06:39:25.244 INFO:teuthology.orchestra.run.smithi081.stdout: "keyring": "/var/lib/ceph/mon/ceph-a/keyring", 2024-09-13T06:39:25.244 INFO:teuthology.orchestra.run.smithi081.stdout: "kstore_backend": "rocksdb", 2024-09-13T06:39:25.244 INFO:teuthology.orchestra.run.smithi081.stdout: "kstore_default_stripe_size": "65536", 2024-09-13T06:39:25.244 INFO:teuthology.orchestra.run.smithi081.stdout: "kstore_fsck_on_mount": "false", 2024-09-13T06:39:25.244 INFO:teuthology.orchestra.run.smithi081.stdout: "kstore_fsck_on_mount_deep": "true", 2024-09-13T06:39:25.244 INFO:teuthology.orchestra.run.smithi081.stdout: "kstore_max_bytes": "67108864", 2024-09-13T06:39:25.244 INFO:teuthology.orchestra.run.smithi081.stdout: "kstore_max_ops": "512", 2024-09-13T06:39:25.244 INFO:teuthology.orchestra.run.smithi081.stdout: "kstore_nid_prealloc": "1024", 2024-09-13T06:39:25.244 INFO:teuthology.orchestra.run.smithi081.stdout: "kstore_onode_map_size": "1024", 2024-09-13T06:39:25.245 INFO:teuthology.orchestra.run.smithi081.stdout: "kstore_rocksdb_options": "compression=kNoCompression", 2024-09-13T06:39:25.245 INFO:teuthology.orchestra.run.smithi081.stdout: "kstore_sync_submit_transaction": "false", 2024-09-13T06:39:25.245 INFO:teuthology.orchestra.run.smithi081.stdout: "kstore_sync_transaction": "false", 2024-09-13T06:39:25.245 INFO:teuthology.orchestra.run.smithi081.stdout: "leveldb_block_size": "65536", 2024-09-13T06:39:25.245 INFO:teuthology.orchestra.run.smithi081.stdout: "leveldb_bloom_size": "0", 2024-09-13T06:39:25.245 INFO:teuthology.orchestra.run.smithi081.stdout: "leveldb_cache_size": "536870912", 2024-09-13T06:39:25.245 INFO:teuthology.orchestra.run.smithi081.stdout: "leveldb_compact_on_mount": "false", 2024-09-13T06:39:25.245 INFO:teuthology.orchestra.run.smithi081.stdout: "leveldb_compression": "false", 2024-09-13T06:39:25.245 INFO:teuthology.orchestra.run.smithi081.stdout: "leveldb_log": "", 2024-09-13T06:39:25.245 INFO:teuthology.orchestra.run.smithi081.stdout: "leveldb_log_to_ceph_log": "true", 2024-09-13T06:39:25.245 INFO:teuthology.orchestra.run.smithi081.stdout: "leveldb_max_open_files": "0", 2024-09-13T06:39:25.245 INFO:teuthology.orchestra.run.smithi081.stdout: "leveldb_paranoid": "false", 2024-09-13T06:39:25.245 INFO:teuthology.orchestra.run.smithi081.stdout: "leveldb_write_buffer_size": "33554432", 2024-09-13T06:39:25.245 INFO:teuthology.orchestra.run.smithi081.stdout: "librados_thread_count": "2", 2024-09-13T06:39:25.246 INFO:teuthology.orchestra.run.smithi081.stdout: "lockdep": "false", 2024-09-13T06:39:25.246 INFO:teuthology.orchestra.run.smithi081.stdout: "lockdep_force_backtrace": "false", 2024-09-13T06:39:25.246 INFO:teuthology.orchestra.run.smithi081.stdout: "log_coarse_timestamps": "true", 2024-09-13T06:39:25.246 INFO:teuthology.orchestra.run.smithi081.stdout: "log_file": "/var/log/ceph/ceph-mon.a.log", 2024-09-13T06:39:25.246 INFO:teuthology.orchestra.run.smithi081.stdout: "log_flush_on_exit": "false", 2024-09-13T06:39:25.246 INFO:teuthology.orchestra.run.smithi081.stdout: "log_graylog_host": "127.0.0.1", 2024-09-13T06:39:25.246 INFO:teuthology.orchestra.run.smithi081.stdout: "log_graylog_port": "12201", 2024-09-13T06:39:25.246 INFO:teuthology.orchestra.run.smithi081.stdout: "log_max_new": "1000", 2024-09-13T06:39:25.246 INFO:teuthology.orchestra.run.smithi081.stdout: "log_max_recent": "10000", 2024-09-13T06:39:25.246 INFO:teuthology.orchestra.run.smithi081.stdout: "log_stderr_prefix": "", 2024-09-13T06:39:25.246 INFO:teuthology.orchestra.run.smithi081.stdout: "log_stop_at_utilization": "0.970000", 2024-09-13T06:39:25.246 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": "true", 2024-09-13T06:39:25.246 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_graylog": "false", 2024-09-13T06:39:25.247 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_journald": "false", 2024-09-13T06:39:25.247 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_stderr": "false", 2024-09-13T06:39:25.247 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_syslog": "false", 2024-09-13T06:39:25.247 INFO:teuthology.orchestra.run.smithi081.stdout: "max_rotating_auth_attempts": "10", 2024-09-13T06:39:25.247 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_abort_on_newly_corrupt_dentry": "true", 2024-09-13T06:39:25.247 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_action_on_write_error": "1", 2024-09-13T06:39:25.247 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_alternate_name_max": "8192", 2024-09-13T06:39:25.247 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_asio_thread_count": "2", 2024-09-13T06:39:25.247 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_bal_export_pin": "true", 2024-09-13T06:39:25.247 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_bal_fragment_dirs": "true", 2024-09-13T06:39:25.247 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_bal_fragment_fast_factor": "1.500000", 2024-09-13T06:39:25.247 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_bal_fragment_interval": "5", 2024-09-13T06:39:25.247 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_bal_fragment_size_max": "100000", 2024-09-13T06:39:25.247 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_bal_idle_threshold": "0.000000", 2024-09-13T06:39:25.248 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_bal_interval": "10", 2024-09-13T06:39:25.248 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_bal_max": "-1", 2024-09-13T06:39:25.248 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_bal_max_until": "-1", 2024-09-13T06:39:25.248 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_bal_merge_size": "50", 2024-09-13T06:39:25.248 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_bal_midchunk": "0.300000", 2024-09-13T06:39:25.248 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_bal_min_rebalance": "0.100000", 2024-09-13T06:39:25.248 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_bal_min_start": "0.200000", 2024-09-13T06:39:25.248 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_bal_minchunk": "0.001000", 2024-09-13T06:39:25.248 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_bal_mode": "0", 2024-09-13T06:39:25.248 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_bal_need_max": "1.200000", 2024-09-13T06:39:25.248 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_bal_need_min": "0.800000", 2024-09-13T06:39:25.248 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_bal_replicate_threshold": "8000.000000", 2024-09-13T06:39:25.248 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_bal_sample_interval": "3.000000", 2024-09-13T06:39:25.249 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_bal_split_bits": "3", 2024-09-13T06:39:25.249 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_bal_split_rd": "25000.000000", 2024-09-13T06:39:25.249 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_bal_split_size": "10000", 2024-09-13T06:39:25.249 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_bal_split_wr": "10000.000000", 2024-09-13T06:39:25.249 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_bal_target_decay": "10.000000", 2024-09-13T06:39:25.249 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_bal_unreplicate_threshold": "0.000000", 2024-09-13T06:39:25.249 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_beacon_grace": "15.000000", 2024-09-13T06:39:25.249 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_beacon_interval": "4.000000", 2024-09-13T06:39:25.249 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_beacon_mon_down_grace": "60", 2024-09-13T06:39:25.249 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_cache_memory_limit": "4294967296", 2024-09-13T06:39:25.249 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_cache_mid": "0.700000", 2024-09-13T06:39:25.249 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_cache_release_free_interval": "10", 2024-09-13T06:39:25.250 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_cache_reservation": "0.050000", 2024-09-13T06:39:25.250 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_cache_trim_decay_rate": "1.000000", 2024-09-13T06:39:25.250 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_cache_trim_interval": "1", 2024-09-13T06:39:25.250 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_cache_trim_threshold": "262144", 2024-09-13T06:39:25.250 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_cap_acquisition_throttle_retry_request_timeout": "0.500000", 2024-09-13T06:39:25.250 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_cap_revoke_eviction_timeout": "0.000000", 2024-09-13T06:39:25.250 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_client_delegate_inos_pct": "50", 2024-09-13T06:39:25.250 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_client_prealloc_inos": "1000", 2024-09-13T06:39:25.250 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_client_writeable_range_max_inc_objs": "1024", 2024-09-13T06:39:25.250 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_connect_bootstrapping": "false", 2024-09-13T06:39:25.250 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_damage_table_max_entries": "10000", 2024-09-13T06:39:25.250 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_data": "/var/lib/ceph/mds/ceph-a", 2024-09-13T06:39:25.250 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_debug_auth_pins": "false", 2024-09-13T06:39:25.251 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_debug_frag": "false", 2024-09-13T06:39:25.251 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_debug_scatterstat": "false", 2024-09-13T06:39:25.251 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_debug_subtrees": "false", 2024-09-13T06:39:25.251 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_decay_halflife": "5.000000", 2024-09-13T06:39:25.251 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_default_dir_hash": "2", 2024-09-13T06:39:25.251 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_defer_session_stale": "true", 2024-09-13T06:39:25.251 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_deny_all_reconnect": "false", 2024-09-13T06:39:25.251 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_dir_keys_per_op": "16384", 2024-09-13T06:39:25.251 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_dir_max_commit_size": "10", 2024-09-13T06:39:25.251 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_dir_max_entries": "0", 2024-09-13T06:39:25.251 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_dir_prefetch": "true", 2024-09-13T06:39:25.251 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_dirstat_min_interval": "1.000000", 2024-09-13T06:39:25.251 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_dump_cache_after_rejoin": "false", 2024-09-13T06:39:25.252 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_dump_cache_on_map": "false", 2024-09-13T06:39:25.252 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_dump_cache_threshold_file": "0", 2024-09-13T06:39:25.252 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_dump_cache_threshold_formatter": "1073741824", 2024-09-13T06:39:25.252 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_early_reply": "true", 2024-09-13T06:39:25.252 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_enable_op_tracker": "true", 2024-09-13T06:39:25.252 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_enforce_unique_name": "true", 2024-09-13T06:39:25.252 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_export_ephemeral_distributed": "true", 2024-09-13T06:39:25.252 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_export_ephemeral_distributed_factor": "2.000000", 2024-09-13T06:39:25.252 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_export_ephemeral_random": "true", 2024-09-13T06:39:25.252 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_export_ephemeral_random_max": "0.010000", 2024-09-13T06:39:25.252 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_extraordinary_events_dump_interval": "0", 2024-09-13T06:39:25.253 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_forward_all_requests_to_auth": "false", 2024-09-13T06:39:25.253 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_freeze_tree_timeout": "30.000000", 2024-09-13T06:39:25.253 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_fscrypt_last_block_max_size": "4096", 2024-09-13T06:39:25.253 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_go_bad_corrupt_dentry": "true", 2024-09-13T06:39:25.253 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_hack_allow_loading_invalid_metadata": "false", 2024-09-13T06:39:25.253 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_health_cache_threshold": "1.500000", 2024-09-13T06:39:25.253 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_health_summarize_threshold": "10", 2024-09-13T06:39:25.253 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_heartbeat_grace": "15.000000", 2024-09-13T06:39:25.253 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_heartbeat_reset_grace": "1000", 2024-09-13T06:39:25.254 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_inject_health_dummy": "false", 2024-09-13T06:39:25.254 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_inject_journal_corrupt_dentry_first": "0.000000", 2024-09-13T06:39:25.254 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_inject_migrator_session_race": "false", 2024-09-13T06:39:25.254 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_inject_rename_corrupt_dentry_first": "0.000000", 2024-09-13T06:39:25.254 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_inject_skip_replaying_inotable": "false", 2024-09-13T06:39:25.254 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_inject_traceless_reply_probability": "0.000000", 2024-09-13T06:39:25.254 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_join_fs": "", 2024-09-13T06:39:25.254 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_journal_format": "1", 2024-09-13T06:39:25.254 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_kill_after_journal_logs_flushed": "false", 2024-09-13T06:39:25.254 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_kill_create_at": "0", 2024-09-13T06:39:25.254 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_kill_export_at": "0", 2024-09-13T06:39:25.254 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_kill_import_at": "0", 2024-09-13T06:39:25.255 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_kill_journal_at": "0", 2024-09-13T06:39:25.255 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_kill_journal_expire_at": "0", 2024-09-13T06:39:25.255 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_kill_journal_replay_at": "0", 2024-09-13T06:39:25.255 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_kill_link_at": "0", 2024-09-13T06:39:25.255 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_kill_mdstable_at": "0", 2024-09-13T06:39:25.255 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_kill_openc_at": "0", 2024-09-13T06:39:25.255 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_kill_rename_at": "0", 2024-09-13T06:39:25.255 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_log_events_per_segment": "1024", 2024-09-13T06:39:25.255 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_log_max_events": "-1", 2024-09-13T06:39:25.255 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_log_max_segments": "128", 2024-09-13T06:39:25.255 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_log_pause": "false", 2024-09-13T06:39:25.255 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_log_segment_size": "0", 2024-09-13T06:39:25.255 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_log_skip_corrupt_events": "false", 2024-09-13T06:39:25.255 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_log_warn_factor": "2.000000", 2024-09-13T06:39:25.256 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_max_caps_per_client": "1048576", 2024-09-13T06:39:25.256 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_max_completed_flushes": "100000", 2024-09-13T06:39:25.256 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_max_completed_requests": "100000", 2024-09-13T06:39:25.256 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_max_export_size": "20971520", 2024-09-13T06:39:25.256 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_max_file_recover": "32", 2024-09-13T06:39:25.256 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_max_purge_files": "64", 2024-09-13T06:39:25.256 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_max_purge_ops": "8192", 2024-09-13T06:39:25.256 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_max_purge_ops_per_pg": "0.500000", 2024-09-13T06:39:25.257 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_max_scrub_ops_in_progress": "5", 2024-09-13T06:39:25.257 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_max_snaps_per_dir": "100", 2024-09-13T06:39:25.257 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_metrics_update_interval": "2", 2024-09-13T06:39:25.257 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_min_caps_per_client": "100", 2024-09-13T06:39:25.257 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_min_caps_working_set": "10000", 2024-09-13T06:39:25.257 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_mon_shutdown_timeout": "5.000000", 2024-09-13T06:39:25.257 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_numa_node": "-1", 2024-09-13T06:39:25.257 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_oft_prefetch_dirfrags": "false", 2024-09-13T06:39:25.257 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_op_complaint_time": "30.000000", 2024-09-13T06:39:25.257 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_op_history_duration": "600", 2024-09-13T06:39:25.257 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_op_history_size": "20", 2024-09-13T06:39:25.257 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_op_history_slow_op_size": "20", 2024-09-13T06:39:25.258 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_op_history_slow_op_threshold": "10", 2024-09-13T06:39:25.258 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_op_log_threshold": "5", 2024-09-13T06:39:25.258 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_ping_grace": "15", 2024-09-13T06:39:25.258 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_ping_interval": "5", 2024-09-13T06:39:25.258 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_purge_queue_busy_flush_period": "1.000000", 2024-09-13T06:39:25.258 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_recall_global_max_decay_threshold": "131072", 2024-09-13T06:39:25.258 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_recall_max_caps": "30000", 2024-09-13T06:39:25.258 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_recall_max_decay_rate": "1.500000", 2024-09-13T06:39:25.258 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_recall_max_decay_threshold": "131072", 2024-09-13T06:39:25.258 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_recall_warning_decay_rate": "60.000000", 2024-09-13T06:39:25.258 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_recall_warning_threshold": "262144", 2024-09-13T06:39:25.258 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_reconnect_timeout": "45.000000", 2024-09-13T06:39:25.258 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_replay_interval": "1.000000", 2024-09-13T06:39:25.259 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_replay_unsafe_with_closed_session": "false", 2024-09-13T06:39:25.259 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_request_load_average_decay_rate": "60.000000", 2024-09-13T06:39:25.259 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_root_ino_gid": "0", 2024-09-13T06:39:25.259 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_root_ino_uid": "0", 2024-09-13T06:39:25.259 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_scatter_nudge_interval": "5.000000", 2024-09-13T06:39:25.259 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_session_blocklist_on_evict": "true", 2024-09-13T06:39:25.259 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_session_blocklist_on_timeout": "true", 2024-09-13T06:39:25.259 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_session_cache_liveness_decay_rate": "300.000000", 2024-09-13T06:39:25.259 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_session_cache_liveness_magnitude": "10", 2024-09-13T06:39:25.259 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_session_cap_acquisition_decay_rate": "30.000000", 2024-09-13T06:39:25.259 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_session_cap_acquisition_throttle": "100000", 2024-09-13T06:39:25.259 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_session_max_caps_throttle_ratio": "1.100000", 2024-09-13T06:39:25.259 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_session_metadata_threshold": "16777216", 2024-09-13T06:39:25.260 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_sessionmap_keys_per_op": "1024", 2024-09-13T06:39:25.260 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_shutdown_check": "0", 2024-09-13T06:39:25.260 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_skip_ino": "0", 2024-09-13T06:39:25.260 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_sleep_rank_change": "0.000000", 2024-09-13T06:39:25.260 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_snap_max_uid": "4294967294", 2024-09-13T06:39:25.260 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_snap_min_uid": "0", 2024-09-13T06:39:25.260 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_snap_rstat": "false", 2024-09-13T06:39:25.260 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_standby_replay_damaged": "false", 2024-09-13T06:39:25.260 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_symlink_recovery": "true", 2024-09-13T06:39:25.260 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_task_status_update_interval": "2.000000", 2024-09-13T06:39:25.260 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_thrash_exports": "0", 2024-09-13T06:39:25.260 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_thrash_fragments": "0", 2024-09-13T06:39:25.260 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_tick_interval": "5.000000", 2024-09-13T06:39:25.261 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_valgrind_exit": "false", 2024-09-13T06:39:25.261 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_verify_backtrace": "1", 2024-09-13T06:39:25.261 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_verify_scatter": "false", 2024-09-13T06:39:25.261 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_wipe_ino_prealloc": "false", 2024-09-13T06:39:25.261 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_wipe_sessions": "false", 2024-09-13T06:39:25.261 INFO:teuthology.orchestra.run.smithi081.stdout: "mempool_debug": "false", 2024-09-13T06:39:25.261 INFO:teuthology.orchestra.run.smithi081.stdout: "memstore_debug_omit_block_device_write": "false", 2024-09-13T06:39:25.261 INFO:teuthology.orchestra.run.smithi081.stdout: "memstore_device_bytes": "1073741824", 2024-09-13T06:39:25.261 INFO:teuthology.orchestra.run.smithi081.stdout: "memstore_page_set": "false", 2024-09-13T06:39:25.261 INFO:teuthology.orchestra.run.smithi081.stdout: "memstore_page_size": "65536", 2024-09-13T06:39:25.261 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr_client_bytes": "134217728", 2024-09-13T06:39:25.261 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr_client_messages": "512", 2024-09-13T06:39:25.261 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr_client_service_daemon_unregister_timeout": "1.000000", 2024-09-13T06:39:25.262 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr_connect_retry_interval": "1.000000", 2024-09-13T06:39:25.262 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr_data": "/var/lib/ceph/mgr/ceph-a", 2024-09-13T06:39:25.262 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr_debug_aggressive_pg_num_changes": "false", 2024-09-13T06:39:25.262 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr_disabled_modules": "", 2024-09-13T06:39:25.262 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr_initial_modules": "restful iostat nfs", 2024-09-13T06:39:25.262 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr_max_pg_num_change": "128", 2024-09-13T06:39:25.262 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr_mds_bytes": "134217728", 2024-09-13T06:39:25.262 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr_mds_messages": "128", 2024-09-13T06:39:25.262 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr_module_path": "/usr/share/ceph/mgr", 2024-09-13T06:39:25.262 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr_mon_bytes": "134217728", 2024-09-13T06:39:25.262 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr_mon_messages": "128", 2024-09-13T06:39:25.262 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr_osd_bytes": "536870912", 2024-09-13T06:39:25.262 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr_osd_messages": "8192", 2024-09-13T06:39:25.263 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr_pool": "true", 2024-09-13T06:39:25.263 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr_service_beacon_grace": "60.000000", 2024-09-13T06:39:25.263 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr_standby_modules": "true", 2024-09-13T06:39:25.263 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr_stats_period": "5", 2024-09-13T06:39:25.263 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr_stats_threshold": "5", 2024-09-13T06:39:25.263 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr_tick_period": "2", 2024-09-13T06:39:25.263 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr_ttl_cache_expire_seconds": "0", 2024-09-13T06:39:25.263 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_accept_timeout_factor": "2.000000", 2024-09-13T06:39:25.264 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_allow_pool_delete": "true", 2024-09-13T06:39:25.264 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_allow_pool_size_one": "true", 2024-09-13T06:39:25.264 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_auth_validate_all_caps": "true", 2024-09-13T06:39:25.264 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_cache_target_full_warn_ratio": "0.660000", 2024-09-13T06:39:25.264 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_clean_pg_upmaps_per_chunk": "256", 2024-09-13T06:39:25.264 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_client_bytes": "104857600", 2024-09-13T06:39:25.264 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_client_directed_command_retry": "5", 2024-09-13T06:39:25.264 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_client_hunt_interval": "3.000000", 2024-09-13T06:39:25.264 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_client_hunt_interval_backoff": "1.500000", 2024-09-13T06:39:25.264 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_client_hunt_interval_max_multiple": "10.000000", 2024-09-13T06:39:25.264 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_client_hunt_interval_min_multiple": "1.000000", 2024-09-13T06:39:25.264 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_client_hunt_parallel": "3", 2024-09-13T06:39:25.265 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_client_log_interval": "1.000000", 2024-09-13T06:39:25.265 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_client_max_log_entries_per_message": "1000", 2024-09-13T06:39:25.265 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_client_ping_interval": "10.000000", 2024-09-13T06:39:25.265 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_client_ping_timeout": "30.000000", 2024-09-13T06:39:25.265 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_clock_drift_allowed": "1.000000", 2024-09-13T06:39:25.265 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_clock_drift_warn_backoff": "5.000000", 2024-09-13T06:39:25.265 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_cluster_log_file": "default=/var/log/ceph/ceph.$channel.log cluster=/var/log/ceph/ceph.log", 2024-09-13T06:39:25.265 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_cluster_log_file_level": "debug", 2024-09-13T06:39:25.265 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_cluster_log_to_file": "true", 2024-09-13T06:39:25.265 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_cluster_log_to_graylog": "false", 2024-09-13T06:39:25.265 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_cluster_log_to_graylog_host": "127.0.0.1", 2024-09-13T06:39:25.265 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_cluster_log_to_graylog_port": "12201", 2024-09-13T06:39:25.265 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_cluster_log_to_journald": "false", 2024-09-13T06:39:25.266 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_cluster_log_to_stderr": "false", 2024-09-13T06:39:25.266 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_cluster_log_to_syslog": "default=false", 2024-09-13T06:39:25.266 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_cluster_log_to_syslog_facility": "daemon", 2024-09-13T06:39:25.266 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_cluster_log_to_syslog_level": "info", 2024-09-13T06:39:25.266 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_compact_on_bootstrap": "false", 2024-09-13T06:39:25.266 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_compact_on_start": "false", 2024-09-13T06:39:25.266 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_compact_on_trim": "true", 2024-09-13T06:39:25.266 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_con_tracker_persist_interval": "10", 2024-09-13T06:39:25.266 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_con_tracker_score_halflife": "43200", 2024-09-13T06:39:25.266 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_config_key_max_entry_size": "65536", 2024-09-13T06:39:25.266 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_cpu_threads": "4", 2024-09-13T06:39:25.266 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_crush_min_required_version": "hammer", 2024-09-13T06:39:25.266 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_daemon_bytes": "419430400", 2024-09-13T06:39:25.267 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_data": "/var/lib/ceph/mon/ceph-a", 2024-09-13T06:39:25.267 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_data_avail_crit": "5", 2024-09-13T06:39:25.267 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_data_avail_warn": "5", 2024-09-13T06:39:25.267 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_data_size_warn": "16106127360", 2024-09-13T06:39:25.267 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_debug_block_osdmap_trim": "false", 2024-09-13T06:39:25.267 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_debug_deprecated_as_obsolete": "false", 2024-09-13T06:39:25.267 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_debug_dump_json": "false", 2024-09-13T06:39:25.267 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_debug_dump_location": "/var/log/ceph/ceph-mon.a.tdump", 2024-09-13T06:39:25.267 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_debug_dump_transactions": "false", 2024-09-13T06:39:25.267 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_debug_extra_checks": "false", 2024-09-13T06:39:25.267 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_debug_no_initial_persistent_features": "false", 2024-09-13T06:39:25.267 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_debug_no_require_bluestore_for_ec_overwrites": "false", 2024-09-13T06:39:25.267 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_debug_no_require_quincy": "false", 2024-09-13T06:39:25.267 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_debug_no_require_reef": "false", 2024-09-13T06:39:25.268 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_debug_unsafe_allow_tier_with_nonempty_snaps": "false", 2024-09-13T06:39:25.268 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_delta_reset_interval": "10.000000", 2024-09-13T06:39:25.268 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_dns_srv_name": "ceph-mon", 2024-09-13T06:39:25.268 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_down_mkfs_grace": "120", 2024-09-13T06:39:25.268 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_election_default_strategy": "1", 2024-09-13T06:39:25.268 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_election_timeout": "5.000000", 2024-09-13T06:39:25.268 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_elector_ignore_propose_margin": "0.000500", 2024-09-13T06:39:25.268 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_elector_ping_divisor": "2", 2024-09-13T06:39:25.268 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_elector_ping_timeout": "2.000000", 2024-09-13T06:39:25.268 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_enable_op_tracker": "true", 2024-09-13T06:39:25.268 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_fake_pool_delete": "false", 2024-09-13T06:39:25.268 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_force_quorum_join": "false", 2024-09-13T06:39:25.268 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_globalid_prealloc": "10000", 2024-09-13T06:39:25.269 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_health_detail_to_clog": "false", 2024-09-13T06:39:25.269 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_health_log_update_period": "5", 2024-09-13T06:39:25.269 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_health_max_detail": "50", 2024-09-13T06:39:25.269 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_health_to_clog": "true", 2024-09-13T06:39:25.269 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_health_to_clog_interval": "600", 2024-09-13T06:39:25.269 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_health_to_clog_tick_interval": "60.000000", 2024-09-13T06:39:25.269 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_host": "172.21.15.81,[v2:172.21.15.81:3301,v1:172.21.15.81:6790],172.21.15.139", 2024-09-13T06:39:25.269 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_host_override": "", 2024-09-13T06:39:25.269 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_initial_members": "", 2024-09-13T06:39:25.269 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_inject_pg_merge_bounce_probability": "0.000000", 2024-09-13T06:39:25.269 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_inject_sync_get_chunk_delay": "0.000000", 2024-09-13T06:39:25.269 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_inject_transaction_delay_max": "10.000000", 2024-09-13T06:39:25.269 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_inject_transaction_delay_probability": "0.000000", 2024-09-13T06:39:25.269 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_keyvaluedb": "rocksdb", 2024-09-13T06:39:25.270 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_lease": "5.000000", 2024-09-13T06:39:25.270 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_lease_ack_timeout_factor": "2.000000", 2024-09-13T06:39:25.270 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_lease_renew_interval_factor": "0.600000", 2024-09-13T06:39:25.270 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_log_full_interval": "50", 2024-09-13T06:39:25.270 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_log_max": "10000", 2024-09-13T06:39:25.270 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_log_max_summary": "50", 2024-09-13T06:39:25.270 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_max_log_entries_per_event": "4096", 2024-09-13T06:39:25.270 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_max_log_epochs": "500", 2024-09-13T06:39:25.270 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_max_mdsmap_epochs": "500", 2024-09-13T06:39:25.270 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_max_mgrmap_epochs": "500", 2024-09-13T06:39:25.270 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_max_osd": "10000", 2024-09-13T06:39:25.270 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_max_pg_per_osd": "10000", 2024-09-13T06:39:25.270 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_max_pool_pg_num": "65536", 2024-09-13T06:39:25.271 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_max_snap_prune_per_epoch": "100", 2024-09-13T06:39:25.271 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_mds_blocklist_interval": "86400.000000", 2024-09-13T06:39:25.271 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_mds_force_trim_to": "0", 2024-09-13T06:39:25.271 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_mds_skip_sanity": "false", 2024-09-13T06:39:25.271 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_memory_autotune": "true", 2024-09-13T06:39:25.271 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_memory_target": "2147483648", 2024-09-13T06:39:25.271 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_mgr_beacon_grace": "30", 2024-09-13T06:39:25.271 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_mgr_blocklist_interval": "86400.000000", 2024-09-13T06:39:25.271 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_mgr_digest_period": "5", 2024-09-13T06:39:25.271 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_mgr_inactive_grace": "60", 2024-09-13T06:39:25.271 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_mgr_mkfs_grace": "240", 2024-09-13T06:39:25.271 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_mgr_proxy_client_bytes_ratio": "0.300000", 2024-09-13T06:39:25.271 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_min_osdmap_epochs": "500", 2024-09-13T06:39:25.271 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_op_complaint_time": "30", 2024-09-13T06:39:25.272 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_op_history_duration": "600", 2024-09-13T06:39:25.272 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_op_history_size": "20", 2024-09-13T06:39:25.272 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_op_history_slow_op_size": "20", 2024-09-13T06:39:25.272 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_op_history_slow_op_threshold": "10", 2024-09-13T06:39:25.272 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_op_log_threshold": "5", 2024-09-13T06:39:25.272 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_osd_adjust_down_out_interval": "true", 2024-09-13T06:39:25.272 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_osd_adjust_heartbeat_grace": "true", 2024-09-13T06:39:25.272 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_osd_auto_mark_auto_out_in": "true", 2024-09-13T06:39:25.272 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_osd_auto_mark_in": "false", 2024-09-13T06:39:25.272 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_osd_auto_mark_new_in": "true", 2024-09-13T06:39:25.272 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_osd_backfillfull_ratio": "0.900000", 2024-09-13T06:39:25.272 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_osd_blocklist_default_expire": "3600.000000", 2024-09-13T06:39:25.272 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_osd_cache_size": "500", 2024-09-13T06:39:25.273 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_osd_cache_size_min": "134217728", 2024-09-13T06:39:25.273 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_osd_crush_smoke_test": "true", 2024-09-13T06:39:25.273 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_osd_destroyed_out_interval": "600", 2024-09-13T06:39:25.273 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_osd_down_out_interval": "600", 2024-09-13T06:39:25.273 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_osd_down_out_subtree_limit": "rack", 2024-09-13T06:39:25.273 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_osd_err_op_age_ratio": "128.000000", 2024-09-13T06:39:25.273 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_osd_force_trim_to": "0", 2024-09-13T06:39:25.273 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_osd_full_ratio": "0.950000", 2024-09-13T06:39:25.273 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_osd_initial_require_min_compat_client": "luminous", 2024-09-13T06:39:25.273 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_osd_laggy_halflife": "3600", 2024-09-13T06:39:25.273 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_osd_laggy_max_interval": "300", 2024-09-13T06:39:25.273 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_osd_laggy_weight": "0.300000", 2024-09-13T06:39:25.273 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_osd_mapping_pgs_per_chunk": "4096", 2024-09-13T06:39:25.274 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_osd_max_creating_pgs": "1024", 2024-09-13T06:39:25.274 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_osd_max_initial_pgs": "1024", 2024-09-13T06:39:25.274 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_osd_min_down_reporters": "2", 2024-09-13T06:39:25.274 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_osd_min_in_ratio": "0.750000", 2024-09-13T06:39:25.274 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_osd_min_up_ratio": "0.300000", 2024-09-13T06:39:25.274 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_osd_nearfull_ratio": "0.850000", 2024-09-13T06:39:25.274 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_osd_prime_pg_temp": "true", 2024-09-13T06:39:25.274 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_osd_prime_pg_temp_max_estimate": "0.250000", 2024-09-13T06:39:25.274 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_osd_prime_pg_temp_max_time": "0.500000", 2024-09-13T06:39:25.274 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_osd_report_timeout": "900", 2024-09-13T06:39:25.274 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_osd_reporter_subtree_level": "osd", 2024-09-13T06:39:25.274 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_osd_snap_trim_queue_warn_on": "32768", 2024-09-13T06:39:25.274 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_osd_warn_num_repaired": "10", 2024-09-13T06:39:25.274 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_osd_warn_op_age": "32.000000", 2024-09-13T06:39:25.275 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_osdmap_full_prune_enabled": "true", 2024-09-13T06:39:25.275 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_osdmap_full_prune_interval": "10", 2024-09-13T06:39:25.275 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_osdmap_full_prune_min": "10000", 2024-09-13T06:39:25.275 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_osdmap_full_prune_txsize": "100", 2024-09-13T06:39:25.275 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_pg_check_down_all_threshold": "0.500000", 2024-09-13T06:39:25.275 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_pg_stuck_threshold": "60", 2024-09-13T06:39:25.275 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_pg_warn_max_object_skew": "0.000000", 2024-09-13T06:39:25.275 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_pg_warn_min_objects": "10000", 2024-09-13T06:39:25.275 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_pg_warn_min_per_osd": "0", 2024-09-13T06:39:25.275 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_pg_warn_min_pool_objects": "1000", 2024-09-13T06:39:25.275 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_pool_quota_crit_threshold": "0", 2024-09-13T06:39:25.275 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_pool_quota_warn_threshold": "0", 2024-09-13T06:39:25.275 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_probe_timeout": "2.000000", 2024-09-13T06:39:25.275 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_reweight_max_change": "0.050000", 2024-09-13T06:39:25.276 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_reweight_max_osds": "4", 2024-09-13T06:39:25.276 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_reweight_min_bytes_per_osd": "10", 2024-09-13T06:39:25.276 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_reweight_min_pgs_per_osd": "4", 2024-09-13T06:39:25.276 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_rocksdb_options": "write_buffer_size=33554432,compression=kNoCompression,level_compaction_dynamic_level_bytes=true", 2024-09-13T06:39:25.276 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_scrub_inject_crc_mismatch": "0.000000", 2024-09-13T06:39:25.276 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_scrub_inject_missing_keys": "0.000000", 2024-09-13T06:39:25.276 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_scrub_interval": "86400", 2024-09-13T06:39:25.276 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_scrub_max_keys": "100", 2024-09-13T06:39:25.276 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_scrub_timeout": "300", 2024-09-13T06:39:25.276 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_session_timeout": "300", 2024-09-13T06:39:25.276 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_smart_report_timeout": "5", 2024-09-13T06:39:25.276 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_stat_smooth_intervals": "6", 2024-09-13T06:39:25.276 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_stretch_cluster_recovery_ratio": "0.600000", 2024-09-13T06:39:25.277 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_stretch_pool_min_size": "2", 2024-09-13T06:39:25.277 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_stretch_pool_size": "4", 2024-09-13T06:39:25.277 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_stretch_recovery_min_wait": "15.000000", 2024-09-13T06:39:25.277 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_subscribe_interval": "86400.000000", 2024-09-13T06:39:25.277 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_sync_debug": "false", 2024-09-13T06:39:25.277 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_sync_max_payload_keys": "2000", 2024-09-13T06:39:25.277 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_sync_max_payload_size": "1048576", 2024-09-13T06:39:25.277 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_sync_provider_kill_at": "0", 2024-09-13T06:39:25.277 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_sync_requester_kill_at": "0", 2024-09-13T06:39:25.277 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_sync_timeout": "60.000000", 2024-09-13T06:39:25.277 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_target_pg_per_osd": "100", 2024-09-13T06:39:25.277 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_tick_interval": "5", 2024-09-13T06:39:25.277 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_timecheck_interval": "300.000000", 2024-09-13T06:39:25.278 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_timecheck_skew_interval": "30.000000", 2024-09-13T06:39:25.278 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_use_min_delay_socket": "false", 2024-09-13T06:39:25.278 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_warn_older_version_delay": "604800", 2024-09-13T06:39:25.278 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_warn_on_cache_pools_without_hit_sets": "true", 2024-09-13T06:39:25.278 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_warn_on_crush_straw_calc_version_zero": "false", 2024-09-13T06:39:25.278 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_warn_on_degraded_stretch_mode": "true", 2024-09-13T06:39:25.278 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_warn_on_filestore_osds": "false", 2024-09-13T06:39:25.278 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_warn_on_insecure_global_id_reclaim": "false", 2024-09-13T06:39:25.278 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_warn_on_insecure_global_id_reclaim_allowed": "false", 2024-09-13T06:39:25.278 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_warn_on_legacy_crush_tunables": "false", 2024-09-13T06:39:25.278 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_warn_on_misplaced": "false", 2024-09-13T06:39:25.279 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_warn_on_msgr2_not_enabled": "true", 2024-09-13T06:39:25.279 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_warn_on_older_version": "true", 2024-09-13T06:39:25.279 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_warn_on_osd_down_out_interval_zero": "false", 2024-09-13T06:39:25.279 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_warn_on_pool_no_app": "false", 2024-09-13T06:39:25.279 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_warn_on_pool_no_redundancy": "false", 2024-09-13T06:39:25.279 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_warn_on_pool_pg_num_not_power_of_two": "false", 2024-09-13T06:39:25.279 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_warn_on_slow_ping_ratio": "0.050000", 2024-09-13T06:39:25.279 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_warn_on_slow_ping_time": "0.000000", 2024-09-13T06:39:25.279 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_warn_on_too_few_osds": "false", 2024-09-13T06:39:25.279 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_warn_pg_not_deep_scrubbed_ratio": "0.750000", 2024-09-13T06:39:25.279 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_warn_pg_not_scrubbed_ratio": "0.500000", 2024-09-13T06:39:25.279 INFO:teuthology.orchestra.run.smithi081.stdout: "monmap": "", 2024-09-13T06:39:25.279 INFO:teuthology.orchestra.run.smithi081.stdout: "motr_admin_endpoint": "192.168.180.182@tcp:12345:4:1", 2024-09-13T06:39:25.280 INFO:teuthology.orchestra.run.smithi081.stdout: "motr_admin_fid": "0x7200000000000001:0x0", 2024-09-13T06:39:25.280 INFO:teuthology.orchestra.run.smithi081.stdout: "motr_ha_endpoint": "192.168.180.182@tcp:12345:1:1", 2024-09-13T06:39:25.280 INFO:teuthology.orchestra.run.smithi081.stdout: "motr_my_endpoint": "192.168.180.182@tcp:12345:4:1", 2024-09-13T06:39:25.280 INFO:teuthology.orchestra.run.smithi081.stdout: "motr_my_fid": "0x7200000000000001:0x0", 2024-09-13T06:39:25.280 INFO:teuthology.orchestra.run.smithi081.stdout: "motr_profile_fid": "0x7000000000000001:0x0", 2024-09-13T06:39:25.280 INFO:teuthology.orchestra.run.smithi081.stdout: "motr_tracing_enabled": "false", 2024-09-13T06:39:25.280 INFO:teuthology.orchestra.run.smithi081.stdout: "ms_async_op_threads": "3", 2024-09-13T06:39:25.280 INFO:teuthology.orchestra.run.smithi081.stdout: "ms_async_rdma_buffer_size": "131072", 2024-09-13T06:39:25.280 INFO:teuthology.orchestra.run.smithi081.stdout: "ms_async_rdma_cm": "false", 2024-09-13T06:39:25.280 INFO:teuthology.orchestra.run.smithi081.stdout: "ms_async_rdma_device_name": "", 2024-09-13T06:39:25.280 INFO:teuthology.orchestra.run.smithi081.stdout: "ms_async_rdma_dscp": "96", 2024-09-13T06:39:25.280 INFO:teuthology.orchestra.run.smithi081.stdout: "ms_async_rdma_enable_hugepage": "false", 2024-09-13T06:39:25.280 INFO:teuthology.orchestra.run.smithi081.stdout: "ms_async_rdma_gid_idx": "0", 2024-09-13T06:39:25.280 INFO:teuthology.orchestra.run.smithi081.stdout: "ms_async_rdma_local_gid": "", 2024-09-13T06:39:25.281 INFO:teuthology.orchestra.run.smithi081.stdout: "ms_async_rdma_polling_us": "1000", 2024-09-13T06:39:25.281 INFO:teuthology.orchestra.run.smithi081.stdout: "ms_async_rdma_port_num": "1", 2024-09-13T06:39:25.281 INFO:teuthology.orchestra.run.smithi081.stdout: "ms_async_rdma_receive_buffers": "32768", 2024-09-13T06:39:25.281 INFO:teuthology.orchestra.run.smithi081.stdout: "ms_async_rdma_receive_queue_len": "4096", 2024-09-13T06:39:25.281 INFO:teuthology.orchestra.run.smithi081.stdout: "ms_async_rdma_roce_ver": "1", 2024-09-13T06:39:25.281 INFO:teuthology.orchestra.run.smithi081.stdout: "ms_async_rdma_send_buffers": "1024", 2024-09-13T06:39:25.281 INFO:teuthology.orchestra.run.smithi081.stdout: "ms_async_rdma_sl": "3", 2024-09-13T06:39:25.281 INFO:teuthology.orchestra.run.smithi081.stdout: "ms_async_rdma_support_srq": "true", 2024-09-13T06:39:25.281 INFO:teuthology.orchestra.run.smithi081.stdout: "ms_async_rdma_type": "ib", 2024-09-13T06:39:25.281 INFO:teuthology.orchestra.run.smithi081.stdout: "ms_async_reap_threshold": "5", 2024-09-13T06:39:25.281 INFO:teuthology.orchestra.run.smithi081.stdout: "ms_bind_before_connect": "false", 2024-09-13T06:39:25.281 INFO:teuthology.orchestra.run.smithi081.stdout: "ms_bind_ipv4": "true", 2024-09-13T06:39:25.281 INFO:teuthology.orchestra.run.smithi081.stdout: "ms_bind_ipv6": "false", 2024-09-13T06:39:25.282 INFO:teuthology.orchestra.run.smithi081.stdout: "ms_bind_msgr1": "true", 2024-09-13T06:39:25.282 INFO:teuthology.orchestra.run.smithi081.stdout: "ms_bind_msgr2": "true", 2024-09-13T06:39:25.282 INFO:teuthology.orchestra.run.smithi081.stdout: "ms_bind_port_max": "7568", 2024-09-13T06:39:25.282 INFO:teuthology.orchestra.run.smithi081.stdout: "ms_bind_port_min": "6800", 2024-09-13T06:39:25.282 INFO:teuthology.orchestra.run.smithi081.stdout: "ms_bind_prefer_ipv4": "false", 2024-09-13T06:39:25.282 INFO:teuthology.orchestra.run.smithi081.stdout: "ms_bind_retry_count": "3", 2024-09-13T06:39:25.282 INFO:teuthology.orchestra.run.smithi081.stdout: "ms_bind_retry_delay": "5", 2024-09-13T06:39:25.282 INFO:teuthology.orchestra.run.smithi081.stdout: "ms_blackhole_client": "false", 2024-09-13T06:39:25.282 INFO:teuthology.orchestra.run.smithi081.stdout: "ms_blackhole_mds": "false", 2024-09-13T06:39:25.282 INFO:teuthology.orchestra.run.smithi081.stdout: "ms_blackhole_mgr": "false", 2024-09-13T06:39:25.282 INFO:teuthology.orchestra.run.smithi081.stdout: "ms_blackhole_mon": "false", 2024-09-13T06:39:25.282 INFO:teuthology.orchestra.run.smithi081.stdout: "ms_blackhole_osd": "false", 2024-09-13T06:39:25.282 INFO:teuthology.orchestra.run.smithi081.stdout: "ms_client_mode": "crc secure", 2024-09-13T06:39:25.283 INFO:teuthology.orchestra.run.smithi081.stdout: "ms_cluster_mode": "crc secure", 2024-09-13T06:39:25.283 INFO:teuthology.orchestra.run.smithi081.stdout: "ms_cluster_type": "", 2024-09-13T06:39:25.283 INFO:teuthology.orchestra.run.smithi081.stdout: "ms_compress_secure": "false", 2024-09-13T06:39:25.283 INFO:teuthology.orchestra.run.smithi081.stdout: "ms_connection_idle_timeout": "900", 2024-09-13T06:39:25.283 INFO:teuthology.orchestra.run.smithi081.stdout: "ms_connection_ready_timeout": "10", 2024-09-13T06:39:25.283 INFO:teuthology.orchestra.run.smithi081.stdout: "ms_crc_data": "true", 2024-09-13T06:39:25.283 INFO:teuthology.orchestra.run.smithi081.stdout: "ms_crc_header": "true", 2024-09-13T06:39:25.283 INFO:teuthology.orchestra.run.smithi081.stdout: "ms_die_on_bad_msg": "false", 2024-09-13T06:39:25.283 INFO:teuthology.orchestra.run.smithi081.stdout: "ms_die_on_bug": "true", 2024-09-13T06:39:25.283 INFO:teuthology.orchestra.run.smithi081.stdout: "ms_die_on_old_message": "true", 2024-09-13T06:39:25.283 INFO:teuthology.orchestra.run.smithi081.stdout: "ms_die_on_skipped_message": "false", 2024-09-13T06:39:25.283 INFO:teuthology.orchestra.run.smithi081.stdout: "ms_die_on_unhandled_msg": "false", 2024-09-13T06:39:25.283 INFO:teuthology.orchestra.run.smithi081.stdout: "ms_dispatch_throttle_bytes": "104857600", 2024-09-13T06:39:25.283 INFO:teuthology.orchestra.run.smithi081.stdout: "ms_dpdk_coremask": "0xF", 2024-09-13T06:39:25.284 INFO:teuthology.orchestra.run.smithi081.stdout: "ms_dpdk_debug_allow_loopback": "false", 2024-09-13T06:39:25.284 INFO:teuthology.orchestra.run.smithi081.stdout: "ms_dpdk_devs_allowlist": "", 2024-09-13T06:39:25.284 INFO:teuthology.orchestra.run.smithi081.stdout: "ms_dpdk_enable_tso": "true", 2024-09-13T06:39:25.284 INFO:teuthology.orchestra.run.smithi081.stdout: "ms_dpdk_gateway_ipv4_addr": "", 2024-09-13T06:39:25.284 INFO:teuthology.orchestra.run.smithi081.stdout: "ms_dpdk_host_ipv4_addr": "", 2024-09-13T06:39:25.284 INFO:teuthology.orchestra.run.smithi081.stdout: "ms_dpdk_hugepages": "", 2024-09-13T06:39:25.284 INFO:teuthology.orchestra.run.smithi081.stdout: "ms_dpdk_hw_flow_control": "true", 2024-09-13T06:39:25.284 INFO:teuthology.orchestra.run.smithi081.stdout: "ms_dpdk_hw_queue_weight": "1.000000", 2024-09-13T06:39:25.284 INFO:teuthology.orchestra.run.smithi081.stdout: "ms_dpdk_lro": "true", 2024-09-13T06:39:25.284 INFO:teuthology.orchestra.run.smithi081.stdout: "ms_dpdk_memory_channel": "4", 2024-09-13T06:39:25.284 INFO:teuthology.orchestra.run.smithi081.stdout: "ms_dpdk_netmask_ipv4_addr": "", 2024-09-13T06:39:25.284 INFO:teuthology.orchestra.run.smithi081.stdout: "ms_dpdk_pmd": "", 2024-09-13T06:39:25.284 INFO:teuthology.orchestra.run.smithi081.stdout: "ms_dpdk_port_id": "0", 2024-09-13T06:39:25.284 INFO:teuthology.orchestra.run.smithi081.stdout: "ms_dpdk_rx_buffer_count_per_core": "8192", 2024-09-13T06:39:25.285 INFO:teuthology.orchestra.run.smithi081.stdout: "ms_dump_corrupt_message_level": "1", 2024-09-13T06:39:25.285 INFO:teuthology.orchestra.run.smithi081.stdout: "ms_dump_on_send": "false", 2024-09-13T06:39:25.285 INFO:teuthology.orchestra.run.smithi081.stdout: "ms_initial_backoff": "0.200000", 2024-09-13T06:39:25.285 INFO:teuthology.orchestra.run.smithi081.stdout: "ms_inject_delay_max": "1.000000", 2024-09-13T06:39:25.285 INFO:teuthology.orchestra.run.smithi081.stdout: "ms_inject_delay_probability": "0.000000", 2024-09-13T06:39:25.285 INFO:teuthology.orchestra.run.smithi081.stdout: "ms_inject_delay_type": "", 2024-09-13T06:39:25.285 INFO:teuthology.orchestra.run.smithi081.stdout: "ms_inject_internal_delays": "0.000000", 2024-09-13T06:39:25.285 INFO:teuthology.orchestra.run.smithi081.stdout: "ms_inject_network_congestion": "0", 2024-09-13T06:39:25.285 INFO:teuthology.orchestra.run.smithi081.stdout: "ms_inject_socket_failures": "5000", 2024-09-13T06:39:25.285 INFO:teuthology.orchestra.run.smithi081.stdout: "ms_learn_addr_from_peer": "true", 2024-09-13T06:39:25.285 INFO:teuthology.orchestra.run.smithi081.stdout: "ms_max_accept_failures": "4", 2024-09-13T06:39:25.285 INFO:teuthology.orchestra.run.smithi081.stdout: "ms_max_backoff": "15.000000", 2024-09-13T06:39:25.285 INFO:teuthology.orchestra.run.smithi081.stdout: "ms_mon_client_mode": "secure crc", 2024-09-13T06:39:25.286 INFO:teuthology.orchestra.run.smithi081.stdout: "ms_mon_cluster_mode": "secure crc", 2024-09-13T06:39:25.286 INFO:teuthology.orchestra.run.smithi081.stdout: "ms_mon_service_mode": "secure crc", 2024-09-13T06:39:25.286 INFO:teuthology.orchestra.run.smithi081.stdout: "ms_osd_compress_min_size": "1024", 2024-09-13T06:39:25.286 INFO:teuthology.orchestra.run.smithi081.stdout: "ms_osd_compress_mode": "none", 2024-09-13T06:39:25.286 INFO:teuthology.orchestra.run.smithi081.stdout: "ms_osd_compression_algorithm": "snappy", 2024-09-13T06:39:25.286 INFO:teuthology.orchestra.run.smithi081.stdout: "ms_pq_max_tokens_per_priority": "16777216", 2024-09-13T06:39:25.286 INFO:teuthology.orchestra.run.smithi081.stdout: "ms_pq_min_cost": "65536", 2024-09-13T06:39:25.286 INFO:teuthology.orchestra.run.smithi081.stdout: "ms_public_type": "", 2024-09-13T06:39:25.286 INFO:teuthology.orchestra.run.smithi081.stdout: "ms_service_mode": "crc secure", 2024-09-13T06:39:25.286 INFO:teuthology.orchestra.run.smithi081.stdout: "ms_tcp_listen_backlog": "512", 2024-09-13T06:39:25.286 INFO:teuthology.orchestra.run.smithi081.stdout: "ms_tcp_nodelay": "true", 2024-09-13T06:39:25.286 INFO:teuthology.orchestra.run.smithi081.stdout: "ms_tcp_prefetch_max_size": "4096", 2024-09-13T06:39:25.286 INFO:teuthology.orchestra.run.smithi081.stdout: "ms_tcp_rcvbuf": "0", 2024-09-13T06:39:25.286 INFO:teuthology.orchestra.run.smithi081.stdout: "ms_type": "async+posix", 2024-09-13T06:39:25.287 INFO:teuthology.orchestra.run.smithi081.stdout: "no_config_file": "false", 2024-09-13T06:39:25.287 INFO:teuthology.orchestra.run.smithi081.stdout: "objecter_completion_locks_per_session": "32", 2024-09-13T06:39:25.287 INFO:teuthology.orchestra.run.smithi081.stdout: "objecter_debug_inject_relock_delay": "false", 2024-09-13T06:39:25.287 INFO:teuthology.orchestra.run.smithi081.stdout: "objecter_inflight_op_bytes": "104857600", 2024-09-13T06:39:25.287 INFO:teuthology.orchestra.run.smithi081.stdout: "objecter_inflight_ops": "1024", 2024-09-13T06:39:25.287 INFO:teuthology.orchestra.run.smithi081.stdout: "objecter_inject_no_watch_ping": "false", 2024-09-13T06:39:25.287 INFO:teuthology.orchestra.run.smithi081.stdout: "objecter_retry_writes_after_first_reply": "false", 2024-09-13T06:39:25.287 INFO:teuthology.orchestra.run.smithi081.stdout: "objecter_tick_interval": "5.000000", 2024-09-13T06:39:25.287 INFO:teuthology.orchestra.run.smithi081.stdout: "objecter_timeout": "10.000000", 2024-09-13T06:39:25.287 INFO:teuthology.orchestra.run.smithi081.stdout: "objectstore_blackhole": "false", 2024-09-13T06:39:25.287 INFO:teuthology.orchestra.run.smithi081.stdout: "openssl_engine_opts": "", 2024-09-13T06:39:25.287 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_agent_delay_time": "5.000000", 2024-09-13T06:39:25.288 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_agent_hist_halflife": "1000", 2024-09-13T06:39:25.288 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_agent_max_low_ops": "2", 2024-09-13T06:39:25.288 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_agent_max_ops": "4", 2024-09-13T06:39:25.288 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_agent_min_evict_effort": "0.100000", 2024-09-13T06:39:25.288 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_agent_quantize_effort": "0.100000", 2024-09-13T06:39:25.288 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_agent_slop": "0.020000", 2024-09-13T06:39:25.288 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_aggregated_slow_ops_logging": "true", 2024-09-13T06:39:25.288 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_allow_recovery_below_min_size": "true", 2024-09-13T06:39:25.288 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_asio_thread_count": "2", 2024-09-13T06:39:25.288 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_async_recovery_min_cost": "100", 2024-09-13T06:39:25.288 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_auto_mark_unfound_lost": "false", 2024-09-13T06:39:25.288 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_backfill_retry_interval": "30.000000", 2024-09-13T06:39:25.288 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_backfill_scan_max": "512", 2024-09-13T06:39:25.289 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_backfill_scan_min": "64", 2024-09-13T06:39:25.289 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_backoff_on_degraded": "false", 2024-09-13T06:39:25.289 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_backoff_on_peering": "false", 2024-09-13T06:39:25.289 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_backoff_on_unfound": "true", 2024-09-13T06:39:25.289 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_beacon_report_interval": "300", 2024-09-13T06:39:25.289 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_bench_duration": "30", 2024-09-13T06:39:25.289 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_bench_large_size_max_throughput": "104857600", 2024-09-13T06:39:25.289 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_bench_max_block_size": "67108864", 2024-09-13T06:39:25.289 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_bench_small_size_max_iops": "100", 2024-09-13T06:39:25.289 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_blkin_trace_all": "false", 2024-09-13T06:39:25.289 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_blocked_scrub_grace_period": "120", 2024-09-13T06:39:25.289 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_calc_pg_upmaps_aggressively": "true", 2024-09-13T06:39:25.290 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_calc_pg_upmaps_aggressively_fast": "true", 2024-09-13T06:39:25.290 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_calc_pg_upmaps_local_fallback_retries": "100", 2024-09-13T06:39:25.290 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_check_for_log_corruption": "false", 2024-09-13T06:39:25.290 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_check_max_object_name_len_on_startup": "true", 2024-09-13T06:39:25.290 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_class_default_list": "cephfs hello journal lock log numops otp rbd refcount rgw rgw_gc timeindex user version cas cmpomap queue 2pc_queue fifo", 2024-09-13T06:39:25.290 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_class_dir": "/usr/lib/rados-classes", 2024-09-13T06:39:25.290 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_class_load_list": "cephfs hello journal lock log numops otp rbd refcount rgw rgw_gc timeindex user version cas cmpomap queue 2pc_queue fifo", 2024-09-13T06:39:25.290 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_class_update_on_start": "true", 2024-09-13T06:39:25.290 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_client_message_cap": "256", 2024-09-13T06:39:25.290 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_client_message_size_cap": "524288000", 2024-09-13T06:39:25.290 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_client_op_priority": "63", 2024-09-13T06:39:25.290 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_client_watch_timeout": "30", 2024-09-13T06:39:25.291 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_command_max_records": "256", 2024-09-13T06:39:25.291 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_compact_on_start": "false", 2024-09-13T06:39:25.291 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_copyfrom_max_chunk": "8388608", 2024-09-13T06:39:25.291 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_crush_chooseleaf_type": "0", 2024-09-13T06:39:25.291 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_crush_initial_weight": "-1.000000", 2024-09-13T06:39:25.291 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_crush_update_on_start": "true", 2024-09-13T06:39:25.291 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_crush_update_weight_set": "true", 2024-09-13T06:39:25.291 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_data": "/var/lib/ceph/osd/ceph-a", 2024-09-13T06:39:25.291 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_debug_crash_on_ignored_backoff": "false", 2024-09-13T06:39:25.291 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_debug_deep_scrub_sleep": "0.000000", 2024-09-13T06:39:25.291 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_debug_drop_ping_duration": "0", 2024-09-13T06:39:25.291 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_debug_drop_ping_probability": "0.000000", 2024-09-13T06:39:25.291 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_debug_feed_pullee": "-1", 2024-09-13T06:39:25.292 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_debug_inject_copyfrom_error": "false", 2024-09-13T06:39:25.292 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_debug_inject_dispatch_delay_duration": "0.100000", 2024-09-13T06:39:25.292 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_debug_inject_dispatch_delay_probability": "0.000000", 2024-09-13T06:39:25.292 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_debug_misdirected_ops": "false", 2024-09-13T06:39:25.292 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_debug_no_acting_change": "false", 2024-09-13T06:39:25.292 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_debug_no_purge_strays": "false", 2024-09-13T06:39:25.292 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_debug_op_order": "false", 2024-09-13T06:39:25.292 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_debug_pg_log_writeout": "false", 2024-09-13T06:39:25.292 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_debug_pretend_recovery_active": "false", 2024-09-13T06:39:25.292 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_debug_random_push_read_error": "0.000000", 2024-09-13T06:39:25.292 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_debug_reject_backfill_probability": "0.000000", 2024-09-13T06:39:25.292 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_debug_shutdown": "false", 2024-09-13T06:39:25.293 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_debug_skip_full_check_in_backfill_reservation": "false", 2024-09-13T06:39:25.293 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_debug_skip_full_check_in_recovery": "false", 2024-09-13T06:39:25.293 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_debug_verify_cached_snaps": "false", 2024-09-13T06:39:25.293 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_debug_verify_missing_on_start": "false", 2024-09-13T06:39:25.293 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_debug_verify_snaps": "false", 2024-09-13T06:39:25.293 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_debug_verify_stray_on_activate": "false", 2024-09-13T06:39:25.293 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_deep_scrub_interval": "604800.000000", 2024-09-13T06:39:25.293 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_deep_scrub_keys": "1024", 2024-09-13T06:39:25.293 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_deep_scrub_large_omap_object_key_threshold": "200000", 2024-09-13T06:39:25.293 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_deep_scrub_large_omap_object_value_sum_threshold": "1073741824", 2024-09-13T06:39:25.293 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_deep_scrub_randomize_ratio": "0.150000", 2024-09-13T06:39:25.293 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_deep_scrub_stride": "524288", 2024-09-13T06:39:25.294 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_deep_scrub_update_digest_min_age": "7200", 2024-09-13T06:39:25.294 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_default_data_pool_replay_window": "5", 2024-09-13T06:39:25.294 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_default_notify_timeout": "30", 2024-09-13T06:39:25.294 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_delete_sleep": "0.000000", 2024-09-13T06:39:25.294 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_delete_sleep_hdd": "5.000000", 2024-09-13T06:39:25.294 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_delete_sleep_hybrid": "1.000000", 2024-09-13T06:39:25.294 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_delete_sleep_ssd": "1.000000", 2024-09-13T06:39:25.294 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_discard_disconnected_ops": "true", 2024-09-13T06:39:25.294 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_enable_op_tracker": "true", 2024-09-13T06:39:25.294 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_erasure_code_plugins": "jerasure lrc", 2024-09-13T06:39:25.294 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_extblkdev_plugins": "vdo", 2024-09-13T06:39:25.295 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_failsafe_full_ratio": "0.970000", 2024-09-13T06:39:25.295 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_fast_fail_on_connection_refused": "true", 2024-09-13T06:39:25.295 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_fast_info": "true", 2024-09-13T06:39:25.295 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_fast_shutdown": "true", 2024-09-13T06:39:25.295 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_fast_shutdown_notify_mon": "true", 2024-09-13T06:39:25.295 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_fast_shutdown_timeout": "15", 2024-09-13T06:39:25.295 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_find_best_info_ignore_history_les": "false", 2024-09-13T06:39:25.295 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_force_auth_primary_missing_objects": "100", 2024-09-13T06:39:25.295 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_force_recovery_pg_log_entries_factor": "1.300000", 2024-09-13T06:39:25.295 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_function_tracing": "false", 2024-09-13T06:39:25.295 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_heartbeat_grace": "20", 2024-09-13T06:39:25.296 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_heartbeat_interval": "6", 2024-09-13T06:39:25.296 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_heartbeat_min_healthy_ratio": "0.330000", 2024-09-13T06:39:25.296 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_heartbeat_min_peers": "10", 2024-09-13T06:39:25.296 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_heartbeat_min_size": "2000", 2024-09-13T06:39:25.296 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_heartbeat_stale": "600", 2024-09-13T06:39:25.296 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_heartbeat_use_min_delay_socket": "false", 2024-09-13T06:39:25.296 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_hit_set_max_size": "100000", 2024-09-13T06:39:25.296 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_hit_set_min_size": "1000", 2024-09-13T06:39:25.296 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_hit_set_namespace": ".ceph-internal", 2024-09-13T06:39:25.297 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_ignore_stale_divergent_priors": "false", 2024-09-13T06:39:25.297 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_inject_bad_map_crc_probability": "0.000000", 2024-09-13T06:39:25.297 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_inject_failure_on_pg_removal": "false", 2024-09-13T06:39:25.297 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_journal": "/var/lib/ceph/osd/ceph-a/journal", 2024-09-13T06:39:25.297 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_journal_flush_on_shutdown": "true", 2024-09-13T06:39:25.297 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_journal_size": "5120", 2024-09-13T06:39:25.297 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_kill_backfill_at": "0", 2024-09-13T06:39:25.297 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_loop_before_reset_tphandle": "64", 2024-09-13T06:39:25.297 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_map_cache_size": "50", 2024-09-13T06:39:25.297 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_map_dedup": "true", 2024-09-13T06:39:25.297 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_map_message_max": "40", 2024-09-13T06:39:25.297 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_map_message_max_bytes": "10485760", 2024-09-13T06:39:25.297 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_map_share_max_epochs": "40", 2024-09-13T06:39:25.298 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_max_attr_name_len": "100", 2024-09-13T06:39:25.298 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_max_attr_size": "0", 2024-09-13T06:39:25.298 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_max_backfills": "1", 2024-09-13T06:39:25.298 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_max_markdown_count": "5", 2024-09-13T06:39:25.298 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_max_markdown_period": "600", 2024-09-13T06:39:25.298 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_max_object_name_len": "2048", 2024-09-13T06:39:25.298 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_max_object_namespace_len": "256", 2024-09-13T06:39:25.298 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_max_object_size": "134217728", 2024-09-13T06:39:25.298 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_max_omap_bytes_per_request": "1073741824", 2024-09-13T06:39:25.298 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_max_omap_entries_per_request": "1024", 2024-09-13T06:39:25.298 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_max_pg_blocked_by": "16", 2024-09-13T06:39:25.298 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_max_pg_log_entries": "10000", 2024-09-13T06:39:25.298 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_max_pg_per_osd_hard_ratio": "3.000000", 2024-09-13T06:39:25.299 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_max_pgls": "1024", 2024-09-13T06:39:25.299 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_max_push_cost": "8388608", 2024-09-13T06:39:25.299 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_max_push_objects": "10", 2024-09-13T06:39:25.299 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_max_scrubs": "3", 2024-09-13T06:39:25.299 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_max_snap_prune_intervals_per_epoch": "512", 2024-09-13T06:39:25.299 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_max_trimming_pgs": "2", 2024-09-13T06:39:25.299 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_max_write_op_reply_len": "64", 2024-09-13T06:39:25.299 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_max_write_size": "90", 2024-09-13T06:39:25.299 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_mclock_force_run_benchmark_on_init": "false", 2024-09-13T06:39:25.299 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_mclock_iops_capacity_threshold_hdd": "500.000000", 2024-09-13T06:39:25.299 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_mclock_iops_capacity_threshold_ssd": "80000.000000", 2024-09-13T06:39:25.299 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_mclock_max_capacity_iops_hdd": "315.000000", 2024-09-13T06:39:25.299 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_mclock_max_capacity_iops_ssd": "21500.000000", 2024-09-13T06:39:25.299 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_mclock_max_sequential_bandwidth_hdd": "157286400", 2024-09-13T06:39:25.300 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_mclock_max_sequential_bandwidth_ssd": "1258291200", 2024-09-13T06:39:25.300 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_mclock_override_recovery_settings": "false", 2024-09-13T06:39:25.300 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_mclock_profile": "balanced", 2024-09-13T06:39:25.300 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_mclock_scheduler_anticipation_timeout": "0.000000", 2024-09-13T06:39:25.300 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_mclock_scheduler_background_best_effort_lim": "0.000000", 2024-09-13T06:39:25.300 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_mclock_scheduler_background_best_effort_res": "0.000000", 2024-09-13T06:39:25.300 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_mclock_scheduler_background_best_effort_wgt": "1", 2024-09-13T06:39:25.300 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_mclock_scheduler_background_recovery_lim": "0.000000", 2024-09-13T06:39:25.300 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_mclock_scheduler_background_recovery_res": "0.000000", 2024-09-13T06:39:25.300 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_mclock_scheduler_background_recovery_wgt": "1", 2024-09-13T06:39:25.300 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_mclock_scheduler_client_lim": "0.000000", 2024-09-13T06:39:25.300 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_mclock_scheduler_client_res": "0.000000", 2024-09-13T06:39:25.300 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_mclock_scheduler_client_wgt": "1", 2024-09-13T06:39:25.301 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_mclock_skip_benchmark": "false", 2024-09-13T06:39:25.301 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_memory_base": "805306368", 2024-09-13T06:39:25.301 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_memory_cache_min": "134217728", 2024-09-13T06:39:25.301 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_memory_cache_resize_interval": "1.000000", 2024-09-13T06:39:25.301 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_memory_expected_fragmentation": "0.150000", 2024-09-13T06:39:25.301 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_memory_target": "4294967296", 2024-09-13T06:39:25.301 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_memory_target_autotune": "false", 2024-09-13T06:39:25.301 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_memory_target_cgroup_limit_ratio": "0.800000", 2024-09-13T06:39:25.301 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_min_pg_log_entries": "250", 2024-09-13T06:39:25.301 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_min_recovery_priority": "0", 2024-09-13T06:39:25.301 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_mon_heartbeat_interval": "30", 2024-09-13T06:39:25.301 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_mon_heartbeat_stat_stale": "3600", 2024-09-13T06:39:25.302 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_mon_report_interval": "5", 2024-09-13T06:39:25.302 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_mon_report_max_in_flight": "2", 2024-09-13T06:39:25.302 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_mon_shutdown_timeout": "5.000000", 2024-09-13T06:39:25.302 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_num_cache_shards": "32", 2024-09-13T06:39:25.302 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_num_op_tracker_shard": "32", 2024-09-13T06:39:25.302 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_numa_auto_affinity": "true", 2024-09-13T06:39:25.302 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_numa_node": "-1", 2024-09-13T06:39:25.302 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_numa_prefer_iface": "true", 2024-09-13T06:39:25.302 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_object_clean_region_max_num_intervals": "10", 2024-09-13T06:39:25.302 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_objecter_finishers": "1", 2024-09-13T06:39:25.302 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_objectstore": "bluestore", 2024-09-13T06:39:25.302 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_objectstore_fuse": "false", 2024-09-13T06:39:25.302 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_objectstore_tracing": "false", 2024-09-13T06:39:25.303 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_op_complaint_time": "30.000000", 2024-09-13T06:39:25.303 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_op_history_duration": "600", 2024-09-13T06:39:25.303 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_op_history_size": "20", 2024-09-13T06:39:25.303 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_op_history_slow_op_size": "20", 2024-09-13T06:39:25.303 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_op_history_slow_op_threshold": "10.000000", 2024-09-13T06:39:25.303 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_op_log_threshold": "5", 2024-09-13T06:39:25.303 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_op_num_shards": "0", 2024-09-13T06:39:25.303 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_op_num_shards_hdd": "5", 2024-09-13T06:39:25.303 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_op_num_shards_ssd": "8", 2024-09-13T06:39:25.303 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_op_num_threads_per_shard": "0", 2024-09-13T06:39:25.303 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_op_num_threads_per_shard_hdd": "1", 2024-09-13T06:39:25.303 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_op_num_threads_per_shard_ssd": "2", 2024-09-13T06:39:25.304 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_op_pq_max_tokens_per_priority": "4194304", 2024-09-13T06:39:25.304 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_op_pq_min_cost": "65536", 2024-09-13T06:39:25.304 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_op_queue": "mclock_scheduler", 2024-09-13T06:39:25.304 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_op_queue_cut_off": "high", 2024-09-13T06:39:25.304 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_op_thread_suicide_timeout": "150", 2024-09-13T06:39:25.304 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_op_thread_timeout": "15", 2024-09-13T06:39:25.304 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_open_classes_on_start": "true", 2024-09-13T06:39:25.304 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_os_flags": "0", 2024-09-13T06:39:25.304 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_peering_op_priority": "255", 2024-09-13T06:39:25.304 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_pg_delete_cost": "1048576", 2024-09-13T06:39:25.304 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_pg_delete_priority": "5", 2024-09-13T06:39:25.304 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_pg_epoch_max_lag_factor": "2.000000", 2024-09-13T06:39:25.304 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_pg_epoch_persisted_max_stale": "40", 2024-09-13T06:39:25.305 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_pg_log_dups_tracked": "3000", 2024-09-13T06:39:25.305 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_pg_log_trim_max": "10000", 2024-09-13T06:39:25.305 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_pg_log_trim_min": "100", 2024-09-13T06:39:25.305 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_pg_max_concurrent_snap_trims": "2", 2024-09-13T06:39:25.305 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_pg_object_context_cache_count": "64", 2024-09-13T06:39:25.305 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_pg_stat_report_interval_max": "500", 2024-09-13T06:39:25.305 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_pool_default_cache_max_evict_check_size": "10", 2024-09-13T06:39:25.305 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_pool_default_cache_min_evict_age": "0", 2024-09-13T06:39:25.305 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_pool_default_cache_min_flush_age": "0", 2024-09-13T06:39:25.305 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_pool_default_cache_target_dirty_high_ratio": "0.600000", 2024-09-13T06:39:25.305 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_pool_default_cache_target_dirty_ratio": "0.400000", 2024-09-13T06:39:25.305 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_pool_default_cache_target_full_ratio": "0.800000", 2024-09-13T06:39:25.305 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_pool_default_crimson": "false", 2024-09-13T06:39:25.306 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_pool_default_crush_rule": "-1", 2024-09-13T06:39:25.306 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_pool_default_ec_fast_read": "false", 2024-09-13T06:39:25.306 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_pool_default_erasure_code_profile": "plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd", 2024-09-13T06:39:25.306 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_pool_default_flag_bulk": "false", 2024-09-13T06:39:25.306 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_pool_default_flag_hashpspool": "true", 2024-09-13T06:39:25.306 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_pool_default_flag_nodelete": "false", 2024-09-13T06:39:25.306 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_pool_default_flag_nopgchange": "false", 2024-09-13T06:39:25.306 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_pool_default_flag_nosizechange": "false", 2024-09-13T06:39:25.306 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_pool_default_flags": "0", 2024-09-13T06:39:25.306 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_pool_default_hit_set_bloom_fpp": "0.050000", 2024-09-13T06:39:25.306 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_pool_default_min_size": "0", 2024-09-13T06:39:25.306 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_pool_default_pg_autoscale_mode": "off", 2024-09-13T06:39:25.306 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_pool_default_pg_num": "32", 2024-09-13T06:39:25.307 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_pool_default_pgp_num": "0", 2024-09-13T06:39:25.307 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_pool_default_read_lease_ratio": "0.800000", 2024-09-13T06:39:25.307 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_pool_default_size": "2", 2024-09-13T06:39:25.307 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_pool_default_type": "replicated", 2024-09-13T06:39:25.307 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_pool_erasure_code_stripe_unit": "4096", 2024-09-13T06:39:25.307 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_pool_use_gmt_hitset": "true", 2024-09-13T06:39:25.307 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_push_per_object_cost": "1000", 2024-09-13T06:39:25.307 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_read_ec_check_for_errors": "false", 2024-09-13T06:39:25.307 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_recover_clone_overlap": "true", 2024-09-13T06:39:25.307 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_recover_clone_overlap_limit": "10", 2024-09-13T06:39:25.307 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_recovery_cost": "20971520", 2024-09-13T06:39:25.307 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_recovery_delay_start": "0.000000", 2024-09-13T06:39:25.307 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_recovery_max_active": "0", 2024-09-13T06:39:25.307 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_recovery_max_active_hdd": "3", 2024-09-13T06:39:25.308 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_recovery_max_active_ssd": "10", 2024-09-13T06:39:25.308 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_recovery_max_chunk": "8388608", 2024-09-13T06:39:25.308 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_recovery_max_omap_entries_per_chunk": "8096", 2024-09-13T06:39:25.308 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_recovery_max_single_start": "1", 2024-09-13T06:39:25.308 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_recovery_op_priority": "3", 2024-09-13T06:39:25.308 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_recovery_op_warn_multiple": "16", 2024-09-13T06:39:25.308 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_recovery_priority": "5", 2024-09-13T06:39:25.308 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_recovery_retry_interval": "30.000000", 2024-09-13T06:39:25.308 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_recovery_sleep": "0.000000", 2024-09-13T06:39:25.308 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_recovery_sleep_hdd": "0.100000", 2024-09-13T06:39:25.308 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_recovery_sleep_hybrid": "0.025000", 2024-09-13T06:39:25.308 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_recovery_sleep_ssd": "0.000000", 2024-09-13T06:39:25.309 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_repair_during_recovery": "false", 2024-09-13T06:39:25.309 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_requested_scrub_priority": "120", 2024-09-13T06:39:25.309 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_rocksdb_iterator_bounds_enabled": "true", 2024-09-13T06:39:25.309 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_rollback_to_cluster_snap": "", 2024-09-13T06:39:25.309 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_scrub_auto_repair": "false", 2024-09-13T06:39:25.309 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_scrub_auto_repair_num_errors": "5", 2024-09-13T06:39:25.309 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_scrub_backoff_ratio": "0.660000", 2024-09-13T06:39:25.309 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_scrub_begin_hour": "0", 2024-09-13T06:39:25.309 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_scrub_begin_week_day": "0", 2024-09-13T06:39:25.309 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_scrub_chunk_max": "25", 2024-09-13T06:39:25.309 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_scrub_chunk_min": "5", 2024-09-13T06:39:25.309 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_scrub_cost": "52428800", 2024-09-13T06:39:25.310 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_scrub_during_recovery": "false", 2024-09-13T06:39:25.310 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_scrub_end_hour": "0", 2024-09-13T06:39:25.310 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_scrub_end_week_day": "0", 2024-09-13T06:39:25.310 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_scrub_event_cost": "4096", 2024-09-13T06:39:25.310 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_scrub_extended_sleep": "0.000000", 2024-09-13T06:39:25.310 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_scrub_interval_randomize_ratio": "0.500000", 2024-09-13T06:39:25.310 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_scrub_invalid_stats": "true", 2024-09-13T06:39:25.310 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_scrub_load_threshold": "0.500000", 2024-09-13T06:39:25.310 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_scrub_max_interval": "604800.000000", 2024-09-13T06:39:25.310 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_scrub_max_preemptions": "5", 2024-09-13T06:39:25.310 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_scrub_min_interval": "86400.000000", 2024-09-13T06:39:25.310 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_scrub_priority": "5", 2024-09-13T06:39:25.310 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_scrub_reservation_timeout": "5000", 2024-09-13T06:39:25.311 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_scrub_sleep": "0.000000", 2024-09-13T06:39:25.311 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_scrub_slow_reservation_response": "2200", 2024-09-13T06:39:25.311 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_shallow_scrub_chunk_max": "100", 2024-09-13T06:39:25.311 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_shallow_scrub_chunk_min": "50", 2024-09-13T06:39:25.311 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_shutdown_pgref_assert": "false", 2024-09-13T06:39:25.311 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_skip_data_digest": "false", 2024-09-13T06:39:25.311 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_smart_report_timeout": "5", 2024-09-13T06:39:25.311 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_snap_trim_cost": "1048576", 2024-09-13T06:39:25.311 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_snap_trim_priority": "5", 2024-09-13T06:39:25.311 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_snap_trim_sleep": "0.000000", 2024-09-13T06:39:25.311 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_snap_trim_sleep_hdd": "5.000000", 2024-09-13T06:39:25.311 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_snap_trim_sleep_hybrid": "2.000000", 2024-09-13T06:39:25.311 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_snap_trim_sleep_ssd": "0.000000", 2024-09-13T06:39:25.311 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_stats_update_period_not_scrubbing": "120", 2024-09-13T06:39:25.312 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_stats_update_period_scrubbing": "15", 2024-09-13T06:39:25.312 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_target_pg_log_entries_per_osd": "300000", 2024-09-13T06:39:25.312 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_target_transaction_size": "30", 2024-09-13T06:39:25.312 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_tier_default_cache_hit_set_count": "4", 2024-09-13T06:39:25.312 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_tier_default_cache_hit_set_grade_decay_rate": "20", 2024-09-13T06:39:25.312 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_tier_default_cache_hit_set_period": "1200", 2024-09-13T06:39:25.312 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_tier_default_cache_hit_set_search_last_n": "1", 2024-09-13T06:39:25.312 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_tier_default_cache_hit_set_type": "bloom", 2024-09-13T06:39:25.312 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_tier_default_cache_min_read_recency_for_promote": "1", 2024-09-13T06:39:25.312 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_tier_default_cache_min_write_recency_for_promote": "1", 2024-09-13T06:39:25.312 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_tier_default_cache_mode": "writeback", 2024-09-13T06:39:25.312 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_tier_promote_max_bytes_sec": "5242880", 2024-09-13T06:39:25.313 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_tier_promote_max_objects_sec": "25", 2024-09-13T06:39:25.313 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_tracing": "false", 2024-09-13T06:39:25.313 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_use_stale_snap": "false", 2024-09-13T06:39:25.313 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_uuid": "00000000-0000-0000-0000-000000000000", 2024-09-13T06:39:25.313 INFO:teuthology.orchestra.run.smithi081.stdout: "osdc_blkin_trace_all": "false", 2024-09-13T06:39:25.313 INFO:teuthology.orchestra.run.smithi081.stdout: "paxos_kill_at": "0", 2024-09-13T06:39:25.313 INFO:teuthology.orchestra.run.smithi081.stdout: "paxos_max_join_drift": "10", 2024-09-13T06:39:25.313 INFO:teuthology.orchestra.run.smithi081.stdout: "paxos_min": "500", 2024-09-13T06:39:25.313 INFO:teuthology.orchestra.run.smithi081.stdout: "paxos_min_wait": "0.050000", 2024-09-13T06:39:25.313 INFO:teuthology.orchestra.run.smithi081.stdout: "paxos_propose_interval": "1.000000", 2024-09-13T06:39:25.313 INFO:teuthology.orchestra.run.smithi081.stdout: "paxos_service_trim_max": "500", 2024-09-13T06:39:25.313 INFO:teuthology.orchestra.run.smithi081.stdout: "paxos_service_trim_max_multiplier": "20", 2024-09-13T06:39:25.313 INFO:teuthology.orchestra.run.smithi081.stdout: "paxos_service_trim_min": "250", 2024-09-13T06:39:25.314 INFO:teuthology.orchestra.run.smithi081.stdout: "paxos_stash_full_interval": "25", 2024-09-13T06:39:25.314 INFO:teuthology.orchestra.run.smithi081.stdout: "paxos_trim_max": "500", 2024-09-13T06:39:25.314 INFO:teuthology.orchestra.run.smithi081.stdout: "paxos_trim_min": "250", 2024-09-13T06:39:25.314 INFO:teuthology.orchestra.run.smithi081.stdout: "perf": "true", 2024-09-13T06:39:25.314 INFO:teuthology.orchestra.run.smithi081.stdout: "pid_file": "/var/run/ceph/ceph-mon.a.pid", 2024-09-13T06:39:25.314 INFO:teuthology.orchestra.run.smithi081.stdout: "plugin_crypto_accelerator": "crypto_isal", 2024-09-13T06:39:25.314 INFO:teuthology.orchestra.run.smithi081.stdout: "plugin_dir": "/usr/lib/ceph", 2024-09-13T06:39:25.314 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "-", 2024-09-13T06:39:25.314 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrv": "", 2024-09-13T06:39:25.314 INFO:teuthology.orchestra.run.smithi081.stdout: "public_bind_addr": "-", 2024-09-13T06:39:25.314 INFO:teuthology.orchestra.run.smithi081.stdout: "public_network": "", 2024-09-13T06:39:25.314 INFO:teuthology.orchestra.run.smithi081.stdout: "public_network_interface": "", 2024-09-13T06:39:25.314 INFO:teuthology.orchestra.run.smithi081.stdout: "qat_compressor_enabled": "false", 2024-09-13T06:39:25.314 INFO:teuthology.orchestra.run.smithi081.stdout: "qat_compressor_session_max_number": "256", 2024-09-13T06:39:25.315 INFO:teuthology.orchestra.run.smithi081.stdout: "rados_mon_op_timeout": "0", 2024-09-13T06:39:25.315 INFO:teuthology.orchestra.run.smithi081.stdout: "rados_osd_op_timeout": "0", 2024-09-13T06:39:25.315 INFO:teuthology.orchestra.run.smithi081.stdout: "rados_tracing": "false", 2024-09-13T06:39:25.315 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_atime_update_interval": "60", 2024-09-13T06:39:25.315 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_auto_exclusive_lock_until_manual_request": "true", 2024-09-13T06:39:25.315 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_balance_parent_reads": "false", 2024-09-13T06:39:25.315 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_balance_snap_reads": "false", 2024-09-13T06:39:25.315 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_blkin_trace_all": "false", 2024-09-13T06:39:25.315 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_blocklist_expire_seconds": "0", 2024-09-13T06:39:25.315 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_blocklist_on_break_lock": "true", 2024-09-13T06:39:25.315 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_cache": "true", 2024-09-13T06:39:25.315 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_cache_block_writes_upfront": "false", 2024-09-13T06:39:25.315 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_cache_max_dirty": "25165824", 2024-09-13T06:39:25.315 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_cache_max_dirty_age": "1.000000", 2024-09-13T06:39:25.316 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_cache_max_dirty_object": "0", 2024-09-13T06:39:25.316 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_cache_policy": "writearound", 2024-09-13T06:39:25.316 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_cache_size": "33554432", 2024-09-13T06:39:25.316 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_cache_target_dirty": "16777216", 2024-09-13T06:39:25.316 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_cache_writethrough_until_flush": "true", 2024-09-13T06:39:25.316 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_clone_copy_on_read": "false", 2024-09-13T06:39:25.316 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_compression_hint": "none", 2024-09-13T06:39:25.316 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_concurrent_management_ops": "10", 2024-09-13T06:39:25.316 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_config_pool_override_update_timestamp": "0", 2024-09-13T06:39:25.316 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_default_clone_format": "auto", 2024-09-13T06:39:25.316 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_default_data_pool": "", 2024-09-13T06:39:25.316 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_default_features": "61", 2024-09-13T06:39:25.316 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_default_format": "2", 2024-09-13T06:39:25.317 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_default_map_options": "", 2024-09-13T06:39:25.317 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_default_order": "22", 2024-09-13T06:39:25.317 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_default_pool": "rbd", 2024-09-13T06:39:25.317 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_default_snapshot_quiesce_mode": "required", 2024-09-13T06:39:25.317 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_default_stripe_count": "0", 2024-09-13T06:39:25.317 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_default_stripe_unit": "0", 2024-09-13T06:39:25.317 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_disable_zero_copy_writes": "true", 2024-09-13T06:39:25.317 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_discard_granularity_bytes": "65536", 2024-09-13T06:39:25.317 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_discard_on_zeroed_write_same": "true", 2024-09-13T06:39:25.317 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_enable_alloc_hint": "true", 2024-09-13T06:39:25.317 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_invalidate_object_map_on_timeout": "true", 2024-09-13T06:39:25.317 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_io_scheduler": "simple", 2024-09-13T06:39:25.317 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_io_scheduler_simple_max_delay": "0", 2024-09-13T06:39:25.318 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_journal_commit_age": "5.000000", 2024-09-13T06:39:25.318 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_journal_max_concurrent_object_sets": "0", 2024-09-13T06:39:25.318 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_journal_max_payload_bytes": "16384", 2024-09-13T06:39:25.318 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_journal_object_flush_age": "0.000000", 2024-09-13T06:39:25.318 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_journal_object_flush_bytes": "1048576", 2024-09-13T06:39:25.318 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_journal_object_flush_interval": "0", 2024-09-13T06:39:25.318 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_journal_object_max_in_flight_appends": "0", 2024-09-13T06:39:25.318 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_journal_object_writethrough_until_flush": "true", 2024-09-13T06:39:25.318 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_journal_order": "24", 2024-09-13T06:39:25.318 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_journal_pool": "", 2024-09-13T06:39:25.318 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_journal_splay_width": "4", 2024-09-13T06:39:25.318 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_localize_parent_reads": "false", 2024-09-13T06:39:25.318 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_localize_snap_reads": "false", 2024-09-13T06:39:25.319 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_mirror_concurrent_image_deletions": "1", 2024-09-13T06:39:25.319 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_mirror_concurrent_image_syncs": "5", 2024-09-13T06:39:25.319 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_mirror_delete_retry_interval": "30.000000", 2024-09-13T06:39:25.319 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_mirror_image_perf_stats_prio": "5", 2024-09-13T06:39:25.319 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_mirror_image_policy_migration_throttle": "300", 2024-09-13T06:39:25.319 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_mirror_image_policy_rebalance_timeout": "0.000000", 2024-09-13T06:39:25.319 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_mirror_image_policy_type": "simple", 2024-09-13T06:39:25.319 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_mirror_image_policy_update_throttle_interval": "1.000000", 2024-09-13T06:39:25.319 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_mirror_image_state_check_interval": "30", 2024-09-13T06:39:25.320 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_mirror_journal_commit_age": "5.000000", 2024-09-13T06:39:25.320 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_mirror_journal_poll_age": "5.000000", 2024-09-13T06:39:25.320 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_mirror_leader_heartbeat_interval": "5", 2024-09-13T06:39:25.320 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_mirror_leader_max_acquire_attempts_before_break": "3", 2024-09-13T06:39:25.320 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_mirror_leader_max_missed_heartbeats": "2", 2024-09-13T06:39:25.320 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_mirror_memory_autotune": "true", 2024-09-13T06:39:25.320 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_mirror_memory_base": "805306368", 2024-09-13T06:39:25.320 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_mirror_memory_cache_autotune_interval": "30.000000", 2024-09-13T06:39:25.320 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_mirror_memory_cache_min": "134217728", 2024-09-13T06:39:25.320 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_mirror_memory_cache_resize_interval": "5.000000", 2024-09-13T06:39:25.320 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_mirror_memory_expected_fragmentation": "0.150000", 2024-09-13T06:39:25.320 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_mirror_memory_target": "4294967296", 2024-09-13T06:39:25.320 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_mirror_perf_stats_prio": "5", 2024-09-13T06:39:25.321 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_mirror_pool_replayers_refresh_interval": "30", 2024-09-13T06:39:25.321 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_mirror_sync_point_update_age": "30.000000", 2024-09-13T06:39:25.321 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_mirroring_delete_delay": "0", 2024-09-13T06:39:25.321 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_mirroring_max_mirroring_snapshots": "5", 2024-09-13T06:39:25.321 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_mirroring_replay_delay": "0", 2024-09-13T06:39:25.321 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_mirroring_resync_after_disconnect": "false", 2024-09-13T06:39:25.321 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_move_parent_to_trash_on_remove": "false", 2024-09-13T06:39:25.321 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_move_to_trash_on_remove": "false", 2024-09-13T06:39:25.321 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_move_to_trash_on_remove_expire_seconds": "0", 2024-09-13T06:39:25.321 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_mtime_update_interval": "60", 2024-09-13T06:39:25.321 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_non_blocking_aio": "true", 2024-09-13T06:39:25.321 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_op_thread_timeout": "60", 2024-09-13T06:39:25.321 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_op_threads": "1", 2024-09-13T06:39:25.321 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_parent_cache_enabled": "false", 2024-09-13T06:39:25.322 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_persistent_cache_mode": "disabled", 2024-09-13T06:39:25.322 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_persistent_cache_path": "/tmp", 2024-09-13T06:39:25.322 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_persistent_cache_size": "1073741824", 2024-09-13T06:39:25.322 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_plugins": "", 2024-09-13T06:39:25.322 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_qos_bps_burst": "0", 2024-09-13T06:39:25.322 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_qos_bps_burst_seconds": "1", 2024-09-13T06:39:25.322 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_qos_bps_limit": "0", 2024-09-13T06:39:25.322 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_qos_exclude_ops": "0", 2024-09-13T06:39:25.322 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_qos_iops_burst": "0", 2024-09-13T06:39:25.322 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_qos_iops_burst_seconds": "1", 2024-09-13T06:39:25.322 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_qos_iops_limit": "0", 2024-09-13T06:39:25.322 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_qos_read_bps_burst": "0", 2024-09-13T06:39:25.322 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_qos_read_bps_burst_seconds": "1", 2024-09-13T06:39:25.322 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_qos_read_bps_limit": "0", 2024-09-13T06:39:25.323 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_qos_read_iops_burst": "0", 2024-09-13T06:39:25.323 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_qos_read_iops_burst_seconds": "1", 2024-09-13T06:39:25.323 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_qos_read_iops_limit": "0", 2024-09-13T06:39:25.323 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_qos_schedule_tick_min": "50", 2024-09-13T06:39:25.323 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_qos_write_bps_burst": "0", 2024-09-13T06:39:25.323 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_qos_write_bps_burst_seconds": "1", 2024-09-13T06:39:25.323 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_qos_write_bps_limit": "0", 2024-09-13T06:39:25.323 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_qos_write_iops_burst": "0", 2024-09-13T06:39:25.323 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_qos_write_iops_burst_seconds": "1", 2024-09-13T06:39:25.323 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_qos_write_iops_limit": "0", 2024-09-13T06:39:25.323 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_quiesce_notification_attempts": "10", 2024-09-13T06:39:25.323 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_read_from_replica_policy": "default", 2024-09-13T06:39:25.323 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_readahead_disable_after_bytes": "52428800", 2024-09-13T06:39:25.324 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_readahead_max_bytes": "524288", 2024-09-13T06:39:25.324 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_readahead_trigger_requests": "10", 2024-09-13T06:39:25.324 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_request_timed_out_seconds": "30", 2024-09-13T06:39:25.324 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_skip_partial_discard": "true", 2024-09-13T06:39:25.324 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_sparse_read_threshold_bytes": "65536", 2024-09-13T06:39:25.324 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_tracing": "false", 2024-09-13T06:39:25.324 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_validate_names": "true", 2024-09-13T06:39:25.324 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_validate_pool": "true", 2024-09-13T06:39:25.324 INFO:teuthology.orchestra.run.smithi081.stdout: "restapi_base_url": "", 2024-09-13T06:39:25.324 INFO:teuthology.orchestra.run.smithi081.stdout: "restapi_log_level": "", 2024-09-13T06:39:25.324 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_acl_grants_max_num": "100", 2024-09-13T06:39:25.324 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_admin_entry": "admin", 2024-09-13T06:39:25.324 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_allow_notification_secrets_in_cleartext": "false", 2024-09-13T06:39:25.325 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_backend_store": "rados", 2024-09-13T06:39:25.325 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_barbican_url": "", 2024-09-13T06:39:25.325 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_beast_enable_async": "true", 2024-09-13T06:39:25.325 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_bucket_default_quota_max_objects": "-1", 2024-09-13T06:39:25.325 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_bucket_default_quota_max_size": "-1", 2024-09-13T06:39:25.325 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_bucket_index_max_aio": "128", 2024-09-13T06:39:25.325 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_bucket_index_transaction_instrumentation": "false", 2024-09-13T06:39:25.325 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_bucket_quota_cache_size": "10000", 2024-09-13T06:39:25.325 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_bucket_quota_ttl": "600", 2024-09-13T06:39:25.325 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_bucket_sync_spawn_window": "20", 2024-09-13T06:39:25.325 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_cache_enabled": "true", 2024-09-13T06:39:25.325 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_cache_expiry_interval": "900", 2024-09-13T06:39:25.325 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_cache_lru_size": "10000", 2024-09-13T06:39:25.326 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_config_store": "rados", 2024-09-13T06:39:25.326 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_content_length_compat": "false", 2024-09-13T06:39:25.326 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_copy_obj_progress": "true", 2024-09-13T06:39:25.326 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_copy_obj_progress_every_bytes": "1048576", 2024-09-13T06:39:25.326 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_cors_rules_max_num": "100", 2024-09-13T06:39:25.326 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_cross_domain_policy": "", 2024-09-13T06:39:25.326 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_crypt_default_encryption_key": "", 2024-09-13T06:39:25.326 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_crypt_kmip_addr": "", 2024-09-13T06:39:25.326 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_crypt_kmip_ca_path": "", 2024-09-13T06:39:25.326 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_crypt_kmip_client_cert": "", 2024-09-13T06:39:25.326 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_crypt_kmip_client_key": "", 2024-09-13T06:39:25.326 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_crypt_kmip_kms_key_template": "", 2024-09-13T06:39:25.326 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_crypt_kmip_password": "", 2024-09-13T06:39:25.326 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_crypt_kmip_s3_key_template": "$keyid", 2024-09-13T06:39:25.327 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_crypt_kmip_username": "", 2024-09-13T06:39:25.327 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_crypt_require_ssl": "true", 2024-09-13T06:39:25.327 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_crypt_s3_kms_backend": "barbican", 2024-09-13T06:39:25.327 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_crypt_s3_kms_encryption_keys": "", 2024-09-13T06:39:25.327 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_crypt_sse_s3_backend": "vault", 2024-09-13T06:39:25.327 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_crypt_sse_s3_key_template": "%bucket_id", 2024-09-13T06:39:25.327 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_crypt_sse_s3_vault_addr": "", 2024-09-13T06:39:25.327 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_crypt_sse_s3_vault_auth": "token", 2024-09-13T06:39:25.327 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_crypt_sse_s3_vault_namespace": "", 2024-09-13T06:39:25.327 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_crypt_sse_s3_vault_prefix": "", 2024-09-13T06:39:25.327 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_crypt_sse_s3_vault_secret_engine": "transit", 2024-09-13T06:39:25.327 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_crypt_sse_s3_vault_ssl_cacert": "", 2024-09-13T06:39:25.327 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_crypt_sse_s3_vault_ssl_clientcert": "", 2024-09-13T06:39:25.327 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_crypt_sse_s3_vault_ssl_clientkey": "", 2024-09-13T06:39:25.328 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_crypt_sse_s3_vault_token_file": "", 2024-09-13T06:39:25.328 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_crypt_sse_s3_vault_verify_ssl": "true", 2024-09-13T06:39:25.328 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_crypt_suppress_logs": "true", 2024-09-13T06:39:25.328 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_crypt_vault_addr": "", 2024-09-13T06:39:25.328 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_crypt_vault_auth": "token", 2024-09-13T06:39:25.328 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_crypt_vault_namespace": "", 2024-09-13T06:39:25.328 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_crypt_vault_prefix": "", 2024-09-13T06:39:25.328 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_crypt_vault_secret_engine": "transit", 2024-09-13T06:39:25.328 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_crypt_vault_ssl_cacert": "", 2024-09-13T06:39:25.328 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_crypt_vault_ssl_clientcert": "", 2024-09-13T06:39:25.328 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_crypt_vault_ssl_clientkey": "", 2024-09-13T06:39:25.328 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_crypt_vault_token_file": "", 2024-09-13T06:39:25.329 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_crypt_vault_verify_ssl": "true", 2024-09-13T06:39:25.329 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_curl_buffersize": "524288", 2024-09-13T06:39:25.329 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_curl_low_speed_limit": "1024", 2024-09-13T06:39:25.329 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_curl_low_speed_time": "300", 2024-09-13T06:39:25.329 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_curl_tcp_keepalive": "0", 2024-09-13T06:39:25.329 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_curl_wait_timeout_ms": "1000", 2024-09-13T06:39:25.329 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_d3n_l1_datacache_persistent_path": "/tmp/rgw_datacache/", 2024-09-13T06:39:25.329 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_d3n_l1_datacache_size": "1073741824", 2024-09-13T06:39:25.329 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_d3n_l1_evict_cache_on_start": "true", 2024-09-13T06:39:25.329 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_d3n_l1_eviction_policy": "lru", 2024-09-13T06:39:25.329 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_d3n_l1_fadvise": "4", 2024-09-13T06:39:25.329 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_d3n_l1_local_datacache_enabled": "false", 2024-09-13T06:39:25.329 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_d3n_libaio_aio_num": "64", 2024-09-13T06:39:25.330 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_d3n_libaio_aio_threads": "20", 2024-09-13T06:39:25.330 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_data": "/var/lib/ceph/radosgw/ceph-a", 2024-09-13T06:39:25.330 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_data_log_changes_size": "1000", 2024-09-13T06:39:25.330 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_data_log_num_shards": "128", 2024-09-13T06:39:25.330 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_data_log_obj_prefix": "data_log", 2024-09-13T06:39:25.330 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_data_log_window": "30", 2024-09-13T06:39:25.330 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_data_notify_interval_msec": "0", 2024-09-13T06:39:25.330 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_data_sync_poll_interval": "20", 2024-09-13T06:39:25.330 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_data_sync_spawn_window": "20", 2024-09-13T06:39:25.330 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_debug_inject_olh_cancel_modification_err": "false", 2024-09-13T06:39:25.330 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_debug_inject_set_olh_err": "0", 2024-09-13T06:39:25.330 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_default_data_log_backing": "fifo", 2024-09-13T06:39:25.330 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_default_realm_info_oid": "default.realm", 2024-09-13T06:39:25.330 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_default_region_info_oid": "default.region", 2024-09-13T06:39:25.331 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_default_zone_info_oid": "default.zone", 2024-09-13T06:39:25.331 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_default_zonegroup_info_oid": "default.zonegroup", 2024-09-13T06:39:25.331 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_defer_to_bucket_acls": "", 2024-09-13T06:39:25.331 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_delete_multi_obj_max_num": "1000", 2024-09-13T06:39:25.331 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_dmclock_admin_lim": "0.000000", 2024-09-13T06:39:25.331 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_dmclock_admin_res": "100.000000", 2024-09-13T06:39:25.331 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_dmclock_admin_wgt": "100.000000", 2024-09-13T06:39:25.331 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_dmclock_auth_lim": "0.000000", 2024-09-13T06:39:25.331 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_dmclock_auth_res": "200.000000", 2024-09-13T06:39:25.331 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_dmclock_auth_wgt": "100.000000", 2024-09-13T06:39:25.331 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_dmclock_data_lim": "0.000000", 2024-09-13T06:39:25.331 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_dmclock_data_res": "500.000000", 2024-09-13T06:39:25.331 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_dmclock_data_wgt": "500.000000", 2024-09-13T06:39:25.331 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_dmclock_metadata_lim": "0.000000", 2024-09-13T06:39:25.332 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_dmclock_metadata_res": "500.000000", 2024-09-13T06:39:25.332 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_dmclock_metadata_wgt": "500.000000", 2024-09-13T06:39:25.332 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_dns_name": "", 2024-09-13T06:39:25.332 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_dns_s3website_name": "", 2024-09-13T06:39:25.332 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_dynamic_resharding": "true", 2024-09-13T06:39:25.332 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_enable_apis": "s3, s3website, swift, swift_auth, admin, sts, iam, notifications", 2024-09-13T06:39:25.332 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_enable_gc_threads": "true", 2024-09-13T06:39:25.332 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_enable_lc_threads": "true", 2024-09-13T06:39:25.332 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_enable_ops_log": "false", 2024-09-13T06:39:25.332 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_enable_quota_threads": "true", 2024-09-13T06:39:25.332 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_enable_static_website": "false", 2024-09-13T06:39:25.332 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_enable_usage_log": "false", 2024-09-13T06:39:25.332 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_enforce_swift_acls": "true", 2024-09-13T06:39:25.333 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_exit_timeout_secs": "120", 2024-09-13T06:39:25.333 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_expose_bucket": "false", 2024-09-13T06:39:25.333 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_extended_http_attrs": "", 2024-09-13T06:39:25.333 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_filter": "none", 2024-09-13T06:39:25.333 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_frontend_defaults": "beast ssl_certificate=config://rgw/cert/$realm/$zone.crt ssl_private_key=config://rgw/cert/$realm/$zone.key", 2024-09-13T06:39:25.333 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_frontends": "beast port=7480", 2024-09-13T06:39:25.333 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_gc_max_concurrent_io": "10", 2024-09-13T06:39:25.333 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_gc_max_deferred": "50", 2024-09-13T06:39:25.333 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_gc_max_deferred_entries_size": "3072", 2024-09-13T06:39:25.333 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_gc_max_objs": "32", 2024-09-13T06:39:25.333 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_gc_max_queue_size": "134213632", 2024-09-13T06:39:25.333 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_gc_max_trim_chunk": "16", 2024-09-13T06:39:25.334 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_gc_obj_min_wait": "7200", 2024-09-13T06:39:25.334 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_gc_processor_max_time": "3600", 2024-09-13T06:39:25.334 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_gc_processor_period": "3600", 2024-09-13T06:39:25.334 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_get_obj_max_req_size": "4194304", 2024-09-13T06:39:25.334 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_get_obj_window_size": "16777216", 2024-09-13T06:39:25.334 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_healthcheck_disabling_path": "", 2024-09-13T06:39:25.334 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_ignore_get_invalid_range": "false", 2024-09-13T06:39:25.334 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_init_timeout": "300", 2024-09-13T06:39:25.334 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_inject_notify_timeout_probability": "0.000000", 2024-09-13T06:39:25.334 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_json_config": "/var/lib/ceph/radosgw/config.json", 2024-09-13T06:39:25.334 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_keystone_accepted_admin_roles": "", 2024-09-13T06:39:25.334 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_keystone_accepted_roles": "Member, admin", 2024-09-13T06:39:25.334 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_keystone_admin_domain": "", 2024-09-13T06:39:25.335 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_keystone_admin_password": "", 2024-09-13T06:39:25.335 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_keystone_admin_password_path": "", 2024-09-13T06:39:25.335 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_keystone_admin_project": "", 2024-09-13T06:39:25.335 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_keystone_admin_tenant": "", 2024-09-13T06:39:25.335 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_keystone_admin_token": "", 2024-09-13T06:39:25.335 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_keystone_admin_token_path": "", 2024-09-13T06:39:25.335 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_keystone_admin_user": "", 2024-09-13T06:39:25.335 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_keystone_api_version": "2", 2024-09-13T06:39:25.335 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_keystone_barbican_domain": "", 2024-09-13T06:39:25.335 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_keystone_barbican_password": "", 2024-09-13T06:39:25.335 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_keystone_barbican_project": "", 2024-09-13T06:39:25.335 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_keystone_barbican_tenant": "", 2024-09-13T06:39:25.335 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_keystone_barbican_user": "", 2024-09-13T06:39:25.335 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_keystone_expired_token_cache_expiration": "3600", 2024-09-13T06:39:25.335 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_keystone_implicit_tenants": "false", 2024-09-13T06:39:25.336 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_keystone_service_token_accepted_roles": "admin", 2024-09-13T06:39:25.336 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_keystone_service_token_enabled": "false", 2024-09-13T06:39:25.336 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_keystone_token_cache_size": "10000", 2024-09-13T06:39:25.336 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_keystone_url": "", 2024-09-13T06:39:25.336 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_keystone_verify_ssl": "true", 2024-09-13T06:39:25.336 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_lc_debug_interval": "-1", 2024-09-13T06:39:25.336 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_lc_lock_max_time": "90", 2024-09-13T06:39:25.336 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_lc_max_objs": "32", 2024-09-13T06:39:25.336 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_lc_max_rules": "1000", 2024-09-13T06:39:25.336 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_lc_max_worker": "3", 2024-09-13T06:39:25.336 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_lc_max_wp_worker": "3", 2024-09-13T06:39:25.336 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_lc_thread_delay": "0", 2024-09-13T06:39:25.336 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_ldap_binddn": "uid=admin,cn=users,dc=example,dc=com", 2024-09-13T06:39:25.336 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_ldap_dnattr": "uid", 2024-09-13T06:39:25.336 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_ldap_searchdn": "cn=users,cn=accounts,dc=example,dc=com", 2024-09-13T06:39:25.337 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_ldap_searchfilter": "", 2024-09-13T06:39:25.337 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_ldap_secret": "/etc/openldap/secret", 2024-09-13T06:39:25.337 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_ldap_uri": "ldaps://", 2024-09-13T06:39:25.337 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_lifecycle_work_time": "00:00-06:00", 2024-09-13T06:39:25.337 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_list_bucket_min_readahead": "1000", 2024-09-13T06:39:25.337 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_list_buckets_max_chunk": "1000", 2024-09-13T06:39:25.337 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_log_http_headers": "", 2024-09-13T06:39:25.337 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_log_nonexistent_bucket": "false", 2024-09-13T06:39:25.337 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_log_object_name": "%Y-%m-%d-%H-%i-%n", 2024-09-13T06:39:25.337 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_log_object_name_utc": "false", 2024-09-13T06:39:25.337 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_luarocks_location": "/tmp/luarocks", 2024-09-13T06:39:25.337 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_max_attr_name_len": "0", 2024-09-13T06:39:25.337 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_max_attr_size": "0", 2024-09-13T06:39:25.337 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_max_attrs_num_in_req": "0", 2024-09-13T06:39:25.337 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_max_chunk_size": "4194304", 2024-09-13T06:39:25.338 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_max_concurrent_requests": "1024", 2024-09-13T06:39:25.338 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_max_copy_obj_concurrent_io": "10", 2024-09-13T06:39:25.338 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_max_dynamic_shards": "1999", 2024-09-13T06:39:25.338 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_max_listing_results": "1000", 2024-09-13T06:39:25.338 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_max_notify_retries": "10", 2024-09-13T06:39:25.338 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_max_objs_per_shard": "100000", 2024-09-13T06:39:25.338 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_max_put_param_size": "1048576", 2024-09-13T06:39:25.338 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_max_put_size": "5368709120", 2024-09-13T06:39:25.338 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_max_slo_entries": "1000", 2024-09-13T06:39:25.338 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_md_log_max_shards": "64", 2024-09-13T06:39:25.338 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_md_notify_interval_msec": "200", 2024-09-13T06:39:25.338 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_meta_sync_poll_interval": "20", 2024-09-13T06:39:25.338 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_meta_sync_spawn_window": "20", 2024-09-13T06:39:25.338 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_mime_types_file": "/etc/mime.types", 2024-09-13T06:39:25.338 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_mp_lock_max_time": "600", 2024-09-13T06:39:25.339 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_multi_obj_del_max_aio": "16", 2024-09-13T06:39:25.339 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_multipart_min_part_size": "5242880", 2024-09-13T06:39:25.339 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_multipart_part_upload_limit": "10000", 2024-09-13T06:39:25.339 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_nfs_fhcache_partitions": "3", 2024-09-13T06:39:25.339 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_nfs_fhcache_size": "2017", 2024-09-13T06:39:25.339 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_nfs_frontends": "rgw-nfs", 2024-09-13T06:39:25.339 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_nfs_lru_lane_hiwat": "911", 2024-09-13T06:39:25.339 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_nfs_lru_lanes": "5", 2024-09-13T06:39:25.339 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_nfs_max_gc": "300", 2024-09-13T06:39:25.339 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_nfs_namespace_expire_secs": "300", 2024-09-13T06:39:25.339 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_nfs_run_gc_threads": "false", 2024-09-13T06:39:25.339 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_nfs_run_lc_threads": "false", 2024-09-13T06:39:25.339 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_nfs_run_quota_threads": "false", 2024-09-13T06:39:25.339 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_nfs_run_sync_thread": "false", 2024-09-13T06:39:25.340 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_nfs_s3_fast_attrs": "false", 2024-09-13T06:39:25.340 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_nfs_write_completion_interval_s": "10", 2024-09-13T06:39:25.340 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_num_async_rados_threads": "32", 2024-09-13T06:39:25.340 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_num_control_oids": "8", 2024-09-13T06:39:25.340 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_numa_node": "-1", 2024-09-13T06:39:25.340 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_obj_stripe_size": "4194304", 2024-09-13T06:39:25.340 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_obj_tombstone_cache_size": "1000", 2024-09-13T06:39:25.340 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_objexp_chunk_size": "100", 2024-09-13T06:39:25.340 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_objexp_gc_interval": "600", 2024-09-13T06:39:25.340 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_objexp_hints_num_shards": "127", 2024-09-13T06:39:25.340 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_olh_pending_timeout_sec": "3600", 2024-09-13T06:39:25.340 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_op_thread_suicide_timeout": "0", 2024-09-13T06:39:25.340 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_op_thread_timeout": "600", 2024-09-13T06:39:25.340 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_op_tracing": "false", 2024-09-13T06:39:25.341 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_opa_token": "", 2024-09-13T06:39:25.341 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_opa_url": "", 2024-09-13T06:39:25.341 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_opa_verify_ssl": "true", 2024-09-13T06:39:25.341 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_ops_log_data_backlog": "5242880", 2024-09-13T06:39:25.341 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_ops_log_file_path": "/var/log/ceph/ops-log-ceph-mon.a.log", 2024-09-13T06:39:25.341 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_ops_log_rados": "false", 2024-09-13T06:39:25.341 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_ops_log_socket_path": "", 2024-09-13T06:39:25.341 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_override_bucket_index_max_shards": "0", 2024-09-13T06:39:25.341 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_pending_bucket_index_op_expiration": "120", 2024-09-13T06:39:25.341 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_period_latest_epoch_info_oid": ".latest_epoch", 2024-09-13T06:39:25.341 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_period_push_interval": "2.000000", 2024-09-13T06:39:25.341 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_period_push_interval_max": "30.000000", 2024-09-13T06:39:25.341 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_period_root_pool": ".rgw.root", 2024-09-13T06:39:25.342 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_policy_reject_invalid_principals": "true", 2024-09-13T06:39:25.342 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_print_continue": "true", 2024-09-13T06:39:25.342 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_print_prohibited_content_length": "false", 2024-09-13T06:39:25.342 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_put_obj_max_window_size": "67108864", 2024-09-13T06:39:25.342 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_put_obj_min_window_size": "16777216", 2024-09-13T06:39:25.342 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_rados_pool_autoscale_bias": "4.000000", 2024-09-13T06:39:25.342 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_rados_pool_recovery_priority": "5", 2024-09-13T06:39:25.342 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_rados_tracing": "false", 2024-09-13T06:39:25.342 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_realm": "", 2024-09-13T06:39:25.342 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_realm_id": "", 2024-09-13T06:39:25.342 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_realm_root_pool": ".rgw.root", 2024-09-13T06:39:25.342 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_region": "", 2024-09-13T06:39:25.342 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_region_root_pool": ".rgw.root", 2024-09-13T06:39:25.342 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_relaxed_region_enforcement": "false", 2024-09-13T06:39:25.343 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_relaxed_s3_bucket_names": "false", 2024-09-13T06:39:25.343 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_remote_addr_param": "REMOTE_ADDR", 2024-09-13T06:39:25.343 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_request_uri": "", 2024-09-13T06:39:25.343 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_reshard_batch_size": "64", 2024-09-13T06:39:25.343 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_reshard_bucket_lock_duration": "360", 2024-09-13T06:39:25.343 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_reshard_max_aio": "128", 2024-09-13T06:39:25.343 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_reshard_num_logs": "16", 2024-09-13T06:39:25.343 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_reshard_thread_interval": "600", 2024-09-13T06:39:25.343 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_resolve_cname": "false", 2024-09-13T06:39:25.343 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_rest_getusage_op_compat": "false", 2024-09-13T06:39:25.343 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_run_sync_thread": "true", 2024-09-13T06:39:25.343 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_s3_auth_order": "sts, external, local", 2024-09-13T06:39:25.343 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_s3_auth_use_keystone": "false", 2024-09-13T06:39:25.343 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_s3_auth_use_ldap": "false", 2024-09-13T06:39:25.344 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_s3_auth_use_rados": "true", 2024-09-13T06:39:25.344 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_s3_auth_use_sts": "false", 2024-09-13T06:39:25.344 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_s3_client_max_sig_ver": "-1", 2024-09-13T06:39:25.344 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_s3_success_create_obj_status": "0", 2024-09-13T06:39:25.344 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_safe_max_objects_per_shard": "102400", 2024-09-13T06:39:25.344 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_scheduler_type": "throttler", 2024-09-13T06:39:25.344 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_script_uri": "", 2024-09-13T06:39:25.344 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_service_provider_name": "", 2024-09-13T06:39:25.344 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_shard_warning_threshold": "90.000000", 2024-09-13T06:39:25.344 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_sts_client_id": "", 2024-09-13T06:39:25.344 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_sts_client_secret": "", 2024-09-13T06:39:25.344 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_sts_entry": "sts", 2024-09-13T06:39:25.344 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_sts_key": "sts", 2024-09-13T06:39:25.344 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_sts_max_session_duration": "43200", 2024-09-13T06:39:25.345 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_sts_min_session_duration": "900", 2024-09-13T06:39:25.345 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_sts_token_introspection_url": "", 2024-09-13T06:39:25.345 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_swift_account_in_url": "false", 2024-09-13T06:39:25.345 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_swift_auth_entry": "auth", 2024-09-13T06:39:25.345 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_swift_auth_url": "", 2024-09-13T06:39:25.345 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_swift_custom_header": "", 2024-09-13T06:39:25.345 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_swift_enforce_content_length": "false", 2024-09-13T06:39:25.345 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_swift_need_stats": "true", 2024-09-13T06:39:25.345 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_swift_tenant_name": "", 2024-09-13T06:39:25.345 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_swift_token_expiration": "86400", 2024-09-13T06:39:25.345 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_swift_url": "", 2024-09-13T06:39:25.346 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_swift_url_prefix": "swift", 2024-09-13T06:39:25.346 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_swift_versioning_enabled": "false", 2024-09-13T06:39:25.346 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_sync_data_full_inject_err_probability": "0.000000", 2024-09-13T06:39:25.346 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_sync_data_inject_err_probability": "0.000000", 2024-09-13T06:39:25.346 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_sync_lease_period": "120", 2024-09-13T06:39:25.346 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_sync_log_trim_concurrent_buckets": "4", 2024-09-13T06:39:25.346 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_sync_log_trim_interval": "1200", 2024-09-13T06:39:25.346 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_sync_log_trim_max_buckets": "16", 2024-09-13T06:39:25.346 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_sync_log_trim_min_cold_buckets": "4", 2024-09-13T06:39:25.346 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_sync_meta_inject_err_probability": "0.000000", 2024-09-13T06:39:25.346 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_sync_obj_etag_verify": "false", 2024-09-13T06:39:25.346 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_sync_trace_history_size": "4096", 2024-09-13T06:39:25.346 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_sync_trace_per_node_log_size": "32", 2024-09-13T06:39:25.346 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_sync_trace_servicemap_update_interval": "10", 2024-09-13T06:39:25.347 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_thread_pool_size": "512", 2024-09-13T06:39:25.347 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_torrent_comment": "", 2024-09-13T06:39:25.347 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_torrent_createby": "", 2024-09-13T06:39:25.347 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_torrent_encoding": "", 2024-09-13T06:39:25.347 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_torrent_flag": "false", 2024-09-13T06:39:25.347 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_torrent_origin": "", 2024-09-13T06:39:25.347 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_torrent_sha_unit": "524288", 2024-09-13T06:39:25.347 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_torrent_tracker": "", 2024-09-13T06:39:25.347 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_trust_forwarded_https": "false", 2024-09-13T06:39:25.347 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_usage_log_flush_threshold": "1024", 2024-09-13T06:39:25.347 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_usage_log_tick_interval": "30", 2024-09-13T06:39:25.347 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_usage_max_shards": "32", 2024-09-13T06:39:25.347 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_usage_max_user_shards": "1", 2024-09-13T06:39:25.348 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_use_opa_authz": "false", 2024-09-13T06:39:25.348 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_user_default_quota_max_objects": "-1", 2024-09-13T06:39:25.348 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_user_default_quota_max_size": "-1", 2024-09-13T06:39:25.348 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_user_max_buckets": "1000", 2024-09-13T06:39:25.348 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_user_policies_max_num": "100", 2024-09-13T06:39:25.348 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_user_quota_bucket_sync_interval": "180", 2024-09-13T06:39:25.348 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_user_quota_sync_idle_users": "false", 2024-09-13T06:39:25.348 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_user_quota_sync_interval": "86400", 2024-09-13T06:39:25.348 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_user_quota_sync_wait_time": "86400", 2024-09-13T06:39:25.348 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_user_unique_email": "true", 2024-09-13T06:39:25.348 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_verify_ssl": "true", 2024-09-13T06:39:25.348 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_website_routing_rules_max_num": "50", 2024-09-13T06:39:25.348 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_zone": "", 2024-09-13T06:39:25.349 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_zone_id": "", 2024-09-13T06:39:25.349 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_zone_root_pool": ".rgw.root", 2024-09-13T06:39:25.349 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_zonegroup": "", 2024-09-13T06:39:25.349 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_zonegroup_id": "", 2024-09-13T06:39:25.349 INFO:teuthology.orchestra.run.smithi081.stdout: "rgw_zonegroup_root_pool": ".rgw.root", 2024-09-13T06:39:25.349 INFO:teuthology.orchestra.run.smithi081.stdout: "rgwlc_auto_session_clear": "true", 2024-09-13T06:39:25.349 INFO:teuthology.orchestra.run.smithi081.stdout: "rgwlc_skip_bucket_step": "false", 2024-09-13T06:39:25.349 INFO:teuthology.orchestra.run.smithi081.stdout: "rocksdb_block_size": "4096", 2024-09-13T06:39:25.349 INFO:teuthology.orchestra.run.smithi081.stdout: "rocksdb_bloom_bits_per_key": "20", 2024-09-13T06:39:25.349 INFO:teuthology.orchestra.run.smithi081.stdout: "rocksdb_cache_index_and_filter_blocks": "true", 2024-09-13T06:39:25.349 INFO:teuthology.orchestra.run.smithi081.stdout: "rocksdb_cache_index_and_filter_blocks_with_high_priority": "false", 2024-09-13T06:39:25.349 INFO:teuthology.orchestra.run.smithi081.stdout: "rocksdb_cache_row_ratio": "0.000000", 2024-09-13T06:39:25.350 INFO:teuthology.orchestra.run.smithi081.stdout: "rocksdb_cache_shard_bits": "4", 2024-09-13T06:39:25.350 INFO:teuthology.orchestra.run.smithi081.stdout: "rocksdb_cache_size": "536870912", 2024-09-13T06:39:25.350 INFO:teuthology.orchestra.run.smithi081.stdout: "rocksdb_cache_type": "binned_lru", 2024-09-13T06:39:25.350 INFO:teuthology.orchestra.run.smithi081.stdout: "rocksdb_cf_compact_on_deletion": "true", 2024-09-13T06:39:25.350 INFO:teuthology.orchestra.run.smithi081.stdout: "rocksdb_cf_compact_on_deletion_sliding_window": "32768", 2024-09-13T06:39:25.350 INFO:teuthology.orchestra.run.smithi081.stdout: "rocksdb_cf_compact_on_deletion_trigger": "16384", 2024-09-13T06:39:25.350 INFO:teuthology.orchestra.run.smithi081.stdout: "rocksdb_collect_compaction_stats": "false", 2024-09-13T06:39:25.350 INFO:teuthology.orchestra.run.smithi081.stdout: "rocksdb_collect_extended_stats": "false", 2024-09-13T06:39:25.350 INFO:teuthology.orchestra.run.smithi081.stdout: "rocksdb_collect_memory_stats": "false", 2024-09-13T06:39:25.350 INFO:teuthology.orchestra.run.smithi081.stdout: "rocksdb_delete_range_threshold": "1048576", 2024-09-13T06:39:25.350 INFO:teuthology.orchestra.run.smithi081.stdout: "rocksdb_index_type": "binary_search", 2024-09-13T06:39:25.350 INFO:teuthology.orchestra.run.smithi081.stdout: "rocksdb_log_to_ceph_log": "true", 2024-09-13T06:39:25.350 INFO:teuthology.orchestra.run.smithi081.stdout: "rocksdb_metadata_block_size": "4096", 2024-09-13T06:39:25.351 INFO:teuthology.orchestra.run.smithi081.stdout: "rocksdb_partition_filters": "false", 2024-09-13T06:39:25.351 INFO:teuthology.orchestra.run.smithi081.stdout: "rocksdb_perf": "false", 2024-09-13T06:39:25.351 INFO:teuthology.orchestra.run.smithi081.stdout: "rocksdb_pin_l0_filter_and_index_blocks_in_cache": "false", 2024-09-13T06:39:25.351 INFO:teuthology.orchestra.run.smithi081.stdout: "rotating_keys_bootstrap_timeout": "30", 2024-09-13T06:39:25.351 INFO:teuthology.orchestra.run.smithi081.stdout: "rotating_keys_renewal_timeout": "10", 2024-09-13T06:39:25.351 INFO:teuthology.orchestra.run.smithi081.stdout: "run_dir": "/var/run/ceph", 2024-09-13T06:39:25.351 INFO:teuthology.orchestra.run.smithi081.stdout: "seastore_block_create": "true", 2024-09-13T06:39:25.351 INFO:teuthology.orchestra.run.smithi081.stdout: "seastore_cache_lru_size": "67108864", 2024-09-13T06:39:25.351 INFO:teuthology.orchestra.run.smithi081.stdout: "seastore_cbjournal_size": "5368709120", 2024-09-13T06:39:25.351 INFO:teuthology.orchestra.run.smithi081.stdout: "seastore_default_max_object_size": "16777216", 2024-09-13T06:39:25.351 INFO:teuthology.orchestra.run.smithi081.stdout: "seastore_default_object_metadata_reservation": "16777216", 2024-09-13T06:39:25.351 INFO:teuthology.orchestra.run.smithi081.stdout: "seastore_device_size": "53687091200", 2024-09-13T06:39:25.351 INFO:teuthology.orchestra.run.smithi081.stdout: "seastore_journal_batch_capacity": "16", 2024-09-13T06:39:25.351 INFO:teuthology.orchestra.run.smithi081.stdout: "seastore_journal_batch_flush_size": "16777216", 2024-09-13T06:39:25.352 INFO:teuthology.orchestra.run.smithi081.stdout: "seastore_journal_batch_preferred_fullness": "0.950000", 2024-09-13T06:39:25.352 INFO:teuthology.orchestra.run.smithi081.stdout: "seastore_journal_iodepth_limit": "5", 2024-09-13T06:39:25.352 INFO:teuthology.orchestra.run.smithi081.stdout: "seastore_main_device_type": "SSD", 2024-09-13T06:39:25.352 INFO:teuthology.orchestra.run.smithi081.stdout: "seastore_max_concurrent_transactions": "8", 2024-09-13T06:39:25.352 INFO:teuthology.orchestra.run.smithi081.stdout: "seastore_multiple_tiers_default_evict_ratio": "0.600000", 2024-09-13T06:39:25.352 INFO:teuthology.orchestra.run.smithi081.stdout: "seastore_multiple_tiers_fast_evict_ratio": "0.700000", 2024-09-13T06:39:25.352 INFO:teuthology.orchestra.run.smithi081.stdout: "seastore_multiple_tiers_stop_evict_ratio": "0.500000", 2024-09-13T06:39:25.352 INFO:teuthology.orchestra.run.smithi081.stdout: "seastore_obj_data_write_amplification": "1.250000", 2024-09-13T06:39:25.352 INFO:teuthology.orchestra.run.smithi081.stdout: "seastore_segment_size": "67108864", 2024-09-13T06:39:25.352 INFO:teuthology.orchestra.run.smithi081.stdout: "set_keepcaps": "false", 2024-09-13T06:39:25.352 INFO:teuthology.orchestra.run.smithi081.stdout: "setgroup": "", 2024-09-13T06:39:25.352 INFO:teuthology.orchestra.run.smithi081.stdout: "setuser": "", 2024-09-13T06:39:25.352 INFO:teuthology.orchestra.run.smithi081.stdout: "setuser_match_path": "", 2024-09-13T06:39:25.353 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_misplaced_ratio": "0.050000", 2024-09-13T06:39:25.353 INFO:teuthology.orchestra.run.smithi081.stdout: "thp": "false", 2024-09-13T06:39:25.353 INFO:teuthology.orchestra.run.smithi081.stdout: "threadpool_default_timeout": "60", 2024-09-13T06:39:25.353 INFO:teuthology.orchestra.run.smithi081.stdout: "threadpool_empty_queue_max_wait": "2", 2024-09-13T06:39:25.353 INFO:teuthology.orchestra.run.smithi081.stdout: "throttler_perf_counter": "true" 2024-09-13T06:39:25.353 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:39:25.355 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=0 2024-09-13T06:39:25.493 INFO:teuthology.orchestra.run.smithi081.stdout:mon.a: {} 2024-09-13T06:39:25.493 INFO:teuthology.orchestra.run.smithi081.stderr:mon.a: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-13T06:39:25.506 INFO:teuthology.orchestra.run.smithi081.stdout:mon.b: {} 2024-09-13T06:39:25.506 INFO:teuthology.orchestra.run.smithi081.stderr:mon.b: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-13T06:39:25.516 INFO:teuthology.orchestra.run.smithi081.stdout:mon.c: {} 2024-09-13T06:39:25.516 INFO:teuthology.orchestra.run.smithi081.stderr:mon.c: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-13T06:39:25.532 DEBUG:teuthology.orchestra.run.smithi139:> type ceph-objectstore-tool 2024-09-13T06:39:25.538 INFO:teuthology.orchestra.run.smithi139.stdout:ceph-objectstore-tool is /usr/bin/ceph-objectstore-tool 2024-09-13T06:39:25.538 DEBUG:teuthology.orchestra.run.smithi081:> type ceph-objectstore-tool 2024-09-13T06:39:25.541 INFO:teuthology.orchestra.run.smithi081.stdout:ceph-objectstore-tool is /usr/bin/ceph-objectstore-tool 2024-09-13T06:39:25.542 INFO:teuthology.run_tasks:Running task rbd_fsx... 2024-09-13T06:39:25.573 INFO:tasks.rbd_fsx:starting rbd_fsx... 2024-09-13T06:39:25.573 INFO:tasks.thrashosds.thrasher:starting do_thrash 2024-09-13T06:39:25.573 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-13T06:39:25.574 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-13T06:39:25.574 INFO:tasks.thrashosds.thrasher:inject_pause on osd.7 2024-09-13T06:39:25.574 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-09-13T06:39:25.574 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-09-13T06:39:25.574 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok config set filestore_inject_stall 3 2024-09-13T06:39:25.574 INFO:tasks.thrashosds.thrasher:starting do_sighup with a delay of 0.1 2024-09-13T06:39:25.575 INFO:tasks.thrashosds.thrasher:starting do_optrack_toggle with a delay of 2.0 2024-09-13T06:39:25.575 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-13T06:39:25.575 INFO:tasks.thrashosds.thrasher:starting do_dump_ops 2024-09-13T06:39:25.575 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-13T06:39:25.576 INFO:tasks.thrashosds.thrasher:starting do_noscrub_toggle with a delay of 2.0 2024-09-13T06:39:25.576 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-13T06:39:25.576 DEBUG:teuthology.orchestra.run.smithi081:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph_test_librbd_fsx --cluster ceph --id 0 -d -W -R -p 100 -P /home/ubuntu/cephtest/archive -r 1 -w 1 -t 1 -h 1 -l 250000000 -S 0 -N 6000 -g pool_client.0 image_client.0 2024-09-13T06:39:25.584 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:39:25.587+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:39:25.599 INFO:teuthology.orchestra.run.smithi081.stdout:mapped writes DISABLED 2024-09-13T06:39:25.599 INFO:teuthology.orchestra.run.smithi081.stdout:mapped reads DISABLED 2024-09-13T06:39:25.599 INFO:teuthology.orchestra.run.smithi081.stdout:Seed set to 8494 2024-09-13T06:39:25.676 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:39:25.679+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:39:25.701 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:39:25.701 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-13T06:39:25.702 INFO:teuthology.orchestra.run.smithi081.stdout: "num_ops": 0 2024-09-13T06:39:25.702 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:39:25.709 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:39:25.709 INFO:teuthology.orchestra.run.smithi139.stdout: "success": "filestore_inject_stall = '' (not observed, change may require restart) " 2024-09-13T06:39:25.709 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:39:25.716 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-13T06:39:25.717 INFO:teuthology.orchestra.run.smithi081.stdout:osd.0: {} 2024-09-13T06:39:25.717 INFO:teuthology.orchestra.run.smithi081.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-13T06:39:25.734 INFO:teuthology.orchestra.run.smithi081.stdout:osd.1: {} 2024-09-13T06:39:25.734 INFO:teuthology.orchestra.run.smithi081.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-13T06:39:25.751 INFO:teuthology.orchestra.run.smithi081.stdout:osd.2: {} 2024-09-13T06:39:25.751 INFO:teuthology.orchestra.run.smithi081.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-13T06:39:25.768 INFO:teuthology.orchestra.run.smithi081.stdout:osd.3: {} 2024-09-13T06:39:25.769 INFO:teuthology.orchestra.run.smithi081.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-13T06:39:25.777 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:39:25.778+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:39:25.788 INFO:teuthology.orchestra.run.smithi081.stdout:osd.4: {} 2024-09-13T06:39:25.789 INFO:teuthology.orchestra.run.smithi081.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-13T06:39:25.809 INFO:teuthology.orchestra.run.smithi081.stdout:osd.5: {} 2024-09-13T06:39:25.809 INFO:teuthology.orchestra.run.smithi081.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-13T06:39:25.825 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:39:25.826 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:39:25.828 INFO:teuthology.orchestra.run.smithi081.stdout:osd.6: {} 2024-09-13T06:39:25.828 INFO:teuthology.orchestra.run.smithi081.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-13T06:39:25.838 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-13T06:39:25.847 INFO:teuthology.orchestra.run.smithi081.stdout:osd.7: {} 2024-09-13T06:39:25.848 INFO:teuthology.orchestra.run.smithi081.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-13T06:39:25.907 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:39:25.911+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:39:25.952 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:39:25.952 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:39:25.965 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-13T06:39:26.007 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:39:26.011+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:39:26.080 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:39:26.083+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:39:26.125 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:39:26.125 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:39:26.137 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-13T06:39:26.181 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:39:26.183+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:39:26.282 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:39:26.283+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:39:26.297 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:39:26.297 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:39:26.311 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-13T06:39:26.340 INFO:teuthology.orchestra.run.smithi081.stderr:noscrub is set 2024-09-13T06:39:26.411 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:39:26.415+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:39:26.465 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:39:26.465 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:39:26.477 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-13T06:39:26.519 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:39:26.523+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:39:26.584 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:39:26.587+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:39:26.634 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:39:26.634 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:39:26.647 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-13T06:39:26.691 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:39:26.695+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:39:26.786 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:39:26.787+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:39:26.804 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:39:26.804 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:39:26.816 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-13T06:39:26.907 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:39:26.911+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:39:26.976 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:39:26.976 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:39:26.988 INFO:tasks.ceph.osd.6.smithi139.stderr:2024-09-13T06:39:26.990+0000 7fcd02c5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26385) UID: 0 2024-09-13T06:39:26.990 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-13T06:39:27.088 INFO:tasks.ceph.osd.6.smithi139.stderr:2024-09-13T06:39:27.090+0000 7fcd02c5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26385) UID: 0 2024-09-13T06:39:27.155 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:39:27.155 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:39:27.170 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-13T06:39:27.215 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:39:27.219+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:39:27.285 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:39:27.286 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:39:27.289 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:39:27.291+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:39:27.299 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-13T06:39:27.393 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:39:27.390+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:39:27.469 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:39:27.470 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:39:27.484 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-13T06:39:27.532 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-13T06:39:27.534+0000 7f86a5f06640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26387) UID: 0 2024-09-13T06:39:27.590 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:39:27.591+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:39:27.615 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:39:27.616 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:39:27.630 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-13T06:39:27.720 INFO:tasks.ceph.osd.6.smithi139.stderr:2024-09-13T06:39:27.722+0000 7fcd02c5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26385) UID: 0 2024-09-13T06:39:27.792 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:39:27.794+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:39:27.795 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:39:27.795 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:39:27.809 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-13T06:39:27.864 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-13T06:39:27.911 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:39:27.915+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:39:27.973 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:39:27.973 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:39:27.987 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-13T06:39:27.993 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:39:27.995+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:39:28.017 INFO:teuthology.orchestra.run.smithi081.stdout:osd.0: {} 2024-09-13T06:39:28.017 INFO:teuthology.orchestra.run.smithi081.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-13T06:39:28.033 INFO:teuthology.orchestra.run.smithi081.stdout:osd.1: {} 2024-09-13T06:39:28.033 INFO:teuthology.orchestra.run.smithi081.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-13T06:39:28.049 INFO:teuthology.orchestra.run.smithi081.stdout:osd.2: {} 2024-09-13T06:39:28.049 INFO:teuthology.orchestra.run.smithi081.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-13T06:39:28.065 INFO:teuthology.orchestra.run.smithi081.stdout:osd.3: {} 2024-09-13T06:39:28.065 INFO:teuthology.orchestra.run.smithi081.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-13T06:39:28.090 INFO:teuthology.orchestra.run.smithi081.stdout:osd.4: {} 2024-09-13T06:39:28.090 INFO:teuthology.orchestra.run.smithi081.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-13T06:39:28.095 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:39:28.094+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:39:28.104 INFO:teuthology.orchestra.run.smithi081.stdout:osd.5: {} 2024-09-13T06:39:28.104 INFO:teuthology.orchestra.run.smithi081.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-13T06:39:28.111 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:39:28.111 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [], 2024-09-13T06:39:28.111 INFO:teuthology.orchestra.run.smithi139.stdout: "num_ops": 0 2024-09-13T06:39:28.111 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:39:28.125 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-13T06:39:28.127 INFO:teuthology.orchestra.run.smithi081.stdout:osd.6: {} 2024-09-13T06:39:28.127 INFO:teuthology.orchestra.run.smithi081.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-13T06:39:28.151 INFO:teuthology.orchestra.run.smithi081.stdout:osd.7: {} 2024-09-13T06:39:28.152 INFO:teuthology.orchestra.run.smithi081.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-13T06:39:28.218 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:39:28.219+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:39:28.296 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:39:28.297 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [], 2024-09-13T06:39:28.297 INFO:teuthology.orchestra.run.smithi139.stdout: "complaint_time": 30, 2024-09-13T06:39:28.297 INFO:teuthology.orchestra.run.smithi139.stdout: "num_blocked_ops": 0 2024-09-13T06:39:28.297 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:39:28.309 INFO:tasks.ceph.osd.6.smithi139.stderr:2024-09-13T06:39:28.298+0000 7fcd02c5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26385) UID: 0 2024-09-13T06:39:28.312 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-13T06:39:28.366 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-13T06:39:28.420 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:39:28.423+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:39:28.482 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:39:28.482 INFO:teuthology.orchestra.run.smithi139.stdout: "size": 20, 2024-09-13T06:39:28.482 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 600, 2024-09-13T06:39:28.482 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [ 2024-09-13T06:39:28.482 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:28.482 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4217.0:1 2.3 2:c4c92e5a:::rbd_trash:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-13T06:39:28.482 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:17.541252+0000", 2024-09-13T06:39:28.482 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 10.944216814000001, 2024-09-13T06:39:28.482 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.002248969, 2024-09-13T06:39:28.483 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:39:28.483 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:28.483 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:39:28.483 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4217", 2024-09-13T06:39:28.483 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/2059993504", 2024-09-13T06:39:28.483 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 1 2024-09-13T06:39:28.483 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:28.483 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:39:28.483 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:28.483 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:39:28.483 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:17.541252+0000", 2024-09-13T06:39:28.483 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:28.483 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:28.483 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:28.484 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:39:28.484 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:17.541252+0000", 2024-09-13T06:39:28.484 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:28.484 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:28.484 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:28.484 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:39:28.484 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:17.541245+0000", 2024-09-13T06:39:28.484 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999928 2024-09-13T06:39:28.484 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:28.484 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:28.484 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:39:28.484 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:17.541262+0000", 2024-09-13T06:39:28.484 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6390000000000001e-05 2024-09-13T06:39:28.485 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:28.485 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:28.485 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:39:28.485 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:17.541283+0000", 2024-09-13T06:39:28.485 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.1285999999999999e-05 2024-09-13T06:39:28.485 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:28.485 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:28.485 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:39:28.485 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:17.541306+0000", 2024-09-13T06:39:28.485 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.2917000000000001e-05 2024-09-13T06:39:28.485 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:28.485 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:28.485 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:39:28.485 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:17.541441+0000", 2024-09-13T06:39:28.486 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000134979 2024-09-13T06:39:28.486 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:28.486 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:28.486 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:39:28.486 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:17.541717+0000", 2024-09-13T06:39:28.486 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00027572799999999999 2024-09-13T06:39:28.486 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:28.486 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:28.486 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 2", 2024-09-13T06:39:28.486 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:17.541954+0000", 2024-09-13T06:39:28.486 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00023709499999999999 2024-09-13T06:39:28.486 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:28.486 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:28.487 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-13T06:39:28.487 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:17.542997+0000", 2024-09-13T06:39:28.487 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0010437720000000001 2024-09-13T06:39:28.487 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:28.487 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:28.487 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:39:28.487 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:17.543368+0000", 2024-09-13T06:39:28.487 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00037039000000000001 2024-09-13T06:39:28.487 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:28.487 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:28.487 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-13T06:39:28.487 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:17.543444+0000", 2024-09-13T06:39:28.487 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5796000000000004e-05 2024-09-13T06:39:28.487 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:28.488 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:28.488 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:39:28.488 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:17.543501+0000", 2024-09-13T06:39:28.488 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.7673000000000002e-05 2024-09-13T06:39:28.488 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:28.488 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:39:28.488 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:28.488 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:28.488 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:28.488 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop_reply(client.4217.0:1 2.3 e18/17 ondisk, result = 0)", 2024-09-13T06:39:28.488 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:17.543215+0000", 2024-09-13T06:39:28.488 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 10.942253656, 2024-09-13T06:39:28.488 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00029769799999999999, 2024-09-13T06:39:28.489 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:39:28.489 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:39:28.489 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:39:28.489 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:28.489 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:39:28.489 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:17.543215+0000", 2024-09-13T06:39:28.489 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:28.489 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:28.489 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:28.489 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:39:28.489 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:17.543215+0000", 2024-09-13T06:39:28.489 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:28.489 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:28.490 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:28.490 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:39:28.490 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:17.543214+0000", 2024-09-13T06:39:28.490 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999981 2024-09-13T06:39:28.490 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:28.490 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:28.490 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:39:28.490 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:17.543226+0000", 2024-09-13T06:39:28.490 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2663000000000001e-05 2024-09-13T06:39:28.490 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:28.490 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:28.490 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:39:28.490 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:17.543248+0000", 2024-09-13T06:39:28.490 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.1654e-05 2024-09-13T06:39:28.491 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:28.491 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:28.491 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:39:28.491 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:17.543261+0000", 2024-09-13T06:39:28.491 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2775999999999999e-05 2024-09-13T06:39:28.491 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:28.491 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:28.491 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:39:28.491 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:17.543344+0000", 2024-09-13T06:39:28.491 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.3459000000000002e-05 2024-09-13T06:39:28.491 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:28.491 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:28.491 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:39:28.491 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:17.543357+0000", 2024-09-13T06:39:28.492 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2544000000000001e-05 2024-09-13T06:39:28.492 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:28.492 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:28.492 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:39:28.492 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:17.543513+0000", 2024-09-13T06:39:28.492 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000156339 2024-09-13T06:39:28.492 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:28.492 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:39:28.492 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:28.492 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:28.492 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:28.492 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4217.0:2 2.2 2:5cea7035:::rbd_info:head [call rbd.metadata_list in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e18)", 2024-09-13T06:39:28.492 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:17.547194+0000", 2024-09-13T06:39:28.493 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 10.938274924, 2024-09-13T06:39:28.493 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00051709599999999998, 2024-09-13T06:39:28.493 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:39:28.493 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:39:28.493 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:39:28.493 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4217", 2024-09-13T06:39:28.493 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/2059993504", 2024-09-13T06:39:28.493 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 2 2024-09-13T06:39:28.493 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:28.493 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:39:28.493 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:28.493 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:39:28.493 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:17.547194+0000", 2024-09-13T06:39:28.493 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:28.494 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:28.494 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:28.494 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:39:28.494 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:17.547194+0000", 2024-09-13T06:39:28.494 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:28.494 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:28.494 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:28.494 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:39:28.494 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:17.547192+0000", 2024-09-13T06:39:28.494 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999976 2024-09-13T06:39:28.494 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:28.494 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:28.494 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:39:28.494 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:17.547211+0000", 2024-09-13T06:39:28.494 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.9346000000000001e-05 2024-09-13T06:39:28.495 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:28.495 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:28.495 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:39:28.495 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:17.547242+0000", 2024-09-13T06:39:28.495 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.095e-05 2024-09-13T06:39:28.495 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:28.495 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:28.495 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:39:28.495 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:17.547257+0000", 2024-09-13T06:39:28.495 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.4987000000000001e-05 2024-09-13T06:39:28.495 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:28.495 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:28.495 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:39:28.496 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:17.547387+0000", 2024-09-13T06:39:28.496 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000129832 2024-09-13T06:39:28.496 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:28.496 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:28.496 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:39:28.496 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:17.547711+0000", 2024-09-13T06:39:28.496 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00032421700000000002 2024-09-13T06:39:28.496 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:28.496 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:39:28.496 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:28.496 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:28.496 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:28.496 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4217.0:3 2.2 2:5cea7035:::rbd_info:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e18)", 2024-09-13T06:39:28.496 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:17.548191+0000", 2024-09-13T06:39:28.497 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 10.937278280999999, 2024-09-13T06:39:28.497 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00032341999999999999, 2024-09-13T06:39:28.497 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:39:28.497 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:39:28.497 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:39:28.497 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4217", 2024-09-13T06:39:28.497 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/2059993504", 2024-09-13T06:39:28.497 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 3 2024-09-13T06:39:28.497 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:28.497 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:39:28.497 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:28.497 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:39:28.497 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:17.548191+0000", 2024-09-13T06:39:28.497 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:28.498 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:28.498 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:28.498 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:39:28.498 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:17.548191+0000", 2024-09-13T06:39:28.498 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:28.498 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:28.498 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:28.498 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:39:28.498 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:17.548190+0000", 2024-09-13T06:39:28.498 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999986 2024-09-13T06:39:28.498 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:28.498 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:28.498 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:39:28.498 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:17.548198+0000", 2024-09-13T06:39:28.499 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.5799999999999992e-06 2024-09-13T06:39:28.499 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:28.499 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:28.499 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:39:28.499 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:17.548218+0000", 2024-09-13T06:39:28.499 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.0063000000000001e-05 2024-09-13T06:39:28.499 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:28.499 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:28.499 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:39:28.499 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:17.548238+0000", 2024-09-13T06:39:28.499 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.9466999999999998e-05 2024-09-13T06:39:28.499 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:28.499 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:28.500 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:39:28.500 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:17.548315+0000", 2024-09-13T06:39:28.500 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.737e-05 2024-09-13T06:39:28.500 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:28.500 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:28.500 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:39:28.500 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:17.548514+0000", 2024-09-13T06:39:28.500 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00019922399999999999 2024-09-13T06:39:28.500 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:28.500 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:39:28.500 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:28.500 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:28.500 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:28.500 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4217.0:5 2.2 2:5cea7035:::rbd_info:head [create,write 0~8] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e19)", 2024-09-13T06:39:28.501 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:18.551848+0000", 2024-09-13T06:39:28.501 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 9.9336210709999992, 2024-09-13T06:39:28.501 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0070706379999999997, 2024-09-13T06:39:28.501 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:39:28.501 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:28.501 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:39:28.501 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4217", 2024-09-13T06:39:28.501 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/2059993504", 2024-09-13T06:39:28.501 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 5 2024-09-13T06:39:28.501 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:28.501 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:39:28.501 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:28.501 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:39:28.501 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:18.551848+0000", 2024-09-13T06:39:28.502 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:28.502 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:28.502 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:28.502 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:39:28.502 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:18.551848+0000", 2024-09-13T06:39:28.502 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:28.502 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:28.502 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:28.502 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:39:28.502 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:18.551845+0000", 2024-09-13T06:39:28.502 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999967 2024-09-13T06:39:28.502 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:28.502 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:28.503 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:39:28.503 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:18.551863+0000", 2024-09-13T06:39:28.503 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.8450000000000001e-05 2024-09-13T06:39:28.503 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:28.503 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:28.503 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:39:28.503 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:18.551898+0000", 2024-09-13T06:39:28.503 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.4292999999999998e-05 2024-09-13T06:39:28.503 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:28.503 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:28.503 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:39:28.503 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:18.551915+0000", 2024-09-13T06:39:28.503 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7390000000000001e-05 2024-09-13T06:39:28.503 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:28.504 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:28.504 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:39:28.504 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:18.552049+0000", 2024-09-13T06:39:28.504 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00013432200000000001 2024-09-13T06:39:28.504 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:28.504 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:28.504 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op must wait for map", 2024-09-13T06:39:28.504 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:18.552060+0000", 2024-09-13T06:39:28.504 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0200000000000001e-05 2024-09-13T06:39:28.504 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:28.504 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:28.504 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:39:28.504 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:18.555492+0000", 2024-09-13T06:39:28.504 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0034328000000000002 2024-09-13T06:39:28.505 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:28.505 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:28.505 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:39:28.505 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:18.555726+0000", 2024-09-13T06:39:28.505 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00023350199999999999 2024-09-13T06:39:28.505 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:28.505 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:28.505 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-13T06:39:28.505 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:18.555949+0000", 2024-09-13T06:39:28.505 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00022290799999999999 2024-09-13T06:39:28.505 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:28.505 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:28.505 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-13T06:39:28.506 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:18.557425+0000", 2024-09-13T06:39:28.506 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.001476525 2024-09-13T06:39:28.506 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:28.506 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:28.506 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:39:28.506 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:18.558785+0000", 2024-09-13T06:39:28.506 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00135929 2024-09-13T06:39:28.506 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:28.506 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:28.506 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-13T06:39:28.506 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:18.558864+0000", 2024-09-13T06:39:28.506 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.9122999999999994e-05 2024-09-13T06:39:28.506 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:28.506 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:28.507 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:39:28.507 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:18.558919+0000", 2024-09-13T06:39:28.507 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.5002e-05 2024-09-13T06:39:28.507 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:28.507 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:39:28.507 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:28.507 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:28.507 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:28.507 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop_reply(client.4217.0:5 2.2 e18/17 ondisk, result = 0)", 2024-09-13T06:39:28.507 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:18.558621+0000", 2024-09-13T06:39:28.507 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 9.9268482630000001, 2024-09-13T06:39:28.507 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00031078300000000002, 2024-09-13T06:39:28.507 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:39:28.508 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:39:28.508 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:39:28.508 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:28.508 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:39:28.508 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:18.558621+0000", 2024-09-13T06:39:28.508 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:28.508 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:28.508 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:28.508 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:39:28.508 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:18.558621+0000", 2024-09-13T06:39:28.508 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:28.508 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:28.508 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:28.509 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:39:28.509 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:18.558619+0000", 2024-09-13T06:39:28.509 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999981 2024-09-13T06:39:28.509 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:28.509 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:28.509 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:39:28.509 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:18.558630+0000", 2024-09-13T06:39:28.509 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0757000000000001e-05 2024-09-13T06:39:28.509 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:28.509 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:28.509 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:39:28.509 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:18.558659+0000", 2024-09-13T06:39:28.509 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.9295999999999999e-05 2024-09-13T06:39:28.509 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:28.510 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:28.510 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:39:28.510 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:18.558674+0000", 2024-09-13T06:39:28.510 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.4885999999999999e-05 2024-09-13T06:39:28.510 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:28.510 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:28.510 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:39:28.510 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:18.558764+0000", 2024-09-13T06:39:28.510 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.9989999999999997e-05 2024-09-13T06:39:28.510 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:28.510 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:28.510 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:39:28.510 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:18.558776+0000", 2024-09-13T06:39:28.510 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.224e-05 2024-09-13T06:39:28.511 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:28.511 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:28.511 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:39:28.511 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:18.558932+0000", 2024-09-13T06:39:28.511 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000155358 2024-09-13T06:39:28.511 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:28.511 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:39:28.511 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:28.511 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:28.511 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:28.511 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4217.0:7 2.2 2:5cea7035:::rbd_info:head [write 0~19] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-09-13T06:39:28.511 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:19.559245+0000", 2024-09-13T06:39:28.511 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 8.9262245890000003, 2024-09-13T06:39:28.511 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0064556470000000001, 2024-09-13T06:39:28.512 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:39:28.512 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:28.512 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:39:28.512 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4217", 2024-09-13T06:39:28.512 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/2059993504", 2024-09-13T06:39:28.512 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 7 2024-09-13T06:39:28.512 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:28.512 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:39:28.512 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:28.512 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:39:28.512 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:19.559245+0000", 2024-09-13T06:39:28.512 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:28.512 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:28.513 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:28.513 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:39:28.513 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:19.559245+0000", 2024-09-13T06:39:28.513 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:28.513 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:28.513 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:28.513 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:39:28.513 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:19.559242+0000", 2024-09-13T06:39:28.513 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999971 2024-09-13T06:39:28.513 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:28.513 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:28.513 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:39:28.513 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:19.559256+0000", 2024-09-13T06:39:28.513 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.4307e-05 2024-09-13T06:39:28.514 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:28.514 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:28.514 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:39:28.514 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:19.559289+0000", 2024-09-13T06:39:28.514 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.2725999999999998e-05 2024-09-13T06:39:28.514 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:28.514 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:28.514 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:39:28.514 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:19.559306+0000", 2024-09-13T06:39:28.514 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7223000000000001e-05 2024-09-13T06:39:28.514 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:28.514 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:28.514 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:39:28.514 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:19.559475+0000", 2024-09-13T06:39:28.515 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000169025 2024-09-13T06:39:28.515 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:28.515 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:28.515 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op must wait for map", 2024-09-13T06:39:28.515 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:19.559486+0000", 2024-09-13T06:39:28.515 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0857e-05 2024-09-13T06:39:28.515 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:28.515 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:28.515 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:39:28.515 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:19.562891+0000", 2024-09-13T06:39:28.515 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.003405347 2024-09-13T06:39:28.515 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:28.515 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:28.515 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:39:28.516 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:19.563030+0000", 2024-09-13T06:39:28.516 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00013865899999999999 2024-09-13T06:39:28.516 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:28.516 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:28.516 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-13T06:39:28.516 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:19.563265+0000", 2024-09-13T06:39:28.516 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00023494799999999999 2024-09-13T06:39:28.516 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:28.516 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:28.516 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-13T06:39:28.516 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:19.564795+0000", 2024-09-13T06:39:28.516 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0015298079999999999 2024-09-13T06:39:28.516 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:28.517 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:28.517 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:39:28.517 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:19.565575+0000", 2024-09-13T06:39:28.517 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00078002400000000004 2024-09-13T06:39:28.517 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:28.517 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:28.517 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-13T06:39:28.517 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:19.565646+0000", 2024-09-13T06:39:28.517 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.1515999999999998e-05 2024-09-13T06:39:28.517 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:28.517 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:28.517 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:39:28.517 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:19.565700+0000", 2024-09-13T06:39:28.517 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.3909999999999997e-05 2024-09-13T06:39:28.518 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:28.518 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:39:28.518 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:28.518 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:28.518 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:28.518 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop_reply(client.4217.0:7 2.2 e19/17 ondisk, result = 0)", 2024-09-13T06:39:28.518 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:19.565398+0000", 2024-09-13T06:39:28.518 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 8.9200713169999997, 2024-09-13T06:39:28.518 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00031264500000000001, 2024-09-13T06:39:28.518 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:39:28.518 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:39:28.518 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:39:28.518 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:28.519 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:39:28.519 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:19.565398+0000", 2024-09-13T06:39:28.519 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:28.519 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:28.519 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:28.519 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:39:28.519 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:19.565398+0000", 2024-09-13T06:39:28.519 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:28.519 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:28.519 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:28.519 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:39:28.519 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:19.565396+0000", 2024-09-13T06:39:28.519 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999981 2024-09-13T06:39:28.519 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:28.520 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:28.520 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:39:28.520 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:19.565406+0000", 2024-09-13T06:39:28.520 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.4469999999999995e-06 2024-09-13T06:39:28.520 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:28.520 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:28.520 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:39:28.520 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:19.565431+0000", 2024-09-13T06:39:28.520 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.5653e-05 2024-09-13T06:39:28.520 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:28.520 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:28.520 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:39:28.520 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:19.565452+0000", 2024-09-13T06:39:28.520 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.1016999999999999e-05 2024-09-13T06:39:28.521 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:28.521 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:28.521 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:39:28.521 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:19.565555+0000", 2024-09-13T06:39:28.521 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000102709 2024-09-13T06:39:28.521 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:28.521 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:28.521 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:39:28.521 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:19.565567+0000", 2024-09-13T06:39:28.521 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1673e-05 2024-09-13T06:39:28.521 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:28.521 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:28.521 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:39:28.521 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:19.565710+0000", 2024-09-13T06:39:28.522 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00014385900000000001 2024-09-13T06:39:28.522 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:28.522 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:39:28.522 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:28.522 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:28.522 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:39:28.522 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:39:28.523 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-13T06:39:28.524 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:39:28.527+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:39:28.625 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-13T06:39:28.626+0000 7f86a5f06640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26387) UID: 0 2024-09-13T06:39:28.647 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:39:28.647 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [], 2024-09-13T06:39:28.647 INFO:teuthology.orchestra.run.smithi139.stdout: "num_ops": 0 2024-09-13T06:39:28.647 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:39:28.661 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-13T06:39:28.725 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:39:28.727+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:39:28.826 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:39:28.826+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:39:28.827 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:39:28.827 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [], 2024-09-13T06:39:28.827 INFO:teuthology.orchestra.run.smithi139.stdout: "complaint_time": 30, 2024-09-13T06:39:28.827 INFO:teuthology.orchestra.run.smithi139.stdout: "num_blocked_ops": 0 2024-09-13T06:39:28.827 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:39:28.842 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-13T06:39:28.928 INFO:tasks.ceph.osd.6.smithi139.stderr:2024-09-13T06:39:28.930+0000 7fcd02c5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26385) UID: 0 2024-09-13T06:39:29.006 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:39:29.006 INFO:teuthology.orchestra.run.smithi139.stdout: "size": 20, 2024-09-13T06:39:29.006 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 600, 2024-09-13T06:39:29.006 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [] 2024-09-13T06:39:29.006 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:39:29.020 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-13T06:39:29.027 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:39:29.031+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:39:29.130 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:39:29.131+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:39:29.181 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:39:29.181 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [], 2024-09-13T06:39:29.182 INFO:teuthology.orchestra.run.smithi139.stdout: "num_ops": 0 2024-09-13T06:39:29.182 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:39:29.195 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-13T06:39:29.230 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:39:29.231+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:39:29.318 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:39:29.318 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [], 2024-09-13T06:39:29.318 INFO:teuthology.orchestra.run.smithi139.stdout: "complaint_time": 30, 2024-09-13T06:39:29.318 INFO:teuthology.orchestra.run.smithi139.stdout: "num_blocked_ops": 0 2024-09-13T06:39:29.319 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:39:29.331 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:39:29.330+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:39:29.332 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-13T06:39:29.360 INFO:teuthology.orchestra.run.smithi081.stderr:nodeep-scrub is set 2024-09-13T06:39:29.432 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:39:29.434+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:39:29.502 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:39:29.502 INFO:teuthology.orchestra.run.smithi139.stdout: "size": 20, 2024-09-13T06:39:29.502 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 600, 2024-09-13T06:39:29.502 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [ 2024-09-13T06:39:29.502 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:29.502 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4154.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-13T06:39:29.502 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:11.143816+0000", 2024-09-13T06:39:29.502 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 18.359010512000001, 2024-09-13T06:39:29.502 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.062483034, 2024-09-13T06:39:29.502 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:39:29.503 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:29.503 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:39:29.503 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4154", 2024-09-13T06:39:29.503 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/2406930292", 2024-09-13T06:39:29.503 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 1 2024-09-13T06:39:29.503 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:29.503 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:39:29.503 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:29.503 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:39:29.503 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.143816+0000", 2024-09-13T06:39:29.503 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:29.503 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:29.503 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:29.504 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:39:29.504 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.143816+0000", 2024-09-13T06:39:29.504 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:29.504 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:29.504 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:29.504 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:39:29.504 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.143814+0000", 2024-09-13T06:39:29.504 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999976 2024-09-13T06:39:29.504 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:29.504 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:29.504 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:39:29.504 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.143829+0000", 2024-09-13T06:39:29.505 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5316999999999999e-05 2024-09-13T06:39:29.505 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:29.505 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:29.505 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:39:29.505 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.143851+0000", 2024-09-13T06:39:29.505 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.1736999999999999e-05 2024-09-13T06:39:29.505 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:29.505 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:29.505 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:39:29.505 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.143870+0000", 2024-09-13T06:39:29.505 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.9185999999999999e-05 2024-09-13T06:39:29.505 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:29.506 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:29.506 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:39:29.506 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.143973+0000", 2024-09-13T06:39:29.506 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000102896 2024-09-13T06:39:29.506 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:29.506 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:29.506 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:39:29.506 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.143987+0000", 2024-09-13T06:39:29.506 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.401e-05 2024-09-13T06:39:29.506 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:29.506 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:29.506 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:39:29.506 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.203333+0000", 2024-09-13T06:39:29.506 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.059346614999999998 2024-09-13T06:39:29.507 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:29.507 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:29.507 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:39:29.507 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.203624+0000", 2024-09-13T06:39:29.507 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00029112700000000002 2024-09-13T06:39:29.507 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:29.507 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:29.507 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 0", 2024-09-13T06:39:29.507 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.203940+0000", 2024-09-13T06:39:29.507 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00031547200000000002 2024-09-13T06:39:29.507 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:29.507 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:29.507 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-13T06:39:29.507 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.205145+0000", 2024-09-13T06:39:29.508 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0012048930000000001 2024-09-13T06:39:29.508 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:29.508 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:29.508 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:39:29.508 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.206110+0000", 2024-09-13T06:39:29.508 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00096536600000000005 2024-09-13T06:39:29.508 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:29.508 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:29.508 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-13T06:39:29.508 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.206196+0000", 2024-09-13T06:39:29.508 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.5798999999999996e-05 2024-09-13T06:39:29.508 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:29.508 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:29.509 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:39:29.509 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.206299+0000", 2024-09-13T06:39:29.509 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00010279 2024-09-13T06:39:29.509 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:29.509 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:39:29.509 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:29.509 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:29.509 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:29.509 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4154.0:36 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-13T06:39:29.509 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:11.257357+0000", 2024-09-13T06:39:29.509 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 18.245469068999999, 2024-09-13T06:39:29.509 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.012807595, 2024-09-13T06:39:29.509 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:39:29.510 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:29.510 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:39:29.510 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4154", 2024-09-13T06:39:29.510 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/2406930292", 2024-09-13T06:39:29.510 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 36 2024-09-13T06:39:29.510 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:29.510 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:39:29.510 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:29.510 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:39:29.510 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.257357+0000", 2024-09-13T06:39:29.510 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:29.510 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:29.510 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:29.511 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:39:29.511 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.257357+0000", 2024-09-13T06:39:29.511 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:29.511 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:29.511 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:29.511 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:39:29.511 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.257356+0000", 2024-09-13T06:39:29.511 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:39:29.511 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:29.511 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:29.511 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:39:29.511 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.257378+0000", 2024-09-13T06:39:29.512 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.1988999999999999e-05 2024-09-13T06:39:29.512 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:29.512 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:29.512 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:39:29.512 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.257389+0000", 2024-09-13T06:39:29.512 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0343000000000001e-05 2024-09-13T06:39:29.512 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:29.512 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:29.512 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:39:29.512 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.257396+0000", 2024-09-13T06:39:29.512 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5839999999999997e-06 2024-09-13T06:39:29.512 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:29.512 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:29.512 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:39:29.513 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.264748+0000", 2024-09-13T06:39:29.513 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0073514640000000003 2024-09-13T06:39:29.513 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:29.513 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:29.513 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:39:29.513 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.264878+0000", 2024-09-13T06:39:29.513 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00012975500000000001 2024-09-13T06:39:29.513 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:29.513 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:29.513 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 0", 2024-09-13T06:39:29.513 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.265064+0000", 2024-09-13T06:39:29.513 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000186799 2024-09-13T06:39:29.514 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:29.514 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:29.514 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:39:29.514 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.267248+0000", 2024-09-13T06:39:29.514 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0021841230000000001 2024-09-13T06:39:29.514 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:29.514 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:29.514 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-13T06:39:29.514 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.269996+0000", 2024-09-13T06:39:29.514 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0027473419999999998 2024-09-13T06:39:29.514 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:29.514 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:29.515 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-13T06:39:29.515 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.270066+0000", 2024-09-13T06:39:29.515 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.0683000000000001e-05 2024-09-13T06:39:29.515 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:29.515 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:29.515 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:39:29.515 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.270165+0000", 2024-09-13T06:39:29.515 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.8319000000000005e-05 2024-09-13T06:39:29.515 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:29.515 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:39:29.515 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:29.515 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:29.515 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:29.515 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4154.0:37 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-13T06:39:29.516 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:11.257405+0000", 2024-09-13T06:39:29.516 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 18.245420888999998, 2024-09-13T06:39:29.516 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.012930476999999999, 2024-09-13T06:39:29.516 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:39:29.516 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:29.516 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:39:29.516 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4154", 2024-09-13T06:39:29.516 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/2406930292", 2024-09-13T06:39:29.516 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 37 2024-09-13T06:39:29.516 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:29.516 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:39:29.517 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:29.517 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:39:29.517 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.257405+0000", 2024-09-13T06:39:29.517 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:29.517 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:29.517 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:29.517 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:39:29.517 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.257405+0000", 2024-09-13T06:39:29.517 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:29.517 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:29.517 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:29.517 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:39:29.517 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.257405+0000", 2024-09-13T06:39:29.518 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:39:29.518 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:29.518 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:29.518 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:39:29.518 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.257411+0000", 2024-09-13T06:39:29.518 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.1500000000000004e-06 2024-09-13T06:39:29.518 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:29.518 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:29.518 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:39:29.518 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.257420+0000", 2024-09-13T06:39:29.518 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.986e-06 2024-09-13T06:39:29.518 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:29.518 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:29.518 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:39:29.519 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.257436+0000", 2024-09-13T06:39:29.519 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6433999999999999e-05 2024-09-13T06:39:29.519 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:29.519 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:29.519 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:39:29.519 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.265923+0000", 2024-09-13T06:39:29.519 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0084872009999999998 2024-09-13T06:39:29.519 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:29.519 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:29.519 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:39:29.519 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.266056+0000", 2024-09-13T06:39:29.519 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00013206599999999999 2024-09-13T06:39:29.519 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:29.520 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:29.520 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 0", 2024-09-13T06:39:29.520 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.266255+0000", 2024-09-13T06:39:29.520 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00019935100000000001 2024-09-13T06:39:29.520 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:29.520 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:29.520 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:39:29.520 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.267788+0000", 2024-09-13T06:39:29.520 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0015335380000000001 2024-09-13T06:39:29.520 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:29.520 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:29.520 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-13T06:39:29.520 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.270181+0000", 2024-09-13T06:39:29.521 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.002392136 2024-09-13T06:39:29.521 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:29.521 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:29.521 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-13T06:39:29.521 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.270245+0000", 2024-09-13T06:39:29.521 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.4401999999999998e-05 2024-09-13T06:39:29.521 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:29.521 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:29.521 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:39:29.521 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.270336+0000", 2024-09-13T06:39:29.521 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.0872999999999995e-05 2024-09-13T06:39:29.521 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:29.521 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:39:29.522 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:29.522 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:29.522 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:29.522 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4154.0:88 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-13T06:39:29.522 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:11.362174+0000", 2024-09-13T06:39:29.522 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 18.140652281000001, 2024-09-13T06:39:29.522 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.012171276, 2024-09-13T06:39:29.522 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:39:29.522 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:29.522 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:39:29.522 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4154", 2024-09-13T06:39:29.522 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/2406930292", 2024-09-13T06:39:29.522 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 88 2024-09-13T06:39:29.522 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:29.523 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:39:29.523 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:29.523 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:39:29.523 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.362174+0000", 2024-09-13T06:39:29.523 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:29.523 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:29.523 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:29.523 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:39:29.523 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.362174+0000", 2024-09-13T06:39:29.523 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:29.523 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:29.523 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:29.523 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:39:29.524 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.362172+0000", 2024-09-13T06:39:29.524 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999986 2024-09-13T06:39:29.524 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:29.524 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:29.524 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:39:29.524 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.362183+0000", 2024-09-13T06:39:29.524 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.081e-05 2024-09-13T06:39:29.524 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:29.524 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:29.524 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:39:29.524 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.362205+0000", 2024-09-13T06:39:29.524 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.1897000000000001e-05 2024-09-13T06:39:29.524 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:29.525 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:29.525 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:39:29.525 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.362221+0000", 2024-09-13T06:39:29.525 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5353e-05 2024-09-13T06:39:29.525 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:29.525 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:29.525 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:39:29.525 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.369202+0000", 2024-09-13T06:39:29.525 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0069816219999999998 2024-09-13T06:39:29.525 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:29.525 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:29.525 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:39:29.525 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.369323+0000", 2024-09-13T06:39:29.526 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000121156 2024-09-13T06:39:29.526 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:29.526 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:29.526 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 0", 2024-09-13T06:39:29.526 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.369683+0000", 2024-09-13T06:39:29.526 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00035930700000000001 2024-09-13T06:39:29.526 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:29.526 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:29.526 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:39:29.526 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.371448+0000", 2024-09-13T06:39:29.526 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.001765043 2024-09-13T06:39:29.526 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:29.526 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:29.526 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-13T06:39:29.527 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.374156+0000", 2024-09-13T06:39:29.527 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.002707999 2024-09-13T06:39:29.527 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:29.527 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:29.527 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-13T06:39:29.527 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.374243+0000", 2024-09-13T06:39:29.527 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6873000000000007e-05 2024-09-13T06:39:29.527 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:29.527 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:29.527 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:39:29.528 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.374345+0000", 2024-09-13T06:39:29.528 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00010272600000000001 2024-09-13T06:39:29.528 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:29.528 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:39:29.528 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:29.528 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:29.528 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:29.528 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4154.0:108 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-13T06:39:29.528 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:11.524074+0000", 2024-09-13T06:39:29.528 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 17.978752277000002, 2024-09-13T06:39:29.528 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.012736235, 2024-09-13T06:39:29.528 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:39:29.528 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:29.529 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:39:29.529 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4154", 2024-09-13T06:39:29.529 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/2406930292", 2024-09-13T06:39:29.529 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 108 2024-09-13T06:39:29.529 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:29.529 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:39:29.529 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:29.529 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:39:29.529 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.524074+0000", 2024-09-13T06:39:29.529 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:29.529 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:29.529 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:29.530 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:39:29.530 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.524074+0000", 2024-09-13T06:39:29.530 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:29.530 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:29.530 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:29.530 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:39:29.530 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.524073+0000", 2024-09-13T06:39:29.530 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:39:29.530 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:29.530 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:29.530 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:39:29.530 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.524084+0000", 2024-09-13T06:39:29.530 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1026000000000001e-05 2024-09-13T06:39:29.531 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:29.531 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:29.531 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:39:29.531 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.524102+0000", 2024-09-13T06:39:29.531 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7992999999999999e-05 2024-09-13T06:39:29.531 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:29.531 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:29.531 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:39:29.531 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.524140+0000", 2024-09-13T06:39:29.531 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.8277e-05 2024-09-13T06:39:29.531 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:29.531 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:29.531 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:39:29.531 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.528884+0000", 2024-09-13T06:39:29.532 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.004743761 2024-09-13T06:39:29.532 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:29.532 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:29.532 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:39:29.532 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.529006+0000", 2024-09-13T06:39:29.532 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000121829 2024-09-13T06:39:29.532 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:29.532 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:29.532 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 0", 2024-09-13T06:39:29.532 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.529196+0000", 2024-09-13T06:39:29.532 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000189731 2024-09-13T06:39:29.532 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:29.532 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:29.533 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:39:29.533 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.535697+0000", 2024-09-13T06:39:29.533 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0065011499999999998 2024-09-13T06:39:29.533 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:29.533 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:29.533 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-13T06:39:29.533 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.536644+0000", 2024-09-13T06:39:29.533 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00094732900000000001 2024-09-13T06:39:29.533 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:29.533 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:29.533 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-13T06:39:29.533 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.536712+0000", 2024-09-13T06:39:29.534 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.8303e-05 2024-09-13T06:39:29.534 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:29.534 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:29.534 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:39:29.534 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.536810+0000", 2024-09-13T06:39:29.534 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.7918999999999995e-05 2024-09-13T06:39:29.534 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:29.534 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:39:29.534 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:29.534 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:29.534 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:29.534 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4154.0:109 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-13T06:39:29.534 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:11.524169+0000", 2024-09-13T06:39:29.535 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 17.978657350999999, 2024-09-13T06:39:29.535 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.013995285999999999, 2024-09-13T06:39:29.535 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:39:29.535 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:29.535 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:39:29.535 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4154", 2024-09-13T06:39:29.535 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/2406930292", 2024-09-13T06:39:29.535 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 109 2024-09-13T06:39:29.535 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:29.535 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:39:29.535 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:29.535 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:39:29.535 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.524169+0000", 2024-09-13T06:39:29.535 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:29.536 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:29.536 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:29.536 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:39:29.536 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.524169+0000", 2024-09-13T06:39:29.536 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:29.536 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:29.536 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:29.536 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:39:29.536 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.524168+0000", 2024-09-13T06:39:29.536 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:39:29.536 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:29.536 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:29.536 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:39:29.537 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.524427+0000", 2024-09-13T06:39:29.537 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00025929799999999998 2024-09-13T06:39:29.537 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:29.537 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:29.537 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:39:29.537 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.524451+0000", 2024-09-13T06:39:29.537 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.3686e-05 2024-09-13T06:39:29.537 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:29.537 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:29.537 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:39:29.537 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.524468+0000", 2024-09-13T06:39:29.537 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7577000000000001e-05 2024-09-13T06:39:29.537 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:29.538 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:29.538 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:39:29.538 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.530416+0000", 2024-09-13T06:39:29.538 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0059474080000000004 2024-09-13T06:39:29.538 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:29.538 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:29.538 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:39:29.538 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.530553+0000", 2024-09-13T06:39:29.538 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000137742 2024-09-13T06:39:29.538 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:29.538 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:29.538 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 0", 2024-09-13T06:39:29.538 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.530749+0000", 2024-09-13T06:39:29.538 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000195608 2024-09-13T06:39:29.539 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:29.539 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:29.539 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-13T06:39:29.539 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.536836+0000", 2024-09-13T06:39:29.539 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.006086546 2024-09-13T06:39:29.539 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:29.539 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:29.539 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:39:29.539 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.538038+0000", 2024-09-13T06:39:29.539 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0012019509999999999 2024-09-13T06:39:29.539 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:29.539 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:29.539 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-13T06:39:29.539 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.538106+0000", 2024-09-13T06:39:29.539 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.8923000000000004e-05 2024-09-13T06:39:29.540 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:29.540 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:29.540 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:39:29.540 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.538164+0000", 2024-09-13T06:39:29.540 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.7729999999999998e-05 2024-09-13T06:39:29.540 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:29.540 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:39:29.540 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:29.540 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:29.540 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:29.540 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4154.0:110 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-13T06:39:29.540 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:11.524488+0000", 2024-09-13T06:39:29.540 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 17.978337874000001, 2024-09-13T06:39:29.541 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.013976323000000001, 2024-09-13T06:39:29.541 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:39:29.541 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:29.541 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:39:29.541 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4154", 2024-09-13T06:39:29.541 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/2406930292", 2024-09-13T06:39:29.541 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 110 2024-09-13T06:39:29.541 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:29.541 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:39:29.541 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:29.541 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:39:29.541 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.524488+0000", 2024-09-13T06:39:29.541 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:29.542 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:29.542 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:29.542 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:39:29.542 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.524488+0000", 2024-09-13T06:39:29.542 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:29.542 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:29.542 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:29.542 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:39:29.542 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.524487+0000", 2024-09-13T06:39:29.542 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999986 2024-09-13T06:39:29.542 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:29.542 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:29.542 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:39:29.542 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.524498+0000", 2024-09-13T06:39:29.543 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1579999999999999e-05 2024-09-13T06:39:29.543 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:29.543 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:29.543 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:39:29.543 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.524516+0000", 2024-09-13T06:39:29.543 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7776000000000001e-05 2024-09-13T06:39:29.543 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:29.543 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:29.543 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:39:29.543 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.524530+0000", 2024-09-13T06:39:29.543 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3896999999999999e-05 2024-09-13T06:39:29.543 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:29.543 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:29.543 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:39:29.544 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.532254+0000", 2024-09-13T06:39:29.544 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0077239409999999998 2024-09-13T06:39:29.544 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:29.544 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:29.544 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:39:29.544 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.532371+0000", 2024-09-13T06:39:29.544 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000117176 2024-09-13T06:39:29.544 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:29.544 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:29.544 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 0", 2024-09-13T06:39:29.544 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.532551+0000", 2024-09-13T06:39:29.544 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00018004100000000001 2024-09-13T06:39:29.544 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:29.545 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:29.545 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:39:29.545 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.538280+0000", 2024-09-13T06:39:29.545 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0057289230000000003 2024-09-13T06:39:29.545 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:29.545 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:29.545 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-13T06:39:29.545 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.538294+0000", 2024-09-13T06:39:29.545 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.4070000000000001e-05 2024-09-13T06:39:29.545 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:29.545 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:29.545 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-13T06:39:29.545 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.538368+0000", 2024-09-13T06:39:29.546 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.3604999999999997e-05 2024-09-13T06:39:29.546 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:29.546 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:29.546 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:39:29.546 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.538465+0000", 2024-09-13T06:39:29.546 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6830000000000006e-05 2024-09-13T06:39:29.546 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:29.546 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:39:29.546 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:29.546 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:29.546 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:29.546 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4154.0:111 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-13T06:39:29.546 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:11.524546+0000", 2024-09-13T06:39:29.547 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 17.978280439999999, 2024-09-13T06:39:29.547 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.016412307000000001, 2024-09-13T06:39:29.547 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:39:29.547 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:29.547 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:39:29.547 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4154", 2024-09-13T06:39:29.547 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/2406930292", 2024-09-13T06:39:29.547 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 111 2024-09-13T06:39:29.547 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:29.547 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:39:29.547 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:29.547 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:39:29.547 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.524546+0000", 2024-09-13T06:39:29.547 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:29.548 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:29.548 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:29.548 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:39:29.548 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.524546+0000", 2024-09-13T06:39:29.548 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:29.548 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:29.548 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:29.548 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:39:29.548 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.524545+0000", 2024-09-13T06:39:29.548 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:39:29.548 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:29.548 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:29.548 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:39:29.549 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.524555+0000", 2024-09-13T06:39:29.549 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0176e-05 2024-09-13T06:39:29.549 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:29.549 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:29.549 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:39:29.549 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.524577+0000", 2024-09-13T06:39:29.549 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.1756999999999999e-05 2024-09-13T06:39:29.549 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:29.549 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:29.549 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:39:29.549 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.524592+0000", 2024-09-13T06:39:29.549 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5345999999999998e-05 2024-09-13T06:39:29.550 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:29.550 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:29.550 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:39:29.550 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.533407+0000", 2024-09-13T06:39:29.550 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0088150559999999999 2024-09-13T06:39:29.550 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:29.550 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:29.550 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:39:29.550 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.533523+0000", 2024-09-13T06:39:29.550 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000116099 2024-09-13T06:39:29.550 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:29.550 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:29.550 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 0", 2024-09-13T06:39:29.550 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.533734+0000", 2024-09-13T06:39:29.550 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000211005 2024-09-13T06:39:29.551 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:29.551 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:29.551 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-13T06:39:29.551 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.538484+0000", 2024-09-13T06:39:29.551 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0047494900000000003 2024-09-13T06:39:29.551 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:29.551 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:29.551 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:39:29.551 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.540823+0000", 2024-09-13T06:39:29.551 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0023390889999999999 2024-09-13T06:39:29.551 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:29.551 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:29.551 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-13T06:39:29.551 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.540898+0000", 2024-09-13T06:39:29.552 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5449000000000002e-05 2024-09-13T06:39:29.552 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:29.552 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:29.552 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:39:29.552 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.540958+0000", 2024-09-13T06:39:29.552 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.9889999999999997e-05 2024-09-13T06:39:29.552 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:29.552 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:39:29.552 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:29.552 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:29.552 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:29.552 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4154.0:112 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-13T06:39:29.552 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:11.524610+0000", 2024-09-13T06:39:29.552 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 17.978216720999999, 2024-09-13T06:39:29.552 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.016538458999999998, 2024-09-13T06:39:29.553 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:39:29.553 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:29.553 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:39:29.553 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4154", 2024-09-13T06:39:29.553 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/2406930292", 2024-09-13T06:39:29.553 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 112 2024-09-13T06:39:29.553 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:29.553 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:39:29.553 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:29.553 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:39:29.553 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.524610+0000", 2024-09-13T06:39:29.553 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:29.553 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:29.554 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:29.554 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:39:29.554 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.524610+0000", 2024-09-13T06:39:29.554 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:29.554 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:29.554 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:29.554 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:39:29.554 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.524608+0000", 2024-09-13T06:39:29.554 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:39:29.554 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:29.554 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:29.554 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:39:29.554 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.524826+0000", 2024-09-13T06:39:29.554 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000217226 2024-09-13T06:39:29.555 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:29.555 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:29.555 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:39:29.555 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.524848+0000", 2024-09-13T06:39:29.555 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.2802999999999998e-05 2024-09-13T06:39:29.555 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:29.555 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:29.555 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:39:29.555 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.524906+0000", 2024-09-13T06:39:29.555 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.7878999999999999e-05 2024-09-13T06:39:29.555 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:29.555 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:29.555 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:39:29.556 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.534402+0000", 2024-09-13T06:39:29.556 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0094956769999999992 2024-09-13T06:39:29.556 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:29.556 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:29.556 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:39:29.556 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.534512+0000", 2024-09-13T06:39:29.556 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000110493 2024-09-13T06:39:29.556 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:29.556 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:29.556 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 0", 2024-09-13T06:39:29.556 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.534688+0000", 2024-09-13T06:39:29.556 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00017564499999999999 2024-09-13T06:39:29.557 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:29.557 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:29.557 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-13T06:39:29.557 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.538493+0000", 2024-09-13T06:39:29.557 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0038051399999999998 2024-09-13T06:39:29.557 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:29.557 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:29.557 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:39:29.557 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.541030+0000", 2024-09-13T06:39:29.557 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0025368080000000002 2024-09-13T06:39:29.557 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:29.557 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:29.557 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-13T06:39:29.558 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.541097+0000", 2024-09-13T06:39:29.558 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.6933000000000004e-05 2024-09-13T06:39:29.558 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:29.558 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:29.558 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:39:29.558 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.541148+0000", 2024-09-13T06:39:29.558 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.1008999999999999e-05 2024-09-13T06:39:29.558 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:29.558 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:39:29.558 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:29.558 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:29.558 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:29.558 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4154.0:113 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-13T06:39:29.558 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:11.524940+0000", 2024-09-13T06:39:29.559 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 17.977885756999999, 2024-09-13T06:39:29.559 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.017201570999999999, 2024-09-13T06:39:29.559 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:39:29.559 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:29.559 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:39:29.559 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4154", 2024-09-13T06:39:29.559 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/2406930292", 2024-09-13T06:39:29.559 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 113 2024-09-13T06:39:29.559 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:29.559 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:39:29.559 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:29.559 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:39:29.559 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.524940+0000", 2024-09-13T06:39:29.559 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:29.560 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:29.560 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:29.560 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:39:29.560 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.524940+0000", 2024-09-13T06:39:29.560 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:29.560 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:29.560 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:29.560 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:39:29.560 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.524938+0000", 2024-09-13T06:39:29.560 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999981 2024-09-13T06:39:29.560 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:29.560 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:29.560 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:39:29.560 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.524951+0000", 2024-09-13T06:39:29.561 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2993000000000001e-05 2024-09-13T06:39:29.561 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:29.561 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:29.561 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:39:29.561 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.524976+0000", 2024-09-13T06:39:29.561 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.4216999999999999e-05 2024-09-13T06:39:29.561 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:29.561 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:29.561 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:39:29.561 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.525000+0000", 2024-09-13T06:39:29.561 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.3986e-05 2024-09-13T06:39:29.561 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:29.561 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:29.561 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:39:29.562 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.535786+0000", 2024-09-13T06:39:29.562 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.010786733999999999 2024-09-13T06:39:29.562 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:29.562 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:29.562 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:39:29.562 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.535916+0000", 2024-09-13T06:39:29.562 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000129865 2024-09-13T06:39:29.562 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:29.562 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:29.562 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 0", 2024-09-13T06:39:29.562 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.536106+0000", 2024-09-13T06:39:29.562 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000190046 2024-09-13T06:39:29.562 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:29.562 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:29.562 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-13T06:39:29.562 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.540977+0000", 2024-09-13T06:39:29.563 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0048708730000000004 2024-09-13T06:39:29.563 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:29.563 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:29.563 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:39:29.563 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.542023+0000", 2024-09-13T06:39:29.563 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0010456179999999999 2024-09-13T06:39:29.563 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:29.563 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:29.563 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-13T06:39:29.563 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.542091+0000", 2024-09-13T06:39:29.563 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.7840000000000001e-05 2024-09-13T06:39:29.563 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:29.563 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:29.563 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:39:29.563 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.542142+0000", 2024-09-13T06:39:29.564 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.1399e-05 2024-09-13T06:39:29.564 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:29.564 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:39:29.564 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:29.564 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:29.564 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:29.564 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4154.0:114 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-13T06:39:29.564 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:11.525025+0000", 2024-09-13T06:39:29.564 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 17.977800878, 2024-09-13T06:39:29.564 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.017310847000000001, 2024-09-13T06:39:29.564 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:39:29.564 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:29.564 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:39:29.565 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4154", 2024-09-13T06:39:29.565 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/2406930292", 2024-09-13T06:39:29.565 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 114 2024-09-13T06:39:29.565 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:29.565 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:39:29.565 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:29.565 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:39:29.565 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.525025+0000", 2024-09-13T06:39:29.565 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:29.565 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:29.565 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:29.565 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:39:29.565 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.525025+0000", 2024-09-13T06:39:29.566 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:29.566 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:29.566 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:29.566 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:39:29.566 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.525024+0000", 2024-09-13T06:39:29.566 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999986 2024-09-13T06:39:29.566 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:29.566 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:29.566 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:39:29.566 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.525035+0000", 2024-09-13T06:39:29.566 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1413999999999999e-05 2024-09-13T06:39:29.566 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:29.566 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:29.566 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:39:29.566 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.525054+0000", 2024-09-13T06:39:29.567 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.8723e-05 2024-09-13T06:39:29.567 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:29.567 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:29.567 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:39:29.567 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.525068+0000", 2024-09-13T06:39:29.567 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.4022999999999999e-05 2024-09-13T06:39:29.567 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:29.567 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:29.567 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:39:29.567 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.536923+0000", 2024-09-13T06:39:29.567 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.011854821999999999 2024-09-13T06:39:29.567 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:29.567 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:29.568 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:39:29.568 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.537048+0000", 2024-09-13T06:39:29.568 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000125399 2024-09-13T06:39:29.568 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:29.568 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:29.568 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 0", 2024-09-13T06:39:29.568 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.537293+0000", 2024-09-13T06:39:29.568 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00024499500000000002 2024-09-13T06:39:29.568 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:29.568 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:29.568 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-13T06:39:29.568 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.541962+0000", 2024-09-13T06:39:29.568 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0046680940000000002 2024-09-13T06:39:29.568 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:29.568 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:29.569 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:39:29.569 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.542218+0000", 2024-09-13T06:39:29.569 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00025668199999999999 2024-09-13T06:39:29.569 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:29.569 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:29.569 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-13T06:39:29.569 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.542286+0000", 2024-09-13T06:39:29.569 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.7565999999999997e-05 2024-09-13T06:39:29.569 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:29.569 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:29.569 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:39:29.569 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.542336+0000", 2024-09-13T06:39:29.569 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.0429000000000001e-05 2024-09-13T06:39:29.569 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:29.570 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:39:29.570 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:29.570 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:29.570 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:29.570 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4154.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-13T06:39:29.570 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:11.525085+0000", 2024-09-13T06:39:29.570 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 17.977741697999999, 2024-09-13T06:39:29.570 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.019358490999999999, 2024-09-13T06:39:29.570 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:39:29.570 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:29.570 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:39:29.570 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4154", 2024-09-13T06:39:29.570 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/2406930292", 2024-09-13T06:39:29.570 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 115 2024-09-13T06:39:29.570 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:29.571 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:39:29.571 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:29.571 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:39:29.571 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.525085+0000", 2024-09-13T06:39:29.571 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:29.571 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:29.571 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:29.571 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:39:29.571 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.525085+0000", 2024-09-13T06:39:29.571 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:29.571 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:29.571 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:29.571 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:39:29.571 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.525083+0000", 2024-09-13T06:39:29.572 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:39:29.572 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:29.572 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:29.572 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:39:29.572 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.525302+0000", 2024-09-13T06:39:29.572 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00021804499999999999 2024-09-13T06:39:29.572 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:29.572 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:29.572 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:39:29.572 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.525324+0000", 2024-09-13T06:39:29.572 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.2147e-05 2024-09-13T06:39:29.572 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:29.573 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:29.573 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:39:29.573 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.525340+0000", 2024-09-13T06:39:29.573 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5879000000000002e-05 2024-09-13T06:39:29.573 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:29.573 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:29.573 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:39:29.573 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.538555+0000", 2024-09-13T06:39:29.573 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.013215499 2024-09-13T06:39:29.573 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:29.573 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:29.573 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:39:29.573 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.538703+0000", 2024-09-13T06:39:29.573 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00014755200000000001 2024-09-13T06:39:29.574 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:29.574 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:29.574 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 0", 2024-09-13T06:39:29.574 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.538967+0000", 2024-09-13T06:39:29.574 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00026453799999999998 2024-09-13T06:39:29.574 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:29.574 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:29.574 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-13T06:39:29.574 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.541969+0000", 2024-09-13T06:39:29.574 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00300184 2024-09-13T06:39:29.574 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:29.574 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:29.574 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:39:29.574 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.544287+0000", 2024-09-13T06:39:29.575 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0023178890000000001 2024-09-13T06:39:29.575 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:29.575 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:29.575 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-13T06:39:29.575 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.544378+0000", 2024-09-13T06:39:29.575 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.1366000000000006e-05 2024-09-13T06:39:29.575 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:29.575 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:29.575 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:39:29.575 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.544443+0000", 2024-09-13T06:39:29.575 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.4826000000000006e-05 2024-09-13T06:39:29.575 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:29.575 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:39:29.576 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:29.576 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:29.576 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:29.576 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4154.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-13T06:39:29.576 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:11.525359+0000", 2024-09-13T06:39:29.576 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 17.977467669999999, 2024-09-13T06:39:29.576 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.019359514000000001, 2024-09-13T06:39:29.576 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:39:29.576 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:29.576 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:39:29.576 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4154", 2024-09-13T06:39:29.576 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/2406930292", 2024-09-13T06:39:29.576 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 116 2024-09-13T06:39:29.577 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:29.577 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:39:29.577 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:29.577 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:39:29.577 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.525359+0000", 2024-09-13T06:39:29.577 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:29.577 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:29.577 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:29.577 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:39:29.577 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.525359+0000", 2024-09-13T06:39:29.577 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:29.577 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:29.577 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:29.578 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:39:29.578 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.525357+0000", 2024-09-13T06:39:29.578 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999981 2024-09-13T06:39:29.578 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:29.578 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:29.578 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:39:29.578 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.525369+0000", 2024-09-13T06:39:29.578 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1647e-05 2024-09-13T06:39:29.578 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:29.578 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:29.578 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:39:29.578 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.525386+0000", 2024-09-13T06:39:29.579 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7762999999999999e-05 2024-09-13T06:39:29.579 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:29.579 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:29.579 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:39:29.579 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.525400+0000", 2024-09-13T06:39:29.579 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.4053000000000001e-05 2024-09-13T06:39:29.579 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:29.579 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:29.579 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:39:29.579 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.539897+0000", 2024-09-13T06:39:29.579 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.014497128999999999 2024-09-13T06:39:29.579 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:29.579 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:29.579 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:39:29.580 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.540022+0000", 2024-09-13T06:39:29.580 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00012416599999999999 2024-09-13T06:39:29.580 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:29.580 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:29.580 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 0", 2024-09-13T06:39:29.580 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.540199+0000", 2024-09-13T06:39:29.580 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00017705499999999999 2024-09-13T06:39:29.580 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:29.580 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:29.580 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-13T06:39:29.580 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.542161+0000", 2024-09-13T06:39:29.580 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0019622210000000001 2024-09-13T06:39:29.580 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:29.581 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:29.581 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:39:29.581 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.544529+0000", 2024-09-13T06:39:29.581 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0023684690000000002 2024-09-13T06:39:29.581 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:29.581 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:29.581 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-13T06:39:29.581 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.544614+0000", 2024-09-13T06:39:29.581 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.4711999999999998e-05 2024-09-13T06:39:29.581 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:29.581 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:29.581 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:39:29.581 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.544718+0000", 2024-09-13T06:39:29.582 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000103986 2024-09-13T06:39:29.582 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:29.582 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:39:29.582 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:29.582 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:29.582 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:29.582 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4154.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-13T06:39:29.582 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:11.525416+0000", 2024-09-13T06:39:29.582 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 17.977410117000002, 2024-09-13T06:39:29.582 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.019501830000000001, 2024-09-13T06:39:29.582 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:39:29.582 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:29.582 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:39:29.582 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4154", 2024-09-13T06:39:29.583 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/2406930292", 2024-09-13T06:39:29.583 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 117 2024-09-13T06:39:29.583 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:29.583 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:39:29.583 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:29.583 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:39:29.583 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.525416+0000", 2024-09-13T06:39:29.583 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:29.583 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:29.583 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:29.583 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:39:29.583 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.525416+0000", 2024-09-13T06:39:29.583 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:29.583 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:29.584 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:29.584 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:39:29.584 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.525415+0000", 2024-09-13T06:39:29.584 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999986 2024-09-13T06:39:29.584 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:29.584 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:29.584 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:39:29.584 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.525426+0000", 2024-09-13T06:39:29.584 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.101e-05 2024-09-13T06:39:29.584 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:29.584 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:29.584 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:39:29.584 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.525444+0000", 2024-09-13T06:39:29.585 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.768e-05 2024-09-13T06:39:29.585 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:29.585 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:29.585 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:39:29.585 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.525463+0000", 2024-09-13T06:39:29.585 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.9026999999999999e-05 2024-09-13T06:39:29.585 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:29.585 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:29.585 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:39:29.585 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.541203+0000", 2024-09-13T06:39:29.585 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.015740309000000001 2024-09-13T06:39:29.585 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:29.585 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:29.585 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:39:29.586 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.541330+0000", 2024-09-13T06:39:29.586 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000126976 2024-09-13T06:39:29.586 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:29.586 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:29.586 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 0", 2024-09-13T06:39:29.586 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.541522+0000", 2024-09-13T06:39:29.586 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00019165100000000001 2024-09-13T06:39:29.586 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:29.586 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:29.586 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-13T06:39:29.586 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.542798+0000", 2024-09-13T06:39:29.586 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.001276424 2024-09-13T06:39:29.586 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:29.586 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:29.586 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:39:29.587 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.544795+0000", 2024-09-13T06:39:29.587 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0019966540000000001 2024-09-13T06:39:29.587 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:29.587 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:29.587 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-13T06:39:29.587 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.544868+0000", 2024-09-13T06:39:29.587 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.3096000000000006e-05 2024-09-13T06:39:29.587 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:29.587 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:29.587 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:39:29.587 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.544918+0000", 2024-09-13T06:39:29.587 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.0226999999999999e-05 2024-09-13T06:39:29.587 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:29.588 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:39:29.588 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:29.588 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:29.588 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:29.588 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4154.0:134 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-13T06:39:29.588 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:12.006248+0000", 2024-09-13T06:39:29.588 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 17.496578186000001, 2024-09-13T06:39:29.588 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.012014530000000001, 2024-09-13T06:39:29.588 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:39:29.588 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:29.588 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:39:29.588 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4154", 2024-09-13T06:39:29.588 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/2406930292", 2024-09-13T06:39:29.589 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 134 2024-09-13T06:39:29.589 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:29.589 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:39:29.589 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:29.589 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:39:29.589 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.006248+0000", 2024-09-13T06:39:29.589 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:29.589 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:29.589 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:29.589 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:39:29.589 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.006248+0000", 2024-09-13T06:39:29.589 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:29.589 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:29.590 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:29.590 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:39:29.590 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.006247+0000", 2024-09-13T06:39:29.590 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:39:29.590 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:29.590 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:29.590 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:39:29.590 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.006329+0000", 2024-09-13T06:39:29.590 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.2003999999999996e-05 2024-09-13T06:39:29.590 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:29.590 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:29.590 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:39:29.590 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.006338+0000", 2024-09-13T06:39:29.591 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.2529999999999993e-06 2024-09-13T06:39:29.591 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:29.591 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:29.591 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:39:29.591 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.006345+0000", 2024-09-13T06:39:29.591 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.2249999999999997e-06 2024-09-13T06:39:29.591 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:29.591 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:29.591 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:39:29.591 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.007463+0000", 2024-09-13T06:39:29.591 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.001118345 2024-09-13T06:39:29.591 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:29.591 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:29.592 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:39:29.592 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.007513+0000", 2024-09-13T06:39:29.592 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.9678000000000001e-05 2024-09-13T06:39:29.592 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:29.592 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:29.592 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 0", 2024-09-13T06:39:29.592 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.007588+0000", 2024-09-13T06:39:29.592 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5433999999999996e-05 2024-09-13T06:39:29.592 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:29.592 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:29.592 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-13T06:39:29.592 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.011008+0000", 2024-09-13T06:39:29.592 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0034198029999999999 2024-09-13T06:39:29.593 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:29.593 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:29.593 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:39:29.593 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.018160+0000", 2024-09-13T06:39:29.593 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0071521579999999996 2024-09-13T06:39:29.593 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:29.593 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:29.593 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-13T06:39:29.593 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.018240+0000", 2024-09-13T06:39:29.593 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.9573000000000005e-05 2024-09-13T06:39:29.593 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:29.593 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:29.593 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:39:29.594 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.018263+0000", 2024-09-13T06:39:29.594 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.2894000000000001e-05 2024-09-13T06:39:29.594 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:29.594 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:39:29.594 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:29.594 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:29.594 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:29.594 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4154.0:136 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-13T06:39:29.594 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:12.006369+0000", 2024-09-13T06:39:29.594 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 17.496456768000002, 2024-09-13T06:39:29.594 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.012052078000000001, 2024-09-13T06:39:29.594 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:39:29.594 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:29.595 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:39:29.595 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4154", 2024-09-13T06:39:29.595 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/2406930292", 2024-09-13T06:39:29.595 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 136 2024-09-13T06:39:29.595 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:29.595 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:39:29.595 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:29.595 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:39:29.595 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.006369+0000", 2024-09-13T06:39:29.595 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:29.595 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:29.595 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:29.595 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:39:29.595 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.006369+0000", 2024-09-13T06:39:29.596 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:29.596 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:29.596 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:29.596 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:39:29.596 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.006369+0000", 2024-09-13T06:39:29.596 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:39:29.596 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:29.596 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:29.596 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:39:29.596 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.006372+0000", 2024-09-13T06:39:29.596 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.0630000000000002e-06 2024-09-13T06:39:29.596 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:29.596 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:29.597 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:39:29.597 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.006377+0000", 2024-09-13T06:39:29.597 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.6079999999999998e-06 2024-09-13T06:39:29.597 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:29.597 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:29.597 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:39:29.597 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.006384+0000", 2024-09-13T06:39:29.597 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.8560000000000001e-06 2024-09-13T06:39:29.597 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:29.597 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:29.597 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:39:29.597 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.008357+0000", 2024-09-13T06:39:29.597 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0019733839999999999 2024-09-13T06:39:29.597 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:29.598 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:29.598 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:39:29.598 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.008406+0000", 2024-09-13T06:39:29.598 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.9023000000000001e-05 2024-09-13T06:39:29.598 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:29.598 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:29.598 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 0", 2024-09-13T06:39:29.598 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.008489+0000", 2024-09-13T06:39:29.598 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.2649000000000001e-05 2024-09-13T06:39:29.598 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:29.598 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:29.598 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-13T06:39:29.598 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.011012+0000", 2024-09-13T06:39:29.598 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0025236880000000001 2024-09-13T06:39:29.598 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:29.599 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:29.599 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:39:29.599 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.018382+0000", 2024-09-13T06:39:29.599 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.007369596 2024-09-13T06:39:29.599 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:29.599 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:29.599 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-13T06:39:29.599 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.018405+0000", 2024-09-13T06:39:29.599 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.2670000000000001e-05 2024-09-13T06:39:29.599 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:29.599 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:29.599 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:39:29.599 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.018422+0000", 2024-09-13T06:39:29.599 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6864999999999999e-05 2024-09-13T06:39:29.600 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:29.600 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:39:29.600 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:29.600 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:29.600 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:29.600 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4154.0:137 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-13T06:39:29.600 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:12.006450+0000", 2024-09-13T06:39:29.600 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 17.496376438999999, 2024-09-13T06:39:29.600 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.012040990999999999, 2024-09-13T06:39:29.600 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:39:29.600 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:29.600 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:39:29.600 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4154", 2024-09-13T06:39:29.601 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/2406930292", 2024-09-13T06:39:29.601 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 137 2024-09-13T06:39:29.601 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:29.601 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:39:29.601 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:29.601 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:39:29.601 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.006450+0000", 2024-09-13T06:39:29.601 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:29.601 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:29.601 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:29.601 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:39:29.601 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.006450+0000", 2024-09-13T06:39:29.601 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:29.602 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:29.602 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:29.602 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:39:29.602 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.006449+0000", 2024-09-13T06:39:29.602 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:39:29.602 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:29.602 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:29.602 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:39:29.602 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.006549+0000", 2024-09-13T06:39:29.602 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.9847999999999997e-05 2024-09-13T06:39:29.602 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:29.602 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:29.602 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:39:29.602 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.006560+0000", 2024-09-13T06:39:29.603 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1012000000000001e-05 2024-09-13T06:39:29.603 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:29.603 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:29.603 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:39:29.603 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.006566+0000", 2024-09-13T06:39:29.603 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.1630000000000001e-06 2024-09-13T06:39:29.603 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:29.603 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:29.603 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:39:29.603 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.008760+0000", 2024-09-13T06:39:29.603 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0021934659999999998 2024-09-13T06:39:29.603 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:29.603 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:29.604 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:39:29.604 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.008803+0000", 2024-09-13T06:39:29.604 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.3492000000000003e-05 2024-09-13T06:39:29.604 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:29.604 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:29.604 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 0", 2024-09-13T06:39:29.604 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.008879+0000", 2024-09-13T06:39:29.604 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5252000000000004e-05 2024-09-13T06:39:29.604 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:29.604 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:29.604 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-13T06:39:29.604 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.011015+0000", 2024-09-13T06:39:29.604 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0021362349999999998 2024-09-13T06:39:29.605 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:29.605 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:29.605 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:39:29.605 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.018452+0000", 2024-09-13T06:39:29.605 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.007436865 2024-09-13T06:39:29.605 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:29.605 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:29.605 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-13T06:39:29.605 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.018474+0000", 2024-09-13T06:39:29.605 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.2149000000000001e-05 2024-09-13T06:39:29.605 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:29.605 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:29.605 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:39:29.606 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.018491+0000", 2024-09-13T06:39:29.606 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6983999999999999e-05 2024-09-13T06:39:29.606 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:29.606 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:39:29.606 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:29.606 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:29.606 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:29.606 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4154.0:139 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-13T06:39:29.606 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:12.006595+0000", 2024-09-13T06:39:29.606 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 17.496231121000001, 2024-09-13T06:39:29.606 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.012024933999999999, 2024-09-13T06:39:29.606 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:39:29.607 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:29.607 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:39:29.607 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4154", 2024-09-13T06:39:29.607 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/2406930292", 2024-09-13T06:39:29.607 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 139 2024-09-13T06:39:29.607 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:29.607 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:39:29.607 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:29.607 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:39:29.607 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.006595+0000", 2024-09-13T06:39:29.607 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:29.607 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:29.607 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:29.608 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:39:29.608 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.006595+0000", 2024-09-13T06:39:29.608 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:29.608 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:29.608 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:29.608 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:39:29.608 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.006595+0000", 2024-09-13T06:39:29.608 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:39:29.608 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:29.608 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:29.608 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:39:29.608 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.006598+0000", 2024-09-13T06:39:29.609 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.1769999999999998e-06 2024-09-13T06:39:29.609 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:29.609 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:29.609 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:39:29.609 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.006612+0000", 2024-09-13T06:39:29.609 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.4177e-05 2024-09-13T06:39:29.609 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:29.609 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:29.609 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:39:29.609 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.006617+0000", 2024-09-13T06:39:29.609 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.561e-06 2024-09-13T06:39:29.609 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:29.609 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:29.609 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:39:29.610 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.009658+0000", 2024-09-13T06:39:29.610 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0030413369999999999 2024-09-13T06:39:29.610 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:29.610 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:29.610 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:39:29.610 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.009707+0000", 2024-09-13T06:39:29.610 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.9089999999999999e-05 2024-09-13T06:39:29.610 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:29.610 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:29.610 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 0", 2024-09-13T06:39:29.610 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.009795+0000", 2024-09-13T06:39:29.610 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.7619000000000003e-05 2024-09-13T06:39:29.610 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:29.611 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:29.611 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-13T06:39:29.611 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.011021+0000", 2024-09-13T06:39:29.611 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0012266289999999999 2024-09-13T06:39:29.611 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:29.611 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:29.611 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:39:29.611 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.018582+0000", 2024-09-13T06:39:29.611 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0075603399999999996 2024-09-13T06:39:29.611 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:29.611 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:29.612 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-13T06:39:29.612 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.018603+0000", 2024-09-13T06:39:29.612 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.1795999999999999e-05 2024-09-13T06:39:29.612 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:29.612 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:29.612 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:39:29.612 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.018620+0000", 2024-09-13T06:39:29.612 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6562000000000002e-05 2024-09-13T06:39:29.612 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:29.612 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:39:29.612 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:29.612 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:29.612 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:29.613 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4154.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-13T06:39:29.613 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:12.006689+0000", 2024-09-13T06:39:29.613 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 17.496136931999999, 2024-09-13T06:39:29.613 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.012427258, 2024-09-13T06:39:29.613 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:39:29.613 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:29.613 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:39:29.613 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4154", 2024-09-13T06:39:29.613 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/2406930292", 2024-09-13T06:39:29.613 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 140 2024-09-13T06:39:29.613 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:29.613 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:39:29.614 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:29.614 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:39:29.614 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.006689+0000", 2024-09-13T06:39:29.614 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:29.614 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:29.614 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:29.614 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:39:29.614 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.006689+0000", 2024-09-13T06:39:29.614 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:29.614 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:29.614 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:29.614 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:39:29.614 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.006689+0000", 2024-09-13T06:39:29.615 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:39:29.615 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:29.615 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:29.615 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:39:29.615 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.006795+0000", 2024-09-13T06:39:29.615 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00010662699999999999 2024-09-13T06:39:29.615 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:29.615 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:29.615 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:39:29.615 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.006804+0000", 2024-09-13T06:39:29.615 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.055e-06 2024-09-13T06:39:29.615 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:29.615 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:29.616 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:39:29.616 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.006808+0000", 2024-09-13T06:39:29.616 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.7450000000000003e-06 2024-09-13T06:39:29.616 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:29.616 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:29.616 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:39:29.616 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.010066+0000", 2024-09-13T06:39:29.616 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0032579570000000001 2024-09-13T06:39:29.616 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:29.616 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:29.616 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:39:29.616 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.010111+0000", 2024-09-13T06:39:29.616 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.4563e-05 2024-09-13T06:39:29.617 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:29.617 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:29.617 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 0", 2024-09-13T06:39:29.617 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.010185+0000", 2024-09-13T06:39:29.617 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.4108000000000003e-05 2024-09-13T06:39:29.617 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:29.617 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:29.617 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-13T06:39:29.617 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.011161+0000", 2024-09-13T06:39:29.617 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00097629200000000002 2024-09-13T06:39:29.617 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:29.617 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:29.617 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:39:29.618 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.019061+0000", 2024-09-13T06:39:29.618 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0079001939999999993 2024-09-13T06:39:29.618 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:29.618 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:29.618 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-13T06:39:29.618 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.019095+0000", 2024-09-13T06:39:29.618 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.3200000000000001e-05 2024-09-13T06:39:29.618 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:29.618 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:29.618 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:39:29.618 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.019117+0000", 2024-09-13T06:39:29.618 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.1985e-05 2024-09-13T06:39:29.618 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:29.619 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:39:29.619 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:29.619 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:29.619 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:29.619 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4154.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-13T06:39:29.619 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:12.006814+0000", 2024-09-13T06:39:29.619 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 17.496011748000001, 2024-09-13T06:39:29.619 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.012896405999999999, 2024-09-13T06:39:29.619 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:39:29.619 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:29.619 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:39:29.619 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4154", 2024-09-13T06:39:29.619 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/2406930292", 2024-09-13T06:39:29.619 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 141 2024-09-13T06:39:29.620 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:29.620 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:39:29.620 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:29.620 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:39:29.620 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.006814+0000", 2024-09-13T06:39:29.620 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:29.620 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:29.620 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:29.620 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:39:29.620 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.006814+0000", 2024-09-13T06:39:29.620 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:29.620 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:29.620 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:29.621 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:39:29.621 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.006814+0000", 2024-09-13T06:39:29.621 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:39:29.621 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:29.621 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:29.621 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:39:29.621 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.006818+0000", 2024-09-13T06:39:29.621 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.8840000000000004e-06 2024-09-13T06:39:29.621 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:29.621 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:29.621 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:39:29.621 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.006834+0000", 2024-09-13T06:39:29.621 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6133999999999998e-05 2024-09-13T06:39:29.622 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:29.622 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:29.622 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:39:29.622 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.006838+0000", 2024-09-13T06:39:29.622 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0879999999999997e-06 2024-09-13T06:39:29.622 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:29.622 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:29.622 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:39:29.622 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.010586+0000", 2024-09-13T06:39:29.622 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.003747954 2024-09-13T06:39:29.622 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:29.622 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:29.622 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:39:29.623 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.010630+0000", 2024-09-13T06:39:29.623 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.3736000000000003e-05 2024-09-13T06:39:29.623 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:29.623 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:29.623 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 0", 2024-09-13T06:39:29.623 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.010701+0000", 2024-09-13T06:39:29.623 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.1284000000000004e-05 2024-09-13T06:39:29.623 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:29.623 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:29.623 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-13T06:39:29.623 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.011593+0000", 2024-09-13T06:39:29.623 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00089209300000000005 2024-09-13T06:39:29.623 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:29.623 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:29.623 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:39:29.624 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.019665+0000", 2024-09-13T06:39:29.624 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0080716169999999997 2024-09-13T06:39:29.624 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:29.624 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:29.624 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-13T06:39:29.624 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.019691+0000", 2024-09-13T06:39:29.624 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.6514000000000001e-05 2024-09-13T06:39:29.624 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:29.624 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:29.624 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:39:29.624 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.019711+0000", 2024-09-13T06:39:29.624 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.9641e-05 2024-09-13T06:39:29.624 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:29.625 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:39:29.625 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:29.625 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:29.625 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:39:29.625 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:39:29.626 INFO:tasks.ceph.osd.6.smithi139.stderr:2024-09-13T06:39:29.626+0000 7fcd02c5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26385) UID: 0 2024-09-13T06:39:29.627 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-13T06:39:29.728 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:39:29.731+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:39:29.746 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:39:29.746 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-13T06:39:29.747 INFO:teuthology.orchestra.run.smithi081.stdout: "num_ops": 0 2024-09-13T06:39:29.747 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:39:29.759 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-13T06:39:29.847 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:39:29.851+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:39:29.919 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:39:29.919 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-13T06:39:29.919 INFO:teuthology.orchestra.run.smithi081.stdout: "complaint_time": 30, 2024-09-13T06:39:29.919 INFO:teuthology.orchestra.run.smithi081.stdout: "num_blocked_ops": 0 2024-09-13T06:39:29.920 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:39:29.929 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-13T06:39:29.930+0000 7f86a5f06640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26387) UID: 0 2024-09-13T06:39:29.932 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-13T06:39:30.030 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:39:30.031+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:39:30.092 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:39:30.092 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 20, 2024-09-13T06:39:30.092 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 600, 2024-09-13T06:39:30.092 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [ 2024-09-13T06:39:30.092 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:30.092 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4154.0:56 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'34, mlcod=15'30)", 2024-09-13T06:39:30.092 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:11.307866+0000", 2024-09-13T06:39:30.092 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 18.786859178, 2024-09-13T06:39:30.093 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0044451710000000004, 2024-09-13T06:39:30.093 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:30.093 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:30.093 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:30.093 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:30.093 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:30.093 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:11.307866+0000", 2024-09-13T06:39:30.093 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:30.093 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:30.093 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:30.093 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:30.093 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:11.307866+0000", 2024-09-13T06:39:30.094 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:30.094 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:30.094 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:30.094 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:30.094 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:11.307865+0000", 2024-09-13T06:39:30.094 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999986 2024-09-13T06:39:30.094 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:30.094 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:30.094 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:30.094 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:11.307876+0000", 2024-09-13T06:39:30.094 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1362999999999999e-05 2024-09-13T06:39:30.094 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:30.095 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:30.095 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:30.095 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:11.307900+0000", 2024-09-13T06:39:30.095 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3813000000000001e-05 2024-09-13T06:39:30.095 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:30.095 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:30.095 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:30.095 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:11.307912+0000", 2024-09-13T06:39:30.095 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2286000000000001e-05 2024-09-13T06:39:30.095 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:30.095 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:30.095 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:30.095 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:11.307987+0000", 2024-09-13T06:39:30.095 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4562999999999997e-05 2024-09-13T06:39:30.095 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:30.096 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:30.096 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:30.096 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:11.308023+0000", 2024-09-13T06:39:30.096 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.6637000000000002e-05 2024-09-13T06:39:30.096 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:30.096 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:30.096 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:39:30.096 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:11.312232+0000", 2024-09-13T06:39:30.096 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0042085539999999998 2024-09-13T06:39:30.096 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:30.096 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:30.097 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:30.097 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:11.312311+0000", 2024-09-13T06:39:30.097 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.9364999999999997e-05 2024-09-13T06:39:30.097 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:30.097 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:30.097 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:30.097 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:30.097 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:30.097 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4154.0:67 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'41, mlcod=15'39)", 2024-09-13T06:39:30.097 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:11.333035+0000", 2024-09-13T06:39:30.097 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 18.761689791999999, 2024-09-13T06:39:30.097 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0063409859999999998, 2024-09-13T06:39:30.097 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:30.098 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:30.098 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:30.098 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:30.098 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:30.098 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:11.333035+0000", 2024-09-13T06:39:30.098 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:30.098 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:30.098 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:30.098 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:30.098 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:11.333035+0000", 2024-09-13T06:39:30.098 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:30.099 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:30.099 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:30.099 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:30.099 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:11.333034+0000", 2024-09-13T06:39:30.099 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999981 2024-09-13T06:39:30.099 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:30.099 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:30.099 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:30.099 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:11.333048+0000", 2024-09-13T06:39:30.099 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3859999999999999e-05 2024-09-13T06:39:30.099 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:30.099 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:30.099 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:30.100 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:11.333076+0000", 2024-09-13T06:39:30.100 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.8586e-05 2024-09-13T06:39:30.100 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:30.100 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:30.100 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:30.100 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:11.333089+0000", 2024-09-13T06:39:30.100 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2447e-05 2024-09-13T06:39:30.100 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:30.100 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:30.100 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:30.100 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:11.333193+0000", 2024-09-13T06:39:30.101 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000104042 2024-09-13T06:39:30.101 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:30.101 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:30.101 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:30.101 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:11.333232+0000", 2024-09-13T06:39:30.101 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.9406999999999997e-05 2024-09-13T06:39:30.101 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:30.101 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:30.101 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:39:30.101 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:11.339313+0000", 2024-09-13T06:39:30.101 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0060808529999999998 2024-09-13T06:39:30.101 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:30.101 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:30.102 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:30.102 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:11.339376+0000", 2024-09-13T06:39:30.102 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3565000000000006e-05 2024-09-13T06:39:30.102 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:30.102 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:30.102 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:30.102 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:30.102 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:30.102 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4154.0:68 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'42, mlcod=15'39)", 2024-09-13T06:39:30.102 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:11.333986+0000", 2024-09-13T06:39:30.102 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 18.760738907, 2024-09-13T06:39:30.102 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0054233750000000002, 2024-09-13T06:39:30.102 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:30.103 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:30.103 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:30.103 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:30.103 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:30.103 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:11.333986+0000", 2024-09-13T06:39:30.103 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:30.103 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:30.103 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:30.104 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:30.104 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:11.333986+0000", 2024-09-13T06:39:30.104 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:30.104 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:30.104 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:30.104 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:30.104 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:11.333985+0000", 2024-09-13T06:39:30.104 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999981 2024-09-13T06:39:30.104 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:30.104 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:30.104 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:30.104 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:11.333997+0000", 2024-09-13T06:39:30.105 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2813000000000001e-05 2024-09-13T06:39:30.105 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:30.105 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:30.105 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:30.105 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:11.334026+0000", 2024-09-13T06:39:30.105 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.8787000000000001e-05 2024-09-13T06:39:30.105 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:30.105 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:30.105 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:30.106 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:11.334039+0000", 2024-09-13T06:39:30.106 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2713e-05 2024-09-13T06:39:30.106 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:30.106 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:30.106 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:30.106 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:11.337023+0000", 2024-09-13T06:39:30.106 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0029835600000000001 2024-09-13T06:39:30.106 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:30.106 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:30.106 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:30.106 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:11.337053+0000", 2024-09-13T06:39:30.106 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.0453000000000001e-05 2024-09-13T06:39:30.106 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:30.107 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:30.107 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:39:30.107 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:11.339379+0000", 2024-09-13T06:39:30.107 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0023261480000000001 2024-09-13T06:39:30.107 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:30.107 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:30.107 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:30.107 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:11.339410+0000", 2024-09-13T06:39:30.107 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.0583999999999997e-05 2024-09-13T06:39:30.107 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:30.107 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:30.107 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:30.107 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:30.107 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:30.107 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4154.0:109 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'71, mlcod=15'67)", 2024-09-13T06:39:30.108 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:11.530573+0000", 2024-09-13T06:39:30.108 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 18.564152540999999, 2024-09-13T06:39:30.108 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0050450549999999997, 2024-09-13T06:39:30.108 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:30.108 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:30.108 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:30.108 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:30.108 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:30.108 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:11.530573+0000", 2024-09-13T06:39:30.108 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:30.108 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:30.108 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:30.108 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:30.108 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:11.530573+0000", 2024-09-13T06:39:30.109 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:30.109 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:30.109 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:30.109 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:30.109 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:11.530571+0000", 2024-09-13T06:39:30.109 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999986 2024-09-13T06:39:30.109 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:30.109 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:30.109 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:30.109 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:11.530689+0000", 2024-09-13T06:39:30.109 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000117182 2024-09-13T06:39:30.110 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:30.110 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:30.110 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:30.110 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:11.530716+0000", 2024-09-13T06:39:30.110 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.7120000000000001e-05 2024-09-13T06:39:30.110 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:30.110 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:30.110 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:30.110 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:11.530736+0000", 2024-09-13T06:39:30.110 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0052999999999999e-05 2024-09-13T06:39:30.111 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:30.111 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:30.111 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:30.111 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:11.530784+0000", 2024-09-13T06:39:30.111 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.8361e-05 2024-09-13T06:39:30.111 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:30.111 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:30.111 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:30.111 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:11.530798+0000", 2024-09-13T06:39:30.111 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4276e-05 2024-09-13T06:39:30.113 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:30.113 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:30.113 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:39:30.113 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:11.535584+0000", 2024-09-13T06:39:30.113 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.004786116 2024-09-13T06:39:30.113 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:30.113 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:30.113 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:30.113 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:11.535618+0000", 2024-09-13T06:39:30.113 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.328e-05 2024-09-13T06:39:30.113 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:30.114 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:30.114 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:30.114 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:30.114 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:30.114 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4154.0:111 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'73, mlcod=15'68)", 2024-09-13T06:39:30.114 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:11.533536+0000", 2024-09-13T06:39:30.114 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 18.561189217999999, 2024-09-13T06:39:30.114 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0048684330000000001, 2024-09-13T06:39:30.114 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:30.114 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:30.115 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:30.115 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:30.115 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:30.115 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:11.533536+0000", 2024-09-13T06:39:30.115 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:30.115 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:30.115 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:30.115 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:30.115 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:11.533536+0000", 2024-09-13T06:39:30.115 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:30.115 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:30.115 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:30.115 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:30.116 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:11.533535+0000", 2024-09-13T06:39:30.116 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:39:30.116 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:30.116 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:30.116 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:30.116 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:11.533544+0000", 2024-09-13T06:39:30.116 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.303e-06 2024-09-13T06:39:30.116 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:30.116 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:30.116 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:30.116 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:11.533554+0000", 2024-09-13T06:39:30.116 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0421999999999999e-05 2024-09-13T06:39:30.116 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:30.116 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:30.117 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:30.117 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:11.533559+0000", 2024-09-13T06:39:30.117 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.203e-06 2024-09-13T06:39:30.117 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:30.117 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:30.117 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:30.117 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:11.533602+0000", 2024-09-13T06:39:30.117 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.2901999999999997e-05 2024-09-13T06:39:30.117 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:30.117 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:30.117 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:30.117 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:11.533616+0000", 2024-09-13T06:39:30.117 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3753e-05 2024-09-13T06:39:30.118 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:30.118 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:30.118 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:39:30.118 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:11.538344+0000", 2024-09-13T06:39:30.118 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0047280489999999998 2024-09-13T06:39:30.118 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:30.118 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:30.118 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:30.118 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:11.538404+0000", 2024-09-13T06:39:30.118 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0408999999999997e-05 2024-09-13T06:39:30.118 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:30.118 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:30.119 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:30.119 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:30.119 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:30.119 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4154.0:113 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'75, mlcod=15'68)", 2024-09-13T06:39:30.119 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:11.536011+0000", 2024-09-13T06:39:30.119 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 18.558714499000001, 2024-09-13T06:39:30.119 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0048854359999999999, 2024-09-13T06:39:30.119 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:30.119 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:30.119 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:30.119 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:30.119 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:30.119 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:11.536011+0000", 2024-09-13T06:39:30.119 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:30.120 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:30.120 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:30.120 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:30.120 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:11.536011+0000", 2024-09-13T06:39:30.120 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:30.120 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:30.120 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:30.120 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:30.120 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:11.536010+0000", 2024-09-13T06:39:30.120 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.999999 2024-09-13T06:39:30.120 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:30.120 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:30.120 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:30.120 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:11.536017+0000", 2024-09-13T06:39:30.121 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.7700000000000004e-06 2024-09-13T06:39:30.121 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:30.121 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:30.121 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:30.121 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:11.536030+0000", 2024-09-13T06:39:30.121 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3608000000000001e-05 2024-09-13T06:39:30.121 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:30.121 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:30.121 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:30.121 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:11.536041+0000", 2024-09-13T06:39:30.121 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0454e-05 2024-09-13T06:39:30.121 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:30.121 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:30.121 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:30.121 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:11.536080+0000", 2024-09-13T06:39:30.122 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.9109000000000001e-05 2024-09-13T06:39:30.122 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:30.122 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:30.122 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:30.122 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:11.536093+0000", 2024-09-13T06:39:30.122 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2948e-05 2024-09-13T06:39:30.122 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:30.122 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:30.122 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:39:30.122 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:11.540864+0000", 2024-09-13T06:39:30.122 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.004771572 2024-09-13T06:39:30.122 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:30.122 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:30.123 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:30.123 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:11.540896+0000", 2024-09-13T06:39:30.123 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.1834e-05 2024-09-13T06:39:30.123 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:30.123 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:30.123 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:30.123 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:30.123 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:30.123 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4154.0:115 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'77, mlcod=15'71)", 2024-09-13T06:39:30.123 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:11.538806+0000", 2024-09-13T06:39:30.123 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 18.555918729999998, 2024-09-13T06:39:30.124 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.004833426, 2024-09-13T06:39:30.124 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:30.124 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:30.124 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:30.124 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:30.124 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:30.124 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:11.538806+0000", 2024-09-13T06:39:30.124 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:30.124 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:30.124 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:30.124 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:30.124 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:11.538806+0000", 2024-09-13T06:39:30.124 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:30.124 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:30.125 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:30.125 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:30.125 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:11.538806+0000", 2024-09-13T06:39:30.125 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.999999 2024-09-13T06:39:30.125 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:30.125 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:30.125 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:30.125 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:11.538853+0000", 2024-09-13T06:39:30.125 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7314000000000001e-05 2024-09-13T06:39:30.125 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:30.125 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:30.125 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:30.125 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:11.538867+0000", 2024-09-13T06:39:30.126 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4287000000000001e-05 2024-09-13T06:39:30.126 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:30.126 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:30.126 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:30.126 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:11.538873+0000", 2024-09-13T06:39:30.126 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8420000000000001e-06 2024-09-13T06:39:30.126 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:30.126 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:30.126 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:30.126 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:11.538913+0000", 2024-09-13T06:39:30.126 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.0085e-05 2024-09-13T06:39:30.126 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:30.126 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:30.126 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:30.127 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:11.538938+0000", 2024-09-13T06:39:30.127 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4598000000000001e-05 2024-09-13T06:39:30.127 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:30.127 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:30.127 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:39:30.127 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:11.543605+0000", 2024-09-13T06:39:30.127 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0046669270000000004 2024-09-13T06:39:30.127 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:30.127 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:30.127 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:30.127 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:11.543640+0000", 2024-09-13T06:39:30.127 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.5271000000000002e-05 2024-09-13T06:39:30.128 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:30.128 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:30.128 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:30.128 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:30.128 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:30.128 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4154.0:130 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'88, mlcod=15'85)", 2024-09-13T06:39:30.128 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:12.005647+0000", 2024-09-13T06:39:30.128 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 18.089078614000002, 2024-09-13T06:39:30.128 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0064037570000000004, 2024-09-13T06:39:30.128 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:30.128 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:30.128 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:30.128 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:30.129 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:30.129 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.005647+0000", 2024-09-13T06:39:30.129 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:30.129 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:30.129 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:30.129 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:30.129 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.005647+0000", 2024-09-13T06:39:30.129 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:30.129 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:30.129 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:30.129 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:30.129 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.005645+0000", 2024-09-13T06:39:30.129 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999981 2024-09-13T06:39:30.130 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:30.130 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:30.130 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:30.130 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.005664+0000", 2024-09-13T06:39:30.130 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8876999999999999e-05 2024-09-13T06:39:30.130 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:30.130 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:30.130 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:30.130 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.005695+0000", 2024-09-13T06:39:30.130 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.1467000000000002e-05 2024-09-13T06:39:30.131 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:30.131 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:30.131 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:30.131 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.005715+0000", 2024-09-13T06:39:30.131 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0248999999999999e-05 2024-09-13T06:39:30.131 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:30.131 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:30.132 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:30.132 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.006412+0000", 2024-09-13T06:39:30.132 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00069722499999999999 2024-09-13T06:39:30.132 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:30.132 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:30.132 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:30.133 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.006475+0000", 2024-09-13T06:39:30.133 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.2955999999999998e-05 2024-09-13T06:39:30.133 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:30.133 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:30.133 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:39:30.133 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.011987+0000", 2024-09-13T06:39:30.133 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0055118240000000002 2024-09-13T06:39:30.134 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:30.134 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:30.134 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:30.134 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.012050+0000", 2024-09-13T06:39:30.134 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3102999999999995e-05 2024-09-13T06:39:30.134 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:30.134 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:30.134 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:30.134 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:30.135 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:30.135 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4154.0:131 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'89, mlcod=15'85)", 2024-09-13T06:39:30.135 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:12.006115+0000", 2024-09-13T06:39:30.135 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 18.088610148000001, 2024-09-13T06:39:30.135 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0092077789999999993, 2024-09-13T06:39:30.135 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:30.135 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:30.135 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:30.135 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:30.135 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:30.135 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.006115+0000", 2024-09-13T06:39:30.135 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:30.135 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:30.136 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:30.136 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:30.136 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.006115+0000", 2024-09-13T06:39:30.136 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:30.136 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:30.136 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:30.136 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:30.136 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.006114+0000", 2024-09-13T06:39:30.136 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999986 2024-09-13T06:39:30.136 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:30.137 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:30.137 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:30.137 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.006258+0000", 2024-09-13T06:39:30.137 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00014467899999999999 2024-09-13T06:39:30.137 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:30.137 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:30.137 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:30.138 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.006277+0000", 2024-09-13T06:39:30.138 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8425999999999999e-05 2024-09-13T06:39:30.138 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:30.138 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:30.138 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:30.138 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.006288+0000", 2024-09-13T06:39:30.138 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1037e-05 2024-09-13T06:39:30.138 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:30.138 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:30.138 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:30.138 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.007461+0000", 2024-09-13T06:39:30.138 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.001173381 2024-09-13T06:39:30.139 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:30.139 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:30.139 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:30.139 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.007522+0000", 2024-09-13T06:39:30.139 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0266999999999997e-05 2024-09-13T06:39:30.139 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:30.139 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:30.139 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:39:30.139 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.015248+0000", 2024-09-13T06:39:30.139 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0077260200000000001 2024-09-13T06:39:30.139 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:30.139 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:30.139 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:30.139 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.015323+0000", 2024-09-13T06:39:30.140 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5289000000000004e-05 2024-09-13T06:39:30.140 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:30.140 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:30.140 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:30.140 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:30.140 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:30.140 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4154.0:132 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'90, mlcod=15'85)", 2024-09-13T06:39:30.140 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:12.006560+0000", 2024-09-13T06:39:30.141 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 18.088165228000001, 2024-09-13T06:39:30.141 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0088017219999999997, 2024-09-13T06:39:30.141 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:30.141 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:30.141 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:30.141 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:30.141 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:30.142 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.006560+0000", 2024-09-13T06:39:30.142 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:30.142 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:30.142 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:30.142 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:30.142 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.006560+0000", 2024-09-13T06:39:30.143 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:30.143 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:30.143 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:30.143 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:30.143 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.006559+0000", 2024-09-13T06:39:30.143 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.999999 2024-09-13T06:39:30.144 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:30.144 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:30.144 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:30.144 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.006569+0000", 2024-09-13T06:39:30.144 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0197000000000001e-05 2024-09-13T06:39:30.144 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:30.144 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:30.145 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:30.145 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.006587+0000", 2024-09-13T06:39:30.145 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8073000000000001e-05 2024-09-13T06:39:30.145 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:30.145 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:30.145 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:30.145 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.006596+0000", 2024-09-13T06:39:30.145 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.0000000000000002e-06 2024-09-13T06:39:30.145 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:30.145 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:30.146 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:30.146 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.008751+0000", 2024-09-13T06:39:30.146 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0021548299999999999 2024-09-13T06:39:30.146 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:30.146 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:30.146 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:30.146 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.008803+0000", 2024-09-13T06:39:30.146 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.215e-05 2024-09-13T06:39:30.147 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:30.147 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:30.147 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:39:30.147 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.015329+0000", 2024-09-13T06:39:30.147 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0065259589999999996 2024-09-13T06:39:30.147 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:30.147 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:30.147 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:30.147 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.015362+0000", 2024-09-13T06:39:30.147 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.2613000000000001e-05 2024-09-13T06:39:30.147 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:30.147 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:30.147 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:30.148 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:30.148 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:30.148 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4154.0:133 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'91, mlcod=15'85)", 2024-09-13T06:39:30.148 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:12.006919+0000", 2024-09-13T06:39:30.148 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 18.087805900999999, 2024-09-13T06:39:30.148 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0084917580000000003, 2024-09-13T06:39:30.148 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:30.148 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:30.148 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:30.149 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:30.149 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:30.149 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.006919+0000", 2024-09-13T06:39:30.149 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:30.149 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:30.149 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:30.149 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:30.149 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.006919+0000", 2024-09-13T06:39:30.149 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:30.149 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:30.149 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:30.149 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:30.149 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.006918+0000", 2024-09-13T06:39:30.150 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.999999 2024-09-13T06:39:30.150 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:30.150 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:30.150 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:30.150 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.006926+0000", 2024-09-13T06:39:30.150 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.9929999999999995e-06 2024-09-13T06:39:30.150 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:30.150 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:30.150 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:30.150 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.006948+0000", 2024-09-13T06:39:30.150 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1593000000000001e-05 2024-09-13T06:39:30.150 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:30.151 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:30.151 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:30.151 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.006958+0000", 2024-09-13T06:39:30.151 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.029e-05 2024-09-13T06:39:30.151 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:30.151 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:30.151 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:30.151 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.009740+0000", 2024-09-13T06:39:30.151 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0027821259999999998 2024-09-13T06:39:30.151 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:30.151 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:30.152 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:30.152 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.009776+0000", 2024-09-13T06:39:30.152 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.5102999999999999e-05 2024-09-13T06:39:30.152 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:30.152 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:30.152 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:39:30.152 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.015366+0000", 2024-09-13T06:39:30.152 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0055902160000000003 2024-09-13T06:39:30.152 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:30.152 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:30.152 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:30.152 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.015411+0000", 2024-09-13T06:39:30.152 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5290000000000002e-05 2024-09-13T06:39:30.153 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:30.153 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:30.153 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:30.153 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:30.153 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:30.153 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4154.0:134 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'92, mlcod=15'85)", 2024-09-13T06:39:30.153 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:12.007373+0000", 2024-09-13T06:39:30.153 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 18.087352553999999, 2024-09-13T06:39:30.153 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.010012544999999999, 2024-09-13T06:39:30.153 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:30.154 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:30.154 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:30.154 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:30.154 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:30.154 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.007373+0000", 2024-09-13T06:39:30.154 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:30.154 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:30.154 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:30.154 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:30.154 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.007373+0000", 2024-09-13T06:39:30.155 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:30.155 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:30.155 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:30.155 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:30.155 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.007372+0000", 2024-09-13T06:39:30.155 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.999999 2024-09-13T06:39:30.155 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:30.155 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:30.155 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:30.155 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.007421+0000", 2024-09-13T06:39:30.155 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9660000000000002e-05 2024-09-13T06:39:30.155 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:30.155 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:30.156 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:30.156 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.007435+0000", 2024-09-13T06:39:30.156 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3743e-05 2024-09-13T06:39:30.156 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:30.156 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:30.156 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:30.156 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.007443+0000", 2024-09-13T06:39:30.156 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.2269999999999993e-06 2024-09-13T06:39:30.156 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:30.156 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:30.156 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:30.156 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.010303+0000", 2024-09-13T06:39:30.156 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0028596509999999999 2024-09-13T06:39:30.157 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:30.157 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:30.157 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:30.157 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.010337+0000", 2024-09-13T06:39:30.157 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.4306e-05 2024-09-13T06:39:30.157 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:30.157 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:30.157 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:39:30.157 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.017329+0000", 2024-09-13T06:39:30.157 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0069915660000000003 2024-09-13T06:39:30.157 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:30.157 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:30.158 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:30.158 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.017385+0000", 2024-09-13T06:39:30.158 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.6409000000000002e-05 2024-09-13T06:39:30.158 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:30.158 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:30.158 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:30.159 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:30.159 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:30.159 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4154.0:135 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'93, mlcod=15'85)", 2024-09-13T06:39:30.159 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:12.007816+0000", 2024-09-13T06:39:30.159 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 18.086909024000001, 2024-09-13T06:39:30.159 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0096068089999999991, 2024-09-13T06:39:30.159 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:30.160 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:30.160 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:30.160 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:30.160 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:30.160 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.007816+0000", 2024-09-13T06:39:30.160 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:30.160 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:30.160 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:30.160 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:30.160 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.007816+0000", 2024-09-13T06:39:30.160 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:30.160 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:30.161 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:30.161 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:30.161 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.007815+0000", 2024-09-13T06:39:30.161 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.999999 2024-09-13T06:39:30.161 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:30.161 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:30.161 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:30.161 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.007823+0000", 2024-09-13T06:39:30.161 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.8730000000000007e-06 2024-09-13T06:39:30.161 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:30.161 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:30.161 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:30.162 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.007836+0000", 2024-09-13T06:39:30.162 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2510000000000001e-05 2024-09-13T06:39:30.162 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:30.162 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:30.162 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:30.162 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.007843+0000", 2024-09-13T06:39:30.162 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5830000000000001e-06 2024-09-13T06:39:30.162 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:30.162 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:30.162 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:30.162 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.011183+0000", 2024-09-13T06:39:30.162 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0033400539999999999 2024-09-13T06:39:30.162 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:30.162 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:30.162 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:30.163 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.011217+0000", 2024-09-13T06:39:30.163 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.3355999999999997e-05 2024-09-13T06:39:30.163 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:30.163 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:30.163 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:39:30.163 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.017391+0000", 2024-09-13T06:39:30.163 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0061736960000000002 2024-09-13T06:39:30.163 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:30.163 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:30.163 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:30.163 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.017423+0000", 2024-09-13T06:39:30.163 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.2499999999999997e-05 2024-09-13T06:39:30.163 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:30.164 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:30.164 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:30.164 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:30.164 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:30.164 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4154.0:136 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'94, mlcod=15'85)", 2024-09-13T06:39:30.164 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:12.008176+0000", 2024-09-13T06:39:30.164 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 18.08654911, 2024-09-13T06:39:30.164 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0092805379999999996, 2024-09-13T06:39:30.164 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:30.164 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:30.164 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:30.164 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:30.165 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:30.165 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.008176+0000", 2024-09-13T06:39:30.165 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:30.165 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:30.165 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:30.165 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:30.165 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.008176+0000", 2024-09-13T06:39:30.165 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:30.165 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:30.165 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:30.166 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:30.166 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.008175+0000", 2024-09-13T06:39:30.166 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:39:30.166 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:30.166 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:30.166 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:30.166 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.008183+0000", 2024-09-13T06:39:30.166 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.1099999999999997e-06 2024-09-13T06:39:30.166 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:30.166 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:30.166 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:30.166 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.008207+0000", 2024-09-13T06:39:30.166 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4383999999999999e-05 2024-09-13T06:39:30.166 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:30.167 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:30.167 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:30.167 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.008216+0000", 2024-09-13T06:39:30.167 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.4860000000000003e-06 2024-09-13T06:39:30.167 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:30.167 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:30.167 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:30.167 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.012139+0000", 2024-09-13T06:39:30.167 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0039226189999999996 2024-09-13T06:39:30.167 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:30.167 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:30.167 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:30.167 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.012198+0000", 2024-09-13T06:39:30.167 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8489999999999997e-05 2024-09-13T06:39:30.168 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:30.168 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:30.168 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:39:30.168 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.017427+0000", 2024-09-13T06:39:30.168 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0052297589999999996 2024-09-13T06:39:30.168 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:30.168 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:30.168 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:30.168 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.017457+0000", 2024-09-13T06:39:30.168 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9357e-05 2024-09-13T06:39:30.168 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:30.168 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:30.168 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:30.168 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:30.169 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:30.169 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4154.0:137 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'95, mlcod=15'85)", 2024-09-13T06:39:30.169 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:12.008624+0000", 2024-09-13T06:39:30.169 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 18.086101027000002, 2024-09-13T06:39:30.169 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0088653910000000002, 2024-09-13T06:39:30.169 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:30.169 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:30.169 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:30.169 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:30.169 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:30.169 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.008624+0000", 2024-09-13T06:39:30.169 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:30.169 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:30.170 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:30.170 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:30.170 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.008624+0000", 2024-09-13T06:39:30.170 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:30.170 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:30.170 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:30.170 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:30.170 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.008623+0000", 2024-09-13T06:39:30.170 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.999999 2024-09-13T06:39:30.170 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:30.170 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:30.170 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:30.170 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.008739+0000", 2024-09-13T06:39:30.170 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00011541599999999999 2024-09-13T06:39:30.170 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:30.171 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:30.171 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:30.171 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.008753+0000", 2024-09-13T06:39:30.171 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4136e-05 2024-09-13T06:39:30.171 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:30.171 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:30.171 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:30.171 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.008761+0000", 2024-09-13T06:39:30.171 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.9899999999999997e-06 2024-09-13T06:39:30.171 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:30.171 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:30.171 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:30.171 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.013092+0000", 2024-09-13T06:39:30.171 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0043311540000000003 2024-09-13T06:39:30.172 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:30.172 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:30.172 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:30.172 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.013131+0000", 2024-09-13T06:39:30.172 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.9266e-05 2024-09-13T06:39:30.172 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:30.172 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:30.172 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:39:30.172 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.017461+0000", 2024-09-13T06:39:30.172 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0043297700000000001 2024-09-13T06:39:30.172 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:30.173 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:30.173 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:30.173 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.017490+0000", 2024-09-13T06:39:30.173 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.8699000000000001e-05 2024-09-13T06:39:30.173 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:30.173 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:30.173 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:30.173 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:30.173 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:30.173 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4154.0:138 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'96, mlcod=15'85)", 2024-09-13T06:39:30.173 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:12.009148+0000", 2024-09-13T06:39:30.173 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 18.085577441000002, 2024-09-13T06:39:30.173 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0083737480000000003, 2024-09-13T06:39:30.173 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:30.174 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:30.174 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:30.174 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:30.174 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:30.174 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.009148+0000", 2024-09-13T06:39:30.174 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:30.174 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:30.174 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:30.174 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:30.174 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.009148+0000", 2024-09-13T06:39:30.174 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:30.174 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:30.174 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:30.174 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:30.175 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.009146+0000", 2024-09-13T06:39:30.175 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999981 2024-09-13T06:39:30.175 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:30.175 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:30.175 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:30.175 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.009160+0000", 2024-09-13T06:39:30.175 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3706000000000001e-05 2024-09-13T06:39:30.175 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:30.175 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:30.175 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:30.175 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.009221+0000", 2024-09-13T06:39:30.175 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.1532999999999995e-05 2024-09-13T06:39:30.175 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:30.176 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:30.176 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:30.176 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.009240+0000", 2024-09-13T06:39:30.176 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8300000000000001e-05 2024-09-13T06:39:30.176 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:30.176 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:30.176 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:30.176 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.014388+0000", 2024-09-13T06:39:30.176 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0051483299999999996 2024-09-13T06:39:30.176 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:30.176 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:30.176 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:30.177 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.014439+0000", 2024-09-13T06:39:30.177 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0618999999999998e-05 2024-09-13T06:39:30.177 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:30.177 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:30.177 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:39:30.177 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.017497+0000", 2024-09-13T06:39:30.177 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0030583899999999998 2024-09-13T06:39:30.177 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:30.177 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:30.177 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:30.177 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.017522+0000", 2024-09-13T06:39:30.177 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4613e-05 2024-09-13T06:39:30.177 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:30.178 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:30.178 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:30.178 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:30.178 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:30.178 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4154.0:139 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'97, mlcod=15'85)", 2024-09-13T06:39:30.178 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:12.009507+0000", 2024-09-13T06:39:30.178 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 18.08521811, 2024-09-13T06:39:30.178 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.008043204, 2024-09-13T06:39:30.178 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:30.178 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:30.178 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:30.178 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:30.178 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:30.178 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.009507+0000", 2024-09-13T06:39:30.178 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:30.179 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:30.179 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:30.179 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:30.179 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.009507+0000", 2024-09-13T06:39:30.179 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:30.179 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:30.179 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:30.179 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:30.179 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.009506+0000", 2024-09-13T06:39:30.179 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.999999 2024-09-13T06:39:30.179 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:30.179 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:30.179 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:30.180 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.009516+0000", 2024-09-13T06:39:30.180 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.91e-06 2024-09-13T06:39:30.180 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:30.180 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:30.180 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:30.180 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.009530+0000", 2024-09-13T06:39:30.180 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4406999999999999e-05 2024-09-13T06:39:30.180 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:30.180 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:30.180 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:30.180 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.009542+0000", 2024-09-13T06:39:30.180 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1549000000000001e-05 2024-09-13T06:39:30.180 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:30.180 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:30.180 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:30.181 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.015501+0000", 2024-09-13T06:39:30.181 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0059592409999999997 2024-09-13T06:39:30.181 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:30.181 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:30.181 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:30.181 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.015558+0000", 2024-09-13T06:39:30.181 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.6496000000000003e-05 2024-09-13T06:39:30.181 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:30.181 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:30.181 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:39:30.181 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.017526+0000", 2024-09-13T06:39:30.181 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0019678249999999999 2024-09-13T06:39:30.182 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:30.182 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:30.182 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:30.182 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.017550+0000", 2024-09-13T06:39:30.182 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4769999999999998e-05 2024-09-13T06:39:30.182 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:30.182 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:30.182 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:30.182 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:30.182 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:30.182 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4154.0:140 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'98, mlcod=15'85)", 2024-09-13T06:39:30.182 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:12.009917+0000", 2024-09-13T06:39:30.182 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 18.08480814, 2024-09-13T06:39:30.183 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0085122300000000008, 2024-09-13T06:39:30.183 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:30.183 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:30.183 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:30.183 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:30.183 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:30.183 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.009917+0000", 2024-09-13T06:39:30.183 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:30.183 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:30.183 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:30.183 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:30.183 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.009917+0000", 2024-09-13T06:39:30.183 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:30.183 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:30.184 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:30.184 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:30.184 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.009916+0000", 2024-09-13T06:39:30.184 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.999999 2024-09-13T06:39:30.184 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:30.184 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:30.184 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:30.184 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.010084+0000", 2024-09-13T06:39:30.184 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000168419 2024-09-13T06:39:30.184 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:30.184 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:30.184 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:30.185 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.010112+0000", 2024-09-13T06:39:30.185 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.7773e-05 2024-09-13T06:39:30.185 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:30.185 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:30.185 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:30.185 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.010128+0000", 2024-09-13T06:39:30.185 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.605e-05 2024-09-13T06:39:30.185 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:30.185 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:30.185 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:30.185 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.016320+0000", 2024-09-13T06:39:30.185 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0061919690000000003 2024-09-13T06:39:30.186 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:30.186 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:30.186 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:30.186 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.016349+0000", 2024-09-13T06:39:30.186 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.8629e-05 2024-09-13T06:39:30.186 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:30.186 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:30.186 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:39:30.186 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.018351+0000", 2024-09-13T06:39:30.186 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.002001985 2024-09-13T06:39:30.186 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:30.186 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:30.187 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:30.187 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.018429+0000", 2024-09-13T06:39:30.187 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.8589000000000003e-05 2024-09-13T06:39:30.187 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:30.187 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:30.187 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:30.187 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:30.187 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:30.187 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4154.0:141 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'99, mlcod=15'85)", 2024-09-13T06:39:30.187 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:12.010422+0000", 2024-09-13T06:39:30.187 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 18.084302837999999, 2024-09-13T06:39:30.187 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0086202829999999994, 2024-09-13T06:39:30.187 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:30.188 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:30.188 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:30.188 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:30.188 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:30.188 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.010422+0000", 2024-09-13T06:39:30.188 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:30.188 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:30.188 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:30.188 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:30.188 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.010422+0000", 2024-09-13T06:39:30.188 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:30.188 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:30.189 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:30.189 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:30.189 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.010421+0000", 2024-09-13T06:39:30.189 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999986 2024-09-13T06:39:30.189 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:30.189 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:30.189 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:30.189 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.010434+0000", 2024-09-13T06:39:30.189 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2840000000000001e-05 2024-09-13T06:39:30.189 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:30.189 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:30.189 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:30.189 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.010457+0000", 2024-09-13T06:39:30.190 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3543000000000001e-05 2024-09-13T06:39:30.190 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:30.190 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:30.190 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:30.190 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.010474+0000", 2024-09-13T06:39:30.190 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6804e-05 2024-09-13T06:39:30.190 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:30.190 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:30.190 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:30.190 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.017610+0000", 2024-09-13T06:39:30.190 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0071355710000000003 2024-09-13T06:39:30.190 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:30.190 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:30.191 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:30.191 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.017663+0000", 2024-09-13T06:39:30.191 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3593e-05 2024-09-13T06:39:30.191 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:30.191 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:30.191 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:39:30.191 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.018991+0000", 2024-09-13T06:39:30.191 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00132777 2024-09-13T06:39:30.191 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:30.191 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:30.191 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:30.191 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.019043+0000", 2024-09-13T06:39:30.191 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.1431999999999998e-05 2024-09-13T06:39:30.191 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:30.192 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:30.192 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:30.192 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:30.192 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:30.192 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:11 3.1f 3:fa654f18:::rbd_id.image_client.0:head [create,call rbd.set_id in=9b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-09-13T06:39:30.192 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:29.377720+0000", 2024-09-13T06:39:30.192 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.71700492500000002, 2024-09-13T06:39:30.192 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0087536650000000008, 2024-09-13T06:39:30.192 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:30.192 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:30.192 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:39:30.192 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:39:30.192 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:30.193 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 11 2024-09-13T06:39:30.193 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:30.193 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:30.193 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:30.193 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:30.193 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:29.377720+0000", 2024-09-13T06:39:30.193 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:30.193 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:30.193 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:30.193 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:30.193 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:29.377720+0000", 2024-09-13T06:39:30.193 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:30.193 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:30.194 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:30.194 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:30.194 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:29.377718+0000", 2024-09-13T06:39:30.194 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999981 2024-09-13T06:39:30.194 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:30.194 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:30.194 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:30.194 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:29.377731+0000", 2024-09-13T06:39:30.194 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2507000000000001e-05 2024-09-13T06:39:30.194 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:30.194 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:30.194 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:30.194 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:29.377751+0000", 2024-09-13T06:39:30.195 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0716999999999998e-05 2024-09-13T06:39:30.195 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:30.195 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:30.195 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:30.195 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:29.377764+0000", 2024-09-13T06:39:30.195 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2378000000000001e-05 2024-09-13T06:39:30.196 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:30.196 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:30.196 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:30.196 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:29.377842+0000", 2024-09-13T06:39:30.196 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.7687000000000003e-05 2024-09-13T06:39:30.196 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:30.197 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:30.197 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op must wait for map", 2024-09-13T06:39:30.197 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:29.377850+0000", 2024-09-13T06:39:30.197 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.7029999999999995e-06 2024-09-13T06:39:30.197 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:30.197 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:30.198 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:30.198 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:29.380699+0000", 2024-09-13T06:39:30.198 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0028488099999999998 2024-09-13T06:39:30.198 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:30.198 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:30.198 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:30.198 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:29.380901+0000", 2024-09-13T06:39:30.199 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000202067 2024-09-13T06:39:30.199 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:30.199 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:30.199 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 5", 2024-09-13T06:39:30.199 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:29.381223+0000", 2024-09-13T06:39:30.199 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00032151199999999998 2024-09-13T06:39:30.199 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:30.200 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:30.200 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:39:30.200 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:29.382479+0000", 2024-09-13T06:39:30.200 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00125636 2024-09-13T06:39:30.200 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:30.200 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:30.200 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-09-13T06:39:30.201 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:29.386337+0000", 2024-09-13T06:39:30.201 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0038575739999999999 2024-09-13T06:39:30.201 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:30.201 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:30.201 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:39:30.201 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:29.386408+0000", 2024-09-13T06:39:30.201 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.1019000000000006e-05 2024-09-13T06:39:30.202 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:30.202 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:30.202 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:30.202 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:29.386474+0000", 2024-09-13T06:39:30.202 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.6407000000000003e-05 2024-09-13T06:39:30.202 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:30.203 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:30.203 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:30.203 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:30.203 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:30.203 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:39:30.204 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-13T06:39:30.205 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:39:30.206+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:39:30.205 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-13T06:39:30.305 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-13T06:39:30.310+0000 7f86a5f06640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26387) UID: 0 2024-09-13T06:39:30.361 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:39:30.362 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-13T06:39:30.362 INFO:teuthology.orchestra.run.smithi081.stdout: "num_ops": 0 2024-09-13T06:39:30.362 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:39:30.378 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-13T06:39:30.380 INFO:teuthology.orchestra.run.smithi081.stdout:osd.0: {} 2024-09-13T06:39:30.380 INFO:teuthology.orchestra.run.smithi081.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-13T06:39:30.396 INFO:teuthology.orchestra.run.smithi081.stdout:osd.1: {} 2024-09-13T06:39:30.396 INFO:teuthology.orchestra.run.smithi081.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-13T06:39:30.406 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:39:30.407+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:39:30.412 INFO:teuthology.orchestra.run.smithi081.stdout:osd.2: {} 2024-09-13T06:39:30.412 INFO:teuthology.orchestra.run.smithi081.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-13T06:39:30.428 INFO:teuthology.orchestra.run.smithi081.stdout:osd.3: {} 2024-09-13T06:39:30.428 INFO:teuthology.orchestra.run.smithi081.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-13T06:39:30.448 INFO:teuthology.orchestra.run.smithi081.stdout:osd.4: {} 2024-09-13T06:39:30.448 INFO:teuthology.orchestra.run.smithi081.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-13T06:39:30.468 INFO:teuthology.orchestra.run.smithi081.stdout:osd.5: {} 2024-09-13T06:39:30.468 INFO:teuthology.orchestra.run.smithi081.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-13T06:39:30.488 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:39:30.488 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:39:30.488 INFO:teuthology.orchestra.run.smithi081.stdout:osd.6: {} 2024-09-13T06:39:30.489 INFO:teuthology.orchestra.run.smithi081.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-13T06:39:30.501 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-13T06:39:30.507 INFO:tasks.ceph.osd.6.smithi139.stderr:2024-09-13T06:39:30.506+0000 7fcd02c5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26385) UID: 0 2024-09-13T06:39:30.508 INFO:teuthology.orchestra.run.smithi081.stdout:osd.7: {} 2024-09-13T06:39:30.508 INFO:teuthology.orchestra.run.smithi081.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-13T06:39:30.608 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:39:30.610+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:39:30.614 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:39:30.614 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:39:30.627 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-13T06:39:30.710 INFO:tasks.ceph.osd.6.smithi139.stderr:2024-09-13T06:39:30.710+0000 7fcd02c5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26385) UID: 0 2024-09-13T06:39:30.723 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-13T06:39:30.723 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-13T06:39:30.723 INFO:tasks.thrashosds.thrasher:inject_pause on osd.5 2024-09-13T06:39:30.723 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-09-13T06:39:30.723 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-09-13T06:39:30.724 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok config set filestore_inject_stall 3 2024-09-13T06:39:30.741 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:39:30.742 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:39:30.754 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-13T06:39:30.810 INFO:tasks.ceph.osd.6.smithi139.stderr:2024-09-13T06:39:30.810+0000 7fcd02c5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26385) UID: 0 2024-09-13T06:39:30.854 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:39:30.854 INFO:teuthology.orchestra.run.smithi139.stdout: "success": "filestore_inject_stall = '' (not observed, change may require restart) " 2024-09-13T06:39:30.854 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:39:30.873 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:39:30.873 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:39:30.886 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-13T06:39:30.912 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:39:30.914+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:39:30.993 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:39:30.993 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:39:31.006 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-13T06:39:31.012 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:39:31.014+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:39:31.113 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-13T06:39:31.118+0000 7f86a5f06640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26387) UID: 0 2024-09-13T06:39:31.131 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:39:31.132 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:39:31.147 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-13T06:39:31.213 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:39:31.215+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:39:31.273 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:39:31.274 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:39:31.282 INFO:teuthology.orchestra.run.smithi081.stdout:1 writesame 0x11f8288 thru 0x1200a3e data_size 0x3(0x87b7 bytes) 2024-09-13T06:39:31.282 INFO:teuthology.orchestra.run.smithi081.stdout:truncating to largest ever: 0xb9dfe7e 2024-09-13T06:39:31.287 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-13T06:39:31.296 INFO:teuthology.orchestra.run.smithi081.stdout:3 trunc from 0x1200a3f to 0xb9dfe7e 2024-09-13T06:39:31.309 INFO:teuthology.orchestra.run.smithi081.stdout:6 write 0x5f508c6 thru 0x5f59d2b (0x9466 bytes) 2024-09-13T06:39:31.314 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:39:31.315+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:39:31.328 INFO:teuthology.orchestra.run.smithi081.stdout:7 trunc from 0xb9dfe7e to 0x354457b 2024-09-13T06:39:31.373 INFO:teuthology.orchestra.run.smithi081.stdout:8 writesame 0xabe34e2 thru 0xabe538b data_size 0x19(0x1eaa bytes) 2024-09-13T06:39:31.373 INFO:teuthology.orchestra.run.smithi081.stdout:9 punch from 0x1feee03 to 0x1ffc397, (0xd594 bytes) 2024-09-13T06:39:31.373 INFO:teuthology.orchestra.run.smithi081.stdout:12 write 0x1934894 thru 0x193bab3 (0x7220 bytes) 2024-09-13T06:39:31.380 INFO:teuthology.orchestra.run.smithi081.stdout:13 write 0x8867cd9 thru 0x88740d3 (0xc3fb bytes) 2024-09-13T06:39:31.386 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-13T06:39:31.386 INFO:teuthology.orchestra.run.smithi081.stdout:17 write 0x6ba7287 thru 0x6bb36bc (0xc436 bytes) 2024-09-13T06:39:31.409 INFO:teuthology.orchestra.run.smithi081.stdout:19 write 0xdc2fa5b thru 0xdc3a399 (0xa93f bytes) 2024-09-13T06:39:31.415 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:39:31.419+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:39:31.415 INFO:teuthology.orchestra.run.smithi081.stdout:20 write 0x9500fca thru 0x950de7a (0xceb1 bytes) 2024-09-13T06:39:31.418 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:39:31.418 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:39:31.422 INFO:teuthology.orchestra.run.smithi081.stdout:21 read 0x3cd3c9 thru 0x3d8b1c (0xb754 bytes) 2024-09-13T06:39:31.422 INFO:teuthology.orchestra.run.smithi081.stdout:22 write 0x7d6e001 thru 0x7d6f115 (0x1115 bytes) 2024-09-13T06:39:31.429 INFO:teuthology.orchestra.run.smithi081.stdout:23 read 0x3607225 thru 0x361508d (0xde69 bytes) 2024-09-13T06:39:31.433 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-13T06:39:31.442 INFO:teuthology.orchestra.run.smithi081.stdout:24 write 0xed482c6 thru 0xed4b196 (0x2ed1 bytes) 2024-09-13T06:39:31.449 INFO:teuthology.orchestra.run.smithi081.stdout:truncating to largest ever: 0xe83532e 2024-09-13T06:39:31.449 INFO:teuthology.orchestra.run.smithi081.stdout:25 trunc from 0xed4b197 to 0xe83532e 2024-09-13T06:39:31.464 INFO:teuthology.orchestra.run.smithi081.stdout:26 trunc from 0xe83532e to 0xe04f086 2024-09-13T06:39:31.472 INFO:teuthology.orchestra.run.smithi081.stdout:27 read 0x1cadf93 thru 0x1cb1c1f (0x3c8d bytes) 2024-09-13T06:39:31.472 INFO:teuthology.orchestra.run.smithi081.stdout:28 write 0x2782f9c thru 0x27885b6 (0x561b bytes) 2024-09-13T06:39:31.476 INFO:teuthology.orchestra.run.smithi081.stdout:29 writesame 0xc2caa07 thru 0xc2ccd9c data_size 0x5(0x2396 bytes) 2024-09-13T06:39:31.495 INFO:teuthology.orchestra.run.smithi081.stdout:30 trunc from 0xe04f086 to 0x284a4f1 2024-09-13T06:39:31.511 INFO:teuthology.orchestra.run.smithi081.stdout:31 read 0x1e7da0a thru 0x1e819d1 (0x3fc8 bytes) 2024-09-13T06:39:31.511 INFO:teuthology.orchestra.run.smithi081.stdout:32 read 0xd12acc thru 0xd1d897 (0xadcc bytes) 2024-09-13T06:39:31.513 INFO:teuthology.orchestra.run.smithi081.stdout:33 trunc from 0x284a4f1 to 0xae05b0 2024-09-13T06:39:31.516 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:39:31.518+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:39:31.534 INFO:teuthology.orchestra.run.smithi081.stdout:34 trunc from 0xae05b0 to 0x5cbc3a6 2024-09-13T06:39:31.544 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:39:31.545 INFO:teuthology.orchestra.run.smithi081.stdout:36 read 0x309f5f1 thru 0x30af086 (0xfa96 bytes) 2024-09-13T06:39:31.545 INFO:teuthology.orchestra.run.smithi081.stdout:37 read 0x2b567c9 thru 0x2b5a2d0 (0x3b08 bytes) 2024-09-13T06:39:31.545 INFO:teuthology.orchestra.run.smithi081.stdout:38 read 0x581b698 thru 0x58230d4 (0x7a3d bytes) 2024-09-13T06:39:31.557 INFO:teuthology.orchestra.run.smithi081.stdout:39 write 0x804454f thru 0x804b95c (0x740e bytes) 2024-09-13T06:39:31.563 INFO:teuthology.orchestra.run.smithi081.stdout:40 read 0x208611f thru 0x20932f8 (0xd1da bytes) 2024-09-13T06:39:31.565 INFO:teuthology.orchestra.run.smithi081.stdout:41 trunc from 0x804b95d to 0xa363bec 2024-09-13T06:39:31.574 INFO:teuthology.orchestra.run.smithi081.stdout:42 writesame 0x94bcf8d thru 0x94c7937 data_size 0x55(0xa9ab bytes) 2024-09-13T06:39:31.578 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:39:31.578 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:39:31.579 INFO:teuthology.orchestra.run.smithi081.stdout:43 read 0x950c70a thru 0x951814b (0xba42 bytes) 2024-09-13T06:39:31.593 INFO:teuthology.orchestra.run.smithi081.stdout:44 writesame 0xb4ed176 thru 0xb4f6a11 data_size 0x2(0x989c bytes) 2024-09-13T06:39:31.593 INFO:teuthology.orchestra.run.smithi081.stdout:45 read 0x838e5c thru 0x84887f (0xfa24 bytes) 2024-09-13T06:39:31.593 INFO:teuthology.orchestra.run.smithi081.stdout:46 read 0x723f1da thru 0x724778f (0x85b6 bytes) 2024-09-13T06:39:31.593 INFO:teuthology.orchestra.run.smithi081.stdout:48 read 0x99fbac6 thru 0x99fc6b4 (0xbef bytes) 2024-09-13T06:39:31.593 INFO:teuthology.orchestra.run.smithi081.stdout:49 write 0xac5a09e thru 0xac5a1b4 (0x117 bytes) 2024-09-13T06:39:31.594 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-13T06:39:31.598 INFO:teuthology.orchestra.run.smithi081.stdout:50 punch from 0x195c6c to 0x199b7f, (0x3f13 bytes) 2024-09-13T06:39:31.598 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:39:31.598 INFO:teuthology.orchestra.run.smithi081.stdout:52 read 0x1ac346d thru 0x1ad1d6f (0xe903 bytes) 2024-09-13T06:39:31.613 INFO:teuthology.orchestra.run.smithi081.stdout:53 write 0xe296e86 thru 0xe29cb28 (0x5ca3 bytes) 2024-09-13T06:39:31.617 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:39:31.619+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:39:31.620 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:39:31.620 INFO:teuthology.orchestra.run.smithi081.stdout:55 read 0x5c443f6 thru 0x5c45874 (0x147f bytes) 2024-09-13T06:39:31.620 INFO:teuthology.orchestra.run.smithi081.stdout:57 read 0xb90d3b6 thru 0xb9194cf (0xc11a bytes) 2024-09-13T06:39:31.620 INFO:teuthology.orchestra.run.smithi081.stdout:58 writesame 0x52fb683 thru 0x52fceb7 data_size 0x1(0x1835 bytes) 2024-09-13T06:39:31.628 INFO:teuthology.orchestra.run.smithi081.stdout:59 writesame 0x5ea9b93 thru 0x5eb5ff9 data_size 0x1(0xc467 bytes) 2024-09-13T06:39:31.677 INFO:teuthology.orchestra.run.smithi081.stdout:60 read 0x4451a4d thru 0x446068d (0xec41 bytes) 2024-09-13T06:39:31.677 INFO:teuthology.orchestra.run.smithi081.stdout:61 read 0xa5a2bf thru 0xa66726 (0xc468 bytes) 2024-09-13T06:39:31.677 INFO:teuthology.orchestra.run.smithi081.stdout:64 read 0x85ac0d thru 0x869b38 (0xef2c bytes) 2024-09-13T06:39:31.678 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:39:31.678 INFO:teuthology.orchestra.run.smithi081.stdout:67 write 0xcd8d935 thru 0xcd9aa5c (0xd128 bytes) 2024-09-13T06:39:31.683 INFO:teuthology.orchestra.run.smithi081.stdout:68 write 0x1ebb5cc thru 0x1ec5672 (0xa0a7 bytes) 2024-09-13T06:39:31.689 INFO:teuthology.orchestra.run.smithi081.stdout:71 read 0x9e28484 thru 0x9e2cc7a (0x47f7 bytes) 2024-09-13T06:39:31.689 INFO:teuthology.orchestra.run.smithi081.stdout:72 punch from 0x15e64bb to 0x15ee6b5, (0x81fa bytes) 2024-09-13T06:39:31.689 INFO:teuthology.orchestra.run.smithi081.stdout:73 write 0x8de1d5c thru 0x8df0c42 (0xeee7 bytes) 2024-09-13T06:39:31.694 INFO:teuthology.orchestra.run.smithi081.stdout:74 read 0x2141eea thru 0x214f22f (0xd346 bytes) 2024-09-13T06:39:31.694 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:39:31.697 INFO:teuthology.orchestra.run.smithi081.stdout:78 trunc from 0xe29cb29 to 0xd0e40a3 2024-09-13T06:39:31.711 INFO:teuthology.orchestra.run.smithi081.stdout:80 punch from 0x29f5d84 to 0x29fc9e8, (0x6c64 bytes) 2024-09-13T06:39:31.711 INFO:teuthology.orchestra.run.smithi081.stdout:83 read 0x9875e61 thru 0x987c5aa (0x674a bytes) 2024-09-13T06:39:31.711 INFO:teuthology.orchestra.run.smithi081.stdout:84 read 0xa4594c4 thru 0xa462c6d (0x97aa bytes) 2024-09-13T06:39:31.712 INFO:teuthology.orchestra.run.smithi081.stdout:85 write 0x4e32797 thru 0x4e33320 (0xb8a bytes) 2024-09-13T06:39:31.718 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:39:31.718+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:39:31.722 INFO:teuthology.orchestra.run.smithi081.stdout:86 trunc from 0xd0e40a3 to 0x7b20f93 2024-09-13T06:39:31.750 INFO:teuthology.orchestra.run.smithi081.stdout:87 trunc from 0x7b20f93 to 0x156cb11 2024-09-13T06:39:31.767 INFO:teuthology.orchestra.run.smithi081.stdout:88 read 0x150cefc thru 0x151a24d (0xd352 bytes) 2024-09-13T06:39:31.767 INFO:teuthology.orchestra.run.smithi081.stdout:89 punch from 0x4db3fb to 0x4e76cd, (0xc2d2 bytes) 2024-09-13T06:39:31.777 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:39:31.777 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:39:31.792 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-13T06:39:31.793 INFO:teuthology.orchestra.run.smithi081.stdout:90 write 0x6b4af41 thru 0x6b58d00 (0xddc0 bytes) 2024-09-13T06:39:31.798 INFO:teuthology.orchestra.run.smithi081.stdout:91 read 0x57152f thru 0x57238f (0xe61 bytes) 2024-09-13T06:39:31.798 INFO:teuthology.orchestra.run.smithi081.stdout:92 clone 1 order 23 su 262144 sc 5 2024-09-13T06:39:31.836 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:39:31.838+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:39:31.920 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:39:31.923+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:39:31.960 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:39:31.961 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:39:31.972 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-13T06:39:32.021 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:39:32.022+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:39:32.090 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:39:32.091 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:39:32.104 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-13T06:39:32.148 INFO:tasks.ceph.osd.6.smithi139.stderr:2024-09-13T06:39:32.150+0000 7fcd02c5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26385) UID: 0 2024-09-13T06:39:32.223 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:39:32.227+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:39:32.272 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:39:32.272 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:39:32.286 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-13T06:39:32.336 INFO:tasks.ceph.osd.6.smithi139.stderr:2024-09-13T06:39:32.338+0000 7fcd02c5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26385) UID: 0 2024-09-13T06:39:32.392 INFO:teuthology.orchestra.run.smithi081.stderr:noscrub is unset 2024-09-13T06:39:32.406 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:39:32.406 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:39:32.423 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-13T06:39:32.459 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:39:32.463+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:39:32.526 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-13T06:39:32.526 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:39:32.526+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:39:32.584 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:39:32.584 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:39:32.599 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-13T06:39:32.627 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:39:32.631+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:39:32.679 INFO:teuthology.orchestra.run.smithi081.stdout:osd.0: {} 2024-09-13T06:39:32.679 INFO:teuthology.orchestra.run.smithi081.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-13T06:39:32.695 INFO:teuthology.orchestra.run.smithi081.stdout:osd.1: {} 2024-09-13T06:39:32.695 INFO:teuthology.orchestra.run.smithi081.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-13T06:39:32.710 INFO:teuthology.orchestra.run.smithi081.stdout:osd.2: {} 2024-09-13T06:39:32.711 INFO:teuthology.orchestra.run.smithi081.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-13T06:39:32.727 INFO:teuthology.orchestra.run.smithi081.stdout:osd.3: {} 2024-09-13T06:39:32.727 INFO:teuthology.orchestra.run.smithi081.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-13T06:39:32.728 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:39:32.731+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:39:32.746 INFO:teuthology.orchestra.run.smithi081.stdout:osd.4: {} 2024-09-13T06:39:32.746 INFO:teuthology.orchestra.run.smithi081.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-13T06:39:32.761 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:39:32.761 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:39:32.765 INFO:teuthology.orchestra.run.smithi081.stdout:osd.5: {} 2024-09-13T06:39:32.766 INFO:teuthology.orchestra.run.smithi081.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-13T06:39:32.775 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-13T06:39:32.784 INFO:teuthology.orchestra.run.smithi081.stdout:osd.6: {} 2024-09-13T06:39:32.784 INFO:teuthology.orchestra.run.smithi081.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-13T06:39:32.801 INFO:teuthology.orchestra.run.smithi081.stdout:osd.7: {} 2024-09-13T06:39:32.801 INFO:teuthology.orchestra.run.smithi081.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-13T06:39:32.829 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:39:32.830+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:39:32.893 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:39:32.893 INFO:teuthology.orchestra.run.smithi139.stdout: "size": 20, 2024-09-13T06:39:32.893 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 600, 2024-09-13T06:39:32.893 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [ 2024-09-13T06:39:32.894 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:32.894 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:12 3.10 3:0a3d6291:::rbd_header.112173e2f1b7:head [create,call rbd.create in=9b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-09-13T06:39:32.894 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:29.388038+0000", 2024-09-13T06:39:32.894 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 3.509118956, 2024-09-13T06:39:32.894 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0056150510000000002, 2024-09-13T06:39:32.894 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:39:32.894 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:32.894 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:39:32.894 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:39:32.894 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:32.894 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 12 2024-09-13T06:39:32.894 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:32.895 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:39:32.895 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:32.895 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:39:32.895 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:29.388038+0000", 2024-09-13T06:39:32.895 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:32.895 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:32.895 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:32.895 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:39:32.895 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:29.388038+0000", 2024-09-13T06:39:32.895 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:32.896 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:32.896 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:32.896 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:39:32.896 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:29.388036+0000", 2024-09-13T06:39:32.896 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999981 2024-09-13T06:39:32.896 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:32.896 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:32.896 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:39:32.896 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:29.388045+0000", 2024-09-13T06:39:32.896 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.4260000000000003e-06 2024-09-13T06:39:32.896 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:32.896 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:32.897 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:39:32.897 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:29.388057+0000", 2024-09-13T06:39:32.897 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1976e-05 2024-09-13T06:39:32.897 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:32.897 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:32.897 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:39:32.897 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:29.388066+0000", 2024-09-13T06:39:32.897 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.0769999999999997e-06 2024-09-13T06:39:32.897 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:32.897 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:32.897 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:39:32.898 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:29.388127+0000", 2024-09-13T06:39:32.898 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.1074999999999994e-05 2024-09-13T06:39:32.898 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:32.898 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:32.898 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op must wait for map", 2024-09-13T06:39:32.898 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:29.388133+0000", 2024-09-13T06:39:32.898 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.6330000000000001e-06 2024-09-13T06:39:32.898 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:32.898 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:32.898 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:39:32.898 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:29.391172+0000", 2024-09-13T06:39:32.898 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.003039641 2024-09-13T06:39:32.898 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:32.899 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:32.899 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:39:32.899 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:29.391449+0000", 2024-09-13T06:39:32.899 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00027656700000000002 2024-09-13T06:39:32.899 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:32.899 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:32.899 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 0", 2024-09-13T06:39:32.899 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:29.391955+0000", 2024-09-13T06:39:32.899 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000506052 2024-09-13T06:39:32.899 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:32.899 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:32.899 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-13T06:39:32.900 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:29.393130+0000", 2024-09-13T06:39:32.900 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.001174727 2024-09-13T06:39:32.900 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:32.900 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:32.900 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:39:32.900 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:29.393493+0000", 2024-09-13T06:39:32.900 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00036336099999999998 2024-09-13T06:39:32.900 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:32.900 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:32.900 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-13T06:39:32.900 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:29.393584+0000", 2024-09-13T06:39:32.900 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.1185000000000002e-05 2024-09-13T06:39:32.900 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:32.901 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:32.901 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:39:32.901 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:29.393653+0000", 2024-09-13T06:39:32.901 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.9000999999999999e-05 2024-09-13T06:39:32.901 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:32.901 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:39:32.901 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:32.901 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:32.901 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:32.901 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop_reply(client.4385.0:12 3.10 e24/21 ondisk, result = 0)", 2024-09-13T06:39:32.901 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:29.393374+0000", 2024-09-13T06:39:32.901 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 3.503783248, 2024-09-13T06:39:32.901 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00029104899999999998, 2024-09-13T06:39:32.902 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:39:32.902 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:39:32.902 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:39:32.902 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:32.902 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:39:32.902 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:29.393374+0000", 2024-09-13T06:39:32.902 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:32.902 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:32.902 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:32.902 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:39:32.902 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:29.393374+0000", 2024-09-13T06:39:32.902 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:32.903 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:32.903 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:32.903 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:39:32.903 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:29.393373+0000", 2024-09-13T06:39:32.903 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:39:32.903 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:32.903 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:32.903 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:39:32.903 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:29.393379+0000", 2024-09-13T06:39:32.903 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.426e-06 2024-09-13T06:39:32.903 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:32.903 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:32.903 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:39:32.904 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:29.393396+0000", 2024-09-13T06:39:32.904 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6798000000000001e-05 2024-09-13T06:39:32.904 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:32.904 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:32.904 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:39:32.904 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:29.393409+0000", 2024-09-13T06:39:32.904 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.296e-05 2024-09-13T06:39:32.904 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:32.904 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:32.904 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:39:32.904 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:29.393472+0000", 2024-09-13T06:39:32.905 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.3471000000000003e-05 2024-09-13T06:39:32.905 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:32.905 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:32.905 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:39:32.905 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:29.393483+0000", 2024-09-13T06:39:32.905 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0834e-05 2024-09-13T06:39:32.905 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:32.905 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:32.905 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:39:32.905 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:29.393665+0000", 2024-09-13T06:39:32.905 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00018163899999999999 2024-09-13T06:39:32.905 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:32.906 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:39:32.906 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:32.906 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:32.906 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:32.906 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:16 3.10 3:0a3d6291:::rbd_header.112173e2f1b7:head [call rbd.get_size in=11b,call,call rbd.get_features in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e24)", 2024-09-13T06:39:32.906 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:29.399573+0000", 2024-09-13T06:39:32.906 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 3.4975842510000001, 2024-09-13T06:39:32.906 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00057725300000000001, 2024-09-13T06:39:32.906 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:39:32.906 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:39:32.906 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:39:32.906 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:39:32.907 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:32.907 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 16 2024-09-13T06:39:32.907 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:32.907 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:39:32.907 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:32.907 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:39:32.907 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:29.399573+0000", 2024-09-13T06:39:32.907 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:32.907 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:32.907 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:32.907 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:39:32.907 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:29.399573+0000", 2024-09-13T06:39:32.907 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:32.908 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:32.908 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:32.908 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:39:32.908 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:29.399569+0000", 2024-09-13T06:39:32.908 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999962 2024-09-13T06:39:32.908 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:32.908 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:32.908 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:39:32.908 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:29.399597+0000", 2024-09-13T06:39:32.908 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.7733e-05 2024-09-13T06:39:32.908 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:32.908 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:32.908 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:39:32.908 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:29.399639+0000", 2024-09-13T06:39:32.909 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.1950000000000003e-05 2024-09-13T06:39:32.909 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:32.909 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:32.909 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:39:32.909 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:29.399662+0000", 2024-09-13T06:39:32.909 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.351e-05 2024-09-13T06:39:32.909 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:32.909 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:32.909 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:39:32.909 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:29.399742+0000", 2024-09-13T06:39:32.909 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.9901999999999995e-05 2024-09-13T06:39:32.909 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:32.909 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:32.910 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:39:32.910 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:29.399865+0000", 2024-09-13T06:39:32.910 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00012270400000000001 2024-09-13T06:39:32.910 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:32.910 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:32.910 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:39:32.910 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:29.400150+0000", 2024-09-13T06:39:32.910 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000285424 2024-09-13T06:39:32.910 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:32.910 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:39:32.910 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:32.910 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:32.910 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:32.910 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:17 3.10 3:0a3d6291:::rbd_header.112173e2f1b7:head [call] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e24)", 2024-09-13T06:39:32.911 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:29.400376+0000", 2024-09-13T06:39:32.911 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 3.4967815830000002, 2024-09-13T06:39:32.911 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00025304800000000002, 2024-09-13T06:39:32.911 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:39:32.911 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:39:32.911 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:39:32.911 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:39:32.911 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:32.911 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 17 2024-09-13T06:39:32.911 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:32.911 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:39:32.911 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:32.911 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:39:32.911 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:29.400376+0000", 2024-09-13T06:39:32.911 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:32.912 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:32.912 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:32.912 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:39:32.912 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:29.400376+0000", 2024-09-13T06:39:32.912 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:32.912 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:32.912 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:32.912 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:39:32.912 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:29.400373+0000", 2024-09-13T06:39:32.912 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999981 2024-09-13T06:39:32.912 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:32.912 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:32.912 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:39:32.913 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:29.400386+0000", 2024-09-13T06:39:32.913 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2366e-05 2024-09-13T06:39:32.913 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:32.913 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:32.913 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:39:32.913 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:29.400412+0000", 2024-09-13T06:39:32.913 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.6567000000000002e-05 2024-09-13T06:39:32.913 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:32.913 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:32.913 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:39:32.913 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:29.400448+0000", 2024-09-13T06:39:32.913 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.5670000000000002e-05 2024-09-13T06:39:32.913 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:32.913 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:32.914 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:39:32.914 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:29.400497+0000", 2024-09-13T06:39:32.914 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.8649999999999997e-05 2024-09-13T06:39:32.914 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:32.914 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:32.914 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:39:32.914 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:29.400549+0000", 2024-09-13T06:39:32.914 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.2092000000000002e-05 2024-09-13T06:39:32.914 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:32.914 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:32.914 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:39:32.914 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:29.400629+0000", 2024-09-13T06:39:32.914 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.9783000000000005e-05 2024-09-13T06:39:32.915 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:32.915 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:39:32.915 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:32.915 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:32.915 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:32.915 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18 3.10 3:0a3d6291:::rbd_header.112173e2f1b7:head [call,call] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e24)", 2024-09-13T06:39:32.915 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:29.400792+0000", 2024-09-13T06:39:32.915 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 3.4963649299999999, 2024-09-13T06:39:32.915 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00020249499999999999, 2024-09-13T06:39:32.915 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:39:32.915 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:39:32.915 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:39:32.915 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:39:32.915 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:32.916 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18 2024-09-13T06:39:32.916 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:32.916 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:39:32.916 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:32.916 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:39:32.916 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:29.400792+0000", 2024-09-13T06:39:32.916 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:32.916 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:32.916 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:32.916 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:39:32.916 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:29.400792+0000", 2024-09-13T06:39:32.916 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:32.916 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:32.916 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:32.917 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:39:32.917 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:29.400791+0000", 2024-09-13T06:39:32.917 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999986 2024-09-13T06:39:32.917 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:32.917 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:32.917 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:39:32.917 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:29.400801+0000", 2024-09-13T06:39:32.917 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.012e-05 2024-09-13T06:39:32.917 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:32.917 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:32.917 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:39:32.917 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:29.400819+0000", 2024-09-13T06:39:32.917 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.8394e-05 2024-09-13T06:39:32.917 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:32.918 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:32.918 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:39:32.918 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:29.400829+0000", 2024-09-13T06:39:32.918 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.7899999999999994e-06 2024-09-13T06:39:32.918 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:32.918 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:32.918 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:39:32.918 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:29.400860+0000", 2024-09-13T06:39:32.918 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.1448000000000001e-05 2024-09-13T06:39:32.918 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:32.918 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:32.918 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:39:32.918 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:29.400904+0000", 2024-09-13T06:39:32.918 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.3668000000000003e-05 2024-09-13T06:39:32.919 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:32.919 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:32.919 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:39:32.919 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:29.400995+0000", 2024-09-13T06:39:32.919 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.0562000000000005e-05 2024-09-13T06:39:32.919 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:32.919 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:39:32.919 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:32.919 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:32.919 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:32.919 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:19 3.10 3:0a3d6291:::rbd_header.112173e2f1b7:head [call] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e24)", 2024-09-13T06:39:32.919 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:29.401158+0000", 2024-09-13T06:39:32.919 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 3.4959991329999998, 2024-09-13T06:39:32.919 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00016346000000000001, 2024-09-13T06:39:32.919 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:39:32.919 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:39:32.920 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:39:32.920 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:39:32.920 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:32.920 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 19 2024-09-13T06:39:32.920 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:32.920 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:39:32.920 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:32.920 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:39:32.920 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:29.401158+0000", 2024-09-13T06:39:32.920 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:32.920 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:32.920 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:32.920 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:39:32.920 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:29.401158+0000", 2024-09-13T06:39:32.921 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:32.921 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:32.921 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:32.921 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:39:32.921 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:29.401157+0000", 2024-09-13T06:39:32.921 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999986 2024-09-13T06:39:32.921 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:32.921 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:32.921 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:39:32.921 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:29.401165+0000", 2024-09-13T06:39:32.921 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.2560000000000002e-06 2024-09-13T06:39:32.921 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:32.921 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:32.921 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:39:32.922 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:29.401182+0000", 2024-09-13T06:39:32.922 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.696e-05 2024-09-13T06:39:32.922 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:32.922 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:32.922 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:39:32.922 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:29.401191+0000", 2024-09-13T06:39:32.922 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.1069999999999994e-06 2024-09-13T06:39:32.922 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:32.922 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:32.922 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:39:32.922 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:29.401218+0000", 2024-09-13T06:39:32.922 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.7106000000000001e-05 2024-09-13T06:39:32.922 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:32.922 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:32.922 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:39:32.923 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:29.401259+0000", 2024-09-13T06:39:32.923 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0979999999999997e-05 2024-09-13T06:39:32.923 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:32.923 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:32.923 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:39:32.923 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:29.401321+0000", 2024-09-13T06:39:32.923 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.2446999999999994e-05 2024-09-13T06:39:32.923 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:32.923 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:39:32.924 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:32.924 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:32.924 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:32.924 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:20 3.10 3:0a3d6291:::rbd_header.112173e2f1b7:head [call rbd.get_size in=11b,call rbd.get_features in=15b,call rbd.get_flags in=12b,call,call lock.get_info in=12b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e24)", 2024-09-13T06:39:32.924 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:29.402082+0000", 2024-09-13T06:39:32.924 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 3.4950752569999999, 2024-09-13T06:39:32.924 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00047464600000000001, 2024-09-13T06:39:32.924 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:39:32.924 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:39:32.924 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:39:32.924 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:39:32.924 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:32.924 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 20 2024-09-13T06:39:32.925 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:32.925 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:39:32.925 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:32.925 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:39:32.925 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:29.402082+0000", 2024-09-13T06:39:32.925 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:32.925 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:32.925 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:32.925 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:39:32.925 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:29.402082+0000", 2024-09-13T06:39:32.925 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:32.925 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:32.925 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:32.926 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:39:32.926 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:29.402080+0000", 2024-09-13T06:39:32.926 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999986 2024-09-13T06:39:32.926 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:32.926 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:32.926 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:39:32.926 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:29.402091+0000", 2024-09-13T06:39:32.926 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0497e-05 2024-09-13T06:39:32.926 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:32.926 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:32.926 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:39:32.926 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:29.402116+0000", 2024-09-13T06:39:32.927 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.491e-05 2024-09-13T06:39:32.927 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:32.927 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:32.927 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:39:32.927 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:29.402132+0000", 2024-09-13T06:39:32.927 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6526000000000001e-05 2024-09-13T06:39:32.927 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:32.927 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:32.927 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:39:32.927 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:29.402166+0000", 2024-09-13T06:39:32.927 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.3865999999999997e-05 2024-09-13T06:39:32.927 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:32.927 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:32.927 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:39:32.927 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:29.402242+0000", 2024-09-13T06:39:32.928 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.6020999999999996e-05 2024-09-13T06:39:32.928 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:32.928 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:32.928 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:39:32.928 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:29.402556+0000", 2024-09-13T06:39:32.928 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00031429899999999998 2024-09-13T06:39:32.928 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:32.928 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:39:32.928 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:32.928 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:32.928 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:32.928 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:21 3.10 3:0a3d6291:::rbd_header.112173e2f1b7:head [call,call rbd.parent_overlap_get in=21b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e24)", 2024-09-13T06:39:32.928 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:29.402870+0000", 2024-09-13T06:39:32.928 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 3.494287404, 2024-09-13T06:39:32.928 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00033667300000000001, 2024-09-13T06:39:32.929 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:39:32.929 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:39:32.929 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:39:32.929 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:39:32.929 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:32.929 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 21 2024-09-13T06:39:32.929 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:32.929 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:39:32.929 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:32.929 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:39:32.929 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:29.402870+0000", 2024-09-13T06:39:32.929 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:32.929 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:32.930 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:32.930 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:39:32.930 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:29.402870+0000", 2024-09-13T06:39:32.930 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:32.930 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:32.930 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:32.930 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:39:32.930 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:29.402869+0000", 2024-09-13T06:39:32.930 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:39:32.930 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:32.930 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:32.930 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:39:32.930 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:29.402876+0000", 2024-09-13T06:39:32.930 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.4909999999999999e-06 2024-09-13T06:39:32.930 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:32.931 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:32.931 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:39:32.931 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:29.402891+0000", 2024-09-13T06:39:32.931 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5362999999999998e-05 2024-09-13T06:39:32.931 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:32.931 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:32.931 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:39:32.931 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:29.402915+0000", 2024-09-13T06:39:32.931 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.3683e-05 2024-09-13T06:39:32.931 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:32.931 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:32.931 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:39:32.931 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:29.402952+0000", 2024-09-13T06:39:32.931 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.7327999999999999e-05 2024-09-13T06:39:32.932 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:32.932 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:32.932 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:39:32.932 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:29.403011+0000", 2024-09-13T06:39:32.932 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.8884000000000001e-05 2024-09-13T06:39:32.932 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:32.932 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:32.932 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:39:32.932 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:29.403206+0000", 2024-09-13T06:39:32.932 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00019505400000000001 2024-09-13T06:39:32.932 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:32.932 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:39:32.932 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:32.932 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:32.933 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:32.933 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:22 3.10 3:0a3d6291:::rbd_header.112173e2f1b7:head [call rbd.metadata_list in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e24)", 2024-09-13T06:39:32.933 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:29.403451+0000", 2024-09-13T06:39:32.933 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 3.4937060170000001, 2024-09-13T06:39:32.933 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00019914299999999999, 2024-09-13T06:39:32.933 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:39:32.933 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:39:32.933 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:39:32.933 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:39:32.933 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:32.933 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 22 2024-09-13T06:39:32.933 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:32.934 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:39:32.934 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:32.934 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:39:32.934 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:29.403451+0000", 2024-09-13T06:39:32.934 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:32.934 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:32.934 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:32.934 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:39:32.934 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:29.403451+0000", 2024-09-13T06:39:32.934 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:32.934 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:32.934 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:32.934 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:39:32.935 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:29.403450+0000", 2024-09-13T06:39:32.935 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:39:32.935 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:32.935 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:32.935 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:39:32.935 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:29.403455+0000", 2024-09-13T06:39:32.935 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.809e-06 2024-09-13T06:39:32.935 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:32.935 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:32.935 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:39:32.935 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:29.403466+0000", 2024-09-13T06:39:32.935 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1377e-05 2024-09-13T06:39:32.935 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:32.935 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:32.936 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:39:32.936 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:29.403476+0000", 2024-09-13T06:39:32.936 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.1910000000000006e-06 2024-09-13T06:39:32.936 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:32.936 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:32.936 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:39:32.936 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:29.403513+0000", 2024-09-13T06:39:32.936 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.7264000000000001e-05 2024-09-13T06:39:32.936 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:32.936 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:32.936 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:39:32.936 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:29.403565+0000", 2024-09-13T06:39:32.936 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.2247000000000003e-05 2024-09-13T06:39:32.937 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:32.937 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:32.937 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:39:32.937 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:29.403650+0000", 2024-09-13T06:39:32.937 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.5063999999999997e-05 2024-09-13T06:39:32.937 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:32.937 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:39:32.937 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:32.937 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:32.937 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:32.937 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:24 3.10 3:0a3d6291:::rbd_header.112173e2f1b7:head [call] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e24)", 2024-09-13T06:39:32.937 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:29.404731+0000", 2024-09-13T06:39:32.937 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 3.492426494, 2024-09-13T06:39:32.938 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000220089, 2024-09-13T06:39:32.938 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:39:32.938 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:39:32.938 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:39:32.938 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:39:32.938 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:32.938 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 24 2024-09-13T06:39:32.938 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:32.938 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:39:32.938 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:32.938 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:39:32.938 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:29.404731+0000", 2024-09-13T06:39:32.938 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:32.939 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:32.939 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:32.939 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:39:32.939 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:29.404731+0000", 2024-09-13T06:39:32.939 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:32.939 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:32.939 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:32.939 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:39:32.939 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:29.404730+0000", 2024-09-13T06:39:32.939 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:39:32.939 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:32.939 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:32.939 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:39:32.939 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:29.404736+0000", 2024-09-13T06:39:32.940 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.9100000000000002e-06 2024-09-13T06:39:32.940 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:32.940 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:32.940 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:39:32.940 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:29.404748+0000", 2024-09-13T06:39:32.940 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2471e-05 2024-09-13T06:39:32.940 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:32.940 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:32.940 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:39:32.940 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:29.404757+0000", 2024-09-13T06:39:32.940 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.9239999999999996e-06 2024-09-13T06:39:32.940 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:32.940 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:32.941 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:39:32.941 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:29.404799+0000", 2024-09-13T06:39:32.941 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.1570999999999999e-05 2024-09-13T06:39:32.941 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:32.941 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:32.941 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:39:32.941 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:29.404866+0000", 2024-09-13T06:39:32.941 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.7638000000000005e-05 2024-09-13T06:39:32.941 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:32.941 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:32.941 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:39:32.941 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:29.404951+0000", 2024-09-13T06:39:32.941 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.4524999999999995e-05 2024-09-13T06:39:32.942 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:32.942 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:39:32.942 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:32.942 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:32.942 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:32.942 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:25 3.10 3:0a3d6291:::rbd_header.112173e2f1b7:head [watch watch cookie 140361410305248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-09-13T06:39:32.942 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:29.405342+0000", 2024-09-13T06:39:32.942 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 3.4918151599999998, 2024-09-13T06:39:32.942 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0017467369999999999, 2024-09-13T06:39:32.942 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:39:32.942 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:32.942 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:39:32.942 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:39:32.943 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:32.943 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 25 2024-09-13T06:39:32.943 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:32.943 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:39:32.943 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:32.943 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:39:32.943 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:29.405342+0000", 2024-09-13T06:39:32.943 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:32.943 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:32.943 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:32.943 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:39:32.943 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:29.405342+0000", 2024-09-13T06:39:32.943 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:32.943 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:32.944 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:32.944 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:39:32.944 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:29.405341+0000", 2024-09-13T06:39:32.944 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:39:32.944 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:32.944 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:32.944 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:39:32.944 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:29.405354+0000", 2024-09-13T06:39:32.944 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3117e-05 2024-09-13T06:39:32.944 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:32.944 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:32.944 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:39:32.944 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:29.405366+0000", 2024-09-13T06:39:32.945 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1583000000000001e-05 2024-09-13T06:39:32.945 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:32.945 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:32.945 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:39:32.945 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:29.405374+0000", 2024-09-13T06:39:32.945 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6009999999999995e-06 2024-09-13T06:39:32.945 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:32.945 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:32.945 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:39:32.946 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:29.405406+0000", 2024-09-13T06:39:32.946 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.1417000000000001e-05 2024-09-13T06:39:32.946 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:32.946 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:32.946 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:39:32.946 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:29.405455+0000", 2024-09-13T06:39:32.946 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.9527999999999997e-05 2024-09-13T06:39:32.946 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:32.946 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:32.946 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 0", 2024-09-13T06:39:32.946 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:29.405574+0000", 2024-09-13T06:39:32.946 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000119218 2024-09-13T06:39:32.947 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:32.947 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:32.947 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-13T06:39:32.947 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:29.406443+0000", 2024-09-13T06:39:32.947 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00086828399999999998 2024-09-13T06:39:32.947 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:32.947 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:32.947 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:39:32.947 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:29.407007+0000", 2024-09-13T06:39:32.947 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00056437700000000002 2024-09-13T06:39:32.947 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:32.947 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:32.947 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-13T06:39:32.947 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:29.407043+0000", 2024-09-13T06:39:32.947 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.5856999999999999e-05 2024-09-13T06:39:32.948 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:32.948 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:32.948 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:39:32.948 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:29.407089+0000", 2024-09-13T06:39:32.948 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.5757999999999998e-05 2024-09-13T06:39:32.948 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:32.948 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:39:32.948 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:32.948 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:32.948 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:32.948 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop_reply(client.4385.0:25 3.10 e24/21 ondisk, result = 0)", 2024-09-13T06:39:32.948 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:29.406944+0000", 2024-09-13T06:39:32.948 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 3.4902132969999999, 2024-09-13T06:39:32.949 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000149419, 2024-09-13T06:39:32.949 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:39:32.949 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:39:32.949 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:39:32.949 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:32.949 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:39:32.949 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:29.406944+0000", 2024-09-13T06:39:32.949 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:32.949 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:32.949 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:32.949 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:39:32.949 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:29.406944+0000", 2024-09-13T06:39:32.949 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:32.949 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:32.950 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:32.950 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:39:32.950 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:29.406943+0000", 2024-09-13T06:39:32.950 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:39:32.950 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:32.950 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:32.950 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:39:32.950 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:29.406950+0000", 2024-09-13T06:39:32.950 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.2219999999999996e-06 2024-09-13T06:39:32.950 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:32.950 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:32.950 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:39:32.950 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:29.406962+0000", 2024-09-13T06:39:32.950 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1960000000000001e-05 2024-09-13T06:39:32.950 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:32.951 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:32.951 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:39:32.951 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:29.406968+0000", 2024-09-13T06:39:32.951 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.7370000000000003e-06 2024-09-13T06:39:32.951 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:32.951 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:32.951 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:39:32.951 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:29.406997+0000", 2024-09-13T06:39:32.951 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.9444000000000001e-05 2024-09-13T06:39:32.951 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:32.951 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:32.951 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:39:32.951 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:29.407003+0000", 2024-09-13T06:39:32.951 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.9259999999999997e-06 2024-09-13T06:39:32.952 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:32.952 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:32.952 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:39:32.952 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:29.407093+0000", 2024-09-13T06:39:32.952 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.0134000000000001e-05 2024-09-13T06:39:32.952 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:32.952 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:39:32.952 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:32.952 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:32.952 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:39:32.952 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:39:32.954 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-13T06:39:32.954 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-13T06:39:32.954+0000 7f86a5f06640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26387) UID: 0 2024-09-13T06:39:33.055 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:39:33.059+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:39:33.123 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:39:33.123 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [], 2024-09-13T06:39:33.123 INFO:teuthology.orchestra.run.smithi139.stdout: "num_ops": 0 2024-09-13T06:39:33.123 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:39:33.137 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-13T06:39:33.183 INFO:tasks.ceph.osd.6.smithi139.stderr:2024-09-13T06:39:33.186+0000 7fcd02c5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26385) UID: 0 2024-09-13T06:39:33.257 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:39:33.258+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:39:33.259 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:39:33.259 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [], 2024-09-13T06:39:33.259 INFO:teuthology.orchestra.run.smithi139.stdout: "complaint_time": 30, 2024-09-13T06:39:33.259 INFO:teuthology.orchestra.run.smithi139.stdout: "num_blocked_ops": 0 2024-09-13T06:39:33.259 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:39:33.274 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-13T06:39:33.360 INFO:tasks.ceph.osd.6.smithi139.stderr:2024-09-13T06:39:33.362+0000 7fcd02c5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26385) UID: 0 2024-09-13T06:39:33.453 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:39:33.453 INFO:teuthology.orchestra.run.smithi139.stdout: "size": 20, 2024-09-13T06:39:33.453 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 600, 2024-09-13T06:39:33.453 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [ 2024-09-13T06:39:33.453 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:33.454 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4154.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-13T06:39:33.454 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:11.143816+0000", 2024-09-13T06:39:33.454 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 22.309141180000001, 2024-09-13T06:39:33.454 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.062483034, 2024-09-13T06:39:33.454 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:39:33.454 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:33.454 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:39:33.454 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4154", 2024-09-13T06:39:33.454 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/2406930292", 2024-09-13T06:39:33.454 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 1 2024-09-13T06:39:33.454 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:33.454 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:39:33.454 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:33.455 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:39:33.455 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.143816+0000", 2024-09-13T06:39:33.455 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:33.455 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:33.455 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:33.455 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:39:33.455 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.143816+0000", 2024-09-13T06:39:33.455 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:33.455 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:33.455 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:33.455 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:39:33.455 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.143814+0000", 2024-09-13T06:39:33.455 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999976 2024-09-13T06:39:33.455 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:33.456 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:33.456 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:39:33.456 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.143829+0000", 2024-09-13T06:39:33.456 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5316999999999999e-05 2024-09-13T06:39:33.456 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:33.456 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:33.456 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:39:33.456 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.143851+0000", 2024-09-13T06:39:33.456 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.1736999999999999e-05 2024-09-13T06:39:33.456 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:33.456 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:33.456 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:39:33.456 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.143870+0000", 2024-09-13T06:39:33.457 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.9185999999999999e-05 2024-09-13T06:39:33.457 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:33.457 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:33.457 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:39:33.457 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.143973+0000", 2024-09-13T06:39:33.457 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000102896 2024-09-13T06:39:33.457 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:33.457 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:33.457 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:39:33.457 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.143987+0000", 2024-09-13T06:39:33.457 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.401e-05 2024-09-13T06:39:33.457 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:33.457 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:33.457 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:39:33.458 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.203333+0000", 2024-09-13T06:39:33.458 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.059346614999999998 2024-09-13T06:39:33.458 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:33.458 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:33.458 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:39:33.458 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.203624+0000", 2024-09-13T06:39:33.458 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00029112700000000002 2024-09-13T06:39:33.458 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:33.458 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:33.458 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 0", 2024-09-13T06:39:33.458 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.203940+0000", 2024-09-13T06:39:33.458 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00031547200000000002 2024-09-13T06:39:33.458 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:33.459 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:33.459 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-13T06:39:33.459 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.205145+0000", 2024-09-13T06:39:33.459 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0012048930000000001 2024-09-13T06:39:33.459 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:33.459 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:33.459 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:39:33.459 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.206110+0000", 2024-09-13T06:39:33.459 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00096536600000000005 2024-09-13T06:39:33.459 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:33.459 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:33.459 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-13T06:39:33.459 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.206196+0000", 2024-09-13T06:39:33.459 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.5798999999999996e-05 2024-09-13T06:39:33.460 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:33.460 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:33.460 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:39:33.460 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.206299+0000", 2024-09-13T06:39:33.460 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00010279 2024-09-13T06:39:33.460 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:33.460 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:39:33.460 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:33.460 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:33.460 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:33.460 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4154.0:36 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-13T06:39:33.460 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:11.257357+0000", 2024-09-13T06:39:33.460 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 22.195599736999998, 2024-09-13T06:39:33.461 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.012807595, 2024-09-13T06:39:33.461 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:39:33.461 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:33.461 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:39:33.461 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4154", 2024-09-13T06:39:33.461 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/2406930292", 2024-09-13T06:39:33.461 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 36 2024-09-13T06:39:33.461 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:33.461 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:39:33.461 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:33.461 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:39:33.461 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.257357+0000", 2024-09-13T06:39:33.461 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:33.461 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:33.461 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:33.462 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:39:33.462 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.257357+0000", 2024-09-13T06:39:33.462 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:33.462 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:33.462 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:33.462 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:39:33.462 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.257356+0000", 2024-09-13T06:39:33.462 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:39:33.462 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:33.462 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:33.462 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:39:33.462 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.257378+0000", 2024-09-13T06:39:33.462 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.1988999999999999e-05 2024-09-13T06:39:33.462 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:33.463 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:33.463 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:39:33.463 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.257389+0000", 2024-09-13T06:39:33.463 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0343000000000001e-05 2024-09-13T06:39:33.463 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:33.463 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:33.463 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:39:33.463 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.257396+0000", 2024-09-13T06:39:33.463 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5839999999999997e-06 2024-09-13T06:39:33.463 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:33.463 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:33.463 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:39:33.463 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.264748+0000", 2024-09-13T06:39:33.464 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0073514640000000003 2024-09-13T06:39:33.464 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:33.464 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:33.464 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:39:33.464 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.264878+0000", 2024-09-13T06:39:33.464 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00012975500000000001 2024-09-13T06:39:33.464 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:33.464 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:33.464 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 0", 2024-09-13T06:39:33.464 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.265064+0000", 2024-09-13T06:39:33.464 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000186799 2024-09-13T06:39:33.464 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:33.464 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:33.464 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:39:33.465 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.267248+0000", 2024-09-13T06:39:33.465 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0021841230000000001 2024-09-13T06:39:33.465 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:33.465 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:33.465 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-13T06:39:33.465 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.269996+0000", 2024-09-13T06:39:33.465 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0027473419999999998 2024-09-13T06:39:33.465 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:33.465 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:33.465 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-13T06:39:33.465 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.270066+0000", 2024-09-13T06:39:33.465 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.0683000000000001e-05 2024-09-13T06:39:33.465 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:33.465 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:33.466 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:39:33.466 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.270165+0000", 2024-09-13T06:39:33.466 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.8319000000000005e-05 2024-09-13T06:39:33.466 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:33.466 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:39:33.466 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:33.466 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:33.466 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:33.466 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4154.0:37 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-13T06:39:33.466 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:11.257405+0000", 2024-09-13T06:39:33.466 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 22.195551557000002, 2024-09-13T06:39:33.466 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.012930476999999999, 2024-09-13T06:39:33.466 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:39:33.466 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:33.467 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:39:33.467 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4154", 2024-09-13T06:39:33.467 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/2406930292", 2024-09-13T06:39:33.467 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 37 2024-09-13T06:39:33.467 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:33.467 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:39:33.467 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:33.467 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:39:33.467 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.257405+0000", 2024-09-13T06:39:33.467 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:33.467 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:33.467 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:33.467 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:39:33.467 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.257405+0000", 2024-09-13T06:39:33.468 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:33.468 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:33.468 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:33.468 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:39:33.468 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.257405+0000", 2024-09-13T06:39:33.468 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:39:33.468 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:33.468 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:33.468 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:39:33.468 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.257411+0000", 2024-09-13T06:39:33.468 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.1500000000000004e-06 2024-09-13T06:39:33.468 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:33.468 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:33.468 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:39:33.469 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.257420+0000", 2024-09-13T06:39:33.469 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.986e-06 2024-09-13T06:39:33.469 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:33.469 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:33.469 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:39:33.469 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.257436+0000", 2024-09-13T06:39:33.469 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6433999999999999e-05 2024-09-13T06:39:33.469 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:33.469 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:33.469 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:39:33.469 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.265923+0000", 2024-09-13T06:39:33.469 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0084872009999999998 2024-09-13T06:39:33.469 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:33.469 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:33.470 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:39:33.470 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.266056+0000", 2024-09-13T06:39:33.470 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00013206599999999999 2024-09-13T06:39:33.470 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:33.470 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:33.470 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 0", 2024-09-13T06:39:33.470 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.266255+0000", 2024-09-13T06:39:33.470 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00019935100000000001 2024-09-13T06:39:33.470 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:33.470 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:33.470 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:39:33.470 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.267788+0000", 2024-09-13T06:39:33.470 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0015335380000000001 2024-09-13T06:39:33.471 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:33.471 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:33.471 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-13T06:39:33.471 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.270181+0000", 2024-09-13T06:39:33.471 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.002392136 2024-09-13T06:39:33.471 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:33.471 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:33.471 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-13T06:39:33.471 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.270245+0000", 2024-09-13T06:39:33.471 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.4401999999999998e-05 2024-09-13T06:39:33.471 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:33.471 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:33.471 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:39:33.472 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.270336+0000", 2024-09-13T06:39:33.472 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.0872999999999995e-05 2024-09-13T06:39:33.472 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:33.472 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:39:33.472 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:33.472 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:33.472 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:33.472 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4154.0:88 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-13T06:39:33.472 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:11.362174+0000", 2024-09-13T06:39:33.472 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 22.090782949000001, 2024-09-13T06:39:33.472 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.012171276, 2024-09-13T06:39:33.472 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:39:33.472 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:33.472 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:39:33.473 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4154", 2024-09-13T06:39:33.473 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/2406930292", 2024-09-13T06:39:33.473 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 88 2024-09-13T06:39:33.473 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:33.473 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:39:33.473 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:33.473 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:39:33.473 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.362174+0000", 2024-09-13T06:39:33.473 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:33.473 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:33.473 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:33.473 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:39:33.473 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.362174+0000", 2024-09-13T06:39:33.473 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:33.474 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:33.474 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:33.474 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:39:33.474 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.362172+0000", 2024-09-13T06:39:33.474 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999986 2024-09-13T06:39:33.474 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:33.474 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:33.474 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:39:33.474 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.362183+0000", 2024-09-13T06:39:33.474 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.081e-05 2024-09-13T06:39:33.474 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:33.474 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:33.474 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:39:33.474 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.362205+0000", 2024-09-13T06:39:33.475 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.1897000000000001e-05 2024-09-13T06:39:33.475 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:33.475 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:33.475 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:39:33.475 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.362221+0000", 2024-09-13T06:39:33.475 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5353e-05 2024-09-13T06:39:33.475 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:33.475 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:33.475 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:39:33.475 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.369202+0000", 2024-09-13T06:39:33.475 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0069816219999999998 2024-09-13T06:39:33.475 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:33.475 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:33.475 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:39:33.476 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.369323+0000", 2024-09-13T06:39:33.476 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000121156 2024-09-13T06:39:33.476 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:33.476 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:33.476 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 0", 2024-09-13T06:39:33.476 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.369683+0000", 2024-09-13T06:39:33.476 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00035930700000000001 2024-09-13T06:39:33.476 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:33.476 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:33.476 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:39:33.476 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.371448+0000", 2024-09-13T06:39:33.476 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.001765043 2024-09-13T06:39:33.476 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:33.477 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:33.477 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-13T06:39:33.477 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.374156+0000", 2024-09-13T06:39:33.477 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.002707999 2024-09-13T06:39:33.477 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:33.477 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:33.477 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-13T06:39:33.477 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.374243+0000", 2024-09-13T06:39:33.477 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6873000000000007e-05 2024-09-13T06:39:33.477 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:33.477 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:33.477 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:39:33.477 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.374345+0000", 2024-09-13T06:39:33.477 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00010272600000000001 2024-09-13T06:39:33.478 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:33.478 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:39:33.478 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:33.478 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:33.478 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:33.478 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4154.0:108 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-13T06:39:33.478 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:11.524074+0000", 2024-09-13T06:39:33.478 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 21.928882945000002, 2024-09-13T06:39:33.478 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.012736235, 2024-09-13T06:39:33.478 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:39:33.478 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:33.478 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:39:33.478 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4154", 2024-09-13T06:39:33.478 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/2406930292", 2024-09-13T06:39:33.479 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 108 2024-09-13T06:39:33.479 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:33.479 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:39:33.479 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:33.479 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:39:33.479 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.524074+0000", 2024-09-13T06:39:33.479 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:33.479 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:33.479 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:33.479 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:39:33.479 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.524074+0000", 2024-09-13T06:39:33.479 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:33.479 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:33.479 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:33.480 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:39:33.480 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.524073+0000", 2024-09-13T06:39:33.480 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:39:33.480 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:33.480 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:33.480 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:39:33.480 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.524084+0000", 2024-09-13T06:39:33.480 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1026000000000001e-05 2024-09-13T06:39:33.480 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:33.480 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:33.480 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:39:33.480 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.524102+0000", 2024-09-13T06:39:33.480 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7992999999999999e-05 2024-09-13T06:39:33.481 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:33.481 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:33.481 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:39:33.481 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.524140+0000", 2024-09-13T06:39:33.481 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.8277e-05 2024-09-13T06:39:33.481 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:33.481 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:33.481 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:39:33.481 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.528884+0000", 2024-09-13T06:39:33.481 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.004743761 2024-09-13T06:39:33.481 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:33.481 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:33.481 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:39:33.481 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.529006+0000", 2024-09-13T06:39:33.482 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000121829 2024-09-13T06:39:33.482 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:33.482 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:33.482 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 0", 2024-09-13T06:39:33.482 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.529196+0000", 2024-09-13T06:39:33.482 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000189731 2024-09-13T06:39:33.482 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:33.482 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:33.482 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:39:33.482 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.535697+0000", 2024-09-13T06:39:33.482 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0065011499999999998 2024-09-13T06:39:33.482 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:33.482 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:33.482 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-13T06:39:33.483 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.536644+0000", 2024-09-13T06:39:33.483 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00094732900000000001 2024-09-13T06:39:33.483 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:33.483 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:33.483 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-13T06:39:33.483 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.536712+0000", 2024-09-13T06:39:33.483 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.8303e-05 2024-09-13T06:39:33.483 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:33.483 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:33.483 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:39:33.483 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.536810+0000", 2024-09-13T06:39:33.483 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.7918999999999995e-05 2024-09-13T06:39:33.483 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:33.484 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:39:33.484 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:33.484 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:33.484 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:33.484 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4154.0:109 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-13T06:39:33.484 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:11.524169+0000", 2024-09-13T06:39:33.484 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 21.928788018999999, 2024-09-13T06:39:33.484 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.013995285999999999, 2024-09-13T06:39:33.484 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:39:33.484 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:33.484 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:39:33.484 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4154", 2024-09-13T06:39:33.485 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/2406930292", 2024-09-13T06:39:33.485 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 109 2024-09-13T06:39:33.485 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:33.485 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:39:33.485 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:33.485 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:39:33.485 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.524169+0000", 2024-09-13T06:39:33.485 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:33.485 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:33.485 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:33.485 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:39:33.485 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.524169+0000", 2024-09-13T06:39:33.485 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:33.486 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:33.486 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:33.486 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:39:33.486 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.524168+0000", 2024-09-13T06:39:33.486 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:39:33.486 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:33.486 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:33.486 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:39:33.486 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.524427+0000", 2024-09-13T06:39:33.486 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00025929799999999998 2024-09-13T06:39:33.486 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:33.486 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:33.486 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:39:33.486 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.524451+0000", 2024-09-13T06:39:33.487 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.3686e-05 2024-09-13T06:39:33.487 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:33.487 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:33.487 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:39:33.487 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.524468+0000", 2024-09-13T06:39:33.487 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7577000000000001e-05 2024-09-13T06:39:33.487 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:33.487 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:33.487 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:39:33.487 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.530416+0000", 2024-09-13T06:39:33.487 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0059474080000000004 2024-09-13T06:39:33.487 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:33.487 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:33.487 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:39:33.488 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.530553+0000", 2024-09-13T06:39:33.488 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000137742 2024-09-13T06:39:33.488 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:33.488 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:33.488 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 0", 2024-09-13T06:39:33.488 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.530749+0000", 2024-09-13T06:39:33.488 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000195608 2024-09-13T06:39:33.488 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:33.488 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:33.488 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-13T06:39:33.488 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.536836+0000", 2024-09-13T06:39:33.488 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.006086546 2024-09-13T06:39:33.488 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:33.489 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:33.489 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:39:33.489 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.538038+0000", 2024-09-13T06:39:33.489 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0012019509999999999 2024-09-13T06:39:33.489 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:33.489 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:33.489 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-13T06:39:33.489 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.538106+0000", 2024-09-13T06:39:33.489 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.8923000000000004e-05 2024-09-13T06:39:33.489 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:33.489 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:33.489 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:39:33.489 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.538164+0000", 2024-09-13T06:39:33.489 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.7729999999999998e-05 2024-09-13T06:39:33.490 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:33.490 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:39:33.490 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:33.490 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:33.490 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:33.490 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4154.0:110 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-13T06:39:33.490 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:11.524488+0000", 2024-09-13T06:39:33.490 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 21.928468542000001, 2024-09-13T06:39:33.490 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.013976323000000001, 2024-09-13T06:39:33.490 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:39:33.490 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:33.490 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:39:33.490 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4154", 2024-09-13T06:39:33.490 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/2406930292", 2024-09-13T06:39:33.491 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 110 2024-09-13T06:39:33.491 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:33.491 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:39:33.491 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:33.491 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:39:33.491 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.524488+0000", 2024-09-13T06:39:33.491 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:33.491 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:33.491 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:33.491 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:39:33.491 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.524488+0000", 2024-09-13T06:39:33.491 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:33.491 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:33.492 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:33.492 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:39:33.492 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.524487+0000", 2024-09-13T06:39:33.492 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999986 2024-09-13T06:39:33.492 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:33.492 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:33.492 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:39:33.492 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.524498+0000", 2024-09-13T06:39:33.492 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1579999999999999e-05 2024-09-13T06:39:33.492 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:33.492 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:33.492 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:39:33.492 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.524516+0000", 2024-09-13T06:39:33.492 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7776000000000001e-05 2024-09-13T06:39:33.493 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:33.493 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:33.493 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:39:33.493 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.524530+0000", 2024-09-13T06:39:33.493 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3896999999999999e-05 2024-09-13T06:39:33.493 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:33.493 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:33.493 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:39:33.493 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.532254+0000", 2024-09-13T06:39:33.493 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0077239409999999998 2024-09-13T06:39:33.493 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:33.493 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:33.493 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:39:33.494 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.532371+0000", 2024-09-13T06:39:33.494 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000117176 2024-09-13T06:39:33.494 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:33.494 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:33.494 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 0", 2024-09-13T06:39:33.494 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.532551+0000", 2024-09-13T06:39:33.494 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00018004100000000001 2024-09-13T06:39:33.494 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:33.494 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:33.494 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:39:33.494 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.538280+0000", 2024-09-13T06:39:33.494 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0057289230000000003 2024-09-13T06:39:33.494 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:33.494 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:33.495 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-13T06:39:33.495 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.538294+0000", 2024-09-13T06:39:33.495 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.4070000000000001e-05 2024-09-13T06:39:33.495 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:33.495 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:33.495 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-13T06:39:33.495 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.538368+0000", 2024-09-13T06:39:33.495 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.3604999999999997e-05 2024-09-13T06:39:33.495 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:33.495 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:33.495 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:39:33.495 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.538465+0000", 2024-09-13T06:39:33.495 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6830000000000006e-05 2024-09-13T06:39:33.496 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:33.496 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:39:33.496 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:33.496 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:33.496 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:33.496 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4154.0:111 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-13T06:39:33.496 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:11.524546+0000", 2024-09-13T06:39:33.496 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 21.928411107999999, 2024-09-13T06:39:33.496 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.016412307000000001, 2024-09-13T06:39:33.496 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:39:33.496 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:33.497 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:39:33.497 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4154", 2024-09-13T06:39:33.497 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/2406930292", 2024-09-13T06:39:33.497 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 111 2024-09-13T06:39:33.497 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:33.497 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:39:33.497 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:33.497 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:39:33.497 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.524546+0000", 2024-09-13T06:39:33.497 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:33.497 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:33.498 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:33.498 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:39:33.498 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.524546+0000", 2024-09-13T06:39:33.498 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:33.498 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:33.498 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:33.498 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:39:33.498 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.524545+0000", 2024-09-13T06:39:33.498 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:39:33.498 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:33.498 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:33.498 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:39:33.498 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.524555+0000", 2024-09-13T06:39:33.499 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0176e-05 2024-09-13T06:39:33.499 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:33.499 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:33.499 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:39:33.499 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.524577+0000", 2024-09-13T06:39:33.499 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.1756999999999999e-05 2024-09-13T06:39:33.499 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:33.499 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:33.499 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:39:33.499 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.524592+0000", 2024-09-13T06:39:33.499 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5345999999999998e-05 2024-09-13T06:39:33.499 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:33.499 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:33.500 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:39:33.500 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.533407+0000", 2024-09-13T06:39:33.500 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0088150559999999999 2024-09-13T06:39:33.500 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:33.500 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:33.500 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:39:33.500 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.533523+0000", 2024-09-13T06:39:33.500 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000116099 2024-09-13T06:39:33.500 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:33.500 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:33.500 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 0", 2024-09-13T06:39:33.500 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.533734+0000", 2024-09-13T06:39:33.500 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000211005 2024-09-13T06:39:33.501 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:33.501 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:33.501 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-13T06:39:33.501 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.538484+0000", 2024-09-13T06:39:33.501 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0047494900000000003 2024-09-13T06:39:33.501 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:33.501 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:33.501 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:39:33.501 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.540823+0000", 2024-09-13T06:39:33.501 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0023390889999999999 2024-09-13T06:39:33.501 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:33.501 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:33.501 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-13T06:39:33.501 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.540898+0000", 2024-09-13T06:39:33.502 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5449000000000002e-05 2024-09-13T06:39:33.502 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:33.502 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:33.502 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:39:33.502 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.540958+0000", 2024-09-13T06:39:33.502 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.9889999999999997e-05 2024-09-13T06:39:33.502 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:33.502 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:39:33.502 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:33.502 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:33.502 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:33.502 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4154.0:112 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-13T06:39:33.502 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:11.524610+0000", 2024-09-13T06:39:33.502 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 21.928347388999999, 2024-09-13T06:39:33.502 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.016538458999999998, 2024-09-13T06:39:33.503 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:39:33.503 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:33.503 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:39:33.503 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4154", 2024-09-13T06:39:33.503 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/2406930292", 2024-09-13T06:39:33.503 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 112 2024-09-13T06:39:33.503 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:33.503 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:39:33.503 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:33.503 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:39:33.503 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.524610+0000", 2024-09-13T06:39:33.503 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:33.503 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:33.503 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:33.503 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:39:33.504 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.524610+0000", 2024-09-13T06:39:33.504 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:33.504 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:33.504 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:33.504 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:39:33.504 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.524608+0000", 2024-09-13T06:39:33.504 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:39:33.504 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:33.504 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:33.504 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:39:33.504 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.524826+0000", 2024-09-13T06:39:33.504 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000217226 2024-09-13T06:39:33.504 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:33.505 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:33.505 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:39:33.505 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.524848+0000", 2024-09-13T06:39:33.505 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.2802999999999998e-05 2024-09-13T06:39:33.505 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:33.505 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:33.505 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:39:33.505 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.524906+0000", 2024-09-13T06:39:33.505 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.7878999999999999e-05 2024-09-13T06:39:33.505 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:33.505 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:33.505 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:39:33.506 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.534402+0000", 2024-09-13T06:39:33.506 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0094956769999999992 2024-09-13T06:39:33.506 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:33.506 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:33.506 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:39:33.506 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.534512+0000", 2024-09-13T06:39:33.506 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000110493 2024-09-13T06:39:33.506 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:33.506 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:33.506 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 0", 2024-09-13T06:39:33.506 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.534688+0000", 2024-09-13T06:39:33.506 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00017564499999999999 2024-09-13T06:39:33.506 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:33.507 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:33.507 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-13T06:39:33.507 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.538493+0000", 2024-09-13T06:39:33.507 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0038051399999999998 2024-09-13T06:39:33.507 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:33.507 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:33.507 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:39:33.507 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.541030+0000", 2024-09-13T06:39:33.507 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0025368080000000002 2024-09-13T06:39:33.507 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:33.507 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:33.507 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-13T06:39:33.507 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.541097+0000", 2024-09-13T06:39:33.508 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.6933000000000004e-05 2024-09-13T06:39:33.508 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:33.508 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:33.508 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:39:33.508 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.541148+0000", 2024-09-13T06:39:33.508 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.1008999999999999e-05 2024-09-13T06:39:33.508 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:33.508 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:39:33.508 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:33.508 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:33.508 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:33.508 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4154.0:113 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-13T06:39:33.508 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:11.524940+0000", 2024-09-13T06:39:33.508 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 21.928016424999999, 2024-09-13T06:39:33.509 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.017201570999999999, 2024-09-13T06:39:33.509 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:39:33.509 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:33.509 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:39:33.509 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4154", 2024-09-13T06:39:33.509 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/2406930292", 2024-09-13T06:39:33.509 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 113 2024-09-13T06:39:33.509 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:33.509 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:39:33.509 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:33.509 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:39:33.509 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.524940+0000", 2024-09-13T06:39:33.510 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:33.510 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:33.510 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:33.510 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:39:33.510 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.524940+0000", 2024-09-13T06:39:33.510 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:33.510 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:33.510 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:33.510 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:39:33.510 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.524938+0000", 2024-09-13T06:39:33.510 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999981 2024-09-13T06:39:33.510 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:33.510 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:33.511 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:39:33.511 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.524951+0000", 2024-09-13T06:39:33.511 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2993000000000001e-05 2024-09-13T06:39:33.511 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:33.511 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:33.511 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:39:33.511 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.524976+0000", 2024-09-13T06:39:33.511 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.4216999999999999e-05 2024-09-13T06:39:33.511 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:33.511 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:33.511 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:39:33.511 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.525000+0000", 2024-09-13T06:39:33.511 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.3986e-05 2024-09-13T06:39:33.511 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:33.512 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:33.512 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:39:33.512 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.535786+0000", 2024-09-13T06:39:33.512 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.010786733999999999 2024-09-13T06:39:33.512 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:33.512 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:33.512 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:39:33.512 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.535916+0000", 2024-09-13T06:39:33.512 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000129865 2024-09-13T06:39:33.512 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:33.512 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:33.512 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 0", 2024-09-13T06:39:33.513 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.536106+0000", 2024-09-13T06:39:33.513 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000190046 2024-09-13T06:39:33.513 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:33.513 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:33.513 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-13T06:39:33.513 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.540977+0000", 2024-09-13T06:39:33.513 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0048708730000000004 2024-09-13T06:39:33.513 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:33.513 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:33.513 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:39:33.513 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.542023+0000", 2024-09-13T06:39:33.513 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0010456179999999999 2024-09-13T06:39:33.514 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:33.514 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:33.514 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-13T06:39:33.514 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.542091+0000", 2024-09-13T06:39:33.514 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.7840000000000001e-05 2024-09-13T06:39:33.514 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:33.514 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:33.514 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:39:33.514 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.542142+0000", 2024-09-13T06:39:33.514 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.1399e-05 2024-09-13T06:39:33.514 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:33.514 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:39:33.514 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:33.515 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:33.515 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:33.515 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4154.0:114 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-13T06:39:33.515 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:11.525025+0000", 2024-09-13T06:39:33.515 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 21.927931546, 2024-09-13T06:39:33.515 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.017310847000000001, 2024-09-13T06:39:33.515 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:39:33.515 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:33.515 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:39:33.515 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4154", 2024-09-13T06:39:33.515 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/2406930292", 2024-09-13T06:39:33.515 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 114 2024-09-13T06:39:33.515 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:33.516 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:39:33.516 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:33.516 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:39:33.516 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.525025+0000", 2024-09-13T06:39:33.516 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:33.516 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:33.516 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:33.516 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:39:33.516 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.525025+0000", 2024-09-13T06:39:33.516 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:33.516 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:33.516 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:33.516 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:39:33.517 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.525024+0000", 2024-09-13T06:39:33.517 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999986 2024-09-13T06:39:33.517 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:33.517 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:33.517 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:39:33.517 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.525035+0000", 2024-09-13T06:39:33.517 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1413999999999999e-05 2024-09-13T06:39:33.517 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:33.517 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:33.517 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:39:33.517 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.525054+0000", 2024-09-13T06:39:33.517 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.8723e-05 2024-09-13T06:39:33.517 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:33.518 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:33.518 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:39:33.518 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.525068+0000", 2024-09-13T06:39:33.518 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.4022999999999999e-05 2024-09-13T06:39:33.518 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:33.518 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:33.518 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:39:33.518 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.536923+0000", 2024-09-13T06:39:33.518 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.011854821999999999 2024-09-13T06:39:33.518 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:33.518 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:33.518 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:39:33.519 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.537048+0000", 2024-09-13T06:39:33.519 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000125399 2024-09-13T06:39:33.519 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:33.519 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:33.519 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 0", 2024-09-13T06:39:33.519 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.537293+0000", 2024-09-13T06:39:33.519 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00024499500000000002 2024-09-13T06:39:33.519 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:33.519 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:33.519 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-13T06:39:33.519 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.541962+0000", 2024-09-13T06:39:33.519 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0046680940000000002 2024-09-13T06:39:33.520 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:33.520 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:33.520 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:39:33.520 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.542218+0000", 2024-09-13T06:39:33.520 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00025668199999999999 2024-09-13T06:39:33.520 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:33.520 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:33.520 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-13T06:39:33.520 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.542286+0000", 2024-09-13T06:39:33.520 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.7565999999999997e-05 2024-09-13T06:39:33.520 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:33.520 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:33.520 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:39:33.521 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.542336+0000", 2024-09-13T06:39:33.521 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.0429000000000001e-05 2024-09-13T06:39:33.521 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:33.521 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:39:33.521 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:33.521 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:33.521 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:33.521 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4154.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-13T06:39:33.521 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:11.525085+0000", 2024-09-13T06:39:33.521 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 21.927872365999999, 2024-09-13T06:39:33.521 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.019358490999999999, 2024-09-13T06:39:33.521 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:39:33.521 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:33.521 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:39:33.522 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4154", 2024-09-13T06:39:33.522 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/2406930292", 2024-09-13T06:39:33.522 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 115 2024-09-13T06:39:33.522 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:33.522 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:39:33.522 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:33.522 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:39:33.522 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.525085+0000", 2024-09-13T06:39:33.522 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:33.522 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:33.522 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:33.522 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:39:33.522 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.525085+0000", 2024-09-13T06:39:33.523 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:33.523 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:33.523 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:33.523 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:39:33.523 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.525083+0000", 2024-09-13T06:39:33.523 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:39:33.523 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:33.523 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:33.523 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:39:33.523 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.525302+0000", 2024-09-13T06:39:33.523 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00021804499999999999 2024-09-13T06:39:33.523 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:33.523 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:33.523 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:39:33.524 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.525324+0000", 2024-09-13T06:39:33.524 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.2147e-05 2024-09-13T06:39:33.524 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:33.524 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:33.524 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:39:33.524 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.525340+0000", 2024-09-13T06:39:33.524 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5879000000000002e-05 2024-09-13T06:39:33.524 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:33.524 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:33.524 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:39:33.524 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.538555+0000", 2024-09-13T06:39:33.524 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.013215499 2024-09-13T06:39:33.524 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:33.524 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:33.524 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:39:33.525 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.538703+0000", 2024-09-13T06:39:33.525 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00014755200000000001 2024-09-13T06:39:33.525 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:33.525 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:33.525 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 0", 2024-09-13T06:39:33.525 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.538967+0000", 2024-09-13T06:39:33.525 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00026453799999999998 2024-09-13T06:39:33.525 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:33.525 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:33.525 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-13T06:39:33.525 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.541969+0000", 2024-09-13T06:39:33.525 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00300184 2024-09-13T06:39:33.525 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:33.526 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:33.526 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:39:33.526 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.544287+0000", 2024-09-13T06:39:33.526 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0023178890000000001 2024-09-13T06:39:33.526 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:33.526 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:33.526 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-13T06:39:33.526 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.544378+0000", 2024-09-13T06:39:33.526 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.1366000000000006e-05 2024-09-13T06:39:33.526 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:33.526 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:33.526 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:39:33.526 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.544443+0000", 2024-09-13T06:39:33.527 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.4826000000000006e-05 2024-09-13T06:39:33.527 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:33.527 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:39:33.527 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:33.527 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:33.527 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:33.527 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4154.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-13T06:39:33.527 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:11.525359+0000", 2024-09-13T06:39:33.527 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 21.927598337999999, 2024-09-13T06:39:33.527 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.019359514000000001, 2024-09-13T06:39:33.527 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:39:33.527 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:33.527 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:39:33.527 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4154", 2024-09-13T06:39:33.528 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/2406930292", 2024-09-13T06:39:33.528 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 116 2024-09-13T06:39:33.528 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:33.528 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:39:33.528 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:33.528 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:39:33.528 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.525359+0000", 2024-09-13T06:39:33.528 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:33.528 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:33.528 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:33.528 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:39:33.528 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.525359+0000", 2024-09-13T06:39:33.528 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:33.529 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:33.529 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:33.529 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:39:33.529 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.525357+0000", 2024-09-13T06:39:33.529 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999981 2024-09-13T06:39:33.529 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:33.529 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:33.529 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:39:33.529 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.525369+0000", 2024-09-13T06:39:33.529 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1647e-05 2024-09-13T06:39:33.529 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:33.529 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:33.529 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:39:33.530 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.525386+0000", 2024-09-13T06:39:33.530 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7762999999999999e-05 2024-09-13T06:39:33.530 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:33.530 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:33.530 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:39:33.530 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.525400+0000", 2024-09-13T06:39:33.530 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.4053000000000001e-05 2024-09-13T06:39:33.530 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:33.530 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:33.530 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:39:33.530 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.539897+0000", 2024-09-13T06:39:33.530 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.014497128999999999 2024-09-13T06:39:33.530 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:33.531 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:33.531 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:39:33.531 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.540022+0000", 2024-09-13T06:39:33.531 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00012416599999999999 2024-09-13T06:39:33.531 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:33.531 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:33.531 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 0", 2024-09-13T06:39:33.531 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.540199+0000", 2024-09-13T06:39:33.531 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00017705499999999999 2024-09-13T06:39:33.531 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:33.531 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:33.531 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-13T06:39:33.531 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.542161+0000", 2024-09-13T06:39:33.531 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0019622210000000001 2024-09-13T06:39:33.532 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:33.532 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:33.532 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:39:33.532 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.544529+0000", 2024-09-13T06:39:33.532 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0023684690000000002 2024-09-13T06:39:33.532 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:33.532 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:33.532 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-13T06:39:33.532 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.544614+0000", 2024-09-13T06:39:33.532 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.4711999999999998e-05 2024-09-13T06:39:33.532 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:33.532 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:33.532 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:39:33.532 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.544718+0000", 2024-09-13T06:39:33.533 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000103986 2024-09-13T06:39:33.533 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:33.533 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:39:33.533 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:33.533 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:33.533 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:33.533 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4154.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-13T06:39:33.533 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:11.525416+0000", 2024-09-13T06:39:33.533 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 21.927540785000001, 2024-09-13T06:39:33.533 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.019501830000000001, 2024-09-13T06:39:33.533 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:39:33.533 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:33.533 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:39:33.534 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4154", 2024-09-13T06:39:33.534 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/2406930292", 2024-09-13T06:39:33.534 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 117 2024-09-13T06:39:33.534 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:33.534 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:39:33.534 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:33.534 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:39:33.534 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.525416+0000", 2024-09-13T06:39:33.534 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:33.534 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:33.534 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:33.534 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:39:33.534 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.525416+0000", 2024-09-13T06:39:33.534 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:33.534 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:33.534 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:33.535 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:39:33.535 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.525415+0000", 2024-09-13T06:39:33.535 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999986 2024-09-13T06:39:33.535 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:33.535 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:33.535 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:39:33.535 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.525426+0000", 2024-09-13T06:39:33.535 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.101e-05 2024-09-13T06:39:33.535 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:33.535 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:33.535 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:39:33.535 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.525444+0000", 2024-09-13T06:39:33.535 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.768e-05 2024-09-13T06:39:33.535 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:33.535 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:33.535 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:39:33.536 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.525463+0000", 2024-09-13T06:39:33.536 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.9026999999999999e-05 2024-09-13T06:39:33.536 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:33.536 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:33.536 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:39:33.536 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.541203+0000", 2024-09-13T06:39:33.536 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.015740309000000001 2024-09-13T06:39:33.536 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:33.536 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:33.536 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:39:33.536 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.541330+0000", 2024-09-13T06:39:33.536 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000126976 2024-09-13T06:39:33.536 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:33.536 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:33.536 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 0", 2024-09-13T06:39:33.537 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.541522+0000", 2024-09-13T06:39:33.537 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00019165100000000001 2024-09-13T06:39:33.537 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:33.537 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:33.537 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-13T06:39:33.537 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.542798+0000", 2024-09-13T06:39:33.537 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.001276424 2024-09-13T06:39:33.537 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:33.537 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:33.537 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:39:33.537 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.544795+0000", 2024-09-13T06:39:33.537 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0019966540000000001 2024-09-13T06:39:33.537 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:33.537 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:33.537 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-13T06:39:33.538 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.544868+0000", 2024-09-13T06:39:33.538 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.3096000000000006e-05 2024-09-13T06:39:33.538 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:33.538 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:33.538 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:39:33.538 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.544918+0000", 2024-09-13T06:39:33.538 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.0226999999999999e-05 2024-09-13T06:39:33.538 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:33.538 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:39:33.538 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:33.538 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:33.538 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:33.538 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4154.0:134 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-13T06:39:33.539 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:12.006248+0000", 2024-09-13T06:39:33.539 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 21.446708854000001, 2024-09-13T06:39:33.539 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.012014530000000001, 2024-09-13T06:39:33.539 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:39:33.539 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:33.539 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:39:33.539 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4154", 2024-09-13T06:39:33.539 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/2406930292", 2024-09-13T06:39:33.539 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 134 2024-09-13T06:39:33.539 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:33.539 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:39:33.539 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:33.539 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:39:33.540 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.006248+0000", 2024-09-13T06:39:33.540 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:33.540 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:33.540 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:33.540 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:39:33.540 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.006248+0000", 2024-09-13T06:39:33.540 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:33.540 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:33.540 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:33.540 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:39:33.540 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.006247+0000", 2024-09-13T06:39:33.540 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:39:33.540 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:33.541 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:33.541 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:39:33.541 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.006329+0000", 2024-09-13T06:39:33.541 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.2003999999999996e-05 2024-09-13T06:39:33.541 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:33.541 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:33.541 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:39:33.541 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.006338+0000", 2024-09-13T06:39:33.541 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.2529999999999993e-06 2024-09-13T06:39:33.541 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:33.541 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:33.541 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:39:33.541 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.006345+0000", 2024-09-13T06:39:33.542 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.2249999999999997e-06 2024-09-13T06:39:33.542 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:33.542 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:33.542 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:39:33.542 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.007463+0000", 2024-09-13T06:39:33.542 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.001118345 2024-09-13T06:39:33.542 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:33.542 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:33.542 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:39:33.542 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.007513+0000", 2024-09-13T06:39:33.542 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.9678000000000001e-05 2024-09-13T06:39:33.542 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:33.542 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:33.542 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 0", 2024-09-13T06:39:33.543 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.007588+0000", 2024-09-13T06:39:33.543 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5433999999999996e-05 2024-09-13T06:39:33.543 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:33.543 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:33.543 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-13T06:39:33.543 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.011008+0000", 2024-09-13T06:39:33.543 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0034198029999999999 2024-09-13T06:39:33.543 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:33.543 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:33.543 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:39:33.543 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.018160+0000", 2024-09-13T06:39:33.543 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0071521579999999996 2024-09-13T06:39:33.543 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:33.543 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:33.544 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-13T06:39:33.544 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.018240+0000", 2024-09-13T06:39:33.544 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.9573000000000005e-05 2024-09-13T06:39:33.544 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:33.544 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:33.544 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:39:33.544 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.018263+0000", 2024-09-13T06:39:33.544 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.2894000000000001e-05 2024-09-13T06:39:33.544 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:33.544 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:39:33.544 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:33.544 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:33.544 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:33.544 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4154.0:136 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-13T06:39:33.545 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:12.006369+0000", 2024-09-13T06:39:33.545 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 21.446587436000002, 2024-09-13T06:39:33.545 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.012052078000000001, 2024-09-13T06:39:33.545 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:39:33.545 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:33.545 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:39:33.545 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4154", 2024-09-13T06:39:33.545 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/2406930292", 2024-09-13T06:39:33.545 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 136 2024-09-13T06:39:33.545 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:33.545 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:39:33.545 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:33.545 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:39:33.546 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.006369+0000", 2024-09-13T06:39:33.546 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:33.546 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:33.546 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:33.546 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:39:33.546 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.006369+0000", 2024-09-13T06:39:33.546 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:33.546 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:33.546 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:33.546 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:39:33.546 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.006369+0000", 2024-09-13T06:39:33.546 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:39:33.546 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:33.547 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:33.547 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:39:33.547 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.006372+0000", 2024-09-13T06:39:33.547 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.0630000000000002e-06 2024-09-13T06:39:33.547 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:33.547 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:33.547 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:39:33.547 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.006377+0000", 2024-09-13T06:39:33.547 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.6079999999999998e-06 2024-09-13T06:39:33.547 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:33.547 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:33.547 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:39:33.547 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.006384+0000", 2024-09-13T06:39:33.547 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.8560000000000001e-06 2024-09-13T06:39:33.548 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:33.548 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:33.548 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:39:33.548 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.008357+0000", 2024-09-13T06:39:33.548 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0019733839999999999 2024-09-13T06:39:33.548 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:33.548 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:33.548 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:39:33.548 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.008406+0000", 2024-09-13T06:39:33.548 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.9023000000000001e-05 2024-09-13T06:39:33.548 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:33.548 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:33.549 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 0", 2024-09-13T06:39:33.549 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.008489+0000", 2024-09-13T06:39:33.549 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.2649000000000001e-05 2024-09-13T06:39:33.549 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:33.549 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:33.549 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-13T06:39:33.549 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.011012+0000", 2024-09-13T06:39:33.549 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0025236880000000001 2024-09-13T06:39:33.549 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:33.549 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:33.549 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:39:33.549 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.018382+0000", 2024-09-13T06:39:33.549 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.007369596 2024-09-13T06:39:33.550 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:33.550 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:33.550 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-13T06:39:33.550 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.018405+0000", 2024-09-13T06:39:33.550 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.2670000000000001e-05 2024-09-13T06:39:33.550 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:33.550 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:33.550 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:39:33.550 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.018422+0000", 2024-09-13T06:39:33.550 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6864999999999999e-05 2024-09-13T06:39:33.550 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:33.550 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:39:33.550 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:33.551 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:33.551 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:33.551 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4154.0:137 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-13T06:39:33.551 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:12.006450+0000", 2024-09-13T06:39:33.551 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 21.446507106999999, 2024-09-13T06:39:33.551 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.012040990999999999, 2024-09-13T06:39:33.551 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:39:33.551 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:33.551 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:39:33.551 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4154", 2024-09-13T06:39:33.551 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/2406930292", 2024-09-13T06:39:33.551 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 137 2024-09-13T06:39:33.551 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:33.551 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:39:33.552 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:33.552 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:39:33.552 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.006450+0000", 2024-09-13T06:39:33.552 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:33.552 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:33.552 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:33.552 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:39:33.552 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.006450+0000", 2024-09-13T06:39:33.552 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:33.552 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:33.552 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:33.552 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:39:33.552 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.006449+0000", 2024-09-13T06:39:33.553 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:39:33.553 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:33.553 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:33.553 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:39:33.553 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.006549+0000", 2024-09-13T06:39:33.553 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.9847999999999997e-05 2024-09-13T06:39:33.553 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:33.553 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:33.553 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:39:33.553 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.006560+0000", 2024-09-13T06:39:33.553 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1012000000000001e-05 2024-09-13T06:39:33.553 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:33.553 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:33.554 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:39:33.554 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.006566+0000", 2024-09-13T06:39:33.554 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.1630000000000001e-06 2024-09-13T06:39:33.554 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:33.554 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:33.554 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:39:33.554 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.008760+0000", 2024-09-13T06:39:33.554 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0021934659999999998 2024-09-13T06:39:33.554 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:33.554 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:33.554 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:39:33.554 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.008803+0000", 2024-09-13T06:39:33.554 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.3492000000000003e-05 2024-09-13T06:39:33.554 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:33.555 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:33.555 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 0", 2024-09-13T06:39:33.555 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.008879+0000", 2024-09-13T06:39:33.555 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5252000000000004e-05 2024-09-13T06:39:33.555 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:33.555 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:33.555 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-13T06:39:33.555 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.011015+0000", 2024-09-13T06:39:33.555 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0021362349999999998 2024-09-13T06:39:33.555 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:33.555 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:33.555 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:39:33.556 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.018452+0000", 2024-09-13T06:39:33.556 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.007436865 2024-09-13T06:39:33.556 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:33.556 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:33.556 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-13T06:39:33.556 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.018474+0000", 2024-09-13T06:39:33.556 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.2149000000000001e-05 2024-09-13T06:39:33.556 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:33.556 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:33.556 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:39:33.556 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.018491+0000", 2024-09-13T06:39:33.556 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6983999999999999e-05 2024-09-13T06:39:33.556 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:33.556 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:39:33.557 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:33.557 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:33.557 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:33.557 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4154.0:139 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-13T06:39:33.557 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:12.006595+0000", 2024-09-13T06:39:33.557 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 21.446361789000001, 2024-09-13T06:39:33.557 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.012024933999999999, 2024-09-13T06:39:33.557 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:39:33.557 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:33.557 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:39:33.557 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4154", 2024-09-13T06:39:33.557 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/2406930292", 2024-09-13T06:39:33.557 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 139 2024-09-13T06:39:33.558 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:33.558 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:39:33.558 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:33.558 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:39:33.558 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.006595+0000", 2024-09-13T06:39:33.558 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:33.558 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:33.558 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:33.558 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:39:33.558 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.006595+0000", 2024-09-13T06:39:33.558 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:33.558 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:33.558 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:33.558 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:39:33.558 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.006595+0000", 2024-09-13T06:39:33.559 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:39:33.559 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:33.559 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:33.559 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:39:33.559 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.006598+0000", 2024-09-13T06:39:33.559 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.1769999999999998e-06 2024-09-13T06:39:33.559 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:33.559 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:33.559 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:39:33.559 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.006612+0000", 2024-09-13T06:39:33.559 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.4177e-05 2024-09-13T06:39:33.559 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:33.559 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:33.560 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:39:33.560 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.006617+0000", 2024-09-13T06:39:33.560 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.561e-06 2024-09-13T06:39:33.560 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:33.560 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:33.560 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:39:33.560 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.009658+0000", 2024-09-13T06:39:33.560 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0030413369999999999 2024-09-13T06:39:33.560 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:33.560 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:33.560 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:39:33.560 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.009707+0000", 2024-09-13T06:39:33.560 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.9089999999999999e-05 2024-09-13T06:39:33.561 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:33.561 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:33.561 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 0", 2024-09-13T06:39:33.561 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.009795+0000", 2024-09-13T06:39:33.561 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.7619000000000003e-05 2024-09-13T06:39:33.561 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:33.561 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:33.561 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-13T06:39:33.561 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.011021+0000", 2024-09-13T06:39:33.561 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0012266289999999999 2024-09-13T06:39:33.561 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:33.561 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:33.562 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:39:33.562 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.018582+0000", 2024-09-13T06:39:33.562 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0075603399999999996 2024-09-13T06:39:33.562 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:33.562 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:33.562 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-13T06:39:33.562 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.018603+0000", 2024-09-13T06:39:33.562 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.1795999999999999e-05 2024-09-13T06:39:33.562 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:33.562 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:33.562 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:39:33.562 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.018620+0000", 2024-09-13T06:39:33.562 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6562000000000002e-05 2024-09-13T06:39:33.563 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:33.563 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:39:33.563 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:33.563 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:33.563 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:33.563 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4154.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-13T06:39:33.563 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:12.006689+0000", 2024-09-13T06:39:33.563 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 21.446267599999999, 2024-09-13T06:39:33.563 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.012427258, 2024-09-13T06:39:33.563 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:39:33.563 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:33.563 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:39:33.563 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4154", 2024-09-13T06:39:33.564 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/2406930292", 2024-09-13T06:39:33.564 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 140 2024-09-13T06:39:33.564 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:33.564 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:39:33.564 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:33.564 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:39:33.564 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.006689+0000", 2024-09-13T06:39:33.564 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:33.564 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:33.564 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:33.564 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:39:33.564 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.006689+0000", 2024-09-13T06:39:33.564 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:33.564 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:33.564 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:33.565 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:39:33.565 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.006689+0000", 2024-09-13T06:39:33.565 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:39:33.565 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:33.565 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:33.565 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:39:33.565 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.006795+0000", 2024-09-13T06:39:33.565 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00010662699999999999 2024-09-13T06:39:33.565 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:33.565 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:33.565 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:39:33.565 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.006804+0000", 2024-09-13T06:39:33.565 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.055e-06 2024-09-13T06:39:33.565 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:33.566 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:33.566 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:39:33.566 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.006808+0000", 2024-09-13T06:39:33.566 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.7450000000000003e-06 2024-09-13T06:39:33.566 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:33.566 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:33.566 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:39:33.566 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.010066+0000", 2024-09-13T06:39:33.566 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0032579570000000001 2024-09-13T06:39:33.566 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:33.566 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:33.566 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:39:33.566 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.010111+0000", 2024-09-13T06:39:33.566 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.4563e-05 2024-09-13T06:39:33.566 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:33.567 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:33.567 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 0", 2024-09-13T06:39:33.567 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.010185+0000", 2024-09-13T06:39:33.567 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.4108000000000003e-05 2024-09-13T06:39:33.567 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:33.567 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:33.567 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-13T06:39:33.567 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.011161+0000", 2024-09-13T06:39:33.567 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00097629200000000002 2024-09-13T06:39:33.567 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:33.567 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:33.567 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:39:33.567 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.019061+0000", 2024-09-13T06:39:33.567 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0079001939999999993 2024-09-13T06:39:33.567 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:33.568 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:33.568 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-13T06:39:33.568 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.019095+0000", 2024-09-13T06:39:33.568 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.3200000000000001e-05 2024-09-13T06:39:33.568 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:33.568 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:33.568 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:39:33.568 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.019117+0000", 2024-09-13T06:39:33.568 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.1985e-05 2024-09-13T06:39:33.568 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:33.568 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:39:33.568 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:33.568 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:33.568 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:33.568 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4154.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-13T06:39:33.569 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:12.006814+0000", 2024-09-13T06:39:33.569 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 21.446142416000001, 2024-09-13T06:39:33.569 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.012896405999999999, 2024-09-13T06:39:33.569 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:39:33.569 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:33.569 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:39:33.569 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4154", 2024-09-13T06:39:33.569 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/2406930292", 2024-09-13T06:39:33.569 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 141 2024-09-13T06:39:33.569 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:33.569 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:39:33.569 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:33.569 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:39:33.569 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.006814+0000", 2024-09-13T06:39:33.569 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:33.569 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:33.570 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:33.570 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:39:33.570 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.006814+0000", 2024-09-13T06:39:33.570 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:33.570 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:33.570 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:33.570 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:39:33.570 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.006814+0000", 2024-09-13T06:39:33.570 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:39:33.570 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:33.570 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:33.570 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:39:33.570 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.006818+0000", 2024-09-13T06:39:33.570 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.8840000000000004e-06 2024-09-13T06:39:33.571 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:33.571 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:33.571 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:39:33.571 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.006834+0000", 2024-09-13T06:39:33.571 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6133999999999998e-05 2024-09-13T06:39:33.571 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:33.571 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:33.571 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:39:33.571 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.006838+0000", 2024-09-13T06:39:33.571 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0879999999999997e-06 2024-09-13T06:39:33.571 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:33.571 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:33.571 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:39:33.571 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.010586+0000", 2024-09-13T06:39:33.572 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.003747954 2024-09-13T06:39:33.572 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:33.572 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:33.572 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:39:33.572 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.010630+0000", 2024-09-13T06:39:33.572 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.3736000000000003e-05 2024-09-13T06:39:33.572 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:33.572 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:33.572 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 0", 2024-09-13T06:39:33.572 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.010701+0000", 2024-09-13T06:39:33.572 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.1284000000000004e-05 2024-09-13T06:39:33.572 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:33.572 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:33.572 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-13T06:39:33.573 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.011593+0000", 2024-09-13T06:39:33.573 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00089209300000000005 2024-09-13T06:39:33.573 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:33.573 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:33.573 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:39:33.573 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.019665+0000", 2024-09-13T06:39:33.573 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0080716169999999997 2024-09-13T06:39:33.573 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:33.573 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:33.573 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-13T06:39:33.573 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.019691+0000", 2024-09-13T06:39:33.573 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.6514000000000001e-05 2024-09-13T06:39:33.573 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:33.574 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:33.574 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:39:33.574 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.019711+0000", 2024-09-13T06:39:33.574 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.9641e-05 2024-09-13T06:39:33.574 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:33.574 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:39:33.574 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:33.574 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:33.574 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:39:33.574 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:39:33.576 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-13T06:39:33.576 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:39:33.579+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:39:33.677 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-13T06:39:33.678+0000 7f86a5f06640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26387) UID: 0 2024-09-13T06:39:33.708 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:39:33.709 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-13T06:39:33.709 INFO:teuthology.orchestra.run.smithi081.stdout: "num_ops": 0 2024-09-13T06:39:33.709 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:39:33.723 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-13T06:39:33.779 INFO:tasks.ceph.osd.6.smithi139.stderr:2024-09-13T06:39:33.782+0000 7fcd02c5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26385) UID: 0 2024-09-13T06:39:33.846 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:39:33.846 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-13T06:39:33.846 INFO:teuthology.orchestra.run.smithi081.stdout: "complaint_time": 30, 2024-09-13T06:39:33.846 INFO:teuthology.orchestra.run.smithi081.stdout: "num_blocked_ops": 0 2024-09-13T06:39:33.846 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:39:33.860 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-13T06:39:33.907 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:39:33.911+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:39:33.980 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:39:33.981 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 20, 2024-09-13T06:39:33.981 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 600, 2024-09-13T06:39:33.981 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [ 2024-09-13T06:39:33.981 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:33.981 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4154.0:67 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'41, mlcod=15'39)", 2024-09-13T06:39:33.981 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:11.333035+0000", 2024-09-13T06:39:33.981 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 22.649546785999998, 2024-09-13T06:39:33.981 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0063409859999999998, 2024-09-13T06:39:33.981 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:33.981 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:33.982 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:33.982 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:33.982 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:33.982 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:11.333035+0000", 2024-09-13T06:39:33.982 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:33.982 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:33.982 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:33.982 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:33.982 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:11.333035+0000", 2024-09-13T06:39:33.982 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:33.982 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:33.982 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:33.982 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:33.983 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:11.333034+0000", 2024-09-13T06:39:33.983 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999981 2024-09-13T06:39:33.983 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:33.983 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:33.983 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:33.983 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:11.333048+0000", 2024-09-13T06:39:33.983 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3859999999999999e-05 2024-09-13T06:39:33.983 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:33.983 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:33.983 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:33.983 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:11.333076+0000", 2024-09-13T06:39:33.983 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.8586e-05 2024-09-13T06:39:33.983 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:33.983 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:33.984 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:33.984 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:11.333089+0000", 2024-09-13T06:39:33.984 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2447e-05 2024-09-13T06:39:33.984 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:33.984 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:33.984 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:33.984 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:11.333193+0000", 2024-09-13T06:39:33.984 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000104042 2024-09-13T06:39:33.984 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:33.984 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:33.984 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:33.984 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:11.333232+0000", 2024-09-13T06:39:33.985 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.9406999999999997e-05 2024-09-13T06:39:33.985 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:33.985 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:33.985 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:39:33.985 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:11.339313+0000", 2024-09-13T06:39:33.985 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0060808529999999998 2024-09-13T06:39:33.985 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:33.985 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:33.985 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:33.985 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:11.339376+0000", 2024-09-13T06:39:33.985 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3565000000000006e-05 2024-09-13T06:39:33.985 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:33.986 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:33.986 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:33.986 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:33.986 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:33.986 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4154.0:68 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'42, mlcod=15'39)", 2024-09-13T06:39:33.986 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:11.333986+0000", 2024-09-13T06:39:33.986 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 22.648595901, 2024-09-13T06:39:33.986 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0054233750000000002, 2024-09-13T06:39:33.986 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:33.986 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:33.986 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:33.986 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:33.986 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:33.987 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:11.333986+0000", 2024-09-13T06:39:33.987 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:33.987 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:33.987 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:33.987 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:33.987 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:11.333986+0000", 2024-09-13T06:39:33.987 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:33.987 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:33.987 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:33.987 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:33.987 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:11.333985+0000", 2024-09-13T06:39:33.987 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999981 2024-09-13T06:39:33.987 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:33.987 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:33.988 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:33.988 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:11.333997+0000", 2024-09-13T06:39:33.988 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2813000000000001e-05 2024-09-13T06:39:33.988 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:33.988 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:33.988 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:33.988 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:11.334026+0000", 2024-09-13T06:39:33.988 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.8787000000000001e-05 2024-09-13T06:39:33.988 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:33.988 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:33.988 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:33.988 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:11.334039+0000", 2024-09-13T06:39:33.989 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2713e-05 2024-09-13T06:39:33.989 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:33.989 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:33.989 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:33.989 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:11.337023+0000", 2024-09-13T06:39:33.989 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0029835600000000001 2024-09-13T06:39:33.989 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:33.989 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:33.989 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:33.989 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:11.337053+0000", 2024-09-13T06:39:33.989 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.0453000000000001e-05 2024-09-13T06:39:33.989 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:33.989 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:33.990 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:39:33.990 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:11.339379+0000", 2024-09-13T06:39:33.990 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0023261480000000001 2024-09-13T06:39:33.990 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:33.990 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:33.990 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:33.990 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:11.339410+0000", 2024-09-13T06:39:33.990 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.0583999999999997e-05 2024-09-13T06:39:33.990 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:33.990 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:33.990 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:33.990 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:33.990 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:33.990 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4154.0:109 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'71, mlcod=15'67)", 2024-09-13T06:39:33.991 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:11.530573+0000", 2024-09-13T06:39:33.991 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 22.452009534999998, 2024-09-13T06:39:33.991 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0050450549999999997, 2024-09-13T06:39:33.991 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:33.991 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:33.991 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:33.991 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:33.991 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:33.991 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:11.530573+0000", 2024-09-13T06:39:33.991 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:33.991 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:33.991 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:33.991 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:33.992 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:11.530573+0000", 2024-09-13T06:39:33.992 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:33.992 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:33.992 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:33.992 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:33.992 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:11.530571+0000", 2024-09-13T06:39:33.992 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999986 2024-09-13T06:39:33.992 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:33.992 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:33.992 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:33.992 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:11.530689+0000", 2024-09-13T06:39:33.992 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000117182 2024-09-13T06:39:33.993 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:33.993 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:33.993 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:33.993 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:11.530716+0000", 2024-09-13T06:39:33.993 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.7120000000000001e-05 2024-09-13T06:39:33.993 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:33.993 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:33.993 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:33.993 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:11.530736+0000", 2024-09-13T06:39:33.993 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0052999999999999e-05 2024-09-13T06:39:33.993 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:33.993 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:33.993 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:33.994 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:11.530784+0000", 2024-09-13T06:39:33.994 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.8361e-05 2024-09-13T06:39:33.994 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:33.994 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:33.994 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:33.994 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:11.530798+0000", 2024-09-13T06:39:33.994 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4276e-05 2024-09-13T06:39:33.994 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:33.994 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:33.994 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:39:33.994 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:11.535584+0000", 2024-09-13T06:39:33.994 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.004786116 2024-09-13T06:39:33.994 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:33.994 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:33.995 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:33.995 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:11.535618+0000", 2024-09-13T06:39:33.995 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.328e-05 2024-09-13T06:39:33.995 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:33.995 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:33.995 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:33.995 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:33.995 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:33.995 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4154.0:113 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'75, mlcod=15'68)", 2024-09-13T06:39:33.995 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:11.536011+0000", 2024-09-13T06:39:33.995 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 22.446571493, 2024-09-13T06:39:33.995 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0048854359999999999, 2024-09-13T06:39:33.995 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:33.995 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:33.996 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:33.996 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:33.996 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:33.996 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:11.536011+0000", 2024-09-13T06:39:33.996 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:33.996 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:33.996 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:33.996 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:33.996 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:11.536011+0000", 2024-09-13T06:39:33.996 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:33.996 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:33.996 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:33.996 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:33.996 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:11.536010+0000", 2024-09-13T06:39:33.997 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.999999 2024-09-13T06:39:33.997 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:33.997 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:33.997 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:33.997 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:11.536017+0000", 2024-09-13T06:39:33.997 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.7700000000000004e-06 2024-09-13T06:39:33.997 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:33.997 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:33.997 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:33.997 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:11.536030+0000", 2024-09-13T06:39:33.997 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3608000000000001e-05 2024-09-13T06:39:33.997 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:33.997 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:33.998 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:33.998 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:11.536041+0000", 2024-09-13T06:39:33.998 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0454e-05 2024-09-13T06:39:33.998 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:33.998 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:33.998 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:33.998 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:11.536080+0000", 2024-09-13T06:39:33.998 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.9109000000000001e-05 2024-09-13T06:39:33.998 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:33.998 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:33.998 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:33.999 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:11.536093+0000", 2024-09-13T06:39:33.999 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2948e-05 2024-09-13T06:39:33.999 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:33.999 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:33.999 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:39:33.999 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:11.540864+0000", 2024-09-13T06:39:33.999 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.004771572 2024-09-13T06:39:33.999 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:33.999 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:33.999 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:33.999 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:11.540896+0000", 2024-09-13T06:39:33.999 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.1834e-05 2024-09-13T06:39:34.000 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:34.000 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:34.000 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:34.000 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:34.000 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.000 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4154.0:130 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'88, mlcod=15'85)", 2024-09-13T06:39:34.000 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:12.005647+0000", 2024-09-13T06:39:34.000 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 21.976935608000002, 2024-09-13T06:39:34.000 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0064037570000000004, 2024-09-13T06:39:34.000 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:34.001 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:34.001 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:34.001 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.001 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:34.001 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.005647+0000", 2024-09-13T06:39:34.001 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:34.001 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:34.001 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.001 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:34.001 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.005647+0000", 2024-09-13T06:39:34.001 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:34.001 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:34.001 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.001 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:34.002 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.005645+0000", 2024-09-13T06:39:34.002 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999981 2024-09-13T06:39:34.002 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:34.002 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.002 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:34.002 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.005664+0000", 2024-09-13T06:39:34.002 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8876999999999999e-05 2024-09-13T06:39:34.002 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:34.002 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.002 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:34.002 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.005695+0000", 2024-09-13T06:39:34.002 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.1467000000000002e-05 2024-09-13T06:39:34.002 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:34.002 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.003 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:34.003 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.005715+0000", 2024-09-13T06:39:34.003 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0248999999999999e-05 2024-09-13T06:39:34.003 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:34.003 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.003 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:34.003 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.006412+0000", 2024-09-13T06:39:34.003 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00069722499999999999 2024-09-13T06:39:34.003 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:34.003 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.003 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:34.003 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.006475+0000", 2024-09-13T06:39:34.003 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.2955999999999998e-05 2024-09-13T06:39:34.004 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:34.004 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.004 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:39:34.004 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.011987+0000", 2024-09-13T06:39:34.004 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0055118240000000002 2024-09-13T06:39:34.004 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:34.004 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.004 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:34.004 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.012050+0000", 2024-09-13T06:39:34.004 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3102999999999995e-05 2024-09-13T06:39:34.004 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:34.004 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:34.004 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:34.005 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:34.005 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.005 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4154.0:131 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'89, mlcod=15'85)", 2024-09-13T06:39:34.005 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:12.006115+0000", 2024-09-13T06:39:34.005 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 21.976467142000001, 2024-09-13T06:39:34.005 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0092077789999999993, 2024-09-13T06:39:34.005 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:34.005 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:34.005 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:34.005 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.005 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:34.005 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.006115+0000", 2024-09-13T06:39:34.006 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:34.006 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:34.006 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.006 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:34.006 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.006115+0000", 2024-09-13T06:39:34.006 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:34.006 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:34.006 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.006 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:34.006 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.006114+0000", 2024-09-13T06:39:34.006 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999986 2024-09-13T06:39:34.006 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:34.006 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.007 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:34.007 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.006258+0000", 2024-09-13T06:39:34.007 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00014467899999999999 2024-09-13T06:39:34.007 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:34.007 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.007 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:34.007 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.006277+0000", 2024-09-13T06:39:34.007 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8425999999999999e-05 2024-09-13T06:39:34.007 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:34.007 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.007 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:34.007 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.006288+0000", 2024-09-13T06:39:34.007 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1037e-05 2024-09-13T06:39:34.007 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:34.008 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.008 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:34.008 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.007461+0000", 2024-09-13T06:39:34.008 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.001173381 2024-09-13T06:39:34.008 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:34.008 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.008 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:34.008 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.007522+0000", 2024-09-13T06:39:34.008 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0266999999999997e-05 2024-09-13T06:39:34.008 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:34.008 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.008 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:39:34.008 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.015248+0000", 2024-09-13T06:39:34.009 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0077260200000000001 2024-09-13T06:39:34.009 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:34.009 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.009 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:34.009 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.015323+0000", 2024-09-13T06:39:34.009 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5289000000000004e-05 2024-09-13T06:39:34.009 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:34.009 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:34.009 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:34.009 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:34.009 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.009 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4154.0:132 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'90, mlcod=15'85)", 2024-09-13T06:39:34.009 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:12.006560+0000", 2024-09-13T06:39:34.010 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 21.976022222000001, 2024-09-13T06:39:34.010 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0088017219999999997, 2024-09-13T06:39:34.010 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:34.010 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:34.010 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:34.010 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.010 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:34.010 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.006560+0000", 2024-09-13T06:39:34.010 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:34.010 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:34.010 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.010 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:34.010 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.006560+0000", 2024-09-13T06:39:34.010 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:34.011 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:34.011 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.011 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:34.011 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.006559+0000", 2024-09-13T06:39:34.011 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.999999 2024-09-13T06:39:34.011 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:34.011 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.011 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:34.011 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.006569+0000", 2024-09-13T06:39:34.011 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0197000000000001e-05 2024-09-13T06:39:34.011 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:34.011 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.012 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:34.012 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.006587+0000", 2024-09-13T06:39:34.012 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8073000000000001e-05 2024-09-13T06:39:34.012 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:34.012 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.012 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:34.012 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.006596+0000", 2024-09-13T06:39:34.012 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.0000000000000002e-06 2024-09-13T06:39:34.012 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:34.012 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.012 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:34.012 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.008751+0000", 2024-09-13T06:39:34.012 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0021548299999999999 2024-09-13T06:39:34.012 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:34.013 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.013 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:34.013 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.008803+0000", 2024-09-13T06:39:34.013 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.215e-05 2024-09-13T06:39:34.013 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:34.013 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.013 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:39:34.013 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.015329+0000", 2024-09-13T06:39:34.013 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0065259589999999996 2024-09-13T06:39:34.013 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:34.013 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.013 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:34.014 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.015362+0000", 2024-09-13T06:39:34.014 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.2613000000000001e-05 2024-09-13T06:39:34.014 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:34.014 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:34.014 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:34.014 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:34.014 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.014 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4154.0:133 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'91, mlcod=15'85)", 2024-09-13T06:39:34.014 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:12.006919+0000", 2024-09-13T06:39:34.014 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 21.975662894999999, 2024-09-13T06:39:34.014 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0084917580000000003, 2024-09-13T06:39:34.014 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:34.014 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:34.014 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:34.015 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.015 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:34.015 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.006919+0000", 2024-09-13T06:39:34.015 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:34.015 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:34.015 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.015 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:34.015 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.006919+0000", 2024-09-13T06:39:34.015 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:34.015 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:34.015 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.015 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:34.015 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.006918+0000", 2024-09-13T06:39:34.015 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.999999 2024-09-13T06:39:34.015 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:34.016 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.016 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:34.016 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.006926+0000", 2024-09-13T06:39:34.016 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.9929999999999995e-06 2024-09-13T06:39:34.016 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:34.016 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.016 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:34.016 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.006948+0000", 2024-09-13T06:39:34.016 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1593000000000001e-05 2024-09-13T06:39:34.016 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:34.016 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.016 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:34.016 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.006958+0000", 2024-09-13T06:39:34.016 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.029e-05 2024-09-13T06:39:34.017 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:34.017 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.017 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:34.017 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.009740+0000", 2024-09-13T06:39:34.017 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0027821259999999998 2024-09-13T06:39:34.017 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:34.017 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.017 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:34.017 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.009776+0000", 2024-09-13T06:39:34.017 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.5102999999999999e-05 2024-09-13T06:39:34.017 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:34.017 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.017 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:39:34.017 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.015366+0000", 2024-09-13T06:39:34.017 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0055902160000000003 2024-09-13T06:39:34.018 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:34.018 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.018 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:34.018 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.015411+0000", 2024-09-13T06:39:34.018 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5290000000000002e-05 2024-09-13T06:39:34.018 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:34.018 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:34.018 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:34.018 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:34.018 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.018 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4154.0:134 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'92, mlcod=15'85)", 2024-09-13T06:39:34.018 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:12.007373+0000", 2024-09-13T06:39:34.018 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 21.975209547999999, 2024-09-13T06:39:34.018 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.010012544999999999, 2024-09-13T06:39:34.018 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:34.019 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:34.019 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:34.019 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.019 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:34.019 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.007373+0000", 2024-09-13T06:39:34.019 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:34.019 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:34.019 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.019 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:34.019 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.007373+0000", 2024-09-13T06:39:34.019 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:34.019 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:34.019 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.019 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:34.019 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.007372+0000", 2024-09-13T06:39:34.020 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.999999 2024-09-13T06:39:34.020 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:34.020 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.020 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:34.020 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.007421+0000", 2024-09-13T06:39:34.020 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9660000000000002e-05 2024-09-13T06:39:34.020 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:34.020 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.020 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:34.020 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.007435+0000", 2024-09-13T06:39:34.020 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3743e-05 2024-09-13T06:39:34.020 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:34.020 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.020 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:34.020 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.007443+0000", 2024-09-13T06:39:34.021 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.2269999999999993e-06 2024-09-13T06:39:34.021 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:34.021 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.021 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:34.021 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.010303+0000", 2024-09-13T06:39:34.021 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0028596509999999999 2024-09-13T06:39:34.021 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:34.021 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.021 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:34.021 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.010337+0000", 2024-09-13T06:39:34.021 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.4306e-05 2024-09-13T06:39:34.021 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:34.021 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.022 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:39:34.022 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.017329+0000", 2024-09-13T06:39:34.022 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0069915660000000003 2024-09-13T06:39:34.022 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:34.022 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.022 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:34.022 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.017385+0000", 2024-09-13T06:39:34.022 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.6409000000000002e-05 2024-09-13T06:39:34.022 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:34.022 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:34.022 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:34.022 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:34.022 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.022 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4154.0:135 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'93, mlcod=15'85)", 2024-09-13T06:39:34.023 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:12.007816+0000", 2024-09-13T06:39:34.023 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 21.974766018, 2024-09-13T06:39:34.023 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0096068089999999991, 2024-09-13T06:39:34.023 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:34.023 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:34.023 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:34.023 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.023 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:34.023 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.007816+0000", 2024-09-13T06:39:34.023 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:34.023 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:34.023 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.023 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:34.024 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.007816+0000", 2024-09-13T06:39:34.024 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:34.024 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:34.024 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.024 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:34.024 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.007815+0000", 2024-09-13T06:39:34.024 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.999999 2024-09-13T06:39:34.024 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:34.024 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.024 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:34.024 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.007823+0000", 2024-09-13T06:39:34.024 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.8730000000000007e-06 2024-09-13T06:39:34.024 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:34.025 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.025 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:34.025 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.007836+0000", 2024-09-13T06:39:34.025 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2510000000000001e-05 2024-09-13T06:39:34.025 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:34.025 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.025 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:34.025 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.007843+0000", 2024-09-13T06:39:34.025 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5830000000000001e-06 2024-09-13T06:39:34.025 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:34.025 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.025 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:34.025 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.011183+0000", 2024-09-13T06:39:34.026 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0033400539999999999 2024-09-13T06:39:34.026 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:34.026 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.026 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:34.026 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.011217+0000", 2024-09-13T06:39:34.026 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.3355999999999997e-05 2024-09-13T06:39:34.026 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:34.026 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.026 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:39:34.026 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.017391+0000", 2024-09-13T06:39:34.026 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0061736960000000002 2024-09-13T06:39:34.026 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:34.026 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.027 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:34.027 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.017423+0000", 2024-09-13T06:39:34.027 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.2499999999999997e-05 2024-09-13T06:39:34.027 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:34.027 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:34.027 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:34.027 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:34.027 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.027 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4154.0:136 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'94, mlcod=15'85)", 2024-09-13T06:39:34.027 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:12.008176+0000", 2024-09-13T06:39:34.027 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 21.974406104, 2024-09-13T06:39:34.027 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0092805379999999996, 2024-09-13T06:39:34.027 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:34.028 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:34.028 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:34.028 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.028 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:34.028 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.008176+0000", 2024-09-13T06:39:34.028 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:34.028 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:34.028 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.028 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:34.028 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.008176+0000", 2024-09-13T06:39:34.028 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:34.028 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:34.029 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.029 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:34.029 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.008175+0000", 2024-09-13T06:39:34.029 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:39:34.029 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:34.029 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.029 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:34.029 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.008183+0000", 2024-09-13T06:39:34.029 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.1099999999999997e-06 2024-09-13T06:39:34.029 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:34.029 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.029 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:34.030 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.008207+0000", 2024-09-13T06:39:34.030 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4383999999999999e-05 2024-09-13T06:39:34.030 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:34.030 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.030 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:34.030 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.008216+0000", 2024-09-13T06:39:34.030 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.4860000000000003e-06 2024-09-13T06:39:34.030 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:34.030 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.030 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:34.030 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.012139+0000", 2024-09-13T06:39:34.030 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0039226189999999996 2024-09-13T06:39:34.030 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:34.031 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.031 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:34.031 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.012198+0000", 2024-09-13T06:39:34.031 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8489999999999997e-05 2024-09-13T06:39:34.031 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:34.031 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.031 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:39:34.031 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.017427+0000", 2024-09-13T06:39:34.031 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0052297589999999996 2024-09-13T06:39:34.031 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:34.031 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.031 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:34.031 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.017457+0000", 2024-09-13T06:39:34.031 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9357e-05 2024-09-13T06:39:34.032 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:34.032 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:34.032 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:34.032 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:34.032 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.032 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4154.0:137 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'95, mlcod=15'85)", 2024-09-13T06:39:34.032 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:12.008624+0000", 2024-09-13T06:39:34.032 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 21.973958021000001, 2024-09-13T06:39:34.032 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0088653910000000002, 2024-09-13T06:39:34.032 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:34.032 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:34.032 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:34.032 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.033 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:34.033 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.008624+0000", 2024-09-13T06:39:34.033 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:34.033 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:34.033 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.033 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:34.033 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.008624+0000", 2024-09-13T06:39:34.033 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:34.033 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:34.033 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.033 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:34.033 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.008623+0000", 2024-09-13T06:39:34.033 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.999999 2024-09-13T06:39:34.034 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:34.034 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.034 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:34.034 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.008739+0000", 2024-09-13T06:39:34.034 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00011541599999999999 2024-09-13T06:39:34.034 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:34.034 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.034 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:34.034 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.008753+0000", 2024-09-13T06:39:34.034 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4136e-05 2024-09-13T06:39:34.034 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:34.034 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.034 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:34.035 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.008761+0000", 2024-09-13T06:39:34.035 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.9899999999999997e-06 2024-09-13T06:39:34.035 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:34.035 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.035 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:34.035 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.013092+0000", 2024-09-13T06:39:34.035 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0043311540000000003 2024-09-13T06:39:34.035 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:34.035 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.035 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:34.035 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.013131+0000", 2024-09-13T06:39:34.035 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.9266e-05 2024-09-13T06:39:34.035 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:34.036 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.036 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:39:34.036 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.017461+0000", 2024-09-13T06:39:34.036 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0043297700000000001 2024-09-13T06:39:34.036 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:34.036 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.036 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:34.036 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.017490+0000", 2024-09-13T06:39:34.036 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.8699000000000001e-05 2024-09-13T06:39:34.036 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:34.036 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:34.036 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:34.036 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:34.037 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.037 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4154.0:138 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'96, mlcod=15'85)", 2024-09-13T06:39:34.037 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:12.009148+0000", 2024-09-13T06:39:34.037 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 21.973434435000001, 2024-09-13T06:39:34.037 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0083737480000000003, 2024-09-13T06:39:34.037 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:34.037 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:34.037 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:34.037 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.037 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:34.037 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.009148+0000", 2024-09-13T06:39:34.037 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:34.037 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:34.038 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.038 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:34.038 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.009148+0000", 2024-09-13T06:39:34.038 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:34.038 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:34.038 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.038 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:34.038 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.009146+0000", 2024-09-13T06:39:34.038 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999981 2024-09-13T06:39:34.038 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:34.038 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.038 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:34.038 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.009160+0000", 2024-09-13T06:39:34.038 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3706000000000001e-05 2024-09-13T06:39:34.039 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:34.039 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.039 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:34.039 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.009221+0000", 2024-09-13T06:39:34.039 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.1532999999999995e-05 2024-09-13T06:39:34.039 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:34.039 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.039 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:34.039 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.009240+0000", 2024-09-13T06:39:34.039 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8300000000000001e-05 2024-09-13T06:39:34.039 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:34.039 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.039 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:34.040 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.014388+0000", 2024-09-13T06:39:34.040 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0051483299999999996 2024-09-13T06:39:34.040 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:34.040 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.040 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:34.040 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.014439+0000", 2024-09-13T06:39:34.040 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0618999999999998e-05 2024-09-13T06:39:34.040 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:34.040 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.040 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:39:34.040 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.017497+0000", 2024-09-13T06:39:34.040 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0030583899999999998 2024-09-13T06:39:34.040 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:34.040 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.041 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:34.041 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.017522+0000", 2024-09-13T06:39:34.041 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4613e-05 2024-09-13T06:39:34.041 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:34.041 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:34.041 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:34.041 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:34.041 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.041 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4154.0:139 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'97, mlcod=15'85)", 2024-09-13T06:39:34.041 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:12.009507+0000", 2024-09-13T06:39:34.041 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 21.973075103999999, 2024-09-13T06:39:34.041 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.008043204, 2024-09-13T06:39:34.041 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:34.042 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:34.042 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:34.042 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.042 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:34.042 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.009507+0000", 2024-09-13T06:39:34.042 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:34.042 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:34.042 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.042 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:34.042 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.009507+0000", 2024-09-13T06:39:34.042 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:34.042 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:34.042 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.042 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:34.043 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.009506+0000", 2024-09-13T06:39:34.043 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.999999 2024-09-13T06:39:34.043 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:34.043 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.043 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:34.043 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.009516+0000", 2024-09-13T06:39:34.043 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.91e-06 2024-09-13T06:39:34.043 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:34.043 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.043 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:34.043 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.009530+0000", 2024-09-13T06:39:34.043 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4406999999999999e-05 2024-09-13T06:39:34.043 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:34.044 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.044 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:34.044 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.009542+0000", 2024-09-13T06:39:34.044 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1549000000000001e-05 2024-09-13T06:39:34.044 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:34.044 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.044 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:34.044 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.015501+0000", 2024-09-13T06:39:34.044 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0059592409999999997 2024-09-13T06:39:34.044 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:34.044 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.044 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:34.045 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.015558+0000", 2024-09-13T06:39:34.045 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.6496000000000003e-05 2024-09-13T06:39:34.045 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:34.045 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.045 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:39:34.045 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.017526+0000", 2024-09-13T06:39:34.045 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0019678249999999999 2024-09-13T06:39:34.045 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:34.045 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.045 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:34.045 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.017550+0000", 2024-09-13T06:39:34.045 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4769999999999998e-05 2024-09-13T06:39:34.045 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:34.046 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:34.046 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:34.046 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:34.046 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.046 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4154.0:140 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'98, mlcod=15'85)", 2024-09-13T06:39:34.046 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:12.009917+0000", 2024-09-13T06:39:34.046 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 21.972665134, 2024-09-13T06:39:34.046 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0085122300000000008, 2024-09-13T06:39:34.046 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:34.046 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:34.046 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:34.046 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.046 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:34.047 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.009917+0000", 2024-09-13T06:39:34.047 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:34.047 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:34.047 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.047 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:34.047 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.009917+0000", 2024-09-13T06:39:34.047 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:34.047 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:34.047 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.047 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:34.047 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.009916+0000", 2024-09-13T06:39:34.047 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.999999 2024-09-13T06:39:34.047 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:34.048 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.048 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:34.048 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.010084+0000", 2024-09-13T06:39:34.048 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000168419 2024-09-13T06:39:34.048 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:34.048 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.048 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:34.048 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.010112+0000", 2024-09-13T06:39:34.048 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.7773e-05 2024-09-13T06:39:34.048 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:34.048 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.048 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:34.048 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.010128+0000", 2024-09-13T06:39:34.049 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.605e-05 2024-09-13T06:39:34.049 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:34.049 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.049 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:34.049 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.016320+0000", 2024-09-13T06:39:34.049 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0061919690000000003 2024-09-13T06:39:34.049 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:34.049 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.049 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:34.049 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.016349+0000", 2024-09-13T06:39:34.049 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.8629e-05 2024-09-13T06:39:34.049 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:34.049 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.050 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:39:34.050 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.018351+0000", 2024-09-13T06:39:34.050 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.002001985 2024-09-13T06:39:34.050 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:34.050 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.050 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:34.050 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.018429+0000", 2024-09-13T06:39:34.050 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.8589000000000003e-05 2024-09-13T06:39:34.050 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:34.050 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:34.050 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:34.050 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:34.050 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.051 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4154.0:141 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'99, mlcod=15'85)", 2024-09-13T06:39:34.051 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:12.010422+0000", 2024-09-13T06:39:34.051 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 21.972159831999999, 2024-09-13T06:39:34.051 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0086202829999999994, 2024-09-13T06:39:34.051 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:34.051 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:34.051 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:34.051 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.051 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:34.051 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.010422+0000", 2024-09-13T06:39:34.051 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:34.051 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:34.051 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.051 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:34.052 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.010422+0000", 2024-09-13T06:39:34.052 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:34.052 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:34.052 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.052 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:34.052 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.010421+0000", 2024-09-13T06:39:34.052 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999986 2024-09-13T06:39:34.052 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:34.052 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.052 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:34.052 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.010434+0000", 2024-09-13T06:39:34.053 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2840000000000001e-05 2024-09-13T06:39:34.053 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:34.053 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.053 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:34.053 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.010457+0000", 2024-09-13T06:39:34.053 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3543000000000001e-05 2024-09-13T06:39:34.053 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:34.053 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.053 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:34.053 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.010474+0000", 2024-09-13T06:39:34.053 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6804e-05 2024-09-13T06:39:34.053 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:34.053 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.053 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:34.054 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.017610+0000", 2024-09-13T06:39:34.054 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0071355710000000003 2024-09-13T06:39:34.054 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:34.054 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.054 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:34.054 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.017663+0000", 2024-09-13T06:39:34.054 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3593e-05 2024-09-13T06:39:34.054 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:34.054 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.054 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:39:34.054 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.018991+0000", 2024-09-13T06:39:34.054 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00132777 2024-09-13T06:39:34.054 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:34.054 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.055 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:34.055 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.019043+0000", 2024-09-13T06:39:34.055 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.1431999999999998e-05 2024-09-13T06:39:34.055 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:34.055 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:34.055 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:34.055 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:34.055 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.055 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:11 3.1f 3:fa654f18:::rbd_id.image_client.0:head [create,call rbd.set_id in=9b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-09-13T06:39:34.055 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:29.377720+0000", 2024-09-13T06:39:34.055 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 4.6048619190000002, 2024-09-13T06:39:34.055 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0087536650000000008, 2024-09-13T06:39:34.055 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:34.056 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:34.056 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:39:34.056 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:39:34.056 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:34.056 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 11 2024-09-13T06:39:34.056 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:34.056 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:34.056 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.056 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:34.056 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:29.377720+0000", 2024-09-13T06:39:34.056 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:34.056 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:34.056 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.057 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:34.057 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:29.377720+0000", 2024-09-13T06:39:34.057 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:34.057 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:34.057 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.057 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:34.057 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:29.377718+0000", 2024-09-13T06:39:34.057 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999981 2024-09-13T06:39:34.057 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:34.057 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.057 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:34.057 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:29.377731+0000", 2024-09-13T06:39:34.057 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2507000000000001e-05 2024-09-13T06:39:34.057 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:34.058 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.058 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:34.058 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:29.377751+0000", 2024-09-13T06:39:34.058 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0716999999999998e-05 2024-09-13T06:39:34.058 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:34.058 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.058 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:34.058 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:29.377764+0000", 2024-09-13T06:39:34.058 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2378000000000001e-05 2024-09-13T06:39:34.058 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:34.058 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.058 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:34.058 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:29.377842+0000", 2024-09-13T06:39:34.058 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.7687000000000003e-05 2024-09-13T06:39:34.058 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:34.059 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.059 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op must wait for map", 2024-09-13T06:39:34.059 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:29.377850+0000", 2024-09-13T06:39:34.059 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.7029999999999995e-06 2024-09-13T06:39:34.059 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:34.059 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.059 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:34.059 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:29.380699+0000", 2024-09-13T06:39:34.059 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0028488099999999998 2024-09-13T06:39:34.059 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:34.059 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.059 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:34.059 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:29.380901+0000", 2024-09-13T06:39:34.059 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000202067 2024-09-13T06:39:34.060 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:34.060 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.060 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 5", 2024-09-13T06:39:34.060 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:29.381223+0000", 2024-09-13T06:39:34.060 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00032151199999999998 2024-09-13T06:39:34.060 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:34.060 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.060 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:39:34.060 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:29.382479+0000", 2024-09-13T06:39:34.060 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00125636 2024-09-13T06:39:34.060 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:34.060 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.060 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-09-13T06:39:34.061 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:29.386337+0000", 2024-09-13T06:39:34.061 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0038575739999999999 2024-09-13T06:39:34.061 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:34.061 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.061 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:39:34.061 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:29.386408+0000", 2024-09-13T06:39:34.061 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.1019000000000006e-05 2024-09-13T06:39:34.061 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:34.061 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.061 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:34.061 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:29.386474+0000", 2024-09-13T06:39:34.061 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.6407000000000003e-05 2024-09-13T06:39:34.061 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:34.062 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:34.062 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:34.062 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:34.062 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.062 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:437 3.12 3:4f94b9f1:::rbd_data.112173e2f1b7.000000000000001a:4 [sparse-read 786432~0 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e26)", 2024-09-13T06:39:34.062 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:33.431568+0000", 2024-09-13T06:39:34.062 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.55101467400000004, 2024-09-13T06:39:34.062 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.005261206, 2024-09-13T06:39:34.062 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:34.062 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:39:34.062 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:39:34.062 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:39:34.062 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:34.063 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 437 2024-09-13T06:39:34.063 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:34.063 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:34.063 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.063 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:34.063 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:33.431568+0000", 2024-09-13T06:39:34.063 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:34.063 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:34.063 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.063 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:34.063 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:33.431568+0000", 2024-09-13T06:39:34.063 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:34.063 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:34.063 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.064 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:34.064 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:33.431566+0000", 2024-09-13T06:39:34.064 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999986 2024-09-13T06:39:34.064 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:34.064 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.064 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:34.064 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:33.431574+0000", 2024-09-13T06:39:34.064 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.4370000000000007e-06 2024-09-13T06:39:34.064 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:34.064 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.064 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:34.064 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:33.431593+0000", 2024-09-13T06:39:34.064 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8589000000000001e-05 2024-09-13T06:39:34.065 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:34.065 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.065 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:34.065 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:33.431602+0000", 2024-09-13T06:39:34.065 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.1169999999999993e-06 2024-09-13T06:39:34.065 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:34.065 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.065 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:34.065 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:33.436247+0000", 2024-09-13T06:39:34.065 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.004645293 2024-09-13T06:39:34.065 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:34.065 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.065 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:34.066 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:33.436520+0000", 2024-09-13T06:39:34.066 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00027259499999999999 2024-09-13T06:39:34.066 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:34.066 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.066 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:34.066 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:33.436829+0000", 2024-09-13T06:39:34.066 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00030866800000000001 2024-09-13T06:39:34.066 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:34.066 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:34.066 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:34.066 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:34.066 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.067 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:438 3.12 3:4f94b9f1:::rbd_data.112173e2f1b7.000000000000001a:4 [sparse-read 2097152~0 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e26)", 2024-09-13T06:39:34.067 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:33.431610+0000", 2024-09-13T06:39:34.067 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.55097218800000003, 2024-09-13T06:39:34.067 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0058411380000000001, 2024-09-13T06:39:34.067 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:34.067 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:39:34.067 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:39:34.067 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:39:34.067 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:34.067 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 438 2024-09-13T06:39:34.067 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:34.067 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:34.068 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.068 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:34.068 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:33.431610+0000", 2024-09-13T06:39:34.068 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:34.068 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:34.068 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.068 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:34.068 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:33.431610+0000", 2024-09-13T06:39:34.068 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:34.068 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:34.068 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.068 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:34.068 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:33.431609+0000", 2024-09-13T06:39:34.069 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:39:34.069 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:34.069 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.069 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:34.069 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:33.431613+0000", 2024-09-13T06:39:34.069 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.7900000000000001e-06 2024-09-13T06:39:34.069 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:34.069 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.069 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:34.069 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:33.431622+0000", 2024-09-13T06:39:34.069 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.5569999999999996e-06 2024-09-13T06:39:34.069 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:34.069 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.069 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:34.070 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:33.431630+0000", 2024-09-13T06:39:34.070 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.7830000000000004e-06 2024-09-13T06:39:34.070 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:34.070 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.070 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:34.070 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:33.436914+0000", 2024-09-13T06:39:34.070 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0052835360000000001 2024-09-13T06:39:34.070 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:34.070 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.070 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:34.070 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:33.437155+0000", 2024-09-13T06:39:34.070 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00024069799999999999 2024-09-13T06:39:34.070 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:34.071 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.071 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:34.071 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:33.437451+0000", 2024-09-13T06:39:34.071 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00029643399999999999 2024-09-13T06:39:34.071 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:34.071 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:34.071 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:34.071 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:34.071 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.071 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:439 3.12 3:4f94b9f1:::rbd_data.112173e2f1b7.000000000000001a:4 [sparse-read 3407872~56768 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e26)", 2024-09-13T06:39:34.071 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:33.431637+0000", 2024-09-13T06:39:34.071 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.55094514500000002, 2024-09-13T06:39:34.071 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0067283320000000001, 2024-09-13T06:39:34.071 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:34.072 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:39:34.072 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:39:34.072 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:39:34.072 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:34.072 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 439 2024-09-13T06:39:34.072 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:34.072 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:34.072 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.072 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:34.072 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:33.431637+0000", 2024-09-13T06:39:34.072 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:34.072 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:34.073 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.073 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:34.073 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:33.431637+0000", 2024-09-13T06:39:34.073 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:34.073 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:34.073 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.073 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:34.073 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:33.431636+0000", 2024-09-13T06:39:34.073 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:39:34.073 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:34.073 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.073 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:34.073 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:33.431640+0000", 2024-09-13T06:39:34.074 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.1429999999999998e-06 2024-09-13T06:39:34.074 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:34.074 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.074 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:34.074 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:33.431648+0000", 2024-09-13T06:39:34.074 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.4600000000000003e-06 2024-09-13T06:39:34.074 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:34.074 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.074 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:34.074 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:33.431657+0000", 2024-09-13T06:39:34.074 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.6200000000000005e-06 2024-09-13T06:39:34.074 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:34.074 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.075 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:34.075 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:33.437518+0000", 2024-09-13T06:39:34.075 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0058614050000000001 2024-09-13T06:39:34.075 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:34.075 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.075 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:34.075 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:33.437654+0000", 2024-09-13T06:39:34.075 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000136062 2024-09-13T06:39:34.075 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:34.075 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.075 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:34.075 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:33.438365+0000", 2024-09-13T06:39:34.075 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000711245 2024-09-13T06:39:34.076 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:34.076 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:34.076 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:34.076 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:34.076 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:34.076 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:39:34.077 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:39:33.983+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:39:34.078 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-13T06:39:34.119 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:39:34.123+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:39:34.183 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:39:34.182+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:39:34.245 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:39:34.245 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-13T06:39:34.245 INFO:teuthology.orchestra.run.smithi081.stdout: "num_ops": 0 2024-09-13T06:39:34.245 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:39:34.259 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-13T06:39:34.283 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:39:34.286+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:39:34.377 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:39:34.377 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-13T06:39:34.377 INFO:teuthology.orchestra.run.smithi081.stdout: "complaint_time": 30, 2024-09-13T06:39:34.378 INFO:teuthology.orchestra.run.smithi081.stdout: "num_blocked_ops": 0 2024-09-13T06:39:34.378 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:39:34.384 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:39:34.386+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:39:34.391 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-13T06:39:34.415 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-13T06:39:34.485 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:39:34.487+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:39:34.533 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:39:34.533 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 20, 2024-09-13T06:39:34.533 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 600, 2024-09-13T06:39:34.534 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [ 2024-09-13T06:39:34.534 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.534 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4217.0:5 2.2 e19/17 2:5cea7035:::rbd_info:head v 19'1, mlcod=0'0)", 2024-09-13T06:39:34.534 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:18.555970+0000", 2024-09-13T06:39:34.534 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 15.982011397000001, 2024-09-13T06:39:34.534 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0019658549999999999, 2024-09-13T06:39:34.534 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:34.534 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:34.534 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:34.534 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.534 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:34.534 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:18.555970+0000", 2024-09-13T06:39:34.534 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:34.535 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:34.535 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.535 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:34.535 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:18.555970+0000", 2024-09-13T06:39:34.535 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:34.535 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:34.535 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.535 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:34.535 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:18.555969+0000", 2024-09-13T06:39:34.535 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:39:34.535 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:34.535 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.535 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:34.536 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:18.555986+0000", 2024-09-13T06:39:34.536 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6135999999999999e-05 2024-09-13T06:39:34.536 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:34.536 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.536 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:34.536 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:18.556022+0000", 2024-09-13T06:39:34.536 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.6032999999999999e-05 2024-09-13T06:39:34.536 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:34.536 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.536 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:34.536 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:18.556049+0000", 2024-09-13T06:39:34.536 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.7019999999999999e-05 2024-09-13T06:39:34.537 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:34.537 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.537 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:34.537 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:18.556178+0000", 2024-09-13T06:39:34.537 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00012947499999999999 2024-09-13T06:39:34.537 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:34.537 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.537 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:34.537 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:18.556228+0000", 2024-09-13T06:39:34.537 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0034000000000002e-05 2024-09-13T06:39:34.537 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:34.537 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.537 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:39:34.538 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:18.557841+0000", 2024-09-13T06:39:34.538 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0016127170000000001 2024-09-13T06:39:34.538 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:34.538 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.538 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:34.538 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:18.557936+0000", 2024-09-13T06:39:34.538 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.4995999999999996e-05 2024-09-13T06:39:34.538 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:34.538 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:34.538 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:34.538 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:34.538 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.538 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4217.0:7 2.2 e20/17 2:5cea7035:::rbd_info:head v 20'2, mlcod=0'0)", 2024-09-13T06:39:34.538 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:19.563171+0000", 2024-09-13T06:39:34.539 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 14.974810127, 2024-09-13T06:39:34.539 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0016863799999999999, 2024-09-13T06:39:34.539 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:34.539 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:34.539 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:34.539 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.539 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:34.539 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:19.563171+0000", 2024-09-13T06:39:34.539 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:34.539 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:34.539 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.539 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:34.539 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:19.563171+0000", 2024-09-13T06:39:34.540 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:34.540 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:34.540 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.540 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:34.540 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:19.563171+0000", 2024-09-13T06:39:34.540 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:39:34.540 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:34.540 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.540 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:34.540 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:19.563183+0000", 2024-09-13T06:39:34.540 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2663000000000001e-05 2024-09-13T06:39:34.540 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:34.540 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.541 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:34.541 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:19.563242+0000", 2024-09-13T06:39:34.541 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9129999999999998e-05 2024-09-13T06:39:34.541 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:34.541 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.541 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:34.541 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:19.563264+0000", 2024-09-13T06:39:34.541 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.124e-05 2024-09-13T06:39:34.541 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:34.541 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.541 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:34.541 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:19.563376+0000", 2024-09-13T06:39:34.542 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000112293 2024-09-13T06:39:34.542 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:34.542 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.542 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:34.542 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:19.563418+0000", 2024-09-13T06:39:34.542 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.2388999999999997e-05 2024-09-13T06:39:34.542 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:34.542 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.542 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:39:34.542 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:19.564754+0000", 2024-09-13T06:39:34.542 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0013353099999999999 2024-09-13T06:39:34.542 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:34.542 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.543 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:34.543 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:19.564858+0000", 2024-09-13T06:39:34.543 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00010406199999999999 2024-09-13T06:39:34.543 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:34.543 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:34.543 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:34.543 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:34.543 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.543 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4385.0:7 3.1a e23/21 3:5cea7035:::rbd_info:head v 23'1, mlcod=0'0)", 2024-09-13T06:39:34.543 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:28.361229+0000", 2024-09-13T06:39:34.543 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 6.1767528179999998, 2024-09-13T06:39:34.543 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0015838639999999999, 2024-09-13T06:39:34.544 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:34.544 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:34.544 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:34.544 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.544 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:34.544 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:28.361229+0000", 2024-09-13T06:39:34.544 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:34.544 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:34.544 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.544 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:34.544 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:28.361229+0000", 2024-09-13T06:39:34.544 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:34.544 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:34.545 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.545 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:34.545 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:28.361228+0000", 2024-09-13T06:39:34.545 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:39:34.545 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:34.545 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.545 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:34.545 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:28.361237+0000", 2024-09-13T06:39:34.545 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.9600000000000006e-06 2024-09-13T06:39:34.545 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:34.545 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.545 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:34.545 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:28.361265+0000", 2024-09-13T06:39:34.546 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.7993000000000001e-05 2024-09-13T06:39:34.546 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:34.546 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.546 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:34.546 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:28.361288+0000", 2024-09-13T06:39:34.546 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2670000000000001e-05 2024-09-13T06:39:34.546 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:34.546 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.546 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:34.546 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:28.361391+0000", 2024-09-13T06:39:34.546 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000102939 2024-09-13T06:39:34.546 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:34.546 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.546 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:34.547 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:28.361426+0000", 2024-09-13T06:39:34.547 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.4876999999999998e-05 2024-09-13T06:39:34.547 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:34.547 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.547 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:39:34.547 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:28.362731+0000", 2024-09-13T06:39:34.547 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0013053260000000001 2024-09-13T06:39:34.547 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:34.547 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.547 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:34.547 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:28.362812+0000", 2024-09-13T06:39:34.547 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.1602999999999998e-05 2024-09-13T06:39:34.547 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:34.548 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:34.548 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:34.548 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:34.548 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.548 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4385.0:9 3.1a e24/21 3:5cea7035:::rbd_info:head v 24'2, mlcod=0'0)", 2024-09-13T06:39:34.548 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:29.373061+0000", 2024-09-13T06:39:34.548 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 5.1649200180000001, 2024-09-13T06:39:34.548 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0017979560000000001, 2024-09-13T06:39:34.548 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:34.548 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:34.548 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:34.548 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.549 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:34.549 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:29.373061+0000", 2024-09-13T06:39:34.549 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:34.549 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:34.549 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.549 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:34.549 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:29.373061+0000", 2024-09-13T06:39:34.549 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:34.549 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:34.549 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.549 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:34.549 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:29.373061+0000", 2024-09-13T06:39:34.549 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:39:34.550 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:34.550 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.550 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:34.550 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:29.373069+0000", 2024-09-13T06:39:34.550 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.2150000000000001e-06 2024-09-13T06:39:34.550 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:34.550 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.550 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:34.550 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:29.373091+0000", 2024-09-13T06:39:34.550 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1753e-05 2024-09-13T06:39:34.550 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:34.550 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.550 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:34.551 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:29.373103+0000", 2024-09-13T06:39:34.551 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2336e-05 2024-09-13T06:39:34.551 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:34.551 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.551 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:34.551 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:29.373169+0000", 2024-09-13T06:39:34.551 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.5760999999999996e-05 2024-09-13T06:39:34.551 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:34.551 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.551 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:34.551 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:29.373195+0000", 2024-09-13T06:39:34.551 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5901000000000002e-05 2024-09-13T06:39:34.551 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:34.552 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.552 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:39:34.552 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:29.374801+0000", 2024-09-13T06:39:34.552 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0016063049999999999 2024-09-13T06:39:34.552 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:34.552 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.552 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:34.552 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:29.374859+0000", 2024-09-13T06:39:34.552 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8118000000000002e-05 2024-09-13T06:39:34.552 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:34.552 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:34.552 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:34.553 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:34.553 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.553 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:385 3.0 3:07257432:::rbd_data.112173e2f1b7.000000000000001d:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e26)", 2024-09-13T06:39:34.553 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:33.424746+0000", 2024-09-13T06:39:34.553 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 1.113235234, 2024-09-13T06:39:34.553 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.005218004, 2024-09-13T06:39:34.553 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:34.553 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:39:34.553 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:39:34.553 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:39:34.553 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:34.553 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 385 2024-09-13T06:39:34.553 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:34.554 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:34.554 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.554 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:34.554 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:33.424746+0000", 2024-09-13T06:39:34.554 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:34.554 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:34.554 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.554 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:34.554 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:33.424746+0000", 2024-09-13T06:39:34.554 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:34.554 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:34.554 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.554 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:34.555 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:33.424742+0000", 2024-09-13T06:39:34.555 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999962 2024-09-13T06:39:34.555 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:34.555 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.555 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:34.555 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:33.424763+0000", 2024-09-13T06:39:34.555 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0526e-05 2024-09-13T06:39:34.555 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:34.555 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.555 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:34.555 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:33.424818+0000", 2024-09-13T06:39:34.555 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.5506e-05 2024-09-13T06:39:34.555 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:34.555 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.556 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:34.556 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:33.424848+0000", 2024-09-13T06:39:34.556 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9427000000000001e-05 2024-09-13T06:39:34.556 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:34.556 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.556 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:34.556 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:33.425016+0000", 2024-09-13T06:39:34.556 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000168565 2024-09-13T06:39:34.556 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:34.556 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.556 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op must wait for map", 2024-09-13T06:39:34.556 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:33.425034+0000", 2024-09-13T06:39:34.557 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8099999999999999e-05 2024-09-13T06:39:34.557 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:34.557 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.557 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:34.557 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:33.429710+0000", 2024-09-13T06:39:34.557 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.004675841 2024-09-13T06:39:34.557 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:34.557 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.557 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:34.557 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:33.429964+0000", 2024-09-13T06:39:34.557 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00025389500000000002 2024-09-13T06:39:34.557 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:34.557 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:34.558 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:34.558 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:34.558 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.558 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:395 3.0 3:07257432:::rbd_data.112173e2f1b7.000000000000001d:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e26)", 2024-09-13T06:39:34.558 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:33.425757+0000", 2024-09-13T06:39:34.558 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 1.112224485, 2024-09-13T06:39:34.558 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.004472419, 2024-09-13T06:39:34.558 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:34.558 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:39:34.558 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:39:34.558 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:39:34.558 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:34.558 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 395 2024-09-13T06:39:34.558 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:34.559 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:34.559 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.559 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:34.559 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:33.425757+0000", 2024-09-13T06:39:34.559 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:34.559 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:34.559 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.559 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:34.559 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:33.425757+0000", 2024-09-13T06:39:34.559 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:34.559 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:34.559 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.559 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:34.560 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:33.425754+0000", 2024-09-13T06:39:34.560 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999971 2024-09-13T06:39:34.560 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:34.560 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.560 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:34.560 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:33.425771+0000", 2024-09-13T06:39:34.560 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7169000000000001e-05 2024-09-13T06:39:34.560 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:34.560 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.560 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:34.560 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:33.425813+0000", 2024-09-13T06:39:34.560 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.1597000000000002e-05 2024-09-13T06:39:34.560 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:34.560 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.561 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:34.561 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:33.425842+0000", 2024-09-13T06:39:34.561 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9427000000000001e-05 2024-09-13T06:39:34.561 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:34.561 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.561 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:34.561 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:33.425960+0000", 2024-09-13T06:39:34.561 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000117909 2024-09-13T06:39:34.561 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:34.561 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.561 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting_for_map not empty", 2024-09-13T06:39:34.561 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:33.425975+0000", 2024-09-13T06:39:34.561 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4902999999999999e-05 2024-09-13T06:39:34.562 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:34.562 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.562 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:34.562 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:33.430004+0000", 2024-09-13T06:39:34.562 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0040290689999999997 2024-09-13T06:39:34.562 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:34.562 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.562 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:34.562 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:33.430229+0000", 2024-09-13T06:39:34.562 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00022520099999999999 2024-09-13T06:39:34.562 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:34.562 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:34.562 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:34.562 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:34.563 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.563 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:405 3.0 3:07257432:::rbd_data.112173e2f1b7.000000000000001d:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e26)", 2024-09-13T06:39:34.563 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:33.426707+0000", 2024-09-13T06:39:34.563 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 1.1112744189999999, 2024-09-13T06:39:34.563 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0038827139999999998, 2024-09-13T06:39:34.563 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:34.563 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:39:34.563 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:39:34.563 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:39:34.563 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:34.563 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 405 2024-09-13T06:39:34.563 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:34.563 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:34.564 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.564 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:34.564 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:33.426707+0000", 2024-09-13T06:39:34.564 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:34.564 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:34.564 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.564 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:34.564 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:33.426707+0000", 2024-09-13T06:39:34.564 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:34.564 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:34.564 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.564 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:34.564 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:33.426704+0000", 2024-09-13T06:39:34.565 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999967 2024-09-13T06:39:34.565 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:34.565 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.565 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:34.565 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:33.426722+0000", 2024-09-13T06:39:34.565 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8377e-05 2024-09-13T06:39:34.565 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:34.565 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.565 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:34.565 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:33.426759+0000", 2024-09-13T06:39:34.565 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.6789999999999998e-05 2024-09-13T06:39:34.565 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:34.565 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.566 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:34.566 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:33.426781+0000", 2024-09-13T06:39:34.566 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2563000000000001e-05 2024-09-13T06:39:34.566 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:34.566 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.566 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:34.566 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:33.426902+0000", 2024-09-13T06:39:34.566 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00012110199999999999 2024-09-13T06:39:34.566 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:34.566 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.566 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting_for_map not empty", 2024-09-13T06:39:34.566 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:33.426928+0000", 2024-09-13T06:39:34.566 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5803e-05 2024-09-13T06:39:34.566 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:34.566 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.567 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:34.567 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:33.430319+0000", 2024-09-13T06:39:34.567 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0033910070000000001 2024-09-13T06:39:34.567 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:34.567 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.567 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:34.567 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:33.430590+0000", 2024-09-13T06:39:34.567 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000270485 2024-09-13T06:39:34.567 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:34.567 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:34.567 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:34.567 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:34.567 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.568 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:415 3.0 3:07257432:::rbd_data.112173e2f1b7.000000000000001d:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e26)", 2024-09-13T06:39:34.568 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:33.427072+0000", 2024-09-13T06:39:34.568 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 1.1109096110000001, 2024-09-13T06:39:34.568 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0038082739999999999, 2024-09-13T06:39:34.568 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:34.568 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:39:34.568 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:39:34.568 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:39:34.568 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:34.568 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 415 2024-09-13T06:39:34.568 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:34.568 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:34.568 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.569 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:34.569 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:33.427072+0000", 2024-09-13T06:39:34.569 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:34.569 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:34.569 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.569 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:34.569 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:33.427072+0000", 2024-09-13T06:39:34.569 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:34.569 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:34.569 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.569 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:34.569 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:33.427070+0000", 2024-09-13T06:39:34.569 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999981 2024-09-13T06:39:34.569 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:34.570 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.570 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:34.570 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:33.427083+0000", 2024-09-13T06:39:34.570 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3463e-05 2024-09-13T06:39:34.570 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:34.570 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.570 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:34.570 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:33.427111+0000", 2024-09-13T06:39:34.570 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.7606999999999998e-05 2024-09-13T06:39:34.570 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:34.570 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.570 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:34.570 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:33.427131+0000", 2024-09-13T06:39:34.570 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9979999999999998e-05 2024-09-13T06:39:34.571 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:34.571 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.571 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:34.571 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:33.427259+0000", 2024-09-13T06:39:34.571 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00012844199999999999 2024-09-13T06:39:34.571 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:34.571 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.571 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting_for_map not empty", 2024-09-13T06:39:34.571 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:33.427273+0000", 2024-09-13T06:39:34.571 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4334e-05 2024-09-13T06:39:34.571 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:34.571 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.571 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:34.572 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:33.430693+0000", 2024-09-13T06:39:34.572 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0034190370000000002 2024-09-13T06:39:34.572 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:34.572 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.572 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:34.572 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:33.430880+0000", 2024-09-13T06:39:34.572 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00018754500000000001 2024-09-13T06:39:34.572 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:34.572 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:34.572 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:34.572 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:34.572 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.572 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:425 3.0 3:07257432:::rbd_data.112173e2f1b7.000000000000001d:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e26)", 2024-09-13T06:39:34.573 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:33.427852+0000", 2024-09-13T06:39:34.573 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 1.110129444, 2024-09-13T06:39:34.573 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0033210449999999999, 2024-09-13T06:39:34.573 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:34.573 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:39:34.573 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:39:34.573 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:39:34.573 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:34.573 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 425 2024-09-13T06:39:34.573 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:34.573 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:34.573 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.573 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:34.574 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:33.427852+0000", 2024-09-13T06:39:34.574 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:34.574 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:34.574 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.574 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:34.574 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:33.427852+0000", 2024-09-13T06:39:34.574 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:34.574 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:34.574 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.574 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:34.574 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:33.427850+0000", 2024-09-13T06:39:34.574 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999981 2024-09-13T06:39:34.574 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:34.575 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.575 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:34.575 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:33.427864+0000", 2024-09-13T06:39:34.575 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4243000000000001e-05 2024-09-13T06:39:34.575 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:34.575 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.575 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:34.575 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:33.427895+0000", 2024-09-13T06:39:34.575 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.0580000000000002e-05 2024-09-13T06:39:34.575 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:34.575 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.575 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:34.575 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:33.427920+0000", 2024-09-13T06:39:34.576 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5792999999999999e-05 2024-09-13T06:39:34.576 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:34.576 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.576 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:34.576 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:33.428043+0000", 2024-09-13T06:39:34.576 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00012276600000000001 2024-09-13T06:39:34.576 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:34.576 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.576 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting_for_map not empty", 2024-09-13T06:39:34.576 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:33.428056+0000", 2024-09-13T06:39:34.576 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3186999999999999e-05 2024-09-13T06:39:34.576 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:34.576 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.576 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:34.577 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:33.430938+0000", 2024-09-13T06:39:34.577 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.002882024 2024-09-13T06:39:34.577 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:34.577 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.577 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:34.577 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:33.431173+0000", 2024-09-13T06:39:34.577 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000234522 2024-09-13T06:39:34.577 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:34.577 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:34.577 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:34.577 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:34.577 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:34.577 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:39:34.578 INFO:teuthology.orchestra.run.smithi081.stdout:93 punch from 0x34640a2 to 0x3473ed8, (0xfe36 bytes) 2024-09-13T06:39:34.578 INFO:teuthology.orchestra.run.smithi081.stdout:94 write 0x47e6f12 thru 0x47f15b5 (0xa6a4 bytes) 2024-09-13T06:39:34.579 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-13T06:39:34.580 INFO:teuthology.orchestra.run.smithi081.stdout:97 punch from 0x7d214c to 0x7d8b7f, (0x6a33 bytes) 2024-09-13T06:39:34.580 INFO:teuthology.orchestra.run.smithi081.stdout:99 write 0xd258557 thru 0xd259af0 (0x159a bytes) 2024-09-13T06:39:34.581 INFO:teuthology.orchestra.run.smithi081.stdout:101 read 0x9459376 thru 0x945f9d7 (0x6662 bytes) 2024-09-13T06:39:34.598 INFO:teuthology.orchestra.run.smithi081.stdout:102 trunc from 0xd259af1 to 0xdb2225 2024-09-13T06:39:34.599 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:39:34.603+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:39:34.628 INFO:teuthology.orchestra.run.smithi081.stdout:truncating to largest ever: 0xed518b5 2024-09-13T06:39:34.646 INFO:teuthology.orchestra.run.smithi081.stdout:104 trunc from 0xdb2225 to 0xed518b5 2024-09-13T06:39:34.680 INFO:teuthology.orchestra.run.smithi081.stdout:105 trunc from 0xed518b5 to 0x1beb387 2024-09-13T06:39:34.687 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:39:34.691+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:39:34.706 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:39:34.706 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-13T06:39:34.706 INFO:teuthology.orchestra.run.smithi081.stdout: "num_ops": 0 2024-09-13T06:39:34.706 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:39:34.723 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-13T06:39:34.723 INFO:teuthology.orchestra.run.smithi081.stdout:106 write 0xcc0abe8 thru 0xcc19820 (0xec39 bytes) 2024-09-13T06:39:34.731 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:39:34.731 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:39:34.745 INFO:teuthology.orchestra.run.smithi081.stdout:110 write 0xe5d261c thru 0xe5dc42d (0x9e12 bytes) 2024-09-13T06:39:34.752 INFO:teuthology.orchestra.run.smithi081.stdout:111 write 0x3b86139 thru 0x3b86fc5 (0xe8d bytes) 2024-09-13T06:39:34.759 INFO:teuthology.orchestra.run.smithi081.stdout:112 read 0x2c90bde thru 0x2c9b3ed (0xa810 bytes) 2024-09-13T06:39:34.760 INFO:teuthology.orchestra.run.smithi081.stdout:113 write 0x33e084a thru 0x33ecda8 (0xc55f bytes) 2024-09-13T06:39:34.768 INFO:teuthology.orchestra.run.smithi081.stdout:115 write 0xcfe067 thru 0xcff39b (0x1335 bytes) 2024-09-13T06:39:34.775 INFO:teuthology.orchestra.run.smithi081.stdout:117 read 0x942e25b thru 0x943d57c (0xf322 bytes) 2024-09-13T06:39:34.775 INFO:teuthology.orchestra.run.smithi081.stdout:119 write 0xddde014 thru 0xdde23e1 (0x43ce bytes) 2024-09-13T06:39:34.782 INFO:teuthology.orchestra.run.smithi081.stdout:120 punch from 0x4dd4ce5 to 0x4ddca98, (0x7db3 bytes) 2024-09-13T06:39:34.782 INFO:teuthology.orchestra.run.smithi081.stdout:122 write 0x5d30be9 thru 0x5d39e1d (0x9235 bytes) 2024-09-13T06:39:34.788 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:39:34.791+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:39:34.789 INFO:teuthology.orchestra.run.smithi081.stdout:123 punch from 0x2b90eb9 to 0x2b9b5b3, (0xa6fa bytes) 2024-09-13T06:39:34.789 INFO:teuthology.orchestra.run.smithi081.stdout:125 read 0x72de73d thru 0x72e8826 (0xa0ea bytes) 2024-09-13T06:39:34.789 INFO:teuthology.orchestra.run.smithi081.stdout:128 read 0x2713a2f thru 0x2718345 (0x4917 bytes) 2024-09-13T06:39:34.790 INFO:teuthology.orchestra.run.smithi081.stdout:129 punch from 0x661a8c9 to 0x661dcd4, (0x340b bytes) 2024-09-13T06:39:34.790 INFO:teuthology.orchestra.run.smithi081.stdout:130 punch from 0x5a79757 to 0x5a828e9, (0x9192 bytes) 2024-09-13T06:39:34.790 INFO:teuthology.orchestra.run.smithi081.stdout:131 write 0xe26d97a thru 0xe27699b (0x9022 bytes) 2024-09-13T06:39:34.795 INFO:teuthology.orchestra.run.smithi081.stdout:133 punch from 0xa9d3cd6 to 0xa9d720c, (0x3536 bytes) 2024-09-13T06:39:34.796 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:39:34.796 INFO:teuthology.orchestra.run.smithi081.stdout:135 writesame 0x32930cb thru 0x329921c data_size 0x1(0x6152 bytes) 2024-09-13T06:39:34.820 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-13T06:39:34.830 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:39:34.832 INFO:teuthology.orchestra.run.smithi081.stdout:138 trunc from 0xe5dc42e to 0xccc44cc 2024-09-13T06:39:34.846 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:39:34.846 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-13T06:39:34.846 INFO:teuthology.orchestra.run.smithi081.stdout: "complaint_time": 30, 2024-09-13T06:39:34.846 INFO:teuthology.orchestra.run.smithi081.stdout: "num_blocked_ops": 0 2024-09-13T06:39:34.846 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:39:34.862 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-13T06:39:34.869 INFO:teuthology.orchestra.run.smithi081.stdout:140 write 0xd55291a thru 0xd56273d (0xfe24 bytes) 2024-09-13T06:39:34.882 INFO:teuthology.orchestra.run.smithi081.stdout:141 trunc from 0xd56273e to 0xa764e7f 2024-09-13T06:39:34.889 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:39:34.890+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:39:34.910 INFO:teuthology.orchestra.run.smithi081.stdout:142 punch from 0x54152e5 to 0x541e4db, (0x91f6 bytes) 2024-09-13T06:39:34.910 INFO:teuthology.orchestra.run.smithi081.stdout:143 read 0x3748d56 thru 0x374b177 (0x2422 bytes) 2024-09-13T06:39:34.926 INFO:teuthology.orchestra.run.smithi081.stdout:146 write 0xb13c577 thru 0xb14568c (0x9116 bytes) 2024-09-13T06:39:34.934 INFO:teuthology.orchestra.run.smithi081.stdout:147 punch from 0xa1c1c5f to 0xa1ce366, (0xc707 bytes) 2024-09-13T06:39:34.947 INFO:teuthology.orchestra.run.smithi081.stdout:148 trunc from 0xb14568d to 0x2ff68d8 2024-09-13T06:39:34.973 INFO:teuthology.orchestra.run.smithi081.stdout:osd.0: {} 2024-09-13T06:39:34.973 INFO:teuthology.orchestra.run.smithi081.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-13T06:39:34.973 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:39:34.973 INFO:teuthology.orchestra.run.smithi081.stdout:150 write 0x1223319 thru 0x1226928 (0x3610 bytes) 2024-09-13T06:39:34.979 INFO:teuthology.orchestra.run.smithi081.stdout:152 read 0x24b820a thru 0x24c0816 (0x860d bytes) 2024-09-13T06:39:34.980 INFO:teuthology.orchestra.run.smithi081.stdout:153 read 0x231f649 thru 0x23229ec (0x33a4 bytes) 2024-09-13T06:39:34.981 INFO:teuthology.orchestra.run.smithi081.stdout:155 read 0x19113ff thru 0x191532f (0x3f31 bytes) 2024-09-13T06:39:34.981 INFO:teuthology.orchestra.run.smithi081.stdout:156 read 0xa2a281 thru 0xa2fe6c (0x5bec bytes) 2024-09-13T06:39:34.990 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:39:34.990+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:39:34.990 INFO:teuthology.orchestra.run.smithi081.stdout:osd.1: {} 2024-09-13T06:39:34.990 INFO:teuthology.orchestra.run.smithi081.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-13T06:39:34.992 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:39:34.992 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 20, 2024-09-13T06:39:34.992 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 600, 2024-09-13T06:39:34.992 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [ 2024-09-13T06:39:34.992 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.992 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4217.0:1 2.3 e18/17 2:c4c92e5a:::rbd_trash:head v 18'1, mlcod=0'0)", 2024-09-13T06:39:34.992 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:17.541772+0000", 2024-09-13T06:39:34.993 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 17.455632502, 2024-09-13T06:39:34.993 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00080160799999999999, 2024-09-13T06:39:34.993 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:34.993 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:34.993 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:34.993 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.993 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:34.993 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:17.541772+0000", 2024-09-13T06:39:34.993 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:34.993 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:34.993 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.993 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:34.993 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:17.541772+0000", 2024-09-13T06:39:34.994 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:34.994 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:34.994 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.994 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:34.994 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:17.541772+0000", 2024-09-13T06:39:34.994 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:39:34.994 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:34.994 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.994 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:34.994 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:17.541781+0000", 2024-09-13T06:39:34.994 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.1540000000000008e-06 2024-09-13T06:39:34.994 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:34.995 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.995 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:34.995 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:17.541793+0000", 2024-09-13T06:39:34.995 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2046e-05 2024-09-13T06:39:34.995 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:34.995 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.995 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:34.995 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:17.541810+0000", 2024-09-13T06:39:34.995 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6807e-05 2024-09-13T06:39:34.995 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:34.995 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.995 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:34.995 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:17.541870+0000", 2024-09-13T06:39:34.995 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0568e-05 2024-09-13T06:39:34.996 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:34.996 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.996 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:34.996 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:17.541894+0000", 2024-09-13T06:39:34.996 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.349e-05 2024-09-13T06:39:34.996 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:34.996 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.996 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:39:34.996 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:17.542526+0000", 2024-09-13T06:39:34.996 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00063173899999999998 2024-09-13T06:39:34.996 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:34.996 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.997 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:34.997 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:17.542574+0000", 2024-09-13T06:39:34.997 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.8470000000000002e-05 2024-09-13T06:39:34.997 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:34.997 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:34.997 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:34.997 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:34.997 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.997 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4385.0:602 3.9 e27/21 3:963a29a1:::rbd_data.11214e25756e.000000000000001b:head v 27'1, mlcod=0'0)", 2024-09-13T06:39:34.997 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:34.785951+0000", 2024-09-13T06:39:34.997 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.21145407199999999, 2024-09-13T06:39:34.997 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.001146141, 2024-09-13T06:39:34.997 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:34.998 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:34.998 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:34.998 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.998 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:34.998 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:34.785951+0000", 2024-09-13T06:39:34.998 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:34.998 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:34.998 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.998 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:34.998 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:34.785951+0000", 2024-09-13T06:39:34.998 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:34.998 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:34.998 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.998 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:34.999 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:34.785951+0000", 2024-09-13T06:39:34.999 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:39:34.999 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:34.999 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.999 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:34.999 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:34.786027+0000", 2024-09-13T06:39:34.999 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.6285000000000006e-05 2024-09-13T06:39:34.999 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:34.999 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:34.999 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:34.999 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:34.786041+0000", 2024-09-13T06:39:34.999 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4062e-05 2024-09-13T06:39:34.999 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:35.000 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:35.000 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:35.000 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:34.786053+0000", 2024-09-13T06:39:35.000 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2245e-05 2024-09-13T06:39:35.000 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:35.000 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:35.000 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:35.000 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:34.786107+0000", 2024-09-13T06:39:35.000 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3981999999999999e-05 2024-09-13T06:39:35.000 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:35.000 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:35.000 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:35.000 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:34.786129+0000", 2024-09-13T06:39:35.001 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1926e-05 2024-09-13T06:39:35.001 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:35.001 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:35.001 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:39:35.001 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:34.787053+0000", 2024-09-13T06:39:35.001 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00092407399999999999 2024-09-13T06:39:35.001 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:35.001 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:35.001 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:35.001 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:34.787097+0000", 2024-09-13T06:39:35.001 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.388e-05 2024-09-13T06:39:35.001 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:35.001 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:35.002 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:35.002 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:35.002 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:35.002 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4385.0:611 3.9 e27/21 3:963a29a1:::rbd_data.11214e25756e.000000000000001b:head v 27'2, mlcod=0'0)", 2024-09-13T06:39:35.002 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:34.839866+0000", 2024-09-13T06:39:35.002 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.157539129, 2024-09-13T06:39:35.002 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0013373529999999999, 2024-09-13T06:39:35.002 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:35.002 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:35.002 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:35.002 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:35.002 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:35.002 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:34.839866+0000", 2024-09-13T06:39:35.002 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:35.003 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:35.003 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:35.003 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:35.003 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:34.839866+0000", 2024-09-13T06:39:35.003 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:35.003 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:35.003 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:35.003 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:35.003 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:34.839865+0000", 2024-09-13T06:39:35.003 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999986 2024-09-13T06:39:35.003 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:35.003 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:35.003 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:35.004 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:34.839876+0000", 2024-09-13T06:39:35.004 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1113e-05 2024-09-13T06:39:35.004 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:35.004 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:35.004 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:35.004 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:34.839898+0000", 2024-09-13T06:39:35.004 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2079e-05 2024-09-13T06:39:35.004 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:35.004 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:35.004 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:35.004 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:34.839908+0000", 2024-09-13T06:39:35.004 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0409e-05 2024-09-13T06:39:35.004 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:35.004 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:35.005 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:35.005 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:34.840023+0000", 2024-09-13T06:39:35.005 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000114814 2024-09-13T06:39:35.005 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:35.005 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:35.005 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:35.005 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:34.840089+0000", 2024-09-13T06:39:35.005 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.5950000000000004e-05 2024-09-13T06:39:35.005 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:35.005 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:35.005 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:39:35.005 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:34.841161+0000", 2024-09-13T06:39:35.006 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.001071972 2024-09-13T06:39:35.006 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:35.006 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:35.006 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:35.006 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:34.841203+0000", 2024-09-13T06:39:35.006 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.2271999999999998e-05 2024-09-13T06:39:35.006 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:35.006 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:35.006 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:35.006 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:35.006 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:35.006 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4385.0:636 3.9 e27/21 3:963a29a1:::rbd_data.11214e25756e.000000000000001b:head v 27'3, mlcod=27'1)", 2024-09-13T06:39:35.006 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:34.893452+0000", 2024-09-13T06:39:35.007 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.10395281100000001, 2024-09-13T06:39:35.007 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.001157941, 2024-09-13T06:39:35.007 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:35.007 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:35.007 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:35.007 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:35.007 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:35.007 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:34.893452+0000", 2024-09-13T06:39:35.007 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:35.007 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:35.007 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:35.007 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:35.007 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:34.893452+0000", 2024-09-13T06:39:35.007 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:35.008 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:35.008 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:35.008 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:35.008 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:34.893451+0000", 2024-09-13T06:39:35.008 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999986 2024-09-13T06:39:35.008 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:35.008 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:35.008 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:35.008 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:34.893463+0000", 2024-09-13T06:39:35.008 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2302e-05 2024-09-13T06:39:35.008 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:35.008 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:35.009 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:35.009 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:34.893486+0000", 2024-09-13T06:39:35.009 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2745999999999999e-05 2024-09-13T06:39:35.009 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:35.009 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:35.009 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:35.009 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:34.893496+0000", 2024-09-13T06:39:35.009 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0481e-05 2024-09-13T06:39:35.009 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:35.009 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:35.009 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:35.009 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:34.893551+0000", 2024-09-13T06:39:35.009 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.4463999999999999e-05 2024-09-13T06:39:35.010 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:35.010 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:35.010 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:35.010 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:34.893575+0000", 2024-09-13T06:39:35.010 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4581999999999999e-05 2024-09-13T06:39:35.010 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:35.010 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:35.010 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:39:35.010 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:34.894565+0000", 2024-09-13T06:39:35.010 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00099020899999999992 2024-09-13T06:39:35.010 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:35.010 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:35.010 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:35.011 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:34.894610+0000", 2024-09-13T06:39:35.011 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4597e-05 2024-09-13T06:39:35.011 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:35.011 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:35.011 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:35.011 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:35.011 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:35.011 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:39:35.012 INFO:teuthology.orchestra.run.smithi081.stdout:161 writesame 0x72cf9e1 thru 0x72d1200 data_size 0x10(0x1820 bytes) 2024-09-13T06:39:35.012 INFO:teuthology.orchestra.run.smithi081.stdout:162 punch from 0x6eef9d6 to 0x6ef03ad, (0x9d7 bytes) 2024-09-13T06:39:35.012 INFO:teuthology.orchestra.run.smithi081.stdout:163 read 0x60f22e3 thru 0x60f2867 (0x585 bytes) 2024-09-13T06:39:35.012 INFO:teuthology.orchestra.run.smithi081.stdout:164 clone 2 order 18 su 65536 sc 14 2024-09-13T06:39:35.013 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-13T06:39:35.013 INFO:teuthology.orchestra.run.smithi081.stdout:osd.2: {} 2024-09-13T06:39:35.014 INFO:teuthology.orchestra.run.smithi081.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-13T06:39:35.023 INFO:teuthology.orchestra.run.smithi081.stdout:osd.3: {} 2024-09-13T06:39:35.024 INFO:teuthology.orchestra.run.smithi081.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-13T06:39:35.044 INFO:teuthology.orchestra.run.smithi081.stdout:osd.4: {} 2024-09-13T06:39:35.044 INFO:teuthology.orchestra.run.smithi081.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-13T06:39:35.064 INFO:teuthology.orchestra.run.smithi081.stdout:osd.5: {} 2024-09-13T06:39:35.064 INFO:teuthology.orchestra.run.smithi081.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-13T06:39:35.084 INFO:teuthology.orchestra.run.smithi081.stdout:osd.6: {} 2024-09-13T06:39:35.084 INFO:teuthology.orchestra.run.smithi081.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-13T06:39:35.091 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:39:35.090+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:39:35.104 INFO:teuthology.orchestra.run.smithi081.stdout:osd.7: {} 2024-09-13T06:39:35.104 INFO:teuthology.orchestra.run.smithi081.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-13T06:39:35.137 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:39:35.137 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:39:35.151 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-13T06:39:35.195 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:39:35.199+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:39:35.293 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:39:35.295+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:39:35.311 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:39:35.312 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:39:35.326 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-13T06:39:35.413 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:39:35.415+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:39:35.413 INFO:teuthology.orchestra.run.smithi081.stderr:nodeep-scrub is unset 2024-09-13T06:39:35.490 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:39:35.490 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:39:35.494 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-13T06:39:35.494+0000 7f86a5f06640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26387) UID: 0 2024-09-13T06:39:35.504 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-13T06:39:35.595 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-13T06:39:35.598+0000 7f86a5f06640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26387) UID: 0 2024-09-13T06:39:35.635 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:39:35.635 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:39:35.650 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-13T06:39:35.740 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-13T06:39:35.742+0000 7f86a5f06640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26387) UID: 0 2024-09-13T06:39:35.797 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-13T06:39:35.798+0000 7f86a5f06640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26387) UID: 0 2024-09-13T06:39:35.810 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:39:35.810 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:39:35.824 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-13T06:39:35.868 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-13T06:39:35.869 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-13T06:39:35.869 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap 2024-09-13T06:39:35.869 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-09-13T06:39:35.915 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:39:35.919+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:39:35.989 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:39:35.989 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:39:35.999 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-13T06:39:36.002+0000 7f86a5f06640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26387) UID: 0 2024-09-13T06:39:36.003 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-13T06:39:36.100 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:39:36.102+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:39:36.168 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:39:36.168 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:39:36.174 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T06:39:36.174 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:39:36.174 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 28, 2024-09-13T06:39:36.174 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "e5612297-d004-4957-927e-afa37f30d6cf", 2024-09-13T06:39:36.174 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-09-13T06:38:56.670231+0000", 2024-09-13T06:39:36.174 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-09-13T06:39:35.407905+0000", 2024-09-13T06:39:36.174 INFO:teuthology.orchestra.run.smithi081.stdout: "last_up_change": "2024-09-13T06:39:09.107597+0000", 2024-09-13T06:39:36.174 INFO:teuthology.orchestra.run.smithi081.stdout: "last_in_change": "2024-09-13T06:38:59.874387+0000", 2024-09-13T06:39:36.174 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-13T06:39:36.175 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_num": 5799936, 2024-09-13T06:39:36.175 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_set": [ 2024-09-13T06:39:36.175 INFO:teuthology.orchestra.run.smithi081.stdout: "pglog_hardlimit", 2024-09-13T06:39:36.175 INFO:teuthology.orchestra.run.smithi081.stdout: "purged_snapdirs", 2024-09-13T06:39:36.175 INFO:teuthology.orchestra.run.smithi081.stdout: "recovery_deletes", 2024-09-13T06:39:36.175 INFO:teuthology.orchestra.run.smithi081.stdout: "sortbitwise" 2024-09-13T06:39:36.175 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-13T06:39:36.175 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_version": 4, 2024-09-13T06:39:36.175 INFO:teuthology.orchestra.run.smithi081.stdout: "full_ratio": 0.94999998807907104, 2024-09-13T06:39:36.175 INFO:teuthology.orchestra.run.smithi081.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-09-13T06:39:36.175 INFO:teuthology.orchestra.run.smithi081.stdout: "nearfull_ratio": 0.85000002384185791, 2024-09-13T06:39:36.175 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_snapshot": "", 2024-09-13T06:39:36.175 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_max": 3, 2024-09-13T06:39:36.176 INFO:teuthology.orchestra.run.smithi081.stdout: "max_osd": 8, 2024-09-13T06:39:36.176 INFO:teuthology.orchestra.run.smithi081.stdout: "require_min_compat_client": "luminous", 2024-09-13T06:39:36.176 INFO:teuthology.orchestra.run.smithi081.stdout: "min_compat_client": "jewel", 2024-09-13T06:39:36.176 INFO:teuthology.orchestra.run.smithi081.stdout: "require_osd_release": "reef", 2024-09-13T06:39:36.176 INFO:teuthology.orchestra.run.smithi081.stdout: "allow_crimson": false, 2024-09-13T06:39:36.176 INFO:teuthology.orchestra.run.smithi081.stdout: "pools": [ 2024-09-13T06:39:36.176 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:36.176 INFO:teuthology.orchestra.run.smithi081.stdout: "pool": 1, 2024-09-13T06:39:36.176 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_name": ".mgr", 2024-09-13T06:39:36.176 INFO:teuthology.orchestra.run.smithi081.stdout: "create_time": "2024-09-13T06:39:09.600726+0000", 2024-09-13T06:39:36.176 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-13T06:39:36.176 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_names": "hashpspool", 2024-09-13T06:39:36.177 INFO:teuthology.orchestra.run.smithi081.stdout: "type": 1, 2024-09-13T06:39:36.177 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 2, 2024-09-13T06:39:36.177 INFO:teuthology.orchestra.run.smithi081.stdout: "min_size": 1, 2024-09-13T06:39:36.177 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_rule": 0, 2024-09-13T06:39:36.177 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_count": 0, 2024-09-13T06:39:36.177 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_target": 0, 2024-09-13T06:39:36.177 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_barrier": 0, 2024-09-13T06:39:36.177 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-13T06:39:36.177 INFO:teuthology.orchestra.run.smithi081.stdout: "object_hash": 2, 2024-09-13T06:39:36.177 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_mode": "off", 2024-09-13T06:39:36.177 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num": 1, 2024-09-13T06:39:36.177 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num": 1, 2024-09-13T06:39:36.177 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num_target": 1, 2024-09-13T06:39:36.177 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_target": 1, 2024-09-13T06:39:36.178 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_pending": 1, 2024-09-13T06:39:36.178 INFO:teuthology.orchestra.run.smithi081.stdout: "last_pg_merge_meta": { 2024-09-13T06:39:36.178 INFO:teuthology.orchestra.run.smithi081.stdout: "source_pgid": "0.0", 2024-09-13T06:39:36.178 INFO:teuthology.orchestra.run.smithi081.stdout: "ready_epoch": 0, 2024-09-13T06:39:36.178 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_started": 0, 2024-09-13T06:39:36.178 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_clean": 0, 2024-09-13T06:39:36.178 INFO:teuthology.orchestra.run.smithi081.stdout: "source_version": "0'0", 2024-09-13T06:39:36.178 INFO:teuthology.orchestra.run.smithi081.stdout: "target_version": "0'0" 2024-09-13T06:39:36.178 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:36.178 INFO:teuthology.orchestra.run.smithi081.stdout: "last_change": "16", 2024-09-13T06:39:36.178 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend": "0", 2024-09-13T06:39:36.178 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-13T06:39:36.178 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_preluminous": "0", 2024-09-13T06:39:36.179 INFO:teuthology.orchestra.run.smithi081.stdout: "auid": 0, 2024-09-13T06:39:36.179 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_mode": "selfmanaged", 2024-09-13T06:39:36.179 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_seq": 0, 2024-09-13T06:39:36.179 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_epoch": 0, 2024-09-13T06:39:36.179 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_snaps": [], 2024-09-13T06:39:36.179 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps": "[]", 2024-09-13T06:39:36.179 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_bytes": 0, 2024-09-13T06:39:36.179 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_objects": 0, 2024-09-13T06:39:36.179 INFO:teuthology.orchestra.run.smithi081.stdout: "tiers": [], 2024-09-13T06:39:36.179 INFO:teuthology.orchestra.run.smithi081.stdout: "tier_of": -1, 2024-09-13T06:39:36.179 INFO:teuthology.orchestra.run.smithi081.stdout: "read_tier": -1, 2024-09-13T06:39:36.179 INFO:teuthology.orchestra.run.smithi081.stdout: "write_tier": -1, 2024-09-13T06:39:36.179 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_mode": "none", 2024-09-13T06:39:36.179 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_bytes": 0, 2024-09-13T06:39:36.180 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_objects": 0, 2024-09-13T06:39:36.180 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-13T06:39:36.180 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-13T06:39:36.180 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-13T06:39:36.180 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_flush_age": 0, 2024-09-13T06:39:36.180 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_evict_age": 0, 2024-09-13T06:39:36.180 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profile": "", 2024-09-13T06:39:36.180 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_params": { 2024-09-13T06:39:36.180 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "none" 2024-09-13T06:39:36.180 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:36.180 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_period": 0, 2024-09-13T06:39:36.180 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_count": 0, 2024-09-13T06:39:36.180 INFO:teuthology.orchestra.run.smithi081.stdout: "use_gmt_hitset": true, 2024-09-13T06:39:36.180 INFO:teuthology.orchestra.run.smithi081.stdout: "min_read_recency_for_promote": 0, 2024-09-13T06:39:36.181 INFO:teuthology.orchestra.run.smithi081.stdout: "min_write_recency_for_promote": 0, 2024-09-13T06:39:36.181 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_grade_decay_rate": 0, 2024-09-13T06:39:36.181 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_search_last_n": 0, 2024-09-13T06:39:36.181 INFO:teuthology.orchestra.run.smithi081.stdout: "grade_table": [], 2024-09-13T06:39:36.181 INFO:teuthology.orchestra.run.smithi081.stdout: "stripe_width": 0, 2024-09-13T06:39:36.181 INFO:teuthology.orchestra.run.smithi081.stdout: "expected_num_objects": 0, 2024-09-13T06:39:36.181 INFO:teuthology.orchestra.run.smithi081.stdout: "fast_read": false, 2024-09-13T06:39:36.181 INFO:teuthology.orchestra.run.smithi081.stdout: "options": { 2024-09-13T06:39:36.181 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_max": 32, 2024-09-13T06:39:36.181 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_min": 1 2024-09-13T06:39:36.181 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:36.181 INFO:teuthology.orchestra.run.smithi081.stdout: "application_metadata": { 2024-09-13T06:39:36.182 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": {} 2024-09-13T06:39:36.182 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:36.182 INFO:teuthology.orchestra.run.smithi081.stdout: "read_balance": { 2024-09-13T06:39:36.182 INFO:teuthology.orchestra.run.smithi081.stdout: "score_acting": 8, 2024-09-13T06:39:36.182 INFO:teuthology.orchestra.run.smithi081.stdout: "score_stable": 8, 2024-09-13T06:39:36.182 INFO:teuthology.orchestra.run.smithi081.stdout: "optimal_score": 0.25, 2024-09-13T06:39:36.182 INFO:teuthology.orchestra.run.smithi081.stdout: "raw_score_acting": 2, 2024-09-13T06:39:36.182 INFO:teuthology.orchestra.run.smithi081.stdout: "raw_score_stable": 2, 2024-09-13T06:39:36.182 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity_weighted": 1, 2024-09-13T06:39:36.182 INFO:teuthology.orchestra.run.smithi081.stdout: "average_primary_affinity": 1, 2024-09-13T06:39:36.182 INFO:teuthology.orchestra.run.smithi081.stdout: "average_primary_affinity_weighted": 1 2024-09-13T06:39:36.182 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:36.182 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:36.183 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:36.183 INFO:teuthology.orchestra.run.smithi081.stdout: "pool": 2, 2024-09-13T06:39:36.183 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_name": "rbd", 2024-09-13T06:39:36.183 INFO:teuthology.orchestra.run.smithi081.stdout: "create_time": "2024-09-13T06:39:15.802118+0000", 2024-09-13T06:39:36.183 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 8193, 2024-09-13T06:39:36.183 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-13T06:39:36.183 INFO:teuthology.orchestra.run.smithi081.stdout: "type": 1, 2024-09-13T06:39:36.183 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 2, 2024-09-13T06:39:36.183 INFO:teuthology.orchestra.run.smithi081.stdout: "min_size": 1, 2024-09-13T06:39:36.183 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_rule": 0, 2024-09-13T06:39:36.183 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_count": 0, 2024-09-13T06:39:36.183 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_target": 0, 2024-09-13T06:39:36.184 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_barrier": 0, 2024-09-13T06:39:36.184 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-13T06:39:36.184 INFO:teuthology.orchestra.run.smithi081.stdout: "object_hash": 2, 2024-09-13T06:39:36.184 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_mode": "off", 2024-09-13T06:39:36.184 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num": 8, 2024-09-13T06:39:36.184 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num": 8, 2024-09-13T06:39:36.185 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num_target": 8, 2024-09-13T06:39:36.185 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_target": 8, 2024-09-13T06:39:36.185 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_pending": 8, 2024-09-13T06:39:36.185 INFO:teuthology.orchestra.run.smithi081.stdout: "last_pg_merge_meta": { 2024-09-13T06:39:36.185 INFO:teuthology.orchestra.run.smithi081.stdout: "source_pgid": "0.0", 2024-09-13T06:39:36.185 INFO:teuthology.orchestra.run.smithi081.stdout: "ready_epoch": 0, 2024-09-13T06:39:36.185 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_started": 0, 2024-09-13T06:39:36.185 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_clean": 0, 2024-09-13T06:39:36.185 INFO:teuthology.orchestra.run.smithi081.stdout: "source_version": "0'0", 2024-09-13T06:39:36.185 INFO:teuthology.orchestra.run.smithi081.stdout: "target_version": "0'0" 2024-09-13T06:39:36.185 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:36.185 INFO:teuthology.orchestra.run.smithi081.stdout: "last_change": "20", 2024-09-13T06:39:36.185 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend": "0", 2024-09-13T06:39:36.185 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-13T06:39:36.186 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_preluminous": "0", 2024-09-13T06:39:36.186 INFO:teuthology.orchestra.run.smithi081.stdout: "auid": 0, 2024-09-13T06:39:36.186 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_mode": "selfmanaged", 2024-09-13T06:39:36.186 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_seq": 3, 2024-09-13T06:39:36.186 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_epoch": 20, 2024-09-13T06:39:36.186 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_snaps": [], 2024-09-13T06:39:36.186 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps": "[]", 2024-09-13T06:39:36.186 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_bytes": 0, 2024-09-13T06:39:36.186 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_objects": 0, 2024-09-13T06:39:36.186 INFO:teuthology.orchestra.run.smithi081.stdout: "tiers": [], 2024-09-13T06:39:36.186 INFO:teuthology.orchestra.run.smithi081.stdout: "tier_of": -1, 2024-09-13T06:39:36.186 INFO:teuthology.orchestra.run.smithi081.stdout: "read_tier": -1, 2024-09-13T06:39:36.187 INFO:teuthology.orchestra.run.smithi081.stdout: "write_tier": -1, 2024-09-13T06:39:36.187 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_mode": "none", 2024-09-13T06:39:36.187 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_bytes": 0, 2024-09-13T06:39:36.187 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_objects": 0, 2024-09-13T06:39:36.187 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-13T06:39:36.187 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-13T06:39:36.187 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-13T06:39:36.187 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_flush_age": 0, 2024-09-13T06:39:36.187 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_evict_age": 0, 2024-09-13T06:39:36.187 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profile": "", 2024-09-13T06:39:36.187 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_params": { 2024-09-13T06:39:36.187 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "none" 2024-09-13T06:39:36.187 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:36.187 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_period": 0, 2024-09-13T06:39:36.188 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_count": 0, 2024-09-13T06:39:36.188 INFO:teuthology.orchestra.run.smithi081.stdout: "use_gmt_hitset": true, 2024-09-13T06:39:36.188 INFO:teuthology.orchestra.run.smithi081.stdout: "min_read_recency_for_promote": 0, 2024-09-13T06:39:36.188 INFO:teuthology.orchestra.run.smithi081.stdout: "min_write_recency_for_promote": 0, 2024-09-13T06:39:36.188 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_grade_decay_rate": 0, 2024-09-13T06:39:36.188 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_search_last_n": 0, 2024-09-13T06:39:36.188 INFO:teuthology.orchestra.run.smithi081.stdout: "grade_table": [], 2024-09-13T06:39:36.188 INFO:teuthology.orchestra.run.smithi081.stdout: "stripe_width": 0, 2024-09-13T06:39:36.188 INFO:teuthology.orchestra.run.smithi081.stdout: "expected_num_objects": 0, 2024-09-13T06:39:36.188 INFO:teuthology.orchestra.run.smithi081.stdout: "fast_read": false, 2024-09-13T06:39:36.188 INFO:teuthology.orchestra.run.smithi081.stdout: "options": {}, 2024-09-13T06:39:36.188 INFO:teuthology.orchestra.run.smithi081.stdout: "application_metadata": { 2024-09-13T06:39:36.188 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd": {} 2024-09-13T06:39:36.189 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:36.189 INFO:teuthology.orchestra.run.smithi081.stdout: "read_balance": { 2024-09-13T06:39:36.189 INFO:teuthology.orchestra.run.smithi081.stdout: "score_acting": 1.9900000095367432, 2024-09-13T06:39:36.189 INFO:teuthology.orchestra.run.smithi081.stdout: "score_stable": 1.9900000095367432, 2024-09-13T06:39:36.189 INFO:teuthology.orchestra.run.smithi081.stdout: "optimal_score": 0.87999999523162842, 2024-09-13T06:39:36.189 INFO:teuthology.orchestra.run.smithi081.stdout: "raw_score_acting": 1.75, 2024-09-13T06:39:36.189 INFO:teuthology.orchestra.run.smithi081.stdout: "raw_score_stable": 1.75, 2024-09-13T06:39:36.189 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity_weighted": 1, 2024-09-13T06:39:36.189 INFO:teuthology.orchestra.run.smithi081.stdout: "average_primary_affinity": 1, 2024-09-13T06:39:36.189 INFO:teuthology.orchestra.run.smithi081.stdout: "average_primary_affinity_weighted": 1 2024-09-13T06:39:36.189 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:36.189 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:36.189 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:36.190 INFO:teuthology.orchestra.run.smithi081.stdout: "pool": 3, 2024-09-13T06:39:36.190 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_name": "pool_client.0", 2024-09-13T06:39:36.190 INFO:teuthology.orchestra.run.smithi081.stdout: "create_time": "2024-09-13T06:39:25.648942+0000", 2024-09-13T06:39:36.190 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 8193, 2024-09-13T06:39:36.190 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-13T06:39:36.190 INFO:teuthology.orchestra.run.smithi081.stdout: "type": 1, 2024-09-13T06:39:36.190 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 2, 2024-09-13T06:39:36.190 INFO:teuthology.orchestra.run.smithi081.stdout: "min_size": 1, 2024-09-13T06:39:36.190 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_rule": 0, 2024-09-13T06:39:36.190 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_count": 0, 2024-09-13T06:39:36.190 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_target": 0, 2024-09-13T06:39:36.191 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_barrier": 0, 2024-09-13T06:39:36.191 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-13T06:39:36.191 INFO:teuthology.orchestra.run.smithi081.stdout: "object_hash": 2, 2024-09-13T06:39:36.191 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_mode": "off", 2024-09-13T06:39:36.191 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num": 32, 2024-09-13T06:39:36.191 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num": 32, 2024-09-13T06:39:36.191 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num_target": 32, 2024-09-13T06:39:36.191 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_target": 32, 2024-09-13T06:39:36.191 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_pending": 32, 2024-09-13T06:39:36.191 INFO:teuthology.orchestra.run.smithi081.stdout: "last_pg_merge_meta": { 2024-09-13T06:39:36.191 INFO:teuthology.orchestra.run.smithi081.stdout: "source_pgid": "0.0", 2024-09-13T06:39:36.191 INFO:teuthology.orchestra.run.smithi081.stdout: "ready_epoch": 0, 2024-09-13T06:39:36.191 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_started": 0, 2024-09-13T06:39:36.191 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_clean": 0, 2024-09-13T06:39:36.192 INFO:teuthology.orchestra.run.smithi081.stdout: "source_version": "0'0", 2024-09-13T06:39:36.192 INFO:teuthology.orchestra.run.smithi081.stdout: "target_version": "0'0" 2024-09-13T06:39:36.192 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:36.192 INFO:teuthology.orchestra.run.smithi081.stdout: "last_change": "28", 2024-09-13T06:39:36.192 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend": "0", 2024-09-13T06:39:36.192 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-13T06:39:36.192 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_preluminous": "0", 2024-09-13T06:39:36.192 INFO:teuthology.orchestra.run.smithi081.stdout: "auid": 0, 2024-09-13T06:39:36.192 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_mode": "selfmanaged", 2024-09-13T06:39:36.192 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_seq": 7, 2024-09-13T06:39:36.192 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_epoch": 28, 2024-09-13T06:39:36.193 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_snaps": [], 2024-09-13T06:39:36.193 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps": "[]", 2024-09-13T06:39:36.193 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_bytes": 0, 2024-09-13T06:39:36.193 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_objects": 0, 2024-09-13T06:39:36.193 INFO:teuthology.orchestra.run.smithi081.stdout: "tiers": [], 2024-09-13T06:39:36.193 INFO:teuthology.orchestra.run.smithi081.stdout: "tier_of": -1, 2024-09-13T06:39:36.193 INFO:teuthology.orchestra.run.smithi081.stdout: "read_tier": -1, 2024-09-13T06:39:36.193 INFO:teuthology.orchestra.run.smithi081.stdout: "write_tier": -1, 2024-09-13T06:39:36.193 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_mode": "none", 2024-09-13T06:39:36.193 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_bytes": 0, 2024-09-13T06:39:36.193 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_objects": 0, 2024-09-13T06:39:36.194 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-13T06:39:36.194 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-13T06:39:36.194 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-13T06:39:36.194 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_flush_age": 0, 2024-09-13T06:39:36.194 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_evict_age": 0, 2024-09-13T06:39:36.194 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profile": "", 2024-09-13T06:39:36.194 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_params": { 2024-09-13T06:39:36.194 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "none" 2024-09-13T06:39:36.194 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:36.194 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_period": 0, 2024-09-13T06:39:36.194 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_count": 0, 2024-09-13T06:39:36.194 INFO:teuthology.orchestra.run.smithi081.stdout: "use_gmt_hitset": true, 2024-09-13T06:39:36.194 INFO:teuthology.orchestra.run.smithi081.stdout: "min_read_recency_for_promote": 0, 2024-09-13T06:39:36.194 INFO:teuthology.orchestra.run.smithi081.stdout: "min_write_recency_for_promote": 0, 2024-09-13T06:39:36.195 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_grade_decay_rate": 0, 2024-09-13T06:39:36.195 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_search_last_n": 0, 2024-09-13T06:39:36.195 INFO:teuthology.orchestra.run.smithi081.stdout: "grade_table": [], 2024-09-13T06:39:36.195 INFO:teuthology.orchestra.run.smithi081.stdout: "stripe_width": 0, 2024-09-13T06:39:36.195 INFO:teuthology.orchestra.run.smithi081.stdout: "expected_num_objects": 0, 2024-09-13T06:39:36.195 INFO:teuthology.orchestra.run.smithi081.stdout: "fast_read": false, 2024-09-13T06:39:36.195 INFO:teuthology.orchestra.run.smithi081.stdout: "options": {}, 2024-09-13T06:39:36.195 INFO:teuthology.orchestra.run.smithi081.stdout: "application_metadata": { 2024-09-13T06:39:36.195 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd": {} 2024-09-13T06:39:36.195 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:36.195 INFO:teuthology.orchestra.run.smithi081.stdout: "read_balance": { 2024-09-13T06:39:36.195 INFO:teuthology.orchestra.run.smithi081.stdout: "score_acting": 1.5, 2024-09-13T06:39:36.196 INFO:teuthology.orchestra.run.smithi081.stdout: "score_stable": 1.5, 2024-09-13T06:39:36.196 INFO:teuthology.orchestra.run.smithi081.stdout: "optimal_score": 1, 2024-09-13T06:39:36.196 INFO:teuthology.orchestra.run.smithi081.stdout: "raw_score_acting": 1.5, 2024-09-13T06:39:36.196 INFO:teuthology.orchestra.run.smithi081.stdout: "raw_score_stable": 1.5, 2024-09-13T06:39:36.196 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity_weighted": 1, 2024-09-13T06:39:36.196 INFO:teuthology.orchestra.run.smithi081.stdout: "average_primary_affinity": 1, 2024-09-13T06:39:36.196 INFO:teuthology.orchestra.run.smithi081.stdout: "average_primary_affinity_weighted": 1 2024-09-13T06:39:36.196 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:36.196 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:36.196 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-13T06:39:36.196 INFO:teuthology.orchestra.run.smithi081.stdout: "osds": [ 2024-09-13T06:39:36.196 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:36.196 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 0, 2024-09-13T06:39:36.197 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "54b0a3e4-58ad-4f95-86dc-29a11c9a1964", 2024-09-13T06:39:36.197 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2024-09-13T06:39:36.197 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2024-09-13T06:39:36.197 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2024-09-13T06:39:36.197 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2024-09-13T06:39:36.197 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2024-09-13T06:39:36.197 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2024-09-13T06:39:36.197 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2024-09-13T06:39:36.197 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 21, 2024-09-13T06:39:36.197 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2024-09-13T06:39:36.197 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2024-09-13T06:39:36.197 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-13T06:39:36.197 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:39:36.198 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:36.198 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:39:36.198 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6808", 2024-09-13T06:39:36.198 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 1904727940 2024-09-13T06:39:36.198 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:36.198 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:36.198 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:39:36.198 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6809", 2024-09-13T06:39:36.198 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 1904727940 2024-09-13T06:39:36.198 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:36.198 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:36.198 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:36.198 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2024-09-13T06:39:36.199 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:39:36.199 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:36.199 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:39:36.199 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6810", 2024-09-13T06:39:36.199 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 1904727940 2024-09-13T06:39:36.199 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:36.199 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:36.199 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:39:36.199 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6811", 2024-09-13T06:39:36.199 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 1904727940 2024-09-13T06:39:36.199 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:36.199 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:36.199 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:36.199 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2024-09-13T06:39:36.199 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:39:36.200 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:36.200 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:39:36.200 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6814", 2024-09-13T06:39:36.200 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 1904727940 2024-09-13T06:39:36.200 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:36.200 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:36.200 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:39:36.200 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6815", 2024-09-13T06:39:36.200 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 1904727940 2024-09-13T06:39:36.200 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:36.200 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:36.200 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:36.200 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2024-09-13T06:39:36.200 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:39:36.201 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:36.201 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:39:36.201 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6812", 2024-09-13T06:39:36.201 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 1904727940 2024-09-13T06:39:36.201 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:36.201 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:36.201 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:39:36.201 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6813", 2024-09-13T06:39:36.201 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 1904727940 2024-09-13T06:39:36.201 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:36.201 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:36.201 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:36.202 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6809/1904727940", 2024-09-13T06:39:36.202 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.81:6811/1904727940", 2024-09-13T06:39:36.202 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.81:6815/1904727940", 2024-09-13T06:39:36.202 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.81:6813/1904727940", 2024-09-13T06:39:36.202 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2024-09-13T06:39:36.202 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2024-09-13T06:39:36.202 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2024-09-13T06:39:36.202 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:36.202 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:36.202 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:36.202 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 1, 2024-09-13T06:39:36.202 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "a6dba5b9-c833-465e-a8a5-1741528b24c0", 2024-09-13T06:39:36.202 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2024-09-13T06:39:36.203 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2024-09-13T06:39:36.203 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2024-09-13T06:39:36.203 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2024-09-13T06:39:36.203 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2024-09-13T06:39:36.203 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2024-09-13T06:39:36.203 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2024-09-13T06:39:36.203 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 21, 2024-09-13T06:39:36.203 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2024-09-13T06:39:36.203 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2024-09-13T06:39:36.203 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-13T06:39:36.203 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:39:36.203 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:36.203 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:39:36.204 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6817", 2024-09-13T06:39:36.204 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 738205570 2024-09-13T06:39:36.204 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:36.204 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:36.204 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:39:36.204 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6819", 2024-09-13T06:39:36.204 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 738205570 2024-09-13T06:39:36.204 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:36.204 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:36.204 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:36.204 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2024-09-13T06:39:36.204 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:39:36.204 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:36.204 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:39:36.205 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6822", 2024-09-13T06:39:36.205 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 738205570 2024-09-13T06:39:36.205 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:36.205 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:36.205 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:39:36.205 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6824", 2024-09-13T06:39:36.205 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 738205570 2024-09-13T06:39:36.205 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:36.205 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:36.205 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:36.205 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2024-09-13T06:39:36.205 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:39:36.205 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:36.206 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:39:36.206 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6830", 2024-09-13T06:39:36.206 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 738205570 2024-09-13T06:39:36.206 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:36.206 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:36.206 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:39:36.206 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6831", 2024-09-13T06:39:36.206 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 738205570 2024-09-13T06:39:36.206 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:36.206 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:36.206 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:36.206 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2024-09-13T06:39:36.206 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:39:36.207 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:36.207 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:39:36.207 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6826", 2024-09-13T06:39:36.207 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 738205570 2024-09-13T06:39:36.207 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:36.207 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:36.207 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:39:36.207 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6829", 2024-09-13T06:39:36.207 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 738205570 2024-09-13T06:39:36.207 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:36.207 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:36.207 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:36.207 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6819/738205570", 2024-09-13T06:39:36.207 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.81:6824/738205570", 2024-09-13T06:39:36.208 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.81:6831/738205570", 2024-09-13T06:39:36.208 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.81:6829/738205570", 2024-09-13T06:39:36.208 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2024-09-13T06:39:36.208 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2024-09-13T06:39:36.208 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2024-09-13T06:39:36.208 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:36.208 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:36.208 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:36.208 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 2, 2024-09-13T06:39:36.208 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "6c45097e-44a2-454f-80a4-0fe879ccd52f", 2024-09-13T06:39:36.208 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2024-09-13T06:39:36.208 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2024-09-13T06:39:36.209 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2024-09-13T06:39:36.209 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2024-09-13T06:39:36.209 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2024-09-13T06:39:36.209 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2024-09-13T06:39:36.209 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2024-09-13T06:39:36.209 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 17, 2024-09-13T06:39:36.209 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2024-09-13T06:39:36.209 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2024-09-13T06:39:36.209 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-13T06:39:36.209 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:39:36.209 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:36.209 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:39:36.209 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6816", 2024-09-13T06:39:36.209 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 3558674335 2024-09-13T06:39:36.210 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:36.210 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:36.210 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:39:36.210 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6818", 2024-09-13T06:39:36.210 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 3558674335 2024-09-13T06:39:36.210 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:36.210 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:36.210 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:36.210 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2024-09-13T06:39:36.210 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:39:36.210 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:36.210 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:39:36.210 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6820", 2024-09-13T06:39:36.211 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 3558674335 2024-09-13T06:39:36.211 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:36.211 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:36.211 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:39:36.211 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6821", 2024-09-13T06:39:36.211 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 3558674335 2024-09-13T06:39:36.211 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:36.211 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:36.211 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:36.211 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2024-09-13T06:39:36.211 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:39:36.211 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:36.211 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:39:36.212 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6827", 2024-09-13T06:39:36.212 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 3558674335 2024-09-13T06:39:36.212 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:36.212 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:36.212 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:39:36.212 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6828", 2024-09-13T06:39:36.212 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 3558674335 2024-09-13T06:39:36.212 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:36.212 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:36.212 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:36.212 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2024-09-13T06:39:36.212 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:39:36.212 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:36.213 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:39:36.213 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6823", 2024-09-13T06:39:36.213 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 3558674335 2024-09-13T06:39:36.213 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:36.213 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:36.213 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:39:36.213 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6825", 2024-09-13T06:39:36.213 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 3558674335 2024-09-13T06:39:36.213 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:36.213 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:36.213 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:36.213 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6818/3558674335", 2024-09-13T06:39:36.213 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.81:6821/3558674335", 2024-09-13T06:39:36.213 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.81:6828/3558674335", 2024-09-13T06:39:36.214 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.81:6825/3558674335", 2024-09-13T06:39:36.214 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2024-09-13T06:39:36.214 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2024-09-13T06:39:36.214 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2024-09-13T06:39:36.214 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:36.214 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:36.214 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:36.214 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 3, 2024-09-13T06:39:36.214 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "31952760-06f3-4618-a5c4-f5c4fed3aadb", 2024-09-13T06:39:36.214 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2024-09-13T06:39:36.214 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2024-09-13T06:39:36.214 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2024-09-13T06:39:36.214 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2024-09-13T06:39:36.215 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2024-09-13T06:39:36.215 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2024-09-13T06:39:36.215 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2024-09-13T06:39:36.215 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 21, 2024-09-13T06:39:36.215 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2024-09-13T06:39:36.215 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2024-09-13T06:39:36.215 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-13T06:39:36.215 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:39:36.215 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:36.215 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:39:36.215 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6800", 2024-09-13T06:39:36.215 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 1886327229 2024-09-13T06:39:36.216 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:36.216 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:36.216 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:39:36.216 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6801", 2024-09-13T06:39:36.216 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 1886327229 2024-09-13T06:39:36.216 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:36.216 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:36.216 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:36.216 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2024-09-13T06:39:36.216 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:39:36.216 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:36.216 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:39:36.216 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6802", 2024-09-13T06:39:36.216 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 1886327229 2024-09-13T06:39:36.217 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:36.217 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:36.217 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:39:36.217 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6803", 2024-09-13T06:39:36.217 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 1886327229 2024-09-13T06:39:36.217 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:36.217 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:36.217 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:36.217 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2024-09-13T06:39:36.217 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:39:36.217 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:36.217 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:39:36.217 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6806", 2024-09-13T06:39:36.217 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 1886327229 2024-09-13T06:39:36.218 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:36.218 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:36.218 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:39:36.218 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6807", 2024-09-13T06:39:36.218 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 1886327229 2024-09-13T06:39:36.218 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:36.218 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:36.218 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:36.218 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2024-09-13T06:39:36.218 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:39:36.218 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:36.218 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:39:36.218 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6804", 2024-09-13T06:39:36.219 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 1886327229 2024-09-13T06:39:36.219 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:36.219 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:36.219 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:39:36.219 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6805", 2024-09-13T06:39:36.219 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 1886327229 2024-09-13T06:39:36.219 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:36.219 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:36.219 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:36.219 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6801/1886327229", 2024-09-13T06:39:36.219 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.81:6803/1886327229", 2024-09-13T06:39:36.219 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.81:6807/1886327229", 2024-09-13T06:39:36.219 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.81:6805/1886327229", 2024-09-13T06:39:36.219 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2024-09-13T06:39:36.220 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2024-09-13T06:39:36.220 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2024-09-13T06:39:36.220 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:36.220 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:36.220 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:36.220 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 4, 2024-09-13T06:39:36.220 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "c9bd2751-c836-43dc-b844-e13678cb2fd9", 2024-09-13T06:39:36.220 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2024-09-13T06:39:36.220 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2024-09-13T06:39:36.220 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2024-09-13T06:39:36.220 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2024-09-13T06:39:36.220 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2024-09-13T06:39:36.221 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2024-09-13T06:39:36.221 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2024-09-13T06:39:36.221 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 21, 2024-09-13T06:39:36.221 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2024-09-13T06:39:36.221 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2024-09-13T06:39:36.221 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-13T06:39:36.221 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:39:36.221 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:36.221 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:39:36.221 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6817", 2024-09-13T06:39:36.221 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2184515621 2024-09-13T06:39:36.221 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:36.222 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:36.222 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:39:36.222 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6819", 2024-09-13T06:39:36.222 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2184515621 2024-09-13T06:39:36.222 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:36.222 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:36.222 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:36.222 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2024-09-13T06:39:36.222 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:39:36.222 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:36.222 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:39:36.222 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6820", 2024-09-13T06:39:36.222 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2184515621 2024-09-13T06:39:36.223 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:36.223 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:36.223 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:39:36.223 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6822", 2024-09-13T06:39:36.223 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2184515621 2024-09-13T06:39:36.223 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:36.223 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:36.223 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:36.223 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2024-09-13T06:39:36.223 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:39:36.223 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:36.223 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:39:36.223 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6827", 2024-09-13T06:39:36.223 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2184515621 2024-09-13T06:39:36.224 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:36.224 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:36.224 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:39:36.224 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6829", 2024-09-13T06:39:36.224 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2184515621 2024-09-13T06:39:36.224 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:36.224 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:36.224 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:36.224 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2024-09-13T06:39:36.224 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:39:36.224 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:36.224 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:39:36.224 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6824", 2024-09-13T06:39:36.225 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2184515621 2024-09-13T06:39:36.225 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:36.225 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:36.225 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:39:36.225 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6826", 2024-09-13T06:39:36.225 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2184515621 2024-09-13T06:39:36.225 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:36.225 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:36.225 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:36.225 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.139:6819/2184515621", 2024-09-13T06:39:36.225 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.139:6822/2184515621", 2024-09-13T06:39:36.225 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.139:6829/2184515621", 2024-09-13T06:39:36.225 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.139:6826/2184515621", 2024-09-13T06:39:36.226 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2024-09-13T06:39:36.226 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2024-09-13T06:39:36.226 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2024-09-13T06:39:36.226 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:36.226 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:36.226 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:36.226 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 5, 2024-09-13T06:39:36.226 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "2971b93a-6c9f-4b77-b526-4eac788fabf9", 2024-09-13T06:39:36.226 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2024-09-13T06:39:36.226 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2024-09-13T06:39:36.226 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2024-09-13T06:39:36.226 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2024-09-13T06:39:36.226 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2024-09-13T06:39:36.226 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2024-09-13T06:39:36.227 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2024-09-13T06:39:36.227 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 21, 2024-09-13T06:39:36.227 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2024-09-13T06:39:36.227 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2024-09-13T06:39:36.227 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-13T06:39:36.227 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:39:36.227 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:36.227 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:39:36.227 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6816", 2024-09-13T06:39:36.227 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 3982901834 2024-09-13T06:39:36.227 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:36.227 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:36.227 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:39:36.228 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6818", 2024-09-13T06:39:36.228 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 3982901834 2024-09-13T06:39:36.228 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:36.228 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:36.228 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:36.228 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2024-09-13T06:39:36.228 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:39:36.228 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:36.228 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:39:36.228 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6821", 2024-09-13T06:39:36.228 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 3982901834 2024-09-13T06:39:36.228 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:36.228 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:36.228 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:39:36.229 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6823", 2024-09-13T06:39:36.229 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 3982901834 2024-09-13T06:39:36.229 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:36.229 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:36.229 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:36.229 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2024-09-13T06:39:36.229 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:39:36.229 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:36.229 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:39:36.229 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6830", 2024-09-13T06:39:36.229 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 3982901834 2024-09-13T06:39:36.229 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:36.229 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:36.229 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:39:36.229 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6831", 2024-09-13T06:39:36.230 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 3982901834 2024-09-13T06:39:36.230 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:36.230 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:36.230 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:36.230 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2024-09-13T06:39:36.230 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:39:36.230 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:36.230 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:39:36.230 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6825", 2024-09-13T06:39:36.230 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 3982901834 2024-09-13T06:39:36.230 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:36.230 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:36.230 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:39:36.230 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6828", 2024-09-13T06:39:36.230 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 3982901834 2024-09-13T06:39:36.231 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:36.231 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:36.231 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:36.231 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.139:6818/3982901834", 2024-09-13T06:39:36.231 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.139:6823/3982901834", 2024-09-13T06:39:36.231 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.139:6831/3982901834", 2024-09-13T06:39:36.231 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.139:6828/3982901834", 2024-09-13T06:39:36.231 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2024-09-13T06:39:36.231 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2024-09-13T06:39:36.231 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2024-09-13T06:39:36.231 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:36.231 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:36.231 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:36.231 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 6, 2024-09-13T06:39:36.232 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "e1f786ce-579e-48cc-b212-83f881b94184", 2024-09-13T06:39:36.232 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2024-09-13T06:39:36.232 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2024-09-13T06:39:36.232 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2024-09-13T06:39:36.232 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2024-09-13T06:39:36.232 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2024-09-13T06:39:36.232 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2024-09-13T06:39:36.232 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2024-09-13T06:39:36.232 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 21, 2024-09-13T06:39:36.232 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2024-09-13T06:39:36.232 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2024-09-13T06:39:36.232 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-13T06:39:36.232 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:39:36.232 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:36.233 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:39:36.233 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6800", 2024-09-13T06:39:36.233 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2283932666 2024-09-13T06:39:36.233 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:36.233 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:36.233 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:39:36.233 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6801", 2024-09-13T06:39:36.233 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2283932666 2024-09-13T06:39:36.233 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:36.233 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:36.233 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:36.233 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2024-09-13T06:39:36.233 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:39:36.234 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:36.234 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:39:36.234 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6802", 2024-09-13T06:39:36.234 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2283932666 2024-09-13T06:39:36.234 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:36.234 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:36.234 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:39:36.234 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6803", 2024-09-13T06:39:36.234 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2283932666 2024-09-13T06:39:36.234 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:36.234 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:36.234 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:36.234 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2024-09-13T06:39:36.235 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:39:36.235 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:36.235 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:39:36.235 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6806", 2024-09-13T06:39:36.235 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2283932666 2024-09-13T06:39:36.235 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:36.235 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:36.235 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:39:36.235 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6807", 2024-09-13T06:39:36.235 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2283932666 2024-09-13T06:39:36.235 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:36.235 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:36.236 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:36.236 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2024-09-13T06:39:36.236 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:39:36.236 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:36.236 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:39:36.236 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6804", 2024-09-13T06:39:36.236 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2283932666 2024-09-13T06:39:36.236 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:36.236 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:36.236 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:39:36.236 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6805", 2024-09-13T06:39:36.236 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2283932666 2024-09-13T06:39:36.237 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:36.237 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:36.237 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:36.237 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.139:6801/2283932666", 2024-09-13T06:39:36.237 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.139:6803/2283932666", 2024-09-13T06:39:36.237 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.139:6807/2283932666", 2024-09-13T06:39:36.237 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.139:6805/2283932666", 2024-09-13T06:39:36.237 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2024-09-13T06:39:36.237 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2024-09-13T06:39:36.237 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2024-09-13T06:39:36.237 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:36.238 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:36.238 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:36.238 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 7, 2024-09-13T06:39:36.238 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "a287ddf6-84eb-4225-b267-25eee1657625", 2024-09-13T06:39:36.238 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2024-09-13T06:39:36.238 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2024-09-13T06:39:36.238 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2024-09-13T06:39:36.238 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2024-09-13T06:39:36.238 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2024-09-13T06:39:36.238 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2024-09-13T06:39:36.238 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2024-09-13T06:39:36.239 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 21, 2024-09-13T06:39:36.239 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2024-09-13T06:39:36.239 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2024-09-13T06:39:36.239 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-13T06:39:36.239 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:39:36.239 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:36.239 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:39:36.239 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6808", 2024-09-13T06:39:36.239 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2348111157 2024-09-13T06:39:36.240 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:36.240 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:36.240 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:39:36.240 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6809", 2024-09-13T06:39:36.240 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2348111157 2024-09-13T06:39:36.240 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:36.240 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:36.240 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:36.240 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2024-09-13T06:39:36.240 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:39:36.240 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:36.240 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:39:36.241 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6810", 2024-09-13T06:39:36.241 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2348111157 2024-09-13T06:39:36.241 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:36.241 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:36.242 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:39:36.242 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6811", 2024-09-13T06:39:36.242 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2348111157 2024-09-13T06:39:36.242 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:36.242 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:36.242 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:36.242 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2024-09-13T06:39:36.242 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:39:36.242 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:36.242 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:39:36.242 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6814", 2024-09-13T06:39:36.242 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2348111157 2024-09-13T06:39:36.243 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:36.243 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:36.243 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:39:36.243 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6815", 2024-09-13T06:39:36.243 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2348111157 2024-09-13T06:39:36.243 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:36.243 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:36.243 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:36.243 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2024-09-13T06:39:36.243 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:39:36.243 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:36.243 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:39:36.243 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6812", 2024-09-13T06:39:36.244 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2348111157 2024-09-13T06:39:36.244 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:36.244 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:36.244 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:39:36.244 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6813", 2024-09-13T06:39:36.244 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2348111157 2024-09-13T06:39:36.244 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:36.244 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:36.244 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:36.244 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.139:6809/2348111157", 2024-09-13T06:39:36.244 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.139:6811/2348111157", 2024-09-13T06:39:36.244 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.139:6815/2348111157", 2024-09-13T06:39:36.244 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.139:6813/2348111157", 2024-09-13T06:39:36.245 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2024-09-13T06:39:36.245 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2024-09-13T06:39:36.245 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2024-09-13T06:39:36.245 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:36.245 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:36.245 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-13T06:39:36.245 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_xinfo": [ 2024-09-13T06:39:36.245 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:36.245 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 0, 2024-09-13T06:39:36.245 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2024-09-13T06:39:36.245 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2024-09-13T06:39:36.245 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2024-09-13T06:39:36.245 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138322906710015, 2024-09-13T06:39:36.245 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2024-09-13T06:39:36.246 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2024-09-13T06:39:05.476871+0000", 2024-09-13T06:39:36.246 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2024-09-13T06:39:36.246 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:36.246 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:36.246 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 1, 2024-09-13T06:39:36.246 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2024-09-13T06:39:36.246 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2024-09-13T06:39:36.246 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2024-09-13T06:39:36.246 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138322906710015, 2024-09-13T06:39:36.246 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2024-09-13T06:39:36.246 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2024-09-13T06:39:05.455183+0000", 2024-09-13T06:39:36.246 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2024-09-13T06:39:36.246 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:36.247 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:36.247 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 2, 2024-09-13T06:39:36.247 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2024-09-13T06:39:36.247 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2024-09-13T06:39:36.247 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2024-09-13T06:39:36.247 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138322906710015, 2024-09-13T06:39:36.247 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2024-09-13T06:39:36.247 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2024-09-13T06:39:05.504853+0000", 2024-09-13T06:39:36.247 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2024-09-13T06:39:36.247 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:36.247 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:36.247 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 3, 2024-09-13T06:39:36.247 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2024-09-13T06:39:36.248 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2024-09-13T06:39:36.248 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2024-09-13T06:39:36.248 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138322906710015, 2024-09-13T06:39:36.248 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2024-09-13T06:39:36.248 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2024-09-13T06:39:05.372429+0000", 2024-09-13T06:39:36.248 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2024-09-13T06:39:36.248 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:36.248 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:36.248 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 4, 2024-09-13T06:39:36.248 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2024-09-13T06:39:36.248 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2024-09-13T06:39:36.248 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2024-09-13T06:39:36.248 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138322906710015, 2024-09-13T06:39:36.249 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2024-09-13T06:39:36.249 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2024-09-13T06:39:05.421023+0000", 2024-09-13T06:39:36.249 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2024-09-13T06:39:36.249 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:36.249 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:36.249 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 5, 2024-09-13T06:39:36.249 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2024-09-13T06:39:36.249 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2024-09-13T06:39:36.249 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2024-09-13T06:39:36.249 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138322906710015, 2024-09-13T06:39:36.249 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2024-09-13T06:39:36.249 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2024-09-13T06:39:05.477489+0000", 2024-09-13T06:39:36.250 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2024-09-13T06:39:36.250 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:36.250 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:36.250 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 6, 2024-09-13T06:39:36.250 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2024-09-13T06:39:36.250 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2024-09-13T06:39:36.250 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2024-09-13T06:39:36.250 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138322906710015, 2024-09-13T06:39:36.250 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2024-09-13T06:39:36.250 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2024-09-13T06:39:05.314700+0000", 2024-09-13T06:39:36.250 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2024-09-13T06:39:36.250 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:36.250 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:36.251 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 7, 2024-09-13T06:39:36.251 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2024-09-13T06:39:36.251 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2024-09-13T06:39:36.251 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2024-09-13T06:39:36.251 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138322906710015, 2024-09-13T06:39:36.251 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2024-09-13T06:39:36.251 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2024-09-13T06:39:05.462229+0000", 2024-09-13T06:39:36.251 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2024-09-13T06:39:36.251 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:36.251 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-13T06:39:36.251 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_upmap": [], 2024-09-13T06:39:36.251 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_upmap_items": [], 2024-09-13T06:39:36.251 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_upmap_primaries": [], 2024-09-13T06:39:36.252 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_temp": [], 2024-09-13T06:39:36.252 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_temp": [], 2024-09-13T06:39:36.252 INFO:teuthology.orchestra.run.smithi081.stdout: "blocklist": {}, 2024-09-13T06:39:36.252 INFO:teuthology.orchestra.run.smithi081.stdout: "range_blocklist": {}, 2024-09-13T06:39:36.252 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profiles": { 2024-09-13T06:39:36.252 INFO:teuthology.orchestra.run.smithi081.stdout: "default": { 2024-09-13T06:39:36.252 INFO:teuthology.orchestra.run.smithi081.stdout: "crush-failure-domain": "osd", 2024-09-13T06:39:36.252 INFO:teuthology.orchestra.run.smithi081.stdout: "k": "2", 2024-09-13T06:39:36.252 INFO:teuthology.orchestra.run.smithi081.stdout: "m": "1", 2024-09-13T06:39:36.252 INFO:teuthology.orchestra.run.smithi081.stdout: "plugin": "jerasure", 2024-09-13T06:39:36.252 INFO:teuthology.orchestra.run.smithi081.stdout: "technique": "reed_sol_van" 2024-09-13T06:39:36.252 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:36.252 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:36.253 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps_queue": [ 2024-09-13T06:39:36.253 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:36.253 INFO:teuthology.orchestra.run.smithi081.stdout: "pool": 3, 2024-09-13T06:39:36.253 INFO:teuthology.orchestra.run.smithi081.stdout: "snaps": [ 2024-09-13T06:39:36.253 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:36.253 INFO:teuthology.orchestra.run.smithi081.stdout: "begin": 2, 2024-09-13T06:39:36.253 INFO:teuthology.orchestra.run.smithi081.stdout: "length": 1 2024-09-13T06:39:36.253 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:36.253 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:36.253 INFO:teuthology.orchestra.run.smithi081.stdout: "begin": 5, 2024-09-13T06:39:36.253 INFO:teuthology.orchestra.run.smithi081.stdout: "length": 1 2024-09-13T06:39:36.253 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:36.253 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:36.254 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:36.254 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-13T06:39:36.254 INFO:teuthology.orchestra.run.smithi081.stdout: "new_removed_snaps": [], 2024-09-13T06:39:36.254 INFO:teuthology.orchestra.run.smithi081.stdout: "new_purged_snaps": [], 2024-09-13T06:39:36.254 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_node_flags": {}, 2024-09-13T06:39:36.254 INFO:teuthology.orchestra.run.smithi081.stdout: "device_class_flags": {}, 2024-09-13T06:39:36.254 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": { 2024-09-13T06:39:36.254 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode_enabled": false, 2024-09-13T06:39:36.254 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_bucket_count": 0, 2024-09-13T06:39:36.254 INFO:teuthology.orchestra.run.smithi081.stdout: "degraded_stretch_mode": 0, 2024-09-13T06:39:36.254 INFO:teuthology.orchestra.run.smithi081.stdout: "recovering_stretch_mode": 0, 2024-09-13T06:39:36.254 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode_bucket": 0 2024-09-13T06:39:36.254 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:36.254 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:39:36.256 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-13T06:39:36.257 INFO:tasks.ceph.osd.6.smithi139.stderr:2024-09-13T06:39:36.258+0000 7fcd02c5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26385) UID: 0 2024-09-13T06:39:36.257 INFO:tasks.thrashosds.thrasher:j is {'epoch': 28, 'fsid': 'e5612297-d004-4957-927e-afa37f30d6cf', 'created': '2024-09-13T06:38:56.670231+0000', 'modified': '2024-09-13T06:39:35.407905+0000', 'last_up_change': '2024-09-13T06:39:09.107597+0000', 'last_in_change': '2024-09-13T06:38:59.874387+0000', 'flags': 'sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5799936, 'flags_set': ['pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 4, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 3, 'max_osd': 8, 'require_min_compat_client': 'luminous', 'min_compat_client': 'jewel', 'require_osd_release': 'reef', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T06:39:09.600726+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-09-13T06:39:15.802118+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 3, 'snap_epoch': 20, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'pool_client.0', 'create_time': '2024-09-13T06:39:25.648942+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '28', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 7, 'snap_epoch': 28, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}], 'osds': [{'osd': 0, 'uuid': '54b0a3e4-58ad-4f95-86dc-29a11c9a1964', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 21, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6808', 'nonce': 1904727940}, {'type': 'v1', 'addr': '172.21.15.81:6809', 'nonce': 1904727940}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6810', 'nonce': 1904727940}, {'type': 'v1', 'addr': '172.21.15.81:6811', 'nonce': 1904727940}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6814', 'nonce': 1904727940}, {'type': 'v1', 'addr': '172.21.15.81:6815', 'nonce': 1904727940}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6812', 'nonce': 1904727940}, {'type': 'v1', 'addr': '172.21.15.81:6813', 'nonce': 1904727940}]}, 'public_addr': '172.21.15.81:6809/1904727940', 'cluster_addr': '172.21.15.81:6811/1904727940', 'heartbeat_back_addr': '172.21.15.81:6815/1904727940', 'heartbeat_front_addr': '172.21.15.81:6813/1904727940', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': 'a6dba5b9-c833-465e-a8a5-1741528b24c0', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 21, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6817', 'nonce': 738205570}, {'type': 'v1', 'addr': '172.21.15.81:6819', 'nonce': 738205570}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6822', 'nonce': 738205570}, {'type': 'v1', 'addr': '172.21.15.81:6824', 'nonce': 738205570}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6830', 'nonce': 738205570}, {'type': 'v1', 'addr': '172.21.15.81:6831', 'nonce': 738205570}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6826', 'nonce': 738205570}, {'type': 'v1', 'addr': '172.21.15.81:6829', 'nonce': 738205570}]}, 'public_addr': '172.21.15.81:6819/738205570', 'cluster_addr': '172.21.15.81:6824/738205570', 'heartbeat_back_addr': '172.21.15.81:6831/738205570', 'heartbeat_front_addr': '172.21.15.81:6829/738205570', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': '6c45097e-44a2-454f-80a4-0fe879ccd52f', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 17, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6816', 'nonce': 3558674335}, {'type': 'v1', 'addr': '172.21.15.81:6818', 'nonce': 3558674335}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6820', 'nonce': 3558674335}, {'type': 'v1', 'addr': '172.21.15.81:6821', 'nonce': 3558674335}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6827', 'nonce': 3558674335}, {'type': 'v1', 'addr': '172.21.15.81:6828', 'nonce': 3558674335}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6823', 'nonce': 3558674335}, {'type': 'v1', 'addr': '172.21.15.81:6825', 'nonce': 3558674335}]}, 'public_addr': '172.21.15.81:6818/3558674335', 'cluster_addr': '172.21.15.81:6821/3558674335', 'heartbeat_back_addr': '172.21.15.81:6828/3558674335', 'heartbeat_front_addr': '172.21.15.81:6825/3558674335', 'state': ['exists', 'up']}, {'osd': 3, 'uuid': '31952760-06f3-4618-a5c4-f5c4fed3aadb', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 21, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6800', 'nonce': 1886327229}, {'type': 'v1', 'addr': '172.21.15.81:6801', 'nonce': 1886327229}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6802', 'nonce': 1886327229}, {'type': 'v1', 'addr': '172.21.15.81:6803', 'nonce': 1886327229}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6806', 'nonce': 1886327229}, {'type': 'v1', 'addr': '172.21.15.81:6807', 'nonce': 1886327229}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6804', 'nonce': 1886327229}, {'type': 'v1', 'addr': '172.21.15.81:6805', 'nonce': 1886327229}]}, 'public_addr': '172.21.15.81:6801/1886327229', 'cluster_addr': '172.21.15.81:6803/1886327229', 'heartbeat_back_addr': '172.21.15.81:6807/1886327229', 'heartbeat_front_addr': '172.21.15.81:6805/1886327229', 'state': ['exists', 'up']}, {'osd': 4, 'uuid': 'c9bd2751-c836-43dc-b844-e13678cb2fd9', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 21, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.139:6817', 'nonce': 2184515621}, {'type': 'v1', 'addr': '172.21.15.139:6819', 'nonce': 2184515621}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.139:6820', 'nonce': 2184515621}, {'type': 'v1', 'addr': '172.21.15.139:6822', 'nonce': 2184515621}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.139:6827', 'nonce': 2184515621}, {'type': 'v1', 'addr': '172.21.15.139:6829', 'nonce': 2184515621}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.139:6824', 'nonce': 2184515621}, {'type': 'v1', 'addr': '172.21.15.139:6826', 'nonce': 2184515621}]}, 'public_addr': '172.21.15.139:6819/2184515621', 'cluster_addr': '172.21.15.139:6822/2184515621', 'heartbeat_back_addr': '172.21.15.139:6829/2184515621', 'heartbeat_front_addr': '172.21.15.139:6826/2184515621', 'state': ['exists', 'up']}, {'osd': 5, 'uuid': '2971b93a-6c9f-4b77-b526-4eac788fabf9', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 21, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.139:6816', 'nonce': 3982901834}, {'type': 'v1', 'addr': '172.21.15.139:6818', 'nonce': 3982901834}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.139:6821', 'nonce': 3982901834}, {'type': 'v1', 'addr': '172.21.15.139:6823', 'nonce': 3982901834}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.139:6830', 'nonce': 3982901834}, {'type': 'v1', 'addr': '172.21.15.139:6831', 'nonce': 3982901834}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.139:6825', 'nonce': 3982901834}, {'type': 'v1', 'addr': '172.21.15.139:6828', 'nonce': 3982901834}]}, 'public_addr': '172.21.15.139:6818/3982901834', 'cluster_addr': '172.21.15.139:6823/3982901834', 'heartbeat_back_addr': '172.21.15.139:6831/3982901834', 'heartbeat_front_addr': '172.21.15.139:6828/3982901834', 'state': ['exists', 'up']}, {'osd': 6, 'uuid': 'e1f786ce-579e-48cc-b212-83f881b94184', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 21, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.139:6800', 'nonce': 2283932666}, {'type': 'v1', 'addr': '172.21.15.139:6801', 'nonce': 2283932666}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.139:6802', 'nonce': 2283932666}, {'type': 'v1', 'addr': '172.21.15.139:6803', 'nonce': 2283932666}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.139:6806', 'nonce': 2283932666}, {'type': 'v1', 'addr': '172.21.15.139:6807', 'nonce': 2283932666}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.139:6804', 'nonce': 2283932666}, {'type': 'v1', 'addr': '172.21.15.139:6805', 'nonce': 2283932666}]}, 'public_addr': '172.21.15.139:6801/2283932666', 'cluster_addr': '172.21.15.139:6803/2283932666', 'heartbeat_back_addr': '172.21.15.139:6807/2283932666', 'heartbeat_front_addr': '172.21.15.139:6805/2283932666', 'state': ['exists', 'up']}, {'osd': 7, 'uuid': 'a287ddf6-84eb-4225-b267-25eee1657625', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 21, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.139:6808', 'nonce': 2348111157}, {'type': 'v1', 'addr': '172.21.15.139:6809', 'nonce': 2348111157}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.139:6810', 'nonce': 2348111157}, {'type': 'v1', 'addr': '172.21.15.139:6811', 'nonce': 2348111157}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.139:6814', 'nonce': 2348111157}, {'type': 'v1', 'addr': '172.21.15.139:6815', 'nonce': 2348111157}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.139:6812', 'nonce': 2348111157}, {'type': 'v1', 'addr': '172.21.15.139:6813', 'nonce': 2348111157}]}, 'public_addr': '172.21.15.139:6809/2348111157', 'cluster_addr': '172.21.15.139:6811/2348111157', 'heartbeat_back_addr': '172.21.15.139:6815/2348111157', 'heartbeat_front_addr': '172.21.15.139:6813/2348111157', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-13T06:39:05.476871+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-13T06:39:05.455183+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-13T06:39:05.504853+0000', 'dead_epoch': 0}, {'osd': 3, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-13T06:39:05.372429+0000', 'dead_epoch': 0}, {'osd': 4, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-13T06:39:05.421023+0000', 'dead_epoch': 0}, {'osd': 5, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-13T06:39:05.477489+0000', 'dead_epoch': 0}, {'osd': 6, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-13T06:39:05.314700+0000', 'dead_epoch': 0}, {'osd': 7, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-13T06:39:05.462229+0000', 'dead_epoch': 0}], 'pg_upmap': [], 'pg_upmap_items': [], 'pg_upmap_primaries': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [{'pool': 3, 'snaps': [{'begin': 2, 'length': 1}, {'begin': 5, 'length': 1}]}], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-09-13T06:39:36.258 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T06:39:36.356 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:39:36.359+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:39:36.453 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:39:36.453 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:39:36.457 INFO:tasks.ceph.osd.6.smithi139.stderr:2024-09-13T06:39:36.458+0000 7fcd02c5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26385) UID: 0 2024-09-13T06:39:36.471 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-13T06:39:36.558 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:39:36.559+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:39:36.634 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:39:36.634 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:39:36.648 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T06:39:36.649 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-09-13T06:39:36.650 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-13T06:39:36.659 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:39:36.663+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:39:36.666 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":35,"stamp":"2024-09-13T06:39:36.341939+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":4100067,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":1276,"num_read_kb":1107,"num_write":396,"num_write_kb":3370,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":318,"ondisk_log_size":318,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219840,"kb_used_data":3656,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754880,"statfs":{"total":773094113280,"available":772868997120,"internally_reserved":0,"allocated":3743744,"data_stored":2267018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":221236792},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":3509615,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1126,"num_read_kb":981,"num_write":229,"num_write_kb":946,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"3.949303"},"pg_stats":[{"pgid":"3.1f","version":"24'1","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T06:39:34.504822+0000","last_change":"2024-09-13T06:39:34.505001+0000","last_active":"2024-09-13T06:39:34.504822+0000","last_peered":"2024-09-13T06:39:34.504822+0000","last_clean":"2024-09-13T06:39:34.504822+0000","last_became_active":"2024-09-13T06:39:27.354227+0000","last_became_peered":"2024-09-13T06:39:27.354227+0000","last_unstale":"2024-09-13T06:39:34.504822+0000","last_undegraded":"2024-09-13T06:39:34.504822+0000","last_fullsized":"2024-09-13T06:39:34.504822+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:53:28.624134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00086096199999999995,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"},{"start":"5","length":"1"}]},{"pgid":"3.1e","version":"24'2","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T06:39:34.410372+0000","last_change":"2024-09-13T06:39:34.410606+0000","last_active":"2024-09-13T06:39:34.410372+0000","last_peered":"2024-09-13T06:39:34.410372+0000","last_clean":"2024-09-13T06:39:34.410372+0000","last_became_active":"2024-09-13T06:39:27.359006+0000","last_became_peered":"2024-09-13T06:39:27.359006+0000","last_unstale":"2024-09-13T06:39:34.410372+0000","last_undegraded":"2024-09-13T06:39:34.410372+0000","last_fullsized":"2024-09-13T06:39:34.410372+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:02:45.825350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00096259099999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"},{"start":"5","length":"1"}]},{"pgid":"3.1d","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T06:39:34.420863+0000","last_change":"2024-09-13T06:39:34.421201+0000","last_active":"2024-09-13T06:39:34.420863+0000","last_peered":"2024-09-13T06:39:34.420863+0000","last_clean":"2024-09-13T06:39:34.420863+0000","last_became_active":"2024-09-13T06:39:27.369952+0000","last_became_peered":"2024-09-13T06:39:27.369952+0000","last_unstale":"2024-09-13T06:39:34.420863+0000","last_undegraded":"2024-09-13T06:39:34.420863+0000","last_fullsized":"2024-09-13T06:39:34.420863+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:37:26.971480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00081480400000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"},{"start":"5","length":"1"}]},{"pgid":"3.1c","version":"25'6","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T06:39:34.421330+0000","last_change":"2024-09-13T06:39:34.422632+0000","last_active":"2024-09-13T06:39:34.421330+0000","last_peered":"2024-09-13T06:39:34.421330+0000","last_clean":"2024-09-13T06:39:34.421330+0000","last_became_active":"2024-09-13T06:39:27.369506+0000","last_became_peered":"2024-09-13T06:39:27.369506+0000","last_unstale":"2024-09-13T06:39:34.421330+0000","last_undegraded":"2024-09-13T06:39:34.421330+0000","last_fullsized":"2024-09-13T06:39:34.421330+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:22:58.980421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020233349999999998,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":6,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"},{"start":"5","length":"1"}]},{"pgid":"3.1b","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T06:39:34.504167+0000","last_change":"2024-09-13T06:39:34.504539+0000","last_active":"2024-09-13T06:39:34.504167+0000","last_peered":"2024-09-13T06:39:34.504167+0000","last_clean":"2024-09-13T06:39:34.504167+0000","last_became_active":"2024-09-13T06:39:27.371776+0000","last_became_peered":"2024-09-13T06:39:27.371776+0000","last_unstale":"2024-09-13T06:39:34.504167+0000","last_undegraded":"2024-09-13T06:39:34.504167+0000","last_fullsized":"2024-09-13T06:39:34.504167+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:25:31.311656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00068670799999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"},{"start":"5","length":"1"}]},{"pgid":"3.1a","version":"24'2","reported_seq":60,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T06:39:34.698368+0000","last_change":"2024-09-13T06:39:34.417092+0000","last_active":"2024-09-13T06:39:34.698368+0000","last_peered":"2024-09-13T06:39:34.698368+0000","last_clean":"2024-09-13T06:39:34.698368+0000","last_became_active":"2024-09-13T06:39:27.369118+0000","last_became_peered":"2024-09-13T06:39:27.369118+0000","last_unstale":"2024-09-13T06:39:34.698368+0000","last_undegraded":"2024-09-13T06:39:34.698368+0000","last_fullsized":"2024-09-13T06:39:34.698368+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:26:10.974045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00074675399999999997,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":36,"num_read_kb":36,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"2","length":"1"},{"start":"5","length":"1"}]},{"pgid":"3.19","version":"24'2","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T06:39:34.698409+0000","last_change":"2024-09-13T06:39:34.698728+0000","last_active":"2024-09-13T06:39:34.698409+0000","last_peered":"2024-09-13T06:39:34.698409+0000","last_clean":"2024-09-13T06:39:34.698409+0000","last_became_active":"2024-09-13T06:39:27.355617+0000","last_became_peered":"2024-09-13T06:39:27.355617+0000","last_unstale":"2024-09-13T06:39:34.698409+0000","last_undegraded":"2024-09-13T06:39:34.698409+0000","last_fullsized":"2024-09-13T06:39:34.698409+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:54:49.311122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00072724400000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"},{"start":"5","length":"1"}]},{"pgid":"3.18","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T06:39:34.409875+0000","last_change":"2024-09-13T06:39:34.410091+0000","last_active":"2024-09-13T06:39:34.409875+0000","last_peered":"2024-09-13T06:39:34.409875+0000","last_clean":"2024-09-13T06:39:34.409875+0000","last_became_active":"2024-09-13T06:39:27.349904+0000","last_became_peered":"2024-09-13T06:39:27.349904+0000","last_unstale":"2024-09-13T06:39:34.409875+0000","last_undegraded":"2024-09-13T06:39:34.409875+0000","last_fullsized":"2024-09-13T06:39:34.409875+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:27:19.676090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00062618500000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"},{"start":"5","length":"1"}]},{"pgid":"3.17","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T06:39:34.505175+0000","last_change":"2024-09-13T06:39:34.505423+0000","last_active":"2024-09-13T06:39:34.505175+0000","last_peered":"2024-09-13T06:39:34.505175+0000","last_clean":"2024-09-13T06:39:34.505175+0000","last_became_active":"2024-09-13T06:39:27.353665+0000","last_became_peered":"2024-09-13T06:39:27.353665+0000","last_unstale":"2024-09-13T06:39:34.505175+0000","last_undegraded":"2024-09-13T06:39:34.505175+0000","last_fullsized":"2024-09-13T06:39:34.505175+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:12:31.128336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001193775,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"},{"start":"5","length":"1"}]},{"pgid":"3.16","version":"27'4","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T06:39:34.587031+0000","last_change":"2024-09-13T06:39:34.423476+0000","last_active":"2024-09-13T06:39:34.587031+0000","last_peered":"2024-09-13T06:39:34.587031+0000","last_clean":"2024-09-13T06:39:34.587031+0000","last_became_active":"2024-09-13T06:39:27.376851+0000","last_became_peered":"2024-09-13T06:39:27.376851+0000","last_unstale":"2024-09-13T06:39:34.587031+0000","last_undegraded":"2024-09-13T06:39:34.587031+0000","last_fullsized":"2024-09-13T06:39:34.587031+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:59:49.761571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.003024437,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"},{"start":"5","length":"1"}]},{"pgid":"3.15","version":"24'4","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T06:39:34.431828+0000","last_change":"2024-09-13T06:39:34.432231+0000","last_active":"2024-09-13T06:39:34.431828+0000","last_peered":"2024-09-13T06:39:34.431828+0000","last_clean":"2024-09-13T06:39:34.431828+0000","last_became_active":"2024-09-13T06:39:27.373034+0000","last_became_peered":"2024-09-13T06:39:27.373034+0000","last_unstale":"2024-09-13T06:39:34.431828+0000","last_undegraded":"2024-09-13T06:39:34.431828+0000","last_fullsized":"2024-09-13T06:39:34.431828+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:50:31.984411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0025608670000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"},{"start":"5","length":"1"}]},{"pgid":"3.14","version":"27'61","reported_seq":85,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T06:39:34.417777+0000","last_change":"2024-09-13T06:39:34.417777+0000","last_active":"2024-09-13T06:39:34.417777+0000","last_peered":"2024-09-13T06:39:34.417777+0000","last_clean":"2024-09-13T06:39:34.417777+0000","last_became_active":"2024-09-13T06:39:27.372886+0000","last_became_peered":"2024-09-13T06:39:27.372886+0000","last_unstale":"2024-09-13T06:39:34.417777+0000","last_undegraded":"2024-09-13T06:39:34.417777+0000","last_fullsized":"2024-09-13T06:39:34.417777+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:11:57.872962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012045039999999999,"stat_sum":{"num_bytes":41,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":282,"num_read_kb":222,"num_write":95,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"2","length":"1"},{"start":"5","length":"1"}]},{"pgid":"2.7","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T06:39:33.415561+0000","last_change":"2024-09-13T06:39:19.552942+0000","last_active":"2024-09-13T06:39:33.415561+0000","last_peered":"2024-09-13T06:39:33.415561+0000","last_clean":"2024-09-13T06:39:33.415561+0000","last_became_active":"2024-09-13T06:39:17.535105+0000","last_became_peered":"2024-09-13T06:39:17.535105+0000","last_unstale":"2024-09-13T06:39:33.415561+0000","last_undegraded":"2024-09-13T06:39:33.415561+0000","last_fullsized":"2024-09-13T06:39:33.415561+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_clean_scrub_stamp":"2024-09-13T06:39:16.508974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:41:19.857628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00080324699999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"24'2","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T06:39:34.504538+0000","last_change":"2024-09-13T06:39:34.504764+0000","last_active":"2024-09-13T06:39:34.504538+0000","last_peered":"2024-09-13T06:39:34.504538+0000","last_clean":"2024-09-13T06:39:34.504538+0000","last_became_active":"2024-09-13T06:39:27.352170+0000","last_became_peered":"2024-09-13T06:39:27.352170+0000","last_unstale":"2024-09-13T06:39:34.504538+0000","last_undegraded":"2024-09-13T06:39:34.504538+0000","last_fullsized":"2024-09-13T06:39:34.504538+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:54:20.547109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00087184999999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":49,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"},{"start":"5","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T06:39:33.429923+0000","last_change":"2024-09-13T06:39:19.567201+0000","last_active":"2024-09-13T06:39:33.429923+0000","last_peered":"2024-09-13T06:39:33.429923+0000","last_clean":"2024-09-13T06:39:33.429923+0000","last_became_active":"2024-09-13T06:39:17.535411+0000","last_became_peered":"2024-09-13T06:39:17.535411+0000","last_unstale":"2024-09-13T06:39:33.429923+0000","last_undegraded":"2024-09-13T06:39:33.429923+0000","last_fullsized":"2024-09-13T06:39:33.429923+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_clean_scrub_stamp":"2024-09-13T06:39:16.508974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:44:11.617809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00097079800000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T06:39:34.410658+0000","last_change":"2024-09-13T06:39:34.411143+0000","last_active":"2024-09-13T06:39:34.410658+0000","last_peered":"2024-09-13T06:39:34.410658+0000","last_clean":"2024-09-13T06:39:34.410658+0000","last_became_active":"2024-09-13T06:39:27.375356+0000","last_became_peered":"2024-09-13T06:39:27.375356+0000","last_unstale":"2024-09-13T06:39:34.410658+0000","last_undegraded":"2024-09-13T06:39:34.410658+0000","last_fullsized":"2024-09-13T06:39:34.410658+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:56:26.610525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013748899999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"},{"start":"5","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T06:39:33.396927+0000","last_change":"2024-09-13T06:39:19.679994+0000","last_active":"2024-09-13T06:39:33.396927+0000","last_peered":"2024-09-13T06:39:33.396927+0000","last_clean":"2024-09-13T06:39:33.396927+0000","last_became_active":"2024-09-13T06:39:17.721806+0000","last_became_peered":"2024-09-13T06:39:17.721806+0000","last_unstale":"2024-09-13T06:39:33.396927+0000","last_undegraded":"2024-09-13T06:39:33.396927+0000","last_fullsized":"2024-09-13T06:39:33.396927+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_clean_scrub_stamp":"2024-09-13T06:39:16.508974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:34:49.893894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00064776899999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T06:39:34.698133+0000","last_change":"2024-09-13T06:39:34.698359+0000","last_active":"2024-09-13T06:39:34.698133+0000","last_peered":"2024-09-13T06:39:34.698133+0000","last_clean":"2024-09-13T06:39:34.698133+0000","last_became_active":"2024-09-13T06:39:27.452904+0000","last_became_peered":"2024-09-13T06:39:27.452904+0000","last_unstale":"2024-09-13T06:39:34.698133+0000","last_undegraded":"2024-09-13T06:39:34.698133+0000","last_fullsized":"2024-09-13T06:39:34.698133+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:44:12.553212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00031680100000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"},{"start":"5","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T06:39:33.429864+0000","last_change":"2024-09-13T06:39:19.567043+0000","last_active":"2024-09-13T06:39:33.429864+0000","last_peered":"2024-09-13T06:39:33.429864+0000","last_clean":"2024-09-13T06:39:33.429864+0000","last_became_active":"2024-09-13T06:39:17.721287+0000","last_became_peered":"2024-09-13T06:39:17.721287+0000","last_unstale":"2024-09-13T06:39:33.429864+0000","last_undegraded":"2024-09-13T06:39:33.429864+0000","last_fullsized":"2024-09-13T06:39:33.429864+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_clean_scrub_stamp":"2024-09-13T06:39:16.508974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:14:34.131074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000890396,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"27'1","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T06:39:34.423359+0000","last_change":"2024-09-13T06:39:34.423359+0000","last_active":"2024-09-13T06:39:34.423359+0000","last_peered":"2024-09-13T06:39:34.423359+0000","last_clean":"2024-09-13T06:39:34.423359+0000","last_became_active":"2024-09-13T06:39:27.359760+0000","last_became_peered":"2024-09-13T06:39:27.359760+0000","last_unstale":"2024-09-13T06:39:34.423359+0000","last_undegraded":"2024-09-13T06:39:34.423359+0000","last_fullsized":"2024-09-13T06:39:34.423359+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:57:54.852468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0026869530000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"},{"start":"5","length":"1"}]},{"pgid":"3.3","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T06:39:34.417179+0000","last_change":"2024-09-13T06:39:34.417625+0000","last_active":"2024-09-13T06:39:34.417179+0000","last_peered":"2024-09-13T06:39:34.417179+0000","last_clean":"2024-09-13T06:39:34.417179+0000","last_became_active":"2024-09-13T06:39:27.372337+0000","last_became_peered":"2024-09-13T06:39:27.372337+0000","last_unstale":"2024-09-13T06:39:34.417179+0000","last_undegraded":"2024-09-13T06:39:34.417179+0000","last_fullsized":"2024-09-13T06:39:34.417179+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:17:49.242059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001108372,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"2","length":"1"},{"start":"5","length":"1"}]},{"pgid":"2.2","version":"20'2","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T06:39:33.407483+0000","last_change":"2024-09-13T06:39:19.564386+0000","last_active":"2024-09-13T06:39:33.407483+0000","last_peered":"2024-09-13T06:39:33.407483+0000","last_clean":"2024-09-13T06:39:33.407483+0000","last_became_active":"2024-09-13T06:39:17.533677+0000","last_became_peered":"2024-09-13T06:39:17.533677+0000","last_unstale":"2024-09-13T06:39:33.407483+0000","last_undegraded":"2024-09-13T06:39:33.407483+0000","last_fullsized":"2024-09-13T06:39:33.407483+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_clean_scrub_stamp":"2024-09-13T06:39:16.508974+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:53:22.714840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001813556,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T06:39:34.698548+0000","last_change":"2024-09-13T06:39:34.698995+0000","last_active":"2024-09-13T06:39:34.698548+0000","last_peered":"2024-09-13T06:39:34.698548+0000","last_clean":"2024-09-13T06:39:34.698548+0000","last_became_active":"2024-09-13T06:39:27.453029+0000","last_became_peered":"2024-09-13T06:39:27.453029+0000","last_unstale":"2024-09-13T06:39:34.698548+0000","last_undegraded":"2024-09-13T06:39:34.698548+0000","last_fullsized":"2024-09-13T06:39:34.698548+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:30:11.714805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00071693099999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"},{"start":"5","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T06:39:34.107640+0000","last_change":"2024-09-13T06:39:20.303314+0000","last_active":"2024-09-13T06:39:34.107640+0000","last_peered":"2024-09-13T06:39:34.107640+0000","last_clean":"2024-09-13T06:39:34.107640+0000","last_became_active":"2024-09-13T06:39:17.536394+0000","last_became_peered":"2024-09-13T06:39:17.536394+0000","last_unstale":"2024-09-13T06:39:34.107640+0000","last_undegraded":"2024-09-13T06:39:34.107640+0000","last_fullsized":"2024-09-13T06:39:34.107640+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_clean_scrub_stamp":"2024-09-13T06:39:16.508974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:24:30.600904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00033592499999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"27'1","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T06:39:34.504846+0000","last_change":"2024-09-13T06:39:34.504846+0000","last_active":"2024-09-13T06:39:34.504846+0000","last_peered":"2024-09-13T06:39:34.504846+0000","last_clean":"2024-09-13T06:39:34.504846+0000","last_became_active":"2024-09-13T06:39:27.371900+0000","last_became_peered":"2024-09-13T06:39:27.371900+0000","last_unstale":"2024-09-13T06:39:34.504846+0000","last_undegraded":"2024-09-13T06:39:34.504846+0000","last_fullsized":"2024-09-13T06:39:34.504846+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:28:48.886885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00088878000000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"},{"start":"5","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T06:39:33.396648+0000","last_change":"2024-09-13T06:39:19.679784+0000","last_active":"2024-09-13T06:39:33.396648+0000","last_peered":"2024-09-13T06:39:33.396648+0000","last_clean":"2024-09-13T06:39:33.396648+0000","last_became_active":"2024-09-13T06:39:17.533439+0000","last_became_peered":"2024-09-13T06:39:17.533439+0000","last_unstale":"2024-09-13T06:39:33.396648+0000","last_undegraded":"2024-09-13T06:39:33.396648+0000","last_fullsized":"2024-09-13T06:39:33.396648+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_clean_scrub_stamp":"2024-09-13T06:39:16.508974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:12:49.774540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00061709999999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"25'1","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T06:39:34.528286+0000","last_change":"2024-09-13T06:39:34.410854+0000","last_active":"2024-09-13T06:39:34.528286+0000","last_peered":"2024-09-13T06:39:34.528286+0000","last_clean":"2024-09-13T06:39:34.528286+0000","last_became_active":"2024-09-13T06:39:27.353845+0000","last_became_peered":"2024-09-13T06:39:27.353845+0000","last_unstale":"2024-09-13T06:39:34.528286+0000","last_undegraded":"2024-09-13T06:39:34.528286+0000","last_fullsized":"2024-09-13T06:39:34.528286+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:18:56.689713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011747470000000001,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":11,"num_read_kb":3,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"},{"start":"5","length":"1"}]},{"pgid":"2.3","version":"18'1","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T06:39:33.407575+0000","last_change":"2024-09-13T06:39:19.563307+0000","last_active":"2024-09-13T06:39:33.407575+0000","last_peered":"2024-09-13T06:39:33.407575+0000","last_clean":"2024-09-13T06:39:33.407575+0000","last_became_active":"2024-09-13T06:39:17.536003+0000","last_became_peered":"2024-09-13T06:39:17.536003+0000","last_unstale":"2024-09-13T06:39:33.407575+0000","last_undegraded":"2024-09-13T06:39:33.407575+0000","last_fullsized":"2024-09-13T06:39:33.407575+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_clean_scrub_stamp":"2024-09-13T06:39:16.508974+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:12:22.307020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000698802,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":170,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T06:39:33.396739+0000","last_change":"2024-09-13T06:39:11.204643+0000","last_active":"2024-09-13T06:39:33.396739+0000","last_peered":"2024-09-13T06:39:33.396739+0000","last_clean":"2024-09-13T06:39:33.396739+0000","last_became_active":"2024-09-13T06:39:11.202831+0000","last_became_peered":"2024-09-13T06:39:11.202831+0000","last_unstale":"2024-09-13T06:39:33.396739+0000","last_undegraded":"2024-09-13T06:39:33.396739+0000","last_fullsized":"2024-09-13T06:39:33.396739+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:10.110558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:10.110558+0000","last_clean_scrub_stamp":"2024-09-13T06:39:10.110558+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:54:11.834414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T06:39:34.410322+0000","last_change":"2024-09-13T06:39:34.410539+0000","last_active":"2024-09-13T06:39:34.410322+0000","last_peered":"2024-09-13T06:39:34.410322+0000","last_clean":"2024-09-13T06:39:34.410322+0000","last_became_active":"2024-09-13T06:39:27.353023+0000","last_became_peered":"2024-09-13T06:39:27.353023+0000","last_unstale":"2024-09-13T06:39:34.410322+0000","last_undegraded":"2024-09-13T06:39:34.410322+0000","last_fullsized":"2024-09-13T06:39:34.410322+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:51:53.573072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00090777900000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"},{"start":"5","length":"1"}]},{"pgid":"3.9","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T06:39:34.416560+0000","last_change":"2024-09-13T06:39:34.417065+0000","last_active":"2024-09-13T06:39:34.416560+0000","last_peered":"2024-09-13T06:39:34.416560+0000","last_clean":"2024-09-13T06:39:34.416560+0000","last_became_active":"2024-09-13T06:39:27.452663+0000","last_became_peered":"2024-09-13T06:39:27.452663+0000","last_unstale":"2024-09-13T06:39:34.416560+0000","last_undegraded":"2024-09-13T06:39:34.416560+0000","last_fullsized":"2024-09-13T06:39:34.416560+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:03:40.676135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000871893,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"2","length":"1"},{"start":"5","length":"1"}]},{"pgid":"3.a","version":"27'3","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T06:39:34.523691+0000","last_change":"2024-09-13T06:39:34.523691+0000","last_active":"2024-09-13T06:39:34.523691+0000","last_peered":"2024-09-13T06:39:34.523691+0000","last_clean":"2024-09-13T06:39:34.523691+0000","last_became_active":"2024-09-13T06:39:27.374384+0000","last_became_peered":"2024-09-13T06:39:27.374384+0000","last_unstale":"2024-09-13T06:39:34.523691+0000","last_undegraded":"2024-09-13T06:39:34.523691+0000","last_fullsized":"2024-09-13T06:39:34.523691+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:21:45.720790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0017428400000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"2","length":"1"},{"start":"5","length":"1"}]},{"pgid":"3.b","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T06:39:34.409920+0000","last_change":"2024-09-13T06:39:34.410112+0000","last_active":"2024-09-13T06:39:34.409920+0000","last_peered":"2024-09-13T06:39:34.409920+0000","last_clean":"2024-09-13T06:39:34.409920+0000","last_became_active":"2024-09-13T06:39:27.352565+0000","last_became_peered":"2024-09-13T06:39:27.352565+0000","last_unstale":"2024-09-13T06:39:34.409920+0000","last_undegraded":"2024-09-13T06:39:34.409920+0000","last_fullsized":"2024-09-13T06:39:34.409920+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:16:19.108034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060548399999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"},{"start":"5","length":"1"}]},{"pgid":"3.c","version":"27'31","reported_seq":138,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T06:39:34.727915+0000","last_change":"2024-09-13T06:39:34.422774+0000","last_active":"2024-09-13T06:39:34.727915+0000","last_peered":"2024-09-13T06:39:34.727915+0000","last_clean":"2024-09-13T06:39:34.727915+0000","last_became_active":"2024-09-13T06:39:27.359518+0000","last_became_peered":"2024-09-13T06:39:27.359518+0000","last_unstale":"2024-09-13T06:39:34.727915+0000","last_undegraded":"2024-09-13T06:39:34.727915+0000","last_fullsized":"2024-09-13T06:39:34.727915+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:09:45.387352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0024705479999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":237,"num_read_kb":205,"num_write":32,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"},{"start":"5","length":"1"}]},{"pgid":"3.d","version":"24'2","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T06:39:34.432303+0000","last_change":"2024-09-13T06:39:34.432801+0000","last_active":"2024-09-13T06:39:34.432303+0000","last_peered":"2024-09-13T06:39:34.432303+0000","last_clean":"2024-09-13T06:39:34.432303+0000","last_became_active":"2024-09-13T06:39:27.371886+0000","last_became_peered":"2024-09-13T06:39:27.371886+0000","last_unstale":"2024-09-13T06:39:34.432303+0000","last_undegraded":"2024-09-13T06:39:34.432303+0000","last_fullsized":"2024-09-13T06:39:34.432303+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:38:02.248703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0029287900000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"},{"start":"5","length":"1"}]},{"pgid":"3.e","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T06:39:34.431742+0000","last_change":"2024-09-13T06:39:34.432185+0000","last_active":"2024-09-13T06:39:34.431742+0000","last_peered":"2024-09-13T06:39:34.431742+0000","last_clean":"2024-09-13T06:39:34.431742+0000","last_became_active":"2024-09-13T06:39:27.382408+0000","last_became_peered":"2024-09-13T06:39:27.382408+0000","last_unstale":"2024-09-13T06:39:34.431742+0000","last_undegraded":"2024-09-13T06:39:34.431742+0000","last_fullsized":"2024-09-13T06:39:34.431742+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:06:36.412421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0025489100000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"},{"start":"5","length":"1"}]},{"pgid":"3.f","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T06:39:34.432378+0000","last_change":"2024-09-13T06:39:34.432908+0000","last_active":"2024-09-13T06:39:34.432378+0000","last_peered":"2024-09-13T06:39:34.432378+0000","last_clean":"2024-09-13T06:39:34.432378+0000","last_became_active":"2024-09-13T06:39:27.382404+0000","last_became_peered":"2024-09-13T06:39:27.382404+0000","last_unstale":"2024-09-13T06:39:34.432378+0000","last_undegraded":"2024-09-13T06:39:34.432378+0000","last_fullsized":"2024-09-13T06:39:34.432378+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:45:40.841862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0027997849999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"},{"start":"5","length":"1"}]},{"pgid":"3.10","version":"27'45","reported_seq":235,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T06:39:34.523377+0000","last_change":"2024-09-13T06:39:34.523377+0000","last_active":"2024-09-13T06:39:34.523377+0000","last_peered":"2024-09-13T06:39:34.523377+0000","last_clean":"2024-09-13T06:39:34.523377+0000","last_became_active":"2024-09-13T06:39:27.361949+0000","last_became_peered":"2024-09-13T06:39:27.361949+0000","last_unstale":"2024-09-13T06:39:34.523377+0000","last_undegraded":"2024-09-13T06:39:34.523377+0000","last_fullsized":"2024-09-13T06:39:34.523377+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:37:21.237288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001582027,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":496,"num_read_kb":430,"num_write":47,"num_write_kb":184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"2","length":"1"},{"start":"5","length":"1"}]},{"pgid":"3.11","version":"27'22","reported_seq":48,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T06:39:34.733620+0000","last_change":"2024-09-13T06:39:34.431336+0000","last_active":"2024-09-13T06:39:34.733620+0000","last_peered":"2024-09-13T06:39:34.733620+0000","last_clean":"2024-09-13T06:39:34.733620+0000","last_became_active":"2024-09-13T06:39:27.381045+0000","last_became_peered":"2024-09-13T06:39:27.381045+0000","last_unstale":"2024-09-13T06:39:34.733620+0000","last_undegraded":"2024-09-13T06:39:34.733620+0000","last_fullsized":"2024-09-13T06:39:34.733620+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:00:28.836044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001915525,"stat_sum":{"num_bytes":42,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":66,"num_read_kb":48,"num_write":25,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"},{"start":"5","length":"1"}]},{"pgid":"3.12","version":"27'5","reported_seq":46,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T06:39:34.504461+0000","last_change":"2024-09-13T06:39:34.504461+0000","last_active":"2024-09-13T06:39:34.504461+0000","last_peered":"2024-09-13T06:39:34.504461+0000","last_clean":"2024-09-13T06:39:34.504461+0000","last_became_active":"2024-09-13T06:39:27.372076+0000","last_became_peered":"2024-09-13T06:39:27.372076+0000","last_unstale":"2024-09-13T06:39:34.504461+0000","last_undegraded":"2024-09-13T06:39:34.504461+0000","last_fullsized":"2024-09-13T06:39:34.504461+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:30:22.510547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00084821799999999998,"stat_sum":{"num_bytes":3509505,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":19,"num_read_kb":56,"num_write":5,"num_write_kb":162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"},{"start":"5","length":"1"}]},{"pgid":"3.13","version":"25'3","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T06:39:34.431075+0000","last_change":"2024-09-13T06:39:34.431521+0000","last_active":"2024-09-13T06:39:34.431075+0000","last_peered":"2024-09-13T06:39:34.431075+0000","last_clean":"2024-09-13T06:39:34.431075+0000","last_became_active":"2024-09-13T06:39:27.382544+0000","last_became_peered":"2024-09-13T06:39:27.382544+0000","last_unstale":"2024-09-13T06:39:34.431075+0000","last_undegraded":"2024-09-13T06:39:34.431075+0000","last_fullsized":"2024-09-13T06:39:34.431075+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:46:36.059537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0019694140000000001,"stat_sum":{"num_bytes":41,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":3,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"},{"start":"5","length":"1"}]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":3509680,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":1160,"num_read_kb":1007,"num_write":235,"num_write_kb":952,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":237568,"data_stored":174359,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":198,"ondisk_log_size":198,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574858,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28008,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343832,"statfs":{"total":96636764160,"available":96608083968,"internally_reserved":0,"allocated":1007616,"data_stored":809825,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56799999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.501}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93899999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68700000000000006}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1339999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.224}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0609999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":278528,"data_stored":105801,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77600000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36199999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64000000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55800000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57799999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54500000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41799999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574856,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27316,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":303104,"data_stored":112063,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83999999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81000000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71999999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69899999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.504}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45100000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47099999999999997}]}]},{"osd":4,"up_from":13,"seq":55834574856,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":294912,"data_stored":105940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61199999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59999999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80000000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88200000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56499999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.504}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76600000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574858,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":282624,"data_stored":105817,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44500000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39700000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41999999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76700000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65700000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79500000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91200000000000003}]}]},{"osd":2,"up_from":13,"seq":55834574856,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":290816,"data_stored":112012,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33500000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47399999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28299999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63500000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.623}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88100000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80200000000000005}]}]},{"osd":1,"up_from":13,"seq":55834574856,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":286720,"data_stored":105839,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54700000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68400000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1439999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1020000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1779999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2909999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2150000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574855,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28004,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343836,"statfs":{"total":96636764160,"available":96608088064,"internally_reserved":0,"allocated":999424,"data_stored":809721,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.505}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42399999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35899999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71199999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76300000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91600000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73699999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":56784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":16,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":143,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":32,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":139264,"data_stored":117365,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T06:39:36.669 INFO:tasks.thrashosds.thrasher:Setting 3.15 to [3, 7] 2024-09-13T06:39:36.669 INFO:tasks.thrashosds.thrasher:cmd ['osd', 'pg-upmap', '3.15', '3', '7'] 2024-09-13T06:39:36.670 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pg-upmap 3.15 3 7 2024-09-13T06:39:36.760 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:39:36.763+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:39:36.771 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:39:36.771 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:39:36.786 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-13T06:39:36.860 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:39:36.863+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:39:36.910 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:39:36.910 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:39:36.924 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-13T06:39:36.971 INFO:tasks.ceph.osd.6.smithi139.stderr:2024-09-13T06:39:36.974+0000 7fcd02c5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26385) UID: 0 2024-09-13T06:39:37.047 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:39:37.047 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:39:37.061 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-13T06:39:37.108 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:39:37.110+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:39:37.122 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-13T06:39:37.167 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:39:37.171+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:39:37.228 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:39:37.228 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:39:37.242 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-13T06:39:37.265 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:39:37.267+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:39:37.270 INFO:teuthology.orchestra.run.smithi081.stdout:osd.0: {} 2024-09-13T06:39:37.270 INFO:teuthology.orchestra.run.smithi081.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-13T06:39:37.286 INFO:teuthology.orchestra.run.smithi081.stdout:osd.1: {} 2024-09-13T06:39:37.287 INFO:teuthology.orchestra.run.smithi081.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-13T06:39:37.302 INFO:teuthology.orchestra.run.smithi081.stdout:osd.2: {} 2024-09-13T06:39:37.302 INFO:teuthology.orchestra.run.smithi081.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-13T06:39:37.319 INFO:teuthology.orchestra.run.smithi081.stdout:osd.3: {} 2024-09-13T06:39:37.319 INFO:teuthology.orchestra.run.smithi081.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-13T06:39:37.338 INFO:teuthology.orchestra.run.smithi081.stdout:osd.4: {} 2024-09-13T06:39:37.338 INFO:teuthology.orchestra.run.smithi081.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-13T06:39:37.358 INFO:teuthology.orchestra.run.smithi081.stdout:osd.5: {} 2024-09-13T06:39:37.358 INFO:teuthology.orchestra.run.smithi081.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-13T06:39:37.361 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:39:37.361 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:39:37.366 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:39:37.367+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:39:37.375 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-13T06:39:37.377 INFO:teuthology.orchestra.run.smithi081.stdout:osd.6: {} 2024-09-13T06:39:37.377 INFO:teuthology.orchestra.run.smithi081.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-13T06:39:37.394 INFO:teuthology.orchestra.run.smithi081.stdout:osd.7: {} 2024-09-13T06:39:37.394 INFO:teuthology.orchestra.run.smithi081.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-13T06:39:37.427 INFO:teuthology.orchestra.run.smithi081.stderr:set 3.15 pg_upmap mapping to [3,7] 2024-09-13T06:39:37.435 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-13T06:39:37.495 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:39:37.499+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:39:37.502 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:39:37.502 INFO:teuthology.orchestra.run.smithi139.stdout: "size": 20, 2024-09-13T06:39:37.502 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 600, 2024-09-13T06:39:37.502 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [ 2024-09-13T06:39:37.502 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:37.502 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4154.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-13T06:39:37.502 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:11.143816+0000", 2024-09-13T06:39:37.502 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 26.359841634999999, 2024-09-13T06:39:37.502 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.062483034, 2024-09-13T06:39:37.502 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:39:37.503 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:37.503 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:39:37.503 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4154", 2024-09-13T06:39:37.503 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/2406930292", 2024-09-13T06:39:37.503 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 1 2024-09-13T06:39:37.503 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:37.503 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:39:37.503 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:37.503 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:39:37.503 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.143816+0000", 2024-09-13T06:39:37.503 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:37.503 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:37.503 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:37.504 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:39:37.504 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.143816+0000", 2024-09-13T06:39:37.504 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:37.504 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:37.504 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:37.504 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:39:37.504 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.143814+0000", 2024-09-13T06:39:37.504 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999976 2024-09-13T06:39:37.504 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:37.504 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:37.504 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:39:37.504 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.143829+0000", 2024-09-13T06:39:37.504 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5316999999999999e-05 2024-09-13T06:39:37.505 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:37.505 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:37.505 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:39:37.505 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.143851+0000", 2024-09-13T06:39:37.505 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.1736999999999999e-05 2024-09-13T06:39:37.505 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:37.505 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:37.505 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:39:37.505 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.143870+0000", 2024-09-13T06:39:37.505 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.9185999999999999e-05 2024-09-13T06:39:37.505 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:37.505 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:37.506 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:39:37.506 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.143973+0000", 2024-09-13T06:39:37.506 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000102896 2024-09-13T06:39:37.506 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:37.506 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:37.506 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:39:37.506 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.143987+0000", 2024-09-13T06:39:37.506 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.401e-05 2024-09-13T06:39:37.506 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:37.506 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:37.506 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:39:37.506 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.203333+0000", 2024-09-13T06:39:37.506 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.059346614999999998 2024-09-13T06:39:37.506 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:37.506 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:37.507 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:39:37.507 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.203624+0000", 2024-09-13T06:39:37.507 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00029112700000000002 2024-09-13T06:39:37.507 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:37.507 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:37.507 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 0", 2024-09-13T06:39:37.507 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.203940+0000", 2024-09-13T06:39:37.507 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00031547200000000002 2024-09-13T06:39:37.507 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:37.507 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:37.507 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-13T06:39:37.507 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.205145+0000", 2024-09-13T06:39:37.507 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0012048930000000001 2024-09-13T06:39:37.507 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:37.508 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:37.508 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:39:37.508 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.206110+0000", 2024-09-13T06:39:37.508 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00096536600000000005 2024-09-13T06:39:37.508 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:37.508 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:37.508 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-13T06:39:37.508 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.206196+0000", 2024-09-13T06:39:37.508 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.5798999999999996e-05 2024-09-13T06:39:37.508 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:37.508 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:37.508 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:39:37.509 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.206299+0000", 2024-09-13T06:39:37.509 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00010279 2024-09-13T06:39:37.509 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:37.509 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:39:37.509 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:37.509 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:37.509 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:37.509 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4154.0:36 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-13T06:39:37.509 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:11.257357+0000", 2024-09-13T06:39:37.509 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 26.246300192, 2024-09-13T06:39:37.509 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.012807595, 2024-09-13T06:39:37.509 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:39:37.509 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:37.510 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:39:37.510 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4154", 2024-09-13T06:39:37.510 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/2406930292", 2024-09-13T06:39:37.510 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 36 2024-09-13T06:39:37.510 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:37.510 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:39:37.510 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:37.510 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:39:37.510 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.257357+0000", 2024-09-13T06:39:37.510 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:37.510 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:37.510 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:37.510 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:39:37.510 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.257357+0000", 2024-09-13T06:39:37.511 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:37.511 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:37.511 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:37.511 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:39:37.511 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.257356+0000", 2024-09-13T06:39:37.511 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:39:37.511 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:37.511 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:37.511 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:39:37.511 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.257378+0000", 2024-09-13T06:39:37.511 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.1988999999999999e-05 2024-09-13T06:39:37.511 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:37.511 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:37.511 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:39:37.512 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.257389+0000", 2024-09-13T06:39:37.512 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0343000000000001e-05 2024-09-13T06:39:37.512 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:37.512 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:37.512 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:39:37.512 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.257396+0000", 2024-09-13T06:39:37.512 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5839999999999997e-06 2024-09-13T06:39:37.512 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:37.512 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:37.512 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:39:37.512 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.264748+0000", 2024-09-13T06:39:37.512 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0073514640000000003 2024-09-13T06:39:37.513 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:37.513 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:37.513 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:39:37.513 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.264878+0000", 2024-09-13T06:39:37.513 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00012975500000000001 2024-09-13T06:39:37.513 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:37.513 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:37.513 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 0", 2024-09-13T06:39:37.513 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.265064+0000", 2024-09-13T06:39:37.513 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000186799 2024-09-13T06:39:37.513 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:37.513 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:37.513 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:39:37.513 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.267248+0000", 2024-09-13T06:39:37.514 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0021841230000000001 2024-09-13T06:39:37.514 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:37.514 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:37.514 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-13T06:39:37.514 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.269996+0000", 2024-09-13T06:39:37.514 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0027473419999999998 2024-09-13T06:39:37.514 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:37.514 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:37.514 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-13T06:39:37.514 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.270066+0000", 2024-09-13T06:39:37.514 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.0683000000000001e-05 2024-09-13T06:39:37.514 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:37.514 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:37.514 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:39:37.515 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.270165+0000", 2024-09-13T06:39:37.515 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.8319000000000005e-05 2024-09-13T06:39:37.515 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:37.515 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:39:37.515 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:37.515 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:37.515 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:37.515 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4154.0:37 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-13T06:39:37.515 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:11.257405+0000", 2024-09-13T06:39:37.515 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 26.246252011999999, 2024-09-13T06:39:37.515 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.012930476999999999, 2024-09-13T06:39:37.515 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:39:37.515 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:37.515 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:39:37.516 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4154", 2024-09-13T06:39:37.516 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/2406930292", 2024-09-13T06:39:37.516 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 37 2024-09-13T06:39:37.516 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:37.516 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:39:37.516 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:37.516 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:39:37.516 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.257405+0000", 2024-09-13T06:39:37.516 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:37.516 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:37.516 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:37.516 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:39:37.516 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.257405+0000", 2024-09-13T06:39:37.516 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:37.516 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:37.517 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:37.517 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:39:37.517 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.257405+0000", 2024-09-13T06:39:37.517 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:39:37.517 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:37.517 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:37.517 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:39:37.517 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.257411+0000", 2024-09-13T06:39:37.517 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.1500000000000004e-06 2024-09-13T06:39:37.517 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:37.517 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:37.517 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:39:37.518 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.257420+0000", 2024-09-13T06:39:37.518 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.986e-06 2024-09-13T06:39:37.518 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:37.518 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:37.518 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:39:37.518 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.257436+0000", 2024-09-13T06:39:37.518 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6433999999999999e-05 2024-09-13T06:39:37.518 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:37.518 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:37.518 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:39:37.518 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.265923+0000", 2024-09-13T06:39:37.518 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0084872009999999998 2024-09-13T06:39:37.518 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:37.518 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:37.519 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:39:37.519 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.266056+0000", 2024-09-13T06:39:37.519 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00013206599999999999 2024-09-13T06:39:37.519 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:37.519 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:37.519 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 0", 2024-09-13T06:39:37.519 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.266255+0000", 2024-09-13T06:39:37.519 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00019935100000000001 2024-09-13T06:39:37.519 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:37.519 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:37.519 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:39:37.519 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.267788+0000", 2024-09-13T06:39:37.519 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0015335380000000001 2024-09-13T06:39:37.520 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:37.520 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:37.520 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-13T06:39:37.520 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.270181+0000", 2024-09-13T06:39:37.520 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.002392136 2024-09-13T06:39:37.520 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:37.520 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:37.520 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-13T06:39:37.520 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.270245+0000", 2024-09-13T06:39:37.520 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.4401999999999998e-05 2024-09-13T06:39:37.520 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:37.520 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:37.520 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:39:37.520 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.270336+0000", 2024-09-13T06:39:37.521 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.0872999999999995e-05 2024-09-13T06:39:37.521 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:37.521 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:39:37.521 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:37.521 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:37.521 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:37.521 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4154.0:88 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-13T06:39:37.521 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:11.362174+0000", 2024-09-13T06:39:37.521 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 26.141483403999999, 2024-09-13T06:39:37.521 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.012171276, 2024-09-13T06:39:37.521 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:39:37.521 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:37.521 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:39:37.522 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4154", 2024-09-13T06:39:37.522 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/2406930292", 2024-09-13T06:39:37.522 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 88 2024-09-13T06:39:37.522 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:37.522 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:39:37.522 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:37.522 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:39:37.522 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.362174+0000", 2024-09-13T06:39:37.522 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:37.522 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:37.522 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:37.522 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:39:37.522 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.362174+0000", 2024-09-13T06:39:37.522 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:37.523 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:37.523 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:37.523 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:39:37.523 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.362172+0000", 2024-09-13T06:39:37.523 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999986 2024-09-13T06:39:37.523 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:37.523 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:37.523 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:39:37.523 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.362183+0000", 2024-09-13T06:39:37.523 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.081e-05 2024-09-13T06:39:37.523 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:37.523 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:37.523 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:39:37.524 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.362205+0000", 2024-09-13T06:39:37.524 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.1897000000000001e-05 2024-09-13T06:39:37.524 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:37.524 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:37.524 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:39:37.524 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.362221+0000", 2024-09-13T06:39:37.524 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5353e-05 2024-09-13T06:39:37.524 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:37.524 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:37.524 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:39:37.524 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.369202+0000", 2024-09-13T06:39:37.524 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0069816219999999998 2024-09-13T06:39:37.524 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:37.524 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:37.525 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:39:37.525 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.369323+0000", 2024-09-13T06:39:37.525 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000121156 2024-09-13T06:39:37.525 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:37.525 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:37.525 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 0", 2024-09-13T06:39:37.525 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.369683+0000", 2024-09-13T06:39:37.525 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00035930700000000001 2024-09-13T06:39:37.525 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:37.525 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:37.525 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:39:37.525 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.371448+0000", 2024-09-13T06:39:37.526 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.001765043 2024-09-13T06:39:37.526 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:37.526 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:37.526 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-13T06:39:37.526 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.374156+0000", 2024-09-13T06:39:37.526 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.002707999 2024-09-13T06:39:37.526 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:37.526 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:37.526 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-13T06:39:37.526 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.374243+0000", 2024-09-13T06:39:37.526 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6873000000000007e-05 2024-09-13T06:39:37.526 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:37.526 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:37.526 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:39:37.527 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.374345+0000", 2024-09-13T06:39:37.527 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00010272600000000001 2024-09-13T06:39:37.527 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:37.527 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:39:37.527 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:37.527 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:37.527 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:37.527 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4154.0:108 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-13T06:39:37.527 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:11.524074+0000", 2024-09-13T06:39:37.527 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 25.979583399999999, 2024-09-13T06:39:37.527 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.012736235, 2024-09-13T06:39:37.527 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:39:37.527 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:37.528 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:39:37.528 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4154", 2024-09-13T06:39:37.528 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/2406930292", 2024-09-13T06:39:37.528 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 108 2024-09-13T06:39:37.528 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:37.528 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:39:37.528 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:37.528 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:39:37.528 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.524074+0000", 2024-09-13T06:39:37.528 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:37.528 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:37.528 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:37.528 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:39:37.528 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.524074+0000", 2024-09-13T06:39:37.529 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:37.529 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:37.529 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:37.529 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:39:37.529 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.524073+0000", 2024-09-13T06:39:37.529 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:39:37.529 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:37.529 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:37.529 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:39:37.529 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.524084+0000", 2024-09-13T06:39:37.529 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1026000000000001e-05 2024-09-13T06:39:37.529 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:37.529 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:37.530 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:39:37.530 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.524102+0000", 2024-09-13T06:39:37.530 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7992999999999999e-05 2024-09-13T06:39:37.530 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:37.530 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:37.530 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:39:37.530 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.524140+0000", 2024-09-13T06:39:37.530 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.8277e-05 2024-09-13T06:39:37.530 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:37.530 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:37.530 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:39:37.530 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.528884+0000", 2024-09-13T06:39:37.530 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.004743761 2024-09-13T06:39:37.531 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:37.531 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:37.531 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:39:37.531 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.529006+0000", 2024-09-13T06:39:37.531 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000121829 2024-09-13T06:39:37.531 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:37.531 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:37.531 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 0", 2024-09-13T06:39:37.531 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.529196+0000", 2024-09-13T06:39:37.531 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000189731 2024-09-13T06:39:37.531 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:37.531 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:37.531 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:39:37.532 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.535697+0000", 2024-09-13T06:39:37.532 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0065011499999999998 2024-09-13T06:39:37.532 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:37.532 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:37.532 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-13T06:39:37.532 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.536644+0000", 2024-09-13T06:39:37.532 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00094732900000000001 2024-09-13T06:39:37.532 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:37.532 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:37.532 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-13T06:39:37.532 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.536712+0000", 2024-09-13T06:39:37.532 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.8303e-05 2024-09-13T06:39:37.532 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:37.533 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:37.533 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:39:37.533 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.536810+0000", 2024-09-13T06:39:37.533 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.7918999999999995e-05 2024-09-13T06:39:37.533 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:37.533 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:39:37.533 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:37.533 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:37.533 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:37.533 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4154.0:109 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-13T06:39:37.533 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:11.524169+0000", 2024-09-13T06:39:37.533 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 25.979488474, 2024-09-13T06:39:37.533 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.013995285999999999, 2024-09-13T06:39:37.534 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:39:37.534 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:37.534 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:39:37.534 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4154", 2024-09-13T06:39:37.534 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/2406930292", 2024-09-13T06:39:37.534 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 109 2024-09-13T06:39:37.534 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:37.534 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:39:37.534 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:37.534 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:39:37.534 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.524169+0000", 2024-09-13T06:39:37.534 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:37.534 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:37.535 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:37.535 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:39:37.535 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.524169+0000", 2024-09-13T06:39:37.535 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:37.535 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:37.535 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:37.535 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:39:37.535 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.524168+0000", 2024-09-13T06:39:37.535 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:39:37.535 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:37.535 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:37.535 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:39:37.535 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.524427+0000", 2024-09-13T06:39:37.535 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00025929799999999998 2024-09-13T06:39:37.536 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:37.536 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:37.536 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:39:37.536 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.524451+0000", 2024-09-13T06:39:37.536 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.3686e-05 2024-09-13T06:39:37.536 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:37.536 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:37.536 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:39:37.536 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.524468+0000", 2024-09-13T06:39:37.536 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7577000000000001e-05 2024-09-13T06:39:37.536 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:37.536 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:37.536 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:39:37.537 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.530416+0000", 2024-09-13T06:39:37.537 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0059474080000000004 2024-09-13T06:39:37.537 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:37.537 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:37.537 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:39:37.537 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.530553+0000", 2024-09-13T06:39:37.537 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000137742 2024-09-13T06:39:37.537 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:37.537 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:37.537 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 0", 2024-09-13T06:39:37.537 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.530749+0000", 2024-09-13T06:39:37.537 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000195608 2024-09-13T06:39:37.537 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:37.538 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:37.538 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-13T06:39:37.538 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.536836+0000", 2024-09-13T06:39:37.538 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.006086546 2024-09-13T06:39:37.538 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:37.538 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:37.538 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:39:37.538 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.538038+0000", 2024-09-13T06:39:37.538 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0012019509999999999 2024-09-13T06:39:37.538 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:37.538 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:37.538 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-13T06:39:37.538 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.538106+0000", 2024-09-13T06:39:37.539 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.8923000000000004e-05 2024-09-13T06:39:37.539 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:37.539 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:37.539 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:39:37.539 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.538164+0000", 2024-09-13T06:39:37.539 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.7729999999999998e-05 2024-09-13T06:39:37.539 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:37.539 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:39:37.539 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:37.539 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:37.539 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:37.539 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4154.0:110 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-13T06:39:37.539 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:11.524488+0000", 2024-09-13T06:39:37.539 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 25.979168996999999, 2024-09-13T06:39:37.540 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.013976323000000001, 2024-09-13T06:39:37.540 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:39:37.540 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:37.540 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:39:37.540 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4154", 2024-09-13T06:39:37.540 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/2406930292", 2024-09-13T06:39:37.540 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 110 2024-09-13T06:39:37.540 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:37.540 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:39:37.540 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:37.540 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:39:37.540 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.524488+0000", 2024-09-13T06:39:37.540 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:37.541 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:37.541 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:37.541 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:39:37.541 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.524488+0000", 2024-09-13T06:39:37.541 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:37.541 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:37.541 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:37.541 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:39:37.541 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.524487+0000", 2024-09-13T06:39:37.541 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999986 2024-09-13T06:39:37.541 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:37.541 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:37.541 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:39:37.541 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.524498+0000", 2024-09-13T06:39:37.542 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1579999999999999e-05 2024-09-13T06:39:37.542 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:37.542 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:37.542 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:39:37.542 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.524516+0000", 2024-09-13T06:39:37.542 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7776000000000001e-05 2024-09-13T06:39:37.542 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:37.542 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:37.542 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:39:37.542 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.524530+0000", 2024-09-13T06:39:37.542 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3896999999999999e-05 2024-09-13T06:39:37.542 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:37.542 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:37.543 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:39:37.543 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.532254+0000", 2024-09-13T06:39:37.543 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0077239409999999998 2024-09-13T06:39:37.543 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:37.543 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:37.543 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:39:37.543 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.532371+0000", 2024-09-13T06:39:37.543 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000117176 2024-09-13T06:39:37.543 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:37.543 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:37.543 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 0", 2024-09-13T06:39:37.543 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.532551+0000", 2024-09-13T06:39:37.543 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00018004100000000001 2024-09-13T06:39:37.543 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:37.544 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:37.544 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:39:37.544 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.538280+0000", 2024-09-13T06:39:37.544 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0057289230000000003 2024-09-13T06:39:37.544 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:37.544 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:37.544 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-13T06:39:37.544 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.538294+0000", 2024-09-13T06:39:37.544 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.4070000000000001e-05 2024-09-13T06:39:37.544 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:37.544 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:37.544 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-13T06:39:37.545 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.538368+0000", 2024-09-13T06:39:37.545 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.3604999999999997e-05 2024-09-13T06:39:37.545 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:37.545 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:37.545 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:39:37.545 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.538465+0000", 2024-09-13T06:39:37.545 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6830000000000006e-05 2024-09-13T06:39:37.545 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:37.545 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:39:37.545 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:37.545 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:37.545 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:37.545 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4154.0:111 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-13T06:39:37.545 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:11.524546+0000", 2024-09-13T06:39:37.546 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 25.979111563, 2024-09-13T06:39:37.546 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.016412307000000001, 2024-09-13T06:39:37.546 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:39:37.546 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:37.546 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:39:37.546 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4154", 2024-09-13T06:39:37.546 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/2406930292", 2024-09-13T06:39:37.546 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 111 2024-09-13T06:39:37.546 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:37.546 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:39:37.546 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:37.546 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:39:37.546 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.524546+0000", 2024-09-13T06:39:37.547 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:37.547 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:37.547 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:37.547 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:39:37.547 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.524546+0000", 2024-09-13T06:39:37.547 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:37.547 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:37.547 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:37.547 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:39:37.547 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.524545+0000", 2024-09-13T06:39:37.547 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:39:37.547 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:37.547 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:37.547 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:39:37.548 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.524555+0000", 2024-09-13T06:39:37.548 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0176e-05 2024-09-13T06:39:37.548 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:37.548 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:37.548 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:39:37.548 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.524577+0000", 2024-09-13T06:39:37.548 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.1756999999999999e-05 2024-09-13T06:39:37.548 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:37.548 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:37.548 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:39:37.548 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.524592+0000", 2024-09-13T06:39:37.548 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5345999999999998e-05 2024-09-13T06:39:37.548 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:37.548 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:37.549 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:39:37.549 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.533407+0000", 2024-09-13T06:39:37.549 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0088150559999999999 2024-09-13T06:39:37.549 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:37.549 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:37.549 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:39:37.549 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.533523+0000", 2024-09-13T06:39:37.549 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000116099 2024-09-13T06:39:37.549 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:37.549 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:37.549 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 0", 2024-09-13T06:39:37.549 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.533734+0000", 2024-09-13T06:39:37.549 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000211005 2024-09-13T06:39:37.549 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:37.550 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:37.550 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-13T06:39:37.550 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.538484+0000", 2024-09-13T06:39:37.550 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0047494900000000003 2024-09-13T06:39:37.550 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:37.550 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:37.550 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:39:37.550 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.540823+0000", 2024-09-13T06:39:37.550 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0023390889999999999 2024-09-13T06:39:37.550 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:37.550 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:37.550 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-13T06:39:37.550 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.540898+0000", 2024-09-13T06:39:37.550 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5449000000000002e-05 2024-09-13T06:39:37.551 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:37.551 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:37.551 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:39:37.551 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.540958+0000", 2024-09-13T06:39:37.551 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.9889999999999997e-05 2024-09-13T06:39:37.551 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:37.551 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:39:37.551 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:37.551 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:37.551 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:37.551 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4154.0:112 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-13T06:39:37.551 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:11.524610+0000", 2024-09-13T06:39:37.551 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 25.979047844, 2024-09-13T06:39:37.551 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.016538458999999998, 2024-09-13T06:39:37.552 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:39:37.552 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:37.552 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:39:37.552 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4154", 2024-09-13T06:39:37.552 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/2406930292", 2024-09-13T06:39:37.552 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 112 2024-09-13T06:39:37.552 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:37.552 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:39:37.552 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:37.552 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:39:37.552 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.524610+0000", 2024-09-13T06:39:37.552 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:37.552 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:37.553 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:37.553 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:39:37.553 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.524610+0000", 2024-09-13T06:39:37.553 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:37.553 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:37.553 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:37.553 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:39:37.553 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.524608+0000", 2024-09-13T06:39:37.553 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:39:37.553 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:37.553 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:37.553 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:39:37.553 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.524826+0000", 2024-09-13T06:39:37.553 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000217226 2024-09-13T06:39:37.554 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:37.554 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:37.554 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:39:37.554 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.524848+0000", 2024-09-13T06:39:37.554 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.2802999999999998e-05 2024-09-13T06:39:37.554 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:37.554 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:37.554 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:39:37.554 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.524906+0000", 2024-09-13T06:39:37.554 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.7878999999999999e-05 2024-09-13T06:39:37.554 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:37.554 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:37.554 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:39:37.554 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.534402+0000", 2024-09-13T06:39:37.555 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0094956769999999992 2024-09-13T06:39:37.555 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:37.555 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:37.555 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:39:37.555 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.534512+0000", 2024-09-13T06:39:37.555 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000110493 2024-09-13T06:39:37.555 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:37.555 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:37.555 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 0", 2024-09-13T06:39:37.555 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.534688+0000", 2024-09-13T06:39:37.555 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00017564499999999999 2024-09-13T06:39:37.555 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:37.555 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:37.556 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-13T06:39:37.556 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.538493+0000", 2024-09-13T06:39:37.556 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0038051399999999998 2024-09-13T06:39:37.556 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:37.556 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:37.556 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:39:37.556 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.541030+0000", 2024-09-13T06:39:37.556 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0025368080000000002 2024-09-13T06:39:37.556 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:37.556 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:37.556 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-13T06:39:37.556 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.541097+0000", 2024-09-13T06:39:37.556 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.6933000000000004e-05 2024-09-13T06:39:37.556 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:37.557 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:37.557 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:39:37.557 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.541148+0000", 2024-09-13T06:39:37.557 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.1008999999999999e-05 2024-09-13T06:39:37.557 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:37.557 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:39:37.557 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:37.557 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:37.557 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:37.557 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4154.0:113 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-13T06:39:37.557 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:11.524940+0000", 2024-09-13T06:39:37.557 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 25.97871688, 2024-09-13T06:39:37.557 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.017201570999999999, 2024-09-13T06:39:37.557 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:39:37.558 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:37.558 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:39:37.558 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4154", 2024-09-13T06:39:37.558 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/2406930292", 2024-09-13T06:39:37.558 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 113 2024-09-13T06:39:37.558 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:37.558 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:39:37.558 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:37.558 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:39:37.558 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.524940+0000", 2024-09-13T06:39:37.558 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:37.558 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:37.558 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:37.558 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:39:37.559 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.524940+0000", 2024-09-13T06:39:37.559 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:37.559 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:37.559 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:37.559 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:39:37.559 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.524938+0000", 2024-09-13T06:39:37.559 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999981 2024-09-13T06:39:37.559 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:37.559 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:37.559 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:39:37.559 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.524951+0000", 2024-09-13T06:39:37.559 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2993000000000001e-05 2024-09-13T06:39:37.559 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:37.560 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:37.560 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:39:37.560 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.524976+0000", 2024-09-13T06:39:37.560 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.4216999999999999e-05 2024-09-13T06:39:37.560 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:37.560 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:37.560 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:39:37.560 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.525000+0000", 2024-09-13T06:39:37.560 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.3986e-05 2024-09-13T06:39:37.560 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:37.560 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:37.560 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:39:37.560 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.535786+0000", 2024-09-13T06:39:37.561 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.010786733999999999 2024-09-13T06:39:37.561 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:37.561 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:37.561 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:39:37.561 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.535916+0000", 2024-09-13T06:39:37.561 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000129865 2024-09-13T06:39:37.561 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:37.561 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:37.561 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 0", 2024-09-13T06:39:37.561 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.536106+0000", 2024-09-13T06:39:37.561 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000190046 2024-09-13T06:39:37.561 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:37.561 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:37.561 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-13T06:39:37.562 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.540977+0000", 2024-09-13T06:39:37.562 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0048708730000000004 2024-09-13T06:39:37.562 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:37.562 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:37.562 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:39:37.562 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.542023+0000", 2024-09-13T06:39:37.562 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0010456179999999999 2024-09-13T06:39:37.562 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:37.562 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:37.562 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-13T06:39:37.562 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.542091+0000", 2024-09-13T06:39:37.562 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.7840000000000001e-05 2024-09-13T06:39:37.562 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:37.563 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:37.563 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:39:37.563 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.542142+0000", 2024-09-13T06:39:37.563 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.1399e-05 2024-09-13T06:39:37.563 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:37.563 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:39:37.563 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:37.563 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:37.563 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:37.563 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4154.0:114 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-13T06:39:37.563 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:11.525025+0000", 2024-09-13T06:39:37.563 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 25.978632001000001, 2024-09-13T06:39:37.564 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.017310847000000001, 2024-09-13T06:39:37.564 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:39:37.564 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:37.564 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:39:37.564 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4154", 2024-09-13T06:39:37.564 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/2406930292", 2024-09-13T06:39:37.564 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 114 2024-09-13T06:39:37.564 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:37.564 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:39:37.564 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:37.564 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:39:37.564 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.525025+0000", 2024-09-13T06:39:37.564 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:37.565 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:37.565 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:37.565 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:39:37.565 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.525025+0000", 2024-09-13T06:39:37.565 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:37.565 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:37.565 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:37.565 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:39:37.565 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.525024+0000", 2024-09-13T06:39:37.565 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999986 2024-09-13T06:39:37.565 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:37.565 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:37.565 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:39:37.565 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.525035+0000", 2024-09-13T06:39:37.566 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1413999999999999e-05 2024-09-13T06:39:37.566 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:37.566 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:37.567 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:39:37.567 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.525054+0000", 2024-09-13T06:39:37.567 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.8723e-05 2024-09-13T06:39:37.567 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:37.567 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:37.567 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:39:37.567 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.525068+0000", 2024-09-13T06:39:37.567 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.4022999999999999e-05 2024-09-13T06:39:37.567 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:37.567 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:37.567 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:39:37.567 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.536923+0000", 2024-09-13T06:39:37.567 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.011854821999999999 2024-09-13T06:39:37.568 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:37.568 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:37.568 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:39:37.568 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.537048+0000", 2024-09-13T06:39:37.568 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000125399 2024-09-13T06:39:37.568 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:37.568 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:37.568 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 0", 2024-09-13T06:39:37.568 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.537293+0000", 2024-09-13T06:39:37.568 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00024499500000000002 2024-09-13T06:39:37.568 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:37.568 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:37.568 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-13T06:39:37.569 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.541962+0000", 2024-09-13T06:39:37.569 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0046680940000000002 2024-09-13T06:39:37.569 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:37.569 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:37.569 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:39:37.569 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.542218+0000", 2024-09-13T06:39:37.569 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00025668199999999999 2024-09-13T06:39:37.569 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:37.569 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:37.569 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-13T06:39:37.569 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.542286+0000", 2024-09-13T06:39:37.569 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.7565999999999997e-05 2024-09-13T06:39:37.569 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:37.569 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:37.570 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:39:37.570 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.542336+0000", 2024-09-13T06:39:37.570 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.0429000000000001e-05 2024-09-13T06:39:37.570 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:37.570 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:39:37.570 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:37.570 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:37.570 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:37.570 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4154.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-13T06:39:37.570 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:11.525085+0000", 2024-09-13T06:39:37.570 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 25.978572821, 2024-09-13T06:39:37.570 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.019358490999999999, 2024-09-13T06:39:37.570 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:39:37.570 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:37.571 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:39:37.571 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4154", 2024-09-13T06:39:37.571 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/2406930292", 2024-09-13T06:39:37.571 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 115 2024-09-13T06:39:37.571 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:37.571 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:39:37.571 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:37.571 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:39:37.571 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.525085+0000", 2024-09-13T06:39:37.571 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:37.571 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:37.571 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:37.571 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:39:37.571 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.525085+0000", 2024-09-13T06:39:37.572 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:37.572 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:37.572 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:37.572 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:39:37.572 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.525083+0000", 2024-09-13T06:39:37.572 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:39:37.572 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:37.572 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:37.572 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:39:37.572 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.525302+0000", 2024-09-13T06:39:37.572 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00021804499999999999 2024-09-13T06:39:37.572 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:37.572 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:37.572 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:39:37.573 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.525324+0000", 2024-09-13T06:39:37.573 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.2147e-05 2024-09-13T06:39:37.573 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:37.573 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:37.573 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:39:37.573 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.525340+0000", 2024-09-13T06:39:37.573 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5879000000000002e-05 2024-09-13T06:39:37.573 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:37.573 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:37.573 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:39:37.573 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.538555+0000", 2024-09-13T06:39:37.573 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.013215499 2024-09-13T06:39:37.573 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:37.574 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:37.574 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:39:37.574 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.538703+0000", 2024-09-13T06:39:37.574 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00014755200000000001 2024-09-13T06:39:37.574 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:37.574 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:37.574 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 0", 2024-09-13T06:39:37.574 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.538967+0000", 2024-09-13T06:39:37.574 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00026453799999999998 2024-09-13T06:39:37.574 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:37.574 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:37.574 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-13T06:39:37.574 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.541969+0000", 2024-09-13T06:39:37.574 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00300184 2024-09-13T06:39:37.575 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:37.575 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:37.575 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:39:37.575 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.544287+0000", 2024-09-13T06:39:37.575 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0023178890000000001 2024-09-13T06:39:37.575 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:37.575 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:37.575 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-13T06:39:37.575 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.544378+0000", 2024-09-13T06:39:37.575 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.1366000000000006e-05 2024-09-13T06:39:37.575 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:37.575 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:37.575 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:39:37.576 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.544443+0000", 2024-09-13T06:39:37.576 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.4826000000000006e-05 2024-09-13T06:39:37.576 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:37.576 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:39:37.576 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:37.576 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:37.576 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:37.576 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4154.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-13T06:39:37.576 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:11.525359+0000", 2024-09-13T06:39:37.576 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 25.978298793, 2024-09-13T06:39:37.576 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.019359514000000001, 2024-09-13T06:39:37.576 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:39:37.576 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:37.576 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:39:37.577 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4154", 2024-09-13T06:39:37.577 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/2406930292", 2024-09-13T06:39:37.577 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 116 2024-09-13T06:39:37.577 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:37.577 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:39:37.577 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:37.577 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:39:37.577 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.525359+0000", 2024-09-13T06:39:37.577 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:37.577 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:37.577 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:37.577 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:39:37.577 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.525359+0000", 2024-09-13T06:39:37.578 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:37.578 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:37.578 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:37.578 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:39:37.578 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.525357+0000", 2024-09-13T06:39:37.578 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999981 2024-09-13T06:39:37.578 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:37.578 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:37.578 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:39:37.578 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.525369+0000", 2024-09-13T06:39:37.578 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1647e-05 2024-09-13T06:39:37.578 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:37.578 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:37.578 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:39:37.579 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.525386+0000", 2024-09-13T06:39:37.579 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7762999999999999e-05 2024-09-13T06:39:37.579 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:37.579 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:37.579 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:39:37.579 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.525400+0000", 2024-09-13T06:39:37.579 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.4053000000000001e-05 2024-09-13T06:39:37.579 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:37.579 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:37.579 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:39:37.579 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.539897+0000", 2024-09-13T06:39:37.579 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.014497128999999999 2024-09-13T06:39:37.579 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:37.579 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:37.580 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:39:37.580 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.540022+0000", 2024-09-13T06:39:37.580 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00012416599999999999 2024-09-13T06:39:37.580 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:37.580 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:37.580 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 0", 2024-09-13T06:39:37.580 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.540199+0000", 2024-09-13T06:39:37.580 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00017705499999999999 2024-09-13T06:39:37.580 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:37.580 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:37.580 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-13T06:39:37.580 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.542161+0000", 2024-09-13T06:39:37.580 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0019622210000000001 2024-09-13T06:39:37.581 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:37.581 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:37.581 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:39:37.581 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.544529+0000", 2024-09-13T06:39:37.581 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0023684690000000002 2024-09-13T06:39:37.581 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:37.581 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:37.581 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-13T06:39:37.581 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.544614+0000", 2024-09-13T06:39:37.581 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.4711999999999998e-05 2024-09-13T06:39:37.581 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:37.581 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:37.581 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:39:37.581 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.544718+0000", 2024-09-13T06:39:37.581 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000103986 2024-09-13T06:39:37.582 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:37.582 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:39:37.582 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:37.582 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:37.582 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:37.582 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4154.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-13T06:39:37.582 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:11.525416+0000", 2024-09-13T06:39:37.582 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 25.978241239999999, 2024-09-13T06:39:37.582 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.019501830000000001, 2024-09-13T06:39:37.582 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:39:37.582 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:37.582 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:39:37.582 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4154", 2024-09-13T06:39:37.583 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/2406930292", 2024-09-13T06:39:37.583 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 117 2024-09-13T06:39:37.583 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:37.583 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:39:37.583 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:37.583 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:39:37.583 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.525416+0000", 2024-09-13T06:39:37.583 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:37.583 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:37.583 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:37.583 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:39:37.583 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.525416+0000", 2024-09-13T06:39:37.583 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:37.584 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:37.584 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:37.584 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:39:37.584 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.525415+0000", 2024-09-13T06:39:37.584 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999986 2024-09-13T06:39:37.584 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:37.584 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:37.584 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:39:37.584 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.525426+0000", 2024-09-13T06:39:37.584 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.101e-05 2024-09-13T06:39:37.584 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:37.584 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:37.584 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:39:37.584 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.525444+0000", 2024-09-13T06:39:37.585 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.768e-05 2024-09-13T06:39:37.585 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:37.585 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:37.585 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:39:37.585 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.525463+0000", 2024-09-13T06:39:37.585 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.9026999999999999e-05 2024-09-13T06:39:37.585 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:37.585 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:37.585 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:39:37.585 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.541203+0000", 2024-09-13T06:39:37.585 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.015740309000000001 2024-09-13T06:39:37.585 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:37.585 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:37.585 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:39:37.586 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.541330+0000", 2024-09-13T06:39:37.586 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000126976 2024-09-13T06:39:37.586 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:37.586 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:37.586 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 0", 2024-09-13T06:39:37.586 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.541522+0000", 2024-09-13T06:39:37.586 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00019165100000000001 2024-09-13T06:39:37.586 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:37.586 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:37.586 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-13T06:39:37.586 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.542798+0000", 2024-09-13T06:39:37.586 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.001276424 2024-09-13T06:39:37.586 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:37.587 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:37.587 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:39:37.587 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.544795+0000", 2024-09-13T06:39:37.587 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0019966540000000001 2024-09-13T06:39:37.587 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:37.587 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:37.587 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-13T06:39:37.587 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.544868+0000", 2024-09-13T06:39:37.587 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.3096000000000006e-05 2024-09-13T06:39:37.587 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:37.587 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:37.587 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:39:37.587 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.544918+0000", 2024-09-13T06:39:37.588 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.0226999999999999e-05 2024-09-13T06:39:37.588 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:37.588 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:39:37.588 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:37.588 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:37.588 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:37.588 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4154.0:136 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-13T06:39:37.588 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:12.006369+0000", 2024-09-13T06:39:37.588 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 25.497287890999999, 2024-09-13T06:39:37.588 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.012052078000000001, 2024-09-13T06:39:37.588 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:39:37.588 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:37.588 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:39:37.589 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4154", 2024-09-13T06:39:37.589 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/2406930292", 2024-09-13T06:39:37.589 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 136 2024-09-13T06:39:37.589 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:37.589 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:39:37.589 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:37.589 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:39:37.589 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.006369+0000", 2024-09-13T06:39:37.589 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:37.589 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:37.589 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:37.589 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:39:37.589 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.006369+0000", 2024-09-13T06:39:37.590 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:37.590 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:37.590 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:37.590 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:39:37.590 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.006369+0000", 2024-09-13T06:39:37.590 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:39:37.590 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:37.590 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:37.590 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:39:37.590 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.006372+0000", 2024-09-13T06:39:37.590 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.0630000000000002e-06 2024-09-13T06:39:37.590 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:37.590 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:37.591 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:39:37.591 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.006377+0000", 2024-09-13T06:39:37.591 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.6079999999999998e-06 2024-09-13T06:39:37.591 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:37.591 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:37.591 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:39:37.591 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.006384+0000", 2024-09-13T06:39:37.591 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.8560000000000001e-06 2024-09-13T06:39:37.591 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:37.591 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:37.591 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:39:37.591 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.008357+0000", 2024-09-13T06:39:37.591 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0019733839999999999 2024-09-13T06:39:37.591 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:37.592 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:37.592 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:39:37.592 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.008406+0000", 2024-09-13T06:39:37.592 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.9023000000000001e-05 2024-09-13T06:39:37.592 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:37.592 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:37.592 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 0", 2024-09-13T06:39:37.592 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.008489+0000", 2024-09-13T06:39:37.592 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.2649000000000001e-05 2024-09-13T06:39:37.592 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:37.592 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:37.592 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-13T06:39:37.592 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.011012+0000", 2024-09-13T06:39:37.593 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0025236880000000001 2024-09-13T06:39:37.593 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:37.593 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:37.593 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:39:37.593 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.018382+0000", 2024-09-13T06:39:37.593 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.007369596 2024-09-13T06:39:37.593 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:37.593 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:37.593 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-13T06:39:37.593 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.018405+0000", 2024-09-13T06:39:37.593 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.2670000000000001e-05 2024-09-13T06:39:37.593 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:37.593 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:37.593 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:39:37.594 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.018422+0000", 2024-09-13T06:39:37.594 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6864999999999999e-05 2024-09-13T06:39:37.594 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:37.594 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:39:37.594 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:37.594 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:37.594 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:37.594 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4154.0:137 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-13T06:39:37.594 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:12.006450+0000", 2024-09-13T06:39:37.594 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 25.497207562, 2024-09-13T06:39:37.594 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.012040990999999999, 2024-09-13T06:39:37.594 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:39:37.594 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:37.594 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:39:37.595 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4154", 2024-09-13T06:39:37.595 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/2406930292", 2024-09-13T06:39:37.595 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 137 2024-09-13T06:39:37.595 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:37.595 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:39:37.595 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:37.595 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:39:37.595 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.006450+0000", 2024-09-13T06:39:37.595 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:37.595 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:37.595 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:37.595 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:39:37.595 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.006450+0000", 2024-09-13T06:39:37.595 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:37.596 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:37.596 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:37.596 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:39:37.596 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.006449+0000", 2024-09-13T06:39:37.596 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:39:37.596 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:37.596 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:37.596 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:39:37.596 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.006549+0000", 2024-09-13T06:39:37.596 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.9847999999999997e-05 2024-09-13T06:39:37.596 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:37.596 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:37.596 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:39:37.597 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.006560+0000", 2024-09-13T06:39:37.597 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1012000000000001e-05 2024-09-13T06:39:37.597 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:37.597 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:37.597 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:39:37.597 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.006566+0000", 2024-09-13T06:39:37.597 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.1630000000000001e-06 2024-09-13T06:39:37.597 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:37.597 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:37.597 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:39:37.597 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.008760+0000", 2024-09-13T06:39:37.597 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0021934659999999998 2024-09-13T06:39:37.597 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:37.597 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:37.598 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:39:37.598 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.008803+0000", 2024-09-13T06:39:37.598 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.3492000000000003e-05 2024-09-13T06:39:37.598 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:37.598 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:37.598 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 0", 2024-09-13T06:39:37.598 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.008879+0000", 2024-09-13T06:39:37.598 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5252000000000004e-05 2024-09-13T06:39:37.598 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:37.598 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:37.598 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-13T06:39:37.598 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.011015+0000", 2024-09-13T06:39:37.598 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0021362349999999998 2024-09-13T06:39:37.599 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:37.599 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:37.599 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:39:37.599 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.018452+0000", 2024-09-13T06:39:37.599 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.007436865 2024-09-13T06:39:37.599 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:37.599 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:37.599 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-13T06:39:37.599 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.018474+0000", 2024-09-13T06:39:37.599 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.2149000000000001e-05 2024-09-13T06:39:37.599 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:37.599 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:37.599 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:39:37.599 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.018491+0000", 2024-09-13T06:39:37.600 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6983999999999999e-05 2024-09-13T06:39:37.600 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:37.600 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:39:37.600 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:37.600 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:37.600 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:37.600 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4154.0:139 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-13T06:39:37.600 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:12.006595+0000", 2024-09-13T06:39:37.600 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 25.497062243999999, 2024-09-13T06:39:37.600 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.012024933999999999, 2024-09-13T06:39:37.600 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:39:37.600 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:37.600 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:39:37.601 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4154", 2024-09-13T06:39:37.601 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/2406930292", 2024-09-13T06:39:37.601 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 139 2024-09-13T06:39:37.601 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:37.601 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:39:37.601 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:37.601 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:39:37.601 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.006595+0000", 2024-09-13T06:39:37.601 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:37.601 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:37.601 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:37.601 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:39:37.601 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.006595+0000", 2024-09-13T06:39:37.601 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:37.602 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:37.602 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:37.602 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:39:37.602 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.006595+0000", 2024-09-13T06:39:37.602 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:39:37.602 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:37.602 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:37.602 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:39:37.602 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.006598+0000", 2024-09-13T06:39:37.602 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.1769999999999998e-06 2024-09-13T06:39:37.602 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:37.602 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:37.602 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:39:37.603 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.006612+0000", 2024-09-13T06:39:37.603 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.4177e-05 2024-09-13T06:39:37.603 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:37.603 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:37.603 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:39:37.603 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.006617+0000", 2024-09-13T06:39:37.603 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.561e-06 2024-09-13T06:39:37.603 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:37.603 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:37.603 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:39:37.603 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.009658+0000", 2024-09-13T06:39:37.603 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0030413369999999999 2024-09-13T06:39:37.603 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:37.603 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:37.603 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:39:37.604 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.009707+0000", 2024-09-13T06:39:37.604 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.9089999999999999e-05 2024-09-13T06:39:37.604 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:37.604 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:37.604 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 0", 2024-09-13T06:39:37.604 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.009795+0000", 2024-09-13T06:39:37.604 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.7619000000000003e-05 2024-09-13T06:39:37.604 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:37.604 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:37.604 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-13T06:39:37.604 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.011021+0000", 2024-09-13T06:39:37.604 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0012266289999999999 2024-09-13T06:39:37.604 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:37.604 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:37.605 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:39:37.605 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.018582+0000", 2024-09-13T06:39:37.605 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0075603399999999996 2024-09-13T06:39:37.605 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:37.605 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:37.605 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-13T06:39:37.605 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.018603+0000", 2024-09-13T06:39:37.605 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.1795999999999999e-05 2024-09-13T06:39:37.605 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:37.605 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:37.605 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:39:37.605 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.018620+0000", 2024-09-13T06:39:37.605 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6562000000000002e-05 2024-09-13T06:39:37.606 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:37.606 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:39:37.606 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:37.606 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:37.606 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:37.606 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4154.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-13T06:39:37.606 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:12.006689+0000", 2024-09-13T06:39:37.606 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 25.496968055, 2024-09-13T06:39:37.606 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.012427258, 2024-09-13T06:39:37.606 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:39:37.606 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:37.606 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:39:37.606 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4154", 2024-09-13T06:39:37.606 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/2406930292", 2024-09-13T06:39:37.607 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 140 2024-09-13T06:39:37.607 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:37.607 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:39:37.607 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:37.607 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:39:37.607 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.006689+0000", 2024-09-13T06:39:37.607 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:37.607 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:37.607 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:37.607 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:39:37.607 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.006689+0000", 2024-09-13T06:39:37.607 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:37.607 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:37.607 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:37.607 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:39:37.608 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.006689+0000", 2024-09-13T06:39:37.608 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:39:37.608 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:37.608 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:37.608 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:39:37.608 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.006795+0000", 2024-09-13T06:39:37.608 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00010662699999999999 2024-09-13T06:39:37.608 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:37.608 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:37.608 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:39:37.608 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.006804+0000", 2024-09-13T06:39:37.608 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.055e-06 2024-09-13T06:39:37.608 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:37.609 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:37.609 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:39:37.609 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.006808+0000", 2024-09-13T06:39:37.609 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.7450000000000003e-06 2024-09-13T06:39:37.609 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:37.609 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:37.609 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:39:37.609 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.010066+0000", 2024-09-13T06:39:37.609 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0032579570000000001 2024-09-13T06:39:37.609 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:37.609 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:37.609 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:39:37.609 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.010111+0000", 2024-09-13T06:39:37.610 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.4563e-05 2024-09-13T06:39:37.610 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:37.610 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:37.610 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 0", 2024-09-13T06:39:37.610 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.010185+0000", 2024-09-13T06:39:37.610 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.4108000000000003e-05 2024-09-13T06:39:37.610 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:37.610 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:37.610 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-13T06:39:37.610 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.011161+0000", 2024-09-13T06:39:37.610 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00097629200000000002 2024-09-13T06:39:37.610 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:37.610 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:37.610 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:39:37.611 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.019061+0000", 2024-09-13T06:39:37.611 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0079001939999999993 2024-09-13T06:39:37.611 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:37.611 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:37.611 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-13T06:39:37.611 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.019095+0000", 2024-09-13T06:39:37.611 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.3200000000000001e-05 2024-09-13T06:39:37.611 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:37.611 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:37.611 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:39:37.611 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.019117+0000", 2024-09-13T06:39:37.611 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.1985e-05 2024-09-13T06:39:37.611 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:37.611 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:39:37.612 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:37.612 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:37.612 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:37.612 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4154.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-13T06:39:37.612 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:12.006814+0000", 2024-09-13T06:39:37.612 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 25.496842870999998, 2024-09-13T06:39:37.612 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.012896405999999999, 2024-09-13T06:39:37.612 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:39:37.612 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:37.612 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:39:37.612 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4154", 2024-09-13T06:39:37.612 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/2406930292", 2024-09-13T06:39:37.612 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 141 2024-09-13T06:39:37.612 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:37.613 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:39:37.613 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:37.613 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:39:37.613 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.006814+0000", 2024-09-13T06:39:37.613 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:37.613 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:37.613 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:37.613 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:39:37.613 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.006814+0000", 2024-09-13T06:39:37.613 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:37.613 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:37.613 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:37.613 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:39:37.613 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.006814+0000", 2024-09-13T06:39:37.614 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:39:37.614 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:37.614 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:37.614 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:39:37.614 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.006818+0000", 2024-09-13T06:39:37.614 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.8840000000000004e-06 2024-09-13T06:39:37.614 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:37.614 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:37.614 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:39:37.614 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.006834+0000", 2024-09-13T06:39:37.614 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6133999999999998e-05 2024-09-13T06:39:37.614 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:37.614 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:37.615 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:39:37.615 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.006838+0000", 2024-09-13T06:39:37.615 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0879999999999997e-06 2024-09-13T06:39:37.615 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:37.615 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:37.615 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:39:37.615 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.010586+0000", 2024-09-13T06:39:37.615 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.003747954 2024-09-13T06:39:37.615 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:37.615 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:37.615 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:39:37.615 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.010630+0000", 2024-09-13T06:39:37.615 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.3736000000000003e-05 2024-09-13T06:39:37.615 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:37.616 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:37.616 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 0", 2024-09-13T06:39:37.616 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.010701+0000", 2024-09-13T06:39:37.616 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.1284000000000004e-05 2024-09-13T06:39:37.616 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:37.616 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:37.616 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-13T06:39:37.616 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.011593+0000", 2024-09-13T06:39:37.616 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00089209300000000005 2024-09-13T06:39:37.616 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:37.616 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:37.616 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:39:37.617 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.019665+0000", 2024-09-13T06:39:37.617 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0080716169999999997 2024-09-13T06:39:37.617 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:37.617 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:37.617 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-13T06:39:37.617 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.019691+0000", 2024-09-13T06:39:37.617 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.6514000000000001e-05 2024-09-13T06:39:37.617 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:37.617 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:37.617 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:39:37.617 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.019711+0000", 2024-09-13T06:39:37.617 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.9641e-05 2024-09-13T06:39:37.617 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:37.617 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:39:37.618 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:37.618 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:37.618 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:37.618 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:608 3.11 3:8ebac99f:::rbd_data.11214e25756e.0000000000000007:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-09-13T06:39:37.618 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:34.801988+0000", 2024-09-13T06:39:37.618 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 2.7016694829999999, 2024-09-13T06:39:37.618 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.033916448000000002, 2024-09-13T06:39:37.618 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:39:37.618 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:37.618 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:39:37.618 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:39:37.618 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:37.618 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 608 2024-09-13T06:39:37.618 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:37.619 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:39:37.619 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:37.619 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:39:37.619 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:34.801988+0000", 2024-09-13T06:39:37.619 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:37.619 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:37.619 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:37.619 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:39:37.619 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:34.801988+0000", 2024-09-13T06:39:37.619 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:37.619 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:37.619 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:37.619 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:39:37.620 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:34.801985+0000", 2024-09-13T06:39:37.620 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999976 2024-09-13T06:39:37.620 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:37.620 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:37.620 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:39:37.620 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:34.801999+0000", 2024-09-13T06:39:37.620 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.402e-05 2024-09-13T06:39:37.620 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:37.620 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:37.620 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:39:37.620 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:34.802031+0000", 2024-09-13T06:39:37.620 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.1582999999999999e-05 2024-09-13T06:39:37.620 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:37.620 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:37.621 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:39:37.621 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:34.802052+0000", 2024-09-13T06:39:37.621 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.1310000000000001e-05 2024-09-13T06:39:37.621 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:37.621 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:37.621 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:39:37.621 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:34.802117+0000", 2024-09-13T06:39:37.621 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.5016000000000002e-05 2024-09-13T06:39:37.621 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:37.621 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:37.621 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:39:37.621 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:34.802254+0000", 2024-09-13T06:39:37.621 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000136186 2024-09-13T06:39:37.621 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:37.622 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:37.622 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 4", 2024-09-13T06:39:37.622 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:34.807944+0000", 2024-09-13T06:39:37.622 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0056906930000000001 2024-09-13T06:39:37.622 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:37.622 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:37.622 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-13T06:39:37.622 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:34.835646+0000", 2024-09-13T06:39:37.622 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.027701546000000001 2024-09-13T06:39:37.622 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:37.622 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:37.622 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:39:37.622 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:34.835754+0000", 2024-09-13T06:39:37.623 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000107889 2024-09-13T06:39:37.623 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:37.623 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:37.623 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-13T06:39:37.623 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:34.835840+0000", 2024-09-13T06:39:37.623 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6621999999999998e-05 2024-09-13T06:39:37.623 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:37.623 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:37.623 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:39:37.623 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:34.835904+0000", 2024-09-13T06:39:37.623 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.4022999999999993e-05 2024-09-13T06:39:37.623 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:37.623 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:39:37.623 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:37.624 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:37.624 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:39:37.624 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:39:37.624 INFO:teuthology.orchestra.run.smithi081.stdout:checking clone #0, image image_client.0 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent1 2024-09-13T06:39:37.625 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-13T06:39:37.626+0000 7f86a5f06640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26387) UID: 0 2024-09-13T06:39:37.626 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-13T06:39:37.726 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:39:37.727+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:39:37.734 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:39:37.734 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-13T06:39:37.734 INFO:teuthology.orchestra.run.smithi081.stdout: "num_ops": 0 2024-09-13T06:39:37.734 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:39:37.747 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-13T06:39:37.827 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:39:37.826+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:39:37.907 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:39:37.907 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-13T06:39:37.907 INFO:teuthology.orchestra.run.smithi081.stdout: "complaint_time": 30, 2024-09-13T06:39:37.907 INFO:teuthology.orchestra.run.smithi081.stdout: "num_blocked_ops": 0 2024-09-13T06:39:37.907 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:39:37.919 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-13T06:39:37.927 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:39:37.930+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:39:38.028 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:39:38.030+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:39:38.039 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:39:38.039 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 20, 2024-09-13T06:39:38.039 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 600, 2024-09-13T06:39:38.040 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [ 2024-09-13T06:39:38.040 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.040 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4154.0:67 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'41, mlcod=15'39)", 2024-09-13T06:39:38.040 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:11.333035+0000", 2024-09-13T06:39:38.040 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 26.708662251, 2024-09-13T06:39:38.040 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0063409859999999998, 2024-09-13T06:39:38.040 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:38.040 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:38.040 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:38.040 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.040 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:38.040 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:11.333035+0000", 2024-09-13T06:39:38.041 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:38.041 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.041 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.041 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:38.041 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:11.333035+0000", 2024-09-13T06:39:38.041 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:38.041 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.041 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.041 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:38.041 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:11.333034+0000", 2024-09-13T06:39:38.041 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999981 2024-09-13T06:39:38.041 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.041 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.042 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:38.042 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:11.333048+0000", 2024-09-13T06:39:38.042 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3859999999999999e-05 2024-09-13T06:39:38.042 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.042 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.042 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:38.042 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:11.333076+0000", 2024-09-13T06:39:38.042 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.8586e-05 2024-09-13T06:39:38.042 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.042 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.042 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:38.042 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:11.333089+0000", 2024-09-13T06:39:38.042 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2447e-05 2024-09-13T06:39:38.042 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.043 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.043 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:38.043 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:11.333193+0000", 2024-09-13T06:39:38.043 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000104042 2024-09-13T06:39:38.043 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.043 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.043 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:38.043 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:11.333232+0000", 2024-09-13T06:39:38.043 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.9406999999999997e-05 2024-09-13T06:39:38.043 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.043 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.043 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:39:38.043 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:11.339313+0000", 2024-09-13T06:39:38.044 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0060808529999999998 2024-09-13T06:39:38.044 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.044 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.044 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:38.044 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:11.339376+0000", 2024-09-13T06:39:38.044 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3565000000000006e-05 2024-09-13T06:39:38.044 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:38.044 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:38.044 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:38.044 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.044 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.044 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4154.0:68 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'42, mlcod=15'39)", 2024-09-13T06:39:38.044 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:11.333986+0000", 2024-09-13T06:39:38.044 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 26.707711366000002, 2024-09-13T06:39:38.045 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0054233750000000002, 2024-09-13T06:39:38.045 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:38.045 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:38.045 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:38.045 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.045 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:38.045 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:11.333986+0000", 2024-09-13T06:39:38.045 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:38.045 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.045 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.045 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:38.045 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:11.333986+0000", 2024-09-13T06:39:38.045 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:38.045 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.046 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.046 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:38.046 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:11.333985+0000", 2024-09-13T06:39:38.046 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999981 2024-09-13T06:39:38.046 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.046 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.046 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:38.046 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:11.333997+0000", 2024-09-13T06:39:38.046 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2813000000000001e-05 2024-09-13T06:39:38.046 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.046 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.046 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:38.046 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:11.334026+0000", 2024-09-13T06:39:38.046 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.8787000000000001e-05 2024-09-13T06:39:38.047 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.047 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.047 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:38.047 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:11.334039+0000", 2024-09-13T06:39:38.047 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2713e-05 2024-09-13T06:39:38.047 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.047 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.047 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:38.047 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:11.337023+0000", 2024-09-13T06:39:38.047 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0029835600000000001 2024-09-13T06:39:38.047 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.047 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.047 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:38.047 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:11.337053+0000", 2024-09-13T06:39:38.048 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.0453000000000001e-05 2024-09-13T06:39:38.048 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.048 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.048 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:39:38.048 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:11.339379+0000", 2024-09-13T06:39:38.048 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0023261480000000001 2024-09-13T06:39:38.048 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.048 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.048 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:38.048 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:11.339410+0000", 2024-09-13T06:39:38.048 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.0583999999999997e-05 2024-09-13T06:39:38.048 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:38.048 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:38.048 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:38.049 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.049 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.049 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4154.0:109 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'71, mlcod=15'67)", 2024-09-13T06:39:38.049 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:11.530573+0000", 2024-09-13T06:39:38.049 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 26.511125, 2024-09-13T06:39:38.049 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0050450549999999997, 2024-09-13T06:39:38.049 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:38.049 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:38.049 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:38.049 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.049 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:38.049 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:11.530573+0000", 2024-09-13T06:39:38.049 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:38.050 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.050 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.050 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:38.050 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:11.530573+0000", 2024-09-13T06:39:38.050 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:38.050 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.050 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.050 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:38.050 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:11.530571+0000", 2024-09-13T06:39:38.050 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999986 2024-09-13T06:39:38.050 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.050 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.050 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:38.050 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:11.530689+0000", 2024-09-13T06:39:38.051 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000117182 2024-09-13T06:39:38.051 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.051 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.051 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:38.051 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:11.530716+0000", 2024-09-13T06:39:38.051 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.7120000000000001e-05 2024-09-13T06:39:38.051 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.051 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.051 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:38.051 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:11.530736+0000", 2024-09-13T06:39:38.051 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0052999999999999e-05 2024-09-13T06:39:38.051 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.051 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.052 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:38.052 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:11.530784+0000", 2024-09-13T06:39:38.052 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.8361e-05 2024-09-13T06:39:38.052 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.052 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.052 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:38.052 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:11.530798+0000", 2024-09-13T06:39:38.052 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4276e-05 2024-09-13T06:39:38.052 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.052 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.052 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:39:38.052 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:11.535584+0000", 2024-09-13T06:39:38.052 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.004786116 2024-09-13T06:39:38.052 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.053 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.053 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:38.053 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:11.535618+0000", 2024-09-13T06:39:38.053 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.328e-05 2024-09-13T06:39:38.053 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:38.053 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:38.053 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:38.053 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.053 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.053 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4154.0:130 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'88, mlcod=15'85)", 2024-09-13T06:39:38.053 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:12.005647+0000", 2024-09-13T06:39:38.053 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 26.036051072999999, 2024-09-13T06:39:38.053 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0064037570000000004, 2024-09-13T06:39:38.053 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:38.054 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:38.054 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:38.054 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.054 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:38.054 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.005647+0000", 2024-09-13T06:39:38.054 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:38.054 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.054 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.054 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:38.054 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.005647+0000", 2024-09-13T06:39:38.054 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:38.054 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.054 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.054 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:38.055 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.005645+0000", 2024-09-13T06:39:38.055 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999981 2024-09-13T06:39:38.055 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.055 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.055 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:38.055 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.005664+0000", 2024-09-13T06:39:38.055 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8876999999999999e-05 2024-09-13T06:39:38.055 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.055 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.055 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:38.055 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.005695+0000", 2024-09-13T06:39:38.055 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.1467000000000002e-05 2024-09-13T06:39:38.055 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.056 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.056 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:38.056 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.005715+0000", 2024-09-13T06:39:38.056 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0248999999999999e-05 2024-09-13T06:39:38.056 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.056 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.056 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:38.056 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.006412+0000", 2024-09-13T06:39:38.056 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00069722499999999999 2024-09-13T06:39:38.056 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.056 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.056 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:38.056 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.006475+0000", 2024-09-13T06:39:38.056 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.2955999999999998e-05 2024-09-13T06:39:38.057 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.057 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.057 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:39:38.057 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.011987+0000", 2024-09-13T06:39:38.057 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0055118240000000002 2024-09-13T06:39:38.057 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.057 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.057 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:38.057 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.012050+0000", 2024-09-13T06:39:38.057 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3102999999999995e-05 2024-09-13T06:39:38.057 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:38.057 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:38.057 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:38.057 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.058 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.058 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4154.0:131 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'89, mlcod=15'85)", 2024-09-13T06:39:38.058 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:12.006115+0000", 2024-09-13T06:39:38.058 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 26.035582606999998, 2024-09-13T06:39:38.058 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0092077789999999993, 2024-09-13T06:39:38.058 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:38.058 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:38.058 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:38.058 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.058 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:38.058 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.006115+0000", 2024-09-13T06:39:38.058 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:38.058 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.058 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.059 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:38.059 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.006115+0000", 2024-09-13T06:39:38.059 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:38.059 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.059 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.059 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:38.059 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.006114+0000", 2024-09-13T06:39:38.059 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999986 2024-09-13T06:39:38.059 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.059 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.059 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:38.059 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.006258+0000", 2024-09-13T06:39:38.059 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00014467899999999999 2024-09-13T06:39:38.060 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.060 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.060 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:38.060 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.006277+0000", 2024-09-13T06:39:38.060 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8425999999999999e-05 2024-09-13T06:39:38.060 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.060 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.060 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:38.060 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.006288+0000", 2024-09-13T06:39:38.060 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1037e-05 2024-09-13T06:39:38.060 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.060 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.060 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:38.061 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.007461+0000", 2024-09-13T06:39:38.061 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.001173381 2024-09-13T06:39:38.061 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.061 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.061 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:38.061 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.007522+0000", 2024-09-13T06:39:38.061 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0266999999999997e-05 2024-09-13T06:39:38.061 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.061 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.061 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:39:38.061 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.015248+0000", 2024-09-13T06:39:38.061 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0077260200000000001 2024-09-13T06:39:38.061 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.062 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.062 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:38.062 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.015323+0000", 2024-09-13T06:39:38.062 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5289000000000004e-05 2024-09-13T06:39:38.062 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:38.062 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:38.062 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:38.062 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.062 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.062 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4154.0:132 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'90, mlcod=15'85)", 2024-09-13T06:39:38.062 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:12.006560+0000", 2024-09-13T06:39:38.062 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 26.035137686999999, 2024-09-13T06:39:38.062 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0088017219999999997, 2024-09-13T06:39:38.062 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:38.062 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:38.063 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:38.063 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.063 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:38.063 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.006560+0000", 2024-09-13T06:39:38.063 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:38.063 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.063 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.063 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:38.063 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.006560+0000", 2024-09-13T06:39:38.063 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:38.063 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.063 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.063 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:38.064 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.006559+0000", 2024-09-13T06:39:38.064 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.999999 2024-09-13T06:39:38.064 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.064 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.064 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:38.064 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.006569+0000", 2024-09-13T06:39:38.064 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0197000000000001e-05 2024-09-13T06:39:38.064 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.064 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.064 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:38.064 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.006587+0000", 2024-09-13T06:39:38.064 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8073000000000001e-05 2024-09-13T06:39:38.064 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.064 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.065 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:38.065 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.006596+0000", 2024-09-13T06:39:38.065 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.0000000000000002e-06 2024-09-13T06:39:38.065 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.065 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.065 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:38.065 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.008751+0000", 2024-09-13T06:39:38.065 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0021548299999999999 2024-09-13T06:39:38.065 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.065 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.065 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:38.065 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.008803+0000", 2024-09-13T06:39:38.065 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.215e-05 2024-09-13T06:39:38.066 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.066 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.066 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:39:38.066 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.015329+0000", 2024-09-13T06:39:38.066 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0065259589999999996 2024-09-13T06:39:38.066 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.066 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.066 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:38.066 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.015362+0000", 2024-09-13T06:39:38.066 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.2613000000000001e-05 2024-09-13T06:39:38.066 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:38.066 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:38.066 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:38.066 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.067 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.067 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4154.0:133 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'91, mlcod=15'85)", 2024-09-13T06:39:38.067 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:12.006919+0000", 2024-09-13T06:39:38.067 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 26.034778360000001, 2024-09-13T06:39:38.067 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0084917580000000003, 2024-09-13T06:39:38.067 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:38.067 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:38.067 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:38.067 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.067 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:38.067 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.006919+0000", 2024-09-13T06:39:38.067 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:38.067 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.068 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.068 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:38.068 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.006919+0000", 2024-09-13T06:39:38.068 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:38.068 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.068 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.069 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:38.069 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.006918+0000", 2024-09-13T06:39:38.069 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.999999 2024-09-13T06:39:38.069 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.069 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.069 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:38.069 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.006926+0000", 2024-09-13T06:39:38.069 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.9929999999999995e-06 2024-09-13T06:39:38.069 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.069 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.069 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:38.069 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.006948+0000", 2024-09-13T06:39:38.069 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1593000000000001e-05 2024-09-13T06:39:38.070 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.070 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.070 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:38.070 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.006958+0000", 2024-09-13T06:39:38.070 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.029e-05 2024-09-13T06:39:38.070 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.070 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.070 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:38.070 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.009740+0000", 2024-09-13T06:39:38.070 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0027821259999999998 2024-09-13T06:39:38.070 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.070 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.070 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:38.070 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.009776+0000", 2024-09-13T06:39:38.071 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.5102999999999999e-05 2024-09-13T06:39:38.071 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.071 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.071 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:39:38.071 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.015366+0000", 2024-09-13T06:39:38.071 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0055902160000000003 2024-09-13T06:39:38.071 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.071 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.071 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:38.071 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.015411+0000", 2024-09-13T06:39:38.071 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5290000000000002e-05 2024-09-13T06:39:38.071 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:38.071 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:38.071 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:38.072 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.072 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.072 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4154.0:134 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'92, mlcod=15'85)", 2024-09-13T06:39:38.072 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:12.007373+0000", 2024-09-13T06:39:38.072 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 26.034325013, 2024-09-13T06:39:38.072 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.010012544999999999, 2024-09-13T06:39:38.072 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:38.072 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:38.072 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:38.072 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.072 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:38.072 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.007373+0000", 2024-09-13T06:39:38.073 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:38.073 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.073 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.073 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:38.073 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.007373+0000", 2024-09-13T06:39:38.073 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:38.073 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.073 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.073 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:38.073 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.007372+0000", 2024-09-13T06:39:38.073 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.999999 2024-09-13T06:39:38.073 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.073 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.074 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:38.074 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.007421+0000", 2024-09-13T06:39:38.074 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9660000000000002e-05 2024-09-13T06:39:38.074 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.074 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.074 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:38.074 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.007435+0000", 2024-09-13T06:39:38.074 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3743e-05 2024-09-13T06:39:38.074 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.074 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.074 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:38.074 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.007443+0000", 2024-09-13T06:39:38.074 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.2269999999999993e-06 2024-09-13T06:39:38.074 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.075 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.075 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:38.075 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.010303+0000", 2024-09-13T06:39:38.075 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0028596509999999999 2024-09-13T06:39:38.075 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.075 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.075 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:38.075 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.010337+0000", 2024-09-13T06:39:38.075 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.4306e-05 2024-09-13T06:39:38.075 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.075 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.075 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:39:38.076 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.017329+0000", 2024-09-13T06:39:38.076 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0069915660000000003 2024-09-13T06:39:38.076 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.076 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.076 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:38.076 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.017385+0000", 2024-09-13T06:39:38.076 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.6409000000000002e-05 2024-09-13T06:39:38.076 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:38.076 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:38.076 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:38.076 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.076 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.076 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4154.0:135 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'93, mlcod=15'85)", 2024-09-13T06:39:38.077 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:12.007816+0000", 2024-09-13T06:39:38.077 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 26.033881482999998, 2024-09-13T06:39:38.077 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0096068089999999991, 2024-09-13T06:39:38.077 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:38.077 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:38.077 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:38.077 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.077 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:38.077 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.007816+0000", 2024-09-13T06:39:38.077 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:38.077 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.077 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.077 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:38.077 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.007816+0000", 2024-09-13T06:39:38.078 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:38.078 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.078 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.078 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:38.078 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.007815+0000", 2024-09-13T06:39:38.078 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.999999 2024-09-13T06:39:38.078 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.078 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.078 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:38.078 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.007823+0000", 2024-09-13T06:39:38.078 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.8730000000000007e-06 2024-09-13T06:39:38.078 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.078 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.079 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:38.079 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.007836+0000", 2024-09-13T06:39:38.079 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2510000000000001e-05 2024-09-13T06:39:38.079 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.079 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.079 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:38.079 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.007843+0000", 2024-09-13T06:39:38.079 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5830000000000001e-06 2024-09-13T06:39:38.079 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.079 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.079 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:38.079 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.011183+0000", 2024-09-13T06:39:38.079 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0033400539999999999 2024-09-13T06:39:38.079 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.079 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.080 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:38.080 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.011217+0000", 2024-09-13T06:39:38.080 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.3355999999999997e-05 2024-09-13T06:39:38.080 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.080 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.080 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:39:38.080 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.017391+0000", 2024-09-13T06:39:38.080 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0061736960000000002 2024-09-13T06:39:38.080 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.080 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.080 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:38.080 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.017423+0000", 2024-09-13T06:39:38.080 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.2499999999999997e-05 2024-09-13T06:39:38.081 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:38.081 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:38.081 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:38.081 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.081 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.081 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4154.0:136 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'94, mlcod=15'85)", 2024-09-13T06:39:38.081 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:12.008176+0000", 2024-09-13T06:39:38.081 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 26.033521569000001, 2024-09-13T06:39:38.081 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0092805379999999996, 2024-09-13T06:39:38.081 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:38.081 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:38.081 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:38.081 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.081 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:38.082 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.008176+0000", 2024-09-13T06:39:38.082 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:38.082 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.082 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.082 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:38.082 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.008176+0000", 2024-09-13T06:39:38.082 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:38.082 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.082 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.082 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:38.082 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.008175+0000", 2024-09-13T06:39:38.082 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:39:38.082 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.082 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.083 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:38.083 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.008183+0000", 2024-09-13T06:39:38.083 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.1099999999999997e-06 2024-09-13T06:39:38.083 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.083 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.083 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:38.083 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.008207+0000", 2024-09-13T06:39:38.083 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4383999999999999e-05 2024-09-13T06:39:38.083 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.083 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.084 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:38.084 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.008216+0000", 2024-09-13T06:39:38.084 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.4860000000000003e-06 2024-09-13T06:39:38.084 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.084 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.084 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:38.084 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.012139+0000", 2024-09-13T06:39:38.084 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0039226189999999996 2024-09-13T06:39:38.084 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.084 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.084 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:38.084 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.012198+0000", 2024-09-13T06:39:38.085 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8489999999999997e-05 2024-09-13T06:39:38.085 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.085 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.085 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:39:38.085 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.017427+0000", 2024-09-13T06:39:38.085 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0052297589999999996 2024-09-13T06:39:38.085 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.085 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.085 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:38.085 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.017457+0000", 2024-09-13T06:39:38.085 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9357e-05 2024-09-13T06:39:38.085 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:38.085 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:38.086 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:38.086 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.086 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.086 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4154.0:137 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'95, mlcod=15'85)", 2024-09-13T06:39:38.086 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:12.008624+0000", 2024-09-13T06:39:38.086 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 26.033073485999999, 2024-09-13T06:39:38.086 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0088653910000000002, 2024-09-13T06:39:38.086 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:38.086 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:38.086 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:38.086 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.086 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:38.086 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.008624+0000", 2024-09-13T06:39:38.086 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:38.087 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.087 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.087 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:38.087 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.008624+0000", 2024-09-13T06:39:38.087 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:38.087 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.087 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.087 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:38.087 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.008623+0000", 2024-09-13T06:39:38.087 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.999999 2024-09-13T06:39:38.087 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.087 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.087 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:38.088 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.008739+0000", 2024-09-13T06:39:38.088 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00011541599999999999 2024-09-13T06:39:38.088 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.088 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.088 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:38.088 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.008753+0000", 2024-09-13T06:39:38.088 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4136e-05 2024-09-13T06:39:38.088 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.088 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.088 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:38.088 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.008761+0000", 2024-09-13T06:39:38.088 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.9899999999999997e-06 2024-09-13T06:39:38.088 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.089 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.089 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:38.089 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.013092+0000", 2024-09-13T06:39:38.089 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0043311540000000003 2024-09-13T06:39:38.089 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.089 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.089 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:38.089 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.013131+0000", 2024-09-13T06:39:38.089 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.9266e-05 2024-09-13T06:39:38.089 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.089 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.089 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:39:38.089 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.017461+0000", 2024-09-13T06:39:38.090 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0043297700000000001 2024-09-13T06:39:38.090 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.090 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.090 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:38.090 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.017490+0000", 2024-09-13T06:39:38.090 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.8699000000000001e-05 2024-09-13T06:39:38.090 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:38.090 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:38.090 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:38.090 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.090 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.090 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4154.0:138 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'96, mlcod=15'85)", 2024-09-13T06:39:38.090 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:12.009148+0000", 2024-09-13T06:39:38.091 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 26.032549899999999, 2024-09-13T06:39:38.091 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0083737480000000003, 2024-09-13T06:39:38.091 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:38.091 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:38.091 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:38.091 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.091 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:38.091 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.009148+0000", 2024-09-13T06:39:38.091 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:38.091 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.092 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.092 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:38.092 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.009148+0000", 2024-09-13T06:39:38.092 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:38.092 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.092 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.092 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:38.092 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.009146+0000", 2024-09-13T06:39:38.092 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999981 2024-09-13T06:39:38.092 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.092 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.092 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:38.092 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.009160+0000", 2024-09-13T06:39:38.092 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3706000000000001e-05 2024-09-13T06:39:38.093 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.093 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.093 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:38.093 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.009221+0000", 2024-09-13T06:39:38.093 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.1532999999999995e-05 2024-09-13T06:39:38.093 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.093 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.093 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:38.093 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.009240+0000", 2024-09-13T06:39:38.093 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8300000000000001e-05 2024-09-13T06:39:38.093 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.093 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.093 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:38.094 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.014388+0000", 2024-09-13T06:39:38.094 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0051483299999999996 2024-09-13T06:39:38.094 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.094 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.094 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:38.094 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.014439+0000", 2024-09-13T06:39:38.094 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0618999999999998e-05 2024-09-13T06:39:38.094 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.094 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.094 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:39:38.094 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.017497+0000", 2024-09-13T06:39:38.094 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0030583899999999998 2024-09-13T06:39:38.094 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.094 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.095 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:38.095 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.017522+0000", 2024-09-13T06:39:38.095 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4613e-05 2024-09-13T06:39:38.095 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:38.095 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:38.095 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:38.095 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.095 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.095 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4154.0:139 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'97, mlcod=15'85)", 2024-09-13T06:39:38.095 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:12.009507+0000", 2024-09-13T06:39:38.095 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 26.032190569000001, 2024-09-13T06:39:38.095 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.008043204, 2024-09-13T06:39:38.095 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:38.095 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:38.096 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:38.096 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.096 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:38.096 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.009507+0000", 2024-09-13T06:39:38.096 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:38.096 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.096 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.096 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:38.096 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.009507+0000", 2024-09-13T06:39:38.096 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:38.096 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.096 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.096 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:38.097 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.009506+0000", 2024-09-13T06:39:38.097 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.999999 2024-09-13T06:39:38.097 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.097 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.097 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:38.097 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.009516+0000", 2024-09-13T06:39:38.097 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.91e-06 2024-09-13T06:39:38.097 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.097 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.097 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:38.097 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.009530+0000", 2024-09-13T06:39:38.097 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4406999999999999e-05 2024-09-13T06:39:38.097 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.097 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.098 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:38.098 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.009542+0000", 2024-09-13T06:39:38.098 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1549000000000001e-05 2024-09-13T06:39:38.098 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.098 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.098 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:38.098 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.015501+0000", 2024-09-13T06:39:38.098 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0059592409999999997 2024-09-13T06:39:38.098 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.098 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.098 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:38.098 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.015558+0000", 2024-09-13T06:39:38.098 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.6496000000000003e-05 2024-09-13T06:39:38.099 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.099 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.099 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:39:38.099 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.017526+0000", 2024-09-13T06:39:38.099 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0019678249999999999 2024-09-13T06:39:38.099 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.099 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.099 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:38.099 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.017550+0000", 2024-09-13T06:39:38.099 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4769999999999998e-05 2024-09-13T06:39:38.099 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:38.099 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:38.099 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:38.099 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.100 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.100 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4154.0:140 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'98, mlcod=15'85)", 2024-09-13T06:39:38.100 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:12.009917+0000", 2024-09-13T06:39:38.100 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 26.031780599000001, 2024-09-13T06:39:38.100 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0085122300000000008, 2024-09-13T06:39:38.100 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:38.100 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:38.100 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:38.100 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.100 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:38.100 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.009917+0000", 2024-09-13T06:39:38.100 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:38.100 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.101 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.101 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:38.101 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.009917+0000", 2024-09-13T06:39:38.101 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:38.101 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.101 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.101 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:38.101 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.009916+0000", 2024-09-13T06:39:38.101 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.999999 2024-09-13T06:39:38.101 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.101 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.101 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:38.101 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.010084+0000", 2024-09-13T06:39:38.102 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000168419 2024-09-13T06:39:38.102 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.102 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.102 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:38.102 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.010112+0000", 2024-09-13T06:39:38.102 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.7773e-05 2024-09-13T06:39:38.102 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.102 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.102 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:38.102 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.010128+0000", 2024-09-13T06:39:38.102 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.605e-05 2024-09-13T06:39:38.103 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.103 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.103 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:38.103 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.016320+0000", 2024-09-13T06:39:38.103 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0061919690000000003 2024-09-13T06:39:38.103 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.103 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.103 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:38.103 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.016349+0000", 2024-09-13T06:39:38.103 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.8629e-05 2024-09-13T06:39:38.103 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.103 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.103 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:39:38.103 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.018351+0000", 2024-09-13T06:39:38.104 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.002001985 2024-09-13T06:39:38.104 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.104 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.104 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:38.104 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.018429+0000", 2024-09-13T06:39:38.104 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.8589000000000003e-05 2024-09-13T06:39:38.104 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:38.104 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:38.104 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:38.104 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.104 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.104 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4154.0:141 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'99, mlcod=15'85)", 2024-09-13T06:39:38.104 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:12.010422+0000", 2024-09-13T06:39:38.105 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 26.031275297000001, 2024-09-13T06:39:38.105 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0086202829999999994, 2024-09-13T06:39:38.105 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:38.105 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:38.105 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:38.105 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.105 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:38.105 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.010422+0000", 2024-09-13T06:39:38.105 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:38.105 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.105 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.105 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:38.105 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.010422+0000", 2024-09-13T06:39:38.105 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:38.106 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.106 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.106 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:38.106 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.010421+0000", 2024-09-13T06:39:38.106 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999986 2024-09-13T06:39:38.106 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.106 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.106 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:38.106 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.010434+0000", 2024-09-13T06:39:38.106 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2840000000000001e-05 2024-09-13T06:39:38.106 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.106 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.106 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:38.106 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.010457+0000", 2024-09-13T06:39:38.107 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3543000000000001e-05 2024-09-13T06:39:38.108 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.108 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.108 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:38.108 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.010474+0000", 2024-09-13T06:39:38.109 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6804e-05 2024-09-13T06:39:38.109 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.109 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.109 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:38.109 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.017610+0000", 2024-09-13T06:39:38.109 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0071355710000000003 2024-09-13T06:39:38.109 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.109 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.109 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:38.109 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.017663+0000", 2024-09-13T06:39:38.109 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3593e-05 2024-09-13T06:39:38.109 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.109 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.110 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:39:38.110 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.018991+0000", 2024-09-13T06:39:38.110 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00132777 2024-09-13T06:39:38.110 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.110 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.110 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:38.110 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.019043+0000", 2024-09-13T06:39:38.110 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.1431999999999998e-05 2024-09-13T06:39:38.110 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:38.110 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:38.110 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:38.110 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.110 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.110 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:11 3.1f 3:fa654f18:::rbd_id.image_client.0:head [create,call rbd.set_id in=9b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-09-13T06:39:38.111 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:29.377720+0000", 2024-09-13T06:39:38.111 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 8.6639773840000007, 2024-09-13T06:39:38.111 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0087536650000000008, 2024-09-13T06:39:38.111 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:38.111 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:38.111 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:39:38.111 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:39:38.111 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:38.111 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 11 2024-09-13T06:39:38.111 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.111 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:38.111 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.111 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:38.112 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:29.377720+0000", 2024-09-13T06:39:38.112 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:38.112 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.112 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.112 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:38.112 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:29.377720+0000", 2024-09-13T06:39:38.112 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:38.112 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.112 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.112 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:38.112 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:29.377718+0000", 2024-09-13T06:39:38.112 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999981 2024-09-13T06:39:38.112 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.113 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.113 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:38.113 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:29.377731+0000", 2024-09-13T06:39:38.113 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2507000000000001e-05 2024-09-13T06:39:38.113 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.113 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.113 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:38.113 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:29.377751+0000", 2024-09-13T06:39:38.113 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0716999999999998e-05 2024-09-13T06:39:38.113 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.113 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.113 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:38.113 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:29.377764+0000", 2024-09-13T06:39:38.113 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2378000000000001e-05 2024-09-13T06:39:38.114 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.114 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.114 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:38.114 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:29.377842+0000", 2024-09-13T06:39:38.114 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.7687000000000003e-05 2024-09-13T06:39:38.114 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.114 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.114 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op must wait for map", 2024-09-13T06:39:38.114 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:29.377850+0000", 2024-09-13T06:39:38.115 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.7029999999999995e-06 2024-09-13T06:39:38.115 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.115 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.115 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:38.115 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:29.380699+0000", 2024-09-13T06:39:38.115 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0028488099999999998 2024-09-13T06:39:38.115 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.115 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.115 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:38.115 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:29.380901+0000", 2024-09-13T06:39:38.115 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000202067 2024-09-13T06:39:38.115 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.115 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.116 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 5", 2024-09-13T06:39:38.116 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:29.381223+0000", 2024-09-13T06:39:38.116 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00032151199999999998 2024-09-13T06:39:38.116 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.116 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.116 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:39:38.116 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:29.382479+0000", 2024-09-13T06:39:38.116 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00125636 2024-09-13T06:39:38.116 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.116 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.116 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-09-13T06:39:38.116 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:29.386337+0000", 2024-09-13T06:39:38.116 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0038575739999999999 2024-09-13T06:39:38.117 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.117 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.117 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:39:38.117 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:29.386408+0000", 2024-09-13T06:39:38.117 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.1019000000000006e-05 2024-09-13T06:39:38.117 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.117 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.117 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:38.117 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:29.386474+0000", 2024-09-13T06:39:38.117 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.6407000000000003e-05 2024-09-13T06:39:38.117 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:38.117 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:38.117 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:38.117 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.118 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.118 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:437 3.12 3:4f94b9f1:::rbd_data.112173e2f1b7.000000000000001a:4 [sparse-read 786432~0 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e26)", 2024-09-13T06:39:38.118 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:33.431568+0000", 2024-09-13T06:39:38.118 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 4.6101301389999998, 2024-09-13T06:39:38.118 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.005261206, 2024-09-13T06:39:38.118 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:38.118 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:39:38.118 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:39:38.118 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:39:38.118 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:38.118 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 437 2024-09-13T06:39:38.118 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.118 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:38.118 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.119 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:38.119 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:33.431568+0000", 2024-09-13T06:39:38.119 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:38.119 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.119 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.119 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:38.119 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:33.431568+0000", 2024-09-13T06:39:38.119 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:38.119 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.119 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.119 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:38.119 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:33.431566+0000", 2024-09-13T06:39:38.119 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999986 2024-09-13T06:39:38.119 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.120 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.120 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:38.120 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:33.431574+0000", 2024-09-13T06:39:38.120 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.4370000000000007e-06 2024-09-13T06:39:38.120 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.120 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.120 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:38.120 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:33.431593+0000", 2024-09-13T06:39:38.120 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8589000000000001e-05 2024-09-13T06:39:38.120 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.120 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.120 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:38.120 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:33.431602+0000", 2024-09-13T06:39:38.120 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.1169999999999993e-06 2024-09-13T06:39:38.121 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.121 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.121 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:38.121 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:33.436247+0000", 2024-09-13T06:39:38.121 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.004645293 2024-09-13T06:39:38.121 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.121 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.121 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:38.121 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:33.436520+0000", 2024-09-13T06:39:38.121 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00027259499999999999 2024-09-13T06:39:38.121 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.121 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.121 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:38.122 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:33.436829+0000", 2024-09-13T06:39:38.122 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00030866800000000001 2024-09-13T06:39:38.122 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:38.122 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:38.122 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:38.122 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.122 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.122 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:438 3.12 3:4f94b9f1:::rbd_data.112173e2f1b7.000000000000001a:4 [sparse-read 2097152~0 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e26)", 2024-09-13T06:39:38.122 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:33.431610+0000", 2024-09-13T06:39:38.122 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 4.6100876529999999, 2024-09-13T06:39:38.122 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0058411380000000001, 2024-09-13T06:39:38.122 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:38.122 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:39:38.122 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:39:38.123 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:39:38.123 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:38.123 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 438 2024-09-13T06:39:38.123 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.123 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:38.123 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.123 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:38.123 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:33.431610+0000", 2024-09-13T06:39:38.123 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:38.123 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.123 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.123 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:38.123 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:33.431610+0000", 2024-09-13T06:39:38.123 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:38.124 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.124 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.124 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:38.124 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:33.431609+0000", 2024-09-13T06:39:38.124 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:39:38.124 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.124 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.124 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:38.124 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:33.431613+0000", 2024-09-13T06:39:38.124 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.7900000000000001e-06 2024-09-13T06:39:38.124 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.124 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.124 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:38.124 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:33.431622+0000", 2024-09-13T06:39:38.125 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.5569999999999996e-06 2024-09-13T06:39:38.125 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.125 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.125 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:38.125 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:33.431630+0000", 2024-09-13T06:39:38.125 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.7830000000000004e-06 2024-09-13T06:39:38.125 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.125 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.125 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:38.125 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:33.436914+0000", 2024-09-13T06:39:38.125 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0052835360000000001 2024-09-13T06:39:38.125 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.125 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.126 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:38.126 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:33.437155+0000", 2024-09-13T06:39:38.126 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00024069799999999999 2024-09-13T06:39:38.126 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.126 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.126 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:38.126 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:33.437451+0000", 2024-09-13T06:39:38.126 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00029643399999999999 2024-09-13T06:39:38.126 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:38.126 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:38.126 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:38.126 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.126 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.126 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:439 3.12 3:4f94b9f1:::rbd_data.112173e2f1b7.000000000000001a:4 [sparse-read 3407872~56768 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e26)", 2024-09-13T06:39:38.127 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:33.431637+0000", 2024-09-13T06:39:38.127 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 4.6100606099999997, 2024-09-13T06:39:38.127 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0067283320000000001, 2024-09-13T06:39:38.127 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:38.127 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:39:38.127 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:39:38.127 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:39:38.127 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:38.127 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 439 2024-09-13T06:39:38.127 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.127 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:38.127 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.127 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:38.127 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:33.431637+0000", 2024-09-13T06:39:38.128 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:38.128 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.128 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.128 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:38.128 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:33.431637+0000", 2024-09-13T06:39:38.128 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:38.128 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.128 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.128 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:38.128 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:33.431636+0000", 2024-09-13T06:39:38.128 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:39:38.128 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.128 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.129 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:38.129 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:33.431640+0000", 2024-09-13T06:39:38.129 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.1429999999999998e-06 2024-09-13T06:39:38.129 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.129 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.129 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:38.129 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:33.431648+0000", 2024-09-13T06:39:38.129 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.4600000000000003e-06 2024-09-13T06:39:38.129 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.129 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.129 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:38.129 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:33.431657+0000", 2024-09-13T06:39:38.129 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.6200000000000005e-06 2024-09-13T06:39:38.130 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.130 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.130 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:38.130 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:33.437518+0000", 2024-09-13T06:39:38.130 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0058614050000000001 2024-09-13T06:39:38.130 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.130 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.130 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:38.130 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:33.437654+0000", 2024-09-13T06:39:38.130 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000136062 2024-09-13T06:39:38.130 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.130 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.130 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:38.131 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:33.438365+0000", 2024-09-13T06:39:38.131 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000711245 2024-09-13T06:39:38.131 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:38.131 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:38.131 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:38.131 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.131 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.131 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:542 3.12 3:4e3d9f36:::rbd_data.11214e25756e.000000000000000e:head [delete] snapc 5=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-09-13T06:39:38.131 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:34.609286+0000", 2024-09-13T06:39:38.131 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 3.432411938, 2024-09-13T06:39:38.131 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0059084430000000002, 2024-09-13T06:39:38.131 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:38.131 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:38.131 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:39:38.132 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:39:38.132 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:38.132 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 542 2024-09-13T06:39:38.132 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.132 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:38.132 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.132 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:38.132 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:34.609286+0000", 2024-09-13T06:39:38.132 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:38.132 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.132 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.132 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:38.132 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:34.609286+0000", 2024-09-13T06:39:38.132 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:38.133 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.133 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.133 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:38.133 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:34.609285+0000", 2024-09-13T06:39:38.133 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:39:38.133 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.133 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.133 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:38.133 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:34.609290+0000", 2024-09-13T06:39:38.133 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6369999999999998e-06 2024-09-13T06:39:38.133 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.133 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.133 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:38.133 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:34.609300+0000", 2024-09-13T06:39:38.134 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0165e-05 2024-09-13T06:39:38.134 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.134 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.134 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:38.134 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:34.609308+0000", 2024-09-13T06:39:38.134 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.4339999999999992e-06 2024-09-13T06:39:38.134 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.134 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.134 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:38.134 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:34.609358+0000", 2024-09-13T06:39:38.134 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9793999999999998e-05 2024-09-13T06:39:38.134 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.134 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.134 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:38.135 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:34.609439+0000", 2024-09-13T06:39:38.135 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.1306999999999999e-05 2024-09-13T06:39:38.135 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.135 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.135 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 7", 2024-09-13T06:39:38.135 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:34.609589+0000", 2024-09-13T06:39:38.135 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00014956099999999999 2024-09-13T06:39:38.135 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.135 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.135 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-09-13T06:39:38.135 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:34.610669+0000", 2024-09-13T06:39:38.135 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00107957 2024-09-13T06:39:38.135 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.136 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.136 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:39:38.136 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:34.615144+0000", 2024-09-13T06:39:38.136 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0044750909999999996 2024-09-13T06:39:38.136 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.136 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.136 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:39:38.136 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:34.615170+0000", 2024-09-13T06:39:38.136 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6584000000000002e-05 2024-09-13T06:39:38.136 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.136 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.136 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:38.136 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:34.615194+0000", 2024-09-13T06:39:38.137 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3947e-05 2024-09-13T06:39:38.137 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:38.137 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:38.137 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:38.137 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:38.137 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:38.137 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:39:38.138 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-13T06:39:38.139 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:39:38.138+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:39:38.239 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:39:38.243+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:39:38.259 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:39:38.259 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-13T06:39:38.259 INFO:teuthology.orchestra.run.smithi081.stdout: "num_ops": 0 2024-09-13T06:39:38.260 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:39:38.273 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-13T06:39:38.359 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:39:38.363+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:39:38.429 INFO:teuthology.orchestra.run.smithi081.stderr:noscrub is set 2024-09-13T06:39:38.441 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:39:38.443+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:39:38.442 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:39:38.442 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-13T06:39:38.442 INFO:teuthology.orchestra.run.smithi081.stdout: "complaint_time": 30, 2024-09-13T06:39:38.443 INFO:teuthology.orchestra.run.smithi081.stdout: "num_blocked_ops": 0 2024-09-13T06:39:38.443 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:39:38.461 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-13T06:39:38.542 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:39:38.542+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:39:38.569 INFO:teuthology.orchestra.run.smithi081.stdout:165 punch from 0x4c1337 to 0x4cddda, (0xcaa3 bytes) 2024-09-13T06:39:38.631 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:39:38.631 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:39:38.631 INFO:teuthology.orchestra.run.smithi081.stdout:168 write 0xe7012bb thru 0xe7071ea (0x5f30 bytes) 2024-09-13T06:39:38.631 INFO:teuthology.orchestra.run.smithi081.stdout:169 writesame 0xad13fd3 thru 0xad2182e data_size 0x3d(0xd85c bytes) 2024-09-13T06:39:38.631 INFO:teuthology.orchestra.run.smithi081.stdout:170 write 0x146b9b5 thru 0x14771b4 (0xb800 bytes) 2024-09-13T06:39:38.631 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:39:38.631 INFO:teuthology.orchestra.run.smithi081.stdout:172 writesame 0xb8bf378 thru 0xb8cb0e7 data_size 0x38(0xbd70 bytes) 2024-09-13T06:39:38.632 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:39:38.632 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 20, 2024-09-13T06:39:38.632 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 600, 2024-09-13T06:39:38.632 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [ 2024-09-13T06:39:38.632 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.632 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4217.0:5 2.2 e19/17 2:5cea7035:::rbd_info:head v 19'1, mlcod=0'0)", 2024-09-13T06:39:38.632 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:18.555970+0000", 2024-09-13T06:39:38.633 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 20.074545128, 2024-09-13T06:39:38.633 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0019658549999999999, 2024-09-13T06:39:38.633 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:38.633 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:38.633 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:38.633 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.633 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:38.633 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:18.555970+0000", 2024-09-13T06:39:38.633 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:38.633 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.633 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.633 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:38.634 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:18.555970+0000", 2024-09-13T06:39:38.634 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:38.634 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.634 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.634 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:38.634 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:18.555969+0000", 2024-09-13T06:39:38.634 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:39:38.634 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.634 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.634 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:38.634 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:18.555986+0000", 2024-09-13T06:39:38.634 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6135999999999999e-05 2024-09-13T06:39:38.634 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.635 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.635 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:38.635 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:18.556022+0000", 2024-09-13T06:39:38.635 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.6032999999999999e-05 2024-09-13T06:39:38.635 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.635 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.635 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:38.635 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:18.556049+0000", 2024-09-13T06:39:38.635 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.7019999999999999e-05 2024-09-13T06:39:38.635 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.635 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.635 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:38.635 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:18.556178+0000", 2024-09-13T06:39:38.635 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00012947499999999999 2024-09-13T06:39:38.636 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.636 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.636 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:38.636 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:18.556228+0000", 2024-09-13T06:39:38.636 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0034000000000002e-05 2024-09-13T06:39:38.636 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.636 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.636 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:39:38.636 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:18.557841+0000", 2024-09-13T06:39:38.637 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0016127170000000001 2024-09-13T06:39:38.637 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.637 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.637 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:38.637 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:18.557936+0000", 2024-09-13T06:39:38.637 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.4995999999999996e-05 2024-09-13T06:39:38.637 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:38.637 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:38.637 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:38.637 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.637 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.637 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4217.0:7 2.2 e20/17 2:5cea7035:::rbd_info:head v 20'2, mlcod=0'0)", 2024-09-13T06:39:38.638 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:19.563171+0000", 2024-09-13T06:39:38.638 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 19.067343858000001, 2024-09-13T06:39:38.638 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0016863799999999999, 2024-09-13T06:39:38.638 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:38.638 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:38.638 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:38.638 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.638 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:38.638 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:19.563171+0000", 2024-09-13T06:39:38.638 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:38.638 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.638 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.638 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:38.639 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:19.563171+0000", 2024-09-13T06:39:38.639 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:38.639 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.639 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.639 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:38.639 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:19.563171+0000", 2024-09-13T06:39:38.639 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:39:38.639 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.639 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.639 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:38.639 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:19.563183+0000", 2024-09-13T06:39:38.639 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2663000000000001e-05 2024-09-13T06:39:38.639 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.639 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.639 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:38.640 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:19.563242+0000", 2024-09-13T06:39:38.640 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9129999999999998e-05 2024-09-13T06:39:38.640 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.640 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.640 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:38.640 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:19.563264+0000", 2024-09-13T06:39:38.640 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.124e-05 2024-09-13T06:39:38.640 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.640 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.640 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:38.640 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:19.563376+0000", 2024-09-13T06:39:38.640 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000112293 2024-09-13T06:39:38.640 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.641 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.641 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:38.641 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:19.563418+0000", 2024-09-13T06:39:38.641 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.2388999999999997e-05 2024-09-13T06:39:38.641 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.641 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.641 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:39:38.641 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:19.564754+0000", 2024-09-13T06:39:38.641 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0013353099999999999 2024-09-13T06:39:38.641 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.641 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.641 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:38.641 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:19.564858+0000", 2024-09-13T06:39:38.642 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00010406199999999999 2024-09-13T06:39:38.642 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:38.642 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:38.642 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:38.642 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.642 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.642 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4385.0:7 3.1a e23/21 3:5cea7035:::rbd_info:head v 23'1, mlcod=0'0)", 2024-09-13T06:39:38.642 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:28.361229+0000", 2024-09-13T06:39:38.642 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 10.269286549, 2024-09-13T06:39:38.642 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0015838639999999999, 2024-09-13T06:39:38.642 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:38.642 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:38.642 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:38.643 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.643 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:38.643 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:28.361229+0000", 2024-09-13T06:39:38.643 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:38.643 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.643 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.643 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:38.644 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:28.361229+0000", 2024-09-13T06:39:38.644 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:38.644 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.644 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.644 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:38.644 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:28.361228+0000", 2024-09-13T06:39:38.644 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:39:38.644 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.644 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.644 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:38.644 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:28.361237+0000", 2024-09-13T06:39:38.644 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.9600000000000006e-06 2024-09-13T06:39:38.644 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.644 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.645 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:38.645 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:28.361265+0000", 2024-09-13T06:39:38.645 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.7993000000000001e-05 2024-09-13T06:39:38.645 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.645 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.645 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:38.645 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:28.361288+0000", 2024-09-13T06:39:38.645 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2670000000000001e-05 2024-09-13T06:39:38.645 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.645 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.645 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:38.646 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:28.361391+0000", 2024-09-13T06:39:38.646 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000102939 2024-09-13T06:39:38.646 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.646 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.646 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:38.646 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:28.361426+0000", 2024-09-13T06:39:38.646 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.4876999999999998e-05 2024-09-13T06:39:38.646 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.646 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.646 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:39:38.646 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:28.362731+0000", 2024-09-13T06:39:38.647 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0013053260000000001 2024-09-13T06:39:38.647 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.647 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.647 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:38.647 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:28.362812+0000", 2024-09-13T06:39:38.647 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.1602999999999998e-05 2024-09-13T06:39:38.647 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:38.647 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:38.647 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:38.647 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.647 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.647 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4385.0:9 3.1a e24/21 3:5cea7035:::rbd_info:head v 24'2, mlcod=0'0)", 2024-09-13T06:39:38.647 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:29.373061+0000", 2024-09-13T06:39:38.648 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 9.2574537489999997, 2024-09-13T06:39:38.648 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0017979560000000001, 2024-09-13T06:39:38.648 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:38.648 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:38.648 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:38.648 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.648 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:38.648 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:29.373061+0000", 2024-09-13T06:39:38.648 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:38.648 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.648 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.648 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:38.649 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:29.373061+0000", 2024-09-13T06:39:38.649 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:38.649 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.649 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.649 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:38.649 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:29.373061+0000", 2024-09-13T06:39:38.649 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:39:38.649 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.649 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.649 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:38.649 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:29.373069+0000", 2024-09-13T06:39:38.649 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.2150000000000001e-06 2024-09-13T06:39:38.649 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.649 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.650 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:38.650 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:29.373091+0000", 2024-09-13T06:39:38.650 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1753e-05 2024-09-13T06:39:38.650 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.650 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.650 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:38.650 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:29.373103+0000", 2024-09-13T06:39:38.650 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2336e-05 2024-09-13T06:39:38.650 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.650 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.650 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:38.650 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:29.373169+0000", 2024-09-13T06:39:38.650 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.5760999999999996e-05 2024-09-13T06:39:38.651 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.651 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.651 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:38.651 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:29.373195+0000", 2024-09-13T06:39:38.651 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5901000000000002e-05 2024-09-13T06:39:38.651 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.651 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.651 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:39:38.651 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:29.374801+0000", 2024-09-13T06:39:38.651 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0016063049999999999 2024-09-13T06:39:38.651 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.652 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.652 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:38.652 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:29.374859+0000", 2024-09-13T06:39:38.652 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8118000000000002e-05 2024-09-13T06:39:38.652 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:38.652 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:38.652 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:38.652 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.652 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.652 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:385 3.0 3:07257432:::rbd_data.112173e2f1b7.000000000000001d:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e26)", 2024-09-13T06:39:38.653 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:33.424746+0000", 2024-09-13T06:39:38.653 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 5.2057689649999999, 2024-09-13T06:39:38.653 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.005218004, 2024-09-13T06:39:38.653 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:38.653 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:39:38.653 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:39:38.653 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:39:38.653 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:38.654 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 385 2024-09-13T06:39:38.654 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.654 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:38.654 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.654 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:38.654 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:33.424746+0000", 2024-09-13T06:39:38.654 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:38.654 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.654 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.654 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:38.654 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:33.424746+0000", 2024-09-13T06:39:38.654 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:38.654 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.654 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.655 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:38.655 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:33.424742+0000", 2024-09-13T06:39:38.655 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999962 2024-09-13T06:39:38.655 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.655 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.655 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:38.655 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:33.424763+0000", 2024-09-13T06:39:38.655 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0526e-05 2024-09-13T06:39:38.656 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.656 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.656 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:38.656 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:33.424818+0000", 2024-09-13T06:39:38.656 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.5506e-05 2024-09-13T06:39:38.656 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.656 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.656 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:38.656 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:33.424848+0000", 2024-09-13T06:39:38.656 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9427000000000001e-05 2024-09-13T06:39:38.656 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.656 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.656 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:38.657 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:33.425016+0000", 2024-09-13T06:39:38.657 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000168565 2024-09-13T06:39:38.657 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.657 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.657 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op must wait for map", 2024-09-13T06:39:38.657 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:33.425034+0000", 2024-09-13T06:39:38.657 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8099999999999999e-05 2024-09-13T06:39:38.657 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.658 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.658 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:38.658 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:33.429710+0000", 2024-09-13T06:39:38.658 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.004675841 2024-09-13T06:39:38.658 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.658 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.658 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:38.658 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:33.429964+0000", 2024-09-13T06:39:38.658 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00025389500000000002 2024-09-13T06:39:38.658 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:38.658 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:38.658 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:38.658 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.658 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.659 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:395 3.0 3:07257432:::rbd_data.112173e2f1b7.000000000000001d:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e26)", 2024-09-13T06:39:38.659 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:33.425757+0000", 2024-09-13T06:39:38.659 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 5.2047582160000001, 2024-09-13T06:39:38.659 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.004472419, 2024-09-13T06:39:38.659 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:38.659 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:39:38.659 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:39:38.659 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:39:38.659 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:38.659 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 395 2024-09-13T06:39:38.659 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.659 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:38.659 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.660 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:38.660 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:33.425757+0000", 2024-09-13T06:39:38.660 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:38.660 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.660 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.660 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:38.660 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:33.425757+0000", 2024-09-13T06:39:38.660 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:38.660 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.660 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.660 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:38.661 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:33.425754+0000", 2024-09-13T06:39:38.661 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999971 2024-09-13T06:39:38.661 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.661 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.661 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:38.661 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:33.425771+0000", 2024-09-13T06:39:38.661 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7169000000000001e-05 2024-09-13T06:39:38.661 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.661 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.662 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:38.662 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:33.425813+0000", 2024-09-13T06:39:38.662 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.1597000000000002e-05 2024-09-13T06:39:38.662 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.662 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.662 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:38.662 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:33.425842+0000", 2024-09-13T06:39:38.662 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9427000000000001e-05 2024-09-13T06:39:38.662 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.662 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.662 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:38.662 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:33.425960+0000", 2024-09-13T06:39:38.662 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000117909 2024-09-13T06:39:38.663 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.663 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.663 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting_for_map not empty", 2024-09-13T06:39:38.663 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:33.425975+0000", 2024-09-13T06:39:38.663 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4902999999999999e-05 2024-09-13T06:39:38.663 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.663 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.663 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:38.663 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:33.430004+0000", 2024-09-13T06:39:38.663 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0040290689999999997 2024-09-13T06:39:38.663 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.664 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.664 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:38.664 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:33.430229+0000", 2024-09-13T06:39:38.664 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00022520099999999999 2024-09-13T06:39:38.664 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:38.664 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:38.664 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:38.664 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.664 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.664 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:405 3.0 3:07257432:::rbd_data.112173e2f1b7.000000000000001d:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e26)", 2024-09-13T06:39:38.664 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:33.426707+0000", 2024-09-13T06:39:38.664 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 5.2038081500000004, 2024-09-13T06:39:38.665 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0038827139999999998, 2024-09-13T06:39:38.665 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:38.665 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:39:38.665 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:39:38.665 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:39:38.665 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:38.665 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 405 2024-09-13T06:39:38.665 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.665 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:38.665 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.665 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:38.665 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:33.426707+0000", 2024-09-13T06:39:38.665 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:38.666 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.666 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.666 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:38.666 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:33.426707+0000", 2024-09-13T06:39:38.666 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:38.666 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.666 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.666 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:38.666 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:33.426704+0000", 2024-09-13T06:39:38.666 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999967 2024-09-13T06:39:38.666 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.666 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.666 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:38.667 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:33.426722+0000", 2024-09-13T06:39:38.667 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8377e-05 2024-09-13T06:39:38.667 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.667 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.667 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:38.667 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:33.426759+0000", 2024-09-13T06:39:38.667 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.6789999999999998e-05 2024-09-13T06:39:38.667 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.667 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.667 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:38.667 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:33.426781+0000", 2024-09-13T06:39:38.667 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2563000000000001e-05 2024-09-13T06:39:38.668 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.668 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.668 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:38.668 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:33.426902+0000", 2024-09-13T06:39:38.668 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00012110199999999999 2024-09-13T06:39:38.668 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.668 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.668 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting_for_map not empty", 2024-09-13T06:39:38.668 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:33.426928+0000", 2024-09-13T06:39:38.668 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5803e-05 2024-09-13T06:39:38.668 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.668 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.668 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:38.669 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:33.430319+0000", 2024-09-13T06:39:38.669 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0033910070000000001 2024-09-13T06:39:38.669 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.669 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.669 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:38.669 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:33.430590+0000", 2024-09-13T06:39:38.669 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000270485 2024-09-13T06:39:38.669 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:38.669 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:38.669 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:38.669 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.669 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.670 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:415 3.0 3:07257432:::rbd_data.112173e2f1b7.000000000000001d:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e26)", 2024-09-13T06:39:38.670 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:33.427072+0000", 2024-09-13T06:39:38.670 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 5.2034433419999999, 2024-09-13T06:39:38.670 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0038082739999999999, 2024-09-13T06:39:38.670 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:38.670 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:39:38.670 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:39:38.670 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:39:38.671 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:38.671 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 415 2024-09-13T06:39:38.671 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.671 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:38.671 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.671 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:38.671 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:33.427072+0000", 2024-09-13T06:39:38.671 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:38.671 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.671 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.671 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:38.671 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:33.427072+0000", 2024-09-13T06:39:38.671 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:38.671 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.672 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.672 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:38.672 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:33.427070+0000", 2024-09-13T06:39:38.672 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999981 2024-09-13T06:39:38.672 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.672 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.672 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:38.672 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:33.427083+0000", 2024-09-13T06:39:38.672 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3463e-05 2024-09-13T06:39:38.672 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.672 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.672 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:38.672 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:33.427111+0000", 2024-09-13T06:39:38.672 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.7606999999999998e-05 2024-09-13T06:39:38.672 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.673 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.673 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:38.673 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:33.427131+0000", 2024-09-13T06:39:38.673 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9979999999999998e-05 2024-09-13T06:39:38.673 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.673 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.673 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:38.673 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:33.427259+0000", 2024-09-13T06:39:38.673 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00012844199999999999 2024-09-13T06:39:38.673 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.673 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.673 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting_for_map not empty", 2024-09-13T06:39:38.673 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:33.427273+0000", 2024-09-13T06:39:38.674 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4334e-05 2024-09-13T06:39:38.674 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.674 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.674 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:38.674 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:33.430693+0000", 2024-09-13T06:39:38.674 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0034190370000000002 2024-09-13T06:39:38.674 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.674 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.674 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:38.674 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:33.430880+0000", 2024-09-13T06:39:38.674 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00018754500000000001 2024-09-13T06:39:38.674 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:38.674 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:38.675 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:38.675 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.675 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.675 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:425 3.0 3:07257432:::rbd_data.112173e2f1b7.000000000000001d:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e26)", 2024-09-13T06:39:38.675 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:33.427852+0000", 2024-09-13T06:39:38.675 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 5.2026631749999996, 2024-09-13T06:39:38.675 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0033210449999999999, 2024-09-13T06:39:38.675 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:38.675 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:39:38.675 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:39:38.675 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:39:38.675 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:38.675 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 425 2024-09-13T06:39:38.676 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.676 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:38.676 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.676 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:38.676 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:33.427852+0000", 2024-09-13T06:39:38.676 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:38.676 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.676 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.676 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:38.676 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:33.427852+0000", 2024-09-13T06:39:38.676 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:38.676 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.676 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.677 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:38.677 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:33.427850+0000", 2024-09-13T06:39:38.677 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999981 2024-09-13T06:39:38.677 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.677 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.677 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:38.677 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:33.427864+0000", 2024-09-13T06:39:38.677 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4243000000000001e-05 2024-09-13T06:39:38.677 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.677 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.677 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:38.677 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:33.427895+0000", 2024-09-13T06:39:38.677 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.0580000000000002e-05 2024-09-13T06:39:38.677 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.678 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.678 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:38.678 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:33.427920+0000", 2024-09-13T06:39:38.678 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5792999999999999e-05 2024-09-13T06:39:38.678 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.678 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.678 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:38.678 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:33.428043+0000", 2024-09-13T06:39:38.678 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00012276600000000001 2024-09-13T06:39:38.678 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.678 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.678 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting_for_map not empty", 2024-09-13T06:39:38.678 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:33.428056+0000", 2024-09-13T06:39:38.679 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3186999999999999e-05 2024-09-13T06:39:38.679 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.679 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.679 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:38.679 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:33.430938+0000", 2024-09-13T06:39:38.679 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.002882024 2024-09-13T06:39:38.679 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.679 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.679 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:38.679 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:33.431173+0000", 2024-09-13T06:39:38.679 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000234522 2024-09-13T06:39:38.679 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:38.679 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:38.680 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:38.680 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.680 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.680 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:593 3.19 3:9c48819f:::rbd_data.11214e25756e.000000000000001d:head [set-alloc-hint object_size 8388608 write_size 8388608,write 6104604~40466] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-09-13T06:39:38.680 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:34.755675+0000", 2024-09-13T06:39:38.680 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 3.8748404980000002, 2024-09-13T06:39:38.680 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0018737300000000001, 2024-09-13T06:39:38.680 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:38.680 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:38.680 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:39:38.680 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:39:38.680 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:38.680 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 593 2024-09-13T06:39:38.681 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.681 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:38.681 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.681 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:38.681 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:34.755675+0000", 2024-09-13T06:39:38.681 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:38.681 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.681 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.681 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:38.681 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:34.755675+0000", 2024-09-13T06:39:38.681 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:38.681 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.681 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.682 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:38.682 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:34.755673+0000", 2024-09-13T06:39:38.682 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999981 2024-09-13T06:39:38.682 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.682 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.682 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:38.682 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:34.755722+0000", 2024-09-13T06:39:38.682 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9268000000000003e-05 2024-09-13T06:39:38.682 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.682 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.682 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:38.682 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:34.755743+0000", 2024-09-13T06:39:38.682 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0703000000000002e-05 2024-09-13T06:39:38.682 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.683 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.683 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:38.683 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:34.755751+0000", 2024-09-13T06:39:38.683 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.9410000000000007e-06 2024-09-13T06:39:38.683 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.683 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.683 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:38.683 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:34.755839+0000", 2024-09-13T06:39:38.683 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.8028000000000005e-05 2024-09-13T06:39:38.683 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.683 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.683 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:38.683 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:34.756001+0000", 2024-09-13T06:39:38.683 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000162523 2024-09-13T06:39:38.684 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.684 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.684 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 3", 2024-09-13T06:39:38.684 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:34.756141+0000", 2024-09-13T06:39:38.684 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000139362 2024-09-13T06:39:38.684 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.684 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.684 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-09-13T06:39:38.684 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:34.757257+0000", 2024-09-13T06:39:38.684 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0011161120000000001 2024-09-13T06:39:38.684 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.684 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.684 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:39:38.684 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:34.757481+0000", 2024-09-13T06:39:38.685 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000224219 2024-09-13T06:39:38.685 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.685 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.685 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:39:38.685 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:34.757518+0000", 2024-09-13T06:39:38.685 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.6924000000000001e-05 2024-09-13T06:39:38.685 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.685 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.685 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:38.685 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:34.757548+0000", 2024-09-13T06:39:38.685 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.0513000000000001e-05 2024-09-13T06:39:38.685 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:38.685 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:38.685 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:38.686 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.686 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.686 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:607 3.19 3:9b7bb54a:::rbd_data.11214e25756e.0000000000000019:head [set-alloc-hint object_size 8388608 write_size 8388608,write 5691770~36898] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-09-13T06:39:38.686 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:34.799404+0000", 2024-09-13T06:39:38.686 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 3.8311113780000001, 2024-09-13T06:39:38.686 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.001735826, 2024-09-13T06:39:38.686 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:38.686 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:38.686 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:39:38.686 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:39:38.686 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:38.686 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 607 2024-09-13T06:39:38.686 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.686 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:38.687 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.687 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:38.687 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:34.799404+0000", 2024-09-13T06:39:38.687 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:38.687 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.687 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.687 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:38.687 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:34.799404+0000", 2024-09-13T06:39:38.687 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:38.687 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.687 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.687 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:38.687 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:34.799402+0000", 2024-09-13T06:39:38.687 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999981 2024-09-13T06:39:38.688 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.688 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.688 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:38.688 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:34.799435+0000", 2024-09-13T06:39:38.688 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.2798e-05 2024-09-13T06:39:38.688 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.688 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.688 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:38.688 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:34.799458+0000", 2024-09-13T06:39:38.688 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3952e-05 2024-09-13T06:39:38.688 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.688 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.688 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:38.688 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:34.799469+0000", 2024-09-13T06:39:38.689 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0141e-05 2024-09-13T06:39:38.689 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.689 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.689 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:38.689 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:34.799530+0000", 2024-09-13T06:39:38.689 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.1845000000000002e-05 2024-09-13T06:39:38.689 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.689 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.689 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:38.689 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:34.799660+0000", 2024-09-13T06:39:38.689 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000129293 2024-09-13T06:39:38.689 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.689 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.690 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 3", 2024-09-13T06:39:38.690 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:34.799784+0000", 2024-09-13T06:39:38.690 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000124179 2024-09-13T06:39:38.690 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.690 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.690 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-09-13T06:39:38.690 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:34.800785+0000", 2024-09-13T06:39:38.690 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.001001463 2024-09-13T06:39:38.690 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.690 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.690 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:39:38.690 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:34.801057+0000", 2024-09-13T06:39:38.690 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00027177199999999999 2024-09-13T06:39:38.690 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.690 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.691 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:39:38.691 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:34.801103+0000", 2024-09-13T06:39:38.691 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5386999999999998e-05 2024-09-13T06:39:38.691 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.691 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.691 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:38.691 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:34.801140+0000", 2024-09-13T06:39:38.691 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.7005000000000002e-05 2024-09-13T06:39:38.691 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:38.691 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:38.691 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:38.691 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.691 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.691 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:609 3.19 3:9b7bb54a:::rbd_data.11214e25756e.0000000000000019:head [truncate 1048576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-09-13T06:39:38.691 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:34.838669+0000", 2024-09-13T06:39:38.692 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 3.7918466, 2024-09-13T06:39:38.692 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0028664010000000002, 2024-09-13T06:39:38.692 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:38.692 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:38.692 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:39:38.692 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:39:38.692 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:38.692 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 609 2024-09-13T06:39:38.692 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.692 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:38.692 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.692 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:38.693 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:34.838669+0000", 2024-09-13T06:39:38.693 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:38.693 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.693 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.693 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:38.693 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:34.838669+0000", 2024-09-13T06:39:38.694 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:38.694 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.694 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.694 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:38.694 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:34.838665+0000", 2024-09-13T06:39:38.694 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999967 2024-09-13T06:39:38.694 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.694 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.694 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:38.694 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:34.838685+0000", 2024-09-13T06:39:38.694 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0064e-05 2024-09-13T06:39:38.694 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.694 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.695 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:38.695 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:34.838716+0000", 2024-09-13T06:39:38.695 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.0895999999999997e-05 2024-09-13T06:39:38.695 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.695 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.695 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:38.695 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:34.838733+0000", 2024-09-13T06:39:38.695 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6969e-05 2024-09-13T06:39:38.695 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.695 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.695 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:38.695 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:34.838818+0000", 2024-09-13T06:39:38.695 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.4934999999999999e-05 2024-09-13T06:39:38.695 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.696 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.696 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:38.696 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:34.838937+0000", 2024-09-13T06:39:38.696 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000119146 2024-09-13T06:39:38.696 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.696 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.696 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 3", 2024-09-13T06:39:38.696 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:34.839110+0000", 2024-09-13T06:39:38.696 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00017290400000000001 2024-09-13T06:39:38.696 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.696 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.696 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-09-13T06:39:38.696 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:34.840267+0000", 2024-09-13T06:39:38.696 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.001156376 2024-09-13T06:39:38.697 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.697 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.697 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:39:38.697 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:34.841290+0000", 2024-09-13T06:39:38.697 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.001023253 2024-09-13T06:39:38.697 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.697 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.697 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:39:38.697 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:34.841416+0000", 2024-09-13T06:39:38.697 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00012593899999999999 2024-09-13T06:39:38.697 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.697 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.697 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:38.698 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:34.841535+0000", 2024-09-13T06:39:38.698 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000119196 2024-09-13T06:39:38.698 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:38.698 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:38.698 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:38.698 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.698 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.698 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:612 3.19 3:9c48819f:::rbd_data.11214e25756e.000000000000001d:head [truncate 804044] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-09-13T06:39:38.698 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:34.838764+0000", 2024-09-13T06:39:38.698 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 3.7917507690000001, 2024-09-13T06:39:38.698 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0046885980000000004, 2024-09-13T06:39:38.698 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:38.698 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:38.698 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:39:38.699 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:39:38.699 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:38.699 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 612 2024-09-13T06:39:38.699 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.699 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:38.699 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.699 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:38.699 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:34.838764+0000", 2024-09-13T06:39:38.699 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:38.699 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.699 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.699 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:38.699 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:34.838764+0000", 2024-09-13T06:39:38.700 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:38.700 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.700 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.700 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:38.700 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:34.838764+0000", 2024-09-13T06:39:38.700 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:39:38.700 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.700 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.700 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:38.700 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:34.838768+0000", 2024-09-13T06:39:38.700 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6399999999999996e-06 2024-09-13T06:39:38.700 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.700 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.700 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:38.700 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:34.838775+0000", 2024-09-13T06:39:38.701 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.1110000000000002e-06 2024-09-13T06:39:38.701 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.701 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.701 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:38.701 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:34.838780+0000", 2024-09-13T06:39:38.701 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.2429999999999999e-06 2024-09-13T06:39:38.701 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.701 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.701 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:38.701 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:34.839535+0000", 2024-09-13T06:39:38.701 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00075480199999999995 2024-09-13T06:39:38.701 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.701 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.702 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:38.702 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:34.839619+0000", 2024-09-13T06:39:38.702 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.4024999999999996e-05 2024-09-13T06:39:38.702 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.702 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.702 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 3", 2024-09-13T06:39:38.702 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:34.839753+0000", 2024-09-13T06:39:38.702 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000134795 2024-09-13T06:39:38.702 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.702 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.702 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-09-13T06:39:38.702 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:34.840935+0000", 2024-09-13T06:39:38.702 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.001181641 2024-09-13T06:39:38.702 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.703 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.703 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:39:38.703 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:34.843273+0000", 2024-09-13T06:39:38.703 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0023378399999999999 2024-09-13T06:39:38.703 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.703 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.703 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:39:38.703 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:34.843350+0000", 2024-09-13T06:39:38.703 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.6902000000000003e-05 2024-09-13T06:39:38.703 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.703 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.703 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:38.703 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:34.843453+0000", 2024-09-13T06:39:38.703 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000103216 2024-09-13T06:39:38.704 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:38.704 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:38.704 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:38.704 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.704 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.704 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop_reply(client.4385.0:609 3.19 e27/21 ondisk, result = 0)", 2024-09-13T06:39:38.704 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:34.841099+0000", 2024-09-13T06:39:38.704 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 3.7894165530000001, 2024-09-13T06:39:38.704 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00044820999999999999, 2024-09-13T06:39:38.704 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:38.704 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:39:38.704 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:38.704 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.704 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:38.705 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:34.841099+0000", 2024-09-13T06:39:38.705 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:38.705 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.705 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.705 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:38.705 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:34.841099+0000", 2024-09-13T06:39:38.705 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:38.705 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.705 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.705 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:38.705 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:34.841097+0000", 2024-09-13T06:39:38.705 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.999999 2024-09-13T06:39:38.705 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.706 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.706 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:38.706 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:34.841104+0000", 2024-09-13T06:39:38.706 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3380000000000001e-06 2024-09-13T06:39:38.706 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.706 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.706 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:38.706 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:34.841119+0000", 2024-09-13T06:39:38.706 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5469e-05 2024-09-13T06:39:38.706 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.706 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.706 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:38.706 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:34.841127+0000", 2024-09-13T06:39:38.706 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.7880000000000007e-06 2024-09-13T06:39:38.707 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.707 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.707 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:38.707 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:34.841248+0000", 2024-09-13T06:39:38.707 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000121259 2024-09-13T06:39:38.707 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.707 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.707 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:38.707 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:34.841274+0000", 2024-09-13T06:39:38.707 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5367e-05 2024-09-13T06:39:38.707 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.707 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.707 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:38.707 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:34.841547+0000", 2024-09-13T06:39:38.708 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00027310700000000003 2024-09-13T06:39:38.708 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:38.708 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:38.708 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:38.708 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.708 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.708 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop_reply(client.4385.0:612 3.19 e27/21 ondisk, result = 0)", 2024-09-13T06:39:38.708 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:34.843128+0000", 2024-09-13T06:39:38.708 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 3.7873873179999999, 2024-09-13T06:39:38.708 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00033561000000000002, 2024-09-13T06:39:38.708 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:38.708 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:39:38.708 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:38.708 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.709 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:38.709 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:34.843128+0000", 2024-09-13T06:39:38.709 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:38.709 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.709 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.709 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:38.709 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:34.843128+0000", 2024-09-13T06:39:38.709 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:38.709 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.709 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.709 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:38.709 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:34.843127+0000", 2024-09-13T06:39:38.710 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.999999 2024-09-13T06:39:38.710 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.710 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.710 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:38.710 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:34.843133+0000", 2024-09-13T06:39:38.710 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.6699999999999999e-06 2024-09-13T06:39:38.710 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.710 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.710 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:38.710 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:34.843147+0000", 2024-09-13T06:39:38.710 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4031e-05 2024-09-13T06:39:38.710 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.710 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.711 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:38.711 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:34.843165+0000", 2024-09-13T06:39:38.711 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8084000000000002e-05 2024-09-13T06:39:38.711 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.711 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.711 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:38.711 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:34.843249+0000", 2024-09-13T06:39:38.711 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.4099999999999998e-05 2024-09-13T06:39:38.711 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.711 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.711 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:38.711 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:34.843263+0000", 2024-09-13T06:39:38.712 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3682999999999999e-05 2024-09-13T06:39:38.712 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.712 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.712 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:38.712 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:34.843463+0000", 2024-09-13T06:39:38.712 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000200798 2024-09-13T06:39:38.712 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:38.712 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:38.712 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:38.712 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.712 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.712 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:634 3.19 3:9b7bb54a:::rbd_data.11214e25756e.0000000000000019:head [delete] snapc 5=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-09-13T06:39:38.712 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:34.892645+0000", 2024-09-13T06:39:38.712 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 3.737869957, 2024-09-13T06:39:38.713 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0042744200000000001, 2024-09-13T06:39:38.713 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:38.713 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:38.713 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:39:38.713 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:39:38.713 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:38.713 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 634 2024-09-13T06:39:38.713 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.713 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:38.713 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.713 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:38.713 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:34.892645+0000", 2024-09-13T06:39:38.713 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:38.714 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.714 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.714 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:38.714 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:34.892645+0000", 2024-09-13T06:39:38.714 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:38.714 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.714 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.714 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:38.714 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:34.892641+0000", 2024-09-13T06:39:38.714 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999962 2024-09-13T06:39:38.714 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.714 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.714 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:38.714 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:34.892659+0000", 2024-09-13T06:39:38.715 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.804e-05 2024-09-13T06:39:38.715 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.715 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.715 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:38.715 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:34.892708+0000", 2024-09-13T06:39:38.715 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.8405999999999997e-05 2024-09-13T06:39:38.715 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.715 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.715 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:38.715 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:34.892737+0000", 2024-09-13T06:39:38.715 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9062999999999999e-05 2024-09-13T06:39:38.715 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.715 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.715 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:38.715 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:34.892805+0000", 2024-09-13T06:39:38.716 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.7926e-05 2024-09-13T06:39:38.716 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.716 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.716 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:38.716 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:34.892902+0000", 2024-09-13T06:39:38.716 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.6807999999999999e-05 2024-09-13T06:39:38.716 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.716 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.716 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 3", 2024-09-13T06:39:38.716 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:34.893027+0000", 2024-09-13T06:39:38.716 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00012524699999999999 2024-09-13T06:39:38.716 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.716 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.716 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-09-13T06:39:38.716 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:34.894544+0000", 2024-09-13T06:39:38.717 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0015175119999999999 2024-09-13T06:39:38.717 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.717 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.717 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:39:38.717 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:34.896714+0000", 2024-09-13T06:39:38.717 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00217009 2024-09-13T06:39:38.717 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.717 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.717 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:39:38.717 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:34.896806+0000", 2024-09-13T06:39:38.717 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.1272000000000003e-05 2024-09-13T06:39:38.717 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.717 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.718 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:38.718 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:34.896920+0000", 2024-09-13T06:39:38.718 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000113929 2024-09-13T06:39:38.718 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:38.718 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:38.718 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:38.718 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.718 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.718 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:638 3.19 3:9c48819f:::rbd_data.11214e25756e.000000000000001d:head [delete] snapc 5=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-09-13T06:39:38.718 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:34.892767+0000", 2024-09-13T06:39:38.718 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 3.7377479710000001, 2024-09-13T06:39:38.718 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0050104069999999997, 2024-09-13T06:39:38.718 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:38.718 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:38.719 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:39:38.719 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:39:38.719 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:38.719 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 638 2024-09-13T06:39:38.719 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.719 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:38.719 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.719 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:38.719 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:34.892767+0000", 2024-09-13T06:39:38.719 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:38.719 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.719 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.719 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:38.719 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:34.892767+0000", 2024-09-13T06:39:38.720 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:38.720 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.720 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.720 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:38.720 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:34.892766+0000", 2024-09-13T06:39:38.720 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999986 2024-09-13T06:39:38.720 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.720 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.720 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:38.720 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:34.892774+0000", 2024-09-13T06:39:38.720 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.8370000000000003e-06 2024-09-13T06:39:38.720 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.720 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.720 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:38.721 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:34.892803+0000", 2024-09-13T06:39:38.721 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.8297e-05 2024-09-13T06:39:38.721 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.721 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.721 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:38.721 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:34.892818+0000", 2024-09-13T06:39:38.721 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4949999999999999e-05 2024-09-13T06:39:38.721 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.721 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.721 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:38.721 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:34.893427+0000", 2024-09-13T06:39:38.721 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000609031 2024-09-13T06:39:38.721 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.721 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.722 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:38.722 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:34.893642+0000", 2024-09-13T06:39:38.722 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00021495499999999999 2024-09-13T06:39:38.722 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.722 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.722 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 3", 2024-09-13T06:39:38.722 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:34.893989+0000", 2024-09-13T06:39:38.722 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00034707500000000002 2024-09-13T06:39:38.722 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.722 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.722 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-09-13T06:39:38.722 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:34.896378+0000", 2024-09-13T06:39:38.722 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0023893569999999999 2024-09-13T06:39:38.722 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.722 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.723 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:39:38.723 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:34.897527+0000", 2024-09-13T06:39:38.723 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.001148785 2024-09-13T06:39:38.723 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.723 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.723 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:39:38.723 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:34.897669+0000", 2024-09-13T06:39:38.723 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000142065 2024-09-13T06:39:38.723 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.723 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.723 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:38.723 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:34.897778+0000", 2024-09-13T06:39:38.723 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000108699 2024-09-13T06:39:38.723 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:38.724 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:38.724 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:38.724 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.724 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.724 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop_reply(client.4385.0:634 3.19 e27/21 ondisk, result = 0)", 2024-09-13T06:39:38.724 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:34.896562+0000", 2024-09-13T06:39:38.724 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 3.7339532609999999, 2024-09-13T06:39:38.724 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00036968100000000001, 2024-09-13T06:39:38.724 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:38.724 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:39:38.724 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:38.724 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.724 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:38.725 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:34.896562+0000", 2024-09-13T06:39:38.725 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:38.725 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.725 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.725 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:38.725 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:34.896562+0000", 2024-09-13T06:39:38.725 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:38.725 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.725 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.725 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:38.725 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:34.896561+0000", 2024-09-13T06:39:38.725 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999986 2024-09-13T06:39:38.726 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.726 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.726 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:38.726 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:34.896568+0000", 2024-09-13T06:39:38.726 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.2729999999999997e-06 2024-09-13T06:39:38.726 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.726 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.726 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:38.726 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:34.896585+0000", 2024-09-13T06:39:38.726 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6844999999999999e-05 2024-09-13T06:39:38.726 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.726 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.726 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:38.727 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:34.896593+0000", 2024-09-13T06:39:38.727 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.4950000000000008e-06 2024-09-13T06:39:38.727 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.727 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.727 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:38.727 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:34.896688+0000", 2024-09-13T06:39:38.727 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.5285000000000007e-05 2024-09-13T06:39:38.727 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.727 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.727 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:38.727 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:34.896703+0000", 2024-09-13T06:39:38.727 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4653e-05 2024-09-13T06:39:38.727 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.728 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.728 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:38.728 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:34.896932+0000", 2024-09-13T06:39:38.728 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00022847500000000001 2024-09-13T06:39:38.728 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:38.728 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:38.728 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:38.728 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.728 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.728 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop_reply(client.4385.0:638 3.19 e27/21 ondisk, result = 0)", 2024-09-13T06:39:38.728 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:34.897355+0000", 2024-09-13T06:39:38.728 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 3.7331598050000001, 2024-09-13T06:39:38.728 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00044286500000000002, 2024-09-13T06:39:38.728 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:38.729 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:39:38.729 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:38.729 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.729 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:38.729 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:34.897355+0000", 2024-09-13T06:39:38.729 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:38.729 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.729 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.729 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:38.729 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:34.897355+0000", 2024-09-13T06:39:38.729 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:38.729 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.729 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.729 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:38.729 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:34.897355+0000", 2024-09-13T06:39:38.730 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.999999 2024-09-13T06:39:38.730 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.730 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.730 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:38.730 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:34.897360+0000", 2024-09-13T06:39:38.730 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.101e-06 2024-09-13T06:39:38.730 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.730 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.730 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:38.730 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:34.897374+0000", 2024-09-13T06:39:38.730 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3984e-05 2024-09-13T06:39:38.730 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.730 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.730 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:38.730 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:34.897381+0000", 2024-09-13T06:39:38.731 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5680000000000002e-06 2024-09-13T06:39:38.731 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.731 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.731 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:38.731 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:34.897484+0000", 2024-09-13T06:39:38.731 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000102464 2024-09-13T06:39:38.731 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.731 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.731 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:38.731 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:34.897510+0000", 2024-09-13T06:39:38.731 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5823e-05 2024-09-13T06:39:38.731 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.731 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.732 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:38.732 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:34.897798+0000", 2024-09-13T06:39:38.732 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00028865500000000002 2024-09-13T06:39:38.732 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:38.732 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:38.732 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:38.732 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.732 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.732 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:2171 3.0 3:07d66135:::rbd_object_map.11212429e5ad:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-13T06:39:38.732 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:37.439644+0000", 2024-09-13T06:39:38.732 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 1.190871349, 2024-09-13T06:39:38.732 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0041789349999999999, 2024-09-13T06:39:38.732 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:38.732 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:38.733 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:39:38.733 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:39:38.733 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:38.733 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 2171 2024-09-13T06:39:38.733 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.733 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:38.733 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.733 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:38.733 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.439644+0000", 2024-09-13T06:39:38.733 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:38.733 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.733 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.733 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:38.733 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.439644+0000", 2024-09-13T06:39:38.734 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:38.734 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.734 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.734 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:38.734 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.439642+0000", 2024-09-13T06:39:38.734 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999976 2024-09-13T06:39:38.734 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.734 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.734 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:38.734 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.439653+0000", 2024-09-13T06:39:38.734 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1028e-05 2024-09-13T06:39:38.734 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.734 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.735 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:38.735 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.439672+0000", 2024-09-13T06:39:38.735 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9840999999999999e-05 2024-09-13T06:39:38.735 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.735 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.735 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:38.735 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.439682+0000", 2024-09-13T06:39:38.735 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.3239999999999992e-06 2024-09-13T06:39:38.735 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.735 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.735 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:38.735 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.439729+0000", 2024-09-13T06:39:38.736 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6833999999999999e-05 2024-09-13T06:39:38.736 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.736 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.736 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op must wait for map", 2024-09-13T06:39:38.736 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.439734+0000", 2024-09-13T06:39:38.736 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.1529999999999996e-06 2024-09-13T06:39:38.736 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.736 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.736 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:38.736 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.441864+0000", 2024-09-13T06:39:38.736 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0021298630000000001 2024-09-13T06:39:38.736 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.736 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.736 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:38.736 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.442012+0000", 2024-09-13T06:39:38.737 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00014793400000000001 2024-09-13T06:39:38.737 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.737 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.737 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 2", 2024-09-13T06:39:38.737 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.442289+0000", 2024-09-13T06:39:38.737 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00027742100000000003 2024-09-13T06:39:38.737 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.737 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.737 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-09-13T06:39:38.737 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.443234+0000", 2024-09-13T06:39:38.737 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00094552299999999998 2024-09-13T06:39:38.737 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.737 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.738 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:39:38.738 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.443729+0000", 2024-09-13T06:39:38.738 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00049438900000000003 2024-09-13T06:39:38.738 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.738 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.738 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:39:38.738 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.443780+0000", 2024-09-13T06:39:38.738 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.1495000000000001e-05 2024-09-13T06:39:38.738 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.738 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.738 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:38.738 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.443823+0000", 2024-09-13T06:39:38.738 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.2344e-05 2024-09-13T06:39:38.738 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:38.738 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:38.739 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:38.739 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:38.739 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:38.739 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:39:38.739 INFO:teuthology.orchestra.run.smithi081.stdout:173 read 0x2314eeb thru 0x231f894 (0xa9aa bytes) 2024-09-13T06:39:38.739 INFO:teuthology.orchestra.run.smithi081.stdout:174 trunc from 0xe7071eb to 0x6d4547f 2024-09-13T06:39:38.740 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-13T06:39:38.741 INFO:teuthology.orchestra.run.smithi081.stdout:175 read 0x2fb647d thru 0x2fbee3d (0x89c1 bytes) 2024-09-13T06:39:38.742 INFO:teuthology.orchestra.run.smithi081.stdout:176 read 0x4f04403 thru 0x4f04562 (0x160 bytes) 2024-09-13T06:39:38.742 INFO:teuthology.orchestra.run.smithi081.stdout:177 writesame 0x1e1e04d thru 0x1e29ac3 data_size 0x1(0xba77 bytes) 2024-09-13T06:39:38.742 INFO:teuthology.orchestra.run.smithi081.stdout:178 write 0xbedea64 thru 0xbeeb278 (0xc815 bytes) 2024-09-13T06:39:38.742 INFO:teuthology.orchestra.run.smithi081.stdout:181 write 0xc259bbb thru 0xc25fe21 (0x6267 bytes) 2024-09-13T06:39:38.742 INFO:teuthology.orchestra.run.smithi081.stdout:183 read 0x6c4dc8f thru 0x6c58b31 (0xaea3 bytes) 2024-09-13T06:39:38.742 INFO:teuthology.orchestra.run.smithi081.stdout:184 write 0x4298ed7 thru 0x42a1034 (0x815e bytes) 2024-09-13T06:39:38.743 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:39:38.746+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:39:38.746 INFO:teuthology.orchestra.run.smithi081.stdout:185 write 0x5034fe4 thru 0x503e42e (0x944b bytes) 2024-09-13T06:39:38.752 INFO:teuthology.orchestra.run.smithi081.stdout:187 write 0x8634992 thru 0x863b13e (0x67ad bytes) 2024-09-13T06:39:38.758 INFO:teuthology.orchestra.run.smithi081.stdout:188 write 0x360317a thru 0x3606a09 (0x3890 bytes) 2024-09-13T06:39:38.780 INFO:teuthology.orchestra.run.smithi081.stdout:189 write 0xee06e05 thru 0xee0cd66 (0x5f62 bytes) 2024-09-13T06:39:38.786 INFO:teuthology.orchestra.run.smithi081.stdout:190 write 0x3606df thru 0x369c0f (0x9531 bytes) 2024-09-13T06:39:38.792 INFO:teuthology.orchestra.run.smithi081.stdout:191 punch from 0x2cef433 to 0x2cf931a, (0x9ee7 bytes) 2024-09-13T06:39:38.792 INFO:teuthology.orchestra.run.smithi081.stdout:193 write 0x8bc0aed thru 0x8bcb1f7 (0xa70b bytes) 2024-09-13T06:39:38.797 INFO:teuthology.orchestra.run.smithi081.stdout:194 read 0x1f41a8b thru 0x1f41be1 (0x157 bytes) 2024-09-13T06:39:38.821 INFO:teuthology.orchestra.run.smithi081.stdout:195 trunc from 0xee0cd67 to 0x76a0ef 2024-09-13T06:39:38.846 INFO:tasks.ceph.osd.6.smithi139.stderr:2024-09-13T06:39:38.846+0000 7fcd02c5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26385) UID: 0 2024-09-13T06:39:38.887 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:39:38.887 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [ 2024-09-13T06:39:38.887 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.887 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4385.0:2411 3.0 e31/21 3:07d66135:::rbd_object_map.11212429e5ad:head v 31'55, mlcod=31'45)", 2024-09-13T06:39:38.887 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:38.887273+0000", 2024-09-13T06:39:38.887 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.0043989670000000002, 2024-09-13T06:39:38.887 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0044163300000000004, 2024-09-13T06:39:38.888 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:38.888 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:39:38.888 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:38.888 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.888 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:38.888 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.887273+0000", 2024-09-13T06:39:38.888 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:38.888 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.888 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.888 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:38.888 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.887273+0000", 2024-09-13T06:39:38.888 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:38.888 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.889 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.889 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:38.889 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.887272+0000", 2024-09-13T06:39:38.889 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.999999 2024-09-13T06:39:38.889 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.889 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.889 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:38.889 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.887280+0000", 2024-09-13T06:39:38.889 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.9060000000000002e-06 2024-09-13T06:39:38.889 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.889 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.889 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:38.889 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.887297+0000", 2024-09-13T06:39:38.889 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6577000000000001e-05 2024-09-13T06:39:38.890 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.890 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.890 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:38.890 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.887306+0000", 2024-09-13T06:39:38.890 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.9579999999999996e-06 2024-09-13T06:39:38.890 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.890 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.890 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:38.890 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.887353+0000", 2024-09-13T06:39:38.890 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7320000000000001e-05 2024-09-13T06:39:38.890 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.890 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.890 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:38.891 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.887374+0000", 2024-09-13T06:39:38.891 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0984000000000001e-05 2024-09-13T06:39:38.891 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:38.891 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:38.891 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:38.891 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.891 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.891 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4385.0:2412 3.0 e31/21 3:07d66135:::rbd_object_map.11212429e5ad:head v 31'56, mlcod=31'48)", 2024-09-13T06:39:38.891 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:38.888795+0000", 2024-09-13T06:39:38.891 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.0028774109999999999, 2024-09-13T06:39:38.891 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0029557250000000002, 2024-09-13T06:39:38.891 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:38.891 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:39:38.892 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:38.892 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.892 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:38.892 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.888795+0000", 2024-09-13T06:39:38.892 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:38.892 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.892 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.892 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:38.892 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.888795+0000", 2024-09-13T06:39:38.892 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:38.892 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.892 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.892 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:38.892 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.888794+0000", 2024-09-13T06:39:38.893 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.999999 2024-09-13T06:39:38.893 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.893 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.893 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:38.893 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.888803+0000", 2024-09-13T06:39:38.893 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.7139999999999999e-06 2024-09-13T06:39:38.893 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.893 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.893 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:38.893 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.888820+0000", 2024-09-13T06:39:38.893 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7555999999999999e-05 2024-09-13T06:39:38.893 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.894 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.894 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:38.894 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.888828+0000", 2024-09-13T06:39:38.894 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.153e-06 2024-09-13T06:39:38.894 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.894 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.894 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:38.894 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.888897+0000", 2024-09-13T06:39:38.894 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.9805e-05 2024-09-13T06:39:38.894 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.894 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.894 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:38.894 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.888928+0000", 2024-09-13T06:39:38.894 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.0633000000000003e-05 2024-09-13T06:39:38.895 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:38.895 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:38.895 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:38.895 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.895 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.895 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4385.0:2413 3.0 e31/21 3:07d66135:::rbd_object_map.11212429e5ad:head v 31'57, mlcod=31'51)", 2024-09-13T06:39:38.895 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:38.890237+0000", 2024-09-13T06:39:38.895 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.0014352099999999999, 2024-09-13T06:39:38.895 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0015647689999999999, 2024-09-13T06:39:38.895 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:38.895 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:39:38.895 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:38.895 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.896 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:38.896 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.890237+0000", 2024-09-13T06:39:38.896 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:38.896 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.896 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.896 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:38.896 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.890237+0000", 2024-09-13T06:39:38.896 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:38.896 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.896 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.896 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:38.896 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.890236+0000", 2024-09-13T06:39:38.896 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.999999 2024-09-13T06:39:38.897 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.897 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.897 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:38.897 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.890243+0000", 2024-09-13T06:39:38.897 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.9630000000000001e-06 2024-09-13T06:39:38.897 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.897 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.897 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:38.897 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.890258+0000", 2024-09-13T06:39:38.897 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4321999999999999e-05 2024-09-13T06:39:38.897 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.897 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.897 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:38.897 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.890265+0000", 2024-09-13T06:39:38.898 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3000000000000004e-06 2024-09-13T06:39:38.898 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.898 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.898 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:38.898 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.890389+0000", 2024-09-13T06:39:38.898 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00012409899999999999 2024-09-13T06:39:38.898 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.898 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.898 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:38.898 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.890420+0000", 2024-09-13T06:39:38.898 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.1090000000000002e-05 2024-09-13T06:39:38.898 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:38.898 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:38.899 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:38.899 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.899 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.899 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "pg_update_log_missing(3.4 epoch 31/21 rep_tid 67 entries 31'2 (0'0) error 3:27e7ab05:::rbd_data.11212429e5ad.0000000000000022:head by client.4385.0:2421 0.000000 0 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-09-13T06:39:38.899 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:38.890280+0000", 2024-09-13T06:39:38.899 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.0013919189999999999, 2024-09-13T06:39:38.899 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0015689860000000001, 2024-09-13T06:39:38.899 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:38.899 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:39:38.899 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:38.899 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.899 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:38.899 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.890280+0000", 2024-09-13T06:39:38.900 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:38.900 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.900 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.900 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:38.900 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.890280+0000", 2024-09-13T06:39:38.900 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:38.900 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.900 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.900 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:38.900 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.890280+0000", 2024-09-13T06:39:38.900 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:39:38.900 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.900 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.901 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:38.901 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.890287+0000", 2024-09-13T06:39:38.901 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.148e-06 2024-09-13T06:39:38.901 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.901 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.901 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:38.901 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.890302+0000", 2024-09-13T06:39:38.901 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.435e-05 2024-09-13T06:39:38.901 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.901 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.901 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:38.901 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.890312+0000", 2024-09-13T06:39:38.901 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0662999999999999e-05 2024-09-13T06:39:38.902 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.902 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.902 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:38.902 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.890428+0000", 2024-09-13T06:39:38.902 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000115505 2024-09-13T06:39:38.902 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:38.902 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:38.902 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:38.902 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.902 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.902 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4385.0:2414 3.0 e31/21 3:07d66135:::rbd_object_map.11212429e5ad:head v 31'58, mlcod=31'52)", 2024-09-13T06:39:38.902 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:38.891577+0000", 2024-09-13T06:39:38.903 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 9.5580000000000003e-05, 2024-09-13T06:39:38.903 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00032838099999999999, 2024-09-13T06:39:38.903 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:38.903 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:39:38.903 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:38.903 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.903 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:38.903 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.891577+0000", 2024-09-13T06:39:38.903 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:38.903 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.903 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.903 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:38.903 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.891577+0000", 2024-09-13T06:39:38.904 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:38.904 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.904 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.904 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:38.904 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.891576+0000", 2024-09-13T06:39:38.904 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.999999 2024-09-13T06:39:38.904 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.904 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.904 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:38.904 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.891585+0000", 2024-09-13T06:39:38.904 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.7329999999999998e-06 2024-09-13T06:39:38.904 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.904 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.905 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:38.905 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.891605+0000", 2024-09-13T06:39:38.905 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9369e-05 2024-09-13T06:39:38.905 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.905 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.905 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:38.905 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.891618+0000", 2024-09-13T06:39:38.905 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2781e-05 2024-09-13T06:39:38.905 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.905 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.905 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:38.905 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.891733+0000", 2024-09-13T06:39:38.905 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00011500799999999999 2024-09-13T06:39:38.906 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:38.906 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:38.906 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:38.906 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.891783+0000", 2024-09-13T06:39:38.906 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0569000000000003e-05 2024-09-13T06:39:38.906 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:38.906 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:38.906 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:38.906 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:38.906 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-13T06:39:38.906 INFO:teuthology.orchestra.run.smithi081.stdout: "num_ops": 5 2024-09-13T06:39:38.906 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:39:38.907 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-13T06:39:38.927 INFO:teuthology.orchestra.run.smithi081.stdout:196 write 0x23e9305 thru 0x23edede (0x4bda bytes) 2024-09-13T06:39:38.932 INFO:teuthology.orchestra.run.smithi081.stdout:197 read 0x1453adf thru 0x145ba85 (0x7fa7 bytes) 2024-09-13T06:39:38.939 INFO:teuthology.orchestra.run.smithi081.stdout:198 trunc from 0x23ededf to 0x5a8c663 2024-09-13T06:39:38.945 INFO:tasks.ceph.osd.6.smithi139.stderr:2024-09-13T06:39:38.946+0000 7fcd02c5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26385) UID: 0 2024-09-13T06:39:38.950 INFO:teuthology.orchestra.run.smithi081.stdout:199 read 0x2cf954d thru 0x2d05154 (0xbc08 bytes) 2024-09-13T06:39:38.955 INFO:teuthology.orchestra.run.smithi081.stdout:200 trunc from 0x5a8c663 to 0x312120c 2024-09-13T06:39:38.989 INFO:teuthology.orchestra.run.smithi081.stdout:201 write 0x8ed53b6 thru 0x8edb619 (0x6264 bytes) 2024-09-13T06:39:38.996 INFO:teuthology.orchestra.run.smithi081.stdout:202 trunc from 0x8edb61a to 0xaa02a66 2024-09-13T06:39:39.007 INFO:teuthology.orchestra.run.smithi081.stdout:203 punch from 0x19615d1 to 0x197093d, (0xf36c bytes) 2024-09-13T06:39:39.008 INFO:teuthology.orchestra.run.smithi081.stdout:204 punch from 0x5b7923b to 0x5b81134, (0x7ef9 bytes) 2024-09-13T06:39:39.008 INFO:teuthology.orchestra.run.smithi081.stdout:206 write 0x4ebdc4b thru 0x4ec2bda (0x4f90 bytes) 2024-09-13T06:39:39.012 INFO:teuthology.orchestra.run.smithi081.stdout:207 write 0x9b20664 thru 0x9b25723 (0x50c0 bytes) 2024-09-13T06:39:39.018 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:39:39.018 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:39:39.018 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:39:39.018 INFO:teuthology.orchestra.run.smithi081.stdout:216 read 0x2b500a2 thru 0x2b50d40 (0xc9f bytes) 2024-09-13T06:39:39.018 INFO:teuthology.orchestra.run.smithi081.stdout:218 write 0x379c423 thru 0x37abfd9 (0xfbb7 bytes) 2024-09-13T06:39:39.025 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:39:39.025 INFO:teuthology.orchestra.run.smithi081.stdout:221 write 0x1e814e4 thru 0x1e8caa2 (0xb5bf bytes) 2024-09-13T06:39:39.045 INFO:teuthology.orchestra.run.smithi081.stdout:224 write 0xd33510c thru 0xd3400a7 (0xaf9c bytes) 2024-09-13T06:39:39.046 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:39:39.047+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:39:39.053 INFO:teuthology.orchestra.run.smithi081.stdout:229 punch from 0x9b52267 to 0x9b59b65, (0x78fe bytes) 2024-09-13T06:39:39.053 INFO:teuthology.orchestra.run.smithi081.stdout:230 write 0x3123e19 thru 0x312cae6 (0x8cce bytes) 2024-09-13T06:39:39.059 INFO:teuthology.orchestra.run.smithi081.stdout:231 read 0x90280f2 thru 0x9029551 (0x1460 bytes) 2024-09-13T06:39:39.059 INFO:teuthology.orchestra.run.smithi081.stdout:235 writesame 0xca197c thru 0xcb0a5f data_size 0x36(0xf0e4 bytes) 2024-09-13T06:39:39.065 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:39:39.065 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-13T06:39:39.065 INFO:teuthology.orchestra.run.smithi081.stdout: "complaint_time": 30, 2024-09-13T06:39:39.065 INFO:teuthology.orchestra.run.smithi081.stdout: "num_blocked_ops": 0 2024-09-13T06:39:39.065 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:39:39.065 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:39:39.073 INFO:teuthology.orchestra.run.smithi081.stdout:239 trunc from 0xd3400a8 to 0x8b73a99 2024-09-13T06:39:39.085 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-13T06:39:39.093 INFO:teuthology.orchestra.run.smithi081.stdout:241 punch from 0x430563a to 0x4312ce9, (0xd6af bytes) 2024-09-13T06:39:39.093 INFO:teuthology.orchestra.run.smithi081.stdout:243 writesame 0x71583dd thru 0x715dd64 data_size 0x3c(0x5988 bytes) 2024-09-13T06:39:39.098 INFO:teuthology.orchestra.run.smithi081.stdout:244 write 0x3f6b753 thru 0x3f6f72d (0x3fdb bytes) 2024-09-13T06:39:39.102 INFO:teuthology.orchestra.run.smithi081.stdout:245 write 0x4da279 thru 0x4dd1c5 (0x2f4d bytes) 2024-09-13T06:39:39.126 INFO:teuthology.orchestra.run.smithi081.stdout:246 write 0xbcf4e58 thru 0xbcfc786 (0x792f bytes) 2024-09-13T06:39:39.131 INFO:teuthology.orchestra.run.smithi081.stdout:247 read 0x24dee15 thru 0x24e373c (0x4928 bytes) 2024-09-13T06:39:39.131 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:39:39.131 INFO:teuthology.orchestra.run.smithi081.stdout:249 punch from 0x695f2e6 to 0x6963b1e, (0x4838 bytes) 2024-09-13T06:39:39.131 INFO:teuthology.orchestra.run.smithi081.stdout:251 read 0x5792d1c thru 0x57a018f (0xd474 bytes) 2024-09-13T06:39:39.131 INFO:teuthology.orchestra.run.smithi081.stdout:252 writesame 0x2b15ed3 thru 0x2b1fb99 data_size 0x17(0x9cc7 bytes) 2024-09-13T06:39:39.136 INFO:teuthology.orchestra.run.smithi081.stdout:255 write 0x1a84479 thru 0x1a8a207 (0x5d8f bytes) 2024-09-13T06:39:39.142 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:39:39.146 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:39:39.147+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:39:39.156 INFO:teuthology.orchestra.run.smithi081.stdout:257 writesame 0xcd8a2eb thru 0xcd9137a data_size 0x8(0x7090 bytes) 2024-09-13T06:39:39.156 INFO:teuthology.orchestra.run.smithi081.stdout:258 read 0x85172a5 thru 0x8526650 (0xf3ac bytes) 2024-09-13T06:39:39.156 INFO:teuthology.orchestra.run.smithi081.stdout:259 read 0x34fe87f thru 0x34fff47 (0x16c9 bytes) 2024-09-13T06:39:39.157 INFO:teuthology.orchestra.run.smithi081.stdout:261 read 0x3e6fd75 thru 0x3e7f005 (0xf291 bytes) 2024-09-13T06:39:39.157 INFO:teuthology.orchestra.run.smithi081.stdout:262 write 0x3ed0fc1 thru 0x3ee0a8c (0xfacc bytes) 2024-09-13T06:39:39.164 INFO:teuthology.orchestra.run.smithi081.stdout:263 read 0xbd70d7d thru 0xbd714fc (0x780 bytes) 2024-09-13T06:39:39.164 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:39:39.167 INFO:teuthology.orchestra.run.smithi081.stdout:267 trunc from 0xcd9137b to 0xe28c325 2024-09-13T06:39:39.177 INFO:teuthology.orchestra.run.smithi081.stdout:268 read 0x551f581 thru 0x5522df2 (0x3872 bytes) 2024-09-13T06:39:39.178 INFO:teuthology.orchestra.run.smithi081.stdout:270 write 0xd74fc68 thru 0xd753618 (0x39b1 bytes) 2024-09-13T06:39:39.184 INFO:teuthology.orchestra.run.smithi081.stdout:271 write 0xde19d7f thru 0xde1ab83 (0xe05 bytes) 2024-09-13T06:39:39.188 INFO:teuthology.orchestra.run.smithi081.stdout:273 punch from 0x7fed9f2 to 0x7ff43c8, (0x69d6 bytes) 2024-09-13T06:39:39.188 INFO:teuthology.orchestra.run.smithi081.stdout:274 write 0xda0bc96 thru 0xda10c61 (0x4fcc bytes) 2024-09-13T06:39:39.194 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:39:39.194 INFO:teuthology.orchestra.run.smithi081.stdout:276 writesame 0x22ed28c thru 0x22fa74e data_size 0x1f(0xd4c3 bytes) 2024-09-13T06:39:39.204 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:39:39.204 INFO:teuthology.orchestra.run.smithi081.stdout:279 writesame 0xcd96179 thru 0xcd97961 data_size 0x1(0x17e9 bytes) 2024-09-13T06:39:39.212 INFO:teuthology.orchestra.run.smithi081.stdout:280 punch from 0x4f72cca to 0x4f77d88, (0x50be bytes) 2024-09-13T06:39:39.212 INFO:teuthology.orchestra.run.smithi081.stdout:281 writesame 0xdbbe146 thru 0xdbc29a9 data_size 0x52(0x4864 bytes) 2024-09-13T06:39:39.216 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:39:39.229 INFO:teuthology.orchestra.run.smithi081.stdout:286 trunc from 0xe28c325 to 0x8acbb13 2024-09-13T06:39:39.234 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:39:39.234 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 20, 2024-09-13T06:39:39.234 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 600, 2024-09-13T06:39:39.234 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [ 2024-09-13T06:39:39.234 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:39.234 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4385.0:2330 3.0 e31/21 3:07d66135:::rbd_object_map.11212429e5ad:head v 31'39, mlcod=31'37)", 2024-09-13T06:39:39.234 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:38.827721+0000", 2024-09-13T06:39:39.234 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.40727983299999998, 2024-09-13T06:39:39.234 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.003728295, 2024-09-13T06:39:39.235 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:39.235 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:39.235 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:39.235 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:39.235 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:39.235 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.827721+0000", 2024-09-13T06:39:39.235 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:39.235 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:39.235 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:39.235 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:39.235 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.827721+0000", 2024-09-13T06:39:39.235 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:39.235 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:39.236 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:39.236 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:39.236 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.827718+0000", 2024-09-13T06:39:39.236 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999976 2024-09-13T06:39:39.236 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:39.236 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:39.236 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:39.236 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.827735+0000", 2024-09-13T06:39:39.236 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6515999999999999e-05 2024-09-13T06:39:39.236 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:39.236 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:39.236 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:39.236 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.827768+0000", 2024-09-13T06:39:39.236 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.3105999999999998e-05 2024-09-13T06:39:39.237 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:39.237 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:39.237 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:39.237 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.827788+0000", 2024-09-13T06:39:39.237 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0210000000000001e-05 2024-09-13T06:39:39.237 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:39.237 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:39.237 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:39.237 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.827855+0000", 2024-09-13T06:39:39.237 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.7046999999999997e-05 2024-09-13T06:39:39.237 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:39.237 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:39.237 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:39.238 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.827900+0000", 2024-09-13T06:39:39.238 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4415000000000001e-05 2024-09-13T06:39:39.238 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:39.238 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:39.238 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:39:39.238 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.831380+0000", 2024-09-13T06:39:39.238 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.003480187 2024-09-13T06:39:39.238 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:39.238 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:39.238 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:39.238 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.831449+0000", 2024-09-13T06:39:39.238 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.9070000000000001e-05 2024-09-13T06:39:39.238 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:39.238 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:39.239 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:39.239 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:39.239 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:39.239 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "pg_update_log_missing(3.0 epoch 31/21 rep_tid 48 entries 31'40 (0'0) error 3:c229cf00:::rbd_data.11212429e5ad.000000000000003d:head by client.4385.0:2348 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 31'38)", 2024-09-13T06:39:39.239 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:38.838805+0000", 2024-09-13T06:39:39.239 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.39619542000000002, 2024-09-13T06:39:39.239 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.003098539, 2024-09-13T06:39:39.239 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:39.239 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:39:39.239 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:39.239 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:39.239 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:39.239 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.838805+0000", 2024-09-13T06:39:39.239 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:39.240 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:39.240 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:39.240 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:39.240 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.838805+0000", 2024-09-13T06:39:39.240 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:39.240 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:39.240 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:39.240 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:39.240 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.838804+0000", 2024-09-13T06:39:39.240 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.999999 2024-09-13T06:39:39.240 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:39.240 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:39.240 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:39.240 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.838816+0000", 2024-09-13T06:39:39.240 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2031999999999999e-05 2024-09-13T06:39:39.241 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:39.241 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:39.241 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:39.241 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.838838+0000", 2024-09-13T06:39:39.241 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2092000000000001e-05 2024-09-13T06:39:39.241 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:39.241 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:39.241 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:39.241 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.838852+0000", 2024-09-13T06:39:39.241 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4157e-05 2024-09-13T06:39:39.241 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:39.241 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:39.241 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:39.241 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.838963+0000", 2024-09-13T06:39:39.242 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000110905 2024-09-13T06:39:39.242 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:39.242 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:39.242 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:39.242 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.841904+0000", 2024-09-13T06:39:39.242 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0029404100000000001 2024-09-13T06:39:39.242 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:39.242 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:39.242 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:39.242 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:39.242 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:39.242 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4385.0:2402 3.0 e31/21 3:07d66135:::rbd_object_map.11212429e5ad:head v 31'46, mlcod=31'43)", 2024-09-13T06:39:39.242 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:38.872174+0000", 2024-09-13T06:39:39.242 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.36282629199999999, 2024-09-13T06:39:39.243 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0037101830000000001, 2024-09-13T06:39:39.243 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:39.243 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:39.243 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:39.243 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:39.243 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:39.243 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.872174+0000", 2024-09-13T06:39:39.243 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:39.243 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:39.243 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:39.243 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:39.243 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.872174+0000", 2024-09-13T06:39:39.243 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:39.244 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:39.244 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:39.244 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:39.244 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.872173+0000", 2024-09-13T06:39:39.244 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.999999 2024-09-13T06:39:39.244 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:39.244 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:39.244 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:39.244 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.872180+0000", 2024-09-13T06:39:39.244 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.4189999999999999e-06 2024-09-13T06:39:39.244 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:39.244 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:39.244 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:39.244 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.872193+0000", 2024-09-13T06:39:39.245 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.349e-05 2024-09-13T06:39:39.245 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:39.245 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:39.245 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:39.245 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.872201+0000", 2024-09-13T06:39:39.245 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.7000000000000008e-06 2024-09-13T06:39:39.245 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:39.245 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:39.245 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:39.246 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.872506+0000", 2024-09-13T06:39:39.246 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00030537300000000001 2024-09-13T06:39:39.246 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:39.246 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:39.246 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:39.246 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.872571+0000", 2024-09-13T06:39:39.246 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.4349000000000003e-05 2024-09-13T06:39:39.246 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:39.246 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:39.246 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:39:39.246 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.875823+0000", 2024-09-13T06:39:39.246 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0032527419999999999 2024-09-13T06:39:39.246 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:39.247 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:39.247 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:39.247 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.875884+0000", 2024-09-13T06:39:39.247 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0847999999999997e-05 2024-09-13T06:39:39.247 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:39.247 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:39.247 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:39.247 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:39.247 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:39.247 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4385.0:2403 3.0 e31/21 3:07d66135:::rbd_object_map.11212429e5ad:head v 31'47, mlcod=31'43)", 2024-09-13T06:39:39.247 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:38.873272+0000", 2024-09-13T06:39:39.247 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.36172843700000001, 2024-09-13T06:39:39.247 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0059524080000000002, 2024-09-13T06:39:39.248 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:39.248 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:39.248 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:39.248 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:39.248 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:39.248 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.873272+0000", 2024-09-13T06:39:39.248 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:39.248 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:39.248 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:39.248 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:39.248 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.873272+0000", 2024-09-13T06:39:39.248 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:39.249 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:39.249 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:39.249 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:39.249 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.873271+0000", 2024-09-13T06:39:39.249 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:39:39.249 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:39.249 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:39.249 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:39.249 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.873277+0000", 2024-09-13T06:39:39.249 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.5999999999999997e-06 2024-09-13T06:39:39.249 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:39.249 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:39.250 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:39.250 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.873285+0000", 2024-09-13T06:39:39.250 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4680000000000003e-06 2024-09-13T06:39:39.250 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:39.250 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:39.250 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:39.250 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.873289+0000", 2024-09-13T06:39:39.250 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7670000000000003e-06 2024-09-13T06:39:39.250 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:39.250 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:39.250 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:39.250 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.873403+0000", 2024-09-13T06:39:39.250 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00011417300000000001 2024-09-13T06:39:39.250 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:39.251 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:39.251 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:39.251 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.873421+0000", 2024-09-13T06:39:39.251 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7278e-05 2024-09-13T06:39:39.251 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:39.251 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:39.251 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:39:39.251 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.879180+0000", 2024-09-13T06:39:39.251 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0057591379999999996 2024-09-13T06:39:39.251 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:39.251 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:39.251 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:39.251 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.879224+0000", 2024-09-13T06:39:39.251 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4558000000000003e-05 2024-09-13T06:39:39.252 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:39.252 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:39.252 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:39.252 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:39.252 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:39.252 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4385.0:2404 3.0 e31/21 3:07d66135:::rbd_object_map.11212429e5ad:head v 31'48, mlcod=31'43)", 2024-09-13T06:39:39.252 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:38.874266+0000", 2024-09-13T06:39:39.252 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.36073467999999997, 2024-09-13T06:39:39.252 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0049906389999999998, 2024-09-13T06:39:39.252 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:39.252 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:39.252 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:39.253 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:39.253 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:39.253 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.874266+0000", 2024-09-13T06:39:39.253 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:39.253 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:39.253 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:39.253 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:39.253 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.874266+0000", 2024-09-13T06:39:39.253 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:39.253 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:39.253 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:39.253 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:39.254 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.874265+0000", 2024-09-13T06:39:39.254 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.999999 2024-09-13T06:39:39.254 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:39.254 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:39.254 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:39.254 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.874281+0000", 2024-09-13T06:39:39.254 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5763000000000001e-05 2024-09-13T06:39:39.254 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:39.254 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:39.254 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:39.254 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.874294+0000", 2024-09-13T06:39:39.254 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2826000000000001e-05 2024-09-13T06:39:39.254 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:39.254 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:39.254 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:39.255 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.874300+0000", 2024-09-13T06:39:39.255 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.6769999999999998e-06 2024-09-13T06:39:39.255 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:39.255 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:39.255 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:39.255 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.874390+0000", 2024-09-13T06:39:39.255 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.0129000000000004e-05 2024-09-13T06:39:39.255 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:39.255 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:39.255 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:39.255 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.874450+0000", 2024-09-13T06:39:39.255 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9512999999999998e-05 2024-09-13T06:39:39.255 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:39.256 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:39.256 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:39:39.256 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.879227+0000", 2024-09-13T06:39:39.256 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0047773329999999999 2024-09-13T06:39:39.256 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:39.256 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:39.256 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:39.256 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.879256+0000", 2024-09-13T06:39:39.256 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9173e-05 2024-09-13T06:39:39.256 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:39.256 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:39.256 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:39.256 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:39.257 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:39.257 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4385.0:2405 3.0 e31/21 3:07d66135:::rbd_object_map.11212429e5ad:head v 31'49, mlcod=31'43)", 2024-09-13T06:39:39.257 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:38.875324+0000", 2024-09-13T06:39:39.257 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.35967683099999997, 2024-09-13T06:39:39.257 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0039619570000000003, 2024-09-13T06:39:39.257 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:39.257 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:39.257 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:39.257 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:39.257 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:39.257 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.875324+0000", 2024-09-13T06:39:39.257 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:39.257 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:39.257 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:39.257 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:39.258 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.875324+0000", 2024-09-13T06:39:39.258 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:39.258 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:39.258 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:39.258 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:39.258 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.875323+0000", 2024-09-13T06:39:39.258 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.999999 2024-09-13T06:39:39.258 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:39.258 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:39.258 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:39.258 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.875329+0000", 2024-09-13T06:39:39.258 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.1689999999999997e-06 2024-09-13T06:39:39.258 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:39.258 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:39.259 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:39.259 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.875340+0000", 2024-09-13T06:39:39.259 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1065e-05 2024-09-13T06:39:39.259 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:39.259 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:39.259 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:39.259 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.875347+0000", 2024-09-13T06:39:39.259 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.674e-06 2024-09-13T06:39:39.259 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:39.259 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:39.259 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:39.259 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.875396+0000", 2024-09-13T06:39:39.259 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9094000000000001e-05 2024-09-13T06:39:39.259 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:39.259 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:39.260 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:39.260 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.875420+0000", 2024-09-13T06:39:39.260 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4199999999999999e-05 2024-09-13T06:39:39.260 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:39.260 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:39.260 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:39:39.260 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.879258+0000", 2024-09-13T06:39:39.260 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0038376930000000001 2024-09-13T06:39:39.260 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:39.260 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:39.260 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:39.260 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.879286+0000", 2024-09-13T06:39:39.260 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.7880000000000001e-05 2024-09-13T06:39:39.260 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:39.261 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:39.261 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:39.261 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:39.261 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:39.261 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4385.0:2406 3.0 e31/21 3:07d66135:::rbd_object_map.11212429e5ad:head v 31'50, mlcod=31'44)", 2024-09-13T06:39:39.261 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:38.876829+0000", 2024-09-13T06:39:39.261 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.358171876, 2024-09-13T06:39:39.261 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0024914070000000002, 2024-09-13T06:39:39.261 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:39.261 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:39.261 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:39.261 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:39.261 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:39.261 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.876829+0000", 2024-09-13T06:39:39.261 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:39.262 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:39.262 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:39.262 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:39.262 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.876829+0000", 2024-09-13T06:39:39.262 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:39.262 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:39.262 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:39.262 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:39.262 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.876828+0000", 2024-09-13T06:39:39.262 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.999999 2024-09-13T06:39:39.262 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:39.262 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:39.262 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:39.262 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.876835+0000", 2024-09-13T06:39:39.262 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.8970000000000002e-06 2024-09-13T06:39:39.263 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:39.263 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:39.263 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:39.263 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.876848+0000", 2024-09-13T06:39:39.263 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3508e-05 2024-09-13T06:39:39.263 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:39.263 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:39.263 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:39.263 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.876862+0000", 2024-09-13T06:39:39.263 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3839000000000001e-05 2024-09-13T06:39:39.263 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:39.263 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:39.263 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:39.264 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.876926+0000", 2024-09-13T06:39:39.264 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.4534000000000002e-05 2024-09-13T06:39:39.264 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:39.264 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:39.264 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:39.264 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.876956+0000", 2024-09-13T06:39:39.264 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9771999999999999e-05 2024-09-13T06:39:39.264 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:39.264 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:39.264 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:39:39.264 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.879289+0000", 2024-09-13T06:39:39.264 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0023322619999999999 2024-09-13T06:39:39.264 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:39.264 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:39.265 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:39.265 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.879320+0000", 2024-09-13T06:39:39.265 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.1466e-05 2024-09-13T06:39:39.265 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:39.265 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:39.265 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:39.265 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:39.265 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:39.265 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4385.0:2407 3.0 e31/21 3:07d66135:::rbd_object_map.11212429e5ad:head v 31'51, mlcod=31'44)", 2024-09-13T06:39:39.265 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:38.878449+0000", 2024-09-13T06:39:39.265 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.35655180800000003, 2024-09-13T06:39:39.265 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0036754119999999999, 2024-09-13T06:39:39.265 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:39.266 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:39.266 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:39.266 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:39.266 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:39.266 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.878449+0000", 2024-09-13T06:39:39.266 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:39.266 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:39.266 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:39.266 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:39.266 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.878449+0000", 2024-09-13T06:39:39.266 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:39.266 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:39.266 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:39.266 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:39.266 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.878447+0000", 2024-09-13T06:39:39.267 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999981 2024-09-13T06:39:39.267 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:39.267 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:39.267 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:39.267 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.878462+0000", 2024-09-13T06:39:39.267 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5133000000000001e-05 2024-09-13T06:39:39.267 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:39.267 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:39.267 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:39.267 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.878500+0000", 2024-09-13T06:39:39.267 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.8213999999999997e-05 2024-09-13T06:39:39.267 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:39.267 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:39.267 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:39.267 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.878520+0000", 2024-09-13T06:39:39.268 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0000000000000002e-05 2024-09-13T06:39:39.268 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:39.268 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:39.268 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:39.268 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.878710+0000", 2024-09-13T06:39:39.268 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00019008100000000001 2024-09-13T06:39:39.268 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:39.268 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:39.268 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:39.268 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.878745+0000", 2024-09-13T06:39:39.268 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.4533000000000003e-05 2024-09-13T06:39:39.268 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:39.268 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:39.268 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:39:39.268 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.882086+0000", 2024-09-13T06:39:39.269 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0033416409999999998 2024-09-13T06:39:39.269 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:39.269 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:39.269 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:39.269 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.882124+0000", 2024-09-13T06:39:39.269 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.7673000000000003e-05 2024-09-13T06:39:39.269 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:39.269 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:39.269 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:39.269 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:39.269 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:39.269 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4385.0:2408 3.0 e31/21 3:07d66135:::rbd_object_map.11212429e5ad:head v 31'52, mlcod=31'45)", 2024-09-13T06:39:39.269 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:38.880785+0000", 2024-09-13T06:39:39.269 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.35421564999999999, 2024-09-13T06:39:39.269 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.004103382, 2024-09-13T06:39:39.270 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:39.270 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:39.270 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:39.270 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:39.270 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:39.270 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.880785+0000", 2024-09-13T06:39:39.270 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:39.270 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:39.270 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:39.270 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:39.270 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.880785+0000", 2024-09-13T06:39:39.270 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:39.270 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:39.271 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:39.271 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:39.271 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.880784+0000", 2024-09-13T06:39:39.271 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.999999 2024-09-13T06:39:39.271 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:39.271 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:39.271 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:39.271 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.880793+0000", 2024-09-13T06:39:39.271 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.8990000000000007e-06 2024-09-13T06:39:39.271 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:39.271 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:39.271 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:39.271 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.880806+0000", 2024-09-13T06:39:39.271 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3597999999999999e-05 2024-09-13T06:39:39.272 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:39.272 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:39.272 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:39.272 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.880813+0000", 2024-09-13T06:39:39.272 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.6789999999999999e-06 2024-09-13T06:39:39.272 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:39.272 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:39.272 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:39.272 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.880918+0000", 2024-09-13T06:39:39.272 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000105256 2024-09-13T06:39:39.272 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:39.272 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:39.272 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:39.272 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.880977+0000", 2024-09-13T06:39:39.273 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8310000000000002e-05 2024-09-13T06:39:39.273 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:39.273 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:39.273 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:39:39.273 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.884849+0000", 2024-09-13T06:39:39.273 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.003872693 2024-09-13T06:39:39.273 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:39.273 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:39.273 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:39.273 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.884888+0000", 2024-09-13T06:39:39.273 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.8955999999999998e-05 2024-09-13T06:39:39.273 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:39.274 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:39.274 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:39.274 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:39.274 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:39.274 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4385.0:2409 3.0 e31/21 3:07d66135:::rbd_object_map.11212429e5ad:head v 31'53, mlcod=31'45)", 2024-09-13T06:39:39.274 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:38.882957+0000", 2024-09-13T06:39:39.274 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.352043247, 2024-09-13T06:39:39.274 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0049287489999999996, 2024-09-13T06:39:39.274 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:39.274 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:39.274 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:39.274 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:39.274 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:39.274 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.882957+0000", 2024-09-13T06:39:39.275 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:39.275 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:39.275 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:39.275 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:39.275 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.882957+0000", 2024-09-13T06:39:39.275 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:39.275 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:39.275 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:39.275 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:39.275 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.882956+0000", 2024-09-13T06:39:39.275 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.999999 2024-09-13T06:39:39.275 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:39.275 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:39.275 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:39.275 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.882963+0000", 2024-09-13T06:39:39.276 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.8680000000000001e-06 2024-09-13T06:39:39.276 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:39.276 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:39.276 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:39.276 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.882975+0000", 2024-09-13T06:39:39.276 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1766000000000001e-05 2024-09-13T06:39:39.276 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:39.276 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:39.276 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:39.276 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.882981+0000", 2024-09-13T06:39:39.276 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3559999999999998e-06 2024-09-13T06:39:39.276 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:39.276 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:39.277 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:39.277 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.883029+0000", 2024-09-13T06:39:39.277 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7839000000000001e-05 2024-09-13T06:39:39.277 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:39.277 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:39.277 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:39.277 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.883047+0000", 2024-09-13T06:39:39.277 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8134e-05 2024-09-13T06:39:39.277 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:39.277 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:39.277 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:39:39.277 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.887832+0000", 2024-09-13T06:39:39.277 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0047848839999999997 2024-09-13T06:39:39.278 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:39.278 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:39.278 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:39.278 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.887886+0000", 2024-09-13T06:39:39.278 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3702999999999997e-05 2024-09-13T06:39:39.278 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:39.278 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:39.278 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:39.278 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:39.278 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:39.278 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4385.0:2410 3.0 e31/21 3:07d66135:::rbd_object_map.11212429e5ad:head v 31'54, mlcod=31'45)", 2024-09-13T06:39:39.278 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:38.885943+0000", 2024-09-13T06:39:39.278 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.34905739699999999, 2024-09-13T06:39:39.278 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0051076330000000003, 2024-09-13T06:39:39.279 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:39.279 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:39.279 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:39.279 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:39.279 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:39.279 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.885943+0000", 2024-09-13T06:39:39.279 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:39.279 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:39.279 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:39.279 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:39.279 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.885943+0000", 2024-09-13T06:39:39.279 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:39.279 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:39.279 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:39.280 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:39.280 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.885942+0000", 2024-09-13T06:39:39.280 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.999999 2024-09-13T06:39:39.280 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:39.280 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:39.280 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:39.280 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.885949+0000", 2024-09-13T06:39:39.280 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.2679999999999997e-06 2024-09-13T06:39:39.280 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:39.280 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:39.280 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:39.280 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.885961+0000", 2024-09-13T06:39:39.280 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1737e-05 2024-09-13T06:39:39.281 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:39.281 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:39.281 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:39.281 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.885967+0000", 2024-09-13T06:39:39.281 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0920000000000003e-06 2024-09-13T06:39:39.281 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:39.281 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:39.281 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:39.281 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.886019+0000", 2024-09-13T06:39:39.281 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.1669000000000003e-05 2024-09-13T06:39:39.281 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:39.281 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:39.281 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:39.281 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.886035+0000", 2024-09-13T06:39:39.282 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6192e-05 2024-09-13T06:39:39.282 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:39.282 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:39.282 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:39:39.282 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.890999+0000", 2024-09-13T06:39:39.282 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0049638440000000002 2024-09-13T06:39:39.282 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:39.282 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:39.282 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:39.282 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.891051+0000", 2024-09-13T06:39:39.282 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.1700999999999998e-05 2024-09-13T06:39:39.282 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:39.282 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:39.283 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:39.283 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:39.283 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:39.283 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4385.0:2411 3.0 e31/21 3:07d66135:::rbd_object_map.11212429e5ad:head v 31'55, mlcod=31'45)", 2024-09-13T06:39:39.283 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:38.887273+0000", 2024-09-13T06:39:39.283 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.347727118, 2024-09-13T06:39:39.283 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0058469940000000003, 2024-09-13T06:39:39.283 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:39.283 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:39.283 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:39.283 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:39.283 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:39.283 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.887273+0000", 2024-09-13T06:39:39.284 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:39.284 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:39.284 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:39.284 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:39.284 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.887273+0000", 2024-09-13T06:39:39.284 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:39.284 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:39.284 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:39.284 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:39.284 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.887272+0000", 2024-09-13T06:39:39.284 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.999999 2024-09-13T06:39:39.284 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:39.284 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:39.285 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:39.285 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.887280+0000", 2024-09-13T06:39:39.285 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.9060000000000002e-06 2024-09-13T06:39:39.285 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:39.285 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:39.285 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:39.285 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.887297+0000", 2024-09-13T06:39:39.285 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6577000000000001e-05 2024-09-13T06:39:39.285 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:39.285 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:39.285 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:39.285 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.887306+0000", 2024-09-13T06:39:39.285 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.9579999999999996e-06 2024-09-13T06:39:39.286 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:39.286 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:39.286 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:39.286 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.887353+0000", 2024-09-13T06:39:39.286 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7320000000000001e-05 2024-09-13T06:39:39.286 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:39.286 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:39.286 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:39.286 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.887374+0000", 2024-09-13T06:39:39.286 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0984000000000001e-05 2024-09-13T06:39:39.286 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:39.286 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:39.287 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:39:39.287 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.893037+0000", 2024-09-13T06:39:39.287 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0056629380000000002 2024-09-13T06:39:39.287 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:39.287 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:39.287 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:39.287 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.893120+0000", 2024-09-13T06:39:39.287 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.3282000000000007e-05 2024-09-13T06:39:39.287 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:39.287 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:39.287 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:39.287 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:39.287 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:39.288 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4385.0:2412 3.0 e31/21 3:07d66135:::rbd_object_map.11212429e5ad:head v 31'56, mlcod=31'48)", 2024-09-13T06:39:39.288 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:38.888795+0000", 2024-09-13T06:39:39.288 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.34620556200000002, 2024-09-13T06:39:39.288 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0043887409999999998, 2024-09-13T06:39:39.288 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:39.288 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:39.288 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:39.288 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:39.288 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:39.288 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.888795+0000", 2024-09-13T06:39:39.288 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:39.288 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:39.288 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:39.289 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:39.289 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.888795+0000", 2024-09-13T06:39:39.289 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:39.289 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:39.289 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:39.289 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:39.289 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.888794+0000", 2024-09-13T06:39:39.289 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.999999 2024-09-13T06:39:39.289 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:39.289 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:39.289 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:39.289 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.888803+0000", 2024-09-13T06:39:39.289 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.7139999999999999e-06 2024-09-13T06:39:39.290 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:39.290 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:39.290 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:39.290 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.888820+0000", 2024-09-13T06:39:39.290 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7555999999999999e-05 2024-09-13T06:39:39.290 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:39.290 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:39.290 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:39.290 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.888828+0000", 2024-09-13T06:39:39.290 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.153e-06 2024-09-13T06:39:39.290 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:39.290 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:39.290 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:39.290 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.888897+0000", 2024-09-13T06:39:39.291 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.9805e-05 2024-09-13T06:39:39.291 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:39.291 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:39.291 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:39.291 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.888928+0000", 2024-09-13T06:39:39.291 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.0633000000000003e-05 2024-09-13T06:39:39.291 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:39.291 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:39.291 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:39:39.291 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.893124+0000", 2024-09-13T06:39:39.291 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0041962079999999999 2024-09-13T06:39:39.291 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:39.291 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:39.292 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:39.292 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.893184+0000", 2024-09-13T06:39:39.292 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9456000000000001e-05 2024-09-13T06:39:39.292 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:39.292 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:39.292 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:39.292 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:39.292 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:39.292 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4385.0:2413 3.0 e31/21 3:07d66135:::rbd_object_map.11212429e5ad:head v 31'57, mlcod=31'51)", 2024-09-13T06:39:39.292 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:38.890237+0000", 2024-09-13T06:39:39.292 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.34476336099999999, 2024-09-13T06:39:39.292 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0034719220000000001, 2024-09-13T06:39:39.293 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:39.293 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:39.293 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:39.293 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:39.293 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:39.293 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.890237+0000", 2024-09-13T06:39:39.293 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:39.293 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:39.293 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:39.293 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:39.293 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.890237+0000", 2024-09-13T06:39:39.293 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:39.293 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:39.294 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:39.294 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:39.294 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.890236+0000", 2024-09-13T06:39:39.294 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.999999 2024-09-13T06:39:39.294 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:39.294 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:39.294 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:39.294 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.890243+0000", 2024-09-13T06:39:39.294 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.9630000000000001e-06 2024-09-13T06:39:39.294 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:39.294 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:39.294 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:39.294 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.890258+0000", 2024-09-13T06:39:39.295 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4321999999999999e-05 2024-09-13T06:39:39.295 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:39.295 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:39.295 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:39.295 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.890265+0000", 2024-09-13T06:39:39.295 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3000000000000004e-06 2024-09-13T06:39:39.295 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:39.295 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:39.295 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:39.295 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.890389+0000", 2024-09-13T06:39:39.295 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00012409899999999999 2024-09-13T06:39:39.295 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:39.295 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:39.296 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:39.296 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.890420+0000", 2024-09-13T06:39:39.296 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.1090000000000002e-05 2024-09-13T06:39:39.296 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:39.296 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:39.296 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:39:39.296 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.893629+0000", 2024-09-13T06:39:39.296 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0032087690000000002 2024-09-13T06:39:39.296 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:39.296 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:39.296 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:39.296 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.893709+0000", 2024-09-13T06:39:39.296 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.0226000000000001e-05 2024-09-13T06:39:39.297 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:39.297 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:39.297 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:39.297 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:39.297 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:39.297 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "pg_update_log_missing(3.4 epoch 31/21 rep_tid 67 entries 31'2 (0'0) error 3:27e7ab05:::rbd_data.11212429e5ad.0000000000000022:head by client.4385.0:2421 0.000000 0 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-09-13T06:39:39.297 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:38.890280+0000", 2024-09-13T06:39:39.297 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.34472006999999999, 2024-09-13T06:39:39.297 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0033244350000000002, 2024-09-13T06:39:39.297 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:39.297 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:39:39.297 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:39.298 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:39.298 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:39.298 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.890280+0000", 2024-09-13T06:39:39.298 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:39.298 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:39.298 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:39.298 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:39.298 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.890280+0000", 2024-09-13T06:39:39.298 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:39.298 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:39.298 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:39.298 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:39.298 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.890280+0000", 2024-09-13T06:39:39.299 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:39:39.299 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:39.299 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:39.299 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:39.299 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.890287+0000", 2024-09-13T06:39:39.299 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.148e-06 2024-09-13T06:39:39.299 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:39.299 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:39.299 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:39.299 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.890302+0000", 2024-09-13T06:39:39.299 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.435e-05 2024-09-13T06:39:39.299 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:39.299 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:39.299 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:39.300 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.890312+0000", 2024-09-13T06:39:39.300 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0662999999999999e-05 2024-09-13T06:39:39.300 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:39.300 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:39.300 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:39.300 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.890428+0000", 2024-09-13T06:39:39.300 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000115505 2024-09-13T06:39:39.300 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:39.300 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:39.300 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:39.300 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.893605+0000", 2024-09-13T06:39:39.300 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.003177119 2024-09-13T06:39:39.300 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:39.300 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:39.301 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:39.301 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:39.301 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:39.301 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4385.0:2431 3.0 e31/21 3:07d66135:::rbd_object_map.11212429e5ad:head v 31'61, mlcod=31'58)", 2024-09-13T06:39:39.301 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:38.899502+0000", 2024-09-13T06:39:39.301 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.33549804799999999, 2024-09-13T06:39:39.301 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0024563139999999998, 2024-09-13T06:39:39.301 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:39.301 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:39.301 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:39.302 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:39.302 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:39.302 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.899502+0000", 2024-09-13T06:39:39.302 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:39.302 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:39.302 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:39.302 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:39.302 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.899502+0000", 2024-09-13T06:39:39.302 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:39.302 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:39.302 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:39.302 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:39.302 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.899502+0000", 2024-09-13T06:39:39.303 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.999999 2024-09-13T06:39:39.303 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:39.303 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:39.303 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:39.303 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.899511+0000", 2024-09-13T06:39:39.303 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.5340000000000005e-06 2024-09-13T06:39:39.303 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:39.303 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:39.303 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:39.303 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.899525+0000", 2024-09-13T06:39:39.303 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3891e-05 2024-09-13T06:39:39.303 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:39.303 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:39.304 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:39.304 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.899533+0000", 2024-09-13T06:39:39.304 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.7440000000000007e-06 2024-09-13T06:39:39.304 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:39.304 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:39.304 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:39.304 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.899586+0000", 2024-09-13T06:39:39.304 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3244e-05 2024-09-13T06:39:39.304 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:39.304 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:39.304 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:39.304 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.899616+0000", 2024-09-13T06:39:39.305 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.0436000000000001e-05 2024-09-13T06:39:39.305 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:39.305 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:39.305 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:39:39.305 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.901889+0000", 2024-09-13T06:39:39.305 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0022726880000000001 2024-09-13T06:39:39.305 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:39.305 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:39.305 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:39.305 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.901959+0000", 2024-09-13T06:39:39.305 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.9648999999999997e-05 2024-09-13T06:39:39.305 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:39.306 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:39.306 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:39.306 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:39.306 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:39.306 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4385.0:2432 3.0 e31/21 3:07d66135:::rbd_object_map.11212429e5ad:head v 31'62, mlcod=31'58)", 2024-09-13T06:39:39.306 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:38.900535+0000", 2024-09-13T06:39:39.306 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.33446534, 2024-09-13T06:39:39.306 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0036949130000000002, 2024-09-13T06:39:39.306 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:39.306 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:39.306 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:39.306 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:39.307 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:39.307 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.900535+0000", 2024-09-13T06:39:39.307 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:39.307 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:39.307 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:39.307 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:39.307 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.900535+0000", 2024-09-13T06:39:39.307 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:39.307 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:39.307 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:39.307 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:39.307 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.900535+0000", 2024-09-13T06:39:39.307 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:39:39.308 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:39.308 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:39.308 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:39.308 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.900541+0000", 2024-09-13T06:39:39.308 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.4169999999999997e-06 2024-09-13T06:39:39.308 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:39.308 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:39.308 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:39.308 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.900553+0000", 2024-09-13T06:39:39.308 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2354000000000001e-05 2024-09-13T06:39:39.308 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:39.308 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:39.309 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:39.309 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.900560+0000", 2024-09-13T06:39:39.309 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.8990000000000004e-06 2024-09-13T06:39:39.309 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:39.309 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:39.309 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:39.309 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.900621+0000", 2024-09-13T06:39:39.309 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0699000000000003e-05 2024-09-13T06:39:39.309 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:39.309 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:39.309 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:39.310 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.900660+0000", 2024-09-13T06:39:39.310 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.8609999999999998e-05 2024-09-13T06:39:39.310 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:39.310 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:39.310 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:39:39.310 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.904177+0000", 2024-09-13T06:39:39.310 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0035175509999999998 2024-09-13T06:39:39.310 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:39.310 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:39.310 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:39.310 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.904230+0000", 2024-09-13T06:39:39.310 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2966000000000001e-05 2024-09-13T06:39:39.311 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:39.311 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:39.311 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:39.311 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:39.311 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:39.311 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4385.0:2433 3.0 e31/21 3:07d66135:::rbd_object_map.11212429e5ad:head v 31'63, mlcod=31'58)", 2024-09-13T06:39:39.311 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:38.901375+0000", 2024-09-13T06:39:39.311 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.33362592899999999, 2024-09-13T06:39:39.311 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.005560738, 2024-09-13T06:39:39.311 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:39.311 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:39.311 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:39.311 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:39.312 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:39.312 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.901375+0000", 2024-09-13T06:39:39.312 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:39.312 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:39.312 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:39.312 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:39.312 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.901375+0000", 2024-09-13T06:39:39.312 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:39.312 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:39.312 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:39.312 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:39.312 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.901374+0000", 2024-09-13T06:39:39.313 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.999999 2024-09-13T06:39:39.313 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:39.313 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:39.313 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:39.313 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.901381+0000", 2024-09-13T06:39:39.313 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.1019999999999999e-06 2024-09-13T06:39:39.313 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:39.313 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:39.313 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:39.313 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.901394+0000", 2024-09-13T06:39:39.313 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2782999999999999e-05 2024-09-13T06:39:39.313 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:39.313 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:39.314 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:39.314 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.901400+0000", 2024-09-13T06:39:39.314 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.8449999999999997e-06 2024-09-13T06:39:39.314 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:39.314 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:39.314 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:39.314 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.901483+0000", 2024-09-13T06:39:39.314 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.2841000000000002e-05 2024-09-13T06:39:39.314 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:39.314 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:39.314 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:39.314 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.901513+0000", 2024-09-13T06:39:39.314 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.0102000000000001e-05 2024-09-13T06:39:39.314 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:39.315 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:39.315 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:39:39.315 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.906853+0000", 2024-09-13T06:39:39.315 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.005339402 2024-09-13T06:39:39.315 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:39.315 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:39.315 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:39.315 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.906935+0000", 2024-09-13T06:39:39.315 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.2488e-05 2024-09-13T06:39:39.315 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:39.315 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:39.315 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:39.315 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:39.315 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:39.315 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4385.0:2434 3.0 e31/21 3:07d66135:::rbd_object_map.11212429e5ad:head v 31'64, mlcod=31'58)", 2024-09-13T06:39:39.316 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:38.902253+0000", 2024-09-13T06:39:39.316 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.33274734299999997, 2024-09-13T06:39:39.316 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0047392650000000003, 2024-09-13T06:39:39.316 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:39.316 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:39.316 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:39.316 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:39.316 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:39.316 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.902253+0000", 2024-09-13T06:39:39.316 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:39.316 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:39.316 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:39.316 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:39.317 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.902253+0000", 2024-09-13T06:39:39.317 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:39.317 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:39.317 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:39.317 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:39.317 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.902252+0000", 2024-09-13T06:39:39.317 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.999999 2024-09-13T06:39:39.317 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:39.317 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:39.317 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:39.317 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.902259+0000", 2024-09-13T06:39:39.317 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.9709999999999998e-06 2024-09-13T06:39:39.317 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:39.318 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:39.318 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:39.318 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.902273+0000", 2024-09-13T06:39:39.318 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3302000000000001e-05 2024-09-13T06:39:39.318 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:39.318 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:39.318 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:39.318 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.902280+0000", 2024-09-13T06:39:39.318 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.126e-06 2024-09-13T06:39:39.318 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:39.318 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:39.318 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:39.318 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.902334+0000", 2024-09-13T06:39:39.318 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.4512000000000003e-05 2024-09-13T06:39:39.318 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:39.319 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:39.319 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:39.319 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.902363+0000", 2024-09-13T06:39:39.319 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.8544e-05 2024-09-13T06:39:39.319 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:39.319 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:39.319 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:39:39.319 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.906941+0000", 2024-09-13T06:39:39.319 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0045781320000000004 2024-09-13T06:39:39.319 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:39.319 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:39.319 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:39.319 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.906992+0000", 2024-09-13T06:39:39.319 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.1533000000000003e-05 2024-09-13T06:39:39.320 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:39.320 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:39.320 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:39.320 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:39.320 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:39.320 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4385.0:2595 3.0 e31/21 3:07d66135:::rbd_object_map.11212429e5ad:head v 31'108, mlcod=31'105)", 2024-09-13T06:39:39.320 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:39.201908+0000", 2024-09-13T06:39:39.320 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.03309206, 2024-09-13T06:39:39.320 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0032468890000000002, 2024-09-13T06:39:39.320 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:39.320 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:39.320 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:39.320 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:39.321 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:39.321 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.201908+0000", 2024-09-13T06:39:39.321 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:39.321 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:39.321 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:39.321 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:39.321 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.201908+0000", 2024-09-13T06:39:39.321 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:39.321 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:39.321 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:39.321 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:39.321 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.201908+0000", 2024-09-13T06:39:39.321 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.999999 2024-09-13T06:39:39.322 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:39.322 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:39.322 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:39.322 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.201915+0000", 2024-09-13T06:39:39.322 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.153e-06 2024-09-13T06:39:39.322 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:39.322 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:39.322 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:39.322 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.201925+0000", 2024-09-13T06:39:39.322 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0453e-05 2024-09-13T06:39:39.322 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:39.322 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:39.322 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:39.323 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.201932+0000", 2024-09-13T06:39:39.323 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.5529999999999998e-06 2024-09-13T06:39:39.323 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:39.323 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:39.323 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:39.323 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.201976+0000", 2024-09-13T06:39:39.323 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4484000000000003e-05 2024-09-13T06:39:39.323 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:39.323 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:39.323 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:39.323 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.201997+0000", 2024-09-13T06:39:39.323 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0310999999999999e-05 2024-09-13T06:39:39.323 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:39.323 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:39.324 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:39:39.324 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.205118+0000", 2024-09-13T06:39:39.324 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0031218890000000001 2024-09-13T06:39:39.324 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:39.324 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:39.324 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:39.324 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.205155+0000", 2024-09-13T06:39:39.324 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.6807000000000002e-05 2024-09-13T06:39:39.324 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:39.324 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:39.324 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:39.325 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:39.325 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:39.325 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:39:39.326 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-13T06:39:39.327 INFO:teuthology.orchestra.run.smithi081.stdout:287 writesame 0x51c0273 thru 0x51c9e65 data_size 0x25(0x9bf3 bytes) 2024-09-13T06:39:39.327 INFO:teuthology.orchestra.run.smithi081.stdout:290 read 0x56c9bef thru 0x56d71da (0xd5ec bytes) 2024-09-13T06:39:39.328 INFO:teuthology.orchestra.run.smithi081.stdout:291 write 0x95a8381 thru 0x95ae179 (0x5df9 bytes) 2024-09-13T06:39:39.328 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:39:39.328 INFO:teuthology.orchestra.run.smithi081.stdout:293 writesame 0x7a3aefd thru 0x7a485ff data_size 0x1(0xd703 bytes) 2024-09-13T06:39:39.328 INFO:teuthology.orchestra.run.smithi081.stdout:294 write 0x3c18456 thru 0x3c24146 (0xbcf1 bytes) 2024-09-13T06:39:39.328 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:39:39.327+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:39:39.333 INFO:teuthology.orchestra.run.smithi081.stdout:295 punch from 0x7c54372 to 0x7c579db, (0x3669 bytes) 2024-09-13T06:39:39.333 INFO:teuthology.orchestra.run.smithi081.stdout:296 read 0x635629b thru 0x6358b22 (0x2888 bytes) 2024-09-13T06:39:39.333 INFO:teuthology.orchestra.run.smithi081.stdout:297 punch from 0x8865dbd to 0x886df5c, (0x819f bytes) 2024-09-13T06:39:39.334 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:39:39.334 INFO:teuthology.orchestra.run.smithi081.stdout:299 read 0x4dc7fb7 thru 0x4dcb164 (0x31ae bytes) 2024-09-13T06:39:39.339 INFO:teuthology.orchestra.run.smithi081.stdout:301 trunc from 0x95ae17a to 0xc4b76a2 2024-09-13T06:39:39.352 INFO:teuthology.orchestra.run.smithi081.stdout:302 read 0x310d8ee thru 0x31186e2 (0xadf5 bytes) 2024-09-13T06:39:39.367 INFO:teuthology.orchestra.run.smithi081.stdout:303 write 0xda936a9 thru 0xda9b4eb (0x7e43 bytes) 2024-09-13T06:39:39.373 INFO:teuthology.orchestra.run.smithi081.stdout:305 read 0x4a4e434 thru 0x4a5bcbc (0xd889 bytes) 2024-09-13T06:39:39.373 INFO:teuthology.orchestra.run.smithi081.stdout:306 read 0xaf8064f thru 0xaf8cb72 (0xc524 bytes) 2024-09-13T06:39:39.373 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:39:39.373 INFO:teuthology.orchestra.run.smithi081.stdout:311 write 0x1fe4004 thru 0x1fefc32 (0xbc2f bytes) 2024-09-13T06:39:39.391 INFO:teuthology.orchestra.run.smithi081.stdout:312 write 0xdd04668 thru 0xdd13588 (0xef21 bytes) 2024-09-13T06:39:39.413 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-13T06:39:39.417 INFO:teuthology.orchestra.run.smithi081.stdout:314 trunc from 0xdd13589 to 0x1d5107c 2024-09-13T06:39:39.426 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:39:39.431+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:39:39.449 INFO:teuthology.orchestra.run.smithi081.stdout:315 punch from 0x414848 to 0x414eb3, (0x66b bytes) 2024-09-13T06:39:39.449 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:39:39.450 INFO:teuthology.orchestra.run.smithi081.stdout:319 read 0xe6e852 thru 0xe7d1b0 (0xe95f bytes) 2024-09-13T06:39:39.477 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:39:39.477 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-13T06:39:39.477 INFO:teuthology.orchestra.run.smithi081.stdout: "num_ops": 0 2024-09-13T06:39:39.477 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:39:39.480 INFO:teuthology.orchestra.run.smithi081.stdout:320 write 0xe8b0c71 thru 0xe8bc7b5 (0xbb45 bytes) 2024-09-13T06:39:39.488 INFO:teuthology.orchestra.run.smithi081.stdout:321 write 0x5223262 thru 0x523053f (0xd2de bytes) 2024-09-13T06:39:39.492 INFO:teuthology.orchestra.run.smithi081.stdout:323 write 0x83fd234 thru 0x840b657 (0xe424 bytes) 2024-09-13T06:39:39.495 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-13T06:39:39.500 INFO:teuthology.orchestra.run.smithi081.stdout:324 writesame 0xb933878 thru 0xb93afd5 data_size 0x21(0x775e bytes) 2024-09-13T06:39:39.519 INFO:teuthology.orchestra.run.smithi081.stdout:326 trunc from 0xe8bc7b6 to 0x5fb3236 2024-09-13T06:39:39.527 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:39:39.531+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:39:39.537 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:39:39.550 INFO:teuthology.orchestra.run.smithi081.stdout:332 write 0x751e481 thru 0x7526d5a (0x88da bytes) 2024-09-13T06:39:39.556 INFO:teuthology.orchestra.run.smithi081.stdout:333 write 0x5e0957e thru 0x5e1907e (0xfb01 bytes) 2024-09-13T06:39:39.563 INFO:teuthology.orchestra.run.smithi081.stdout:334 trunc from 0x7526d5b to 0x8087289 2024-09-13T06:39:39.572 INFO:teuthology.orchestra.run.smithi081.stdout:osd.0: {} 2024-09-13T06:39:39.572 INFO:teuthology.orchestra.run.smithi081.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-13T06:39:39.574 INFO:teuthology.orchestra.run.smithi081.stdout:335 trunc from 0x8087289 to 0x7a5c18c 2024-09-13T06:39:39.584 INFO:teuthology.orchestra.run.smithi081.stdout:336 read 0x62461b8 thru 0x624a9ea (0x4833 bytes) 2024-09-13T06:39:39.585 INFO:teuthology.orchestra.run.smithi081.stdout:337 write 0xb02a39 thru 0xb0f416 (0xc9de bytes) 2024-09-13T06:39:39.589 INFO:teuthology.orchestra.run.smithi081.stdout:338 read 0x3124d94 thru 0x3130291 (0xb4fe bytes) 2024-09-13T06:39:39.591 INFO:teuthology.orchestra.run.smithi081.stdout:osd.1: {} 2024-09-13T06:39:39.591 INFO:teuthology.orchestra.run.smithi081.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-13T06:39:39.593 INFO:teuthology.orchestra.run.smithi081.stdout:339 trunc from 0x7a5c18c to 0xa1619e5 2024-09-13T06:39:39.603 INFO:teuthology.orchestra.run.smithi081.stdout:341 write 0x9b2cbe2 thru 0x9b31477 (0x4896 bytes) 2024-09-13T06:39:39.610 INFO:teuthology.orchestra.run.smithi081.stdout:osd.2: {} 2024-09-13T06:39:39.610 INFO:teuthology.orchestra.run.smithi081.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-13T06:39:39.611 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:39:39.611 INFO:teuthology.orchestra.run.smithi081.stdout:344 punch from 0x76d7967 to 0x76d9364, (0x19fd bytes) 2024-09-13T06:39:39.611 INFO:teuthology.orchestra.run.smithi081.stdout:345 punch from 0x5c8f363 to 0x5c93c3c, (0x48d9 bytes) 2024-09-13T06:39:39.611 INFO:teuthology.orchestra.run.smithi081.stdout:346 write 0x6225144 thru 0x622c2b1 (0x716e bytes) 2024-09-13T06:39:39.615 INFO:teuthology.orchestra.run.smithi081.stdout:347 writesame 0x3e960f3 thru 0x3e9b22b data_size 0x1d(0x5139 bytes) 2024-09-13T06:39:39.620 INFO:teuthology.orchestra.run.smithi081.stdout:348 write 0x27e97e thru 0x281b8d (0x3210 bytes) 2024-09-13T06:39:39.628 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-13T06:39:39.630+0000 7f86a5f06640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26387) UID: 0 2024-09-13T06:39:39.629 INFO:teuthology.orchestra.run.smithi081.stdout:osd.3: {} 2024-09-13T06:39:39.629 INFO:teuthology.orchestra.run.smithi081.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-13T06:39:39.631 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:39:39.631 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:39:39.638 INFO:teuthology.orchestra.run.smithi081.stdout:349 write 0xb5038d8 thru 0xb5066e1 (0x2e0a bytes) 2024-09-13T06:39:39.644 INFO:teuthology.orchestra.run.smithi081.stdout:350 read 0x525f0b4 thru 0x525ff80 (0xecd bytes) 2024-09-13T06:39:39.644 INFO:teuthology.orchestra.run.smithi081.stdout:351 write 0x13aa58d thru 0x13ae63f (0x40b3 bytes) 2024-09-13T06:39:39.646 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-13T06:39:39.649 INFO:teuthology.orchestra.run.smithi081.stdout:352 writesame 0x9531e30 thru 0x953277b data_size 0x7(0x94c bytes) 2024-09-13T06:39:39.651 INFO:teuthology.orchestra.run.smithi081.stdout:osd.4: {} 2024-09-13T06:39:39.651 INFO:teuthology.orchestra.run.smithi081.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-13T06:39:39.663 INFO:teuthology.orchestra.run.smithi081.stdout:353 writesame 0xb82831a thru 0xb832662 data_size 0x1(0xa349 bytes) 2024-09-13T06:39:39.663 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:39:39.664 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:39:39.664 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:39:39.664 INFO:teuthology.orchestra.run.smithi081.stdout:360 read 0x9f831ad thru 0x9f92ad6 (0xf92a bytes) 2024-09-13T06:39:39.672 INFO:teuthology.orchestra.run.smithi081.stdout:osd.5: {} 2024-09-13T06:39:39.672 INFO:teuthology.orchestra.run.smithi081.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-13T06:39:39.676 INFO:teuthology.orchestra.run.smithi081.stdout:361 trunc from 0xb832663 to 0x2e17373 2024-09-13T06:39:39.696 INFO:teuthology.orchestra.run.smithi081.stdout:osd.6: {} 2024-09-13T06:39:39.696 INFO:teuthology.orchestra.run.smithi081.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-13T06:39:39.700 INFO:teuthology.orchestra.run.smithi081.stdout:362 read 0xc8889 thru 0xd05c8 (0x7d40 bytes) 2024-09-13T06:39:39.701 INFO:teuthology.orchestra.run.smithi081.stdout:363 clone 3 order 19 su 65536 sc 2 2024-09-13T06:39:39.716 INFO:teuthology.orchestra.run.smithi081.stdout:osd.7: {} 2024-09-13T06:39:39.716 INFO:teuthology.orchestra.run.smithi081.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-13T06:39:39.729 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:39:39.731+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:39:39.771 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:39:39.771 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:39:39.784 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-13T06:39:39.829 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:39:39.831+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:39:39.917 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:39:39.917 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:39:39.931 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-13T06:39:39.932 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-13T06:39:39.930+0000 7f86a5f06640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26387) UID: 0 2024-09-13T06:39:40.032 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:39:40.035+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:39:40.104 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:39:40.104 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:39:40.119 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-13T06:39:40.132 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:39:40.135+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:39:40.233 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:39:40.235+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:39:40.239 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:39:40.239 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:39:40.255 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-13T06:39:40.334 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:39:40.335+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:39:40.372 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:39:40.372 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:39:40.386 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-13T06:39:40.435 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:39:40.439+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:39:40.456 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-13T06:39:40.509 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:39:40.509 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:39:40.524 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-13T06:39:40.535 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:39:40.539+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:39:40.636 INFO:tasks.ceph.osd.6.smithi139.stderr:2024-09-13T06:39:40.638+0000 7fcd02c5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26385) UID: 0 2024-09-13T06:39:40.639 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:39:40.639 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:39:40.652 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-13T06:39:40.737 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:39:40.739+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:39:40.803 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:39:40.803 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:39:40.815 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-13T06:39:40.859 INFO:tasks.ceph.osd.6.smithi139.stderr:2024-09-13T06:39:40.862+0000 7fcd02c5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26385) UID: 0 2024-09-13T06:39:40.921 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:39:40.922 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:39:40.934 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-13T06:39:40.981 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:39:40.982+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:39:41.040 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:39:41.042+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:39:41.102 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:39:41.102 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:39:41.116 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-13T06:39:41.142 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:39:41.143+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:39:41.243 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:39:41.247+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:39:41.278 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:39:41.278 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:39:41.293 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-13T06:39:41.343 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:39:41.347+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:39:41.412 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:39:41.413 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:39:41.428 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-13T06:39:41.455 INFO:teuthology.orchestra.run.smithi081.stderr:nodeep-scrub is set 2024-09-13T06:39:41.472 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:39:41.474+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:39:41.545 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:39:41.546+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:39:41.558 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:39:41.559 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:39:41.573 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-13T06:39:41.646 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:39:41.647+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:39:41.698 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:39:41.698 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:39:41.712 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-13T06:39:41.735 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-13T06:39:41.755 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:39:41.759+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:39:41.848 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:39:41.851+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:39:41.874 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:39:41.874 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:39:41.890 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-13T06:39:41.895 INFO:teuthology.orchestra.run.smithi081.stdout:osd.0: {} 2024-09-13T06:39:41.895 INFO:teuthology.orchestra.run.smithi081.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-13T06:39:41.912 INFO:teuthology.orchestra.run.smithi081.stdout:osd.1: {} 2024-09-13T06:39:41.913 INFO:teuthology.orchestra.run.smithi081.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-13T06:39:41.929 INFO:teuthology.orchestra.run.smithi081.stdout:osd.2: {} 2024-09-13T06:39:41.929 INFO:teuthology.orchestra.run.smithi081.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-13T06:39:41.945 INFO:teuthology.orchestra.run.smithi081.stdout:osd.3: {} 2024-09-13T06:39:41.945 INFO:teuthology.orchestra.run.smithi081.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-13T06:39:41.948 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:39:41.950+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:39:41.965 INFO:teuthology.orchestra.run.smithi081.stdout:osd.4: {} 2024-09-13T06:39:41.965 INFO:teuthology.orchestra.run.smithi081.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-13T06:39:41.986 INFO:teuthology.orchestra.run.smithi081.stdout:osd.5: {} 2024-09-13T06:39:41.986 INFO:teuthology.orchestra.run.smithi081.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-13T06:39:42.006 INFO:teuthology.orchestra.run.smithi081.stdout:osd.6: {} 2024-09-13T06:39:42.006 INFO:teuthology.orchestra.run.smithi081.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-13T06:39:42.012 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:39:42.012 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 20, 2024-09-13T06:39:42.012 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 600, 2024-09-13T06:39:42.012 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [ 2024-09-13T06:39:42.012 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.012 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4154.0:67 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'41, mlcod=15'39)", 2024-09-13T06:39:42.012 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:11.333035+0000", 2024-09-13T06:39:42.012 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 30.682909788, 2024-09-13T06:39:42.012 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0063409859999999998, 2024-09-13T06:39:42.012 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:42.013 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:42.013 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:42.013 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.013 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:42.013 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:11.333035+0000", 2024-09-13T06:39:42.013 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:42.013 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.013 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.013 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:42.013 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:11.333035+0000", 2024-09-13T06:39:42.013 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:42.013 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.013 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.014 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:42.014 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:11.333034+0000", 2024-09-13T06:39:42.014 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999981 2024-09-13T06:39:42.014 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.014 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.014 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:42.014 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:11.333048+0000", 2024-09-13T06:39:42.014 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3859999999999999e-05 2024-09-13T06:39:42.014 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.014 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.014 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:42.014 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:11.333076+0000", 2024-09-13T06:39:42.014 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.8586e-05 2024-09-13T06:39:42.014 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.014 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.015 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:42.015 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:11.333089+0000", 2024-09-13T06:39:42.015 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2447e-05 2024-09-13T06:39:42.015 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.015 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.015 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:42.015 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:11.333193+0000", 2024-09-13T06:39:42.015 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000104042 2024-09-13T06:39:42.015 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.016 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.016 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:42.016 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:11.333232+0000", 2024-09-13T06:39:42.016 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.9406999999999997e-05 2024-09-13T06:39:42.016 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.016 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.016 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:39:42.016 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:11.339313+0000", 2024-09-13T06:39:42.016 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0060808529999999998 2024-09-13T06:39:42.016 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.016 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.016 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:42.016 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:11.339376+0000", 2024-09-13T06:39:42.016 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3565000000000006e-05 2024-09-13T06:39:42.016 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:42.017 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:42.017 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:42.017 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.017 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.017 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4154.0:130 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'88, mlcod=15'85)", 2024-09-13T06:39:42.017 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:12.005647+0000", 2024-09-13T06:39:42.017 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 30.01029861, 2024-09-13T06:39:42.017 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0064037570000000004, 2024-09-13T06:39:42.017 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:42.017 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:42.017 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:42.017 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.017 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:42.017 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.005647+0000", 2024-09-13T06:39:42.018 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:42.018 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.018 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.018 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:42.018 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.005647+0000", 2024-09-13T06:39:42.018 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:42.018 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.018 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.018 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:42.018 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.005645+0000", 2024-09-13T06:39:42.018 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999981 2024-09-13T06:39:42.018 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.018 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.018 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:42.019 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.005664+0000", 2024-09-13T06:39:42.019 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8876999999999999e-05 2024-09-13T06:39:42.019 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.019 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.019 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:42.019 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.005695+0000", 2024-09-13T06:39:42.019 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.1467000000000002e-05 2024-09-13T06:39:42.019 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.019 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.019 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:42.019 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.005715+0000", 2024-09-13T06:39:42.019 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0248999999999999e-05 2024-09-13T06:39:42.019 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.019 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.019 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:42.020 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.006412+0000", 2024-09-13T06:39:42.020 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00069722499999999999 2024-09-13T06:39:42.020 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.020 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.020 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:42.020 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.006475+0000", 2024-09-13T06:39:42.020 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.2955999999999998e-05 2024-09-13T06:39:42.020 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.020 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.020 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:39:42.020 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.011987+0000", 2024-09-13T06:39:42.020 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0055118240000000002 2024-09-13T06:39:42.021 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.021 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.021 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:42.021 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.012050+0000", 2024-09-13T06:39:42.021 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3102999999999995e-05 2024-09-13T06:39:42.021 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:42.021 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:42.021 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:42.021 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.021 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.021 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4154.0:131 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'89, mlcod=15'85)", 2024-09-13T06:39:42.021 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:12.006115+0000", 2024-09-13T06:39:42.021 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 30.009830143999999, 2024-09-13T06:39:42.022 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0092077789999999993, 2024-09-13T06:39:42.022 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:42.022 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:42.022 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:42.022 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.022 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:42.022 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.006115+0000", 2024-09-13T06:39:42.022 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:42.022 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.022 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.022 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:42.022 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.006115+0000", 2024-09-13T06:39:42.022 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:42.023 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.023 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.023 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:42.023 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.006114+0000", 2024-09-13T06:39:42.023 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999986 2024-09-13T06:39:42.023 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.023 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.023 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:42.023 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.006258+0000", 2024-09-13T06:39:42.023 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00014467899999999999 2024-09-13T06:39:42.023 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.023 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.023 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:42.024 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.006277+0000", 2024-09-13T06:39:42.024 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8425999999999999e-05 2024-09-13T06:39:42.024 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.024 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.024 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:42.024 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.006288+0000", 2024-09-13T06:39:42.024 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1037e-05 2024-09-13T06:39:42.024 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.024 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.024 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:42.024 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.007461+0000", 2024-09-13T06:39:42.024 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.001173381 2024-09-13T06:39:42.025 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.025 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.025 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:42.025 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.007522+0000", 2024-09-13T06:39:42.025 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0266999999999997e-05 2024-09-13T06:39:42.025 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.025 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.025 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:39:42.025 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.015248+0000", 2024-09-13T06:39:42.025 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0077260200000000001 2024-09-13T06:39:42.025 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.025 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.025 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:42.026 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.015323+0000", 2024-09-13T06:39:42.026 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5289000000000004e-05 2024-09-13T06:39:42.026 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:42.026 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:42.026 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:42.026 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.026 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.026 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4154.0:132 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'90, mlcod=15'85)", 2024-09-13T06:39:42.026 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:12.006560+0000", 2024-09-13T06:39:42.026 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 30.009385223999999, 2024-09-13T06:39:42.026 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0088017219999999997, 2024-09-13T06:39:42.026 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:42.026 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:42.027 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:42.027 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.027 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:42.027 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.006560+0000", 2024-09-13T06:39:42.027 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:42.027 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.027 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.027 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:42.027 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.006560+0000", 2024-09-13T06:39:42.027 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:42.027 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.027 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.028 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:42.028 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.006559+0000", 2024-09-13T06:39:42.028 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.999999 2024-09-13T06:39:42.028 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.028 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.028 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:42.028 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.006569+0000", 2024-09-13T06:39:42.028 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0197000000000001e-05 2024-09-13T06:39:42.028 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.028 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.028 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:42.028 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.006587+0000", 2024-09-13T06:39:42.029 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8073000000000001e-05 2024-09-13T06:39:42.029 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.029 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.029 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:42.029 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.006596+0000", 2024-09-13T06:39:42.029 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.0000000000000002e-06 2024-09-13T06:39:42.029 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.029 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.029 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:42.029 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.008751+0000", 2024-09-13T06:39:42.029 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0021548299999999999 2024-09-13T06:39:42.029 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.029 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.030 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:42.030 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.008803+0000", 2024-09-13T06:39:42.030 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.215e-05 2024-09-13T06:39:42.030 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.030 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.030 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:39:42.030 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.015329+0000", 2024-09-13T06:39:42.030 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0065259589999999996 2024-09-13T06:39:42.030 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.030 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.030 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:42.030 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.015362+0000", 2024-09-13T06:39:42.030 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.2613000000000001e-05 2024-09-13T06:39:42.031 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:42.031 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:42.031 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:42.031 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.031 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.031 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4154.0:133 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'91, mlcod=15'85)", 2024-09-13T06:39:42.031 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:12.006919+0000", 2024-09-13T06:39:42.031 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 30.009025897000001, 2024-09-13T06:39:42.031 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0084917580000000003, 2024-09-13T06:39:42.031 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:42.031 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:42.031 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:42.031 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.031 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:42.031 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.006919+0000", 2024-09-13T06:39:42.032 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:42.032 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.032 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.032 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:42.032 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.006919+0000", 2024-09-13T06:39:42.032 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:42.032 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.032 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.032 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:42.032 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.006918+0000", 2024-09-13T06:39:42.032 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.999999 2024-09-13T06:39:42.032 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.032 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.032 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:42.032 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.006926+0000", 2024-09-13T06:39:42.033 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.9929999999999995e-06 2024-09-13T06:39:42.033 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.033 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.033 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:42.033 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.006948+0000", 2024-09-13T06:39:42.033 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1593000000000001e-05 2024-09-13T06:39:42.033 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.033 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.033 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:42.033 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.006958+0000", 2024-09-13T06:39:42.033 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.029e-05 2024-09-13T06:39:42.033 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.033 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.034 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:42.034 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.009740+0000", 2024-09-13T06:39:42.034 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0027821259999999998 2024-09-13T06:39:42.034 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.034 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.034 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:42.034 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.009776+0000", 2024-09-13T06:39:42.034 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.5102999999999999e-05 2024-09-13T06:39:42.034 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.034 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.034 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:39:42.034 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.015366+0000", 2024-09-13T06:39:42.034 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0055902160000000003 2024-09-13T06:39:42.034 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.034 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.035 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:42.035 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.015411+0000", 2024-09-13T06:39:42.035 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5290000000000002e-05 2024-09-13T06:39:42.035 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:42.035 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:42.035 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:42.035 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.035 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.035 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4154.0:134 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'92, mlcod=15'85)", 2024-09-13T06:39:42.035 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:12.007373+0000", 2024-09-13T06:39:42.035 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 30.00857255, 2024-09-13T06:39:42.035 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.010012544999999999, 2024-09-13T06:39:42.035 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:42.035 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:42.036 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:42.036 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.036 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:42.036 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.007373+0000", 2024-09-13T06:39:42.036 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:42.036 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.036 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.036 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:42.036 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.007373+0000", 2024-09-13T06:39:42.036 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:42.036 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.036 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.036 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:42.036 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.007372+0000", 2024-09-13T06:39:42.037 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.999999 2024-09-13T06:39:42.037 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.037 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.037 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:42.037 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.007421+0000", 2024-09-13T06:39:42.037 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9660000000000002e-05 2024-09-13T06:39:42.037 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.037 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.037 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:42.037 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.007435+0000", 2024-09-13T06:39:42.037 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3743e-05 2024-09-13T06:39:42.037 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.037 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.037 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:42.038 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.007443+0000", 2024-09-13T06:39:42.038 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.2269999999999993e-06 2024-09-13T06:39:42.038 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.038 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.038 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:42.038 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.010303+0000", 2024-09-13T06:39:42.038 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0028596509999999999 2024-09-13T06:39:42.038 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.038 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.038 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:42.038 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.010337+0000", 2024-09-13T06:39:42.038 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.4306e-05 2024-09-13T06:39:42.039 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.039 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.039 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:39:42.039 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.017329+0000", 2024-09-13T06:39:42.039 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0069915660000000003 2024-09-13T06:39:42.039 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.039 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.039 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:42.039 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.017385+0000", 2024-09-13T06:39:42.039 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.6409000000000002e-05 2024-09-13T06:39:42.039 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:42.039 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:42.039 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:42.039 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.039 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.040 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4154.0:135 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'93, mlcod=15'85)", 2024-09-13T06:39:42.040 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:12.007816+0000", 2024-09-13T06:39:42.040 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 30.008129019999998, 2024-09-13T06:39:42.040 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0096068089999999991, 2024-09-13T06:39:42.040 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:42.040 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:42.040 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:42.040 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.040 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:42.040 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.007816+0000", 2024-09-13T06:39:42.040 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:42.040 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.040 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.040 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:42.040 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.007816+0000", 2024-09-13T06:39:42.041 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:42.041 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.041 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.041 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:42.041 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.007815+0000", 2024-09-13T06:39:42.041 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.999999 2024-09-13T06:39:42.041 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.041 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.041 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:42.041 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.007823+0000", 2024-09-13T06:39:42.041 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.8730000000000007e-06 2024-09-13T06:39:42.041 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.041 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.042 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:42.042 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.007836+0000", 2024-09-13T06:39:42.042 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2510000000000001e-05 2024-09-13T06:39:42.042 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.042 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.042 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:42.042 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.007843+0000", 2024-09-13T06:39:42.042 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5830000000000001e-06 2024-09-13T06:39:42.042 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.042 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.042 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:42.042 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.011183+0000", 2024-09-13T06:39:42.042 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0033400539999999999 2024-09-13T06:39:42.043 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.043 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.043 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:42.043 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.011217+0000", 2024-09-13T06:39:42.043 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.3355999999999997e-05 2024-09-13T06:39:42.043 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.043 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.043 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:39:42.043 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.017391+0000", 2024-09-13T06:39:42.043 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0061736960000000002 2024-09-13T06:39:42.043 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.044 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.044 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:42.044 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.017423+0000", 2024-09-13T06:39:42.044 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.2499999999999997e-05 2024-09-13T06:39:42.044 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:42.044 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:42.044 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:42.044 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.044 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.044 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4154.0:136 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'94, mlcod=15'85)", 2024-09-13T06:39:42.044 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:12.008176+0000", 2024-09-13T06:39:42.044 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 30.007769106000001, 2024-09-13T06:39:42.044 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0092805379999999996, 2024-09-13T06:39:42.045 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:42.045 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:42.045 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:42.045 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.045 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:42.045 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.008176+0000", 2024-09-13T06:39:42.045 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:42.045 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.045 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.045 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:42.045 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.008176+0000", 2024-09-13T06:39:42.045 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:42.045 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.046 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.046 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:42.046 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.008175+0000", 2024-09-13T06:39:42.046 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:39:42.046 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.046 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.046 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:42.046 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.008183+0000", 2024-09-13T06:39:42.046 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.1099999999999997e-06 2024-09-13T06:39:42.046 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.046 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.046 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:42.046 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.008207+0000", 2024-09-13T06:39:42.047 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4383999999999999e-05 2024-09-13T06:39:42.047 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.047 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.047 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:42.047 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.008216+0000", 2024-09-13T06:39:42.047 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.4860000000000003e-06 2024-09-13T06:39:42.047 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.047 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.047 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:42.047 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.012139+0000", 2024-09-13T06:39:42.047 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0039226189999999996 2024-09-13T06:39:42.047 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.047 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.047 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:42.048 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.012198+0000", 2024-09-13T06:39:42.048 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8489999999999997e-05 2024-09-13T06:39:42.048 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.048 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.048 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:39:42.048 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.017427+0000", 2024-09-13T06:39:42.048 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0052297589999999996 2024-09-13T06:39:42.048 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.048 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.048 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:42.048 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.017457+0000", 2024-09-13T06:39:42.048 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9357e-05 2024-09-13T06:39:42.048 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:42.048 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:42.049 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:42.049 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.049 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.049 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4154.0:137 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'95, mlcod=15'85)", 2024-09-13T06:39:42.049 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:12.008624+0000", 2024-09-13T06:39:42.049 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 30.007321022999999, 2024-09-13T06:39:42.049 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0088653910000000002, 2024-09-13T06:39:42.049 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:42.049 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:42.049 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:42.049 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.049 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:42.049 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.008624+0000", 2024-09-13T06:39:42.050 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:42.050 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.050 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.050 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:42.050 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.008624+0000", 2024-09-13T06:39:42.050 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:42.050 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.050 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.050 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:42.050 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.008623+0000", 2024-09-13T06:39:42.050 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.999999 2024-09-13T06:39:42.050 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.050 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.050 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:42.050 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.008739+0000", 2024-09-13T06:39:42.051 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00011541599999999999 2024-09-13T06:39:42.051 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.051 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.051 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:42.051 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.008753+0000", 2024-09-13T06:39:42.051 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4136e-05 2024-09-13T06:39:42.051 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.051 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.051 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:42.051 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.008761+0000", 2024-09-13T06:39:42.051 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.9899999999999997e-06 2024-09-13T06:39:42.051 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.051 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.051 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:42.052 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.013092+0000", 2024-09-13T06:39:42.052 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0043311540000000003 2024-09-13T06:39:42.052 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.052 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.052 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:42.052 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.013131+0000", 2024-09-13T06:39:42.052 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.9266e-05 2024-09-13T06:39:42.052 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.052 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.052 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:39:42.052 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.017461+0000", 2024-09-13T06:39:42.052 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0043297700000000001 2024-09-13T06:39:42.052 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.052 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.053 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:42.053 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.017490+0000", 2024-09-13T06:39:42.053 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.8699000000000001e-05 2024-09-13T06:39:42.053 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:42.053 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:42.053 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:42.053 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.053 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.053 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4154.0:138 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'96, mlcod=15'85)", 2024-09-13T06:39:42.053 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:12.009148+0000", 2024-09-13T06:39:42.053 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 30.006797436999999, 2024-09-13T06:39:42.053 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0083737480000000003, 2024-09-13T06:39:42.053 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:42.054 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:42.054 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:42.054 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.054 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:42.054 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.009148+0000", 2024-09-13T06:39:42.054 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:42.054 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.054 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.054 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:42.054 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.009148+0000", 2024-09-13T06:39:42.054 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:42.054 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.054 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.054 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:42.055 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.009146+0000", 2024-09-13T06:39:42.055 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999981 2024-09-13T06:39:42.055 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.055 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.055 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:42.055 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.009160+0000", 2024-09-13T06:39:42.055 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3706000000000001e-05 2024-09-13T06:39:42.055 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.055 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.055 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:42.055 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.009221+0000", 2024-09-13T06:39:42.055 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.1532999999999995e-05 2024-09-13T06:39:42.055 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.055 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.055 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:42.056 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.009240+0000", 2024-09-13T06:39:42.056 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8300000000000001e-05 2024-09-13T06:39:42.056 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.056 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.056 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:42.056 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.014388+0000", 2024-09-13T06:39:42.056 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0051483299999999996 2024-09-13T06:39:42.056 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.056 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.056 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:42.056 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.014439+0000", 2024-09-13T06:39:42.056 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0618999999999998e-05 2024-09-13T06:39:42.056 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.057 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.057 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:39:42.057 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.017497+0000", 2024-09-13T06:39:42.057 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0030583899999999998 2024-09-13T06:39:42.057 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.057 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.057 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:42.057 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.017522+0000", 2024-09-13T06:39:42.057 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4613e-05 2024-09-13T06:39:42.057 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:42.057 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:42.057 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:42.057 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.058 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.058 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4154.0:139 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'97, mlcod=15'85)", 2024-09-13T06:39:42.058 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:12.009507+0000", 2024-09-13T06:39:42.058 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 30.006438106000001, 2024-09-13T06:39:42.058 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.008043204, 2024-09-13T06:39:42.058 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:42.058 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:42.058 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:42.058 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.058 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:42.058 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.009507+0000", 2024-09-13T06:39:42.058 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:42.058 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.058 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.059 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:42.059 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.009507+0000", 2024-09-13T06:39:42.059 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:42.059 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.059 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.059 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:42.059 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.009506+0000", 2024-09-13T06:39:42.059 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.999999 2024-09-13T06:39:42.059 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.059 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.059 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:42.059 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.009516+0000", 2024-09-13T06:39:42.059 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.91e-06 2024-09-13T06:39:42.059 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.060 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.060 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:42.060 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.009530+0000", 2024-09-13T06:39:42.060 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4406999999999999e-05 2024-09-13T06:39:42.060 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.060 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.060 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:42.060 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.009542+0000", 2024-09-13T06:39:42.060 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1549000000000001e-05 2024-09-13T06:39:42.060 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.060 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.060 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:42.060 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.015501+0000", 2024-09-13T06:39:42.061 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0059592409999999997 2024-09-13T06:39:42.061 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.061 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.061 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:42.061 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.015558+0000", 2024-09-13T06:39:42.061 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.6496000000000003e-05 2024-09-13T06:39:42.061 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.061 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.061 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:39:42.061 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.017526+0000", 2024-09-13T06:39:42.061 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0019678249999999999 2024-09-13T06:39:42.061 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.061 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.062 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:42.062 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.017550+0000", 2024-09-13T06:39:42.062 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4769999999999998e-05 2024-09-13T06:39:42.062 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:42.062 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:42.062 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:42.062 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.062 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.062 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4154.0:140 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'98, mlcod=15'85)", 2024-09-13T06:39:42.062 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:12.009917+0000", 2024-09-13T06:39:42.062 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 30.006028136000001, 2024-09-13T06:39:42.062 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0085122300000000008, 2024-09-13T06:39:42.062 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:42.063 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:42.063 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:42.063 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.063 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:42.063 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.009917+0000", 2024-09-13T06:39:42.063 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:42.063 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.063 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.063 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:42.063 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.009917+0000", 2024-09-13T06:39:42.063 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:42.063 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.063 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.064 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:42.064 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.009916+0000", 2024-09-13T06:39:42.064 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.999999 2024-09-13T06:39:42.064 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.064 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.064 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:42.064 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.010084+0000", 2024-09-13T06:39:42.064 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000168419 2024-09-13T06:39:42.064 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.064 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.064 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:42.064 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.010112+0000", 2024-09-13T06:39:42.064 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.7773e-05 2024-09-13T06:39:42.065 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.065 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.065 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:42.065 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.010128+0000", 2024-09-13T06:39:42.065 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.605e-05 2024-09-13T06:39:42.065 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.065 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.065 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:42.065 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.016320+0000", 2024-09-13T06:39:42.065 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0061919690000000003 2024-09-13T06:39:42.065 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.065 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.065 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:42.066 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.016349+0000", 2024-09-13T06:39:42.066 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.8629e-05 2024-09-13T06:39:42.066 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.066 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.066 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:39:42.066 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.018351+0000", 2024-09-13T06:39:42.066 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.002001985 2024-09-13T06:39:42.066 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.066 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.066 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:42.066 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.018429+0000", 2024-09-13T06:39:42.066 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.8589000000000003e-05 2024-09-13T06:39:42.066 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:42.067 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:42.067 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:42.067 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.067 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.067 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4154.0:141 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'99, mlcod=15'85)", 2024-09-13T06:39:42.067 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:12.010422+0000", 2024-09-13T06:39:42.067 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 30.005522834000001, 2024-09-13T06:39:42.067 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0086202829999999994, 2024-09-13T06:39:42.067 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:42.067 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:42.067 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:42.067 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.067 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:42.067 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.010422+0000", 2024-09-13T06:39:42.067 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:42.068 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.068 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.068 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:42.068 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.010422+0000", 2024-09-13T06:39:42.068 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:42.068 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.068 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.068 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:42.068 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.010421+0000", 2024-09-13T06:39:42.068 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999986 2024-09-13T06:39:42.068 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.068 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.068 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:42.069 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.010434+0000", 2024-09-13T06:39:42.069 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2840000000000001e-05 2024-09-13T06:39:42.069 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.069 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.069 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:42.069 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.010457+0000", 2024-09-13T06:39:42.069 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3543000000000001e-05 2024-09-13T06:39:42.069 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.069 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.069 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:42.069 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.010474+0000", 2024-09-13T06:39:42.069 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6804e-05 2024-09-13T06:39:42.069 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.069 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.070 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:42.070 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.017610+0000", 2024-09-13T06:39:42.070 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0071355710000000003 2024-09-13T06:39:42.070 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.070 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.070 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:42.070 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.017663+0000", 2024-09-13T06:39:42.070 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3593e-05 2024-09-13T06:39:42.070 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.070 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.070 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:39:42.070 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.018991+0000", 2024-09-13T06:39:42.070 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00132777 2024-09-13T06:39:42.071 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.071 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.071 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:42.071 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:12.019043+0000", 2024-09-13T06:39:42.071 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.1431999999999998e-05 2024-09-13T06:39:42.071 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:42.071 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:42.071 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:42.071 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.071 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.071 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:11 3.1f 3:fa654f18:::rbd_id.image_client.0:head [create,call rbd.set_id in=9b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-09-13T06:39:42.071 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:29.377720+0000", 2024-09-13T06:39:42.071 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 12.638224920999999, 2024-09-13T06:39:42.071 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0087536650000000008, 2024-09-13T06:39:42.071 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:42.072 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:42.072 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:39:42.072 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:39:42.072 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:42.072 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 11 2024-09-13T06:39:42.072 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.072 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:42.072 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.072 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:42.072 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:29.377720+0000", 2024-09-13T06:39:42.072 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:42.072 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.072 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.072 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:42.073 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:29.377720+0000", 2024-09-13T06:39:42.073 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:42.073 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.073 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.073 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:42.073 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:29.377718+0000", 2024-09-13T06:39:42.073 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999981 2024-09-13T06:39:42.073 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.073 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.073 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:42.073 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:29.377731+0000", 2024-09-13T06:39:42.073 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2507000000000001e-05 2024-09-13T06:39:42.074 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.074 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.074 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:42.074 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:29.377751+0000", 2024-09-13T06:39:42.074 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0716999999999998e-05 2024-09-13T06:39:42.074 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.074 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.074 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:42.074 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:29.377764+0000", 2024-09-13T06:39:42.074 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2378000000000001e-05 2024-09-13T06:39:42.074 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.074 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.074 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:42.074 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:29.377842+0000", 2024-09-13T06:39:42.075 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.7687000000000003e-05 2024-09-13T06:39:42.075 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.075 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.075 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op must wait for map", 2024-09-13T06:39:42.075 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:29.377850+0000", 2024-09-13T06:39:42.075 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.7029999999999995e-06 2024-09-13T06:39:42.075 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.075 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.075 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:42.075 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:29.380699+0000", 2024-09-13T06:39:42.075 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0028488099999999998 2024-09-13T06:39:42.075 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.075 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.075 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:42.076 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:29.380901+0000", 2024-09-13T06:39:42.076 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000202067 2024-09-13T06:39:42.076 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.076 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.076 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 5", 2024-09-13T06:39:42.076 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:29.381223+0000", 2024-09-13T06:39:42.076 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00032151199999999998 2024-09-13T06:39:42.076 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.076 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.076 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:39:42.076 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:29.382479+0000", 2024-09-13T06:39:42.076 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00125636 2024-09-13T06:39:42.076 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.076 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.076 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-09-13T06:39:42.077 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:29.386337+0000", 2024-09-13T06:39:42.077 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0038575739999999999 2024-09-13T06:39:42.077 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.077 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.077 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:39:42.077 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:29.386408+0000", 2024-09-13T06:39:42.077 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.1019000000000006e-05 2024-09-13T06:39:42.077 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.077 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.077 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:42.077 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:29.386474+0000", 2024-09-13T06:39:42.077 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.6407000000000003e-05 2024-09-13T06:39:42.077 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:42.077 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:42.077 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:42.078 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.078 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.078 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:439 3.12 3:4f94b9f1:::rbd_data.112173e2f1b7.000000000000001a:4 [sparse-read 3407872~56768 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e26)", 2024-09-13T06:39:42.078 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:33.431637+0000", 2024-09-13T06:39:42.078 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 8.5843081469999998, 2024-09-13T06:39:42.078 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0067283320000000001, 2024-09-13T06:39:42.078 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:42.078 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:39:42.078 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:39:42.078 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:39:42.078 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:42.078 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 439 2024-09-13T06:39:42.078 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.079 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:42.079 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.079 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:42.079 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:33.431637+0000", 2024-09-13T06:39:42.079 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:42.079 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.079 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.079 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:42.079 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:33.431637+0000", 2024-09-13T06:39:42.079 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:42.079 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.079 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.079 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:42.079 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:33.431636+0000", 2024-09-13T06:39:42.080 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:39:42.080 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.080 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.080 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:42.080 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:33.431640+0000", 2024-09-13T06:39:42.080 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.1429999999999998e-06 2024-09-13T06:39:42.080 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.080 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.080 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:42.080 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:33.431648+0000", 2024-09-13T06:39:42.080 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.4600000000000003e-06 2024-09-13T06:39:42.080 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.080 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.080 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:42.081 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:33.431657+0000", 2024-09-13T06:39:42.081 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.6200000000000005e-06 2024-09-13T06:39:42.081 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.081 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.081 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:42.081 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:33.437518+0000", 2024-09-13T06:39:42.081 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0058614050000000001 2024-09-13T06:39:42.081 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.081 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.081 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:42.081 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:33.437654+0000", 2024-09-13T06:39:42.081 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000136062 2024-09-13T06:39:42.081 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.081 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.082 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:42.082 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:33.438365+0000", 2024-09-13T06:39:42.082 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000711245 2024-09-13T06:39:42.082 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:42.082 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:42.082 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:42.082 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.082 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.082 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:542 3.12 3:4e3d9f36:::rbd_data.11214e25756e.000000000000000e:head [delete] snapc 5=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-09-13T06:39:42.082 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:34.609286+0000", 2024-09-13T06:39:42.082 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 7.4066594749999997, 2024-09-13T06:39:42.082 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0059084430000000002, 2024-09-13T06:39:42.082 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:42.082 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:42.083 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:39:42.083 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:39:42.083 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:42.083 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 542 2024-09-13T06:39:42.083 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.083 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:42.083 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.083 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:42.083 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:34.609286+0000", 2024-09-13T06:39:42.083 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:42.083 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.083 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.083 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:42.084 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:34.609286+0000", 2024-09-13T06:39:42.084 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:42.084 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.084 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.084 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:42.084 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:34.609285+0000", 2024-09-13T06:39:42.084 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:39:42.084 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.084 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.084 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:42.084 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:34.609290+0000", 2024-09-13T06:39:42.084 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6369999999999998e-06 2024-09-13T06:39:42.084 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.085 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.085 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:42.085 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:34.609300+0000", 2024-09-13T06:39:42.085 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0165e-05 2024-09-13T06:39:42.085 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.085 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.085 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:42.085 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:34.609308+0000", 2024-09-13T06:39:42.085 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.4339999999999992e-06 2024-09-13T06:39:42.085 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.085 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.085 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:42.085 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:34.609358+0000", 2024-09-13T06:39:42.086 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9793999999999998e-05 2024-09-13T06:39:42.086 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.086 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.086 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:42.086 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:34.609439+0000", 2024-09-13T06:39:42.086 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.1306999999999999e-05 2024-09-13T06:39:42.086 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.086 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.086 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 7", 2024-09-13T06:39:42.086 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:34.609589+0000", 2024-09-13T06:39:42.086 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00014956099999999999 2024-09-13T06:39:42.086 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.087 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.087 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-09-13T06:39:42.087 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:34.610669+0000", 2024-09-13T06:39:42.087 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00107957 2024-09-13T06:39:42.087 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.087 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.087 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:39:42.087 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:34.615144+0000", 2024-09-13T06:39:42.087 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0044750909999999996 2024-09-13T06:39:42.087 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.087 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.087 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:39:42.087 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:34.615170+0000", 2024-09-13T06:39:42.088 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6584000000000002e-05 2024-09-13T06:39:42.088 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.088 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.088 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:42.088 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:34.615194+0000", 2024-09-13T06:39:42.088 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3947e-05 2024-09-13T06:39:42.088 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:42.088 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:42.088 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:42.088 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.088 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.088 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:2383 3.1 3:861707a4:::rbd_data.11212429e5ad.00000000000000bd:head [delete] snapc 8=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-13T06:39:42.089 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:38.855337+0000", 2024-09-13T06:39:42.089 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 3.160608613, 2024-09-13T06:39:42.089 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0070546530000000001, 2024-09-13T06:39:42.089 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:42.089 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:39:42.089 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:39:42.089 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:39:42.089 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:42.089 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 2383 2024-09-13T06:39:42.089 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.089 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:42.089 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.089 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:42.090 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.855337+0000", 2024-09-13T06:39:42.090 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:42.090 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.090 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.090 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:42.090 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.855337+0000", 2024-09-13T06:39:42.090 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:42.090 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.090 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.090 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:42.090 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.855335+0000", 2024-09-13T06:39:42.090 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999986 2024-09-13T06:39:42.090 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.090 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.091 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:42.091 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.855341+0000", 2024-09-13T06:39:42.091 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9429999999999997e-06 2024-09-13T06:39:42.091 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.091 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.091 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:42.091 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.855360+0000", 2024-09-13T06:39:42.091 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9015999999999999e-05 2024-09-13T06:39:42.091 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.091 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.091 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:42.091 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.855374+0000", 2024-09-13T06:39:42.092 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3607e-05 2024-09-13T06:39:42.092 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.092 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.092 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:42.092 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.855451+0000", 2024-09-13T06:39:42.092 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.7006000000000001e-05 2024-09-13T06:39:42.092 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.092 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.092 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:42.092 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.855629+0000", 2024-09-13T06:39:42.092 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000178192 2024-09-13T06:39:42.092 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.092 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.093 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:42.093 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.862391+0000", 2024-09-13T06:39:42.093 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0067621319999999997 2024-09-13T06:39:42.093 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:42.093 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:42.093 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:42.093 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.093 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.093 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:2391 3.17 3:ef90b167:::rbd_data.11212429e5ad.000000000000010b:head [delete] snapc 8=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-13T06:39:42.093 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:38.858451+0000", 2024-09-13T06:39:42.093 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 3.1574947149999999, 2024-09-13T06:39:42.093 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0092325280000000003, 2024-09-13T06:39:42.093 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:42.094 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:42.094 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:39:42.094 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:39:42.094 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:42.094 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 2391 2024-09-13T06:39:42.094 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.094 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:42.094 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.094 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:42.094 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.858451+0000", 2024-09-13T06:39:42.094 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:42.094 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.094 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.094 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:42.095 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.858451+0000", 2024-09-13T06:39:42.095 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:42.095 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.095 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.095 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:42.095 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.858449+0000", 2024-09-13T06:39:42.095 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999986 2024-09-13T06:39:42.095 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.095 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.095 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:42.095 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.858456+0000", 2024-09-13T06:39:42.095 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.1659999999999997e-06 2024-09-13T06:39:42.095 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.095 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.096 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:42.096 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.858475+0000", 2024-09-13T06:39:42.096 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8365000000000001e-05 2024-09-13T06:39:42.096 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.096 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.096 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:42.096 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.858485+0000", 2024-09-13T06:39:42.096 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0473e-05 2024-09-13T06:39:42.096 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.096 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.096 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:42.096 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.858603+0000", 2024-09-13T06:39:42.096 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000117706 2024-09-13T06:39:42.096 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.097 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.097 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:42.097 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.858837+0000", 2024-09-13T06:39:42.097 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000233938 2024-09-13T06:39:42.097 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.097 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.097 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 5", 2024-09-13T06:39:42.097 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.859160+0000", 2024-09-13T06:39:42.097 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00032297400000000001 2024-09-13T06:39:42.097 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.097 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.097 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-09-13T06:39:42.098 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.862548+0000", 2024-09-13T06:39:42.098 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00338829 2024-09-13T06:39:42.098 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.098 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.098 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:39:42.098 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.867544+0000", 2024-09-13T06:39:42.098 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.004995897 2024-09-13T06:39:42.098 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.098 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.098 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:39:42.098 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.867618+0000", 2024-09-13T06:39:42.098 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3904000000000003e-05 2024-09-13T06:39:42.098 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.099 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.099 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:42.099 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.867683+0000", 2024-09-13T06:39:42.099 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.5108000000000001e-05 2024-09-13T06:39:42.099 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:42.099 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:42.099 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:42.099 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.099 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.099 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:2392 3.1f 3:fdec2555:::rbd_data.11212429e5ad.000000000000010c:head [delete] snapc 8=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-13T06:39:42.099 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:38.860079+0000", 2024-09-13T06:39:42.099 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 3.1558666290000001, 2024-09-13T06:39:42.099 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0076027949999999999, 2024-09-13T06:39:42.099 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:42.099 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:42.100 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:39:42.100 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:39:42.100 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:42.100 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 2392 2024-09-13T06:39:42.100 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.100 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:42.100 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.100 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:42.100 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.860079+0000", 2024-09-13T06:39:42.100 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:42.100 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.101 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.101 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:42.101 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.860079+0000", 2024-09-13T06:39:42.101 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:42.101 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.101 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.101 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:42.101 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.860077+0000", 2024-09-13T06:39:42.101 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999986 2024-09-13T06:39:42.101 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.101 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.101 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:42.101 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.860085+0000", 2024-09-13T06:39:42.102 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.7500000000000003e-06 2024-09-13T06:39:42.102 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.102 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.102 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:42.102 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.860101+0000", 2024-09-13T06:39:42.102 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5641000000000002e-05 2024-09-13T06:39:42.102 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.102 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.102 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:42.103 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.860109+0000", 2024-09-13T06:39:42.103 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.1179999999999992e-06 2024-09-13T06:39:42.103 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.103 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.103 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:42.103 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.860162+0000", 2024-09-13T06:39:42.103 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3010000000000002e-05 2024-09-13T06:39:42.103 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.103 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.103 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:42.103 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.860262+0000", 2024-09-13T06:39:42.103 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00010066200000000001 2024-09-13T06:39:42.103 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.104 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.104 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 5", 2024-09-13T06:39:42.104 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.860354+0000", 2024-09-13T06:39:42.104 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.1576999999999994e-05 2024-09-13T06:39:42.104 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.104 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.104 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-09-13T06:39:42.104 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.865193+0000", 2024-09-13T06:39:42.104 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0048387109999999999 2024-09-13T06:39:42.104 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.104 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.104 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:39:42.104 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.867557+0000", 2024-09-13T06:39:42.105 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0023642899999999998 2024-09-13T06:39:42.105 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.105 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.105 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:39:42.105 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.867623+0000", 2024-09-13T06:39:42.105 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.5889000000000006e-05 2024-09-13T06:39:42.105 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.105 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.105 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:42.105 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.867681+0000", 2024-09-13T06:39:42.105 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8523000000000002e-05 2024-09-13T06:39:42.105 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:42.105 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:42.106 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:42.106 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.106 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.106 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:2395 3.1 3:81e6c980:::rbd_data.11212429e5ad.000000000000022c:head [delete] snapc 8=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-13T06:39:42.106 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:38.860554+0000", 2024-09-13T06:39:42.106 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 3.1553913109999998, 2024-09-13T06:39:42.106 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0071345360000000003, 2024-09-13T06:39:42.106 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:42.106 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:42.107 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:39:42.107 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:39:42.107 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:42.107 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 2395 2024-09-13T06:39:42.107 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.107 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:42.107 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.107 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:42.107 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.860554+0000", 2024-09-13T06:39:42.107 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:42.107 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.107 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.107 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:42.108 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.860554+0000", 2024-09-13T06:39:42.108 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:42.108 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.108 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.108 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:42.108 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.860553+0000", 2024-09-13T06:39:42.108 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.999999 2024-09-13T06:39:42.108 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.108 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.108 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:42.108 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.860559+0000", 2024-09-13T06:39:42.108 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.4439999999999996e-06 2024-09-13T06:39:42.108 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.109 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.109 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:42.109 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.860575+0000", 2024-09-13T06:39:42.109 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5600999999999999e-05 2024-09-13T06:39:42.109 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.109 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.109 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:42.109 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.860583+0000", 2024-09-13T06:39:42.109 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.3180000000000007e-06 2024-09-13T06:39:42.109 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.109 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.109 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:42.109 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.860696+0000", 2024-09-13T06:39:42.110 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000112952 2024-09-13T06:39:42.110 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.110 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.110 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:42.110 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.860802+0000", 2024-09-13T06:39:42.110 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000105869 2024-09-13T06:39:42.110 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.110 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.110 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 4", 2024-09-13T06:39:42.110 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.860902+0000", 2024-09-13T06:39:42.110 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.9908000000000006e-05 2024-09-13T06:39:42.110 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.110 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.111 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-09-13T06:39:42.111 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.865267+0000", 2024-09-13T06:39:42.111 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0043653570000000003 2024-09-13T06:39:42.111 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.111 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.111 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:39:42.111 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.867592+0000", 2024-09-13T06:39:42.111 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0023245150000000001 2024-09-13T06:39:42.111 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.111 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.111 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:39:42.111 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.867635+0000", 2024-09-13T06:39:42.111 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.3409999999999999e-05 2024-09-13T06:39:42.112 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.112 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.112 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:42.112 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.867688+0000", 2024-09-13T06:39:42.112 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3276000000000003e-05 2024-09-13T06:39:42.112 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:42.112 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:42.112 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:42.112 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:42.112 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:42.112 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:39:42.114 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-13T06:39:42.114 INFO:teuthology.orchestra.run.smithi081.stdout:osd.7: {} 2024-09-13T06:39:42.115 INFO:teuthology.orchestra.run.smithi081.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-13T06:39:42.116 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:39:42.115+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:39:42.215 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:39:42.218+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:39:42.281 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:39:42.281 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-13T06:39:42.281 INFO:teuthology.orchestra.run.smithi081.stdout: "num_ops": 0 2024-09-13T06:39:42.282 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:39:42.296 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-13T06:39:42.339 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:39:42.343+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:39:42.412 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:39:42.412 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-13T06:39:42.412 INFO:teuthology.orchestra.run.smithi081.stdout: "complaint_time": 30, 2024-09-13T06:39:42.413 INFO:teuthology.orchestra.run.smithi081.stdout: "num_blocked_ops": 0 2024-09-13T06:39:42.413 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:39:42.417 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:39:42.418+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:39:42.426 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-13T06:39:42.453 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-13T06:39:42.453 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-13T06:39:42.453 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T06:39:42.518 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:39:42.519+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:39:42.567 INFO:teuthology.orchestra.run.smithi081.stdout:checking clone #1, image image_client.0-clone1 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent2 2024-09-13T06:39:42.619 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:39:42.619 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 20, 2024-09-13T06:39:42.619 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 600, 2024-09-13T06:39:42.619 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [ 2024-09-13T06:39:42.619 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.619 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:2402 3.0 3:07d66135:::rbd_object_map.11212429e5ad:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-13T06:39:42.619 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:38.870979+0000", 2024-09-13T06:39:42.620 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 3.7507729799999998, 2024-09-13T06:39:42.620 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0082207960000000007, 2024-09-13T06:39:42.620 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:42.620 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:42.620 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:39:42.620 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:39:42.620 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:42.620 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 2402 2024-09-13T06:39:42.620 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.620 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:42.621 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.621 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:42.621 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.870979+0000", 2024-09-13T06:39:42.621 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:42.621 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.621 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.621 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:42.621 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.870979+0000", 2024-09-13T06:39:42.621 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:42.621 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.621 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.621 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:42.622 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.870978+0000", 2024-09-13T06:39:42.622 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999986 2024-09-13T06:39:42.622 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.622 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.622 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:42.622 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.870988+0000", 2024-09-13T06:39:42.622 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.9369999999999999e-06 2024-09-13T06:39:42.622 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.622 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.622 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:42.623 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.871010+0000", 2024-09-13T06:39:42.623 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2359000000000001e-05 2024-09-13T06:39:42.623 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.623 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.623 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:42.623 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.871028+0000", 2024-09-13T06:39:42.623 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8023e-05 2024-09-13T06:39:42.623 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.623 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.623 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:42.623 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.871545+0000", 2024-09-13T06:39:42.623 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000516801 2024-09-13T06:39:42.623 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.623 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.624 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:42.624 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.871661+0000", 2024-09-13T06:39:42.624 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000115474 2024-09-13T06:39:42.624 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.624 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.624 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 2", 2024-09-13T06:39:42.624 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.872091+0000", 2024-09-13T06:39:42.624 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000430197 2024-09-13T06:39:42.624 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.625 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.625 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-09-13T06:39:42.625 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.875941+0000", 2024-09-13T06:39:42.625 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.003850619 2024-09-13T06:39:42.625 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.625 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.626 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:39:42.626 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.878969+0000", 2024-09-13T06:39:42.626 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0030271719999999998 2024-09-13T06:39:42.626 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.626 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.626 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:39:42.626 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.879097+0000", 2024-09-13T06:39:42.626 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00012866900000000001 2024-09-13T06:39:42.626 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.626 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.626 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:42.627 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.879200+0000", 2024-09-13T06:39:42.627 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00010286200000000001 2024-09-13T06:39:42.627 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:42.627 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:42.627 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:42.627 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.627 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.627 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:2403 3.0 3:07d66135:::rbd_object_map.11212429e5ad:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-13T06:39:42.627 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:38.871050+0000", 2024-09-13T06:39:42.628 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 3.750702601, 2024-09-13T06:39:42.628 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.016612471, 2024-09-13T06:39:42.628 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:42.628 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:42.628 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:39:42.628 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:39:42.628 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:42.628 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 2403 2024-09-13T06:39:42.629 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.629 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:42.629 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.629 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:42.629 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.871050+0000", 2024-09-13T06:39:42.629 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:42.629 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.629 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.629 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:42.629 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.871050+0000", 2024-09-13T06:39:42.629 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:42.629 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.629 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.630 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:42.630 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.871048+0000", 2024-09-13T06:39:42.630 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.999999 2024-09-13T06:39:42.630 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.630 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.630 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:42.630 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.871059+0000", 2024-09-13T06:39:42.630 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0817e-05 2024-09-13T06:39:42.630 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.630 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.630 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:42.630 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.871077+0000", 2024-09-13T06:39:42.630 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7753000000000001e-05 2024-09-13T06:39:42.631 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.631 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.631 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:42.631 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.871090+0000", 2024-09-13T06:39:42.631 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3380000000000001e-05 2024-09-13T06:39:42.631 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.631 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.631 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:42.631 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.872519+0000", 2024-09-13T06:39:42.631 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0014282609999999999 2024-09-13T06:39:42.631 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.631 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.631 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:42.631 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.872634+0000", 2024-09-13T06:39:42.632 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00011548999999999999 2024-09-13T06:39:42.632 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.632 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.632 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 2", 2024-09-13T06:39:42.632 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.873183+0000", 2024-09-13T06:39:42.632 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00054875400000000004 2024-09-13T06:39:42.632 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.632 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.632 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:39:42.633 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.883887+0000", 2024-09-13T06:39:42.633 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.010704173000000001 2024-09-13T06:39:42.633 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.633 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.633 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-09-13T06:39:42.633 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.887543+0000", 2024-09-13T06:39:42.633 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0036558749999999998 2024-09-13T06:39:42.634 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.634 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.634 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:39:42.634 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.887581+0000", 2024-09-13T06:39:42.634 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.8287000000000001e-05 2024-09-13T06:39:42.634 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.634 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.635 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:42.635 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.887662+0000", 2024-09-13T06:39:42.635 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.0871000000000005e-05 2024-09-13T06:39:42.635 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:42.635 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:42.635 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:42.635 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.636 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.636 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:2404 3.0 3:07d66135:::rbd_object_map.11212429e5ad:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-13T06:39:42.636 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:38.871106+0000", 2024-09-13T06:39:42.636 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 3.750646331, 2024-09-13T06:39:42.636 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.016696478000000001, 2024-09-13T06:39:42.636 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:42.636 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:42.636 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:39:42.636 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:39:42.636 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:42.636 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 2404 2024-09-13T06:39:42.636 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.637 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:42.637 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.637 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:42.637 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.871106+0000", 2024-09-13T06:39:42.637 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:42.637 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.637 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.637 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:42.637 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.871106+0000", 2024-09-13T06:39:42.637 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:42.637 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.638 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.638 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:42.638 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.871105+0000", 2024-09-13T06:39:42.638 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.999999 2024-09-13T06:39:42.638 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.638 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.638 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:42.638 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.871112+0000", 2024-09-13T06:39:42.638 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.973e-06 2024-09-13T06:39:42.638 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.638 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.638 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:42.638 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.871128+0000", 2024-09-13T06:39:42.639 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6697e-05 2024-09-13T06:39:42.639 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.639 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.639 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:42.639 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.871141+0000", 2024-09-13T06:39:42.639 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2849e-05 2024-09-13T06:39:42.639 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.639 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.639 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:42.639 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.873783+0000", 2024-09-13T06:39:42.639 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0026413539999999998 2024-09-13T06:39:42.639 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.640 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.640 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:42.640 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.873905+0000", 2024-09-13T06:39:42.640 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00012281 2024-09-13T06:39:42.640 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.640 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.640 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 2", 2024-09-13T06:39:42.640 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.874183+0000", 2024-09-13T06:39:42.640 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00027736599999999997 2024-09-13T06:39:42.640 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.640 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.640 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:39:42.640 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.883993+0000", 2024-09-13T06:39:42.641 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0098103210000000003 2024-09-13T06:39:42.641 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.641 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.641 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-09-13T06:39:42.641 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.887687+0000", 2024-09-13T06:39:42.641 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.003694279 2024-09-13T06:39:42.641 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.641 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.641 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:39:42.641 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.887750+0000", 2024-09-13T06:39:42.641 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.2755000000000005e-05 2024-09-13T06:39:42.641 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.642 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.642 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:42.642 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.887802+0000", 2024-09-13T06:39:42.642 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2181000000000001e-05 2024-09-13T06:39:42.642 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:42.642 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:42.642 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:42.642 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.642 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.642 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:2405 3.0 3:07d66135:::rbd_object_map.11212429e5ad:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-13T06:39:42.642 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:38.871158+0000", 2024-09-13T06:39:42.642 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 3.750594575, 2024-09-13T06:39:42.642 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.016762175000000001, 2024-09-13T06:39:42.643 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:42.643 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:42.643 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:39:42.643 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:39:42.643 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:42.643 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 2405 2024-09-13T06:39:42.643 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.643 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:42.643 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.643 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:42.643 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.871158+0000", 2024-09-13T06:39:42.643 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:42.643 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.644 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.644 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:42.644 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.871158+0000", 2024-09-13T06:39:42.644 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:42.644 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.644 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.644 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:42.644 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.871157+0000", 2024-09-13T06:39:42.644 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.999999 2024-09-13T06:39:42.644 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.644 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.644 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:42.645 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.871164+0000", 2024-09-13T06:39:42.645 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.9199999999999998e-06 2024-09-13T06:39:42.645 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.645 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.645 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:42.645 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.871180+0000", 2024-09-13T06:39:42.645 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6759999999999999e-05 2024-09-13T06:39:42.645 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.645 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.646 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:42.646 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.871193+0000", 2024-09-13T06:39:42.646 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2713e-05 2024-09-13T06:39:42.646 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.646 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.646 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:42.646 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.874566+0000", 2024-09-13T06:39:42.646 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0033733320000000002 2024-09-13T06:39:42.646 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.646 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.646 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:42.646 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.874694+0000", 2024-09-13T06:39:42.646 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00012748600000000001 2024-09-13T06:39:42.647 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.647 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.647 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 2", 2024-09-13T06:39:42.647 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.875228+0000", 2024-09-13T06:39:42.647 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00053444699999999996 2024-09-13T06:39:42.647 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.647 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.647 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:39:42.647 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.884098+0000", 2024-09-13T06:39:42.647 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0088695319999999994 2024-09-13T06:39:42.647 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.647 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.647 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-09-13T06:39:42.647 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.887816+0000", 2024-09-13T06:39:42.648 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.003718009 2024-09-13T06:39:42.648 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.648 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.648 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:39:42.648 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.887870+0000", 2024-09-13T06:39:42.648 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.4119000000000001e-05 2024-09-13T06:39:42.648 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.648 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.648 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:42.648 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.887920+0000", 2024-09-13T06:39:42.648 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9843999999999999e-05 2024-09-13T06:39:42.649 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:42.649 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:42.649 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:42.649 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.649 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.649 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:2406 3.0 3:07d66135:::rbd_object_map.11212429e5ad:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-13T06:39:42.649 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:38.871205+0000", 2024-09-13T06:39:42.649 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 3.7505474649999999, 2024-09-13T06:39:42.649 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.018104353, 2024-09-13T06:39:42.649 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:42.649 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:42.650 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:39:42.650 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:39:42.650 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:42.650 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 2406 2024-09-13T06:39:42.650 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.650 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:42.650 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.650 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:42.650 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.871205+0000", 2024-09-13T06:39:42.650 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:42.650 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.650 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.651 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:42.651 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.871205+0000", 2024-09-13T06:39:42.651 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:42.651 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.651 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.651 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:42.651 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.871204+0000", 2024-09-13T06:39:42.651 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.999999 2024-09-13T06:39:42.651 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.651 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.651 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:42.651 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.871211+0000", 2024-09-13T06:39:42.652 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.866e-06 2024-09-13T06:39:42.652 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.652 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.652 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:42.652 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.871228+0000", 2024-09-13T06:39:42.653 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7044000000000001e-05 2024-09-13T06:39:42.653 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.653 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.653 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:42.653 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.871241+0000", 2024-09-13T06:39:42.653 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3159000000000001e-05 2024-09-13T06:39:42.653 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.653 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.653 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:42.653 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.876131+0000", 2024-09-13T06:39:42.654 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0048900829999999999 2024-09-13T06:39:42.654 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.654 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.654 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:42.654 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.876327+0000", 2024-09-13T06:39:42.654 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00019568 2024-09-13T06:39:42.654 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.654 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.654 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 2", 2024-09-13T06:39:42.654 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.876723+0000", 2024-09-13T06:39:42.654 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00039652200000000001 2024-09-13T06:39:42.654 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.655 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.655 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:39:42.655 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.884194+0000", 2024-09-13T06:39:42.655 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0074708190000000001 2024-09-13T06:39:42.655 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.655 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.655 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-09-13T06:39:42.655 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.889181+0000", 2024-09-13T06:39:42.655 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0049872880000000003 2024-09-13T06:39:42.656 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.656 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.656 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:39:42.656 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.889248+0000", 2024-09-13T06:39:42.656 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.6402999999999994e-05 2024-09-13T06:39:42.656 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.657 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.657 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:42.657 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.889309+0000", 2024-09-13T06:39:42.657 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.1499000000000002e-05 2024-09-13T06:39:42.657 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:42.657 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:42.657 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:42.657 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.657 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.658 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:2407 3.0 3:07d66135:::rbd_object_map.11212429e5ad:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-13T06:39:42.658 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:38.871253+0000", 2024-09-13T06:39:42.658 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 3.750499289, 2024-09-13T06:39:42.658 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.018156648000000001, 2024-09-13T06:39:42.658 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:42.658 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:42.658 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:39:42.659 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:39:42.659 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:42.659 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 2407 2024-09-13T06:39:42.659 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.659 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:42.659 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.659 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:42.659 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.871253+0000", 2024-09-13T06:39:42.659 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:42.659 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.660 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.660 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:42.660 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.871253+0000", 2024-09-13T06:39:42.660 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:42.660 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.660 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.660 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:42.660 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.871252+0000", 2024-09-13T06:39:42.660 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.999999 2024-09-13T06:39:42.660 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.660 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.661 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:42.661 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.871259+0000", 2024-09-13T06:39:42.661 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.8499999999999996e-06 2024-09-13T06:39:42.661 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.661 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.661 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:42.661 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.871277+0000", 2024-09-13T06:39:42.661 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8306999999999999e-05 2024-09-13T06:39:42.662 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.662 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.662 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:42.662 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.871290+0000", 2024-09-13T06:39:42.662 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2622999999999999e-05 2024-09-13T06:39:42.662 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.662 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.662 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:42.662 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.877676+0000", 2024-09-13T06:39:42.662 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0063860430000000001 2024-09-13T06:39:42.663 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.663 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.663 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:42.663 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.877814+0000", 2024-09-13T06:39:42.663 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00013874499999999999 2024-09-13T06:39:42.663 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.663 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.663 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 2", 2024-09-13T06:39:42.663 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.878299+0000", 2024-09-13T06:39:42.663 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00048456900000000002 2024-09-13T06:39:42.663 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.664 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.664 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:39:42.664 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.884304+0000", 2024-09-13T06:39:42.664 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0060048660000000002 2024-09-13T06:39:42.664 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.664 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.664 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-09-13T06:39:42.664 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.889324+0000", 2024-09-13T06:39:42.664 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0050200009999999996 2024-09-13T06:39:42.664 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.664 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.664 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:39:42.665 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.889380+0000", 2024-09-13T06:39:42.665 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.6029999999999997e-05 2024-09-13T06:39:42.665 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.665 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.665 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:42.665 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.889410+0000", 2024-09-13T06:39:42.665 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9668000000000001e-05 2024-09-13T06:39:42.665 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:42.665 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:42.665 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:42.665 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.665 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.665 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:2408 3.0 3:07d66135:::rbd_object_map.11212429e5ad:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-13T06:39:42.665 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:38.871302+0000", 2024-09-13T06:39:42.666 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 3.7504507, 2024-09-13T06:39:42.666 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.018195006999999999, 2024-09-13T06:39:42.666 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:42.666 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:42.666 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:39:42.666 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:39:42.666 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:42.666 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 2408 2024-09-13T06:39:42.666 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.667 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:42.667 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.667 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:42.667 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.871302+0000", 2024-09-13T06:39:42.667 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:42.667 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.667 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.667 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:42.667 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.871302+0000", 2024-09-13T06:39:42.667 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:42.667 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.667 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.667 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:42.668 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.871301+0000", 2024-09-13T06:39:42.668 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.999999 2024-09-13T06:39:42.668 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.668 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.668 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:42.668 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.871308+0000", 2024-09-13T06:39:42.668 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.1840000000000002e-06 2024-09-13T06:39:42.668 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.668 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.668 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:42.668 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.871324+0000", 2024-09-13T06:39:42.668 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6549999999999999e-05 2024-09-13T06:39:42.669 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.669 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.669 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:42.669 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.871337+0000", 2024-09-13T06:39:42.669 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2753e-05 2024-09-13T06:39:42.669 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.669 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.670 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:42.670 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.879310+0000", 2024-09-13T06:39:42.670 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0079725249999999994 2024-09-13T06:39:42.670 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.670 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.670 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:42.670 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.879539+0000", 2024-09-13T06:39:42.670 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000229779 2024-09-13T06:39:42.670 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.670 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.670 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 2", 2024-09-13T06:39:42.670 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.880678+0000", 2024-09-13T06:39:42.670 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.001138977 2024-09-13T06:39:42.670 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.671 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.671 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:39:42.671 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.888002+0000", 2024-09-13T06:39:42.671 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0073241460000000001 2024-09-13T06:39:42.671 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.671 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.671 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-09-13T06:39:42.671 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.889421+0000", 2024-09-13T06:39:42.671 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.001418863 2024-09-13T06:39:42.671 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.671 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.671 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:39:42.671 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.889471+0000", 2024-09-13T06:39:42.671 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0127000000000003e-05 2024-09-13T06:39:42.672 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.672 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.672 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:42.672 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.889497+0000", 2024-09-13T06:39:42.672 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5063e-05 2024-09-13T06:39:42.672 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:42.672 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:42.672 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:42.672 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.672 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.672 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:2409 3.0 3:07d66135:::rbd_object_map.11212429e5ad:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-13T06:39:42.673 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:38.871348+0000", 2024-09-13T06:39:42.673 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 3.7504038529999999, 2024-09-13T06:39:42.673 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.019629904, 2024-09-13T06:39:42.673 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:42.673 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:42.673 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:39:42.673 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:39:42.673 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:42.673 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 2409 2024-09-13T06:39:42.673 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.673 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:42.673 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.674 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:42.674 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.871348+0000", 2024-09-13T06:39:42.674 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:42.674 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.674 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.674 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:42.674 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.871348+0000", 2024-09-13T06:39:42.674 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:42.674 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.674 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.674 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:42.674 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.871347+0000", 2024-09-13T06:39:42.674 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.999999 2024-09-13T06:39:42.675 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.675 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.675 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:42.675 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.871373+0000", 2024-09-13T06:39:42.675 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5398999999999999e-05 2024-09-13T06:39:42.675 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.675 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.675 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:42.675 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.871390+0000", 2024-09-13T06:39:42.675 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6759999999999999e-05 2024-09-13T06:39:42.675 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.675 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.676 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:42.676 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.871403+0000", 2024-09-13T06:39:42.676 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3573e-05 2024-09-13T06:39:42.676 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.676 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.676 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:42.676 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.881553+0000", 2024-09-13T06:39:42.676 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.010150219 2024-09-13T06:39:42.676 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.676 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.676 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:42.676 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.881776+0000", 2024-09-13T06:39:42.676 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00022227099999999999 2024-09-13T06:39:42.677 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.677 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.677 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 2", 2024-09-13T06:39:42.677 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.882853+0000", 2024-09-13T06:39:42.677 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0010777149999999999 2024-09-13T06:39:42.677 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.677 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.677 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-09-13T06:39:42.677 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.889507+0000", 2024-09-13T06:39:42.678 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0066536390000000003 2024-09-13T06:39:42.678 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.678 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.678 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:39:42.678 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.890884+0000", 2024-09-13T06:39:42.678 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0013771549999999999 2024-09-13T06:39:42.679 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.679 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.679 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:39:42.679 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.890932+0000", 2024-09-13T06:39:42.679 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.8183000000000003e-05 2024-09-13T06:39:42.679 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.679 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.680 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:42.680 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.890978+0000", 2024-09-13T06:39:42.680 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6003e-05 2024-09-13T06:39:42.680 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:42.680 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:42.680 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:42.680 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.680 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.681 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:2410 3.0 3:07d66135:::rbd_object_map.11212429e5ad:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-13T06:39:42.681 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:38.871418+0000", 2024-09-13T06:39:42.681 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 3.7503339809999998, 2024-09-13T06:39:42.681 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.020651638, 2024-09-13T06:39:42.681 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:42.681 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:42.681 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:39:42.681 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:39:42.681 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:42.681 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 2410 2024-09-13T06:39:42.681 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.681 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:42.681 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.681 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:42.682 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.871418+0000", 2024-09-13T06:39:42.682 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:42.682 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.682 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.682 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:42.682 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.871418+0000", 2024-09-13T06:39:42.682 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:42.682 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.682 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.682 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:42.682 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.871417+0000", 2024-09-13T06:39:42.682 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.999999 2024-09-13T06:39:42.682 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.683 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.683 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:42.683 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.871424+0000", 2024-09-13T06:39:42.683 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.0570000000000004e-06 2024-09-13T06:39:42.683 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.683 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.683 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:42.683 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.871442+0000", 2024-09-13T06:39:42.683 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7612999999999999e-05 2024-09-13T06:39:42.683 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.683 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.683 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:42.684 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.871455+0000", 2024-09-13T06:39:42.684 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2887e-05 2024-09-13T06:39:42.684 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.684 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.684 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:42.685 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.884381+0000", 2024-09-13T06:39:42.685 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.012926076 2024-09-13T06:39:42.685 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.685 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.686 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:42.686 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.884711+0000", 2024-09-13T06:39:42.686 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00033045500000000001 2024-09-13T06:39:42.686 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.686 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.686 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 2", 2024-09-13T06:39:42.687 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.885814+0000", 2024-09-13T06:39:42.687 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0011031540000000001 2024-09-13T06:39:42.687 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.687 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.687 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-09-13T06:39:42.687 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.889517+0000", 2024-09-13T06:39:42.687 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0037020690000000001 2024-09-13T06:39:42.687 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.687 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.687 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:39:42.688 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.891944+0000", 2024-09-13T06:39:42.688 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0024278490000000002 2024-09-13T06:39:42.688 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.688 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.688 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:39:42.688 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.892015+0000", 2024-09-13T06:39:42.688 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.0389999999999995e-05 2024-09-13T06:39:42.688 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.688 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.688 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:42.689 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.892070+0000", 2024-09-13T06:39:42.689 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.5121000000000003e-05 2024-09-13T06:39:42.689 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:42.689 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:42.689 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:42.689 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.689 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.689 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:2411 3.0 3:07d66135:::rbd_object_map.11212429e5ad:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-13T06:39:42.689 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:38.871467+0000", 2024-09-13T06:39:42.689 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 3.7502852239999998, 2024-09-13T06:39:42.689 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.021894663000000002, 2024-09-13T06:39:42.689 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:42.689 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:42.690 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:39:42.690 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:39:42.690 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:42.690 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 2411 2024-09-13T06:39:42.690 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.690 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:42.690 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.690 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:42.690 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.871467+0000", 2024-09-13T06:39:42.690 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:42.690 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.690 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.690 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:42.691 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.871467+0000", 2024-09-13T06:39:42.691 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:42.691 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.691 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.691 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:42.691 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.871466+0000", 2024-09-13T06:39:42.691 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.999999 2024-09-13T06:39:42.691 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.691 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.691 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:42.691 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.871509+0000", 2024-09-13T06:39:42.691 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.3368999999999998e-05 2024-09-13T06:39:42.691 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.692 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.692 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:42.692 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.871530+0000", 2024-09-13T06:39:42.692 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0259999999999999e-05 2024-09-13T06:39:42.692 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.692 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.692 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:42.692 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.871544+0000", 2024-09-13T06:39:42.692 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4173e-05 2024-09-13T06:39:42.692 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.692 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.692 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:42.692 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.886836+0000", 2024-09-13T06:39:42.693 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.015292441 2024-09-13T06:39:42.693 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.693 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.693 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:42.693 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.886909+0000", 2024-09-13T06:39:42.693 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.2341000000000004e-05 2024-09-13T06:39:42.693 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.693 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.693 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 2", 2024-09-13T06:39:42.693 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.887189+0000", 2024-09-13T06:39:42.693 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00027997500000000002 2024-09-13T06:39:42.693 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.693 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.694 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-09-13T06:39:42.694 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.891891+0000", 2024-09-13T06:39:42.694 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0047020450000000002 2024-09-13T06:39:42.694 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.694 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.695 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:39:42.695 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.893254+0000", 2024-09-13T06:39:42.695 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0013632469999999999 2024-09-13T06:39:42.695 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.695 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.695 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:39:42.695 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.893314+0000", 2024-09-13T06:39:42.695 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0173999999999997e-05 2024-09-13T06:39:42.695 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.695 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.695 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:42.695 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.893362+0000", 2024-09-13T06:39:42.695 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7598000000000001e-05 2024-09-13T06:39:42.696 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:42.696 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:42.696 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:42.696 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.696 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.696 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:2412 3.0 3:07d66135:::rbd_object_map.11212429e5ad:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-13T06:39:42.696 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:38.871557+0000", 2024-09-13T06:39:42.696 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 3.7501952320000003, 2024-09-13T06:39:42.696 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.022525739999999999, 2024-09-13T06:39:42.697 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:42.697 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:42.697 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:39:42.697 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:39:42.697 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:42.697 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 2412 2024-09-13T06:39:42.697 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.697 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:42.697 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.697 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:42.697 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.871557+0000", 2024-09-13T06:39:42.697 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:42.697 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.698 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.698 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:42.698 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.871557+0000", 2024-09-13T06:39:42.698 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:42.698 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.698 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.698 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:42.698 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.871556+0000", 2024-09-13T06:39:42.698 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999986 2024-09-13T06:39:42.698 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.698 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.698 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:42.698 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.871563+0000", 2024-09-13T06:39:42.699 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.1369999999999996e-06 2024-09-13T06:39:42.699 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.699 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.699 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:42.699 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.871579+0000", 2024-09-13T06:39:42.699 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6263e-05 2024-09-13T06:39:42.699 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.699 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.699 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:42.699 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.871593+0000", 2024-09-13T06:39:42.699 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3477e-05 2024-09-13T06:39:42.699 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.699 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.699 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:42.700 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.888057+0000", 2024-09-13T06:39:42.700 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.016463872000000001 2024-09-13T06:39:42.700 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.700 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.700 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:42.700 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.888147+0000", 2024-09-13T06:39:42.700 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.0525000000000005e-05 2024-09-13T06:39:42.700 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.700 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.700 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 2", 2024-09-13T06:39:42.700 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.888693+0000", 2024-09-13T06:39:42.700 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00054564000000000001 2024-09-13T06:39:42.700 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.701 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.701 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:39:42.701 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.893476+0000", 2024-09-13T06:39:42.701 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0047834440000000004 2024-09-13T06:39:42.701 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.701 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.701 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-09-13T06:39:42.701 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.893507+0000", 2024-09-13T06:39:42.701 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.1069999999999999e-05 2024-09-13T06:39:42.701 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.701 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.701 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:39:42.701 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.893971+0000", 2024-09-13T06:39:42.702 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00046344000000000002 2024-09-13T06:39:42.702 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.702 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.702 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:42.702 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.894083+0000", 2024-09-13T06:39:42.702 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00011208499999999999 2024-09-13T06:39:42.702 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:42.702 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:42.702 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:42.702 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.702 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.702 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:2413 3.0 3:07d66135:::rbd_object_map.11212429e5ad:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-13T06:39:42.703 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:38.871605+0000", 2024-09-13T06:39:42.703 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 3.7501472420000002, 2024-09-13T06:39:42.703 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.024408125999999999, 2024-09-13T06:39:42.703 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:42.703 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:42.703 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:39:42.703 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:39:42.703 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:42.703 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 2413 2024-09-13T06:39:42.703 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.703 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:42.703 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.703 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:42.703 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.871605+0000", 2024-09-13T06:39:42.704 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:42.704 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.704 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.704 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:42.704 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.871605+0000", 2024-09-13T06:39:42.704 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:42.704 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.704 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.704 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:42.704 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.871604+0000", 2024-09-13T06:39:42.704 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.999999 2024-09-13T06:39:42.704 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.704 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.705 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:42.705 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.871611+0000", 2024-09-13T06:39:42.705 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.9430000000000003e-06 2024-09-13T06:39:42.705 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.705 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.705 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:42.705 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.871628+0000", 2024-09-13T06:39:42.705 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7183000000000001e-05 2024-09-13T06:39:42.705 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.705 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.705 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:42.705 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.871642+0000", 2024-09-13T06:39:42.705 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3487e-05 2024-09-13T06:39:42.706 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.706 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.706 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:42.706 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.889555+0000", 2024-09-13T06:39:42.706 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017913710999999999 2024-09-13T06:39:42.706 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.706 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.706 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:42.706 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.889643+0000", 2024-09-13T06:39:42.706 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.7185e-05 2024-09-13T06:39:42.706 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.707 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.707 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 2", 2024-09-13T06:39:42.707 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.889927+0000", 2024-09-13T06:39:42.707 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00028462099999999998 2024-09-13T06:39:42.707 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.707 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.707 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-09-13T06:39:42.707 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.894113+0000", 2024-09-13T06:39:42.707 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0041857589999999998 2024-09-13T06:39:42.707 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.707 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.707 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:39:42.708 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.895768+0000", 2024-09-13T06:39:42.708 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.001655396 2024-09-13T06:39:42.708 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.708 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.708 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:39:42.708 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.895896+0000", 2024-09-13T06:39:42.708 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00012808200000000001 2024-09-13T06:39:42.708 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.709 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.709 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:42.709 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.896013+0000", 2024-09-13T06:39:42.709 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000116742 2024-09-13T06:39:42.709 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:42.709 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:42.709 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:42.709 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.709 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.709 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:2414 3.0 3:07d66135:::rbd_object_map.11212429e5ad:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-13T06:39:42.709 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:38.871653+0000", 2024-09-13T06:39:42.709 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 3.7500991890000002, 2024-09-13T06:39:42.709 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.026426291000000001, 2024-09-13T06:39:42.710 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:42.710 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:42.710 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:39:42.710 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:39:42.710 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:42.710 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 2414 2024-09-13T06:39:42.710 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.710 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:42.710 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.710 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:42.710 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.871653+0000", 2024-09-13T06:39:42.710 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:42.710 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.710 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.711 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:42.711 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.871653+0000", 2024-09-13T06:39:42.711 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:42.711 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.711 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.711 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:42.711 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.871652+0000", 2024-09-13T06:39:42.711 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.999999 2024-09-13T06:39:42.711 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.711 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.711 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:42.711 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.871659+0000", 2024-09-13T06:39:42.711 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.7390000000000002e-06 2024-09-13T06:39:42.712 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.712 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.712 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:42.712 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.871676+0000", 2024-09-13T06:39:42.712 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7357e-05 2024-09-13T06:39:42.712 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.712 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.712 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:42.712 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.871691+0000", 2024-09-13T06:39:42.712 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4363e-05 2024-09-13T06:39:42.712 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.712 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.712 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:42.712 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.891028+0000", 2024-09-13T06:39:42.713 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.019337844 2024-09-13T06:39:42.713 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.713 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.713 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:42.713 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.891143+0000", 2024-09-13T06:39:42.713 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000114642 2024-09-13T06:39:42.713 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.713 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.713 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 2", 2024-09-13T06:39:42.713 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.891495+0000", 2024-09-13T06:39:42.713 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00035152600000000001 2024-09-13T06:39:42.713 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.713 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.714 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:39:42.714 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.896098+0000", 2024-09-13T06:39:42.714 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0046033369999999999 2024-09-13T06:39:42.714 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.714 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.714 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-09-13T06:39:42.714 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.897911+0000", 2024-09-13T06:39:42.714 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0018129019999999999 2024-09-13T06:39:42.714 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.714 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.714 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:39:42.714 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.897978+0000", 2024-09-13T06:39:42.714 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.7445000000000002e-05 2024-09-13T06:39:42.714 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.715 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.715 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:42.715 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.898079+0000", 2024-09-13T06:39:42.715 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000101139 2024-09-13T06:39:42.715 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:42.715 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:42.715 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:42.715 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.715 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.715 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:2428 3.0 3:07d66135:::rbd_object_map.11212429e5ad:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-13T06:39:42.715 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:38.895774+0000", 2024-09-13T06:39:42.715 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 3.7259779829999999, 2024-09-13T06:39:42.715 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0068296049999999999, 2024-09-13T06:39:42.715 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:42.716 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:42.716 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:39:42.716 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:39:42.716 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:42.716 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 2428 2024-09-13T06:39:42.716 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.716 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:42.716 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.716 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:42.716 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.895774+0000", 2024-09-13T06:39:42.716 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:42.716 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.716 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.716 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:42.717 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.895774+0000", 2024-09-13T06:39:42.717 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:42.717 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.717 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.717 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:42.717 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.895773+0000", 2024-09-13T06:39:42.717 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999981 2024-09-13T06:39:42.717 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.717 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.717 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:42.718 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.895783+0000", 2024-09-13T06:39:42.718 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0144e-05 2024-09-13T06:39:42.718 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.718 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.718 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:42.718 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.895801+0000", 2024-09-13T06:39:42.718 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8572000000000001e-05 2024-09-13T06:39:42.718 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.718 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.718 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:42.718 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.895813+0000", 2024-09-13T06:39:42.719 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2054e-05 2024-09-13T06:39:42.719 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.719 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.719 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:42.719 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.896177+0000", 2024-09-13T06:39:42.719 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000364123 2024-09-13T06:39:42.719 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.719 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.719 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:42.719 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.896551+0000", 2024-09-13T06:39:42.719 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00037318300000000002 2024-09-13T06:39:42.719 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.719 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.719 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 2", 2024-09-13T06:39:42.720 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.897308+0000", 2024-09-13T06:39:42.720 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00075731400000000003 2024-09-13T06:39:42.720 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.720 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.720 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:39:42.720 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.900021+0000", 2024-09-13T06:39:42.720 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.002713558 2024-09-13T06:39:42.720 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.720 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.720 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-09-13T06:39:42.720 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.902510+0000", 2024-09-13T06:39:42.720 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0024889360000000002 2024-09-13T06:39:42.720 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.721 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.721 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:39:42.721 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.902549+0000", 2024-09-13T06:39:42.721 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.8936000000000001e-05 2024-09-13T06:39:42.721 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.721 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.721 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:42.721 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.902604+0000", 2024-09-13T06:39:42.721 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.4537999999999999e-05 2024-09-13T06:39:42.721 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:42.721 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:42.721 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:42.721 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.721 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.722 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:2431 3.0 3:07d66135:::rbd_object_map.11212429e5ad:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-13T06:39:42.722 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:38.898553+0000", 2024-09-13T06:39:42.722 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 3.7231994660000001, 2024-09-13T06:39:42.722 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0059042859999999999, 2024-09-13T06:39:42.722 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:42.722 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:42.722 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:39:42.722 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:39:42.722 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:42.722 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 2431 2024-09-13T06:39:42.722 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.722 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:42.722 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.723 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:42.723 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.898553+0000", 2024-09-13T06:39:42.723 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:42.723 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.723 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.723 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:42.723 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.898553+0000", 2024-09-13T06:39:42.723 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:42.723 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.723 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.723 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:42.723 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.898551+0000", 2024-09-13T06:39:42.723 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999981 2024-09-13T06:39:42.723 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.724 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.724 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:42.724 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.898560+0000", 2024-09-13T06:39:42.724 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.2900000000000008e-06 2024-09-13T06:39:42.724 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.724 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.724 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:42.724 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.898585+0000", 2024-09-13T06:39:42.724 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5134999999999999e-05 2024-09-13T06:39:42.724 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.725 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.725 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:42.725 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.898595+0000", 2024-09-13T06:39:42.725 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0373999999999999e-05 2024-09-13T06:39:42.725 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.725 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.725 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:42.725 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.898772+0000", 2024-09-13T06:39:42.725 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000176875 2024-09-13T06:39:42.725 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.725 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.725 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:42.725 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.898953+0000", 2024-09-13T06:39:42.726 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00018034400000000001 2024-09-13T06:39:42.726 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.726 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.726 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 2", 2024-09-13T06:39:42.726 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.899412+0000", 2024-09-13T06:39:42.726 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00045919100000000002 2024-09-13T06:39:42.726 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.726 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.726 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:39:42.726 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.902656+0000", 2024-09-13T06:39:42.726 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0032438639999999999 2024-09-13T06:39:42.726 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.726 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.726 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-09-13T06:39:42.727 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.904253+0000", 2024-09-13T06:39:42.727 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0015977159999999999 2024-09-13T06:39:42.727 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.727 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.727 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:39:42.727 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.904358+0000", 2024-09-13T06:39:42.727 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000104944 2024-09-13T06:39:42.727 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.727 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.727 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:42.727 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.904457+0000", 2024-09-13T06:39:42.727 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.8634000000000005e-05 2024-09-13T06:39:42.728 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:42.728 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:42.728 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:42.728 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.728 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.728 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "pg_update_log_missing(3.8 epoch 31/21 rep_tid 123 entries 31'5 (0'0) error 3:157e7bb9:::rbd_data.11212429e5ad.0000000000000029:head by client.4385.0:2430 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 31'3)", 2024-09-13T06:39:42.728 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:38.898734+0000", 2024-09-13T06:39:42.728 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 3.7230183779999999, 2024-09-13T06:39:42.728 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0054973180000000002, 2024-09-13T06:39:42.728 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:42.728 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:39:42.728 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:42.729 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.729 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:42.729 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.898734+0000", 2024-09-13T06:39:42.729 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:42.729 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.729 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.729 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:42.729 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.898734+0000", 2024-09-13T06:39:42.729 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:42.729 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.729 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.729 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:42.729 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.898733+0000", 2024-09-13T06:39:42.729 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.999999 2024-09-13T06:39:42.730 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.730 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.730 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:42.730 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.898744+0000", 2024-09-13T06:39:42.730 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1527e-05 2024-09-13T06:39:42.730 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.730 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.730 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:42.730 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.898771+0000", 2024-09-13T06:39:42.730 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6855e-05 2024-09-13T06:39:42.730 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.730 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.730 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:42.730 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.898792+0000", 2024-09-13T06:39:42.731 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0539000000000001e-05 2024-09-13T06:39:42.731 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.731 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.731 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:42.731 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.898938+0000", 2024-09-13T06:39:42.731 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00014596999999999999 2024-09-13T06:39:42.731 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.731 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.731 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:42.731 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.904231+0000", 2024-09-13T06:39:42.731 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0052935259999999998 2024-09-13T06:39:42.731 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:42.731 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:42.732 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:42.732 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.732 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.732 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:2432 3.0 3:07d66135:::rbd_object_map.11212429e5ad:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-13T06:39:42.732 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:38.899068+0000", 2024-09-13T06:39:42.732 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 3.7226844789999998, 2024-09-13T06:39:42.732 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0056374529999999997, 2024-09-13T06:39:42.732 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:42.732 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:42.732 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:39:42.732 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:39:42.732 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:42.732 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 2432 2024-09-13T06:39:42.732 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.733 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:42.733 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.733 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:42.733 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.899068+0000", 2024-09-13T06:39:42.733 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:42.733 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.733 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.733 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:42.733 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.899068+0000", 2024-09-13T06:39:42.733 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:42.733 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.734 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.734 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:42.734 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.899067+0000", 2024-09-13T06:39:42.734 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.999999 2024-09-13T06:39:42.734 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.734 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.734 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:42.734 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.899073+0000", 2024-09-13T06:39:42.734 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9089999999999997e-06 2024-09-13T06:39:42.734 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.734 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.735 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:42.735 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.899083+0000", 2024-09-13T06:39:42.735 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0458999999999999e-05 2024-09-13T06:39:42.735 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.735 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.735 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:42.735 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.899090+0000", 2024-09-13T06:39:42.735 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.9480000000000002e-06 2024-09-13T06:39:42.735 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.735 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.735 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:42.735 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.900077+0000", 2024-09-13T06:39:42.735 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00098700400000000009 2024-09-13T06:39:42.735 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.736 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.736 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:42.736 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.900145+0000", 2024-09-13T06:39:42.736 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.8224000000000003e-05 2024-09-13T06:39:42.736 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.736 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.736 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 2", 2024-09-13T06:39:42.736 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.900417+0000", 2024-09-13T06:39:42.736 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00027116299999999999 2024-09-13T06:39:42.736 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.736 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.736 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-09-13T06:39:42.736 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.904478+0000", 2024-09-13T06:39:42.737 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0040610630000000002 2024-09-13T06:39:42.737 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.737 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.737 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:39:42.737 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.904560+0000", 2024-09-13T06:39:42.737 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.2392000000000007e-05 2024-09-13T06:39:42.737 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.737 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.737 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:39:42.737 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.904638+0000", 2024-09-13T06:39:42.737 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.7572999999999997e-05 2024-09-13T06:39:42.737 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.737 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.737 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:42.738 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.904705+0000", 2024-09-13T06:39:42.738 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.7590999999999997e-05 2024-09-13T06:39:42.738 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:42.738 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:42.738 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:42.738 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.738 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.738 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:2433 3.0 3:07d66135:::rbd_object_map.11212429e5ad:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-13T06:39:42.738 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:38.899172+0000", 2024-09-13T06:39:42.738 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 3.7225803179999999, 2024-09-13T06:39:42.738 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0080424510000000008, 2024-09-13T06:39:42.739 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:42.739 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:42.739 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:39:42.739 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:39:42.739 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:42.739 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 2433 2024-09-13T06:39:42.739 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.739 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:42.739 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.739 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:42.739 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.899172+0000", 2024-09-13T06:39:42.740 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:42.740 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.740 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.740 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:42.740 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.899172+0000", 2024-09-13T06:39:42.740 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:42.740 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.740 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.740 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:42.740 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.899171+0000", 2024-09-13T06:39:42.740 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999986 2024-09-13T06:39:42.740 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.740 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.741 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:42.741 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.899179+0000", 2024-09-13T06:39:42.741 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.8220000000000007e-06 2024-09-13T06:39:42.741 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.741 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.741 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:42.741 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.899192+0000", 2024-09-13T06:39:42.741 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3484e-05 2024-09-13T06:39:42.741 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.741 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.741 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:42.741 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.899202+0000", 2024-09-13T06:39:42.741 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.5729999999999997e-06 2024-09-13T06:39:42.741 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.742 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.742 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:42.742 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.900815+0000", 2024-09-13T06:39:42.742 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.001613457 2024-09-13T06:39:42.742 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.742 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.742 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:42.742 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.900888+0000", 2024-09-13T06:39:42.742 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.2566999999999998e-05 2024-09-13T06:39:42.742 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.742 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.742 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 2", 2024-09-13T06:39:42.742 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.901265+0000", 2024-09-13T06:39:42.742 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000377544 2024-09-13T06:39:42.743 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.743 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.743 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-09-13T06:39:42.743 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.906846+0000", 2024-09-13T06:39:42.743 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0055812680000000003 2024-09-13T06:39:42.743 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.743 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.743 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:39:42.743 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.907136+0000", 2024-09-13T06:39:42.743 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000289673 2024-09-13T06:39:42.743 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.743 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.743 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:39:42.743 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.907180+0000", 2024-09-13T06:39:42.744 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4240999999999999e-05 2024-09-13T06:39:42.744 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.744 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.744 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:42.744 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.907214+0000", 2024-09-13T06:39:42.744 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.4065e-05 2024-09-13T06:39:42.745 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:42.745 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:42.745 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:42.745 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.745 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.745 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:2434 3.0 3:07d66135:::rbd_object_map.11212429e5ad:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-13T06:39:42.745 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:38.899380+0000", 2024-09-13T06:39:42.745 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 3.722372021, 2024-09-13T06:39:42.745 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0079672360000000008, 2024-09-13T06:39:42.745 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:42.746 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:42.746 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:39:42.746 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:39:42.746 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:42.746 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 2434 2024-09-13T06:39:42.746 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.746 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:42.746 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.746 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:42.746 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.899380+0000", 2024-09-13T06:39:42.746 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:42.746 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.746 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.746 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:42.747 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.899380+0000", 2024-09-13T06:39:42.747 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:42.747 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.747 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.747 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:42.747 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.899379+0000", 2024-09-13T06:39:42.747 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999986 2024-09-13T06:39:42.747 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.747 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.747 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:42.747 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.899391+0000", 2024-09-13T06:39:42.747 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1652e-05 2024-09-13T06:39:42.747 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.747 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.748 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:42.748 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.899405+0000", 2024-09-13T06:39:42.748 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3913999999999999e-05 2024-09-13T06:39:42.748 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.748 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.748 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:42.748 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.899416+0000", 2024-09-13T06:39:42.748 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1076e-05 2024-09-13T06:39:42.748 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.748 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.748 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:42.749 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.901824+0000", 2024-09-13T06:39:42.749 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0024086490000000001 2024-09-13T06:39:42.749 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.749 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.749 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:42.749 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.901892+0000", 2024-09-13T06:39:42.749 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.7955999999999998e-05 2024-09-13T06:39:42.750 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.750 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.750 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 2", 2024-09-13T06:39:42.750 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.902185+0000", 2024-09-13T06:39:42.750 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00029283400000000001 2024-09-13T06:39:42.750 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.750 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.750 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-09-13T06:39:42.751 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.906864+0000", 2024-09-13T06:39:42.751 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0046788039999999999 2024-09-13T06:39:42.751 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.751 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.751 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:39:42.751 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.907253+0000", 2024-09-13T06:39:42.751 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00038920399999999998 2024-09-13T06:39:42.752 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.752 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.752 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:39:42.752 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.907303+0000", 2024-09-13T06:39:42.752 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0373e-05 2024-09-13T06:39:42.752 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.753 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.753 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:42.753 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.907347+0000", 2024-09-13T06:39:42.753 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.3989000000000002e-05 2024-09-13T06:39:42.753 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:42.753 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:42.753 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:42.754 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.754 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.754 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:2694 3.0 3:02013738:::rbd_data.11212429e5ad.0000000000000148:head [delete] snapc 8=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-13T06:39:42.754 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:39.430844+0000", 2024-09-13T06:39:42.754 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 3.190908479, 2024-09-13T06:39:42.755 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0065738339999999998, 2024-09-13T06:39:42.755 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:42.755 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:42.755 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:39:42.755 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:39:42.755 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:42.756 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 2694 2024-09-13T06:39:42.756 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.756 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:42.756 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.756 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:42.756 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.430844+0000", 2024-09-13T06:39:42.757 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:42.757 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.757 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.757 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:42.757 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.430844+0000", 2024-09-13T06:39:42.758 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:42.758 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.758 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.758 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:42.758 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.430843+0000", 2024-09-13T06:39:42.758 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.999999 2024-09-13T06:39:42.759 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.759 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.759 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:42.759 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.430861+0000", 2024-09-13T06:39:42.759 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7872000000000001e-05 2024-09-13T06:39:42.759 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.760 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.760 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:42.760 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.430874+0000", 2024-09-13T06:39:42.760 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2931999999999999e-05 2024-09-13T06:39:42.760 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.760 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.760 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:42.760 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.430881+0000", 2024-09-13T06:39:42.761 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3159999999999999e-06 2024-09-13T06:39:42.761 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.761 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.761 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:42.761 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.431286+0000", 2024-09-13T06:39:42.761 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00040501600000000001 2024-09-13T06:39:42.761 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.761 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.761 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:42.762 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.431388+0000", 2024-09-13T06:39:42.762 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000102303 2024-09-13T06:39:42.762 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.762 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.762 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 2", 2024-09-13T06:39:42.762 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.431494+0000", 2024-09-13T06:39:42.762 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00010579800000000001 2024-09-13T06:39:42.762 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.763 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.763 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:39:42.763 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.434739+0000", 2024-09-13T06:39:42.763 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.003244935 2024-09-13T06:39:42.763 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.763 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.763 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-09-13T06:39:42.763 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.437303+0000", 2024-09-13T06:39:42.764 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00256434 2024-09-13T06:39:42.764 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.764 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.764 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:39:42.764 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.437362+0000", 2024-09-13T06:39:42.764 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8341999999999998e-05 2024-09-13T06:39:42.765 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.765 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.765 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:42.765 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.437418+0000", 2024-09-13T06:39:42.765 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.5943999999999998e-05 2024-09-13T06:39:42.765 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:42.765 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:42.766 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:42.766 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:42.766 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:42.766 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:39:42.767 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:39:42.618+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:39:42.769 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-13T06:39:42.770 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:39:42.770 INFO:teuthology.orchestra.run.smithi081.stdout:369 read 0x15c4070 thru 0x15ce178 (0xa109 bytes) 2024-09-13T06:39:42.770 INFO:teuthology.orchestra.run.smithi081.stdout:371 write 0x2a52db thru 0x2b2972 (0xd698 bytes) 2024-09-13T06:39:42.771 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:39:42.770+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:39:42.773 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T06:39:42.774 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-09-13T06:39:42.778 INFO:teuthology.orchestra.run.smithi081.stdout:372 read 0x5199af thru 0x5272e4 (0xd936 bytes) 2024-09-13T06:39:42.791 INFO:teuthology.orchestra.run.smithi081.stdout:373 write 0x5aec64b thru 0x5af6aa7 (0xa45d bytes) 2024-09-13T06:39:42.797 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":43,"stamp":"2024-09-13T06:39:42.472866+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":15327681,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":4236,"num_read_kb":3294,"num_write":1142,"num_write_kb":6339,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":909,"ondisk_log_size":909,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":229384,"kb_used_data":4892,"kb_used_omap":12,"kb_used_meta":224243,"kb_avail":754745336,"statfs":{"total":773094113280,"available":772859224064,"internally_reserved":0,"allocated":5009408,"data_stored":3196167,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":229625400},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":11227614,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":2960,"num_read_kb":2187,"num_write":746,"num_write_kb":2969,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.939980"},"pg_stats":[{"pgid":"3.1f","version":"31'8","reported_seq":43,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-13T06:39:39.561668+0000","last_change":"2024-09-13T06:39:37.489615+0000","last_active":"2024-09-13T06:39:39.561668+0000","last_peered":"2024-09-13T06:39:39.561668+0000","last_clean":"2024-09-13T06:39:39.561668+0000","last_became_active":"2024-09-13T06:39:27.354227+0000","last_became_peered":"2024-09-13T06:39:27.354227+0000","last_unstale":"2024-09-13T06:39:39.561668+0000","last_undegraded":"2024-09-13T06:39:39.561668+0000","last_fullsized":"2024-09-13T06:39:39.561668+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:53:28.624134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058066900000000002,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":8,"num_read_kb":2,"num_write":5,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"5","length":"1"},{"start":"8","length":"1"}]},{"pgid":"3.1e","version":"31'108","reported_seq":141,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-13T06:39:39.141984+0000","last_change":"2024-09-13T06:39:37.432762+0000","last_active":"2024-09-13T06:39:39.141984+0000","last_peered":"2024-09-13T06:39:39.141984+0000","last_clean":"2024-09-13T06:39:39.141984+0000","last_became_active":"2024-09-13T06:39:27.359006+0000","last_became_peered":"2024-09-13T06:39:27.359006+0000","last_unstale":"2024-09-13T06:39:39.141984+0000","last_undegraded":"2024-09-13T06:39:39.141984+0000","last_fullsized":"2024-09-13T06:39:39.141984+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:02:45.825350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0024603910000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":489,"num_read_kb":390,"num_write":202,"num_write_kb":301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"5","length":"1"},{"start":"8","length":"1"}]},{"pgid":"3.1d","version":"31'7","reported_seq":173,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-13T06:39:38.896742+0000","last_change":"2024-09-13T06:39:37.431163+0000","last_active":"2024-09-13T06:39:38.896742+0000","last_peered":"2024-09-13T06:39:38.896742+0000","last_clean":"2024-09-13T06:39:38.896742+0000","last_became_active":"2024-09-13T06:39:27.369952+0000","last_became_peered":"2024-09-13T06:39:27.369952+0000","last_unstale":"2024-09-13T06:39:38.896742+0000","last_undegraded":"2024-09-13T06:39:38.896742+0000","last_fullsized":"2024-09-13T06:39:38.896742+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:37:26.971480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00059830799999999998,"stat_sum":{"num_bytes":1706592,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":135,"num_read_kb":43,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"5","length":"1"},{"start":"8","length":"1"}]},{"pgid":"3.1c","version":"31'11","reported_seq":42,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-13T06:39:39.431408+0000","last_change":"2024-09-13T06:39:37.430864+0000","last_active":"2024-09-13T06:39:39.431408+0000","last_peered":"2024-09-13T06:39:39.431408+0000","last_clean":"2024-09-13T06:39:39.431408+0000","last_became_active":"2024-09-13T06:39:27.369506+0000","last_became_peered":"2024-09-13T06:39:27.369506+0000","last_unstale":"2024-09-13T06:39:39.431408+0000","last_undegraded":"2024-09-13T06:39:39.431408+0000","last_fullsized":"2024-09-13T06:39:39.431408+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:22:58.980421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00040840800000000002,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":11,"num_write_kb":134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"5","length":"1"},{"start":"8","length":"1"}]},{"pgid":"3.1b","version":"31'8","reported_seq":39,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-13T06:39:39.567251+0000","last_change":"2024-09-13T06:39:37.489836+0000","last_active":"2024-09-13T06:39:39.567251+0000","last_peered":"2024-09-13T06:39:39.567251+0000","last_clean":"2024-09-13T06:39:39.567251+0000","last_became_active":"2024-09-13T06:39:27.371776+0000","last_became_peered":"2024-09-13T06:39:27.371776+0000","last_unstale":"2024-09-13T06:39:39.567251+0000","last_undegraded":"2024-09-13T06:39:39.567251+0000","last_fullsized":"2024-09-13T06:39:39.567251+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:25:31.311656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00062755299999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"5","length":"1"},{"start":"8","length":"1"}]},{"pgid":"3.1a","version":"31'11","reported_seq":125,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-13T06:39:39.668740+0000","last_change":"2024-09-13T06:39:37.441491+0000","last_active":"2024-09-13T06:39:39.668740+0000","last_peered":"2024-09-13T06:39:39.668740+0000","last_clean":"2024-09-13T06:39:39.668740+0000","last_became_active":"2024-09-13T06:39:27.369118+0000","last_became_peered":"2024-09-13T06:39:27.369118+0000","last_unstale":"2024-09-13T06:39:39.668740+0000","last_undegraded":"2024-09-13T06:39:39.668740+0000","last_fullsized":"2024-09-13T06:39:39.668740+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:26:10.974045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00066018100000000003,"stat_sum":{"num_bytes":196627,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":83,"num_read_kb":83,"num_write":9,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"5","length":"1"},{"start":"8","length":"1"}]},{"pgid":"3.19","version":"31'11","reported_seq":42,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-13T06:39:39.208162+0000","last_change":"2024-09-13T06:39:37.441909+0000","last_active":"2024-09-13T06:39:39.208162+0000","last_peered":"2024-09-13T06:39:39.208162+0000","last_clean":"2024-09-13T06:39:39.208162+0000","last_became_active":"2024-09-13T06:39:27.355617+0000","last_became_peered":"2024-09-13T06:39:27.355617+0000","last_unstale":"2024-09-13T06:39:39.208162+0000","last_undegraded":"2024-09-13T06:39:39.208162+0000","last_fullsized":"2024-09-13T06:39:39.208162+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:54:49.311122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00036320999999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"5","length":"1"},{"start":"8","length":"1"}]},{"pgid":"3.18","version":"31'4","reported_seq":35,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-13T06:39:39.497552+0000","last_change":"2024-09-13T06:39:37.430704+0000","last_active":"2024-09-13T06:39:39.497552+0000","last_peered":"2024-09-13T06:39:39.497552+0000","last_clean":"2024-09-13T06:39:39.497552+0000","last_became_active":"2024-09-13T06:39:27.349904+0000","last_became_peered":"2024-09-13T06:39:27.349904+0000","last_unstale":"2024-09-13T06:39:39.497552+0000","last_undegraded":"2024-09-13T06:39:39.497552+0000","last_fullsized":"2024-09-13T06:39:39.497552+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:27:19.676090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00073271499999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"5","length":"1"},{"start":"8","length":"1"}]},{"pgid":"3.17","version":"31'8","reported_seq":39,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-13T06:39:39.505769+0000","last_change":"2024-09-13T06:39:37.489970+0000","last_active":"2024-09-13T06:39:39.505769+0000","last_peered":"2024-09-13T06:39:39.505769+0000","last_clean":"2024-09-13T06:39:39.505769+0000","last_became_active":"2024-09-13T06:39:27.353665+0000","last_became_peered":"2024-09-13T06:39:27.353665+0000","last_unstale":"2024-09-13T06:39:39.505769+0000","last_undegraded":"2024-09-13T06:39:39.505769+0000","last_fullsized":"2024-09-13T06:39:39.505769+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:12:31.128336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00074144499999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"5","length":"1"},{"start":"8","length":"1"}]},{"pgid":"3.16","version":"31'16","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-13T06:39:39.403611+0000","last_change":"2024-09-13T06:39:37.430873+0000","last_active":"2024-09-13T06:39:39.403611+0000","last_peered":"2024-09-13T06:39:39.403611+0000","last_clean":"2024-09-13T06:39:39.403611+0000","last_became_active":"2024-09-13T06:39:27.376851+0000","last_became_peered":"2024-09-13T06:39:27.376851+0000","last_unstale":"2024-09-13T06:39:39.403611+0000","last_undegraded":"2024-09-13T06:39:39.403611+0000","last_fullsized":"2024-09-13T06:39:39.403611+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:59:49.761571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000376122,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":158,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"5","length":"1"},{"start":"8","length":"1"}]},{"pgid":"3.15","version":"31'14","reported_seq":42,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-13T06:39:39.432904+0000","last_change":"2024-09-13T06:39:38.440634+0000","last_active":"2024-09-13T06:39:39.432904+0000","last_peered":"2024-09-13T06:39:39.432904+0000","last_clean":"2024-09-13T06:39:39.432904+0000","last_became_active":"2024-09-13T06:39:38.439130+0000","last_became_peered":"2024-09-13T06:39:38.439130+0000","last_unstale":"2024-09-13T06:39:39.432904+0000","last_undegraded":"2024-09-13T06:39:39.432904+0000","last_fullsized":"2024-09-13T06:39:39.432904+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:48:14.709104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058325900000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":195,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"5","length":"1"},{"start":"8","length":"1"}]},{"pgid":"3.14","version":"31'69","reported_seq":102,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-13T06:39:39.336134+0000","last_change":"2024-09-13T06:39:37.441222+0000","last_active":"2024-09-13T06:39:39.336134+0000","last_peered":"2024-09-13T06:39:39.336134+0000","last_clean":"2024-09-13T06:39:39.336134+0000","last_became_active":"2024-09-13T06:39:27.372886+0000","last_became_peered":"2024-09-13T06:39:27.372886+0000","last_unstale":"2024-09-13T06:39:39.336134+0000","last_undegraded":"2024-09-13T06:39:39.336134+0000","last_fullsized":"2024-09-13T06:39:39.336134+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:11:57.872962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00056844800000000004,"stat_sum":{"num_bytes":172593,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":282,"num_read_kb":222,"num_write":100,"num_write_kb":175,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"5","length":"1"},{"start":"8","length":"1"}]},{"pgid":"2.7","version":"0'0","reported_seq":27,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-13T06:39:37.436731+0000","last_change":"2024-09-13T06:39:19.552942+0000","last_active":"2024-09-13T06:39:37.436731+0000","last_peered":"2024-09-13T06:39:37.436731+0000","last_clean":"2024-09-13T06:39:37.436731+0000","last_became_active":"2024-09-13T06:39:17.535105+0000","last_became_peered":"2024-09-13T06:39:17.535105+0000","last_unstale":"2024-09-13T06:39:37.436731+0000","last_undegraded":"2024-09-13T06:39:37.436731+0000","last_fullsized":"2024-09-13T06:39:37.436731+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_clean_scrub_stamp":"2024-09-13T06:39:16.508974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:41:19.857628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00080324699999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"31'7","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-13T06:39:39.188981+0000","last_change":"2024-09-13T06:39:37.489784+0000","last_active":"2024-09-13T06:39:39.188981+0000","last_peered":"2024-09-13T06:39:39.188981+0000","last_clean":"2024-09-13T06:39:39.188981+0000","last_became_active":"2024-09-13T06:39:27.352170+0000","last_became_peered":"2024-09-13T06:39:27.352170+0000","last_unstale":"2024-09-13T06:39:39.188981+0000","last_undegraded":"2024-09-13T06:39:39.188981+0000","last_fullsized":"2024-09-13T06:39:39.188981+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:54:20.547109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00069139699999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":99,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"5","length":"1"},{"start":"8","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":27,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-13T06:39:37.441575+0000","last_change":"2024-09-13T06:39:19.567201+0000","last_active":"2024-09-13T06:39:37.441575+0000","last_peered":"2024-09-13T06:39:37.441575+0000","last_clean":"2024-09-13T06:39:37.441575+0000","last_became_active":"2024-09-13T06:39:17.535411+0000","last_became_peered":"2024-09-13T06:39:17.535411+0000","last_unstale":"2024-09-13T06:39:37.441575+0000","last_undegraded":"2024-09-13T06:39:37.441575+0000","last_fullsized":"2024-09-13T06:39:37.441575+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_clean_scrub_stamp":"2024-09-13T06:39:16.508974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:44:11.617809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00097079800000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"31'8","reported_seq":39,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-13T06:39:39.625559+0000","last_change":"2024-09-13T06:39:37.430830+0000","last_active":"2024-09-13T06:39:39.625559+0000","last_peered":"2024-09-13T06:39:39.625559+0000","last_clean":"2024-09-13T06:39:39.625559+0000","last_became_active":"2024-09-13T06:39:27.375356+0000","last_became_peered":"2024-09-13T06:39:27.375356+0000","last_unstale":"2024-09-13T06:39:39.625559+0000","last_undegraded":"2024-09-13T06:39:39.625559+0000","last_fullsized":"2024-09-13T06:39:39.625559+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:56:26.610525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00064208799999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"5","length":"1"},{"start":"8","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":26,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-13T06:39:37.434924+0000","last_change":"2024-09-13T06:39:19.679994+0000","last_active":"2024-09-13T06:39:37.434924+0000","last_peered":"2024-09-13T06:39:37.434924+0000","last_clean":"2024-09-13T06:39:37.434924+0000","last_became_active":"2024-09-13T06:39:17.721806+0000","last_became_peered":"2024-09-13T06:39:17.721806+0000","last_unstale":"2024-09-13T06:39:37.434924+0000","last_undegraded":"2024-09-13T06:39:37.434924+0000","last_fullsized":"2024-09-13T06:39:37.434924+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_clean_scrub_stamp":"2024-09-13T06:39:16.508974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:34:49.893894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00064776899999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"31'6","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-13T06:39:39.242437+0000","last_change":"2024-09-13T06:39:37.441981+0000","last_active":"2024-09-13T06:39:39.242437+0000","last_peered":"2024-09-13T06:39:39.242437+0000","last_clean":"2024-09-13T06:39:39.242437+0000","last_became_active":"2024-09-13T06:39:27.452904+0000","last_became_peered":"2024-09-13T06:39:27.452904+0000","last_unstale":"2024-09-13T06:39:39.242437+0000","last_undegraded":"2024-09-13T06:39:39.242437+0000","last_fullsized":"2024-09-13T06:39:39.242437+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:44:12.553212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00044071399999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"5","length":"1"},{"start":"8","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":27,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-13T06:39:37.441775+0000","last_change":"2024-09-13T06:39:19.567043+0000","last_active":"2024-09-13T06:39:37.441775+0000","last_peered":"2024-09-13T06:39:37.441775+0000","last_clean":"2024-09-13T06:39:37.441775+0000","last_became_active":"2024-09-13T06:39:17.721287+0000","last_became_peered":"2024-09-13T06:39:17.721287+0000","last_unstale":"2024-09-13T06:39:37.441775+0000","last_undegraded":"2024-09-13T06:39:37.441775+0000","last_fullsized":"2024-09-13T06:39:37.441775+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_clean_scrub_stamp":"2024-09-13T06:39:16.508974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:14:34.131074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000890396,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"31'15","reported_seq":46,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-13T06:39:39.659313+0000","last_change":"2024-09-13T06:39:37.431568+0000","last_active":"2024-09-13T06:39:39.659313+0000","last_peered":"2024-09-13T06:39:39.659313+0000","last_clean":"2024-09-13T06:39:39.659313+0000","last_became_active":"2024-09-13T06:39:27.359760+0000","last_became_peered":"2024-09-13T06:39:27.359760+0000","last_unstale":"2024-09-13T06:39:39.659313+0000","last_undegraded":"2024-09-13T06:39:39.659313+0000","last_fullsized":"2024-09-13T06:39:39.659313+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:57:54.852468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000846505,"stat_sum":{"num_bytes":196608,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":151,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"5","length":"1"},{"start":"8","length":"1"}]},{"pgid":"3.3","version":"31'6","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-13T06:39:39.220775+0000","last_change":"2024-09-13T06:39:37.441471+0000","last_active":"2024-09-13T06:39:39.220775+0000","last_peered":"2024-09-13T06:39:39.220775+0000","last_clean":"2024-09-13T06:39:39.220775+0000","last_became_active":"2024-09-13T06:39:27.372337+0000","last_became_peered":"2024-09-13T06:39:27.372337+0000","last_unstale":"2024-09-13T06:39:39.220775+0000","last_undegraded":"2024-09-13T06:39:39.220775+0000","last_fullsized":"2024-09-13T06:39:39.220775+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:17:49.242059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060834300000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"5","length":"1"},{"start":"8","length":"1"}]},{"pgid":"2.2","version":"20'2","reported_seq":29,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-13T06:39:37.430388+0000","last_change":"2024-09-13T06:39:19.564386+0000","last_active":"2024-09-13T06:39:37.430388+0000","last_peered":"2024-09-13T06:39:37.430388+0000","last_clean":"2024-09-13T06:39:37.430388+0000","last_became_active":"2024-09-13T06:39:17.533677+0000","last_became_peered":"2024-09-13T06:39:17.533677+0000","last_unstale":"2024-09-13T06:39:37.430388+0000","last_undegraded":"2024-09-13T06:39:37.430388+0000","last_fullsized":"2024-09-13T06:39:37.430388+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_clean_scrub_stamp":"2024-09-13T06:39:16.508974+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:53:22.714840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001813556,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"31'166","reported_seq":207,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-13T06:39:39.695044+0000","last_change":"2024-09-13T06:39:37.443167+0000","last_active":"2024-09-13T06:39:39.695044+0000","last_peered":"2024-09-13T06:39:39.695044+0000","last_clean":"2024-09-13T06:39:39.695044+0000","last_became_active":"2024-09-13T06:39:27.453029+0000","last_became_peered":"2024-09-13T06:39:27.453029+0000","last_unstale":"2024-09-13T06:39:39.695044+0000","last_undegraded":"2024-09-13T06:39:39.695044+0000","last_fullsized":"2024-09-13T06:39:39.695044+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":166,"log_dups_size":0,"ondisk_log_size":166,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:30:11.714805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001423948,"stat_sum":{"num_bytes":98,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":806,"num_read_kb":646,"num_write":275,"num_write_kb":359,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"5","length":"1"},{"start":"8","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":27,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-13T06:39:37.429632+0000","last_change":"2024-09-13T06:39:20.303314+0000","last_active":"2024-09-13T06:39:37.429632+0000","last_peered":"2024-09-13T06:39:37.429632+0000","last_clean":"2024-09-13T06:39:37.429632+0000","last_became_active":"2024-09-13T06:39:17.536394+0000","last_became_peered":"2024-09-13T06:39:17.536394+0000","last_unstale":"2024-09-13T06:39:37.429632+0000","last_undegraded":"2024-09-13T06:39:37.429632+0000","last_fullsized":"2024-09-13T06:39:37.429632+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_clean_scrub_stamp":"2024-09-13T06:39:16.508974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:24:30.600904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00033592499999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"31'11","reported_seq":42,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-13T06:39:39.693270+0000","last_change":"2024-09-13T06:39:37.489520+0000","last_active":"2024-09-13T06:39:39.693270+0000","last_peered":"2024-09-13T06:39:39.693270+0000","last_clean":"2024-09-13T06:39:39.693270+0000","last_became_active":"2024-09-13T06:39:27.371900+0000","last_became_peered":"2024-09-13T06:39:27.371900+0000","last_unstale":"2024-09-13T06:39:39.693270+0000","last_undegraded":"2024-09-13T06:39:39.693270+0000","last_fullsized":"2024-09-13T06:39:39.693270+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:28:48.886885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00050123599999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"5","length":"1"},{"start":"8","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":26,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-13T06:39:37.433393+0000","last_change":"2024-09-13T06:39:19.679784+0000","last_active":"2024-09-13T06:39:37.433393+0000","last_peered":"2024-09-13T06:39:37.433393+0000","last_clean":"2024-09-13T06:39:37.433393+0000","last_became_active":"2024-09-13T06:39:17.533439+0000","last_became_peered":"2024-09-13T06:39:17.533439+0000","last_unstale":"2024-09-13T06:39:37.433393+0000","last_undegraded":"2024-09-13T06:39:37.433393+0000","last_fullsized":"2024-09-13T06:39:37.433393+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_clean_scrub_stamp":"2024-09-13T06:39:16.508974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:12:49.774540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00061709999999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"31'7","reported_seq":214,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-13T06:39:39.561165+0000","last_change":"2024-09-13T06:39:37.430600+0000","last_active":"2024-09-13T06:39:39.561165+0000","last_peered":"2024-09-13T06:39:39.561165+0000","last_clean":"2024-09-13T06:39:39.561165+0000","last_became_active":"2024-09-13T06:39:27.353845+0000","last_became_peered":"2024-09-13T06:39:27.353845+0000","last_unstale":"2024-09-13T06:39:39.561165+0000","last_undegraded":"2024-09-13T06:39:39.561165+0000","last_fullsized":"2024-09-13T06:39:39.561165+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:18:56.689713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00066692100000000001,"stat_sum":{"num_bytes":3828025,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":181,"num_read_kb":30,"num_write":6,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"5","length":"1"},{"start":"8","length":"1"}]},{"pgid":"2.3","version":"18'1","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-13T06:39:37.430391+0000","last_change":"2024-09-13T06:39:19.563307+0000","last_active":"2024-09-13T06:39:37.430391+0000","last_peered":"2024-09-13T06:39:37.430391+0000","last_clean":"2024-09-13T06:39:37.430391+0000","last_became_active":"2024-09-13T06:39:17.536003+0000","last_became_peered":"2024-09-13T06:39:17.536003+0000","last_unstale":"2024-09-13T06:39:37.430391+0000","last_undegraded":"2024-09-13T06:39:37.430391+0000","last_fullsized":"2024-09-13T06:39:37.430391+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_clean_scrub_stamp":"2024-09-13T06:39:16.508974+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:12:22.307020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000698802,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":174,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-13T06:39:37.433691+0000","last_change":"2024-09-13T06:39:11.204643+0000","last_active":"2024-09-13T06:39:37.433691+0000","last_peered":"2024-09-13T06:39:37.433691+0000","last_clean":"2024-09-13T06:39:37.433691+0000","last_became_active":"2024-09-13T06:39:11.202831+0000","last_became_peered":"2024-09-13T06:39:11.202831+0000","last_unstale":"2024-09-13T06:39:37.433691+0000","last_undegraded":"2024-09-13T06:39:37.433691+0000","last_fullsized":"2024-09-13T06:39:37.433691+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:10.110558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:10.110558+0000","last_clean_scrub_stamp":"2024-09-13T06:39:10.110558+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:54:11.834414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"31'9","reported_seq":40,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-13T06:39:39.429883+0000","last_change":"2024-09-13T06:39:37.430286+0000","last_active":"2024-09-13T06:39:39.429883+0000","last_peered":"2024-09-13T06:39:39.429883+0000","last_clean":"2024-09-13T06:39:39.429883+0000","last_became_active":"2024-09-13T06:39:27.353023+0000","last_became_peered":"2024-09-13T06:39:27.353023+0000","last_unstale":"2024-09-13T06:39:39.429883+0000","last_undegraded":"2024-09-13T06:39:39.429883+0000","last_fullsized":"2024-09-13T06:39:39.429883+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:51:53.573072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00044092699999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":99,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"5","length":"1"},{"start":"8","length":"1"}]},{"pgid":"3.9","version":"31'13","reported_seq":44,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-13T06:39:39.621391+0000","last_change":"2024-09-13T06:39:37.441145+0000","last_active":"2024-09-13T06:39:39.621391+0000","last_peered":"2024-09-13T06:39:39.621391+0000","last_clean":"2024-09-13T06:39:39.621391+0000","last_became_active":"2024-09-13T06:39:27.452663+0000","last_became_peered":"2024-09-13T06:39:27.452663+0000","last_unstale":"2024-09-13T06:39:39.621391+0000","last_undegraded":"2024-09-13T06:39:39.621391+0000","last_fullsized":"2024-09-13T06:39:39.621391+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:03:40.676135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00054467999999999997,"stat_sum":{"num_bytes":65536,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"5","length":"1"},{"start":"8","length":"1"}]},{"pgid":"3.a","version":"31'55","reported_seq":330,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-13T06:39:39.707867+0000","last_change":"2024-09-13T06:39:37.437898+0000","last_active":"2024-09-13T06:39:39.707867+0000","last_peered":"2024-09-13T06:39:39.707867+0000","last_clean":"2024-09-13T06:39:39.707867+0000","last_became_active":"2024-09-13T06:39:27.374384+0000","last_became_peered":"2024-09-13T06:39:27.374384+0000","last_unstale":"2024-09-13T06:39:39.707867+0000","last_undegraded":"2024-09-13T06:39:39.707867+0000","last_fullsized":"2024-09-13T06:39:39.707867+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:21:45.720790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00124204,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":686,"num_read_kb":602,"num_write":54,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"5","length":"1"},{"start":"8","length":"1"}]},{"pgid":"3.b","version":"31'2","reported_seq":33,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-13T06:39:39.136454+0000","last_change":"2024-09-13T06:39:37.430407+0000","last_active":"2024-09-13T06:39:39.136454+0000","last_peered":"2024-09-13T06:39:39.136454+0000","last_clean":"2024-09-13T06:39:39.136454+0000","last_became_active":"2024-09-13T06:39:27.352565+0000","last_became_peered":"2024-09-13T06:39:27.352565+0000","last_unstale":"2024-09-13T06:39:39.136454+0000","last_undegraded":"2024-09-13T06:39:39.136454+0000","last_fullsized":"2024-09-13T06:39:39.136454+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:16:19.108034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046930300000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"5","length":"1"},{"start":"8","length":"1"}]},{"pgid":"3.c","version":"31'51","reported_seq":387,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-13T06:39:39.435769+0000","last_change":"2024-09-13T06:39:37.431314+0000","last_active":"2024-09-13T06:39:39.435769+0000","last_peered":"2024-09-13T06:39:39.435769+0000","last_clean":"2024-09-13T06:39:39.435769+0000","last_became_active":"2024-09-13T06:39:27.359518+0000","last_became_peered":"2024-09-13T06:39:27.359518+0000","last_unstale":"2024-09-13T06:39:39.435769+0000","last_undegraded":"2024-09-13T06:39:39.435769+0000","last_fullsized":"2024-09-13T06:39:39.435769+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:09:45.387352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00076073099999999995,"stat_sum":{"num_bytes":3070428,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":572,"num_read_kb":422,"num_write":49,"num_write_kb":155,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"5","length":"1"},{"start":"8","length":"1"}]},{"pgid":"3.d","version":"31'8","reported_seq":40,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-13T06:39:39.629276+0000","last_change":"2024-09-13T06:39:37.435182+0000","last_active":"2024-09-13T06:39:39.629276+0000","last_peered":"2024-09-13T06:39:39.629276+0000","last_clean":"2024-09-13T06:39:39.629276+0000","last_became_active":"2024-09-13T06:39:27.371886+0000","last_became_peered":"2024-09-13T06:39:27.371886+0000","last_unstale":"2024-09-13T06:39:39.629276+0000","last_undegraded":"2024-09-13T06:39:39.629276+0000","last_fullsized":"2024-09-13T06:39:39.629276+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:38:02.248703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00034829300000000001,"stat_sum":{"num_bytes":355798,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":30,"num_write":7,"num_write_kb":102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"5","length":"1"},{"start":"8","length":"1"}]},{"pgid":"3.e","version":"31'4","reported_seq":35,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-13T06:39:38.855322+0000","last_change":"2024-09-13T06:39:37.434097+0000","last_active":"2024-09-13T06:39:38.855322+0000","last_peered":"2024-09-13T06:39:38.855322+0000","last_clean":"2024-09-13T06:39:38.855322+0000","last_became_active":"2024-09-13T06:39:27.382408+0000","last_became_peered":"2024-09-13T06:39:27.382408+0000","last_unstale":"2024-09-13T06:39:38.855322+0000","last_undegraded":"2024-09-13T06:39:38.855322+0000","last_fullsized":"2024-09-13T06:39:38.855322+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:06:36.412421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000510473,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"5","length":"1"},{"start":"8","length":"1"}]},{"pgid":"3.f","version":"31'8","reported_seq":39,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-13T06:39:39.085728+0000","last_change":"2024-09-13T06:39:37.434086+0000","last_active":"2024-09-13T06:39:39.085728+0000","last_peered":"2024-09-13T06:39:39.085728+0000","last_clean":"2024-09-13T06:39:39.085728+0000","last_became_active":"2024-09-13T06:39:27.382404+0000","last_became_peered":"2024-09-13T06:39:27.382404+0000","last_unstale":"2024-09-13T06:39:39.085728+0000","last_undegraded":"2024-09-13T06:39:39.085728+0000","last_fullsized":"2024-09-13T06:39:39.085728+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:45:40.841862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000442158,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"5","length":"1"},{"start":"8","length":"1"}]},{"pgid":"3.10","version":"31'63","reported_seq":272,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-13T06:39:39.438404+0000","last_change":"2024-09-13T06:39:37.437011+0000","last_active":"2024-09-13T06:39:39.438404+0000","last_peered":"2024-09-13T06:39:39.438404+0000","last_clean":"2024-09-13T06:39:39.438404+0000","last_became_active":"2024-09-13T06:39:27.361949+0000","last_became_peered":"2024-09-13T06:39:27.361949+0000","last_unstale":"2024-09-13T06:39:39.438404+0000","last_undegraded":"2024-09-13T06:39:39.438404+0000","last_fullsized":"2024-09-13T06:39:39.438404+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:37:21.237288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00037630600000000003,"stat_sum":{"num_bytes":62487,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":528,"num_read_kb":463,"num_write":60,"num_write_kb":385,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"5","length":"1"},{"start":"8","length":"1"}]},{"pgid":"3.11","version":"31'61","reported_seq":235,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-13T06:39:39.616039+0000","last_change":"2024-09-13T06:39:37.434554+0000","last_active":"2024-09-13T06:39:39.616039+0000","last_peered":"2024-09-13T06:39:39.616039+0000","last_clean":"2024-09-13T06:39:39.616039+0000","last_became_active":"2024-09-13T06:39:27.381045+0000","last_became_peered":"2024-09-13T06:39:27.381045+0000","last_unstale":"2024-09-13T06:39:39.616039+0000","last_undegraded":"2024-09-13T06:39:39.616039+0000","last_fullsized":"2024-09-13T06:39:39.616039+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:00:28.836044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00090394599999999998,"stat_sum":{"num_bytes":1572940,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":319,"num_read_kb":141,"num_write":75,"num_write_kb":250,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"5","length":"1"},{"start":"8","length":"1"}]},{"pgid":"3.12","version":"31'8","reported_seq":59,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-13T06:39:38.652008+0000","last_change":"2024-09-13T06:39:37.489365+0000","last_active":"2024-09-13T06:39:38.652008+0000","last_peered":"2024-09-13T06:39:38.652008+0000","last_clean":"2024-09-13T06:39:38.652008+0000","last_became_active":"2024-09-13T06:39:27.372076+0000","last_became_peered":"2024-09-13T06:39:27.372076+0000","last_unstale":"2024-09-13T06:39:38.652008+0000","last_undegraded":"2024-09-13T06:39:38.652008+0000","last_fullsized":"2024-09-13T06:39:38.652008+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:30:22.510547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00042609499999999998,"stat_sum":{"num_bytes":3509505,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":112,"num_write":7,"num_write_kb":186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"5","length":"1"},{"start":"8","length":"1"}]},{"pgid":"3.13","version":"31'6","reported_seq":39,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-13T06:39:38.852911+0000","last_change":"2024-09-13T06:39:37.434755+0000","last_active":"2024-09-13T06:39:38.852911+0000","last_peered":"2024-09-13T06:39:38.852911+0000","last_clean":"2024-09-13T06:39:38.852911+0000","last_became_active":"2024-09-13T06:39:27.382544+0000","last_became_peered":"2024-09-13T06:39:27.382544+0000","last_unstale":"2024-09-13T06:39:38.852911+0000","last_undegraded":"2024-09-13T06:39:38.852911+0000","last_fullsized":"2024-09-13T06:39:38.852911+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:46:36.059537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010528270000000001,"stat_sum":{"num_bytes":41,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":3,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"5","length":"1"},{"start":"8","length":"1"}]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":14737294,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":4120,"num_read_kb":3194,"num_write":981,"num_write_kb":3921,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":737280,"data_stored":585620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":789,"ondisk_log_size":789,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574859,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32192,"kb_used_data":1080,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339648,"statfs":{"total":96636764160,"available":96603799552,"internally_reserved":0,"allocated":1105920,"data_stored":865086,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31848907},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54800000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78900000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51800000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69499999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57699999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63800000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.752}]}]},{"osd":6,"up_from":13,"seq":55834574856,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27516,"kb_used_data":424,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344324,"statfs":{"total":96636764160,"available":96608587776,"internally_reserved":0,"allocated":434176,"data_stored":222590,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66900000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.01}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84199999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.224}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.321}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.27}]}]},{"osd":5,"up_from":13,"seq":55834574857,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27512,"kb_used_data":488,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344328,"statfs":{"total":96636764160,"available":96608591872,"internally_reserved":0,"allocated":499712,"data_stored":267263,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61099999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69499999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.746}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84599999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.159}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0649999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.212}]}]},{"osd":4,"up_from":13,"seq":55834574857,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27528,"kb_used_data":504,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344312,"statfs":{"total":96636764160,"available":96608575488,"internally_reserved":0,"allocated":516096,"data_stored":272600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67100000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81899999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.056}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98599999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52700000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.443}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83199999999999996}]}]},{"osd":3,"up_from":13,"seq":55834574859,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27724,"kb_used_data":632,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344116,"statfs":{"total":96636764160,"available":96608374784,"internally_reserved":0,"allocated":647168,"data_stored":415925,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27500000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.316}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.495}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64300000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84899999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68799999999999994}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78800000000000003}]}]},{"osd":2,"up_from":13,"seq":55834574857,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27456,"kb_used_data":440,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344384,"statfs":{"total":96636764160,"available":96608649216,"internally_reserved":0,"allocated":450560,"data_stored":232349,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39600000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.434}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49399999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91700000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88300000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65500000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63600000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574857,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27364,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344476,"statfs":{"total":96636764160,"available":96608743424,"internally_reserved":0,"allocated":356352,"data_stored":136717,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60899999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.751}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80100000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83499999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92000000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96899999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1459999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574856,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32092,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339748,"statfs":{"total":96636764160,"available":96603901952,"internally_reserved":0,"allocated":999424,"data_stored":783637,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.505}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42399999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35899999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71199999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76300000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91600000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73699999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":108462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":5879,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":98,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":94348,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":32546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":184320,"data_stored":154376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":51678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":172032,"data_stored":138233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T06:39:42.801 INFO:teuthology.orchestra.run.smithi081.stdout:374 read 0xfb08bc thru 0xfb6fad (0x66f2 bytes) 2024-09-13T06:39:42.801 INFO:teuthology.orchestra.run.smithi081.stdout:376 read 0x1fe2728 thru 0x1febde3 (0x96bc bytes) 2024-09-13T06:39:42.801 INFO:teuthology.orchestra.run.smithi081.stdout:377 writesame 0x2fad3d thru 0x3005f7 data_size 0x23(0x58bb bytes) 2024-09-13T06:39:42.805 INFO:teuthology.orchestra.run.smithi081.stdout:379 punch from 0x1d1ffa9 to 0x1d20656, (0x6ad bytes) 2024-09-13T06:39:42.805 INFO:teuthology.orchestra.run.smithi081.stdout:380 writesame 0x24f5892 thru 0x24f7415 data_size 0x6(0x1b84 bytes) 2024-09-13T06:39:42.811 INFO:teuthology.orchestra.run.smithi081.stdout:381 punch from 0x1dcd14a to 0x1ddc747, (0xf5fd bytes) 2024-09-13T06:39:42.812 INFO:teuthology.orchestra.run.smithi081.stdout:382 write 0x554e2e3 thru 0x555366f (0x538d bytes) 2024-09-13T06:39:42.819 INFO:teuthology.orchestra.run.smithi081.stdout:383 read 0x117f5a5 thru 0x11827e7 (0x3243 bytes) 2024-09-13T06:39:42.820 INFO:teuthology.orchestra.run.smithi081.stdout:384 writesame 0x8377fa thru 0x8426cc data_size 0x1(0xaed3 bytes) 2024-09-13T06:39:42.841 INFO:teuthology.orchestra.run.smithi081.stdout:385 write 0x3da405c thru 0x3db02bd (0xc262 bytes) 2024-09-13T06:39:42.851 INFO:teuthology.orchestra.run.smithi081.stdout:386 trunc from 0x5af6aa8 to 0x57b9ce6 2024-09-13T06:39:42.869 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-13T06:39:42.870+0000 7f86a5f06640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26387) UID: 0 2024-09-13T06:39:42.874 INFO:teuthology.orchestra.run.smithi081.stdout:387 write 0x6cdb6fa thru 0x6cdd154 (0x1a5b bytes) 2024-09-13T06:39:42.880 INFO:teuthology.orchestra.run.smithi081.stdout:388 read 0x764b1a thru 0x76c9cb (0x7eb2 bytes) 2024-09-13T06:39:42.881 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:39:42.881 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:39:42.892 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:39:42.892 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [ 2024-09-13T06:39:42.892 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.892 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4385.0:3447 3.9 e34/21 3:9105f097:::rbd_object_map.11217e777cf4:head v 34'38, mlcod=34'36)", 2024-09-13T06:39:42.892 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:42.896431+0000", 2024-09-13T06:39:42.892 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.00074633700000000002, 2024-09-13T06:39:42.892 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000773432, 2024-09-13T06:39:42.892 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:42.892 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:39:42.893 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:42.893 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.893 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:42.893 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:42.896431+0000", 2024-09-13T06:39:42.893 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:42.893 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.893 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.893 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:42.893 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:42.896431+0000", 2024-09-13T06:39:42.893 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:42.893 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.893 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.893 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:42.893 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:42.896429+0000", 2024-09-13T06:39:42.894 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999981 2024-09-13T06:39:42.894 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.894 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.894 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:42.894 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:42.896443+0000", 2024-09-13T06:39:42.894 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3862999999999999e-05 2024-09-13T06:39:42.894 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.894 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.894 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:42.894 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:42.896465+0000", 2024-09-13T06:39:42.894 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1971e-05 2024-09-13T06:39:42.894 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.894 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.895 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:42.895 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:42.896474+0000", 2024-09-13T06:39:42.895 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.2159999999999995e-06 2024-09-13T06:39:42.895 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.895 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.895 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:42.895 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:42.896538+0000", 2024-09-13T06:39:42.895 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3684999999999998e-05 2024-09-13T06:39:42.895 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:42.896 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:42.896 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:42.896 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:42.896565+0000", 2024-09-13T06:39:42.896 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.7586999999999999e-05 2024-09-13T06:39:42.896 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:42.896 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:42.896 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:42.896 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:42.896 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-13T06:39:42.896 INFO:teuthology.orchestra.run.smithi081.stdout: "num_ops": 1 2024-09-13T06:39:42.896 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:39:42.897 INFO:teuthology.orchestra.run.smithi081.stdout:393 write 0xe023647 thru 0xe027f1c (0x48d6 bytes) 2024-09-13T06:39:42.903 INFO:teuthology.orchestra.run.smithi081.stdout:395 write 0xcdd083f thru 0xcddc9db (0xc19d bytes) 2024-09-13T06:39:42.906 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-13T06:39:42.907 INFO:teuthology.orchestra.run.smithi081.stdout:396 read 0xb22ce37 thru 0xb23b852 (0xea1c bytes) 2024-09-13T06:39:42.920 INFO:teuthology.orchestra.run.smithi081.stdout:398 trunc from 0xe027f1d to 0x4bba5dc 2024-09-13T06:39:42.936 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:39:42.947 INFO:teuthology.orchestra.run.smithi081.stdout:400 trunc from 0x4bba5dc to 0xc83f01b 2024-09-13T06:39:42.957 INFO:teuthology.orchestra.run.smithi081.stdout:401 trunc from 0xc83f01b to 0xd5559b0 2024-09-13T06:39:42.967 INFO:teuthology.orchestra.run.smithi081.stdout:403 trunc from 0xd5559b0 to 0xbce5780 2024-09-13T06:39:42.970 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:39:42.971+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:39:42.976 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:39:42.981 INFO:teuthology.orchestra.run.smithi081.stdout:407 trunc from 0xbce5780 to 0x807c3c9 2024-09-13T06:39:43.012 INFO:teuthology.orchestra.run.smithi081.stdout:408 write 0xeb5087f thru 0xeb5e12a (0xd8ac bytes) 2024-09-13T06:39:43.022 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:39:43.024 INFO:teuthology.orchestra.run.smithi081.stdout:412 trunc from 0xeb5e12b to 0xbcd9fd3 2024-09-13T06:39:43.032 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:39:43.032 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-13T06:39:43.032 INFO:teuthology.orchestra.run.smithi081.stdout: "complaint_time": 30, 2024-09-13T06:39:43.032 INFO:teuthology.orchestra.run.smithi081.stdout: "num_blocked_ops": 0 2024-09-13T06:39:43.033 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:39:43.048 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-13T06:39:43.061 INFO:teuthology.orchestra.run.smithi081.stdout:413 trunc from 0xbcd9fd3 to 0x224c116 2024-09-13T06:39:43.070 INFO:tasks.ceph.osd.6.smithi139.stderr:2024-09-13T06:39:43.070+0000 7fcd02c5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26385) UID: 0 2024-09-13T06:39:43.108 INFO:teuthology.orchestra.run.smithi081.stdout:414 write 0xbfec7cd thru 0xbff4fc5 (0x87f9 bytes) 2024-09-13T06:39:43.117 INFO:teuthology.orchestra.run.smithi081.stdout:417 write 0x26adaa2 thru 0x26b6f8b (0x94ea bytes) 2024-09-13T06:39:43.126 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:39:43.126 INFO:teuthology.orchestra.run.smithi081.stdout:420 read 0x73ffedd thru 0x7403c31 (0x3d55 bytes) 2024-09-13T06:39:43.126 INFO:teuthology.orchestra.run.smithi081.stdout:421 read 0x5d6f604 thru 0x5d74219 (0x4c16 bytes) 2024-09-13T06:39:43.139 INFO:teuthology.orchestra.run.smithi081.stdout:422 write 0xe15905a thru 0xe166a65 (0xda0c bytes) 2024-09-13T06:39:43.148 INFO:teuthology.orchestra.run.smithi081.stdout:423 write 0xd9bb89b thru 0xd9c2505 (0x6c6b bytes) 2024-09-13T06:39:43.155 INFO:teuthology.orchestra.run.smithi081.stdout:424 punch from 0x67a000e to 0x67a9c21, (0x9c13 bytes) 2024-09-13T06:39:43.155 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:39:43.155 INFO:teuthology.orchestra.run.smithi081.stdout:426 read 0xbff7e69 thru 0xc005bae (0xdd46 bytes) 2024-09-13T06:39:43.157 INFO:teuthology.orchestra.run.smithi081.stdout:428 read 0xdfcecf4 thru 0xdfd1853 (0x2b60 bytes) 2024-09-13T06:39:43.157 INFO:teuthology.orchestra.run.smithi081.stdout:429 punch from 0x956b50e to 0x956efef, (0x3ae1 bytes) 2024-09-13T06:39:43.157 INFO:teuthology.orchestra.run.smithi081.stdout:430 write 0xcce8263 thru 0xccf192a (0x96c8 bytes) 2024-09-13T06:39:43.164 INFO:teuthology.orchestra.run.smithi081.stdout:431 clone 4 order 25 su 8388608 sc 11 2024-09-13T06:39:43.171 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:39:43.174+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:39:43.188 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:39:43.188 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 20, 2024-09-13T06:39:43.188 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 600, 2024-09-13T06:39:43.188 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [ 2024-09-13T06:39:43.188 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.188 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4385.0:2330 3.0 e31/21 3:07d66135:::rbd_object_map.11212429e5ad:head v 31'39, mlcod=31'37)", 2024-09-13T06:39:43.188 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:38.827721+0000", 2024-09-13T06:39:43.188 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 4.3630254439999998, 2024-09-13T06:39:43.188 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.003728295, 2024-09-13T06:39:43.189 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:43.189 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:43.189 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:43.189 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.189 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:43.189 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.827721+0000", 2024-09-13T06:39:43.189 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:43.189 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.189 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.189 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:43.189 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.827721+0000", 2024-09-13T06:39:43.189 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:43.189 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.190 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.190 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:43.190 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.827718+0000", 2024-09-13T06:39:43.190 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999976 2024-09-13T06:39:43.190 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.190 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.190 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:43.190 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.827735+0000", 2024-09-13T06:39:43.190 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6515999999999999e-05 2024-09-13T06:39:43.190 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.190 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.190 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:43.190 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.827768+0000", 2024-09-13T06:39:43.191 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.3105999999999998e-05 2024-09-13T06:39:43.191 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.191 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.191 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:43.191 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.827788+0000", 2024-09-13T06:39:43.191 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0210000000000001e-05 2024-09-13T06:39:43.191 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.191 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.191 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:43.191 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.827855+0000", 2024-09-13T06:39:43.191 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.7046999999999997e-05 2024-09-13T06:39:43.192 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.192 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.192 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:43.192 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.827900+0000", 2024-09-13T06:39:43.192 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4415000000000001e-05 2024-09-13T06:39:43.192 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.192 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.192 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:39:43.192 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.831380+0000", 2024-09-13T06:39:43.192 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.003480187 2024-09-13T06:39:43.192 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.192 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.193 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:43.193 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.831449+0000", 2024-09-13T06:39:43.193 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.9070000000000001e-05 2024-09-13T06:39:43.193 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:43.193 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:43.193 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:43.193 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.193 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.194 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4385.0:2402 3.0 e31/21 3:07d66135:::rbd_object_map.11212429e5ad:head v 31'46, mlcod=31'43)", 2024-09-13T06:39:43.194 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:38.872174+0000", 2024-09-13T06:39:43.195 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 4.3185719029999996, 2024-09-13T06:39:43.195 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0037101830000000001, 2024-09-13T06:39:43.195 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:43.195 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:43.195 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:43.195 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.195 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:43.195 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.872174+0000", 2024-09-13T06:39:43.195 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:43.195 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.195 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.195 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:43.195 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.872174+0000", 2024-09-13T06:39:43.196 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:43.196 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.196 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.196 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:43.196 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.872173+0000", 2024-09-13T06:39:43.196 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.999999 2024-09-13T06:39:43.196 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.196 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.196 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:43.197 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.872180+0000", 2024-09-13T06:39:43.197 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.4189999999999999e-06 2024-09-13T06:39:43.197 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.197 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.197 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:43.197 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.872193+0000", 2024-09-13T06:39:43.197 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.349e-05 2024-09-13T06:39:43.197 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.197 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.197 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:43.197 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.872201+0000", 2024-09-13T06:39:43.197 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.7000000000000008e-06 2024-09-13T06:39:43.197 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.198 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.198 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:43.198 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.872506+0000", 2024-09-13T06:39:43.198 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00030537300000000001 2024-09-13T06:39:43.198 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.198 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.198 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:43.198 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.872571+0000", 2024-09-13T06:39:43.198 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.4349000000000003e-05 2024-09-13T06:39:43.198 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.198 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.198 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:39:43.198 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.875823+0000", 2024-09-13T06:39:43.199 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0032527419999999999 2024-09-13T06:39:43.199 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.199 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.199 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:43.199 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.875884+0000", 2024-09-13T06:39:43.199 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0847999999999997e-05 2024-09-13T06:39:43.199 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:43.199 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:43.199 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:43.199 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.199 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.199 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4385.0:2403 3.0 e31/21 3:07d66135:::rbd_object_map.11212429e5ad:head v 31'47, mlcod=31'43)", 2024-09-13T06:39:43.199 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:38.873272+0000", 2024-09-13T06:39:43.199 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 4.3174740480000002, 2024-09-13T06:39:43.200 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0059524080000000002, 2024-09-13T06:39:43.200 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:43.200 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:43.200 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:43.200 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.200 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:43.200 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.873272+0000", 2024-09-13T06:39:43.200 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:43.200 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.200 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.200 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:43.200 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.873272+0000", 2024-09-13T06:39:43.200 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:43.201 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.201 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.201 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:43.201 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.873271+0000", 2024-09-13T06:39:43.201 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:39:43.201 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.201 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.201 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:43.201 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.873277+0000", 2024-09-13T06:39:43.201 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.5999999999999997e-06 2024-09-13T06:39:43.201 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.201 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.202 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:43.202 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.873285+0000", 2024-09-13T06:39:43.202 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4680000000000003e-06 2024-09-13T06:39:43.202 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.202 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.202 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:43.202 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.873289+0000", 2024-09-13T06:39:43.202 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7670000000000003e-06 2024-09-13T06:39:43.202 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.203 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.203 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:43.203 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.873403+0000", 2024-09-13T06:39:43.203 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00011417300000000001 2024-09-13T06:39:43.203 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.203 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.203 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:43.203 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.873421+0000", 2024-09-13T06:39:43.203 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7278e-05 2024-09-13T06:39:43.203 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.204 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.204 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:39:43.204 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.879180+0000", 2024-09-13T06:39:43.204 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0057591379999999996 2024-09-13T06:39:43.204 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.204 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.204 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:43.204 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.879224+0000", 2024-09-13T06:39:43.204 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4558000000000003e-05 2024-09-13T06:39:43.204 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:43.204 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:43.204 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:43.204 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.205 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.205 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4385.0:2404 3.0 e31/21 3:07d66135:::rbd_object_map.11212429e5ad:head v 31'48, mlcod=31'43)", 2024-09-13T06:39:43.205 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:38.874266+0000", 2024-09-13T06:39:43.205 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 4.3164802910000004, 2024-09-13T06:39:43.205 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0049906389999999998, 2024-09-13T06:39:43.205 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:43.205 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:43.205 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:43.205 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.205 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:43.205 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.874266+0000", 2024-09-13T06:39:43.205 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:43.205 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.206 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.206 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:43.206 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.874266+0000", 2024-09-13T06:39:43.206 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:43.206 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.206 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.206 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:43.206 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.874265+0000", 2024-09-13T06:39:43.206 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.999999 2024-09-13T06:39:43.206 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.206 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.206 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:43.206 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.874281+0000", 2024-09-13T06:39:43.207 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5763000000000001e-05 2024-09-13T06:39:43.207 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.207 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.207 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:43.207 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.874294+0000", 2024-09-13T06:39:43.207 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2826000000000001e-05 2024-09-13T06:39:43.207 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.207 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.207 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:43.207 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.874300+0000", 2024-09-13T06:39:43.207 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.6769999999999998e-06 2024-09-13T06:39:43.207 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.208 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.208 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:43.208 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.874390+0000", 2024-09-13T06:39:43.208 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.0129000000000004e-05 2024-09-13T06:39:43.208 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.208 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.208 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:43.208 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.874450+0000", 2024-09-13T06:39:43.208 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9512999999999998e-05 2024-09-13T06:39:43.208 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.209 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.209 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:39:43.209 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.879227+0000", 2024-09-13T06:39:43.209 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0047773329999999999 2024-09-13T06:39:43.209 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.209 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.209 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:43.209 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.879256+0000", 2024-09-13T06:39:43.209 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9173e-05 2024-09-13T06:39:43.209 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:43.209 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:43.210 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:43.210 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.210 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.210 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4385.0:2405 3.0 e31/21 3:07d66135:::rbd_object_map.11212429e5ad:head v 31'49, mlcod=31'43)", 2024-09-13T06:39:43.210 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:38.875324+0000", 2024-09-13T06:39:43.210 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 4.315422442, 2024-09-13T06:39:43.210 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0039619570000000003, 2024-09-13T06:39:43.210 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:43.210 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:43.210 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:43.210 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.210 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:43.210 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.875324+0000", 2024-09-13T06:39:43.211 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:43.211 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.211 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.211 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:43.211 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.875324+0000", 2024-09-13T06:39:43.211 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:43.211 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.211 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.211 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:43.211 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.875323+0000", 2024-09-13T06:39:43.211 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.999999 2024-09-13T06:39:43.211 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.211 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.211 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:43.212 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.875329+0000", 2024-09-13T06:39:43.212 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.1689999999999997e-06 2024-09-13T06:39:43.212 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.212 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.212 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:43.212 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.875340+0000", 2024-09-13T06:39:43.212 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1065e-05 2024-09-13T06:39:43.212 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.212 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.212 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:43.212 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.875347+0000", 2024-09-13T06:39:43.212 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.674e-06 2024-09-13T06:39:43.212 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.213 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.213 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:43.213 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.875396+0000", 2024-09-13T06:39:43.213 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9094000000000001e-05 2024-09-13T06:39:43.213 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.213 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.213 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:43.213 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.875420+0000", 2024-09-13T06:39:43.213 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4199999999999999e-05 2024-09-13T06:39:43.213 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.213 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.213 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:39:43.213 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.879258+0000", 2024-09-13T06:39:43.213 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0038376930000000001 2024-09-13T06:39:43.214 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.214 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.214 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:43.214 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.879286+0000", 2024-09-13T06:39:43.214 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.7880000000000001e-05 2024-09-13T06:39:43.214 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:43.214 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:43.214 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:43.214 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.214 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.214 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4385.0:2407 3.0 e31/21 3:07d66135:::rbd_object_map.11212429e5ad:head v 31'51, mlcod=31'44)", 2024-09-13T06:39:43.214 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:38.878449+0000", 2024-09-13T06:39:43.214 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 4.3122974190000001, 2024-09-13T06:39:43.215 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0036754119999999999, 2024-09-13T06:39:43.215 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:43.215 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:43.215 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:43.215 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.215 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:43.215 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.878449+0000", 2024-09-13T06:39:43.215 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:43.215 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.215 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.215 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:43.215 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.878449+0000", 2024-09-13T06:39:43.215 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:43.215 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.215 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.216 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:43.216 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.878447+0000", 2024-09-13T06:39:43.216 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999981 2024-09-13T06:39:43.216 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.216 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.216 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:43.216 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.878462+0000", 2024-09-13T06:39:43.216 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5133000000000001e-05 2024-09-13T06:39:43.216 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.216 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.216 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:43.216 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.878500+0000", 2024-09-13T06:39:43.216 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.8213999999999997e-05 2024-09-13T06:39:43.217 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.217 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.217 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:43.217 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.878520+0000", 2024-09-13T06:39:43.217 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0000000000000002e-05 2024-09-13T06:39:43.217 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.217 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.217 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:43.217 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.878710+0000", 2024-09-13T06:39:43.217 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00019008100000000001 2024-09-13T06:39:43.217 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.217 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.217 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:43.217 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.878745+0000", 2024-09-13T06:39:43.218 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.4533000000000003e-05 2024-09-13T06:39:43.218 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.218 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.218 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:39:43.218 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.882086+0000", 2024-09-13T06:39:43.218 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0033416409999999998 2024-09-13T06:39:43.218 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.218 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.218 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:43.218 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.882124+0000", 2024-09-13T06:39:43.219 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.7673000000000003e-05 2024-09-13T06:39:43.219 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:43.219 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:43.219 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:43.219 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.219 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.219 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4385.0:2408 3.0 e31/21 3:07d66135:::rbd_object_map.11212429e5ad:head v 31'52, mlcod=31'45)", 2024-09-13T06:39:43.219 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:38.880785+0000", 2024-09-13T06:39:43.219 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 4.3099612609999998, 2024-09-13T06:39:43.219 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.004103382, 2024-09-13T06:39:43.219 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:43.219 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:43.219 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:43.219 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.220 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:43.220 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.880785+0000", 2024-09-13T06:39:43.220 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:43.220 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.220 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.220 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:43.220 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.880785+0000", 2024-09-13T06:39:43.220 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:43.220 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.220 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.220 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:43.220 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.880784+0000", 2024-09-13T06:39:43.221 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.999999 2024-09-13T06:39:43.221 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.221 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.221 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:43.221 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.880793+0000", 2024-09-13T06:39:43.221 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.8990000000000007e-06 2024-09-13T06:39:43.221 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.221 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.221 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:43.221 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.880806+0000", 2024-09-13T06:39:43.221 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3597999999999999e-05 2024-09-13T06:39:43.221 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.221 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.222 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:43.222 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.880813+0000", 2024-09-13T06:39:43.222 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.6789999999999999e-06 2024-09-13T06:39:43.222 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.222 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.222 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:43.222 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.880918+0000", 2024-09-13T06:39:43.222 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000105256 2024-09-13T06:39:43.222 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.222 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.222 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:43.222 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.880977+0000", 2024-09-13T06:39:43.223 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8310000000000002e-05 2024-09-13T06:39:43.223 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.223 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.223 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:39:43.223 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.884849+0000", 2024-09-13T06:39:43.223 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.003872693 2024-09-13T06:39:43.223 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.223 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.223 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:43.223 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.884888+0000", 2024-09-13T06:39:43.224 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.8955999999999998e-05 2024-09-13T06:39:43.224 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:43.224 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:43.224 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:43.224 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.224 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.224 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4385.0:2409 3.0 e31/21 3:07d66135:::rbd_object_map.11212429e5ad:head v 31'53, mlcod=31'45)", 2024-09-13T06:39:43.224 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:38.882957+0000", 2024-09-13T06:39:43.224 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 4.3077888580000003, 2024-09-13T06:39:43.225 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0049287489999999996, 2024-09-13T06:39:43.225 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:43.225 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:43.225 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:43.225 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.225 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:43.225 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.882957+0000", 2024-09-13T06:39:43.225 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:43.225 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.225 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.225 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:43.225 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.882957+0000", 2024-09-13T06:39:43.226 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:43.226 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.226 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.226 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:43.226 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.882956+0000", 2024-09-13T06:39:43.226 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.999999 2024-09-13T06:39:43.226 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.226 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.226 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:43.226 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.882963+0000", 2024-09-13T06:39:43.226 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.8680000000000001e-06 2024-09-13T06:39:43.226 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.226 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.226 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:43.227 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.882975+0000", 2024-09-13T06:39:43.227 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1766000000000001e-05 2024-09-13T06:39:43.227 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.227 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.227 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:43.227 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.882981+0000", 2024-09-13T06:39:43.227 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3559999999999998e-06 2024-09-13T06:39:43.227 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.227 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.227 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:43.227 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.883029+0000", 2024-09-13T06:39:43.227 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7839000000000001e-05 2024-09-13T06:39:43.228 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.228 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.228 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:43.228 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.883047+0000", 2024-09-13T06:39:43.228 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8134e-05 2024-09-13T06:39:43.228 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.228 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.228 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:39:43.228 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.887832+0000", 2024-09-13T06:39:43.228 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0047848839999999997 2024-09-13T06:39:43.228 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.228 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.228 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:43.229 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.887886+0000", 2024-09-13T06:39:43.229 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3702999999999997e-05 2024-09-13T06:39:43.229 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:43.229 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:43.229 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:43.229 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.229 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.229 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4385.0:2410 3.0 e31/21 3:07d66135:::rbd_object_map.11212429e5ad:head v 31'54, mlcod=31'45)", 2024-09-13T06:39:43.229 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:38.885943+0000", 2024-09-13T06:39:43.229 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 4.3048030080000004, 2024-09-13T06:39:43.229 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0051076330000000003, 2024-09-13T06:39:43.229 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:43.229 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:43.230 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:43.230 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.230 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:43.230 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.885943+0000", 2024-09-13T06:39:43.230 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:43.230 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.230 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.230 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:43.230 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.885943+0000", 2024-09-13T06:39:43.230 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:43.230 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.230 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.230 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:43.231 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.885942+0000", 2024-09-13T06:39:43.231 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.999999 2024-09-13T06:39:43.231 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.231 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.231 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:43.231 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.885949+0000", 2024-09-13T06:39:43.231 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.2679999999999997e-06 2024-09-13T06:39:43.231 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.231 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.231 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:43.231 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.885961+0000", 2024-09-13T06:39:43.231 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1737e-05 2024-09-13T06:39:43.231 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.232 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.232 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:43.232 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.885967+0000", 2024-09-13T06:39:43.232 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0920000000000003e-06 2024-09-13T06:39:43.232 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.232 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.232 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:43.232 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.886019+0000", 2024-09-13T06:39:43.232 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.1669000000000003e-05 2024-09-13T06:39:43.232 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.232 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.232 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:43.232 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.886035+0000", 2024-09-13T06:39:43.233 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6192e-05 2024-09-13T06:39:43.233 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.233 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.233 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:39:43.233 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.890999+0000", 2024-09-13T06:39:43.233 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0049638440000000002 2024-09-13T06:39:43.233 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.233 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.233 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:43.233 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.891051+0000", 2024-09-13T06:39:43.233 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.1700999999999998e-05 2024-09-13T06:39:43.233 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:43.233 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:43.234 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:43.234 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.234 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.234 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4385.0:2411 3.0 e31/21 3:07d66135:::rbd_object_map.11212429e5ad:head v 31'55, mlcod=31'45)", 2024-09-13T06:39:43.234 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:38.887273+0000", 2024-09-13T06:39:43.234 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 4.3034727290000001, 2024-09-13T06:39:43.234 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0058469940000000003, 2024-09-13T06:39:43.234 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:43.234 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:43.234 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:43.234 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.234 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:43.234 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.887273+0000", 2024-09-13T06:39:43.234 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:43.235 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.235 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.235 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:43.235 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.887273+0000", 2024-09-13T06:39:43.235 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:43.235 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.235 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.235 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:43.235 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.887272+0000", 2024-09-13T06:39:43.235 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.999999 2024-09-13T06:39:43.236 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.236 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.236 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:43.236 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.887280+0000", 2024-09-13T06:39:43.236 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.9060000000000002e-06 2024-09-13T06:39:43.236 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.236 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.236 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:43.236 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.887297+0000", 2024-09-13T06:39:43.236 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6577000000000001e-05 2024-09-13T06:39:43.236 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.236 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.236 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:43.237 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.887306+0000", 2024-09-13T06:39:43.237 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.9579999999999996e-06 2024-09-13T06:39:43.237 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.237 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.237 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:43.237 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.887353+0000", 2024-09-13T06:39:43.237 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7320000000000001e-05 2024-09-13T06:39:43.237 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.237 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.237 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:43.237 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.887374+0000", 2024-09-13T06:39:43.237 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0984000000000001e-05 2024-09-13T06:39:43.237 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.238 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.238 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:39:43.238 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.893037+0000", 2024-09-13T06:39:43.238 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0056629380000000002 2024-09-13T06:39:43.238 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.238 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.238 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:43.238 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.893120+0000", 2024-09-13T06:39:43.238 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.3282000000000007e-05 2024-09-13T06:39:43.238 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:43.238 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:43.238 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:43.238 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.239 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.239 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4385.0:2412 3.0 e31/21 3:07d66135:::rbd_object_map.11212429e5ad:head v 31'56, mlcod=31'48)", 2024-09-13T06:39:43.239 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:38.888795+0000", 2024-09-13T06:39:43.239 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 4.301951173, 2024-09-13T06:39:43.239 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0043887409999999998, 2024-09-13T06:39:43.239 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:43.239 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:43.239 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:43.239 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.239 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:43.239 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.888795+0000", 2024-09-13T06:39:43.240 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:43.240 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.240 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.240 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:43.240 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.888795+0000", 2024-09-13T06:39:43.240 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:43.240 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.240 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.240 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:43.240 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.888794+0000", 2024-09-13T06:39:43.240 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.999999 2024-09-13T06:39:43.240 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.241 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.241 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:43.241 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.888803+0000", 2024-09-13T06:39:43.241 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.7139999999999999e-06 2024-09-13T06:39:43.241 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.241 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.241 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:43.241 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.888820+0000", 2024-09-13T06:39:43.241 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7555999999999999e-05 2024-09-13T06:39:43.241 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.241 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.241 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:43.241 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.888828+0000", 2024-09-13T06:39:43.242 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.153e-06 2024-09-13T06:39:43.242 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.242 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.242 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:43.242 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.888897+0000", 2024-09-13T06:39:43.242 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.9805e-05 2024-09-13T06:39:43.242 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.242 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.242 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:43.242 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.888928+0000", 2024-09-13T06:39:43.242 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.0633000000000003e-05 2024-09-13T06:39:43.242 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.242 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.243 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:39:43.243 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.893124+0000", 2024-09-13T06:39:43.243 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0041962079999999999 2024-09-13T06:39:43.243 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.243 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.243 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:43.243 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.893184+0000", 2024-09-13T06:39:43.243 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9456000000000001e-05 2024-09-13T06:39:43.243 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:43.243 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:43.243 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:43.243 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.243 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.244 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4385.0:2413 3.0 e31/21 3:07d66135:::rbd_object_map.11212429e5ad:head v 31'57, mlcod=31'51)", 2024-09-13T06:39:43.244 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:38.890237+0000", 2024-09-13T06:39:43.244 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 4.3005089720000003, 2024-09-13T06:39:43.244 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0034719220000000001, 2024-09-13T06:39:43.244 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:43.244 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:43.244 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:43.244 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.244 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:43.244 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.890237+0000", 2024-09-13T06:39:43.244 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:43.244 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.245 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.245 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:43.245 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.890237+0000", 2024-09-13T06:39:43.245 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:43.245 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.245 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.245 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:43.245 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.890236+0000", 2024-09-13T06:39:43.245 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.999999 2024-09-13T06:39:43.245 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.245 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.245 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:43.245 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.890243+0000", 2024-09-13T06:39:43.246 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.9630000000000001e-06 2024-09-13T06:39:43.246 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.246 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.246 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:43.246 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.890258+0000", 2024-09-13T06:39:43.246 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4321999999999999e-05 2024-09-13T06:39:43.246 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.246 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.246 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:43.246 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.890265+0000", 2024-09-13T06:39:43.246 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3000000000000004e-06 2024-09-13T06:39:43.247 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.247 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.247 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:43.247 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.890389+0000", 2024-09-13T06:39:43.247 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00012409899999999999 2024-09-13T06:39:43.247 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.247 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.247 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:43.247 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.890420+0000", 2024-09-13T06:39:43.247 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.1090000000000002e-05 2024-09-13T06:39:43.247 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.247 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.247 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:39:43.248 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.893629+0000", 2024-09-13T06:39:43.248 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0032087690000000002 2024-09-13T06:39:43.248 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.248 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.248 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:43.248 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.893709+0000", 2024-09-13T06:39:43.248 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.0226000000000001e-05 2024-09-13T06:39:43.248 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:43.248 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:43.248 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:43.248 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.248 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.248 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "pg_update_log_missing(3.4 epoch 31/21 rep_tid 67 entries 31'2 (0'0) error 3:27e7ab05:::rbd_data.11212429e5ad.0000000000000022:head by client.4385.0:2421 0.000000 0 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-09-13T06:39:43.249 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:38.890280+0000", 2024-09-13T06:39:43.249 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 4.3004656810000004, 2024-09-13T06:39:43.249 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0033244350000000002, 2024-09-13T06:39:43.249 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:43.249 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:39:43.249 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:43.249 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.249 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:43.249 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.890280+0000", 2024-09-13T06:39:43.249 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:43.249 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.249 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.249 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:43.249 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.890280+0000", 2024-09-13T06:39:43.250 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:43.250 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.250 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.250 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:43.250 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.890280+0000", 2024-09-13T06:39:43.250 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:39:43.250 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.250 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.250 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:43.250 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.890287+0000", 2024-09-13T06:39:43.250 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.148e-06 2024-09-13T06:39:43.250 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.250 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.251 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:43.251 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.890302+0000", 2024-09-13T06:39:43.251 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.435e-05 2024-09-13T06:39:43.251 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.251 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.251 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:43.251 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.890312+0000", 2024-09-13T06:39:43.251 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0662999999999999e-05 2024-09-13T06:39:43.251 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.251 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.251 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:43.251 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.890428+0000", 2024-09-13T06:39:43.251 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000115505 2024-09-13T06:39:43.252 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.252 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.252 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:43.252 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.893605+0000", 2024-09-13T06:39:43.252 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.003177119 2024-09-13T06:39:43.252 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:43.252 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:43.252 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:43.252 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.252 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.252 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4385.0:2432 3.0 e31/21 3:07d66135:::rbd_object_map.11212429e5ad:head v 31'62, mlcod=31'58)", 2024-09-13T06:39:43.252 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:38.900535+0000", 2024-09-13T06:39:43.252 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 4.2902109509999997, 2024-09-13T06:39:43.253 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0036949130000000002, 2024-09-13T06:39:43.253 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:43.253 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:43.253 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:43.253 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.253 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:43.253 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.900535+0000", 2024-09-13T06:39:43.253 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:43.253 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.253 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.253 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:43.253 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.900535+0000", 2024-09-13T06:39:43.253 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:43.254 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.254 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.254 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:43.254 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.900535+0000", 2024-09-13T06:39:43.254 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:39:43.254 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.254 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.254 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:43.254 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.900541+0000", 2024-09-13T06:39:43.254 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.4169999999999997e-06 2024-09-13T06:39:43.254 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.254 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.254 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:43.254 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.900553+0000", 2024-09-13T06:39:43.255 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2354000000000001e-05 2024-09-13T06:39:43.255 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.255 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.255 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:43.255 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.900560+0000", 2024-09-13T06:39:43.255 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.8990000000000004e-06 2024-09-13T06:39:43.255 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.255 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.255 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:43.255 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.900621+0000", 2024-09-13T06:39:43.255 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0699000000000003e-05 2024-09-13T06:39:43.255 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.255 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.256 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:43.256 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.900660+0000", 2024-09-13T06:39:43.256 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.8609999999999998e-05 2024-09-13T06:39:43.256 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.256 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.256 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:39:43.256 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.904177+0000", 2024-09-13T06:39:43.256 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0035175509999999998 2024-09-13T06:39:43.256 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.256 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.256 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:43.256 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.904230+0000", 2024-09-13T06:39:43.256 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2966000000000001e-05 2024-09-13T06:39:43.257 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:43.257 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:43.257 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:43.257 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.257 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.257 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4385.0:2433 3.0 e31/21 3:07d66135:::rbd_object_map.11212429e5ad:head v 31'63, mlcod=31'58)", 2024-09-13T06:39:43.257 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:38.901375+0000", 2024-09-13T06:39:43.257 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 4.2893715400000003, 2024-09-13T06:39:43.257 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.005560738, 2024-09-13T06:39:43.257 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:43.257 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:43.258 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:43.258 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.258 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:43.258 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.901375+0000", 2024-09-13T06:39:43.258 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:43.258 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.258 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.258 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:43.258 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.901375+0000", 2024-09-13T06:39:43.258 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:43.258 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.258 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.258 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:43.259 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.901374+0000", 2024-09-13T06:39:43.259 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.999999 2024-09-13T06:39:43.259 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.259 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.259 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:43.259 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.901381+0000", 2024-09-13T06:39:43.259 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.1019999999999999e-06 2024-09-13T06:39:43.259 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.259 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.259 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:43.259 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.901394+0000", 2024-09-13T06:39:43.259 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2782999999999999e-05 2024-09-13T06:39:43.259 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.259 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.260 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:43.260 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.901400+0000", 2024-09-13T06:39:43.260 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.8449999999999997e-06 2024-09-13T06:39:43.260 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.260 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.260 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:43.260 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.901483+0000", 2024-09-13T06:39:43.260 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.2841000000000002e-05 2024-09-13T06:39:43.260 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.260 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.260 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:43.260 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.901513+0000", 2024-09-13T06:39:43.261 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.0102000000000001e-05 2024-09-13T06:39:43.261 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.261 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.261 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:39:43.261 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.906853+0000", 2024-09-13T06:39:43.261 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.005339402 2024-09-13T06:39:43.261 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.261 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.261 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:43.261 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.906935+0000", 2024-09-13T06:39:43.261 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.2488e-05 2024-09-13T06:39:43.261 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:43.261 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:43.262 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:43.262 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.262 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.262 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4385.0:2434 3.0 e31/21 3:07d66135:::rbd_object_map.11212429e5ad:head v 31'64, mlcod=31'58)", 2024-09-13T06:39:43.262 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:38.902253+0000", 2024-09-13T06:39:43.262 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 4.2884929539999996, 2024-09-13T06:39:43.262 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0047392650000000003, 2024-09-13T06:39:43.262 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:43.262 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:43.262 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:43.262 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.262 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:43.262 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.902253+0000", 2024-09-13T06:39:43.263 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:43.263 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.263 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.263 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:43.263 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.902253+0000", 2024-09-13T06:39:43.263 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:43.263 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.263 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.263 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:43.263 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.902252+0000", 2024-09-13T06:39:43.263 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.999999 2024-09-13T06:39:43.263 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.263 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.263 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:43.264 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.902259+0000", 2024-09-13T06:39:43.264 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.9709999999999998e-06 2024-09-13T06:39:43.264 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.264 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.264 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:43.264 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.902273+0000", 2024-09-13T06:39:43.264 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3302000000000001e-05 2024-09-13T06:39:43.264 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.264 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.264 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:43.264 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.902280+0000", 2024-09-13T06:39:43.264 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.126e-06 2024-09-13T06:39:43.264 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.265 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.265 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:43.265 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.902334+0000", 2024-09-13T06:39:43.265 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.4512000000000003e-05 2024-09-13T06:39:43.265 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.265 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.265 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:43.265 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.902363+0000", 2024-09-13T06:39:43.265 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.8544e-05 2024-09-13T06:39:43.265 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.265 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.265 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:39:43.266 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.906941+0000", 2024-09-13T06:39:43.266 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0045781320000000004 2024-09-13T06:39:43.266 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.266 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.266 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:43.266 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.906992+0000", 2024-09-13T06:39:43.266 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.1533000000000003e-05 2024-09-13T06:39:43.266 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:43.266 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:43.266 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:43.266 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.266 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.266 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4385.0:2595 3.0 e31/21 3:07d66135:::rbd_object_map.11212429e5ad:head v 31'108, mlcod=31'105)", 2024-09-13T06:39:43.267 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:39.201908+0000", 2024-09-13T06:39:43.267 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 3.9888376709999998, 2024-09-13T06:39:43.267 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0032468890000000002, 2024-09-13T06:39:43.267 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:43.267 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:43.267 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:43.267 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.267 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:43.267 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.201908+0000", 2024-09-13T06:39:43.267 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:43.267 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.267 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.267 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:43.267 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.201908+0000", 2024-09-13T06:39:43.268 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:43.268 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.268 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.268 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:43.268 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.201908+0000", 2024-09-13T06:39:43.268 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.999999 2024-09-13T06:39:43.268 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.268 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.268 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:43.268 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.201915+0000", 2024-09-13T06:39:43.268 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.153e-06 2024-09-13T06:39:43.268 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.269 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.269 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:43.269 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.201925+0000", 2024-09-13T06:39:43.269 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0453e-05 2024-09-13T06:39:43.269 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.269 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.269 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:43.269 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.201932+0000", 2024-09-13T06:39:43.269 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.5529999999999998e-06 2024-09-13T06:39:43.269 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.269 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.269 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:43.269 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.201976+0000", 2024-09-13T06:39:43.270 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4484000000000003e-05 2024-09-13T06:39:43.270 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.270 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.270 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:43.270 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.201997+0000", 2024-09-13T06:39:43.270 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0310999999999999e-05 2024-09-13T06:39:43.270 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.270 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.270 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:39:43.270 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.205118+0000", 2024-09-13T06:39:43.270 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0031218890000000001 2024-09-13T06:39:43.270 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.270 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.270 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:43.271 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.205155+0000", 2024-09-13T06:39:43.271 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.6807000000000002e-05 2024-09-13T06:39:43.271 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:43.271 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:43.271 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:43.271 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.271 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.271 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4385.0:2607 3.4 e31/21 3:26a6dcab:::rbd_data.11212429e5ad.0000000000000357:head v 31'5, mlcod=31'3)", 2024-09-13T06:39:43.271 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:39.238869+0000", 2024-09-13T06:39:43.271 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 3.9518774629999998, 2024-09-13T06:39:43.271 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0033590059999999999, 2024-09-13T06:39:43.271 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:43.272 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:43.272 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:43.272 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.272 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:43.272 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.238869+0000", 2024-09-13T06:39:43.272 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:43.272 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.272 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.272 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:43.272 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.238869+0000", 2024-09-13T06:39:43.272 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:43.272 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.272 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.273 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:43.273 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.238867+0000", 2024-09-13T06:39:43.273 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999981 2024-09-13T06:39:43.273 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.273 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.273 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:43.273 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.238882+0000", 2024-09-13T06:39:43.273 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5226e-05 2024-09-13T06:39:43.273 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.273 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.273 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:43.273 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.238976+0000", 2024-09-13T06:39:43.273 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.4423e-05 2024-09-13T06:39:43.274 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.274 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.274 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:43.274 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.238995+0000", 2024-09-13T06:39:43.274 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9066e-05 2024-09-13T06:39:43.274 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.274 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.274 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:43.274 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.239059+0000", 2024-09-13T06:39:43.274 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3744999999999994e-05 2024-09-13T06:39:43.274 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.274 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.275 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:43.275 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.239082+0000", 2024-09-13T06:39:43.275 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2405999999999999e-05 2024-09-13T06:39:43.275 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.275 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.275 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:39:43.275 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.242184+0000", 2024-09-13T06:39:43.275 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0031028850000000001 2024-09-13T06:39:43.275 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.275 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.275 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:43.275 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.242228+0000", 2024-09-13T06:39:43.275 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.3155000000000003e-05 2024-09-13T06:39:43.275 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:43.276 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:43.276 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:43.276 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.276 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.276 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4385.0:2610 3.0 e31/21 3:05b06d2f:::rbd_data.11212429e5ad.0000000000000367:head v 31'112, mlcod=31'110)", 2024-09-13T06:39:43.276 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:39.239230+0000", 2024-09-13T06:39:43.276 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 3.951516179, 2024-09-13T06:39:43.276 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0036041720000000001, 2024-09-13T06:39:43.276 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:43.276 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:43.276 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:43.276 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.276 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:43.277 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.239230+0000", 2024-09-13T06:39:43.277 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:43.277 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.277 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.277 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:43.277 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.239230+0000", 2024-09-13T06:39:43.277 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:43.277 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.277 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.277 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:43.277 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.239229+0000", 2024-09-13T06:39:43.277 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.999999 2024-09-13T06:39:43.278 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.278 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.278 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:43.278 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.239238+0000", 2024-09-13T06:39:43.278 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.2529999999999993e-06 2024-09-13T06:39:43.278 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.278 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.278 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:43.278 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.240075+0000", 2024-09-13T06:39:43.278 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00083642899999999997 2024-09-13T06:39:43.278 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.278 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.278 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:43.279 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.240084+0000", 2024-09-13T06:39:43.279 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.3160000000000003e-06 2024-09-13T06:39:43.279 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.279 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.279 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:43.279 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.240173+0000", 2024-09-13T06:39:43.279 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.9536999999999993e-05 2024-09-13T06:39:43.279 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.279 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.279 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:43.279 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.240192+0000", 2024-09-13T06:39:43.279 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8547999999999999e-05 2024-09-13T06:39:43.279 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.279 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.280 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:39:43.280 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.242758+0000", 2024-09-13T06:39:43.280 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.002565936 2024-09-13T06:39:43.280 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.280 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.280 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:43.280 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.242834+0000", 2024-09-13T06:39:43.280 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.6198999999999993e-05 2024-09-13T06:39:43.281 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:43.281 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:43.281 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:43.281 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.281 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.281 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4385.0:2665 3.0 e31/21 3:07d66135:::rbd_object_map.11212429e5ad:head v 31'127, mlcod=31'125)", 2024-09-13T06:39:43.281 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:39.384538+0000", 2024-09-13T06:39:43.281 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 3.8062078870000002, 2024-09-13T06:39:43.281 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00349468, 2024-09-13T06:39:43.281 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:43.281 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:43.281 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:43.281 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.282 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:43.282 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.384538+0000", 2024-09-13T06:39:43.282 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:43.282 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.282 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.282 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:43.282 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.384538+0000", 2024-09-13T06:39:43.282 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:43.282 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.282 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.282 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:43.282 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.384537+0000", 2024-09-13T06:39:43.282 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999986 2024-09-13T06:39:43.283 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.283 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.283 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:43.283 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.384548+0000", 2024-09-13T06:39:43.283 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1542999999999999e-05 2024-09-13T06:39:43.283 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.283 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.283 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:43.283 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.384571+0000", 2024-09-13T06:39:43.283 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2317e-05 2024-09-13T06:39:43.283 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.284 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.284 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:43.284 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.384579+0000", 2024-09-13T06:39:43.284 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.3140000000000004e-06 2024-09-13T06:39:43.284 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.284 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.285 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:43.285 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.384634+0000", 2024-09-13T06:39:43.285 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.5451999999999997e-05 2024-09-13T06:39:43.285 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.285 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.286 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:43.286 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.384663+0000", 2024-09-13T06:39:43.286 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.8419999999999999e-05 2024-09-13T06:39:43.286 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.286 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.286 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:39:43.286 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.387993+0000", 2024-09-13T06:39:43.286 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0033301630000000001 2024-09-13T06:39:43.286 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.287 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.287 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:43.287 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.388033+0000", 2024-09-13T06:39:43.287 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.9818999999999999e-05 2024-09-13T06:39:43.287 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:43.287 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:43.287 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:43.287 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:43.287 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:43.287 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:39:43.289 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-13T06:39:43.289 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:39:43.291+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:39:43.389 INFO:tasks.ceph.osd.6.smithi139.stderr:2024-09-13T06:39:43.390+0000 7fcd02c5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26385) UID: 0 2024-09-13T06:39:43.455 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:39:43.455 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-13T06:39:43.455 INFO:teuthology.orchestra.run.smithi081.stdout: "num_ops": 0 2024-09-13T06:39:43.455 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:39:43.470 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-13T06:39:43.485 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-13T06:39:43.516 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:39:43.519+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:39:43.591 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:39:43.595+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:39:43.597 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:39:43.597 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-13T06:39:43.597 INFO:teuthology.orchestra.run.smithi081.stdout: "complaint_time": 30, 2024-09-13T06:39:43.597 INFO:teuthology.orchestra.run.smithi081.stdout: "num_blocked_ops": 0 2024-09-13T06:39:43.597 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:39:43.612 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-13T06:39:43.693 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-13T06:39:43.694+0000 7f86a5f06640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26387) UID: 0 2024-09-13T06:39:43.776 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:39:43.776 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 20, 2024-09-13T06:39:43.776 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 600, 2024-09-13T06:39:43.776 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [ 2024-09-13T06:39:43.776 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.776 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4385.0:613 3.c e27/21 3:30175a4c:::rbd_header.11214e25756e:head v 27'34, mlcod=27'32)", 2024-09-13T06:39:43.776 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:34.844467+0000", 2024-09-13T06:39:43.776 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 8.9332315439999999, 2024-09-13T06:39:43.777 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0038627290000000001, 2024-09-13T06:39:43.777 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:43.777 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:43.777 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:43.777 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.777 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:43.777 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:34.844467+0000", 2024-09-13T06:39:43.777 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:43.777 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.777 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.777 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:43.777 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:34.844467+0000", 2024-09-13T06:39:43.778 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:43.778 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.778 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.778 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:43.778 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:34.844466+0000", 2024-09-13T06:39:43.778 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:39:43.778 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.778 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.778 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:43.778 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:34.844472+0000", 2024-09-13T06:39:43.778 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9410000000000004e-06 2024-09-13T06:39:43.778 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.778 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.779 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:43.779 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:34.844489+0000", 2024-09-13T06:39:43.779 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7218999999999999e-05 2024-09-13T06:39:43.779 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.779 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.779 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:43.779 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:34.844495+0000", 2024-09-13T06:39:43.779 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.4430000000000002e-06 2024-09-13T06:39:43.779 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.779 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.779 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:43.779 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:34.844553+0000", 2024-09-13T06:39:43.780 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8658e-05 2024-09-13T06:39:43.780 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.780 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.780 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:43.780 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:34.844578+0000", 2024-09-13T06:39:43.780 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5055999999999999e-05 2024-09-13T06:39:43.780 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.780 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.780 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:39:43.781 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:34.848256+0000", 2024-09-13T06:39:43.781 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.003677881 2024-09-13T06:39:43.781 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.781 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.781 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:43.781 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:34.848329+0000", 2024-09-13T06:39:43.781 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3221999999999998e-05 2024-09-13T06:39:43.781 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:43.781 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:43.781 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:43.781 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.781 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.781 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:2226 3.15 3:af026987:::rbd_data.112173e2f1b7.0000000000000017:head [sparse-read 0~4194304] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-13T06:39:43.781 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:37.606562+0000", 2024-09-13T06:39:43.782 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 6.1711366600000002, 2024-09-13T06:39:43.782 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.83322091700000001, 2024-09-13T06:39:43.782 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:43.782 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:39:43.782 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:39:43.782 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:39:43.782 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:43.782 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 2226 2024-09-13T06:39:43.782 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.782 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:43.782 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.782 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:43.782 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606562+0000", 2024-09-13T06:39:43.783 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:43.783 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.783 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.783 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:43.783 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606562+0000", 2024-09-13T06:39:43.783 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:43.783 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.783 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.783 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:43.783 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606561+0000", 2024-09-13T06:39:43.783 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:39:43.783 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.783 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.784 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:43.784 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606565+0000", 2024-09-13T06:39:43.784 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.4379999999999999e-06 2024-09-13T06:39:43.784 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.784 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.784 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:43.784 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606569+0000", 2024-09-13T06:39:43.784 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.425e-06 2024-09-13T06:39:43.784 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.784 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.784 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:43.784 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606572+0000", 2024-09-13T06:39:43.784 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.05e-06 2024-09-13T06:39:43.785 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.785 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.785 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:43.785 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606621+0000", 2024-09-13T06:39:43.785 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.8723000000000001e-05 2024-09-13T06:39:43.785 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.785 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.785 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:39:43.785 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606630+0000", 2024-09-13T06:39:43.785 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.8040000000000007e-06 2024-09-13T06:39:43.785 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.785 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.785 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:43.785 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.439648+0000", 2024-09-13T06:39:43.786 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.83301824800000002 2024-09-13T06:39:43.786 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.786 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.786 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:43.786 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.439782+0000", 2024-09-13T06:39:43.786 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00013466699999999999 2024-09-13T06:39:43.786 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:43.786 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:43.786 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:43.786 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.786 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.786 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:2280 3.15 3:a94cd9aa:::rbd_data.11212429e5ad.0000000000000076:head [set-alloc-hint object_size 262144 write_size 262144,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-13T06:39:43.786 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:38.669961+0000", 2024-09-13T06:39:43.786 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 5.1077371210000004, 2024-09-13T06:39:43.787 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.028162192999999999, 2024-09-13T06:39:43.787 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:43.787 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:43.787 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:39:43.787 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:39:43.787 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:43.787 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 2280 2024-09-13T06:39:43.787 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.787 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:43.787 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.787 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:43.787 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.669961+0000", 2024-09-13T06:39:43.787 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:43.788 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.788 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.788 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:43.788 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.669961+0000", 2024-09-13T06:39:43.788 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:43.788 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.788 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.788 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:43.788 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.669960+0000", 2024-09-13T06:39:43.788 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999986 2024-09-13T06:39:43.788 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.788 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.788 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:43.788 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.669968+0000", 2024-09-13T06:39:43.789 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.3429999999999996e-06 2024-09-13T06:39:43.789 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.789 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.789 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:43.789 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.669983+0000", 2024-09-13T06:39:43.789 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4722999999999999e-05 2024-09-13T06:39:43.789 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.789 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.789 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:43.789 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.669989+0000", 2024-09-13T06:39:43.789 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.4699999999999999e-06 2024-09-13T06:39:43.789 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.789 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.790 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:43.790 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.670034+0000", 2024-09-13T06:39:43.790 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4796000000000003e-05 2024-09-13T06:39:43.790 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.790 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.790 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:43.790 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.670138+0000", 2024-09-13T06:39:43.790 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00010367800000000001 2024-09-13T06:39:43.790 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.791 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.791 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 7", 2024-09-13T06:39:43.791 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.673689+0000", 2024-09-13T06:39:43.791 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0035515400000000002 2024-09-13T06:39:43.791 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.791 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.791 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-09-13T06:39:43.791 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.697921+0000", 2024-09-13T06:39:43.791 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.024231946000000001 2024-09-13T06:39:43.791 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.791 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.791 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:39:43.791 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.697984+0000", 2024-09-13T06:39:43.792 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.2885999999999994e-05 2024-09-13T06:39:43.792 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.792 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.792 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:39:43.792 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.698059+0000", 2024-09-13T06:39:43.792 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.538e-05 2024-09-13T06:39:43.792 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.792 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.792 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:43.793 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.698123+0000", 2024-09-13T06:39:43.793 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.4024999999999998e-05 2024-09-13T06:39:43.793 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:43.793 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:43.793 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:43.793 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.793 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.793 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop_reply(client.4385.0:2280 3.15 e31/30 ondisk, result = 0)", 2024-09-13T06:39:43.793 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:38.693889+0000", 2024-09-13T06:39:43.793 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 5.0838089039999996, 2024-09-13T06:39:43.794 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0042543499999999996, 2024-09-13T06:39:43.794 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:43.794 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:39:43.794 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:43.794 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.794 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:43.794 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.693889+0000", 2024-09-13T06:39:43.794 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:43.794 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.794 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.794 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:43.794 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.693889+0000", 2024-09-13T06:39:43.794 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:43.794 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.795 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.795 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:43.795 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.693887+0000", 2024-09-13T06:39:43.795 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999981 2024-09-13T06:39:43.795 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.795 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.795 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:43.795 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.693898+0000", 2024-09-13T06:39:43.795 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0679999999999999e-05 2024-09-13T06:39:43.795 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.795 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.795 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:43.795 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.693929+0000", 2024-09-13T06:39:43.796 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.0902999999999999e-05 2024-09-13T06:39:43.796 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.796 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.796 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:43.796 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.693945+0000", 2024-09-13T06:39:43.796 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5472999999999999e-05 2024-09-13T06:39:43.796 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.796 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.796 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:43.796 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.697958+0000", 2024-09-13T06:39:43.796 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0040138170000000003 2024-09-13T06:39:43.796 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.796 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.797 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:43.797 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.697973+0000", 2024-09-13T06:39:43.797 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.471e-05 2024-09-13T06:39:43.797 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.797 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.797 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:43.797 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.698144+0000", 2024-09-13T06:39:43.797 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00017060400000000001 2024-09-13T06:39:43.797 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:43.797 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:43.797 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:43.797 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.797 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.798 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:2334 3.18 3:1d18707c:::rbd_data.11212429e5ad.000000000000002d:head [delete] snapc 8=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-13T06:39:43.798 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:38.831972+0000", 2024-09-13T06:39:43.798 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 4.94572637, 2024-09-13T06:39:43.798 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0039621639999999998, 2024-09-13T06:39:43.798 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:43.798 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:39:43.798 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:39:43.798 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:39:43.798 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:43.798 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 2334 2024-09-13T06:39:43.798 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.798 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:43.798 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.798 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:43.799 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.831972+0000", 2024-09-13T06:39:43.799 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:43.799 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.799 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.799 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:43.799 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.831972+0000", 2024-09-13T06:39:43.799 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:43.799 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.799 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.799 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:43.799 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.831969+0000", 2024-09-13T06:39:43.800 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999971 2024-09-13T06:39:43.800 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.800 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.800 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:43.800 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.831981+0000", 2024-09-13T06:39:43.800 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.165e-05 2024-09-13T06:39:43.800 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.800 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.800 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:43.800 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.832014+0000", 2024-09-13T06:39:43.800 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.3597999999999999e-05 2024-09-13T06:39:43.800 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.800 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.801 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:43.801 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.832029+0000", 2024-09-13T06:39:43.801 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4617000000000001e-05 2024-09-13T06:39:43.801 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.801 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.801 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:43.801 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.832088+0000", 2024-09-13T06:39:43.801 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9369e-05 2024-09-13T06:39:43.801 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.801 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.801 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:43.801 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.832226+0000", 2024-09-13T06:39:43.801 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00013727600000000001 2024-09-13T06:39:43.802 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.802 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.802 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:43.802 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.835934+0000", 2024-09-13T06:39:43.802 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0037084230000000002 2024-09-13T06:39:43.802 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:43.802 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:43.802 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:43.802 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.802 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.802 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:2351 3.15 3:a8b7c3d8:::rbd_data.11212429e5ad.0000000000000044:head [delete] snapc 8=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-13T06:39:43.802 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:38.839360+0000", 2024-09-13T06:39:43.802 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 4.9383387079999999, 2024-09-13T06:39:43.803 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0056685679999999997, 2024-09-13T06:39:43.803 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:43.803 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:39:43.803 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:39:43.803 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:39:43.803 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:43.803 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 2351 2024-09-13T06:39:43.803 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.803 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:43.803 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.803 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:43.803 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.839360+0000", 2024-09-13T06:39:43.803 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:43.803 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.804 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.804 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:43.804 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.839360+0000", 2024-09-13T06:39:43.804 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:43.804 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.804 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.804 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:43.804 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.839358+0000", 2024-09-13T06:39:43.804 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999986 2024-09-13T06:39:43.804 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.804 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.804 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:43.804 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.839366+0000", 2024-09-13T06:39:43.805 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.2069999999999995e-06 2024-09-13T06:39:43.805 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.805 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.805 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:43.805 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.839382+0000", 2024-09-13T06:39:43.805 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5458e-05 2024-09-13T06:39:43.805 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.805 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.805 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:43.805 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.839389+0000", 2024-09-13T06:39:43.805 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3490000000000003e-06 2024-09-13T06:39:43.805 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.806 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.806 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:43.806 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.839436+0000", 2024-09-13T06:39:43.806 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6456999999999999e-05 2024-09-13T06:39:43.806 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.806 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.806 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:43.806 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.839540+0000", 2024-09-13T06:39:43.806 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00010473 2024-09-13T06:39:43.806 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.806 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.806 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:43.806 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.845028+0000", 2024-09-13T06:39:43.807 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0054877099999999998 2024-09-13T06:39:43.807 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:43.807 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:43.807 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:43.807 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.807 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.807 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:2357 3.15 3:a94cd9aa:::rbd_data.11212429e5ad.0000000000000076:head [delete] snapc 8=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-13T06:39:43.807 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:38.845199+0000", 2024-09-13T06:39:43.807 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 4.9324991359999997, 2024-09-13T06:39:43.807 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0041413279999999997, 2024-09-13T06:39:43.807 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:43.807 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:43.807 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:39:43.808 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:39:43.808 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:43.808 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 2357 2024-09-13T06:39:43.808 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.808 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:43.808 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.808 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:43.808 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.845199+0000", 2024-09-13T06:39:43.808 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:43.808 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.808 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.808 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:43.809 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.845199+0000", 2024-09-13T06:39:43.809 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:43.809 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.809 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.809 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:43.809 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.845198+0000", 2024-09-13T06:39:43.809 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.999999 2024-09-13T06:39:43.809 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.809 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.809 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:43.810 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.845204+0000", 2024-09-13T06:39:43.810 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7590000000000003e-06 2024-09-13T06:39:43.810 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.810 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.810 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:43.810 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.845220+0000", 2024-09-13T06:39:43.810 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5988e-05 2024-09-13T06:39:43.810 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.810 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.810 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:43.810 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.845228+0000", 2024-09-13T06:39:43.810 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.0369999999999995e-06 2024-09-13T06:39:43.810 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.810 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.811 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:43.811 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.845282+0000", 2024-09-13T06:39:43.811 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.4187000000000001e-05 2024-09-13T06:39:43.811 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.811 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.811 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:43.811 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.845406+0000", 2024-09-13T06:39:43.811 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000123695 2024-09-13T06:39:43.811 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.811 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.811 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 7", 2024-09-13T06:39:43.811 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.845582+0000", 2024-09-13T06:39:43.812 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00017596500000000001 2024-09-13T06:39:43.812 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.812 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.812 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-09-13T06:39:43.812 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.846244+0000", 2024-09-13T06:39:43.812 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00066242899999999997 2024-09-13T06:39:43.812 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.812 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.812 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:39:43.812 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.849256+0000", 2024-09-13T06:39:43.812 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.003011643 2024-09-13T06:39:43.812 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.812 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.813 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:39:43.813 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.849302+0000", 2024-09-13T06:39:43.813 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6449999999999997e-05 2024-09-13T06:39:43.813 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.813 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.813 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:43.813 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.849340+0000", 2024-09-13T06:39:43.813 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.8250000000000001e-05 2024-09-13T06:39:43.813 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:43.813 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:43.813 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:43.813 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.813 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.814 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:2371 3.1e 3:7b202373:::rbd_data.11212429e5ad.00000000000000ab:head [delete] snapc 8=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-13T06:39:43.814 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:38.849850+0000", 2024-09-13T06:39:43.814 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 4.927848462, 2024-09-13T06:39:43.814 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0042073730000000004, 2024-09-13T06:39:43.814 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:43.814 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:39:43.814 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:39:43.814 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:39:43.814 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:43.814 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 2371 2024-09-13T06:39:43.814 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.814 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:43.814 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.814 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:43.815 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.849850+0000", 2024-09-13T06:39:43.815 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:43.815 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.815 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.815 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:43.815 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.849850+0000", 2024-09-13T06:39:43.815 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:43.815 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.815 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.815 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:43.815 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.849849+0000", 2024-09-13T06:39:43.815 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.999999 2024-09-13T06:39:43.815 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.816 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.816 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:43.816 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.849856+0000", 2024-09-13T06:39:43.816 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.2169999999999997e-06 2024-09-13T06:39:43.816 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.816 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.816 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:43.816 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.849870+0000", 2024-09-13T06:39:43.816 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3560000000000001e-05 2024-09-13T06:39:43.816 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.816 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.816 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:43.816 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.849878+0000", 2024-09-13T06:39:43.816 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.2670000000000006e-06 2024-09-13T06:39:43.817 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.817 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.817 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:43.817 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.849926+0000", 2024-09-13T06:39:43.817 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.8572000000000002e-05 2024-09-13T06:39:43.817 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.817 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.817 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:43.817 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.850065+0000", 2024-09-13T06:39:43.817 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00013843199999999999 2024-09-13T06:39:43.817 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.817 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.817 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:43.818 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.854057+0000", 2024-09-13T06:39:43.818 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.003992359 2024-09-13T06:39:43.818 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:43.818 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:43.818 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:43.818 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.818 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.818 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:2372 3.8 3:173d1868:::rbd_data.11212429e5ad.00000000000000ac:head [delete] snapc 8=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-13T06:39:43.818 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:38.849888+0000", 2024-09-13T06:39:43.818 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 4.9278100949999999, 2024-09-13T06:39:43.818 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0042468810000000001, 2024-09-13T06:39:43.818 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:43.818 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:39:43.818 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:39:43.819 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:39:43.819 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:43.819 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 2372 2024-09-13T06:39:43.819 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.819 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:43.819 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.819 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:43.819 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.849888+0000", 2024-09-13T06:39:43.819 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:43.819 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.819 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.819 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:43.819 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.849888+0000", 2024-09-13T06:39:43.819 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:43.820 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.820 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.820 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:43.820 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.849888+0000", 2024-09-13T06:39:43.820 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:39:43.820 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.820 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.820 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:43.820 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.849890+0000", 2024-09-13T06:39:43.820 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.7350000000000001e-06 2024-09-13T06:39:43.820 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.820 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.820 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:43.820 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.849896+0000", 2024-09-13T06:39:43.821 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.1490000000000002e-06 2024-09-13T06:39:43.821 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.821 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.821 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:43.821 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.849900+0000", 2024-09-13T06:39:43.821 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.2010000000000001e-06 2024-09-13T06:39:43.821 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.821 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.821 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:43.821 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.849939+0000", 2024-09-13T06:39:43.821 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.9682999999999999e-05 2024-09-13T06:39:43.821 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.821 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.822 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:43.822 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.850053+0000", 2024-09-13T06:39:43.822 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00011350500000000001 2024-09-13T06:39:43.822 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.822 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.822 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:43.822 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.854135+0000", 2024-09-13T06:39:43.822 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0040820689999999998 2024-09-13T06:39:43.822 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:43.822 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:43.822 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:43.822 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.822 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.823 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "pg_update_log_missing(3.c epoch 31/21 rep_tid 76 entries 31'46 (0'0) error 3:33b14f9a:::rbd_data.11212429e5ad.00000000000000aa:head by client.4385.0:2370 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 28'44)", 2024-09-13T06:39:43.823 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:38.851137+0000", 2024-09-13T06:39:43.823 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 4.9265607280000001, 2024-09-13T06:39:43.823 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0055062599999999998, 2024-09-13T06:39:43.823 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:43.823 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:39:43.823 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:43.823 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.823 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:43.823 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.851137+0000", 2024-09-13T06:39:43.823 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:43.823 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.823 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.823 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:43.824 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.851137+0000", 2024-09-13T06:39:43.824 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:43.824 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.824 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.824 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:43.824 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.851136+0000", 2024-09-13T06:39:43.824 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.999999 2024-09-13T06:39:43.824 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.824 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.824 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:43.824 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.851148+0000", 2024-09-13T06:39:43.824 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1790999999999999e-05 2024-09-13T06:39:43.824 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.824 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.825 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:43.825 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.851171+0000", 2024-09-13T06:39:43.825 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3246000000000001e-05 2024-09-13T06:39:43.825 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.825 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.825 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:43.825 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.851187+0000", 2024-09-13T06:39:43.825 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5673999999999999e-05 2024-09-13T06:39:43.825 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.825 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.825 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:43.826 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.851426+0000", 2024-09-13T06:39:43.826 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000238722 2024-09-13T06:39:43.826 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.826 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.826 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:43.826 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.856644+0000", 2024-09-13T06:39:43.826 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0052179009999999996 2024-09-13T06:39:43.826 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:43.826 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:43.826 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:43.826 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.826 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.826 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:2430 3.8 3:157e7bb9:::rbd_data.11212429e5ad.0000000000000029:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-13T06:39:43.826 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:38.898223+0000", 2024-09-13T06:39:43.827 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 4.8794755460000001, 2024-09-13T06:39:43.827 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0062964479999999996, 2024-09-13T06:39:43.827 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:43.827 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:39:43.827 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:39:43.827 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:39:43.827 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:43.827 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 2430 2024-09-13T06:39:43.827 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.827 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:43.827 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.827 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:43.827 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.898223+0000", 2024-09-13T06:39:43.827 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:43.828 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.828 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.828 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:43.828 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.898223+0000", 2024-09-13T06:39:43.828 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:43.828 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.828 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.828 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:43.828 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.898221+0000", 2024-09-13T06:39:43.828 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999981 2024-09-13T06:39:43.828 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.828 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.828 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:43.829 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.898231+0000", 2024-09-13T06:39:43.829 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0149999999999999e-05 2024-09-13T06:39:43.829 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.829 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.829 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:43.829 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.898253+0000", 2024-09-13T06:39:43.829 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2639000000000001e-05 2024-09-13T06:39:43.829 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.829 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.829 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:43.829 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.898265+0000", 2024-09-13T06:39:43.829 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1381e-05 2024-09-13T06:39:43.829 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.829 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.830 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:43.830 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.898326+0000", 2024-09-13T06:39:43.830 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.1379999999999998e-05 2024-09-13T06:39:43.830 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.830 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.830 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:43.830 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.898490+0000", 2024-09-13T06:39:43.830 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000164155 2024-09-13T06:39:43.830 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.830 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.830 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:43.830 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.904519+0000", 2024-09-13T06:39:43.830 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0060287200000000004 2024-09-13T06:39:43.831 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:43.831 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:43.831 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:43.831 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.831 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.831 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4385.0:2637 3.c e31/21 3:34346ebf:::rbd_data.11212429e5ad.00000000000001e5:head v 31'49, mlcod=31'47)", 2024-09-13T06:39:43.831 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:39.288896+0000", 2024-09-13T06:39:43.831 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 4.4888023749999997, 2024-09-13T06:39:43.831 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0041430700000000004, 2024-09-13T06:39:43.831 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:43.831 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:43.831 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:43.831 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.831 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:43.832 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.288896+0000", 2024-09-13T06:39:43.832 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:43.832 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.832 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.832 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:43.832 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.288896+0000", 2024-09-13T06:39:43.832 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:43.832 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.832 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.832 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:43.832 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.288894+0000", 2024-09-13T06:39:43.832 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999976 2024-09-13T06:39:43.832 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.832 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.833 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:43.833 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.291185+0000", 2024-09-13T06:39:43.833 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0022910959999999998 2024-09-13T06:39:43.833 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.833 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.833 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:43.833 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.291213+0000", 2024-09-13T06:39:43.833 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.8537000000000001e-05 2024-09-13T06:39:43.833 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.833 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.833 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:43.833 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.291227+0000", 2024-09-13T06:39:43.833 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3506000000000001e-05 2024-09-13T06:39:43.834 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.834 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.834 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:43.834 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.291349+0000", 2024-09-13T06:39:43.834 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000122459 2024-09-13T06:39:43.834 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.834 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.834 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:43.834 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.291405+0000", 2024-09-13T06:39:43.834 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.5470000000000003e-05 2024-09-13T06:39:43.834 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.834 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.834 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:39:43.834 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.292980+0000", 2024-09-13T06:39:43.834 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0015756380000000001 2024-09-13T06:39:43.835 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.835 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.835 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:43.835 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.293039+0000", 2024-09-13T06:39:43.835 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8712999999999998e-05 2024-09-13T06:39:43.835 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:43.835 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:43.835 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:43.835 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.835 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.835 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:2679 3.15 3:afe512c8:::rbd_data.11212429e5ad.0000000000000084:head [delete] snapc 8=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-13T06:39:43.835 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:39.425673+0000", 2024-09-13T06:39:43.835 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 4.3520248559999999, 2024-09-13T06:39:43.836 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0051813859999999996, 2024-09-13T06:39:43.836 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:43.836 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:43.836 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:39:43.836 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:39:43.836 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:43.836 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 2679 2024-09-13T06:39:43.836 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.836 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:43.836 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.836 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:43.836 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.425673+0000", 2024-09-13T06:39:43.836 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:43.837 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.837 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.837 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:43.837 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.425673+0000", 2024-09-13T06:39:43.837 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:43.837 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.837 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.837 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:43.837 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.425671+0000", 2024-09-13T06:39:43.837 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999976 2024-09-13T06:39:43.838 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.838 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.838 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:43.838 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.425682+0000", 2024-09-13T06:39:43.838 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.11e-05 2024-09-13T06:39:43.838 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.838 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.838 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:43.838 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.425715+0000", 2024-09-13T06:39:43.838 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.2768000000000002e-05 2024-09-13T06:39:43.838 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.838 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.838 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:43.839 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.425731+0000", 2024-09-13T06:39:43.839 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5866e-05 2024-09-13T06:39:43.839 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.839 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.839 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:43.839 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.425779+0000", 2024-09-13T06:39:43.839 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.8322999999999998e-05 2024-09-13T06:39:43.839 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.839 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.839 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:43.839 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.425869+0000", 2024-09-13T06:39:43.839 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.9985e-05 2024-09-13T06:39:43.839 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.840 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.840 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 7", 2024-09-13T06:39:43.840 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.425985+0000", 2024-09-13T06:39:43.840 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000115633 2024-09-13T06:39:43.840 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.840 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.840 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-09-13T06:39:43.840 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.426776+0000", 2024-09-13T06:39:43.840 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00079090499999999995 2024-09-13T06:39:43.840 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.840 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.840 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:39:43.840 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.430767+0000", 2024-09-13T06:39:43.841 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0039910040000000003 2024-09-13T06:39:43.841 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.841 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.841 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:39:43.841 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.430814+0000", 2024-09-13T06:39:43.841 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7633999999999998e-05 2024-09-13T06:39:43.845 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.845 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.845 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:43.845 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.430855+0000", 2024-09-13T06:39:43.845 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.0596999999999998e-05 2024-09-13T06:39:43.845 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:43.845 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:43.845 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:43.846 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.846 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.846 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:2686 3.7 3:e797442e:::rbd_data.11212429e5ad.00000000000000da:head [delete] snapc 8=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-13T06:39:43.846 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:39.425784+0000", 2024-09-13T06:39:43.846 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 4.3519144289999998, 2024-09-13T06:39:43.846 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0045158100000000003, 2024-09-13T06:39:43.846 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:43.846 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:43.846 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:39:43.846 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:39:43.846 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:43.846 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 2686 2024-09-13T06:39:43.846 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.847 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:43.847 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.847 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:43.847 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.425784+0000", 2024-09-13T06:39:43.847 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:43.847 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.847 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.847 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:43.847 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.425784+0000", 2024-09-13T06:39:43.847 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:43.847 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.847 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.847 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:43.847 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.425783+0000", 2024-09-13T06:39:43.848 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:39:43.848 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.848 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.848 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:43.848 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.425787+0000", 2024-09-13T06:39:43.848 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.7699999999999999e-06 2024-09-13T06:39:43.848 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.848 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.848 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:43.848 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.425796+0000", 2024-09-13T06:39:43.848 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.5329999999999994e-06 2024-09-13T06:39:43.848 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.848 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.849 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:43.849 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.425802+0000", 2024-09-13T06:39:43.849 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.798e-06 2024-09-13T06:39:43.849 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.849 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.849 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:43.849 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.425853+0000", 2024-09-13T06:39:43.849 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.1075999999999997e-05 2024-09-13T06:39:43.849 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.849 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.849 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:43.849 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.425940+0000", 2024-09-13T06:39:43.849 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.6932e-05 2024-09-13T06:39:43.850 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.850 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.850 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 7", 2024-09-13T06:39:43.850 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.426054+0000", 2024-09-13T06:39:43.850 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000113266 2024-09-13T06:39:43.850 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.850 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.850 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-09-13T06:39:43.850 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.426772+0000", 2024-09-13T06:39:43.850 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00071808899999999999 2024-09-13T06:39:43.850 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.850 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.850 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:39:43.850 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.430225+0000", 2024-09-13T06:39:43.851 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0034537639999999998 2024-09-13T06:39:43.851 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.851 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.851 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:39:43.851 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.430253+0000", 2024-09-13T06:39:43.851 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.7912999999999999e-05 2024-09-13T06:39:43.851 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.851 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.851 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:43.851 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.430300+0000", 2024-09-13T06:39:43.851 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6233000000000003e-05 2024-09-13T06:39:43.851 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:43.851 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:43.852 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:43.852 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.852 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.852 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:2695 3.8 3:11c8caf4:::rbd_data.11212429e5ad.00000000000001c7:head [delete] snapc 8=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-13T06:39:43.852 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:39.430982+0000", 2024-09-13T06:39:43.852 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 4.3467158210000001, 2024-09-13T06:39:43.852 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0039220080000000003, 2024-09-13T06:39:43.852 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:43.852 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:43.852 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:39:43.852 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:39:43.852 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:43.852 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 2695 2024-09-13T06:39:43.852 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.853 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:43.853 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.853 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:43.853 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.430982+0000", 2024-09-13T06:39:43.853 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:43.853 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.853 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.853 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:43.853 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.430982+0000", 2024-09-13T06:39:43.853 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:43.853 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.853 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.853 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:43.854 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.430981+0000", 2024-09-13T06:39:43.854 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.999999 2024-09-13T06:39:43.854 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.854 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.854 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:43.854 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.430988+0000", 2024-09-13T06:39:43.854 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.6649999999999997e-06 2024-09-13T06:39:43.854 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.854 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.854 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:43.854 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.431000+0000", 2024-09-13T06:39:43.854 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1474000000000001e-05 2024-09-13T06:39:43.854 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.854 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.855 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:43.855 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.431006+0000", 2024-09-13T06:39:43.855 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3600000000000001e-06 2024-09-13T06:39:43.855 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.855 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.855 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:43.855 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.431069+0000", 2024-09-13T06:39:43.855 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.2880999999999996e-05 2024-09-13T06:39:43.855 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.855 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.855 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:43.855 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.431175+0000", 2024-09-13T06:39:43.855 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000106437 2024-09-13T06:39:43.856 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.856 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.856 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 1", 2024-09-13T06:39:43.856 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.431303+0000", 2024-09-13T06:39:43.856 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00012734000000000001 2024-09-13T06:39:43.856 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.856 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.856 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-09-13T06:39:43.856 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.432165+0000", 2024-09-13T06:39:43.856 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00086203400000000002 2024-09-13T06:39:43.856 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.856 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.856 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:39:43.857 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.434813+0000", 2024-09-13T06:39:43.857 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.002647965 2024-09-13T06:39:43.857 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.857 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.857 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:39:43.857 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.434861+0000", 2024-09-13T06:39:43.857 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.8445000000000001e-05 2024-09-13T06:39:43.857 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.857 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.857 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:43.857 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.434904+0000", 2024-09-13T06:39:43.857 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.3401e-05 2024-09-13T06:39:43.857 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:43.857 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:43.858 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:43.858 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.858 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.858 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:3390 3.7 3:e3024cb3:::rbd_data.11217e777cf4.0000000000000004:head [write 348891~44325] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-13T06:39:43.858 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:42.779589+0000", 2024-09-13T06:39:43.858 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.99810922400000002, 2024-09-13T06:39:43.858 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0040594749999999999, 2024-09-13T06:39:43.858 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:43.858 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:43.859 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:39:43.859 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:39:43.859 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:43.859 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 3390 2024-09-13T06:39:43.859 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.859 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:43.859 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.859 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:43.860 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:42.779589+0000", 2024-09-13T06:39:43.860 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:43.860 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.860 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.860 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:43.860 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:42.779589+0000", 2024-09-13T06:39:43.860 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:43.860 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.860 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.860 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:43.860 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:42.779587+0000", 2024-09-13T06:39:43.860 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999976 2024-09-13T06:39:43.860 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.860 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.861 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:43.861 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:42.779639+0000", 2024-09-13T06:39:43.861 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2027000000000002e-05 2024-09-13T06:39:43.861 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.861 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.861 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:43.861 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:42.779661+0000", 2024-09-13T06:39:43.861 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2455000000000001e-05 2024-09-13T06:39:43.861 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.861 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.861 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:43.861 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:42.779674+0000", 2024-09-13T06:39:43.861 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2809999999999999e-05 2024-09-13T06:39:43.862 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.862 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.862 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:43.862 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:42.779740+0000", 2024-09-13T06:39:43.862 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.5896999999999996e-05 2024-09-13T06:39:43.862 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.862 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.862 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:43.862 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:42.779832+0000", 2024-09-13T06:39:43.862 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.2143000000000002e-05 2024-09-13T06:39:43.862 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.862 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.862 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 7", 2024-09-13T06:39:43.862 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:42.779970+0000", 2024-09-13T06:39:43.863 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00013752799999999999 2024-09-13T06:39:43.863 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.863 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.863 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:39:43.863 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:42.782260+0000", 2024-09-13T06:39:43.863 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0022905260000000002 2024-09-13T06:39:43.863 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.863 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.863 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-09-13T06:39:43.863 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:42.783570+0000", 2024-09-13T06:39:43.863 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.001309866 2024-09-13T06:39:43.863 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.864 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.864 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:39:43.864 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:42.783613+0000", 2024-09-13T06:39:43.864 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.3275000000000002e-05 2024-09-13T06:39:43.864 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.864 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.864 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:43.864 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:42.783648+0000", 2024-09-13T06:39:43.864 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.5212000000000001e-05 2024-09-13T06:39:43.864 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:43.864 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:43.865 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:43.865 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.865 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.865 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:3391 3.8 3:16b1c06a:::rbd_data.11217e777cf4.0000000000000005:head [write 327680~10611] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-13T06:39:43.865 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:42.779693+0000", 2024-09-13T06:39:43.865 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.99800526899999997, 2024-09-13T06:39:43.865 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0041685840000000004, 2024-09-13T06:39:43.865 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:43.865 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:43.865 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:39:43.865 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:39:43.865 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:43.865 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 3391 2024-09-13T06:39:43.865 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.866 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:43.866 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.866 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:43.866 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:42.779693+0000", 2024-09-13T06:39:43.866 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:43.866 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.866 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.866 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:43.866 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:42.779693+0000", 2024-09-13T06:39:43.866 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:43.866 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.866 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.866 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:43.866 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:42.779692+0000", 2024-09-13T06:39:43.867 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.999999 2024-09-13T06:39:43.867 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.867 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.867 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:43.867 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:42.779721+0000", 2024-09-13T06:39:43.867 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9286e-05 2024-09-13T06:39:43.867 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.867 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.867 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:43.867 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:42.779733+0000", 2024-09-13T06:39:43.867 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.163e-05 2024-09-13T06:39:43.867 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.867 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.867 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:43.868 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:42.779741+0000", 2024-09-13T06:39:43.868 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.1929999999999993e-06 2024-09-13T06:39:43.868 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.868 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.868 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:43.868 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:42.779790+0000", 2024-09-13T06:39:43.868 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9166999999999999e-05 2024-09-13T06:39:43.868 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.868 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.868 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:43.868 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:42.779841+0000", 2024-09-13T06:39:43.868 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0912999999999999e-05 2024-09-13T06:39:43.868 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.869 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.869 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 1", 2024-09-13T06:39:43.869 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:42.779981+0000", 2024-09-13T06:39:43.869 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000139505 2024-09-13T06:39:43.869 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.869 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.869 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-09-13T06:39:43.869 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:42.781017+0000", 2024-09-13T06:39:43.869 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.001036251 2024-09-13T06:39:43.869 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.869 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.869 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:39:43.869 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:42.783765+0000", 2024-09-13T06:39:43.870 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.002747892 2024-09-13T06:39:43.870 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.870 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.870 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:39:43.870 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:42.783807+0000", 2024-09-13T06:39:43.870 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.1544000000000001e-05 2024-09-13T06:39:43.870 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.870 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.870 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:43.870 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:42.783862+0000", 2024-09-13T06:39:43.870 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.5015000000000001e-05 2024-09-13T06:39:43.870 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:43.870 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:43.871 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:43.871 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.871 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.871 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:3406 3.8 3:16b1c06a:::rbd_data.11217e777cf4.0000000000000005:head [write 503101~21187] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-13T06:39:43.871 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:42.806222+0000", 2024-09-13T06:39:43.871 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.97147624499999996, 2024-09-13T06:39:43.871 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0050034149999999998, 2024-09-13T06:39:43.871 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:43.871 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:43.871 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:39:43.871 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:39:43.871 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:43.871 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 3406 2024-09-13T06:39:43.871 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.872 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:43.872 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.872 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:43.872 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:42.806222+0000", 2024-09-13T06:39:43.872 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:43.872 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.872 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.872 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:43.872 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:42.806222+0000", 2024-09-13T06:39:43.872 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:43.872 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.872 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.872 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:43.873 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:42.806221+0000", 2024-09-13T06:39:43.873 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.999999 2024-09-13T06:39:43.873 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.873 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.873 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:43.873 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:42.806247+0000", 2024-09-13T06:39:43.873 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5918000000000002e-05 2024-09-13T06:39:43.873 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.873 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.873 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:43.873 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:42.806261+0000", 2024-09-13T06:39:43.873 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3831e-05 2024-09-13T06:39:43.873 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.874 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.874 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:43.874 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:42.806268+0000", 2024-09-13T06:39:43.874 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.0740000000000004e-06 2024-09-13T06:39:43.874 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.874 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.874 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:43.874 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:42.806320+0000", 2024-09-13T06:39:43.874 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.1771999999999998e-05 2024-09-13T06:39:43.874 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.874 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.874 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:43.874 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:42.806417+0000", 2024-09-13T06:39:43.874 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.7719000000000004e-05 2024-09-13T06:39:43.875 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.875 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.875 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 1", 2024-09-13T06:39:43.875 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:42.806562+0000", 2024-09-13T06:39:43.875 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00014434800000000001 2024-09-13T06:39:43.875 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.875 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.875 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-09-13T06:39:43.875 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:42.811053+0000", 2024-09-13T06:39:43.875 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0044913879999999998 2024-09-13T06:39:43.875 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.875 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.875 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:39:43.875 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:42.811164+0000", 2024-09-13T06:39:43.876 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000110566 2024-09-13T06:39:43.876 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.876 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.876 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:39:43.876 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:42.811195+0000", 2024-09-13T06:39:43.876 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.1099999999999997e-05 2024-09-13T06:39:43.876 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.876 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.876 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:43.876 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:42.811225+0000", 2024-09-13T06:39:43.876 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.0772000000000003e-05 2024-09-13T06:39:43.877 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:43.877 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:43.877 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:43.877 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.877 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.877 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:3418 3.15 3:ac5106ea:::rbd_data.11217e777cf4.0000000000000011:head [set-alloc-hint object_size 524288 write_size 524288,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-13T06:39:43.877 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:42.830227+0000", 2024-09-13T06:39:43.877 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.947470861, 2024-09-13T06:39:43.877 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017034491999999998, 2024-09-13T06:39:43.877 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:43.877 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:43.878 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:39:43.878 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:39:43.878 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:43.878 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 3418 2024-09-13T06:39:43.878 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.878 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:43.878 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.878 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:43.878 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:42.830227+0000", 2024-09-13T06:39:43.878 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:43.878 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.878 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.878 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:43.879 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:42.830227+0000", 2024-09-13T06:39:43.879 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:43.879 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.879 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.879 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:43.879 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:42.830226+0000", 2024-09-13T06:39:43.879 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999986 2024-09-13T06:39:43.879 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.879 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.879 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:43.879 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:42.830233+0000", 2024-09-13T06:39:43.879 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.9700000000000002e-06 2024-09-13T06:39:43.879 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.880 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.880 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:43.880 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:42.830248+0000", 2024-09-13T06:39:43.880 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5617999999999999e-05 2024-09-13T06:39:43.880 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.880 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.880 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:43.880 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:42.830256+0000", 2024-09-13T06:39:43.880 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.0169999999999996e-06 2024-09-13T06:39:43.880 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.880 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.880 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:43.880 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:42.830295+0000", 2024-09-13T06:39:43.881 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.8609999999999998e-05 2024-09-13T06:39:43.881 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.881 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.881 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:43.881 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:42.830390+0000", 2024-09-13T06:39:43.881 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.5253000000000004e-05 2024-09-13T06:39:43.881 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.881 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.882 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 7", 2024-09-13T06:39:43.882 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:42.833415+0000", 2024-09-13T06:39:43.882 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.003024704 2024-09-13T06:39:43.882 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.882 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.882 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-09-13T06:39:43.882 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:42.847160+0000", 2024-09-13T06:39:43.882 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.013745215999999999 2024-09-13T06:39:43.882 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.882 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.882 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:39:43.882 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:42.847195+0000", 2024-09-13T06:39:43.883 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.4585000000000002e-05 2024-09-13T06:39:43.883 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.883 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.883 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:39:43.883 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:42.847232+0000", 2024-09-13T06:39:43.883 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.6743999999999999e-05 2024-09-13T06:39:43.883 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.883 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.883 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:43.883 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:42.847262+0000", 2024-09-13T06:39:43.883 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.0249000000000001e-05 2024-09-13T06:39:43.883 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:43.883 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:43.883 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:43.883 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.884 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.884 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop_reply(client.4385.0:3418 3.15 e34/30 ondisk, result = 0)", 2024-09-13T06:39:43.884 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:42.841093+0000", 2024-09-13T06:39:43.884 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.93660499699999999, 2024-09-13T06:39:43.884 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0061745799999999998, 2024-09-13T06:39:43.884 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:43.884 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:39:43.884 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:43.884 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.884 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:43.884 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:42.841093+0000", 2024-09-13T06:39:43.884 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:43.884 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.885 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.885 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:43.885 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:42.841093+0000", 2024-09-13T06:39:43.885 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:43.885 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.885 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.885 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:43.885 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:42.841092+0000", 2024-09-13T06:39:43.885 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.999999 2024-09-13T06:39:43.885 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.885 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.885 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:43.885 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:42.841100+0000", 2024-09-13T06:39:43.885 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.3159999999999997e-06 2024-09-13T06:39:43.886 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.886 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.886 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:43.886 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:42.841117+0000", 2024-09-13T06:39:43.886 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6537000000000001e-05 2024-09-13T06:39:43.886 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.886 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.886 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:43.886 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:42.841127+0000", 2024-09-13T06:39:43.886 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0232e-05 2024-09-13T06:39:43.886 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.886 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.886 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:43.886 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:42.847182+0000", 2024-09-13T06:39:43.887 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0060546549999999999 2024-09-13T06:39:43.887 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.887 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.887 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:43.887 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:42.847190+0000", 2024-09-13T06:39:43.887 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.6290000000000001e-06 2024-09-13T06:39:43.887 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:43.887 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:43.887 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:43.887 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:42.847268+0000", 2024-09-13T06:39:43.887 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.8301999999999997e-05 2024-09-13T06:39:43.887 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:43.887 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:43.887 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:43.887 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:43.888 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:43.888 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:39:43.889 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-13T06:39:43.890 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:39:43.894+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:39:43.991 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:39:43.995+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:39:44.021 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:39:44.021 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [], 2024-09-13T06:39:44.021 INFO:teuthology.orchestra.run.smithi139.stdout: "num_ops": 0 2024-09-13T06:39:44.021 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:39:44.035 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-13T06:39:44.091 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:39:44.090+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:39:44.116 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-13T06:39:44.153 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:39:44.153 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [], 2024-09-13T06:39:44.153 INFO:teuthology.orchestra.run.smithi139.stdout: "complaint_time": 30, 2024-09-13T06:39:44.153 INFO:teuthology.orchestra.run.smithi139.stdout: "num_blocked_ops": 0 2024-09-13T06:39:44.154 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:39:44.169 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-13T06:39:44.212 INFO:tasks.ceph.osd.6.smithi139.stderr:2024-09-13T06:39:44.214+0000 7fcd02c5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26385) UID: 0 2024-09-13T06:39:44.270 INFO:teuthology.orchestra.run.smithi081.stdout:osd.0: {} 2024-09-13T06:39:44.271 INFO:teuthology.orchestra.run.smithi081.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-13T06:39:44.287 INFO:teuthology.orchestra.run.smithi081.stdout:osd.1: {} 2024-09-13T06:39:44.287 INFO:teuthology.orchestra.run.smithi081.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-13T06:39:44.292 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:39:44.295+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:39:44.302 INFO:teuthology.orchestra.run.smithi081.stdout:osd.2: {} 2024-09-13T06:39:44.303 INFO:teuthology.orchestra.run.smithi081.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-13T06:39:44.319 INFO:teuthology.orchestra.run.smithi081.stdout:osd.3: {} 2024-09-13T06:39:44.319 INFO:teuthology.orchestra.run.smithi081.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-13T06:39:44.340 INFO:teuthology.orchestra.run.smithi081.stdout:osd.4: {} 2024-09-13T06:39:44.340 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:39:44.340 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:39:44.340 INFO:teuthology.orchestra.run.smithi081.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-13T06:39:44.355 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-13T06:39:44.360 INFO:teuthology.orchestra.run.smithi081.stdout:osd.5: {} 2024-09-13T06:39:44.360 INFO:teuthology.orchestra.run.smithi081.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-13T06:39:44.379 INFO:teuthology.orchestra.run.smithi081.stdout:osd.6: {} 2024-09-13T06:39:44.379 INFO:teuthology.orchestra.run.smithi081.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-13T06:39:44.396 INFO:teuthology.orchestra.run.smithi081.stdout:osd.7: {} 2024-09-13T06:39:44.396 INFO:teuthology.orchestra.run.smithi081.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-13T06:39:44.399 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:39:44.402+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:39:44.478 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:39:44.478 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:39:44.487 INFO:teuthology.orchestra.run.smithi081.stderr:noscrub is unset 2024-09-13T06:39:44.494 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-13T06:39:44.495 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:39:44.494+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:39:44.595 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:39:44.599+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:39:44.655 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:39:44.655 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:39:44.670 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-13T06:39:44.715 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:39:44.718+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:39:44.790 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:39:44.790 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:39:44.798 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:39:44.799+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:39:44.804 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-13T06:39:44.898 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:39:44.899+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:39:44.972 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:39:44.972 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:39:44.986 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-13T06:39:45.031 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-13T06:39:45.034+0000 7f86a5f06640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26387) UID: 0 2024-09-13T06:39:45.100 INFO:tasks.ceph.osd.6.smithi139.stderr:2024-09-13T06:39:45.102+0000 7fcd02c5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26385) UID: 0 2024-09-13T06:39:45.109 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:39:45.109 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:39:45.123 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-13T06:39:45.201 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:39:45.203+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:39:45.284 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:39:45.284 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:39:45.298 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-13T06:39:45.301 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:39:45.303+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:39:45.402 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-13T06:39:45.402+0000 7f86a5f06640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26387) UID: 0 2024-09-13T06:39:45.414 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:39:45.414 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:39:45.428 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-13T06:39:45.503 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:39:45.507+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:39:45.597 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:39:45.597 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:39:45.604 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:39:45.607+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:39:45.611 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-13T06:39:45.704 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:39:45.706+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:39:45.733 INFO:teuthology.orchestra.run.smithi081.stdout:checking clone #2, image image_client.0-clone2 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent3 2024-09-13T06:39:45.738 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:39:45.738 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:39:45.753 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-13T06:39:45.805 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:39:45.807+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:39:45.851 INFO:teuthology.orchestra.run.smithi081.stdout:433 write 0x3442925 thru 0x3445b17 (0x31f3 bytes) 2024-09-13T06:39:45.863 INFO:teuthology.orchestra.run.smithi081.stdout:435 trunc from 0xe166a66 to 0xe9690f3 2024-09-13T06:39:45.873 INFO:teuthology.orchestra.run.smithi081.stdout:436 read 0x5c3f2f8 thru 0x5c480ca (0x8dd3 bytes) 2024-09-13T06:39:45.874 INFO:teuthology.orchestra.run.smithi081.stdout:439 write 0x7dd2834 thru 0x7de031d (0xdaea bytes) 2024-09-13T06:39:45.878 INFO:teuthology.orchestra.run.smithi081.stdout:440 punch from 0x66a25da to 0x66ac473, (0x9e99 bytes) 2024-09-13T06:39:45.895 INFO:teuthology.orchestra.run.smithi081.stdout:441 trunc from 0xe9690f3 to 0x2a1f8da 2024-09-13T06:39:45.907 INFO:tasks.ceph.osd.6.smithi139.stderr:2024-09-13T06:39:45.906+0000 7fcd02c5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26385) UID: 0 2024-09-13T06:39:45.912 INFO:teuthology.orchestra.run.smithi081.stdout:442 punch from 0x61f269 to 0x621711, (0x24a8 bytes) 2024-09-13T06:39:45.915 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:39:45.915 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:39:45.938 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-13T06:39:45.939 INFO:teuthology.orchestra.run.smithi081.stdout:444 write 0xe92cc2f thru 0xe93c069 (0xf43b bytes) 2024-09-13T06:39:45.945 INFO:teuthology.orchestra.run.smithi081.stdout:445 punch from 0x519755e to 0x519b8a0, (0x4342 bytes) 2024-09-13T06:39:45.945 INFO:teuthology.orchestra.run.smithi081.stdout:446 write 0xc257615 thru 0xc25a3c4 (0x2db0 bytes) 2024-09-13T06:39:45.947 INFO:teuthology.orchestra.run.smithi081.stdout:448 read 0x51db9ef thru 0x51dd79b (0x1dad bytes) 2024-09-13T06:39:45.948 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:39:45.948 INFO:teuthology.orchestra.run.smithi081.stdout:450 write 0x4261393 thru 0x4269968 (0x85d6 bytes) 2024-09-13T06:39:45.953 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:39:45.954 INFO:teuthology.orchestra.run.smithi081.stdout:452 read 0x50e75f4 thru 0x50eac00 (0x360d bytes) 2024-09-13T06:39:45.954 INFO:teuthology.orchestra.run.smithi081.stdout:453 read 0x2af96d8 thru 0x2afbdba (0x26e3 bytes) 2024-09-13T06:39:45.954 INFO:teuthology.orchestra.run.smithi081.stdout:456 writesame 0x3137de0 thru 0x3146ba9 data_size 0xb(0xedca bytes) 2024-09-13T06:39:45.961 INFO:teuthology.orchestra.run.smithi081.stdout:457 writesame 0x34f5470 thru 0x34f8326 data_size 0x1(0x2eb7 bytes) 2024-09-13T06:39:45.967 INFO:teuthology.orchestra.run.smithi081.stdout:458 writesame 0xe2e3f0e thru 0xe2ea754 data_size 0x13(0x6847 bytes) 2024-09-13T06:39:45.969 INFO:teuthology.orchestra.run.smithi081.stdout:460 read 0xb8c61af thru 0xb8d0a2e (0xa880 bytes) 2024-09-13T06:39:45.970 INFO:teuthology.orchestra.run.smithi081.stdout:461 punch from 0x5ddf07d to 0x5de75ca, (0x854d bytes) 2024-09-13T06:39:45.979 INFO:teuthology.orchestra.run.smithi081.stdout:462 trunc from 0xe93c06a to 0x8d7f2e4 2024-09-13T06:39:45.994 INFO:teuthology.orchestra.run.smithi081.stdout:463 punch from 0x85c6784 to 0x85c6e50, (0x6cc bytes) 2024-09-13T06:39:45.994 INFO:teuthology.orchestra.run.smithi081.stdout:465 read 0x269e52e thru 0x26a206c (0x3b3f bytes) 2024-09-13T06:39:45.994 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:39:46.008 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:39:46.011+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:39:46.011 INFO:teuthology.orchestra.run.smithi081.stdout:467 writesame 0xe20ccbc thru 0xe210bd5 data_size 0x2(0x3f1a bytes) 2024-09-13T06:39:46.012 INFO:teuthology.orchestra.run.smithi081.stdout:469 writesame 0xbbb13d3 thru 0xbbb1bfe data_size 0x2(0x82c bytes) 2024-09-13T06:39:46.015 INFO:teuthology.orchestra.run.smithi081.stdout:470 write 0x6b8b853 thru 0x6b9a5f0 (0xed9e bytes) 2024-09-13T06:39:46.018 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:39:46.018 INFO:teuthology.orchestra.run.smithi081.stdout:472 write 0x4b8e29f thru 0x4b8f92d (0x168f bytes) 2024-09-13T06:39:46.024 INFO:teuthology.orchestra.run.smithi081.stdout:474 punch from 0x91926a6 to 0x919c698, (0x9ff2 bytes) 2024-09-13T06:39:46.024 INFO:teuthology.orchestra.run.smithi081.stdout:476 write 0x2f1a2f0 thru 0x2f243a9 (0xa0ba bytes) 2024-09-13T06:39:46.026 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:39:46.026 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:39:46.026 INFO:teuthology.orchestra.run.smithi081.stdout:479 read 0xbc345ce thru 0xbc35f48 (0x197b bytes) 2024-09-13T06:39:46.026 INFO:teuthology.orchestra.run.smithi081.stdout:480 write 0xbda8e5a thru 0xbdae1f6 (0x539d bytes) 2024-09-13T06:39:46.028 INFO:teuthology.orchestra.run.smithi081.stdout:481 writesame 0x4d12555 thru 0x4d1f0a7 data_size 0x1(0xcb53 bytes) 2024-09-13T06:39:46.053 INFO:teuthology.orchestra.run.smithi081.stdout:483 write 0x882a808 thru 0x882afe4 (0x7dd bytes) 2024-09-13T06:39:46.055 INFO:teuthology.orchestra.run.smithi081.stdout:484 read 0x9a59107 thru 0x9a5bd94 (0x2c8e bytes) 2024-09-13T06:39:46.056 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:39:46.056 INFO:teuthology.orchestra.run.smithi081.stdout:487 punch from 0xe0b7d5e to 0xe0be59b, (0x683d bytes) 2024-09-13T06:39:46.056 INFO:teuthology.orchestra.run.smithi081.stdout:489 write 0x46662db thru 0x46712dd (0xb003 bytes) 2024-09-13T06:39:46.058 INFO:teuthology.orchestra.run.smithi081.stdout:491 read 0xadc7d0a thru 0xadcaf0d (0x3204 bytes) 2024-09-13T06:39:46.058 INFO:teuthology.orchestra.run.smithi081.stdout:492 write 0x4b6133d thru 0x4b63938 (0x25fc bytes) 2024-09-13T06:39:46.061 INFO:teuthology.orchestra.run.smithi081.stdout:493 writesame 0x498bdce thru 0x49987b8 data_size 0x1(0xc9eb bytes) 2024-09-13T06:39:46.073 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:39:46.073 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:39:46.084 INFO:teuthology.orchestra.run.smithi081.stdout:494 writesame 0x6189551 thru 0x619380f data_size 0x1(0xa2bf bytes) 2024-09-13T06:39:46.089 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-13T06:39:46.108 INFO:teuthology.orchestra.run.smithi081.stdout:495 trunc from 0xe210bd6 to 0xca3d27a 2024-09-13T06:39:46.109 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:39:46.110+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:39:46.120 INFO:teuthology.orchestra.run.smithi081.stdout:496 writesame 0x72a16cc thru 0x72ae769 data_size 0x6(0xd09e bytes) 2024-09-13T06:39:46.126 INFO:teuthology.orchestra.run.smithi081.stdout:497 write 0xb734859 thru 0xb73866a (0x3e12 bytes) 2024-09-13T06:39:46.128 INFO:teuthology.orchestra.run.smithi081.stdout:498 read 0xbea90ca thru 0xbeb891b (0xf852 bytes) 2024-09-13T06:39:46.129 INFO:teuthology.orchestra.run.smithi081.stdout:499 punch from 0x8a26dc5 to 0x8a2f7e1, (0x8a1c bytes) 2024-09-13T06:39:46.129 INFO:teuthology.orchestra.run.smithi081.stdout:500 write 0x9b9d86b thru 0x9ba76a5 (0x9e3b bytes) 2024-09-13T06:39:46.132 INFO:teuthology.orchestra.run.smithi081.stdout:501 punch from 0x279b78b to 0x27a383a, (0x80af bytes) 2024-09-13T06:39:46.132 INFO:teuthology.orchestra.run.smithi081.stdout:503 writesame 0x36b3052 thru 0x36b3ddc data_size 0x1(0xd8b bytes) 2024-09-13T06:39:46.134 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:39:46.134 INFO:teuthology.orchestra.run.smithi081.stdout:505 writesame 0x89a1589 thru 0x89ae5be data_size 0x1d(0xd036 bytes) 2024-09-13T06:39:46.136 INFO:teuthology.orchestra.run.smithi081.stdout:508 writesame 0x8d6111b thru 0x8d6b5f1 data_size 0x1(0xa4d7 bytes) 2024-09-13T06:39:46.160 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:39:46.160 INFO:teuthology.orchestra.run.smithi081.stdout:510 read 0x121071a thru 0x1210c25 (0x50c bytes) 2024-09-13T06:39:46.161 INFO:teuthology.orchestra.run.smithi081.stdout:511 writesame 0x70feb97 thru 0x71003ff data_size 0x1(0x1869 bytes) 2024-09-13T06:39:46.165 INFO:teuthology.orchestra.run.smithi081.stdout:512 writesame 0x439063 thru 0x442c15 data_size 0x1(0x9bb3 bytes) 2024-09-13T06:39:46.209 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:39:46.211+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:39:46.227 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:39:46.227 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:39:46.243 INFO:teuthology.orchestra.run.smithi081.stdout:513 trunc from 0xca3d27a to 0x1a8ce21 2024-09-13T06:39:46.249 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-13T06:39:46.287 INFO:teuthology.orchestra.run.smithi081.stdout:514 trunc from 0x1a8ce21 to 0x8b96883 2024-09-13T06:39:46.295 INFO:teuthology.orchestra.run.smithi081.stdout:516 read 0x7d1cc12 thru 0x7d24f01 (0x82f0 bytes) 2024-09-13T06:39:46.310 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:39:46.310+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:39:46.314 INFO:teuthology.orchestra.run.smithi081.stdout:517 writesame 0xec14579 thru 0xec2160b data_size 0x3b(0xd093 bytes) 2024-09-13T06:39:46.314 INFO:teuthology.orchestra.run.smithi081.stdout:519 writesame 0x503c0e thru 0x50863a data_size 0x1(0x4a2d bytes) 2024-09-13T06:39:46.341 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:39:46.352 INFO:teuthology.orchestra.run.smithi081.stdout:521 trunc from 0xec2160c to 0x78801d6 2024-09-13T06:39:46.380 INFO:teuthology.orchestra.run.smithi081.stdout:522 write 0x7548142 thru 0x754fb43 (0x7a02 bytes) 2024-09-13T06:39:46.382 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:39:46.382 INFO:teuthology.orchestra.run.smithi081.stdout:524 write 0x57ad04a thru 0x57b972e (0xc6e5 bytes) 2024-09-13T06:39:46.389 INFO:teuthology.orchestra.run.smithi081.stdout:525 read 0x719f755 thru 0x71a709c (0x7948 bytes) 2024-09-13T06:39:46.405 INFO:teuthology.orchestra.run.smithi081.stdout:526 writesame 0xc076259 thru 0xc07fbd8 data_size 0x40(0x9980 bytes) 2024-09-13T06:39:46.407 INFO:teuthology.orchestra.run.smithi081.stdout:527 read 0x109934a thru 0x10a6aad (0xd764 bytes) 2024-09-13T06:39:46.409 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:39:46.410 INFO:teuthology.orchestra.run.smithi081.stdout:530 trunc from 0xc07fbd9 to 0xb0683dc 2024-09-13T06:39:46.411 INFO:tasks.ceph.osd.6.smithi139.stderr:2024-09-13T06:39:46.410+0000 7fcd02c5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26385) UID: 0 2024-09-13T06:39:46.414 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-13T06:39:46.421 INFO:teuthology.orchestra.run.smithi081.stdout:531 writesame 0x6ed29b1 thru 0x6ee28b6 data_size 0x3e(0xff06 bytes) 2024-09-13T06:39:46.422 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:39:46.422 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:39:46.433 INFO:teuthology.orchestra.run.smithi081.stdout:532 writesame 0xb3fe0aa thru 0xb4049ea data_size 0x11(0x6941 bytes) 2024-09-13T06:39:46.435 INFO:teuthology.orchestra.run.smithi081.stdout:533 punch from 0x6c42c06 to 0x6c4b22c, (0x8626 bytes) 2024-09-13T06:39:46.436 INFO:teuthology.orchestra.run.smithi081.stdout:534 punch from 0x735382e to 0x735451a, (0xcec bytes) 2024-09-13T06:39:46.440 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-13T06:39:46.442 INFO:teuthology.orchestra.run.smithi081.stdout:535 trunc from 0xb4049eb to 0xed09328 2024-09-13T06:39:46.450 INFO:teuthology.orchestra.run.smithi081.stdout:536 punch from 0x10c6fb4 to 0x10ce3fb, (0x7447 bytes) 2024-09-13T06:39:46.450 INFO:teuthology.orchestra.run.smithi081.stdout:537 read 0x9c9c698 thru 0x9c9eed8 (0x2841 bytes) 2024-09-13T06:39:46.450 INFO:teuthology.orchestra.run.smithi081.stdout:539 writesame 0x9134116 thru 0x913fae4 data_size 0x1(0xb9cf bytes) 2024-09-13T06:39:46.512 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:39:46.515+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:39:46.512 INFO:teuthology.orchestra.run.smithi081.stdout:540 write 0xe1b34aa thru 0xe1c02df (0xce36 bytes) 2024-09-13T06:39:46.516 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-13T06:39:46.518 INFO:teuthology.orchestra.run.smithi081.stdout:541 read 0xaf422cb thru 0xaf4d90d (0xb643 bytes) 2024-09-13T06:39:46.518 INFO:teuthology.orchestra.run.smithi081.stdout:542 write 0x53d47ce thru 0x53e3819 (0xf04c bytes) 2024-09-13T06:39:46.521 INFO:teuthology.orchestra.run.smithi081.stdout:543 writesame 0x42e9a96 thru 0x42f799b data_size 0x1(0xdf06 bytes) 2024-09-13T06:39:46.575 INFO:teuthology.orchestra.run.smithi081.stdout:osd.0: {} 2024-09-13T06:39:46.575 INFO:teuthology.orchestra.run.smithi081.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-13T06:39:46.576 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:39:46.576 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:39:46.587 INFO:teuthology.orchestra.run.smithi081.stdout:546 punch from 0x328512a to 0x328c598, (0x746e bytes) 2024-09-13T06:39:46.587 INFO:teuthology.orchestra.run.smithi081.stdout:547 write 0xbeea8d8 thru 0xbef2a3a (0x8163 bytes) 2024-09-13T06:39:46.593 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-13T06:39:46.596 INFO:teuthology.orchestra.run.smithi081.stdout:osd.1: {} 2024-09-13T06:39:46.596 INFO:teuthology.orchestra.run.smithi081.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-13T06:39:46.609 INFO:teuthology.orchestra.run.smithi081.stdout:548 trunc from 0xed09328 to 0x26c7b9e 2024-09-13T06:39:46.613 INFO:tasks.ceph.osd.6.smithi139.stderr:2024-09-13T06:39:46.614+0000 7fcd02c5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26385) UID: 0 2024-09-13T06:39:46.623 INFO:teuthology.orchestra.run.smithi081.stdout:osd.2: {} 2024-09-13T06:39:46.624 INFO:teuthology.orchestra.run.smithi081.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-13T06:39:46.643 INFO:teuthology.orchestra.run.smithi081.stdout:osd.3: {} 2024-09-13T06:39:46.643 INFO:teuthology.orchestra.run.smithi081.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-13T06:39:46.652 INFO:teuthology.orchestra.run.smithi081.stdout:549 write 0x9947436 thru 0x994dc30 (0x67fb bytes) 2024-09-13T06:39:46.661 INFO:teuthology.orchestra.run.smithi081.stdout:550 read 0x33200d thru 0x338f6c (0x6f60 bytes) 2024-09-13T06:39:46.661 INFO:teuthology.orchestra.run.smithi081.stdout:551 write 0x7b42c69 thru 0x7b446fd (0x1a95 bytes) 2024-09-13T06:39:46.667 INFO:teuthology.orchestra.run.smithi081.stdout:552 read 0x6482ccb thru 0x648ce7e (0xa1b4 bytes) 2024-09-13T06:39:46.668 INFO:teuthology.orchestra.run.smithi081.stdout:553 read 0x7b57b9c thru 0x7b5c7eb (0x4c50 bytes) 2024-09-13T06:39:46.668 INFO:teuthology.orchestra.run.smithi081.stdout:554 read 0x5dc2de8 thru 0x5dcd339 (0xa552 bytes) 2024-09-13T06:39:46.669 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:39:46.669 INFO:teuthology.orchestra.run.smithi081.stdout:556 trunc from 0x994dc31 to 0x950bb13 2024-09-13T06:39:46.678 INFO:teuthology.orchestra.run.smithi081.stdout:osd.4: {} 2024-09-13T06:39:46.678 INFO:teuthology.orchestra.run.smithi081.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-13T06:39:46.686 INFO:teuthology.orchestra.run.smithi081.stdout:557 writesame 0x9f0573c thru 0x9f10bc0 data_size 0x1(0xb485 bytes) 2024-09-13T06:39:46.689 INFO:teuthology.orchestra.run.smithi081.stdout:558 writesame 0x8d8f027 thru 0x8d97238 data_size 0x1(0x8212 bytes) 2024-09-13T06:39:46.700 INFO:teuthology.orchestra.run.smithi081.stdout:osd.5: {} 2024-09-13T06:39:46.701 INFO:teuthology.orchestra.run.smithi081.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-13T06:39:46.710 INFO:teuthology.orchestra.run.smithi081.stdout:559 write 0x9d9b0af thru 0x9da06b2 (0x5604 bytes) 2024-09-13T06:39:46.713 INFO:teuthology.orchestra.run.smithi081.stdout:560 read 0x2ec8f97 thru 0x2ed0730 (0x779a bytes) 2024-09-13T06:39:46.713 INFO:teuthology.orchestra.run.smithi081.stdout:561 read 0x5c48fce thru 0x5c53b76 (0xaba9 bytes) 2024-09-13T06:39:46.713 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-13T06:39:46.714+0000 7f86a5f06640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26387) UID: 0 2024-09-13T06:39:46.723 INFO:teuthology.orchestra.run.smithi081.stdout:osd.6: {} 2024-09-13T06:39:46.723 INFO:teuthology.orchestra.run.smithi081.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-13T06:39:46.727 INFO:teuthology.orchestra.run.smithi081.stdout:562 writesame 0xe0a7438 thru 0xe0b05cf data_size 0xc(0x9198 bytes) 2024-09-13T06:39:46.734 INFO:teuthology.orchestra.run.smithi081.stdout:563 trunc from 0xe0b05d0 to 0x9726bce 2024-09-13T06:39:46.739 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:39:46.739 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 20, 2024-09-13T06:39:46.739 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 600, 2024-09-13T06:39:46.740 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [ 2024-09-13T06:39:46.740 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:46.740 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:2402 3.0 3:07d66135:::rbd_object_map.11212429e5ad:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-13T06:39:46.740 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:38.870979+0000", 2024-09-13T06:39:46.740 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 7.8716881589999996, 2024-09-13T06:39:46.740 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0082207960000000007, 2024-09-13T06:39:46.740 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:46.740 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:46.740 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:39:46.740 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:39:46.740 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:46.741 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 2402 2024-09-13T06:39:46.741 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:46.741 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:46.741 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:46.741 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:46.741 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.870979+0000", 2024-09-13T06:39:46.741 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:46.741 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:46.741 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:46.741 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:46.741 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.870979+0000", 2024-09-13T06:39:46.742 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:46.742 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:46.742 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:46.742 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:46.742 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.870978+0000", 2024-09-13T06:39:46.742 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999986 2024-09-13T06:39:46.742 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:46.742 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:46.742 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:46.743 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.870988+0000", 2024-09-13T06:39:46.743 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.9369999999999999e-06 2024-09-13T06:39:46.743 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:46.743 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:46.743 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:46.743 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.871010+0000", 2024-09-13T06:39:46.743 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2359000000000001e-05 2024-09-13T06:39:46.743 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:46.743 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:46.743 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:46.743 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.871028+0000", 2024-09-13T06:39:46.743 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8023e-05 2024-09-13T06:39:46.744 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:46.744 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:46.744 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:46.744 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.871545+0000", 2024-09-13T06:39:46.744 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000516801 2024-09-13T06:39:46.744 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:46.744 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:46.744 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:46.744 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.871661+0000", 2024-09-13T06:39:46.744 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000115474 2024-09-13T06:39:46.744 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:46.744 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:46.745 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 2", 2024-09-13T06:39:46.745 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.872091+0000", 2024-09-13T06:39:46.745 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000430197 2024-09-13T06:39:46.745 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:46.745 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:46.745 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-09-13T06:39:46.745 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.875941+0000", 2024-09-13T06:39:46.745 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.003850619 2024-09-13T06:39:46.745 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:46.745 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:46.745 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:39:46.745 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.878969+0000", 2024-09-13T06:39:46.746 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0030271719999999998 2024-09-13T06:39:46.746 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:46.746 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:46.746 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:39:46.746 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.879097+0000", 2024-09-13T06:39:46.746 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00012866900000000001 2024-09-13T06:39:46.746 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:46.746 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:46.746 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:46.746 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.879200+0000", 2024-09-13T06:39:46.746 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00010286200000000001 2024-09-13T06:39:46.746 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:46.746 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:46.747 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:46.747 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:46.747 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:46.747 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:2403 3.0 3:07d66135:::rbd_object_map.11212429e5ad:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-13T06:39:46.747 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:38.871050+0000", 2024-09-13T06:39:46.747 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 7.8716177800000002, 2024-09-13T06:39:46.747 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.016612471, 2024-09-13T06:39:46.747 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:46.747 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:46.747 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:39:46.747 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:39:46.747 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:46.747 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 2403 2024-09-13T06:39:46.748 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:46.748 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:46.748 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:46.748 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:46.748 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.871050+0000", 2024-09-13T06:39:46.748 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:46.748 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:46.748 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:46.748 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:46.748 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.871050+0000", 2024-09-13T06:39:46.748 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:46.748 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:46.749 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:46.749 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:46.749 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.871048+0000", 2024-09-13T06:39:46.749 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.999999 2024-09-13T06:39:46.749 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:46.749 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:46.749 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:46.749 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.871059+0000", 2024-09-13T06:39:46.749 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0817e-05 2024-09-13T06:39:46.749 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:46.749 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:46.749 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:46.750 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.871077+0000", 2024-09-13T06:39:46.750 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7753000000000001e-05 2024-09-13T06:39:46.750 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:46.750 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:46.750 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:46.750 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.871090+0000", 2024-09-13T06:39:46.750 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3380000000000001e-05 2024-09-13T06:39:46.750 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:46.750 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:46.750 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:46.750 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.872519+0000", 2024-09-13T06:39:46.750 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0014282609999999999 2024-09-13T06:39:46.751 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:46.751 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:46.751 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:46.751 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.872634+0000", 2024-09-13T06:39:46.751 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00011548999999999999 2024-09-13T06:39:46.751 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:46.751 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:46.751 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 2", 2024-09-13T06:39:46.751 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.873183+0000", 2024-09-13T06:39:46.751 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00054875400000000004 2024-09-13T06:39:46.751 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:46.751 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:46.751 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:39:46.752 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.883887+0000", 2024-09-13T06:39:46.752 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.010704173000000001 2024-09-13T06:39:46.752 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:46.752 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:46.752 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-09-13T06:39:46.752 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.887543+0000", 2024-09-13T06:39:46.752 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0036558749999999998 2024-09-13T06:39:46.752 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:46.752 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:46.752 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:39:46.752 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.887581+0000", 2024-09-13T06:39:46.752 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.8287000000000001e-05 2024-09-13T06:39:46.752 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:46.753 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:46.753 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:46.753 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.887662+0000", 2024-09-13T06:39:46.753 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.0871000000000005e-05 2024-09-13T06:39:46.753 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:46.753 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:46.753 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:46.753 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:46.753 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:46.753 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:2404 3.0 3:07d66135:::rbd_object_map.11212429e5ad:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-13T06:39:46.753 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:38.871106+0000", 2024-09-13T06:39:46.754 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 7.8715615100000003, 2024-09-13T06:39:46.754 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.016696478000000001, 2024-09-13T06:39:46.754 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:46.754 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:46.754 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:39:46.754 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:39:46.754 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:46.754 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 2404 2024-09-13T06:39:46.754 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:46.754 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:46.754 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:46.754 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:46.754 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.871106+0000", 2024-09-13T06:39:46.755 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:46.755 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:46.755 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:46.755 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:46.755 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.871106+0000", 2024-09-13T06:39:46.755 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:46.755 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:46.755 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:46.755 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:46.755 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.871105+0000", 2024-09-13T06:39:46.755 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.999999 2024-09-13T06:39:46.755 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:46.755 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:46.756 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:46.756 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.871112+0000", 2024-09-13T06:39:46.756 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.973e-06 2024-09-13T06:39:46.756 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:46.756 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:46.756 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:46.756 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.871128+0000", 2024-09-13T06:39:46.756 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6697e-05 2024-09-13T06:39:46.756 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:46.756 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:46.756 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:46.756 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.871141+0000", 2024-09-13T06:39:46.756 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2849e-05 2024-09-13T06:39:46.757 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:46.757 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:46.757 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:46.757 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.873783+0000", 2024-09-13T06:39:46.757 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0026413539999999998 2024-09-13T06:39:46.757 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:46.757 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:46.757 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:46.757 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.873905+0000", 2024-09-13T06:39:46.757 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00012281 2024-09-13T06:39:46.757 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:46.757 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:46.757 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 2", 2024-09-13T06:39:46.758 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.874183+0000", 2024-09-13T06:39:46.758 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00027736599999999997 2024-09-13T06:39:46.758 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:46.758 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:46.758 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:39:46.758 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.883993+0000", 2024-09-13T06:39:46.758 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0098103210000000003 2024-09-13T06:39:46.758 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:46.758 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:46.758 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-09-13T06:39:46.758 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.887687+0000", 2024-09-13T06:39:46.758 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.003694279 2024-09-13T06:39:46.758 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:46.759 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:46.759 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:39:46.759 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.887750+0000", 2024-09-13T06:39:46.759 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.2755000000000005e-05 2024-09-13T06:39:46.759 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:46.759 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:46.759 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:46.759 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.887802+0000", 2024-09-13T06:39:46.759 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2181000000000001e-05 2024-09-13T06:39:46.759 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:46.759 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:46.759 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:46.759 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:46.759 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:46.759 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:2405 3.0 3:07d66135:::rbd_object_map.11212429e5ad:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-13T06:39:46.760 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:38.871158+0000", 2024-09-13T06:39:46.760 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 7.8715097539999999, 2024-09-13T06:39:46.760 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.016762175000000001, 2024-09-13T06:39:46.760 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:46.760 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:46.760 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:39:46.760 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:39:46.760 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:46.760 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 2405 2024-09-13T06:39:46.760 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:46.760 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:46.761 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:46.761 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:46.761 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.871158+0000", 2024-09-13T06:39:46.761 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:46.761 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:46.761 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:46.761 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:46.761 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.871158+0000", 2024-09-13T06:39:46.761 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:46.761 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:46.761 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:46.762 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:46.762 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.871157+0000", 2024-09-13T06:39:46.762 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.999999 2024-09-13T06:39:46.762 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:46.762 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:46.762 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:46.762 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.871164+0000", 2024-09-13T06:39:46.762 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.9199999999999998e-06 2024-09-13T06:39:46.762 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:46.762 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:46.762 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:46.762 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.871180+0000", 2024-09-13T06:39:46.762 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6759999999999999e-05 2024-09-13T06:39:46.763 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:46.763 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:46.763 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:46.763 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.871193+0000", 2024-09-13T06:39:46.763 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2713e-05 2024-09-13T06:39:46.763 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:46.763 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:46.763 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:46.763 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.874566+0000", 2024-09-13T06:39:46.763 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0033733320000000002 2024-09-13T06:39:46.763 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:46.763 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:46.763 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:46.764 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.874694+0000", 2024-09-13T06:39:46.764 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00012748600000000001 2024-09-13T06:39:46.764 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:46.764 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:46.764 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 2", 2024-09-13T06:39:46.764 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.875228+0000", 2024-09-13T06:39:46.764 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00053444699999999996 2024-09-13T06:39:46.764 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:46.765 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:46.765 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:39:46.765 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.884098+0000", 2024-09-13T06:39:46.765 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0088695319999999994 2024-09-13T06:39:46.765 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:46.765 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:46.765 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-09-13T06:39:46.765 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.887816+0000", 2024-09-13T06:39:46.765 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.003718009 2024-09-13T06:39:46.765 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:46.765 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:46.765 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:39:46.766 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.887870+0000", 2024-09-13T06:39:46.766 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.4119000000000001e-05 2024-09-13T06:39:46.766 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:46.766 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:46.766 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:46.766 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.887920+0000", 2024-09-13T06:39:46.766 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9843999999999999e-05 2024-09-13T06:39:46.766 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:46.766 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:46.766 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:46.766 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:46.767 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:46.767 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:2406 3.0 3:07d66135:::rbd_object_map.11212429e5ad:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-13T06:39:46.767 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:38.871205+0000", 2024-09-13T06:39:46.767 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 7.8714626440000002, 2024-09-13T06:39:46.767 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.018104353, 2024-09-13T06:39:46.767 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:46.767 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:46.767 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:39:46.767 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:39:46.767 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:46.767 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 2406 2024-09-13T06:39:46.767 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:46.767 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:46.768 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:46.768 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:46.768 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.871205+0000", 2024-09-13T06:39:46.768 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:46.768 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:46.768 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:46.768 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:46.768 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.871205+0000", 2024-09-13T06:39:46.768 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:46.768 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:46.768 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:46.768 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:46.768 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.871204+0000", 2024-09-13T06:39:46.769 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.999999 2024-09-13T06:39:46.769 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:46.769 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:46.769 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:46.769 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.871211+0000", 2024-09-13T06:39:46.769 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.866e-06 2024-09-13T06:39:46.769 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:46.769 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:46.769 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:46.770 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.871228+0000", 2024-09-13T06:39:46.770 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7044000000000001e-05 2024-09-13T06:39:46.770 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:46.770 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:46.770 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:46.770 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.871241+0000", 2024-09-13T06:39:46.770 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3159000000000001e-05 2024-09-13T06:39:46.770 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:46.770 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:46.770 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:46.770 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.876131+0000", 2024-09-13T06:39:46.770 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0048900829999999999 2024-09-13T06:39:46.770 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:46.770 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:46.770 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:46.771 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.876327+0000", 2024-09-13T06:39:46.771 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00019568 2024-09-13T06:39:46.771 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:46.771 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:46.771 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 2", 2024-09-13T06:39:46.771 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.876723+0000", 2024-09-13T06:39:46.771 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00039652200000000001 2024-09-13T06:39:46.771 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:46.771 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:46.771 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:39:46.771 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.884194+0000", 2024-09-13T06:39:46.771 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0074708190000000001 2024-09-13T06:39:46.772 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:46.772 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:46.772 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-09-13T06:39:46.772 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.889181+0000", 2024-09-13T06:39:46.772 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0049872880000000003 2024-09-13T06:39:46.772 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:46.772 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:46.772 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:39:46.772 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.889248+0000", 2024-09-13T06:39:46.772 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.6402999999999994e-05 2024-09-13T06:39:46.772 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:46.772 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:46.772 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:46.773 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.889309+0000", 2024-09-13T06:39:46.773 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.1499000000000002e-05 2024-09-13T06:39:46.773 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:46.773 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:46.773 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:46.773 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:46.773 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:46.773 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:2407 3.0 3:07d66135:::rbd_object_map.11212429e5ad:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-13T06:39:46.773 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:38.871253+0000", 2024-09-13T06:39:46.773 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 7.8714144680000002, 2024-09-13T06:39:46.773 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.018156648000000001, 2024-09-13T06:39:46.773 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:46.773 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:46.773 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:39:46.774 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:39:46.774 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:46.774 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 2407 2024-09-13T06:39:46.774 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:46.774 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:46.774 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:46.774 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:46.774 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.871253+0000", 2024-09-13T06:39:46.774 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:46.774 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:46.774 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:46.774 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:46.775 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.871253+0000", 2024-09-13T06:39:46.775 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:46.775 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:46.775 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:46.775 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:46.775 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.871252+0000", 2024-09-13T06:39:46.775 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.999999 2024-09-13T06:39:46.775 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:46.775 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:46.775 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:46.775 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.871259+0000", 2024-09-13T06:39:46.775 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.8499999999999996e-06 2024-09-13T06:39:46.775 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:46.775 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:46.776 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:46.776 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.871277+0000", 2024-09-13T06:39:46.776 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8306999999999999e-05 2024-09-13T06:39:46.776 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:46.776 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:46.776 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:46.776 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.871290+0000", 2024-09-13T06:39:46.776 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2622999999999999e-05 2024-09-13T06:39:46.776 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:46.776 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:46.776 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:46.776 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.877676+0000", 2024-09-13T06:39:46.776 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0063860430000000001 2024-09-13T06:39:46.777 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:46.777 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:46.777 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:46.777 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.877814+0000", 2024-09-13T06:39:46.777 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00013874499999999999 2024-09-13T06:39:46.777 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:46.777 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:46.777 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 2", 2024-09-13T06:39:46.777 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.878299+0000", 2024-09-13T06:39:46.777 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00048456900000000002 2024-09-13T06:39:46.777 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:46.777 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:46.777 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:39:46.777 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.884304+0000", 2024-09-13T06:39:46.778 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0060048660000000002 2024-09-13T06:39:46.778 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:46.778 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:46.778 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-09-13T06:39:46.778 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.889324+0000", 2024-09-13T06:39:46.778 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0050200009999999996 2024-09-13T06:39:46.778 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:46.778 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:46.778 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:39:46.778 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.889380+0000", 2024-09-13T06:39:46.778 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.6029999999999997e-05 2024-09-13T06:39:46.778 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:46.778 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:46.778 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:46.779 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.889410+0000", 2024-09-13T06:39:46.779 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9668000000000001e-05 2024-09-13T06:39:46.779 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:46.779 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:46.779 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:46.779 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:46.779 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:46.779 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:2408 3.0 3:07d66135:::rbd_object_map.11212429e5ad:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-13T06:39:46.779 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:38.871302+0000", 2024-09-13T06:39:46.779 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 7.8713658789999998, 2024-09-13T06:39:46.779 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.018195006999999999, 2024-09-13T06:39:46.779 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:46.780 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:46.780 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:39:46.780 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:39:46.780 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:46.780 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 2408 2024-09-13T06:39:46.780 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:46.780 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:46.780 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:46.780 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:46.780 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.871302+0000", 2024-09-13T06:39:46.780 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:46.780 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:46.780 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:46.781 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:46.781 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.871302+0000", 2024-09-13T06:39:46.781 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:46.781 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:46.781 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:46.781 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:46.781 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.871301+0000", 2024-09-13T06:39:46.781 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.999999 2024-09-13T06:39:46.781 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:46.781 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:46.781 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:46.781 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.871308+0000", 2024-09-13T06:39:46.781 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.1840000000000002e-06 2024-09-13T06:39:46.781 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:46.782 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:46.782 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:46.782 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.871324+0000", 2024-09-13T06:39:46.782 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6549999999999999e-05 2024-09-13T06:39:46.782 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:46.782 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:46.782 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:46.782 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.871337+0000", 2024-09-13T06:39:46.782 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2753e-05 2024-09-13T06:39:46.782 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:46.782 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:46.782 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:46.782 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.879310+0000", 2024-09-13T06:39:46.783 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0079725249999999994 2024-09-13T06:39:46.783 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:46.783 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:46.783 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:46.783 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.879539+0000", 2024-09-13T06:39:46.783 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000229779 2024-09-13T06:39:46.783 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:46.783 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:46.783 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 2", 2024-09-13T06:39:46.783 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.880678+0000", 2024-09-13T06:39:46.783 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.001138977 2024-09-13T06:39:46.783 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:46.783 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:46.784 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:39:46.784 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.888002+0000", 2024-09-13T06:39:46.784 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0073241460000000001 2024-09-13T06:39:46.784 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:46.784 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:46.784 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-09-13T06:39:46.784 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.889421+0000", 2024-09-13T06:39:46.784 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.001418863 2024-09-13T06:39:46.784 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:46.784 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:46.784 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:39:46.784 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.889471+0000", 2024-09-13T06:39:46.784 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0127000000000003e-05 2024-09-13T06:39:46.784 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:46.784 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:46.785 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:46.785 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.889497+0000", 2024-09-13T06:39:46.785 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5063e-05 2024-09-13T06:39:46.785 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:46.785 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:46.785 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:46.785 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:46.785 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:46.785 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:2409 3.0 3:07d66135:::rbd_object_map.11212429e5ad:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-13T06:39:46.785 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:38.871348+0000", 2024-09-13T06:39:46.785 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 7.8713190319999997, 2024-09-13T06:39:46.785 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.019629904, 2024-09-13T06:39:46.785 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:46.786 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:46.786 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:39:46.786 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:39:46.786 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:46.786 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 2409 2024-09-13T06:39:46.786 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:46.786 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:46.786 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:46.786 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:46.786 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.871348+0000", 2024-09-13T06:39:46.786 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:46.786 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:46.786 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:46.786 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:46.786 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.871348+0000", 2024-09-13T06:39:46.787 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:46.787 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:46.787 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:46.787 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:46.787 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.871347+0000", 2024-09-13T06:39:46.787 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.999999 2024-09-13T06:39:46.787 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:46.787 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:46.787 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:46.787 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.871373+0000", 2024-09-13T06:39:46.787 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5398999999999999e-05 2024-09-13T06:39:46.787 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:46.787 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:46.787 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:46.787 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.871390+0000", 2024-09-13T06:39:46.788 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6759999999999999e-05 2024-09-13T06:39:46.788 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:46.788 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:46.788 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:46.788 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.871403+0000", 2024-09-13T06:39:46.788 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3573e-05 2024-09-13T06:39:46.788 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:46.788 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:46.788 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:46.788 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.881553+0000", 2024-09-13T06:39:46.788 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.010150219 2024-09-13T06:39:46.788 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:46.788 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:46.788 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:46.789 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.881776+0000", 2024-09-13T06:39:46.789 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00022227099999999999 2024-09-13T06:39:46.789 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:46.789 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:46.789 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 2", 2024-09-13T06:39:46.789 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.882853+0000", 2024-09-13T06:39:46.789 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0010777149999999999 2024-09-13T06:39:46.789 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:46.789 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:46.789 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-09-13T06:39:46.789 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.889507+0000", 2024-09-13T06:39:46.789 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0066536390000000003 2024-09-13T06:39:46.789 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:46.789 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:46.790 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:39:46.790 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.890884+0000", 2024-09-13T06:39:46.790 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0013771549999999999 2024-09-13T06:39:46.790 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:46.790 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:46.790 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:39:46.790 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.890932+0000", 2024-09-13T06:39:46.790 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.8183000000000003e-05 2024-09-13T06:39:46.790 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:46.790 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:46.790 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:46.790 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.890978+0000", 2024-09-13T06:39:46.790 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6003e-05 2024-09-13T06:39:46.790 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:46.791 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:46.791 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:46.791 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:46.791 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:46.791 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:2410 3.0 3:07d66135:::rbd_object_map.11212429e5ad:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-13T06:39:46.791 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:38.871418+0000", 2024-09-13T06:39:46.791 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 7.8712491599999996, 2024-09-13T06:39:46.791 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.020651638, 2024-09-13T06:39:46.791 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:46.791 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:46.791 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:39:46.791 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:39:46.791 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:46.791 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 2410 2024-09-13T06:39:46.791 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:46.792 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:46.792 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:46.792 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:46.792 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.871418+0000", 2024-09-13T06:39:46.792 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:46.792 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:46.792 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:46.792 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:46.792 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.871418+0000", 2024-09-13T06:39:46.792 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:46.792 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:46.792 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:46.792 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:46.792 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.871417+0000", 2024-09-13T06:39:46.793 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.999999 2024-09-13T06:39:46.793 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:46.793 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:46.793 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:46.793 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.871424+0000", 2024-09-13T06:39:46.793 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.0570000000000004e-06 2024-09-13T06:39:46.793 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:46.793 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:46.793 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:46.793 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.871442+0000", 2024-09-13T06:39:46.793 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7612999999999999e-05 2024-09-13T06:39:46.793 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:46.794 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:46.794 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:46.794 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.871455+0000", 2024-09-13T06:39:46.794 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2887e-05 2024-09-13T06:39:46.794 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:46.794 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:46.794 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:46.794 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.884381+0000", 2024-09-13T06:39:46.794 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.012926076 2024-09-13T06:39:46.794 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:46.795 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:46.795 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:46.795 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.884711+0000", 2024-09-13T06:39:46.795 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00033045500000000001 2024-09-13T06:39:46.795 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:46.795 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:46.795 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 2", 2024-09-13T06:39:46.795 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.885814+0000", 2024-09-13T06:39:46.795 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0011031540000000001 2024-09-13T06:39:46.795 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:46.795 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:46.795 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-09-13T06:39:46.795 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.889517+0000", 2024-09-13T06:39:46.795 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0037020690000000001 2024-09-13T06:39:46.795 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:46.796 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:46.796 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:39:46.796 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.891944+0000", 2024-09-13T06:39:46.796 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0024278490000000002 2024-09-13T06:39:46.796 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:46.796 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:46.796 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:39:46.796 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.892015+0000", 2024-09-13T06:39:46.796 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.0389999999999995e-05 2024-09-13T06:39:46.796 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:46.796 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:46.796 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:46.796 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.892070+0000", 2024-09-13T06:39:46.797 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.5121000000000003e-05 2024-09-13T06:39:46.797 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:46.797 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:46.797 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:46.797 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:46.797 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:46.797 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:2411 3.0 3:07d66135:::rbd_object_map.11212429e5ad:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-13T06:39:46.797 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:38.871467+0000", 2024-09-13T06:39:46.797 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 7.8712004029999996, 2024-09-13T06:39:46.797 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.021894663000000002, 2024-09-13T06:39:46.797 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:46.797 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:46.797 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:39:46.797 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:39:46.797 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:46.798 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 2411 2024-09-13T06:39:46.798 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:46.798 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:46.798 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:46.798 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:46.798 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.871467+0000", 2024-09-13T06:39:46.798 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:46.798 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:46.798 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:46.798 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:46.798 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.871467+0000", 2024-09-13T06:39:46.798 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:46.798 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:46.798 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:46.798 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:46.799 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.871466+0000", 2024-09-13T06:39:46.799 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.999999 2024-09-13T06:39:46.799 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:46.799 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:46.799 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:46.799 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.871509+0000", 2024-09-13T06:39:46.799 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.3368999999999998e-05 2024-09-13T06:39:46.799 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:46.799 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:46.799 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:46.799 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.871530+0000", 2024-09-13T06:39:46.799 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0259999999999999e-05 2024-09-13T06:39:46.799 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:46.799 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:46.799 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:46.800 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.871544+0000", 2024-09-13T06:39:46.800 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4173e-05 2024-09-13T06:39:46.800 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:46.800 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:46.800 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:46.800 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.886836+0000", 2024-09-13T06:39:46.800 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.015292441 2024-09-13T06:39:46.800 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:46.800 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:46.800 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:46.800 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.886909+0000", 2024-09-13T06:39:46.800 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.2341000000000004e-05 2024-09-13T06:39:46.800 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:46.800 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:46.801 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 2", 2024-09-13T06:39:46.801 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.887189+0000", 2024-09-13T06:39:46.801 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00027997500000000002 2024-09-13T06:39:46.801 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:46.801 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:46.801 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-09-13T06:39:46.801 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.891891+0000", 2024-09-13T06:39:46.801 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0047020450000000002 2024-09-13T06:39:46.801 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:46.801 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:46.801 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:39:46.801 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.893254+0000", 2024-09-13T06:39:46.801 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0013632469999999999 2024-09-13T06:39:46.801 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:46.802 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:46.802 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:39:46.802 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.893314+0000", 2024-09-13T06:39:46.802 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0173999999999997e-05 2024-09-13T06:39:46.802 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:46.802 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:46.802 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:46.802 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.893362+0000", 2024-09-13T06:39:46.802 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7598000000000001e-05 2024-09-13T06:39:46.802 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:46.802 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:46.802 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:46.802 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:46.802 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:46.802 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:2412 3.0 3:07d66135:::rbd_object_map.11212429e5ad:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-13T06:39:46.803 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:38.871557+0000", 2024-09-13T06:39:46.803 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 7.8711104110000001, 2024-09-13T06:39:46.803 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.022525739999999999, 2024-09-13T06:39:46.803 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:46.803 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:46.803 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:39:46.803 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:39:46.803 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:46.803 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 2412 2024-09-13T06:39:46.803 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:46.803 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:46.803 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:46.803 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:46.803 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.871557+0000", 2024-09-13T06:39:46.803 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:46.804 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:46.804 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:46.804 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:46.804 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.871557+0000", 2024-09-13T06:39:46.804 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:46.804 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:46.804 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:46.804 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:46.804 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.871556+0000", 2024-09-13T06:39:46.804 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999986 2024-09-13T06:39:46.804 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:46.804 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:46.804 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:46.804 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.871563+0000", 2024-09-13T06:39:46.805 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.1369999999999996e-06 2024-09-13T06:39:46.805 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:46.805 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:46.805 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:46.805 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.871579+0000", 2024-09-13T06:39:46.805 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6263e-05 2024-09-13T06:39:46.805 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:46.805 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:46.805 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:46.805 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.871593+0000", 2024-09-13T06:39:46.805 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3477e-05 2024-09-13T06:39:46.805 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:46.805 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:46.805 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:46.805 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.888057+0000", 2024-09-13T06:39:46.806 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.016463872000000001 2024-09-13T06:39:46.806 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:46.806 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:46.806 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:46.806 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.888147+0000", 2024-09-13T06:39:46.806 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.0525000000000005e-05 2024-09-13T06:39:46.806 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:46.806 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:46.806 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 2", 2024-09-13T06:39:46.806 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.888693+0000", 2024-09-13T06:39:46.806 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00054564000000000001 2024-09-13T06:39:46.806 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:46.806 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:46.806 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:39:46.806 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.893476+0000", 2024-09-13T06:39:46.807 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0047834440000000004 2024-09-13T06:39:46.807 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:46.807 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:46.807 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-09-13T06:39:46.807 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.893507+0000", 2024-09-13T06:39:46.807 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.1069999999999999e-05 2024-09-13T06:39:46.807 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:46.807 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:46.807 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:39:46.807 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.893971+0000", 2024-09-13T06:39:46.807 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00046344000000000002 2024-09-13T06:39:46.807 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:46.807 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:46.807 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:46.807 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.894083+0000", 2024-09-13T06:39:46.808 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00011208499999999999 2024-09-13T06:39:46.808 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:46.808 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:46.808 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:46.808 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:46.808 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:46.808 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:2413 3.0 3:07d66135:::rbd_object_map.11212429e5ad:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-13T06:39:46.808 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:38.871605+0000", 2024-09-13T06:39:46.808 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 7.8710624209999995, 2024-09-13T06:39:46.808 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.024408125999999999, 2024-09-13T06:39:46.808 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:46.808 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:46.808 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:39:46.808 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:39:46.808 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:46.809 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 2413 2024-09-13T06:39:46.809 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:46.809 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:46.809 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:46.809 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:46.809 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.871605+0000", 2024-09-13T06:39:46.809 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:46.809 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:46.809 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:46.809 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:46.809 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.871605+0000", 2024-09-13T06:39:46.809 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:46.810 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:46.810 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:46.810 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:46.810 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.871604+0000", 2024-09-13T06:39:46.810 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.999999 2024-09-13T06:39:46.810 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:46.810 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:46.810 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:46.810 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.871611+0000", 2024-09-13T06:39:46.810 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.9430000000000003e-06 2024-09-13T06:39:46.810 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:46.810 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:46.810 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:46.810 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.871628+0000", 2024-09-13T06:39:46.810 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7183000000000001e-05 2024-09-13T06:39:46.811 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:46.811 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:46.811 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:46.811 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.871642+0000", 2024-09-13T06:39:46.811 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3487e-05 2024-09-13T06:39:46.811 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:46.811 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:46.811 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:46.811 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.889555+0000", 2024-09-13T06:39:46.811 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017913710999999999 2024-09-13T06:39:46.811 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:46.811 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:46.811 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:46.811 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.889643+0000", 2024-09-13T06:39:46.812 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.7185e-05 2024-09-13T06:39:46.812 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:46.812 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:46.812 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 2", 2024-09-13T06:39:46.812 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.889927+0000", 2024-09-13T06:39:46.812 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00028462099999999998 2024-09-13T06:39:46.812 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:46.812 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:46.812 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-09-13T06:39:46.812 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.894113+0000", 2024-09-13T06:39:46.812 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0041857589999999998 2024-09-13T06:39:46.812 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:46.812 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:46.813 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:39:46.813 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.895768+0000", 2024-09-13T06:39:46.813 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.001655396 2024-09-13T06:39:46.813 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:46.813 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:46.813 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:39:46.813 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.895896+0000", 2024-09-13T06:39:46.813 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00012808200000000001 2024-09-13T06:39:46.813 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:46.813 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:46.813 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:46.814 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.896013+0000", 2024-09-13T06:39:46.814 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000116742 2024-09-13T06:39:46.814 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:46.814 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:46.814 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:46.814 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:46.814 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:46.814 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:2414 3.0 3:07d66135:::rbd_object_map.11212429e5ad:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-13T06:39:46.814 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:38.871653+0000", 2024-09-13T06:39:46.814 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 7.871014368, 2024-09-13T06:39:46.814 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.026426291000000001, 2024-09-13T06:39:46.814 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:46.814 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:46.815 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:39:46.815 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:39:46.815 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:46.815 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 2414 2024-09-13T06:39:46.815 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:46.815 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:46.815 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:46.815 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:46.815 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.871653+0000", 2024-09-13T06:39:46.815 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:46.815 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:46.815 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:46.815 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:46.815 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.871653+0000", 2024-09-13T06:39:46.815 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:46.816 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:46.816 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:46.816 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:46.816 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.871652+0000", 2024-09-13T06:39:46.816 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.999999 2024-09-13T06:39:46.816 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:46.816 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:46.816 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:46.817 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.871659+0000", 2024-09-13T06:39:46.817 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.7390000000000002e-06 2024-09-13T06:39:46.817 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:46.817 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:46.817 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:46.817 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.871676+0000", 2024-09-13T06:39:46.818 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7357e-05 2024-09-13T06:39:46.818 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:46.818 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:46.818 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:46.818 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.871691+0000", 2024-09-13T06:39:46.819 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4363e-05 2024-09-13T06:39:46.819 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:46.819 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:46.819 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:46.819 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.891028+0000", 2024-09-13T06:39:46.819 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.019337844 2024-09-13T06:39:46.820 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:46.820 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:46.820 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:46.820 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.891143+0000", 2024-09-13T06:39:46.820 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000114642 2024-09-13T06:39:46.820 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:46.821 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:46.821 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 2", 2024-09-13T06:39:46.821 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.891495+0000", 2024-09-13T06:39:46.821 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00035152600000000001 2024-09-13T06:39:46.821 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:46.822 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:46.822 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:39:46.822 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.896098+0000", 2024-09-13T06:39:46.822 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0046033369999999999 2024-09-13T06:39:46.822 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:46.822 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:46.823 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-09-13T06:39:46.823 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.897911+0000", 2024-09-13T06:39:46.823 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0018129019999999999 2024-09-13T06:39:46.823 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:46.823 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:46.823 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:39:46.824 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.897978+0000", 2024-09-13T06:39:46.824 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.7445000000000002e-05 2024-09-13T06:39:46.824 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:46.824 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:46.824 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:46.825 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.898079+0000", 2024-09-13T06:39:46.825 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000101139 2024-09-13T06:39:46.825 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:46.825 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:46.825 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:46.825 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:46.826 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:46.826 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:2428 3.0 3:07d66135:::rbd_object_map.11212429e5ad:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-13T06:39:46.826 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:38.895774+0000", 2024-09-13T06:39:46.826 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 7.8468931619999998, 2024-09-13T06:39:46.826 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0068296049999999999, 2024-09-13T06:39:46.826 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:46.827 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:46.827 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:39:46.827 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:39:46.827 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:46.827 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 2428 2024-09-13T06:39:46.827 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:46.828 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:46.828 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:46.828 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:46.828 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.895774+0000", 2024-09-13T06:39:46.828 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:46.828 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:46.828 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:46.829 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:46.829 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.895774+0000", 2024-09-13T06:39:46.829 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:46.829 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:46.829 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:46.830 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:46.830 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.895773+0000", 2024-09-13T06:39:46.830 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999981 2024-09-13T06:39:46.830 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:46.830 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:46.830 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:46.831 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.895783+0000", 2024-09-13T06:39:46.831 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0144e-05 2024-09-13T06:39:46.831 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:46.831 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:46.831 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:46.832 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.895801+0000", 2024-09-13T06:39:46.832 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8572000000000001e-05 2024-09-13T06:39:46.832 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:46.832 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:46.832 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:46.832 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.895813+0000", 2024-09-13T06:39:46.833 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2054e-05 2024-09-13T06:39:46.833 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:46.833 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:46.833 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:46.833 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.896177+0000", 2024-09-13T06:39:46.834 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000364123 2024-09-13T06:39:46.834 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:46.834 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:46.834 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:46.834 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.896551+0000", 2024-09-13T06:39:46.835 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00037318300000000002 2024-09-13T06:39:46.835 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:46.835 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:46.835 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 2", 2024-09-13T06:39:46.835 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.897308+0000", 2024-09-13T06:39:46.835 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00075731400000000003 2024-09-13T06:39:46.836 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:46.836 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:46.836 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:39:46.836 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.900021+0000", 2024-09-13T06:39:46.836 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.002713558 2024-09-13T06:39:46.836 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:46.837 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:46.837 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-09-13T06:39:46.837 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.902510+0000", 2024-09-13T06:39:46.837 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0024889360000000002 2024-09-13T06:39:46.837 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:46.837 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:46.838 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:39:46.838 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.902549+0000", 2024-09-13T06:39:46.838 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.8936000000000001e-05 2024-09-13T06:39:46.838 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:46.838 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:46.838 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:46.839 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.902604+0000", 2024-09-13T06:39:46.839 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.4537999999999999e-05 2024-09-13T06:39:46.839 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:46.839 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:46.839 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:46.839 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:46.840 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:46.840 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:2431 3.0 3:07d66135:::rbd_object_map.11212429e5ad:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-13T06:39:46.840 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:38.898553+0000", 2024-09-13T06:39:46.840 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 7.8441146450000003, 2024-09-13T06:39:46.840 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0059042859999999999, 2024-09-13T06:39:46.840 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:46.841 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:46.841 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:39:46.841 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:39:46.841 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:46.841 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 2431 2024-09-13T06:39:46.842 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:46.842 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:46.842 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:46.842 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:46.842 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.898553+0000", 2024-09-13T06:39:46.842 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:46.843 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:46.843 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:46.843 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:46.843 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.898553+0000", 2024-09-13T06:39:46.843 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:46.844 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:46.844 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:46.844 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:46.844 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.898551+0000", 2024-09-13T06:39:46.844 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999981 2024-09-13T06:39:46.844 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:46.845 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:46.845 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:46.845 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.898560+0000", 2024-09-13T06:39:46.845 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.2900000000000008e-06 2024-09-13T06:39:46.845 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:46.845 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:46.846 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:46.846 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.898585+0000", 2024-09-13T06:39:46.846 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5134999999999999e-05 2024-09-13T06:39:46.846 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:46.846 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:46.847 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:46.847 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.898595+0000", 2024-09-13T06:39:46.847 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0373999999999999e-05 2024-09-13T06:39:46.847 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:46.847 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:46.848 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:46.848 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.898772+0000", 2024-09-13T06:39:46.848 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000176875 2024-09-13T06:39:46.848 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:46.848 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:46.849 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:46.849 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.898953+0000", 2024-09-13T06:39:46.849 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00018034400000000001 2024-09-13T06:39:46.849 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:46.849 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:46.850 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 2", 2024-09-13T06:39:46.850 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.899412+0000", 2024-09-13T06:39:46.850 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00045919100000000002 2024-09-13T06:39:46.850 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:46.850 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:46.850 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:39:46.851 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.902656+0000", 2024-09-13T06:39:46.851 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0032438639999999999 2024-09-13T06:39:46.851 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:46.851 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:46.851 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-09-13T06:39:46.852 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.904253+0000", 2024-09-13T06:39:46.852 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0015977159999999999 2024-09-13T06:39:46.852 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:46.852 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:46.852 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:39:46.853 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.904358+0000", 2024-09-13T06:39:46.853 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000104944 2024-09-13T06:39:46.853 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:46.853 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:46.853 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:46.854 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.904457+0000", 2024-09-13T06:39:46.854 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.8634000000000005e-05 2024-09-13T06:39:46.854 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:46.854 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:46.854 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:46.854 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:46.855 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:46.855 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:2432 3.0 3:07d66135:::rbd_object_map.11212429e5ad:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-13T06:39:46.855 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:38.899068+0000", 2024-09-13T06:39:46.855 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 7.8435996580000005, 2024-09-13T06:39:46.855 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0056374529999999997, 2024-09-13T06:39:46.856 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:46.856 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:46.856 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:39:46.856 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:39:46.856 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:46.857 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 2432 2024-09-13T06:39:46.857 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:46.857 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:46.857 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:46.857 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:46.857 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.899068+0000", 2024-09-13T06:39:46.858 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:46.858 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:46.858 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:46.858 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:46.858 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.899068+0000", 2024-09-13T06:39:46.859 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:46.859 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:46.859 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:46.859 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:46.859 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.899067+0000", 2024-09-13T06:39:46.860 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.999999 2024-09-13T06:39:46.860 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:46.860 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:46.860 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:46.860 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.899073+0000", 2024-09-13T06:39:46.860 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9089999999999997e-06 2024-09-13T06:39:46.861 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:46.861 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:46.861 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:46.861 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.899083+0000", 2024-09-13T06:39:46.861 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0458999999999999e-05 2024-09-13T06:39:46.862 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:46.862 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:46.862 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:46.862 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.899090+0000", 2024-09-13T06:39:46.862 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.9480000000000002e-06 2024-09-13T06:39:46.863 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:46.863 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:46.863 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:46.863 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.900077+0000", 2024-09-13T06:39:46.863 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00098700400000000009 2024-09-13T06:39:46.863 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:46.864 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:46.864 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:46.864 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.900145+0000", 2024-09-13T06:39:46.864 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.8224000000000003e-05 2024-09-13T06:39:46.864 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:46.865 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:46.865 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 2", 2024-09-13T06:39:46.865 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.900417+0000", 2024-09-13T06:39:46.865 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00027116299999999999 2024-09-13T06:39:46.865 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:46.865 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:46.866 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-09-13T06:39:46.866 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.904478+0000", 2024-09-13T06:39:46.866 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0040610630000000002 2024-09-13T06:39:46.866 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:46.866 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:46.867 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:39:46.867 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.904560+0000", 2024-09-13T06:39:46.867 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.2392000000000007e-05 2024-09-13T06:39:46.867 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:46.867 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:46.867 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:39:46.868 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.904638+0000", 2024-09-13T06:39:46.868 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.7572999999999997e-05 2024-09-13T06:39:46.868 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:46.868 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:46.868 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:46.869 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.904705+0000", 2024-09-13T06:39:46.869 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.7590999999999997e-05 2024-09-13T06:39:46.869 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:46.869 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:46.869 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:46.869 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:46.870 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:46.870 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:2433 3.0 3:07d66135:::rbd_object_map.11212429e5ad:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-13T06:39:46.870 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:38.899172+0000", 2024-09-13T06:39:46.870 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 7.8434954970000001, 2024-09-13T06:39:46.870 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0080424510000000008, 2024-09-13T06:39:46.871 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:46.871 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:46.871 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:39:46.871 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:39:46.871 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:46.871 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 2433 2024-09-13T06:39:46.872 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:46.872 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:46.872 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:46.872 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:46.872 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.899172+0000", 2024-09-13T06:39:46.872 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:46.873 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:46.873 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:46.873 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:46.873 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.899172+0000", 2024-09-13T06:39:46.873 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:46.873 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:46.873 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:46.873 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:46.874 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.899171+0000", 2024-09-13T06:39:46.874 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999986 2024-09-13T06:39:46.874 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:46.874 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:46.874 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:46.874 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.899179+0000", 2024-09-13T06:39:46.874 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.8220000000000007e-06 2024-09-13T06:39:46.874 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:46.874 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:46.874 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:46.874 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.899192+0000", 2024-09-13T06:39:46.874 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3484e-05 2024-09-13T06:39:46.875 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:46.875 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:46.875 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:46.875 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.899202+0000", 2024-09-13T06:39:46.875 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.5729999999999997e-06 2024-09-13T06:39:46.875 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:46.875 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:46.875 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:46.875 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.900815+0000", 2024-09-13T06:39:46.875 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.001613457 2024-09-13T06:39:46.875 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:46.875 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:46.875 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:46.875 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.900888+0000", 2024-09-13T06:39:46.876 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.2566999999999998e-05 2024-09-13T06:39:46.876 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:46.876 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:46.876 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 2", 2024-09-13T06:39:46.876 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.901265+0000", 2024-09-13T06:39:46.876 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000377544 2024-09-13T06:39:46.876 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:46.876 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:46.876 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-09-13T06:39:46.876 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.906846+0000", 2024-09-13T06:39:46.876 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0055812680000000003 2024-09-13T06:39:46.876 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:46.877 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:46.877 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:39:46.877 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.907136+0000", 2024-09-13T06:39:46.877 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000289673 2024-09-13T06:39:46.877 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:46.877 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:46.877 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:39:46.877 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.907180+0000", 2024-09-13T06:39:46.877 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4240999999999999e-05 2024-09-13T06:39:46.877 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:46.877 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:46.877 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:46.877 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.907214+0000", 2024-09-13T06:39:46.878 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.4065e-05 2024-09-13T06:39:46.878 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:46.878 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:46.878 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:46.878 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:46.878 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:46.878 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:2434 3.0 3:07d66135:::rbd_object_map.11212429e5ad:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-13T06:39:46.878 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:38.899380+0000", 2024-09-13T06:39:46.878 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 7.8432871999999998, 2024-09-13T06:39:46.878 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0079672360000000008, 2024-09-13T06:39:46.878 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:46.878 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:46.878 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:39:46.879 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:39:46.879 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:46.879 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 2434 2024-09-13T06:39:46.879 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:46.879 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:46.879 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:46.879 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:46.879 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.899380+0000", 2024-09-13T06:39:46.879 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:46.879 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:46.879 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:46.879 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:46.879 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.899380+0000", 2024-09-13T06:39:46.879 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:46.880 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:46.880 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:46.880 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:46.880 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.899379+0000", 2024-09-13T06:39:46.880 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999986 2024-09-13T06:39:46.880 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:46.880 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:46.880 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:46.880 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.899391+0000", 2024-09-13T06:39:46.880 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1652e-05 2024-09-13T06:39:46.880 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:46.880 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:46.881 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:46.881 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.899405+0000", 2024-09-13T06:39:46.881 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3913999999999999e-05 2024-09-13T06:39:46.881 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:46.881 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:46.881 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:46.881 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.899416+0000", 2024-09-13T06:39:46.881 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1076e-05 2024-09-13T06:39:46.881 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:46.881 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:46.881 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:46.881 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.901824+0000", 2024-09-13T06:39:46.882 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0024086490000000001 2024-09-13T06:39:46.882 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:46.882 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:46.882 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:46.882 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.901892+0000", 2024-09-13T06:39:46.882 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.7955999999999998e-05 2024-09-13T06:39:46.882 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:46.882 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:46.882 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 2", 2024-09-13T06:39:46.882 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.902185+0000", 2024-09-13T06:39:46.882 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00029283400000000001 2024-09-13T06:39:46.882 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:46.882 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:46.883 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-09-13T06:39:46.883 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.906864+0000", 2024-09-13T06:39:46.883 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0046788039999999999 2024-09-13T06:39:46.883 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:46.883 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:46.883 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:39:46.883 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.907253+0000", 2024-09-13T06:39:46.883 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00038920399999999998 2024-09-13T06:39:46.883 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:46.883 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:46.883 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:39:46.883 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.907303+0000", 2024-09-13T06:39:46.883 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0373e-05 2024-09-13T06:39:46.884 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:46.884 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:46.884 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:46.884 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.907347+0000", 2024-09-13T06:39:46.884 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.3989000000000002e-05 2024-09-13T06:39:46.884 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:46.884 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:46.884 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:46.884 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:46.884 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:46.884 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:2694 3.0 3:02013738:::rbd_data.11212429e5ad.0000000000000148:head [delete] snapc 8=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-13T06:39:46.884 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:39.430844+0000", 2024-09-13T06:39:46.885 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 7.3118236579999998, 2024-09-13T06:39:46.885 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0065738339999999998, 2024-09-13T06:39:46.885 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:46.885 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:46.885 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:39:46.885 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:39:46.885 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:46.885 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 2694 2024-09-13T06:39:46.885 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:46.885 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:46.885 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:46.885 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:46.885 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.430844+0000", 2024-09-13T06:39:46.886 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:46.886 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:46.886 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:46.886 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:46.886 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.430844+0000", 2024-09-13T06:39:46.886 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:46.886 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:46.886 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:46.886 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:46.886 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.430843+0000", 2024-09-13T06:39:46.886 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.999999 2024-09-13T06:39:46.886 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:46.886 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:46.887 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:46.887 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.430861+0000", 2024-09-13T06:39:46.887 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7872000000000001e-05 2024-09-13T06:39:46.887 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:46.887 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:46.887 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:46.887 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.430874+0000", 2024-09-13T06:39:46.887 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2931999999999999e-05 2024-09-13T06:39:46.887 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:46.887 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:46.887 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:46.887 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.430881+0000", 2024-09-13T06:39:46.887 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3159999999999999e-06 2024-09-13T06:39:46.887 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:46.888 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:46.888 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:46.888 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.431286+0000", 2024-09-13T06:39:46.888 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00040501600000000001 2024-09-13T06:39:46.888 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:46.888 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:46.888 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:46.888 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.431388+0000", 2024-09-13T06:39:46.888 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000102303 2024-09-13T06:39:46.888 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:46.888 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:46.888 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 2", 2024-09-13T06:39:46.888 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.431494+0000", 2024-09-13T06:39:46.889 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00010579800000000001 2024-09-13T06:39:46.889 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:46.889 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:46.889 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:39:46.889 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.434739+0000", 2024-09-13T06:39:46.889 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.003244935 2024-09-13T06:39:46.889 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:46.889 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:46.889 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-09-13T06:39:46.889 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.437303+0000", 2024-09-13T06:39:46.889 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00256434 2024-09-13T06:39:46.889 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:46.889 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:46.890 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:39:46.890 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.437362+0000", 2024-09-13T06:39:46.890 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8341999999999998e-05 2024-09-13T06:39:46.890 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:46.890 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:46.890 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:46.890 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.437418+0000", 2024-09-13T06:39:46.890 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.5943999999999998e-05 2024-09-13T06:39:46.890 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:46.890 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:46.890 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:46.890 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:46.891 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:46.891 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:4978 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:head [set-alloc-hint object_size 33554432 write_size 33554432,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-09-13T06:39:46.891 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:46.697456+0000", 2024-09-13T06:39:46.891 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.045210988000000001, 2024-09-13T06:39:46.891 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.018223996999999999, 2024-09-13T06:39:46.891 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:46.891 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:46.891 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:39:46.891 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:39:46.891 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:46.891 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 4978 2024-09-13T06:39:46.891 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:46.891 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:46.891 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:46.892 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:46.892 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:46.697456+0000", 2024-09-13T06:39:46.892 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:46.892 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:46.892 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:46.892 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:46.892 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:46.697456+0000", 2024-09-13T06:39:46.892 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:46.892 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:46.892 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:46.892 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:46.892 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:46.697455+0000", 2024-09-13T06:39:46.893 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999986 2024-09-13T06:39:46.893 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:46.893 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:46.893 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:46.893 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:46.697464+0000", 2024-09-13T06:39:46.893 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.2269999999999999e-06 2024-09-13T06:39:46.893 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:46.893 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:46.893 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:46.893 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:46.697482+0000", 2024-09-13T06:39:46.893 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8026999999999999e-05 2024-09-13T06:39:46.893 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:46.893 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:46.894 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:46.894 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:46.697501+0000", 2024-09-13T06:39:46.894 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8640000000000001e-05 2024-09-13T06:39:46.894 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:46.894 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:46.894 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:46.894 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:46.697554+0000", 2024-09-13T06:39:46.894 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3223999999999997e-05 2024-09-13T06:39:46.894 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:46.894 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:46.894 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:46.894 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:46.697604+0000", 2024-09-13T06:39:46.894 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0421999999999999e-05 2024-09-13T06:39:46.894 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:46.895 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:46.895 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 2", 2024-09-13T06:39:46.895 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:46.700462+0000", 2024-09-13T06:39:46.895 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0028576040000000001 2024-09-13T06:39:46.895 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:46.895 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:46.895 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:39:46.895 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:46.715606+0000", 2024-09-13T06:39:46.895 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.015143892000000001 2024-09-13T06:39:46.895 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:46.895 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:46.895 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-09-13T06:39:46.895 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:46.715616+0000", 2024-09-13T06:39:46.896 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.7929999999999992e-06 2024-09-13T06:39:46.896 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:46.896 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:46.896 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:39:46.896 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:46.715650+0000", 2024-09-13T06:39:46.896 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.4270000000000002e-05 2024-09-13T06:39:46.896 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:46.896 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:46.896 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:46.896 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:46.715680+0000", 2024-09-13T06:39:46.896 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.0561000000000001e-05 2024-09-13T06:39:46.896 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:46.896 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:46.896 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:46.897 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:46.897 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:46.897 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:39:46.898 INFO:teuthology.orchestra.run.smithi081.stdout:osd.7: {} 2024-09-13T06:39:46.898 INFO:teuthology.orchestra.run.smithi081.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-13T06:39:46.898 INFO:teuthology.orchestra.run.smithi081.stdout:564 punch from 0x15804bc to 0x1580621, (0x165 bytes) 2024-09-13T06:39:46.898 INFO:teuthology.orchestra.run.smithi081.stdout:565 punch from 0xb23e8a to 0xb25f4a, (0x20c0 bytes) 2024-09-13T06:39:46.899 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-13T06:39:46.900 INFO:teuthology.orchestra.run.smithi081.stdout:566 writesame 0xdbd1fe9 thru 0xdbd291e data_size 0x12(0x936 bytes) 2024-09-13T06:39:46.900 INFO:teuthology.orchestra.run.smithi081.stdout:567 clone 5 order 19 su 4096 sc 7 2024-09-13T06:39:46.901 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:39:46.898+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:39:46.999 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:39:47.002+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:39:47.067 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:39:47.067 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-13T06:39:47.067 INFO:teuthology.orchestra.run.smithi081.stdout: "num_ops": 0 2024-09-13T06:39:47.067 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:39:47.081 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-13T06:39:47.127 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:39:47.131+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:39:47.201 INFO:tasks.ceph.osd.6.smithi139.stderr:2024-09-13T06:39:47.202+0000 7fcd02c5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26385) UID: 0 2024-09-13T06:39:47.203 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:39:47.203 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-13T06:39:47.203 INFO:teuthology.orchestra.run.smithi081.stdout: "complaint_time": 30, 2024-09-13T06:39:47.203 INFO:teuthology.orchestra.run.smithi081.stdout: "num_blocked_ops": 0 2024-09-13T06:39:47.203 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:39:47.217 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-13T06:39:47.302 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:39:47.306+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:39:47.392 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:39:47.392 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 20, 2024-09-13T06:39:47.392 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 600, 2024-09-13T06:39:47.393 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [ 2024-09-13T06:39:47.393 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.393 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4385.0:2330 3.0 e31/21 3:07d66135:::rbd_object_map.11212429e5ad:head v 31'39, mlcod=31'37)", 2024-09-13T06:39:47.393 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:38.827721+0000", 2024-09-13T06:39:47.393 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 8.5671029480000005, 2024-09-13T06:39:47.393 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.003728295, 2024-09-13T06:39:47.393 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:47.393 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:47.393 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:47.393 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.393 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:47.393 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.827721+0000", 2024-09-13T06:39:47.393 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:47.394 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.394 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.394 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:47.394 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.827721+0000", 2024-09-13T06:39:47.394 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:47.394 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.394 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.394 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:47.394 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.827718+0000", 2024-09-13T06:39:47.394 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999976 2024-09-13T06:39:47.394 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.394 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.394 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:47.395 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.827735+0000", 2024-09-13T06:39:47.395 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6515999999999999e-05 2024-09-13T06:39:47.395 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.395 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.395 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:47.395 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.827768+0000", 2024-09-13T06:39:47.395 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.3105999999999998e-05 2024-09-13T06:39:47.395 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.395 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.395 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:47.395 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.827788+0000", 2024-09-13T06:39:47.395 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0210000000000001e-05 2024-09-13T06:39:47.395 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.395 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.396 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:47.396 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.827855+0000", 2024-09-13T06:39:47.396 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.7046999999999997e-05 2024-09-13T06:39:47.396 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.396 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.396 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:47.396 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.827900+0000", 2024-09-13T06:39:47.396 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4415000000000001e-05 2024-09-13T06:39:47.396 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.396 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.396 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:39:47.396 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.831380+0000", 2024-09-13T06:39:47.396 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.003480187 2024-09-13T06:39:47.397 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.397 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.397 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:47.397 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.831449+0000", 2024-09-13T06:39:47.397 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.9070000000000001e-05 2024-09-13T06:39:47.397 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:47.397 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:47.397 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:47.397 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.397 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.398 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4385.0:2402 3.0 e31/21 3:07d66135:::rbd_object_map.11212429e5ad:head v 31'46, mlcod=31'43)", 2024-09-13T06:39:47.398 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:38.872174+0000", 2024-09-13T06:39:47.398 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 8.5226494069999994, 2024-09-13T06:39:47.398 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0037101830000000001, 2024-09-13T06:39:47.398 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:47.398 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:47.398 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:47.399 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.399 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:47.399 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.872174+0000", 2024-09-13T06:39:47.399 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:47.399 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.399 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.399 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:47.399 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.872174+0000", 2024-09-13T06:39:47.399 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:47.399 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.399 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.399 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:47.400 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.872173+0000", 2024-09-13T06:39:47.400 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.999999 2024-09-13T06:39:47.400 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.400 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.401 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:47.401 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.872180+0000", 2024-09-13T06:39:47.401 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.4189999999999999e-06 2024-09-13T06:39:47.401 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.401 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.401 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:47.401 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.872193+0000", 2024-09-13T06:39:47.401 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.349e-05 2024-09-13T06:39:47.401 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.401 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.402 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:47.402 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.872201+0000", 2024-09-13T06:39:47.402 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.7000000000000008e-06 2024-09-13T06:39:47.402 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.402 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.402 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:47.402 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.872506+0000", 2024-09-13T06:39:47.402 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00030537300000000001 2024-09-13T06:39:47.402 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.402 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.402 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:47.402 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.872571+0000", 2024-09-13T06:39:47.402 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.4349000000000003e-05 2024-09-13T06:39:47.403 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.403 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.403 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:39:47.403 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.875823+0000", 2024-09-13T06:39:47.403 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0032527419999999999 2024-09-13T06:39:47.403 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.403 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.403 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:47.403 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.875884+0000", 2024-09-13T06:39:47.403 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0847999999999997e-05 2024-09-13T06:39:47.403 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:47.403 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:47.403 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:47.404 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.404 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.404 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4385.0:2403 3.0 e31/21 3:07d66135:::rbd_object_map.11212429e5ad:head v 31'47, mlcod=31'43)", 2024-09-13T06:39:47.404 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:38.873272+0000", 2024-09-13T06:39:47.404 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 8.521551552, 2024-09-13T06:39:47.404 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0059524080000000002, 2024-09-13T06:39:47.404 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:47.404 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:47.404 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:47.404 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.404 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:47.404 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.873272+0000", 2024-09-13T06:39:47.404 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:47.405 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.405 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.405 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:47.405 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.873272+0000", 2024-09-13T06:39:47.405 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:47.405 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.405 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.405 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:47.405 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.873271+0000", 2024-09-13T06:39:47.405 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:39:47.405 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.405 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.405 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:47.405 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.873277+0000", 2024-09-13T06:39:47.406 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.5999999999999997e-06 2024-09-13T06:39:47.406 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.406 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.406 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:47.406 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.873285+0000", 2024-09-13T06:39:47.406 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4680000000000003e-06 2024-09-13T06:39:47.406 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.406 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.406 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:47.406 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.873289+0000", 2024-09-13T06:39:47.406 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7670000000000003e-06 2024-09-13T06:39:47.406 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.406 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.406 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:47.407 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.873403+0000", 2024-09-13T06:39:47.407 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00011417300000000001 2024-09-13T06:39:47.407 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.407 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.407 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:47.407 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.873421+0000", 2024-09-13T06:39:47.407 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7278e-05 2024-09-13T06:39:47.407 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.407 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.407 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:39:47.407 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.879180+0000", 2024-09-13T06:39:47.407 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0057591379999999996 2024-09-13T06:39:47.407 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.408 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.408 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:47.408 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.879224+0000", 2024-09-13T06:39:47.408 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4558000000000003e-05 2024-09-13T06:39:47.408 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:47.408 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:47.408 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:47.408 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.408 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.408 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4385.0:2404 3.0 e31/21 3:07d66135:::rbd_object_map.11212429e5ad:head v 31'48, mlcod=31'43)", 2024-09-13T06:39:47.408 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:38.874266+0000", 2024-09-13T06:39:47.408 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 8.5205577950000002, 2024-09-13T06:39:47.408 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0049906389999999998, 2024-09-13T06:39:47.408 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:47.409 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:47.409 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:47.409 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.409 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:47.409 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.874266+0000", 2024-09-13T06:39:47.409 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:47.409 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.409 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.409 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:47.409 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.874266+0000", 2024-09-13T06:39:47.409 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:47.409 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.409 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.410 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:47.410 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.874265+0000", 2024-09-13T06:39:47.410 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.999999 2024-09-13T06:39:47.410 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.410 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.410 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:47.410 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.874281+0000", 2024-09-13T06:39:47.410 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5763000000000001e-05 2024-09-13T06:39:47.410 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.410 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.410 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:47.410 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.874294+0000", 2024-09-13T06:39:47.410 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2826000000000001e-05 2024-09-13T06:39:47.411 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.411 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.411 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:47.411 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.874300+0000", 2024-09-13T06:39:47.411 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.6769999999999998e-06 2024-09-13T06:39:47.411 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.411 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.411 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:47.411 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.874390+0000", 2024-09-13T06:39:47.412 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.0129000000000004e-05 2024-09-13T06:39:47.412 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.412 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.412 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:47.412 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.874450+0000", 2024-09-13T06:39:47.412 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9512999999999998e-05 2024-09-13T06:39:47.412 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.412 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.412 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:39:47.412 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.879227+0000", 2024-09-13T06:39:47.412 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0047773329999999999 2024-09-13T06:39:47.412 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.413 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.413 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:47.413 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.879256+0000", 2024-09-13T06:39:47.413 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9173e-05 2024-09-13T06:39:47.413 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:47.413 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:47.413 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:47.413 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.413 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.413 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4385.0:2405 3.0 e31/21 3:07d66135:::rbd_object_map.11212429e5ad:head v 31'49, mlcod=31'43)", 2024-09-13T06:39:47.413 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:38.875324+0000", 2024-09-13T06:39:47.413 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 8.5194999459999998, 2024-09-13T06:39:47.413 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0039619570000000003, 2024-09-13T06:39:47.414 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:47.414 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:47.414 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:47.414 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.414 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:47.414 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.875324+0000", 2024-09-13T06:39:47.414 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:47.414 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.414 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.414 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:47.414 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.875324+0000", 2024-09-13T06:39:47.414 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:47.414 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.414 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.415 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:47.415 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.875323+0000", 2024-09-13T06:39:47.415 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.999999 2024-09-13T06:39:47.415 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.415 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.415 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:47.415 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.875329+0000", 2024-09-13T06:39:47.415 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.1689999999999997e-06 2024-09-13T06:39:47.415 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.415 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.415 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:47.415 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.875340+0000", 2024-09-13T06:39:47.415 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1065e-05 2024-09-13T06:39:47.416 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.416 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.416 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:47.416 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.875347+0000", 2024-09-13T06:39:47.416 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.674e-06 2024-09-13T06:39:47.416 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.416 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.416 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:47.416 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.875396+0000", 2024-09-13T06:39:47.416 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9094000000000001e-05 2024-09-13T06:39:47.416 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.416 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.416 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:47.417 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.875420+0000", 2024-09-13T06:39:47.417 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4199999999999999e-05 2024-09-13T06:39:47.417 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.417 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.417 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:39:47.417 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.879258+0000", 2024-09-13T06:39:47.417 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0038376930000000001 2024-09-13T06:39:47.417 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.417 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.417 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:47.417 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.879286+0000", 2024-09-13T06:39:47.417 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.7880000000000001e-05 2024-09-13T06:39:47.417 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:47.418 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:47.418 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:47.418 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.418 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.418 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4385.0:2407 3.0 e31/21 3:07d66135:::rbd_object_map.11212429e5ad:head v 31'51, mlcod=31'44)", 2024-09-13T06:39:47.418 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:38.878449+0000", 2024-09-13T06:39:47.418 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 8.5163749230000008, 2024-09-13T06:39:47.418 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0036754119999999999, 2024-09-13T06:39:47.418 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:47.418 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:47.418 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:47.418 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.418 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:47.419 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.878449+0000", 2024-09-13T06:39:47.419 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:47.419 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.419 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.419 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:47.419 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.878449+0000", 2024-09-13T06:39:47.419 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:47.419 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.419 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.419 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:47.419 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.878447+0000", 2024-09-13T06:39:47.419 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999981 2024-09-13T06:39:47.419 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.419 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.420 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:47.420 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.878462+0000", 2024-09-13T06:39:47.420 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5133000000000001e-05 2024-09-13T06:39:47.420 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.420 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.420 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:47.420 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.878500+0000", 2024-09-13T06:39:47.420 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.8213999999999997e-05 2024-09-13T06:39:47.420 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.420 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.421 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:47.421 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.878520+0000", 2024-09-13T06:39:47.421 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0000000000000002e-05 2024-09-13T06:39:47.421 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.421 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.421 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:47.421 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.878710+0000", 2024-09-13T06:39:47.421 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00019008100000000001 2024-09-13T06:39:47.422 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.422 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.422 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:47.422 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.878745+0000", 2024-09-13T06:39:47.422 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.4533000000000003e-05 2024-09-13T06:39:47.422 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.422 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.423 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:39:47.423 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.882086+0000", 2024-09-13T06:39:47.423 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0033416409999999998 2024-09-13T06:39:47.423 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.423 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.423 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:47.423 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.882124+0000", 2024-09-13T06:39:47.423 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.7673000000000003e-05 2024-09-13T06:39:47.423 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:47.423 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:47.423 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:47.423 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.423 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.423 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4385.0:2408 3.0 e31/21 3:07d66135:::rbd_object_map.11212429e5ad:head v 31'52, mlcod=31'45)", 2024-09-13T06:39:47.424 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:38.880785+0000", 2024-09-13T06:39:47.424 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 8.5140387650000005, 2024-09-13T06:39:47.424 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.004103382, 2024-09-13T06:39:47.424 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:47.424 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:47.424 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:47.424 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.424 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:47.424 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.880785+0000", 2024-09-13T06:39:47.424 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:47.424 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.424 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.424 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:47.425 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.880785+0000", 2024-09-13T06:39:47.425 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:47.425 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.425 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.425 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:47.425 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.880784+0000", 2024-09-13T06:39:47.425 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.999999 2024-09-13T06:39:47.425 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.425 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.425 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:47.425 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.880793+0000", 2024-09-13T06:39:47.425 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.8990000000000007e-06 2024-09-13T06:39:47.426 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.426 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.426 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:47.426 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.880806+0000", 2024-09-13T06:39:47.426 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3597999999999999e-05 2024-09-13T06:39:47.426 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.426 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.426 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:47.426 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.880813+0000", 2024-09-13T06:39:47.426 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.6789999999999999e-06 2024-09-13T06:39:47.427 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.427 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.427 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:47.427 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.880918+0000", 2024-09-13T06:39:47.427 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000105256 2024-09-13T06:39:47.427 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.427 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.427 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:47.427 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.880977+0000", 2024-09-13T06:39:47.427 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8310000000000002e-05 2024-09-13T06:39:47.427 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.427 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.427 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:39:47.428 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.884849+0000", 2024-09-13T06:39:47.428 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.003872693 2024-09-13T06:39:47.428 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.428 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.428 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:47.428 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.884888+0000", 2024-09-13T06:39:47.428 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.8955999999999998e-05 2024-09-13T06:39:47.428 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:47.428 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:47.428 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:47.428 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.428 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.429 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4385.0:2409 3.0 e31/21 3:07d66135:::rbd_object_map.11212429e5ad:head v 31'53, mlcod=31'45)", 2024-09-13T06:39:47.429 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:38.882957+0000", 2024-09-13T06:39:47.429 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 8.5118663619999992, 2024-09-13T06:39:47.429 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0049287489999999996, 2024-09-13T06:39:47.429 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:47.429 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:47.429 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:47.429 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.429 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:47.429 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.882957+0000", 2024-09-13T06:39:47.429 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:47.429 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.429 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.430 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:47.430 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.882957+0000", 2024-09-13T06:39:47.430 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:47.430 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.430 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.430 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:47.430 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.882956+0000", 2024-09-13T06:39:47.430 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.999999 2024-09-13T06:39:47.430 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.430 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.430 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:47.431 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.882963+0000", 2024-09-13T06:39:47.431 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.8680000000000001e-06 2024-09-13T06:39:47.431 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.431 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.431 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:47.431 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.882975+0000", 2024-09-13T06:39:47.431 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1766000000000001e-05 2024-09-13T06:39:47.431 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.431 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.431 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:47.431 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.882981+0000", 2024-09-13T06:39:47.431 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3559999999999998e-06 2024-09-13T06:39:47.431 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.432 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.432 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:47.432 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.883029+0000", 2024-09-13T06:39:47.432 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7839000000000001e-05 2024-09-13T06:39:47.432 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.432 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.432 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:47.432 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.883047+0000", 2024-09-13T06:39:47.432 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8134e-05 2024-09-13T06:39:47.432 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.432 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.432 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:39:47.432 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.887832+0000", 2024-09-13T06:39:47.432 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0047848839999999997 2024-09-13T06:39:47.433 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.433 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.433 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:47.433 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.887886+0000", 2024-09-13T06:39:47.433 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3702999999999997e-05 2024-09-13T06:39:47.433 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:47.433 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:47.433 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:47.433 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.433 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.433 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4385.0:2410 3.0 e31/21 3:07d66135:::rbd_object_map.11212429e5ad:head v 31'54, mlcod=31'45)", 2024-09-13T06:39:47.434 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:38.885943+0000", 2024-09-13T06:39:47.434 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 8.5088805119999993, 2024-09-13T06:39:47.434 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0051076330000000003, 2024-09-13T06:39:47.434 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:47.434 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:47.434 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:47.434 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.434 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:47.434 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.885943+0000", 2024-09-13T06:39:47.434 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:47.434 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.434 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.434 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:47.435 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.885943+0000", 2024-09-13T06:39:47.435 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:47.435 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.435 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.435 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:47.435 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.885942+0000", 2024-09-13T06:39:47.435 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.999999 2024-09-13T06:39:47.435 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.435 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.435 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:47.435 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.885949+0000", 2024-09-13T06:39:47.435 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.2679999999999997e-06 2024-09-13T06:39:47.436 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.436 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.436 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:47.436 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.885961+0000", 2024-09-13T06:39:47.436 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1737e-05 2024-09-13T06:39:47.436 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.436 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.436 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:47.436 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.885967+0000", 2024-09-13T06:39:47.436 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0920000000000003e-06 2024-09-13T06:39:47.436 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.436 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.437 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:47.437 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.886019+0000", 2024-09-13T06:39:47.437 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.1669000000000003e-05 2024-09-13T06:39:47.437 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.437 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.437 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:47.437 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.886035+0000", 2024-09-13T06:39:47.437 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6192e-05 2024-09-13T06:39:47.437 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.437 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.437 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:39:47.437 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.890999+0000", 2024-09-13T06:39:47.437 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0049638440000000002 2024-09-13T06:39:47.438 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.438 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.438 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:47.438 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.891051+0000", 2024-09-13T06:39:47.438 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.1700999999999998e-05 2024-09-13T06:39:47.438 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:47.438 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:47.438 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:47.438 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.438 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.438 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4385.0:2411 3.0 e31/21 3:07d66135:::rbd_object_map.11212429e5ad:head v 31'55, mlcod=31'45)", 2024-09-13T06:39:47.438 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:38.887273+0000", 2024-09-13T06:39:47.438 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 8.5075502329999999, 2024-09-13T06:39:47.439 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0058469940000000003, 2024-09-13T06:39:47.439 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:47.439 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:47.439 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:47.439 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.439 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:47.439 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.887273+0000", 2024-09-13T06:39:47.439 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:47.439 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.440 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.440 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:47.440 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.887273+0000", 2024-09-13T06:39:47.440 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:47.440 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.440 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.440 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:47.440 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.887272+0000", 2024-09-13T06:39:47.440 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.999999 2024-09-13T06:39:47.440 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.440 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.440 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:47.440 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.887280+0000", 2024-09-13T06:39:47.441 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.9060000000000002e-06 2024-09-13T06:39:47.441 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.442 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.442 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:47.442 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.887297+0000", 2024-09-13T06:39:47.442 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6577000000000001e-05 2024-09-13T06:39:47.442 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.442 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.442 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:47.442 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.887306+0000", 2024-09-13T06:39:47.442 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.9579999999999996e-06 2024-09-13T06:39:47.442 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.442 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.442 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:47.442 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.887353+0000", 2024-09-13T06:39:47.443 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7320000000000001e-05 2024-09-13T06:39:47.443 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.443 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.443 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:47.443 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.887374+0000", 2024-09-13T06:39:47.443 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0984000000000001e-05 2024-09-13T06:39:47.443 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.443 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.443 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:39:47.443 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.893037+0000", 2024-09-13T06:39:47.443 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0056629380000000002 2024-09-13T06:39:47.443 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.443 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.444 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:47.444 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.893120+0000", 2024-09-13T06:39:47.444 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.3282000000000007e-05 2024-09-13T06:39:47.444 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:47.444 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:47.444 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:47.444 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.444 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.444 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4385.0:2412 3.0 e31/21 3:07d66135:::rbd_object_map.11212429e5ad:head v 31'56, mlcod=31'48)", 2024-09-13T06:39:47.444 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:38.888795+0000", 2024-09-13T06:39:47.444 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 8.5060286769999998, 2024-09-13T06:39:47.444 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0043887409999999998, 2024-09-13T06:39:47.444 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:47.445 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:47.445 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:47.445 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.445 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:47.445 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.888795+0000", 2024-09-13T06:39:47.445 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:47.445 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.445 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.445 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:47.445 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.888795+0000", 2024-09-13T06:39:47.445 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:47.445 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.445 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.445 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:47.446 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.888794+0000", 2024-09-13T06:39:47.446 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.999999 2024-09-13T06:39:47.446 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.446 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.446 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:47.446 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.888803+0000", 2024-09-13T06:39:47.446 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.7139999999999999e-06 2024-09-13T06:39:47.446 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.446 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.446 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:47.446 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.888820+0000", 2024-09-13T06:39:47.446 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7555999999999999e-05 2024-09-13T06:39:47.446 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.446 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.447 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:47.447 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.888828+0000", 2024-09-13T06:39:47.447 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.153e-06 2024-09-13T06:39:47.447 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.447 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.447 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:47.447 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.888897+0000", 2024-09-13T06:39:47.447 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.9805e-05 2024-09-13T06:39:47.447 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.447 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.447 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:47.447 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.888928+0000", 2024-09-13T06:39:47.447 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.0633000000000003e-05 2024-09-13T06:39:47.447 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.448 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.448 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:39:47.448 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.893124+0000", 2024-09-13T06:39:47.448 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0041962079999999999 2024-09-13T06:39:47.448 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.448 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.448 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:47.448 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.893184+0000", 2024-09-13T06:39:47.448 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9456000000000001e-05 2024-09-13T06:39:47.448 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:47.448 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:47.448 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:47.448 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.448 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.449 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4385.0:2413 3.0 e31/21 3:07d66135:::rbd_object_map.11212429e5ad:head v 31'57, mlcod=31'51)", 2024-09-13T06:39:47.449 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:38.890237+0000", 2024-09-13T06:39:47.449 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 8.5045864760000001, 2024-09-13T06:39:47.449 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0034719220000000001, 2024-09-13T06:39:47.449 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:47.449 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:47.449 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:47.449 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.449 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:47.449 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.890237+0000", 2024-09-13T06:39:47.449 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:47.449 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.449 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.449 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:47.450 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.890237+0000", 2024-09-13T06:39:47.450 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:47.450 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.450 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.450 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:47.450 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.890236+0000", 2024-09-13T06:39:47.450 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.999999 2024-09-13T06:39:47.450 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.450 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.450 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:47.450 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.890243+0000", 2024-09-13T06:39:47.450 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.9630000000000001e-06 2024-09-13T06:39:47.450 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.450 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.451 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:47.451 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.890258+0000", 2024-09-13T06:39:47.451 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4321999999999999e-05 2024-09-13T06:39:47.451 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.451 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.451 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:47.451 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.890265+0000", 2024-09-13T06:39:47.451 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3000000000000004e-06 2024-09-13T06:39:47.451 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.451 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.451 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:47.451 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.890389+0000", 2024-09-13T06:39:47.451 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00012409899999999999 2024-09-13T06:39:47.451 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.452 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.452 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:47.452 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.890420+0000", 2024-09-13T06:39:47.452 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.1090000000000002e-05 2024-09-13T06:39:47.452 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.452 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.452 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:39:47.452 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.893629+0000", 2024-09-13T06:39:47.452 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0032087690000000002 2024-09-13T06:39:47.452 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.452 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.452 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:47.452 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.893709+0000", 2024-09-13T06:39:47.452 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.0226000000000001e-05 2024-09-13T06:39:47.453 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:47.453 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:47.453 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:47.453 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.453 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.453 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "pg_update_log_missing(3.4 epoch 31/21 rep_tid 67 entries 31'2 (0'0) error 3:27e7ab05:::rbd_data.11212429e5ad.0000000000000022:head by client.4385.0:2421 0.000000 0 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-09-13T06:39:47.453 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:38.890280+0000", 2024-09-13T06:39:47.453 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 8.5045431849999993, 2024-09-13T06:39:47.453 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0033244350000000002, 2024-09-13T06:39:47.453 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:47.453 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:39:47.453 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:47.453 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.453 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:47.454 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.890280+0000", 2024-09-13T06:39:47.454 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:47.454 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.454 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.454 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:47.454 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.890280+0000", 2024-09-13T06:39:47.454 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:47.454 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.454 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.454 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:47.454 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.890280+0000", 2024-09-13T06:39:47.454 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:39:47.454 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.454 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.455 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:47.455 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.890287+0000", 2024-09-13T06:39:47.455 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.148e-06 2024-09-13T06:39:47.455 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.455 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.455 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:47.455 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.890302+0000", 2024-09-13T06:39:47.455 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.435e-05 2024-09-13T06:39:47.455 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.455 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.455 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:47.455 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.890312+0000", 2024-09-13T06:39:47.455 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0662999999999999e-05 2024-09-13T06:39:47.455 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.455 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.456 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:47.456 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.890428+0000", 2024-09-13T06:39:47.456 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000115505 2024-09-13T06:39:47.456 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.456 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.456 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:47.456 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.893605+0000", 2024-09-13T06:39:47.456 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.003177119 2024-09-13T06:39:47.456 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:47.456 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:47.456 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:47.456 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.456 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.457 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4385.0:2432 3.0 e31/21 3:07d66135:::rbd_object_map.11212429e5ad:head v 31'62, mlcod=31'58)", 2024-09-13T06:39:47.457 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:38.900535+0000", 2024-09-13T06:39:47.457 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 8.4942884549999995, 2024-09-13T06:39:47.457 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0036949130000000002, 2024-09-13T06:39:47.457 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:47.457 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:47.457 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:47.457 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.457 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:47.457 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.900535+0000", 2024-09-13T06:39:47.457 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:47.457 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.457 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.457 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:47.458 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.900535+0000", 2024-09-13T06:39:47.458 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:47.458 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.458 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.458 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:47.458 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.900535+0000", 2024-09-13T06:39:47.458 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:39:47.458 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.458 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.458 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:47.459 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.900541+0000", 2024-09-13T06:39:47.459 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.4169999999999997e-06 2024-09-13T06:39:47.459 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.459 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.459 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:47.459 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.900553+0000", 2024-09-13T06:39:47.459 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2354000000000001e-05 2024-09-13T06:39:47.459 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.459 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.459 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:47.459 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.900560+0000", 2024-09-13T06:39:47.459 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.8990000000000004e-06 2024-09-13T06:39:47.459 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.460 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.460 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:47.460 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.900621+0000", 2024-09-13T06:39:47.460 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0699000000000003e-05 2024-09-13T06:39:47.460 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.460 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.460 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:47.460 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.900660+0000", 2024-09-13T06:39:47.460 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.8609999999999998e-05 2024-09-13T06:39:47.460 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.460 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.460 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:39:47.460 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.904177+0000", 2024-09-13T06:39:47.460 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0035175509999999998 2024-09-13T06:39:47.461 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.461 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.461 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:47.461 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.904230+0000", 2024-09-13T06:39:47.461 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2966000000000001e-05 2024-09-13T06:39:47.461 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:47.461 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:47.461 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:47.461 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.461 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.461 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4385.0:2433 3.0 e31/21 3:07d66135:::rbd_object_map.11212429e5ad:head v 31'63, mlcod=31'58)", 2024-09-13T06:39:47.461 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:38.901375+0000", 2024-09-13T06:39:47.461 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 8.4934490440000001, 2024-09-13T06:39:47.461 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.005560738, 2024-09-13T06:39:47.462 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:47.462 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:47.462 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:47.462 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.462 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:47.462 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.901375+0000", 2024-09-13T06:39:47.462 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:47.462 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.462 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.462 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:47.462 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.901375+0000", 2024-09-13T06:39:47.462 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:47.462 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.462 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.463 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:47.463 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.901374+0000", 2024-09-13T06:39:47.463 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.999999 2024-09-13T06:39:47.463 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.463 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.463 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:47.463 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.901381+0000", 2024-09-13T06:39:47.463 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.1019999999999999e-06 2024-09-13T06:39:47.463 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.463 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.463 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:47.463 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.901394+0000", 2024-09-13T06:39:47.463 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2782999999999999e-05 2024-09-13T06:39:47.463 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.464 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.464 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:47.464 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.901400+0000", 2024-09-13T06:39:47.464 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.8449999999999997e-06 2024-09-13T06:39:47.464 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.464 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.464 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:47.464 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.901483+0000", 2024-09-13T06:39:47.464 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.2841000000000002e-05 2024-09-13T06:39:47.464 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.464 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.464 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:47.464 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.901513+0000", 2024-09-13T06:39:47.465 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.0102000000000001e-05 2024-09-13T06:39:47.465 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.465 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.465 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:39:47.465 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.906853+0000", 2024-09-13T06:39:47.465 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.005339402 2024-09-13T06:39:47.465 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.465 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.465 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:47.465 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.906935+0000", 2024-09-13T06:39:47.465 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.2488e-05 2024-09-13T06:39:47.465 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:47.465 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:47.465 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:47.465 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.466 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.466 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4385.0:2434 3.0 e31/21 3:07d66135:::rbd_object_map.11212429e5ad:head v 31'64, mlcod=31'58)", 2024-09-13T06:39:47.466 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:38.902253+0000", 2024-09-13T06:39:47.466 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 8.4925704579999994, 2024-09-13T06:39:47.466 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0047392650000000003, 2024-09-13T06:39:47.466 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:47.466 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:47.466 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:47.466 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.466 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:47.466 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.902253+0000", 2024-09-13T06:39:47.466 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:47.466 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.466 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.467 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:47.467 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.902253+0000", 2024-09-13T06:39:47.467 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:47.467 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.467 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.467 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:47.467 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.902252+0000", 2024-09-13T06:39:47.467 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.999999 2024-09-13T06:39:47.467 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.467 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.467 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:47.467 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.902259+0000", 2024-09-13T06:39:47.467 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.9709999999999998e-06 2024-09-13T06:39:47.467 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.468 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.468 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:47.468 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.902273+0000", 2024-09-13T06:39:47.468 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3302000000000001e-05 2024-09-13T06:39:47.468 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.468 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.468 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:47.468 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.902280+0000", 2024-09-13T06:39:47.468 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.126e-06 2024-09-13T06:39:47.468 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.468 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.468 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:47.468 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.902334+0000", 2024-09-13T06:39:47.468 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.4512000000000003e-05 2024-09-13T06:39:47.469 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.469 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.469 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:47.469 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.902363+0000", 2024-09-13T06:39:47.469 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.8544e-05 2024-09-13T06:39:47.469 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.469 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.469 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:39:47.469 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.906941+0000", 2024-09-13T06:39:47.469 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0045781320000000004 2024-09-13T06:39:47.469 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.469 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.470 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:47.470 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.906992+0000", 2024-09-13T06:39:47.470 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.1533000000000003e-05 2024-09-13T06:39:47.470 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:47.470 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:47.470 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:47.470 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.470 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.470 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4385.0:2607 3.4 e31/21 3:26a6dcab:::rbd_data.11212429e5ad.0000000000000357:head v 31'5, mlcod=31'3)", 2024-09-13T06:39:47.470 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:39.238869+0000", 2024-09-13T06:39:47.470 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 8.1559549669999996, 2024-09-13T06:39:47.470 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0033590059999999999, 2024-09-13T06:39:47.470 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:47.471 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:47.471 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:47.471 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.471 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:47.471 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.238869+0000", 2024-09-13T06:39:47.471 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:47.471 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.471 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.471 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:47.471 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.238869+0000", 2024-09-13T06:39:47.471 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:47.471 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.471 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.472 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:47.472 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.238867+0000", 2024-09-13T06:39:47.472 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999981 2024-09-13T06:39:47.472 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.472 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.472 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:47.472 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.238882+0000", 2024-09-13T06:39:47.472 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5226e-05 2024-09-13T06:39:47.472 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.472 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.472 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:47.472 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.238976+0000", 2024-09-13T06:39:47.472 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.4423e-05 2024-09-13T06:39:47.472 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.473 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.473 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:47.473 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.238995+0000", 2024-09-13T06:39:47.473 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9066e-05 2024-09-13T06:39:47.473 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.473 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.473 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:47.473 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.239059+0000", 2024-09-13T06:39:47.473 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3744999999999994e-05 2024-09-13T06:39:47.473 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.473 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.474 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:47.474 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.239082+0000", 2024-09-13T06:39:47.474 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2405999999999999e-05 2024-09-13T06:39:47.474 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.474 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.474 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:39:47.474 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.242184+0000", 2024-09-13T06:39:47.474 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0031028850000000001 2024-09-13T06:39:47.474 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.474 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.474 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:47.474 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.242228+0000", 2024-09-13T06:39:47.474 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.3155000000000003e-05 2024-09-13T06:39:47.475 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:47.475 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:47.475 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:47.475 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.475 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.475 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4385.0:2610 3.0 e31/21 3:05b06d2f:::rbd_data.11212429e5ad.0000000000000367:head v 31'112, mlcod=31'110)", 2024-09-13T06:39:47.475 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:39.239230+0000", 2024-09-13T06:39:47.475 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 8.1555936829999993, 2024-09-13T06:39:47.475 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0036041720000000001, 2024-09-13T06:39:47.475 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:47.475 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:47.475 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:47.475 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.476 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:47.476 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.239230+0000", 2024-09-13T06:39:47.476 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:47.476 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.476 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.476 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:47.476 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.239230+0000", 2024-09-13T06:39:47.476 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:47.476 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.476 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.476 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:47.476 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.239229+0000", 2024-09-13T06:39:47.476 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.999999 2024-09-13T06:39:47.477 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.477 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.477 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:47.477 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.239238+0000", 2024-09-13T06:39:47.477 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.2529999999999993e-06 2024-09-13T06:39:47.477 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.477 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.477 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:47.477 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.240075+0000", 2024-09-13T06:39:47.477 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00083642899999999997 2024-09-13T06:39:47.477 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.477 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.477 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:47.478 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.240084+0000", 2024-09-13T06:39:47.478 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.3160000000000003e-06 2024-09-13T06:39:47.478 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.478 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.478 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:47.478 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.240173+0000", 2024-09-13T06:39:47.478 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.9536999999999993e-05 2024-09-13T06:39:47.478 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.478 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.478 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:47.478 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.240192+0000", 2024-09-13T06:39:47.478 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8547999999999999e-05 2024-09-13T06:39:47.478 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.479 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.479 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:39:47.479 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.242758+0000", 2024-09-13T06:39:47.479 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.002565936 2024-09-13T06:39:47.479 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.479 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.479 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:47.479 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.242834+0000", 2024-09-13T06:39:47.479 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.6198999999999993e-05 2024-09-13T06:39:47.479 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:47.479 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:47.480 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:47.480 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.480 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.480 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4385.0:2665 3.0 e31/21 3:07d66135:::rbd_object_map.11212429e5ad:head v 31'127, mlcod=31'125)", 2024-09-13T06:39:47.480 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:39.384538+0000", 2024-09-13T06:39:47.480 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 8.010285391, 2024-09-13T06:39:47.480 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00349468, 2024-09-13T06:39:47.480 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:47.480 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:47.480 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:47.480 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.480 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:47.480 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.384538+0000", 2024-09-13T06:39:47.481 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:47.481 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.481 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.481 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:47.481 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.384538+0000", 2024-09-13T06:39:47.481 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:47.481 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.481 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.481 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:47.481 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.384537+0000", 2024-09-13T06:39:47.481 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999986 2024-09-13T06:39:47.481 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.481 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.481 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:47.482 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.384548+0000", 2024-09-13T06:39:47.482 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1542999999999999e-05 2024-09-13T06:39:47.482 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.482 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.482 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:47.482 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.384571+0000", 2024-09-13T06:39:47.482 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2317e-05 2024-09-13T06:39:47.482 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.482 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.482 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:47.482 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.384579+0000", 2024-09-13T06:39:47.482 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.3140000000000004e-06 2024-09-13T06:39:47.482 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.482 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.483 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:47.483 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.384634+0000", 2024-09-13T06:39:47.483 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.5451999999999997e-05 2024-09-13T06:39:47.483 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.483 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.483 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:47.483 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.384663+0000", 2024-09-13T06:39:47.483 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.8419999999999999e-05 2024-09-13T06:39:47.483 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.483 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.483 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:39:47.483 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.387993+0000", 2024-09-13T06:39:47.483 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0033301630000000001 2024-09-13T06:39:47.483 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.484 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.484 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:47.484 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.388033+0000", 2024-09-13T06:39:47.484 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.9818999999999999e-05 2024-09-13T06:39:47.484 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:47.484 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:47.484 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:47.484 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.484 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.484 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4385.0:4997 3.9 e38/21 3:904af028:::rbd_data.112150cd58e1.0000000000000008:head v 38'98, mlcod=38'95)", 2024-09-13T06:39:47.484 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:46.743130+0000", 2024-09-13T06:39:47.484 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.65169329499999995, 2024-09-13T06:39:47.484 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0049048570000000003, 2024-09-13T06:39:47.484 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:47.485 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:47.485 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:47.485 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.485 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:47.485 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:46.743130+0000", 2024-09-13T06:39:47.485 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:47.485 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.485 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.485 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:47.485 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:46.743130+0000", 2024-09-13T06:39:47.485 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:47.485 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.485 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.485 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:47.486 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:46.743129+0000", 2024-09-13T06:39:47.486 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.999999 2024-09-13T06:39:47.486 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.486 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.486 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:47.486 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:46.743138+0000", 2024-09-13T06:39:47.486 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.6519999999999995e-06 2024-09-13T06:39:47.486 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.486 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.486 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:47.486 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:46.743152+0000", 2024-09-13T06:39:47.486 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3757999999999999e-05 2024-09-13T06:39:47.486 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.486 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.487 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:47.487 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:46.743160+0000", 2024-09-13T06:39:47.487 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.5550000000000003e-06 2024-09-13T06:39:47.487 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.487 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.487 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:47.487 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:46.743208+0000", 2024-09-13T06:39:47.487 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7348999999999997e-05 2024-09-13T06:39:47.487 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.487 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.487 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:47.487 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:46.743233+0000", 2024-09-13T06:39:47.487 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5058e-05 2024-09-13T06:39:47.487 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.488 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.488 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:39:47.488 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:46.747999+0000", 2024-09-13T06:39:47.488 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0047658680000000004 2024-09-13T06:39:47.488 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.488 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.488 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:47.488 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:46.748035+0000", 2024-09-13T06:39:47.488 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.6421000000000002e-05 2024-09-13T06:39:47.488 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:47.488 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:47.488 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:47.488 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:47.488 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:47.489 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:39:47.490 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-13T06:39:47.490 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:39:47.491+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:39:47.514 INFO:teuthology.orchestra.run.smithi081.stderr:nodeep-scrub is unset 2024-09-13T06:39:47.590 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:39:47.590+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:39:47.644 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:39:47.644 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-13T06:39:47.644 INFO:teuthology.orchestra.run.smithi081.stdout: "num_ops": 0 2024-09-13T06:39:47.644 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:39:47.658 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-13T06:39:47.691 INFO:tasks.ceph.osd.6.smithi139.stderr:2024-09-13T06:39:47.694+0000 7fcd02c5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26385) UID: 0 2024-09-13T06:39:47.779 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:39:47.779 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-13T06:39:47.779 INFO:teuthology.orchestra.run.smithi081.stdout: "complaint_time": 30, 2024-09-13T06:39:47.780 INFO:teuthology.orchestra.run.smithi081.stdout: "num_blocked_ops": 0 2024-09-13T06:39:47.780 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:39:47.792 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:39:47.798+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:39:47.793 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-13T06:39:47.801 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-13T06:39:47.801 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-13T06:39:47.802 INFO:tasks.thrashosds.thrasher:Removing osd 7, in_osds are: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-13T06:39:47.802 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd out 7 2024-09-13T06:39:47.893 INFO:tasks.ceph.osd.6.smithi139.stderr:2024-09-13T06:39:47.894+0000 7fcd02c5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26385) UID: 0 2024-09-13T06:39:47.921 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:39:47.921 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 20, 2024-09-13T06:39:47.921 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 600, 2024-09-13T06:39:47.921 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [ 2024-09-13T06:39:47.921 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.921 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4385.0:613 3.c e27/21 3:30175a4c:::rbd_header.11214e25756e:head v 27'34, mlcod=27'32)", 2024-09-13T06:39:47.921 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:34.844467+0000", 2024-09-13T06:39:47.922 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 13.079750731000001, 2024-09-13T06:39:47.922 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0038627290000000001, 2024-09-13T06:39:47.922 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:47.922 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:47.922 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:47.922 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.922 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:47.922 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:34.844467+0000", 2024-09-13T06:39:47.922 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:47.922 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.922 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.922 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:47.923 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:34.844467+0000", 2024-09-13T06:39:47.923 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:47.923 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.923 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.923 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:47.923 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:34.844466+0000", 2024-09-13T06:39:47.923 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:39:47.923 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.923 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.923 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:47.923 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:34.844472+0000", 2024-09-13T06:39:47.923 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9410000000000004e-06 2024-09-13T06:39:47.923 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.923 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.924 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:47.924 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:34.844489+0000", 2024-09-13T06:39:47.924 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7218999999999999e-05 2024-09-13T06:39:47.924 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.924 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.924 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:47.924 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:34.844495+0000", 2024-09-13T06:39:47.924 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.4430000000000002e-06 2024-09-13T06:39:47.924 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.924 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.924 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:47.924 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:34.844553+0000", 2024-09-13T06:39:47.924 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8658e-05 2024-09-13T06:39:47.925 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.925 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.925 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:47.925 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:34.844578+0000", 2024-09-13T06:39:47.925 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5055999999999999e-05 2024-09-13T06:39:47.925 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.925 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.925 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:39:47.925 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:34.848256+0000", 2024-09-13T06:39:47.925 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.003677881 2024-09-13T06:39:47.925 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.925 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.925 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:47.925 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:34.848329+0000", 2024-09-13T06:39:47.926 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3221999999999998e-05 2024-09-13T06:39:47.926 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:47.926 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:47.926 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:47.926 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.926 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.926 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:2226 3.15 3:af026987:::rbd_data.112173e2f1b7.0000000000000017:head [sparse-read 0~4194304] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-13T06:39:47.926 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:37.606562+0000", 2024-09-13T06:39:47.926 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 10.317655846999999, 2024-09-13T06:39:47.926 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.83322091700000001, 2024-09-13T06:39:47.926 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:47.926 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:39:47.926 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:39:47.927 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:39:47.927 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:47.927 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 2226 2024-09-13T06:39:47.927 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.927 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:47.927 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.927 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:47.927 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606562+0000", 2024-09-13T06:39:47.927 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:47.927 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.928 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.928 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:47.928 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606562+0000", 2024-09-13T06:39:47.928 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:47.928 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.928 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.928 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:47.928 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606561+0000", 2024-09-13T06:39:47.928 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:39:47.928 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.928 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.928 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:47.928 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606565+0000", 2024-09-13T06:39:47.929 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.4379999999999999e-06 2024-09-13T06:39:47.929 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.929 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.929 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:47.929 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606569+0000", 2024-09-13T06:39:47.929 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.425e-06 2024-09-13T06:39:47.929 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.929 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.929 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:47.929 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606572+0000", 2024-09-13T06:39:47.929 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.05e-06 2024-09-13T06:39:47.929 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.929 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.929 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:47.930 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606621+0000", 2024-09-13T06:39:47.930 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.8723000000000001e-05 2024-09-13T06:39:47.930 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.930 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.930 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:39:47.930 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606630+0000", 2024-09-13T06:39:47.930 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.8040000000000007e-06 2024-09-13T06:39:47.930 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.930 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.930 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:47.930 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.439648+0000", 2024-09-13T06:39:47.930 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.83301824800000002 2024-09-13T06:39:47.930 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.930 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.931 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:47.931 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.439782+0000", 2024-09-13T06:39:47.931 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00013466699999999999 2024-09-13T06:39:47.931 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:47.931 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:47.931 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:47.931 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.931 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.931 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:2280 3.15 3:a94cd9aa:::rbd_data.11212429e5ad.0000000000000076:head [set-alloc-hint object_size 262144 write_size 262144,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-13T06:39:47.931 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:38.669961+0000", 2024-09-13T06:39:47.931 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 9.2542563080000004, 2024-09-13T06:39:47.931 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.028162192999999999, 2024-09-13T06:39:47.931 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:47.931 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:47.932 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:39:47.932 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:39:47.932 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:47.932 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 2280 2024-09-13T06:39:47.932 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.932 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:47.932 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.932 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:47.932 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.669961+0000", 2024-09-13T06:39:47.932 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:47.932 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.932 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.933 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:47.933 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.669961+0000", 2024-09-13T06:39:47.933 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:47.933 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.933 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.933 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:47.933 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.669960+0000", 2024-09-13T06:39:47.933 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999986 2024-09-13T06:39:47.933 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.933 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.933 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:47.933 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.669968+0000", 2024-09-13T06:39:47.933 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.3429999999999996e-06 2024-09-13T06:39:47.933 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.934 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.934 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:47.934 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.669983+0000", 2024-09-13T06:39:47.934 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4722999999999999e-05 2024-09-13T06:39:47.934 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.934 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.934 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:47.934 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.669989+0000", 2024-09-13T06:39:47.934 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.4699999999999999e-06 2024-09-13T06:39:47.934 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.934 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.934 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:47.934 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.670034+0000", 2024-09-13T06:39:47.934 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4796000000000003e-05 2024-09-13T06:39:47.935 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.935 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.935 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:47.935 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.670138+0000", 2024-09-13T06:39:47.935 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00010367800000000001 2024-09-13T06:39:47.935 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.935 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.935 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 7", 2024-09-13T06:39:47.935 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.673689+0000", 2024-09-13T06:39:47.935 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0035515400000000002 2024-09-13T06:39:47.935 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.935 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.935 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-09-13T06:39:47.935 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.697921+0000", 2024-09-13T06:39:47.936 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.024231946000000001 2024-09-13T06:39:47.936 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.936 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.936 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:39:47.936 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.697984+0000", 2024-09-13T06:39:47.936 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.2885999999999994e-05 2024-09-13T06:39:47.936 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.936 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.936 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:39:47.936 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.698059+0000", 2024-09-13T06:39:47.936 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.538e-05 2024-09-13T06:39:47.936 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.936 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.936 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:47.937 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.698123+0000", 2024-09-13T06:39:47.937 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.4024999999999998e-05 2024-09-13T06:39:47.937 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:47.937 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:47.937 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:47.937 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.937 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.937 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop_reply(client.4385.0:2280 3.15 e31/30 ondisk, result = 0)", 2024-09-13T06:39:47.937 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:38.693889+0000", 2024-09-13T06:39:47.937 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 9.2303280910000005, 2024-09-13T06:39:47.937 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0042543499999999996, 2024-09-13T06:39:47.937 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:47.937 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:39:47.938 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:47.938 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.938 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:47.938 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.693889+0000", 2024-09-13T06:39:47.938 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:47.938 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.938 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.938 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:47.938 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.693889+0000", 2024-09-13T06:39:47.938 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:47.938 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.938 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.938 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:47.939 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.693887+0000", 2024-09-13T06:39:47.939 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999981 2024-09-13T06:39:47.939 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.939 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.939 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:47.939 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.693898+0000", 2024-09-13T06:39:47.939 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0679999999999999e-05 2024-09-13T06:39:47.939 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.939 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.939 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:47.939 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.693929+0000", 2024-09-13T06:39:47.939 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.0902999999999999e-05 2024-09-13T06:39:47.939 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.939 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.940 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:47.940 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.693945+0000", 2024-09-13T06:39:47.940 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5472999999999999e-05 2024-09-13T06:39:47.940 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.940 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.940 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:47.940 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.697958+0000", 2024-09-13T06:39:47.940 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0040138170000000003 2024-09-13T06:39:47.940 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.941 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.941 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:47.941 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.697973+0000", 2024-09-13T06:39:47.941 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.471e-05 2024-09-13T06:39:47.941 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.941 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.941 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:47.941 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.698144+0000", 2024-09-13T06:39:47.941 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00017060400000000001 2024-09-13T06:39:47.941 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:47.942 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:47.942 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:47.942 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.942 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.942 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:2334 3.18 3:1d18707c:::rbd_data.11212429e5ad.000000000000002d:head [delete] snapc 8=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-13T06:39:47.942 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:38.831972+0000", 2024-09-13T06:39:47.942 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 9.092245557, 2024-09-13T06:39:47.942 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0039621639999999998, 2024-09-13T06:39:47.942 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:47.942 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:39:47.942 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:39:47.942 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:39:47.942 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:47.943 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 2334 2024-09-13T06:39:47.943 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.943 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:47.943 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.943 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:47.943 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.831972+0000", 2024-09-13T06:39:47.943 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:47.943 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.943 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.943 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:47.943 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.831972+0000", 2024-09-13T06:39:47.943 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:47.943 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.944 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.944 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:47.944 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.831969+0000", 2024-09-13T06:39:47.944 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999971 2024-09-13T06:39:47.944 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.944 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.944 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:47.944 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.831981+0000", 2024-09-13T06:39:47.944 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.165e-05 2024-09-13T06:39:47.944 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.944 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.944 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:47.944 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.832014+0000", 2024-09-13T06:39:47.944 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.3597999999999999e-05 2024-09-13T06:39:47.945 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.945 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.945 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:47.945 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.832029+0000", 2024-09-13T06:39:47.945 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4617000000000001e-05 2024-09-13T06:39:47.945 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.945 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.945 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:47.945 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.832088+0000", 2024-09-13T06:39:47.945 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9369e-05 2024-09-13T06:39:47.945 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.945 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.945 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:47.945 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.832226+0000", 2024-09-13T06:39:47.946 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00013727600000000001 2024-09-13T06:39:47.946 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.946 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.946 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:47.946 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.835934+0000", 2024-09-13T06:39:47.946 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0037084230000000002 2024-09-13T06:39:47.946 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:47.946 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:47.946 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:47.946 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.946 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.946 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:2351 3.15 3:a8b7c3d8:::rbd_data.11212429e5ad.0000000000000044:head [delete] snapc 8=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-13T06:39:47.947 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:38.839360+0000", 2024-09-13T06:39:47.947 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 9.0848578950000007, 2024-09-13T06:39:47.947 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0056685679999999997, 2024-09-13T06:39:47.947 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:47.947 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:39:47.947 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:39:47.947 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:39:47.947 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:47.947 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 2351 2024-09-13T06:39:47.947 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.947 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:47.947 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.948 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:47.948 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.839360+0000", 2024-09-13T06:39:47.948 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:47.948 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.948 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.948 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:47.948 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.839360+0000", 2024-09-13T06:39:47.948 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:47.948 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.948 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.948 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:47.948 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.839358+0000", 2024-09-13T06:39:47.948 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999986 2024-09-13T06:39:47.948 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.949 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.949 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:47.949 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.839366+0000", 2024-09-13T06:39:47.949 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.2069999999999995e-06 2024-09-13T06:39:47.949 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.949 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.949 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:47.949 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.839382+0000", 2024-09-13T06:39:47.949 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5458e-05 2024-09-13T06:39:47.949 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.949 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.950 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:47.950 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.839389+0000", 2024-09-13T06:39:47.950 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3490000000000003e-06 2024-09-13T06:39:47.950 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.950 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.950 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:47.950 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.839436+0000", 2024-09-13T06:39:47.950 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6456999999999999e-05 2024-09-13T06:39:47.950 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.950 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.950 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:47.950 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.839540+0000", 2024-09-13T06:39:47.951 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00010473 2024-09-13T06:39:47.951 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.951 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.951 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:47.951 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.845028+0000", 2024-09-13T06:39:47.951 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0054877099999999998 2024-09-13T06:39:47.951 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:47.951 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:47.951 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:47.951 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.951 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.951 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:2357 3.15 3:a94cd9aa:::rbd_data.11212429e5ad.0000000000000076:head [delete] snapc 8=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-13T06:39:47.952 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:38.845199+0000", 2024-09-13T06:39:47.952 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 9.0790183229999997, 2024-09-13T06:39:47.952 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0041413279999999997, 2024-09-13T06:39:47.952 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:47.952 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:47.952 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:39:47.952 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:39:47.952 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:47.952 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 2357 2024-09-13T06:39:47.952 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.952 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:47.952 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.953 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:47.953 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.845199+0000", 2024-09-13T06:39:47.953 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:47.953 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.953 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.953 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:47.953 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.845199+0000", 2024-09-13T06:39:47.953 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:47.953 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.953 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.953 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:47.954 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.845198+0000", 2024-09-13T06:39:47.954 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.999999 2024-09-13T06:39:47.954 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.954 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.954 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:47.954 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.845204+0000", 2024-09-13T06:39:47.954 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7590000000000003e-06 2024-09-13T06:39:47.954 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.954 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.954 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:47.954 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.845220+0000", 2024-09-13T06:39:47.954 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5988e-05 2024-09-13T06:39:47.954 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.954 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.955 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:47.955 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.845228+0000", 2024-09-13T06:39:47.955 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.0369999999999995e-06 2024-09-13T06:39:47.955 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.955 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.955 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:47.955 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.845282+0000", 2024-09-13T06:39:47.955 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.4187000000000001e-05 2024-09-13T06:39:47.955 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.955 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.955 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:47.955 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.845406+0000", 2024-09-13T06:39:47.955 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000123695 2024-09-13T06:39:47.955 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.956 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.956 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 7", 2024-09-13T06:39:47.956 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.845582+0000", 2024-09-13T06:39:47.956 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00017596500000000001 2024-09-13T06:39:47.956 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.956 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.956 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-09-13T06:39:47.956 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.846244+0000", 2024-09-13T06:39:47.956 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00066242899999999997 2024-09-13T06:39:47.956 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.956 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.956 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:39:47.956 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.849256+0000", 2024-09-13T06:39:47.957 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.003011643 2024-09-13T06:39:47.957 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.957 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.957 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:39:47.957 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.849302+0000", 2024-09-13T06:39:47.957 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6449999999999997e-05 2024-09-13T06:39:47.957 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.957 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.957 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:47.957 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.849340+0000", 2024-09-13T06:39:47.957 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.8250000000000001e-05 2024-09-13T06:39:47.957 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:47.957 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:47.957 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:47.958 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.958 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.958 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:2371 3.1e 3:7b202373:::rbd_data.11212429e5ad.00000000000000ab:head [delete] snapc 8=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-13T06:39:47.958 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:38.849850+0000", 2024-09-13T06:39:47.958 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 9.0743676489999991, 2024-09-13T06:39:47.958 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0042073730000000004, 2024-09-13T06:39:47.958 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:47.958 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:39:47.958 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:39:47.958 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:39:47.958 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:47.958 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 2371 2024-09-13T06:39:47.959 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.959 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:47.959 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.959 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:47.959 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.849850+0000", 2024-09-13T06:39:47.959 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:47.959 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.959 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.959 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:47.959 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.849850+0000", 2024-09-13T06:39:47.959 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:47.959 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.959 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.960 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:47.960 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.849849+0000", 2024-09-13T06:39:47.960 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.999999 2024-09-13T06:39:47.960 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.960 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.960 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:47.960 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.849856+0000", 2024-09-13T06:39:47.960 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.2169999999999997e-06 2024-09-13T06:39:47.960 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.960 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.960 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:47.960 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.849870+0000", 2024-09-13T06:39:47.960 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3560000000000001e-05 2024-09-13T06:39:47.961 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.961 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.961 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:47.961 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.849878+0000", 2024-09-13T06:39:47.961 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.2670000000000006e-06 2024-09-13T06:39:47.961 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.961 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.961 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:47.961 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.849926+0000", 2024-09-13T06:39:47.961 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.8572000000000002e-05 2024-09-13T06:39:47.961 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.961 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.961 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:47.962 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.850065+0000", 2024-09-13T06:39:47.962 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00013843199999999999 2024-09-13T06:39:47.962 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.962 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.962 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:47.962 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.854057+0000", 2024-09-13T06:39:47.962 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.003992359 2024-09-13T06:39:47.962 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:47.962 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:47.962 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:47.962 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.962 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.962 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:2372 3.8 3:173d1868:::rbd_data.11212429e5ad.00000000000000ac:head [delete] snapc 8=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-13T06:39:47.963 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:38.849888+0000", 2024-09-13T06:39:47.963 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 9.0743292820000008, 2024-09-13T06:39:47.963 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0042468810000000001, 2024-09-13T06:39:47.963 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:47.963 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:39:47.963 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:39:47.963 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:39:47.963 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:47.963 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 2372 2024-09-13T06:39:47.963 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.963 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:47.963 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.963 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:47.963 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.849888+0000", 2024-09-13T06:39:47.964 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:47.964 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.964 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.964 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:47.964 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.849888+0000", 2024-09-13T06:39:47.964 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:47.964 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.964 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.964 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:47.964 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.849888+0000", 2024-09-13T06:39:47.964 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:39:47.964 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.964 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.964 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:47.965 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.849890+0000", 2024-09-13T06:39:47.965 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.7350000000000001e-06 2024-09-13T06:39:47.965 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.965 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.965 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:47.965 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.849896+0000", 2024-09-13T06:39:47.965 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.1490000000000002e-06 2024-09-13T06:39:47.965 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.965 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.965 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:47.965 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.849900+0000", 2024-09-13T06:39:47.965 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.2010000000000001e-06 2024-09-13T06:39:47.965 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.966 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.966 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:47.966 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.849939+0000", 2024-09-13T06:39:47.966 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.9682999999999999e-05 2024-09-13T06:39:47.966 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.966 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.966 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:47.966 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.850053+0000", 2024-09-13T06:39:47.966 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00011350500000000001 2024-09-13T06:39:47.966 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.966 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.966 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:47.966 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.854135+0000", 2024-09-13T06:39:47.967 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0040820689999999998 2024-09-13T06:39:47.967 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:47.967 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:47.967 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:47.967 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.967 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.967 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "pg_update_log_missing(3.c epoch 31/21 rep_tid 76 entries 31'46 (0'0) error 3:33b14f9a:::rbd_data.11212429e5ad.00000000000000aa:head by client.4385.0:2370 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 28'44)", 2024-09-13T06:39:47.967 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:38.851137+0000", 2024-09-13T06:39:47.967 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 9.0730799149999992, 2024-09-13T06:39:47.967 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0055062599999999998, 2024-09-13T06:39:47.967 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:47.967 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:39:47.968 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:47.968 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.968 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:47.968 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.851137+0000", 2024-09-13T06:39:47.968 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:47.968 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.968 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.968 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:47.968 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.851137+0000", 2024-09-13T06:39:47.968 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:47.968 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.968 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.968 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:47.969 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.851136+0000", 2024-09-13T06:39:47.969 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.999999 2024-09-13T06:39:47.969 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.969 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.969 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:47.969 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.851148+0000", 2024-09-13T06:39:47.969 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1790999999999999e-05 2024-09-13T06:39:47.969 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.969 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.969 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:47.969 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.851171+0000", 2024-09-13T06:39:47.969 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3246000000000001e-05 2024-09-13T06:39:47.969 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.970 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.970 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:47.970 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.851187+0000", 2024-09-13T06:39:47.970 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5673999999999999e-05 2024-09-13T06:39:47.970 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.970 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.970 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:47.970 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.851426+0000", 2024-09-13T06:39:47.970 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000238722 2024-09-13T06:39:47.970 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.970 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.970 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:47.970 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.856644+0000", 2024-09-13T06:39:47.971 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0052179009999999996 2024-09-13T06:39:47.971 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:47.971 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:47.971 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:47.971 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.971 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.971 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:2430 3.8 3:157e7bb9:::rbd_data.11212429e5ad.0000000000000029:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-13T06:39:47.971 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:38.898223+0000", 2024-09-13T06:39:47.971 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 9.0259947329999992, 2024-09-13T06:39:47.971 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0062964479999999996, 2024-09-13T06:39:47.971 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:47.971 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:39:47.971 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:39:47.972 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:39:47.972 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:47.972 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 2430 2024-09-13T06:39:47.972 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.972 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:47.972 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.972 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:47.972 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.898223+0000", 2024-09-13T06:39:47.972 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:47.972 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.972 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.972 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:47.972 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.898223+0000", 2024-09-13T06:39:47.972 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:47.973 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.973 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.973 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:47.973 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.898221+0000", 2024-09-13T06:39:47.973 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999981 2024-09-13T06:39:47.973 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.973 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.973 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:47.973 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.898231+0000", 2024-09-13T06:39:47.973 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0149999999999999e-05 2024-09-13T06:39:47.973 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.973 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.973 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:47.974 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.898253+0000", 2024-09-13T06:39:47.974 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2639000000000001e-05 2024-09-13T06:39:47.974 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.974 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.974 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:47.974 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.898265+0000", 2024-09-13T06:39:47.974 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1381e-05 2024-09-13T06:39:47.974 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.974 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.974 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:47.974 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.898326+0000", 2024-09-13T06:39:47.974 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.1379999999999998e-05 2024-09-13T06:39:47.974 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.974 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.975 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:47.975 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.898490+0000", 2024-09-13T06:39:47.975 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000164155 2024-09-13T06:39:47.975 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.975 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.975 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:47.975 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.904519+0000", 2024-09-13T06:39:47.975 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0060287200000000004 2024-09-13T06:39:47.975 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:47.975 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:47.975 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:47.975 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.975 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.976 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4385.0:2637 3.c e31/21 3:34346ebf:::rbd_data.11212429e5ad.00000000000001e5:head v 31'49, mlcod=31'47)", 2024-09-13T06:39:47.976 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:39.288896+0000", 2024-09-13T06:39:47.976 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 8.6353215619999997, 2024-09-13T06:39:47.976 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0041430700000000004, 2024-09-13T06:39:47.976 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:47.976 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:47.976 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:47.976 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.976 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:47.976 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.288896+0000", 2024-09-13T06:39:47.976 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:47.976 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.976 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.977 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:47.977 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.288896+0000", 2024-09-13T06:39:47.977 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:47.977 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.977 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.977 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:47.977 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.288894+0000", 2024-09-13T06:39:47.977 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999976 2024-09-13T06:39:47.977 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.977 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.977 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:47.977 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.291185+0000", 2024-09-13T06:39:47.977 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0022910959999999998 2024-09-13T06:39:47.977 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.978 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.978 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:47.978 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.291213+0000", 2024-09-13T06:39:47.978 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.8537000000000001e-05 2024-09-13T06:39:47.978 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.978 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.978 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:47.978 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.291227+0000", 2024-09-13T06:39:47.978 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3506000000000001e-05 2024-09-13T06:39:47.978 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.978 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.978 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:47.978 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.291349+0000", 2024-09-13T06:39:47.978 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000122459 2024-09-13T06:39:47.979 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.979 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.979 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:47.979 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.291405+0000", 2024-09-13T06:39:47.979 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.5470000000000003e-05 2024-09-13T06:39:47.979 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.979 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.979 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:39:47.979 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.292980+0000", 2024-09-13T06:39:47.979 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0015756380000000001 2024-09-13T06:39:47.979 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.979 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.979 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:47.979 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.293039+0000", 2024-09-13T06:39:47.980 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8712999999999998e-05 2024-09-13T06:39:47.980 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:47.980 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:47.980 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:47.980 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.980 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.980 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:2679 3.15 3:afe512c8:::rbd_data.11212429e5ad.0000000000000084:head [delete] snapc 8=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-13T06:39:47.980 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:39.425673+0000", 2024-09-13T06:39:47.980 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 8.4985440430000008, 2024-09-13T06:39:47.980 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0051813859999999996, 2024-09-13T06:39:47.980 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:47.980 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:47.980 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:39:47.980 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:39:47.981 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:47.981 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 2679 2024-09-13T06:39:47.981 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.981 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:47.981 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.981 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:47.981 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.425673+0000", 2024-09-13T06:39:47.981 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:47.981 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.981 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.981 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:47.981 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.425673+0000", 2024-09-13T06:39:47.981 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:47.982 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.982 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.982 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:47.982 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.425671+0000", 2024-09-13T06:39:47.982 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999976 2024-09-13T06:39:47.982 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.982 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.982 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:47.982 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.425682+0000", 2024-09-13T06:39:47.982 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.11e-05 2024-09-13T06:39:47.982 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.982 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.982 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:47.982 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.425715+0000", 2024-09-13T06:39:47.983 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.2768000000000002e-05 2024-09-13T06:39:47.983 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.983 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.983 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:47.983 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.425731+0000", 2024-09-13T06:39:47.983 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5866e-05 2024-09-13T06:39:47.983 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.983 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.983 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:47.983 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.425779+0000", 2024-09-13T06:39:47.983 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.8322999999999998e-05 2024-09-13T06:39:47.983 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.983 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.983 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:47.984 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.425869+0000", 2024-09-13T06:39:47.984 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.9985e-05 2024-09-13T06:39:47.984 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.984 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.984 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 7", 2024-09-13T06:39:47.984 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.425985+0000", 2024-09-13T06:39:47.984 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000115633 2024-09-13T06:39:47.984 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.984 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.984 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-09-13T06:39:47.984 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.426776+0000", 2024-09-13T06:39:47.984 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00079090499999999995 2024-09-13T06:39:47.984 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.985 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.985 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:39:47.985 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.430767+0000", 2024-09-13T06:39:47.985 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0039910040000000003 2024-09-13T06:39:47.985 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.985 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.985 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:39:47.985 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.430814+0000", 2024-09-13T06:39:47.985 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7633999999999998e-05 2024-09-13T06:39:47.985 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.985 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.985 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:47.985 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.430855+0000", 2024-09-13T06:39:47.985 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.0596999999999998e-05 2024-09-13T06:39:47.986 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:47.986 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:47.986 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:47.986 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.986 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.986 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:2686 3.7 3:e797442e:::rbd_data.11212429e5ad.00000000000000da:head [delete] snapc 8=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-13T06:39:47.986 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:39.425784+0000", 2024-09-13T06:39:47.986 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 8.4984336159999998, 2024-09-13T06:39:47.986 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0045158100000000003, 2024-09-13T06:39:47.986 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:47.986 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:47.986 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:39:47.986 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:39:47.986 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:47.987 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 2686 2024-09-13T06:39:47.987 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.987 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:47.987 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.987 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:47.987 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.425784+0000", 2024-09-13T06:39:47.987 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:47.987 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.987 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.987 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:47.987 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.425784+0000", 2024-09-13T06:39:47.987 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:47.987 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.987 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.987 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:47.988 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.425783+0000", 2024-09-13T06:39:47.988 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:39:47.988 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.988 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.988 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:47.988 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.425787+0000", 2024-09-13T06:39:47.988 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.7699999999999999e-06 2024-09-13T06:39:47.988 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.988 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.988 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:47.988 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.425796+0000", 2024-09-13T06:39:47.988 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.5329999999999994e-06 2024-09-13T06:39:47.989 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.989 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.989 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:47.989 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.425802+0000", 2024-09-13T06:39:47.989 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.798e-06 2024-09-13T06:39:47.989 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.989 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.989 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:47.989 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.425853+0000", 2024-09-13T06:39:47.989 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.1075999999999997e-05 2024-09-13T06:39:47.989 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.989 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.989 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:47.990 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.425940+0000", 2024-09-13T06:39:47.990 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.6932e-05 2024-09-13T06:39:47.990 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.990 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.990 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 7", 2024-09-13T06:39:47.990 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.426054+0000", 2024-09-13T06:39:47.990 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000113266 2024-09-13T06:39:47.990 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.990 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.990 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-09-13T06:39:47.990 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.426772+0000", 2024-09-13T06:39:47.990 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00071808899999999999 2024-09-13T06:39:47.990 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.991 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.991 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:39:47.991 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.430225+0000", 2024-09-13T06:39:47.991 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0034537639999999998 2024-09-13T06:39:47.991 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.991 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.991 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:39:47.991 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.430253+0000", 2024-09-13T06:39:47.991 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.7912999999999999e-05 2024-09-13T06:39:47.991 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.991 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.991 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:47.991 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.430300+0000", 2024-09-13T06:39:47.991 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6233000000000003e-05 2024-09-13T06:39:47.992 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:47.992 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:47.992 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:47.992 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.992 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.992 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:2695 3.8 3:11c8caf4:::rbd_data.11212429e5ad.00000000000001c7:head [delete] snapc 8=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-13T06:39:47.992 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:39.430982+0000", 2024-09-13T06:39:47.992 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 8.4932350079999992, 2024-09-13T06:39:47.992 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0039220080000000003, 2024-09-13T06:39:47.992 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:47.992 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:47.992 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:39:47.992 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:39:47.993 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:47.993 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 2695 2024-09-13T06:39:47.993 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.993 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:47.993 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.993 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:47.993 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.430982+0000", 2024-09-13T06:39:47.993 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:47.993 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.993 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.993 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:47.993 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.430982+0000", 2024-09-13T06:39:47.993 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:47.994 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.994 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.994 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:47.994 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.430981+0000", 2024-09-13T06:39:47.994 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.999999 2024-09-13T06:39:47.994 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.994 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.994 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:47.994 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.430988+0000", 2024-09-13T06:39:47.994 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.6649999999999997e-06 2024-09-13T06:39:47.994 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.994 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.994 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:47.994 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.431000+0000", 2024-09-13T06:39:47.995 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1474000000000001e-05 2024-09-13T06:39:47.995 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.995 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.995 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:47.995 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.431006+0000", 2024-09-13T06:39:47.995 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3600000000000001e-06 2024-09-13T06:39:47.995 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.995 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.995 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:47.995 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.431069+0000", 2024-09-13T06:39:47.995 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.2880999999999996e-05 2024-09-13T06:39:47.995 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.995 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.995 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:47.996 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.431175+0000", 2024-09-13T06:39:47.996 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000106437 2024-09-13T06:39:47.996 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.996 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.996 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 1", 2024-09-13T06:39:47.996 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.431303+0000", 2024-09-13T06:39:47.996 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00012734000000000001 2024-09-13T06:39:47.996 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.996 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.996 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-09-13T06:39:47.996 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.432165+0000", 2024-09-13T06:39:47.996 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00086203400000000002 2024-09-13T06:39:47.996 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.996 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.997 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:39:47.997 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.434813+0000", 2024-09-13T06:39:47.997 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.002647965 2024-09-13T06:39:47.997 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.997 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.997 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:39:47.997 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.434861+0000", 2024-09-13T06:39:47.997 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.8445000000000001e-05 2024-09-13T06:39:47.997 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.997 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.997 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:47.997 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.434904+0000", 2024-09-13T06:39:47.997 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.3401e-05 2024-09-13T06:39:47.998 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:47.998 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:47.998 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:47.998 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.998 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.998 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:3390 3.7 3:e3024cb3:::rbd_data.11217e777cf4.0000000000000004:head [write 348891~44325] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-13T06:39:47.998 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:42.779589+0000", 2024-09-13T06:39:47.998 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 5.1446284110000002, 2024-09-13T06:39:47.998 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0040594749999999999, 2024-09-13T06:39:47.998 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:47.998 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:47.998 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:39:47.998 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:39:47.998 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:47.999 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 3390 2024-09-13T06:39:47.999 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.999 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:47.999 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.999 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:47.999 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:42.779589+0000", 2024-09-13T06:39:47.999 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:47.999 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.999 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:47.999 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:47.999 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:42.779589+0000", 2024-09-13T06:39:47.999 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:47.999 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:47.999 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:48.000 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:48.000 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:42.779587+0000", 2024-09-13T06:39:48.000 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999976 2024-09-13T06:39:48.000 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:48.000 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:48.000 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:48.000 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:42.779639+0000", 2024-09-13T06:39:48.000 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2027000000000002e-05 2024-09-13T06:39:48.000 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:48.000 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:48.000 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:48.000 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:42.779661+0000", 2024-09-13T06:39:48.000 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2455000000000001e-05 2024-09-13T06:39:48.000 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:48.001 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:48.001 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:48.001 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:42.779674+0000", 2024-09-13T06:39:48.001 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2809999999999999e-05 2024-09-13T06:39:48.001 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:48.001 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:48.001 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:48.001 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:42.779740+0000", 2024-09-13T06:39:48.001 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.5896999999999996e-05 2024-09-13T06:39:48.001 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:48.001 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:48.001 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:48.001 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:42.779832+0000", 2024-09-13T06:39:48.002 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.2143000000000002e-05 2024-09-13T06:39:48.002 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:48.002 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:48.002 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 7", 2024-09-13T06:39:48.002 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:42.779970+0000", 2024-09-13T06:39:48.002 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00013752799999999999 2024-09-13T06:39:48.002 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:48.002 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:48.002 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:39:48.002 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:42.782260+0000", 2024-09-13T06:39:48.002 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0022905260000000002 2024-09-13T06:39:48.002 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:48.002 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:48.003 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-09-13T06:39:48.003 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:42.783570+0000", 2024-09-13T06:39:48.003 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.001309866 2024-09-13T06:39:48.003 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:48.003 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:48.003 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:39:48.003 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:42.783613+0000", 2024-09-13T06:39:48.003 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.3275000000000002e-05 2024-09-13T06:39:48.003 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:48.003 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:48.003 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:48.003 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:42.783648+0000", 2024-09-13T06:39:48.003 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.5212000000000001e-05 2024-09-13T06:39:48.003 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:48.004 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:48.004 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:48.004 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:48.004 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:48.004 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:3391 3.8 3:16b1c06a:::rbd_data.11217e777cf4.0000000000000005:head [write 327680~10611] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-13T06:39:48.004 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:42.779693+0000", 2024-09-13T06:39:48.004 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 5.1445244560000001, 2024-09-13T06:39:48.004 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0041685840000000004, 2024-09-13T06:39:48.004 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:48.004 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:48.004 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:39:48.004 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:39:48.004 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:48.005 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 3391 2024-09-13T06:39:48.005 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:48.005 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:48.005 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:48.005 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:48.005 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:42.779693+0000", 2024-09-13T06:39:48.005 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:48.005 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:48.005 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:48.005 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:48.005 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:42.779693+0000", 2024-09-13T06:39:48.005 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:48.005 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:48.006 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:48.006 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:48.006 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:42.779692+0000", 2024-09-13T06:39:48.006 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.999999 2024-09-13T06:39:48.006 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:48.006 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:48.006 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:48.006 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:42.779721+0000", 2024-09-13T06:39:48.006 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9286e-05 2024-09-13T06:39:48.006 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:48.006 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:48.006 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:48.006 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:42.779733+0000", 2024-09-13T06:39:48.006 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.163e-05 2024-09-13T06:39:48.007 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:48.007 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:48.007 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:48.007 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:42.779741+0000", 2024-09-13T06:39:48.007 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.1929999999999993e-06 2024-09-13T06:39:48.007 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:48.007 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:48.007 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:48.007 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:42.779790+0000", 2024-09-13T06:39:48.007 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9166999999999999e-05 2024-09-13T06:39:48.007 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:48.007 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:48.007 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:48.007 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:42.779841+0000", 2024-09-13T06:39:48.008 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0912999999999999e-05 2024-09-13T06:39:48.008 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:48.008 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:48.008 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 1", 2024-09-13T06:39:48.008 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:42.779981+0000", 2024-09-13T06:39:48.008 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000139505 2024-09-13T06:39:48.008 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:48.008 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:48.008 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-09-13T06:39:48.008 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:42.781017+0000", 2024-09-13T06:39:48.008 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.001036251 2024-09-13T06:39:48.008 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:48.008 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:48.008 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:39:48.009 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:42.783765+0000", 2024-09-13T06:39:48.009 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.002747892 2024-09-13T06:39:48.009 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:48.009 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:48.009 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:39:48.009 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:42.783807+0000", 2024-09-13T06:39:48.009 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.1544000000000001e-05 2024-09-13T06:39:48.009 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:48.009 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:48.009 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:48.009 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:42.783862+0000", 2024-09-13T06:39:48.009 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.5015000000000001e-05 2024-09-13T06:39:48.009 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:48.010 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:48.010 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:48.010 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:48.010 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:48.010 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:3406 3.8 3:16b1c06a:::rbd_data.11217e777cf4.0000000000000005:head [write 503101~21187] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-13T06:39:48.010 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:42.806222+0000", 2024-09-13T06:39:48.010 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 5.1179954319999998, 2024-09-13T06:39:48.010 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0050034149999999998, 2024-09-13T06:39:48.010 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:48.010 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:48.010 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:39:48.010 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:39:48.010 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:48.011 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 3406 2024-09-13T06:39:48.011 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:48.011 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:48.011 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:48.011 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:48.011 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:42.806222+0000", 2024-09-13T06:39:48.011 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:48.011 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:48.011 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:48.011 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:48.011 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:42.806222+0000", 2024-09-13T06:39:48.011 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:48.011 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:48.011 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:48.012 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:48.012 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:42.806221+0000", 2024-09-13T06:39:48.012 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.999999 2024-09-13T06:39:48.012 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:48.012 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:48.012 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:48.012 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:42.806247+0000", 2024-09-13T06:39:48.012 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5918000000000002e-05 2024-09-13T06:39:48.012 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:48.012 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:48.012 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:48.012 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:42.806261+0000", 2024-09-13T06:39:48.012 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3831e-05 2024-09-13T06:39:48.013 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:48.013 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:48.013 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:48.013 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:42.806268+0000", 2024-09-13T06:39:48.013 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.0740000000000004e-06 2024-09-13T06:39:48.013 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:48.013 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:48.013 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:48.013 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:42.806320+0000", 2024-09-13T06:39:48.013 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.1771999999999998e-05 2024-09-13T06:39:48.013 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:48.013 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:48.013 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:48.013 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:42.806417+0000", 2024-09-13T06:39:48.014 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.7719000000000004e-05 2024-09-13T06:39:48.014 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:48.014 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:48.014 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 1", 2024-09-13T06:39:48.014 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:42.806562+0000", 2024-09-13T06:39:48.014 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00014434800000000001 2024-09-13T06:39:48.014 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:48.014 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:48.014 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-09-13T06:39:48.014 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:42.811053+0000", 2024-09-13T06:39:48.014 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0044913879999999998 2024-09-13T06:39:48.014 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:48.014 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:48.014 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:39:48.015 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:42.811164+0000", 2024-09-13T06:39:48.015 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000110566 2024-09-13T06:39:48.015 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:48.015 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:48.015 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:39:48.015 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:42.811195+0000", 2024-09-13T06:39:48.015 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.1099999999999997e-05 2024-09-13T06:39:48.015 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:48.015 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:48.015 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:48.015 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:42.811225+0000", 2024-09-13T06:39:48.015 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.0772000000000003e-05 2024-09-13T06:39:48.015 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:48.015 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:48.016 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:48.016 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:48.016 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:48.016 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:3418 3.15 3:ac5106ea:::rbd_data.11217e777cf4.0000000000000011:head [set-alloc-hint object_size 524288 write_size 524288,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-13T06:39:48.016 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:42.830227+0000", 2024-09-13T06:39:48.016 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 5.0939900480000002, 2024-09-13T06:39:48.016 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017034491999999998, 2024-09-13T06:39:48.016 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:48.016 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:48.016 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:39:48.016 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:39:48.016 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:48.016 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 3418 2024-09-13T06:39:48.017 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:48.017 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:48.017 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:48.017 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:48.017 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:42.830227+0000", 2024-09-13T06:39:48.017 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:48.017 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:48.017 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:48.017 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:48.017 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:42.830227+0000", 2024-09-13T06:39:48.017 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:48.018 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:48.018 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:48.018 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:48.018 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:42.830226+0000", 2024-09-13T06:39:48.018 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999986 2024-09-13T06:39:48.018 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:48.018 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:48.018 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:48.018 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:42.830233+0000", 2024-09-13T06:39:48.018 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.9700000000000002e-06 2024-09-13T06:39:48.018 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:48.018 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:48.019 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:48.019 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:42.830248+0000", 2024-09-13T06:39:48.019 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5617999999999999e-05 2024-09-13T06:39:48.019 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:48.019 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:48.019 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:48.019 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:42.830256+0000", 2024-09-13T06:39:48.019 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.0169999999999996e-06 2024-09-13T06:39:48.019 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:48.019 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:48.019 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:48.019 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:42.830295+0000", 2024-09-13T06:39:48.019 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.8609999999999998e-05 2024-09-13T06:39:48.019 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:48.020 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:48.020 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:48.020 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:42.830390+0000", 2024-09-13T06:39:48.020 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.5253000000000004e-05 2024-09-13T06:39:48.020 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:48.020 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:48.020 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 7", 2024-09-13T06:39:48.020 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:42.833415+0000", 2024-09-13T06:39:48.020 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.003024704 2024-09-13T06:39:48.020 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:48.020 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:48.020 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-09-13T06:39:48.020 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:42.847160+0000", 2024-09-13T06:39:48.021 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.013745215999999999 2024-09-13T06:39:48.021 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:48.021 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:48.021 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:39:48.021 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:42.847195+0000", 2024-09-13T06:39:48.021 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.4585000000000002e-05 2024-09-13T06:39:48.021 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:48.021 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:48.021 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:39:48.021 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:42.847232+0000", 2024-09-13T06:39:48.021 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.6743999999999999e-05 2024-09-13T06:39:48.021 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:48.021 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:48.021 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:48.021 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:42.847262+0000", 2024-09-13T06:39:48.022 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.0249000000000001e-05 2024-09-13T06:39:48.022 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:48.022 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:48.022 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:48.022 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:48.022 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:48.022 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop_reply(client.4385.0:3418 3.15 e34/30 ondisk, result = 0)", 2024-09-13T06:39:48.022 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:42.841093+0000", 2024-09-13T06:39:48.022 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 5.0831241839999999, 2024-09-13T06:39:48.022 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0061745799999999998, 2024-09-13T06:39:48.022 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:48.022 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:39:48.022 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:48.022 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:48.023 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:48.023 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:42.841093+0000", 2024-09-13T06:39:48.023 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:48.023 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:48.023 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:48.023 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:48.023 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:42.841093+0000", 2024-09-13T06:39:48.023 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:48.023 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:48.023 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:48.023 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:48.023 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:42.841092+0000", 2024-09-13T06:39:48.023 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.999999 2024-09-13T06:39:48.024 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:48.024 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:48.024 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:48.024 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:42.841100+0000", 2024-09-13T06:39:48.024 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.3159999999999997e-06 2024-09-13T06:39:48.024 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:48.024 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:48.024 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:48.024 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:42.841117+0000", 2024-09-13T06:39:48.024 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6537000000000001e-05 2024-09-13T06:39:48.024 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:48.024 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:48.024 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:48.025 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:42.841127+0000", 2024-09-13T06:39:48.025 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0232e-05 2024-09-13T06:39:48.025 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:48.025 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:48.025 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:48.025 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:42.847182+0000", 2024-09-13T06:39:48.025 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0060546549999999999 2024-09-13T06:39:48.025 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:48.025 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:48.025 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:48.025 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:42.847190+0000", 2024-09-13T06:39:48.025 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.6290000000000001e-06 2024-09-13T06:39:48.025 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:48.025 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:48.025 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:48.026 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:42.847268+0000", 2024-09-13T06:39:48.026 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.8301999999999997e-05 2024-09-13T06:39:48.026 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:48.026 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:48.026 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:48.026 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:48.026 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:48.026 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:39:48.027 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-13T06:39:48.028 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-13T06:39:48.030+0000 7f86a5f06640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26387) UID: 0 2024-09-13T06:39:48.120 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-13T06:39:48.123+0000 7fcdeb9fe640 -1 mon.a@0(leader).osd e39 definitely_dead 0 2024-09-13T06:39:48.128 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:39:48.131+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:39:48.158 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:39:48.159 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [], 2024-09-13T06:39:48.159 INFO:teuthology.orchestra.run.smithi139.stdout: "num_ops": 0 2024-09-13T06:39:48.159 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:39:48.173 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-13T06:39:48.229 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-13T06:39:48.230+0000 7f86a5f06640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26387) UID: 0 2024-09-13T06:39:48.297 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:39:48.297 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [], 2024-09-13T06:39:48.297 INFO:teuthology.orchestra.run.smithi139.stdout: "complaint_time": 30, 2024-09-13T06:39:48.297 INFO:teuthology.orchestra.run.smithi139.stdout: "num_blocked_ops": 0 2024-09-13T06:39:48.297 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:39:48.311 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-13T06:39:48.356 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-13T06:39:48.358+0000 7f86a5f06640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26387) UID: 0 2024-09-13T06:39:48.430 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-13T06:39:48.430+0000 7f86a5f06640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26387) UID: 0 2024-09-13T06:39:48.484 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:39:48.484 INFO:teuthology.orchestra.run.smithi139.stdout: "size": 20, 2024-09-13T06:39:48.484 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 600, 2024-09-13T06:39:48.484 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [ 2024-09-13T06:39:48.484 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:48.484 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:9 3.1a 3:5cea7035:::rbd_info:head [write 0~19] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-09-13T06:39:48.485 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:29.366602+0000", 2024-09-13T06:39:48.485 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 19.119662852000001, 2024-09-13T06:39:48.485 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0089251079999999993, 2024-09-13T06:39:48.485 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:39:48.485 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:48.485 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:39:48.485 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:39:48.485 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:48.485 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 9 2024-09-13T06:39:48.485 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:48.485 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:39:48.485 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:48.485 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:39:48.486 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:29.366602+0000", 2024-09-13T06:39:48.486 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:48.486 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:48.486 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:48.486 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:39:48.486 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:29.366602+0000", 2024-09-13T06:39:48.486 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:48.486 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:48.486 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:48.486 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:39:48.486 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:29.366601+0000", 2024-09-13T06:39:48.486 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999981 2024-09-13T06:39:48.486 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:48.487 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:48.487 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:39:48.487 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:29.366615+0000", 2024-09-13T06:39:48.487 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.4046000000000001e-05 2024-09-13T06:39:48.487 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:48.487 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:48.487 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:39:48.487 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:29.366632+0000", 2024-09-13T06:39:48.487 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7527999999999999e-05 2024-09-13T06:39:48.487 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:48.487 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:48.487 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:39:48.487 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:29.366641+0000", 2024-09-13T06:39:48.488 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.9779999999999994e-06 2024-09-13T06:39:48.488 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:48.488 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:48.488 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:39:48.488 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:29.366695+0000", 2024-09-13T06:39:48.488 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.4094000000000001e-05 2024-09-13T06:39:48.488 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:48.488 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:48.488 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op must wait for map", 2024-09-13T06:39:48.488 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:29.366701+0000", 2024-09-13T06:39:48.488 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.8100000000000003e-06 2024-09-13T06:39:48.488 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:48.489 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:48.489 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:39:48.489 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:29.373006+0000", 2024-09-13T06:39:48.489 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0063048870000000003 2024-09-13T06:39:48.489 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:48.489 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:48.489 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:39:48.489 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:29.373129+0000", 2024-09-13T06:39:48.489 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000123273 2024-09-13T06:39:48.489 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:48.489 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:48.489 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-13T06:39:48.489 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:29.373273+0000", 2024-09-13T06:39:48.490 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00014384599999999999 2024-09-13T06:39:48.490 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:48.490 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:48.490 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-13T06:39:48.490 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:29.374207+0000", 2024-09-13T06:39:48.490 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00093434300000000002 2024-09-13T06:39:48.490 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:48.490 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:48.490 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:39:48.490 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:29.375441+0000", 2024-09-13T06:39:48.490 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0012333019999999999 2024-09-13T06:39:48.490 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:48.491 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:48.491 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-13T06:39:48.491 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:29.375482+0000", 2024-09-13T06:39:48.491 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.1643000000000001e-05 2024-09-13T06:39:48.491 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:48.491 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:48.491 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:39:48.491 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:29.375528+0000", 2024-09-13T06:39:48.491 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.5157000000000002e-05 2024-09-13T06:39:48.491 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:48.491 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:39:48.491 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:48.491 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:48.491 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:48.492 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:538 3.14 3:2c892ad1:::rbd_data.11214e25756e.000000000000000a:head [delete] snapc 5=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-09-13T06:39:48.492 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:34.609686+0000", 2024-09-13T06:39:48.492 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 13.876579111, 2024-09-13T06:39:48.492 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0061026630000000004, 2024-09-13T06:39:48.492 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:39:48.492 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:39:48.492 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:39:48.492 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:39:48.492 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:48.492 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 538 2024-09-13T06:39:48.492 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:48.492 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:39:48.492 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:48.493 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:39:48.493 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:34.609686+0000", 2024-09-13T06:39:48.493 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:48.493 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:48.493 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:48.493 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:39:48.493 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:34.609686+0000", 2024-09-13T06:39:48.493 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:48.493 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:48.493 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:48.493 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:39:48.493 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:34.609684+0000", 2024-09-13T06:39:48.493 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999976 2024-09-13T06:39:48.493 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:48.494 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:48.494 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:39:48.494 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:34.609697+0000", 2024-09-13T06:39:48.494 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3497e-05 2024-09-13T06:39:48.494 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:48.494 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:48.494 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:39:48.494 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:34.609770+0000", 2024-09-13T06:39:48.494 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.2658999999999997e-05 2024-09-13T06:39:48.494 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:48.494 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:48.494 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:39:48.494 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:34.609788+0000", 2024-09-13T06:39:48.495 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.8363e-05 2024-09-13T06:39:48.495 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:48.495 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:48.495 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:39:48.495 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:34.609927+0000", 2024-09-13T06:39:48.495 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000138326 2024-09-13T06:39:48.495 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:48.495 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:48.495 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:39:48.495 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:34.610342+0000", 2024-09-13T06:39:48.495 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00041547300000000003 2024-09-13T06:39:48.495 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:48.495 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:48.496 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:39:48.496 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:34.615789+0000", 2024-09-13T06:39:48.496 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0054467689999999997 2024-09-13T06:39:48.496 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:48.496 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:39:48.496 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:48.496 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:48.496 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:48.496 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:2279 3.1a 3:5d8276d7:::rbd_data.11212429e5ad.0000000000000075:head [set-alloc-hint object_size 262144 write_size 262144,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-13T06:39:48.496 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:38.669790+0000", 2024-09-13T06:39:48.496 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 9.8164753729999994, 2024-09-13T06:39:48.496 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.011375939, 2024-09-13T06:39:48.496 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:39:48.497 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:48.497 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:39:48.497 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:39:48.497 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:48.497 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 2279 2024-09-13T06:39:48.497 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:48.497 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:39:48.497 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:48.497 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:39:48.497 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.669790+0000", 2024-09-13T06:39:48.497 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:48.497 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:48.497 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:48.498 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:39:48.498 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.669790+0000", 2024-09-13T06:39:48.498 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:48.498 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:48.498 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:48.498 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:39:48.498 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.669788+0000", 2024-09-13T06:39:48.498 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999981 2024-09-13T06:39:48.498 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:48.498 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:48.499 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:39:48.499 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.669802+0000", 2024-09-13T06:39:48.499 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.4579999999999999e-05 2024-09-13T06:39:48.499 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:48.499 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:48.500 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:39:48.500 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.669834+0000", 2024-09-13T06:39:48.500 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.1272999999999997e-05 2024-09-13T06:39:48.500 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:48.500 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:48.500 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:39:48.500 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.669848+0000", 2024-09-13T06:39:48.500 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.4616e-05 2024-09-13T06:39:48.500 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:48.500 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:48.500 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:39:48.501 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.669954+0000", 2024-09-13T06:39:48.501 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000105456 2024-09-13T06:39:48.501 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:48.501 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:48.501 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:39:48.501 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.670197+0000", 2024-09-13T06:39:48.501 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000243568 2024-09-13T06:39:48.501 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:48.501 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:48.501 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-13T06:39:48.501 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.672097+0000", 2024-09-13T06:39:48.501 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.001899483 2024-09-13T06:39:48.501 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:48.502 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:48.502 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:39:48.502 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.680994+0000", 2024-09-13T06:39:48.502 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0088976609999999994 2024-09-13T06:39:48.502 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:48.502 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:48.502 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-13T06:39:48.502 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.681018+0000", 2024-09-13T06:39:48.502 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.3036000000000001e-05 2024-09-13T06:39:48.503 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:48.503 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:48.503 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-13T06:39:48.503 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.681103+0000", 2024-09-13T06:39:48.504 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.5116000000000003e-05 2024-09-13T06:39:48.504 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:48.504 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:48.504 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:39:48.504 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.681166+0000", 2024-09-13T06:39:48.504 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.3293000000000005e-05 2024-09-13T06:39:48.505 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:48.505 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:39:48.505 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:48.505 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:48.505 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:48.505 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "pg_update_log_missing(3.11 epoch 31/21 rep_tid 184 entries 31'54 (0'0) error 3:8c8749a1:::rbd_data.11212429e5ad.000000000000003b:head by client.4385.0:2346 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 31'52)", 2024-09-13T06:39:48.505 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:38.839437+0000", 2024-09-13T06:39:48.505 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 9.6468286019999994, 2024-09-13T06:39:48.505 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0056918990000000003, 2024-09-13T06:39:48.505 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:39:48.505 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:39:48.506 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:39:48.506 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:48.506 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:39:48.506 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.839437+0000", 2024-09-13T06:39:48.506 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:48.506 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:48.506 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:48.506 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:39:48.506 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.839437+0000", 2024-09-13T06:39:48.506 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:48.506 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:48.507 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:48.507 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:39:48.507 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.839435+0000", 2024-09-13T06:39:48.507 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999986 2024-09-13T06:39:48.507 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:48.507 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:48.507 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:39:48.507 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.839453+0000", 2024-09-13T06:39:48.507 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7507e-05 2024-09-13T06:39:48.507 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:48.507 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:48.507 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:39:48.508 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.839503+0000", 2024-09-13T06:39:48.508 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.0646000000000003e-05 2024-09-13T06:39:48.508 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:48.508 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:48.508 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:39:48.508 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.839538+0000", 2024-09-13T06:39:48.508 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.4870000000000003e-05 2024-09-13T06:39:48.508 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:48.508 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:48.508 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:39:48.508 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.839690+0000", 2024-09-13T06:39:48.509 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000151485 2024-09-13T06:39:48.509 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:48.509 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:48.509 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:39:48.509 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.845129+0000", 2024-09-13T06:39:48.509 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0054390209999999996 2024-09-13T06:39:48.509 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:48.509 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:39:48.509 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:48.509 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:48.509 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:48.510 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:2349 3.14 3:2904dcb1:::rbd_data.11212429e5ad.0000000000000042:head [delete] snapc 8=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-13T06:39:48.510 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:38.839706+0000", 2024-09-13T06:39:48.510 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 9.6465589309999995, 2024-09-13T06:39:48.510 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0077307440000000003, 2024-09-13T06:39:48.510 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:39:48.510 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:39:48.510 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:39:48.510 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:39:48.510 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:48.510 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 2349 2024-09-13T06:39:48.510 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:48.510 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:39:48.511 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:48.511 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:39:48.511 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.839706+0000", 2024-09-13T06:39:48.511 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:48.511 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:48.511 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:48.511 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:39:48.511 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.839706+0000", 2024-09-13T06:39:48.511 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:48.511 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:48.511 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:48.511 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:39:48.512 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.839704+0000", 2024-09-13T06:39:48.512 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999981 2024-09-13T06:39:48.512 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:48.512 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:48.512 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:39:48.512 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.839717+0000", 2024-09-13T06:39:48.512 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2896e-05 2024-09-13T06:39:48.512 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:48.512 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:48.512 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:39:48.512 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.839748+0000", 2024-09-13T06:39:48.513 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.0957000000000002e-05 2024-09-13T06:39:48.513 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:48.513 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:48.513 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:39:48.513 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.839768+0000", 2024-09-13T06:39:48.513 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.0077000000000001e-05 2024-09-13T06:39:48.513 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:48.513 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:48.513 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:39:48.513 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.839942+0000", 2024-09-13T06:39:48.513 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000173838 2024-09-13T06:39:48.513 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:48.514 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:48.514 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:39:48.514 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.840364+0000", 2024-09-13T06:39:48.514 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00042193999999999999 2024-09-13T06:39:48.514 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:48.514 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:48.514 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:39:48.514 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.847437+0000", 2024-09-13T06:39:48.515 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0070731520000000001 2024-09-13T06:39:48.515 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:48.515 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:39:48.515 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:48.515 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:48.515 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:48.515 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "pg_update_log_missing(3.1d epoch 31/21 rep_tid 75 entries 31'4 (0'0) error 3:bbeb2066:::rbd_data.11212429e5ad.0000000000000045:head by client.4385.0:2352 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 27'1)", 2024-09-13T06:39:48.515 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:38.841153+0000", 2024-09-13T06:39:48.515 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 9.6451126679999994, 2024-09-13T06:39:48.515 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0053278279999999997, 2024-09-13T06:39:48.515 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:39:48.516 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:39:48.516 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:39:48.516 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:48.516 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:39:48.516 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.841153+0000", 2024-09-13T06:39:48.516 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:48.516 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:48.516 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:48.516 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:39:48.516 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.841153+0000", 2024-09-13T06:39:48.516 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:48.516 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:48.517 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:48.517 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:39:48.517 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.841151+0000", 2024-09-13T06:39:48.517 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999981 2024-09-13T06:39:48.517 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:48.517 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:48.517 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:39:48.517 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.841173+0000", 2024-09-13T06:39:48.517 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.251e-05 2024-09-13T06:39:48.517 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:48.517 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:48.518 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:39:48.518 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.841216+0000", 2024-09-13T06:39:48.518 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.2373000000000002e-05 2024-09-13T06:39:48.518 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:48.518 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:48.518 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:39:48.518 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.841249+0000", 2024-09-13T06:39:48.519 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.3062999999999998e-05 2024-09-13T06:39:48.519 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:48.519 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:48.519 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:39:48.519 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.841397+0000", 2024-09-13T06:39:48.519 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00014785199999999999 2024-09-13T06:39:48.519 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:48.519 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:48.519 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:39:48.519 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.846481+0000", 2024-09-13T06:39:48.519 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0050838439999999997 2024-09-13T06:39:48.519 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:48.520 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:39:48.520 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:48.520 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:48.520 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:48.520 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:2355 3.14 3:2f99926c:::rbd_data.11212429e5ad.0000000000000050:head [delete] snapc 8=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-13T06:39:48.520 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:38.841638+0000", 2024-09-13T06:39:48.520 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 9.6446274360000004, 2024-09-13T06:39:48.520 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0061569600000000004, 2024-09-13T06:39:48.520 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:39:48.520 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:48.520 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:39:48.521 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:39:48.521 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:48.521 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 2355 2024-09-13T06:39:48.521 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:48.521 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:39:48.521 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:48.521 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:39:48.521 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.841638+0000", 2024-09-13T06:39:48.521 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:48.521 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:48.521 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:48.522 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:39:48.522 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.841638+0000", 2024-09-13T06:39:48.522 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:48.522 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:48.522 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:48.522 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:39:48.522 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.841635+0000", 2024-09-13T06:39:48.522 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999971 2024-09-13T06:39:48.522 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:48.522 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:48.522 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:39:48.523 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.841652+0000", 2024-09-13T06:39:48.523 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7430000000000001e-05 2024-09-13T06:39:48.523 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:48.523 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:48.523 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:39:48.523 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.841685+0000", 2024-09-13T06:39:48.523 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.2842999999999997e-05 2024-09-13T06:39:48.523 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:48.523 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:48.523 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:39:48.523 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.841706+0000", 2024-09-13T06:39:48.523 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.0400000000000001e-05 2024-09-13T06:39:48.524 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:48.524 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:48.524 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:39:48.524 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.841849+0000", 2024-09-13T06:39:48.524 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000142972 2024-09-13T06:39:48.524 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:48.524 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:48.524 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:39:48.524 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.842154+0000", 2024-09-13T06:39:48.524 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00030491099999999999 2024-09-13T06:39:48.524 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:48.525 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:48.525 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 7", 2024-09-13T06:39:48.525 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.842455+0000", 2024-09-13T06:39:48.525 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00030119100000000002 2024-09-13T06:39:48.525 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:48.525 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:48.525 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:39:48.525 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.847541+0000", 2024-09-13T06:39:48.525 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0050858709999999996 2024-09-13T06:39:48.525 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:48.525 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:48.525 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-13T06:39:48.526 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.847598+0000", 2024-09-13T06:39:48.526 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.6922000000000002e-05 2024-09-13T06:39:48.526 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:48.526 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:48.526 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-13T06:39:48.526 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.847702+0000", 2024-09-13T06:39:48.526 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000104576 2024-09-13T06:39:48.526 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:48.526 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:48.527 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:39:48.527 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.847795+0000", 2024-09-13T06:39:48.527 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.2750000000000005e-05 2024-09-13T06:39:48.527 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:48.527 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:39:48.527 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:48.527 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:48.527 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:48.527 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "pg_update_log_missing(3.1 epoch 31/21 rep_tid 24 entries 31'4 (0'0) error 3:861707a4:::rbd_data.11212429e5ad.00000000000000bd:head by client.4385.0:2383 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 31'2)", 2024-09-13T06:39:48.527 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:38.856554+0000", 2024-09-13T06:39:48.527 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 9.6297116369999998, 2024-09-13T06:39:48.528 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0060346829999999999, 2024-09-13T06:39:48.528 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:39:48.528 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:39:48.528 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:39:48.528 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:48.528 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:39:48.528 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.856554+0000", 2024-09-13T06:39:48.528 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:48.528 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:48.528 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:48.528 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:39:48.529 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.856554+0000", 2024-09-13T06:39:48.529 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:48.529 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:48.529 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:48.529 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:39:48.529 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.856552+0000", 2024-09-13T06:39:48.529 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999981 2024-09-13T06:39:48.529 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:48.529 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:48.529 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:39:48.529 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.856574+0000", 2024-09-13T06:39:48.530 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.2163000000000001e-05 2024-09-13T06:39:48.530 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:48.530 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:48.530 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:39:48.530 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.856616+0000", 2024-09-13T06:39:48.530 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.1763e-05 2024-09-13T06:39:48.530 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:48.530 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:48.530 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:39:48.530 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.856646+0000", 2024-09-13T06:39:48.530 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.0389e-05 2024-09-13T06:39:48.531 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:48.531 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:48.531 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:39:48.531 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.856811+0000", 2024-09-13T06:39:48.531 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000164656 2024-09-13T06:39:48.531 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:48.531 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:48.531 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:39:48.531 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.862588+0000", 2024-09-13T06:39:48.531 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.005777412 2024-09-13T06:39:48.531 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:48.532 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:39:48.532 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:48.532 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:48.532 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:48.532 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:2387 3.3 3:c75fb252:::rbd_data.11212429e5ad.00000000000000c1:head [delete] snapc 8=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-13T06:39:48.532 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:38.858430+0000", 2024-09-13T06:39:48.532 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 9.6278351359999998, 2024-09-13T06:39:48.532 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0050620179999999997, 2024-09-13T06:39:48.532 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:39:48.532 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:39:48.533 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:39:48.533 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:39:48.533 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:48.533 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 2387 2024-09-13T06:39:48.533 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:48.533 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:39:48.533 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:48.533 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:39:48.533 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.858430+0000", 2024-09-13T06:39:48.533 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:48.533 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:48.533 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:48.534 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:39:48.534 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.858430+0000", 2024-09-13T06:39:48.534 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:48.534 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:48.534 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:48.534 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:39:48.534 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.858429+0000", 2024-09-13T06:39:48.534 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999986 2024-09-13T06:39:48.534 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:48.534 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:48.534 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:39:48.535 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.858437+0000", 2024-09-13T06:39:48.535 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.3429999999999996e-06 2024-09-13T06:39:48.535 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:48.535 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:48.535 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:39:48.535 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.858461+0000", 2024-09-13T06:39:48.535 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.4337000000000001e-05 2024-09-13T06:39:48.535 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:48.535 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:48.535 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:39:48.535 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.858478+0000", 2024-09-13T06:39:48.535 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6557000000000001e-05 2024-09-13T06:39:48.536 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:48.536 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:48.536 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:39:48.536 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.858602+0000", 2024-09-13T06:39:48.536 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000124292 2024-09-13T06:39:48.536 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:48.536 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:48.536 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:39:48.536 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.858938+0000", 2024-09-13T06:39:48.536 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00033573099999999997 2024-09-13T06:39:48.537 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:48.537 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:48.537 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:39:48.537 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.863492+0000", 2024-09-13T06:39:48.537 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0045542109999999998 2024-09-13T06:39:48.537 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:48.537 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:39:48.537 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:48.537 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:48.537 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:48.537 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop(client.4385.0:2395 3.1 e31/21 3:81e6c980:::rbd_data.11212429e5ad.000000000000022c:head v 31'5, mlcod=31'2)", 2024-09-13T06:39:48.538 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:38.861615+0000", 2024-09-13T06:39:48.538 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 9.6246506499999995, 2024-09-13T06:39:48.538 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0062573760000000003, 2024-09-13T06:39:48.538 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:39:48.538 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:48.538 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:39:48.538 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:48.538 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:39:48.538 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.861615+0000", 2024-09-13T06:39:48.538 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:48.538 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:48.538 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:48.539 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:39:48.539 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.861615+0000", 2024-09-13T06:39:48.539 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:48.539 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:48.539 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:48.539 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:39:48.539 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.861613+0000", 2024-09-13T06:39:48.539 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999981 2024-09-13T06:39:48.539 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:48.539 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:48.539 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:39:48.540 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.861630+0000", 2024-09-13T06:39:48.540 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7316000000000002e-05 2024-09-13T06:39:48.540 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:48.540 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:48.540 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:39:48.540 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.861666+0000", 2024-09-13T06:39:48.540 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.5982999999999998e-05 2024-09-13T06:39:48.540 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:48.540 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:48.540 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:39:48.540 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.861684+0000", 2024-09-13T06:39:48.541 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.8442999999999999e-05 2024-09-13T06:39:48.541 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:48.541 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:48.541 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:39:48.541 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.861836+0000", 2024-09-13T06:39:48.541 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000151576 2024-09-13T06:39:48.541 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:48.541 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:48.541 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:39:48.541 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.861894+0000", 2024-09-13T06:39:48.541 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.8359000000000001e-05 2024-09-13T06:39:48.542 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:48.542 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:48.542 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-13T06:39:48.542 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.867469+0000", 2024-09-13T06:39:48.542 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0055744810000000001 2024-09-13T06:39:48.542 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:48.542 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:48.542 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:39:48.542 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.867872+0000", 2024-09-13T06:39:48.542 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00040319100000000001 2024-09-13T06:39:48.542 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:48.543 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:39:48.543 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:48.543 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:48.543 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:48.543 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:2396 3.9 3:90b0c819:::rbd_data.11212429e5ad.00000000000002f5:head [delete] snapc 8=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-13T06:39:48.543 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:38.862899+0000", 2024-09-13T06:39:48.543 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 9.6233663600000003, 2024-09-13T06:39:48.543 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0054828819999999997, 2024-09-13T06:39:48.543 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:39:48.543 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:48.543 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:39:48.544 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:39:48.544 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:48.544 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 2396 2024-09-13T06:39:48.544 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:48.544 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:39:48.544 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:48.544 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:39:48.544 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.862899+0000", 2024-09-13T06:39:48.544 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:48.544 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:48.544 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:48.545 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:39:48.545 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.862899+0000", 2024-09-13T06:39:48.545 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:48.545 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:48.545 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:48.545 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:39:48.545 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.862897+0000", 2024-09-13T06:39:48.546 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999981 2024-09-13T06:39:48.546 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:48.546 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:48.546 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:39:48.546 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.862906+0000", 2024-09-13T06:39:48.546 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.1759999999999999e-06 2024-09-13T06:39:48.546 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:48.546 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:48.546 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:39:48.546 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.862929+0000", 2024-09-13T06:39:48.547 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.2200000000000001e-05 2024-09-13T06:39:48.547 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:48.547 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:48.547 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:39:48.547 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.862956+0000", 2024-09-13T06:39:48.547 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.7526e-05 2024-09-13T06:39:48.547 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:48.547 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:48.547 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:39:48.547 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.863069+0000", 2024-09-13T06:39:48.548 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000112723 2024-09-13T06:39:48.548 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:48.548 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:48.548 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:39:48.548 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.863278+0000", 2024-09-13T06:39:48.548 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00020896200000000001 2024-09-13T06:39:48.548 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:48.548 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:48.548 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 2", 2024-09-13T06:39:48.548 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.863473+0000", 2024-09-13T06:39:48.548 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00019547499999999999 2024-09-13T06:39:48.549 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:48.549 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:48.549 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:39:48.549 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.865277+0000", 2024-09-13T06:39:48.549 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00180379 2024-09-13T06:39:48.549 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:48.549 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:48.549 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-13T06:39:48.549 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.868208+0000", 2024-09-13T06:39:48.549 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0029311570000000002 2024-09-13T06:39:48.549 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:48.550 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:48.550 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-13T06:39:48.550 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.868294+0000", 2024-09-13T06:39:48.550 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.5841999999999996e-05 2024-09-13T06:39:48.550 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:48.550 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:48.550 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:39:48.550 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.868382+0000", 2024-09-13T06:39:48.550 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.7806999999999995e-05 2024-09-13T06:39:48.550 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:48.550 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:39:48.550 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:48.551 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:48.551 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:48.551 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "pg_update_log_missing(3.1d epoch 31/21 rep_tid 84 entries 31'6 (0'0) error 3:bd13e332:::rbd_data.11212429e5ad.0000000000000021:head by client.4385.0:2420 0.000000 0 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 31'3)", 2024-09-13T06:39:48.551 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:38.890735+0000", 2024-09-13T06:39:48.551 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 9.5955298510000002, 2024-09-13T06:39:48.551 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0056063370000000003, 2024-09-13T06:39:48.551 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:39:48.551 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:39:48.551 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:39:48.551 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:48.551 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:39:48.551 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.890735+0000", 2024-09-13T06:39:48.552 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:48.552 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:48.552 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:48.552 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:39:48.552 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.890735+0000", 2024-09-13T06:39:48.552 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:48.552 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:48.552 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:48.552 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:39:48.552 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.890734+0000", 2024-09-13T06:39:48.552 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:39:48.553 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:48.553 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:48.553 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:39:48.553 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.890754+0000", 2024-09-13T06:39:48.553 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.9477e-05 2024-09-13T06:39:48.553 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:48.553 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:48.553 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:39:48.553 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.890784+0000", 2024-09-13T06:39:48.553 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.0326000000000001e-05 2024-09-13T06:39:48.553 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:48.554 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:48.554 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:39:48.554 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.890814+0000", 2024-09-13T06:39:48.554 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.9283000000000001e-05 2024-09-13T06:39:48.554 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:48.554 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:48.554 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:39:48.554 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.890946+0000", 2024-09-13T06:39:48.554 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00013222599999999999 2024-09-13T06:39:48.554 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:48.554 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:48.555 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:39:48.555 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.896342+0000", 2024-09-13T06:39:48.555 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0053960919999999999 2024-09-13T06:39:48.555 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:48.555 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:39:48.555 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:48.555 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:48.555 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:48.555 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:2424 3.14 3:2fc86118:::rbd_data.11212429e5ad.0000000000000025:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-13T06:39:48.555 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:38.892774+0000", 2024-09-13T06:39:48.555 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 9.5934918170000003, 2024-09-13T06:39:48.556 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.006494306, 2024-09-13T06:39:48.556 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:39:48.556 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:39:48.556 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:39:48.556 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:39:48.556 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:48.556 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 2424 2024-09-13T06:39:48.556 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:48.556 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:39:48.556 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:48.556 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:39:48.557 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.892774+0000", 2024-09-13T06:39:48.557 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:48.557 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:48.557 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:48.557 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:39:48.557 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.892774+0000", 2024-09-13T06:39:48.557 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:48.557 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:48.557 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:48.557 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:39:48.557 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.892771+0000", 2024-09-13T06:39:48.557 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999971 2024-09-13T06:39:48.558 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:48.558 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:48.558 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:39:48.558 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.892789+0000", 2024-09-13T06:39:48.558 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7920000000000001e-05 2024-09-13T06:39:48.558 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:48.558 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:48.558 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:39:48.558 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.892826+0000", 2024-09-13T06:39:48.558 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.6808999999999999e-05 2024-09-13T06:39:48.558 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:48.559 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:48.559 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:39:48.559 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.892851+0000", 2024-09-13T06:39:48.559 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.5434000000000001e-05 2024-09-13T06:39:48.559 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:48.559 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:48.559 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:39:48.559 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.893005+0000", 2024-09-13T06:39:48.559 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00015415900000000001 2024-09-13T06:39:48.559 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:48.559 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:48.559 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:39:48.560 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.893347+0000", 2024-09-13T06:39:48.560 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00034154999999999998 2024-09-13T06:39:48.560 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:48.560 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:48.560 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:39:48.560 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.899268+0000", 2024-09-13T06:39:48.560 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0059211569999999998 2024-09-13T06:39:48.560 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:48.560 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:39:48.560 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:48.560 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:48.560 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:48.560 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:2638 3.1a 3:5b17be67:::rbd_data.11212429e5ad.00000000000001e6:head [set-alloc-hint object_size 262144 write_size 262144,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-13T06:39:48.561 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:39.280285+0000", 2024-09-13T06:39:48.561 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 9.2059805469999993, 2024-09-13T06:39:48.561 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.048593187000000003, 2024-09-13T06:39:48.561 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:39:48.561 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:48.561 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:39:48.561 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:39:48.561 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:48.561 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 2638 2024-09-13T06:39:48.561 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:48.562 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:39:48.562 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:48.562 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:39:48.562 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:39.280285+0000", 2024-09-13T06:39:48.562 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:48.562 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:48.562 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:48.562 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:39:48.562 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:39.280285+0000", 2024-09-13T06:39:48.562 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:48.562 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:48.562 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:48.563 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:39:48.563 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:39.280283+0000", 2024-09-13T06:39:48.563 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999976 2024-09-13T06:39:48.563 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:48.563 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:48.563 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:39:48.563 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:39.280296+0000", 2024-09-13T06:39:48.563 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.347e-05 2024-09-13T06:39:48.563 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:48.563 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:48.563 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:39:48.563 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:39.280328+0000", 2024-09-13T06:39:48.564 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.1639e-05 2024-09-13T06:39:48.564 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:48.564 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:48.564 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:39:48.564 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:39.280342+0000", 2024-09-13T06:39:48.564 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.4426999999999999e-05 2024-09-13T06:39:48.564 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:48.564 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:48.564 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:39:48.564 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:39.280433+0000", 2024-09-13T06:39:48.564 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.0599000000000005e-05 2024-09-13T06:39:48.565 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:48.565 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:48.565 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:39:48.565 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:39.280654+0000", 2024-09-13T06:39:48.565 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000221105 2024-09-13T06:39:48.565 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:48.565 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:48.565 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-13T06:39:48.565 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:39.288290+0000", 2024-09-13T06:39:48.565 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0076362970000000002 2024-09-13T06:39:48.565 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:48.566 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:48.566 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-13T06:39:48.566 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:39.328608+0000", 2024-09-13T06:39:48.566 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.040317613000000002 2024-09-13T06:39:48.566 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:48.566 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:48.566 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:39:48.566 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:39.328717+0000", 2024-09-13T06:39:48.566 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000109632 2024-09-13T06:39:48.566 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:48.566 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:48.566 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-13T06:39:48.567 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:39.328810+0000", 2024-09-13T06:39:48.567 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.2670000000000006e-05 2024-09-13T06:39:48.567 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:48.567 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:48.567 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:39:48.567 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:39.328878+0000", 2024-09-13T06:39:48.567 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.7931999999999999e-05 2024-09-13T06:39:48.567 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:48.567 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:39:48.567 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:48.567 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:48.567 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:48.568 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop_reply(client.4385.0:2638 3.1a e31/21 ondisk, result = 0)", 2024-09-13T06:39:48.568 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:39.311466+0000", 2024-09-13T06:39:48.568 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 9.1747993619999999, 2024-09-13T06:39:48.568 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.017425009000000002, 2024-09-13T06:39:48.568 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:39:48.568 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:39:48.568 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:39:48.568 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:48.568 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:39:48.568 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:39.311466+0000", 2024-09-13T06:39:48.568 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:48.569 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:48.569 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:48.569 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:39:48.569 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:39.311466+0000", 2024-09-13T06:39:48.569 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:48.569 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:48.569 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:48.569 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:39:48.569 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:39.311463+0000", 2024-09-13T06:39:48.569 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999976 2024-09-13T06:39:48.569 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:48.569 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:48.570 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:39:48.570 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:39.311475+0000", 2024-09-13T06:39:48.570 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1303e-05 2024-09-13T06:39:48.570 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:48.570 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:48.570 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:39:48.570 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:39.311506+0000", 2024-09-13T06:39:48.570 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.0889999999999997e-05 2024-09-13T06:39:48.570 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:48.570 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:48.570 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:39:48.571 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:39.311527+0000", 2024-09-13T06:39:48.571 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.1619000000000001e-05 2024-09-13T06:39:48.571 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:48.571 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:48.571 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:39:48.571 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:39.328686+0000", 2024-09-13T06:39:48.571 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.017158837999999999 2024-09-13T06:39:48.571 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:48.571 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:48.571 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:39:48.571 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:39.328707+0000", 2024-09-13T06:39:48.571 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.0696e-05 2024-09-13T06:39:48.572 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:48.572 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:48.572 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:39:48.572 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:39.328891+0000", 2024-09-13T06:39:48.572 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00018414899999999999 2024-09-13T06:39:48.572 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:48.572 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:39:48.572 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:48.572 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:48.572 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:48.572 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:2697 3.1a 3:5b17be67:::rbd_data.11212429e5ad.00000000000001e6:head [delete] snapc 8=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-13T06:39:48.573 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:39.431651+0000", 2024-09-13T06:39:48.573 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 9.0546142090000004, 2024-09-13T06:39:48.573 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0069583359999999999, 2024-09-13T06:39:48.573 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:39:48.573 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:48.573 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:39:48.573 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:39:48.573 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:48.573 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 2697 2024-09-13T06:39:48.573 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:48.573 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:39:48.573 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:48.574 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:39:48.574 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:39.431651+0000", 2024-09-13T06:39:48.574 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:48.574 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:48.574 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:48.574 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:39:48.574 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:39.431651+0000", 2024-09-13T06:39:48.574 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:48.574 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:48.574 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:48.574 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:39:48.574 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:39.431649+0000", 2024-09-13T06:39:48.575 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999976 2024-09-13T06:39:48.575 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:48.575 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:48.575 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:39:48.575 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:39.431665+0000", 2024-09-13T06:39:48.575 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.594e-05 2024-09-13T06:39:48.575 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:48.575 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:48.575 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:39:48.575 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:39.431697+0000", 2024-09-13T06:39:48.575 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.2440000000000001e-05 2024-09-13T06:39:48.576 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:48.576 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:48.576 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:39:48.576 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:39.431719+0000", 2024-09-13T06:39:48.576 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.1622999999999999e-05 2024-09-13T06:39:48.576 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:48.576 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:48.576 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:39:48.576 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:39.431916+0000", 2024-09-13T06:39:48.576 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00019700800000000001 2024-09-13T06:39:48.577 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:48.577 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:48.577 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:39:48.577 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:39.432134+0000", 2024-09-13T06:39:48.577 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00021823599999999999 2024-09-13T06:39:48.577 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:48.577 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:48.577 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-13T06:39:48.577 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:39.432447+0000", 2024-09-13T06:39:48.577 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00031285699999999999 2024-09-13T06:39:48.577 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:48.578 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:48.578 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-13T06:39:48.578 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:39.435366+0000", 2024-09-13T06:39:48.578 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0029190969999999998 2024-09-13T06:39:48.578 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:48.578 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:48.578 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:39:48.578 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:39.438382+0000", 2024-09-13T06:39:48.578 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0030164969999999999 2024-09-13T06:39:48.578 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:48.578 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:48.578 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-13T06:39:48.579 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:39.438492+0000", 2024-09-13T06:39:48.579 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000109919 2024-09-13T06:39:48.579 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:48.579 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:48.579 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:39:48.579 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:39.438609+0000", 2024-09-13T06:39:48.579 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00011711599999999999 2024-09-13T06:39:48.579 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:48.579 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:39:48.579 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:48.579 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:48.579 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:48.579 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:3403 3.9 3:9105f097:::rbd_object_map.11217e777cf4:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-13T06:39:48.580 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:42.797279+0000", 2024-09-13T06:39:48.580 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 5.6889867150000004, 2024-09-13T06:39:48.580 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0055183840000000003, 2024-09-13T06:39:48.580 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:39:48.580 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:48.580 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:39:48.580 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:39:48.580 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:48.580 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 3403 2024-09-13T06:39:48.580 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:48.580 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:39:48.581 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:48.581 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:39:48.581 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:42.797279+0000", 2024-09-13T06:39:48.581 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:48.581 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:48.581 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:48.581 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:39:48.581 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:42.797279+0000", 2024-09-13T06:39:48.581 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:48.581 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:48.581 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:48.581 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:39:48.582 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:42.797278+0000", 2024-09-13T06:39:48.582 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:39:48.582 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:48.582 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:48.582 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:39:48.582 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:42.797283+0000", 2024-09-13T06:39:48.582 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.5700000000000003e-06 2024-09-13T06:39:48.582 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:48.582 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:48.582 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:39:48.582 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:42.797295+0000", 2024-09-13T06:39:48.582 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.271e-05 2024-09-13T06:39:48.583 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:48.583 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:48.583 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:39:48.583 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:42.797306+0000", 2024-09-13T06:39:48.583 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0393e-05 2024-09-13T06:39:48.583 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:48.583 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:48.583 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:39:48.583 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:42.798909+0000", 2024-09-13T06:39:48.583 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0016035209999999999 2024-09-13T06:39:48.583 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:48.584 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:48.584 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:39:48.584 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:42.799160+0000", 2024-09-13T06:39:48.584 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00025035500000000001 2024-09-13T06:39:48.584 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:48.584 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:48.584 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 2", 2024-09-13T06:39:48.584 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:42.800305+0000", 2024-09-13T06:39:48.584 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0011456509999999999 2024-09-13T06:39:48.584 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:48.584 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:48.585 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:39:48.585 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:42.801874+0000", 2024-09-13T06:39:48.585 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0015683579999999999 2024-09-13T06:39:48.585 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:48.585 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:48.585 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-13T06:39:48.585 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:42.802616+0000", 2024-09-13T06:39:48.585 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00074294699999999999 2024-09-13T06:39:48.585 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:48.585 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:48.585 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-13T06:39:48.585 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:42.802729+0000", 2024-09-13T06:39:48.586 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000112916 2024-09-13T06:39:48.586 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:48.586 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:48.586 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:39:48.586 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:42.802797+0000", 2024-09-13T06:39:48.586 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.7620000000000006e-05 2024-09-13T06:39:48.586 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:48.586 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:39:48.586 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:48.586 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:48.587 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:48.587 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:3559 3.9 3:9105f097:::rbd_object_map.11217e777cf4:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-13T06:39:48.587 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:43.114801+0000", 2024-09-13T06:39:48.587 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 5.371464456, 2024-09-13T06:39:48.587 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00517673, 2024-09-13T06:39:48.587 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:39:48.587 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:48.587 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:39:48.587 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:39:48.588 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:48.588 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 3559 2024-09-13T06:39:48.588 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:48.588 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:39:48.588 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:48.588 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:39:48.588 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:43.114801+0000", 2024-09-13T06:39:48.588 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:48.588 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:48.588 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:48.588 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:39:48.589 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:43.114801+0000", 2024-09-13T06:39:48.589 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:48.589 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:48.589 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:48.589 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:39:48.589 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:43.114800+0000", 2024-09-13T06:39:48.589 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999986 2024-09-13T06:39:48.589 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:48.589 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:48.589 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:39:48.590 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:43.114808+0000", 2024-09-13T06:39:48.590 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.5599999999999994e-06 2024-09-13T06:39:48.590 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:48.590 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:48.590 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:39:48.590 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:43.114828+0000", 2024-09-13T06:39:48.590 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.963e-05 2024-09-13T06:39:48.590 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:48.590 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:48.590 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:39:48.590 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:43.114839+0000", 2024-09-13T06:39:48.591 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1770000000000001e-05 2024-09-13T06:39:48.591 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:48.591 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:48.591 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:39:48.591 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:43.116355+0000", 2024-09-13T06:39:48.591 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0015151940000000001 2024-09-13T06:39:48.591 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:48.591 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:48.591 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:39:48.591 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:43.116536+0000", 2024-09-13T06:39:48.591 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00018083899999999999 2024-09-13T06:39:48.591 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:48.592 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:48.592 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 2", 2024-09-13T06:39:48.592 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:43.117363+0000", 2024-09-13T06:39:48.592 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00082782699999999995 2024-09-13T06:39:48.592 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:48.592 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:48.592 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:39:48.592 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:43.119753+0000", 2024-09-13T06:39:48.592 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0023900610000000002 2024-09-13T06:39:48.592 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:48.592 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:48.593 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-13T06:39:48.593 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:43.119831+0000", 2024-09-13T06:39:48.593 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.8055999999999999e-05 2024-09-13T06:39:48.593 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:48.593 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:48.593 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-13T06:39:48.593 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:43.119916+0000", 2024-09-13T06:39:48.593 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.4148999999999997e-05 2024-09-13T06:39:48.593 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:48.593 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:48.593 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:39:48.594 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:43.119978+0000", 2024-09-13T06:39:48.594 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.1996999999999996e-05 2024-09-13T06:39:48.594 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:48.594 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:39:48.594 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:48.594 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:48.594 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:48.594 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:3592 3.9 3:9105f097:::rbd_object_map.11217e777cf4:head [read 0~147] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35)", 2024-09-13T06:39:48.594 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:43.483604+0000", 2024-09-13T06:39:48.594 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 5.0026609439999996, 2024-09-13T06:39:48.594 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0049989810000000004, 2024-09-13T06:39:48.595 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:39:48.595 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:39:48.595 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:39:48.595 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:39:48.595 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:48.595 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 3592 2024-09-13T06:39:48.595 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:48.595 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:39:48.595 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:48.595 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:39:48.596 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:43.483604+0000", 2024-09-13T06:39:48.596 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:48.596 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:48.596 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:48.596 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:39:48.596 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:43.483604+0000", 2024-09-13T06:39:48.596 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:48.596 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:48.596 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:48.596 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:39:48.596 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:43.483602+0000", 2024-09-13T06:39:48.597 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999971 2024-09-13T06:39:48.597 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:48.597 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:48.597 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:39:48.597 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:43.483617+0000", 2024-09-13T06:39:48.597 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5276000000000001e-05 2024-09-13T06:39:48.597 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:48.597 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:48.597 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:39:48.597 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:43.483653+0000", 2024-09-13T06:39:48.597 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.5578999999999999e-05 2024-09-13T06:39:48.598 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:48.598 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:48.598 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:39:48.598 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:43.483683+0000", 2024-09-13T06:39:48.598 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.0204000000000001e-05 2024-09-13T06:39:48.598 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:48.598 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:48.598 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:39:48.598 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:43.483789+0000", 2024-09-13T06:39:48.598 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000106099 2024-09-13T06:39:48.598 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:48.599 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:48.599 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op must wait for map", 2024-09-13T06:39:48.599 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:43.483807+0000", 2024-09-13T06:39:48.599 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7932999999999999e-05 2024-09-13T06:39:48.599 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:48.599 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:48.599 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:39:48.599 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:43.488162+0000", 2024-09-13T06:39:48.599 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0043556630000000001 2024-09-13T06:39:48.599 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:48.599 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:48.600 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:39:48.600 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:43.488391+0000", 2024-09-13T06:39:48.600 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000228178 2024-09-13T06:39:48.600 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:48.600 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:48.600 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:39:48.600 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:43.488603+0000", 2024-09-13T06:39:48.600 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00021274900000000001 2024-09-13T06:39:48.600 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:48.600 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:39:48.601 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:48.601 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:48.601 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:48.601 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:4997 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:head [truncate 8388608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-09-13T06:39:48.601 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:46.741689+0000", 2024-09-13T06:39:48.601 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 1.744576076, 2024-09-13T06:39:48.601 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.007221224, 2024-09-13T06:39:48.601 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:39:48.601 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:48.601 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:39:48.602 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:39:48.602 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:48.602 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 4997 2024-09-13T06:39:48.602 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:48.602 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:39:48.602 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:48.602 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:39:48.602 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:46.741689+0000", 2024-09-13T06:39:48.602 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:48.602 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:48.602 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:48.603 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:39:48.603 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:46.741689+0000", 2024-09-13T06:39:48.603 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:48.603 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:48.603 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:48.603 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:39:48.603 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:46.741688+0000", 2024-09-13T06:39:48.603 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:39:48.603 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:48.603 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:48.603 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:39:48.603 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:46.741694+0000", 2024-09-13T06:39:48.604 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.1e-06 2024-09-13T06:39:48.604 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:48.604 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:48.604 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:39:48.604 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:46.741712+0000", 2024-09-13T06:39:48.604 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.734e-05 2024-09-13T06:39:48.604 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:48.605 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:48.605 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:39:48.605 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:46.741721+0000", 2024-09-13T06:39:48.605 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.8890000000000008e-06 2024-09-13T06:39:48.605 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:48.605 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:48.605 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:39:48.605 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:46.742887+0000", 2024-09-13T06:39:48.605 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.001165988 2024-09-13T06:39:48.605 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:48.605 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:48.605 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:39:48.606 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:46.743188+0000", 2024-09-13T06:39:48.606 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00030161100000000002 2024-09-13T06:39:48.606 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:48.606 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:48.606 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 2", 2024-09-13T06:39:48.606 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:46.743454+0000", 2024-09-13T06:39:48.606 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000266278 2024-09-13T06:39:48.606 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:48.606 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:48.606 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-13T06:39:48.606 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:46.746442+0000", 2024-09-13T06:39:48.606 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0029872029999999999 2024-09-13T06:39:48.607 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:48.607 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:48.607 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:39:48.607 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:46.748756+0000", 2024-09-13T06:39:48.607 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.002314726 2024-09-13T06:39:48.607 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:48.607 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:48.607 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-13T06:39:48.607 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:46.748843+0000", 2024-09-13T06:39:48.607 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6185000000000002e-05 2024-09-13T06:39:48.607 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:48.607 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:48.608 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:39:48.608 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:46.748910+0000", 2024-09-13T06:39:48.608 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.7890000000000002e-05 2024-09-13T06:39:48.608 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:48.608 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:39:48.608 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:48.608 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:48.608 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:39:48.608 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:39:48.610 INFO:teuthology.orchestra.run.smithi081.stderr:marked out osd.7. 2024-09-13T06:39:48.611 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-13T06:39:48.611 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:39:48.610+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:39:48.710 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-13T06:39:48.710+0000 7f86a5f06640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26387) UID: 0 2024-09-13T06:39:48.778 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:39:48.779 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [], 2024-09-13T06:39:48.779 INFO:teuthology.orchestra.run.smithi139.stdout: "num_ops": 0 2024-09-13T06:39:48.779 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:39:48.792 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-13T06:39:48.836 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:39:48.838+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:39:48.901 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-13T06:39:48.947 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:39:48.951+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:39:48.956 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:39:48.956 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [], 2024-09-13T06:39:48.957 INFO:teuthology.orchestra.run.smithi139.stdout: "complaint_time": 30, 2024-09-13T06:39:48.957 INFO:teuthology.orchestra.run.smithi139.stdout: "num_blocked_ops": 0 2024-09-13T06:39:48.957 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:39:48.970 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-13T06:39:49.013 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:39:49.015+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:39:49.058 INFO:teuthology.orchestra.run.smithi081.stdout:osd.0: {} 2024-09-13T06:39:49.058 INFO:teuthology.orchestra.run.smithi081.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-13T06:39:49.073 INFO:teuthology.orchestra.run.smithi081.stdout:osd.1: {} 2024-09-13T06:39:49.074 INFO:teuthology.orchestra.run.smithi081.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-13T06:39:49.090 INFO:teuthology.orchestra.run.smithi081.stdout:osd.2: {} 2024-09-13T06:39:49.091 INFO:teuthology.orchestra.run.smithi081.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-13T06:39:49.093 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:39:49.093 INFO:teuthology.orchestra.run.smithi139.stdout: "size": 20, 2024-09-13T06:39:49.093 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 600, 2024-09-13T06:39:49.093 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [ 2024-09-13T06:39:49.093 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:49.093 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4217.0:5 2.2 2:5cea7035:::rbd_info:head [create,write 0~8] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e19)", 2024-09-13T06:39:49.093 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:18.551848+0000", 2024-09-13T06:39:49.094 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 30.545165828999998, 2024-09-13T06:39:49.094 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0070706379999999997, 2024-09-13T06:39:49.094 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:39:49.094 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:49.094 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:39:49.094 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4217", 2024-09-13T06:39:49.094 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/2059993504", 2024-09-13T06:39:49.094 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 5 2024-09-13T06:39:49.094 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:49.094 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:39:49.094 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:49.094 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:39:49.094 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:18.551848+0000", 2024-09-13T06:39:49.094 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:49.095 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:49.095 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:49.095 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:39:49.095 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:18.551848+0000", 2024-09-13T06:39:49.095 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:49.095 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:49.095 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:49.095 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:39:49.095 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:18.551845+0000", 2024-09-13T06:39:49.095 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999967 2024-09-13T06:39:49.095 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:49.095 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:49.095 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:39:49.095 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:18.551863+0000", 2024-09-13T06:39:49.096 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.8450000000000001e-05 2024-09-13T06:39:49.096 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:49.096 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:49.096 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:39:49.096 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:18.551898+0000", 2024-09-13T06:39:49.096 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.4292999999999998e-05 2024-09-13T06:39:49.096 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:49.096 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:49.096 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:39:49.096 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:18.551915+0000", 2024-09-13T06:39:49.096 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7390000000000001e-05 2024-09-13T06:39:49.096 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:49.096 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:49.097 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:39:49.097 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:18.552049+0000", 2024-09-13T06:39:49.097 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00013432200000000001 2024-09-13T06:39:49.097 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:49.097 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:49.097 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op must wait for map", 2024-09-13T06:39:49.097 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:18.552060+0000", 2024-09-13T06:39:49.097 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0200000000000001e-05 2024-09-13T06:39:49.097 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:49.097 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:49.097 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:39:49.097 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:18.555492+0000", 2024-09-13T06:39:49.098 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0034328000000000002 2024-09-13T06:39:49.098 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:49.098 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:49.098 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:39:49.098 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:18.555726+0000", 2024-09-13T06:39:49.098 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00023350199999999999 2024-09-13T06:39:49.098 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:49.098 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:49.098 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-13T06:39:49.098 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:18.555949+0000", 2024-09-13T06:39:49.098 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00022290799999999999 2024-09-13T06:39:49.098 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:49.098 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:49.099 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-13T06:39:49.099 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:18.557425+0000", 2024-09-13T06:39:49.099 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.001476525 2024-09-13T06:39:49.099 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:49.099 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:49.099 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:39:49.099 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:18.558785+0000", 2024-09-13T06:39:49.099 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00135929 2024-09-13T06:39:49.099 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:49.099 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:49.099 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-13T06:39:49.099 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:18.558864+0000", 2024-09-13T06:39:49.099 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.9122999999999994e-05 2024-09-13T06:39:49.100 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:49.100 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:49.100 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:39:49.100 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:18.558919+0000", 2024-09-13T06:39:49.100 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.5002e-05 2024-09-13T06:39:49.100 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:49.100 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:39:49.100 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:49.100 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:49.100 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:49.100 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4217.0:7 2.2 2:5cea7035:::rbd_info:head [write 0~19] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-09-13T06:39:49.100 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:19.559245+0000", 2024-09-13T06:39:49.100 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 29.537769347000001, 2024-09-13T06:39:49.100 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0064556470000000001, 2024-09-13T06:39:49.101 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:39:49.101 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:49.101 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:39:49.101 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4217", 2024-09-13T06:39:49.101 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/2059993504", 2024-09-13T06:39:49.101 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 7 2024-09-13T06:39:49.101 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:49.101 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:39:49.101 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:49.101 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:39:49.101 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:19.559245+0000", 2024-09-13T06:39:49.101 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:49.102 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:49.102 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:49.102 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:39:49.102 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:19.559245+0000", 2024-09-13T06:39:49.102 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:49.102 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:49.102 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:49.102 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:39:49.102 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:19.559242+0000", 2024-09-13T06:39:49.102 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999971 2024-09-13T06:39:49.102 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:49.103 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:49.103 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:39:49.103 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:19.559256+0000", 2024-09-13T06:39:49.103 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.4307e-05 2024-09-13T06:39:49.103 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:49.103 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:49.103 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:39:49.103 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:19.559289+0000", 2024-09-13T06:39:49.103 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.2725999999999998e-05 2024-09-13T06:39:49.103 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:49.104 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:49.104 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:39:49.104 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:19.559306+0000", 2024-09-13T06:39:49.104 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7223000000000001e-05 2024-09-13T06:39:49.104 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:49.104 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:49.104 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:39:49.104 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:19.559475+0000", 2024-09-13T06:39:49.104 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000169025 2024-09-13T06:39:49.104 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:49.104 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:49.104 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op must wait for map", 2024-09-13T06:39:49.105 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:19.559486+0000", 2024-09-13T06:39:49.105 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0857e-05 2024-09-13T06:39:49.105 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:49.105 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:49.105 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:39:49.105 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:19.562891+0000", 2024-09-13T06:39:49.105 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.003405347 2024-09-13T06:39:49.105 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:49.105 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:49.105 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:39:49.106 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:19.563030+0000", 2024-09-13T06:39:49.106 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00013865899999999999 2024-09-13T06:39:49.106 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:49.106 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:49.106 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-13T06:39:49.106 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:19.563265+0000", 2024-09-13T06:39:49.106 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00023494799999999999 2024-09-13T06:39:49.106 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:49.106 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:49.106 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-13T06:39:49.106 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:19.564795+0000", 2024-09-13T06:39:49.106 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0015298079999999999 2024-09-13T06:39:49.106 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:49.107 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:49.107 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:39:49.107 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:19.565575+0000", 2024-09-13T06:39:49.107 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00078002400000000004 2024-09-13T06:39:49.107 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:49.107 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:49.107 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-13T06:39:49.107 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:19.565646+0000", 2024-09-13T06:39:49.107 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.1515999999999998e-05 2024-09-13T06:39:49.107 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:49.107 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:49.107 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:39:49.107 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:19.565700+0000", 2024-09-13T06:39:49.107 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.3909999999999997e-05 2024-09-13T06:39:49.108 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:49.108 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:39:49.108 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:49.108 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:49.108 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:49.108 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:368 3.c 3:30175a4c:::rbd_header.11214e25756e:head [call rbd.snapshot_add in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-13T06:39:49.108 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:33.401201+0000", 2024-09-13T06:39:49.108 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 15.695813126000001, 2024-09-13T06:39:49.108 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0094084609999999999, 2024-09-13T06:39:49.108 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:39:49.108 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:49.108 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:39:49.108 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:39:49.109 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:49.109 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 368 2024-09-13T06:39:49.109 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:49.109 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:39:49.109 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:49.109 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:39:49.109 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:33.401201+0000", 2024-09-13T06:39:49.109 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:49.109 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:49.109 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:49.109 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:39:49.109 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:33.401201+0000", 2024-09-13T06:39:49.110 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:49.110 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:49.110 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:49.110 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:39:49.110 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:33.401199+0000", 2024-09-13T06:39:49.110 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999976 2024-09-13T06:39:49.110 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:49.110 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:49.110 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:39:49.110 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:33.401211+0000", 2024-09-13T06:39:49.110 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.217e-05 2024-09-13T06:39:49.110 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:49.110 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:49.110 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:39:49.111 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:33.401232+0000", 2024-09-13T06:39:49.111 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.1355000000000001e-05 2024-09-13T06:39:49.111 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:49.111 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:49.111 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:39:49.111 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:33.401242+0000", 2024-09-13T06:39:49.111 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0091999999999999e-05 2024-09-13T06:39:49.111 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:49.111 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:49.111 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:39:49.111 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:33.401295+0000", 2024-09-13T06:39:49.111 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.2494999999999998e-05 2024-09-13T06:39:49.111 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:49.112 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:49.112 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op must wait for map", 2024-09-13T06:39:49.112 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:33.401300+0000", 2024-09-13T06:39:49.112 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.4840000000000003e-06 2024-09-13T06:39:49.112 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:49.112 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:49.112 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:39:49.112 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:33.407859+0000", 2024-09-13T06:39:49.112 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0065591160000000003 2024-09-13T06:39:49.112 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:49.112 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:49.112 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:39:49.112 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:33.407994+0000", 2024-09-13T06:39:49.113 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00013461300000000001 2024-09-13T06:39:49.113 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:49.113 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:49.113 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 3", 2024-09-13T06:39:49.113 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:33.408499+0000", 2024-09-13T06:39:49.113 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00050556600000000004 2024-09-13T06:39:49.113 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:49.113 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:49.113 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-13T06:39:49.113 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:33.409665+0000", 2024-09-13T06:39:49.113 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0011658840000000001 2024-09-13T06:39:49.114 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:49.114 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:49.114 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:39:49.114 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:33.410524+0000", 2024-09-13T06:39:49.114 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00085852200000000002 2024-09-13T06:39:49.114 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:49.114 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:49.114 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-13T06:39:49.114 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:33.410562+0000", 2024-09-13T06:39:49.114 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.7722999999999998e-05 2024-09-13T06:39:49.114 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:49.114 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:49.114 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:39:49.115 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:33.410609+0000", 2024-09-13T06:39:49.115 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.7673999999999998e-05 2024-09-13T06:39:49.115 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:49.115 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:39:49.115 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:49.115 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:49.115 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:49.115 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:495 3.c 3:30175a4c:::rbd_header.11214e25756e:head [call rbd.snapshot_remove in=18b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-09-13T06:39:49.115 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:34.413029+0000", 2024-09-13T06:39:49.115 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 14.683984664, 2024-09-13T06:39:49.116 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.011078490999999999, 2024-09-13T06:39:49.116 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:39:49.116 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:49.116 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:39:49.116 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:39:49.116 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:49.116 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 495 2024-09-13T06:39:49.116 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:49.116 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:39:49.116 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:49.116 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:39:49.116 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:34.413029+0000", 2024-09-13T06:39:49.116 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:49.117 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:49.117 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:49.117 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:39:49.117 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:34.413029+0000", 2024-09-13T06:39:49.117 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:49.117 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:49.117 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:49.117 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:39:49.117 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:34.413026+0000", 2024-09-13T06:39:49.117 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999967 2024-09-13T06:39:49.117 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:49.117 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:49.118 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:39:49.118 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:34.413043+0000", 2024-09-13T06:39:49.118 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7237000000000001e-05 2024-09-13T06:39:49.118 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:49.118 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:49.118 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:39:49.118 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:34.413081+0000", 2024-09-13T06:39:49.118 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.8112999999999999e-05 2024-09-13T06:39:49.119 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:49.119 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:49.119 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:39:49.119 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:34.413103+0000", 2024-09-13T06:39:49.120 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.2385999999999999e-05 2024-09-13T06:39:49.120 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:49.120 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:49.120 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:39:49.120 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:34.413241+0000", 2024-09-13T06:39:49.120 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00013729200000000001 2024-09-13T06:39:49.121 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:49.121 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:49.121 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op must wait for map", 2024-09-13T06:39:49.121 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:34.413252+0000", 2024-09-13T06:39:49.121 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1717e-05 2024-09-13T06:39:49.122 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:49.122 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:49.122 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:39:49.122 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:34.420767+0000", 2024-09-13T06:39:49.122 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.007514405 2024-09-13T06:39:49.122 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:49.122 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:49.122 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:39:49.122 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:34.420914+0000", 2024-09-13T06:39:49.123 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000147076 2024-09-13T06:39:49.123 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:49.123 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:49.123 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 3", 2024-09-13T06:39:49.123 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:34.421675+0000", 2024-09-13T06:39:49.123 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00076097999999999997 2024-09-13T06:39:49.123 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:49.123 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:49.123 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:39:49.124 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:34.423787+0000", 2024-09-13T06:39:49.124 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.002112414 2024-09-13T06:39:49.124 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:49.124 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:49.124 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-13T06:39:49.124 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:34.423810+0000", 2024-09-13T06:39:49.125 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.2453999999999999e-05 2024-09-13T06:39:49.125 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:49.125 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:49.125 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-13T06:39:49.125 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:34.423976+0000", 2024-09-13T06:39:49.125 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000165778 2024-09-13T06:39:49.125 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:49.125 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:49.125 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:39:49.125 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:34.424108+0000", 2024-09-13T06:39:49.125 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00013216200000000001 2024-09-13T06:39:49.125 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:49.126 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:39:49.126 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:49.126 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:49.126 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:49.126 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:543 3.16 3:6bcf1921:::rbd_data.11214e25756e.000000000000001a:head [delete] snapc 5=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-09-13T06:39:49.126 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:34.609838+0000", 2024-09-13T06:39:49.126 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 14.487176313000001, 2024-09-13T06:39:49.126 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0066085329999999998, 2024-09-13T06:39:49.126 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:39:49.126 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:49.126 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:39:49.126 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:39:49.126 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:49.126 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 543 2024-09-13T06:39:49.127 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:49.127 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:39:49.127 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:49.127 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:39:49.127 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:34.609838+0000", 2024-09-13T06:39:49.127 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:49.127 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:49.127 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:49.127 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:39:49.127 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:34.609838+0000", 2024-09-13T06:39:49.127 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:49.127 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:49.128 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:49.128 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:39:49.128 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:34.609836+0000", 2024-09-13T06:39:49.128 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999986 2024-09-13T06:39:49.128 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:49.128 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:49.128 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:39:49.128 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:34.609846+0000", 2024-09-13T06:39:49.128 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0263e-05 2024-09-13T06:39:49.128 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:49.128 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:49.128 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:39:49.129 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:34.609870+0000", 2024-09-13T06:39:49.129 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.3309e-05 2024-09-13T06:39:49.129 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:49.129 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:49.129 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:39:49.129 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:34.609887+0000", 2024-09-13T06:39:49.129 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7677e-05 2024-09-13T06:39:49.129 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:49.129 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:49.129 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:39:49.130 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:34.610920+0000", 2024-09-13T06:39:49.130 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.001032222 2024-09-13T06:39:49.130 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:49.130 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:49.130 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:39:49.130 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:34.611132+0000", 2024-09-13T06:39:49.130 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000211945 2024-09-13T06:39:49.130 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:49.130 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:49.130 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 7", 2024-09-13T06:39:49.130 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:34.611436+0000", 2024-09-13T06:39:49.131 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00030445800000000002 2024-09-13T06:39:49.131 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:49.131 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:49.131 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-13T06:39:49.131 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:34.613043+0000", 2024-09-13T06:39:49.131 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.001607081 2024-09-13T06:39:49.132 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:49.132 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:49.132 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:39:49.132 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:34.616293+0000", 2024-09-13T06:39:49.132 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0032495380000000002 2024-09-13T06:39:49.133 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:49.133 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:49.133 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-13T06:39:49.133 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:34.616380+0000", 2024-09-13T06:39:49.133 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.7802999999999999e-05 2024-09-13T06:39:49.133 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:49.134 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:49.134 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:39:49.134 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:34.616446+0000", 2024-09-13T06:39:49.134 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.5710000000000006e-05 2024-09-13T06:39:49.134 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:49.134 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:39:49.135 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:49.135 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:49.135 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:49.135 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:2335 3.16 3:688a349f:::rbd_data.11212429e5ad.000000000000002e:head [delete] snapc 8=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-13T06:39:49.135 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:38.832593+0000", 2024-09-13T06:39:49.136 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 10.264420446000001, 2024-09-13T06:39:49.136 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0054323849999999996, 2024-09-13T06:39:49.136 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:39:49.136 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:39:49.136 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:39:49.136 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:39:49.137 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:49.137 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 2335 2024-09-13T06:39:49.137 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:49.137 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:39:49.137 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:49.138 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:39:49.138 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.832593+0000", 2024-09-13T06:39:49.138 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:49.138 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:49.138 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:49.138 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:39:49.138 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.832593+0000", 2024-09-13T06:39:49.139 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:49.139 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:49.139 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:49.139 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:39:49.139 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.832590+0000", 2024-09-13T06:39:49.139 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999967 2024-09-13T06:39:49.139 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:49.139 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:49.139 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:39:49.139 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.832606+0000", 2024-09-13T06:39:49.139 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5639999999999999e-05 2024-09-13T06:39:49.139 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:49.139 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:49.140 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:39:49.140 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.832652+0000", 2024-09-13T06:39:49.140 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.5958999999999998e-05 2024-09-13T06:39:49.140 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:49.140 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:49.140 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:39:49.140 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.832673+0000", 2024-09-13T06:39:49.140 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.1367000000000001e-05 2024-09-13T06:39:49.140 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:49.140 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:49.140 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:39:49.140 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.832831+0000", 2024-09-13T06:39:49.140 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00015797599999999999 2024-09-13T06:39:49.140 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:49.141 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:49.141 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:39:49.141 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.833205+0000", 2024-09-13T06:39:49.141 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000373853 2024-09-13T06:39:49.141 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:49.141 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:49.141 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:39:49.141 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.838026+0000", 2024-09-13T06:39:49.141 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0048208269999999998 2024-09-13T06:39:49.141 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:49.141 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:39:49.141 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:49.141 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:49.141 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:49.142 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:2338 3.1d 3:bf97f67e:::rbd_data.11212429e5ad.0000000000000031:head [delete] snapc 8=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-13T06:39:49.142 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:38.832797+0000", 2024-09-13T06:39:49.142 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 10.264216871, 2024-09-13T06:39:49.142 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00856319, 2024-09-13T06:39:49.142 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:39:49.142 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:39:49.142 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:39:49.142 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:39:49.142 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:49.142 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 2338 2024-09-13T06:39:49.142 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:49.142 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:39:49.142 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:49.143 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:39:49.143 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.832797+0000", 2024-09-13T06:39:49.143 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:49.143 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:49.143 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:49.143 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:39:49.143 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.832797+0000", 2024-09-13T06:39:49.143 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:49.143 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:49.143 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:49.143 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:39:49.143 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.832796+0000", 2024-09-13T06:39:49.143 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:39:49.144 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:49.144 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:49.144 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:39:49.144 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.832803+0000", 2024-09-13T06:39:49.144 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.9430000000000003e-06 2024-09-13T06:39:49.144 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:49.144 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:49.144 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:39:49.144 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.832822+0000", 2024-09-13T06:39:49.144 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.893e-05 2024-09-13T06:39:49.144 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:49.144 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:49.144 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:39:49.145 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.832837+0000", 2024-09-13T06:39:49.145 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.472e-05 2024-09-13T06:39:49.145 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:49.145 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:49.145 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:39:49.145 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.833177+0000", 2024-09-13T06:39:49.145 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000340787 2024-09-13T06:39:49.145 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:49.145 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:49.145 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:39:49.145 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.833498+0000", 2024-09-13T06:39:49.145 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00032089100000000001 2024-09-13T06:39:49.145 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:49.145 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:49.146 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:39:49.146 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.841360+0000", 2024-09-13T06:39:49.146 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0078620189999999996 2024-09-13T06:39:49.146 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:49.146 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:39:49.146 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:49.146 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:49.146 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:49.146 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:2347 3.16 3:6ed54f2e:::rbd_data.11212429e5ad.000000000000003c:head [delete] snapc 8=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-13T06:39:49.146 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:38.838489+0000", 2024-09-13T06:39:49.146 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 10.258524470999999, 2024-09-13T06:39:49.146 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0072517129999999999, 2024-09-13T06:39:49.146 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:39:49.147 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:39:49.147 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:39:49.147 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:39:49.147 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:49.147 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 2347 2024-09-13T06:39:49.147 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:49.147 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:39:49.147 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:49.147 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:39:49.147 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.838489+0000", 2024-09-13T06:39:49.147 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:49.148 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:49.148 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:49.148 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:39:49.148 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.838489+0000", 2024-09-13T06:39:49.148 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:49.148 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:49.148 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:49.148 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:39:49.148 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.838487+0000", 2024-09-13T06:39:49.148 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999976 2024-09-13T06:39:49.148 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:49.148 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:49.148 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:39:49.149 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.838502+0000", 2024-09-13T06:39:49.149 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5082999999999999e-05 2024-09-13T06:39:49.149 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:49.149 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:49.149 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:39:49.149 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.838538+0000", 2024-09-13T06:39:49.149 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.5905999999999998e-05 2024-09-13T06:39:49.149 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:49.149 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:49.149 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:39:49.149 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.838560+0000", 2024-09-13T06:39:49.149 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.1797000000000002e-05 2024-09-13T06:39:49.150 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:49.150 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:49.150 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:39:49.150 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.838683+0000", 2024-09-13T06:39:49.150 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000123566 2024-09-13T06:39:49.150 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:49.150 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:49.150 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:39:49.150 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.839043+0000", 2024-09-13T06:39:49.150 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00035978300000000002 2024-09-13T06:39:49.150 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:49.150 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:49.150 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:39:49.150 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.845741+0000", 2024-09-13T06:39:49.150 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.006698135 2024-09-13T06:39:49.151 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:49.151 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:39:49.151 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:49.151 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:49.151 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:49.151 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:2352 3.1d 3:bbeb2066:::rbd_data.11212429e5ad.0000000000000045:head [delete] snapc 8=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-13T06:39:49.151 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:38.839987+0000", 2024-09-13T06:39:49.151 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 10.257026956000001, 2024-09-13T06:39:49.151 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0070639079999999998, 2024-09-13T06:39:49.151 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:39:49.152 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:39:49.152 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:39:49.152 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:39:49.152 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:49.152 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 2352 2024-09-13T06:39:49.152 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:49.152 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:39:49.152 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:49.152 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:39:49.153 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.839987+0000", 2024-09-13T06:39:49.153 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:49.153 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:49.153 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:49.153 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:39:49.153 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.839987+0000", 2024-09-13T06:39:49.153 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:49.153 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:49.153 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:49.153 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:39:49.153 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.839984+0000", 2024-09-13T06:39:49.153 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999971 2024-09-13T06:39:49.153 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:49.153 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:49.154 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:39:49.154 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.839998+0000", 2024-09-13T06:39:49.154 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.4185999999999999e-05 2024-09-13T06:39:49.154 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:49.154 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:49.154 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:39:49.154 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.840030+0000", 2024-09-13T06:39:49.154 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.1590000000000001e-05 2024-09-13T06:39:49.154 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:49.154 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:49.154 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:39:49.154 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.840052+0000", 2024-09-13T06:39:49.154 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.1926e-05 2024-09-13T06:39:49.155 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:49.155 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:49.155 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:39:49.155 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.840179+0000", 2024-09-13T06:39:49.155 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00012688599999999999 2024-09-13T06:39:49.155 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:49.155 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:49.155 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:39:49.155 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.840492+0000", 2024-09-13T06:39:49.155 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00031314100000000002 2024-09-13T06:39:49.155 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:49.155 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:49.155 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:39:49.156 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.847051+0000", 2024-09-13T06:39:49.156 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0065589589999999996 2024-09-13T06:39:49.156 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:49.156 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:39:49.156 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:49.156 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:49.156 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:49.156 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:2370 3.c 3:33b14f9a:::rbd_data.11212429e5ad.00000000000000aa:head [delete] snapc 8=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-13T06:39:49.156 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:38.850355+0000", 2024-09-13T06:39:49.156 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 10.246658416000001, 2024-09-13T06:39:49.156 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0074079189999999998, 2024-09-13T06:39:49.156 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:39:49.156 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:39:49.157 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:39:49.157 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:39:49.157 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:49.157 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 2370 2024-09-13T06:39:49.157 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:49.157 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:39:49.157 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:49.157 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:39:49.157 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.850355+0000", 2024-09-13T06:39:49.157 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:49.157 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:49.158 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:49.158 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:39:49.158 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.850355+0000", 2024-09-13T06:39:49.158 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:49.158 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:49.158 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:49.158 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:39:49.158 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.850353+0000", 2024-09-13T06:39:49.158 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999971 2024-09-13T06:39:49.158 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:49.158 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:49.159 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:39:49.159 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.850368+0000", 2024-09-13T06:39:49.159 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5426000000000001e-05 2024-09-13T06:39:49.159 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:49.159 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:49.159 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:39:49.159 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.850413+0000", 2024-09-13T06:39:49.159 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.4910000000000002e-05 2024-09-13T06:39:49.159 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:49.159 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:49.159 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:39:49.160 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.850436+0000", 2024-09-13T06:39:49.160 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.2776999999999999e-05 2024-09-13T06:39:49.160 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:49.160 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:49.160 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:39:49.160 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.850568+0000", 2024-09-13T06:39:49.160 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00013224499999999999 2024-09-13T06:39:49.160 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:49.160 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:49.160 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:39:49.160 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.850877+0000", 2024-09-13T06:39:49.160 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00030922399999999998 2024-09-13T06:39:49.160 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:49.161 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:49.161 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:39:49.161 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.857763+0000", 2024-09-13T06:39:49.161 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0068861269999999997 2024-09-13T06:39:49.161 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:49.161 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:39:49.161 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:49.161 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:49.161 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:49.161 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop(client.4385.0:2391 3.17 e31/21 3:ef90b167:::rbd_data.11212429e5ad.000000000000010b:head v 31'3, mlcod=31'1)", 2024-09-13T06:39:49.161 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:38.859918+0000", 2024-09-13T06:39:49.161 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 10.237095517, 2024-09-13T06:39:49.161 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0077607529999999996, 2024-09-13T06:39:49.162 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:39:49.162 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:49.162 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:39:49.162 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:49.162 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:39:49.162 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.859918+0000", 2024-09-13T06:39:49.162 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:49.162 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:49.162 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:49.162 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:39:49.162 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.859918+0000", 2024-09-13T06:39:49.162 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:49.162 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:49.162 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:49.163 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:39:49.163 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.859916+0000", 2024-09-13T06:39:49.163 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999981 2024-09-13T06:39:49.163 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:49.163 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:49.163 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:39:49.163 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.859944+0000", 2024-09-13T06:39:49.163 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.7827e-05 2024-09-13T06:39:49.163 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:49.163 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:49.163 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:39:49.163 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.859982+0000", 2024-09-13T06:39:49.163 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.7666000000000002e-05 2024-09-13T06:39:49.163 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:49.164 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:49.164 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:39:49.164 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.860001+0000", 2024-09-13T06:39:49.164 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.8615999999999999e-05 2024-09-13T06:39:49.164 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:49.164 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:49.164 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:39:49.164 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.860110+0000", 2024-09-13T06:39:49.164 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000109493 2024-09-13T06:39:49.164 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:49.164 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:49.164 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:39:49.164 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.860169+0000", 2024-09-13T06:39:49.165 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.8672999999999999e-05 2024-09-13T06:39:49.165 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:49.165 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:49.165 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-13T06:39:49.165 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.867603+0000", 2024-09-13T06:39:49.165 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.007434286 2024-09-13T06:39:49.165 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:49.165 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:49.165 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:39:49.165 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.867679+0000", 2024-09-13T06:39:49.165 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.6099000000000004e-05 2024-09-13T06:39:49.165 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:49.165 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:39:49.165 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:49.166 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:49.166 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:49.166 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:2393 3.16 3:6e357f53:::rbd_data.11212429e5ad.000000000000013d:head [delete] snapc 8=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-13T06:39:49.166 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:38.860707+0000", 2024-09-13T06:39:49.166 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 10.23630674, 2024-09-13T06:39:49.166 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0070848990000000004, 2024-09-13T06:39:49.166 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:39:49.166 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:49.166 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:39:49.166 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:39:49.166 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:49.167 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 2393 2024-09-13T06:39:49.167 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:49.167 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:39:49.167 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:49.167 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:39:49.167 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.860707+0000", 2024-09-13T06:39:49.167 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:49.167 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:49.167 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:49.167 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:39:49.167 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.860707+0000", 2024-09-13T06:39:49.167 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:49.167 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:49.168 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:49.168 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:39:49.168 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.860705+0000", 2024-09-13T06:39:49.168 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999981 2024-09-13T06:39:49.168 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:49.168 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:49.168 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:39:49.168 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.860716+0000", 2024-09-13T06:39:49.168 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1199999999999999e-05 2024-09-13T06:39:49.168 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:49.168 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:49.168 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:39:49.168 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.860747+0000", 2024-09-13T06:39:49.169 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.0102000000000001e-05 2024-09-13T06:39:49.169 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:49.169 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:49.169 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:39:49.169 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.860765+0000", 2024-09-13T06:39:49.169 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.8323999999999999e-05 2024-09-13T06:39:49.169 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:49.169 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:49.169 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:39:49.169 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.860859+0000", 2024-09-13T06:39:49.169 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.3936000000000003e-05 2024-09-13T06:39:49.169 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:49.169 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:49.170 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:39:49.170 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.861025+0000", 2024-09-13T06:39:49.170 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00016648800000000001 2024-09-13T06:39:49.170 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:49.170 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:49.170 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 7", 2024-09-13T06:39:49.170 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.861217+0000", 2024-09-13T06:39:49.170 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000191576 2024-09-13T06:39:49.170 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:49.170 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:49.170 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:39:49.171 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.865095+0000", 2024-09-13T06:39:49.171 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0038781269999999999 2024-09-13T06:39:49.171 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:49.171 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:49.171 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-13T06:39:49.171 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.867541+0000", 2024-09-13T06:39:49.171 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.002445834 2024-09-13T06:39:49.171 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:49.171 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:49.171 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-13T06:39:49.171 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.867683+0000", 2024-09-13T06:39:49.171 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00014221200000000001 2024-09-13T06:39:49.172 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:49.172 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:49.172 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:39:49.172 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.867792+0000", 2024-09-13T06:39:49.172 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00010901299999999999 2024-09-13T06:39:49.172 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:49.172 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:39:49.172 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:49.172 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:49.172 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:49.172 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:2394 3.5 3:a18f5e28:::rbd_data.11212429e5ad.0000000000000219:head [delete] snapc 8=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-13T06:39:49.173 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:38.860871+0000", 2024-09-13T06:39:49.173 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 10.236142958, 2024-09-13T06:39:49.173 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0069226130000000002, 2024-09-13T06:39:49.173 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:39:49.173 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:49.173 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:39:49.173 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:39:49.173 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:49.173 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 2394 2024-09-13T06:39:49.173 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:49.174 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:39:49.174 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:49.174 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:39:49.174 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.860871+0000", 2024-09-13T06:39:49.174 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:49.174 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:49.174 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:49.174 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:39:49.174 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.860871+0000", 2024-09-13T06:39:49.174 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:49.174 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:49.174 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:49.174 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:39:49.174 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.860870+0000", 2024-09-13T06:39:49.175 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:39:49.175 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:49.175 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:49.175 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:39:49.175 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.860877+0000", 2024-09-13T06:39:49.175 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.277e-06 2024-09-13T06:39:49.175 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:49.175 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:49.175 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:39:49.175 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.860897+0000", 2024-09-13T06:39:49.175 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.9530000000000001e-05 2024-09-13T06:39:49.175 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:49.175 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:49.175 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:39:49.176 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.860907+0000", 2024-09-13T06:39:49.176 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0396e-05 2024-09-13T06:39:49.176 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:49.176 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:49.176 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:39:49.176 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.861020+0000", 2024-09-13T06:39:49.176 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000113006 2024-09-13T06:39:49.176 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:49.176 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:49.176 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:39:49.176 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.861148+0000", 2024-09-13T06:39:49.176 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00012793200000000001 2024-09-13T06:39:49.176 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:49.176 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:49.177 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 3", 2024-09-13T06:39:49.177 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.861311+0000", 2024-09-13T06:39:49.177 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00016286600000000001 2024-09-13T06:39:49.177 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:49.177 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:49.177 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:39:49.177 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.863229+0000", 2024-09-13T06:39:49.177 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.001918052 2024-09-13T06:39:49.177 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:49.177 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:49.177 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-13T06:39:49.177 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.867549+0000", 2024-09-13T06:39:49.177 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0043200799999999996 2024-09-13T06:39:49.178 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:49.178 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:49.178 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-13T06:39:49.178 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.867700+0000", 2024-09-13T06:39:49.178 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00015136199999999999 2024-09-13T06:39:49.178 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:49.178 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:49.178 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:39:49.178 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.867794+0000", 2024-09-13T06:39:49.178 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.3249000000000001e-05 2024-09-13T06:39:49.178 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:49.178 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:39:49.178 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:49.179 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:49.179 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:49.179 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop(client.4385.0:2392 3.1f e31/21 3:fdec2555:::rbd_data.11212429e5ad.000000000000010c:head v 31'6, mlcod=31'3)", 2024-09-13T06:39:49.179 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:38.861004+0000", 2024-09-13T06:39:49.179 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 10.236010389, 2024-09-13T06:39:49.179 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0067347520000000001, 2024-09-13T06:39:49.179 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:39:49.179 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:49.179 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:39:49.179 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:49.179 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:39:49.179 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.861004+0000", 2024-09-13T06:39:49.179 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:49.179 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:49.180 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:49.180 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:39:49.180 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.861004+0000", 2024-09-13T06:39:49.180 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:49.180 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:49.180 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:49.180 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:39:49.180 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.861003+0000", 2024-09-13T06:39:49.180 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:39:49.180 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:49.180 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:49.180 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:39:49.180 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.861010+0000", 2024-09-13T06:39:49.181 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.6000000000000001e-06 2024-09-13T06:39:49.181 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:49.181 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:49.181 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:39:49.181 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.861023+0000", 2024-09-13T06:39:49.181 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2347000000000001e-05 2024-09-13T06:39:49.181 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:49.181 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:49.181 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:39:49.181 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.861030+0000", 2024-09-13T06:39:49.181 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.8760000000000005e-06 2024-09-13T06:39:49.181 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:49.181 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:49.181 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:39:49.182 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.861122+0000", 2024-09-13T06:39:49.182 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.1773000000000004e-05 2024-09-13T06:39:49.182 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:49.182 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:49.182 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:39:49.182 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.861172+0000", 2024-09-13T06:39:49.182 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.0266000000000003e-05 2024-09-13T06:39:49.182 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:49.182 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:49.182 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-13T06:39:49.182 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.867684+0000", 2024-09-13T06:39:49.182 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.006511714 2024-09-13T06:39:49.182 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:49.182 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:49.183 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:39:49.183 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.867738+0000", 2024-09-13T06:39:49.183 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.4042999999999997e-05 2024-09-13T06:39:49.183 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:49.183 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:39:49.183 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:49.183 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:49.183 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:49.183 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:2420 3.1d 3:bd13e332:::rbd_data.11212429e5ad.0000000000000021:head [truncate 65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-13T06:39:49.183 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:38.889959+0000", 2024-09-13T06:39:49.183 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 10.207054399, 2024-09-13T06:39:49.183 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0068746399999999996, 2024-09-13T06:39:49.183 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:39:49.183 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:39:49.184 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:39:49.184 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:39:49.184 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:49.184 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 2420 2024-09-13T06:39:49.184 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:49.184 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:39:49.184 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:49.184 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:39:49.184 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.889959+0000", 2024-09-13T06:39:49.184 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:49.184 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:49.184 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:49.184 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:39:49.185 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.889959+0000", 2024-09-13T06:39:49.185 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:49.185 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:49.185 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:49.185 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:39:49.185 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.889957+0000", 2024-09-13T06:39:49.185 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999976 2024-09-13T06:39:49.185 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:49.185 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:49.185 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:39:49.185 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.889971+0000", 2024-09-13T06:39:49.185 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.4217e-05 2024-09-13T06:39:49.185 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:49.186 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:49.186 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:39:49.186 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.890001+0000", 2024-09-13T06:39:49.186 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.0049999999999999e-05 2024-09-13T06:39:49.186 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:49.186 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:49.186 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:39:49.186 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.890021+0000", 2024-09-13T06:39:49.186 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.0129e-05 2024-09-13T06:39:49.186 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:49.186 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:49.186 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:39:49.186 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.890106+0000", 2024-09-13T06:39:49.187 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.4396999999999998e-05 2024-09-13T06:39:49.187 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:49.187 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:49.187 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:39:49.187 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.890346+0000", 2024-09-13T06:39:49.187 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000240564 2024-09-13T06:39:49.187 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:49.187 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:49.187 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:39:49.187 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.896834+0000", 2024-09-13T06:39:49.187 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0064876999999999999 2024-09-13T06:39:49.187 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:49.187 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:39:49.187 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:49.188 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:49.188 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:49.188 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:2422 3.5 3:a47607e3:::rbd_data.11212429e5ad.0000000000000023:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-13T06:39:49.188 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:38.890176+0000", 2024-09-13T06:39:49.188 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 10.206837794, 2024-09-13T06:39:49.188 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0057967060000000004, 2024-09-13T06:39:49.188 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:39:49.188 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:39:49.188 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:39:49.188 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:39:49.188 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:49.188 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 2422 2024-09-13T06:39:49.188 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:49.189 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:39:49.189 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:49.189 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:39:49.189 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.890176+0000", 2024-09-13T06:39:49.189 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:49.189 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:49.189 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:49.189 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:39:49.189 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.890176+0000", 2024-09-13T06:39:49.189 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:49.189 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:49.189 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:49.189 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:39:49.189 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.890174+0000", 2024-09-13T06:39:49.190 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999981 2024-09-13T06:39:49.190 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:49.190 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:49.190 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:39:49.190 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.890185+0000", 2024-09-13T06:39:49.190 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1467e-05 2024-09-13T06:39:49.190 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:49.190 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:49.190 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:39:49.190 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.890216+0000", 2024-09-13T06:39:49.190 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.0533000000000001e-05 2024-09-13T06:39:49.190 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:49.190 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:49.191 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:39:49.191 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.890240+0000", 2024-09-13T06:39:49.191 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.4216999999999999e-05 2024-09-13T06:39:49.191 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:49.191 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:49.191 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:39:49.191 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.890357+0000", 2024-09-13T06:39:49.191 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000117279 2024-09-13T06:39:49.191 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:49.191 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:49.191 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:39:49.191 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.890709+0000", 2024-09-13T06:39:49.191 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00035154700000000001 2024-09-13T06:39:49.191 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:49.192 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:49.192 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:39:49.192 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.895973+0000", 2024-09-13T06:39:49.192 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0052637999999999999 2024-09-13T06:39:49.192 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:49.192 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:39:49.192 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:49.192 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:49.192 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:49.192 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:2637 3.c 3:34346ebf:::rbd_data.11212429e5ad.00000000000001e5:head [set-alloc-hint object_size 262144 write_size 262144,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-13T06:39:49.192 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:39.279539+0000", 2024-09-13T06:39:49.192 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 9.8174753020000001, 2024-09-13T06:39:49.192 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.026144222000000002, 2024-09-13T06:39:49.193 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:39:49.193 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:49.193 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:39:49.193 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:39:49.193 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:49.193 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 2637 2024-09-13T06:39:49.193 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:49.193 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:39:49.193 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:49.193 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:39:49.193 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:39.279539+0000", 2024-09-13T06:39:49.193 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:49.193 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:49.194 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:49.194 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:39:49.194 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:39.279539+0000", 2024-09-13T06:39:49.194 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:49.194 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:49.194 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:49.194 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:39:49.194 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:39.279537+0000", 2024-09-13T06:39:49.194 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999986 2024-09-13T06:39:49.194 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:49.194 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:49.194 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:39:49.194 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:39.279547+0000", 2024-09-13T06:39:49.195 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.04e-05 2024-09-13T06:39:49.195 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:49.195 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:49.195 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:39:49.195 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:39.279571+0000", 2024-09-13T06:39:49.195 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.3166000000000001e-05 2024-09-13T06:39:49.195 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:49.195 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:49.195 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:39:49.195 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:39.279583+0000", 2024-09-13T06:39:49.195 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2693e-05 2024-09-13T06:39:49.195 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:49.195 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:49.195 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:39:49.196 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:39.279667+0000", 2024-09-13T06:39:49.196 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.3780000000000001e-05 2024-09-13T06:39:49.196 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:49.196 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:49.196 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:39:49.196 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:39.279888+0000", 2024-09-13T06:39:49.196 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000220435 2024-09-13T06:39:49.196 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:49.196 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:49.196 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 3", 2024-09-13T06:39:49.196 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:39.284649+0000", 2024-09-13T06:39:49.196 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0047618900000000004 2024-09-13T06:39:49.196 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:49.197 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:49.197 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-13T06:39:49.197 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:39.305310+0000", 2024-09-13T06:39:49.197 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.020660917000000001 2024-09-13T06:39:49.197 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:49.197 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:49.197 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:39:49.197 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:39.305434+0000", 2024-09-13T06:39:49.197 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000124179 2024-09-13T06:39:49.197 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:49.197 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:49.197 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-13T06:39:49.198 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:39.305580+0000", 2024-09-13T06:39:49.198 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00014571899999999999 2024-09-13T06:39:49.198 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:49.198 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:49.198 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:39:49.198 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:39.305683+0000", 2024-09-13T06:39:49.198 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000102593 2024-09-13T06:39:49.198 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:49.198 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:39:49.198 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:49.198 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:49.198 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:49.198 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop_reply(client.4385.0:2637 3.c e31/21 ondisk, result = 0)", 2024-09-13T06:39:49.199 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:39.295093+0000", 2024-09-13T06:39:49.199 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 9.8019209319999998, 2024-09-13T06:39:49.199 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.010611122000000001, 2024-09-13T06:39:49.199 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:39:49.199 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:39:49.199 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:39:49.199 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:49.199 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:39:49.199 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:39.295093+0000", 2024-09-13T06:39:49.199 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:49.199 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:49.199 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:49.199 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:39:49.199 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:39.295093+0000", 2024-09-13T06:39:49.200 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:49.200 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:49.200 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:49.200 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:39:49.200 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:39.295084+0000", 2024-09-13T06:39:49.200 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999909 2024-09-13T06:39:49.200 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:49.200 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:49.200 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:39:49.200 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:39.295105+0000", 2024-09-13T06:39:49.200 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.1209e-05 2024-09-13T06:39:49.200 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:49.201 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:49.201 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:39:49.201 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:39.295142+0000", 2024-09-13T06:39:49.201 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.6940000000000002e-05 2024-09-13T06:39:49.201 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:49.201 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:49.201 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:39:49.201 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:39.295164+0000", 2024-09-13T06:39:49.201 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.1974e-05 2024-09-13T06:39:49.201 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:49.201 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:49.201 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:39:49.201 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:39.305394+0000", 2024-09-13T06:39:49.202 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.010229911 2024-09-13T06:39:49.202 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:49.202 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:49.202 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:39:49.202 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:39.305416+0000", 2024-09-13T06:39:49.202 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.1776e-05 2024-09-13T06:39:49.202 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:49.202 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:49.202 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:39:49.202 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:39.305704+0000", 2024-09-13T06:39:49.203 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00028855200000000003 2024-09-13T06:39:49.203 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:49.203 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:39:49.203 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:49.203 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:49.203 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:49.203 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:2698 3.1c 3:3e5fcbe2:::rbd_data.11212429e5ad.000000000000024c:head [delete] snapc 8=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-13T06:39:49.203 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:39.432490+0000", 2024-09-13T06:39:49.203 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 9.6645235560000007, 2024-09-13T06:39:49.203 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0064328299999999996, 2024-09-13T06:39:49.203 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:39:49.203 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:49.203 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:39:49.204 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:39:49.204 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:49.204 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 2698 2024-09-13T06:39:49.204 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:49.204 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:39:49.204 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:49.204 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:39:49.204 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:39.432490+0000", 2024-09-13T06:39:49.204 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:49.204 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:49.204 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:49.204 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:39:49.204 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:39.432490+0000", 2024-09-13T06:39:49.205 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:49.205 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:49.205 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:49.205 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:39:49.205 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:39.432487+0000", 2024-09-13T06:39:49.205 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999971 2024-09-13T06:39:49.205 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:49.205 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:49.205 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:39:49.205 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:39.432504+0000", 2024-09-13T06:39:49.206 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6480000000000001e-05 2024-09-13T06:39:49.206 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:49.206 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:49.206 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:39:49.206 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:39.432540+0000", 2024-09-13T06:39:49.206 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.6298999999999999e-05 2024-09-13T06:39:49.206 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:49.206 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:49.206 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:39:49.206 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:39.432564+0000", 2024-09-13T06:39:49.206 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.4216999999999999e-05 2024-09-13T06:39:49.206 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:49.206 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:49.206 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:39:49.207 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:39.432695+0000", 2024-09-13T06:39:49.207 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000130312 2024-09-13T06:39:49.207 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:49.207 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:49.207 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:39:49.207 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:39.433332+0000", 2024-09-13T06:39:49.207 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00063734200000000005 2024-09-13T06:39:49.207 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:49.207 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:49.207 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 4", 2024-09-13T06:39:49.207 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:39.433640+0000", 2024-09-13T06:39:49.207 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00030837099999999999 2024-09-13T06:39:49.207 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:49.207 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:49.208 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-13T06:39:49.208 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:39.438205+0000", 2024-09-13T06:39:49.208 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0045651140000000003 2024-09-13T06:39:49.208 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:49.208 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:49.208 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:39:49.208 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:39.438633+0000", 2024-09-13T06:39:49.208 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00042783699999999998 2024-09-13T06:39:49.208 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:49.208 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:49.208 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-13T06:39:49.208 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:39.438824+0000", 2024-09-13T06:39:49.208 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00019104899999999999 2024-09-13T06:39:49.208 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:49.209 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:49.209 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:39:49.209 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:39.438923+0000", 2024-09-13T06:39:49.209 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.8791999999999999e-05 2024-09-13T06:39:49.209 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:49.209 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:39:49.209 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:49.209 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:49.209 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:49.209 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:2700 3.16 3:6b16c46d:::rbd_data.11212429e5ad.000000000000037a:head [delete] snapc 8=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-13T06:39:49.209 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:39.433274+0000", 2024-09-13T06:39:49.209 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 9.6637402120000004, 2024-09-13T06:39:49.209 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0057244949999999996, 2024-09-13T06:39:49.210 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:39:49.210 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:49.210 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:39:49.210 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:39:49.210 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:49.210 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 2700 2024-09-13T06:39:49.210 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:49.210 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:39:49.210 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:49.210 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:39:49.211 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:39.433274+0000", 2024-09-13T06:39:49.211 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:49.211 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:49.211 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:49.211 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:39:49.211 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:39.433274+0000", 2024-09-13T06:39:49.211 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:49.211 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:49.211 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:49.211 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:39:49.211 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:39.433271+0000", 2024-09-13T06:39:49.211 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999971 2024-09-13T06:39:49.211 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:49.211 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:49.212 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:39:49.212 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:39.433286+0000", 2024-09-13T06:39:49.212 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5087e-05 2024-09-13T06:39:49.212 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:49.212 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:49.212 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:39:49.212 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:39.433325+0000", 2024-09-13T06:39:49.212 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.8940000000000003e-05 2024-09-13T06:39:49.212 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:49.212 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:49.212 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:39:49.212 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:39.433349+0000", 2024-09-13T06:39:49.212 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.4059000000000001e-05 2024-09-13T06:39:49.213 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:49.213 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:49.213 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:39:49.213 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:39.433485+0000", 2024-09-13T06:39:49.213 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000135986 2024-09-13T06:39:49.213 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:49.213 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:49.213 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:39:49.213 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:39.433701+0000", 2024-09-13T06:39:49.213 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00021552799999999999 2024-09-13T06:39:49.213 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:49.213 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:49.213 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 7", 2024-09-13T06:39:49.213 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:39.433969+0000", 2024-09-13T06:39:49.214 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00026811499999999998 2024-09-13T06:39:49.214 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:49.214 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:49.214 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-13T06:39:49.214 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:39.435488+0000", 2024-09-13T06:39:49.214 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0015187550000000001 2024-09-13T06:39:49.214 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:49.214 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:49.214 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:39:49.214 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:39.438741+0000", 2024-09-13T06:39:49.214 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0032539510000000002 2024-09-13T06:39:49.215 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:49.215 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:49.215 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-13T06:39:49.215 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:39.438878+0000", 2024-09-13T06:39:49.215 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00013657200000000001 2024-09-13T06:39:49.215 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:49.215 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:49.215 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:39:49.215 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:39.438998+0000", 2024-09-13T06:39:49.215 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000120129 2024-09-13T06:39:49.215 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:49.215 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:39:49.216 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:49.216 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:49.216 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:39:49.216 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:39:49.217 INFO:teuthology.orchestra.run.smithi081.stdout:osd.3: {} 2024-09-13T06:39:49.217 INFO:teuthology.orchestra.run.smithi081.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-13T06:39:49.218 INFO:teuthology.orchestra.run.smithi081.stdout:osd.4: {} 2024-09-13T06:39:49.218 INFO:teuthology.orchestra.run.smithi081.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-13T06:39:49.218 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-13T06:39:49.220 INFO:teuthology.orchestra.run.smithi081.stdout:osd.5: {} 2024-09-13T06:39:49.220 INFO:teuthology.orchestra.run.smithi081.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-13T06:39:49.220 INFO:teuthology.orchestra.run.smithi081.stdout:osd.6: {} 2024-09-13T06:39:49.220 INFO:teuthology.orchestra.run.smithi081.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-13T06:39:49.221 INFO:teuthology.orchestra.run.smithi081.stdout:osd.7: {} 2024-09-13T06:39:49.222 INFO:teuthology.orchestra.run.smithi081.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-13T06:39:49.222 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:39:49.219+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:39:49.318 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-13T06:39:49.318+0000 7f86a5f06640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26387) UID: 0 2024-09-13T06:39:49.347 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:39:49.347 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:39:49.362 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-13T06:39:49.419 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:39:49.423+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:39:49.520 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:39:49.523+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:39:49.521 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:39:49.522 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:39:49.543 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-13T06:39:49.544 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-13T06:39:49.621 INFO:tasks.ceph.osd.6.smithi139.stderr:2024-09-13T06:39:49.622+0000 7fcd02c5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26385) UID: 0 2024-09-13T06:39:49.706 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:39:49.706 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:39:49.723 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:39:49.727+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:39:49.724 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-13T06:39:49.824 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:39:49.827+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:39:49.925 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:39:49.926+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:39:49.928 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:39:49.928 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:39:49.944 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-13T06:39:50.026 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:39:50.027+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:39:50.108 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:39:50.109 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:39:50.127 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-13T06:39:50.128 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:39:50.130+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:39:50.228 INFO:tasks.ceph.osd.6.smithi139.stderr:2024-09-13T06:39:50.230+0000 7fcd02c5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26385) UID: 0 2024-09-13T06:39:50.329 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-13T06:39:50.330+0000 7f86a5f06640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26387) UID: 0 2024-09-13T06:39:50.336 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:39:50.336 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:39:50.354 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-13T06:39:50.430 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:39:50.431+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:39:50.511 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:39:50.512 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:39:50.528 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-13T06:39:50.531 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:39:50.534+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:39:50.539 INFO:teuthology.orchestra.run.smithi081.stderr:noscrub is set 2024-09-13T06:39:50.632 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-13T06:39:50.634+0000 7f86a5f06640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26387) UID: 0 2024-09-13T06:39:50.674 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:39:50.674 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:39:50.688 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-13T06:39:50.735 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:39:50.739+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:39:50.803 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:39:50.803 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:39:50.818 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-13T06:39:50.859 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:39:50.863+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:39:50.935 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-13T06:39:50.934+0000 7f86a5f06640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26387) UID: 0 2024-09-13T06:39:50.981 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:39:50.982 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:39:50.994 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-13T06:39:51.036 INFO:tasks.ceph.osd.6.smithi139.stderr:2024-09-13T06:39:51.038+0000 7fcd02c5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26385) UID: 0 2024-09-13T06:39:51.131 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:39:51.131 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:39:51.136 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:39:51.139+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:39:51.146 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-13T06:39:51.223 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-13T06:39:51.279 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:39:51.283+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:39:51.327 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:39:51.327 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:39:51.338 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:39:51.339+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:39:51.347 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-13T06:39:51.404 INFO:teuthology.orchestra.run.smithi081.stdout:osd.0: {} 2024-09-13T06:39:51.404 INFO:teuthology.orchestra.run.smithi081.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-13T06:39:51.424 INFO:teuthology.orchestra.run.smithi081.stdout:osd.1: {} 2024-09-13T06:39:51.424 INFO:teuthology.orchestra.run.smithi081.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-13T06:39:51.438 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:39:51.438+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:39:51.448 INFO:teuthology.orchestra.run.smithi081.stdout:osd.2: {} 2024-09-13T06:39:51.449 INFO:teuthology.orchestra.run.smithi081.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-13T06:39:51.478 INFO:teuthology.orchestra.run.smithi081.stdout:osd.3: {} 2024-09-13T06:39:51.479 INFO:teuthology.orchestra.run.smithi081.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-13T06:39:51.502 INFO:teuthology.orchestra.run.smithi081.stdout:osd.4: {} 2024-09-13T06:39:51.503 INFO:teuthology.orchestra.run.smithi081.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-13T06:39:51.524 INFO:teuthology.orchestra.run.smithi081.stdout:osd.5: {} 2024-09-13T06:39:51.525 INFO:teuthology.orchestra.run.smithi081.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-13T06:39:51.539 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-13T06:39:51.542+0000 7f86a5f06640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26387) UID: 0 2024-09-13T06:39:51.549 INFO:teuthology.orchestra.run.smithi081.stdout:osd.6: {} 2024-09-13T06:39:51.549 INFO:teuthology.orchestra.run.smithi081.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-13T06:39:51.549 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:39:51.550 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-13T06:39:51.550 INFO:teuthology.orchestra.run.smithi081.stdout: "num_ops": 0 2024-09-13T06:39:51.550 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:39:51.567 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-13T06:39:51.576 INFO:teuthology.orchestra.run.smithi081.stdout:osd.7: {} 2024-09-13T06:39:51.577 INFO:teuthology.orchestra.run.smithi081.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-13T06:39:51.640 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-13T06:39:51.642+0000 7f86a5f06640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26387) UID: 0 2024-09-13T06:39:51.690 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:39:51.690 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-13T06:39:51.690 INFO:teuthology.orchestra.run.smithi081.stdout: "complaint_time": 30, 2024-09-13T06:39:51.690 INFO:teuthology.orchestra.run.smithi081.stdout: "num_blocked_ops": 0 2024-09-13T06:39:51.691 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:39:51.705 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-13T06:39:51.742 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:39:51.742+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:39:51.831 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:39:51.831 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 20, 2024-09-13T06:39:51.831 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 600, 2024-09-13T06:39:51.831 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [ 2024-09-13T06:39:51.832 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:51.832 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4385.0:2330 3.0 e31/21 3:07d66135:::rbd_object_map.11212429e5ad:head v 31'39, mlcod=31'37)", 2024-09-13T06:39:51.832 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:38.827721+0000", 2024-09-13T06:39:51.832 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 13.005024626000001, 2024-09-13T06:39:51.832 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.003728295, 2024-09-13T06:39:51.833 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:51.833 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:51.833 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:51.833 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:51.833 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:51.834 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.827721+0000", 2024-09-13T06:39:51.834 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:51.834 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:51.834 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:51.834 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:51.834 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.827721+0000", 2024-09-13T06:39:51.834 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:51.835 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:51.835 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:51.835 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:51.835 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.827718+0000", 2024-09-13T06:39:51.835 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999976 2024-09-13T06:39:51.835 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:51.835 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:51.835 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:51.835 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.827735+0000", 2024-09-13T06:39:51.836 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6515999999999999e-05 2024-09-13T06:39:51.836 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:51.836 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:51.836 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:51.836 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.827768+0000", 2024-09-13T06:39:51.836 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.3105999999999998e-05 2024-09-13T06:39:51.836 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:51.836 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:51.837 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:51.837 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.827788+0000", 2024-09-13T06:39:51.837 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0210000000000001e-05 2024-09-13T06:39:51.837 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:51.837 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:51.837 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:51.837 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.827855+0000", 2024-09-13T06:39:51.838 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.7046999999999997e-05 2024-09-13T06:39:51.838 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:51.838 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:51.838 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:51.838 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.827900+0000", 2024-09-13T06:39:51.838 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4415000000000001e-05 2024-09-13T06:39:51.839 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:51.839 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:51.839 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:39:51.839 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.831380+0000", 2024-09-13T06:39:51.839 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.003480187 2024-09-13T06:39:51.839 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:51.840 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:51.840 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:51.840 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.831449+0000", 2024-09-13T06:39:51.840 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.9070000000000001e-05 2024-09-13T06:39:51.840 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:51.840 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:51.840 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:51.840 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:51.840 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:51.840 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4385.0:2402 3.0 e31/21 3:07d66135:::rbd_object_map.11212429e5ad:head v 31'46, mlcod=31'43)", 2024-09-13T06:39:51.840 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:38.872174+0000", 2024-09-13T06:39:51.840 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 12.960571085, 2024-09-13T06:39:51.840 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0037101830000000001, 2024-09-13T06:39:51.841 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:51.841 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:51.841 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:51.841 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:51.841 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:51.841 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.872174+0000", 2024-09-13T06:39:51.841 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:51.841 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:51.841 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:51.841 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:51.841 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.872174+0000", 2024-09-13T06:39:51.841 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:51.841 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:51.842 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:51.842 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:51.842 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.872173+0000", 2024-09-13T06:39:51.842 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.999999 2024-09-13T06:39:51.842 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:51.842 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:51.842 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:51.842 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.872180+0000", 2024-09-13T06:39:51.842 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.4189999999999999e-06 2024-09-13T06:39:51.842 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:51.843 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:51.843 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:51.843 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.872193+0000", 2024-09-13T06:39:51.843 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.349e-05 2024-09-13T06:39:51.843 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:51.843 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:51.843 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:51.843 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.872201+0000", 2024-09-13T06:39:51.843 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.7000000000000008e-06 2024-09-13T06:39:51.843 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:51.843 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:51.843 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:51.843 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.872506+0000", 2024-09-13T06:39:51.844 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00030537300000000001 2024-09-13T06:39:51.844 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:51.844 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:51.844 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:51.844 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.872571+0000", 2024-09-13T06:39:51.844 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.4349000000000003e-05 2024-09-13T06:39:51.844 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:51.844 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:51.844 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:39:51.844 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.875823+0000", 2024-09-13T06:39:51.845 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0032527419999999999 2024-09-13T06:39:51.845 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:51.845 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:51.845 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:51.845 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.875884+0000", 2024-09-13T06:39:51.845 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0847999999999997e-05 2024-09-13T06:39:51.845 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:51.845 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:51.845 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:51.845 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:51.845 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:51.845 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4385.0:2403 3.0 e31/21 3:07d66135:::rbd_object_map.11212429e5ad:head v 31'47, mlcod=31'43)", 2024-09-13T06:39:51.845 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:38.873272+0000", 2024-09-13T06:39:51.846 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 12.95947323, 2024-09-13T06:39:51.846 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0059524080000000002, 2024-09-13T06:39:51.846 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:51.846 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:51.846 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:51.846 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:51.846 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:51.846 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.873272+0000", 2024-09-13T06:39:51.846 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:51.846 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:51.846 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:51.846 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:51.846 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.873272+0000", 2024-09-13T06:39:51.846 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:51.846 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:51.847 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:51.847 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:51.847 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.873271+0000", 2024-09-13T06:39:51.847 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:39:51.847 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:51.847 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:51.847 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:51.847 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.873277+0000", 2024-09-13T06:39:51.847 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.5999999999999997e-06 2024-09-13T06:39:51.847 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:51.847 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:51.847 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:51.847 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.873285+0000", 2024-09-13T06:39:51.847 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4680000000000003e-06 2024-09-13T06:39:51.848 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:51.848 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:51.848 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:51.848 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.873289+0000", 2024-09-13T06:39:51.848 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7670000000000003e-06 2024-09-13T06:39:51.848 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:51.848 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:51.848 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:51.848 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.873403+0000", 2024-09-13T06:39:51.848 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00011417300000000001 2024-09-13T06:39:51.848 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:51.849 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:51.849 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:51.849 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.873421+0000", 2024-09-13T06:39:51.849 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7278e-05 2024-09-13T06:39:51.849 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:51.849 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:51.849 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:39:51.849 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.879180+0000", 2024-09-13T06:39:51.849 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0057591379999999996 2024-09-13T06:39:51.849 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:51.849 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:51.849 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:51.849 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.879224+0000", 2024-09-13T06:39:51.850 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4558000000000003e-05 2024-09-13T06:39:51.850 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:51.850 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:51.850 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:51.850 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:51.850 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:51.851 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4385.0:2404 3.0 e31/21 3:07d66135:::rbd_object_map.11212429e5ad:head v 31'48, mlcod=31'43)", 2024-09-13T06:39:51.851 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:38.874266+0000", 2024-09-13T06:39:51.851 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 12.958479473000001, 2024-09-13T06:39:51.851 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0049906389999999998, 2024-09-13T06:39:51.851 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:51.851 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:51.851 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:51.851 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:51.851 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:51.852 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.874266+0000", 2024-09-13T06:39:51.852 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:51.852 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:51.852 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:51.852 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:51.852 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.874266+0000", 2024-09-13T06:39:51.852 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:51.852 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:51.852 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:51.852 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:51.852 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.874265+0000", 2024-09-13T06:39:51.852 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.999999 2024-09-13T06:39:51.852 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:51.853 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:51.853 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:51.853 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.874281+0000", 2024-09-13T06:39:51.853 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5763000000000001e-05 2024-09-13T06:39:51.853 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:51.853 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:51.853 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:51.853 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.874294+0000", 2024-09-13T06:39:51.853 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2826000000000001e-05 2024-09-13T06:39:51.853 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:51.853 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:51.853 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:51.853 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.874300+0000", 2024-09-13T06:39:51.854 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.6769999999999998e-06 2024-09-13T06:39:51.854 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:51.854 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:51.854 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:51.854 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.874390+0000", 2024-09-13T06:39:51.854 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.0129000000000004e-05 2024-09-13T06:39:51.854 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:51.854 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:51.854 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:51.854 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.874450+0000", 2024-09-13T06:39:51.854 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9512999999999998e-05 2024-09-13T06:39:51.854 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:51.854 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:51.854 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:39:51.855 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.879227+0000", 2024-09-13T06:39:51.855 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0047773329999999999 2024-09-13T06:39:51.855 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:51.855 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:51.855 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:51.855 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.879256+0000", 2024-09-13T06:39:51.855 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9173e-05 2024-09-13T06:39:51.855 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:51.855 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:51.855 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:51.855 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:51.855 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:51.855 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4385.0:2405 3.0 e31/21 3:07d66135:::rbd_object_map.11212429e5ad:head v 31'49, mlcod=31'43)", 2024-09-13T06:39:51.855 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:38.875324+0000", 2024-09-13T06:39:51.856 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 12.957421624, 2024-09-13T06:39:51.856 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0039619570000000003, 2024-09-13T06:39:51.856 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:51.856 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:51.856 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:51.856 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:51.856 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:51.856 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.875324+0000", 2024-09-13T06:39:51.856 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:51.856 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:51.856 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:51.856 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:51.857 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.875324+0000", 2024-09-13T06:39:51.857 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:51.857 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:51.857 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:51.857 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:51.857 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.875323+0000", 2024-09-13T06:39:51.857 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.999999 2024-09-13T06:39:51.857 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:51.857 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:51.857 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:51.857 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.875329+0000", 2024-09-13T06:39:51.857 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.1689999999999997e-06 2024-09-13T06:39:51.857 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:51.857 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:51.858 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:51.858 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.875340+0000", 2024-09-13T06:39:51.858 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1065e-05 2024-09-13T06:39:51.858 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:51.858 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:51.858 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:51.858 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.875347+0000", 2024-09-13T06:39:51.858 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.674e-06 2024-09-13T06:39:51.858 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:51.858 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:51.858 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:51.858 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.875396+0000", 2024-09-13T06:39:51.858 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9094000000000001e-05 2024-09-13T06:39:51.858 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:51.859 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:51.859 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:51.859 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.875420+0000", 2024-09-13T06:39:51.859 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4199999999999999e-05 2024-09-13T06:39:51.859 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:51.859 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:51.859 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:39:51.859 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.879258+0000", 2024-09-13T06:39:51.859 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0038376930000000001 2024-09-13T06:39:51.859 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:51.859 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:51.859 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:51.859 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.879286+0000", 2024-09-13T06:39:51.859 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.7880000000000001e-05 2024-09-13T06:39:51.860 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:51.860 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:51.860 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:51.860 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:51.860 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:51.860 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4385.0:2407 3.0 e31/21 3:07d66135:::rbd_object_map.11212429e5ad:head v 31'51, mlcod=31'44)", 2024-09-13T06:39:51.860 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:38.878449+0000", 2024-09-13T06:39:51.860 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 12.954296600999999, 2024-09-13T06:39:51.860 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0036754119999999999, 2024-09-13T06:39:51.860 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:51.860 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:51.860 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:51.860 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:51.861 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:51.861 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.878449+0000", 2024-09-13T06:39:51.861 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:51.861 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:51.861 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:51.861 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:51.861 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.878449+0000", 2024-09-13T06:39:51.861 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:51.861 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:51.862 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:51.862 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:51.862 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.878447+0000", 2024-09-13T06:39:51.862 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999981 2024-09-13T06:39:51.862 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:51.862 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:51.862 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:51.862 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.878462+0000", 2024-09-13T06:39:51.862 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5133000000000001e-05 2024-09-13T06:39:51.862 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:51.862 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:51.862 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:51.862 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.878500+0000", 2024-09-13T06:39:51.862 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.8213999999999997e-05 2024-09-13T06:39:51.863 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:51.863 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:51.863 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:51.863 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.878520+0000", 2024-09-13T06:39:51.863 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0000000000000002e-05 2024-09-13T06:39:51.863 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:51.863 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:51.863 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:51.863 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.878710+0000", 2024-09-13T06:39:51.863 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00019008100000000001 2024-09-13T06:39:51.863 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:51.863 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:51.863 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:51.863 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.878745+0000", 2024-09-13T06:39:51.864 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.4533000000000003e-05 2024-09-13T06:39:51.864 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:51.864 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:51.864 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:39:51.864 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.882086+0000", 2024-09-13T06:39:51.864 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0033416409999999998 2024-09-13T06:39:51.864 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:51.864 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:51.864 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:51.864 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.882124+0000", 2024-09-13T06:39:51.864 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.7673000000000003e-05 2024-09-13T06:39:51.864 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:51.864 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:51.864 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:51.865 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:51.865 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:51.865 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4385.0:2408 3.0 e31/21 3:07d66135:::rbd_object_map.11212429e5ad:head v 31'52, mlcod=31'45)", 2024-09-13T06:39:51.865 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:38.880785+0000", 2024-09-13T06:39:51.865 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 12.951960443000001, 2024-09-13T06:39:51.865 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.004103382, 2024-09-13T06:39:51.865 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:51.865 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:51.865 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:51.865 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:51.865 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:51.865 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.880785+0000", 2024-09-13T06:39:51.865 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:51.866 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:51.866 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:51.866 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:51.866 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.880785+0000", 2024-09-13T06:39:51.866 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:51.866 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:51.866 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:51.866 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:51.866 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.880784+0000", 2024-09-13T06:39:51.866 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.999999 2024-09-13T06:39:51.866 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:51.867 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:51.867 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:51.867 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.880793+0000", 2024-09-13T06:39:51.867 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.8990000000000007e-06 2024-09-13T06:39:51.867 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:51.867 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:51.867 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:51.867 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.880806+0000", 2024-09-13T06:39:51.867 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3597999999999999e-05 2024-09-13T06:39:51.867 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:51.867 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:51.867 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:51.867 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.880813+0000", 2024-09-13T06:39:51.868 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.6789999999999999e-06 2024-09-13T06:39:51.868 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:51.868 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:51.868 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:51.868 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.880918+0000", 2024-09-13T06:39:51.868 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000105256 2024-09-13T06:39:51.868 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:51.868 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:51.868 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:51.868 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.880977+0000", 2024-09-13T06:39:51.868 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8310000000000002e-05 2024-09-13T06:39:51.868 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:51.868 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:51.869 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:39:51.869 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.884849+0000", 2024-09-13T06:39:51.869 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.003872693 2024-09-13T06:39:51.869 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:51.869 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:51.869 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:51.869 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.884888+0000", 2024-09-13T06:39:51.869 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.8955999999999998e-05 2024-09-13T06:39:51.869 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:51.869 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:51.869 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:51.869 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:51.870 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:51.870 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4385.0:2409 3.0 e31/21 3:07d66135:::rbd_object_map.11212429e5ad:head v 31'53, mlcod=31'45)", 2024-09-13T06:39:51.870 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:38.882957+0000", 2024-09-13T06:39:51.870 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 12.94978804, 2024-09-13T06:39:51.870 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0049287489999999996, 2024-09-13T06:39:51.870 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:51.870 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:51.870 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:51.870 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:51.870 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:51.871 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.882957+0000", 2024-09-13T06:39:51.871 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:51.871 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:51.871 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:51.871 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:51.871 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.882957+0000", 2024-09-13T06:39:51.871 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:51.871 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:51.871 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:51.871 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:51.871 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.882956+0000", 2024-09-13T06:39:51.871 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.999999 2024-09-13T06:39:51.871 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:51.872 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:51.872 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:51.872 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.882963+0000", 2024-09-13T06:39:51.872 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.8680000000000001e-06 2024-09-13T06:39:51.872 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:51.872 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:51.872 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:51.872 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.882975+0000", 2024-09-13T06:39:51.872 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1766000000000001e-05 2024-09-13T06:39:51.872 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:51.872 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:51.872 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:51.873 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.882981+0000", 2024-09-13T06:39:51.873 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3559999999999998e-06 2024-09-13T06:39:51.873 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:51.873 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:51.873 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:51.873 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.883029+0000", 2024-09-13T06:39:51.873 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7839000000000001e-05 2024-09-13T06:39:51.873 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:51.873 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:51.873 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:51.873 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.883047+0000", 2024-09-13T06:39:51.874 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8134e-05 2024-09-13T06:39:51.874 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:51.874 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:51.874 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:39:51.874 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.887832+0000", 2024-09-13T06:39:51.874 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0047848839999999997 2024-09-13T06:39:51.874 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:51.874 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:51.874 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:51.874 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.887886+0000", 2024-09-13T06:39:51.875 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3702999999999997e-05 2024-09-13T06:39:51.875 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:51.875 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:51.875 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:51.875 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:51.875 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:51.875 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4385.0:2410 3.0 e31/21 3:07d66135:::rbd_object_map.11212429e5ad:head v 31'54, mlcod=31'45)", 2024-09-13T06:39:51.875 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:38.885943+0000", 2024-09-13T06:39:51.875 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 12.94680219, 2024-09-13T06:39:51.875 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0051076330000000003, 2024-09-13T06:39:51.875 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:51.875 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:51.875 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:51.875 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:51.876 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:51.876 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.885943+0000", 2024-09-13T06:39:51.876 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:51.876 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:51.876 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:51.876 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:51.876 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.885943+0000", 2024-09-13T06:39:51.876 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:51.876 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:51.876 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:51.876 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:51.876 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.885942+0000", 2024-09-13T06:39:51.876 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.999999 2024-09-13T06:39:51.877 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:51.877 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:51.877 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:51.877 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.885949+0000", 2024-09-13T06:39:51.877 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.2679999999999997e-06 2024-09-13T06:39:51.877 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:51.877 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:51.877 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:51.877 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.885961+0000", 2024-09-13T06:39:51.877 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1737e-05 2024-09-13T06:39:51.877 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:51.877 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:51.877 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:51.878 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.885967+0000", 2024-09-13T06:39:51.878 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0920000000000003e-06 2024-09-13T06:39:51.878 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:51.878 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:51.878 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:51.878 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.886019+0000", 2024-09-13T06:39:51.878 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.1669000000000003e-05 2024-09-13T06:39:51.878 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:51.878 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:51.878 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:51.878 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.886035+0000", 2024-09-13T06:39:51.878 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6192e-05 2024-09-13T06:39:51.878 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:51.879 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:51.879 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:39:51.879 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.890999+0000", 2024-09-13T06:39:51.879 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0049638440000000002 2024-09-13T06:39:51.879 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:51.879 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:51.879 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:51.879 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.891051+0000", 2024-09-13T06:39:51.879 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.1700999999999998e-05 2024-09-13T06:39:51.879 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:51.879 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:51.879 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:51.879 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:51.879 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:51.880 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4385.0:2411 3.0 e31/21 3:07d66135:::rbd_object_map.11212429e5ad:head v 31'55, mlcod=31'45)", 2024-09-13T06:39:51.880 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:38.887273+0000", 2024-09-13T06:39:51.880 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 12.945471911, 2024-09-13T06:39:51.880 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0058469940000000003, 2024-09-13T06:39:51.880 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:51.880 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:51.880 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:51.880 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:51.880 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:51.880 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.887273+0000", 2024-09-13T06:39:51.880 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:51.880 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:51.881 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:51.881 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:51.881 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.887273+0000", 2024-09-13T06:39:51.881 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:51.881 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:51.881 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:51.881 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:51.881 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.887272+0000", 2024-09-13T06:39:51.881 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.999999 2024-09-13T06:39:51.881 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:51.881 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:51.881 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:51.881 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.887280+0000", 2024-09-13T06:39:51.882 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.9060000000000002e-06 2024-09-13T06:39:51.882 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:51.882 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:51.882 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:51.882 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.887297+0000", 2024-09-13T06:39:51.882 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6577000000000001e-05 2024-09-13T06:39:51.882 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:51.882 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:51.882 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:51.882 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.887306+0000", 2024-09-13T06:39:51.882 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.9579999999999996e-06 2024-09-13T06:39:51.882 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:51.882 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:51.883 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:51.883 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.887353+0000", 2024-09-13T06:39:51.883 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7320000000000001e-05 2024-09-13T06:39:51.883 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:51.883 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:51.883 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:51.883 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.887374+0000", 2024-09-13T06:39:51.883 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0984000000000001e-05 2024-09-13T06:39:51.883 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:51.883 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:51.884 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:39:51.884 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.893037+0000", 2024-09-13T06:39:51.884 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0056629380000000002 2024-09-13T06:39:51.884 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:51.884 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:51.884 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:51.884 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.893120+0000", 2024-09-13T06:39:51.884 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.3282000000000007e-05 2024-09-13T06:39:51.884 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:51.885 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:51.885 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:51.885 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:51.885 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:51.885 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4385.0:2412 3.0 e31/21 3:07d66135:::rbd_object_map.11212429e5ad:head v 31'56, mlcod=31'48)", 2024-09-13T06:39:51.885 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:38.888795+0000", 2024-09-13T06:39:51.885 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 12.943950355, 2024-09-13T06:39:51.885 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0043887409999999998, 2024-09-13T06:39:51.885 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:51.885 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:51.885 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:51.885 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:51.885 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:51.886 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.888795+0000", 2024-09-13T06:39:51.886 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:51.886 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:51.886 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:51.886 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:51.886 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.888795+0000", 2024-09-13T06:39:51.886 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:51.886 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:51.886 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:51.886 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:51.886 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.888794+0000", 2024-09-13T06:39:51.886 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.999999 2024-09-13T06:39:51.886 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:51.887 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:51.887 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:51.887 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.888803+0000", 2024-09-13T06:39:51.887 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.7139999999999999e-06 2024-09-13T06:39:51.887 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:51.887 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:51.887 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:51.887 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.888820+0000", 2024-09-13T06:39:51.887 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7555999999999999e-05 2024-09-13T06:39:51.887 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:51.887 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:51.887 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:51.887 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.888828+0000", 2024-09-13T06:39:51.887 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.153e-06 2024-09-13T06:39:51.888 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:51.888 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:51.888 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:51.888 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.888897+0000", 2024-09-13T06:39:51.888 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.9805e-05 2024-09-13T06:39:51.888 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:51.888 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:51.888 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:51.888 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.888928+0000", 2024-09-13T06:39:51.888 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.0633000000000003e-05 2024-09-13T06:39:51.888 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:51.888 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:51.889 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:39:51.889 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.893124+0000", 2024-09-13T06:39:51.889 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0041962079999999999 2024-09-13T06:39:51.889 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:51.889 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:51.889 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:51.889 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.893184+0000", 2024-09-13T06:39:51.889 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9456000000000001e-05 2024-09-13T06:39:51.889 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:51.889 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:51.889 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:51.889 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:51.889 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:51.890 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4385.0:2413 3.0 e31/21 3:07d66135:::rbd_object_map.11212429e5ad:head v 31'57, mlcod=31'51)", 2024-09-13T06:39:51.890 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:38.890237+0000", 2024-09-13T06:39:51.890 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 12.942508154, 2024-09-13T06:39:51.890 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0034719220000000001, 2024-09-13T06:39:51.890 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:51.890 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:51.890 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:51.890 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:51.890 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:51.890 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.890237+0000", 2024-09-13T06:39:51.890 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:51.890 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:51.890 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:51.890 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:51.891 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.890237+0000", 2024-09-13T06:39:51.891 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:51.891 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:51.891 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:51.891 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:51.891 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.890236+0000", 2024-09-13T06:39:51.891 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.999999 2024-09-13T06:39:51.891 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:51.891 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:51.891 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:51.891 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.890243+0000", 2024-09-13T06:39:51.891 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.9630000000000001e-06 2024-09-13T06:39:51.891 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:51.891 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:51.892 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:51.892 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.890258+0000", 2024-09-13T06:39:51.892 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4321999999999999e-05 2024-09-13T06:39:51.892 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:51.892 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:51.892 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:51.892 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.890265+0000", 2024-09-13T06:39:51.892 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3000000000000004e-06 2024-09-13T06:39:51.892 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:51.892 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:51.892 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:51.892 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.890389+0000", 2024-09-13T06:39:51.893 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00012409899999999999 2024-09-13T06:39:51.893 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:51.893 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:51.893 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:51.893 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.890420+0000", 2024-09-13T06:39:51.893 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.1090000000000002e-05 2024-09-13T06:39:51.893 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:51.893 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:51.893 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:39:51.893 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.893629+0000", 2024-09-13T06:39:51.893 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0032087690000000002 2024-09-13T06:39:51.893 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:51.894 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:51.894 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:51.894 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.893709+0000", 2024-09-13T06:39:51.894 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.0226000000000001e-05 2024-09-13T06:39:51.894 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:51.894 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:51.894 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:51.894 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:51.894 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:51.894 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "pg_update_log_missing(3.4 epoch 31/21 rep_tid 67 entries 31'2 (0'0) error 3:27e7ab05:::rbd_data.11212429e5ad.0000000000000022:head by client.4385.0:2421 0.000000 0 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-09-13T06:39:51.894 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:38.890280+0000", 2024-09-13T06:39:51.894 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 12.942464863, 2024-09-13T06:39:51.895 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0033244350000000002, 2024-09-13T06:39:51.895 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:51.895 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:39:51.895 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:51.895 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:51.895 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:51.896 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.890280+0000", 2024-09-13T06:39:51.896 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:51.896 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:51.896 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:51.896 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:51.896 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.890280+0000", 2024-09-13T06:39:51.896 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:51.896 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:51.896 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:51.896 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:51.896 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.890280+0000", 2024-09-13T06:39:51.897 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:39:51.897 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:51.897 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:51.897 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:51.897 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.890287+0000", 2024-09-13T06:39:51.897 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.148e-06 2024-09-13T06:39:51.897 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:51.897 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:51.897 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:51.897 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.890302+0000", 2024-09-13T06:39:51.897 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.435e-05 2024-09-13T06:39:51.897 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:51.897 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:51.898 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:51.898 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.890312+0000", 2024-09-13T06:39:51.898 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0662999999999999e-05 2024-09-13T06:39:51.898 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:51.898 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:51.898 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:51.898 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.890428+0000", 2024-09-13T06:39:51.898 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000115505 2024-09-13T06:39:51.898 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:51.898 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:51.898 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:51.898 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.893605+0000", 2024-09-13T06:39:51.898 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.003177119 2024-09-13T06:39:51.899 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:51.899 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:51.899 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:51.899 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:51.899 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:51.899 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4385.0:2432 3.0 e31/21 3:07d66135:::rbd_object_map.11212429e5ad:head v 31'62, mlcod=31'58)", 2024-09-13T06:39:51.899 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:38.900535+0000", 2024-09-13T06:39:51.899 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 12.932210133, 2024-09-13T06:39:51.899 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0036949130000000002, 2024-09-13T06:39:51.899 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:51.899 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:51.899 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:51.899 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:51.900 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:51.900 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.900535+0000", 2024-09-13T06:39:51.900 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:51.900 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:51.900 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:51.900 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:51.900 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.900535+0000", 2024-09-13T06:39:51.900 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:51.900 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:51.900 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:51.901 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:51.901 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.900535+0000", 2024-09-13T06:39:51.901 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:39:51.901 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:51.901 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:51.901 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:51.901 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.900541+0000", 2024-09-13T06:39:51.901 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.4169999999999997e-06 2024-09-13T06:39:51.901 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:51.901 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:51.901 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:51.901 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.900553+0000", 2024-09-13T06:39:51.901 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2354000000000001e-05 2024-09-13T06:39:51.902 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:51.902 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:51.902 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:51.902 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.900560+0000", 2024-09-13T06:39:51.902 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.8990000000000004e-06 2024-09-13T06:39:51.902 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:51.902 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:51.902 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:51.902 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.900621+0000", 2024-09-13T06:39:51.902 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0699000000000003e-05 2024-09-13T06:39:51.902 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:51.902 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:51.902 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:51.902 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.900660+0000", 2024-09-13T06:39:51.903 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.8609999999999998e-05 2024-09-13T06:39:51.903 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:51.903 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:51.903 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:39:51.903 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.904177+0000", 2024-09-13T06:39:51.903 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0035175509999999998 2024-09-13T06:39:51.903 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:51.903 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:51.903 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:51.903 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.904230+0000", 2024-09-13T06:39:51.903 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2966000000000001e-05 2024-09-13T06:39:51.903 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:51.903 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:51.904 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:51.904 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:51.904 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:51.904 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4385.0:2433 3.0 e31/21 3:07d66135:::rbd_object_map.11212429e5ad:head v 31'63, mlcod=31'58)", 2024-09-13T06:39:51.904 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:38.901375+0000", 2024-09-13T06:39:51.904 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 12.931370722, 2024-09-13T06:39:51.904 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.005560738, 2024-09-13T06:39:51.904 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:51.904 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:51.904 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:51.904 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:51.904 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:51.904 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.901375+0000", 2024-09-13T06:39:51.905 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:51.905 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:51.905 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:51.905 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:51.905 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.901375+0000", 2024-09-13T06:39:51.905 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:51.905 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:51.905 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:51.905 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:51.905 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.901374+0000", 2024-09-13T06:39:51.905 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.999999 2024-09-13T06:39:51.905 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:51.905 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:51.906 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:51.906 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.901381+0000", 2024-09-13T06:39:51.906 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.1019999999999999e-06 2024-09-13T06:39:51.906 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:51.906 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:51.906 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:51.907 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.901394+0000", 2024-09-13T06:39:51.907 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2782999999999999e-05 2024-09-13T06:39:51.907 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:51.907 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:51.907 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:51.907 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.901400+0000", 2024-09-13T06:39:51.908 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.8449999999999997e-06 2024-09-13T06:39:51.908 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:51.908 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:51.908 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:51.908 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.901483+0000", 2024-09-13T06:39:51.908 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.2841000000000002e-05 2024-09-13T06:39:51.909 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:51.909 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:51.909 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:51.909 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.901513+0000", 2024-09-13T06:39:51.909 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.0102000000000001e-05 2024-09-13T06:39:51.909 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:51.909 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:51.910 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:39:51.910 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.906853+0000", 2024-09-13T06:39:51.910 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.005339402 2024-09-13T06:39:51.910 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:51.910 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:51.910 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:51.911 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.906935+0000", 2024-09-13T06:39:51.911 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.2488e-05 2024-09-13T06:39:51.911 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:51.911 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:51.911 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:51.911 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:51.912 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:51.912 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4385.0:2434 3.0 e31/21 3:07d66135:::rbd_object_map.11212429e5ad:head v 31'64, mlcod=31'58)", 2024-09-13T06:39:51.912 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:38.902253+0000", 2024-09-13T06:39:51.912 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 12.930492136, 2024-09-13T06:39:51.912 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0047392650000000003, 2024-09-13T06:39:51.912 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:51.913 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:51.913 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:51.913 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:51.913 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:51.913 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.902253+0000", 2024-09-13T06:39:51.914 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:51.914 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:51.914 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:51.914 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:51.914 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.902253+0000", 2024-09-13T06:39:51.914 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:51.914 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:51.915 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:51.915 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:51.915 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.902252+0000", 2024-09-13T06:39:51.915 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.999999 2024-09-13T06:39:51.915 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:51.915 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:51.915 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:51.916 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.902259+0000", 2024-09-13T06:39:51.916 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.9709999999999998e-06 2024-09-13T06:39:51.916 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:51.916 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:51.916 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:51.916 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.902273+0000", 2024-09-13T06:39:51.916 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3302000000000001e-05 2024-09-13T06:39:51.917 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:51.917 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:51.917 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:51.917 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.902280+0000", 2024-09-13T06:39:51.917 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.126e-06 2024-09-13T06:39:51.917 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:51.918 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:51.918 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:51.918 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.902334+0000", 2024-09-13T06:39:51.918 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.4512000000000003e-05 2024-09-13T06:39:51.918 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:51.919 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:51.919 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:51.919 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.902363+0000", 2024-09-13T06:39:51.919 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.8544e-05 2024-09-13T06:39:51.919 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:51.919 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:51.920 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:39:51.920 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.906941+0000", 2024-09-13T06:39:51.920 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0045781320000000004 2024-09-13T06:39:51.920 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:51.920 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:51.920 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:51.920 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.906992+0000", 2024-09-13T06:39:51.920 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.1533000000000003e-05 2024-09-13T06:39:51.921 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:51.921 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:51.921 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:51.921 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:51.921 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:51.921 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4385.0:2607 3.4 e31/21 3:26a6dcab:::rbd_data.11212429e5ad.0000000000000357:head v 31'5, mlcod=31'3)", 2024-09-13T06:39:51.921 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:39.238869+0000", 2024-09-13T06:39:51.922 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 12.593876645, 2024-09-13T06:39:51.922 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0033590059999999999, 2024-09-13T06:39:51.922 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:51.922 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:51.922 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:51.922 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:51.922 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:51.923 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.238869+0000", 2024-09-13T06:39:51.923 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:51.923 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:51.923 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:51.923 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:51.923 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.238869+0000", 2024-09-13T06:39:51.923 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:51.924 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:51.924 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:51.924 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:51.924 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.238867+0000", 2024-09-13T06:39:51.924 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999981 2024-09-13T06:39:51.924 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:51.925 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:51.925 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:51.925 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.238882+0000", 2024-09-13T06:39:51.925 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5226e-05 2024-09-13T06:39:51.925 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:51.925 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:51.925 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:51.925 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.238976+0000", 2024-09-13T06:39:51.926 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.4423e-05 2024-09-13T06:39:51.926 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:51.926 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:51.926 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:51.926 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.238995+0000", 2024-09-13T06:39:51.926 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9066e-05 2024-09-13T06:39:51.926 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:51.926 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:51.926 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:51.926 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.239059+0000", 2024-09-13T06:39:51.926 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3744999999999994e-05 2024-09-13T06:39:51.926 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:51.926 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:51.927 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:51.927 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.239082+0000", 2024-09-13T06:39:51.927 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2405999999999999e-05 2024-09-13T06:39:51.927 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:51.927 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:51.927 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:39:51.927 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.242184+0000", 2024-09-13T06:39:51.927 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0031028850000000001 2024-09-13T06:39:51.927 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:51.927 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:51.928 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:51.928 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.242228+0000", 2024-09-13T06:39:51.928 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.3155000000000003e-05 2024-09-13T06:39:51.928 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:51.928 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:51.928 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:51.928 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:51.928 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:51.929 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4385.0:2610 3.0 e31/21 3:05b06d2f:::rbd_data.11212429e5ad.0000000000000367:head v 31'112, mlcod=31'110)", 2024-09-13T06:39:51.929 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:39.239230+0000", 2024-09-13T06:39:51.929 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 12.593515361, 2024-09-13T06:39:51.929 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0036041720000000001, 2024-09-13T06:39:51.929 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:51.929 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:51.929 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:51.929 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:51.929 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:51.929 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.239230+0000", 2024-09-13T06:39:51.929 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:51.929 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:51.929 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:51.930 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:51.930 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.239230+0000", 2024-09-13T06:39:51.930 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:51.930 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:51.930 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:51.930 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:51.930 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.239229+0000", 2024-09-13T06:39:51.930 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.999999 2024-09-13T06:39:51.930 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:51.930 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:51.930 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:51.930 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.239238+0000", 2024-09-13T06:39:51.930 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.2529999999999993e-06 2024-09-13T06:39:51.930 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:51.931 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:51.931 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:51.931 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.240075+0000", 2024-09-13T06:39:51.931 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00083642899999999997 2024-09-13T06:39:51.931 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:51.931 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:51.931 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:51.931 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.240084+0000", 2024-09-13T06:39:51.931 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.3160000000000003e-06 2024-09-13T06:39:51.931 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:51.931 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:51.931 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:51.931 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.240173+0000", 2024-09-13T06:39:51.931 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.9536999999999993e-05 2024-09-13T06:39:51.932 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:51.932 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:51.932 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:51.932 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.240192+0000", 2024-09-13T06:39:51.932 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8547999999999999e-05 2024-09-13T06:39:51.932 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:51.932 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:51.932 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:39:51.932 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.242758+0000", 2024-09-13T06:39:51.932 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.002565936 2024-09-13T06:39:51.932 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:51.932 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:51.932 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:51.933 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.242834+0000", 2024-09-13T06:39:51.933 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.6198999999999993e-05 2024-09-13T06:39:51.933 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:51.933 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:51.933 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:51.933 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:51.933 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:51.933 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4385.0:2665 3.0 e31/21 3:07d66135:::rbd_object_map.11212429e5ad:head v 31'127, mlcod=31'125)", 2024-09-13T06:39:51.933 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:39.384538+0000", 2024-09-13T06:39:51.933 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 12.448207069, 2024-09-13T06:39:51.933 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00349468, 2024-09-13T06:39:51.933 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:51.934 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:51.934 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:51.934 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:51.934 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:51.934 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.384538+0000", 2024-09-13T06:39:51.934 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:51.934 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:51.934 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:51.934 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:51.934 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.384538+0000", 2024-09-13T06:39:51.934 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:51.934 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:51.935 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:51.935 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:51.935 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.384537+0000", 2024-09-13T06:39:51.935 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999986 2024-09-13T06:39:51.935 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:51.935 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:51.935 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:51.935 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.384548+0000", 2024-09-13T06:39:51.935 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1542999999999999e-05 2024-09-13T06:39:51.935 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:51.935 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:51.935 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:51.936 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.384571+0000", 2024-09-13T06:39:51.936 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2317e-05 2024-09-13T06:39:51.936 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:51.936 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:51.936 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:51.936 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.384579+0000", 2024-09-13T06:39:51.937 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.3140000000000004e-06 2024-09-13T06:39:51.937 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:51.937 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:51.937 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:51.937 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.384634+0000", 2024-09-13T06:39:51.937 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.5451999999999997e-05 2024-09-13T06:39:51.937 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:51.937 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:51.937 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:51.937 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.384663+0000", 2024-09-13T06:39:51.937 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.8419999999999999e-05 2024-09-13T06:39:51.937 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:51.938 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:51.938 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:39:51.938 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.387993+0000", 2024-09-13T06:39:51.938 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0033301630000000001 2024-09-13T06:39:51.938 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:51.938 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:51.938 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:51.938 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.388033+0000", 2024-09-13T06:39:51.938 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.9818999999999999e-05 2024-09-13T06:39:51.938 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:51.938 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:51.938 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:51.938 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:51.938 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:51.939 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4385.0:4997 3.9 e38/21 3:904af028:::rbd_data.112150cd58e1.0000000000000008:head v 38'98, mlcod=38'95)", 2024-09-13T06:39:51.939 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:46.743130+0000", 2024-09-13T06:39:51.939 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 5.0896149729999998, 2024-09-13T06:39:51.939 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0049048570000000003, 2024-09-13T06:39:51.939 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:51.939 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:51.939 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:51.939 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:51.939 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:51.939 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:46.743130+0000", 2024-09-13T06:39:51.939 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:51.939 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:51.939 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:51.939 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:51.940 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:46.743130+0000", 2024-09-13T06:39:51.940 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:51.940 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:51.940 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:51.940 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:51.940 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:46.743129+0000", 2024-09-13T06:39:51.940 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.999999 2024-09-13T06:39:51.940 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:51.940 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:51.940 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:51.940 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:46.743138+0000", 2024-09-13T06:39:51.941 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.6519999999999995e-06 2024-09-13T06:39:51.941 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:51.941 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:51.941 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:51.941 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:46.743152+0000", 2024-09-13T06:39:51.941 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3757999999999999e-05 2024-09-13T06:39:51.941 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:51.941 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:51.941 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:51.941 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:46.743160+0000", 2024-09-13T06:39:51.941 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.5550000000000003e-06 2024-09-13T06:39:51.941 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:51.941 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:51.942 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:51.942 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:46.743208+0000", 2024-09-13T06:39:51.942 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7348999999999997e-05 2024-09-13T06:39:51.942 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:51.942 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:51.942 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:51.942 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:46.743233+0000", 2024-09-13T06:39:51.942 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5058e-05 2024-09-13T06:39:51.942 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:51.942 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:51.942 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:39:51.942 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:46.747999+0000", 2024-09-13T06:39:51.942 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0047658680000000004 2024-09-13T06:39:51.943 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:51.943 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:51.943 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:51.943 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:46.748035+0000", 2024-09-13T06:39:51.943 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.6421000000000002e-05 2024-09-13T06:39:51.943 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:51.943 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:51.943 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:51.943 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:51.943 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:51.943 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:39:51.945 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-13T06:39:51.945 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:39:51.947+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:39:52.046 INFO:tasks.ceph.osd.6.smithi139.stderr:2024-09-13T06:39:52.046+0000 7fcd02c5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26385) UID: 0 2024-09-13T06:39:52.121 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:39:52.121 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-13T06:39:52.121 INFO:teuthology.orchestra.run.smithi081.stdout: "num_ops": 0 2024-09-13T06:39:52.122 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:39:52.137 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-13T06:39:52.183 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:39:52.187+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:39:52.247 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:39:52.251+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:39:52.265 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:39:52.265 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-13T06:39:52.265 INFO:teuthology.orchestra.run.smithi081.stdout: "complaint_time": 30, 2024-09-13T06:39:52.266 INFO:teuthology.orchestra.run.smithi081.stdout: "num_blocked_ops": 0 2024-09-13T06:39:52.266 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:39:52.279 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-13T06:39:52.348 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:39:52.350+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:39:52.449 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:39:52.451+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:39:52.456 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:39:52.456 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 20, 2024-09-13T06:39:52.456 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 600, 2024-09-13T06:39:52.456 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [ 2024-09-13T06:39:52.456 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:52.456 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:2226 3.15 3:af026987:::rbd_data.112173e2f1b7.0000000000000017:head [sparse-read 0~4194304] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-13T06:39:52.456 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:37.606562+0000", 2024-09-13T06:39:52.456 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 14.853148504, 2024-09-13T06:39:52.457 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.83322091700000001, 2024-09-13T06:39:52.457 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:52.457 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:39:52.457 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:39:52.457 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:39:52.457 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:52.457 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 2226 2024-09-13T06:39:52.457 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:52.457 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:52.458 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:52.458 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:52.458 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606562+0000", 2024-09-13T06:39:52.458 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:52.458 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:52.458 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:52.458 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:52.458 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606562+0000", 2024-09-13T06:39:52.458 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:52.458 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:52.458 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:52.459 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:52.459 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606561+0000", 2024-09-13T06:39:52.459 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:39:52.459 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:52.459 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:52.459 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:52.459 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606565+0000", 2024-09-13T06:39:52.459 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.4379999999999999e-06 2024-09-13T06:39:52.460 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:52.460 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:52.460 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:52.460 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606569+0000", 2024-09-13T06:39:52.460 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.425e-06 2024-09-13T06:39:52.460 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:52.460 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:52.460 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:52.460 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606572+0000", 2024-09-13T06:39:52.460 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.05e-06 2024-09-13T06:39:52.460 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:52.460 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:52.460 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:52.461 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606621+0000", 2024-09-13T06:39:52.461 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.8723000000000001e-05 2024-09-13T06:39:52.461 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:52.461 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:52.461 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:39:52.461 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606630+0000", 2024-09-13T06:39:52.461 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.8040000000000007e-06 2024-09-13T06:39:52.461 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:52.461 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:52.461 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:52.461 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.439648+0000", 2024-09-13T06:39:52.461 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.83301824800000002 2024-09-13T06:39:52.461 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:52.462 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:52.462 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:52.462 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.439782+0000", 2024-09-13T06:39:52.462 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00013466699999999999 2024-09-13T06:39:52.462 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:52.462 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:52.462 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:52.462 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:52.462 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:52.462 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:2280 3.15 3:a94cd9aa:::rbd_data.11212429e5ad.0000000000000076:head [set-alloc-hint object_size 262144 write_size 262144,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-13T06:39:52.462 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:38.669961+0000", 2024-09-13T06:39:52.462 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 13.789748964999999, 2024-09-13T06:39:52.463 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.028162192999999999, 2024-09-13T06:39:52.463 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:52.463 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:52.463 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:39:52.463 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:39:52.463 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:52.463 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 2280 2024-09-13T06:39:52.463 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:52.463 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:52.463 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:52.463 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:52.463 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.669961+0000", 2024-09-13T06:39:52.463 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:52.464 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:52.464 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:52.464 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:52.464 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.669961+0000", 2024-09-13T06:39:52.464 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:52.464 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:52.464 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:52.464 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:52.464 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.669960+0000", 2024-09-13T06:39:52.464 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999986 2024-09-13T06:39:52.465 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:52.465 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:52.465 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:52.465 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.669968+0000", 2024-09-13T06:39:52.465 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.3429999999999996e-06 2024-09-13T06:39:52.465 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:52.465 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:52.465 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:52.465 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.669983+0000", 2024-09-13T06:39:52.465 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4722999999999999e-05 2024-09-13T06:39:52.465 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:52.465 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:52.466 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:52.466 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.669989+0000", 2024-09-13T06:39:52.466 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.4699999999999999e-06 2024-09-13T06:39:52.466 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:52.466 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:52.466 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:52.466 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.670034+0000", 2024-09-13T06:39:52.466 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4796000000000003e-05 2024-09-13T06:39:52.466 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:52.466 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:52.466 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:52.466 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.670138+0000", 2024-09-13T06:39:52.466 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00010367800000000001 2024-09-13T06:39:52.467 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:52.467 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:52.467 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 7", 2024-09-13T06:39:52.467 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.673689+0000", 2024-09-13T06:39:52.467 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0035515400000000002 2024-09-13T06:39:52.467 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:52.467 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:52.467 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-09-13T06:39:52.467 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.697921+0000", 2024-09-13T06:39:52.468 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.024231946000000001 2024-09-13T06:39:52.468 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:52.468 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:52.468 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:39:52.468 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.697984+0000", 2024-09-13T06:39:52.468 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.2885999999999994e-05 2024-09-13T06:39:52.468 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:52.468 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:52.468 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:39:52.468 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.698059+0000", 2024-09-13T06:39:52.468 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.538e-05 2024-09-13T06:39:52.468 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:52.468 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:52.469 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:52.469 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.698123+0000", 2024-09-13T06:39:52.469 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.4024999999999998e-05 2024-09-13T06:39:52.469 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:52.469 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:52.469 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:52.469 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:52.469 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:52.469 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop_reply(client.4385.0:2280 3.15 e31/30 ondisk, result = 0)", 2024-09-13T06:39:52.469 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:38.693889+0000", 2024-09-13T06:39:52.469 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 13.765820747999999, 2024-09-13T06:39:52.469 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0042543499999999996, 2024-09-13T06:39:52.469 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:52.469 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:39:52.469 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:52.470 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:52.470 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:52.470 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.693889+0000", 2024-09-13T06:39:52.470 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:52.470 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:52.470 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:52.470 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:52.470 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.693889+0000", 2024-09-13T06:39:52.470 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:52.470 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:52.470 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:52.470 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:52.470 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.693887+0000", 2024-09-13T06:39:52.470 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999981 2024-09-13T06:39:52.471 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:52.471 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:52.471 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:52.471 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.693898+0000", 2024-09-13T06:39:52.471 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0679999999999999e-05 2024-09-13T06:39:52.471 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:52.471 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:52.471 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:52.471 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.693929+0000", 2024-09-13T06:39:52.471 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.0902999999999999e-05 2024-09-13T06:39:52.471 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:52.471 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:52.471 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:52.471 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.693945+0000", 2024-09-13T06:39:52.472 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5472999999999999e-05 2024-09-13T06:39:52.472 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:52.472 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:52.472 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:52.472 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.697958+0000", 2024-09-13T06:39:52.472 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0040138170000000003 2024-09-13T06:39:52.472 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:52.472 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:52.473 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:52.473 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.697973+0000", 2024-09-13T06:39:52.473 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.471e-05 2024-09-13T06:39:52.473 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:52.473 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:52.473 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:52.473 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.698144+0000", 2024-09-13T06:39:52.473 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00017060400000000001 2024-09-13T06:39:52.473 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:52.473 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:52.474 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:52.474 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:52.474 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:52.474 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:2351 3.15 3:a8b7c3d8:::rbd_data.11212429e5ad.0000000000000044:head [delete] snapc 8=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-13T06:39:52.474 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:38.839360+0000", 2024-09-13T06:39:52.474 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 13.620350552, 2024-09-13T06:39:52.474 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0056685679999999997, 2024-09-13T06:39:52.474 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:52.474 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:39:52.474 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:39:52.474 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:39:52.474 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:52.474 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 2351 2024-09-13T06:39:52.475 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:52.475 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:52.475 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:52.475 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:52.475 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.839360+0000", 2024-09-13T06:39:52.475 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:52.475 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:52.475 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:52.475 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:52.475 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.839360+0000", 2024-09-13T06:39:52.475 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:52.475 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:52.475 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:52.476 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:52.476 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.839358+0000", 2024-09-13T06:39:52.476 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999986 2024-09-13T06:39:52.476 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:52.476 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:52.476 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:52.476 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.839366+0000", 2024-09-13T06:39:52.476 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.2069999999999995e-06 2024-09-13T06:39:52.476 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:52.476 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:52.476 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:52.476 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.839382+0000", 2024-09-13T06:39:52.476 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5458e-05 2024-09-13T06:39:52.477 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:52.477 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:52.477 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:52.477 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.839389+0000", 2024-09-13T06:39:52.477 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3490000000000003e-06 2024-09-13T06:39:52.477 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:52.477 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:52.477 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:52.477 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.839436+0000", 2024-09-13T06:39:52.477 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6456999999999999e-05 2024-09-13T06:39:52.477 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:52.477 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:52.477 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:52.478 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.839540+0000", 2024-09-13T06:39:52.478 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00010473 2024-09-13T06:39:52.478 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:52.478 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:52.478 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:52.478 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.845028+0000", 2024-09-13T06:39:52.478 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0054877099999999998 2024-09-13T06:39:52.478 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:52.478 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:52.478 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:52.478 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:52.478 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:52.478 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:2357 3.15 3:a94cd9aa:::rbd_data.11212429e5ad.0000000000000076:head [delete] snapc 8=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-13T06:39:52.478 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:38.845199+0000", 2024-09-13T06:39:52.479 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 13.61451098, 2024-09-13T06:39:52.479 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0041413279999999997, 2024-09-13T06:39:52.479 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:52.479 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:52.479 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:39:52.479 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:39:52.479 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:52.479 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 2357 2024-09-13T06:39:52.479 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:52.479 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:52.479 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:52.479 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:52.479 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.845199+0000", 2024-09-13T06:39:52.479 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:52.480 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:52.480 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:52.480 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:52.480 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.845199+0000", 2024-09-13T06:39:52.480 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:52.480 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:52.480 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:52.480 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:52.480 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.845198+0000", 2024-09-13T06:39:52.480 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.999999 2024-09-13T06:39:52.480 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:52.480 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:52.480 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:52.481 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.845204+0000", 2024-09-13T06:39:52.481 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7590000000000003e-06 2024-09-13T06:39:52.481 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:52.481 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:52.481 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:52.481 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.845220+0000", 2024-09-13T06:39:52.481 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5988e-05 2024-09-13T06:39:52.481 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:52.481 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:52.481 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:52.481 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.845228+0000", 2024-09-13T06:39:52.481 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.0369999999999995e-06 2024-09-13T06:39:52.481 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:52.482 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:52.482 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:52.482 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.845282+0000", 2024-09-13T06:39:52.482 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.4187000000000001e-05 2024-09-13T06:39:52.482 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:52.482 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:52.482 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:52.482 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.845406+0000", 2024-09-13T06:39:52.482 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000123695 2024-09-13T06:39:52.482 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:52.482 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:52.482 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 7", 2024-09-13T06:39:52.482 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.845582+0000", 2024-09-13T06:39:52.482 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00017596500000000001 2024-09-13T06:39:52.483 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:52.483 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:52.483 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-09-13T06:39:52.483 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.846244+0000", 2024-09-13T06:39:52.483 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00066242899999999997 2024-09-13T06:39:52.483 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:52.483 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:52.483 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:39:52.483 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.849256+0000", 2024-09-13T06:39:52.483 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.003011643 2024-09-13T06:39:52.483 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:52.483 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:52.483 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:39:52.483 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.849302+0000", 2024-09-13T06:39:52.484 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6449999999999997e-05 2024-09-13T06:39:52.484 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:52.484 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:52.484 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:52.484 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.849340+0000", 2024-09-13T06:39:52.484 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.8250000000000001e-05 2024-09-13T06:39:52.484 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:52.484 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:52.484 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:52.484 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:52.484 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:52.484 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:2371 3.1e 3:7b202373:::rbd_data.11212429e5ad.00000000000000ab:head [delete] snapc 8=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-13T06:39:52.484 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:38.849850+0000", 2024-09-13T06:39:52.484 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 13.609860306, 2024-09-13T06:39:52.485 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0042073730000000004, 2024-09-13T06:39:52.485 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:52.485 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:39:52.485 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:39:52.485 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:39:52.485 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:52.485 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 2371 2024-09-13T06:39:52.485 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:52.485 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:52.485 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:52.485 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:52.485 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.849850+0000", 2024-09-13T06:39:52.485 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:52.485 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:52.486 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:52.486 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:52.486 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.849850+0000", 2024-09-13T06:39:52.486 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:52.486 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:52.486 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:52.486 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:52.486 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.849849+0000", 2024-09-13T06:39:52.486 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.999999 2024-09-13T06:39:52.486 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:52.486 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:52.486 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:52.486 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.849856+0000", 2024-09-13T06:39:52.486 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.2169999999999997e-06 2024-09-13T06:39:52.486 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:52.487 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:52.487 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:52.487 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.849870+0000", 2024-09-13T06:39:52.487 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3560000000000001e-05 2024-09-13T06:39:52.487 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:52.487 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:52.487 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:52.487 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.849878+0000", 2024-09-13T06:39:52.487 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.2670000000000006e-06 2024-09-13T06:39:52.487 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:52.487 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:52.487 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:52.487 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.849926+0000", 2024-09-13T06:39:52.488 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.8572000000000002e-05 2024-09-13T06:39:52.488 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:52.488 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:52.488 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:52.488 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.850065+0000", 2024-09-13T06:39:52.488 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00013843199999999999 2024-09-13T06:39:52.488 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:52.488 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:52.488 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:52.488 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.854057+0000", 2024-09-13T06:39:52.488 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.003992359 2024-09-13T06:39:52.488 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:52.488 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:52.488 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:52.489 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:52.489 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:52.489 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:2372 3.8 3:173d1868:::rbd_data.11212429e5ad.00000000000000ac:head [delete] snapc 8=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-13T06:39:52.489 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:38.849888+0000", 2024-09-13T06:39:52.489 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 13.609821939, 2024-09-13T06:39:52.489 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0042468810000000001, 2024-09-13T06:39:52.489 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:52.489 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:39:52.489 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:39:52.489 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:39:52.489 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:52.490 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 2372 2024-09-13T06:39:52.490 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:52.490 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:52.490 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:52.490 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:52.490 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.849888+0000", 2024-09-13T06:39:52.490 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:52.490 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:52.490 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:52.490 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:52.490 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.849888+0000", 2024-09-13T06:39:52.490 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:52.490 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:52.491 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:52.491 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:52.491 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.849888+0000", 2024-09-13T06:39:52.491 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:39:52.491 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:52.491 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:52.491 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:52.491 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.849890+0000", 2024-09-13T06:39:52.491 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.7350000000000001e-06 2024-09-13T06:39:52.491 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:52.491 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:52.491 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:52.491 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.849896+0000", 2024-09-13T06:39:52.492 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.1490000000000002e-06 2024-09-13T06:39:52.492 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:52.492 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:52.492 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:52.492 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.849900+0000", 2024-09-13T06:39:52.492 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.2010000000000001e-06 2024-09-13T06:39:52.492 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:52.492 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:52.492 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:52.492 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.849939+0000", 2024-09-13T06:39:52.492 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.9682999999999999e-05 2024-09-13T06:39:52.492 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:52.493 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:52.493 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:52.493 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.850053+0000", 2024-09-13T06:39:52.493 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00011350500000000001 2024-09-13T06:39:52.493 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:52.493 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:52.493 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:52.493 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.854135+0000", 2024-09-13T06:39:52.493 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0040820689999999998 2024-09-13T06:39:52.493 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:52.493 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:52.493 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:52.494 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:52.494 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:52.494 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "pg_update_log_missing(3.c epoch 31/21 rep_tid 76 entries 31'46 (0'0) error 3:33b14f9a:::rbd_data.11212429e5ad.00000000000000aa:head by client.4385.0:2370 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 28'44)", 2024-09-13T06:39:52.494 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:38.851137+0000", 2024-09-13T06:39:52.494 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 13.608572572, 2024-09-13T06:39:52.494 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0055062599999999998, 2024-09-13T06:39:52.494 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:52.494 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:39:52.494 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:52.494 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:52.494 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:52.494 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.851137+0000", 2024-09-13T06:39:52.494 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:52.495 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:52.495 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:52.495 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:52.495 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.851137+0000", 2024-09-13T06:39:52.495 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:52.495 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:52.495 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:52.495 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:52.495 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.851136+0000", 2024-09-13T06:39:52.495 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.999999 2024-09-13T06:39:52.495 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:52.495 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:52.495 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:52.495 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.851148+0000", 2024-09-13T06:39:52.496 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1790999999999999e-05 2024-09-13T06:39:52.496 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:52.496 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:52.496 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:52.496 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.851171+0000", 2024-09-13T06:39:52.496 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3246000000000001e-05 2024-09-13T06:39:52.496 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:52.496 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:52.496 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:52.496 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.851187+0000", 2024-09-13T06:39:52.496 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5673999999999999e-05 2024-09-13T06:39:52.496 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:52.496 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:52.497 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:52.497 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.851426+0000", 2024-09-13T06:39:52.497 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000238722 2024-09-13T06:39:52.497 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:52.497 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:52.497 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:52.497 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.856644+0000", 2024-09-13T06:39:52.497 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0052179009999999996 2024-09-13T06:39:52.497 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:52.497 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:52.497 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:52.497 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:52.498 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:52.498 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:2430 3.8 3:157e7bb9:::rbd_data.11212429e5ad.0000000000000029:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-13T06:39:52.498 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:38.898223+0000", 2024-09-13T06:39:52.498 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 13.56148739, 2024-09-13T06:39:52.498 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0062964479999999996, 2024-09-13T06:39:52.498 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:52.498 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:39:52.498 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:39:52.498 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:39:52.498 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:52.498 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 2430 2024-09-13T06:39:52.498 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:52.498 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:52.499 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:52.499 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:52.499 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.898223+0000", 2024-09-13T06:39:52.499 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:52.499 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:52.499 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:52.499 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:52.499 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.898223+0000", 2024-09-13T06:39:52.499 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:52.499 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:52.499 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:52.499 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:52.499 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.898221+0000", 2024-09-13T06:39:52.499 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999981 2024-09-13T06:39:52.500 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:52.500 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:52.500 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:52.500 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.898231+0000", 2024-09-13T06:39:52.500 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0149999999999999e-05 2024-09-13T06:39:52.500 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:52.500 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:52.500 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:52.500 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.898253+0000", 2024-09-13T06:39:52.500 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2639000000000001e-05 2024-09-13T06:39:52.500 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:52.500 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:52.500 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:52.500 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.898265+0000", 2024-09-13T06:39:52.500 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1381e-05 2024-09-13T06:39:52.501 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:52.501 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:52.501 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:52.501 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.898326+0000", 2024-09-13T06:39:52.501 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.1379999999999998e-05 2024-09-13T06:39:52.501 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:52.501 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:52.501 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:52.501 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.898490+0000", 2024-09-13T06:39:52.501 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000164155 2024-09-13T06:39:52.501 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:52.501 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:52.501 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:52.501 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.904519+0000", 2024-09-13T06:39:52.502 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0060287200000000004 2024-09-13T06:39:52.502 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:52.502 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:52.502 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:52.502 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:52.502 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:52.502 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4385.0:2637 3.c e31/21 3:34346ebf:::rbd_data.11212429e5ad.00000000000001e5:head v 31'49, mlcod=31'47)", 2024-09-13T06:39:52.502 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:39.288896+0000", 2024-09-13T06:39:52.502 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 13.170814219, 2024-09-13T06:39:52.502 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0041430700000000004, 2024-09-13T06:39:52.502 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:52.502 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:52.502 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:52.502 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:52.503 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:52.503 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.288896+0000", 2024-09-13T06:39:52.503 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:52.503 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:52.503 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:52.503 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:52.503 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.288896+0000", 2024-09-13T06:39:52.503 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:52.503 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:52.503 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:52.503 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:52.503 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.288894+0000", 2024-09-13T06:39:52.503 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999976 2024-09-13T06:39:52.504 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:52.504 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:52.504 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:52.504 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.291185+0000", 2024-09-13T06:39:52.504 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0022910959999999998 2024-09-13T06:39:52.504 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:52.504 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:52.504 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:52.504 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.291213+0000", 2024-09-13T06:39:52.504 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.8537000000000001e-05 2024-09-13T06:39:52.504 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:52.504 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:52.504 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:52.505 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.291227+0000", 2024-09-13T06:39:52.505 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3506000000000001e-05 2024-09-13T06:39:52.505 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:52.505 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:52.505 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:52.505 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.291349+0000", 2024-09-13T06:39:52.505 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000122459 2024-09-13T06:39:52.505 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:52.505 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:52.505 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:52.505 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.291405+0000", 2024-09-13T06:39:52.505 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.5470000000000003e-05 2024-09-13T06:39:52.505 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:52.506 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:52.506 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:39:52.506 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.292980+0000", 2024-09-13T06:39:52.506 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0015756380000000001 2024-09-13T06:39:52.506 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:52.506 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:52.506 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:52.506 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.293039+0000", 2024-09-13T06:39:52.506 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8712999999999998e-05 2024-09-13T06:39:52.506 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:52.507 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:52.507 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:52.507 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:52.507 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:52.507 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:2679 3.15 3:afe512c8:::rbd_data.11212429e5ad.0000000000000084:head [delete] snapc 8=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-13T06:39:52.507 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:39.425673+0000", 2024-09-13T06:39:52.507 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 13.0340367, 2024-09-13T06:39:52.507 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0051813859999999996, 2024-09-13T06:39:52.507 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:52.507 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:52.507 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:39:52.507 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:39:52.508 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:52.508 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 2679 2024-09-13T06:39:52.508 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:52.508 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:52.508 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:52.508 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:52.508 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.425673+0000", 2024-09-13T06:39:52.508 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:52.508 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:52.508 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:52.508 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:52.508 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.425673+0000", 2024-09-13T06:39:52.509 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:52.509 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:52.509 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:52.509 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:52.509 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.425671+0000", 2024-09-13T06:39:52.509 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999976 2024-09-13T06:39:52.509 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:52.509 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:52.509 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:52.509 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.425682+0000", 2024-09-13T06:39:52.509 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.11e-05 2024-09-13T06:39:52.509 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:52.510 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:52.510 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:52.510 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.425715+0000", 2024-09-13T06:39:52.510 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.2768000000000002e-05 2024-09-13T06:39:52.510 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:52.510 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:52.510 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:52.510 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.425731+0000", 2024-09-13T06:39:52.510 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5866e-05 2024-09-13T06:39:52.510 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:52.510 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:52.510 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:52.510 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.425779+0000", 2024-09-13T06:39:52.510 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.8322999999999998e-05 2024-09-13T06:39:52.511 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:52.511 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:52.511 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:52.511 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.425869+0000", 2024-09-13T06:39:52.511 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.9985e-05 2024-09-13T06:39:52.511 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:52.511 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:52.511 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 7", 2024-09-13T06:39:52.511 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.425985+0000", 2024-09-13T06:39:52.511 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000115633 2024-09-13T06:39:52.511 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:52.511 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:52.511 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-09-13T06:39:52.512 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.426776+0000", 2024-09-13T06:39:52.512 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00079090499999999995 2024-09-13T06:39:52.512 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:52.512 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:52.512 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:39:52.512 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.430767+0000", 2024-09-13T06:39:52.512 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0039910040000000003 2024-09-13T06:39:52.512 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:52.512 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:52.512 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:39:52.512 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.430814+0000", 2024-09-13T06:39:52.512 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7633999999999998e-05 2024-09-13T06:39:52.513 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:52.513 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:52.513 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:52.513 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.430855+0000", 2024-09-13T06:39:52.513 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.0596999999999998e-05 2024-09-13T06:39:52.513 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:52.513 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:52.513 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:52.513 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:52.513 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:52.513 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:2686 3.7 3:e797442e:::rbd_data.11212429e5ad.00000000000000da:head [delete] snapc 8=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-13T06:39:52.513 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:39.425784+0000", 2024-09-13T06:39:52.513 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 13.033926273000001, 2024-09-13T06:39:52.514 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0045158100000000003, 2024-09-13T06:39:52.514 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:52.514 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:52.514 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:39:52.514 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:39:52.514 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:52.514 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 2686 2024-09-13T06:39:52.514 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:52.514 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:52.514 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:52.514 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:52.514 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.425784+0000", 2024-09-13T06:39:52.515 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:52.515 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:52.515 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:52.515 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:52.515 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.425784+0000", 2024-09-13T06:39:52.515 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:52.515 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:52.515 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:52.515 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:52.515 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.425783+0000", 2024-09-13T06:39:52.515 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:39:52.515 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:52.515 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:52.515 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:52.516 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.425787+0000", 2024-09-13T06:39:52.516 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.7699999999999999e-06 2024-09-13T06:39:52.516 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:52.516 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:52.516 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:52.516 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.425796+0000", 2024-09-13T06:39:52.516 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.5329999999999994e-06 2024-09-13T06:39:52.516 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:52.516 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:52.516 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:52.516 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.425802+0000", 2024-09-13T06:39:52.516 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.798e-06 2024-09-13T06:39:52.516 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:52.517 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:52.517 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:52.517 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.425853+0000", 2024-09-13T06:39:52.517 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.1075999999999997e-05 2024-09-13T06:39:52.517 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:52.517 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:52.517 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:52.517 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.425940+0000", 2024-09-13T06:39:52.517 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.6932e-05 2024-09-13T06:39:52.517 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:52.517 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:52.517 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 7", 2024-09-13T06:39:52.518 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.426054+0000", 2024-09-13T06:39:52.518 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000113266 2024-09-13T06:39:52.518 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:52.518 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:52.518 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-09-13T06:39:52.518 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.426772+0000", 2024-09-13T06:39:52.518 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00071808899999999999 2024-09-13T06:39:52.518 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:52.518 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:52.518 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:39:52.518 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.430225+0000", 2024-09-13T06:39:52.518 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0034537639999999998 2024-09-13T06:39:52.518 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:52.518 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:52.519 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:39:52.519 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.430253+0000", 2024-09-13T06:39:52.519 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.7912999999999999e-05 2024-09-13T06:39:52.519 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:52.519 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:52.519 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:52.519 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.430300+0000", 2024-09-13T06:39:52.519 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6233000000000003e-05 2024-09-13T06:39:52.519 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:52.519 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:52.519 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:52.519 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:52.519 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:52.519 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:3390 3.7 3:e3024cb3:::rbd_data.11217e777cf4.0000000000000004:head [write 348891~44325] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-13T06:39:52.520 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:42.779589+0000", 2024-09-13T06:39:52.520 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 9.6801210680000001, 2024-09-13T06:39:52.520 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0040594749999999999, 2024-09-13T06:39:52.520 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:52.520 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:52.520 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:39:52.520 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:39:52.520 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:52.520 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 3390 2024-09-13T06:39:52.520 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:52.520 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:52.520 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:52.520 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:52.521 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:42.779589+0000", 2024-09-13T06:39:52.521 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:52.521 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:52.521 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:52.521 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:52.521 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:42.779589+0000", 2024-09-13T06:39:52.521 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:52.521 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:52.521 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:52.521 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:52.521 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:42.779587+0000", 2024-09-13T06:39:52.521 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999976 2024-09-13T06:39:52.521 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:52.521 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:52.521 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:52.522 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:42.779639+0000", 2024-09-13T06:39:52.522 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2027000000000002e-05 2024-09-13T06:39:52.522 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:52.522 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:52.522 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:52.522 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:42.779661+0000", 2024-09-13T06:39:52.522 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2455000000000001e-05 2024-09-13T06:39:52.522 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:52.522 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:52.522 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:52.522 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:42.779674+0000", 2024-09-13T06:39:52.522 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2809999999999999e-05 2024-09-13T06:39:52.522 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:52.522 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:52.523 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:52.523 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:42.779740+0000", 2024-09-13T06:39:52.523 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.5896999999999996e-05 2024-09-13T06:39:52.523 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:52.523 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:52.523 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:52.523 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:42.779832+0000", 2024-09-13T06:39:52.523 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.2143000000000002e-05 2024-09-13T06:39:52.523 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:52.523 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:52.523 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 7", 2024-09-13T06:39:52.523 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:42.779970+0000", 2024-09-13T06:39:52.524 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00013752799999999999 2024-09-13T06:39:52.524 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:52.524 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:52.524 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:39:52.524 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:42.782260+0000", 2024-09-13T06:39:52.524 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0022905260000000002 2024-09-13T06:39:52.524 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:52.524 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:52.524 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-09-13T06:39:52.524 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:42.783570+0000", 2024-09-13T06:39:52.524 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.001309866 2024-09-13T06:39:52.524 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:52.525 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:52.525 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:39:52.525 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:42.783613+0000", 2024-09-13T06:39:52.525 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.3275000000000002e-05 2024-09-13T06:39:52.525 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:52.525 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:52.525 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:52.525 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:42.783648+0000", 2024-09-13T06:39:52.525 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.5212000000000001e-05 2024-09-13T06:39:52.525 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:52.525 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:52.525 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:52.525 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:52.525 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:52.526 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:3391 3.8 3:16b1c06a:::rbd_data.11217e777cf4.0000000000000005:head [write 327680~10611] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-13T06:39:52.526 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:42.779693+0000", 2024-09-13T06:39:52.526 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 9.6800171129999999, 2024-09-13T06:39:52.526 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0041685840000000004, 2024-09-13T06:39:52.526 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:52.526 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:52.526 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:39:52.526 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:39:52.526 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:52.526 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 3391 2024-09-13T06:39:52.526 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:52.526 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:52.526 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:52.527 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:52.527 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:42.779693+0000", 2024-09-13T06:39:52.527 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:52.527 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:52.527 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:52.527 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:52.527 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:42.779693+0000", 2024-09-13T06:39:52.527 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:52.527 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:52.527 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:52.527 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:52.527 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:42.779692+0000", 2024-09-13T06:39:52.527 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.999999 2024-09-13T06:39:52.527 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:52.527 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:52.528 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:52.528 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:42.779721+0000", 2024-09-13T06:39:52.528 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9286e-05 2024-09-13T06:39:52.528 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:52.528 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:52.528 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:52.528 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:42.779733+0000", 2024-09-13T06:39:52.528 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.163e-05 2024-09-13T06:39:52.528 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:52.528 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:52.528 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:52.528 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:42.779741+0000", 2024-09-13T06:39:52.528 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.1929999999999993e-06 2024-09-13T06:39:52.528 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:52.529 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:52.529 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:52.529 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:42.779790+0000", 2024-09-13T06:39:52.529 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9166999999999999e-05 2024-09-13T06:39:52.529 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:52.529 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:52.529 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:52.529 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:42.779841+0000", 2024-09-13T06:39:52.529 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0912999999999999e-05 2024-09-13T06:39:52.529 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:52.529 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:52.529 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 1", 2024-09-13T06:39:52.529 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:42.779981+0000", 2024-09-13T06:39:52.530 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000139505 2024-09-13T06:39:52.530 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:52.530 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:52.530 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-09-13T06:39:52.530 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:42.781017+0000", 2024-09-13T06:39:52.530 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.001036251 2024-09-13T06:39:52.530 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:52.530 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:52.530 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:39:52.530 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:42.783765+0000", 2024-09-13T06:39:52.530 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.002747892 2024-09-13T06:39:52.530 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:52.530 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:52.530 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:39:52.531 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:42.783807+0000", 2024-09-13T06:39:52.531 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.1544000000000001e-05 2024-09-13T06:39:52.531 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:52.531 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:52.531 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:52.531 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:42.783862+0000", 2024-09-13T06:39:52.531 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.5015000000000001e-05 2024-09-13T06:39:52.531 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:52.531 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:52.532 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:52.532 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:52.532 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:52.532 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:3406 3.8 3:16b1c06a:::rbd_data.11217e777cf4.0000000000000005:head [write 503101~21187] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-13T06:39:52.532 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:42.806222+0000", 2024-09-13T06:39:52.532 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 9.6534880889999997, 2024-09-13T06:39:52.532 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0050034149999999998, 2024-09-13T06:39:52.532 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:52.532 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:52.532 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:39:52.532 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:39:52.532 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:52.532 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 3406 2024-09-13T06:39:52.533 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:52.533 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:52.533 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:52.533 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:52.533 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:42.806222+0000", 2024-09-13T06:39:52.533 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:52.533 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:52.533 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:52.533 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:52.533 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:42.806222+0000", 2024-09-13T06:39:52.533 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:52.533 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:52.534 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:52.534 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:52.534 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:42.806221+0000", 2024-09-13T06:39:52.534 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.999999 2024-09-13T06:39:52.534 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:52.534 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:52.534 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:52.534 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:42.806247+0000", 2024-09-13T06:39:52.534 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5918000000000002e-05 2024-09-13T06:39:52.534 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:52.534 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:52.534 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:52.534 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:42.806261+0000", 2024-09-13T06:39:52.534 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3831e-05 2024-09-13T06:39:52.534 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:52.535 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:52.535 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:52.535 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:42.806268+0000", 2024-09-13T06:39:52.535 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.0740000000000004e-06 2024-09-13T06:39:52.535 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:52.535 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:52.535 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:52.535 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:42.806320+0000", 2024-09-13T06:39:52.535 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.1771999999999998e-05 2024-09-13T06:39:52.535 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:52.535 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:52.535 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:52.535 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:42.806417+0000", 2024-09-13T06:39:52.535 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.7719000000000004e-05 2024-09-13T06:39:52.536 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:52.536 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:52.536 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 1", 2024-09-13T06:39:52.536 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:42.806562+0000", 2024-09-13T06:39:52.536 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00014434800000000001 2024-09-13T06:39:52.536 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:52.536 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:52.536 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-09-13T06:39:52.536 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:42.811053+0000", 2024-09-13T06:39:52.536 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0044913879999999998 2024-09-13T06:39:52.536 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:52.536 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:52.536 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:39:52.536 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:42.811164+0000", 2024-09-13T06:39:52.537 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000110566 2024-09-13T06:39:52.537 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:52.537 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:52.537 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:39:52.537 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:42.811195+0000", 2024-09-13T06:39:52.537 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.1099999999999997e-05 2024-09-13T06:39:52.537 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:52.537 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:52.537 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:52.537 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:42.811225+0000", 2024-09-13T06:39:52.537 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.0772000000000003e-05 2024-09-13T06:39:52.537 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:52.537 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:52.538 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:52.538 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:52.538 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:52.538 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:3418 3.15 3:ac5106ea:::rbd_data.11217e777cf4.0000000000000011:head [set-alloc-hint object_size 524288 write_size 524288,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-13T06:39:52.538 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:42.830227+0000", 2024-09-13T06:39:52.538 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 9.6294827050000009, 2024-09-13T06:39:52.538 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017034491999999998, 2024-09-13T06:39:52.538 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:52.538 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:52.538 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:39:52.538 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:39:52.538 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:52.538 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 3418 2024-09-13T06:39:52.538 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:52.539 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:52.539 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:52.539 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:52.539 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:42.830227+0000", 2024-09-13T06:39:52.539 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:52.539 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:52.539 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:52.539 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:52.539 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:42.830227+0000", 2024-09-13T06:39:52.539 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:52.539 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:52.539 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:52.539 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:52.539 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:42.830226+0000", 2024-09-13T06:39:52.540 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999986 2024-09-13T06:39:52.540 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:52.540 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:52.540 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:52.540 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:42.830233+0000", 2024-09-13T06:39:52.540 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.9700000000000002e-06 2024-09-13T06:39:52.540 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:52.540 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:52.540 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:52.540 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:42.830248+0000", 2024-09-13T06:39:52.540 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5617999999999999e-05 2024-09-13T06:39:52.540 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:52.540 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:52.541 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:52.541 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:42.830256+0000", 2024-09-13T06:39:52.541 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.0169999999999996e-06 2024-09-13T06:39:52.541 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:52.541 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:52.541 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:52.541 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:42.830295+0000", 2024-09-13T06:39:52.541 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.8609999999999998e-05 2024-09-13T06:39:52.541 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:52.541 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:52.541 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:52.541 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:42.830390+0000", 2024-09-13T06:39:52.542 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.5253000000000004e-05 2024-09-13T06:39:52.542 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:52.542 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:52.542 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 7", 2024-09-13T06:39:52.542 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:42.833415+0000", 2024-09-13T06:39:52.542 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.003024704 2024-09-13T06:39:52.542 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:52.542 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:52.542 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-09-13T06:39:52.542 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:42.847160+0000", 2024-09-13T06:39:52.542 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.013745215999999999 2024-09-13T06:39:52.542 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:52.543 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:52.543 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:39:52.543 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:42.847195+0000", 2024-09-13T06:39:52.543 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.4585000000000002e-05 2024-09-13T06:39:52.543 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:52.543 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:52.543 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:39:52.543 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:42.847232+0000", 2024-09-13T06:39:52.543 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.6743999999999999e-05 2024-09-13T06:39:52.543 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:52.543 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:52.543 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:52.543 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:42.847262+0000", 2024-09-13T06:39:52.544 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.0249000000000001e-05 2024-09-13T06:39:52.544 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:52.544 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:52.544 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:52.544 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:52.544 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:52.544 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop_reply(client.4385.0:3418 3.15 e34/30 ondisk, result = 0)", 2024-09-13T06:39:52.544 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:42.841093+0000", 2024-09-13T06:39:52.544 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 9.6186168409999997, 2024-09-13T06:39:52.544 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0061745799999999998, 2024-09-13T06:39:52.544 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:52.544 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:39:52.544 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:52.545 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:52.545 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:52.545 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:42.841093+0000", 2024-09-13T06:39:52.545 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:52.545 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:52.545 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:52.545 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:52.545 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:42.841093+0000", 2024-09-13T06:39:52.545 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:52.545 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:52.545 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:52.545 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:52.546 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:42.841092+0000", 2024-09-13T06:39:52.546 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.999999 2024-09-13T06:39:52.546 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:52.546 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:52.546 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:52.546 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:42.841100+0000", 2024-09-13T06:39:52.546 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.3159999999999997e-06 2024-09-13T06:39:52.546 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:52.546 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:52.546 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:52.546 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:42.841117+0000", 2024-09-13T06:39:52.546 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6537000000000001e-05 2024-09-13T06:39:52.547 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:52.547 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:52.547 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:52.547 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:42.841127+0000", 2024-09-13T06:39:52.547 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0232e-05 2024-09-13T06:39:52.547 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:52.547 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:52.547 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:52.547 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:42.847182+0000", 2024-09-13T06:39:52.547 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0060546549999999999 2024-09-13T06:39:52.547 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:52.547 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:52.547 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:52.548 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:42.847190+0000", 2024-09-13T06:39:52.548 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.6290000000000001e-06 2024-09-13T06:39:52.548 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:52.548 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:52.548 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:52.548 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:42.847268+0000", 2024-09-13T06:39:52.548 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.8301999999999997e-05 2024-09-13T06:39:52.548 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:52.548 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:52.548 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:52.548 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:52.548 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:52.548 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:18040 3.8 3:17891456:::rbd_data.1121f2c5ee81.000000000000006d:head [write 0~524288 [fadvise_sequential+fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:39:52.549 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:51.678556+0000", 2024-09-13T06:39:52.549 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.78115402499999997, 2024-09-13T06:39:52.549 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0051473389999999999, 2024-09-13T06:39:52.549 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:52.549 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:52.549 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:39:52.549 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:39:52.549 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:52.549 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 18040 2024-09-13T06:39:52.549 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:52.549 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:52.549 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:52.550 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:52.550 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:51.678556+0000", 2024-09-13T06:39:52.550 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:52.550 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:52.550 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:52.550 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:52.550 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:51.678556+0000", 2024-09-13T06:39:52.550 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:52.550 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:52.550 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:52.550 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:52.550 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:51.678552+0000", 2024-09-13T06:39:52.550 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999962 2024-09-13T06:39:52.551 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:52.551 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:52.551 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:52.551 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:51.679401+0000", 2024-09-13T06:39:52.551 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000848963 2024-09-13T06:39:52.551 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:52.551 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:52.551 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:52.551 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:51.679450+0000", 2024-09-13T06:39:52.551 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.8582999999999999e-05 2024-09-13T06:39:52.551 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:52.551 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:52.551 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:52.551 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:51.679472+0000", 2024-09-13T06:39:52.552 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2263e-05 2024-09-13T06:39:52.552 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:52.552 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:52.552 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:52.552 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:51.679538+0000", 2024-09-13T06:39:52.552 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.6168999999999996e-05 2024-09-13T06:39:52.552 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:52.552 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:52.552 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:52.552 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:51.679703+0000", 2024-09-13T06:39:52.552 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000164432 2024-09-13T06:39:52.552 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:52.553 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:52.553 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 1", 2024-09-13T06:39:52.553 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:51.679828+0000", 2024-09-13T06:39:52.553 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00012482899999999999 2024-09-13T06:39:52.553 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:52.553 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:52.553 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-09-13T06:39:52.553 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:51.682529+0000", 2024-09-13T06:39:52.553 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0027017389999999999 2024-09-13T06:39:52.553 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:52.553 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:52.553 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:39:52.553 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:51.683601+0000", 2024-09-13T06:39:52.554 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0010713890000000001 2024-09-13T06:39:52.554 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:52.554 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:52.554 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:39:52.554 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:51.683658+0000", 2024-09-13T06:39:52.554 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7006000000000003e-05 2024-09-13T06:39:52.554 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:52.554 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:52.554 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:52.554 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:51.683703+0000", 2024-09-13T06:39:52.554 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5636000000000001e-05 2024-09-13T06:39:52.554 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:52.554 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:52.555 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:52.555 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:52.555 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:52.555 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:18041 3.2 3:45a2e498:::rbd_data.1121f2c5ee81.000000000000006e:head [write 0~524288 [fadvise_sequential+fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:39:52.555 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:51.679500+0000", 2024-09-13T06:39:52.555 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.78020970300000003, 2024-09-13T06:39:52.555 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.011180865999999999, 2024-09-13T06:39:52.555 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:52.555 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:52.555 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:39:52.555 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:39:52.555 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:52.555 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 18041 2024-09-13T06:39:52.556 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:52.556 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:52.556 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:52.556 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:52.556 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:51.679500+0000", 2024-09-13T06:39:52.556 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:52.556 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:52.556 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:52.556 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:52.556 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:51.679500+0000", 2024-09-13T06:39:52.556 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:52.556 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:52.556 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:52.557 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:52.557 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:51.679499+0000", 2024-09-13T06:39:52.557 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999981 2024-09-13T06:39:52.557 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:52.557 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:52.557 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:52.557 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:51.680164+0000", 2024-09-13T06:39:52.557 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00066593499999999999 2024-09-13T06:39:52.557 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:52.557 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:52.557 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:52.557 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:51.680194+0000", 2024-09-13T06:39:52.558 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9856e-05 2024-09-13T06:39:52.558 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:52.558 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:52.558 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:52.558 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:51.680213+0000", 2024-09-13T06:39:52.558 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9143999999999998e-05 2024-09-13T06:39:52.558 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:52.558 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:52.558 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:52.558 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:51.680273+0000", 2024-09-13T06:39:52.558 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9821000000000002e-05 2024-09-13T06:39:52.558 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:52.558 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:52.559 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:52.559 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:51.680400+0000", 2024-09-13T06:39:52.559 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000127179 2024-09-13T06:39:52.559 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:52.559 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:52.559 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 5", 2024-09-13T06:39:52.559 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:51.680536+0000", 2024-09-13T06:39:52.559 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00013573900000000001 2024-09-13T06:39:52.559 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:52.559 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:52.559 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-09-13T06:39:52.559 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:51.682822+0000", 2024-09-13T06:39:52.560 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0022862709999999999 2024-09-13T06:39:52.560 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:52.560 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:52.560 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:39:52.560 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:51.690629+0000", 2024-09-13T06:39:52.560 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0078068709999999999 2024-09-13T06:39:52.560 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:52.560 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:52.560 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:39:52.560 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:51.690659+0000", 2024-09-13T06:39:52.560 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9963000000000001e-05 2024-09-13T06:39:52.560 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:52.560 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:52.561 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:52.561 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:51.690681+0000", 2024-09-13T06:39:52.561 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1937e-05 2024-09-13T06:39:52.561 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:52.561 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:52.561 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:52.561 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:52.561 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:52.561 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:19402 3.15 3:adb8271d:::rbd_data.1121f2c5ee81.0000000000000085:head [write 0~524288 [fadvise_sequential+fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:39:52.561 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:51.943606+0000", 2024-09-13T06:39:52.561 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.51610442099999998, 2024-09-13T06:39:52.561 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0046125460000000004, 2024-09-13T06:39:52.561 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:52.562 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:52.562 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:39:52.562 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:39:52.562 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:52.562 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 19402 2024-09-13T06:39:52.562 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:52.562 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:52.562 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:52.562 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:52.562 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:51.943606+0000", 2024-09-13T06:39:52.562 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:52.562 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:52.562 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:52.563 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:52.563 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:51.943606+0000", 2024-09-13T06:39:52.563 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:52.563 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:52.563 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:52.563 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:52.563 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:51.943602+0000", 2024-09-13T06:39:52.563 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999967 2024-09-13T06:39:52.563 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:52.563 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:52.563 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:52.563 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:51.943873+0000", 2024-09-13T06:39:52.563 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00027081099999999998 2024-09-13T06:39:52.564 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:52.564 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:52.564 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:52.564 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:51.943907+0000", 2024-09-13T06:39:52.564 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.4236999999999998e-05 2024-09-13T06:39:52.564 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:52.564 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:52.564 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:52.564 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:51.943922+0000", 2024-09-13T06:39:52.564 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4912999999999999e-05 2024-09-13T06:39:52.564 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:52.564 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:52.564 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:52.564 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:51.943979+0000", 2024-09-13T06:39:52.565 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7204999999999999e-05 2024-09-13T06:39:52.565 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:52.565 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:52.565 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:52.565 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:51.944108+0000", 2024-09-13T06:39:52.565 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00012812899999999999 2024-09-13T06:39:52.565 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:52.565 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:52.565 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 4", 2024-09-13T06:39:52.565 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:51.944220+0000", 2024-09-13T06:39:52.565 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000112833 2024-09-13T06:39:52.565 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:52.565 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:52.566 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-09-13T06:39:52.566 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:51.945578+0000", 2024-09-13T06:39:52.566 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0013575 2024-09-13T06:39:52.566 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:52.566 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:52.566 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:39:52.566 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:51.948152+0000", 2024-09-13T06:39:52.566 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0025739740000000001 2024-09-13T06:39:52.566 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:52.566 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:52.566 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:39:52.566 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:51.948188+0000", 2024-09-13T06:39:52.566 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.6483999999999998e-05 2024-09-13T06:39:52.566 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:52.567 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:52.567 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:52.567 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:51.948218+0000", 2024-09-13T06:39:52.567 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9847000000000001e-05 2024-09-13T06:39:52.567 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:52.567 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:52.567 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:52.567 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:52.567 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:52.567 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:39:52.568 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-13T06:39:52.569 INFO:tasks.ceph.osd.6.smithi139.stderr:2024-09-13T06:39:52.570+0000 7fcd02c5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26385) UID: 0 2024-09-13T06:39:52.570 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-13T06:39:52.669 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-13T06:39:52.670+0000 7f86a5f06640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26387) UID: 0 2024-09-13T06:39:52.721 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:39:52.722 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [ 2024-09-13T06:39:52.722 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:52.722 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:20843 3.3 3.7159d4e3 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:39:52.722 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:52.707136+0000", 2024-09-13T06:39:52.722 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.020157376000000001, 2024-09-13T06:39:52.722 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.020171452999999999, 2024-09-13T06:39:52.722 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:39:52.722 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "queued for pg", 2024-09-13T06:39:52.722 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:39:52.722 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:39:52.722 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:52.722 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 20843 2024-09-13T06:39:52.723 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:52.723 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:39:52.723 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:52.723 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:39:52.723 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:52.707136+0000", 2024-09-13T06:39:52.723 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:52.723 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:52.723 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:52.723 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:39:52.723 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:52.707136+0000", 2024-09-13T06:39:52.723 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:52.723 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:52.723 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:52.724 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:39:52.724 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:52.707136+0000", 2024-09-13T06:39:52.724 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:39:52.724 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:52.724 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:52.724 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:39:52.724 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:52.707139+0000", 2024-09-13T06:39:52.724 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.0259999999999999e-06 2024-09-13T06:39:52.724 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:52.724 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:52.724 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:39:52.724 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:52.707147+0000", 2024-09-13T06:39:52.724 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.1009999999999992e-06 2024-09-13T06:39:52.725 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:52.725 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:52.725 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:39:52.725 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:52.707152+0000", 2024-09-13T06:39:52.725 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.5500000000000002e-06 2024-09-13T06:39:52.725 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:52.725 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:39:52.725 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:52.725 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:52.725 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:52.725 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:20844 3.3 3.7159d4e3 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:39:52.725 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:52.707310+0000", 2024-09-13T06:39:52.726 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.019983717000000002, 2024-09-13T06:39:52.726 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.02003446, 2024-09-13T06:39:52.726 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:39:52.726 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "queued for pg", 2024-09-13T06:39:52.726 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:39:52.726 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:39:52.726 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:52.726 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 20844 2024-09-13T06:39:52.726 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:52.726 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:39:52.726 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:52.726 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:39:52.726 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:52.707310+0000", 2024-09-13T06:39:52.727 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:52.727 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:52.727 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:52.727 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:39:52.727 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:52.707310+0000", 2024-09-13T06:39:52.727 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:52.727 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:52.727 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:52.727 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:39:52.727 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:52.707309+0000", 2024-09-13T06:39:52.727 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:39:52.727 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:52.727 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:52.728 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:39:52.728 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:52.707313+0000", 2024-09-13T06:39:52.728 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.9029999999999997e-06 2024-09-13T06:39:52.728 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:52.728 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:52.728 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:39:52.728 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:52.707322+0000", 2024-09-13T06:39:52.728 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.8049999999999996e-06 2024-09-13T06:39:52.728 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:52.728 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:52.728 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:39:52.728 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:52.707328+0000", 2024-09-13T06:39:52.729 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.5529999999999998e-06 2024-09-13T06:39:52.729 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:52.729 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:39:52.729 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:52.729 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:52.729 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:52.729 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:20846 3.3 3.7159d4e3 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:39:52.729 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:52.707839+0000", 2024-09-13T06:39:52.729 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.019454058999999999, 2024-09-13T06:39:52.729 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.019534988, 2024-09-13T06:39:52.729 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:39:52.729 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "queued for pg", 2024-09-13T06:39:52.730 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:39:52.730 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:39:52.730 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:52.730 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 20846 2024-09-13T06:39:52.730 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:52.730 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:39:52.730 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:52.730 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:39:52.730 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:52.707839+0000", 2024-09-13T06:39:52.730 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:52.730 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:52.730 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:52.730 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:39:52.730 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:52.707839+0000", 2024-09-13T06:39:52.731 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:52.731 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:52.731 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:52.731 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:39:52.731 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:52.707838+0000", 2024-09-13T06:39:52.731 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:39:52.731 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:52.731 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:52.731 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:39:52.731 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:52.707844+0000", 2024-09-13T06:39:52.731 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.4020000000000001e-06 2024-09-13T06:39:52.731 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:52.731 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:52.732 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:39:52.732 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:52.707860+0000", 2024-09-13T06:39:52.732 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6087e-05 2024-09-13T06:39:52.732 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:52.732 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:52.732 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:39:52.732 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:52.707868+0000", 2024-09-13T06:39:52.732 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.3000000000000002e-06 2024-09-13T06:39:52.732 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:52.733 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:39:52.733 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:52.733 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:52.733 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:52.733 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:20848 3.13 3.e85a4e53 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:39:52.733 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:52.710273+0000", 2024-09-13T06:39:52.733 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.017020517999999998, 2024-09-13T06:39:52.733 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.017131219, 2024-09-13T06:39:52.733 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:39:52.733 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "queued for pg", 2024-09-13T06:39:52.733 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:39:52.734 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:39:52.734 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:52.734 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 20848 2024-09-13T06:39:52.734 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:52.734 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:39:52.734 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:52.734 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:39:52.734 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:52.710273+0000", 2024-09-13T06:39:52.734 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:52.734 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:52.734 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:52.734 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:39:52.734 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:52.710273+0000", 2024-09-13T06:39:52.734 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:52.735 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:52.735 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:52.735 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:39:52.735 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:52.710272+0000", 2024-09-13T06:39:52.735 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999986 2024-09-13T06:39:52.735 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:52.735 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:52.735 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:39:52.735 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:52.710278+0000", 2024-09-13T06:39:52.735 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.7900000000000002e-06 2024-09-13T06:39:52.735 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:52.735 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:52.735 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:39:52.736 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:52.710296+0000", 2024-09-13T06:39:52.736 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7873e-05 2024-09-13T06:39:52.736 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:52.736 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:52.736 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:39:52.736 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:52.710306+0000", 2024-09-13T06:39:52.736 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.4599999999999992e-06 2024-09-13T06:39:52.736 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:52.736 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:39:52.736 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:52.736 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:52.736 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:52.736 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:20849 3.3 3.7159d4e3 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:39:52.736 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:52.710573+0000", 2024-09-13T06:39:52.737 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.016720523000000001, 2024-09-13T06:39:52.737 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.01686023, 2024-09-13T06:39:52.737 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:39:52.737 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "queued for pg", 2024-09-13T06:39:52.737 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:39:52.737 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:39:52.737 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:52.737 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 20849 2024-09-13T06:39:52.737 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:52.737 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:39:52.737 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:52.737 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:39:52.737 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:52.710573+0000", 2024-09-13T06:39:52.738 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:52.738 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:52.738 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:52.738 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:39:52.738 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:52.710573+0000", 2024-09-13T06:39:52.738 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:52.738 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:52.738 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:52.738 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:39:52.738 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:52.710572+0000", 2024-09-13T06:39:52.738 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:39:52.738 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:52.738 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:52.739 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:39:52.739 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:52.710577+0000", 2024-09-13T06:39:52.739 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.3850000000000001e-06 2024-09-13T06:39:52.739 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:52.739 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:52.739 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:39:52.739 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:52.710590+0000", 2024-09-13T06:39:52.739 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2186e-05 2024-09-13T06:39:52.739 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:52.739 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:52.739 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:39:52.739 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:52.710599+0000", 2024-09-13T06:39:52.739 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.1069999999999994e-06 2024-09-13T06:39:52.739 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:52.740 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:39:52.740 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:52.740 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:52.740 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:52.740 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:20851 3.13 3.e85a4e53 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:39:52.740 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:52.717419+0000", 2024-09-13T06:39:52.740 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0098747599999999998, 2024-09-13T06:39:52.740 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.010043636, 2024-09-13T06:39:52.740 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:39:52.740 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "queued for pg", 2024-09-13T06:39:52.740 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:39:52.740 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:39:52.740 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:52.740 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 20851 2024-09-13T06:39:52.741 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:52.741 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:39:52.741 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:52.741 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:39:52.741 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:52.717419+0000", 2024-09-13T06:39:52.741 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:52.741 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:52.741 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:52.741 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:39:52.741 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:52.717419+0000", 2024-09-13T06:39:52.741 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:52.741 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:52.742 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:52.742 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:39:52.742 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:52.717418+0000", 2024-09-13T06:39:52.742 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:39:52.742 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:52.742 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:52.742 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:39:52.742 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:52.717424+0000", 2024-09-13T06:39:52.742 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.2489999999999998e-06 2024-09-13T06:39:52.742 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:52.742 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:52.742 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:39:52.742 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:52.717439+0000", 2024-09-13T06:39:52.743 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5081e-05 2024-09-13T06:39:52.743 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:52.743 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:52.743 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:39:52.743 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:52.717449+0000", 2024-09-13T06:39:52.743 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.9289999999999993e-06 2024-09-13T06:39:52.743 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:52.743 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:39:52.743 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:52.743 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:52.743 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:52.743 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:20852 3.3 3.7159d4e3 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:39:52.743 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:52.717497+0000", 2024-09-13T06:39:52.743 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0097967729999999999, 2024-09-13T06:39:52.744 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0099938400000000004, 2024-09-13T06:39:52.744 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:39:52.744 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "queued for pg", 2024-09-13T06:39:52.744 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:39:52.744 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:39:52.744 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:52.744 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 20852 2024-09-13T06:39:52.744 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:52.744 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:39:52.744 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:52.744 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:39:52.744 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:52.717497+0000", 2024-09-13T06:39:52.745 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:52.745 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:52.745 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:52.745 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:39:52.745 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:52.717497+0000", 2024-09-13T06:39:52.745 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:52.745 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:52.745 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:52.745 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:39:52.745 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:52.717496+0000", 2024-09-13T06:39:52.745 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:39:52.745 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:52.745 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:52.745 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:39:52.746 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:52.717501+0000", 2024-09-13T06:39:52.746 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.7469999999999996e-06 2024-09-13T06:39:52.746 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:52.746 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:52.746 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:39:52.746 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:52.717511+0000", 2024-09-13T06:39:52.746 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0047999999999999e-05 2024-09-13T06:39:52.746 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:52.746 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:52.746 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:39:52.746 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:52.717518+0000", 2024-09-13T06:39:52.746 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.9970000000000001e-06 2024-09-13T06:39:52.746 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:52.747 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:39:52.747 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:52.747 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:52.747 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:52.747 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:20894 3.13 3.e85a4e53 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:39:52.747 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:52.722886+0000", 2024-09-13T06:39:52.747 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0044075570000000003, 2024-09-13T06:39:52.747 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0046334339999999996, 2024-09-13T06:39:52.747 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:39:52.747 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "queued for pg", 2024-09-13T06:39:52.747 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:39:52.747 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:39:52.747 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:52.748 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 20894 2024-09-13T06:39:52.748 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:52.748 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:39:52.748 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:52.748 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:39:52.748 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:52.722886+0000", 2024-09-13T06:39:52.748 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:52.748 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:52.748 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:52.748 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:39:52.748 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:52.722886+0000", 2024-09-13T06:39:52.748 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:52.748 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:52.749 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:52.749 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:39:52.749 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:52.722885+0000", 2024-09-13T06:39:52.749 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:39:52.749 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:52.749 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:52.749 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:39:52.749 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:52.722891+0000", 2024-09-13T06:39:52.749 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.1090000000000003e-06 2024-09-13T06:39:52.749 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:52.749 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:52.749 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:39:52.749 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:52.722904+0000", 2024-09-13T06:39:52.750 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2738000000000001e-05 2024-09-13T06:39:52.750 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:52.750 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:52.750 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:39:52.750 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:52.722912+0000", 2024-09-13T06:39:52.750 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.1219999999999995e-06 2024-09-13T06:39:52.750 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:52.750 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:39:52.750 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:52.750 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:52.750 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:52.750 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:20895 3.13 3.e85a4e53 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:39:52.750 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:52.726439+0000", 2024-09-13T06:39:52.750 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.00085488999999999997, 2024-09-13T06:39:52.751 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0011090589999999999, 2024-09-13T06:39:52.751 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:39:52.751 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "queued for pg", 2024-09-13T06:39:52.751 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:39:52.751 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:39:52.751 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:52.751 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 20895 2024-09-13T06:39:52.751 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:52.751 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:39:52.751 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:52.751 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:39:52.751 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:52.726439+0000", 2024-09-13T06:39:52.751 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:52.752 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:52.752 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:52.752 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:39:52.752 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:52.726439+0000", 2024-09-13T06:39:52.752 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:52.752 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:52.752 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:52.752 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:39:52.752 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:52.726437+0000", 2024-09-13T06:39:52.752 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999986 2024-09-13T06:39:52.752 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:52.752 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:52.752 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:39:52.753 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:52.726444+0000", 2024-09-13T06:39:52.753 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.1029999999999998e-06 2024-09-13T06:39:52.753 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:52.753 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:52.753 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:39:52.753 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:52.726457+0000", 2024-09-13T06:39:52.753 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3239e-05 2024-09-13T06:39:52.753 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:52.753 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:52.753 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:39:52.753 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:52.726464+0000", 2024-09-13T06:39:52.753 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.6510000000000001e-06 2024-09-13T06:39:52.753 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:52.753 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:39:52.753 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:52.754 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:52.754 INFO:teuthology.orchestra.run.smithi139.stdout: ], 2024-09-13T06:39:52.754 INFO:teuthology.orchestra.run.smithi139.stdout: "num_ops": 9 2024-09-13T06:39:52.754 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:39:52.755 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-13T06:39:52.799 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-13T06:39:52.802+0000 7f86a5f06640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26387) UID: 0 2024-09-13T06:39:52.869 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:39:52.871+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:39:52.926 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:39:52.926 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [], 2024-09-13T06:39:52.926 INFO:teuthology.orchestra.run.smithi139.stdout: "complaint_time": 30, 2024-09-13T06:39:52.926 INFO:teuthology.orchestra.run.smithi139.stdout: "num_blocked_ops": 0 2024-09-13T06:39:52.926 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:39:52.941 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-13T06:39:52.970 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:39:52.975+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:39:53.071 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:39:53.075+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:39:53.075 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:39:53.075 INFO:teuthology.orchestra.run.smithi139.stdout: "size": 20, 2024-09-13T06:39:53.075 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 600, 2024-09-13T06:39:53.075 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [ 2024-09-13T06:39:53.075 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.075 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18706 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 3346432~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:39:53.075 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.846138+0000", 2024-09-13T06:39:53.075 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 1.2315896710000001, 2024-09-13T06:39:53.075 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.102018712, 2024-09-13T06:39:53.076 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:39:53.076 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:39:53.076 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:39:53.076 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:39:53.076 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:53.076 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18706 2024-09-13T06:39:53.076 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.076 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:39:53.076 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.076 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:39:53.076 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846138+0000", 2024-09-13T06:39:53.077 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:53.077 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.077 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.077 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:39:53.077 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846138+0000", 2024-09-13T06:39:53.077 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:53.077 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.077 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.077 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:39:53.077 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846138+0000", 2024-09-13T06:39:53.077 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:39:53.077 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.077 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.077 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:39:53.078 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846141+0000", 2024-09-13T06:39:53.078 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.6969999999999999e-06 2024-09-13T06:39:53.078 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.078 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.078 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:39:53.078 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846150+0000", 2024-09-13T06:39:53.078 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6400000000000003e-06 2024-09-13T06:39:53.078 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.078 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.078 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:39:53.078 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846160+0000", 2024-09-13T06:39:53.078 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.3999999999999998e-06 2024-09-13T06:39:53.078 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.079 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.079 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:39:53.079 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.947764+0000", 2024-09-13T06:39:53.079 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101604085 2024-09-13T06:39:53.079 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.079 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.079 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:39:53.079 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.947888+0000", 2024-09-13T06:39:53.079 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000124113 2024-09-13T06:39:53.079 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.079 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.079 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:39:53.079 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.948157+0000", 2024-09-13T06:39:53.079 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00026943399999999998 2024-09-13T06:39:53.080 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:53.080 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:39:53.080 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:53.080 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.080 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.080 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18707 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 3375104~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:39:53.080 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.846207+0000", 2024-09-13T06:39:53.080 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 1.231520905, 2024-09-13T06:39:53.080 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10238114099999999, 2024-09-13T06:39:53.080 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:39:53.080 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:39:53.080 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:39:53.081 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:39:53.081 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:53.081 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18707 2024-09-13T06:39:53.081 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.081 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:39:53.081 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.081 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:39:53.081 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846207+0000", 2024-09-13T06:39:53.081 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:53.081 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.081 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.081 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:39:53.081 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846207+0000", 2024-09-13T06:39:53.082 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:53.082 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.082 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.082 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:39:53.082 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846206+0000", 2024-09-13T06:39:53.082 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:39:53.082 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.082 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.082 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:39:53.082 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846211+0000", 2024-09-13T06:39:53.082 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.3000000000000003e-06 2024-09-13T06:39:53.083 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.083 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.083 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:39:53.083 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846220+0000", 2024-09-13T06:39:53.083 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6199999999999994e-06 2024-09-13T06:39:53.083 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.083 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.083 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:39:53.083 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846228+0000", 2024-09-13T06:39:53.083 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.7500000000000003e-06 2024-09-13T06:39:53.083 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.083 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.083 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:39:53.084 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.948267+0000", 2024-09-13T06:39:53.084 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10203878700000001 2024-09-13T06:39:53.084 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.084 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.084 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:39:53.084 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.948435+0000", 2024-09-13T06:39:53.084 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00016796500000000001 2024-09-13T06:39:53.084 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.084 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.084 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:39:53.084 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.948588+0000", 2024-09-13T06:39:53.085 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00015373599999999999 2024-09-13T06:39:53.085 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:53.085 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:39:53.085 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:53.085 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.085 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.085 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18718 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 3690496~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:39:53.085 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.850174+0000", 2024-09-13T06:39:53.085 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 1.2275537519999999, 2024-09-13T06:39:53.085 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101854154, 2024-09-13T06:39:53.085 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:39:53.085 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:39:53.085 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:39:53.085 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:39:53.086 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:53.086 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18718 2024-09-13T06:39:53.086 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.086 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:39:53.086 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.086 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:39:53.086 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850174+0000", 2024-09-13T06:39:53.086 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:53.086 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.087 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.087 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:39:53.087 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850174+0000", 2024-09-13T06:39:53.087 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:53.087 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.087 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.087 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:39:53.087 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850173+0000", 2024-09-13T06:39:53.087 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:39:53.087 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.088 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.088 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:39:53.088 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850178+0000", 2024-09-13T06:39:53.088 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.4129999999999999e-06 2024-09-13T06:39:53.088 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.088 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.088 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:39:53.088 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850188+0000", 2024-09-13T06:39:53.089 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.8600000000000005e-06 2024-09-13T06:39:53.089 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.089 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.089 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:39:53.089 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850195+0000", 2024-09-13T06:39:53.089 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.8730000000000007e-06 2024-09-13T06:39:53.090 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.090 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.090 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:39:53.090 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.951766+0000", 2024-09-13T06:39:53.090 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.1015703 2024-09-13T06:39:53.090 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.090 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.090 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:39:53.091 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.951879+0000", 2024-09-13T06:39:53.091 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000112932 2024-09-13T06:39:53.091 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.091 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.091 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:39:53.091 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.952029+0000", 2024-09-13T06:39:53.091 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000149846 2024-09-13T06:39:53.091 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:53.092 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:39:53.092 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:53.092 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.092 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.092 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18719 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 3719168~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:39:53.092 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.850202+0000", 2024-09-13T06:39:53.092 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 1.227525709, 2024-09-13T06:39:53.093 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.102191676, 2024-09-13T06:39:53.093 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:39:53.093 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:39:53.093 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:39:53.093 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:39:53.093 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:53.094 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18719 2024-09-13T06:39:53.094 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.094 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:39:53.094 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.094 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:39:53.094 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850202+0000", 2024-09-13T06:39:53.094 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:53.094 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.094 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.094 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:39:53.094 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850202+0000", 2024-09-13T06:39:53.094 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:53.094 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.094 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.095 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:39:53.095 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850202+0000", 2024-09-13T06:39:53.095 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:39:53.095 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.095 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.095 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:39:53.095 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850205+0000", 2024-09-13T06:39:53.095 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.89e-06 2024-09-13T06:39:53.095 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.095 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.095 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:39:53.095 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850216+0000", 2024-09-13T06:39:53.095 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0233e-05 2024-09-13T06:39:53.096 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.096 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.096 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:39:53.096 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850223+0000", 2024-09-13T06:39:53.096 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5299999999999999e-06 2024-09-13T06:39:53.096 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.096 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.096 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:39:53.096 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.952106+0000", 2024-09-13T06:39:53.096 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10188309299999999 2024-09-13T06:39:53.096 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.096 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.097 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:39:53.097 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.952233+0000", 2024-09-13T06:39:53.097 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000126993 2024-09-13T06:39:53.097 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.097 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.097 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:39:53.097 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.952394+0000", 2024-09-13T06:39:53.097 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000160791 2024-09-13T06:39:53.097 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:53.097 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:39:53.098 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:53.098 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.098 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.098 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18720 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 3747840~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:39:53.098 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.850726+0000", 2024-09-13T06:39:53.098 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 1.22700188, 2024-09-13T06:39:53.098 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10199504299999999, 2024-09-13T06:39:53.098 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:39:53.098 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:39:53.099 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:39:53.099 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:39:53.099 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:53.099 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18720 2024-09-13T06:39:53.099 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.099 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:39:53.099 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.099 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:39:53.099 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850726+0000", 2024-09-13T06:39:53.099 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:53.099 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.099 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.099 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:39:53.100 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850726+0000", 2024-09-13T06:39:53.100 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:53.100 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.100 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.100 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:39:53.100 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850229+0000", 2024-09-13T06:39:53.100 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9995027 2024-09-13T06:39:53.100 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.100 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.100 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:39:53.100 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850731+0000", 2024-09-13T06:39:53.101 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00050221599999999999 2024-09-13T06:39:53.101 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.101 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.101 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:39:53.101 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850751+0000", 2024-09-13T06:39:53.101 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.9703000000000001e-05 2024-09-13T06:39:53.101 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.101 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.101 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:39:53.101 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850764+0000", 2024-09-13T06:39:53.101 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3207000000000001e-05 2024-09-13T06:39:53.101 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.101 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.101 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:39:53.102 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.952454+0000", 2024-09-13T06:39:53.102 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101690102 2024-09-13T06:39:53.102 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.102 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.102 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:39:53.102 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.952571+0000", 2024-09-13T06:39:53.102 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000116556 2024-09-13T06:39:53.102 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.102 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.102 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:39:53.102 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.952721+0000", 2024-09-13T06:39:53.102 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000150419 2024-09-13T06:39:53.102 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:53.103 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:39:53.103 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:53.103 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.103 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.103 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18730 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 4034560~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:39:53.103 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.854013+0000", 2024-09-13T06:39:53.103 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 1.2237149389999999, 2024-09-13T06:39:53.103 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10186914399999999, 2024-09-13T06:39:53.103 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:39:53.103 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:39:53.103 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:39:53.103 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:39:53.103 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:53.103 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18730 2024-09-13T06:39:53.104 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.104 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:39:53.104 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.104 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:39:53.104 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.854013+0000", 2024-09-13T06:39:53.104 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:53.104 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.104 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.104 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:39:53.104 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.854013+0000", 2024-09-13T06:39:53.104 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:53.104 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.104 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.104 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:39:53.105 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.854013+0000", 2024-09-13T06:39:53.105 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:39:53.105 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.105 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.105 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:39:53.105 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.854016+0000", 2024-09-13T06:39:53.105 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.1839999999999999e-06 2024-09-13T06:39:53.105 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.105 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.105 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:39:53.106 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.854025+0000", 2024-09-13T06:39:53.106 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.8030000000000003e-06 2024-09-13T06:39:53.106 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.106 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.106 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:39:53.106 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.854033+0000", 2024-09-13T06:39:53.106 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6500000000000002e-06 2024-09-13T06:39:53.106 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.106 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.106 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:39:53.106 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.955546+0000", 2024-09-13T06:39:53.106 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10151296 2024-09-13T06:39:53.106 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.106 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.107 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:39:53.107 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.955694+0000", 2024-09-13T06:39:53.107 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000147773 2024-09-13T06:39:53.107 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.107 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.107 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:39:53.107 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.955882+0000", 2024-09-13T06:39:53.107 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000188371 2024-09-13T06:39:53.107 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:53.107 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:39:53.108 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:53.108 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.108 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.108 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18742 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 4378624~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:39:53.108 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.857984+0000", 2024-09-13T06:39:53.108 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 1.219743816, 2024-09-13T06:39:53.108 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10179961799999999, 2024-09-13T06:39:53.108 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:39:53.108 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:39:53.108 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:39:53.108 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:39:53.108 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:53.108 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18742 2024-09-13T06:39:53.108 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.109 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:39:53.109 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.109 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:39:53.109 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.857984+0000", 2024-09-13T06:39:53.109 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:53.109 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.109 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.109 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:39:53.109 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.857984+0000", 2024-09-13T06:39:53.109 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:53.110 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.110 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.110 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:39:53.110 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.857983+0000", 2024-09-13T06:39:53.110 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:39:53.110 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.110 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.110 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:39:53.110 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.857987+0000", 2024-09-13T06:39:53.110 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0670000000000002e-06 2024-09-13T06:39:53.110 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.111 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.111 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:39:53.111 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.857997+0000", 2024-09-13T06:39:53.111 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6830000000000003e-06 2024-09-13T06:39:53.111 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.112 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.112 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:39:53.112 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.858006+0000", 2024-09-13T06:39:53.112 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.5739999999999996e-06 2024-09-13T06:39:53.112 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.112 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.112 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:39:53.112 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.959453+0000", 2024-09-13T06:39:53.112 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101447339 2024-09-13T06:39:53.112 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.112 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.112 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:39:53.112 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.959603+0000", 2024-09-13T06:39:53.113 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000150316 2024-09-13T06:39:53.113 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.113 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.113 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:39:53.113 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.959784+0000", 2024-09-13T06:39:53.113 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00018065900000000001 2024-09-13T06:39:53.113 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:53.113 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:39:53.113 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:53.113 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.114 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.114 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18743 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 4407296~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:39:53.114 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.858012+0000", 2024-09-13T06:39:53.114 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 1.219715823, 2024-09-13T06:39:53.114 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10210024500000001, 2024-09-13T06:39:53.114 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:39:53.114 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:39:53.114 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:39:53.114 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:39:53.114 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:53.114 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18743 2024-09-13T06:39:53.115 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.115 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:39:53.115 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.115 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:39:53.115 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.858012+0000", 2024-09-13T06:39:53.115 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:53.115 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.115 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.115 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:39:53.115 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.858012+0000", 2024-09-13T06:39:53.115 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:53.115 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.115 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.116 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:39:53.116 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.858011+0000", 2024-09-13T06:39:53.116 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:39:53.116 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.116 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.116 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:39:53.116 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.858016+0000", 2024-09-13T06:39:53.116 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0659999999999997e-06 2024-09-13T06:39:53.116 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.116 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.116 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:39:53.116 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.858024+0000", 2024-09-13T06:39:53.116 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.7700000000000007e-06 2024-09-13T06:39:53.116 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.117 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.117 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:39:53.117 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.858032+0000", 2024-09-13T06:39:53.117 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.7700000000000001e-06 2024-09-13T06:39:53.117 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.117 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.117 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:39:53.117 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.959850+0000", 2024-09-13T06:39:53.118 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.1018182 2024-09-13T06:39:53.118 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.118 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.118 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:39:53.118 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.959964+0000", 2024-09-13T06:39:53.118 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00011413600000000001 2024-09-13T06:39:53.118 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.118 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.118 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:39:53.119 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.960113+0000", 2024-09-13T06:39:53.119 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00014813900000000001 2024-09-13T06:39:53.119 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:53.119 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:39:53.119 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:53.119 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.119 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.119 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18755 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 4751360~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:39:53.119 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.862061+0000", 2024-09-13T06:39:53.119 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 1.215667571, 2024-09-13T06:39:53.119 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101907023, 2024-09-13T06:39:53.119 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:39:53.119 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:39:53.120 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:39:53.120 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:39:53.120 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:53.120 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18755 2024-09-13T06:39:53.120 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.120 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:39:53.120 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.120 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:39:53.120 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862061+0000", 2024-09-13T06:39:53.120 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:53.120 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.121 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.121 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:39:53.121 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862061+0000", 2024-09-13T06:39:53.121 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:53.121 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.121 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.121 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:39:53.121 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862060+0000", 2024-09-13T06:39:53.121 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:39:53.121 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.121 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.121 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:39:53.122 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862064+0000", 2024-09-13T06:39:53.122 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.3229999999999999e-06 2024-09-13T06:39:53.122 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.122 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.122 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:39:53.122 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862078+0000", 2024-09-13T06:39:53.122 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.433e-05 2024-09-13T06:39:53.122 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.122 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.122 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:39:53.123 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862086+0000", 2024-09-13T06:39:53.123 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.3869999999999997e-06 2024-09-13T06:39:53.123 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.123 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.123 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:39:53.123 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.963635+0000", 2024-09-13T06:39:53.123 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101549606 2024-09-13T06:39:53.123 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.123 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.123 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:39:53.123 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.963783+0000", 2024-09-13T06:39:53.123 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000147312 2024-09-13T06:39:53.123 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.123 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.124 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:39:53.124 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.963968+0000", 2024-09-13T06:39:53.124 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000185028 2024-09-13T06:39:53.124 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:53.124 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:39:53.124 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:53.124 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.124 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.124 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18756 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 4780032~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:39:53.124 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.862132+0000", 2024-09-13T06:39:53.124 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 1.215595728, 2024-09-13T06:39:53.124 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.102159295, 2024-09-13T06:39:53.124 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:39:53.125 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:39:53.125 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:39:53.125 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:39:53.125 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:53.125 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18756 2024-09-13T06:39:53.125 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.125 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:39:53.125 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.125 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:39:53.125 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862132+0000", 2024-09-13T06:39:53.125 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:53.125 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.125 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.125 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:39:53.126 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862132+0000", 2024-09-13T06:39:53.126 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:53.126 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.126 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.126 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:39:53.126 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862132+0000", 2024-09-13T06:39:53.126 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:39:53.126 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.126 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.126 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:39:53.126 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862136+0000", 2024-09-13T06:39:53.126 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.9559999999999999e-06 2024-09-13T06:39:53.126 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.127 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.127 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:39:53.127 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862145+0000", 2024-09-13T06:39:53.127 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6169999999999996e-06 2024-09-13T06:39:53.127 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.127 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.127 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:39:53.127 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862153+0000", 2024-09-13T06:39:53.127 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.8359999999999992e-06 2024-09-13T06:39:53.128 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.128 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.128 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:39:53.128 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.964018+0000", 2024-09-13T06:39:53.128 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101865421 2024-09-13T06:39:53.128 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.129 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.129 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:39:53.129 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.964140+0000", 2024-09-13T06:39:53.129 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000121172 2024-09-13T06:39:53.129 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.129 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.129 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:39:53.129 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.964292+0000", 2024-09-13T06:39:53.129 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00015202600000000001 2024-09-13T06:39:53.129 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:53.129 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:39:53.129 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:53.129 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.130 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.130 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18768 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 5124096~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:39:53.130 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.866345+0000", 2024-09-13T06:39:53.130 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 1.2113834210000001, 2024-09-13T06:39:53.130 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101779361, 2024-09-13T06:39:53.130 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:39:53.130 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:39:53.130 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:39:53.130 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:39:53.130 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:53.130 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18768 2024-09-13T06:39:53.130 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.130 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:39:53.130 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.131 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:39:53.131 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.866345+0000", 2024-09-13T06:39:53.131 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:53.131 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.131 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.131 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:39:53.131 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.866345+0000", 2024-09-13T06:39:53.131 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:53.131 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.131 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.131 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:39:53.132 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.866344+0000", 2024-09-13T06:39:53.132 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:39:53.132 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.132 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.132 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:39:53.132 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.866348+0000", 2024-09-13T06:39:53.132 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.4300000000000002e-06 2024-09-13T06:39:53.132 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.133 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.133 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:39:53.133 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.866356+0000", 2024-09-13T06:39:53.133 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.5930000000000006e-06 2024-09-13T06:39:53.133 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.133 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.133 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:39:53.133 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.866364+0000", 2024-09-13T06:39:53.133 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5599999999999996e-06 2024-09-13T06:39:53.134 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.134 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.134 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:39:53.134 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.967865+0000", 2024-09-13T06:39:53.134 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101501683 2024-09-13T06:39:53.134 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.134 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.134 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:39:53.134 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.967981+0000", 2024-09-13T06:39:53.134 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000115643 2024-09-13T06:39:53.134 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.134 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.134 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:39:53.135 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.968124+0000", 2024-09-13T06:39:53.135 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00014305500000000001 2024-09-13T06:39:53.135 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:53.135 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:39:53.135 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:53.135 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.135 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.135 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18779 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 5439488~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:39:53.135 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.869996+0000", 2024-09-13T06:39:53.135 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 1.207732536, 2024-09-13T06:39:53.136 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10189577399999999, 2024-09-13T06:39:53.136 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:39:53.136 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:39:53.136 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:39:53.136 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:39:53.136 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:53.136 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18779 2024-09-13T06:39:53.136 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.136 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:39:53.136 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.137 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:39:53.137 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.869996+0000", 2024-09-13T06:39:53.137 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:53.137 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.137 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.137 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:39:53.137 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.869996+0000", 2024-09-13T06:39:53.137 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:53.137 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.137 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.137 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:39:53.138 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.869995+0000", 2024-09-13T06:39:53.138 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:39:53.138 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.138 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.138 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:39:53.138 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.869998+0000", 2024-09-13T06:39:53.138 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.2729999999999998e-06 2024-09-13T06:39:53.138 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.138 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.138 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:39:53.139 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.870007+0000", 2024-09-13T06:39:53.139 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.5760000000000006e-06 2024-09-13T06:39:53.139 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.139 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.139 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:39:53.140 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.870014+0000", 2024-09-13T06:39:53.140 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.1400000000000002e-06 2024-09-13T06:39:53.140 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.140 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.140 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:39:53.140 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.971631+0000", 2024-09-13T06:39:53.140 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101617503 2024-09-13T06:39:53.140 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.140 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.141 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:39:53.141 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.971747+0000", 2024-09-13T06:39:53.141 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00011599600000000001 2024-09-13T06:39:53.141 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.141 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.141 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:39:53.141 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.971891+0000", 2024-09-13T06:39:53.141 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000143912 2024-09-13T06:39:53.141 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:53.141 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:39:53.141 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:53.141 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.142 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.142 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18792 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 5812224~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:39:53.142 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.874371+0000", 2024-09-13T06:39:53.142 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 1.2033574060000001, 2024-09-13T06:39:53.142 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101736005, 2024-09-13T06:39:53.142 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:39:53.142 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:39:53.142 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:39:53.142 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:39:53.142 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:53.142 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18792 2024-09-13T06:39:53.142 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.142 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:39:53.142 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.143 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:39:53.143 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874371+0000", 2024-09-13T06:39:53.143 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:53.143 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.143 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.143 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:39:53.143 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874371+0000", 2024-09-13T06:39:53.144 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:53.144 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.144 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.144 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:39:53.144 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874370+0000", 2024-09-13T06:39:53.144 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:39:53.144 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.144 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.144 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:39:53.145 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874374+0000", 2024-09-13T06:39:53.145 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.7239999999999998e-06 2024-09-13T06:39:53.145 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.145 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.145 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:39:53.145 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874385+0000", 2024-09-13T06:39:53.145 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1293e-05 2024-09-13T06:39:53.145 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.145 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.145 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:39:53.145 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874394+0000", 2024-09-13T06:39:53.145 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.0729999999999994e-06 2024-09-13T06:39:53.145 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.146 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.146 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:39:53.146 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.975850+0000", 2024-09-13T06:39:53.146 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10145599700000001 2024-09-13T06:39:53.146 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.146 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.146 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:39:53.146 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.975963+0000", 2024-09-13T06:39:53.146 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000112689 2024-09-13T06:39:53.146 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.146 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.146 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:39:53.146 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.976107+0000", 2024-09-13T06:39:53.147 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000143836 2024-09-13T06:39:53.147 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:53.147 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:39:53.147 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:53.147 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.147 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.147 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18793 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 5840896~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:39:53.147 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.874401+0000", 2024-09-13T06:39:53.147 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 1.203327373, 2024-09-13T06:39:53.148 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.102005516, 2024-09-13T06:39:53.148 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:39:53.148 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:39:53.148 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:39:53.148 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:39:53.148 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:53.148 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18793 2024-09-13T06:39:53.148 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.148 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:39:53.148 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.148 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:39:53.149 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874401+0000", 2024-09-13T06:39:53.149 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:53.149 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.149 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.149 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:39:53.149 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874401+0000", 2024-09-13T06:39:53.149 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:53.149 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.149 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.149 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:39:53.149 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874400+0000", 2024-09-13T06:39:53.149 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:39:53.149 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.150 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.150 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:39:53.150 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874404+0000", 2024-09-13T06:39:53.150 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0069999999999999e-06 2024-09-13T06:39:53.150 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.150 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.150 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:39:53.150 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874412+0000", 2024-09-13T06:39:53.150 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.5399999999999996e-06 2024-09-13T06:39:53.150 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.151 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.151 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:39:53.151 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874420+0000", 2024-09-13T06:39:53.151 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.6199999999999999e-06 2024-09-13T06:39:53.151 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.151 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.151 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:39:53.151 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.976150+0000", 2024-09-13T06:39:53.151 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101729874 2024-09-13T06:39:53.151 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.151 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.151 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:39:53.151 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.976261+0000", 2024-09-13T06:39:53.151 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000110819 2024-09-13T06:39:53.152 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.152 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.152 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:39:53.152 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.976406+0000", 2024-09-13T06:39:53.152 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000145489 2024-09-13T06:39:53.152 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:53.152 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:39:53.152 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:53.152 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.152 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.152 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18803 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 6127616~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:39:53.152 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.877851+0000", 2024-09-13T06:39:53.152 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 1.1998768799999999, 2024-09-13T06:39:53.153 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101951584, 2024-09-13T06:39:53.153 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:39:53.153 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:39:53.153 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:39:53.153 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:39:53.153 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:53.153 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18803 2024-09-13T06:39:53.153 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.153 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:39:53.153 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.153 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:39:53.154 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.877851+0000", 2024-09-13T06:39:53.154 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:53.154 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.154 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.154 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:39:53.154 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.877851+0000", 2024-09-13T06:39:53.154 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:53.154 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.154 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.155 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:39:53.155 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.877851+0000", 2024-09-13T06:39:53.155 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:39:53.155 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.155 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.155 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:39:53.155 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.877854+0000", 2024-09-13T06:39:53.155 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.7929999999999999e-06 2024-09-13T06:39:53.155 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.155 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.155 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:39:53.155 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.877864+0000", 2024-09-13T06:39:53.156 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.2029999999999998e-06 2024-09-13T06:39:53.156 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.156 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.156 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:39:53.156 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.877873+0000", 2024-09-13T06:39:53.156 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.0440000000000001e-06 2024-09-13T06:39:53.156 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.156 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.156 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:39:53.156 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.979544+0000", 2024-09-13T06:39:53.156 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101671198 2024-09-13T06:39:53.156 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.157 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.157 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:39:53.157 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.979658+0000", 2024-09-13T06:39:53.157 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000114456 2024-09-13T06:39:53.157 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.157 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.157 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:39:53.157 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.979803+0000", 2024-09-13T06:39:53.157 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000144506 2024-09-13T06:39:53.157 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:53.157 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:39:53.158 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:53.158 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.158 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.158 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18807 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 6242304~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:39:53.158 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.879235+0000", 2024-09-13T06:39:53.158 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 1.1984928500000001, 2024-09-13T06:39:53.158 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101781258, 2024-09-13T06:39:53.158 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:39:53.158 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:39:53.158 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:39:53.158 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:39:53.158 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:53.158 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18807 2024-09-13T06:39:53.158 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.159 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:39:53.159 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.159 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:39:53.159 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879235+0000", 2024-09-13T06:39:53.159 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:53.159 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.159 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.159 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:39:53.159 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879235+0000", 2024-09-13T06:39:53.159 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:53.160 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.160 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.160 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:39:53.160 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879235+0000", 2024-09-13T06:39:53.160 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:39:53.160 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.160 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.160 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:39:53.160 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879239+0000", 2024-09-13T06:39:53.160 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.963e-06 2024-09-13T06:39:53.160 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.160 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.160 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:39:53.160 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879247+0000", 2024-09-13T06:39:53.161 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6470000000000004e-06 2024-09-13T06:39:53.161 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.161 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.161 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:39:53.161 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879255+0000", 2024-09-13T06:39:53.161 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5429999999999996e-06 2024-09-13T06:39:53.161 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.161 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.161 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:39:53.161 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.980756+0000", 2024-09-13T06:39:53.161 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10150165999999999 2024-09-13T06:39:53.161 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.161 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.161 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:39:53.162 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.980868+0000", 2024-09-13T06:39:53.162 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000111196 2024-09-13T06:39:53.162 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.162 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.162 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:39:53.162 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.981017+0000", 2024-09-13T06:39:53.162 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000148846 2024-09-13T06:39:53.162 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:53.162 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:39:53.162 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:53.162 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.162 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.162 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18808 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 6270976~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:39:53.162 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.879261+0000", 2024-09-13T06:39:53.163 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 1.198466711, 2024-09-13T06:39:53.163 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.102057547, 2024-09-13T06:39:53.163 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:39:53.163 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:39:53.163 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:39:53.163 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:39:53.163 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:53.163 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18808 2024-09-13T06:39:53.163 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.163 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:39:53.163 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.163 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:39:53.163 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879261+0000", 2024-09-13T06:39:53.163 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:53.164 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.164 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.164 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:39:53.164 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879261+0000", 2024-09-13T06:39:53.164 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:53.164 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.164 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.164 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:39:53.164 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879261+0000", 2024-09-13T06:39:53.164 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:39:53.165 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.165 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.165 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:39:53.165 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879264+0000", 2024-09-13T06:39:53.165 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.523e-06 2024-09-13T06:39:53.165 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.165 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.165 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:39:53.165 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879273+0000", 2024-09-13T06:39:53.165 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6070000000000008e-06 2024-09-13T06:39:53.165 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.166 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.166 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:39:53.166 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879280+0000", 2024-09-13T06:39:53.166 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.4699999999999996e-06 2024-09-13T06:39:53.166 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.166 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.166 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:39:53.166 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.981060+0000", 2024-09-13T06:39:53.166 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10177934800000001 2024-09-13T06:39:53.166 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.166 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.166 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:39:53.166 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.981174+0000", 2024-09-13T06:39:53.167 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000114456 2024-09-13T06:39:53.167 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.167 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.167 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:39:53.167 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.981319+0000", 2024-09-13T06:39:53.167 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00014473900000000001 2024-09-13T06:39:53.167 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:53.167 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:39:53.167 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:53.167 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.167 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.168 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18810 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 2662400~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:39:53.168 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.880386+0000", 2024-09-13T06:39:53.168 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 1.197342549, 2024-09-13T06:39:53.168 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101728022, 2024-09-13T06:39:53.168 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:39:53.168 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:39:53.168 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:39:53.168 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:39:53.168 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:53.168 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18810 2024-09-13T06:39:53.168 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.168 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:39:53.168 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.169 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:39:53.169 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880386+0000", 2024-09-13T06:39:53.169 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:53.169 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.169 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.169 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:39:53.169 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880386+0000", 2024-09-13T06:39:53.169 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:53.169 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.169 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.169 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:39:53.169 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880385+0000", 2024-09-13T06:39:53.170 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:39:53.170 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.170 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.170 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:39:53.170 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880389+0000", 2024-09-13T06:39:53.170 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.8539999999999999e-06 2024-09-13T06:39:53.170 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.170 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.170 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:39:53.170 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880398+0000", 2024-09-13T06:39:53.170 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.1689999999999998e-06 2024-09-13T06:39:53.170 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.171 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.171 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:39:53.171 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880405+0000", 2024-09-13T06:39:53.171 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5700000000000004e-06 2024-09-13T06:39:53.171 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.171 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.171 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:39:53.171 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.981833+0000", 2024-09-13T06:39:53.171 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10142791800000001 2024-09-13T06:39:53.171 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.171 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.172 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:39:53.172 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.981973+0000", 2024-09-13T06:39:53.172 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00014002900000000001 2024-09-13T06:39:53.172 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.172 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.172 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:39:53.172 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.982114+0000", 2024-09-13T06:39:53.172 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000140276 2024-09-13T06:39:53.172 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:53.172 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:39:53.172 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:53.173 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.173 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.173 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18811 3.9 3.140f5209 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:39:53.173 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.880449+0000", 2024-09-13T06:39:53.173 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 1.1972791730000001, 2024-09-13T06:39:53.173 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101739355, 2024-09-13T06:39:53.173 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:39:53.173 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:39:53.173 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:39:53.173 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:39:53.173 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:53.173 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18811 2024-09-13T06:39:53.173 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.173 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:39:53.174 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.174 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:39:53.174 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880449+0000", 2024-09-13T06:39:53.174 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:53.174 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.174 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.174 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:39:53.174 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880449+0000", 2024-09-13T06:39:53.174 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:53.174 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.174 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.174 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:39:53.174 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880448+0000", 2024-09-13T06:39:53.174 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:39:53.175 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.175 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.175 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:39:53.175 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880452+0000", 2024-09-13T06:39:53.175 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0470000000000004e-06 2024-09-13T06:39:53.175 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.175 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.175 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:39:53.175 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880462+0000", 2024-09-13T06:39:53.176 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6530000000000006e-06 2024-09-13T06:39:53.176 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.176 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.176 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:39:53.176 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880472+0000", 2024-09-13T06:39:53.176 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0027000000000001e-05 2024-09-13T06:39:53.176 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.176 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.176 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:39:53.176 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.982172+0000", 2024-09-13T06:39:53.176 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10170043500000001 2024-09-13T06:39:53.176 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.176 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.176 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:39:53.177 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.982188+0000", 2024-09-13T06:39:53.177 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6172999999999999e-05 2024-09-13T06:39:53.177 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:53.177 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:39:53.177 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:53.177 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.177 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.177 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18812 3.9 3.140f5209 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:39:53.177 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.880478+0000", 2024-09-13T06:39:53.177 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 1.197249936, 2024-09-13T06:39:53.177 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10177795100000001, 2024-09-13T06:39:53.177 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:39:53.177 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:39:53.177 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:39:53.178 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:39:53.178 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:53.178 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18812 2024-09-13T06:39:53.178 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.178 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:39:53.178 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.178 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:39:53.178 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880478+0000", 2024-09-13T06:39:53.178 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:53.178 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.178 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.178 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:39:53.178 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880478+0000", 2024-09-13T06:39:53.178 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:53.179 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.179 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.179 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:39:53.179 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880477+0000", 2024-09-13T06:39:53.179 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:39:53.179 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.179 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.179 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:39:53.179 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880481+0000", 2024-09-13T06:39:53.179 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.827e-06 2024-09-13T06:39:53.179 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.179 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.179 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:39:53.179 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880490+0000", 2024-09-13T06:39:53.180 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6100000000000006e-06 2024-09-13T06:39:53.180 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.180 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.180 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:39:53.180 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880497+0000", 2024-09-13T06:39:53.180 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.7030000000000006e-06 2024-09-13T06:39:53.180 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.180 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.180 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:39:53.180 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.982241+0000", 2024-09-13T06:39:53.181 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10174351199999999 2024-09-13T06:39:53.181 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.181 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.181 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:39:53.181 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.982256+0000", 2024-09-13T06:39:53.181 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5143000000000001e-05 2024-09-13T06:39:53.181 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:53.181 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:39:53.181 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:53.181 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:53.182 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:39:53.182 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:39:53.183 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-13T06:39:53.184 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:39:53.187+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:39:53.285 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-13T06:39:53.286+0000 7f86a5f06640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26387) UID: 0 2024-09-13T06:39:53.310 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:39:53.310 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [], 2024-09-13T06:39:53.310 INFO:teuthology.orchestra.run.smithi139.stdout: "num_ops": 0 2024-09-13T06:39:53.310 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:39:53.324 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-13T06:39:53.419 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:39:53.422+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:39:53.486 INFO:tasks.ceph.osd.6.smithi139.stderr:2024-09-13T06:39:53.486+0000 7fcd02c5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26385) UID: 0 2024-09-13T06:39:53.493 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:39:53.494 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [], 2024-09-13T06:39:53.494 INFO:teuthology.orchestra.run.smithi139.stdout: "complaint_time": 30, 2024-09-13T06:39:53.494 INFO:teuthology.orchestra.run.smithi139.stdout: "num_blocked_ops": 0 2024-09-13T06:39:53.494 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:39:53.508 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-13T06:39:53.545 INFO:teuthology.orchestra.run.smithi081.stderr:nodeep-scrub is set 2024-09-13T06:39:53.593 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-13T06:39:53.601 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:39:53.602+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:39:53.612 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6] out_osds: [7] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-13T06:39:53.612 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-13T06:39:53.612 INFO:tasks.thrashosds.thrasher:inject_pause on osd.6 2024-09-13T06:39:53.612 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-09-13T06:39:53.612 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-09-13T06:39:53.612 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok config set filestore_inject_stall 3 2024-09-13T06:39:53.678 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:39:53.678 INFO:teuthology.orchestra.run.smithi139.stdout: "size": 20, 2024-09-13T06:39:53.678 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 600, 2024-09-13T06:39:53.678 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [ 2024-09-13T06:39:53.678 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.678 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4217.0:5 2.2 2:5cea7035:::rbd_info:head [create,write 0~8] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e19)", 2024-09-13T06:39:53.678 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:18.551848+0000", 2024-09-13T06:39:53.678 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 35.129734998000004, 2024-09-13T06:39:53.678 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0070706379999999997, 2024-09-13T06:39:53.678 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:39:53.678 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:53.679 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:39:53.679 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4217", 2024-09-13T06:39:53.679 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/2059993504", 2024-09-13T06:39:53.679 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 5 2024-09-13T06:39:53.679 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.679 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:39:53.679 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.679 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:39:53.679 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:18.551848+0000", 2024-09-13T06:39:53.679 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:53.679 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.680 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.680 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:39:53.680 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:18.551848+0000", 2024-09-13T06:39:53.680 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:53.680 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.680 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.680 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:39:53.680 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:18.551845+0000", 2024-09-13T06:39:53.680 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999967 2024-09-13T06:39:53.680 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.680 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.680 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:39:53.681 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:18.551863+0000", 2024-09-13T06:39:53.681 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.8450000000000001e-05 2024-09-13T06:39:53.681 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.681 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.681 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:39:53.681 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:18.551898+0000", 2024-09-13T06:39:53.681 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.4292999999999998e-05 2024-09-13T06:39:53.681 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.681 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.681 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:39:53.681 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:18.551915+0000", 2024-09-13T06:39:53.681 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7390000000000001e-05 2024-09-13T06:39:53.681 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.682 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.682 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:39:53.682 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:18.552049+0000", 2024-09-13T06:39:53.682 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00013432200000000001 2024-09-13T06:39:53.682 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.682 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.682 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op must wait for map", 2024-09-13T06:39:53.682 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:18.552060+0000", 2024-09-13T06:39:53.682 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0200000000000001e-05 2024-09-13T06:39:53.682 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.682 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.682 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:39:53.682 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:18.555492+0000", 2024-09-13T06:39:53.683 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0034328000000000002 2024-09-13T06:39:53.683 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.683 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.683 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:39:53.683 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:18.555726+0000", 2024-09-13T06:39:53.683 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00023350199999999999 2024-09-13T06:39:53.683 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.683 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.683 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-13T06:39:53.683 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:18.555949+0000", 2024-09-13T06:39:53.683 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00022290799999999999 2024-09-13T06:39:53.683 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.684 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.684 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-13T06:39:53.684 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:18.557425+0000", 2024-09-13T06:39:53.684 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.001476525 2024-09-13T06:39:53.684 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.684 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.684 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:39:53.684 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:18.558785+0000", 2024-09-13T06:39:53.684 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00135929 2024-09-13T06:39:53.684 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.684 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.684 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-13T06:39:53.684 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:18.558864+0000", 2024-09-13T06:39:53.685 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.9122999999999994e-05 2024-09-13T06:39:53.685 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.685 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.685 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:39:53.685 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:18.558919+0000", 2024-09-13T06:39:53.685 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.5002e-05 2024-09-13T06:39:53.685 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:53.685 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:39:53.685 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:53.685 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.685 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.685 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4217.0:7 2.2 2:5cea7035:::rbd_info:head [write 0~19] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-09-13T06:39:53.685 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:19.559245+0000", 2024-09-13T06:39:53.686 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 34.122338515999999, 2024-09-13T06:39:53.686 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0064556470000000001, 2024-09-13T06:39:53.686 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:39:53.686 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:53.686 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:39:53.686 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4217", 2024-09-13T06:39:53.686 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/2059993504", 2024-09-13T06:39:53.686 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 7 2024-09-13T06:39:53.686 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.686 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:39:53.686 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.686 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:39:53.686 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:19.559245+0000", 2024-09-13T06:39:53.686 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:53.687 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.687 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.687 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:39:53.687 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:19.559245+0000", 2024-09-13T06:39:53.687 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:53.687 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.687 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.687 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:39:53.687 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:19.559242+0000", 2024-09-13T06:39:53.687 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999971 2024-09-13T06:39:53.688 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.688 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.688 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:39:53.688 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:19.559256+0000", 2024-09-13T06:39:53.688 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.4307e-05 2024-09-13T06:39:53.688 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.688 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.688 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:39:53.688 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:19.559289+0000", 2024-09-13T06:39:53.688 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.2725999999999998e-05 2024-09-13T06:39:53.688 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.688 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.689 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:39:53.689 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:19.559306+0000", 2024-09-13T06:39:53.689 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7223000000000001e-05 2024-09-13T06:39:53.689 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.689 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.689 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:39:53.689 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:19.559475+0000", 2024-09-13T06:39:53.689 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000169025 2024-09-13T06:39:53.689 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.689 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.689 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op must wait for map", 2024-09-13T06:39:53.689 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:19.559486+0000", 2024-09-13T06:39:53.689 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0857e-05 2024-09-13T06:39:53.689 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.690 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.690 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:39:53.690 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:19.562891+0000", 2024-09-13T06:39:53.690 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.003405347 2024-09-13T06:39:53.690 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.690 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.690 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:39:53.690 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:19.563030+0000", 2024-09-13T06:39:53.690 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00013865899999999999 2024-09-13T06:39:53.690 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.690 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.690 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-13T06:39:53.690 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:19.563265+0000", 2024-09-13T06:39:53.691 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00023494799999999999 2024-09-13T06:39:53.691 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.691 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.691 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-13T06:39:53.691 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:19.564795+0000", 2024-09-13T06:39:53.691 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0015298079999999999 2024-09-13T06:39:53.691 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.691 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.691 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:39:53.691 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:19.565575+0000", 2024-09-13T06:39:53.691 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00078002400000000004 2024-09-13T06:39:53.691 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.691 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.692 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-13T06:39:53.692 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:19.565646+0000", 2024-09-13T06:39:53.692 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.1515999999999998e-05 2024-09-13T06:39:53.692 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.692 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.692 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:39:53.692 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:19.565700+0000", 2024-09-13T06:39:53.692 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.3909999999999997e-05 2024-09-13T06:39:53.692 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:53.692 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:39:53.692 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:53.692 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.692 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.692 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:368 3.c 3:30175a4c:::rbd_header.11214e25756e:head [call rbd.snapshot_add in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-13T06:39:53.693 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:33.401201+0000", 2024-09-13T06:39:53.693 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 20.280382294999999, 2024-09-13T06:39:53.693 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0094084609999999999, 2024-09-13T06:39:53.693 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:39:53.693 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:53.693 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:39:53.693 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:39:53.693 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:53.693 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 368 2024-09-13T06:39:53.693 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.693 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:39:53.693 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.694 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:39:53.694 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:33.401201+0000", 2024-09-13T06:39:53.694 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:53.694 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.694 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.694 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:39:53.694 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:33.401201+0000", 2024-09-13T06:39:53.694 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:53.694 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.694 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.694 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:39:53.694 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:33.401199+0000", 2024-09-13T06:39:53.695 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999976 2024-09-13T06:39:53.695 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.695 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.695 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:39:53.695 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:33.401211+0000", 2024-09-13T06:39:53.695 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.217e-05 2024-09-13T06:39:53.695 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.695 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.695 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:39:53.695 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:33.401232+0000", 2024-09-13T06:39:53.695 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.1355000000000001e-05 2024-09-13T06:39:53.695 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.695 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.696 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:39:53.696 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:33.401242+0000", 2024-09-13T06:39:53.696 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0091999999999999e-05 2024-09-13T06:39:53.696 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.696 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.696 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:39:53.696 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:33.401295+0000", 2024-09-13T06:39:53.696 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.2494999999999998e-05 2024-09-13T06:39:53.696 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.696 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.696 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op must wait for map", 2024-09-13T06:39:53.696 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:33.401300+0000", 2024-09-13T06:39:53.696 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.4840000000000003e-06 2024-09-13T06:39:53.697 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.697 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.697 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:39:53.697 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:33.407859+0000", 2024-09-13T06:39:53.697 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0065591160000000003 2024-09-13T06:39:53.697 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.697 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.697 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:39:53.697 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:33.407994+0000", 2024-09-13T06:39:53.697 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00013461300000000001 2024-09-13T06:39:53.697 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.697 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.698 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 3", 2024-09-13T06:39:53.698 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:33.408499+0000", 2024-09-13T06:39:53.698 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00050556600000000004 2024-09-13T06:39:53.698 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.698 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.698 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-13T06:39:53.698 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:33.409665+0000", 2024-09-13T06:39:53.698 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0011658840000000001 2024-09-13T06:39:53.698 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.698 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.698 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:39:53.699 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:33.410524+0000", 2024-09-13T06:39:53.699 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00085852200000000002 2024-09-13T06:39:53.699 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.699 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.699 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-13T06:39:53.699 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:33.410562+0000", 2024-09-13T06:39:53.699 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.7722999999999998e-05 2024-09-13T06:39:53.699 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.699 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.699 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:39:53.699 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:33.410609+0000", 2024-09-13T06:39:53.699 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.7673999999999998e-05 2024-09-13T06:39:53.699 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:53.700 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:39:53.700 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:53.700 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.700 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.700 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:495 3.c 3:30175a4c:::rbd_header.11214e25756e:head [call rbd.snapshot_remove in=18b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-09-13T06:39:53.700 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:34.413029+0000", 2024-09-13T06:39:53.700 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 19.268553832999999, 2024-09-13T06:39:53.700 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.011078490999999999, 2024-09-13T06:39:53.700 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:39:53.700 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:53.700 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:39:53.700 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:39:53.700 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:53.700 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 495 2024-09-13T06:39:53.701 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.701 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:39:53.701 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.701 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:39:53.701 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:34.413029+0000", 2024-09-13T06:39:53.701 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:53.701 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.701 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.701 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:39:53.701 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:34.413029+0000", 2024-09-13T06:39:53.701 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:53.701 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.701 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.702 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:39:53.702 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:34.413026+0000", 2024-09-13T06:39:53.702 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999967 2024-09-13T06:39:53.702 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.702 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.702 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:39:53.702 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:34.413043+0000", 2024-09-13T06:39:53.702 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7237000000000001e-05 2024-09-13T06:39:53.702 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.702 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.702 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:39:53.702 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:34.413081+0000", 2024-09-13T06:39:53.702 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.8112999999999999e-05 2024-09-13T06:39:53.702 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.703 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.703 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:39:53.703 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:34.413103+0000", 2024-09-13T06:39:53.703 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.2385999999999999e-05 2024-09-13T06:39:53.703 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.703 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.703 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:39:53.703 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:34.413241+0000", 2024-09-13T06:39:53.703 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00013729200000000001 2024-09-13T06:39:53.703 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.703 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.703 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op must wait for map", 2024-09-13T06:39:53.703 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:34.413252+0000", 2024-09-13T06:39:53.703 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1717e-05 2024-09-13T06:39:53.704 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.704 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.704 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:39:53.704 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:34.420767+0000", 2024-09-13T06:39:53.704 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.007514405 2024-09-13T06:39:53.704 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.704 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.704 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:39:53.704 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:34.420914+0000", 2024-09-13T06:39:53.704 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000147076 2024-09-13T06:39:53.704 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.704 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.704 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 3", 2024-09-13T06:39:53.705 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:34.421675+0000", 2024-09-13T06:39:53.705 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00076097999999999997 2024-09-13T06:39:53.705 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.705 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.705 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:39:53.705 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:34.423787+0000", 2024-09-13T06:39:53.705 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.002112414 2024-09-13T06:39:53.705 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.705 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.705 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-13T06:39:53.705 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:34.423810+0000", 2024-09-13T06:39:53.705 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.2453999999999999e-05 2024-09-13T06:39:53.705 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.706 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.706 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-13T06:39:53.706 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:34.423976+0000", 2024-09-13T06:39:53.706 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000165778 2024-09-13T06:39:53.706 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.706 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.706 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:39:53.706 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:34.424108+0000", 2024-09-13T06:39:53.706 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00013216200000000001 2024-09-13T06:39:53.706 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:53.706 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:39:53.706 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:53.706 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.706 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.707 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:543 3.16 3:6bcf1921:::rbd_data.11214e25756e.000000000000001a:head [delete] snapc 5=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-09-13T06:39:53.707 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:34.609838+0000", 2024-09-13T06:39:53.707 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 19.071745482000001, 2024-09-13T06:39:53.707 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0066085329999999998, 2024-09-13T06:39:53.707 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:39:53.707 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:53.707 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:39:53.707 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:39:53.707 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:53.707 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 543 2024-09-13T06:39:53.707 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.707 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:39:53.707 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.708 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:39:53.708 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:34.609838+0000", 2024-09-13T06:39:53.708 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:53.708 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.708 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.708 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:39:53.708 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:34.609838+0000", 2024-09-13T06:39:53.708 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:53.708 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.709 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.709 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:39:53.709 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:34.609836+0000", 2024-09-13T06:39:53.709 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999986 2024-09-13T06:39:53.709 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.709 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.709 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:39:53.709 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:34.609846+0000", 2024-09-13T06:39:53.709 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0263e-05 2024-09-13T06:39:53.709 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.709 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.709 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:39:53.709 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:34.609870+0000", 2024-09-13T06:39:53.709 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.3309e-05 2024-09-13T06:39:53.710 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.710 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.710 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:39:53.710 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:34.609887+0000", 2024-09-13T06:39:53.710 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7677e-05 2024-09-13T06:39:53.710 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.710 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.710 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:39:53.710 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:34.610920+0000", 2024-09-13T06:39:53.710 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.001032222 2024-09-13T06:39:53.710 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.710 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.710 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:39:53.710 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:34.611132+0000", 2024-09-13T06:39:53.711 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000211945 2024-09-13T06:39:53.711 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.711 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.711 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 7", 2024-09-13T06:39:53.711 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:34.611436+0000", 2024-09-13T06:39:53.711 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00030445800000000002 2024-09-13T06:39:53.711 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.711 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.711 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-13T06:39:53.711 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:34.613043+0000", 2024-09-13T06:39:53.711 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.001607081 2024-09-13T06:39:53.711 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.711 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.712 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:39:53.712 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:34.616293+0000", 2024-09-13T06:39:53.712 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0032495380000000002 2024-09-13T06:39:53.712 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.712 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.712 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-13T06:39:53.712 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:34.616380+0000", 2024-09-13T06:39:53.712 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.7802999999999999e-05 2024-09-13T06:39:53.712 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.712 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.712 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:39:53.712 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:34.616446+0000", 2024-09-13T06:39:53.712 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.5710000000000006e-05 2024-09-13T06:39:53.712 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:53.713 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:39:53.713 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:53.713 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.713 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.713 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:2338 3.1d 3:bf97f67e:::rbd_data.11212429e5ad.0000000000000031:head [delete] snapc 8=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-13T06:39:53.713 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:38.832797+0000", 2024-09-13T06:39:53.713 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 14.84878604, 2024-09-13T06:39:53.713 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00856319, 2024-09-13T06:39:53.713 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:39:53.713 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:39:53.713 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:39:53.713 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:39:53.713 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:53.714 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 2338 2024-09-13T06:39:53.714 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.714 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:39:53.714 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.714 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:39:53.714 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.832797+0000", 2024-09-13T06:39:53.714 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:53.714 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.714 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.714 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:39:53.714 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.832797+0000", 2024-09-13T06:39:53.714 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:53.714 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.714 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.715 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:39:53.715 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.832796+0000", 2024-09-13T06:39:53.715 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:39:53.715 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.715 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.715 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:39:53.715 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.832803+0000", 2024-09-13T06:39:53.715 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.9430000000000003e-06 2024-09-13T06:39:53.715 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.715 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.715 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:39:53.715 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.832822+0000", 2024-09-13T06:39:53.715 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.893e-05 2024-09-13T06:39:53.716 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.716 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.716 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:39:53.716 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.832837+0000", 2024-09-13T06:39:53.716 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.472e-05 2024-09-13T06:39:53.716 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.716 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.716 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:39:53.716 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.833177+0000", 2024-09-13T06:39:53.716 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000340787 2024-09-13T06:39:53.716 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.716 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.716 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:39:53.717 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.833498+0000", 2024-09-13T06:39:53.717 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00032089100000000001 2024-09-13T06:39:53.717 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.717 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.717 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:39:53.717 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.841360+0000", 2024-09-13T06:39:53.717 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0078620189999999996 2024-09-13T06:39:53.717 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:53.717 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:39:53.717 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:53.717 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.717 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.718 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:2347 3.16 3:6ed54f2e:::rbd_data.11212429e5ad.000000000000003c:head [delete] snapc 8=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-13T06:39:53.718 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:38.838489+0000", 2024-09-13T06:39:53.718 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 14.843093639999999, 2024-09-13T06:39:53.718 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0072517129999999999, 2024-09-13T06:39:53.718 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:39:53.718 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:39:53.718 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:39:53.718 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:39:53.718 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:53.719 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 2347 2024-09-13T06:39:53.719 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.719 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:39:53.719 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.719 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:39:53.719 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.838489+0000", 2024-09-13T06:39:53.719 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:53.719 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.719 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.719 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:39:53.719 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.838489+0000", 2024-09-13T06:39:53.719 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:53.720 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.720 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.720 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:39:53.720 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.838487+0000", 2024-09-13T06:39:53.720 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999976 2024-09-13T06:39:53.720 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.720 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.720 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:39:53.720 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.838502+0000", 2024-09-13T06:39:53.720 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5082999999999999e-05 2024-09-13T06:39:53.720 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.720 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.720 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:39:53.721 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.838538+0000", 2024-09-13T06:39:53.721 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.5905999999999998e-05 2024-09-13T06:39:53.721 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.721 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.721 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:39:53.721 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.838560+0000", 2024-09-13T06:39:53.721 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.1797000000000002e-05 2024-09-13T06:39:53.721 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.721 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.721 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:39:53.721 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.838683+0000", 2024-09-13T06:39:53.721 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000123566 2024-09-13T06:39:53.721 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.722 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.722 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:39:53.722 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.839043+0000", 2024-09-13T06:39:53.722 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00035978300000000002 2024-09-13T06:39:53.722 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.722 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.722 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:39:53.722 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.845741+0000", 2024-09-13T06:39:53.722 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.006698135 2024-09-13T06:39:53.722 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:53.722 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:39:53.722 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:53.722 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.722 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.723 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:2352 3.1d 3:bbeb2066:::rbd_data.11212429e5ad.0000000000000045:head [delete] snapc 8=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-13T06:39:53.723 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:38.839987+0000", 2024-09-13T06:39:53.723 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 14.841596125000001, 2024-09-13T06:39:53.723 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0070639079999999998, 2024-09-13T06:39:53.723 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:39:53.723 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:39:53.723 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:39:53.723 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:39:53.723 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:53.723 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 2352 2024-09-13T06:39:53.723 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.723 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:39:53.723 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.723 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:39:53.724 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.839987+0000", 2024-09-13T06:39:53.724 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:53.724 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.724 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.724 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:39:53.724 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.839987+0000", 2024-09-13T06:39:53.724 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:53.724 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.724 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.724 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:39:53.724 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.839984+0000", 2024-09-13T06:39:53.725 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999971 2024-09-13T06:39:53.725 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.725 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.725 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:39:53.725 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.839998+0000", 2024-09-13T06:39:53.725 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.4185999999999999e-05 2024-09-13T06:39:53.725 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.725 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.725 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:39:53.726 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.840030+0000", 2024-09-13T06:39:53.726 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.1590000000000001e-05 2024-09-13T06:39:53.726 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.726 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.726 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:39:53.726 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.840052+0000", 2024-09-13T06:39:53.726 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.1926e-05 2024-09-13T06:39:53.726 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.726 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.726 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:39:53.726 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.840179+0000", 2024-09-13T06:39:53.726 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00012688599999999999 2024-09-13T06:39:53.726 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.727 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.727 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:39:53.727 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.840492+0000", 2024-09-13T06:39:53.727 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00031314100000000002 2024-09-13T06:39:53.727 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.727 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.727 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:39:53.727 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.847051+0000", 2024-09-13T06:39:53.727 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0065589589999999996 2024-09-13T06:39:53.727 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:53.727 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:39:53.727 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:53.727 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.728 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.728 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:2370 3.c 3:33b14f9a:::rbd_data.11212429e5ad.00000000000000aa:head [delete] snapc 8=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-13T06:39:53.728 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:38.850355+0000", 2024-09-13T06:39:53.728 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 14.831227585000001, 2024-09-13T06:39:53.728 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0074079189999999998, 2024-09-13T06:39:53.728 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:39:53.728 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:39:53.728 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:39:53.728 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:39:53.728 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:53.728 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 2370 2024-09-13T06:39:53.728 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.728 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:39:53.728 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.729 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:39:53.729 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.850355+0000", 2024-09-13T06:39:53.729 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:53.729 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.729 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.729 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:39:53.729 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.850355+0000", 2024-09-13T06:39:53.729 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:53.729 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.729 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.730 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:39:53.730 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.850353+0000", 2024-09-13T06:39:53.730 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999971 2024-09-13T06:39:53.730 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.730 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.730 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:39:53.730 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.850368+0000", 2024-09-13T06:39:53.730 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5426000000000001e-05 2024-09-13T06:39:53.730 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.730 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.730 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:39:53.730 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.850413+0000", 2024-09-13T06:39:53.730 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.4910000000000002e-05 2024-09-13T06:39:53.731 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.731 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.731 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:39:53.731 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.850436+0000", 2024-09-13T06:39:53.731 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.2776999999999999e-05 2024-09-13T06:39:53.731 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.731 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.731 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:39:53.731 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.850568+0000", 2024-09-13T06:39:53.731 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00013224499999999999 2024-09-13T06:39:53.731 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.731 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.731 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:39:53.731 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.850877+0000", 2024-09-13T06:39:53.732 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00030922399999999998 2024-09-13T06:39:53.732 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.732 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.732 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:39:53.732 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.857763+0000", 2024-09-13T06:39:53.732 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0068861269999999997 2024-09-13T06:39:53.732 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:53.732 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:39:53.732 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:53.732 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.732 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.732 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop(client.4385.0:2391 3.17 e31/21 3:ef90b167:::rbd_data.11212429e5ad.000000000000010b:head v 31'3, mlcod=31'1)", 2024-09-13T06:39:53.733 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:38.859918+0000", 2024-09-13T06:39:53.733 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 14.821664686, 2024-09-13T06:39:53.733 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0077607529999999996, 2024-09-13T06:39:53.733 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:39:53.733 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:53.733 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:39:53.733 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.733 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:39:53.733 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.859918+0000", 2024-09-13T06:39:53.733 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:53.733 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.733 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.733 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:39:53.734 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.859918+0000", 2024-09-13T06:39:53.734 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:53.734 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.734 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.734 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:39:53.734 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.859916+0000", 2024-09-13T06:39:53.734 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999981 2024-09-13T06:39:53.734 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.734 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.734 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:39:53.734 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.859944+0000", 2024-09-13T06:39:53.734 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.7827e-05 2024-09-13T06:39:53.734 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.734 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.735 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:39:53.735 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.859982+0000", 2024-09-13T06:39:53.735 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.7666000000000002e-05 2024-09-13T06:39:53.735 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.735 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.735 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:39:53.735 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.860001+0000", 2024-09-13T06:39:53.735 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.8615999999999999e-05 2024-09-13T06:39:53.735 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.735 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.736 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:39:53.736 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.860110+0000", 2024-09-13T06:39:53.736 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000109493 2024-09-13T06:39:53.736 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.736 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.736 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:39:53.736 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.860169+0000", 2024-09-13T06:39:53.736 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.8672999999999999e-05 2024-09-13T06:39:53.736 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.736 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.736 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-13T06:39:53.737 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.867603+0000", 2024-09-13T06:39:53.737 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.007434286 2024-09-13T06:39:53.737 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.737 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.737 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:39:53.737 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.867679+0000", 2024-09-13T06:39:53.737 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.6099000000000004e-05 2024-09-13T06:39:53.737 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:53.737 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:39:53.737 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:53.737 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.737 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.737 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:2393 3.16 3:6e357f53:::rbd_data.11212429e5ad.000000000000013d:head [delete] snapc 8=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-13T06:39:53.738 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:38.860707+0000", 2024-09-13T06:39:53.738 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 14.820875909, 2024-09-13T06:39:53.738 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0070848990000000004, 2024-09-13T06:39:53.738 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:39:53.738 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:53.738 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:39:53.738 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:39:53.738 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:53.739 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 2393 2024-09-13T06:39:53.739 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.739 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:39:53.739 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.739 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:39:53.739 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.860707+0000", 2024-09-13T06:39:53.739 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:53.740 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.740 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.740 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:39:53.740 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.860707+0000", 2024-09-13T06:39:53.740 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:53.740 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.740 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.740 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:39:53.740 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.860705+0000", 2024-09-13T06:39:53.740 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999981 2024-09-13T06:39:53.740 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.740 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.740 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:39:53.741 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.860716+0000", 2024-09-13T06:39:53.741 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1199999999999999e-05 2024-09-13T06:39:53.741 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.741 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.741 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:39:53.741 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.860747+0000", 2024-09-13T06:39:53.741 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.0102000000000001e-05 2024-09-13T06:39:53.741 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.741 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.741 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:39:53.741 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.860765+0000", 2024-09-13T06:39:53.741 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.8323999999999999e-05 2024-09-13T06:39:53.742 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.742 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.742 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:39:53.742 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.860859+0000", 2024-09-13T06:39:53.742 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.3936000000000003e-05 2024-09-13T06:39:53.742 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.742 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.742 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:39:53.742 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.861025+0000", 2024-09-13T06:39:53.742 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00016648800000000001 2024-09-13T06:39:53.743 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.743 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.743 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 7", 2024-09-13T06:39:53.743 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.861217+0000", 2024-09-13T06:39:53.743 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000191576 2024-09-13T06:39:53.743 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.743 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.743 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:39:53.743 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.865095+0000", 2024-09-13T06:39:53.743 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0038781269999999999 2024-09-13T06:39:53.743 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.743 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.743 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-13T06:39:53.743 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.867541+0000", 2024-09-13T06:39:53.744 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.002445834 2024-09-13T06:39:53.744 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.744 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.744 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-13T06:39:53.744 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.867683+0000", 2024-09-13T06:39:53.744 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00014221200000000001 2024-09-13T06:39:53.744 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.744 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.744 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:39:53.744 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.867792+0000", 2024-09-13T06:39:53.744 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00010901299999999999 2024-09-13T06:39:53.744 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:53.744 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:39:53.745 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:53.745 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.745 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.745 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:2394 3.5 3:a18f5e28:::rbd_data.11212429e5ad.0000000000000219:head [delete] snapc 8=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-13T06:39:53.745 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:38.860871+0000", 2024-09-13T06:39:53.745 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 14.820712127, 2024-09-13T06:39:53.745 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0069226130000000002, 2024-09-13T06:39:53.745 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:39:53.745 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:53.745 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:39:53.746 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:39:53.746 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:53.746 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 2394 2024-09-13T06:39:53.746 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.746 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:39:53.746 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.746 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:39:53.746 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.860871+0000", 2024-09-13T06:39:53.746 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:53.746 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.746 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.746 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:39:53.747 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.860871+0000", 2024-09-13T06:39:53.747 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:53.747 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.747 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.747 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:39:53.747 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.860870+0000", 2024-09-13T06:39:53.747 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:39:53.747 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.747 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.747 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:39:53.747 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.860877+0000", 2024-09-13T06:39:53.747 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.277e-06 2024-09-13T06:39:53.747 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.747 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.748 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:39:53.748 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.860897+0000", 2024-09-13T06:39:53.748 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.9530000000000001e-05 2024-09-13T06:39:53.748 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.748 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.748 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:39:53.748 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.860907+0000", 2024-09-13T06:39:53.748 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0396e-05 2024-09-13T06:39:53.748 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.748 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.748 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:39:53.748 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.861020+0000", 2024-09-13T06:39:53.748 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000113006 2024-09-13T06:39:53.749 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.749 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.749 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:39:53.749 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.861148+0000", 2024-09-13T06:39:53.749 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00012793200000000001 2024-09-13T06:39:53.749 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.749 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.749 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 3", 2024-09-13T06:39:53.749 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.861311+0000", 2024-09-13T06:39:53.749 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00016286600000000001 2024-09-13T06:39:53.749 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.749 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.750 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:39:53.750 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.863229+0000", 2024-09-13T06:39:53.750 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.001918052 2024-09-13T06:39:53.750 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.750 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.750 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-13T06:39:53.750 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.867549+0000", 2024-09-13T06:39:53.750 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0043200799999999996 2024-09-13T06:39:53.750 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.750 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.750 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-13T06:39:53.751 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.867700+0000", 2024-09-13T06:39:53.751 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00015136199999999999 2024-09-13T06:39:53.751 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.751 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.751 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:39:53.751 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.867794+0000", 2024-09-13T06:39:53.751 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.3249000000000001e-05 2024-09-13T06:39:53.751 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:53.751 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:39:53.751 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:53.751 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.751 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.751 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop(client.4385.0:2392 3.1f e31/21 3:fdec2555:::rbd_data.11212429e5ad.000000000000010c:head v 31'6, mlcod=31'3)", 2024-09-13T06:39:53.751 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:38.861004+0000", 2024-09-13T06:39:53.751 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 14.820579558, 2024-09-13T06:39:53.752 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0067347520000000001, 2024-09-13T06:39:53.752 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:39:53.752 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:53.752 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:39:53.752 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.752 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:39:53.752 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.861004+0000", 2024-09-13T06:39:53.752 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:53.752 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.752 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.752 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:39:53.752 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.861004+0000", 2024-09-13T06:39:53.752 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:53.752 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.753 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.753 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:39:53.753 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.861003+0000", 2024-09-13T06:39:53.753 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:39:53.753 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.753 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.753 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:39:53.753 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.861010+0000", 2024-09-13T06:39:53.753 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.6000000000000001e-06 2024-09-13T06:39:53.753 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.753 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.753 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:39:53.753 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.861023+0000", 2024-09-13T06:39:53.753 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2347000000000001e-05 2024-09-13T06:39:53.754 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.754 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.754 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:39:53.754 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.861030+0000", 2024-09-13T06:39:53.754 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.8760000000000005e-06 2024-09-13T06:39:53.754 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.754 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.754 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:39:53.754 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.861122+0000", 2024-09-13T06:39:53.754 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.1773000000000004e-05 2024-09-13T06:39:53.754 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.754 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.754 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:39:53.754 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.861172+0000", 2024-09-13T06:39:53.755 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.0266000000000003e-05 2024-09-13T06:39:53.755 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.755 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.755 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-13T06:39:53.755 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.867684+0000", 2024-09-13T06:39:53.755 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.006511714 2024-09-13T06:39:53.755 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.755 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.755 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:39:53.755 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.867738+0000", 2024-09-13T06:39:53.755 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.4042999999999997e-05 2024-09-13T06:39:53.755 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:53.755 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:39:53.756 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:53.756 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.756 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.756 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:2420 3.1d 3:bd13e332:::rbd_data.11212429e5ad.0000000000000021:head [truncate 65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-13T06:39:53.756 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:38.889959+0000", 2024-09-13T06:39:53.756 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 14.791623568, 2024-09-13T06:39:53.756 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0068746399999999996, 2024-09-13T06:39:53.756 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:39:53.756 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:39:53.757 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:39:53.757 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:39:53.757 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:53.757 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 2420 2024-09-13T06:39:53.757 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.757 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:39:53.757 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.757 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:39:53.757 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.889959+0000", 2024-09-13T06:39:53.757 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:53.757 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.757 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.757 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:39:53.758 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.889959+0000", 2024-09-13T06:39:53.758 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:53.758 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.758 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.758 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:39:53.758 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.889957+0000", 2024-09-13T06:39:53.758 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999976 2024-09-13T06:39:53.758 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.758 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.758 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:39:53.758 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.889971+0000", 2024-09-13T06:39:53.758 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.4217e-05 2024-09-13T06:39:53.758 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.759 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.759 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:39:53.759 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.890001+0000", 2024-09-13T06:39:53.759 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.0049999999999999e-05 2024-09-13T06:39:53.759 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.759 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.759 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:39:53.759 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.890021+0000", 2024-09-13T06:39:53.759 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.0129e-05 2024-09-13T06:39:53.759 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.759 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.759 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:39:53.759 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.890106+0000", 2024-09-13T06:39:53.759 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.4396999999999998e-05 2024-09-13T06:39:53.760 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.760 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.760 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:39:53.760 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.890346+0000", 2024-09-13T06:39:53.760 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000240564 2024-09-13T06:39:53.760 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.760 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.760 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:39:53.760 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:38.896834+0000", 2024-09-13T06:39:53.760 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0064876999999999999 2024-09-13T06:39:53.760 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:53.760 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:39:53.760 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:53.761 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.761 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.761 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:2637 3.c 3:34346ebf:::rbd_data.11212429e5ad.00000000000001e5:head [set-alloc-hint object_size 262144 write_size 262144,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-13T06:39:53.761 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:39.279539+0000", 2024-09-13T06:39:53.761 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 14.402044471, 2024-09-13T06:39:53.761 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.026144222000000002, 2024-09-13T06:39:53.761 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:39:53.761 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:53.761 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:39:53.761 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:39:53.761 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:53.761 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 2637 2024-09-13T06:39:53.761 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.762 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:39:53.762 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.762 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:39:53.762 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:39.279539+0000", 2024-09-13T06:39:53.762 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:53.762 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.762 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.762 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:39:53.762 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:39.279539+0000", 2024-09-13T06:39:53.762 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:53.762 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.762 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.762 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:39:53.763 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:39.279537+0000", 2024-09-13T06:39:53.763 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999986 2024-09-13T06:39:53.763 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.763 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.763 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:39:53.763 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:39.279547+0000", 2024-09-13T06:39:53.763 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.04e-05 2024-09-13T06:39:53.763 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.763 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.763 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:39:53.763 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:39.279571+0000", 2024-09-13T06:39:53.763 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.3166000000000001e-05 2024-09-13T06:39:53.763 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.764 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.764 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:39:53.764 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:39.279583+0000", 2024-09-13T06:39:53.764 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2693e-05 2024-09-13T06:39:53.764 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.764 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.764 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:39:53.764 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:39.279667+0000", 2024-09-13T06:39:53.764 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.3780000000000001e-05 2024-09-13T06:39:53.764 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.764 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.764 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:39:53.764 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:39.279888+0000", 2024-09-13T06:39:53.764 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000220435 2024-09-13T06:39:53.765 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.765 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.765 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 3", 2024-09-13T06:39:53.765 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:39.284649+0000", 2024-09-13T06:39:53.765 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0047618900000000004 2024-09-13T06:39:53.765 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.765 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.765 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-13T06:39:53.765 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:39.305310+0000", 2024-09-13T06:39:53.765 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.020660917000000001 2024-09-13T06:39:53.765 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.765 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.765 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:39:53.765 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:39.305434+0000", 2024-09-13T06:39:53.766 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000124179 2024-09-13T06:39:53.766 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.766 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.766 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-13T06:39:53.766 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:39.305580+0000", 2024-09-13T06:39:53.766 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00014571899999999999 2024-09-13T06:39:53.766 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.766 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.766 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:39:53.766 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:39.305683+0000", 2024-09-13T06:39:53.766 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000102593 2024-09-13T06:39:53.766 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:53.766 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:39:53.766 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:53.767 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.767 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.767 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop_reply(client.4385.0:2637 3.c e31/21 ondisk, result = 0)", 2024-09-13T06:39:53.767 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:39.295093+0000", 2024-09-13T06:39:53.767 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 14.386490101, 2024-09-13T06:39:53.767 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.010611122000000001, 2024-09-13T06:39:53.767 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:39:53.767 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:39:53.767 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:39:53.767 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.767 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:39:53.767 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:39.295093+0000", 2024-09-13T06:39:53.767 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:53.767 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.768 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.768 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:39:53.768 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:39.295093+0000", 2024-09-13T06:39:53.768 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:53.768 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.768 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.768 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:39:53.768 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:39.295084+0000", 2024-09-13T06:39:53.768 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999909 2024-09-13T06:39:53.768 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.769 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.769 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:39:53.769 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:39.295105+0000", 2024-09-13T06:39:53.769 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.1209e-05 2024-09-13T06:39:53.769 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.769 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.769 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:39:53.769 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:39.295142+0000", 2024-09-13T06:39:53.769 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.6940000000000002e-05 2024-09-13T06:39:53.769 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.769 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.769 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:39:53.769 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:39.295164+0000", 2024-09-13T06:39:53.769 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.1974e-05 2024-09-13T06:39:53.770 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.770 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.770 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:39:53.770 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:39.305394+0000", 2024-09-13T06:39:53.770 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.010229911 2024-09-13T06:39:53.770 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.770 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.770 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:39:53.770 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:39.305416+0000", 2024-09-13T06:39:53.770 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.1776e-05 2024-09-13T06:39:53.770 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.770 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.770 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:39:53.771 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:39.305704+0000", 2024-09-13T06:39:53.771 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00028855200000000003 2024-09-13T06:39:53.771 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:53.771 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:39:53.771 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:53.771 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.771 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.771 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:2698 3.1c 3:3e5fcbe2:::rbd_data.11212429e5ad.000000000000024c:head [delete] snapc 8=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-13T06:39:53.771 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:39.432490+0000", 2024-09-13T06:39:53.771 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 14.249092725000001, 2024-09-13T06:39:53.771 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0064328299999999996, 2024-09-13T06:39:53.771 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:39:53.771 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:53.771 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:39:53.772 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:39:53.772 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:53.772 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 2698 2024-09-13T06:39:53.772 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.772 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:39:53.772 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.772 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:39:53.772 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:39.432490+0000", 2024-09-13T06:39:53.772 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:53.772 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.772 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.772 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:39:53.773 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:39.432490+0000", 2024-09-13T06:39:53.773 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:53.773 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.773 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.773 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:39:53.773 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:39.432487+0000", 2024-09-13T06:39:53.773 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999971 2024-09-13T06:39:53.773 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.773 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.774 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:39:53.774 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:39.432504+0000", 2024-09-13T06:39:53.774 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6480000000000001e-05 2024-09-13T06:39:53.774 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.774 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.774 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:39:53.774 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:39.432540+0000", 2024-09-13T06:39:53.774 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.6298999999999999e-05 2024-09-13T06:39:53.774 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.774 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.774 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:39:53.774 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:39.432564+0000", 2024-09-13T06:39:53.774 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.4216999999999999e-05 2024-09-13T06:39:53.774 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.775 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.775 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:39:53.775 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:39.432695+0000", 2024-09-13T06:39:53.775 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000130312 2024-09-13T06:39:53.775 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.775 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.775 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:39:53.775 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:39.433332+0000", 2024-09-13T06:39:53.775 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00063734200000000005 2024-09-13T06:39:53.775 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.775 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.775 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 4", 2024-09-13T06:39:53.775 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:39.433640+0000", 2024-09-13T06:39:53.775 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00030837099999999999 2024-09-13T06:39:53.776 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.776 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.776 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-13T06:39:53.776 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:39.438205+0000", 2024-09-13T06:39:53.776 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0045651140000000003 2024-09-13T06:39:53.776 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.776 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.776 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:39:53.776 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:39.438633+0000", 2024-09-13T06:39:53.776 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00042783699999999998 2024-09-13T06:39:53.776 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.776 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.776 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-13T06:39:53.776 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:39.438824+0000", 2024-09-13T06:39:53.777 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00019104899999999999 2024-09-13T06:39:53.777 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.777 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.777 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:39:53.777 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:39.438923+0000", 2024-09-13T06:39:53.777 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.8791999999999999e-05 2024-09-13T06:39:53.777 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:53.777 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:39:53.777 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:53.777 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.777 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.777 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop(client.4385.0:18041 3.2 e43/21 3:45a2e498:::rbd_data.1121f2c5ee81.000000000000006e:head v 43'16, mlcod=41'14)", 2024-09-13T06:39:53.777 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.681346+0000", 2024-09-13T06:39:53.778 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 2.0002374679999999, 2024-09-13T06:39:53.778 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0096021490000000008, 2024-09-13T06:39:53.778 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:39:53.778 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:53.778 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:39:53.778 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.778 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:39:53.778 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.681346+0000", 2024-09-13T06:39:53.778 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:53.778 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.778 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.778 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:39:53.778 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.681346+0000", 2024-09-13T06:39:53.779 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:53.779 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.779 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.779 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:39:53.779 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.681343+0000", 2024-09-13T06:39:53.779 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999976 2024-09-13T06:39:53.779 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.779 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.779 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:39:53.779 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.682466+0000", 2024-09-13T06:39:53.779 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.001122861 2024-09-13T06:39:53.779 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.779 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.780 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:39:53.780 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.682508+0000", 2024-09-13T06:39:53.780 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.1885999999999998e-05 2024-09-13T06:39:53.780 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.780 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.780 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:39:53.780 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.682529+0000", 2024-09-13T06:39:53.780 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.1327000000000001e-05 2024-09-13T06:39:53.780 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.780 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.780 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:39:53.780 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.682639+0000", 2024-09-13T06:39:53.780 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000110049 2024-09-13T06:39:53.781 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.781 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.781 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:39:53.781 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.682700+0000", 2024-09-13T06:39:53.781 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.0992999999999997e-05 2024-09-13T06:39:53.781 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.781 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.781 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-13T06:39:53.781 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.690848+0000", 2024-09-13T06:39:53.781 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0081473259999999999 2024-09-13T06:39:53.781 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.781 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.781 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:39:53.781 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.690948+0000", 2024-09-13T06:39:53.782 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.9970000000000007e-05 2024-09-13T06:39:53.782 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:53.782 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:39:53.782 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:53.782 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.782 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.782 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop(client.4385.0:18042 3.1f e43/21 3:fbdf63ee:::rbd_data.1121f2c5ee81.000000000000006f:head v 43'118, mlcod=39'116)", 2024-09-13T06:39:53.782 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.681494+0000", 2024-09-13T06:39:53.782 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 2.0000887920000001, 2024-09-13T06:39:53.782 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.011891720999999999, 2024-09-13T06:39:53.782 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:39:53.782 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:53.782 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:39:53.783 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.783 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:39:53.783 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.681494+0000", 2024-09-13T06:39:53.783 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:53.783 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.783 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.783 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:39:53.784 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.681494+0000", 2024-09-13T06:39:53.784 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:53.784 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.784 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.784 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:39:53.784 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.681494+0000", 2024-09-13T06:39:53.784 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:39:53.784 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.784 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.784 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:39:53.785 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.683269+0000", 2024-09-13T06:39:53.785 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.001775506 2024-09-13T06:39:53.785 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.785 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.785 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:39:53.785 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.683291+0000", 2024-09-13T06:39:53.785 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.1852999999999999e-05 2024-09-13T06:39:53.785 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.785 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.785 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:39:53.785 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.683302+0000", 2024-09-13T06:39:53.785 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0413e-05 2024-09-13T06:39:53.785 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.785 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.786 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:39:53.786 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.683456+0000", 2024-09-13T06:39:53.786 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00015489200000000001 2024-09-13T06:39:53.786 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.786 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.786 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:39:53.786 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.683552+0000", 2024-09-13T06:39:53.786 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.5870000000000002e-05 2024-09-13T06:39:53.786 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.786 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.786 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-13T06:39:53.786 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.693278+0000", 2024-09-13T06:39:53.786 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.009725605 2024-09-13T06:39:53.787 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.787 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.787 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:39:53.787 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.693386+0000", 2024-09-13T06:39:53.787 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00010804200000000001 2024-09-13T06:39:53.787 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:53.787 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:39:53.787 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:53.787 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.787 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.787 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:20719 3.d 3:b1cb669d:::rbd_data.1121f2c5ee81.00000000000000f3:head [write 147456~376832 [fadvise_sequential+fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:39:53.788 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:52.698195+0000", 2024-09-13T06:39:53.788 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.98338828599999994, 2024-09-13T06:39:53.788 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0059711039999999996, 2024-09-13T06:39:53.788 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:39:53.788 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:53.788 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:39:53.788 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:39:53.788 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:53.788 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 20719 2024-09-13T06:39:53.788 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.788 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:39:53.788 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.788 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:39:53.789 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:52.698195+0000", 2024-09-13T06:39:53.789 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:53.789 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.789 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.789 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:39:53.789 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:52.698195+0000", 2024-09-13T06:39:53.789 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:53.789 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.789 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.789 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:39:53.790 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:52.698191+0000", 2024-09-13T06:39:53.790 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999967 2024-09-13T06:39:53.790 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.790 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.790 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:39:53.790 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:52.699342+0000", 2024-09-13T06:39:53.790 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.001151004 2024-09-13T06:39:53.790 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.790 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.790 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:39:53.790 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:52.699379+0000", 2024-09-13T06:39:53.790 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.7089999999999999e-05 2024-09-13T06:39:53.790 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.791 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.791 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:39:53.791 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:52.699396+0000", 2024-09-13T06:39:53.791 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6277e-05 2024-09-13T06:39:53.791 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.791 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.791 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:39:53.791 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:52.699528+0000", 2024-09-13T06:39:53.791 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00013211899999999999 2024-09-13T06:39:53.791 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.791 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.791 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:39:53.792 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:52.699884+0000", 2024-09-13T06:39:53.792 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00035601699999999998 2024-09-13T06:39:53.792 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.792 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.792 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 6", 2024-09-13T06:39:53.792 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:52.700195+0000", 2024-09-13T06:39:53.792 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00031111399999999998 2024-09-13T06:39:53.792 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.792 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.792 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:39:53.792 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:52.703226+0000", 2024-09-13T06:39:53.792 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0030312569999999999 2024-09-13T06:39:53.792 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.793 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.793 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-13T06:39:53.793 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:52.704061+0000", 2024-09-13T06:39:53.793 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00083446799999999999 2024-09-13T06:39:53.793 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.793 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.793 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-13T06:39:53.793 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:52.704121+0000", 2024-09-13T06:39:53.793 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.0061e-05 2024-09-13T06:39:53.793 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:53.793 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:53.793 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:39:53.793 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:52.704166+0000", 2024-09-13T06:39:53.794 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.5157000000000002e-05 2024-09-13T06:39:53.794 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:53.794 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:39:53.794 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:53.794 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:53.794 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:39:53.794 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:39:53.795 INFO:teuthology.orchestra.run.smithi081.stdout:checking clone #3, image image_client.0-clone3 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent4 2024-09-13T06:39:53.795 INFO:teuthology.orchestra.run.smithi081.stdout:osd.0: {} 2024-09-13T06:39:53.796 INFO:teuthology.orchestra.run.smithi081.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-13T06:39:53.796 INFO:teuthology.orchestra.run.smithi081.stdout:osd.1: {} 2024-09-13T06:39:53.797 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-13T06:39:53.797 INFO:teuthology.orchestra.run.smithi081.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-13T06:39:53.798 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:39:53.799+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:39:53.798 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:39:53.798 INFO:teuthology.orchestra.run.smithi139.stdout: "success": "filestore_inject_stall = '' (not observed, change may require restart) " 2024-09-13T06:39:53.798 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:39:53.802 INFO:teuthology.orchestra.run.smithi081.stdout:osd.2: {} 2024-09-13T06:39:53.803 INFO:teuthology.orchestra.run.smithi081.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-13T06:39:53.819 INFO:teuthology.orchestra.run.smithi081.stdout:osd.3: {} 2024-09-13T06:39:53.819 INFO:teuthology.orchestra.run.smithi081.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-13T06:39:53.840 INFO:teuthology.orchestra.run.smithi081.stdout:osd.4: {} 2024-09-13T06:39:53.840 INFO:teuthology.orchestra.run.smithi081.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-13T06:39:53.860 INFO:teuthology.orchestra.run.smithi081.stdout:osd.5: {} 2024-09-13T06:39:53.861 INFO:teuthology.orchestra.run.smithi081.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-13T06:39:53.896 INFO:tasks.ceph.osd.6.smithi139.stderr:2024-09-13T06:39:53.898+0000 7fcd02c5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26385) UID: 0 2024-09-13T06:39:53.897 INFO:teuthology.orchestra.run.smithi081.stdout:osd.6: {} 2024-09-13T06:39:53.897 INFO:teuthology.orchestra.run.smithi081.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-13T06:39:53.931 INFO:teuthology.orchestra.run.smithi081.stdout:osd.7: {} 2024-09-13T06:39:53.931 INFO:teuthology.orchestra.run.smithi081.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-13T06:39:53.971 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:39:53.971 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:39:53.985 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-13T06:39:54.027 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-13T06:39:54.030+0000 7f86a5f06640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26387) UID: 0 2024-09-13T06:39:54.098 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:39:54.099+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:39:54.151 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:39:54.151 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:39:54.166 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-13T06:39:54.167 INFO:teuthology.orchestra.run.smithi081.stdout:568 writesame 0xa870baf thru 0xa87606c data_size 0x1(0x54be bytes) 2024-09-13T06:39:54.188 INFO:teuthology.orchestra.run.smithi081.stdout:571 read 0xc230a46 thru 0xc235b1b (0x50d6 bytes) 2024-09-13T06:39:54.188 INFO:teuthology.orchestra.run.smithi081.stdout:572 read 0x9c4b946 thru 0x9c58b34 (0xd1ef bytes) 2024-09-13T06:39:54.188 INFO:teuthology.orchestra.run.smithi081.stdout:573 punch from 0x73f73f5 to 0x73fa5a8, (0x31b3 bytes) 2024-09-13T06:39:54.199 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:39:54.203+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:39:54.202 INFO:teuthology.orchestra.run.smithi081.stdout:574 trunc from 0xdbd291f to 0x42b8a2d 2024-09-13T06:39:54.244 INFO:teuthology.orchestra.run.smithi081.stdout:575 punch from 0xec1577 to 0xeca081, (0x8b0a bytes) 2024-09-13T06:39:54.257 INFO:teuthology.orchestra.run.smithi081.stdout:577 write 0x715a2f1 thru 0x715fccf (0x59df bytes) 2024-09-13T06:39:54.282 INFO:teuthology.orchestra.run.smithi081.stdout:578 write 0x79ccce1 thru 0x79ce55f (0x187f bytes) 2024-09-13T06:39:54.290 INFO:teuthology.orchestra.run.smithi081.stdout:580 read 0x41f6211 thru 0x4205ca2 (0xfa92 bytes) 2024-09-13T06:39:54.292 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:39:54.292 INFO:teuthology.orchestra.run.smithi081.stdout:582 punch from 0x3df2394 to 0x3e00ddd, (0xea49 bytes) 2024-09-13T06:39:54.292 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:39:54.292 INFO:teuthology.orchestra.run.smithi081.stdout:584 writesame 0x27580c9 thru 0x275c0ae data_size 0x1(0x3fe6 bytes) 2024-09-13T06:39:54.298 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:39:54.298 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:39:54.299 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:39:54.302+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:39:54.301 INFO:teuthology.orchestra.run.smithi081.stdout:585 punch from 0x47e7c97 to 0x47ee6d8, (0x6a41 bytes) 2024-09-13T06:39:54.302 INFO:teuthology.orchestra.run.smithi081.stdout:586 punch from 0x6780c4f to 0x678df1c, (0xd2cd bytes) 2024-09-13T06:39:54.302 INFO:teuthology.orchestra.run.smithi081.stdout:587 read 0x67e95f6 thru 0x67f3911 (0xa31c bytes) 2024-09-13T06:39:54.302 INFO:teuthology.orchestra.run.smithi081.stdout:589 read 0x28b6ffd thru 0x28b758f (0x593 bytes) 2024-09-13T06:39:54.302 INFO:teuthology.orchestra.run.smithi081.stdout:590 read 0x73e2eca thru 0x73e38d4 (0xa0b bytes) 2024-09-13T06:39:54.302 INFO:teuthology.orchestra.run.smithi081.stdout:591 read 0x1f8122c thru 0x1f84f8e (0x3d63 bytes) 2024-09-13T06:39:54.314 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-13T06:39:54.324 INFO:teuthology.orchestra.run.smithi081.stdout:592 write 0xb333b2b thru 0xb33a4fe (0x69d4 bytes) 2024-09-13T06:39:54.342 INFO:teuthology.orchestra.run.smithi081.stdout:594 write 0x5f7d229 thru 0x5f8c7d7 (0xf5af bytes) 2024-09-13T06:39:54.361 INFO:teuthology.orchestra.run.smithi081.stdout:595 read 0x42bf60 thru 0x439f4a (0xdfeb bytes) 2024-09-13T06:39:54.370 INFO:teuthology.orchestra.run.smithi081.stdout:596 trunc from 0xb33a4ff to 0xdc7190c 2024-09-13T06:39:54.381 INFO:teuthology.orchestra.run.smithi081.stdout:597 punch from 0xd2ead4e to 0xd2f0046, (0x52f8 bytes) 2024-09-13T06:39:54.381 INFO:teuthology.orchestra.run.smithi081.stdout:598 write 0x2c806c7 thru 0x2c88ded (0x8727 bytes) 2024-09-13T06:39:54.400 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:39:54.403+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:39:54.413 INFO:teuthology.orchestra.run.smithi081.stdout:601 write 0xe8df602 thru 0xe8ebd1a (0xc719 bytes) 2024-09-13T06:39:54.438 INFO:teuthology.orchestra.run.smithi081.stdout:602 punch from 0x67d1dfc to 0x67dc425, (0xa629 bytes) 2024-09-13T06:39:54.447 INFO:teuthology.orchestra.run.smithi081.stdout:604 trunc from 0xe8ebd1b to 0xac8d07c 2024-09-13T06:39:54.468 INFO:teuthology.orchestra.run.smithi081.stdout:605 writesame 0x2cc53d6 thru 0x2cc8c35 data_size 0x29(0x3860 bytes) 2024-09-13T06:39:54.472 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:39:54.482 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:39:54.482 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:39:54.494 INFO:teuthology.orchestra.run.smithi081.stdout:607 trunc from 0xac8d07c to 0xded02a 2024-09-13T06:39:54.496 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-13T06:39:54.502 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:39:54.503+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:39:54.586 INFO:teuthology.orchestra.run.smithi081.stdout:608 write 0x80bd42d thru 0x80c4ceb (0x78bf bytes) 2024-09-13T06:39:54.600 INFO:teuthology.orchestra.run.smithi081.stdout:609 writesame 0x3364c8a thru 0x3367869 data_size 0x60(0x2be0 bytes) 2024-09-13T06:39:54.603 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:39:54.607+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:39:54.612 INFO:teuthology.orchestra.run.smithi081.stdout:610 writesame 0x6e21413 thru 0x6e2a0d6 data_size 0x34(0x8cc4 bytes) 2024-09-13T06:39:54.626 INFO:teuthology.orchestra.run.smithi081.stdout:611 writesame 0x4445770 thru 0x4447934 data_size 0x7(0x21c5 bytes) 2024-09-13T06:39:54.628 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:39:54.628 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:39:54.644 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-13T06:39:54.654 INFO:teuthology.orchestra.run.smithi081.stdout:613 write 0xb659aa6 thru 0xb667506 (0xda61 bytes) 2024-09-13T06:39:54.670 INFO:teuthology.orchestra.run.smithi081.stdout:616 read 0x62dc1a thru 0x6336c3 (0x5aaa bytes) 2024-09-13T06:39:54.671 INFO:teuthology.orchestra.run.smithi081.stdout:617 read 0x43d9b9f thru 0x43e38a6 (0x9d08 bytes) 2024-09-13T06:39:54.671 INFO:teuthology.orchestra.run.smithi081.stdout:618 write 0x1bf2525 thru 0x1c01769 (0xf245 bytes) 2024-09-13T06:39:54.688 INFO:teuthology.orchestra.run.smithi081.stdout:619 read 0x9e0e91b thru 0x9e1e1a5 (0xf88b bytes) 2024-09-13T06:39:54.689 INFO:teuthology.orchestra.run.smithi081.stdout:621 trunc from 0xb667507 to 0xc1df17e 2024-09-13T06:39:54.696 INFO:teuthology.orchestra.run.smithi081.stdout:622 write 0xbc7faa3 thru 0xbc8cf10 (0xd46e bytes) 2024-09-13T06:39:54.703 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:39:54.707+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:39:54.721 INFO:teuthology.orchestra.run.smithi081.stdout:623 write 0xe6f0910 thru 0xe6fcb3a (0xc22b bytes) 2024-09-13T06:39:54.735 INFO:teuthology.orchestra.run.smithi081.stdout:624 read 0xe239d4b thru 0xe2494be (0xf774 bytes) 2024-09-13T06:39:54.735 INFO:teuthology.orchestra.run.smithi081.stdout:625 write 0x3ef477a thru 0x3f0040b (0xbc92 bytes) 2024-09-13T06:39:54.751 INFO:teuthology.orchestra.run.smithi081.stdout:627 punch from 0x79f1e9a to 0x79fe14b, (0xc2b1 bytes) 2024-09-13T06:39:54.751 INFO:teuthology.orchestra.run.smithi081.stdout:629 read 0x36f4e67 thru 0x36f8787 (0x3921 bytes) 2024-09-13T06:39:54.752 INFO:teuthology.orchestra.run.smithi081.stdout:630 trunc from 0xe6fcb3b to 0xdd8b367 2024-09-13T06:39:54.767 INFO:teuthology.orchestra.run.smithi081.stdout:631 writesame 0xa0c5685 thru 0xa0d2039 data_size 0x1(0xc9b5 bytes) 2024-09-13T06:39:54.774 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:39:54.774 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:39:54.792 INFO:teuthology.orchestra.run.smithi081.stdout:632 read 0xc3df534 thru 0xc3e6030 (0x6afd bytes) 2024-09-13T06:39:54.792 INFO:teuthology.orchestra.run.smithi081.stdout:633 punch from 0x9282756 to 0x92913bc, (0xec66 bytes) 2024-09-13T06:39:54.792 INFO:teuthology.orchestra.run.smithi081.stdout:635 punch from 0x73e8729 to 0x73f72c7, (0xeb9e bytes) 2024-09-13T06:39:54.793 INFO:teuthology.orchestra.run.smithi081.stdout:636 read 0x2ab4039 thru 0x2abe3fb (0xa3c3 bytes) 2024-09-13T06:39:54.793 INFO:teuthology.orchestra.run.smithi081.stdout:637 read 0x2b72393 thru 0x2b7feca (0xdb38 bytes) 2024-09-13T06:39:54.793 INFO:teuthology.orchestra.run.smithi081.stdout:638 punch from 0xad703fb to 0xad77bbf, (0x77c4 bytes) 2024-09-13T06:39:54.793 INFO:teuthology.orchestra.run.smithi081.stdout:639 punch from 0x24c9f77 to 0x24cf4ef, (0x5578 bytes) 2024-09-13T06:39:54.793 INFO:teuthology.orchestra.run.smithi081.stdout:640 writesame 0x9817f78 thru 0x98209bf data_size 0x28(0x8a48 bytes) 2024-09-13T06:39:54.795 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-13T06:39:54.804 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:39:54.806+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:39:54.806 INFO:teuthology.orchestra.run.smithi081.stdout:641 writesame 0x1ace398 thru 0x1ace420 data_size 0x1(0x89 bytes) 2024-09-13T06:39:54.822 INFO:teuthology.orchestra.run.smithi081.stdout:642 trunc from 0xdd8b367 to 0x64f1994 2024-09-13T06:39:54.845 INFO:teuthology.orchestra.run.smithi081.stdout:644 write 0x1c0606d thru 0x1c121ee (0xc182 bytes) 2024-09-13T06:39:54.856 INFO:teuthology.orchestra.run.smithi081.stdout:645 read 0x31f3fe9 thru 0x3201656 (0xd66e bytes) 2024-09-13T06:39:54.857 INFO:teuthology.orchestra.run.smithi081.stdout:646 punch from 0xf4c27d to 0xf500cd, (0x3e50 bytes) 2024-09-13T06:39:54.865 INFO:teuthology.orchestra.run.smithi081.stdout:648 trunc from 0x64f1994 to 0xb7b8436 2024-09-13T06:39:54.871 INFO:teuthology.orchestra.run.smithi081.stdout:649 read 0x6c2c5a0 thru 0x6c2e31a (0x1d7b bytes) 2024-09-13T06:39:54.886 INFO:teuthology.orchestra.run.smithi081.stdout:652 trunc from 0xb7b8436 to 0x173ea6a 2024-09-13T06:39:54.906 INFO:tasks.ceph.osd.6.smithi139.stderr:2024-09-13T06:39:54.906+0000 7fcd02c5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26385) UID: 0 2024-09-13T06:39:54.907 INFO:teuthology.orchestra.run.smithi081.stdout:653 read 0xfdc87c thru 0xfdddea (0x156f bytes) 2024-09-13T06:39:54.907 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:39:54.907 INFO:teuthology.orchestra.run.smithi081.stdout:656 read 0xcd2a22 thru 0xcda53d (0x7b1c bytes) 2024-09-13T06:39:54.915 INFO:teuthology.orchestra.run.smithi081.stdout:657 trunc from 0x173ea6a to 0x58445f4 2024-09-13T06:39:54.922 INFO:teuthology.orchestra.run.smithi081.stdout:658 write 0xd98485 thru 0xda31bb (0xad37 bytes) 2024-09-13T06:39:54.927 INFO:teuthology.orchestra.run.smithi081.stdout:659 punch from 0x44bf77b to 0x44c1213, (0x1a98 bytes) 2024-09-13T06:39:54.941 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:39:54.941 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:39:54.946 INFO:teuthology.orchestra.run.smithi081.stdout:660 write 0xd5a8d10 thru 0xd5ac107 (0x33f8 bytes) 2024-09-13T06:39:54.957 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-13T06:39:54.958 INFO:teuthology.orchestra.run.smithi081.stdout:661 punch from 0x9941755 to 0x9946c39, (0x54e4 bytes) 2024-09-13T06:39:54.959 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:39:54.959 INFO:teuthology.orchestra.run.smithi081.stdout:663 read 0x6b2c75d thru 0x6b35a02 (0x92a6 bytes) 2024-09-13T06:39:54.959 INFO:teuthology.orchestra.run.smithi081.stdout:664 punch from 0x78e745a to 0x78ec1ba, (0x4d60 bytes) 2024-09-13T06:39:54.959 INFO:teuthology.orchestra.run.smithi081.stdout:665 read 0xc560e00 thru 0xc56cba6 (0xbda7 bytes) 2024-09-13T06:39:54.959 INFO:teuthology.orchestra.run.smithi081.stdout:666 write 0x9514625 thru 0x951b70c (0x70e8 bytes) 2024-09-13T06:39:54.974 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:39:54.974 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:39:54.974 INFO:teuthology.orchestra.run.smithi081.stdout:669 write 0x8a2843a thru 0x8a3150c (0x90d3 bytes) 2024-09-13T06:39:54.988 INFO:teuthology.orchestra.run.smithi081.stdout:670 read 0x21f7c2d thru 0x21f915b (0x152f bytes) 2024-09-13T06:39:54.988 INFO:teuthology.orchestra.run.smithi081.stdout:671 read 0x45d0917 thru 0x45d9aa8 (0x9192 bytes) 2024-09-13T06:39:54.988 INFO:teuthology.orchestra.run.smithi081.stdout:673 punch from 0x5bb25d5 to 0x5bb7d6a, (0x5795 bytes) 2024-09-13T06:39:54.988 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:39:54.988 INFO:teuthology.orchestra.run.smithi081.stdout:676 punch from 0x21ca1ec to 0x21d04ec, (0x6300 bytes) 2024-09-13T06:39:54.988 INFO:teuthology.orchestra.run.smithi081.stdout:677 write 0x526e406 thru 0x52728cb (0x44c6 bytes) 2024-09-13T06:39:55.007 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-13T06:39:55.006+0000 7f86a5f06640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26387) UID: 0 2024-09-13T06:39:55.008 INFO:teuthology.orchestra.run.smithi081.stdout:678 trunc from 0xd5ac108 to 0x6dd76c7 2024-09-13T06:39:55.030 INFO:teuthology.orchestra.run.smithi081.stdout:679 trunc from 0x6dd76c7 to 0x3fc351f 2024-09-13T06:39:55.051 INFO:teuthology.orchestra.run.smithi081.stdout:681 writesame 0x46f24ae thru 0x46f54a5 data_size 0xa(0x2ff8 bytes) 2024-09-13T06:39:55.051 INFO:teuthology.orchestra.run.smithi081.stdout:682 writesame 0x282c709 thru 0x2830b68 data_size 0x10(0x4460 bytes) 2024-09-13T06:39:55.061 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:39:55.061 INFO:teuthology.orchestra.run.smithi081.stdout:685 punch from 0x3c357d9 to 0x3c363d7, (0xbfe bytes) 2024-09-13T06:39:55.061 INFO:teuthology.orchestra.run.smithi081.stdout:687 read 0x43f0a41 thru 0x43f4e8d (0x444d bytes) 2024-09-13T06:39:55.077 INFO:teuthology.orchestra.run.smithi081.stdout:688 write 0xa969832 thru 0xa969968 (0x137 bytes) 2024-09-13T06:39:55.081 INFO:teuthology.orchestra.run.smithi081.stdout:689 read 0x8e09119 thru 0x8e0ffaf (0x6e97 bytes) 2024-09-13T06:39:55.094 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:39:55.094 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:39:55.095 INFO:teuthology.orchestra.run.smithi081.stdout:691 write 0xec4a3c4 thru 0xec58ce9 (0xe926 bytes) 2024-09-13T06:39:55.108 INFO:teuthology.orchestra.run.smithi081.stdout:692 read 0x59895fd thru 0x598c98f (0x3393 bytes) 2024-09-13T06:39:55.108 INFO:teuthology.orchestra.run.smithi081.stdout:693 write 0xd5cb92d thru 0xd5cbbb0 (0x284 bytes) 2024-09-13T06:39:55.109 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:39:55.111+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:39:55.110 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:39:55.110 INFO:teuthology.orchestra.run.smithi081.stdout:696 write 0x253db04 thru 0x2542206 (0x4703 bytes) 2024-09-13T06:39:55.113 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-13T06:39:55.120 INFO:teuthology.orchestra.run.smithi081.stdout:697 read 0x78fdef0 thru 0x7900db6 (0x2ec7 bytes) 2024-09-13T06:39:55.121 INFO:teuthology.orchestra.run.smithi081.stdout:698 read 0xa102ea thru 0xa120b2 (0x1dc9 bytes) 2024-09-13T06:39:55.121 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:39:55.121 INFO:teuthology.orchestra.run.smithi081.stdout:700 read 0x6f461fa thru 0x6f4b0d6 (0x4edd bytes) 2024-09-13T06:39:55.124 INFO:teuthology.orchestra.run.smithi081.stdout:701 trunc from 0xec58cea to 0xcc272f0 2024-09-13T06:39:55.138 INFO:teuthology.orchestra.run.smithi081.stdout:702 read 0xa173bb thru 0xa1c8ef (0x5535 bytes) 2024-09-13T06:39:55.139 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:39:55.139 INFO:teuthology.orchestra.run.smithi081.stdout:706 read 0x9e75638 thru 0x9e84bf6 (0xf5bf bytes) 2024-09-13T06:39:55.142 INFO:teuthology.orchestra.run.smithi081.stdout:707 trunc from 0xcc272f0 to 0xb02fb2c 2024-09-13T06:39:55.148 INFO:teuthology.orchestra.run.smithi081.stdout:709 writesame 0x7ef57f7 thru 0x7ef6b99 data_size 0x1(0x13a3 bytes) 2024-09-13T06:39:55.153 INFO:teuthology.orchestra.run.smithi081.stdout:711 write 0x52d6fd9 thru 0x52de2c9 (0x72f1 bytes) 2024-09-13T06:39:55.172 INFO:teuthology.orchestra.run.smithi081.stdout:712 trunc from 0xb02fb2c to 0x8cd96e9 2024-09-13T06:39:55.184 INFO:teuthology.orchestra.run.smithi081.stdout:713 read 0x4c3950b thru 0x4c3d44c (0x3f42 bytes) 2024-09-13T06:39:55.185 INFO:teuthology.orchestra.run.smithi081.stdout:714 punch from 0x8be0069 to 0x8bebdea, (0xbd81 bytes) 2024-09-13T06:39:55.185 INFO:teuthology.orchestra.run.smithi081.stdout:715 write 0x4bb9860 thru 0x4bc7152 (0xd8f3 bytes) 2024-09-13T06:39:55.199 INFO:teuthology.orchestra.run.smithi081.stdout:716 write 0x4626da0 thru 0x462d38d (0x65ee bytes) 2024-09-13T06:39:55.209 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:39:55.210+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:39:55.211 INFO:teuthology.orchestra.run.smithi081.stdout:717 read 0x7fa9bf1 thru 0x7fb561d (0xba2d bytes) 2024-09-13T06:39:55.221 INFO:teuthology.orchestra.run.smithi081.stdout:718 writesame 0xacae6b1 thru 0xacbcb04 data_size 0x6(0xe454 bytes) 2024-09-13T06:39:55.222 INFO:teuthology.orchestra.run.smithi081.stdout:719 read 0x69de599 thru 0x69eafaf (0xca17 bytes) 2024-09-13T06:39:55.222 INFO:teuthology.orchestra.run.smithi081.stdout:720 writesame 0x97138ab thru 0x9720ccc data_size 0x3f(0xd422 bytes) 2024-09-13T06:39:55.236 INFO:teuthology.orchestra.run.smithi081.stdout:723 punch from 0x8442a34 to 0x844da28, (0xaff4 bytes) 2024-09-13T06:39:55.236 INFO:teuthology.orchestra.run.smithi081.stdout:724 writesame 0x2c96174 thru 0x2ca4e8b data_size 0x48(0xed18 bytes) 2024-09-13T06:39:55.250 INFO:teuthology.orchestra.run.smithi081.stdout:727 punch from 0x1ebafe9 to 0x1ec2b80, (0x7b97 bytes) 2024-09-13T06:39:55.250 INFO:teuthology.orchestra.run.smithi081.stdout:728 read 0x4c3619b thru 0x4c36501 (0x367 bytes) 2024-09-13T06:39:55.251 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:39:55.251 INFO:teuthology.orchestra.run.smithi081.stdout:731 read 0x9086f1c thru 0x9094715 (0xd7fa bytes) 2024-09-13T06:39:55.251 INFO:teuthology.orchestra.run.smithi081.stdout:732 read 0x4176006 thru 0x4180c9d (0xac98 bytes) 2024-09-13T06:39:55.260 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:39:55.260 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:39:55.260 INFO:teuthology.orchestra.run.smithi081.stdout:733 write 0xd5366e6 thru 0xd53b1b5 (0x4ad0 bytes) 2024-09-13T06:39:55.271 INFO:teuthology.orchestra.run.smithi081.stdout:735 read 0xa6c67e2 thru 0xa6c8241 (0x1a60 bytes) 2024-09-13T06:39:55.271 INFO:teuthology.orchestra.run.smithi081.stdout:738 read 0x4f4591b thru 0x4f4f184 (0x986a bytes) 2024-09-13T06:39:55.271 INFO:teuthology.orchestra.run.smithi081.stdout:739 read 0x575a277 thru 0x5769cca (0xfa54 bytes) 2024-09-13T06:39:55.278 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-13T06:39:55.279 INFO:teuthology.orchestra.run.smithi081.stdout:740 writesame 0xd939b17 thru 0xd9448ba data_size 0x2(0xada4 bytes) 2024-09-13T06:39:55.279 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:39:55.279 INFO:teuthology.orchestra.run.smithi081.stdout:742 punch from 0xb4f67f6 to 0xb4ff7bd, (0x8fc7 bytes) 2024-09-13T06:39:55.279 INFO:teuthology.orchestra.run.smithi081.stdout:743 writesame 0x835137d thru 0x835c199 data_size 0x1d(0xae1d bytes) 2024-09-13T06:39:55.294 INFO:teuthology.orchestra.run.smithi081.stdout:744 trunc from 0xd9448bb to 0xbee226a 2024-09-13T06:39:55.311 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:39:55.312 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:39:55.315+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:39:55.312 INFO:teuthology.orchestra.run.smithi081.stdout:747 trunc from 0xbee226a to 0xb77fa4a 2024-09-13T06:39:55.320 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:39:55.320 INFO:teuthology.orchestra.run.smithi081.stdout:749 punch from 0x63e6a1f to 0x63f0007, (0x95e8 bytes) 2024-09-13T06:39:55.320 INFO:teuthology.orchestra.run.smithi081.stdout:750 write 0x2bd346e thru 0x2bd629a (0x2e2d bytes) 2024-09-13T06:39:55.323 INFO:teuthology.orchestra.run.smithi081.stdout:752 punch from 0x3ee94a9 to 0x3eeb881, (0x23d8 bytes) 2024-09-13T06:39:55.323 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:39:55.333 INFO:teuthology.orchestra.run.smithi081.stdout:754 write 0xc384612 thru 0xc3875c9 (0x2fb8 bytes) 2024-09-13T06:39:55.340 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:39:55.340 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:39:55.341 INFO:teuthology.orchestra.run.smithi081.stdout:758 clone 6 order 20 su 16384 sc 10 2024-09-13T06:39:55.411 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:39:55.410+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:39:55.413 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:39:55.414 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:39:55.429 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-13T06:39:55.519 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:39:55.523+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:39:55.574 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-13T06:39:55.600 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:39:55.600 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:39:55.612 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:39:55.615+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:39:55.617 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-13T06:39:55.714 INFO:tasks.ceph.osd.6.smithi139.stderr:2024-09-13T06:39:55.714+0000 7fcd02c5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26385) UID: 0 2024-09-13T06:39:55.783 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:39:55.784 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:39:55.799 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-13T06:39:55.843 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:39:55.847+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:39:55.913 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:39:55.914 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:39:55.915 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:39:55.919+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:39:55.929 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-13T06:39:55.960 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-13T06:39:56.016 INFO:tasks.ceph.osd.6.smithi139.stderr:2024-09-13T06:39:56.018+0000 7fcd02c5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26385) UID: 0 2024-09-13T06:39:56.088 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:39:56.088 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:39:56.103 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-13T06:39:56.117 INFO:tasks.ceph.osd.6.smithi139.stderr:2024-09-13T06:39:56.118+0000 7fcd02c5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26385) UID: 0 2024-09-13T06:39:56.118 INFO:teuthology.orchestra.run.smithi081.stdout:osd.0: {} 2024-09-13T06:39:56.119 INFO:teuthology.orchestra.run.smithi081.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-13T06:39:56.135 INFO:teuthology.orchestra.run.smithi081.stdout:osd.1: {} 2024-09-13T06:39:56.136 INFO:teuthology.orchestra.run.smithi081.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-13T06:39:56.151 INFO:teuthology.orchestra.run.smithi081.stdout:osd.2: {} 2024-09-13T06:39:56.152 INFO:teuthology.orchestra.run.smithi081.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-13T06:39:56.168 INFO:teuthology.orchestra.run.smithi081.stdout:osd.3: {} 2024-09-13T06:39:56.168 INFO:teuthology.orchestra.run.smithi081.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-13T06:39:56.188 INFO:teuthology.orchestra.run.smithi081.stdout:osd.4: {} 2024-09-13T06:39:56.188 INFO:teuthology.orchestra.run.smithi081.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-13T06:39:56.209 INFO:teuthology.orchestra.run.smithi081.stdout:osd.5: {} 2024-09-13T06:39:56.209 INFO:teuthology.orchestra.run.smithi081.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-13T06:39:56.218 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:39:56.218+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:39:56.219 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:39:56.220 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 20, 2024-09-13T06:39:56.220 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 600, 2024-09-13T06:39:56.220 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [ 2024-09-13T06:39:56.220 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.220 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4385.0:2330 3.0 e31/21 3:07d66135:::rbd_object_map.11212429e5ad:head v 31'39, mlcod=31'37)", 2024-09-13T06:39:56.220 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:38.827721+0000", 2024-09-13T06:39:56.220 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 17.395659909999999, 2024-09-13T06:39:56.220 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.003728295, 2024-09-13T06:39:56.220 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:56.220 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:56.220 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:56.220 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.220 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:56.221 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.827721+0000", 2024-09-13T06:39:56.221 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.221 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.221 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.221 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:56.221 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.827721+0000", 2024-09-13T06:39:56.221 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.221 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.221 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.221 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:56.221 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.827718+0000", 2024-09-13T06:39:56.221 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999976 2024-09-13T06:39:56.221 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.222 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.222 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:56.222 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.827735+0000", 2024-09-13T06:39:56.222 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6515999999999999e-05 2024-09-13T06:39:56.222 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.222 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.222 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:56.222 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.827768+0000", 2024-09-13T06:39:56.222 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.3105999999999998e-05 2024-09-13T06:39:56.222 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.222 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.222 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:56.222 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.827788+0000", 2024-09-13T06:39:56.222 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0210000000000001e-05 2024-09-13T06:39:56.223 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.223 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.223 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:56.223 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.827855+0000", 2024-09-13T06:39:56.223 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.7046999999999997e-05 2024-09-13T06:39:56.223 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.223 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.223 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:56.223 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.827900+0000", 2024-09-13T06:39:56.223 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4415000000000001e-05 2024-09-13T06:39:56.223 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.223 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.223 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:39:56.223 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.831380+0000", 2024-09-13T06:39:56.224 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.003480187 2024-09-13T06:39:56.224 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.224 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.224 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:56.224 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.831449+0000", 2024-09-13T06:39:56.224 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.9070000000000001e-05 2024-09-13T06:39:56.224 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.224 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:56.224 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.224 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.224 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.224 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4385.0:2402 3.0 e31/21 3:07d66135:::rbd_object_map.11212429e5ad:head v 31'46, mlcod=31'43)", 2024-09-13T06:39:56.224 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:38.872174+0000", 2024-09-13T06:39:56.225 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 17.351206369, 2024-09-13T06:39:56.225 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0037101830000000001, 2024-09-13T06:39:56.225 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:56.225 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:56.225 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:56.225 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.225 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:56.225 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.872174+0000", 2024-09-13T06:39:56.225 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.225 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.225 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.225 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:56.225 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.872174+0000", 2024-09-13T06:39:56.225 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.226 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.226 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.226 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:56.226 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.872173+0000", 2024-09-13T06:39:56.226 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.999999 2024-09-13T06:39:56.226 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.226 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.226 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:56.226 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.872180+0000", 2024-09-13T06:39:56.226 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.4189999999999999e-06 2024-09-13T06:39:56.226 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.226 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.226 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:56.227 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.872193+0000", 2024-09-13T06:39:56.227 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.349e-05 2024-09-13T06:39:56.227 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.227 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.227 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:56.227 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.872201+0000", 2024-09-13T06:39:56.227 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.7000000000000008e-06 2024-09-13T06:39:56.227 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.228 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.228 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:56.228 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.872506+0000", 2024-09-13T06:39:56.228 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00030537300000000001 2024-09-13T06:39:56.228 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.228 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.228 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:56.228 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.872571+0000", 2024-09-13T06:39:56.228 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.4349000000000003e-05 2024-09-13T06:39:56.228 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.228 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.228 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:39:56.228 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.875823+0000", 2024-09-13T06:39:56.229 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0032527419999999999 2024-09-13T06:39:56.229 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.229 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.229 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:56.229 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.875884+0000", 2024-09-13T06:39:56.229 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0847999999999997e-05 2024-09-13T06:39:56.229 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.229 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:56.229 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.229 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.229 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.229 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4385.0:2403 3.0 e31/21 3:07d66135:::rbd_object_map.11212429e5ad:head v 31'47, mlcod=31'43)", 2024-09-13T06:39:56.229 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:38.873272+0000", 2024-09-13T06:39:56.230 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 17.350108513999999, 2024-09-13T06:39:56.230 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0059524080000000002, 2024-09-13T06:39:56.230 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:56.230 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:56.230 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:56.230 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.230 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:56.230 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.873272+0000", 2024-09-13T06:39:56.230 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.230 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.231 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.231 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:56.231 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.873272+0000", 2024-09-13T06:39:56.231 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.231 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.231 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.231 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:56.231 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.873271+0000", 2024-09-13T06:39:56.231 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:39:56.231 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.231 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.231 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:56.231 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.873277+0000", 2024-09-13T06:39:56.231 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.5999999999999997e-06 2024-09-13T06:39:56.232 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.232 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.232 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:56.232 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.873285+0000", 2024-09-13T06:39:56.232 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4680000000000003e-06 2024-09-13T06:39:56.232 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.232 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.232 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:56.232 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.873289+0000", 2024-09-13T06:39:56.232 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7670000000000003e-06 2024-09-13T06:39:56.232 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.232 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.232 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:56.233 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.873403+0000", 2024-09-13T06:39:56.233 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00011417300000000001 2024-09-13T06:39:56.233 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.233 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.233 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:56.233 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.873421+0000", 2024-09-13T06:39:56.233 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7278e-05 2024-09-13T06:39:56.233 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.233 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.233 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:39:56.233 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.879180+0000", 2024-09-13T06:39:56.233 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0057591379999999996 2024-09-13T06:39:56.233 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.233 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.234 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:56.234 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.879224+0000", 2024-09-13T06:39:56.234 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4558000000000003e-05 2024-09-13T06:39:56.234 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.234 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:56.234 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.234 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.234 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.234 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4385.0:2404 3.0 e31/21 3:07d66135:::rbd_object_map.11212429e5ad:head v 31'48, mlcod=31'43)", 2024-09-13T06:39:56.234 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:38.874266+0000", 2024-09-13T06:39:56.234 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 17.349114756999999, 2024-09-13T06:39:56.234 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0049906389999999998, 2024-09-13T06:39:56.234 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:56.234 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:56.235 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:56.235 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.235 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:56.235 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.874266+0000", 2024-09-13T06:39:56.235 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.235 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.235 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.235 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:56.235 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.874266+0000", 2024-09-13T06:39:56.235 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.235 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.235 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.235 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:56.236 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.874265+0000", 2024-09-13T06:39:56.236 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.999999 2024-09-13T06:39:56.236 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.236 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.236 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:56.236 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.874281+0000", 2024-09-13T06:39:56.236 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5763000000000001e-05 2024-09-13T06:39:56.236 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.236 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.237 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:56.237 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.874294+0000", 2024-09-13T06:39:56.237 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2826000000000001e-05 2024-09-13T06:39:56.237 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.237 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.237 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:56.237 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.874300+0000", 2024-09-13T06:39:56.237 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.6769999999999998e-06 2024-09-13T06:39:56.237 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.237 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.237 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:56.237 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.874390+0000", 2024-09-13T06:39:56.237 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.0129000000000004e-05 2024-09-13T06:39:56.238 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.238 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.238 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:56.238 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.874450+0000", 2024-09-13T06:39:56.238 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9512999999999998e-05 2024-09-13T06:39:56.238 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.238 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.238 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:39:56.238 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.879227+0000", 2024-09-13T06:39:56.238 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0047773329999999999 2024-09-13T06:39:56.238 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.238 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.238 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:56.238 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.879256+0000", 2024-09-13T06:39:56.239 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9173e-05 2024-09-13T06:39:56.239 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.239 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:56.239 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.239 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.239 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.239 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4385.0:2405 3.0 e31/21 3:07d66135:::rbd_object_map.11212429e5ad:head v 31'49, mlcod=31'43)", 2024-09-13T06:39:56.239 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:38.875324+0000", 2024-09-13T06:39:56.239 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 17.348056908, 2024-09-13T06:39:56.239 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0039619570000000003, 2024-09-13T06:39:56.239 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:56.239 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:56.239 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:56.240 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.240 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:56.240 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.875324+0000", 2024-09-13T06:39:56.240 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.240 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.240 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.240 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:56.240 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.875324+0000", 2024-09-13T06:39:56.240 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.240 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.240 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.240 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:56.240 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.875323+0000", 2024-09-13T06:39:56.241 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.999999 2024-09-13T06:39:56.241 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.241 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.241 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:56.241 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.875329+0000", 2024-09-13T06:39:56.241 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.1689999999999997e-06 2024-09-13T06:39:56.241 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.241 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.241 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:56.241 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.875340+0000", 2024-09-13T06:39:56.241 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1065e-05 2024-09-13T06:39:56.241 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.241 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.241 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:56.242 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.875347+0000", 2024-09-13T06:39:56.242 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.674e-06 2024-09-13T06:39:56.242 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.242 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.242 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:56.242 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.875396+0000", 2024-09-13T06:39:56.242 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9094000000000001e-05 2024-09-13T06:39:56.242 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.242 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.242 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:56.242 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.875420+0000", 2024-09-13T06:39:56.242 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4199999999999999e-05 2024-09-13T06:39:56.242 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.243 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.243 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:39:56.243 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.879258+0000", 2024-09-13T06:39:56.243 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0038376930000000001 2024-09-13T06:39:56.243 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.243 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.243 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:56.243 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.879286+0000", 2024-09-13T06:39:56.243 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.7880000000000001e-05 2024-09-13T06:39:56.243 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.243 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:56.243 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.243 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.243 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.244 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4385.0:2407 3.0 e31/21 3:07d66135:::rbd_object_map.11212429e5ad:head v 31'51, mlcod=31'44)", 2024-09-13T06:39:56.244 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:38.878449+0000", 2024-09-13T06:39:56.244 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 17.344931885000001, 2024-09-13T06:39:56.244 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0036754119999999999, 2024-09-13T06:39:56.244 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:56.244 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:56.244 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:56.244 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.244 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:56.244 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.878449+0000", 2024-09-13T06:39:56.244 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.244 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.244 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.245 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:56.245 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.878449+0000", 2024-09-13T06:39:56.245 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.245 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.245 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.245 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:56.245 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.878447+0000", 2024-09-13T06:39:56.245 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999981 2024-09-13T06:39:56.245 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.245 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.245 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:56.245 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.878462+0000", 2024-09-13T06:39:56.245 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5133000000000001e-05 2024-09-13T06:39:56.245 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.246 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.246 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:56.246 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.878500+0000", 2024-09-13T06:39:56.246 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.8213999999999997e-05 2024-09-13T06:39:56.246 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.246 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.246 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:56.246 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.878520+0000", 2024-09-13T06:39:56.246 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0000000000000002e-05 2024-09-13T06:39:56.246 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.246 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.246 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:56.246 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.878710+0000", 2024-09-13T06:39:56.247 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00019008100000000001 2024-09-13T06:39:56.247 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.247 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.247 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:56.247 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.878745+0000", 2024-09-13T06:39:56.247 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.4533000000000003e-05 2024-09-13T06:39:56.247 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.247 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.247 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:39:56.247 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.882086+0000", 2024-09-13T06:39:56.247 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0033416409999999998 2024-09-13T06:39:56.247 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.247 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.247 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:56.248 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.882124+0000", 2024-09-13T06:39:56.248 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.7673000000000003e-05 2024-09-13T06:39:56.248 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.248 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:56.248 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.248 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.248 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.248 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4385.0:2408 3.0 e31/21 3:07d66135:::rbd_object_map.11212429e5ad:head v 31'52, mlcod=31'45)", 2024-09-13T06:39:56.248 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:38.880785+0000", 2024-09-13T06:39:56.248 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 17.342595726999999, 2024-09-13T06:39:56.248 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.004103382, 2024-09-13T06:39:56.248 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:56.248 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:56.248 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:56.249 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.249 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:56.249 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.880785+0000", 2024-09-13T06:39:56.249 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.249 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.249 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.249 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:56.249 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.880785+0000", 2024-09-13T06:39:56.249 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.249 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.249 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.249 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:56.249 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.880784+0000", 2024-09-13T06:39:56.249 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.999999 2024-09-13T06:39:56.250 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.250 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.250 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:56.250 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.880793+0000", 2024-09-13T06:39:56.250 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.8990000000000007e-06 2024-09-13T06:39:56.250 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.250 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.250 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:56.250 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.880806+0000", 2024-09-13T06:39:56.250 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3597999999999999e-05 2024-09-13T06:39:56.250 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.250 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.250 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:56.251 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.880813+0000", 2024-09-13T06:39:56.251 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.6789999999999999e-06 2024-09-13T06:39:56.251 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.251 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.251 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:56.251 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.880918+0000", 2024-09-13T06:39:56.251 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000105256 2024-09-13T06:39:56.251 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.251 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.251 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:56.251 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.880977+0000", 2024-09-13T06:39:56.251 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8310000000000002e-05 2024-09-13T06:39:56.251 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.252 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.252 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:39:56.252 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.884849+0000", 2024-09-13T06:39:56.252 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.003872693 2024-09-13T06:39:56.252 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.252 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.252 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:56.252 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.884888+0000", 2024-09-13T06:39:56.252 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.8955999999999998e-05 2024-09-13T06:39:56.252 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.252 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:56.252 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.252 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.253 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.253 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4385.0:2409 3.0 e31/21 3:07d66135:::rbd_object_map.11212429e5ad:head v 31'53, mlcod=31'45)", 2024-09-13T06:39:56.253 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:38.882957+0000", 2024-09-13T06:39:56.253 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 17.340423324, 2024-09-13T06:39:56.253 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0049287489999999996, 2024-09-13T06:39:56.253 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:56.253 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:56.253 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:56.253 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.253 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:56.253 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.882957+0000", 2024-09-13T06:39:56.253 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.253 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.254 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.254 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:56.254 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.882957+0000", 2024-09-13T06:39:56.254 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.254 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.254 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.254 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:56.254 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.882956+0000", 2024-09-13T06:39:56.254 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.999999 2024-09-13T06:39:56.254 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.254 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.254 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:56.255 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.882963+0000", 2024-09-13T06:39:56.255 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.8680000000000001e-06 2024-09-13T06:39:56.255 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.255 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.255 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:56.255 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.882975+0000", 2024-09-13T06:39:56.255 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1766000000000001e-05 2024-09-13T06:39:56.255 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.255 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.255 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:56.255 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.882981+0000", 2024-09-13T06:39:56.255 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3559999999999998e-06 2024-09-13T06:39:56.255 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.255 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.256 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:56.256 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.883029+0000", 2024-09-13T06:39:56.256 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7839000000000001e-05 2024-09-13T06:39:56.256 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.256 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.256 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:56.256 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.883047+0000", 2024-09-13T06:39:56.256 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8134e-05 2024-09-13T06:39:56.256 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.256 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.256 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:39:56.256 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.887832+0000", 2024-09-13T06:39:56.256 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0047848839999999997 2024-09-13T06:39:56.257 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.257 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.257 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:56.257 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.887886+0000", 2024-09-13T06:39:56.257 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3702999999999997e-05 2024-09-13T06:39:56.257 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.257 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:56.257 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.257 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.257 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.257 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4385.0:2410 3.0 e31/21 3:07d66135:::rbd_object_map.11212429e5ad:head v 31'54, mlcod=31'45)", 2024-09-13T06:39:56.257 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:38.885943+0000", 2024-09-13T06:39:56.258 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 17.337437474000001, 2024-09-13T06:39:56.258 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0051076330000000003, 2024-09-13T06:39:56.258 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:56.258 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:56.258 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:56.258 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.258 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:56.258 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.885943+0000", 2024-09-13T06:39:56.258 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.258 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.258 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.258 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:56.258 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.885943+0000", 2024-09-13T06:39:56.258 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.259 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.259 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.259 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:56.259 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.885942+0000", 2024-09-13T06:39:56.259 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.999999 2024-09-13T06:39:56.259 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.259 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.259 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:56.259 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.885949+0000", 2024-09-13T06:39:56.259 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.2679999999999997e-06 2024-09-13T06:39:56.259 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.259 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.259 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:56.260 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.885961+0000", 2024-09-13T06:39:56.260 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1737e-05 2024-09-13T06:39:56.260 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.260 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.260 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:56.260 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.885967+0000", 2024-09-13T06:39:56.260 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0920000000000003e-06 2024-09-13T06:39:56.260 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.260 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.260 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:56.260 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.886019+0000", 2024-09-13T06:39:56.260 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.1669000000000003e-05 2024-09-13T06:39:56.260 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.261 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.261 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:56.261 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.886035+0000", 2024-09-13T06:39:56.261 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6192e-05 2024-09-13T06:39:56.261 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.261 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.261 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:39:56.261 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.890999+0000", 2024-09-13T06:39:56.261 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0049638440000000002 2024-09-13T06:39:56.261 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.261 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.261 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:56.261 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.891051+0000", 2024-09-13T06:39:56.262 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.1700999999999998e-05 2024-09-13T06:39:56.262 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.262 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:56.262 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.262 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.262 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.262 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4385.0:2411 3.0 e31/21 3:07d66135:::rbd_object_map.11212429e5ad:head v 31'55, mlcod=31'45)", 2024-09-13T06:39:56.262 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:38.887273+0000", 2024-09-13T06:39:56.262 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 17.336107195, 2024-09-13T06:39:56.262 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0058469940000000003, 2024-09-13T06:39:56.262 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:56.262 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:56.262 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:56.263 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.263 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:56.263 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.887273+0000", 2024-09-13T06:39:56.263 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.263 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.263 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.263 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:56.263 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.887273+0000", 2024-09-13T06:39:56.263 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.263 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.263 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.263 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:56.263 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.887272+0000", 2024-09-13T06:39:56.263 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.999999 2024-09-13T06:39:56.264 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.264 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.264 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:56.264 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.887280+0000", 2024-09-13T06:39:56.264 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.9060000000000002e-06 2024-09-13T06:39:56.264 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.264 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.264 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:56.264 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.887297+0000", 2024-09-13T06:39:56.264 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6577000000000001e-05 2024-09-13T06:39:56.264 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.264 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.264 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:56.265 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.887306+0000", 2024-09-13T06:39:56.265 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.9579999999999996e-06 2024-09-13T06:39:56.265 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.265 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.265 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:56.265 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.887353+0000", 2024-09-13T06:39:56.265 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7320000000000001e-05 2024-09-13T06:39:56.265 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.265 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.265 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:56.265 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.887374+0000", 2024-09-13T06:39:56.265 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0984000000000001e-05 2024-09-13T06:39:56.265 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.266 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.266 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:39:56.266 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.893037+0000", 2024-09-13T06:39:56.266 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0056629380000000002 2024-09-13T06:39:56.266 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.266 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.266 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:56.266 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.893120+0000", 2024-09-13T06:39:56.266 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.3282000000000007e-05 2024-09-13T06:39:56.266 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.266 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:56.266 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.266 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.267 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.267 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4385.0:2412 3.0 e31/21 3:07d66135:::rbd_object_map.11212429e5ad:head v 31'56, mlcod=31'48)", 2024-09-13T06:39:56.267 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:38.888795+0000", 2024-09-13T06:39:56.267 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 17.334585639, 2024-09-13T06:39:56.267 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0043887409999999998, 2024-09-13T06:39:56.267 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:56.267 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:56.267 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:56.267 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.267 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:56.267 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.888795+0000", 2024-09-13T06:39:56.267 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.267 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.268 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.268 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:56.268 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.888795+0000", 2024-09-13T06:39:56.268 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.268 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.268 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.268 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:56.268 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.888794+0000", 2024-09-13T06:39:56.268 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.999999 2024-09-13T06:39:56.268 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.268 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.268 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:56.268 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.888803+0000", 2024-09-13T06:39:56.269 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.7139999999999999e-06 2024-09-13T06:39:56.269 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.269 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.269 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:56.269 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.888820+0000", 2024-09-13T06:39:56.269 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7555999999999999e-05 2024-09-13T06:39:56.269 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.269 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.269 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:56.269 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.888828+0000", 2024-09-13T06:39:56.269 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.153e-06 2024-09-13T06:39:56.269 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.269 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.270 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:56.270 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.888897+0000", 2024-09-13T06:39:56.270 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.9805e-05 2024-09-13T06:39:56.270 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.270 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.270 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:56.270 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.888928+0000", 2024-09-13T06:39:56.270 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.0633000000000003e-05 2024-09-13T06:39:56.270 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.270 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.270 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:39:56.270 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.893124+0000", 2024-09-13T06:39:56.270 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0041962079999999999 2024-09-13T06:39:56.271 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.271 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.271 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:56.271 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.893184+0000", 2024-09-13T06:39:56.271 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9456000000000001e-05 2024-09-13T06:39:56.271 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.271 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:56.271 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.271 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.271 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.271 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4385.0:2413 3.0 e31/21 3:07d66135:::rbd_object_map.11212429e5ad:head v 31'57, mlcod=31'51)", 2024-09-13T06:39:56.271 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:38.890237+0000", 2024-09-13T06:39:56.271 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 17.333143438, 2024-09-13T06:39:56.272 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0034719220000000001, 2024-09-13T06:39:56.272 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:56.272 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:56.272 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:56.272 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.272 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:56.272 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.890237+0000", 2024-09-13T06:39:56.272 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.272 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.272 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.272 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:56.272 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.890237+0000", 2024-09-13T06:39:56.272 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.273 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.273 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.273 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:56.273 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.890236+0000", 2024-09-13T06:39:56.273 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.999999 2024-09-13T06:39:56.273 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.273 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.273 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:56.273 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.890243+0000", 2024-09-13T06:39:56.273 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.9630000000000001e-06 2024-09-13T06:39:56.273 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.273 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.273 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:56.274 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.890258+0000", 2024-09-13T06:39:56.274 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4321999999999999e-05 2024-09-13T06:39:56.274 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.274 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.274 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:56.274 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.890265+0000", 2024-09-13T06:39:56.274 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3000000000000004e-06 2024-09-13T06:39:56.274 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.274 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.274 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:56.274 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.890389+0000", 2024-09-13T06:39:56.274 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00012409899999999999 2024-09-13T06:39:56.274 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.274 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.275 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:56.275 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.890420+0000", 2024-09-13T06:39:56.275 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.1090000000000002e-05 2024-09-13T06:39:56.275 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.275 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.275 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:39:56.275 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.893629+0000", 2024-09-13T06:39:56.275 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0032087690000000002 2024-09-13T06:39:56.275 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.275 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.275 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:56.275 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.893709+0000", 2024-09-13T06:39:56.275 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.0226000000000001e-05 2024-09-13T06:39:56.276 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.276 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:56.276 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.276 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.276 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.276 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4385.0:2432 3.0 e31/21 3:07d66135:::rbd_object_map.11212429e5ad:head v 31'62, mlcod=31'58)", 2024-09-13T06:39:56.276 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:38.900535+0000", 2024-09-13T06:39:56.276 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 17.322845417, 2024-09-13T06:39:56.276 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0036949130000000002, 2024-09-13T06:39:56.276 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:56.276 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:56.276 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:56.276 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.277 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:56.277 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.900535+0000", 2024-09-13T06:39:56.277 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.277 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.277 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.277 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:56.277 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.900535+0000", 2024-09-13T06:39:56.277 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.277 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.277 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.277 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:56.277 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.900535+0000", 2024-09-13T06:39:56.277 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:39:56.277 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.278 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.278 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:56.278 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.900541+0000", 2024-09-13T06:39:56.278 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.4169999999999997e-06 2024-09-13T06:39:56.278 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.278 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.278 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:56.278 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.900553+0000", 2024-09-13T06:39:56.278 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2354000000000001e-05 2024-09-13T06:39:56.278 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.278 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.278 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:56.278 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.900560+0000", 2024-09-13T06:39:56.279 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.8990000000000004e-06 2024-09-13T06:39:56.279 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.279 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.279 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:56.279 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.900621+0000", 2024-09-13T06:39:56.279 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0699000000000003e-05 2024-09-13T06:39:56.279 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.279 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.279 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:56.279 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.900660+0000", 2024-09-13T06:39:56.279 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.8609999999999998e-05 2024-09-13T06:39:56.279 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.279 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.280 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:39:56.280 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.904177+0000", 2024-09-13T06:39:56.280 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0035175509999999998 2024-09-13T06:39:56.280 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.280 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.280 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:56.280 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.904230+0000", 2024-09-13T06:39:56.280 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2966000000000001e-05 2024-09-13T06:39:56.280 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.280 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:56.280 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.280 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.281 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.281 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4385.0:2433 3.0 e31/21 3:07d66135:::rbd_object_map.11212429e5ad:head v 31'63, mlcod=31'58)", 2024-09-13T06:39:56.281 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:38.901375+0000", 2024-09-13T06:39:56.281 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 17.322006005999999, 2024-09-13T06:39:56.281 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.005560738, 2024-09-13T06:39:56.281 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:56.281 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:56.281 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:56.281 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.281 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:56.281 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.901375+0000", 2024-09-13T06:39:56.281 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.281 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.282 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.282 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:56.282 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.901375+0000", 2024-09-13T06:39:56.282 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.282 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.282 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.282 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:56.282 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.901374+0000", 2024-09-13T06:39:56.282 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.999999 2024-09-13T06:39:56.282 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.282 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.282 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:56.282 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.901381+0000", 2024-09-13T06:39:56.282 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.1019999999999999e-06 2024-09-13T06:39:56.283 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.283 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.283 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:56.283 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.901394+0000", 2024-09-13T06:39:56.283 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2782999999999999e-05 2024-09-13T06:39:56.283 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.283 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.283 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:56.283 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.901400+0000", 2024-09-13T06:39:56.283 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.8449999999999997e-06 2024-09-13T06:39:56.283 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.283 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.283 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:56.283 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.901483+0000", 2024-09-13T06:39:56.284 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.2841000000000002e-05 2024-09-13T06:39:56.284 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.284 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.284 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:56.284 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.901513+0000", 2024-09-13T06:39:56.284 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.0102000000000001e-05 2024-09-13T06:39:56.284 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.284 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.284 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:39:56.284 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.906853+0000", 2024-09-13T06:39:56.284 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.005339402 2024-09-13T06:39:56.284 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.284 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.285 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:56.285 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.906935+0000", 2024-09-13T06:39:56.285 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.2488e-05 2024-09-13T06:39:56.285 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.285 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:56.285 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.285 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.285 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.285 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4385.0:2434 3.0 e31/21 3:07d66135:::rbd_object_map.11212429e5ad:head v 31'64, mlcod=31'58)", 2024-09-13T06:39:56.285 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:38.902253+0000", 2024-09-13T06:39:56.285 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 17.32112742, 2024-09-13T06:39:56.285 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0047392650000000003, 2024-09-13T06:39:56.285 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:56.286 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:56.286 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:56.286 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.286 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:56.286 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.902253+0000", 2024-09-13T06:39:56.286 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.286 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.286 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.286 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:56.286 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.902253+0000", 2024-09-13T06:39:56.286 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.286 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.286 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.286 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:56.287 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.902252+0000", 2024-09-13T06:39:56.287 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.999999 2024-09-13T06:39:56.287 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.287 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.287 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:56.287 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.902259+0000", 2024-09-13T06:39:56.287 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.9709999999999998e-06 2024-09-13T06:39:56.287 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.287 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.287 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:56.287 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.902273+0000", 2024-09-13T06:39:56.287 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3302000000000001e-05 2024-09-13T06:39:56.287 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.288 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.288 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:56.288 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.902280+0000", 2024-09-13T06:39:56.288 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.126e-06 2024-09-13T06:39:56.288 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.288 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.288 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:56.288 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.902334+0000", 2024-09-13T06:39:56.288 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.4512000000000003e-05 2024-09-13T06:39:56.288 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.288 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.288 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:56.288 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.902363+0000", 2024-09-13T06:39:56.289 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.8544e-05 2024-09-13T06:39:56.289 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.289 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.289 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:39:56.289 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.906941+0000", 2024-09-13T06:39:56.289 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0045781320000000004 2024-09-13T06:39:56.289 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.289 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.289 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:56.289 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.906992+0000", 2024-09-13T06:39:56.289 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.1533000000000003e-05 2024-09-13T06:39:56.289 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.289 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:56.289 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.290 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.290 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.290 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4385.0:2610 3.0 e31/21 3:05b06d2f:::rbd_data.11212429e5ad.0000000000000367:head v 31'112, mlcod=31'110)", 2024-09-13T06:39:56.290 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:39.239230+0000", 2024-09-13T06:39:56.290 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 16.984150645, 2024-09-13T06:39:56.290 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0036041720000000001, 2024-09-13T06:39:56.290 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:56.290 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:56.290 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:56.290 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.291 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:56.291 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.239230+0000", 2024-09-13T06:39:56.291 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.291 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.291 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.291 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:56.291 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.239230+0000", 2024-09-13T06:39:56.291 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.291 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.291 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.291 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:56.291 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.239229+0000", 2024-09-13T06:39:56.292 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.999999 2024-09-13T06:39:56.292 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.292 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.292 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:56.292 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.239238+0000", 2024-09-13T06:39:56.292 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.2529999999999993e-06 2024-09-13T06:39:56.292 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.292 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.292 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:56.292 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.240075+0000", 2024-09-13T06:39:56.292 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00083642899999999997 2024-09-13T06:39:56.292 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.292 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.293 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:56.293 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.240084+0000", 2024-09-13T06:39:56.293 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.3160000000000003e-06 2024-09-13T06:39:56.293 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.293 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.293 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:56.293 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.240173+0000", 2024-09-13T06:39:56.293 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.9536999999999993e-05 2024-09-13T06:39:56.293 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.293 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.293 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:56.293 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.240192+0000", 2024-09-13T06:39:56.293 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8547999999999999e-05 2024-09-13T06:39:56.294 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.294 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.294 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:39:56.294 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.242758+0000", 2024-09-13T06:39:56.294 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.002565936 2024-09-13T06:39:56.294 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.294 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.294 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:56.294 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.242834+0000", 2024-09-13T06:39:56.294 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.6198999999999993e-05 2024-09-13T06:39:56.294 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.294 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:56.295 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.295 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.295 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.295 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4385.0:2665 3.0 e31/21 3:07d66135:::rbd_object_map.11212429e5ad:head v 31'127, mlcod=31'125)", 2024-09-13T06:39:56.295 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:39.384538+0000", 2024-09-13T06:39:56.295 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 16.838842353, 2024-09-13T06:39:56.295 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00349468, 2024-09-13T06:39:56.295 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:56.295 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:56.295 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:56.295 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.295 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:56.295 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.384538+0000", 2024-09-13T06:39:56.295 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.296 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.296 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.296 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:56.296 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.384538+0000", 2024-09-13T06:39:56.296 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.296 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.296 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.296 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:56.296 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.384537+0000", 2024-09-13T06:39:56.296 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999986 2024-09-13T06:39:56.296 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.296 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.297 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:56.297 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.384548+0000", 2024-09-13T06:39:56.297 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1542999999999999e-05 2024-09-13T06:39:56.297 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.297 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.297 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:56.297 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.384571+0000", 2024-09-13T06:39:56.297 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2317e-05 2024-09-13T06:39:56.297 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.297 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.297 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:56.297 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.384579+0000", 2024-09-13T06:39:56.297 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.3140000000000004e-06 2024-09-13T06:39:56.297 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.298 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.298 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:56.298 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.384634+0000", 2024-09-13T06:39:56.298 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.5451999999999997e-05 2024-09-13T06:39:56.298 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.298 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.298 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:56.298 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.384663+0000", 2024-09-13T06:39:56.298 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.8419999999999999e-05 2024-09-13T06:39:56.298 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.298 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.298 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:39:56.299 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.387993+0000", 2024-09-13T06:39:56.299 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0033301630000000001 2024-09-13T06:39:56.299 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.299 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.299 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:56.299 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.388033+0000", 2024-09-13T06:39:56.299 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.9818999999999999e-05 2024-09-13T06:39:56.299 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.299 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:56.299 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.299 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.299 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.299 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4385.0:4997 3.9 e38/21 3:904af028:::rbd_data.112150cd58e1.0000000000000008:head v 38'98, mlcod=38'95)", 2024-09-13T06:39:56.300 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:46.743130+0000", 2024-09-13T06:39:56.300 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 9.4802502569999998, 2024-09-13T06:39:56.300 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0049048570000000003, 2024-09-13T06:39:56.300 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:56.300 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:56.300 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:56.300 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.300 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:56.300 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:46.743130+0000", 2024-09-13T06:39:56.300 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.300 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.300 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.300 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:56.301 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:46.743130+0000", 2024-09-13T06:39:56.301 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.301 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.301 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.301 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:56.301 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:46.743129+0000", 2024-09-13T06:39:56.301 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.999999 2024-09-13T06:39:56.301 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.301 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.301 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:56.301 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:46.743138+0000", 2024-09-13T06:39:56.301 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.6519999999999995e-06 2024-09-13T06:39:56.302 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.302 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.302 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:56.302 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:46.743152+0000", 2024-09-13T06:39:56.302 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3757999999999999e-05 2024-09-13T06:39:56.302 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.302 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.302 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:56.302 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:46.743160+0000", 2024-09-13T06:39:56.302 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.5550000000000003e-06 2024-09-13T06:39:56.302 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.302 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.302 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:56.303 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:46.743208+0000", 2024-09-13T06:39:56.303 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7348999999999997e-05 2024-09-13T06:39:56.303 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.303 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.303 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:56.303 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:46.743233+0000", 2024-09-13T06:39:56.303 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5058e-05 2024-09-13T06:39:56.303 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.303 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.303 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:39:56.303 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:46.747999+0000", 2024-09-13T06:39:56.303 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0047658680000000004 2024-09-13T06:39:56.303 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.304 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.304 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:56.304 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:46.748035+0000", 2024-09-13T06:39:56.304 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.6421000000000002e-05 2024-09-13T06:39:56.304 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.304 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:56.304 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.304 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.304 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.304 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4385.0:20848 3.13 e44/40 3:ca725a17:::rbd_object_map.1121f2c5ee81.0000000000000011:head v 44'151, mlcod=44'149)", 2024-09-13T06:39:56.304 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.727815+0000", 2024-09-13T06:39:56.304 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 3.495565042, 2024-09-13T06:39:56.304 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0047140769999999997, 2024-09-13T06:39:56.305 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:56.305 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:56.305 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:56.305 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.305 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:56.305 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.727815+0000", 2024-09-13T06:39:56.305 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.305 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.305 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.305 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:56.305 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.727815+0000", 2024-09-13T06:39:56.305 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.305 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.306 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.306 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:56.306 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.727814+0000", 2024-09-13T06:39:56.306 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999986 2024-09-13T06:39:56.306 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.306 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.306 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:56.306 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.727824+0000", 2024-09-13T06:39:56.306 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0454e-05 2024-09-13T06:39:56.306 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.306 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.306 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:56.306 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.727845+0000", 2024-09-13T06:39:56.306 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0068000000000002e-05 2024-09-13T06:39:56.307 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.307 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.307 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:56.307 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.727858+0000", 2024-09-13T06:39:56.307 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3301e-05 2024-09-13T06:39:56.307 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.307 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.307 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:56.307 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.727999+0000", 2024-09-13T06:39:56.307 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000141213 2024-09-13T06:39:56.307 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.307 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.307 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:56.307 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.728063+0000", 2024-09-13T06:39:56.308 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3862999999999995e-05 2024-09-13T06:39:56.308 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.308 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.308 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:39:56.308 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.732468+0000", 2024-09-13T06:39:56.308 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0044050529999999999 2024-09-13T06:39:56.308 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.308 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.308 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:56.308 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.732530+0000", 2024-09-13T06:39:56.308 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.1569000000000006e-05 2024-09-13T06:39:56.308 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.308 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:56.309 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.309 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.309 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.309 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4385.0:20851 3.13 e44/40 3:ca725a17:::rbd_object_map.1121f2c5ee81.0000000000000011:head v 44'152, mlcod=44'149)", 2024-09-13T06:39:56.309 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.728856+0000", 2024-09-13T06:39:56.309 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 3.4945240599999998, 2024-09-13T06:39:56.309 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0037075770000000001, 2024-09-13T06:39:56.309 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:56.309 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:39:56.309 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:56.309 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.309 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:56.310 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.728856+0000", 2024-09-13T06:39:56.310 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.310 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.310 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.310 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:56.310 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.728856+0000", 2024-09-13T06:39:56.310 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.310 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.310 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.310 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:56.310 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.728855+0000", 2024-09-13T06:39:56.310 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.999999 2024-09-13T06:39:56.310 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.311 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.311 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:56.311 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.728865+0000", 2024-09-13T06:39:56.311 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.431e-06 2024-09-13T06:39:56.311 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.311 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.311 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:56.311 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.728881+0000", 2024-09-13T06:39:56.311 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5642e-05 2024-09-13T06:39:56.311 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.311 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.311 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:56.311 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.728890+0000", 2024-09-13T06:39:56.312 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.4069999999999999e-06 2024-09-13T06:39:56.312 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.312 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.312 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:56.312 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.729222+0000", 2024-09-13T06:39:56.312 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00033190999999999998 2024-09-13T06:39:56.312 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.312 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.312 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:56.312 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.729275+0000", 2024-09-13T06:39:56.312 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3179e-05 2024-09-13T06:39:56.312 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.312 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.312 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:39:56.313 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.732534+0000", 2024-09-13T06:39:56.313 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0032586210000000002 2024-09-13T06:39:56.313 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.313 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.313 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:56.313 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.732564+0000", 2024-09-13T06:39:56.313 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.0352999999999999e-05 2024-09-13T06:39:56.313 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.313 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:56.313 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.313 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.313 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:56.313 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:39:56.314 INFO:teuthology.orchestra.run.smithi081.stdout:osd.6: {} 2024-09-13T06:39:56.314 INFO:teuthology.orchestra.run.smithi081.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-13T06:39:56.315 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-13T06:39:56.316 INFO:teuthology.orchestra.run.smithi081.stdout:osd.7: {} 2024-09-13T06:39:56.316 INFO:teuthology.orchestra.run.smithi081.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-13T06:39:56.348 INFO:teuthology.orchestra.run.smithi081.stderr:noscrub is unset 2024-09-13T06:39:56.351 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:39:56.351+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:39:56.420 INFO:tasks.ceph.osd.6.smithi139.stderr:2024-09-13T06:39:56.421+0000 7fcd02c5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26385) UID: 0 2024-09-13T06:39:56.520 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:39:56.523+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:39:56.540 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:39:56.540 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [ 2024-09-13T06:39:56.540 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.540 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:26422 3.8 3.36160188 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:39:56.540 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.504863+0000", 2024-09-13T06:39:56.540 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.031763430000000002, 2024-09-13T06:39:56.540 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.031781482, 2024-09-13T06:39:56.540 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:56.540 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-13T06:39:56.540 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:39:56.541 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:39:56.541 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:56.541 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 26422 2024-09-13T06:39:56.541 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.541 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:56.541 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.541 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:56.541 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.504863+0000", 2024-09-13T06:39:56.541 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.541 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.541 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.541 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:56.541 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.504863+0000", 2024-09-13T06:39:56.541 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.542 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.542 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.542 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:56.542 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.504863+0000", 2024-09-13T06:39:56.542 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:39:56.542 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.542 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.542 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:56.542 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.504865+0000", 2024-09-13T06:39:56.542 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5339999999999998e-06 2024-09-13T06:39:56.542 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.542 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.542 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:56.542 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.504873+0000", 2024-09-13T06:39:56.543 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5079999999999999e-06 2024-09-13T06:39:56.543 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.543 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.543 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:56.543 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.504878+0000", 2024-09-13T06:39:56.543 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2599999999999996e-06 2024-09-13T06:39:56.543 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.543 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:56.543 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.543 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.543 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.543 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:26467 3.18 3.c6d96fb8 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:39:56.543 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.512628+0000", 2024-09-13T06:39:56.544 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.023998698999999998, 2024-09-13T06:39:56.544 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.02405558, 2024-09-13T06:39:56.544 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:56.544 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-13T06:39:56.544 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:39:56.544 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:39:56.544 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:56.544 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 26467 2024-09-13T06:39:56.544 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.544 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:56.544 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.544 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:56.544 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.512628+0000", 2024-09-13T06:39:56.544 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.545 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.545 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.545 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:56.545 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.512628+0000", 2024-09-13T06:39:56.545 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.545 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.545 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.545 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:56.545 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.509325+0000", 2024-09-13T06:39:56.545 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9966969 2024-09-13T06:39:56.545 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.545 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.545 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:56.545 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.512637+0000", 2024-09-13T06:39:56.546 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.003312419 2024-09-13T06:39:56.546 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.546 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.546 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:56.546 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.512656+0000", 2024-09-13T06:39:56.546 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9139000000000001e-05 2024-09-13T06:39:56.546 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.546 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.546 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:56.546 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.512665+0000", 2024-09-13T06:39:56.546 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.1839999999999999e-06 2024-09-13T06:39:56.546 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.546 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:56.547 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.547 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.547 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.547 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:26676 3.8 3.36160188 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:39:56.547 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.525095+0000", 2024-09-13T06:39:56.547 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.011531850999999999, 2024-09-13T06:39:56.547 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.011623333, 2024-09-13T06:39:56.547 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:56.547 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-13T06:39:56.547 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:39:56.547 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:39:56.547 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:56.547 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 26676 2024-09-13T06:39:56.547 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.548 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:56.548 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.548 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:56.548 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.525095+0000", 2024-09-13T06:39:56.548 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.548 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.548 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.548 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:56.548 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.525095+0000", 2024-09-13T06:39:56.548 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.548 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.548 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.548 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:56.548 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.525094+0000", 2024-09-13T06:39:56.549 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:39:56.549 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.549 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.549 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:56.549 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.525097+0000", 2024-09-13T06:39:56.549 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5409999999999999e-06 2024-09-13T06:39:56.549 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.549 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.549 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:56.549 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.525103+0000", 2024-09-13T06:39:56.549 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.1349999999999997e-06 2024-09-13T06:39:56.549 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.549 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.549 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:56.550 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.525109+0000", 2024-09-13T06:39:56.550 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7930000000000003e-06 2024-09-13T06:39:56.550 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.550 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:56.550 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.550 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.550 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.550 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:26722 3.18 3.c6d96fb8 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:39:56.550 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.532757+0000", 2024-09-13T06:39:56.550 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.0038694100000000002, 2024-09-13T06:39:56.550 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0039920040000000004, 2024-09-13T06:39:56.550 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:56.550 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-13T06:39:56.550 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:39:56.551 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:39:56.551 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:56.551 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 26722 2024-09-13T06:39:56.551 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.551 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:56.551 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.551 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:56.551 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532757+0000", 2024-09-13T06:39:56.551 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.551 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.551 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.551 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:56.551 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532757+0000", 2024-09-13T06:39:56.551 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.552 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.552 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.552 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:56.552 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532757+0000", 2024-09-13T06:39:56.552 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:39:56.552 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.552 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.552 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:56.552 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532759+0000", 2024-09-13T06:39:56.552 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5330000000000001e-06 2024-09-13T06:39:56.552 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.552 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.552 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:56.553 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532767+0000", 2024-09-13T06:39:56.553 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.8429999999999993e-06 2024-09-13T06:39:56.553 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.553 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.553 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:56.553 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532772+0000", 2024-09-13T06:39:56.553 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2000000000000002e-06 2024-09-13T06:39:56.553 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.553 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:56.553 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.553 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.553 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.553 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25749 3.8 3.63996268 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:39:56.553 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.534467+0000", 2024-09-13T06:39:56.554 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.0021597130000000002, 2024-09-13T06:39:56.554 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0023136369999999999, 2024-09-13T06:39:56.554 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:56.554 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-13T06:39:56.554 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:39:56.554 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:39:56.554 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:56.554 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25749 2024-09-13T06:39:56.554 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.554 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:56.554 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.554 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:56.554 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.534467+0000", 2024-09-13T06:39:56.555 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.555 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.555 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.555 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:56.555 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.534467+0000", 2024-09-13T06:39:56.555 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.555 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.555 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.555 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:56.555 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.534466+0000", 2024-09-13T06:39:56.555 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:39:56.555 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.555 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.555 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:56.555 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.534470+0000", 2024-09-13T06:39:56.556 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.2820000000000001e-06 2024-09-13T06:39:56.556 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.556 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.556 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:56.556 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.534478+0000", 2024-09-13T06:39:56.556 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.4619999999999996e-06 2024-09-13T06:39:56.556 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.556 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.556 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:56.556 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.534485+0000", 2024-09-13T06:39:56.556 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.9909999999999996e-06 2024-09-13T06:39:56.556 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.556 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:56.557 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.557 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.557 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.557 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25916 3.8 3.36160188 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:39:56.557 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.535397+0000", 2024-09-13T06:39:56.557 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.001229836, 2024-09-13T06:39:56.557 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.001415868, 2024-09-13T06:39:56.557 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:56.557 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-13T06:39:56.557 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:39:56.557 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:39:56.557 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:56.557 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25916 2024-09-13T06:39:56.558 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.558 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:56.558 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.558 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:56.558 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.535397+0000", 2024-09-13T06:39:56.558 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.558 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.558 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.558 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:56.558 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.535397+0000", 2024-09-13T06:39:56.558 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.558 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.558 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.558 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:56.559 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.535396+0000", 2024-09-13T06:39:56.559 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:39:56.559 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.559 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.559 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:56.559 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.535399+0000", 2024-09-13T06:39:56.559 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5890000000000001e-06 2024-09-13T06:39:56.559 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.559 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.559 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:56.559 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.535405+0000", 2024-09-13T06:39:56.560 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.1109999999999996e-06 2024-09-13T06:39:56.560 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.560 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.560 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:56.560 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.535410+0000", 2024-09-13T06:39:56.560 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9019999999999998e-06 2024-09-13T06:39:56.560 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.560 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:56.560 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.560 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.560 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.560 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:26011 3.8 3.63996268 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:39:56.561 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.536201+0000", 2024-09-13T06:39:56.561 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.00042584399999999998, 2024-09-13T06:39:56.561 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00064075600000000003, 2024-09-13T06:39:56.561 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:56.561 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-13T06:39:56.561 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:39:56.561 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:39:56.561 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:56.561 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 26011 2024-09-13T06:39:56.561 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.561 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:56.561 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.561 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:56.562 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.536201+0000", 2024-09-13T06:39:56.562 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.562 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.562 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.562 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:56.562 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.536201+0000", 2024-09-13T06:39:56.562 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.562 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.562 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.562 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:56.562 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.536200+0000", 2024-09-13T06:39:56.562 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:39:56.562 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.562 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.563 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:56.563 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.536207+0000", 2024-09-13T06:39:56.563 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.2480000000000001e-06 2024-09-13T06:39:56.563 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.563 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.563 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:56.563 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.536214+0000", 2024-09-13T06:39:56.563 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.0319999999999998e-06 2024-09-13T06:39:56.563 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.563 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.563 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:56.563 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.536219+0000", 2024-09-13T06:39:56.563 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3900000000000001e-06 2024-09-13T06:39:56.564 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.564 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:56.564 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.564 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.564 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.564 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:26423 3.8 3.36160188 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:39:56.564 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.504883+0000", 2024-09-13T06:39:56.564 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.031744092000000002, 2024-09-13T06:39:56.564 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.031988405999999997, 2024-09-13T06:39:56.564 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:56.564 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-13T06:39:56.564 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:39:56.564 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:39:56.565 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:56.565 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 26423 2024-09-13T06:39:56.565 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.565 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:56.565 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.565 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:56.565 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.504883+0000", 2024-09-13T06:39:56.565 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.565 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.565 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.565 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:56.565 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.504883+0000", 2024-09-13T06:39:56.565 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.566 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.566 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.566 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:56.566 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.504882+0000", 2024-09-13T06:39:56.566 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:39:56.566 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.566 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.566 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:56.566 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.504885+0000", 2024-09-13T06:39:56.566 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6680000000000001e-06 2024-09-13T06:39:56.566 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.566 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.566 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:56.567 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.504892+0000", 2024-09-13T06:39:56.567 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.221e-06 2024-09-13T06:39:56.567 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.567 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.567 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:56.567 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.504897+0000", 2024-09-13T06:39:56.567 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6959999999999996e-06 2024-09-13T06:39:56.567 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.567 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:56.567 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.567 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.567 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.567 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:26468 3.18 3.c6d96fb8 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:39:56.567 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.512672+0000", 2024-09-13T06:39:56.568 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.023955085000000001, 2024-09-13T06:39:56.568 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.024228599999999999, 2024-09-13T06:39:56.568 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:56.568 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-13T06:39:56.568 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:39:56.568 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:39:56.568 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:56.568 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 26468 2024-09-13T06:39:56.568 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.568 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:56.568 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.568 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:56.568 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.512672+0000", 2024-09-13T06:39:56.569 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.569 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.569 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.569 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:56.569 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.512672+0000", 2024-09-13T06:39:56.569 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.569 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.569 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.569 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:56.569 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.512671+0000", 2024-09-13T06:39:56.569 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:39:56.569 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.569 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.569 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:56.570 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.512674+0000", 2024-09-13T06:39:56.570 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.2940000000000001e-06 2024-09-13T06:39:56.570 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.570 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.570 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:56.570 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.512681+0000", 2024-09-13T06:39:56.570 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.9999999999999999e-06 2024-09-13T06:39:56.570 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.570 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.570 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:56.570 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.512687+0000", 2024-09-13T06:39:56.570 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3770000000000004e-06 2024-09-13T06:39:56.570 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.570 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:56.571 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.571 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.571 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.571 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:26677 3.8 3.36160188 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:39:56.571 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.525114+0000", 2024-09-13T06:39:56.571 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.011512629, 2024-09-13T06:39:56.571 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.011817162000000001, 2024-09-13T06:39:56.571 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:56.571 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-13T06:39:56.571 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:39:56.571 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:39:56.571 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:56.571 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 26677 2024-09-13T06:39:56.572 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.572 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:56.572 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.572 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:56.572 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.525114+0000", 2024-09-13T06:39:56.572 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.572 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.572 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.572 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:56.572 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.525114+0000", 2024-09-13T06:39:56.572 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.572 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.573 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.573 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:56.573 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.525114+0000", 2024-09-13T06:39:56.573 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:39:56.573 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.573 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.573 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:56.573 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.525116+0000", 2024-09-13T06:39:56.573 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5440000000000001e-06 2024-09-13T06:39:56.573 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.574 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.574 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:56.574 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.525122+0000", 2024-09-13T06:39:56.574 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.1190000000000002e-06 2024-09-13T06:39:56.574 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.574 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.574 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:56.574 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.525128+0000", 2024-09-13T06:39:56.574 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.5940000000000001e-06 2024-09-13T06:39:56.574 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.574 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:56.574 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.575 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.575 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.575 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:26723 3.18 3.c6d96fb8 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:39:56.575 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.532777+0000", 2024-09-13T06:39:56.575 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.0038499850000000002, 2024-09-13T06:39:56.575 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.004183801, 2024-09-13T06:39:56.575 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:56.575 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-13T06:39:56.575 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:39:56.575 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:39:56.575 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:56.575 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 26723 2024-09-13T06:39:56.575 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.575 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:56.576 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.576 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:56.576 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532777+0000", 2024-09-13T06:39:56.576 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.576 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.576 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.576 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:56.576 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532777+0000", 2024-09-13T06:39:56.576 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.576 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.576 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.576 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:56.576 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532776+0000", 2024-09-13T06:39:56.576 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:39:56.577 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.577 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.577 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:56.577 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532784+0000", 2024-09-13T06:39:56.577 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3170000000000004e-06 2024-09-13T06:39:56.577 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.577 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.577 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:56.577 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532790+0000", 2024-09-13T06:39:56.577 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.139e-06 2024-09-13T06:39:56.577 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.577 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.577 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:56.577 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532795+0000", 2024-09-13T06:39:56.577 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6929999999999998e-06 2024-09-13T06:39:56.578 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.578 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:56.578 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.578 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.578 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.578 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25750 3.8 3.63996268 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:39:56.578 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.534491+0000", 2024-09-13T06:39:56.578 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.0021357749999999999, 2024-09-13T06:39:56.578 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0024984109999999999, 2024-09-13T06:39:56.578 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:56.578 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-13T06:39:56.578 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:39:56.578 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:39:56.579 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:56.579 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25750 2024-09-13T06:39:56.579 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.579 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:56.579 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.579 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:56.579 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.534491+0000", 2024-09-13T06:39:56.579 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.579 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.579 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.579 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:56.579 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.534491+0000", 2024-09-13T06:39:56.579 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.580 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.580 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.580 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:56.580 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.534490+0000", 2024-09-13T06:39:56.580 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:39:56.580 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.580 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.580 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:56.580 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.534493+0000", 2024-09-13T06:39:56.580 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.796e-06 2024-09-13T06:39:56.580 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.580 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.580 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:56.580 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.534500+0000", 2024-09-13T06:39:56.581 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.4699999999999999e-06 2024-09-13T06:39:56.581 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.581 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.581 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:56.581 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.534505+0000", 2024-09-13T06:39:56.581 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.4389999999999999e-06 2024-09-13T06:39:56.581 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.581 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:56.581 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.581 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.581 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.581 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25917 3.8 3.36160188 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:39:56.581 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.535424+0000", 2024-09-13T06:39:56.581 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.001202507, 2024-09-13T06:39:56.582 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0015936800000000001, 2024-09-13T06:39:56.582 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:56.582 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-13T06:39:56.582 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:39:56.582 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:39:56.582 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:56.582 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25917 2024-09-13T06:39:56.582 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.582 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:56.582 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.582 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:56.582 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.535424+0000", 2024-09-13T06:39:56.582 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.582 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.583 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.583 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:56.583 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.535424+0000", 2024-09-13T06:39:56.583 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.583 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.583 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.583 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:56.583 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.535424+0000", 2024-09-13T06:39:56.583 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:39:56.583 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.583 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.583 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:56.583 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.535427+0000", 2024-09-13T06:39:56.583 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9189999999999999e-06 2024-09-13T06:39:56.584 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.584 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.584 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:56.584 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.535433+0000", 2024-09-13T06:39:56.584 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.8129999999999998e-06 2024-09-13T06:39:56.584 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.584 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.584 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:56.584 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.535438+0000", 2024-09-13T06:39:56.584 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.1019999999999996e-06 2024-09-13T06:39:56.584 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.584 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:56.584 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.585 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.585 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.585 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:26012 3.8 3.63996268 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:39:56.585 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.536225+0000", 2024-09-13T06:39:56.585 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.00040214100000000001, 2024-09-13T06:39:56.585 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00082205500000000003, 2024-09-13T06:39:56.585 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:56.585 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-13T06:39:56.585 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:39:56.585 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:39:56.585 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:56.585 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 26012 2024-09-13T06:39:56.585 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.586 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:56.586 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.586 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:56.586 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.536225+0000", 2024-09-13T06:39:56.586 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.586 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.586 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.586 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:56.586 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.536225+0000", 2024-09-13T06:39:56.586 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.586 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.586 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.586 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:56.587 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.536224+0000", 2024-09-13T06:39:56.587 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:39:56.587 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.587 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.587 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:56.587 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.536231+0000", 2024-09-13T06:39:56.587 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4100000000000002e-06 2024-09-13T06:39:56.587 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.587 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.587 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:56.587 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.536238+0000", 2024-09-13T06:39:56.587 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.6080000000000001e-06 2024-09-13T06:39:56.587 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.588 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.588 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:56.588 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.536246+0000", 2024-09-13T06:39:56.588 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.1030000000000002e-06 2024-09-13T06:39:56.588 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.588 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:56.588 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.588 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.588 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.588 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:26424 3.8 3.36160188 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:39:56.588 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.504901+0000", 2024-09-13T06:39:56.588 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.031725307000000001, 2024-09-13T06:39:56.588 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.032175519, 2024-09-13T06:39:56.589 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:56.589 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-13T06:39:56.589 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:39:56.589 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:39:56.589 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:56.589 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 26424 2024-09-13T06:39:56.589 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.589 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:56.589 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.589 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:56.589 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.504901+0000", 2024-09-13T06:39:56.589 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.589 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.590 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.590 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:56.590 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.504901+0000", 2024-09-13T06:39:56.590 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.590 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.590 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.590 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:56.590 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.504901+0000", 2024-09-13T06:39:56.590 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:39:56.590 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.591 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.591 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:56.591 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.504904+0000", 2024-09-13T06:39:56.591 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4329999999999998e-06 2024-09-13T06:39:56.591 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.591 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.591 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:56.591 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.504912+0000", 2024-09-13T06:39:56.591 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.2269999999999993e-06 2024-09-13T06:39:56.591 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.591 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.592 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:56.592 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.504917+0000", 2024-09-13T06:39:56.592 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0769999999999998e-06 2024-09-13T06:39:56.592 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.592 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:56.592 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.592 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.592 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.592 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:26469 3.18 3.c6d96fb8 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:39:56.592 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.512692+0000", 2024-09-13T06:39:56.592 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.02393516, 2024-09-13T06:39:56.592 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.02441428, 2024-09-13T06:39:56.592 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:56.593 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-13T06:39:56.593 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:39:56.593 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:39:56.593 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:56.593 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 26469 2024-09-13T06:39:56.593 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.593 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:56.593 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.593 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:56.593 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.512692+0000", 2024-09-13T06:39:56.593 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.593 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.593 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.594 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:56.594 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.512692+0000", 2024-09-13T06:39:56.594 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.594 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.594 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.594 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:56.594 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.512691+0000", 2024-09-13T06:39:56.594 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:39:56.594 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.594 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.594 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:56.594 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.512694+0000", 2024-09-13T06:39:56.594 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4399999999999999e-06 2024-09-13T06:39:56.594 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.595 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.595 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:56.595 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.512699+0000", 2024-09-13T06:39:56.595 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7710000000000003e-06 2024-09-13T06:39:56.595 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.595 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.595 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:56.595 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.512704+0000", 2024-09-13T06:39:56.595 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7709999999999997e-06 2024-09-13T06:39:56.595 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.595 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:56.595 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.595 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.595 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.596 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:26678 3.8 3.36160188 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:39:56.596 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.525133+0000", 2024-09-13T06:39:56.596 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.0114941, 2024-09-13T06:39:56.596 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.012001974, 2024-09-13T06:39:56.596 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:56.596 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-13T06:39:56.596 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:39:56.596 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:39:56.596 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:56.596 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 26678 2024-09-13T06:39:56.596 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.596 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:56.596 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.597 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:56.597 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.525133+0000", 2024-09-13T06:39:56.597 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.597 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.597 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.597 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:56.597 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.525133+0000", 2024-09-13T06:39:56.597 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.597 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.597 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.597 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:56.597 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.525132+0000", 2024-09-13T06:39:56.597 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:39:56.597 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.598 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.598 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:56.598 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.525135+0000", 2024-09-13T06:39:56.598 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2400000000000002e-06 2024-09-13T06:39:56.598 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.598 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.598 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:56.598 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.525141+0000", 2024-09-13T06:39:56.598 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.1519999999999997e-06 2024-09-13T06:39:56.598 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.598 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.598 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:56.598 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.525146+0000", 2024-09-13T06:39:56.598 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9529999999999998e-06 2024-09-13T06:39:56.599 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.599 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:56.599 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.599 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.599 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.599 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:26724 3.18 3.c6d96fb8 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:39:56.599 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.532799+0000", 2024-09-13T06:39:56.599 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.0038278600000000002, 2024-09-13T06:39:56.599 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.004364751, 2024-09-13T06:39:56.599 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:56.599 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-13T06:39:56.599 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:39:56.599 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:39:56.599 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:56.600 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 26724 2024-09-13T06:39:56.600 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.600 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:56.600 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.600 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:56.600 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532799+0000", 2024-09-13T06:39:56.600 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.600 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.600 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.600 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:56.600 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532799+0000", 2024-09-13T06:39:56.600 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.600 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.601 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.601 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:56.601 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532799+0000", 2024-09-13T06:39:56.601 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:39:56.601 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.601 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.601 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:56.601 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532801+0000", 2024-09-13T06:39:56.601 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.531e-06 2024-09-13T06:39:56.601 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.601 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.601 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:56.601 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532807+0000", 2024-09-13T06:39:56.602 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8220000000000003e-06 2024-09-13T06:39:56.602 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.602 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.602 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:56.602 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532811+0000", 2024-09-13T06:39:56.602 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4549999999999997e-06 2024-09-13T06:39:56.602 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.602 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:56.602 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.602 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.602 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.602 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25751 3.8 3.63996268 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:39:56.602 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.534517+0000", 2024-09-13T06:39:56.602 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.0021098480000000001, 2024-09-13T06:39:56.602 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0026789409999999998, 2024-09-13T06:39:56.603 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:56.603 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-13T06:39:56.603 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:39:56.603 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:39:56.603 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:56.603 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25751 2024-09-13T06:39:56.603 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.603 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:56.603 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.603 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:56.603 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.534517+0000", 2024-09-13T06:39:56.603 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.603 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.603 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.604 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:56.604 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.534517+0000", 2024-09-13T06:39:56.604 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.604 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.604 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.604 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:56.604 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.534516+0000", 2024-09-13T06:39:56.604 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:39:56.604 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.604 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.604 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:56.604 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.534519+0000", 2024-09-13T06:39:56.604 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.7659999999999999e-06 2024-09-13T06:39:56.605 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.605 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.605 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:56.605 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.534526+0000", 2024-09-13T06:39:56.605 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.7730000000000002e-06 2024-09-13T06:39:56.605 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.605 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.605 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:56.605 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.534531+0000", 2024-09-13T06:39:56.605 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3519999999999997e-06 2024-09-13T06:39:56.605 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.605 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:56.605 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.606 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.606 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.606 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25945 3.18 3.c6d96fb8 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:39:56.606 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.535443+0000", 2024-09-13T06:39:56.606 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.0011833620000000001, 2024-09-13T06:39:56.606 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0017878880000000001, 2024-09-13T06:39:56.606 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:56.606 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-13T06:39:56.606 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:39:56.606 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:39:56.606 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:56.606 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25945 2024-09-13T06:39:56.606 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.607 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:56.607 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.607 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:56.607 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.535443+0000", 2024-09-13T06:39:56.607 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.607 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.607 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.607 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:56.607 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.535443+0000", 2024-09-13T06:39:56.607 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.607 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.607 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.607 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:56.608 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.535443+0000", 2024-09-13T06:39:56.608 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:39:56.608 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.608 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.608 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:56.608 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.535445+0000", 2024-09-13T06:39:56.608 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.695e-06 2024-09-13T06:39:56.608 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.608 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.608 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:56.608 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.535452+0000", 2024-09-13T06:39:56.608 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.5420000000000002e-06 2024-09-13T06:39:56.608 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.608 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.609 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:56.609 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.535457+0000", 2024-09-13T06:39:56.609 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7110000000000003e-06 2024-09-13T06:39:56.609 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.609 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:56.609 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.609 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.609 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.609 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:26013 3.8 3.63996268 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:39:56.609 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.536261+0000", 2024-09-13T06:39:56.609 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.00036613999999999999, 2024-09-13T06:39:56.609 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00099943499999999991, 2024-09-13T06:39:56.609 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:56.610 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-13T06:39:56.610 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:39:56.610 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:39:56.610 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:56.610 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 26013 2024-09-13T06:39:56.610 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.610 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:56.610 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.610 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:56.610 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.536261+0000", 2024-09-13T06:39:56.610 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.610 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.610 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.611 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:56.611 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.536261+0000", 2024-09-13T06:39:56.611 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.611 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.611 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.611 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:56.611 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.536260+0000", 2024-09-13T06:39:56.611 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:39:56.611 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.611 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.611 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:56.611 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.536263+0000", 2024-09-13T06:39:56.611 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.982e-06 2024-09-13T06:39:56.612 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.612 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.612 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:56.612 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.536270+0000", 2024-09-13T06:39:56.612 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.9519999999999997e-06 2024-09-13T06:39:56.612 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.612 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.612 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:56.612 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.536275+0000", 2024-09-13T06:39:56.612 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9180000000000002e-06 2024-09-13T06:39:56.612 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.612 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:56.612 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.613 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.613 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.613 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:26425 3.8 3.36160188 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:39:56.613 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.504922+0000", 2024-09-13T06:39:56.613 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.031704599, 2024-09-13T06:39:56.613 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.032367999000000001, 2024-09-13T06:39:56.613 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:56.613 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:39:56.613 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:39:56.613 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:39:56.613 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:56.613 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 26425 2024-09-13T06:39:56.614 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.614 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:56.614 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.614 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:56.614 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.504922+0000", 2024-09-13T06:39:56.614 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.614 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.614 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.614 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:56.614 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.504922+0000", 2024-09-13T06:39:56.614 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.614 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.614 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.614 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:56.615 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.504922+0000", 2024-09-13T06:39:56.615 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:39:56.615 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.615 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.615 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:56.615 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.504924+0000", 2024-09-13T06:39:56.615 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4839999999999998e-06 2024-09-13T06:39:56.615 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.615 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.615 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:56.615 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.504932+0000", 2024-09-13T06:39:56.615 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5020000000000003e-06 2024-09-13T06:39:56.615 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.615 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.615 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:56.616 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.504936+0000", 2024-09-13T06:39:56.616 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6759999999999998e-06 2024-09-13T06:39:56.616 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.616 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.616 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:56.616 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.537284+0000", 2024-09-13T06:39:56.616 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.032347980999999998 2024-09-13T06:39:56.616 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.616 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.616 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:56.616 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.537293+0000", 2024-09-13T06:39:56.616 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.3410000000000003e-06 2024-09-13T06:39:56.616 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.616 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:56.617 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.617 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.617 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.617 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:26506 3.18 3.69d46638 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:39:56.617 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.512708+0000", 2024-09-13T06:39:56.617 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.023918548000000001, 2024-09-13T06:39:56.617 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.024623094000000002, 2024-09-13T06:39:56.617 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:56.617 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-13T06:39:56.617 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:39:56.617 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:39:56.617 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:56.617 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 26506 2024-09-13T06:39:56.617 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.617 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:56.618 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.618 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:56.618 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.512708+0000", 2024-09-13T06:39:56.618 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.618 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.618 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.618 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:56.618 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.512708+0000", 2024-09-13T06:39:56.618 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.618 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.618 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.618 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:56.618 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.512708+0000", 2024-09-13T06:39:56.618 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:39:56.618 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.619 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.619 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:56.619 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.512710+0000", 2024-09-13T06:39:56.619 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.458e-06 2024-09-13T06:39:56.619 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.619 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.619 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:56.619 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.512716+0000", 2024-09-13T06:39:56.619 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8730000000000004e-06 2024-09-13T06:39:56.619 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.619 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.619 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:56.619 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.512721+0000", 2024-09-13T06:39:56.619 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.3980000000000001e-06 2024-09-13T06:39:56.619 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.619 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:56.620 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.620 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.620 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.620 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:26679 3.8 3.36160188 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:39:56.620 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.525150+0000", 2024-09-13T06:39:56.620 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.011476627, 2024-09-13T06:39:56.620 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.012210634999999999, 2024-09-13T06:39:56.620 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:56.620 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-13T06:39:56.620 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:39:56.620 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:39:56.620 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:56.620 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 26679 2024-09-13T06:39:56.620 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.620 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:56.621 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.621 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:56.621 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.525150+0000", 2024-09-13T06:39:56.621 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.621 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.621 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.621 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:56.621 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.525150+0000", 2024-09-13T06:39:56.621 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.621 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.621 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.621 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:56.621 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.525150+0000", 2024-09-13T06:39:56.621 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:39:56.622 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.622 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.622 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:56.622 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.525152+0000", 2024-09-13T06:39:56.622 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.401e-06 2024-09-13T06:39:56.622 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.622 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.622 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:56.622 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.525158+0000", 2024-09-13T06:39:56.622 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0170000000000002e-06 2024-09-13T06:39:56.622 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.622 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.622 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:56.622 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.525164+0000", 2024-09-13T06:39:56.622 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.1299999999999998e-06 2024-09-13T06:39:56.623 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.623 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:56.623 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.623 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.623 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.623 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:26725 3.18 3.c6d96fb8 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:39:56.623 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.532815+0000", 2024-09-13T06:39:56.623 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.0038114070000000002, 2024-09-13T06:39:56.623 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.004574519, 2024-09-13T06:39:56.623 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:56.623 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-13T06:39:56.623 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:39:56.623 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:39:56.624 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:56.624 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 26725 2024-09-13T06:39:56.624 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.624 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:56.624 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.624 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:56.624 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532815+0000", 2024-09-13T06:39:56.624 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.624 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.624 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.624 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:56.624 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532815+0000", 2024-09-13T06:39:56.624 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.625 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.625 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.625 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:56.625 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532815+0000", 2024-09-13T06:39:56.625 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:39:56.625 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.625 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.625 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:56.625 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532817+0000", 2024-09-13T06:39:56.625 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3910000000000001e-06 2024-09-13T06:39:56.625 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.625 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.625 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:56.625 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532822+0000", 2024-09-13T06:39:56.626 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9919999999999998e-06 2024-09-13T06:39:56.626 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.626 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.626 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:56.626 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532827+0000", 2024-09-13T06:39:56.626 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5549999999999996e-06 2024-09-13T06:39:56.626 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.626 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:56.626 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.626 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.626 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.626 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25752 3.8 3.63996268 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:39:56.626 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.534544+0000", 2024-09-13T06:39:56.626 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.0020831589999999998, 2024-09-13T06:39:56.627 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0028773969999999999, 2024-09-13T06:39:56.627 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:56.627 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-13T06:39:56.627 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:39:56.627 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:39:56.627 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:56.627 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25752 2024-09-13T06:39:56.627 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.627 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:56.627 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.627 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:56.627 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.534544+0000", 2024-09-13T06:39:56.627 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.628 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.628 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.628 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:56.628 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.534544+0000", 2024-09-13T06:39:56.628 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.628 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.628 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.628 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:56.628 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.534543+0000", 2024-09-13T06:39:56.628 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:39:56.628 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.628 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.628 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:56.628 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.534546+0000", 2024-09-13T06:39:56.629 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.7609999999999999e-06 2024-09-13T06:39:56.629 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.629 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.629 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:56.629 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.534552+0000", 2024-09-13T06:39:56.629 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.331e-06 2024-09-13T06:39:56.629 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.629 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.629 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:56.629 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.534557+0000", 2024-09-13T06:39:56.629 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.169e-06 2024-09-13T06:39:56.629 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.629 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:56.629 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.630 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.630 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.630 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25946 3.18 3.c6d96fb8 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:39:56.630 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.535474+0000", 2024-09-13T06:39:56.630 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.0011529050000000001, 2024-09-13T06:39:56.630 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0019759000000000001, 2024-09-13T06:39:56.630 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:56.630 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-13T06:39:56.630 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:39:56.630 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:39:56.630 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:56.630 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25946 2024-09-13T06:39:56.630 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.630 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:56.631 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.631 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:56.631 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.535474+0000", 2024-09-13T06:39:56.631 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.631 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.631 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.631 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:56.631 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.535474+0000", 2024-09-13T06:39:56.631 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.631 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.631 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.631 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:56.631 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.535473+0000", 2024-09-13T06:39:56.631 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:39:56.631 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.632 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.632 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:56.632 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.535476+0000", 2024-09-13T06:39:56.632 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.1140000000000002e-06 2024-09-13T06:39:56.632 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.632 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.632 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:56.632 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.535483+0000", 2024-09-13T06:39:56.632 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.0129999999999996e-06 2024-09-13T06:39:56.632 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.632 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.632 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:56.632 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.535489+0000", 2024-09-13T06:39:56.633 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.4979999999999997e-06 2024-09-13T06:39:56.633 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.633 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:56.633 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.633 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.633 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.633 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:26014 3.8 3.63996268 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:39:56.633 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.536280+0000", 2024-09-13T06:39:56.633 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.00034667900000000002, 2024-09-13T06:39:56.633 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0011983320000000001, 2024-09-13T06:39:56.633 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:56.633 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-13T06:39:56.634 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:39:56.634 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:39:56.634 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:56.634 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 26014 2024-09-13T06:39:56.634 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.634 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:56.634 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.634 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:56.634 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.536280+0000", 2024-09-13T06:39:56.634 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.634 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.634 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.634 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:56.634 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.536280+0000", 2024-09-13T06:39:56.635 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.635 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.635 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.635 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:56.635 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.536280+0000", 2024-09-13T06:39:56.635 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:39:56.635 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.635 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.635 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:56.635 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.536282+0000", 2024-09-13T06:39:56.635 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5050000000000002e-06 2024-09-13T06:39:56.635 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.635 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.635 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:56.636 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.536288+0000", 2024-09-13T06:39:56.636 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.5369999999999997e-06 2024-09-13T06:39:56.636 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.636 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.636 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:56.636 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.536292+0000", 2024-09-13T06:39:56.636 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7709999999999997e-06 2024-09-13T06:39:56.636 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.636 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:56.636 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.636 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.636 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.636 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:26507 3.18 3.69d46638 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:39:56.637 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.512725+0000", 2024-09-13T06:39:56.637 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.023902163000000001, 2024-09-13T06:39:56.637 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.024784105000000001, 2024-09-13T06:39:56.637 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:56.637 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-13T06:39:56.637 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:39:56.637 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:39:56.637 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:56.637 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 26507 2024-09-13T06:39:56.637 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.637 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:56.637 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.637 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:56.637 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.512725+0000", 2024-09-13T06:39:56.638 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.638 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.638 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.638 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:56.638 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.512725+0000", 2024-09-13T06:39:56.638 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.638 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.638 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.638 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:56.638 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.512724+0000", 2024-09-13T06:39:56.638 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:39:56.638 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.638 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.638 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:56.639 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.512726+0000", 2024-09-13T06:39:56.639 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1399999999999998e-06 2024-09-13T06:39:56.639 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.639 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.639 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:56.639 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.512732+0000", 2024-09-13T06:39:56.639 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.6019999999999999e-06 2024-09-13T06:39:56.639 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.639 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.639 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:56.639 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.512736+0000", 2024-09-13T06:39:56.639 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.3529999999999997e-06 2024-09-13T06:39:56.639 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.639 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:56.640 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.640 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.640 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.640 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:26610 3.8 3.62c67748 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:39:56.640 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.520654+0000", 2024-09-13T06:39:56.640 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.015972324999999999, 2024-09-13T06:39:56.640 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.016885051000000002, 2024-09-13T06:39:56.640 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:56.640 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-13T06:39:56.640 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:39:56.640 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:39:56.640 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:56.640 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 26610 2024-09-13T06:39:56.641 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.641 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:56.641 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.641 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:56.641 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.520654+0000", 2024-09-13T06:39:56.641 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.641 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.641 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.641 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:56.641 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.520654+0000", 2024-09-13T06:39:56.641 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.641 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.641 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.641 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:56.641 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.520654+0000", 2024-09-13T06:39:56.642 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:39:56.642 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.642 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.642 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:56.642 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.520660+0000", 2024-09-13T06:39:56.642 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.5790000000000003e-06 2024-09-13T06:39:56.642 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.642 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.642 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:56.642 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.520663+0000", 2024-09-13T06:39:56.642 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.2880000000000001e-06 2024-09-13T06:39:56.642 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.642 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.642 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:56.642 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.520666+0000", 2024-09-13T06:39:56.643 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.869e-06 2024-09-13T06:39:56.643 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.643 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:56.643 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.643 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.643 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.643 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:26680 3.8 3.36160188 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:39:56.643 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.525168+0000", 2024-09-13T06:39:56.643 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.011458283, 2024-09-13T06:39:56.643 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.012402280999999999, 2024-09-13T06:39:56.643 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:56.643 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-13T06:39:56.643 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:39:56.644 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:39:56.644 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:56.644 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 26680 2024-09-13T06:39:56.644 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.644 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:56.644 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.644 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:56.644 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.525168+0000", 2024-09-13T06:39:56.644 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.644 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.644 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.644 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:56.644 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.525168+0000", 2024-09-13T06:39:56.644 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.645 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.645 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.645 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:56.645 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.525168+0000", 2024-09-13T06:39:56.645 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:39:56.645 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.645 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.645 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:56.645 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.525170+0000", 2024-09-13T06:39:56.645 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9759999999999998e-06 2024-09-13T06:39:56.645 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.645 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.645 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:56.645 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.525176+0000", 2024-09-13T06:39:56.646 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8200000000000002e-06 2024-09-13T06:39:56.646 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.646 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.646 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:56.646 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.525182+0000", 2024-09-13T06:39:56.646 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.212e-06 2024-09-13T06:39:56.646 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.646 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:56.646 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.646 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.646 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.646 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:26762 3.18 3.69d46638 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:39:56.646 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.532831+0000", 2024-09-13T06:39:56.646 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.0037956460000000002, 2024-09-13T06:39:56.647 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0047683120000000002, 2024-09-13T06:39:56.647 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:56.647 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-13T06:39:56.647 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:39:56.647 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:39:56.647 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:56.647 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 26762 2024-09-13T06:39:56.647 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.647 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:56.647 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.647 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:56.647 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532831+0000", 2024-09-13T06:39:56.647 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.647 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.648 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.648 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:56.648 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532831+0000", 2024-09-13T06:39:56.648 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.648 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.648 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.648 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:56.648 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532831+0000", 2024-09-13T06:39:56.648 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:39:56.648 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.648 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.648 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:56.648 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532833+0000", 2024-09-13T06:39:56.648 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2649999999999999e-06 2024-09-13T06:39:56.649 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.649 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.649 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:56.649 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532838+0000", 2024-09-13T06:39:56.649 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.4559999999999999e-06 2024-09-13T06:39:56.649 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.649 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.649 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:56.649 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532843+0000", 2024-09-13T06:39:56.649 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4769999999999997e-06 2024-09-13T06:39:56.649 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.649 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:56.649 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.649 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.649 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.650 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25753 3.8 3.63996268 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:39:56.650 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.534568+0000", 2024-09-13T06:39:56.650 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.002058453, 2024-09-13T06:39:56.650 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0030597630000000001, 2024-09-13T06:39:56.650 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:56.650 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-13T06:39:56.650 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:39:56.650 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:39:56.650 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:56.650 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25753 2024-09-13T06:39:56.650 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.650 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:56.650 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.650 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:56.650 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.534568+0000", 2024-09-13T06:39:56.651 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.651 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.651 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.651 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:56.651 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.534568+0000", 2024-09-13T06:39:56.651 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.651 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.651 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.651 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:56.651 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.534568+0000", 2024-09-13T06:39:56.651 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:39:56.651 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.651 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.651 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:56.652 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.534583+0000", 2024-09-13T06:39:56.652 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4899000000000001e-05 2024-09-13T06:39:56.652 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.652 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.652 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:56.652 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.534590+0000", 2024-09-13T06:39:56.652 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3599999999999998e-06 2024-09-13T06:39:56.652 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.652 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.652 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:56.652 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.534597+0000", 2024-09-13T06:39:56.652 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.8290000000000002e-06 2024-09-13T06:39:56.652 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.652 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:56.653 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.653 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.653 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.653 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25947 3.18 3.c6d96fb8 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:39:56.653 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.535520+0000", 2024-09-13T06:39:56.653 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.001106456, 2024-09-13T06:39:56.653 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0021416349999999998, 2024-09-13T06:39:56.653 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:56.653 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-13T06:39:56.653 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:39:56.653 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:39:56.653 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:56.653 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25947 2024-09-13T06:39:56.654 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.654 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:56.654 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.654 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:56.654 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.535520+0000", 2024-09-13T06:39:56.654 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.654 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.654 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.654 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:56.654 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.535520+0000", 2024-09-13T06:39:56.654 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.654 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.654 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.655 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:56.655 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.535520+0000", 2024-09-13T06:39:56.655 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:39:56.655 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.655 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.655 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:56.655 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.535523+0000", 2024-09-13T06:39:56.655 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.129e-06 2024-09-13T06:39:56.655 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.655 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.655 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:56.655 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.535536+0000", 2024-09-13T06:39:56.655 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3380000000000001e-05 2024-09-13T06:39:56.655 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.656 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.656 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:56.656 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.535542+0000", 2024-09-13T06:39:56.656 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.6099999999999997e-06 2024-09-13T06:39:56.656 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.656 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:56.656 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.656 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.656 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.656 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:26015 3.8 3.63996268 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:39:56.656 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.536306+0000", 2024-09-13T06:39:56.656 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.00032040699999999998, 2024-09-13T06:39:56.656 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0013838710000000001, 2024-09-13T06:39:56.656 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:56.657 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-13T06:39:56.657 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:39:56.657 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:39:56.657 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:56.657 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 26015 2024-09-13T06:39:56.657 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.657 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:56.657 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.657 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:56.657 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.536306+0000", 2024-09-13T06:39:56.657 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.657 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.657 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.657 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:56.657 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.536306+0000", 2024-09-13T06:39:56.658 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.658 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.658 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.658 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:56.658 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.536306+0000", 2024-09-13T06:39:56.658 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:39:56.658 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.658 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.658 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:56.658 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.536309+0000", 2024-09-13T06:39:56.658 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.8830000000000002e-06 2024-09-13T06:39:56.658 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.658 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.658 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:56.658 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.536315+0000", 2024-09-13T06:39:56.659 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.2740000000000004e-06 2024-09-13T06:39:56.659 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.659 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.659 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:56.659 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.536320+0000", 2024-09-13T06:39:56.659 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.938e-06 2024-09-13T06:39:56.659 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.659 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:56.659 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.659 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.659 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.659 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:26611 3.8 3.62c67748 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:39:56.659 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.520669+0000", 2024-09-13T06:39:56.660 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.015958192999999999, 2024-09-13T06:39:56.660 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017090561000000001, 2024-09-13T06:39:56.660 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:56.660 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-13T06:39:56.660 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:39:56.660 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:39:56.660 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:56.660 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 26611 2024-09-13T06:39:56.660 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.660 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:56.660 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.660 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:56.660 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.520669+0000", 2024-09-13T06:39:56.660 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.660 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.661 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.661 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:56.661 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.520669+0000", 2024-09-13T06:39:56.661 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.661 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.661 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.661 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:56.661 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.520668+0000", 2024-09-13T06:39:56.661 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:39:56.661 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.661 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.661 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:56.661 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.520670+0000", 2024-09-13T06:39:56.661 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4249999999999999e-06 2024-09-13T06:39:56.662 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.662 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.662 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:56.662 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.520673+0000", 2024-09-13T06:39:56.662 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.0649999999999999e-06 2024-09-13T06:39:56.662 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.662 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.662 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:56.662 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.520675+0000", 2024-09-13T06:39:56.662 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6369999999999999e-06 2024-09-13T06:39:56.662 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.662 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:56.662 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.662 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.663 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.663 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:26681 3.8 3.36160188 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:39:56.663 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.525186+0000", 2024-09-13T06:39:56.663 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.011440529, 2024-09-13T06:39:56.663 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.012602425, 2024-09-13T06:39:56.663 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:56.663 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-13T06:39:56.663 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:39:56.663 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:39:56.663 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:56.663 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 26681 2024-09-13T06:39:56.663 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.663 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:56.664 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.664 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:56.664 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.525186+0000", 2024-09-13T06:39:56.664 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.664 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.664 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.664 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:56.664 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.525186+0000", 2024-09-13T06:39:56.664 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.664 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.664 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.664 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:56.664 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.525186+0000", 2024-09-13T06:39:56.664 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:39:56.664 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.665 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.665 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:56.665 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.525188+0000", 2024-09-13T06:39:56.665 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1859999999999999e-06 2024-09-13T06:39:56.665 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.665 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.665 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:56.665 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.525194+0000", 2024-09-13T06:39:56.665 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8329999999999999e-06 2024-09-13T06:39:56.665 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.665 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.665 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:56.665 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.525199+0000", 2024-09-13T06:39:56.665 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.8350000000000003e-06 2024-09-13T06:39:56.666 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.666 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:56.666 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.666 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.666 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.666 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:26763 3.18 3.69d46638 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:39:56.666 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.532847+0000", 2024-09-13T06:39:56.666 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.0037802560000000001, 2024-09-13T06:39:56.666 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.004974315, 2024-09-13T06:39:56.666 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:56.666 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-13T06:39:56.666 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:39:56.666 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:39:56.666 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:56.667 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 26763 2024-09-13T06:39:56.667 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.667 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:56.667 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.667 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:56.667 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532847+0000", 2024-09-13T06:39:56.667 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.667 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.667 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.667 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:56.667 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532847+0000", 2024-09-13T06:39:56.667 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.667 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.667 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.668 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:56.668 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532846+0000", 2024-09-13T06:39:56.668 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:39:56.668 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.668 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.668 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:56.668 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532848+0000", 2024-09-13T06:39:56.668 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1919999999999999e-06 2024-09-13T06:39:56.668 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.668 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.668 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:56.668 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532854+0000", 2024-09-13T06:39:56.668 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.502e-06 2024-09-13T06:39:56.668 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.669 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.669 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:56.669 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532858+0000", 2024-09-13T06:39:56.669 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.2939999999999999e-06 2024-09-13T06:39:56.669 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.669 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:56.669 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.669 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.669 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.669 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25754 3.8 3.63996268 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:39:56.669 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.534613+0000", 2024-09-13T06:39:56.669 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.002013295, 2024-09-13T06:39:56.669 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0032358069999999998, 2024-09-13T06:39:56.669 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:56.670 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-13T06:39:56.670 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:39:56.670 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:39:56.670 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:56.670 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25754 2024-09-13T06:39:56.670 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.670 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:56.670 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.670 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:56.670 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.534613+0000", 2024-09-13T06:39:56.670 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.670 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.670 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.671 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:56.671 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.534613+0000", 2024-09-13T06:39:56.671 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.671 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.671 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.671 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:56.671 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.534613+0000", 2024-09-13T06:39:56.671 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.999999 2024-09-13T06:39:56.671 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.671 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.671 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:56.671 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.534616+0000", 2024-09-13T06:39:56.671 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.117e-06 2024-09-13T06:39:56.671 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.672 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.672 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:56.672 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.534623+0000", 2024-09-13T06:39:56.672 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.542e-06 2024-09-13T06:39:56.672 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.672 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.672 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:56.672 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.534629+0000", 2024-09-13T06:39:56.672 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.553e-06 2024-09-13T06:39:56.672 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.672 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:56.672 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.672 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.673 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.673 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25948 3.18 3.c6d96fb8 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:39:56.673 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.535574+0000", 2024-09-13T06:39:56.673 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.001052669, 2024-09-13T06:39:56.673 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0023063599999999999, 2024-09-13T06:39:56.673 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:56.673 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-13T06:39:56.673 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:39:56.673 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:39:56.673 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:56.673 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25948 2024-09-13T06:39:56.673 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.673 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:56.674 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.674 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:56.674 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.535574+0000", 2024-09-13T06:39:56.674 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.674 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.674 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.674 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:56.674 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.535574+0000", 2024-09-13T06:39:56.674 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.674 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.674 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.674 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:56.674 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.535573+0000", 2024-09-13T06:39:56.674 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:39:56.674 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.675 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.675 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:56.675 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.535576+0000", 2024-09-13T06:39:56.675 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.734e-06 2024-09-13T06:39:56.675 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.675 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.675 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:56.675 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.535583+0000", 2024-09-13T06:39:56.675 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.6989999999999997e-06 2024-09-13T06:39:56.675 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.675 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.675 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:56.675 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.535588+0000", 2024-09-13T06:39:56.675 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3569999999999997e-06 2024-09-13T06:39:56.675 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.676 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:56.676 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.676 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.676 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.676 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:26016 3.8 3.63996268 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:39:56.676 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.536325+0000", 2024-09-13T06:39:56.676 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.00030210000000000002, 2024-09-13T06:39:56.676 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.001585433, 2024-09-13T06:39:56.676 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:56.676 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-13T06:39:56.676 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:39:56.676 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:39:56.676 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:56.676 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 26016 2024-09-13T06:39:56.677 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.677 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:56.677 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.677 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:56.677 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.536325+0000", 2024-09-13T06:39:56.677 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.677 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.677 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.677 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:56.677 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.536325+0000", 2024-09-13T06:39:56.677 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.677 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.677 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.677 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:56.678 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.536324+0000", 2024-09-13T06:39:56.678 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:39:56.678 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.678 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.678 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:56.678 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.536326+0000", 2024-09-13T06:39:56.678 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.424e-06 2024-09-13T06:39:56.678 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.678 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.678 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:56.678 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.536332+0000", 2024-09-13T06:39:56.678 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9900000000000002e-06 2024-09-13T06:39:56.678 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.678 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.679 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:56.679 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.536337+0000", 2024-09-13T06:39:56.679 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4560000000000002e-06 2024-09-13T06:39:56.679 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.679 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:56.679 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.679 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.679 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.679 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:26612 3.8 3.62c67748 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:39:56.679 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.520678+0000", 2024-09-13T06:39:56.679 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.015949147, 2024-09-13T06:39:56.679 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017263985999999999, 2024-09-13T06:39:56.679 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:56.679 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-13T06:39:56.680 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:39:56.680 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:39:56.680 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:56.680 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 26612 2024-09-13T06:39:56.680 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.680 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:56.680 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.680 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:56.680 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.520678+0000", 2024-09-13T06:39:56.680 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.680 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.680 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.680 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:56.681 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.520678+0000", 2024-09-13T06:39:56.681 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.681 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.681 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.681 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:56.681 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.520677+0000", 2024-09-13T06:39:56.681 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:39:56.681 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.681 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.681 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:56.681 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.520679+0000", 2024-09-13T06:39:56.681 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.392e-06 2024-09-13T06:39:56.681 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.681 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.682 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:56.682 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.520682+0000", 2024-09-13T06:39:56.682 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9699999999999999e-06 2024-09-13T06:39:56.682 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.682 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.682 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:56.682 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.520686+0000", 2024-09-13T06:39:56.682 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.0149999999999997e-06 2024-09-13T06:39:56.682 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.682 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:56.682 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.682 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.682 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.682 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:26683 3.8 3.36160188 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:39:56.683 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.525203+0000", 2024-09-13T06:39:56.683 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.01142371, 2024-09-13T06:39:56.683 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.012766764999999999, 2024-09-13T06:39:56.683 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:56.683 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-13T06:39:56.683 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:39:56.683 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:39:56.683 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:56.683 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 26683 2024-09-13T06:39:56.683 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.683 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:56.683 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.683 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:56.683 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.525203+0000", 2024-09-13T06:39:56.684 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.684 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.684 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.684 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:56.684 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.525203+0000", 2024-09-13T06:39:56.684 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.684 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.684 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.684 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:56.684 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.525203+0000", 2024-09-13T06:39:56.684 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:39:56.684 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.684 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.685 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:56.685 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.525205+0000", 2024-09-13T06:39:56.685 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.103e-06 2024-09-13T06:39:56.685 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.685 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.685 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:56.685 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.525210+0000", 2024-09-13T06:39:56.685 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.6289999999999998e-06 2024-09-13T06:39:56.685 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.685 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.685 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:56.685 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.525215+0000", 2024-09-13T06:39:56.685 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.3599999999999998e-06 2024-09-13T06:39:56.685 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.685 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:56.686 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.686 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.686 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.686 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:26764 3.18 3.69d46638 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:39:56.686 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.532864+0000", 2024-09-13T06:39:56.686 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.003762301, 2024-09-13T06:39:56.686 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0051359780000000002, 2024-09-13T06:39:56.686 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:56.686 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-13T06:39:56.686 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:39:56.686 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:39:56.686 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:56.686 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 26764 2024-09-13T06:39:56.686 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.687 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:56.687 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.687 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:56.687 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532864+0000", 2024-09-13T06:39:56.687 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.687 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.687 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.687 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:56.687 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532864+0000", 2024-09-13T06:39:56.687 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.687 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.687 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.687 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:56.687 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532864+0000", 2024-09-13T06:39:56.688 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:39:56.688 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.688 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.688 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:56.688 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532893+0000", 2024-09-13T06:39:56.688 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.8571000000000001e-05 2024-09-13T06:39:56.688 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.688 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.688 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:56.688 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532903+0000", 2024-09-13T06:39:56.688 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0064000000000001e-05 2024-09-13T06:39:56.688 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.688 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.688 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:56.689 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532909+0000", 2024-09-13T06:39:56.689 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9989999999999997e-06 2024-09-13T06:39:56.689 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.689 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:56.689 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.689 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.689 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.689 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25755 3.8 3.63996268 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:39:56.689 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.534650+0000", 2024-09-13T06:39:56.689 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.0019770529999999999, 2024-09-13T06:39:56.689 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.003380288, 2024-09-13T06:39:56.689 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:56.689 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-13T06:39:56.689 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:39:56.690 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:39:56.690 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:56.690 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25755 2024-09-13T06:39:56.690 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.690 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:56.690 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.690 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:56.690 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.534650+0000", 2024-09-13T06:39:56.690 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.690 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.690 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.690 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:56.690 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.534650+0000", 2024-09-13T06:39:56.690 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.691 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.691 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.691 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:56.691 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.534649+0000", 2024-09-13T06:39:56.691 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:39:56.691 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.691 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.691 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:56.691 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.534652+0000", 2024-09-13T06:39:56.691 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.1860000000000001e-06 2024-09-13T06:39:56.691 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.691 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.691 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:56.691 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.534660+0000", 2024-09-13T06:39:56.691 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4309999999999997e-06 2024-09-13T06:39:56.692 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.692 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.692 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:56.692 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.534665+0000", 2024-09-13T06:39:56.692 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.5219999999999998e-06 2024-09-13T06:39:56.692 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.692 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:56.692 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.692 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.692 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.692 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25949 3.18 3.c6d96fb8 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:39:56.692 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.535600+0000", 2024-09-13T06:39:56.692 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.0010271740000000001, 2024-09-13T06:39:56.692 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0024597640000000001, 2024-09-13T06:39:56.693 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:56.693 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-13T06:39:56.693 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:39:56.693 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:39:56.693 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:56.693 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25949 2024-09-13T06:39:56.693 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.693 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:56.693 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.693 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:56.693 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.535600+0000", 2024-09-13T06:39:56.693 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.693 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.693 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.694 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:56.694 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.535600+0000", 2024-09-13T06:39:56.694 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.694 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.694 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.694 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:56.694 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.535599+0000", 2024-09-13T06:39:56.694 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:39:56.694 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.694 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.694 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:56.694 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.535602+0000", 2024-09-13T06:39:56.694 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.1030000000000002e-06 2024-09-13T06:39:56.694 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.695 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.695 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:56.695 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.535609+0000", 2024-09-13T06:39:56.695 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.0060000000000003e-06 2024-09-13T06:39:56.695 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.695 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.695 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:56.695 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.535614+0000", 2024-09-13T06:39:56.695 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2469999999999999e-06 2024-09-13T06:39:56.695 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.695 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:56.695 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.695 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.695 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.696 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:26097 3.8 3.62c67748 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:39:56.696 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.536355+0000", 2024-09-13T06:39:56.696 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.00027201100000000001, 2024-09-13T06:39:56.696 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.001737829, 2024-09-13T06:39:56.696 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:56.696 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-13T06:39:56.696 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:39:56.696 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:39:56.696 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:56.696 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 26097 2024-09-13T06:39:56.696 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.696 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:56.696 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.696 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:56.697 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.536355+0000", 2024-09-13T06:39:56.697 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.697 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.697 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.697 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:56.697 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.536355+0000", 2024-09-13T06:39:56.697 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.697 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.697 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.697 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:56.697 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.536354+0000", 2024-09-13T06:39:56.697 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:39:56.697 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.697 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.698 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:56.698 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.536357+0000", 2024-09-13T06:39:56.698 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.1640000000000001e-06 2024-09-13T06:39:56.698 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.698 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.698 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:56.698 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.536364+0000", 2024-09-13T06:39:56.698 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.1980000000000004e-06 2024-09-13T06:39:56.698 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.698 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.698 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:56.698 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.536370+0000", 2024-09-13T06:39:56.698 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.1139999999999997e-06 2024-09-13T06:39:56.698 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.699 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:56.699 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.699 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.699 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.699 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:26613 3.8 3.62c67748 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:39:56.699 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.520688+0000", 2024-09-13T06:39:56.699 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.015938688999999999, 2024-09-13T06:39:56.699 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.017435089000000001, 2024-09-13T06:39:56.699 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:56.699 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-13T06:39:56.699 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:39:56.699 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:39:56.699 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:56.699 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 26613 2024-09-13T06:39:56.700 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.700 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:56.700 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.700 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:56.700 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.520688+0000", 2024-09-13T06:39:56.700 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.700 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.700 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.700 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:56.700 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.520688+0000", 2024-09-13T06:39:56.700 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.700 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.700 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.700 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:56.701 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.520688+0000", 2024-09-13T06:39:56.701 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:39:56.701 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.701 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.701 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:56.701 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.520689+0000", 2024-09-13T06:39:56.701 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.297e-06 2024-09-13T06:39:56.701 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.701 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.701 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:56.701 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.520692+0000", 2024-09-13T06:39:56.701 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9969999999999999e-06 2024-09-13T06:39:56.701 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.702 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.702 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:56.702 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.520695+0000", 2024-09-13T06:39:56.702 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.768e-06 2024-09-13T06:39:56.702 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.702 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:56.702 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.702 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.702 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.702 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:26684 3.8 3.36160188 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:39:56.702 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.528529+0000", 2024-09-13T06:39:56.702 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.0080982050000000007, 2024-09-13T06:39:56.702 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0096259440000000009, 2024-09-13T06:39:56.702 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:56.703 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-13T06:39:56.703 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:39:56.703 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:39:56.703 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:56.703 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 26684 2024-09-13T06:39:56.703 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.703 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:56.703 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.703 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:56.703 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.528529+0000", 2024-09-13T06:39:56.703 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.703 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.703 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.703 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:56.704 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.528529+0000", 2024-09-13T06:39:56.704 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.704 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.704 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.704 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:56.704 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.525219+0000", 2024-09-13T06:39:56.704 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9966903 2024-09-13T06:39:56.704 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.704 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.704 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:56.704 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.528534+0000", 2024-09-13T06:39:56.704 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0033153929999999998 2024-09-13T06:39:56.704 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.705 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.705 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:56.705 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.528544+0000", 2024-09-13T06:39:56.705 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.9510000000000001e-06 2024-09-13T06:39:56.705 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.705 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.705 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:56.705 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.528550+0000", 2024-09-13T06:39:56.705 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0000000000000002e-06 2024-09-13T06:39:56.705 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.705 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:56.705 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.705 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.705 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.706 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:26765 3.18 3.69d46638 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:39:56.706 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.532914+0000", 2024-09-13T06:39:56.706 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.003712566, 2024-09-13T06:39:56.706 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0052690460000000003, 2024-09-13T06:39:56.706 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:56.706 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-13T06:39:56.706 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:39:56.706 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:39:56.706 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:56.706 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 26765 2024-09-13T06:39:56.706 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.706 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:56.706 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.706 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:56.707 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532914+0000", 2024-09-13T06:39:56.707 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.707 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.707 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.707 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:56.707 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532914+0000", 2024-09-13T06:39:56.707 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.707 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.707 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.707 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:56.707 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532914+0000", 2024-09-13T06:39:56.707 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:39:56.707 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.707 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.707 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:56.708 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532917+0000", 2024-09-13T06:39:56.708 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9129999999999999e-06 2024-09-13T06:39:56.708 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.708 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.708 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:56.708 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532923+0000", 2024-09-13T06:39:56.708 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.4860000000000002e-06 2024-09-13T06:39:56.708 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.708 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.708 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:56.708 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532928+0000", 2024-09-13T06:39:56.708 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7589999999999997e-06 2024-09-13T06:39:56.708 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.709 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:56.709 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.709 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.709 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.709 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25756 3.8 3.63996268 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:39:56.709 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.534678+0000", 2024-09-13T06:39:56.709 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.001948728, 2024-09-13T06:39:56.709 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.003535042, 2024-09-13T06:39:56.709 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:56.709 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-13T06:39:56.709 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:39:56.709 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:39:56.709 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:56.709 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25756 2024-09-13T06:39:56.710 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.710 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:56.710 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.710 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:56.710 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.534678+0000", 2024-09-13T06:39:56.710 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.710 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.710 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.710 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:56.710 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.534678+0000", 2024-09-13T06:39:56.710 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.710 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.710 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.710 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:56.710 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.534677+0000", 2024-09-13T06:39:56.711 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:39:56.711 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.711 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.711 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:56.711 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.534680+0000", 2024-09-13T06:39:56.711 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.0819999999999999e-06 2024-09-13T06:39:56.711 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.711 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.711 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:56.711 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.534687+0000", 2024-09-13T06:39:56.711 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.725e-06 2024-09-13T06:39:56.711 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.711 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.711 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:56.712 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.534692+0000", 2024-09-13T06:39:56.712 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3360000000000002e-06 2024-09-13T06:39:56.712 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.712 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:56.712 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.712 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.712 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.712 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25950 3.18 3.c6d96fb8 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:39:56.712 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.535627+0000", 2024-09-13T06:39:56.712 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.00099967799999999994, 2024-09-13T06:39:56.712 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0026139850000000001, 2024-09-13T06:39:56.712 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:56.712 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-13T06:39:56.712 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:39:56.713 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:39:56.713 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:56.713 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25950 2024-09-13T06:39:56.713 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.713 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:56.713 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.713 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:56.713 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.535627+0000", 2024-09-13T06:39:56.713 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.713 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.713 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.713 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:56.713 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.535627+0000", 2024-09-13T06:39:56.713 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.714 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.714 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.714 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:56.714 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.535626+0000", 2024-09-13T06:39:56.714 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:39:56.714 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.714 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.714 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:56.714 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.535629+0000", 2024-09-13T06:39:56.714 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.0290000000000001e-06 2024-09-13T06:39:56.714 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.714 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.714 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:56.714 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.535636+0000", 2024-09-13T06:39:56.715 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.7429999999999996e-06 2024-09-13T06:39:56.715 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.715 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.715 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:56.715 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.535641+0000", 2024-09-13T06:39:56.715 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0989999999999998e-06 2024-09-13T06:39:56.715 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.715 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:56.715 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.715 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.715 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.715 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:26098 3.8 3.62c67748 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:39:56.715 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.536376+0000", 2024-09-13T06:39:56.715 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.00025053599999999999, 2024-09-13T06:39:56.715 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0019016549999999999, 2024-09-13T06:39:56.716 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:56.716 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-13T06:39:56.716 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:39:56.716 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:39:56.716 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:56.716 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 26098 2024-09-13T06:39:56.716 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.716 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:56.716 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.716 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:56.716 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.536376+0000", 2024-09-13T06:39:56.716 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.716 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.717 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.717 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:56.717 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.536376+0000", 2024-09-13T06:39:56.717 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.717 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.717 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.717 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:56.717 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.536376+0000", 2024-09-13T06:39:56.717 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:39:56.717 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.717 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.717 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:56.717 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.536378+0000", 2024-09-13T06:39:56.717 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.858e-06 2024-09-13T06:39:56.717 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.718 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.718 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:56.718 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.536385+0000", 2024-09-13T06:39:56.718 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.9070000000000001e-06 2024-09-13T06:39:56.718 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.718 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.718 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:56.718 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.536391+0000", 2024-09-13T06:39:56.718 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7679999999999997e-06 2024-09-13T06:39:56.718 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.718 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:56.718 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.718 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.718 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.719 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:26685 3.8 3.36160188 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:39:56.719 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.528565+0000", 2024-09-13T06:39:56.719 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.0080619109999999997, 2024-09-13T06:39:56.719 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0097435339999999999, 2024-09-13T06:39:56.719 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:56.719 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-13T06:39:56.719 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:39:56.719 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:39:56.719 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:56.719 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 26685 2024-09-13T06:39:56.719 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.719 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:56.719 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.719 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:56.719 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.528565+0000", 2024-09-13T06:39:56.720 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.720 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.720 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.720 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:56.720 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.528565+0000", 2024-09-13T06:39:56.720 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.720 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.720 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.720 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:56.720 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.528564+0000", 2024-09-13T06:39:56.720 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:39:56.720 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.720 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.721 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:56.721 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.528567+0000", 2024-09-13T06:39:56.721 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3999999999999999e-06 2024-09-13T06:39:56.721 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.721 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.721 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:56.721 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.528571+0000", 2024-09-13T06:39:56.721 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.1160000000000001e-06 2024-09-13T06:39:56.721 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.721 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.721 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:56.721 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.528576+0000", 2024-09-13T06:39:56.721 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6999999999999999e-06 2024-09-13T06:39:56.721 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.722 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:56.722 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.722 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.722 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.722 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:26766 3.18 3.69d46638 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:39:56.722 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.532932+0000", 2024-09-13T06:39:56.722 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.0036945709999999998, 2024-09-13T06:39:56.722 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0054097490000000002, 2024-09-13T06:39:56.722 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:56.722 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-13T06:39:56.722 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:39:56.722 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:39:56.722 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:56.723 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 26766 2024-09-13T06:39:56.723 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.723 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:56.723 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.723 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:56.723 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532932+0000", 2024-09-13T06:39:56.723 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.723 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.723 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.723 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:56.723 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532932+0000", 2024-09-13T06:39:56.723 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.723 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.724 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.724 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:56.724 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532932+0000", 2024-09-13T06:39:56.724 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:39:56.724 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.724 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.724 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:56.724 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532934+0000", 2024-09-13T06:39:56.724 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4430000000000002e-06 2024-09-13T06:39:56.724 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.724 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.724 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:56.724 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532942+0000", 2024-09-13T06:39:56.725 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.9419999999999995e-06 2024-09-13T06:39:56.725 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.725 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.725 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:56.725 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532948+0000", 2024-09-13T06:39:56.725 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3600000000000004e-06 2024-09-13T06:39:56.725 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.725 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:56.725 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.725 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.725 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.725 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25757 3.8 3.63996268 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:39:56.725 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.534704+0000", 2024-09-13T06:39:56.725 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.001922294, 2024-09-13T06:39:56.726 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0036683530000000001, 2024-09-13T06:39:56.726 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:56.726 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-13T06:39:56.726 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:39:56.726 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:39:56.726 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:56.726 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25757 2024-09-13T06:39:56.726 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.726 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:56.726 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.726 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:56.726 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.534704+0000", 2024-09-13T06:39:56.726 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.727 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.727 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.727 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:56.727 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.534704+0000", 2024-09-13T06:39:56.727 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.727 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.727 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.727 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:56.727 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.534704+0000", 2024-09-13T06:39:56.727 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:39:56.727 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.727 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.727 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:56.727 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.534707+0000", 2024-09-13T06:39:56.728 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.027e-06 2024-09-13T06:39:56.728 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.728 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.728 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:56.728 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.534719+0000", 2024-09-13T06:39:56.728 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2138e-05 2024-09-13T06:39:56.728 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.728 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.728 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:56.728 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.534725+0000", 2024-09-13T06:39:56.728 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7690000000000002e-06 2024-09-13T06:39:56.728 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.728 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:56.728 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.729 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.729 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.729 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25951 3.18 3.c6d96fb8 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:39:56.729 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.535647+0000", 2024-09-13T06:39:56.729 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.00097940599999999994, 2024-09-13T06:39:56.729 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0027553959999999998, 2024-09-13T06:39:56.729 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:56.729 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-13T06:39:56.729 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:39:56.729 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:39:56.729 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:56.729 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25951 2024-09-13T06:39:56.729 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.730 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:56.730 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.730 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:56.730 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.535647+0000", 2024-09-13T06:39:56.730 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.730 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.730 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.730 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:56.730 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.535647+0000", 2024-09-13T06:39:56.730 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.730 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.730 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.730 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:56.730 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.535647+0000", 2024-09-13T06:39:56.731 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:39:56.731 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.731 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.731 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:56.731 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.535653+0000", 2024-09-13T06:39:56.731 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.1979999999999998e-06 2024-09-13T06:39:56.731 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.731 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.731 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:56.731 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.535660+0000", 2024-09-13T06:39:56.731 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.8719999999999996e-06 2024-09-13T06:39:56.731 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.731 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.732 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:56.732 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.535665+0000", 2024-09-13T06:39:56.732 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.4229999999999996e-06 2024-09-13T06:39:56.732 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.732 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:56.732 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.732 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.732 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.732 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:26099 3.8 3.62c67748 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:39:56.732 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.536396+0000", 2024-09-13T06:39:56.732 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.00023028499999999999, 2024-09-13T06:39:56.732 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0020347, 2024-09-13T06:39:56.732 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:56.732 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-13T06:39:56.733 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:39:56.733 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:39:56.733 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:56.733 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 26099 2024-09-13T06:39:56.733 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.733 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:56.733 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.733 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:56.733 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.536396+0000", 2024-09-13T06:39:56.733 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.733 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.733 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.733 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:56.733 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.536396+0000", 2024-09-13T06:39:56.734 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.734 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.734 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.734 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:56.734 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.536396+0000", 2024-09-13T06:39:56.734 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:39:56.734 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.734 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.734 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:56.734 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.536399+0000", 2024-09-13T06:39:56.734 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.542e-06 2024-09-13T06:39:56.734 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.734 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.735 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:56.735 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.536405+0000", 2024-09-13T06:39:56.735 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3369999999999996e-06 2024-09-13T06:39:56.735 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.735 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.735 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:56.735 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.536410+0000", 2024-09-13T06:39:56.735 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9269999999999996e-06 2024-09-13T06:39:56.735 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.735 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:56.735 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.735 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.735 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.735 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:26686 3.8 3.36160188 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:39:56.736 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.528578+0000", 2024-09-13T06:39:56.736 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.0080484130000000008, 2024-09-13T06:39:56.736 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0098825349999999996, 2024-09-13T06:39:56.736 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:56.736 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-13T06:39:56.736 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:39:56.736 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:39:56.736 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:56.736 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 26686 2024-09-13T06:39:56.736 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.736 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:56.736 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.736 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:56.737 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.528578+0000", 2024-09-13T06:39:56.737 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.737 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.737 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.737 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:56.737 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.528578+0000", 2024-09-13T06:39:56.737 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.737 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.737 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.737 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:56.737 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.528578+0000", 2024-09-13T06:39:56.737 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:39:56.737 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.737 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.738 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:56.738 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.528583+0000", 2024-09-13T06:39:56.738 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.1499999999999998e-06 2024-09-13T06:39:56.738 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.738 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.738 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:56.738 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.528587+0000", 2024-09-13T06:39:56.738 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.3749999999999999e-06 2024-09-13T06:39:56.738 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.738 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.738 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:56.738 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.528590+0000", 2024-09-13T06:39:56.738 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9969999999999999e-06 2024-09-13T06:39:56.739 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.739 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:56.739 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.739 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.739 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.739 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:26767 3.18 3.69d46638 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:39:56.739 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.532952+0000", 2024-09-13T06:39:56.739 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.003674521, 2024-09-13T06:39:56.739 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0055397090000000003, 2024-09-13T06:39:56.739 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:56.739 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-13T06:39:56.739 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:39:56.739 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:39:56.739 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:56.740 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 26767 2024-09-13T06:39:56.740 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.740 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:56.740 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.740 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:56.740 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532952+0000", 2024-09-13T06:39:56.740 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.740 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.740 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.740 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:56.740 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532952+0000", 2024-09-13T06:39:56.740 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.740 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.741 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.741 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:56.741 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532952+0000", 2024-09-13T06:39:56.741 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:39:56.741 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.741 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.741 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:56.741 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532954+0000", 2024-09-13T06:39:56.741 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6120000000000001e-06 2024-09-13T06:39:56.741 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.741 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.741 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:56.741 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532961+0000", 2024-09-13T06:39:56.741 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0689999999999998e-06 2024-09-13T06:39:56.742 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.742 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.742 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:56.742 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532965+0000", 2024-09-13T06:39:56.742 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4689999999999999e-06 2024-09-13T06:39:56.742 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.742 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:56.744 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.744 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.744 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.744 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25843 3.8 3.62c67748 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:39:56.744 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.534730+0000", 2024-09-13T06:39:56.744 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.001896619, 2024-09-13T06:39:56.744 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0037901829999999999, 2024-09-13T06:39:56.744 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:56.744 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-13T06:39:56.745 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:39:56.745 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:39:56.745 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:56.745 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25843 2024-09-13T06:39:56.745 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.745 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:56.745 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.745 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:56.745 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.534730+0000", 2024-09-13T06:39:56.745 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.745 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.745 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.745 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:56.746 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.534730+0000", 2024-09-13T06:39:56.746 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.746 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.746 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.746 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:56.746 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.534730+0000", 2024-09-13T06:39:56.746 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:39:56.746 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.746 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.746 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:56.746 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.534732+0000", 2024-09-13T06:39:56.746 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.7709999999999998e-06 2024-09-13T06:39:56.746 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.746 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.747 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:56.747 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.534740+0000", 2024-09-13T06:39:56.747 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.7340000000000008e-06 2024-09-13T06:39:56.747 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.747 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.747 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:56.747 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.534745+0000", 2024-09-13T06:39:56.747 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0889999999999999e-06 2024-09-13T06:39:56.747 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.747 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:56.747 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.747 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.747 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.748 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25952 3.18 3.c6d96fb8 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:39:56.748 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.535672+0000", 2024-09-13T06:39:56.748 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.00095514099999999995, 2024-09-13T06:39:56.748 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0028790970000000002, 2024-09-13T06:39:56.748 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:56.748 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-13T06:39:56.748 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:39:56.748 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:39:56.748 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:56.748 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25952 2024-09-13T06:39:56.748 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.748 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:56.749 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.749 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:56.749 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.535672+0000", 2024-09-13T06:39:56.749 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.749 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.749 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.749 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:56.749 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.535672+0000", 2024-09-13T06:39:56.749 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.749 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.749 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.749 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:56.749 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.535671+0000", 2024-09-13T06:39:56.749 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:39:56.750 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.750 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.750 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:56.750 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.535674+0000", 2024-09-13T06:39:56.750 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.8820000000000001e-06 2024-09-13T06:39:56.750 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.750 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.750 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:56.750 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.535680+0000", 2024-09-13T06:39:56.750 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.1099999999999999e-06 2024-09-13T06:39:56.750 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.750 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.750 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:56.751 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.535685+0000", 2024-09-13T06:39:56.751 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0520000000000001e-06 2024-09-13T06:39:56.751 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.751 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:56.751 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.751 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.751 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.751 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:26100 3.8 3.62c67748 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:39:56.751 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.536422+0000", 2024-09-13T06:39:56.751 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.000204348, 2024-09-13T06:39:56.751 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0021564179999999998, 2024-09-13T06:39:56.751 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:56.751 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-13T06:39:56.752 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:39:56.752 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:39:56.752 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:56.752 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 26100 2024-09-13T06:39:56.752 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.752 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:56.752 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.752 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:56.752 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.536422+0000", 2024-09-13T06:39:56.752 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.752 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.752 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.752 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:56.753 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.536422+0000", 2024-09-13T06:39:56.753 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.753 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.753 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.753 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:56.753 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.536422+0000", 2024-09-13T06:39:56.753 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:39:56.753 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.753 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.753 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:56.753 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.536425+0000", 2024-09-13T06:39:56.753 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.0410000000000002e-06 2024-09-13T06:39:56.753 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.753 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.754 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:56.754 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.536432+0000", 2024-09-13T06:39:56.754 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.9e-06 2024-09-13T06:39:56.754 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.754 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.754 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:56.754 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.536439+0000", 2024-09-13T06:39:56.754 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.8029999999999999e-06 2024-09-13T06:39:56.754 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.754 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:56.754 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.754 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.754 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.755 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:26768 3.18 3.69d46638 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:39:56.755 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.532969+0000", 2024-09-13T06:39:56.755 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.0036577290000000002, 2024-09-13T06:39:56.755 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0056412199999999997, 2024-09-13T06:39:56.755 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:56.755 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-13T06:39:56.755 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:39:56.755 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:39:56.755 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:56.755 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 26768 2024-09-13T06:39:56.755 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.755 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:56.755 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.755 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:56.756 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532969+0000", 2024-09-13T06:39:56.756 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.756 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.756 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.756 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:56.756 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532969+0000", 2024-09-13T06:39:56.756 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.756 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.756 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.756 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:56.756 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532969+0000", 2024-09-13T06:39:56.756 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:39:56.756 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.756 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.757 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:56.757 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532971+0000", 2024-09-13T06:39:56.757 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5579999999999999e-06 2024-09-13T06:39:56.757 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.757 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.757 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:56.757 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532979+0000", 2024-09-13T06:39:56.757 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4590000000000001e-06 2024-09-13T06:39:56.757 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.757 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.757 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:56.757 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532984+0000", 2024-09-13T06:39:56.757 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2809999999999999e-06 2024-09-13T06:39:56.758 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.758 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:56.758 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.758 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.758 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.758 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25844 3.8 3.62c67748 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:39:56.758 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.534758+0000", 2024-09-13T06:39:56.758 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.001869222, 2024-09-13T06:39:56.758 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0038820640000000002, 2024-09-13T06:39:56.758 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:56.758 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-13T06:39:56.758 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:39:56.758 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:39:56.759 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:56.759 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25844 2024-09-13T06:39:56.759 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.759 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:56.759 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.759 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:56.759 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.534758+0000", 2024-09-13T06:39:56.759 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.759 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.759 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.759 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:56.759 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.534758+0000", 2024-09-13T06:39:56.759 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.759 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.760 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.760 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:56.760 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.534757+0000", 2024-09-13T06:39:56.760 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:39:56.760 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.760 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.760 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:56.760 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.534760+0000", 2024-09-13T06:39:56.760 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.0910000000000001e-06 2024-09-13T06:39:56.760 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.760 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.760 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:56.760 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.534766+0000", 2024-09-13T06:39:56.761 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.5209999999999999e-06 2024-09-13T06:39:56.761 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.761 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.761 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:56.761 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.534772+0000", 2024-09-13T06:39:56.761 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3349999999999997e-06 2024-09-13T06:39:56.761 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.761 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:56.761 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.761 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.761 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.761 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25953 3.18 3.c6d96fb8 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:39:56.761 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.535700+0000", 2024-09-13T06:39:56.762 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.000926939, 2024-09-13T06:39:56.762 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0029715119999999999, 2024-09-13T06:39:56.762 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:56.762 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-13T06:39:56.762 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:39:56.762 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:39:56.762 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:56.762 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25953 2024-09-13T06:39:56.762 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.762 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:56.762 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.762 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:56.762 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.535700+0000", 2024-09-13T06:39:56.762 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.763 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.763 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.763 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:56.763 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.535700+0000", 2024-09-13T06:39:56.763 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.763 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.763 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.763 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:56.763 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.535699+0000", 2024-09-13T06:39:56.763 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:39:56.763 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.763 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.763 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:56.764 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.535702+0000", 2024-09-13T06:39:56.764 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9699999999999999e-06 2024-09-13T06:39:56.764 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.764 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.764 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:56.764 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.535709+0000", 2024-09-13T06:39:56.764 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.1149999999999996e-06 2024-09-13T06:39:56.764 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.764 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.764 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:56.764 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.535715+0000", 2024-09-13T06:39:56.764 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2920000000000003e-06 2024-09-13T06:39:56.764 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.764 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:56.765 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.765 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.765 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.765 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:26101 3.8 3.62c67748 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:39:56.765 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.536444+0000", 2024-09-13T06:39:56.765 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.00018265800000000001, 2024-09-13T06:39:56.765 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0022567490000000002, 2024-09-13T06:39:56.765 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:56.765 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-13T06:39:56.765 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:39:56.765 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:39:56.765 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:56.765 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 26101 2024-09-13T06:39:56.765 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.766 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:56.766 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.766 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:56.766 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.536444+0000", 2024-09-13T06:39:56.766 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.766 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.766 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.766 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:56.766 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.536444+0000", 2024-09-13T06:39:56.766 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.766 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.766 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.766 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:56.766 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.536443+0000", 2024-09-13T06:39:56.767 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:39:56.767 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.767 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.767 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:56.767 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.536446+0000", 2024-09-13T06:39:56.767 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.977e-06 2024-09-13T06:39:56.767 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.767 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.767 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:56.767 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.536452+0000", 2024-09-13T06:39:56.767 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9309999999999996e-06 2024-09-13T06:39:56.767 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.768 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.768 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:56.768 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.536457+0000", 2024-09-13T06:39:56.768 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.3900000000000003e-06 2024-09-13T06:39:56.768 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.768 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:56.768 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.768 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.768 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.768 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:26769 3.18 3.69d46638 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:39:56.768 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.532990+0000", 2024-09-13T06:39:56.768 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.003636523, 2024-09-13T06:39:56.768 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0057421900000000003, 2024-09-13T06:39:56.769 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:56.769 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-13T06:39:56.769 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:39:56.769 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:39:56.769 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:56.769 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 26769 2024-09-13T06:39:56.769 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.769 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:56.769 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.769 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:56.769 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532990+0000", 2024-09-13T06:39:56.769 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.769 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.769 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.770 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:56.770 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532990+0000", 2024-09-13T06:39:56.770 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.770 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.770 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.770 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:56.770 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532990+0000", 2024-09-13T06:39:56.770 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:39:56.770 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.770 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.770 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:56.770 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532992+0000", 2024-09-13T06:39:56.770 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.525e-06 2024-09-13T06:39:56.771 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.771 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.771 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:56.771 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532999+0000", 2024-09-13T06:39:56.771 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.4370000000000004e-06 2024-09-13T06:39:56.771 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.771 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.771 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:56.771 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533003+0000", 2024-09-13T06:39:56.771 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4780000000000002e-06 2024-09-13T06:39:56.771 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.771 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:56.771 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.771 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.772 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.772 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25845 3.8 3.62c67748 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:39:56.772 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.534777+0000", 2024-09-13T06:39:56.772 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.001850013, 2024-09-13T06:39:56.772 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0039842319999999999, 2024-09-13T06:39:56.772 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:56.772 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-13T06:39:56.772 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:39:56.772 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:39:56.772 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:56.772 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25845 2024-09-13T06:39:56.772 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.772 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:56.772 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.773 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:56.773 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.534777+0000", 2024-09-13T06:39:56.773 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.773 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.773 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.773 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:56.773 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.534777+0000", 2024-09-13T06:39:56.773 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.773 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.773 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.773 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:56.773 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.534776+0000", 2024-09-13T06:39:56.773 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:39:56.773 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.774 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.774 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:56.774 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.534779+0000", 2024-09-13T06:39:56.774 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3250000000000002e-06 2024-09-13T06:39:56.774 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.774 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.774 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:56.774 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.534785+0000", 2024-09-13T06:39:56.774 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3049999999999998e-06 2024-09-13T06:39:56.774 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.774 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.774 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:56.774 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.534790+0000", 2024-09-13T06:39:56.774 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3349999999999997e-06 2024-09-13T06:39:56.775 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.775 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:56.775 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.775 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.775 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.775 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25954 3.18 3.c6d96fb8 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:39:56.775 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.535719+0000", 2024-09-13T06:39:56.775 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.00090767799999999998, 2024-09-13T06:39:56.775 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.003134651, 2024-09-13T06:39:56.775 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:56.775 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-13T06:39:56.775 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:39:56.775 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:39:56.776 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:56.776 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25954 2024-09-13T06:39:56.776 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.776 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:56.776 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.776 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:56.776 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.535719+0000", 2024-09-13T06:39:56.776 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.776 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.776 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.776 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:56.776 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.535719+0000", 2024-09-13T06:39:56.776 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.776 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.777 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.777 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:56.777 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.535719+0000", 2024-09-13T06:39:56.777 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:39:56.777 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.777 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.777 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:56.777 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.535721+0000", 2024-09-13T06:39:56.777 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2529999999999999e-06 2024-09-13T06:39:56.777 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.777 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.777 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:56.777 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.535729+0000", 2024-09-13T06:39:56.778 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.6969999999999993e-06 2024-09-13T06:39:56.778 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.778 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.778 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:56.778 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.535734+0000", 2024-09-13T06:39:56.778 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2249999999999999e-06 2024-09-13T06:39:56.778 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.778 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:56.778 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.778 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.778 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.778 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:26102 3.8 3.62c67748 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:39:56.778 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.536461+0000", 2024-09-13T06:39:56.778 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.000165377, 2024-09-13T06:39:56.779 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0024221529999999998, 2024-09-13T06:39:56.779 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:56.779 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-13T06:39:56.779 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:39:56.779 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:39:56.779 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:56.779 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 26102 2024-09-13T06:39:56.779 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.779 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:56.779 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.779 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:56.779 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.536461+0000", 2024-09-13T06:39:56.779 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.779 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.780 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.780 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:56.780 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.536461+0000", 2024-09-13T06:39:56.780 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.780 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.780 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.780 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:56.780 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.536461+0000", 2024-09-13T06:39:56.780 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:39:56.780 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.780 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.780 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:56.780 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.536463+0000", 2024-09-13T06:39:56.781 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4320000000000002e-06 2024-09-13T06:39:56.781 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.781 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.781 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:56.781 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.536468+0000", 2024-09-13T06:39:56.781 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2410000000000003e-06 2024-09-13T06:39:56.781 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.781 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.781 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:56.781 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.536473+0000", 2024-09-13T06:39:56.781 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.2039999999999999e-06 2024-09-13T06:39:56.781 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.781 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:56.781 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.782 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.782 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.782 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:26770 3.18 3.69d46638 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:39:56.782 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.533008+0000", 2024-09-13T06:39:56.782 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.003618413, 2024-09-13T06:39:56.782 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0059059200000000003, 2024-09-13T06:39:56.782 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:56.782 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-13T06:39:56.782 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:39:56.782 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:39:56.782 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:56.782 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 26770 2024-09-13T06:39:56.782 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.783 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:56.783 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.783 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:56.783 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533008+0000", 2024-09-13T06:39:56.783 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.783 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.783 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.783 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:56.783 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533008+0000", 2024-09-13T06:39:56.783 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.783 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.783 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.783 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:56.783 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533008+0000", 2024-09-13T06:39:56.784 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:39:56.784 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.784 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.784 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:56.784 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533010+0000", 2024-09-13T06:39:56.784 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4590000000000001e-06 2024-09-13T06:39:56.784 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.784 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.784 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:56.784 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533016+0000", 2024-09-13T06:39:56.784 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.6980000000000003e-06 2024-09-13T06:39:56.784 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.784 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.785 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:56.785 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533021+0000", 2024-09-13T06:39:56.785 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6199999999999998e-06 2024-09-13T06:39:56.785 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.785 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:56.785 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.785 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.785 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.785 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25846 3.8 3.62c67748 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:39:56.785 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.534803+0000", 2024-09-13T06:39:56.785 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.0018240050000000001, 2024-09-13T06:39:56.785 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0041421540000000003, 2024-09-13T06:39:56.785 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:56.785 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-13T06:39:56.786 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:39:56.786 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:39:56.786 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:56.786 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25846 2024-09-13T06:39:56.786 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.786 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:56.786 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.786 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:56.786 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.534803+0000", 2024-09-13T06:39:56.786 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.786 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.786 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.786 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:56.787 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.534803+0000", 2024-09-13T06:39:56.787 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.787 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.787 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.787 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:56.787 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.534802+0000", 2024-09-13T06:39:56.787 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:39:56.787 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.787 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.787 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:56.787 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.534805+0000", 2024-09-13T06:39:56.787 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.932e-06 2024-09-13T06:39:56.787 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.787 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.788 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:56.788 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.534812+0000", 2024-09-13T06:39:56.788 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.6919999999999996e-06 2024-09-13T06:39:56.788 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.788 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.788 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:56.788 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.534819+0000", 2024-09-13T06:39:56.788 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.9160000000000004e-06 2024-09-13T06:39:56.788 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.788 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:56.788 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.788 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.788 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.788 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25955 3.18 3.c6d96fb8 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:39:56.789 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.535748+0000", 2024-09-13T06:39:56.789 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.00087872500000000001, 2024-09-13T06:39:56.789 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0032252359999999998, 2024-09-13T06:39:56.789 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:56.789 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-13T06:39:56.789 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:39:56.789 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:39:56.789 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:56.789 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25955 2024-09-13T06:39:56.789 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.789 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:56.789 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.789 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:56.789 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.535748+0000", 2024-09-13T06:39:56.790 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.790 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.790 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.790 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:56.790 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.535748+0000", 2024-09-13T06:39:56.790 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.790 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.790 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.790 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:56.790 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.535747+0000", 2024-09-13T06:39:56.790 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:39:56.790 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.791 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.791 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:56.791 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.535750+0000", 2024-09-13T06:39:56.791 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.8150000000000002e-06 2024-09-13T06:39:56.791 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.791 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.791 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:56.791 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.535757+0000", 2024-09-13T06:39:56.791 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.4099999999999996e-06 2024-09-13T06:39:56.791 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.791 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.791 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:56.791 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.535762+0000", 2024-09-13T06:39:56.791 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.1209999999999998e-06 2024-09-13T06:39:56.792 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.792 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:56.792 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.792 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.792 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.792 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:26103 3.8 3.62c67748 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:39:56.792 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.536477+0000", 2024-09-13T06:39:56.792 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.00014971799999999999, 2024-09-13T06:39:56.792 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0025266540000000001, 2024-09-13T06:39:56.792 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:56.792 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-13T06:39:56.792 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:39:56.792 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:39:56.793 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:56.793 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 26103 2024-09-13T06:39:56.793 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.793 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:56.793 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.793 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:56.793 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.536477+0000", 2024-09-13T06:39:56.793 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.793 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.793 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.793 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:56.793 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.536477+0000", 2024-09-13T06:39:56.793 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.793 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.794 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.794 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:56.794 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.536477+0000", 2024-09-13T06:39:56.794 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:39:56.794 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.794 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.794 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:56.794 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.536479+0000", 2024-09-13T06:39:56.794 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1880000000000001e-06 2024-09-13T06:39:56.794 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.794 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.794 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:56.794 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.536504+0000", 2024-09-13T06:39:56.795 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5320000000000002e-05 2024-09-13T06:39:56.795 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.795 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.795 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:56.795 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.536509+0000", 2024-09-13T06:39:56.795 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.8919999999999999e-06 2024-09-13T06:39:56.795 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.795 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:56.795 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.795 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.795 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.795 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:26771 3.18 3.69d46638 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:39:56.795 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.533038+0000", 2024-09-13T06:39:56.795 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.0035886310000000001, 2024-09-13T06:39:56.796 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0059959410000000003, 2024-09-13T06:39:56.796 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:56.796 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-13T06:39:56.796 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:39:56.796 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:39:56.796 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:56.796 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 26771 2024-09-13T06:39:56.796 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.796 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:56.796 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.796 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:56.796 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533038+0000", 2024-09-13T06:39:56.796 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.796 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.797 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.797 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:56.797 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533038+0000", 2024-09-13T06:39:56.797 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.797 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.797 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.797 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:56.797 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533037+0000", 2024-09-13T06:39:56.797 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:39:56.797 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.797 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.797 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:56.797 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533044+0000", 2024-09-13T06:39:56.798 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.7549999999999997e-06 2024-09-13T06:39:56.798 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.798 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.798 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:56.798 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533051+0000", 2024-09-13T06:39:56.798 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.8820000000000003e-06 2024-09-13T06:39:56.798 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.798 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.798 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:56.798 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533056+0000", 2024-09-13T06:39:56.798 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.181e-06 2024-09-13T06:39:56.798 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.798 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:56.798 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.799 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.799 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.799 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25847 3.8 3.62c67748 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:39:56.799 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.534824+0000", 2024-09-13T06:39:56.799 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.001803104, 2024-09-13T06:39:56.799 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0042404599999999997, 2024-09-13T06:39:56.799 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:56.799 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-13T06:39:56.799 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:39:56.799 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:39:56.799 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:56.799 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25847 2024-09-13T06:39:56.799 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.799 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:56.800 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.800 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:56.800 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.534824+0000", 2024-09-13T06:39:56.800 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.800 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.800 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.800 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:56.800 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.534824+0000", 2024-09-13T06:39:56.800 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.800 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.800 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.800 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:56.800 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.534823+0000", 2024-09-13T06:39:56.801 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:39:56.801 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.801 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.801 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:56.801 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.534826+0000", 2024-09-13T06:39:56.801 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.531e-06 2024-09-13T06:39:56.801 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.801 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.801 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:56.801 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.534832+0000", 2024-09-13T06:39:56.801 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0669999999999997e-06 2024-09-13T06:39:56.801 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.801 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.801 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:56.802 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.534837+0000", 2024-09-13T06:39:56.802 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0379999999999999e-06 2024-09-13T06:39:56.802 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.802 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:56.802 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.802 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.802 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.802 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25956 3.18 3.c6d96fb8 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:39:56.802 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.535766+0000", 2024-09-13T06:39:56.802 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.00086072899999999996, 2024-09-13T06:39:56.802 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0033259100000000001, 2024-09-13T06:39:56.802 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:56.802 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-13T06:39:56.803 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:39:56.803 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:39:56.803 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:56.803 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25956 2024-09-13T06:39:56.803 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.803 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:56.803 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.803 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:56.803 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.535766+0000", 2024-09-13T06:39:56.803 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.803 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.803 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.803 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:56.803 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.535766+0000", 2024-09-13T06:39:56.804 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.804 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.804 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.804 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:56.804 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.535766+0000", 2024-09-13T06:39:56.804 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:39:56.804 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.804 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.804 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:56.804 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.535768+0000", 2024-09-13T06:39:56.804 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1629999999999999e-06 2024-09-13T06:39:56.804 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.804 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.805 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:56.805 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.535774+0000", 2024-09-13T06:39:56.805 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.6980000000000003e-06 2024-09-13T06:39:56.805 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.805 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.805 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:56.805 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.535778+0000", 2024-09-13T06:39:56.805 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.8269999999999997e-06 2024-09-13T06:39:56.805 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.805 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:56.805 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.805 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.805 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.806 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:26104 3.8 3.62c67748 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:39:56.806 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.536556+0000", 2024-09-13T06:39:56.806 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 7.0815999999999994e-05, 2024-09-13T06:39:56.806 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0025663800000000001, 2024-09-13T06:39:56.806 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:56.806 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-13T06:39:56.806 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:39:56.806 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:39:56.806 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:56.806 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 26104 2024-09-13T06:39:56.806 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.806 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:56.806 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.807 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:56.807 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.536556+0000", 2024-09-13T06:39:56.807 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.807 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.807 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.807 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:56.807 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.536556+0000", 2024-09-13T06:39:56.807 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.807 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.807 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.807 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:56.807 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.536555+0000", 2024-09-13T06:39:56.807 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.999999 2024-09-13T06:39:56.807 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.808 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.808 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:56.808 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.536560+0000", 2024-09-13T06:39:56.808 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.3610000000000003e-06 2024-09-13T06:39:56.808 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.808 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.808 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:56.808 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.536567+0000", 2024-09-13T06:39:56.808 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.6820000000000003e-06 2024-09-13T06:39:56.808 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.808 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.808 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:56.808 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.536571+0000", 2024-09-13T06:39:56.809 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.613e-06 2024-09-13T06:39:56.809 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.809 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:56.809 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.809 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.809 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.809 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:26772 3.18 3.69d46638 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:39:56.809 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.533061+0000", 2024-09-13T06:39:56.809 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.0035657430000000001, 2024-09-13T06:39:56.809 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0060908309999999997, 2024-09-13T06:39:56.809 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:56.809 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-13T06:39:56.810 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:39:56.810 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:39:56.810 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:56.810 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 26772 2024-09-13T06:39:56.810 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.810 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:56.810 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.810 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:56.810 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533061+0000", 2024-09-13T06:39:56.810 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.810 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.810 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.810 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:56.810 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533061+0000", 2024-09-13T06:39:56.811 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.811 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.811 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.811 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:56.811 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533061+0000", 2024-09-13T06:39:56.811 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:39:56.811 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.811 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.811 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:56.811 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533063+0000", 2024-09-13T06:39:56.811 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.463e-06 2024-09-13T06:39:56.811 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.811 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.812 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:56.812 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533070+0000", 2024-09-13T06:39:56.812 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.8260000000000004e-06 2024-09-13T06:39:56.812 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.812 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.812 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:56.812 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533075+0000", 2024-09-13T06:39:56.812 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6040000000000003e-06 2024-09-13T06:39:56.812 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.812 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:56.812 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.812 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.812 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.812 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25848 3.8 3.62c67748 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:39:56.813 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.534872+0000", 2024-09-13T06:39:56.813 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.0017548729999999999, 2024-09-13T06:39:56.813 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0043109089999999999, 2024-09-13T06:39:56.813 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:56.813 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-13T06:39:56.813 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:39:56.813 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:39:56.813 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:56.813 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25848 2024-09-13T06:39:56.813 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.813 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:56.813 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.813 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:56.814 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.534872+0000", 2024-09-13T06:39:56.814 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.814 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.814 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.814 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:56.814 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.534872+0000", 2024-09-13T06:39:56.814 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.814 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.814 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.814 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:56.814 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.534871+0000", 2024-09-13T06:39:56.814 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:39:56.814 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.814 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.815 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:56.815 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.534874+0000", 2024-09-13T06:39:56.815 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.853e-06 2024-09-13T06:39:56.815 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.815 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.815 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:56.815 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.534881+0000", 2024-09-13T06:39:56.815 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.4400000000000002e-06 2024-09-13T06:39:56.815 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.815 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.815 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:56.815 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.534886+0000", 2024-09-13T06:39:56.815 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.1669999999999998e-06 2024-09-13T06:39:56.816 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.816 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:56.816 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.816 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.816 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.816 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25957 3.18 3.c6d96fb8 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:39:56.816 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.535783+0000", 2024-09-13T06:39:56.816 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.000843606, 2024-09-13T06:39:56.816 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.003428342, 2024-09-13T06:39:56.816 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:56.816 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-13T06:39:56.816 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:39:56.816 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:39:56.816 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:56.817 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25957 2024-09-13T06:39:56.817 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.817 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:56.817 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.817 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:56.817 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.535783+0000", 2024-09-13T06:39:56.817 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.817 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.817 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.817 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:56.817 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.535783+0000", 2024-09-13T06:39:56.817 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.817 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.817 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.818 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:56.818 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.535783+0000", 2024-09-13T06:39:56.818 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:39:56.818 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.818 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.818 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:56.818 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.535785+0000", 2024-09-13T06:39:56.818 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3719999999999999e-06 2024-09-13T06:39:56.818 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.818 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.818 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:56.818 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.535791+0000", 2024-09-13T06:39:56.818 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7089999999999999e-06 2024-09-13T06:39:56.819 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.819 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.819 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:56.819 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.535795+0000", 2024-09-13T06:39:56.819 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5940000000000004e-06 2024-09-13T06:39:56.819 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.819 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:56.819 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.819 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.819 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.819 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:26105 3.8 3.62c67748 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:39:56.819 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.536582+0000", 2024-09-13T06:39:56.819 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 4.4694000000000003e-05, 2024-09-13T06:39:56.820 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0026620989999999998, 2024-09-13T06:39:56.820 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:56.820 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-13T06:39:56.820 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:39:56.820 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:39:56.820 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:56.820 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 26105 2024-09-13T06:39:56.820 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.820 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:56.820 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.820 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:56.820 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.536582+0000", 2024-09-13T06:39:56.820 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.821 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.821 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.821 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:56.821 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.536582+0000", 2024-09-13T06:39:56.821 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.821 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.821 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.821 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:56.821 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.536582+0000", 2024-09-13T06:39:56.821 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:39:56.821 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.821 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.821 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:56.822 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.536584+0000", 2024-09-13T06:39:56.822 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1679999999999998e-06 2024-09-13T06:39:56.822 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.822 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.822 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:56.822 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.536588+0000", 2024-09-13T06:39:56.822 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5759999999999999e-06 2024-09-13T06:39:56.822 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.822 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.822 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:56.822 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.536593+0000", 2024-09-13T06:39:56.822 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.8609999999999997e-06 2024-09-13T06:39:56.822 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.822 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:56.823 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.823 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.823 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.823 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:26773 3.8 3.63996268 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:39:56.823 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.533079+0000", 2024-09-13T06:39:56.823 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.003547779, 2024-09-13T06:39:56.823 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0061951159999999996, 2024-09-13T06:39:56.823 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:56.823 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-13T06:39:56.823 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:39:56.823 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:39:56.823 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:56.823 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 26773 2024-09-13T06:39:56.824 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.824 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:56.824 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.824 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:56.824 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533079+0000", 2024-09-13T06:39:56.824 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.824 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.824 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.824 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:56.824 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533079+0000", 2024-09-13T06:39:56.824 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.824 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.824 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.825 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:56.825 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533079+0000", 2024-09-13T06:39:56.825 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:39:56.825 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.825 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.825 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:56.825 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533081+0000", 2024-09-13T06:39:56.825 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4490000000000002e-06 2024-09-13T06:39:56.825 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.825 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.825 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:56.825 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533090+0000", 2024-09-13T06:39:56.825 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.2900000000000008e-06 2024-09-13T06:39:56.826 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.826 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.826 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:56.826 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533095+0000", 2024-09-13T06:39:56.826 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9230000000000001e-06 2024-09-13T06:39:56.826 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.826 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:56.826 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.826 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.826 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.826 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25849 3.8 3.62c67748 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:39:56.826 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.534939+0000", 2024-09-13T06:39:56.826 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.0016877800000000001, 2024-09-13T06:39:56.827 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0043647809999999999, 2024-09-13T06:39:56.827 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:56.827 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-13T06:39:56.827 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:39:56.827 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:39:56.827 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:56.827 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25849 2024-09-13T06:39:56.827 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.827 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:56.827 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.827 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:56.827 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.534939+0000", 2024-09-13T06:39:56.827 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.827 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.828 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.828 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:56.828 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.534939+0000", 2024-09-13T06:39:56.828 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.828 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.828 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.828 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:56.828 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.534938+0000", 2024-09-13T06:39:56.828 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.999999 2024-09-13T06:39:56.828 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.828 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.828 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:56.828 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.534942+0000", 2024-09-13T06:39:56.829 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.4120000000000001e-06 2024-09-13T06:39:56.829 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.829 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.829 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:56.829 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.534949+0000", 2024-09-13T06:39:56.829 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.8010000000000004e-06 2024-09-13T06:39:56.829 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.829 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.829 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:56.829 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.534955+0000", 2024-09-13T06:39:56.829 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7629999999999997e-06 2024-09-13T06:39:56.829 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.830 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:56.830 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.830 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.830 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.830 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25958 3.18 3.c6d96fb8 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:39:56.830 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.535800+0000", 2024-09-13T06:39:56.830 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.00082720500000000002, 2024-09-13T06:39:56.830 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0035343710000000001, 2024-09-13T06:39:56.830 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:56.830 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-13T06:39:56.830 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:39:56.830 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:39:56.830 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:56.831 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25958 2024-09-13T06:39:56.831 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.831 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:56.831 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.831 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:56.831 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.535800+0000", 2024-09-13T06:39:56.831 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.831 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.831 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.831 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:56.831 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.535800+0000", 2024-09-13T06:39:56.831 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.831 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.831 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.832 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:56.832 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.535799+0000", 2024-09-13T06:39:56.832 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:39:56.832 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.832 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.832 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:56.832 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.535802+0000", 2024-09-13T06:39:56.832 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3130000000000001e-06 2024-09-13T06:39:56.832 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.832 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.832 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:56.832 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.535808+0000", 2024-09-13T06:39:56.832 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.947e-06 2024-09-13T06:39:56.833 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.833 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.833 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:56.833 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.535812+0000", 2024-09-13T06:39:56.833 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6929999999999998e-06 2024-09-13T06:39:56.833 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.833 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:56.833 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.833 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.833 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.833 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:26106 3.8 3.62c67748 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:39:56.833 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.536596+0000", 2024-09-13T06:39:56.833 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 3.0851e-05, 2024-09-13T06:39:56.833 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0027665089999999999, 2024-09-13T06:39:56.834 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:56.834 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-13T06:39:56.834 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:39:56.834 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:39:56.834 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:56.834 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 26106 2024-09-13T06:39:56.834 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.834 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:56.834 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.834 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:56.834 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.536596+0000", 2024-09-13T06:39:56.834 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.834 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.835 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.835 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:56.835 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.536596+0000", 2024-09-13T06:39:56.835 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.835 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.835 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.835 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:56.835 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.536595+0000", 2024-09-13T06:39:56.835 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:39:56.835 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.835 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.835 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:56.835 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.536597+0000", 2024-09-13T06:39:56.836 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7039999999999999e-06 2024-09-13T06:39:56.836 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.836 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.836 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:56.836 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.536600+0000", 2024-09-13T06:39:56.836 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.1190000000000001e-06 2024-09-13T06:39:56.836 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.836 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.836 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:56.836 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.536603+0000", 2024-09-13T06:39:56.836 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.796e-06 2024-09-13T06:39:56.836 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.837 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:56.837 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.837 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.837 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.837 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:26774 3.8 3.63996268 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:39:56.837 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.533100+0000", 2024-09-13T06:39:56.837 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.0035272300000000001, 2024-09-13T06:39:56.837 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0062945479999999996, 2024-09-13T06:39:56.837 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:56.837 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-13T06:39:56.837 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:39:56.837 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:39:56.837 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:56.838 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 26774 2024-09-13T06:39:56.838 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.838 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:56.838 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.838 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:56.838 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533100+0000", 2024-09-13T06:39:56.838 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.838 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.838 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.838 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:56.838 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533100+0000", 2024-09-13T06:39:56.838 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.838 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.838 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.839 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:56.839 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533099+0000", 2024-09-13T06:39:56.839 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:39:56.839 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.839 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.839 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:56.839 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533102+0000", 2024-09-13T06:39:56.839 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5160000000000001e-06 2024-09-13T06:39:56.839 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.839 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.839 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:56.839 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533108+0000", 2024-09-13T06:39:56.840 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.2190000000000001e-06 2024-09-13T06:39:56.840 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.840 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.840 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:56.840 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533113+0000", 2024-09-13T06:39:56.840 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.8350000000000003e-06 2024-09-13T06:39:56.840 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.840 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:56.840 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.840 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.840 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.840 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25850 3.8 3.62c67748 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:39:56.840 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.534960+0000", 2024-09-13T06:39:56.841 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.0016664819999999999, 2024-09-13T06:39:56.841 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0044627030000000002, 2024-09-13T06:39:56.841 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:56.841 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-13T06:39:56.841 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:39:56.841 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:39:56.841 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:56.841 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25850 2024-09-13T06:39:56.841 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.841 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:56.841 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.841 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:56.842 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.534960+0000", 2024-09-13T06:39:56.842 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.842 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.842 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.842 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:56.842 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.534960+0000", 2024-09-13T06:39:56.842 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.842 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.842 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.842 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:56.842 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.534960+0000", 2024-09-13T06:39:56.842 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:39:56.842 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.842 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.843 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:56.843 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.534966+0000", 2024-09-13T06:39:56.843 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.4049999999999997e-06 2024-09-13T06:39:56.843 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.843 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.843 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:56.843 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.534972+0000", 2024-09-13T06:39:56.843 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.1140000000000002e-06 2024-09-13T06:39:56.843 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.843 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.843 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:56.843 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.534977+0000", 2024-09-13T06:39:56.843 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0629999999999996e-06 2024-09-13T06:39:56.844 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.844 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:56.844 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.844 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.844 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.844 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25995 3.18 3.69d46638 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:39:56.844 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.535817+0000", 2024-09-13T06:39:56.844 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.00080975399999999999, 2024-09-13T06:39:56.844 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0036426190000000002, 2024-09-13T06:39:56.844 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:56.844 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-13T06:39:56.844 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:39:56.844 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:39:56.845 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:56.845 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25995 2024-09-13T06:39:56.845 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.845 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:56.845 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.845 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:56.845 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.535817+0000", 2024-09-13T06:39:56.845 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.845 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.845 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.845 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:56.845 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.535817+0000", 2024-09-13T06:39:56.845 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.846 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.846 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.846 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:56.846 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.535816+0000", 2024-09-13T06:39:56.846 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:39:56.846 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.846 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.846 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:56.846 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.535819+0000", 2024-09-13T06:39:56.846 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6879999999999999e-06 2024-09-13T06:39:56.846 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.846 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.847 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:56.847 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.535825+0000", 2024-09-13T06:39:56.847 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.302e-06 2024-09-13T06:39:56.847 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.847 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.847 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:56.847 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.535830+0000", 2024-09-13T06:39:56.847 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.8960000000000002e-06 2024-09-13T06:39:56.847 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.847 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:56.847 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.847 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.847 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.847 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:26107 3.8 3.62c67748 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:39:56.848 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.536606+0000", 2024-09-13T06:39:56.848 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 2.1106000000000001e-05, 2024-09-13T06:39:56.848 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0028827089999999998, 2024-09-13T06:39:56.848 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:56.848 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-13T06:39:56.848 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:39:56.848 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:39:56.848 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:56.848 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 26107 2024-09-13T06:39:56.848 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.848 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:56.848 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.849 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:56.849 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.536606+0000", 2024-09-13T06:39:56.849 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.849 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.849 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.849 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:56.849 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.536606+0000", 2024-09-13T06:39:56.849 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.849 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.849 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.849 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:56.849 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.536605+0000", 2024-09-13T06:39:56.849 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:39:56.850 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.850 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.850 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:56.850 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.536607+0000", 2024-09-13T06:39:56.850 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3859999999999999e-06 2024-09-13T06:39:56.850 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.850 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.850 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:56.850 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.536610+0000", 2024-09-13T06:39:56.850 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9160000000000001e-06 2024-09-13T06:39:56.850 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.850 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.851 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:56.851 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.536612+0000", 2024-09-13T06:39:56.851 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.469e-06 2024-09-13T06:39:56.851 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.851 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:56.851 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.851 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.851 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.851 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:26775 3.8 3.63996268 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:39:56.851 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.533117+0000", 2024-09-13T06:39:56.851 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.0035096010000000002, 2024-09-13T06:39:56.851 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0064029739999999996, 2024-09-13T06:39:56.852 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:56.852 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-13T06:39:56.852 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:39:56.852 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:39:56.852 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:56.852 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 26775 2024-09-13T06:39:56.852 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.852 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:56.852 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.852 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:56.852 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533117+0000", 2024-09-13T06:39:56.852 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.853 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.853 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.853 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:56.853 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533117+0000", 2024-09-13T06:39:56.853 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.853 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.853 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.853 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:56.853 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533117+0000", 2024-09-13T06:39:56.853 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:39:56.853 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.853 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.853 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:56.854 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533119+0000", 2024-09-13T06:39:56.854 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5450000000000002e-06 2024-09-13T06:39:56.854 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.854 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.854 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:56.854 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533125+0000", 2024-09-13T06:39:56.854 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8159999999999999e-06 2024-09-13T06:39:56.854 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.854 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.854 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:56.854 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533130+0000", 2024-09-13T06:39:56.854 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7190000000000001e-06 2024-09-13T06:39:56.854 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.855 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:56.855 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.855 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.855 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.855 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25851 3.8 3.62c67748 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:39:56.855 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.534982+0000", 2024-09-13T06:39:56.855 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.0016446589999999999, 2024-09-13T06:39:56.855 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0045678740000000004, 2024-09-13T06:39:56.855 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:56.855 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-13T06:39:56.855 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:39:56.855 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:39:56.855 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:56.856 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25851 2024-09-13T06:39:56.856 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.856 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:56.856 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.856 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:56.856 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.534982+0000", 2024-09-13T06:39:56.856 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.856 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.856 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.856 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:56.856 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.534982+0000", 2024-09-13T06:39:56.856 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.856 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.857 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.857 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:56.857 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.534981+0000", 2024-09-13T06:39:56.857 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:39:56.857 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.857 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.857 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:56.857 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.534984+0000", 2024-09-13T06:39:56.857 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.559e-06 2024-09-13T06:39:56.857 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.857 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.857 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:56.857 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.534990+0000", 2024-09-13T06:39:56.857 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7899999999999996e-06 2024-09-13T06:39:56.858 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.858 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.858 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:56.858 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.534995+0000", 2024-09-13T06:39:56.858 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0309999999999998e-06 2024-09-13T06:39:56.858 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.858 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:56.858 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.858 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.858 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.858 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25996 3.18 3.69d46638 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:39:56.858 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.535834+0000", 2024-09-13T06:39:56.858 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.00079238799999999999, 2024-09-13T06:39:56.859 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0037460169999999999, 2024-09-13T06:39:56.859 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:56.859 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-13T06:39:56.859 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:39:56.859 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:39:56.859 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:56.859 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25996 2024-09-13T06:39:56.859 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.859 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:56.859 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.859 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:56.859 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.535834+0000", 2024-09-13T06:39:56.859 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.860 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.860 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.860 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:56.860 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.535834+0000", 2024-09-13T06:39:56.860 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.860 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.860 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.860 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:56.860 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.535834+0000", 2024-09-13T06:39:56.860 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:39:56.860 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.860 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.860 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:56.861 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.535836+0000", 2024-09-13T06:39:56.861 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3760000000000002e-06 2024-09-13T06:39:56.861 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.861 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.861 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:56.861 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.535842+0000", 2024-09-13T06:39:56.861 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9750000000000004e-06 2024-09-13T06:39:56.861 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.861 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.861 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:56.861 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.535847+0000", 2024-09-13T06:39:56.861 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9080000000000003e-06 2024-09-13T06:39:56.861 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.861 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:56.862 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.862 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.862 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.862 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:26108 3.8 3.62c67748 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:39:56.862 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.536622+0000", 2024-09-13T06:39:56.862 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 4.4920000000000004e-06, 2024-09-13T06:39:56.862 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0029863960000000001, 2024-09-13T06:39:56.862 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:56.862 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-13T06:39:56.862 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:39:56.862 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:39:56.862 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:56.862 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 26108 2024-09-13T06:39:56.863 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.863 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:56.863 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.863 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:56.863 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.536622+0000", 2024-09-13T06:39:56.863 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.863 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.863 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.863 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:56.863 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.536622+0000", 2024-09-13T06:39:56.863 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.863 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.863 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.864 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:56.864 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.536622+0000", 2024-09-13T06:39:56.864 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:39:56.864 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.864 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.864 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:56.864 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.536623+0000", 2024-09-13T06:39:56.864 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.454e-06 2024-09-13T06:39:56.864 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.864 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.864 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:56.864 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.536627+0000", 2024-09-13T06:39:56.865 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.3270000000000001e-06 2024-09-13T06:39:56.865 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.865 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.865 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:56.865 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.536630+0000", 2024-09-13T06:39:56.865 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9050000000000001e-06 2024-09-13T06:39:56.865 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.865 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:56.865 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.865 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.865 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.865 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25852 3.8 3.62c67748 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:39:56.865 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.535021+0000", 2024-09-13T06:39:56.866 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.0016055679999999999, 2024-09-13T06:39:56.866 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0046188779999999999, 2024-09-13T06:39:56.866 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:56.866 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-13T06:39:56.866 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:39:56.866 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:39:56.866 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:56.866 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25852 2024-09-13T06:39:56.866 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.866 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:56.866 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.866 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:56.866 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.535021+0000", 2024-09-13T06:39:56.867 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.867 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.867 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.867 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:56.867 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.535021+0000", 2024-09-13T06:39:56.867 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.867 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.867 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.867 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:56.867 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.535021+0000", 2024-09-13T06:39:56.867 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:39:56.867 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.867 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.867 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:56.868 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.535024+0000", 2024-09-13T06:39:56.868 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.2729999999999998e-06 2024-09-13T06:39:56.868 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.868 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.868 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:56.868 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.535031+0000", 2024-09-13T06:39:56.868 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3649999999999998e-06 2024-09-13T06:39:56.868 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.868 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.868 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:56.868 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.535036+0000", 2024-09-13T06:39:56.868 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0379999999999999e-06 2024-09-13T06:39:56.868 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.868 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:56.869 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.869 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.869 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.869 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25997 3.18 3.69d46638 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:39:56.869 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.535853+0000", 2024-09-13T06:39:56.869 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.00077359399999999995, 2024-09-13T06:39:56.869 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0038149939999999999, 2024-09-13T06:39:56.869 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:56.869 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-13T06:39:56.869 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:39:56.869 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:39:56.869 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:56.870 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25997 2024-09-13T06:39:56.870 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.870 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:56.870 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.870 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:56.870 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.535853+0000", 2024-09-13T06:39:56.870 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.870 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.870 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.870 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:56.870 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.535853+0000", 2024-09-13T06:39:56.870 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.870 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.871 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.871 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:56.871 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.535853+0000", 2024-09-13T06:39:56.871 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:39:56.871 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.871 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.871 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:56.871 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.535855+0000", 2024-09-13T06:39:56.871 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.7099999999999999e-06 2024-09-13T06:39:56.871 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.871 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.871 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:56.871 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.535861+0000", 2024-09-13T06:39:56.871 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0009999999999998e-06 2024-09-13T06:39:56.872 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.872 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.872 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:56.872 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.535866+0000", 2024-09-13T06:39:56.872 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7929999999999997e-06 2024-09-13T06:39:56.872 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.872 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:56.872 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.872 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.872 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.872 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:26109 3.8 3.62c67748 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:39:56.872 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.536632+0000", 2024-09-13T06:39:56.872 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 4294967295.9999943, 2024-09-13T06:39:56.873 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0030697680000000001, 2024-09-13T06:39:56.873 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:56.873 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-13T06:39:56.873 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:39:56.873 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:39:56.873 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:56.873 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 26109 2024-09-13T06:39:56.873 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.873 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:56.873 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.873 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:56.873 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.536632+0000", 2024-09-13T06:39:56.874 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.874 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.874 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.874 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:56.874 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.536632+0000", 2024-09-13T06:39:56.874 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.874 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.874 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.874 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:56.874 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.536632+0000", 2024-09-13T06:39:56.874 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:39:56.874 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.874 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.875 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:56.875 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.536634+0000", 2024-09-13T06:39:56.875 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.733e-06 2024-09-13T06:39:56.875 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.875 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.875 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:56.875 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.536637+0000", 2024-09-13T06:39:56.875 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.2830000000000002e-06 2024-09-13T06:39:56.875 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.875 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.875 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:56.875 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.536639+0000", 2024-09-13T06:39:56.875 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.542e-06 2024-09-13T06:39:56.875 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.876 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:56.876 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.876 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.876 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.876 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25853 3.8 3.62c67748 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:39:56.876 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.535057+0000", 2024-09-13T06:39:56.876 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.0015698070000000001, 2024-09-13T06:39:56.876 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0046763990000000004, 2024-09-13T06:39:56.876 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:56.876 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-13T06:39:56.876 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:39:56.876 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:39:56.876 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:56.877 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25853 2024-09-13T06:39:56.877 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.877 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:56.877 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.877 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:56.877 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.535057+0000", 2024-09-13T06:39:56.877 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.877 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.877 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.877 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:56.877 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.535057+0000", 2024-09-13T06:39:56.877 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.877 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.878 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.878 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:56.878 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.535056+0000", 2024-09-13T06:39:56.878 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:39:56.878 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.878 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.878 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:56.878 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.535060+0000", 2024-09-13T06:39:56.878 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.2009999999999999e-06 2024-09-13T06:39:56.878 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.878 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.878 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:56.878 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.535068+0000", 2024-09-13T06:39:56.878 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.2009999999999999e-06 2024-09-13T06:39:56.879 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.879 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.879 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:56.879 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.535074+0000", 2024-09-13T06:39:56.879 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9580000000000004e-06 2024-09-13T06:39:56.879 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.879 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:56.879 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.879 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.879 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.879 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25998 3.18 3.69d46638 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:39:56.879 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.535885+0000", 2024-09-13T06:39:56.879 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.00074155800000000002, 2024-09-13T06:39:56.879 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0038763560000000001, 2024-09-13T06:39:56.880 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:56.880 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-13T06:39:56.880 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:39:56.880 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:39:56.880 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:56.880 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25998 2024-09-13T06:39:56.880 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.880 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:56.880 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.880 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:56.880 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.535885+0000", 2024-09-13T06:39:56.880 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.881 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.881 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.881 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:56.881 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.535885+0000", 2024-09-13T06:39:56.881 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.881 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.881 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.881 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:56.881 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.535885+0000", 2024-09-13T06:39:56.881 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:39:56.881 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.881 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.882 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:56.882 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.535888+0000", 2024-09-13T06:39:56.882 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.1250000000000001e-06 2024-09-13T06:39:56.882 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.882 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.882 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:56.882 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.535895+0000", 2024-09-13T06:39:56.882 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.0249999999999997e-06 2024-09-13T06:39:56.882 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.882 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.882 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:56.882 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.535900+0000", 2024-09-13T06:39:56.882 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7320000000000003e-06 2024-09-13T06:39:56.882 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.883 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:56.883 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.883 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.883 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.883 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:26163 3.8 3.36160188 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:39:56.883 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.536654+0000", 2024-09-13T06:39:56.883 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 4294967295.9999728, 2024-09-13T06:39:56.883 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0031381059999999999, 2024-09-13T06:39:56.883 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:56.883 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-13T06:39:56.883 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:39:56.883 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:39:56.883 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:56.884 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 26163 2024-09-13T06:39:56.884 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.884 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:56.884 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.884 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:56.884 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.536654+0000", 2024-09-13T06:39:56.884 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.884 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.884 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.884 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:56.884 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.536654+0000", 2024-09-13T06:39:56.884 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.884 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.885 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.885 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:56.885 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.536654+0000", 2024-09-13T06:39:56.885 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:39:56.885 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.885 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.885 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:56.885 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.536655+0000", 2024-09-13T06:39:56.885 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.471e-06 2024-09-13T06:39:56.885 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.885 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.885 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:56.885 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.536658+0000", 2024-09-13T06:39:56.886 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.3119999999999998e-06 2024-09-13T06:39:56.886 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.886 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.886 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:56.886 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.536661+0000", 2024-09-13T06:39:56.886 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.8049999999999998e-06 2024-09-13T06:39:56.886 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.886 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:56.886 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.886 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.886 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.886 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25854 3.8 3.62c67748 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:39:56.886 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.535085+0000", 2024-09-13T06:39:56.886 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.001541272, 2024-09-13T06:39:56.887 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0047350259999999998, 2024-09-13T06:39:56.887 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:56.887 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-13T06:39:56.887 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:39:56.887 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:39:56.887 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:56.887 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25854 2024-09-13T06:39:56.887 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.887 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:56.887 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.887 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:56.887 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.535085+0000", 2024-09-13T06:39:56.887 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.888 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.888 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.888 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:56.888 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.535085+0000", 2024-09-13T06:39:56.888 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.888 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.888 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.888 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:56.888 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.535085+0000", 2024-09-13T06:39:56.888 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:39:56.888 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.888 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.888 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:56.888 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.535088+0000", 2024-09-13T06:39:56.889 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9699999999999999e-06 2024-09-13T06:39:56.889 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.889 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.889 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:56.889 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.535095+0000", 2024-09-13T06:39:56.889 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.9099999999999999e-06 2024-09-13T06:39:56.889 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.889 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.889 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:56.889 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.535100+0000", 2024-09-13T06:39:56.889 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.6840000000000001e-06 2024-09-13T06:39:56.889 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.890 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:56.890 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.890 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.890 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.890 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25999 3.18 3.69d46638 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:39:56.890 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.535906+0000", 2024-09-13T06:39:56.890 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.000721209, 2024-09-13T06:39:56.890 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0039464280000000001, 2024-09-13T06:39:56.890 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:56.890 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-13T06:39:56.890 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:39:56.890 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:39:56.890 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:56.891 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25999 2024-09-13T06:39:56.891 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.891 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:56.891 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.891 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:56.891 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.535906+0000", 2024-09-13T06:39:56.891 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.891 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.891 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.891 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:56.891 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.535906+0000", 2024-09-13T06:39:56.891 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.891 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.891 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.892 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:56.892 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.535905+0000", 2024-09-13T06:39:56.892 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:39:56.892 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.892 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.892 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:56.892 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.535911+0000", 2024-09-13T06:39:56.892 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0759999999999999e-06 2024-09-13T06:39:56.892 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.892 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.892 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:56.892 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.535917+0000", 2024-09-13T06:39:56.893 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.2299999999999996e-06 2024-09-13T06:39:56.893 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.893 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.893 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:56.893 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.535922+0000", 2024-09-13T06:39:56.893 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9570000000000001e-06 2024-09-13T06:39:56.893 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.893 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:56.893 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.893 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.893 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.893 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:26164 3.8 3.36160188 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:39:56.894 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.536663+0000", 2024-09-13T06:39:56.894 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 4294967295.9999633, 2024-09-13T06:39:56.894 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0032171980000000001, 2024-09-13T06:39:56.894 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:56.894 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-13T06:39:56.894 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:39:56.894 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:39:56.894 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:56.894 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 26164 2024-09-13T06:39:56.894 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.894 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:56.894 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.894 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:56.894 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.536663+0000", 2024-09-13T06:39:56.895 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.895 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.895 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.895 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:56.895 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.536663+0000", 2024-09-13T06:39:56.895 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.895 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.895 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.895 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:56.895 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.536663+0000", 2024-09-13T06:39:56.895 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:39:56.895 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.895 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.896 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:56.896 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.536664+0000", 2024-09-13T06:39:56.896 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2860000000000001e-06 2024-09-13T06:39:56.896 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.896 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.896 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:56.896 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.536667+0000", 2024-09-13T06:39:56.896 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.022e-06 2024-09-13T06:39:56.896 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.896 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.896 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:56.896 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.536671+0000", 2024-09-13T06:39:56.896 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.258e-06 2024-09-13T06:39:56.897 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.897 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:56.897 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.897 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.897 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.897 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25905 3.8 3.36160188 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:39:56.897 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.535106+0000", 2024-09-13T06:39:56.897 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.0015205730000000001, 2024-09-13T06:39:56.897 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00480665, 2024-09-13T06:39:56.897 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:56.897 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-13T06:39:56.897 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:39:56.898 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:39:56.898 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:56.898 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25905 2024-09-13T06:39:56.898 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.898 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:56.898 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.898 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:56.898 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.535106+0000", 2024-09-13T06:39:56.898 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.898 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.898 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.898 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:56.898 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.535106+0000", 2024-09-13T06:39:56.899 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.899 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.899 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.899 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:56.899 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.535106+0000", 2024-09-13T06:39:56.899 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:39:56.899 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.899 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.899 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:56.899 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.535108+0000", 2024-09-13T06:39:56.899 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6850000000000001e-06 2024-09-13T06:39:56.899 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.900 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.900 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:56.900 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.535114+0000", 2024-09-13T06:39:56.900 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.1539999999999999e-06 2024-09-13T06:39:56.900 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.900 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.900 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:56.900 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.535120+0000", 2024-09-13T06:39:56.900 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.1340000000000003e-06 2024-09-13T06:39:56.900 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.900 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:56.900 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.900 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.901 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.901 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:26000 3.18 3.69d46638 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:39:56.901 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.535931+0000", 2024-09-13T06:39:56.901 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.00069569399999999996, 2024-09-13T06:39:56.901 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0040101850000000003, 2024-09-13T06:39:56.901 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:56.901 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-13T06:39:56.901 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:39:56.901 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:39:56.901 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:56.901 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 26000 2024-09-13T06:39:56.901 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.901 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:56.902 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.902 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:56.902 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.535931+0000", 2024-09-13T06:39:56.902 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.902 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.902 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.902 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:56.902 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.535931+0000", 2024-09-13T06:39:56.902 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.902 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.902 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.902 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:56.902 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.535930+0000", 2024-09-13T06:39:56.903 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:39:56.903 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.903 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.903 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:56.903 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.535933+0000", 2024-09-13T06:39:56.903 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9569999999999998e-06 2024-09-13T06:39:56.903 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.903 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.903 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:56.903 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.535939+0000", 2024-09-13T06:39:56.903 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0129999999999999e-06 2024-09-13T06:39:56.903 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.903 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.903 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:56.904 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.535944+0000", 2024-09-13T06:39:56.904 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7620000000000003e-06 2024-09-13T06:39:56.904 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.904 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:56.904 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.904 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.904 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.904 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:26165 3.8 3.36160188 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:39:56.904 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.536675+0000", 2024-09-13T06:39:56.904 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 4294967295.9999518, 2024-09-13T06:39:56.904 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0032994330000000001, 2024-09-13T06:39:56.904 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:56.905 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-13T06:39:56.905 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:39:56.905 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:39:56.905 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:56.905 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 26165 2024-09-13T06:39:56.905 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.905 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:56.905 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.905 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:56.905 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.536675+0000", 2024-09-13T06:39:56.905 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.905 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.905 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.905 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:56.906 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.536675+0000", 2024-09-13T06:39:56.906 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.906 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.906 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.906 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:56.906 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.536675+0000", 2024-09-13T06:39:56.906 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:39:56.906 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.906 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.906 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:56.906 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.536676+0000", 2024-09-13T06:39:56.906 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6160000000000001e-06 2024-09-13T06:39:56.906 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.907 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.907 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:56.907 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.536679+0000", 2024-09-13T06:39:56.907 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.8169999999999999e-06 2024-09-13T06:39:56.907 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.907 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.907 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:56.907 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.536682+0000", 2024-09-13T06:39:56.907 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.7499999999999999e-06 2024-09-13T06:39:56.907 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.907 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:56.907 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.907 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.907 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.908 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25906 3.8 3.36160188 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:39:56.908 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.535135+0000", 2024-09-13T06:39:56.908 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.001491837, 2024-09-13T06:39:56.908 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0048738369999999998, 2024-09-13T06:39:56.908 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:56.908 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-13T06:39:56.908 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:39:56.908 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:39:56.908 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:56.908 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25906 2024-09-13T06:39:56.908 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.908 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:56.909 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.909 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:56.909 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.535135+0000", 2024-09-13T06:39:56.909 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.909 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.909 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.909 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:56.909 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.535135+0000", 2024-09-13T06:39:56.909 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.909 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.909 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.909 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:56.909 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.535134+0000", 2024-09-13T06:39:56.910 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:39:56.910 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.910 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.910 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:56.910 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.535137+0000", 2024-09-13T06:39:56.910 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5780000000000001e-06 2024-09-13T06:39:56.910 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.910 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.910 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:56.910 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.535143+0000", 2024-09-13T06:39:56.910 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0730000000000001e-06 2024-09-13T06:39:56.910 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.910 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.911 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:56.911 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.535148+0000", 2024-09-13T06:39:56.911 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0080000000000002e-06 2024-09-13T06:39:56.911 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.911 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:56.911 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.911 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.911 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.911 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:26001 3.18 3.69d46638 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:39:56.911 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.535949+0000", 2024-09-13T06:39:56.912 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.00067757400000000001, 2024-09-13T06:39:56.912 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0040894470000000004, 2024-09-13T06:39:56.912 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:56.912 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-13T06:39:56.912 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:39:56.912 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:39:56.912 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:56.912 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 26001 2024-09-13T06:39:56.912 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.912 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:56.912 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.912 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:56.912 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.535949+0000", 2024-09-13T06:39:56.913 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.913 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.913 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.913 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:56.913 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.535949+0000", 2024-09-13T06:39:56.913 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.913 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.913 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.913 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:56.913 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.535949+0000", 2024-09-13T06:39:56.913 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:39:56.913 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.913 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.914 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:56.914 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.535951+0000", 2024-09-13T06:39:56.914 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.768e-06 2024-09-13T06:39:56.914 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.914 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.914 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:56.914 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.535957+0000", 2024-09-13T06:39:56.914 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8479999999999997e-06 2024-09-13T06:39:56.914 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.914 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.914 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:56.914 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.535962+0000", 2024-09-13T06:39:56.914 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.1089999999999997e-06 2024-09-13T06:39:56.915 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.915 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:56.915 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.915 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.915 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.915 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:26166 3.8 3.36160188 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:39:56.915 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.536698+0000", 2024-09-13T06:39:56.915 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 4294967295.9999294, 2024-09-13T06:39:56.915 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0033692969999999998, 2024-09-13T06:39:56.915 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:56.915 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-13T06:39:56.915 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:39:56.915 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:39:56.916 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:56.916 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 26166 2024-09-13T06:39:56.916 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.916 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:56.916 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.916 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:56.916 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.536698+0000", 2024-09-13T06:39:56.916 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.916 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.916 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.916 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:56.916 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.536698+0000", 2024-09-13T06:39:56.916 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.917 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.917 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.917 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:56.917 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.536697+0000", 2024-09-13T06:39:56.917 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:39:56.917 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.917 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.917 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:56.917 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.536699+0000", 2024-09-13T06:39:56.917 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.663e-06 2024-09-13T06:39:56.917 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.917 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.917 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:56.918 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.536702+0000", 2024-09-13T06:39:56.918 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.3680000000000002e-06 2024-09-13T06:39:56.918 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.918 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.918 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:56.918 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.536705+0000", 2024-09-13T06:39:56.918 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6790000000000001e-06 2024-09-13T06:39:56.918 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.918 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:56.918 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.918 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.918 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.918 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25907 3.8 3.36160188 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:39:56.919 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.535153+0000", 2024-09-13T06:39:56.919 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.0014742010000000001, 2024-09-13T06:39:56.919 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0049467840000000001, 2024-09-13T06:39:56.919 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:56.919 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-13T06:39:56.919 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:39:56.919 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:39:56.919 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:56.919 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25907 2024-09-13T06:39:56.919 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.919 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:56.919 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.919 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:56.919 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.535153+0000", 2024-09-13T06:39:56.920 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.920 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.920 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.920 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:56.920 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.535153+0000", 2024-09-13T06:39:56.920 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.920 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.920 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.920 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:56.920 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.535152+0000", 2024-09-13T06:39:56.920 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:39:56.920 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.920 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.921 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:56.921 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.535154+0000", 2024-09-13T06:39:56.921 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4590000000000001e-06 2024-09-13T06:39:56.921 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.921 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.921 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:56.921 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.535160+0000", 2024-09-13T06:39:56.921 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9719999999999997e-06 2024-09-13T06:39:56.921 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.921 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.921 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:56.921 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.535165+0000", 2024-09-13T06:39:56.921 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.848e-06 2024-09-13T06:39:56.922 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.922 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:56.922 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.922 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.922 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.922 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:26002 3.18 3.69d46638 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:39:56.922 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.535967+0000", 2024-09-13T06:39:56.922 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.00065959799999999996, 2024-09-13T06:39:56.922 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.004161105, 2024-09-13T06:39:56.922 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:56.922 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-13T06:39:56.922 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:39:56.922 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:39:56.923 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:56.923 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 26002 2024-09-13T06:39:56.923 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.923 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:56.923 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.923 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:56.923 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.535967+0000", 2024-09-13T06:39:56.923 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.923 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.923 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.923 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:56.923 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.535967+0000", 2024-09-13T06:39:56.923 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.923 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.924 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.924 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:56.924 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.535967+0000", 2024-09-13T06:39:56.924 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:39:56.924 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.924 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.924 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:56.924 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.535969+0000", 2024-09-13T06:39:56.924 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.8059999999999999e-06 2024-09-13T06:39:56.924 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.924 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.924 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:56.925 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.535977+0000", 2024-09-13T06:39:56.925 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5850000000000002e-06 2024-09-13T06:39:56.925 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.925 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.925 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:56.925 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.535982+0000", 2024-09-13T06:39:56.925 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.1410000000000004e-06 2024-09-13T06:39:56.925 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.925 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:56.925 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.925 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.925 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.925 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:26167 3.8 3.36160188 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:39:56.926 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.536707+0000", 2024-09-13T06:39:56.926 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 4294967295.9999194, 2024-09-13T06:39:56.926 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0034494410000000001, 2024-09-13T06:39:56.926 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:56.926 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-13T06:39:56.926 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:39:56.926 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:39:56.926 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:56.926 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 26167 2024-09-13T06:39:56.926 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.926 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:56.926 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.926 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:56.927 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.536707+0000", 2024-09-13T06:39:56.927 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.927 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.927 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.927 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:56.927 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.536707+0000", 2024-09-13T06:39:56.927 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.927 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.927 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.927 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:56.927 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.536707+0000", 2024-09-13T06:39:56.927 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:39:56.927 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.928 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.928 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:56.928 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.536708+0000", 2024-09-13T06:39:56.928 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.367e-06 2024-09-13T06:39:56.928 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.928 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.928 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:56.928 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.536711+0000", 2024-09-13T06:39:56.928 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9909999999999998e-06 2024-09-13T06:39:56.928 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.928 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.928 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:56.929 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.536714+0000", 2024-09-13T06:39:56.929 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6910000000000002e-06 2024-09-13T06:39:56.929 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.929 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:56.929 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.929 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.929 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.929 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25908 3.8 3.36160188 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:39:56.929 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.535172+0000", 2024-09-13T06:39:56.929 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.0014551080000000001, 2024-09-13T06:39:56.929 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0050161679999999997, 2024-09-13T06:39:56.929 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:56.929 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-13T06:39:56.930 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:39:56.930 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:39:56.930 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:56.930 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25908 2024-09-13T06:39:56.930 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.930 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:56.930 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.930 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:56.930 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.535172+0000", 2024-09-13T06:39:56.930 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.930 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.930 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.930 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:56.931 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.535172+0000", 2024-09-13T06:39:56.931 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.931 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.931 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.931 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:56.931 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.535171+0000", 2024-09-13T06:39:56.931 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:39:56.931 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.931 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.931 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:56.931 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.535174+0000", 2024-09-13T06:39:56.931 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.7709999999999998e-06 2024-09-13T06:39:56.931 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.931 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.932 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:56.932 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.535180+0000", 2024-09-13T06:39:56.932 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.1720000000000004e-06 2024-09-13T06:39:56.932 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.932 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.932 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:56.932 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.535184+0000", 2024-09-13T06:39:56.932 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4449999999999998e-06 2024-09-13T06:39:56.932 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.932 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:56.932 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.932 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.933 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.933 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:26003 3.18 3.69d46638 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:39:56.933 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.535998+0000", 2024-09-13T06:39:56.933 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.00062911900000000003, 2024-09-13T06:39:56.933 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0042187489999999999, 2024-09-13T06:39:56.933 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:56.933 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-13T06:39:56.933 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:39:56.933 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:39:56.933 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:56.933 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 26003 2024-09-13T06:39:56.933 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.933 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:56.933 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.934 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:56.934 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.535998+0000", 2024-09-13T06:39:56.934 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.934 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.934 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.934 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:56.934 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.535998+0000", 2024-09-13T06:39:56.934 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.934 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.934 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.934 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:56.934 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.535996+0000", 2024-09-13T06:39:56.934 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999986 2024-09-13T06:39:56.935 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.935 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.935 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:56.935 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.536000+0000", 2024-09-13T06:39:56.935 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.0160000000000002e-06 2024-09-13T06:39:56.935 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.935 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.935 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:56.935 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.536007+0000", 2024-09-13T06:39:56.935 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.8809999999999998e-06 2024-09-13T06:39:56.935 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.935 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.935 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:56.935 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.536012+0000", 2024-09-13T06:39:56.936 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0250000000000002e-06 2024-09-13T06:39:56.936 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.936 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:56.936 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.936 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.936 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.936 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:26168 3.8 3.36160188 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:39:56.936 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.536730+0000", 2024-09-13T06:39:56.936 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 4294967295.999897, 2024-09-13T06:39:56.936 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.003517577, 2024-09-13T06:39:56.936 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:56.936 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-13T06:39:56.937 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:39:56.937 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:39:56.937 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:56.937 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 26168 2024-09-13T06:39:56.937 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.937 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:56.937 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.937 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:56.937 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.536730+0000", 2024-09-13T06:39:56.937 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.937 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.937 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.937 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:56.937 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.536730+0000", 2024-09-13T06:39:56.938 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.938 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.938 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.938 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:56.938 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.536729+0000", 2024-09-13T06:39:56.938 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:39:56.938 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.938 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.938 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:56.938 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.536731+0000", 2024-09-13T06:39:56.938 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.666e-06 2024-09-13T06:39:56.938 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.938 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.939 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:56.939 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.536734+0000", 2024-09-13T06:39:56.939 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.2550000000000002e-06 2024-09-13T06:39:56.939 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.939 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.939 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:56.939 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.536737+0000", 2024-09-13T06:39:56.939 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.7219999999999999e-06 2024-09-13T06:39:56.939 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.939 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:56.939 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.939 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.939 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.940 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25909 3.8 3.36160188 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:39:56.940 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.535189+0000", 2024-09-13T06:39:56.940 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.001437855, 2024-09-13T06:39:56.940 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.005086953, 2024-09-13T06:39:56.940 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:56.940 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-13T06:39:56.940 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:39:56.940 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:39:56.940 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:56.940 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25909 2024-09-13T06:39:56.940 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.940 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:56.940 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.940 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:56.941 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.535189+0000", 2024-09-13T06:39:56.941 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.941 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.941 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.941 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:56.941 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.535189+0000", 2024-09-13T06:39:56.941 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.941 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.941 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.941 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:56.941 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.535189+0000", 2024-09-13T06:39:56.941 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:39:56.942 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.942 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.942 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:56.942 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.535191+0000", 2024-09-13T06:39:56.942 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4719999999999998e-06 2024-09-13T06:39:56.942 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.942 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.942 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:56.942 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.535197+0000", 2024-09-13T06:39:56.942 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.2439999999999998e-06 2024-09-13T06:39:56.942 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.942 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.942 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:56.942 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.535203+0000", 2024-09-13T06:39:56.943 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.1840000000000004e-06 2024-09-13T06:39:56.943 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.943 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:56.943 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.943 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.943 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.943 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:26004 3.18 3.69d46638 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:39:56.943 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.536026+0000", 2024-09-13T06:39:56.943 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.00060060400000000003, 2024-09-13T06:39:56.943 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.004279532, 2024-09-13T06:39:56.943 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:56.943 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-13T06:39:56.943 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:39:56.944 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:39:56.944 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:56.944 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 26004 2024-09-13T06:39:56.944 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.944 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:56.944 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.944 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:56.944 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.536026+0000", 2024-09-13T06:39:56.944 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.944 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.944 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.944 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:56.944 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.536026+0000", 2024-09-13T06:39:56.944 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.945 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.945 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.945 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:56.945 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.536025+0000", 2024-09-13T06:39:56.945 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:39:56.945 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.945 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.945 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:56.945 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.536029+0000", 2024-09-13T06:39:56.945 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.106e-06 2024-09-13T06:39:56.945 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.945 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.945 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:56.946 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.536036+0000", 2024-09-13T06:39:56.946 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.1609999999999997e-06 2024-09-13T06:39:56.946 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.946 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.946 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:56.946 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.536041+0000", 2024-09-13T06:39:56.946 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.4879999999999998e-06 2024-09-13T06:39:56.946 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.946 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:56.946 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.946 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.946 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.946 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:26169 3.8 3.36160188 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:39:56.946 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.536757+0000", 2024-09-13T06:39:56.947 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 4294967295.9998693, 2024-09-13T06:39:56.947 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0035763510000000002, 2024-09-13T06:39:56.947 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:56.947 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-13T06:39:56.947 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:39:56.947 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:39:56.947 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:56.947 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 26169 2024-09-13T06:39:56.947 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.947 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:56.947 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.947 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:56.947 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.536757+0000", 2024-09-13T06:39:56.948 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.948 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.948 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.948 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:56.948 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.536757+0000", 2024-09-13T06:39:56.948 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.948 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.948 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.948 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:56.948 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.536757+0000", 2024-09-13T06:39:56.948 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:39:56.948 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.948 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.948 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:56.949 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.536775+0000", 2024-09-13T06:39:56.949 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7663999999999999e-05 2024-09-13T06:39:56.949 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.949 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.949 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:56.949 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.536779+0000", 2024-09-13T06:39:56.949 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6999999999999999e-06 2024-09-13T06:39:56.949 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.949 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.949 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:56.949 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.536783+0000", 2024-09-13T06:39:56.949 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.9509999999999999e-06 2024-09-13T06:39:56.949 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.950 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:56.950 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.950 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.950 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.952 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25743 3.18 3:1c662b96:::rbd_data.1121f2c5ee81.0000000000000010:13 [read 294912~4096 [fadvise_nocache] out=4096b] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:39:56.952 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.534327+0000", 2024-09-13T06:39:56.952 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.0022994980000000001, 2024-09-13T06:39:56.952 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.006042955, 2024-09-13T06:39:56.952 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:56.952 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:39:56.952 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:39:56.952 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:39:56.952 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:56.952 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25743 2024-09-13T06:39:56.952 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.952 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:56.953 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.953 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:56.953 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.534327+0000", 2024-09-13T06:39:56.953 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.953 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.953 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.953 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:56.953 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.534327+0000", 2024-09-13T06:39:56.953 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.953 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.953 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.953 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:56.953 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.534327+0000", 2024-09-13T06:39:56.954 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:39:56.954 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.954 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.954 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:56.954 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.534329+0000", 2024-09-13T06:39:56.954 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.638e-06 2024-09-13T06:39:56.954 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.954 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.954 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:56.954 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.534341+0000", 2024-09-13T06:39:56.954 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2189e-05 2024-09-13T06:39:56.954 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.954 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.955 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:56.955 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.534347+0000", 2024-09-13T06:39:56.955 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.4700000000000001e-06 2024-09-13T06:39:56.955 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.955 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.955 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:56.955 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.540126+0000", 2024-09-13T06:39:56.955 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0057791530000000004 2024-09-13T06:39:56.955 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.955 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.955 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:56.955 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.540212+0000", 2024-09-13T06:39:56.955 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.5614999999999999e-05 2024-09-13T06:39:56.955 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.956 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:56.956 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.956 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.956 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.956 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25910 3.8 3.36160188 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:39:56.956 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.535208+0000", 2024-09-13T06:39:56.956 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.0014186699999999999, 2024-09-13T06:39:56.956 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0051988499999999997, 2024-09-13T06:39:56.956 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:56.956 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-13T06:39:56.956 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:39:56.956 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:39:56.956 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:56.956 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25910 2024-09-13T06:39:56.957 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.957 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:56.957 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.957 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:56.957 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.535208+0000", 2024-09-13T06:39:56.957 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.957 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.957 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.957 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:56.957 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.535208+0000", 2024-09-13T06:39:56.957 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.957 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.957 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.957 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:56.958 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.535207+0000", 2024-09-13T06:39:56.958 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:39:56.958 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.958 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.958 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:56.958 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.535210+0000", 2024-09-13T06:39:56.958 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6359999999999998e-06 2024-09-13T06:39:56.958 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.958 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.958 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:56.958 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.535216+0000", 2024-09-13T06:39:56.958 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.1399999999999997e-06 2024-09-13T06:39:56.959 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.959 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.959 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:56.959 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.535221+0000", 2024-09-13T06:39:56.959 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.1800000000000004e-06 2024-09-13T06:39:56.959 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.959 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:56.959 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.959 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.959 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.959 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:26005 3.18 3.69d46638 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:39:56.959 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.536046+0000", 2024-09-13T06:39:56.959 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.00058070300000000001, 2024-09-13T06:39:56.959 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0043920139999999996, 2024-09-13T06:39:56.960 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:56.960 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-13T06:39:56.960 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:39:56.960 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:39:56.960 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:56.960 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 26005 2024-09-13T06:39:56.960 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.960 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:56.960 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.960 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:56.960 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.536046+0000", 2024-09-13T06:39:56.960 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.960 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.961 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.961 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:56.961 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.536046+0000", 2024-09-13T06:39:56.961 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.961 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.961 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.961 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:56.961 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.536045+0000", 2024-09-13T06:39:56.961 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:39:56.961 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.961 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.961 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:56.961 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.536048+0000", 2024-09-13T06:39:56.962 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4370000000000001e-06 2024-09-13T06:39:56.962 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.962 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.962 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:56.962 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.536054+0000", 2024-09-13T06:39:56.962 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0209999999999996e-06 2024-09-13T06:39:56.962 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.962 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.962 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:56.962 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.536059+0000", 2024-09-13T06:39:56.962 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.8740000000000003e-06 2024-09-13T06:39:56.962 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.962 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:56.962 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.963 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.963 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.963 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:26170 3.8 3.36160188 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:39:56.963 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.536806+0000", 2024-09-13T06:39:56.963 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 4294967295.9998212, 2024-09-13T06:39:56.963 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.003661999, 2024-09-13T06:39:56.963 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:56.963 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-13T06:39:56.963 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:39:56.963 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:39:56.963 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:56.963 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 26170 2024-09-13T06:39:56.963 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.963 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:56.964 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.964 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:56.964 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.536806+0000", 2024-09-13T06:39:56.964 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.964 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.964 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.964 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:56.964 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.536806+0000", 2024-09-13T06:39:56.964 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.964 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.964 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.964 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:56.964 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.536805+0000", 2024-09-13T06:39:56.965 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:39:56.965 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.965 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.965 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:56.965 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.536807+0000", 2024-09-13T06:39:56.965 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.001e-06 2024-09-13T06:39:56.965 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.965 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.965 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:56.965 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.536811+0000", 2024-09-13T06:39:56.965 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.5310000000000002e-06 2024-09-13T06:39:56.965 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.965 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.965 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:56.966 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.536813+0000", 2024-09-13T06:39:56.966 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.7630000000000001e-06 2024-09-13T06:39:56.966 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.966 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:56.966 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.966 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.966 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.966 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25744 3.18 3:1c662b96:::rbd_data.1121f2c5ee81.0000000000000010:13 [read 364544~4096 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:39:56.966 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.534352+0000", 2024-09-13T06:39:56.966 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.0022748489999999998, 2024-09-13T06:39:56.966 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.006170544, 2024-09-13T06:39:56.966 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:56.966 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:39:56.967 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:39:56.967 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:39:56.967 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:56.967 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25744 2024-09-13T06:39:56.967 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.967 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:56.967 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.967 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:56.967 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.534352+0000", 2024-09-13T06:39:56.967 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.967 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.967 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.967 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:56.967 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.534352+0000", 2024-09-13T06:39:56.968 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.968 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.968 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.968 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:56.968 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.534351+0000", 2024-09-13T06:39:56.968 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:39:56.968 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.968 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.968 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:56.968 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.534354+0000", 2024-09-13T06:39:56.968 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.615e-06 2024-09-13T06:39:56.968 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.968 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.969 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:56.969 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.534363+0000", 2024-09-13T06:39:56.969 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.0089999999999996e-06 2024-09-13T06:39:56.969 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.969 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.969 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:56.969 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.534368+0000", 2024-09-13T06:39:56.969 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9660000000000004e-06 2024-09-13T06:39:56.969 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.969 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.969 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:56.969 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.540397+0000", 2024-09-13T06:39:56.969 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0060293760000000004 2024-09-13T06:39:56.969 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.970 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.970 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:56.970 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.540443+0000", 2024-09-13T06:39:56.970 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5392999999999997e-05 2024-09-13T06:39:56.970 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.970 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:56.970 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.970 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.970 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.970 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25911 3.8 3.36160188 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:39:56.970 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.535234+0000", 2024-09-13T06:39:56.970 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.001392447, 2024-09-13T06:39:56.970 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0053296589999999996, 2024-09-13T06:39:56.971 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:56.971 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-13T06:39:56.971 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:39:56.971 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:39:56.971 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:56.971 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25911 2024-09-13T06:39:56.971 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.971 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:56.971 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.971 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:56.971 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.535234+0000", 2024-09-13T06:39:56.971 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.971 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.971 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.972 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:56.972 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.535234+0000", 2024-09-13T06:39:56.972 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.972 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.972 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.972 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:56.972 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.535234+0000", 2024-09-13T06:39:56.972 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:39:56.972 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.972 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.972 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:56.972 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.535237+0000", 2024-09-13T06:39:56.973 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.869e-06 2024-09-13T06:39:56.973 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.973 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.973 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:56.973 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.535244+0000", 2024-09-13T06:39:56.973 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.2200000000000003e-06 2024-09-13T06:39:56.973 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.973 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.973 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:56.973 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.535249+0000", 2024-09-13T06:39:56.973 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.4729999999999999e-06 2024-09-13T06:39:56.973 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.973 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:56.974 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.974 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.974 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.974 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:26006 3.8 3.63996268 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:39:56.974 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.536070+0000", 2024-09-13T06:39:56.974 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.00055688700000000005, 2024-09-13T06:39:56.974 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0045241780000000002, 2024-09-13T06:39:56.974 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:56.974 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-13T06:39:56.974 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:39:56.974 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:39:56.974 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:56.974 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 26006 2024-09-13T06:39:56.975 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.975 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:56.975 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.975 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:56.975 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.536070+0000", 2024-09-13T06:39:56.975 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.975 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.975 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.975 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:56.975 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.536070+0000", 2024-09-13T06:39:56.975 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.975 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.975 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.976 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:56.976 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.536069+0000", 2024-09-13T06:39:56.976 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:39:56.976 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.976 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.976 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:56.976 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.536072+0000", 2024-09-13T06:39:56.976 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4559999999999999e-06 2024-09-13T06:39:56.976 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.976 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.976 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:56.976 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.536081+0000", 2024-09-13T06:39:56.976 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.2250000000000006e-06 2024-09-13T06:39:56.977 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.977 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.977 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:56.977 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.536087+0000", 2024-09-13T06:39:56.977 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0240000000000003e-06 2024-09-13T06:39:56.977 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.977 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:56.977 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.977 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.977 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.977 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:26171 3.8 3.36160188 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:39:56.977 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.536844+0000", 2024-09-13T06:39:56.978 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 4294967295.999783, 2024-09-13T06:39:56.978 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0037795289999999998, 2024-09-13T06:39:56.978 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:56.978 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-13T06:39:56.978 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:39:56.978 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:39:56.978 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:56.978 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 26171 2024-09-13T06:39:56.978 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.978 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:56.978 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.978 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:56.978 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.536844+0000", 2024-09-13T06:39:56.979 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.979 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.979 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.979 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:56.979 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.536844+0000", 2024-09-13T06:39:56.979 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.979 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.979 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.979 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:56.979 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.536843+0000", 2024-09-13T06:39:56.979 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:39:56.979 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.979 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.980 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:56.980 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.536845+0000", 2024-09-13T06:39:56.980 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6330000000000001e-06 2024-09-13T06:39:56.980 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.980 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.980 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:56.980 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.536848+0000", 2024-09-13T06:39:56.980 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.2509999999999999e-06 2024-09-13T06:39:56.980 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.980 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.980 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:56.980 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.536851+0000", 2024-09-13T06:39:56.980 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.8119999999999999e-06 2024-09-13T06:39:56.980 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.981 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:56.981 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.981 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.981 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.981 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25745 3.18 3.69d46638 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:39:56.981 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.534374+0000", 2024-09-13T06:39:56.981 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.0022527739999999999, 2024-09-13T06:39:56.981 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0062809980000000003, 2024-09-13T06:39:56.981 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:56.981 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-13T06:39:56.981 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:39:56.981 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:39:56.981 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:56.982 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25745 2024-09-13T06:39:56.982 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.982 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:56.982 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.982 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:56.982 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.534374+0000", 2024-09-13T06:39:56.982 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.982 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.982 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.982 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:56.982 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.534374+0000", 2024-09-13T06:39:56.982 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.982 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.982 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.983 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:56.983 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.534373+0000", 2024-09-13T06:39:56.983 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:39:56.983 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.983 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.983 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:56.983 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.534376+0000", 2024-09-13T06:39:56.983 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4490000000000002e-06 2024-09-13T06:39:56.983 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.983 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.983 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:56.983 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.534382+0000", 2024-09-13T06:39:56.983 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0349999999999998e-06 2024-09-13T06:39:56.984 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.984 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.984 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:56.984 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.534387+0000", 2024-09-13T06:39:56.984 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0159999999999999e-06 2024-09-13T06:39:56.984 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.984 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:56.984 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.984 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.984 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.984 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25912 3.8 3.36160188 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:39:56.984 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.535266+0000", 2024-09-13T06:39:56.984 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.001360996, 2024-09-13T06:39:56.985 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0054184769999999997, 2024-09-13T06:39:56.985 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:56.985 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-13T06:39:56.985 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:39:56.985 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:39:56.985 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:56.985 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25912 2024-09-13T06:39:56.985 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.985 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:56.985 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.985 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:56.985 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.535266+0000", 2024-09-13T06:39:56.985 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.986 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.986 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.986 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:56.986 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.535266+0000", 2024-09-13T06:39:56.986 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.986 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.986 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.986 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:56.986 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.535265+0000", 2024-09-13T06:39:56.986 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:39:56.986 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.986 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.986 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:56.987 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.535271+0000", 2024-09-13T06:39:56.987 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.1229999999999997e-06 2024-09-13T06:39:56.987 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.987 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.987 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:56.987 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.535280+0000", 2024-09-13T06:39:56.987 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.1580000000000005e-06 2024-09-13T06:39:56.987 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.987 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.987 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:56.987 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.535285+0000", 2024-09-13T06:39:56.987 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.1839999999999998e-06 2024-09-13T06:39:56.987 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.987 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:56.988 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.988 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.988 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.988 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:26007 3.8 3.63996268 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:39:56.988 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.536092+0000", 2024-09-13T06:39:56.988 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.00053435799999999997, 2024-09-13T06:39:56.988 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0046219080000000001, 2024-09-13T06:39:56.988 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:56.988 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-13T06:39:56.988 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:39:56.988 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:39:56.988 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:56.988 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 26007 2024-09-13T06:39:56.989 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.989 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:56.989 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.989 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:56.989 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.536092+0000", 2024-09-13T06:39:56.989 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.989 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.989 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.989 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:56.989 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.536092+0000", 2024-09-13T06:39:56.989 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.989 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.990 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.990 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:56.990 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.536092+0000", 2024-09-13T06:39:56.990 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:39:56.990 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.990 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.990 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:56.990 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.536094+0000", 2024-09-13T06:39:56.990 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.34e-06 2024-09-13T06:39:56.990 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.990 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.990 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:56.990 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.536100+0000", 2024-09-13T06:39:56.991 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7479999999999999e-06 2024-09-13T06:39:56.991 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.991 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.991 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:56.991 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.536106+0000", 2024-09-13T06:39:56.991 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3419999999999996e-06 2024-09-13T06:39:56.991 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.991 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:56.991 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.991 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.991 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.991 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:26172 3.8 3.36160188 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:39:56.991 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.536854+0000", 2024-09-13T06:39:56.991 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 4294967295.9997725, 2024-09-13T06:39:56.992 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0038890769999999999, 2024-09-13T06:39:56.992 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:56.992 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-13T06:39:56.992 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:39:56.992 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:39:56.992 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:56.992 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 26172 2024-09-13T06:39:56.992 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.992 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:56.992 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.993 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:56.993 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.536854+0000", 2024-09-13T06:39:56.993 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.993 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.993 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.993 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:56.993 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.536854+0000", 2024-09-13T06:39:56.993 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.993 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.993 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.993 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:56.993 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.536854+0000", 2024-09-13T06:39:56.993 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:39:56.994 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.994 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.994 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:56.994 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.536855+0000", 2024-09-13T06:39:56.994 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5379999999999999e-06 2024-09-13T06:39:56.994 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.994 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.994 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:56.994 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.536858+0000", 2024-09-13T06:39:56.994 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.1259999999999998e-06 2024-09-13T06:39:56.994 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.994 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.994 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:56.995 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.536861+0000", 2024-09-13T06:39:56.995 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5610000000000001e-06 2024-09-13T06:39:56.995 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.995 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:56.995 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.995 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.995 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.995 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25746 3.18 3.69d46638 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:39:56.995 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.534393+0000", 2024-09-13T06:39:56.995 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.0022342059999999999, 2024-09-13T06:39:56.995 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0063806210000000004, 2024-09-13T06:39:56.995 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:56.995 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-13T06:39:56.996 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:39:56.996 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:39:56.996 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:56.996 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25746 2024-09-13T06:39:56.996 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.996 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:56.996 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.996 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:56.996 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.534393+0000", 2024-09-13T06:39:56.996 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.996 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.996 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.996 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:56.996 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.534393+0000", 2024-09-13T06:39:56.997 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:56.997 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.997 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.997 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:56.997 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.534392+0000", 2024-09-13T06:39:56.997 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:39:56.997 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.997 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.997 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:56.997 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.534395+0000", 2024-09-13T06:39:56.997 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.7089999999999998e-06 2024-09-13T06:39:56.997 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.997 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.998 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:56.998 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.534401+0000", 2024-09-13T06:39:56.998 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.285e-06 2024-09-13T06:39:56.998 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.998 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.998 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:56.998 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.534406+0000", 2024-09-13T06:39:56.998 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9450000000000001e-06 2024-09-13T06:39:56.998 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.998 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:56.998 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:56.998 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.998 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.998 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25913 3.8 3.36160188 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:39:56.999 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.535299+0000", 2024-09-13T06:39:56.999 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.001328182, 2024-09-13T06:39:56.999 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0055047689999999996, 2024-09-13T06:39:56.999 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:56.999 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-13T06:39:56.999 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:39:56.999 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:39:56.999 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:56.999 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25913 2024-09-13T06:39:56.999 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:56.999 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:56.999 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:56.999 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:56.999 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.535299+0000", 2024-09-13T06:39:57.000 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:57.000 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:57.000 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:57.000 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:57.000 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.535299+0000", 2024-09-13T06:39:57.000 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:57.000 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:57.000 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:57.000 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:57.000 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.535298+0000", 2024-09-13T06:39:57.000 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:39:57.000 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:57.000 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:57.000 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:57.001 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.535301+0000", 2024-09-13T06:39:57.001 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.588e-06 2024-09-13T06:39:57.001 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:57.001 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:57.001 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:57.001 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.535307+0000", 2024-09-13T06:39:57.001 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.1770000000000003e-06 2024-09-13T06:39:57.001 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:57.001 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:57.001 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:57.001 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.535311+0000", 2024-09-13T06:39:57.001 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6750000000000001e-06 2024-09-13T06:39:57.001 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:57.002 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:57.002 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:57.002 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:57.002 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:57.002 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:26008 3.8 3.63996268 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:39:57.002 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.536127+0000", 2024-09-13T06:39:57.002 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.00049930000000000005, 2024-09-13T06:39:57.002 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0047038890000000002, 2024-09-13T06:39:57.002 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:57.002 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-13T06:39:57.002 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:39:57.002 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:39:57.002 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:57.002 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 26008 2024-09-13T06:39:57.002 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:57.003 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:57.003 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:57.003 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:57.003 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.536127+0000", 2024-09-13T06:39:57.003 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:57.003 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:57.003 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:57.003 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:57.003 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.536127+0000", 2024-09-13T06:39:57.003 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:57.003 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:57.003 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:57.003 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:57.004 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.536127+0000", 2024-09-13T06:39:57.004 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:39:57.004 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:57.004 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:57.004 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:57.004 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.536130+0000", 2024-09-13T06:39:57.004 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.7800000000000001e-06 2024-09-13T06:39:57.004 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:57.004 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:57.004 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:57.004 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.536137+0000", 2024-09-13T06:39:57.004 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3579999999999997e-06 2024-09-13T06:39:57.004 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:57.004 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:57.005 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:57.005 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.536150+0000", 2024-09-13T06:39:57.005 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2782000000000001e-05 2024-09-13T06:39:57.005 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:57.005 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:57.005 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:57.005 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:57.005 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:57.005 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:26173 3.8 3.36160188 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:39:57.005 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.536863+0000", 2024-09-13T06:39:57.005 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 4294967295.9997635, 2024-09-13T06:39:57.005 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0039983750000000002, 2024-09-13T06:39:57.005 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:57.006 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-13T06:39:57.006 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:39:57.006 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:39:57.006 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:57.006 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 26173 2024-09-13T06:39:57.006 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:57.006 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:57.006 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:57.006 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:57.006 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.536863+0000", 2024-09-13T06:39:57.006 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:57.006 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:57.006 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:57.006 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:57.007 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.536863+0000", 2024-09-13T06:39:57.007 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:57.007 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:57.007 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:57.007 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:57.007 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.536863+0000", 2024-09-13T06:39:57.007 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:39:57.007 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:57.007 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:57.007 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:57.007 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.536865+0000", 2024-09-13T06:39:57.007 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.37e-06 2024-09-13T06:39:57.007 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:57.007 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:57.008 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:57.008 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.536867+0000", 2024-09-13T06:39:57.008 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9189999999999999e-06 2024-09-13T06:39:57.008 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:57.008 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:57.008 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:57.008 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.536870+0000", 2024-09-13T06:39:57.008 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.503e-06 2024-09-13T06:39:57.008 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:57.008 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:57.008 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:57.008 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:57.008 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:57.009 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25747 3.8 3.63996268 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:39:57.009 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.534411+0000", 2024-09-13T06:39:57.009 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.0022157489999999999, 2024-09-13T06:39:57.009 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0064792419999999996, 2024-09-13T06:39:57.009 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:57.009 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-13T06:39:57.009 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:39:57.009 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:39:57.009 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:57.009 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25747 2024-09-13T06:39:57.009 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:57.009 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:57.009 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:57.010 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:57.010 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.534411+0000", 2024-09-13T06:39:57.010 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:57.010 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:57.010 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:57.010 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:57.010 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.534411+0000", 2024-09-13T06:39:57.010 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:57.010 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:57.010 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:57.010 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:57.010 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.534411+0000", 2024-09-13T06:39:57.010 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:39:57.010 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:57.011 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:57.011 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:57.011 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.534413+0000", 2024-09-13T06:39:57.011 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6960000000000001e-06 2024-09-13T06:39:57.011 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:57.011 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:57.011 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:57.011 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.534420+0000", 2024-09-13T06:39:57.011 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.5050000000000004e-06 2024-09-13T06:39:57.011 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:57.011 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:57.011 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:57.011 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.534432+0000", 2024-09-13T06:39:57.011 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.224e-05 2024-09-13T06:39:57.012 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:57.012 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:57.012 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:57.012 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:57.012 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:57.012 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25914 3.8 3.36160188 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:39:57.012 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.535335+0000", 2024-09-13T06:39:57.012 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.0012918109999999999, 2024-09-13T06:39:57.012 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0055855569999999997, 2024-09-13T06:39:57.012 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:57.012 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-13T06:39:57.012 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:39:57.012 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:39:57.013 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:57.013 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25914 2024-09-13T06:39:57.013 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:57.013 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:57.013 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:57.013 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:57.013 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.535335+0000", 2024-09-13T06:39:57.013 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:57.013 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:57.013 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:57.013 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:57.013 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.535335+0000", 2024-09-13T06:39:57.013 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:57.013 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:57.014 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:57.014 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:57.014 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.535334+0000", 2024-09-13T06:39:57.014 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:39:57.014 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:57.014 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:57.014 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:57.014 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.535337+0000", 2024-09-13T06:39:57.014 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.1130000000000001e-06 2024-09-13T06:39:57.014 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:57.014 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:57.014 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:57.014 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.535344+0000", 2024-09-13T06:39:57.014 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.0530000000000001e-06 2024-09-13T06:39:57.015 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:57.015 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:57.015 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:57.015 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.535349+0000", 2024-09-13T06:39:57.015 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.955e-06 2024-09-13T06:39:57.015 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:57.015 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:57.015 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:57.015 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:57.015 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:57.015 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:26009 3.8 3.63996268 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:39:57.015 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.536157+0000", 2024-09-13T06:39:57.015 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.00047002699999999998, 2024-09-13T06:39:57.015 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0047914530000000002, 2024-09-13T06:39:57.016 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:57.016 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-13T06:39:57.016 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:39:57.016 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:39:57.016 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:57.016 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 26009 2024-09-13T06:39:57.016 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:57.016 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:57.016 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:57.016 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:57.016 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.536157+0000", 2024-09-13T06:39:57.016 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:57.016 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:57.017 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:57.017 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:57.017 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.536157+0000", 2024-09-13T06:39:57.017 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:57.017 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:57.017 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:57.017 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:57.017 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.536156+0000", 2024-09-13T06:39:57.017 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:39:57.017 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:57.017 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:57.017 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:57.017 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.536159+0000", 2024-09-13T06:39:57.017 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9229999999999998e-06 2024-09-13T06:39:57.018 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:57.018 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:57.018 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:57.018 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.536165+0000", 2024-09-13T06:39:57.018 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8610000000000003e-06 2024-09-13T06:39:57.018 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:57.018 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:57.018 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:57.018 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.536170+0000", 2024-09-13T06:39:57.018 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0679999999999996e-06 2024-09-13T06:39:57.018 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:57.018 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:57.018 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:57.018 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:57.019 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:57.019 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:26174 3.8 3.36160188 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:39:57.019 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.536872+0000", 2024-09-13T06:39:57.019 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 4294967295.9997544, 2024-09-13T06:39:57.019 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0042195160000000004, 2024-09-13T06:39:57.019 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:57.019 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-13T06:39:57.019 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:39:57.019 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:39:57.019 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:57.019 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 26174 2024-09-13T06:39:57.019 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:57.019 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:57.019 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:57.020 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:57.020 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.536872+0000", 2024-09-13T06:39:57.020 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:57.020 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:57.020 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:57.020 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:57.020 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.536872+0000", 2024-09-13T06:39:57.020 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:57.020 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:57.020 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:57.020 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:57.020 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.536872+0000", 2024-09-13T06:39:57.021 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:39:57.021 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:57.021 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:57.021 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:57.021 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.536873+0000", 2024-09-13T06:39:57.021 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2979999999999999e-06 2024-09-13T06:39:57.021 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:57.021 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:57.021 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:57.021 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.536876+0000", 2024-09-13T06:39:57.021 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.965e-06 2024-09-13T06:39:57.021 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:57.021 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:57.021 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:57.022 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.536879+0000", 2024-09-13T06:39:57.022 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5809999999999999e-06 2024-09-13T06:39:57.022 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:57.022 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:57.022 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:57.022 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:57.022 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:57.022 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25748 3.8 3.63996268 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:39:57.022 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.534438+0000", 2024-09-13T06:39:57.022 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.0021887769999999998, 2024-09-13T06:39:57.022 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0066918439999999997, 2024-09-13T06:39:57.022 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:57.022 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-13T06:39:57.023 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:39:57.023 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:39:57.023 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:57.023 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25748 2024-09-13T06:39:57.023 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:57.023 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:57.023 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:57.023 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:57.023 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.534438+0000", 2024-09-13T06:39:57.023 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:57.023 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:57.023 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:57.023 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:57.023 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.534438+0000", 2024-09-13T06:39:57.024 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:57.024 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:57.024 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:57.024 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:57.024 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.534437+0000", 2024-09-13T06:39:57.024 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:39:57.024 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:57.024 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:57.024 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:57.024 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.534440+0000", 2024-09-13T06:39:57.024 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.942e-06 2024-09-13T06:39:57.024 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:57.024 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:57.024 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:57.025 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.534448+0000", 2024-09-13T06:39:57.025 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.9650000000000008e-06 2024-09-13T06:39:57.025 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:57.025 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:57.025 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:57.025 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.534454+0000", 2024-09-13T06:39:57.025 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2619999999999998e-06 2024-09-13T06:39:57.025 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:57.025 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:57.025 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:57.025 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:57.025 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:57.025 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25915 3.8 3.36160188 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:39:57.026 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.535361+0000", 2024-09-13T06:39:57.026 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.001265354, 2024-09-13T06:39:57.026 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0058002510000000002, 2024-09-13T06:39:57.026 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:57.026 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-13T06:39:57.026 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:39:57.026 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:39:57.026 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:57.026 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25915 2024-09-13T06:39:57.026 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:57.026 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:57.026 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:57.026 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:57.026 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.535361+0000", 2024-09-13T06:39:57.027 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:57.027 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:57.027 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:57.027 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:57.027 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.535361+0000", 2024-09-13T06:39:57.027 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:57.027 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:57.027 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:57.027 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:57.027 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.535361+0000", 2024-09-13T06:39:57.027 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:39:57.027 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:57.027 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:57.027 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:57.028 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.535364+0000", 2024-09-13T06:39:57.028 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.1070000000000001e-06 2024-09-13T06:39:57.028 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:57.028 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:57.028 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:57.028 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.535370+0000", 2024-09-13T06:39:57.028 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.6279999999999999e-06 2024-09-13T06:39:57.028 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:57.028 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:57.028 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:57.028 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.535376+0000", 2024-09-13T06:39:57.028 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.1390000000000003e-06 2024-09-13T06:39:57.028 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:57.029 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:57.029 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:57.029 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:57.029 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:57.029 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:26010 3.8 3.63996268 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:39:57.029 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.536176+0000", 2024-09-13T06:39:57.029 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.00045040500000000002, 2024-09-13T06:39:57.029 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0050131849999999999, 2024-09-13T06:39:57.029 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:57.029 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-13T06:39:57.029 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:39:57.029 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:39:57.029 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:57.029 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 26010 2024-09-13T06:39:57.030 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:57.030 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:57.030 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:57.030 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:57.030 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.536176+0000", 2024-09-13T06:39:57.030 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:57.030 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:57.030 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:57.030 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:57.030 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.536176+0000", 2024-09-13T06:39:57.030 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:57.030 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:57.030 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:57.030 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:57.031 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.536176+0000", 2024-09-13T06:39:57.031 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:39:57.031 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:57.031 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:57.031 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:57.031 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.536178+0000", 2024-09-13T06:39:57.031 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3599999999999999e-06 2024-09-13T06:39:57.031 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:57.031 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:57.031 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:57.031 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.536184+0000", 2024-09-13T06:39:57.031 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8320000000000002e-06 2024-09-13T06:39:57.031 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:57.032 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:57.032 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:57.032 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.536189+0000", 2024-09-13T06:39:57.032 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4939999999999997e-06 2024-09-13T06:39:57.032 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:57.032 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:57.032 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:57.032 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:57.032 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:57.032 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:26175 3.8 3.36160188 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:39:57.032 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.536890+0000", 2024-09-13T06:39:57.032 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 4294967295.9997368, 2024-09-13T06:39:57.032 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.004330436, 2024-09-13T06:39:57.032 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:57.033 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-13T06:39:57.033 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:39:57.033 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:39:57.033 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:57.033 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 26175 2024-09-13T06:39:57.033 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:57.033 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:57.033 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:57.033 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:57.033 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.536890+0000", 2024-09-13T06:39:57.033 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:57.033 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:57.033 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:57.034 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:57.034 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.536890+0000", 2024-09-13T06:39:57.034 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:57.034 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:57.034 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:57.034 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:57.034 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.536889+0000", 2024-09-13T06:39:57.034 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:39:57.034 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:57.034 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:57.034 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:57.034 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.536891+0000", 2024-09-13T06:39:57.034 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.72e-06 2024-09-13T06:39:57.034 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:57.034 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:57.035 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:57.035 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.536895+0000", 2024-09-13T06:39:57.035 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.4149999999999999e-06 2024-09-13T06:39:57.035 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:57.035 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:57.035 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:57.035 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.536897+0000", 2024-09-13T06:39:57.035 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6110000000000001e-06 2024-09-13T06:39:57.035 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:57.035 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:57.035 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:57.035 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:57.035 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-13T06:39:57.035 INFO:teuthology.orchestra.run.smithi081.stdout: "num_ops": 143 2024-09-13T06:39:57.036 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:39:57.037 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-13T06:39:57.037 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:39:57.039+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:39:57.138 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:39:57.137+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:39:57.200 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:39:57.200 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-13T06:39:57.200 INFO:teuthology.orchestra.run.smithi081.stdout: "complaint_time": 30, 2024-09-13T06:39:57.201 INFO:teuthology.orchestra.run.smithi081.stdout: "num_blocked_ops": 0 2024-09-13T06:39:57.201 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:39:57.214 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-13T06:39:57.259 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:39:57.263+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:39:57.335 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:39:57.335 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 20, 2024-09-13T06:39:57.335 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 600, 2024-09-13T06:39:57.335 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [ 2024-09-13T06:39:57.335 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:57.335 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:2226 3.15 3:af026987:::rbd_data.112173e2f1b7.0000000000000017:head [sparse-read 0~4194304] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-13T06:39:57.335 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:37.606562+0000", 2024-09-13T06:39:57.335 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 19.730880627000001, 2024-09-13T06:39:57.336 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.83322091700000001, 2024-09-13T06:39:57.336 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:57.336 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:39:57.336 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:39:57.336 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:39:57.336 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:57.336 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 2226 2024-09-13T06:39:57.336 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:57.336 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:57.336 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:57.336 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:57.336 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606562+0000", 2024-09-13T06:39:57.336 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:57.337 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:57.337 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:57.337 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:57.337 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606562+0000", 2024-09-13T06:39:57.337 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:57.337 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:57.337 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:57.337 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:57.337 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606561+0000", 2024-09-13T06:39:57.337 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:39:57.337 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:57.337 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:57.338 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:57.338 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606565+0000", 2024-09-13T06:39:57.338 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.4379999999999999e-06 2024-09-13T06:39:57.338 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:57.338 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:57.338 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:57.338 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606569+0000", 2024-09-13T06:39:57.338 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.425e-06 2024-09-13T06:39:57.338 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:57.338 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:57.338 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:57.338 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606572+0000", 2024-09-13T06:39:57.338 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.05e-06 2024-09-13T06:39:57.339 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:57.339 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:57.339 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:57.339 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606621+0000", 2024-09-13T06:39:57.339 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.8723000000000001e-05 2024-09-13T06:39:57.339 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:57.339 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:57.339 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:39:57.339 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606630+0000", 2024-09-13T06:39:57.339 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.8040000000000007e-06 2024-09-13T06:39:57.339 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:57.339 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:57.339 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:57.340 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.439648+0000", 2024-09-13T06:39:57.340 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.83301824800000002 2024-09-13T06:39:57.340 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:57.340 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:57.340 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:57.340 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.439782+0000", 2024-09-13T06:39:57.340 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00013466699999999999 2024-09-13T06:39:57.340 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:57.340 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:57.340 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:57.340 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:57.340 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:57.340 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25661 3.8 3:1180686c:::rbd_data.1121f2c5ee81.0000000000000009:13 [read 397312~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:39:57.341 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.436956+0000", 2024-09-13T06:39:57.341 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.90048609300000004, 2024-09-13T06:39:57.341 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089036758999999993, 2024-09-13T06:39:57.341 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:57.341 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:39:57.341 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:39:57.341 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:39:57.341 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:57.341 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25661 2024-09-13T06:39:57.341 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:57.341 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:57.341 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:57.342 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:57.342 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436956+0000", 2024-09-13T06:39:57.342 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:57.342 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:57.342 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:57.342 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:57.342 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436956+0000", 2024-09-13T06:39:57.342 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:57.342 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:57.342 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:57.342 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:57.342 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436956+0000", 2024-09-13T06:39:57.342 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:39:57.343 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:57.343 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:57.343 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:57.343 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436958+0000", 2024-09-13T06:39:57.343 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1770000000000001e-06 2024-09-13T06:39:57.343 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:57.343 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:57.343 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:57.343 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436963+0000", 2024-09-13T06:39:57.343 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.6489999999999996e-06 2024-09-13T06:39:57.343 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:57.343 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:57.343 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:57.344 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436975+0000", 2024-09-13T06:39:57.344 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1783999999999999e-05 2024-09-13T06:39:57.344 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:57.344 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:57.344 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:57.344 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.525671+0000", 2024-09-13T06:39:57.344 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.088696292999999995 2024-09-13T06:39:57.344 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:57.344 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:57.344 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:57.344 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.525749+0000", 2024-09-13T06:39:57.344 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.7589000000000005e-05 2024-09-13T06:39:57.344 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:57.345 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:57.345 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:57.345 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.525993+0000", 2024-09-13T06:39:57.345 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00024381000000000001 2024-09-13T06:39:57.345 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:57.345 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:57.345 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:57.345 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:57.345 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:57.345 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25662 3.8 3:1180686c:::rbd_data.1121f2c5ee81.0000000000000009:13 [read 421888~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:39:57.345 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.436980+0000", 2024-09-13T06:39:57.345 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.90046178099999996, 2024-09-13T06:39:57.345 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089367577000000004, 2024-09-13T06:39:57.346 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:57.346 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:39:57.346 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:39:57.346 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:39:57.346 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:57.346 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25662 2024-09-13T06:39:57.346 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:57.346 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:57.346 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:57.346 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:57.346 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436980+0000", 2024-09-13T06:39:57.346 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:57.346 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:57.347 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:57.347 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:57.347 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436980+0000", 2024-09-13T06:39:57.347 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:57.347 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:57.347 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:57.347 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:57.347 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436980+0000", 2024-09-13T06:39:57.347 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:39:57.347 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:57.347 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:57.347 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:57.347 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436982+0000", 2024-09-13T06:39:57.348 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3989999999999998e-06 2024-09-13T06:39:57.348 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:57.348 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:57.348 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:57.348 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436988+0000", 2024-09-13T06:39:57.348 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0039999999999996e-06 2024-09-13T06:39:57.348 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:57.348 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:57.348 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:57.348 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436993+0000", 2024-09-13T06:39:57.348 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6090000000000003e-06 2024-09-13T06:39:57.348 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:57.349 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:57.349 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:57.349 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.526035+0000", 2024-09-13T06:39:57.349 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089042248000000004 2024-09-13T06:39:57.349 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:57.349 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:57.349 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:57.349 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.526111+0000", 2024-09-13T06:39:57.349 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5643999999999996e-05 2024-09-13T06:39:57.349 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:57.349 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:57.349 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:57.349 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.526348+0000", 2024-09-13T06:39:57.350 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00023705800000000001 2024-09-13T06:39:57.350 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:57.350 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:57.350 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:57.350 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:57.350 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:57.350 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25663 3.8 3:1180686c:::rbd_data.1121f2c5ee81.0000000000000009:13 [read 466944~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:39:57.350 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.436998+0000", 2024-09-13T06:39:57.350 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.90044413400000001, 2024-09-13T06:39:57.350 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089730867000000006, 2024-09-13T06:39:57.350 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:57.351 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:39:57.351 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:39:57.351 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:39:57.351 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:57.351 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25663 2024-09-13T06:39:57.351 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:57.351 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:57.351 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:57.351 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:57.351 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436998+0000", 2024-09-13T06:39:57.351 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:57.351 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:57.351 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:57.352 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:57.352 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436998+0000", 2024-09-13T06:39:57.352 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:57.352 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:57.352 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:57.352 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:57.352 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436998+0000", 2024-09-13T06:39:57.352 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:39:57.352 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:57.352 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:57.352 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:57.352 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437000+0000", 2024-09-13T06:39:57.352 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0940000000000002e-06 2024-09-13T06:39:57.353 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:57.353 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:57.353 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:57.353 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437005+0000", 2024-09-13T06:39:57.353 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.604e-06 2024-09-13T06:39:57.353 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:57.353 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:57.353 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:57.353 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437032+0000", 2024-09-13T06:39:57.353 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6407e-05 2024-09-13T06:39:57.353 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:57.353 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:57.353 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:57.354 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.526363+0000", 2024-09-13T06:39:57.354 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089331456000000004 2024-09-13T06:39:57.354 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:57.354 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:57.354 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:57.354 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.526404+0000", 2024-09-13T06:39:57.354 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.0887999999999999e-05 2024-09-13T06:39:57.354 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:57.354 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:57.354 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:57.354 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.526729+0000", 2024-09-13T06:39:57.354 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00032486 2024-09-13T06:39:57.354 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:57.355 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:57.355 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:57.355 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:57.355 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:57.355 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25664 3.8 3:1180686c:::rbd_data.1121f2c5ee81.0000000000000009:13 [read 491520~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:39:57.355 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.437040+0000", 2024-09-13T06:39:57.355 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.90040221899999995, 2024-09-13T06:39:57.355 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.090016650000000004, 2024-09-13T06:39:57.355 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:57.355 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:39:57.355 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:39:57.355 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:39:57.355 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:57.356 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25664 2024-09-13T06:39:57.356 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:57.356 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:57.356 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:57.356 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:57.356 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437040+0000", 2024-09-13T06:39:57.356 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:57.356 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:57.356 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:57.356 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:57.356 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437040+0000", 2024-09-13T06:39:57.356 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:57.357 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:57.357 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:57.357 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:57.357 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437039+0000", 2024-09-13T06:39:57.357 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:39:57.357 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:57.357 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:57.357 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:57.357 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437047+0000", 2024-09-13T06:39:57.357 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4839999999999998e-06 2024-09-13T06:39:57.357 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:57.357 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:57.358 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:57.358 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437054+0000", 2024-09-13T06:39:57.358 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.8299999999999998e-06 2024-09-13T06:39:57.358 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:57.358 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:57.358 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:57.358 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437060+0000", 2024-09-13T06:39:57.358 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.1510000000000001e-06 2024-09-13T06:39:57.358 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:57.358 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:57.358 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:57.358 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.526772+0000", 2024-09-13T06:39:57.360 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089711737999999999 2024-09-13T06:39:57.360 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:57.360 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:57.360 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:57.360 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.526848+0000", 2024-09-13T06:39:57.360 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5870000000000004e-05 2024-09-13T06:39:57.360 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:57.360 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:57.360 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:57.360 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.527057+0000", 2024-09-13T06:39:57.360 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000209106 2024-09-13T06:39:57.361 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:57.361 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:57.361 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:57.361 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:57.361 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:57.361 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25740 3.18 3:1c662b96:::rbd_data.1121f2c5ee81.0000000000000010:13 [read 200704~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:39:57.361 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443352+0000", 2024-09-13T06:39:57.361 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.89409054399999999, 2024-09-13T06:39:57.361 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089068222000000002, 2024-09-13T06:39:57.361 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:57.361 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:39:57.361 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:39:57.362 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:39:57.362 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:57.362 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25740 2024-09-13T06:39:57.362 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:57.362 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:57.362 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:57.362 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:57.362 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443352+0000", 2024-09-13T06:39:57.362 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:57.362 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:57.362 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:57.362 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:57.362 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443352+0000", 2024-09-13T06:39:57.363 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:57.363 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:57.363 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:57.363 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:57.363 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443351+0000", 2024-09-13T06:39:57.363 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:39:57.363 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:57.363 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:57.363 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:57.363 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443354+0000", 2024-09-13T06:39:57.363 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.841e-06 2024-09-13T06:39:57.363 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:57.363 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:57.364 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:57.364 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443361+0000", 2024-09-13T06:39:57.364 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.0010000000000004e-06 2024-09-13T06:39:57.364 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:57.364 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:57.364 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:57.364 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443366+0000", 2024-09-13T06:39:57.364 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7119999999999999e-06 2024-09-13T06:39:57.364 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:57.364 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:57.364 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:57.364 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532117+0000", 2024-09-13T06:39:57.365 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.088751327000000005 2024-09-13T06:39:57.365 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:57.365 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:57.365 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:57.365 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532193+0000", 2024-09-13T06:39:57.365 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5839000000000004e-05 2024-09-13T06:39:57.365 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:57.365 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:57.365 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:57.365 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532420+0000", 2024-09-13T06:39:57.365 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00022691000000000001 2024-09-13T06:39:57.365 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:57.365 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:57.366 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:57.366 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:57.366 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:57.366 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25741 3.18 3:1c662b96:::rbd_data.1121f2c5ee81.0000000000000010:13 [read 225280~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:39:57.366 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443378+0000", 2024-09-13T06:39:57.366 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.89406377699999995, 2024-09-13T06:39:57.366 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089324107, 2024-09-13T06:39:57.366 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:57.366 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:39:57.366 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:39:57.366 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:39:57.366 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:57.366 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25741 2024-09-13T06:39:57.367 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:57.367 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:57.367 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:57.367 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:57.367 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443378+0000", 2024-09-13T06:39:57.367 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:57.367 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:57.367 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:57.367 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:57.367 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443378+0000", 2024-09-13T06:39:57.367 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:57.367 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:57.368 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:57.368 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:57.368 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443378+0000", 2024-09-13T06:39:57.368 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:39:57.368 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:57.368 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:57.368 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:57.368 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443380+0000", 2024-09-13T06:39:57.368 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3549999999999999e-06 2024-09-13T06:39:57.368 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:57.368 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:57.368 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:57.368 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443388+0000", 2024-09-13T06:39:57.369 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.7449999999999995e-06 2024-09-13T06:39:57.369 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:57.369 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:57.369 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:57.369 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443393+0000", 2024-09-13T06:39:57.369 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.4e-06 2024-09-13T06:39:57.369 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:57.369 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:57.369 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:57.369 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532454+0000", 2024-09-13T06:39:57.369 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089060941000000005 2024-09-13T06:39:57.369 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:57.369 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:57.369 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:57.370 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532512+0000", 2024-09-13T06:39:57.370 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7763000000000002e-05 2024-09-13T06:39:57.370 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:57.370 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:57.370 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:57.370 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532703+0000", 2024-09-13T06:39:57.370 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000190328 2024-09-13T06:39:57.370 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:57.370 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:57.370 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:57.370 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:57.370 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:57.370 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25742 3.18 3:1c662b96:::rbd_data.1121f2c5ee81.0000000000000010:13 [read 270336~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:39:57.371 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443398+0000", 2024-09-13T06:39:57.371 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.894044065, 2024-09-13T06:39:57.371 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089621836999999996, 2024-09-13T06:39:57.371 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:57.371 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:39:57.371 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:39:57.371 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:39:57.371 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:57.371 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25742 2024-09-13T06:39:57.371 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:57.371 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:57.371 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:57.371 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:57.372 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443398+0000", 2024-09-13T06:39:57.372 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:57.372 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:57.372 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:57.372 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:57.372 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443398+0000", 2024-09-13T06:39:57.372 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:57.372 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:57.372 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:57.372 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:57.372 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443398+0000", 2024-09-13T06:39:57.372 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:39:57.373 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:57.373 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:57.373 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:57.373 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443400+0000", 2024-09-13T06:39:57.373 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1849999999999998e-06 2024-09-13T06:39:57.373 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:57.373 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:57.373 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:57.373 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443407+0000", 2024-09-13T06:39:57.373 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3669999999999999e-06 2024-09-13T06:39:57.373 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:57.373 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:57.374 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:57.374 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443420+0000", 2024-09-13T06:39:57.374 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2645e-05 2024-09-13T06:39:57.374 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:57.374 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:57.374 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:57.374 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532742+0000", 2024-09-13T06:39:57.374 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089322200000000004 2024-09-13T06:39:57.374 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:57.374 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:57.374 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:57.374 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532818+0000", 2024-09-13T06:39:57.374 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.6019000000000005e-05 2024-09-13T06:39:57.375 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:57.375 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:57.375 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:57.375 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533020+0000", 2024-09-13T06:39:57.375 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000201721 2024-09-13T06:39:57.375 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:57.375 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:57.375 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:57.375 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:57.375 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:57.375 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25743 3.18 3:1c662b96:::rbd_data.1121f2c5ee81.0000000000000010:13 [read 294912~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:39:57.375 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443425+0000", 2024-09-13T06:39:57.375 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.894017057, 2024-09-13T06:39:57.376 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089864075000000002, 2024-09-13T06:39:57.376 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:57.376 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:39:57.376 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:39:57.376 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:39:57.376 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:57.376 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25743 2024-09-13T06:39:57.376 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:57.377 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:57.377 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:57.377 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:57.377 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443425+0000", 2024-09-13T06:39:57.377 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:57.377 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:57.377 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:57.377 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:57.377 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443425+0000", 2024-09-13T06:39:57.377 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:57.377 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:57.377 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:57.377 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:57.377 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443425+0000", 2024-09-13T06:39:57.378 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:39:57.378 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:57.378 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:57.378 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:57.378 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443432+0000", 2024-09-13T06:39:57.378 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3420000000000002e-06 2024-09-13T06:39:57.378 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:57.378 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:57.378 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:57.378 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443440+0000", 2024-09-13T06:39:57.378 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5689999999999999e-06 2024-09-13T06:39:57.378 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:57.378 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:57.379 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:57.379 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443445+0000", 2024-09-13T06:39:57.379 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9590000000000003e-06 2024-09-13T06:39:57.379 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:57.379 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:57.379 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:57.379 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533063+0000", 2024-09-13T06:39:57.379 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089617988999999995 2024-09-13T06:39:57.379 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:57.379 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:57.379 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:39:57.379 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533122+0000", 2024-09-13T06:39:57.379 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9052999999999999e-05 2024-09-13T06:39:57.380 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:57.380 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:57.380 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:57.380 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533289+0000", 2024-09-13T06:39:57.380 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00016752800000000001 2024-09-13T06:39:57.380 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:57.380 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:57.380 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:57.380 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:57.380 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:57.380 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25744 3.18 3.69d46638 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:39:57.380 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443449+0000", 2024-09-13T06:39:57.380 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.89399291000000003, 2024-09-13T06:39:57.380 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089869148999999995, 2024-09-13T06:39:57.381 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:57.381 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:39:57.381 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:39:57.381 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:39:57.381 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:57.381 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25744 2024-09-13T06:39:57.381 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:57.381 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:57.381 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:57.381 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:57.381 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443449+0000", 2024-09-13T06:39:57.381 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:57.381 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:57.382 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:57.382 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:57.382 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443449+0000", 2024-09-13T06:39:57.382 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:57.382 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:57.382 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:57.382 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:57.382 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443449+0000", 2024-09-13T06:39:57.382 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:39:57.382 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:57.382 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:57.382 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:57.383 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443451+0000", 2024-09-13T06:39:57.383 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.244e-06 2024-09-13T06:39:57.383 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:57.383 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:57.383 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:57.383 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443457+0000", 2024-09-13T06:39:57.383 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.66e-06 2024-09-13T06:39:57.383 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:57.383 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:57.383 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:57.383 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443461+0000", 2024-09-13T06:39:57.383 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5449999999999997e-06 2024-09-13T06:39:57.383 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:57.383 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:57.384 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:57.384 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533311+0000", 2024-09-13T06:39:57.384 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089849729000000003 2024-09-13T06:39:57.384 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:57.384 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:57.384 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:57.384 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533318+0000", 2024-09-13T06:39:57.384 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.328e-06 2024-09-13T06:39:57.384 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:57.384 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:57.384 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:57.384 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:57.385 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:57.385 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25745 3.18 3.69d46638 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:39:57.385 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443466+0000", 2024-09-13T06:39:57.385 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.89397585199999996, 2024-09-13T06:39:57.385 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089886743000000005, 2024-09-13T06:39:57.385 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:57.385 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:39:57.385 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:39:57.385 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:39:57.385 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:57.385 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25745 2024-09-13T06:39:57.385 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:57.385 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:57.386 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:57.386 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:57.386 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443466+0000", 2024-09-13T06:39:57.386 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:57.386 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:57.386 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:57.386 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:57.386 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443466+0000", 2024-09-13T06:39:57.386 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:57.386 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:57.386 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:57.386 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:57.386 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443466+0000", 2024-09-13T06:39:57.387 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:39:57.387 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:57.387 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:57.387 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:57.387 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443474+0000", 2024-09-13T06:39:57.387 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.1289999999999996e-06 2024-09-13T06:39:57.387 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:57.387 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:57.387 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:57.387 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443484+0000", 2024-09-13T06:39:57.387 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0654e-05 2024-09-13T06:39:57.387 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:57.387 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:57.387 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:57.388 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443490+0000", 2024-09-13T06:39:57.388 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8030000000000002e-06 2024-09-13T06:39:57.388 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:57.388 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:57.388 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:57.388 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533348+0000", 2024-09-13T06:39:57.388 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089857267000000005 2024-09-13T06:39:57.388 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:57.388 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:57.388 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:57.388 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533353+0000", 2024-09-13T06:39:57.388 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.5520000000000004e-06 2024-09-13T06:39:57.388 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:57.389 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:57.389 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:57.389 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:57.389 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:57.389 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25746 3.18 3.69d46638 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:39:57.389 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443495+0000", 2024-09-13T06:39:57.389 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.89394673899999999, 2024-09-13T06:39:57.389 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089903725000000004, 2024-09-13T06:39:57.389 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:57.389 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:39:57.389 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:39:57.389 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:39:57.389 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:57.390 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25746 2024-09-13T06:39:57.390 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:57.390 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:57.390 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:57.390 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:57.390 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443495+0000", 2024-09-13T06:39:57.390 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:57.390 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:57.390 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:57.390 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:57.390 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443495+0000", 2024-09-13T06:39:57.390 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:57.390 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:57.391 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:57.391 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:57.391 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443495+0000", 2024-09-13T06:39:57.391 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:39:57.391 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:57.391 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:57.391 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:57.391 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443498+0000", 2024-09-13T06:39:57.391 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.7690000000000001e-06 2024-09-13T06:39:57.391 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:57.391 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:57.391 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:57.391 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443504+0000", 2024-09-13T06:39:57.392 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9710000000000001e-06 2024-09-13T06:39:57.392 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:57.392 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:57.392 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:57.392 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443508+0000", 2024-09-13T06:39:57.392 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4159999999999997e-06 2024-09-13T06:39:57.392 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:57.392 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:57.392 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:57.392 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533391+0000", 2024-09-13T06:39:57.392 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089882607000000003 2024-09-13T06:39:57.392 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:57.392 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:57.393 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:57.393 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533399+0000", 2024-09-13T06:39:57.393 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.4349999999999997e-06 2024-09-13T06:39:57.393 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:57.393 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:57.393 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:57.393 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:57.393 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:57.393 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25747 3.8 3.63996268 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:39:57.393 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443512+0000", 2024-09-13T06:39:57.393 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.893930008, 2024-09-13T06:39:57.393 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089880075000000004, 2024-09-13T06:39:57.393 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:57.394 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:39:57.394 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:39:57.394 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:39:57.394 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:57.394 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25747 2024-09-13T06:39:57.394 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:57.394 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:57.394 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:57.394 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:57.394 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443512+0000", 2024-09-13T06:39:57.394 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:57.394 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:57.395 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:57.395 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:57.395 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443512+0000", 2024-09-13T06:39:57.395 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:57.395 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:57.395 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:57.395 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:57.395 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443512+0000", 2024-09-13T06:39:57.395 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:39:57.395 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:57.395 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:57.395 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:57.395 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443514+0000", 2024-09-13T06:39:57.396 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0980000000000001e-06 2024-09-13T06:39:57.396 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:57.396 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:57.396 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:57.396 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443520+0000", 2024-09-13T06:39:57.396 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7069999999999997e-06 2024-09-13T06:39:57.396 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:57.396 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:57.396 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:57.396 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443524+0000", 2024-09-13T06:39:57.396 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5390000000000001e-06 2024-09-13T06:39:57.396 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:57.396 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:57.397 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:57.397 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533384+0000", 2024-09-13T06:39:57.397 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089859684999999995 2024-09-13T06:39:57.397 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:57.397 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:57.397 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:57.397 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533392+0000", 2024-09-13T06:39:57.397 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.3440000000000001e-06 2024-09-13T06:39:57.397 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:57.397 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:57.397 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:57.397 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:57.397 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:57.398 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25748 3.8 3.63996268 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:39:57.398 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443528+0000", 2024-09-13T06:39:57.398 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.89391388100000002, 2024-09-13T06:39:57.398 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089890715999999996, 2024-09-13T06:39:57.398 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:57.398 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:39:57.398 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:39:57.398 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:39:57.398 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:57.398 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25748 2024-09-13T06:39:57.398 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:57.398 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:57.398 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:57.399 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:57.399 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443528+0000", 2024-09-13T06:39:57.399 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:57.399 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:57.399 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:57.399 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:57.399 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443528+0000", 2024-09-13T06:39:57.399 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:57.399 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:57.399 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:57.399 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:57.399 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443528+0000", 2024-09-13T06:39:57.399 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:39:57.400 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:57.400 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:57.400 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:57.400 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443530+0000", 2024-09-13T06:39:57.400 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0650000000000001e-06 2024-09-13T06:39:57.400 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:57.400 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:57.400 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:57.400 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443536+0000", 2024-09-13T06:39:57.400 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7259999999999999e-06 2024-09-13T06:39:57.400 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:57.400 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:57.400 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:57.401 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443540+0000", 2024-09-13T06:39:57.401 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5009999999999998e-06 2024-09-13T06:39:57.401 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:57.401 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:57.401 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:57.401 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533412+0000", 2024-09-13T06:39:57.401 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089871873000000005 2024-09-13T06:39:57.401 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:57.401 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:57.401 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:57.401 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533419+0000", 2024-09-13T06:39:57.401 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.883e-06 2024-09-13T06:39:57.401 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:57.402 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:57.402 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:57.402 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:57.402 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:57.402 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25749 3.8 3.63996268 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:39:57.402 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443545+0000", 2024-09-13T06:39:57.402 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.893897685, 2024-09-13T06:39:57.402 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089897988999999998, 2024-09-13T06:39:57.402 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:57.402 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:39:57.402 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:39:57.402 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:39:57.402 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:57.403 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25749 2024-09-13T06:39:57.403 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:57.403 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:57.403 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:57.403 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:57.403 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443545+0000", 2024-09-13T06:39:57.403 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:57.403 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:57.403 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:57.403 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:57.403 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443545+0000", 2024-09-13T06:39:57.403 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:57.403 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:57.403 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:57.404 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:57.404 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443544+0000", 2024-09-13T06:39:57.404 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:39:57.404 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:57.404 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:57.404 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:57.404 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443553+0000", 2024-09-13T06:39:57.404 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.4770000000000003e-06 2024-09-13T06:39:57.404 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:57.404 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:57.404 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:57.404 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443564+0000", 2024-09-13T06:39:57.405 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0986e-05 2024-09-13T06:39:57.405 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:57.405 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:57.405 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:57.405 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443569+0000", 2024-09-13T06:39:57.405 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2530000000000004e-06 2024-09-13T06:39:57.405 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:57.405 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:57.405 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:57.405 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533438+0000", 2024-09-13T06:39:57.405 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089868641999999999 2024-09-13T06:39:57.405 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:57.405 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:57.406 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:57.406 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533442+0000", 2024-09-13T06:39:57.406 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.989e-06 2024-09-13T06:39:57.406 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:57.406 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:57.406 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:57.406 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:57.406 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:57.406 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25750 3.8 3.63996268 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:39:57.406 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443574+0000", 2024-09-13T06:39:57.406 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.89386819900000003, 2024-09-13T06:39:57.406 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089895143999999996, 2024-09-13T06:39:57.406 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:57.406 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:39:57.407 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:39:57.407 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:39:57.407 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:57.407 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25750 2024-09-13T06:39:57.407 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:57.407 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:57.407 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:57.407 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:57.407 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443574+0000", 2024-09-13T06:39:57.407 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:57.407 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:57.407 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:57.407 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:57.407 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443574+0000", 2024-09-13T06:39:57.408 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:57.408 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:57.408 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:57.408 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:57.408 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443574+0000", 2024-09-13T06:39:57.408 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:39:57.408 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:57.408 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:57.408 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:57.408 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443576+0000", 2024-09-13T06:39:57.408 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6910000000000002e-06 2024-09-13T06:39:57.408 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:57.409 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:57.409 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:57.409 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443583+0000", 2024-09-13T06:39:57.409 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.331e-06 2024-09-13T06:39:57.409 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:57.409 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:57.409 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:57.409 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443587+0000", 2024-09-13T06:39:57.409 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6129999999999997e-06 2024-09-13T06:39:57.409 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:57.409 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:57.409 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:57.409 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533464+0000", 2024-09-13T06:39:57.409 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089876605999999998 2024-09-13T06:39:57.410 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:57.410 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:57.410 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:57.410 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533469+0000", 2024-09-13T06:39:57.410 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3909999999999997e-06 2024-09-13T06:39:57.410 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:57.410 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:57.410 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:57.410 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:57.410 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:57.410 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25751 3.8 3.63996268 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:39:57.410 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443592+0000", 2024-09-13T06:39:57.410 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.89385050200000005, 2024-09-13T06:39:57.411 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089913650999999997, 2024-09-13T06:39:57.411 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:57.411 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:39:57.411 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:39:57.411 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:39:57.411 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:57.411 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25751 2024-09-13T06:39:57.411 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:57.411 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:57.411 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:57.411 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:57.411 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443592+0000", 2024-09-13T06:39:57.411 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:57.411 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:57.412 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:57.412 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:57.412 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443592+0000", 2024-09-13T06:39:57.412 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:57.412 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:57.412 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:57.412 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:57.412 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443591+0000", 2024-09-13T06:39:57.412 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:39:57.412 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:57.412 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:57.412 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:57.413 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443594+0000", 2024-09-13T06:39:57.413 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3649999999999998e-06 2024-09-13T06:39:57.413 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:57.413 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:57.413 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:57.413 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443599+0000", 2024-09-13T06:39:57.413 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.699e-06 2024-09-13T06:39:57.413 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:57.413 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:57.413 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:57.413 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443611+0000", 2024-09-13T06:39:57.413 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1503e-05 2024-09-13T06:39:57.413 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:57.413 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:57.414 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:57.414 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533497+0000", 2024-09-13T06:39:57.414 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089886453000000005 2024-09-13T06:39:57.414 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:57.414 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:57.414 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:57.414 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533505+0000", 2024-09-13T06:39:57.414 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.9910000000000002e-06 2024-09-13T06:39:57.414 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:57.414 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:57.414 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:57.414 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:57.414 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:57.415 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25752 3.8 3.63996268 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:39:57.415 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443615+0000", 2024-09-13T06:39:57.415 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.89382672100000005, 2024-09-13T06:39:57.415 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089905868999999999, 2024-09-13T06:39:57.415 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:57.415 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:39:57.415 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:39:57.415 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:39:57.415 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:57.415 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25752 2024-09-13T06:39:57.415 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:57.415 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:57.415 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:57.416 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:57.416 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443615+0000", 2024-09-13T06:39:57.416 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:57.416 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:57.416 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:57.416 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:57.416 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443615+0000", 2024-09-13T06:39:57.416 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:57.416 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:57.416 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:57.416 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:57.416 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443615+0000", 2024-09-13T06:39:57.416 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:39:57.417 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:57.417 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:57.417 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:57.417 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443617+0000", 2024-09-13T06:39:57.417 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3539999999999998e-06 2024-09-13T06:39:57.417 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:57.417 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:57.417 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:57.417 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443624+0000", 2024-09-13T06:39:57.417 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3600000000000001e-06 2024-09-13T06:39:57.417 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:57.417 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:57.418 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:57.418 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443628+0000", 2024-09-13T06:39:57.418 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.2350000000000001e-06 2024-09-13T06:39:57.418 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:57.418 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:57.418 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:57.418 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533517+0000", 2024-09-13T06:39:57.418 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089889029999999995 2024-09-13T06:39:57.418 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:57.418 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:57.418 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:57.418 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533521+0000", 2024-09-13T06:39:57.418 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.2529999999999998e-06 2024-09-13T06:39:57.419 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:57.419 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:57.419 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:57.419 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:57.419 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:57.419 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25755 3.8 3.63996268 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:39:57.419 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.444692+0000", 2024-09-13T06:39:57.419 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.89275001499999995, 2024-09-13T06:39:57.419 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.088904186999999996, 2024-09-13T06:39:57.419 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:57.419 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:39:57.419 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:39:57.419 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:39:57.420 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:57.420 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25755 2024-09-13T06:39:57.420 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:57.420 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:57.420 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:57.420 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:57.420 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.444692+0000", 2024-09-13T06:39:57.420 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:57.420 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:57.420 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:57.420 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:57.420 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.444692+0000", 2024-09-13T06:39:57.420 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:57.421 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:57.421 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:57.421 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:57.421 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.444692+0000", 2024-09-13T06:39:57.421 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:39:57.421 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:57.421 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:57.421 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:57.421 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.444694+0000", 2024-09-13T06:39:57.421 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.058e-06 2024-09-13T06:39:57.421 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:57.421 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:57.421 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:57.422 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.444700+0000", 2024-09-13T06:39:57.422 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7769999999999999e-06 2024-09-13T06:39:57.422 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:57.422 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:57.422 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:57.422 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.444704+0000", 2024-09-13T06:39:57.422 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6229999999999996e-06 2024-09-13T06:39:57.422 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:57.422 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:57.422 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:57.422 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533587+0000", 2024-09-13T06:39:57.422 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.088882744999999999 2024-09-13T06:39:57.422 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:57.422 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:57.423 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:57.423 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533596+0000", 2024-09-13T06:39:57.423 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.3270000000000007e-06 2024-09-13T06:39:57.423 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:57.423 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:57.423 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:57.423 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:57.423 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:57.423 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25756 3.8 3.63996268 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:39:57.423 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.444709+0000", 2024-09-13T06:39:57.423 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.89273363900000002, 2024-09-13T06:39:57.423 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.088902571, 2024-09-13T06:39:57.423 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:39:57.424 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:39:57.424 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:39:57.424 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:39:57.424 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:57.424 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25756 2024-09-13T06:39:57.424 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:57.424 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:39:57.424 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:57.424 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:39:57.424 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.444709+0000", 2024-09-13T06:39:57.424 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:57.424 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:57.424 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:57.425 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:39:57.425 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.444709+0000", 2024-09-13T06:39:57.425 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:39:57.425 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:57.425 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:57.425 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:39:57.425 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.444708+0000", 2024-09-13T06:39:57.425 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:39:57.425 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:57.425 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:57.425 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:39:57.425 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.444710+0000", 2024-09-13T06:39:57.425 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0729999999999999e-06 2024-09-13T06:39:57.426 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:57.426 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:57.426 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:39:57.426 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.444716+0000", 2024-09-13T06:39:57.426 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7819999999999999e-06 2024-09-13T06:39:57.426 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:57.426 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:57.426 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:39:57.426 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.444720+0000", 2024-09-13T06:39:57.426 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4000000000000002e-06 2024-09-13T06:39:57.426 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:57.426 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:57.426 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:39:57.427 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533606+0000", 2024-09-13T06:39:57.427 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.088885711000000006 2024-09-13T06:39:57.427 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:39:57.427 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:39:57.427 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:39:57.427 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533611+0000", 2024-09-13T06:39:57.427 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.057e-06 2024-09-13T06:39:57.427 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:57.427 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:57.427 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:57.427 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:39:57.427 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:39:57.427 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:39:57.429 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-13T06:39:57.429 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:39:57.431+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:39:57.530 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:39:57.529+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:39:57.568 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:39:57.568 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [], 2024-09-13T06:39:57.568 INFO:teuthology.orchestra.run.smithi139.stdout: "num_ops": 0 2024-09-13T06:39:57.568 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:39:57.581 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-13T06:39:57.668 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:39:57.669+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:39:57.731 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:39:57.735+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:39:57.745 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:39:57.745 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [], 2024-09-13T06:39:57.745 INFO:teuthology.orchestra.run.smithi139.stdout: "complaint_time": 30, 2024-09-13T06:39:57.745 INFO:teuthology.orchestra.run.smithi139.stdout: "num_blocked_ops": 0 2024-09-13T06:39:57.745 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:39:57.760 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-13T06:39:57.780 INFO:teuthology.orchestra.run.smithi081.stdout:checking clone #4, image image_client.0-clone4 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent5 2024-09-13T06:39:57.848 INFO:tasks.ceph.osd.6.smithi139.stderr:2024-09-13T06:39:57.849+0000 7fcd02c5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26385) UID: 0 2024-09-13T06:39:57.931 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:39:57.931 INFO:teuthology.orchestra.run.smithi139.stdout: "size": 20, 2024-09-13T06:39:57.931 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 600, 2024-09-13T06:39:57.932 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [ 2024-09-13T06:39:57.932 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:57.932 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18706 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 3346432~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:39:57.932 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.846138+0000", 2024-09-13T06:39:57.932 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 6.0878247959999996, 2024-09-13T06:39:57.932 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.102018712, 2024-09-13T06:39:57.932 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:39:57.932 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:39:57.932 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:39:57.932 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:39:57.932 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:57.932 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18706 2024-09-13T06:39:57.932 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:57.933 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:39:57.933 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:57.933 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:39:57.933 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846138+0000", 2024-09-13T06:39:57.933 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:57.933 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:57.933 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:57.933 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:39:57.933 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846138+0000", 2024-09-13T06:39:57.933 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:57.933 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:57.934 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:57.934 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:39:57.934 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846138+0000", 2024-09-13T06:39:57.934 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:39:57.934 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:57.934 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:57.934 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:39:57.934 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846141+0000", 2024-09-13T06:39:57.934 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.6969999999999999e-06 2024-09-13T06:39:57.934 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:57.934 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:57.934 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:39:57.935 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846150+0000", 2024-09-13T06:39:57.935 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6400000000000003e-06 2024-09-13T06:39:57.935 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:57.935 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:57.935 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:39:57.935 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846160+0000", 2024-09-13T06:39:57.935 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.3999999999999998e-06 2024-09-13T06:39:57.935 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:57.935 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:57.935 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:39:57.935 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.947764+0000", 2024-09-13T06:39:57.935 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101604085 2024-09-13T06:39:57.935 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:57.936 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:57.936 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:39:57.936 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.947888+0000", 2024-09-13T06:39:57.936 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000124113 2024-09-13T06:39:57.936 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:57.936 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:57.936 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:39:57.936 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.948157+0000", 2024-09-13T06:39:57.936 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00026943399999999998 2024-09-13T06:39:57.936 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:57.936 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:39:57.936 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:57.937 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:57.937 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:57.937 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18707 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 3375104~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:39:57.937 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.846207+0000", 2024-09-13T06:39:57.937 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 6.0877560300000004, 2024-09-13T06:39:57.937 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10238114099999999, 2024-09-13T06:39:57.937 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:39:57.937 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:39:57.937 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:39:57.937 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:39:57.937 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:57.937 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18707 2024-09-13T06:39:57.938 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:57.938 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:39:57.938 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:57.938 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:39:57.938 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846207+0000", 2024-09-13T06:39:57.938 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:57.938 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:57.938 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:57.938 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:39:57.938 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846207+0000", 2024-09-13T06:39:57.938 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:57.938 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:57.938 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:57.939 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:39:57.939 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846206+0000", 2024-09-13T06:39:57.939 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:39:57.939 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:57.939 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:57.939 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:39:57.939 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846211+0000", 2024-09-13T06:39:57.939 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.3000000000000003e-06 2024-09-13T06:39:57.939 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:57.939 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:57.939 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:39:57.939 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846220+0000", 2024-09-13T06:39:57.939 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6199999999999994e-06 2024-09-13T06:39:57.940 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:57.940 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:57.940 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:39:57.940 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846228+0000", 2024-09-13T06:39:57.940 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.7500000000000003e-06 2024-09-13T06:39:57.940 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:57.940 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:57.940 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:39:57.940 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.948267+0000", 2024-09-13T06:39:57.940 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10203878700000001 2024-09-13T06:39:57.940 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:57.940 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:57.940 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:39:57.941 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.948435+0000", 2024-09-13T06:39:57.941 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00016796500000000001 2024-09-13T06:39:57.941 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:57.941 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:57.941 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:39:57.941 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.948588+0000", 2024-09-13T06:39:57.941 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00015373599999999999 2024-09-13T06:39:57.941 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:57.941 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:39:57.941 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:57.941 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:57.941 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:57.942 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18718 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 3690496~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:39:57.942 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.850174+0000", 2024-09-13T06:39:57.942 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 6.0837888769999999, 2024-09-13T06:39:57.942 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101854154, 2024-09-13T06:39:57.942 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:39:57.942 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:39:57.942 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:39:57.942 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:39:57.942 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:57.942 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18718 2024-09-13T06:39:57.942 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:57.942 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:39:57.942 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:57.943 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:39:57.943 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850174+0000", 2024-09-13T06:39:57.943 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:57.943 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:57.943 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:57.943 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:39:57.943 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850174+0000", 2024-09-13T06:39:57.943 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:57.943 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:57.943 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:57.943 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:39:57.943 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850173+0000", 2024-09-13T06:39:57.943 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:39:57.943 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:57.944 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:57.944 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:39:57.944 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850178+0000", 2024-09-13T06:39:57.944 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.4129999999999999e-06 2024-09-13T06:39:57.944 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:57.944 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:57.944 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:39:57.944 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850188+0000", 2024-09-13T06:39:57.944 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.8600000000000005e-06 2024-09-13T06:39:57.944 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:57.944 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:57.944 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:39:57.944 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850195+0000", 2024-09-13T06:39:57.945 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.8730000000000007e-06 2024-09-13T06:39:57.945 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:57.945 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:57.945 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:39:57.945 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.951766+0000", 2024-09-13T06:39:57.945 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.1015703 2024-09-13T06:39:57.945 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:57.945 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:57.945 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:39:57.946 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.951879+0000", 2024-09-13T06:39:57.946 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000112932 2024-09-13T06:39:57.946 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:57.946 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:57.946 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:39:57.946 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.952029+0000", 2024-09-13T06:39:57.946 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000149846 2024-09-13T06:39:57.946 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:57.946 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:39:57.946 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:57.946 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:57.946 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:57.946 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18719 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 3719168~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:39:57.947 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.850202+0000", 2024-09-13T06:39:57.947 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 6.0837608339999996, 2024-09-13T06:39:57.947 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.102191676, 2024-09-13T06:39:57.947 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:39:57.947 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:39:57.947 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:39:57.947 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:39:57.947 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:57.947 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18719 2024-09-13T06:39:57.947 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:57.947 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:39:57.948 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:57.948 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:39:57.948 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850202+0000", 2024-09-13T06:39:57.948 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:57.948 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:57.948 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:57.948 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:39:57.948 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850202+0000", 2024-09-13T06:39:57.948 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:57.948 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:57.948 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:57.948 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:39:57.949 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850202+0000", 2024-09-13T06:39:57.949 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:39:57.949 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:57.949 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:57.949 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:39:57.949 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850205+0000", 2024-09-13T06:39:57.949 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.89e-06 2024-09-13T06:39:57.949 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:57.950 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:57.950 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:39:57.950 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850216+0000", 2024-09-13T06:39:57.950 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0233e-05 2024-09-13T06:39:57.950 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:57.950 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:57.950 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:39:57.950 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850223+0000", 2024-09-13T06:39:57.950 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5299999999999999e-06 2024-09-13T06:39:57.950 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:57.950 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:57.950 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:39:57.950 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.952106+0000", 2024-09-13T06:39:57.951 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10188309299999999 2024-09-13T06:39:57.951 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:57.951 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:57.951 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:39:57.951 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.952233+0000", 2024-09-13T06:39:57.951 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000126993 2024-09-13T06:39:57.951 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:57.951 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:57.951 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:39:57.951 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.952394+0000", 2024-09-13T06:39:57.951 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000160791 2024-09-13T06:39:57.951 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:57.951 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:39:57.952 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:57.952 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:57.952 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:57.952 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18720 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 3747840~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:39:57.952 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.850726+0000", 2024-09-13T06:39:57.952 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 6.083237005, 2024-09-13T06:39:57.952 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10199504299999999, 2024-09-13T06:39:57.952 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:39:57.952 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:39:57.952 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:39:57.952 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:39:57.952 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:57.953 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18720 2024-09-13T06:39:57.953 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:57.953 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:39:57.953 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:57.953 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:39:57.953 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850726+0000", 2024-09-13T06:39:57.953 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:57.953 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:57.953 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:57.953 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:39:57.953 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850726+0000", 2024-09-13T06:39:57.953 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:57.953 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:57.954 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:57.954 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:39:57.954 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850229+0000", 2024-09-13T06:39:57.954 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9995027 2024-09-13T06:39:57.954 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:57.954 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:57.954 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:39:57.954 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850731+0000", 2024-09-13T06:39:57.954 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00050221599999999999 2024-09-13T06:39:57.954 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:57.954 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:57.954 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:39:57.954 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850751+0000", 2024-09-13T06:39:57.955 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.9703000000000001e-05 2024-09-13T06:39:57.955 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:57.955 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:57.955 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:39:57.955 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850764+0000", 2024-09-13T06:39:57.955 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3207000000000001e-05 2024-09-13T06:39:57.955 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:57.955 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:57.955 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:39:57.955 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.952454+0000", 2024-09-13T06:39:57.955 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101690102 2024-09-13T06:39:57.955 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:57.955 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:57.955 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:39:57.956 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.952571+0000", 2024-09-13T06:39:57.956 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000116556 2024-09-13T06:39:57.956 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:57.956 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:57.956 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:39:57.956 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.952721+0000", 2024-09-13T06:39:57.956 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000150419 2024-09-13T06:39:57.956 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:57.956 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:39:57.956 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:57.956 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:57.956 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:57.956 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18730 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 4034560~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:39:57.957 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.854013+0000", 2024-09-13T06:39:57.957 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 6.0799500640000002, 2024-09-13T06:39:57.957 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10186914399999999, 2024-09-13T06:39:57.957 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:39:57.957 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:39:57.957 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:39:57.957 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:39:57.957 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:57.957 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18730 2024-09-13T06:39:57.957 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:57.957 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:39:57.958 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:57.958 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:39:57.958 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.854013+0000", 2024-09-13T06:39:57.958 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:57.958 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:57.958 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:57.958 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:39:57.958 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.854013+0000", 2024-09-13T06:39:57.958 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:57.958 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:57.958 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:57.958 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:39:57.959 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.854013+0000", 2024-09-13T06:39:57.959 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:39:57.959 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:57.959 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:57.959 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:39:57.959 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.854016+0000", 2024-09-13T06:39:57.959 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.1839999999999999e-06 2024-09-13T06:39:57.959 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:57.959 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:57.959 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:39:57.959 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.854025+0000", 2024-09-13T06:39:57.959 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.8030000000000003e-06 2024-09-13T06:39:57.959 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:57.960 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:57.960 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:39:57.960 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.854033+0000", 2024-09-13T06:39:57.960 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6500000000000002e-06 2024-09-13T06:39:57.960 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:57.960 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:57.960 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:39:57.960 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.955546+0000", 2024-09-13T06:39:57.960 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10151296 2024-09-13T06:39:57.960 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:57.960 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:57.960 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:39:57.960 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.955694+0000", 2024-09-13T06:39:57.961 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000147773 2024-09-13T06:39:57.961 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:57.961 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:57.961 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:39:57.961 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.955882+0000", 2024-09-13T06:39:57.961 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000188371 2024-09-13T06:39:57.961 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:57.961 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:39:57.961 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:57.961 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:57.961 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:57.961 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18742 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 4378624~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:39:57.961 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.857984+0000", 2024-09-13T06:39:57.962 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 6.0759789409999998, 2024-09-13T06:39:57.962 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10179961799999999, 2024-09-13T06:39:57.962 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:39:57.962 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:39:57.962 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:39:57.962 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:39:57.962 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:57.962 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18742 2024-09-13T06:39:57.962 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:57.962 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:39:57.962 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:57.962 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:39:57.962 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.857984+0000", 2024-09-13T06:39:57.962 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:57.963 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:57.963 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:57.963 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:39:57.963 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.857984+0000", 2024-09-13T06:39:57.963 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:57.963 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:57.963 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:57.963 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:39:57.963 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.857983+0000", 2024-09-13T06:39:57.963 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:39:57.963 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:57.963 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:57.964 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:39:57.964 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.857987+0000", 2024-09-13T06:39:57.964 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0670000000000002e-06 2024-09-13T06:39:57.964 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:57.964 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:57.964 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:39:57.964 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.857997+0000", 2024-09-13T06:39:57.964 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6830000000000003e-06 2024-09-13T06:39:57.964 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:57.964 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:57.964 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:39:57.964 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.858006+0000", 2024-09-13T06:39:57.964 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.5739999999999996e-06 2024-09-13T06:39:57.965 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:57.965 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:57.965 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:39:57.965 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.959453+0000", 2024-09-13T06:39:57.965 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101447339 2024-09-13T06:39:57.965 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:57.965 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:57.965 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:39:57.965 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.959603+0000", 2024-09-13T06:39:57.965 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000150316 2024-09-13T06:39:57.965 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:57.965 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:57.965 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:39:57.965 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.959784+0000", 2024-09-13T06:39:57.966 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00018065900000000001 2024-09-13T06:39:57.966 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:57.966 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:39:57.966 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:57.966 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:57.966 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:57.966 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18743 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 4407296~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:39:57.966 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.858012+0000", 2024-09-13T06:39:57.966 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 6.075950948, 2024-09-13T06:39:57.966 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10210024500000001, 2024-09-13T06:39:57.966 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:39:57.966 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:39:57.966 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:39:57.966 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:39:57.967 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:57.967 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18743 2024-09-13T06:39:57.967 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:57.967 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:39:57.967 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:57.967 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:39:57.967 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.858012+0000", 2024-09-13T06:39:57.967 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:57.967 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:57.967 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:57.967 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:39:57.967 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.858012+0000", 2024-09-13T06:39:57.967 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:57.968 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:57.968 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:57.968 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:39:57.968 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.858011+0000", 2024-09-13T06:39:57.968 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:39:57.968 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:57.968 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:57.968 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:39:57.968 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.858016+0000", 2024-09-13T06:39:57.968 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0659999999999997e-06 2024-09-13T06:39:57.968 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:57.968 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:57.968 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:39:57.969 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.858024+0000", 2024-09-13T06:39:57.969 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.7700000000000007e-06 2024-09-13T06:39:57.969 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:57.969 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:57.969 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:39:57.969 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.858032+0000", 2024-09-13T06:39:57.969 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.7700000000000001e-06 2024-09-13T06:39:57.969 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:57.969 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:57.969 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:39:57.969 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.959850+0000", 2024-09-13T06:39:57.969 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.1018182 2024-09-13T06:39:57.969 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:57.970 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:57.970 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:39:57.970 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.959964+0000", 2024-09-13T06:39:57.970 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00011413600000000001 2024-09-13T06:39:57.970 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:57.970 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:57.970 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:39:57.970 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.960113+0000", 2024-09-13T06:39:57.970 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00014813900000000001 2024-09-13T06:39:57.970 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:57.970 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:39:57.970 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:57.970 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:57.970 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:57.971 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18755 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 4751360~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:39:57.971 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.862061+0000", 2024-09-13T06:39:57.971 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 6.0719026960000004, 2024-09-13T06:39:57.971 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101907023, 2024-09-13T06:39:57.971 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:39:57.971 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:39:57.971 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:39:57.971 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:39:57.971 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:57.971 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18755 2024-09-13T06:39:57.971 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:57.971 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:39:57.972 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:57.972 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:39:57.972 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862061+0000", 2024-09-13T06:39:57.972 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:57.972 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:57.972 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:57.972 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:39:57.972 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862061+0000", 2024-09-13T06:39:57.972 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:57.972 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:57.972 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:57.972 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:39:57.972 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862060+0000", 2024-09-13T06:39:57.972 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:39:57.973 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:57.973 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:57.973 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:39:57.973 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862064+0000", 2024-09-13T06:39:57.973 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.3229999999999999e-06 2024-09-13T06:39:57.973 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:57.973 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:57.973 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:39:57.973 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862078+0000", 2024-09-13T06:39:57.973 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.433e-05 2024-09-13T06:39:57.973 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:57.973 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:57.973 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:39:57.974 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862086+0000", 2024-09-13T06:39:57.974 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.3869999999999997e-06 2024-09-13T06:39:57.974 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:57.974 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:57.974 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:39:57.974 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.963635+0000", 2024-09-13T06:39:57.974 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101549606 2024-09-13T06:39:57.974 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:57.974 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:57.975 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:39:57.976 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.963783+0000", 2024-09-13T06:39:57.976 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000147312 2024-09-13T06:39:57.976 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:57.976 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:57.976 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:39:57.976 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.963968+0000", 2024-09-13T06:39:57.976 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000185028 2024-09-13T06:39:57.976 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:57.976 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:39:57.976 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:57.976 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:57.976 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:57.977 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18756 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 4780032~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:39:57.977 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.862132+0000", 2024-09-13T06:39:57.977 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 6.0718308529999998, 2024-09-13T06:39:57.977 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.102159295, 2024-09-13T06:39:57.977 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:39:57.977 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:39:57.977 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:39:57.977 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:39:57.977 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:57.977 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18756 2024-09-13T06:39:57.977 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:57.977 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:39:57.977 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:57.978 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:39:57.978 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862132+0000", 2024-09-13T06:39:57.978 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:57.978 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:57.978 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:57.978 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:39:57.978 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862132+0000", 2024-09-13T06:39:57.978 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:57.978 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:57.978 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:57.978 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:39:57.978 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862132+0000", 2024-09-13T06:39:57.978 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:39:57.978 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:57.979 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:57.979 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:39:57.979 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862136+0000", 2024-09-13T06:39:57.979 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.9559999999999999e-06 2024-09-13T06:39:57.979 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:57.979 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:57.979 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:39:57.979 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862145+0000", 2024-09-13T06:39:57.979 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6169999999999996e-06 2024-09-13T06:39:57.979 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:57.979 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:57.979 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:39:57.980 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862153+0000", 2024-09-13T06:39:57.980 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.8359999999999992e-06 2024-09-13T06:39:57.980 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:57.980 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:57.980 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:39:57.980 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.964018+0000", 2024-09-13T06:39:57.980 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101865421 2024-09-13T06:39:57.980 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:57.980 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:57.980 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:39:57.980 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.964140+0000", 2024-09-13T06:39:57.980 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000121172 2024-09-13T06:39:57.980 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:57.981 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:57.981 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:39:57.981 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.964292+0000", 2024-09-13T06:39:57.981 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00015202600000000001 2024-09-13T06:39:57.981 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:57.981 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:39:57.981 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:57.981 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:57.981 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:57.981 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18768 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 5124096~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:39:57.981 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.866345+0000", 2024-09-13T06:39:57.981 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 6.0676185460000003, 2024-09-13T06:39:57.981 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101779361, 2024-09-13T06:39:57.982 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:39:57.982 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:39:57.982 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:39:57.982 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:39:57.982 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:57.982 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18768 2024-09-13T06:39:57.982 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:57.982 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:39:57.982 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:57.982 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:39:57.982 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.866345+0000", 2024-09-13T06:39:57.982 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:57.982 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:57.982 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:57.983 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:39:57.983 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.866345+0000", 2024-09-13T06:39:57.983 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:57.983 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:57.983 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:57.983 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:39:57.983 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.866344+0000", 2024-09-13T06:39:57.983 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:39:57.983 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:57.984 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:57.984 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:39:57.984 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.866348+0000", 2024-09-13T06:39:57.984 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.4300000000000002e-06 2024-09-13T06:39:57.984 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:57.984 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:57.984 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:39:57.984 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.866356+0000", 2024-09-13T06:39:57.984 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.5930000000000006e-06 2024-09-13T06:39:57.984 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:57.984 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:57.984 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:39:57.985 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.866364+0000", 2024-09-13T06:39:57.985 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5599999999999996e-06 2024-09-13T06:39:57.985 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:57.985 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:57.985 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:39:57.985 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.967865+0000", 2024-09-13T06:39:57.985 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101501683 2024-09-13T06:39:57.985 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:57.985 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:57.985 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:39:57.985 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.967981+0000", 2024-09-13T06:39:57.985 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000115643 2024-09-13T06:39:57.986 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:57.986 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:57.986 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:39:57.986 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.968124+0000", 2024-09-13T06:39:57.986 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00014305500000000001 2024-09-13T06:39:57.986 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:57.986 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:39:57.986 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:57.986 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:57.986 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:57.986 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18779 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 5439488~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:39:57.986 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.869996+0000", 2024-09-13T06:39:57.986 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 6.0639676610000004, 2024-09-13T06:39:57.987 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10189577399999999, 2024-09-13T06:39:57.987 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:39:57.987 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:39:57.987 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:39:57.987 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:39:57.987 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:57.987 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18779 2024-09-13T06:39:57.987 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:57.987 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:39:57.987 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:57.987 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:39:57.987 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.869996+0000", 2024-09-13T06:39:57.987 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:57.987 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:57.988 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:57.988 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:39:57.988 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.869996+0000", 2024-09-13T06:39:57.988 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:57.988 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:57.988 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:57.988 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:39:57.988 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.869995+0000", 2024-09-13T06:39:57.988 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:39:57.988 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:57.988 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:57.988 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:39:57.989 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.869998+0000", 2024-09-13T06:39:57.989 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.2729999999999998e-06 2024-09-13T06:39:57.989 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:57.989 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:57.989 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:39:57.989 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.870007+0000", 2024-09-13T06:39:57.989 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.5760000000000006e-06 2024-09-13T06:39:57.989 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:57.989 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:57.989 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:39:57.989 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.870014+0000", 2024-09-13T06:39:57.989 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.1400000000000002e-06 2024-09-13T06:39:57.989 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:57.990 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:57.990 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:39:57.990 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.971631+0000", 2024-09-13T06:39:57.990 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101617503 2024-09-13T06:39:57.990 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:57.990 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:57.990 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:39:57.990 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.971747+0000", 2024-09-13T06:39:57.990 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00011599600000000001 2024-09-13T06:39:57.990 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:57.990 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:57.990 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:39:57.990 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.971891+0000", 2024-09-13T06:39:57.991 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000143912 2024-09-13T06:39:57.991 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:57.991 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:39:57.991 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:57.991 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:57.991 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:57.991 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18792 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 5812224~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:39:57.991 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.874371+0000", 2024-09-13T06:39:57.991 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 6.0595925309999998, 2024-09-13T06:39:57.991 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101736005, 2024-09-13T06:39:57.991 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:39:57.991 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:39:57.991 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:39:57.991 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:39:57.992 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:57.992 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18792 2024-09-13T06:39:57.992 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:57.992 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:39:57.992 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:57.992 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:39:57.992 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874371+0000", 2024-09-13T06:39:57.992 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:57.992 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:57.992 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:57.992 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:39:57.992 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874371+0000", 2024-09-13T06:39:57.993 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:57.993 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:57.993 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:57.993 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:39:57.993 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874370+0000", 2024-09-13T06:39:57.993 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:39:57.993 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:57.993 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:57.993 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:39:57.993 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874374+0000", 2024-09-13T06:39:57.993 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.7239999999999998e-06 2024-09-13T06:39:57.993 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:57.994 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:57.994 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:39:57.994 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874385+0000", 2024-09-13T06:39:57.994 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1293e-05 2024-09-13T06:39:57.994 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:57.994 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:57.994 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:39:57.994 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874394+0000", 2024-09-13T06:39:57.994 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.0729999999999994e-06 2024-09-13T06:39:57.994 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:57.994 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:57.994 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:39:57.994 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.975850+0000", 2024-09-13T06:39:57.994 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10145599700000001 2024-09-13T06:39:57.995 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:57.995 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:57.995 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:39:57.995 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.975963+0000", 2024-09-13T06:39:57.995 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000112689 2024-09-13T06:39:57.995 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:57.995 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:57.995 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:39:57.995 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.976107+0000", 2024-09-13T06:39:57.995 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000143836 2024-09-13T06:39:57.995 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:57.995 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:39:57.995 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:57.996 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:57.996 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:57.996 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18793 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 5840896~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:39:57.996 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.874401+0000", 2024-09-13T06:39:57.996 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 6.059562498, 2024-09-13T06:39:57.996 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.102005516, 2024-09-13T06:39:57.996 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:39:57.996 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:39:57.996 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:39:57.996 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:39:57.996 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:57.996 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18793 2024-09-13T06:39:57.996 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:57.997 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:39:57.997 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:57.997 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:39:57.997 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874401+0000", 2024-09-13T06:39:57.997 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:57.997 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:57.997 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:57.997 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:39:57.997 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874401+0000", 2024-09-13T06:39:57.997 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:57.997 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:57.997 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:57.997 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:39:57.998 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874400+0000", 2024-09-13T06:39:57.998 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:39:57.998 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:57.998 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:57.998 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:39:57.998 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874404+0000", 2024-09-13T06:39:57.998 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0069999999999999e-06 2024-09-13T06:39:57.998 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:57.998 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:57.998 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:39:57.998 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874412+0000", 2024-09-13T06:39:57.998 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.5399999999999996e-06 2024-09-13T06:39:57.998 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:57.999 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:57.999 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:39:57.999 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874420+0000", 2024-09-13T06:39:57.999 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.6199999999999999e-06 2024-09-13T06:39:57.999 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:57.999 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:57.999 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:39:57.999 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.976150+0000", 2024-09-13T06:39:57.999 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101729874 2024-09-13T06:39:57.999 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:57.999 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:57.999 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:39:57.999 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.976261+0000", 2024-09-13T06:39:57.999 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000110819 2024-09-13T06:39:58.000 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:58.000 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:58.000 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:39:58.000 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.976406+0000", 2024-09-13T06:39:58.000 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000145489 2024-09-13T06:39:58.000 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:58.000 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:39:58.000 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:58.000 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:58.000 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:58.000 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18803 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 6127616~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:39:58.000 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.877851+0000", 2024-09-13T06:39:58.000 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 6.0561120050000001, 2024-09-13T06:39:58.001 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101951584, 2024-09-13T06:39:58.001 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:39:58.001 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:39:58.001 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:39:58.001 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:39:58.001 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:58.001 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18803 2024-09-13T06:39:58.001 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:58.001 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:39:58.001 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:58.001 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:39:58.001 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.877851+0000", 2024-09-13T06:39:58.001 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:58.002 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:58.002 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:58.002 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:39:58.002 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.877851+0000", 2024-09-13T06:39:58.002 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:58.002 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:58.002 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:58.002 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:39:58.002 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.877851+0000", 2024-09-13T06:39:58.002 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:39:58.002 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:58.002 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:58.002 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:39:58.003 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.877854+0000", 2024-09-13T06:39:58.003 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.7929999999999999e-06 2024-09-13T06:39:58.003 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:58.003 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:58.003 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:39:58.003 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.877864+0000", 2024-09-13T06:39:58.003 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.2029999999999998e-06 2024-09-13T06:39:58.003 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:58.003 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:58.003 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:39:58.003 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.877873+0000", 2024-09-13T06:39:58.003 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.0440000000000001e-06 2024-09-13T06:39:58.003 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:58.003 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:58.004 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:39:58.004 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.979544+0000", 2024-09-13T06:39:58.004 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101671198 2024-09-13T06:39:58.004 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:58.004 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:58.004 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:39:58.004 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.979658+0000", 2024-09-13T06:39:58.004 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000114456 2024-09-13T06:39:58.004 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:58.004 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:58.004 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:39:58.004 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.979803+0000", 2024-09-13T06:39:58.004 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000144506 2024-09-13T06:39:58.005 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:58.005 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:39:58.005 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:58.005 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:58.005 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:58.005 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18807 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 6242304~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:39:58.005 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.879235+0000", 2024-09-13T06:39:58.005 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 6.0547279749999996, 2024-09-13T06:39:58.005 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101781258, 2024-09-13T06:39:58.005 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:39:58.005 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:39:58.005 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:39:58.005 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:39:58.006 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:58.006 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18807 2024-09-13T06:39:58.006 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:58.006 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:39:58.006 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:58.006 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:39:58.006 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879235+0000", 2024-09-13T06:39:58.006 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:58.006 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:58.006 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:58.006 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:39:58.006 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879235+0000", 2024-09-13T06:39:58.006 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:58.006 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:58.007 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:58.007 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:39:58.007 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879235+0000", 2024-09-13T06:39:58.007 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:39:58.007 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:58.007 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:58.007 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:39:58.007 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879239+0000", 2024-09-13T06:39:58.007 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.963e-06 2024-09-13T06:39:58.007 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:58.007 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:58.007 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:39:58.007 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879247+0000", 2024-09-13T06:39:58.008 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6470000000000004e-06 2024-09-13T06:39:58.008 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:58.008 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:58.008 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:39:58.008 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879255+0000", 2024-09-13T06:39:58.008 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5429999999999996e-06 2024-09-13T06:39:58.008 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:58.008 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:58.008 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:39:58.008 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.980756+0000", 2024-09-13T06:39:58.008 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10150165999999999 2024-09-13T06:39:58.008 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:58.008 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:58.008 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:39:58.009 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.980868+0000", 2024-09-13T06:39:58.009 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000111196 2024-09-13T06:39:58.009 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:58.009 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:58.009 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:39:58.009 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.981017+0000", 2024-09-13T06:39:58.009 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000148846 2024-09-13T06:39:58.009 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:58.009 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:39:58.009 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:58.009 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:58.009 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:58.009 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18808 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 6270976~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:39:58.009 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.879261+0000", 2024-09-13T06:39:58.009 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 6.0547018359999996, 2024-09-13T06:39:58.010 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.102057547, 2024-09-13T06:39:58.010 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:39:58.010 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:39:58.010 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:39:58.010 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:39:58.010 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:58.010 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18808 2024-09-13T06:39:58.010 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:58.010 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:39:58.010 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:58.010 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:39:58.010 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879261+0000", 2024-09-13T06:39:58.010 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:58.010 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:58.010 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:58.011 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:39:58.011 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879261+0000", 2024-09-13T06:39:58.011 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:58.011 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:58.011 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:58.011 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:39:58.011 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879261+0000", 2024-09-13T06:39:58.011 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:39:58.011 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:58.011 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:58.011 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:39:58.011 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879264+0000", 2024-09-13T06:39:58.011 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.523e-06 2024-09-13T06:39:58.011 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:58.011 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:58.012 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:39:58.012 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879273+0000", 2024-09-13T06:39:58.012 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6070000000000008e-06 2024-09-13T06:39:58.012 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:58.012 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:58.012 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:39:58.012 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879280+0000", 2024-09-13T06:39:58.012 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.4699999999999996e-06 2024-09-13T06:39:58.012 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:58.012 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:58.012 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:39:58.012 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.981060+0000", 2024-09-13T06:39:58.012 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10177934800000001 2024-09-13T06:39:58.012 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:58.013 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:58.013 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:39:58.013 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.981174+0000", 2024-09-13T06:39:58.013 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000114456 2024-09-13T06:39:58.013 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:58.013 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:58.013 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:39:58.013 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.981319+0000", 2024-09-13T06:39:58.013 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00014473900000000001 2024-09-13T06:39:58.013 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:58.013 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:39:58.013 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:58.013 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:58.013 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:58.014 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18810 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 2662400~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:39:58.014 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.880386+0000", 2024-09-13T06:39:58.014 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 6.0535776739999996, 2024-09-13T06:39:58.014 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101728022, 2024-09-13T06:39:58.014 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:39:58.014 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:39:58.014 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:39:58.014 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:39:58.014 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:58.014 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18810 2024-09-13T06:39:58.014 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:58.014 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:39:58.014 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:58.014 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:39:58.015 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880386+0000", 2024-09-13T06:39:58.015 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:58.015 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:58.015 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:58.015 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:39:58.015 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880386+0000", 2024-09-13T06:39:58.015 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:58.015 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:58.015 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:58.015 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:39:58.015 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880385+0000", 2024-09-13T06:39:58.015 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:39:58.015 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:58.016 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:58.016 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:39:58.016 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880389+0000", 2024-09-13T06:39:58.016 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.8539999999999999e-06 2024-09-13T06:39:58.016 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:58.016 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:58.016 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:39:58.016 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880398+0000", 2024-09-13T06:39:58.016 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.1689999999999998e-06 2024-09-13T06:39:58.016 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:58.016 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:58.016 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:39:58.016 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880405+0000", 2024-09-13T06:39:58.017 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5700000000000004e-06 2024-09-13T06:39:58.017 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:58.017 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:58.017 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:39:58.017 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.981833+0000", 2024-09-13T06:39:58.017 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10142791800000001 2024-09-13T06:39:58.017 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:58.017 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:58.017 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:39:58.017 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.981973+0000", 2024-09-13T06:39:58.017 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00014002900000000001 2024-09-13T06:39:58.017 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:58.018 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:58.018 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:39:58.018 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.982114+0000", 2024-09-13T06:39:58.018 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000140276 2024-09-13T06:39:58.018 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:58.018 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:39:58.018 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:58.018 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:58.018 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:58.018 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18811 3.9 3.140f5209 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:39:58.018 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.880449+0000", 2024-09-13T06:39:58.018 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 6.0535142979999996, 2024-09-13T06:39:58.018 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101739355, 2024-09-13T06:39:58.018 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:39:58.019 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:39:58.019 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:39:58.019 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:39:58.019 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:58.019 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18811 2024-09-13T06:39:58.019 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:58.019 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:39:58.019 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:58.019 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:39:58.019 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880449+0000", 2024-09-13T06:39:58.019 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:58.019 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:58.019 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:58.020 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:39:58.020 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880449+0000", 2024-09-13T06:39:58.020 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:58.020 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:58.020 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:58.020 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:39:58.020 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880448+0000", 2024-09-13T06:39:58.020 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:39:58.020 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:58.020 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:58.020 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:39:58.020 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880452+0000", 2024-09-13T06:39:58.020 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0470000000000004e-06 2024-09-13T06:39:58.020 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:58.020 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:58.021 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:39:58.021 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880462+0000", 2024-09-13T06:39:58.021 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6530000000000006e-06 2024-09-13T06:39:58.021 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:58.021 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:58.021 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:39:58.021 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880472+0000", 2024-09-13T06:39:58.021 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0027000000000001e-05 2024-09-13T06:39:58.021 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:58.021 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:58.021 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:39:58.021 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.982172+0000", 2024-09-13T06:39:58.021 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10170043500000001 2024-09-13T06:39:58.022 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:58.022 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:58.022 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:39:58.022 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.982188+0000", 2024-09-13T06:39:58.022 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6172999999999999e-05 2024-09-13T06:39:58.022 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:58.022 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:39:58.022 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:58.022 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:58.022 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:58.022 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18812 3.9 3.140f5209 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:39:58.022 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.880478+0000", 2024-09-13T06:39:58.022 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 6.0534850609999999, 2024-09-13T06:39:58.022 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10177795100000001, 2024-09-13T06:39:58.023 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:39:58.023 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:39:58.023 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:39:58.023 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:39:58.023 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:58.023 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18812 2024-09-13T06:39:58.023 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:58.023 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:39:58.023 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:58.023 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:39:58.023 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880478+0000", 2024-09-13T06:39:58.023 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:58.023 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:58.023 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:58.024 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:39:58.024 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880478+0000", 2024-09-13T06:39:58.024 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:58.024 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:58.024 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:58.024 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:39:58.024 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880477+0000", 2024-09-13T06:39:58.024 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:39:58.024 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:58.024 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:58.024 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:39:58.024 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880481+0000", 2024-09-13T06:39:58.024 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.827e-06 2024-09-13T06:39:58.025 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:58.025 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:58.025 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:39:58.025 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880490+0000", 2024-09-13T06:39:58.025 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6100000000000006e-06 2024-09-13T06:39:58.025 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:58.025 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:58.025 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:39:58.025 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880497+0000", 2024-09-13T06:39:58.025 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.7030000000000006e-06 2024-09-13T06:39:58.025 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:58.025 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:58.025 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:39:58.026 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.982241+0000", 2024-09-13T06:39:58.026 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10174351199999999 2024-09-13T06:39:58.026 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:58.026 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:58.026 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:39:58.026 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.982256+0000", 2024-09-13T06:39:58.026 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5143000000000001e-05 2024-09-13T06:39:58.026 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:58.026 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:39:58.026 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:58.026 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:58.026 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:39:58.026 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:39:58.028 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-13T06:39:58.028 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:39:58.029+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:39:58.129 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:39:58.129+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:39:58.193 INFO:teuthology.orchestra.run.smithi081.stdout:761 write 0xae02c91 thru 0xae0a327 (0x7697 bytes) 2024-09-13T06:39:58.207 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:39:58.208 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [ 2024-09-13T06:39:58.208 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:58.208 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:34653 3.5 3:a72a1f82:::rbd_data.11219660270d.00000000000000b2:head [set-alloc-hint object_size 1048576 write_size 1048576,write 409600~9000 in=9000b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-13T06:39:58.208 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:58.211561+0000", 2024-09-13T06:39:58.208 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0014093949999999999, 2024-09-13T06:39:58.208 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0014580490000000001, 2024-09-13T06:39:58.208 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:39:58.208 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "waiting for sub ops", 2024-09-13T06:39:58.208 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:39:58.208 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:39:58.208 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:58.209 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 34653 2024-09-13T06:39:58.209 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:58.209 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:39:58.209 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:58.209 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:39:58.209 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:58.211561+0000", 2024-09-13T06:39:58.209 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:58.209 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:58.209 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:58.209 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:39:58.209 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:58.211561+0000", 2024-09-13T06:39:58.209 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:58.209 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:58.210 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:58.210 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:39:58.210 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:58.211559+0000", 2024-09-13T06:39:58.210 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999976 2024-09-13T06:39:58.210 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:58.210 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:58.210 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:39:58.210 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:58.211589+0000", 2024-09-13T06:39:58.210 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.9989e-05 2024-09-13T06:39:58.210 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:58.210 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:58.210 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:39:58.210 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:58.211620+0000", 2024-09-13T06:39:58.210 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.1198999999999997e-05 2024-09-13T06:39:58.211 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:58.211 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:58.211 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:39:58.211 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:58.211639+0000", 2024-09-13T06:39:58.211 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.8722000000000001e-05 2024-09-13T06:39:58.211 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:58.211 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:58.211 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:39:58.211 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:58.211699+0000", 2024-09-13T06:39:58.211 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.0769e-05 2024-09-13T06:39:58.211 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:58.211 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:58.211 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:39:58.211 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:58.211830+0000", 2024-09-13T06:39:58.211 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000130662 2024-09-13T06:39:58.212 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:58.212 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:58.212 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 3", 2024-09-13T06:39:58.212 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:58.211970+0000", 2024-09-13T06:39:58.212 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000140323 2024-09-13T06:39:58.212 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:58.212 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:39:58.212 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:58.212 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:58.212 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:58.212 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop_reply(client.4385.0:34653 3.5 e48/21 ondisk, result = 0)", 2024-09-13T06:39:58.212 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:58.212990+0000", 2024-09-13T06:39:58.212 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 4294967295.9999809, 2024-09-13T06:39:58.212 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00024514799999999999, 2024-09-13T06:39:58.213 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:39:58.213 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:39:58.213 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:39:58.213 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:58.213 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:39:58.213 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:58.212990+0000", 2024-09-13T06:39:58.213 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:58.213 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:58.213 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:58.213 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:39:58.213 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:58.212990+0000", 2024-09-13T06:39:58.213 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:58.213 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:58.214 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:58.214 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:39:58.214 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:58.212988+0000", 2024-09-13T06:39:58.214 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999981 2024-09-13T06:39:58.214 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:58.214 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:58.214 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:39:58.214 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:58.213001+0000", 2024-09-13T06:39:58.214 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2985e-05 2024-09-13T06:39:58.214 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:58.214 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:58.214 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:39:58.214 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:58.213034+0000", 2024-09-13T06:39:58.214 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.3179000000000002e-05 2024-09-13T06:39:58.215 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:58.215 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:58.215 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:39:58.215 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:58.213051+0000", 2024-09-13T06:39:58.215 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7331999999999999e-05 2024-09-13T06:39:58.215 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:58.215 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:58.215 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:39:58.215 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:58.213115+0000", 2024-09-13T06:39:58.215 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.3523999999999997e-05 2024-09-13T06:39:58.215 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:58.215 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:58.215 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:39:58.215 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:58.213120+0000", 2024-09-13T06:39:58.216 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.2789999999999998e-06 2024-09-13T06:39:58.216 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:58.216 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:58.216 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:39:58.216 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:58.213235+0000", 2024-09-13T06:39:58.216 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000114819 2024-09-13T06:39:58.216 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:58.216 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:39:58.216 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:58.216 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:58.216 INFO:teuthology.orchestra.run.smithi139.stdout: ], 2024-09-13T06:39:58.216 INFO:teuthology.orchestra.run.smithi139.stdout: "num_ops": 2 2024-09-13T06:39:58.216 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:39:58.217 INFO:teuthology.orchestra.run.smithi081.stdout:762 read 0x7b5b1d3 thru 0x7b66d31 (0xbb5f bytes) 2024-09-13T06:39:58.217 INFO:teuthology.orchestra.run.smithi081.stdout:764 writesame 0x91a7017 thru 0x91b4274 data_size 0x1(0xd25e bytes) 2024-09-13T06:39:58.228 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-13T06:39:58.230 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:39:58.231+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:39:58.250 INFO:teuthology.orchestra.run.smithi081.stdout:765 write 0xd29137d thru 0xd29d1aa (0xbe2e bytes) 2024-09-13T06:39:58.262 INFO:teuthology.orchestra.run.smithi081.stdout:766 write 0x241f0ea thru 0x2420959 (0x1870 bytes) 2024-09-13T06:39:58.265 INFO:teuthology.orchestra.run.smithi081.stdout:769 writesame 0xc70f24d thru 0xc7113c4 data_size 0x18(0x2178 bytes) 2024-09-13T06:39:58.279 INFO:teuthology.orchestra.run.smithi081.stdout:770 trunc from 0xd29d1ab to 0x610d3c5 2024-09-13T06:39:58.317 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-13T06:39:58.320 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:39:58.320 INFO:teuthology.orchestra.run.smithi081.stdout:772 write 0x1e1e345 thru 0x1e26900 (0x85bc bytes) 2024-09-13T06:39:58.321 INFO:teuthology.orchestra.run.smithi081.stdout:773 read 0x130dd14 thru 0x1314283 (0x6570 bytes) 2024-09-13T06:39:58.322 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:39:58.330 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:39:58.331+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:39:58.345 INFO:teuthology.orchestra.run.smithi081.stdout:776 writesame 0xd695e47 thru 0xd6a3d0e data_size 0x4(0xdec8 bytes) 2024-09-13T06:39:58.346 INFO:teuthology.orchestra.run.smithi081.stdout:777 writesame 0x91ee52e thru 0x91efb23 data_size 0x6(0x15f6 bytes) 2024-09-13T06:39:58.350 INFO:teuthology.orchestra.run.smithi081.stdout:778 write 0x196de thru 0x1f7d8 (0x60fb bytes) 2024-09-13T06:39:58.353 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:39:58.353 INFO:teuthology.orchestra.run.smithi081.stdout:781 write 0x38c82aa thru 0x38d43ea (0xc141 bytes) 2024-09-13T06:39:58.365 INFO:teuthology.orchestra.run.smithi081.stdout:782 read 0x936500b thru 0x9369150 (0x4146 bytes) 2024-09-13T06:39:58.374 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-13T06:39:58.377 INFO:teuthology.orchestra.run.smithi081.stdout:783 trunc from 0xd6a3d0f to 0x65816ef 2024-09-13T06:39:58.389 INFO:teuthology.orchestra.run.smithi081.stdout:785 read 0x4fa664d thru 0x4fa9daa (0x375e bytes) 2024-09-13T06:39:58.389 INFO:teuthology.orchestra.run.smithi081.stdout:786 punch from 0x28c034f to 0x28c92e0, (0x8f91 bytes) 2024-09-13T06:39:58.390 INFO:teuthology.orchestra.run.smithi081.stdout:787 punch from 0x20f8ea2 to 0x21082b7, (0xf415 bytes) 2024-09-13T06:39:58.390 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:39:58.397 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:39:58.397 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [], 2024-09-13T06:39:58.397 INFO:teuthology.orchestra.run.smithi139.stdout: "complaint_time": 30, 2024-09-13T06:39:58.397 INFO:teuthology.orchestra.run.smithi139.stdout: "num_blocked_ops": 0 2024-09-13T06:39:58.397 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:39:58.401 INFO:teuthology.orchestra.run.smithi081.stdout:790 write 0x9218d97 thru 0x922185e (0x8ac8 bytes) 2024-09-13T06:39:58.406 INFO:teuthology.orchestra.run.smithi081.stdout:791 read 0x2fe3f3d thru 0x2fe4729 (0x7ed bytes) 2024-09-13T06:39:58.413 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-13T06:39:58.413 INFO:teuthology.orchestra.run.smithi081.stdout:792 write 0x95e480f thru 0x95e54b5 (0xca7 bytes) 2024-09-13T06:39:58.425 INFO:teuthology.orchestra.run.smithi081.stdout:793 trunc from 0x95e54b6 to 0x499264f 2024-09-13T06:39:58.454 INFO:teuthology.orchestra.run.smithi081.stdout:794 trunc from 0x499264f to 0x9f2929e 2024-09-13T06:39:58.461 INFO:teuthology.orchestra.run.smithi081.stdout:795 write 0x2ae1c76 thru 0x2aec053 (0xa3de bytes) 2024-09-13T06:39:58.464 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:39:58.465+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:39:58.464 INFO:teuthology.orchestra.run.smithi081.stdout:797 write 0x4cc4a6d thru 0x4ccfd9d (0xb331 bytes) 2024-09-13T06:39:58.466 INFO:teuthology.orchestra.run.smithi081.stdout:799 read 0x4eba4f7 thru 0x4ec4fef (0xaaf9 bytes) 2024-09-13T06:39:58.476 INFO:teuthology.orchestra.run.smithi081.stdout:800 writesame 0xc92e0c9 thru 0xc92e271 data_size 0x5(0x1a9 bytes) 2024-09-13T06:39:58.476 INFO:teuthology.orchestra.run.smithi081.stdout:801 read 0x770686c thru 0x771152b (0xacc0 bytes) 2024-09-13T06:39:58.477 INFO:teuthology.orchestra.run.smithi081.stdout:802 read 0x8de00a4 thru 0x8de4b0d (0x4a6a bytes) 2024-09-13T06:39:58.480 INFO:teuthology.orchestra.run.smithi081.stdout:803 trunc from 0xc92e272 to 0x9ceecd8 2024-09-13T06:39:58.487 INFO:teuthology.orchestra.run.smithi081.stdout:805 read 0x8b5a749 thru 0x8b6a2f9 (0xfbb1 bytes) 2024-09-13T06:39:58.488 INFO:teuthology.orchestra.run.smithi081.stdout:osd.0: {} 2024-09-13T06:39:58.488 INFO:teuthology.orchestra.run.smithi081.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-13T06:39:58.492 INFO:teuthology.orchestra.run.smithi081.stdout:806 trunc from 0x9ceecd8 to 0xce996c0 2024-09-13T06:39:58.497 INFO:teuthology.orchestra.run.smithi081.stdout:808 write 0x17b2bb9 thru 0x17bde9a (0xb2e2 bytes) 2024-09-13T06:39:58.504 INFO:teuthology.orchestra.run.smithi081.stdout:809 write 0xa6163e thru 0xa64f4d (0x3910 bytes) 2024-09-13T06:39:58.506 INFO:teuthology.orchestra.run.smithi081.stdout:810 write 0x4834579 thru 0x483a267 (0x5cef bytes) 2024-09-13T06:39:58.508 INFO:teuthology.orchestra.run.smithi081.stdout:812 read 0x2f6b482 thru 0x2f76fc5 (0xbb44 bytes) 2024-09-13T06:39:58.509 INFO:teuthology.orchestra.run.smithi081.stdout:osd.1: {} 2024-09-13T06:39:58.509 INFO:teuthology.orchestra.run.smithi081.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-13T06:39:58.509 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:39:58.510 INFO:teuthology.orchestra.run.smithi081.stdout:814 read 0xabf6aa5 thru 0xabf7ca8 (0x1204 bytes) 2024-09-13T06:39:58.523 INFO:teuthology.orchestra.run.smithi081.stdout:815 trunc from 0xce996c0 to 0x337cb05 2024-09-13T06:39:58.531 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:39:58.533+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:39:58.535 INFO:teuthology.orchestra.run.smithi081.stdout:osd.2: {} 2024-09-13T06:39:58.535 INFO:teuthology.orchestra.run.smithi081.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-13T06:39:58.547 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:39:58.548 INFO:teuthology.orchestra.run.smithi139.stdout: "size": 20, 2024-09-13T06:39:58.548 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 600, 2024-09-13T06:39:58.548 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [ 2024-09-13T06:39:58.548 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:58.548 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:25884 3.1c 3:3da1e1c6:::rbd_data.1121f2c5ee81.0000000000000007:13 [read 167936~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:39:58.548 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.424614+0000", 2024-09-13T06:39:58.549 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 2.1255956170000001, 2024-09-13T06:39:58.549 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.040027199999999999, 2024-09-13T06:39:58.549 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:39:58.549 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:39:58.549 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:39:58.549 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:39:58.549 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:58.549 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 25884 2024-09-13T06:39:58.549 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:58.549 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:39:58.549 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:58.549 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:39:58.549 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.424614+0000", 2024-09-13T06:39:58.549 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:58.550 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:58.550 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:58.550 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:39:58.550 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.424614+0000", 2024-09-13T06:39:58.550 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:58.550 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:58.550 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:58.550 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:39:58.550 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.424613+0000", 2024-09-13T06:39:58.550 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:39:58.550 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:58.550 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:58.550 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:39:58.551 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.424619+0000", 2024-09-13T06:39:58.551 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.6149999999999996e-06 2024-09-13T06:39:58.551 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:58.551 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:58.551 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:39:58.551 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.424629+0000", 2024-09-13T06:39:58.551 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0145e-05 2024-09-13T06:39:58.551 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:58.551 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:58.551 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:39:58.551 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.424635+0000", 2024-09-13T06:39:58.551 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.0039999999999996e-06 2024-09-13T06:39:58.551 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:58.552 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:58.552 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:39:58.552 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.464196+0000", 2024-09-13T06:39:58.552 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039561116 2024-09-13T06:39:58.552 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:58.553 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:58.553 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:39:58.553 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.464257+0000", 2024-09-13T06:39:58.553 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.1215000000000003e-05 2024-09-13T06:39:58.553 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:58.553 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:58.553 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:39:58.553 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.464641+0000", 2024-09-13T06:39:58.553 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00038401199999999998 2024-09-13T06:39:58.553 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:58.553 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:39:58.553 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:58.554 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:58.554 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:58.554 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:25885 3.1c 3:3da1e1c6:::rbd_data.1121f2c5ee81.0000000000000007:13 [read 212992~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:39:58.554 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.424640+0000", 2024-09-13T06:39:58.554 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 2.1255696159999999, 2024-09-13T06:39:58.554 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.040449289999999999, 2024-09-13T06:39:58.554 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:39:58.554 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:39:58.554 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:39:58.554 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:39:58.555 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:58.555 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 25885 2024-09-13T06:39:58.555 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:58.555 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:39:58.555 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:58.555 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:39:58.555 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.424640+0000", 2024-09-13T06:39:58.555 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:58.555 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:58.555 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:58.555 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:39:58.556 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.424640+0000", 2024-09-13T06:39:58.556 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:58.556 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:58.556 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:58.556 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:39:58.556 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.424640+0000", 2024-09-13T06:39:58.556 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:39:58.556 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:58.556 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:58.556 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:39:58.556 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.424643+0000", 2024-09-13T06:39:58.557 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.19e-06 2024-09-13T06:39:58.557 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:58.557 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:58.557 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:39:58.557 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.424650+0000", 2024-09-13T06:39:58.557 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.1189999999999999e-06 2024-09-13T06:39:58.557 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:58.557 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:58.557 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:39:58.557 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.424656+0000", 2024-09-13T06:39:58.558 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.7780000000000004e-06 2024-09-13T06:39:58.558 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:58.558 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:58.558 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:39:58.558 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.464699+0000", 2024-09-13T06:39:58.558 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.040043792000000002 2024-09-13T06:39:58.558 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:58.558 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:58.558 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:39:58.558 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.464800+0000", 2024-09-13T06:39:58.558 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000100278 2024-09-13T06:39:58.558 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:58.558 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:58.558 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:39:58.559 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.465089+0000", 2024-09-13T06:39:58.559 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00028969800000000002 2024-09-13T06:39:58.559 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:58.559 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:39:58.559 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:58.559 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:58.559 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:58.559 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:25886 3.1c 3:3da1e1c6:::rbd_data.1121f2c5ee81.0000000000000007:13 [read 237568~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:39:58.559 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.424661+0000", 2024-09-13T06:39:58.559 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 2.1255492519999999, 2024-09-13T06:39:58.559 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.040784316000000001, 2024-09-13T06:39:58.559 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:39:58.559 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:39:58.559 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:39:58.560 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:39:58.560 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:58.560 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 25886 2024-09-13T06:39:58.560 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:58.560 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:39:58.560 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:58.560 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:39:58.560 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.424661+0000", 2024-09-13T06:39:58.560 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:58.560 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:58.560 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:58.560 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:39:58.560 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.424661+0000", 2024-09-13T06:39:58.561 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:58.561 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:58.561 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:58.561 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:39:58.561 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.424660+0000", 2024-09-13T06:39:58.561 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:39:58.561 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:58.561 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:58.561 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:39:58.561 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.424672+0000", 2024-09-13T06:39:58.561 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1578e-05 2024-09-13T06:39:58.561 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:58.562 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:58.562 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:39:58.562 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.424680+0000", 2024-09-13T06:39:58.562 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.9489999999999996e-06 2024-09-13T06:39:58.562 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:58.562 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:58.562 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:39:58.562 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.424689+0000", 2024-09-13T06:39:58.563 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.0790000000000007e-06 2024-09-13T06:39:58.563 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:58.563 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:58.563 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:39:58.563 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.465128+0000", 2024-09-13T06:39:58.563 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.040438922000000002 2024-09-13T06:39:58.563 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:58.563 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:58.563 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:39:58.564 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.465210+0000", 2024-09-13T06:39:58.564 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.2853000000000001e-05 2024-09-13T06:39:58.564 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:58.564 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:58.564 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:39:58.564 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.465445+0000", 2024-09-13T06:39:58.564 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000234453 2024-09-13T06:39:58.564 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:58.564 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:39:58.564 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:58.564 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:58.565 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:58.565 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:25887 3.1c 3:3da1e1c6:::rbd_data.1121f2c5ee81.0000000000000007:13 [read 307200~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:39:58.565 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.425137+0000", 2024-09-13T06:39:58.565 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 2.1250729310000001, 2024-09-13T06:39:58.565 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.040764531, 2024-09-13T06:39:58.565 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:39:58.565 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:39:58.565 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:39:58.565 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:39:58.566 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:58.566 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 25887 2024-09-13T06:39:58.566 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:58.566 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:39:58.566 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:58.566 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:39:58.566 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.425137+0000", 2024-09-13T06:39:58.566 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:58.566 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:58.566 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:58.567 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:39:58.567 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.425137+0000", 2024-09-13T06:39:58.567 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:58.567 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:58.567 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:58.567 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:39:58.567 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.425135+0000", 2024-09-13T06:39:58.567 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999986 2024-09-13T06:39:58.568 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:58.568 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:58.568 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:39:58.568 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.425160+0000", 2024-09-13T06:39:58.568 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.4423999999999999e-05 2024-09-13T06:39:58.568 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:58.568 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:58.568 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:39:58.568 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.425186+0000", 2024-09-13T06:39:58.568 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.6329000000000002e-05 2024-09-13T06:39:58.569 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:58.569 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:58.569 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:39:58.569 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.425201+0000", 2024-09-13T06:39:58.569 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5048000000000001e-05 2024-09-13T06:39:58.569 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:58.569 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:58.569 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:39:58.569 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.465483+0000", 2024-09-13T06:39:58.569 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.040281381999999998 2024-09-13T06:39:58.569 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:58.569 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:58.569 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:39:58.570 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.465575+0000", 2024-09-13T06:39:58.570 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.2794000000000006e-05 2024-09-13T06:39:58.570 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:58.570 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:58.570 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:39:58.570 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.465901+0000", 2024-09-13T06:39:58.570 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00032604900000000002 2024-09-13T06:39:58.570 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:58.570 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:39:58.570 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:58.570 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:58.570 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:58.571 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:25888 3.1c 3:3da1e1c6:::rbd_data.1121f2c5ee81.0000000000000007:13 [read 331776~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:39:58.571 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.425217+0000", 2024-09-13T06:39:58.571 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 2.1249931850000001, 2024-09-13T06:39:58.571 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.041115250999999998, 2024-09-13T06:39:58.571 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:39:58.571 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:39:58.571 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:39:58.571 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:39:58.571 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:58.571 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 25888 2024-09-13T06:39:58.571 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:58.571 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:39:58.572 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:58.572 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:39:58.572 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.425217+0000", 2024-09-13T06:39:58.572 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:58.572 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:58.572 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:58.572 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:39:58.572 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.425217+0000", 2024-09-13T06:39:58.572 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:58.572 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:58.572 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:58.572 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:39:58.572 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.425215+0000", 2024-09-13T06:39:58.573 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:39:58.573 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:58.573 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:58.573 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:39:58.573 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.425222+0000", 2024-09-13T06:39:58.573 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.5830000000000003e-06 2024-09-13T06:39:58.573 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:58.573 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:58.573 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:39:58.573 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.425240+0000", 2024-09-13T06:39:58.573 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7914000000000002e-05 2024-09-13T06:39:58.573 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:58.573 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:58.573 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:39:58.574 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.425252+0000", 2024-09-13T06:39:58.574 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2170999999999999e-05 2024-09-13T06:39:58.574 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:58.574 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:58.574 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:39:58.574 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.465947+0000", 2024-09-13T06:39:58.574 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.040694755999999999 2024-09-13T06:39:58.574 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:58.574 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:58.574 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:39:58.574 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.466065+0000", 2024-09-13T06:39:58.574 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000117669 2024-09-13T06:39:58.574 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:58.574 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:58.575 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:39:58.575 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.466332+0000", 2024-09-13T06:39:58.575 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00026730500000000002 2024-09-13T06:39:58.575 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:58.575 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:39:58.575 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:58.575 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:58.575 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:58.575 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:25889 3.1c 3:3da1e1c6:::rbd_data.1121f2c5ee81.0000000000000007:13 [read 376832~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:39:58.575 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.425262+0000", 2024-09-13T06:39:58.575 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 2.1249472730000001, 2024-09-13T06:39:58.575 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.041487885000000002, 2024-09-13T06:39:58.576 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:39:58.576 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:39:58.576 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:39:58.576 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:39:58.576 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:58.576 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 25889 2024-09-13T06:39:58.576 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:58.576 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:39:58.576 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:58.576 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:39:58.576 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.425262+0000", 2024-09-13T06:39:58.576 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:58.576 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:58.577 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:58.577 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:39:58.577 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.425262+0000", 2024-09-13T06:39:58.577 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:58.577 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:58.577 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:58.577 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:39:58.577 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.425262+0000", 2024-09-13T06:39:58.577 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:39:58.577 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:58.577 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:58.577 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:39:58.577 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.425267+0000", 2024-09-13T06:39:58.578 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.587e-06 2024-09-13T06:39:58.578 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:58.578 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:58.578 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:39:58.578 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.425284+0000", 2024-09-13T06:39:58.578 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6858999999999999e-05 2024-09-13T06:39:58.578 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:58.578 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:58.578 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:39:58.578 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.425295+0000", 2024-09-13T06:39:58.578 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1238e-05 2024-09-13T06:39:58.578 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:58.578 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:58.579 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:39:58.579 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.466371+0000", 2024-09-13T06:39:58.579 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.041075381000000001 2024-09-13T06:39:58.579 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:58.579 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:58.579 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:39:58.579 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.466479+0000", 2024-09-13T06:39:58.579 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000108026 2024-09-13T06:39:58.579 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:58.579 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:58.579 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:39:58.579 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.466750+0000", 2024-09-13T06:39:58.579 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00027173200000000001 2024-09-13T06:39:58.580 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:58.580 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:39:58.580 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:58.580 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:58.580 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:58.580 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:25890 3.1c 3:3da1e1c6:::rbd_data.1121f2c5ee81.0000000000000007:13 [read 401408~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:39:58.580 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.425305+0000", 2024-09-13T06:39:58.580 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 2.1249047409999999, 2024-09-13T06:39:58.580 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.041642419999999999, 2024-09-13T06:39:58.580 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:39:58.580 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:39:58.580 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:39:58.580 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:39:58.581 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:58.581 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 25890 2024-09-13T06:39:58.581 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:58.581 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:39:58.581 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:58.581 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:39:58.581 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.425305+0000", 2024-09-13T06:39:58.581 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:58.581 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:58.581 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:58.581 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:39:58.581 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.425305+0000", 2024-09-13T06:39:58.582 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:58.582 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:58.582 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:58.582 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:39:58.582 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.425304+0000", 2024-09-13T06:39:58.582 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:39:58.582 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:58.582 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:58.582 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:39:58.582 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.425309+0000", 2024-09-13T06:39:58.582 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.0640000000000001e-06 2024-09-13T06:39:58.582 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:58.582 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:58.583 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:39:58.583 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.425326+0000", 2024-09-13T06:39:58.583 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6855e-05 2024-09-13T06:39:58.583 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:58.583 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:58.583 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:39:58.583 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.425346+0000", 2024-09-13T06:39:58.583 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.0387999999999999e-05 2024-09-13T06:39:58.583 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:58.583 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:58.583 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:39:58.583 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.466796+0000", 2024-09-13T06:39:58.583 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.041449062000000002 2024-09-13T06:39:58.584 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:58.584 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:58.584 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:39:58.584 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.466859+0000", 2024-09-13T06:39:58.584 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.3682000000000005e-05 2024-09-13T06:39:58.584 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:58.584 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:58.584 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:39:58.584 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.466947+0000", 2024-09-13T06:39:58.584 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.8220999999999994e-05 2024-09-13T06:39:58.584 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:58.584 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:39:58.584 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:58.584 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:58.585 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:58.585 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:25891 3.1c 3:3da1e1c6:::rbd_data.1121f2c5ee81.0000000000000007:13 [read 471040~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:39:58.585 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.425357+0000", 2024-09-13T06:39:58.585 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 2.1248528709999999, 2024-09-13T06:39:58.585 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.042016413000000002, 2024-09-13T06:39:58.585 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:39:58.585 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:39:58.585 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:39:58.585 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:39:58.586 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:58.586 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 25891 2024-09-13T06:39:58.586 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:58.586 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:39:58.586 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:58.586 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:39:58.586 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.425357+0000", 2024-09-13T06:39:58.586 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:58.586 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:58.586 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:58.586 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:39:58.586 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.425357+0000", 2024-09-13T06:39:58.586 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:58.587 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:58.587 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:58.587 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:39:58.587 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.425356+0000", 2024-09-13T06:39:58.587 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:39:58.587 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:58.587 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:58.587 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:39:58.587 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.425361+0000", 2024-09-13T06:39:58.587 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.2340000000000002e-06 2024-09-13T06:39:58.587 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:58.587 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:58.587 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:39:58.588 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.425377+0000", 2024-09-13T06:39:58.588 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6087e-05 2024-09-13T06:39:58.588 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:58.588 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:58.588 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:39:58.588 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.425391+0000", 2024-09-13T06:39:58.588 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3580999999999999e-05 2024-09-13T06:39:58.588 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:58.588 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:58.588 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:39:58.588 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.466995+0000", 2024-09-13T06:39:58.588 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.041604527000000002 2024-09-13T06:39:58.588 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:58.589 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:58.589 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:39:58.589 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.467100+0000", 2024-09-13T06:39:58.589 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00010417299999999999 2024-09-13T06:39:58.589 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:58.589 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:58.589 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:39:58.589 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.467373+0000", 2024-09-13T06:39:58.589 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00027376800000000003 2024-09-13T06:39:58.589 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:58.589 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:39:58.589 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:58.589 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:58.589 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:58.590 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:25892 3.1c 3:3da1e1c6:::rbd_data.1121f2c5ee81.0000000000000007:13 [read 495616~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:39:58.590 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.425401+0000", 2024-09-13T06:39:58.590 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 2.1248088200000002, 2024-09-13T06:39:58.590 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.042422195000000003, 2024-09-13T06:39:58.590 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:39:58.590 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:39:58.590 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:39:58.590 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:39:58.591 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:58.591 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 25892 2024-09-13T06:39:58.591 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:58.591 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:39:58.591 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:58.591 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:39:58.591 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.425401+0000", 2024-09-13T06:39:58.591 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:58.591 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:58.591 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:58.591 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:39:58.591 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.425401+0000", 2024-09-13T06:39:58.591 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:58.592 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:58.592 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:58.592 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:39:58.592 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.425400+0000", 2024-09-13T06:39:58.592 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:39:58.592 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:58.592 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:58.592 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:39:58.592 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.425405+0000", 2024-09-13T06:39:58.592 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.4389999999999999e-06 2024-09-13T06:39:58.593 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:58.593 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:58.593 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:39:58.593 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.425419+0000", 2024-09-13T06:39:58.593 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3593e-05 2024-09-13T06:39:58.593 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:58.593 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:58.593 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:39:58.593 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.425430+0000", 2024-09-13T06:39:58.594 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0774999999999999e-05 2024-09-13T06:39:58.594 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:58.594 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:58.594 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:39:58.594 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.467438+0000", 2024-09-13T06:39:58.594 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.042008570000000002 2024-09-13T06:39:58.594 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:58.594 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:58.594 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:39:58.594 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.467531+0000", 2024-09-13T06:39:58.594 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.2857999999999998e-05 2024-09-13T06:39:58.594 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:58.594 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:58.595 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:39:58.595 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.467823+0000", 2024-09-13T06:39:58.595 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000291945 2024-09-13T06:39:58.595 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:58.595 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:39:58.595 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:58.595 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:58.595 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:58.595 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:26020 3.c 3:3566b607:::rbd_data.1121f2c5ee81.0000000000000012:13 [read 155648~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:39:58.595 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.429006+0000", 2024-09-13T06:39:58.596 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 2.1212041949999998, 2024-09-13T06:39:58.596 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.040033945000000001, 2024-09-13T06:39:58.596 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:39:58.596 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:39:58.596 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:39:58.596 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:39:58.596 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:58.596 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 26020 2024-09-13T06:39:58.596 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:58.596 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:39:58.596 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:58.597 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:39:58.597 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.429006+0000", 2024-09-13T06:39:58.597 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:58.597 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:58.597 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:58.597 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:39:58.597 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.429006+0000", 2024-09-13T06:39:58.597 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:58.597 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:58.597 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:58.597 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:39:58.598 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.429005+0000", 2024-09-13T06:39:58.598 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:39:58.598 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:58.598 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:58.598 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:39:58.598 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.429010+0000", 2024-09-13T06:39:58.598 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.079e-06 2024-09-13T06:39:58.598 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:58.598 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:58.598 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:39:58.598 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.429023+0000", 2024-09-13T06:39:58.599 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3366e-05 2024-09-13T06:39:58.599 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:58.599 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:58.599 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:39:58.599 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.429033+0000", 2024-09-13T06:39:58.599 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6930000000000002e-06 2024-09-13T06:39:58.599 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:58.599 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:58.599 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:39:58.599 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.468710+0000", 2024-09-13T06:39:58.600 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039676808000000001 2024-09-13T06:39:58.600 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:58.600 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:58.600 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:39:58.600 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.468826+0000", 2024-09-13T06:39:58.600 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000116251 2024-09-13T06:39:58.600 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:58.600 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:58.600 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:39:58.601 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.469040+0000", 2024-09-13T06:39:58.601 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00021363 2024-09-13T06:39:58.601 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:58.601 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:39:58.601 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:58.601 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:58.601 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:58.601 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:26021 3.c 3:3566b607:::rbd_data.1121f2c5ee81.0000000000000012:13 [read 225280~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:39:58.601 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.429042+0000", 2024-09-13T06:39:58.602 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 2.1211678090000001, 2024-09-13T06:39:58.602 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.040384481, 2024-09-13T06:39:58.602 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:39:58.602 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:39:58.602 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:39:58.602 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:39:58.602 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:58.602 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 26021 2024-09-13T06:39:58.603 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:58.603 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:39:58.603 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:58.603 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:39:58.603 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.429042+0000", 2024-09-13T06:39:58.603 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:58.603 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:58.603 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:58.603 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:39:58.603 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.429042+0000", 2024-09-13T06:39:58.603 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:58.604 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:58.604 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:58.604 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:39:58.604 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.429041+0000", 2024-09-13T06:39:58.604 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:39:58.604 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:58.604 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:58.604 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:39:58.604 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.429046+0000", 2024-09-13T06:39:58.604 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.6600000000000003e-06 2024-09-13T06:39:58.604 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:58.604 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:58.605 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:39:58.605 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.429060+0000", 2024-09-13T06:39:58.605 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3747000000000001e-05 2024-09-13T06:39:58.605 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:58.605 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:58.605 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:39:58.605 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.429069+0000", 2024-09-13T06:39:58.605 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.5659999999999996e-06 2024-09-13T06:39:58.605 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:58.605 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:58.605 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:39:58.605 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.469091+0000", 2024-09-13T06:39:58.605 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.040021811999999997 2024-09-13T06:39:58.606 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:58.606 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:58.606 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:39:58.606 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.469170+0000", 2024-09-13T06:39:58.606 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.9498000000000004e-05 2024-09-13T06:39:58.606 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:58.606 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:58.606 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:39:58.606 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.469426+0000", 2024-09-13T06:39:58.606 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00025596800000000003 2024-09-13T06:39:58.606 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:58.606 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:39:58.606 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:58.606 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:58.607 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:58.607 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:26022 3.c 3:3566b607:::rbd_data.1121f2c5ee81.0000000000000012:13 [read 249856~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:39:58.607 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.429079+0000", 2024-09-13T06:39:58.607 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 2.1211312169999998, 2024-09-13T06:39:58.607 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.040733327, 2024-09-13T06:39:58.607 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:39:58.607 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:39:58.607 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:39:58.607 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:39:58.607 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:58.607 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 26022 2024-09-13T06:39:58.607 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:58.607 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:39:58.608 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:58.608 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:39:58.608 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.429079+0000", 2024-09-13T06:39:58.608 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:58.608 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:58.608 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:58.608 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:39:58.608 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.429079+0000", 2024-09-13T06:39:58.608 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:58.608 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:58.608 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:58.608 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:39:58.608 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.429078+0000", 2024-09-13T06:39:58.609 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:39:58.609 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:58.609 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:58.609 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:39:58.609 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.429083+0000", 2024-09-13T06:39:58.609 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.8069999999999999e-06 2024-09-13T06:39:58.609 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:58.609 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:58.609 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:39:58.609 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.429096+0000", 2024-09-13T06:39:58.609 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3665e-05 2024-09-13T06:39:58.609 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:58.609 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:58.610 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:39:58.610 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.429106+0000", 2024-09-13T06:39:58.610 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.8460000000000003e-06 2024-09-13T06:39:58.610 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:58.610 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:58.610 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:39:58.610 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.469479+0000", 2024-09-13T06:39:58.610 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.04037259 2024-09-13T06:39:58.610 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:58.610 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:58.610 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:39:58.610 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.469564+0000", 2024-09-13T06:39:58.610 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.5669999999999998e-05 2024-09-13T06:39:58.610 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:58.611 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:58.611 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:39:58.611 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.469812+0000", 2024-09-13T06:39:58.611 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00024753699999999998 2024-09-13T06:39:58.611 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:58.611 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:39:58.611 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:58.611 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:58.611 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:58.611 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:26023 3.c 3:3566b607:::rbd_data.1121f2c5ee81.0000000000000012:13 [read 294912~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:39:58.611 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.429115+0000", 2024-09-13T06:39:58.611 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 2.1210947980000001, 2024-09-13T06:39:58.611 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.041079490000000003, 2024-09-13T06:39:58.611 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:39:58.612 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:39:58.612 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:39:58.612 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:39:58.612 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:58.612 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 26023 2024-09-13T06:39:58.612 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:58.612 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:39:58.612 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:58.612 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:39:58.612 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.429115+0000", 2024-09-13T06:39:58.612 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:58.612 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:58.612 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:58.612 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:39:58.613 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.429115+0000", 2024-09-13T06:39:58.613 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:58.613 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:58.613 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:58.613 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:39:58.613 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.429114+0000", 2024-09-13T06:39:58.613 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:39:58.613 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:58.613 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:58.613 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:39:58.613 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.429119+0000", 2024-09-13T06:39:58.613 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.0189999999999997e-06 2024-09-13T06:39:58.613 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:58.614 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:58.614 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:39:58.614 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.429137+0000", 2024-09-13T06:39:58.614 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.8087000000000001e-05 2024-09-13T06:39:58.614 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:58.614 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:58.614 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:39:58.614 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.429148+0000", 2024-09-13T06:39:58.614 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0740999999999999e-05 2024-09-13T06:39:58.614 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:58.614 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:58.614 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:39:58.614 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.469861+0000", 2024-09-13T06:39:58.615 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.040713271000000002 2024-09-13T06:39:58.615 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:58.615 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:58.615 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:39:58.615 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.469954+0000", 2024-09-13T06:39:58.615 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.2917000000000005e-05 2024-09-13T06:39:58.615 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:58.615 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:58.615 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:39:58.615 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.470194+0000", 2024-09-13T06:39:58.615 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00024033099999999999 2024-09-13T06:39:58.615 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:58.615 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:39:58.616 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:58.616 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:58.616 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:58.616 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:26024 3.c 3:3566b607:::rbd_data.1121f2c5ee81.0000000000000012:13 [read 319488~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:39:58.616 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.429157+0000", 2024-09-13T06:39:58.616 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 2.1210522690000002, 2024-09-13T06:39:58.616 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.041386232000000002, 2024-09-13T06:39:58.616 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:39:58.616 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:39:58.616 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:39:58.616 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:39:58.616 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:58.616 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 26024 2024-09-13T06:39:58.616 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:58.617 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:39:58.617 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:58.617 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:39:58.617 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.429157+0000", 2024-09-13T06:39:58.617 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:58.617 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:58.617 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:58.617 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:39:58.617 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.429157+0000", 2024-09-13T06:39:58.617 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:58.617 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:58.617 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:58.617 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:39:58.617 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.429157+0000", 2024-09-13T06:39:58.618 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:39:58.618 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:58.618 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:58.618 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:39:58.618 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.429162+0000", 2024-09-13T06:39:58.618 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.3820000000000003e-06 2024-09-13T06:39:58.618 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:58.618 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:58.618 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:39:58.618 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.429175+0000", 2024-09-13T06:39:58.618 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2797e-05 2024-09-13T06:39:58.618 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:58.618 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:58.619 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:39:58.619 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.429185+0000", 2024-09-13T06:39:58.619 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0016e-05 2024-09-13T06:39:58.619 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:58.619 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:58.619 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:39:58.619 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.470233+0000", 2024-09-13T06:39:58.619 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.041047868000000001 2024-09-13T06:39:58.619 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:58.619 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:58.619 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:39:58.619 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.470280+0000", 2024-09-13T06:39:58.619 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.7422000000000001e-05 2024-09-13T06:39:58.619 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:58.620 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:58.620 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:39:58.620 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.470544+0000", 2024-09-13T06:39:58.620 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00026366399999999999 2024-09-13T06:39:58.620 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:58.620 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:39:58.620 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:58.620 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:58.620 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:58.620 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:26025 3.c 3:3566b607:::rbd_data.1121f2c5ee81.0000000000000012:13 [read 389120~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:39:58.620 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.429194+0000", 2024-09-13T06:39:58.620 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 2.1210159079999999, 2024-09-13T06:39:58.621 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.041722952000000001, 2024-09-13T06:39:58.621 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:39:58.621 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:39:58.621 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:39:58.621 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:39:58.621 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:58.621 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 26025 2024-09-13T06:39:58.621 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:58.621 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:39:58.621 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:58.621 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:39:58.621 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.429194+0000", 2024-09-13T06:39:58.621 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:58.621 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:58.622 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:58.622 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:39:58.622 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.429194+0000", 2024-09-13T06:39:58.622 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:58.622 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:58.622 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:58.622 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:39:58.622 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.429193+0000", 2024-09-13T06:39:58.622 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:39:58.622 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:58.622 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:58.622 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:39:58.622 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.429206+0000", 2024-09-13T06:39:58.623 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3008e-05 2024-09-13T06:39:58.623 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:58.623 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:58.623 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:39:58.623 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.429220+0000", 2024-09-13T06:39:58.623 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.4398e-05 2024-09-13T06:39:58.623 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:58.623 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:58.623 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:39:58.623 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.429230+0000", 2024-09-13T06:39:58.623 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.4280000000000002e-06 2024-09-13T06:39:58.623 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:58.624 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:58.624 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:39:58.624 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.470584+0000", 2024-09-13T06:39:58.624 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.041354512000000003 2024-09-13T06:39:58.624 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:58.624 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:58.624 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:39:58.624 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.470648+0000", 2024-09-13T06:39:58.624 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.3163999999999994e-05 2024-09-13T06:39:58.624 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:58.624 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:58.624 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:39:58.624 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.470917+0000", 2024-09-13T06:39:58.625 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00026928199999999997 2024-09-13T06:39:58.625 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:58.625 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:39:58.625 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:58.625 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:58.625 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:58.625 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:26026 3.c 3:3566b607:::rbd_data.1121f2c5ee81.0000000000000012:13 [read 413696~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:39:58.625 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.429240+0000", 2024-09-13T06:39:58.626 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 2.1209699199999998, 2024-09-13T06:39:58.626 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.041996092999999998, 2024-09-13T06:39:58.626 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:39:58.626 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:39:58.626 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:39:58.626 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:39:58.626 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:58.626 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 26026 2024-09-13T06:39:58.626 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:58.626 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:39:58.626 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:58.626 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:39:58.626 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.429240+0000", 2024-09-13T06:39:58.626 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:58.627 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:58.627 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:58.627 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:39:58.627 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.429240+0000", 2024-09-13T06:39:58.627 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:58.627 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:58.627 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:58.627 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:39:58.627 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.429239+0000", 2024-09-13T06:39:58.627 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:39:58.628 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:58.628 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:58.628 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:39:58.628 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.429244+0000", 2024-09-13T06:39:58.628 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.0989999999999998e-06 2024-09-13T06:39:58.628 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:58.628 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:58.628 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:39:58.628 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.429257+0000", 2024-09-13T06:39:58.628 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.296e-05 2024-09-13T06:39:58.628 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:58.628 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:58.629 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:39:58.629 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.429268+0000", 2024-09-13T06:39:58.629 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0971999999999999e-05 2024-09-13T06:39:58.629 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:58.629 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:58.629 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:39:58.629 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.470962+0000", 2024-09-13T06:39:58.629 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.041694426 2024-09-13T06:39:58.629 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:58.629 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:58.630 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:39:58.630 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.471024+0000", 2024-09-13T06:39:58.630 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.1741000000000004e-05 2024-09-13T06:39:58.630 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:58.630 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:58.630 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:39:58.630 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.471236+0000", 2024-09-13T06:39:58.630 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00021181100000000001 2024-09-13T06:39:58.630 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:58.630 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:39:58.630 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:58.630 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:58.631 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:58.631 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:26146 3.1c 3:3da1e1c6:::rbd_data.1121f2c5ee81.0000000000000007:13 [read 425984~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:39:58.631 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.434603+0000", 2024-09-13T06:39:58.631 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 2.115606423, 2024-09-13T06:39:58.631 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.040125802000000002, 2024-09-13T06:39:58.631 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:39:58.631 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:39:58.631 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:39:58.631 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:39:58.631 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:58.631 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 26146 2024-09-13T06:39:58.632 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:58.632 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:39:58.632 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:58.632 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:39:58.632 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.434603+0000", 2024-09-13T06:39:58.632 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:58.632 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:58.632 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:58.632 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:39:58.632 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.434603+0000", 2024-09-13T06:39:58.632 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:58.633 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:58.633 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:58.633 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:39:58.633 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.434602+0000", 2024-09-13T06:39:58.633 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999986 2024-09-13T06:39:58.633 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:58.633 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:58.633 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:39:58.633 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.434609+0000", 2024-09-13T06:39:58.633 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.1380000000000001e-06 2024-09-13T06:39:58.633 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:58.633 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:58.633 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:39:58.634 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.434621+0000", 2024-09-13T06:39:58.634 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2164000000000001e-05 2024-09-13T06:39:58.634 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:58.634 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:58.634 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:39:58.634 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.434629+0000", 2024-09-13T06:39:58.634 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.0669999999999992e-06 2024-09-13T06:39:58.634 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:58.634 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:58.634 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:39:58.634 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.474400+0000", 2024-09-13T06:39:58.635 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039770755999999997 2024-09-13T06:39:58.635 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:58.635 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:58.635 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:39:58.635 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.474483+0000", 2024-09-13T06:39:58.635 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.3238000000000005e-05 2024-09-13T06:39:58.635 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:58.635 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:58.635 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:39:58.635 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.474729+0000", 2024-09-13T06:39:58.635 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00024571499999999997 2024-09-13T06:39:58.635 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:58.635 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:39:58.636 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:58.636 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:58.636 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:58.636 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:26147 3.1c 3:3da1e1c6:::rbd_data.1121f2c5ee81.0000000000000007:13 [read 450560~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:39:58.636 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.434635+0000", 2024-09-13T06:39:58.636 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 2.1155749730000002, 2024-09-13T06:39:58.636 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.040501387, 2024-09-13T06:39:58.636 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:39:58.636 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:39:58.636 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:39:58.637 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:39:58.637 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:58.637 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 26147 2024-09-13T06:39:58.637 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:58.637 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:39:58.637 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:58.637 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:39:58.637 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.434635+0000", 2024-09-13T06:39:58.637 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:58.637 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:58.638 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:58.638 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:39:58.638 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.434635+0000", 2024-09-13T06:39:58.638 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:58.638 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:58.638 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:58.638 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:39:58.638 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.434634+0000", 2024-09-13T06:39:58.638 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:39:58.638 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:58.639 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:58.639 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:39:58.639 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.434637+0000", 2024-09-13T06:39:58.639 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.0180000000000002e-06 2024-09-13T06:39:58.639 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:58.639 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:58.639 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:39:58.639 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.434643+0000", 2024-09-13T06:39:58.639 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.5380000000000002e-06 2024-09-13T06:39:58.640 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:58.640 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:58.640 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:39:58.640 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.434647+0000", 2024-09-13T06:39:58.640 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.5379999999999996e-06 2024-09-13T06:39:58.640 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:58.640 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:58.640 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:39:58.640 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.474784+0000", 2024-09-13T06:39:58.641 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.040136731000000002 2024-09-13T06:39:58.641 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:58.641 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:58.641 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:39:58.641 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.474879+0000", 2024-09-13T06:39:58.641 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.5274999999999998e-05 2024-09-13T06:39:58.641 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:58.641 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:58.641 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:39:58.641 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.475136+0000", 2024-09-13T06:39:58.641 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00025693999999999999 2024-09-13T06:39:58.641 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:58.641 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:39:58.641 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:58.642 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:58.642 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:58.642 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:26148 3.1c 3:3da1e1c6:::rbd_data.1121f2c5ee81.0000000000000007:13 [read 520192~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:39:58.642 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.434651+0000", 2024-09-13T06:39:58.642 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 2.1155584730000001, 2024-09-13T06:39:58.642 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.040853773000000003, 2024-09-13T06:39:58.642 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:39:58.642 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:39:58.642 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:39:58.642 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:39:58.642 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:58.642 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 26148 2024-09-13T06:39:58.642 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:58.643 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:39:58.643 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:58.643 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:39:58.643 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.434651+0000", 2024-09-13T06:39:58.643 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:58.643 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:58.643 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:58.643 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:39:58.643 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.434651+0000", 2024-09-13T06:39:58.643 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:58.643 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:58.643 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:58.643 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:39:58.643 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.434651+0000", 2024-09-13T06:39:58.644 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:39:58.644 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:58.644 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:58.644 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:39:58.644 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.434653+0000", 2024-09-13T06:39:58.644 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.4509999999999999e-06 2024-09-13T06:39:58.644 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:58.644 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:58.644 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:39:58.644 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.434659+0000", 2024-09-13T06:39:58.644 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.1930000000000001e-06 2024-09-13T06:39:58.644 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:58.644 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:58.645 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:39:58.645 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.434664+0000", 2024-09-13T06:39:58.645 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.7400000000000001e-06 2024-09-13T06:39:58.645 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:58.645 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:58.645 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:39:58.645 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.475194+0000", 2024-09-13T06:39:58.645 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.040530123000000001 2024-09-13T06:39:58.645 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:58.645 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:58.645 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:39:58.645 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.475300+0000", 2024-09-13T06:39:58.645 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000106 2024-09-13T06:39:58.646 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:58.646 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:58.646 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:39:58.646 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.475505+0000", 2024-09-13T06:39:58.646 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00020465199999999999 2024-09-13T06:39:58.646 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:58.646 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:39:58.646 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:58.646 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:58.646 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:58.646 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:28049 3.1d 3:b83606fe:::rbd_data.1121f2c5ee81.000000000000001b:13 [read 475136~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:39:58.646 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.661622+0000", 2024-09-13T06:39:58.646 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 1.88858759, 2024-09-13T06:39:58.646 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.040354183000000002, 2024-09-13T06:39:58.647 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:39:58.647 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:39:58.647 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:39:58.647 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:39:58.647 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:39:58.647 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 28049 2024-09-13T06:39:58.647 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:58.647 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:39:58.647 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:58.647 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:39:58.647 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.661622+0000", 2024-09-13T06:39:58.647 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:58.647 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:58.647 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:58.647 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:39:58.648 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.661622+0000", 2024-09-13T06:39:58.648 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:39:58.648 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:58.648 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:58.648 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:39:58.648 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.661621+0000", 2024-09-13T06:39:58.648 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999986 2024-09-13T06:39:58.648 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:58.648 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:58.648 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:39:58.648 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.661627+0000", 2024-09-13T06:39:58.648 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.2450000000000003e-06 2024-09-13T06:39:58.648 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:58.648 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:58.649 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:39:58.649 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.661643+0000", 2024-09-13T06:39:58.649 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5860999999999999e-05 2024-09-13T06:39:58.649 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:58.649 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:58.649 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:39:58.649 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.661656+0000", 2024-09-13T06:39:58.649 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3524e-05 2024-09-13T06:39:58.649 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:58.649 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:58.649 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:39:58.649 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.701307+0000", 2024-09-13T06:39:58.649 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039650336000000001 2024-09-13T06:39:58.650 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:58.650 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:58.650 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:39:58.650 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.701418+0000", 2024-09-13T06:39:58.650 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000111333 2024-09-13T06:39:58.650 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:39:58.650 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:39:58.650 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:39:58.650 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.701976+0000", 2024-09-13T06:39:58.650 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000558247 2024-09-13T06:39:58.650 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:58.650 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:39:58.650 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:58.650 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:39:58.651 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:39:58.651 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:39:58.652 INFO:teuthology.orchestra.run.smithi081.stdout:816 write 0x7ad18ac thru 0x7ad2da6 (0x14fb bytes) 2024-09-13T06:39:58.652 INFO:teuthology.orchestra.run.smithi081.stdout:osd.3: {} 2024-09-13T06:39:58.653 INFO:teuthology.orchestra.run.smithi081.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-13T06:39:58.653 INFO:teuthology.orchestra.run.smithi081.stdout:817 punch from 0xde2a70 to 0xde822c, (0x57bc bytes) 2024-09-13T06:39:58.654 INFO:teuthology.orchestra.run.smithi081.stdout:818 trunc from 0x7ad2da7 to 0x309d0d1 2024-09-13T06:39:58.654 INFO:teuthology.orchestra.run.smithi081.stdout:osd.4: {} 2024-09-13T06:39:58.654 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-13T06:39:58.655 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:39:58.653+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:39:58.655 INFO:teuthology.orchestra.run.smithi081.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-13T06:39:58.655 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:39:58.655 INFO:teuthology.orchestra.run.smithi081.stdout:osd.5: {} 2024-09-13T06:39:58.656 INFO:teuthology.orchestra.run.smithi081.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-13T06:39:58.657 INFO:teuthology.orchestra.run.smithi081.stdout:820 write 0xbae0572 thru 0xbaebf1a (0xb9a9 bytes) 2024-09-13T06:39:58.657 INFO:teuthology.orchestra.run.smithi081.stdout:821 writesame 0x1be378 thru 0x1c9a56 data_size 0x5(0xb6df bytes) 2024-09-13T06:39:58.657 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:39:58.657 INFO:teuthology.orchestra.run.smithi081.stdout:823 read 0xabbec07 thru 0xabc009f (0x1499 bytes) 2024-09-13T06:39:58.657 INFO:teuthology.orchestra.run.smithi081.stdout:825 read 0xaa847a2 thru 0xaa8cdb5 (0x8614 bytes) 2024-09-13T06:39:58.657 INFO:teuthology.orchestra.run.smithi081.stdout:826 read 0x4f07778 thru 0x4f08fc1 (0x184a bytes) 2024-09-13T06:39:58.657 INFO:teuthology.orchestra.run.smithi081.stdout:827 read 0x5353a57 thru 0x535db9b (0xa145 bytes) 2024-09-13T06:39:58.657 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:39:58.657 INFO:teuthology.orchestra.run.smithi081.stdout:829 writesame 0x37d91d4 thru 0x37e405b data_size 0x14(0xae88 bytes) 2024-09-13T06:39:58.657 INFO:teuthology.orchestra.run.smithi081.stdout:osd.6: {} 2024-09-13T06:39:58.658 INFO:teuthology.orchestra.run.smithi081.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-13T06:39:58.658 INFO:teuthology.orchestra.run.smithi081.stdout:830 punch from 0xa373da4 to 0xa3814a3, (0xd6ff bytes) 2024-09-13T06:39:58.658 INFO:teuthology.orchestra.run.smithi081.stdout:831 read 0x521f568 thru 0x522d0f7 (0xdb90 bytes) 2024-09-13T06:39:58.658 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:39:58.658 INFO:teuthology.orchestra.run.smithi081.stdout:833 write 0x3e2b9f7 thru 0x3e2d9fd (0x2007 bytes) 2024-09-13T06:39:58.659 INFO:teuthology.orchestra.run.smithi081.stdout:osd.7: {} 2024-09-13T06:39:58.659 INFO:teuthology.orchestra.run.smithi081.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-13T06:39:58.659 INFO:teuthology.orchestra.run.smithi081.stdout:834 trunc from 0xbaebf1b to 0x2cae3b2 2024-09-13T06:39:58.670 INFO:teuthology.orchestra.run.smithi081.stdout:836 trunc from 0x2cae3b2 to 0x9d8ed3e 2024-09-13T06:39:58.676 INFO:teuthology.orchestra.run.smithi081.stdout:837 read 0x68efdaa thru 0x68f50e0 (0x5337 bytes) 2024-09-13T06:39:58.685 INFO:teuthology.orchestra.run.smithi081.stdout:838 write 0xb6fe348 thru 0xb70a55f (0xc218 bytes) 2024-09-13T06:39:58.693 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:39:58.704 INFO:teuthology.orchestra.run.smithi081.stdout:840 write 0xde86d54 thru 0xde8afcc (0x4279 bytes) 2024-09-13T06:39:58.710 INFO:teuthology.orchestra.run.smithi081.stdout:842 write 0x1a44a18 thru 0x1a47ba5 (0x318e bytes) 2024-09-13T06:39:58.713 INFO:teuthology.orchestra.run.smithi081.stdout:843 read 0xae5440 thru 0xaf0365 (0xaf26 bytes) 2024-09-13T06:39:58.714 INFO:teuthology.orchestra.run.smithi081.stdout:848 write 0x14ed3f8 thru 0x14f455a (0x7163 bytes) 2024-09-13T06:39:58.719 INFO:teuthology.orchestra.run.smithi081.stdout:850 writesame 0x6bea527 thru 0x6bf5cb5 data_size 0x31(0xb78f bytes) 2024-09-13T06:39:58.746 INFO:teuthology.orchestra.run.smithi081.stdout:852 trunc from 0xde8afcd to 0xf0a619 2024-09-13T06:39:58.753 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:39:58.755+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:39:58.775 INFO:teuthology.orchestra.run.smithi081.stdout:854 read 0xac3a78 thru 0xad2de1 (0xf36a bytes) 2024-09-13T06:39:58.776 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:39:58.795 INFO:teuthology.orchestra.run.smithi081.stdout:858 writesame 0x76a8ea0 thru 0x76b4a48 data_size 0x1(0xbba9 bytes) 2024-09-13T06:39:58.795 INFO:teuthology.orchestra.run.smithi081.stdout:859 punch from 0x724f28c to 0x725055f, (0x12d3 bytes) 2024-09-13T06:39:58.800 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6] out_osds: [7] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-13T06:39:58.800 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-13T06:39:58.800 INFO:tasks.thrashosds.thrasher:primary_affinity 2024-09-13T06:39:58.800 INFO:tasks.thrashosds.thrasher:Setting osd 0 primary_affinity to 1.000000 2024-09-13T06:39:58.800 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 0 1 2024-09-13T06:39:58.801 INFO:teuthology.orchestra.run.smithi081.stdout:860 write 0x76dfb1f thru 0x76e8aec (0x8fce bytes) 2024-09-13T06:39:58.808 INFO:teuthology.orchestra.run.smithi081.stdout:862 writesame 0x6efc2cb thru 0x6f08a19 data_size 0x25(0xc74f bytes) 2024-09-13T06:39:58.835 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:39:58.835 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:39:58.836 INFO:teuthology.orchestra.run.smithi081.stdout:864 write 0xe06e171 thru 0xe073a16 (0x58a6 bytes) 2024-09-13T06:39:58.840 INFO:teuthology.orchestra.run.smithi081.stdout:865 read 0x5ff5ffd thru 0x60041a9 (0xe1ad bytes) 2024-09-13T06:39:58.840 INFO:teuthology.orchestra.run.smithi081.stdout:866 write 0xd3fc425 thru 0xd4015de (0x51ba bytes) 2024-09-13T06:39:58.845 INFO:teuthology.orchestra.run.smithi081.stdout:867 read 0xb38090 thru 0xb43298 (0xb209 bytes) 2024-09-13T06:39:58.846 INFO:teuthology.orchestra.run.smithi081.stdout:868 punch from 0x95e45cf to 0x95e8b72, (0x45a3 bytes) 2024-09-13T06:39:58.846 INFO:teuthology.orchestra.run.smithi081.stdout:869 write 0xbdc1bcd thru 0xbdc9068 (0x749c bytes) 2024-09-13T06:39:58.852 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-13T06:39:58.852 INFO:teuthology.orchestra.run.smithi081.stdout:870 write 0x9bde660 thru 0x9be276d (0x410e bytes) 2024-09-13T06:39:58.853 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:39:58.855+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:39:58.856 INFO:teuthology.orchestra.run.smithi081.stdout:871 read 0x6e7ba83 thru 0x6e7d67c (0x1bfa bytes) 2024-09-13T06:39:58.857 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:39:58.857 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:39:58.861 INFO:teuthology.orchestra.run.smithi081.stdout:874 trunc from 0xe073a17 to 0xb9c1ee7 2024-09-13T06:39:58.886 INFO:teuthology.orchestra.run.smithi081.stdout:875 writesame 0xc91da6a thru 0xc92cc9b data_size 0x1d(0xf232 bytes) 2024-09-13T06:39:58.886 INFO:teuthology.orchestra.run.smithi081.stdout:876 writesame 0x5bd1e8c thru 0x5bda4d8 data_size 0x1(0x864d bytes) 2024-09-13T06:39:58.924 INFO:teuthology.orchestra.run.smithi081.stdout:877 trunc from 0xc92cc9c to 0x633580b 2024-09-13T06:39:58.943 INFO:teuthology.orchestra.run.smithi081.stdout:878 write 0x3ee92cb thru 0x3eed679 (0x43af bytes) 2024-09-13T06:39:58.954 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:39:58.955+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:39:58.958 INFO:teuthology.orchestra.run.smithi081.stdout:879 write 0x64fe6fd thru 0x6508446 (0x9d4a bytes) 2024-09-13T06:39:58.981 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:39:58.981 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:39:58.982 INFO:teuthology.orchestra.run.smithi081.stdout:882 write 0x9eb40c9 thru 0x9eb6fe2 (0x2f1a bytes) 2024-09-13T06:39:58.997 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-13T06:39:58.998 INFO:teuthology.orchestra.run.smithi081.stdout:883 writesame 0xe814198 thru 0xe820cb0 data_size 0x35(0xcb19 bytes) 2024-09-13T06:39:58.999 INFO:teuthology.orchestra.run.smithi081.stdout:885 write 0xd1b7db7 thru 0xd1ba0e0 (0x232a bytes) 2024-09-13T06:39:59.004 INFO:teuthology.orchestra.run.smithi081.stdout:886 write 0x77679c0 thru 0x777247b (0xaabc bytes) 2024-09-13T06:39:59.015 INFO:teuthology.orchestra.run.smithi081.stdout:887 punch from 0x80d3cb5 to 0x80d8709, (0x4a54 bytes) 2024-09-13T06:39:59.015 INFO:teuthology.orchestra.run.smithi081.stdout:889 read 0xb74873f thru 0xb74e820 (0x60e2 bytes) 2024-09-13T06:39:59.015 INFO:teuthology.orchestra.run.smithi081.stdout:890 writesame 0x2ab394 thru 0x2b5307 data_size 0x82(0x9f74 bytes) 2024-09-13T06:39:59.020 INFO:teuthology.orchestra.run.smithi081.stdout:891 read 0x7f58550 thru 0x7f5be81 (0x3932 bytes) 2024-09-13T06:39:59.020 INFO:teuthology.orchestra.run.smithi081.stdout:892 read 0x31acad7 thru 0x31b7389 (0xa8b3 bytes) 2024-09-13T06:39:59.020 INFO:teuthology.orchestra.run.smithi081.stdout:893 write 0x6912dfb thru 0x691c372 (0x9578 bytes) 2024-09-13T06:39:59.026 INFO:teuthology.orchestra.run.smithi081.stdout:894 write 0x75f3527 thru 0x75fc54a (0x9024 bytes) 2024-09-13T06:39:59.033 INFO:teuthology.orchestra.run.smithi081.stdout:895 write 0x2743009 thru 0x274d7bd (0xa7b5 bytes) 2024-09-13T06:39:59.044 INFO:teuthology.orchestra.run.smithi081.stdout:897 read 0xccbd34d thru 0xccbe561 (0x1215 bytes) 2024-09-13T06:39:59.044 INFO:teuthology.orchestra.run.smithi081.stdout:899 write 0xd24f262 thru 0xd250fb4 (0x1d53 bytes) 2024-09-13T06:39:59.049 INFO:teuthology.orchestra.run.smithi081.stdout:902 punch from 0xcf11f28 to 0xcf1a51d, (0x85f5 bytes) 2024-09-13T06:39:59.049 INFO:teuthology.orchestra.run.smithi081.stdout:903 writesame 0x1f69de thru 0x203e7b data_size 0x5(0xd49e bytes) 2024-09-13T06:39:59.054 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:39:59.055+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:39:59.075 INFO:teuthology.orchestra.run.smithi081.stdout:904 trunc from 0xe820cb1 to 0x2861bac 2024-09-13T06:39:59.093 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:39:59.094 INFO:teuthology.orchestra.run.smithi081.stdout:908 write 0xa19ec0 thru 0xa1a42e (0x56f bytes) 2024-09-13T06:39:59.110 INFO:teuthology.orchestra.run.smithi081.stdout:909 writesame 0x6ee2529 thru 0x6ee6271 data_size 0x1(0x3d49 bytes) 2024-09-13T06:39:59.110 INFO:teuthology.orchestra.run.smithi081.stdout:910 read 0x28b0201 thru 0x28b9be0 (0x99e0 bytes) 2024-09-13T06:39:59.110 INFO:teuthology.orchestra.run.smithi081.stdout:911 writesame 0x69ae887 thru 0x69b9a7e data_size 0x28(0xb1f8 bytes) 2024-09-13T06:39:59.125 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:39:59.125 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:39:59.130 INFO:teuthology.orchestra.run.smithi081.stdout:912 write 0x92c621b thru 0x92c7eb5 (0x1c9b bytes) 2024-09-13T06:39:59.140 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-13T06:39:59.146 INFO:teuthology.orchestra.run.smithi081.stdout:913 write 0xa3b4ffb thru 0xa3b6595 (0x159b bytes) 2024-09-13T06:39:59.150 INFO:teuthology.orchestra.run.smithi081.stdout:916 read 0x121a6ed thru 0x121b80c (0x1120 bytes) 2024-09-13T06:39:59.151 INFO:teuthology.orchestra.run.smithi081.stdout:917 punch from 0xf636d3 to 0xf72e5a, (0xf787 bytes) 2024-09-13T06:39:59.151 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:39:59.151 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:39:59.155 INFO:teuthology.orchestra.run.smithi081.stdout:920 trunc from 0xa3b6596 to 0x85bebae 2024-09-13T06:39:59.167 INFO:teuthology.orchestra.run.smithi081.stdout:921 read 0x4cffb79 thru 0x4d053b6 (0x583e bytes) 2024-09-13T06:39:59.167 INFO:teuthology.orchestra.run.smithi081.stdout:922 punch from 0x2187ca4 to 0x218c65f, (0x49bb bytes) 2024-09-13T06:39:59.167 INFO:teuthology.orchestra.run.smithi081.stdout:923 punch from 0x173354a to 0x1739c16, (0x66cc bytes) 2024-09-13T06:39:59.183 INFO:teuthology.orchestra.run.smithi081.stdout:924 writesame 0xbb14d85 thru 0xbb1df54 data_size 0x8(0x91d0 bytes) 2024-09-13T06:39:59.183 INFO:teuthology.orchestra.run.smithi081.stdout:925 writesame 0x91ad666 thru 0x91b13a9 data_size 0x6(0x3d44 bytes) 2024-09-13T06:39:59.188 INFO:teuthology.orchestra.run.smithi081.stdout:927 read 0x58b2f73 thru 0x58ba39e (0x742c bytes) 2024-09-13T06:39:59.188 INFO:teuthology.orchestra.run.smithi081.stdout:929 punch from 0xae9a8bd to 0xaea1266, (0x69a9 bytes) 2024-09-13T06:39:59.188 INFO:teuthology.orchestra.run.smithi081.stdout:930 read 0xa874f61 thru 0xa87619e (0x123e bytes) 2024-09-13T06:39:59.188 INFO:teuthology.orchestra.run.smithi081.stdout:931 read 0x51b797a thru 0x51b849c (0xb23 bytes) 2024-09-13T06:39:59.189 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-13T06:39:59.189+0000 7f86a5f06640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26387) UID: 0 2024-09-13T06:39:59.190 INFO:teuthology.orchestra.run.smithi081.stdout:932 trunc from 0xbb1df55 to 0xd45d964 2024-09-13T06:39:59.196 INFO:teuthology.orchestra.run.smithi081.stdout:934 punch from 0xb4463a0 to 0xb45486a, (0xe4ca bytes) 2024-09-13T06:39:59.218 INFO:teuthology.orchestra.run.smithi081.stdout:935 trunc from 0xd45d964 to 0xc7abde 2024-09-13T06:39:59.257 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:39:59.259+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:39:59.262 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:39:59.262 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:39:59.265 INFO:teuthology.orchestra.run.smithi081.stdout:936 write 0xb2ab918 thru 0xb2b72ad (0xb996 bytes) 2024-09-13T06:39:59.277 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-13T06:39:59.282 INFO:teuthology.orchestra.run.smithi081.stdout:937 writesame 0x1e9bb44 thru 0x1ea01b8 data_size 0x1(0x4675 bytes) 2024-09-13T06:39:59.299 INFO:teuthology.orchestra.run.smithi081.stdout:938 read 0x3b52cb6 thru 0x3b5ebe7 (0xbf32 bytes) 2024-09-13T06:39:59.300 INFO:teuthology.orchestra.run.smithi081.stdout:941 write 0x50d33ab thru 0x50daaa8 (0x76fe bytes) 2024-09-13T06:39:59.309 INFO:teuthology.orchestra.run.smithi081.stdout:944 write 0x380c573 thru 0x3816509 (0x9f97 bytes) 2024-09-13T06:39:59.315 INFO:teuthology.orchestra.run.smithi081.stdout:945 punch from 0x11c038 to 0x128240, (0xc208 bytes) 2024-09-13T06:39:59.315 INFO:teuthology.orchestra.run.smithi081.stdout:947 read 0x347c514 thru 0x347e564 (0x2051 bytes) 2024-09-13T06:39:59.316 INFO:teuthology.orchestra.run.smithi081.stdout:949 punch from 0x9e31bb0 to 0x9e3c8e1, (0xad31 bytes) 2024-09-13T06:39:59.316 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:39:59.316 INFO:teuthology.orchestra.run.smithi081.stdout:951 write 0x9350ddf thru 0x93522f3 (0x1515 bytes) 2024-09-13T06:39:59.322 INFO:teuthology.orchestra.run.smithi081.stdout:952 read 0x8d191bb thru 0x8d1fffa (0x6e40 bytes) 2024-09-13T06:39:59.323 INFO:teuthology.orchestra.run.smithi081.stdout:954 read 0x397d8ae thru 0x398326b (0x59be bytes) 2024-09-13T06:39:59.323 INFO:teuthology.orchestra.run.smithi081.stdout:955 punch from 0x6e0f069 to 0x6e17a87, (0x8a1e bytes) 2024-09-13T06:39:59.323 INFO:teuthology.orchestra.run.smithi081.stdout:956 punch from 0x5a9928c to 0x5aa4393, (0xb107 bytes) 2024-09-13T06:39:59.323 INFO:teuthology.orchestra.run.smithi081.stdout:957 read 0x321fb94 thru 0x322cd10 (0xd17d bytes) 2024-09-13T06:39:59.324 INFO:teuthology.orchestra.run.smithi081.stdout:961 punch from 0x420b895 to 0x42165d0, (0xad3b bytes) 2024-09-13T06:39:59.333 INFO:teuthology.orchestra.run.smithi081.stdout:962 write 0xc5b1c4d thru 0xc5b9a5c (0x7e10 bytes) 2024-09-13T06:39:59.341 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:39:59.341 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:39:59.341 INFO:teuthology.orchestra.run.smithi081.stdout:966 read 0x4a8a735 thru 0x4a8b32e (0xbfa bytes) 2024-09-13T06:39:59.341 INFO:teuthology.orchestra.run.smithi081.stdout:967 read 0x6c350b6 thru 0x6c3d534 (0x847f bytes) 2024-09-13T06:39:59.341 INFO:teuthology.orchestra.run.smithi081.stdout:968 punch from 0x77d1fbe to 0x77dea56, (0xca98 bytes) 2024-09-13T06:39:59.342 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:39:59.342 INFO:teuthology.orchestra.run.smithi081.stdout:973 read 0x8349790 thru 0x8356f7a (0xd7eb bytes) 2024-09-13T06:39:59.342 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:39:59.342 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:39:59.350 INFO:teuthology.orchestra.run.smithi081.stdout:978 trunc from 0xc5b9a5d to 0x8d007d3 2024-09-13T06:39:59.364 INFO:tasks.ceph.osd.6.smithi139.stderr:2024-09-13T06:39:59.365+0000 7fcd02c5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26385) UID: 0 2024-09-13T06:39:59.366 INFO:teuthology.orchestra.run.smithi081.stdout:979 read 0x55a6b2 thru 0x561f63 (0x78b2 bytes) 2024-09-13T06:39:59.368 INFO:teuthology.orchestra.run.smithi081.stdout:980 trunc from 0x8d007d3 to 0x8a0e26b 2024-09-13T06:39:59.382 INFO:teuthology.orchestra.run.smithi081.stdout:982 punch from 0x4a0da39 to 0x4a0fb1f, (0x20e6 bytes) 2024-09-13T06:39:59.382 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:39:59.382 INFO:teuthology.orchestra.run.smithi081.stdout:985 read 0x5f2a392 thru 0x5f30608 (0x6277 bytes) 2024-09-13T06:39:59.382 INFO:teuthology.orchestra.run.smithi081.stdout:986 read 0x43d4831 thru 0x43dae68 (0x6638 bytes) 2024-09-13T06:39:59.382 INFO:teuthology.orchestra.run.smithi081.stdout:989 read 0x74502a5 thru 0x7455471 (0x51cd bytes) 2024-09-13T06:39:59.384 INFO:teuthology.orchestra.run.smithi081.stdout:991 trunc from 0x8a0e26b to 0x79aae3f 2024-09-13T06:39:59.392 INFO:teuthology.orchestra.run.smithi081.stdout:992 writesame 0x19c00fe thru 0x19cc2cf data_size 0x1(0xc1d2 bytes) 2024-09-13T06:39:59.447 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:39:59.447 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:39:59.448 INFO:teuthology.orchestra.run.smithi081.stdout:993 writesame 0xbb3fe13 thru 0xbb4752c data_size 0x5(0x771a bytes) 2024-09-13T06:39:59.458 INFO:tasks.ceph.osd.6.smithi139.stderr:2024-09-13T06:39:59.457+0000 7fcd02c5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26385) UID: 0 2024-09-13T06:39:59.462 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-13T06:39:59.465 INFO:teuthology.orchestra.run.smithi081.stdout:994 write 0xe057989 thru 0xe06700a (0xf682 bytes) 2024-09-13T06:39:59.480 INFO:teuthology.orchestra.run.smithi081.stdout:996 write 0xa6c59e2 thru 0xa6cc17c (0x679b bytes) 2024-09-13T06:39:59.488 INFO:teuthology.orchestra.run.smithi081.stdout:997 write 0xa4a5cfc thru 0xa4a839e (0x26a3 bytes) 2024-09-13T06:39:59.496 INFO:teuthology.orchestra.run.smithi081.stdout:998 read 0xb853769 thru 0xb85d2c8 (0x9b60 bytes) 2024-09-13T06:39:59.496 INFO:teuthology.orchestra.run.smithi081.stdout:1000 write 0x3ab174b thru 0x3abfbf8 (0xe4ae bytes) 2024-09-13T06:39:59.513 INFO:teuthology.orchestra.run.smithi081.stdout:1002 write 0xe147ed1 thru 0xe14fb94 (0x7cc4 bytes) 2024-09-13T06:39:59.516 INFO:teuthology.orchestra.run.smithi081.stdout:1003 write 0x66df0ec thru 0x66e1281 (0x2196 bytes) 2024-09-13T06:39:59.523 INFO:teuthology.orchestra.run.smithi081.stdout:1004 read 0x1b5aaff thru 0x1b66c5a (0xc15c bytes) 2024-09-13T06:39:59.524 INFO:teuthology.orchestra.run.smithi081.stdout:1005 writesame 0xb3eb698 thru 0xb3f11dc data_size 0x1(0x5b45 bytes) 2024-09-13T06:39:59.555 INFO:teuthology.orchestra.run.smithi081.stdout:1008 write 0xb021a62 thru 0xb02ea3b (0xcfda bytes) 2024-09-13T06:39:59.559 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:39:59.557+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:39:59.565 INFO:teuthology.orchestra.run.smithi081.stdout:1009 read 0xab75713 thru 0xab83ab4 (0xe3a2 bytes) 2024-09-13T06:39:59.566 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:39:59.566 INFO:teuthology.orchestra.run.smithi081.stdout:1011 read 0x2b86fbb thru 0x2b8ee25 (0x7e6b bytes) 2024-09-13T06:39:59.580 INFO:teuthology.orchestra.run.smithi081.stderr:nodeep-scrub is unset 2024-09-13T06:39:59.580 INFO:teuthology.orchestra.run.smithi081.stderr:set osd.0 primary-affinity to 1 (8655362) 2024-09-13T06:39:59.586 INFO:teuthology.orchestra.run.smithi081.stdout:1012 trunc from 0xe14fb95 to 0x6b1f6b5 2024-09-13T06:39:59.609 INFO:teuthology.orchestra.run.smithi081.stdout:1014 write 0x115c57f thru 0x116433d (0x7dbf bytes) 2024-09-13T06:39:59.612 INFO:teuthology.orchestra.run.smithi081.stdout:1015 trunc from 0x6b1f6b5 to 0x6f8774b 2024-09-13T06:39:59.618 INFO:teuthology.orchestra.run.smithi081.stdout:1016 read 0x679a774 thru 0x67a0284 (0x5b11 bytes) 2024-09-13T06:39:59.618 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:39:59.618 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:39:59.624 INFO:teuthology.orchestra.run.smithi081.stdout:1020 trunc from 0x6f8774b to 0x2b843d5 2024-09-13T06:39:59.638 INFO:teuthology.orchestra.run.smithi081.stdout:1021 read 0x86471e thru 0x872587 (0xde6a bytes) 2024-09-13T06:39:59.639 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:39:59.639 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:39:59.654 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-13T06:39:59.657 INFO:teuthology.orchestra.run.smithi081.stdout:1023 write 0x9eb8b0f thru 0x9eb911c (0x60e bytes) 2024-09-13T06:39:59.661 INFO:teuthology.orchestra.run.smithi081.stdout:1024 writesame 0xc5bb37 thru 0xc6b2ca data_size 0xa(0xf794 bytes) 2024-09-13T06:39:59.661 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:39:59.663+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:39:59.673 INFO:teuthology.orchestra.run.smithi081.stdout:1025 trunc from 0x9eb911d to 0x54750eb 2024-09-13T06:39:59.692 INFO:teuthology.orchestra.run.smithi081.stdout:1026 trunc from 0x54750eb to 0x19e5f77 2024-09-13T06:39:59.709 INFO:teuthology.orchestra.run.smithi081.stdout:1028 read 0x840cca thru 0x8421be (0x14f5 bytes) 2024-09-13T06:39:59.737 INFO:teuthology.orchestra.run.smithi081.stdout:1031 writesame 0xea20f89 thru 0xea259a0 data_size 0x4(0x4a18 bytes) 2024-09-13T06:39:59.737 INFO:teuthology.orchestra.run.smithi081.stdout:1032 writesame 0xacfb1ad thru 0xacfb5bb data_size 0x1(0x40f bytes) 2024-09-13T06:39:59.741 INFO:teuthology.orchestra.run.smithi081.stdout:1035 write 0x6361c35 thru 0x6361dc6 (0x192 bytes) 2024-09-13T06:39:59.747 INFO:teuthology.orchestra.run.smithi081.stdout:1036 write 0x2c7f658 thru 0x2c8cab1 (0xd45a bytes) 2024-09-13T06:39:59.761 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:39:59.761+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:39:59.761 INFO:teuthology.orchestra.run.smithi081.stdout:1037 trunc from 0xea259a1 to 0xd633d9a 2024-09-13T06:39:59.768 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:39:59.771 INFO:teuthology.orchestra.run.smithi081.stdout:1040 trunc from 0xd633d9a to 0xb90e03d 2024-09-13T06:39:59.782 INFO:teuthology.orchestra.run.smithi081.stdout:1041 punch from 0xaf6a5f0 to 0xaf6ecb7, (0x46c7 bytes) 2024-09-13T06:39:59.782 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:39:59.791 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:39:59.791 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:39:59.792 INFO:teuthology.orchestra.run.smithi081.stdout:1045 write 0xc28f4b4 thru 0xc298e6a (0x99b7 bytes) 2024-09-13T06:39:59.804 INFO:teuthology.orchestra.run.smithi081.stdout:1046 read 0xb02d0e5 thru 0xb035421 (0x833d bytes) 2024-09-13T06:39:59.804 INFO:teuthology.orchestra.run.smithi081.stdout:1048 read 0x9c6123c thru 0x9c67fc5 (0x6d8a bytes) 2024-09-13T06:39:59.804 INFO:teuthology.orchestra.run.smithi081.stdout:1050 write 0xf9f747 thru 0xfa68a5 (0x715f bytes) 2024-09-13T06:39:59.808 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-13T06:39:59.808 INFO:teuthology.orchestra.run.smithi081.stdout:1052 write 0xc089b6a thru 0xc08ab30 (0xfc7 bytes) 2024-09-13T06:39:59.810 INFO:teuthology.orchestra.run.smithi081.stdout:1053 write 0x2c4f6ab thru 0x2c5df68 (0xe8be bytes) 2024-09-13T06:39:59.818 INFO:teuthology.orchestra.run.smithi081.stdout:1054 write 0x176692e thru 0x176e822 (0x7ef5 bytes) 2024-09-13T06:39:59.825 INFO:teuthology.orchestra.run.smithi081.stdout:1055 write 0xfe1ae5 thru 0xfef352 (0xd86e bytes) 2024-09-13T06:39:59.829 INFO:teuthology.orchestra.run.smithi081.stdout:1057 punch from 0xcb1ee0 to 0xcba310, (0x8430 bytes) 2024-09-13T06:39:59.830 INFO:teuthology.orchestra.run.smithi081.stdout:1058 read 0xb4a0a13 thru 0xb4a5396 (0x4984 bytes) 2024-09-13T06:39:59.830 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:39:59.830 INFO:teuthology.orchestra.run.smithi081.stdout:1060 punch from 0xc033380 to 0xc035809, (0x2489 bytes) 2024-09-13T06:39:59.837 INFO:teuthology.orchestra.run.smithi081.stdout:1061 write 0xc39a795 thru 0xc3a8d27 (0xe593 bytes) 2024-09-13T06:39:59.846 INFO:teuthology.orchestra.run.smithi081.stdout:1062 read 0x7d35bf5 thru 0x7d373c2 (0x17ce bytes) 2024-09-13T06:39:59.846 INFO:teuthology.orchestra.run.smithi081.stdout:1063 punch from 0xbea330 to 0xbec50b, (0x21db bytes) 2024-09-13T06:39:59.847 INFO:teuthology.orchestra.run.smithi081.stdout:1064 read 0x892969c thru 0x89296a8 (0xd bytes) 2024-09-13T06:39:59.847 INFO:teuthology.orchestra.run.smithi081.stdout:1066 punch from 0x196f628 to 0x197e481, (0xee59 bytes) 2024-09-13T06:39:59.847 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:39:59.847 INFO:teuthology.orchestra.run.smithi081.stdout:1068 punch from 0x43e663b to 0x43ec610, (0x5fd5 bytes) 2024-09-13T06:39:59.847 INFO:teuthology.orchestra.run.smithi081.stdout:1069 punch from 0x2fa7981 to 0x2fb773a, (0xfdb9 bytes) 2024-09-13T06:39:59.847 INFO:teuthology.orchestra.run.smithi081.stdout:1070 punch from 0x4c165bd to 0x4c1d8c9, (0x730c bytes) 2024-09-13T06:39:59.847 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:39:59.847 INFO:teuthology.orchestra.run.smithi081.stdout:1072 punch from 0x67acc26 to 0x67bac9c, (0xe076 bytes) 2024-09-13T06:39:59.847 INFO:teuthology.orchestra.run.smithi081.stdout:1073 punch from 0x68dcadd to 0x68e8c6c, (0xc18f bytes) 2024-09-13T06:39:59.847 INFO:teuthology.orchestra.run.smithi081.stdout:1074 writesame 0x440af4b thru 0x44182ab data_size 0x1(0xd361 bytes) 2024-09-13T06:39:59.860 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:39:59.863+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:39:59.880 INFO:teuthology.orchestra.run.smithi081.stdout:1077 writesame 0x127073c thru 0x1277322 data_size 0x1(0x6be7 bytes) 2024-09-13T06:39:59.898 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:39:59.898 INFO:teuthology.orchestra.run.smithi081.stdout:1079 write 0xbffc87e thru 0xc009b10 (0xd293 bytes) 2024-09-13T06:39:59.906 INFO:teuthology.orchestra.run.smithi081.stdout:1080 read 0xa49b7ce thru 0xa4a1584 (0x5db7 bytes) 2024-09-13T06:39:59.906 INFO:teuthology.orchestra.run.smithi081.stdout:1082 write 0x2fbd02d thru 0x2fbee51 (0x1e25 bytes) 2024-09-13T06:39:59.922 INFO:teuthology.orchestra.run.smithi081.stdout:1084 write 0xcb02d59 thru 0xcb07164 (0x440c bytes) 2024-09-13T06:39:59.933 INFO:teuthology.orchestra.run.smithi081.stdout:1086 trunc from 0xcb07165 to 0xc2e6ffa 2024-09-13T06:39:59.942 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:39:59.942 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:39:59.956 INFO:teuthology.orchestra.run.smithi081.stdout:1088 read 0x417fe63 thru 0x418e673 (0xe811 bytes) 2024-09-13T06:39:59.960 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-13T06:39:59.966 INFO:teuthology.orchestra.run.smithi081.stdout:1089 trunc from 0xc2e6ffa to 0x8437fad 2024-09-13T06:39:59.967 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:39:59.971+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:39:59.987 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:39:59.987 INFO:teuthology.orchestra.run.smithi081.stdout:1091 punch from 0x332ef91 to 0x3338533, (0x95a2 bytes) 2024-09-13T06:39:59.987 INFO:teuthology.orchestra.run.smithi081.stdout:1093 write 0x418c61e thru 0x419643b (0x9e1e bytes) 2024-09-13T06:39:59.991 INFO:teuthology.orchestra.run.smithi081.stdout:1095 write 0x5ef5736 thru 0x5ef9372 (0x3c3d bytes) 2024-09-13T06:40:00.015 INFO:teuthology.orchestra.run.smithi081.stdout:1096 write 0xbacf0cc thru 0xbad4187 (0x50bc bytes) 2024-09-13T06:40:00.021 INFO:teuthology.orchestra.run.smithi081.stdout:1097 read 0x99268f4 thru 0x992c22f (0x593c bytes) 2024-09-13T06:40:00.021 INFO:teuthology.orchestra.run.smithi081.stdout:1101 read 0x30e908e thru 0x30ea026 (0xf99 bytes) 2024-09-13T06:40:00.022 INFO:teuthology.orchestra.run.smithi081.stdout:1102 write 0x8aa0361 thru 0x8aad513 (0xd1b3 bytes) 2024-09-13T06:40:00.031 INFO:teuthology.orchestra.run.smithi081.stdout:1103 read 0x7f3b998 thru 0x7f43cbe (0x8327 bytes) 2024-09-13T06:40:00.031 INFO:teuthology.orchestra.run.smithi081.stdout:1104 write 0x4c6f4f1 thru 0x4c7f4b2 (0xffc2 bytes) 2024-09-13T06:40:00.043 INFO:teuthology.orchestra.run.smithi081.stdout:1105 write 0x654a54f thru 0x654b537 (0xfe9 bytes) 2024-09-13T06:40:00.049 INFO:teuthology.orchestra.run.smithi081.stdout:1106 read 0x9fa27bd thru 0x9faad9f (0x85e3 bytes) 2024-09-13T06:40:00.049 INFO:teuthology.orchestra.run.smithi081.stdout:1108 write 0x9838308 thru 0x984480e (0xc507 bytes) 2024-09-13T06:40:00.060 INFO:teuthology.orchestra.run.smithi081.stdout:1110 write 0x9ee90fb thru 0x9eed7f0 (0x46f6 bytes) 2024-09-13T06:40:00.062 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:40:00.065+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:40:00.066 INFO:teuthology.orchestra.run.smithi081.stdout:1111 write 0x38568d8 thru 0x385cab2 (0x61db bytes) 2024-09-13T06:40:00.073 INFO:teuthology.orchestra.run.smithi081.stdout:1112 punch from 0x61b9cd2 to 0x61c68ea, (0xcc18 bytes) 2024-09-13T06:40:00.074 INFO:teuthology.orchestra.run.smithi081.stdout:1113 write 0xa8fe141 thru 0xa9016a4 (0x3564 bytes) 2024-09-13T06:40:00.079 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:40:00.088 INFO:teuthology.orchestra.run.smithi081.stdout:1117 writesame 0xd349efc thru 0xd34ad42 data_size 0x5(0xe47 bytes) 2024-09-13T06:40:00.099 INFO:teuthology.orchestra.run.smithi081.stdout:1119 trunc from 0xd34ad43 to 0x5325eed 2024-09-13T06:40:00.113 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:40:00.113 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:40:00.118 INFO:teuthology.orchestra.run.smithi081.stdout:1121 punch from 0x459c172 to 0x45a1b52, (0x59e0 bytes) 2024-09-13T06:40:00.119 INFO:teuthology.orchestra.run.smithi081.stdout:1125 trunc from 0x5325eed to 0x611b7c4 2024-09-13T06:40:00.127 INFO:teuthology.orchestra.run.smithi081.stdout:1126 punch from 0x8940bb to 0x8995c5, (0x550a bytes) 2024-09-13T06:40:00.128 INFO:teuthology.orchestra.run.smithi081.stdout:1127 clone 7 order 22 su 524288 sc 5 2024-09-13T06:40:00.131 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-13T06:40:00.179 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:40:00.183+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:40:00.264 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:40:00.267+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:40:00.303 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:40:00.303 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:40:00.318 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-13T06:40:00.364 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:40:00.367+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:40:00.465 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:40:00.467+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:40:00.502 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:40:00.502 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:40:00.517 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-13T06:40:00.603 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:40:00.607+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:40:00.661 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-13T06:40:00.667 INFO:tasks.ceph.osd.6.smithi139.stderr:2024-09-13T06:40:00.669+0000 7fcd02c5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26385) UID: 0 2024-09-13T06:40:00.683 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:40:00.684 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:40:00.698 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-13T06:40:00.768 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:40:00.773+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:40:00.819 INFO:teuthology.orchestra.run.smithi081.stdout:osd.0: {} 2024-09-13T06:40:00.819 INFO:teuthology.orchestra.run.smithi081.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-13T06:40:00.835 INFO:teuthology.orchestra.run.smithi081.stdout:osd.1: {} 2024-09-13T06:40:00.836 INFO:teuthology.orchestra.run.smithi081.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-13T06:40:00.852 INFO:teuthology.orchestra.run.smithi081.stdout:osd.2: {} 2024-09-13T06:40:00.852 INFO:teuthology.orchestra.run.smithi081.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-13T06:40:00.869 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:40:00.871+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:40:00.882 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:40:00.882 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-13T06:40:00.882 INFO:teuthology.orchestra.run.smithi081.stdout: "num_ops": 0 2024-09-13T06:40:00.882 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:40:00.883 INFO:teuthology.orchestra.run.smithi081.stdout:osd.3: {} 2024-09-13T06:40:00.883 INFO:teuthology.orchestra.run.smithi081.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-13T06:40:00.900 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-13T06:40:00.910 INFO:teuthology.orchestra.run.smithi081.stdout:osd.4: {} 2024-09-13T06:40:00.911 INFO:teuthology.orchestra.run.smithi081.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-13T06:40:00.931 INFO:teuthology.orchestra.run.smithi081.stdout:osd.5: {} 2024-09-13T06:40:00.931 INFO:teuthology.orchestra.run.smithi081.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-13T06:40:00.951 INFO:teuthology.orchestra.run.smithi081.stdout:osd.6: {} 2024-09-13T06:40:00.952 INFO:teuthology.orchestra.run.smithi081.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-13T06:40:00.970 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:40:00.971+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:40:00.971 INFO:teuthology.orchestra.run.smithi081.stdout:osd.7: {} 2024-09-13T06:40:00.972 INFO:teuthology.orchestra.run.smithi081.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-13T06:40:01.034 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:40:01.034 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-13T06:40:01.034 INFO:teuthology.orchestra.run.smithi081.stdout: "complaint_time": 30, 2024-09-13T06:40:01.034 INFO:teuthology.orchestra.run.smithi081.stdout: "num_blocked_ops": 0 2024-09-13T06:40:01.034 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:40:01.048 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-13T06:40:01.072 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:40:01.077+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:40:01.173 INFO:tasks.ceph.osd.6.smithi139.stderr:2024-09-13T06:40:01.177+0000 7fcd02c5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26385) UID: 0 2024-09-13T06:40:01.221 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:40:01.221 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 20, 2024-09-13T06:40:01.221 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 600, 2024-09-13T06:40:01.221 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [ 2024-09-13T06:40:01.222 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.222 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4385.0:2330 3.0 e31/21 3:07d66135:::rbd_object_map.11212429e5ad:head v 31'39, mlcod=31'37)", 2024-09-13T06:40:01.222 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:38.827721+0000", 2024-09-13T06:40:01.222 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 22.39557469, 2024-09-13T06:40:01.222 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.003728295, 2024-09-13T06:40:01.222 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:01.222 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:40:01.222 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:01.222 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.222 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:01.222 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.827721+0000", 2024-09-13T06:40:01.222 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:01.222 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.223 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.223 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:01.223 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.827721+0000", 2024-09-13T06:40:01.223 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:01.223 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.223 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.223 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:01.223 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.827718+0000", 2024-09-13T06:40:01.223 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999976 2024-09-13T06:40:01.223 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.223 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.223 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:01.223 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.827735+0000", 2024-09-13T06:40:01.223 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6515999999999999e-05 2024-09-13T06:40:01.224 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.224 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.224 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:01.224 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.827768+0000", 2024-09-13T06:40:01.224 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.3105999999999998e-05 2024-09-13T06:40:01.224 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.224 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.224 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:01.224 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.827788+0000", 2024-09-13T06:40:01.224 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0210000000000001e-05 2024-09-13T06:40:01.224 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.224 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.224 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:01.224 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.827855+0000", 2024-09-13T06:40:01.225 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.7046999999999997e-05 2024-09-13T06:40:01.225 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.225 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.225 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:01.225 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.827900+0000", 2024-09-13T06:40:01.225 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4415000000000001e-05 2024-09-13T06:40:01.225 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.225 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.226 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:40:01.226 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.831380+0000", 2024-09-13T06:40:01.226 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.003480187 2024-09-13T06:40:01.226 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.226 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.226 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:01.226 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.831449+0000", 2024-09-13T06:40:01.226 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.9070000000000001e-05 2024-09-13T06:40:01.226 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:01.226 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:01.226 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:01.226 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.226 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.227 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4385.0:2402 3.0 e31/21 3:07d66135:::rbd_object_map.11212429e5ad:head v 31'46, mlcod=31'43)", 2024-09-13T06:40:01.227 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:38.872174+0000", 2024-09-13T06:40:01.227 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 22.351121149000001, 2024-09-13T06:40:01.227 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0037101830000000001, 2024-09-13T06:40:01.227 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:01.227 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:40:01.227 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:01.227 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.227 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:01.227 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.872174+0000", 2024-09-13T06:40:01.227 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:01.227 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.227 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.228 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:01.228 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.872174+0000", 2024-09-13T06:40:01.228 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:01.228 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.228 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.228 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:01.228 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.872173+0000", 2024-09-13T06:40:01.228 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.999999 2024-09-13T06:40:01.228 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.228 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.228 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:01.228 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.872180+0000", 2024-09-13T06:40:01.228 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.4189999999999999e-06 2024-09-13T06:40:01.228 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.229 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.229 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:01.229 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.872193+0000", 2024-09-13T06:40:01.229 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.349e-05 2024-09-13T06:40:01.229 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.229 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.229 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:01.229 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.872201+0000", 2024-09-13T06:40:01.229 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.7000000000000008e-06 2024-09-13T06:40:01.229 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.229 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.229 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:01.230 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.872506+0000", 2024-09-13T06:40:01.230 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00030537300000000001 2024-09-13T06:40:01.230 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.230 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.230 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:01.230 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.872571+0000", 2024-09-13T06:40:01.230 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.4349000000000003e-05 2024-09-13T06:40:01.230 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.230 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.230 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:40:01.230 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.875823+0000", 2024-09-13T06:40:01.230 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0032527419999999999 2024-09-13T06:40:01.230 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.230 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.231 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:01.231 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.875884+0000", 2024-09-13T06:40:01.231 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0847999999999997e-05 2024-09-13T06:40:01.231 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:01.231 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:01.231 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:01.231 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.231 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.231 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4385.0:2403 3.0 e31/21 3:07d66135:::rbd_object_map.11212429e5ad:head v 31'47, mlcod=31'43)", 2024-09-13T06:40:01.231 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:38.873272+0000", 2024-09-13T06:40:01.231 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 22.350023294, 2024-09-13T06:40:01.231 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0059524080000000002, 2024-09-13T06:40:01.231 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:01.232 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:40:01.232 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:01.232 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.232 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:01.232 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.873272+0000", 2024-09-13T06:40:01.232 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:01.232 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.232 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.232 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:01.232 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.873272+0000", 2024-09-13T06:40:01.232 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:01.232 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.232 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.233 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:01.233 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.873271+0000", 2024-09-13T06:40:01.233 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:01.233 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.233 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.233 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:01.233 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.873277+0000", 2024-09-13T06:40:01.233 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.5999999999999997e-06 2024-09-13T06:40:01.233 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.233 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.233 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:01.233 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.873285+0000", 2024-09-13T06:40:01.233 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4680000000000003e-06 2024-09-13T06:40:01.233 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.234 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.234 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:01.234 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.873289+0000", 2024-09-13T06:40:01.234 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7670000000000003e-06 2024-09-13T06:40:01.234 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.234 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.234 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:01.234 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.873403+0000", 2024-09-13T06:40:01.234 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00011417300000000001 2024-09-13T06:40:01.234 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.234 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.234 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:01.234 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.873421+0000", 2024-09-13T06:40:01.235 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7278e-05 2024-09-13T06:40:01.235 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.235 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.235 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:40:01.235 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.879180+0000", 2024-09-13T06:40:01.235 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0057591379999999996 2024-09-13T06:40:01.235 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.235 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.235 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:01.235 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.879224+0000", 2024-09-13T06:40:01.235 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4558000000000003e-05 2024-09-13T06:40:01.235 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:01.235 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:01.235 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:01.236 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.236 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.236 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4385.0:2404 3.0 e31/21 3:07d66135:::rbd_object_map.11212429e5ad:head v 31'48, mlcod=31'43)", 2024-09-13T06:40:01.236 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:38.874266+0000", 2024-09-13T06:40:01.236 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 22.349029537, 2024-09-13T06:40:01.236 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0049906389999999998, 2024-09-13T06:40:01.236 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:01.236 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:40:01.236 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:01.236 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.236 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:01.236 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.874266+0000", 2024-09-13T06:40:01.236 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:01.236 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.237 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.237 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:01.237 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.874266+0000", 2024-09-13T06:40:01.237 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:01.237 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.237 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.237 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:01.237 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.874265+0000", 2024-09-13T06:40:01.237 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.999999 2024-09-13T06:40:01.237 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.237 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.237 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:01.237 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.874281+0000", 2024-09-13T06:40:01.238 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5763000000000001e-05 2024-09-13T06:40:01.238 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.238 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.238 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:01.238 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.874294+0000", 2024-09-13T06:40:01.238 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2826000000000001e-05 2024-09-13T06:40:01.238 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.238 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.238 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:01.238 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.874300+0000", 2024-09-13T06:40:01.238 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.6769999999999998e-06 2024-09-13T06:40:01.238 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.238 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.238 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:01.239 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.874390+0000", 2024-09-13T06:40:01.239 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.0129000000000004e-05 2024-09-13T06:40:01.239 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.239 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.239 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:01.239 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.874450+0000", 2024-09-13T06:40:01.239 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9512999999999998e-05 2024-09-13T06:40:01.239 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.239 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.239 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:40:01.239 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.879227+0000", 2024-09-13T06:40:01.239 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0047773329999999999 2024-09-13T06:40:01.239 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.239 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.240 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:01.240 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.879256+0000", 2024-09-13T06:40:01.240 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9173e-05 2024-09-13T06:40:01.240 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:01.240 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:01.240 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:01.240 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.240 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.240 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4385.0:2405 3.0 e31/21 3:07d66135:::rbd_object_map.11212429e5ad:head v 31'49, mlcod=31'43)", 2024-09-13T06:40:01.240 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:38.875324+0000", 2024-09-13T06:40:01.240 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 22.347971688000001, 2024-09-13T06:40:01.240 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0039619570000000003, 2024-09-13T06:40:01.240 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:01.241 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:40:01.241 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:01.241 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.241 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:01.241 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.875324+0000", 2024-09-13T06:40:01.241 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:01.241 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.241 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.241 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:01.241 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.875324+0000", 2024-09-13T06:40:01.241 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:01.241 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.241 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.241 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:01.242 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.875323+0000", 2024-09-13T06:40:01.242 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.999999 2024-09-13T06:40:01.242 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.242 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.242 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:01.242 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.875329+0000", 2024-09-13T06:40:01.242 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.1689999999999997e-06 2024-09-13T06:40:01.242 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.242 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.242 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:01.242 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.875340+0000", 2024-09-13T06:40:01.242 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1065e-05 2024-09-13T06:40:01.242 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.243 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.243 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:01.243 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.875347+0000", 2024-09-13T06:40:01.243 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.674e-06 2024-09-13T06:40:01.243 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.243 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.243 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:01.243 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.875396+0000", 2024-09-13T06:40:01.243 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9094000000000001e-05 2024-09-13T06:40:01.243 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.243 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.243 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:01.243 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.875420+0000", 2024-09-13T06:40:01.243 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4199999999999999e-05 2024-09-13T06:40:01.244 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.244 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.244 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:40:01.244 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.879258+0000", 2024-09-13T06:40:01.244 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0038376930000000001 2024-09-13T06:40:01.244 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.244 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.244 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:01.244 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.879286+0000", 2024-09-13T06:40:01.244 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.7880000000000001e-05 2024-09-13T06:40:01.244 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:01.244 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:01.245 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:01.245 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.245 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.245 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4385.0:2407 3.0 e31/21 3:07d66135:::rbd_object_map.11212429e5ad:head v 31'51, mlcod=31'44)", 2024-09-13T06:40:01.245 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:38.878449+0000", 2024-09-13T06:40:01.245 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 22.344846664999999, 2024-09-13T06:40:01.245 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0036754119999999999, 2024-09-13T06:40:01.245 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:01.245 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:40:01.245 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:01.245 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.245 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:01.245 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.878449+0000", 2024-09-13T06:40:01.246 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:01.246 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.246 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.246 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:01.246 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.878449+0000", 2024-09-13T06:40:01.246 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:01.246 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.246 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.246 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:01.246 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.878447+0000", 2024-09-13T06:40:01.246 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999981 2024-09-13T06:40:01.246 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.246 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.246 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:01.247 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.878462+0000", 2024-09-13T06:40:01.247 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5133000000000001e-05 2024-09-13T06:40:01.247 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.247 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.247 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:01.247 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.878500+0000", 2024-09-13T06:40:01.247 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.8213999999999997e-05 2024-09-13T06:40:01.247 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.247 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.247 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:01.247 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.878520+0000", 2024-09-13T06:40:01.247 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0000000000000002e-05 2024-09-13T06:40:01.248 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.248 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.248 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:01.248 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.878710+0000", 2024-09-13T06:40:01.248 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00019008100000000001 2024-09-13T06:40:01.248 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.248 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.248 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:01.248 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.878745+0000", 2024-09-13T06:40:01.248 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.4533000000000003e-05 2024-09-13T06:40:01.248 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.248 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.248 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:40:01.249 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.882086+0000", 2024-09-13T06:40:01.249 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0033416409999999998 2024-09-13T06:40:01.249 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.249 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.249 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:01.249 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.882124+0000", 2024-09-13T06:40:01.249 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.7673000000000003e-05 2024-09-13T06:40:01.249 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:01.249 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:01.249 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:01.250 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.250 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.250 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4385.0:2408 3.0 e31/21 3:07d66135:::rbd_object_map.11212429e5ad:head v 31'52, mlcod=31'45)", 2024-09-13T06:40:01.250 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:38.880785+0000", 2024-09-13T06:40:01.250 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 22.342510507, 2024-09-13T06:40:01.250 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.004103382, 2024-09-13T06:40:01.250 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:01.250 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:40:01.250 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:01.250 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.250 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:01.250 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.880785+0000", 2024-09-13T06:40:01.250 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:01.250 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.251 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.251 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:01.251 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.880785+0000", 2024-09-13T06:40:01.251 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:01.251 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.251 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.251 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:01.251 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.880784+0000", 2024-09-13T06:40:01.251 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.999999 2024-09-13T06:40:01.251 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.251 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.251 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:01.252 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.880793+0000", 2024-09-13T06:40:01.252 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.8990000000000007e-06 2024-09-13T06:40:01.252 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.252 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.252 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:01.252 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.880806+0000", 2024-09-13T06:40:01.252 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3597999999999999e-05 2024-09-13T06:40:01.252 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.252 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.252 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:01.252 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.880813+0000", 2024-09-13T06:40:01.252 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.6789999999999999e-06 2024-09-13T06:40:01.252 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.253 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.253 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:01.253 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.880918+0000", 2024-09-13T06:40:01.253 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000105256 2024-09-13T06:40:01.253 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.253 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.253 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:01.253 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.880977+0000", 2024-09-13T06:40:01.253 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8310000000000002e-05 2024-09-13T06:40:01.253 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.253 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.253 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:40:01.253 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.884849+0000", 2024-09-13T06:40:01.253 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.003872693 2024-09-13T06:40:01.254 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.254 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.254 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:01.254 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.884888+0000", 2024-09-13T06:40:01.254 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.8955999999999998e-05 2024-09-13T06:40:01.254 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:01.254 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:01.254 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:01.256 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.256 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.256 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4385.0:2409 3.0 e31/21 3:07d66135:::rbd_object_map.11212429e5ad:head v 31'53, mlcod=31'45)", 2024-09-13T06:40:01.256 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:38.882957+0000", 2024-09-13T06:40:01.256 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 22.340338104000001, 2024-09-13T06:40:01.256 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0049287489999999996, 2024-09-13T06:40:01.256 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:01.256 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:40:01.256 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:01.256 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.256 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:01.256 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.882957+0000", 2024-09-13T06:40:01.256 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:01.257 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.257 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.257 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:01.257 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.882957+0000", 2024-09-13T06:40:01.257 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:01.257 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.257 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.257 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:01.257 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.882956+0000", 2024-09-13T06:40:01.257 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.999999 2024-09-13T06:40:01.257 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.257 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.257 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:01.257 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.882963+0000", 2024-09-13T06:40:01.258 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.8680000000000001e-06 2024-09-13T06:40:01.258 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.258 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.258 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:01.258 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.882975+0000", 2024-09-13T06:40:01.258 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1766000000000001e-05 2024-09-13T06:40:01.258 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.258 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.258 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:01.258 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.882981+0000", 2024-09-13T06:40:01.258 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3559999999999998e-06 2024-09-13T06:40:01.258 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.258 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.258 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:01.259 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.883029+0000", 2024-09-13T06:40:01.259 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7839000000000001e-05 2024-09-13T06:40:01.259 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.259 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.259 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:01.259 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.883047+0000", 2024-09-13T06:40:01.259 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8134e-05 2024-09-13T06:40:01.259 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.259 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.259 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:40:01.259 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.887832+0000", 2024-09-13T06:40:01.259 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0047848839999999997 2024-09-13T06:40:01.259 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.259 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.260 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:01.260 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.887886+0000", 2024-09-13T06:40:01.260 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3702999999999997e-05 2024-09-13T06:40:01.260 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:01.260 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:01.260 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:01.260 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.260 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.260 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4385.0:2410 3.0 e31/21 3:07d66135:::rbd_object_map.11212429e5ad:head v 31'54, mlcod=31'45)", 2024-09-13T06:40:01.260 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:38.885943+0000", 2024-09-13T06:40:01.260 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 22.337352253999999, 2024-09-13T06:40:01.260 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0051076330000000003, 2024-09-13T06:40:01.260 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:01.260 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:40:01.261 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:01.261 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.261 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:01.261 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.885943+0000", 2024-09-13T06:40:01.261 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:01.261 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.261 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.261 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:01.261 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.885943+0000", 2024-09-13T06:40:01.261 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:01.261 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.261 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.261 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:01.262 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.885942+0000", 2024-09-13T06:40:01.262 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.999999 2024-09-13T06:40:01.262 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.262 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.262 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:01.262 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.885949+0000", 2024-09-13T06:40:01.262 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.2679999999999997e-06 2024-09-13T06:40:01.262 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.262 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.262 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:01.263 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.885961+0000", 2024-09-13T06:40:01.263 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1737e-05 2024-09-13T06:40:01.263 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.263 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.263 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:01.263 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.885967+0000", 2024-09-13T06:40:01.263 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0920000000000003e-06 2024-09-13T06:40:01.263 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.263 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.263 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:01.263 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.886019+0000", 2024-09-13T06:40:01.263 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.1669000000000003e-05 2024-09-13T06:40:01.263 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.263 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.264 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:01.264 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.886035+0000", 2024-09-13T06:40:01.264 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6192e-05 2024-09-13T06:40:01.264 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.264 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.264 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:40:01.264 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.890999+0000", 2024-09-13T06:40:01.264 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0049638440000000002 2024-09-13T06:40:01.264 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.264 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.264 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:01.264 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.891051+0000", 2024-09-13T06:40:01.264 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.1700999999999998e-05 2024-09-13T06:40:01.264 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:01.265 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:01.265 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:01.265 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.265 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.265 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4385.0:2411 3.0 e31/21 3:07d66135:::rbd_object_map.11212429e5ad:head v 31'55, mlcod=31'45)", 2024-09-13T06:40:01.265 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:38.887273+0000", 2024-09-13T06:40:01.265 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 22.336021975000001, 2024-09-13T06:40:01.265 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0058469940000000003, 2024-09-13T06:40:01.265 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:01.265 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:40:01.265 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:01.265 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.265 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:01.265 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.887273+0000", 2024-09-13T06:40:01.266 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:01.266 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.266 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.266 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:01.266 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.887273+0000", 2024-09-13T06:40:01.266 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:01.266 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.266 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.266 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:01.266 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.887272+0000", 2024-09-13T06:40:01.266 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.999999 2024-09-13T06:40:01.266 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.266 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.266 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:01.267 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.887280+0000", 2024-09-13T06:40:01.267 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.9060000000000002e-06 2024-09-13T06:40:01.267 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.267 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.267 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:01.267 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.887297+0000", 2024-09-13T06:40:01.267 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6577000000000001e-05 2024-09-13T06:40:01.267 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.267 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.267 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:01.267 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.887306+0000", 2024-09-13T06:40:01.267 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.9579999999999996e-06 2024-09-13T06:40:01.267 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.268 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.268 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:01.268 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.887353+0000", 2024-09-13T06:40:01.268 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7320000000000001e-05 2024-09-13T06:40:01.268 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.268 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.268 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:01.268 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.887374+0000", 2024-09-13T06:40:01.268 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0984000000000001e-05 2024-09-13T06:40:01.268 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.268 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.268 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:40:01.268 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.893037+0000", 2024-09-13T06:40:01.268 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0056629380000000002 2024-09-13T06:40:01.269 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.269 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.269 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:01.269 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.893120+0000", 2024-09-13T06:40:01.269 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.3282000000000007e-05 2024-09-13T06:40:01.269 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:01.269 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:01.269 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:01.269 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.269 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.269 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4385.0:2412 3.0 e31/21 3:07d66135:::rbd_object_map.11212429e5ad:head v 31'56, mlcod=31'48)", 2024-09-13T06:40:01.269 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:38.888795+0000", 2024-09-13T06:40:01.269 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 22.334500419000001, 2024-09-13T06:40:01.270 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0043887409999999998, 2024-09-13T06:40:01.270 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:01.270 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:40:01.270 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:01.270 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.270 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:01.270 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.888795+0000", 2024-09-13T06:40:01.270 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:01.270 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.270 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.270 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:01.270 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.888795+0000", 2024-09-13T06:40:01.270 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:01.270 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.271 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.271 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:01.271 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.888794+0000", 2024-09-13T06:40:01.271 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.999999 2024-09-13T06:40:01.271 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.271 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.271 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:01.271 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.888803+0000", 2024-09-13T06:40:01.271 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.7139999999999999e-06 2024-09-13T06:40:01.271 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.271 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.271 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:01.271 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.888820+0000", 2024-09-13T06:40:01.272 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7555999999999999e-05 2024-09-13T06:40:01.272 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.272 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.272 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:01.272 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.888828+0000", 2024-09-13T06:40:01.272 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.153e-06 2024-09-13T06:40:01.272 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.272 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.272 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:01.272 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.888897+0000", 2024-09-13T06:40:01.272 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.9805e-05 2024-09-13T06:40:01.272 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.272 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.273 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:01.273 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.888928+0000", 2024-09-13T06:40:01.273 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.0633000000000003e-05 2024-09-13T06:40:01.273 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.273 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.273 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:40:01.273 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.893124+0000", 2024-09-13T06:40:01.273 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0041962079999999999 2024-09-13T06:40:01.273 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.273 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.273 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:01.273 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.893184+0000", 2024-09-13T06:40:01.273 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9456000000000001e-05 2024-09-13T06:40:01.273 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:01.274 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:01.274 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:01.274 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.274 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.274 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4385.0:2413 3.0 e31/21 3:07d66135:::rbd_object_map.11212429e5ad:head v 31'57, mlcod=31'51)", 2024-09-13T06:40:01.274 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:38.890237+0000", 2024-09-13T06:40:01.274 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 22.333058218000001, 2024-09-13T06:40:01.274 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0034719220000000001, 2024-09-13T06:40:01.274 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:01.274 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:40:01.274 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:01.274 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.274 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:01.275 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.890237+0000", 2024-09-13T06:40:01.275 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:01.275 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.275 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.275 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:01.275 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.890237+0000", 2024-09-13T06:40:01.275 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:01.275 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.275 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.275 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:01.275 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.890236+0000", 2024-09-13T06:40:01.275 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.999999 2024-09-13T06:40:01.275 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.275 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.276 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:01.276 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.890243+0000", 2024-09-13T06:40:01.276 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.9630000000000001e-06 2024-09-13T06:40:01.276 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.276 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.276 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:01.276 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.890258+0000", 2024-09-13T06:40:01.276 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4321999999999999e-05 2024-09-13T06:40:01.276 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.276 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.276 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:01.276 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.890265+0000", 2024-09-13T06:40:01.276 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3000000000000004e-06 2024-09-13T06:40:01.276 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.277 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.277 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:01.277 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.890389+0000", 2024-09-13T06:40:01.277 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00012409899999999999 2024-09-13T06:40:01.277 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.277 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.277 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:01.277 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.890420+0000", 2024-09-13T06:40:01.277 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.1090000000000002e-05 2024-09-13T06:40:01.277 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.277 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.277 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:40:01.277 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.893629+0000", 2024-09-13T06:40:01.278 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0032087690000000002 2024-09-13T06:40:01.278 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.278 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.278 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:01.278 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.893709+0000", 2024-09-13T06:40:01.278 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.0226000000000001e-05 2024-09-13T06:40:01.278 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:01.278 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:01.278 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:01.278 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.278 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.278 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4385.0:2432 3.0 e31/21 3:07d66135:::rbd_object_map.11212429e5ad:head v 31'62, mlcod=31'58)", 2024-09-13T06:40:01.278 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:38.900535+0000", 2024-09-13T06:40:01.278 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 22.322760197000001, 2024-09-13T06:40:01.278 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0036949130000000002, 2024-09-13T06:40:01.279 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:01.279 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:40:01.279 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:01.279 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.279 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:01.279 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.900535+0000", 2024-09-13T06:40:01.279 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:01.279 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.279 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.279 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:01.279 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.900535+0000", 2024-09-13T06:40:01.279 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:01.279 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.280 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.280 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:01.280 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.900535+0000", 2024-09-13T06:40:01.280 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:01.280 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.280 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.280 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:01.280 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.900541+0000", 2024-09-13T06:40:01.280 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.4169999999999997e-06 2024-09-13T06:40:01.280 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.280 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.280 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:01.280 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.900553+0000", 2024-09-13T06:40:01.281 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2354000000000001e-05 2024-09-13T06:40:01.281 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.281 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.281 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:01.281 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.900560+0000", 2024-09-13T06:40:01.281 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.8990000000000004e-06 2024-09-13T06:40:01.281 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.281 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.281 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:01.281 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.900621+0000", 2024-09-13T06:40:01.281 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0699000000000003e-05 2024-09-13T06:40:01.281 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.281 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.281 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:01.282 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.900660+0000", 2024-09-13T06:40:01.282 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.8609999999999998e-05 2024-09-13T06:40:01.282 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.282 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.282 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:40:01.282 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.904177+0000", 2024-09-13T06:40:01.282 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0035175509999999998 2024-09-13T06:40:01.282 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.282 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.282 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:01.282 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.904230+0000", 2024-09-13T06:40:01.282 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2966000000000001e-05 2024-09-13T06:40:01.282 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:01.282 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:01.283 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:01.283 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.283 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.283 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4385.0:2433 3.0 e31/21 3:07d66135:::rbd_object_map.11212429e5ad:head v 31'63, mlcod=31'58)", 2024-09-13T06:40:01.283 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:38.901375+0000", 2024-09-13T06:40:01.283 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 22.321920786, 2024-09-13T06:40:01.283 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.005560738, 2024-09-13T06:40:01.283 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:01.283 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:40:01.283 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:01.283 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.283 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:01.283 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.901375+0000", 2024-09-13T06:40:01.283 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:01.284 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.284 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.284 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:01.284 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.901375+0000", 2024-09-13T06:40:01.284 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:01.284 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.284 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.284 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:01.284 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.901374+0000", 2024-09-13T06:40:01.284 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.999999 2024-09-13T06:40:01.284 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.284 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.284 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:01.285 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.901381+0000", 2024-09-13T06:40:01.285 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.1019999999999999e-06 2024-09-13T06:40:01.285 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.285 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.285 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:01.285 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.901394+0000", 2024-09-13T06:40:01.285 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2782999999999999e-05 2024-09-13T06:40:01.285 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.285 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.286 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:01.286 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.901400+0000", 2024-09-13T06:40:01.286 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.8449999999999997e-06 2024-09-13T06:40:01.286 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.286 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.286 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:01.286 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.901483+0000", 2024-09-13T06:40:01.286 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.2841000000000002e-05 2024-09-13T06:40:01.286 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.286 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.286 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:01.286 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.901513+0000", 2024-09-13T06:40:01.286 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.0102000000000001e-05 2024-09-13T06:40:01.287 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.287 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.287 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:40:01.287 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.906853+0000", 2024-09-13T06:40:01.287 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.005339402 2024-09-13T06:40:01.287 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.287 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.287 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:01.287 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.906935+0000", 2024-09-13T06:40:01.287 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.2488e-05 2024-09-13T06:40:01.288 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:01.288 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:01.288 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:01.288 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.288 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.288 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4385.0:2434 3.0 e31/21 3:07d66135:::rbd_object_map.11212429e5ad:head v 31'64, mlcod=31'58)", 2024-09-13T06:40:01.288 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:38.902253+0000", 2024-09-13T06:40:01.288 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 22.321042200000001, 2024-09-13T06:40:01.288 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0047392650000000003, 2024-09-13T06:40:01.288 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:01.288 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:40:01.288 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:01.289 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.289 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:01.289 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.902253+0000", 2024-09-13T06:40:01.289 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:01.289 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.289 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.289 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:01.289 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.902253+0000", 2024-09-13T06:40:01.289 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:01.289 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.289 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.289 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:01.289 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.902252+0000", 2024-09-13T06:40:01.289 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.999999 2024-09-13T06:40:01.290 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.290 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.290 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:01.290 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.902259+0000", 2024-09-13T06:40:01.290 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.9709999999999998e-06 2024-09-13T06:40:01.290 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.290 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.290 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:01.290 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.902273+0000", 2024-09-13T06:40:01.290 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3302000000000001e-05 2024-09-13T06:40:01.290 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.290 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.290 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:01.291 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.902280+0000", 2024-09-13T06:40:01.291 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.126e-06 2024-09-13T06:40:01.291 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.291 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.291 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:01.291 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.902334+0000", 2024-09-13T06:40:01.291 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.4512000000000003e-05 2024-09-13T06:40:01.291 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.291 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.291 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:01.291 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.902363+0000", 2024-09-13T06:40:01.291 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.8544e-05 2024-09-13T06:40:01.291 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.292 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.292 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:40:01.292 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.906941+0000", 2024-09-13T06:40:01.292 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0045781320000000004 2024-09-13T06:40:01.292 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.292 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.292 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:01.292 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.906992+0000", 2024-09-13T06:40:01.292 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.1533000000000003e-05 2024-09-13T06:40:01.292 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:01.292 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:01.292 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:01.292 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.293 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.293 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4385.0:2610 3.0 e31/21 3:05b06d2f:::rbd_data.11212429e5ad.0000000000000367:head v 31'112, mlcod=31'110)", 2024-09-13T06:40:01.293 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:39.239230+0000", 2024-09-13T06:40:01.293 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 21.984065425000001, 2024-09-13T06:40:01.293 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0036041720000000001, 2024-09-13T06:40:01.293 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:01.293 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:40:01.293 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:01.293 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.293 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:01.293 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.239230+0000", 2024-09-13T06:40:01.293 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:01.293 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.294 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.294 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:01.294 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.239230+0000", 2024-09-13T06:40:01.294 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:01.294 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.294 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.294 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:01.294 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.239229+0000", 2024-09-13T06:40:01.294 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.999999 2024-09-13T06:40:01.294 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.294 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.294 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:01.294 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.239238+0000", 2024-09-13T06:40:01.294 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.2529999999999993e-06 2024-09-13T06:40:01.295 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.295 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.295 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:01.295 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.240075+0000", 2024-09-13T06:40:01.295 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00083642899999999997 2024-09-13T06:40:01.295 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.295 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.295 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:01.295 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.240084+0000", 2024-09-13T06:40:01.295 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.3160000000000003e-06 2024-09-13T06:40:01.295 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.295 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.295 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:01.296 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.240173+0000", 2024-09-13T06:40:01.296 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.9536999999999993e-05 2024-09-13T06:40:01.296 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.296 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.296 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:01.296 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.240192+0000", 2024-09-13T06:40:01.296 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8547999999999999e-05 2024-09-13T06:40:01.296 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.296 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.296 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:40:01.296 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.242758+0000", 2024-09-13T06:40:01.296 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.002565936 2024-09-13T06:40:01.296 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.296 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.297 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:01.297 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.242834+0000", 2024-09-13T06:40:01.297 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.6198999999999993e-05 2024-09-13T06:40:01.297 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:01.297 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:01.297 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:01.297 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.297 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.297 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4385.0:2665 3.0 e31/21 3:07d66135:::rbd_object_map.11212429e5ad:head v 31'127, mlcod=31'125)", 2024-09-13T06:40:01.297 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:39.384538+0000", 2024-09-13T06:40:01.297 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 21.838757133000001, 2024-09-13T06:40:01.297 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00349468, 2024-09-13T06:40:01.297 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:01.298 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:40:01.298 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:01.298 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.298 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:01.298 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.384538+0000", 2024-09-13T06:40:01.298 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:01.298 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.298 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.298 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:01.298 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.384538+0000", 2024-09-13T06:40:01.298 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:01.298 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.298 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.299 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:01.299 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.384537+0000", 2024-09-13T06:40:01.299 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999986 2024-09-13T06:40:01.299 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.299 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.299 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:01.299 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.384548+0000", 2024-09-13T06:40:01.299 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1542999999999999e-05 2024-09-13T06:40:01.299 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.299 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.299 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:01.300 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.384571+0000", 2024-09-13T06:40:01.300 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2317e-05 2024-09-13T06:40:01.300 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.300 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.300 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:01.300 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.384579+0000", 2024-09-13T06:40:01.300 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.3140000000000004e-06 2024-09-13T06:40:01.300 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.300 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.300 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:01.300 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.384634+0000", 2024-09-13T06:40:01.300 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.5451999999999997e-05 2024-09-13T06:40:01.300 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.301 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.301 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:01.301 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.384663+0000", 2024-09-13T06:40:01.301 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.8419999999999999e-05 2024-09-13T06:40:01.301 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.301 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.301 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:40:01.301 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.387993+0000", 2024-09-13T06:40:01.301 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0033301630000000001 2024-09-13T06:40:01.301 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.301 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.301 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:01.301 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:39.388033+0000", 2024-09-13T06:40:01.302 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.9818999999999999e-05 2024-09-13T06:40:01.302 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:01.302 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:01.302 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:01.302 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.302 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.302 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4385.0:4997 3.9 e38/21 3:904af028:::rbd_data.112150cd58e1.0000000000000008:head v 38'98, mlcod=38'95)", 2024-09-13T06:40:01.302 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:46.743130+0000", 2024-09-13T06:40:01.302 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 14.480165037000001, 2024-09-13T06:40:01.302 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0049048570000000003, 2024-09-13T06:40:01.302 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:01.302 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:40:01.302 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:01.303 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.303 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:01.303 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:46.743130+0000", 2024-09-13T06:40:01.303 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:01.303 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.303 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.303 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:01.303 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:46.743130+0000", 2024-09-13T06:40:01.303 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:01.303 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.303 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.303 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:01.303 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:46.743129+0000", 2024-09-13T06:40:01.304 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.999999 2024-09-13T06:40:01.304 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.304 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.304 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:01.304 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:46.743138+0000", 2024-09-13T06:40:01.304 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.6519999999999995e-06 2024-09-13T06:40:01.304 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.304 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.304 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:01.304 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:46.743152+0000", 2024-09-13T06:40:01.304 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3757999999999999e-05 2024-09-13T06:40:01.304 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.304 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.304 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:01.305 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:46.743160+0000", 2024-09-13T06:40:01.305 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.5550000000000003e-06 2024-09-13T06:40:01.305 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.305 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.305 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:01.305 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:46.743208+0000", 2024-09-13T06:40:01.305 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7348999999999997e-05 2024-09-13T06:40:01.305 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.305 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.305 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:01.305 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:46.743233+0000", 2024-09-13T06:40:01.305 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5058e-05 2024-09-13T06:40:01.305 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.306 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.306 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:40:01.306 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:46.747999+0000", 2024-09-13T06:40:01.306 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0047658680000000004 2024-09-13T06:40:01.306 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.306 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.306 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:01.306 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:46.748035+0000", 2024-09-13T06:40:01.306 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.6421000000000002e-05 2024-09-13T06:40:01.306 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:01.306 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:01.306 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:01.306 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.306 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.306 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4385.0:20848 3.13 e44/40 3:ca725a17:::rbd_object_map.1121f2c5ee81.0000000000000011:head v 44'151, mlcod=44'149)", 2024-09-13T06:40:01.307 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.727815+0000", 2024-09-13T06:40:01.307 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 8.4954798220000001, 2024-09-13T06:40:01.307 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0047140769999999997, 2024-09-13T06:40:01.307 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:01.307 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:40:01.307 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:01.307 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.307 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:01.307 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.727815+0000", 2024-09-13T06:40:01.307 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:01.307 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.307 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.307 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:01.308 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.727815+0000", 2024-09-13T06:40:01.308 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:01.308 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.308 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.308 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:01.308 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.727814+0000", 2024-09-13T06:40:01.308 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999986 2024-09-13T06:40:01.308 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.308 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.308 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:01.308 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.727824+0000", 2024-09-13T06:40:01.308 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0454e-05 2024-09-13T06:40:01.308 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.309 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.309 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:01.309 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.727845+0000", 2024-09-13T06:40:01.309 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0068000000000002e-05 2024-09-13T06:40:01.309 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.309 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.309 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:01.309 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.727858+0000", 2024-09-13T06:40:01.309 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3301e-05 2024-09-13T06:40:01.309 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.309 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.309 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:01.309 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.727999+0000", 2024-09-13T06:40:01.309 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000141213 2024-09-13T06:40:01.310 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.310 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.310 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:01.310 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.728063+0000", 2024-09-13T06:40:01.310 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3862999999999995e-05 2024-09-13T06:40:01.310 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.310 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.310 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:40:01.310 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.732468+0000", 2024-09-13T06:40:01.310 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0044050529999999999 2024-09-13T06:40:01.310 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.310 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.310 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:01.310 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.732530+0000", 2024-09-13T06:40:01.311 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.1569000000000006e-05 2024-09-13T06:40:01.311 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:01.311 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:01.311 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:01.311 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.311 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.311 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4385.0:20851 3.13 e44/40 3:ca725a17:::rbd_object_map.1121f2c5ee81.0000000000000011:head v 44'152, mlcod=44'149)", 2024-09-13T06:40:01.311 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.728856+0000", 2024-09-13T06:40:01.311 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 8.4944388400000008, 2024-09-13T06:40:01.311 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0037075770000000001, 2024-09-13T06:40:01.311 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:01.311 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:40:01.311 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:01.312 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.312 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:01.312 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.728856+0000", 2024-09-13T06:40:01.312 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:01.312 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.312 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.312 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:01.312 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.728856+0000", 2024-09-13T06:40:01.312 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:01.312 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.312 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.312 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:01.312 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.728855+0000", 2024-09-13T06:40:01.312 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.999999 2024-09-13T06:40:01.313 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.313 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.313 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:01.313 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.728865+0000", 2024-09-13T06:40:01.313 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.431e-06 2024-09-13T06:40:01.313 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.313 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.313 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:01.313 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.728881+0000", 2024-09-13T06:40:01.313 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5642e-05 2024-09-13T06:40:01.313 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.313 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.313 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:01.314 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.728890+0000", 2024-09-13T06:40:01.314 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.4069999999999999e-06 2024-09-13T06:40:01.314 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.314 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.314 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:01.314 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.729222+0000", 2024-09-13T06:40:01.314 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00033190999999999998 2024-09-13T06:40:01.314 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.314 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.314 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:01.314 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.729275+0000", 2024-09-13T06:40:01.314 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3179e-05 2024-09-13T06:40:01.314 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.314 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.315 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:40:01.315 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.732534+0000", 2024-09-13T06:40:01.315 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0032586210000000002 2024-09-13T06:40:01.315 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.315 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.315 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:01.315 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.732564+0000", 2024-09-13T06:40:01.315 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.0352999999999999e-05 2024-09-13T06:40:01.315 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:01.315 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:01.315 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:01.315 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:01.315 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:01.315 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:40:01.317 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-13T06:40:01.317 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:40:01.319+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:40:01.418 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:40:01.418+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:40:01.486 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:40:01.486 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-13T06:40:01.486 INFO:teuthology.orchestra.run.smithi081.stdout: "num_ops": 0 2024-09-13T06:40:01.486 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:40:01.500 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-13T06:40:01.543 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:40:01.546+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:40:01.609 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-13T06:40:01.655 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:40:01.658+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:40:01.671 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:40:01.671 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-13T06:40:01.671 INFO:teuthology.orchestra.run.smithi081.stdout: "complaint_time": 30, 2024-09-13T06:40:01.671 INFO:teuthology.orchestra.run.smithi081.stdout: "num_blocked_ops": 0 2024-09-13T06:40:01.671 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:40:01.686 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-13T06:40:01.721 INFO:tasks.ceph.osd.6.smithi139.stderr:2024-09-13T06:40:01.725+0000 7fcd02c5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26385) UID: 0 2024-09-13T06:40:01.821 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:40:01.822+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:40:01.847 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:40:01.847 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 20, 2024-09-13T06:40:01.847 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 600, 2024-09-13T06:40:01.847 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [ 2024-09-13T06:40:01.847 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.847 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:2226 3.15 3:af026987:::rbd_data.112173e2f1b7.0000000000000017:head [sparse-read 0~4194304] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-13T06:40:01.847 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:37.606562+0000", 2024-09-13T06:40:01.847 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 24.242936827000001, 2024-09-13T06:40:01.847 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.83322091700000001, 2024-09-13T06:40:01.848 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:01.848 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:40:01.848 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:01.848 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:01.848 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:01.848 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 2226 2024-09-13T06:40:01.848 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.848 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:01.848 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.848 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:01.848 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606562+0000", 2024-09-13T06:40:01.848 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:01.848 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.849 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.849 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:01.849 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606562+0000", 2024-09-13T06:40:01.849 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:01.849 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.849 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.849 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:01.849 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606561+0000", 2024-09-13T06:40:01.849 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:01.849 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.850 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.850 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:01.850 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606565+0000", 2024-09-13T06:40:01.850 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.4379999999999999e-06 2024-09-13T06:40:01.850 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.850 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.850 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:01.850 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606569+0000", 2024-09-13T06:40:01.850 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.425e-06 2024-09-13T06:40:01.850 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.850 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.850 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:01.850 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606572+0000", 2024-09-13T06:40:01.851 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.05e-06 2024-09-13T06:40:01.851 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.851 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.851 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:01.851 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606621+0000", 2024-09-13T06:40:01.851 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.8723000000000001e-05 2024-09-13T06:40:01.851 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.851 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.851 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:40:01.851 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606630+0000", 2024-09-13T06:40:01.851 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.8040000000000007e-06 2024-09-13T06:40:01.852 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.852 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.852 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:01.852 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.439648+0000", 2024-09-13T06:40:01.852 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.83301824800000002 2024-09-13T06:40:01.852 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.852 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.852 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:01.852 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.439782+0000", 2024-09-13T06:40:01.852 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00013466699999999999 2024-09-13T06:40:01.853 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:01.853 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:01.853 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:01.853 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.853 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.854 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25661 3.8 3:1180686c:::rbd_data.1121f2c5ee81.0000000000000009:13 [read 397312~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:01.854 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.436956+0000", 2024-09-13T06:40:01.854 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 5.4125422929999996, 2024-09-13T06:40:01.854 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089036758999999993, 2024-09-13T06:40:01.854 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:01.854 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:01.854 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:01.854 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:01.854 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:01.854 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25661 2024-09-13T06:40:01.854 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.855 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:01.855 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.855 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:01.855 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436956+0000", 2024-09-13T06:40:01.855 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:01.855 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.855 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.855 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:01.855 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436956+0000", 2024-09-13T06:40:01.855 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:01.855 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.856 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.856 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:01.856 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436956+0000", 2024-09-13T06:40:01.856 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:01.856 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.856 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.856 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:01.856 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436958+0000", 2024-09-13T06:40:01.856 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1770000000000001e-06 2024-09-13T06:40:01.856 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.856 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.857 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:01.857 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436963+0000", 2024-09-13T06:40:01.857 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.6489999999999996e-06 2024-09-13T06:40:01.857 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.857 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.857 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:01.857 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436975+0000", 2024-09-13T06:40:01.857 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1783999999999999e-05 2024-09-13T06:40:01.857 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.857 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.857 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:01.858 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.525671+0000", 2024-09-13T06:40:01.858 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.088696292999999995 2024-09-13T06:40:01.858 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.858 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.858 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:01.858 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.525749+0000", 2024-09-13T06:40:01.858 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.7589000000000005e-05 2024-09-13T06:40:01.858 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.858 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.858 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:01.858 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.525993+0000", 2024-09-13T06:40:01.858 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00024381000000000001 2024-09-13T06:40:01.859 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:01.859 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:01.859 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:01.859 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.859 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.859 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25662 3.8 3:1180686c:::rbd_data.1121f2c5ee81.0000000000000009:13 [read 421888~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:01.859 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.436980+0000", 2024-09-13T06:40:01.859 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 5.4125179809999997, 2024-09-13T06:40:01.859 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089367577000000004, 2024-09-13T06:40:01.859 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:01.859 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:01.860 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:01.860 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:01.860 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:01.860 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25662 2024-09-13T06:40:01.860 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.860 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:01.860 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.860 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:01.860 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436980+0000", 2024-09-13T06:40:01.860 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:01.860 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.861 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.861 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:01.861 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436980+0000", 2024-09-13T06:40:01.861 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:01.861 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.861 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.861 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:01.861 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436980+0000", 2024-09-13T06:40:01.861 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:01.861 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.861 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.862 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:01.862 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436982+0000", 2024-09-13T06:40:01.862 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3989999999999998e-06 2024-09-13T06:40:01.862 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.862 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.862 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:01.862 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436988+0000", 2024-09-13T06:40:01.863 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0039999999999996e-06 2024-09-13T06:40:01.863 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.863 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.863 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:01.863 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436993+0000", 2024-09-13T06:40:01.863 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6090000000000003e-06 2024-09-13T06:40:01.863 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.863 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.863 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:01.863 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.526035+0000", 2024-09-13T06:40:01.863 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089042248000000004 2024-09-13T06:40:01.863 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.864 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.864 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:01.864 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.526111+0000", 2024-09-13T06:40:01.864 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5643999999999996e-05 2024-09-13T06:40:01.864 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.864 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.864 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:01.865 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.526348+0000", 2024-09-13T06:40:01.865 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00023705800000000001 2024-09-13T06:40:01.865 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:01.865 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:01.865 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:01.865 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.865 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.865 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25663 3.8 3:1180686c:::rbd_data.1121f2c5ee81.0000000000000009:13 [read 466944~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:01.865 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.436998+0000", 2024-09-13T06:40:01.865 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 5.4125003339999997, 2024-09-13T06:40:01.866 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089730867000000006, 2024-09-13T06:40:01.866 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:01.866 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:01.866 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:01.866 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:01.866 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:01.866 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25663 2024-09-13T06:40:01.866 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.866 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:01.866 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.866 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:01.867 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436998+0000", 2024-09-13T06:40:01.867 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:01.867 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.867 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.867 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:01.867 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436998+0000", 2024-09-13T06:40:01.867 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:01.867 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.867 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.867 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:01.867 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436998+0000", 2024-09-13T06:40:01.868 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:01.868 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.868 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.868 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:01.868 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437000+0000", 2024-09-13T06:40:01.868 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0940000000000002e-06 2024-09-13T06:40:01.868 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.868 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.868 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:01.868 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437005+0000", 2024-09-13T06:40:01.868 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.604e-06 2024-09-13T06:40:01.869 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.869 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.869 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:01.869 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437032+0000", 2024-09-13T06:40:01.869 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6407e-05 2024-09-13T06:40:01.869 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.869 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.869 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:01.869 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.526363+0000", 2024-09-13T06:40:01.869 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089331456000000004 2024-09-13T06:40:01.869 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.869 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.870 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:01.870 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.526404+0000", 2024-09-13T06:40:01.870 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.0887999999999999e-05 2024-09-13T06:40:01.870 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.870 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.870 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:01.870 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.526729+0000", 2024-09-13T06:40:01.870 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00032486 2024-09-13T06:40:01.870 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:01.870 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:01.870 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:01.871 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.871 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.871 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25664 3.8 3:1180686c:::rbd_data.1121f2c5ee81.0000000000000009:13 [read 491520~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:01.871 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.437040+0000", 2024-09-13T06:40:01.871 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 5.412458419, 2024-09-13T06:40:01.871 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.090016650000000004, 2024-09-13T06:40:01.871 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:01.871 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:01.871 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:01.871 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:01.871 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:01.871 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25664 2024-09-13T06:40:01.872 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.872 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:01.872 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.872 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:01.872 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437040+0000", 2024-09-13T06:40:01.872 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:01.872 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.872 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.872 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:01.872 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437040+0000", 2024-09-13T06:40:01.872 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:01.873 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.873 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.873 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:01.873 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437039+0000", 2024-09-13T06:40:01.873 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:01.873 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.873 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.873 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:01.873 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437047+0000", 2024-09-13T06:40:01.873 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4839999999999998e-06 2024-09-13T06:40:01.873 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.874 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.874 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:01.874 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437054+0000", 2024-09-13T06:40:01.874 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.8299999999999998e-06 2024-09-13T06:40:01.874 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.874 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.874 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:01.874 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437060+0000", 2024-09-13T06:40:01.874 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.1510000000000001e-06 2024-09-13T06:40:01.874 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.874 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.874 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:01.875 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.526772+0000", 2024-09-13T06:40:01.875 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089711737999999999 2024-09-13T06:40:01.875 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.875 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.875 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:01.875 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.526848+0000", 2024-09-13T06:40:01.875 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5870000000000004e-05 2024-09-13T06:40:01.875 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.875 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.875 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:01.875 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.527057+0000", 2024-09-13T06:40:01.875 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000209106 2024-09-13T06:40:01.876 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:01.876 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:01.876 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:01.876 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.876 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.876 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25740 3.18 3:1c662b96:::rbd_data.1121f2c5ee81.0000000000000010:13 [read 200704~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:01.876 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443352+0000", 2024-09-13T06:40:01.876 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 5.4061467439999999, 2024-09-13T06:40:01.876 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089068222000000002, 2024-09-13T06:40:01.876 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:01.876 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:01.877 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:01.877 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:01.877 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:01.877 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25740 2024-09-13T06:40:01.877 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.877 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:01.877 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.877 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:01.877 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443352+0000", 2024-09-13T06:40:01.877 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:01.877 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.877 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.878 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:01.878 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443352+0000", 2024-09-13T06:40:01.878 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:01.878 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.878 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.878 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:01.878 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443351+0000", 2024-09-13T06:40:01.878 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:01.878 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.878 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.878 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:01.879 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443354+0000", 2024-09-13T06:40:01.879 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.841e-06 2024-09-13T06:40:01.879 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.879 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.879 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:01.879 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443361+0000", 2024-09-13T06:40:01.879 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.0010000000000004e-06 2024-09-13T06:40:01.879 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.879 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.879 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:01.879 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443366+0000", 2024-09-13T06:40:01.879 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7119999999999999e-06 2024-09-13T06:40:01.880 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.880 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.880 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:01.880 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532117+0000", 2024-09-13T06:40:01.880 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.088751327000000005 2024-09-13T06:40:01.880 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.880 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.880 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:01.880 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532193+0000", 2024-09-13T06:40:01.880 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5839000000000004e-05 2024-09-13T06:40:01.880 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.880 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.881 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:01.881 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532420+0000", 2024-09-13T06:40:01.881 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00022691000000000001 2024-09-13T06:40:01.881 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:01.881 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:01.881 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:01.881 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.881 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.881 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25741 3.18 3:1c662b96:::rbd_data.1121f2c5ee81.0000000000000010:13 [read 225280~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:01.881 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443378+0000", 2024-09-13T06:40:01.881 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 5.4061199770000004, 2024-09-13T06:40:01.881 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089324107, 2024-09-13T06:40:01.882 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:01.882 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:01.882 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:01.882 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:01.882 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:01.882 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25741 2024-09-13T06:40:01.882 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.882 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:01.882 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.882 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:01.882 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443378+0000", 2024-09-13T06:40:01.883 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:01.883 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.883 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.883 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:01.883 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443378+0000", 2024-09-13T06:40:01.883 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:01.883 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.883 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.883 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:01.883 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443378+0000", 2024-09-13T06:40:01.883 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:01.884 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.884 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.884 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:01.884 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443380+0000", 2024-09-13T06:40:01.884 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3549999999999999e-06 2024-09-13T06:40:01.884 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.884 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.884 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:01.884 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443388+0000", 2024-09-13T06:40:01.884 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.7449999999999995e-06 2024-09-13T06:40:01.884 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.885 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.885 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:01.885 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443393+0000", 2024-09-13T06:40:01.885 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.4e-06 2024-09-13T06:40:01.885 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.885 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.885 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:01.885 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532454+0000", 2024-09-13T06:40:01.885 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089060941000000005 2024-09-13T06:40:01.885 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.886 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.886 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:01.886 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532512+0000", 2024-09-13T06:40:01.886 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7763000000000002e-05 2024-09-13T06:40:01.886 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.886 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.886 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:01.886 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532703+0000", 2024-09-13T06:40:01.886 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000190328 2024-09-13T06:40:01.886 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:01.886 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:01.886 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:01.886 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.886 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.887 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25742 3.18 3:1c662b96:::rbd_data.1121f2c5ee81.0000000000000010:13 [read 270336~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:01.887 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443398+0000", 2024-09-13T06:40:01.887 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 5.4061002650000001, 2024-09-13T06:40:01.887 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089621836999999996, 2024-09-13T06:40:01.887 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:01.887 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:01.887 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:01.887 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:01.887 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:01.887 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25742 2024-09-13T06:40:01.887 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.887 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:01.887 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.888 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:01.888 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443398+0000", 2024-09-13T06:40:01.888 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:01.888 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.888 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.888 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:01.888 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443398+0000", 2024-09-13T06:40:01.888 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:01.888 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.888 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.888 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:01.888 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443398+0000", 2024-09-13T06:40:01.888 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:01.889 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.889 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.889 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:01.889 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443400+0000", 2024-09-13T06:40:01.889 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1849999999999998e-06 2024-09-13T06:40:01.889 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.889 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.889 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:01.889 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443407+0000", 2024-09-13T06:40:01.889 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3669999999999999e-06 2024-09-13T06:40:01.889 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.889 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.889 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:01.890 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443420+0000", 2024-09-13T06:40:01.890 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2645e-05 2024-09-13T06:40:01.890 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.890 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.890 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:01.890 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532742+0000", 2024-09-13T06:40:01.890 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089322200000000004 2024-09-13T06:40:01.890 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.890 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.890 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:01.890 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532818+0000", 2024-09-13T06:40:01.890 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.6019000000000005e-05 2024-09-13T06:40:01.890 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.891 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.891 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:01.891 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533020+0000", 2024-09-13T06:40:01.891 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000201721 2024-09-13T06:40:01.891 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:01.891 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:01.891 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:01.891 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.891 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.891 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25743 3.18 3:1c662b96:::rbd_data.1121f2c5ee81.0000000000000010:13 [read 294912~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:01.891 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443425+0000", 2024-09-13T06:40:01.891 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 5.4060732570000001, 2024-09-13T06:40:01.891 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089864075000000002, 2024-09-13T06:40:01.891 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:01.892 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:01.892 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:01.892 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:01.892 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:01.892 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25743 2024-09-13T06:40:01.892 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.892 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:01.892 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.892 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:01.892 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443425+0000", 2024-09-13T06:40:01.892 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:01.892 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.893 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.893 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:01.893 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443425+0000", 2024-09-13T06:40:01.893 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:01.893 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.893 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.893 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:01.893 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443425+0000", 2024-09-13T06:40:01.893 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:01.893 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.893 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.893 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:01.893 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443432+0000", 2024-09-13T06:40:01.894 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3420000000000002e-06 2024-09-13T06:40:01.894 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.894 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.894 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:01.894 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443440+0000", 2024-09-13T06:40:01.894 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5689999999999999e-06 2024-09-13T06:40:01.894 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.894 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.894 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:01.894 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443445+0000", 2024-09-13T06:40:01.894 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9590000000000003e-06 2024-09-13T06:40:01.894 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.894 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.895 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:01.895 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533063+0000", 2024-09-13T06:40:01.895 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089617988999999995 2024-09-13T06:40:01.895 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.895 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.895 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:01.895 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533122+0000", 2024-09-13T06:40:01.895 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9052999999999999e-05 2024-09-13T06:40:01.895 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.895 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.895 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:01.895 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533289+0000", 2024-09-13T06:40:01.895 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00016752800000000001 2024-09-13T06:40:01.895 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:01.896 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:01.896 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:01.896 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.896 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.896 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25744 3.18 3.69d46638 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:01.896 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443449+0000", 2024-09-13T06:40:01.896 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 5.4060491099999997, 2024-09-13T06:40:01.896 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089869148999999995, 2024-09-13T06:40:01.896 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:01.896 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:40:01.896 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:01.896 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:01.896 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:01.897 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25744 2024-09-13T06:40:01.897 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.897 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:01.897 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.897 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:01.897 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443449+0000", 2024-09-13T06:40:01.897 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:01.897 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.897 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.897 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:01.897 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443449+0000", 2024-09-13T06:40:01.897 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:01.898 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.898 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.898 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:01.898 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443449+0000", 2024-09-13T06:40:01.898 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:01.898 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.898 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.898 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:01.898 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443451+0000", 2024-09-13T06:40:01.898 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.244e-06 2024-09-13T06:40:01.898 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.898 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.898 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:01.899 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443457+0000", 2024-09-13T06:40:01.899 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.66e-06 2024-09-13T06:40:01.899 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.899 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.899 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:01.899 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443461+0000", 2024-09-13T06:40:01.899 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5449999999999997e-06 2024-09-13T06:40:01.899 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.899 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.899 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:01.899 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533311+0000", 2024-09-13T06:40:01.899 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089849729000000003 2024-09-13T06:40:01.899 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.900 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.900 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:01.900 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533318+0000", 2024-09-13T06:40:01.900 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.328e-06 2024-09-13T06:40:01.900 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:01.900 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:01.900 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:01.900 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.900 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.900 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25745 3.18 3.69d46638 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:01.900 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443466+0000", 2024-09-13T06:40:01.900 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 5.4060320519999996, 2024-09-13T06:40:01.900 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089886743000000005, 2024-09-13T06:40:01.901 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:01.901 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:40:01.901 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:01.901 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:01.901 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:01.901 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25745 2024-09-13T06:40:01.901 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.901 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:01.901 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.901 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:01.901 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443466+0000", 2024-09-13T06:40:01.901 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:01.901 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.902 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.902 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:01.902 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443466+0000", 2024-09-13T06:40:01.902 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:01.902 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.902 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.902 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:01.902 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443466+0000", 2024-09-13T06:40:01.902 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:01.902 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.902 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.902 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:01.903 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443474+0000", 2024-09-13T06:40:01.903 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.1289999999999996e-06 2024-09-13T06:40:01.903 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.903 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.903 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:01.903 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443484+0000", 2024-09-13T06:40:01.903 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0654e-05 2024-09-13T06:40:01.903 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.903 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.903 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:01.903 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443490+0000", 2024-09-13T06:40:01.903 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8030000000000002e-06 2024-09-13T06:40:01.903 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.903 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.904 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:01.904 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533348+0000", 2024-09-13T06:40:01.904 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089857267000000005 2024-09-13T06:40:01.904 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.904 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.904 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:01.904 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533353+0000", 2024-09-13T06:40:01.904 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.5520000000000004e-06 2024-09-13T06:40:01.904 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:01.904 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:01.904 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:01.904 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.905 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.905 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25746 3.18 3.69d46638 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:01.905 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443495+0000", 2024-09-13T06:40:01.905 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 5.4060029390000004, 2024-09-13T06:40:01.905 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089903725000000004, 2024-09-13T06:40:01.905 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:01.905 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:40:01.905 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:01.905 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:01.905 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:01.905 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25746 2024-09-13T06:40:01.905 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.905 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:01.906 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.906 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:01.906 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443495+0000", 2024-09-13T06:40:01.906 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:01.906 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.906 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.906 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:01.906 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443495+0000", 2024-09-13T06:40:01.906 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:01.906 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.906 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.906 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:01.906 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443495+0000", 2024-09-13T06:40:01.906 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:01.907 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.907 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.907 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:01.907 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443498+0000", 2024-09-13T06:40:01.907 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.7690000000000001e-06 2024-09-13T06:40:01.907 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.907 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.907 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:01.907 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443504+0000", 2024-09-13T06:40:01.907 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9710000000000001e-06 2024-09-13T06:40:01.907 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.907 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.908 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:01.908 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443508+0000", 2024-09-13T06:40:01.908 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4159999999999997e-06 2024-09-13T06:40:01.908 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.908 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.908 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:01.908 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533391+0000", 2024-09-13T06:40:01.908 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089882607000000003 2024-09-13T06:40:01.908 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.908 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.908 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:01.908 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533399+0000", 2024-09-13T06:40:01.908 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.4349999999999997e-06 2024-09-13T06:40:01.908 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:01.908 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:01.909 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:01.909 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.909 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.909 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25747 3.8 3.63996268 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:01.909 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443512+0000", 2024-09-13T06:40:01.909 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 5.4059862079999998, 2024-09-13T06:40:01.909 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089880075000000004, 2024-09-13T06:40:01.909 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:01.909 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:40:01.909 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:01.909 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:01.909 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:01.909 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25747 2024-09-13T06:40:01.909 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.910 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:01.910 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.910 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:01.910 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443512+0000", 2024-09-13T06:40:01.910 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:01.910 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.910 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.910 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:01.910 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443512+0000", 2024-09-13T06:40:01.910 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:01.910 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.910 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.910 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:01.910 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443512+0000", 2024-09-13T06:40:01.911 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:01.911 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.911 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.911 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:01.911 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443514+0000", 2024-09-13T06:40:01.911 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0980000000000001e-06 2024-09-13T06:40:01.911 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.911 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.911 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:01.911 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443520+0000", 2024-09-13T06:40:01.911 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7069999999999997e-06 2024-09-13T06:40:01.911 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.911 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.911 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:01.911 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443524+0000", 2024-09-13T06:40:01.912 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5390000000000001e-06 2024-09-13T06:40:01.912 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.912 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.912 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:01.912 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533384+0000", 2024-09-13T06:40:01.912 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089859684999999995 2024-09-13T06:40:01.912 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.912 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.912 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:01.912 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533392+0000", 2024-09-13T06:40:01.912 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.3440000000000001e-06 2024-09-13T06:40:01.912 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:01.912 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:01.913 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:01.913 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.913 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.913 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25748 3.8 3.63996268 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:01.913 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443528+0000", 2024-09-13T06:40:01.913 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 5.4059700809999995, 2024-09-13T06:40:01.913 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089890715999999996, 2024-09-13T06:40:01.913 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:01.913 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:40:01.913 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:01.913 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:01.913 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:01.913 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25748 2024-09-13T06:40:01.914 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.914 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:01.914 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.914 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:01.914 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443528+0000", 2024-09-13T06:40:01.914 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:01.914 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.914 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.914 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:01.914 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443528+0000", 2024-09-13T06:40:01.914 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:01.914 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.914 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.914 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:01.915 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443528+0000", 2024-09-13T06:40:01.915 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:01.915 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.915 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.915 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:01.915 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443530+0000", 2024-09-13T06:40:01.915 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0650000000000001e-06 2024-09-13T06:40:01.915 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.915 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.915 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:01.915 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443536+0000", 2024-09-13T06:40:01.916 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7259999999999999e-06 2024-09-13T06:40:01.916 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.916 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.916 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:01.916 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443540+0000", 2024-09-13T06:40:01.916 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5009999999999998e-06 2024-09-13T06:40:01.916 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.917 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.917 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:01.917 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533412+0000", 2024-09-13T06:40:01.917 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089871873000000005 2024-09-13T06:40:01.917 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.917 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.917 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:01.917 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533419+0000", 2024-09-13T06:40:01.917 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.883e-06 2024-09-13T06:40:01.917 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:01.917 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:01.917 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:01.918 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.918 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.918 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25749 3.8 3.63996268 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:01.918 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443545+0000", 2024-09-13T06:40:01.918 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 5.4059538849999997, 2024-09-13T06:40:01.918 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089897988999999998, 2024-09-13T06:40:01.918 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:01.918 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:40:01.918 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:01.918 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:01.918 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:01.918 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25749 2024-09-13T06:40:01.918 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.918 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:01.919 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.919 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:01.919 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443545+0000", 2024-09-13T06:40:01.919 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:01.919 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.919 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.919 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:01.919 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443545+0000", 2024-09-13T06:40:01.919 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:01.919 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.919 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.919 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:01.919 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443544+0000", 2024-09-13T06:40:01.920 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:01.920 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.920 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.920 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:01.920 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443553+0000", 2024-09-13T06:40:01.920 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.4770000000000003e-06 2024-09-13T06:40:01.920 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.920 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.920 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:01.920 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443564+0000", 2024-09-13T06:40:01.920 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0986e-05 2024-09-13T06:40:01.920 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.920 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.921 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:01.921 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443569+0000", 2024-09-13T06:40:01.921 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2530000000000004e-06 2024-09-13T06:40:01.921 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.921 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.921 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:01.921 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533438+0000", 2024-09-13T06:40:01.921 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089868641999999999 2024-09-13T06:40:01.921 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.921 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.921 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:01.921 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533442+0000", 2024-09-13T06:40:01.921 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.989e-06 2024-09-13T06:40:01.922 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:01.922 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:01.922 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:01.922 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.922 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.922 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25750 3.8 3.63996268 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:01.922 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443574+0000", 2024-09-13T06:40:01.922 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 5.4059243989999999, 2024-09-13T06:40:01.922 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089895143999999996, 2024-09-13T06:40:01.922 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:01.922 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:40:01.922 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:01.922 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:01.923 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:01.923 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25750 2024-09-13T06:40:01.923 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.923 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:01.923 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.923 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:01.923 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443574+0000", 2024-09-13T06:40:01.923 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:01.923 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.923 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.923 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:01.923 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443574+0000", 2024-09-13T06:40:01.923 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:01.924 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.924 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.924 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:01.924 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443574+0000", 2024-09-13T06:40:01.924 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:01.924 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.924 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.924 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:01.924 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443576+0000", 2024-09-13T06:40:01.924 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6910000000000002e-06 2024-09-13T06:40:01.924 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.924 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.924 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:01.925 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443583+0000", 2024-09-13T06:40:01.925 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.331e-06 2024-09-13T06:40:01.925 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.925 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.925 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:01.925 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443587+0000", 2024-09-13T06:40:01.925 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6129999999999997e-06 2024-09-13T06:40:01.925 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.925 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.925 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:01.925 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533464+0000", 2024-09-13T06:40:01.925 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089876605999999998 2024-09-13T06:40:01.925 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.926 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.926 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:01.926 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533469+0000", 2024-09-13T06:40:01.926 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3909999999999997e-06 2024-09-13T06:40:01.926 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:01.926 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:01.926 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:01.926 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.926 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.926 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25751 3.8 3.63996268 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:01.926 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443592+0000", 2024-09-13T06:40:01.926 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 5.4059067020000002, 2024-09-13T06:40:01.926 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089913650999999997, 2024-09-13T06:40:01.927 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:01.927 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:40:01.927 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:01.927 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:01.927 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:01.927 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25751 2024-09-13T06:40:01.927 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.927 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:01.927 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.927 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:01.927 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443592+0000", 2024-09-13T06:40:01.927 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:01.927 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.927 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.928 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:01.928 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443592+0000", 2024-09-13T06:40:01.928 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:01.928 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.928 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.928 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:01.928 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443591+0000", 2024-09-13T06:40:01.928 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:01.928 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.928 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.928 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:01.928 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443594+0000", 2024-09-13T06:40:01.928 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3649999999999998e-06 2024-09-13T06:40:01.929 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.929 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.929 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:01.929 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443599+0000", 2024-09-13T06:40:01.929 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.699e-06 2024-09-13T06:40:01.929 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.929 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.929 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:01.929 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443611+0000", 2024-09-13T06:40:01.929 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1503e-05 2024-09-13T06:40:01.929 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.929 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.930 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:01.930 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533497+0000", 2024-09-13T06:40:01.930 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089886453000000005 2024-09-13T06:40:01.930 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.930 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.930 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:01.930 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533505+0000", 2024-09-13T06:40:01.930 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.9910000000000002e-06 2024-09-13T06:40:01.930 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:01.930 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:01.930 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:01.930 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.930 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.930 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25752 3.8 3.63996268 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:01.931 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443615+0000", 2024-09-13T06:40:01.931 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 5.4058829209999999, 2024-09-13T06:40:01.931 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089905868999999999, 2024-09-13T06:40:01.931 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:01.931 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:40:01.931 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:01.931 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:01.931 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:01.931 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25752 2024-09-13T06:40:01.931 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.931 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:01.931 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.931 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:01.931 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443615+0000", 2024-09-13T06:40:01.932 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:01.932 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.932 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.932 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:01.932 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443615+0000", 2024-09-13T06:40:01.932 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:01.932 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.932 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.932 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:01.932 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443615+0000", 2024-09-13T06:40:01.932 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:01.932 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.933 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.933 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:01.933 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443617+0000", 2024-09-13T06:40:01.933 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3539999999999998e-06 2024-09-13T06:40:01.933 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.933 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.933 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:01.933 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443624+0000", 2024-09-13T06:40:01.933 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3600000000000001e-06 2024-09-13T06:40:01.933 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.933 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.933 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:01.933 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443628+0000", 2024-09-13T06:40:01.934 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.2350000000000001e-06 2024-09-13T06:40:01.934 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.934 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.934 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:01.934 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533517+0000", 2024-09-13T06:40:01.934 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089889029999999995 2024-09-13T06:40:01.934 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.934 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.934 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:01.934 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533521+0000", 2024-09-13T06:40:01.934 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.2529999999999998e-06 2024-09-13T06:40:01.934 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:01.934 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:01.934 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:01.935 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.935 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.935 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25755 3.8 3.63996268 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:01.935 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.444692+0000", 2024-09-13T06:40:01.935 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 5.4048062149999998, 2024-09-13T06:40:01.935 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.088904186999999996, 2024-09-13T06:40:01.935 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:01.935 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:40:01.935 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:01.935 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:01.935 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:01.935 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25755 2024-09-13T06:40:01.935 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.935 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:01.936 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.936 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:01.936 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.444692+0000", 2024-09-13T06:40:01.936 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:01.936 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.936 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.936 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:01.936 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.444692+0000", 2024-09-13T06:40:01.936 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:01.936 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.936 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.936 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:01.936 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.444692+0000", 2024-09-13T06:40:01.937 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:01.937 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.937 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.937 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:01.937 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.444694+0000", 2024-09-13T06:40:01.937 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.058e-06 2024-09-13T06:40:01.937 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.937 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.937 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:01.937 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.444700+0000", 2024-09-13T06:40:01.937 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7769999999999999e-06 2024-09-13T06:40:01.937 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.937 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.938 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:01.938 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.444704+0000", 2024-09-13T06:40:01.938 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6229999999999996e-06 2024-09-13T06:40:01.938 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.938 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.938 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:01.938 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533587+0000", 2024-09-13T06:40:01.938 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.088882744999999999 2024-09-13T06:40:01.938 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.938 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.938 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:01.938 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533596+0000", 2024-09-13T06:40:01.938 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.3270000000000007e-06 2024-09-13T06:40:01.938 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:01.939 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:01.939 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:01.939 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.939 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.939 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25756 3.8 3.63996268 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:01.939 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.444709+0000", 2024-09-13T06:40:01.939 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 5.4047898390000002, 2024-09-13T06:40:01.939 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.088902571, 2024-09-13T06:40:01.939 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:01.939 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:40:01.939 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:01.939 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:01.939 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:01.939 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25756 2024-09-13T06:40:01.940 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.940 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:01.940 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.940 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:01.940 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.444709+0000", 2024-09-13T06:40:01.940 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:01.940 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.940 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.940 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:01.940 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.444709+0000", 2024-09-13T06:40:01.940 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:01.940 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.940 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.941 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:01.941 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.444708+0000", 2024-09-13T06:40:01.941 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:01.941 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.941 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.941 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:01.941 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.444710+0000", 2024-09-13T06:40:01.941 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0729999999999999e-06 2024-09-13T06:40:01.941 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.942 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.942 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:01.942 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.444716+0000", 2024-09-13T06:40:01.942 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7819999999999999e-06 2024-09-13T06:40:01.942 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.942 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.942 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:01.942 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.444720+0000", 2024-09-13T06:40:01.942 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4000000000000002e-06 2024-09-13T06:40:01.942 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.942 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.942 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:01.942 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533606+0000", 2024-09-13T06:40:01.943 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.088885711000000006 2024-09-13T06:40:01.943 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:01.943 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:01.943 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:01.943 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533611+0000", 2024-09-13T06:40:01.943 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.057e-06 2024-09-13T06:40:01.943 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:01.943 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:01.943 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:01.943 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:01.943 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:01.943 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:40:01.945 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-13T06:40:01.945 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:40:01.946+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:40:02.046 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:40:02.050+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:40:02.076 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:40:02.076 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [], 2024-09-13T06:40:02.076 INFO:teuthology.orchestra.run.smithi139.stdout: "num_ops": 0 2024-09-13T06:40:02.076 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:40:02.090 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-13T06:40:02.147 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:40:02.149+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:40:02.205 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:40:02.206 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [], 2024-09-13T06:40:02.206 INFO:teuthology.orchestra.run.smithi139.stdout: "complaint_time": 30, 2024-09-13T06:40:02.206 INFO:teuthology.orchestra.run.smithi139.stdout: "num_blocked_ops": 0 2024-09-13T06:40:02.206 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:40:02.219 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-13T06:40:02.260 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:40:02.265+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:40:02.349 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:40:02.350+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:40:02.378 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:40:02.379 INFO:teuthology.orchestra.run.smithi139.stdout: "size": 20, 2024-09-13T06:40:02.379 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 600, 2024-09-13T06:40:02.379 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [ 2024-09-13T06:40:02.379 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:02.379 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18706 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 3346432~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:40:02.379 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.846138+0000", 2024-09-13T06:40:02.379 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 10.536047235, 2024-09-13T06:40:02.379 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.102018712, 2024-09-13T06:40:02.379 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:02.379 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:02.380 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:02.380 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:02.380 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:02.380 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18706 2024-09-13T06:40:02.380 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:02.380 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:02.380 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:02.380 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:02.380 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846138+0000", 2024-09-13T06:40:02.380 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:02.380 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:02.381 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:02.381 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:02.381 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846138+0000", 2024-09-13T06:40:02.381 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:02.381 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:02.381 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:02.381 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:02.381 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846138+0000", 2024-09-13T06:40:02.382 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:02.382 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:02.382 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:02.382 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:02.382 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846141+0000", 2024-09-13T06:40:02.382 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.6969999999999999e-06 2024-09-13T06:40:02.382 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:02.382 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:02.382 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:02.382 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846150+0000", 2024-09-13T06:40:02.382 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6400000000000003e-06 2024-09-13T06:40:02.382 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:02.382 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:02.382 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:02.383 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846160+0000", 2024-09-13T06:40:02.383 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.3999999999999998e-06 2024-09-13T06:40:02.383 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:02.383 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:02.383 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:02.383 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.947764+0000", 2024-09-13T06:40:02.383 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101604085 2024-09-13T06:40:02.383 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:02.383 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:02.383 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:02.383 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.947888+0000", 2024-09-13T06:40:02.383 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000124113 2024-09-13T06:40:02.383 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:02.384 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:02.384 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:02.384 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.948157+0000", 2024-09-13T06:40:02.384 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00026943399999999998 2024-09-13T06:40:02.384 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:02.384 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:02.384 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:02.384 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:02.384 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:02.384 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18707 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 3375104~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:40:02.384 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.846207+0000", 2024-09-13T06:40:02.384 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 10.535978469, 2024-09-13T06:40:02.385 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10238114099999999, 2024-09-13T06:40:02.385 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:02.385 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:02.385 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:02.385 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:02.385 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:02.385 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18707 2024-09-13T06:40:02.385 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:02.385 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:02.385 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:02.385 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:02.385 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846207+0000", 2024-09-13T06:40:02.385 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:02.385 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:02.386 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:02.386 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:02.386 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846207+0000", 2024-09-13T06:40:02.386 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:02.386 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:02.386 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:02.386 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:02.386 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846206+0000", 2024-09-13T06:40:02.386 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:02.386 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:02.386 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:02.386 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:02.386 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846211+0000", 2024-09-13T06:40:02.386 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.3000000000000003e-06 2024-09-13T06:40:02.387 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:02.387 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:02.387 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:02.387 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846220+0000", 2024-09-13T06:40:02.387 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6199999999999994e-06 2024-09-13T06:40:02.387 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:02.387 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:02.387 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:02.388 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846228+0000", 2024-09-13T06:40:02.388 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.7500000000000003e-06 2024-09-13T06:40:02.388 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:02.388 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:02.388 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:02.388 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.948267+0000", 2024-09-13T06:40:02.388 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10203878700000001 2024-09-13T06:40:02.388 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:02.388 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:02.388 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:02.388 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.948435+0000", 2024-09-13T06:40:02.388 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00016796500000000001 2024-09-13T06:40:02.388 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:02.389 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:02.389 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:02.389 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.948588+0000", 2024-09-13T06:40:02.389 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00015373599999999999 2024-09-13T06:40:02.389 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:02.389 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:02.389 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:02.389 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:02.389 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:02.389 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18718 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 3690496~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:40:02.389 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.850174+0000", 2024-09-13T06:40:02.389 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 10.532011316, 2024-09-13T06:40:02.390 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101854154, 2024-09-13T06:40:02.390 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:02.390 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:02.390 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:02.390 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:02.390 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:02.390 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18718 2024-09-13T06:40:02.390 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:02.390 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:02.390 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:02.390 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:02.390 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850174+0000", 2024-09-13T06:40:02.390 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:02.390 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:02.391 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:02.391 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:02.391 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850174+0000", 2024-09-13T06:40:02.391 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:02.391 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:02.391 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:02.391 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:02.391 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850173+0000", 2024-09-13T06:40:02.391 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:02.391 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:02.391 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:02.391 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:02.391 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850178+0000", 2024-09-13T06:40:02.392 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.4129999999999999e-06 2024-09-13T06:40:02.392 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:02.392 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:02.392 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:02.392 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850188+0000", 2024-09-13T06:40:02.392 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.8600000000000005e-06 2024-09-13T06:40:02.392 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:02.392 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:02.392 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:02.392 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850195+0000", 2024-09-13T06:40:02.392 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.8730000000000007e-06 2024-09-13T06:40:02.392 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:02.392 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:02.392 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:02.393 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.951766+0000", 2024-09-13T06:40:02.393 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.1015703 2024-09-13T06:40:02.393 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:02.393 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:02.393 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:02.393 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.951879+0000", 2024-09-13T06:40:02.393 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000112932 2024-09-13T06:40:02.393 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:02.393 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:02.393 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:02.393 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.952029+0000", 2024-09-13T06:40:02.393 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000149846 2024-09-13T06:40:02.393 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:02.394 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:02.394 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:02.394 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:02.394 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:02.394 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18719 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 3719168~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:40:02.394 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.850202+0000", 2024-09-13T06:40:02.394 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 10.531983273, 2024-09-13T06:40:02.394 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.102191676, 2024-09-13T06:40:02.394 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:02.394 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:02.394 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:02.394 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:02.394 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:02.395 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18719 2024-09-13T06:40:02.395 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:02.395 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:02.395 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:02.395 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:02.395 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850202+0000", 2024-09-13T06:40:02.395 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:02.395 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:02.395 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:02.395 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:02.395 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850202+0000", 2024-09-13T06:40:02.395 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:02.395 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:02.396 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:02.396 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:02.396 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850202+0000", 2024-09-13T06:40:02.396 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:02.396 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:02.396 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:02.396 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:02.396 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850205+0000", 2024-09-13T06:40:02.396 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.89e-06 2024-09-13T06:40:02.397 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:02.397 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:02.397 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:02.397 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850216+0000", 2024-09-13T06:40:02.397 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0233e-05 2024-09-13T06:40:02.397 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:02.397 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:02.397 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:02.397 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850223+0000", 2024-09-13T06:40:02.397 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5299999999999999e-06 2024-09-13T06:40:02.398 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:02.398 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:02.398 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:02.398 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.952106+0000", 2024-09-13T06:40:02.398 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10188309299999999 2024-09-13T06:40:02.399 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:02.399 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:02.399 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:02.399 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.952233+0000", 2024-09-13T06:40:02.399 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000126993 2024-09-13T06:40:02.399 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:02.400 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:02.400 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:02.400 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.952394+0000", 2024-09-13T06:40:02.400 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000160791 2024-09-13T06:40:02.400 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:02.400 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:02.400 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:02.400 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:02.400 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:02.401 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18720 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 3747840~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:40:02.401 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.850726+0000", 2024-09-13T06:40:02.401 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 10.531459443999999, 2024-09-13T06:40:02.401 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10199504299999999, 2024-09-13T06:40:02.401 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:02.401 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:02.401 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:02.401 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:02.401 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:02.401 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18720 2024-09-13T06:40:02.401 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:02.401 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:02.401 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:02.401 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:02.402 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850726+0000", 2024-09-13T06:40:02.402 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:02.402 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:02.402 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:02.402 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:02.402 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850726+0000", 2024-09-13T06:40:02.402 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:02.402 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:02.402 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:02.402 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:02.402 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850229+0000", 2024-09-13T06:40:02.402 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9995027 2024-09-13T06:40:02.402 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:02.403 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:02.403 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:02.403 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850731+0000", 2024-09-13T06:40:02.403 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00050221599999999999 2024-09-13T06:40:02.403 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:02.403 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:02.403 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:02.403 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850751+0000", 2024-09-13T06:40:02.404 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.9703000000000001e-05 2024-09-13T06:40:02.404 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:02.404 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:02.404 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:02.404 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850764+0000", 2024-09-13T06:40:02.404 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3207000000000001e-05 2024-09-13T06:40:02.404 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:02.404 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:02.404 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:02.405 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.952454+0000", 2024-09-13T06:40:02.405 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101690102 2024-09-13T06:40:02.405 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:02.405 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:02.405 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:02.405 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.952571+0000", 2024-09-13T06:40:02.405 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000116556 2024-09-13T06:40:02.405 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:02.405 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:02.405 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:02.405 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.952721+0000", 2024-09-13T06:40:02.405 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000150419 2024-09-13T06:40:02.405 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:02.406 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:02.406 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:02.406 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:02.406 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:02.406 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18730 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 4034560~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:40:02.406 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.854013+0000", 2024-09-13T06:40:02.406 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 10.528172503, 2024-09-13T06:40:02.406 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10186914399999999, 2024-09-13T06:40:02.406 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:02.406 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:02.406 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:02.406 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:02.406 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:02.406 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18730 2024-09-13T06:40:02.407 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:02.407 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:02.407 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:02.407 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:02.407 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.854013+0000", 2024-09-13T06:40:02.407 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:02.407 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:02.407 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:02.407 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:02.407 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.854013+0000", 2024-09-13T06:40:02.408 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:02.408 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:02.408 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:02.408 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:02.408 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.854013+0000", 2024-09-13T06:40:02.408 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:02.408 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:02.408 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:02.408 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:02.408 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.854016+0000", 2024-09-13T06:40:02.409 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.1839999999999999e-06 2024-09-13T06:40:02.409 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:02.409 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:02.409 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:02.409 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.854025+0000", 2024-09-13T06:40:02.409 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.8030000000000003e-06 2024-09-13T06:40:02.409 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:02.409 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:02.409 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:02.409 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.854033+0000", 2024-09-13T06:40:02.409 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6500000000000002e-06 2024-09-13T06:40:02.409 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:02.409 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:02.410 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:02.410 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.955546+0000", 2024-09-13T06:40:02.410 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10151296 2024-09-13T06:40:02.410 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:02.410 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:02.410 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:02.410 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.955694+0000", 2024-09-13T06:40:02.410 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000147773 2024-09-13T06:40:02.410 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:02.410 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:02.410 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:02.411 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.955882+0000", 2024-09-13T06:40:02.411 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000188371 2024-09-13T06:40:02.411 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:02.411 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:02.411 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:02.411 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:02.411 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:02.411 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18742 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 4378624~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:40:02.411 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.857984+0000", 2024-09-13T06:40:02.411 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 10.524201380000001, 2024-09-13T06:40:02.411 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10179961799999999, 2024-09-13T06:40:02.411 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:02.412 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:02.412 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:02.412 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:02.412 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:02.412 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18742 2024-09-13T06:40:02.412 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:02.412 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:02.412 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:02.412 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:02.412 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.857984+0000", 2024-09-13T06:40:02.412 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:02.412 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:02.412 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:02.413 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:02.413 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.857984+0000", 2024-09-13T06:40:02.413 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:02.413 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:02.413 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:02.413 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:02.413 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.857983+0000", 2024-09-13T06:40:02.413 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:02.413 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:02.413 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:02.413 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:02.413 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.857987+0000", 2024-09-13T06:40:02.414 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0670000000000002e-06 2024-09-13T06:40:02.414 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:02.414 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:02.414 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:02.414 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.857997+0000", 2024-09-13T06:40:02.414 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6830000000000003e-06 2024-09-13T06:40:02.414 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:02.414 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:02.414 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:02.414 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.858006+0000", 2024-09-13T06:40:02.414 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.5739999999999996e-06 2024-09-13T06:40:02.415 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:02.415 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:02.415 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:02.415 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.959453+0000", 2024-09-13T06:40:02.415 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101447339 2024-09-13T06:40:02.415 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:02.415 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:02.415 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:02.415 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.959603+0000", 2024-09-13T06:40:02.415 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000150316 2024-09-13T06:40:02.415 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:02.415 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:02.416 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:02.416 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.959784+0000", 2024-09-13T06:40:02.416 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00018065900000000001 2024-09-13T06:40:02.416 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:02.416 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:02.416 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:02.416 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:02.416 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:02.416 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18743 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 4407296~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:40:02.417 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.858012+0000", 2024-09-13T06:40:02.417 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 10.524173386999999, 2024-09-13T06:40:02.417 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10210024500000001, 2024-09-13T06:40:02.417 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:02.417 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:02.417 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:02.417 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:02.417 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:02.417 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18743 2024-09-13T06:40:02.417 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:02.417 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:02.417 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:02.417 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:02.418 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.858012+0000", 2024-09-13T06:40:02.418 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:02.418 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:02.418 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:02.418 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:02.418 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.858012+0000", 2024-09-13T06:40:02.418 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:02.418 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:02.418 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:02.418 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:02.418 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.858011+0000", 2024-09-13T06:40:02.418 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:02.418 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:02.419 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:02.419 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:02.419 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.858016+0000", 2024-09-13T06:40:02.419 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0659999999999997e-06 2024-09-13T06:40:02.419 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:02.419 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:02.419 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:02.419 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.858024+0000", 2024-09-13T06:40:02.419 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.7700000000000007e-06 2024-09-13T06:40:02.419 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:02.419 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:02.419 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:02.420 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.858032+0000", 2024-09-13T06:40:02.420 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.7700000000000001e-06 2024-09-13T06:40:02.420 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:02.420 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:02.420 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:02.420 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.959850+0000", 2024-09-13T06:40:02.420 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.1018182 2024-09-13T06:40:02.420 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:02.420 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:02.421 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:02.421 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.959964+0000", 2024-09-13T06:40:02.421 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00011413600000000001 2024-09-13T06:40:02.421 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:02.421 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:02.421 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:02.421 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.960113+0000", 2024-09-13T06:40:02.421 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00014813900000000001 2024-09-13T06:40:02.421 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:02.421 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:02.421 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:02.421 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:02.421 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:02.422 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18755 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 4751360~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:40:02.422 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.862061+0000", 2024-09-13T06:40:02.422 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 10.520125135000001, 2024-09-13T06:40:02.422 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101907023, 2024-09-13T06:40:02.422 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:02.422 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:02.422 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:02.422 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:02.422 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:02.422 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18755 2024-09-13T06:40:02.423 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:02.423 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:02.423 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:02.423 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:02.423 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862061+0000", 2024-09-13T06:40:02.423 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:02.423 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:02.423 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:02.423 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:02.423 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862061+0000", 2024-09-13T06:40:02.423 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:02.423 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:02.424 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:02.424 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:02.424 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862060+0000", 2024-09-13T06:40:02.424 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:02.424 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:02.424 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:02.424 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:02.424 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862064+0000", 2024-09-13T06:40:02.424 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.3229999999999999e-06 2024-09-13T06:40:02.424 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:02.424 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:02.425 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:02.425 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862078+0000", 2024-09-13T06:40:02.425 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.433e-05 2024-09-13T06:40:02.425 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:02.425 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:02.425 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:02.425 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862086+0000", 2024-09-13T06:40:02.425 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.3869999999999997e-06 2024-09-13T06:40:02.426 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:02.426 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:02.426 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:02.426 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.963635+0000", 2024-09-13T06:40:02.426 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101549606 2024-09-13T06:40:02.427 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:02.427 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:02.427 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:02.427 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.963783+0000", 2024-09-13T06:40:02.427 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000147312 2024-09-13T06:40:02.427 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:02.428 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:02.428 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:02.428 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.963968+0000", 2024-09-13T06:40:02.428 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000185028 2024-09-13T06:40:02.428 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:02.428 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:02.429 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:02.429 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:02.429 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:02.429 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18756 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 4780032~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:40:02.429 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.862132+0000", 2024-09-13T06:40:02.430 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 10.520053292, 2024-09-13T06:40:02.430 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.102159295, 2024-09-13T06:40:02.430 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:02.430 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:02.430 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:02.430 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:02.431 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:02.431 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18756 2024-09-13T06:40:02.431 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:02.431 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:02.431 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:02.431 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:02.432 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862132+0000", 2024-09-13T06:40:02.432 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:02.432 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:02.432 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:02.432 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:02.433 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862132+0000", 2024-09-13T06:40:02.433 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:02.433 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:02.433 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:02.433 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:02.433 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862132+0000", 2024-09-13T06:40:02.434 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:02.434 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:02.434 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:02.434 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:02.434 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862136+0000", 2024-09-13T06:40:02.434 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.9559999999999999e-06 2024-09-13T06:40:02.435 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:02.435 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:02.435 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:02.435 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862145+0000", 2024-09-13T06:40:02.435 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6169999999999996e-06 2024-09-13T06:40:02.435 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:02.436 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:02.436 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:02.436 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862153+0000", 2024-09-13T06:40:02.436 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.8359999999999992e-06 2024-09-13T06:40:02.436 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:02.436 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:02.437 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:02.437 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.964018+0000", 2024-09-13T06:40:02.437 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101865421 2024-09-13T06:40:02.437 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:02.437 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:02.438 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:02.438 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.964140+0000", 2024-09-13T06:40:02.438 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000121172 2024-09-13T06:40:02.438 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:02.438 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:02.438 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:02.439 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.964292+0000", 2024-09-13T06:40:02.439 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00015202600000000001 2024-09-13T06:40:02.439 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:02.439 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:02.439 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:02.439 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:02.439 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:02.440 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18768 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 5124096~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:40:02.440 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.866345+0000", 2024-09-13T06:40:02.440 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 10.515840985000001, 2024-09-13T06:40:02.440 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101779361, 2024-09-13T06:40:02.440 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:02.440 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:02.441 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:02.441 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:02.441 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:02.441 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18768 2024-09-13T06:40:02.441 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:02.441 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:02.442 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:02.442 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:02.442 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.866345+0000", 2024-09-13T06:40:02.442 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:02.442 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:02.442 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:02.443 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:02.443 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.866345+0000", 2024-09-13T06:40:02.443 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:02.443 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:02.443 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:02.443 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:02.444 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.866344+0000", 2024-09-13T06:40:02.444 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:02.444 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:02.444 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:02.444 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:02.445 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.866348+0000", 2024-09-13T06:40:02.445 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.4300000000000002e-06 2024-09-13T06:40:02.445 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:02.445 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:02.445 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:02.445 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.866356+0000", 2024-09-13T06:40:02.446 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.5930000000000006e-06 2024-09-13T06:40:02.446 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:02.446 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:02.446 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:02.446 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.866364+0000", 2024-09-13T06:40:02.446 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5599999999999996e-06 2024-09-13T06:40:02.447 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:02.447 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:02.447 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:02.447 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.967865+0000", 2024-09-13T06:40:02.447 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101501683 2024-09-13T06:40:02.447 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:02.448 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:02.448 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:02.448 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.967981+0000", 2024-09-13T06:40:02.448 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000115643 2024-09-13T06:40:02.448 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:02.449 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:02.449 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:02.449 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.968124+0000", 2024-09-13T06:40:02.449 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00014305500000000001 2024-09-13T06:40:02.449 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:02.449 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:02.450 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:02.450 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:02.450 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:02.450 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18779 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 5439488~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:40:02.450 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.869996+0000", 2024-09-13T06:40:02.450 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 10.5121901, 2024-09-13T06:40:02.451 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10189577399999999, 2024-09-13T06:40:02.451 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:02.451 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:02.451 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:02.451 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:02.451 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:02.451 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18779 2024-09-13T06:40:02.452 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:02.452 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:02.452 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:02.452 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:02.452 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.869996+0000", 2024-09-13T06:40:02.453 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:02.453 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:02.453 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:02.453 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:02.453 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.869996+0000", 2024-09-13T06:40:02.453 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:02.453 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:02.454 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:02.454 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:02.454 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.869995+0000", 2024-09-13T06:40:02.454 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:02.454 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:02.454 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:02.454 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:02.455 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.869998+0000", 2024-09-13T06:40:02.455 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.2729999999999998e-06 2024-09-13T06:40:02.455 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:02.455 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:02.455 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:02.455 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.870007+0000", 2024-09-13T06:40:02.455 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.5760000000000006e-06 2024-09-13T06:40:02.456 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:02.456 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:02.456 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:02.456 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.870014+0000", 2024-09-13T06:40:02.456 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.1400000000000002e-06 2024-09-13T06:40:02.456 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:02.456 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:02.456 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:02.456 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.971631+0000", 2024-09-13T06:40:02.456 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101617503 2024-09-13T06:40:02.456 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:02.456 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:02.456 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:02.456 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.971747+0000", 2024-09-13T06:40:02.457 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00011599600000000001 2024-09-13T06:40:02.457 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:02.457 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:02.457 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:02.457 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.971891+0000", 2024-09-13T06:40:02.457 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000143912 2024-09-13T06:40:02.457 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:02.457 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:02.457 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:02.457 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:02.457 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:02.457 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18792 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 5812224~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:40:02.458 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.874371+0000", 2024-09-13T06:40:02.458 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 10.50781497, 2024-09-13T06:40:02.458 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101736005, 2024-09-13T06:40:02.458 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:02.458 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:02.458 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:02.458 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:02.458 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:02.458 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18792 2024-09-13T06:40:02.458 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:02.458 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:02.458 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:02.458 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:02.458 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874371+0000", 2024-09-13T06:40:02.459 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:02.459 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:02.459 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:02.459 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:02.459 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874371+0000", 2024-09-13T06:40:02.459 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:02.459 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:02.459 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:02.459 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:02.459 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874370+0000", 2024-09-13T06:40:02.459 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:02.459 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:02.459 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:02.459 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:02.460 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874374+0000", 2024-09-13T06:40:02.460 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.7239999999999998e-06 2024-09-13T06:40:02.460 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:02.460 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:02.460 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:02.460 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874385+0000", 2024-09-13T06:40:02.460 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1293e-05 2024-09-13T06:40:02.460 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:02.460 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:02.460 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:02.461 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874394+0000", 2024-09-13T06:40:02.461 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.0729999999999994e-06 2024-09-13T06:40:02.461 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:02.461 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:02.461 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:02.461 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.975850+0000", 2024-09-13T06:40:02.461 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10145599700000001 2024-09-13T06:40:02.461 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:02.461 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:02.461 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:02.461 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.975963+0000", 2024-09-13T06:40:02.461 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000112689 2024-09-13T06:40:02.462 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:02.462 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:02.462 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:02.462 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.976107+0000", 2024-09-13T06:40:02.462 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000143836 2024-09-13T06:40:02.462 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:02.462 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:02.462 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:02.462 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:02.462 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:02.462 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18793 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 5840896~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:40:02.463 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.874401+0000", 2024-09-13T06:40:02.463 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 10.507784937, 2024-09-13T06:40:02.463 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.102005516, 2024-09-13T06:40:02.463 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:02.463 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:02.463 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:02.463 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:02.463 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:02.463 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18793 2024-09-13T06:40:02.463 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:02.463 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:02.464 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:02.464 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:02.464 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874401+0000", 2024-09-13T06:40:02.464 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:02.464 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:02.464 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:02.464 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:02.464 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874401+0000", 2024-09-13T06:40:02.464 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:02.464 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:02.464 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:02.464 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:02.464 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874400+0000", 2024-09-13T06:40:02.465 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:02.465 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:02.465 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:02.465 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:02.465 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874404+0000", 2024-09-13T06:40:02.465 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0069999999999999e-06 2024-09-13T06:40:02.465 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:02.465 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:02.465 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:02.465 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874412+0000", 2024-09-13T06:40:02.465 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.5399999999999996e-06 2024-09-13T06:40:02.465 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:02.465 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:02.466 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:02.466 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874420+0000", 2024-09-13T06:40:02.466 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.6199999999999999e-06 2024-09-13T06:40:02.466 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:02.466 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:02.466 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:02.466 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.976150+0000", 2024-09-13T06:40:02.466 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101729874 2024-09-13T06:40:02.466 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:02.466 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:02.466 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:02.466 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.976261+0000", 2024-09-13T06:40:02.466 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000110819 2024-09-13T06:40:02.467 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:02.467 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:02.467 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:02.467 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.976406+0000", 2024-09-13T06:40:02.467 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000145489 2024-09-13T06:40:02.467 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:02.467 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:02.467 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:02.467 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:02.467 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:02.467 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18803 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 6127616~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:40:02.467 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.877851+0000", 2024-09-13T06:40:02.467 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 10.504334443999999, 2024-09-13T06:40:02.467 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101951584, 2024-09-13T06:40:02.468 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:02.468 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:02.468 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:02.468 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:02.468 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:02.468 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18803 2024-09-13T06:40:02.468 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:02.468 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:02.468 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:02.468 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:02.468 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.877851+0000", 2024-09-13T06:40:02.468 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:02.468 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:02.469 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:02.469 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:02.469 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.877851+0000", 2024-09-13T06:40:02.469 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:02.469 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:02.469 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:02.469 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:02.469 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.877851+0000", 2024-09-13T06:40:02.469 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:02.469 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:02.469 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:02.469 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:02.469 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.877854+0000", 2024-09-13T06:40:02.470 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.7929999999999999e-06 2024-09-13T06:40:02.470 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:02.470 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:02.470 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:02.470 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.877864+0000", 2024-09-13T06:40:02.470 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.2029999999999998e-06 2024-09-13T06:40:02.470 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:02.470 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:02.470 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:02.470 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.877873+0000", 2024-09-13T06:40:02.471 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.0440000000000001e-06 2024-09-13T06:40:02.471 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:02.471 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:02.471 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:02.471 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.979544+0000", 2024-09-13T06:40:02.471 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101671198 2024-09-13T06:40:02.471 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:02.471 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:02.471 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:02.471 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.979658+0000", 2024-09-13T06:40:02.471 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000114456 2024-09-13T06:40:02.471 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:02.471 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:02.471 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:02.471 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.979803+0000", 2024-09-13T06:40:02.472 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000144506 2024-09-13T06:40:02.472 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:02.472 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:02.472 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:02.472 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:02.472 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:02.472 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18807 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 6242304~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:40:02.472 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.879235+0000", 2024-09-13T06:40:02.472 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 10.502950414000001, 2024-09-13T06:40:02.472 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101781258, 2024-09-13T06:40:02.472 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:02.472 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:02.472 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:02.473 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:02.473 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:02.473 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18807 2024-09-13T06:40:02.473 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:02.473 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:02.473 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:02.473 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:02.473 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879235+0000", 2024-09-13T06:40:02.473 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:02.473 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:02.473 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:02.473 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:02.474 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879235+0000", 2024-09-13T06:40:02.474 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:02.474 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:02.474 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:02.474 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:02.474 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879235+0000", 2024-09-13T06:40:02.474 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:02.474 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:02.474 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:02.474 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:02.474 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879239+0000", 2024-09-13T06:40:02.474 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.963e-06 2024-09-13T06:40:02.474 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:02.474 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:02.474 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:02.475 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879247+0000", 2024-09-13T06:40:02.475 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6470000000000004e-06 2024-09-13T06:40:02.475 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:02.475 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:02.475 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:02.475 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879255+0000", 2024-09-13T06:40:02.475 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5429999999999996e-06 2024-09-13T06:40:02.475 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:02.475 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:02.475 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:02.475 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.980756+0000", 2024-09-13T06:40:02.475 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10150165999999999 2024-09-13T06:40:02.475 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:02.475 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:02.476 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:02.476 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.980868+0000", 2024-09-13T06:40:02.476 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000111196 2024-09-13T06:40:02.476 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:02.476 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:02.476 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:02.476 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.981017+0000", 2024-09-13T06:40:02.476 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000148846 2024-09-13T06:40:02.477 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:02.477 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:02.477 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:02.477 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:02.477 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:02.477 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18808 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 6270976~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:40:02.477 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.879261+0000", 2024-09-13T06:40:02.477 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 10.502924275, 2024-09-13T06:40:02.477 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.102057547, 2024-09-13T06:40:02.477 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:02.477 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:02.477 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:02.478 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:02.478 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:02.478 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18808 2024-09-13T06:40:02.478 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:02.478 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:02.478 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:02.478 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:02.478 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879261+0000", 2024-09-13T06:40:02.478 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:02.478 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:02.479 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:02.479 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:02.479 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879261+0000", 2024-09-13T06:40:02.479 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:02.479 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:02.479 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:02.479 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:02.479 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879261+0000", 2024-09-13T06:40:02.479 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:02.479 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:02.479 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:02.479 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:02.479 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879264+0000", 2024-09-13T06:40:02.480 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.523e-06 2024-09-13T06:40:02.480 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:02.480 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:02.480 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:02.480 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879273+0000", 2024-09-13T06:40:02.480 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6070000000000008e-06 2024-09-13T06:40:02.480 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:02.480 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:02.480 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:02.480 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879280+0000", 2024-09-13T06:40:02.480 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.4699999999999996e-06 2024-09-13T06:40:02.480 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:02.480 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:02.481 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:02.481 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.981060+0000", 2024-09-13T06:40:02.481 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10177934800000001 2024-09-13T06:40:02.481 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:02.481 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:02.481 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:02.481 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.981174+0000", 2024-09-13T06:40:02.482 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000114456 2024-09-13T06:40:02.482 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:02.482 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:02.482 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:02.482 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.981319+0000", 2024-09-13T06:40:02.482 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00014473900000000001 2024-09-13T06:40:02.482 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:02.482 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:02.482 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:02.482 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:02.482 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:02.482 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18810 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 2662400~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:40:02.482 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.880386+0000", 2024-09-13T06:40:02.482 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 10.501800113, 2024-09-13T06:40:02.483 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101728022, 2024-09-13T06:40:02.483 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:02.483 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:02.483 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:02.483 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:02.483 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:02.483 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18810 2024-09-13T06:40:02.483 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:02.483 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:02.483 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:02.483 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:02.483 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880386+0000", 2024-09-13T06:40:02.483 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:02.483 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:02.483 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:02.484 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:02.484 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880386+0000", 2024-09-13T06:40:02.484 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:02.484 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:02.484 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:02.484 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:02.484 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880385+0000", 2024-09-13T06:40:02.484 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:02.484 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:02.484 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:02.484 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:02.484 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880389+0000", 2024-09-13T06:40:02.484 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.8539999999999999e-06 2024-09-13T06:40:02.484 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:02.485 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:02.485 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:02.485 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880398+0000", 2024-09-13T06:40:02.485 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.1689999999999998e-06 2024-09-13T06:40:02.485 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:02.485 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:02.485 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:02.485 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880405+0000", 2024-09-13T06:40:02.485 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5700000000000004e-06 2024-09-13T06:40:02.485 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:02.485 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:02.485 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:02.485 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.981833+0000", 2024-09-13T06:40:02.485 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10142791800000001 2024-09-13T06:40:02.486 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:02.486 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:02.486 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:02.486 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.981973+0000", 2024-09-13T06:40:02.486 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00014002900000000001 2024-09-13T06:40:02.486 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:02.486 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:02.486 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:02.486 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.982114+0000", 2024-09-13T06:40:02.486 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000140276 2024-09-13T06:40:02.487 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:02.487 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:02.487 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:02.487 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:02.487 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:02.487 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18811 3.9 3.140f5209 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:40:02.487 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.880449+0000", 2024-09-13T06:40:02.487 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 10.501736737, 2024-09-13T06:40:02.487 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101739355, 2024-09-13T06:40:02.487 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:02.488 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:40:02.488 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:02.488 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:02.488 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:02.488 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18811 2024-09-13T06:40:02.488 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:02.488 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:02.488 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:02.488 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:02.489 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880449+0000", 2024-09-13T06:40:02.489 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:02.489 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:02.489 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:02.489 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:02.489 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880449+0000", 2024-09-13T06:40:02.489 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:02.490 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:02.490 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:02.490 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:02.490 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880448+0000", 2024-09-13T06:40:02.490 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:02.490 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:02.490 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:02.490 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:02.490 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880452+0000", 2024-09-13T06:40:02.491 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0470000000000004e-06 2024-09-13T06:40:02.491 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:02.491 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:02.491 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:02.491 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880462+0000", 2024-09-13T06:40:02.491 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6530000000000006e-06 2024-09-13T06:40:02.491 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:02.491 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:02.492 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:02.492 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880472+0000", 2024-09-13T06:40:02.492 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0027000000000001e-05 2024-09-13T06:40:02.492 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:02.492 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:02.492 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:02.492 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.982172+0000", 2024-09-13T06:40:02.492 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10170043500000001 2024-09-13T06:40:02.493 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:02.493 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:02.493 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:02.493 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.982188+0000", 2024-09-13T06:40:02.493 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6172999999999999e-05 2024-09-13T06:40:02.493 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:02.493 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:02.493 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:02.493 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:02.494 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:02.494 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18812 3.9 3.140f5209 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:40:02.494 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.880478+0000", 2024-09-13T06:40:02.494 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 10.5017075, 2024-09-13T06:40:02.494 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10177795100000001, 2024-09-13T06:40:02.494 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:02.494 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:40:02.494 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:02.494 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:02.495 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:02.495 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18812 2024-09-13T06:40:02.495 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:02.495 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:02.495 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:02.495 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:02.495 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880478+0000", 2024-09-13T06:40:02.495 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:02.495 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:02.496 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:02.496 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:02.496 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880478+0000", 2024-09-13T06:40:02.496 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:02.496 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:02.496 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:02.496 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:02.496 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880477+0000", 2024-09-13T06:40:02.496 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:02.497 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:02.497 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:02.497 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:02.497 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880481+0000", 2024-09-13T06:40:02.497 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.827e-06 2024-09-13T06:40:02.497 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:02.497 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:02.498 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:02.498 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880490+0000", 2024-09-13T06:40:02.498 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6100000000000006e-06 2024-09-13T06:40:02.498 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:02.498 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:02.498 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:02.498 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880497+0000", 2024-09-13T06:40:02.498 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.7030000000000006e-06 2024-09-13T06:40:02.498 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:02.498 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:02.498 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:02.498 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.982241+0000", 2024-09-13T06:40:02.498 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10174351199999999 2024-09-13T06:40:02.499 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:02.499 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:02.499 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:02.499 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.982256+0000", 2024-09-13T06:40:02.499 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5143000000000001e-05 2024-09-13T06:40:02.499 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:02.499 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:02.499 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:02.499 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:02.499 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:02.499 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:40:02.501 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-13T06:40:02.501 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:40:02.505+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:40:02.589 INFO:teuthology.orchestra.run.smithi081.stderr:noscrub is set 2024-09-13T06:40:02.604 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:40:02.605+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:40:02.702 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:40:02.702+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:40:02.711 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:40:02.711 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [], 2024-09-13T06:40:02.711 INFO:teuthology.orchestra.run.smithi139.stdout: "num_ops": 0 2024-09-13T06:40:02.711 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:40:02.725 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-13T06:40:02.804 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:40:02.806+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:40:02.882 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:40:02.882 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [], 2024-09-13T06:40:02.882 INFO:teuthology.orchestra.run.smithi139.stdout: "complaint_time": 30, 2024-09-13T06:40:02.882 INFO:teuthology.orchestra.run.smithi139.stdout: "num_blocked_ops": 0 2024-09-13T06:40:02.882 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:40:02.896 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-13T06:40:02.905 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:40:02.906+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:40:02.995 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-13T06:40:03.013 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:40:03.013 INFO:teuthology.orchestra.run.smithi139.stdout: "size": 20, 2024-09-13T06:40:03.013 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 600, 2024-09-13T06:40:03.013 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [ 2024-09-13T06:40:03.013 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:03.013 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:25884 3.1c 3:3da1e1c6:::rbd_data.1121f2c5ee81.0000000000000007:13 [read 167936~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:03.013 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.424614+0000", 2024-09-13T06:40:03.013 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 6.5922312590000001, 2024-09-13T06:40:03.014 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.040027199999999999, 2024-09-13T06:40:03.014 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:03.014 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:03.014 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:03.014 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:03.014 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:03.014 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 25884 2024-09-13T06:40:03.014 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:03.014 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:03.014 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:03.015 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:03.015 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.424614+0000", 2024-09-13T06:40:03.015 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:03.015 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:03.015 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:03.015 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:03.015 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.424614+0000", 2024-09-13T06:40:03.015 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:03.015 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:03.015 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:03.015 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:03.015 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.424613+0000", 2024-09-13T06:40:03.015 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:03.016 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:03.016 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:03.016 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:03.016 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.424619+0000", 2024-09-13T06:40:03.016 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.6149999999999996e-06 2024-09-13T06:40:03.016 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:03.016 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:03.016 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:03.016 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.424629+0000", 2024-09-13T06:40:03.016 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0145e-05 2024-09-13T06:40:03.016 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:03.016 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:03.016 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:03.017 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.424635+0000", 2024-09-13T06:40:03.017 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.0039999999999996e-06 2024-09-13T06:40:03.017 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:03.017 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:03.017 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:03.017 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.464196+0000", 2024-09-13T06:40:03.017 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039561116 2024-09-13T06:40:03.017 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:03.017 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:03.017 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:03.017 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.464257+0000", 2024-09-13T06:40:03.017 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.1215000000000003e-05 2024-09-13T06:40:03.017 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:03.018 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:03.018 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:03.018 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.464641+0000", 2024-09-13T06:40:03.018 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00038401199999999998 2024-09-13T06:40:03.018 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:03.018 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:03.018 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:03.018 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:03.018 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:03.018 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:25885 3.1c 3:3da1e1c6:::rbd_data.1121f2c5ee81.0000000000000007:13 [read 212992~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:03.018 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.424640+0000", 2024-09-13T06:40:03.018 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 6.5922052579999999, 2024-09-13T06:40:03.018 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.040449289999999999, 2024-09-13T06:40:03.018 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:03.019 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:03.019 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:03.019 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:03.019 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:03.019 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 25885 2024-09-13T06:40:03.019 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:03.019 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:03.019 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:03.019 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:03.019 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.424640+0000", 2024-09-13T06:40:03.019 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:03.019 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:03.019 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:03.019 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:03.020 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.424640+0000", 2024-09-13T06:40:03.020 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:03.020 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:03.020 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:03.020 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:03.020 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.424640+0000", 2024-09-13T06:40:03.020 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:03.020 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:03.020 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:03.020 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:03.020 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.424643+0000", 2024-09-13T06:40:03.020 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.19e-06 2024-09-13T06:40:03.020 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:03.020 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:03.021 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:03.021 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.424650+0000", 2024-09-13T06:40:03.021 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.1189999999999999e-06 2024-09-13T06:40:03.021 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:03.021 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:03.021 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:03.021 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.424656+0000", 2024-09-13T06:40:03.021 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.7780000000000004e-06 2024-09-13T06:40:03.021 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:03.021 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:03.021 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:03.021 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.464699+0000", 2024-09-13T06:40:03.021 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.040043792000000002 2024-09-13T06:40:03.022 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:03.022 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:03.022 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:03.022 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.464800+0000", 2024-09-13T06:40:03.022 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000100278 2024-09-13T06:40:03.022 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:03.022 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:03.022 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:03.022 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.465089+0000", 2024-09-13T06:40:03.022 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00028969800000000002 2024-09-13T06:40:03.022 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:03.022 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:03.022 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:03.023 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:03.023 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:03.023 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:25886 3.1c 3:3da1e1c6:::rbd_data.1121f2c5ee81.0000000000000007:13 [read 237568~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:03.023 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.424661+0000", 2024-09-13T06:40:03.023 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 6.5921848939999999, 2024-09-13T06:40:03.023 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.040784316000000001, 2024-09-13T06:40:03.023 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:03.023 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:03.023 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:03.023 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:03.023 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:03.024 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 25886 2024-09-13T06:40:03.024 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:03.024 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:03.024 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:03.024 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:03.024 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.424661+0000", 2024-09-13T06:40:03.024 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:03.024 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:03.024 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:03.024 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:03.025 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.424661+0000", 2024-09-13T06:40:03.025 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:03.025 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:03.025 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:03.025 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:03.025 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.424660+0000", 2024-09-13T06:40:03.025 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:03.025 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:03.025 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:03.025 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:03.025 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.424672+0000", 2024-09-13T06:40:03.025 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1578e-05 2024-09-13T06:40:03.025 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:03.026 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:03.026 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:03.026 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.424680+0000", 2024-09-13T06:40:03.026 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.9489999999999996e-06 2024-09-13T06:40:03.026 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:03.026 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:03.026 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:03.026 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.424689+0000", 2024-09-13T06:40:03.026 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.0790000000000007e-06 2024-09-13T06:40:03.026 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:03.026 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:03.026 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:03.026 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.465128+0000", 2024-09-13T06:40:03.026 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.040438922000000002 2024-09-13T06:40:03.026 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:03.027 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:03.027 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:03.027 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.465210+0000", 2024-09-13T06:40:03.027 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.2853000000000001e-05 2024-09-13T06:40:03.027 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:03.027 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:03.027 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:03.027 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.465445+0000", 2024-09-13T06:40:03.027 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000234453 2024-09-13T06:40:03.027 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:03.027 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:03.027 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:03.027 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:03.027 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:03.027 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:25887 3.1c 3:3da1e1c6:::rbd_data.1121f2c5ee81.0000000000000007:13 [read 307200~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:03.028 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.425137+0000", 2024-09-13T06:40:03.028 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 6.591708573, 2024-09-13T06:40:03.028 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.040764531, 2024-09-13T06:40:03.028 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:03.028 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:03.028 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:03.028 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:03.028 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:03.028 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 25887 2024-09-13T06:40:03.028 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:03.028 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:03.028 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:03.028 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:03.029 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.425137+0000", 2024-09-13T06:40:03.029 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:03.029 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:03.029 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:03.029 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:03.029 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.425137+0000", 2024-09-13T06:40:03.029 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:03.029 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:03.029 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:03.029 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:03.029 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.425135+0000", 2024-09-13T06:40:03.029 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999986 2024-09-13T06:40:03.029 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:03.030 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:03.030 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:03.030 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.425160+0000", 2024-09-13T06:40:03.030 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.4423999999999999e-05 2024-09-13T06:40:03.030 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:03.030 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:03.030 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:03.030 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.425186+0000", 2024-09-13T06:40:03.030 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.6329000000000002e-05 2024-09-13T06:40:03.030 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:03.030 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:03.030 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:03.030 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.425201+0000", 2024-09-13T06:40:03.030 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5048000000000001e-05 2024-09-13T06:40:03.031 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:03.031 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:03.031 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:03.031 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.465483+0000", 2024-09-13T06:40:03.031 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.040281381999999998 2024-09-13T06:40:03.031 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:03.031 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:03.031 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:03.031 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.465575+0000", 2024-09-13T06:40:03.031 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.2794000000000006e-05 2024-09-13T06:40:03.031 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:03.031 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:03.031 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:03.031 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.465901+0000", 2024-09-13T06:40:03.032 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00032604900000000002 2024-09-13T06:40:03.032 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:03.032 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:03.032 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:03.032 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:03.032 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:03.032 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:25888 3.1c 3:3da1e1c6:::rbd_data.1121f2c5ee81.0000000000000007:13 [read 331776~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:03.032 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.425217+0000", 2024-09-13T06:40:03.032 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 6.5916288270000001, 2024-09-13T06:40:03.032 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.041115250999999998, 2024-09-13T06:40:03.032 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:03.032 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:03.032 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:03.033 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:03.033 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:03.033 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 25888 2024-09-13T06:40:03.033 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:03.033 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:03.033 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:03.033 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:03.033 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.425217+0000", 2024-09-13T06:40:03.033 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:03.033 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:03.033 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:03.033 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:03.033 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.425217+0000", 2024-09-13T06:40:03.034 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:03.034 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:03.034 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:03.034 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:03.034 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.425215+0000", 2024-09-13T06:40:03.034 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:03.034 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:03.034 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:03.034 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:03.034 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.425222+0000", 2024-09-13T06:40:03.034 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.5830000000000003e-06 2024-09-13T06:40:03.034 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:03.034 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:03.034 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:03.034 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.425240+0000", 2024-09-13T06:40:03.035 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7914000000000002e-05 2024-09-13T06:40:03.035 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:03.035 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:03.035 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:03.035 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.425252+0000", 2024-09-13T06:40:03.035 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2170999999999999e-05 2024-09-13T06:40:03.035 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:03.035 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:03.035 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:03.035 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.465947+0000", 2024-09-13T06:40:03.035 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.040694755999999999 2024-09-13T06:40:03.035 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:03.035 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:03.035 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:03.036 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.466065+0000", 2024-09-13T06:40:03.036 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000117669 2024-09-13T06:40:03.036 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:03.036 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:03.036 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:03.036 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.466332+0000", 2024-09-13T06:40:03.036 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00026730500000000002 2024-09-13T06:40:03.036 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:03.036 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:03.036 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:03.036 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:03.036 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:03.036 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:25889 3.1c 3:3da1e1c6:::rbd_data.1121f2c5ee81.0000000000000007:13 [read 376832~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:03.037 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.425262+0000", 2024-09-13T06:40:03.037 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 6.591582915, 2024-09-13T06:40:03.037 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.041487885000000002, 2024-09-13T06:40:03.037 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:03.037 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:03.037 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:03.037 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:03.037 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:03.037 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 25889 2024-09-13T06:40:03.037 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:03.037 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:03.037 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:03.037 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:03.037 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.425262+0000", 2024-09-13T06:40:03.038 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:03.038 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:03.038 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:03.038 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:03.038 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.425262+0000", 2024-09-13T06:40:03.038 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:03.038 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:03.038 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:03.038 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:03.038 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.425262+0000", 2024-09-13T06:40:03.038 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:03.038 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:03.038 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:03.038 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:03.039 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.425267+0000", 2024-09-13T06:40:03.039 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.587e-06 2024-09-13T06:40:03.039 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:03.039 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:03.039 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:03.039 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.425284+0000", 2024-09-13T06:40:03.039 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6858999999999999e-05 2024-09-13T06:40:03.039 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:03.039 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:03.039 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:03.039 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.425295+0000", 2024-09-13T06:40:03.039 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1238e-05 2024-09-13T06:40:03.040 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:03.040 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:03.040 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:03.040 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.466371+0000", 2024-09-13T06:40:03.040 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.041075381000000001 2024-09-13T06:40:03.040 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:03.040 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:03.040 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:03.040 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.466479+0000", 2024-09-13T06:40:03.040 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000108026 2024-09-13T06:40:03.040 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:03.040 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:03.040 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:03.040 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.466750+0000", 2024-09-13T06:40:03.041 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00027173200000000001 2024-09-13T06:40:03.041 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:03.041 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:03.041 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:03.041 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:03.041 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:03.041 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:25890 3.1c 3:3da1e1c6:::rbd_data.1121f2c5ee81.0000000000000007:13 [read 401408~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:03.041 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.425305+0000", 2024-09-13T06:40:03.041 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 6.5915403829999999, 2024-09-13T06:40:03.041 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.041642419999999999, 2024-09-13T06:40:03.041 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:03.041 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:03.041 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:03.041 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:03.041 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:03.042 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 25890 2024-09-13T06:40:03.042 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:03.042 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:03.042 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:03.042 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:03.042 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.425305+0000", 2024-09-13T06:40:03.042 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:03.042 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:03.042 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:03.042 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:03.042 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.425305+0000", 2024-09-13T06:40:03.042 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:03.042 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:03.042 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:03.043 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:03.043 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.425304+0000", 2024-09-13T06:40:03.043 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:03.043 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:03.043 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:03.043 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:03.043 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.425309+0000", 2024-09-13T06:40:03.043 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.0640000000000001e-06 2024-09-13T06:40:03.043 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:03.043 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:03.043 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:03.043 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.425326+0000", 2024-09-13T06:40:03.043 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6855e-05 2024-09-13T06:40:03.044 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:03.044 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:03.044 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:03.044 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.425346+0000", 2024-09-13T06:40:03.044 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.0387999999999999e-05 2024-09-13T06:40:03.044 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:03.044 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:03.044 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:03.044 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.466796+0000", 2024-09-13T06:40:03.044 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.041449062000000002 2024-09-13T06:40:03.044 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:03.044 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:03.044 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:03.044 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.466859+0000", 2024-09-13T06:40:03.045 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.3682000000000005e-05 2024-09-13T06:40:03.045 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:03.045 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:03.045 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:03.045 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.466947+0000", 2024-09-13T06:40:03.045 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.8220999999999994e-05 2024-09-13T06:40:03.045 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:03.045 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:03.045 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:03.045 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:03.045 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:03.045 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:25891 3.1c 3:3da1e1c6:::rbd_data.1121f2c5ee81.0000000000000007:13 [read 471040~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:03.045 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.425357+0000", 2024-09-13T06:40:03.046 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 6.5914885129999998, 2024-09-13T06:40:03.046 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.042016413000000002, 2024-09-13T06:40:03.046 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:03.046 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:03.046 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:03.046 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:03.046 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:03.046 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 25891 2024-09-13T06:40:03.046 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:03.046 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:03.046 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:03.046 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:03.046 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.425357+0000", 2024-09-13T06:40:03.047 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:03.047 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:03.047 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:03.047 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:03.047 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.425357+0000", 2024-09-13T06:40:03.047 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:03.047 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:03.047 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:03.047 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:03.047 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.425356+0000", 2024-09-13T06:40:03.047 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:03.047 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:03.047 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:03.047 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:03.048 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.425361+0000", 2024-09-13T06:40:03.048 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.2340000000000002e-06 2024-09-13T06:40:03.048 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:03.048 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:03.048 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:03.048 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.425377+0000", 2024-09-13T06:40:03.048 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6087e-05 2024-09-13T06:40:03.048 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:03.048 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:03.048 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:03.049 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.425391+0000", 2024-09-13T06:40:03.049 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3580999999999999e-05 2024-09-13T06:40:03.049 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:03.049 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:03.049 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:03.049 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.466995+0000", 2024-09-13T06:40:03.049 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.041604527000000002 2024-09-13T06:40:03.049 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:03.049 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:03.049 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:03.049 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.467100+0000", 2024-09-13T06:40:03.049 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00010417299999999999 2024-09-13T06:40:03.050 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:03.050 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:03.050 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:03.050 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.467373+0000", 2024-09-13T06:40:03.050 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00027376800000000003 2024-09-13T06:40:03.050 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:03.050 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:03.050 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:03.050 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:03.050 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:03.050 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:25892 3.1c 3:3da1e1c6:::rbd_data.1121f2c5ee81.0000000000000007:13 [read 495616~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:03.050 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.425401+0000", 2024-09-13T06:40:03.051 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 6.5914444620000001, 2024-09-13T06:40:03.051 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.042422195000000003, 2024-09-13T06:40:03.051 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:03.051 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:03.051 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:03.051 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:03.051 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:03.051 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 25892 2024-09-13T06:40:03.051 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:03.051 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:03.051 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:03.052 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:03.052 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.425401+0000", 2024-09-13T06:40:03.052 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:03.052 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:03.052 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:03.052 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:03.052 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.425401+0000", 2024-09-13T06:40:03.052 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:03.052 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:03.052 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:03.052 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:03.052 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.425400+0000", 2024-09-13T06:40:03.052 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:03.053 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:03.053 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:03.053 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:03.053 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.425405+0000", 2024-09-13T06:40:03.053 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.4389999999999999e-06 2024-09-13T06:40:03.053 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:03.053 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:03.053 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:03.053 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.425419+0000", 2024-09-13T06:40:03.053 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3593e-05 2024-09-13T06:40:03.053 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:03.053 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:03.053 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:03.054 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.425430+0000", 2024-09-13T06:40:03.054 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0774999999999999e-05 2024-09-13T06:40:03.054 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:03.054 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:03.054 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:03.054 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.467438+0000", 2024-09-13T06:40:03.054 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.042008570000000002 2024-09-13T06:40:03.054 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:03.054 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:03.054 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:03.054 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.467531+0000", 2024-09-13T06:40:03.054 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.2857999999999998e-05 2024-09-13T06:40:03.054 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:03.055 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:03.055 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:03.055 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.467823+0000", 2024-09-13T06:40:03.055 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000291945 2024-09-13T06:40:03.055 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:03.055 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:03.055 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:03.055 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:03.055 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:03.055 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:26020 3.c 3:3566b607:::rbd_data.1121f2c5ee81.0000000000000012:13 [read 155648~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:03.055 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.429006+0000", 2024-09-13T06:40:03.055 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 6.5878398369999998, 2024-09-13T06:40:03.055 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.040033945000000001, 2024-09-13T06:40:03.055 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:03.055 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:03.056 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:03.056 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:03.056 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:03.056 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 26020 2024-09-13T06:40:03.056 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:03.056 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:03.056 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:03.056 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:03.056 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.429006+0000", 2024-09-13T06:40:03.056 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:03.056 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:03.056 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:03.056 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:03.056 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.429006+0000", 2024-09-13T06:40:03.057 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:03.057 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:03.057 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:03.057 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:03.057 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.429005+0000", 2024-09-13T06:40:03.057 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:03.057 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:03.057 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:03.057 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:03.057 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.429010+0000", 2024-09-13T06:40:03.057 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.079e-06 2024-09-13T06:40:03.057 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:03.057 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:03.058 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:03.058 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.429023+0000", 2024-09-13T06:40:03.058 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3366e-05 2024-09-13T06:40:03.058 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:03.058 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:03.058 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:03.058 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.429033+0000", 2024-09-13T06:40:03.058 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6930000000000002e-06 2024-09-13T06:40:03.058 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:03.058 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:03.058 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:03.058 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.468710+0000", 2024-09-13T06:40:03.058 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039676808000000001 2024-09-13T06:40:03.059 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:03.059 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:03.059 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:03.059 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.468826+0000", 2024-09-13T06:40:03.059 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000116251 2024-09-13T06:40:03.059 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:03.059 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:03.059 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:03.059 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.469040+0000", 2024-09-13T06:40:03.059 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00021363 2024-09-13T06:40:03.059 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:03.059 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:03.059 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:03.059 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:03.059 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:03.059 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:26021 3.c 3:3566b607:::rbd_data.1121f2c5ee81.0000000000000012:13 [read 225280~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:03.060 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.429042+0000", 2024-09-13T06:40:03.060 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 6.5878034510000001, 2024-09-13T06:40:03.060 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.040384481, 2024-09-13T06:40:03.060 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:03.060 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:03.060 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:03.060 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:03.060 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:03.060 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 26021 2024-09-13T06:40:03.060 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:03.060 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:03.060 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:03.060 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:03.061 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.429042+0000", 2024-09-13T06:40:03.061 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:03.061 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:03.061 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:03.061 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:03.061 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.429042+0000", 2024-09-13T06:40:03.061 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:03.061 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:03.061 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:03.061 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:03.061 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.429041+0000", 2024-09-13T06:40:03.061 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:03.061 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:03.061 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:03.062 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:03.062 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.429046+0000", 2024-09-13T06:40:03.062 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.6600000000000003e-06 2024-09-13T06:40:03.062 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:03.062 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:03.062 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:03.062 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.429060+0000", 2024-09-13T06:40:03.062 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3747000000000001e-05 2024-09-13T06:40:03.062 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:03.062 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:03.062 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:03.062 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.429069+0000", 2024-09-13T06:40:03.062 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.5659999999999996e-06 2024-09-13T06:40:03.063 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:03.063 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:03.063 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:03.063 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.469091+0000", 2024-09-13T06:40:03.063 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.040021811999999997 2024-09-13T06:40:03.063 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:03.063 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:03.063 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:03.063 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.469170+0000", 2024-09-13T06:40:03.063 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.9498000000000004e-05 2024-09-13T06:40:03.063 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:03.063 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:03.063 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:03.063 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.469426+0000", 2024-09-13T06:40:03.064 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00025596800000000003 2024-09-13T06:40:03.064 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:03.064 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:03.064 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:03.064 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:03.064 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:03.064 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:26022 3.c 3:3566b607:::rbd_data.1121f2c5ee81.0000000000000012:13 [read 249856~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:03.064 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.429079+0000", 2024-09-13T06:40:03.064 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 6.5877668590000003, 2024-09-13T06:40:03.064 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.040733327, 2024-09-13T06:40:03.064 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:03.064 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:03.064 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:03.065 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:03.065 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:03.065 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 26022 2024-09-13T06:40:03.065 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:03.065 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:03.065 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:03.065 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:03.065 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.429079+0000", 2024-09-13T06:40:03.065 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:03.065 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:03.066 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:03.066 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:03.066 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.429079+0000", 2024-09-13T06:40:03.066 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:03.066 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:03.066 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:03.066 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:03.066 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.429078+0000", 2024-09-13T06:40:03.066 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:03.066 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:03.067 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:03.067 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:03.067 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.429083+0000", 2024-09-13T06:40:03.067 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.8069999999999999e-06 2024-09-13T06:40:03.067 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:03.067 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:03.067 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:03.067 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.429096+0000", 2024-09-13T06:40:03.067 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3665e-05 2024-09-13T06:40:03.067 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:03.067 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:03.067 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:03.067 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.429106+0000", 2024-09-13T06:40:03.068 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.8460000000000003e-06 2024-09-13T06:40:03.068 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:03.068 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:03.068 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:03.068 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.469479+0000", 2024-09-13T06:40:03.068 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.04037259 2024-09-13T06:40:03.068 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:03.068 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:03.068 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:03.068 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.469564+0000", 2024-09-13T06:40:03.068 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.5669999999999998e-05 2024-09-13T06:40:03.068 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:03.069 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:03.069 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:03.069 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.469812+0000", 2024-09-13T06:40:03.069 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00024753699999999998 2024-09-13T06:40:03.069 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:03.069 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:03.069 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:03.069 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:03.069 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:03.069 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:26023 3.c 3:3566b607:::rbd_data.1121f2c5ee81.0000000000000012:13 [read 294912~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:03.070 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.429115+0000", 2024-09-13T06:40:03.070 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 6.5877304399999996, 2024-09-13T06:40:03.070 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.041079490000000003, 2024-09-13T06:40:03.070 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:03.070 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:03.070 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:03.070 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:03.070 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:03.070 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 26023 2024-09-13T06:40:03.070 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:03.070 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:03.070 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:03.070 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:03.070 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.429115+0000", 2024-09-13T06:40:03.071 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:03.071 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:03.071 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:03.071 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:03.071 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.429115+0000", 2024-09-13T06:40:03.071 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:03.071 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:03.071 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:03.071 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:03.071 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.429114+0000", 2024-09-13T06:40:03.071 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:03.071 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:03.071 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:03.071 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:03.072 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.429119+0000", 2024-09-13T06:40:03.072 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.0189999999999997e-06 2024-09-13T06:40:03.072 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:03.072 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:03.072 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:03.072 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.429137+0000", 2024-09-13T06:40:03.072 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.8087000000000001e-05 2024-09-13T06:40:03.072 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:03.072 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:03.072 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:03.072 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.429148+0000", 2024-09-13T06:40:03.072 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0740999999999999e-05 2024-09-13T06:40:03.073 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:03.073 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:03.073 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:03.073 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.469861+0000", 2024-09-13T06:40:03.073 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.040713271000000002 2024-09-13T06:40:03.073 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:03.073 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:03.073 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:03.073 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.469954+0000", 2024-09-13T06:40:03.074 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.2917000000000005e-05 2024-09-13T06:40:03.074 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:03.074 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:03.074 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:03.074 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.470194+0000", 2024-09-13T06:40:03.074 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00024033099999999999 2024-09-13T06:40:03.074 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:03.074 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:03.074 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:03.074 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:03.074 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:03.074 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:26024 3.c 3:3566b607:::rbd_data.1121f2c5ee81.0000000000000012:13 [read 319488~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:03.074 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.429157+0000", 2024-09-13T06:40:03.074 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 6.5876879109999997, 2024-09-13T06:40:03.075 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.041386232000000002, 2024-09-13T06:40:03.075 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:03.075 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:03.075 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:03.075 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:03.075 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:03.075 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 26024 2024-09-13T06:40:03.075 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:03.075 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:03.075 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:03.075 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:03.075 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.429157+0000", 2024-09-13T06:40:03.075 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:03.075 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:03.076 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:03.076 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:03.076 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.429157+0000", 2024-09-13T06:40:03.076 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:03.076 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:03.076 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:03.076 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:03.076 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.429157+0000", 2024-09-13T06:40:03.076 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:03.076 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:03.076 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:03.076 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:03.076 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.429162+0000", 2024-09-13T06:40:03.076 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.3820000000000003e-06 2024-09-13T06:40:03.077 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:03.077 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:03.077 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:03.077 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.429175+0000", 2024-09-13T06:40:03.077 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2797e-05 2024-09-13T06:40:03.077 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:03.077 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:03.077 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:03.077 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.429185+0000", 2024-09-13T06:40:03.077 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0016e-05 2024-09-13T06:40:03.077 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:03.077 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:03.077 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:03.078 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.470233+0000", 2024-09-13T06:40:03.078 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.041047868000000001 2024-09-13T06:40:03.078 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:03.078 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:03.078 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:03.078 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.470280+0000", 2024-09-13T06:40:03.078 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.7422000000000001e-05 2024-09-13T06:40:03.078 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:03.078 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:03.078 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:03.078 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.470544+0000", 2024-09-13T06:40:03.078 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00026366399999999999 2024-09-13T06:40:03.078 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:03.078 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:03.079 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:03.079 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:03.079 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:03.079 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:26025 3.c 3:3566b607:::rbd_data.1121f2c5ee81.0000000000000012:13 [read 389120~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:03.079 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.429194+0000", 2024-09-13T06:40:03.079 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 6.5876515500000004, 2024-09-13T06:40:03.079 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.041722952000000001, 2024-09-13T06:40:03.079 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:03.079 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:03.079 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:03.079 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:03.079 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:03.079 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 26025 2024-09-13T06:40:03.079 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:03.080 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:03.080 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:03.080 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:03.080 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.429194+0000", 2024-09-13T06:40:03.080 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:03.080 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:03.081 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:03.081 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:03.081 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.429194+0000", 2024-09-13T06:40:03.081 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:03.081 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:03.081 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:03.081 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:03.081 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.429193+0000", 2024-09-13T06:40:03.081 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:03.081 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:03.081 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:03.081 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:03.081 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.429206+0000", 2024-09-13T06:40:03.082 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3008e-05 2024-09-13T06:40:03.082 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:03.082 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:03.082 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:03.082 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.429220+0000", 2024-09-13T06:40:03.082 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.4398e-05 2024-09-13T06:40:03.082 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:03.082 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:03.082 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:03.082 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.429230+0000", 2024-09-13T06:40:03.082 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.4280000000000002e-06 2024-09-13T06:40:03.082 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:03.082 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:03.082 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:03.083 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.470584+0000", 2024-09-13T06:40:03.083 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.041354512000000003 2024-09-13T06:40:03.083 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:03.083 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:03.083 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:03.083 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.470648+0000", 2024-09-13T06:40:03.083 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.3163999999999994e-05 2024-09-13T06:40:03.083 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:03.083 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:03.083 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:03.084 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.470917+0000", 2024-09-13T06:40:03.084 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00026928199999999997 2024-09-13T06:40:03.084 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:03.084 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:03.084 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:03.084 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:03.084 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:03.084 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:26026 3.c 3:3566b607:::rbd_data.1121f2c5ee81.0000000000000012:13 [read 413696~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:03.084 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.429240+0000", 2024-09-13T06:40:03.084 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 6.5876055620000002, 2024-09-13T06:40:03.084 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.041996092999999998, 2024-09-13T06:40:03.084 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:03.084 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:03.085 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:03.085 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:03.085 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:03.085 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 26026 2024-09-13T06:40:03.085 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:03.085 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:03.085 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:03.085 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:03.085 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.429240+0000", 2024-09-13T06:40:03.085 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:03.085 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:03.085 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:03.085 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:03.086 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.429240+0000", 2024-09-13T06:40:03.086 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:03.086 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:03.086 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:03.086 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:03.086 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.429239+0000", 2024-09-13T06:40:03.086 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:03.086 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:03.086 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:03.086 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:03.086 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.429244+0000", 2024-09-13T06:40:03.086 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.0989999999999998e-06 2024-09-13T06:40:03.086 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:03.086 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:03.086 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:03.087 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.429257+0000", 2024-09-13T06:40:03.087 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.296e-05 2024-09-13T06:40:03.087 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:03.087 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:03.087 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:03.087 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.429268+0000", 2024-09-13T06:40:03.087 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0971999999999999e-05 2024-09-13T06:40:03.087 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:03.087 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:03.087 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:03.087 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.470962+0000", 2024-09-13T06:40:03.087 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.041694426 2024-09-13T06:40:03.087 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:03.087 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:03.087 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:03.088 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.471024+0000", 2024-09-13T06:40:03.088 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.1741000000000004e-05 2024-09-13T06:40:03.088 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:03.088 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:03.088 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:03.088 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.471236+0000", 2024-09-13T06:40:03.088 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00021181100000000001 2024-09-13T06:40:03.088 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:03.088 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:03.088 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:03.088 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:03.088 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:03.088 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:26146 3.1c 3:3da1e1c6:::rbd_data.1121f2c5ee81.0000000000000007:13 [read 425984~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:03.089 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.434603+0000", 2024-09-13T06:40:03.089 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 6.582242065, 2024-09-13T06:40:03.089 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.040125802000000002, 2024-09-13T06:40:03.089 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:03.089 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:03.089 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:03.089 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:03.089 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:03.089 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 26146 2024-09-13T06:40:03.089 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:03.089 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:03.090 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:03.090 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:03.090 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.434603+0000", 2024-09-13T06:40:03.090 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:03.090 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:03.090 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:03.090 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:03.090 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.434603+0000", 2024-09-13T06:40:03.090 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:03.090 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:03.090 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:03.090 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:03.090 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.434602+0000", 2024-09-13T06:40:03.090 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999986 2024-09-13T06:40:03.090 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:03.091 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:03.091 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:03.091 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.434609+0000", 2024-09-13T06:40:03.091 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.1380000000000001e-06 2024-09-13T06:40:03.091 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:03.091 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:03.091 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:03.091 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.434621+0000", 2024-09-13T06:40:03.091 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2164000000000001e-05 2024-09-13T06:40:03.091 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:03.091 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:03.091 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:03.091 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.434629+0000", 2024-09-13T06:40:03.091 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.0669999999999992e-06 2024-09-13T06:40:03.092 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:03.092 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:03.092 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:03.092 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.474400+0000", 2024-09-13T06:40:03.092 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039770755999999997 2024-09-13T06:40:03.092 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:03.092 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:03.092 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:03.092 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.474483+0000", 2024-09-13T06:40:03.092 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.3238000000000005e-05 2024-09-13T06:40:03.092 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:03.092 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:03.093 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:03.093 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.474729+0000", 2024-09-13T06:40:03.093 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00024571499999999997 2024-09-13T06:40:03.093 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:03.093 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:03.093 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:03.093 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:03.093 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:03.093 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:26147 3.1c 3:3da1e1c6:::rbd_data.1121f2c5ee81.0000000000000007:13 [read 450560~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:03.093 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.434635+0000", 2024-09-13T06:40:03.093 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 6.5822106150000002, 2024-09-13T06:40:03.093 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.040501387, 2024-09-13T06:40:03.093 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:03.094 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:03.094 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:03.094 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:03.094 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:03.094 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 26147 2024-09-13T06:40:03.094 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:03.094 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:03.094 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:03.094 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:03.094 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.434635+0000", 2024-09-13T06:40:03.094 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:03.094 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:03.095 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:03.095 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:03.095 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.434635+0000", 2024-09-13T06:40:03.095 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:03.095 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:03.095 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:03.095 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:03.095 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.434634+0000", 2024-09-13T06:40:03.095 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:03.095 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:03.095 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:03.095 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:03.095 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.434637+0000", 2024-09-13T06:40:03.095 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.0180000000000002e-06 2024-09-13T06:40:03.096 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:03.096 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:03.096 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:03.096 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.434643+0000", 2024-09-13T06:40:03.096 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.5380000000000002e-06 2024-09-13T06:40:03.096 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:03.096 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:03.096 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:03.096 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.434647+0000", 2024-09-13T06:40:03.096 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.5379999999999996e-06 2024-09-13T06:40:03.096 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:03.096 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:03.096 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:03.097 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.474784+0000", 2024-09-13T06:40:03.097 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.040136731000000002 2024-09-13T06:40:03.097 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:03.097 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:03.097 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:03.097 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.474879+0000", 2024-09-13T06:40:03.097 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.5274999999999998e-05 2024-09-13T06:40:03.097 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:03.097 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:03.097 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:03.097 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.475136+0000", 2024-09-13T06:40:03.097 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00025693999999999999 2024-09-13T06:40:03.097 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:03.098 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:03.098 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:03.098 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:03.098 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:03.098 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:26148 3.1c 3:3da1e1c6:::rbd_data.1121f2c5ee81.0000000000000007:13 [read 520192~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:03.100 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.434651+0000", 2024-09-13T06:40:03.100 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 6.5821941150000001, 2024-09-13T06:40:03.100 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.040853773000000003, 2024-09-13T06:40:03.100 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:03.100 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:03.100 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:03.100 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:03.100 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:03.100 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 26148 2024-09-13T06:40:03.100 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:03.100 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:03.100 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:03.100 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:03.101 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.434651+0000", 2024-09-13T06:40:03.101 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:03.101 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:03.101 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:03.101 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:03.101 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.434651+0000", 2024-09-13T06:40:03.101 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:03.101 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:03.101 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:03.101 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:03.102 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.434651+0000", 2024-09-13T06:40:03.102 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:03.102 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:03.102 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:03.102 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:03.102 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.434653+0000", 2024-09-13T06:40:03.102 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.4509999999999999e-06 2024-09-13T06:40:03.102 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:03.102 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:03.102 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:03.102 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.434659+0000", 2024-09-13T06:40:03.103 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.1930000000000001e-06 2024-09-13T06:40:03.103 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:03.103 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:03.103 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:03.103 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.434664+0000", 2024-09-13T06:40:03.103 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.7400000000000001e-06 2024-09-13T06:40:03.103 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:03.103 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:03.103 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:03.103 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.475194+0000", 2024-09-13T06:40:03.103 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.040530123000000001 2024-09-13T06:40:03.103 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:03.103 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:03.103 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:03.104 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.475300+0000", 2024-09-13T06:40:03.104 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000106 2024-09-13T06:40:03.104 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:03.104 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:03.104 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:03.104 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.475505+0000", 2024-09-13T06:40:03.104 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00020465199999999999 2024-09-13T06:40:03.104 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:03.104 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:03.104 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:03.104 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:03.104 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:03.104 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:28049 3.1d 3:b83606fe:::rbd_data.1121f2c5ee81.000000000000001b:13 [read 475136~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:03.105 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.661622+0000", 2024-09-13T06:40:03.105 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 6.3552232320000002, 2024-09-13T06:40:03.105 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.040354183000000002, 2024-09-13T06:40:03.105 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:03.105 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:03.105 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:03.105 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:03.105 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:03.105 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 28049 2024-09-13T06:40:03.105 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:03.105 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:03.105 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:03.105 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:03.106 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.661622+0000", 2024-09-13T06:40:03.106 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:03.106 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:03.106 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:03.106 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:03.106 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.661622+0000", 2024-09-13T06:40:03.106 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:03.106 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:03.106 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:03.107 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:03.107 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.661621+0000", 2024-09-13T06:40:03.107 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999986 2024-09-13T06:40:03.107 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:03.107 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:03.107 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:03.107 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.661627+0000", 2024-09-13T06:40:03.107 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.2450000000000003e-06 2024-09-13T06:40:03.107 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:03.107 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:03.107 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:03.107 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.661643+0000", 2024-09-13T06:40:03.107 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5860999999999999e-05 2024-09-13T06:40:03.107 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:03.108 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:03.108 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:03.108 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.661656+0000", 2024-09-13T06:40:03.108 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3524e-05 2024-09-13T06:40:03.108 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:03.108 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:03.108 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:03.108 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.701307+0000", 2024-09-13T06:40:03.108 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039650336000000001 2024-09-13T06:40:03.108 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:03.108 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:03.108 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:03.108 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.701418+0000", 2024-09-13T06:40:03.108 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000111333 2024-09-13T06:40:03.109 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:03.109 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:03.109 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:03.109 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.701976+0000", 2024-09-13T06:40:03.109 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000558247 2024-09-13T06:40:03.109 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:03.109 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:03.109 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:03.109 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:03.109 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:03.109 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:40:03.110 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:40:03.042+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:40:03.111 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-13T06:40:03.111 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:40:03.110+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:40:03.150 INFO:teuthology.orchestra.run.smithi081.stdout:osd.0: {} 2024-09-13T06:40:03.151 INFO:teuthology.orchestra.run.smithi081.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-13T06:40:03.166 INFO:teuthology.orchestra.run.smithi081.stdout:osd.1: {} 2024-09-13T06:40:03.166 INFO:teuthology.orchestra.run.smithi081.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-13T06:40:03.182 INFO:teuthology.orchestra.run.smithi081.stdout:osd.2: {} 2024-09-13T06:40:03.182 INFO:teuthology.orchestra.run.smithi081.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-13T06:40:03.198 INFO:teuthology.orchestra.run.smithi081.stdout:osd.3: {} 2024-09-13T06:40:03.198 INFO:teuthology.orchestra.run.smithi081.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-13T06:40:03.212 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:40:03.217+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:40:03.218 INFO:teuthology.orchestra.run.smithi081.stdout:osd.4: {} 2024-09-13T06:40:03.219 INFO:teuthology.orchestra.run.smithi081.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-13T06:40:03.237 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:40:03.238 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [], 2024-09-13T06:40:03.238 INFO:teuthology.orchestra.run.smithi139.stdout: "num_ops": 0 2024-09-13T06:40:03.238 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:40:03.238 INFO:teuthology.orchestra.run.smithi081.stdout:osd.5: {} 2024-09-13T06:40:03.238 INFO:teuthology.orchestra.run.smithi081.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-13T06:40:03.252 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-13T06:40:03.258 INFO:teuthology.orchestra.run.smithi081.stdout:osd.6: {} 2024-09-13T06:40:03.258 INFO:teuthology.orchestra.run.smithi081.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-13T06:40:03.277 INFO:teuthology.orchestra.run.smithi081.stdout:osd.7: {} 2024-09-13T06:40:03.277 INFO:teuthology.orchestra.run.smithi081.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-13T06:40:03.339 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:40:03.342+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:40:03.414 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:40:03.414+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:40:03.419 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:40:03.419 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:40:03.433 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-13T06:40:03.515 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-13T06:40:03.517+0000 7f86a5f06640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26387) UID: 0 2024-09-13T06:40:03.555 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:40:03.555 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:40:03.569 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-13T06:40:03.616 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:40:03.618+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:40:03.718 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:40:03.718+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:40:03.738 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:40:03.738 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:40:03.753 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-13T06:40:03.759 INFO:teuthology.orchestra.run.smithi081.stdout:checking clone #5, image image_client.0-clone5 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent6 2024-09-13T06:40:03.818 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:40:03.818+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:40:03.878 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:40:03.878 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:40:03.897 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-13T06:40:03.921 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:40:03.922+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:40:04.020 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:40:04.020 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:40:04.021 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:40:04.024+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:40:04.034 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-13T06:40:04.123 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:40:04.124+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:40:04.160 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:40:04.160 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:40:04.174 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-13T06:40:04.194 INFO:teuthology.orchestra.run.smithi081.stdout:1128 punch from 0x55f712c to 0x56010bd, (0x9f91 bytes) 2024-09-13T06:40:04.199 INFO:teuthology.orchestra.run.smithi081.stdout:1129 write 0x2b7e21f thru 0x2b8852d (0xa30f bytes) 2024-09-13T06:40:04.203 INFO:teuthology.orchestra.run.smithi081.stdout:1131 clone 8 order 23 su 131072 sc 7 2024-09-13T06:40:04.224 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:40:04.228+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:40:04.304 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:40:04.305 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:40:04.318 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-13T06:40:04.325 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:40:04.328+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:40:04.426 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:40:04.426+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:40:04.483 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:40:04.483 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:40:04.498 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-13T06:40:04.544 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:40:04.546+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:40:04.614 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6] out_osds: [7] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-13T06:40:04.614 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-13T06:40:04.614 INFO:tasks.thrashosds.thrasher:Reweighting osd 4 to 0.586863810444743 2024-09-13T06:40:04.615 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 4 0.586863810444743 2024-09-13T06:40:04.626 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-13T06:40:04.627 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:40:04.628+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:40:04.673 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:40:04.673 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:40:04.690 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-13T06:40:04.728 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-13T06:40:04.732+0000 7f86a5f06640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26387) UID: 0 2024-09-13T06:40:04.829 INFO:tasks.ceph.osd.6.smithi139.stderr:2024-09-13T06:40:04.832+0000 7fcd02c5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26385) UID: 0 2024-09-13T06:40:04.850 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:40:04.850 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:40:04.865 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-13T06:40:04.930 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:40:04.932+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:40:04.980 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:40:04.981 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:40:04.994 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-13T06:40:05.039 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:40:05.042+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:40:05.109 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:40:05.109 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:40:05.123 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-13T06:40:05.132 INFO:tasks.ceph.osd.6.smithi139.stderr:2024-09-13T06:40:05.132+0000 7fcd02c5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26385) UID: 0 2024-09-13T06:40:05.233 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:40:05.234+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:40:05.285 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:40:05.285 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:40:05.295 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-13T06:40:05.299 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-13T06:40:05.334 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-13T06:40:05.336+0000 7f86a5f06640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26387) UID: 0 2024-09-13T06:40:05.433 INFO:teuthology.orchestra.run.smithi081.stdout:osd.0: {} 2024-09-13T06:40:05.433 INFO:teuthology.orchestra.run.smithi081.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-13T06:40:05.434 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:40:05.434+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:40:05.449 INFO:teuthology.orchestra.run.smithi081.stdout:osd.1: {} 2024-09-13T06:40:05.449 INFO:teuthology.orchestra.run.smithi081.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-13T06:40:05.463 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:40:05.463 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:40:05.465 INFO:teuthology.orchestra.run.smithi081.stdout:osd.2: {} 2024-09-13T06:40:05.465 INFO:teuthology.orchestra.run.smithi081.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-13T06:40:05.477 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-13T06:40:05.482 INFO:teuthology.orchestra.run.smithi081.stdout:osd.3: {} 2024-09-13T06:40:05.482 INFO:teuthology.orchestra.run.smithi081.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-13T06:40:05.502 INFO:teuthology.orchestra.run.smithi081.stdout:osd.4: {} 2024-09-13T06:40:05.502 INFO:teuthology.orchestra.run.smithi081.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-13T06:40:05.523 INFO:teuthology.orchestra.run.smithi081.stdout:osd.5: {} 2024-09-13T06:40:05.523 INFO:teuthology.orchestra.run.smithi081.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-13T06:40:05.535 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:40:05.538+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:40:05.542 INFO:teuthology.orchestra.run.smithi081.stdout:osd.6: {} 2024-09-13T06:40:05.542 INFO:teuthology.orchestra.run.smithi081.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-13T06:40:05.562 INFO:teuthology.orchestra.run.smithi081.stdout:osd.7: {} 2024-09-13T06:40:05.563 INFO:teuthology.orchestra.run.smithi081.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-13T06:40:05.599 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:40:05.599 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-13T06:40:05.599 INFO:teuthology.orchestra.run.smithi081.stdout: "num_ops": 0 2024-09-13T06:40:05.599 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:40:05.615 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-13T06:40:05.616 INFO:teuthology.orchestra.run.smithi081.stderr:reweighted osd.4 to 0.586864 (963c) 2024-09-13T06:40:05.617 INFO:teuthology.orchestra.run.smithi081.stderr:nodeep-scrub is set 2024-09-13T06:40:05.636 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:40:05.636+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:40:05.730 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:40:05.730 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-13T06:40:05.730 INFO:teuthology.orchestra.run.smithi081.stdout: "complaint_time": 30, 2024-09-13T06:40:05.731 INFO:teuthology.orchestra.run.smithi081.stdout: "num_blocked_ops": 0 2024-09-13T06:40:05.731 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:40:05.737 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:40:05.738+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:40:05.743 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-13T06:40:05.838 INFO:tasks.ceph.osd.6.smithi139.stderr:2024-09-13T06:40:05.840+0000 7fcd02c5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26385) UID: 0 2024-09-13T06:40:05.901 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:40:05.901 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 20, 2024-09-13T06:40:05.902 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 600, 2024-09-13T06:40:05.902 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [ 2024-09-13T06:40:05.902 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:05.902 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:2226 3.15 3:af026987:::rbd_data.112173e2f1b7.0000000000000017:head [sparse-read 0~4194304] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-13T06:40:05.902 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:37.606562+0000", 2024-09-13T06:40:05.902 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 28.297085763999998, 2024-09-13T06:40:05.902 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.83322091700000001, 2024-09-13T06:40:05.902 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:05.902 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:40:05.902 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:05.902 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:05.902 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:05.903 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 2226 2024-09-13T06:40:05.903 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:05.903 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:05.903 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:05.903 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:05.903 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606562+0000", 2024-09-13T06:40:05.903 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:05.903 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:05.903 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:05.903 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:05.903 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606562+0000", 2024-09-13T06:40:05.903 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:05.903 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:05.903 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:05.904 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:05.904 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606561+0000", 2024-09-13T06:40:05.904 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:05.904 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:05.904 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:05.904 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:05.904 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606565+0000", 2024-09-13T06:40:05.904 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.4379999999999999e-06 2024-09-13T06:40:05.904 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:05.904 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:05.904 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:05.905 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606569+0000", 2024-09-13T06:40:05.905 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.425e-06 2024-09-13T06:40:05.905 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:05.905 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:05.905 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:05.905 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606572+0000", 2024-09-13T06:40:05.905 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.05e-06 2024-09-13T06:40:05.905 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:05.905 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:05.905 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:05.905 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606621+0000", 2024-09-13T06:40:05.905 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.8723000000000001e-05 2024-09-13T06:40:05.906 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:05.906 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:05.906 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:40:05.906 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606630+0000", 2024-09-13T06:40:05.906 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.8040000000000007e-06 2024-09-13T06:40:05.906 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:05.906 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:05.906 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:05.906 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.439648+0000", 2024-09-13T06:40:05.906 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.83301824800000002 2024-09-13T06:40:05.906 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:05.907 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:05.907 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:05.907 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.439782+0000", 2024-09-13T06:40:05.907 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00013466699999999999 2024-09-13T06:40:05.907 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:05.907 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:05.907 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:05.907 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:05.907 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:05.907 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25661 3.8 3:1180686c:::rbd_data.1121f2c5ee81.0000000000000009:13 [read 397312~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:05.907 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.436956+0000", 2024-09-13T06:40:05.907 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 9.4666912300000003, 2024-09-13T06:40:05.908 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089036758999999993, 2024-09-13T06:40:05.908 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:05.908 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:05.908 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:05.908 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:05.908 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:05.908 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25661 2024-09-13T06:40:05.908 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:05.908 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:05.908 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:05.908 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:05.908 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436956+0000", 2024-09-13T06:40:05.908 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:05.909 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:05.909 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:05.909 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:05.909 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436956+0000", 2024-09-13T06:40:05.909 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:05.909 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:05.909 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:05.909 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:05.909 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436956+0000", 2024-09-13T06:40:05.909 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:05.909 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:05.909 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:05.909 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:05.909 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436958+0000", 2024-09-13T06:40:05.910 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1770000000000001e-06 2024-09-13T06:40:05.910 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:05.910 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:05.910 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:05.910 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436963+0000", 2024-09-13T06:40:05.910 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.6489999999999996e-06 2024-09-13T06:40:05.910 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:05.910 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:05.910 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:05.910 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436975+0000", 2024-09-13T06:40:05.910 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1783999999999999e-05 2024-09-13T06:40:05.910 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:05.910 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:05.911 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:05.911 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.525671+0000", 2024-09-13T06:40:05.911 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.088696292999999995 2024-09-13T06:40:05.911 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:05.911 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:05.911 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:05.911 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.525749+0000", 2024-09-13T06:40:05.911 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.7589000000000005e-05 2024-09-13T06:40:05.911 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:05.911 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:05.911 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:05.911 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.525993+0000", 2024-09-13T06:40:05.911 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00024381000000000001 2024-09-13T06:40:05.911 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:05.912 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:05.912 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:05.912 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:05.912 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:05.912 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25662 3.8 3:1180686c:::rbd_data.1121f2c5ee81.0000000000000009:13 [read 421888~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:05.912 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.436980+0000", 2024-09-13T06:40:05.912 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 9.4666669179999996, 2024-09-13T06:40:05.912 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089367577000000004, 2024-09-13T06:40:05.912 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:05.912 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:05.912 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:05.912 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:05.913 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:05.913 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25662 2024-09-13T06:40:05.913 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:05.913 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:05.913 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:05.913 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:05.913 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436980+0000", 2024-09-13T06:40:05.913 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:05.913 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:05.913 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:05.913 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:05.913 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436980+0000", 2024-09-13T06:40:05.913 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:05.913 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:05.914 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:05.914 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:05.914 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436980+0000", 2024-09-13T06:40:05.914 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:05.914 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:05.914 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:05.914 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:05.914 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436982+0000", 2024-09-13T06:40:05.914 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3989999999999998e-06 2024-09-13T06:40:05.914 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:05.914 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:05.914 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:05.914 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436988+0000", 2024-09-13T06:40:05.914 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0039999999999996e-06 2024-09-13T06:40:05.915 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:05.915 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:05.915 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:05.915 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436993+0000", 2024-09-13T06:40:05.915 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6090000000000003e-06 2024-09-13T06:40:05.915 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:05.915 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:05.915 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:05.915 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.526035+0000", 2024-09-13T06:40:05.915 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089042248000000004 2024-09-13T06:40:05.915 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:05.915 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:05.915 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:05.916 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.526111+0000", 2024-09-13T06:40:05.916 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5643999999999996e-05 2024-09-13T06:40:05.916 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:05.916 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:05.916 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:05.916 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.526348+0000", 2024-09-13T06:40:05.916 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00023705800000000001 2024-09-13T06:40:05.916 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:05.916 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:05.916 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:05.916 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:05.916 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:05.916 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25663 3.8 3:1180686c:::rbd_data.1121f2c5ee81.0000000000000009:13 [read 466944~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:05.917 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.436998+0000", 2024-09-13T06:40:05.917 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 9.4666492709999996, 2024-09-13T06:40:05.917 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089730867000000006, 2024-09-13T06:40:05.917 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:05.917 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:05.917 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:05.917 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:05.917 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:05.917 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25663 2024-09-13T06:40:05.917 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:05.917 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:05.917 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:05.918 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:05.918 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436998+0000", 2024-09-13T06:40:05.918 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:05.918 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:05.918 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:05.918 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:05.918 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436998+0000", 2024-09-13T06:40:05.918 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:05.918 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:05.918 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:05.918 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:05.918 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436998+0000", 2024-09-13T06:40:05.918 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:05.918 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:05.919 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:05.919 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:05.919 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437000+0000", 2024-09-13T06:40:05.919 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0940000000000002e-06 2024-09-13T06:40:05.919 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:05.919 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:05.919 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:05.919 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437005+0000", 2024-09-13T06:40:05.919 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.604e-06 2024-09-13T06:40:05.919 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:05.919 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:05.919 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:05.919 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437032+0000", 2024-09-13T06:40:05.920 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6407e-05 2024-09-13T06:40:05.920 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:05.920 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:05.920 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:05.920 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.526363+0000", 2024-09-13T06:40:05.920 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089331456000000004 2024-09-13T06:40:05.920 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:05.920 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:05.920 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:05.920 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.526404+0000", 2024-09-13T06:40:05.920 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.0887999999999999e-05 2024-09-13T06:40:05.920 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:05.920 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:05.921 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:05.921 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.526729+0000", 2024-09-13T06:40:05.921 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00032486 2024-09-13T06:40:05.921 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:05.921 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:05.921 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:05.921 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:05.921 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:05.921 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25664 3.8 3:1180686c:::rbd_data.1121f2c5ee81.0000000000000009:13 [read 491520~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:05.921 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.437040+0000", 2024-09-13T06:40:05.921 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 9.4666073560000008, 2024-09-13T06:40:05.921 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.090016650000000004, 2024-09-13T06:40:05.921 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:05.922 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:05.922 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:05.922 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:05.922 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:05.922 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25664 2024-09-13T06:40:05.922 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:05.922 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:05.922 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:05.922 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:05.922 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437040+0000", 2024-09-13T06:40:05.922 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:05.922 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:05.922 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:05.923 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:05.923 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437040+0000", 2024-09-13T06:40:05.923 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:05.923 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:05.923 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:05.923 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:05.923 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437039+0000", 2024-09-13T06:40:05.923 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:05.923 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:05.923 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:05.923 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:05.923 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437047+0000", 2024-09-13T06:40:05.923 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4839999999999998e-06 2024-09-13T06:40:05.924 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:05.924 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:05.924 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:05.924 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437054+0000", 2024-09-13T06:40:05.924 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.8299999999999998e-06 2024-09-13T06:40:05.924 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:05.924 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:05.924 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:05.924 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437060+0000", 2024-09-13T06:40:05.924 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.1510000000000001e-06 2024-09-13T06:40:05.924 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:05.924 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:05.924 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:05.925 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.526772+0000", 2024-09-13T06:40:05.925 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089711737999999999 2024-09-13T06:40:05.925 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:05.925 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:05.925 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:05.925 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.526848+0000", 2024-09-13T06:40:05.925 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5870000000000004e-05 2024-09-13T06:40:05.925 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:05.925 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:05.925 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:05.925 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.527057+0000", 2024-09-13T06:40:05.925 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000209106 2024-09-13T06:40:05.925 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:05.926 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:05.926 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:05.926 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:05.926 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:05.926 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25740 3.18 3:1c662b96:::rbd_data.1121f2c5ee81.0000000000000010:13 [read 200704~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:05.926 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443352+0000", 2024-09-13T06:40:05.926 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 9.4602956809999998, 2024-09-13T06:40:05.926 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089068222000000002, 2024-09-13T06:40:05.926 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:05.926 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:05.926 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:05.926 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:05.926 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:05.927 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25740 2024-09-13T06:40:05.927 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:05.927 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:05.927 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:05.927 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:05.927 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443352+0000", 2024-09-13T06:40:05.927 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:05.927 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:05.927 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:05.927 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:05.927 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443352+0000", 2024-09-13T06:40:05.927 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:05.927 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:05.927 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:05.928 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:05.928 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443351+0000", 2024-09-13T06:40:05.928 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:05.928 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:05.928 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:05.928 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:05.928 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443354+0000", 2024-09-13T06:40:05.928 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.841e-06 2024-09-13T06:40:05.928 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:05.928 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:05.928 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:05.928 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443361+0000", 2024-09-13T06:40:05.929 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.0010000000000004e-06 2024-09-13T06:40:05.929 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:05.929 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:05.929 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:05.929 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443366+0000", 2024-09-13T06:40:05.929 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7119999999999999e-06 2024-09-13T06:40:05.929 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:05.929 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:05.929 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:05.929 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532117+0000", 2024-09-13T06:40:05.929 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.088751327000000005 2024-09-13T06:40:05.929 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:05.930 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:05.930 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:05.930 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532193+0000", 2024-09-13T06:40:05.930 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5839000000000004e-05 2024-09-13T06:40:05.930 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:05.930 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:05.930 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:05.930 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532420+0000", 2024-09-13T06:40:05.930 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00022691000000000001 2024-09-13T06:40:05.930 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:05.930 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:05.930 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:05.930 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:05.930 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:05.931 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25741 3.18 3:1c662b96:::rbd_data.1121f2c5ee81.0000000000000010:13 [read 225280~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:05.931 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443378+0000", 2024-09-13T06:40:05.931 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 9.4602689140000003, 2024-09-13T06:40:05.931 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089324107, 2024-09-13T06:40:05.931 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:05.931 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:05.931 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:05.931 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:05.931 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:05.931 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25741 2024-09-13T06:40:05.931 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:05.931 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:05.931 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:05.932 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:05.932 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443378+0000", 2024-09-13T06:40:05.932 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:05.932 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:05.932 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:05.932 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:05.932 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443378+0000", 2024-09-13T06:40:05.932 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:05.932 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:05.932 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:05.932 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:05.932 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443378+0000", 2024-09-13T06:40:05.933 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:05.933 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:05.933 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:05.933 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:05.933 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443380+0000", 2024-09-13T06:40:05.933 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3549999999999999e-06 2024-09-13T06:40:05.933 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:05.933 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:05.933 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:05.933 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443388+0000", 2024-09-13T06:40:05.933 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.7449999999999995e-06 2024-09-13T06:40:05.933 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:05.933 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:05.934 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:05.934 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443393+0000", 2024-09-13T06:40:05.934 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.4e-06 2024-09-13T06:40:05.934 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:05.934 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:05.934 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:05.934 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532454+0000", 2024-09-13T06:40:05.934 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089060941000000005 2024-09-13T06:40:05.934 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:05.934 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:05.934 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:05.934 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532512+0000", 2024-09-13T06:40:05.934 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7763000000000002e-05 2024-09-13T06:40:05.934 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:05.935 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:05.935 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:05.935 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532703+0000", 2024-09-13T06:40:05.935 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000190328 2024-09-13T06:40:05.935 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:05.935 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:05.935 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:05.935 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:05.935 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:05.935 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25742 3.18 3:1c662b96:::rbd_data.1121f2c5ee81.0000000000000010:13 [read 270336~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:05.935 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443398+0000", 2024-09-13T06:40:05.935 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 9.460249202, 2024-09-13T06:40:05.935 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089621836999999996, 2024-09-13T06:40:05.936 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:05.936 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:05.936 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:05.936 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:05.936 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:05.936 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25742 2024-09-13T06:40:05.936 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:05.936 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:05.936 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:05.936 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:05.936 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443398+0000", 2024-09-13T06:40:05.936 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:05.936 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:05.936 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:05.937 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:05.937 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443398+0000", 2024-09-13T06:40:05.937 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:05.937 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:05.937 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:05.937 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:05.937 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443398+0000", 2024-09-13T06:40:05.937 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:05.937 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:05.937 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:05.937 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:05.937 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443400+0000", 2024-09-13T06:40:05.937 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1849999999999998e-06 2024-09-13T06:40:05.938 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:05.938 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:05.938 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:05.938 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443407+0000", 2024-09-13T06:40:05.938 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3669999999999999e-06 2024-09-13T06:40:05.938 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:05.938 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:05.938 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:05.938 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443420+0000", 2024-09-13T06:40:05.938 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2645e-05 2024-09-13T06:40:05.938 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:05.938 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:05.938 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:05.939 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532742+0000", 2024-09-13T06:40:05.939 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089322200000000004 2024-09-13T06:40:05.939 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:05.939 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:05.939 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:05.939 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532818+0000", 2024-09-13T06:40:05.939 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.6019000000000005e-05 2024-09-13T06:40:05.939 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:05.939 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:05.939 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:05.939 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533020+0000", 2024-09-13T06:40:05.939 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000201721 2024-09-13T06:40:05.939 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:05.939 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:05.940 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:05.940 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:05.940 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:05.940 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25743 3.18 3:1c662b96:::rbd_data.1121f2c5ee81.0000000000000010:13 [read 294912~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:05.940 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443425+0000", 2024-09-13T06:40:05.940 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 9.460222194, 2024-09-13T06:40:05.940 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089864075000000002, 2024-09-13T06:40:05.940 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:05.940 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:05.940 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:05.940 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:05.940 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:05.940 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25743 2024-09-13T06:40:05.941 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:05.941 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:05.941 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:05.941 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:05.941 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443425+0000", 2024-09-13T06:40:05.941 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:05.941 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:05.941 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:05.941 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:05.941 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443425+0000", 2024-09-13T06:40:05.941 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:05.941 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:05.941 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:05.941 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:05.942 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443425+0000", 2024-09-13T06:40:05.942 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:05.942 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:05.942 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:05.942 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:05.942 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443432+0000", 2024-09-13T06:40:05.942 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3420000000000002e-06 2024-09-13T06:40:05.942 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:05.942 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:05.942 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:05.942 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443440+0000", 2024-09-13T06:40:05.942 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5689999999999999e-06 2024-09-13T06:40:05.942 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:05.943 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:05.943 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:05.943 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443445+0000", 2024-09-13T06:40:05.943 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9590000000000003e-06 2024-09-13T06:40:05.943 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:05.943 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:05.943 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:05.943 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533063+0000", 2024-09-13T06:40:05.943 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089617988999999995 2024-09-13T06:40:05.943 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:05.943 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:05.943 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:05.943 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533122+0000", 2024-09-13T06:40:05.944 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9052999999999999e-05 2024-09-13T06:40:05.944 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:05.944 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:05.944 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:05.944 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533289+0000", 2024-09-13T06:40:05.944 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00016752800000000001 2024-09-13T06:40:05.944 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:05.944 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:05.944 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:05.944 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:05.944 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:05.944 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25744 3.18 3.69d46638 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:05.944 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443449+0000", 2024-09-13T06:40:05.944 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 9.4601980470000004, 2024-09-13T06:40:05.945 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089869148999999995, 2024-09-13T06:40:05.945 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:05.945 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:40:05.945 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:05.945 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:05.945 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:05.945 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25744 2024-09-13T06:40:05.945 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:05.945 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:05.945 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:05.945 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:05.945 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443449+0000", 2024-09-13T06:40:05.945 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:05.946 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:05.946 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:05.946 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:05.946 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443449+0000", 2024-09-13T06:40:05.946 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:05.946 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:05.946 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:05.946 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:05.946 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443449+0000", 2024-09-13T06:40:05.946 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:05.946 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:05.946 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:05.946 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:05.947 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443451+0000", 2024-09-13T06:40:05.947 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.244e-06 2024-09-13T06:40:05.947 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:05.947 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:05.947 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:05.947 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443457+0000", 2024-09-13T06:40:05.947 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.66e-06 2024-09-13T06:40:05.947 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:05.947 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:05.947 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:05.947 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443461+0000", 2024-09-13T06:40:05.947 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5449999999999997e-06 2024-09-13T06:40:05.947 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:05.948 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:05.948 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:05.948 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533311+0000", 2024-09-13T06:40:05.948 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089849729000000003 2024-09-13T06:40:05.948 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:05.948 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:05.948 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:05.948 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533318+0000", 2024-09-13T06:40:05.948 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.328e-06 2024-09-13T06:40:05.948 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:05.948 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:05.948 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:05.948 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:05.949 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:05.949 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25745 3.18 3.69d46638 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:05.949 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443466+0000", 2024-09-13T06:40:05.949 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 9.4601809889999995, 2024-09-13T06:40:05.949 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089886743000000005, 2024-09-13T06:40:05.949 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:05.949 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:40:05.949 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:05.949 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:05.949 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:05.949 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25745 2024-09-13T06:40:05.949 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:05.949 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:05.949 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:05.950 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:05.950 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443466+0000", 2024-09-13T06:40:05.950 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:05.950 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:05.950 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:05.950 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:05.950 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443466+0000", 2024-09-13T06:40:05.950 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:05.950 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:05.950 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:05.950 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:05.950 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443466+0000", 2024-09-13T06:40:05.950 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:05.950 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:05.951 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:05.951 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:05.951 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443474+0000", 2024-09-13T06:40:05.951 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.1289999999999996e-06 2024-09-13T06:40:05.951 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:05.951 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:05.951 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:05.951 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443484+0000", 2024-09-13T06:40:05.951 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0654e-05 2024-09-13T06:40:05.951 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:05.951 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:05.951 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:05.951 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443490+0000", 2024-09-13T06:40:05.951 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8030000000000002e-06 2024-09-13T06:40:05.952 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:05.952 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:05.952 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:05.952 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533348+0000", 2024-09-13T06:40:05.952 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089857267000000005 2024-09-13T06:40:05.952 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:05.952 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:05.952 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:05.952 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533353+0000", 2024-09-13T06:40:05.952 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.5520000000000004e-06 2024-09-13T06:40:05.952 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:05.952 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:05.952 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:05.953 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:05.953 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:05.953 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25746 3.18 3.69d46638 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:05.953 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443495+0000", 2024-09-13T06:40:05.953 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 9.4601518759999994, 2024-09-13T06:40:05.953 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089903725000000004, 2024-09-13T06:40:05.953 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:05.953 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:40:05.953 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:05.953 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:05.953 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:05.953 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25746 2024-09-13T06:40:05.953 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:05.953 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:05.954 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:05.954 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:05.954 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443495+0000", 2024-09-13T06:40:05.954 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:05.954 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:05.954 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:05.954 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:05.954 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443495+0000", 2024-09-13T06:40:05.954 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:05.954 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:05.954 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:05.955 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:05.955 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443495+0000", 2024-09-13T06:40:05.955 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:05.955 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:05.955 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:05.955 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:05.955 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443498+0000", 2024-09-13T06:40:05.955 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.7690000000000001e-06 2024-09-13T06:40:05.955 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:05.955 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:05.955 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:05.955 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443504+0000", 2024-09-13T06:40:05.955 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9710000000000001e-06 2024-09-13T06:40:05.955 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:05.956 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:05.956 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:05.956 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443508+0000", 2024-09-13T06:40:05.956 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4159999999999997e-06 2024-09-13T06:40:05.956 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:05.956 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:05.956 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:05.956 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533391+0000", 2024-09-13T06:40:05.956 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089882607000000003 2024-09-13T06:40:05.956 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:05.956 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:05.956 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:05.956 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533399+0000", 2024-09-13T06:40:05.957 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.4349999999999997e-06 2024-09-13T06:40:05.957 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:05.957 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:05.957 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:05.957 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:05.957 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:05.957 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25747 3.8 3.63996268 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:05.957 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443512+0000", 2024-09-13T06:40:05.957 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 9.4601351450000006, 2024-09-13T06:40:05.957 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089880075000000004, 2024-09-13T06:40:05.957 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:05.957 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:40:05.957 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:05.958 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:05.958 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:05.958 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25747 2024-09-13T06:40:05.958 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:05.958 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:05.958 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:05.958 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:05.958 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443512+0000", 2024-09-13T06:40:05.958 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:05.958 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:05.958 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:05.958 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:05.958 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443512+0000", 2024-09-13T06:40:05.959 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:05.959 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:05.959 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:05.959 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:05.959 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443512+0000", 2024-09-13T06:40:05.959 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:05.959 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:05.959 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:05.959 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:05.959 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443514+0000", 2024-09-13T06:40:05.959 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0980000000000001e-06 2024-09-13T06:40:05.959 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:05.960 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:05.960 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:05.960 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443520+0000", 2024-09-13T06:40:05.960 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7069999999999997e-06 2024-09-13T06:40:05.960 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:05.960 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:05.960 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:05.960 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443524+0000", 2024-09-13T06:40:05.960 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5390000000000001e-06 2024-09-13T06:40:05.960 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:05.960 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:05.960 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:05.960 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533384+0000", 2024-09-13T06:40:05.961 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089859684999999995 2024-09-13T06:40:05.961 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:05.961 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:05.961 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:05.961 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533392+0000", 2024-09-13T06:40:05.961 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.3440000000000001e-06 2024-09-13T06:40:05.961 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:05.961 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:05.961 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:05.961 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:05.961 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:05.961 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25748 3.8 3.63996268 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:05.962 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443528+0000", 2024-09-13T06:40:05.962 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 9.4601190180000003, 2024-09-13T06:40:05.962 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089890715999999996, 2024-09-13T06:40:05.962 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:05.962 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:40:05.962 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:05.962 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:05.962 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:05.962 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25748 2024-09-13T06:40:05.962 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:05.962 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:05.962 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:05.962 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:05.963 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443528+0000", 2024-09-13T06:40:05.963 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:05.963 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:05.963 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:05.963 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:05.963 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443528+0000", 2024-09-13T06:40:05.963 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:05.963 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:05.963 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:05.963 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:05.963 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443528+0000", 2024-09-13T06:40:05.963 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:05.963 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:05.964 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:05.964 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:05.964 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443530+0000", 2024-09-13T06:40:05.964 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0650000000000001e-06 2024-09-13T06:40:05.964 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:05.964 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:05.964 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:05.964 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443536+0000", 2024-09-13T06:40:05.964 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7259999999999999e-06 2024-09-13T06:40:05.964 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:05.964 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:05.964 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:05.964 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443540+0000", 2024-09-13T06:40:05.965 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5009999999999998e-06 2024-09-13T06:40:05.965 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:05.965 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:05.965 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:05.965 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533412+0000", 2024-09-13T06:40:05.965 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089871873000000005 2024-09-13T06:40:05.965 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:05.965 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:05.965 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:05.965 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533419+0000", 2024-09-13T06:40:05.965 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.883e-06 2024-09-13T06:40:05.965 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:05.966 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:05.966 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:05.966 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:05.966 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:05.966 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25749 3.8 3.63996268 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:05.966 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443545+0000", 2024-09-13T06:40:05.966 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 9.4601028219999996, 2024-09-13T06:40:05.966 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089897988999999998, 2024-09-13T06:40:05.966 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:05.966 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:40:05.966 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:05.966 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:05.967 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:05.967 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25749 2024-09-13T06:40:05.967 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:05.967 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:05.967 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:05.967 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:05.967 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443545+0000", 2024-09-13T06:40:05.967 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:05.967 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:05.967 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:05.967 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:05.967 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443545+0000", 2024-09-13T06:40:05.967 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:05.967 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:05.968 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:05.968 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:05.968 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443544+0000", 2024-09-13T06:40:05.968 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:05.968 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:05.968 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:05.968 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:05.968 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443553+0000", 2024-09-13T06:40:05.968 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.4770000000000003e-06 2024-09-13T06:40:05.968 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:05.968 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:05.968 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:05.968 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443564+0000", 2024-09-13T06:40:05.969 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0986e-05 2024-09-13T06:40:05.969 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:05.969 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:05.969 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:05.969 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443569+0000", 2024-09-13T06:40:05.969 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2530000000000004e-06 2024-09-13T06:40:05.969 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:05.969 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:05.969 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:05.969 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533438+0000", 2024-09-13T06:40:05.969 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089868641999999999 2024-09-13T06:40:05.969 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:05.969 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:05.969 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:05.970 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533442+0000", 2024-09-13T06:40:05.970 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.989e-06 2024-09-13T06:40:05.970 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:05.970 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:05.970 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:05.970 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:05.970 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:05.970 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25750 3.8 3.63996268 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:05.970 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443574+0000", 2024-09-13T06:40:05.970 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 9.4600733360000007, 2024-09-13T06:40:05.970 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089895143999999996, 2024-09-13T06:40:05.970 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:05.970 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:40:05.971 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:05.971 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:05.971 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:05.971 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25750 2024-09-13T06:40:05.971 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:05.971 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:05.971 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:05.971 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:05.971 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443574+0000", 2024-09-13T06:40:05.971 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:05.971 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:05.971 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:05.971 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:05.971 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443574+0000", 2024-09-13T06:40:05.972 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:05.972 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:05.972 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:05.972 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:05.972 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443574+0000", 2024-09-13T06:40:05.972 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:05.972 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:05.972 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:05.972 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:05.972 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443576+0000", 2024-09-13T06:40:05.972 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6910000000000002e-06 2024-09-13T06:40:05.972 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:05.972 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:05.972 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:05.973 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443583+0000", 2024-09-13T06:40:05.973 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.331e-06 2024-09-13T06:40:05.973 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:05.973 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:05.973 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:05.973 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443587+0000", 2024-09-13T06:40:05.973 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6129999999999997e-06 2024-09-13T06:40:05.973 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:05.973 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:05.973 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:05.973 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533464+0000", 2024-09-13T06:40:05.973 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089876605999999998 2024-09-13T06:40:05.973 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:05.973 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:05.974 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:05.974 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533469+0000", 2024-09-13T06:40:05.974 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3909999999999997e-06 2024-09-13T06:40:05.974 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:05.974 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:05.974 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:05.974 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:05.974 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:05.974 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25751 3.8 3.63996268 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:05.974 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443592+0000", 2024-09-13T06:40:05.974 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 9.4600556390000001, 2024-09-13T06:40:05.974 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089913650999999997, 2024-09-13T06:40:05.976 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:05.977 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:40:05.977 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:05.977 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:05.977 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:05.977 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25751 2024-09-13T06:40:05.977 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:05.977 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:05.977 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:05.977 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:05.978 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443592+0000", 2024-09-13T06:40:05.978 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:05.978 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:05.978 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:05.978 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:05.978 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443592+0000", 2024-09-13T06:40:05.978 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:05.978 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:05.978 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:05.978 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:05.978 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443591+0000", 2024-09-13T06:40:05.979 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:05.979 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:05.979 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:05.979 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:05.979 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443594+0000", 2024-09-13T06:40:05.979 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3649999999999998e-06 2024-09-13T06:40:05.979 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:05.979 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:05.979 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:05.979 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443599+0000", 2024-09-13T06:40:05.979 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.699e-06 2024-09-13T06:40:05.979 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:05.980 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:05.980 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:05.980 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443611+0000", 2024-09-13T06:40:05.980 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1503e-05 2024-09-13T06:40:05.980 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:05.980 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:05.980 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:05.980 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533497+0000", 2024-09-13T06:40:05.980 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089886453000000005 2024-09-13T06:40:05.980 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:05.980 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:05.980 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:05.980 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533505+0000", 2024-09-13T06:40:05.981 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.9910000000000002e-06 2024-09-13T06:40:05.981 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:05.981 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:05.981 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:05.981 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:05.981 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:05.981 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25752 3.8 3.63996268 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:05.981 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443615+0000", 2024-09-13T06:40:05.981 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 9.4600318580000007, 2024-09-13T06:40:05.981 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089905868999999999, 2024-09-13T06:40:05.981 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:05.981 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:40:05.981 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:05.982 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:05.982 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:05.982 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25752 2024-09-13T06:40:05.982 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:05.982 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:05.982 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:05.982 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:05.982 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443615+0000", 2024-09-13T06:40:05.982 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:05.982 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:05.982 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:05.982 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:05.982 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443615+0000", 2024-09-13T06:40:05.982 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:05.983 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:05.983 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:05.983 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:05.983 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443615+0000", 2024-09-13T06:40:05.983 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:05.983 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:05.983 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:05.983 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:05.983 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443617+0000", 2024-09-13T06:40:05.983 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3539999999999998e-06 2024-09-13T06:40:05.983 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:05.983 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:05.983 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:05.984 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443624+0000", 2024-09-13T06:40:05.984 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3600000000000001e-06 2024-09-13T06:40:05.984 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:05.984 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:05.984 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:05.984 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443628+0000", 2024-09-13T06:40:05.984 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.2350000000000001e-06 2024-09-13T06:40:05.984 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:05.984 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:05.984 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:05.984 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533517+0000", 2024-09-13T06:40:05.984 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089889029999999995 2024-09-13T06:40:05.984 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:05.985 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:05.985 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:05.985 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533521+0000", 2024-09-13T06:40:05.985 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.2529999999999998e-06 2024-09-13T06:40:05.985 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:05.985 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:05.985 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:05.985 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:05.985 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:05.985 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25755 3.8 3.63996268 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:05.985 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.444692+0000", 2024-09-13T06:40:05.985 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 9.4589551519999997, 2024-09-13T06:40:05.985 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.088904186999999996, 2024-09-13T06:40:05.986 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:05.986 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:40:05.986 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:05.986 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:05.986 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:05.986 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25755 2024-09-13T06:40:05.986 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:05.986 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:05.986 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:05.986 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:05.986 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.444692+0000", 2024-09-13T06:40:05.986 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:05.986 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:05.987 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:05.987 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:05.987 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.444692+0000", 2024-09-13T06:40:05.987 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:05.987 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:05.987 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:05.987 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:05.987 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.444692+0000", 2024-09-13T06:40:05.987 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:05.987 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:05.987 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:05.987 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:05.987 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.444694+0000", 2024-09-13T06:40:05.987 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.058e-06 2024-09-13T06:40:05.988 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:05.988 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:05.988 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:05.988 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.444700+0000", 2024-09-13T06:40:05.988 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7769999999999999e-06 2024-09-13T06:40:05.988 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:05.988 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:05.988 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:05.988 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.444704+0000", 2024-09-13T06:40:05.988 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6229999999999996e-06 2024-09-13T06:40:05.988 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:05.988 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:05.988 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:05.989 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533587+0000", 2024-09-13T06:40:05.989 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.088882744999999999 2024-09-13T06:40:05.989 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:05.989 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:05.989 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:05.989 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533596+0000", 2024-09-13T06:40:05.989 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.3270000000000007e-06 2024-09-13T06:40:05.989 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:05.989 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:05.989 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:05.989 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:05.989 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:05.989 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25756 3.8 3.63996268 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:05.989 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.444709+0000", 2024-09-13T06:40:05.990 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 9.4589387760000001, 2024-09-13T06:40:05.990 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.088902571, 2024-09-13T06:40:05.990 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:05.990 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:40:05.990 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:05.990 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:05.990 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:05.990 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25756 2024-09-13T06:40:05.990 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:05.990 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:05.990 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:05.990 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:05.990 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.444709+0000", 2024-09-13T06:40:05.990 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:05.991 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:05.991 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:05.991 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:05.991 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.444709+0000", 2024-09-13T06:40:05.991 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:05.991 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:05.991 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:05.991 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:05.991 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.444708+0000", 2024-09-13T06:40:05.991 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:05.991 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:05.991 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:05.991 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:05.991 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.444710+0000", 2024-09-13T06:40:05.992 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0729999999999999e-06 2024-09-13T06:40:05.992 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:05.992 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:05.992 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:05.992 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.444716+0000", 2024-09-13T06:40:05.992 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7819999999999999e-06 2024-09-13T06:40:05.992 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:05.992 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:05.992 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:05.992 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.444720+0000", 2024-09-13T06:40:05.992 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4000000000000002e-06 2024-09-13T06:40:05.992 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:05.992 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:05.993 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:05.993 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533606+0000", 2024-09-13T06:40:05.993 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.088885711000000006 2024-09-13T06:40:05.993 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:05.993 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:05.993 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:05.993 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533611+0000", 2024-09-13T06:40:05.993 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.057e-06 2024-09-13T06:40:05.993 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:05.993 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:05.993 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:05.993 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:05.993 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:05.993 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:40:05.995 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-13T06:40:05.996 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:40:05.994+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:40:06.095 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:40:06.098+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:40:06.132 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:40:06.132 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [], 2024-09-13T06:40:06.132 INFO:teuthology.orchestra.run.smithi139.stdout: "num_ops": 0 2024-09-13T06:40:06.132 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:40:06.146 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-13T06:40:06.196 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:40:06.196+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:40:06.262 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:40:06.262 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [], 2024-09-13T06:40:06.262 INFO:teuthology.orchestra.run.smithi139.stdout: "complaint_time": 30, 2024-09-13T06:40:06.262 INFO:teuthology.orchestra.run.smithi139.stdout: "num_blocked_ops": 0 2024-09-13T06:40:06.262 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:40:06.276 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-13T06:40:06.297 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:40:06.298+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:40:06.397 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-13T06:40:06.400+0000 7f86a5f06640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26387) UID: 0 2024-09-13T06:40:06.459 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:40:06.459 INFO:teuthology.orchestra.run.smithi139.stdout: "size": 20, 2024-09-13T06:40:06.459 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 600, 2024-09-13T06:40:06.459 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [ 2024-09-13T06:40:06.459 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:06.459 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18706 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 3346432~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:40:06.459 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.846138+0000", 2024-09-13T06:40:06.459 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 14.615907100999999, 2024-09-13T06:40:06.459 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.102018712, 2024-09-13T06:40:06.459 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:06.460 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:06.460 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:06.460 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:06.460 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:06.460 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18706 2024-09-13T06:40:06.460 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:06.460 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:06.460 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:06.460 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:06.460 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846138+0000", 2024-09-13T06:40:06.460 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:06.460 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:06.461 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:06.461 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:06.461 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846138+0000", 2024-09-13T06:40:06.461 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:06.461 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:06.461 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:06.461 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:06.461 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846138+0000", 2024-09-13T06:40:06.461 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:06.461 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:06.461 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:06.461 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:06.461 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846141+0000", 2024-09-13T06:40:06.462 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.6969999999999999e-06 2024-09-13T06:40:06.462 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:06.462 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:06.462 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:06.462 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846150+0000", 2024-09-13T06:40:06.462 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6400000000000003e-06 2024-09-13T06:40:06.462 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:06.462 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:06.462 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:06.462 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846160+0000", 2024-09-13T06:40:06.462 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.3999999999999998e-06 2024-09-13T06:40:06.462 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:06.462 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:06.462 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:06.463 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.947764+0000", 2024-09-13T06:40:06.463 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101604085 2024-09-13T06:40:06.463 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:06.463 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:06.463 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:06.463 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.947888+0000", 2024-09-13T06:40:06.463 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000124113 2024-09-13T06:40:06.463 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:06.463 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:06.463 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:06.463 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.948157+0000", 2024-09-13T06:40:06.463 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00026943399999999998 2024-09-13T06:40:06.463 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:06.464 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:06.464 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:06.464 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:06.464 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:06.464 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18707 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 3375104~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:40:06.464 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.846207+0000", 2024-09-13T06:40:06.464 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 14.615838334999999, 2024-09-13T06:40:06.464 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10238114099999999, 2024-09-13T06:40:06.464 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:06.464 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:06.464 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:06.464 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:06.465 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:06.465 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18707 2024-09-13T06:40:06.465 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:06.465 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:06.465 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:06.465 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:06.465 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846207+0000", 2024-09-13T06:40:06.465 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:06.465 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:06.465 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:06.465 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:06.465 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846207+0000", 2024-09-13T06:40:06.465 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:06.465 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:06.466 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:06.466 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:06.466 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846206+0000", 2024-09-13T06:40:06.466 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:06.466 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:06.466 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:06.466 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:06.466 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846211+0000", 2024-09-13T06:40:06.466 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.3000000000000003e-06 2024-09-13T06:40:06.466 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:06.466 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:06.466 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:06.467 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846220+0000", 2024-09-13T06:40:06.467 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6199999999999994e-06 2024-09-13T06:40:06.467 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:06.467 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:06.467 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:06.467 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846228+0000", 2024-09-13T06:40:06.467 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.7500000000000003e-06 2024-09-13T06:40:06.467 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:06.467 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:06.467 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:06.467 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.948267+0000", 2024-09-13T06:40:06.467 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10203878700000001 2024-09-13T06:40:06.467 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:06.467 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:06.468 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:06.468 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.948435+0000", 2024-09-13T06:40:06.468 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00016796500000000001 2024-09-13T06:40:06.468 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:06.468 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:06.468 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:06.468 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.948588+0000", 2024-09-13T06:40:06.468 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00015373599999999999 2024-09-13T06:40:06.468 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:06.468 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:06.468 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:06.468 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:06.468 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:06.469 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18718 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 3690496~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:40:06.469 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.850174+0000", 2024-09-13T06:40:06.469 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 14.611871182, 2024-09-13T06:40:06.469 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101854154, 2024-09-13T06:40:06.469 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:06.469 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:06.469 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:06.469 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:06.469 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:06.469 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18718 2024-09-13T06:40:06.469 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:06.469 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:06.469 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:06.470 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:06.470 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850174+0000", 2024-09-13T06:40:06.470 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:06.470 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:06.470 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:06.470 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:06.470 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850174+0000", 2024-09-13T06:40:06.470 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:06.470 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:06.470 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:06.470 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:06.470 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850173+0000", 2024-09-13T06:40:06.470 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:06.471 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:06.471 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:06.471 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:06.471 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850178+0000", 2024-09-13T06:40:06.471 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.4129999999999999e-06 2024-09-13T06:40:06.471 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:06.471 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:06.471 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:06.471 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850188+0000", 2024-09-13T06:40:06.471 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.8600000000000005e-06 2024-09-13T06:40:06.471 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:06.471 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:06.471 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:06.471 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850195+0000", 2024-09-13T06:40:06.472 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.8730000000000007e-06 2024-09-13T06:40:06.472 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:06.472 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:06.472 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:06.472 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.951766+0000", 2024-09-13T06:40:06.472 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.1015703 2024-09-13T06:40:06.472 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:06.472 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:06.472 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:06.472 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.951879+0000", 2024-09-13T06:40:06.472 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000112932 2024-09-13T06:40:06.472 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:06.473 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:06.473 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:06.473 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.952029+0000", 2024-09-13T06:40:06.473 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000149846 2024-09-13T06:40:06.473 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:06.473 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:06.473 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:06.473 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:06.473 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:06.473 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18719 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 3719168~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:40:06.473 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.850202+0000", 2024-09-13T06:40:06.473 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 14.611843138999999, 2024-09-13T06:40:06.473 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.102191676, 2024-09-13T06:40:06.474 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:06.474 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:06.474 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:06.474 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:06.474 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:06.474 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18719 2024-09-13T06:40:06.474 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:06.474 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:06.474 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:06.474 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:06.474 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850202+0000", 2024-09-13T06:40:06.474 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:06.474 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:06.475 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:06.475 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:06.475 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850202+0000", 2024-09-13T06:40:06.475 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:06.475 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:06.475 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:06.475 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:06.475 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850202+0000", 2024-09-13T06:40:06.475 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:06.475 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:06.475 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:06.475 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:06.475 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850205+0000", 2024-09-13T06:40:06.475 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.89e-06 2024-09-13T06:40:06.475 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:06.476 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:06.476 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:06.476 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850216+0000", 2024-09-13T06:40:06.476 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0233e-05 2024-09-13T06:40:06.476 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:06.476 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:06.476 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:06.476 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850223+0000", 2024-09-13T06:40:06.476 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5299999999999999e-06 2024-09-13T06:40:06.476 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:06.476 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:06.476 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:06.476 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.952106+0000", 2024-09-13T06:40:06.476 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10188309299999999 2024-09-13T06:40:06.477 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:06.477 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:06.477 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:06.477 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.952233+0000", 2024-09-13T06:40:06.477 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000126993 2024-09-13T06:40:06.477 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:06.477 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:06.477 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:06.477 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.952394+0000", 2024-09-13T06:40:06.477 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000160791 2024-09-13T06:40:06.477 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:06.477 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:06.478 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:06.478 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:06.478 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:06.478 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18720 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 3747840~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:40:06.478 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.850726+0000", 2024-09-13T06:40:06.478 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 14.611319310000001, 2024-09-13T06:40:06.478 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10199504299999999, 2024-09-13T06:40:06.478 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:06.478 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:06.478 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:06.478 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:06.478 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:06.478 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18720 2024-09-13T06:40:06.479 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:06.479 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:06.479 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:06.479 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:06.479 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850726+0000", 2024-09-13T06:40:06.479 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:06.479 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:06.479 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:06.479 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:06.479 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850726+0000", 2024-09-13T06:40:06.479 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:06.479 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:06.479 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:06.480 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:06.480 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850229+0000", 2024-09-13T06:40:06.480 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9995027 2024-09-13T06:40:06.480 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:06.480 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:06.480 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:06.480 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850731+0000", 2024-09-13T06:40:06.480 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00050221599999999999 2024-09-13T06:40:06.480 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:06.480 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:06.480 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:06.480 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850751+0000", 2024-09-13T06:40:06.481 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.9703000000000001e-05 2024-09-13T06:40:06.481 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:06.481 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:06.481 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:06.481 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850764+0000", 2024-09-13T06:40:06.481 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3207000000000001e-05 2024-09-13T06:40:06.481 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:06.481 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:06.481 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:06.481 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.952454+0000", 2024-09-13T06:40:06.481 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101690102 2024-09-13T06:40:06.482 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:06.482 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:06.482 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:06.482 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.952571+0000", 2024-09-13T06:40:06.482 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000116556 2024-09-13T06:40:06.482 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:06.482 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:06.482 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:06.482 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.952721+0000", 2024-09-13T06:40:06.482 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000150419 2024-09-13T06:40:06.482 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:06.482 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:06.483 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:06.483 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:06.483 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:06.483 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18730 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 4034560~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:40:06.483 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.854013+0000", 2024-09-13T06:40:06.483 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 14.608032369, 2024-09-13T06:40:06.483 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10186914399999999, 2024-09-13T06:40:06.483 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:06.483 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:06.483 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:06.483 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:06.483 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:06.483 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18730 2024-09-13T06:40:06.484 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:06.484 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:06.484 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:06.484 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:06.484 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.854013+0000", 2024-09-13T06:40:06.484 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:06.484 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:06.484 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:06.484 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:06.484 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.854013+0000", 2024-09-13T06:40:06.484 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:06.484 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:06.484 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:06.485 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:06.485 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.854013+0000", 2024-09-13T06:40:06.485 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:06.485 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:06.485 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:06.485 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:06.485 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.854016+0000", 2024-09-13T06:40:06.485 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.1839999999999999e-06 2024-09-13T06:40:06.485 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:06.485 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:06.485 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:06.485 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.854025+0000", 2024-09-13T06:40:06.486 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.8030000000000003e-06 2024-09-13T06:40:06.486 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:06.486 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:06.486 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:06.486 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.854033+0000", 2024-09-13T06:40:06.486 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6500000000000002e-06 2024-09-13T06:40:06.486 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:06.486 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:06.486 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:06.486 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.955546+0000", 2024-09-13T06:40:06.486 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10151296 2024-09-13T06:40:06.486 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:06.486 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:06.487 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:06.487 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.955694+0000", 2024-09-13T06:40:06.487 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000147773 2024-09-13T06:40:06.487 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:06.487 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:06.487 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:06.487 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.955882+0000", 2024-09-13T06:40:06.487 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000188371 2024-09-13T06:40:06.487 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:06.487 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:06.487 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:06.487 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:06.487 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:06.488 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18742 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 4378624~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:40:06.488 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.857984+0000", 2024-09-13T06:40:06.488 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 14.604061246000001, 2024-09-13T06:40:06.488 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10179961799999999, 2024-09-13T06:40:06.488 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:06.488 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:06.488 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:06.488 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:06.488 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:06.488 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18742 2024-09-13T06:40:06.488 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:06.488 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:06.489 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:06.489 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:06.489 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.857984+0000", 2024-09-13T06:40:06.489 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:06.489 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:06.489 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:06.489 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:06.489 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.857984+0000", 2024-09-13T06:40:06.489 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:06.489 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:06.489 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:06.489 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:06.489 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.857983+0000", 2024-09-13T06:40:06.490 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:06.490 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:06.490 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:06.490 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:06.490 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.857987+0000", 2024-09-13T06:40:06.490 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0670000000000002e-06 2024-09-13T06:40:06.490 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:06.490 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:06.490 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:06.490 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.857997+0000", 2024-09-13T06:40:06.490 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6830000000000003e-06 2024-09-13T06:40:06.490 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:06.490 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:06.490 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:06.491 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.858006+0000", 2024-09-13T06:40:06.491 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.5739999999999996e-06 2024-09-13T06:40:06.491 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:06.491 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:06.491 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:06.491 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.959453+0000", 2024-09-13T06:40:06.491 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101447339 2024-09-13T06:40:06.491 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:06.491 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:06.491 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:06.491 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.959603+0000", 2024-09-13T06:40:06.491 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000150316 2024-09-13T06:40:06.491 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:06.492 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:06.492 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:06.492 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.959784+0000", 2024-09-13T06:40:06.492 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00018065900000000001 2024-09-13T06:40:06.492 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:06.492 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:06.492 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:06.492 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:06.492 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:06.492 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18743 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 4407296~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:40:06.492 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.858012+0000", 2024-09-13T06:40:06.492 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 14.604033253000001, 2024-09-13T06:40:06.492 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10210024500000001, 2024-09-13T06:40:06.493 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:06.493 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:06.493 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:06.493 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:06.493 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:06.493 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18743 2024-09-13T06:40:06.493 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:06.493 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:06.493 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:06.493 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:06.493 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.858012+0000", 2024-09-13T06:40:06.493 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:06.493 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:06.494 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:06.494 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:06.494 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.858012+0000", 2024-09-13T06:40:06.494 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:06.494 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:06.494 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:06.494 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:06.494 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.858011+0000", 2024-09-13T06:40:06.494 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:06.494 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:06.494 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:06.494 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:06.494 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.858016+0000", 2024-09-13T06:40:06.495 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0659999999999997e-06 2024-09-13T06:40:06.495 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:06.495 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:06.495 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:06.495 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.858024+0000", 2024-09-13T06:40:06.495 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.7700000000000007e-06 2024-09-13T06:40:06.495 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:06.495 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:06.495 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:06.495 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.858032+0000", 2024-09-13T06:40:06.495 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.7700000000000001e-06 2024-09-13T06:40:06.495 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:06.495 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:06.495 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:06.496 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.959850+0000", 2024-09-13T06:40:06.496 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.1018182 2024-09-13T06:40:06.496 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:06.496 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:06.496 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:06.496 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.959964+0000", 2024-09-13T06:40:06.496 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00011413600000000001 2024-09-13T06:40:06.496 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:06.496 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:06.496 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:06.496 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.960113+0000", 2024-09-13T06:40:06.496 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00014813900000000001 2024-09-13T06:40:06.496 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:06.497 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:06.497 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:06.497 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:06.497 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:06.497 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18755 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 4751360~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:40:06.497 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.862061+0000", 2024-09-13T06:40:06.497 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 14.599985001, 2024-09-13T06:40:06.497 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101907023, 2024-09-13T06:40:06.497 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:06.497 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:06.497 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:06.497 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:06.498 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:06.498 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18755 2024-09-13T06:40:06.498 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:06.498 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:06.498 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:06.498 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:06.498 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862061+0000", 2024-09-13T06:40:06.498 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:06.498 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:06.498 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:06.498 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:06.498 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862061+0000", 2024-09-13T06:40:06.498 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:06.498 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:06.499 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:06.499 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:06.499 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862060+0000", 2024-09-13T06:40:06.499 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:06.499 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:06.499 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:06.499 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:06.499 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862064+0000", 2024-09-13T06:40:06.499 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.3229999999999999e-06 2024-09-13T06:40:06.499 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:06.499 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:06.499 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:06.499 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862078+0000", 2024-09-13T06:40:06.500 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.433e-05 2024-09-13T06:40:06.500 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:06.500 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:06.500 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:06.500 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862086+0000", 2024-09-13T06:40:06.500 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.3869999999999997e-06 2024-09-13T06:40:06.500 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:06.500 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:06.500 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:06.500 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.963635+0000", 2024-09-13T06:40:06.500 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101549606 2024-09-13T06:40:06.500 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:06.500 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:06.501 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:06.501 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.963783+0000", 2024-09-13T06:40:06.501 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000147312 2024-09-13T06:40:06.501 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:06.501 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:06.501 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:06.501 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.963968+0000", 2024-09-13T06:40:06.501 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000185028 2024-09-13T06:40:06.501 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:06.501 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:06.501 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:06.501 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:06.501 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:06.502 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18756 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 4780032~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:40:06.502 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.862132+0000", 2024-09-13T06:40:06.502 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 14.599913158, 2024-09-13T06:40:06.502 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.102159295, 2024-09-13T06:40:06.502 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:06.502 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:06.502 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:06.502 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:06.502 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:06.502 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18756 2024-09-13T06:40:06.502 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:06.502 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:06.502 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:06.502 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:06.503 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862132+0000", 2024-09-13T06:40:06.503 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:06.503 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:06.503 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:06.503 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:06.503 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862132+0000", 2024-09-13T06:40:06.503 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:06.503 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:06.503 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:06.503 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:06.503 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862132+0000", 2024-09-13T06:40:06.503 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:06.503 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:06.503 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:06.504 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:06.504 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862136+0000", 2024-09-13T06:40:06.504 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.9559999999999999e-06 2024-09-13T06:40:06.504 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:06.504 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:06.504 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:06.504 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862145+0000", 2024-09-13T06:40:06.504 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6169999999999996e-06 2024-09-13T06:40:06.504 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:06.504 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:06.504 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:06.504 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862153+0000", 2024-09-13T06:40:06.505 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.8359999999999992e-06 2024-09-13T06:40:06.505 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:06.505 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:06.505 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:06.505 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.964018+0000", 2024-09-13T06:40:06.505 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101865421 2024-09-13T06:40:06.505 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:06.505 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:06.505 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:06.505 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.964140+0000", 2024-09-13T06:40:06.505 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000121172 2024-09-13T06:40:06.505 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:06.505 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:06.506 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:06.506 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.964292+0000", 2024-09-13T06:40:06.506 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00015202600000000001 2024-09-13T06:40:06.506 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:06.506 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:06.506 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:06.506 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:06.506 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:06.506 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18768 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 5124096~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:40:06.506 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.866345+0000", 2024-09-13T06:40:06.506 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 14.595700851, 2024-09-13T06:40:06.506 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101779361, 2024-09-13T06:40:06.506 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:06.506 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:06.506 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:06.507 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:06.507 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:06.507 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18768 2024-09-13T06:40:06.507 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:06.507 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:06.507 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:06.507 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:06.507 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.866345+0000", 2024-09-13T06:40:06.507 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:06.507 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:06.507 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:06.507 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:06.507 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.866345+0000", 2024-09-13T06:40:06.507 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:06.507 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:06.508 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:06.508 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:06.508 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.866344+0000", 2024-09-13T06:40:06.508 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:06.508 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:06.508 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:06.508 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:06.508 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.866348+0000", 2024-09-13T06:40:06.508 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.4300000000000002e-06 2024-09-13T06:40:06.508 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:06.508 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:06.508 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:06.509 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.866356+0000", 2024-09-13T06:40:06.509 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.5930000000000006e-06 2024-09-13T06:40:06.509 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:06.509 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:06.509 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:06.509 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.866364+0000", 2024-09-13T06:40:06.509 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5599999999999996e-06 2024-09-13T06:40:06.509 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:06.509 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:06.509 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:06.509 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.967865+0000", 2024-09-13T06:40:06.509 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101501683 2024-09-13T06:40:06.510 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:06.510 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:06.510 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:06.510 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.967981+0000", 2024-09-13T06:40:06.510 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000115643 2024-09-13T06:40:06.510 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:06.510 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:06.510 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:06.510 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.968124+0000", 2024-09-13T06:40:06.510 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00014305500000000001 2024-09-13T06:40:06.510 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:06.510 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:06.510 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:06.511 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:06.511 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:06.511 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18779 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 5439488~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:40:06.511 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.869996+0000", 2024-09-13T06:40:06.511 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 14.592049965999999, 2024-09-13T06:40:06.511 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10189577399999999, 2024-09-13T06:40:06.511 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:06.511 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:06.511 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:06.511 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:06.511 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:06.511 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18779 2024-09-13T06:40:06.511 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:06.511 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:06.512 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:06.512 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:06.512 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.869996+0000", 2024-09-13T06:40:06.512 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:06.512 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:06.512 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:06.512 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:06.512 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.869996+0000", 2024-09-13T06:40:06.512 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:06.512 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:06.512 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:06.512 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:06.513 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.869995+0000", 2024-09-13T06:40:06.513 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:06.513 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:06.513 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:06.513 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:06.513 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.869998+0000", 2024-09-13T06:40:06.513 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.2729999999999998e-06 2024-09-13T06:40:06.513 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:06.513 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:06.513 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:06.513 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.870007+0000", 2024-09-13T06:40:06.513 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.5760000000000006e-06 2024-09-13T06:40:06.513 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:06.514 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:06.514 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:06.514 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.870014+0000", 2024-09-13T06:40:06.514 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.1400000000000002e-06 2024-09-13T06:40:06.514 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:06.514 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:06.514 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:06.514 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.971631+0000", 2024-09-13T06:40:06.514 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101617503 2024-09-13T06:40:06.514 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:06.514 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:06.514 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:06.515 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.971747+0000", 2024-09-13T06:40:06.515 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00011599600000000001 2024-09-13T06:40:06.515 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:06.515 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:06.515 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:06.515 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.971891+0000", 2024-09-13T06:40:06.515 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000143912 2024-09-13T06:40:06.515 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:06.515 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:06.515 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:06.516 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:06.516 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:06.516 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18792 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 5812224~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:40:06.516 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.874371+0000", 2024-09-13T06:40:06.516 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 14.587674836, 2024-09-13T06:40:06.516 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101736005, 2024-09-13T06:40:06.516 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:06.516 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:06.516 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:06.516 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:06.516 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:06.516 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18792 2024-09-13T06:40:06.516 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:06.517 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:06.517 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:06.517 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:06.517 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874371+0000", 2024-09-13T06:40:06.517 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:06.517 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:06.517 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:06.517 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:06.517 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874371+0000", 2024-09-13T06:40:06.517 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:06.517 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:06.517 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:06.517 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:06.518 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874370+0000", 2024-09-13T06:40:06.518 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:06.518 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:06.518 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:06.518 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:06.518 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874374+0000", 2024-09-13T06:40:06.518 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.7239999999999998e-06 2024-09-13T06:40:06.518 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:06.518 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:06.518 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:06.518 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874385+0000", 2024-09-13T06:40:06.518 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1293e-05 2024-09-13T06:40:06.518 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:06.519 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:06.519 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:06.519 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874394+0000", 2024-09-13T06:40:06.519 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.0729999999999994e-06 2024-09-13T06:40:06.519 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:06.519 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:06.519 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:06.519 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.975850+0000", 2024-09-13T06:40:06.519 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10145599700000001 2024-09-13T06:40:06.519 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:06.519 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:06.519 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:06.519 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.975963+0000", 2024-09-13T06:40:06.520 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000112689 2024-09-13T06:40:06.520 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:06.520 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:06.520 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:06.520 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.976107+0000", 2024-09-13T06:40:06.520 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000143836 2024-09-13T06:40:06.520 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:06.520 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:06.520 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:06.520 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:06.520 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:06.520 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18793 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 5840896~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:40:06.520 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.874401+0000", 2024-09-13T06:40:06.521 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 14.587644803, 2024-09-13T06:40:06.521 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.102005516, 2024-09-13T06:40:06.521 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:06.521 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:06.521 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:06.521 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:06.521 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:06.521 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18793 2024-09-13T06:40:06.521 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:06.521 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:06.521 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:06.521 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:06.521 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874401+0000", 2024-09-13T06:40:06.522 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:06.522 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:06.522 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:06.522 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:06.522 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874401+0000", 2024-09-13T06:40:06.522 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:06.522 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:06.522 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:06.522 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:06.522 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874400+0000", 2024-09-13T06:40:06.522 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:06.522 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:06.523 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:06.523 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:06.523 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874404+0000", 2024-09-13T06:40:06.523 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0069999999999999e-06 2024-09-13T06:40:06.523 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:06.523 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:06.523 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:06.523 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874412+0000", 2024-09-13T06:40:06.523 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.5399999999999996e-06 2024-09-13T06:40:06.523 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:06.523 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:06.523 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:06.523 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874420+0000", 2024-09-13T06:40:06.524 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.6199999999999999e-06 2024-09-13T06:40:06.524 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:06.524 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:06.524 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:06.524 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.976150+0000", 2024-09-13T06:40:06.524 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101729874 2024-09-13T06:40:06.524 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:06.524 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:06.524 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:06.524 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.976261+0000", 2024-09-13T06:40:06.524 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000110819 2024-09-13T06:40:06.524 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:06.524 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:06.525 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:06.525 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.976406+0000", 2024-09-13T06:40:06.525 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000145489 2024-09-13T06:40:06.525 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:06.525 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:06.525 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:06.525 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:06.525 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:06.525 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18803 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 6127616~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:40:06.525 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.877851+0000", 2024-09-13T06:40:06.525 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 14.584194310000001, 2024-09-13T06:40:06.525 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101951584, 2024-09-13T06:40:06.525 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:06.526 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:06.526 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:06.526 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:06.526 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:06.526 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18803 2024-09-13T06:40:06.526 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:06.526 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:06.526 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:06.526 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:06.526 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.877851+0000", 2024-09-13T06:40:06.526 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:06.526 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:06.526 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:06.526 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:06.527 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.877851+0000", 2024-09-13T06:40:06.527 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:06.527 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:06.527 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:06.527 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:06.527 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.877851+0000", 2024-09-13T06:40:06.527 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:06.527 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:06.527 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:06.527 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:06.527 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.877854+0000", 2024-09-13T06:40:06.527 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.7929999999999999e-06 2024-09-13T06:40:06.527 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:06.528 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:06.528 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:06.528 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.877864+0000", 2024-09-13T06:40:06.528 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.2029999999999998e-06 2024-09-13T06:40:06.528 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:06.528 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:06.528 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:06.528 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.877873+0000", 2024-09-13T06:40:06.528 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.0440000000000001e-06 2024-09-13T06:40:06.528 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:06.528 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:06.528 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:06.528 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.979544+0000", 2024-09-13T06:40:06.528 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101671198 2024-09-13T06:40:06.529 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:06.529 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:06.529 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:06.529 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.979658+0000", 2024-09-13T06:40:06.529 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000114456 2024-09-13T06:40:06.529 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:06.529 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:06.529 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:06.529 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.979803+0000", 2024-09-13T06:40:06.529 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000144506 2024-09-13T06:40:06.529 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:06.529 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:06.529 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:06.530 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:06.530 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:06.530 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18807 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 6242304~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:40:06.530 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.879235+0000", 2024-09-13T06:40:06.530 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 14.58281028, 2024-09-13T06:40:06.530 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101781258, 2024-09-13T06:40:06.530 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:06.530 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:06.530 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:06.530 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:06.530 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:06.530 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18807 2024-09-13T06:40:06.530 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:06.530 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:06.531 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:06.531 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:06.531 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879235+0000", 2024-09-13T06:40:06.531 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:06.531 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:06.531 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:06.531 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:06.531 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879235+0000", 2024-09-13T06:40:06.531 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:06.531 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:06.531 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:06.531 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:06.531 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879235+0000", 2024-09-13T06:40:06.532 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:06.532 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:06.532 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:06.532 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:06.532 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879239+0000", 2024-09-13T06:40:06.532 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.963e-06 2024-09-13T06:40:06.532 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:06.532 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:06.532 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:06.532 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879247+0000", 2024-09-13T06:40:06.532 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6470000000000004e-06 2024-09-13T06:40:06.532 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:06.532 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:06.532 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:06.533 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879255+0000", 2024-09-13T06:40:06.533 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5429999999999996e-06 2024-09-13T06:40:06.533 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:06.533 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:06.533 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:06.533 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.980756+0000", 2024-09-13T06:40:06.533 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10150165999999999 2024-09-13T06:40:06.533 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:06.533 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:06.533 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:06.533 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.980868+0000", 2024-09-13T06:40:06.533 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000111196 2024-09-13T06:40:06.533 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:06.534 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:06.534 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:06.534 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.981017+0000", 2024-09-13T06:40:06.534 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000148846 2024-09-13T06:40:06.534 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:06.534 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:06.534 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:06.534 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:06.534 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:06.534 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18808 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 6270976~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:40:06.534 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.879261+0000", 2024-09-13T06:40:06.534 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 14.582784140999999, 2024-09-13T06:40:06.534 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.102057547, 2024-09-13T06:40:06.535 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:06.535 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:06.535 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:06.535 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:06.535 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:06.535 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18808 2024-09-13T06:40:06.535 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:06.535 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:06.535 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:06.535 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:06.535 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879261+0000", 2024-09-13T06:40:06.535 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:06.535 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:06.535 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:06.536 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:06.536 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879261+0000", 2024-09-13T06:40:06.536 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:06.536 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:06.536 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:06.536 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:06.536 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879261+0000", 2024-09-13T06:40:06.536 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:06.536 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:06.536 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:06.536 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:06.536 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879264+0000", 2024-09-13T06:40:06.536 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.523e-06 2024-09-13T06:40:06.537 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:06.537 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:06.537 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:06.537 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879273+0000", 2024-09-13T06:40:06.537 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6070000000000008e-06 2024-09-13T06:40:06.537 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:06.537 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:06.537 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:06.537 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879280+0000", 2024-09-13T06:40:06.537 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.4699999999999996e-06 2024-09-13T06:40:06.537 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:06.537 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:06.537 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:06.538 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.981060+0000", 2024-09-13T06:40:06.538 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10177934800000001 2024-09-13T06:40:06.538 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:06.538 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:06.538 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:06.538 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.981174+0000", 2024-09-13T06:40:06.538 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000114456 2024-09-13T06:40:06.538 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:06.538 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:06.538 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:06.538 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.981319+0000", 2024-09-13T06:40:06.538 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00014473900000000001 2024-09-13T06:40:06.538 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:06.539 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:06.539 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:06.539 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:06.539 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:06.539 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18810 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 2662400~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:40:06.539 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.880386+0000", 2024-09-13T06:40:06.539 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 14.581659978999999, 2024-09-13T06:40:06.539 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101728022, 2024-09-13T06:40:06.539 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:06.539 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:06.539 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:06.539 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:06.539 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:06.540 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18810 2024-09-13T06:40:06.540 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:06.540 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:06.540 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:06.540 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:06.540 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880386+0000", 2024-09-13T06:40:06.540 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:06.540 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:06.540 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:06.540 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:06.540 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880386+0000", 2024-09-13T06:40:06.540 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:06.540 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:06.541 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:06.541 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:06.541 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880385+0000", 2024-09-13T06:40:06.541 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:06.541 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:06.541 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:06.541 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:06.541 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880389+0000", 2024-09-13T06:40:06.541 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.8539999999999999e-06 2024-09-13T06:40:06.541 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:06.541 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:06.541 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:06.541 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880398+0000", 2024-09-13T06:40:06.541 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.1689999999999998e-06 2024-09-13T06:40:06.542 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:06.542 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:06.542 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:06.542 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880405+0000", 2024-09-13T06:40:06.542 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5700000000000004e-06 2024-09-13T06:40:06.542 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:06.542 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:06.542 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:06.542 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.981833+0000", 2024-09-13T06:40:06.542 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10142791800000001 2024-09-13T06:40:06.542 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:06.542 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:06.542 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:06.542 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.981973+0000", 2024-09-13T06:40:06.543 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00014002900000000001 2024-09-13T06:40:06.543 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:06.543 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:06.543 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:06.543 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.982114+0000", 2024-09-13T06:40:06.543 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000140276 2024-09-13T06:40:06.543 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:06.543 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:06.543 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:06.543 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:06.543 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:06.543 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18811 3.9 3.140f5209 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:40:06.543 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.880449+0000", 2024-09-13T06:40:06.543 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 14.581596602999999, 2024-09-13T06:40:06.544 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101739355, 2024-09-13T06:40:06.544 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:06.544 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:40:06.544 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:06.544 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:06.544 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:06.544 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18811 2024-09-13T06:40:06.544 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:06.544 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:06.544 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:06.544 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:06.544 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880449+0000", 2024-09-13T06:40:06.544 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:06.545 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:06.545 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:06.545 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:06.545 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880449+0000", 2024-09-13T06:40:06.545 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:06.545 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:06.545 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:06.545 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:06.545 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880448+0000", 2024-09-13T06:40:06.545 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:06.545 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:06.545 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:06.545 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:06.545 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880452+0000", 2024-09-13T06:40:06.546 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0470000000000004e-06 2024-09-13T06:40:06.546 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:06.546 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:06.546 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:06.546 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880462+0000", 2024-09-13T06:40:06.546 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6530000000000006e-06 2024-09-13T06:40:06.546 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:06.546 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:06.546 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:06.546 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880472+0000", 2024-09-13T06:40:06.546 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0027000000000001e-05 2024-09-13T06:40:06.546 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:06.546 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:06.546 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:06.547 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.982172+0000", 2024-09-13T06:40:06.547 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10170043500000001 2024-09-13T06:40:06.547 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:06.547 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:06.547 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:06.547 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.982188+0000", 2024-09-13T06:40:06.547 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6172999999999999e-05 2024-09-13T06:40:06.547 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:06.547 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:06.547 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:06.547 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:06.547 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:06.547 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18812 3.9 3.140f5209 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:40:06.547 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.880478+0000", 2024-09-13T06:40:06.548 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 14.581567366, 2024-09-13T06:40:06.548 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10177795100000001, 2024-09-13T06:40:06.548 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:06.548 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:40:06.548 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:06.548 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:06.548 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:06.548 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18812 2024-09-13T06:40:06.548 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:06.548 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:06.548 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:06.548 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:06.548 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880478+0000", 2024-09-13T06:40:06.549 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:06.549 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:06.549 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:06.549 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:06.549 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880478+0000", 2024-09-13T06:40:06.549 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:06.549 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:06.549 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:06.549 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:06.549 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880477+0000", 2024-09-13T06:40:06.549 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:06.549 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:06.549 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:06.550 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:06.550 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880481+0000", 2024-09-13T06:40:06.550 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.827e-06 2024-09-13T06:40:06.550 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:06.550 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:06.550 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:06.550 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880490+0000", 2024-09-13T06:40:06.550 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6100000000000006e-06 2024-09-13T06:40:06.550 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:06.550 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:06.550 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:06.550 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880497+0000", 2024-09-13T06:40:06.550 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.7030000000000006e-06 2024-09-13T06:40:06.550 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:06.551 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:06.551 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:06.551 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.982241+0000", 2024-09-13T06:40:06.551 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10174351199999999 2024-09-13T06:40:06.551 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:06.551 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:06.551 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:06.551 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.982256+0000", 2024-09-13T06:40:06.551 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5143000000000001e-05 2024-09-13T06:40:06.551 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:06.551 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:06.551 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:06.551 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:06.551 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:06.552 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:40:06.553 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-13T06:40:06.554 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:40:06.554+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:40:06.654 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:40:06.656+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:40:06.722 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:40:06.722 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [], 2024-09-13T06:40:06.722 INFO:teuthology.orchestra.run.smithi139.stdout: "num_ops": 0 2024-09-13T06:40:06.722 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:40:06.736 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-13T06:40:06.755 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:40:06.758+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:40:06.856 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:40:06.858+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:40:06.896 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:40:06.897 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [], 2024-09-13T06:40:06.897 INFO:teuthology.orchestra.run.smithi139.stdout: "complaint_time": 30, 2024-09-13T06:40:06.897 INFO:teuthology.orchestra.run.smithi139.stdout: "num_blocked_ops": 0 2024-09-13T06:40:06.897 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:40:06.911 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-13T06:40:06.957 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:40:06.958+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:40:07.037 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:40:07.037 INFO:teuthology.orchestra.run.smithi139.stdout: "size": 20, 2024-09-13T06:40:07.037 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 600, 2024-09-13T06:40:07.037 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [ 2024-09-13T06:40:07.037 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.037 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:25884 3.1c 3:3da1e1c6:::rbd_data.1121f2c5ee81.0000000000000007:13 [read 167936~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:07.037 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.424614+0000", 2024-09-13T06:40:07.037 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 10.614081727, 2024-09-13T06:40:07.037 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.040027199999999999, 2024-09-13T06:40:07.037 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:07.038 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:07.038 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:07.038 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:07.038 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:07.038 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 25884 2024-09-13T06:40:07.038 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.038 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:07.038 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.038 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:07.038 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.424614+0000", 2024-09-13T06:40:07.038 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:07.038 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.039 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.039 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:07.039 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.424614+0000", 2024-09-13T06:40:07.039 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:07.039 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.039 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.039 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:07.039 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.424613+0000", 2024-09-13T06:40:07.039 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:07.039 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.039 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.039 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:07.039 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.424619+0000", 2024-09-13T06:40:07.040 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.6149999999999996e-06 2024-09-13T06:40:07.040 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.040 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.040 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:07.040 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.424629+0000", 2024-09-13T06:40:07.040 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0145e-05 2024-09-13T06:40:07.040 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.040 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.040 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:07.040 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.424635+0000", 2024-09-13T06:40:07.040 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.0039999999999996e-06 2024-09-13T06:40:07.040 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.040 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.041 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:07.041 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.464196+0000", 2024-09-13T06:40:07.041 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039561116 2024-09-13T06:40:07.041 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.041 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.041 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:07.041 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.464257+0000", 2024-09-13T06:40:07.041 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.1215000000000003e-05 2024-09-13T06:40:07.041 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.041 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.041 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:07.041 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.464641+0000", 2024-09-13T06:40:07.042 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00038401199999999998 2024-09-13T06:40:07.042 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:07.042 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:07.042 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:07.042 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.042 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.042 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:25885 3.1c 3:3da1e1c6:::rbd_data.1121f2c5ee81.0000000000000007:13 [read 212992~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:07.042 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.424640+0000", 2024-09-13T06:40:07.042 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 10.614055726, 2024-09-13T06:40:07.042 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.040449289999999999, 2024-09-13T06:40:07.042 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:07.042 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:07.042 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:07.043 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:07.043 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:07.043 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 25885 2024-09-13T06:40:07.043 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.043 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:07.043 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.043 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:07.043 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.424640+0000", 2024-09-13T06:40:07.043 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:07.043 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.043 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.043 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:07.043 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.424640+0000", 2024-09-13T06:40:07.044 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:07.044 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.044 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.044 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:07.044 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.424640+0000", 2024-09-13T06:40:07.044 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:07.044 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.044 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.044 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:07.044 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.424643+0000", 2024-09-13T06:40:07.044 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.19e-06 2024-09-13T06:40:07.045 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.045 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.045 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:07.045 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.424650+0000", 2024-09-13T06:40:07.045 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.1189999999999999e-06 2024-09-13T06:40:07.045 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.045 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.045 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:07.045 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.424656+0000", 2024-09-13T06:40:07.045 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.7780000000000004e-06 2024-09-13T06:40:07.045 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.045 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.045 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:07.046 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.464699+0000", 2024-09-13T06:40:07.046 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.040043792000000002 2024-09-13T06:40:07.046 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.046 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.046 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:07.046 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.464800+0000", 2024-09-13T06:40:07.046 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000100278 2024-09-13T06:40:07.046 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.046 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.046 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:07.046 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.465089+0000", 2024-09-13T06:40:07.046 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00028969800000000002 2024-09-13T06:40:07.046 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:07.047 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:07.047 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:07.047 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.047 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.047 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:25886 3.1c 3:3da1e1c6:::rbd_data.1121f2c5ee81.0000000000000007:13 [read 237568~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:07.047 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.424661+0000", 2024-09-13T06:40:07.047 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 10.614035361999999, 2024-09-13T06:40:07.047 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.040784316000000001, 2024-09-13T06:40:07.047 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:07.047 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:07.047 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:07.047 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:07.047 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:07.048 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 25886 2024-09-13T06:40:07.048 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.048 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:07.048 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.048 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:07.048 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.424661+0000", 2024-09-13T06:40:07.048 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:07.048 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.048 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.048 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:07.048 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.424661+0000", 2024-09-13T06:40:07.048 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:07.049 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.049 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.049 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:07.049 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.424660+0000", 2024-09-13T06:40:07.049 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:07.049 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.049 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.049 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:07.049 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.424672+0000", 2024-09-13T06:40:07.049 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1578e-05 2024-09-13T06:40:07.049 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.049 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.049 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:07.050 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.424680+0000", 2024-09-13T06:40:07.050 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.9489999999999996e-06 2024-09-13T06:40:07.050 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.050 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.050 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:07.050 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.424689+0000", 2024-09-13T06:40:07.050 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.0790000000000007e-06 2024-09-13T06:40:07.050 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.050 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.050 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:07.050 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.465128+0000", 2024-09-13T06:40:07.050 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.040438922000000002 2024-09-13T06:40:07.050 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.050 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.051 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:07.051 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.465210+0000", 2024-09-13T06:40:07.051 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.2853000000000001e-05 2024-09-13T06:40:07.051 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.051 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.051 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:07.051 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.465445+0000", 2024-09-13T06:40:07.051 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000234453 2024-09-13T06:40:07.051 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:07.051 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:07.051 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:07.051 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.051 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.052 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:25887 3.1c 3:3da1e1c6:::rbd_data.1121f2c5ee81.0000000000000007:13 [read 307200~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:07.052 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.425137+0000", 2024-09-13T06:40:07.052 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 10.613559041, 2024-09-13T06:40:07.052 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.040764531, 2024-09-13T06:40:07.052 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:07.052 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:07.052 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:07.052 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:07.052 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:07.052 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 25887 2024-09-13T06:40:07.052 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.052 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:07.052 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.053 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:07.053 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.425137+0000", 2024-09-13T06:40:07.053 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:07.053 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.053 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.053 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:07.053 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.425137+0000", 2024-09-13T06:40:07.053 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:07.053 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.053 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.053 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:07.053 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.425135+0000", 2024-09-13T06:40:07.053 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999986 2024-09-13T06:40:07.054 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.054 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.054 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:07.054 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.425160+0000", 2024-09-13T06:40:07.054 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.4423999999999999e-05 2024-09-13T06:40:07.054 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.054 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.054 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:07.054 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.425186+0000", 2024-09-13T06:40:07.054 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.6329000000000002e-05 2024-09-13T06:40:07.054 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.054 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.054 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:07.055 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.425201+0000", 2024-09-13T06:40:07.055 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5048000000000001e-05 2024-09-13T06:40:07.055 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.055 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.055 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:07.055 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.465483+0000", 2024-09-13T06:40:07.055 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.040281381999999998 2024-09-13T06:40:07.055 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.055 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.055 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:07.055 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.465575+0000", 2024-09-13T06:40:07.055 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.2794000000000006e-05 2024-09-13T06:40:07.055 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.055 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.056 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:07.056 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.465901+0000", 2024-09-13T06:40:07.056 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00032604900000000002 2024-09-13T06:40:07.056 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:07.056 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:07.056 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:07.056 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.056 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.056 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:25888 3.1c 3:3da1e1c6:::rbd_data.1121f2c5ee81.0000000000000007:13 [read 331776~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:07.056 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.425217+0000", 2024-09-13T06:40:07.056 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 10.613479294999999, 2024-09-13T06:40:07.056 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.041115250999999998, 2024-09-13T06:40:07.056 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:07.057 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:07.057 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:07.057 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:07.057 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:07.057 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 25888 2024-09-13T06:40:07.057 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.057 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:07.057 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.057 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:07.057 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.425217+0000", 2024-09-13T06:40:07.057 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:07.057 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.057 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.058 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:07.058 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.425217+0000", 2024-09-13T06:40:07.058 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:07.058 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.058 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.058 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:07.058 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.425215+0000", 2024-09-13T06:40:07.058 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:07.058 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.058 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.058 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:07.058 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.425222+0000", 2024-09-13T06:40:07.058 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.5830000000000003e-06 2024-09-13T06:40:07.059 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.059 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.059 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:07.059 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.425240+0000", 2024-09-13T06:40:07.059 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7914000000000002e-05 2024-09-13T06:40:07.059 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.059 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.059 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:07.059 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.425252+0000", 2024-09-13T06:40:07.059 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2170999999999999e-05 2024-09-13T06:40:07.059 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.059 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.059 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:07.060 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.465947+0000", 2024-09-13T06:40:07.060 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.040694755999999999 2024-09-13T06:40:07.060 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.060 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.060 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:07.060 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.466065+0000", 2024-09-13T06:40:07.060 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000117669 2024-09-13T06:40:07.060 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.060 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.060 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:07.060 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.466332+0000", 2024-09-13T06:40:07.060 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00026730500000000002 2024-09-13T06:40:07.061 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:07.061 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:07.061 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:07.061 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.061 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.061 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:25889 3.1c 3:3da1e1c6:::rbd_data.1121f2c5ee81.0000000000000007:13 [read 376832~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:07.061 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.425262+0000", 2024-09-13T06:40:07.061 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 10.613433383, 2024-09-13T06:40:07.061 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.041487885000000002, 2024-09-13T06:40:07.061 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:07.061 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:07.061 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:07.062 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:07.062 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:07.062 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 25889 2024-09-13T06:40:07.062 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.062 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:07.062 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.062 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:07.062 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.425262+0000", 2024-09-13T06:40:07.062 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:07.062 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.062 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.062 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:07.063 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.425262+0000", 2024-09-13T06:40:07.063 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:07.063 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.063 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.063 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:07.063 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.425262+0000", 2024-09-13T06:40:07.063 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:07.063 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.063 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.063 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:07.063 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.425267+0000", 2024-09-13T06:40:07.063 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.587e-06 2024-09-13T06:40:07.063 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.064 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.064 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:07.064 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.425284+0000", 2024-09-13T06:40:07.064 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6858999999999999e-05 2024-09-13T06:40:07.064 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.064 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.064 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:07.064 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.425295+0000", 2024-09-13T06:40:07.064 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1238e-05 2024-09-13T06:40:07.064 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.064 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.064 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:07.064 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.466371+0000", 2024-09-13T06:40:07.065 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.041075381000000001 2024-09-13T06:40:07.065 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.065 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.065 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:07.065 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.466479+0000", 2024-09-13T06:40:07.065 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000108026 2024-09-13T06:40:07.065 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.065 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.065 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:07.065 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.466750+0000", 2024-09-13T06:40:07.065 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00027173200000000001 2024-09-13T06:40:07.065 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:07.065 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:07.066 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:07.066 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.066 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.066 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:25890 3.1c 3:3da1e1c6:::rbd_data.1121f2c5ee81.0000000000000007:13 [read 401408~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:07.066 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.425305+0000", 2024-09-13T06:40:07.066 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 10.613390851, 2024-09-13T06:40:07.066 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.041642419999999999, 2024-09-13T06:40:07.066 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:07.066 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:07.066 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:07.066 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:07.066 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:07.066 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 25890 2024-09-13T06:40:07.066 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.067 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:07.067 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.067 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:07.067 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.425305+0000", 2024-09-13T06:40:07.067 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:07.067 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.067 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.067 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:07.067 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.425305+0000", 2024-09-13T06:40:07.067 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:07.067 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.067 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.067 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:07.068 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.425304+0000", 2024-09-13T06:40:07.068 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:07.068 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.068 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.068 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:07.068 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.425309+0000", 2024-09-13T06:40:07.068 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.0640000000000001e-06 2024-09-13T06:40:07.068 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.068 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.068 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:07.068 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.425326+0000", 2024-09-13T06:40:07.068 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6855e-05 2024-09-13T06:40:07.068 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.069 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.069 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:07.069 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.425346+0000", 2024-09-13T06:40:07.069 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.0387999999999999e-05 2024-09-13T06:40:07.069 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.069 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.069 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:07.069 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.466796+0000", 2024-09-13T06:40:07.069 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.041449062000000002 2024-09-13T06:40:07.069 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.069 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.069 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:07.069 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.466859+0000", 2024-09-13T06:40:07.070 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.3682000000000005e-05 2024-09-13T06:40:07.070 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.070 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.070 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:07.070 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.466947+0000", 2024-09-13T06:40:07.070 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.8220999999999994e-05 2024-09-13T06:40:07.070 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:07.070 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:07.070 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:07.070 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.070 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.070 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:25891 3.1c 3:3da1e1c6:::rbd_data.1121f2c5ee81.0000000000000007:13 [read 471040~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:07.070 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.425357+0000", 2024-09-13T06:40:07.070 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 10.613338981, 2024-09-13T06:40:07.071 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.042016413000000002, 2024-09-13T06:40:07.071 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:07.071 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:07.071 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:07.071 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:07.071 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:07.071 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 25891 2024-09-13T06:40:07.071 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.071 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:07.071 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.071 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:07.071 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.425357+0000", 2024-09-13T06:40:07.071 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:07.072 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.072 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.072 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:07.072 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.425357+0000", 2024-09-13T06:40:07.072 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:07.072 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.072 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.072 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:07.072 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.425356+0000", 2024-09-13T06:40:07.072 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:07.072 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.072 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.072 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:07.073 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.425361+0000", 2024-09-13T06:40:07.073 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.2340000000000002e-06 2024-09-13T06:40:07.073 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.073 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.073 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:07.073 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.425377+0000", 2024-09-13T06:40:07.073 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6087e-05 2024-09-13T06:40:07.073 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.073 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.073 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:07.073 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.425391+0000", 2024-09-13T06:40:07.073 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3580999999999999e-05 2024-09-13T06:40:07.073 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.074 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.074 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:07.074 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.466995+0000", 2024-09-13T06:40:07.074 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.041604527000000002 2024-09-13T06:40:07.074 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.074 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.074 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:07.074 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.467100+0000", 2024-09-13T06:40:07.074 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00010417299999999999 2024-09-13T06:40:07.074 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.074 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.074 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:07.074 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.467373+0000", 2024-09-13T06:40:07.074 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00027376800000000003 2024-09-13T06:40:07.075 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:07.075 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:07.075 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:07.075 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.075 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.075 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:25892 3.1c 3:3da1e1c6:::rbd_data.1121f2c5ee81.0000000000000007:13 [read 495616~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:07.075 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.425401+0000", 2024-09-13T06:40:07.075 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 10.61329493, 2024-09-13T06:40:07.075 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.042422195000000003, 2024-09-13T06:40:07.075 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:07.075 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:07.075 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:07.076 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:07.076 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:07.076 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 25892 2024-09-13T06:40:07.076 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.076 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:07.076 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.076 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:07.076 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.425401+0000", 2024-09-13T06:40:07.076 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:07.076 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.076 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.076 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:07.076 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.425401+0000", 2024-09-13T06:40:07.077 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:07.077 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.077 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.077 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:07.077 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.425400+0000", 2024-09-13T06:40:07.077 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:07.077 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.077 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.077 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:07.077 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.425405+0000", 2024-09-13T06:40:07.077 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.4389999999999999e-06 2024-09-13T06:40:07.077 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.077 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.077 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:07.078 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.425419+0000", 2024-09-13T06:40:07.078 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3593e-05 2024-09-13T06:40:07.078 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.078 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.078 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:07.078 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.425430+0000", 2024-09-13T06:40:07.078 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0774999999999999e-05 2024-09-13T06:40:07.078 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.078 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.078 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:07.078 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.467438+0000", 2024-09-13T06:40:07.078 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.042008570000000002 2024-09-13T06:40:07.078 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.079 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.079 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:07.079 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.467531+0000", 2024-09-13T06:40:07.079 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.2857999999999998e-05 2024-09-13T06:40:07.079 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.079 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.079 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:07.079 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.467823+0000", 2024-09-13T06:40:07.079 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000291945 2024-09-13T06:40:07.079 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:07.079 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:07.079 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:07.079 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.080 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.080 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:26020 3.c 3:3566b607:::rbd_data.1121f2c5ee81.0000000000000012:13 [read 155648~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:07.080 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.429006+0000", 2024-09-13T06:40:07.080 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 10.609690305000001, 2024-09-13T06:40:07.080 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.040033945000000001, 2024-09-13T06:40:07.080 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:07.080 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:07.080 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:07.080 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:07.080 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:07.080 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 26020 2024-09-13T06:40:07.080 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.080 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:07.080 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.081 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:07.081 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.429006+0000", 2024-09-13T06:40:07.081 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:07.081 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.081 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.081 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:07.081 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.429006+0000", 2024-09-13T06:40:07.081 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:07.081 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.081 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.081 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:07.081 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.429005+0000", 2024-09-13T06:40:07.081 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:07.082 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.082 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.082 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:07.082 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.429010+0000", 2024-09-13T06:40:07.082 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.079e-06 2024-09-13T06:40:07.082 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.082 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.082 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:07.082 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.429023+0000", 2024-09-13T06:40:07.082 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3366e-05 2024-09-13T06:40:07.082 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.082 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.083 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:07.083 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.429033+0000", 2024-09-13T06:40:07.083 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6930000000000002e-06 2024-09-13T06:40:07.083 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.083 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.083 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:07.083 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.468710+0000", 2024-09-13T06:40:07.083 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039676808000000001 2024-09-13T06:40:07.083 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.083 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.083 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:07.083 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.468826+0000", 2024-09-13T06:40:07.083 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000116251 2024-09-13T06:40:07.083 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.084 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.084 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:07.084 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.469040+0000", 2024-09-13T06:40:07.084 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00021363 2024-09-13T06:40:07.084 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:07.084 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:07.084 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:07.084 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.084 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.084 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:26021 3.c 3:3566b607:::rbd_data.1121f2c5ee81.0000000000000012:13 [read 225280~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:07.084 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.429042+0000", 2024-09-13T06:40:07.084 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 10.609653918999999, 2024-09-13T06:40:07.084 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.040384481, 2024-09-13T06:40:07.085 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:07.085 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:07.085 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:07.085 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:07.085 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:07.085 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 26021 2024-09-13T06:40:07.085 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.085 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:07.085 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.085 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:07.085 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.429042+0000", 2024-09-13T06:40:07.085 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:07.085 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.086 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.086 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:07.086 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.429042+0000", 2024-09-13T06:40:07.086 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:07.086 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.086 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.086 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:07.086 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.429041+0000", 2024-09-13T06:40:07.086 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:07.086 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.086 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.086 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:07.086 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.429046+0000", 2024-09-13T06:40:07.087 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.6600000000000003e-06 2024-09-13T06:40:07.087 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.087 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.087 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:07.087 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.429060+0000", 2024-09-13T06:40:07.087 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3747000000000001e-05 2024-09-13T06:40:07.087 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.087 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.087 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:07.087 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.429069+0000", 2024-09-13T06:40:07.087 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.5659999999999996e-06 2024-09-13T06:40:07.087 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.088 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.088 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:07.088 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.469091+0000", 2024-09-13T06:40:07.088 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.040021811999999997 2024-09-13T06:40:07.088 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.088 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.088 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:07.088 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.469170+0000", 2024-09-13T06:40:07.088 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.9498000000000004e-05 2024-09-13T06:40:07.088 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.088 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.088 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:07.088 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.469426+0000", 2024-09-13T06:40:07.089 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00025596800000000003 2024-09-13T06:40:07.089 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:07.089 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:07.089 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:07.089 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.089 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.089 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:26022 3.c 3:3566b607:::rbd_data.1121f2c5ee81.0000000000000012:13 [read 249856~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:07.089 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.429079+0000", 2024-09-13T06:40:07.089 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 10.609617327, 2024-09-13T06:40:07.089 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.040733327, 2024-09-13T06:40:07.089 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:07.089 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:07.089 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:07.090 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:07.090 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:07.090 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 26022 2024-09-13T06:40:07.090 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.090 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:07.090 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.090 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:07.090 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.429079+0000", 2024-09-13T06:40:07.090 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:07.090 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.090 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.090 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:07.090 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.429079+0000", 2024-09-13T06:40:07.090 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:07.091 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.091 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.091 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:07.091 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.429078+0000", 2024-09-13T06:40:07.091 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:07.091 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.091 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.091 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:07.091 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.429083+0000", 2024-09-13T06:40:07.091 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.8069999999999999e-06 2024-09-13T06:40:07.091 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.091 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.091 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:07.092 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.429096+0000", 2024-09-13T06:40:07.092 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3665e-05 2024-09-13T06:40:07.092 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.092 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.092 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:07.092 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.429106+0000", 2024-09-13T06:40:07.092 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.8460000000000003e-06 2024-09-13T06:40:07.092 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.092 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.092 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:07.092 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.469479+0000", 2024-09-13T06:40:07.092 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.04037259 2024-09-13T06:40:07.092 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.093 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.093 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:07.093 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.469564+0000", 2024-09-13T06:40:07.093 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.5669999999999998e-05 2024-09-13T06:40:07.093 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.093 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.093 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:07.093 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.469812+0000", 2024-09-13T06:40:07.093 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00024753699999999998 2024-09-13T06:40:07.093 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:07.093 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:07.093 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:07.093 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.094 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.094 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:26023 3.c 3:3566b607:::rbd_data.1121f2c5ee81.0000000000000012:13 [read 294912~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:07.094 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.429115+0000", 2024-09-13T06:40:07.094 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 10.609580908, 2024-09-13T06:40:07.094 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.041079490000000003, 2024-09-13T06:40:07.094 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:07.094 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:07.094 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:07.094 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:07.094 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:07.094 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 26023 2024-09-13T06:40:07.094 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.094 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:07.094 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.095 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:07.095 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.429115+0000", 2024-09-13T06:40:07.095 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:07.095 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.095 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.095 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:07.095 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.429115+0000", 2024-09-13T06:40:07.095 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:07.095 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.095 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.095 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:07.095 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.429114+0000", 2024-09-13T06:40:07.095 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:07.095 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.096 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.096 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:07.096 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.429119+0000", 2024-09-13T06:40:07.096 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.0189999999999997e-06 2024-09-13T06:40:07.096 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.096 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.096 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:07.096 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.429137+0000", 2024-09-13T06:40:07.096 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.8087000000000001e-05 2024-09-13T06:40:07.096 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.096 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.096 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:07.097 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.429148+0000", 2024-09-13T06:40:07.097 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0740999999999999e-05 2024-09-13T06:40:07.097 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.097 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.097 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:07.097 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.469861+0000", 2024-09-13T06:40:07.097 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.040713271000000002 2024-09-13T06:40:07.097 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.097 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.097 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:07.097 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.469954+0000", 2024-09-13T06:40:07.097 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.2917000000000005e-05 2024-09-13T06:40:07.097 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.098 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.098 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:07.098 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.470194+0000", 2024-09-13T06:40:07.098 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00024033099999999999 2024-09-13T06:40:07.098 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:07.098 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:07.098 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:07.098 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.098 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.098 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:26024 3.c 3:3566b607:::rbd_data.1121f2c5ee81.0000000000000012:13 [read 319488~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:07.098 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.429157+0000", 2024-09-13T06:40:07.098 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 10.609538379, 2024-09-13T06:40:07.098 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.041386232000000002, 2024-09-13T06:40:07.098 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:07.099 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:07.099 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:07.099 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:07.099 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:07.099 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 26024 2024-09-13T06:40:07.099 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.099 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:07.099 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.099 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:07.099 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.429157+0000", 2024-09-13T06:40:07.099 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:07.099 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.099 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.100 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:07.100 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.429157+0000", 2024-09-13T06:40:07.100 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:07.100 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.100 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.100 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:07.100 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.429157+0000", 2024-09-13T06:40:07.100 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:07.100 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.100 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.100 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:07.100 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.429162+0000", 2024-09-13T06:40:07.101 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.3820000000000003e-06 2024-09-13T06:40:07.101 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.101 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.101 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:07.101 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.429175+0000", 2024-09-13T06:40:07.101 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2797e-05 2024-09-13T06:40:07.101 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.101 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.101 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:07.101 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.429185+0000", 2024-09-13T06:40:07.101 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0016e-05 2024-09-13T06:40:07.101 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.101 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.102 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:07.102 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.470233+0000", 2024-09-13T06:40:07.102 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.041047868000000001 2024-09-13T06:40:07.102 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.102 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.102 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:07.102 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.470280+0000", 2024-09-13T06:40:07.102 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.7422000000000001e-05 2024-09-13T06:40:07.102 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.102 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.102 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:07.102 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.470544+0000", 2024-09-13T06:40:07.102 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00026366399999999999 2024-09-13T06:40:07.103 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:07.103 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:07.103 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:07.103 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.103 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.103 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:26025 3.c 3:3566b607:::rbd_data.1121f2c5ee81.0000000000000012:13 [read 389120~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:07.103 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.429194+0000", 2024-09-13T06:40:07.103 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 10.609502018000001, 2024-09-13T06:40:07.103 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.041722952000000001, 2024-09-13T06:40:07.103 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:07.103 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:07.103 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:07.103 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:07.103 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:07.104 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 26025 2024-09-13T06:40:07.104 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.104 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:07.104 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.104 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:07.104 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.429194+0000", 2024-09-13T06:40:07.104 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:07.104 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.104 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.104 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:07.104 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.429194+0000", 2024-09-13T06:40:07.104 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:07.105 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.105 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.105 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:07.105 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.429193+0000", 2024-09-13T06:40:07.105 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:07.105 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.105 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.105 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:07.105 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.429206+0000", 2024-09-13T06:40:07.105 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3008e-05 2024-09-13T06:40:07.105 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.105 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.105 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:07.106 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.429220+0000", 2024-09-13T06:40:07.106 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.4398e-05 2024-09-13T06:40:07.106 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.106 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.106 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:07.106 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.429230+0000", 2024-09-13T06:40:07.106 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.4280000000000002e-06 2024-09-13T06:40:07.106 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.106 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.106 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:07.106 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.470584+0000", 2024-09-13T06:40:07.106 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.041354512000000003 2024-09-13T06:40:07.106 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.107 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.107 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:07.107 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.470648+0000", 2024-09-13T06:40:07.107 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.3163999999999994e-05 2024-09-13T06:40:07.107 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.107 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.107 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:07.107 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.470917+0000", 2024-09-13T06:40:07.107 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00026928199999999997 2024-09-13T06:40:07.107 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:07.107 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:07.107 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:07.107 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.107 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.108 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:26026 3.c 3:3566b607:::rbd_data.1121f2c5ee81.0000000000000012:13 [read 413696~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:07.108 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.429240+0000", 2024-09-13T06:40:07.108 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 10.60945603, 2024-09-13T06:40:07.108 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.041996092999999998, 2024-09-13T06:40:07.108 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:07.108 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:07.108 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:07.108 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:07.108 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:07.108 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 26026 2024-09-13T06:40:07.108 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.108 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:07.108 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.109 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:07.109 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.429240+0000", 2024-09-13T06:40:07.109 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:07.109 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.109 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.109 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:07.109 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.429240+0000", 2024-09-13T06:40:07.109 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:07.109 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.109 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.109 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:07.109 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.429239+0000", 2024-09-13T06:40:07.109 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:07.110 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.110 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.110 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:07.110 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.429244+0000", 2024-09-13T06:40:07.110 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.0989999999999998e-06 2024-09-13T06:40:07.110 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.110 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.110 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:07.110 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.429257+0000", 2024-09-13T06:40:07.110 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.296e-05 2024-09-13T06:40:07.110 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.110 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.110 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:07.110 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.429268+0000", 2024-09-13T06:40:07.111 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0971999999999999e-05 2024-09-13T06:40:07.111 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.111 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.111 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:07.111 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.470962+0000", 2024-09-13T06:40:07.111 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.041694426 2024-09-13T06:40:07.111 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.111 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.111 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:07.111 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.471024+0000", 2024-09-13T06:40:07.111 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.1741000000000004e-05 2024-09-13T06:40:07.111 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.111 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.112 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:07.112 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.471236+0000", 2024-09-13T06:40:07.112 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00021181100000000001 2024-09-13T06:40:07.112 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:07.112 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:07.112 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:07.112 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.112 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.112 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:26146 3.1c 3:3da1e1c6:::rbd_data.1121f2c5ee81.0000000000000007:13 [read 425984~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:07.112 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.434603+0000", 2024-09-13T06:40:07.112 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 10.604092532999999, 2024-09-13T06:40:07.112 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.040125802000000002, 2024-09-13T06:40:07.112 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:07.113 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:07.113 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:07.113 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:07.113 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:07.113 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 26146 2024-09-13T06:40:07.113 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.113 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:07.113 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.113 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:07.113 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.434603+0000", 2024-09-13T06:40:07.113 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:07.113 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.113 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.114 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:07.114 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.434603+0000", 2024-09-13T06:40:07.114 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:07.114 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.114 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.114 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:07.114 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.434602+0000", 2024-09-13T06:40:07.114 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999986 2024-09-13T06:40:07.114 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.114 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.114 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:07.114 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.434609+0000", 2024-09-13T06:40:07.114 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.1380000000000001e-06 2024-09-13T06:40:07.114 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.115 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.115 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:07.115 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.434621+0000", 2024-09-13T06:40:07.115 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2164000000000001e-05 2024-09-13T06:40:07.115 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.115 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.115 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:07.115 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.434629+0000", 2024-09-13T06:40:07.115 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.0669999999999992e-06 2024-09-13T06:40:07.115 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.115 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.115 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:07.115 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.474400+0000", 2024-09-13T06:40:07.116 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039770755999999997 2024-09-13T06:40:07.116 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.116 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.116 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:07.116 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.474483+0000", 2024-09-13T06:40:07.116 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.3238000000000005e-05 2024-09-13T06:40:07.116 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.116 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.116 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:07.116 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.474729+0000", 2024-09-13T06:40:07.116 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00024571499999999997 2024-09-13T06:40:07.116 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:07.116 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:07.116 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:07.117 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.117 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.117 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:26147 3.1c 3:3da1e1c6:::rbd_data.1121f2c5ee81.0000000000000007:13 [read 450560~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:07.117 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.434635+0000", 2024-09-13T06:40:07.117 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 10.604061082999999, 2024-09-13T06:40:07.117 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.040501387, 2024-09-13T06:40:07.117 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:07.117 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:07.117 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:07.117 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:07.117 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:07.117 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 26147 2024-09-13T06:40:07.117 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.118 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:07.118 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.118 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:07.118 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.434635+0000", 2024-09-13T06:40:07.118 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:07.118 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.118 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.118 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:07.118 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.434635+0000", 2024-09-13T06:40:07.118 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:07.118 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.118 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.118 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:07.119 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.434634+0000", 2024-09-13T06:40:07.119 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:07.119 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.119 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.119 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:07.119 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.434637+0000", 2024-09-13T06:40:07.119 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.0180000000000002e-06 2024-09-13T06:40:07.119 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.119 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.119 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:07.119 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.434643+0000", 2024-09-13T06:40:07.119 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.5380000000000002e-06 2024-09-13T06:40:07.119 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.119 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.120 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:07.120 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.434647+0000", 2024-09-13T06:40:07.120 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.5379999999999996e-06 2024-09-13T06:40:07.120 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.120 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.120 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:07.120 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.474784+0000", 2024-09-13T06:40:07.120 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.040136731000000002 2024-09-13T06:40:07.120 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.120 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.120 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:07.120 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.474879+0000", 2024-09-13T06:40:07.120 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.5274999999999998e-05 2024-09-13T06:40:07.121 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.121 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.121 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:07.121 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.475136+0000", 2024-09-13T06:40:07.121 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00025693999999999999 2024-09-13T06:40:07.121 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:07.121 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:07.121 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:07.121 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.121 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.121 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:26148 3.1c 3:3da1e1c6:::rbd_data.1121f2c5ee81.0000000000000007:13 [read 520192~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:07.121 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.434651+0000", 2024-09-13T06:40:07.121 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 10.604044583, 2024-09-13T06:40:07.122 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.040853773000000003, 2024-09-13T06:40:07.122 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:07.122 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:07.122 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:07.122 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:07.122 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:07.122 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 26148 2024-09-13T06:40:07.122 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.122 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:07.122 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.122 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:07.122 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.434651+0000", 2024-09-13T06:40:07.122 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:07.123 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.123 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.123 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:07.123 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.434651+0000", 2024-09-13T06:40:07.123 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:07.123 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.123 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.123 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:07.123 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.434651+0000", 2024-09-13T06:40:07.123 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:07.123 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.123 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.123 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:07.124 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.434653+0000", 2024-09-13T06:40:07.124 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.4509999999999999e-06 2024-09-13T06:40:07.124 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.124 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.124 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:07.124 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.434659+0000", 2024-09-13T06:40:07.124 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.1930000000000001e-06 2024-09-13T06:40:07.124 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.124 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.124 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:07.124 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.434664+0000", 2024-09-13T06:40:07.124 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.7400000000000001e-06 2024-09-13T06:40:07.124 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.125 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.125 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:07.125 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.475194+0000", 2024-09-13T06:40:07.125 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.040530123000000001 2024-09-13T06:40:07.125 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.125 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.125 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:07.125 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.475300+0000", 2024-09-13T06:40:07.125 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000106 2024-09-13T06:40:07.125 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.125 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.125 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:07.125 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.475505+0000", 2024-09-13T06:40:07.126 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00020465199999999999 2024-09-13T06:40:07.126 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:07.126 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:07.126 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:07.126 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.126 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.126 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:28049 3.1d 3:b83606fe:::rbd_data.1121f2c5ee81.000000000000001b:13 [read 475136~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:07.126 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.661622+0000", 2024-09-13T06:40:07.126 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 10.3770737, 2024-09-13T06:40:07.126 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.040354183000000002, 2024-09-13T06:40:07.126 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:07.126 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:07.126 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:07.127 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:07.127 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:07.127 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 28049 2024-09-13T06:40:07.127 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.127 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:07.127 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.127 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:07.127 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.661622+0000", 2024-09-13T06:40:07.127 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:07.127 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.127 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.127 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:07.127 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.661622+0000", 2024-09-13T06:40:07.128 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:07.128 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.128 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.128 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:07.128 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.661621+0000", 2024-09-13T06:40:07.128 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999986 2024-09-13T06:40:07.128 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.128 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.128 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:07.128 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.661627+0000", 2024-09-13T06:40:07.128 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.2450000000000003e-06 2024-09-13T06:40:07.128 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.128 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.128 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:07.129 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.661643+0000", 2024-09-13T06:40:07.129 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5860999999999999e-05 2024-09-13T06:40:07.129 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.129 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.129 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:07.129 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.661656+0000", 2024-09-13T06:40:07.129 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3524e-05 2024-09-13T06:40:07.129 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.129 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.129 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:07.129 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.701307+0000", 2024-09-13T06:40:07.129 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039650336000000001 2024-09-13T06:40:07.130 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.130 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.130 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:07.130 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.701418+0000", 2024-09-13T06:40:07.130 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000111333 2024-09-13T06:40:07.130 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.130 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.130 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:07.130 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.701976+0000", 2024-09-13T06:40:07.130 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000558247 2024-09-13T06:40:07.130 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:07.130 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:07.130 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:07.130 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:07.131 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:07.131 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:40:07.132 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-13T06:40:07.133 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:40:07.134+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:40:07.233 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:40:07.236+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:40:07.257 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:40:07.258 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [], 2024-09-13T06:40:07.258 INFO:teuthology.orchestra.run.smithi139.stdout: "num_ops": 0 2024-09-13T06:40:07.258 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:40:07.272 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-13T06:40:07.356 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-13T06:40:07.360+0000 7f86a5f06640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26387) UID: 0 2024-09-13T06:40:07.435 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:40:07.436+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:40:07.442 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:40:07.442 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [], 2024-09-13T06:40:07.442 INFO:teuthology.orchestra.run.smithi139.stdout: "complaint_time": 30, 2024-09-13T06:40:07.442 INFO:teuthology.orchestra.run.smithi139.stdout: "num_blocked_ops": 0 2024-09-13T06:40:07.442 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:40:07.466 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-13T06:40:07.536 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:40:07.538+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:40:07.581 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-13T06:40:07.631 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:40:07.631 INFO:teuthology.orchestra.run.smithi139.stdout: "size": 20, 2024-09-13T06:40:07.631 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 600, 2024-09-13T06:40:07.631 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [ 2024-09-13T06:40:07.631 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.631 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27854 3.a 3:537b3559:::rbd_data.1121f2c5ee81.0000000000000016:13 [read 335872~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:07.631 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.658750+0000", 2024-09-13T06:40:07.632 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 10.973918424000001, 2024-09-13T06:40:07.632 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.037969532, 2024-09-13T06:40:07.632 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:07.632 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:07.632 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:07.632 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:07.632 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:07.632 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27854 2024-09-13T06:40:07.632 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.632 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:07.632 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.632 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:07.632 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658750+0000", 2024-09-13T06:40:07.633 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:07.633 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.633 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.633 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:07.633 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658750+0000", 2024-09-13T06:40:07.633 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:07.633 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.633 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.633 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:07.633 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658749+0000", 2024-09-13T06:40:07.633 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:07.633 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.634 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.634 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:07.634 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658757+0000", 2024-09-13T06:40:07.634 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.7389999999999999e-06 2024-09-13T06:40:07.634 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.634 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.634 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:07.634 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658763+0000", 2024-09-13T06:40:07.634 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.7769999999999999e-06 2024-09-13T06:40:07.634 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.634 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.634 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:07.634 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658767+0000", 2024-09-13T06:40:07.635 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.1749999999999998e-06 2024-09-13T06:40:07.635 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.635 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.635 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:07.635 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.696322+0000", 2024-09-13T06:40:07.635 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.037554772 2024-09-13T06:40:07.635 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.635 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.635 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:07.635 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.696418+0000", 2024-09-13T06:40:07.635 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6050000000000004e-05 2024-09-13T06:40:07.635 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.635 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.636 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:07.636 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.696719+0000", 2024-09-13T06:40:07.636 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00030138499999999999 2024-09-13T06:40:07.636 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:07.636 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:07.636 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:07.636 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.636 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.636 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27855 3.a 3:537b3559:::rbd_data.1121f2c5ee81.0000000000000016:13 [read 380928~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:07.636 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.658771+0000", 2024-09-13T06:40:07.636 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 10.97389718, 2024-09-13T06:40:07.636 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.038326354, 2024-09-13T06:40:07.636 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:07.637 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:07.637 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:07.637 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:07.637 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:07.637 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27855 2024-09-13T06:40:07.637 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.637 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:07.637 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.637 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:07.637 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658771+0000", 2024-09-13T06:40:07.637 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:07.637 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.638 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.638 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:07.638 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658771+0000", 2024-09-13T06:40:07.638 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:07.638 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.638 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.638 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:07.638 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658770+0000", 2024-09-13T06:40:07.638 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:07.638 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.638 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.638 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:07.638 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658772+0000", 2024-09-13T06:40:07.638 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.0930000000000001e-06 2024-09-13T06:40:07.638 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.639 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.639 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:07.639 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658778+0000", 2024-09-13T06:40:07.639 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.2730000000000002e-06 2024-09-13T06:40:07.639 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.639 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.639 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:07.639 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658782+0000", 2024-09-13T06:40:07.639 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0879999999999997e-06 2024-09-13T06:40:07.639 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.639 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.639 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:07.639 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.696770+0000", 2024-09-13T06:40:07.640 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.037988145000000001 2024-09-13T06:40:07.640 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.640 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.640 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:07.640 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.696852+0000", 2024-09-13T06:40:07.640 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.2039999999999994e-05 2024-09-13T06:40:07.640 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.640 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.640 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:07.640 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.697097+0000", 2024-09-13T06:40:07.640 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00024508800000000002 2024-09-13T06:40:07.640 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:07.640 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:07.640 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:07.641 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.641 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.641 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27856 3.a 3:537b3559:::rbd_data.1121f2c5ee81.0000000000000016:13 [read 405504~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:07.641 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.658786+0000", 2024-09-13T06:40:07.641 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 10.973882064, 2024-09-13T06:40:07.641 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.038736029999999998, 2024-09-13T06:40:07.641 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:07.641 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:07.641 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:07.641 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:07.641 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:07.641 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27856 2024-09-13T06:40:07.641 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.642 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:07.642 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.642 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:07.642 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658786+0000", 2024-09-13T06:40:07.642 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:07.642 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.642 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.642 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:07.642 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658786+0000", 2024-09-13T06:40:07.642 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:07.642 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.642 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.642 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:07.642 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658785+0000", 2024-09-13T06:40:07.643 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:07.643 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.643 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.643 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:07.643 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658787+0000", 2024-09-13T06:40:07.643 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.0040000000000002e-06 2024-09-13T06:40:07.643 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.643 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.643 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:07.643 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658793+0000", 2024-09-13T06:40:07.643 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.2410000000000003e-06 2024-09-13T06:40:07.643 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.643 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.643 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:07.643 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658797+0000", 2024-09-13T06:40:07.644 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.1330000000000001e-06 2024-09-13T06:40:07.644 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.644 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.644 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:07.644 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.697176+0000", 2024-09-13T06:40:07.644 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.038379074999999999 2024-09-13T06:40:07.644 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.644 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.644 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:07.644 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.697275+0000", 2024-09-13T06:40:07.644 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.8819000000000004e-05 2024-09-13T06:40:07.644 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.644 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.645 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:07.645 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.697522+0000", 2024-09-13T06:40:07.645 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00024719999999999999 2024-09-13T06:40:07.645 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:07.645 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:07.645 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:07.645 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.645 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.645 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27857 3.a 3:537b3559:::rbd_data.1121f2c5ee81.0000000000000016:13 [read 475136~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:07.645 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.658845+0000", 2024-09-13T06:40:07.645 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 10.973823061000001, 2024-09-13T06:40:07.645 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039112570999999999, 2024-09-13T06:40:07.645 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:07.645 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:07.646 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:07.646 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:07.646 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:07.646 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27857 2024-09-13T06:40:07.646 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.646 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:07.646 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.646 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:07.646 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658845+0000", 2024-09-13T06:40:07.646 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:07.646 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.646 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.646 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:07.646 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658845+0000", 2024-09-13T06:40:07.646 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:07.647 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.647 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.647 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:07.647 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658844+0000", 2024-09-13T06:40:07.647 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999986 2024-09-13T06:40:07.647 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.647 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.647 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:07.647 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658868+0000", 2024-09-13T06:40:07.647 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.4615000000000001e-05 2024-09-13T06:40:07.647 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.647 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.647 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:07.647 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658884+0000", 2024-09-13T06:40:07.647 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5401999999999999e-05 2024-09-13T06:40:07.647 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.648 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.648 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:07.648 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658896+0000", 2024-09-13T06:40:07.648 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2509e-05 2024-09-13T06:40:07.648 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.648 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.648 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:07.648 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.697571+0000", 2024-09-13T06:40:07.648 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.038675107 2024-09-13T06:40:07.648 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.648 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.648 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:07.648 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.697658+0000", 2024-09-13T06:40:07.648 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6349999999999998e-05 2024-09-13T06:40:07.648 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.649 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.649 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:07.649 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.697957+0000", 2024-09-13T06:40:07.649 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00029986100000000001 2024-09-13T06:40:07.649 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:07.649 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:07.649 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:07.649 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.649 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.649 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27858 3.a 3:537b3559:::rbd_data.1121f2c5ee81.0000000000000016:13 [read 499712~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:07.649 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.658905+0000", 2024-09-13T06:40:07.649 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 10.973762511, 2024-09-13T06:40:07.649 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039475392999999998, 2024-09-13T06:40:07.649 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:07.650 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:07.650 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:07.650 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:07.650 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:07.650 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27858 2024-09-13T06:40:07.650 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.650 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:07.650 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.650 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:07.650 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658905+0000", 2024-09-13T06:40:07.650 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:07.650 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.650 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.650 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:07.650 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658905+0000", 2024-09-13T06:40:07.651 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:07.651 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.651 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.651 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:07.651 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658905+0000", 2024-09-13T06:40:07.651 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:07.651 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.651 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.651 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:07.651 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658909+0000", 2024-09-13T06:40:07.651 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.831e-06 2024-09-13T06:40:07.651 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.651 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.651 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:07.652 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658920+0000", 2024-09-13T06:40:07.652 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0936e-05 2024-09-13T06:40:07.652 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.652 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.652 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:07.652 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658929+0000", 2024-09-13T06:40:07.652 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.2749999999999995e-06 2024-09-13T06:40:07.652 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.652 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.652 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:07.652 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.697990+0000", 2024-09-13T06:40:07.652 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039061625000000003 2024-09-13T06:40:07.652 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.652 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.653 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:07.653 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.698077+0000", 2024-09-13T06:40:07.653 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6922000000000006e-05 2024-09-13T06:40:07.653 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.653 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.653 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:07.653 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.698381+0000", 2024-09-13T06:40:07.653 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00030360599999999999 2024-09-13T06:40:07.653 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:07.653 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:07.653 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:07.653 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.653 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.654 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27929 3.a 3:537b3559:::rbd_data.1121f2c5ee81.0000000000000016:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:07.654 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.659338+0000", 2024-09-13T06:40:07.654 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 10.973329679999999, 2024-09-13T06:40:07.654 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039351214000000002, 2024-09-13T06:40:07.654 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:07.654 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:07.654 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:07.654 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:07.654 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:07.654 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27929 2024-09-13T06:40:07.654 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.654 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:07.654 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.655 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:07.655 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.659338+0000", 2024-09-13T06:40:07.655 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:07.655 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.655 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.655 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:07.655 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.659338+0000", 2024-09-13T06:40:07.655 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:07.655 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.655 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.655 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:07.655 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.659337+0000", 2024-09-13T06:40:07.655 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:07.656 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.656 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.656 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:07.656 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.659342+0000", 2024-09-13T06:40:07.656 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0799999999999999e-06 2024-09-13T06:40:07.656 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.656 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.656 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:07.656 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.659353+0000", 2024-09-13T06:40:07.656 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1798e-05 2024-09-13T06:40:07.656 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.656 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.656 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:07.656 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.659361+0000", 2024-09-13T06:40:07.657 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.8040000000000002e-06 2024-09-13T06:40:07.657 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.657 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.657 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:07.657 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.698449+0000", 2024-09-13T06:40:07.657 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039087519000000001 2024-09-13T06:40:07.657 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.657 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.657 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:07.657 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.698567+0000", 2024-09-13T06:40:07.657 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00011857 2024-09-13T06:40:07.657 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.657 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.658 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:07.658 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.698689+0000", 2024-09-13T06:40:07.658 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00012226699999999999 2024-09-13T06:40:07.658 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:07.658 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:07.658 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:07.658 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.658 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.658 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27974 3.a 3:537b3559:::rbd_data.1121f2c5ee81.0000000000000016:13 [read 32768~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:07.658 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.660102+0000", 2024-09-13T06:40:07.658 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 10.972565912, 2024-09-13T06:40:07.658 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.038972346999999997, 2024-09-13T06:40:07.658 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:07.658 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:07.659 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:07.659 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:07.659 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:07.659 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27974 2024-09-13T06:40:07.659 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.659 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:07.659 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.659 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:07.659 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660102+0000", 2024-09-13T06:40:07.659 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:07.659 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.659 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.659 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:07.660 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660102+0000", 2024-09-13T06:40:07.660 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:07.660 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.660 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.660 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:07.660 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660100+0000", 2024-09-13T06:40:07.660 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999976 2024-09-13T06:40:07.660 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.660 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.660 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:07.660 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660114+0000", 2024-09-13T06:40:07.660 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.4466e-05 2024-09-13T06:40:07.660 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.660 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.661 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:07.661 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660148+0000", 2024-09-13T06:40:07.661 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.3742999999999999e-05 2024-09-13T06:40:07.661 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.661 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.661 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:07.661 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660170+0000", 2024-09-13T06:40:07.661 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.2518e-05 2024-09-13T06:40:07.661 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.661 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.661 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:07.661 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.698719+0000", 2024-09-13T06:40:07.661 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.038548529999999998 2024-09-13T06:40:07.661 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.662 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.662 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:07.662 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.698806+0000", 2024-09-13T06:40:07.662 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.7179e-05 2024-09-13T06:40:07.662 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.662 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.662 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:07.662 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.699074+0000", 2024-09-13T06:40:07.662 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00026834800000000001 2024-09-13T06:40:07.662 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:07.662 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:07.662 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:07.662 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.662 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.663 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27975 3.a 3:537b3559:::rbd_data.1121f2c5ee81.0000000000000016:13 [read 57344~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:07.663 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.660189+0000", 2024-09-13T06:40:07.663 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 10.972479068, 2024-09-13T06:40:07.663 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039288678, 2024-09-13T06:40:07.663 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:07.663 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:07.663 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:07.663 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:07.663 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:07.663 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27975 2024-09-13T06:40:07.663 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.663 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:07.663 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.663 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:07.664 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660189+0000", 2024-09-13T06:40:07.664 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:07.664 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.664 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.664 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:07.664 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660189+0000", 2024-09-13T06:40:07.664 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:07.664 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.664 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.664 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:07.664 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660187+0000", 2024-09-13T06:40:07.664 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999981 2024-09-13T06:40:07.664 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.664 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.664 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:07.665 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660195+0000", 2024-09-13T06:40:07.665 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5610000000000001e-06 2024-09-13T06:40:07.665 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.665 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.665 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:07.665 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660212+0000", 2024-09-13T06:40:07.665 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7725999999999999e-05 2024-09-13T06:40:07.665 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.665 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.665 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:07.665 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660227+0000", 2024-09-13T06:40:07.665 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.43e-05 2024-09-13T06:40:07.665 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.666 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.666 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:07.666 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.699135+0000", 2024-09-13T06:40:07.666 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.038908336000000002 2024-09-13T06:40:07.666 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.666 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.666 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:07.666 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.699208+0000", 2024-09-13T06:40:07.666 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.3065000000000006e-05 2024-09-13T06:40:07.666 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.666 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.666 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:07.667 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.699478+0000", 2024-09-13T06:40:07.667 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00026946899999999999 2024-09-13T06:40:07.667 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:07.667 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:07.667 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:07.667 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.667 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.667 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27976 3.a 3:537b3559:::rbd_data.1121f2c5ee81.0000000000000016:13 [read 102400~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:07.667 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.660238+0000", 2024-09-13T06:40:07.667 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 10.972429905, 2024-09-13T06:40:07.667 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039636515999999997, 2024-09-13T06:40:07.667 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:07.667 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:07.667 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:07.667 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:07.667 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:07.668 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27976 2024-09-13T06:40:07.668 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.668 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:07.668 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.668 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:07.668 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660238+0000", 2024-09-13T06:40:07.668 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:07.668 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.668 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.668 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:07.668 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660238+0000", 2024-09-13T06:40:07.668 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:07.668 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.668 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.669 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:07.669 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660237+0000", 2024-09-13T06:40:07.669 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:07.669 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.669 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.669 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:07.669 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660243+0000", 2024-09-13T06:40:07.669 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.9909999999999999e-06 2024-09-13T06:40:07.669 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.669 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.669 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:07.669 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660259+0000", 2024-09-13T06:40:07.669 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6294e-05 2024-09-13T06:40:07.669 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.669 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.670 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:07.670 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660272+0000", 2024-09-13T06:40:07.670 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2714999999999999e-05 2024-09-13T06:40:07.670 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.670 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.670 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:07.670 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.699513+0000", 2024-09-13T06:40:07.670 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039240932999999999 2024-09-13T06:40:07.670 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.670 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.670 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:07.670 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.699604+0000", 2024-09-13T06:40:07.670 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.1367999999999997e-05 2024-09-13T06:40:07.671 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.671 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.671 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:07.671 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.699875+0000", 2024-09-13T06:40:07.671 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00027029499999999999 2024-09-13T06:40:07.671 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:07.671 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:07.671 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:07.671 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.671 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.671 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27977 3.a 3:537b3559:::rbd_data.1121f2c5ee81.0000000000000016:13 [read 126976~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:07.671 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.660284+0000", 2024-09-13T06:40:07.671 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 10.972384333000001, 2024-09-13T06:40:07.671 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039969945, 2024-09-13T06:40:07.672 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:07.672 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:07.672 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:07.672 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:07.672 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:07.672 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27977 2024-09-13T06:40:07.672 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.672 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:07.672 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.672 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:07.672 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660284+0000", 2024-09-13T06:40:07.672 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:07.672 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.672 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.673 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:07.673 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660284+0000", 2024-09-13T06:40:07.673 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:07.673 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.673 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.673 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:07.673 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660282+0000", 2024-09-13T06:40:07.673 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999986 2024-09-13T06:40:07.673 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.673 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.673 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:07.673 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660288+0000", 2024-09-13T06:40:07.674 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.2650000000000002e-06 2024-09-13T06:40:07.674 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.674 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.674 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:07.674 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660304+0000", 2024-09-13T06:40:07.674 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5430999999999998e-05 2024-09-13T06:40:07.674 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.674 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.674 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:07.674 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660316+0000", 2024-09-13T06:40:07.674 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.237e-05 2024-09-13T06:40:07.674 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.674 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.675 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:07.675 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.699907+0000", 2024-09-13T06:40:07.675 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039590735000000002 2024-09-13T06:40:07.675 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.675 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.675 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:07.675 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.699994+0000", 2024-09-13T06:40:07.675 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6996999999999994e-05 2024-09-13T06:40:07.675 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.675 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.675 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:07.675 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700254+0000", 2024-09-13T06:40:07.675 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000259564 2024-09-13T06:40:07.675 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:07.675 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:07.676 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:07.676 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.676 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.676 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27978 3.a 3.9aacdeca (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:07.676 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.660327+0000", 2024-09-13T06:40:07.676 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 10.972340735, 2024-09-13T06:40:07.676 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039984858999999998, 2024-09-13T06:40:07.676 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:07.676 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:40:07.676 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:07.676 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:07.676 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:07.676 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27978 2024-09-13T06:40:07.677 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.677 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:07.677 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.677 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:07.677 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660327+0000", 2024-09-13T06:40:07.677 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:07.677 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.677 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.677 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:07.677 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660327+0000", 2024-09-13T06:40:07.677 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:07.677 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.677 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.677 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:07.678 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660326+0000", 2024-09-13T06:40:07.678 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:07.678 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.678 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.678 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:07.678 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660366+0000", 2024-09-13T06:40:07.678 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.9691000000000003e-05 2024-09-13T06:40:07.678 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.678 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.678 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:07.678 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660399+0000", 2024-09-13T06:40:07.678 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.3262000000000001e-05 2024-09-13T06:40:07.678 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.678 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.678 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:07.679 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660414+0000", 2024-09-13T06:40:07.679 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.4775e-05 2024-09-13T06:40:07.679 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.679 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.679 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:07.679 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700298+0000", 2024-09-13T06:40:07.679 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039883759999999997 2024-09-13T06:40:07.679 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.679 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.679 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:07.679 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700312+0000", 2024-09-13T06:40:07.679 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.4374e-05 2024-09-13T06:40:07.679 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:07.680 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:07.680 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:07.680 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.680 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.680 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27979 3.a 3.9aacdeca (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:07.680 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.660429+0000", 2024-09-13T06:40:07.680 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 10.972238867, 2024-09-13T06:40:07.680 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039921361000000002, 2024-09-13T06:40:07.680 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:07.680 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:40:07.680 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:07.680 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:07.680 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:07.681 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27979 2024-09-13T06:40:07.681 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.681 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:07.681 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.681 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:07.681 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660429+0000", 2024-09-13T06:40:07.681 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:07.681 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.681 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.681 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:07.681 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660429+0000", 2024-09-13T06:40:07.681 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:07.681 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.682 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.682 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:07.682 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660428+0000", 2024-09-13T06:40:07.682 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999986 2024-09-13T06:40:07.682 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.682 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.682 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:07.682 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660434+0000", 2024-09-13T06:40:07.682 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.8190000000000003e-06 2024-09-13T06:40:07.682 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.682 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.682 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:07.682 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660451+0000", 2024-09-13T06:40:07.683 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6963e-05 2024-09-13T06:40:07.683 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.683 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.683 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:07.683 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660485+0000", 2024-09-13T06:40:07.683 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.3414000000000002e-05 2024-09-13T06:40:07.683 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.683 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.683 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:07.683 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700342+0000", 2024-09-13T06:40:07.683 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039857278000000003 2024-09-13T06:40:07.683 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.683 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.683 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:07.684 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700350+0000", 2024-09-13T06:40:07.684 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.2930000000000001e-06 2024-09-13T06:40:07.684 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:07.684 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:07.684 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:07.684 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.684 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.684 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27980 3.a 3.9aacdeca (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:07.684 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.660497+0000", 2024-09-13T06:40:07.684 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 10.972170655999999, 2024-09-13T06:40:07.684 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039888034000000003, 2024-09-13T06:40:07.684 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:07.684 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:40:07.685 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:07.685 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:07.685 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:07.685 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27980 2024-09-13T06:40:07.685 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.685 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:07.685 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.685 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:07.685 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660497+0000", 2024-09-13T06:40:07.685 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:07.685 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.685 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.685 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:07.685 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660497+0000", 2024-09-13T06:40:07.685 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:07.686 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.686 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.686 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:07.686 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660496+0000", 2024-09-13T06:40:07.686 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:07.686 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.686 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.686 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:07.686 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660503+0000", 2024-09-13T06:40:07.686 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.4110000000000001e-06 2024-09-13T06:40:07.686 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.686 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.686 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:07.687 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660519+0000", 2024-09-13T06:40:07.687 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6180000000000001e-05 2024-09-13T06:40:07.687 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.687 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.687 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:07.687 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660544+0000", 2024-09-13T06:40:07.687 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.5177999999999998e-05 2024-09-13T06:40:07.687 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.687 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.687 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:07.687 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700377+0000", 2024-09-13T06:40:07.687 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039833434000000001 2024-09-13T06:40:07.687 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.687 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.687 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:07.688 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700385+0000", 2024-09-13T06:40:07.688 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.8800000000000008e-06 2024-09-13T06:40:07.688 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:07.688 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:07.688 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:07.688 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.688 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.688 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27981 3.a 3.9aacdeca (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:07.688 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.660556+0000", 2024-09-13T06:40:07.688 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 10.97211231, 2024-09-13T06:40:07.688 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039869989000000002, 2024-09-13T06:40:07.688 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:07.689 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:40:07.689 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:07.689 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:07.689 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:07.689 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27981 2024-09-13T06:40:07.689 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.689 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:07.689 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.689 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:07.689 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660556+0000", 2024-09-13T06:40:07.689 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:07.689 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.689 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.690 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:07.690 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660556+0000", 2024-09-13T06:40:07.690 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:07.690 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.690 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.690 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:07.690 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660555+0000", 2024-09-13T06:40:07.690 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:07.690 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.690 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.690 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:07.690 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660561+0000", 2024-09-13T06:40:07.690 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.088e-06 2024-09-13T06:40:07.691 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.691 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.691 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:07.691 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660577+0000", 2024-09-13T06:40:07.691 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6147999999999999e-05 2024-09-13T06:40:07.691 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.691 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.691 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:07.691 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660589+0000", 2024-09-13T06:40:07.691 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2551999999999999e-05 2024-09-13T06:40:07.691 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.691 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.691 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:07.692 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700414+0000", 2024-09-13T06:40:07.692 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039825007000000003 2024-09-13T06:40:07.692 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.692 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.692 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:07.692 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700426+0000", 2024-09-13T06:40:07.692 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1265e-05 2024-09-13T06:40:07.692 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:07.692 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:07.692 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:07.692 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.692 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.692 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27982 3.a 3.9aacdeca (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:07.693 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.660603+0000", 2024-09-13T06:40:07.693 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 10.972064715, 2024-09-13T06:40:07.693 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039874779999999999, 2024-09-13T06:40:07.693 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:07.693 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:40:07.693 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:07.693 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:07.693 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:07.693 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27982 2024-09-13T06:40:07.693 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.693 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:07.693 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.694 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:07.694 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660603+0000", 2024-09-13T06:40:07.694 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:07.694 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.694 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.694 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:07.694 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660603+0000", 2024-09-13T06:40:07.694 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:07.694 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.694 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.694 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:07.694 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660602+0000", 2024-09-13T06:40:07.694 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:07.694 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.695 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.695 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:07.695 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660653+0000", 2024-09-13T06:40:07.695 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.0862000000000002e-05 2024-09-13T06:40:07.695 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.695 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.695 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:07.695 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660697+0000", 2024-09-13T06:40:07.695 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.3773000000000003e-05 2024-09-13T06:40:07.695 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.695 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.695 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:07.695 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660712+0000", 2024-09-13T06:40:07.695 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5464999999999998e-05 2024-09-13T06:40:07.696 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.696 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.696 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:07.696 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700469+0000", 2024-09-13T06:40:07.696 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039756503999999998 2024-09-13T06:40:07.696 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.696 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.696 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:07.696 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700478+0000", 2024-09-13T06:40:07.696 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.1730000000000001e-06 2024-09-13T06:40:07.696 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:07.696 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:07.696 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:07.697 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.697 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.697 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27983 3.a 3.9aacdeca (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:07.697 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.660726+0000", 2024-09-13T06:40:07.697 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 10.97194144, 2024-09-13T06:40:07.697 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039804357999999998, 2024-09-13T06:40:07.697 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:07.697 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:40:07.697 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:07.697 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:07.697 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:07.697 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27983 2024-09-13T06:40:07.697 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.697 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:07.698 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.698 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:07.698 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660726+0000", 2024-09-13T06:40:07.698 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:07.698 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.698 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.698 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:07.698 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660726+0000", 2024-09-13T06:40:07.698 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:07.698 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.698 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.698 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:07.698 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660725+0000", 2024-09-13T06:40:07.698 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999986 2024-09-13T06:40:07.699 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.699 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.699 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:07.699 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660733+0000", 2024-09-13T06:40:07.699 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.9359999999999999e-06 2024-09-13T06:40:07.699 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.699 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.699 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:07.699 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660751+0000", 2024-09-13T06:40:07.699 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7679000000000001e-05 2024-09-13T06:40:07.699 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.699 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.699 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:07.700 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660764+0000", 2024-09-13T06:40:07.700 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3112000000000001e-05 2024-09-13T06:40:07.700 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.700 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.700 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:07.700 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700516+0000", 2024-09-13T06:40:07.700 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039752183000000003 2024-09-13T06:40:07.700 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.700 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.700 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:07.700 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700531+0000", 2024-09-13T06:40:07.700 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.4732999999999999e-05 2024-09-13T06:40:07.700 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:07.701 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:07.701 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:07.701 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.701 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.701 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27984 3.a 3.9aacdeca (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:07.701 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.660776+0000", 2024-09-13T06:40:07.701 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 10.971892337, 2024-09-13T06:40:07.701 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039795697999999997, 2024-09-13T06:40:07.701 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:07.701 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:40:07.701 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:07.701 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:07.701 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:07.702 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27984 2024-09-13T06:40:07.702 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.702 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:07.702 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.702 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:07.702 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660776+0000", 2024-09-13T06:40:07.702 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:07.702 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.702 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.702 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:07.702 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660776+0000", 2024-09-13T06:40:07.702 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:07.702 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.702 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.703 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:07.703 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660775+0000", 2024-09-13T06:40:07.703 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:07.703 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.703 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.703 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:07.703 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660780+0000", 2024-09-13T06:40:07.703 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.7849999999999997e-06 2024-09-13T06:40:07.703 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.703 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.703 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:07.703 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660799+0000", 2024-09-13T06:40:07.703 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.8794e-05 2024-09-13T06:40:07.703 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.703 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.704 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:07.704 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660812+0000", 2024-09-13T06:40:07.704 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3029e-05 2024-09-13T06:40:07.704 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.704 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.704 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:07.704 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700562+0000", 2024-09-13T06:40:07.704 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039749984000000002 2024-09-13T06:40:07.704 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.704 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.704 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:07.704 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700571+0000", 2024-09-13T06:40:07.704 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.1260000000000004e-06 2024-09-13T06:40:07.705 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:07.705 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:07.705 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:07.705 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.705 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.705 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27985 3.a 3.9aacdeca (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:07.705 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.660824+0000", 2024-09-13T06:40:07.705 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 10.971844285, 2024-09-13T06:40:07.705 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039784462, 2024-09-13T06:40:07.705 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:07.705 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:40:07.705 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:07.705 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:07.706 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:07.706 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27985 2024-09-13T06:40:07.706 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.706 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:07.706 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.706 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:07.706 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660824+0000", 2024-09-13T06:40:07.706 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:07.706 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.706 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.706 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:07.706 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660824+0000", 2024-09-13T06:40:07.706 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:07.706 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.706 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.707 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:07.707 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660823+0000", 2024-09-13T06:40:07.707 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:07.707 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.707 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.707 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:07.707 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660829+0000", 2024-09-13T06:40:07.707 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.9440000000000002e-06 2024-09-13T06:40:07.707 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.707 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.707 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:07.707 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660922+0000", 2024-09-13T06:40:07.707 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.2958e-05 2024-09-13T06:40:07.707 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.707 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.708 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:07.708 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660964+0000", 2024-09-13T06:40:07.708 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.2407000000000002e-05 2024-09-13T06:40:07.708 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.708 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.708 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:07.708 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700600+0000", 2024-09-13T06:40:07.708 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039635581000000003 2024-09-13T06:40:07.708 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.708 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.708 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:07.708 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700608+0000", 2024-09-13T06:40:07.708 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.5890000000000003e-06 2024-09-13T06:40:07.709 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:07.709 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:07.709 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:07.709 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.709 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.709 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:28023 3.10 3:0dedc28a:::rbd_data.1121f2c5ee81.0000000000000019:13 [read 475136~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:07.709 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.662072+0000", 2024-09-13T06:40:07.709 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 10.9705963, 2024-09-13T06:40:07.709 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.038086508999999998, 2024-09-13T06:40:07.709 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:07.709 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:07.709 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:07.709 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:07.710 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:07.710 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 28023 2024-09-13T06:40:07.710 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.710 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:07.710 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.710 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:07.710 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.662072+0000", 2024-09-13T06:40:07.710 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:07.710 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.710 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.710 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:07.710 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.662072+0000", 2024-09-13T06:40:07.710 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:07.711 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.711 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.711 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:07.711 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.662070+0000", 2024-09-13T06:40:07.711 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999986 2024-09-13T06:40:07.711 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.711 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.711 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:07.711 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.662076+0000", 2024-09-13T06:40:07.711 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.139e-06 2024-09-13T06:40:07.711 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.711 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.711 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:07.711 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.662094+0000", 2024-09-13T06:40:07.712 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7136999999999999e-05 2024-09-13T06:40:07.712 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.712 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.712 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:07.712 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.662124+0000", 2024-09-13T06:40:07.712 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.0528999999999999e-05 2024-09-13T06:40:07.712 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.712 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.712 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:07.712 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.699843+0000", 2024-09-13T06:40:07.712 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.037718415999999998 2024-09-13T06:40:07.712 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.712 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.713 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:07.713 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.699931+0000", 2024-09-13T06:40:07.713 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.8345999999999997e-05 2024-09-13T06:40:07.713 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.713 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.713 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:07.713 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700158+0000", 2024-09-13T06:40:07.713 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00022723099999999999 2024-09-13T06:40:07.713 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:07.713 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:07.713 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:07.713 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.713 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.713 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:28024 3.10 3.5143b7b0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:07.714 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.662137+0000", 2024-09-13T06:40:07.714 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 10.970530778000001, 2024-09-13T06:40:07.714 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.038056092999999999, 2024-09-13T06:40:07.714 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:07.714 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:40:07.714 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:07.714 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:07.714 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:07.714 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 28024 2024-09-13T06:40:07.714 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.714 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:07.714 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.714 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:07.715 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.662137+0000", 2024-09-13T06:40:07.715 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:07.715 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.715 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.715 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:07.715 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.662137+0000", 2024-09-13T06:40:07.715 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:07.715 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.715 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.715 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:07.715 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.662136+0000", 2024-09-13T06:40:07.715 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999986 2024-09-13T06:40:07.715 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.715 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.716 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:07.716 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.662142+0000", 2024-09-13T06:40:07.716 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.6930000000000001e-06 2024-09-13T06:40:07.716 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.716 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.716 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:07.716 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.662160+0000", 2024-09-13T06:40:07.716 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7863000000000002e-05 2024-09-13T06:40:07.716 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.716 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.716 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:07.716 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.662189+0000", 2024-09-13T06:40:07.716 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.8486000000000001e-05 2024-09-13T06:40:07.717 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.717 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.717 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:07.717 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700187+0000", 2024-09-13T06:40:07.717 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.037998331000000003 2024-09-13T06:40:07.717 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:07.717 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:07.717 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:07.717 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700193+0000", 2024-09-13T06:40:07.717 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.0909999999999998e-06 2024-09-13T06:40:07.717 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:07.717 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:07.717 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:07.718 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:07.718 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:07.718 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:40:07.718 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-13T06:40:07.720 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-13T06:40:07.720 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-13T06:40:07.720+0000 7f86a5f06640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26387) UID: 0 2024-09-13T06:40:07.734 INFO:teuthology.orchestra.run.smithi081.stdout:osd.0: {} 2024-09-13T06:40:07.734 INFO:teuthology.orchestra.run.smithi081.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-13T06:40:07.752 INFO:teuthology.orchestra.run.smithi081.stdout:osd.1: {} 2024-09-13T06:40:07.752 INFO:teuthology.orchestra.run.smithi081.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-13T06:40:07.768 INFO:teuthology.orchestra.run.smithi081.stdout:osd.2: {} 2024-09-13T06:40:07.769 INFO:teuthology.orchestra.run.smithi081.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-13T06:40:07.786 INFO:teuthology.orchestra.run.smithi081.stdout:osd.3: {} 2024-09-13T06:40:07.786 INFO:teuthology.orchestra.run.smithi081.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-13T06:40:07.805 INFO:teuthology.orchestra.run.smithi081.stdout:osd.4: {} 2024-09-13T06:40:07.806 INFO:teuthology.orchestra.run.smithi081.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-13T06:40:07.821 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-13T06:40:07.824+0000 7f86a5f06640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26387) UID: 0 2024-09-13T06:40:07.822 INFO:teuthology.orchestra.run.smithi081.stdout:osd.5: {} 2024-09-13T06:40:07.823 INFO:teuthology.orchestra.run.smithi081.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-13T06:40:07.840 INFO:teuthology.orchestra.run.smithi081.stdout:osd.6: {} 2024-09-13T06:40:07.841 INFO:teuthology.orchestra.run.smithi081.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-13T06:40:07.864 INFO:teuthology.orchestra.run.smithi081.stdout:osd.7: {} 2024-09-13T06:40:07.865 INFO:teuthology.orchestra.run.smithi081.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-13T06:40:07.893 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:40:07.893 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:40:07.907 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-13T06:40:07.949 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-13T06:40:07.952+0000 7f86a5f06640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26387) UID: 0 2024-09-13T06:40:08.023 INFO:tasks.ceph.osd.6.smithi139.stderr:2024-09-13T06:40:08.024+0000 7fcd02c5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26385) UID: 0 2024-09-13T06:40:08.069 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:40:08.069 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:40:08.083 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-13T06:40:08.123 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:40:08.126+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:40:08.224 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-13T06:40:08.224+0000 7f86a5f06640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26387) UID: 0 2024-09-13T06:40:08.247 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:40:08.247 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:40:08.261 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-13T06:40:08.325 INFO:tasks.ceph.osd.6.smithi139.stderr:2024-09-13T06:40:08.328+0000 7fcd02c5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26385) UID: 0 2024-09-13T06:40:08.369 INFO:teuthology.orchestra.run.smithi081.stderr:noscrub is unset 2024-09-13T06:40:08.401 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:40:08.401 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:40:08.417 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-13T06:40:08.464 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:40:08.466+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:40:08.489 INFO:teuthology.orchestra.run.smithi081.stdout:checking clone #6, image image_client.0-clone6 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent7 2024-09-13T06:40:08.527 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:40:08.526+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:40:08.591 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:40:08.591 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:40:08.604 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-13T06:40:08.648 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:40:08.650+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:40:08.729 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:40:08.732+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:40:08.767 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:40:08.767 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:40:08.781 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-13T06:40:08.831 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:40:08.832+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:40:08.903 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:40:08.904 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:40:08.918 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-13T06:40:08.931 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:40:08.932+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:40:09.032 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:40:09.034+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:40:09.035 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:40:09.035 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:40:09.049 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-13T06:40:09.136 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:40:09.138+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:40:09.214 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:40:09.214 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:40:09.229 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-13T06:40:09.233 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:40:09.236+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:40:09.334 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:40:09.336+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:40:09.398 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:40:09.398 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:40:09.414 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-13T06:40:09.460 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:40:09.462+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:40:09.533 INFO:teuthology.orchestra.run.smithi081.stdout:1133 punch from 0x1ceb12f to 0x1cf8b0d, (0xd9de bytes) 2024-09-13T06:40:09.536 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:40:09.538+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:40:09.538 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:40:09.538 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:40:09.544 INFO:teuthology.orchestra.run.smithi081.stdout:1134 punch from 0x594bee3 to 0x5957417, (0xb534 bytes) 2024-09-13T06:40:09.544 INFO:teuthology.orchestra.run.smithi081.stdout:1135 punch from 0x4f0f4dd to 0x4f0f510, (0x33 bytes) 2024-09-13T06:40:09.544 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:40:09.544 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:40:09.544 INFO:teuthology.orchestra.run.smithi081.stdout:1141 punch from 0x1d75de4 to 0x1d84062, (0xe27e bytes) 2024-09-13T06:40:09.557 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-13T06:40:09.567 INFO:teuthology.orchestra.run.smithi081.stdout:1142 writesame 0xc178b24 thru 0xc18099d data_size 0x1(0x7e7a bytes) 2024-09-13T06:40:09.567 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:40:09.567 INFO:teuthology.orchestra.run.smithi081.stdout:1145 writesame 0x5d4d43b thru 0x5d545b3 data_size 0x17(0x7179 bytes) 2024-09-13T06:40:09.582 INFO:teuthology.orchestra.run.smithi081.stdout:1147 trunc from 0xc18099e to 0x49cb0e1 2024-09-13T06:40:09.608 INFO:teuthology.orchestra.run.smithi081.stdout:1148 write 0x4c9d8e7 thru 0x4ca6acc (0x91e6 bytes) 2024-09-13T06:40:09.634 INFO:teuthology.orchestra.run.smithi081.stdout:1149 writesame 0xc2d8c93 thru 0xc2dc399 data_size 0x1(0x3707 bytes) 2024-09-13T06:40:09.634 INFO:teuthology.orchestra.run.smithi081.stdout:1150 write 0x8caf1a3 thru 0x8cb976e (0xa5cc bytes) 2024-09-13T06:40:09.637 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:40:09.640+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:40:09.638 INFO:teuthology.orchestra.run.smithi081.stdout:1151 write 0x3c74f24 thru 0x3c77829 (0x2906 bytes) 2024-09-13T06:40:09.645 INFO:teuthology.orchestra.run.smithi081.stdout:1152 trunc from 0xc2dc39a to 0x96b1750 2024-09-13T06:40:09.661 INFO:teuthology.orchestra.run.smithi081.stdout:1153 trunc from 0x96b1750 to 0x96c6f08 2024-09-13T06:40:09.669 INFO:teuthology.orchestra.run.smithi081.stdout:1154 writesame 0x5a2bf19 thru 0x5a38558 data_size 0x20(0xc640 bytes) 2024-09-13T06:40:09.673 INFO:teuthology.orchestra.run.smithi081.stdout:1155 write 0x8d1a34b thru 0x8d27421 (0xd0d7 bytes) 2024-09-13T06:40:09.680 INFO:teuthology.orchestra.run.smithi081.stdout:1158 writesame 0x9059239 thru 0x9062a30 data_size 0xc(0x97f8 bytes) 2024-09-13T06:40:09.687 INFO:teuthology.orchestra.run.smithi081.stdout:1159 writesame 0x7328d15 thru 0x73385d3 data_size 0xb(0xf8bf bytes) 2024-09-13T06:40:09.699 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:40:09.699 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:40:09.716 INFO:teuthology.orchestra.run.smithi081.stdout:1160 writesame 0xc0038fc thru 0xc009a08 data_size 0x1(0x610d bytes) 2024-09-13T06:40:09.716 INFO:teuthology.orchestra.run.smithi081.stdout:1161 read 0x9fb7310 thru 0x9fc4762 (0xd453 bytes) 2024-09-13T06:40:09.717 INFO:teuthology.orchestra.run.smithi081.stdout:1162 write 0x2a331f9 thru 0x2a39d1a (0x6b22 bytes) 2024-09-13T06:40:09.718 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-13T06:40:09.720 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:40:09.721 INFO:teuthology.orchestra.run.smithi081.stdout:1164 punch from 0xb249e9d to 0xb24effd, (0x5160 bytes) 2024-09-13T06:40:09.721 INFO:teuthology.orchestra.run.smithi081.stdout:1165 write 0xb8838b7 thru 0xb8876e1 (0x3e2b bytes) 2024-09-13T06:40:09.726 INFO:teuthology.orchestra.run.smithi081.stdout:1166 write 0x4c68625 thru 0x4c707c7 (0x81a3 bytes) 2024-09-13T06:40:09.728 INFO:teuthology.orchestra.run.smithi081.stdout:1167 write 0x62de0b7 thru 0x62e0b09 (0x2a53 bytes) 2024-09-13T06:40:09.730 INFO:teuthology.orchestra.run.smithi081.stdout:1168 read 0x726338b thru 0x7266e67 (0x3add bytes) 2024-09-13T06:40:09.735 INFO:teuthology.orchestra.run.smithi081.stdout:1169 trunc from 0xc009a09 to 0xe9f61f8 2024-09-13T06:40:09.737 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:40:09.738+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:40:09.745 INFO:teuthology.orchestra.run.smithi081.stdout:1171 read 0x96fdb2f thru 0x970c6b0 (0xeb82 bytes) 2024-09-13T06:40:09.746 INFO:teuthology.orchestra.run.smithi081.stdout:1172 write 0x16dc13d thru 0x16e2d87 (0x6c4b bytes) 2024-09-13T06:40:09.749 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:40:09.749 INFO:teuthology.orchestra.run.smithi081.stdout:1174 punch from 0x8b6d6cc to 0x8b7a900, (0xd234 bytes) 2024-09-13T06:40:09.749 INFO:teuthology.orchestra.run.smithi081.stdout:1175 writesame 0xe07a8bd thru 0xe0822f1 data_size 0x1(0x7a35 bytes) 2024-09-13T06:40:09.769 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:40:09.794 INFO:teuthology.orchestra.run.smithi081.stdout:1178 trunc from 0xe9f61f8 to 0x1a434ef 2024-09-13T06:40:09.829 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:40:09.839 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-13T06:40:09.840+0000 7f86a5f06640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26387) UID: 0 2024-09-13T06:40:09.855 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:40:09.855 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:40:09.858 INFO:teuthology.orchestra.run.smithi081.stdout:1182 write 0xb396c4c thru 0xb3a55bf (0xe974 bytes) 2024-09-13T06:40:09.867 INFO:teuthology.orchestra.run.smithi081.stdout:1183 write 0x5ea921f thru 0x5eb4e41 (0xbc23 bytes) 2024-09-13T06:40:09.872 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-13T06:40:09.873 INFO:teuthology.orchestra.run.smithi081.stdout:1184 read 0x152206c thru 0x1524d59 (0x2cee bytes) 2024-09-13T06:40:09.873 INFO:teuthology.orchestra.run.smithi081.stdout:1185 read 0x7a2f3ce thru 0x7a3d925 (0xe558 bytes) 2024-09-13T06:40:09.874 INFO:teuthology.orchestra.run.smithi081.stdout:1186 writesame 0x806f933 thru 0x807d103 data_size 0x1(0xd7d1 bytes) 2024-09-13T06:40:09.882 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-13T06:40:09.913 INFO:teuthology.orchestra.run.smithi081.stdout:1187 read 0x6a09971 thru 0x6a105a7 (0x6c37 bytes) 2024-09-13T06:40:09.914 INFO:teuthology.orchestra.run.smithi081.stdout:1188 read 0xa5514be thru 0xa55c25c (0xad9f bytes) 2024-09-13T06:40:09.914 INFO:teuthology.orchestra.run.smithi081.stdout:1189 punch from 0x2837a89 to 0x2847634, (0xfbab bytes) 2024-09-13T06:40:09.929 INFO:teuthology.orchestra.run.smithi081.stdout:1191 write 0xdc39992 thru 0xdc4806f (0xe6de bytes) 2024-09-13T06:40:09.936 INFO:teuthology.orchestra.run.smithi081.stdout:1192 write 0x2ebcd6 thru 0x2f168a (0x59b5 bytes) 2024-09-13T06:40:09.939 INFO:teuthology.orchestra.run.smithi081.stdout:1193 write 0xdc04202 thru 0xdc0d5e0 (0x93df bytes) 2024-09-13T06:40:09.939 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:40:09.938+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:40:09.942 INFO:teuthology.orchestra.run.smithi081.stdout:1195 write 0x1a9e739 thru 0x1aabb20 (0xd3e8 bytes) 2024-09-13T06:40:09.945 INFO:teuthology.orchestra.run.smithi081.stdout:1196 write 0x1719f7f thru 0x172219a (0x821c bytes) 2024-09-13T06:40:09.950 INFO:teuthology.orchestra.run.smithi081.stdout:1197 write 0x1f65db5 thru 0x1f72d35 (0xcf81 bytes) 2024-09-13T06:40:09.952 INFO:teuthology.orchestra.run.smithi081.stdout:1199 writesame 0x329d863 thru 0x32a9cbd data_size 0x2b(0xc45b bytes) 2024-09-13T06:40:09.955 INFO:teuthology.orchestra.run.smithi081.stdout:1200 read 0xbe27b8 thru 0xbe5508 (0x2d51 bytes) 2024-09-13T06:40:09.956 INFO:teuthology.orchestra.run.smithi081.stdout:1201 writesame 0x4e168ae thru 0x4e21482 data_size 0x2b(0xabd5 bytes) 2024-09-13T06:40:09.960 INFO:teuthology.orchestra.run.smithi081.stdout:1204 punch from 0x40223c2 to 0x402c08e, (0x9ccc bytes) 2024-09-13T06:40:09.960 INFO:teuthology.orchestra.run.smithi081.stdout:1206 read 0x6b00935 thru 0x6b01a90 (0x115c bytes) 2024-09-13T06:40:09.960 INFO:teuthology.orchestra.run.smithi081.stdout:1207 read 0x9218db1 thru 0x921f937 (0x6b87 bytes) 2024-09-13T06:40:09.960 INFO:teuthology.orchestra.run.smithi081.stdout:1208 writesame 0x8305bc6 thru 0x8309de7 data_size 0x5(0x4222 bytes) 2024-09-13T06:40:09.963 INFO:teuthology.orchestra.run.smithi081.stdout:1209 read 0x9c1edd2 thru 0x9c2a140 (0xb36f bytes) 2024-09-13T06:40:09.963 INFO:teuthology.orchestra.run.smithi081.stdout:1210 write 0x88c21c0 thru 0x88c670d (0x454e bytes) 2024-09-13T06:40:09.967 INFO:teuthology.orchestra.run.smithi081.stdout:1211 read 0x3f7d7ba thru 0x3f837af (0x5ff6 bytes) 2024-09-13T06:40:09.967 INFO:teuthology.orchestra.run.smithi081.stdout:1212 write 0xdbb1cfb thru 0xdbb71c6 (0x54cc bytes) 2024-09-13T06:40:09.970 INFO:teuthology.orchestra.run.smithi081.stdout:1213 punch from 0xb4cb2bc to 0xb4d28e1, (0x7625 bytes) 2024-09-13T06:40:09.970 INFO:teuthology.orchestra.run.smithi081.stdout:1214 punch from 0x6eb5ba3 to 0x6ebff78, (0xa3d5 bytes) 2024-09-13T06:40:09.980 INFO:teuthology.orchestra.run.smithi081.stdout:1216 trunc from 0xdc48070 to 0x69ef74a 2024-09-13T06:40:10.002 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:40:10.002 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:40:10.026 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-13T06:40:10.026 INFO:teuthology.orchestra.run.smithi081.stdout:1219 write 0xddcbf26 thru 0xddd1580 (0x565b bytes) 2024-09-13T06:40:10.029 INFO:teuthology.orchestra.run.smithi081.stdout:1221 punch from 0x58879d9 to 0x5893178, (0xb79f bytes) 2024-09-13T06:40:10.029 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:40:10.029 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:40:10.029 INFO:teuthology.orchestra.run.smithi081.stdout:1225 write 0xa502271 thru 0xa507fa6 (0x5d36 bytes) 2024-09-13T06:40:10.033 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:40:10.033 INFO:teuthology.orchestra.run.smithi081.stdout:1228 punch from 0xd0cf4cc to 0xd0d63e7, (0x6f1b bytes) 2024-09-13T06:40:10.033 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:40:10.033 INFO:teuthology.orchestra.run.smithi081.stdout:1230 write 0xdafa26b thru 0xdb052dd (0xb073 bytes) 2024-09-13T06:40:10.037 INFO:teuthology.orchestra.run.smithi081.stdout:1234 writesame 0xbe3aecf thru 0xbe419f2 data_size 0x2(0x6b24 bytes) 2024-09-13T06:40:10.040 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:40:10.042+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:40:10.045 INFO:teuthology.orchestra.run.smithi081.stdout:1235 write 0x8a613b thru 0x8b47b0 (0xe676 bytes) 2024-09-13T06:40:10.047 INFO:teuthology.orchestra.run.smithi081.stdout:1236 punch from 0x413fd2e to 0x414e195, (0xe467 bytes) 2024-09-13T06:40:10.047 INFO:teuthology.orchestra.run.smithi081.stdout:1238 writesame 0xbc64404 thru 0xbc6dd69 data_size 0x6e(0x9966 bytes) 2024-09-13T06:40:10.049 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:40:10.049 INFO:teuthology.orchestra.run.smithi081.stdout:1240 writesame 0x9f6d84e thru 0x9f7376d data_size 0x8(0x5f20 bytes) 2024-09-13T06:40:10.054 INFO:teuthology.orchestra.run.smithi081.stdout:1242 writesame 0x7b060e7 thru 0x7b0e9d3 data_size 0x1(0x88ed bytes) 2024-09-13T06:40:10.087 INFO:teuthology.orchestra.run.smithi081.stdout:osd.0: {} 2024-09-13T06:40:10.088 INFO:teuthology.orchestra.run.smithi081.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-13T06:40:10.104 INFO:teuthology.orchestra.run.smithi081.stdout:osd.1: {} 2024-09-13T06:40:10.105 INFO:teuthology.orchestra.run.smithi081.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-13T06:40:10.107 INFO:teuthology.orchestra.run.smithi081.stdout:1245 trunc from 0xddd1581 to 0x914faf9 2024-09-13T06:40:10.136 INFO:teuthology.orchestra.run.smithi081.stdout:osd.2: {} 2024-09-13T06:40:10.137 INFO:teuthology.orchestra.run.smithi081.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-13T06:40:10.139 INFO:teuthology.orchestra.run.smithi081.stdout:1246 writesame 0x97a12d6 thru 0x97aa3d2 data_size 0x1(0x90fd bytes) 2024-09-13T06:40:10.139 INFO:teuthology.orchestra.run.smithi081.stdout:1247 punch from 0x423910d to 0x4247ab4, (0xe9a7 bytes) 2024-09-13T06:40:10.139 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:40:10.139 INFO:teuthology.orchestra.run.smithi081.stdout:1252 write 0x7840670 thru 0x784daed (0xd47e bytes) 2024-09-13T06:40:10.140 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:40:10.142+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:40:10.142 INFO:teuthology.orchestra.run.smithi081.stdout:1253 writesame 0x2c45f69 thru 0x2c5426e data_size 0x1(0xe306 bytes) 2024-09-13T06:40:10.162 INFO:teuthology.orchestra.run.smithi081.stdout:osd.3: {} 2024-09-13T06:40:10.162 INFO:teuthology.orchestra.run.smithi081.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-13T06:40:10.180 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:40:10.180 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 20, 2024-09-13T06:40:10.180 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 600, 2024-09-13T06:40:10.180 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [ 2024-09-13T06:40:10.180 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:10.180 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:2226 3.15 3:af026987:::rbd_data.112173e2f1b7.0000000000000017:head [sparse-read 0~4194304] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-13T06:40:10.180 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:37.606562+0000", 2024-09-13T06:40:10.180 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 32.576750279000002, 2024-09-13T06:40:10.180 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.83322091700000001, 2024-09-13T06:40:10.180 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:10.181 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:40:10.181 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:10.181 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:10.181 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:10.181 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 2226 2024-09-13T06:40:10.181 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:10.181 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:10.181 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:10.181 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:10.181 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606562+0000", 2024-09-13T06:40:10.181 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:10.181 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:10.181 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:10.182 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:10.182 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606562+0000", 2024-09-13T06:40:10.182 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:10.182 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:10.182 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:10.182 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:10.182 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606561+0000", 2024-09-13T06:40:10.182 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:10.182 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:10.182 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:10.182 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:10.182 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606565+0000", 2024-09-13T06:40:10.182 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.4379999999999999e-06 2024-09-13T06:40:10.182 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:10.183 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:10.183 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:10.183 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606569+0000", 2024-09-13T06:40:10.183 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.425e-06 2024-09-13T06:40:10.183 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:10.183 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:10.183 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:10.183 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606572+0000", 2024-09-13T06:40:10.183 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.05e-06 2024-09-13T06:40:10.183 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:10.183 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:10.183 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:10.183 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606621+0000", 2024-09-13T06:40:10.184 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.8723000000000001e-05 2024-09-13T06:40:10.184 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:10.184 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:10.184 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:40:10.184 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606630+0000", 2024-09-13T06:40:10.184 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.8040000000000007e-06 2024-09-13T06:40:10.184 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:10.184 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:10.184 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:10.184 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.439648+0000", 2024-09-13T06:40:10.184 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.83301824800000002 2024-09-13T06:40:10.184 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:10.184 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:10.184 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:10.185 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.439782+0000", 2024-09-13T06:40:10.185 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00013466699999999999 2024-09-13T06:40:10.185 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:10.185 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:10.185 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:10.185 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:10.185 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:10.185 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25661 3.8 3:1180686c:::rbd_data.1121f2c5ee81.0000000000000009:13 [read 397312~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:10.185 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.436956+0000", 2024-09-13T06:40:10.185 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 13.746355745000001, 2024-09-13T06:40:10.185 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089036758999999993, 2024-09-13T06:40:10.185 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:10.185 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:10.186 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:10.186 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:10.186 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:10.186 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25661 2024-09-13T06:40:10.186 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:10.186 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:10.186 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:10.186 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:10.186 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436956+0000", 2024-09-13T06:40:10.186 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:10.186 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:10.186 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:10.186 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:10.186 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436956+0000", 2024-09-13T06:40:10.187 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:10.187 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:10.187 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:10.187 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:10.187 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436956+0000", 2024-09-13T06:40:10.187 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:10.187 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:10.187 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:10.187 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:10.187 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436958+0000", 2024-09-13T06:40:10.187 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1770000000000001e-06 2024-09-13T06:40:10.187 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:10.187 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:10.188 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:10.188 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436963+0000", 2024-09-13T06:40:10.188 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.6489999999999996e-06 2024-09-13T06:40:10.188 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:10.188 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:10.188 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:10.188 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436975+0000", 2024-09-13T06:40:10.188 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1783999999999999e-05 2024-09-13T06:40:10.188 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:10.188 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:10.188 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:10.188 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.525671+0000", 2024-09-13T06:40:10.188 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.088696292999999995 2024-09-13T06:40:10.188 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:10.189 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:10.189 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:10.189 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.525749+0000", 2024-09-13T06:40:10.189 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.7589000000000005e-05 2024-09-13T06:40:10.189 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:10.189 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:10.189 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:10.189 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.525993+0000", 2024-09-13T06:40:10.189 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00024381000000000001 2024-09-13T06:40:10.189 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:10.189 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:10.189 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:10.189 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:10.189 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:10.190 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25662 3.8 3:1180686c:::rbd_data.1121f2c5ee81.0000000000000009:13 [read 421888~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:10.190 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.436980+0000", 2024-09-13T06:40:10.190 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 13.746331433, 2024-09-13T06:40:10.190 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089367577000000004, 2024-09-13T06:40:10.190 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:10.190 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:10.190 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:10.190 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:10.190 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:10.190 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25662 2024-09-13T06:40:10.190 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:10.190 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:10.190 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:10.190 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:10.191 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436980+0000", 2024-09-13T06:40:10.191 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:10.191 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:10.191 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:10.191 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:10.191 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436980+0000", 2024-09-13T06:40:10.191 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:10.191 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:10.191 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:10.191 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:10.191 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436980+0000", 2024-09-13T06:40:10.191 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:10.191 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:10.191 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:10.192 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:10.192 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436982+0000", 2024-09-13T06:40:10.192 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3989999999999998e-06 2024-09-13T06:40:10.192 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:10.192 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:10.192 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:10.192 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436988+0000", 2024-09-13T06:40:10.192 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0039999999999996e-06 2024-09-13T06:40:10.192 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:10.192 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:10.192 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:10.192 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436993+0000", 2024-09-13T06:40:10.192 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6090000000000003e-06 2024-09-13T06:40:10.193 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:10.193 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:10.193 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:10.193 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.526035+0000", 2024-09-13T06:40:10.193 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089042248000000004 2024-09-13T06:40:10.193 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:10.193 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:10.193 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:10.193 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.526111+0000", 2024-09-13T06:40:10.193 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5643999999999996e-05 2024-09-13T06:40:10.193 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:10.193 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:10.193 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:10.193 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.526348+0000", 2024-09-13T06:40:10.194 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00023705800000000001 2024-09-13T06:40:10.194 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:10.194 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:10.194 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:10.194 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:10.194 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:10.194 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25663 3.8 3:1180686c:::rbd_data.1121f2c5ee81.0000000000000009:13 [read 466944~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:10.194 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.436998+0000", 2024-09-13T06:40:10.194 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 13.746313786, 2024-09-13T06:40:10.194 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089730867000000006, 2024-09-13T06:40:10.194 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:10.194 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:10.194 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:10.194 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:10.195 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:10.195 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25663 2024-09-13T06:40:10.195 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:10.195 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:10.195 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:10.195 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:10.195 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436998+0000", 2024-09-13T06:40:10.195 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:10.195 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:10.195 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:10.195 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:10.195 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436998+0000", 2024-09-13T06:40:10.195 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:10.196 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:10.196 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:10.196 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:10.196 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436998+0000", 2024-09-13T06:40:10.196 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:10.196 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:10.196 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:10.196 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:10.196 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437000+0000", 2024-09-13T06:40:10.196 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0940000000000002e-06 2024-09-13T06:40:10.196 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:10.196 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:10.196 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:10.197 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437005+0000", 2024-09-13T06:40:10.197 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.604e-06 2024-09-13T06:40:10.197 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:10.197 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:10.197 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:10.197 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437032+0000", 2024-09-13T06:40:10.197 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6407e-05 2024-09-13T06:40:10.197 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:10.197 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:10.197 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:10.197 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.526363+0000", 2024-09-13T06:40:10.197 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089331456000000004 2024-09-13T06:40:10.197 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:10.197 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:10.198 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:10.198 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.526404+0000", 2024-09-13T06:40:10.198 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.0887999999999999e-05 2024-09-13T06:40:10.198 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:10.198 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:10.198 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:10.198 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.526729+0000", 2024-09-13T06:40:10.198 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00032486 2024-09-13T06:40:10.198 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:10.198 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:10.198 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:10.198 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:10.198 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:10.198 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25664 3.8 3:1180686c:::rbd_data.1121f2c5ee81.0000000000000009:13 [read 491520~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:10.199 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.437040+0000", 2024-09-13T06:40:10.199 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 13.746271870999999, 2024-09-13T06:40:10.199 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.090016650000000004, 2024-09-13T06:40:10.199 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:10.199 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:10.199 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:10.199 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:10.199 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:10.199 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25664 2024-09-13T06:40:10.199 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:10.199 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:10.199 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:10.199 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:10.200 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437040+0000", 2024-09-13T06:40:10.200 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:10.200 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:10.200 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:10.200 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:10.200 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437040+0000", 2024-09-13T06:40:10.200 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:10.200 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:10.200 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:10.200 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:10.200 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437039+0000", 2024-09-13T06:40:10.200 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:10.200 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:10.201 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:10.201 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:10.201 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437047+0000", 2024-09-13T06:40:10.201 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4839999999999998e-06 2024-09-13T06:40:10.201 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:10.201 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:10.201 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:10.201 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437054+0000", 2024-09-13T06:40:10.201 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.8299999999999998e-06 2024-09-13T06:40:10.201 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:10.201 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:10.201 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:10.201 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437060+0000", 2024-09-13T06:40:10.202 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.1510000000000001e-06 2024-09-13T06:40:10.202 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:10.202 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:10.202 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:10.202 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.526772+0000", 2024-09-13T06:40:10.202 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089711737999999999 2024-09-13T06:40:10.202 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:10.202 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:10.202 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:10.202 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.526848+0000", 2024-09-13T06:40:10.202 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5870000000000004e-05 2024-09-13T06:40:10.202 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:10.202 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:10.202 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:10.203 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.527057+0000", 2024-09-13T06:40:10.203 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000209106 2024-09-13T06:40:10.203 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:10.203 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:10.203 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:10.203 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:10.203 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:10.203 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25740 3.18 3:1c662b96:::rbd_data.1121f2c5ee81.0000000000000010:13 [read 200704~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:10.203 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443352+0000", 2024-09-13T06:40:10.203 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 13.739960196, 2024-09-13T06:40:10.203 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089068222000000002, 2024-09-13T06:40:10.203 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:10.203 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:10.203 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:10.204 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:10.204 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:10.204 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25740 2024-09-13T06:40:10.204 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:10.204 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:10.204 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:10.204 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:10.204 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443352+0000", 2024-09-13T06:40:10.204 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:10.204 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:10.204 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:10.204 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:10.204 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443352+0000", 2024-09-13T06:40:10.205 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:10.205 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:10.205 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:10.205 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:10.205 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443351+0000", 2024-09-13T06:40:10.205 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:10.205 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:10.205 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:10.205 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:10.205 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443354+0000", 2024-09-13T06:40:10.205 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.841e-06 2024-09-13T06:40:10.205 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:10.205 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:10.206 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:10.206 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443361+0000", 2024-09-13T06:40:10.206 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.0010000000000004e-06 2024-09-13T06:40:10.206 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:10.206 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:10.206 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:10.206 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443366+0000", 2024-09-13T06:40:10.206 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7119999999999999e-06 2024-09-13T06:40:10.206 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:10.206 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:10.206 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:10.206 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532117+0000", 2024-09-13T06:40:10.206 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.088751327000000005 2024-09-13T06:40:10.207 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:10.207 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:10.207 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:10.207 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532193+0000", 2024-09-13T06:40:10.207 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5839000000000004e-05 2024-09-13T06:40:10.207 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:10.207 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:10.207 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:10.207 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532420+0000", 2024-09-13T06:40:10.207 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00022691000000000001 2024-09-13T06:40:10.207 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:10.207 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:10.207 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:10.207 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:10.208 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:10.208 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25741 3.18 3:1c662b96:::rbd_data.1121f2c5ee81.0000000000000010:13 [read 225280~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:10.208 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443378+0000", 2024-09-13T06:40:10.208 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 13.739933429000001, 2024-09-13T06:40:10.208 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089324107, 2024-09-13T06:40:10.208 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:10.208 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:10.208 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:10.208 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:10.208 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:10.208 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25741 2024-09-13T06:40:10.208 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:10.208 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:10.208 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:10.208 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:10.209 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443378+0000", 2024-09-13T06:40:10.209 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:10.209 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:10.209 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:10.209 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:10.209 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443378+0000", 2024-09-13T06:40:10.209 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:10.209 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:10.209 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:10.209 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:10.209 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443378+0000", 2024-09-13T06:40:10.209 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:10.209 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:10.209 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:10.210 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:10.210 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443380+0000", 2024-09-13T06:40:10.210 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3549999999999999e-06 2024-09-13T06:40:10.210 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:10.210 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:10.210 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:10.210 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443388+0000", 2024-09-13T06:40:10.210 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.7449999999999995e-06 2024-09-13T06:40:10.210 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:10.210 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:10.210 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:10.210 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443393+0000", 2024-09-13T06:40:10.210 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.4e-06 2024-09-13T06:40:10.210 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:10.211 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:10.211 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:10.211 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532454+0000", 2024-09-13T06:40:10.211 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089060941000000005 2024-09-13T06:40:10.211 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:10.211 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:10.211 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:10.211 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532512+0000", 2024-09-13T06:40:10.211 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7763000000000002e-05 2024-09-13T06:40:10.211 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:10.211 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:10.211 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:10.211 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532703+0000", 2024-09-13T06:40:10.211 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000190328 2024-09-13T06:40:10.211 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:10.212 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:10.212 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:10.212 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:10.212 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:10.212 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25742 3.18 3:1c662b96:::rbd_data.1121f2c5ee81.0000000000000010:13 [read 270336~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:10.212 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443398+0000", 2024-09-13T06:40:10.212 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 13.739913717, 2024-09-13T06:40:10.212 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089621836999999996, 2024-09-13T06:40:10.212 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:10.212 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:10.212 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:10.212 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:10.212 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:10.212 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25742 2024-09-13T06:40:10.213 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:10.213 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:10.213 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:10.213 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:10.213 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443398+0000", 2024-09-13T06:40:10.213 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:10.213 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:10.213 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:10.213 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:10.213 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443398+0000", 2024-09-13T06:40:10.213 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:10.213 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:10.213 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:10.213 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:10.214 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443398+0000", 2024-09-13T06:40:10.214 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:10.214 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:10.214 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:10.214 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:10.214 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443400+0000", 2024-09-13T06:40:10.214 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1849999999999998e-06 2024-09-13T06:40:10.214 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:10.214 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:10.214 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:10.214 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443407+0000", 2024-09-13T06:40:10.214 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3669999999999999e-06 2024-09-13T06:40:10.214 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:10.214 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:10.214 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:10.214 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443420+0000", 2024-09-13T06:40:10.215 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2645e-05 2024-09-13T06:40:10.215 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:10.215 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:10.215 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:10.215 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532742+0000", 2024-09-13T06:40:10.215 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089322200000000004 2024-09-13T06:40:10.215 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:10.215 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:10.215 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:10.215 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532818+0000", 2024-09-13T06:40:10.215 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.6019000000000005e-05 2024-09-13T06:40:10.215 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:10.215 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:10.215 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:10.215 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533020+0000", 2024-09-13T06:40:10.215 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000201721 2024-09-13T06:40:10.216 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:10.216 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:10.216 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:10.216 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:10.216 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:10.216 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25743 3.18 3:1c662b96:::rbd_data.1121f2c5ee81.0000000000000010:13 [read 294912~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:10.216 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443425+0000", 2024-09-13T06:40:10.216 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 13.739886709, 2024-09-13T06:40:10.216 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089864075000000002, 2024-09-13T06:40:10.216 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:10.216 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:10.216 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:10.216 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:10.216 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:10.216 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25743 2024-09-13T06:40:10.217 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:10.217 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:10.217 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:10.217 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:10.217 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443425+0000", 2024-09-13T06:40:10.217 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:10.217 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:10.217 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:10.217 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:10.217 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443425+0000", 2024-09-13T06:40:10.217 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:10.217 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:10.217 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:10.218 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:10.218 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443425+0000", 2024-09-13T06:40:10.218 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:10.218 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:10.218 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:10.218 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:10.218 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443432+0000", 2024-09-13T06:40:10.218 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3420000000000002e-06 2024-09-13T06:40:10.218 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:10.218 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:10.218 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:10.218 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443440+0000", 2024-09-13T06:40:10.218 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5689999999999999e-06 2024-09-13T06:40:10.218 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:10.218 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:10.218 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:10.219 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443445+0000", 2024-09-13T06:40:10.219 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9590000000000003e-06 2024-09-13T06:40:10.219 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:10.219 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:10.219 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:10.219 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533063+0000", 2024-09-13T06:40:10.219 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089617988999999995 2024-09-13T06:40:10.219 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:10.219 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:10.219 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:10.219 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533122+0000", 2024-09-13T06:40:10.219 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9052999999999999e-05 2024-09-13T06:40:10.219 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:10.219 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:10.220 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:10.220 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533289+0000", 2024-09-13T06:40:10.220 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00016752800000000001 2024-09-13T06:40:10.220 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:10.220 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:10.220 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:10.220 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:10.220 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:10.220 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25744 3.18 3.69d46638 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:10.220 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443449+0000", 2024-09-13T06:40:10.220 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 13.739862562000001, 2024-09-13T06:40:10.220 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089869148999999995, 2024-09-13T06:40:10.220 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:10.220 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:40:10.220 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:10.221 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:10.221 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:10.221 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25744 2024-09-13T06:40:10.221 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:10.221 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:10.221 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:10.221 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:10.221 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443449+0000", 2024-09-13T06:40:10.221 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:10.221 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:10.221 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:10.221 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:10.221 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443449+0000", 2024-09-13T06:40:10.221 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:10.222 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:10.222 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:10.222 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:10.222 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443449+0000", 2024-09-13T06:40:10.222 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:10.222 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:10.222 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:10.222 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:10.222 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443451+0000", 2024-09-13T06:40:10.222 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.244e-06 2024-09-13T06:40:10.222 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:10.222 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:10.222 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:10.222 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443457+0000", 2024-09-13T06:40:10.222 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.66e-06 2024-09-13T06:40:10.223 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:10.223 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:10.223 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:10.223 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443461+0000", 2024-09-13T06:40:10.223 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5449999999999997e-06 2024-09-13T06:40:10.223 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:10.223 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:10.223 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:10.223 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533311+0000", 2024-09-13T06:40:10.223 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089849729000000003 2024-09-13T06:40:10.223 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:10.223 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:10.223 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:10.224 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533318+0000", 2024-09-13T06:40:10.224 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.328e-06 2024-09-13T06:40:10.224 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:10.224 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:10.224 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:10.224 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:10.224 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:10.224 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25745 3.18 3.69d46638 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:10.224 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443466+0000", 2024-09-13T06:40:10.224 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 13.739845504, 2024-09-13T06:40:10.224 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089886743000000005, 2024-09-13T06:40:10.224 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:10.224 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:40:10.224 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:10.225 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:10.225 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:10.225 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25745 2024-09-13T06:40:10.225 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:10.225 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:10.225 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:10.225 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:10.225 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443466+0000", 2024-09-13T06:40:10.225 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:10.225 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:10.225 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:10.225 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:10.225 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443466+0000", 2024-09-13T06:40:10.226 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:10.226 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:10.226 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:10.226 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:10.226 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443466+0000", 2024-09-13T06:40:10.226 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:10.226 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:10.226 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:10.226 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:10.226 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443474+0000", 2024-09-13T06:40:10.226 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.1289999999999996e-06 2024-09-13T06:40:10.226 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:10.226 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:10.226 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:10.227 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443484+0000", 2024-09-13T06:40:10.227 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0654e-05 2024-09-13T06:40:10.227 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:10.227 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:10.227 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:10.227 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443490+0000", 2024-09-13T06:40:10.227 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8030000000000002e-06 2024-09-13T06:40:10.227 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:10.227 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:10.227 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:10.227 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533348+0000", 2024-09-13T06:40:10.227 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089857267000000005 2024-09-13T06:40:10.227 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:10.228 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:10.228 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:10.228 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533353+0000", 2024-09-13T06:40:10.228 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.5520000000000004e-06 2024-09-13T06:40:10.228 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:10.228 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:10.228 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:10.228 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:10.228 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:10.228 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25746 3.18 3.69d46638 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:10.228 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443495+0000", 2024-09-13T06:40:10.228 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 13.739816391, 2024-09-13T06:40:10.228 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089903725000000004, 2024-09-13T06:40:10.228 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:10.229 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:40:10.229 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:10.229 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:10.229 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:10.229 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25746 2024-09-13T06:40:10.229 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:10.229 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:10.229 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:10.229 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:10.229 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443495+0000", 2024-09-13T06:40:10.229 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:10.229 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:10.229 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:10.229 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:10.230 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443495+0000", 2024-09-13T06:40:10.230 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:10.230 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:10.230 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:10.230 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:10.230 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443495+0000", 2024-09-13T06:40:10.230 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:10.230 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:10.230 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:10.230 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:10.230 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443498+0000", 2024-09-13T06:40:10.230 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.7690000000000001e-06 2024-09-13T06:40:10.230 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:10.230 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:10.230 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:10.230 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443504+0000", 2024-09-13T06:40:10.231 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9710000000000001e-06 2024-09-13T06:40:10.231 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:10.231 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:10.231 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:10.231 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443508+0000", 2024-09-13T06:40:10.231 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4159999999999997e-06 2024-09-13T06:40:10.231 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:10.231 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:10.231 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:10.231 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533391+0000", 2024-09-13T06:40:10.231 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089882607000000003 2024-09-13T06:40:10.231 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:10.231 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:10.231 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:10.232 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533399+0000", 2024-09-13T06:40:10.232 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.4349999999999997e-06 2024-09-13T06:40:10.232 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:10.232 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:10.232 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:10.232 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:10.232 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:10.232 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25747 3.8 3.63996268 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:10.232 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443512+0000", 2024-09-13T06:40:10.232 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 13.739799659999999, 2024-09-13T06:40:10.232 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089880075000000004, 2024-09-13T06:40:10.232 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:10.232 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:40:10.232 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:10.233 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:10.233 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:10.233 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25747 2024-09-13T06:40:10.233 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:10.233 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:10.233 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:10.233 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:10.233 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443512+0000", 2024-09-13T06:40:10.233 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:10.233 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:10.233 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:10.233 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:10.233 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443512+0000", 2024-09-13T06:40:10.233 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:10.234 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:10.234 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:10.234 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:10.234 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443512+0000", 2024-09-13T06:40:10.234 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:10.234 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:10.234 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:10.234 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:10.234 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443514+0000", 2024-09-13T06:40:10.234 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0980000000000001e-06 2024-09-13T06:40:10.234 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:10.234 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:10.234 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:10.235 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443520+0000", 2024-09-13T06:40:10.235 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7069999999999997e-06 2024-09-13T06:40:10.235 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:10.235 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:10.235 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:10.235 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443524+0000", 2024-09-13T06:40:10.235 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5390000000000001e-06 2024-09-13T06:40:10.235 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:10.235 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:10.235 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:10.235 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533384+0000", 2024-09-13T06:40:10.235 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089859684999999995 2024-09-13T06:40:10.235 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:10.235 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:10.235 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:10.236 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533392+0000", 2024-09-13T06:40:10.236 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.3440000000000001e-06 2024-09-13T06:40:10.236 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:10.236 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:10.236 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:10.236 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:10.236 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:10.236 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25748 3.8 3.63996268 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:10.236 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443528+0000", 2024-09-13T06:40:10.236 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 13.739783533000001, 2024-09-13T06:40:10.236 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089890715999999996, 2024-09-13T06:40:10.236 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:10.236 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:40:10.236 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:10.237 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:10.237 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:10.237 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25748 2024-09-13T06:40:10.237 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:10.237 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:10.237 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:10.237 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:10.237 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443528+0000", 2024-09-13T06:40:10.237 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:10.237 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:10.237 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:10.237 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:10.237 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443528+0000", 2024-09-13T06:40:10.237 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:10.237 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:10.238 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:10.238 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:10.238 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443528+0000", 2024-09-13T06:40:10.238 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:10.238 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:10.238 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:10.238 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:10.238 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443530+0000", 2024-09-13T06:40:10.238 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0650000000000001e-06 2024-09-13T06:40:10.238 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:10.238 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:10.238 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:10.238 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443536+0000", 2024-09-13T06:40:10.238 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7259999999999999e-06 2024-09-13T06:40:10.238 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:10.239 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:10.239 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:10.239 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443540+0000", 2024-09-13T06:40:10.239 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5009999999999998e-06 2024-09-13T06:40:10.239 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:10.239 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:10.239 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:10.239 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533412+0000", 2024-09-13T06:40:10.239 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089871873000000005 2024-09-13T06:40:10.239 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:10.239 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:10.239 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:10.239 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533419+0000", 2024-09-13T06:40:10.239 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.883e-06 2024-09-13T06:40:10.239 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:10.240 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:10.240 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:10.240 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:10.240 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:10.240 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25749 3.8 3.63996268 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:10.240 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443545+0000", 2024-09-13T06:40:10.240 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 13.739767337, 2024-09-13T06:40:10.240 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089897988999999998, 2024-09-13T06:40:10.240 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:10.240 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:40:10.240 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:10.240 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:10.240 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:10.240 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25749 2024-09-13T06:40:10.240 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:10.241 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:10.241 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:10.241 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:10.241 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443545+0000", 2024-09-13T06:40:10.241 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:10.241 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:10.241 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:10.241 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:10.241 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443545+0000", 2024-09-13T06:40:10.241 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:10.241 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:10.241 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:10.241 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:10.241 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443544+0000", 2024-09-13T06:40:10.242 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:10.242 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:10.242 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:10.242 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:10.242 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443553+0000", 2024-09-13T06:40:10.242 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.4770000000000003e-06 2024-09-13T06:40:10.242 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:10.242 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:10.242 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:10.242 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443564+0000", 2024-09-13T06:40:10.242 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0986e-05 2024-09-13T06:40:10.242 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:10.242 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:10.242 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:10.242 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443569+0000", 2024-09-13T06:40:10.242 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2530000000000004e-06 2024-09-13T06:40:10.243 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:10.243 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:10.243 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:10.243 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533438+0000", 2024-09-13T06:40:10.243 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089868641999999999 2024-09-13T06:40:10.243 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:10.243 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:10.243 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:10.243 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533442+0000", 2024-09-13T06:40:10.243 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.989e-06 2024-09-13T06:40:10.243 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:10.243 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:10.243 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:10.244 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:10.244 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:10.244 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25750 3.8 3.63996268 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:10.244 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443574+0000", 2024-09-13T06:40:10.244 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 13.739737850999999, 2024-09-13T06:40:10.244 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089895143999999996, 2024-09-13T06:40:10.244 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:10.244 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:40:10.244 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:10.244 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:10.245 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:10.245 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25750 2024-09-13T06:40:10.245 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:10.245 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:10.245 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:10.245 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:10.245 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443574+0000", 2024-09-13T06:40:10.245 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:10.245 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:10.245 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:10.245 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:10.245 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443574+0000", 2024-09-13T06:40:10.245 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:10.246 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:10.246 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:10.246 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:10.246 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443574+0000", 2024-09-13T06:40:10.246 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:10.246 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:10.246 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:10.246 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:10.246 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443576+0000", 2024-09-13T06:40:10.246 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6910000000000002e-06 2024-09-13T06:40:10.246 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:10.246 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:10.246 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:10.246 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443583+0000", 2024-09-13T06:40:10.246 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.331e-06 2024-09-13T06:40:10.247 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:10.247 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:10.247 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:10.247 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443587+0000", 2024-09-13T06:40:10.247 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6129999999999997e-06 2024-09-13T06:40:10.247 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:10.247 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:10.247 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:10.247 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533464+0000", 2024-09-13T06:40:10.247 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089876605999999998 2024-09-13T06:40:10.247 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:10.247 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:10.247 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:10.247 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533469+0000", 2024-09-13T06:40:10.248 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3909999999999997e-06 2024-09-13T06:40:10.248 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:10.248 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:10.248 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:10.248 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:10.248 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:10.248 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25751 3.8 3.63996268 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:10.248 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443592+0000", 2024-09-13T06:40:10.248 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 13.739720154, 2024-09-13T06:40:10.248 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089913650999999997, 2024-09-13T06:40:10.248 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:10.248 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:40:10.248 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:10.249 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:10.249 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:10.249 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25751 2024-09-13T06:40:10.249 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:10.249 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:10.249 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:10.249 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:10.249 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443592+0000", 2024-09-13T06:40:10.249 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:10.249 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:10.249 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:10.249 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:10.249 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443592+0000", 2024-09-13T06:40:10.250 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:10.250 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:10.250 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:10.250 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:10.250 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443591+0000", 2024-09-13T06:40:10.250 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:10.250 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:10.250 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:10.250 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:10.250 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443594+0000", 2024-09-13T06:40:10.250 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3649999999999998e-06 2024-09-13T06:40:10.250 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:10.250 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:10.250 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:10.251 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443599+0000", 2024-09-13T06:40:10.251 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.699e-06 2024-09-13T06:40:10.251 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:10.251 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:10.251 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:10.251 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443611+0000", 2024-09-13T06:40:10.251 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1503e-05 2024-09-13T06:40:10.251 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:10.251 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:10.251 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:10.251 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533497+0000", 2024-09-13T06:40:10.251 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089886453000000005 2024-09-13T06:40:10.251 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:10.251 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:10.252 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:10.252 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533505+0000", 2024-09-13T06:40:10.252 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.9910000000000002e-06 2024-09-13T06:40:10.252 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:10.252 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:10.252 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:10.252 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:10.252 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:10.252 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25752 3.8 3.63996268 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:10.252 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443615+0000", 2024-09-13T06:40:10.252 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 13.739696372999999, 2024-09-13T06:40:10.252 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089905868999999999, 2024-09-13T06:40:10.252 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:10.252 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:40:10.253 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:10.253 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:10.253 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:10.253 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25752 2024-09-13T06:40:10.253 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:10.253 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:10.253 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:10.253 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:10.253 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443615+0000", 2024-09-13T06:40:10.253 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:10.253 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:10.253 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:10.253 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:10.253 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443615+0000", 2024-09-13T06:40:10.254 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:10.254 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:10.254 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:10.254 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:10.254 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443615+0000", 2024-09-13T06:40:10.254 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:10.254 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:10.254 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:10.254 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:10.254 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443617+0000", 2024-09-13T06:40:10.254 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3539999999999998e-06 2024-09-13T06:40:10.254 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:10.254 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:10.254 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:10.255 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443624+0000", 2024-09-13T06:40:10.255 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3600000000000001e-06 2024-09-13T06:40:10.255 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:10.255 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:10.255 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:10.255 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443628+0000", 2024-09-13T06:40:10.255 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.2350000000000001e-06 2024-09-13T06:40:10.255 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:10.255 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:10.255 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:10.255 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533517+0000", 2024-09-13T06:40:10.255 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089889029999999995 2024-09-13T06:40:10.255 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:10.255 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:10.256 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:10.256 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533521+0000", 2024-09-13T06:40:10.256 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.2529999999999998e-06 2024-09-13T06:40:10.256 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:10.256 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:10.256 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:10.256 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:10.256 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:10.256 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25755 3.8 3.63996268 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:10.256 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.444692+0000", 2024-09-13T06:40:10.256 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 13.738619667, 2024-09-13T06:40:10.256 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.088904186999999996, 2024-09-13T06:40:10.256 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:10.256 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:40:10.257 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:10.257 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:10.257 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:10.257 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25755 2024-09-13T06:40:10.257 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:10.257 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:10.257 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:10.257 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:10.257 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.444692+0000", 2024-09-13T06:40:10.257 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:10.257 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:10.257 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:10.257 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:10.258 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.444692+0000", 2024-09-13T06:40:10.258 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:10.258 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:10.258 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:10.258 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:10.258 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.444692+0000", 2024-09-13T06:40:10.258 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:10.258 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:10.258 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:10.258 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:10.258 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.444694+0000", 2024-09-13T06:40:10.258 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.058e-06 2024-09-13T06:40:10.258 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:10.258 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:10.258 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:10.259 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.444700+0000", 2024-09-13T06:40:10.259 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7769999999999999e-06 2024-09-13T06:40:10.259 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:10.259 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:10.259 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:10.259 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.444704+0000", 2024-09-13T06:40:10.259 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6229999999999996e-06 2024-09-13T06:40:10.259 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:10.259 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:10.259 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:10.259 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533587+0000", 2024-09-13T06:40:10.259 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.088882744999999999 2024-09-13T06:40:10.259 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:10.259 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:10.260 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:10.260 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533596+0000", 2024-09-13T06:40:10.260 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.3270000000000007e-06 2024-09-13T06:40:10.260 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:10.260 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:10.260 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:10.260 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:10.260 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:10.260 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25756 3.8 3.63996268 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:10.260 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.444709+0000", 2024-09-13T06:40:10.260 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 13.738603291, 2024-09-13T06:40:10.260 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.088902571, 2024-09-13T06:40:10.260 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:10.260 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:40:10.261 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:10.261 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:10.261 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:10.261 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25756 2024-09-13T06:40:10.261 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:10.261 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:10.261 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:10.261 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:10.261 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.444709+0000", 2024-09-13T06:40:10.261 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:10.261 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:10.261 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:10.261 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:10.261 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.444709+0000", 2024-09-13T06:40:10.262 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:10.262 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:10.262 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:10.262 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:10.262 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.444708+0000", 2024-09-13T06:40:10.262 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:10.262 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:10.262 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:10.262 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:10.262 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.444710+0000", 2024-09-13T06:40:10.262 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0729999999999999e-06 2024-09-13T06:40:10.262 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:10.262 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:10.262 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:10.263 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.444716+0000", 2024-09-13T06:40:10.263 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7819999999999999e-06 2024-09-13T06:40:10.263 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:10.263 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:10.263 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:10.263 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.444720+0000", 2024-09-13T06:40:10.263 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4000000000000002e-06 2024-09-13T06:40:10.263 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:10.263 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:10.263 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:10.263 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533606+0000", 2024-09-13T06:40:10.263 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.088885711000000006 2024-09-13T06:40:10.263 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:10.263 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:10.264 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:10.264 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533611+0000", 2024-09-13T06:40:10.264 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.057e-06 2024-09-13T06:40:10.264 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:10.264 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:10.264 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:10.264 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:10.264 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:10.264 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:40:10.265 INFO:teuthology.orchestra.run.smithi081.stdout:osd.4: {} 2024-09-13T06:40:10.265 INFO:teuthology.orchestra.run.smithi081.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-13T06:40:10.266 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-13T06:40:10.267 INFO:teuthology.orchestra.run.smithi081.stdout:osd.5: {} 2024-09-13T06:40:10.267 INFO:teuthology.orchestra.run.smithi081.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-13T06:40:10.268 INFO:teuthology.orchestra.run.smithi081.stdout:1254 read 0x28fcce1 thru 0x290575c (0x8a7c bytes) 2024-09-13T06:40:10.268 INFO:teuthology.orchestra.run.smithi081.stdout:1255 write 0x60411fa thru 0x6041352 (0x159 bytes) 2024-09-13T06:40:10.268 INFO:teuthology.orchestra.run.smithi081.stdout:1256 punch from 0x49a35c7 to 0x49a7993, (0x43cc bytes) 2024-09-13T06:40:10.268 INFO:teuthology.orchestra.run.smithi081.stdout:1258 trunc from 0x97aa3d3 to 0x9255f50 2024-09-13T06:40:10.268 INFO:teuthology.orchestra.run.smithi081.stdout:1259 writesame 0x154bbe thru 0x15c303 data_size 0x15(0x7746 bytes) 2024-09-13T06:40:10.268 INFO:teuthology.orchestra.run.smithi081.stdout:osd.6: {} 2024-09-13T06:40:10.268 INFO:teuthology.orchestra.run.smithi081.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-13T06:40:10.269 INFO:teuthology.orchestra.run.smithi081.stdout:1260 write 0x42a6b7a thru 0x42ad479 (0x6900 bytes) 2024-09-13T06:40:10.269 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:40:10.269 INFO:teuthology.orchestra.run.smithi081.stdout:1262 trunc from 0x9255f50 to 0x6d38414 2024-09-13T06:40:10.273 INFO:teuthology.orchestra.run.smithi081.stdout:osd.7: {} 2024-09-13T06:40:10.273 INFO:teuthology.orchestra.run.smithi081.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-13T06:40:10.273 INFO:teuthology.orchestra.run.smithi081.stdout:1263 trunc from 0x6d38414 to 0x62e3f1a 2024-09-13T06:40:10.274 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:40:10.266+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:40:10.275 INFO:teuthology.orchestra.run.smithi081.stdout:1264 trunc from 0x62e3f1a to 0x3beab28 2024-09-13T06:40:10.288 INFO:teuthology.orchestra.run.smithi081.stdout:1265 punch from 0xda5fb1 to 0xda9f3a, (0x3f89 bytes) 2024-09-13T06:40:10.288 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:40:10.288 INFO:teuthology.orchestra.run.smithi081.stdout:1268 read 0x35b323 thru 0x366219 (0xaef7 bytes) 2024-09-13T06:40:10.310 INFO:teuthology.orchestra.run.smithi081.stdout:1270 write 0xc47ecaa thru 0xc48059d (0x18f4 bytes) 2024-09-13T06:40:10.319 INFO:teuthology.orchestra.run.smithi081.stdout:1272 trunc from 0xc48059e to 0xeba50ac 2024-09-13T06:40:10.327 INFO:teuthology.orchestra.run.smithi081.stdout:1273 read 0xa92663a thru 0xa926699 (0x60 bytes) 2024-09-13T06:40:10.327 INFO:teuthology.orchestra.run.smithi081.stdout:1276 write 0x2af9ad1 thru 0x2b000ee (0x661e bytes) 2024-09-13T06:40:10.329 INFO:teuthology.orchestra.run.smithi081.stdout:1277 writesame 0x9aef574 thru 0x9af1a6b data_size 0x1c(0x24f8 bytes) 2024-09-13T06:40:10.332 INFO:teuthology.orchestra.run.smithi081.stdout:1279 writesame 0x8084a3f thru 0x80917bb data_size 0x3f(0xcd7d bytes) 2024-09-13T06:40:10.336 INFO:teuthology.orchestra.run.smithi081.stdout:1281 read 0xdd91ecb thru 0xdd9d9ad (0xbae3 bytes) 2024-09-13T06:40:10.336 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:40:10.336 INFO:teuthology.orchestra.run.smithi081.stdout:1283 read 0xa43a9bb thru 0xa43fd61 (0x53a7 bytes) 2024-09-13T06:40:10.340 INFO:teuthology.orchestra.run.smithi081.stdout:1284 trunc from 0xeba50ac to 0xc1c7b6f 2024-09-13T06:40:10.351 INFO:teuthology.orchestra.run.smithi081.stdout:1285 write 0xc066926 thru 0xc06a049 (0x3724 bytes) 2024-09-13T06:40:10.355 INFO:teuthology.orchestra.run.smithi081.stdout:1286 writesame 0x4866216 thru 0x487263a data_size 0x1(0xc425 bytes) 2024-09-13T06:40:10.366 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:40:10.366+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:40:10.392 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-13T06:40:10.408 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:40:10.408 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [], 2024-09-13T06:40:10.408 INFO:teuthology.orchestra.run.smithi139.stdout: "num_ops": 0 2024-09-13T06:40:10.408 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:40:10.418 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:40:10.418 INFO:teuthology.orchestra.run.smithi081.stdout:1288 write 0x9bccf02 thru 0x9bce694 (0x1793 bytes) 2024-09-13T06:40:10.420 INFO:teuthology.orchestra.run.smithi081.stdout:1289 punch from 0x12b67bb to 0x12b7268, (0xaad bytes) 2024-09-13T06:40:10.420 INFO:teuthology.orchestra.run.smithi081.stdout:1290 writesame 0xc09bfb thru 0xc0a79d data_size 0x3(0xba3 bytes) 2024-09-13T06:40:10.423 INFO:teuthology.orchestra.run.smithi081.stdout:1291 writesame 0x3bfda12 thru 0x3bffb6d data_size 0x3d(0x215c bytes) 2024-09-13T06:40:10.424 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-13T06:40:10.427 INFO:teuthology.orchestra.run.smithi081.stdout:1292 read 0x4972903 thru 0x4978530 (0x5c2e bytes) 2024-09-13T06:40:10.427 INFO:teuthology.orchestra.run.smithi081.stdout:1293 writesame 0x8fc75af thru 0x8fcb0c1 data_size 0x3(0x3b13 bytes) 2024-09-13T06:40:10.442 INFO:teuthology.orchestra.run.smithi081.stdout:1294 writesame 0xce87fdb thru 0xce94103 data_size 0x3(0xc129 bytes) 2024-09-13T06:40:10.442 INFO:teuthology.orchestra.run.smithi081.stdout:1295 write 0x613ee3f thru 0x614e314 (0xf4d6 bytes) 2024-09-13T06:40:10.444 INFO:teuthology.orchestra.run.smithi081.stdout:1296 writesame 0x9abd63b thru 0x9ac7b8b data_size 0x1(0xa551 bytes) 2024-09-13T06:40:10.464 INFO:teuthology.orchestra.run.smithi081.stdout:1297 read 0x6c01cd9 thru 0x6c03a43 (0x1d6b bytes) 2024-09-13T06:40:10.465 INFO:teuthology.orchestra.run.smithi081.stdout:1298 write 0x21288d2 thru 0x2137b1a (0xf249 bytes) 2024-09-13T06:40:10.467 INFO:teuthology.orchestra.run.smithi081.stdout:1299 read 0x4bcb4bf thru 0x4bcd496 (0x1fd8 bytes) 2024-09-13T06:40:10.467 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:40:10.467 INFO:teuthology.orchestra.run.smithi081.stdout:1302 punch from 0x60da76d to 0x60dd3a9, (0x2c3c bytes) 2024-09-13T06:40:10.468 INFO:teuthology.orchestra.run.smithi081.stdout:1304 punch from 0xc77fff2 to 0xc783a3d, (0x3a4b bytes) 2024-09-13T06:40:10.468 INFO:teuthology.orchestra.run.smithi081.stdout:1305 read 0x316afb8 thru 0x3172e02 (0x7e4b bytes) 2024-09-13T06:40:10.468 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:40:10.478 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:40:10.476+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:40:10.478 INFO:teuthology.orchestra.run.smithi081.stdout:1308 write 0xdf14b9f thru 0xdf224a8 (0xd90a bytes) 2024-09-13T06:40:10.482 INFO:teuthology.orchestra.run.smithi081.stdout:1309 read 0x1984f6e thru 0x1990765 (0xb7f8 bytes) 2024-09-13T06:40:10.482 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:40:10.482 INFO:teuthology.orchestra.run.smithi081.stdout:1312 trunc from 0xdf224a9 to 0xdd346b2 2024-09-13T06:40:10.491 INFO:teuthology.orchestra.run.smithi081.stdout:1313 write 0x28a6fc1 thru 0x28adc61 (0x6ca1 bytes) 2024-09-13T06:40:10.493 INFO:teuthology.orchestra.run.smithi081.stdout:1314 punch from 0xc788c6c to 0xc791a56, (0x8dea bytes) 2024-09-13T06:40:10.494 INFO:teuthology.orchestra.run.smithi081.stdout:1315 writesame 0x25b2f06 thru 0x25ba79a data_size 0x1(0x7895 bytes) 2024-09-13T06:40:10.519 INFO:teuthology.orchestra.run.smithi081.stdout:1316 write 0xbb365ad thru 0xbb3ba02 (0x5456 bytes) 2024-09-13T06:40:10.521 INFO:teuthology.orchestra.run.smithi081.stdout:1317 write 0xc31e394 thru 0xc31ef95 (0xc02 bytes) 2024-09-13T06:40:10.523 INFO:teuthology.orchestra.run.smithi081.stdout:1318 writesame 0x89bb662 thru 0x89be695 data_size 0xa(0x3034 bytes) 2024-09-13T06:40:10.526 INFO:teuthology.orchestra.run.smithi081.stdout:1320 punch from 0x213bf08 to 0x214b700, (0xf7f8 bytes) 2024-09-13T06:40:10.526 INFO:teuthology.orchestra.run.smithi081.stdout:1321 punch from 0x9aa47bd to 0x9aafd30, (0xb573 bytes) 2024-09-13T06:40:10.526 INFO:teuthology.orchestra.run.smithi081.stdout:1323 read 0x27e9d5 thru 0x284e98 (0x64c4 bytes) 2024-09-13T06:40:10.527 INFO:teuthology.orchestra.run.smithi081.stdout:1324 read 0xad70bab thru 0xad734d8 (0x292e bytes) 2024-09-13T06:40:10.546 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:40:10.546 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [], 2024-09-13T06:40:10.547 INFO:teuthology.orchestra.run.smithi139.stdout: "complaint_time": 30, 2024-09-13T06:40:10.547 INFO:teuthology.orchestra.run.smithi139.stdout: "num_blocked_ops": 0 2024-09-13T06:40:10.547 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:40:10.548 INFO:teuthology.orchestra.run.smithi081.stdout:1326 trunc from 0xdd346b2 to 0x1088e85 2024-09-13T06:40:10.563 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-13T06:40:10.568 INFO:teuthology.orchestra.run.smithi081.stdout:1327 read 0xca87d2 thru 0xcaba3e (0x326d bytes) 2024-09-13T06:40:10.568 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:40:10.570+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:40:10.569 INFO:teuthology.orchestra.run.smithi081.stdout:1328 trunc from 0x1088e85 to 0x11753c0 2024-09-13T06:40:10.599 INFO:teuthology.orchestra.run.smithi081.stdout:1329 write 0xd38a0b5 thru 0xd38dd6b (0x3cb7 bytes) 2024-09-13T06:40:10.612 INFO:teuthology.orchestra.run.smithi081.stdout:1330 writesame 0xdad725e thru 0xdae27f9 data_size 0x76(0xb59c bytes) 2024-09-13T06:40:10.616 INFO:teuthology.orchestra.run.smithi081.stdout:1331 trunc from 0xdae27fa to 0xaee6fad 2024-09-13T06:40:10.636 INFO:teuthology.orchestra.run.smithi081.stdout:1332 trunc from 0xaee6fad to 0x2e647f9 2024-09-13T06:40:10.650 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6] out_osds: [7] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-13T06:40:10.651 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-13T06:40:10.651 INFO:tasks.thrashosds.thrasher:inject_pause on osd.1 2024-09-13T06:40:10.651 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-09-13T06:40:10.651 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-09-13T06:40:10.651 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok config set filestore_inject_stall 3 2024-09-13T06:40:10.669 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:40:10.672+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:40:10.677 INFO:teuthology.orchestra.run.smithi081.stdout:1333 write 0xbc6938e thru 0xbc6adb1 (0x1a24 bytes) 2024-09-13T06:40:10.685 INFO:teuthology.orchestra.run.smithi081.stdout:1335 read 0xa054a4a thru 0xa05576b (0xd22 bytes) 2024-09-13T06:40:10.685 INFO:teuthology.orchestra.run.smithi081.stdout:1336 trunc from 0xbc6adb2 to 0xb04f6f4 2024-09-13T06:40:10.707 INFO:teuthology.orchestra.run.smithi081.stdout:1337 writesame 0xddbd79a thru 0xddc9054 data_size 0x13(0xb8bb bytes) 2024-09-13T06:40:10.709 INFO:teuthology.orchestra.run.smithi081.stdout:1338 read 0x3674d1c thru 0x3679bb6 (0x4e9b bytes) 2024-09-13T06:40:10.709 INFO:teuthology.orchestra.run.smithi081.stdout:1339 write 0x73dcf30 thru 0x73e38e0 (0x69b1 bytes) 2024-09-13T06:40:10.715 INFO:teuthology.orchestra.run.smithi081.stdout:1340 writesame 0xd154dad thru 0xd15cfb4 data_size 0x4(0x8208 bytes) 2024-09-13T06:40:10.732 INFO:teuthology.orchestra.run.smithi081.stdout:1341 trunc from 0xddc9055 to 0x8a18cf4 2024-09-13T06:40:10.735 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:40:10.735 INFO:teuthology.orchestra.run.smithi139.stdout: "size": 20, 2024-09-13T06:40:10.735 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 600, 2024-09-13T06:40:10.735 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [ 2024-09-13T06:40:10.736 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:10.736 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18706 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 3346432~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:40:10.736 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.846138+0000", 2024-09-13T06:40:10.736 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 18.890516001999998, 2024-09-13T06:40:10.736 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.102018712, 2024-09-13T06:40:10.736 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:10.736 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:10.736 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:10.736 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:10.736 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:10.736 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18706 2024-09-13T06:40:10.736 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:10.736 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:10.737 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:10.737 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:10.737 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846138+0000", 2024-09-13T06:40:10.737 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:10.737 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:10.737 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:10.737 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:10.737 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846138+0000", 2024-09-13T06:40:10.737 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:10.737 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:10.737 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:10.737 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:10.737 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846138+0000", 2024-09-13T06:40:10.738 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:10.738 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:10.738 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:10.738 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:10.738 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846141+0000", 2024-09-13T06:40:10.738 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.6969999999999999e-06 2024-09-13T06:40:10.738 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:10.738 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:10.738 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:10.738 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846150+0000", 2024-09-13T06:40:10.738 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6400000000000003e-06 2024-09-13T06:40:10.738 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:10.738 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:10.738 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:10.739 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846160+0000", 2024-09-13T06:40:10.739 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.3999999999999998e-06 2024-09-13T06:40:10.739 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:10.739 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:10.739 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:10.739 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.947764+0000", 2024-09-13T06:40:10.739 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101604085 2024-09-13T06:40:10.739 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:10.739 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:10.739 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:10.739 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.947888+0000", 2024-09-13T06:40:10.739 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000124113 2024-09-13T06:40:10.739 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:10.739 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:10.739 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:10.740 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.948157+0000", 2024-09-13T06:40:10.740 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00026943399999999998 2024-09-13T06:40:10.740 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:10.740 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:10.740 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:10.740 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:10.740 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:10.740 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18707 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 3375104~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:40:10.740 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.846207+0000", 2024-09-13T06:40:10.740 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 18.890447236, 2024-09-13T06:40:10.740 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10238114099999999, 2024-09-13T06:40:10.740 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:10.740 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:10.740 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:10.741 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:10.741 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:10.741 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18707 2024-09-13T06:40:10.741 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:10.741 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:10.741 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:10.741 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:10.741 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846207+0000", 2024-09-13T06:40:10.741 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:10.741 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:10.741 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:10.741 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:10.741 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846207+0000", 2024-09-13T06:40:10.741 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:10.742 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:10.742 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:10.742 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:10.742 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846206+0000", 2024-09-13T06:40:10.742 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:10.742 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:10.742 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:10.742 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:10.742 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846211+0000", 2024-09-13T06:40:10.742 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.3000000000000003e-06 2024-09-13T06:40:10.742 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:10.742 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:10.742 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:10.742 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846220+0000", 2024-09-13T06:40:10.742 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6199999999999994e-06 2024-09-13T06:40:10.743 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:10.743 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:10.743 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:10.743 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846228+0000", 2024-09-13T06:40:10.743 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.7500000000000003e-06 2024-09-13T06:40:10.743 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:10.743 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:10.743 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:10.743 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.948267+0000", 2024-09-13T06:40:10.743 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10203878700000001 2024-09-13T06:40:10.743 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:10.743 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:10.743 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:10.743 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.948435+0000", 2024-09-13T06:40:10.744 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00016796500000000001 2024-09-13T06:40:10.744 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:10.744 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:10.744 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:10.744 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.948588+0000", 2024-09-13T06:40:10.744 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00015373599999999999 2024-09-13T06:40:10.744 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:10.744 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:10.744 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:10.744 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:10.744 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:10.744 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18718 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 3690496~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:40:10.744 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.850174+0000", 2024-09-13T06:40:10.745 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 18.886480082999999, 2024-09-13T06:40:10.745 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101854154, 2024-09-13T06:40:10.745 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:10.745 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:10.745 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:10.745 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:10.745 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:10.745 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18718 2024-09-13T06:40:10.745 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:10.745 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:10.745 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:10.745 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:10.745 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850174+0000", 2024-09-13T06:40:10.746 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:10.746 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:10.746 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:10.746 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:10.746 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850174+0000", 2024-09-13T06:40:10.746 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:10.746 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:10.746 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:10.746 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:10.746 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850173+0000", 2024-09-13T06:40:10.746 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:10.746 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:10.746 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:10.746 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:10.747 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850178+0000", 2024-09-13T06:40:10.747 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.4129999999999999e-06 2024-09-13T06:40:10.747 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:10.747 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:10.747 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:10.747 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850188+0000", 2024-09-13T06:40:10.747 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.8600000000000005e-06 2024-09-13T06:40:10.747 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:10.747 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:10.747 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:10.747 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850195+0000", 2024-09-13T06:40:10.747 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.8730000000000007e-06 2024-09-13T06:40:10.747 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:10.747 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:10.748 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:10.748 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.951766+0000", 2024-09-13T06:40:10.748 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.1015703 2024-09-13T06:40:10.748 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:10.748 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:10.748 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:10.748 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.951879+0000", 2024-09-13T06:40:10.748 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000112932 2024-09-13T06:40:10.748 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:10.748 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:10.748 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:10.748 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.952029+0000", 2024-09-13T06:40:10.748 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000149846 2024-09-13T06:40:10.748 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:10.749 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:10.749 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:10.749 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:10.749 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:10.749 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18719 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 3719168~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:40:10.749 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.850202+0000", 2024-09-13T06:40:10.749 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 18.886452040000002, 2024-09-13T06:40:10.749 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.102191676, 2024-09-13T06:40:10.749 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:10.749 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:10.749 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:10.749 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:10.749 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:10.750 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18719 2024-09-13T06:40:10.750 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:10.750 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:10.750 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:10.750 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:10.750 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850202+0000", 2024-09-13T06:40:10.750 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:10.750 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:10.750 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:10.750 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:10.750 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850202+0000", 2024-09-13T06:40:10.750 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:10.750 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:10.751 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:10.751 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:10.751 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850202+0000", 2024-09-13T06:40:10.751 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:10.751 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:10.751 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:10.751 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:10.751 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850205+0000", 2024-09-13T06:40:10.751 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.89e-06 2024-09-13T06:40:10.751 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:10.751 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:10.751 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:10.751 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850216+0000", 2024-09-13T06:40:10.751 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0233e-05 2024-09-13T06:40:10.751 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:10.752 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:10.752 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:10.752 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850223+0000", 2024-09-13T06:40:10.752 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5299999999999999e-06 2024-09-13T06:40:10.752 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:10.752 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:10.752 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:10.752 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.952106+0000", 2024-09-13T06:40:10.752 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10188309299999999 2024-09-13T06:40:10.752 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:10.752 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:10.752 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:10.752 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.952233+0000", 2024-09-13T06:40:10.752 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000126993 2024-09-13T06:40:10.752 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:10.753 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:10.753 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:10.753 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.952394+0000", 2024-09-13T06:40:10.753 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000160791 2024-09-13T06:40:10.753 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:10.753 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:10.753 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:10.753 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:10.753 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:10.753 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18720 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 3747840~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:40:10.753 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.850726+0000", 2024-09-13T06:40:10.753 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 18.885928211, 2024-09-13T06:40:10.753 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10199504299999999, 2024-09-13T06:40:10.754 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:10.754 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:10.754 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:10.754 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:10.754 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:10.754 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18720 2024-09-13T06:40:10.754 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:10.754 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:10.754 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:10.754 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:10.754 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850726+0000", 2024-09-13T06:40:10.754 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:10.754 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:10.754 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:10.754 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:10.754 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850726+0000", 2024-09-13T06:40:10.755 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:10.755 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:10.755 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:10.755 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:10.755 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850229+0000", 2024-09-13T06:40:10.755 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9995027 2024-09-13T06:40:10.755 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:10.755 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:10.755 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:10.755 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850731+0000", 2024-09-13T06:40:10.755 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00050221599999999999 2024-09-13T06:40:10.755 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:10.755 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:10.755 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:10.755 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850751+0000", 2024-09-13T06:40:10.756 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.9703000000000001e-05 2024-09-13T06:40:10.756 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:10.756 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:10.756 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:10.756 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850764+0000", 2024-09-13T06:40:10.756 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3207000000000001e-05 2024-09-13T06:40:10.756 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:10.756 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:10.756 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:10.756 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.952454+0000", 2024-09-13T06:40:10.756 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101690102 2024-09-13T06:40:10.756 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:10.756 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:10.757 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:10.757 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.952571+0000", 2024-09-13T06:40:10.757 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000116556 2024-09-13T06:40:10.757 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:10.757 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:10.757 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:10.757 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.952721+0000", 2024-09-13T06:40:10.757 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000150419 2024-09-13T06:40:10.757 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:10.757 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:10.757 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:10.757 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:10.757 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:10.757 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18730 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 4034560~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:40:10.758 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.854013+0000", 2024-09-13T06:40:10.758 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 18.882641270000001, 2024-09-13T06:40:10.758 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10186914399999999, 2024-09-13T06:40:10.758 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:10.758 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:10.758 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:10.758 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:10.758 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:10.758 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18730 2024-09-13T06:40:10.758 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:10.758 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:10.758 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:10.758 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:10.759 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.854013+0000", 2024-09-13T06:40:10.759 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:10.759 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:10.759 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:10.759 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:10.759 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.854013+0000", 2024-09-13T06:40:10.759 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:10.759 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:10.759 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:10.759 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:10.759 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.854013+0000", 2024-09-13T06:40:10.759 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:10.759 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:10.760 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:10.760 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:10.760 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.854016+0000", 2024-09-13T06:40:10.760 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.1839999999999999e-06 2024-09-13T06:40:10.760 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:10.760 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:10.760 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:10.760 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.854025+0000", 2024-09-13T06:40:10.760 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.8030000000000003e-06 2024-09-13T06:40:10.760 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:10.760 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:10.760 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:10.761 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.854033+0000", 2024-09-13T06:40:10.761 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6500000000000002e-06 2024-09-13T06:40:10.761 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:10.761 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:10.761 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:10.761 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.955546+0000", 2024-09-13T06:40:10.761 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10151296 2024-09-13T06:40:10.761 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:10.761 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:10.761 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:10.761 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.955694+0000", 2024-09-13T06:40:10.761 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000147773 2024-09-13T06:40:10.761 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:10.761 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:10.762 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:10.762 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.955882+0000", 2024-09-13T06:40:10.762 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000188371 2024-09-13T06:40:10.762 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:10.762 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:10.762 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:10.762 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:10.762 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:10.762 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18742 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 4378624~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:40:10.762 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.857984+0000", 2024-09-13T06:40:10.762 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 18.878670147000001, 2024-09-13T06:40:10.762 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10179961799999999, 2024-09-13T06:40:10.762 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:10.763 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:10.763 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:10.763 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:10.763 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:10.763 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18742 2024-09-13T06:40:10.763 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:10.763 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:10.763 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:10.763 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:10.763 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.857984+0000", 2024-09-13T06:40:10.763 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:10.763 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:10.763 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:10.764 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:10.764 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.857984+0000", 2024-09-13T06:40:10.764 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:10.764 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:10.764 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:10.764 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:10.764 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.857983+0000", 2024-09-13T06:40:10.764 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:10.764 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:10.764 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:10.764 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:10.764 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.857987+0000", 2024-09-13T06:40:10.764 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0670000000000002e-06 2024-09-13T06:40:10.765 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:10.765 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:10.765 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:10.765 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.857997+0000", 2024-09-13T06:40:10.765 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6830000000000003e-06 2024-09-13T06:40:10.765 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:10.765 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:10.765 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:10.765 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.858006+0000", 2024-09-13T06:40:10.765 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.5739999999999996e-06 2024-09-13T06:40:10.765 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:10.765 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:10.766 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:10.766 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.959453+0000", 2024-09-13T06:40:10.766 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101447339 2024-09-13T06:40:10.766 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:10.766 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:10.766 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:10.766 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.959603+0000", 2024-09-13T06:40:10.766 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000150316 2024-09-13T06:40:10.766 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:10.766 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:10.766 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:10.766 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.959784+0000", 2024-09-13T06:40:10.766 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00018065900000000001 2024-09-13T06:40:10.766 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:10.767 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:10.767 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:10.767 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:10.767 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:10.767 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18743 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 4407296~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:40:10.767 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.858012+0000", 2024-09-13T06:40:10.767 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 18.878642154000001, 2024-09-13T06:40:10.767 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10210024500000001, 2024-09-13T06:40:10.767 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:10.767 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:10.767 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:10.767 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:10.767 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:10.768 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18743 2024-09-13T06:40:10.768 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:10.768 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:10.768 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:10.768 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:10.768 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.858012+0000", 2024-09-13T06:40:10.768 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:10.768 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:10.768 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:10.768 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:10.768 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.858012+0000", 2024-09-13T06:40:10.768 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:10.769 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:10.769 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:10.769 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:10.769 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.858011+0000", 2024-09-13T06:40:10.769 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:10.769 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:10.769 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:10.769 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:10.769 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.858016+0000", 2024-09-13T06:40:10.769 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0659999999999997e-06 2024-09-13T06:40:10.769 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:10.769 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:10.769 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:10.770 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.858024+0000", 2024-09-13T06:40:10.770 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.7700000000000007e-06 2024-09-13T06:40:10.770 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:10.770 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:10.770 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:10.770 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.858032+0000", 2024-09-13T06:40:10.770 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.7700000000000001e-06 2024-09-13T06:40:10.770 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:10.770 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:10.770 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:10.770 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.959850+0000", 2024-09-13T06:40:10.770 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.1018182 2024-09-13T06:40:10.770 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:10.771 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:10.771 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:10.771 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.959964+0000", 2024-09-13T06:40:10.771 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00011413600000000001 2024-09-13T06:40:10.771 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:10.771 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:10.771 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:10.771 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.960113+0000", 2024-09-13T06:40:10.771 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00014813900000000001 2024-09-13T06:40:10.771 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:10.771 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:10.771 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:10.771 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:10.771 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:10.771 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18755 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 4751360~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:40:10.772 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.862061+0000", 2024-09-13T06:40:10.772 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 18.874593902000001, 2024-09-13T06:40:10.772 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101907023, 2024-09-13T06:40:10.772 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:10.772 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:10.772 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:10.772 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:10.772 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:10.772 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18755 2024-09-13T06:40:10.772 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:10.772 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:10.772 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:10.773 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:10.773 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862061+0000", 2024-09-13T06:40:10.773 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:10.773 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:10.773 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:10.773 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:10.773 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862061+0000", 2024-09-13T06:40:10.773 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:10.773 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:10.773 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:10.773 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:10.773 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862060+0000", 2024-09-13T06:40:10.773 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:10.774 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:10.774 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:10.774 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:10.774 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862064+0000", 2024-09-13T06:40:10.774 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.3229999999999999e-06 2024-09-13T06:40:10.774 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:10.774 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:10.774 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:10.774 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862078+0000", 2024-09-13T06:40:10.774 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.433e-05 2024-09-13T06:40:10.774 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:10.774 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:10.774 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:10.774 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862086+0000", 2024-09-13T06:40:10.774 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.3869999999999997e-06 2024-09-13T06:40:10.775 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:10.775 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:10.775 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:10.775 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.963635+0000", 2024-09-13T06:40:10.775 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101549606 2024-09-13T06:40:10.775 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:10.775 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:10.775 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:10.775 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.963783+0000", 2024-09-13T06:40:10.775 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000147312 2024-09-13T06:40:10.775 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:10.775 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:10.775 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:10.776 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.963968+0000", 2024-09-13T06:40:10.776 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000185028 2024-09-13T06:40:10.776 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:10.776 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:10.776 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:10.776 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:10.776 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:10.776 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18756 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 4780032~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:40:10.776 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.862132+0000", 2024-09-13T06:40:10.776 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 18.874522059, 2024-09-13T06:40:10.776 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.102159295, 2024-09-13T06:40:10.776 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:10.776 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:10.777 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:10.777 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:10.777 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:10.777 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18756 2024-09-13T06:40:10.777 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:10.777 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:10.777 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:10.777 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:10.777 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862132+0000", 2024-09-13T06:40:10.777 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:10.777 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:10.777 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:10.777 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:10.777 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862132+0000", 2024-09-13T06:40:10.777 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:10.777 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:10.778 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:10.778 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:10.778 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862132+0000", 2024-09-13T06:40:10.778 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:10.778 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:10.778 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:10.778 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:10.778 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862136+0000", 2024-09-13T06:40:10.778 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.9559999999999999e-06 2024-09-13T06:40:10.778 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:10.778 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:10.778 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:10.778 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862145+0000", 2024-09-13T06:40:10.778 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6169999999999996e-06 2024-09-13T06:40:10.778 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:10.779 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:10.779 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:10.779 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862153+0000", 2024-09-13T06:40:10.779 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.8359999999999992e-06 2024-09-13T06:40:10.779 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:10.779 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:10.779 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:10.779 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.964018+0000", 2024-09-13T06:40:10.779 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101865421 2024-09-13T06:40:10.779 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:10.779 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:10.779 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:10.779 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.964140+0000", 2024-09-13T06:40:10.779 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000121172 2024-09-13T06:40:10.779 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:10.780 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:10.780 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:10.780 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.964292+0000", 2024-09-13T06:40:10.780 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00015202600000000001 2024-09-13T06:40:10.780 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:10.780 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:10.780 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:10.780 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:10.780 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:10.780 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18768 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 5124096~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:40:10.780 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.866345+0000", 2024-09-13T06:40:10.780 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 18.870309752000001, 2024-09-13T06:40:10.780 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101779361, 2024-09-13T06:40:10.780 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:10.780 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:10.781 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:10.781 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:10.781 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:10.781 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18768 2024-09-13T06:40:10.781 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:10.781 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:10.781 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:10.781 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:10.781 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.866345+0000", 2024-09-13T06:40:10.781 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:10.781 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:10.781 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:10.781 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:10.781 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.866345+0000", 2024-09-13T06:40:10.781 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:10.782 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:10.782 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:10.782 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:10.782 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.866344+0000", 2024-09-13T06:40:10.782 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:10.782 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:10.782 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:10.782 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:10.782 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.866348+0000", 2024-09-13T06:40:10.782 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.4300000000000002e-06 2024-09-13T06:40:10.782 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:10.782 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:10.782 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:10.783 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.866356+0000", 2024-09-13T06:40:10.783 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.5930000000000006e-06 2024-09-13T06:40:10.783 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:10.783 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:10.783 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:10.783 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.866364+0000", 2024-09-13T06:40:10.783 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5599999999999996e-06 2024-09-13T06:40:10.783 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:10.783 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:10.783 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:10.783 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.967865+0000", 2024-09-13T06:40:10.783 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101501683 2024-09-13T06:40:10.784 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:10.784 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:10.784 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:10.784 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.967981+0000", 2024-09-13T06:40:10.784 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000115643 2024-09-13T06:40:10.784 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:10.784 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:10.784 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:10.784 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.968124+0000", 2024-09-13T06:40:10.784 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00014305500000000001 2024-09-13T06:40:10.784 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:10.784 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:10.784 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:10.785 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:10.785 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:10.785 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18779 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 5439488~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:40:10.785 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.869996+0000", 2024-09-13T06:40:10.785 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 18.866658867000002, 2024-09-13T06:40:10.785 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10189577399999999, 2024-09-13T06:40:10.785 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:10.785 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:10.785 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:10.785 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:10.785 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:10.785 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18779 2024-09-13T06:40:10.785 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:10.786 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:10.786 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:10.786 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:10.786 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.869996+0000", 2024-09-13T06:40:10.786 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:10.786 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:10.786 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:10.786 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:10.786 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.869996+0000", 2024-09-13T06:40:10.786 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:10.786 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:10.786 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:10.786 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:10.787 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.869995+0000", 2024-09-13T06:40:10.787 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:10.787 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:10.787 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:10.787 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:10.787 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.869998+0000", 2024-09-13T06:40:10.787 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.2729999999999998e-06 2024-09-13T06:40:10.787 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:10.787 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:10.787 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:10.787 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.870007+0000", 2024-09-13T06:40:10.787 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.5760000000000006e-06 2024-09-13T06:40:10.788 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:10.788 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:10.788 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:10.788 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.870014+0000", 2024-09-13T06:40:10.788 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.1400000000000002e-06 2024-09-13T06:40:10.788 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:10.788 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:10.788 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:10.788 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.971631+0000", 2024-09-13T06:40:10.788 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101617503 2024-09-13T06:40:10.788 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:10.788 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:10.788 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:10.789 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.971747+0000", 2024-09-13T06:40:10.789 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00011599600000000001 2024-09-13T06:40:10.789 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:10.789 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:10.789 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:10.789 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.971891+0000", 2024-09-13T06:40:10.789 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000143912 2024-09-13T06:40:10.789 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:10.789 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:10.789 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:10.789 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:10.789 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:10.790 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18792 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 5812224~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:40:10.790 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.874371+0000", 2024-09-13T06:40:10.790 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 18.862283736999998, 2024-09-13T06:40:10.790 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101736005, 2024-09-13T06:40:10.790 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:10.790 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:10.790 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:10.790 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:10.790 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:10.790 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18792 2024-09-13T06:40:10.790 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:10.790 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:10.790 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:10.791 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:10.791 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874371+0000", 2024-09-13T06:40:10.791 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:10.791 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:10.791 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:10.791 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:10.791 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874371+0000", 2024-09-13T06:40:10.791 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:10.791 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:10.791 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:10.791 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:10.791 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874370+0000", 2024-09-13T06:40:10.791 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:10.792 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:10.792 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:10.792 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:10.792 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874374+0000", 2024-09-13T06:40:10.792 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.7239999999999998e-06 2024-09-13T06:40:10.792 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:10.792 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:10.792 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:10.792 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874385+0000", 2024-09-13T06:40:10.792 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1293e-05 2024-09-13T06:40:10.792 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:10.792 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:10.792 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:10.793 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874394+0000", 2024-09-13T06:40:10.793 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.0729999999999994e-06 2024-09-13T06:40:10.793 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:10.793 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:10.793 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:10.793 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.975850+0000", 2024-09-13T06:40:10.793 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10145599700000001 2024-09-13T06:40:10.793 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:10.793 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:10.793 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:10.793 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.975963+0000", 2024-09-13T06:40:10.793 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000112689 2024-09-13T06:40:10.793 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:10.794 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:10.794 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:10.794 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.976107+0000", 2024-09-13T06:40:10.794 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000143836 2024-09-13T06:40:10.794 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:10.794 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:10.794 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:10.794 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:10.794 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:10.794 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18793 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 5840896~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:40:10.794 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.874401+0000", 2024-09-13T06:40:10.794 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 18.862253704, 2024-09-13T06:40:10.794 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.102005516, 2024-09-13T06:40:10.794 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:10.795 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:10.795 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:10.795 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:10.795 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:10.795 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18793 2024-09-13T06:40:10.795 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:10.795 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:10.795 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:10.795 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:10.795 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874401+0000", 2024-09-13T06:40:10.795 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:10.795 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:10.795 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:10.795 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:10.796 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874401+0000", 2024-09-13T06:40:10.796 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:10.796 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:10.796 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:10.796 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:10.796 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874400+0000", 2024-09-13T06:40:10.796 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:10.796 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:10.796 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:10.796 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:10.796 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874404+0000", 2024-09-13T06:40:10.796 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0069999999999999e-06 2024-09-13T06:40:10.796 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:10.796 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:10.797 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:10.797 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874412+0000", 2024-09-13T06:40:10.797 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.5399999999999996e-06 2024-09-13T06:40:10.797 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:10.797 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:10.797 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:10.797 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874420+0000", 2024-09-13T06:40:10.797 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.6199999999999999e-06 2024-09-13T06:40:10.797 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:10.797 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:10.797 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:10.797 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.976150+0000", 2024-09-13T06:40:10.797 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101729874 2024-09-13T06:40:10.797 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:10.798 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:10.798 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:10.798 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.976261+0000", 2024-09-13T06:40:10.798 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000110819 2024-09-13T06:40:10.798 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:10.798 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:10.798 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:10.798 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.976406+0000", 2024-09-13T06:40:10.798 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000145489 2024-09-13T06:40:10.798 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:10.798 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:10.798 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:10.798 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:10.799 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:10.799 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18803 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 6127616~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:40:10.799 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.877851+0000", 2024-09-13T06:40:10.799 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 18.858803211000001, 2024-09-13T06:40:10.799 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101951584, 2024-09-13T06:40:10.799 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:10.799 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:10.799 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:10.799 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:10.799 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:10.799 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18803 2024-09-13T06:40:10.799 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:10.799 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:10.799 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:10.800 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:10.800 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.877851+0000", 2024-09-13T06:40:10.800 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:10.800 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:10.800 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:10.800 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:10.800 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.877851+0000", 2024-09-13T06:40:10.800 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:10.800 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:10.800 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:10.800 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:10.800 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.877851+0000", 2024-09-13T06:40:10.800 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:10.801 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:10.801 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:10.801 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:10.801 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.877854+0000", 2024-09-13T06:40:10.801 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.7929999999999999e-06 2024-09-13T06:40:10.801 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:10.801 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:10.801 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:10.801 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.877864+0000", 2024-09-13T06:40:10.801 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.2029999999999998e-06 2024-09-13T06:40:10.801 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:10.801 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:10.801 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:10.801 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.877873+0000", 2024-09-13T06:40:10.802 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.0440000000000001e-06 2024-09-13T06:40:10.802 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:10.802 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:10.802 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:10.802 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.979544+0000", 2024-09-13T06:40:10.802 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101671198 2024-09-13T06:40:10.802 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:10.802 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:10.802 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:10.802 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.979658+0000", 2024-09-13T06:40:10.802 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000114456 2024-09-13T06:40:10.802 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:10.802 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:10.803 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:10.803 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.979803+0000", 2024-09-13T06:40:10.803 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000144506 2024-09-13T06:40:10.803 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:10.803 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:10.803 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:10.803 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:10.803 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:10.803 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18807 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 6242304~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:40:10.803 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.879235+0000", 2024-09-13T06:40:10.803 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 18.857419181000001, 2024-09-13T06:40:10.803 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101781258, 2024-09-13T06:40:10.803 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:10.803 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:10.804 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:10.804 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:10.804 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:10.804 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18807 2024-09-13T06:40:10.804 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:10.804 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:10.804 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:10.804 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:10.804 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879235+0000", 2024-09-13T06:40:10.804 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:10.804 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:10.804 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:10.804 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:10.805 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879235+0000", 2024-09-13T06:40:10.805 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:10.805 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:10.805 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:10.805 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:10.805 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879235+0000", 2024-09-13T06:40:10.805 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:10.805 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:10.805 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:10.805 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:10.805 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879239+0000", 2024-09-13T06:40:10.805 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.963e-06 2024-09-13T06:40:10.805 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:10.805 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:10.806 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:10.806 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879247+0000", 2024-09-13T06:40:10.806 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6470000000000004e-06 2024-09-13T06:40:10.806 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:10.806 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:10.806 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:10.806 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879255+0000", 2024-09-13T06:40:10.806 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5429999999999996e-06 2024-09-13T06:40:10.806 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:10.806 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:10.806 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:10.806 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.980756+0000", 2024-09-13T06:40:10.806 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10150165999999999 2024-09-13T06:40:10.806 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:10.807 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:10.807 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:10.807 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.980868+0000", 2024-09-13T06:40:10.807 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000111196 2024-09-13T06:40:10.807 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:10.807 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:10.807 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:10.807 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.981017+0000", 2024-09-13T06:40:10.807 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000148846 2024-09-13T06:40:10.807 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:10.807 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:10.807 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:10.807 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:10.807 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:10.808 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18808 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 6270976~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:40:10.808 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.879261+0000", 2024-09-13T06:40:10.808 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 18.857393041999998, 2024-09-13T06:40:10.808 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.102057547, 2024-09-13T06:40:10.808 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:10.808 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:10.808 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:10.808 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:10.808 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:10.808 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18808 2024-09-13T06:40:10.808 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:10.808 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:10.809 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:10.809 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:10.809 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879261+0000", 2024-09-13T06:40:10.809 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:10.809 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:10.809 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:10.809 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:10.809 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879261+0000", 2024-09-13T06:40:10.809 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:10.809 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:10.809 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:10.809 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:10.809 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879261+0000", 2024-09-13T06:40:10.810 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:10.810 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:10.810 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:10.810 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:10.810 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879264+0000", 2024-09-13T06:40:10.810 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.523e-06 2024-09-13T06:40:10.810 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:10.810 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:10.810 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:10.810 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879273+0000", 2024-09-13T06:40:10.810 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6070000000000008e-06 2024-09-13T06:40:10.810 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:10.810 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:10.811 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:10.811 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879280+0000", 2024-09-13T06:40:10.811 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.4699999999999996e-06 2024-09-13T06:40:10.811 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:10.811 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:10.811 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:10.811 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.981060+0000", 2024-09-13T06:40:10.811 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10177934800000001 2024-09-13T06:40:10.811 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:10.811 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:10.811 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:10.811 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.981174+0000", 2024-09-13T06:40:10.811 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000114456 2024-09-13T06:40:10.811 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:10.812 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:10.812 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:10.812 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.981319+0000", 2024-09-13T06:40:10.812 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00014473900000000001 2024-09-13T06:40:10.812 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:10.812 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:10.812 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:10.812 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:10.812 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:10.812 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18810 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 2662400~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:40:10.812 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.880386+0000", 2024-09-13T06:40:10.812 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 18.856268880000002, 2024-09-13T06:40:10.812 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101728022, 2024-09-13T06:40:10.813 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:10.813 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:10.813 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:10.813 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:10.813 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:10.813 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18810 2024-09-13T06:40:10.813 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:10.813 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:10.813 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:10.813 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:10.814 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880386+0000", 2024-09-13T06:40:10.814 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:10.814 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:10.814 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:10.814 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:10.814 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880386+0000", 2024-09-13T06:40:10.814 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:10.814 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:10.814 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:10.814 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:10.814 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880385+0000", 2024-09-13T06:40:10.814 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:10.814 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:10.815 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:10.815 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:10.815 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880389+0000", 2024-09-13T06:40:10.815 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.8539999999999999e-06 2024-09-13T06:40:10.815 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:10.815 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:10.815 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:10.815 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880398+0000", 2024-09-13T06:40:10.815 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.1689999999999998e-06 2024-09-13T06:40:10.815 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:10.815 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:10.815 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:10.815 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880405+0000", 2024-09-13T06:40:10.816 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5700000000000004e-06 2024-09-13T06:40:10.816 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:10.816 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:10.816 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:10.816 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.981833+0000", 2024-09-13T06:40:10.816 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10142791800000001 2024-09-13T06:40:10.816 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:10.816 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:10.816 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:10.816 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.981973+0000", 2024-09-13T06:40:10.816 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00014002900000000001 2024-09-13T06:40:10.816 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:10.816 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:10.816 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:10.817 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.982114+0000", 2024-09-13T06:40:10.817 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000140276 2024-09-13T06:40:10.817 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:10.817 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:10.817 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:10.817 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:10.817 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:10.817 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18811 3.9 3.140f5209 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:40:10.817 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.880449+0000", 2024-09-13T06:40:10.817 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 18.856205503999998, 2024-09-13T06:40:10.817 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101739355, 2024-09-13T06:40:10.817 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:10.817 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:40:10.818 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:10.818 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:10.818 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:10.818 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18811 2024-09-13T06:40:10.818 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:10.818 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:10.818 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:10.818 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:10.818 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880449+0000", 2024-09-13T06:40:10.818 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:10.818 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:10.818 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:10.818 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:10.818 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880449+0000", 2024-09-13T06:40:10.819 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:10.819 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:10.819 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:10.819 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:10.819 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880448+0000", 2024-09-13T06:40:10.819 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:10.819 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:10.819 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:10.819 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:10.819 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880452+0000", 2024-09-13T06:40:10.819 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0470000000000004e-06 2024-09-13T06:40:10.819 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:10.819 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:10.820 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:10.820 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880462+0000", 2024-09-13T06:40:10.820 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6530000000000006e-06 2024-09-13T06:40:10.820 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:10.820 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:10.820 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:10.820 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880472+0000", 2024-09-13T06:40:10.820 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0027000000000001e-05 2024-09-13T06:40:10.820 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:10.820 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:10.820 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:10.820 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.982172+0000", 2024-09-13T06:40:10.820 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10170043500000001 2024-09-13T06:40:10.820 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:10.821 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:10.821 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:10.821 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.982188+0000", 2024-09-13T06:40:10.821 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6172999999999999e-05 2024-09-13T06:40:10.821 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:10.821 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:10.821 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:10.821 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:10.821 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:10.821 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18812 3.9 3.140f5209 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:40:10.821 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.880478+0000", 2024-09-13T06:40:10.821 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 18.856176266999999, 2024-09-13T06:40:10.821 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10177795100000001, 2024-09-13T06:40:10.822 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:10.822 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:40:10.822 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:10.822 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:10.822 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:10.822 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18812 2024-09-13T06:40:10.822 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:10.822 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:10.822 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:10.822 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:10.822 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880478+0000", 2024-09-13T06:40:10.822 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:10.822 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:10.822 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:10.823 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:10.823 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880478+0000", 2024-09-13T06:40:10.823 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:10.823 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:10.823 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:10.823 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:10.823 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880477+0000", 2024-09-13T06:40:10.823 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:10.823 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:10.823 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:10.823 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:10.823 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880481+0000", 2024-09-13T06:40:10.823 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.827e-06 2024-09-13T06:40:10.824 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:10.824 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:10.824 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:10.824 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880490+0000", 2024-09-13T06:40:10.824 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6100000000000006e-06 2024-09-13T06:40:10.824 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:10.824 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:10.824 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:10.824 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880497+0000", 2024-09-13T06:40:10.824 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.7030000000000006e-06 2024-09-13T06:40:10.824 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:10.824 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:10.824 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:10.824 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.982241+0000", 2024-09-13T06:40:10.825 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10174351199999999 2024-09-13T06:40:10.825 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:10.825 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:10.825 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:10.825 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.982256+0000", 2024-09-13T06:40:10.825 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5143000000000001e-05 2024-09-13T06:40:10.825 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:10.825 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:10.825 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:10.825 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:10.825 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:10.825 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:40:10.827 INFO:teuthology.orchestra.run.smithi081.stdout:1342 punch from 0x311224a to 0x311380e, (0x15c4 bytes) 2024-09-13T06:40:10.827 INFO:teuthology.orchestra.run.smithi081.stdout:1343 read 0x7487d48 thru 0x74939ae (0xbc67 bytes) 2024-09-13T06:40:10.827 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:40:10.827 INFO:teuthology.orchestra.run.smithi081.stdout:1346 read 0x6e23717 thru 0x6e2dbd4 (0xa4be bytes) 2024-09-13T06:40:10.827 INFO:teuthology.orchestra.run.smithi081.stdout:1347 writesame 0x2238dc9 thru 0x22412b1 data_size 0x5(0x84e9 bytes) 2024-09-13T06:40:10.827 INFO:teuthology.orchestra.run.smithi081.stdout:1348 write 0x6c776f1 thru 0x6c7a66c (0x2f7c bytes) 2024-09-13T06:40:10.827 INFO:teuthology.orchestra.run.smithi081.stdout:1349 writesame 0x4192c91 thru 0x419d233 data_size 0x1(0xa5a3 bytes) 2024-09-13T06:40:10.828 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:40:10.828 INFO:teuthology.orchestra.run.smithi081.stdout: "success": "filestore_inject_stall = '' (not observed, change may require restart) " 2024-09-13T06:40:10.828 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:40:10.828 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-13T06:40:10.829 INFO:teuthology.orchestra.run.smithi081.stdout:1350 read 0x2f0962b thru 0x2f09ce0 (0x6b6 bytes) 2024-09-13T06:40:10.829 INFO:teuthology.orchestra.run.smithi081.stdout:1351 write 0x3f050e thru 0x3f95e0 (0x90d3 bytes) 2024-09-13T06:40:10.829 INFO:teuthology.orchestra.run.smithi081.stdout:1352 punch from 0x1873264 to 0x18778b1, (0x464d bytes) 2024-09-13T06:40:10.829 INFO:teuthology.orchestra.run.smithi081.stdout:1353 read 0x9cafff thru 0x9cd564 (0x2566 bytes) 2024-09-13T06:40:10.830 INFO:teuthology.orchestra.run.smithi081.stdout:1354 punch from 0x65334f6 to 0x653b52a, (0x8034 bytes) 2024-09-13T06:40:10.830 INFO:teuthology.orchestra.run.smithi081.stdout:1356 writesame 0x5f7103d thru 0x5f72b8c data_size 0x13(0x1b50 bytes) 2024-09-13T06:40:10.830 INFO:teuthology.orchestra.run.smithi081.stdout:1357 write 0x5b84b11 thru 0x5b86e76 (0x2366 bytes) 2024-09-13T06:40:10.831 INFO:teuthology.orchestra.run.smithi081.stdout:1358 read 0x7981ca5 thru 0x798ae10 (0x916c bytes) 2024-09-13T06:40:10.831 INFO:teuthology.orchestra.run.smithi081.stdout:1359 trunc from 0x8a18cf4 to 0xe491bfa 2024-09-13T06:40:10.831 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:40:10.826+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:40:10.835 INFO:teuthology.orchestra.run.smithi081.stdout:1361 trunc from 0xe491bfa to 0x508e449 2024-09-13T06:40:10.855 INFO:teuthology.orchestra.run.smithi081.stdout:1362 read 0x14ec258 thru 0x14ee21a (0x1fc3 bytes) 2024-09-13T06:40:10.856 INFO:teuthology.orchestra.run.smithi081.stdout:1363 read 0x4f5c41b thru 0x4f69948 (0xd52e bytes) 2024-09-13T06:40:10.857 INFO:teuthology.orchestra.run.smithi081.stdout:1366 read 0xf46eb thru 0xf92e4 (0x4bfa bytes) 2024-09-13T06:40:10.858 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:40:10.858 INFO:teuthology.orchestra.run.smithi081.stdout:1368 punch from 0x4b9c543 to 0x4baad44, (0xe801 bytes) 2024-09-13T06:40:10.859 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:40:10.861 INFO:teuthology.orchestra.run.smithi081.stdout:1370 trunc from 0x508e449 to 0x3a5e03d 2024-09-13T06:40:10.876 INFO:teuthology.orchestra.run.smithi081.stdout:1371 punch from 0x2322d36 to 0x233112f, (0xe3f9 bytes) 2024-09-13T06:40:10.876 INFO:teuthology.orchestra.run.smithi081.stdout:1372 write 0x232e609 thru 0x233d7b8 (0xf1b0 bytes) 2024-09-13T06:40:10.902 INFO:teuthology.orchestra.run.smithi081.stdout:1373 trunc from 0x3a5e03d to 0xdbc5d4f 2024-09-13T06:40:10.928 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:40:10.928+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:40:10.930 INFO:teuthology.orchestra.run.smithi081.stdout:1375 trunc from 0xdbc5d4f to 0x5649298 2024-09-13T06:40:10.967 INFO:teuthology.orchestra.run.smithi081.stdout:1376 write 0xaa1ac24 thru 0xaa292a4 (0xe681 bytes) 2024-09-13T06:40:10.983 INFO:teuthology.orchestra.run.smithi081.stdout:1377 trunc from 0xaa292a5 to 0xe3c72b3 2024-09-13T06:40:10.994 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:40:10.994 INFO:teuthology.orchestra.run.smithi081.stdout:1380 write 0x5a9e4ea thru 0x5a9f6f1 (0x1208 bytes) 2024-09-13T06:40:11.001 INFO:teuthology.orchestra.run.smithi081.stdout:truncating to largest ever: 0xedfdd6d 2024-09-13T06:40:11.003 INFO:teuthology.orchestra.run.smithi081.stdout:1381 trunc from 0xe3c72b3 to 0xedfdd6d 2024-09-13T06:40:11.007 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:40:11.008 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [], 2024-09-13T06:40:11.008 INFO:teuthology.orchestra.run.smithi139.stdout: "num_ops": 0 2024-09-13T06:40:11.008 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:40:11.015 INFO:teuthology.orchestra.run.smithi081.stdout:1382 read 0xddfdd63 thru 0xde0bb26 (0xddc4 bytes) 2024-09-13T06:40:11.016 INFO:teuthology.orchestra.run.smithi081.stdout:1383 read 0x13e2ca2 thru 0x13e5606 (0x2965 bytes) 2024-09-13T06:40:11.017 INFO:teuthology.orchestra.run.smithi081.stdout:1385 read 0xca9f83d thru 0xcaaccd1 (0xd495 bytes) 2024-09-13T06:40:11.018 INFO:teuthology.orchestra.run.smithi081.stdout:1386 read 0xc4df774 thru 0xc4e6aa1 (0x732e bytes) 2024-09-13T06:40:11.018 INFO:teuthology.orchestra.run.smithi081.stdout:1387 writesame 0x5771b20 thru 0x5777191 data_size 0x5(0x5672 bytes) 2024-09-13T06:40:11.023 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-13T06:40:11.026 INFO:teuthology.orchestra.run.smithi081.stdout:1388 read 0x5a700a0 thru 0x5a7c3f3 (0xc354 bytes) 2024-09-13T06:40:11.026 INFO:teuthology.orchestra.run.smithi081.stdout:1389 writesame 0xb980591 thru 0xb98a757 data_size 0x37(0xa1c7 bytes) 2024-09-13T06:40:11.028 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:40:11.030+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:40:11.033 INFO:teuthology.orchestra.run.smithi081.stdout:1392 write 0x54fd176 thru 0x5506aef (0x997a bytes) 2024-09-13T06:40:11.039 INFO:teuthology.orchestra.run.smithi081.stdout:1394 read 0x4a66c50 thru 0x4a763cb (0xf77c bytes) 2024-09-13T06:40:11.041 INFO:teuthology.orchestra.run.smithi081.stdout:1396 writesame 0x1021fc1 thru 0x10307f1 data_size 0x1(0xe831 bytes) 2024-09-13T06:40:11.093 INFO:teuthology.orchestra.run.smithi081.stdout:1397 write 0xcb92aa thru 0xcba61f (0x1376 bytes) 2024-09-13T06:40:11.095 INFO:teuthology.orchestra.run.smithi081.stdout:1398 write 0xdb8b7df thru 0xdb8eefa (0x371c bytes) 2024-09-13T06:40:11.102 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:40:11.102 INFO:teuthology.orchestra.run.smithi081.stdout:1400 punch from 0xe363ae8 to 0xe365e72, (0x238a bytes) 2024-09-13T06:40:11.102 INFO:teuthology.orchestra.run.smithi081.stdout:1402 write 0xc52c1bb thru 0xc52c1fd (0x43 bytes) 2024-09-13T06:40:11.105 INFO:teuthology.orchestra.run.smithi081.stdout:1403 writesame 0x5e176a7 thru 0x5e24775 data_size 0x1(0xd0cf bytes) 2024-09-13T06:40:11.130 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:40:11.130+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:40:11.163 INFO:teuthology.orchestra.run.smithi081.stdout:1404 read 0x75d3db8 thru 0x75d75dc (0x3825 bytes) 2024-09-13T06:40:11.163 INFO:teuthology.orchestra.run.smithi081.stdout:1405 read 0xc8a5e8d thru 0xc8b0452 (0xa5c6 bytes) 2024-09-13T06:40:11.164 INFO:teuthology.orchestra.run.smithi081.stdout:1407 write 0x5475deb thru 0x547d818 (0x7a2e bytes) 2024-09-13T06:40:11.167 INFO:teuthology.orchestra.run.smithi081.stdout:1408 write 0x19669c1 thru 0x1966ad4 (0x114 bytes) 2024-09-13T06:40:11.171 INFO:teuthology.orchestra.run.smithi081.stdout:1410 punch from 0x3ec96f to 0x3fae32, (0xe4c3 bytes) 2024-09-13T06:40:11.171 INFO:teuthology.orchestra.run.smithi081.stdout:1413 read 0xc9ca32c thru 0xc9d564b (0xb320 bytes) 2024-09-13T06:40:11.171 INFO:teuthology.orchestra.run.smithi081.stdout:1414 read 0x5f8739 thru 0x60586c (0xd134 bytes) 2024-09-13T06:40:11.172 INFO:teuthology.orchestra.run.smithi081.stdout:1415 read 0x7596f69 thru 0x759d455 (0x64ed bytes) 2024-09-13T06:40:11.172 INFO:teuthology.orchestra.run.smithi081.stdout:1416 write 0x81b6aea thru 0x81ba1e7 (0x36fe bytes) 2024-09-13T06:40:11.179 INFO:teuthology.orchestra.run.smithi081.stdout:1417 write 0x5db86c5 thru 0x5dc03f1 (0x7d2d bytes) 2024-09-13T06:40:11.183 INFO:teuthology.orchestra.run.smithi081.stdout:1418 punch from 0x36bacde to 0x36c406b, (0x938d bytes) 2024-09-13T06:40:11.183 INFO:teuthology.orchestra.run.smithi081.stdout:1419 writesame 0xa6bf2a4 thru 0xa6c9c62 data_size 0x5(0xa9bf bytes) 2024-09-13T06:40:11.198 INFO:teuthology.orchestra.run.smithi081.stdout:1421 punch from 0x13396c3 to 0x133d336, (0x3c73 bytes) 2024-09-13T06:40:11.198 INFO:teuthology.orchestra.run.smithi081.stdout:1423 read 0x237693b thru 0x2384140 (0xd806 bytes) 2024-09-13T06:40:11.200 INFO:teuthology.orchestra.run.smithi081.stdout:1425 writesame 0x6d5000b thru 0x6d57bc1 data_size 0x3(0x7bb7 bytes) 2024-09-13T06:40:11.205 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:40:11.205 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [], 2024-09-13T06:40:11.205 INFO:teuthology.orchestra.run.smithi139.stdout: "complaint_time": 30, 2024-09-13T06:40:11.205 INFO:teuthology.orchestra.run.smithi139.stdout: "num_blocked_ops": 0 2024-09-13T06:40:11.205 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:40:11.215 INFO:teuthology.orchestra.run.smithi081.stdout:1426 writesame 0x579e3d2 thru 0x57a4546 data_size 0x1(0x6175 bytes) 2024-09-13T06:40:11.220 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-13T06:40:11.239 INFO:teuthology.orchestra.run.smithi081.stdout:1427 read 0x43628fb thru 0x4365dba (0x34c0 bytes) 2024-09-13T06:40:11.265 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-13T06:40:11.268+0000 7f86a5f06640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26387) UID: 0 2024-09-13T06:40:11.270 INFO:teuthology.orchestra.run.smithi081.stdout:1428 trunc from 0xedfdd6d to 0x37c0baf 2024-09-13T06:40:11.297 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:40:11.316 INFO:teuthology.orchestra.run.smithi081.stdout:1430 write 0x69e5ab5 thru 0x69e7e69 (0x23b5 bytes) 2024-09-13T06:40:11.323 INFO:teuthology.orchestra.run.smithi081.stdout:1431 write 0x1572d1e thru 0x1581119 (0xe3fc bytes) 2024-09-13T06:40:11.332 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:40:11.333+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:40:11.346 INFO:teuthology.orchestra.run.smithi081.stdout:1433 write 0x9ad73c1 thru 0x9ae14e2 (0xa122 bytes) 2024-09-13T06:40:11.350 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:40:11.350 INFO:teuthology.orchestra.run.smithi139.stdout: "size": 20, 2024-09-13T06:40:11.350 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 600, 2024-09-13T06:40:11.350 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [ 2024-09-13T06:40:11.350 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.350 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:25885 3.1c 3:3da1e1c6:::rbd_data.1121f2c5ee81.0000000000000007:13 [read 212992~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:11.350 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.424640+0000", 2024-09-13T06:40:11.350 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 14.926849009, 2024-09-13T06:40:11.350 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.040449289999999999, 2024-09-13T06:40:11.350 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:11.351 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:11.351 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:11.351 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:11.351 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:11.351 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 25885 2024-09-13T06:40:11.351 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:11.351 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:11.351 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.351 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:11.351 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.424640+0000", 2024-09-13T06:40:11.351 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:11.351 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:11.351 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.352 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:11.352 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.424640+0000", 2024-09-13T06:40:11.352 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:11.352 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:11.352 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.352 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:11.352 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.424640+0000", 2024-09-13T06:40:11.352 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:11.352 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:11.352 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.352 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:11.352 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.424643+0000", 2024-09-13T06:40:11.352 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.19e-06 2024-09-13T06:40:11.353 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:11.353 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.353 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:11.353 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.424650+0000", 2024-09-13T06:40:11.353 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.1189999999999999e-06 2024-09-13T06:40:11.353 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:11.353 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.353 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:11.353 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.424656+0000", 2024-09-13T06:40:11.353 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.7780000000000004e-06 2024-09-13T06:40:11.353 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:11.353 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.354 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:11.354 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.464699+0000", 2024-09-13T06:40:11.354 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.040043792000000002 2024-09-13T06:40:11.354 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:11.354 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.354 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:11.354 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.464800+0000", 2024-09-13T06:40:11.354 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000100278 2024-09-13T06:40:11.354 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:11.354 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.354 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:11.354 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.465089+0000", 2024-09-13T06:40:11.354 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00028969800000000002 2024-09-13T06:40:11.355 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:11.355 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:11.355 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:11.355 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:11.355 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.355 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:25886 3.1c 3:3da1e1c6:::rbd_data.1121f2c5ee81.0000000000000007:13 [read 237568~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:11.355 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.424661+0000", 2024-09-13T06:40:11.355 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 14.926828645000001, 2024-09-13T06:40:11.355 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.040784316000000001, 2024-09-13T06:40:11.355 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:11.355 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:11.355 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:11.355 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:11.356 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:11.356 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 25886 2024-09-13T06:40:11.356 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:11.356 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:11.356 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.356 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:11.356 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.424661+0000", 2024-09-13T06:40:11.356 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:11.356 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:11.356 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.356 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:11.356 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.424661+0000", 2024-09-13T06:40:11.356 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:11.357 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:11.357 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.357 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:11.357 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.424660+0000", 2024-09-13T06:40:11.357 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:11.357 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:11.357 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.357 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:11.357 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.424672+0000", 2024-09-13T06:40:11.357 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1578e-05 2024-09-13T06:40:11.357 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:11.357 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.358 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:11.358 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.424680+0000", 2024-09-13T06:40:11.358 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.9489999999999996e-06 2024-09-13T06:40:11.358 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:11.358 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.358 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:11.358 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.424689+0000", 2024-09-13T06:40:11.358 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.0790000000000007e-06 2024-09-13T06:40:11.358 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:11.358 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.358 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:11.358 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.465128+0000", 2024-09-13T06:40:11.358 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.040438922000000002 2024-09-13T06:40:11.359 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:11.359 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.359 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:11.359 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.465210+0000", 2024-09-13T06:40:11.359 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.2853000000000001e-05 2024-09-13T06:40:11.359 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:11.359 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.359 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:11.359 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.465445+0000", 2024-09-13T06:40:11.359 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000234453 2024-09-13T06:40:11.359 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:11.359 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:11.359 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:11.360 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:11.360 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.360 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:25887 3.1c 3:3da1e1c6:::rbd_data.1121f2c5ee81.0000000000000007:13 [read 307200~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:11.360 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.425137+0000", 2024-09-13T06:40:11.360 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 14.926352324, 2024-09-13T06:40:11.360 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.040764531, 2024-09-13T06:40:11.360 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:11.360 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:11.360 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:11.360 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:11.360 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:11.360 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 25887 2024-09-13T06:40:11.360 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:11.361 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:11.361 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.361 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:11.361 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.425137+0000", 2024-09-13T06:40:11.361 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:11.361 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:11.361 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.361 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:11.361 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.425137+0000", 2024-09-13T06:40:11.361 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:11.361 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:11.361 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.362 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:11.362 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.425135+0000", 2024-09-13T06:40:11.362 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999986 2024-09-13T06:40:11.362 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:11.362 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.362 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:11.362 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.425160+0000", 2024-09-13T06:40:11.362 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.4423999999999999e-05 2024-09-13T06:40:11.362 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:11.362 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.362 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:11.362 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.425186+0000", 2024-09-13T06:40:11.362 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.6329000000000002e-05 2024-09-13T06:40:11.363 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:11.363 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.363 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:11.363 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.425201+0000", 2024-09-13T06:40:11.363 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5048000000000001e-05 2024-09-13T06:40:11.363 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:11.363 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.363 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:11.363 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.465483+0000", 2024-09-13T06:40:11.363 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.040281381999999998 2024-09-13T06:40:11.363 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:11.363 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.363 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:11.364 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.465575+0000", 2024-09-13T06:40:11.364 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.2794000000000006e-05 2024-09-13T06:40:11.364 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:11.364 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.364 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:11.364 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.465901+0000", 2024-09-13T06:40:11.364 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00032604900000000002 2024-09-13T06:40:11.364 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:11.364 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:11.364 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:11.364 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:11.364 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.364 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:25888 3.1c 3:3da1e1c6:::rbd_data.1121f2c5ee81.0000000000000007:13 [read 331776~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:11.365 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.425217+0000", 2024-09-13T06:40:11.365 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 14.926272578000001, 2024-09-13T06:40:11.365 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.041115250999999998, 2024-09-13T06:40:11.365 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:11.365 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:11.365 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:11.365 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:11.365 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:11.365 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 25888 2024-09-13T06:40:11.365 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:11.365 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:11.365 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.365 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:11.366 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.425217+0000", 2024-09-13T06:40:11.366 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:11.366 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:11.366 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.366 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:11.366 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.425217+0000", 2024-09-13T06:40:11.366 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:11.366 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:11.366 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.366 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:11.366 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.425215+0000", 2024-09-13T06:40:11.366 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:11.366 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:11.367 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.367 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:11.367 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.425222+0000", 2024-09-13T06:40:11.367 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.5830000000000003e-06 2024-09-13T06:40:11.367 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:11.367 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.367 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:11.367 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.425240+0000", 2024-09-13T06:40:11.367 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7914000000000002e-05 2024-09-13T06:40:11.367 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:11.367 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.367 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:11.367 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.425252+0000", 2024-09-13T06:40:11.368 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2170999999999999e-05 2024-09-13T06:40:11.368 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:11.368 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.368 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:11.368 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.465947+0000", 2024-09-13T06:40:11.368 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.040694755999999999 2024-09-13T06:40:11.368 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:11.368 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.368 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:11.368 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.466065+0000", 2024-09-13T06:40:11.368 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000117669 2024-09-13T06:40:11.368 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:11.368 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.369 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:11.369 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.466332+0000", 2024-09-13T06:40:11.369 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00026730500000000002 2024-09-13T06:40:11.369 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:11.369 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:11.369 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:11.369 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:11.369 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.369 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:25889 3.1c 3:3da1e1c6:::rbd_data.1121f2c5ee81.0000000000000007:13 [read 376832~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:11.369 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.425262+0000", 2024-09-13T06:40:11.369 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 14.926226666, 2024-09-13T06:40:11.369 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.041487885000000002, 2024-09-13T06:40:11.369 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:11.370 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:11.370 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:11.370 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:11.370 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:11.370 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 25889 2024-09-13T06:40:11.370 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:11.370 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:11.370 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.370 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:11.370 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.425262+0000", 2024-09-13T06:40:11.370 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:11.370 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:11.370 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.370 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:11.371 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.425262+0000", 2024-09-13T06:40:11.371 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:11.371 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:11.371 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.371 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:11.371 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.425262+0000", 2024-09-13T06:40:11.371 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:11.371 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:11.371 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.371 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:11.371 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.425267+0000", 2024-09-13T06:40:11.371 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.587e-06 2024-09-13T06:40:11.372 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:11.372 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.372 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:11.372 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.425284+0000", 2024-09-13T06:40:11.372 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6858999999999999e-05 2024-09-13T06:40:11.372 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:11.372 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.372 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:11.372 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.425295+0000", 2024-09-13T06:40:11.372 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1238e-05 2024-09-13T06:40:11.372 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:11.372 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.372 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:11.373 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.466371+0000", 2024-09-13T06:40:11.373 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.041075381000000001 2024-09-13T06:40:11.373 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:11.373 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.373 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:11.373 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.466479+0000", 2024-09-13T06:40:11.373 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000108026 2024-09-13T06:40:11.373 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:11.373 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.373 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:11.373 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.466750+0000", 2024-09-13T06:40:11.373 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00027173200000000001 2024-09-13T06:40:11.374 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:11.374 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:11.374 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:11.374 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:11.374 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.374 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:25890 3.1c 3:3da1e1c6:::rbd_data.1121f2c5ee81.0000000000000007:13 [read 401408~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:11.374 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.425305+0000", 2024-09-13T06:40:11.374 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 14.926184134, 2024-09-13T06:40:11.374 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.041642419999999999, 2024-09-13T06:40:11.374 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:11.374 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:11.374 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:11.374 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:11.374 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:11.375 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 25890 2024-09-13T06:40:11.375 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:11.375 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:11.375 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.375 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:11.375 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.425305+0000", 2024-09-13T06:40:11.375 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:11.375 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:11.375 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.375 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:11.375 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.425305+0000", 2024-09-13T06:40:11.375 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:11.376 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:11.376 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.376 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:11.376 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.425304+0000", 2024-09-13T06:40:11.376 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:11.376 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:11.376 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.376 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:11.376 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.425309+0000", 2024-09-13T06:40:11.376 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.0640000000000001e-06 2024-09-13T06:40:11.376 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:11.376 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.376 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:11.377 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.425326+0000", 2024-09-13T06:40:11.377 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6855e-05 2024-09-13T06:40:11.377 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:11.377 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.377 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:11.377 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.425346+0000", 2024-09-13T06:40:11.377 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.0387999999999999e-05 2024-09-13T06:40:11.377 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:11.377 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.377 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:11.377 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.466796+0000", 2024-09-13T06:40:11.377 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.041449062000000002 2024-09-13T06:40:11.377 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:11.378 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.378 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:11.378 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.466859+0000", 2024-09-13T06:40:11.378 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.3682000000000005e-05 2024-09-13T06:40:11.378 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:11.378 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.378 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:11.378 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.466947+0000", 2024-09-13T06:40:11.378 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.8220999999999994e-05 2024-09-13T06:40:11.378 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:11.378 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:11.378 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:11.378 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:11.379 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.379 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:25891 3.1c 3:3da1e1c6:::rbd_data.1121f2c5ee81.0000000000000007:13 [read 471040~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:11.379 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.425357+0000", 2024-09-13T06:40:11.379 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 14.926132264, 2024-09-13T06:40:11.379 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.042016413000000002, 2024-09-13T06:40:11.379 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:11.379 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:11.379 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:11.379 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:11.379 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:11.379 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 25891 2024-09-13T06:40:11.379 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:11.379 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:11.380 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.380 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:11.380 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.425357+0000", 2024-09-13T06:40:11.380 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:11.380 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:11.380 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.380 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:11.380 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.425357+0000", 2024-09-13T06:40:11.380 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:11.380 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:11.380 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.380 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:11.380 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.425356+0000", 2024-09-13T06:40:11.381 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:11.381 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:11.381 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.381 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:11.381 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.425361+0000", 2024-09-13T06:40:11.381 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.2340000000000002e-06 2024-09-13T06:40:11.381 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:11.381 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.381 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:11.381 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.425377+0000", 2024-09-13T06:40:11.381 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6087e-05 2024-09-13T06:40:11.381 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:11.381 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.382 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:11.382 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.425391+0000", 2024-09-13T06:40:11.382 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3580999999999999e-05 2024-09-13T06:40:11.382 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:11.382 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.382 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:11.382 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.466995+0000", 2024-09-13T06:40:11.382 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.041604527000000002 2024-09-13T06:40:11.382 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:11.382 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.382 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:11.382 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.467100+0000", 2024-09-13T06:40:11.383 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00010417299999999999 2024-09-13T06:40:11.383 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:11.383 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.383 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:11.383 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.467373+0000", 2024-09-13T06:40:11.383 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00027376800000000003 2024-09-13T06:40:11.383 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:11.383 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:11.383 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:11.383 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:11.383 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.383 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:25892 3.1c 3:3da1e1c6:::rbd_data.1121f2c5ee81.0000000000000007:13 [read 495616~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:11.383 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.425401+0000", 2024-09-13T06:40:11.383 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 14.926088213, 2024-09-13T06:40:11.384 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.042422195000000003, 2024-09-13T06:40:11.384 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:11.384 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:11.384 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:11.384 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:11.384 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:11.384 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 25892 2024-09-13T06:40:11.384 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:11.384 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:11.385 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.385 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:11.385 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.425401+0000", 2024-09-13T06:40:11.385 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:11.385 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:11.385 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.385 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:11.385 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.425401+0000", 2024-09-13T06:40:11.385 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:11.385 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:11.385 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.385 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:11.385 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.425400+0000", 2024-09-13T06:40:11.386 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:11.386 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:11.386 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.386 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:11.386 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.425405+0000", 2024-09-13T06:40:11.386 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.4389999999999999e-06 2024-09-13T06:40:11.386 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:11.386 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.386 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:11.386 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.425419+0000", 2024-09-13T06:40:11.386 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3593e-05 2024-09-13T06:40:11.386 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:11.386 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.387 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:11.387 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.425430+0000", 2024-09-13T06:40:11.387 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0774999999999999e-05 2024-09-13T06:40:11.387 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:11.387 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.387 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:11.387 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.467438+0000", 2024-09-13T06:40:11.387 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.042008570000000002 2024-09-13T06:40:11.387 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:11.387 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.387 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:11.387 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.467531+0000", 2024-09-13T06:40:11.387 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.2857999999999998e-05 2024-09-13T06:40:11.388 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:11.388 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.388 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:11.388 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.467823+0000", 2024-09-13T06:40:11.388 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000291945 2024-09-13T06:40:11.388 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:11.388 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:11.388 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:11.388 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:11.388 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.388 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:26020 3.c 3:3566b607:::rbd_data.1121f2c5ee81.0000000000000012:13 [read 155648~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:11.388 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.429006+0000", 2024-09-13T06:40:11.388 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 14.922483588, 2024-09-13T06:40:11.389 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.040033945000000001, 2024-09-13T06:40:11.389 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:11.389 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:11.389 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:11.389 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:11.389 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:11.389 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 26020 2024-09-13T06:40:11.389 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:11.389 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:11.389 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.389 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:11.389 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.429006+0000", 2024-09-13T06:40:11.390 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:11.390 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:11.390 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.390 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:11.390 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.429006+0000", 2024-09-13T06:40:11.390 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:11.390 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:11.390 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.390 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:11.390 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.429005+0000", 2024-09-13T06:40:11.390 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:11.390 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:11.390 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.391 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:11.391 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.429010+0000", 2024-09-13T06:40:11.391 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.079e-06 2024-09-13T06:40:11.391 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:11.391 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.391 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:11.391 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.429023+0000", 2024-09-13T06:40:11.391 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3366e-05 2024-09-13T06:40:11.391 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:11.391 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.391 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:11.391 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.429033+0000", 2024-09-13T06:40:11.391 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6930000000000002e-06 2024-09-13T06:40:11.392 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:11.392 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.392 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:11.392 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.468710+0000", 2024-09-13T06:40:11.392 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039676808000000001 2024-09-13T06:40:11.392 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:11.392 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.392 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:11.392 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.468826+0000", 2024-09-13T06:40:11.392 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000116251 2024-09-13T06:40:11.392 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:11.392 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.392 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:11.393 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.469040+0000", 2024-09-13T06:40:11.393 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00021363 2024-09-13T06:40:11.393 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:11.393 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:11.393 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:11.393 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:11.393 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.393 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:26021 3.c 3:3566b607:::rbd_data.1121f2c5ee81.0000000000000012:13 [read 225280~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:11.393 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.429042+0000", 2024-09-13T06:40:11.393 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 14.922447202000001, 2024-09-13T06:40:11.393 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.040384481, 2024-09-13T06:40:11.393 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:11.394 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:11.394 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:11.394 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:11.394 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:11.394 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 26021 2024-09-13T06:40:11.394 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:11.394 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:11.394 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.394 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:11.394 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.429042+0000", 2024-09-13T06:40:11.394 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:11.394 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:11.394 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.395 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:11.395 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.429042+0000", 2024-09-13T06:40:11.395 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:11.395 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:11.395 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.395 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:11.395 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.429041+0000", 2024-09-13T06:40:11.395 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:11.395 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:11.395 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.395 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:11.395 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.429046+0000", 2024-09-13T06:40:11.395 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.6600000000000003e-06 2024-09-13T06:40:11.396 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:11.396 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.396 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:11.396 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.429060+0000", 2024-09-13T06:40:11.396 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3747000000000001e-05 2024-09-13T06:40:11.396 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:11.396 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.396 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:11.396 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.429069+0000", 2024-09-13T06:40:11.396 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.5659999999999996e-06 2024-09-13T06:40:11.396 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:11.396 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.397 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:11.397 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.469091+0000", 2024-09-13T06:40:11.397 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.040021811999999997 2024-09-13T06:40:11.397 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:11.397 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.397 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:11.397 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.469170+0000", 2024-09-13T06:40:11.397 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.9498000000000004e-05 2024-09-13T06:40:11.397 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:11.397 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.397 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:11.397 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.469426+0000", 2024-09-13T06:40:11.397 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00025596800000000003 2024-09-13T06:40:11.397 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:11.398 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:11.398 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:11.398 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:11.398 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.398 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:26022 3.c 3:3566b607:::rbd_data.1121f2c5ee81.0000000000000012:13 [read 249856~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:11.398 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.429079+0000", 2024-09-13T06:40:11.398 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 14.92241061, 2024-09-13T06:40:11.398 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.040733327, 2024-09-13T06:40:11.398 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:11.398 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:11.398 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:11.398 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:11.398 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:11.399 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 26022 2024-09-13T06:40:11.399 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:11.399 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:11.399 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.399 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:11.399 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.429079+0000", 2024-09-13T06:40:11.399 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:11.399 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:11.399 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.399 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:11.399 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.429079+0000", 2024-09-13T06:40:11.400 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:11.400 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:11.400 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.400 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:11.400 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.429078+0000", 2024-09-13T06:40:11.400 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:11.400 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:11.400 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.400 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:11.400 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.429083+0000", 2024-09-13T06:40:11.401 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.8069999999999999e-06 2024-09-13T06:40:11.401 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:11.401 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.401 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:11.401 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.429096+0000", 2024-09-13T06:40:11.401 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3665e-05 2024-09-13T06:40:11.401 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:11.401 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.401 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:11.401 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.429106+0000", 2024-09-13T06:40:11.401 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.8460000000000003e-06 2024-09-13T06:40:11.401 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:11.402 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.402 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:11.402 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.469479+0000", 2024-09-13T06:40:11.402 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.04037259 2024-09-13T06:40:11.402 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:11.402 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.402 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:11.402 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.469564+0000", 2024-09-13T06:40:11.402 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.5669999999999998e-05 2024-09-13T06:40:11.402 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:11.402 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.402 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:11.402 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.469812+0000", 2024-09-13T06:40:11.402 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00024753699999999998 2024-09-13T06:40:11.403 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:11.403 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:11.403 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:11.403 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:11.403 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.403 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:26023 3.c 3:3566b607:::rbd_data.1121f2c5ee81.0000000000000012:13 [read 294912~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:11.403 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.429115+0000", 2024-09-13T06:40:11.403 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 14.922374190999999, 2024-09-13T06:40:11.403 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.041079490000000003, 2024-09-13T06:40:11.403 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:11.403 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:11.403 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:11.403 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:11.404 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:11.404 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 26023 2024-09-13T06:40:11.404 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:11.404 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:11.404 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.404 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:11.404 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.429115+0000", 2024-09-13T06:40:11.404 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:11.404 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:11.404 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.404 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:11.404 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.429115+0000", 2024-09-13T06:40:11.404 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:11.405 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:11.405 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.405 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:11.405 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.429114+0000", 2024-09-13T06:40:11.405 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:11.405 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:11.405 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.405 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:11.405 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.429119+0000", 2024-09-13T06:40:11.405 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.0189999999999997e-06 2024-09-13T06:40:11.405 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:11.405 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.406 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:11.406 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.429137+0000", 2024-09-13T06:40:11.406 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.8087000000000001e-05 2024-09-13T06:40:11.406 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:11.406 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.406 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:11.406 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.429148+0000", 2024-09-13T06:40:11.406 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0740999999999999e-05 2024-09-13T06:40:11.406 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:11.406 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.406 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:11.406 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.469861+0000", 2024-09-13T06:40:11.406 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.040713271000000002 2024-09-13T06:40:11.407 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:11.407 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.407 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:11.407 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.469954+0000", 2024-09-13T06:40:11.407 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.2917000000000005e-05 2024-09-13T06:40:11.407 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:11.407 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.407 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:11.407 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.470194+0000", 2024-09-13T06:40:11.407 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00024033099999999999 2024-09-13T06:40:11.407 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:11.407 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:11.407 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:11.408 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:11.408 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.408 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:26024 3.c 3:3566b607:::rbd_data.1121f2c5ee81.0000000000000012:13 [read 319488~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:11.408 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.429157+0000", 2024-09-13T06:40:11.408 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 14.922331661999999, 2024-09-13T06:40:11.408 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.041386232000000002, 2024-09-13T06:40:11.408 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:11.408 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:11.408 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:11.408 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:11.408 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:11.408 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 26024 2024-09-13T06:40:11.408 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:11.408 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:11.409 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.409 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:11.409 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.429157+0000", 2024-09-13T06:40:11.409 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:11.409 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:11.409 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.409 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:11.409 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.429157+0000", 2024-09-13T06:40:11.409 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:11.409 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:11.409 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.409 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:11.409 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.429157+0000", 2024-09-13T06:40:11.410 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:11.410 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:11.410 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.410 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:11.410 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.429162+0000", 2024-09-13T06:40:11.410 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.3820000000000003e-06 2024-09-13T06:40:11.410 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:11.410 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.410 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:11.410 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.429175+0000", 2024-09-13T06:40:11.410 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2797e-05 2024-09-13T06:40:11.410 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:11.411 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.411 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:11.411 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.429185+0000", 2024-09-13T06:40:11.411 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0016e-05 2024-09-13T06:40:11.411 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:11.411 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.411 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:11.411 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.470233+0000", 2024-09-13T06:40:11.411 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.041047868000000001 2024-09-13T06:40:11.411 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:11.411 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.411 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:11.411 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.470280+0000", 2024-09-13T06:40:11.412 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.7422000000000001e-05 2024-09-13T06:40:11.412 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:11.412 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.412 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:11.412 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.470544+0000", 2024-09-13T06:40:11.412 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00026366399999999999 2024-09-13T06:40:11.412 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:11.412 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:11.412 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:11.412 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:11.412 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.412 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:26025 3.c 3:3566b607:::rbd_data.1121f2c5ee81.0000000000000012:13 [read 389120~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:11.413 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.429194+0000", 2024-09-13T06:40:11.413 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 14.922295301, 2024-09-13T06:40:11.413 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.041722952000000001, 2024-09-13T06:40:11.413 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:11.413 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:11.413 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:11.413 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:11.413 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:11.413 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 26025 2024-09-13T06:40:11.413 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:11.413 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:11.413 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.413 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:11.414 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.429194+0000", 2024-09-13T06:40:11.414 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:11.414 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:11.414 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.414 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:11.414 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.429194+0000", 2024-09-13T06:40:11.414 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:11.414 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:11.414 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.414 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:11.414 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.429193+0000", 2024-09-13T06:40:11.414 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:11.414 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:11.415 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.415 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:11.415 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.429206+0000", 2024-09-13T06:40:11.415 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3008e-05 2024-09-13T06:40:11.415 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:11.415 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.415 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:11.415 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.429220+0000", 2024-09-13T06:40:11.415 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.4398e-05 2024-09-13T06:40:11.415 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:11.415 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.415 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:11.416 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.429230+0000", 2024-09-13T06:40:11.416 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.4280000000000002e-06 2024-09-13T06:40:11.416 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:11.416 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.416 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:11.416 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.470584+0000", 2024-09-13T06:40:11.416 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.041354512000000003 2024-09-13T06:40:11.416 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:11.416 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.416 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:11.416 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.470648+0000", 2024-09-13T06:40:11.416 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.3163999999999994e-05 2024-09-13T06:40:11.416 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:11.417 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.417 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:11.417 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.470917+0000", 2024-09-13T06:40:11.417 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00026928199999999997 2024-09-13T06:40:11.417 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:11.417 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:11.417 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:11.417 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:11.417 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.417 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:26026 3.c 3:3566b607:::rbd_data.1121f2c5ee81.0000000000000012:13 [read 413696~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:11.417 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.429240+0000", 2024-09-13T06:40:11.417 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 14.922249313, 2024-09-13T06:40:11.418 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.041996092999999998, 2024-09-13T06:40:11.418 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:11.418 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:11.418 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:11.418 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:11.418 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:11.418 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 26026 2024-09-13T06:40:11.418 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:11.418 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:11.418 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.418 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:11.418 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.429240+0000", 2024-09-13T06:40:11.418 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:11.419 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:11.419 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.419 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:11.419 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.429240+0000", 2024-09-13T06:40:11.419 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:11.419 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:11.419 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.419 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:11.419 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.429239+0000", 2024-09-13T06:40:11.419 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:11.419 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:11.419 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.419 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:11.420 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.429244+0000", 2024-09-13T06:40:11.420 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.0989999999999998e-06 2024-09-13T06:40:11.420 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:11.420 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.420 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:11.420 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.429257+0000", 2024-09-13T06:40:11.420 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.296e-05 2024-09-13T06:40:11.420 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:11.420 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.420 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:11.420 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.429268+0000", 2024-09-13T06:40:11.420 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0971999999999999e-05 2024-09-13T06:40:11.420 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:11.421 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.421 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:11.421 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.470962+0000", 2024-09-13T06:40:11.421 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.041694426 2024-09-13T06:40:11.421 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:11.421 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.421 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:11.421 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.471024+0000", 2024-09-13T06:40:11.421 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.1741000000000004e-05 2024-09-13T06:40:11.421 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:11.421 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.421 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:11.421 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.471236+0000", 2024-09-13T06:40:11.422 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00021181100000000001 2024-09-13T06:40:11.422 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:11.422 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:11.422 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:11.422 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:11.422 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.422 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:26146 3.1c 3:3da1e1c6:::rbd_data.1121f2c5ee81.0000000000000007:13 [read 425984~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:11.422 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.434603+0000", 2024-09-13T06:40:11.422 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 14.916885816000001, 2024-09-13T06:40:11.422 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.040125802000000002, 2024-09-13T06:40:11.422 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:11.422 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:11.422 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:11.423 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:11.423 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:11.423 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 26146 2024-09-13T06:40:11.423 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:11.423 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:11.423 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.423 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:11.423 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.434603+0000", 2024-09-13T06:40:11.423 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:11.423 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:11.423 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.423 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:11.423 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.434603+0000", 2024-09-13T06:40:11.424 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:11.424 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:11.424 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.424 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:11.424 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.434602+0000", 2024-09-13T06:40:11.424 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999986 2024-09-13T06:40:11.424 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:11.424 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.424 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:11.424 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.434609+0000", 2024-09-13T06:40:11.424 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.1380000000000001e-06 2024-09-13T06:40:11.424 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:11.424 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.425 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:11.425 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.434621+0000", 2024-09-13T06:40:11.425 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2164000000000001e-05 2024-09-13T06:40:11.425 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:11.425 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.425 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:11.425 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.434629+0000", 2024-09-13T06:40:11.425 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.0669999999999992e-06 2024-09-13T06:40:11.425 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:11.425 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.425 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:11.425 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.474400+0000", 2024-09-13T06:40:11.425 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039770755999999997 2024-09-13T06:40:11.426 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:11.426 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.426 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:11.426 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.474483+0000", 2024-09-13T06:40:11.426 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.3238000000000005e-05 2024-09-13T06:40:11.426 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:11.426 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.426 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:11.426 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.474729+0000", 2024-09-13T06:40:11.426 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00024571499999999997 2024-09-13T06:40:11.426 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:11.426 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:11.426 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:11.427 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:11.427 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.427 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:26147 3.1c 3:3da1e1c6:::rbd_data.1121f2c5ee81.0000000000000007:13 [read 450560~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:11.427 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.434635+0000", 2024-09-13T06:40:11.427 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 14.916854366000001, 2024-09-13T06:40:11.427 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.040501387, 2024-09-13T06:40:11.427 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:11.427 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:11.427 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:11.427 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:11.427 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:11.427 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 26147 2024-09-13T06:40:11.427 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:11.427 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:11.428 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.428 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:11.428 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.434635+0000", 2024-09-13T06:40:11.428 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:11.428 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:11.428 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.428 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:11.428 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.434635+0000", 2024-09-13T06:40:11.428 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:11.428 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:11.428 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.428 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:11.428 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.434634+0000", 2024-09-13T06:40:11.429 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:11.429 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:11.429 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.429 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:11.429 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.434637+0000", 2024-09-13T06:40:11.429 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.0180000000000002e-06 2024-09-13T06:40:11.429 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:11.429 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.429 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:11.429 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.434643+0000", 2024-09-13T06:40:11.429 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.5380000000000002e-06 2024-09-13T06:40:11.429 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:11.429 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.430 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:11.430 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.434647+0000", 2024-09-13T06:40:11.430 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.5379999999999996e-06 2024-09-13T06:40:11.430 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:11.430 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.430 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:11.430 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.474784+0000", 2024-09-13T06:40:11.430 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.040136731000000002 2024-09-13T06:40:11.430 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:11.430 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.430 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:11.430 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.474879+0000", 2024-09-13T06:40:11.430 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.5274999999999998e-05 2024-09-13T06:40:11.431 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:11.431 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.431 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:11.431 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.475136+0000", 2024-09-13T06:40:11.431 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00025693999999999999 2024-09-13T06:40:11.431 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:11.431 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:11.431 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:11.431 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:11.431 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.431 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:26148 3.1c 3:3da1e1c6:::rbd_data.1121f2c5ee81.0000000000000007:13 [read 520192~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:11.431 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.434651+0000", 2024-09-13T06:40:11.432 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 14.916837866, 2024-09-13T06:40:11.432 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.040853773000000003, 2024-09-13T06:40:11.432 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:11.432 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:11.432 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:11.432 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:11.432 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:11.432 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 26148 2024-09-13T06:40:11.432 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:11.432 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:11.432 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.432 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:11.432 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.434651+0000", 2024-09-13T06:40:11.432 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:11.433 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:11.433 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.433 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:11.433 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.434651+0000", 2024-09-13T06:40:11.433 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:11.433 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:11.433 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.433 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:11.433 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.434651+0000", 2024-09-13T06:40:11.433 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:11.433 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:11.433 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.433 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:11.434 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.434653+0000", 2024-09-13T06:40:11.434 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.4509999999999999e-06 2024-09-13T06:40:11.434 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:11.434 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.434 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:11.434 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.434659+0000", 2024-09-13T06:40:11.434 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.1930000000000001e-06 2024-09-13T06:40:11.434 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:11.434 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.434 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:11.434 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.434664+0000", 2024-09-13T06:40:11.434 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.7400000000000001e-06 2024-09-13T06:40:11.434 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:11.435 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.435 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:11.435 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.475194+0000", 2024-09-13T06:40:11.435 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.040530123000000001 2024-09-13T06:40:11.435 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:11.435 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.435 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:11.435 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.475300+0000", 2024-09-13T06:40:11.435 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000106 2024-09-13T06:40:11.435 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:11.435 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.435 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:11.435 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.475505+0000", 2024-09-13T06:40:11.436 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00020465199999999999 2024-09-13T06:40:11.436 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:11.436 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:11.436 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:11.436 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:11.436 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.436 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:28049 3.1d 3:b83606fe:::rbd_data.1121f2c5ee81.000000000000001b:13 [read 475136~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:11.436 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.661622+0000", 2024-09-13T06:40:11.436 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 14.689866983, 2024-09-13T06:40:11.436 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.040354183000000002, 2024-09-13T06:40:11.436 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:11.436 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:11.436 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:11.437 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:11.437 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:11.437 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 28049 2024-09-13T06:40:11.437 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:11.437 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:11.437 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.437 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:11.437 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.661622+0000", 2024-09-13T06:40:11.437 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:11.437 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:11.437 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.437 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:11.437 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.661622+0000", 2024-09-13T06:40:11.437 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:11.438 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:11.438 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.438 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:11.438 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.661621+0000", 2024-09-13T06:40:11.438 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999986 2024-09-13T06:40:11.438 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:11.438 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.438 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:11.438 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.661627+0000", 2024-09-13T06:40:11.438 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.2450000000000003e-06 2024-09-13T06:40:11.438 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:11.438 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.438 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:11.438 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.661643+0000", 2024-09-13T06:40:11.439 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5860999999999999e-05 2024-09-13T06:40:11.439 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:11.439 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.439 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:11.439 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.661656+0000", 2024-09-13T06:40:11.439 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3524e-05 2024-09-13T06:40:11.439 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:11.439 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.439 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:11.439 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.701307+0000", 2024-09-13T06:40:11.439 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039650336000000001 2024-09-13T06:40:11.439 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:11.439 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.440 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:11.440 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.701418+0000", 2024-09-13T06:40:11.440 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000111333 2024-09-13T06:40:11.440 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:11.440 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.440 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:11.440 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.701976+0000", 2024-09-13T06:40:11.440 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000558247 2024-09-13T06:40:11.440 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:11.440 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:11.440 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:11.440 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:11.441 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.441 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:39085 3.1d 3:beb6f89d:::rbd_data.11216b5b8320.000000000000000c:head [set-alloc-hint object_size 8388608 write_size 8388608,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-13T06:40:11.441 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:10.362427+0000", 2024-09-13T06:40:11.441 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.989061784, 2024-09-13T06:40:11.441 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.060680485999999999, 2024-09-13T06:40:11.441 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:11.441 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:40:11.441 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:11.441 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:11.441 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:11.441 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 39085 2024-09-13T06:40:11.441 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:11.441 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:11.442 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.442 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:11.442 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:10.362427+0000", 2024-09-13T06:40:11.442 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:11.442 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:11.442 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.442 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:11.442 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:10.362427+0000", 2024-09-13T06:40:11.442 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:11.442 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:11.442 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.442 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:11.442 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:10.362425+0000", 2024-09-13T06:40:11.442 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999976 2024-09-13T06:40:11.443 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:11.443 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.443 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:11.443 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:10.362439+0000", 2024-09-13T06:40:11.443 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.437e-05 2024-09-13T06:40:11.443 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:11.443 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.443 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:11.443 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:10.362469+0000", 2024-09-13T06:40:11.443 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.9556e-05 2024-09-13T06:40:11.443 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:11.443 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.444 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:11.444 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:10.362483+0000", 2024-09-13T06:40:11.444 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.4701999999999999e-05 2024-09-13T06:40:11.444 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:11.444 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.444 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:11.444 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:10.362624+0000", 2024-09-13T06:40:11.444 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000140295 2024-09-13T06:40:11.444 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:11.444 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.444 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:11.444 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:10.362861+0000", 2024-09-13T06:40:11.444 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00023738700000000001 2024-09-13T06:40:11.445 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:11.445 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.445 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 4", 2024-09-13T06:40:11.445 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:10.372495+0000", 2024-09-13T06:40:11.445 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0096338710000000004 2024-09-13T06:40:11.445 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:11.445 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.445 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-13T06:40:11.445 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:10.422838+0000", 2024-09-13T06:40:11.445 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.050342944000000001 2024-09-13T06:40:11.445 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:11.445 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.445 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:40:11.446 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:10.423007+0000", 2024-09-13T06:40:11.446 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00016926800000000001 2024-09-13T06:40:11.446 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:11.446 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.446 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-13T06:40:11.446 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:10.423062+0000", 2024-09-13T06:40:11.446 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.4911999999999999e-05 2024-09-13T06:40:11.446 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:11.446 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.446 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:11.446 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:10.423108+0000", 2024-09-13T06:40:11.446 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.5674999999999999e-05 2024-09-13T06:40:11.446 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:11.446 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:11.447 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:11.447 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:11.447 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:11.447 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:40:11.448 INFO:teuthology.orchestra.run.smithi081.stdout:1434 write 0x5f5a807 thru 0x5f60b19 (0x6313 bytes) 2024-09-13T06:40:11.449 INFO:teuthology.orchestra.run.smithi081.stdout:1436 read 0x534ec1 thru 0x53c3f0 (0x7530 bytes) 2024-09-13T06:40:11.449 INFO:teuthology.orchestra.run.smithi081.stdout:1437 read 0x6643daa thru 0x66485c4 (0x481b bytes) 2024-09-13T06:40:11.449 INFO:teuthology.orchestra.run.smithi081.stdout:1438 write 0x83cc428 thru 0x83ccb1a (0x6f3 bytes) 2024-09-13T06:40:11.449 INFO:teuthology.orchestra.run.smithi081.stdout:1439 write 0xa8e4752 thru 0xa8f3474 (0xed23 bytes) 2024-09-13T06:40:11.449 INFO:teuthology.orchestra.run.smithi081.stderr:nodeep-scrub is unset 2024-09-13T06:40:11.449 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-13T06:40:11.450 INFO:teuthology.orchestra.run.smithi081.stdout:1440 trunc from 0xa8f3475 to 0x46b3c52 2024-09-13T06:40:11.451 INFO:teuthology.orchestra.run.smithi081.stdout:1441 writesame 0x2c7e901 thru 0x2c82976 data_size 0x2(0x4076 bytes) 2024-09-13T06:40:11.451 INFO:teuthology.orchestra.run.smithi081.stdout:1442 read 0x207a8f8 thru 0x2084ec9 (0xa5d2 bytes) 2024-09-13T06:40:11.451 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:40:11.449+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:40:11.452 INFO:teuthology.orchestra.run.smithi081.stdout:1443 trunc from 0x46b3c52 to 0x86d6d2c 2024-09-13T06:40:11.464 INFO:teuthology.orchestra.run.smithi081.stdout:1444 write 0x4b6094 thru 0x4bc9be (0x692b bytes) 2024-09-13T06:40:11.466 INFO:teuthology.orchestra.run.smithi081.stdout:1445 read 0x1f5d284 thru 0x1f6836b (0xb0e8 bytes) 2024-09-13T06:40:11.467 INFO:teuthology.orchestra.run.smithi081.stdout:1446 read 0x7d053b0 thru 0x7d05b62 (0x7b3 bytes) 2024-09-13T06:40:11.467 INFO:teuthology.orchestra.run.smithi081.stdout:1448 writesame 0x1570794 thru 0x157ba15 data_size 0x49(0xb282 bytes) 2024-09-13T06:40:11.471 INFO:teuthology.orchestra.run.smithi081.stdout:1449 punch from 0x17a324b to 0x17a522b, (0x1fe0 bytes) 2024-09-13T06:40:11.471 INFO:teuthology.orchestra.run.smithi081.stdout:1450 write 0xe0b096 thru 0xe1663a (0xb5a5 bytes) 2024-09-13T06:40:11.494 INFO:teuthology.orchestra.run.smithi081.stdout:1451 writesame 0xb6657bc thru 0xb670b02 data_size 0x5(0xb347 bytes) 2024-09-13T06:40:11.494 INFO:teuthology.orchestra.run.smithi081.stdout:1452 punch from 0x60f081 to 0x615b2e, (0x6aad bytes) 2024-09-13T06:40:11.494 INFO:teuthology.orchestra.run.smithi081.stdout:1453 read 0xacfa157 thru 0xacfaf93 (0xe3d bytes) 2024-09-13T06:40:11.494 INFO:teuthology.orchestra.run.smithi081.stdout:1457 write 0x5346ffd thru 0x5356ba4 (0xfba8 bytes) 2024-09-13T06:40:11.501 INFO:teuthology.orchestra.run.smithi081.stdout:1458 read 0x6d1163c thru 0x6d14816 (0x31db bytes) 2024-09-13T06:40:11.501 INFO:teuthology.orchestra.run.smithi081.stdout:1459 writesame 0x62215a6 thru 0x6224061 data_size 0xa(0x2abc bytes) 2024-09-13T06:40:11.505 INFO:teuthology.orchestra.run.smithi081.stdout:1460 read 0x24c806d thru 0x24d3330 (0xb2c4 bytes) 2024-09-13T06:40:11.507 INFO:teuthology.orchestra.run.smithi081.stdout:1461 read 0x3db55a4 thru 0x3dc50e3 (0xfb40 bytes) 2024-09-13T06:40:11.507 INFO:teuthology.orchestra.run.smithi081.stdout:1462 write 0x73b9265 thru 0x73be5c7 (0x5363 bytes) 2024-09-13T06:40:11.522 INFO:teuthology.orchestra.run.smithi081.stdout:1463 write 0xbb7613d thru 0xbb7fc08 (0x9acc bytes) 2024-09-13T06:40:11.527 INFO:teuthology.orchestra.run.smithi081.stdout:1465 write 0x6014dd7 thru 0x6017953 (0x2b7d bytes) 2024-09-13T06:40:11.532 INFO:teuthology.orchestra.run.smithi081.stdout:1466 read 0x46b68d thru 0x472dd5 (0x7749 bytes) 2024-09-13T06:40:11.534 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:40:11.534 INFO:teuthology.orchestra.run.smithi081.stdout:1469 writesame 0x66c73cb thru 0x66cb175 data_size 0x1(0x3dab bytes) 2024-09-13T06:40:11.549 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:40:11.549+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:40:11.560 INFO:teuthology.orchestra.run.smithi081.stdout:1470 trunc from 0xbb7fc09 to 0x804fe10 2024-09-13T06:40:11.582 INFO:teuthology.orchestra.run.smithi081.stdout:1473 write 0x4ba02c3 thru 0x4ba9568 (0x92a6 bytes) 2024-09-13T06:40:11.585 INFO:teuthology.orchestra.run.smithi081.stdout:1478 writesame 0x2c3ffcf thru 0x2c4b60e data_size 0xa2(0xb640 bytes) 2024-09-13T06:40:11.588 INFO:teuthology.orchestra.run.smithi081.stdout:1479 write 0x37a22e2 thru 0x37a9f6d (0x7c8c bytes) 2024-09-13T06:40:11.610 INFO:teuthology.orchestra.run.smithi081.stdout:1481 write 0xabd546c thru 0xabdaf15 (0x5aaa bytes) 2024-09-13T06:40:11.631 INFO:teuthology.orchestra.run.smithi081.stdout:1483 write 0xb9b744b thru 0xb9c5c10 (0xe7c6 bytes) 2024-09-13T06:40:11.633 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:40:11.633 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [], 2024-09-13T06:40:11.633 INFO:teuthology.orchestra.run.smithi139.stdout: "num_ops": 0 2024-09-13T06:40:11.634 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:40:11.637 INFO:teuthology.orchestra.run.smithi081.stdout:1486 read 0x8744288 thru 0x874b1e2 (0x6f5b bytes) 2024-09-13T06:40:11.637 INFO:teuthology.orchestra.run.smithi081.stdout:1488 punch from 0x9826d04 to 0x982e821, (0x7b1d bytes) 2024-09-13T06:40:11.648 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-13T06:40:11.649 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:40:11.649+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:40:11.654 INFO:teuthology.orchestra.run.smithi081.stdout:1489 writesame 0xe51caca thru 0xe52445e data_size 0x53(0x7995 bytes) 2024-09-13T06:40:11.654 INFO:teuthology.orchestra.run.smithi081.stdout:1492 read 0x983651d thru 0x983c79e (0x6282 bytes) 2024-09-13T06:40:11.662 INFO:teuthology.orchestra.run.smithi081.stdout:1493 write 0xe68f462 thru 0xe695caf (0x684e bytes) 2024-09-13T06:40:11.668 INFO:teuthology.orchestra.run.smithi081.stdout:1494 write 0x939901a thru 0x93a4b8d (0xbb74 bytes) 2024-09-13T06:40:11.675 INFO:teuthology.orchestra.run.smithi081.stdout:1496 punch from 0xaab84d3 to 0xaac2fb4, (0xaae1 bytes) 2024-09-13T06:40:11.681 INFO:teuthology.orchestra.run.smithi081.stdout:1498 trunc from 0xe695cb0 to 0xc66f405 2024-09-13T06:40:11.700 INFO:teuthology.orchestra.run.smithi081.stdout:1499 write 0x9a02d09 thru 0x9a0f40c (0xc704 bytes) 2024-09-13T06:40:11.705 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:40:11.706 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:40:11.706 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:40:11.706 INFO:teuthology.orchestra.run.smithi081.stdout:1503 writesame 0x2e2f39 thru 0x2f032c data_size 0xa(0xd3f4 bytes) 2024-09-13T06:40:11.715 INFO:teuthology.orchestra.run.smithi081.stdout:1504 punch from 0x4d15b47 to 0x4d1b158, (0x5611 bytes) 2024-09-13T06:40:11.715 INFO:teuthology.orchestra.run.smithi081.stdout:1506 write 0xa9d8fd9 thru 0xa9df0db (0x6103 bytes) 2024-09-13T06:40:11.729 INFO:teuthology.orchestra.run.smithi081.stdout:1507 trunc from 0xc66f405 to 0x9a2114a 2024-09-13T06:40:11.750 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-13T06:40:11.752+0000 7f86a5f06640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26387) UID: 0 2024-09-13T06:40:11.771 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:40:11.771 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [], 2024-09-13T06:40:11.772 INFO:teuthology.orchestra.run.smithi139.stdout: "complaint_time": 30, 2024-09-13T06:40:11.772 INFO:teuthology.orchestra.run.smithi139.stdout: "num_blocked_ops": 0 2024-09-13T06:40:11.772 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:40:11.773 INFO:teuthology.orchestra.run.smithi081.stdout:1508 write 0xbc01622 thru 0xbc06739 (0x5118 bytes) 2024-09-13T06:40:11.780 INFO:teuthology.orchestra.run.smithi081.stdout:1509 punch from 0x6762277 to 0x6771ba2, (0xf92b bytes) 2024-09-13T06:40:11.781 INFO:teuthology.orchestra.run.smithi081.stdout:1510 trunc from 0xbc0673a to 0xb7579f2 2024-09-13T06:40:11.787 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-13T06:40:11.794 INFO:teuthology.orchestra.run.smithi081.stdout:1511 trunc from 0xb7579f2 to 0xbb8a3ff 2024-09-13T06:40:11.803 INFO:teuthology.orchestra.run.smithi081.stdout:1512 write 0x5e3978f thru 0x5e3ee24 (0x5696 bytes) 2024-09-13T06:40:11.809 INFO:teuthology.orchestra.run.smithi081.stdout:1513 read 0xaae98c0 thru 0xaaf3779 (0x9eba bytes) 2024-09-13T06:40:11.821 INFO:teuthology.orchestra.run.smithi081.stdout:1514 writesame 0xc74bce4 thru 0xc75bb5f data_size 0x1(0xfe7c bytes) 2024-09-13T06:40:11.852 INFO:teuthology.orchestra.run.smithi081.stdout:1515 trunc from 0xc75bb60 to 0xb5c45c 2024-09-13T06:40:11.873 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:40:11.876+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:40:11.882 INFO:teuthology.orchestra.run.smithi081.stdout:1516 read 0x3fc9fe thru 0x40a15e (0xd761 bytes) 2024-09-13T06:40:11.917 INFO:teuthology.orchestra.run.smithi081.stdout:1517 write 0x943e4b0 thru 0x944a00c (0xbb5d bytes) 2024-09-13T06:40:11.926 INFO:teuthology.orchestra.run.smithi081.stdout:1518 writesame 0x2be6a30 thru 0x2bee0ac data_size 0x1(0x767d bytes) 2024-09-13T06:40:11.952 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:40:11.953+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:40:11.964 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:40:11.964 INFO:teuthology.orchestra.run.smithi139.stdout: "size": 20, 2024-09-13T06:40:11.964 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 600, 2024-09-13T06:40:11.964 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [ 2024-09-13T06:40:11.964 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.964 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27854 3.a 3:537b3559:::rbd_data.1121f2c5ee81.0000000000000016:13 [read 335872~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:11.964 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.658750+0000", 2024-09-13T06:40:11.964 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 15.306382190000001, 2024-09-13T06:40:11.964 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.037969532, 2024-09-13T06:40:11.964 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:11.965 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:11.965 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:11.965 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:11.965 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:11.965 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27854 2024-09-13T06:40:11.965 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:11.965 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:11.965 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.965 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:11.965 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658750+0000", 2024-09-13T06:40:11.965 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:11.965 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:11.966 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.966 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:11.966 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658750+0000", 2024-09-13T06:40:11.966 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:11.966 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:11.966 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.966 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:11.966 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658749+0000", 2024-09-13T06:40:11.966 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:11.966 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:11.966 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.966 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:11.966 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658757+0000", 2024-09-13T06:40:11.966 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.7389999999999999e-06 2024-09-13T06:40:11.966 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:11.967 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.967 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:11.967 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658763+0000", 2024-09-13T06:40:11.967 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.7769999999999999e-06 2024-09-13T06:40:11.967 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:11.967 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.967 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:11.967 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658767+0000", 2024-09-13T06:40:11.967 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.1749999999999998e-06 2024-09-13T06:40:11.967 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:11.967 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.967 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:11.967 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.696322+0000", 2024-09-13T06:40:11.967 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.037554772 2024-09-13T06:40:11.967 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:11.968 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.968 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:11.968 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.696418+0000", 2024-09-13T06:40:11.968 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6050000000000004e-05 2024-09-13T06:40:11.968 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:11.968 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.968 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:11.968 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.696719+0000", 2024-09-13T06:40:11.968 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00030138499999999999 2024-09-13T06:40:11.968 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:11.968 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:11.968 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:11.968 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:11.968 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.968 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27855 3.a 3:537b3559:::rbd_data.1121f2c5ee81.0000000000000016:13 [read 380928~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:11.969 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.658771+0000", 2024-09-13T06:40:11.969 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 15.306360946, 2024-09-13T06:40:11.969 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.038326354, 2024-09-13T06:40:11.969 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:11.969 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:11.969 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:11.969 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:11.969 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:11.969 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27855 2024-09-13T06:40:11.969 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:11.969 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:11.969 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.969 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:11.969 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658771+0000", 2024-09-13T06:40:11.970 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:11.970 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:11.970 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.970 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:11.970 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658771+0000", 2024-09-13T06:40:11.970 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:11.970 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:11.970 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.970 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:11.970 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658770+0000", 2024-09-13T06:40:11.970 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:11.970 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:11.970 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.970 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:11.970 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658772+0000", 2024-09-13T06:40:11.970 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.0930000000000001e-06 2024-09-13T06:40:11.971 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:11.971 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.971 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:11.971 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658778+0000", 2024-09-13T06:40:11.971 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.2730000000000002e-06 2024-09-13T06:40:11.971 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:11.971 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.971 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:11.971 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658782+0000", 2024-09-13T06:40:11.971 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0879999999999997e-06 2024-09-13T06:40:11.971 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:11.971 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.971 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:11.971 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.696770+0000", 2024-09-13T06:40:11.971 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.037988145000000001 2024-09-13T06:40:11.972 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:11.972 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.972 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:11.972 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.696852+0000", 2024-09-13T06:40:11.972 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.2039999999999994e-05 2024-09-13T06:40:11.972 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:11.972 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.972 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:11.972 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.697097+0000", 2024-09-13T06:40:11.972 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00024508800000000002 2024-09-13T06:40:11.972 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:11.972 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:11.972 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:11.972 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:11.972 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.973 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27856 3.a 3:537b3559:::rbd_data.1121f2c5ee81.0000000000000016:13 [read 405504~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:11.973 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.658786+0000", 2024-09-13T06:40:11.973 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 15.30634583, 2024-09-13T06:40:11.973 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.038736029999999998, 2024-09-13T06:40:11.973 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:11.973 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:11.973 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:11.973 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:11.973 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:11.973 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27856 2024-09-13T06:40:11.973 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:11.973 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:11.973 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.973 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:11.973 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658786+0000", 2024-09-13T06:40:11.974 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:11.974 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:11.974 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.974 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:11.974 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658786+0000", 2024-09-13T06:40:11.974 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:11.974 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:11.974 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.974 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:11.974 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658785+0000", 2024-09-13T06:40:11.974 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:11.974 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:11.974 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.974 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:11.974 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658787+0000", 2024-09-13T06:40:11.974 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.0040000000000002e-06 2024-09-13T06:40:11.975 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:11.975 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.975 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:11.975 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658793+0000", 2024-09-13T06:40:11.975 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.2410000000000003e-06 2024-09-13T06:40:11.975 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:11.975 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.975 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:11.975 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658797+0000", 2024-09-13T06:40:11.975 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.1330000000000001e-06 2024-09-13T06:40:11.975 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:11.975 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.975 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:11.975 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.697176+0000", 2024-09-13T06:40:11.975 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.038379074999999999 2024-09-13T06:40:11.976 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:11.976 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.976 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:11.976 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.697275+0000", 2024-09-13T06:40:11.976 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.8819000000000004e-05 2024-09-13T06:40:11.976 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:11.976 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.976 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:11.976 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.697522+0000", 2024-09-13T06:40:11.976 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00024719999999999999 2024-09-13T06:40:11.976 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:11.976 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:11.976 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:11.976 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:11.977 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.977 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27857 3.a 3:537b3559:::rbd_data.1121f2c5ee81.0000000000000016:13 [read 475136~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:11.977 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.658845+0000", 2024-09-13T06:40:11.977 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 15.306286826999999, 2024-09-13T06:40:11.977 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039112570999999999, 2024-09-13T06:40:11.977 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:11.977 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:11.977 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:11.977 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:11.977 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:11.977 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27857 2024-09-13T06:40:11.977 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:11.977 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:11.977 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.977 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:11.978 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658845+0000", 2024-09-13T06:40:11.978 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:11.978 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:11.978 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.978 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:11.978 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658845+0000", 2024-09-13T06:40:11.978 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:11.978 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:11.978 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.978 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:11.978 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658844+0000", 2024-09-13T06:40:11.978 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999986 2024-09-13T06:40:11.978 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:11.978 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.979 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:11.979 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658868+0000", 2024-09-13T06:40:11.979 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.4615000000000001e-05 2024-09-13T06:40:11.979 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:11.979 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.979 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:11.979 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658884+0000", 2024-09-13T06:40:11.979 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5401999999999999e-05 2024-09-13T06:40:11.979 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:11.979 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.979 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:11.979 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658896+0000", 2024-09-13T06:40:11.980 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2509e-05 2024-09-13T06:40:11.980 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:11.980 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.980 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:11.980 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.697571+0000", 2024-09-13T06:40:11.980 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.038675107 2024-09-13T06:40:11.980 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:11.980 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.980 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:11.980 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.697658+0000", 2024-09-13T06:40:11.980 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6349999999999998e-05 2024-09-13T06:40:11.980 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:11.980 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.981 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:11.981 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.697957+0000", 2024-09-13T06:40:11.981 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00029986100000000001 2024-09-13T06:40:11.981 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:11.981 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:11.981 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:11.981 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:11.981 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.981 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27858 3.a 3:537b3559:::rbd_data.1121f2c5ee81.0000000000000016:13 [read 499712~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:11.981 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.658905+0000", 2024-09-13T06:40:11.981 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 15.306226277, 2024-09-13T06:40:11.981 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039475392999999998, 2024-09-13T06:40:11.981 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:11.981 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:11.981 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:11.982 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:11.982 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:11.982 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27858 2024-09-13T06:40:11.982 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:11.982 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:11.982 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.982 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:11.982 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658905+0000", 2024-09-13T06:40:11.982 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:11.982 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:11.982 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.982 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:11.982 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658905+0000", 2024-09-13T06:40:11.982 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:11.982 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:11.983 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.983 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:11.983 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658905+0000", 2024-09-13T06:40:11.983 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:11.983 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:11.983 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.983 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:11.983 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658909+0000", 2024-09-13T06:40:11.983 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.831e-06 2024-09-13T06:40:11.983 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:11.983 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.983 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:11.983 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658920+0000", 2024-09-13T06:40:11.984 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0936e-05 2024-09-13T06:40:11.984 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:11.984 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.984 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:11.984 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658929+0000", 2024-09-13T06:40:11.984 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.2749999999999995e-06 2024-09-13T06:40:11.984 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:11.984 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.984 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:11.984 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.697990+0000", 2024-09-13T06:40:11.984 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039061625000000003 2024-09-13T06:40:11.984 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:11.984 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.984 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:11.984 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.698077+0000", 2024-09-13T06:40:11.985 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6922000000000006e-05 2024-09-13T06:40:11.985 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:11.985 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.985 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:11.985 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.698381+0000", 2024-09-13T06:40:11.985 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00030360599999999999 2024-09-13T06:40:11.985 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:11.985 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:11.985 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:11.985 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:11.985 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.985 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27929 3.a 3:537b3559:::rbd_data.1121f2c5ee81.0000000000000016:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:11.985 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.659338+0000", 2024-09-13T06:40:11.985 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 15.305793445999999, 2024-09-13T06:40:11.985 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039351214000000002, 2024-09-13T06:40:11.986 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:11.986 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:11.986 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:11.986 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:11.986 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:11.986 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27929 2024-09-13T06:40:11.986 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:11.986 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:11.986 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.986 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:11.986 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.659338+0000", 2024-09-13T06:40:11.986 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:11.986 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:11.986 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.986 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:11.986 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.659338+0000", 2024-09-13T06:40:11.987 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:11.987 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:11.987 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.987 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:11.987 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.659337+0000", 2024-09-13T06:40:11.987 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:11.987 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:11.987 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.987 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:11.987 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.659342+0000", 2024-09-13T06:40:11.987 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0799999999999999e-06 2024-09-13T06:40:11.987 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:11.987 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.987 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:11.987 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.659353+0000", 2024-09-13T06:40:11.988 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1798e-05 2024-09-13T06:40:11.988 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:11.988 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.988 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:11.988 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.659361+0000", 2024-09-13T06:40:11.988 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.8040000000000002e-06 2024-09-13T06:40:11.988 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:11.988 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.988 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:11.988 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.698449+0000", 2024-09-13T06:40:11.988 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039087519000000001 2024-09-13T06:40:11.988 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:11.988 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.988 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:11.988 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.698567+0000", 2024-09-13T06:40:11.989 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00011857 2024-09-13T06:40:11.989 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:11.989 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.989 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:11.989 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.698689+0000", 2024-09-13T06:40:11.989 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00012226699999999999 2024-09-13T06:40:11.989 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:11.989 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:11.989 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:11.989 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:11.989 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.989 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27974 3.a 3:537b3559:::rbd_data.1121f2c5ee81.0000000000000016:13 [read 32768~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:11.989 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.660102+0000", 2024-09-13T06:40:11.989 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 15.305029678, 2024-09-13T06:40:11.989 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.038972346999999997, 2024-09-13T06:40:11.989 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:11.990 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:11.990 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:11.990 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:11.990 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:11.990 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27974 2024-09-13T06:40:11.990 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:11.990 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:11.990 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.990 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:11.990 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660102+0000", 2024-09-13T06:40:11.990 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:11.990 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:11.990 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.990 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:11.991 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660102+0000", 2024-09-13T06:40:11.991 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:11.991 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:11.991 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.991 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:11.991 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660100+0000", 2024-09-13T06:40:11.991 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999976 2024-09-13T06:40:11.991 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:11.991 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.991 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:11.991 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660114+0000", 2024-09-13T06:40:11.991 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.4466e-05 2024-09-13T06:40:11.992 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:11.992 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.992 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:11.992 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660148+0000", 2024-09-13T06:40:11.992 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.3742999999999999e-05 2024-09-13T06:40:11.992 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:11.992 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.992 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:11.992 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660170+0000", 2024-09-13T06:40:11.992 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.2518e-05 2024-09-13T06:40:11.992 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:11.992 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.992 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:11.992 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.698719+0000", 2024-09-13T06:40:11.993 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.038548529999999998 2024-09-13T06:40:11.993 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:11.993 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.993 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:11.993 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.698806+0000", 2024-09-13T06:40:11.993 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.7179e-05 2024-09-13T06:40:11.993 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:11.993 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.993 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:11.993 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.699074+0000", 2024-09-13T06:40:11.993 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00026834800000000001 2024-09-13T06:40:11.993 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:11.993 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:11.994 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:11.994 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:11.994 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.994 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27975 3.a 3:537b3559:::rbd_data.1121f2c5ee81.0000000000000016:13 [read 57344~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:11.994 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.660189+0000", 2024-09-13T06:40:11.994 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 15.304942834, 2024-09-13T06:40:11.994 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039288678, 2024-09-13T06:40:11.994 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:11.994 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:11.994 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:11.994 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:11.994 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:11.994 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27975 2024-09-13T06:40:11.994 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:11.995 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:11.995 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.995 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:11.995 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660189+0000", 2024-09-13T06:40:11.995 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:11.995 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:11.995 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.995 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:11.995 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660189+0000", 2024-09-13T06:40:11.995 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:11.995 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:11.995 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.995 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:11.995 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660187+0000", 2024-09-13T06:40:11.996 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999981 2024-09-13T06:40:11.996 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:11.996 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.996 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:11.996 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660195+0000", 2024-09-13T06:40:11.996 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5610000000000001e-06 2024-09-13T06:40:11.996 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:11.996 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.996 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:11.996 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660212+0000", 2024-09-13T06:40:11.996 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7725999999999999e-05 2024-09-13T06:40:11.996 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:11.996 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.997 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:11.997 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660227+0000", 2024-09-13T06:40:11.997 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.43e-05 2024-09-13T06:40:11.997 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:11.997 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.997 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:11.997 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.699135+0000", 2024-09-13T06:40:11.997 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.038908336000000002 2024-09-13T06:40:11.997 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:11.997 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.997 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:11.997 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.699208+0000", 2024-09-13T06:40:11.997 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.3065000000000006e-05 2024-09-13T06:40:11.997 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:11.998 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.998 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:11.998 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.699478+0000", 2024-09-13T06:40:11.998 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00026946899999999999 2024-09-13T06:40:11.998 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:11.998 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:11.998 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:11.998 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:11.998 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.998 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27976 3.a 3:537b3559:::rbd_data.1121f2c5ee81.0000000000000016:13 [read 102400~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:11.998 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.660238+0000", 2024-09-13T06:40:11.998 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 15.304893671, 2024-09-13T06:40:11.998 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039636515999999997, 2024-09-13T06:40:11.999 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:11.999 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:11.999 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:11.999 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:11.999 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:11.999 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27976 2024-09-13T06:40:11.999 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:11.999 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:11.999 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:11.999 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:11.999 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660238+0000", 2024-09-13T06:40:11.999 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:11.999 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:11.999 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:12.000 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:12.000 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660238+0000", 2024-09-13T06:40:12.000 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:12.000 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:12.000 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:12.000 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:12.000 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660237+0000", 2024-09-13T06:40:12.000 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:12.000 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:12.000 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:12.000 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:12.000 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660243+0000", 2024-09-13T06:40:12.000 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.9909999999999999e-06 2024-09-13T06:40:12.001 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:12.001 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:12.001 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:12.001 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660259+0000", 2024-09-13T06:40:12.001 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6294e-05 2024-09-13T06:40:12.001 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:12.001 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:12.001 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:12.001 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660272+0000", 2024-09-13T06:40:12.001 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2714999999999999e-05 2024-09-13T06:40:12.001 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:12.001 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:12.001 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:12.002 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.699513+0000", 2024-09-13T06:40:12.002 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039240932999999999 2024-09-13T06:40:12.002 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:12.002 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:12.002 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:12.002 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.699604+0000", 2024-09-13T06:40:12.002 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.1367999999999997e-05 2024-09-13T06:40:12.002 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:12.002 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:12.002 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:12.003 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.699875+0000", 2024-09-13T06:40:12.003 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00027029499999999999 2024-09-13T06:40:12.003 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:12.003 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:12.003 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:12.003 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:12.003 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:12.003 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27977 3.a 3:537b3559:::rbd_data.1121f2c5ee81.0000000000000016:13 [read 126976~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:12.003 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.660284+0000", 2024-09-13T06:40:12.003 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 15.304848099000001, 2024-09-13T06:40:12.003 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039969945, 2024-09-13T06:40:12.003 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:12.003 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:12.003 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:12.004 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:12.004 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:12.004 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27977 2024-09-13T06:40:12.004 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:12.004 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:12.004 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:12.004 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:12.004 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660284+0000", 2024-09-13T06:40:12.004 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:12.004 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:12.004 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:12.004 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:12.005 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660284+0000", 2024-09-13T06:40:12.005 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:12.005 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:12.005 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:12.005 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:12.005 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660282+0000", 2024-09-13T06:40:12.005 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999986 2024-09-13T06:40:12.005 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:12.005 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:12.005 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:12.005 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660288+0000", 2024-09-13T06:40:12.005 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.2650000000000002e-06 2024-09-13T06:40:12.005 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:12.005 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:12.006 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:12.006 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660304+0000", 2024-09-13T06:40:12.006 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5430999999999998e-05 2024-09-13T06:40:12.006 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:12.006 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:12.006 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:12.006 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660316+0000", 2024-09-13T06:40:12.006 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.237e-05 2024-09-13T06:40:12.006 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:12.006 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:12.006 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:12.006 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.699907+0000", 2024-09-13T06:40:12.006 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039590735000000002 2024-09-13T06:40:12.006 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:12.007 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:12.007 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:12.007 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.699994+0000", 2024-09-13T06:40:12.007 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6996999999999994e-05 2024-09-13T06:40:12.007 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:12.007 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:12.007 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:12.007 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700254+0000", 2024-09-13T06:40:12.007 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000259564 2024-09-13T06:40:12.007 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:12.007 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:12.007 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:12.007 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:12.007 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:12.008 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27978 3.a 3.9aacdeca (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:12.008 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.660327+0000", 2024-09-13T06:40:12.008 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 15.304804501, 2024-09-13T06:40:12.008 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039984858999999998, 2024-09-13T06:40:12.008 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:12.008 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:40:12.008 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:12.008 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:12.008 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:12.008 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27978 2024-09-13T06:40:12.008 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:12.008 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:12.008 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:12.009 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:12.009 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660327+0000", 2024-09-13T06:40:12.009 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:12.009 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:12.009 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:12.009 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:12.009 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660327+0000", 2024-09-13T06:40:12.009 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:12.009 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:12.009 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:12.009 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:12.009 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660326+0000", 2024-09-13T06:40:12.009 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:12.009 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:12.009 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:12.010 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:12.010 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660366+0000", 2024-09-13T06:40:12.010 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.9691000000000003e-05 2024-09-13T06:40:12.010 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:12.010 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:12.010 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:12.010 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660399+0000", 2024-09-13T06:40:12.010 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.3262000000000001e-05 2024-09-13T06:40:12.010 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:12.010 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:12.010 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:12.010 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660414+0000", 2024-09-13T06:40:12.010 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.4775e-05 2024-09-13T06:40:12.011 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:12.011 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:12.011 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:12.011 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700298+0000", 2024-09-13T06:40:12.011 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039883759999999997 2024-09-13T06:40:12.011 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:12.011 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:12.011 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:12.011 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700312+0000", 2024-09-13T06:40:12.011 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.4374e-05 2024-09-13T06:40:12.011 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:12.011 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:12.011 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:12.011 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:12.011 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:12.012 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27979 3.a 3.9aacdeca (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:12.012 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.660429+0000", 2024-09-13T06:40:12.012 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 15.304702633, 2024-09-13T06:40:12.012 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039921361000000002, 2024-09-13T06:40:12.012 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:12.012 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:40:12.012 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:12.012 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:12.012 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:12.012 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27979 2024-09-13T06:40:12.012 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:12.012 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:12.012 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:12.013 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:12.013 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660429+0000", 2024-09-13T06:40:12.013 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:12.013 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:12.013 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:12.013 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:12.013 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660429+0000", 2024-09-13T06:40:12.013 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:12.013 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:12.013 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:12.013 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:12.013 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660428+0000", 2024-09-13T06:40:12.013 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999986 2024-09-13T06:40:12.014 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:12.014 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:12.014 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:12.014 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660434+0000", 2024-09-13T06:40:12.014 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.8190000000000003e-06 2024-09-13T06:40:12.014 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:12.014 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:12.014 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:12.014 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660451+0000", 2024-09-13T06:40:12.014 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6963e-05 2024-09-13T06:40:12.014 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:12.014 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:12.014 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:12.015 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660485+0000", 2024-09-13T06:40:12.015 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.3414000000000002e-05 2024-09-13T06:40:12.015 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:12.015 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:12.015 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:12.015 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700342+0000", 2024-09-13T06:40:12.015 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039857278000000003 2024-09-13T06:40:12.015 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:12.015 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:12.015 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:12.015 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700350+0000", 2024-09-13T06:40:12.015 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.2930000000000001e-06 2024-09-13T06:40:12.015 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:12.015 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:12.016 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:12.016 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:12.016 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:12.016 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27980 3.a 3.9aacdeca (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:12.016 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.660497+0000", 2024-09-13T06:40:12.016 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 15.304634421999999, 2024-09-13T06:40:12.016 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039888034000000003, 2024-09-13T06:40:12.016 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:12.016 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:40:12.016 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:12.016 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:12.016 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:12.016 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27980 2024-09-13T06:40:12.016 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:12.017 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:12.017 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:12.017 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:12.017 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660497+0000", 2024-09-13T06:40:12.017 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:12.017 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:12.017 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:12.017 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:12.017 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660497+0000", 2024-09-13T06:40:12.017 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:12.017 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:12.017 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:12.017 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:12.017 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660496+0000", 2024-09-13T06:40:12.018 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:12.018 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:12.018 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:12.018 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:12.018 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660503+0000", 2024-09-13T06:40:12.018 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.4110000000000001e-06 2024-09-13T06:40:12.018 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:12.018 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:12.018 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:12.018 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660519+0000", 2024-09-13T06:40:12.018 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6180000000000001e-05 2024-09-13T06:40:12.018 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:12.018 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:12.018 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:12.019 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660544+0000", 2024-09-13T06:40:12.019 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.5177999999999998e-05 2024-09-13T06:40:12.019 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:12.019 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:12.019 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:12.019 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700377+0000", 2024-09-13T06:40:12.019 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039833434000000001 2024-09-13T06:40:12.019 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:12.019 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:12.019 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:12.019 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700385+0000", 2024-09-13T06:40:12.019 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.8800000000000008e-06 2024-09-13T06:40:12.019 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:12.020 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:12.020 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:12.020 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:12.020 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:12.020 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27981 3.a 3.9aacdeca (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:12.020 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.660556+0000", 2024-09-13T06:40:12.020 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 15.304576076, 2024-09-13T06:40:12.020 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039869989000000002, 2024-09-13T06:40:12.020 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:12.020 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:40:12.020 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:12.020 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:12.020 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:12.020 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27981 2024-09-13T06:40:12.021 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:12.021 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:12.021 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:12.021 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:12.021 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660556+0000", 2024-09-13T06:40:12.021 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:12.021 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:12.021 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:12.021 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:12.021 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660556+0000", 2024-09-13T06:40:12.021 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:12.021 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:12.021 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:12.021 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:12.022 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660555+0000", 2024-09-13T06:40:12.022 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:12.022 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:12.022 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:12.022 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:12.022 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660561+0000", 2024-09-13T06:40:12.022 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.088e-06 2024-09-13T06:40:12.022 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:12.022 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:12.022 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:12.022 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660577+0000", 2024-09-13T06:40:12.022 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6147999999999999e-05 2024-09-13T06:40:12.022 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:12.022 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:12.023 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:12.023 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660589+0000", 2024-09-13T06:40:12.023 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2551999999999999e-05 2024-09-13T06:40:12.023 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:12.023 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:12.023 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:12.023 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700414+0000", 2024-09-13T06:40:12.023 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039825007000000003 2024-09-13T06:40:12.023 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:12.023 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:12.023 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:12.023 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700426+0000", 2024-09-13T06:40:12.024 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1265e-05 2024-09-13T06:40:12.024 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:12.024 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:12.024 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:12.024 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:12.024 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:12.024 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27982 3.a 3.9aacdeca (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:12.024 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.660603+0000", 2024-09-13T06:40:12.024 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 15.304528481, 2024-09-13T06:40:12.024 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039874779999999999, 2024-09-13T06:40:12.024 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:12.024 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:40:12.024 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:12.025 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:12.025 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:12.025 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27982 2024-09-13T06:40:12.025 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:12.025 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:12.025 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:12.025 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:12.025 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660603+0000", 2024-09-13T06:40:12.025 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:12.025 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:12.025 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:12.025 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:12.025 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660603+0000", 2024-09-13T06:40:12.026 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:12.026 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:12.026 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:12.026 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:12.026 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660602+0000", 2024-09-13T06:40:12.026 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:12.026 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:12.026 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:12.026 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:12.026 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660653+0000", 2024-09-13T06:40:12.026 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.0862000000000002e-05 2024-09-13T06:40:12.026 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:12.026 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:12.026 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:12.027 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660697+0000", 2024-09-13T06:40:12.027 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.3773000000000003e-05 2024-09-13T06:40:12.027 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:12.027 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:12.027 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:12.027 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660712+0000", 2024-09-13T06:40:12.027 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5464999999999998e-05 2024-09-13T06:40:12.027 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:12.027 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:12.027 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:12.027 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700469+0000", 2024-09-13T06:40:12.027 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039756503999999998 2024-09-13T06:40:12.027 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:12.027 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:12.027 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:12.028 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700478+0000", 2024-09-13T06:40:12.028 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.1730000000000001e-06 2024-09-13T06:40:12.028 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:12.028 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:12.028 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:12.028 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:12.028 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:12.028 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27983 3.a 3.9aacdeca (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:12.028 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.660726+0000", 2024-09-13T06:40:12.028 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 15.304405206, 2024-09-13T06:40:12.028 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039804357999999998, 2024-09-13T06:40:12.028 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:12.028 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:40:12.029 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:12.029 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:12.029 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:12.029 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27983 2024-09-13T06:40:12.029 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:12.029 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:12.029 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:12.029 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:12.029 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660726+0000", 2024-09-13T06:40:12.029 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:12.029 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:12.029 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:12.029 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:12.030 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660726+0000", 2024-09-13T06:40:12.030 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:12.030 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:12.030 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:12.030 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:12.030 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660725+0000", 2024-09-13T06:40:12.030 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999986 2024-09-13T06:40:12.030 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:12.030 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:12.030 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:12.030 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660733+0000", 2024-09-13T06:40:12.030 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.9359999999999999e-06 2024-09-13T06:40:12.030 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:12.031 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:12.031 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:12.031 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660751+0000", 2024-09-13T06:40:12.031 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7679000000000001e-05 2024-09-13T06:40:12.031 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:12.031 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:12.031 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:12.031 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660764+0000", 2024-09-13T06:40:12.031 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3112000000000001e-05 2024-09-13T06:40:12.031 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:12.031 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:12.031 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:12.031 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700516+0000", 2024-09-13T06:40:12.031 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039752183000000003 2024-09-13T06:40:12.032 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:12.032 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:12.032 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:12.032 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700531+0000", 2024-09-13T06:40:12.032 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.4732999999999999e-05 2024-09-13T06:40:12.032 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:12.032 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:12.032 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:12.032 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:12.032 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:12.032 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27984 3.a 3.9aacdeca (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:12.032 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.660776+0000", 2024-09-13T06:40:12.032 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 15.304356103, 2024-09-13T06:40:12.032 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039795697999999997, 2024-09-13T06:40:12.033 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:12.033 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:40:12.033 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:12.033 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:12.033 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:12.033 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27984 2024-09-13T06:40:12.033 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:12.033 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:12.033 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:12.033 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:12.033 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660776+0000", 2024-09-13T06:40:12.033 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:12.033 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:12.033 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:12.034 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:12.034 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660776+0000", 2024-09-13T06:40:12.034 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:12.034 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:12.034 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:12.034 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:12.034 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660775+0000", 2024-09-13T06:40:12.034 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:12.034 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:12.034 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:12.034 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:12.034 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660780+0000", 2024-09-13T06:40:12.034 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.7849999999999997e-06 2024-09-13T06:40:12.035 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:12.035 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:12.035 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:12.035 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660799+0000", 2024-09-13T06:40:12.035 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.8794e-05 2024-09-13T06:40:12.035 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:12.035 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:12.035 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:12.035 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660812+0000", 2024-09-13T06:40:12.035 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3029e-05 2024-09-13T06:40:12.035 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:12.035 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:12.035 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:12.035 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700562+0000", 2024-09-13T06:40:12.036 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039749984000000002 2024-09-13T06:40:12.036 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:12.036 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:12.036 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:12.036 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700571+0000", 2024-09-13T06:40:12.036 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.1260000000000004e-06 2024-09-13T06:40:12.036 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:12.036 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:12.036 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:12.036 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:12.036 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:12.036 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27985 3.a 3.9aacdeca (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:12.036 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.660824+0000", 2024-09-13T06:40:12.036 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 15.304308051, 2024-09-13T06:40:12.037 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039784462, 2024-09-13T06:40:12.037 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:12.037 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:40:12.037 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:12.037 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:12.037 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:12.037 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27985 2024-09-13T06:40:12.037 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:12.037 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:12.037 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:12.037 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:12.037 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660824+0000", 2024-09-13T06:40:12.037 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:12.038 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:12.038 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:12.038 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:12.038 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660824+0000", 2024-09-13T06:40:12.038 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:12.038 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:12.038 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:12.038 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:12.038 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660823+0000", 2024-09-13T06:40:12.038 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:12.038 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:12.038 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:12.038 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:12.038 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660829+0000", 2024-09-13T06:40:12.039 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.9440000000000002e-06 2024-09-13T06:40:12.039 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:12.039 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:12.039 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:12.039 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660922+0000", 2024-09-13T06:40:12.039 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.2958e-05 2024-09-13T06:40:12.039 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:12.039 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:12.039 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:12.039 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660964+0000", 2024-09-13T06:40:12.039 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.2407000000000002e-05 2024-09-13T06:40:12.039 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:12.039 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:12.039 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:12.040 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700600+0000", 2024-09-13T06:40:12.040 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039635581000000003 2024-09-13T06:40:12.040 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:12.040 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:12.040 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:12.040 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700608+0000", 2024-09-13T06:40:12.040 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.5890000000000003e-06 2024-09-13T06:40:12.040 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:12.040 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:12.040 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:12.040 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:12.040 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:12.040 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:28023 3.10 3:0dedc28a:::rbd_data.1121f2c5ee81.0000000000000019:13 [read 475136~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:12.040 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.662072+0000", 2024-09-13T06:40:12.041 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 15.303060066, 2024-09-13T06:40:12.041 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.038086508999999998, 2024-09-13T06:40:12.041 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:12.041 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:12.041 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:12.041 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:12.041 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:12.041 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 28023 2024-09-13T06:40:12.041 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:12.041 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:12.041 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:12.041 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:12.041 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.662072+0000", 2024-09-13T06:40:12.041 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:12.042 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:12.042 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:12.042 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:12.042 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.662072+0000", 2024-09-13T06:40:12.042 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:12.042 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:12.042 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:12.042 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:12.042 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.662070+0000", 2024-09-13T06:40:12.042 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999986 2024-09-13T06:40:12.042 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:12.042 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:12.042 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:12.042 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.662076+0000", 2024-09-13T06:40:12.043 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.139e-06 2024-09-13T06:40:12.043 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:12.043 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:12.043 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:12.043 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.662094+0000", 2024-09-13T06:40:12.043 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7136999999999999e-05 2024-09-13T06:40:12.043 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:12.043 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:12.043 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:12.043 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.662124+0000", 2024-09-13T06:40:12.043 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.0528999999999999e-05 2024-09-13T06:40:12.043 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:12.043 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:12.043 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:12.044 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.699843+0000", 2024-09-13T06:40:12.044 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.037718415999999998 2024-09-13T06:40:12.044 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:12.044 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:12.044 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:12.044 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.699931+0000", 2024-09-13T06:40:12.044 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.8345999999999997e-05 2024-09-13T06:40:12.044 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:12.044 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:12.044 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:12.044 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700158+0000", 2024-09-13T06:40:12.044 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00022723099999999999 2024-09-13T06:40:12.044 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:12.045 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:12.045 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:12.045 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:12.045 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:12.045 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:28024 3.10 3.5143b7b0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:12.045 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.662137+0000", 2024-09-13T06:40:12.045 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 15.302994544000001, 2024-09-13T06:40:12.045 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.038056092999999999, 2024-09-13T06:40:12.045 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:12.045 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:40:12.045 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:12.045 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:12.045 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:12.045 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 28024 2024-09-13T06:40:12.046 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:12.046 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:12.046 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:12.046 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:12.046 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.662137+0000", 2024-09-13T06:40:12.046 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:12.046 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:12.046 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:12.046 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:12.046 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.662137+0000", 2024-09-13T06:40:12.046 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:12.046 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:12.046 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:12.047 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:12.047 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.662136+0000", 2024-09-13T06:40:12.047 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999986 2024-09-13T06:40:12.047 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:12.047 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:12.047 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:12.047 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.662142+0000", 2024-09-13T06:40:12.047 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.6930000000000001e-06 2024-09-13T06:40:12.047 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:12.047 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:12.047 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:12.047 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.662160+0000", 2024-09-13T06:40:12.047 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7863000000000002e-05 2024-09-13T06:40:12.047 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:12.047 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:12.048 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:12.048 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.662189+0000", 2024-09-13T06:40:12.048 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.8486000000000001e-05 2024-09-13T06:40:12.048 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:12.048 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:12.048 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:12.048 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700187+0000", 2024-09-13T06:40:12.048 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.037998331000000003 2024-09-13T06:40:12.048 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:12.048 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:12.048 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:12.048 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700193+0000", 2024-09-13T06:40:12.048 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.0909999999999998e-06 2024-09-13T06:40:12.049 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:12.049 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:12.049 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:12.049 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:12.049 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:12.049 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:40:12.050 INFO:teuthology.orchestra.run.smithi081.stdout:1519 read 0x3a703e6 thru 0x3a79494 (0x90af bytes) 2024-09-13T06:40:12.050 INFO:teuthology.orchestra.run.smithi081.stdout:1520 write 0xcfd9ef2 thru 0xcfda052 (0x161 bytes) 2024-09-13T06:40:12.050 INFO:teuthology.orchestra.run.smithi081.stdout:1521 write 0xd289be1 thru 0xd291721 (0x7b41 bytes) 2024-09-13T06:40:12.050 INFO:teuthology.orchestra.run.smithi081.stdout:1522 trunc from 0xd291722 to 0x4da0ed6 2024-09-13T06:40:12.051 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-13T06:40:12.052 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:40:12.053+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:40:12.099 INFO:teuthology.orchestra.run.smithi081.stdout:1523 write 0xe119501 thru 0xe1218ac (0x83ac bytes) 2024-09-13T06:40:12.137 INFO:teuthology.orchestra.run.smithi081.stdout:1525 trunc from 0xe1218ad to 0x2085be1 2024-09-13T06:40:12.153 INFO:tasks.ceph.osd.6.smithi139.stderr:2024-09-13T06:40:12.155+0000 7fcd02c5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26385) UID: 0 2024-09-13T06:40:12.160 INFO:teuthology.orchestra.run.smithi081.stdout:1526 read 0x18b3e5d thru 0x18bb57d (0x7721 bytes) 2024-09-13T06:40:12.191 INFO:teuthology.orchestra.run.smithi081.stdout:1527 write 0x82b29ea thru 0x82b8ed6 (0x64ed bytes) 2024-09-13T06:40:12.198 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:40:12.198 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:40:12.202 INFO:teuthology.orchestra.run.smithi081.stdout:1532 trunc from 0x82b8ed7 to 0x9bdd717 2024-09-13T06:40:12.216 INFO:teuthology.orchestra.run.smithi081.stdout:1533 read 0x88613c8 thru 0x8869256 (0x7e8f bytes) 2024-09-13T06:40:12.216 INFO:teuthology.orchestra.run.smithi081.stdout:1534 write 0x8cd87d8 thru 0x8cdf722 (0x6f4b bytes) 2024-09-13T06:40:12.222 INFO:teuthology.orchestra.run.smithi081.stdout:1535 write 0x148ac54 thru 0x14955cd (0xa97a bytes) 2024-09-13T06:40:12.226 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:40:12.226 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [], 2024-09-13T06:40:12.226 INFO:teuthology.orchestra.run.smithi139.stdout: "num_ops": 0 2024-09-13T06:40:12.226 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:40:12.226 INFO:teuthology.orchestra.run.smithi081.stdout:1536 punch from 0x8b0b8e4 to 0x8b18698, (0xcdb4 bytes) 2024-09-13T06:40:12.226 INFO:teuthology.orchestra.run.smithi081.stdout:1537 read 0x1e8863a thru 0x1e89563 (0xf2a bytes) 2024-09-13T06:40:12.233 INFO:teuthology.orchestra.run.smithi081.stdout:1538 trunc from 0x9bdd717 to 0xc102972 2024-09-13T06:40:12.240 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-13T06:40:12.246 INFO:teuthology.orchestra.run.smithi081.stdout:1539 write 0xa9a1d43 thru 0xa9af939 (0xdbf7 bytes) 2024-09-13T06:40:12.252 INFO:teuthology.orchestra.run.smithi081.stdout:1540 write 0x9ef5662 thru 0x9f02d4a (0xd6e9 bytes) 2024-09-13T06:40:12.275 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-13T06:40:12.281 INFO:teuthology.orchestra.run.smithi081.stdout:1541 writesame 0xe96e774 thru 0xe97e288 data_size 0x13(0xfb15 bytes) 2024-09-13T06:40:12.281 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:40:12.283+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:40:12.310 INFO:teuthology.orchestra.run.smithi081.stdout:1542 trunc from 0xe97e289 to 0x2164928 2024-09-13T06:40:12.327 INFO:teuthology.orchestra.run.smithi081.stdout:1543 read 0xa59675 thru 0xa5e213 (0x4b9f bytes) 2024-09-13T06:40:12.328 INFO:teuthology.orchestra.run.smithi081.stdout:1544 write 0x1938e5c thru 0x193acdf (0x1e84 bytes) 2024-09-13T06:40:12.353 INFO:teuthology.orchestra.run.smithi081.stdout:1546 write 0xa9d4f5d thru 0xa9db926 (0x69ca bytes) 2024-09-13T06:40:12.355 INFO:tasks.ceph.osd.6.smithi139.stderr:2024-09-13T06:40:12.355+0000 7fcd02c5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26385) UID: 0 2024-09-13T06:40:12.358 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:40:12.358 INFO:teuthology.orchestra.run.smithi081.stdout:1548 read 0x9bfc40f thru 0x9c052e2 (0x8ed4 bytes) 2024-09-13T06:40:12.358 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:40:12.358 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:40:12.358 INFO:teuthology.orchestra.run.smithi081.stdout:1552 writesame 0x3fbc82e thru 0x3fc9505 data_size 0x5f(0xccd8 bytes) 2024-09-13T06:40:12.364 INFO:teuthology.orchestra.run.smithi081.stdout:1553 writesame 0x26aedd5 thru 0x26b70fd data_size 0x1(0x8329 bytes) 2024-09-13T06:40:12.386 INFO:teuthology.orchestra.run.smithi081.stdout:1554 read 0x72d8031 thru 0x72e29e2 (0xa9b2 bytes) 2024-09-13T06:40:12.386 INFO:teuthology.orchestra.run.smithi081.stdout:1555 write 0x3d94368 thru 0x3da13a1 (0xd03a bytes) 2024-09-13T06:40:12.402 INFO:teuthology.orchestra.run.smithi081.stdout:1559 read 0x719cb83 thru 0x71a94c5 (0xc943 bytes) 2024-09-13T06:40:12.403 INFO:teuthology.orchestra.run.smithi081.stdout:1560 write 0x7f5f05d thru 0x7f6e92a (0xf8ce bytes) 2024-09-13T06:40:12.405 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:40:12.405 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [], 2024-09-13T06:40:12.405 INFO:teuthology.orchestra.run.smithi139.stdout: "complaint_time": 30, 2024-09-13T06:40:12.405 INFO:teuthology.orchestra.run.smithi139.stdout: "num_blocked_ops": 0 2024-09-13T06:40:12.405 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:40:12.409 INFO:teuthology.orchestra.run.smithi081.stdout:1561 punch from 0x92e12a to 0x93e043, (0xff19 bytes) 2024-09-13T06:40:12.410 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:40:12.410 INFO:teuthology.orchestra.run.smithi081.stdout:1563 write 0x6fb0e76 thru 0x6fbded1 (0xd05c bytes) 2024-09-13T06:40:12.414 INFO:teuthology.orchestra.run.smithi081.stdout:1564 writesame 0x7a6cd8f thru 0x7a71f2a data_size 0x6(0x519c bytes) 2024-09-13T06:40:12.417 INFO:teuthology.orchestra.run.smithi081.stdout:1568 read 0x34773a1 thru 0x347f04e (0x7cae bytes) 2024-09-13T06:40:12.418 INFO:teuthology.orchestra.run.smithi081.stdout:1570 writesame 0x91ea9b4 thru 0x91efef7 data_size 0x22(0x5544 bytes) 2024-09-13T06:40:12.421 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-13T06:40:12.421 INFO:teuthology.orchestra.run.smithi081.stdout:1571 punch from 0x74ed486 to 0x74f8b53, (0xb6cd bytes) 2024-09-13T06:40:12.422 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:40:12.422 INFO:teuthology.orchestra.run.smithi081.stdout:1573 writesame 0x30c54a6 thru 0x30d0c28 data_size 0x1(0xb783 bytes) 2024-09-13T06:40:12.441 INFO:teuthology.orchestra.run.smithi081.stdout:osd.0: {} 2024-09-13T06:40:12.441 INFO:teuthology.orchestra.run.smithi081.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-13T06:40:12.456 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:40:12.457+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:40:12.457 INFO:teuthology.orchestra.run.smithi081.stdout:osd.1: {} 2024-09-13T06:40:12.457 INFO:teuthology.orchestra.run.smithi081.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-13T06:40:12.462 INFO:teuthology.orchestra.run.smithi081.stdout:1574 read 0x853fc68 thru 0x8543ed4 (0x426d bytes) 2024-09-13T06:40:12.462 INFO:teuthology.orchestra.run.smithi081.stdout:1576 punch from 0x3703eb3 to 0x370f091, (0xb1de bytes) 2024-09-13T06:40:12.462 INFO:teuthology.orchestra.run.smithi081.stdout:1578 read 0x9f6c6da thru 0x9f7a4a2 (0xddc9 bytes) 2024-09-13T06:40:12.462 INFO:teuthology.orchestra.run.smithi081.stdout:1580 read 0xa026657 thru 0xa02d7d7 (0x7181 bytes) 2024-09-13T06:40:12.463 INFO:teuthology.orchestra.run.smithi081.stdout:1581 write 0x934fedc thru 0x9356c3d (0x6d62 bytes) 2024-09-13T06:40:12.465 INFO:teuthology.orchestra.run.smithi081.stdout:1582 read 0x8711098 thru 0x871b6ef (0xa658 bytes) 2024-09-13T06:40:12.482 INFO:teuthology.orchestra.run.smithi081.stdout:osd.2: {} 2024-09-13T06:40:12.482 INFO:teuthology.orchestra.run.smithi081.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-13T06:40:12.482 INFO:teuthology.orchestra.run.smithi081.stdout:1585 trunc from 0xa9db927 to 0x5fe2f8 2024-09-13T06:40:12.501 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:40:12.501 INFO:teuthology.orchestra.run.smithi081.stdout:1588 read 0x267174 thru 0x2710da (0x9f67 bytes) 2024-09-13T06:40:12.502 INFO:teuthology.orchestra.run.smithi081.stdout:osd.3: {} 2024-09-13T06:40:12.502 INFO:teuthology.orchestra.run.smithi081.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-13T06:40:12.502 INFO:teuthology.orchestra.run.smithi081.stdout:1589 punch from 0x1edd28 to 0x1ef56a, (0x1842 bytes) 2024-09-13T06:40:12.503 INFO:teuthology.orchestra.run.smithi081.stdout:1590 trunc from 0x5fe2f8 to 0x16388a3 2024-09-13T06:40:12.511 INFO:teuthology.orchestra.run.smithi081.stdout:1591 read 0xa012a9 thru 0xa017f7 (0x54f bytes) 2024-09-13T06:40:12.511 INFO:teuthology.orchestra.run.smithi081.stdout:1592 read 0xac79c3 thru 0xad66c7 (0xed05 bytes) 2024-09-13T06:40:12.511 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:40:12.512 INFO:teuthology.orchestra.run.smithi081.stdout:1597 clone 9 order 19 su 131072 sc 6 2024-09-13T06:40:12.520 INFO:teuthology.orchestra.run.smithi081.stdout:osd.4: {} 2024-09-13T06:40:12.520 INFO:teuthology.orchestra.run.smithi081.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-13T06:40:12.537 INFO:teuthology.orchestra.run.smithi081.stdout:osd.5: {} 2024-09-13T06:40:12.537 INFO:teuthology.orchestra.run.smithi081.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-13T06:40:12.555 INFO:teuthology.orchestra.run.smithi081.stdout:osd.6: {} 2024-09-13T06:40:12.555 INFO:teuthology.orchestra.run.smithi081.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-13T06:40:12.557 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:40:12.557+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:40:12.575 INFO:teuthology.orchestra.run.smithi081.stdout:osd.7: {} 2024-09-13T06:40:12.575 INFO:teuthology.orchestra.run.smithi081.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-13T06:40:12.593 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:40:12.593 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:40:12.609 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-13T06:40:12.684 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:40:12.685+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:40:12.759 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:40:12.759 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:40:12.759 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:40:12.757+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:40:12.773 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-13T06:40:12.860 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-13T06:40:12.859+0000 7f86a5f06640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26387) UID: 0 2024-09-13T06:40:12.937 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:40:12.937 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:40:12.951 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-13T06:40:12.996 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:40:12.997+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:40:13.062 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:40:13.061+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:40:13.068 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:40:13.068 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:40:13.083 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-13T06:40:13.163 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:40:13.163+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:40:13.248 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:40:13.248 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:40:13.262 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-13T06:40:13.264 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:40:13.265+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:40:13.365 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:40:13.365+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:40:13.385 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:40:13.386 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:40:13.401 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-13T06:40:13.452 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-13T06:40:13.488 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:40:13.489+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:40:13.567 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:40:13.565+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:40:13.569 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:40:13.569 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:40:13.584 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-13T06:40:13.668 INFO:tasks.ceph.osd.6.smithi139.stderr:2024-09-13T06:40:13.667+0000 7fcd02c5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26385) UID: 0 2024-09-13T06:40:13.742 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:40:13.743 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:40:13.757 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-13T06:40:13.804 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:40:13.805+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:40:13.870 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:40:13.871+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:40:13.882 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:40:13.882 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:40:13.896 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-13T06:40:13.971 INFO:tasks.ceph.osd.6.smithi139.stderr:2024-09-13T06:40:13.971+0000 7fcd02c5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26385) UID: 0 2024-09-13T06:40:14.060 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:40:14.061 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:40:14.072 INFO:tasks.ceph.osd.6.smithi139.stderr:2024-09-13T06:40:14.071+0000 7fcd02c5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26385) UID: 0 2024-09-13T06:40:14.075 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-13T06:40:14.173 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-13T06:40:14.175+0000 7f86a5f06640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26387) UID: 0 2024-09-13T06:40:14.199 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:40:14.200 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:40:14.213 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-13T06:40:14.274 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:40:14.275+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:40:14.336 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:40:14.336 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:40:14.350 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-13T06:40:14.396 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:40:14.397+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:40:14.409 INFO:teuthology.orchestra.run.smithi081.stderr:noscrub is set 2024-09-13T06:40:14.476 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:40:14.477+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:40:14.487 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:40:14.487 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:40:14.502 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-13T06:40:14.576 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:40:14.575+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:40:14.592 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-13T06:40:14.634 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:40:14.634 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:40:14.648 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-13T06:40:14.689 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:40:14.691+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:40:14.743 INFO:teuthology.orchestra.run.smithi081.stdout:osd.0: {} 2024-09-13T06:40:14.743 INFO:teuthology.orchestra.run.smithi081.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-13T06:40:14.759 INFO:teuthology.orchestra.run.smithi081.stdout:osd.1: {} 2024-09-13T06:40:14.759 INFO:teuthology.orchestra.run.smithi081.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-13T06:40:14.775 INFO:teuthology.orchestra.run.smithi081.stdout:osd.2: {} 2024-09-13T06:40:14.775 INFO:teuthology.orchestra.run.smithi081.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-13T06:40:14.779 INFO:tasks.ceph.osd.6.smithi139.stderr:2024-09-13T06:40:14.779+0000 7fcd02c5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26385) UID: 0 2024-09-13T06:40:14.792 INFO:teuthology.orchestra.run.smithi081.stdout:osd.3: {} 2024-09-13T06:40:14.792 INFO:teuthology.orchestra.run.smithi081.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-13T06:40:14.812 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:40:14.812 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [], 2024-09-13T06:40:14.812 INFO:teuthology.orchestra.run.smithi139.stdout: "complaint_time": 30, 2024-09-13T06:40:14.812 INFO:teuthology.orchestra.run.smithi139.stdout: "num_blocked_ops": 0 2024-09-13T06:40:14.812 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:40:14.813 INFO:teuthology.orchestra.run.smithi081.stdout:osd.4: {} 2024-09-13T06:40:14.813 INFO:teuthology.orchestra.run.smithi081.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-13T06:40:14.827 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-13T06:40:14.831 INFO:teuthology.orchestra.run.smithi081.stdout:osd.5: {} 2024-09-13T06:40:14.831 INFO:teuthology.orchestra.run.smithi081.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-13T06:40:14.849 INFO:teuthology.orchestra.run.smithi081.stdout:osd.6: {} 2024-09-13T06:40:14.849 INFO:teuthology.orchestra.run.smithi081.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-13T06:40:14.866 INFO:teuthology.orchestra.run.smithi081.stdout:osd.7: {} 2024-09-13T06:40:14.866 INFO:teuthology.orchestra.run.smithi081.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-13T06:40:14.880 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:40:14.881+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:40:14.985 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:40:14.981+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:40:15.001 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:40:15.001 INFO:teuthology.orchestra.run.smithi139.stdout: "size": 20, 2024-09-13T06:40:15.001 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 600, 2024-09-13T06:40:15.001 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [ 2024-09-13T06:40:15.001 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.001 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18706 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 3346432~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:40:15.001 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.846138+0000", 2024-09-13T06:40:15.001 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 23.155206486000001, 2024-09-13T06:40:15.001 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.102018712, 2024-09-13T06:40:15.001 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:15.001 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:15.002 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:15.002 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:15.002 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:15.002 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18706 2024-09-13T06:40:15.002 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.002 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:15.002 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.002 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:15.002 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846138+0000", 2024-09-13T06:40:15.002 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:15.002 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.002 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.002 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:15.002 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846138+0000", 2024-09-13T06:40:15.003 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:15.003 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.003 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.003 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:15.003 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846138+0000", 2024-09-13T06:40:15.003 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:15.003 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.003 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.003 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:15.003 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846141+0000", 2024-09-13T06:40:15.003 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.6969999999999999e-06 2024-09-13T06:40:15.003 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.003 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.004 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:15.004 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846150+0000", 2024-09-13T06:40:15.004 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6400000000000003e-06 2024-09-13T06:40:15.004 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.004 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.004 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:15.004 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846160+0000", 2024-09-13T06:40:15.004 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.3999999999999998e-06 2024-09-13T06:40:15.004 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.004 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.004 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:15.004 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.947764+0000", 2024-09-13T06:40:15.004 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101604085 2024-09-13T06:40:15.005 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.005 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.005 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:15.005 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.947888+0000", 2024-09-13T06:40:15.005 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000124113 2024-09-13T06:40:15.005 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.005 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.005 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:15.005 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.948157+0000", 2024-09-13T06:40:15.005 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00026943399999999998 2024-09-13T06:40:15.005 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:15.005 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:15.005 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:15.005 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.006 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.006 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18707 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 3375104~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:40:15.006 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.846207+0000", 2024-09-13T06:40:15.006 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 23.155137719999999, 2024-09-13T06:40:15.006 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10238114099999999, 2024-09-13T06:40:15.006 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:15.006 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:15.006 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:15.006 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:15.006 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:15.006 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18707 2024-09-13T06:40:15.006 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.006 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:15.007 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.007 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:15.007 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846207+0000", 2024-09-13T06:40:15.007 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:15.007 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.007 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.007 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:15.007 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846207+0000", 2024-09-13T06:40:15.007 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:15.007 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.007 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.007 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:15.007 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846206+0000", 2024-09-13T06:40:15.007 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:15.008 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.008 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.008 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:15.008 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846211+0000", 2024-09-13T06:40:15.008 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.3000000000000003e-06 2024-09-13T06:40:15.008 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.008 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.008 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:15.008 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846220+0000", 2024-09-13T06:40:15.008 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6199999999999994e-06 2024-09-13T06:40:15.008 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.008 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.008 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:15.008 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846228+0000", 2024-09-13T06:40:15.009 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.7500000000000003e-06 2024-09-13T06:40:15.009 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.009 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.009 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:15.009 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.948267+0000", 2024-09-13T06:40:15.009 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10203878700000001 2024-09-13T06:40:15.009 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.009 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.009 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:15.009 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.948435+0000", 2024-09-13T06:40:15.009 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00016796500000000001 2024-09-13T06:40:15.010 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.010 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.010 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:15.010 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.948588+0000", 2024-09-13T06:40:15.010 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00015373599999999999 2024-09-13T06:40:15.010 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:15.010 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:15.010 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:15.010 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.010 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.010 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18718 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 3690496~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:40:15.011 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.850174+0000", 2024-09-13T06:40:15.011 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 23.151170567000001, 2024-09-13T06:40:15.011 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101854154, 2024-09-13T06:40:15.011 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:15.011 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:15.011 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:15.011 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:15.011 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:15.011 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18718 2024-09-13T06:40:15.011 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.011 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:15.011 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.011 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:15.012 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850174+0000", 2024-09-13T06:40:15.012 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:15.012 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.012 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.012 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:15.012 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850174+0000", 2024-09-13T06:40:15.012 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:15.012 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.012 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.012 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:15.012 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850173+0000", 2024-09-13T06:40:15.012 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:15.012 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.013 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.013 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:15.013 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850178+0000", 2024-09-13T06:40:15.013 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.4129999999999999e-06 2024-09-13T06:40:15.013 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.013 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.013 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:15.013 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850188+0000", 2024-09-13T06:40:15.013 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.8600000000000005e-06 2024-09-13T06:40:15.013 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.014 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.014 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:15.014 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850195+0000", 2024-09-13T06:40:15.014 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.8730000000000007e-06 2024-09-13T06:40:15.014 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.014 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.014 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:15.014 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.951766+0000", 2024-09-13T06:40:15.014 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.1015703 2024-09-13T06:40:15.014 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.014 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.014 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:15.014 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.951879+0000", 2024-09-13T06:40:15.015 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000112932 2024-09-13T06:40:15.015 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.015 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.015 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:15.015 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.952029+0000", 2024-09-13T06:40:15.015 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000149846 2024-09-13T06:40:15.015 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:15.015 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:15.015 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:15.015 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.015 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.015 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18719 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 3719168~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:40:15.015 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.850202+0000", 2024-09-13T06:40:15.015 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 23.151142524000001, 2024-09-13T06:40:15.016 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.102191676, 2024-09-13T06:40:15.016 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:15.016 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:15.016 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:15.016 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:15.016 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:15.016 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18719 2024-09-13T06:40:15.016 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.016 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:15.016 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.016 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:15.016 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850202+0000", 2024-09-13T06:40:15.017 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:15.017 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.017 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.017 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:15.017 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850202+0000", 2024-09-13T06:40:15.017 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:15.017 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.017 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.017 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:15.017 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850202+0000", 2024-09-13T06:40:15.017 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:15.017 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.018 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.018 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:15.018 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850205+0000", 2024-09-13T06:40:15.018 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.89e-06 2024-09-13T06:40:15.018 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.018 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.018 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:15.018 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850216+0000", 2024-09-13T06:40:15.018 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0233e-05 2024-09-13T06:40:15.019 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.019 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.019 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:15.019 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850223+0000", 2024-09-13T06:40:15.019 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5299999999999999e-06 2024-09-13T06:40:15.019 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.019 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.019 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:15.019 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.952106+0000", 2024-09-13T06:40:15.019 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10188309299999999 2024-09-13T06:40:15.019 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.019 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.019 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:15.019 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.952233+0000", 2024-09-13T06:40:15.020 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000126993 2024-09-13T06:40:15.020 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.020 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.020 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:15.020 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.952394+0000", 2024-09-13T06:40:15.020 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000160791 2024-09-13T06:40:15.020 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:15.020 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:15.020 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:15.021 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.021 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.021 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18720 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 3747840~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:40:15.021 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.850726+0000", 2024-09-13T06:40:15.021 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 23.150618694999999, 2024-09-13T06:40:15.021 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10199504299999999, 2024-09-13T06:40:15.022 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:15.022 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:15.022 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:15.022 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:15.022 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:15.023 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18720 2024-09-13T06:40:15.023 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.023 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:15.023 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.023 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:15.023 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850726+0000", 2024-09-13T06:40:15.023 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:15.023 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.023 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.023 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:15.023 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850726+0000", 2024-09-13T06:40:15.023 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:15.024 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.024 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.024 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:15.024 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850229+0000", 2024-09-13T06:40:15.024 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9995027 2024-09-13T06:40:15.024 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.024 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.024 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:15.024 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850731+0000", 2024-09-13T06:40:15.024 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00050221599999999999 2024-09-13T06:40:15.024 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.024 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.024 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:15.025 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850751+0000", 2024-09-13T06:40:15.025 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.9703000000000001e-05 2024-09-13T06:40:15.025 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.025 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.025 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:15.025 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850764+0000", 2024-09-13T06:40:15.025 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3207000000000001e-05 2024-09-13T06:40:15.025 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.025 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.025 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:15.025 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.952454+0000", 2024-09-13T06:40:15.025 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101690102 2024-09-13T06:40:15.026 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.026 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.026 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:15.026 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.952571+0000", 2024-09-13T06:40:15.026 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000116556 2024-09-13T06:40:15.026 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.026 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.026 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:15.026 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.952721+0000", 2024-09-13T06:40:15.026 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000150419 2024-09-13T06:40:15.026 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:15.026 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:15.026 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:15.026 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.027 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.027 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18730 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 4034560~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:40:15.027 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.854013+0000", 2024-09-13T06:40:15.027 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 23.147331754, 2024-09-13T06:40:15.027 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10186914399999999, 2024-09-13T06:40:15.027 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:15.027 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:15.028 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:15.028 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:15.028 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:15.028 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18730 2024-09-13T06:40:15.028 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.028 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:15.028 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.028 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:15.028 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.854013+0000", 2024-09-13T06:40:15.028 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:15.028 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.029 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.029 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:15.029 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.854013+0000", 2024-09-13T06:40:15.029 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:15.029 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.029 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.029 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:15.029 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.854013+0000", 2024-09-13T06:40:15.029 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:15.029 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.029 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.029 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:15.030 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.854016+0000", 2024-09-13T06:40:15.030 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.1839999999999999e-06 2024-09-13T06:40:15.030 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.030 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.030 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:15.030 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.854025+0000", 2024-09-13T06:40:15.030 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.8030000000000003e-06 2024-09-13T06:40:15.030 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.030 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.030 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:15.030 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.854033+0000", 2024-09-13T06:40:15.030 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6500000000000002e-06 2024-09-13T06:40:15.031 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.031 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.031 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:15.031 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.955546+0000", 2024-09-13T06:40:15.031 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10151296 2024-09-13T06:40:15.031 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.031 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.031 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:15.031 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.955694+0000", 2024-09-13T06:40:15.031 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000147773 2024-09-13T06:40:15.031 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.031 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.031 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:15.031 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.955882+0000", 2024-09-13T06:40:15.032 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000188371 2024-09-13T06:40:15.032 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:15.032 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:15.032 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:15.032 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.032 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.032 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18742 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 4378624~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:40:15.032 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.857984+0000", 2024-09-13T06:40:15.032 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 23.143360631, 2024-09-13T06:40:15.032 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10179961799999999, 2024-09-13T06:40:15.032 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:15.032 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:15.032 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:15.032 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:15.033 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:15.033 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18742 2024-09-13T06:40:15.033 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.033 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:15.033 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.033 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:15.033 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.857984+0000", 2024-09-13T06:40:15.033 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:15.033 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.033 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.033 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:15.033 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.857984+0000", 2024-09-13T06:40:15.033 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:15.033 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.034 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.034 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:15.034 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.857983+0000", 2024-09-13T06:40:15.034 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:15.034 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.034 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.034 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:15.034 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.857987+0000", 2024-09-13T06:40:15.034 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0670000000000002e-06 2024-09-13T06:40:15.034 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.034 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.035 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:15.035 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.857997+0000", 2024-09-13T06:40:15.035 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6830000000000003e-06 2024-09-13T06:40:15.035 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.035 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.035 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:15.035 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.858006+0000", 2024-09-13T06:40:15.035 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.5739999999999996e-06 2024-09-13T06:40:15.035 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.035 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.035 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:15.035 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.959453+0000", 2024-09-13T06:40:15.035 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101447339 2024-09-13T06:40:15.035 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.035 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.036 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:15.036 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.959603+0000", 2024-09-13T06:40:15.036 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000150316 2024-09-13T06:40:15.036 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.036 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.036 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:15.036 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.959784+0000", 2024-09-13T06:40:15.036 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00018065900000000001 2024-09-13T06:40:15.036 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:15.036 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:15.036 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:15.036 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.036 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.036 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18743 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 4407296~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:40:15.037 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.858012+0000", 2024-09-13T06:40:15.037 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 23.143332638, 2024-09-13T06:40:15.037 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10210024500000001, 2024-09-13T06:40:15.037 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:15.037 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:15.037 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:15.037 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:15.037 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:15.037 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18743 2024-09-13T06:40:15.037 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.037 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:15.037 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.038 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:15.038 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.858012+0000", 2024-09-13T06:40:15.038 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:15.038 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.038 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.038 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:15.038 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.858012+0000", 2024-09-13T06:40:15.038 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:15.038 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.038 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.038 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:15.038 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.858011+0000", 2024-09-13T06:40:15.038 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:15.039 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.039 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.039 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:15.039 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.858016+0000", 2024-09-13T06:40:15.039 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0659999999999997e-06 2024-09-13T06:40:15.039 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.039 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.039 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:15.039 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.858024+0000", 2024-09-13T06:40:15.039 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.7700000000000007e-06 2024-09-13T06:40:15.039 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.039 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.039 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:15.039 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.858032+0000", 2024-09-13T06:40:15.039 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.7700000000000001e-06 2024-09-13T06:40:15.040 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.040 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.040 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:15.040 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.959850+0000", 2024-09-13T06:40:15.040 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.1018182 2024-09-13T06:40:15.040 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.040 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.040 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:15.040 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.959964+0000", 2024-09-13T06:40:15.040 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00011413600000000001 2024-09-13T06:40:15.040 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.040 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.040 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:15.040 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.960113+0000", 2024-09-13T06:40:15.041 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00014813900000000001 2024-09-13T06:40:15.041 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:15.041 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:15.041 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:15.041 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.041 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.041 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18755 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 4751360~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:40:15.041 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.862061+0000", 2024-09-13T06:40:15.041 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 23.139284386, 2024-09-13T06:40:15.041 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101907023, 2024-09-13T06:40:15.041 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:15.042 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:15.042 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:15.042 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:15.042 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:15.042 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18755 2024-09-13T06:40:15.042 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.042 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:15.042 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.042 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:15.042 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862061+0000", 2024-09-13T06:40:15.042 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:15.042 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.042 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.042 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:15.043 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862061+0000", 2024-09-13T06:40:15.043 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:15.043 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.043 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.043 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:15.043 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862060+0000", 2024-09-13T06:40:15.043 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:15.043 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.043 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.044 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:15.044 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862064+0000", 2024-09-13T06:40:15.044 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.3229999999999999e-06 2024-09-13T06:40:15.044 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.044 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.044 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:15.044 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862078+0000", 2024-09-13T06:40:15.044 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.433e-05 2024-09-13T06:40:15.044 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.044 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.044 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:15.044 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862086+0000", 2024-09-13T06:40:15.044 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.3869999999999997e-06 2024-09-13T06:40:15.045 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.045 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.045 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:15.045 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.963635+0000", 2024-09-13T06:40:15.045 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101549606 2024-09-13T06:40:15.045 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.045 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.045 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:15.045 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.963783+0000", 2024-09-13T06:40:15.045 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000147312 2024-09-13T06:40:15.045 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.045 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.045 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:15.045 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.963968+0000", 2024-09-13T06:40:15.046 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000185028 2024-09-13T06:40:15.046 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:15.046 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:15.046 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:15.046 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.046 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.046 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18756 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 4780032~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:40:15.046 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.862132+0000", 2024-09-13T06:40:15.046 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 23.139212542999999, 2024-09-13T06:40:15.046 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.102159295, 2024-09-13T06:40:15.046 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:15.046 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:15.046 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:15.047 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:15.047 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:15.047 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18756 2024-09-13T06:40:15.047 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.047 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:15.047 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.047 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:15.047 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862132+0000", 2024-09-13T06:40:15.047 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:15.047 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.047 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.047 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:15.047 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862132+0000", 2024-09-13T06:40:15.047 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:15.048 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.048 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.048 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:15.048 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862132+0000", 2024-09-13T06:40:15.048 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:15.048 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.048 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.048 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:15.048 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862136+0000", 2024-09-13T06:40:15.048 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.9559999999999999e-06 2024-09-13T06:40:15.048 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.048 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.049 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:15.049 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862145+0000", 2024-09-13T06:40:15.049 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6169999999999996e-06 2024-09-13T06:40:15.049 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.049 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.049 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:15.049 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862153+0000", 2024-09-13T06:40:15.049 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.8359999999999992e-06 2024-09-13T06:40:15.049 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.049 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.049 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:15.049 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.964018+0000", 2024-09-13T06:40:15.049 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101865421 2024-09-13T06:40:15.050 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.050 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.050 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:15.050 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.964140+0000", 2024-09-13T06:40:15.050 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000121172 2024-09-13T06:40:15.050 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.050 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.050 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:15.050 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.964292+0000", 2024-09-13T06:40:15.050 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00015202600000000001 2024-09-13T06:40:15.050 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:15.050 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:15.050 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:15.050 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.051 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.051 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18768 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 5124096~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:40:15.051 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.866345+0000", 2024-09-13T06:40:15.051 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 23.135000236, 2024-09-13T06:40:15.051 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101779361, 2024-09-13T06:40:15.051 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:15.051 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:15.051 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:15.051 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:15.052 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:15.052 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18768 2024-09-13T06:40:15.052 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.052 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:15.052 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.052 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:15.052 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.866345+0000", 2024-09-13T06:40:15.052 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:15.052 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.052 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.052 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:15.052 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.866345+0000", 2024-09-13T06:40:15.052 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:15.053 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.053 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.053 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:15.053 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.866344+0000", 2024-09-13T06:40:15.053 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:15.053 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.053 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.053 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:15.053 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.866348+0000", 2024-09-13T06:40:15.053 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.4300000000000002e-06 2024-09-13T06:40:15.053 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.053 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.053 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:15.053 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.866356+0000", 2024-09-13T06:40:15.053 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.5930000000000006e-06 2024-09-13T06:40:15.054 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.054 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.054 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:15.054 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.866364+0000", 2024-09-13T06:40:15.054 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5599999999999996e-06 2024-09-13T06:40:15.054 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.054 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.054 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:15.054 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.967865+0000", 2024-09-13T06:40:15.055 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101501683 2024-09-13T06:40:15.055 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.055 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.055 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:15.055 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.967981+0000", 2024-09-13T06:40:15.055 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000115643 2024-09-13T06:40:15.055 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.055 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.055 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:15.055 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.968124+0000", 2024-09-13T06:40:15.055 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00014305500000000001 2024-09-13T06:40:15.055 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:15.055 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:15.056 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:15.056 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.056 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.056 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18779 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 5439488~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:40:15.056 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.869996+0000", 2024-09-13T06:40:15.056 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 23.131349351000001, 2024-09-13T06:40:15.056 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10189577399999999, 2024-09-13T06:40:15.056 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:15.056 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:15.056 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:15.056 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:15.056 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:15.056 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18779 2024-09-13T06:40:15.056 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.057 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:15.057 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.057 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:15.057 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.869996+0000", 2024-09-13T06:40:15.057 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:15.057 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.057 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.057 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:15.057 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.869996+0000", 2024-09-13T06:40:15.057 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:15.057 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.057 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.058 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:15.058 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.869995+0000", 2024-09-13T06:40:15.058 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:15.058 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.058 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.058 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:15.058 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.869998+0000", 2024-09-13T06:40:15.058 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.2729999999999998e-06 2024-09-13T06:40:15.058 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.058 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.058 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:15.058 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.870007+0000", 2024-09-13T06:40:15.058 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.5760000000000006e-06 2024-09-13T06:40:15.058 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.059 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.059 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:15.059 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.870014+0000", 2024-09-13T06:40:15.059 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.1400000000000002e-06 2024-09-13T06:40:15.059 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.059 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.059 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:15.059 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.971631+0000", 2024-09-13T06:40:15.059 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101617503 2024-09-13T06:40:15.059 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.059 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.059 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:15.059 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.971747+0000", 2024-09-13T06:40:15.059 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00011599600000000001 2024-09-13T06:40:15.060 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.060 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.060 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:15.060 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.971891+0000", 2024-09-13T06:40:15.060 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000143912 2024-09-13T06:40:15.060 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:15.060 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:15.060 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:15.060 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.060 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.060 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18792 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 5812224~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:40:15.060 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.874371+0000", 2024-09-13T06:40:15.060 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 23.126974221000001, 2024-09-13T06:40:15.060 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101736005, 2024-09-13T06:40:15.061 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:15.061 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:15.061 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:15.061 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:15.061 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:15.061 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18792 2024-09-13T06:40:15.061 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.061 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:15.061 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.062 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:15.062 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874371+0000", 2024-09-13T06:40:15.062 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:15.062 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.062 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.062 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:15.062 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874371+0000", 2024-09-13T06:40:15.062 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:15.062 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.062 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.062 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:15.062 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874370+0000", 2024-09-13T06:40:15.062 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:15.062 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.063 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.063 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:15.063 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874374+0000", 2024-09-13T06:40:15.063 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.7239999999999998e-06 2024-09-13T06:40:15.063 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.063 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.063 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:15.063 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874385+0000", 2024-09-13T06:40:15.063 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1293e-05 2024-09-13T06:40:15.063 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.063 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.063 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:15.063 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874394+0000", 2024-09-13T06:40:15.063 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.0729999999999994e-06 2024-09-13T06:40:15.064 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.064 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.064 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:15.064 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.975850+0000", 2024-09-13T06:40:15.064 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10145599700000001 2024-09-13T06:40:15.064 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.064 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.064 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:15.064 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.975963+0000", 2024-09-13T06:40:15.064 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000112689 2024-09-13T06:40:15.064 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.064 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.064 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:15.065 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.976107+0000", 2024-09-13T06:40:15.065 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000143836 2024-09-13T06:40:15.065 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:15.065 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:15.065 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:15.065 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.065 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.065 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18793 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 5840896~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:40:15.065 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.874401+0000", 2024-09-13T06:40:15.065 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 23.126944188, 2024-09-13T06:40:15.065 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.102005516, 2024-09-13T06:40:15.065 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:15.065 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:15.066 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:15.066 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:15.066 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:15.066 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18793 2024-09-13T06:40:15.066 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.066 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:15.066 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.066 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:15.066 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874401+0000", 2024-09-13T06:40:15.066 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:15.066 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.066 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.066 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:15.066 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874401+0000", 2024-09-13T06:40:15.067 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:15.067 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.067 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.067 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:15.067 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874400+0000", 2024-09-13T06:40:15.067 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:15.067 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.067 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.067 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:15.067 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874404+0000", 2024-09-13T06:40:15.067 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0069999999999999e-06 2024-09-13T06:40:15.068 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.068 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.068 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:15.068 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874412+0000", 2024-09-13T06:40:15.068 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.5399999999999996e-06 2024-09-13T06:40:15.068 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.068 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.068 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:15.068 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874420+0000", 2024-09-13T06:40:15.068 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.6199999999999999e-06 2024-09-13T06:40:15.068 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.068 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.068 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:15.069 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.976150+0000", 2024-09-13T06:40:15.069 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101729874 2024-09-13T06:40:15.069 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.069 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.069 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:15.069 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.976261+0000", 2024-09-13T06:40:15.069 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000110819 2024-09-13T06:40:15.069 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.069 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.069 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:15.069 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.976406+0000", 2024-09-13T06:40:15.069 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000145489 2024-09-13T06:40:15.070 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:15.070 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:15.070 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:15.070 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.070 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.070 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18803 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 6127616~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:40:15.070 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.877851+0000", 2024-09-13T06:40:15.070 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 23.123493695000001, 2024-09-13T06:40:15.070 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101951584, 2024-09-13T06:40:15.070 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:15.070 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:15.070 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:15.070 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:15.071 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:15.071 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18803 2024-09-13T06:40:15.071 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.071 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:15.071 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.071 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:15.071 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.877851+0000", 2024-09-13T06:40:15.071 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:15.071 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.071 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.071 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:15.071 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.877851+0000", 2024-09-13T06:40:15.072 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:15.072 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.072 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.072 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:15.072 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.877851+0000", 2024-09-13T06:40:15.072 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:15.072 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.072 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.072 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:15.072 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.877854+0000", 2024-09-13T06:40:15.073 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.7929999999999999e-06 2024-09-13T06:40:15.073 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.073 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.073 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:15.073 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.877864+0000", 2024-09-13T06:40:15.073 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.2029999999999998e-06 2024-09-13T06:40:15.073 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.073 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.073 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:15.073 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.877873+0000", 2024-09-13T06:40:15.073 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.0440000000000001e-06 2024-09-13T06:40:15.073 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.073 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.073 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:15.074 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.979544+0000", 2024-09-13T06:40:15.074 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101671198 2024-09-13T06:40:15.074 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.074 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.074 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:15.074 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.979658+0000", 2024-09-13T06:40:15.074 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000114456 2024-09-13T06:40:15.074 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.074 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.074 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:15.074 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.979803+0000", 2024-09-13T06:40:15.074 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000144506 2024-09-13T06:40:15.074 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:15.074 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:15.074 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:15.075 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.075 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.075 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18807 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 6242304~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:40:15.075 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.879235+0000", 2024-09-13T06:40:15.075 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 23.122109665, 2024-09-13T06:40:15.075 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101781258, 2024-09-13T06:40:15.075 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:15.075 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:15.075 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:15.075 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:15.075 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:15.075 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18807 2024-09-13T06:40:15.075 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.075 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:15.075 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.076 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:15.076 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879235+0000", 2024-09-13T06:40:15.076 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:15.076 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.076 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.076 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:15.076 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879235+0000", 2024-09-13T06:40:15.076 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:15.076 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.076 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.076 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:15.076 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879235+0000", 2024-09-13T06:40:15.076 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:15.076 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.077 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.077 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:15.077 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879239+0000", 2024-09-13T06:40:15.077 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.963e-06 2024-09-13T06:40:15.077 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.077 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.077 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:15.077 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879247+0000", 2024-09-13T06:40:15.077 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6470000000000004e-06 2024-09-13T06:40:15.077 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.077 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.077 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:15.078 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879255+0000", 2024-09-13T06:40:15.078 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5429999999999996e-06 2024-09-13T06:40:15.078 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.078 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.078 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:15.078 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.980756+0000", 2024-09-13T06:40:15.078 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10150165999999999 2024-09-13T06:40:15.078 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.078 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.078 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:15.078 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.980868+0000", 2024-09-13T06:40:15.078 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000111196 2024-09-13T06:40:15.078 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.079 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.079 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:15.079 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.981017+0000", 2024-09-13T06:40:15.079 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000148846 2024-09-13T06:40:15.079 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:15.079 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:15.079 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:15.079 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.079 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.079 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18808 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 6270976~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:40:15.079 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.879261+0000", 2024-09-13T06:40:15.079 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 23.122083526000001, 2024-09-13T06:40:15.079 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.102057547, 2024-09-13T06:40:15.080 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:15.080 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:15.080 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:15.080 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:15.080 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:15.080 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18808 2024-09-13T06:40:15.080 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.080 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:15.080 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.080 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:15.080 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879261+0000", 2024-09-13T06:40:15.080 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:15.080 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.080 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.081 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:15.081 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879261+0000", 2024-09-13T06:40:15.081 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:15.081 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.081 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.081 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:15.081 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879261+0000", 2024-09-13T06:40:15.081 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:15.081 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.081 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.081 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:15.081 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879264+0000", 2024-09-13T06:40:15.081 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.523e-06 2024-09-13T06:40:15.081 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.082 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.082 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:15.082 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879273+0000", 2024-09-13T06:40:15.082 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6070000000000008e-06 2024-09-13T06:40:15.082 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.082 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.082 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:15.082 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879280+0000", 2024-09-13T06:40:15.082 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.4699999999999996e-06 2024-09-13T06:40:15.082 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.082 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.083 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:15.083 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.981060+0000", 2024-09-13T06:40:15.083 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10177934800000001 2024-09-13T06:40:15.083 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.083 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.083 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:15.083 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.981174+0000", 2024-09-13T06:40:15.083 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000114456 2024-09-13T06:40:15.083 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.083 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.083 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:15.083 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.981319+0000", 2024-09-13T06:40:15.083 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00014473900000000001 2024-09-13T06:40:15.083 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:15.083 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:15.084 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:15.084 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.084 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.084 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18810 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 2662400~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:40:15.084 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.880386+0000", 2024-09-13T06:40:15.084 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 23.120959364000001, 2024-09-13T06:40:15.084 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101728022, 2024-09-13T06:40:15.084 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:15.085 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:15.085 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:15.085 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:15.085 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:15.085 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18810 2024-09-13T06:40:15.085 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.085 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:15.085 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.085 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:15.086 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880386+0000", 2024-09-13T06:40:15.086 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:15.086 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.086 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.086 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:15.086 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880386+0000", 2024-09-13T06:40:15.086 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:15.086 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.086 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.086 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:15.086 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880385+0000", 2024-09-13T06:40:15.086 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:15.086 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.086 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.086 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:15.087 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880389+0000", 2024-09-13T06:40:15.087 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.8539999999999999e-06 2024-09-13T06:40:15.087 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.087 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.087 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:15.087 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880398+0000", 2024-09-13T06:40:15.087 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.1689999999999998e-06 2024-09-13T06:40:15.087 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.087 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.087 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:15.087 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880405+0000", 2024-09-13T06:40:15.087 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5700000000000004e-06 2024-09-13T06:40:15.087 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.087 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.087 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:15.088 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.981833+0000", 2024-09-13T06:40:15.088 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10142791800000001 2024-09-13T06:40:15.088 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.088 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.088 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:15.088 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.981973+0000", 2024-09-13T06:40:15.088 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00014002900000000001 2024-09-13T06:40:15.088 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.088 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.088 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:15.088 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.982114+0000", 2024-09-13T06:40:15.088 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000140276 2024-09-13T06:40:15.088 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:15.088 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:15.089 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:15.089 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.089 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.089 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18811 3.9 3.140f5209 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:40:15.089 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.880449+0000", 2024-09-13T06:40:15.089 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 23.120895988000001, 2024-09-13T06:40:15.089 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101739355, 2024-09-13T06:40:15.089 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:15.089 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:40:15.089 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:15.089 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:15.089 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:15.089 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18811 2024-09-13T06:40:15.090 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.090 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:15.090 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.090 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:15.090 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880449+0000", 2024-09-13T06:40:15.090 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:15.090 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.090 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.090 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:15.090 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880449+0000", 2024-09-13T06:40:15.090 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:15.090 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.090 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.090 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:15.090 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880448+0000", 2024-09-13T06:40:15.091 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:15.091 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.091 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.091 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:15.091 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880452+0000", 2024-09-13T06:40:15.091 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0470000000000004e-06 2024-09-13T06:40:15.091 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.091 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.091 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:15.091 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880462+0000", 2024-09-13T06:40:15.091 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6530000000000006e-06 2024-09-13T06:40:15.091 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.091 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.091 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:15.092 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880472+0000", 2024-09-13T06:40:15.092 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0027000000000001e-05 2024-09-13T06:40:15.092 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.092 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.092 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:15.092 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.982172+0000", 2024-09-13T06:40:15.092 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10170043500000001 2024-09-13T06:40:15.092 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.092 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.092 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:15.092 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.982188+0000", 2024-09-13T06:40:15.092 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6172999999999999e-05 2024-09-13T06:40:15.092 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:15.093 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:15.093 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:15.093 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.093 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.093 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18812 3.9 3.140f5209 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:40:15.093 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.880478+0000", 2024-09-13T06:40:15.093 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 23.120866751000001, 2024-09-13T06:40:15.093 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10177795100000001, 2024-09-13T06:40:15.093 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:15.093 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:40:15.093 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:15.093 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:15.094 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:15.094 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18812 2024-09-13T06:40:15.094 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.094 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:15.094 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.094 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:15.094 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880478+0000", 2024-09-13T06:40:15.094 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:15.094 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.094 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.094 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:15.094 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880478+0000", 2024-09-13T06:40:15.094 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:15.094 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.095 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.095 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:15.095 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880477+0000", 2024-09-13T06:40:15.095 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:15.095 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.095 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.095 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:15.095 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880481+0000", 2024-09-13T06:40:15.095 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.827e-06 2024-09-13T06:40:15.095 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.095 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.095 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:15.095 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880490+0000", 2024-09-13T06:40:15.095 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6100000000000006e-06 2024-09-13T06:40:15.095 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.096 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.096 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:15.096 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880497+0000", 2024-09-13T06:40:15.096 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.7030000000000006e-06 2024-09-13T06:40:15.096 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.096 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.096 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:15.096 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.982241+0000", 2024-09-13T06:40:15.096 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10174351199999999 2024-09-13T06:40:15.096 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.096 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.096 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:15.097 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.982256+0000", 2024-09-13T06:40:15.097 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5143000000000001e-05 2024-09-13T06:40:15.097 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:15.097 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:15.097 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:15.097 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:15.097 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:15.097 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:40:15.099 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-13T06:40:15.099 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-13T06:40:15.099+0000 7f86a5f06640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26387) UID: 0 2024-09-13T06:40:15.200 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:40:15.197+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:40:15.269 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:40:15.269 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [], 2024-09-13T06:40:15.270 INFO:teuthology.orchestra.run.smithi139.stdout: "num_ops": 0 2024-09-13T06:40:15.270 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:40:15.283 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-13T06:40:15.329 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-13T06:40:15.331+0000 7f86a5f06640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26387) UID: 0 2024-09-13T06:40:15.402 INFO:tasks.ceph.osd.6.smithi139.stderr:2024-09-13T06:40:15.403+0000 7fcd02c5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26385) UID: 0 2024-09-13T06:40:15.406 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:40:15.407 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [], 2024-09-13T06:40:15.407 INFO:teuthology.orchestra.run.smithi139.stdout: "complaint_time": 30, 2024-09-13T06:40:15.407 INFO:teuthology.orchestra.run.smithi139.stdout: "num_blocked_ops": 0 2024-09-13T06:40:15.407 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:40:15.422 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-13T06:40:15.509 INFO:tasks.ceph.osd.6.smithi139.stderr:2024-09-13T06:40:15.511+0000 7fcd02c5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26385) UID: 0 2024-09-13T06:40:15.530 INFO:teuthology.orchestra.run.smithi081.stdout:checking clone #7, image image_client.0-clone7 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent8 2024-09-13T06:40:15.592 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:40:15.592 INFO:teuthology.orchestra.run.smithi139.stdout: "size": 20, 2024-09-13T06:40:15.593 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 600, 2024-09-13T06:40:15.593 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [ 2024-09-13T06:40:15.593 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.593 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:25885 3.1c 3:3da1e1c6:::rbd_data.1121f2c5ee81.0000000000000007:13 [read 212992~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:15.593 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.424640+0000", 2024-09-13T06:40:15.593 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 19.168293759000001, 2024-09-13T06:40:15.593 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.040449289999999999, 2024-09-13T06:40:15.593 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:15.593 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:15.593 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:15.593 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:15.593 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:15.594 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 25885 2024-09-13T06:40:15.594 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.594 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:15.594 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.594 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:15.594 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.424640+0000", 2024-09-13T06:40:15.594 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:15.594 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.594 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.594 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:15.594 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.424640+0000", 2024-09-13T06:40:15.594 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:15.594 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.595 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.595 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:15.595 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.424640+0000", 2024-09-13T06:40:15.595 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:15.595 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.595 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.595 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:15.596 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.424643+0000", 2024-09-13T06:40:15.596 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.19e-06 2024-09-13T06:40:15.596 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.596 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.596 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:15.596 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.424650+0000", 2024-09-13T06:40:15.597 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.1189999999999999e-06 2024-09-13T06:40:15.597 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.597 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.597 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:15.597 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.424656+0000", 2024-09-13T06:40:15.597 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.7780000000000004e-06 2024-09-13T06:40:15.597 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.597 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.597 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:15.597 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.464699+0000", 2024-09-13T06:40:15.597 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.040043792000000002 2024-09-13T06:40:15.597 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.597 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.598 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:15.598 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.464800+0000", 2024-09-13T06:40:15.598 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000100278 2024-09-13T06:40:15.598 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.598 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.598 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:15.598 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.465089+0000", 2024-09-13T06:40:15.598 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00028969800000000002 2024-09-13T06:40:15.598 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:15.598 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:15.598 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:15.598 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.598 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.598 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:25886 3.1c 3:3da1e1c6:::rbd_data.1121f2c5ee81.0000000000000007:13 [read 237568~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:15.599 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.424661+0000", 2024-09-13T06:40:15.599 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 19.168273395, 2024-09-13T06:40:15.599 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.040784316000000001, 2024-09-13T06:40:15.599 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:15.599 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:15.599 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:15.599 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:15.599 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:15.599 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 25886 2024-09-13T06:40:15.599 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.599 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:15.599 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.599 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:15.600 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.424661+0000", 2024-09-13T06:40:15.600 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:15.600 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.600 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.600 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:15.600 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.424661+0000", 2024-09-13T06:40:15.600 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:15.600 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.600 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.601 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:15.601 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.424660+0000", 2024-09-13T06:40:15.601 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:15.601 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.601 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.601 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:15.601 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.424672+0000", 2024-09-13T06:40:15.601 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1578e-05 2024-09-13T06:40:15.601 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.601 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.601 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:15.601 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.424680+0000", 2024-09-13T06:40:15.601 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.9489999999999996e-06 2024-09-13T06:40:15.601 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.602 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.602 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:15.602 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.424689+0000", 2024-09-13T06:40:15.602 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.0790000000000007e-06 2024-09-13T06:40:15.602 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.602 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.602 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:15.602 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.465128+0000", 2024-09-13T06:40:15.602 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.040438922000000002 2024-09-13T06:40:15.602 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.602 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.602 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:15.602 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.465210+0000", 2024-09-13T06:40:15.603 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.2853000000000001e-05 2024-09-13T06:40:15.603 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.603 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.603 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:15.603 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.465445+0000", 2024-09-13T06:40:15.603 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000234453 2024-09-13T06:40:15.603 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:15.603 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:15.603 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:15.603 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.603 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.604 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:25887 3.1c 3:3da1e1c6:::rbd_data.1121f2c5ee81.0000000000000007:13 [read 307200~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:15.604 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.425137+0000", 2024-09-13T06:40:15.604 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 19.167797073999999, 2024-09-13T06:40:15.604 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.040764531, 2024-09-13T06:40:15.604 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:15.604 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:15.604 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:15.604 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:15.604 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:15.604 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 25887 2024-09-13T06:40:15.605 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.605 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:15.605 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.605 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:15.605 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.425137+0000", 2024-09-13T06:40:15.605 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:15.605 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.605 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.605 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:15.605 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.425137+0000", 2024-09-13T06:40:15.605 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:15.605 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.605 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.606 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:15.606 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.425135+0000", 2024-09-13T06:40:15.606 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999986 2024-09-13T06:40:15.606 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.606 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.606 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:15.606 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.425160+0000", 2024-09-13T06:40:15.606 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.4423999999999999e-05 2024-09-13T06:40:15.606 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.606 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.606 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:15.606 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.425186+0000", 2024-09-13T06:40:15.606 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.6329000000000002e-05 2024-09-13T06:40:15.607 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.607 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.607 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:15.607 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.425201+0000", 2024-09-13T06:40:15.607 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5048000000000001e-05 2024-09-13T06:40:15.607 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.607 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.607 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:15.607 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.465483+0000", 2024-09-13T06:40:15.607 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.040281381999999998 2024-09-13T06:40:15.607 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.608 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.608 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:15.608 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.465575+0000", 2024-09-13T06:40:15.608 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.2794000000000006e-05 2024-09-13T06:40:15.608 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.608 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.608 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:15.608 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.465901+0000", 2024-09-13T06:40:15.608 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00032604900000000002 2024-09-13T06:40:15.608 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:15.608 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:15.608 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:15.608 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.608 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.609 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:25888 3.1c 3:3da1e1c6:::rbd_data.1121f2c5ee81.0000000000000007:13 [read 331776~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:15.609 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.425217+0000", 2024-09-13T06:40:15.609 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 19.167717327999998, 2024-09-13T06:40:15.609 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.041115250999999998, 2024-09-13T06:40:15.609 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:15.609 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:15.609 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:15.609 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:15.609 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:15.609 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 25888 2024-09-13T06:40:15.609 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.610 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:15.610 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.610 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:15.610 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.425217+0000", 2024-09-13T06:40:15.610 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:15.610 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.610 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.610 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:15.610 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.425217+0000", 2024-09-13T06:40:15.610 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:15.610 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.610 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.610 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:15.610 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.425215+0000", 2024-09-13T06:40:15.611 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:15.611 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.611 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.611 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:15.611 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.425222+0000", 2024-09-13T06:40:15.611 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.5830000000000003e-06 2024-09-13T06:40:15.611 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.611 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.611 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:15.611 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.425240+0000", 2024-09-13T06:40:15.611 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7914000000000002e-05 2024-09-13T06:40:15.611 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.611 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.612 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:15.612 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.425252+0000", 2024-09-13T06:40:15.612 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2170999999999999e-05 2024-09-13T06:40:15.612 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.612 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.612 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:15.612 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.465947+0000", 2024-09-13T06:40:15.612 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.040694755999999999 2024-09-13T06:40:15.612 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.612 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.612 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:15.612 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.466065+0000", 2024-09-13T06:40:15.612 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000117669 2024-09-13T06:40:15.613 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.613 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.613 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:15.613 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.466332+0000", 2024-09-13T06:40:15.613 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00026730500000000002 2024-09-13T06:40:15.613 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:15.613 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:15.613 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:15.613 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.613 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.613 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:25889 3.1c 3:3da1e1c6:::rbd_data.1121f2c5ee81.0000000000000007:13 [read 376832~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:15.613 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.425262+0000", 2024-09-13T06:40:15.613 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 19.167671416000001, 2024-09-13T06:40:15.613 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.041487885000000002, 2024-09-13T06:40:15.614 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:15.614 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:15.614 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:15.614 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:15.614 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:15.614 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 25889 2024-09-13T06:40:15.614 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.614 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:15.614 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.614 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:15.614 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.425262+0000", 2024-09-13T06:40:15.614 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:15.614 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.614 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.615 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:15.615 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.425262+0000", 2024-09-13T06:40:15.615 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:15.615 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.615 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.615 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:15.615 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.425262+0000", 2024-09-13T06:40:15.615 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:15.616 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.616 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.616 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:15.616 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.425267+0000", 2024-09-13T06:40:15.616 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.587e-06 2024-09-13T06:40:15.616 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.616 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.616 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:15.616 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.425284+0000", 2024-09-13T06:40:15.616 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6858999999999999e-05 2024-09-13T06:40:15.616 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.616 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.616 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:15.617 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.425295+0000", 2024-09-13T06:40:15.617 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1238e-05 2024-09-13T06:40:15.617 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.617 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.617 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:15.617 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.466371+0000", 2024-09-13T06:40:15.617 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.041075381000000001 2024-09-13T06:40:15.617 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.617 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.617 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:15.617 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.466479+0000", 2024-09-13T06:40:15.617 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000108026 2024-09-13T06:40:15.617 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.618 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.618 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:15.618 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.466750+0000", 2024-09-13T06:40:15.618 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00027173200000000001 2024-09-13T06:40:15.618 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:15.618 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:15.618 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:15.618 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.618 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.618 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:25890 3.1c 3:3da1e1c6:::rbd_data.1121f2c5ee81.0000000000000007:13 [read 401408~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:15.618 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.425305+0000", 2024-09-13T06:40:15.618 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 19.167628883999999, 2024-09-13T06:40:15.618 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.041642419999999999, 2024-09-13T06:40:15.618 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:15.619 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:15.619 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:15.619 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:15.619 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:15.619 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 25890 2024-09-13T06:40:15.619 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.619 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:15.619 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.619 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:15.619 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.425305+0000", 2024-09-13T06:40:15.619 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:15.619 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.619 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.620 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:15.620 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.425305+0000", 2024-09-13T06:40:15.620 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:15.620 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.620 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.620 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:15.620 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.425304+0000", 2024-09-13T06:40:15.620 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:15.620 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.620 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.620 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:15.620 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.425309+0000", 2024-09-13T06:40:15.620 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.0640000000000001e-06 2024-09-13T06:40:15.621 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.621 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.621 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:15.621 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.425326+0000", 2024-09-13T06:40:15.621 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6855e-05 2024-09-13T06:40:15.621 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.621 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.621 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:15.621 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.425346+0000", 2024-09-13T06:40:15.621 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.0387999999999999e-05 2024-09-13T06:40:15.621 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.621 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.622 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:15.622 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.466796+0000", 2024-09-13T06:40:15.622 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.041449062000000002 2024-09-13T06:40:15.622 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.622 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.622 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:15.622 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.466859+0000", 2024-09-13T06:40:15.623 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.3682000000000005e-05 2024-09-13T06:40:15.623 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.623 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.623 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:15.623 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.466947+0000", 2024-09-13T06:40:15.623 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.8220999999999994e-05 2024-09-13T06:40:15.623 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:15.623 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:15.623 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:15.623 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.623 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.623 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:25891 3.1c 3:3da1e1c6:::rbd_data.1121f2c5ee81.0000000000000007:13 [read 471040~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:15.623 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.425357+0000", 2024-09-13T06:40:15.624 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 19.167577013999999, 2024-09-13T06:40:15.624 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.042016413000000002, 2024-09-13T06:40:15.624 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:15.624 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:15.624 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:15.624 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:15.624 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:15.624 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 25891 2024-09-13T06:40:15.624 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.624 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:15.624 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.624 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:15.624 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.425357+0000", 2024-09-13T06:40:15.625 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:15.625 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.625 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.625 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:15.625 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.425357+0000", 2024-09-13T06:40:15.625 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:15.625 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.625 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.625 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:15.625 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.425356+0000", 2024-09-13T06:40:15.625 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:15.625 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.625 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.626 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:15.626 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.425361+0000", 2024-09-13T06:40:15.626 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.2340000000000002e-06 2024-09-13T06:40:15.626 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.626 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.626 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:15.626 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.425377+0000", 2024-09-13T06:40:15.626 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6087e-05 2024-09-13T06:40:15.626 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.626 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.626 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:15.626 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.425391+0000", 2024-09-13T06:40:15.626 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3580999999999999e-05 2024-09-13T06:40:15.626 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.627 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.627 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:15.627 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.466995+0000", 2024-09-13T06:40:15.627 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.041604527000000002 2024-09-13T06:40:15.627 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.627 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.627 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:15.628 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.467100+0000", 2024-09-13T06:40:15.628 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00010417299999999999 2024-09-13T06:40:15.628 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.628 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.628 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:15.628 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.467373+0000", 2024-09-13T06:40:15.628 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00027376800000000003 2024-09-13T06:40:15.628 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:15.628 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:15.628 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:15.629 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.629 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.629 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:25892 3.1c 3:3da1e1c6:::rbd_data.1121f2c5ee81.0000000000000007:13 [read 495616~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:15.629 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.425401+0000", 2024-09-13T06:40:15.629 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 19.167532962999999, 2024-09-13T06:40:15.630 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.042422195000000003, 2024-09-13T06:40:15.630 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:15.630 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:15.630 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:15.630 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:15.630 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:15.630 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 25892 2024-09-13T06:40:15.630 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.630 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:15.630 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.630 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:15.630 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.425401+0000", 2024-09-13T06:40:15.630 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:15.631 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.631 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.631 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:15.631 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.425401+0000", 2024-09-13T06:40:15.631 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:15.631 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.631 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.631 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:15.631 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.425400+0000", 2024-09-13T06:40:15.631 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:15.631 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.631 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.631 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:15.632 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.425405+0000", 2024-09-13T06:40:15.632 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.4389999999999999e-06 2024-09-13T06:40:15.632 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.632 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.632 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:15.632 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.425419+0000", 2024-09-13T06:40:15.632 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3593e-05 2024-09-13T06:40:15.632 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.632 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.632 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:15.632 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.425430+0000", 2024-09-13T06:40:15.632 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0774999999999999e-05 2024-09-13T06:40:15.633 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.633 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.633 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:15.633 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.467438+0000", 2024-09-13T06:40:15.633 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.042008570000000002 2024-09-13T06:40:15.633 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.633 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.633 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:15.633 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.467531+0000", 2024-09-13T06:40:15.633 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.2857999999999998e-05 2024-09-13T06:40:15.633 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.633 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.633 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:15.633 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.467823+0000", 2024-09-13T06:40:15.634 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000291945 2024-09-13T06:40:15.634 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:15.634 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:15.634 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:15.634 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.634 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.634 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:26021 3.c 3:3566b607:::rbd_data.1121f2c5ee81.0000000000000012:13 [read 225280~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:15.634 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.429042+0000", 2024-09-13T06:40:15.634 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 19.163891952, 2024-09-13T06:40:15.634 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.040384481, 2024-09-13T06:40:15.634 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:15.634 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:15.634 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:15.635 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:15.635 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:15.635 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 26021 2024-09-13T06:40:15.635 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.635 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:15.635 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.635 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:15.635 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.429042+0000", 2024-09-13T06:40:15.635 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:15.635 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.635 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.635 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:15.635 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.429042+0000", 2024-09-13T06:40:15.635 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:15.636 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.636 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.636 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:15.636 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.429041+0000", 2024-09-13T06:40:15.636 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:15.636 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.636 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.636 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:15.636 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.429046+0000", 2024-09-13T06:40:15.636 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.6600000000000003e-06 2024-09-13T06:40:15.636 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.636 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.637 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:15.637 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.429060+0000", 2024-09-13T06:40:15.637 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3747000000000001e-05 2024-09-13T06:40:15.637 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.637 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.637 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:15.637 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.429069+0000", 2024-09-13T06:40:15.637 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.5659999999999996e-06 2024-09-13T06:40:15.637 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.637 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.637 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:15.637 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.469091+0000", 2024-09-13T06:40:15.637 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.040021811999999997 2024-09-13T06:40:15.638 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.638 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.638 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:15.638 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.469170+0000", 2024-09-13T06:40:15.638 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.9498000000000004e-05 2024-09-13T06:40:15.638 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.638 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.638 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:15.638 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.469426+0000", 2024-09-13T06:40:15.638 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00025596800000000003 2024-09-13T06:40:15.638 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:15.638 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:15.638 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:15.638 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.639 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.639 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:26022 3.c 3:3566b607:::rbd_data.1121f2c5ee81.0000000000000012:13 [read 249856~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:15.639 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.429079+0000", 2024-09-13T06:40:15.639 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 19.163855359999999, 2024-09-13T06:40:15.639 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.040733327, 2024-09-13T06:40:15.639 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:15.639 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:15.639 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:15.639 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:15.639 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:15.639 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 26022 2024-09-13T06:40:15.639 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.639 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:15.640 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.640 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:15.640 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.429079+0000", 2024-09-13T06:40:15.640 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:15.640 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.640 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.640 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:15.640 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.429079+0000", 2024-09-13T06:40:15.640 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:15.640 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.640 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.640 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:15.640 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.429078+0000", 2024-09-13T06:40:15.641 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:15.641 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.641 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.641 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:15.641 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.429083+0000", 2024-09-13T06:40:15.641 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.8069999999999999e-06 2024-09-13T06:40:15.641 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.641 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.641 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:15.641 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.429096+0000", 2024-09-13T06:40:15.641 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3665e-05 2024-09-13T06:40:15.641 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.641 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.642 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:15.642 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.429106+0000", 2024-09-13T06:40:15.642 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.8460000000000003e-06 2024-09-13T06:40:15.642 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.642 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.642 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:15.642 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.469479+0000", 2024-09-13T06:40:15.642 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.04037259 2024-09-13T06:40:15.642 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.642 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.642 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:15.642 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.469564+0000", 2024-09-13T06:40:15.642 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.5669999999999998e-05 2024-09-13T06:40:15.643 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.643 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.643 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:15.643 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.469812+0000", 2024-09-13T06:40:15.643 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00024753699999999998 2024-09-13T06:40:15.643 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:15.643 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:15.643 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:15.643 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.643 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.643 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:26023 3.c 3:3566b607:::rbd_data.1121f2c5ee81.0000000000000012:13 [read 294912~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:15.643 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.429115+0000", 2024-09-13T06:40:15.643 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 19.163818940999999, 2024-09-13T06:40:15.643 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.041079490000000003, 2024-09-13T06:40:15.644 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:15.644 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:15.644 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:15.644 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:15.644 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:15.644 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 26023 2024-09-13T06:40:15.644 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.644 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:15.644 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.644 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:15.644 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.429115+0000", 2024-09-13T06:40:15.644 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:15.644 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.645 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.645 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:15.645 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.429115+0000", 2024-09-13T06:40:15.645 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:15.645 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.645 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.645 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:15.645 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.429114+0000", 2024-09-13T06:40:15.645 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:15.645 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.645 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.645 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:15.645 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.429119+0000", 2024-09-13T06:40:15.646 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.0189999999999997e-06 2024-09-13T06:40:15.646 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.646 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.646 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:15.646 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.429137+0000", 2024-09-13T06:40:15.646 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.8087000000000001e-05 2024-09-13T06:40:15.646 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.646 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.646 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:15.646 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.429148+0000", 2024-09-13T06:40:15.646 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0740999999999999e-05 2024-09-13T06:40:15.646 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.646 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.647 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:15.647 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.469861+0000", 2024-09-13T06:40:15.647 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.040713271000000002 2024-09-13T06:40:15.647 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.647 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.647 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:15.647 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.469954+0000", 2024-09-13T06:40:15.647 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.2917000000000005e-05 2024-09-13T06:40:15.647 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.647 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.647 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:15.647 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.470194+0000", 2024-09-13T06:40:15.647 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00024033099999999999 2024-09-13T06:40:15.648 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:15.648 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:15.648 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:15.648 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.648 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.648 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:26024 3.c 3:3566b607:::rbd_data.1121f2c5ee81.0000000000000012:13 [read 319488~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:15.648 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.429157+0000", 2024-09-13T06:40:15.648 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 19.163776412000001, 2024-09-13T06:40:15.648 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.041386232000000002, 2024-09-13T06:40:15.648 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:15.648 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:15.648 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:15.648 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:15.649 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:15.649 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 26024 2024-09-13T06:40:15.649 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.649 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:15.649 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.649 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:15.649 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.429157+0000", 2024-09-13T06:40:15.649 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:15.649 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.649 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.649 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:15.649 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.429157+0000", 2024-09-13T06:40:15.649 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:15.650 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.650 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.650 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:15.650 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.429157+0000", 2024-09-13T06:40:15.650 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:15.650 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.650 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.650 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:15.650 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.429162+0000", 2024-09-13T06:40:15.650 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.3820000000000003e-06 2024-09-13T06:40:15.650 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.650 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.650 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:15.651 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.429175+0000", 2024-09-13T06:40:15.651 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2797e-05 2024-09-13T06:40:15.651 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.651 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.651 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:15.651 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.429185+0000", 2024-09-13T06:40:15.651 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0016e-05 2024-09-13T06:40:15.651 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.651 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.651 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:15.651 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.470233+0000", 2024-09-13T06:40:15.651 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.041047868000000001 2024-09-13T06:40:15.651 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.652 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.652 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:15.652 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.470280+0000", 2024-09-13T06:40:15.652 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.7422000000000001e-05 2024-09-13T06:40:15.652 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.652 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.652 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:15.652 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.470544+0000", 2024-09-13T06:40:15.652 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00026366399999999999 2024-09-13T06:40:15.652 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:15.652 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:15.652 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:15.652 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.653 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.653 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:26025 3.c 3:3566b607:::rbd_data.1121f2c5ee81.0000000000000012:13 [read 389120~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:15.653 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.429194+0000", 2024-09-13T06:40:15.653 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 19.163740051000001, 2024-09-13T06:40:15.653 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.041722952000000001, 2024-09-13T06:40:15.653 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:15.653 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:15.653 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:15.653 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:15.653 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:15.653 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 26025 2024-09-13T06:40:15.653 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.653 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:15.653 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.654 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:15.654 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.429194+0000", 2024-09-13T06:40:15.654 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:15.654 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.654 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.654 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:15.654 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.429194+0000", 2024-09-13T06:40:15.654 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:15.654 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.654 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.654 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:15.654 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.429193+0000", 2024-09-13T06:40:15.654 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:15.654 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.655 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.655 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:15.655 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.429206+0000", 2024-09-13T06:40:15.655 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3008e-05 2024-09-13T06:40:15.655 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.655 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.655 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:15.655 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.429220+0000", 2024-09-13T06:40:15.655 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.4398e-05 2024-09-13T06:40:15.655 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.655 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.655 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:15.655 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.429230+0000", 2024-09-13T06:40:15.656 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.4280000000000002e-06 2024-09-13T06:40:15.656 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.656 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.656 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:15.656 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.470584+0000", 2024-09-13T06:40:15.656 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.041354512000000003 2024-09-13T06:40:15.656 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.656 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.656 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:15.656 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.470648+0000", 2024-09-13T06:40:15.656 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.3163999999999994e-05 2024-09-13T06:40:15.656 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.657 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.657 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:15.657 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.470917+0000", 2024-09-13T06:40:15.657 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00026928199999999997 2024-09-13T06:40:15.657 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:15.657 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:15.657 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:15.657 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.657 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.657 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:26026 3.c 3:3566b607:::rbd_data.1121f2c5ee81.0000000000000012:13 [read 413696~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:15.657 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.429240+0000", 2024-09-13T06:40:15.657 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 19.163694063000001, 2024-09-13T06:40:15.657 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.041996092999999998, 2024-09-13T06:40:15.658 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:15.658 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:15.658 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:15.658 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:15.658 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:15.658 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 26026 2024-09-13T06:40:15.658 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.658 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:15.658 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.658 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:15.658 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.429240+0000", 2024-09-13T06:40:15.658 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:15.658 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.659 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.659 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:15.659 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.429240+0000", 2024-09-13T06:40:15.659 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:15.659 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.659 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.659 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:15.659 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.429239+0000", 2024-09-13T06:40:15.659 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:15.659 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.659 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.659 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:15.659 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.429244+0000", 2024-09-13T06:40:15.660 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.0989999999999998e-06 2024-09-13T06:40:15.660 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.660 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.660 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:15.660 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.429257+0000", 2024-09-13T06:40:15.660 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.296e-05 2024-09-13T06:40:15.660 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.660 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.660 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:15.660 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.429268+0000", 2024-09-13T06:40:15.660 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0971999999999999e-05 2024-09-13T06:40:15.660 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.660 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.660 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:15.661 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.470962+0000", 2024-09-13T06:40:15.661 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.041694426 2024-09-13T06:40:15.661 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.661 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.661 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:15.661 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.471024+0000", 2024-09-13T06:40:15.661 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.1741000000000004e-05 2024-09-13T06:40:15.661 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.661 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.661 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:15.661 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.471236+0000", 2024-09-13T06:40:15.661 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00021181100000000001 2024-09-13T06:40:15.661 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:15.662 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:15.662 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:15.662 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.662 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.662 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:26146 3.1c 3:3da1e1c6:::rbd_data.1121f2c5ee81.0000000000000007:13 [read 425984~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:15.662 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.434603+0000", 2024-09-13T06:40:15.662 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 19.158330566, 2024-09-13T06:40:15.662 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.040125802000000002, 2024-09-13T06:40:15.662 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:15.662 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:15.662 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:15.662 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:15.662 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:15.663 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 26146 2024-09-13T06:40:15.663 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.663 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:15.663 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.663 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:15.663 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.434603+0000", 2024-09-13T06:40:15.663 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:15.663 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.663 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.663 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:15.663 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.434603+0000", 2024-09-13T06:40:15.663 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:15.663 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.664 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.664 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:15.664 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.434602+0000", 2024-09-13T06:40:15.664 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999986 2024-09-13T06:40:15.664 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.664 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.664 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:15.664 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.434609+0000", 2024-09-13T06:40:15.664 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.1380000000000001e-06 2024-09-13T06:40:15.664 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.664 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.664 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:15.664 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.434621+0000", 2024-09-13T06:40:15.664 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2164000000000001e-05 2024-09-13T06:40:15.665 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.665 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.665 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:15.665 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.434629+0000", 2024-09-13T06:40:15.665 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.0669999999999992e-06 2024-09-13T06:40:15.665 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.665 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.665 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:15.665 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.474400+0000", 2024-09-13T06:40:15.665 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039770755999999997 2024-09-13T06:40:15.665 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.665 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.665 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:15.666 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.474483+0000", 2024-09-13T06:40:15.666 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.3238000000000005e-05 2024-09-13T06:40:15.666 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.666 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.666 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:15.666 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.474729+0000", 2024-09-13T06:40:15.666 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00024571499999999997 2024-09-13T06:40:15.666 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:15.666 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:15.666 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:15.666 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.666 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.666 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:26147 3.1c 3:3da1e1c6:::rbd_data.1121f2c5ee81.0000000000000007:13 [read 450560~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:15.666 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.434635+0000", 2024-09-13T06:40:15.667 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 19.158299115999998, 2024-09-13T06:40:15.667 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.040501387, 2024-09-13T06:40:15.667 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:15.667 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:15.667 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:15.667 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:15.667 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:15.667 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 26147 2024-09-13T06:40:15.667 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.667 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:15.667 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.667 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:15.667 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.434635+0000", 2024-09-13T06:40:15.667 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:15.668 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.668 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.668 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:15.668 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.434635+0000", 2024-09-13T06:40:15.668 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:15.668 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.668 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.668 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:15.668 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.434634+0000", 2024-09-13T06:40:15.668 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:15.668 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.668 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.668 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:15.668 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.434637+0000", 2024-09-13T06:40:15.669 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.0180000000000002e-06 2024-09-13T06:40:15.669 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.669 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.669 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:15.669 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.434643+0000", 2024-09-13T06:40:15.669 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.5380000000000002e-06 2024-09-13T06:40:15.669 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.669 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.669 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:15.669 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.434647+0000", 2024-09-13T06:40:15.669 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.5379999999999996e-06 2024-09-13T06:40:15.669 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.669 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.670 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:15.670 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.474784+0000", 2024-09-13T06:40:15.670 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.040136731000000002 2024-09-13T06:40:15.670 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.670 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.670 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:15.670 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.474879+0000", 2024-09-13T06:40:15.670 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.5274999999999998e-05 2024-09-13T06:40:15.670 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.670 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.670 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:15.670 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.475136+0000", 2024-09-13T06:40:15.670 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00025693999999999999 2024-09-13T06:40:15.670 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:15.671 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:15.671 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:15.671 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.671 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.671 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:26148 3.1c 3:3da1e1c6:::rbd_data.1121f2c5ee81.0000000000000007:13 [read 520192~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:15.671 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.434651+0000", 2024-09-13T06:40:15.671 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 19.158282616000001, 2024-09-13T06:40:15.671 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.040853773000000003, 2024-09-13T06:40:15.671 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:15.671 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:15.671 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:15.671 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:15.671 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:15.672 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 26148 2024-09-13T06:40:15.672 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.672 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:15.672 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.672 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:15.672 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.434651+0000", 2024-09-13T06:40:15.672 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:15.672 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.672 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.672 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:15.672 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.434651+0000", 2024-09-13T06:40:15.672 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:15.672 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.673 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.673 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:15.673 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.434651+0000", 2024-09-13T06:40:15.673 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:15.673 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.673 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.673 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:15.673 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.434653+0000", 2024-09-13T06:40:15.673 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.4509999999999999e-06 2024-09-13T06:40:15.673 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.673 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.673 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:15.673 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.434659+0000", 2024-09-13T06:40:15.673 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.1930000000000001e-06 2024-09-13T06:40:15.674 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.674 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.674 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:15.674 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.434664+0000", 2024-09-13T06:40:15.674 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.7400000000000001e-06 2024-09-13T06:40:15.674 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.674 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.674 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:15.674 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.475194+0000", 2024-09-13T06:40:15.674 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.040530123000000001 2024-09-13T06:40:15.674 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.674 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.674 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:15.674 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.475300+0000", 2024-09-13T06:40:15.675 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000106 2024-09-13T06:40:15.675 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.675 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.675 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:15.675 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.475505+0000", 2024-09-13T06:40:15.675 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00020465199999999999 2024-09-13T06:40:15.675 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:15.675 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:15.675 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:15.675 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.675 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.675 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:28049 3.1d 3:b83606fe:::rbd_data.1121f2c5ee81.000000000000001b:13 [read 475136~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:15.675 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.661622+0000", 2024-09-13T06:40:15.676 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 18.931311733000001, 2024-09-13T06:40:15.676 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.040354183000000002, 2024-09-13T06:40:15.676 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:15.676 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:15.676 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:15.676 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:15.676 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:15.676 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 28049 2024-09-13T06:40:15.676 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.676 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:15.676 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.676 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:15.676 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.661622+0000", 2024-09-13T06:40:15.676 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:15.677 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.677 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.677 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:15.677 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.661622+0000", 2024-09-13T06:40:15.677 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:15.677 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.677 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.677 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:15.677 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.661621+0000", 2024-09-13T06:40:15.677 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999986 2024-09-13T06:40:15.677 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.677 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.677 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:15.678 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.661627+0000", 2024-09-13T06:40:15.678 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.2450000000000003e-06 2024-09-13T06:40:15.678 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.678 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.678 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:15.678 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.661643+0000", 2024-09-13T06:40:15.678 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5860999999999999e-05 2024-09-13T06:40:15.678 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.678 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.678 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:15.678 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.661656+0000", 2024-09-13T06:40:15.678 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3524e-05 2024-09-13T06:40:15.678 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.679 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.679 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:15.679 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.701307+0000", 2024-09-13T06:40:15.679 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039650336000000001 2024-09-13T06:40:15.679 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.679 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.679 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:15.679 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.701418+0000", 2024-09-13T06:40:15.679 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000111333 2024-09-13T06:40:15.679 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.679 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.679 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:15.679 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.701976+0000", 2024-09-13T06:40:15.679 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000558247 2024-09-13T06:40:15.680 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:15.680 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:15.680 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:15.680 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.680 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.680 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:39085 3.1d 3:beb6f89d:::rbd_data.11216b5b8320.000000000000000c:head [set-alloc-hint object_size 8388608 write_size 8388608,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-13T06:40:15.680 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:10.362427+0000", 2024-09-13T06:40:15.680 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 5.2305065339999999, 2024-09-13T06:40:15.680 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.060680485999999999, 2024-09-13T06:40:15.680 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:15.680 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:40:15.680 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:15.680 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:15.681 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:15.681 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 39085 2024-09-13T06:40:15.681 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.681 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:15.681 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.681 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:15.681 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:10.362427+0000", 2024-09-13T06:40:15.681 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:15.681 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.681 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.681 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:15.681 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:10.362427+0000", 2024-09-13T06:40:15.681 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:15.681 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.682 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.682 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:15.682 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:10.362425+0000", 2024-09-13T06:40:15.682 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999976 2024-09-13T06:40:15.682 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.682 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.682 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:15.682 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:10.362439+0000", 2024-09-13T06:40:15.682 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.437e-05 2024-09-13T06:40:15.682 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.682 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.682 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:15.682 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:10.362469+0000", 2024-09-13T06:40:15.682 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.9556e-05 2024-09-13T06:40:15.683 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.683 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.683 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:15.683 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:10.362483+0000", 2024-09-13T06:40:15.683 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.4701999999999999e-05 2024-09-13T06:40:15.683 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.683 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.683 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:15.683 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:10.362624+0000", 2024-09-13T06:40:15.683 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000140295 2024-09-13T06:40:15.683 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.683 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.683 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:15.684 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:10.362861+0000", 2024-09-13T06:40:15.684 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00023738700000000001 2024-09-13T06:40:15.684 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.684 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.684 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 4", 2024-09-13T06:40:15.684 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:10.372495+0000", 2024-09-13T06:40:15.684 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0096338710000000004 2024-09-13T06:40:15.684 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.684 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.684 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-13T06:40:15.684 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:10.422838+0000", 2024-09-13T06:40:15.684 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.050342944000000001 2024-09-13T06:40:15.684 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.685 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.685 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:40:15.685 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:10.423007+0000", 2024-09-13T06:40:15.685 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00016926800000000001 2024-09-13T06:40:15.685 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.685 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.685 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-13T06:40:15.685 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:10.423062+0000", 2024-09-13T06:40:15.685 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.4911999999999999e-05 2024-09-13T06:40:15.685 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.685 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.685 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:15.685 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:10.423108+0000", 2024-09-13T06:40:15.685 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.5674999999999999e-05 2024-09-13T06:40:15.686 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:15.686 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:15.686 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:15.686 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.686 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.686 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:39407 3.5 3:a322b6b3:::rbd_data.11216b5b8320.000000000000000a:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-13T06:40:15.686 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:11.110502+0000", 2024-09-13T06:40:15.686 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 4.4824315490000002, 2024-09-13T06:40:15.686 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.056837161999999997, 2024-09-13T06:40:15.686 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:15.686 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:40:15.686 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:15.686 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:15.686 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:15.687 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 39407 2024-09-13T06:40:15.687 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.687 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:15.687 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.687 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:15.687 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:11.110502+0000", 2024-09-13T06:40:15.687 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:15.687 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.687 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.687 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:15.687 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:11.110502+0000", 2024-09-13T06:40:15.687 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:15.687 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.688 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.688 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:15.688 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:11.110499+0000", 2024-09-13T06:40:15.688 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999971 2024-09-13T06:40:15.688 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.688 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.688 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:15.688 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:11.110516+0000", 2024-09-13T06:40:15.688 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6662000000000001e-05 2024-09-13T06:40:15.688 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.688 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.688 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:15.688 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:11.110552+0000", 2024-09-13T06:40:15.688 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.6149000000000002e-05 2024-09-13T06:40:15.689 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.689 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.689 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:15.689 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:11.110572+0000", 2024-09-13T06:40:15.689 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.9698e-05 2024-09-13T06:40:15.689 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.689 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.689 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:15.689 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:11.110700+0000", 2024-09-13T06:40:15.689 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00012795600000000001 2024-09-13T06:40:15.689 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.689 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.689 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:15.689 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:11.110849+0000", 2024-09-13T06:40:15.690 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000148963 2024-09-13T06:40:15.690 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.690 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.690 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 3", 2024-09-13T06:40:15.690 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:11.125009+0000", 2024-09-13T06:40:15.690 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.014159859 2024-09-13T06:40:15.690 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.690 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.690 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:40:15.690 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:11.167211+0000", 2024-09-13T06:40:15.690 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.042202866999999998 2024-09-13T06:40:15.690 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.690 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.690 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-13T06:40:15.691 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:11.167228+0000", 2024-09-13T06:40:15.691 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6969999999999998e-05 2024-09-13T06:40:15.691 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.691 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.691 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-13T06:40:15.691 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:11.167292+0000", 2024-09-13T06:40:15.691 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.3361000000000005e-05 2024-09-13T06:40:15.691 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:15.691 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:15.691 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:15.691 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:11.167340+0000", 2024-09-13T06:40:15.691 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.7722999999999997e-05 2024-09-13T06:40:15.691 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:15.691 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:15.692 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:15.692 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:15.692 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:15.692 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:40:15.693 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-13T06:40:15.694 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:40:15.693+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:40:15.794 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:40:15.793+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:40:15.822 INFO:teuthology.orchestra.run.smithi081.stdout:1598 punch from 0x265b53 to 0x273776, (0xdc23 bytes) 2024-09-13T06:40:15.831 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6] out_osds: [7] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-13T06:40:15.831 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-13T06:40:15.831 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap 2024-09-13T06:40:15.832 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-09-13T06:40:15.840 INFO:teuthology.orchestra.run.smithi081.stdout:1599 writesame 0x208087e thru 0x2086588 data_size 0x1(0x5d0b bytes) 2024-09-13T06:40:15.840 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:40:15.867 INFO:teuthology.orchestra.run.smithi081.stdout:1602 write 0xd018a33 thru 0xd026d01 (0xe2cf bytes) 2024-09-13T06:40:15.870 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:40:15.870 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [], 2024-09-13T06:40:15.870 INFO:teuthology.orchestra.run.smithi139.stdout: "num_ops": 0 2024-09-13T06:40:15.870 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:40:15.873 INFO:teuthology.orchestra.run.smithi081.stdout:1604 read 0x3b8c36a thru 0x3b98c0a (0xc8a1 bytes) 2024-09-13T06:40:15.873 INFO:teuthology.orchestra.run.smithi081.stdout:1605 writesame 0x71f3685 thru 0x71fd3ee data_size 0x1(0x9d6a bytes) 2024-09-13T06:40:15.886 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-13T06:40:15.931 INFO:teuthology.orchestra.run.smithi081.stdout:1606 trunc from 0xd026d02 to 0x2554113 2024-09-13T06:40:15.933 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-13T06:40:15.935+0000 7f86a5f06640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26387) UID: 0 2024-09-13T06:40:15.948 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:40:15.948 INFO:teuthology.orchestra.run.smithi081.stdout:1608 read 0xcadbd8 thru 0xcb7325 (0x974e bytes) 2024-09-13T06:40:15.948 INFO:teuthology.orchestra.run.smithi081.stdout:1609 read 0xf73746 thru 0xf7e2dd (0xab98 bytes) 2024-09-13T06:40:15.958 INFO:teuthology.orchestra.run.smithi081.stdout:1611 trunc from 0x2554113 to 0x858902f 2024-09-13T06:40:15.977 INFO:teuthology.orchestra.run.smithi081.stdout:1612 trunc from 0x858902f to 0x1ae2556 2024-09-13T06:40:15.985 INFO:teuthology.orchestra.run.smithi081.stdout:1613 writesame 0x14337c9 thru 0x1439537 data_size 0x33(0x5d6f bytes) 2024-09-13T06:40:15.989 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:40:15.991 INFO:teuthology.orchestra.run.smithi081.stdout:1616 trunc from 0x1ae2556 to 0x3009287 2024-09-13T06:40:15.995 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:40:15.995+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:40:16.009 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:40:16.010 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [], 2024-09-13T06:40:16.010 INFO:teuthology.orchestra.run.smithi139.stdout: "complaint_time": 30, 2024-09-13T06:40:16.010 INFO:teuthology.orchestra.run.smithi139.stdout: "num_blocked_ops": 0 2024-09-13T06:40:16.010 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:40:16.023 INFO:teuthology.orchestra.run.smithi081.stdout:1617 write 0xb128595 thru 0xb12da77 (0x54e3 bytes) 2024-09-13T06:40:16.025 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-13T06:40:16.028 INFO:teuthology.orchestra.run.smithi081.stdout:1618 writesame 0x57c6846 thru 0x57c782c data_size 0x3(0xfe7 bytes) 2024-09-13T06:40:16.035 INFO:teuthology.orchestra.run.smithi081.stdout:1619 writesame 0x492069 thru 0x4a036b data_size 0x3b(0xe303 bytes) 2024-09-13T06:40:16.040 INFO:teuthology.orchestra.run.smithi081.stdout:1620 write 0x5dbc796 thru 0x5dc1ccd (0x5538 bytes) 2024-09-13T06:40:16.048 INFO:teuthology.orchestra.run.smithi081.stdout:1621 writesame 0x32baee9 thru 0x32c75e7 data_size 0x1(0xc6ff bytes) 2024-09-13T06:40:16.097 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:40:16.097+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:40:16.097 INFO:teuthology.orchestra.run.smithi081.stdout:1622 write 0xc3731f thru 0xc41fe7 (0xacc9 bytes) 2024-09-13T06:40:16.103 INFO:teuthology.orchestra.run.smithi081.stdout:1623 write 0x862fa7 thru 0x871cdb (0xed35 bytes) 2024-09-13T06:40:16.109 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:40:16.110 INFO:teuthology.orchestra.run.smithi081.stdout:1627 write 0x47e3328 thru 0x47eb50d (0x81e6 bytes) 2024-09-13T06:40:16.114 INFO:teuthology.orchestra.run.smithi081.stdout:1629 punch from 0x6ee6894 to 0x6ef40a1, (0xd80d bytes) 2024-09-13T06:40:16.114 INFO:teuthology.orchestra.run.smithi081.stdout:1630 write 0x5bd6e84 thru 0x5be588c (0xea09 bytes) 2024-09-13T06:40:16.120 INFO:teuthology.orchestra.run.smithi081.stdout:1632 write 0x19f9296 thru 0x19f9ded (0xb58 bytes) 2024-09-13T06:40:16.124 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:40:16.124 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:40:16.125 INFO:teuthology.orchestra.run.smithi081.stdout:1635 write 0xb523fe thru 0xb5a352 (0x7f55 bytes) 2024-09-13T06:40:16.129 INFO:teuthology.orchestra.run.smithi081.stdout:1637 read 0x50f70b9 thru 0x50fa96d (0x38b5 bytes) 2024-09-13T06:40:16.129 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:40:16.129 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:40:16.129 INFO:teuthology.orchestra.run.smithi081.stdout:1641 read 0x7bbad41 thru 0x7bbae42 (0x102 bytes) 2024-09-13T06:40:16.129 INFO:teuthology.orchestra.run.smithi081.stdout:1642 writesame 0x9829830 thru 0x9832c5c data_size 0x1(0x942d bytes) 2024-09-13T06:40:16.162 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T06:40:16.162 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:40:16.162 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 63, 2024-09-13T06:40:16.162 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "e5612297-d004-4957-927e-afa37f30d6cf", 2024-09-13T06:40:16.162 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-09-13T06:38:56.670231+0000", 2024-09-13T06:40:16.163 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-09-13T06:40:15.417389+0000", 2024-09-13T06:40:16.163 INFO:teuthology.orchestra.run.smithi081.stdout: "last_up_change": "2024-09-13T06:39:09.107597+0000", 2024-09-13T06:40:16.163 INFO:teuthology.orchestra.run.smithi081.stdout: "last_in_change": "2024-09-13T06:39:48.513717+0000", 2024-09-13T06:40:16.163 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": "noscrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-13T06:40:16.163 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_num": 5801984, 2024-09-13T06:40:16.163 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_set": [ 2024-09-13T06:40:16.163 INFO:teuthology.orchestra.run.smithi081.stdout: "noscrub", 2024-09-13T06:40:16.163 INFO:teuthology.orchestra.run.smithi081.stdout: "pglog_hardlimit", 2024-09-13T06:40:16.163 INFO:teuthology.orchestra.run.smithi081.stdout: "purged_snapdirs", 2024-09-13T06:40:16.164 INFO:teuthology.orchestra.run.smithi081.stdout: "recovery_deletes", 2024-09-13T06:40:16.164 INFO:teuthology.orchestra.run.smithi081.stdout: "sortbitwise" 2024-09-13T06:40:16.164 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-13T06:40:16.164 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_version": 4, 2024-09-13T06:40:16.164 INFO:teuthology.orchestra.run.smithi081.stdout: "full_ratio": 0.94999998807907104, 2024-09-13T06:40:16.164 INFO:teuthology.orchestra.run.smithi081.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-09-13T06:40:16.164 INFO:teuthology.orchestra.run.smithi081.stdout: "nearfull_ratio": 0.85000002384185791, 2024-09-13T06:40:16.164 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_snapshot": "", 2024-09-13T06:40:16.164 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_max": 3, 2024-09-13T06:40:16.164 INFO:teuthology.orchestra.run.smithi081.stdout: "max_osd": 8, 2024-09-13T06:40:16.164 INFO:teuthology.orchestra.run.smithi081.stdout: "require_min_compat_client": "luminous", 2024-09-13T06:40:16.164 INFO:teuthology.orchestra.run.smithi081.stdout: "min_compat_client": "luminous", 2024-09-13T06:40:16.165 INFO:teuthology.orchestra.run.smithi081.stdout: "require_osd_release": "reef", 2024-09-13T06:40:16.165 INFO:teuthology.orchestra.run.smithi081.stdout: "allow_crimson": false, 2024-09-13T06:40:16.165 INFO:teuthology.orchestra.run.smithi081.stdout: "pools": [ 2024-09-13T06:40:16.165 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:16.165 INFO:teuthology.orchestra.run.smithi081.stdout: "pool": 1, 2024-09-13T06:40:16.165 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_name": ".mgr", 2024-09-13T06:40:16.165 INFO:teuthology.orchestra.run.smithi081.stdout: "create_time": "2024-09-13T06:39:09.600726+0000", 2024-09-13T06:40:16.165 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-13T06:40:16.165 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_names": "hashpspool", 2024-09-13T06:40:16.165 INFO:teuthology.orchestra.run.smithi081.stdout: "type": 1, 2024-09-13T06:40:16.165 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 2, 2024-09-13T06:40:16.165 INFO:teuthology.orchestra.run.smithi081.stdout: "min_size": 1, 2024-09-13T06:40:16.166 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_rule": 0, 2024-09-13T06:40:16.166 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_count": 0, 2024-09-13T06:40:16.166 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_target": 0, 2024-09-13T06:40:16.166 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_barrier": 0, 2024-09-13T06:40:16.166 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-13T06:40:16.166 INFO:teuthology.orchestra.run.smithi081.stdout: "object_hash": 2, 2024-09-13T06:40:16.166 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_mode": "off", 2024-09-13T06:40:16.166 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num": 1, 2024-09-13T06:40:16.166 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num": 1, 2024-09-13T06:40:16.166 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num_target": 1, 2024-09-13T06:40:16.166 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_target": 1, 2024-09-13T06:40:16.166 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_pending": 1, 2024-09-13T06:40:16.166 INFO:teuthology.orchestra.run.smithi081.stdout: "last_pg_merge_meta": { 2024-09-13T06:40:16.167 INFO:teuthology.orchestra.run.smithi081.stdout: "source_pgid": "0.0", 2024-09-13T06:40:16.167 INFO:teuthology.orchestra.run.smithi081.stdout: "ready_epoch": 0, 2024-09-13T06:40:16.167 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_started": 0, 2024-09-13T06:40:16.167 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_clean": 0, 2024-09-13T06:40:16.167 INFO:teuthology.orchestra.run.smithi081.stdout: "source_version": "0'0", 2024-09-13T06:40:16.167 INFO:teuthology.orchestra.run.smithi081.stdout: "target_version": "0'0" 2024-09-13T06:40:16.167 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:16.167 INFO:teuthology.orchestra.run.smithi081.stdout: "last_change": "16", 2024-09-13T06:40:16.167 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend": "0", 2024-09-13T06:40:16.167 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-13T06:40:16.167 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_preluminous": "0", 2024-09-13T06:40:16.167 INFO:teuthology.orchestra.run.smithi081.stdout: "auid": 0, 2024-09-13T06:40:16.167 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_mode": "selfmanaged", 2024-09-13T06:40:16.167 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_seq": 0, 2024-09-13T06:40:16.168 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_epoch": 0, 2024-09-13T06:40:16.168 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_snaps": [], 2024-09-13T06:40:16.168 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps": "[]", 2024-09-13T06:40:16.168 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_bytes": 0, 2024-09-13T06:40:16.168 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_objects": 0, 2024-09-13T06:40:16.168 INFO:teuthology.orchestra.run.smithi081.stdout: "tiers": [], 2024-09-13T06:40:16.168 INFO:teuthology.orchestra.run.smithi081.stdout: "tier_of": -1, 2024-09-13T06:40:16.168 INFO:teuthology.orchestra.run.smithi081.stdout: "read_tier": -1, 2024-09-13T06:40:16.168 INFO:teuthology.orchestra.run.smithi081.stdout: "write_tier": -1, 2024-09-13T06:40:16.168 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_mode": "none", 2024-09-13T06:40:16.168 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_bytes": 0, 2024-09-13T06:40:16.168 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_objects": 0, 2024-09-13T06:40:16.168 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-13T06:40:16.169 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-13T06:40:16.169 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-13T06:40:16.169 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_flush_age": 0, 2024-09-13T06:40:16.169 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_evict_age": 0, 2024-09-13T06:40:16.169 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profile": "", 2024-09-13T06:40:16.169 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_params": { 2024-09-13T06:40:16.169 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "none" 2024-09-13T06:40:16.169 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:16.169 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_period": 0, 2024-09-13T06:40:16.169 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_count": 0, 2024-09-13T06:40:16.169 INFO:teuthology.orchestra.run.smithi081.stdout: "use_gmt_hitset": true, 2024-09-13T06:40:16.169 INFO:teuthology.orchestra.run.smithi081.stdout: "min_read_recency_for_promote": 0, 2024-09-13T06:40:16.169 INFO:teuthology.orchestra.run.smithi081.stdout: "min_write_recency_for_promote": 0, 2024-09-13T06:40:16.170 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_grade_decay_rate": 0, 2024-09-13T06:40:16.170 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_search_last_n": 0, 2024-09-13T06:40:16.170 INFO:teuthology.orchestra.run.smithi081.stdout: "grade_table": [], 2024-09-13T06:40:16.170 INFO:teuthology.orchestra.run.smithi081.stdout: "stripe_width": 0, 2024-09-13T06:40:16.170 INFO:teuthology.orchestra.run.smithi081.stdout: "expected_num_objects": 0, 2024-09-13T06:40:16.170 INFO:teuthology.orchestra.run.smithi081.stdout: "fast_read": false, 2024-09-13T06:40:16.170 INFO:teuthology.orchestra.run.smithi081.stdout: "options": { 2024-09-13T06:40:16.170 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_max": 32, 2024-09-13T06:40:16.170 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_min": 1 2024-09-13T06:40:16.170 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:16.170 INFO:teuthology.orchestra.run.smithi081.stdout: "application_metadata": { 2024-09-13T06:40:16.170 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": {} 2024-09-13T06:40:16.171 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:16.171 INFO:teuthology.orchestra.run.smithi081.stdout: "read_balance": { 2024-09-13T06:40:16.171 INFO:teuthology.orchestra.run.smithi081.stdout: "score_acting": 8, 2024-09-13T06:40:16.171 INFO:teuthology.orchestra.run.smithi081.stdout: "score_stable": 8, 2024-09-13T06:40:16.171 INFO:teuthology.orchestra.run.smithi081.stdout: "optimal_score": 0.25, 2024-09-13T06:40:16.171 INFO:teuthology.orchestra.run.smithi081.stdout: "raw_score_acting": 2, 2024-09-13T06:40:16.171 INFO:teuthology.orchestra.run.smithi081.stdout: "raw_score_stable": 2, 2024-09-13T06:40:16.171 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity_weighted": 1, 2024-09-13T06:40:16.171 INFO:teuthology.orchestra.run.smithi081.stdout: "average_primary_affinity": 1, 2024-09-13T06:40:16.171 INFO:teuthology.orchestra.run.smithi081.stdout: "average_primary_affinity_weighted": 1 2024-09-13T06:40:16.171 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:16.171 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:16.171 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:16.171 INFO:teuthology.orchestra.run.smithi081.stdout: "pool": 2, 2024-09-13T06:40:16.172 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_name": "rbd", 2024-09-13T06:40:16.172 INFO:teuthology.orchestra.run.smithi081.stdout: "create_time": "2024-09-13T06:39:15.802118+0000", 2024-09-13T06:40:16.172 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 8193, 2024-09-13T06:40:16.172 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-13T06:40:16.172 INFO:teuthology.orchestra.run.smithi081.stdout: "type": 1, 2024-09-13T06:40:16.172 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 2, 2024-09-13T06:40:16.172 INFO:teuthology.orchestra.run.smithi081.stdout: "min_size": 1, 2024-09-13T06:40:16.172 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_rule": 0, 2024-09-13T06:40:16.172 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_count": 0, 2024-09-13T06:40:16.172 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_target": 0, 2024-09-13T06:40:16.172 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_barrier": 0, 2024-09-13T06:40:16.172 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-13T06:40:16.173 INFO:teuthology.orchestra.run.smithi081.stdout: "object_hash": 2, 2024-09-13T06:40:16.173 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_mode": "off", 2024-09-13T06:40:16.173 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num": 8, 2024-09-13T06:40:16.173 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num": 8, 2024-09-13T06:40:16.173 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num_target": 8, 2024-09-13T06:40:16.173 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_target": 8, 2024-09-13T06:40:16.173 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_pending": 8, 2024-09-13T06:40:16.173 INFO:teuthology.orchestra.run.smithi081.stdout: "last_pg_merge_meta": { 2024-09-13T06:40:16.173 INFO:teuthology.orchestra.run.smithi081.stdout: "source_pgid": "0.0", 2024-09-13T06:40:16.173 INFO:teuthology.orchestra.run.smithi081.stdout: "ready_epoch": 0, 2024-09-13T06:40:16.173 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_started": 0, 2024-09-13T06:40:16.174 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_clean": 0, 2024-09-13T06:40:16.174 INFO:teuthology.orchestra.run.smithi081.stdout: "source_version": "0'0", 2024-09-13T06:40:16.174 INFO:teuthology.orchestra.run.smithi081.stdout: "target_version": "0'0" 2024-09-13T06:40:16.174 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:16.174 INFO:teuthology.orchestra.run.smithi081.stdout: "last_change": "20", 2024-09-13T06:40:16.174 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend": "0", 2024-09-13T06:40:16.174 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-13T06:40:16.174 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_preluminous": "0", 2024-09-13T06:40:16.174 INFO:teuthology.orchestra.run.smithi081.stdout: "auid": 0, 2024-09-13T06:40:16.174 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_mode": "selfmanaged", 2024-09-13T06:40:16.174 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_seq": 3, 2024-09-13T06:40:16.174 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_epoch": 20, 2024-09-13T06:40:16.174 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_snaps": [], 2024-09-13T06:40:16.175 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps": "[]", 2024-09-13T06:40:16.175 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_bytes": 0, 2024-09-13T06:40:16.175 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_objects": 0, 2024-09-13T06:40:16.175 INFO:teuthology.orchestra.run.smithi081.stdout: "tiers": [], 2024-09-13T06:40:16.175 INFO:teuthology.orchestra.run.smithi081.stdout: "tier_of": -1, 2024-09-13T06:40:16.175 INFO:teuthology.orchestra.run.smithi081.stdout: "read_tier": -1, 2024-09-13T06:40:16.175 INFO:teuthology.orchestra.run.smithi081.stdout: "write_tier": -1, 2024-09-13T06:40:16.175 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_mode": "none", 2024-09-13T06:40:16.175 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_bytes": 0, 2024-09-13T06:40:16.175 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_objects": 0, 2024-09-13T06:40:16.175 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-13T06:40:16.175 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-13T06:40:16.175 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-13T06:40:16.175 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_flush_age": 0, 2024-09-13T06:40:16.176 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_evict_age": 0, 2024-09-13T06:40:16.176 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profile": "", 2024-09-13T06:40:16.176 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_params": { 2024-09-13T06:40:16.176 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "none" 2024-09-13T06:40:16.176 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:16.176 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_period": 0, 2024-09-13T06:40:16.176 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_count": 0, 2024-09-13T06:40:16.176 INFO:teuthology.orchestra.run.smithi081.stdout: "use_gmt_hitset": true, 2024-09-13T06:40:16.176 INFO:teuthology.orchestra.run.smithi081.stdout: "min_read_recency_for_promote": 0, 2024-09-13T06:40:16.176 INFO:teuthology.orchestra.run.smithi081.stdout: "min_write_recency_for_promote": 0, 2024-09-13T06:40:16.176 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_grade_decay_rate": 0, 2024-09-13T06:40:16.176 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_search_last_n": 0, 2024-09-13T06:40:16.176 INFO:teuthology.orchestra.run.smithi081.stdout: "grade_table": [], 2024-09-13T06:40:16.177 INFO:teuthology.orchestra.run.smithi081.stdout: "stripe_width": 0, 2024-09-13T06:40:16.177 INFO:teuthology.orchestra.run.smithi081.stdout: "expected_num_objects": 0, 2024-09-13T06:40:16.177 INFO:teuthology.orchestra.run.smithi081.stdout: "fast_read": false, 2024-09-13T06:40:16.177 INFO:teuthology.orchestra.run.smithi081.stdout: "options": {}, 2024-09-13T06:40:16.177 INFO:teuthology.orchestra.run.smithi081.stdout: "application_metadata": { 2024-09-13T06:40:16.177 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd": {} 2024-09-13T06:40:16.177 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:16.177 INFO:teuthology.orchestra.run.smithi081.stdout: "read_balance": { 2024-09-13T06:40:16.177 INFO:teuthology.orchestra.run.smithi081.stdout: "score_acting": 2.9900000095367432, 2024-09-13T06:40:16.177 INFO:teuthology.orchestra.run.smithi081.stdout: "score_stable": 2.9900000095367432, 2024-09-13T06:40:16.177 INFO:teuthology.orchestra.run.smithi081.stdout: "optimal_score": 0.87999999523162842, 2024-09-13T06:40:16.177 INFO:teuthology.orchestra.run.smithi081.stdout: "raw_score_acting": 2.630000114440918, 2024-09-13T06:40:16.177 INFO:teuthology.orchestra.run.smithi081.stdout: "raw_score_stable": 2.630000114440918, 2024-09-13T06:40:16.177 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity_weighted": 1, 2024-09-13T06:40:16.177 INFO:teuthology.orchestra.run.smithi081.stdout: "average_primary_affinity": 1, 2024-09-13T06:40:16.178 INFO:teuthology.orchestra.run.smithi081.stdout: "average_primary_affinity_weighted": 1 2024-09-13T06:40:16.178 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:16.178 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:16.178 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:16.178 INFO:teuthology.orchestra.run.smithi081.stdout: "pool": 3, 2024-09-13T06:40:16.178 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_name": "pool_client.0", 2024-09-13T06:40:16.178 INFO:teuthology.orchestra.run.smithi081.stdout: "create_time": "2024-09-13T06:39:25.648942+0000", 2024-09-13T06:40:16.178 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 8193, 2024-09-13T06:40:16.178 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-13T06:40:16.178 INFO:teuthology.orchestra.run.smithi081.stdout: "type": 1, 2024-09-13T06:40:16.178 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 2, 2024-09-13T06:40:16.178 INFO:teuthology.orchestra.run.smithi081.stdout: "min_size": 1, 2024-09-13T06:40:16.178 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_rule": 0, 2024-09-13T06:40:16.179 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_count": 0, 2024-09-13T06:40:16.179 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_target": 0, 2024-09-13T06:40:16.179 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_barrier": 0, 2024-09-13T06:40:16.179 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-13T06:40:16.179 INFO:teuthology.orchestra.run.smithi081.stdout: "object_hash": 2, 2024-09-13T06:40:16.179 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_mode": "off", 2024-09-13T06:40:16.179 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num": 32, 2024-09-13T06:40:16.179 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num": 32, 2024-09-13T06:40:16.179 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num_target": 32, 2024-09-13T06:40:16.179 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_target": 32, 2024-09-13T06:40:16.179 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_pending": 32, 2024-09-13T06:40:16.179 INFO:teuthology.orchestra.run.smithi081.stdout: "last_pg_merge_meta": { 2024-09-13T06:40:16.179 INFO:teuthology.orchestra.run.smithi081.stdout: "source_pgid": "0.0", 2024-09-13T06:40:16.179 INFO:teuthology.orchestra.run.smithi081.stdout: "ready_epoch": 0, 2024-09-13T06:40:16.179 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_started": 0, 2024-09-13T06:40:16.180 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_clean": 0, 2024-09-13T06:40:16.180 INFO:teuthology.orchestra.run.smithi081.stdout: "source_version": "0'0", 2024-09-13T06:40:16.180 INFO:teuthology.orchestra.run.smithi081.stdout: "target_version": "0'0" 2024-09-13T06:40:16.180 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:16.180 INFO:teuthology.orchestra.run.smithi081.stdout: "last_change": "63", 2024-09-13T06:40:16.180 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend": "0", 2024-09-13T06:40:16.180 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-13T06:40:16.180 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_preluminous": "0", 2024-09-13T06:40:16.180 INFO:teuthology.orchestra.run.smithi081.stdout: "auid": 0, 2024-09-13T06:40:16.180 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_mode": "selfmanaged", 2024-09-13T06:40:16.180 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_seq": 30, 2024-09-13T06:40:16.180 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_epoch": 63, 2024-09-13T06:40:16.180 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_snaps": [], 2024-09-13T06:40:16.180 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps": "[]", 2024-09-13T06:40:16.181 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_bytes": 0, 2024-09-13T06:40:16.181 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_objects": 0, 2024-09-13T06:40:16.181 INFO:teuthology.orchestra.run.smithi081.stdout: "tiers": [], 2024-09-13T06:40:16.181 INFO:teuthology.orchestra.run.smithi081.stdout: "tier_of": -1, 2024-09-13T06:40:16.181 INFO:teuthology.orchestra.run.smithi081.stdout: "read_tier": -1, 2024-09-13T06:40:16.181 INFO:teuthology.orchestra.run.smithi081.stdout: "write_tier": -1, 2024-09-13T06:40:16.181 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_mode": "none", 2024-09-13T06:40:16.181 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_bytes": 0, 2024-09-13T06:40:16.181 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_objects": 0, 2024-09-13T06:40:16.181 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-13T06:40:16.181 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-13T06:40:16.181 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-13T06:40:16.182 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_flush_age": 0, 2024-09-13T06:40:16.182 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_evict_age": 0, 2024-09-13T06:40:16.182 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profile": "", 2024-09-13T06:40:16.182 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_params": { 2024-09-13T06:40:16.182 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "none" 2024-09-13T06:40:16.182 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:16.182 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_period": 0, 2024-09-13T06:40:16.182 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_count": 0, 2024-09-13T06:40:16.182 INFO:teuthology.orchestra.run.smithi081.stdout: "use_gmt_hitset": true, 2024-09-13T06:40:16.182 INFO:teuthology.orchestra.run.smithi081.stdout: "min_read_recency_for_promote": 0, 2024-09-13T06:40:16.182 INFO:teuthology.orchestra.run.smithi081.stdout: "min_write_recency_for_promote": 0, 2024-09-13T06:40:16.182 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_grade_decay_rate": 0, 2024-09-13T06:40:16.182 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_search_last_n": 0, 2024-09-13T06:40:16.182 INFO:teuthology.orchestra.run.smithi081.stdout: "grade_table": [], 2024-09-13T06:40:16.183 INFO:teuthology.orchestra.run.smithi081.stdout: "stripe_width": 0, 2024-09-13T06:40:16.183 INFO:teuthology.orchestra.run.smithi081.stdout: "expected_num_objects": 0, 2024-09-13T06:40:16.183 INFO:teuthology.orchestra.run.smithi081.stdout: "fast_read": false, 2024-09-13T06:40:16.183 INFO:teuthology.orchestra.run.smithi081.stdout: "options": {}, 2024-09-13T06:40:16.183 INFO:teuthology.orchestra.run.smithi081.stdout: "application_metadata": { 2024-09-13T06:40:16.183 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd": {} 2024-09-13T06:40:16.183 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:16.183 INFO:teuthology.orchestra.run.smithi081.stdout: "read_balance": { 2024-09-13T06:40:16.183 INFO:teuthology.orchestra.run.smithi081.stdout: "score_acting": 1.7400000095367432, 2024-09-13T06:40:16.183 INFO:teuthology.orchestra.run.smithi081.stdout: "score_stable": 1.7400000095367432, 2024-09-13T06:40:16.183 INFO:teuthology.orchestra.run.smithi081.stdout: "optimal_score": 0.87999999523162842, 2024-09-13T06:40:16.183 INFO:teuthology.orchestra.run.smithi081.stdout: "raw_score_acting": 1.5299999713897705, 2024-09-13T06:40:16.183 INFO:teuthology.orchestra.run.smithi081.stdout: "raw_score_stable": 1.5299999713897705, 2024-09-13T06:40:16.184 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity_weighted": 1, 2024-09-13T06:40:16.184 INFO:teuthology.orchestra.run.smithi081.stdout: "average_primary_affinity": 1, 2024-09-13T06:40:16.184 INFO:teuthology.orchestra.run.smithi081.stdout: "average_primary_affinity_weighted": 1 2024-09-13T06:40:16.184 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:16.184 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:16.184 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-13T06:40:16.184 INFO:teuthology.orchestra.run.smithi081.stdout: "osds": [ 2024-09-13T06:40:16.184 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:16.184 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 0, 2024-09-13T06:40:16.185 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "54b0a3e4-58ad-4f95-86dc-29a11c9a1964", 2024-09-13T06:40:16.185 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2024-09-13T06:40:16.185 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2024-09-13T06:40:16.185 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2024-09-13T06:40:16.185 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2024-09-13T06:40:16.185 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2024-09-13T06:40:16.185 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2024-09-13T06:40:16.185 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2024-09-13T06:40:16.185 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 55, 2024-09-13T06:40:16.185 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2024-09-13T06:40:16.185 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2024-09-13T06:40:16.185 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-13T06:40:16.186 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:40:16.186 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:16.186 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:40:16.186 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6808", 2024-09-13T06:40:16.186 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 1904727940 2024-09-13T06:40:16.186 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:16.186 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:16.186 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:40:16.186 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6809", 2024-09-13T06:40:16.186 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 1904727940 2024-09-13T06:40:16.186 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:16.186 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:16.186 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:16.187 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2024-09-13T06:40:16.187 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:40:16.187 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:16.187 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:40:16.187 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6810", 2024-09-13T06:40:16.187 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 1904727940 2024-09-13T06:40:16.187 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:16.187 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:16.187 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:40:16.187 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6811", 2024-09-13T06:40:16.187 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 1904727940 2024-09-13T06:40:16.187 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:16.187 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:16.187 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:16.188 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2024-09-13T06:40:16.188 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:40:16.188 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:16.188 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:40:16.188 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6814", 2024-09-13T06:40:16.188 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 1904727940 2024-09-13T06:40:16.188 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:16.188 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:16.188 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:40:16.188 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6815", 2024-09-13T06:40:16.188 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 1904727940 2024-09-13T06:40:16.188 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:16.188 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:16.189 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:16.189 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2024-09-13T06:40:16.189 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:40:16.189 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:16.189 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:40:16.189 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6812", 2024-09-13T06:40:16.189 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 1904727940 2024-09-13T06:40:16.189 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:16.189 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:16.189 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:40:16.189 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6813", 2024-09-13T06:40:16.190 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 1904727940 2024-09-13T06:40:16.190 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:16.190 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:16.190 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:16.190 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6809/1904727940", 2024-09-13T06:40:16.190 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.81:6811/1904727940", 2024-09-13T06:40:16.190 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.81:6815/1904727940", 2024-09-13T06:40:16.190 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.81:6813/1904727940", 2024-09-13T06:40:16.190 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2024-09-13T06:40:16.190 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2024-09-13T06:40:16.191 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2024-09-13T06:40:16.191 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:16.191 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:16.191 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:16.191 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 1, 2024-09-13T06:40:16.191 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "a6dba5b9-c833-465e-a8a5-1741528b24c0", 2024-09-13T06:40:16.191 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2024-09-13T06:40:16.191 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2024-09-13T06:40:16.191 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2024-09-13T06:40:16.191 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2024-09-13T06:40:16.191 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2024-09-13T06:40:16.191 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2024-09-13T06:40:16.191 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2024-09-13T06:40:16.191 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 55, 2024-09-13T06:40:16.191 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2024-09-13T06:40:16.192 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2024-09-13T06:40:16.192 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-13T06:40:16.192 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:40:16.192 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:16.192 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:40:16.192 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6817", 2024-09-13T06:40:16.192 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 738205570 2024-09-13T06:40:16.192 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:16.192 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:16.192 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:40:16.192 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6819", 2024-09-13T06:40:16.192 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 738205570 2024-09-13T06:40:16.192 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:16.192 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:16.193 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:16.193 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2024-09-13T06:40:16.193 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:40:16.193 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:16.193 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:40:16.193 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6822", 2024-09-13T06:40:16.193 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 738205570 2024-09-13T06:40:16.193 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:16.193 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:16.194 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:40:16.194 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6824", 2024-09-13T06:40:16.194 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 738205570 2024-09-13T06:40:16.194 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:16.194 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:16.194 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:16.194 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2024-09-13T06:40:16.194 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:40:16.194 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:16.194 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:40:16.195 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6830", 2024-09-13T06:40:16.195 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 738205570 2024-09-13T06:40:16.195 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:16.195 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:16.195 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:40:16.195 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6831", 2024-09-13T06:40:16.195 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 738205570 2024-09-13T06:40:16.195 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:16.195 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:16.195 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:16.195 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2024-09-13T06:40:16.195 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:40:16.196 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:16.196 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:40:16.196 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6826", 2024-09-13T06:40:16.196 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 738205570 2024-09-13T06:40:16.196 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:16.196 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:16.196 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:40:16.196 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6829", 2024-09-13T06:40:16.196 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 738205570 2024-09-13T06:40:16.196 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:16.196 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:16.196 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:16.197 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6819/738205570", 2024-09-13T06:40:16.197 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.81:6824/738205570", 2024-09-13T06:40:16.197 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.81:6831/738205570", 2024-09-13T06:40:16.197 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.81:6829/738205570", 2024-09-13T06:40:16.197 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2024-09-13T06:40:16.197 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2024-09-13T06:40:16.197 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2024-09-13T06:40:16.197 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:16.197 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:16.197 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:16.197 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 2, 2024-09-13T06:40:16.197 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "6c45097e-44a2-454f-80a4-0fe879ccd52f", 2024-09-13T06:40:16.197 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2024-09-13T06:40:16.198 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2024-09-13T06:40:16.198 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2024-09-13T06:40:16.198 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2024-09-13T06:40:16.198 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2024-09-13T06:40:16.198 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2024-09-13T06:40:16.198 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2024-09-13T06:40:16.198 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 58, 2024-09-13T06:40:16.198 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2024-09-13T06:40:16.198 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2024-09-13T06:40:16.198 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-13T06:40:16.198 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:40:16.198 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:16.198 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:40:16.198 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6816", 2024-09-13T06:40:16.199 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 3558674335 2024-09-13T06:40:16.199 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:16.199 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:16.199 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:40:16.199 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6818", 2024-09-13T06:40:16.199 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 3558674335 2024-09-13T06:40:16.199 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:16.199 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:16.199 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:16.199 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2024-09-13T06:40:16.199 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:40:16.199 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:16.199 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:40:16.200 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6820", 2024-09-13T06:40:16.200 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 3558674335 2024-09-13T06:40:16.200 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:16.200 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:16.200 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:40:16.200 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6821", 2024-09-13T06:40:16.200 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 3558674335 2024-09-13T06:40:16.200 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:16.200 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:16.200 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:16.200 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2024-09-13T06:40:16.200 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:40:16.200 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:16.200 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:40:16.201 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6827", 2024-09-13T06:40:16.201 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 3558674335 2024-09-13T06:40:16.201 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:16.201 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:16.201 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:40:16.201 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6828", 2024-09-13T06:40:16.201 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 3558674335 2024-09-13T06:40:16.201 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:16.201 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:16.201 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:16.201 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2024-09-13T06:40:16.201 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:40:16.201 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:16.201 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:40:16.202 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6823", 2024-09-13T06:40:16.202 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 3558674335 2024-09-13T06:40:16.202 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:16.202 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:16.202 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:40:16.202 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6825", 2024-09-13T06:40:16.202 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 3558674335 2024-09-13T06:40:16.202 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:16.202 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:16.202 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:16.202 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6818/3558674335", 2024-09-13T06:40:16.202 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.81:6821/3558674335", 2024-09-13T06:40:16.202 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.81:6828/3558674335", 2024-09-13T06:40:16.202 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.81:6825/3558674335", 2024-09-13T06:40:16.202 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2024-09-13T06:40:16.203 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2024-09-13T06:40:16.203 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2024-09-13T06:40:16.203 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:16.203 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:16.203 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:16.203 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 3, 2024-09-13T06:40:16.203 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "31952760-06f3-4618-a5c4-f5c4fed3aadb", 2024-09-13T06:40:16.203 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2024-09-13T06:40:16.203 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2024-09-13T06:40:16.203 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2024-09-13T06:40:16.203 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2024-09-13T06:40:16.203 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2024-09-13T06:40:16.203 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2024-09-13T06:40:16.203 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2024-09-13T06:40:16.204 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 40, 2024-09-13T06:40:16.204 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2024-09-13T06:40:16.204 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2024-09-13T06:40:16.204 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-13T06:40:16.204 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:40:16.204 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:16.204 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:40:16.204 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6800", 2024-09-13T06:40:16.204 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 1886327229 2024-09-13T06:40:16.204 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:16.204 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:16.204 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:40:16.204 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6801", 2024-09-13T06:40:16.205 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 1886327229 2024-09-13T06:40:16.205 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:16.205 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:16.205 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:16.205 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2024-09-13T06:40:16.205 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:40:16.205 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:16.205 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:40:16.205 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6802", 2024-09-13T06:40:16.206 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 1886327229 2024-09-13T06:40:16.206 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:16.206 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:16.206 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:40:16.206 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6803", 2024-09-13T06:40:16.206 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 1886327229 2024-09-13T06:40:16.206 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:16.206 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:16.206 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:16.206 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2024-09-13T06:40:16.206 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:40:16.206 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:16.206 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:40:16.206 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6806", 2024-09-13T06:40:16.207 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 1886327229 2024-09-13T06:40:16.207 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:16.207 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:16.207 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:40:16.207 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6807", 2024-09-13T06:40:16.207 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 1886327229 2024-09-13T06:40:16.207 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:16.207 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:16.207 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:16.207 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2024-09-13T06:40:16.207 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:40:16.207 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:16.207 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:40:16.208 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6804", 2024-09-13T06:40:16.208 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 1886327229 2024-09-13T06:40:16.208 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:16.208 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:16.208 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:40:16.208 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6805", 2024-09-13T06:40:16.208 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 1886327229 2024-09-13T06:40:16.208 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:16.208 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:16.208 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:16.208 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6801/1886327229", 2024-09-13T06:40:16.208 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.81:6803/1886327229", 2024-09-13T06:40:16.209 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.81:6807/1886327229", 2024-09-13T06:40:16.209 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.81:6805/1886327229", 2024-09-13T06:40:16.209 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2024-09-13T06:40:16.209 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2024-09-13T06:40:16.209 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2024-09-13T06:40:16.209 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:16.213 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:16.213 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:16.213 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 4, 2024-09-13T06:40:16.213 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "c9bd2751-c836-43dc-b844-e13678cb2fd9", 2024-09-13T06:40:16.213 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2024-09-13T06:40:16.213 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2024-09-13T06:40:16.213 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0.58685302734375, 2024-09-13T06:40:16.214 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2024-09-13T06:40:16.214 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2024-09-13T06:40:16.214 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2024-09-13T06:40:16.214 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2024-09-13T06:40:16.214 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 40, 2024-09-13T06:40:16.214 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2024-09-13T06:40:16.214 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2024-09-13T06:40:16.214 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-13T06:40:16.214 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:40:16.214 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:16.214 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:40:16.214 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6817", 2024-09-13T06:40:16.214 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2184515621 2024-09-13T06:40:16.215 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:16.215 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:16.215 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:40:16.215 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6819", 2024-09-13T06:40:16.215 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2184515621 2024-09-13T06:40:16.215 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:16.215 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:16.215 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:16.215 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2024-09-13T06:40:16.215 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:40:16.216 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:16.216 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:40:16.216 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6820", 2024-09-13T06:40:16.216 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2184515621 2024-09-13T06:40:16.216 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:16.216 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:16.216 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:40:16.216 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6822", 2024-09-13T06:40:16.216 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2184515621 2024-09-13T06:40:16.216 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:16.216 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:16.216 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:16.217 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2024-09-13T06:40:16.217 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:40:16.217 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:16.217 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:40:16.217 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6827", 2024-09-13T06:40:16.217 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2184515621 2024-09-13T06:40:16.217 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:16.217 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:16.217 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:40:16.217 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6829", 2024-09-13T06:40:16.217 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2184515621 2024-09-13T06:40:16.217 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:16.218 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:16.218 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:16.218 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2024-09-13T06:40:16.218 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:40:16.218 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:16.218 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:40:16.218 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6824", 2024-09-13T06:40:16.218 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2184515621 2024-09-13T06:40:16.218 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:16.218 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:16.219 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:40:16.219 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6826", 2024-09-13T06:40:16.219 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2184515621 2024-09-13T06:40:16.219 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:16.219 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:16.219 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:16.219 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.139:6819/2184515621", 2024-09-13T06:40:16.219 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.139:6822/2184515621", 2024-09-13T06:40:16.219 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.139:6829/2184515621", 2024-09-13T06:40:16.219 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.139:6826/2184515621", 2024-09-13T06:40:16.219 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2024-09-13T06:40:16.219 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2024-09-13T06:40:16.219 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2024-09-13T06:40:16.219 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:16.220 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:16.220 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:16.220 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 5, 2024-09-13T06:40:16.220 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "2971b93a-6c9f-4b77-b526-4eac788fabf9", 2024-09-13T06:40:16.220 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2024-09-13T06:40:16.220 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2024-09-13T06:40:16.220 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2024-09-13T06:40:16.220 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2024-09-13T06:40:16.220 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2024-09-13T06:40:16.220 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2024-09-13T06:40:16.220 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2024-09-13T06:40:16.220 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 40, 2024-09-13T06:40:16.220 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2024-09-13T06:40:16.220 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2024-09-13T06:40:16.221 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-13T06:40:16.221 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:40:16.221 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:16.221 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:40:16.221 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6816", 2024-09-13T06:40:16.221 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 3982901834 2024-09-13T06:40:16.221 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:16.221 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:16.221 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:40:16.221 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6818", 2024-09-13T06:40:16.221 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 3982901834 2024-09-13T06:40:16.221 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:16.222 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:16.222 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:16.222 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2024-09-13T06:40:16.222 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:40:16.222 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:16.222 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:40:16.222 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6821", 2024-09-13T06:40:16.222 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 3982901834 2024-09-13T06:40:16.222 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:16.222 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:16.222 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:40:16.222 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6823", 2024-09-13T06:40:16.222 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 3982901834 2024-09-13T06:40:16.222 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:16.223 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:16.223 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:16.223 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2024-09-13T06:40:16.223 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:40:16.223 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:16.223 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:40:16.223 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6830", 2024-09-13T06:40:16.223 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 3982901834 2024-09-13T06:40:16.223 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:16.223 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:16.223 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:40:16.223 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6831", 2024-09-13T06:40:16.223 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 3982901834 2024-09-13T06:40:16.224 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:16.224 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:16.224 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:16.224 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2024-09-13T06:40:16.224 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:40:16.224 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:16.224 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:40:16.224 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6825", 2024-09-13T06:40:16.224 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 3982901834 2024-09-13T06:40:16.224 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:16.224 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:16.224 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:40:16.225 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6828", 2024-09-13T06:40:16.225 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 3982901834 2024-09-13T06:40:16.225 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:16.225 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:16.225 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:16.225 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.139:6818/3982901834", 2024-09-13T06:40:16.225 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.139:6823/3982901834", 2024-09-13T06:40:16.225 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.139:6831/3982901834", 2024-09-13T06:40:16.225 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.139:6828/3982901834", 2024-09-13T06:40:16.225 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2024-09-13T06:40:16.225 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2024-09-13T06:40:16.226 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2024-09-13T06:40:16.226 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:16.226 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:16.226 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:16.226 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 6, 2024-09-13T06:40:16.226 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "e1f786ce-579e-48cc-b212-83f881b94184", 2024-09-13T06:40:16.226 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2024-09-13T06:40:16.226 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2024-09-13T06:40:16.226 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2024-09-13T06:40:16.226 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2024-09-13T06:40:16.226 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2024-09-13T06:40:16.227 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2024-09-13T06:40:16.227 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2024-09-13T06:40:16.227 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 40, 2024-09-13T06:40:16.227 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2024-09-13T06:40:16.227 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2024-09-13T06:40:16.227 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-13T06:40:16.227 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:40:16.227 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:16.227 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:40:16.227 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6800", 2024-09-13T06:40:16.227 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2283932666 2024-09-13T06:40:16.227 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:16.227 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:16.228 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:40:16.228 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6801", 2024-09-13T06:40:16.228 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2283932666 2024-09-13T06:40:16.228 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:16.228 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:16.228 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:16.228 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2024-09-13T06:40:16.228 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:40:16.228 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:16.228 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:40:16.228 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6802", 2024-09-13T06:40:16.228 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2283932666 2024-09-13T06:40:16.229 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:16.229 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:16.229 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:40:16.229 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6803", 2024-09-13T06:40:16.229 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2283932666 2024-09-13T06:40:16.229 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:16.229 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:16.229 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:16.229 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2024-09-13T06:40:16.229 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:40:16.230 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:16.230 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:40:16.230 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6806", 2024-09-13T06:40:16.230 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2283932666 2024-09-13T06:40:16.230 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:16.230 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:16.230 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:40:16.231 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6807", 2024-09-13T06:40:16.231 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2283932666 2024-09-13T06:40:16.231 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:16.231 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:16.231 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:16.231 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2024-09-13T06:40:16.232 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:40:16.232 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:16.232 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:40:16.232 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6804", 2024-09-13T06:40:16.233 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2283932666 2024-09-13T06:40:16.233 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:16.233 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:16.233 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:40:16.233 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6805", 2024-09-13T06:40:16.233 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2283932666 2024-09-13T06:40:16.234 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:16.234 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:16.234 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:16.234 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.139:6801/2283932666", 2024-09-13T06:40:16.234 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.139:6803/2283932666", 2024-09-13T06:40:16.234 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.139:6807/2283932666", 2024-09-13T06:40:16.235 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.139:6805/2283932666", 2024-09-13T06:40:16.235 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2024-09-13T06:40:16.235 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2024-09-13T06:40:16.235 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2024-09-13T06:40:16.235 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:16.235 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:16.235 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:16.236 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 7, 2024-09-13T06:40:16.236 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "a287ddf6-84eb-4225-b267-25eee1657625", 2024-09-13T06:40:16.236 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2024-09-13T06:40:16.236 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 0, 2024-09-13T06:40:16.236 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-13T06:40:16.236 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2024-09-13T06:40:16.236 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2024-09-13T06:40:16.237 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2024-09-13T06:40:16.237 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2024-09-13T06:40:16.237 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 21, 2024-09-13T06:40:16.237 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2024-09-13T06:40:16.237 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2024-09-13T06:40:16.237 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-13T06:40:16.238 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:40:16.238 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:16.238 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:40:16.238 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6808", 2024-09-13T06:40:16.238 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2348111157 2024-09-13T06:40:16.238 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:16.238 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:16.238 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:40:16.239 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6809", 2024-09-13T06:40:16.239 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2348111157 2024-09-13T06:40:16.239 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:16.239 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:16.239 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:16.239 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2024-09-13T06:40:16.239 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:40:16.240 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:16.240 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:40:16.240 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6810", 2024-09-13T06:40:16.240 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2348111157 2024-09-13T06:40:16.240 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:16.240 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:16.240 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:40:16.241 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6811", 2024-09-13T06:40:16.241 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2348111157 2024-09-13T06:40:16.241 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:16.241 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:16.241 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:16.241 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2024-09-13T06:40:16.241 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:40:16.242 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:16.242 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:40:16.242 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6814", 2024-09-13T06:40:16.242 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2348111157 2024-09-13T06:40:16.242 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:16.242 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:16.242 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:40:16.243 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6815", 2024-09-13T06:40:16.243 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2348111157 2024-09-13T06:40:16.243 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:16.243 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:16.243 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:16.243 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2024-09-13T06:40:16.243 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:40:16.244 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:16.244 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:40:16.244 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6812", 2024-09-13T06:40:16.244 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2348111157 2024-09-13T06:40:16.244 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:16.244 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:16.244 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:40:16.245 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6813", 2024-09-13T06:40:16.245 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2348111157 2024-09-13T06:40:16.245 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:16.245 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:16.245 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:16.245 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.139:6809/2348111157", 2024-09-13T06:40:16.246 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.139:6811/2348111157", 2024-09-13T06:40:16.246 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.139:6815/2348111157", 2024-09-13T06:40:16.246 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.139:6813/2348111157", 2024-09-13T06:40:16.246 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2024-09-13T06:40:16.246 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2024-09-13T06:40:16.246 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2024-09-13T06:40:16.246 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:16.247 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:16.247 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-13T06:40:16.247 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_xinfo": [ 2024-09-13T06:40:16.247 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:16.247 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 0, 2024-09-13T06:40:16.247 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2024-09-13T06:40:16.247 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2024-09-13T06:40:16.248 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2024-09-13T06:40:16.248 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138322906710015, 2024-09-13T06:40:16.248 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2024-09-13T06:40:16.248 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2024-09-13T06:39:05.476871+0000", 2024-09-13T06:40:16.248 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2024-09-13T06:40:16.248 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:16.248 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:16.249 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 1, 2024-09-13T06:40:16.249 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2024-09-13T06:40:16.249 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2024-09-13T06:40:16.249 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2024-09-13T06:40:16.249 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138322906710015, 2024-09-13T06:40:16.249 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2024-09-13T06:40:16.249 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2024-09-13T06:39:05.455183+0000", 2024-09-13T06:40:16.250 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2024-09-13T06:40:16.250 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:16.250 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:16.250 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 2, 2024-09-13T06:40:16.250 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2024-09-13T06:40:16.250 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2024-09-13T06:40:16.251 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2024-09-13T06:40:16.251 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138322906710015, 2024-09-13T06:40:16.251 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2024-09-13T06:40:16.251 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2024-09-13T06:39:05.504853+0000", 2024-09-13T06:40:16.251 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2024-09-13T06:40:16.251 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:16.251 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:16.252 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 3, 2024-09-13T06:40:16.252 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2024-09-13T06:40:16.252 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2024-09-13T06:40:16.252 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2024-09-13T06:40:16.252 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138322906710015, 2024-09-13T06:40:16.252 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2024-09-13T06:40:16.252 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2024-09-13T06:39:05.372429+0000", 2024-09-13T06:40:16.253 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2024-09-13T06:40:16.253 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:16.253 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:16.253 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 4, 2024-09-13T06:40:16.253 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2024-09-13T06:40:16.253 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2024-09-13T06:40:16.254 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2024-09-13T06:40:16.254 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138322906710015, 2024-09-13T06:40:16.254 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2024-09-13T06:40:16.254 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2024-09-13T06:39:05.421023+0000", 2024-09-13T06:40:16.254 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2024-09-13T06:40:16.254 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:16.254 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:16.255 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 5, 2024-09-13T06:40:16.255 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2024-09-13T06:40:16.255 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2024-09-13T06:40:16.255 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2024-09-13T06:40:16.255 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138322906710015, 2024-09-13T06:40:16.255 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2024-09-13T06:40:16.255 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2024-09-13T06:39:05.477489+0000", 2024-09-13T06:40:16.256 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2024-09-13T06:40:16.256 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:16.256 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:16.256 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 6, 2024-09-13T06:40:16.256 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2024-09-13T06:40:16.256 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2024-09-13T06:40:16.256 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2024-09-13T06:40:16.257 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138322906710015, 2024-09-13T06:40:16.257 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2024-09-13T06:40:16.257 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2024-09-13T06:39:05.314700+0000", 2024-09-13T06:40:16.257 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2024-09-13T06:40:16.257 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:16.257 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:16.257 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 7, 2024-09-13T06:40:16.257 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2024-09-13T06:40:16.257 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2024-09-13T06:40:16.257 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2024-09-13T06:40:16.257 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138322906710015, 2024-09-13T06:40:16.258 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 65536, 2024-09-13T06:40:16.258 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2024-09-13T06:39:05.462229+0000", 2024-09-13T06:40:16.258 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2024-09-13T06:40:16.258 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:16.258 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-13T06:40:16.258 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_upmap": [ 2024-09-13T06:40:16.258 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:16.258 INFO:teuthology.orchestra.run.smithi081.stdout: "pgid": "3.15", 2024-09-13T06:40:16.258 INFO:teuthology.orchestra.run.smithi081.stdout: "osds": [ 2024-09-13T06:40:16.258 INFO:teuthology.orchestra.run.smithi081.stdout: 3, 2024-09-13T06:40:16.258 INFO:teuthology.orchestra.run.smithi081.stdout: 7 2024-09-13T06:40:16.258 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:16.258 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:16.259 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-13T06:40:16.259 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_upmap_items": [ 2024-09-13T06:40:16.259 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:16.259 INFO:teuthology.orchestra.run.smithi081.stdout: "pgid": "3.f", 2024-09-13T06:40:16.259 INFO:teuthology.orchestra.run.smithi081.stdout: "mappings": [ 2024-09-13T06:40:16.259 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:16.259 INFO:teuthology.orchestra.run.smithi081.stdout: "from": 4, 2024-09-13T06:40:16.259 INFO:teuthology.orchestra.run.smithi081.stdout: "to": 2 2024-09-13T06:40:16.259 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:16.259 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:16.259 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:16.259 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-13T06:40:16.259 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_upmap_primaries": [], 2024-09-13T06:40:16.259 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_temp": [], 2024-09-13T06:40:16.260 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_temp": [], 2024-09-13T06:40:16.260 INFO:teuthology.orchestra.run.smithi081.stdout: "blocklist": {}, 2024-09-13T06:40:16.260 INFO:teuthology.orchestra.run.smithi081.stdout: "range_blocklist": {}, 2024-09-13T06:40:16.260 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profiles": { 2024-09-13T06:40:16.260 INFO:teuthology.orchestra.run.smithi081.stdout: "default": { 2024-09-13T06:40:16.260 INFO:teuthology.orchestra.run.smithi081.stdout: "crush-failure-domain": "osd", 2024-09-13T06:40:16.260 INFO:teuthology.orchestra.run.smithi081.stdout: "k": "2", 2024-09-13T06:40:16.260 INFO:teuthology.orchestra.run.smithi081.stdout: "m": "1", 2024-09-13T06:40:16.260 INFO:teuthology.orchestra.run.smithi081.stdout: "plugin": "jerasure", 2024-09-13T06:40:16.260 INFO:teuthology.orchestra.run.smithi081.stdout: "technique": "reed_sol_van" 2024-09-13T06:40:16.260 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:16.260 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:16.260 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps_queue": [ 2024-09-13T06:40:16.261 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:16.261 INFO:teuthology.orchestra.run.smithi081.stdout: "pool": 3, 2024-09-13T06:40:16.261 INFO:teuthology.orchestra.run.smithi081.stdout: "snaps": [ 2024-09-13T06:40:16.261 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:16.261 INFO:teuthology.orchestra.run.smithi081.stdout: "begin": 26, 2024-09-13T06:40:16.261 INFO:teuthology.orchestra.run.smithi081.stdout: "length": 1 2024-09-13T06:40:16.261 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:16.261 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:16.261 INFO:teuthology.orchestra.run.smithi081.stdout: "begin": 29, 2024-09-13T06:40:16.261 INFO:teuthology.orchestra.run.smithi081.stdout: "length": 1 2024-09-13T06:40:16.261 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:16.261 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:16.262 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:16.262 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-13T06:40:16.262 INFO:teuthology.orchestra.run.smithi081.stdout: "new_removed_snaps": [ 2024-09-13T06:40:16.262 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:16.262 INFO:teuthology.orchestra.run.smithi081.stdout: "pool": 3, 2024-09-13T06:40:16.262 INFO:teuthology.orchestra.run.smithi081.stdout: "snaps": [ 2024-09-13T06:40:16.262 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:16.262 INFO:teuthology.orchestra.run.smithi081.stdout: "begin": 29, 2024-09-13T06:40:16.262 INFO:teuthology.orchestra.run.smithi081.stdout: "length": 1 2024-09-13T06:40:16.262 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:16.262 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:16.262 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:16.262 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-13T06:40:16.262 INFO:teuthology.orchestra.run.smithi081.stdout: "new_purged_snaps": [], 2024-09-13T06:40:16.263 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_node_flags": {}, 2024-09-13T06:40:16.263 INFO:teuthology.orchestra.run.smithi081.stdout: "device_class_flags": {}, 2024-09-13T06:40:16.263 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": { 2024-09-13T06:40:16.263 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode_enabled": false, 2024-09-13T06:40:16.263 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_bucket_count": 0, 2024-09-13T06:40:16.263 INFO:teuthology.orchestra.run.smithi081.stdout: "degraded_stretch_mode": 0, 2024-09-13T06:40:16.263 INFO:teuthology.orchestra.run.smithi081.stdout: "recovering_stretch_mode": 0, 2024-09-13T06:40:16.263 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode_bucket": 0 2024-09-13T06:40:16.263 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:16.263 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:40:16.265 INFO:teuthology.orchestra.run.smithi081.stdout:1645 write 0x1e435cf thru 0x1e4daa6 (0xa4d8 bytes) 2024-09-13T06:40:16.265 INFO:teuthology.orchestra.run.smithi081.stdout:1646 writesame 0x71cbd69 thru 0x71da685 data_size 0x1(0xe91d bytes) 2024-09-13T06:40:16.266 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:40:16.266 INFO:teuthology.orchestra.run.smithi139.stdout: "size": 20, 2024-09-13T06:40:16.266 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 600, 2024-09-13T06:40:16.266 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [ 2024-09-13T06:40:16.266 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.266 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27854 3.a 3:537b3559:::rbd_data.1121f2c5ee81.0000000000000016:13 [read 335872~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:16.266 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.658750+0000", 2024-09-13T06:40:16.267 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 19.540770634000001, 2024-09-13T06:40:16.267 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.037969532, 2024-09-13T06:40:16.267 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:16.267 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:16.267 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:16.267 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:16.267 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:16.267 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27854 2024-09-13T06:40:16.267 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.267 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:16.267 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.267 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:16.267 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658750+0000", 2024-09-13T06:40:16.267 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:16.268 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.268 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.268 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:16.268 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658750+0000", 2024-09-13T06:40:16.268 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:16.268 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.268 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.268 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:16.268 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658749+0000", 2024-09-13T06:40:16.268 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:16.268 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.268 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.269 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:16.269 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658757+0000", 2024-09-13T06:40:16.269 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.7389999999999999e-06 2024-09-13T06:40:16.269 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.269 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.269 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:16.269 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658763+0000", 2024-09-13T06:40:16.269 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.7769999999999999e-06 2024-09-13T06:40:16.269 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.269 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.269 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:16.269 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658767+0000", 2024-09-13T06:40:16.269 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.1749999999999998e-06 2024-09-13T06:40:16.270 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.270 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.270 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:16.270 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.696322+0000", 2024-09-13T06:40:16.270 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.037554772 2024-09-13T06:40:16.270 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.270 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.270 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:16.270 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.696418+0000", 2024-09-13T06:40:16.270 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6050000000000004e-05 2024-09-13T06:40:16.270 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.270 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.271 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:16.271 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.696719+0000", 2024-09-13T06:40:16.271 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00030138499999999999 2024-09-13T06:40:16.271 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:16.271 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:16.271 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:16.271 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.271 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.271 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27855 3.a 3:537b3559:::rbd_data.1121f2c5ee81.0000000000000016:13 [read 380928~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:16.271 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.658771+0000", 2024-09-13T06:40:16.271 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 19.540749389999998, 2024-09-13T06:40:16.271 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.038326354, 2024-09-13T06:40:16.271 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:16.272 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:16.272 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:16.272 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:16.272 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:16.272 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27855 2024-09-13T06:40:16.272 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.272 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:16.272 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.272 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:16.272 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658771+0000", 2024-09-13T06:40:16.272 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:16.272 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.272 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.273 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:16.273 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658771+0000", 2024-09-13T06:40:16.273 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:16.273 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.273 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.273 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:16.273 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658770+0000", 2024-09-13T06:40:16.273 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:16.273 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.273 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.273 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:16.273 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658772+0000", 2024-09-13T06:40:16.273 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.0930000000000001e-06 2024-09-13T06:40:16.274 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.274 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.274 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:16.274 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658778+0000", 2024-09-13T06:40:16.274 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.2730000000000002e-06 2024-09-13T06:40:16.274 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.274 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.274 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:16.274 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658782+0000", 2024-09-13T06:40:16.274 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0879999999999997e-06 2024-09-13T06:40:16.274 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.274 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.274 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:16.274 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.696770+0000", 2024-09-13T06:40:16.275 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.037988145000000001 2024-09-13T06:40:16.275 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.275 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.275 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:16.275 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.696852+0000", 2024-09-13T06:40:16.275 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.2039999999999994e-05 2024-09-13T06:40:16.275 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.275 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.275 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:16.275 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.697097+0000", 2024-09-13T06:40:16.275 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00024508800000000002 2024-09-13T06:40:16.275 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:16.275 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:16.275 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:16.276 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.276 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.276 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27856 3.a 3:537b3559:::rbd_data.1121f2c5ee81.0000000000000016:13 [read 405504~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:16.276 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.658786+0000", 2024-09-13T06:40:16.276 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 19.540734273999998, 2024-09-13T06:40:16.276 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.038736029999999998, 2024-09-13T06:40:16.276 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:16.276 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:16.276 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:16.276 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:16.276 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:16.276 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27856 2024-09-13T06:40:16.276 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.277 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:16.277 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.277 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:16.277 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658786+0000", 2024-09-13T06:40:16.277 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:16.277 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.277 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.277 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:16.277 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658786+0000", 2024-09-13T06:40:16.277 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:16.277 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.277 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.277 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:16.278 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658785+0000", 2024-09-13T06:40:16.278 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:16.278 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.278 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.278 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:16.278 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658787+0000", 2024-09-13T06:40:16.278 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.0040000000000002e-06 2024-09-13T06:40:16.278 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.278 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.278 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:16.278 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658793+0000", 2024-09-13T06:40:16.278 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.2410000000000003e-06 2024-09-13T06:40:16.278 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.279 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.279 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:16.279 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658797+0000", 2024-09-13T06:40:16.279 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.1330000000000001e-06 2024-09-13T06:40:16.279 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.279 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.279 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:16.279 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.697176+0000", 2024-09-13T06:40:16.279 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.038379074999999999 2024-09-13T06:40:16.279 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.279 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.279 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:16.279 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.697275+0000", 2024-09-13T06:40:16.279 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.8819000000000004e-05 2024-09-13T06:40:16.280 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.280 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.280 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:16.280 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.697522+0000", 2024-09-13T06:40:16.280 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00024719999999999999 2024-09-13T06:40:16.280 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:16.280 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:16.280 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:16.280 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.280 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.280 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27857 3.a 3:537b3559:::rbd_data.1121f2c5ee81.0000000000000016:13 [read 475136~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:16.281 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.658845+0000", 2024-09-13T06:40:16.281 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 19.540675271000001, 2024-09-13T06:40:16.281 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039112570999999999, 2024-09-13T06:40:16.281 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:16.281 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:16.281 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:16.281 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:16.281 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:16.281 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27857 2024-09-13T06:40:16.281 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.281 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:16.281 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.281 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:16.282 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658845+0000", 2024-09-13T06:40:16.282 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:16.282 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.282 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.282 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:16.282 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658845+0000", 2024-09-13T06:40:16.282 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:16.282 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.282 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.282 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:16.282 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658844+0000", 2024-09-13T06:40:16.282 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999986 2024-09-13T06:40:16.283 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.283 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.283 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:16.283 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658868+0000", 2024-09-13T06:40:16.283 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.4615000000000001e-05 2024-09-13T06:40:16.283 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.283 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.283 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:16.283 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658884+0000", 2024-09-13T06:40:16.283 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5401999999999999e-05 2024-09-13T06:40:16.283 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.283 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.283 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:16.284 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658896+0000", 2024-09-13T06:40:16.284 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2509e-05 2024-09-13T06:40:16.284 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.284 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.284 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:16.284 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.697571+0000", 2024-09-13T06:40:16.284 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.038675107 2024-09-13T06:40:16.284 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.284 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.284 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:16.284 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.697658+0000", 2024-09-13T06:40:16.284 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6349999999999998e-05 2024-09-13T06:40:16.285 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.285 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.285 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:16.285 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.697957+0000", 2024-09-13T06:40:16.285 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00029986100000000001 2024-09-13T06:40:16.285 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:16.285 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:16.285 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:16.285 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.285 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.286 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27858 3.a 3:537b3559:::rbd_data.1121f2c5ee81.0000000000000016:13 [read 499712~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:16.286 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.658905+0000", 2024-09-13T06:40:16.286 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 19.540614721000001, 2024-09-13T06:40:16.286 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039475392999999998, 2024-09-13T06:40:16.286 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:16.286 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:16.286 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:16.286 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:16.286 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:16.286 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27858 2024-09-13T06:40:16.286 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.286 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:16.286 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.287 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:16.287 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658905+0000", 2024-09-13T06:40:16.287 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:16.287 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.287 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.287 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:16.287 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658905+0000", 2024-09-13T06:40:16.287 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:16.287 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.287 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.287 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:16.287 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658905+0000", 2024-09-13T06:40:16.287 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:16.288 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.288 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.288 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:16.288 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658909+0000", 2024-09-13T06:40:16.288 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.831e-06 2024-09-13T06:40:16.288 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.288 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.288 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:16.288 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658920+0000", 2024-09-13T06:40:16.288 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0936e-05 2024-09-13T06:40:16.288 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.288 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.288 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:16.289 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658929+0000", 2024-09-13T06:40:16.289 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.2749999999999995e-06 2024-09-13T06:40:16.289 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.289 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.289 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:16.289 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.697990+0000", 2024-09-13T06:40:16.289 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039061625000000003 2024-09-13T06:40:16.289 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.289 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.289 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:16.289 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.698077+0000", 2024-09-13T06:40:16.289 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6922000000000006e-05 2024-09-13T06:40:16.289 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.290 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.290 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:16.290 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.698381+0000", 2024-09-13T06:40:16.290 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00030360599999999999 2024-09-13T06:40:16.290 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:16.290 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:16.290 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:16.290 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.290 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.290 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27929 3.a 3:537b3559:::rbd_data.1121f2c5ee81.0000000000000016:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:16.290 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.659338+0000", 2024-09-13T06:40:16.290 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 19.540181889999999, 2024-09-13T06:40:16.291 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039351214000000002, 2024-09-13T06:40:16.291 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:16.291 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:16.291 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:16.291 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:16.291 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:16.291 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27929 2024-09-13T06:40:16.291 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.291 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:16.291 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.291 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:16.291 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.659338+0000", 2024-09-13T06:40:16.291 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:16.291 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.292 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.292 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:16.292 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.659338+0000", 2024-09-13T06:40:16.292 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:16.292 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.292 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.292 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:16.292 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.659337+0000", 2024-09-13T06:40:16.292 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:16.292 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.292 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.292 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:16.293 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.659342+0000", 2024-09-13T06:40:16.293 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0799999999999999e-06 2024-09-13T06:40:16.293 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.293 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.293 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:16.293 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.659353+0000", 2024-09-13T06:40:16.293 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1798e-05 2024-09-13T06:40:16.293 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.293 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.293 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:16.293 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.659361+0000", 2024-09-13T06:40:16.293 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.8040000000000002e-06 2024-09-13T06:40:16.293 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.294 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.294 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:16.294 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.698449+0000", 2024-09-13T06:40:16.294 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039087519000000001 2024-09-13T06:40:16.294 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.294 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.294 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:16.294 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.698567+0000", 2024-09-13T06:40:16.294 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00011857 2024-09-13T06:40:16.294 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.294 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.294 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:16.294 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.698689+0000", 2024-09-13T06:40:16.295 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00012226699999999999 2024-09-13T06:40:16.295 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:16.295 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:16.295 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:16.295 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.295 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.295 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27974 3.a 3:537b3559:::rbd_data.1121f2c5ee81.0000000000000016:13 [read 32768~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:16.295 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.660102+0000", 2024-09-13T06:40:16.295 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 19.539418122000001, 2024-09-13T06:40:16.295 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.038972346999999997, 2024-09-13T06:40:16.295 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:16.295 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:16.295 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:16.296 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:16.296 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:16.296 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27974 2024-09-13T06:40:16.296 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.296 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:16.296 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.296 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:16.296 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660102+0000", 2024-09-13T06:40:16.296 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:16.296 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.296 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.296 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:16.297 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660102+0000", 2024-09-13T06:40:16.297 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:16.297 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.297 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.297 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:16.297 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660100+0000", 2024-09-13T06:40:16.297 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999976 2024-09-13T06:40:16.297 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.297 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.297 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:16.297 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660114+0000", 2024-09-13T06:40:16.297 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.4466e-05 2024-09-13T06:40:16.298 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.298 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.298 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:16.298 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660148+0000", 2024-09-13T06:40:16.298 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.3742999999999999e-05 2024-09-13T06:40:16.298 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.298 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.298 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:16.298 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660170+0000", 2024-09-13T06:40:16.298 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.2518e-05 2024-09-13T06:40:16.298 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.298 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.298 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:16.299 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.698719+0000", 2024-09-13T06:40:16.299 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.038548529999999998 2024-09-13T06:40:16.299 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.299 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.299 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:16.299 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.698806+0000", 2024-09-13T06:40:16.299 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.7179e-05 2024-09-13T06:40:16.299 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.299 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.299 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:16.299 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.699074+0000", 2024-09-13T06:40:16.299 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00026834800000000001 2024-09-13T06:40:16.299 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:16.299 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:16.300 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:16.300 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.300 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.300 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27975 3.a 3:537b3559:::rbd_data.1121f2c5ee81.0000000000000016:13 [read 57344~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:16.300 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.660189+0000", 2024-09-13T06:40:16.300 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 19.539331277999999, 2024-09-13T06:40:16.300 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039288678, 2024-09-13T06:40:16.300 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:16.300 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:16.300 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:16.300 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:16.300 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:16.301 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27975 2024-09-13T06:40:16.301 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.301 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:16.301 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.301 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:16.301 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660189+0000", 2024-09-13T06:40:16.301 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:16.301 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.301 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.301 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:16.301 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660189+0000", 2024-09-13T06:40:16.301 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:16.302 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.302 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.302 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:16.302 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660187+0000", 2024-09-13T06:40:16.302 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999981 2024-09-13T06:40:16.302 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.302 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.302 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:16.302 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660195+0000", 2024-09-13T06:40:16.302 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5610000000000001e-06 2024-09-13T06:40:16.302 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.302 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.302 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:16.302 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660212+0000", 2024-09-13T06:40:16.303 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7725999999999999e-05 2024-09-13T06:40:16.303 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.303 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.303 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:16.303 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660227+0000", 2024-09-13T06:40:16.303 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.43e-05 2024-09-13T06:40:16.303 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.303 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.303 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:16.303 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.699135+0000", 2024-09-13T06:40:16.303 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.038908336000000002 2024-09-13T06:40:16.303 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.303 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.304 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:16.304 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.699208+0000", 2024-09-13T06:40:16.304 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.3065000000000006e-05 2024-09-13T06:40:16.304 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.304 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.304 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:16.304 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.699478+0000", 2024-09-13T06:40:16.304 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00026946899999999999 2024-09-13T06:40:16.304 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:16.304 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:16.304 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:16.304 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.304 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.305 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27976 3.a 3:537b3559:::rbd_data.1121f2c5ee81.0000000000000016:13 [read 102400~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:16.305 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.660238+0000", 2024-09-13T06:40:16.305 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 19.539282114999999, 2024-09-13T06:40:16.305 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039636515999999997, 2024-09-13T06:40:16.305 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:16.305 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:16.305 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:16.305 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:16.305 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:16.305 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27976 2024-09-13T06:40:16.305 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.305 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:16.305 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.306 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:16.306 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660238+0000", 2024-09-13T06:40:16.306 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:16.306 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.306 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.306 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:16.306 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660238+0000", 2024-09-13T06:40:16.306 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:16.306 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.306 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.306 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:16.306 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660237+0000", 2024-09-13T06:40:16.306 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:16.307 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.307 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.307 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:16.307 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660243+0000", 2024-09-13T06:40:16.307 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.9909999999999999e-06 2024-09-13T06:40:16.307 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.307 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.307 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:16.307 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660259+0000", 2024-09-13T06:40:16.307 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6294e-05 2024-09-13T06:40:16.307 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.307 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.307 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:16.308 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660272+0000", 2024-09-13T06:40:16.308 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2714999999999999e-05 2024-09-13T06:40:16.308 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.308 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.308 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:16.308 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.699513+0000", 2024-09-13T06:40:16.308 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039240932999999999 2024-09-13T06:40:16.308 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.308 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.308 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:16.309 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.699604+0000", 2024-09-13T06:40:16.309 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.1367999999999997e-05 2024-09-13T06:40:16.309 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.309 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.309 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:16.309 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.699875+0000", 2024-09-13T06:40:16.309 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00027029499999999999 2024-09-13T06:40:16.309 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:16.309 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:16.309 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:16.309 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.309 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.310 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27977 3.a 3:537b3559:::rbd_data.1121f2c5ee81.0000000000000016:13 [read 126976~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:16.310 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.660284+0000", 2024-09-13T06:40:16.310 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 19.539236543000001, 2024-09-13T06:40:16.310 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039969945, 2024-09-13T06:40:16.310 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:16.310 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:16.310 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:16.310 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:16.310 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:16.310 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27977 2024-09-13T06:40:16.310 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.310 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:16.310 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.311 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:16.311 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660284+0000", 2024-09-13T06:40:16.311 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:16.311 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.311 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.311 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:16.311 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660284+0000", 2024-09-13T06:40:16.311 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:16.311 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.311 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.311 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:16.311 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660282+0000", 2024-09-13T06:40:16.311 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999986 2024-09-13T06:40:16.312 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.312 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.312 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:16.312 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660288+0000", 2024-09-13T06:40:16.312 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.2650000000000002e-06 2024-09-13T06:40:16.312 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.312 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.312 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:16.312 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660304+0000", 2024-09-13T06:40:16.312 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5430999999999998e-05 2024-09-13T06:40:16.312 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.312 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.313 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:16.313 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660316+0000", 2024-09-13T06:40:16.313 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.237e-05 2024-09-13T06:40:16.313 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.313 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.313 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:16.313 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.699907+0000", 2024-09-13T06:40:16.313 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039590735000000002 2024-09-13T06:40:16.313 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.313 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.313 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:16.313 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.699994+0000", 2024-09-13T06:40:16.314 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6996999999999994e-05 2024-09-13T06:40:16.314 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.314 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.314 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:16.314 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700254+0000", 2024-09-13T06:40:16.314 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000259564 2024-09-13T06:40:16.314 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:16.314 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:16.314 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:16.315 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.315 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.315 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27978 3.a 3.9aacdeca (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:16.315 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.660327+0000", 2024-09-13T06:40:16.315 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 19.539192945, 2024-09-13T06:40:16.315 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039984858999999998, 2024-09-13T06:40:16.315 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:16.315 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:40:16.315 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:16.315 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:16.316 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:16.316 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27978 2024-09-13T06:40:16.316 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.316 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:16.316 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.316 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:16.316 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660327+0000", 2024-09-13T06:40:16.316 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:16.316 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.316 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.316 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:16.316 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660327+0000", 2024-09-13T06:40:16.317 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:16.317 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.317 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.317 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:16.317 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660326+0000", 2024-09-13T06:40:16.317 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:16.317 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.317 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.318 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:16.318 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660366+0000", 2024-09-13T06:40:16.318 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.9691000000000003e-05 2024-09-13T06:40:16.318 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.318 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.318 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:16.318 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660399+0000", 2024-09-13T06:40:16.318 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.3262000000000001e-05 2024-09-13T06:40:16.318 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.319 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.319 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:16.319 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660414+0000", 2024-09-13T06:40:16.319 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.4775e-05 2024-09-13T06:40:16.319 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.319 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.319 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:16.319 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700298+0000", 2024-09-13T06:40:16.320 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039883759999999997 2024-09-13T06:40:16.320 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.320 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.320 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:16.320 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700312+0000", 2024-09-13T06:40:16.320 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.4374e-05 2024-09-13T06:40:16.320 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:16.320 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:16.320 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:16.320 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.320 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.320 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27979 3.a 3.9aacdeca (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:16.320 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.660429+0000", 2024-09-13T06:40:16.321 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 19.539091076999998, 2024-09-13T06:40:16.321 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039921361000000002, 2024-09-13T06:40:16.321 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:16.321 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:40:16.321 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:16.321 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:16.321 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:16.321 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27979 2024-09-13T06:40:16.321 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.321 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:16.322 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.322 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:16.322 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660429+0000", 2024-09-13T06:40:16.322 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:16.322 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.322 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.322 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:16.322 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660429+0000", 2024-09-13T06:40:16.322 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:16.322 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.322 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.322 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:16.322 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660428+0000", 2024-09-13T06:40:16.323 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999986 2024-09-13T06:40:16.323 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.323 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.323 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:16.323 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660434+0000", 2024-09-13T06:40:16.323 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.8190000000000003e-06 2024-09-13T06:40:16.323 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.323 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.323 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:16.323 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660451+0000", 2024-09-13T06:40:16.323 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6963e-05 2024-09-13T06:40:16.323 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.323 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.324 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:16.324 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660485+0000", 2024-09-13T06:40:16.324 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.3414000000000002e-05 2024-09-13T06:40:16.324 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.324 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.324 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:16.324 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700342+0000", 2024-09-13T06:40:16.324 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039857278000000003 2024-09-13T06:40:16.324 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.324 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.324 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:16.324 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700350+0000", 2024-09-13T06:40:16.325 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.2930000000000001e-06 2024-09-13T06:40:16.325 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:16.325 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:16.325 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:16.325 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.325 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.325 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27980 3.a 3.9aacdeca (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:16.325 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.660497+0000", 2024-09-13T06:40:16.325 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 19.539022866, 2024-09-13T06:40:16.325 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039888034000000003, 2024-09-13T06:40:16.325 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:16.325 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:40:16.326 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:16.326 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:16.326 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:16.326 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27980 2024-09-13T06:40:16.326 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.326 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:16.326 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.326 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:16.326 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660497+0000", 2024-09-13T06:40:16.326 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:16.326 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.326 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.326 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:16.326 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660497+0000", 2024-09-13T06:40:16.327 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:16.327 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.327 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.327 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:16.327 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660496+0000", 2024-09-13T06:40:16.327 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:16.327 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.327 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.327 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:16.327 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660503+0000", 2024-09-13T06:40:16.327 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.4110000000000001e-06 2024-09-13T06:40:16.327 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.327 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.328 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:16.328 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660519+0000", 2024-09-13T06:40:16.328 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6180000000000001e-05 2024-09-13T06:40:16.328 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.328 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.328 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:16.328 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660544+0000", 2024-09-13T06:40:16.328 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.5177999999999998e-05 2024-09-13T06:40:16.328 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.328 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.328 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:16.328 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700377+0000", 2024-09-13T06:40:16.329 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039833434000000001 2024-09-13T06:40:16.329 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.329 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.329 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:16.329 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700385+0000", 2024-09-13T06:40:16.329 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.8800000000000008e-06 2024-09-13T06:40:16.329 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:16.329 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:16.329 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:16.329 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.330 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.330 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27981 3.a 3.9aacdeca (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:16.330 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.660556+0000", 2024-09-13T06:40:16.330 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 19.53896452, 2024-09-13T06:40:16.330 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039869989000000002, 2024-09-13T06:40:16.330 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:16.330 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:40:16.330 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:16.330 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:16.331 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:16.331 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27981 2024-09-13T06:40:16.331 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.331 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:16.331 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.331 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:16.331 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660556+0000", 2024-09-13T06:40:16.331 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:16.331 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.331 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.331 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:16.332 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660556+0000", 2024-09-13T06:40:16.332 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:16.332 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.332 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.332 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:16.332 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660555+0000", 2024-09-13T06:40:16.332 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:16.332 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.332 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.333 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:16.333 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660561+0000", 2024-09-13T06:40:16.333 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.088e-06 2024-09-13T06:40:16.333 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.333 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.333 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:16.333 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660577+0000", 2024-09-13T06:40:16.333 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6147999999999999e-05 2024-09-13T06:40:16.334 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.334 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.334 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:16.334 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660589+0000", 2024-09-13T06:40:16.334 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2551999999999999e-05 2024-09-13T06:40:16.334 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.334 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.334 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:16.334 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700414+0000", 2024-09-13T06:40:16.334 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039825007000000003 2024-09-13T06:40:16.334 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.334 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.334 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:16.335 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700426+0000", 2024-09-13T06:40:16.335 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1265e-05 2024-09-13T06:40:16.335 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:16.335 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:16.335 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:16.335 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.335 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.335 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27982 3.a 3.9aacdeca (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:16.335 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.660603+0000", 2024-09-13T06:40:16.335 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 19.538916924999999, 2024-09-13T06:40:16.335 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039874779999999999, 2024-09-13T06:40:16.335 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:16.336 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:40:16.336 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:16.336 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:16.336 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:16.336 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27982 2024-09-13T06:40:16.336 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.336 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:16.337 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.337 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:16.337 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660603+0000", 2024-09-13T06:40:16.337 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:16.337 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.338 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.338 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:16.338 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660603+0000", 2024-09-13T06:40:16.338 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:16.338 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.338 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.338 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:16.339 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660602+0000", 2024-09-13T06:40:16.339 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:16.339 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.339 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.339 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:16.339 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660653+0000", 2024-09-13T06:40:16.340 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.0862000000000002e-05 2024-09-13T06:40:16.340 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.340 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.340 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:16.340 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660697+0000", 2024-09-13T06:40:16.340 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.3773000000000003e-05 2024-09-13T06:40:16.341 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.341 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.341 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:16.341 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660712+0000", 2024-09-13T06:40:16.341 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5464999999999998e-05 2024-09-13T06:40:16.341 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.342 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.342 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:16.342 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700469+0000", 2024-09-13T06:40:16.342 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039756503999999998 2024-09-13T06:40:16.342 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.342 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.342 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:16.343 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700478+0000", 2024-09-13T06:40:16.343 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.1730000000000001e-06 2024-09-13T06:40:16.343 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:16.343 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:16.343 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:16.343 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.344 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.344 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27983 3.a 3.9aacdeca (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:16.344 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.660726+0000", 2024-09-13T06:40:16.344 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 19.538793649999999, 2024-09-13T06:40:16.344 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039804357999999998, 2024-09-13T06:40:16.344 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:16.345 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:40:16.345 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:16.345 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:16.345 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:16.345 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27983 2024-09-13T06:40:16.345 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.346 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:16.346 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.346 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:16.346 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660726+0000", 2024-09-13T06:40:16.346 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:16.346 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.347 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.347 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:16.347 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660726+0000", 2024-09-13T06:40:16.347 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:16.347 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.347 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.347 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:16.348 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660725+0000", 2024-09-13T06:40:16.348 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999986 2024-09-13T06:40:16.348 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.348 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.348 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:16.348 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660733+0000", 2024-09-13T06:40:16.349 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.9359999999999999e-06 2024-09-13T06:40:16.349 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.349 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.349 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:16.349 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660751+0000", 2024-09-13T06:40:16.349 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7679000000000001e-05 2024-09-13T06:40:16.349 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.350 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.350 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:16.350 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660764+0000", 2024-09-13T06:40:16.350 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3112000000000001e-05 2024-09-13T06:40:16.350 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.350 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.351 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:16.351 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700516+0000", 2024-09-13T06:40:16.351 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039752183000000003 2024-09-13T06:40:16.351 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.351 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.351 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:16.352 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700531+0000", 2024-09-13T06:40:16.352 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.4732999999999999e-05 2024-09-13T06:40:16.352 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:16.352 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:16.352 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:16.352 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.353 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.353 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27984 3.a 3.9aacdeca (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:16.353 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.660776+0000", 2024-09-13T06:40:16.353 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 19.538744547, 2024-09-13T06:40:16.353 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039795697999999997, 2024-09-13T06:40:16.353 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:16.353 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:40:16.354 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:16.354 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:16.354 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:16.354 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27984 2024-09-13T06:40:16.354 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.354 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:16.355 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.355 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:16.355 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660776+0000", 2024-09-13T06:40:16.355 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:16.355 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.355 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.355 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:16.355 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660776+0000", 2024-09-13T06:40:16.356 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:16.356 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.356 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.356 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:16.356 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660775+0000", 2024-09-13T06:40:16.356 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:16.356 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.357 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.357 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:16.357 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660780+0000", 2024-09-13T06:40:16.357 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.7849999999999997e-06 2024-09-13T06:40:16.357 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.357 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.357 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:16.358 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660799+0000", 2024-09-13T06:40:16.358 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.8794e-05 2024-09-13T06:40:16.358 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.358 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.358 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:16.358 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660812+0000", 2024-09-13T06:40:16.358 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3029e-05 2024-09-13T06:40:16.359 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.359 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.359 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:16.359 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700562+0000", 2024-09-13T06:40:16.359 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039749984000000002 2024-09-13T06:40:16.359 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.359 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.360 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:16.360 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700571+0000", 2024-09-13T06:40:16.360 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.1260000000000004e-06 2024-09-13T06:40:16.360 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:16.360 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:16.360 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:16.360 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.361 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.361 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27985 3.a 3.9aacdeca (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:16.361 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.660824+0000", 2024-09-13T06:40:16.361 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 19.538696495, 2024-09-13T06:40:16.361 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039784462, 2024-09-13T06:40:16.361 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:16.361 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:40:16.362 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:16.362 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:16.362 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:16.362 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27985 2024-09-13T06:40:16.362 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.362 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:16.362 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.363 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:16.363 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660824+0000", 2024-09-13T06:40:16.363 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:16.363 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.363 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.363 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:16.363 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660824+0000", 2024-09-13T06:40:16.364 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:16.364 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.364 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.364 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:16.364 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660823+0000", 2024-09-13T06:40:16.364 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:16.364 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.364 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.365 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:16.365 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660829+0000", 2024-09-13T06:40:16.365 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.9440000000000002e-06 2024-09-13T06:40:16.365 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.365 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.365 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:16.365 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660922+0000", 2024-09-13T06:40:16.366 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.2958e-05 2024-09-13T06:40:16.366 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.366 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.366 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:16.366 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660964+0000", 2024-09-13T06:40:16.366 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.2407000000000002e-05 2024-09-13T06:40:16.366 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.366 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.367 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:16.367 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700600+0000", 2024-09-13T06:40:16.367 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039635581000000003 2024-09-13T06:40:16.367 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.367 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.367 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:16.367 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700608+0000", 2024-09-13T06:40:16.367 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.5890000000000003e-06 2024-09-13T06:40:16.368 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:16.368 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:16.368 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:16.368 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.368 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.368 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:28023 3.10 3:0dedc28a:::rbd_data.1121f2c5ee81.0000000000000019:13 [read 475136~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:16.369 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.662072+0000", 2024-09-13T06:40:16.369 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 19.537448510000001, 2024-09-13T06:40:16.369 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.038086508999999998, 2024-09-13T06:40:16.369 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:16.369 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:16.369 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:16.369 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:16.370 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:16.370 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 28023 2024-09-13T06:40:16.370 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.370 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:16.370 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.370 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:16.371 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.662072+0000", 2024-09-13T06:40:16.371 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:16.371 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.371 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.371 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:16.371 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.662072+0000", 2024-09-13T06:40:16.371 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:16.372 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.372 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.372 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:16.372 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.662070+0000", 2024-09-13T06:40:16.372 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999986 2024-09-13T06:40:16.372 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.373 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.373 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:16.373 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.662076+0000", 2024-09-13T06:40:16.373 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.139e-06 2024-09-13T06:40:16.373 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.373 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.373 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:16.374 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.662094+0000", 2024-09-13T06:40:16.374 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7136999999999999e-05 2024-09-13T06:40:16.374 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.374 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.374 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:16.374 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.662124+0000", 2024-09-13T06:40:16.375 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.0528999999999999e-05 2024-09-13T06:40:16.375 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.375 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.375 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:16.375 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.699843+0000", 2024-09-13T06:40:16.375 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.037718415999999998 2024-09-13T06:40:16.375 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.376 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.376 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:16.376 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.699931+0000", 2024-09-13T06:40:16.376 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.8345999999999997e-05 2024-09-13T06:40:16.376 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.376 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.376 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:16.377 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700158+0000", 2024-09-13T06:40:16.377 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00022723099999999999 2024-09-13T06:40:16.377 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:16.377 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:16.377 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:16.377 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.378 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.378 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:28024 3.10 3.5143b7b0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:16.378 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.662137+0000", 2024-09-13T06:40:16.378 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 19.537382988000001, 2024-09-13T06:40:16.378 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.038056092999999999, 2024-09-13T06:40:16.378 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:16.378 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:40:16.379 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:16.379 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:16.379 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:16.379 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 28024 2024-09-13T06:40:16.379 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.379 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:16.379 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.380 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:16.380 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.662137+0000", 2024-09-13T06:40:16.380 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:16.380 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.380 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.380 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:16.380 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.662137+0000", 2024-09-13T06:40:16.381 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:16.381 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.381 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.381 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:16.381 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.662136+0000", 2024-09-13T06:40:16.381 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999986 2024-09-13T06:40:16.382 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.382 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.382 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:16.382 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.662142+0000", 2024-09-13T06:40:16.382 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.6930000000000001e-06 2024-09-13T06:40:16.382 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.382 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.383 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:16.383 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.662160+0000", 2024-09-13T06:40:16.383 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7863000000000002e-05 2024-09-13T06:40:16.383 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.383 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.383 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:16.383 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.662189+0000", 2024-09-13T06:40:16.384 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.8486000000000001e-05 2024-09-13T06:40:16.384 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.384 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.384 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:16.384 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700187+0000", 2024-09-13T06:40:16.384 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.037998331000000003 2024-09-13T06:40:16.385 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.385 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.385 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:16.385 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700193+0000", 2024-09-13T06:40:16.385 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.0909999999999998e-06 2024-09-13T06:40:16.385 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:16.386 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:16.386 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:16.386 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:16.386 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:16.386 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:40:16.387 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-13T06:40:16.388 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:40:16.263+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:40:16.389 INFO:tasks.thrashosds.thrasher:j is {'epoch': 63, 'fsid': 'e5612297-d004-4957-927e-afa37f30d6cf', 'created': '2024-09-13T06:38:56.670231+0000', 'modified': '2024-09-13T06:40:15.417389+0000', 'last_up_change': '2024-09-13T06:39:09.107597+0000', 'last_in_change': '2024-09-13T06:39:48.513717+0000', 'flags': 'noscrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5801984, 'flags_set': ['noscrub', 'pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 4, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 3, 'max_osd': 8, 'require_min_compat_client': 'luminous', 'min_compat_client': 'luminous', 'require_osd_release': 'reef', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T06:39:09.600726+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-09-13T06:39:15.802118+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 3, 'snap_epoch': 20, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 2.630000114440918, 'raw_score_stable': 2.630000114440918, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'pool_client.0', 'create_time': '2024-09-13T06:39:25.648942+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '63', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 30, 'snap_epoch': 63, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.7400000095367432, 'score_stable': 1.7400000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.5299999713897705, 'raw_score_stable': 1.5299999713897705, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}], 'osds': [{'osd': 0, 'uuid': '54b0a3e4-58ad-4f95-86dc-29a11c9a1964', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 55, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6808', 'nonce': 1904727940}, {'type': 'v1', 'addr': '172.21.15.81:6809', 'nonce': 1904727940}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6810', 'nonce': 1904727940}, {'type': 'v1', 'addr': '172.21.15.81:6811', 'nonce': 1904727940}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6814', 'nonce': 1904727940}, {'type': 'v1', 'addr': '172.21.15.81:6815', 'nonce': 1904727940}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6812', 'nonce': 1904727940}, {'type': 'v1', 'addr': '172.21.15.81:6813', 'nonce': 1904727940}]}, 'public_addr': '172.21.15.81:6809/1904727940', 'cluster_addr': '172.21.15.81:6811/1904727940', 'heartbeat_back_addr': '172.21.15.81:6815/1904727940', 'heartbeat_front_addr': '172.21.15.81:6813/1904727940', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': 'a6dba5b9-c833-465e-a8a5-1741528b24c0', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 55, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6817', 'nonce': 738205570}, {'type': 'v1', 'addr': '172.21.15.81:6819', 'nonce': 738205570}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6822', 'nonce': 738205570}, {'type': 'v1', 'addr': '172.21.15.81:6824', 'nonce': 738205570}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6830', 'nonce': 738205570}, {'type': 'v1', 'addr': '172.21.15.81:6831', 'nonce': 738205570}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6826', 'nonce': 738205570}, {'type': 'v1', 'addr': '172.21.15.81:6829', 'nonce': 738205570}]}, 'public_addr': '172.21.15.81:6819/738205570', 'cluster_addr': '172.21.15.81:6824/738205570', 'heartbeat_back_addr': '172.21.15.81:6831/738205570', 'heartbeat_front_addr': '172.21.15.81:6829/738205570', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': '6c45097e-44a2-454f-80a4-0fe879ccd52f', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 58, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6816', 'nonce': 3558674335}, {'type': 'v1', 'addr': '172.21.15.81:6818', 'nonce': 3558674335}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6820', 'nonce': 3558674335}, {'type': 'v1', 'addr': '172.21.15.81:6821', 'nonce': 3558674335}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6827', 'nonce': 3558674335}, {'type': 'v1', 'addr': '172.21.15.81:6828', 'nonce': 3558674335}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6823', 'nonce': 3558674335}, {'type': 'v1', 'addr': '172.21.15.81:6825', 'nonce': 3558674335}]}, 'public_addr': '172.21.15.81:6818/3558674335', 'cluster_addr': '172.21.15.81:6821/3558674335', 'heartbeat_back_addr': '172.21.15.81:6828/3558674335', 'heartbeat_front_addr': '172.21.15.81:6825/3558674335', 'state': ['exists', 'up']}, {'osd': 3, 'uuid': '31952760-06f3-4618-a5c4-f5c4fed3aadb', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 40, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6800', 'nonce': 1886327229}, {'type': 'v1', 'addr': '172.21.15.81:6801', 'nonce': 1886327229}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6802', 'nonce': 1886327229}, {'type': 'v1', 'addr': '172.21.15.81:6803', 'nonce': 1886327229}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6806', 'nonce': 1886327229}, {'type': 'v1', 'addr': '172.21.15.81:6807', 'nonce': 1886327229}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6804', 'nonce': 1886327229}, {'type': 'v1', 'addr': '172.21.15.81:6805', 'nonce': 1886327229}]}, 'public_addr': '172.21.15.81:6801/1886327229', 'cluster_addr': '172.21.15.81:6803/1886327229', 'heartbeat_back_addr': '172.21.15.81:6807/1886327229', 'heartbeat_front_addr': '172.21.15.81:6805/1886327229', 'state': ['exists', 'up']}, {'osd': 4, 'uuid': 'c9bd2751-c836-43dc-b844-e13678cb2fd9', 'up': 1, 'in': 1, 'weight': 0.58685302734375, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 40, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.139:6817', 'nonce': 2184515621}, {'type': 'v1', 'addr': '172.21.15.139:6819', 'nonce': 2184515621}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.139:6820', 'nonce': 2184515621}, {'type': 'v1', 'addr': '172.21.15.139:6822', 'nonce': 2184515621}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.139:6827', 'nonce': 2184515621}, {'type': 'v1', 'addr': '172.21.15.139:6829', 'nonce': 2184515621}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.139:6824', 'nonce': 2184515621}, {'type': 'v1', 'addr': '172.21.15.139:6826', 'nonce': 2184515621}]}, 'public_addr': '172.21.15.139:6819/2184515621', 'cluster_addr': '172.21.15.139:6822/2184515621', 'heartbeat_back_addr': '172.21.15.139:6829/2184515621', 'heartbeat_front_addr': '172.21.15.139:6826/2184515621', 'state': ['exists', 'up']}, {'osd': 5, 'uuid': '2971b93a-6c9f-4b77-b526-4eac788fabf9', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 40, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.139:6816', 'nonce': 3982901834}, {'type': 'v1', 'addr': '172.21.15.139:6818', 'nonce': 3982901834}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.139:6821', 'nonce': 3982901834}, {'type': 'v1', 'addr': '172.21.15.139:6823', 'nonce': 3982901834}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.139:6830', 'nonce': 3982901834}, {'type': 'v1', 'addr': '172.21.15.139:6831', 'nonce': 3982901834}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.139:6825', 'nonce': 3982901834}, {'type': 'v1', 'addr': '172.21.15.139:6828', 'nonce': 3982901834}]}, 'public_addr': '172.21.15.139:6818/3982901834', 'cluster_addr': '172.21.15.139:6823/3982901834', 'heartbeat_back_addr': '172.21.15.139:6831/3982901834', 'heartbeat_front_addr': '172.21.15.139:6828/3982901834', 'state': ['exists', 'up']}, {'osd': 6, 'uuid': 'e1f786ce-579e-48cc-b212-83f881b94184', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 40, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.139:6800', 'nonce': 2283932666}, {'type': 'v1', 'addr': '172.21.15.139:6801', 'nonce': 2283932666}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.139:6802', 'nonce': 2283932666}, {'type': 'v1', 'addr': '172.21.15.139:6803', 'nonce': 2283932666}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.139:6806', 'nonce': 2283932666}, {'type': 'v1', 'addr': '172.21.15.139:6807', 'nonce': 2283932666}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.139:6804', 'nonce': 2283932666}, {'type': 'v1', 'addr': '172.21.15.139:6805', 'nonce': 2283932666}]}, 'public_addr': '172.21.15.139:6801/2283932666', 'cluster_addr': '172.21.15.139:6803/2283932666', 'heartbeat_back_addr': '172.21.15.139:6807/2283932666', 'heartbeat_front_addr': '172.21.15.139:6805/2283932666', 'state': ['exists', 'up']}, {'osd': 7, 'uuid': 'a287ddf6-84eb-4225-b267-25eee1657625', 'up': 1, 'in': 0, 'weight': 0, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 21, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.139:6808', 'nonce': 2348111157}, {'type': 'v1', 'addr': '172.21.15.139:6809', 'nonce': 2348111157}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.139:6810', 'nonce': 2348111157}, {'type': 'v1', 'addr': '172.21.15.139:6811', 'nonce': 2348111157}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.139:6814', 'nonce': 2348111157}, {'type': 'v1', 'addr': '172.21.15.139:6815', 'nonce': 2348111157}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.139:6812', 'nonce': 2348111157}, {'type': 'v1', 'addr': '172.21.15.139:6813', 'nonce': 2348111157}]}, 'public_addr': '172.21.15.139:6809/2348111157', 'cluster_addr': '172.21.15.139:6811/2348111157', 'heartbeat_back_addr': '172.21.15.139:6815/2348111157', 'heartbeat_front_addr': '172.21.15.139:6813/2348111157', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-13T06:39:05.476871+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-13T06:39:05.455183+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-13T06:39:05.504853+0000', 'dead_epoch': 0}, {'osd': 3, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-13T06:39:05.372429+0000', 'dead_epoch': 0}, {'osd': 4, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-13T06:39:05.421023+0000', 'dead_epoch': 0}, {'osd': 5, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-13T06:39:05.477489+0000', 'dead_epoch': 0}, {'osd': 6, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-13T06:39:05.314700+0000', 'dead_epoch': 0}, {'osd': 7, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 65536, 'last_purged_snaps_scrub': '2024-09-13T06:39:05.462229+0000', 'dead_epoch': 0}], 'pg_upmap': [{'pgid': '3.15', 'osds': [3, 7]}], 'pg_upmap_items': [{'pgid': '3.f', 'mappings': [{'from': 4, 'to': 2}]}], 'pg_upmap_primaries': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [{'pool': 3, 'snaps': [{'begin': 26, 'length': 1}, {'begin': 29, 'length': 1}]}], 'new_removed_snaps': [{'pool': 3, 'snaps': [{'begin': 29, 'length': 1}]}], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-09-13T06:40:16.389 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T06:40:16.392 INFO:teuthology.orchestra.run.smithi081.stdout:1648 read 0x9904d7e thru 0x9910b11 (0xbd94 bytes) 2024-09-13T06:40:16.392 INFO:teuthology.orchestra.run.smithi081.stdout:1649 writesame 0xa49cfca thru 0xa49f383 data_size 0x11(0x23ba bytes) 2024-09-13T06:40:16.392 INFO:teuthology.orchestra.run.smithi081.stdout:1650 trunc from 0xb12da78 to 0x5bfdcf8 2024-09-13T06:40:16.392 INFO:teuthology.orchestra.run.smithi081.stdout:1652 writesame 0x6a3613 thru 0x6aca62 data_size 0x18(0x9450 bytes) 2024-09-13T06:40:16.392 INFO:teuthology.orchestra.run.smithi081.stdout:1653 writesame 0x23abd3c thru 0x23b465d data_size 0x3(0x8922 bytes) 2024-09-13T06:40:16.392 INFO:teuthology.orchestra.run.smithi081.stdout:1654 write 0xab4802a thru 0xab540c9 (0xc0a0 bytes) 2024-09-13T06:40:16.393 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:40:16.393 INFO:teuthology.orchestra.run.smithi081.stdout:1657 writesame 0x1f52313 thru 0x1f541d2 data_size 0x30(0x1ec0 bytes) 2024-09-13T06:40:16.393 INFO:teuthology.orchestra.run.smithi081.stdout:1658 writesame 0x5e55c5a thru 0x5e56ae8 data_size 0x1(0xe8f bytes) 2024-09-13T06:40:16.393 INFO:teuthology.orchestra.run.smithi081.stdout:1659 trunc from 0xab540ca to 0x9a5ccd0 2024-09-13T06:40:16.393 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:40:16.393 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:40:16.393 INFO:teuthology.orchestra.run.smithi081.stdout:1664 read 0x573918 thru 0x579fd3 (0x66bc bytes) 2024-09-13T06:40:16.393 INFO:teuthology.orchestra.run.smithi081.stdout:1665 write 0x9a5b465 thru 0x9a5ea95 (0x3631 bytes) 2024-09-13T06:40:16.393 INFO:teuthology.orchestra.run.smithi081.stdout:1666 read 0x8c9a6ae thru 0x8ca5b41 (0xb494 bytes) 2024-09-13T06:40:16.393 INFO:teuthology.orchestra.run.smithi081.stdout:1667 writesame 0xabedc49 thru 0xabf8172 data_size 0x1d(0xa52a bytes) 2024-09-13T06:40:16.393 INFO:teuthology.orchestra.run.smithi081.stdout:1668 read 0x8186b1d thru 0x8189fab (0x348f bytes) 2024-09-13T06:40:16.393 INFO:teuthology.orchestra.run.smithi081.stdout:1669 read 0xada907 thru 0xae459b (0x9c95 bytes) 2024-09-13T06:40:16.393 INFO:teuthology.orchestra.run.smithi081.stdout:1670 write 0x32bf8b2 thru 0x32cb8d7 (0xc026 bytes) 2024-09-13T06:40:16.393 INFO:teuthology.orchestra.run.smithi081.stdout:1671 write 0x9677822 thru 0x967f18e (0x796d bytes) 2024-09-13T06:40:16.394 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:40:16.391+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:40:16.412 INFO:teuthology.orchestra.run.smithi081.stdout:1672 write 0xbb7fa46 thru 0xbb89f39 (0xa4f4 bytes) 2024-09-13T06:40:16.419 INFO:teuthology.orchestra.run.smithi081.stdout:1673 punch from 0x6ac93d6 to 0x6acd864, (0x448e bytes) 2024-09-13T06:40:16.419 INFO:teuthology.orchestra.run.smithi081.stdout:1675 punch from 0x309a60b to 0x309ef3f, (0x4934 bytes) 2024-09-13T06:40:16.419 INFO:teuthology.orchestra.run.smithi081.stdout:1676 punch from 0x6a1e5d7 to 0x6a256ca, (0x70f3 bytes) 2024-09-13T06:40:16.419 INFO:teuthology.orchestra.run.smithi081.stdout:1679 writesame 0x799a22e thru 0x79a7520 data_size 0x3(0xd2f3 bytes) 2024-09-13T06:40:16.432 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-13T06:40:16.435 INFO:teuthology.orchestra.run.smithi081.stdout:1680 read 0x55b5d6f thru 0x55c1972 (0xbc04 bytes) 2024-09-13T06:40:16.435 INFO:teuthology.orchestra.run.smithi081.stdout:1681 read 0x89f55f thru 0x8ad6b3 (0xe155 bytes) 2024-09-13T06:40:16.455 INFO:teuthology.orchestra.run.smithi081.stdout:1682 trunc from 0xbb89f3a to 0x3c940fe 2024-09-13T06:40:16.474 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:40:16.474 INFO:teuthology.orchestra.run.smithi081.stdout:1686 read 0x32935c6 thru 0x3293b14 (0x54f bytes) 2024-09-13T06:40:16.475 INFO:teuthology.orchestra.run.smithi081.stdout:1687 read 0x16f2687 thru 0x16f940a (0x6d84 bytes) 2024-09-13T06:40:16.475 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:40:16.475 INFO:teuthology.orchestra.run.smithi081.stdout:1689 read 0x3abc7 thru 0x45410 (0xa84a bytes) 2024-09-13T06:40:16.475 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:40:16.475 INFO:teuthology.orchestra.run.smithi081.stdout:1691 read 0x2f07da2 thru 0x2f17a53 (0xfcb2 bytes) 2024-09-13T06:40:16.475 INFO:teuthology.orchestra.run.smithi081.stdout:1692 read 0x180ae83 thru 0x1811d8d (0x6f0b bytes) 2024-09-13T06:40:16.493 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:40:16.493+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:40:16.497 INFO:teuthology.orchestra.run.smithi081.stdout:1693 write 0x93b4991 thru 0x93c318e (0xe7fe bytes) 2024-09-13T06:40:16.504 INFO:teuthology.orchestra.run.smithi081.stdout:1695 writesame 0x1b46b07 thru 0x1b492f0 data_size 0x27(0x27ea bytes) 2024-09-13T06:40:16.509 INFO:teuthology.orchestra.run.smithi081.stdout:1697 read 0x8cb24eb thru 0x8cbd95e (0xb474 bytes) 2024-09-13T06:40:16.509 INFO:teuthology.orchestra.run.smithi081.stdout:1698 punch from 0x87db69b to 0x87dfa46, (0x43ab bytes) 2024-09-13T06:40:16.509 INFO:teuthology.orchestra.run.smithi081.stdout:1699 read 0x349cca7 thru 0x349d874 (0xbce bytes) 2024-09-13T06:40:16.509 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:40:16.509 INFO:teuthology.orchestra.run.smithi081.stdout:1701 writesame 0x37b3577 thru 0x37c1eb2 data_size 0x76(0xe93c bytes) 2024-09-13T06:40:16.528 INFO:teuthology.orchestra.run.smithi081.stdout:1702 writesame 0xaf1e5bb thru 0xaf2304a data_size 0x8(0x4a90 bytes) 2024-09-13T06:40:16.532 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:40:16.532 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [], 2024-09-13T06:40:16.532 INFO:teuthology.orchestra.run.smithi139.stdout: "num_ops": 0 2024-09-13T06:40:16.532 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:40:16.546 INFO:teuthology.orchestra.run.smithi081.stdout:1705 write 0xeb0fa63 thru 0xeb134bc (0x3a5a bytes) 2024-09-13T06:40:16.547 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-13T06:40:16.550 INFO:teuthology.orchestra.run.smithi081.stdout:1706 writesame 0x54405d4 thru 0x544dbd0 data_size 0x1(0xd5fd bytes) 2024-09-13T06:40:16.581 INFO:teuthology.orchestra.run.smithi081.stdout:1707 read 0xd96ff0 thru 0xda1776 (0xa787 bytes) 2024-09-13T06:40:16.582 INFO:teuthology.orchestra.run.smithi081.stdout:1708 write 0x7098395 thru 0x709b456 (0x30c2 bytes) 2024-09-13T06:40:16.586 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:40:16.589 INFO:teuthology.orchestra.run.smithi081.stdout:1710 trunc from 0xeb134bd to 0xc483893 2024-09-13T06:40:16.593 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:40:16.595+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:40:16.603 INFO:teuthology.orchestra.run.smithi081.stdout:1712 write 0xa8e23ac thru 0xa8eef9b (0xcbf0 bytes) 2024-09-13T06:40:16.607 INFO:teuthology.orchestra.run.smithi081.stdout:1713 punch from 0x56feb20 to 0x570e54e, (0xfa2e bytes) 2024-09-13T06:40:16.607 INFO:teuthology.orchestra.run.smithi081.stdout:1714 write 0x1acce42 thru 0x1acd7ed (0x9ac bytes) 2024-09-13T06:40:16.622 INFO:teuthology.orchestra.run.smithi081.stdout:1715 write 0xe22eb0f thru 0xe2329f6 (0x3ee8 bytes) 2024-09-13T06:40:16.626 INFO:teuthology.orchestra.run.smithi081.stdout:1716 write 0x1a215ca thru 0x1a22b81 (0x15b8 bytes) 2024-09-13T06:40:16.629 INFO:teuthology.orchestra.run.smithi081.stdout:1717 write 0x1c28e57 thru 0x1c31d27 (0x8ed1 bytes) 2024-09-13T06:40:16.633 INFO:teuthology.orchestra.run.smithi081.stdout:1718 read 0x6fa6704 thru 0x6fa79a3 (0x12a0 bytes) 2024-09-13T06:40:16.633 INFO:teuthology.orchestra.run.smithi081.stdout:1720 read 0x33f5c85 thru 0x33fdcc4 (0x8040 bytes) 2024-09-13T06:40:16.633 INFO:teuthology.orchestra.run.smithi081.stdout:1722 write 0x7218f00 thru 0x722582b (0xc92c bytes) 2024-09-13T06:40:16.637 INFO:teuthology.orchestra.run.smithi081.stdout:1724 read 0x529f7ab thru 0x52a35b2 (0x3e08 bytes) 2024-09-13T06:40:16.637 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:40:16.637 INFO:teuthology.orchestra.run.smithi081.stdout:1726 read 0x8b08218 thru 0x8b0bb45 (0x392e bytes) 2024-09-13T06:40:16.637 INFO:teuthology.orchestra.run.smithi081.stdout:1727 writesame 0x3b6e4af thru 0x3b7ab44 data_size 0x4a(0xc696 bytes) 2024-09-13T06:40:16.641 INFO:teuthology.orchestra.run.smithi081.stdout:1728 write 0x5c9122c thru 0x5c9ddc6 (0xcb9b bytes) 2024-09-13T06:40:16.658 INFO:teuthology.orchestra.run.smithi081.stdout:1729 trunc from 0xe2329f7 to 0x69d2a12 2024-09-13T06:40:16.677 INFO:teuthology.orchestra.run.smithi081.stdout:1731 read 0x69540bc thru 0x695e952 (0xa897 bytes) 2024-09-13T06:40:16.683 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:40:16.684 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [], 2024-09-13T06:40:16.684 INFO:teuthology.orchestra.run.smithi139.stdout: "complaint_time": 30, 2024-09-13T06:40:16.684 INFO:teuthology.orchestra.run.smithi139.stdout: "num_blocked_ops": 0 2024-09-13T06:40:16.684 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:40:16.694 INFO:tasks.ceph.osd.6.smithi139.stderr:2024-09-13T06:40:16.695+0000 7fcd02c5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26385) UID: 0 2024-09-13T06:40:16.697 INFO:teuthology.orchestra.run.smithi081.stdout:1732 write 0xcfe21c1 thru 0xcfeb501 (0x9341 bytes) 2024-09-13T06:40:16.699 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-13T06:40:16.701 INFO:teuthology.orchestra.run.smithi081.stdout:1733 write 0x9af030d thru 0x9af2483 (0x2177 bytes) 2024-09-13T06:40:16.705 INFO:teuthology.orchestra.run.smithi081.stdout:1735 read 0x7bfb33d thru 0x7c03501 (0x81c5 bytes) 2024-09-13T06:40:16.705 INFO:teuthology.orchestra.run.smithi081.stdout:1736 writesame 0x965727b thru 0x9666741 data_size 0x1(0xf4c7 bytes) 2024-09-13T06:40:16.743 INFO:teuthology.orchestra.run.smithi081.stdout:1737 punch from 0x968df30 to 0x96946f8, (0x67c8 bytes) 2024-09-13T06:40:16.743 INFO:teuthology.orchestra.run.smithi081.stdout:1738 punch from 0x22276ca to 0x22309e9, (0x931f bytes) 2024-09-13T06:40:16.757 INFO:teuthology.orchestra.run.smithi081.stdout:1739 writesame 0xd9789da thru 0xd98887c data_size 0x3(0xfea3 bytes) 2024-09-13T06:40:16.757 INFO:teuthology.orchestra.run.smithi081.stdout:1740 read 0x8c5369f thru 0x8c5bccf (0x8631 bytes) 2024-09-13T06:40:16.757 INFO:teuthology.orchestra.run.smithi081.stdout:1741 read 0xcfd4240 thru 0xcfdfec8 (0xbc89 bytes) 2024-09-13T06:40:16.757 INFO:teuthology.orchestra.run.smithi081.stdout:1742 read 0x181cdd1 thru 0x1821cff (0x4f2f bytes) 2024-09-13T06:40:16.757 INFO:teuthology.orchestra.run.smithi081.stdout:1743 read 0x87736e2 thru 0x87835b7 (0xfed6 bytes) 2024-09-13T06:40:16.758 INFO:teuthology.orchestra.run.smithi081.stdout:1744 read 0x5580b01 thru 0x5583fa1 (0x34a1 bytes) 2024-09-13T06:40:16.758 INFO:teuthology.orchestra.run.smithi081.stdout:1745 writesame 0x63b8b5a thru 0x63b91a2 data_size 0x1(0x649 bytes) 2024-09-13T06:40:16.763 INFO:teuthology.orchestra.run.smithi081.stdout:1746 write 0xcac18e thru 0xcb6c83 (0xaaf6 bytes) 2024-09-13T06:40:16.768 INFO:teuthology.orchestra.run.smithi081.stdout:1747 write 0x2ecc9fa thru 0x2ed8f02 (0xc509 bytes) 2024-09-13T06:40:16.773 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:40:16.773 INFO:teuthology.orchestra.run.smithi081.stdout:1750 punch from 0x3e19c99 to 0x3e25635, (0xb99c bytes) 2024-09-13T06:40:16.773 INFO:teuthology.orchestra.run.smithi081.stdout:1751 read 0x561c919 thru 0x561ed17 (0x23ff bytes) 2024-09-13T06:40:16.773 INFO:teuthology.orchestra.run.smithi081.stdout:1752 write 0xba91ee thru 0xbb7979 (0xe78c bytes) 2024-09-13T06:40:16.777 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T06:40:16.778 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-09-13T06:40:16.793 INFO:teuthology.orchestra.run.smithi081.stdout:1753 trunc from 0xd98887d to 0x4fa779d 2024-09-13T06:40:16.795 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:40:16.795+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:40:16.808 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":90,"stamp":"2024-09-13T06:40:16.355780+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":225044184,"num_objects":258,"num_object_clones":0,"num_object_copies":516,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":258,"num_whiteouts":0,"num_read":44714,"num_read_kb":205953,"num_write":6692,"num_write_kb":178103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":142,"num_bytes_recovered":9950668,"num_keys_recovered":10,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4627,"ondisk_log_size":4627,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":7,"num_per_pool_osds":7,"num_per_pool_omap_osds":7,"kb":660602880,"kb_used":373480,"kb_used_data":136740,"kb_used_omap":10,"kb_used_meta":234101,"kb_avail":660229400,"statfs":{"total":676457349120,"available":676074905600,"internally_reserved":0,"allocated":140021760,"data_stored":136485978,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11155,"internal_metadata":239719533},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,1],"upper_bound":4},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-100520539,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2819,"num_read_kb":9215,"num_write":808,"num_write_kb":10610,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.814006"},"pg_stats":[{"pgid":"3.1f","version":"62'188","reported_seq":891,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-13T06:40:14.480460+0000","last_change":"2024-09-13T06:40:08.387694+0000","last_active":"2024-09-13T06:40:14.480460+0000","last_peered":"2024-09-13T06:40:14.480460+0000","last_clean":"2024-09-13T06:40:14.480460+0000","last_became_active":"2024-09-13T06:39:27.354227+0000","last_became_peered":"2024-09-13T06:39:27.354227+0000","last_unstale":"2024-09-13T06:40:14.480460+0000","last_undegraded":"2024-09-13T06:40:14.480460+0000","last_fullsized":"2024-09-13T06:40:14.480460+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":188,"log_dups_size":0,"ondisk_log_size":188,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:53:28.624134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001430752,"stat_sum":{"num_bytes":7757350,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":1211,"num_read_kb":4931,"num_write":284,"num_write_kb":7806,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"1a","length":"1"}]},{"pgid":"3.1e","version":"62'155","reported_seq":677,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-13T06:40:14.411695+0000","last_change":"2024-09-13T06:40:08.371401+0000","last_active":"2024-09-13T06:40:14.411695+0000","last_peered":"2024-09-13T06:40:14.411695+0000","last_clean":"2024-09-13T06:40:14.411695+0000","last_became_active":"2024-09-13T06:39:27.359006+0000","last_became_peered":"2024-09-13T06:39:27.359006+0000","last_unstale":"2024-09-13T06:40:14.411695+0000","last_undegraded":"2024-09-13T06:40:14.411695+0000","last_fullsized":"2024-09-13T06:40:14.411695+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":155,"log_dups_size":0,"ondisk_log_size":155,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:02:45.825350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0022466729999999998,"stat_sum":{"num_bytes":2901162,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":920,"num_read_kb":3652,"num_write":277,"num_write_kb":3600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"1a","length":"1"}]},{"pgid":"3.1d","version":"60'105","reported_seq":674,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-13T06:40:14.483597+0000","last_change":"2024-09-13T06:40:08.485660+0000","last_active":"2024-09-13T06:40:14.483597+0000","last_peered":"2024-09-13T06:40:14.483597+0000","last_clean":"2024-09-13T06:40:14.483597+0000","last_became_active":"2024-09-13T06:39:27.369952+0000","last_became_peered":"2024-09-13T06:39:27.369952+0000","last_unstale":"2024-09-13T06:40:14.483597+0000","last_undegraded":"2024-09-13T06:40:14.483597+0000","last_fullsized":"2024-09-13T06:40:14.483597+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:37:26.971480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020298299999999998,"stat_sum":{"num_bytes":5024691,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":582,"num_read_kb":3752,"num_write":168,"num_write_kb":6493,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"1a","length":"1"}]},{"pgid":"3.1c","version":"62'114","reported_seq":606,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-13T06:40:14.531312+0000","last_change":"2024-09-13T06:40:08.484369+0000","last_active":"2024-09-13T06:40:14.531312+0000","last_peered":"2024-09-13T06:40:14.531312+0000","last_clean":"2024-09-13T06:40:14.531312+0000","last_became_active":"2024-09-13T06:39:27.369506+0000","last_became_peered":"2024-09-13T06:39:27.369506+0000","last_unstale":"2024-09-13T06:40:14.531312+0000","last_undegraded":"2024-09-13T06:40:14.531312+0000","last_fullsized":"2024-09-13T06:40:14.531312+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":114,"log_dups_size":0,"ondisk_log_size":114,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:22:58.980421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001172696,"stat_sum":{"num_bytes":3870720,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":570,"num_read_kb":6528,"num_write":126,"num_write_kb":4972,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"1a","length":"1"}]},{"pgid":"3.1b","version":"62'88","reported_seq":767,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-13T06:40:14.529498+0000","last_change":"2024-09-13T06:40:08.387076+0000","last_active":"2024-09-13T06:40:14.529498+0000","last_peered":"2024-09-13T06:40:14.529498+0000","last_clean":"2024-09-13T06:40:14.529498+0000","last_became_active":"2024-09-13T06:39:27.371776+0000","last_became_peered":"2024-09-13T06:39:27.371776+0000","last_unstale":"2024-09-13T06:40:14.529498+0000","last_undegraded":"2024-09-13T06:40:14.529498+0000","last_fullsized":"2024-09-13T06:40:14.529498+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:25:31.311656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001094706,"stat_sum":{"num_bytes":12646120,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":619,"num_read_kb":9857,"num_write":120,"num_write_kb":8636,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"1a","length":"1"}]},{"pgid":"3.1a","version":"62'86","reported_seq":652,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-13T06:40:14.508634+0000","last_change":"2024-09-13T06:40:08.377914+0000","last_active":"2024-09-13T06:40:14.508634+0000","last_peered":"2024-09-13T06:40:14.508634+0000","last_clean":"2024-09-13T06:40:14.508634+0000","last_became_active":"2024-09-13T06:39:27.369118+0000","last_became_peered":"2024-09-13T06:39:27.369118+0000","last_unstale":"2024-09-13T06:40:14.508634+0000","last_undegraded":"2024-09-13T06:40:14.508634+0000","last_fullsized":"2024-09-13T06:40:14.508634+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:26:10.974045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020397919999999999,"stat_sum":{"num_bytes":3661654,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":479,"num_read_kb":2865,"num_write":163,"num_write_kb":6844,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"1a","length":"1"}]},{"pgid":"3.19","version":"60'80","reported_seq":2567,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-13T06:40:13.459403+0000","last_change":"2024-09-13T06:40:08.375845+0000","last_active":"2024-09-13T06:40:13.459403+0000","last_peered":"2024-09-13T06:40:13.459403+0000","last_clean":"2024-09-13T06:40:13.459403+0000","last_became_active":"2024-09-13T06:39:27.355617+0000","last_became_peered":"2024-09-13T06:39:27.355617+0000","last_unstale":"2024-09-13T06:40:13.459403+0000","last_undegraded":"2024-09-13T06:40:13.459403+0000","last_fullsized":"2024-09-13T06:40:13.459403+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:54:49.311122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00056955999999999999,"stat_sum":{"num_bytes":10658312,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2398,"num_read_kb":11941,"num_write":77,"num_write_kb":4931,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"1a","length":"1"}]},{"pgid":"3.18","version":"62'84","reported_seq":823,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-13T06:40:14.411115+0000","last_change":"2024-09-13T06:40:08.368589+0000","last_active":"2024-09-13T06:40:14.411115+0000","last_peered":"2024-09-13T06:40:14.411115+0000","last_clean":"2024-09-13T06:40:14.411115+0000","last_became_active":"2024-09-13T06:39:27.349904+0000","last_became_peered":"2024-09-13T06:39:27.349904+0000","last_unstale":"2024-09-13T06:40:14.411115+0000","last_undegraded":"2024-09-13T06:40:14.411115+0000","last_fullsized":"2024-09-13T06:40:14.411115+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:27:19.676090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001529634,"stat_sum":{"num_bytes":5840327,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":652,"num_read_kb":9043,"num_write":99,"num_write_kb":7734,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"1a","length":"1"}]},{"pgid":"3.17","version":"62'462","reported_seq":1458,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-13T06:40:14.436949+0000","last_change":"2024-09-13T06:40:08.388000+0000","last_active":"2024-09-13T06:40:14.436949+0000","last_peered":"2024-09-13T06:40:14.436949+0000","last_clean":"2024-09-13T06:40:14.436949+0000","last_became_active":"2024-09-13T06:39:27.353665+0000","last_became_peered":"2024-09-13T06:39:27.353665+0000","last_unstale":"2024-09-13T06:40:14.436949+0000","last_undegraded":"2024-09-13T06:40:14.436949+0000","last_fullsized":"2024-09-13T06:40:14.436949+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":462,"log_dups_size":0,"ondisk_log_size":462,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:12:31.128336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0016858439999999999,"stat_sum":{"num_bytes":7867844,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":3370,"num_read_kb":10512,"num_write":691,"num_write_kb":8884,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"1a","length":"1"}]},{"pgid":"3.16","version":"60'59","reported_seq":527,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-13T06:40:13.412388+0000","last_change":"2024-09-13T06:40:08.485159+0000","last_active":"2024-09-13T06:40:13.412388+0000","last_peered":"2024-09-13T06:40:13.412388+0000","last_clean":"2024-09-13T06:40:13.412388+0000","last_became_active":"2024-09-13T06:39:49.554072+0000","last_became_peered":"2024-09-13T06:39:49.554072+0000","last_unstale":"2024-09-13T06:40:13.412388+0000","last_undegraded":"2024-09-13T06:40:13.412388+0000","last_fullsized":"2024-09-13T06:40:13.412388+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:54:49.165449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001568669,"stat_sum":{"num_bytes":4913843,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":359,"num_read_kb":2340,"num_write":76,"num_write_kb":2038,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":28582,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"1a","length":"1"}]},{"pgid":"3.15","version":"62'62","reported_seq":518,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-13T06:40:14.411568+0000","last_change":"2024-09-13T06:40:08.376866+0000","last_active":"2024-09-13T06:40:14.411568+0000","last_peered":"2024-09-13T06:40:14.411568+0000","last_clean":"2024-09-13T06:40:14.411568+0000","last_became_active":"2024-09-13T06:39:49.547342+0000","last_became_peered":"2024-09-13T06:39:49.547342+0000","last_unstale":"2024-09-13T06:40:14.411568+0000","last_undegraded":"2024-09-13T06:40:14.411568+0000","last_fullsized":"2024-09-13T06:40:14.411568+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:17:18.985415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0069623740000000003,"stat_sum":{"num_bytes":3696074,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":346,"num_read_kb":2778,"num_write":79,"num_write_kb":3613,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":93834,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"1a","length":"1"}]},{"pgid":"3.14","version":"60'135","reported_seq":602,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-13T06:40:13.420651+0000","last_change":"2024-09-13T06:40:08.378124+0000","last_active":"2024-09-13T06:40:13.420651+0000","last_peered":"2024-09-13T06:40:13.420651+0000","last_clean":"2024-09-13T06:40:13.420651+0000","last_became_active":"2024-09-13T06:39:49.558152+0000","last_became_peered":"2024-09-13T06:39:49.558152+0000","last_unstale":"2024-09-13T06:40:13.420651+0000","last_undegraded":"2024-09-13T06:40:13.420651+0000","last_fullsized":"2024-09-13T06:40:13.420651+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:37:26.076203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014988969999999999,"stat_sum":{"num_bytes":7151128,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":635,"num_read_kb":4250,"num_write":206,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":40017,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"1a","length":"1"}]},{"pgid":"2.7","version":"0'0","reported_seq":66,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-13T06:40:13.416183+0000","last_change":"2024-09-13T06:39:49.550592+0000","last_active":"2024-09-13T06:40:13.416183+0000","last_peered":"2024-09-13T06:40:13.416183+0000","last_clean":"2024-09-13T06:40:13.416183+0000","last_became_active":"2024-09-13T06:39:49.549876+0000","last_became_peered":"2024-09-13T06:39:49.549876+0000","last_unstale":"2024-09-13T06:40:13.416183+0000","last_undegraded":"2024-09-13T06:40:13.416183+0000","last_fullsized":"2024-09-13T06:40:13.416183+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_clean_scrub_stamp":"2024-09-13T06:39:16.508974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:32:09.235292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00080324699999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"62'107","reported_seq":489,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-13T06:40:14.436709+0000","last_change":"2024-09-13T06:40:08.386939+0000","last_active":"2024-09-13T06:40:14.436709+0000","last_peered":"2024-09-13T06:40:14.436709+0000","last_clean":"2024-09-13T06:40:14.436709+0000","last_became_active":"2024-09-13T06:39:27.352170+0000","last_became_peered":"2024-09-13T06:39:27.352170+0000","last_unstale":"2024-09-13T06:40:14.436709+0000","last_undegraded":"2024-09-13T06:40:14.436709+0000","last_fullsized":"2024-09-13T06:40:14.436709+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:54:20.547109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00081007200000000001,"stat_sum":{"num_bytes":2349664,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":405,"num_read_kb":1577,"num_write":157,"num_write_kb":3997,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"1a","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":58,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-13T06:40:13.459635+0000","last_change":"2024-09-13T06:39:19.567201+0000","last_active":"2024-09-13T06:40:13.459635+0000","last_peered":"2024-09-13T06:40:13.459635+0000","last_clean":"2024-09-13T06:40:13.459635+0000","last_became_active":"2024-09-13T06:39:17.535411+0000","last_became_peered":"2024-09-13T06:39:17.535411+0000","last_unstale":"2024-09-13T06:40:13.459635+0000","last_undegraded":"2024-09-13T06:40:13.459635+0000","last_fullsized":"2024-09-13T06:40:13.459635+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_clean_scrub_stamp":"2024-09-13T06:39:16.508974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:44:11.617809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00097079800000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"60'51","reported_seq":366,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-13T06:40:13.408902+0000","last_change":"2024-09-13T06:40:08.373420+0000","last_active":"2024-09-13T06:40:13.408902+0000","last_peered":"2024-09-13T06:40:13.408902+0000","last_clean":"2024-09-13T06:40:13.408902+0000","last_became_active":"2024-09-13T06:39:49.545259+0000","last_became_peered":"2024-09-13T06:39:49.545259+0000","last_unstale":"2024-09-13T06:40:13.408902+0000","last_undegraded":"2024-09-13T06:40:13.408902+0000","last_fullsized":"2024-09-13T06:40:13.408902+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:15:53.967278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0038464699999999998,"stat_sum":{"num_bytes":2519040,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":204,"num_read_kb":4185,"num_write":51,"num_write_kb":2617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":51379,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"1a","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":32,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-13T06:40:13.410043+0000","last_change":"2024-09-13T06:39:49.549780+0000","last_active":"2024-09-13T06:40:13.410043+0000","last_peered":"2024-09-13T06:40:13.410043+0000","last_clean":"2024-09-13T06:40:13.410043+0000","last_became_active":"2024-09-13T06:39:49.548606+0000","last_became_peered":"2024-09-13T06:39:49.548606+0000","last_unstale":"2024-09-13T06:40:13.410043+0000","last_undegraded":"2024-09-13T06:40:13.410043+0000","last_fullsized":"2024-09-13T06:40:13.410043+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_clean_scrub_stamp":"2024-09-13T06:39:16.508974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:25:22.354501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"62'126","reported_seq":645,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-13T06:40:14.426624+0000","last_change":"2024-09-13T06:40:08.375865+0000","last_active":"2024-09-13T06:40:14.426624+0000","last_peered":"2024-09-13T06:40:14.426624+0000","last_clean":"2024-09-13T06:40:14.426624+0000","last_became_active":"2024-09-13T06:39:27.452904+0000","last_became_peered":"2024-09-13T06:39:27.452904+0000","last_unstale":"2024-09-13T06:40:14.426624+0000","last_undegraded":"2024-09-13T06:40:14.426624+0000","last_fullsized":"2024-09-13T06:40:14.426624+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":126,"log_dups_size":0,"ondisk_log_size":126,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:44:12.553212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00088535700000000003,"stat_sum":{"num_bytes":6292713,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":825,"num_read_kb":5718,"num_write":131,"num_write_kb":7644,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"1a","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":58,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-13T06:40:13.459506+0000","last_change":"2024-09-13T06:39:19.567043+0000","last_active":"2024-09-13T06:40:13.459506+0000","last_peered":"2024-09-13T06:40:13.459506+0000","last_clean":"2024-09-13T06:40:13.459506+0000","last_became_active":"2024-09-13T06:39:17.721287+0000","last_became_peered":"2024-09-13T06:39:17.721287+0000","last_unstale":"2024-09-13T06:40:13.459506+0000","last_undegraded":"2024-09-13T06:40:13.459506+0000","last_fullsized":"2024-09-13T06:40:13.459506+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_clean_scrub_stamp":"2024-09-13T06:39:16.508974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:14:34.131074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000890396,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"60'74","reported_seq":363,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-13T06:40:13.412743+0000","last_change":"2024-09-13T06:40:08.486087+0000","last_active":"2024-09-13T06:40:13.412743+0000","last_peered":"2024-09-13T06:40:13.412743+0000","last_clean":"2024-09-13T06:40:13.412743+0000","last_became_active":"2024-09-13T06:39:27.359760+0000","last_became_peered":"2024-09-13T06:39:27.359760+0000","last_unstale":"2024-09-13T06:40:13.412743+0000","last_undegraded":"2024-09-13T06:40:13.412743+0000","last_fullsized":"2024-09-13T06:40:13.412743+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:57:54.852468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0024097820000000001,"stat_sum":{"num_bytes":1740460,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":212,"num_read_kb":1608,"num_write":104,"num_write_kb":3310,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"1a","length":"1"}]},{"pgid":"3.3","version":"48'149","reported_seq":3535,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-13T06:40:13.420657+0000","last_change":"2024-09-13T06:40:08.377491+0000","last_active":"2024-09-13T06:40:13.420657+0000","last_peered":"2024-09-13T06:40:13.420657+0000","last_clean":"2024-09-13T06:40:13.420657+0000","last_became_active":"2024-09-13T06:39:27.372337+0000","last_became_peered":"2024-09-13T06:39:27.372337+0000","last_unstale":"2024-09-13T06:40:13.420657+0000","last_undegraded":"2024-09-13T06:40:13.420657+0000","last_fullsized":"2024-09-13T06:40:13.420657+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":149,"log_dups_size":0,"ondisk_log_size":149,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:17:49.242059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001311623,"stat_sum":{"num_bytes":13029717,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":3799,"num_read_kb":13934,"num_write":245,"num_write_kb":2279,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"1a","length":"1"}]},{"pgid":"2.2","version":"20'2","reported_seq":60,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-13T06:40:13.412124+0000","last_change":"2024-09-13T06:39:19.564386+0000","last_active":"2024-09-13T06:40:13.412124+0000","last_peered":"2024-09-13T06:40:13.412124+0000","last_clean":"2024-09-13T06:40:13.412124+0000","last_became_active":"2024-09-13T06:39:17.533677+0000","last_became_peered":"2024-09-13T06:39:17.533677+0000","last_unstale":"2024-09-13T06:40:13.412124+0000","last_undegraded":"2024-09-13T06:40:13.412124+0000","last_fullsized":"2024-09-13T06:40:13.412124+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_clean_scrub_stamp":"2024-09-13T06:39:16.508974+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:53:22.714840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001813556,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"62'253","reported_seq":4004,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-13T06:40:14.532529+0000","last_change":"2024-09-13T06:40:08.376352+0000","last_active":"2024-09-13T06:40:14.532529+0000","last_peered":"2024-09-13T06:40:14.532529+0000","last_clean":"2024-09-13T06:40:14.532529+0000","last_became_active":"2024-09-13T06:39:27.453029+0000","last_became_peered":"2024-09-13T06:39:27.453029+0000","last_unstale":"2024-09-13T06:40:14.532529+0000","last_undegraded":"2024-09-13T06:40:14.532529+0000","last_fullsized":"2024-09-13T06:40:14.532529+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":253,"log_dups_size":0,"ondisk_log_size":253,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:30:11.714805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00064858899999999998,"stat_sum":{"num_bytes":15429307,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":4529,"num_read_kb":15883,"num_write":399,"num_write_kb":5894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"1a","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":58,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-13T06:40:13.455362+0000","last_change":"2024-09-13T06:39:20.303314+0000","last_active":"2024-09-13T06:40:13.455362+0000","last_peered":"2024-09-13T06:40:13.455362+0000","last_clean":"2024-09-13T06:40:13.455362+0000","last_became_active":"2024-09-13T06:39:17.536394+0000","last_became_peered":"2024-09-13T06:39:17.536394+0000","last_unstale":"2024-09-13T06:40:13.455362+0000","last_undegraded":"2024-09-13T06:40:13.455362+0000","last_fullsized":"2024-09-13T06:40:13.455362+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_clean_scrub_stamp":"2024-09-13T06:39:16.508974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:24:30.600904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00033592499999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"61'278","reported_seq":761,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-13T06:40:13.447866+0000","last_change":"2024-09-13T06:40:08.387616+0000","last_active":"2024-09-13T06:40:13.447866+0000","last_peered":"2024-09-13T06:40:13.447866+0000","last_clean":"2024-09-13T06:40:13.447866+0000","last_became_active":"2024-09-13T06:40:06.371121+0000","last_became_peered":"2024-09-13T06:40:06.371121+0000","last_unstale":"2024-09-13T06:40:13.447866+0000","last_undegraded":"2024-09-13T06:40:13.447866+0000","last_fullsized":"2024-09-13T06:40:13.447866+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":278,"log_dups_size":0,"ondisk_log_size":278,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:21:42.915268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015203009999999999,"stat_sum":{"num_bytes":2355843,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1417,"num_read_kb":2945,"num_write":427,"num_write_kb":3347,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20,"num_bytes_recovered":90796,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"1a","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":32,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-13T06:40:13.459646+0000","last_change":"2024-09-13T06:39:49.553283+0000","last_active":"2024-09-13T06:40:13.459646+0000","last_peered":"2024-09-13T06:40:13.459646+0000","last_clean":"2024-09-13T06:40:13.459646+0000","last_became_active":"2024-09-13T06:39:49.552737+0000","last_became_peered":"2024-09-13T06:39:49.552737+0000","last_unstale":"2024-09-13T06:40:13.459646+0000","last_undegraded":"2024-09-13T06:40:13.459646+0000","last_fullsized":"2024-09-13T06:40:13.459646+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_clean_scrub_stamp":"2024-09-13T06:39:16.508974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:46:26.354966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"59'60","reported_seq":612,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-13T06:40:13.409266+0000","last_change":"2024-09-13T06:40:08.367957+0000","last_active":"2024-09-13T06:40:13.409266+0000","last_peered":"2024-09-13T06:40:13.409266+0000","last_clean":"2024-09-13T06:40:13.409266+0000","last_became_active":"2024-09-13T06:39:27.353845+0000","last_became_peered":"2024-09-13T06:39:27.353845+0000","last_unstale":"2024-09-13T06:40:13.409266+0000","last_undegraded":"2024-09-13T06:40:13.409266+0000","last_fullsized":"2024-09-13T06:40:13.409266+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:18:56.689713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00098161800000000007,"stat_sum":{"num_bytes":4798777,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":469,"num_read_kb":1567,"num_write":60,"num_write_kb":2651,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"1a","length":"1"}]},{"pgid":"2.3","version":"18'1","reported_seq":59,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-13T06:40:13.412195+0000","last_change":"2024-09-13T06:39:19.563307+0000","last_active":"2024-09-13T06:40:13.412195+0000","last_peered":"2024-09-13T06:40:13.412195+0000","last_clean":"2024-09-13T06:40:13.412195+0000","last_became_active":"2024-09-13T06:39:17.536003+0000","last_became_peered":"2024-09-13T06:39:17.536003+0000","last_unstale":"2024-09-13T06:40:13.412195+0000","last_undegraded":"2024-09-13T06:40:13.412195+0000","last_fullsized":"2024-09-13T06:40:13.412195+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_clean_scrub_stamp":"2024-09-13T06:39:16.508974+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:12:22.307020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000698802,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":202,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-13T06:40:13.410563+0000","last_change":"2024-09-13T06:39:52.360565+0000","last_active":"2024-09-13T06:40:13.410563+0000","last_peered":"2024-09-13T06:40:13.410563+0000","last_clean":"2024-09-13T06:40:13.410563+0000","last_became_active":"2024-09-13T06:39:52.359870+0000","last_became_peered":"2024-09-13T06:39:52.359870+0000","last_unstale":"2024-09-13T06:40:13.410563+0000","last_undegraded":"2024-09-13T06:40:13.410563+0000","last_fullsized":"2024-09-13T06:40:13.410563+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:10.110558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:10.110558+0000","last_clean_scrub_stamp":"2024-09-13T06:39:10.110558+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:48:49.952971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"60'84","reported_seq":2938,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-13T06:40:13.408663+0000","last_change":"2024-09-13T06:40:08.368731+0000","last_active":"2024-09-13T06:40:13.408663+0000","last_peered":"2024-09-13T06:40:13.408663+0000","last_clean":"2024-09-13T06:40:13.408663+0000","last_became_active":"2024-09-13T06:39:27.353023+0000","last_became_peered":"2024-09-13T06:39:27.353023+0000","last_unstale":"2024-09-13T06:40:13.408663+0000","last_undegraded":"2024-09-13T06:40:13.408663+0000","last_fullsized":"2024-09-13T06:40:13.408663+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:51:53.573072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012957190000000001,"stat_sum":{"num_bytes":12316688,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":2771,"num_read_kb":12748,"num_write":85,"num_write_kb":6178,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"1a","length":"1"}]},{"pgid":"3.9","version":"60'162","reported_seq":5217,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-13T06:40:14.479406+0000","last_change":"2024-09-13T06:40:09.379298+0000","last_active":"2024-09-13T06:40:14.479406+0000","last_peered":"2024-09-13T06:40:14.479406+0000","last_clean":"2024-09-13T06:40:14.479406+0000","last_became_active":"2024-09-13T06:40:09.377643+0000","last_became_peered":"2024-09-13T06:40:09.377643+0000","last_unstale":"2024-09-13T06:40:14.479406+0000","last_undegraded":"2024-09-13T06:40:14.479406+0000","last_fullsized":"2024-09-13T06:40:14.479406+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":162,"log_dups_size":0,"ondisk_log_size":162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:56:03.841425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001017953,"stat_sum":{"num_bytes":23179411,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":5155,"num_read_kb":23165,"num_write":215,"num_write_kb":11063,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":5031340,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"1a","length":"1"}]},{"pgid":"3.a","version":"61'260","reported_seq":1393,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-13T06:40:14.465933+0000","last_change":"2024-09-13T06:40:08.380986+0000","last_active":"2024-09-13T06:40:14.465933+0000","last_peered":"2024-09-13T06:40:14.465933+0000","last_clean":"2024-09-13T06:40:14.465933+0000","last_became_active":"2024-09-13T06:39:27.374384+0000","last_became_peered":"2024-09-13T06:39:27.374384+0000","last_unstale":"2024-09-13T06:40:14.465933+0000","last_undegraded":"2024-09-13T06:40:14.465933+0000","last_fullsized":"2024-09-13T06:40:14.465933+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":260,"log_dups_size":0,"ondisk_log_size":260,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:21:45.720790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0024102749999999999,"stat_sum":{"num_bytes":3383296,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2557,"num_read_kb":5586,"num_write":271,"num_write_kb":4737,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"1a","length":"1"}]},{"pgid":"3.b","version":"60'373","reported_seq":681,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-13T06:40:13.409611+0000","last_change":"2024-09-13T06:40:08.367925+0000","last_active":"2024-09-13T06:40:13.409611+0000","last_peered":"2024-09-13T06:40:13.409611+0000","last_clean":"2024-09-13T06:40:13.409611+0000","last_became_active":"2024-09-13T06:39:27.352565+0000","last_became_peered":"2024-09-13T06:39:27.352565+0000","last_unstale":"2024-09-13T06:40:13.409611+0000","last_undegraded":"2024-09-13T06:40:13.409611+0000","last_fullsized":"2024-09-13T06:40:13.409611+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":373,"log_dups_size":0,"ondisk_log_size":373,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:16:19.108034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00098659399999999993,"stat_sum":{"num_bytes":1405076,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1920,"num_read_kb":4932,"num_write":627,"num_write_kb":4887,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"1a","length":"1"}]},{"pgid":"3.c","version":"62'99","reported_seq":2818,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-13T06:40:14.418954+0000","last_change":"2024-09-13T06:40:08.485051+0000","last_active":"2024-09-13T06:40:14.418954+0000","last_peered":"2024-09-13T06:40:14.418954+0000","last_clean":"2024-09-13T06:40:14.418954+0000","last_became_active":"2024-09-13T06:39:27.359518+0000","last_became_peered":"2024-09-13T06:39:27.359518+0000","last_unstale":"2024-09-13T06:40:14.418954+0000","last_undegraded":"2024-09-13T06:40:14.418954+0000","last_fullsized":"2024-09-13T06:40:14.418954+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:09:45.387352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0017227169999999999,"stat_sum":{"num_bytes":15587804,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2922,"num_read_kb":10946,"num_write":160,"num_write_kb":5666,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"1a","length":"1"}]},{"pgid":"3.d","version":"62'94","reported_seq":470,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-13T06:40:14.484056+0000","last_change":"2024-09-13T06:40:08.484379+0000","last_active":"2024-09-13T06:40:14.484056+0000","last_peered":"2024-09-13T06:40:14.484056+0000","last_clean":"2024-09-13T06:40:14.484056+0000","last_became_active":"2024-09-13T06:39:49.546474+0000","last_became_peered":"2024-09-13T06:39:49.546474+0000","last_unstale":"2024-09-13T06:40:14.484056+0000","last_undegraded":"2024-09-13T06:40:14.484056+0000","last_fullsized":"2024-09-13T06:40:14.484056+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:25:07.344006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00117285,"stat_sum":{"num_bytes":7713011,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":267,"num_read_kb":4554,"num_write":216,"num_write_kb":11692,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":57393,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"1a","length":"1"}]},{"pgid":"3.e","version":"60'69","reported_seq":870,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-13T06:40:13.459460+0000","last_change":"2024-09-13T06:40:08.375470+0000","last_active":"2024-09-13T06:40:13.459460+0000","last_peered":"2024-09-13T06:40:13.459460+0000","last_clean":"2024-09-13T06:40:13.459460+0000","last_became_active":"2024-09-13T06:40:06.367853+0000","last_became_peered":"2024-09-13T06:40:06.367853+0000","last_unstale":"2024-09-13T06:40:13.459460+0000","last_undegraded":"2024-09-13T06:40:13.459460+0000","last_fullsized":"2024-09-13T06:40:13.459460+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:06:14.823993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058633700000000003,"stat_sum":{"num_bytes":7079091,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":647,"num_read_kb":4322,"num_write":92,"num_write_kb":4927,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":19,"num_bytes_recovered":2827443,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"1a","length":"1"}]},{"pgid":"3.f","version":"62'84","reported_seq":237,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-13T06:40:14.462723+0000","last_change":"2024-09-13T06:40:08.372148+0000","last_active":"2024-09-13T06:40:14.462723+0000","last_peered":"2024-09-13T06:40:14.462723+0000","last_clean":"2024-09-13T06:40:14.462723+0000","last_became_active":"2024-09-13T06:40:02.595491+0000","last_became_peered":"2024-09-13T06:40:02.595491+0000","last_unstale":"2024-09-13T06:40:14.462723+0000","last_undegraded":"2024-09-13T06:40:14.462723+0000","last_fullsized":"2024-09-13T06:40:14.462723+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:00:30.916558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015304470000000001,"stat_sum":{"num_bytes":13038403,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":432,"num_read_kb":7875,"num_write":128,"num_write_kb":9645,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":31,"num_bytes_recovered":1052731,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"1a","length":"1"}]},{"pgid":"3.10","version":"60'99","reported_seq":818,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-13T06:40:13.415915+0000","last_change":"2024-09-13T06:40:08.379135+0000","last_active":"2024-09-13T06:40:13.415915+0000","last_peered":"2024-09-13T06:40:13.415915+0000","last_clean":"2024-09-13T06:40:13.415915+0000","last_became_active":"2024-09-13T06:39:27.361949+0000","last_became_peered":"2024-09-13T06:39:27.361949+0000","last_unstale":"2024-09-13T06:40:13.415915+0000","last_undegraded":"2024-09-13T06:40:13.415915+0000","last_fullsized":"2024-09-13T06:40:13.415915+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:37:21.237288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00070970500000000004,"stat_sum":{"num_bytes":5100699,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":982,"num_read_kb":3759,"num_write":139,"num_write_kb":3394,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"1a","length":"1"}]},{"pgid":"3.11","version":"61'131","reported_seq":576,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-13T06:40:14.414256+0000","last_change":"2024-09-13T06:40:08.377368+0000","last_active":"2024-09-13T06:40:14.414256+0000","last_peered":"2024-09-13T06:40:14.414256+0000","last_clean":"2024-09-13T06:40:14.414256+0000","last_became_active":"2024-09-13T06:39:49.555347+0000","last_became_peered":"2024-09-13T06:39:49.555347+0000","last_unstale":"2024-09-13T06:40:14.414256+0000","last_undegraded":"2024-09-13T06:40:14.414256+0000","last_fullsized":"2024-09-13T06:40:14.414256+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":131,"log_dups_size":0,"ondisk_log_size":131,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:59:27.631888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015002469999999999,"stat_sum":{"num_bytes":4464694,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":521,"num_read_kb":2275,"num_write":163,"num_write_kb":4549,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":20498,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"1a","length":"1"}]},{"pgid":"3.12","version":"60'135","reported_seq":1202,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-13T06:40:13.410148+0000","last_change":"2024-09-13T06:40:08.388016+0000","last_active":"2024-09-13T06:40:13.410148+0000","last_peered":"2024-09-13T06:40:13.410148+0000","last_clean":"2024-09-13T06:40:13.410148+0000","last_became_active":"2024-09-13T06:39:49.547614+0000","last_became_peered":"2024-09-13T06:39:49.547614+0000","last_unstale":"2024-09-13T06:40:13.410148+0000","last_undegraded":"2024-09-13T06:40:13.410148+0000","last_fullsized":"2024-09-13T06:40:13.410148+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:30:18.025681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015350450000000001,"stat_sum":{"num_bytes":5844786,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1474,"num_read_kb":4687,"num_write":131,"num_write_kb":4258,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":56768,"num_keys_recovered":10,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"1a","length":"1"}]},{"pgid":"3.13","version":"49'201","reported_seq":435,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-13T06:40:13.420516+0000","last_change":"2024-09-13T06:40:08.376802+0000","last_active":"2024-09-13T06:40:13.420516+0000","last_peered":"2024-09-13T06:40:13.420516+0000","last_clean":"2024-09-13T06:40:13.420516+0000","last_became_active":"2024-09-13T06:39:49.552693+0000","last_became_peered":"2024-09-13T06:39:49.552693+0000","last_unstale":"2024-09-13T06:40:13.420516+0000","last_undegraded":"2024-09-13T06:40:13.420516+0000","last_fullsized":"2024-09-13T06:40:13.420516+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":201,"log_dups_size":0,"ondisk_log_size":201,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:30:53.813754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00083933599999999999,"stat_sum":{"num_bytes":836092,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":949,"num_read_kb":1138,"num_write":364,"num_write_kb":3303,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":9519,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"1a","length":"1"}]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":224453797,"num_objects":254,"num_object_clones":0,"num_object_copies":508,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":254,"num_whiteouts":0,"num_read":44598,"num_read_kb":205853,"num_write":6531,"num_write_kb":175685,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":140,"num_bytes_recovered":9360300,"num_keys_recovered":10,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":143151104,"data_stored":142314211,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4507,"ondisk_log_size":4507,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":3}],"osd_stats":[{"osd":7,"up_from":0,"seq":55834574866,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},{"osd":6,"up_from":13,"seq":55834574863,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41072,"kb_used_data":9956,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94330768,"statfs":{"total":96636764160,"available":96594706432,"internally_reserved":0,"allocated":10194944,"data_stored":9713739,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 06:40:10 2024","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.746,"15min":0.746},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.3029999999999999,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.258,"5min":1.258,"15min":1.258},"last":0.73299999999999998}]},{"osd":1,"last update":"Fri Sep 13 06:40:10 2024","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":1.081,"5min":1.081,"15min":1.081},"last":0.82199999999999995},{"interface":"front","average":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.5660000000000001,"5min":1.5660000000000001,"15min":1.5660000000000001},"last":0.88800000000000001}]},{"osd":2,"last update":"Fri Sep 13 06:40:10 2024","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.3140000000000001,"5min":1.3140000000000001,"15min":1.3140000000000001},"last":1.0609999999999999},{"interface":"front","average":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.5229999999999999,"5min":1.5229999999999999,"15min":1.5229999999999999},"last":0.99099999999999999}]},{"osd":3,"last update":"Fri Sep 13 06:40:10 2024","interfaces":[{"interface":"back","average":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.2869999999999999,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":0.91300000000000003},{"interface":"front","average":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.171,"5min":1.171,"15min":1.171},"last":0.69299999999999995}]},{"osd":4,"last update":"Fri Sep 13 06:40:10 2024","interfaces":[{"interface":"back","average":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.748,"5min":1.748,"15min":1.748},"last":0.59799999999999998},{"interface":"front","average":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.3480000000000001,"5min":1.3480000000000001,"15min":1.3480000000000001},"last":0.85699999999999998}]},{"osd":5,"last update":"Fri Sep 13 06:40:10 2024","interfaces":[{"interface":"back","average":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.387,"5min":1.387,"15min":1.387},"last":0.93500000000000005},{"interface":"front","average":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.4830000000000001,"5min":1.4830000000000001,"15min":1.4830000000000001},"last":0.96299999999999997}]},{"osd":7,"last update":"Fri Sep 13 06:40:10 2024","interfaces":[{"interface":"back","average":{"1min":1.1679999999999999,"5min":1.1679999999999999,"15min":1.1679999999999999},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.8999999999999999,"5min":1.8999999999999999,"15min":1.8999999999999999},"last":1.038},{"interface":"front","average":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.6020000000000001,"5min":1.6020000000000001,"15min":1.6020000000000001},"last":1.0089999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574864,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55796,"kb_used_data":20580,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94316044,"statfs":{"total":96636764160,"available":96579629056,"internally_reserved":0,"allocated":21073920,"data_stored":20577111,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36043206},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 06:40:10 2024","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.6679999999999999,"5min":1.6679999999999999,"15min":1.6679999999999999},"last":0.752},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.2410000000000001,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.81200000000000006}]},{"osd":1,"last update":"Fri Sep 13 06:40:10 2024","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.163,"5min":1.163,"15min":1.163},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.081,"5min":1.081,"15min":1.081},"last":0.58799999999999997}]},{"osd":2,"last update":"Fri Sep 13 06:40:10 2024","interfaces":[{"interface":"back","average":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.246,"5min":1.246,"15min":1.246},"last":0.82599999999999996},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":1.4279999999999999,"5min":1.4279999999999999,"15min":1.4279999999999999},"last":0.60899999999999999}]},{"osd":3,"last update":"Fri Sep 13 06:40:10 2024","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.2190000000000001,"5min":1.2190000000000001,"15min":1.2190000000000001},"last":0.73499999999999999}]},{"osd":4,"last update":"Fri Sep 13 06:40:10 2024","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.754,"5min":1.754,"15min":1.754},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":1.123,"5min":1.123,"15min":1.123},"last":0.48299999999999998}]},{"osd":6,"last update":"Fri Sep 13 06:40:10 2024","interfaces":[{"interface":"back","average":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.1870000000000001,"5min":1.1870000000000001,"15min":1.1870000000000001},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.875,"5min":0.875,"15min":0.875},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.968,"5min":1.968,"15min":1.968},"last":0.64600000000000002}]},{"osd":7,"last update":"Fri Sep 13 06:40:10 2024","interfaces":[{"interface":"back","average":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":1.212,"5min":1.212,"15min":1.212},"last":0.84899999999999998},{"interface":"front","average":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.4790000000000001,"5min":1.4790000000000001,"15min":1.4790000000000001},"last":0.875}]}]},{"osd":4,"up_from":13,"seq":55834574864,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52236,"kb_used_data":17024,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94319604,"statfs":{"total":96636764160,"available":96583274496,"internally_reserved":0,"allocated":17432576,"data_stored":16920228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36043206},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,1],"upper_bound":4},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 06:40:11 2024","interfaces":[{"interface":"back","average":{"1min":1.089,"5min":1.089,"15min":1.089},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":5.8230000000000004,"5min":5.8230000000000004,"15min":5.8230000000000004},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":1.1519999999999999,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":0.80300000000000005}]},{"osd":1,"last update":"Fri Sep 13 06:40:11 2024","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.2090000000000001,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.286,"5min":1.286,"15min":1.286},"last":0.86899999999999999}]},{"osd":2,"last update":"Fri Sep 13 06:40:11 2024","interfaces":[{"interface":"back","average":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.5209999999999999,"5min":1.5209999999999999,"15min":1.5209999999999999},"last":1.2},{"interface":"front","average":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.3540000000000001,"5min":1.3540000000000001,"15min":1.3540000000000001},"last":0.96199999999999997}]},{"osd":3,"last update":"Fri Sep 13 06:40:11 2024","interfaces":[{"interface":"back","average":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.4810000000000001,"5min":1.4810000000000001,"15min":1.4810000000000001},"last":1.113},{"interface":"front","average":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":1.452,"5min":1.452,"15min":1.452},"last":1.252}]},{"osd":5,"last update":"Fri Sep 13 06:40:11 2024","interfaces":[{"interface":"back","average":{"1min":0.878,"5min":0.878,"15min":0.878},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":2.9790000000000001,"5min":2.9790000000000001,"15min":2.9790000000000001},"last":1.0389999999999999},{"interface":"front","average":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.8779999999999999,"5min":1.8779999999999999,"15min":1.8779999999999999},"last":1.2969999999999999}]},{"osd":6,"last update":"Fri Sep 13 06:40:11 2024","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.391,"5min":1.391,"15min":1.391},"last":1.3460000000000001},{"interface":"front","average":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":2.0750000000000002,"5min":2.0750000000000002,"15min":2.0750000000000002},"last":1.1519999999999999}]},{"osd":7,"last update":"Fri Sep 13 06:40:11 2024","interfaces":[{"interface":"back","average":{"1min":0.996,"5min":0.996,"15min":0.996},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.583,"5min":1.583,"15min":1.583},"last":1.3779999999999999},{"interface":"front","average":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":1.546,"5min":1.546,"15min":1.546},"last":1.4159999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574866,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51308,"kb_used_data":16096,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94320532,"statfs":{"total":96636764160,"available":96584224768,"internally_reserved":0,"allocated":16482304,"data_stored":15961254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":36043208},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 06:40:09 2024","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.191,"5min":0.191,"15min":0.191},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.29499999999999998},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":1.2789999999999999,"5min":1.2789999999999999,"15min":1.2789999999999999},"last":0.44400000000000001}]},{"osd":1,"last update":"Fri Sep 13 06:40:09 2024","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.222,"5min":0.222,"15min":0.222},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":1.589,"5min":1.589,"15min":1.589},"last":0.41399999999999998}]},{"osd":2,"last update":"Fri Sep 13 06:40:09 2024","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.323,"5min":1.323,"15min":1.323},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":1.1699999999999999,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.5}]},{"osd":4,"last update":"Fri Sep 13 06:40:09 2024","interfaces":[{"interface":"back","average":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.7929999999999999,"5min":1.7929999999999999,"15min":1.7929999999999999},"last":0.747},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":1.3240000000000001,"5min":1.3240000000000001,"15min":1.3240000000000001},"last":0.70299999999999996}]},{"osd":5,"last update":"Fri Sep 13 06:40:09 2024","interfaces":[{"interface":"back","average":{"1min":0.87,"5min":0.87,"15min":0.87},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.3799999999999999,"5min":1.3799999999999999,"15min":1.3799999999999999},"last":0.78300000000000003},{"interface":"front","average":{"1min":0.878,"5min":0.878,"15min":0.878},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.204,"5min":1.204,"15min":1.204},"last":0.61799999999999999}]},{"osd":6,"last update":"Fri Sep 13 06:40:09 2024","interfaces":[{"interface":"back","average":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.532,"5min":1.532,"15min":1.532},"last":0.82099999999999995},{"interface":"front","average":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"min":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.825,"5min":1.825,"15min":1.825},"last":0.877}]},{"osd":7,"last update":"Fri Sep 13 06:40:09 2024","interfaces":[{"interface":"back","average":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"min":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.7430000000000001,"5min":1.7430000000000001,"15min":1.7430000000000001},"last":0.84099999999999997},{"interface":"front","average":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.8859999999999999,"5min":1.8859999999999999,"15min":1.8859999999999999},"last":0.84999999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574864,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51728,"kb_used_data":19340,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94320112,"statfs":{"total":96636764160,"available":96583794688,"internally_reserved":0,"allocated":19804160,"data_stored":19325447,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 06:40:09 2024","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":1.141,"5min":1.141,"15min":1.141},"last":0.49099999999999999}]},{"osd":1,"last update":"Fri Sep 13 06:40:09 2024","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":1.4970000000000001,"5min":1.4970000000000001,"15min":1.4970000000000001},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.61799999999999999}]},{"osd":3,"last update":"Fri Sep 13 06:40:09 2024","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":1.5800000000000001,"5min":1.5800000000000001,"15min":1.5800000000000001},"last":0.69099999999999995}]},{"osd":4,"last update":"Fri Sep 13 06:40:09 2024","interfaces":[{"interface":"back","average":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":1.9379999999999999,"5min":1.9379999999999999,"15min":1.9379999999999999},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.4950000000000001,"5min":1.4950000000000001,"15min":1.4950000000000001},"last":0.745}]},{"osd":5,"last update":"Fri Sep 13 06:40:09 2024","interfaces":[{"interface":"back","average":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":1.607,"5min":1.607,"15min":1.607},"last":0.93100000000000005},{"interface":"front","average":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.2729999999999999,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":0.95699999999999996}]},{"osd":6,"last update":"Fri Sep 13 06:40:09 2024","interfaces":[{"interface":"back","average":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"min":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":1.5509999999999999,"5min":1.5509999999999999,"15min":1.5509999999999999},"last":1.0049999999999999},{"interface":"front","average":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.4239999999999999,"5min":1.4239999999999999,"15min":1.4239999999999999},"last":0.86799999999999999}]},{"osd":7,"last update":"Fri Sep 13 06:40:09 2024","interfaces":[{"interface":"back","average":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"min":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.375,"5min":1.375,"15min":1.375},"last":0.91000000000000003},{"interface":"front","average":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.53,"5min":1.53,"15min":1.53},"last":0.98199999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574864,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52388,"kb_used_data":20004,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94319452,"statfs":{"total":96636764160,"available":96583118848,"internally_reserved":0,"allocated":20484096,"data_stored":19971208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 06:40:13 2024","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":1.387,"5min":1.387,"15min":1.387},"last":0.373}]},{"osd":2,"last update":"Fri Sep 13 06:40:13 2024","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":2.113,"5min":2.113,"15min":2.113},"last":0.34999999999999998},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":1.2989999999999999,"5min":1.2989999999999999,"15min":1.2989999999999999},"last":0.47999999999999998}]},{"osd":3,"last update":"Fri Sep 13 06:40:13 2024","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":1.3640000000000001,"5min":1.3640000000000001,"15min":1.3640000000000001},"last":0.44},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":1.427,"5min":1.427,"15min":1.427},"last":0.45200000000000001}]},{"osd":4,"last update":"Fri Sep 13 06:40:13 2024","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.226,"5min":1.226,"15min":1.226},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.4359999999999999,"5min":1.4359999999999999,"15min":1.4359999999999999},"last":0.878}]},{"osd":5,"last update":"Fri Sep 13 06:40:13 2024","interfaces":[{"interface":"back","average":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.7849999999999999,"5min":1.7849999999999999,"15min":1.7849999999999999},"last":0.83099999999999996},{"interface":"front","average":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":2.036,"5min":2.036,"15min":2.036},"last":0.629}]},{"osd":6,"last update":"Fri Sep 13 06:40:13 2024","interfaces":[{"interface":"back","average":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.8149999999999999,"5min":1.8149999999999999,"15min":1.8149999999999999},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.9490000000000001,"5min":1.9490000000000001,"15min":1.9490000000000001},"last":0.74199999999999999}]},{"osd":7,"last update":"Fri Sep 13 06:40:13 2024","interfaces":[{"interface":"back","average":{"1min":1,"5min":1,"15min":1},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.5509999999999999,"5min":1.5509999999999999,"15min":1.5509999999999999},"last":0.90900000000000003},{"interface":"front","average":{"1min":1.024,"5min":1.024,"15min":1.024},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.748,"5min":1.748,"15min":1.748},"last":0.76700000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574863,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":68952,"kb_used_data":33740,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94302888,"statfs":{"total":96636764160,"available":96566157312,"internally_reserved":0,"allocated":34549760,"data_stored":34016991,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36043206},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 06:40:09 2024","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.21299999999999999,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":1.2270000000000001,"5min":1.2270000000000001,"15min":1.2270000000000001},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":1.222,"5min":1.222,"15min":1.222},"last":0.44500000000000001}]},{"osd":2,"last update":"Fri Sep 13 06:40:09 2024","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.88900000000000001},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":1.359,"5min":1.359,"15min":1.359},"last":0.48199999999999998}]},{"osd":3,"last update":"Fri Sep 13 06:40:09 2024","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":1.51,"5min":1.51,"15min":1.51},"last":0.69199999999999995}]},{"osd":4,"last update":"Fri Sep 13 06:40:09 2024","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.5449999999999999,"5min":1.5449999999999999,"15min":1.5449999999999999},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.6319999999999999,"5min":1.6319999999999999,"15min":1.6319999999999999},"last":0.92100000000000004}]},{"osd":5,"last update":"Fri Sep 13 06:40:09 2024","interfaces":[{"interface":"back","average":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":1.3240000000000001,"5min":1.3240000000000001,"15min":1.3240000000000001},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.877,"5min":0.877,"15min":0.877},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.5740000000000001,"5min":1.5740000000000001,"15min":1.5740000000000001},"last":0.77300000000000002}]},{"osd":6,"last update":"Fri Sep 13 06:40:09 2024","interfaces":[{"interface":"back","average":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":2.4969999999999999,"5min":2.4969999999999999,"15min":2.4969999999999999},"last":0.81200000000000006},{"interface":"front","average":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":2.0419999999999998,"5min":2.0419999999999998,"15min":2.0419999999999998},"last":0.79400000000000004}]},{"osd":7,"last update":"Fri Sep 13 06:40:09 2024","interfaces":[{"interface":"back","average":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"min":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.6020000000000001,"5min":1.6020000000000001,"15min":1.6020000000000001},"last":0.87},{"interface":"front","average":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":2.4049999999999998,"5min":2.4049999999999998,"15min":2.4049999999999998},"last":1.0309999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":36388864,"data_stored":36244649,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":21344256,"data_stored":21223783,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":19079168,"data_stored":18998902,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":17870848,"data_stored":17738136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":17772544,"data_stored":17648534,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20348928,"data_stored":20250593,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":9940992,"data_stored":9851677,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":405504,"data_stored":357937,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T06:40:16.811 INFO:tasks.thrashosds.thrasher:Setting 3.1a to [2, 6] 2024-09-13T06:40:16.811 INFO:tasks.thrashosds.thrasher:cmd ['osd', 'pg-upmap', '3.1a', '2', '6'] 2024-09-13T06:40:16.811 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pg-upmap 3.1a 2 6 2024-09-13T06:40:16.812 INFO:teuthology.orchestra.run.smithi081.stdout:1754 read 0xf11a3e thru 0xf1bf64 (0xa527 bytes) 2024-09-13T06:40:16.812 INFO:teuthology.orchestra.run.smithi081.stdout:1756 write 0x1f1398a thru 0x1f23820 (0xfe97 bytes) 2024-09-13T06:40:16.815 INFO:teuthology.orchestra.run.smithi081.stdout:1757 punch from 0x1a29cda to 0x1a31aba, (0x7de0 bytes) 2024-09-13T06:40:16.815 INFO:teuthology.orchestra.run.smithi081.stdout:1759 punch from 0x2b46bca to 0x2b5604c, (0xf482 bytes) 2024-09-13T06:40:16.829 INFO:teuthology.orchestra.run.smithi081.stdout:1760 writesame 0x99c9936 thru 0x99ca9e6 data_size 0x1(0x10b1 bytes) 2024-09-13T06:40:16.829 INFO:teuthology.orchestra.run.smithi081.stdout:1761 read 0x85e7b3b thru 0x85e86b9 (0xb7f bytes) 2024-09-13T06:40:16.841 INFO:teuthology.orchestra.run.smithi081.stdout:1762 trunc from 0x99ca9e7 to 0x1545de4 2024-09-13T06:40:16.881 INFO:teuthology.orchestra.run.smithi081.stdout:1763 write 0x96724f3 thru 0x967da46 (0xb554 bytes) 2024-09-13T06:40:16.883 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-13T06:40:16.885 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:40:16.885 INFO:teuthology.orchestra.run.smithi139.stdout: "size": 20, 2024-09-13T06:40:16.885 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 600, 2024-09-13T06:40:16.885 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [ 2024-09-13T06:40:16.885 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.885 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4154.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-13T06:40:16.885 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:11.143816+0000", 2024-09-13T06:40:16.885 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 65.741857840999998, 2024-09-13T06:40:16.885 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.062483034, 2024-09-13T06:40:16.885 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:16.885 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:40:16.886 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:16.886 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4154", 2024-09-13T06:40:16.886 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/2406930292", 2024-09-13T06:40:16.886 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 1 2024-09-13T06:40:16.886 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.886 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:16.886 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.886 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:16.886 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.143816+0000", 2024-09-13T06:40:16.886 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:16.886 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.886 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.887 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:16.887 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.143816+0000", 2024-09-13T06:40:16.887 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:16.887 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.887 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.887 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:16.887 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.143814+0000", 2024-09-13T06:40:16.887 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999976 2024-09-13T06:40:16.887 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.887 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.887 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:16.887 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.143829+0000", 2024-09-13T06:40:16.888 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5316999999999999e-05 2024-09-13T06:40:16.888 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.888 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.888 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:16.888 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.143851+0000", 2024-09-13T06:40:16.888 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.1736999999999999e-05 2024-09-13T06:40:16.888 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.888 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.888 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:16.888 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.143870+0000", 2024-09-13T06:40:16.888 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.9185999999999999e-05 2024-09-13T06:40:16.888 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.888 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.888 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:16.889 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.143973+0000", 2024-09-13T06:40:16.889 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000102896 2024-09-13T06:40:16.889 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.889 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.889 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:40:16.889 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.143987+0000", 2024-09-13T06:40:16.889 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.401e-05 2024-09-13T06:40:16.889 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.889 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.889 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:16.889 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.203333+0000", 2024-09-13T06:40:16.889 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.059346614999999998 2024-09-13T06:40:16.890 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.890 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.890 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:16.890 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.203624+0000", 2024-09-13T06:40:16.890 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00029112700000000002 2024-09-13T06:40:16.890 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.890 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.890 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 0", 2024-09-13T06:40:16.890 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.203940+0000", 2024-09-13T06:40:16.890 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00031547200000000002 2024-09-13T06:40:16.890 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.890 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.891 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-13T06:40:16.891 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.205145+0000", 2024-09-13T06:40:16.891 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0012048930000000001 2024-09-13T06:40:16.891 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.891 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.891 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:40:16.891 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.206110+0000", 2024-09-13T06:40:16.891 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00096536600000000005 2024-09-13T06:40:16.891 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.891 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.891 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-13T06:40:16.891 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.206196+0000", 2024-09-13T06:40:16.891 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.5798999999999996e-05 2024-09-13T06:40:16.892 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.892 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.892 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:16.892 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.206299+0000", 2024-09-13T06:40:16.892 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00010279 2024-09-13T06:40:16.892 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:16.892 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:16.892 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:16.892 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.892 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.892 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4154.0:36 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-13T06:40:16.892 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:11.257357+0000", 2024-09-13T06:40:16.892 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 65.628316397999996, 2024-09-13T06:40:16.893 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.012807595, 2024-09-13T06:40:16.893 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:16.893 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:40:16.893 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:16.893 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4154", 2024-09-13T06:40:16.893 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/2406930292", 2024-09-13T06:40:16.893 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 36 2024-09-13T06:40:16.893 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.893 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:16.893 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.893 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:16.893 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.257357+0000", 2024-09-13T06:40:16.894 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:16.894 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.894 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.894 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:16.894 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.257357+0000", 2024-09-13T06:40:16.894 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:16.894 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.894 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.894 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:16.894 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.257356+0000", 2024-09-13T06:40:16.894 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:16.894 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.895 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.895 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:16.895 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.257378+0000", 2024-09-13T06:40:16.895 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.1988999999999999e-05 2024-09-13T06:40:16.895 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.895 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.895 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:16.895 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.257389+0000", 2024-09-13T06:40:16.895 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0343000000000001e-05 2024-09-13T06:40:16.895 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.895 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.895 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:16.895 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.257396+0000", 2024-09-13T06:40:16.895 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5839999999999997e-06 2024-09-13T06:40:16.896 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.896 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.896 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:16.896 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.264748+0000", 2024-09-13T06:40:16.896 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0073514640000000003 2024-09-13T06:40:16.896 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.896 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.896 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:16.896 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.264878+0000", 2024-09-13T06:40:16.896 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00012975500000000001 2024-09-13T06:40:16.896 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.896 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.897 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 0", 2024-09-13T06:40:16.897 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.265064+0000", 2024-09-13T06:40:16.897 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000186799 2024-09-13T06:40:16.897 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.897 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.897 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:40:16.897 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.267248+0000", 2024-09-13T06:40:16.897 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0021841230000000001 2024-09-13T06:40:16.897 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.897 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.897 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-13T06:40:16.897 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.269996+0000", 2024-09-13T06:40:16.897 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0027473419999999998 2024-09-13T06:40:16.898 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.898 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.898 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-13T06:40:16.898 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.270066+0000", 2024-09-13T06:40:16.898 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.0683000000000001e-05 2024-09-13T06:40:16.898 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.898 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.898 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:16.898 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.270165+0000", 2024-09-13T06:40:16.898 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.8319000000000005e-05 2024-09-13T06:40:16.898 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:16.899 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:16.899 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:16.899 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.899 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.899 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4154.0:37 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-13T06:40:16.899 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:11.257405+0000", 2024-09-13T06:40:16.899 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 65.628268218000002, 2024-09-13T06:40:16.899 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.012930476999999999, 2024-09-13T06:40:16.899 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:16.899 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:40:16.899 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:16.899 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4154", 2024-09-13T06:40:16.900 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/2406930292", 2024-09-13T06:40:16.900 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 37 2024-09-13T06:40:16.900 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.900 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:16.900 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.900 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:16.900 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.257405+0000", 2024-09-13T06:40:16.900 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:16.900 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.900 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.900 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:16.900 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.257405+0000", 2024-09-13T06:40:16.900 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:16.901 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.901 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.901 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:16.901 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.257405+0000", 2024-09-13T06:40:16.901 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:16.901 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.901 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.901 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:16.901 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.257411+0000", 2024-09-13T06:40:16.901 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.1500000000000004e-06 2024-09-13T06:40:16.901 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.901 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.902 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:16.902 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.257420+0000", 2024-09-13T06:40:16.902 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.986e-06 2024-09-13T06:40:16.902 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.902 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.902 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:16.902 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.257436+0000", 2024-09-13T06:40:16.902 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6433999999999999e-05 2024-09-13T06:40:16.902 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.902 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.902 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:16.902 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.265923+0000", 2024-09-13T06:40:16.902 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0084872009999999998 2024-09-13T06:40:16.902 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.903 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.903 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:16.903 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.266056+0000", 2024-09-13T06:40:16.903 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00013206599999999999 2024-09-13T06:40:16.903 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.903 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.903 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 0", 2024-09-13T06:40:16.903 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.266255+0000", 2024-09-13T06:40:16.903 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00019935100000000001 2024-09-13T06:40:16.903 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.903 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.903 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:40:16.904 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.267788+0000", 2024-09-13T06:40:16.904 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0015335380000000001 2024-09-13T06:40:16.904 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.904 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.904 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-13T06:40:16.904 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.270181+0000", 2024-09-13T06:40:16.904 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.002392136 2024-09-13T06:40:16.904 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.904 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.904 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-13T06:40:16.904 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.270245+0000", 2024-09-13T06:40:16.904 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.4401999999999998e-05 2024-09-13T06:40:16.905 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.905 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.905 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:16.905 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.270336+0000", 2024-09-13T06:40:16.905 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.0872999999999995e-05 2024-09-13T06:40:16.905 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:16.905 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:16.905 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:16.905 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.905 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.905 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4154.0:88 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-13T06:40:16.905 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:11.362174+0000", 2024-09-13T06:40:16.906 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 65.523499610000002, 2024-09-13T06:40:16.906 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.012171276, 2024-09-13T06:40:16.906 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:16.906 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:40:16.906 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:16.906 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4154", 2024-09-13T06:40:16.906 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/2406930292", 2024-09-13T06:40:16.906 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 88 2024-09-13T06:40:16.906 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.906 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:16.906 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.906 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:16.906 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.362174+0000", 2024-09-13T06:40:16.906 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:16.907 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.907 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.907 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:16.907 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.362174+0000", 2024-09-13T06:40:16.907 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:16.907 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.907 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.907 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:16.907 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.362172+0000", 2024-09-13T06:40:16.907 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999986 2024-09-13T06:40:16.907 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.907 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.907 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:16.907 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.362183+0000", 2024-09-13T06:40:16.908 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.081e-05 2024-09-13T06:40:16.908 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.908 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.908 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:16.908 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.362205+0000", 2024-09-13T06:40:16.908 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.1897000000000001e-05 2024-09-13T06:40:16.908 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.908 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.908 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:16.908 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.362221+0000", 2024-09-13T06:40:16.908 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5353e-05 2024-09-13T06:40:16.908 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.909 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.909 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:16.909 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.369202+0000", 2024-09-13T06:40:16.909 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0069816219999999998 2024-09-13T06:40:16.909 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.909 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.909 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:16.909 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.369323+0000", 2024-09-13T06:40:16.909 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000121156 2024-09-13T06:40:16.909 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.909 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.909 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 0", 2024-09-13T06:40:16.909 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.369683+0000", 2024-09-13T06:40:16.910 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00035930700000000001 2024-09-13T06:40:16.910 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.910 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.910 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:40:16.910 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.371448+0000", 2024-09-13T06:40:16.910 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.001765043 2024-09-13T06:40:16.910 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.910 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.910 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-13T06:40:16.910 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.374156+0000", 2024-09-13T06:40:16.910 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.002707999 2024-09-13T06:40:16.910 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.911 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.911 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-13T06:40:16.911 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.374243+0000", 2024-09-13T06:40:16.911 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6873000000000007e-05 2024-09-13T06:40:16.911 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.911 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.911 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:16.911 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.374345+0000", 2024-09-13T06:40:16.911 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00010272600000000001 2024-09-13T06:40:16.911 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:16.911 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:16.911 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:16.911 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.911 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.912 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4154.0:108 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-13T06:40:16.912 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:11.524074+0000", 2024-09-13T06:40:16.912 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 65.361599605999999, 2024-09-13T06:40:16.912 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.012736235, 2024-09-13T06:40:16.912 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:16.912 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:40:16.912 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:16.912 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4154", 2024-09-13T06:40:16.912 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/2406930292", 2024-09-13T06:40:16.912 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 108 2024-09-13T06:40:16.912 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.912 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:16.912 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.912 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:16.913 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.524074+0000", 2024-09-13T06:40:16.913 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:16.913 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.913 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.913 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:16.913 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.524074+0000", 2024-09-13T06:40:16.913 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:16.913 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.913 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.913 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:16.913 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.524073+0000", 2024-09-13T06:40:16.913 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:16.913 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.914 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.914 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:16.914 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.524084+0000", 2024-09-13T06:40:16.914 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1026000000000001e-05 2024-09-13T06:40:16.914 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.914 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.914 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:16.914 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.524102+0000", 2024-09-13T06:40:16.914 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7992999999999999e-05 2024-09-13T06:40:16.914 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.914 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.914 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:16.914 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.524140+0000", 2024-09-13T06:40:16.914 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.8277e-05 2024-09-13T06:40:16.915 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.915 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.915 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:16.915 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.528884+0000", 2024-09-13T06:40:16.915 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.004743761 2024-09-13T06:40:16.915 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.915 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.915 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:16.915 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.529006+0000", 2024-09-13T06:40:16.915 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000121829 2024-09-13T06:40:16.915 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.915 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.915 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 0", 2024-09-13T06:40:16.915 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.529196+0000", 2024-09-13T06:40:16.916 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000189731 2024-09-13T06:40:16.916 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.916 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.916 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:40:16.916 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.535697+0000", 2024-09-13T06:40:16.916 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0065011499999999998 2024-09-13T06:40:16.916 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.916 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.916 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-13T06:40:16.916 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.536644+0000", 2024-09-13T06:40:16.916 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00094732900000000001 2024-09-13T06:40:16.916 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.917 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.917 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-13T06:40:16.917 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.536712+0000", 2024-09-13T06:40:16.917 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.8303e-05 2024-09-13T06:40:16.917 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.917 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.917 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:16.917 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.536810+0000", 2024-09-13T06:40:16.917 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.7918999999999995e-05 2024-09-13T06:40:16.917 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:16.917 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:16.917 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:16.918 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.918 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.918 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4154.0:109 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-13T06:40:16.918 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:11.524169+0000", 2024-09-13T06:40:16.918 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 65.361504679999996, 2024-09-13T06:40:16.918 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.013995285999999999, 2024-09-13T06:40:16.918 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:16.918 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:40:16.918 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:16.918 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4154", 2024-09-13T06:40:16.918 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/2406930292", 2024-09-13T06:40:16.918 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 109 2024-09-13T06:40:16.918 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.919 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:16.919 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.919 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:16.919 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.524169+0000", 2024-09-13T06:40:16.919 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:16.919 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.919 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.919 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:16.919 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.524169+0000", 2024-09-13T06:40:16.919 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:16.919 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.919 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.920 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:16.920 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.524168+0000", 2024-09-13T06:40:16.920 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:16.920 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.920 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.920 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:16.920 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.524427+0000", 2024-09-13T06:40:16.920 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00025929799999999998 2024-09-13T06:40:16.920 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.920 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.920 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:16.920 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.524451+0000", 2024-09-13T06:40:16.920 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.3686e-05 2024-09-13T06:40:16.921 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.921 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.921 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:16.921 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.524468+0000", 2024-09-13T06:40:16.921 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7577000000000001e-05 2024-09-13T06:40:16.921 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.921 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.921 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:16.921 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.530416+0000", 2024-09-13T06:40:16.922 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0059474080000000004 2024-09-13T06:40:16.922 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.922 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.922 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:16.922 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.530553+0000", 2024-09-13T06:40:16.922 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000137742 2024-09-13T06:40:16.922 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.922 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.922 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 0", 2024-09-13T06:40:16.922 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.530749+0000", 2024-09-13T06:40:16.922 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000195608 2024-09-13T06:40:16.922 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.923 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.923 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-13T06:40:16.923 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.536836+0000", 2024-09-13T06:40:16.923 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.006086546 2024-09-13T06:40:16.923 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.923 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.923 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:40:16.923 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.538038+0000", 2024-09-13T06:40:16.923 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0012019509999999999 2024-09-13T06:40:16.923 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.923 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.923 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-13T06:40:16.923 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.538106+0000", 2024-09-13T06:40:16.923 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.8923000000000004e-05 2024-09-13T06:40:16.924 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.924 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.924 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:16.924 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.538164+0000", 2024-09-13T06:40:16.924 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.7729999999999998e-05 2024-09-13T06:40:16.924 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:16.924 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:16.924 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:16.924 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.924 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.924 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4154.0:110 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-13T06:40:16.924 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:11.524488+0000", 2024-09-13T06:40:16.925 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 65.361185203000005, 2024-09-13T06:40:16.925 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.013976323000000001, 2024-09-13T06:40:16.925 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:16.925 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:40:16.925 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:16.925 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4154", 2024-09-13T06:40:16.925 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/2406930292", 2024-09-13T06:40:16.925 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 110 2024-09-13T06:40:16.925 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.925 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:16.925 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.925 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:16.926 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.524488+0000", 2024-09-13T06:40:16.926 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:16.926 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.926 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.926 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:16.926 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.524488+0000", 2024-09-13T06:40:16.926 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:16.926 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.926 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.926 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:16.926 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.524487+0000", 2024-09-13T06:40:16.926 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999986 2024-09-13T06:40:16.926 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.927 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.927 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:16.927 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.524498+0000", 2024-09-13T06:40:16.927 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1579999999999999e-05 2024-09-13T06:40:16.927 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.927 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.927 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:16.927 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.524516+0000", 2024-09-13T06:40:16.927 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7776000000000001e-05 2024-09-13T06:40:16.927 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.927 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.927 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:16.927 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.524530+0000", 2024-09-13T06:40:16.928 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3896999999999999e-05 2024-09-13T06:40:16.928 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.928 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.928 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:16.928 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.532254+0000", 2024-09-13T06:40:16.928 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0077239409999999998 2024-09-13T06:40:16.928 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.928 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.928 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:16.928 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.532371+0000", 2024-09-13T06:40:16.928 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000117176 2024-09-13T06:40:16.928 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.928 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.929 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 0", 2024-09-13T06:40:16.929 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.532551+0000", 2024-09-13T06:40:16.929 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00018004100000000001 2024-09-13T06:40:16.929 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.929 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.929 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:40:16.929 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.538280+0000", 2024-09-13T06:40:16.929 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0057289230000000003 2024-09-13T06:40:16.929 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.929 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.929 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-13T06:40:16.929 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.538294+0000", 2024-09-13T06:40:16.930 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.4070000000000001e-05 2024-09-13T06:40:16.930 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.930 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.930 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-13T06:40:16.930 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.538368+0000", 2024-09-13T06:40:16.930 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.3604999999999997e-05 2024-09-13T06:40:16.930 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.930 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.930 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:16.930 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.538465+0000", 2024-09-13T06:40:16.930 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6830000000000006e-05 2024-09-13T06:40:16.930 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:16.930 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:16.930 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:16.931 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.931 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.931 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4154.0:111 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-13T06:40:16.931 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:11.524546+0000", 2024-09-13T06:40:16.931 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 65.361127769000007, 2024-09-13T06:40:16.931 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.016412307000000001, 2024-09-13T06:40:16.931 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:16.931 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:40:16.931 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:16.931 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4154", 2024-09-13T06:40:16.931 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/2406930292", 2024-09-13T06:40:16.931 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 111 2024-09-13T06:40:16.931 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.932 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:16.932 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.932 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:16.932 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.524546+0000", 2024-09-13T06:40:16.932 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:16.932 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.932 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.932 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:16.932 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.524546+0000", 2024-09-13T06:40:16.932 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:16.932 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.932 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.932 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:16.933 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.524545+0000", 2024-09-13T06:40:16.933 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:16.933 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.933 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.933 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:16.933 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.524555+0000", 2024-09-13T06:40:16.933 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0176e-05 2024-09-13T06:40:16.933 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.933 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.933 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:16.933 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.524577+0000", 2024-09-13T06:40:16.934 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.1756999999999999e-05 2024-09-13T06:40:16.934 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.934 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.934 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:16.934 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.524592+0000", 2024-09-13T06:40:16.934 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5345999999999998e-05 2024-09-13T06:40:16.934 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.934 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.934 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:16.934 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.533407+0000", 2024-09-13T06:40:16.934 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0088150559999999999 2024-09-13T06:40:16.934 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.934 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.935 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:16.935 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.533523+0000", 2024-09-13T06:40:16.935 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000116099 2024-09-13T06:40:16.935 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.935 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.935 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 0", 2024-09-13T06:40:16.935 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.533734+0000", 2024-09-13T06:40:16.935 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000211005 2024-09-13T06:40:16.935 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.935 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.935 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-13T06:40:16.935 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.538484+0000", 2024-09-13T06:40:16.935 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0047494900000000003 2024-09-13T06:40:16.936 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.936 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.936 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:40:16.936 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.540823+0000", 2024-09-13T06:40:16.936 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0023390889999999999 2024-09-13T06:40:16.936 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.936 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.936 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-13T06:40:16.936 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.540898+0000", 2024-09-13T06:40:16.936 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5449000000000002e-05 2024-09-13T06:40:16.936 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.936 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.936 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:16.937 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.540958+0000", 2024-09-13T06:40:16.937 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.9889999999999997e-05 2024-09-13T06:40:16.937 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:16.937 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:16.937 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:16.937 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.937 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.937 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4154.0:112 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-13T06:40:16.937 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:11.524610+0000", 2024-09-13T06:40:16.937 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 65.361064049999996, 2024-09-13T06:40:16.937 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.016538458999999998, 2024-09-13T06:40:16.938 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:16.938 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:40:16.938 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:16.938 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4154", 2024-09-13T06:40:16.938 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/2406930292", 2024-09-13T06:40:16.938 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 112 2024-09-13T06:40:16.938 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.939 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:16.939 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.939 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:16.939 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.524610+0000", 2024-09-13T06:40:16.939 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:16.939 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.939 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.939 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:16.939 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.524610+0000", 2024-09-13T06:40:16.939 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:16.939 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.939 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.939 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:16.940 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.524608+0000", 2024-09-13T06:40:16.940 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:16.940 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.940 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.940 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:16.940 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.524826+0000", 2024-09-13T06:40:16.940 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000217226 2024-09-13T06:40:16.940 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.940 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.940 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:16.940 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.524848+0000", 2024-09-13T06:40:16.940 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.2802999999999998e-05 2024-09-13T06:40:16.940 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.941 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.941 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:16.941 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.524906+0000", 2024-09-13T06:40:16.941 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.7878999999999999e-05 2024-09-13T06:40:16.941 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.941 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.941 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:16.941 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.534402+0000", 2024-09-13T06:40:16.941 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0094956769999999992 2024-09-13T06:40:16.941 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.941 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.942 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:16.942 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.534512+0000", 2024-09-13T06:40:16.942 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000110493 2024-09-13T06:40:16.942 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.942 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.942 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 0", 2024-09-13T06:40:16.942 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.534688+0000", 2024-09-13T06:40:16.942 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00017564499999999999 2024-09-13T06:40:16.942 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.942 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.942 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-13T06:40:16.942 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.538493+0000", 2024-09-13T06:40:16.942 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0038051399999999998 2024-09-13T06:40:16.943 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.943 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.943 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:40:16.943 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.541030+0000", 2024-09-13T06:40:16.943 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0025368080000000002 2024-09-13T06:40:16.943 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.943 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.943 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-13T06:40:16.943 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.541097+0000", 2024-09-13T06:40:16.943 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.6933000000000004e-05 2024-09-13T06:40:16.943 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.943 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.943 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:16.943 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.541148+0000", 2024-09-13T06:40:16.944 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.1008999999999999e-05 2024-09-13T06:40:16.944 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:16.944 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:16.944 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:16.944 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.944 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.944 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4154.0:113 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-13T06:40:16.944 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:11.524940+0000", 2024-09-13T06:40:16.944 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 65.360733085999996, 2024-09-13T06:40:16.944 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.017201570999999999, 2024-09-13T06:40:16.944 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:16.944 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:40:16.945 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:16.945 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4154", 2024-09-13T06:40:16.945 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/2406930292", 2024-09-13T06:40:16.945 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 113 2024-09-13T06:40:16.945 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.945 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:16.945 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.945 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:16.945 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.524940+0000", 2024-09-13T06:40:16.945 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:16.945 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.945 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.945 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:16.946 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.524940+0000", 2024-09-13T06:40:16.946 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:16.946 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.946 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.946 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:16.946 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.524938+0000", 2024-09-13T06:40:16.946 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999981 2024-09-13T06:40:16.946 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.946 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.946 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:16.946 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.524951+0000", 2024-09-13T06:40:16.946 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2993000000000001e-05 2024-09-13T06:40:16.946 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.946 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.947 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:16.947 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.524976+0000", 2024-09-13T06:40:16.947 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.4216999999999999e-05 2024-09-13T06:40:16.947 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.947 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.947 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:16.947 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.525000+0000", 2024-09-13T06:40:16.947 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.3986e-05 2024-09-13T06:40:16.947 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.947 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.947 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:16.947 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.535786+0000", 2024-09-13T06:40:16.947 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.010786733999999999 2024-09-13T06:40:16.948 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.948 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.948 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:16.948 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.535916+0000", 2024-09-13T06:40:16.948 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000129865 2024-09-13T06:40:16.948 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.948 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.948 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 0", 2024-09-13T06:40:16.948 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.536106+0000", 2024-09-13T06:40:16.948 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000190046 2024-09-13T06:40:16.948 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.949 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.949 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-13T06:40:16.949 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.540977+0000", 2024-09-13T06:40:16.949 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0048708730000000004 2024-09-13T06:40:16.949 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.949 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.949 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:40:16.949 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.542023+0000", 2024-09-13T06:40:16.949 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0010456179999999999 2024-09-13T06:40:16.949 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.949 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.949 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-13T06:40:16.950 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.542091+0000", 2024-09-13T06:40:16.950 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.7840000000000001e-05 2024-09-13T06:40:16.950 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.950 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.950 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:16.950 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.542142+0000", 2024-09-13T06:40:16.950 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.1399e-05 2024-09-13T06:40:16.950 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:16.950 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:16.950 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:16.950 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.950 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.950 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4154.0:114 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-13T06:40:16.950 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:11.525025+0000", 2024-09-13T06:40:16.951 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 65.360648206999997, 2024-09-13T06:40:16.951 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.017310847000000001, 2024-09-13T06:40:16.951 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:16.951 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:40:16.951 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:16.951 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4154", 2024-09-13T06:40:16.951 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/2406930292", 2024-09-13T06:40:16.951 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 114 2024-09-13T06:40:16.951 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.951 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:16.951 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.951 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:16.951 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.525025+0000", 2024-09-13T06:40:16.952 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:16.952 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.952 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.952 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:16.952 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.525025+0000", 2024-09-13T06:40:16.952 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:16.952 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.952 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.952 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:16.952 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.525024+0000", 2024-09-13T06:40:16.952 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999986 2024-09-13T06:40:16.952 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.952 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.953 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:16.953 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.525035+0000", 2024-09-13T06:40:16.953 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1413999999999999e-05 2024-09-13T06:40:16.953 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.953 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.953 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:16.953 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.525054+0000", 2024-09-13T06:40:16.953 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.8723e-05 2024-09-13T06:40:16.953 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.953 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.953 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:16.953 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.525068+0000", 2024-09-13T06:40:16.954 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.4022999999999999e-05 2024-09-13T06:40:16.954 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.954 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.954 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:16.954 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.536923+0000", 2024-09-13T06:40:16.954 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.011854821999999999 2024-09-13T06:40:16.954 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.954 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.954 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:16.954 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.537048+0000", 2024-09-13T06:40:16.954 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000125399 2024-09-13T06:40:16.954 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.954 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.954 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 0", 2024-09-13T06:40:16.955 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.537293+0000", 2024-09-13T06:40:16.955 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00024499500000000002 2024-09-13T06:40:16.955 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.955 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.955 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-13T06:40:16.955 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.541962+0000", 2024-09-13T06:40:16.955 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0046680940000000002 2024-09-13T06:40:16.955 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.955 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.955 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:40:16.955 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.542218+0000", 2024-09-13T06:40:16.955 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00025668199999999999 2024-09-13T06:40:16.955 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.956 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.956 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-13T06:40:16.956 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.542286+0000", 2024-09-13T06:40:16.956 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.7565999999999997e-05 2024-09-13T06:40:16.956 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.956 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.956 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:16.956 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.542336+0000", 2024-09-13T06:40:16.956 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.0429000000000001e-05 2024-09-13T06:40:16.956 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:16.956 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:16.956 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:16.957 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.957 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.957 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4154.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-13T06:40:16.957 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:11.525085+0000", 2024-09-13T06:40:16.957 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 65.360589027000003, 2024-09-13T06:40:16.957 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.019358490999999999, 2024-09-13T06:40:16.957 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:16.957 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:40:16.957 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:16.957 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4154", 2024-09-13T06:40:16.957 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/2406930292", 2024-09-13T06:40:16.957 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 115 2024-09-13T06:40:16.958 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.958 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:16.958 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.958 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:16.958 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.525085+0000", 2024-09-13T06:40:16.958 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:16.958 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.958 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.958 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:16.958 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.525085+0000", 2024-09-13T06:40:16.958 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:16.958 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.958 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.958 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:16.959 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.525083+0000", 2024-09-13T06:40:16.959 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:16.959 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.959 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.959 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:16.959 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.525302+0000", 2024-09-13T06:40:16.959 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00021804499999999999 2024-09-13T06:40:16.959 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.959 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.959 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:16.959 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.525324+0000", 2024-09-13T06:40:16.959 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.2147e-05 2024-09-13T06:40:16.959 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.959 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.960 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:16.960 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.525340+0000", 2024-09-13T06:40:16.960 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5879000000000002e-05 2024-09-13T06:40:16.960 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.960 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.960 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:16.960 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.538555+0000", 2024-09-13T06:40:16.960 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.013215499 2024-09-13T06:40:16.960 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.960 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.960 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:16.960 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.538703+0000", 2024-09-13T06:40:16.961 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00014755200000000001 2024-09-13T06:40:16.961 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.961 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.961 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 0", 2024-09-13T06:40:16.961 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.538967+0000", 2024-09-13T06:40:16.961 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00026453799999999998 2024-09-13T06:40:16.961 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.961 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.961 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-13T06:40:16.961 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.541969+0000", 2024-09-13T06:40:16.961 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00300184 2024-09-13T06:40:16.961 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.961 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.962 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:40:16.962 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.544287+0000", 2024-09-13T06:40:16.962 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0023178890000000001 2024-09-13T06:40:16.962 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.962 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.962 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-13T06:40:16.962 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.544378+0000", 2024-09-13T06:40:16.962 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.1366000000000006e-05 2024-09-13T06:40:16.962 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.962 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.962 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:16.962 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.544443+0000", 2024-09-13T06:40:16.962 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.4826000000000006e-05 2024-09-13T06:40:16.962 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:16.963 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:16.963 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:16.963 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.963 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.963 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4154.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-13T06:40:16.963 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:11.525359+0000", 2024-09-13T06:40:16.963 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 65.360314998999996, 2024-09-13T06:40:16.963 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.019359514000000001, 2024-09-13T06:40:16.963 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:16.963 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:40:16.963 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:16.963 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4154", 2024-09-13T06:40:16.964 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/2406930292", 2024-09-13T06:40:16.964 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 116 2024-09-13T06:40:16.964 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.964 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:16.964 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.964 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:16.964 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.525359+0000", 2024-09-13T06:40:16.964 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:16.964 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.964 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.964 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:16.964 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.525359+0000", 2024-09-13T06:40:16.964 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:16.965 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.965 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.965 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:16.965 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.525357+0000", 2024-09-13T06:40:16.965 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999981 2024-09-13T06:40:16.965 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.965 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.965 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:16.965 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.525369+0000", 2024-09-13T06:40:16.965 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1647e-05 2024-09-13T06:40:16.965 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.965 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.966 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:16.966 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.525386+0000", 2024-09-13T06:40:16.966 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7762999999999999e-05 2024-09-13T06:40:16.966 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.966 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.966 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:16.966 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.525400+0000", 2024-09-13T06:40:16.966 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.4053000000000001e-05 2024-09-13T06:40:16.966 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.966 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.966 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:16.966 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.539897+0000", 2024-09-13T06:40:16.966 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.014497128999999999 2024-09-13T06:40:16.967 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.967 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.967 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:16.967 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.540022+0000", 2024-09-13T06:40:16.967 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00012416599999999999 2024-09-13T06:40:16.967 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.967 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.967 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 0", 2024-09-13T06:40:16.967 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.540199+0000", 2024-09-13T06:40:16.967 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00017705499999999999 2024-09-13T06:40:16.967 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.967 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.967 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-13T06:40:16.968 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.542161+0000", 2024-09-13T06:40:16.968 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0019622210000000001 2024-09-13T06:40:16.968 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.968 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.968 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:40:16.968 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.544529+0000", 2024-09-13T06:40:16.968 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0023684690000000002 2024-09-13T06:40:16.968 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.968 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.968 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-13T06:40:16.968 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.544614+0000", 2024-09-13T06:40:16.968 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.4711999999999998e-05 2024-09-13T06:40:16.968 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.969 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.969 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:16.969 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.544718+0000", 2024-09-13T06:40:16.969 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000103986 2024-09-13T06:40:16.969 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:16.969 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:16.969 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:16.969 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.969 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.969 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4154.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-13T06:40:16.969 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:11.525416+0000", 2024-09-13T06:40:16.970 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 65.360257446000006, 2024-09-13T06:40:16.970 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.019501830000000001, 2024-09-13T06:40:16.970 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:16.970 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:40:16.970 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:16.970 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4154", 2024-09-13T06:40:16.970 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/2406930292", 2024-09-13T06:40:16.970 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 117 2024-09-13T06:40:16.970 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.970 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:16.970 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.970 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:16.970 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.525416+0000", 2024-09-13T06:40:16.971 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:16.971 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.971 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.971 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:16.971 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.525416+0000", 2024-09-13T06:40:16.971 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:16.971 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.971 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.971 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:16.971 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.525415+0000", 2024-09-13T06:40:16.971 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999986 2024-09-13T06:40:16.971 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.971 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.971 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:16.972 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.525426+0000", 2024-09-13T06:40:16.972 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.101e-05 2024-09-13T06:40:16.972 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.972 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.972 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:16.972 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.525444+0000", 2024-09-13T06:40:16.972 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.768e-05 2024-09-13T06:40:16.972 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.972 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.972 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:16.972 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.525463+0000", 2024-09-13T06:40:16.972 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.9026999999999999e-05 2024-09-13T06:40:16.972 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.973 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.973 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:16.973 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.541203+0000", 2024-09-13T06:40:16.973 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.015740309000000001 2024-09-13T06:40:16.973 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.973 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.973 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:16.973 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.541330+0000", 2024-09-13T06:40:16.973 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000126976 2024-09-13T06:40:16.973 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.973 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.973 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 0", 2024-09-13T06:40:16.974 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.541522+0000", 2024-09-13T06:40:16.974 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00019165100000000001 2024-09-13T06:40:16.974 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.974 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.974 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-13T06:40:16.974 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.542798+0000", 2024-09-13T06:40:16.974 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.001276424 2024-09-13T06:40:16.974 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.974 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.974 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:40:16.974 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.544795+0000", 2024-09-13T06:40:16.974 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0019966540000000001 2024-09-13T06:40:16.974 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.975 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.975 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-13T06:40:16.975 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.544868+0000", 2024-09-13T06:40:16.975 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.3096000000000006e-05 2024-09-13T06:40:16.975 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.975 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.975 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:16.975 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.544918+0000", 2024-09-13T06:40:16.975 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.0226999999999999e-05 2024-09-13T06:40:16.975 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:16.975 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:16.975 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:16.975 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.976 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.976 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4154.0:136 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-13T06:40:16.976 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:12.006369+0000", 2024-09-13T06:40:16.976 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 64.879304097000002, 2024-09-13T06:40:16.976 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.012052078000000001, 2024-09-13T06:40:16.976 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:16.976 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:40:16.976 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:16.976 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4154", 2024-09-13T06:40:16.976 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/2406930292", 2024-09-13T06:40:16.976 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 136 2024-09-13T06:40:16.976 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.976 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:16.976 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.977 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:16.977 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.006369+0000", 2024-09-13T06:40:16.977 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:16.977 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.977 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.977 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:16.977 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.006369+0000", 2024-09-13T06:40:16.977 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:16.977 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.977 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.977 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:16.977 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.006369+0000", 2024-09-13T06:40:16.978 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:16.978 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.978 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.978 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:16.978 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.006372+0000", 2024-09-13T06:40:16.978 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.0630000000000002e-06 2024-09-13T06:40:16.978 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.978 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.978 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:16.978 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.006377+0000", 2024-09-13T06:40:16.978 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.6079999999999998e-06 2024-09-13T06:40:16.978 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.978 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.979 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:16.979 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.006384+0000", 2024-09-13T06:40:16.979 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.8560000000000001e-06 2024-09-13T06:40:16.979 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.979 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.979 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:16.979 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.008357+0000", 2024-09-13T06:40:16.979 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0019733839999999999 2024-09-13T06:40:16.979 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.979 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.979 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:16.979 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.008406+0000", 2024-09-13T06:40:16.979 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.9023000000000001e-05 2024-09-13T06:40:16.980 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.980 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.980 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 0", 2024-09-13T06:40:16.980 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.008489+0000", 2024-09-13T06:40:16.980 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.2649000000000001e-05 2024-09-13T06:40:16.980 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.980 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.980 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-13T06:40:16.980 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.011012+0000", 2024-09-13T06:40:16.980 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0025236880000000001 2024-09-13T06:40:16.980 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.980 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.980 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:40:16.981 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.018382+0000", 2024-09-13T06:40:16.981 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.007369596 2024-09-13T06:40:16.981 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.981 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.981 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-13T06:40:16.981 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.018405+0000", 2024-09-13T06:40:16.981 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.2670000000000001e-05 2024-09-13T06:40:16.981 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.981 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.981 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:16.981 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.018422+0000", 2024-09-13T06:40:16.981 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6864999999999999e-05 2024-09-13T06:40:16.981 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:16.982 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:16.982 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:16.982 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.982 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.982 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4154.0:137 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-13T06:40:16.982 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:12.006450+0000", 2024-09-13T06:40:16.982 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 64.879223768000003, 2024-09-13T06:40:16.982 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.012040990999999999, 2024-09-13T06:40:16.982 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:16.982 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:40:16.982 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:16.982 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4154", 2024-09-13T06:40:16.982 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/2406930292", 2024-09-13T06:40:16.982 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 137 2024-09-13T06:40:16.983 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.983 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:16.983 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.983 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:16.983 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.006450+0000", 2024-09-13T06:40:16.983 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:16.983 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.983 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.983 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:16.983 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.006450+0000", 2024-09-13T06:40:16.983 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:16.983 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.984 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.984 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:16.984 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.006449+0000", 2024-09-13T06:40:16.984 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:16.984 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.984 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.984 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:16.984 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.006549+0000", 2024-09-13T06:40:16.984 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.9847999999999997e-05 2024-09-13T06:40:16.984 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.984 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.984 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:16.984 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.006560+0000", 2024-09-13T06:40:16.985 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1012000000000001e-05 2024-09-13T06:40:16.985 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.985 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.985 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:16.985 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.006566+0000", 2024-09-13T06:40:16.985 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.1630000000000001e-06 2024-09-13T06:40:16.985 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.985 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.985 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:16.985 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.008760+0000", 2024-09-13T06:40:16.985 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0021934659999999998 2024-09-13T06:40:16.985 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.986 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.986 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:16.986 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.008803+0000", 2024-09-13T06:40:16.986 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.3492000000000003e-05 2024-09-13T06:40:16.986 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.986 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.986 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 0", 2024-09-13T06:40:16.986 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.008879+0000", 2024-09-13T06:40:16.986 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5252000000000004e-05 2024-09-13T06:40:16.986 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.986 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.986 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-13T06:40:16.986 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.011015+0000", 2024-09-13T06:40:16.987 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0021362349999999998 2024-09-13T06:40:16.987 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.987 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.987 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:40:16.987 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.018452+0000", 2024-09-13T06:40:16.987 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.007436865 2024-09-13T06:40:16.987 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.987 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.987 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-13T06:40:16.987 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.018474+0000", 2024-09-13T06:40:16.987 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.2149000000000001e-05 2024-09-13T06:40:16.987 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.987 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.988 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:16.988 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.018491+0000", 2024-09-13T06:40:16.988 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6983999999999999e-05 2024-09-13T06:40:16.988 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:16.988 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:16.988 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:16.988 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.988 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.988 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4154.0:139 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-13T06:40:16.988 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:12.006595+0000", 2024-09-13T06:40:16.988 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 64.879078449999994, 2024-09-13T06:40:16.988 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.012024933999999999, 2024-09-13T06:40:16.988 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:16.988 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:40:16.989 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:16.989 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4154", 2024-09-13T06:40:16.989 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/2406930292", 2024-09-13T06:40:16.989 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 139 2024-09-13T06:40:16.989 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.989 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:16.989 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.989 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:16.989 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.006595+0000", 2024-09-13T06:40:16.989 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:16.989 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.989 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.990 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:16.990 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.006595+0000", 2024-09-13T06:40:16.990 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:16.990 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.990 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.990 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:16.990 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.006595+0000", 2024-09-13T06:40:16.990 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:16.990 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.990 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.990 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:16.990 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.006598+0000", 2024-09-13T06:40:16.990 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.1769999999999998e-06 2024-09-13T06:40:16.991 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.991 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.991 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:16.991 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.006612+0000", 2024-09-13T06:40:16.991 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.4177e-05 2024-09-13T06:40:16.991 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.991 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.991 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:16.991 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.006617+0000", 2024-09-13T06:40:16.991 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.561e-06 2024-09-13T06:40:16.991 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.991 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.991 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:16.991 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.009658+0000", 2024-09-13T06:40:16.992 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0030413369999999999 2024-09-13T06:40:16.992 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.992 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.992 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:16.992 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.009707+0000", 2024-09-13T06:40:16.992 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.9089999999999999e-05 2024-09-13T06:40:16.992 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.992 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.992 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 0", 2024-09-13T06:40:16.992 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.009795+0000", 2024-09-13T06:40:16.992 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.7619000000000003e-05 2024-09-13T06:40:16.992 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.992 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.992 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-13T06:40:16.993 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.011021+0000", 2024-09-13T06:40:16.993 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0012266289999999999 2024-09-13T06:40:16.993 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.993 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.993 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:40:16.993 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.018582+0000", 2024-09-13T06:40:16.993 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0075603399999999996 2024-09-13T06:40:16.993 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.993 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.993 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-13T06:40:16.994 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.018603+0000", 2024-09-13T06:40:16.994 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.1795999999999999e-05 2024-09-13T06:40:16.994 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.994 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.994 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:16.994 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.018620+0000", 2024-09-13T06:40:16.994 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6562000000000002e-05 2024-09-13T06:40:16.994 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:16.994 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:16.994 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:16.994 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.994 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.994 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4154.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-13T06:40:16.995 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:12.006689+0000", 2024-09-13T06:40:16.995 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 64.878984260999999, 2024-09-13T06:40:16.995 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.012427258, 2024-09-13T06:40:16.995 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:16.995 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:40:16.995 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:16.995 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4154", 2024-09-13T06:40:16.995 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/2406930292", 2024-09-13T06:40:16.995 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 140 2024-09-13T06:40:16.995 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.995 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:16.995 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.996 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:16.996 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.006689+0000", 2024-09-13T06:40:16.996 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:16.996 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.996 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.996 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:16.996 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.006689+0000", 2024-09-13T06:40:16.996 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:16.996 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.996 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.996 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:16.996 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.006689+0000", 2024-09-13T06:40:16.996 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:16.997 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.997 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.997 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:16.997 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.006795+0000", 2024-09-13T06:40:16.997 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00010662699999999999 2024-09-13T06:40:16.997 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.997 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.997 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:16.997 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.006804+0000", 2024-09-13T06:40:16.997 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.055e-06 2024-09-13T06:40:16.997 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.997 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.997 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:16.998 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.006808+0000", 2024-09-13T06:40:16.998 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.7450000000000003e-06 2024-09-13T06:40:16.998 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.998 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.998 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:16.998 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.010066+0000", 2024-09-13T06:40:16.998 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0032579570000000001 2024-09-13T06:40:16.998 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.998 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.998 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:16.998 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.010111+0000", 2024-09-13T06:40:16.998 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.4563e-05 2024-09-13T06:40:16.998 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.998 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.998 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 0", 2024-09-13T06:40:16.999 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.010185+0000", 2024-09-13T06:40:16.999 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.4108000000000003e-05 2024-09-13T06:40:16.999 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.999 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.999 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-13T06:40:16.999 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.011161+0000", 2024-09-13T06:40:16.999 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00097629200000000002 2024-09-13T06:40:16.999 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:16.999 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:16.999 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:40:16.999 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.019061+0000", 2024-09-13T06:40:16.999 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0079001939999999993 2024-09-13T06:40:17.000 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:17.000 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:17.000 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-13T06:40:17.000 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.019095+0000", 2024-09-13T06:40:17.000 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.3200000000000001e-05 2024-09-13T06:40:17.000 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:17.000 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:17.000 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:17.000 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.019117+0000", 2024-09-13T06:40:17.000 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.1985e-05 2024-09-13T06:40:17.000 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:17.000 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:17.000 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:17.001 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:17.001 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:17.001 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4154.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-13T06:40:17.001 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:12.006814+0000", 2024-09-13T06:40:17.001 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 64.878859077000001, 2024-09-13T06:40:17.001 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.012896405999999999, 2024-09-13T06:40:17.001 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:17.001 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:40:17.001 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:17.001 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4154", 2024-09-13T06:40:17.001 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/2406930292", 2024-09-13T06:40:17.001 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 141 2024-09-13T06:40:17.001 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:17.001 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:17.002 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:17.002 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:17.002 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.006814+0000", 2024-09-13T06:40:17.002 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:17.002 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:17.002 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:17.002 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:17.002 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.006814+0000", 2024-09-13T06:40:17.002 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:17.002 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:17.002 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:17.002 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:17.002 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.006814+0000", 2024-09-13T06:40:17.002 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:17.003 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:17.003 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:17.003 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:17.003 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.006818+0000", 2024-09-13T06:40:17.003 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.8840000000000004e-06 2024-09-13T06:40:17.003 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:17.003 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:17.003 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:17.003 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.006834+0000", 2024-09-13T06:40:17.003 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6133999999999998e-05 2024-09-13T06:40:17.003 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:17.003 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:17.003 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:17.003 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.006838+0000", 2024-09-13T06:40:17.004 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0879999999999997e-06 2024-09-13T06:40:17.004 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:17.004 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:17.004 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:17.004 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.010586+0000", 2024-09-13T06:40:17.004 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.003747954 2024-09-13T06:40:17.004 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:17.004 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:17.004 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:17.004 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.010630+0000", 2024-09-13T06:40:17.004 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.3736000000000003e-05 2024-09-13T06:40:17.004 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:17.005 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:17.005 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 0", 2024-09-13T06:40:17.005 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.010701+0000", 2024-09-13T06:40:17.005 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.1284000000000004e-05 2024-09-13T06:40:17.005 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:17.005 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:17.005 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-13T06:40:17.005 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.011593+0000", 2024-09-13T06:40:17.005 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00089209300000000005 2024-09-13T06:40:17.005 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:17.005 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:17.005 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:40:17.006 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.019665+0000", 2024-09-13T06:40:17.006 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0080716169999999997 2024-09-13T06:40:17.006 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:17.006 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:17.006 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-13T06:40:17.006 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.019691+0000", 2024-09-13T06:40:17.006 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.6514000000000001e-05 2024-09-13T06:40:17.006 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:17.006 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:17.006 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:17.006 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.019711+0000", 2024-09-13T06:40:17.006 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.9641e-05 2024-09-13T06:40:17.006 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:17.007 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:17.007 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:17.007 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:17.007 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:17.007 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:608 3.11 3:8ebac99f:::rbd_data.11214e25756e.0000000000000007:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-09-13T06:40:17.007 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:34.801988+0000", 2024-09-13T06:40:17.007 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 42.083685688999999, 2024-09-13T06:40:17.007 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.033916448000000002, 2024-09-13T06:40:17.007 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:17.007 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:40:17.007 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:17.007 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:17.008 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:17.008 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 608 2024-09-13T06:40:17.008 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:17.008 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:17.008 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:17.008 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:17.008 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:34.801988+0000", 2024-09-13T06:40:17.008 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:17.008 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:17.008 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:17.008 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:17.008 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:34.801988+0000", 2024-09-13T06:40:17.008 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:17.009 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:17.009 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:17.009 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:17.009 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:34.801985+0000", 2024-09-13T06:40:17.009 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999976 2024-09-13T06:40:17.009 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:17.009 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:17.009 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:17.009 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:34.801999+0000", 2024-09-13T06:40:17.009 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.402e-05 2024-09-13T06:40:17.009 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:17.009 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:17.010 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:17.010 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:34.802031+0000", 2024-09-13T06:40:17.010 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.1582999999999999e-05 2024-09-13T06:40:17.010 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:17.010 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:17.010 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:17.010 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:34.802052+0000", 2024-09-13T06:40:17.010 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.1310000000000001e-05 2024-09-13T06:40:17.010 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:17.010 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:17.010 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:17.010 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:34.802117+0000", 2024-09-13T06:40:17.010 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.5016000000000002e-05 2024-09-13T06:40:17.010 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:17.011 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:17.011 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:17.011 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:34.802254+0000", 2024-09-13T06:40:17.011 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000136186 2024-09-13T06:40:17.011 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:17.011 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:17.011 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 4", 2024-09-13T06:40:17.011 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:34.807944+0000", 2024-09-13T06:40:17.011 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0056906930000000001 2024-09-13T06:40:17.011 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:17.011 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:17.011 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-13T06:40:17.011 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:34.835646+0000", 2024-09-13T06:40:17.012 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.027701546000000001 2024-09-13T06:40:17.012 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:17.012 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:17.012 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:40:17.012 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:34.835754+0000", 2024-09-13T06:40:17.012 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000107889 2024-09-13T06:40:17.012 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:17.012 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:17.012 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-13T06:40:17.012 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:34.835840+0000", 2024-09-13T06:40:17.012 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6621999999999998e-05 2024-09-13T06:40:17.012 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:17.012 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:17.013 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:17.013 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:34.835904+0000", 2024-09-13T06:40:17.013 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.4022999999999993e-05 2024-09-13T06:40:17.013 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:17.013 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:17.013 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:17.013 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:17.013 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:17.013 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:40:17.016 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-13T06:40:17.017 INFO:teuthology.orchestra.run.smithi081.stdout:1764 write 0x9ea7640 thru 0x9eaec8a (0x764b bytes) 2024-09-13T06:40:17.018 INFO:teuthology.orchestra.run.smithi081.stdout:1766 writesame 0xaff3164 thru 0xb001dfd data_size 0x2d(0xec9a bytes) 2024-09-13T06:40:17.018 INFO:teuthology.orchestra.run.smithi081.stdout:1767 writesame 0xbcb2a58 thru 0xbcba7dc data_size 0x1(0x7d85 bytes) 2024-09-13T06:40:17.018 INFO:teuthology.orchestra.run.smithi081.stdout:1768 trunc from 0xbcba7dd to 0x80ac5cb 2024-09-13T06:40:17.018 INFO:teuthology.orchestra.run.smithi081.stdout:1769 read 0x547a6bc thru 0x54859d6 (0xb31b bytes) 2024-09-13T06:40:17.018 INFO:teuthology.orchestra.run.smithi081.stdout:1770 write 0x611543c thru 0x61197aa (0x436f bytes) 2024-09-13T06:40:17.018 INFO:teuthology.orchestra.run.smithi081.stdout:1771 read 0x2b1073e thru 0x2b13cfa (0x35bd bytes) 2024-09-13T06:40:17.018 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:40:17.018 INFO:teuthology.orchestra.run.smithi081.stdout:1773 writesame 0x276e995 thru 0x2773545 data_size 0x3(0x4bb1 bytes) 2024-09-13T06:40:17.018 INFO:teuthology.orchestra.run.smithi081.stdout:1774 trunc from 0x80ac5cb to 0x867e916 2024-09-13T06:40:17.018 INFO:teuthology.orchestra.run.smithi081.stdout:1775 write 0xeb00bb thru 0xeb3dfa (0x3d40 bytes) 2024-09-13T06:40:17.018 INFO:teuthology.orchestra.run.smithi081.stdout:1777 trunc from 0x867e916 to 0x90e4f14 2024-09-13T06:40:17.018 INFO:teuthology.orchestra.run.smithi081.stdout:1778 write 0x6257fea thru 0x625ca7b (0x4a92 bytes) 2024-09-13T06:40:17.019 INFO:teuthology.orchestra.run.smithi081.stdout:1780 read 0x117e7dc thru 0x118798f (0x91b4 bytes) 2024-09-13T06:40:17.019 INFO:teuthology.orchestra.run.smithi081.stdout:1782 punch from 0x1ea742a to 0x1eae040, (0x6c16 bytes) 2024-09-13T06:40:17.019 INFO:teuthology.orchestra.run.smithi081.stdout:1783 read 0x5b3c734 thru 0x5b49317 (0xcbe4 bytes) 2024-09-13T06:40:17.019 INFO:teuthology.orchestra.run.smithi081.stdout:1784 writesame 0xc3c1d40 thru 0xc3d019b data_size 0x9e(0xe45c bytes) 2024-09-13T06:40:17.019 INFO:teuthology.orchestra.run.smithi081.stdout:1785 read 0x5ae1faf thru 0x5ae7ee5 (0x5f37 bytes) 2024-09-13T06:40:17.019 INFO:teuthology.orchestra.run.smithi081.stdout:1786 read 0x46d3697 thru 0x46d985e (0x61c8 bytes) 2024-09-13T06:40:17.019 INFO:teuthology.orchestra.run.smithi081.stdout:1787 trunc from 0xc3d019c to 0x86b62ba 2024-09-13T06:40:17.019 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:40:17.019 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:40:17.019 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:40:17.013+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:40:17.020 INFO:teuthology.orchestra.run.smithi081.stdout:1790 trunc from 0x86b62ba to 0x704079 2024-09-13T06:40:17.054 INFO:teuthology.orchestra.run.smithi081.stdout:1792 trunc from 0x704079 to 0x70c8231 2024-09-13T06:40:17.065 INFO:teuthology.orchestra.run.smithi081.stdout:1794 read 0x5db80f9 thru 0x5dc0668 (0x8570 bytes) 2024-09-13T06:40:17.066 INFO:teuthology.orchestra.run.smithi081.stdout:1795 write 0x36a6710 thru 0x36b43d4 (0xdcc5 bytes) 2024-09-13T06:40:17.072 INFO:teuthology.orchestra.run.smithi081.stdout:1796 punch from 0x1eb4e05 to 0x1ec3b21, (0xed1c bytes) 2024-09-13T06:40:17.072 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:40:17.072 INFO:teuthology.orchestra.run.smithi081.stdout:1798 write 0x3e07702 thru 0x3e0d1a2 (0x5aa1 bytes) 2024-09-13T06:40:17.101 INFO:teuthology.orchestra.run.smithi081.stdout:1799 write 0xd55ee1e thru 0xd563906 (0x4ae9 bytes) 2024-09-13T06:40:17.107 INFO:teuthology.orchestra.run.smithi081.stdout:1801 read 0x5a929a6 thru 0x5a9fe1a (0xd475 bytes) 2024-09-13T06:40:17.108 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:40:17.108 INFO:teuthology.orchestra.run.smithi081.stdout:1803 read 0x3830062 thru 0x3839a14 (0x99b3 bytes) 2024-09-13T06:40:17.108 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:40:17.108 INFO:teuthology.orchestra.run.smithi081.stdout:1805 read 0x18ff8c3 thru 0x190bebf (0xc5fd bytes) 2024-09-13T06:40:17.116 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:40:17.115+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:40:17.120 INFO:teuthology.orchestra.run.smithi081.stdout:1806 writesame 0xd9a7b59 thru 0xd9a8117 data_size 0x1(0x5bf bytes) 2024-09-13T06:40:17.121 INFO:teuthology.orchestra.run.smithi081.stdout:1807 write 0x590e05f thru 0x5918e96 (0xae38 bytes) 2024-09-13T06:40:17.127 INFO:teuthology.orchestra.run.smithi081.stdout:1808 read 0xae277b thru 0xae706a (0x48f0 bytes) 2024-09-13T06:40:17.127 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:40:17.146 INFO:teuthology.orchestra.run.smithi081.stdout:1810 trunc from 0xd9a8118 to 0x2046489 2024-09-13T06:40:17.166 INFO:teuthology.orchestra.run.smithi081.stdout:osd.0: {} 2024-09-13T06:40:17.166 INFO:teuthology.orchestra.run.smithi081.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-13T06:40:17.170 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:40:17.170 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:40:17.183 INFO:teuthology.orchestra.run.smithi081.stdout:1811 writesame 0x539096e thru 0x539d8aa data_size 0xd(0xcf3d bytes) 2024-09-13T06:40:17.183 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:40:17.184 INFO:teuthology.orchestra.run.smithi081.stdout:osd.1: {} 2024-09-13T06:40:17.184 INFO:teuthology.orchestra.run.smithi081.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-13T06:40:17.186 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-13T06:40:17.196 INFO:teuthology.orchestra.run.smithi081.stdout:1814 trunc from 0x539d8ab to 0xe291bf9 2024-09-13T06:40:17.201 INFO:teuthology.orchestra.run.smithi081.stdout:osd.2: {} 2024-09-13T06:40:17.202 INFO:teuthology.orchestra.run.smithi081.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-13T06:40:17.207 INFO:teuthology.orchestra.run.smithi081.stdout:1815 write 0x2ffd3f4 thru 0x2ffe30c (0xf19 bytes) 2024-09-13T06:40:17.215 INFO:teuthology.orchestra.run.smithi081.stdout:1816 trunc from 0xe291bf9 to 0xbc5b775 2024-09-13T06:40:17.216 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:40:17.217+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:40:17.219 INFO:teuthology.orchestra.run.smithi081.stdout:osd.3: {} 2024-09-13T06:40:17.219 INFO:teuthology.orchestra.run.smithi081.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-13T06:40:17.226 INFO:teuthology.orchestra.run.smithi081.stdout:1817 write 0x4ee4233 thru 0x4ef22d6 (0xe0a4 bytes) 2024-09-13T06:40:17.240 INFO:teuthology.orchestra.run.smithi081.stdout:osd.4: {} 2024-09-13T06:40:17.240 INFO:teuthology.orchestra.run.smithi081.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-13T06:40:17.246 INFO:teuthology.orchestra.run.smithi081.stdout:1818 write 0xc1733c5 thru 0xc17778d (0x43c9 bytes) 2024-09-13T06:40:17.251 INFO:teuthology.orchestra.run.smithi081.stdout:1820 writesame 0x4fa5d56 thru 0x4fb0859 data_size 0x6e(0xab04 bytes) 2024-09-13T06:40:17.255 INFO:teuthology.orchestra.run.smithi081.stdout:1821 trunc from 0xc17778e to 0xbd85a41 2024-09-13T06:40:17.261 INFO:teuthology.orchestra.run.smithi081.stdout:osd.5: {} 2024-09-13T06:40:17.261 INFO:teuthology.orchestra.run.smithi081.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-13T06:40:17.273 INFO:teuthology.orchestra.run.smithi081.stdout:1823 write 0xbce3947 thru 0xbcf1629 (0xdce3 bytes) 2024-09-13T06:40:17.279 INFO:teuthology.orchestra.run.smithi081.stdout:1824 write 0x35c46ba thru 0x35d3db5 (0xf6fc bytes) 2024-09-13T06:40:17.282 INFO:teuthology.orchestra.run.smithi081.stdout:osd.6: {} 2024-09-13T06:40:17.283 INFO:teuthology.orchestra.run.smithi081.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-13T06:40:17.284 INFO:teuthology.orchestra.run.smithi081.stdout:1825 read 0x2c42450 thru 0x2c50011 (0xdbc2 bytes) 2024-09-13T06:40:17.284 INFO:teuthology.orchestra.run.smithi081.stdout:1826 write 0x4fc2bac thru 0x4fc7aef (0x4f44 bytes) 2024-09-13T06:40:17.289 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:40:17.289 INFO:teuthology.orchestra.run.smithi081.stdout:1829 read 0xea2dda thru 0xeb2848 (0xfa6f bytes) 2024-09-13T06:40:17.291 INFO:teuthology.orchestra.run.smithi081.stdout:1830 trunc from 0xbd85a41 to 0xd57f196 2024-09-13T06:40:17.302 INFO:teuthology.orchestra.run.smithi081.stdout:1831 punch from 0x82dcd8 to 0x83940f, (0xb737 bytes) 2024-09-13T06:40:17.302 INFO:teuthology.orchestra.run.smithi081.stdout:1832 write 0x9511d29 thru 0x951d2f8 (0xb5d0 bytes) 2024-09-13T06:40:17.304 INFO:teuthology.orchestra.run.smithi081.stdout:osd.7: {} 2024-09-13T06:40:17.304 INFO:teuthology.orchestra.run.smithi081.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-13T06:40:17.307 INFO:teuthology.orchestra.run.smithi081.stdout:1833 write 0x597cfb thru 0x59d3bf (0x56c5 bytes) 2024-09-13T06:40:17.311 INFO:teuthology.orchestra.run.smithi081.stdout:1834 write 0x9f7d67d thru 0x9f7ec8c (0x1610 bytes) 2024-09-13T06:40:17.316 INFO:teuthology.orchestra.run.smithi081.stdout:1835 write 0x869203a thru 0x86a0761 (0xe728 bytes) 2024-09-13T06:40:17.316 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:40:17.317 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:40:17.317 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:40:17.317+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:40:17.321 INFO:teuthology.orchestra.run.smithi081.stdout:1836 punch from 0xa47cfa7 to 0xa48a028, (0xd081 bytes) 2024-09-13T06:40:17.321 INFO:teuthology.orchestra.run.smithi081.stdout:1839 punch from 0x23be09a to 0x23c3251, (0x51b7 bytes) 2024-09-13T06:40:17.321 INFO:teuthology.orchestra.run.smithi081.stdout:1840 writesame 0x1b4388 thru 0x1b84cc data_size 0xb(0x4145 bytes) 2024-09-13T06:40:17.331 INFO:teuthology.orchestra.run.smithi081.stdout:1841 trunc from 0xd57f196 to 0x91ae0ed 2024-09-13T06:40:17.336 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-13T06:40:17.354 INFO:teuthology.orchestra.run.smithi081.stdout:1842 read 0x820c69a thru 0x821ba4f (0xf3b6 bytes) 2024-09-13T06:40:17.354 INFO:teuthology.orchestra.run.smithi081.stdout:1843 write 0x792e3c3 thru 0x7930643 (0x2281 bytes) 2024-09-13T06:40:17.360 INFO:teuthology.orchestra.run.smithi081.stdout:1844 read 0x49b49b9 thru 0x49b8463 (0x3aab bytes) 2024-09-13T06:40:17.360 INFO:teuthology.orchestra.run.smithi081.stdout:1845 writesame 0x28a2a89 thru 0x28aedce data_size 0x5(0xc346 bytes) 2024-09-13T06:40:17.369 INFO:teuthology.orchestra.run.smithi081.stdout:1847 read 0x5428680 thru 0x54330af (0xaa30 bytes) 2024-09-13T06:40:17.380 INFO:teuthology.orchestra.run.smithi081.stdout:1850 trunc from 0x91ae0ed to 0x1a38c83 2024-09-13T06:40:17.417 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:40:17.417+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:40:17.428 INFO:teuthology.orchestra.run.smithi081.stdout:1851 writesame 0x9bf7536 thru 0x9bf85a7 data_size 0x5(0x1072 bytes) 2024-09-13T06:40:17.429 INFO:teuthology.orchestra.run.smithi081.stdout:1853 read 0x1c507a3 thru 0x1c58400 (0x7c5e bytes) 2024-09-13T06:40:17.429 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:40:17.429 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:40:17.429 INFO:teuthology.orchestra.run.smithi081.stdout:1856 read 0x75b2f5 thru 0x76714d (0xbe59 bytes) 2024-09-13T06:40:17.429 INFO:teuthology.orchestra.run.smithi081.stdout:1857 trunc from 0x9bf85a8 to 0x91b5dde 2024-09-13T06:40:17.448 INFO:teuthology.orchestra.run.smithi081.stderr:set 3.1a pg_upmap mapping to [2,6] 2024-09-13T06:40:17.448 INFO:teuthology.orchestra.run.smithi081.stderr:nodeep-scrub is set 2024-09-13T06:40:17.483 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:40:17.483 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:40:17.498 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-13T06:40:17.518 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:40:17.519+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:40:17.620 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-13T06:40:17.623+0000 7f86a5f06640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26387) UID: 0 2024-09-13T06:40:17.658 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:40:17.658 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:40:17.673 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-13T06:40:17.720 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:40:17.719+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:40:17.786 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:40:17.786 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:40:17.799 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-13T06:40:17.848 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:40:17.849+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:40:17.921 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-13T06:40:17.923+0000 7f86a5f06640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26387) UID: 0 2024-09-13T06:40:17.922 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:40:17.922 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:40:17.935 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-13T06:40:18.024 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:40:18.025+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:40:18.099 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:40:18.099 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:40:18.111 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-13T06:40:18.156 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:40:18.157+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:40:18.223 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:40:18.221+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:40:18.273 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:40:18.273 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:40:18.287 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-13T06:40:18.328 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:40:18.329+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:40:18.425 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:40:18.425+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:40:18.452 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:40:18.453 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:40:18.471 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-13T06:40:18.556 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:40:18.557+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:40:18.627 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:40:18.627+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:40:18.627 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:40:18.627 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:40:18.640 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-13T06:40:18.728 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:40:18.729+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:40:18.806 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:40:18.806 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:40:18.821 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-13T06:40:18.829 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-13T06:40:18.827+0000 7f86a5f06640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26387) UID: 0 2024-09-13T06:40:18.929 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:40:18.929+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:40:18.985 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:40:18.985 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:40:19.001 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-13T06:40:19.002 INFO:teuthology.orchestra.run.smithi081.stdout:1858 write 0xc131659 thru 0xc13662e (0x4fd6 bytes) 2024-09-13T06:40:19.008 INFO:teuthology.orchestra.run.smithi081.stdout:1861 read 0xaad0831 thru 0xaad97d0 (0x8fa0 bytes) 2024-09-13T06:40:19.008 INFO:teuthology.orchestra.run.smithi081.stdout:1862 write 0x8fe6d6 thru 0x908095 (0x99c0 bytes) 2024-09-13T06:40:19.014 INFO:teuthology.orchestra.run.smithi081.stdout:1864 read 0xb98e5f4 thru 0xb99c947 (0xe354 bytes) 2024-09-13T06:40:19.014 INFO:teuthology.orchestra.run.smithi081.stdout:1865 read 0x9e1ca7b thru 0x9e28693 (0xbc19 bytes) 2024-09-13T06:40:19.014 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:40:19.014 INFO:teuthology.orchestra.run.smithi081.stdout:1867 read 0xaaf9382 thru 0xaafa1b5 (0xe34 bytes) 2024-09-13T06:40:19.022 INFO:teuthology.orchestra.run.smithi081.stdout:1868 writesame 0xc198b83 thru 0xc19ba9a data_size 0x2c(0x2f18 bytes) 2024-09-13T06:40:19.023 INFO:teuthology.orchestra.run.smithi081.stdout:1870 punch from 0xb6712e8 to 0xb679e28, (0x8b40 bytes) 2024-09-13T06:40:19.023 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:40:19.023 INFO:teuthology.orchestra.run.smithi081.stdout:1873 read 0x73faa47 thru 0x73fd1e1 (0x279b bytes) 2024-09-13T06:40:19.023 INFO:teuthology.orchestra.run.smithi081.stdout:1877 write 0x9e7d54 thru 0x9ee38c (0x6639 bytes) 2024-09-13T06:40:19.030 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:40:19.029+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:40:19.038 INFO:teuthology.orchestra.run.smithi081.stdout:1878 trunc from 0xc19ba9b to 0x77448dc 2024-09-13T06:40:19.060 INFO:teuthology.orchestra.run.smithi081.stdout:1879 read 0x57ba5c4 thru 0x57bd20c (0x2c49 bytes) 2024-09-13T06:40:19.060 INFO:teuthology.orchestra.run.smithi081.stdout:1880 read 0x2a46e1d thru 0x2a47595 (0x779 bytes) 2024-09-13T06:40:19.077 INFO:teuthology.orchestra.run.smithi081.stdout:1881 write 0xa481f1a thru 0xa48939c (0x7483 bytes) 2024-09-13T06:40:19.084 INFO:teuthology.orchestra.run.smithi081.stdout:1882 writesame 0x40091f3 thru 0x4016f1c data_size 0x1(0xdd2a bytes) 2024-09-13T06:40:19.131 INFO:tasks.ceph.osd.6.smithi139.stderr:2024-09-13T06:40:19.131+0000 7fcd02c5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26385) UID: 0 2024-09-13T06:40:19.135 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:40:19.135 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:40:19.149 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-13T06:40:19.152 INFO:teuthology.orchestra.run.smithi081.stdout:1884 read 0x5489821 thru 0x548efed (0x57cd bytes) 2024-09-13T06:40:19.152 INFO:teuthology.orchestra.run.smithi081.stdout:1885 read 0x205c496 thru 0x2067088 (0xabf3 bytes) 2024-09-13T06:40:19.152 INFO:teuthology.orchestra.run.smithi081.stdout:1886 punch from 0x95f2b1d to 0x96008a4, (0xdd87 bytes) 2024-09-13T06:40:19.152 INFO:teuthology.orchestra.run.smithi081.stdout:1888 read 0x7354390 thru 0x73614a5 (0xd116 bytes) 2024-09-13T06:40:19.152 INFO:teuthology.orchestra.run.smithi081.stdout:1889 punch from 0x4d8a17c to 0x4d999c8, (0xf84c bytes) 2024-09-13T06:40:19.152 INFO:teuthology.orchestra.run.smithi081.stdout:1890 punch from 0x3672e53 to 0x367896b, (0x5b18 bytes) 2024-09-13T06:40:19.152 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:40:19.152 INFO:teuthology.orchestra.run.smithi081.stdout:1892 read 0x447c3a8 thru 0x448a633 (0xe28c bytes) 2024-09-13T06:40:19.152 INFO:teuthology.orchestra.run.smithi081.stdout:1894 punch from 0x5c220c6 to 0x5c22bcb, (0xb05 bytes) 2024-09-13T06:40:19.153 INFO:teuthology.orchestra.run.smithi081.stdout:1896 punch from 0x2e57ab5 to 0x2e653eb, (0xd936 bytes) 2024-09-13T06:40:19.169 INFO:teuthology.orchestra.run.smithi081.stdout:1897 trunc from 0xa48939d to 0x4f70bd 2024-09-13T06:40:19.203 INFO:teuthology.orchestra.run.smithi081.stdout:1898 write 0x1a334b6 thru 0x1a3679a (0x32e5 bytes) 2024-09-13T06:40:19.238 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:40:19.239+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:40:19.246 INFO:teuthology.orchestra.run.smithi081.stdout:1899 writesame 0xc9b5604 thru 0xc9c3aa5 data_size 0x3(0xe4a2 bytes) 2024-09-13T06:40:19.260 INFO:teuthology.orchestra.run.smithi081.stdout:1900 trunc from 0xc9c3aa6 to 0x629575d 2024-09-13T06:40:19.290 INFO:teuthology.orchestra.run.smithi081.stdout:1902 write 0x80796de thru 0x808614b (0xca6e bytes) 2024-09-13T06:40:19.312 INFO:teuthology.orchestra.run.smithi081.stdout:1903 trunc from 0x808614c to 0x1efc289 2024-09-13T06:40:19.323 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:40:19.323 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:40:19.324 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-13T06:40:19.331 INFO:teuthology.orchestra.run.smithi081.stdout:1904 read 0x168c7c1 thru 0x169424a (0x7a8a bytes) 2024-09-13T06:40:19.332 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:40:19.333 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-13T06:40:19.331+0000 7f86a5f06640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26387) UID: 0 2024-09-13T06:40:19.338 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-13T06:40:19.368 INFO:teuthology.orchestra.run.smithi081.stdout:1908 write 0xda53ca3 thru 0xda61d44 (0xe0a2 bytes) 2024-09-13T06:40:19.373 INFO:teuthology.orchestra.run.smithi081.stdout:1909 writesame 0x4d53766 thru 0x4d61c9a data_size 0x1(0xe535 bytes) 2024-09-13T06:40:19.410 INFO:teuthology.orchestra.run.smithi081.stdout:1910 read 0x6e713f0 thru 0x6e78d55 (0x7966 bytes) 2024-09-13T06:40:19.410 INFO:teuthology.orchestra.run.smithi081.stdout:1913 punch from 0xa9b91b6 to 0xa9ba76d, (0x15b7 bytes) 2024-09-13T06:40:19.411 INFO:teuthology.orchestra.run.smithi081.stdout:1916 write 0xa0c1f7d thru 0xa0ccd10 (0xad94 bytes) 2024-09-13T06:40:19.415 INFO:teuthology.orchestra.run.smithi081.stdout:1917 write 0xa1ea388 thru 0xa1f9fd3 (0xfc4c bytes) 2024-09-13T06:40:19.419 INFO:teuthology.orchestra.run.smithi081.stdout:1920 write 0xa186fc0 thru 0xa187741 (0x782 bytes) 2024-09-13T06:40:19.421 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:40:19.421 INFO:teuthology.orchestra.run.smithi081.stdout:1923 punch from 0x3e0e63a to 0x3e1a889, (0xc24f bytes) 2024-09-13T06:40:19.421 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:40:19.422 INFO:teuthology.orchestra.run.smithi081.stdout:1925 write 0x384356e thru 0x384513e (0x1bd1 bytes) 2024-09-13T06:40:19.425 INFO:teuthology.orchestra.run.smithi081.stdout:1926 write 0x1fbe3fa thru 0x1fc30ba (0x4cc1 bytes) 2024-09-13T06:40:19.432 INFO:teuthology.orchestra.run.smithi081.stdout:1927 write 0x3f44adc thru 0x3f48fad (0x44d2 bytes) 2024-09-13T06:40:19.433 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-13T06:40:19.435+0000 7f86a5f06640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26387) UID: 0 2024-09-13T06:40:19.436 INFO:teuthology.orchestra.run.smithi081.stdout:1928 writesame 0x928221f thru 0x92833eb data_size 0x1f(0x11cd bytes) 2024-09-13T06:40:19.441 INFO:teuthology.orchestra.run.smithi081.stdout:1929 write 0xc5d39ac thru 0xc5da6f0 (0x6d45 bytes) 2024-09-13T06:40:19.445 INFO:teuthology.orchestra.run.smithi081.stdout:1930 read 0x337a7aa thru 0x3385548 (0xad9f bytes) 2024-09-13T06:40:19.445 INFO:teuthology.orchestra.run.smithi081.stdout:1931 read 0xd7cb167 thru 0xd7d48a5 (0x973f bytes) 2024-09-13T06:40:19.446 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:40:19.446 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:40:19.446 INFO:teuthology.orchestra.run.smithi081.stdout:1934 write 0x21318c4 thru 0x213d2b2 (0xb9ef bytes) 2024-09-13T06:40:19.450 INFO:teuthology.orchestra.run.smithi081.stdout:1938 write 0xcd9e6ce thru 0xcda06ac (0x1fdf bytes) 2024-09-13T06:40:19.459 INFO:teuthology.orchestra.run.smithi081.stdout:1939 trunc from 0xda61d45 to 0xb916fbd 2024-09-13T06:40:19.472 INFO:teuthology.orchestra.run.smithi081.stdout:1940 punch from 0x8b54db4 to 0x8b5f5ea, (0xa836 bytes) 2024-09-13T06:40:19.472 INFO:teuthology.orchestra.run.smithi081.stdout:1941 write 0x53e327b thru 0x53ec263 (0x8fe9 bytes) 2024-09-13T06:40:19.476 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:40:19.476 INFO:teuthology.orchestra.run.smithi081.stdout:1943 write 0xb39f15b thru 0xb3aa5fa (0xb4a0 bytes) 2024-09-13T06:40:19.481 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-13T06:40:19.494 INFO:teuthology.orchestra.run.smithi081.stdout:osd.0: {} 2024-09-13T06:40:19.494 INFO:teuthology.orchestra.run.smithi081.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-13T06:40:19.496 INFO:teuthology.orchestra.run.smithi081.stdout:1946 trunc from 0xb916fbd to 0x11f2d0d 2024-09-13T06:40:19.515 INFO:teuthology.orchestra.run.smithi081.stdout:osd.1: {} 2024-09-13T06:40:19.515 INFO:teuthology.orchestra.run.smithi081.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-13T06:40:19.515 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:40:19.515 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:40:19.529 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-13T06:40:19.530 INFO:teuthology.orchestra.run.smithi081.stdout:1947 trunc from 0x11f2d0d to 0xe45e1dd 2024-09-13T06:40:19.532 INFO:teuthology.orchestra.run.smithi081.stdout:osd.2: {} 2024-09-13T06:40:19.532 INFO:teuthology.orchestra.run.smithi081.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-13T06:40:19.537 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:40:19.537 INFO:teuthology.orchestra.run.smithi081.stdout:1949 punch from 0xcda1f70 to 0xcda7045, (0x50d5 bytes) 2024-09-13T06:40:19.537 INFO:teuthology.orchestra.run.smithi081.stdout:1950 punch from 0x9337f74 to 0x934593b, (0xd9c7 bytes) 2024-09-13T06:40:19.537 INFO:teuthology.orchestra.run.smithi081.stdout:1952 punch from 0xae749bc to 0xae801de, (0xb822 bytes) 2024-09-13T06:40:19.551 INFO:teuthology.orchestra.run.smithi081.stdout:1953 trunc from 0xe45e1dd to 0x46a86c7 2024-09-13T06:40:19.551 INFO:teuthology.orchestra.run.smithi081.stdout:osd.3: {} 2024-09-13T06:40:19.551 INFO:teuthology.orchestra.run.smithi081.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-13T06:40:19.571 INFO:teuthology.orchestra.run.smithi081.stdout:osd.4: {} 2024-09-13T06:40:19.571 INFO:teuthology.orchestra.run.smithi081.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-13T06:40:19.572 INFO:teuthology.orchestra.run.smithi081.stdout:1954 trunc from 0x46a86c7 to 0xdfb9e16 2024-09-13T06:40:19.574 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-13T06:40:19.575+0000 7f86a5f06640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26387) UID: 0 2024-09-13T06:40:19.579 INFO:teuthology.orchestra.run.smithi081.stdout:1955 write 0x85fc68 thru 0x864799 (0x4b32 bytes) 2024-09-13T06:40:19.584 INFO:teuthology.orchestra.run.smithi081.stdout:1956 read 0x5960a52 thru 0x5961c26 (0x11d5 bytes) 2024-09-13T06:40:19.584 INFO:teuthology.orchestra.run.smithi081.stdout:1957 clone 10 order 19 su 2048 sc 7 2024-09-13T06:40:19.593 INFO:teuthology.orchestra.run.smithi081.stdout:osd.5: {} 2024-09-13T06:40:19.593 INFO:teuthology.orchestra.run.smithi081.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-13T06:40:19.610 INFO:teuthology.orchestra.run.smithi081.stdout:osd.6: {} 2024-09-13T06:40:19.610 INFO:teuthology.orchestra.run.smithi081.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-13T06:40:19.631 INFO:teuthology.orchestra.run.smithi081.stdout:osd.7: {} 2024-09-13T06:40:19.631 INFO:teuthology.orchestra.run.smithi081.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-13T06:40:19.635 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:40:19.633+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:40:19.696 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:40:19.697 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [], 2024-09-13T06:40:19.697 INFO:teuthology.orchestra.run.smithi139.stdout: "num_ops": 0 2024-09-13T06:40:19.697 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:40:19.710 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-13T06:40:19.736 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:40:19.733+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:40:19.826 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:40:19.826 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [], 2024-09-13T06:40:19.826 INFO:teuthology.orchestra.run.smithi139.stdout: "complaint_time": 30, 2024-09-13T06:40:19.826 INFO:teuthology.orchestra.run.smithi139.stdout: "num_blocked_ops": 0 2024-09-13T06:40:19.826 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:40:19.837 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:40:19.835+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:40:19.840 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-13T06:40:19.938 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:40:19.937+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:40:20.001 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:40:20.001 INFO:teuthology.orchestra.run.smithi139.stdout: "size": 20, 2024-09-13T06:40:20.001 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 600, 2024-09-13T06:40:20.001 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [ 2024-09-13T06:40:20.001 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.001 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:25885 3.1c 3:3da1e1c6:::rbd_data.1121f2c5ee81.0000000000000007:13 [read 212992~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:20.001 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.424640+0000", 2024-09-13T06:40:20.001 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 23.578010375000002, 2024-09-13T06:40:20.001 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.040449289999999999, 2024-09-13T06:40:20.001 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:20.001 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:20.002 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:20.002 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:20.002 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:20.002 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 25885 2024-09-13T06:40:20.002 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.002 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:20.002 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.002 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:20.002 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.424640+0000", 2024-09-13T06:40:20.002 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:20.002 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.002 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.003 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:20.003 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.424640+0000", 2024-09-13T06:40:20.003 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:20.003 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.003 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.003 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:20.003 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.424640+0000", 2024-09-13T06:40:20.003 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:20.003 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.003 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.003 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:20.003 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.424643+0000", 2024-09-13T06:40:20.003 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.19e-06 2024-09-13T06:40:20.003 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.004 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.004 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:20.004 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.424650+0000", 2024-09-13T06:40:20.004 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.1189999999999999e-06 2024-09-13T06:40:20.004 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.004 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.004 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:20.004 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.424656+0000", 2024-09-13T06:40:20.004 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.7780000000000004e-06 2024-09-13T06:40:20.004 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.004 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.004 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:20.004 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.464699+0000", 2024-09-13T06:40:20.005 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.040043792000000002 2024-09-13T06:40:20.005 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.005 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.005 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:20.005 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.464800+0000", 2024-09-13T06:40:20.005 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000100278 2024-09-13T06:40:20.005 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.005 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.005 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:20.005 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.465089+0000", 2024-09-13T06:40:20.005 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00028969800000000002 2024-09-13T06:40:20.005 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:20.005 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:20.006 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:20.006 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.006 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.006 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:25886 3.1c 3:3da1e1c6:::rbd_data.1121f2c5ee81.0000000000000007:13 [read 237568~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:20.006 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.424661+0000", 2024-09-13T06:40:20.006 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 23.577990011000001, 2024-09-13T06:40:20.006 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.040784316000000001, 2024-09-13T06:40:20.006 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:20.006 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:20.006 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:20.006 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:20.006 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:20.006 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 25886 2024-09-13T06:40:20.007 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.007 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:20.007 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.007 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:20.007 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.424661+0000", 2024-09-13T06:40:20.007 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:20.007 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.007 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.007 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:20.007 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.424661+0000", 2024-09-13T06:40:20.007 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:20.007 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.007 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.007 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:20.008 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.424660+0000", 2024-09-13T06:40:20.008 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:20.008 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.008 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.008 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:20.008 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.424672+0000", 2024-09-13T06:40:20.008 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1578e-05 2024-09-13T06:40:20.008 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.008 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.008 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:20.008 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.424680+0000", 2024-09-13T06:40:20.008 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.9489999999999996e-06 2024-09-13T06:40:20.008 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.009 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.009 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:20.009 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.424689+0000", 2024-09-13T06:40:20.009 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.0790000000000007e-06 2024-09-13T06:40:20.009 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.009 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.009 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:20.009 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.465128+0000", 2024-09-13T06:40:20.009 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.040438922000000002 2024-09-13T06:40:20.009 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.009 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.009 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:20.009 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.465210+0000", 2024-09-13T06:40:20.010 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.2853000000000001e-05 2024-09-13T06:40:20.010 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.010 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.010 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:20.010 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.465445+0000", 2024-09-13T06:40:20.010 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000234453 2024-09-13T06:40:20.010 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:20.010 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:20.010 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:20.010 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.010 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.010 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:25887 3.1c 3:3da1e1c6:::rbd_data.1121f2c5ee81.0000000000000007:13 [read 307200~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:20.010 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.425137+0000", 2024-09-13T06:40:20.011 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 23.57751369, 2024-09-13T06:40:20.011 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.040764531, 2024-09-13T06:40:20.011 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:20.011 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:20.011 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:20.011 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:20.011 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:20.011 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 25887 2024-09-13T06:40:20.011 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.011 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:20.011 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.011 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:20.011 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.425137+0000", 2024-09-13T06:40:20.011 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:20.012 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.012 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.012 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:20.012 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.425137+0000", 2024-09-13T06:40:20.012 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:20.012 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.012 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.012 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:20.012 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.425135+0000", 2024-09-13T06:40:20.012 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999986 2024-09-13T06:40:20.012 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.012 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.012 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:20.013 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.425160+0000", 2024-09-13T06:40:20.013 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.4423999999999999e-05 2024-09-13T06:40:20.013 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.013 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.013 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:20.013 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.425186+0000", 2024-09-13T06:40:20.013 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.6329000000000002e-05 2024-09-13T06:40:20.013 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.013 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.013 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:20.013 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.425201+0000", 2024-09-13T06:40:20.013 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5048000000000001e-05 2024-09-13T06:40:20.013 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.014 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.014 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:20.014 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.465483+0000", 2024-09-13T06:40:20.014 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.040281381999999998 2024-09-13T06:40:20.014 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.014 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.014 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:20.014 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.465575+0000", 2024-09-13T06:40:20.014 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.2794000000000006e-05 2024-09-13T06:40:20.014 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.014 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.014 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:20.014 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.465901+0000", 2024-09-13T06:40:20.014 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00032604900000000002 2024-09-13T06:40:20.015 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:20.015 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:20.015 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:20.015 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.015 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.015 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:25888 3.1c 3:3da1e1c6:::rbd_data.1121f2c5ee81.0000000000000007:13 [read 331776~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:20.015 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.425217+0000", 2024-09-13T06:40:20.015 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 23.577433943999999, 2024-09-13T06:40:20.015 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.041115250999999998, 2024-09-13T06:40:20.015 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:20.015 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:20.015 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:20.015 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:20.016 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:20.016 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 25888 2024-09-13T06:40:20.016 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.016 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:20.016 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.016 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:20.016 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.425217+0000", 2024-09-13T06:40:20.016 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:20.016 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.016 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.016 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:20.016 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.425217+0000", 2024-09-13T06:40:20.016 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:20.017 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.017 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.017 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:20.017 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.425215+0000", 2024-09-13T06:40:20.017 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:20.017 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.017 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.017 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:20.017 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.425222+0000", 2024-09-13T06:40:20.017 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.5830000000000003e-06 2024-09-13T06:40:20.017 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.017 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.017 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:20.017 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.425240+0000", 2024-09-13T06:40:20.018 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7914000000000002e-05 2024-09-13T06:40:20.018 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.018 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.018 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:20.018 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.425252+0000", 2024-09-13T06:40:20.018 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2170999999999999e-05 2024-09-13T06:40:20.018 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.018 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.018 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:20.018 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.465947+0000", 2024-09-13T06:40:20.018 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.040694755999999999 2024-09-13T06:40:20.018 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.018 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.019 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:20.019 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.466065+0000", 2024-09-13T06:40:20.019 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000117669 2024-09-13T06:40:20.019 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.019 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.019 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:20.019 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.466332+0000", 2024-09-13T06:40:20.019 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00026730500000000002 2024-09-13T06:40:20.019 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:20.019 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:20.019 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:20.019 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.019 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.019 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:25889 3.1c 3:3da1e1c6:::rbd_data.1121f2c5ee81.0000000000000007:13 [read 376832~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:20.020 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.425262+0000", 2024-09-13T06:40:20.020 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 23.577388032000002, 2024-09-13T06:40:20.020 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.041487885000000002, 2024-09-13T06:40:20.020 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:20.020 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:20.020 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:20.020 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:20.020 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:20.020 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 25889 2024-09-13T06:40:20.020 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.020 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:20.020 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.021 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:20.021 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.425262+0000", 2024-09-13T06:40:20.021 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:20.021 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.021 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.021 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:20.021 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.425262+0000", 2024-09-13T06:40:20.021 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:20.021 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.021 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.021 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:20.021 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.425262+0000", 2024-09-13T06:40:20.021 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:20.022 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.022 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.022 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:20.022 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.425267+0000", 2024-09-13T06:40:20.022 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.587e-06 2024-09-13T06:40:20.022 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.022 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.022 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:20.022 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.425284+0000", 2024-09-13T06:40:20.022 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6858999999999999e-05 2024-09-13T06:40:20.022 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.022 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.022 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:20.023 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.425295+0000", 2024-09-13T06:40:20.023 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1238e-05 2024-09-13T06:40:20.023 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.023 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.023 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:20.023 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.466371+0000", 2024-09-13T06:40:20.023 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.041075381000000001 2024-09-13T06:40:20.023 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.023 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.023 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:20.023 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.466479+0000", 2024-09-13T06:40:20.023 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000108026 2024-09-13T06:40:20.023 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.023 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.024 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:20.024 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.466750+0000", 2024-09-13T06:40:20.024 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00027173200000000001 2024-09-13T06:40:20.024 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:20.024 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:20.024 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:20.024 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.024 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.024 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:25890 3.1c 3:3da1e1c6:::rbd_data.1121f2c5ee81.0000000000000007:13 [read 401408~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:20.024 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.425305+0000", 2024-09-13T06:40:20.024 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 23.5773455, 2024-09-13T06:40:20.024 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.041642419999999999, 2024-09-13T06:40:20.025 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:20.025 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:20.025 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:20.025 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:20.025 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:20.025 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 25890 2024-09-13T06:40:20.025 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.025 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:20.025 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.025 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:20.025 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.425305+0000", 2024-09-13T06:40:20.025 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:20.025 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.026 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.026 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:20.026 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.425305+0000", 2024-09-13T06:40:20.026 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:20.026 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.026 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.026 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:20.026 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.425304+0000", 2024-09-13T06:40:20.026 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:20.026 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.026 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.026 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:20.026 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.425309+0000", 2024-09-13T06:40:20.026 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.0640000000000001e-06 2024-09-13T06:40:20.027 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.027 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.027 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:20.027 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.425326+0000", 2024-09-13T06:40:20.027 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6855e-05 2024-09-13T06:40:20.027 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.027 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.027 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:20.027 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.425346+0000", 2024-09-13T06:40:20.027 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.0387999999999999e-05 2024-09-13T06:40:20.027 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.027 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.027 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:20.028 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.466796+0000", 2024-09-13T06:40:20.028 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.041449062000000002 2024-09-13T06:40:20.028 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.028 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.028 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:20.028 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.466859+0000", 2024-09-13T06:40:20.028 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.3682000000000005e-05 2024-09-13T06:40:20.028 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.028 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.028 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:20.028 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.466947+0000", 2024-09-13T06:40:20.028 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.8220999999999994e-05 2024-09-13T06:40:20.028 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:20.029 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:20.029 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:20.029 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.029 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.029 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:25891 3.1c 3:3da1e1c6:::rbd_data.1121f2c5ee81.0000000000000007:13 [read 471040~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:20.029 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.425357+0000", 2024-09-13T06:40:20.029 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 23.57729363, 2024-09-13T06:40:20.029 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.042016413000000002, 2024-09-13T06:40:20.029 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:20.029 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:20.029 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:20.029 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:20.030 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:20.030 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 25891 2024-09-13T06:40:20.030 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.030 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:20.030 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.030 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:20.030 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.425357+0000", 2024-09-13T06:40:20.030 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:20.030 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.031 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.031 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:20.031 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.425357+0000", 2024-09-13T06:40:20.031 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:20.031 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.031 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.031 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:20.031 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.425356+0000", 2024-09-13T06:40:20.031 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:20.031 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.031 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.031 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:20.032 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.425361+0000", 2024-09-13T06:40:20.032 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.2340000000000002e-06 2024-09-13T06:40:20.032 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.032 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.032 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:20.032 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.425377+0000", 2024-09-13T06:40:20.032 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6087e-05 2024-09-13T06:40:20.032 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.032 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.032 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:20.032 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.425391+0000", 2024-09-13T06:40:20.033 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3580999999999999e-05 2024-09-13T06:40:20.033 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.033 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.033 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:20.033 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.466995+0000", 2024-09-13T06:40:20.033 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.041604527000000002 2024-09-13T06:40:20.033 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.033 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.033 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:20.034 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.467100+0000", 2024-09-13T06:40:20.034 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00010417299999999999 2024-09-13T06:40:20.034 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.034 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.034 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:20.034 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.467373+0000", 2024-09-13T06:40:20.034 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00027376800000000003 2024-09-13T06:40:20.034 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:20.034 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:20.034 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:20.034 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.034 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.034 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:25892 3.1c 3:3da1e1c6:::rbd_data.1121f2c5ee81.0000000000000007:13 [read 495616~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:20.035 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.425401+0000", 2024-09-13T06:40:20.035 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 23.577249579, 2024-09-13T06:40:20.035 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.042422195000000003, 2024-09-13T06:40:20.035 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:20.035 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:20.035 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:20.035 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:20.035 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:20.035 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 25892 2024-09-13T06:40:20.035 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.035 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:20.035 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.035 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:20.036 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.425401+0000", 2024-09-13T06:40:20.036 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:20.036 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.036 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.036 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:20.036 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.425401+0000", 2024-09-13T06:40:20.036 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:20.036 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.036 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.036 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:20.036 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.425400+0000", 2024-09-13T06:40:20.036 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:20.036 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.037 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.037 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:20.037 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.425405+0000", 2024-09-13T06:40:20.037 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.4389999999999999e-06 2024-09-13T06:40:20.037 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.037 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.037 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:20.037 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.425419+0000", 2024-09-13T06:40:20.037 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3593e-05 2024-09-13T06:40:20.037 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.037 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.037 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:20.038 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.425430+0000", 2024-09-13T06:40:20.038 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0774999999999999e-05 2024-09-13T06:40:20.038 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.038 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.038 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:20.038 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.467438+0000", 2024-09-13T06:40:20.038 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.042008570000000002 2024-09-13T06:40:20.038 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.038 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.038 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:20.038 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.467531+0000", 2024-09-13T06:40:20.038 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.2857999999999998e-05 2024-09-13T06:40:20.038 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.038 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.039 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:20.039 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.467823+0000", 2024-09-13T06:40:20.039 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000291945 2024-09-13T06:40:20.039 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:20.039 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:20.039 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:20.039 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.039 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.039 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:26021 3.c 3:3566b607:::rbd_data.1121f2c5ee81.0000000000000012:13 [read 225280~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:20.039 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.429042+0000", 2024-09-13T06:40:20.039 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 23.573608568000001, 2024-09-13T06:40:20.039 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.040384481, 2024-09-13T06:40:20.040 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:20.040 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:20.040 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:20.040 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:20.040 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:20.040 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 26021 2024-09-13T06:40:20.040 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.040 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:20.040 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.040 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:20.040 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.429042+0000", 2024-09-13T06:40:20.040 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:20.040 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.040 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.041 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:20.041 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.429042+0000", 2024-09-13T06:40:20.041 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:20.041 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.041 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.041 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:20.041 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.429041+0000", 2024-09-13T06:40:20.041 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:20.041 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.041 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.041 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:20.041 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.429046+0000", 2024-09-13T06:40:20.041 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.6600000000000003e-06 2024-09-13T06:40:20.042 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.042 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.042 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:20.042 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.429060+0000", 2024-09-13T06:40:20.042 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3747000000000001e-05 2024-09-13T06:40:20.042 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.042 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.042 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:20.042 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.429069+0000", 2024-09-13T06:40:20.042 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.5659999999999996e-06 2024-09-13T06:40:20.042 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.042 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.042 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:20.042 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.469091+0000", 2024-09-13T06:40:20.043 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.040021811999999997 2024-09-13T06:40:20.043 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.043 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.043 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:20.043 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.469170+0000", 2024-09-13T06:40:20.043 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.9498000000000004e-05 2024-09-13T06:40:20.043 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.043 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.043 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:20.043 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.469426+0000", 2024-09-13T06:40:20.043 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00025596800000000003 2024-09-13T06:40:20.043 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:20.043 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:20.044 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:20.044 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.044 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.044 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:26022 3.c 3:3566b607:::rbd_data.1121f2c5ee81.0000000000000012:13 [read 249856~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:20.044 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.429079+0000", 2024-09-13T06:40:20.044 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 23.573571976, 2024-09-13T06:40:20.044 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.040733327, 2024-09-13T06:40:20.044 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:20.044 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:20.044 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:20.044 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:20.044 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:20.044 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 26022 2024-09-13T06:40:20.045 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.045 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:20.045 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.045 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:20.045 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.429079+0000", 2024-09-13T06:40:20.045 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:20.045 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.045 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.045 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:20.045 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.429079+0000", 2024-09-13T06:40:20.045 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:20.045 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.045 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.045 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:20.046 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.429078+0000", 2024-09-13T06:40:20.046 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:20.046 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.046 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.046 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:20.046 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.429083+0000", 2024-09-13T06:40:20.046 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.8069999999999999e-06 2024-09-13T06:40:20.046 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.046 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.046 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:20.046 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.429096+0000", 2024-09-13T06:40:20.046 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3665e-05 2024-09-13T06:40:20.047 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.047 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.047 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:20.047 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.429106+0000", 2024-09-13T06:40:20.047 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.8460000000000003e-06 2024-09-13T06:40:20.047 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.047 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.047 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:20.047 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.469479+0000", 2024-09-13T06:40:20.047 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.04037259 2024-09-13T06:40:20.047 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.047 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.047 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:20.047 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.469564+0000", 2024-09-13T06:40:20.048 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.5669999999999998e-05 2024-09-13T06:40:20.048 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.048 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.048 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:20.048 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.469812+0000", 2024-09-13T06:40:20.048 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00024753699999999998 2024-09-13T06:40:20.048 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:20.048 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:20.048 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:20.048 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.048 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.048 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:26023 3.c 3:3566b607:::rbd_data.1121f2c5ee81.0000000000000012:13 [read 294912~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:20.048 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.429115+0000", 2024-09-13T06:40:20.049 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 23.573535557, 2024-09-13T06:40:20.049 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.041079490000000003, 2024-09-13T06:40:20.049 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:20.049 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:20.049 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:20.049 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:20.049 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:20.049 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 26023 2024-09-13T06:40:20.049 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.049 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:20.049 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.049 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:20.049 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.429115+0000", 2024-09-13T06:40:20.049 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:20.050 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.050 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.050 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:20.050 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.429115+0000", 2024-09-13T06:40:20.050 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:20.050 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.050 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.050 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:20.050 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.429114+0000", 2024-09-13T06:40:20.050 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:20.050 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.050 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.051 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:20.051 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.429119+0000", 2024-09-13T06:40:20.051 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.0189999999999997e-06 2024-09-13T06:40:20.051 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.051 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.051 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:20.051 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.429137+0000", 2024-09-13T06:40:20.051 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.8087000000000001e-05 2024-09-13T06:40:20.051 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.051 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.051 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:20.051 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.429148+0000", 2024-09-13T06:40:20.051 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0740999999999999e-05 2024-09-13T06:40:20.052 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.052 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.052 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:20.052 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.469861+0000", 2024-09-13T06:40:20.052 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.040713271000000002 2024-09-13T06:40:20.052 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.052 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.052 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:20.052 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.469954+0000", 2024-09-13T06:40:20.052 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.2917000000000005e-05 2024-09-13T06:40:20.052 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.052 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.052 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:20.053 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.470194+0000", 2024-09-13T06:40:20.053 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00024033099999999999 2024-09-13T06:40:20.053 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:20.053 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:20.053 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:20.053 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.053 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.053 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:26024 3.c 3:3566b607:::rbd_data.1121f2c5ee81.0000000000000012:13 [read 319488~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:20.053 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.429157+0000", 2024-09-13T06:40:20.053 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 23.573493028000001, 2024-09-13T06:40:20.053 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.041386232000000002, 2024-09-13T06:40:20.053 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:20.053 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:20.054 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:20.054 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:20.054 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:20.054 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 26024 2024-09-13T06:40:20.054 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.054 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:20.054 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.054 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:20.054 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.429157+0000", 2024-09-13T06:40:20.054 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:20.054 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.054 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.054 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:20.055 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.429157+0000", 2024-09-13T06:40:20.055 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:20.055 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.055 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.055 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:20.055 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.429157+0000", 2024-09-13T06:40:20.055 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:20.055 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.055 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.055 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:20.055 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.429162+0000", 2024-09-13T06:40:20.055 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.3820000000000003e-06 2024-09-13T06:40:20.055 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.056 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.056 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:20.056 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.429175+0000", 2024-09-13T06:40:20.056 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2797e-05 2024-09-13T06:40:20.056 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.056 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.056 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:20.056 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.429185+0000", 2024-09-13T06:40:20.056 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0016e-05 2024-09-13T06:40:20.056 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.056 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.056 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:20.057 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.470233+0000", 2024-09-13T06:40:20.057 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.041047868000000001 2024-09-13T06:40:20.057 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.057 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.057 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:20.057 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.470280+0000", 2024-09-13T06:40:20.057 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.7422000000000001e-05 2024-09-13T06:40:20.057 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.057 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.057 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:20.057 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.470544+0000", 2024-09-13T06:40:20.057 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00026366399999999999 2024-09-13T06:40:20.057 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:20.058 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:20.058 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:20.058 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.058 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.058 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:26025 3.c 3:3566b607:::rbd_data.1121f2c5ee81.0000000000000012:13 [read 389120~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:20.058 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.429194+0000", 2024-09-13T06:40:20.058 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 23.573456666999999, 2024-09-13T06:40:20.058 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.041722952000000001, 2024-09-13T06:40:20.058 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:20.058 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:20.058 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:20.058 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:20.058 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:20.059 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 26025 2024-09-13T06:40:20.059 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.059 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:20.059 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.059 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:20.059 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.429194+0000", 2024-09-13T06:40:20.059 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:20.059 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.059 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.059 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:20.059 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.429194+0000", 2024-09-13T06:40:20.059 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:20.059 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.059 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.060 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:20.060 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.429193+0000", 2024-09-13T06:40:20.060 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:20.060 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.060 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.060 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:20.060 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.429206+0000", 2024-09-13T06:40:20.060 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3008e-05 2024-09-13T06:40:20.060 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.060 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.060 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:20.060 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.429220+0000", 2024-09-13T06:40:20.060 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.4398e-05 2024-09-13T06:40:20.061 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.061 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.061 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:20.061 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.429230+0000", 2024-09-13T06:40:20.061 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.4280000000000002e-06 2024-09-13T06:40:20.061 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.061 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.061 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:20.061 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.470584+0000", 2024-09-13T06:40:20.061 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.041354512000000003 2024-09-13T06:40:20.061 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.061 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.061 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:20.062 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.470648+0000", 2024-09-13T06:40:20.062 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.3163999999999994e-05 2024-09-13T06:40:20.062 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.062 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.062 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:20.062 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.470917+0000", 2024-09-13T06:40:20.062 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00026928199999999997 2024-09-13T06:40:20.062 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:20.062 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:20.062 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:20.062 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.062 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.062 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:26026 3.c 3:3566b607:::rbd_data.1121f2c5ee81.0000000000000012:13 [read 413696~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:20.062 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.429240+0000", 2024-09-13T06:40:20.063 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 23.573410678999998, 2024-09-13T06:40:20.063 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.041996092999999998, 2024-09-13T06:40:20.063 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:20.063 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:20.063 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:20.063 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:20.063 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:20.063 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 26026 2024-09-13T06:40:20.063 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.063 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:20.063 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.063 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:20.063 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.429240+0000", 2024-09-13T06:40:20.064 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:20.064 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.064 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.064 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:20.064 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.429240+0000", 2024-09-13T06:40:20.064 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:20.064 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.064 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.064 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:20.064 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.429239+0000", 2024-09-13T06:40:20.064 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:20.064 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.064 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.065 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:20.065 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.429244+0000", 2024-09-13T06:40:20.065 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.0989999999999998e-06 2024-09-13T06:40:20.065 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.065 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.065 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:20.065 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.429257+0000", 2024-09-13T06:40:20.065 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.296e-05 2024-09-13T06:40:20.065 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.065 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.065 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:20.065 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.429268+0000", 2024-09-13T06:40:20.065 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0971999999999999e-05 2024-09-13T06:40:20.065 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.066 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.066 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:20.066 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.470962+0000", 2024-09-13T06:40:20.066 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.041694426 2024-09-13T06:40:20.066 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.066 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.066 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:20.066 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.471024+0000", 2024-09-13T06:40:20.066 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.1741000000000004e-05 2024-09-13T06:40:20.066 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.066 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.066 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:20.066 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.471236+0000", 2024-09-13T06:40:20.067 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00021181100000000001 2024-09-13T06:40:20.067 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:20.067 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:20.067 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:20.067 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.067 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.067 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:26146 3.1c 3:3da1e1c6:::rbd_data.1121f2c5ee81.0000000000000007:13 [read 425984~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:20.067 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.434603+0000", 2024-09-13T06:40:20.067 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 23.568047182000001, 2024-09-13T06:40:20.067 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.040125802000000002, 2024-09-13T06:40:20.067 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:20.067 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:20.067 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:20.067 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:20.068 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:20.068 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 26146 2024-09-13T06:40:20.068 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.068 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:20.068 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.068 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:20.068 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.434603+0000", 2024-09-13T06:40:20.068 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:20.068 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.068 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.068 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:20.068 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.434603+0000", 2024-09-13T06:40:20.068 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:20.069 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.069 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.069 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:20.069 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.434602+0000", 2024-09-13T06:40:20.069 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999986 2024-09-13T06:40:20.069 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.069 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.069 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:20.069 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.434609+0000", 2024-09-13T06:40:20.069 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.1380000000000001e-06 2024-09-13T06:40:20.069 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.069 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.069 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:20.070 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.434621+0000", 2024-09-13T06:40:20.070 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2164000000000001e-05 2024-09-13T06:40:20.070 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.070 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.070 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:20.070 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.434629+0000", 2024-09-13T06:40:20.070 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.0669999999999992e-06 2024-09-13T06:40:20.070 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.070 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.070 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:20.070 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.474400+0000", 2024-09-13T06:40:20.070 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039770755999999997 2024-09-13T06:40:20.070 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.070 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.071 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:20.071 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.474483+0000", 2024-09-13T06:40:20.071 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.3238000000000005e-05 2024-09-13T06:40:20.071 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.071 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.071 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:20.071 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.474729+0000", 2024-09-13T06:40:20.071 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00024571499999999997 2024-09-13T06:40:20.071 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:20.071 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:20.071 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:20.071 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.071 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.071 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:26147 3.1c 3:3da1e1c6:::rbd_data.1121f2c5ee81.0000000000000007:13 [read 450560~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:20.072 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.434635+0000", 2024-09-13T06:40:20.072 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 23.568015731999999, 2024-09-13T06:40:20.072 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.040501387, 2024-09-13T06:40:20.072 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:20.072 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:20.072 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:20.072 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:20.072 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:20.072 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 26147 2024-09-13T06:40:20.072 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.072 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:20.072 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.072 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:20.073 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.434635+0000", 2024-09-13T06:40:20.073 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:20.073 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.073 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.073 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:20.073 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.434635+0000", 2024-09-13T06:40:20.073 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:20.073 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.073 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.073 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:20.073 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.434634+0000", 2024-09-13T06:40:20.073 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:20.073 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.073 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.074 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:20.074 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.434637+0000", 2024-09-13T06:40:20.074 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.0180000000000002e-06 2024-09-13T06:40:20.074 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.074 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.074 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:20.074 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.434643+0000", 2024-09-13T06:40:20.074 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.5380000000000002e-06 2024-09-13T06:40:20.074 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.074 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.074 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:20.074 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.434647+0000", 2024-09-13T06:40:20.074 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.5379999999999996e-06 2024-09-13T06:40:20.074 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.075 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.075 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:20.075 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.474784+0000", 2024-09-13T06:40:20.075 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.040136731000000002 2024-09-13T06:40:20.075 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.075 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.075 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:20.075 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.474879+0000", 2024-09-13T06:40:20.075 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.5274999999999998e-05 2024-09-13T06:40:20.075 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.075 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.075 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:20.075 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.475136+0000", 2024-09-13T06:40:20.076 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00025693999999999999 2024-09-13T06:40:20.076 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:20.076 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:20.076 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:20.076 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.076 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.076 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:26148 3.1c 3:3da1e1c6:::rbd_data.1121f2c5ee81.0000000000000007:13 [read 520192~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:20.076 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.434651+0000", 2024-09-13T06:40:20.076 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 23.567999231999998, 2024-09-13T06:40:20.076 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.040853773000000003, 2024-09-13T06:40:20.076 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:20.076 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:20.076 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:20.077 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:20.077 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:20.077 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 26148 2024-09-13T06:40:20.077 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.077 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:20.077 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.077 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:20.077 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.434651+0000", 2024-09-13T06:40:20.077 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:20.077 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.077 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.077 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:20.077 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.434651+0000", 2024-09-13T06:40:20.077 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:20.078 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.078 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.078 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:20.078 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.434651+0000", 2024-09-13T06:40:20.078 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:20.078 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.078 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.078 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:20.078 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.434653+0000", 2024-09-13T06:40:20.078 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.4509999999999999e-06 2024-09-13T06:40:20.078 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.078 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.078 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:20.079 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.434659+0000", 2024-09-13T06:40:20.079 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.1930000000000001e-06 2024-09-13T06:40:20.079 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.079 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.079 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:20.079 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.434664+0000", 2024-09-13T06:40:20.079 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.7400000000000001e-06 2024-09-13T06:40:20.079 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.079 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.079 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:20.079 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.475194+0000", 2024-09-13T06:40:20.079 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.040530123000000001 2024-09-13T06:40:20.079 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.080 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.080 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:20.080 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.475300+0000", 2024-09-13T06:40:20.080 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000106 2024-09-13T06:40:20.080 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.080 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.080 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:20.080 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.475505+0000", 2024-09-13T06:40:20.080 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00020465199999999999 2024-09-13T06:40:20.080 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:20.080 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:20.080 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:20.080 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.080 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.081 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:28049 3.1d 3:b83606fe:::rbd_data.1121f2c5ee81.000000000000001b:13 [read 475136~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:20.081 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.661622+0000", 2024-09-13T06:40:20.081 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 23.341028348999998, 2024-09-13T06:40:20.081 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.040354183000000002, 2024-09-13T06:40:20.081 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:20.081 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:20.081 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:20.081 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:20.081 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:20.081 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 28049 2024-09-13T06:40:20.081 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.081 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:20.081 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.082 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:20.082 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.661622+0000", 2024-09-13T06:40:20.082 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:20.082 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.082 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.082 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:20.082 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.661622+0000", 2024-09-13T06:40:20.082 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:20.082 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.082 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.082 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:20.082 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.661621+0000", 2024-09-13T06:40:20.082 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999986 2024-09-13T06:40:20.082 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.083 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.083 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:20.083 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.661627+0000", 2024-09-13T06:40:20.083 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.2450000000000003e-06 2024-09-13T06:40:20.083 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.083 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.083 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:20.083 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.661643+0000", 2024-09-13T06:40:20.083 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5860999999999999e-05 2024-09-13T06:40:20.083 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.083 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.083 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:20.083 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.661656+0000", 2024-09-13T06:40:20.083 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3524e-05 2024-09-13T06:40:20.084 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.084 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.084 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:20.084 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.701307+0000", 2024-09-13T06:40:20.084 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039650336000000001 2024-09-13T06:40:20.084 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.084 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.084 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:20.084 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.701418+0000", 2024-09-13T06:40:20.084 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000111333 2024-09-13T06:40:20.084 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.084 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.084 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:20.085 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.701976+0000", 2024-09-13T06:40:20.085 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000558247 2024-09-13T06:40:20.085 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:20.085 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:20.085 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:20.085 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.085 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.085 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:39085 3.1d 3:beb6f89d:::rbd_data.11216b5b8320.000000000000000c:head [set-alloc-hint object_size 8388608 write_size 8388608,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-13T06:40:20.085 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:10.362427+0000", 2024-09-13T06:40:20.085 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 9.6402231500000006, 2024-09-13T06:40:20.085 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.060680485999999999, 2024-09-13T06:40:20.085 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:20.085 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:40:20.085 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:20.086 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:20.086 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:20.086 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 39085 2024-09-13T06:40:20.086 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.086 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:20.086 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.086 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:20.086 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:10.362427+0000", 2024-09-13T06:40:20.086 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:20.086 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.086 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.086 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:20.086 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:10.362427+0000", 2024-09-13T06:40:20.086 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:20.087 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.087 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.087 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:20.087 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:10.362425+0000", 2024-09-13T06:40:20.087 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999976 2024-09-13T06:40:20.087 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.087 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.087 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:20.087 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:10.362439+0000", 2024-09-13T06:40:20.087 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.437e-05 2024-09-13T06:40:20.087 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.087 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.087 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:20.088 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:10.362469+0000", 2024-09-13T06:40:20.088 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.9556e-05 2024-09-13T06:40:20.088 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.088 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.088 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:20.088 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:10.362483+0000", 2024-09-13T06:40:20.088 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.4701999999999999e-05 2024-09-13T06:40:20.088 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.088 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.088 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:20.088 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:10.362624+0000", 2024-09-13T06:40:20.088 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000140295 2024-09-13T06:40:20.088 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.089 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.089 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:20.089 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:10.362861+0000", 2024-09-13T06:40:20.089 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00023738700000000001 2024-09-13T06:40:20.089 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.089 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.089 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 4", 2024-09-13T06:40:20.089 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:10.372495+0000", 2024-09-13T06:40:20.089 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0096338710000000004 2024-09-13T06:40:20.089 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.089 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.089 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-13T06:40:20.089 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:10.422838+0000", 2024-09-13T06:40:20.090 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.050342944000000001 2024-09-13T06:40:20.090 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.090 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.090 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:40:20.090 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:10.423007+0000", 2024-09-13T06:40:20.090 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00016926800000000001 2024-09-13T06:40:20.090 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.090 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.090 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-13T06:40:20.090 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:10.423062+0000", 2024-09-13T06:40:20.090 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.4911999999999999e-05 2024-09-13T06:40:20.090 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.090 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.090 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:20.091 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:10.423108+0000", 2024-09-13T06:40:20.091 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.5674999999999999e-05 2024-09-13T06:40:20.091 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:20.091 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:20.091 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:20.091 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.091 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.091 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:39407 3.5 3:a322b6b3:::rbd_data.11216b5b8320.000000000000000a:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-13T06:40:20.091 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:11.110502+0000", 2024-09-13T06:40:20.091 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 8.892148165, 2024-09-13T06:40:20.091 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.056837161999999997, 2024-09-13T06:40:20.091 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:20.091 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:40:20.092 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:20.092 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:20.092 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:20.092 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 39407 2024-09-13T06:40:20.092 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.092 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:20.092 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.092 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:20.092 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:11.110502+0000", 2024-09-13T06:40:20.092 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:20.092 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.092 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.092 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:20.092 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:11.110502+0000", 2024-09-13T06:40:20.093 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:20.093 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.093 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.093 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:20.093 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:11.110499+0000", 2024-09-13T06:40:20.093 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999971 2024-09-13T06:40:20.093 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.093 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.093 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:20.093 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:11.110516+0000", 2024-09-13T06:40:20.093 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6662000000000001e-05 2024-09-13T06:40:20.093 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.093 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.094 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:20.094 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:11.110552+0000", 2024-09-13T06:40:20.094 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.6149000000000002e-05 2024-09-13T06:40:20.094 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.094 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.094 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:20.094 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:11.110572+0000", 2024-09-13T06:40:20.094 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.9698e-05 2024-09-13T06:40:20.094 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.094 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.094 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:20.094 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:11.110700+0000", 2024-09-13T06:40:20.094 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00012795600000000001 2024-09-13T06:40:20.094 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.095 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.095 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:20.095 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:11.110849+0000", 2024-09-13T06:40:20.095 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000148963 2024-09-13T06:40:20.095 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.095 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.095 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 3", 2024-09-13T06:40:20.095 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:11.125009+0000", 2024-09-13T06:40:20.095 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.014159859 2024-09-13T06:40:20.095 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.095 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.095 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:40:20.095 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:11.167211+0000", 2024-09-13T06:40:20.096 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.042202866999999998 2024-09-13T06:40:20.096 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.096 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.096 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-13T06:40:20.096 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:11.167228+0000", 2024-09-13T06:40:20.096 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6969999999999998e-05 2024-09-13T06:40:20.096 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.096 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.096 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-13T06:40:20.096 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:11.167292+0000", 2024-09-13T06:40:20.096 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.3361000000000005e-05 2024-09-13T06:40:20.096 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.096 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.096 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:20.097 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:11.167340+0000", 2024-09-13T06:40:20.097 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.7722999999999997e-05 2024-09-13T06:40:20.097 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:20.097 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:20.097 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:20.097 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:20.097 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:20.097 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:40:20.099 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-13T06:40:20.099 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:40:20.097+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:40:20.200 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:40:20.197+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:40:20.223 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:40:20.223 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [], 2024-09-13T06:40:20.224 INFO:teuthology.orchestra.run.smithi139.stdout: "num_ops": 0 2024-09-13T06:40:20.224 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:40:20.240 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-13T06:40:20.301 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:40:20.301+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:40:20.357 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:40:20.357 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [], 2024-09-13T06:40:20.357 INFO:teuthology.orchestra.run.smithi139.stdout: "complaint_time": 30, 2024-09-13T06:40:20.358 INFO:teuthology.orchestra.run.smithi139.stdout: "num_blocked_ops": 0 2024-09-13T06:40:20.358 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:40:20.371 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-13T06:40:20.422 INFO:tasks.ceph.osd.6.smithi139.stderr:2024-09-13T06:40:20.423+0000 7fcd02c5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26385) UID: 0 2024-09-13T06:40:20.470 INFO:teuthology.orchestra.run.smithi081.stderr:noscrub is unset 2024-09-13T06:40:20.499 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:40:20.499 INFO:teuthology.orchestra.run.smithi139.stdout: "size": 20, 2024-09-13T06:40:20.499 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 600, 2024-09-13T06:40:20.499 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [ 2024-09-13T06:40:20.499 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.499 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27854 3.a 3:537b3559:::rbd_data.1121f2c5ee81.0000000000000016:13 [read 335872~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:20.499 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.658750+0000", 2024-09-13T06:40:20.499 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 23.842594183999999, 2024-09-13T06:40:20.499 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.037969532, 2024-09-13T06:40:20.500 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:20.500 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:20.500 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:20.500 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:20.500 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:20.500 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27854 2024-09-13T06:40:20.500 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.500 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:20.500 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.500 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:20.500 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658750+0000", 2024-09-13T06:40:20.500 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:20.500 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.501 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.501 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:20.501 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658750+0000", 2024-09-13T06:40:20.501 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:20.501 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.501 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.501 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:20.501 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658749+0000", 2024-09-13T06:40:20.501 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:20.501 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.501 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.502 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:20.502 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658757+0000", 2024-09-13T06:40:20.502 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.7389999999999999e-06 2024-09-13T06:40:20.502 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.502 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.502 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:20.502 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658763+0000", 2024-09-13T06:40:20.502 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.7769999999999999e-06 2024-09-13T06:40:20.502 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.502 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.502 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:20.502 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658767+0000", 2024-09-13T06:40:20.503 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.1749999999999998e-06 2024-09-13T06:40:20.503 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.503 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.503 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:20.503 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.696322+0000", 2024-09-13T06:40:20.503 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.037554772 2024-09-13T06:40:20.503 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.503 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.503 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:20.504 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.696418+0000", 2024-09-13T06:40:20.504 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6050000000000004e-05 2024-09-13T06:40:20.504 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.504 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.504 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:20.504 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.696719+0000", 2024-09-13T06:40:20.504 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00030138499999999999 2024-09-13T06:40:20.504 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:20.504 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:20.504 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:20.504 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.504 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.504 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27855 3.a 3:537b3559:::rbd_data.1121f2c5ee81.0000000000000016:13 [read 380928~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:20.504 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.658771+0000", 2024-09-13T06:40:20.505 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 23.84257294, 2024-09-13T06:40:20.505 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.038326354, 2024-09-13T06:40:20.505 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:20.505 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:20.505 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:20.505 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:20.505 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:20.505 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27855 2024-09-13T06:40:20.505 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.505 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:20.505 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.505 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:20.506 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658771+0000", 2024-09-13T06:40:20.506 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:20.506 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.506 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.506 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:20.506 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658771+0000", 2024-09-13T06:40:20.506 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:20.506 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.506 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.506 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:20.506 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658770+0000", 2024-09-13T06:40:20.506 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:20.506 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.506 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.507 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:20.507 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658772+0000", 2024-09-13T06:40:20.507 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.0930000000000001e-06 2024-09-13T06:40:20.507 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.507 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.507 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:20.507 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658778+0000", 2024-09-13T06:40:20.507 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.2730000000000002e-06 2024-09-13T06:40:20.507 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.507 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.507 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:20.507 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658782+0000", 2024-09-13T06:40:20.507 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0879999999999997e-06 2024-09-13T06:40:20.507 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.508 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.508 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:20.508 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.696770+0000", 2024-09-13T06:40:20.508 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.037988145000000001 2024-09-13T06:40:20.508 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.508 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.508 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:20.508 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.696852+0000", 2024-09-13T06:40:20.508 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.2039999999999994e-05 2024-09-13T06:40:20.508 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.508 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.508 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:20.508 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.697097+0000", 2024-09-13T06:40:20.508 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00024508800000000002 2024-09-13T06:40:20.509 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:20.509 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:20.509 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:20.509 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.509 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.509 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27856 3.a 3:537b3559:::rbd_data.1121f2c5ee81.0000000000000016:13 [read 405504~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:20.509 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.658786+0000", 2024-09-13T06:40:20.509 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 23.842557824, 2024-09-13T06:40:20.509 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.038736029999999998, 2024-09-13T06:40:20.509 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:20.509 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:20.509 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:20.509 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:20.510 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:20.510 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27856 2024-09-13T06:40:20.510 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.510 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:20.510 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.510 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:20.510 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658786+0000", 2024-09-13T06:40:20.510 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:20.510 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.510 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.510 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:20.510 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658786+0000", 2024-09-13T06:40:20.510 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:20.511 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.511 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.511 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:20.511 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658785+0000", 2024-09-13T06:40:20.511 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:20.511 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.511 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.511 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:20.511 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658787+0000", 2024-09-13T06:40:20.511 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.0040000000000002e-06 2024-09-13T06:40:20.511 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.511 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.511 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:20.512 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658793+0000", 2024-09-13T06:40:20.512 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.2410000000000003e-06 2024-09-13T06:40:20.512 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.512 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.512 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:20.512 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658797+0000", 2024-09-13T06:40:20.512 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.1330000000000001e-06 2024-09-13T06:40:20.512 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.512 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.512 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:20.512 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.697176+0000", 2024-09-13T06:40:20.512 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.038379074999999999 2024-09-13T06:40:20.513 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.513 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.513 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:20.513 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.697275+0000", 2024-09-13T06:40:20.513 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.8819000000000004e-05 2024-09-13T06:40:20.513 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.513 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.513 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:20.513 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.697522+0000", 2024-09-13T06:40:20.513 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00024719999999999999 2024-09-13T06:40:20.513 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:20.513 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:20.513 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:20.514 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.514 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.514 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27857 3.a 3:537b3559:::rbd_data.1121f2c5ee81.0000000000000016:13 [read 475136~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:20.514 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.658845+0000", 2024-09-13T06:40:20.514 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 23.842498821, 2024-09-13T06:40:20.514 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039112570999999999, 2024-09-13T06:40:20.514 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:20.514 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:20.514 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:20.514 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:20.514 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:20.514 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27857 2024-09-13T06:40:20.515 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.515 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:20.515 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.515 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:20.515 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658845+0000", 2024-09-13T06:40:20.515 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:20.515 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.515 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.515 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:20.515 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658845+0000", 2024-09-13T06:40:20.515 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:20.515 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.515 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.516 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:20.516 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658844+0000", 2024-09-13T06:40:20.516 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999986 2024-09-13T06:40:20.516 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.516 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.516 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:20.516 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658868+0000", 2024-09-13T06:40:20.516 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.4615000000000001e-05 2024-09-13T06:40:20.516 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.516 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.516 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:20.516 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658884+0000", 2024-09-13T06:40:20.516 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5401999999999999e-05 2024-09-13T06:40:20.517 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.517 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.517 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:20.517 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658896+0000", 2024-09-13T06:40:20.517 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2509e-05 2024-09-13T06:40:20.517 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.517 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.517 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:20.517 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.697571+0000", 2024-09-13T06:40:20.517 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.038675107 2024-09-13T06:40:20.517 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.517 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.517 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:20.517 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.697658+0000", 2024-09-13T06:40:20.518 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6349999999999998e-05 2024-09-13T06:40:20.518 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.518 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.518 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:20.518 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.697957+0000", 2024-09-13T06:40:20.518 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00029986100000000001 2024-09-13T06:40:20.518 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:20.518 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:20.518 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:20.518 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.518 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.518 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27858 3.a 3:537b3559:::rbd_data.1121f2c5ee81.0000000000000016:13 [read 499712~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:20.518 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.658905+0000", 2024-09-13T06:40:20.519 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 23.842438270999999, 2024-09-13T06:40:20.519 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039475392999999998, 2024-09-13T06:40:20.519 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:20.519 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:20.519 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:20.519 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:20.519 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:20.519 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27858 2024-09-13T06:40:20.519 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.519 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:20.519 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.519 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:20.519 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658905+0000", 2024-09-13T06:40:20.520 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:20.520 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.520 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.520 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:20.520 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658905+0000", 2024-09-13T06:40:20.520 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:20.520 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.520 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.520 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:20.520 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658905+0000", 2024-09-13T06:40:20.520 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:20.520 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.520 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.520 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:20.520 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658909+0000", 2024-09-13T06:40:20.521 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.831e-06 2024-09-13T06:40:20.521 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.521 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.521 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:20.521 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658920+0000", 2024-09-13T06:40:20.521 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0936e-05 2024-09-13T06:40:20.521 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.521 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.521 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:20.521 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658929+0000", 2024-09-13T06:40:20.521 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.2749999999999995e-06 2024-09-13T06:40:20.521 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.521 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.521 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:20.522 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.697990+0000", 2024-09-13T06:40:20.522 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039061625000000003 2024-09-13T06:40:20.522 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.522 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.522 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:20.522 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.698077+0000", 2024-09-13T06:40:20.522 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6922000000000006e-05 2024-09-13T06:40:20.522 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.522 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.522 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:20.522 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.698381+0000", 2024-09-13T06:40:20.522 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00030360599999999999 2024-09-13T06:40:20.522 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:20.522 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:20.522 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:20.523 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.523 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.523 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27929 3.a 3:537b3559:::rbd_data.1121f2c5ee81.0000000000000016:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:20.523 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.659338+0000", 2024-09-13T06:40:20.523 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 23.842005440000001, 2024-09-13T06:40:20.523 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039351214000000002, 2024-09-13T06:40:20.523 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:20.523 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:20.523 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:20.523 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:20.523 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:20.523 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27929 2024-09-13T06:40:20.523 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.523 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:20.524 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.524 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:20.524 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.659338+0000", 2024-09-13T06:40:20.524 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:20.524 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.524 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.524 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:20.524 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.659338+0000", 2024-09-13T06:40:20.524 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:20.524 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.524 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.524 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:20.524 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.659337+0000", 2024-09-13T06:40:20.524 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:20.525 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.525 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.525 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:20.525 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.659342+0000", 2024-09-13T06:40:20.525 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0799999999999999e-06 2024-09-13T06:40:20.525 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.525 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.525 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:20.525 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.659353+0000", 2024-09-13T06:40:20.525 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1798e-05 2024-09-13T06:40:20.525 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.525 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.526 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:20.526 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.659361+0000", 2024-09-13T06:40:20.526 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.8040000000000002e-06 2024-09-13T06:40:20.526 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.526 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.526 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:20.526 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.698449+0000", 2024-09-13T06:40:20.526 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039087519000000001 2024-09-13T06:40:20.526 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.526 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.526 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:20.526 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.698567+0000", 2024-09-13T06:40:20.526 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00011857 2024-09-13T06:40:20.527 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.527 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.527 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:20.527 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.698689+0000", 2024-09-13T06:40:20.527 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00012226699999999999 2024-09-13T06:40:20.527 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:20.527 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:20.527 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:20.527 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.527 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.527 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27974 3.a 3:537b3559:::rbd_data.1121f2c5ee81.0000000000000016:13 [read 32768~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:20.527 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.660102+0000", 2024-09-13T06:40:20.527 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 23.841241671999999, 2024-09-13T06:40:20.527 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.038972346999999997, 2024-09-13T06:40:20.528 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:20.528 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:20.528 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:20.528 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:20.528 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:20.528 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27974 2024-09-13T06:40:20.528 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.528 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:20.528 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.528 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:20.528 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660102+0000", 2024-09-13T06:40:20.528 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:20.529 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.529 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.529 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:20.529 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660102+0000", 2024-09-13T06:40:20.529 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:20.529 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.529 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.529 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:20.529 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660100+0000", 2024-09-13T06:40:20.529 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999976 2024-09-13T06:40:20.529 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.529 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.529 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:20.529 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660114+0000", 2024-09-13T06:40:20.530 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.4466e-05 2024-09-13T06:40:20.530 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.530 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.530 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:20.530 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660148+0000", 2024-09-13T06:40:20.530 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.3742999999999999e-05 2024-09-13T06:40:20.530 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.530 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.530 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:20.530 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660170+0000", 2024-09-13T06:40:20.530 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.2518e-05 2024-09-13T06:40:20.530 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.530 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.531 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:20.531 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.698719+0000", 2024-09-13T06:40:20.531 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.038548529999999998 2024-09-13T06:40:20.531 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.531 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.531 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:20.531 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.698806+0000", 2024-09-13T06:40:20.531 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.7179e-05 2024-09-13T06:40:20.531 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.531 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.531 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:20.531 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.699074+0000", 2024-09-13T06:40:20.531 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00026834800000000001 2024-09-13T06:40:20.532 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:20.532 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:20.532 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:20.532 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.532 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.532 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27975 3.a 3:537b3559:::rbd_data.1121f2c5ee81.0000000000000016:13 [read 57344~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:20.532 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.660189+0000", 2024-09-13T06:40:20.532 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 23.841154828000001, 2024-09-13T06:40:20.532 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039288678, 2024-09-13T06:40:20.532 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:20.532 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:20.532 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:20.532 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:20.532 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:20.533 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27975 2024-09-13T06:40:20.533 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.533 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:20.533 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.533 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:20.533 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660189+0000", 2024-09-13T06:40:20.533 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:20.533 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.533 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.533 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:20.534 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660189+0000", 2024-09-13T06:40:20.534 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:20.534 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.534 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.534 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:20.534 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660187+0000", 2024-09-13T06:40:20.534 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999981 2024-09-13T06:40:20.534 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.534 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.534 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:20.534 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660195+0000", 2024-09-13T06:40:20.535 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5610000000000001e-06 2024-09-13T06:40:20.535 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.535 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.535 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:20.535 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660212+0000", 2024-09-13T06:40:20.535 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7725999999999999e-05 2024-09-13T06:40:20.535 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.535 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.535 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:20.535 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660227+0000", 2024-09-13T06:40:20.535 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.43e-05 2024-09-13T06:40:20.535 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.536 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.536 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:20.536 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.699135+0000", 2024-09-13T06:40:20.536 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.038908336000000002 2024-09-13T06:40:20.536 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.536 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.536 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:20.536 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.699208+0000", 2024-09-13T06:40:20.536 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.3065000000000006e-05 2024-09-13T06:40:20.536 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.536 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.536 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:20.536 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.699478+0000", 2024-09-13T06:40:20.536 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00026946899999999999 2024-09-13T06:40:20.537 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:20.537 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:20.537 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:20.537 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.537 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.537 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27976 3.a 3:537b3559:::rbd_data.1121f2c5ee81.0000000000000016:13 [read 102400~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:20.537 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.660238+0000", 2024-09-13T06:40:20.537 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 23.841105665000001, 2024-09-13T06:40:20.537 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039636515999999997, 2024-09-13T06:40:20.537 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:20.537 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:20.537 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:20.537 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:20.538 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:20.538 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27976 2024-09-13T06:40:20.538 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.538 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:20.538 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.538 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:20.538 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660238+0000", 2024-09-13T06:40:20.538 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:20.538 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.538 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.538 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:20.538 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660238+0000", 2024-09-13T06:40:20.538 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:20.538 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.539 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.539 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:20.539 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660237+0000", 2024-09-13T06:40:20.539 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:20.539 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.539 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.539 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:20.539 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660243+0000", 2024-09-13T06:40:20.539 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.9909999999999999e-06 2024-09-13T06:40:20.539 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.539 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.539 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:20.539 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660259+0000", 2024-09-13T06:40:20.539 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6294e-05 2024-09-13T06:40:20.539 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.540 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.540 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:20.540 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660272+0000", 2024-09-13T06:40:20.540 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2714999999999999e-05 2024-09-13T06:40:20.540 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.540 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.540 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:20.540 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.699513+0000", 2024-09-13T06:40:20.540 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039240932999999999 2024-09-13T06:40:20.540 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.540 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.540 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:20.540 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.699604+0000", 2024-09-13T06:40:20.541 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.1367999999999997e-05 2024-09-13T06:40:20.541 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.541 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.541 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:20.541 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.699875+0000", 2024-09-13T06:40:20.541 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00027029499999999999 2024-09-13T06:40:20.541 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:20.541 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:20.541 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:20.541 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.541 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.541 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27977 3.a 3:537b3559:::rbd_data.1121f2c5ee81.0000000000000016:13 [read 126976~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:20.541 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.660284+0000", 2024-09-13T06:40:20.542 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 23.841060092999999, 2024-09-13T06:40:20.542 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039969945, 2024-09-13T06:40:20.542 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:20.542 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:20.542 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:20.542 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:20.542 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:20.542 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27977 2024-09-13T06:40:20.542 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.542 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:20.542 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.542 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:20.542 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660284+0000", 2024-09-13T06:40:20.542 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:20.543 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.543 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.543 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:20.543 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660284+0000", 2024-09-13T06:40:20.543 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:20.543 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.543 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.543 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:20.543 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660282+0000", 2024-09-13T06:40:20.543 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999986 2024-09-13T06:40:20.543 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.543 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.543 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:20.543 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660288+0000", 2024-09-13T06:40:20.544 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.2650000000000002e-06 2024-09-13T06:40:20.544 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.544 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.544 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:20.544 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660304+0000", 2024-09-13T06:40:20.544 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5430999999999998e-05 2024-09-13T06:40:20.544 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.544 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.544 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:20.544 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660316+0000", 2024-09-13T06:40:20.544 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.237e-05 2024-09-13T06:40:20.544 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.545 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.545 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:20.545 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.699907+0000", 2024-09-13T06:40:20.545 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039590735000000002 2024-09-13T06:40:20.545 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.545 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.545 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:20.545 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.699994+0000", 2024-09-13T06:40:20.545 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6996999999999994e-05 2024-09-13T06:40:20.545 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.545 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.545 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:20.545 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700254+0000", 2024-09-13T06:40:20.546 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000259564 2024-09-13T06:40:20.546 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:20.546 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:20.546 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:20.546 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.546 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.546 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27978 3.a 3.9aacdeca (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:20.546 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.660327+0000", 2024-09-13T06:40:20.546 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 23.841016495000002, 2024-09-13T06:40:20.546 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039984858999999998, 2024-09-13T06:40:20.546 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:20.547 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:40:20.547 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:20.547 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:20.547 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:20.547 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27978 2024-09-13T06:40:20.547 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.547 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:20.547 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.547 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:20.547 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660327+0000", 2024-09-13T06:40:20.547 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:20.548 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.548 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.548 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:20.548 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660327+0000", 2024-09-13T06:40:20.548 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:20.548 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.548 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.548 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:20.548 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660326+0000", 2024-09-13T06:40:20.548 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:20.548 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.548 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.548 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:20.549 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660366+0000", 2024-09-13T06:40:20.549 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.9691000000000003e-05 2024-09-13T06:40:20.549 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.549 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.549 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:20.549 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660399+0000", 2024-09-13T06:40:20.549 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.3262000000000001e-05 2024-09-13T06:40:20.549 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.549 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.549 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:20.549 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660414+0000", 2024-09-13T06:40:20.550 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.4775e-05 2024-09-13T06:40:20.550 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.550 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.550 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:20.550 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700298+0000", 2024-09-13T06:40:20.550 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039883759999999997 2024-09-13T06:40:20.550 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.550 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.550 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:20.550 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700312+0000", 2024-09-13T06:40:20.550 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.4374e-05 2024-09-13T06:40:20.550 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:20.550 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:20.550 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:20.551 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.551 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.551 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27979 3.a 3.9aacdeca (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:20.551 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.660429+0000", 2024-09-13T06:40:20.551 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 23.840914627, 2024-09-13T06:40:20.551 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039921361000000002, 2024-09-13T06:40:20.551 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:20.551 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:40:20.551 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:20.551 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:20.551 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:20.551 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27979 2024-09-13T06:40:20.551 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.552 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:20.552 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.552 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:20.552 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660429+0000", 2024-09-13T06:40:20.552 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:20.552 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.552 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.552 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:20.552 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660429+0000", 2024-09-13T06:40:20.552 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:20.552 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.552 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.553 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:20.553 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660428+0000", 2024-09-13T06:40:20.553 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999986 2024-09-13T06:40:20.553 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.553 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.553 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:20.553 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660434+0000", 2024-09-13T06:40:20.553 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.8190000000000003e-06 2024-09-13T06:40:20.553 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.553 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.553 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:20.553 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660451+0000", 2024-09-13T06:40:20.553 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6963e-05 2024-09-13T06:40:20.553 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.554 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.554 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:20.554 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660485+0000", 2024-09-13T06:40:20.554 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.3414000000000002e-05 2024-09-13T06:40:20.554 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.554 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.554 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:20.554 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700342+0000", 2024-09-13T06:40:20.554 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039857278000000003 2024-09-13T06:40:20.554 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.554 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.554 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:20.554 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700350+0000", 2024-09-13T06:40:20.555 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.2930000000000001e-06 2024-09-13T06:40:20.555 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:20.555 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:20.555 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:20.555 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.555 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.555 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27980 3.a 3.9aacdeca (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:20.555 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.660497+0000", 2024-09-13T06:40:20.555 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 23.840846416000002, 2024-09-13T06:40:20.555 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039888034000000003, 2024-09-13T06:40:20.555 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:20.555 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:40:20.555 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:20.556 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:20.556 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:20.556 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27980 2024-09-13T06:40:20.556 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.556 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:20.556 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.556 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:20.556 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660497+0000", 2024-09-13T06:40:20.556 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:20.556 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.556 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.556 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:20.556 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660497+0000", 2024-09-13T06:40:20.556 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:20.557 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.557 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.557 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:20.557 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660496+0000", 2024-09-13T06:40:20.557 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:20.557 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.557 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.557 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:20.557 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660503+0000", 2024-09-13T06:40:20.557 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.4110000000000001e-06 2024-09-13T06:40:20.557 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.557 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.558 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:20.558 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660519+0000", 2024-09-13T06:40:20.558 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6180000000000001e-05 2024-09-13T06:40:20.558 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.558 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.558 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:20.558 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660544+0000", 2024-09-13T06:40:20.558 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.5177999999999998e-05 2024-09-13T06:40:20.558 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.558 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.558 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:20.558 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700377+0000", 2024-09-13T06:40:20.558 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039833434000000001 2024-09-13T06:40:20.558 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.559 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.559 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:20.559 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700385+0000", 2024-09-13T06:40:20.559 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.8800000000000008e-06 2024-09-13T06:40:20.559 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:20.559 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:20.559 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:20.559 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.559 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.559 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27981 3.a 3.9aacdeca (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:20.559 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.660556+0000", 2024-09-13T06:40:20.559 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 23.840788069999999, 2024-09-13T06:40:20.559 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039869989000000002, 2024-09-13T06:40:20.560 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:20.560 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:40:20.560 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:20.560 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:20.560 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:20.560 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27981 2024-09-13T06:40:20.560 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.560 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:20.560 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.560 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:20.560 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660556+0000", 2024-09-13T06:40:20.560 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:20.560 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.561 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.561 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:20.561 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660556+0000", 2024-09-13T06:40:20.561 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:20.561 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.561 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.561 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:20.561 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660555+0000", 2024-09-13T06:40:20.561 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:20.561 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.561 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.561 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:20.561 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660561+0000", 2024-09-13T06:40:20.562 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.088e-06 2024-09-13T06:40:20.562 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.562 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.562 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:20.562 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660577+0000", 2024-09-13T06:40:20.562 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6147999999999999e-05 2024-09-13T06:40:20.562 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.562 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.562 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:20.562 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660589+0000", 2024-09-13T06:40:20.562 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2551999999999999e-05 2024-09-13T06:40:20.562 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.562 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.562 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:20.563 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700414+0000", 2024-09-13T06:40:20.563 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039825007000000003 2024-09-13T06:40:20.563 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.563 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.563 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:20.563 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700426+0000", 2024-09-13T06:40:20.563 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1265e-05 2024-09-13T06:40:20.563 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:20.563 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:20.563 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:20.563 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.563 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.563 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27982 3.a 3.9aacdeca (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:20.564 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.660603+0000", 2024-09-13T06:40:20.564 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 23.840740475, 2024-09-13T06:40:20.564 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039874779999999999, 2024-09-13T06:40:20.564 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:20.564 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:40:20.564 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:20.564 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:20.564 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:20.564 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27982 2024-09-13T06:40:20.564 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.564 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:20.564 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.564 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:20.565 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660603+0000", 2024-09-13T06:40:20.565 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:20.565 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.565 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.565 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:20.565 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660603+0000", 2024-09-13T06:40:20.565 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:20.565 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.565 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.565 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:20.565 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660602+0000", 2024-09-13T06:40:20.565 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:20.565 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.565 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.566 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:20.566 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660653+0000", 2024-09-13T06:40:20.566 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.0862000000000002e-05 2024-09-13T06:40:20.566 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.566 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.566 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:20.566 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660697+0000", 2024-09-13T06:40:20.566 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.3773000000000003e-05 2024-09-13T06:40:20.566 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.566 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.566 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:20.566 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660712+0000", 2024-09-13T06:40:20.566 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5464999999999998e-05 2024-09-13T06:40:20.567 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.567 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.567 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:20.567 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700469+0000", 2024-09-13T06:40:20.567 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039756503999999998 2024-09-13T06:40:20.567 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.567 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.567 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:20.567 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700478+0000", 2024-09-13T06:40:20.567 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.1730000000000001e-06 2024-09-13T06:40:20.567 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:20.567 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:20.567 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:20.568 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.568 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.568 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27983 3.a 3.9aacdeca (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:20.568 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.660726+0000", 2024-09-13T06:40:20.568 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 23.840617200000001, 2024-09-13T06:40:20.568 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039804357999999998, 2024-09-13T06:40:20.568 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:20.568 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:40:20.568 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:20.568 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:20.568 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:20.568 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27983 2024-09-13T06:40:20.568 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.568 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:20.569 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.569 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:20.569 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660726+0000", 2024-09-13T06:40:20.569 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:20.569 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.569 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.569 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:20.569 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660726+0000", 2024-09-13T06:40:20.569 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:20.569 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.569 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.569 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:20.569 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660725+0000", 2024-09-13T06:40:20.570 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999986 2024-09-13T06:40:20.570 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.570 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.570 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:20.570 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660733+0000", 2024-09-13T06:40:20.570 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.9359999999999999e-06 2024-09-13T06:40:20.570 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.570 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.570 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:20.570 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660751+0000", 2024-09-13T06:40:20.570 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7679000000000001e-05 2024-09-13T06:40:20.570 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.570 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.571 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:20.571 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660764+0000", 2024-09-13T06:40:20.571 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3112000000000001e-05 2024-09-13T06:40:20.571 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.571 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.571 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:20.571 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700516+0000", 2024-09-13T06:40:20.571 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039752183000000003 2024-09-13T06:40:20.571 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.571 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.571 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:20.571 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700531+0000", 2024-09-13T06:40:20.571 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.4732999999999999e-05 2024-09-13T06:40:20.572 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:20.572 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:20.572 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:20.572 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.572 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.572 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27984 3.a 3.9aacdeca (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:20.572 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.660776+0000", 2024-09-13T06:40:20.572 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 23.840568096999998, 2024-09-13T06:40:20.572 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039795697999999997, 2024-09-13T06:40:20.572 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:20.572 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:40:20.572 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:20.572 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:20.573 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:20.573 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27984 2024-09-13T06:40:20.573 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.573 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:20.573 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.573 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:20.573 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660776+0000", 2024-09-13T06:40:20.573 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:20.573 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.573 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.573 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:20.573 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660776+0000", 2024-09-13T06:40:20.573 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:20.574 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.574 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.574 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:20.574 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660775+0000", 2024-09-13T06:40:20.574 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:20.574 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.574 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.574 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:20.574 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660780+0000", 2024-09-13T06:40:20.574 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.7849999999999997e-06 2024-09-13T06:40:20.574 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.574 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.575 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:20.575 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660799+0000", 2024-09-13T06:40:20.575 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.8794e-05 2024-09-13T06:40:20.575 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.575 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.575 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:20.575 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660812+0000", 2024-09-13T06:40:20.575 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3029e-05 2024-09-13T06:40:20.575 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.575 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.575 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:20.575 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700562+0000", 2024-09-13T06:40:20.575 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039749984000000002 2024-09-13T06:40:20.576 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.576 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.576 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:20.576 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700571+0000", 2024-09-13T06:40:20.576 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.1260000000000004e-06 2024-09-13T06:40:20.576 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:20.576 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:20.576 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:20.576 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.576 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.576 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27985 3.a 3.9aacdeca (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:20.576 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.660824+0000", 2024-09-13T06:40:20.577 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 23.840520045000002, 2024-09-13T06:40:20.577 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039784462, 2024-09-13T06:40:20.577 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:20.577 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:40:20.577 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:20.577 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:20.577 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:20.577 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27985 2024-09-13T06:40:20.577 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.577 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:20.577 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.577 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:20.577 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660824+0000", 2024-09-13T06:40:20.578 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:20.578 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.578 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.578 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:20.578 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660824+0000", 2024-09-13T06:40:20.578 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:20.578 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.578 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.578 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:20.578 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660823+0000", 2024-09-13T06:40:20.578 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:20.578 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.578 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.579 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:20.579 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660829+0000", 2024-09-13T06:40:20.579 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.9440000000000002e-06 2024-09-13T06:40:20.579 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.579 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.579 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:20.579 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660922+0000", 2024-09-13T06:40:20.579 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.2958e-05 2024-09-13T06:40:20.579 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.579 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.579 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:20.579 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660964+0000", 2024-09-13T06:40:20.579 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.2407000000000002e-05 2024-09-13T06:40:20.580 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.580 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.580 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:20.580 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700600+0000", 2024-09-13T06:40:20.580 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039635581000000003 2024-09-13T06:40:20.580 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.580 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.580 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:20.580 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700608+0000", 2024-09-13T06:40:20.580 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.5890000000000003e-06 2024-09-13T06:40:20.580 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:20.580 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:20.580 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:20.581 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.581 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.581 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:28023 3.10 3:0dedc28a:::rbd_data.1121f2c5ee81.0000000000000019:13 [read 475136~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:20.581 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.662072+0000", 2024-09-13T06:40:20.581 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 23.839272059999999, 2024-09-13T06:40:20.581 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.038086508999999998, 2024-09-13T06:40:20.581 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:20.581 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:20.581 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:20.581 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:20.581 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:20.582 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 28023 2024-09-13T06:40:20.582 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.582 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:20.582 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.582 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:20.582 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.662072+0000", 2024-09-13T06:40:20.582 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:20.582 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.582 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.582 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:20.583 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.662072+0000", 2024-09-13T06:40:20.583 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:20.583 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.583 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.583 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:20.583 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.662070+0000", 2024-09-13T06:40:20.583 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999986 2024-09-13T06:40:20.583 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.583 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.583 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:20.584 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.662076+0000", 2024-09-13T06:40:20.584 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.139e-06 2024-09-13T06:40:20.584 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.584 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.584 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:20.584 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.662094+0000", 2024-09-13T06:40:20.584 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7136999999999999e-05 2024-09-13T06:40:20.584 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.584 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.584 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:20.584 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.662124+0000", 2024-09-13T06:40:20.585 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.0528999999999999e-05 2024-09-13T06:40:20.585 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.585 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.585 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:20.585 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.699843+0000", 2024-09-13T06:40:20.585 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.037718415999999998 2024-09-13T06:40:20.585 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.585 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.585 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:20.585 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.699931+0000", 2024-09-13T06:40:20.585 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.8345999999999997e-05 2024-09-13T06:40:20.585 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.586 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.586 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:20.586 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700158+0000", 2024-09-13T06:40:20.586 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00022723099999999999 2024-09-13T06:40:20.586 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:20.586 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:20.586 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:20.586 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.586 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.586 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:28024 3.10 3.5143b7b0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:20.586 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.662137+0000", 2024-09-13T06:40:20.586 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 23.839206537999999, 2024-09-13T06:40:20.586 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.038056092999999999, 2024-09-13T06:40:20.587 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:20.587 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:40:20.587 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:20.587 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:20.587 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:20.587 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 28024 2024-09-13T06:40:20.587 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.587 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:20.587 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.587 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:20.588 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.662137+0000", 2024-09-13T06:40:20.588 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:20.588 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.588 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.588 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:20.588 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.662137+0000", 2024-09-13T06:40:20.588 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:20.588 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.588 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.589 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:20.589 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.662136+0000", 2024-09-13T06:40:20.589 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999986 2024-09-13T06:40:20.589 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.589 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.589 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:20.589 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.662142+0000", 2024-09-13T06:40:20.589 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.6930000000000001e-06 2024-09-13T06:40:20.589 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.590 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.590 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:20.590 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.662160+0000", 2024-09-13T06:40:20.590 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7863000000000002e-05 2024-09-13T06:40:20.590 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.590 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.590 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:20.590 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.662189+0000", 2024-09-13T06:40:20.590 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.8486000000000001e-05 2024-09-13T06:40:20.591 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.591 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.591 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:20.591 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700187+0000", 2024-09-13T06:40:20.591 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.037998331000000003 2024-09-13T06:40:20.591 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:20.591 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:20.591 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:20.591 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700193+0000", 2024-09-13T06:40:20.591 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.0909999999999998e-06 2024-09-13T06:40:20.591 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:20.591 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:20.592 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:20.592 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:20.592 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:20.592 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:40:20.593 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-13T06:40:20.593 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:40:20.591+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:40:20.694 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:40:20.695+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:40:20.766 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:40:20.766 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [], 2024-09-13T06:40:20.766 INFO:teuthology.orchestra.run.smithi139.stdout: "num_ops": 0 2024-09-13T06:40:20.766 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:40:20.780 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-13T06:40:20.795 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:40:20.793+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:40:20.896 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-13T06:40:20.895+0000 7f86a5f06640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26387) UID: 0 2024-09-13T06:40:20.946 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:40:20.946 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [], 2024-09-13T06:40:20.946 INFO:teuthology.orchestra.run.smithi139.stdout: "complaint_time": 30, 2024-09-13T06:40:20.946 INFO:teuthology.orchestra.run.smithi139.stdout: "num_blocked_ops": 0 2024-09-13T06:40:20.946 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:40:20.960 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-13T06:40:21.002 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:40:21.003+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:40:21.098 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:40:21.097+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:40:21.128 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:40:21.128 INFO:teuthology.orchestra.run.smithi139.stdout: "size": 20, 2024-09-13T06:40:21.129 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 600, 2024-09-13T06:40:21.129 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [ 2024-09-13T06:40:21.129 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:21.129 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4154.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-13T06:40:21.129 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:11.143816+0000", 2024-09-13T06:40:21.129 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 69.983974969000002, 2024-09-13T06:40:21.129 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.062483034, 2024-09-13T06:40:21.129 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:21.129 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:40:21.129 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:21.129 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4154", 2024-09-13T06:40:21.129 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/2406930292", 2024-09-13T06:40:21.129 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 1 2024-09-13T06:40:21.130 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:21.130 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:21.130 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:21.130 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:21.130 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.143816+0000", 2024-09-13T06:40:21.130 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:21.130 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:21.130 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:21.130 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:21.130 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.143816+0000", 2024-09-13T06:40:21.130 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:21.130 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:21.130 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:21.131 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:21.131 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.143814+0000", 2024-09-13T06:40:21.131 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999976 2024-09-13T06:40:21.131 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:21.131 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:21.131 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:21.131 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.143829+0000", 2024-09-13T06:40:21.131 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5316999999999999e-05 2024-09-13T06:40:21.131 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:21.131 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:21.131 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:21.131 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.143851+0000", 2024-09-13T06:40:21.131 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.1736999999999999e-05 2024-09-13T06:40:21.131 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:21.132 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:21.132 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:21.132 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.143870+0000", 2024-09-13T06:40:21.132 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.9185999999999999e-05 2024-09-13T06:40:21.132 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:21.132 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:21.132 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:21.132 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.143973+0000", 2024-09-13T06:40:21.132 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000102896 2024-09-13T06:40:21.132 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:21.132 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:21.132 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:40:21.132 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.143987+0000", 2024-09-13T06:40:21.133 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.401e-05 2024-09-13T06:40:21.133 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:21.133 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:21.133 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:21.133 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.203333+0000", 2024-09-13T06:40:21.133 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.059346614999999998 2024-09-13T06:40:21.133 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:21.133 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:21.133 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:21.133 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.203624+0000", 2024-09-13T06:40:21.133 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00029112700000000002 2024-09-13T06:40:21.133 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:21.133 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:21.134 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 0", 2024-09-13T06:40:21.134 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.203940+0000", 2024-09-13T06:40:21.134 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00031547200000000002 2024-09-13T06:40:21.134 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:21.134 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:21.134 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-13T06:40:21.134 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.205145+0000", 2024-09-13T06:40:21.134 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0012048930000000001 2024-09-13T06:40:21.134 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:21.134 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:21.134 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:40:21.134 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.206110+0000", 2024-09-13T06:40:21.134 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00096536600000000005 2024-09-13T06:40:21.135 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:21.135 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:21.135 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-13T06:40:21.135 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.206196+0000", 2024-09-13T06:40:21.135 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.5798999999999996e-05 2024-09-13T06:40:21.135 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:21.135 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:21.135 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:21.135 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.206299+0000", 2024-09-13T06:40:21.135 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00010279 2024-09-13T06:40:21.135 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:21.135 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:21.135 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:21.135 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:21.136 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:21.136 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4154.0:36 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-13T06:40:21.136 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:11.257357+0000", 2024-09-13T06:40:21.136 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 69.870433525999999, 2024-09-13T06:40:21.136 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.012807595, 2024-09-13T06:40:21.136 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:21.136 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:40:21.136 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:21.136 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4154", 2024-09-13T06:40:21.136 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/2406930292", 2024-09-13T06:40:21.136 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 36 2024-09-13T06:40:21.136 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:21.136 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:21.137 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:21.137 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:21.137 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.257357+0000", 2024-09-13T06:40:21.137 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:21.137 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:21.137 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:21.137 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:21.137 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.257357+0000", 2024-09-13T06:40:21.137 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:21.137 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:21.137 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:21.137 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:21.137 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.257356+0000", 2024-09-13T06:40:21.138 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:21.138 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:21.138 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:21.138 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:21.138 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.257378+0000", 2024-09-13T06:40:21.138 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.1988999999999999e-05 2024-09-13T06:40:21.138 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:21.138 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:21.138 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:21.138 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.257389+0000", 2024-09-13T06:40:21.138 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0343000000000001e-05 2024-09-13T06:40:21.138 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:21.138 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:21.138 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:21.139 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.257396+0000", 2024-09-13T06:40:21.139 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5839999999999997e-06 2024-09-13T06:40:21.139 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:21.139 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:21.139 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:21.139 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.264748+0000", 2024-09-13T06:40:21.139 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0073514640000000003 2024-09-13T06:40:21.139 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:21.139 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:21.139 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:21.139 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.264878+0000", 2024-09-13T06:40:21.139 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00012975500000000001 2024-09-13T06:40:21.139 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:21.139 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:21.140 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 0", 2024-09-13T06:40:21.140 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.265064+0000", 2024-09-13T06:40:21.140 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000186799 2024-09-13T06:40:21.140 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:21.140 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:21.140 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:40:21.140 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.267248+0000", 2024-09-13T06:40:21.140 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0021841230000000001 2024-09-13T06:40:21.140 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:21.140 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:21.140 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-13T06:40:21.140 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.269996+0000", 2024-09-13T06:40:21.140 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0027473419999999998 2024-09-13T06:40:21.141 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:21.141 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:21.141 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-13T06:40:21.141 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.270066+0000", 2024-09-13T06:40:21.141 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.0683000000000001e-05 2024-09-13T06:40:21.141 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:21.141 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:21.141 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:21.141 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.270165+0000", 2024-09-13T06:40:21.141 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.8319000000000005e-05 2024-09-13T06:40:21.141 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:21.141 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:21.141 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:21.142 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:21.142 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:21.142 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4154.0:37 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-13T06:40:21.142 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:11.257405+0000", 2024-09-13T06:40:21.142 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 69.870385346000006, 2024-09-13T06:40:21.142 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.012930476999999999, 2024-09-13T06:40:21.142 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:21.142 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:40:21.142 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:21.142 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4154", 2024-09-13T06:40:21.142 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/2406930292", 2024-09-13T06:40:21.142 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 37 2024-09-13T06:40:21.142 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:21.142 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:21.143 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:21.143 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:21.143 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.257405+0000", 2024-09-13T06:40:21.143 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:21.143 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:21.143 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:21.143 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:21.143 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.257405+0000", 2024-09-13T06:40:21.143 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:21.143 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:21.143 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:21.143 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:21.143 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.257405+0000", 2024-09-13T06:40:21.144 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:21.144 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:21.144 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:21.144 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:21.144 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.257411+0000", 2024-09-13T06:40:21.144 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.1500000000000004e-06 2024-09-13T06:40:21.144 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:21.144 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:21.144 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:21.144 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.257420+0000", 2024-09-13T06:40:21.144 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.986e-06 2024-09-13T06:40:21.144 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:21.144 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:21.145 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:21.145 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.257436+0000", 2024-09-13T06:40:21.145 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6433999999999999e-05 2024-09-13T06:40:21.145 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:21.145 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:21.145 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:21.145 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.265923+0000", 2024-09-13T06:40:21.145 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0084872009999999998 2024-09-13T06:40:21.145 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:21.145 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:21.145 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:21.145 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.266056+0000", 2024-09-13T06:40:21.145 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00013206599999999999 2024-09-13T06:40:21.145 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:21.146 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:21.146 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 0", 2024-09-13T06:40:21.146 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.266255+0000", 2024-09-13T06:40:21.146 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00019935100000000001 2024-09-13T06:40:21.146 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:21.146 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:21.146 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:40:21.146 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.267788+0000", 2024-09-13T06:40:21.146 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0015335380000000001 2024-09-13T06:40:21.146 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:21.146 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:21.146 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-13T06:40:21.146 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.270181+0000", 2024-09-13T06:40:21.147 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.002392136 2024-09-13T06:40:21.147 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:21.147 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:21.147 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-13T06:40:21.147 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.270245+0000", 2024-09-13T06:40:21.147 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.4401999999999998e-05 2024-09-13T06:40:21.147 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:21.147 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:21.147 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:21.147 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.270336+0000", 2024-09-13T06:40:21.147 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.0872999999999995e-05 2024-09-13T06:40:21.147 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:21.147 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:21.148 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:21.148 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:21.148 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:21.148 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4154.0:88 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-13T06:40:21.148 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:11.362174+0000", 2024-09-13T06:40:21.148 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 69.765616738000006, 2024-09-13T06:40:21.148 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.012171276, 2024-09-13T06:40:21.148 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:21.148 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:40:21.148 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:21.148 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4154", 2024-09-13T06:40:21.148 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/2406930292", 2024-09-13T06:40:21.148 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 88 2024-09-13T06:40:21.149 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:21.149 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:21.149 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:21.149 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:21.149 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.362174+0000", 2024-09-13T06:40:21.149 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:21.149 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:21.149 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:21.149 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:21.149 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.362174+0000", 2024-09-13T06:40:21.149 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:21.149 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:21.149 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:21.150 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:21.150 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.362172+0000", 2024-09-13T06:40:21.150 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999986 2024-09-13T06:40:21.150 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:21.150 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:21.150 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:21.150 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.362183+0000", 2024-09-13T06:40:21.150 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.081e-05 2024-09-13T06:40:21.150 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:21.150 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:21.150 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:21.150 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.362205+0000", 2024-09-13T06:40:21.150 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.1897000000000001e-05 2024-09-13T06:40:21.150 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:21.151 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:21.151 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:21.151 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.362221+0000", 2024-09-13T06:40:21.151 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5353e-05 2024-09-13T06:40:21.151 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:21.151 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:21.151 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:21.151 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.369202+0000", 2024-09-13T06:40:21.151 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0069816219999999998 2024-09-13T06:40:21.151 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:21.151 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:21.151 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:21.151 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.369323+0000", 2024-09-13T06:40:21.151 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000121156 2024-09-13T06:40:21.152 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:21.152 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:21.152 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 0", 2024-09-13T06:40:21.152 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.369683+0000", 2024-09-13T06:40:21.152 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00035930700000000001 2024-09-13T06:40:21.152 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:21.152 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:21.152 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:40:21.152 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.371448+0000", 2024-09-13T06:40:21.152 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.001765043 2024-09-13T06:40:21.152 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:21.152 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:21.152 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-13T06:40:21.153 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.374156+0000", 2024-09-13T06:40:21.153 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.002707999 2024-09-13T06:40:21.153 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:21.153 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:21.153 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-13T06:40:21.153 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.374243+0000", 2024-09-13T06:40:21.153 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6873000000000007e-05 2024-09-13T06:40:21.153 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:21.153 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:21.153 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:21.153 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.374345+0000", 2024-09-13T06:40:21.153 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00010272600000000001 2024-09-13T06:40:21.153 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:21.153 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:21.154 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:21.154 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:21.154 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:21.154 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4154.0:108 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-13T06:40:21.154 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:11.524074+0000", 2024-09-13T06:40:21.154 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 69.603716734000002, 2024-09-13T06:40:21.154 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.012736235, 2024-09-13T06:40:21.154 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:21.154 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:40:21.154 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:21.154 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4154", 2024-09-13T06:40:21.154 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/2406930292", 2024-09-13T06:40:21.154 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 108 2024-09-13T06:40:21.155 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:21.155 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:21.155 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:21.155 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:21.155 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.524074+0000", 2024-09-13T06:40:21.155 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:21.155 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:21.155 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:21.155 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:21.155 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.524074+0000", 2024-09-13T06:40:21.155 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:21.155 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:21.155 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:21.155 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:21.156 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.524073+0000", 2024-09-13T06:40:21.156 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:21.156 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:21.156 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:21.156 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:21.156 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.524084+0000", 2024-09-13T06:40:21.156 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1026000000000001e-05 2024-09-13T06:40:21.156 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:21.156 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:21.156 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:21.156 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.524102+0000", 2024-09-13T06:40:21.156 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7992999999999999e-05 2024-09-13T06:40:21.156 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:21.157 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:21.157 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:21.157 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.524140+0000", 2024-09-13T06:40:21.157 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.8277e-05 2024-09-13T06:40:21.157 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:21.157 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:21.157 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:21.157 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.528884+0000", 2024-09-13T06:40:21.157 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.004743761 2024-09-13T06:40:21.157 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:21.157 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:21.157 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:21.157 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.529006+0000", 2024-09-13T06:40:21.158 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000121829 2024-09-13T06:40:21.158 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:21.158 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:21.158 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 0", 2024-09-13T06:40:21.158 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.529196+0000", 2024-09-13T06:40:21.158 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000189731 2024-09-13T06:40:21.158 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:21.158 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:21.158 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:40:21.158 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.535697+0000", 2024-09-13T06:40:21.158 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0065011499999999998 2024-09-13T06:40:21.158 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:21.158 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:21.158 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-13T06:40:21.159 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.536644+0000", 2024-09-13T06:40:21.159 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00094732900000000001 2024-09-13T06:40:21.159 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:21.159 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:21.159 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-13T06:40:21.159 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.536712+0000", 2024-09-13T06:40:21.159 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.8303e-05 2024-09-13T06:40:21.159 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:21.159 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:21.159 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:21.159 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.536810+0000", 2024-09-13T06:40:21.159 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.7918999999999995e-05 2024-09-13T06:40:21.159 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:21.160 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:21.160 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:21.160 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:21.160 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:21.160 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4154.0:109 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-13T06:40:21.160 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:11.524169+0000", 2024-09-13T06:40:21.160 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 69.603621808, 2024-09-13T06:40:21.160 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.013995285999999999, 2024-09-13T06:40:21.160 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:21.160 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:40:21.160 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:21.160 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4154", 2024-09-13T06:40:21.160 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/2406930292", 2024-09-13T06:40:21.161 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 109 2024-09-13T06:40:21.161 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:21.161 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:21.161 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:21.161 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:21.161 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.524169+0000", 2024-09-13T06:40:21.161 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:21.161 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:21.161 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:21.161 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:21.161 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.524169+0000", 2024-09-13T06:40:21.161 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:21.161 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:21.162 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:21.162 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:21.162 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.524168+0000", 2024-09-13T06:40:21.162 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:21.162 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:21.162 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:21.162 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:21.162 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.524427+0000", 2024-09-13T06:40:21.162 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00025929799999999998 2024-09-13T06:40:21.162 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:21.162 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:21.162 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:21.162 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.524451+0000", 2024-09-13T06:40:21.163 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.3686e-05 2024-09-13T06:40:21.163 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:21.163 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:21.163 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:21.163 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.524468+0000", 2024-09-13T06:40:21.163 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7577000000000001e-05 2024-09-13T06:40:21.163 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:21.163 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:21.163 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:21.163 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.530416+0000", 2024-09-13T06:40:21.163 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0059474080000000004 2024-09-13T06:40:21.163 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:21.163 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:21.164 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:21.164 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.530553+0000", 2024-09-13T06:40:21.164 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000137742 2024-09-13T06:40:21.164 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:21.164 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:21.164 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 0", 2024-09-13T06:40:21.164 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.530749+0000", 2024-09-13T06:40:21.164 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000195608 2024-09-13T06:40:21.164 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:21.164 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:21.164 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-13T06:40:21.164 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.536836+0000", 2024-09-13T06:40:21.164 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.006086546 2024-09-13T06:40:21.165 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:21.165 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:21.165 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:40:21.165 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.538038+0000", 2024-09-13T06:40:21.165 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0012019509999999999 2024-09-13T06:40:21.165 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:21.165 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:21.165 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-13T06:40:21.165 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.538106+0000", 2024-09-13T06:40:21.165 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.8923000000000004e-05 2024-09-13T06:40:21.165 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:21.165 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:21.166 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:21.166 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.538164+0000", 2024-09-13T06:40:21.166 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.7729999999999998e-05 2024-09-13T06:40:21.166 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:21.166 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:21.166 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:21.166 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:21.166 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:21.166 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4154.0:110 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-13T06:40:21.166 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:11.524488+0000", 2024-09-13T06:40:21.166 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 69.603302330999995, 2024-09-13T06:40:21.166 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.013976323000000001, 2024-09-13T06:40:21.166 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:21.166 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:40:21.167 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:21.167 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4154", 2024-09-13T06:40:21.167 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/2406930292", 2024-09-13T06:40:21.167 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 110 2024-09-13T06:40:21.167 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:21.167 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:21.167 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:21.167 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:21.167 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.524488+0000", 2024-09-13T06:40:21.167 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:21.167 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:21.167 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:21.167 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:21.167 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.524488+0000", 2024-09-13T06:40:21.168 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:21.168 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:21.168 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:21.168 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:21.168 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.524487+0000", 2024-09-13T06:40:21.168 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999986 2024-09-13T06:40:21.168 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:21.168 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:21.168 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:21.168 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.524498+0000", 2024-09-13T06:40:21.168 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1579999999999999e-05 2024-09-13T06:40:21.168 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:21.168 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:21.169 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:21.169 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.524516+0000", 2024-09-13T06:40:21.169 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7776000000000001e-05 2024-09-13T06:40:21.169 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:21.169 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:21.169 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:21.169 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.524530+0000", 2024-09-13T06:40:21.169 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3896999999999999e-05 2024-09-13T06:40:21.169 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:21.169 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:21.169 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:21.169 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.532254+0000", 2024-09-13T06:40:21.169 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0077239409999999998 2024-09-13T06:40:21.170 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:21.170 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:21.170 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:21.170 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.532371+0000", 2024-09-13T06:40:21.170 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000117176 2024-09-13T06:40:21.170 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:21.170 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:21.170 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 0", 2024-09-13T06:40:21.170 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.532551+0000", 2024-09-13T06:40:21.170 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00018004100000000001 2024-09-13T06:40:21.170 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:21.170 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:21.170 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:40:21.170 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.538280+0000", 2024-09-13T06:40:21.171 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0057289230000000003 2024-09-13T06:40:21.171 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:21.171 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:21.171 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-13T06:40:21.171 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.538294+0000", 2024-09-13T06:40:21.171 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.4070000000000001e-05 2024-09-13T06:40:21.171 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:21.171 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:21.171 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-13T06:40:21.171 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.538368+0000", 2024-09-13T06:40:21.171 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.3604999999999997e-05 2024-09-13T06:40:21.171 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:21.171 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:21.172 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:21.172 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.538465+0000", 2024-09-13T06:40:21.172 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6830000000000006e-05 2024-09-13T06:40:21.172 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:21.172 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:21.172 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:21.172 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:21.172 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:21.172 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4154.0:111 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-13T06:40:21.172 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:11.524546+0000", 2024-09-13T06:40:21.172 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 69.603244896999996, 2024-09-13T06:40:21.172 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.016412307000000001, 2024-09-13T06:40:21.172 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:21.173 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:40:21.173 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:21.173 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4154", 2024-09-13T06:40:21.173 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/2406930292", 2024-09-13T06:40:21.173 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 111 2024-09-13T06:40:21.173 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:21.173 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:21.173 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:21.173 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:21.173 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.524546+0000", 2024-09-13T06:40:21.173 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:21.173 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:21.173 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:21.173 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:21.174 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.524546+0000", 2024-09-13T06:40:21.174 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:21.174 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:21.174 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:21.174 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:21.174 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.524545+0000", 2024-09-13T06:40:21.174 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:21.174 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:21.174 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:21.174 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:21.174 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.524555+0000", 2024-09-13T06:40:21.174 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0176e-05 2024-09-13T06:40:21.174 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:21.175 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:21.175 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:21.175 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.524577+0000", 2024-09-13T06:40:21.175 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.1756999999999999e-05 2024-09-13T06:40:21.175 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:21.175 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:21.175 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:21.175 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.524592+0000", 2024-09-13T06:40:21.175 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5345999999999998e-05 2024-09-13T06:40:21.175 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:21.175 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:21.175 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:21.175 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.533407+0000", 2024-09-13T06:40:21.175 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0088150559999999999 2024-09-13T06:40:21.176 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:21.176 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:21.176 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:21.176 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.533523+0000", 2024-09-13T06:40:21.176 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000116099 2024-09-13T06:40:21.176 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:21.176 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:21.176 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 0", 2024-09-13T06:40:21.176 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.533734+0000", 2024-09-13T06:40:21.176 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000211005 2024-09-13T06:40:21.176 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:21.176 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:21.176 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-13T06:40:21.177 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.538484+0000", 2024-09-13T06:40:21.177 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0047494900000000003 2024-09-13T06:40:21.177 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:21.177 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:21.177 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:40:21.177 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.540823+0000", 2024-09-13T06:40:21.177 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0023390889999999999 2024-09-13T06:40:21.177 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:21.177 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:21.177 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-13T06:40:21.177 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.540898+0000", 2024-09-13T06:40:21.177 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5449000000000002e-05 2024-09-13T06:40:21.177 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:21.178 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:21.178 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:21.178 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.540958+0000", 2024-09-13T06:40:21.178 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.9889999999999997e-05 2024-09-13T06:40:21.178 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:21.178 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:21.178 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:21.178 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:21.178 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:21.178 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4154.0:112 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-13T06:40:21.178 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:11.524610+0000", 2024-09-13T06:40:21.178 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 69.603181178, 2024-09-13T06:40:21.178 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.016538458999999998, 2024-09-13T06:40:21.178 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:21.179 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:40:21.179 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:21.179 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4154", 2024-09-13T06:40:21.179 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/2406930292", 2024-09-13T06:40:21.179 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 112 2024-09-13T06:40:21.179 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:21.179 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:21.179 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:21.179 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:21.179 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.524610+0000", 2024-09-13T06:40:21.179 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:21.179 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:21.179 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:21.180 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:21.180 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.524610+0000", 2024-09-13T06:40:21.180 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:21.180 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:21.180 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:21.180 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:21.180 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.524608+0000", 2024-09-13T06:40:21.180 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:21.180 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:21.180 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:21.180 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:21.180 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.524826+0000", 2024-09-13T06:40:21.180 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000217226 2024-09-13T06:40:21.181 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:21.181 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:21.181 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:21.181 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.524848+0000", 2024-09-13T06:40:21.181 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.2802999999999998e-05 2024-09-13T06:40:21.181 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:21.181 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:21.181 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:21.181 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.524906+0000", 2024-09-13T06:40:21.181 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.7878999999999999e-05 2024-09-13T06:40:21.181 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:21.181 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:21.181 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:21.182 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.534402+0000", 2024-09-13T06:40:21.182 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0094956769999999992 2024-09-13T06:40:21.182 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:21.182 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:21.182 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:21.182 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.534512+0000", 2024-09-13T06:40:21.182 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000110493 2024-09-13T06:40:21.182 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:21.182 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:21.182 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 0", 2024-09-13T06:40:21.182 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.534688+0000", 2024-09-13T06:40:21.182 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00017564499999999999 2024-09-13T06:40:21.182 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:21.182 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:21.183 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-13T06:40:21.183 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.538493+0000", 2024-09-13T06:40:21.183 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0038051399999999998 2024-09-13T06:40:21.183 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:21.183 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:21.183 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:40:21.183 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.541030+0000", 2024-09-13T06:40:21.183 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0025368080000000002 2024-09-13T06:40:21.183 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:21.183 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:21.183 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-13T06:40:21.183 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.541097+0000", 2024-09-13T06:40:21.183 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.6933000000000004e-05 2024-09-13T06:40:21.183 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:21.184 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:21.184 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:21.184 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.541148+0000", 2024-09-13T06:40:21.184 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.1008999999999999e-05 2024-09-13T06:40:21.184 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:21.184 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:21.184 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:21.184 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:21.184 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:21.184 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4154.0:113 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-13T06:40:21.184 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:11.524940+0000", 2024-09-13T06:40:21.184 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 69.602850214, 2024-09-13T06:40:21.184 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.017201570999999999, 2024-09-13T06:40:21.185 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:21.185 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:40:21.185 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:21.185 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4154", 2024-09-13T06:40:21.185 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/2406930292", 2024-09-13T06:40:21.185 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 113 2024-09-13T06:40:21.185 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:21.185 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:21.185 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:21.185 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:21.185 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.524940+0000", 2024-09-13T06:40:21.185 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:21.185 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:21.186 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:21.186 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:21.186 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.524940+0000", 2024-09-13T06:40:21.186 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:21.186 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:21.186 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:21.186 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:21.186 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.524938+0000", 2024-09-13T06:40:21.186 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999981 2024-09-13T06:40:21.186 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:21.186 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:21.186 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:21.186 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.524951+0000", 2024-09-13T06:40:21.187 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2993000000000001e-05 2024-09-13T06:40:21.187 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:21.187 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:21.187 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:21.187 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.524976+0000", 2024-09-13T06:40:21.187 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.4216999999999999e-05 2024-09-13T06:40:21.187 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:21.187 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:21.187 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:21.187 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.525000+0000", 2024-09-13T06:40:21.187 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.3986e-05 2024-09-13T06:40:21.187 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:21.187 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:21.187 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:21.188 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.535786+0000", 2024-09-13T06:40:21.188 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.010786733999999999 2024-09-13T06:40:21.188 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:21.188 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:21.188 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:21.188 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.535916+0000", 2024-09-13T06:40:21.188 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000129865 2024-09-13T06:40:21.188 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:21.188 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:21.188 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 0", 2024-09-13T06:40:21.188 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.536106+0000", 2024-09-13T06:40:21.188 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000190046 2024-09-13T06:40:21.188 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:21.189 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:21.189 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-13T06:40:21.189 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.540977+0000", 2024-09-13T06:40:21.189 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0048708730000000004 2024-09-13T06:40:21.189 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:21.189 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:21.189 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:40:21.189 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.542023+0000", 2024-09-13T06:40:21.189 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0010456179999999999 2024-09-13T06:40:21.189 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:21.189 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:21.189 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-13T06:40:21.189 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.542091+0000", 2024-09-13T06:40:21.189 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.7840000000000001e-05 2024-09-13T06:40:21.190 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:21.190 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:21.190 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:21.190 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.542142+0000", 2024-09-13T06:40:21.190 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.1399e-05 2024-09-13T06:40:21.190 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:21.190 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:21.190 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:21.190 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:21.190 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:21.190 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4154.0:114 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-13T06:40:21.190 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:11.525025+0000", 2024-09-13T06:40:21.190 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 69.602765335000001, 2024-09-13T06:40:21.191 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.017310847000000001, 2024-09-13T06:40:21.191 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:21.191 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:40:21.191 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:21.191 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4154", 2024-09-13T06:40:21.191 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/2406930292", 2024-09-13T06:40:21.191 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 114 2024-09-13T06:40:21.191 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:21.191 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:21.191 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:21.191 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:21.191 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.525025+0000", 2024-09-13T06:40:21.191 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:21.192 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:21.192 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:21.192 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:21.192 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.525025+0000", 2024-09-13T06:40:21.192 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:21.192 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:21.192 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:21.192 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:21.192 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.525024+0000", 2024-09-13T06:40:21.192 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999986 2024-09-13T06:40:21.192 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:21.192 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:21.192 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:21.193 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.525035+0000", 2024-09-13T06:40:21.193 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1413999999999999e-05 2024-09-13T06:40:21.193 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:21.193 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:21.193 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:21.193 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.525054+0000", 2024-09-13T06:40:21.193 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.8723e-05 2024-09-13T06:40:21.193 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:21.193 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:21.193 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:21.193 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.525068+0000", 2024-09-13T06:40:21.193 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.4022999999999999e-05 2024-09-13T06:40:21.193 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:21.193 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:21.194 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:21.194 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.536923+0000", 2024-09-13T06:40:21.194 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.011854821999999999 2024-09-13T06:40:21.194 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:21.194 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:21.194 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:21.194 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.537048+0000", 2024-09-13T06:40:21.194 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000125399 2024-09-13T06:40:21.194 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:21.194 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:21.194 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 0", 2024-09-13T06:40:21.194 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.537293+0000", 2024-09-13T06:40:21.194 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00024499500000000002 2024-09-13T06:40:21.194 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:21.195 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:21.195 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-13T06:40:21.195 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.541962+0000", 2024-09-13T06:40:21.195 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0046680940000000002 2024-09-13T06:40:21.195 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:21.195 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:21.195 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:40:21.195 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.542218+0000", 2024-09-13T06:40:21.195 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00025668199999999999 2024-09-13T06:40:21.195 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:21.195 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:21.195 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-13T06:40:21.195 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.542286+0000", 2024-09-13T06:40:21.195 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.7565999999999997e-05 2024-09-13T06:40:21.196 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:21.196 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:21.196 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:21.196 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.542336+0000", 2024-09-13T06:40:21.196 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.0429000000000001e-05 2024-09-13T06:40:21.196 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:21.196 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:21.196 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:21.196 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:21.196 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:21.196 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4154.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-13T06:40:21.196 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:11.525085+0000", 2024-09-13T06:40:21.196 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 69.602706155000007, 2024-09-13T06:40:21.197 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.019358490999999999, 2024-09-13T06:40:21.197 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:21.197 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:40:21.197 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:21.197 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4154", 2024-09-13T06:40:21.197 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/2406930292", 2024-09-13T06:40:21.197 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 115 2024-09-13T06:40:21.197 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:21.197 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:21.197 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:21.197 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:21.197 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.525085+0000", 2024-09-13T06:40:21.197 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:21.197 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:21.198 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:21.198 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:21.198 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.525085+0000", 2024-09-13T06:40:21.198 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:21.198 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:21.198 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:21.198 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:21.198 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.525083+0000", 2024-09-13T06:40:21.198 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:21.198 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:21.198 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:21.198 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:21.198 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.525302+0000", 2024-09-13T06:40:21.198 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00021804499999999999 2024-09-13T06:40:21.199 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:21.199 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:21.199 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:21.199 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.525324+0000", 2024-09-13T06:40:21.199 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.2147e-05 2024-09-13T06:40:21.199 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:21.199 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:21.199 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:21.199 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.525340+0000", 2024-09-13T06:40:21.199 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5879000000000002e-05 2024-09-13T06:40:21.199 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:21.199 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:21.199 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:21.200 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.538555+0000", 2024-09-13T06:40:21.200 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.013215499 2024-09-13T06:40:21.200 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:21.200 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:21.200 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:21.200 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.538703+0000", 2024-09-13T06:40:21.200 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00014755200000000001 2024-09-13T06:40:21.200 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:21.200 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:21.200 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 0", 2024-09-13T06:40:21.200 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.538967+0000", 2024-09-13T06:40:21.200 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00026453799999999998 2024-09-13T06:40:21.200 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:21.201 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:21.201 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-13T06:40:21.201 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.541969+0000", 2024-09-13T06:40:21.201 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00300184 2024-09-13T06:40:21.201 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:21.201 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:21.201 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:40:21.201 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.544287+0000", 2024-09-13T06:40:21.201 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0023178890000000001 2024-09-13T06:40:21.201 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:21.201 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:21.201 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-13T06:40:21.201 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.544378+0000", 2024-09-13T06:40:21.201 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.1366000000000006e-05 2024-09-13T06:40:21.202 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:21.202 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:21.202 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:21.202 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.544443+0000", 2024-09-13T06:40:21.202 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.4826000000000006e-05 2024-09-13T06:40:21.202 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:21.202 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:21.202 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:21.202 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:21.202 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:21.202 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4154.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-13T06:40:21.202 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:11.525359+0000", 2024-09-13T06:40:21.202 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 69.602432127, 2024-09-13T06:40:21.203 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.019359514000000001, 2024-09-13T06:40:21.203 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:21.203 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:40:21.203 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:21.203 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4154", 2024-09-13T06:40:21.203 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/2406930292", 2024-09-13T06:40:21.203 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 116 2024-09-13T06:40:21.203 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:21.203 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:21.203 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:21.203 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:21.203 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.525359+0000", 2024-09-13T06:40:21.203 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:21.203 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:21.204 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:21.204 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:21.204 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.525359+0000", 2024-09-13T06:40:21.204 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:21.204 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:21.204 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:21.204 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:21.204 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.525357+0000", 2024-09-13T06:40:21.204 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999981 2024-09-13T06:40:21.204 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:21.204 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:21.204 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:21.204 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.525369+0000", 2024-09-13T06:40:21.204 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1647e-05 2024-09-13T06:40:21.205 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:21.205 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:21.205 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:21.205 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.525386+0000", 2024-09-13T06:40:21.205 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7762999999999999e-05 2024-09-13T06:40:21.205 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:21.205 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:21.205 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:21.205 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.525400+0000", 2024-09-13T06:40:21.205 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.4053000000000001e-05 2024-09-13T06:40:21.205 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:21.205 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:21.205 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:21.206 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.539897+0000", 2024-09-13T06:40:21.206 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.014497128999999999 2024-09-13T06:40:21.206 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:21.206 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:21.206 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:21.206 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.540022+0000", 2024-09-13T06:40:21.206 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00012416599999999999 2024-09-13T06:40:21.206 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:21.206 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:21.206 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 0", 2024-09-13T06:40:21.206 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.540199+0000", 2024-09-13T06:40:21.206 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00017705499999999999 2024-09-13T06:40:21.206 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:21.206 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:21.207 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-13T06:40:21.207 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.542161+0000", 2024-09-13T06:40:21.207 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0019622210000000001 2024-09-13T06:40:21.207 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:21.207 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:21.207 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:40:21.207 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.544529+0000", 2024-09-13T06:40:21.207 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0023684690000000002 2024-09-13T06:40:21.207 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:21.207 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:21.207 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-13T06:40:21.207 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.544614+0000", 2024-09-13T06:40:21.207 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.4711999999999998e-05 2024-09-13T06:40:21.207 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:21.208 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:21.208 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:21.208 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.544718+0000", 2024-09-13T06:40:21.208 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000103986 2024-09-13T06:40:21.208 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:21.208 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:21.208 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:21.208 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:21.208 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:21.208 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4154.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-13T06:40:21.208 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:11.525416+0000", 2024-09-13T06:40:21.208 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 69.602374573999995, 2024-09-13T06:40:21.208 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.019501830000000001, 2024-09-13T06:40:21.209 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:21.209 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:40:21.209 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:21.209 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4154", 2024-09-13T06:40:21.209 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/2406930292", 2024-09-13T06:40:21.209 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 117 2024-09-13T06:40:21.209 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:21.209 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:21.209 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:21.209 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:21.209 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.525416+0000", 2024-09-13T06:40:21.209 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:21.209 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:21.209 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:21.210 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:21.210 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.525416+0000", 2024-09-13T06:40:21.210 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:21.210 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:21.210 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:21.210 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:21.210 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.525415+0000", 2024-09-13T06:40:21.210 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999986 2024-09-13T06:40:21.210 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:21.210 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:21.210 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:21.210 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.525426+0000", 2024-09-13T06:40:21.210 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.101e-05 2024-09-13T06:40:21.210 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:21.211 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:21.211 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:21.211 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.525444+0000", 2024-09-13T06:40:21.211 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.768e-05 2024-09-13T06:40:21.211 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:21.211 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:21.211 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:21.211 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.525463+0000", 2024-09-13T06:40:21.211 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.9026999999999999e-05 2024-09-13T06:40:21.211 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:21.211 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:21.211 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:21.211 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.541203+0000", 2024-09-13T06:40:21.212 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.015740309000000001 2024-09-13T06:40:21.212 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:21.212 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:21.212 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:21.212 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.541330+0000", 2024-09-13T06:40:21.212 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000126976 2024-09-13T06:40:21.212 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:21.212 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:21.212 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 0", 2024-09-13T06:40:21.212 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.541522+0000", 2024-09-13T06:40:21.212 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00019165100000000001 2024-09-13T06:40:21.212 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:21.212 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:21.212 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-13T06:40:21.213 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.542798+0000", 2024-09-13T06:40:21.213 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.001276424 2024-09-13T06:40:21.213 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:21.213 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:21.213 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:40:21.213 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.544795+0000", 2024-09-13T06:40:21.213 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0019966540000000001 2024-09-13T06:40:21.213 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:21.213 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:21.213 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-13T06:40:21.213 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.544868+0000", 2024-09-13T06:40:21.213 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.3096000000000006e-05 2024-09-13T06:40:21.213 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:21.214 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:21.214 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:21.214 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.544918+0000", 2024-09-13T06:40:21.214 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.0226999999999999e-05 2024-09-13T06:40:21.214 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:21.214 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:21.214 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:21.214 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:21.214 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:21.214 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4154.0:136 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-13T06:40:21.214 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:12.006369+0000", 2024-09-13T06:40:21.214 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 69.121421225000006, 2024-09-13T06:40:21.214 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.012052078000000001, 2024-09-13T06:40:21.214 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:21.215 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:40:21.215 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:21.215 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4154", 2024-09-13T06:40:21.215 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/2406930292", 2024-09-13T06:40:21.215 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 136 2024-09-13T06:40:21.215 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:21.215 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:21.215 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:21.215 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:21.215 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.006369+0000", 2024-09-13T06:40:21.215 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:21.215 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:21.215 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:21.215 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:21.216 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.006369+0000", 2024-09-13T06:40:21.216 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:21.216 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:21.216 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:21.216 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:21.216 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.006369+0000", 2024-09-13T06:40:21.216 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:21.216 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:21.216 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:21.216 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:21.216 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.006372+0000", 2024-09-13T06:40:21.217 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.0630000000000002e-06 2024-09-13T06:40:21.217 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:21.217 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:21.217 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:21.217 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.006377+0000", 2024-09-13T06:40:21.217 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.6079999999999998e-06 2024-09-13T06:40:21.217 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:21.217 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:21.217 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:21.217 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.006384+0000", 2024-09-13T06:40:21.217 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.8560000000000001e-06 2024-09-13T06:40:21.217 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:21.217 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:21.217 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:21.218 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.008357+0000", 2024-09-13T06:40:21.218 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0019733839999999999 2024-09-13T06:40:21.218 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:21.218 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:21.218 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:21.218 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.008406+0000", 2024-09-13T06:40:21.218 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.9023000000000001e-05 2024-09-13T06:40:21.218 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:21.218 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:21.218 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 0", 2024-09-13T06:40:21.218 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.008489+0000", 2024-09-13T06:40:21.218 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.2649000000000001e-05 2024-09-13T06:40:21.218 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:21.219 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:21.219 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-13T06:40:21.219 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.011012+0000", 2024-09-13T06:40:21.219 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0025236880000000001 2024-09-13T06:40:21.219 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:21.219 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:21.219 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:40:21.219 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.018382+0000", 2024-09-13T06:40:21.219 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.007369596 2024-09-13T06:40:21.219 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:21.219 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:21.219 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-13T06:40:21.219 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.018405+0000", 2024-09-13T06:40:21.219 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.2670000000000001e-05 2024-09-13T06:40:21.220 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:21.220 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:21.220 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:21.220 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.018422+0000", 2024-09-13T06:40:21.220 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6864999999999999e-05 2024-09-13T06:40:21.220 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:21.220 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:21.220 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:21.220 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:21.220 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:21.220 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4154.0:137 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-13T06:40:21.220 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:12.006450+0000", 2024-09-13T06:40:21.220 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 69.121340896000007, 2024-09-13T06:40:21.220 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.012040990999999999, 2024-09-13T06:40:21.221 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:21.221 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:40:21.221 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:21.221 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4154", 2024-09-13T06:40:21.221 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/2406930292", 2024-09-13T06:40:21.221 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 137 2024-09-13T06:40:21.221 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:21.221 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:21.221 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:21.221 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:21.221 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.006450+0000", 2024-09-13T06:40:21.221 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:21.221 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:21.222 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:21.222 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:21.222 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.006450+0000", 2024-09-13T06:40:21.222 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:21.222 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:21.222 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:21.222 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:21.222 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.006449+0000", 2024-09-13T06:40:21.222 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:21.222 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:21.222 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:21.222 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:21.222 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.006549+0000", 2024-09-13T06:40:21.222 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.9847999999999997e-05 2024-09-13T06:40:21.223 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:21.223 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:21.223 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:21.223 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.006560+0000", 2024-09-13T06:40:21.223 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1012000000000001e-05 2024-09-13T06:40:21.223 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:21.223 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:21.223 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:21.223 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.006566+0000", 2024-09-13T06:40:21.223 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.1630000000000001e-06 2024-09-13T06:40:21.223 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:21.223 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:21.223 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:21.223 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.008760+0000", 2024-09-13T06:40:21.224 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0021934659999999998 2024-09-13T06:40:21.224 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:21.224 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:21.224 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:21.224 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.008803+0000", 2024-09-13T06:40:21.224 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.3492000000000003e-05 2024-09-13T06:40:21.224 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:21.224 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:21.224 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 0", 2024-09-13T06:40:21.224 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.008879+0000", 2024-09-13T06:40:21.224 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5252000000000004e-05 2024-09-13T06:40:21.224 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:21.224 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:21.224 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-13T06:40:21.225 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.011015+0000", 2024-09-13T06:40:21.225 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0021362349999999998 2024-09-13T06:40:21.225 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:21.225 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:21.225 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:40:21.225 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.018452+0000", 2024-09-13T06:40:21.225 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.007436865 2024-09-13T06:40:21.225 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:21.225 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:21.225 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-13T06:40:21.225 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.018474+0000", 2024-09-13T06:40:21.225 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.2149000000000001e-05 2024-09-13T06:40:21.225 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:21.225 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:21.226 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:21.226 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.018491+0000", 2024-09-13T06:40:21.226 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6983999999999999e-05 2024-09-13T06:40:21.226 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:21.226 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:21.226 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:21.226 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:21.226 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:21.226 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4154.0:139 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-13T06:40:21.226 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:12.006595+0000", 2024-09-13T06:40:21.226 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 69.121195577999998, 2024-09-13T06:40:21.226 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.012024933999999999, 2024-09-13T06:40:21.226 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:21.227 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:40:21.227 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:21.227 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4154", 2024-09-13T06:40:21.227 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/2406930292", 2024-09-13T06:40:21.227 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 139 2024-09-13T06:40:21.227 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:21.227 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:21.227 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:21.227 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:21.227 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.006595+0000", 2024-09-13T06:40:21.227 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:21.227 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:21.227 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:21.227 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:21.228 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.006595+0000", 2024-09-13T06:40:21.228 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:21.228 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:21.228 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:21.228 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:21.228 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.006595+0000", 2024-09-13T06:40:21.228 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:21.228 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:21.228 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:21.228 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:21.228 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.006598+0000", 2024-09-13T06:40:21.228 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.1769999999999998e-06 2024-09-13T06:40:21.228 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:21.229 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:21.229 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:21.229 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.006612+0000", 2024-09-13T06:40:21.229 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.4177e-05 2024-09-13T06:40:21.229 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:21.229 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:21.229 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:21.229 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.006617+0000", 2024-09-13T06:40:21.229 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.561e-06 2024-09-13T06:40:21.229 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:21.229 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:21.229 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:21.229 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.009658+0000", 2024-09-13T06:40:21.230 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0030413369999999999 2024-09-13T06:40:21.230 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:21.230 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:21.230 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:21.230 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.009707+0000", 2024-09-13T06:40:21.230 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.9089999999999999e-05 2024-09-13T06:40:21.230 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:21.230 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:21.230 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 0", 2024-09-13T06:40:21.230 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.009795+0000", 2024-09-13T06:40:21.230 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.7619000000000003e-05 2024-09-13T06:40:21.230 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:21.230 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:21.230 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-13T06:40:21.231 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.011021+0000", 2024-09-13T06:40:21.231 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0012266289999999999 2024-09-13T06:40:21.231 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:21.231 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:21.231 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:40:21.231 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.018582+0000", 2024-09-13T06:40:21.231 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0075603399999999996 2024-09-13T06:40:21.231 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:21.231 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:21.231 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-13T06:40:21.231 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.018603+0000", 2024-09-13T06:40:21.231 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.1795999999999999e-05 2024-09-13T06:40:21.231 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:21.231 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:21.232 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:21.232 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.018620+0000", 2024-09-13T06:40:21.232 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6562000000000002e-05 2024-09-13T06:40:21.232 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:21.232 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:21.232 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:21.232 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:21.232 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:21.232 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4154.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-13T06:40:21.232 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:12.006689+0000", 2024-09-13T06:40:21.232 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 69.121101389000003, 2024-09-13T06:40:21.232 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.012427258, 2024-09-13T06:40:21.232 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:21.233 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:40:21.233 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:21.233 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4154", 2024-09-13T06:40:21.233 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/2406930292", 2024-09-13T06:40:21.233 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 140 2024-09-13T06:40:21.233 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:21.233 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:21.233 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:21.233 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:21.233 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.006689+0000", 2024-09-13T06:40:21.233 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:21.233 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:21.233 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:21.233 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:21.234 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.006689+0000", 2024-09-13T06:40:21.234 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:21.234 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:21.234 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:21.234 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:21.234 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.006689+0000", 2024-09-13T06:40:21.234 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:21.234 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:21.234 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:21.234 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:21.234 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.006795+0000", 2024-09-13T06:40:21.234 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00010662699999999999 2024-09-13T06:40:21.234 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:21.234 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:21.235 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:21.235 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.006804+0000", 2024-09-13T06:40:21.235 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.055e-06 2024-09-13T06:40:21.235 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:21.235 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:21.235 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:21.235 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.006808+0000", 2024-09-13T06:40:21.235 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.7450000000000003e-06 2024-09-13T06:40:21.235 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:21.235 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:21.235 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:21.235 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.010066+0000", 2024-09-13T06:40:21.235 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0032579570000000001 2024-09-13T06:40:21.236 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:21.236 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:21.236 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:21.236 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.010111+0000", 2024-09-13T06:40:21.236 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.4563e-05 2024-09-13T06:40:21.236 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:21.236 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:21.236 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 0", 2024-09-13T06:40:21.236 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.010185+0000", 2024-09-13T06:40:21.236 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.4108000000000003e-05 2024-09-13T06:40:21.236 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:21.236 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:21.236 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-13T06:40:21.236 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.011161+0000", 2024-09-13T06:40:21.237 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00097629200000000002 2024-09-13T06:40:21.237 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:21.237 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:21.237 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:40:21.237 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.019061+0000", 2024-09-13T06:40:21.237 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0079001939999999993 2024-09-13T06:40:21.237 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:21.237 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:21.237 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-13T06:40:21.237 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.019095+0000", 2024-09-13T06:40:21.237 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.3200000000000001e-05 2024-09-13T06:40:21.237 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:21.237 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:21.237 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:21.238 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.019117+0000", 2024-09-13T06:40:21.238 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.1985e-05 2024-09-13T06:40:21.238 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:21.238 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:21.238 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:21.238 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:21.238 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:21.238 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4154.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-13T06:40:21.238 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:12.006814+0000", 2024-09-13T06:40:21.238 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 69.120976205000005, 2024-09-13T06:40:21.238 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.012896405999999999, 2024-09-13T06:40:21.238 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:21.238 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:40:21.238 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:21.239 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4154", 2024-09-13T06:40:21.239 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/2406930292", 2024-09-13T06:40:21.239 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 141 2024-09-13T06:40:21.239 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:21.239 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:21.239 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:21.239 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:21.239 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.006814+0000", 2024-09-13T06:40:21.239 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:21.239 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:21.239 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:21.239 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:21.239 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.006814+0000", 2024-09-13T06:40:21.240 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:21.240 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:21.240 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:21.240 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:21.240 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.006814+0000", 2024-09-13T06:40:21.240 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:21.240 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:21.240 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:21.240 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:21.240 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.006818+0000", 2024-09-13T06:40:21.240 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.8840000000000004e-06 2024-09-13T06:40:21.240 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:21.240 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:21.240 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:21.241 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.006834+0000", 2024-09-13T06:40:21.241 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6133999999999998e-05 2024-09-13T06:40:21.241 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:21.241 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:21.241 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:21.241 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.006838+0000", 2024-09-13T06:40:21.241 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0879999999999997e-06 2024-09-13T06:40:21.241 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:21.241 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:21.241 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:21.241 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.010586+0000", 2024-09-13T06:40:21.241 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.003747954 2024-09-13T06:40:21.241 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:21.242 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:21.242 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:21.242 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.010630+0000", 2024-09-13T06:40:21.242 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.3736000000000003e-05 2024-09-13T06:40:21.242 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:21.242 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:21.242 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 0", 2024-09-13T06:40:21.242 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.010701+0000", 2024-09-13T06:40:21.242 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.1284000000000004e-05 2024-09-13T06:40:21.242 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:21.242 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:21.242 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-13T06:40:21.242 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.011593+0000", 2024-09-13T06:40:21.242 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00089209300000000005 2024-09-13T06:40:21.243 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:21.243 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:21.243 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:40:21.243 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.019665+0000", 2024-09-13T06:40:21.243 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0080716169999999997 2024-09-13T06:40:21.243 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:21.243 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:21.243 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-13T06:40:21.243 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.019691+0000", 2024-09-13T06:40:21.243 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.6514000000000001e-05 2024-09-13T06:40:21.243 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:21.243 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:21.243 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:21.243 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.019711+0000", 2024-09-13T06:40:21.244 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.9641e-05 2024-09-13T06:40:21.244 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:21.244 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:21.244 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:21.244 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:21.244 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:21.244 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:608 3.11 3:8ebac99f:::rbd_data.11214e25756e.0000000000000007:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-09-13T06:40:21.244 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:34.801988+0000", 2024-09-13T06:40:21.244 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 46.325802817000003, 2024-09-13T06:40:21.244 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.033916448000000002, 2024-09-13T06:40:21.244 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:21.244 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:40:21.244 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:21.245 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:21.245 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:21.245 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 608 2024-09-13T06:40:21.245 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:21.245 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:21.245 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:21.245 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:21.245 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:34.801988+0000", 2024-09-13T06:40:21.245 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:21.245 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:21.245 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:21.245 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:21.245 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:34.801988+0000", 2024-09-13T06:40:21.245 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:21.246 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:21.246 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:21.246 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:21.246 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:34.801985+0000", 2024-09-13T06:40:21.246 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999976 2024-09-13T06:40:21.246 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:21.246 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:21.246 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:21.246 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:34.801999+0000", 2024-09-13T06:40:21.246 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.402e-05 2024-09-13T06:40:21.246 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:21.246 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:21.246 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:21.247 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:34.802031+0000", 2024-09-13T06:40:21.247 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.1582999999999999e-05 2024-09-13T06:40:21.247 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:21.247 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:21.247 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:21.247 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:34.802052+0000", 2024-09-13T06:40:21.247 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.1310000000000001e-05 2024-09-13T06:40:21.247 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:21.247 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:21.247 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:21.247 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:34.802117+0000", 2024-09-13T06:40:21.247 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.5016000000000002e-05 2024-09-13T06:40:21.247 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:21.247 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:21.248 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:21.248 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:34.802254+0000", 2024-09-13T06:40:21.248 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000136186 2024-09-13T06:40:21.248 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:21.248 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:21.248 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 4", 2024-09-13T06:40:21.248 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:34.807944+0000", 2024-09-13T06:40:21.248 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0056906930000000001 2024-09-13T06:40:21.248 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:21.248 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:21.248 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-13T06:40:21.248 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:34.835646+0000", 2024-09-13T06:40:21.248 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.027701546000000001 2024-09-13T06:40:21.249 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:21.249 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:21.249 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:40:21.249 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:34.835754+0000", 2024-09-13T06:40:21.249 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000107889 2024-09-13T06:40:21.249 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:21.249 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:21.249 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-13T06:40:21.249 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:34.835840+0000", 2024-09-13T06:40:21.249 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6621999999999998e-05 2024-09-13T06:40:21.249 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:21.249 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:21.249 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:21.249 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:34.835904+0000", 2024-09-13T06:40:21.250 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.4022999999999993e-05 2024-09-13T06:40:21.250 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:21.250 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:21.250 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:21.250 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:21.250 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:21.250 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:40:21.251 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:40:21.255+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:40:21.252 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-13T06:40:21.352 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:40:21.349+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:40:21.382 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:40:21.382 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-13T06:40:21.383 INFO:teuthology.orchestra.run.smithi081.stdout: "num_ops": 0 2024-09-13T06:40:21.383 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:40:21.396 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-13T06:40:21.453 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:40:21.451+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:40:21.554 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:40:21.555+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:40:21.624 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:40:21.624 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-13T06:40:21.624 INFO:teuthology.orchestra.run.smithi081.stdout: "complaint_time": 30, 2024-09-13T06:40:21.624 INFO:teuthology.orchestra.run.smithi081.stdout: "num_blocked_ops": 0 2024-09-13T06:40:21.624 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:40:21.645 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-13T06:40:21.648 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-13T06:40:21.655 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-13T06:40:21.655+0000 7f86a5f06640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26387) UID: 0 2024-09-13T06:40:21.756 INFO:tasks.ceph.osd.6.smithi139.stderr:2024-09-13T06:40:21.755+0000 7fcd02c5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26385) UID: 0 2024-09-13T06:40:21.831 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:40:21.831 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 20, 2024-09-13T06:40:21.831 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 600, 2024-09-13T06:40:21.832 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [ 2024-09-13T06:40:21.832 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:21.832 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:37801 3.1 3:82e31015:::rbd_object_map.1121d8143c6e.0000000000000019:head [call] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e55)", 2024-09-13T06:40:21.832 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:05.646191+0000", 2024-09-13T06:40:21.832 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 16.187628596, 2024-09-13T06:40:21.832 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.72659507800000001, 2024-09-13T06:40:21.832 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:21.832 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:21.832 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:21.832 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:21.832 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:21.832 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 37801 2024-09-13T06:40:21.833 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:21.833 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:21.833 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:21.833 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:21.833 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:05.646191+0000", 2024-09-13T06:40:21.833 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:21.833 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:21.833 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:21.833 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:21.833 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:05.646191+0000", 2024-09-13T06:40:21.833 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:21.833 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:21.833 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:21.834 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:21.834 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:05.646188+0000", 2024-09-13T06:40:21.834 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999971 2024-09-13T06:40:21.834 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:21.834 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:21.834 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:21.834 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:05.646206+0000", 2024-09-13T06:40:21.834 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8182999999999999e-05 2024-09-13T06:40:21.834 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:21.834 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:21.834 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:21.834 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:05.646237+0000", 2024-09-13T06:40:21.834 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.1071000000000001e-05 2024-09-13T06:40:21.835 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:21.835 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:21.835 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:21.835 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:05.646251+0000", 2024-09-13T06:40:21.835 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3679000000000001e-05 2024-09-13T06:40:21.835 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:21.835 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:21.835 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:21.835 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:05.646321+0000", 2024-09-13T06:40:21.835 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.9831000000000003e-05 2024-09-13T06:40:21.835 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:21.835 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:21.835 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:40:21.836 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:05.646331+0000", 2024-09-13T06:40:21.836 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0242e-05 2024-09-13T06:40:21.836 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:21.836 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:21.836 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:21.836 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.371959+0000", 2024-09-13T06:40:21.836 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.72562817199999996 2024-09-13T06:40:21.836 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:21.836 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:21.836 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:21.836 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.372389+0000", 2024-09-13T06:40:21.836 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00042977400000000001 2024-09-13T06:40:21.837 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:21.837 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:21.837 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:21.837 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.372786+0000", 2024-09-13T06:40:21.837 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00039706099999999999 2024-09-13T06:40:21.837 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:21.837 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:21.837 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:21.837 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:21.837 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:21.837 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43009 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 489472~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:40:21.837 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.644660+0000", 2024-09-13T06:40:21.837 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.18915963399999999, 2024-09-13T06:40:21.838 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123376071, 2024-09-13T06:40:21.838 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:21.838 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:21.838 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:21.838 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:21.838 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:21.838 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43009 2024-09-13T06:40:21.838 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:21.838 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:21.838 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:21.838 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:21.838 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.644660+0000", 2024-09-13T06:40:21.838 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:21.838 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:21.839 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:21.839 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:21.839 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.644660+0000", 2024-09-13T06:40:21.839 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:21.839 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:21.839 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:21.839 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:21.839 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.644659+0000", 2024-09-13T06:40:21.839 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:21.839 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:21.839 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:21.839 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:21.839 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.644662+0000", 2024-09-13T06:40:21.840 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4949999999999998e-06 2024-09-13T06:40:21.840 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:21.840 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:21.840 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:21.840 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.644669+0000", 2024-09-13T06:40:21.840 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.289e-06 2024-09-13T06:40:21.840 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:21.840 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:21.840 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:21.840 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.644674+0000", 2024-09-13T06:40:21.840 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.8840000000000002e-06 2024-09-13T06:40:21.840 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:21.841 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:21.841 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:21.841 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.767602+0000", 2024-09-13T06:40:21.841 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.122928158 2024-09-13T06:40:21.841 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:21.841 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:21.841 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:21.841 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.767676+0000", 2024-09-13T06:40:21.841 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3992999999999994e-05 2024-09-13T06:40:21.841 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:21.841 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:21.841 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:21.841 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.768036+0000", 2024-09-13T06:40:21.842 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00035966200000000001 2024-09-13T06:40:21.842 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:21.842 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:21.842 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:21.842 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:21.842 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:21.842 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43010 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 503808~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:40:21.842 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.644678+0000", 2024-09-13T06:40:21.842 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.18914130800000001, 2024-09-13T06:40:21.842 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123728798, 2024-09-13T06:40:21.842 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:21.842 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:21.842 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:21.843 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:21.843 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:21.843 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43010 2024-09-13T06:40:21.843 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:21.843 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:21.843 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:21.843 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:21.843 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.644678+0000", 2024-09-13T06:40:21.843 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:21.843 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:21.843 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:21.843 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:21.843 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.644678+0000", 2024-09-13T06:40:21.843 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:21.844 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:21.844 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:21.844 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:21.844 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.644678+0000", 2024-09-13T06:40:21.844 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:21.844 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:21.844 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:21.844 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:21.844 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.644680+0000", 2024-09-13T06:40:21.844 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2050000000000001e-06 2024-09-13T06:40:21.844 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:21.844 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:21.844 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:21.845 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.644686+0000", 2024-09-13T06:40:21.845 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8440000000000003e-06 2024-09-13T06:40:21.845 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:21.845 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:21.845 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:21.845 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.644691+0000", 2024-09-13T06:40:21.845 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.118e-06 2024-09-13T06:40:21.845 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:21.845 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:21.845 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:21.845 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.768065+0000", 2024-09-13T06:40:21.845 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123374698 2024-09-13T06:40:21.845 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:21.846 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:21.846 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:21.846 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.768139+0000", 2024-09-13T06:40:21.846 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3934000000000001e-05 2024-09-13T06:40:21.846 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:21.846 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:21.846 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:21.846 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.768407+0000", 2024-09-13T06:40:21.846 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00026738800000000002 2024-09-13T06:40:21.846 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:21.846 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:21.846 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:21.846 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:21.847 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:21.847 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43181 3.17 3:ec5ebce4:::rbd_data.1121f5f2e1c0.0000000000000001:1f [read 319488~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:40:21.847 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.652968+0000", 2024-09-13T06:40:21.847 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.18085079200000001, 2024-09-13T06:40:21.847 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.12363807, 2024-09-13T06:40:21.847 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:21.847 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:21.847 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:21.847 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:21.847 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:21.847 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43181 2024-09-13T06:40:21.847 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:21.847 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:21.847 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:21.848 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:21.848 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.652968+0000", 2024-09-13T06:40:21.848 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:21.848 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:21.848 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:21.848 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:21.848 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.652968+0000", 2024-09-13T06:40:21.848 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:21.848 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:21.848 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:21.848 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:21.848 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.652968+0000", 2024-09-13T06:40:21.848 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:21.849 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:21.849 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:21.849 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:21.849 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.652970+0000", 2024-09-13T06:40:21.849 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2409999999999998e-06 2024-09-13T06:40:21.849 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:21.849 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:21.849 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:21.849 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.652976+0000", 2024-09-13T06:40:21.849 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0079999999999999e-06 2024-09-13T06:40:21.849 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:21.849 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:21.849 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:21.850 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.652981+0000", 2024-09-13T06:40:21.850 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4390000000000002e-06 2024-09-13T06:40:21.850 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:21.850 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:21.850 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:21.850 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.776275+0000", 2024-09-13T06:40:21.850 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.12329396099999999 2024-09-13T06:40:21.850 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:21.850 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:21.850 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:21.850 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.776316+0000", 2024-09-13T06:40:21.850 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.1244e-05 2024-09-13T06:40:21.850 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:21.851 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:21.851 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:21.851 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.776607+0000", 2024-09-13T06:40:21.851 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00029051199999999999 2024-09-13T06:40:21.851 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:21.851 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:21.851 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:21.851 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:21.851 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:21.851 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43182 3.17 3:ec5ebce4:::rbd_data.1121f5f2e1c0.0000000000000001:1f [read 333824~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:40:21.851 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.652985+0000", 2024-09-13T06:40:21.851 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.180833983, 2024-09-13T06:40:21.851 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123926616, 2024-09-13T06:40:21.852 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:21.852 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:21.852 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:21.852 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:21.852 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:21.852 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43182 2024-09-13T06:40:21.852 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:21.852 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:21.852 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:21.852 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:21.852 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.652985+0000", 2024-09-13T06:40:21.852 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:21.852 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:21.853 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:21.853 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:21.853 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.652985+0000", 2024-09-13T06:40:21.853 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:21.853 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:21.853 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:21.853 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:21.853 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.652985+0000", 2024-09-13T06:40:21.853 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:21.853 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:21.853 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:21.853 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:21.853 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.652987+0000", 2024-09-13T06:40:21.854 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0899999999999999e-06 2024-09-13T06:40:21.854 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:21.854 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:21.854 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:21.854 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.652994+0000", 2024-09-13T06:40:21.854 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3100000000000003e-06 2024-09-13T06:40:21.854 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:21.854 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:21.854 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:21.854 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.653000+0000", 2024-09-13T06:40:21.854 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2020000000000003e-06 2024-09-13T06:40:21.854 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:21.854 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:21.855 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:21.855 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.776635+0000", 2024-09-13T06:40:21.855 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.12363529400000001 2024-09-13T06:40:21.855 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:21.855 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:21.855 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:21.855 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.776676+0000", 2024-09-13T06:40:21.855 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.0745999999999999e-05 2024-09-13T06:40:21.855 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:21.855 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:21.855 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:21.855 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.776912+0000", 2024-09-13T06:40:21.855 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00023631300000000001 2024-09-13T06:40:21.855 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:21.856 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:21.856 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:21.856 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:21.856 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:21.856 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43192 3.17 3:ec5ebce4:::rbd_data.1121f5f2e1c0.0000000000000001:1f [read 466944~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:40:21.856 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.656622+0000", 2024-09-13T06:40:21.856 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.177196927, 2024-09-13T06:40:21.856 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123503136, 2024-09-13T06:40:21.856 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:21.856 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:21.856 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:21.856 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:21.856 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:21.857 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43192 2024-09-13T06:40:21.857 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:21.857 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:21.857 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:21.857 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:21.857 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656622+0000", 2024-09-13T06:40:21.857 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:21.857 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:21.857 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:21.857 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:21.857 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656622+0000", 2024-09-13T06:40:21.857 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:21.858 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:21.858 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:21.858 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:21.858 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656622+0000", 2024-09-13T06:40:21.858 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:40:21.858 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:21.858 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:21.858 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:21.858 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656623+0000", 2024-09-13T06:40:21.858 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2079999999999999e-06 2024-09-13T06:40:21.858 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:21.858 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:21.858 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:21.859 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656627+0000", 2024-09-13T06:40:21.859 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.4819999999999999e-06 2024-09-13T06:40:21.859 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:21.859 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:21.859 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:21.859 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656629+0000", 2024-09-13T06:40:21.859 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.582e-06 2024-09-13T06:40:21.859 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:21.859 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:21.859 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:21.859 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.779866+0000", 2024-09-13T06:40:21.859 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.12323638100000001 2024-09-13T06:40:21.859 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:21.860 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:21.860 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:21.860 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.779905+0000", 2024-09-13T06:40:21.860 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.9529e-05 2024-09-13T06:40:21.860 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:21.860 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:21.860 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:21.860 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.780125+0000", 2024-09-13T06:40:21.860 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000220168 2024-09-13T06:40:21.860 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:21.860 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:21.860 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:21.861 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:21.861 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:21.861 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43193 3.17 3:ec5ebce4:::rbd_data.1121f5f2e1c0.0000000000000001:1f [read 481280~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:40:21.861 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.656635+0000", 2024-09-13T06:40:21.861 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.177184443, 2024-09-13T06:40:21.861 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.12374478999999999, 2024-09-13T06:40:21.861 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:21.861 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:21.861 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:21.861 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:21.861 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:21.861 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43193 2024-09-13T06:40:21.862 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:21.862 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:21.862 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:21.862 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:21.862 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656635+0000", 2024-09-13T06:40:21.862 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:21.862 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:21.862 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:21.862 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:21.862 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656635+0000", 2024-09-13T06:40:21.862 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:21.862 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:21.862 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:21.862 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:21.863 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656635+0000", 2024-09-13T06:40:21.863 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:40:21.863 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:21.863 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:21.863 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:21.863 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656636+0000", 2024-09-13T06:40:21.863 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.544e-06 2024-09-13T06:40:21.863 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:21.863 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:21.863 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:21.863 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656639+0000", 2024-09-13T06:40:21.863 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.0879999999999999e-06 2024-09-13T06:40:21.863 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:21.863 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:21.864 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:21.864 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656642+0000", 2024-09-13T06:40:21.864 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5799999999999999e-06 2024-09-13T06:40:21.864 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:21.864 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:21.864 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:21.864 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.780151+0000", 2024-09-13T06:40:21.864 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123509035 2024-09-13T06:40:21.864 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:21.864 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:21.864 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:21.864 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.780191+0000", 2024-09-13T06:40:21.865 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.9758000000000001e-05 2024-09-13T06:40:21.865 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:21.865 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:21.865 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:21.865 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.780380+0000", 2024-09-13T06:40:21.865 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000189023 2024-09-13T06:40:21.865 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:21.865 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:21.865 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:21.865 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:21.865 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:21.865 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43194 3.17 3:ec5ebce4:::rbd_data.1121f5f2e1c0.0000000000000001:1f [read 495616~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:40:21.865 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.656645+0000", 2024-09-13T06:40:21.866 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.17717379, 2024-09-13T06:40:21.866 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.124088483, 2024-09-13T06:40:21.866 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:21.866 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:21.866 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:21.866 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:21.866 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:21.866 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43194 2024-09-13T06:40:21.866 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:21.866 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:21.866 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:21.866 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:21.866 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656645+0000", 2024-09-13T06:40:21.867 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:21.867 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:21.867 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:21.867 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:21.867 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656645+0000", 2024-09-13T06:40:21.867 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:21.867 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:21.867 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:21.867 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:21.867 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656645+0000", 2024-09-13T06:40:21.867 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:21.867 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:21.867 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:21.868 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:21.868 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656647+0000", 2024-09-13T06:40:21.868 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9180000000000001e-06 2024-09-13T06:40:21.868 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:21.868 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:21.868 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:21.868 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656653+0000", 2024-09-13T06:40:21.868 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7860000000000002e-06 2024-09-13T06:40:21.868 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:21.868 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:21.868 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:21.868 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656658+0000", 2024-09-13T06:40:21.868 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6949999999999999e-06 2024-09-13T06:40:21.869 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:21.869 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:21.869 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:21.869 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.780406+0000", 2024-09-13T06:40:21.869 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123748657 2024-09-13T06:40:21.869 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:21.869 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:21.869 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:21.869 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.780446+0000", 2024-09-13T06:40:21.869 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.9360999999999998e-05 2024-09-13T06:40:21.869 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:21.869 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:21.869 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:21.869 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.780734+0000", 2024-09-13T06:40:21.870 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00028838399999999998 2024-09-13T06:40:21.870 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:21.870 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:21.870 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:21.870 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:21.870 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:21.870 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43240 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 106496~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:40:21.870 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.660672+0000", 2024-09-13T06:40:21.870 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.17314742699999999, 2024-09-13T06:40:21.870 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123612707, 2024-09-13T06:40:21.870 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:21.870 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:21.870 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:21.871 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:21.871 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:21.871 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43240 2024-09-13T06:40:21.871 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:21.871 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:21.871 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:21.871 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:21.871 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660672+0000", 2024-09-13T06:40:21.871 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:21.871 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:21.871 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:21.871 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:21.871 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660672+0000", 2024-09-13T06:40:21.872 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:21.872 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:21.872 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:21.872 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:21.872 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660671+0000", 2024-09-13T06:40:21.872 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:21.872 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:21.872 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:21.872 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:21.872 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660673+0000", 2024-09-13T06:40:21.872 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.652e-06 2024-09-13T06:40:21.872 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:21.872 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:21.872 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:21.873 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660677+0000", 2024-09-13T06:40:21.873 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.2509999999999996e-06 2024-09-13T06:40:21.873 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:21.873 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:21.873 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:21.873 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660680+0000", 2024-09-13T06:40:21.873 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.8150000000000002e-06 2024-09-13T06:40:21.873 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:21.873 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:21.873 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:21.873 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.783596+0000", 2024-09-13T06:40:21.873 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.122915841 2024-09-13T06:40:21.873 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:21.874 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:21.874 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:21.874 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.783682+0000", 2024-09-13T06:40:21.874 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.5822999999999995e-05 2024-09-13T06:40:21.874 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:21.874 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:21.874 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:21.874 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.784285+0000", 2024-09-13T06:40:21.874 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00060276500000000001 2024-09-13T06:40:21.874 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:21.874 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:21.874 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:21.874 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:21.875 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:21.875 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43241 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 120832~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:40:21.875 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.660682+0000", 2024-09-13T06:40:21.875 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.17313685200000001, 2024-09-13T06:40:21.875 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123958204, 2024-09-13T06:40:21.875 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:21.875 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:21.875 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:21.875 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:21.875 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:21.875 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43241 2024-09-13T06:40:21.875 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:21.875 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:21.876 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:21.876 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:21.876 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660682+0000", 2024-09-13T06:40:21.876 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:21.876 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:21.876 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:21.876 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:21.876 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660682+0000", 2024-09-13T06:40:21.876 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:21.876 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:21.876 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:21.876 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:21.876 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660682+0000", 2024-09-13T06:40:21.877 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:21.877 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:21.877 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:21.877 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:21.877 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660683+0000", 2024-09-13T06:40:21.877 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.308e-06 2024-09-13T06:40:21.877 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:21.877 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:21.877 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:21.877 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660686+0000", 2024-09-13T06:40:21.877 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.977e-06 2024-09-13T06:40:21.877 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:21.877 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:21.878 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:21.878 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660689+0000", 2024-09-13T06:40:21.878 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5830000000000001e-06 2024-09-13T06:40:21.878 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:21.878 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:21.878 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:21.878 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.784366+0000", 2024-09-13T06:40:21.878 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.12367713599999999 2024-09-13T06:40:21.878 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:21.878 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:21.878 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:21.878 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.784451+0000", 2024-09-13T06:40:21.878 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.4629999999999994e-05 2024-09-13T06:40:21.878 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:21.879 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:21.879 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:21.879 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.784641+0000", 2024-09-13T06:40:21.879 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00018984899999999999 2024-09-13T06:40:21.879 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:21.879 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:21.879 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:21.879 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:21.879 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:21.879 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43242 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 139264~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:40:21.879 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.660691+0000", 2024-09-13T06:40:21.879 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.17312787399999999, 2024-09-13T06:40:21.879 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.124536443, 2024-09-13T06:40:21.880 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:21.880 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:21.880 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:21.880 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:21.880 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:21.880 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43242 2024-09-13T06:40:21.880 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:21.880 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:21.880 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:21.880 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:21.880 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660691+0000", 2024-09-13T06:40:21.880 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:21.880 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:21.881 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:21.881 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:21.881 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660691+0000", 2024-09-13T06:40:21.881 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:21.881 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:21.881 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:21.881 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:21.881 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660691+0000", 2024-09-13T06:40:21.881 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:40:21.881 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:21.881 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:21.881 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:21.881 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660696+0000", 2024-09-13T06:40:21.881 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0560000000000004e-06 2024-09-13T06:40:21.882 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:21.882 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:21.882 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:21.882 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660699+0000", 2024-09-13T06:40:21.882 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.2009999999999999e-06 2024-09-13T06:40:21.882 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:21.883 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:21.883 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:21.883 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660702+0000", 2024-09-13T06:40:21.883 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.633e-06 2024-09-13T06:40:21.883 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:21.883 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:21.883 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:21.883 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.784912+0000", 2024-09-13T06:40:21.883 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.124209497 2024-09-13T06:40:21.883 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:21.884 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:21.884 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:21.884 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.784995+0000", 2024-09-13T06:40:21.884 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.3891e-05 2024-09-13T06:40:21.884 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:21.884 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:21.884 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:21.884 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.785228+0000", 2024-09-13T06:40:21.884 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00023237400000000001 2024-09-13T06:40:21.884 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:21.884 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:21.884 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:21.884 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:21.885 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:21.885 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43243 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 153600~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:40:21.885 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.660705+0000", 2024-09-13T06:40:21.885 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.17311454100000001, 2024-09-13T06:40:21.885 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.124825835, 2024-09-13T06:40:21.885 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:21.885 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:21.885 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:21.885 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:21.885 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:21.885 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43243 2024-09-13T06:40:21.885 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:21.885 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:21.885 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:21.886 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:21.886 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660705+0000", 2024-09-13T06:40:21.886 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:21.886 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:21.886 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:21.886 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:21.886 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660705+0000", 2024-09-13T06:40:21.886 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:21.886 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:21.886 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:21.886 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:21.886 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660705+0000", 2024-09-13T06:40:21.886 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:40:21.887 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:21.887 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:21.887 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:21.887 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660706+0000", 2024-09-13T06:40:21.887 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4339999999999999e-06 2024-09-13T06:40:21.887 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:21.887 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:21.887 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:21.887 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660709+0000", 2024-09-13T06:40:21.888 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9000000000000002e-06 2024-09-13T06:40:21.888 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:21.888 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:21.888 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:21.888 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660712+0000", 2024-09-13T06:40:21.888 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.0589999999999998e-06 2024-09-13T06:40:21.888 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:21.888 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:21.888 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:21.889 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.785318+0000", 2024-09-13T06:40:21.889 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.124606299 2024-09-13T06:40:21.889 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:21.889 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:21.889 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:21.889 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.785361+0000", 2024-09-13T06:40:21.889 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.3214999999999999e-05 2024-09-13T06:40:21.889 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:21.889 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:21.889 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:21.889 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.785531+0000", 2024-09-13T06:40:21.889 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00016914400000000001 2024-09-13T06:40:21.890 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:21.890 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:21.890 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:21.890 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:21.890 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:21.890 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43244 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 167936~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:40:21.890 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.660714+0000", 2024-09-13T06:40:21.890 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.173105128, 2024-09-13T06:40:21.890 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.125073248, 2024-09-13T06:40:21.890 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:21.890 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:21.890 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:21.890 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:21.891 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:21.891 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43244 2024-09-13T06:40:21.891 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:21.891 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:21.891 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:21.891 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:21.891 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660714+0000", 2024-09-13T06:40:21.891 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:21.891 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:21.891 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:21.891 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:21.891 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660714+0000", 2024-09-13T06:40:21.891 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:21.891 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:21.892 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:21.892 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:21.892 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660714+0000", 2024-09-13T06:40:21.892 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:40:21.892 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:21.892 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:21.892 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:21.892 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660715+0000", 2024-09-13T06:40:21.892 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2330000000000001e-06 2024-09-13T06:40:21.892 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:21.892 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:21.892 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:21.892 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660718+0000", 2024-09-13T06:40:21.893 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9569999999999998e-06 2024-09-13T06:40:21.893 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:21.893 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:21.893 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:21.893 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660721+0000", 2024-09-13T06:40:21.893 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.678e-06 2024-09-13T06:40:21.893 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:21.893 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:21.893 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:21.893 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.785557+0000", 2024-09-13T06:40:21.893 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.12483633199999999 2024-09-13T06:40:21.893 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:21.893 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:21.894 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:21.894 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.785618+0000", 2024-09-13T06:40:21.894 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0686000000000001e-05 2024-09-13T06:40:21.894 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:21.894 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:21.894 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:21.894 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.785787+0000", 2024-09-13T06:40:21.894 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00016957699999999999 2024-09-13T06:40:21.894 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:21.894 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:21.894 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:21.894 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:21.894 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:21.894 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43254 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 315392~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:40:21.895 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.664717+0000", 2024-09-13T06:40:21.895 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.16910256000000001, 2024-09-13T06:40:21.895 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.12357108, 2024-09-13T06:40:21.895 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:21.895 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:21.895 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:21.895 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:21.895 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:21.895 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43254 2024-09-13T06:40:21.895 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:21.895 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:21.895 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:21.895 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:21.896 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664717+0000", 2024-09-13T06:40:21.896 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:21.896 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:21.896 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:21.896 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:21.896 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664717+0000", 2024-09-13T06:40:21.896 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:21.896 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:21.896 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:21.896 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:21.896 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664716+0000", 2024-09-13T06:40:21.896 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:21.896 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:21.897 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:21.897 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:21.897 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664724+0000", 2024-09-13T06:40:21.897 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.7109999999999995e-06 2024-09-13T06:40:21.897 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:21.897 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:21.897 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:21.897 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664732+0000", 2024-09-13T06:40:21.897 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.8399999999999995e-06 2024-09-13T06:40:21.897 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:21.897 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:21.897 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:21.897 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664738+0000", 2024-09-13T06:40:21.898 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.879e-06 2024-09-13T06:40:21.898 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:21.898 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:21.898 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:21.898 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.788018+0000", 2024-09-13T06:40:21.898 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123280719 2024-09-13T06:40:21.898 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:21.898 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:21.898 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:21.898 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.788119+0000", 2024-09-13T06:40:21.898 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000100558 2024-09-13T06:40:21.898 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:21.898 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:21.899 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:21.899 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.788288+0000", 2024-09-13T06:40:21.899 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000168751 2024-09-13T06:40:21.899 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:21.899 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:21.899 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:21.899 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:21.899 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:21.899 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43255 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 329728~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:40:21.899 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.664743+0000", 2024-09-13T06:40:21.899 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.16907656400000001, 2024-09-13T06:40:21.899 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.12381711500000001, 2024-09-13T06:40:21.899 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:21.900 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:21.900 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:21.900 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:21.900 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:21.900 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43255 2024-09-13T06:40:21.900 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:21.900 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:21.900 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:21.900 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:21.900 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664743+0000", 2024-09-13T06:40:21.900 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:21.900 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:21.900 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:21.901 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:21.901 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664743+0000", 2024-09-13T06:40:21.901 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:21.901 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:21.901 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:21.901 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:21.901 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664742+0000", 2024-09-13T06:40:21.901 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:21.901 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:21.901 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:21.901 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:21.901 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664745+0000", 2024-09-13T06:40:21.901 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.7269999999999999e-06 2024-09-13T06:40:21.902 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:21.902 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:21.902 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:21.902 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664753+0000", 2024-09-13T06:40:21.902 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.8709999999999997e-06 2024-09-13T06:40:21.902 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:21.902 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:21.902 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:21.902 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664758+0000", 2024-09-13T06:40:21.902 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2220000000000001e-06 2024-09-13T06:40:21.902 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:21.902 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:21.902 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:21.902 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.788314+0000", 2024-09-13T06:40:21.903 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123555545 2024-09-13T06:40:21.903 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:21.903 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:21.903 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:21.903 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.788368+0000", 2024-09-13T06:40:21.903 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3928999999999998e-05 2024-09-13T06:40:21.903 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:21.903 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:21.903 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:21.903 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.788560+0000", 2024-09-13T06:40:21.903 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000192237 2024-09-13T06:40:21.903 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:21.903 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:21.904 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:21.904 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:21.904 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:21.904 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43256 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 344064~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:40:21.904 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.664763+0000", 2024-09-13T06:40:21.904 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.16905661799999999, 2024-09-13T06:40:21.904 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.12418359399999999, 2024-09-13T06:40:21.904 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:21.904 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:21.904 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:21.904 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:21.904 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:21.904 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43256 2024-09-13T06:40:21.904 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:21.905 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:21.905 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:21.905 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:21.905 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664763+0000", 2024-09-13T06:40:21.905 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:21.905 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:21.905 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:21.905 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:21.905 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664763+0000", 2024-09-13T06:40:21.905 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:21.905 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:21.905 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:21.906 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:21.906 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664762+0000", 2024-09-13T06:40:21.906 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:21.906 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:21.906 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:21.906 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:21.906 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664765+0000", 2024-09-13T06:40:21.906 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3290000000000001e-06 2024-09-13T06:40:21.906 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:21.906 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:21.906 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:21.906 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664771+0000", 2024-09-13T06:40:21.906 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.1319999999999999e-06 2024-09-13T06:40:21.906 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:21.907 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:21.907 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:21.907 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664776+0000", 2024-09-13T06:40:21.907 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.8840000000000002e-06 2024-09-13T06:40:21.907 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:21.907 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:21.907 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:21.907 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.788598+0000", 2024-09-13T06:40:21.907 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123821979 2024-09-13T06:40:21.907 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:21.907 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:21.907 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:21.907 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.788680+0000", 2024-09-13T06:40:21.908 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.2367999999999995e-05 2024-09-13T06:40:21.908 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:21.908 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:21.908 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:21.908 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.788946+0000", 2024-09-13T06:40:21.908 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00026629799999999999 2024-09-13T06:40:21.908 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:21.908 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:21.908 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:21.908 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:21.908 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:21.908 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43265 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 477184~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:40:21.908 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.669414+0000", 2024-09-13T06:40:21.909 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.16440498200000001, 2024-09-13T06:40:21.909 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123446973, 2024-09-13T06:40:21.909 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:21.909 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:21.909 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:21.909 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:21.909 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:21.909 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43265 2024-09-13T06:40:21.909 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:21.909 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:21.909 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:21.909 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:21.909 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669414+0000", 2024-09-13T06:40:21.910 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:21.910 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:21.910 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:21.910 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:21.910 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669414+0000", 2024-09-13T06:40:21.910 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:21.910 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:21.910 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:21.910 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:21.910 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669414+0000", 2024-09-13T06:40:21.910 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:21.910 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:21.910 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:21.910 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:21.911 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669416+0000", 2024-09-13T06:40:21.911 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.317e-06 2024-09-13T06:40:21.911 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:21.911 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:21.911 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:21.911 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669425+0000", 2024-09-13T06:40:21.911 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.0650000000000005e-06 2024-09-13T06:40:21.911 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:21.911 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:21.911 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:21.911 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669430+0000", 2024-09-13T06:40:21.911 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5079999999999999e-06 2024-09-13T06:40:21.911 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:21.911 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:21.912 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:21.912 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.792649+0000", 2024-09-13T06:40:21.912 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123219328 2024-09-13T06:40:21.912 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:21.912 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:21.912 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:21.912 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.792695+0000", 2024-09-13T06:40:21.912 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5476999999999998e-05 2024-09-13T06:40:21.912 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:21.912 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:21.912 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:21.912 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.792861+0000", 2024-09-13T06:40:21.912 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00016658999999999999 2024-09-13T06:40:21.912 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:21.913 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:21.913 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:21.913 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:21.913 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:21.913 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43266 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 491520~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:40:21.913 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.669434+0000", 2024-09-13T06:40:21.913 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.16438485999999999, 2024-09-13T06:40:21.913 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123685267, 2024-09-13T06:40:21.913 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:21.913 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:21.913 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:21.913 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:21.913 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:21.914 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43266 2024-09-13T06:40:21.914 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:21.914 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:21.914 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:21.914 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:21.914 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669434+0000", 2024-09-13T06:40:21.914 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:21.914 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:21.914 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:21.914 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:21.914 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669434+0000", 2024-09-13T06:40:21.914 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:21.914 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:21.914 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:21.915 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:21.915 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669434+0000", 2024-09-13T06:40:21.915 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:21.915 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:21.915 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:21.915 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:21.915 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669441+0000", 2024-09-13T06:40:21.915 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3019999999999997e-06 2024-09-13T06:40:21.915 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:21.915 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:21.915 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:21.915 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669451+0000", 2024-09-13T06:40:21.915 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.6379999999999999e-06 2024-09-13T06:40:21.916 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:21.916 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:21.916 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:21.916 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669456+0000", 2024-09-13T06:40:21.916 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.361e-06 2024-09-13T06:40:21.916 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:21.916 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:21.916 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:21.916 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.792879+0000", 2024-09-13T06:40:21.916 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123422686 2024-09-13T06:40:21.916 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:21.916 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:21.916 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:21.916 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.792923+0000", 2024-09-13T06:40:21.917 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4035000000000001e-05 2024-09-13T06:40:21.917 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:21.917 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:21.917 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:21.917 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.793120+0000", 2024-09-13T06:40:21.917 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00019660899999999999 2024-09-13T06:40:21.917 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:21.917 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:21.917 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:21.917 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:21.917 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:21.917 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43267 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 505856~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:40:21.917 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.669461+0000", 2024-09-13T06:40:21.917 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.164358064, 2024-09-13T06:40:21.918 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123933711, 2024-09-13T06:40:21.918 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:21.918 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:21.918 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:21.918 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:21.918 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:21.918 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43267 2024-09-13T06:40:21.918 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:21.918 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:21.918 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:21.918 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:21.918 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669461+0000", 2024-09-13T06:40:21.918 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:21.919 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:21.919 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:21.919 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:21.919 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669461+0000", 2024-09-13T06:40:21.919 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:21.919 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:21.919 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:21.919 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:21.919 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669461+0000", 2024-09-13T06:40:21.919 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:21.919 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:21.919 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:21.919 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:21.919 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669463+0000", 2024-09-13T06:40:21.920 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5629999999999999e-06 2024-09-13T06:40:21.920 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:21.920 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:21.920 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:21.920 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669473+0000", 2024-09-13T06:40:21.920 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.9520000000000006e-06 2024-09-13T06:40:21.920 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:21.920 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:21.920 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:21.920 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669479+0000", 2024-09-13T06:40:21.920 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8540000000000002e-06 2024-09-13T06:40:21.920 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:21.920 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:21.920 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:21.921 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.793137+0000", 2024-09-13T06:40:21.921 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.12365825699999999 2024-09-13T06:40:21.921 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:21.921 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:21.921 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:21.921 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.793181+0000", 2024-09-13T06:40:21.921 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.3773999999999998e-05 2024-09-13T06:40:21.921 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:21.921 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:21.921 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:21.921 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.793395+0000", 2024-09-13T06:40:21.921 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00021372399999999999 2024-09-13T06:40:21.921 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:21.922 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:21.922 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:21.922 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:21.922 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:21.922 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43268 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 520192~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:40:21.922 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.669484+0000", 2024-09-13T06:40:21.922 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.164335279, 2024-09-13T06:40:21.922 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.12441057899999999, 2024-09-13T06:40:21.922 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:21.922 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:21.922 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:21.922 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:21.922 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:21.922 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43268 2024-09-13T06:40:21.923 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:21.923 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:21.923 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:21.923 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:21.923 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669484+0000", 2024-09-13T06:40:21.923 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:21.923 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:21.923 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:21.923 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:21.923 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669484+0000", 2024-09-13T06:40:21.923 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:21.923 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:21.923 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:21.923 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:21.924 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669484+0000", 2024-09-13T06:40:21.924 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:21.924 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:21.924 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:21.924 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:21.924 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669486+0000", 2024-09-13T06:40:21.924 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6120000000000001e-06 2024-09-13T06:40:21.924 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:21.924 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:21.924 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:21.924 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669494+0000", 2024-09-13T06:40:21.924 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4819999999999997e-06 2024-09-13T06:40:21.924 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:21.924 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:21.925 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:21.925 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669497+0000", 2024-09-13T06:40:21.925 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9790000000000002e-06 2024-09-13T06:40:21.925 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:21.925 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:21.925 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:21.925 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.793559+0000", 2024-09-13T06:40:21.925 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.124062436 2024-09-13T06:40:21.925 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:21.925 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:21.925 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:21.925 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.793603+0000", 2024-09-13T06:40:21.925 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.3764999999999999e-05 2024-09-13T06:40:21.926 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:21.926 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:21.926 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:21.926 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.793895+0000", 2024-09-13T06:40:21.926 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00029168299999999999 2024-09-13T06:40:21.926 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:21.926 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:21.926 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:21.926 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:21.926 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:21.926 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:40:21.928 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-13T06:40:21.928 INFO:teuthology.orchestra.run.smithi081.stdout:osd.0: {} 2024-09-13T06:40:21.928 INFO:teuthology.orchestra.run.smithi081.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-13T06:40:21.929 INFO:teuthology.orchestra.run.smithi081.stdout:osd.1: {} 2024-09-13T06:40:21.929 INFO:teuthology.orchestra.run.smithi081.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-13T06:40:21.929 INFO:teuthology.orchestra.run.smithi081.stdout:osd.2: {} 2024-09-13T06:40:21.930 INFO:teuthology.orchestra.run.smithi081.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-13T06:40:21.930 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:40:21.925+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:40:21.933 INFO:teuthology.orchestra.run.smithi081.stdout:osd.3: {} 2024-09-13T06:40:21.933 INFO:teuthology.orchestra.run.smithi081.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-13T06:40:21.953 INFO:teuthology.orchestra.run.smithi081.stdout:osd.4: {} 2024-09-13T06:40:21.953 INFO:teuthology.orchestra.run.smithi081.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-13T06:40:21.972 INFO:teuthology.orchestra.run.smithi081.stdout:osd.5: {} 2024-09-13T06:40:21.972 INFO:teuthology.orchestra.run.smithi081.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-13T06:40:21.991 INFO:teuthology.orchestra.run.smithi081.stdout:osd.6: {} 2024-09-13T06:40:21.992 INFO:teuthology.orchestra.run.smithi081.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-13T06:40:22.011 INFO:teuthology.orchestra.run.smithi081.stdout:osd.7: {} 2024-09-13T06:40:22.011 INFO:teuthology.orchestra.run.smithi081.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-13T06:40:22.028 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:40:22.027+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:40:22.045 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:40:22.046 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:40:22.059 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-13T06:40:22.129 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-13T06:40:22.127+0000 7f86a5f06640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26387) UID: 0 2024-09-13T06:40:22.218 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:40:22.219 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:40:22.230 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:40:22.231+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:40:22.231 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-13T06:40:22.331 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:40:22.329+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:40:22.346 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:40:22.346 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:40:22.359 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-13T06:40:22.432 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-13T06:40:22.431+0000 7f86a5f06640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26387) UID: 0 2024-09-13T06:40:22.481 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6] out_osds: [7] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-13T06:40:22.482 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-13T06:40:22.482 INFO:tasks.thrashosds.thrasher:primary_affinity 2024-09-13T06:40:22.482 INFO:tasks.thrashosds.thrasher:Setting osd 6 primary_affinity to 0.546682 2024-09-13T06:40:22.482 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 6 0.546681748152113 2024-09-13T06:40:22.494 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-13T06:40:22.526 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:40:22.526 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:40:22.543 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-13T06:40:22.543 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:40:22.541+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:40:22.634 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:40:22.633+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:40:22.704 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:40:22.705 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:40:22.705 INFO:teuthology.orchestra.run.smithi081.stdout:checking clone #8, image image_client.0-clone8 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent9 2024-09-13T06:40:22.719 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-13T06:40:22.760 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:40:22.761+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:40:22.768 INFO:teuthology.orchestra.run.smithi081.stdout:1958 read 0xd06f611 thru 0xd07110c (0x1afc bytes) 2024-09-13T06:40:22.769 INFO:teuthology.orchestra.run.smithi081.stdout:1959 write 0x698aeca thru 0x698baea (0xc21 bytes) 2024-09-13T06:40:22.781 INFO:teuthology.orchestra.run.smithi081.stdout:1960 read 0x6a40cbc thru 0x6a48539 (0x787e bytes) 2024-09-13T06:40:22.782 INFO:teuthology.orchestra.run.smithi081.stdout:1961 writesame 0x9f71729 thru 0x9f7aab6 data_size 0x65(0x938e bytes) 2024-09-13T06:40:22.793 INFO:teuthology.orchestra.run.smithi081.stdout:1962 write 0xb4a9b6a thru 0xb4adc9c (0x4133 bytes) 2024-09-13T06:40:22.810 INFO:teuthology.orchestra.run.smithi081.stdout:1963 read 0x818937b thru 0x818968c (0x312 bytes) 2024-09-13T06:40:22.810 INFO:teuthology.orchestra.run.smithi081.stdout:1964 read 0x329f04b thru 0x329fbc2 (0xb78 bytes) 2024-09-13T06:40:22.811 INFO:teuthology.orchestra.run.smithi081.stdout:1965 read 0xdce024 thru 0xdd2638 (0x4615 bytes) 2024-09-13T06:40:22.811 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:40:22.814 INFO:teuthology.orchestra.run.smithi081.stdout:1967 trunc from 0xdfb9e16 to 0xabf0de3 2024-09-13T06:40:22.827 INFO:teuthology.orchestra.run.smithi081.stdout:1969 read 0x3ea2cc9 thru 0x3ea62b8 (0x35f0 bytes) 2024-09-13T06:40:22.827 INFO:teuthology.orchestra.run.smithi081.stdout:1970 write 0x41dd21f thru 0x41e6d08 (0x9aea bytes) 2024-09-13T06:40:22.835 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:40:22.833+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:40:22.840 INFO:teuthology.orchestra.run.smithi081.stdout:1971 write 0x6c77ea5 thru 0x6c7a5d0 (0x272c bytes) 2024-09-13T06:40:22.850 INFO:teuthology.orchestra.run.smithi081.stdout:1972 punch from 0x6b51afd to 0x6b5a177, (0x867a bytes) 2024-09-13T06:40:22.850 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:40:22.854 INFO:teuthology.orchestra.run.smithi081.stdout:1974 trunc from 0xabf0de3 to 0x7d41693 2024-09-13T06:40:22.866 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:40:22.872 INFO:teuthology.orchestra.run.smithi081.stdout:1976 write 0x7f8121f thru 0x7f8ff55 (0xed37 bytes) 2024-09-13T06:40:22.887 INFO:teuthology.orchestra.run.smithi081.stdout:1977 writesame 0x149d9cf thru 0x14a22d1 data_size 0x1(0x4903 bytes) 2024-09-13T06:40:22.901 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:40:22.901 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:40:22.905 INFO:teuthology.orchestra.run.smithi081.stdout:1978 read 0x5cc83bb thru 0x5ccc507 (0x414d bytes) 2024-09-13T06:40:22.905 INFO:teuthology.orchestra.run.smithi081.stdout:1980 punch from 0x3e15bbc to 0x3e1c85f, (0x6ca3 bytes) 2024-09-13T06:40:22.905 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:40:22.905 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:40:22.905 INFO:teuthology.orchestra.run.smithi081.stdout:1984 read 0x61a7147 thru 0x61b249c (0xb356 bytes) 2024-09-13T06:40:22.905 INFO:teuthology.orchestra.run.smithi081.stdout:1987 write 0x652c9ce thru 0x6535ea9 (0x94dc bytes) 2024-09-13T06:40:22.916 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-13T06:40:22.917 INFO:teuthology.orchestra.run.smithi081.stdout:1988 read 0x55c03cd thru 0x55c1928 (0x155c bytes) 2024-09-13T06:40:22.920 INFO:teuthology.orchestra.run.smithi081.stdout:1989 trunc from 0x7f8ff56 to 0xa51299b 2024-09-13T06:40:22.927 INFO:teuthology.orchestra.run.smithi081.stdout:1990 write 0x375baa5 thru 0x37617ea (0x5d46 bytes) 2024-09-13T06:40:22.936 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:40:22.937+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:40:22.937 INFO:teuthology.orchestra.run.smithi081.stdout:1992 write 0x7d5b052 thru 0x7d5d6fc (0x26ab bytes) 2024-09-13T06:40:22.946 INFO:teuthology.orchestra.run.smithi081.stdout:1993 read 0x1bb3c5c thru 0x1bc3542 (0xf8e7 bytes) 2024-09-13T06:40:22.955 INFO:teuthology.orchestra.run.smithi081.stdout:1994 writesame 0xc1704b2 thru 0xc1790bb data_size 0x4b(0x8c0a bytes) 2024-09-13T06:40:22.955 INFO:teuthology.orchestra.run.smithi081.stdout:1996 read 0x6f4e6c4 thru 0x6f5c2ba (0xdbf7 bytes) 2024-09-13T06:40:22.955 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:40:22.965 INFO:teuthology.orchestra.run.smithi081.stdout:1998 trunc from 0xc1790bc to 0x375ae46 2024-09-13T06:40:22.992 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:40:22.993 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:40:22.993 INFO:teuthology.orchestra.run.smithi081.stdout:2001 read 0x28e392a thru 0x28eb3b6 (0x7a8d bytes) 2024-09-13T06:40:23.011 INFO:teuthology.orchestra.run.smithi081.stdout:2002 write 0xb3fdbf6 thru 0xb4092cb (0xb6d6 bytes) 2024-09-13T06:40:23.022 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:40:23.033 INFO:teuthology.orchestra.run.smithi081.stdout:2004 write 0xe18298f thru 0xe183107 (0x779 bytes) 2024-09-13T06:40:23.038 INFO:tasks.ceph.osd.6.smithi139.stderr:2024-09-13T06:40:23.038+0000 7fcd02c5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26385) UID: 0 2024-09-13T06:40:23.041 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:40:23.042 INFO:teuthology.orchestra.run.smithi081.stdout:2006 read 0x8365b8a thru 0x836d973 (0x7dea bytes) 2024-09-13T06:40:23.042 INFO:teuthology.orchestra.run.smithi081.stdout:2007 write 0x8d8141d thru 0x8d8444e (0x3032 bytes) 2024-09-13T06:40:23.048 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:40:23.048 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:40:23.054 INFO:teuthology.orchestra.run.smithi081.stdout:2009 read 0xa9c16d9 thru 0xa9cbb98 (0xa4c0 bytes) 2024-09-13T06:40:23.054 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:40:23.068 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-13T06:40:23.070 INFO:teuthology.orchestra.run.smithi081.stdout:2011 trunc from 0xe183108 to 0x23c1363 2024-09-13T06:40:23.088 INFO:teuthology.orchestra.run.smithi081.stdout:2012 read 0xac7d54 thru 0xad44ad (0xc75a bytes) 2024-09-13T06:40:23.089 INFO:teuthology.orchestra.run.smithi081.stdout:2013 punch from 0xc0dc35 to 0xc1d55e, (0xf929 bytes) 2024-09-13T06:40:23.109 INFO:teuthology.orchestra.run.smithi081.stdout:2014 write 0xe942464 thru 0xe944ef1 (0x2a8e bytes) 2024-09-13T06:40:23.120 INFO:teuthology.orchestra.run.smithi081.stdout:2015 read 0x8c53eee thru 0x8c553b0 (0x14c3 bytes) 2024-09-13T06:40:23.121 INFO:teuthology.orchestra.run.smithi081.stdout:2016 write 0xcd462bb thru 0xcd4fc54 (0x999a bytes) 2024-09-13T06:40:23.133 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:40:23.139 INFO:teuthology.orchestra.run.smithi081.stdout:2020 trunc from 0xe944ef2 to 0xa773592 2024-09-13T06:40:23.139 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:40:23.137+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:40:23.153 INFO:teuthology.orchestra.run.smithi081.stdout:2021 writesame 0x278c6e8 thru 0x27917ce data_size 0x1(0x50e7 bytes) 2024-09-13T06:40:23.171 INFO:teuthology.orchestra.run.smithi081.stdout:2023 read 0x793e40d thru 0x794afc3 (0xcbb7 bytes) 2024-09-13T06:40:23.171 INFO:teuthology.orchestra.run.smithi081.stdout:2025 write 0x886f269 thru 0x886f5c1 (0x359 bytes) 2024-09-13T06:40:23.174 INFO:teuthology.orchestra.run.smithi081.stdout:2026 read 0x9fc8f15 thru 0x9fd4ac0 (0xbbac bytes) 2024-09-13T06:40:23.184 INFO:teuthology.orchestra.run.smithi081.stdout:2027 writesame 0xbab9a64 thru 0xbac14b3 data_size 0x8(0x7a50 bytes) 2024-09-13T06:40:23.199 INFO:teuthology.orchestra.run.smithi081.stdout:2028 trunc from 0xbac14b4 to 0x78f214 2024-09-13T06:40:23.202 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:40:23.202 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:40:23.219 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-13T06:40:23.230 INFO:teuthology.orchestra.run.smithi081.stdout:2029 trunc from 0x78f214 to 0x67f4d13 2024-09-13T06:40:23.237 INFO:teuthology.orchestra.run.smithi081.stdout:2030 read 0x5adc4d9 thru 0x5ade5d6 (0x20fe bytes) 2024-09-13T06:40:23.237 INFO:teuthology.orchestra.run.smithi081.stdout:2032 write 0x220abb4 thru 0x220af2e (0x37b bytes) 2024-09-13T06:40:23.240 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-13T06:40:23.238+0000 7f86a5f06640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26387) UID: 0 2024-09-13T06:40:23.252 INFO:teuthology.orchestra.run.smithi081.stdout:2034 trunc from 0x67f4d13 to 0xe06f889 2024-09-13T06:40:23.259 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:40:23.262 INFO:teuthology.orchestra.run.smithi081.stdout:2036 trunc from 0xe06f889 to 0xbcc41fc 2024-09-13T06:40:23.269 INFO:teuthology.orchestra.run.smithi081.stdout:2037 read 0x8b1b282 thru 0x8b29df7 (0xeb76 bytes) 2024-09-13T06:40:23.270 INFO:teuthology.orchestra.run.smithi081.stdout:2038 writesame 0x4f7dd5a thru 0x4f827bc data_size 0x1(0x4a63 bytes) 2024-09-13T06:40:23.283 INFO:teuthology.orchestra.run.smithi081.stdout:2040 read 0x103da1c thru 0x104702d (0x9612 bytes) 2024-09-13T06:40:23.284 INFO:teuthology.orchestra.run.smithi081.stdout:2041 write 0xba195b1 thru 0xba19c52 (0x6a2 bytes) 2024-09-13T06:40:23.289 INFO:teuthology.orchestra.run.smithi081.stdout:2042 clone 11 order 20 su 262144 sc 7 2024-09-13T06:40:23.340 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:40:23.341+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:40:23.346 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:40:23.346 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:40:23.360 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-13T06:40:23.441 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:40:23.438+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:40:23.484 INFO:teuthology.orchestra.run.smithi081.stderr:set osd.6 primary-affinity to 0.546682 (8358272) 2024-09-13T06:40:23.488 INFO:teuthology.orchestra.run.smithi081.stderr:nodeep-scrub is unset 2024-09-13T06:40:23.492 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:40:23.493 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:40:23.508 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-13T06:40:23.564 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:40:23.565+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:40:23.643 INFO:tasks.ceph.osd.6.smithi139.stderr:2024-09-13T06:40:23.642+0000 7fcd02c5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26385) UID: 0 2024-09-13T06:40:23.674 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:40:23.674 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:40:23.688 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-13T06:40:23.745 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:40:23.745+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:40:23.846 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:40:23.845+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:40:23.846 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:40:23.846 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:40:23.860 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-13T06:40:23.946 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:40:23.949+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:40:23.982 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:40:23.983 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:40:23.997 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-13T06:40:24.027 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-13T06:40:24.047 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-13T06:40:24.046+0000 7f86a5f06640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26387) UID: 0 2024-09-13T06:40:24.120 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:40:24.120 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:40:24.136 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-13T06:40:24.182 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:40:24.182+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:40:24.183 INFO:teuthology.orchestra.run.smithi081.stdout:osd.0: {} 2024-09-13T06:40:24.183 INFO:teuthology.orchestra.run.smithi081.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-13T06:40:24.198 INFO:teuthology.orchestra.run.smithi081.stdout:osd.1: {} 2024-09-13T06:40:24.198 INFO:teuthology.orchestra.run.smithi081.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-13T06:40:24.213 INFO:teuthology.orchestra.run.smithi081.stdout:osd.2: {} 2024-09-13T06:40:24.214 INFO:teuthology.orchestra.run.smithi081.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-13T06:40:24.231 INFO:teuthology.orchestra.run.smithi081.stdout:osd.3: {} 2024-09-13T06:40:24.231 INFO:teuthology.orchestra.run.smithi081.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-13T06:40:24.248 INFO:teuthology.orchestra.run.smithi081.stdout:osd.4: {} 2024-09-13T06:40:24.248 INFO:teuthology.orchestra.run.smithi081.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-13T06:40:24.249 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-13T06:40:24.246+0000 7f86a5f06640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26387) UID: 0 2024-09-13T06:40:24.265 INFO:teuthology.orchestra.run.smithi081.stdout:osd.5: {} 2024-09-13T06:40:24.265 INFO:teuthology.orchestra.run.smithi081.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-13T06:40:24.284 INFO:teuthology.orchestra.run.smithi081.stdout:osd.6: {} 2024-09-13T06:40:24.285 INFO:teuthology.orchestra.run.smithi081.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-13T06:40:24.304 INFO:teuthology.orchestra.run.smithi081.stdout:osd.7: {} 2024-09-13T06:40:24.305 INFO:teuthology.orchestra.run.smithi081.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-13T06:40:24.314 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:40:24.314 INFO:teuthology.orchestra.run.smithi139.stdout: "size": 20, 2024-09-13T06:40:24.314 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 600, 2024-09-13T06:40:24.314 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [ 2024-09-13T06:40:24.314 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.314 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43282 3.1d 3:bd80bfb3:::rbd_object_map.11212f44bfb1.0000000000000020:head [call rbd.object_map_update in=20b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:40:24.315 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589032+0000", 2024-09-13T06:40:24.315 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 2.7253720330000002, 2024-09-13T06:40:24.315 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.076225263000000001, 2024-09-13T06:40:24.315 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:24.315 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:40:24.315 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:24.315 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:24.315 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:24.315 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43282 2024-09-13T06:40:24.315 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.315 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:24.315 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.315 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:24.316 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589032+0000", 2024-09-13T06:40:24.316 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:24.316 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.316 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.316 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:24.316 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589032+0000", 2024-09-13T06:40:24.316 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:24.316 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.316 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.316 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:24.316 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589031+0000", 2024-09-13T06:40:24.316 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:24.316 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.317 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.317 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:24.317 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589036+0000", 2024-09-13T06:40:24.317 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.2619999999999998e-06 2024-09-13T06:40:24.317 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.317 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.317 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:24.317 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589046+0000", 2024-09-13T06:40:24.317 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.8099999999999992e-06 2024-09-13T06:40:24.317 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.317 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.317 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:24.317 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589054+0000", 2024-09-13T06:40:24.317 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.2230000000000007e-06 2024-09-13T06:40:24.318 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.318 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.318 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:24.318 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.660691+0000", 2024-09-13T06:40:24.318 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.07163659 2024-09-13T06:40:24.318 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.318 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.318 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:24.318 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.660850+0000", 2024-09-13T06:40:24.318 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00015864300000000001 2024-09-13T06:40:24.318 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.318 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.318 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 4", 2024-09-13T06:40:24.319 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.661729+0000", 2024-09-13T06:40:24.319 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00087956099999999995 2024-09-13T06:40:24.319 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.319 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.319 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:40:24.319 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.664409+0000", 2024-09-13T06:40:24.319 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0026803479999999999 2024-09-13T06:40:24.319 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.319 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.319 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-13T06:40:24.319 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.665088+0000", 2024-09-13T06:40:24.319 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00067901400000000003 2024-09-13T06:40:24.319 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.320 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.320 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-13T06:40:24.320 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.665181+0000", 2024-09-13T06:40:24.320 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.2050000000000001e-05 2024-09-13T06:40:24.320 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.320 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.320 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:24.320 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.665257+0000", 2024-09-13T06:40:24.320 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.6698000000000003e-05 2024-09-13T06:40:24.320 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:24.320 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:24.320 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:24.320 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.321 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.321 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43287 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 251904~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:40:24.321 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589424+0000", 2024-09-13T06:40:24.321 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 2.7249804950000001, 2024-09-13T06:40:24.321 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.074334281000000002, 2024-09-13T06:40:24.321 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:24.321 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:24.321 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:24.321 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:24.321 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:24.321 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43287 2024-09-13T06:40:24.321 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.322 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:24.322 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.322 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:24.322 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589424+0000", 2024-09-13T06:40:24.322 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:24.322 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.322 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.322 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:24.322 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589424+0000", 2024-09-13T06:40:24.322 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:24.322 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.322 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.322 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:24.322 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589423+0000", 2024-09-13T06:40:24.323 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:24.323 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.323 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.323 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:24.323 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589426+0000", 2024-09-13T06:40:24.323 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.9129999999999996e-06 2024-09-13T06:40:24.323 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.323 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.323 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:24.323 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589436+0000", 2024-09-13T06:40:24.323 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.2320000000000007e-06 2024-09-13T06:40:24.323 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.323 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.323 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:24.324 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589443+0000", 2024-09-13T06:40:24.324 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.7770000000000002e-06 2024-09-13T06:40:24.324 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.324 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.324 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:24.324 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.663033+0000", 2024-09-13T06:40:24.324 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.073589744999999998 2024-09-13T06:40:24.324 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.324 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.324 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:24.324 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.663334+0000", 2024-09-13T06:40:24.324 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00030028200000000002 2024-09-13T06:40:24.324 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.324 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.325 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:24.325 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.663758+0000", 2024-09-13T06:40:24.325 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000424282 2024-09-13T06:40:24.325 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:24.325 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:24.325 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:24.325 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.325 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.325 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43288 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 270336~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:40:24.325 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589449+0000", 2024-09-13T06:40:24.325 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 2.7249547810000001, 2024-09-13T06:40:24.325 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.074906773999999995, 2024-09-13T06:40:24.326 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:24.326 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:24.326 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:24.326 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:24.326 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:24.326 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43288 2024-09-13T06:40:24.326 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.326 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:24.326 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.326 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:24.326 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589449+0000", 2024-09-13T06:40:24.326 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:24.326 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.326 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.327 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:24.327 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589449+0000", 2024-09-13T06:40:24.327 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:24.327 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.327 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.327 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:24.327 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589449+0000", 2024-09-13T06:40:24.327 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:24.327 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.327 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.327 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:24.327 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589452+0000", 2024-09-13T06:40:24.327 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.5769999999999998e-06 2024-09-13T06:40:24.328 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.328 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.328 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:24.328 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589461+0000", 2024-09-13T06:40:24.328 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.5720000000000003e-06 2024-09-13T06:40:24.328 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.328 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.328 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:24.328 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589468+0000", 2024-09-13T06:40:24.328 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5859999999999999e-06 2024-09-13T06:40:24.328 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.328 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.329 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:24.329 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.663827+0000", 2024-09-13T06:40:24.329 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.074358704999999997 2024-09-13T06:40:24.329 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.329 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.329 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:24.329 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.664011+0000", 2024-09-13T06:40:24.329 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00018381699999999999 2024-09-13T06:40:24.329 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.329 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.329 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:24.329 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.664356+0000", 2024-09-13T06:40:24.329 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00034510999999999998 2024-09-13T06:40:24.329 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:24.330 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:24.330 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:24.330 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.330 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.330 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43289 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 284672~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:40:24.330 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589475+0000", 2024-09-13T06:40:24.330 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 2.7249293830000001, 2024-09-13T06:40:24.330 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.075789117000000003, 2024-09-13T06:40:24.330 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:24.330 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:24.330 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:24.330 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:24.330 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:24.331 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43289 2024-09-13T06:40:24.331 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.331 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:24.331 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.331 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:24.331 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589475+0000", 2024-09-13T06:40:24.331 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:24.331 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.331 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.331 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:24.331 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589475+0000", 2024-09-13T06:40:24.331 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:24.331 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.332 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.332 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:24.332 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589474+0000", 2024-09-13T06:40:24.332 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:24.332 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.332 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.332 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:24.332 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589477+0000", 2024-09-13T06:40:24.332 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.7929999999999999e-06 2024-09-13T06:40:24.332 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.332 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.332 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:24.332 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589486+0000", 2024-09-13T06:40:24.333 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.4989999999999994e-06 2024-09-13T06:40:24.333 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.333 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.333 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:24.333 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589493+0000", 2024-09-13T06:40:24.333 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5329999999999997e-06 2024-09-13T06:40:24.333 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.333 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.333 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:24.333 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.664456+0000", 2024-09-13T06:40:24.333 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.074962794999999999 2024-09-13T06:40:24.333 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.333 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.334 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:24.334 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.664653+0000", 2024-09-13T06:40:24.334 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000197107 2024-09-13T06:40:24.334 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.334 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.334 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:24.334 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.665264+0000", 2024-09-13T06:40:24.334 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00061037600000000004 2024-09-13T06:40:24.334 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:24.334 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:24.334 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:24.334 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.334 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.334 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43290 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 299008~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:40:24.335 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589500+0000", 2024-09-13T06:40:24.335 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 2.724903871, 2024-09-13T06:40:24.335 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.075898564000000002, 2024-09-13T06:40:24.335 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:24.335 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:24.335 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:24.335 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:24.335 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:24.335 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43290 2024-09-13T06:40:24.335 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.335 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:24.335 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.335 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:24.336 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589500+0000", 2024-09-13T06:40:24.336 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:24.336 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.336 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.336 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:24.336 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589500+0000", 2024-09-13T06:40:24.336 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:24.336 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.336 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.336 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:24.336 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589499+0000", 2024-09-13T06:40:24.336 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:24.336 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.336 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.337 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:24.337 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589503+0000", 2024-09-13T06:40:24.337 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.8330000000000004e-06 2024-09-13T06:40:24.337 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.337 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.337 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:24.337 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589511+0000", 2024-09-13T06:40:24.337 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.3359999999999995e-06 2024-09-13T06:40:24.337 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.337 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.337 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:24.337 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589519+0000", 2024-09-13T06:40:24.337 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.4760000000000001e-06 2024-09-13T06:40:24.338 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.338 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.338 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:24.338 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.665097+0000", 2024-09-13T06:40:24.338 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.075577828999999999 2024-09-13T06:40:24.338 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.338 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.338 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:24.338 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.665170+0000", 2024-09-13T06:40:24.338 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.3745000000000006e-05 2024-09-13T06:40:24.338 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.338 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.338 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:24.338 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.665399+0000", 2024-09-13T06:40:24.339 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00022826199999999999 2024-09-13T06:40:24.339 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:24.339 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:24.339 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:24.339 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.339 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.339 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43291 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 313344~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:40:24.339 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589560+0000", 2024-09-13T06:40:24.339 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 2.72484365, 2024-09-13T06:40:24.339 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.076145594999999996, 2024-09-13T06:40:24.339 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:24.339 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:24.339 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:24.340 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:24.340 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:24.340 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43291 2024-09-13T06:40:24.340 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.340 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:24.340 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.340 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:24.340 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589560+0000", 2024-09-13T06:40:24.340 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:24.340 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.340 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.340 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:24.340 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589560+0000", 2024-09-13T06:40:24.340 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:24.341 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.341 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.341 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:24.341 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589559+0000", 2024-09-13T06:40:24.341 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:24.341 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.341 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.341 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:24.341 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589564+0000", 2024-09-13T06:40:24.341 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.3989999999999997e-06 2024-09-13T06:40:24.341 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.341 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.341 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:24.342 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589574+0000", 2024-09-13T06:40:24.342 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0502999999999999e-05 2024-09-13T06:40:24.342 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.342 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.342 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:24.342 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589582+0000", 2024-09-13T06:40:24.342 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.1859999999999992e-06 2024-09-13T06:40:24.342 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.342 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.342 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:24.342 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.665423+0000", 2024-09-13T06:40:24.342 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.075840290000000005 2024-09-13T06:40:24.342 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.342 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.343 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:24.343 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.665496+0000", 2024-09-13T06:40:24.343 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.2791000000000002e-05 2024-09-13T06:40:24.343 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.343 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.343 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:24.343 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.665706+0000", 2024-09-13T06:40:24.343 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00021038200000000001 2024-09-13T06:40:24.343 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:24.343 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:24.343 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:24.343 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.343 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.344 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43292 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 327680~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:40:24.344 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589589+0000", 2024-09-13T06:40:24.344 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 2.7248151090000001, 2024-09-13T06:40:24.344 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.076769537999999998, 2024-09-13T06:40:24.344 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:24.344 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:24.344 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:24.344 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:24.344 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:24.344 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43292 2024-09-13T06:40:24.344 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.344 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:24.344 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.344 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:24.345 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589589+0000", 2024-09-13T06:40:24.345 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:24.345 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.345 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.345 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:24.345 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589589+0000", 2024-09-13T06:40:24.345 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:24.345 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.345 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.345 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:24.345 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589588+0000", 2024-09-13T06:40:24.345 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:24.345 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.346 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.346 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:24.346 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589592+0000", 2024-09-13T06:40:24.346 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.6389999999999998e-06 2024-09-13T06:40:24.346 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.346 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.346 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:24.346 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589600+0000", 2024-09-13T06:40:24.346 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.4630000000000001e-06 2024-09-13T06:40:24.346 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.346 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.346 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:24.346 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589608+0000", 2024-09-13T06:40:24.347 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.2359999999999998e-06 2024-09-13T06:40:24.347 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.347 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.347 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:24.347 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.665779+0000", 2024-09-13T06:40:24.347 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.076170924000000001 2024-09-13T06:40:24.347 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.347 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.347 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:24.347 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.665977+0000", 2024-09-13T06:40:24.347 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00019891900000000001 2024-09-13T06:40:24.347 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.347 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.347 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:24.348 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.666358+0000", 2024-09-13T06:40:24.348 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000380963 2024-09-13T06:40:24.348 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:24.348 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:24.348 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:24.348 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.348 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.348 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43293 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 342016~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:40:24.348 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589616+0000", 2024-09-13T06:40:24.349 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 2.7247882150000002, 2024-09-13T06:40:24.349 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.077030083999999999, 2024-09-13T06:40:24.349 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:24.349 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:24.349 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:24.349 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:24.349 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:24.349 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43293 2024-09-13T06:40:24.350 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.350 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:24.350 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.350 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:24.350 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589616+0000", 2024-09-13T06:40:24.350 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:24.350 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.350 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.350 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:24.350 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589616+0000", 2024-09-13T06:40:24.350 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:24.350 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.350 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.351 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:24.351 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589615+0000", 2024-09-13T06:40:24.351 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:24.351 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.351 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.351 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:24.351 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589619+0000", 2024-09-13T06:40:24.351 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.9559999999999999e-06 2024-09-13T06:40:24.351 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.351 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.351 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:24.351 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589627+0000", 2024-09-13T06:40:24.351 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.2490000000000001e-06 2024-09-13T06:40:24.352 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.352 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.352 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:24.352 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589635+0000", 2024-09-13T06:40:24.352 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.96e-06 2024-09-13T06:40:24.352 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.352 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.352 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:24.352 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.666379+0000", 2024-09-13T06:40:24.352 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.076744484000000002 2024-09-13T06:40:24.352 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.352 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.352 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:24.353 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.666454+0000", 2024-09-13T06:40:24.353 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.4623999999999996e-05 2024-09-13T06:40:24.353 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.353 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.353 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:24.353 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.666646+0000", 2024-09-13T06:40:24.353 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00019176999999999999 2024-09-13T06:40:24.353 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:24.353 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:24.353 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:24.353 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.353 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.353 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43294 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 356352~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:40:24.354 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589681+0000", 2024-09-13T06:40:24.354 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 2.7247228999999997, 2024-09-13T06:40:24.354 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.077594648000000002, 2024-09-13T06:40:24.354 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:24.354 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:24.354 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:24.354 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:24.354 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:24.354 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43294 2024-09-13T06:40:24.354 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.354 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:24.354 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.354 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:24.354 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589681+0000", 2024-09-13T06:40:24.355 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:24.355 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.355 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.355 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:24.355 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589681+0000", 2024-09-13T06:40:24.355 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:24.355 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.355 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.355 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:24.355 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589680+0000", 2024-09-13T06:40:24.355 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:24.355 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.355 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.356 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:24.356 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589684+0000", 2024-09-13T06:40:24.356 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.8369999999999999e-06 2024-09-13T06:40:24.356 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.356 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.356 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:24.356 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589693+0000", 2024-09-13T06:40:24.356 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.1020000000000003e-06 2024-09-13T06:40:24.356 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.356 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.356 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:24.356 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589701+0000", 2024-09-13T06:40:24.356 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.8059999999999995e-06 2024-09-13T06:40:24.356 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.357 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.357 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:24.357 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.666714+0000", 2024-09-13T06:40:24.357 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.077013463000000004 2024-09-13T06:40:24.357 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.357 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.357 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:24.357 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.666897+0000", 2024-09-13T06:40:24.357 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000182268 2024-09-13T06:40:24.357 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.357 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.357 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:24.357 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.667276+0000", 2024-09-13T06:40:24.357 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00037907499999999998 2024-09-13T06:40:24.358 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:24.358 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:24.358 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:24.358 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.358 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.358 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43295 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 370688~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:40:24.358 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589744+0000", 2024-09-13T06:40:24.358 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 2.7246597279999998, 2024-09-13T06:40:24.358 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.077854343000000006, 2024-09-13T06:40:24.358 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:24.358 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:24.358 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:24.358 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:24.359 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:24.359 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43295 2024-09-13T06:40:24.359 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.359 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:24.359 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.359 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:24.359 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589744+0000", 2024-09-13T06:40:24.359 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:24.359 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.359 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.359 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:24.359 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589744+0000", 2024-09-13T06:40:24.359 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:24.360 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.360 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.360 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:24.360 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589743+0000", 2024-09-13T06:40:24.360 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:24.360 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.360 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.360 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:24.360 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589747+0000", 2024-09-13T06:40:24.360 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0130000000000004e-06 2024-09-13T06:40:24.360 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.360 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.360 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:24.360 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589756+0000", 2024-09-13T06:40:24.361 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.003e-06 2024-09-13T06:40:24.361 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.361 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.361 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:24.361 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589766+0000", 2024-09-13T06:40:24.361 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.2820000000000002e-06 2024-09-13T06:40:24.361 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.361 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.361 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:24.361 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.667300+0000", 2024-09-13T06:40:24.361 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.077534299000000001 2024-09-13T06:40:24.361 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.361 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.362 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:24.362 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.667372+0000", 2024-09-13T06:40:24.362 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.2393999999999998e-05 2024-09-13T06:40:24.362 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.362 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.362 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:24.362 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.667599+0000", 2024-09-13T06:40:24.362 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000226269 2024-09-13T06:40:24.362 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:24.362 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:24.362 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:24.362 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.362 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.363 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43296 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 385024~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:40:24.363 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589772+0000", 2024-09-13T06:40:24.363 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 2.7246317040000001, 2024-09-13T06:40:24.363 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.078469647000000003, 2024-09-13T06:40:24.363 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:24.363 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:24.363 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:24.363 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:24.363 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:24.363 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43296 2024-09-13T06:40:24.363 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.363 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:24.363 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.364 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:24.364 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589772+0000", 2024-09-13T06:40:24.364 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:24.364 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.364 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.364 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:24.364 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589772+0000", 2024-09-13T06:40:24.364 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:24.364 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.364 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.364 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:24.364 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589771+0000", 2024-09-13T06:40:24.364 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:24.365 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.365 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.365 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:24.365 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589775+0000", 2024-09-13T06:40:24.365 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.8530000000000002e-06 2024-09-13T06:40:24.365 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.365 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.365 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:24.365 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589784+0000", 2024-09-13T06:40:24.365 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.4300000000000006e-06 2024-09-13T06:40:24.365 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.365 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.365 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:24.365 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589791+0000", 2024-09-13T06:40:24.366 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.4660000000000002e-06 2024-09-13T06:40:24.366 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.366 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.366 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:24.366 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.667667+0000", 2024-09-13T06:40:24.366 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.077875697999999993 2024-09-13T06:40:24.366 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.366 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.366 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:24.366 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.667854+0000", 2024-09-13T06:40:24.366 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00018760099999999999 2024-09-13T06:40:24.366 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.366 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.366 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:24.367 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.668242+0000", 2024-09-13T06:40:24.367 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00038750600000000003 2024-09-13T06:40:24.367 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:24.367 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:24.367 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:24.367 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.367 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.367 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43297 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 403456~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:40:24.367 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589797+0000", 2024-09-13T06:40:24.367 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 2.7246069999999998, 2024-09-13T06:40:24.367 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.078756672999999999, 2024-09-13T06:40:24.367 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:24.367 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:24.368 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:24.368 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:24.368 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:24.368 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43297 2024-09-13T06:40:24.368 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.368 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:24.368 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.368 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:24.368 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589797+0000", 2024-09-13T06:40:24.368 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:24.368 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.368 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.368 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:24.369 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589797+0000", 2024-09-13T06:40:24.369 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:24.369 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.369 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.369 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:24.369 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589796+0000", 2024-09-13T06:40:24.369 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:24.369 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.369 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.369 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:24.369 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589800+0000", 2024-09-13T06:40:24.369 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.3230000000000002e-06 2024-09-13T06:40:24.370 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.370 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.370 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:24.370 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589808+0000", 2024-09-13T06:40:24.370 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.2390000000000002e-06 2024-09-13T06:40:24.370 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.370 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.370 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:24.370 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589815+0000", 2024-09-13T06:40:24.370 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.413e-06 2024-09-13T06:40:24.370 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.370 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.370 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:24.370 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.668265+0000", 2024-09-13T06:40:24.371 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.078449873000000003 2024-09-13T06:40:24.371 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.371 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.371 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:24.371 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.668332+0000", 2024-09-13T06:40:24.371 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.7178e-05 2024-09-13T06:40:24.371 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.371 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.371 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:24.371 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.668554+0000", 2024-09-13T06:40:24.371 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00022128600000000001 2024-09-13T06:40:24.371 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:24.371 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:24.372 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:24.372 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.372 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.372 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43298 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 417792~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:40:24.372 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589821+0000", 2024-09-13T06:40:24.372 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 2.7245828780000001, 2024-09-13T06:40:24.372 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.079368660999999993, 2024-09-13T06:40:24.372 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:24.372 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:24.372 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:24.372 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:24.372 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:24.372 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43298 2024-09-13T06:40:24.373 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.373 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:24.373 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.373 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:24.373 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589821+0000", 2024-09-13T06:40:24.373 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:24.373 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.373 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.373 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:24.373 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589821+0000", 2024-09-13T06:40:24.373 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:24.373 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.373 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.374 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:24.374 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589821+0000", 2024-09-13T06:40:24.374 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:24.374 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.374 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.374 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:24.374 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589830+0000", 2024-09-13T06:40:24.374 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.4860000000000003e-06 2024-09-13T06:40:24.374 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.374 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.374 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:24.374 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589839+0000", 2024-09-13T06:40:24.374 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.0159999999999997e-06 2024-09-13T06:40:24.375 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.375 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.375 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:24.375 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589847+0000", 2024-09-13T06:40:24.375 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.6059999999999997e-06 2024-09-13T06:40:24.375 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.375 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.375 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:24.375 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.668620+0000", 2024-09-13T06:40:24.375 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.078773485000000004 2024-09-13T06:40:24.375 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.375 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.375 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:24.375 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.668798+0000", 2024-09-13T06:40:24.376 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000178233 2024-09-13T06:40:24.376 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.376 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.376 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:24.376 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.669190+0000", 2024-09-13T06:40:24.376 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00039143499999999998 2024-09-13T06:40:24.376 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:24.376 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:24.376 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:24.376 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.376 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.376 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43299 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 432128~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:40:24.376 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589881+0000", 2024-09-13T06:40:24.377 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 2.7245230299999998, 2024-09-13T06:40:24.377 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.079693849999999997, 2024-09-13T06:40:24.377 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:24.377 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:24.377 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:24.377 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:24.377 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:24.377 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43299 2024-09-13T06:40:24.377 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.377 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:24.377 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.377 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:24.377 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589881+0000", 2024-09-13T06:40:24.378 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:24.378 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.378 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.378 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:24.378 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589881+0000", 2024-09-13T06:40:24.378 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:24.378 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.378 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.378 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:24.378 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589880+0000", 2024-09-13T06:40:24.378 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:24.378 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.378 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.379 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:24.379 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589884+0000", 2024-09-13T06:40:24.379 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.053e-06 2024-09-13T06:40:24.379 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.379 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.379 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:24.379 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589893+0000", 2024-09-13T06:40:24.379 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.2129999999999997e-06 2024-09-13T06:40:24.379 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.379 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.379 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:24.379 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589901+0000", 2024-09-13T06:40:24.379 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.6399999999999997e-06 2024-09-13T06:40:24.380 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.380 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.380 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:24.380 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.669213+0000", 2024-09-13T06:40:24.380 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.079312074999999996 2024-09-13T06:40:24.380 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.380 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.380 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:24.380 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.669281+0000", 2024-09-13T06:40:24.380 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.8322000000000001e-05 2024-09-13T06:40:24.381 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.381 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.381 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:24.381 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.669575+0000", 2024-09-13T06:40:24.381 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00029349699999999999 2024-09-13T06:40:24.381 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:24.381 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:24.381 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:24.381 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.381 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.381 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43300 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 446464~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:40:24.381 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589909+0000", 2024-09-13T06:40:24.381 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 2.7244951349999997, 2024-09-13T06:40:24.382 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.080339496999999996, 2024-09-13T06:40:24.382 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:24.382 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:24.382 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:24.382 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:24.382 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:24.382 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43300 2024-09-13T06:40:24.382 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.382 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:24.382 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.382 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:24.382 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589909+0000", 2024-09-13T06:40:24.382 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:24.383 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.383 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.383 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:24.383 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589909+0000", 2024-09-13T06:40:24.383 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:24.383 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.383 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.383 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:24.383 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589908+0000", 2024-09-13T06:40:24.383 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:24.383 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.383 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.383 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:24.383 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589912+0000", 2024-09-13T06:40:24.384 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.9430000000000002e-06 2024-09-13T06:40:24.384 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.384 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.384 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:24.384 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589920+0000", 2024-09-13T06:40:24.384 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.3860000000000007e-06 2024-09-13T06:40:24.384 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.384 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.384 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:24.384 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589928+0000", 2024-09-13T06:40:24.384 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.3329999999999999e-06 2024-09-13T06:40:24.384 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.384 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.385 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:24.385 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.669651+0000", 2024-09-13T06:40:24.385 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.079723204000000006 2024-09-13T06:40:24.385 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.385 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.385 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:24.385 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.669840+0000", 2024-09-13T06:40:24.385 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000189397 2024-09-13T06:40:24.385 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.385 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.385 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:24.385 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.670248+0000", 2024-09-13T06:40:24.385 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00040811100000000001 2024-09-13T06:40:24.385 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:24.386 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:24.386 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:24.386 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.386 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.386 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43301 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 460800~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:40:24.386 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589934+0000", 2024-09-13T06:40:24.386 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 2.7244704610000001, 2024-09-13T06:40:24.386 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.080747474999999999, 2024-09-13T06:40:24.386 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:24.386 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:24.386 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:24.386 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:24.386 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:24.387 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43301 2024-09-13T06:40:24.387 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.387 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:24.387 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.387 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:24.387 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589934+0000", 2024-09-13T06:40:24.387 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:24.387 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.387 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.387 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:24.387 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589934+0000", 2024-09-13T06:40:24.387 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:24.387 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.387 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.388 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:24.388 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589933+0000", 2024-09-13T06:40:24.388 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:24.388 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.388 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.388 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:24.388 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589936+0000", 2024-09-13T06:40:24.388 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.4599999999999999e-06 2024-09-13T06:40:24.388 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.388 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.388 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:24.388 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589945+0000", 2024-09-13T06:40:24.389 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.2430000000000005e-06 2024-09-13T06:40:24.389 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.389 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.389 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:24.389 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589952+0000", 2024-09-13T06:40:24.389 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.3289999999999996e-06 2024-09-13T06:40:24.389 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.389 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.389 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:24.389 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.670280+0000", 2024-09-13T06:40:24.389 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.080328514000000004 2024-09-13T06:40:24.389 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.389 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.390 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:24.390 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.670376+0000", 2024-09-13T06:40:24.390 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.5752000000000001e-05 2024-09-13T06:40:24.390 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.390 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.390 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:24.390 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.670681+0000", 2024-09-13T06:40:24.390 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00030479699999999999 2024-09-13T06:40:24.390 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:24.390 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:24.390 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:24.390 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.390 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.390 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43302 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 475136~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:40:24.391 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589958+0000", 2024-09-13T06:40:24.391 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 2.7244463990000001, 2024-09-13T06:40:24.391 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.081402394000000003, 2024-09-13T06:40:24.391 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:24.391 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:24.391 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:24.391 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:24.391 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:24.391 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43302 2024-09-13T06:40:24.391 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.391 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:24.391 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.391 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:24.391 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589958+0000", 2024-09-13T06:40:24.392 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:24.392 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.392 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.392 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:24.392 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589958+0000", 2024-09-13T06:40:24.392 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:24.392 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.392 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.392 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:24.392 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589957+0000", 2024-09-13T06:40:24.392 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:24.392 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.392 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.393 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:24.393 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589960+0000", 2024-09-13T06:40:24.393 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.4939999999999999e-06 2024-09-13T06:40:24.393 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.393 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.393 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:24.393 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589969+0000", 2024-09-13T06:40:24.393 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.3520000000000007e-06 2024-09-13T06:40:24.393 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.393 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.393 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:24.393 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589976+0000", 2024-09-13T06:40:24.393 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.3030000000000002e-06 2024-09-13T06:40:24.393 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.394 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.394 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:24.394 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.670765+0000", 2024-09-13T06:40:24.394 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.080789154000000002 2024-09-13T06:40:24.394 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.394 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.394 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:24.394 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.670960+0000", 2024-09-13T06:40:24.394 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00019464300000000001 2024-09-13T06:40:24.394 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.394 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.394 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:24.394 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.671360+0000", 2024-09-13T06:40:24.395 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00040005200000000002 2024-09-13T06:40:24.395 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:24.395 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:24.395 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:24.395 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.395 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.395 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43303 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 489472~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:40:24.395 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589985+0000", 2024-09-13T06:40:24.395 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 2.7244194510000002, 2024-09-13T06:40:24.395 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.082024333000000005, 2024-09-13T06:40:24.395 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:24.395 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:24.395 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:24.395 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:24.396 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:24.396 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43303 2024-09-13T06:40:24.396 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.396 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:24.396 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.396 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:24.396 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589985+0000", 2024-09-13T06:40:24.396 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:24.396 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.396 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.396 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:24.396 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589985+0000", 2024-09-13T06:40:24.396 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:24.397 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.397 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.397 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:24.397 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589984+0000", 2024-09-13T06:40:24.397 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:24.397 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.397 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.397 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:24.397 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589987+0000", 2024-09-13T06:40:24.397 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.726e-06 2024-09-13T06:40:24.397 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.397 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.397 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:24.397 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589996+0000", 2024-09-13T06:40:24.398 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.5459999999999992e-06 2024-09-13T06:40:24.398 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.398 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.398 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:24.398 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590003+0000", 2024-09-13T06:40:24.398 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.4229999999999999e-06 2024-09-13T06:40:24.398 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.398 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.398 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:24.398 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.671426+0000", 2024-09-13T06:40:24.398 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.081422704999999998 2024-09-13T06:40:24.398 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.398 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.398 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:24.399 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.671615+0000", 2024-09-13T06:40:24.399 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000188875 2024-09-13T06:40:24.399 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.399 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.399 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:24.399 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.672009+0000", 2024-09-13T06:40:24.399 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000394015 2024-09-13T06:40:24.399 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:24.399 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:24.400 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:24.400 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.400 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.400 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43304 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 503808~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:40:24.400 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.590039+0000", 2024-09-13T06:40:24.400 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 2.7243649059999999, 2024-09-13T06:40:24.400 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.082573880000000002, 2024-09-13T06:40:24.400 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:24.400 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:24.400 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:24.400 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:24.400 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:24.400 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43304 2024-09-13T06:40:24.401 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.401 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:24.401 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.401 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:24.401 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590039+0000", 2024-09-13T06:40:24.401 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:24.401 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.401 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.401 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:24.401 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590039+0000", 2024-09-13T06:40:24.401 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:24.401 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.401 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.402 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:24.402 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590038+0000", 2024-09-13T06:40:24.402 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:24.402 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.402 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.402 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:24.402 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590042+0000", 2024-09-13T06:40:24.402 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.9500000000000003e-06 2024-09-13T06:40:24.402 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.402 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.402 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:24.402 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590052+0000", 2024-09-13T06:40:24.402 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.3919999999999992e-06 2024-09-13T06:40:24.402 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.403 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.403 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:24.403 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590059+0000", 2024-09-13T06:40:24.403 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.7970000000000001e-06 2024-09-13T06:40:24.403 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.403 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.403 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:24.403 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.672078+0000", 2024-09-13T06:40:24.403 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.082018778000000001 2024-09-13T06:40:24.403 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.403 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.403 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:24.403 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.672266+0000", 2024-09-13T06:40:24.403 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00018807399999999999 2024-09-13T06:40:24.404 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.404 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.404 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:24.404 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.672613+0000", 2024-09-13T06:40:24.404 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00034677599999999997 2024-09-13T06:40:24.404 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:24.404 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:24.404 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:24.404 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.404 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.404 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43305 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 518144~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:40:24.404 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.590136+0000", 2024-09-13T06:40:24.404 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 2.7242677180000001, 2024-09-13T06:40:24.405 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.082988206999999994, 2024-09-13T06:40:24.405 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:24.405 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:24.405 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:24.405 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:24.405 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:24.405 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43305 2024-09-13T06:40:24.405 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.405 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:24.405 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.405 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:24.405 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590136+0000", 2024-09-13T06:40:24.405 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:24.405 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.406 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.406 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:24.406 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590136+0000", 2024-09-13T06:40:24.406 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:24.406 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.406 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.406 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:24.406 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590135+0000", 2024-09-13T06:40:24.406 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:24.406 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.406 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.406 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:24.406 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590139+0000", 2024-09-13T06:40:24.406 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.9489999999999998e-06 2024-09-13T06:40:24.407 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.407 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.407 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:24.407 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590148+0000", 2024-09-13T06:40:24.407 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.9830000000000002e-06 2024-09-13T06:40:24.407 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.407 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.407 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:24.407 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590156+0000", 2024-09-13T06:40:24.407 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5229999999999998e-06 2024-09-13T06:40:24.407 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.407 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.407 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:24.408 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.672709+0000", 2024-09-13T06:40:24.408 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.082552886000000006 2024-09-13T06:40:24.408 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.408 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.408 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:24.408 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.672816+0000", 2024-09-13T06:40:24.408 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000107736 2024-09-13T06:40:24.408 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.408 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.408 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:24.408 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.673124+0000", 2024-09-13T06:40:24.408 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00030804900000000002 2024-09-13T06:40:24.408 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:24.408 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:24.409 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:24.409 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:24.409 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:24.409 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:40:24.411 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:40:24.409+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:40:24.411 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-13T06:40:24.511 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:40:24.510+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:40:24.596 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:40:24.596 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [ 2024-09-13T06:40:24.596 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.596 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop(client.4385.0:45867 3.11 e71/40 3:8e0b21b9:::rbd_object_map.11211200685d.0000000000000023:head v 71'162, mlcod=71'160)", 2024-09-13T06:40:24.596 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:24.595475+0000", 2024-09-13T06:40:24.596 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0033682849999999999, 2024-09-13T06:40:24.596 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0034034019999999998, 2024-09-13T06:40:24.596 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:24.596 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:24.596 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:24.597 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.597 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:24.597 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:24.595475+0000", 2024-09-13T06:40:24.597 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:24.597 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.597 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.597 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:24.597 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:24.595475+0000", 2024-09-13T06:40:24.597 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:24.597 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.597 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.597 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:24.597 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:24.595472+0000", 2024-09-13T06:40:24.598 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999971 2024-09-13T06:40:24.598 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.598 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.598 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:24.598 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:24.595491+0000", 2024-09-13T06:40:24.598 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.8581999999999999e-05 2024-09-13T06:40:24.598 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.598 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.598 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:24.598 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:24.595566+0000", 2024-09-13T06:40:24.598 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.4537999999999997e-05 2024-09-13T06:40:24.598 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.598 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.599 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:24.599 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:24.595636+0000", 2024-09-13T06:40:24.599 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.0214000000000002e-05 2024-09-13T06:40:24.599 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.599 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.599 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:24.599 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:24.595933+0000", 2024-09-13T06:40:24.599 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00029691500000000003 2024-09-13T06:40:24.599 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.599 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.599 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:24.599 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:24.596029+0000", 2024-09-13T06:40:24.599 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6275999999999998e-05 2024-09-13T06:40:24.600 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:24.600 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:24.600 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:24.600 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:24.600 INFO:teuthology.orchestra.run.smithi139.stdout: ], 2024-09-13T06:40:24.600 INFO:teuthology.orchestra.run.smithi139.stdout: "num_ops": 1 2024-09-13T06:40:24.600 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:40:24.613 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:40:24.613+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:40:24.616 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-13T06:40:24.714 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:40:24.713+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:40:24.772 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:40:24.773 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [], 2024-09-13T06:40:24.773 INFO:teuthology.orchestra.run.smithi139.stdout: "complaint_time": 30, 2024-09-13T06:40:24.773 INFO:teuthology.orchestra.run.smithi139.stdout: "num_blocked_ops": 0 2024-09-13T06:40:24.773 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:40:24.787 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-13T06:40:24.834 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-13T06:40:24.834+0000 7f86a5f06640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26387) UID: 0 2024-09-13T06:40:24.903 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:40:24.903 INFO:teuthology.orchestra.run.smithi139.stdout: "size": 20, 2024-09-13T06:40:24.903 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 600, 2024-09-13T06:40:24.904 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [ 2024-09-13T06:40:24.904 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.904 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27854 3.a 3:537b3559:::rbd_data.1121f2c5ee81.0000000000000016:13 [read 335872~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:24.904 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.658750+0000", 2024-09-13T06:40:24.904 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 28.246694077000001, 2024-09-13T06:40:24.904 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.037969532, 2024-09-13T06:40:24.904 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:24.904 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:24.904 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:24.904 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:24.904 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:24.904 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27854 2024-09-13T06:40:24.905 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.905 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:24.905 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.905 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:24.905 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658750+0000", 2024-09-13T06:40:24.905 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:24.905 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.905 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.905 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:24.905 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658750+0000", 2024-09-13T06:40:24.905 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:24.905 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.906 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.906 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:24.906 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658749+0000", 2024-09-13T06:40:24.906 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:24.906 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.906 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.906 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:24.906 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658757+0000", 2024-09-13T06:40:24.906 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.7389999999999999e-06 2024-09-13T06:40:24.907 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.907 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.907 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:24.907 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658763+0000", 2024-09-13T06:40:24.907 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.7769999999999999e-06 2024-09-13T06:40:24.907 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.907 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.907 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:24.907 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658767+0000", 2024-09-13T06:40:24.907 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.1749999999999998e-06 2024-09-13T06:40:24.907 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.907 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.907 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:24.907 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.696322+0000", 2024-09-13T06:40:24.908 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.037554772 2024-09-13T06:40:24.908 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.908 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.908 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:24.908 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.696418+0000", 2024-09-13T06:40:24.908 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6050000000000004e-05 2024-09-13T06:40:24.908 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.908 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.908 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:24.909 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.696719+0000", 2024-09-13T06:40:24.909 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00030138499999999999 2024-09-13T06:40:24.909 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:24.909 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:24.909 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:24.909 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.909 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.910 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27855 3.a 3:537b3559:::rbd_data.1121f2c5ee81.0000000000000016:13 [read 380928~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:24.910 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.658771+0000", 2024-09-13T06:40:24.910 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 28.246672833000002, 2024-09-13T06:40:24.910 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.038326354, 2024-09-13T06:40:24.910 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:24.910 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:24.910 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:24.910 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:24.910 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:24.910 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27855 2024-09-13T06:40:24.910 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.910 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:24.910 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.911 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:24.911 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658771+0000", 2024-09-13T06:40:24.911 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:24.911 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.911 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.911 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:24.911 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658771+0000", 2024-09-13T06:40:24.911 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:24.911 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.912 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.912 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:24.912 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658770+0000", 2024-09-13T06:40:24.912 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:24.912 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.912 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.912 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:24.912 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658772+0000", 2024-09-13T06:40:24.912 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.0930000000000001e-06 2024-09-13T06:40:24.912 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.912 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.912 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:24.913 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658778+0000", 2024-09-13T06:40:24.913 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.2730000000000002e-06 2024-09-13T06:40:24.913 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.913 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.913 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:24.913 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658782+0000", 2024-09-13T06:40:24.913 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0879999999999997e-06 2024-09-13T06:40:24.913 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.913 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.913 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:24.913 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.696770+0000", 2024-09-13T06:40:24.913 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.037988145000000001 2024-09-13T06:40:24.914 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.914 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.914 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:24.914 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.696852+0000", 2024-09-13T06:40:24.914 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.2039999999999994e-05 2024-09-13T06:40:24.914 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.914 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.914 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:24.914 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.697097+0000", 2024-09-13T06:40:24.914 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00024508800000000002 2024-09-13T06:40:24.914 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:24.914 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:24.914 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:24.914 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.914 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.915 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27856 3.a 3:537b3559:::rbd_data.1121f2c5ee81.0000000000000016:13 [read 405504~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:24.915 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.658786+0000", 2024-09-13T06:40:24.915 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 28.246657717000001, 2024-09-13T06:40:24.915 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.038736029999999998, 2024-09-13T06:40:24.915 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:24.915 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:24.915 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:24.915 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:24.915 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:24.915 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27856 2024-09-13T06:40:24.915 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.915 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:24.916 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.916 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:24.916 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658786+0000", 2024-09-13T06:40:24.916 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:24.916 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.916 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.916 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:24.916 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658786+0000", 2024-09-13T06:40:24.916 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:24.916 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.916 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.916 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:24.917 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658785+0000", 2024-09-13T06:40:24.917 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:24.917 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.917 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.917 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:24.917 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658787+0000", 2024-09-13T06:40:24.917 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.0040000000000002e-06 2024-09-13T06:40:24.917 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.917 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.917 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:24.917 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658793+0000", 2024-09-13T06:40:24.917 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.2410000000000003e-06 2024-09-13T06:40:24.917 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.918 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.918 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:24.918 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658797+0000", 2024-09-13T06:40:24.918 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.1330000000000001e-06 2024-09-13T06:40:24.918 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.918 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.918 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:24.918 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.697176+0000", 2024-09-13T06:40:24.918 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.038379074999999999 2024-09-13T06:40:24.918 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.918 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.918 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:24.918 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.697275+0000", 2024-09-13T06:40:24.918 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.8819000000000004e-05 2024-09-13T06:40:24.918 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.919 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.919 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:24.919 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.697522+0000", 2024-09-13T06:40:24.919 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00024719999999999999 2024-09-13T06:40:24.919 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:24.919 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:24.919 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:24.919 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.919 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.919 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27857 3.a 3:537b3559:::rbd_data.1121f2c5ee81.0000000000000016:13 [read 475136~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:24.919 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.658845+0000", 2024-09-13T06:40:24.919 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 28.246598714000001, 2024-09-13T06:40:24.919 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039112570999999999, 2024-09-13T06:40:24.920 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:24.920 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:24.920 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:24.920 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:24.920 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:24.920 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27857 2024-09-13T06:40:24.920 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.920 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:24.920 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.920 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:24.920 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658845+0000", 2024-09-13T06:40:24.920 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:24.920 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.921 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.921 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:24.921 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658845+0000", 2024-09-13T06:40:24.921 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:24.921 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.921 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.921 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:24.921 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658844+0000", 2024-09-13T06:40:24.921 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999986 2024-09-13T06:40:24.921 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.921 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.921 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:24.922 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658868+0000", 2024-09-13T06:40:24.922 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.4615000000000001e-05 2024-09-13T06:40:24.922 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.922 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.922 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:24.922 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658884+0000", 2024-09-13T06:40:24.922 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5401999999999999e-05 2024-09-13T06:40:24.922 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.922 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.922 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:24.922 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658896+0000", 2024-09-13T06:40:24.922 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2509e-05 2024-09-13T06:40:24.922 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.923 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.923 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:24.923 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.697571+0000", 2024-09-13T06:40:24.923 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.038675107 2024-09-13T06:40:24.923 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.923 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.923 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:24.923 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.697658+0000", 2024-09-13T06:40:24.923 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6349999999999998e-05 2024-09-13T06:40:24.923 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.923 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.923 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:24.923 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.697957+0000", 2024-09-13T06:40:24.923 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00029986100000000001 2024-09-13T06:40:24.924 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:24.924 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:24.924 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:24.924 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.924 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.924 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27858 3.a 3:537b3559:::rbd_data.1121f2c5ee81.0000000000000016:13 [read 499712~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:24.924 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.658905+0000", 2024-09-13T06:40:24.924 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 28.246538164, 2024-09-13T06:40:24.924 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039475392999999998, 2024-09-13T06:40:24.924 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:24.924 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:24.924 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:24.924 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:24.924 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:24.925 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27858 2024-09-13T06:40:24.925 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.925 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:24.925 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.925 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:24.925 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658905+0000", 2024-09-13T06:40:24.925 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:24.925 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.925 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.925 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:24.925 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658905+0000", 2024-09-13T06:40:24.925 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:24.925 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.926 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.926 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:24.926 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658905+0000", 2024-09-13T06:40:24.926 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:24.926 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.926 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.926 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:24.926 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658909+0000", 2024-09-13T06:40:24.926 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.831e-06 2024-09-13T06:40:24.927 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.927 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.927 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:24.927 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658920+0000", 2024-09-13T06:40:24.927 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0936e-05 2024-09-13T06:40:24.927 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.927 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.927 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:24.927 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658929+0000", 2024-09-13T06:40:24.927 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.2749999999999995e-06 2024-09-13T06:40:24.927 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.927 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.927 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:24.928 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.697990+0000", 2024-09-13T06:40:24.928 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039061625000000003 2024-09-13T06:40:24.928 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.928 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.928 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:24.928 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.698077+0000", 2024-09-13T06:40:24.928 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6922000000000006e-05 2024-09-13T06:40:24.928 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.928 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.928 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:24.928 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.698381+0000", 2024-09-13T06:40:24.928 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00030360599999999999 2024-09-13T06:40:24.929 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:24.929 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:24.929 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:24.929 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.929 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.929 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27929 3.a 3:537b3559:::rbd_data.1121f2c5ee81.0000000000000016:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:24.929 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.659338+0000", 2024-09-13T06:40:24.929 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 28.246105332999999, 2024-09-13T06:40:24.929 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039351214000000002, 2024-09-13T06:40:24.929 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:24.930 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:24.930 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:24.930 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:24.930 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:24.930 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27929 2024-09-13T06:40:24.930 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.930 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:24.930 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.930 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:24.930 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.659338+0000", 2024-09-13T06:40:24.931 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:24.931 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.931 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.931 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:24.931 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.659338+0000", 2024-09-13T06:40:24.931 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:24.931 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.931 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.931 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:24.931 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.659337+0000", 2024-09-13T06:40:24.931 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:24.931 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.932 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.932 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:24.932 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.659342+0000", 2024-09-13T06:40:24.932 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0799999999999999e-06 2024-09-13T06:40:24.932 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.932 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.932 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:24.932 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.659353+0000", 2024-09-13T06:40:24.932 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1798e-05 2024-09-13T06:40:24.932 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.932 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.932 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:24.933 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.659361+0000", 2024-09-13T06:40:24.933 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.8040000000000002e-06 2024-09-13T06:40:24.933 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.933 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.933 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:24.933 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.698449+0000", 2024-09-13T06:40:24.933 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039087519000000001 2024-09-13T06:40:24.933 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.933 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.933 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:24.933 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.698567+0000", 2024-09-13T06:40:24.933 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00011857 2024-09-13T06:40:24.934 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.934 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.934 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:24.934 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.698689+0000", 2024-09-13T06:40:24.934 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00012226699999999999 2024-09-13T06:40:24.934 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:24.934 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:24.934 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:24.934 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.934 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.934 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27974 3.a 3:537b3559:::rbd_data.1121f2c5ee81.0000000000000016:13 [read 32768~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:24.934 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.660102+0000", 2024-09-13T06:40:24.934 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 28.245341565, 2024-09-13T06:40:24.935 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.038972346999999997, 2024-09-13T06:40:24.935 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:24.935 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:24.935 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:24.935 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:24.935 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:24.935 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27974 2024-09-13T06:40:24.935 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.935 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:24.935 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.935 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:24.935 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660102+0000", 2024-09-13T06:40:24.935 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:24.936 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.936 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.936 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:24.936 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660102+0000", 2024-09-13T06:40:24.936 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:24.936 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.936 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.936 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:24.936 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660100+0000", 2024-09-13T06:40:24.936 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999976 2024-09-13T06:40:24.936 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.936 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.936 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:24.936 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660114+0000", 2024-09-13T06:40:24.937 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.4466e-05 2024-09-13T06:40:24.937 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.937 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.937 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:24.937 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660148+0000", 2024-09-13T06:40:24.937 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.3742999999999999e-05 2024-09-13T06:40:24.937 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.937 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.937 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:24.937 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660170+0000", 2024-09-13T06:40:24.937 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.2518e-05 2024-09-13T06:40:24.937 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.937 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.938 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:24.938 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.698719+0000", 2024-09-13T06:40:24.938 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.038548529999999998 2024-09-13T06:40:24.938 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.938 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.938 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:24.938 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.698806+0000", 2024-09-13T06:40:24.938 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.7179e-05 2024-09-13T06:40:24.938 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.938 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.938 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:24.938 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.699074+0000", 2024-09-13T06:40:24.938 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00026834800000000001 2024-09-13T06:40:24.938 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:24.939 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:24.939 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:24.939 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.939 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.939 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27975 3.a 3:537b3559:::rbd_data.1121f2c5ee81.0000000000000016:13 [read 57344~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:24.939 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.660189+0000", 2024-09-13T06:40:24.939 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 28.245254720999998, 2024-09-13T06:40:24.939 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039288678, 2024-09-13T06:40:24.939 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:24.939 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:24.939 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:24.939 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:24.939 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:24.939 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27975 2024-09-13T06:40:24.939 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.940 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:24.940 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.940 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:24.940 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660189+0000", 2024-09-13T06:40:24.940 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:24.940 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.940 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.940 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:24.940 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660189+0000", 2024-09-13T06:40:24.940 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:24.940 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.940 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.940 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:24.940 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660187+0000", 2024-09-13T06:40:24.941 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999981 2024-09-13T06:40:24.941 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.941 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.941 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:24.941 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660195+0000", 2024-09-13T06:40:24.941 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5610000000000001e-06 2024-09-13T06:40:24.941 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.941 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.941 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:24.941 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660212+0000", 2024-09-13T06:40:24.941 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7725999999999999e-05 2024-09-13T06:40:24.941 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.942 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.942 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:24.942 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660227+0000", 2024-09-13T06:40:24.942 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.43e-05 2024-09-13T06:40:24.942 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.942 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.942 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:24.942 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.699135+0000", 2024-09-13T06:40:24.942 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.038908336000000002 2024-09-13T06:40:24.942 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.942 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.942 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:24.943 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.699208+0000", 2024-09-13T06:40:24.943 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.3065000000000006e-05 2024-09-13T06:40:24.943 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.943 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.943 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:24.943 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.699478+0000", 2024-09-13T06:40:24.943 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00026946899999999999 2024-09-13T06:40:24.943 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:24.943 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:24.943 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:24.943 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.943 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.943 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27976 3.a 3:537b3559:::rbd_data.1121f2c5ee81.0000000000000016:13 [read 102400~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:24.944 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.660238+0000", 2024-09-13T06:40:24.944 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 28.245205557999999, 2024-09-13T06:40:24.944 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039636515999999997, 2024-09-13T06:40:24.944 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:24.944 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:24.944 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:24.944 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:24.944 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:24.944 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27976 2024-09-13T06:40:24.944 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.944 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:24.944 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.944 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:24.945 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660238+0000", 2024-09-13T06:40:24.945 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:24.945 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.945 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.945 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:24.945 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660238+0000", 2024-09-13T06:40:24.945 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:24.945 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.945 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.945 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:24.945 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660237+0000", 2024-09-13T06:40:24.945 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:24.945 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.945 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.946 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:24.946 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660243+0000", 2024-09-13T06:40:24.946 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.9909999999999999e-06 2024-09-13T06:40:24.946 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.946 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.946 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:24.946 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660259+0000", 2024-09-13T06:40:24.946 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6294e-05 2024-09-13T06:40:24.946 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.946 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.946 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:24.946 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660272+0000", 2024-09-13T06:40:24.946 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2714999999999999e-05 2024-09-13T06:40:24.946 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.947 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.947 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:24.947 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.699513+0000", 2024-09-13T06:40:24.947 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039240932999999999 2024-09-13T06:40:24.947 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.947 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.947 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:24.947 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.699604+0000", 2024-09-13T06:40:24.947 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.1367999999999997e-05 2024-09-13T06:40:24.947 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.947 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.947 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:24.947 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.699875+0000", 2024-09-13T06:40:24.947 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00027029499999999999 2024-09-13T06:40:24.948 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:24.948 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:24.948 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:24.948 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.948 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.948 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27977 3.a 3:537b3559:::rbd_data.1121f2c5ee81.0000000000000016:13 [read 126976~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:24.948 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.660284+0000", 2024-09-13T06:40:24.948 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 28.245159986000001, 2024-09-13T06:40:24.948 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039969945, 2024-09-13T06:40:24.948 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:24.948 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:24.948 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:24.948 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:24.948 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:24.949 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27977 2024-09-13T06:40:24.949 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.949 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:24.949 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.949 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:24.949 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660284+0000", 2024-09-13T06:40:24.949 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:24.949 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.949 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.949 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:24.949 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660284+0000", 2024-09-13T06:40:24.949 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:24.949 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.950 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.950 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:24.950 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660282+0000", 2024-09-13T06:40:24.950 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999986 2024-09-13T06:40:24.950 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.950 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.950 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:24.950 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660288+0000", 2024-09-13T06:40:24.950 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.2650000000000002e-06 2024-09-13T06:40:24.950 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.950 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.950 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:24.950 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660304+0000", 2024-09-13T06:40:24.951 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5430999999999998e-05 2024-09-13T06:40:24.951 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.951 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.951 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:24.951 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660316+0000", 2024-09-13T06:40:24.951 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.237e-05 2024-09-13T06:40:24.951 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.951 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.951 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:24.951 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.699907+0000", 2024-09-13T06:40:24.951 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039590735000000002 2024-09-13T06:40:24.951 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.951 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.952 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:24.952 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.699994+0000", 2024-09-13T06:40:24.952 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6996999999999994e-05 2024-09-13T06:40:24.952 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.952 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.952 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:24.952 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700254+0000", 2024-09-13T06:40:24.952 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000259564 2024-09-13T06:40:24.952 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:24.952 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:24.952 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:24.952 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.952 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.953 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27978 3.a 3.9aacdeca (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:24.953 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.660327+0000", 2024-09-13T06:40:24.953 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 28.245116388, 2024-09-13T06:40:24.953 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039984858999999998, 2024-09-13T06:40:24.953 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:24.953 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:40:24.953 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:24.953 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:24.953 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:24.953 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27978 2024-09-13T06:40:24.953 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.953 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:24.953 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.954 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:24.954 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660327+0000", 2024-09-13T06:40:24.954 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:24.954 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.954 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.954 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:24.954 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660327+0000", 2024-09-13T06:40:24.954 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:24.954 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.954 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.954 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:24.954 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660326+0000", 2024-09-13T06:40:24.954 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:24.954 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.955 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.955 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:24.955 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660366+0000", 2024-09-13T06:40:24.955 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.9691000000000003e-05 2024-09-13T06:40:24.955 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.955 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.955 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:24.955 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660399+0000", 2024-09-13T06:40:24.955 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.3262000000000001e-05 2024-09-13T06:40:24.955 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.955 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.955 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:24.955 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660414+0000", 2024-09-13T06:40:24.955 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.4775e-05 2024-09-13T06:40:24.956 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.956 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.956 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:24.956 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700298+0000", 2024-09-13T06:40:24.956 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039883759999999997 2024-09-13T06:40:24.956 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.956 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.956 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:24.956 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700312+0000", 2024-09-13T06:40:24.956 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.4374e-05 2024-09-13T06:40:24.956 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:24.956 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:24.956 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:24.956 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.957 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.957 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27979 3.a 3.9aacdeca (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:24.957 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.660429+0000", 2024-09-13T06:40:24.957 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 28.245014520000002, 2024-09-13T06:40:24.957 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039921361000000002, 2024-09-13T06:40:24.957 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:24.957 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:40:24.957 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:24.957 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:24.957 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:24.957 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27979 2024-09-13T06:40:24.957 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.957 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:24.957 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.958 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:24.958 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660429+0000", 2024-09-13T06:40:24.958 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:24.958 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.958 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.958 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:24.958 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660429+0000", 2024-09-13T06:40:24.958 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:24.958 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.958 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.958 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:24.958 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660428+0000", 2024-09-13T06:40:24.958 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999986 2024-09-13T06:40:24.958 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.959 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.959 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:24.959 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660434+0000", 2024-09-13T06:40:24.959 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.8190000000000003e-06 2024-09-13T06:40:24.959 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.959 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.959 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:24.959 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660451+0000", 2024-09-13T06:40:24.959 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6963e-05 2024-09-13T06:40:24.959 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.959 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.959 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:24.959 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660485+0000", 2024-09-13T06:40:24.959 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.3414000000000002e-05 2024-09-13T06:40:24.960 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.960 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.960 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:24.960 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700342+0000", 2024-09-13T06:40:24.960 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039857278000000003 2024-09-13T06:40:24.960 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.960 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.960 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:24.960 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700350+0000", 2024-09-13T06:40:24.960 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.2930000000000001e-06 2024-09-13T06:40:24.960 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:24.960 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:24.960 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:24.961 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.961 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.961 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27980 3.a 3.9aacdeca (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:24.961 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.660497+0000", 2024-09-13T06:40:24.961 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 28.244946308999999, 2024-09-13T06:40:24.961 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039888034000000003, 2024-09-13T06:40:24.961 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:24.961 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:40:24.961 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:24.961 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:24.961 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:24.961 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27980 2024-09-13T06:40:24.961 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.961 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:24.962 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.962 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:24.962 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660497+0000", 2024-09-13T06:40:24.962 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:24.962 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.962 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.962 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:24.962 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660497+0000", 2024-09-13T06:40:24.962 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:24.962 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.962 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.962 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:24.962 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660496+0000", 2024-09-13T06:40:24.963 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:24.963 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.963 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.963 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:24.963 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660503+0000", 2024-09-13T06:40:24.963 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.4110000000000001e-06 2024-09-13T06:40:24.963 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.963 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.963 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:24.963 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660519+0000", 2024-09-13T06:40:24.963 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6180000000000001e-05 2024-09-13T06:40:24.963 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.963 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.964 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:24.964 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660544+0000", 2024-09-13T06:40:24.964 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.5177999999999998e-05 2024-09-13T06:40:24.964 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.964 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.964 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:24.964 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700377+0000", 2024-09-13T06:40:24.964 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039833434000000001 2024-09-13T06:40:24.964 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.964 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.964 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:24.964 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700385+0000", 2024-09-13T06:40:24.964 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.8800000000000008e-06 2024-09-13T06:40:24.965 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:24.965 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:24.965 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:24.965 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.965 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.965 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27981 3.a 3.9aacdeca (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:24.965 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.660556+0000", 2024-09-13T06:40:24.965 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 28.244887963, 2024-09-13T06:40:24.965 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039869989000000002, 2024-09-13T06:40:24.965 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:24.965 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:40:24.965 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:24.965 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:24.966 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:24.966 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27981 2024-09-13T06:40:24.966 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.966 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:24.966 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.966 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:24.966 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660556+0000", 2024-09-13T06:40:24.966 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:24.966 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.966 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.966 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:24.966 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660556+0000", 2024-09-13T06:40:24.966 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:24.967 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.967 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.967 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:24.967 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660555+0000", 2024-09-13T06:40:24.967 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:24.967 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.967 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.967 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:24.967 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660561+0000", 2024-09-13T06:40:24.967 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.088e-06 2024-09-13T06:40:24.967 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.967 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.967 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:24.967 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660577+0000", 2024-09-13T06:40:24.968 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6147999999999999e-05 2024-09-13T06:40:24.968 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.968 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.968 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:24.968 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660589+0000", 2024-09-13T06:40:24.968 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2551999999999999e-05 2024-09-13T06:40:24.968 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.968 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.968 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:24.968 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700414+0000", 2024-09-13T06:40:24.968 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039825007000000003 2024-09-13T06:40:24.968 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.968 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.969 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:24.969 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700426+0000", 2024-09-13T06:40:24.969 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1265e-05 2024-09-13T06:40:24.969 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:24.969 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:24.969 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:24.969 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.969 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.969 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27982 3.a 3.9aacdeca (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:24.969 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.660603+0000", 2024-09-13T06:40:24.969 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 28.244840367999998, 2024-09-13T06:40:24.969 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039874779999999999, 2024-09-13T06:40:24.969 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:24.970 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:40:24.970 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:24.970 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:24.970 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:24.970 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27982 2024-09-13T06:40:24.970 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.970 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:24.970 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.970 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:24.970 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660603+0000", 2024-09-13T06:40:24.970 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:24.970 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.970 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.971 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:24.971 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660603+0000", 2024-09-13T06:40:24.971 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:24.971 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.971 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.971 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:24.971 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660602+0000", 2024-09-13T06:40:24.971 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:24.971 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.971 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.971 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:24.971 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660653+0000", 2024-09-13T06:40:24.971 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.0862000000000002e-05 2024-09-13T06:40:24.972 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.972 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.972 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:24.972 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660697+0000", 2024-09-13T06:40:24.972 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.3773000000000003e-05 2024-09-13T06:40:24.972 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.972 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.972 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:24.972 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660712+0000", 2024-09-13T06:40:24.972 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5464999999999998e-05 2024-09-13T06:40:24.972 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.972 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.972 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:24.973 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700469+0000", 2024-09-13T06:40:24.973 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039756503999999998 2024-09-13T06:40:24.973 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.973 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.973 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:24.973 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700478+0000", 2024-09-13T06:40:24.973 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.1730000000000001e-06 2024-09-13T06:40:24.973 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:24.973 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:24.973 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:24.973 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.973 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.973 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27983 3.a 3.9aacdeca (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:24.973 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.660726+0000", 2024-09-13T06:40:24.974 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 28.244717092999998, 2024-09-13T06:40:24.974 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039804357999999998, 2024-09-13T06:40:24.974 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:24.974 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:40:24.974 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:24.974 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:24.974 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:24.974 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27983 2024-09-13T06:40:24.974 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.974 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:24.974 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.974 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:24.974 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660726+0000", 2024-09-13T06:40:24.975 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:24.975 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.975 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.975 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:24.975 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660726+0000", 2024-09-13T06:40:24.975 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:24.975 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.975 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.975 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:24.975 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660725+0000", 2024-09-13T06:40:24.975 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999986 2024-09-13T06:40:24.975 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.975 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.975 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:24.976 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660733+0000", 2024-09-13T06:40:24.976 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.9359999999999999e-06 2024-09-13T06:40:24.976 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.976 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.976 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:24.976 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660751+0000", 2024-09-13T06:40:24.976 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7679000000000001e-05 2024-09-13T06:40:24.976 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.976 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.976 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:24.976 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660764+0000", 2024-09-13T06:40:24.976 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3112000000000001e-05 2024-09-13T06:40:24.976 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.977 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.977 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:24.977 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700516+0000", 2024-09-13T06:40:24.977 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039752183000000003 2024-09-13T06:40:24.977 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.977 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.977 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:24.977 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700531+0000", 2024-09-13T06:40:24.977 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.4732999999999999e-05 2024-09-13T06:40:24.977 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:24.977 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:24.977 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:24.977 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.977 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.978 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27984 3.a 3.9aacdeca (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:24.978 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.660776+0000", 2024-09-13T06:40:24.978 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 28.24466799, 2024-09-13T06:40:24.978 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039795697999999997, 2024-09-13T06:40:24.978 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:24.978 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:40:24.978 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:24.978 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:24.978 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:24.978 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27984 2024-09-13T06:40:24.978 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.978 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:24.978 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.978 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:24.979 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660776+0000", 2024-09-13T06:40:24.979 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:24.979 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.979 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.979 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:24.979 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660776+0000", 2024-09-13T06:40:24.979 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:24.979 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.979 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.979 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:24.979 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660775+0000", 2024-09-13T06:40:24.979 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:24.979 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.979 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.980 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:24.980 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660780+0000", 2024-09-13T06:40:24.980 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.7849999999999997e-06 2024-09-13T06:40:24.980 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.980 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.980 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:24.980 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660799+0000", 2024-09-13T06:40:24.980 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.8794e-05 2024-09-13T06:40:24.980 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.980 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.980 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:24.980 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660812+0000", 2024-09-13T06:40:24.980 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3029e-05 2024-09-13T06:40:24.980 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.981 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.981 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:24.981 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700562+0000", 2024-09-13T06:40:24.981 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039749984000000002 2024-09-13T06:40:24.981 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.981 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.981 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:24.981 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700571+0000", 2024-09-13T06:40:24.981 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.1260000000000004e-06 2024-09-13T06:40:24.981 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:24.981 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:24.981 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:24.981 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.982 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.982 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27985 3.a 3.9aacdeca (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:24.982 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.660824+0000", 2024-09-13T06:40:24.982 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 28.244619938, 2024-09-13T06:40:24.982 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039784462, 2024-09-13T06:40:24.982 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:24.982 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:40:24.982 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:24.982 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:24.982 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:24.982 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27985 2024-09-13T06:40:24.982 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.982 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:24.982 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.983 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:24.983 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660824+0000", 2024-09-13T06:40:24.983 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:24.983 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.983 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.983 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:24.983 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660824+0000", 2024-09-13T06:40:24.983 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:24.983 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.983 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.983 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:24.983 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660823+0000", 2024-09-13T06:40:24.983 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:24.983 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.984 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.984 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:24.984 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660829+0000", 2024-09-13T06:40:24.984 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.9440000000000002e-06 2024-09-13T06:40:24.984 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.984 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.984 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:24.984 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660922+0000", 2024-09-13T06:40:24.984 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.2958e-05 2024-09-13T06:40:24.984 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.984 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.984 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:24.984 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660964+0000", 2024-09-13T06:40:24.984 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.2407000000000002e-05 2024-09-13T06:40:24.985 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.985 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.985 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:24.985 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700600+0000", 2024-09-13T06:40:24.985 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039635581000000003 2024-09-13T06:40:24.985 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.985 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.985 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:24.985 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700608+0000", 2024-09-13T06:40:24.985 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.5890000000000003e-06 2024-09-13T06:40:24.985 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:24.985 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:24.985 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:24.986 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.986 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.986 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:28023 3.10 3:0dedc28a:::rbd_data.1121f2c5ee81.0000000000000019:13 [read 475136~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:24.986 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.662072+0000", 2024-09-13T06:40:24.986 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 28.243371953, 2024-09-13T06:40:24.986 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.038086508999999998, 2024-09-13T06:40:24.986 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:24.986 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:24.986 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:24.986 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:24.986 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:24.986 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 28023 2024-09-13T06:40:24.986 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.986 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:24.987 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.987 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:24.987 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.662072+0000", 2024-09-13T06:40:24.987 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:24.987 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.987 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.987 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:24.987 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.662072+0000", 2024-09-13T06:40:24.987 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:24.987 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.987 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.987 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:24.987 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.662070+0000", 2024-09-13T06:40:24.987 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999986 2024-09-13T06:40:24.988 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.988 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.988 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:24.988 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.662076+0000", 2024-09-13T06:40:24.988 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.139e-06 2024-09-13T06:40:24.988 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.988 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.988 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:24.988 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.662094+0000", 2024-09-13T06:40:24.988 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7136999999999999e-05 2024-09-13T06:40:24.988 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.988 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.988 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:24.988 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.662124+0000", 2024-09-13T06:40:24.989 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.0528999999999999e-05 2024-09-13T06:40:24.989 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.989 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.989 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:24.989 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.699843+0000", 2024-09-13T06:40:24.989 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.037718415999999998 2024-09-13T06:40:24.989 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.989 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.989 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:24.989 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.699931+0000", 2024-09-13T06:40:24.989 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.8345999999999997e-05 2024-09-13T06:40:24.989 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.989 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.990 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:24.990 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700158+0000", 2024-09-13T06:40:24.990 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00022723099999999999 2024-09-13T06:40:24.990 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:24.990 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:24.990 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:24.990 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.990 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.990 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:28024 3.10 3.5143b7b0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:24.990 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.662137+0000", 2024-09-13T06:40:24.990 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 28.243306431000001, 2024-09-13T06:40:24.990 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.038056092999999999, 2024-09-13T06:40:24.990 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:24.990 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:40:24.991 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:24.991 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:24.991 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:24.991 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 28024 2024-09-13T06:40:24.991 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.991 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:24.991 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.991 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:24.991 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.662137+0000", 2024-09-13T06:40:24.991 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:24.991 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.991 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.991 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:24.991 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.662137+0000", 2024-09-13T06:40:24.992 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:24.992 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.992 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.992 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:24.992 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.662136+0000", 2024-09-13T06:40:24.992 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999986 2024-09-13T06:40:24.992 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.992 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.992 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:24.992 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.662142+0000", 2024-09-13T06:40:24.992 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.6930000000000001e-06 2024-09-13T06:40:24.992 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.992 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.993 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:24.993 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.662160+0000", 2024-09-13T06:40:24.993 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7863000000000002e-05 2024-09-13T06:40:24.993 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.993 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.993 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:24.993 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.662189+0000", 2024-09-13T06:40:24.993 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.8486000000000001e-05 2024-09-13T06:40:24.993 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.993 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.993 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:24.993 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700187+0000", 2024-09-13T06:40:24.993 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.037998331000000003 2024-09-13T06:40:24.994 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:24.994 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:24.994 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:24.994 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700193+0000", 2024-09-13T06:40:24.994 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.0909999999999998e-06 2024-09-13T06:40:24.994 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:24.994 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:24.994 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:24.994 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:24.994 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:24.994 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:40:24.996 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-13T06:40:24.996 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:40:24.992+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:40:25.097 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:40:25.100+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:40:25.163 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:40:25.163 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [], 2024-09-13T06:40:25.163 INFO:teuthology.orchestra.run.smithi139.stdout: "num_ops": 0 2024-09-13T06:40:25.164 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:40:25.177 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-13T06:40:25.222 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:40:25.222+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:40:25.300 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:40:25.300+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:40:25.301 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:40:25.301 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [], 2024-09-13T06:40:25.301 INFO:teuthology.orchestra.run.smithi139.stdout: "complaint_time": 30, 2024-09-13T06:40:25.301 INFO:teuthology.orchestra.run.smithi139.stdout: "num_blocked_ops": 0 2024-09-13T06:40:25.301 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:40:25.315 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-13T06:40:25.401 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:40:25.400+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:40:25.491 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:40:25.492 INFO:teuthology.orchestra.run.smithi139.stdout: "size": 20, 2024-09-13T06:40:25.492 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 600, 2024-09-13T06:40:25.492 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [ 2024-09-13T06:40:25.492 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:25.492 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4154.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-13T06:40:25.492 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:11.143816+0000", 2024-09-13T06:40:25.492 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 74.346763018999994, 2024-09-13T06:40:25.492 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.062483034, 2024-09-13T06:40:25.492 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:25.492 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:40:25.492 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:25.493 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4154", 2024-09-13T06:40:25.493 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/2406930292", 2024-09-13T06:40:25.493 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 1 2024-09-13T06:40:25.493 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:25.493 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:25.493 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:25.493 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:25.493 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.143816+0000", 2024-09-13T06:40:25.493 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:25.493 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:25.493 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:25.493 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:25.494 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.143816+0000", 2024-09-13T06:40:25.494 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:25.494 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:25.494 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:25.494 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:25.494 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.143814+0000", 2024-09-13T06:40:25.494 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999976 2024-09-13T06:40:25.494 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:25.494 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:25.494 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:25.494 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.143829+0000", 2024-09-13T06:40:25.495 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5316999999999999e-05 2024-09-13T06:40:25.495 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:25.495 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:25.495 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:25.495 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.143851+0000", 2024-09-13T06:40:25.495 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.1736999999999999e-05 2024-09-13T06:40:25.495 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:25.495 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:25.495 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:25.495 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.143870+0000", 2024-09-13T06:40:25.495 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.9185999999999999e-05 2024-09-13T06:40:25.495 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:25.496 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:25.496 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:25.496 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.143973+0000", 2024-09-13T06:40:25.496 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000102896 2024-09-13T06:40:25.496 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:25.496 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:25.496 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:40:25.496 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.143987+0000", 2024-09-13T06:40:25.496 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.401e-05 2024-09-13T06:40:25.496 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:25.496 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:25.497 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:25.497 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.203333+0000", 2024-09-13T06:40:25.497 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.059346614999999998 2024-09-13T06:40:25.497 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:25.497 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:25.497 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:25.497 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.203624+0000", 2024-09-13T06:40:25.497 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00029112700000000002 2024-09-13T06:40:25.497 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:25.497 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:25.497 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 0", 2024-09-13T06:40:25.497 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.203940+0000", 2024-09-13T06:40:25.498 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00031547200000000002 2024-09-13T06:40:25.498 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:25.498 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:25.498 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-13T06:40:25.498 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.205145+0000", 2024-09-13T06:40:25.498 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0012048930000000001 2024-09-13T06:40:25.498 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:25.498 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:25.498 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:40:25.498 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.206110+0000", 2024-09-13T06:40:25.498 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00096536600000000005 2024-09-13T06:40:25.498 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:25.499 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:25.499 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-13T06:40:25.499 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.206196+0000", 2024-09-13T06:40:25.499 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.5798999999999996e-05 2024-09-13T06:40:25.499 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:25.499 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:25.499 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:25.499 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.206299+0000", 2024-09-13T06:40:25.499 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00010279 2024-09-13T06:40:25.499 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:25.499 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:25.500 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:25.500 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:25.500 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:25.500 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4154.0:36 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-13T06:40:25.500 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:11.257357+0000", 2024-09-13T06:40:25.500 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 74.233221576000005, 2024-09-13T06:40:25.500 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.012807595, 2024-09-13T06:40:25.500 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:25.500 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:40:25.500 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:25.500 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4154", 2024-09-13T06:40:25.500 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/2406930292", 2024-09-13T06:40:25.501 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 36 2024-09-13T06:40:25.501 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:25.501 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:25.501 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:25.501 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:25.501 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.257357+0000", 2024-09-13T06:40:25.501 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:25.501 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:25.501 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:25.501 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:25.501 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.257357+0000", 2024-09-13T06:40:25.501 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:25.502 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:25.502 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:25.502 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:25.502 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.257356+0000", 2024-09-13T06:40:25.502 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:25.502 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:25.502 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:25.502 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:25.502 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.257378+0000", 2024-09-13T06:40:25.502 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.1988999999999999e-05 2024-09-13T06:40:25.502 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:25.502 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:25.503 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:25.503 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.257389+0000", 2024-09-13T06:40:25.503 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0343000000000001e-05 2024-09-13T06:40:25.503 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:25.503 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:25.503 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:25.503 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.257396+0000", 2024-09-13T06:40:25.503 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5839999999999997e-06 2024-09-13T06:40:25.503 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:25.503 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:25.503 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:25.503 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.264748+0000", 2024-09-13T06:40:25.504 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0073514640000000003 2024-09-13T06:40:25.504 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:25.504 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:25.504 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:25.504 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.264878+0000", 2024-09-13T06:40:25.504 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00012975500000000001 2024-09-13T06:40:25.504 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:25.504 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:25.504 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 0", 2024-09-13T06:40:25.504 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.265064+0000", 2024-09-13T06:40:25.504 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000186799 2024-09-13T06:40:25.505 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:25.505 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:25.505 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:40:25.505 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.267248+0000", 2024-09-13T06:40:25.505 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0021841230000000001 2024-09-13T06:40:25.505 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:25.505 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:25.505 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-13T06:40:25.505 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.269996+0000", 2024-09-13T06:40:25.505 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0027473419999999998 2024-09-13T06:40:25.505 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:25.506 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:25.506 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-13T06:40:25.506 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.270066+0000", 2024-09-13T06:40:25.506 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.0683000000000001e-05 2024-09-13T06:40:25.506 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:25.506 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:25.506 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:25.506 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.270165+0000", 2024-09-13T06:40:25.506 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.8319000000000005e-05 2024-09-13T06:40:25.506 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:25.506 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:25.507 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:25.507 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:25.507 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:25.507 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4154.0:37 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-13T06:40:25.507 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:11.257405+0000", 2024-09-13T06:40:25.507 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 74.233173395999998, 2024-09-13T06:40:25.507 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.012930476999999999, 2024-09-13T06:40:25.507 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:25.507 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:40:25.507 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:25.507 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4154", 2024-09-13T06:40:25.508 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/2406930292", 2024-09-13T06:40:25.508 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 37 2024-09-13T06:40:25.508 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:25.508 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:25.508 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:25.508 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:25.508 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.257405+0000", 2024-09-13T06:40:25.508 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:25.508 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:25.508 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:25.508 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:25.509 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.257405+0000", 2024-09-13T06:40:25.509 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:25.509 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:25.509 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:25.509 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:25.509 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.257405+0000", 2024-09-13T06:40:25.509 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:25.509 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:25.509 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:25.509 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:25.509 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.257411+0000", 2024-09-13T06:40:25.510 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.1500000000000004e-06 2024-09-13T06:40:25.510 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:25.510 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:25.510 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:25.510 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.257420+0000", 2024-09-13T06:40:25.510 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.986e-06 2024-09-13T06:40:25.510 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:25.510 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:25.510 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:25.510 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.257436+0000", 2024-09-13T06:40:25.510 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6433999999999999e-05 2024-09-13T06:40:25.511 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:25.511 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:25.511 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:25.511 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.265923+0000", 2024-09-13T06:40:25.511 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0084872009999999998 2024-09-13T06:40:25.511 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:25.511 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:25.511 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:25.511 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.266056+0000", 2024-09-13T06:40:25.511 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00013206599999999999 2024-09-13T06:40:25.511 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:25.512 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:25.512 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 0", 2024-09-13T06:40:25.512 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.266255+0000", 2024-09-13T06:40:25.512 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00019935100000000001 2024-09-13T06:40:25.512 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:25.512 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:25.512 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:40:25.512 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.267788+0000", 2024-09-13T06:40:25.512 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0015335380000000001 2024-09-13T06:40:25.512 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:25.513 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:25.513 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-13T06:40:25.513 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.270181+0000", 2024-09-13T06:40:25.513 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.002392136 2024-09-13T06:40:25.513 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:25.513 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:25.513 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-13T06:40:25.513 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.270245+0000", 2024-09-13T06:40:25.513 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.4401999999999998e-05 2024-09-13T06:40:25.513 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:25.514 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:25.514 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:25.514 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.270336+0000", 2024-09-13T06:40:25.514 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.0872999999999995e-05 2024-09-13T06:40:25.514 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:25.514 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:25.514 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:25.514 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:25.514 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:25.514 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4154.0:88 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-13T06:40:25.514 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:11.362174+0000", 2024-09-13T06:40:25.515 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 74.128404787999997, 2024-09-13T06:40:25.515 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.012171276, 2024-09-13T06:40:25.515 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:25.515 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:40:25.515 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:25.515 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4154", 2024-09-13T06:40:25.515 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/2406930292", 2024-09-13T06:40:25.515 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 88 2024-09-13T06:40:25.515 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:25.515 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:25.515 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:25.515 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:25.516 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.362174+0000", 2024-09-13T06:40:25.516 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:25.516 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:25.516 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:25.516 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:25.516 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.362174+0000", 2024-09-13T06:40:25.516 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:25.516 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:25.516 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:25.516 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:25.516 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.362172+0000", 2024-09-13T06:40:25.517 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999986 2024-09-13T06:40:25.517 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:25.517 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:25.517 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:25.517 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.362183+0000", 2024-09-13T06:40:25.517 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.081e-05 2024-09-13T06:40:25.517 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:25.517 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:25.517 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:25.517 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.362205+0000", 2024-09-13T06:40:25.517 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.1897000000000001e-05 2024-09-13T06:40:25.518 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:25.518 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:25.518 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:25.518 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.362221+0000", 2024-09-13T06:40:25.518 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5353e-05 2024-09-13T06:40:25.518 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:25.518 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:25.518 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:25.518 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.369202+0000", 2024-09-13T06:40:25.518 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0069816219999999998 2024-09-13T06:40:25.518 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:25.519 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:25.519 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:25.519 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.369323+0000", 2024-09-13T06:40:25.519 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000121156 2024-09-13T06:40:25.519 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:25.519 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:25.519 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 0", 2024-09-13T06:40:25.519 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.369683+0000", 2024-09-13T06:40:25.519 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00035930700000000001 2024-09-13T06:40:25.519 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:25.519 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:25.519 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:40:25.520 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.371448+0000", 2024-09-13T06:40:25.520 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.001765043 2024-09-13T06:40:25.520 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:25.520 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:25.520 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-13T06:40:25.520 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.374156+0000", 2024-09-13T06:40:25.520 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.002707999 2024-09-13T06:40:25.520 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:25.520 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:25.520 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-13T06:40:25.520 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.374243+0000", 2024-09-13T06:40:25.520 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6873000000000007e-05 2024-09-13T06:40:25.521 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:25.521 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:25.521 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:25.521 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.374345+0000", 2024-09-13T06:40:25.521 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00010272600000000001 2024-09-13T06:40:25.521 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:25.521 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:25.521 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:25.522 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:25.522 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:25.522 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4154.0:108 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-13T06:40:25.522 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:11.524074+0000", 2024-09-13T06:40:25.522 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 73.966504783999994, 2024-09-13T06:40:25.522 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.012736235, 2024-09-13T06:40:25.522 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:25.522 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:40:25.522 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:25.522 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4154", 2024-09-13T06:40:25.522 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/2406930292", 2024-09-13T06:40:25.523 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 108 2024-09-13T06:40:25.523 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:25.523 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:25.523 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:25.523 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:25.523 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.524074+0000", 2024-09-13T06:40:25.523 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:25.523 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:25.523 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:25.523 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:25.523 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.524074+0000", 2024-09-13T06:40:25.523 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:25.524 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:25.524 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:25.524 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:25.524 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.524073+0000", 2024-09-13T06:40:25.524 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:25.524 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:25.524 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:25.524 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:25.524 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.524084+0000", 2024-09-13T06:40:25.524 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1026000000000001e-05 2024-09-13T06:40:25.524 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:25.524 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:25.525 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:25.525 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.524102+0000", 2024-09-13T06:40:25.525 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7992999999999999e-05 2024-09-13T06:40:25.525 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:25.525 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:25.525 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:25.525 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.524140+0000", 2024-09-13T06:40:25.525 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.8277e-05 2024-09-13T06:40:25.525 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:25.525 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:25.525 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:25.526 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.528884+0000", 2024-09-13T06:40:25.526 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.004743761 2024-09-13T06:40:25.526 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:25.526 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:25.526 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:25.526 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.529006+0000", 2024-09-13T06:40:25.526 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000121829 2024-09-13T06:40:25.526 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:25.526 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:25.526 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 0", 2024-09-13T06:40:25.526 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.529196+0000", 2024-09-13T06:40:25.526 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000189731 2024-09-13T06:40:25.527 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:25.527 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:25.527 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:40:25.527 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.535697+0000", 2024-09-13T06:40:25.527 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0065011499999999998 2024-09-13T06:40:25.527 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:25.527 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:25.527 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-13T06:40:25.527 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.536644+0000", 2024-09-13T06:40:25.527 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00094732900000000001 2024-09-13T06:40:25.527 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:25.527 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:25.528 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-13T06:40:25.528 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.536712+0000", 2024-09-13T06:40:25.528 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.8303e-05 2024-09-13T06:40:25.528 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:25.528 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:25.528 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:25.528 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.536810+0000", 2024-09-13T06:40:25.528 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.7918999999999995e-05 2024-09-13T06:40:25.528 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:25.528 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:25.528 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:25.529 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:25.529 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:25.529 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4154.0:109 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-13T06:40:25.529 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:11.524169+0000", 2024-09-13T06:40:25.529 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 73.966409858000006, 2024-09-13T06:40:25.529 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.013995285999999999, 2024-09-13T06:40:25.529 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:25.529 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:40:25.529 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:25.529 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4154", 2024-09-13T06:40:25.529 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/2406930292", 2024-09-13T06:40:25.530 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 109 2024-09-13T06:40:25.530 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:25.530 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:25.530 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:25.530 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:25.530 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.524169+0000", 2024-09-13T06:40:25.530 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:25.530 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:25.530 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:25.530 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:25.530 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.524169+0000", 2024-09-13T06:40:25.530 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:25.531 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:25.531 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:25.531 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:25.531 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.524168+0000", 2024-09-13T06:40:25.531 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:25.531 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:25.531 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:25.531 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:25.531 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.524427+0000", 2024-09-13T06:40:25.531 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00025929799999999998 2024-09-13T06:40:25.531 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:25.532 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:25.532 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:25.532 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.524451+0000", 2024-09-13T06:40:25.532 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.3686e-05 2024-09-13T06:40:25.532 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:25.532 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:25.532 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:25.532 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.524468+0000", 2024-09-13T06:40:25.532 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7577000000000001e-05 2024-09-13T06:40:25.532 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:25.532 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:25.533 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:25.533 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.530416+0000", 2024-09-13T06:40:25.533 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0059474080000000004 2024-09-13T06:40:25.533 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:25.533 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:25.533 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:25.533 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.530553+0000", 2024-09-13T06:40:25.533 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000137742 2024-09-13T06:40:25.533 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:25.533 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:25.533 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 0", 2024-09-13T06:40:25.534 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.530749+0000", 2024-09-13T06:40:25.534 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000195608 2024-09-13T06:40:25.534 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:25.534 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:25.534 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-13T06:40:25.534 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.536836+0000", 2024-09-13T06:40:25.534 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.006086546 2024-09-13T06:40:25.534 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:25.534 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:25.534 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:40:25.534 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.538038+0000", 2024-09-13T06:40:25.534 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0012019509999999999 2024-09-13T06:40:25.535 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:25.535 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:25.535 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-13T06:40:25.535 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.538106+0000", 2024-09-13T06:40:25.535 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.8923000000000004e-05 2024-09-13T06:40:25.535 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:25.535 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:25.535 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:25.535 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.538164+0000", 2024-09-13T06:40:25.535 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.7729999999999998e-05 2024-09-13T06:40:25.535 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:25.535 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:25.536 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:25.536 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:25.536 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:25.536 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4154.0:110 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-13T06:40:25.536 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:11.524488+0000", 2024-09-13T06:40:25.536 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 73.966090381000001, 2024-09-13T06:40:25.536 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.013976323000000001, 2024-09-13T06:40:25.536 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:25.536 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:40:25.536 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:25.536 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4154", 2024-09-13T06:40:25.537 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/2406930292", 2024-09-13T06:40:25.537 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 110 2024-09-13T06:40:25.537 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:25.537 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:25.537 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:25.537 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:25.537 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.524488+0000", 2024-09-13T06:40:25.537 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:25.537 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:25.537 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:25.537 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:25.538 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.524488+0000", 2024-09-13T06:40:25.538 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:25.538 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:25.538 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:25.538 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:25.539 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.524487+0000", 2024-09-13T06:40:25.539 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999986 2024-09-13T06:40:25.539 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:25.539 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:25.540 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:25.540 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.524498+0000", 2024-09-13T06:40:25.540 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1579999999999999e-05 2024-09-13T06:40:25.540 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:25.540 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:25.541 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:25.541 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.524516+0000", 2024-09-13T06:40:25.541 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7776000000000001e-05 2024-09-13T06:40:25.541 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:25.541 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:25.541 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:25.541 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.524530+0000", 2024-09-13T06:40:25.541 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3896999999999999e-05 2024-09-13T06:40:25.542 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:25.542 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:25.542 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:25.542 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.532254+0000", 2024-09-13T06:40:25.542 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0077239409999999998 2024-09-13T06:40:25.542 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:25.542 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:25.542 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:25.542 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.532371+0000", 2024-09-13T06:40:25.542 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000117176 2024-09-13T06:40:25.542 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:25.543 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:25.543 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 0", 2024-09-13T06:40:25.543 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.532551+0000", 2024-09-13T06:40:25.543 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00018004100000000001 2024-09-13T06:40:25.543 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:25.543 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:25.543 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:40:25.543 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.538280+0000", 2024-09-13T06:40:25.543 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0057289230000000003 2024-09-13T06:40:25.543 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:25.543 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:25.543 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-13T06:40:25.544 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.538294+0000", 2024-09-13T06:40:25.544 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.4070000000000001e-05 2024-09-13T06:40:25.544 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:25.544 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:25.544 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-13T06:40:25.544 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.538368+0000", 2024-09-13T06:40:25.544 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.3604999999999997e-05 2024-09-13T06:40:25.544 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:25.544 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:25.544 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:25.544 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.538465+0000", 2024-09-13T06:40:25.545 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6830000000000006e-05 2024-09-13T06:40:25.545 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:25.545 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:25.545 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:25.545 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:25.545 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:25.545 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4154.0:111 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-13T06:40:25.545 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:11.524546+0000", 2024-09-13T06:40:25.545 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 73.966032947000002, 2024-09-13T06:40:25.545 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.016412307000000001, 2024-09-13T06:40:25.546 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:25.546 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:40:25.546 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:25.546 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4154", 2024-09-13T06:40:25.546 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/2406930292", 2024-09-13T06:40:25.546 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 111 2024-09-13T06:40:25.546 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:25.546 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:25.546 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:25.546 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:25.546 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.524546+0000", 2024-09-13T06:40:25.546 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:25.547 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:25.547 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:25.547 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:25.547 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.524546+0000", 2024-09-13T06:40:25.547 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:25.547 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:25.547 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:25.547 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:25.547 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.524545+0000", 2024-09-13T06:40:25.547 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:25.548 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:25.548 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:25.548 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:25.548 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.524555+0000", 2024-09-13T06:40:25.548 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0176e-05 2024-09-13T06:40:25.548 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:25.548 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:25.548 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:25.548 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.524577+0000", 2024-09-13T06:40:25.549 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.1756999999999999e-05 2024-09-13T06:40:25.549 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:25.549 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:25.549 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:25.549 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.524592+0000", 2024-09-13T06:40:25.549 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5345999999999998e-05 2024-09-13T06:40:25.549 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:25.549 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:25.549 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:25.549 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.533407+0000", 2024-09-13T06:40:25.550 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0088150559999999999 2024-09-13T06:40:25.550 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:25.550 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:25.550 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:25.550 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.533523+0000", 2024-09-13T06:40:25.550 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000116099 2024-09-13T06:40:25.550 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:25.550 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:25.550 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 0", 2024-09-13T06:40:25.551 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.533734+0000", 2024-09-13T06:40:25.551 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000211005 2024-09-13T06:40:25.551 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:25.551 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:25.551 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-13T06:40:25.551 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.538484+0000", 2024-09-13T06:40:25.551 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0047494900000000003 2024-09-13T06:40:25.551 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:25.551 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:25.551 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:40:25.551 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.540823+0000", 2024-09-13T06:40:25.552 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0023390889999999999 2024-09-13T06:40:25.552 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:25.552 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:25.552 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-13T06:40:25.552 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.540898+0000", 2024-09-13T06:40:25.552 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5449000000000002e-05 2024-09-13T06:40:25.552 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:25.552 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:25.552 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:25.552 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.540958+0000", 2024-09-13T06:40:25.552 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.9889999999999997e-05 2024-09-13T06:40:25.552 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:25.553 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:25.553 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:25.553 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:25.553 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:25.553 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4154.0:112 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-13T06:40:25.553 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:11.524610+0000", 2024-09-13T06:40:25.553 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 73.965969228000006, 2024-09-13T06:40:25.553 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.016538458999999998, 2024-09-13T06:40:25.553 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:25.553 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:40:25.553 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:25.554 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4154", 2024-09-13T06:40:25.554 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/2406930292", 2024-09-13T06:40:25.554 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 112 2024-09-13T06:40:25.554 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:25.554 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:25.554 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:25.554 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:25.554 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.524610+0000", 2024-09-13T06:40:25.554 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:25.554 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:25.554 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:25.554 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:25.555 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.524610+0000", 2024-09-13T06:40:25.555 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:25.555 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:25.555 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:25.555 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:25.555 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.524608+0000", 2024-09-13T06:40:25.555 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:25.555 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:25.555 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:25.555 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:25.555 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.524826+0000", 2024-09-13T06:40:25.555 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000217226 2024-09-13T06:40:25.556 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:25.556 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:25.556 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:25.556 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.524848+0000", 2024-09-13T06:40:25.556 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.2802999999999998e-05 2024-09-13T06:40:25.556 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:25.556 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:25.556 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:25.556 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.524906+0000", 2024-09-13T06:40:25.556 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.7878999999999999e-05 2024-09-13T06:40:25.556 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:25.556 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:25.556 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:25.557 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.534402+0000", 2024-09-13T06:40:25.557 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0094956769999999992 2024-09-13T06:40:25.557 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:25.557 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:25.557 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:25.557 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.534512+0000", 2024-09-13T06:40:25.557 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000110493 2024-09-13T06:40:25.557 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:25.557 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:25.557 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 0", 2024-09-13T06:40:25.557 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.534688+0000", 2024-09-13T06:40:25.557 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00017564499999999999 2024-09-13T06:40:25.558 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:25.558 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:25.558 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-13T06:40:25.558 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.538493+0000", 2024-09-13T06:40:25.558 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0038051399999999998 2024-09-13T06:40:25.558 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:25.558 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:25.558 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:40:25.558 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.541030+0000", 2024-09-13T06:40:25.558 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0025368080000000002 2024-09-13T06:40:25.558 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:25.558 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:25.559 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-13T06:40:25.559 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.541097+0000", 2024-09-13T06:40:25.559 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.6933000000000004e-05 2024-09-13T06:40:25.559 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:25.559 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:25.559 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:25.559 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.541148+0000", 2024-09-13T06:40:25.559 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.1008999999999999e-05 2024-09-13T06:40:25.559 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:25.559 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:25.559 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:25.559 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:25.559 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:25.560 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4154.0:113 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-13T06:40:25.560 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:11.524940+0000", 2024-09-13T06:40:25.560 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 73.965638264000006, 2024-09-13T06:40:25.560 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.017201570999999999, 2024-09-13T06:40:25.560 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:25.560 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:40:25.560 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:25.560 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4154", 2024-09-13T06:40:25.560 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/2406930292", 2024-09-13T06:40:25.560 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 113 2024-09-13T06:40:25.560 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:25.561 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:25.561 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:25.561 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:25.561 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.524940+0000", 2024-09-13T06:40:25.561 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:25.561 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:25.561 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:25.561 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:25.561 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.524940+0000", 2024-09-13T06:40:25.561 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:25.561 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:25.561 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:25.562 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:25.562 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.524938+0000", 2024-09-13T06:40:25.562 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999981 2024-09-13T06:40:25.562 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:25.562 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:25.562 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:25.562 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.524951+0000", 2024-09-13T06:40:25.562 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2993000000000001e-05 2024-09-13T06:40:25.562 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:25.562 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:25.562 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:25.562 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.524976+0000", 2024-09-13T06:40:25.563 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.4216999999999999e-05 2024-09-13T06:40:25.563 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:25.563 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:25.563 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:25.563 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.525000+0000", 2024-09-13T06:40:25.563 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.3986e-05 2024-09-13T06:40:25.563 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:25.563 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:25.563 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:25.563 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.535786+0000", 2024-09-13T06:40:25.563 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.010786733999999999 2024-09-13T06:40:25.563 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:25.564 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:25.564 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:25.564 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.535916+0000", 2024-09-13T06:40:25.564 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000129865 2024-09-13T06:40:25.564 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:25.564 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:25.564 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 0", 2024-09-13T06:40:25.564 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.536106+0000", 2024-09-13T06:40:25.564 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000190046 2024-09-13T06:40:25.564 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:25.564 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:25.565 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-13T06:40:25.565 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.540977+0000", 2024-09-13T06:40:25.565 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0048708730000000004 2024-09-13T06:40:25.565 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:25.565 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:25.565 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:40:25.565 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.542023+0000", 2024-09-13T06:40:25.565 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0010456179999999999 2024-09-13T06:40:25.565 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:25.565 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:25.565 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-13T06:40:25.566 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.542091+0000", 2024-09-13T06:40:25.566 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.7840000000000001e-05 2024-09-13T06:40:25.566 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:25.566 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:25.566 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:25.566 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.542142+0000", 2024-09-13T06:40:25.566 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.1399e-05 2024-09-13T06:40:25.566 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:25.566 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:25.566 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:25.566 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:25.566 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:25.567 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4154.0:114 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-13T06:40:25.567 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:11.525025+0000", 2024-09-13T06:40:25.567 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 73.965553385000007, 2024-09-13T06:40:25.567 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.017310847000000001, 2024-09-13T06:40:25.567 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:25.567 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:40:25.567 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:25.567 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4154", 2024-09-13T06:40:25.567 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/2406930292", 2024-09-13T06:40:25.567 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 114 2024-09-13T06:40:25.567 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:25.567 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:25.568 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:25.568 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:25.568 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.525025+0000", 2024-09-13T06:40:25.568 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:25.568 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:25.568 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:25.568 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:25.568 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.525025+0000", 2024-09-13T06:40:25.568 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:25.568 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:25.568 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:25.569 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:25.569 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.525024+0000", 2024-09-13T06:40:25.569 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999986 2024-09-13T06:40:25.569 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:25.569 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:25.569 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:25.569 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.525035+0000", 2024-09-13T06:40:25.569 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1413999999999999e-05 2024-09-13T06:40:25.569 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:25.569 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:25.569 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:25.569 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.525054+0000", 2024-09-13T06:40:25.570 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.8723e-05 2024-09-13T06:40:25.570 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:25.570 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:25.570 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:25.570 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.525068+0000", 2024-09-13T06:40:25.570 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.4022999999999999e-05 2024-09-13T06:40:25.570 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:25.570 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:25.570 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:25.570 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.536923+0000", 2024-09-13T06:40:25.570 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.011854821999999999 2024-09-13T06:40:25.570 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:25.571 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:25.571 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:25.571 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.537048+0000", 2024-09-13T06:40:25.571 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000125399 2024-09-13T06:40:25.571 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:25.571 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:25.571 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 0", 2024-09-13T06:40:25.571 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.537293+0000", 2024-09-13T06:40:25.571 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00024499500000000002 2024-09-13T06:40:25.571 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:25.571 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:25.572 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-13T06:40:25.572 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.541962+0000", 2024-09-13T06:40:25.572 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0046680940000000002 2024-09-13T06:40:25.572 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:25.572 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:25.572 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:40:25.572 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.542218+0000", 2024-09-13T06:40:25.572 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00025668199999999999 2024-09-13T06:40:25.572 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:25.572 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:25.573 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-13T06:40:25.573 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.542286+0000", 2024-09-13T06:40:25.573 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.7565999999999997e-05 2024-09-13T06:40:25.573 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:25.573 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:25.573 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:25.573 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.542336+0000", 2024-09-13T06:40:25.573 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.0429000000000001e-05 2024-09-13T06:40:25.573 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:25.573 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:25.573 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:25.573 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:25.574 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:25.574 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4154.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-13T06:40:25.574 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:11.525085+0000", 2024-09-13T06:40:25.574 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 73.965494204999999, 2024-09-13T06:40:25.574 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.019358490999999999, 2024-09-13T06:40:25.574 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:25.574 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:40:25.574 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:25.574 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4154", 2024-09-13T06:40:25.574 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/2406930292", 2024-09-13T06:40:25.574 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 115 2024-09-13T06:40:25.574 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:25.575 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:25.575 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:25.575 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:25.575 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.525085+0000", 2024-09-13T06:40:25.575 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:25.575 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:25.575 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:25.575 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:25.575 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.525085+0000", 2024-09-13T06:40:25.575 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:25.575 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:25.575 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:25.576 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:25.576 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.525083+0000", 2024-09-13T06:40:25.576 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:25.576 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:25.576 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:25.576 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:25.576 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.525302+0000", 2024-09-13T06:40:25.576 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00021804499999999999 2024-09-13T06:40:25.576 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:25.576 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:25.576 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:25.577 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.525324+0000", 2024-09-13T06:40:25.577 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.2147e-05 2024-09-13T06:40:25.577 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:25.577 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:25.577 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:25.577 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.525340+0000", 2024-09-13T06:40:25.577 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5879000000000002e-05 2024-09-13T06:40:25.577 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:25.577 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:25.577 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:25.577 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.538555+0000", 2024-09-13T06:40:25.577 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.013215499 2024-09-13T06:40:25.578 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:25.578 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:25.578 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:25.578 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.538703+0000", 2024-09-13T06:40:25.578 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00014755200000000001 2024-09-13T06:40:25.578 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:25.578 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:25.578 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 0", 2024-09-13T06:40:25.578 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.538967+0000", 2024-09-13T06:40:25.578 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00026453799999999998 2024-09-13T06:40:25.578 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:25.578 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:25.579 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-13T06:40:25.579 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.541969+0000", 2024-09-13T06:40:25.579 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00300184 2024-09-13T06:40:25.579 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:25.579 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:25.579 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:40:25.579 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.544287+0000", 2024-09-13T06:40:25.579 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0023178890000000001 2024-09-13T06:40:25.579 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:25.579 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:25.579 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-13T06:40:25.579 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.544378+0000", 2024-09-13T06:40:25.580 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.1366000000000006e-05 2024-09-13T06:40:25.580 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:25.580 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:25.580 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:25.580 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.544443+0000", 2024-09-13T06:40:25.580 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.4826000000000006e-05 2024-09-13T06:40:25.580 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:25.580 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:25.580 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:25.580 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:25.580 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:25.581 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4154.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-13T06:40:25.581 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:11.525359+0000", 2024-09-13T06:40:25.581 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 73.965220177000006, 2024-09-13T06:40:25.581 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.019359514000000001, 2024-09-13T06:40:25.581 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:25.581 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:40:25.581 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:25.581 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4154", 2024-09-13T06:40:25.581 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/2406930292", 2024-09-13T06:40:25.581 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 116 2024-09-13T06:40:25.581 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:25.581 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:25.582 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:25.582 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:25.582 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.525359+0000", 2024-09-13T06:40:25.582 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:25.582 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:25.582 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:25.582 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:25.582 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.525359+0000", 2024-09-13T06:40:25.583 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:25.583 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:25.583 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:25.583 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:25.583 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.525357+0000", 2024-09-13T06:40:25.583 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999981 2024-09-13T06:40:25.583 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:25.583 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:25.583 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:25.583 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.525369+0000", 2024-09-13T06:40:25.583 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1647e-05 2024-09-13T06:40:25.584 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:25.584 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:25.584 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:25.584 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.525386+0000", 2024-09-13T06:40:25.584 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7762999999999999e-05 2024-09-13T06:40:25.584 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:25.584 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:25.584 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:25.584 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.525400+0000", 2024-09-13T06:40:25.584 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.4053000000000001e-05 2024-09-13T06:40:25.584 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:25.584 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:25.585 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:25.585 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.539897+0000", 2024-09-13T06:40:25.585 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.014497128999999999 2024-09-13T06:40:25.585 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:25.585 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:25.585 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:25.585 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.540022+0000", 2024-09-13T06:40:25.585 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00012416599999999999 2024-09-13T06:40:25.585 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:25.585 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:25.585 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 0", 2024-09-13T06:40:25.586 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.540199+0000", 2024-09-13T06:40:25.586 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00017705499999999999 2024-09-13T06:40:25.586 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:25.586 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:25.586 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-13T06:40:25.586 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.542161+0000", 2024-09-13T06:40:25.586 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0019622210000000001 2024-09-13T06:40:25.586 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:25.586 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:25.586 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:40:25.586 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.544529+0000", 2024-09-13T06:40:25.586 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0023684690000000002 2024-09-13T06:40:25.587 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:25.587 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:25.587 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-13T06:40:25.587 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.544614+0000", 2024-09-13T06:40:25.587 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.4711999999999998e-05 2024-09-13T06:40:25.587 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:25.587 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:25.587 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:25.587 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.544718+0000", 2024-09-13T06:40:25.587 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000103986 2024-09-13T06:40:25.587 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:25.587 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:25.588 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:25.588 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:25.588 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:25.588 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4154.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-13T06:40:25.588 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:11.525416+0000", 2024-09-13T06:40:25.588 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 73.965162624000001, 2024-09-13T06:40:25.588 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.019501830000000001, 2024-09-13T06:40:25.588 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:25.588 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:40:25.588 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:25.588 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4154", 2024-09-13T06:40:25.588 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/2406930292", 2024-09-13T06:40:25.589 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 117 2024-09-13T06:40:25.589 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:25.589 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:25.589 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:25.589 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:25.589 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.525416+0000", 2024-09-13T06:40:25.589 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:25.589 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:25.589 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:25.589 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:25.589 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.525416+0000", 2024-09-13T06:40:25.590 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:25.590 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:25.590 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:25.590 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:25.590 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.525415+0000", 2024-09-13T06:40:25.590 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999986 2024-09-13T06:40:25.590 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:25.590 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:25.590 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:25.590 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.525426+0000", 2024-09-13T06:40:25.591 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.101e-05 2024-09-13T06:40:25.591 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:25.591 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:25.591 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:25.591 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.525444+0000", 2024-09-13T06:40:25.591 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.768e-05 2024-09-13T06:40:25.591 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:25.591 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:25.591 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:25.591 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.525463+0000", 2024-09-13T06:40:25.591 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.9026999999999999e-05 2024-09-13T06:40:25.591 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:25.592 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:25.592 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:25.592 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.541203+0000", 2024-09-13T06:40:25.592 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.015740309000000001 2024-09-13T06:40:25.592 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:25.592 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:25.592 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:25.592 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.541330+0000", 2024-09-13T06:40:25.592 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000126976 2024-09-13T06:40:25.592 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:25.592 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:25.593 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 0", 2024-09-13T06:40:25.593 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.541522+0000", 2024-09-13T06:40:25.593 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00019165100000000001 2024-09-13T06:40:25.593 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:25.593 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:25.593 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-13T06:40:25.593 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.542798+0000", 2024-09-13T06:40:25.593 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.001276424 2024-09-13T06:40:25.593 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:25.593 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:25.593 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:40:25.593 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.544795+0000", 2024-09-13T06:40:25.594 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0019966540000000001 2024-09-13T06:40:25.594 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:25.594 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:25.594 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-13T06:40:25.594 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.544868+0000", 2024-09-13T06:40:25.594 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.3096000000000006e-05 2024-09-13T06:40:25.594 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:25.594 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:25.594 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:25.594 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.544918+0000", 2024-09-13T06:40:25.594 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.0226999999999999e-05 2024-09-13T06:40:25.595 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:25.595 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:25.595 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:25.595 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:25.595 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:25.595 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4154.0:136 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-13T06:40:25.595 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:12.006369+0000", 2024-09-13T06:40:25.595 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 73.484209274999998, 2024-09-13T06:40:25.595 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.012052078000000001, 2024-09-13T06:40:25.595 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:25.595 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:40:25.595 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:25.596 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4154", 2024-09-13T06:40:25.596 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/2406930292", 2024-09-13T06:40:25.596 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 136 2024-09-13T06:40:25.596 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:25.596 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:25.596 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:25.596 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:25.596 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.006369+0000", 2024-09-13T06:40:25.596 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:25.596 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:25.596 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:25.596 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:25.597 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.006369+0000", 2024-09-13T06:40:25.597 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:25.597 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:25.597 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:25.597 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:25.597 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.006369+0000", 2024-09-13T06:40:25.597 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:25.597 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:25.597 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:25.597 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:25.597 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.006372+0000", 2024-09-13T06:40:25.598 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.0630000000000002e-06 2024-09-13T06:40:25.598 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:25.598 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:25.598 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:25.598 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.006377+0000", 2024-09-13T06:40:25.598 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.6079999999999998e-06 2024-09-13T06:40:25.598 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:25.598 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:25.598 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:25.598 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.006384+0000", 2024-09-13T06:40:25.598 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.8560000000000001e-06 2024-09-13T06:40:25.598 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:25.599 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:25.599 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:25.599 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.008357+0000", 2024-09-13T06:40:25.599 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0019733839999999999 2024-09-13T06:40:25.599 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:25.599 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:25.599 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:25.599 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.008406+0000", 2024-09-13T06:40:25.599 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.9023000000000001e-05 2024-09-13T06:40:25.599 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:25.599 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:25.599 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 0", 2024-09-13T06:40:25.600 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.008489+0000", 2024-09-13T06:40:25.600 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.2649000000000001e-05 2024-09-13T06:40:25.600 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:25.600 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:25.600 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-13T06:40:25.600 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.011012+0000", 2024-09-13T06:40:25.600 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0025236880000000001 2024-09-13T06:40:25.600 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:25.600 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:25.600 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:40:25.600 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.018382+0000", 2024-09-13T06:40:25.600 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.007369596 2024-09-13T06:40:25.601 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:25.601 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:25.601 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-13T06:40:25.601 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.018405+0000", 2024-09-13T06:40:25.601 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.2670000000000001e-05 2024-09-13T06:40:25.601 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:25.601 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:25.601 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:25.601 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.018422+0000", 2024-09-13T06:40:25.601 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6864999999999999e-05 2024-09-13T06:40:25.601 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:25.602 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:25.602 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:25.602 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:25.602 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:25.602 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4154.0:137 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-13T06:40:25.602 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:12.006450+0000", 2024-09-13T06:40:25.602 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 73.484128945999998, 2024-09-13T06:40:25.602 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.012040990999999999, 2024-09-13T06:40:25.602 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:25.602 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:40:25.602 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:25.602 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4154", 2024-09-13T06:40:25.602 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/2406930292", 2024-09-13T06:40:25.603 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 137 2024-09-13T06:40:25.603 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:25.603 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:25.603 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:25.603 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:25.603 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.006450+0000", 2024-09-13T06:40:25.603 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:25.603 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:25.603 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:25.603 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:25.603 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.006450+0000", 2024-09-13T06:40:25.604 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:25.604 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:25.604 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:25.604 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:25.604 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.006449+0000", 2024-09-13T06:40:25.604 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:25.604 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:25.604 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:25.604 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:25.604 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.006549+0000", 2024-09-13T06:40:25.604 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.9847999999999997e-05 2024-09-13T06:40:25.605 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:25.605 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:25.605 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:25.605 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.006560+0000", 2024-09-13T06:40:25.605 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1012000000000001e-05 2024-09-13T06:40:25.605 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:25.605 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:25.605 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:25.605 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.006566+0000", 2024-09-13T06:40:25.605 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.1630000000000001e-06 2024-09-13T06:40:25.605 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:25.605 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:25.606 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:25.606 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.008760+0000", 2024-09-13T06:40:25.606 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0021934659999999998 2024-09-13T06:40:25.606 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:25.606 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:25.606 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:25.606 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.008803+0000", 2024-09-13T06:40:25.606 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.3492000000000003e-05 2024-09-13T06:40:25.606 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:25.606 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:25.606 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 0", 2024-09-13T06:40:25.607 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.008879+0000", 2024-09-13T06:40:25.607 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5252000000000004e-05 2024-09-13T06:40:25.607 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:25.607 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:25.607 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-13T06:40:25.607 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.011015+0000", 2024-09-13T06:40:25.607 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0021362349999999998 2024-09-13T06:40:25.607 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:25.607 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:25.607 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:40:25.607 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.018452+0000", 2024-09-13T06:40:25.607 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.007436865 2024-09-13T06:40:25.608 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:25.608 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:25.608 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-13T06:40:25.608 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.018474+0000", 2024-09-13T06:40:25.608 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.2149000000000001e-05 2024-09-13T06:40:25.608 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:25.608 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:25.608 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:25.608 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.018491+0000", 2024-09-13T06:40:25.608 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6983999999999999e-05 2024-09-13T06:40:25.608 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:25.608 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:25.609 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:25.609 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:25.609 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:25.609 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4154.0:139 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-13T06:40:25.609 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:12.006595+0000", 2024-09-13T06:40:25.609 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 73.483983628000004, 2024-09-13T06:40:25.609 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.012024933999999999, 2024-09-13T06:40:25.609 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:25.609 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:40:25.609 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:25.610 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4154", 2024-09-13T06:40:25.610 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/2406930292", 2024-09-13T06:40:25.610 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 139 2024-09-13T06:40:25.610 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:25.610 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:25.610 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:25.610 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:25.610 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.006595+0000", 2024-09-13T06:40:25.610 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:25.610 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:25.610 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:25.611 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:25.611 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.006595+0000", 2024-09-13T06:40:25.611 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:25.611 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:25.611 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:25.611 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:25.611 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.006595+0000", 2024-09-13T06:40:25.611 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:25.611 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:25.611 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:25.612 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:25.612 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.006598+0000", 2024-09-13T06:40:25.612 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.1769999999999998e-06 2024-09-13T06:40:25.612 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:25.612 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:25.612 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:25.612 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.006612+0000", 2024-09-13T06:40:25.612 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.4177e-05 2024-09-13T06:40:25.612 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:25.612 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:25.613 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:25.613 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.006617+0000", 2024-09-13T06:40:25.613 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.561e-06 2024-09-13T06:40:25.613 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:25.613 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:25.613 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:25.613 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.009658+0000", 2024-09-13T06:40:25.613 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0030413369999999999 2024-09-13T06:40:25.613 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:25.613 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:25.613 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:25.614 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.009707+0000", 2024-09-13T06:40:25.614 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.9089999999999999e-05 2024-09-13T06:40:25.614 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:25.614 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:25.614 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 0", 2024-09-13T06:40:25.614 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.009795+0000", 2024-09-13T06:40:25.614 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.7619000000000003e-05 2024-09-13T06:40:25.614 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:25.614 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:25.614 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-13T06:40:25.614 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.011021+0000", 2024-09-13T06:40:25.614 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0012266289999999999 2024-09-13T06:40:25.615 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:25.615 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:25.615 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:40:25.615 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.018582+0000", 2024-09-13T06:40:25.615 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0075603399999999996 2024-09-13T06:40:25.615 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:25.615 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:25.615 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-13T06:40:25.615 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.018603+0000", 2024-09-13T06:40:25.615 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.1795999999999999e-05 2024-09-13T06:40:25.615 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:25.616 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:25.616 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:25.616 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.018620+0000", 2024-09-13T06:40:25.616 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6562000000000002e-05 2024-09-13T06:40:25.616 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:25.616 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:25.616 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:25.616 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:25.616 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:25.616 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4154.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-13T06:40:25.616 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:12.006689+0000", 2024-09-13T06:40:25.617 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 73.483889438999995, 2024-09-13T06:40:25.617 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.012427258, 2024-09-13T06:40:25.617 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:25.617 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:40:25.617 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:25.617 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4154", 2024-09-13T06:40:25.617 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/2406930292", 2024-09-13T06:40:25.617 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 140 2024-09-13T06:40:25.617 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:25.617 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:25.617 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:25.617 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:25.618 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.006689+0000", 2024-09-13T06:40:25.618 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:25.618 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:25.618 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:25.618 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:25.618 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.006689+0000", 2024-09-13T06:40:25.618 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:25.618 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:25.618 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:25.618 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:25.618 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.006689+0000", 2024-09-13T06:40:25.618 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:25.619 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:25.619 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:25.619 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:25.619 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.006795+0000", 2024-09-13T06:40:25.619 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00010662699999999999 2024-09-13T06:40:25.619 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:25.619 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:25.619 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:25.619 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.006804+0000", 2024-09-13T06:40:25.619 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.055e-06 2024-09-13T06:40:25.619 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:25.619 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:25.620 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:25.620 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.006808+0000", 2024-09-13T06:40:25.620 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.7450000000000003e-06 2024-09-13T06:40:25.620 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:25.620 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:25.620 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:25.620 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.010066+0000", 2024-09-13T06:40:25.620 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0032579570000000001 2024-09-13T06:40:25.620 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:25.620 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:25.620 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:25.621 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.010111+0000", 2024-09-13T06:40:25.621 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.4563e-05 2024-09-13T06:40:25.621 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:25.621 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:25.621 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 0", 2024-09-13T06:40:25.621 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.010185+0000", 2024-09-13T06:40:25.621 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.4108000000000003e-05 2024-09-13T06:40:25.621 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:25.621 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:25.621 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-13T06:40:25.621 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.011161+0000", 2024-09-13T06:40:25.621 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00097629200000000002 2024-09-13T06:40:25.622 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:25.622 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:25.622 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:40:25.622 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.019061+0000", 2024-09-13T06:40:25.622 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0079001939999999993 2024-09-13T06:40:25.624 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:25.624 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:25.624 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-13T06:40:25.624 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.019095+0000", 2024-09-13T06:40:25.625 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.3200000000000001e-05 2024-09-13T06:40:25.625 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:25.625 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:25.625 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:25.625 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.019117+0000", 2024-09-13T06:40:25.625 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.1985e-05 2024-09-13T06:40:25.625 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:25.625 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:25.625 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:25.625 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:25.625 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:25.625 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4154.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-13T06:40:25.626 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:12.006814+0000", 2024-09-13T06:40:25.626 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 73.483764254999997, 2024-09-13T06:40:25.626 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.012896405999999999, 2024-09-13T06:40:25.626 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:25.626 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:40:25.626 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:25.626 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4154", 2024-09-13T06:40:25.626 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/2406930292", 2024-09-13T06:40:25.626 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 141 2024-09-13T06:40:25.626 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:25.626 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:25.626 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:25.627 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:25.627 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.006814+0000", 2024-09-13T06:40:25.627 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:25.627 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:25.627 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:25.627 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:25.627 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.006814+0000", 2024-09-13T06:40:25.627 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:25.627 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:25.627 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:25.627 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:25.628 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.006814+0000", 2024-09-13T06:40:25.628 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:25.628 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:25.628 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:25.628 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:25.628 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.006818+0000", 2024-09-13T06:40:25.628 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.8840000000000004e-06 2024-09-13T06:40:25.628 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:25.628 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:25.628 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:25.628 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.006834+0000", 2024-09-13T06:40:25.629 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6133999999999998e-05 2024-09-13T06:40:25.629 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:25.629 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:25.629 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:25.629 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.006838+0000", 2024-09-13T06:40:25.629 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0879999999999997e-06 2024-09-13T06:40:25.629 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:25.629 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:25.629 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:25.629 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.010586+0000", 2024-09-13T06:40:25.629 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.003747954 2024-09-13T06:40:25.629 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:25.630 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:25.630 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:25.630 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.010630+0000", 2024-09-13T06:40:25.630 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.3736000000000003e-05 2024-09-13T06:40:25.630 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:25.630 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:25.630 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 0", 2024-09-13T06:40:25.630 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.010701+0000", 2024-09-13T06:40:25.630 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.1284000000000004e-05 2024-09-13T06:40:25.630 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:25.630 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:25.631 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-13T06:40:25.631 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.011593+0000", 2024-09-13T06:40:25.631 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00089209300000000005 2024-09-13T06:40:25.631 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:25.631 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:25.631 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:40:25.631 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.019665+0000", 2024-09-13T06:40:25.631 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0080716169999999997 2024-09-13T06:40:25.631 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:25.631 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:25.631 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-13T06:40:25.631 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.019691+0000", 2024-09-13T06:40:25.632 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.6514000000000001e-05 2024-09-13T06:40:25.632 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:25.632 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:25.632 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:25.632 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.019711+0000", 2024-09-13T06:40:25.632 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.9641e-05 2024-09-13T06:40:25.632 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:25.632 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:25.632 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:25.632 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:25.632 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:25.632 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:608 3.11 3:8ebac99f:::rbd_data.11214e25756e.0000000000000007:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-09-13T06:40:25.633 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:34.801988+0000", 2024-09-13T06:40:25.633 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 50.688590867000002, 2024-09-13T06:40:25.633 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.033916448000000002, 2024-09-13T06:40:25.633 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:25.633 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:40:25.633 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:25.633 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:25.633 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:25.633 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 608 2024-09-13T06:40:25.633 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:25.633 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:25.634 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:25.634 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:25.634 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:34.801988+0000", 2024-09-13T06:40:25.634 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:25.634 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:25.634 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:25.634 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:25.634 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:34.801988+0000", 2024-09-13T06:40:25.634 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:25.634 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:25.634 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:25.634 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:25.635 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:34.801985+0000", 2024-09-13T06:40:25.635 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999976 2024-09-13T06:40:25.635 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:25.635 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:25.635 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:25.635 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:34.801999+0000", 2024-09-13T06:40:25.635 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.402e-05 2024-09-13T06:40:25.635 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:25.635 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:25.635 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:25.635 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:34.802031+0000", 2024-09-13T06:40:25.635 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.1582999999999999e-05 2024-09-13T06:40:25.636 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:25.636 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:25.636 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:25.636 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:34.802052+0000", 2024-09-13T06:40:25.636 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.1310000000000001e-05 2024-09-13T06:40:25.636 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:25.636 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:25.636 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:25.636 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:34.802117+0000", 2024-09-13T06:40:25.636 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.5016000000000002e-05 2024-09-13T06:40:25.636 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:25.636 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:25.637 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:25.637 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:34.802254+0000", 2024-09-13T06:40:25.637 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000136186 2024-09-13T06:40:25.637 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:25.637 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:25.637 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 4", 2024-09-13T06:40:25.637 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:34.807944+0000", 2024-09-13T06:40:25.637 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0056906930000000001 2024-09-13T06:40:25.637 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:25.637 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:25.637 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-13T06:40:25.637 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:34.835646+0000", 2024-09-13T06:40:25.638 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.027701546000000001 2024-09-13T06:40:25.638 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:25.638 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:25.638 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:40:25.638 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:34.835754+0000", 2024-09-13T06:40:25.638 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000107889 2024-09-13T06:40:25.638 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:25.638 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:25.638 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-13T06:40:25.638 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:34.835840+0000", 2024-09-13T06:40:25.638 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6621999999999998e-05 2024-09-13T06:40:25.639 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:25.639 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:25.639 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:25.639 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:34.835904+0000", 2024-09-13T06:40:25.639 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.4022999999999993e-05 2024-09-13T06:40:25.639 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:25.639 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:25.639 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:25.639 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:25.639 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:25.639 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:40:25.640 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-13T06:40:25.641 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:40:25.640+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:40:25.642 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-13T06:40:25.722 INFO:teuthology.orchestra.run.smithi081.stdout:checking clone #9, image image_client.0-clone9 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent10 2024-09-13T06:40:25.742 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:40:25.740+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:40:25.771 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:40:25.771 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-13T06:40:25.771 INFO:teuthology.orchestra.run.smithi081.stdout: "num_ops": 0 2024-09-13T06:40:25.771 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:40:25.791 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-13T06:40:25.844 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-13T06:40:25.842+0000 7f86a5f06640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26387) UID: 0 2024-09-13T06:40:25.944 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:40:25.944+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:40:25.952 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:40:25.952 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-13T06:40:25.952 INFO:teuthology.orchestra.run.smithi081.stdout: "complaint_time": 30, 2024-09-13T06:40:25.952 INFO:teuthology.orchestra.run.smithi081.stdout: "num_blocked_ops": 0 2024-09-13T06:40:25.952 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:40:25.967 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-13T06:40:26.046 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:40:26.046+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:40:26.136 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:40:26.136 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 20, 2024-09-13T06:40:26.136 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 600, 2024-09-13T06:40:26.136 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [ 2024-09-13T06:40:26.136 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:26.136 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:37801 3.1 3:82e31015:::rbd_object_map.1121d8143c6e.0000000000000019:head [call] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e55)", 2024-09-13T06:40:26.136 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:05.646191+0000", 2024-09-13T06:40:26.136 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 20.489711567000001, 2024-09-13T06:40:26.136 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.72659507800000001, 2024-09-13T06:40:26.137 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:26.137 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:26.137 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:26.137 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:26.137 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:26.137 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 37801 2024-09-13T06:40:26.137 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:26.137 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:26.137 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:26.137 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:26.137 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:05.646191+0000", 2024-09-13T06:40:26.137 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:26.137 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:26.138 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:26.138 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:26.138 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:05.646191+0000", 2024-09-13T06:40:26.138 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:26.138 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:26.138 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:26.138 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:26.138 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:05.646188+0000", 2024-09-13T06:40:26.138 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999971 2024-09-13T06:40:26.138 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:26.138 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:26.138 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:26.138 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:05.646206+0000", 2024-09-13T06:40:26.138 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8182999999999999e-05 2024-09-13T06:40:26.139 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:26.139 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:26.139 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:26.139 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:05.646237+0000", 2024-09-13T06:40:26.139 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.1071000000000001e-05 2024-09-13T06:40:26.139 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:26.139 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:26.139 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:26.139 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:05.646251+0000", 2024-09-13T06:40:26.139 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3679000000000001e-05 2024-09-13T06:40:26.139 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:26.139 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:26.139 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:26.139 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:05.646321+0000", 2024-09-13T06:40:26.140 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.9831000000000003e-05 2024-09-13T06:40:26.140 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:26.140 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:26.140 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:40:26.140 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:05.646331+0000", 2024-09-13T06:40:26.140 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0242e-05 2024-09-13T06:40:26.140 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:26.140 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:26.140 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:26.140 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.371959+0000", 2024-09-13T06:40:26.140 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.72562817199999996 2024-09-13T06:40:26.140 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:26.140 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:26.140 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:26.141 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.372389+0000", 2024-09-13T06:40:26.141 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00042977400000000001 2024-09-13T06:40:26.141 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:26.141 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:26.141 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:26.141 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.372786+0000", 2024-09-13T06:40:26.141 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00039706099999999999 2024-09-13T06:40:26.141 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:26.141 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:26.141 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:26.141 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:26.141 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:26.141 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43009 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 489472~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:40:26.142 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.644660+0000", 2024-09-13T06:40:26.142 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 4.4912426050000001, 2024-09-13T06:40:26.142 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123376071, 2024-09-13T06:40:26.142 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:26.142 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:26.142 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:26.142 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:26.142 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:26.142 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43009 2024-09-13T06:40:26.142 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:26.142 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:26.142 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:26.142 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:26.142 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.644660+0000", 2024-09-13T06:40:26.143 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:26.143 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:26.143 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:26.143 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:26.143 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.644660+0000", 2024-09-13T06:40:26.143 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:26.143 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:26.143 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:26.143 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:26.143 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.644659+0000", 2024-09-13T06:40:26.143 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:26.143 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:26.143 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:26.143 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:26.144 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.644662+0000", 2024-09-13T06:40:26.144 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4949999999999998e-06 2024-09-13T06:40:26.144 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:26.144 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:26.144 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:26.144 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.644669+0000", 2024-09-13T06:40:26.144 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.289e-06 2024-09-13T06:40:26.144 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:26.144 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:26.144 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:26.144 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.644674+0000", 2024-09-13T06:40:26.144 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.8840000000000002e-06 2024-09-13T06:40:26.144 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:26.145 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:26.145 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:26.145 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.767602+0000", 2024-09-13T06:40:26.145 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.122928158 2024-09-13T06:40:26.145 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:26.145 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:26.145 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:26.145 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.767676+0000", 2024-09-13T06:40:26.145 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3992999999999994e-05 2024-09-13T06:40:26.145 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:26.145 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:26.145 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:26.145 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.768036+0000", 2024-09-13T06:40:26.146 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00035966200000000001 2024-09-13T06:40:26.146 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:26.146 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:26.146 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:26.146 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:26.146 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:26.146 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43010 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 503808~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:40:26.146 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.644678+0000", 2024-09-13T06:40:26.146 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 4.4912242789999999, 2024-09-13T06:40:26.146 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123728798, 2024-09-13T06:40:26.146 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:26.146 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:26.146 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:26.147 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:26.147 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:26.147 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43010 2024-09-13T06:40:26.147 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:26.147 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:26.147 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:26.147 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:26.147 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.644678+0000", 2024-09-13T06:40:26.147 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:26.147 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:26.147 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:26.147 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:26.147 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.644678+0000", 2024-09-13T06:40:26.148 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:26.148 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:26.148 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:26.148 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:26.148 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.644678+0000", 2024-09-13T06:40:26.148 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:26.148 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:26.148 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:26.148 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:26.148 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.644680+0000", 2024-09-13T06:40:26.148 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2050000000000001e-06 2024-09-13T06:40:26.148 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:26.148 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:26.148 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:26.149 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.644686+0000", 2024-09-13T06:40:26.149 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8440000000000003e-06 2024-09-13T06:40:26.149 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:26.149 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:26.149 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:26.149 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.644691+0000", 2024-09-13T06:40:26.149 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.118e-06 2024-09-13T06:40:26.149 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:26.149 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:26.149 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:26.149 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.768065+0000", 2024-09-13T06:40:26.149 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123374698 2024-09-13T06:40:26.149 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:26.150 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:26.150 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:26.150 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.768139+0000", 2024-09-13T06:40:26.150 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3934000000000001e-05 2024-09-13T06:40:26.150 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:26.150 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:26.150 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:26.150 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.768407+0000", 2024-09-13T06:40:26.150 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00026738800000000002 2024-09-13T06:40:26.150 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:26.150 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:26.150 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:26.150 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:26.151 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:26.151 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43181 3.17 3:ec5ebce4:::rbd_data.1121f5f2e1c0.0000000000000001:1f [read 319488~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:40:26.151 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.652968+0000", 2024-09-13T06:40:26.151 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 4.4829337630000001, 2024-09-13T06:40:26.151 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.12363807, 2024-09-13T06:40:26.151 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:26.151 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:26.151 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:26.151 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:26.151 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:26.152 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43181 2024-09-13T06:40:26.152 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:26.152 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:26.152 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:26.152 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:26.152 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.652968+0000", 2024-09-13T06:40:26.152 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:26.152 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:26.152 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:26.152 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:26.152 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.652968+0000", 2024-09-13T06:40:26.152 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:26.153 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:26.153 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:26.153 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:26.153 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.652968+0000", 2024-09-13T06:40:26.153 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:26.153 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:26.153 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:26.153 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:26.153 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.652970+0000", 2024-09-13T06:40:26.153 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2409999999999998e-06 2024-09-13T06:40:26.153 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:26.153 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:26.153 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:26.154 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.652976+0000", 2024-09-13T06:40:26.154 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0079999999999999e-06 2024-09-13T06:40:26.154 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:26.154 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:26.154 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:26.154 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.652981+0000", 2024-09-13T06:40:26.154 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4390000000000002e-06 2024-09-13T06:40:26.154 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:26.154 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:26.154 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:26.154 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.776275+0000", 2024-09-13T06:40:26.154 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.12329396099999999 2024-09-13T06:40:26.154 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:26.155 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:26.155 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:26.155 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.776316+0000", 2024-09-13T06:40:26.155 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.1244e-05 2024-09-13T06:40:26.155 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:26.155 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:26.155 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:26.155 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.776607+0000", 2024-09-13T06:40:26.155 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00029051199999999999 2024-09-13T06:40:26.155 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:26.155 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:26.155 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:26.155 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:26.155 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:26.156 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43182 3.17 3:ec5ebce4:::rbd_data.1121f5f2e1c0.0000000000000001:1f [read 333824~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:40:26.156 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.652985+0000", 2024-09-13T06:40:26.156 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 4.4829169540000002, 2024-09-13T06:40:26.156 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123926616, 2024-09-13T06:40:26.156 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:26.156 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:26.156 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:26.156 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:26.156 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:26.156 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43182 2024-09-13T06:40:26.156 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:26.157 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:26.157 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:26.157 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:26.157 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.652985+0000", 2024-09-13T06:40:26.157 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:26.157 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:26.157 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:26.157 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:26.157 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.652985+0000", 2024-09-13T06:40:26.157 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:26.157 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:26.157 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:26.157 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:26.158 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.652985+0000", 2024-09-13T06:40:26.158 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:26.158 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:26.158 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:26.158 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:26.158 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.652987+0000", 2024-09-13T06:40:26.158 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0899999999999999e-06 2024-09-13T06:40:26.158 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:26.158 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:26.158 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:26.158 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.652994+0000", 2024-09-13T06:40:26.158 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3100000000000003e-06 2024-09-13T06:40:26.158 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:26.158 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:26.159 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:26.159 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.653000+0000", 2024-09-13T06:40:26.159 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2020000000000003e-06 2024-09-13T06:40:26.159 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:26.159 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:26.159 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:26.159 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.776635+0000", 2024-09-13T06:40:26.159 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.12363529400000001 2024-09-13T06:40:26.159 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:26.159 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:26.159 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:26.159 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.776676+0000", 2024-09-13T06:40:26.159 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.0745999999999999e-05 2024-09-13T06:40:26.159 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:26.160 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:26.160 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:26.160 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.776912+0000", 2024-09-13T06:40:26.160 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00023631300000000001 2024-09-13T06:40:26.160 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:26.160 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:26.160 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:26.160 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:26.160 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:26.160 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43192 3.17 3:ec5ebce4:::rbd_data.1121f5f2e1c0.0000000000000001:1f [read 466944~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:40:26.160 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.656622+0000", 2024-09-13T06:40:26.160 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 4.4792798979999997, 2024-09-13T06:40:26.160 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123503136, 2024-09-13T06:40:26.161 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:26.161 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:26.161 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:26.161 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:26.161 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:26.161 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43192 2024-09-13T06:40:26.161 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:26.161 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:26.161 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:26.161 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:26.161 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656622+0000", 2024-09-13T06:40:26.161 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:26.161 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:26.161 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:26.162 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:26.162 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656622+0000", 2024-09-13T06:40:26.162 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:26.162 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:26.162 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:26.162 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:26.162 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656622+0000", 2024-09-13T06:40:26.162 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:40:26.162 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:26.162 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:26.162 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:26.162 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656623+0000", 2024-09-13T06:40:26.162 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2079999999999999e-06 2024-09-13T06:40:26.162 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:26.163 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:26.163 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:26.163 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656627+0000", 2024-09-13T06:40:26.163 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.4819999999999999e-06 2024-09-13T06:40:26.163 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:26.163 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:26.163 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:26.163 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656629+0000", 2024-09-13T06:40:26.163 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.582e-06 2024-09-13T06:40:26.163 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:26.163 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:26.163 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:26.163 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.779866+0000", 2024-09-13T06:40:26.164 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.12323638100000001 2024-09-13T06:40:26.164 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:26.164 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:26.164 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:26.164 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.779905+0000", 2024-09-13T06:40:26.164 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.9529e-05 2024-09-13T06:40:26.164 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:26.164 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:26.164 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:26.164 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.780125+0000", 2024-09-13T06:40:26.164 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000220168 2024-09-13T06:40:26.164 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:26.164 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:26.165 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:26.165 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:26.165 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:26.165 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43193 3.17 3:ec5ebce4:::rbd_data.1121f5f2e1c0.0000000000000001:1f [read 481280~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:40:26.165 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.656635+0000", 2024-09-13T06:40:26.165 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 4.4792674139999997, 2024-09-13T06:40:26.165 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.12374478999999999, 2024-09-13T06:40:26.165 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:26.165 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:26.165 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:26.165 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:26.165 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:26.166 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43193 2024-09-13T06:40:26.166 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:26.166 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:26.166 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:26.166 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:26.166 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656635+0000", 2024-09-13T06:40:26.166 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:26.166 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:26.166 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:26.166 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:26.166 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656635+0000", 2024-09-13T06:40:26.166 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:26.166 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:26.166 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:26.167 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:26.167 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656635+0000", 2024-09-13T06:40:26.167 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:40:26.167 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:26.167 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:26.167 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:26.167 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656636+0000", 2024-09-13T06:40:26.167 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.544e-06 2024-09-13T06:40:26.167 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:26.167 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:26.167 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:26.167 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656639+0000", 2024-09-13T06:40:26.168 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.0879999999999999e-06 2024-09-13T06:40:26.168 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:26.168 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:26.168 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:26.168 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656642+0000", 2024-09-13T06:40:26.168 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5799999999999999e-06 2024-09-13T06:40:26.168 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:26.168 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:26.168 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:26.168 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.780151+0000", 2024-09-13T06:40:26.168 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123509035 2024-09-13T06:40:26.168 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:26.168 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:26.169 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:26.169 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.780191+0000", 2024-09-13T06:40:26.169 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.9758000000000001e-05 2024-09-13T06:40:26.169 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:26.169 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:26.169 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:26.169 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.780380+0000", 2024-09-13T06:40:26.169 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000189023 2024-09-13T06:40:26.169 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:26.169 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:26.169 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:26.169 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:26.169 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:26.169 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43194 3.17 3:ec5ebce4:::rbd_data.1121f5f2e1c0.0000000000000001:1f [read 495616~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:40:26.170 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.656645+0000", 2024-09-13T06:40:26.170 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 4.4792567610000003, 2024-09-13T06:40:26.170 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.124088483, 2024-09-13T06:40:26.170 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:26.170 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:26.170 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:26.170 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:26.170 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:26.170 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43194 2024-09-13T06:40:26.170 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:26.170 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:26.170 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:26.170 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:26.170 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656645+0000", 2024-09-13T06:40:26.171 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:26.171 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:26.171 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:26.171 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:26.171 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656645+0000", 2024-09-13T06:40:26.171 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:26.171 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:26.171 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:26.171 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:26.171 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656645+0000", 2024-09-13T06:40:26.171 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:26.171 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:26.171 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:26.171 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:26.172 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656647+0000", 2024-09-13T06:40:26.172 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9180000000000001e-06 2024-09-13T06:40:26.172 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:26.172 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:26.172 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:26.172 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656653+0000", 2024-09-13T06:40:26.172 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7860000000000002e-06 2024-09-13T06:40:26.172 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:26.172 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:26.172 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:26.172 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656658+0000", 2024-09-13T06:40:26.172 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6949999999999999e-06 2024-09-13T06:40:26.172 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:26.172 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:26.173 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:26.173 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.780406+0000", 2024-09-13T06:40:26.173 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123748657 2024-09-13T06:40:26.173 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:26.173 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:26.173 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:26.173 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.780446+0000", 2024-09-13T06:40:26.173 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.9360999999999998e-05 2024-09-13T06:40:26.173 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:26.173 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:26.173 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:26.173 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.780734+0000", 2024-09-13T06:40:26.174 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00028838399999999998 2024-09-13T06:40:26.174 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:26.174 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:26.174 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:26.174 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:26.174 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:26.174 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43240 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 106496~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:40:26.174 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.660672+0000", 2024-09-13T06:40:26.174 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 4.4752303979999999, 2024-09-13T06:40:26.174 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123612707, 2024-09-13T06:40:26.174 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:26.174 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:26.174 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:26.175 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:26.175 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:26.175 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43240 2024-09-13T06:40:26.175 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:26.175 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:26.175 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:26.175 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:26.175 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660672+0000", 2024-09-13T06:40:26.175 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:26.175 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:26.175 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:26.175 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:26.176 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660672+0000", 2024-09-13T06:40:26.176 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:26.176 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:26.176 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:26.177 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:26.177 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660671+0000", 2024-09-13T06:40:26.177 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:26.177 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:26.177 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:26.177 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:26.178 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660673+0000", 2024-09-13T06:40:26.178 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.652e-06 2024-09-13T06:40:26.178 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:26.178 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:26.178 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:26.178 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660677+0000", 2024-09-13T06:40:26.178 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.2509999999999996e-06 2024-09-13T06:40:26.178 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:26.178 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:26.178 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:26.178 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660680+0000", 2024-09-13T06:40:26.178 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.8150000000000002e-06 2024-09-13T06:40:26.178 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:26.179 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:26.179 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:26.179 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.783596+0000", 2024-09-13T06:40:26.179 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.122915841 2024-09-13T06:40:26.179 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:26.179 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:26.179 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:26.179 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.783682+0000", 2024-09-13T06:40:26.179 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.5822999999999995e-05 2024-09-13T06:40:26.179 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:26.179 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:26.179 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:26.179 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.784285+0000", 2024-09-13T06:40:26.180 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00060276500000000001 2024-09-13T06:40:26.180 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:26.180 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:26.180 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:26.180 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:26.180 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:26.180 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43241 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 120832~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:40:26.180 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.660682+0000", 2024-09-13T06:40:26.180 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 4.4752198229999998, 2024-09-13T06:40:26.180 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123958204, 2024-09-13T06:40:26.180 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:26.180 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:26.180 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:26.181 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:26.181 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:26.181 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43241 2024-09-13T06:40:26.181 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:26.181 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:26.181 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:26.181 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:26.181 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660682+0000", 2024-09-13T06:40:26.181 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:26.181 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:26.181 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:26.181 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:26.181 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660682+0000", 2024-09-13T06:40:26.182 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:26.182 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:26.182 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:26.182 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:26.182 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660682+0000", 2024-09-13T06:40:26.182 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:26.182 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:26.182 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:26.182 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:26.182 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660683+0000", 2024-09-13T06:40:26.182 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.308e-06 2024-09-13T06:40:26.182 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:26.182 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:26.182 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:26.183 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660686+0000", 2024-09-13T06:40:26.183 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.977e-06 2024-09-13T06:40:26.183 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:26.183 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:26.183 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:26.183 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660689+0000", 2024-09-13T06:40:26.183 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5830000000000001e-06 2024-09-13T06:40:26.183 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:26.183 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:26.183 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:26.183 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.784366+0000", 2024-09-13T06:40:26.183 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.12367713599999999 2024-09-13T06:40:26.183 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:26.183 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:26.184 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:26.184 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.784451+0000", 2024-09-13T06:40:26.184 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.4629999999999994e-05 2024-09-13T06:40:26.184 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:26.184 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:26.184 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:26.184 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.784641+0000", 2024-09-13T06:40:26.184 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00018984899999999999 2024-09-13T06:40:26.184 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:26.184 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:26.184 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:26.184 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:26.184 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:26.185 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43242 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 139264~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:40:26.185 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.660691+0000", 2024-09-13T06:40:26.185 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 4.4752108450000003, 2024-09-13T06:40:26.185 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.124536443, 2024-09-13T06:40:26.185 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:26.185 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:26.185 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:26.185 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:26.185 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:26.185 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43242 2024-09-13T06:40:26.185 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:26.185 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:26.185 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:26.185 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:26.186 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660691+0000", 2024-09-13T06:40:26.186 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:26.186 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:26.186 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:26.186 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:26.186 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660691+0000", 2024-09-13T06:40:26.186 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:26.186 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:26.186 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:26.186 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:26.186 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660691+0000", 2024-09-13T06:40:26.186 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:40:26.186 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:26.187 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:26.187 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:26.187 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660696+0000", 2024-09-13T06:40:26.187 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0560000000000004e-06 2024-09-13T06:40:26.187 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:26.187 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:26.187 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:26.187 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660699+0000", 2024-09-13T06:40:26.187 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.2009999999999999e-06 2024-09-13T06:40:26.187 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:26.187 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:26.187 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:26.187 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660702+0000", 2024-09-13T06:40:26.187 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.633e-06 2024-09-13T06:40:26.188 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:26.188 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:26.188 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:26.188 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.784912+0000", 2024-09-13T06:40:26.188 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.124209497 2024-09-13T06:40:26.188 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:26.188 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:26.188 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:26.188 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.784995+0000", 2024-09-13T06:40:26.188 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.3891e-05 2024-09-13T06:40:26.188 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:26.188 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:26.188 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:26.189 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.785228+0000", 2024-09-13T06:40:26.189 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00023237400000000001 2024-09-13T06:40:26.189 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:26.189 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:26.189 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:26.189 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:26.189 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:26.189 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43243 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 153600~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:40:26.189 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.660705+0000", 2024-09-13T06:40:26.189 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 4.4751975120000003, 2024-09-13T06:40:26.189 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.124825835, 2024-09-13T06:40:26.189 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:26.189 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:26.190 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:26.190 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:26.190 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:26.190 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43243 2024-09-13T06:40:26.190 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:26.190 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:26.190 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:26.190 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:26.190 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660705+0000", 2024-09-13T06:40:26.190 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:26.190 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:26.190 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:26.190 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:26.190 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660705+0000", 2024-09-13T06:40:26.191 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:26.191 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:26.191 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:26.191 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:26.191 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660705+0000", 2024-09-13T06:40:26.191 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:40:26.191 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:26.191 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:26.191 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:26.191 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660706+0000", 2024-09-13T06:40:26.191 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4339999999999999e-06 2024-09-13T06:40:26.191 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:26.192 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:26.192 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:26.192 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660709+0000", 2024-09-13T06:40:26.192 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9000000000000002e-06 2024-09-13T06:40:26.192 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:26.192 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:26.192 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:26.192 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660712+0000", 2024-09-13T06:40:26.192 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.0589999999999998e-06 2024-09-13T06:40:26.192 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:26.192 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:26.192 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:26.192 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.785318+0000", 2024-09-13T06:40:26.193 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.124606299 2024-09-13T06:40:26.193 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:26.193 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:26.193 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:26.193 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.785361+0000", 2024-09-13T06:40:26.193 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.3214999999999999e-05 2024-09-13T06:40:26.193 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:26.193 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:26.193 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:26.193 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.785531+0000", 2024-09-13T06:40:26.193 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00016914400000000001 2024-09-13T06:40:26.193 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:26.193 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:26.194 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:26.194 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:26.194 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:26.194 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43244 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 167936~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:40:26.194 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.660714+0000", 2024-09-13T06:40:26.194 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 4.4751880990000004, 2024-09-13T06:40:26.194 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.125073248, 2024-09-13T06:40:26.194 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:26.194 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:26.194 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:26.194 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:26.194 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:26.194 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43244 2024-09-13T06:40:26.194 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:26.195 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:26.195 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:26.196 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:26.196 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660714+0000", 2024-09-13T06:40:26.196 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:26.196 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:26.196 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:26.196 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:26.196 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660714+0000", 2024-09-13T06:40:26.196 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:26.196 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:26.196 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:26.196 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:26.196 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660714+0000", 2024-09-13T06:40:26.197 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:40:26.197 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:26.197 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:26.197 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:26.197 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660715+0000", 2024-09-13T06:40:26.197 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2330000000000001e-06 2024-09-13T06:40:26.197 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:26.197 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:26.197 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:26.197 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660718+0000", 2024-09-13T06:40:26.197 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9569999999999998e-06 2024-09-13T06:40:26.197 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:26.197 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:26.197 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:26.198 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660721+0000", 2024-09-13T06:40:26.198 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.678e-06 2024-09-13T06:40:26.198 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:26.198 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:26.198 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:26.198 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.785557+0000", 2024-09-13T06:40:26.198 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.12483633199999999 2024-09-13T06:40:26.198 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:26.198 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:26.198 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:26.198 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.785618+0000", 2024-09-13T06:40:26.198 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0686000000000001e-05 2024-09-13T06:40:26.198 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:26.199 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:26.199 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:26.199 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.785787+0000", 2024-09-13T06:40:26.199 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00016957699999999999 2024-09-13T06:40:26.199 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:26.199 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:26.199 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:26.199 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:26.199 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:26.199 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43254 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 315392~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:40:26.199 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.664717+0000", 2024-09-13T06:40:26.199 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 4.4711855309999997, 2024-09-13T06:40:26.199 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.12357108, 2024-09-13T06:40:26.200 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:26.200 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:26.200 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:26.200 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:26.200 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:26.200 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43254 2024-09-13T06:40:26.200 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:26.200 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:26.200 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:26.200 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:26.200 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664717+0000", 2024-09-13T06:40:26.200 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:26.200 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:26.201 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:26.201 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:26.201 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664717+0000", 2024-09-13T06:40:26.201 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:26.201 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:26.201 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:26.201 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:26.201 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664716+0000", 2024-09-13T06:40:26.201 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:26.201 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:26.201 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:26.201 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:26.201 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664724+0000", 2024-09-13T06:40:26.201 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.7109999999999995e-06 2024-09-13T06:40:26.202 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:26.202 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:26.202 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:26.202 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664732+0000", 2024-09-13T06:40:26.202 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.8399999999999995e-06 2024-09-13T06:40:26.202 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:26.202 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:26.202 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:26.202 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664738+0000", 2024-09-13T06:40:26.202 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.879e-06 2024-09-13T06:40:26.202 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:26.202 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:26.202 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:26.203 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.788018+0000", 2024-09-13T06:40:26.203 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123280719 2024-09-13T06:40:26.203 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:26.203 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:26.203 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:26.204 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.788119+0000", 2024-09-13T06:40:26.204 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000100558 2024-09-13T06:40:26.204 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:26.205 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:26.205 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:26.205 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.788288+0000", 2024-09-13T06:40:26.205 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000168751 2024-09-13T06:40:26.205 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:26.205 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:26.205 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:26.205 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:26.205 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:26.205 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43255 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 329728~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:40:26.205 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.664743+0000", 2024-09-13T06:40:26.205 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 4.471159535, 2024-09-13T06:40:26.205 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.12381711500000001, 2024-09-13T06:40:26.206 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:26.206 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:26.206 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:26.206 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:26.206 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:26.206 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43255 2024-09-13T06:40:26.206 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:26.206 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:26.206 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:26.206 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:26.206 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664743+0000", 2024-09-13T06:40:26.206 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:26.206 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:26.206 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:26.207 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:26.207 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664743+0000", 2024-09-13T06:40:26.207 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:26.207 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:26.207 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:26.207 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:26.207 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664742+0000", 2024-09-13T06:40:26.207 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:26.207 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:26.207 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:26.207 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:26.207 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664745+0000", 2024-09-13T06:40:26.207 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.7269999999999999e-06 2024-09-13T06:40:26.207 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:26.208 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:26.208 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:26.208 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664753+0000", 2024-09-13T06:40:26.208 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.8709999999999997e-06 2024-09-13T06:40:26.208 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:26.208 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:26.208 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:26.208 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664758+0000", 2024-09-13T06:40:26.208 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2220000000000001e-06 2024-09-13T06:40:26.208 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:26.208 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:26.208 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:26.209 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.788314+0000", 2024-09-13T06:40:26.209 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123555545 2024-09-13T06:40:26.209 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:26.209 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:26.209 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:26.209 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.788368+0000", 2024-09-13T06:40:26.209 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3928999999999998e-05 2024-09-13T06:40:26.209 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:26.209 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:26.209 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:26.209 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.788560+0000", 2024-09-13T06:40:26.209 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000192237 2024-09-13T06:40:26.210 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:26.210 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:26.210 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:26.210 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:26.210 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:26.210 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43256 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 344064~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:40:26.210 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.664763+0000", 2024-09-13T06:40:26.210 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 4.4711395889999999, 2024-09-13T06:40:26.210 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.12418359399999999, 2024-09-13T06:40:26.210 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:26.210 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:26.210 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:26.210 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:26.211 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:26.211 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43256 2024-09-13T06:40:26.211 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:26.211 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:26.211 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:26.211 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:26.211 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664763+0000", 2024-09-13T06:40:26.211 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:26.211 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:26.211 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:26.211 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:26.211 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664763+0000", 2024-09-13T06:40:26.212 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:26.212 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:26.212 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:26.212 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:26.212 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664762+0000", 2024-09-13T06:40:26.212 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:26.212 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:26.212 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:26.212 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:26.212 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664765+0000", 2024-09-13T06:40:26.212 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3290000000000001e-06 2024-09-13T06:40:26.212 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:26.213 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:26.213 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:26.213 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664771+0000", 2024-09-13T06:40:26.213 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.1319999999999999e-06 2024-09-13T06:40:26.213 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:26.213 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:26.213 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:26.213 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664776+0000", 2024-09-13T06:40:26.213 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.8840000000000002e-06 2024-09-13T06:40:26.213 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:26.213 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:26.214 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:26.214 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.788598+0000", 2024-09-13T06:40:26.214 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123821979 2024-09-13T06:40:26.214 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:26.214 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:26.214 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:26.214 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.788680+0000", 2024-09-13T06:40:26.214 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.2367999999999995e-05 2024-09-13T06:40:26.214 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:26.214 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:26.214 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:26.214 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.788946+0000", 2024-09-13T06:40:26.214 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00026629799999999999 2024-09-13T06:40:26.215 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:26.215 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:26.215 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:26.215 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:26.215 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:26.215 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43265 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 477184~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:40:26.215 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.669414+0000", 2024-09-13T06:40:26.215 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 4.4664879529999997, 2024-09-13T06:40:26.215 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123446973, 2024-09-13T06:40:26.215 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:26.215 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:26.215 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:26.216 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:26.216 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:26.216 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43265 2024-09-13T06:40:26.216 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:26.216 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:26.216 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:26.216 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:26.216 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669414+0000", 2024-09-13T06:40:26.216 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:26.216 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:26.216 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:26.216 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:26.216 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669414+0000", 2024-09-13T06:40:26.216 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:26.217 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:26.217 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:26.217 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:26.217 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669414+0000", 2024-09-13T06:40:26.217 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:26.217 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:26.217 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:26.217 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:26.217 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669416+0000", 2024-09-13T06:40:26.217 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.317e-06 2024-09-13T06:40:26.217 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:26.217 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:26.217 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:26.218 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669425+0000", 2024-09-13T06:40:26.218 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.0650000000000005e-06 2024-09-13T06:40:26.218 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:26.218 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:26.218 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:26.218 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669430+0000", 2024-09-13T06:40:26.218 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5079999999999999e-06 2024-09-13T06:40:26.218 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:26.218 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:26.218 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:26.218 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.792649+0000", 2024-09-13T06:40:26.218 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123219328 2024-09-13T06:40:26.219 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:26.219 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:26.219 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:26.219 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.792695+0000", 2024-09-13T06:40:26.219 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5476999999999998e-05 2024-09-13T06:40:26.219 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:26.219 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:26.219 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:26.219 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.792861+0000", 2024-09-13T06:40:26.219 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00016658999999999999 2024-09-13T06:40:26.219 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:26.219 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:26.219 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:26.219 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:26.220 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:26.220 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43266 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 491520~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:40:26.220 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.669434+0000", 2024-09-13T06:40:26.220 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 4.4664678310000001, 2024-09-13T06:40:26.220 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123685267, 2024-09-13T06:40:26.220 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:26.220 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:26.220 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:26.220 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:26.220 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:26.220 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43266 2024-09-13T06:40:26.220 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:26.220 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:26.221 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:26.221 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:26.221 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669434+0000", 2024-09-13T06:40:26.221 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:26.221 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:26.221 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:26.221 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:26.221 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669434+0000", 2024-09-13T06:40:26.221 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:26.221 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:26.221 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:26.221 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:26.221 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669434+0000", 2024-09-13T06:40:26.222 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:26.222 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:26.222 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:26.222 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:26.222 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669441+0000", 2024-09-13T06:40:26.222 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3019999999999997e-06 2024-09-13T06:40:26.222 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:26.222 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:26.222 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:26.222 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669451+0000", 2024-09-13T06:40:26.222 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.6379999999999999e-06 2024-09-13T06:40:26.222 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:26.223 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:26.223 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:26.223 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669456+0000", 2024-09-13T06:40:26.223 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.361e-06 2024-09-13T06:40:26.223 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:26.223 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:26.223 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:26.223 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.792879+0000", 2024-09-13T06:40:26.223 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123422686 2024-09-13T06:40:26.223 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:26.223 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:26.223 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:26.223 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.792923+0000", 2024-09-13T06:40:26.224 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4035000000000001e-05 2024-09-13T06:40:26.224 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:26.224 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:26.224 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:26.224 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.793120+0000", 2024-09-13T06:40:26.224 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00019660899999999999 2024-09-13T06:40:26.224 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:26.224 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:26.224 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:26.224 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:26.224 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:26.224 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43267 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 505856~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:40:26.224 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.669461+0000", 2024-09-13T06:40:26.225 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 4.4664410349999999, 2024-09-13T06:40:26.225 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123933711, 2024-09-13T06:40:26.225 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:26.225 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:26.225 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:26.225 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:26.225 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:26.225 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43267 2024-09-13T06:40:26.225 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:26.225 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:26.225 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:26.225 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:26.225 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669461+0000", 2024-09-13T06:40:26.225 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:26.226 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:26.226 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:26.226 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:26.226 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669461+0000", 2024-09-13T06:40:26.226 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:26.226 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:26.226 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:26.226 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:26.226 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669461+0000", 2024-09-13T06:40:26.226 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:26.226 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:26.226 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:26.226 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:26.227 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669463+0000", 2024-09-13T06:40:26.227 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5629999999999999e-06 2024-09-13T06:40:26.227 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:26.227 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:26.227 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:26.227 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669473+0000", 2024-09-13T06:40:26.227 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.9520000000000006e-06 2024-09-13T06:40:26.227 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:26.227 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:26.227 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:26.227 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669479+0000", 2024-09-13T06:40:26.227 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8540000000000002e-06 2024-09-13T06:40:26.227 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:26.227 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:26.228 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:26.228 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.793137+0000", 2024-09-13T06:40:26.228 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.12365825699999999 2024-09-13T06:40:26.228 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:26.228 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:26.228 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:26.228 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.793181+0000", 2024-09-13T06:40:26.228 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.3773999999999998e-05 2024-09-13T06:40:26.228 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:26.228 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:26.228 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:26.228 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.793395+0000", 2024-09-13T06:40:26.228 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00021372399999999999 2024-09-13T06:40:26.228 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:26.228 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:26.229 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:26.229 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:26.229 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:26.229 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43268 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 520192~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:40:26.229 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.669484+0000", 2024-09-13T06:40:26.229 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 4.4664182500000003, 2024-09-13T06:40:26.229 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.12441057899999999, 2024-09-13T06:40:26.229 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:26.229 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:26.229 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:26.229 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:26.229 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:26.229 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43268 2024-09-13T06:40:26.230 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:26.230 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:26.230 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:26.230 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:26.230 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669484+0000", 2024-09-13T06:40:26.230 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:26.230 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:26.230 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:26.230 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:26.230 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669484+0000", 2024-09-13T06:40:26.230 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:26.230 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:26.230 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:26.230 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:26.230 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669484+0000", 2024-09-13T06:40:26.231 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:26.231 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:26.231 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:26.231 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:26.231 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669486+0000", 2024-09-13T06:40:26.231 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6120000000000001e-06 2024-09-13T06:40:26.231 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:26.231 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:26.231 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:26.231 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669494+0000", 2024-09-13T06:40:26.231 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4819999999999997e-06 2024-09-13T06:40:26.231 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:26.231 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:26.231 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:26.232 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669497+0000", 2024-09-13T06:40:26.232 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9790000000000002e-06 2024-09-13T06:40:26.232 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:26.232 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:26.232 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:26.232 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.793559+0000", 2024-09-13T06:40:26.232 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.124062436 2024-09-13T06:40:26.232 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:26.232 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:26.232 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:26.232 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.793603+0000", 2024-09-13T06:40:26.232 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.3764999999999999e-05 2024-09-13T06:40:26.232 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:26.232 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:26.233 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:26.233 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.793895+0000", 2024-09-13T06:40:26.233 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00029168299999999999 2024-09-13T06:40:26.233 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:26.233 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:26.233 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:26.233 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:26.233 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:26.233 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:40:26.234 INFO:teuthology.orchestra.run.smithi081.stdout:2043 write 0xaa534e4 thru 0xaa5b5fd (0x811a bytes) 2024-09-13T06:40:26.234 INFO:teuthology.orchestra.run.smithi081.stdout:2044 writesame 0x56ef7b6 thru 0x56f24e0 data_size 0x1(0x2d2b bytes) 2024-09-13T06:40:26.235 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-13T06:40:26.237 INFO:teuthology.orchestra.run.smithi081.stdout:2045 write 0xeb62655 thru 0xeb670cb (0x4a77 bytes) 2024-09-13T06:40:26.240 INFO:teuthology.orchestra.run.smithi081.stdout:2046 write 0xab9b139 thru 0xaba95ed (0xe4b5 bytes) 2024-09-13T06:40:26.240 INFO:teuthology.orchestra.run.smithi081.stdout:2047 writesame 0x54bae79 thru 0x54c1070 data_size 0x6e(0x61f8 bytes) 2024-09-13T06:40:26.240 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:40:26.241 INFO:teuthology.orchestra.run.smithi081.stdout:2050 write 0x304c714 thru 0x305c1ce (0xfabb bytes) 2024-09-13T06:40:26.241 INFO:teuthology.orchestra.run.smithi081.stdout:2051 write 0x498aaac thru 0x49947ff (0x9d54 bytes) 2024-09-13T06:40:26.241 INFO:teuthology.orchestra.run.smithi081.stdout:2052 writesame 0xbeb1abb thru 0xbeb47ad data_size 0x1(0x2cf3 bytes) 2024-09-13T06:40:26.243 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-13T06:40:26.242+0000 7f86a5f06640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26387) UID: 0 2024-09-13T06:40:26.246 INFO:teuthology.orchestra.run.smithi081.stdout:2053 trunc from 0xeb670cc to 0x883afd1 2024-09-13T06:40:26.285 INFO:teuthology.orchestra.run.smithi081.stdout:2055 write 0xe9e54f0 thru 0xe9f3c2e (0xe73f bytes) 2024-09-13T06:40:26.316 INFO:teuthology.orchestra.run.smithi081.stdout:2057 trunc from 0xe9f3c2f to 0x1938be 2024-09-13T06:40:26.343 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:40:26.340+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:40:26.346 INFO:teuthology.orchestra.run.smithi081.stdout:2059 read 0x191e7b thru 0x1938bd (0x1a43 bytes) 2024-09-13T06:40:26.347 INFO:teuthology.orchestra.run.smithi081.stdout:2063 punch from 0xb2ffd to 0xc03f4, (0xd3f7 bytes) 2024-09-13T06:40:26.355 INFO:teuthology.orchestra.run.smithi081.stderr:noscrub is set 2024-09-13T06:40:26.365 INFO:teuthology.orchestra.run.smithi081.stdout:2064 writesame 0x21c2bfa thru 0x21ceeaa data_size 0x17(0xc2b1 bytes) 2024-09-13T06:40:26.392 INFO:teuthology.orchestra.run.smithi081.stdout:2066 write 0xd908042 thru 0xd909825 (0x17e4 bytes) 2024-09-13T06:40:26.397 INFO:teuthology.orchestra.run.smithi081.stdout:2067 punch from 0x42ce77 to 0x4307ee, (0x3977 bytes) 2024-09-13T06:40:26.397 INFO:teuthology.orchestra.run.smithi081.stdout:2069 clone 12 order 21 su 262144 sc 4 2024-09-13T06:40:26.405 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:40:26.406 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-13T06:40:26.406 INFO:teuthology.orchestra.run.smithi081.stdout: "num_ops": 0 2024-09-13T06:40:26.406 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:40:26.411 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-13T06:40:26.420 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-13T06:40:26.446 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:40:26.442+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:40:26.546 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:40:26.546+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:40:26.566 INFO:teuthology.orchestra.run.smithi081.stdout:osd.0: {} 2024-09-13T06:40:26.566 INFO:teuthology.orchestra.run.smithi081.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-13T06:40:26.596 INFO:teuthology.orchestra.run.smithi081.stdout:osd.1: {} 2024-09-13T06:40:26.597 INFO:teuthology.orchestra.run.smithi081.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-13T06:40:26.604 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:40:26.604 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:40:26.624 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-13T06:40:26.628 INFO:teuthology.orchestra.run.smithi081.stdout:osd.2: {} 2024-09-13T06:40:26.628 INFO:teuthology.orchestra.run.smithi081.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-13T06:40:26.645 INFO:teuthology.orchestra.run.smithi081.stdout:osd.3: {} 2024-09-13T06:40:26.645 INFO:teuthology.orchestra.run.smithi081.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-13T06:40:26.649 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:40:26.646+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:40:26.665 INFO:teuthology.orchestra.run.smithi081.stdout:osd.4: {} 2024-09-13T06:40:26.665 INFO:teuthology.orchestra.run.smithi081.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-13T06:40:26.685 INFO:teuthology.orchestra.run.smithi081.stdout:osd.5: {} 2024-09-13T06:40:26.685 INFO:teuthology.orchestra.run.smithi081.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-13T06:40:26.705 INFO:teuthology.orchestra.run.smithi081.stdout:osd.6: {} 2024-09-13T06:40:26.705 INFO:teuthology.orchestra.run.smithi081.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-13T06:40:26.725 INFO:teuthology.orchestra.run.smithi081.stdout:osd.7: {} 2024-09-13T06:40:26.725 INFO:teuthology.orchestra.run.smithi081.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-13T06:40:26.738 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:40:26.738 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:40:26.750 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-13T06:40:26.750+0000 7f86a5f06640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26387) UID: 0 2024-09-13T06:40:26.753 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-13T06:40:26.852 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:40:26.850+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:40:26.920 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:40:26.920 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:40:26.934 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-13T06:40:26.953 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:40:26.950+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:40:27.053 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:40:27.054+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:40:27.056 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:40:27.057 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:40:27.071 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-13T06:40:27.154 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:40:27.152+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:40:27.193 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:40:27.193 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:40:27.207 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-13T06:40:27.255 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:40:27.254+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:40:27.356 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:40:27.352+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:40:27.368 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:40:27.369 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:40:27.385 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-13T06:40:27.457 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:40:27.454+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:40:27.549 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:40:27.549 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:40:27.558 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:40:27.556+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:40:27.563 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-13T06:40:27.658 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-13T06:40:27.658+0000 7f86a5f06640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26387) UID: 0 2024-09-13T06:40:27.726 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:40:27.726 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:40:27.741 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-13T06:40:27.759 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:40:27.756+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:40:27.860 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:40:27.856+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:40:27.873 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:40:27.874 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:40:27.888 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-13T06:40:27.961 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:40:27.960+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:40:28.011 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:40:28.011 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:40:28.026 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-13T06:40:28.074 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:40:28.074+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:40:28.144 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:40:28.145 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:40:28.159 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-13T06:40:28.202 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:40:28.202+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:40:28.263 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:40:28.264+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:40:28.325 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:40:28.325 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:40:28.339 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-13T06:40:28.364 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:40:28.360+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:40:28.385 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-13T06:40:28.465 INFO:tasks.ceph.osd.6.smithi139.stderr:2024-09-13T06:40:28.462+0000 7fcd02c5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26385) UID: 0 2024-09-13T06:40:28.468 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:40:28.468 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:40:28.482 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-13T06:40:28.516 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6] out_osds: [7] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-13T06:40:28.516 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-13T06:40:28.517 INFO:tasks.thrashosds.thrasher:Adding osd 7 2024-09-13T06:40:28.517 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd in 7 2024-09-13T06:40:28.574 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-13T06:40:28.574+0000 7f86a5f06640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26387) UID: 0 2024-09-13T06:40:28.651 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:40:28.651 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:40:28.666 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-13T06:40:28.710 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:40:28.710+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:40:28.742 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-13T06:40:28.768 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-13T06:40:28.766+0000 7f86a5f06640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26387) UID: 0 2024-09-13T06:40:28.822 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-13T06:40:28.820+0000 7fcdeb9fe640 -1 mon.a@0(leader).osd e75 definitely_dead 0 2024-09-13T06:40:28.831 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:40:28.831 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:40:28.847 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-13T06:40:28.883 INFO:teuthology.orchestra.run.smithi081.stdout:osd.0: {} 2024-09-13T06:40:28.883 INFO:teuthology.orchestra.run.smithi081.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-13T06:40:28.890 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-13T06:40:28.890+0000 7f86a5f06640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26387) UID: 0 2024-09-13T06:40:28.899 INFO:teuthology.orchestra.run.smithi081.stdout:osd.1: {} 2024-09-13T06:40:28.899 INFO:teuthology.orchestra.run.smithi081.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-13T06:40:28.914 INFO:teuthology.orchestra.run.smithi081.stdout:osd.2: {} 2024-09-13T06:40:28.914 INFO:teuthology.orchestra.run.smithi081.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-13T06:40:28.930 INFO:teuthology.orchestra.run.smithi081.stdout:osd.3: {} 2024-09-13T06:40:28.930 INFO:teuthology.orchestra.run.smithi081.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-13T06:40:28.947 INFO:teuthology.orchestra.run.smithi081.stdout:osd.4: {} 2024-09-13T06:40:28.947 INFO:teuthology.orchestra.run.smithi081.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-13T06:40:28.965 INFO:teuthology.orchestra.run.smithi081.stdout:osd.5: {} 2024-09-13T06:40:28.966 INFO:teuthology.orchestra.run.smithi081.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-13T06:40:28.970 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:40:28.970+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:40:28.985 INFO:teuthology.orchestra.run.smithi081.stdout:osd.6: {} 2024-09-13T06:40:28.985 INFO:teuthology.orchestra.run.smithi081.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-13T06:40:29.005 INFO:teuthology.orchestra.run.smithi081.stdout:osd.7: {} 2024-09-13T06:40:29.005 INFO:teuthology.orchestra.run.smithi081.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-13T06:40:29.016 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:40:29.016 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [], 2024-09-13T06:40:29.016 INFO:teuthology.orchestra.run.smithi139.stdout: "complaint_time": 30, 2024-09-13T06:40:29.016 INFO:teuthology.orchestra.run.smithi139.stdout: "num_blocked_ops": 0 2024-09-13T06:40:29.016 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:40:29.030 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-13T06:40:29.074 INFO:tasks.ceph.osd.6.smithi139.stderr:2024-09-13T06:40:29.074+0000 7fcd02c5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26385) UID: 0 2024-09-13T06:40:29.172 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-13T06:40:29.170+0000 7f86a5f06640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26387) UID: 0 2024-09-13T06:40:29.199 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:40:29.199 INFO:teuthology.orchestra.run.smithi139.stdout: "size": 20, 2024-09-13T06:40:29.199 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 600, 2024-09-13T06:40:29.199 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [ 2024-09-13T06:40:29.200 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.200 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27854 3.a 3:537b3559:::rbd_data.1121f2c5ee81.0000000000000016:13 [read 335872~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:29.200 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.658750+0000", 2024-09-13T06:40:29.200 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 32.540637508000003, 2024-09-13T06:40:29.200 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.037969532, 2024-09-13T06:40:29.200 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:29.200 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:29.200 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:29.200 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:29.200 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:29.200 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27854 2024-09-13T06:40:29.200 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.201 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:29.201 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.201 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:29.201 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658750+0000", 2024-09-13T06:40:29.201 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:29.201 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.201 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.201 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:29.201 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658750+0000", 2024-09-13T06:40:29.201 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:29.201 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.201 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.201 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:29.202 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658749+0000", 2024-09-13T06:40:29.202 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:29.202 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.202 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.202 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:29.202 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658757+0000", 2024-09-13T06:40:29.202 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.7389999999999999e-06 2024-09-13T06:40:29.202 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.202 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.202 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:29.202 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658763+0000", 2024-09-13T06:40:29.203 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.7769999999999999e-06 2024-09-13T06:40:29.203 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.203 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.203 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:29.203 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658767+0000", 2024-09-13T06:40:29.203 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.1749999999999998e-06 2024-09-13T06:40:29.203 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.203 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.203 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:29.203 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.696322+0000", 2024-09-13T06:40:29.203 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.037554772 2024-09-13T06:40:29.204 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.204 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.204 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:29.204 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.696418+0000", 2024-09-13T06:40:29.204 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6050000000000004e-05 2024-09-13T06:40:29.204 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.204 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.204 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:29.204 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.696719+0000", 2024-09-13T06:40:29.204 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00030138499999999999 2024-09-13T06:40:29.204 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:29.204 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:29.204 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:29.204 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.205 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.205 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27855 3.a 3:537b3559:::rbd_data.1121f2c5ee81.0000000000000016:13 [read 380928~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:29.205 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.658771+0000", 2024-09-13T06:40:29.205 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 32.540616264000001, 2024-09-13T06:40:29.205 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.038326354, 2024-09-13T06:40:29.205 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:29.205 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:29.205 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:29.205 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:29.205 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:29.205 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27855 2024-09-13T06:40:29.205 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.205 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:29.206 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.206 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:29.206 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658771+0000", 2024-09-13T06:40:29.206 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:29.206 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.206 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.206 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:29.206 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658771+0000", 2024-09-13T06:40:29.206 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:29.206 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.206 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.206 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:29.206 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658770+0000", 2024-09-13T06:40:29.207 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:29.207 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.207 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.207 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:29.207 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658772+0000", 2024-09-13T06:40:29.207 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.0930000000000001e-06 2024-09-13T06:40:29.207 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.207 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.207 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:29.207 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658778+0000", 2024-09-13T06:40:29.207 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.2730000000000002e-06 2024-09-13T06:40:29.207 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.207 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.208 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:29.208 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658782+0000", 2024-09-13T06:40:29.208 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0879999999999997e-06 2024-09-13T06:40:29.208 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.208 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.208 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:29.208 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.696770+0000", 2024-09-13T06:40:29.208 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.037988145000000001 2024-09-13T06:40:29.208 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.208 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.208 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:29.208 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.696852+0000", 2024-09-13T06:40:29.208 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.2039999999999994e-05 2024-09-13T06:40:29.209 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.209 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.209 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:29.209 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.697097+0000", 2024-09-13T06:40:29.209 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00024508800000000002 2024-09-13T06:40:29.209 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:29.209 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:29.209 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:29.209 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.209 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.209 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27856 3.a 3:537b3559:::rbd_data.1121f2c5ee81.0000000000000016:13 [read 405504~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:29.209 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.658786+0000", 2024-09-13T06:40:29.209 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 32.540601148, 2024-09-13T06:40:29.209 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.038736029999999998, 2024-09-13T06:40:29.210 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:29.210 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:29.210 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:29.210 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:29.210 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:29.210 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27856 2024-09-13T06:40:29.210 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.210 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:29.210 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.210 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:29.210 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658786+0000", 2024-09-13T06:40:29.210 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:29.210 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.211 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.211 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:29.211 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658786+0000", 2024-09-13T06:40:29.211 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:29.211 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.211 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.211 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:29.211 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658785+0000", 2024-09-13T06:40:29.211 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:29.211 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.211 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.211 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:29.211 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658787+0000", 2024-09-13T06:40:29.211 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.0040000000000002e-06 2024-09-13T06:40:29.212 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.212 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.212 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:29.212 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658793+0000", 2024-09-13T06:40:29.212 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.2410000000000003e-06 2024-09-13T06:40:29.212 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.212 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.212 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:29.212 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658797+0000", 2024-09-13T06:40:29.212 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.1330000000000001e-06 2024-09-13T06:40:29.212 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.212 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.212 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:29.213 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.697176+0000", 2024-09-13T06:40:29.213 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.038379074999999999 2024-09-13T06:40:29.213 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.213 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.213 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:29.213 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.697275+0000", 2024-09-13T06:40:29.213 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.8819000000000004e-05 2024-09-13T06:40:29.213 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.213 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.213 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:29.213 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.697522+0000", 2024-09-13T06:40:29.213 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00024719999999999999 2024-09-13T06:40:29.213 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:29.214 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:29.214 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:29.214 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.214 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.214 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27857 3.a 3:537b3559:::rbd_data.1121f2c5ee81.0000000000000016:13 [read 475136~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:29.214 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.658845+0000", 2024-09-13T06:40:29.214 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 32.540542145000003, 2024-09-13T06:40:29.214 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039112570999999999, 2024-09-13T06:40:29.214 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:29.214 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:29.214 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:29.214 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:29.215 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:29.215 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27857 2024-09-13T06:40:29.215 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.215 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:29.215 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.215 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:29.215 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658845+0000", 2024-09-13T06:40:29.215 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:29.215 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.215 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.215 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:29.215 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658845+0000", 2024-09-13T06:40:29.215 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:29.215 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.216 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.216 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:29.216 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658844+0000", 2024-09-13T06:40:29.216 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999986 2024-09-13T06:40:29.216 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.216 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.216 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:29.216 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658868+0000", 2024-09-13T06:40:29.216 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.4615000000000001e-05 2024-09-13T06:40:29.216 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.216 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.216 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:29.216 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658884+0000", 2024-09-13T06:40:29.217 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5401999999999999e-05 2024-09-13T06:40:29.217 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.217 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.217 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:29.217 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658896+0000", 2024-09-13T06:40:29.217 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2509e-05 2024-09-13T06:40:29.217 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.217 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.217 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:29.217 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.697571+0000", 2024-09-13T06:40:29.217 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.038675107 2024-09-13T06:40:29.217 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.217 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.217 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:29.218 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.697658+0000", 2024-09-13T06:40:29.218 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6349999999999998e-05 2024-09-13T06:40:29.218 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.218 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.218 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:29.218 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.697957+0000", 2024-09-13T06:40:29.218 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00029986100000000001 2024-09-13T06:40:29.218 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:29.218 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:29.218 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:29.218 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.218 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.219 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27858 3.a 3:537b3559:::rbd_data.1121f2c5ee81.0000000000000016:13 [read 499712~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:29.219 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.658905+0000", 2024-09-13T06:40:29.219 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 32.540481595000003, 2024-09-13T06:40:29.219 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039475392999999998, 2024-09-13T06:40:29.219 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:29.219 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:29.219 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:29.219 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:29.219 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:29.219 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27858 2024-09-13T06:40:29.219 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.219 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:29.219 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.219 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:29.220 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658905+0000", 2024-09-13T06:40:29.220 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:29.220 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.220 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.220 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:29.220 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658905+0000", 2024-09-13T06:40:29.220 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:29.220 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.220 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.220 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:29.220 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658905+0000", 2024-09-13T06:40:29.220 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:29.220 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.221 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.221 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:29.221 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658909+0000", 2024-09-13T06:40:29.221 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.831e-06 2024-09-13T06:40:29.221 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.221 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.221 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:29.221 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658920+0000", 2024-09-13T06:40:29.221 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0936e-05 2024-09-13T06:40:29.221 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.221 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.221 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:29.221 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658929+0000", 2024-09-13T06:40:29.221 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.2749999999999995e-06 2024-09-13T06:40:29.222 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.222 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.222 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:29.222 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.697990+0000", 2024-09-13T06:40:29.222 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039061625000000003 2024-09-13T06:40:29.222 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.222 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.222 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:29.222 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.698077+0000", 2024-09-13T06:40:29.222 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6922000000000006e-05 2024-09-13T06:40:29.222 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.222 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.222 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:29.223 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.698381+0000", 2024-09-13T06:40:29.223 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00030360599999999999 2024-09-13T06:40:29.223 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:29.223 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:29.223 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:29.223 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.223 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.223 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27929 3.a 3:537b3559:::rbd_data.1121f2c5ee81.0000000000000016:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:29.223 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.659338+0000", 2024-09-13T06:40:29.223 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 32.540048763999998, 2024-09-13T06:40:29.223 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039351214000000002, 2024-09-13T06:40:29.223 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:29.224 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:29.224 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:29.224 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:29.224 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:29.224 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27929 2024-09-13T06:40:29.224 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.224 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:29.224 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.224 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:29.224 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.659338+0000", 2024-09-13T06:40:29.224 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:29.224 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.224 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.225 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:29.225 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.659338+0000", 2024-09-13T06:40:29.225 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:29.225 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.225 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.225 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:29.225 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.659337+0000", 2024-09-13T06:40:29.225 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:29.225 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.225 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.225 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:29.225 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.659342+0000", 2024-09-13T06:40:29.225 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0799999999999999e-06 2024-09-13T06:40:29.226 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.226 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.226 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:29.226 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.659353+0000", 2024-09-13T06:40:29.226 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1798e-05 2024-09-13T06:40:29.226 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.226 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.226 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:29.226 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.659361+0000", 2024-09-13T06:40:29.226 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.8040000000000002e-06 2024-09-13T06:40:29.226 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.226 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.226 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:29.227 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.698449+0000", 2024-09-13T06:40:29.227 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039087519000000001 2024-09-13T06:40:29.227 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.227 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.227 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:29.227 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.698567+0000", 2024-09-13T06:40:29.227 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00011857 2024-09-13T06:40:29.227 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.227 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.227 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:29.227 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.698689+0000", 2024-09-13T06:40:29.227 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00012226699999999999 2024-09-13T06:40:29.227 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:29.228 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:29.228 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:29.228 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.228 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.228 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27974 3.a 3:537b3559:::rbd_data.1121f2c5ee81.0000000000000016:13 [read 32768~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:29.228 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.660102+0000", 2024-09-13T06:40:29.228 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 32.539284995999999, 2024-09-13T06:40:29.228 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.038972346999999997, 2024-09-13T06:40:29.228 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:29.228 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:29.228 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:29.228 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:29.228 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:29.229 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27974 2024-09-13T06:40:29.229 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.229 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:29.229 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.229 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:29.229 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660102+0000", 2024-09-13T06:40:29.229 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:29.229 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.229 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.229 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:29.229 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660102+0000", 2024-09-13T06:40:29.229 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:29.229 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.230 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.230 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:29.230 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660100+0000", 2024-09-13T06:40:29.230 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999976 2024-09-13T06:40:29.230 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.230 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.230 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:29.230 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660114+0000", 2024-09-13T06:40:29.230 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.4466e-05 2024-09-13T06:40:29.230 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.230 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.230 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:29.230 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660148+0000", 2024-09-13T06:40:29.231 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.3742999999999999e-05 2024-09-13T06:40:29.231 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.231 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.231 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:29.231 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660170+0000", 2024-09-13T06:40:29.231 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.2518e-05 2024-09-13T06:40:29.231 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.231 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.231 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:29.231 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.698719+0000", 2024-09-13T06:40:29.231 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.038548529999999998 2024-09-13T06:40:29.231 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.231 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.232 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:29.232 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.698806+0000", 2024-09-13T06:40:29.232 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.7179e-05 2024-09-13T06:40:29.232 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.232 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.232 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:29.232 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.699074+0000", 2024-09-13T06:40:29.232 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00026834800000000001 2024-09-13T06:40:29.232 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:29.232 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:29.232 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:29.232 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.233 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.233 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27975 3.a 3:537b3559:::rbd_data.1121f2c5ee81.0000000000000016:13 [read 57344~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:29.233 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.660189+0000", 2024-09-13T06:40:29.233 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 32.539198151999997, 2024-09-13T06:40:29.233 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039288678, 2024-09-13T06:40:29.233 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:29.233 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:29.233 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:29.233 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:29.233 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:29.233 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27975 2024-09-13T06:40:29.234 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.234 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:29.234 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.234 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:29.234 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660189+0000", 2024-09-13T06:40:29.234 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:29.234 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.234 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.234 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:29.234 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660189+0000", 2024-09-13T06:40:29.234 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:29.234 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.235 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.235 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:29.235 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660187+0000", 2024-09-13T06:40:29.235 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999981 2024-09-13T06:40:29.235 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.235 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.235 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:29.235 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660195+0000", 2024-09-13T06:40:29.235 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5610000000000001e-06 2024-09-13T06:40:29.235 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.235 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.235 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:29.235 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660212+0000", 2024-09-13T06:40:29.236 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7725999999999999e-05 2024-09-13T06:40:29.236 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.236 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.236 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:29.236 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660227+0000", 2024-09-13T06:40:29.236 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.43e-05 2024-09-13T06:40:29.236 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.236 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.236 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:29.236 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.699135+0000", 2024-09-13T06:40:29.236 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.038908336000000002 2024-09-13T06:40:29.236 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.236 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.237 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:29.237 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.699208+0000", 2024-09-13T06:40:29.237 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.3065000000000006e-05 2024-09-13T06:40:29.237 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.237 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.237 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:29.237 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.699478+0000", 2024-09-13T06:40:29.237 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00026946899999999999 2024-09-13T06:40:29.237 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:29.237 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:29.237 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:29.237 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.237 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.237 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27976 3.a 3:537b3559:::rbd_data.1121f2c5ee81.0000000000000016:13 [read 102400~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:29.238 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.660238+0000", 2024-09-13T06:40:29.238 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 32.539148988999997, 2024-09-13T06:40:29.238 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039636515999999997, 2024-09-13T06:40:29.238 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:29.238 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:29.238 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:29.238 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:29.238 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:29.238 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27976 2024-09-13T06:40:29.238 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.238 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:29.238 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.238 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:29.239 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660238+0000", 2024-09-13T06:40:29.239 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:29.239 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.239 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.239 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:29.239 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660238+0000", 2024-09-13T06:40:29.239 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:29.239 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.239 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.239 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:29.239 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660237+0000", 2024-09-13T06:40:29.239 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:29.239 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.239 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.240 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:29.240 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660243+0000", 2024-09-13T06:40:29.240 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.9909999999999999e-06 2024-09-13T06:40:29.240 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.240 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.240 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:29.240 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660259+0000", 2024-09-13T06:40:29.240 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6294e-05 2024-09-13T06:40:29.240 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.240 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.240 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:29.240 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660272+0000", 2024-09-13T06:40:29.240 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2714999999999999e-05 2024-09-13T06:40:29.240 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.241 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.241 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:29.241 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.699513+0000", 2024-09-13T06:40:29.241 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039240932999999999 2024-09-13T06:40:29.241 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.241 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.241 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:29.241 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.699604+0000", 2024-09-13T06:40:29.241 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.1367999999999997e-05 2024-09-13T06:40:29.241 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.241 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.241 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:29.241 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.699875+0000", 2024-09-13T06:40:29.242 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00027029499999999999 2024-09-13T06:40:29.242 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:29.242 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:29.242 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:29.242 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.242 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.242 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27977 3.a 3:537b3559:::rbd_data.1121f2c5ee81.0000000000000016:13 [read 126976~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:29.242 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.660284+0000", 2024-09-13T06:40:29.242 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 32.539103417, 2024-09-13T06:40:29.242 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039969945, 2024-09-13T06:40:29.242 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:29.242 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:29.242 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:29.242 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:29.243 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:29.243 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27977 2024-09-13T06:40:29.243 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.243 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:29.243 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.243 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:29.243 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660284+0000", 2024-09-13T06:40:29.243 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:29.243 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.243 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.243 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:29.243 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660284+0000", 2024-09-13T06:40:29.243 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:29.244 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.244 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.244 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:29.244 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660282+0000", 2024-09-13T06:40:29.244 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999986 2024-09-13T06:40:29.244 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.244 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.244 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:29.244 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660288+0000", 2024-09-13T06:40:29.244 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.2650000000000002e-06 2024-09-13T06:40:29.244 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.244 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.245 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:29.245 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660304+0000", 2024-09-13T06:40:29.245 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5430999999999998e-05 2024-09-13T06:40:29.245 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.245 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.245 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:29.245 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660316+0000", 2024-09-13T06:40:29.245 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.237e-05 2024-09-13T06:40:29.245 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.245 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.245 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:29.245 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.699907+0000", 2024-09-13T06:40:29.245 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039590735000000002 2024-09-13T06:40:29.246 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.246 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.246 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:29.246 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.699994+0000", 2024-09-13T06:40:29.246 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6996999999999994e-05 2024-09-13T06:40:29.246 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.246 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.246 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:29.246 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700254+0000", 2024-09-13T06:40:29.246 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000259564 2024-09-13T06:40:29.246 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:29.246 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:29.246 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:29.246 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.247 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.247 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27978 3.a 3.9aacdeca (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:29.247 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.660327+0000", 2024-09-13T06:40:29.247 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 32.539059819000002, 2024-09-13T06:40:29.247 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039984858999999998, 2024-09-13T06:40:29.247 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:29.247 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:40:29.247 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:29.247 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:29.247 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:29.247 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27978 2024-09-13T06:40:29.247 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.247 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:29.248 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.248 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:29.248 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660327+0000", 2024-09-13T06:40:29.248 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:29.248 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.248 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.248 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:29.248 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660327+0000", 2024-09-13T06:40:29.248 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:29.248 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.248 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.248 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:29.248 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660326+0000", 2024-09-13T06:40:29.249 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:29.249 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.249 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.249 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:29.249 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660366+0000", 2024-09-13T06:40:29.249 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.9691000000000003e-05 2024-09-13T06:40:29.249 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.249 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.249 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:29.249 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660399+0000", 2024-09-13T06:40:29.249 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.3262000000000001e-05 2024-09-13T06:40:29.249 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.249 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.250 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:29.250 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660414+0000", 2024-09-13T06:40:29.250 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.4775e-05 2024-09-13T06:40:29.250 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.250 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.250 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:29.250 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700298+0000", 2024-09-13T06:40:29.250 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039883759999999997 2024-09-13T06:40:29.250 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.250 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.250 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:29.250 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700312+0000", 2024-09-13T06:40:29.250 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.4374e-05 2024-09-13T06:40:29.251 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:29.251 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:29.251 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:29.251 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.251 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.251 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27979 3.a 3.9aacdeca (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:29.251 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.660429+0000", 2024-09-13T06:40:29.251 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 32.538957951, 2024-09-13T06:40:29.251 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039921361000000002, 2024-09-13T06:40:29.251 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:29.251 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:40:29.251 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:29.252 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:29.252 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:29.252 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27979 2024-09-13T06:40:29.252 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.252 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:29.253 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.253 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:29.253 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660429+0000", 2024-09-13T06:40:29.253 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:29.253 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.254 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.254 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:29.254 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660429+0000", 2024-09-13T06:40:29.254 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:29.254 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.254 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.254 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:29.255 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660428+0000", 2024-09-13T06:40:29.256 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999986 2024-09-13T06:40:29.256 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.256 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.256 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:29.256 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660434+0000", 2024-09-13T06:40:29.256 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.8190000000000003e-06 2024-09-13T06:40:29.256 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.256 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.256 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:29.256 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660451+0000", 2024-09-13T06:40:29.256 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6963e-05 2024-09-13T06:40:29.256 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.256 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.257 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:29.257 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660485+0000", 2024-09-13T06:40:29.257 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.3414000000000002e-05 2024-09-13T06:40:29.257 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.257 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.257 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:29.257 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700342+0000", 2024-09-13T06:40:29.257 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039857278000000003 2024-09-13T06:40:29.257 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.257 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.257 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:29.257 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700350+0000", 2024-09-13T06:40:29.257 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.2930000000000001e-06 2024-09-13T06:40:29.258 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:29.258 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:29.258 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:29.258 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.258 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.258 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27980 3.a 3.9aacdeca (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:29.258 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.660497+0000", 2024-09-13T06:40:29.258 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 32.538889740000002, 2024-09-13T06:40:29.258 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039888034000000003, 2024-09-13T06:40:29.258 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:29.258 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:40:29.258 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:29.258 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:29.259 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:29.259 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27980 2024-09-13T06:40:29.259 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.259 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:29.259 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.259 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:29.259 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660497+0000", 2024-09-13T06:40:29.259 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:29.259 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.259 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.259 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:29.259 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660497+0000", 2024-09-13T06:40:29.259 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:29.259 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.260 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.260 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:29.260 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660496+0000", 2024-09-13T06:40:29.260 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:29.260 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.260 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.260 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:29.260 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660503+0000", 2024-09-13T06:40:29.260 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.4110000000000001e-06 2024-09-13T06:40:29.260 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.260 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.260 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:29.260 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660519+0000", 2024-09-13T06:40:29.260 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6180000000000001e-05 2024-09-13T06:40:29.261 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.261 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.261 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:29.261 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660544+0000", 2024-09-13T06:40:29.261 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.5177999999999998e-05 2024-09-13T06:40:29.261 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.261 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.261 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:29.261 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700377+0000", 2024-09-13T06:40:29.261 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039833434000000001 2024-09-13T06:40:29.261 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.261 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.261 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:29.261 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700385+0000", 2024-09-13T06:40:29.262 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.8800000000000008e-06 2024-09-13T06:40:29.262 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:29.262 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:29.262 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:29.262 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.262 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.262 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27981 3.a 3.9aacdeca (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:29.262 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.660556+0000", 2024-09-13T06:40:29.262 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 32.538831393999999, 2024-09-13T06:40:29.262 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039869989000000002, 2024-09-13T06:40:29.262 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:29.262 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:40:29.262 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:29.263 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:29.263 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:29.263 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27981 2024-09-13T06:40:29.263 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.263 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:29.263 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.263 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:29.263 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660556+0000", 2024-09-13T06:40:29.263 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:29.263 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.263 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.263 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:29.263 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660556+0000", 2024-09-13T06:40:29.263 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:29.264 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.264 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.264 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:29.264 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660555+0000", 2024-09-13T06:40:29.264 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:29.264 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.264 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.264 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:29.264 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660561+0000", 2024-09-13T06:40:29.264 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.088e-06 2024-09-13T06:40:29.264 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.264 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.264 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:29.265 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660577+0000", 2024-09-13T06:40:29.265 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6147999999999999e-05 2024-09-13T06:40:29.265 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.265 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.265 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:29.265 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660589+0000", 2024-09-13T06:40:29.265 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2551999999999999e-05 2024-09-13T06:40:29.265 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.265 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.265 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:29.265 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700414+0000", 2024-09-13T06:40:29.265 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039825007000000003 2024-09-13T06:40:29.265 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.265 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.266 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:29.266 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700426+0000", 2024-09-13T06:40:29.266 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1265e-05 2024-09-13T06:40:29.266 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:29.266 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:29.266 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:29.266 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.266 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.266 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27982 3.a 3.9aacdeca (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:29.266 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.660603+0000", 2024-09-13T06:40:29.266 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 32.538783799000001, 2024-09-13T06:40:29.266 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039874779999999999, 2024-09-13T06:40:29.266 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:29.266 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:40:29.267 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:29.267 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:29.267 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:29.267 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27982 2024-09-13T06:40:29.267 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.267 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:29.268 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.268 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:29.268 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660603+0000", 2024-09-13T06:40:29.268 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:29.268 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.268 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.268 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:29.268 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660603+0000", 2024-09-13T06:40:29.268 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:29.268 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.268 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.268 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:29.268 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660602+0000", 2024-09-13T06:40:29.269 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:29.269 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.269 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.269 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:29.269 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660653+0000", 2024-09-13T06:40:29.269 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.0862000000000002e-05 2024-09-13T06:40:29.269 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.269 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.269 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:29.269 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660697+0000", 2024-09-13T06:40:29.269 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.3773000000000003e-05 2024-09-13T06:40:29.269 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.269 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.270 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:29.270 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660712+0000", 2024-09-13T06:40:29.270 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5464999999999998e-05 2024-09-13T06:40:29.270 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.270 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.270 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:29.270 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700469+0000", 2024-09-13T06:40:29.270 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039756503999999998 2024-09-13T06:40:29.270 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.270 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.270 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:29.270 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700478+0000", 2024-09-13T06:40:29.270 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.1730000000000001e-06 2024-09-13T06:40:29.270 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:29.271 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:29.271 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:29.271 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.271 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.271 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27983 3.a 3.9aacdeca (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:29.271 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.660726+0000", 2024-09-13T06:40:29.271 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 32.538660524000001, 2024-09-13T06:40:29.271 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039804357999999998, 2024-09-13T06:40:29.271 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:29.271 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:40:29.271 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:29.271 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:29.271 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:29.271 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27983 2024-09-13T06:40:29.272 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.272 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:29.272 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.272 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:29.272 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660726+0000", 2024-09-13T06:40:29.272 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:29.272 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.272 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.272 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:29.272 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660726+0000", 2024-09-13T06:40:29.272 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:29.272 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.272 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.272 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:29.273 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660725+0000", 2024-09-13T06:40:29.273 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999986 2024-09-13T06:40:29.273 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.273 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.273 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:29.273 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660733+0000", 2024-09-13T06:40:29.273 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.9359999999999999e-06 2024-09-13T06:40:29.273 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.273 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.273 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:29.273 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660751+0000", 2024-09-13T06:40:29.273 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7679000000000001e-05 2024-09-13T06:40:29.273 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.273 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.274 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:29.274 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660764+0000", 2024-09-13T06:40:29.274 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3112000000000001e-05 2024-09-13T06:40:29.274 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.274 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.274 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:29.274 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700516+0000", 2024-09-13T06:40:29.274 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039752183000000003 2024-09-13T06:40:29.274 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.274 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.274 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:29.274 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700531+0000", 2024-09-13T06:40:29.274 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.4732999999999999e-05 2024-09-13T06:40:29.274 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:29.275 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:29.275 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:29.275 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.275 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.275 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27984 3.a 3.9aacdeca (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:29.275 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.660776+0000", 2024-09-13T06:40:29.275 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 32.538611420999999, 2024-09-13T06:40:29.275 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039795697999999997, 2024-09-13T06:40:29.275 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:29.275 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:40:29.275 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:29.275 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:29.275 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:29.276 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27984 2024-09-13T06:40:29.276 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.276 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:29.276 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.276 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:29.276 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660776+0000", 2024-09-13T06:40:29.276 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:29.276 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.276 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.276 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:29.276 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660776+0000", 2024-09-13T06:40:29.276 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:29.276 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.276 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.277 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:29.277 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660775+0000", 2024-09-13T06:40:29.277 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:29.277 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.277 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.277 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:29.277 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660780+0000", 2024-09-13T06:40:29.277 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.7849999999999997e-06 2024-09-13T06:40:29.277 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.277 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.277 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:29.277 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660799+0000", 2024-09-13T06:40:29.277 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.8794e-05 2024-09-13T06:40:29.278 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.278 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.278 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:29.278 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660812+0000", 2024-09-13T06:40:29.278 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3029e-05 2024-09-13T06:40:29.278 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.278 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.278 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:29.278 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700562+0000", 2024-09-13T06:40:29.278 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039749984000000002 2024-09-13T06:40:29.278 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.278 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.278 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:29.278 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700571+0000", 2024-09-13T06:40:29.279 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.1260000000000004e-06 2024-09-13T06:40:29.279 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:29.279 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:29.279 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:29.279 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.279 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.279 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27985 3.a 3.9aacdeca (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:29.279 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.660824+0000", 2024-09-13T06:40:29.279 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 32.538563369000002, 2024-09-13T06:40:29.279 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039784462, 2024-09-13T06:40:29.279 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:29.279 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:40:29.279 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:29.280 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:29.280 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:29.280 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27985 2024-09-13T06:40:29.280 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.280 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:29.280 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.280 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:29.280 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660824+0000", 2024-09-13T06:40:29.280 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:29.280 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.280 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.280 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:29.280 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660824+0000", 2024-09-13T06:40:29.280 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:29.281 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.281 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.281 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:29.281 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660823+0000", 2024-09-13T06:40:29.281 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:29.281 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.281 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.281 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:29.281 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660829+0000", 2024-09-13T06:40:29.281 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.9440000000000002e-06 2024-09-13T06:40:29.281 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.281 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.281 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:29.281 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660922+0000", 2024-09-13T06:40:29.282 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.2958e-05 2024-09-13T06:40:29.282 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.282 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.282 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:29.282 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660964+0000", 2024-09-13T06:40:29.282 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.2407000000000002e-05 2024-09-13T06:40:29.282 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.282 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.282 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:29.282 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700600+0000", 2024-09-13T06:40:29.282 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039635581000000003 2024-09-13T06:40:29.282 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.282 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.282 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:29.283 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700608+0000", 2024-09-13T06:40:29.283 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.5890000000000003e-06 2024-09-13T06:40:29.283 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:29.283 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:29.283 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:29.283 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.283 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.283 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:28023 3.10 3:0dedc28a:::rbd_data.1121f2c5ee81.0000000000000019:13 [read 475136~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:29.283 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.662072+0000", 2024-09-13T06:40:29.283 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 32.537315384000003, 2024-09-13T06:40:29.283 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.038086508999999998, 2024-09-13T06:40:29.283 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:29.283 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:29.284 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:29.284 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:29.284 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:29.284 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 28023 2024-09-13T06:40:29.284 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.284 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:29.284 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.284 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:29.284 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.662072+0000", 2024-09-13T06:40:29.284 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:29.284 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.284 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.284 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:29.284 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.662072+0000", 2024-09-13T06:40:29.285 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:29.285 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.285 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.285 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:29.285 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.662070+0000", 2024-09-13T06:40:29.285 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999986 2024-09-13T06:40:29.285 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.285 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.285 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:29.285 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.662076+0000", 2024-09-13T06:40:29.285 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.139e-06 2024-09-13T06:40:29.285 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.285 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.285 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:29.286 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.662094+0000", 2024-09-13T06:40:29.286 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7136999999999999e-05 2024-09-13T06:40:29.286 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.286 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.286 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:29.286 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.662124+0000", 2024-09-13T06:40:29.286 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.0528999999999999e-05 2024-09-13T06:40:29.286 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.286 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.286 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:29.286 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.699843+0000", 2024-09-13T06:40:29.286 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.037718415999999998 2024-09-13T06:40:29.286 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.286 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.287 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:29.287 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.699931+0000", 2024-09-13T06:40:29.287 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.8345999999999997e-05 2024-09-13T06:40:29.287 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.287 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.287 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:29.287 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700158+0000", 2024-09-13T06:40:29.287 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00022723099999999999 2024-09-13T06:40:29.287 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:29.287 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:29.287 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:29.287 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.287 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.287 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:28024 3.10 3.5143b7b0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:29.288 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.662137+0000", 2024-09-13T06:40:29.288 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 32.537249862000003, 2024-09-13T06:40:29.288 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.038056092999999999, 2024-09-13T06:40:29.288 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:29.288 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:40:29.288 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:29.288 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:29.288 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:29.288 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 28024 2024-09-13T06:40:29.288 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.288 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:29.288 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.288 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:29.289 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.662137+0000", 2024-09-13T06:40:29.289 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:29.289 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.289 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.289 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:29.289 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.662137+0000", 2024-09-13T06:40:29.289 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:29.289 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.289 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.289 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:29.289 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.662136+0000", 2024-09-13T06:40:29.289 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999986 2024-09-13T06:40:29.289 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.289 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.290 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:29.290 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.662142+0000", 2024-09-13T06:40:29.290 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.6930000000000001e-06 2024-09-13T06:40:29.290 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.290 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.290 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:29.290 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.662160+0000", 2024-09-13T06:40:29.290 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7863000000000002e-05 2024-09-13T06:40:29.290 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.290 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.290 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:29.290 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.662189+0000", 2024-09-13T06:40:29.290 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.8486000000000001e-05 2024-09-13T06:40:29.290 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.291 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.291 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:29.291 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700187+0000", 2024-09-13T06:40:29.291 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.037998331000000003 2024-09-13T06:40:29.291 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.291 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.291 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:29.291 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700193+0000", 2024-09-13T06:40:29.291 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.0909999999999998e-06 2024-09-13T06:40:29.291 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:29.291 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:29.291 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:29.291 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:29.292 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:29.292 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:40:29.293 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-13T06:40:29.294 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:40:29.290+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:40:29.367 INFO:teuthology.orchestra.run.smithi081.stderr:marked in osd.7. 2024-09-13T06:40:29.371 INFO:teuthology.orchestra.run.smithi081.stderr:nodeep-scrub is set 2024-09-13T06:40:29.394 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-13T06:40:29.390+0000 7f86a5f06640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26387) UID: 0 2024-09-13T06:40:29.402 INFO:tasks.thrashosds.thrasher:Added osd 7 2024-09-13T06:40:29.469 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:40:29.470 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [], 2024-09-13T06:40:29.470 INFO:teuthology.orchestra.run.smithi139.stdout: "num_ops": 0 2024-09-13T06:40:29.470 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:40:29.484 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-13T06:40:29.494 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:40:29.492+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:40:29.595 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:40:29.594+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:40:29.652 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:40:29.653 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [], 2024-09-13T06:40:29.653 INFO:teuthology.orchestra.run.smithi139.stdout: "complaint_time": 30, 2024-09-13T06:40:29.653 INFO:teuthology.orchestra.run.smithi139.stdout: "num_blocked_ops": 0 2024-09-13T06:40:29.653 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:40:29.667 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-13T06:40:29.696 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:40:29.692+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:40:29.798 INFO:tasks.ceph.osd.6.smithi139.stderr:2024-09-13T06:40:29.794+0000 7fcd02c5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26385) UID: 0 2024-09-13T06:40:29.840 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:40:29.840 INFO:teuthology.orchestra.run.smithi139.stdout: "size": 20, 2024-09-13T06:40:29.840 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 600, 2024-09-13T06:40:29.841 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [ 2024-09-13T06:40:29.841 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.841 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4154.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-13T06:40:29.841 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:11.143816+0000", 2024-09-13T06:40:29.841 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 78.695212753000007, 2024-09-13T06:40:29.841 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.062483034, 2024-09-13T06:40:29.841 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:29.842 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:40:29.842 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:29.842 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4154", 2024-09-13T06:40:29.842 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/2406930292", 2024-09-13T06:40:29.842 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 1 2024-09-13T06:40:29.842 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.842 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:29.843 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.843 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:29.843 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.143816+0000", 2024-09-13T06:40:29.843 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:29.843 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.843 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.843 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:29.844 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.143816+0000", 2024-09-13T06:40:29.844 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:29.844 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.844 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.844 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:29.844 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.143814+0000", 2024-09-13T06:40:29.844 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999976 2024-09-13T06:40:29.845 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.845 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.845 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:29.845 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.143829+0000", 2024-09-13T06:40:29.845 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5316999999999999e-05 2024-09-13T06:40:29.845 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.845 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.845 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:29.846 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.143851+0000", 2024-09-13T06:40:29.846 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.1736999999999999e-05 2024-09-13T06:40:29.846 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.846 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.846 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:29.846 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.143870+0000", 2024-09-13T06:40:29.846 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.9185999999999999e-05 2024-09-13T06:40:29.847 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.847 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.847 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:29.847 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.143973+0000", 2024-09-13T06:40:29.847 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000102896 2024-09-13T06:40:29.847 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.847 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.848 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:40:29.848 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.143987+0000", 2024-09-13T06:40:29.848 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.401e-05 2024-09-13T06:40:29.848 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.848 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.848 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:29.849 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.203333+0000", 2024-09-13T06:40:29.849 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.059346614999999998 2024-09-13T06:40:29.849 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.849 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.849 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:29.849 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.203624+0000", 2024-09-13T06:40:29.850 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00029112700000000002 2024-09-13T06:40:29.850 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.850 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.850 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 0", 2024-09-13T06:40:29.850 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.203940+0000", 2024-09-13T06:40:29.851 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00031547200000000002 2024-09-13T06:40:29.851 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.851 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.851 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-13T06:40:29.851 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.205145+0000", 2024-09-13T06:40:29.851 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0012048930000000001 2024-09-13T06:40:29.851 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.851 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.851 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:40:29.852 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.206110+0000", 2024-09-13T06:40:29.852 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00096536600000000005 2024-09-13T06:40:29.852 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.852 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.852 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-13T06:40:29.852 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.206196+0000", 2024-09-13T06:40:29.852 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.5798999999999996e-05 2024-09-13T06:40:29.853 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.853 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.853 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:29.853 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.206299+0000", 2024-09-13T06:40:29.853 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00010279 2024-09-13T06:40:29.853 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:29.853 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:29.853 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:29.854 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.854 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.854 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4154.0:36 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-13T06:40:29.854 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:11.257357+0000", 2024-09-13T06:40:29.854 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 78.581671310000004, 2024-09-13T06:40:29.854 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.012807595, 2024-09-13T06:40:29.854 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:29.854 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:40:29.854 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:29.855 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4154", 2024-09-13T06:40:29.855 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/2406930292", 2024-09-13T06:40:29.855 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 36 2024-09-13T06:40:29.855 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.855 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:29.855 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.855 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:29.855 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.257357+0000", 2024-09-13T06:40:29.855 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:29.855 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.855 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.856 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:29.856 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.257357+0000", 2024-09-13T06:40:29.856 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:29.856 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.856 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.856 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:29.856 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.257356+0000", 2024-09-13T06:40:29.856 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:29.856 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.856 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.857 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:29.857 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.257378+0000", 2024-09-13T06:40:29.857 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.1988999999999999e-05 2024-09-13T06:40:29.857 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.857 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.857 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:29.857 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.257389+0000", 2024-09-13T06:40:29.857 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0343000000000001e-05 2024-09-13T06:40:29.857 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.857 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.857 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:29.858 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.257396+0000", 2024-09-13T06:40:29.858 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5839999999999997e-06 2024-09-13T06:40:29.858 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.858 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.858 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:29.858 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.264748+0000", 2024-09-13T06:40:29.858 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0073514640000000003 2024-09-13T06:40:29.858 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.858 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.858 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:29.858 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.264878+0000", 2024-09-13T06:40:29.858 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00012975500000000001 2024-09-13T06:40:29.859 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.859 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.859 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 0", 2024-09-13T06:40:29.859 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.265064+0000", 2024-09-13T06:40:29.859 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000186799 2024-09-13T06:40:29.859 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.859 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.859 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:40:29.859 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.267248+0000", 2024-09-13T06:40:29.859 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0021841230000000001 2024-09-13T06:40:29.859 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.860 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.860 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-13T06:40:29.860 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.269996+0000", 2024-09-13T06:40:29.860 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0027473419999999998 2024-09-13T06:40:29.860 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.860 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.860 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-13T06:40:29.860 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.270066+0000", 2024-09-13T06:40:29.860 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.0683000000000001e-05 2024-09-13T06:40:29.860 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.860 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.861 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:29.861 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.270165+0000", 2024-09-13T06:40:29.861 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.8319000000000005e-05 2024-09-13T06:40:29.861 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:29.861 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:29.861 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:29.861 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.861 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.861 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4154.0:37 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-13T06:40:29.861 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:11.257405+0000", 2024-09-13T06:40:29.861 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 78.581623129999997, 2024-09-13T06:40:29.861 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.012930476999999999, 2024-09-13T06:40:29.862 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:29.862 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:40:29.862 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:29.862 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4154", 2024-09-13T06:40:29.862 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/2406930292", 2024-09-13T06:40:29.862 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 37 2024-09-13T06:40:29.862 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.862 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:29.862 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.862 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:29.863 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.257405+0000", 2024-09-13T06:40:29.863 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:29.863 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.863 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.863 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:29.863 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.257405+0000", 2024-09-13T06:40:29.863 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:29.863 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.863 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.863 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:29.863 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.257405+0000", 2024-09-13T06:40:29.863 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:29.864 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.864 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.864 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:29.864 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.257411+0000", 2024-09-13T06:40:29.864 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.1500000000000004e-06 2024-09-13T06:40:29.864 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.864 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.864 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:29.864 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.257420+0000", 2024-09-13T06:40:29.864 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.986e-06 2024-09-13T06:40:29.864 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.864 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.865 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:29.865 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.257436+0000", 2024-09-13T06:40:29.865 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6433999999999999e-05 2024-09-13T06:40:29.865 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.865 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.865 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:29.865 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.265923+0000", 2024-09-13T06:40:29.865 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0084872009999999998 2024-09-13T06:40:29.865 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.865 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.865 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:29.865 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.266056+0000", 2024-09-13T06:40:29.865 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00013206599999999999 2024-09-13T06:40:29.866 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.866 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.866 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 0", 2024-09-13T06:40:29.866 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.266255+0000", 2024-09-13T06:40:29.866 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00019935100000000001 2024-09-13T06:40:29.866 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.866 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.866 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:40:29.866 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.267788+0000", 2024-09-13T06:40:29.866 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0015335380000000001 2024-09-13T06:40:29.866 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.867 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.867 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-13T06:40:29.867 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.270181+0000", 2024-09-13T06:40:29.867 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.002392136 2024-09-13T06:40:29.867 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.867 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.867 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-13T06:40:29.867 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.270245+0000", 2024-09-13T06:40:29.867 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.4401999999999998e-05 2024-09-13T06:40:29.867 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.867 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.867 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:29.867 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.270336+0000", 2024-09-13T06:40:29.867 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.0872999999999995e-05 2024-09-13T06:40:29.868 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:29.868 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:29.868 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:29.868 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.868 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.868 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4154.0:88 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-13T06:40:29.868 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:11.362174+0000", 2024-09-13T06:40:29.868 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 78.476854521999996, 2024-09-13T06:40:29.868 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.012171276, 2024-09-13T06:40:29.868 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:29.868 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:40:29.868 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:29.868 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4154", 2024-09-13T06:40:29.869 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/2406930292", 2024-09-13T06:40:29.869 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 88 2024-09-13T06:40:29.869 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.869 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:29.869 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.869 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:29.869 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.362174+0000", 2024-09-13T06:40:29.870 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:29.870 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.871 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.871 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:29.871 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.362174+0000", 2024-09-13T06:40:29.871 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:29.871 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.871 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.871 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:29.871 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.362172+0000", 2024-09-13T06:40:29.871 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999986 2024-09-13T06:40:29.871 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.871 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.872 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:29.872 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.362183+0000", 2024-09-13T06:40:29.872 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.081e-05 2024-09-13T06:40:29.872 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.872 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.872 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:29.872 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.362205+0000", 2024-09-13T06:40:29.872 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.1897000000000001e-05 2024-09-13T06:40:29.872 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.872 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.872 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:29.872 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.362221+0000", 2024-09-13T06:40:29.872 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5353e-05 2024-09-13T06:40:29.873 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.873 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.873 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:29.873 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.369202+0000", 2024-09-13T06:40:29.873 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0069816219999999998 2024-09-13T06:40:29.873 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.873 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.873 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:29.873 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.369323+0000", 2024-09-13T06:40:29.873 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000121156 2024-09-13T06:40:29.874 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.874 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.874 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 0", 2024-09-13T06:40:29.874 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.369683+0000", 2024-09-13T06:40:29.874 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00035930700000000001 2024-09-13T06:40:29.874 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.874 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.874 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:40:29.874 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.371448+0000", 2024-09-13T06:40:29.874 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.001765043 2024-09-13T06:40:29.875 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.875 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.875 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-13T06:40:29.875 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.374156+0000", 2024-09-13T06:40:29.875 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.002707999 2024-09-13T06:40:29.875 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.875 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.875 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-13T06:40:29.875 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.374243+0000", 2024-09-13T06:40:29.875 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6873000000000007e-05 2024-09-13T06:40:29.875 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.875 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.875 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:29.875 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.374345+0000", 2024-09-13T06:40:29.876 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00010272600000000001 2024-09-13T06:40:29.876 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:29.876 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:29.876 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:29.876 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.876 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.876 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4154.0:108 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-13T06:40:29.876 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:11.524074+0000", 2024-09-13T06:40:29.876 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 78.314954517999993, 2024-09-13T06:40:29.876 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.012736235, 2024-09-13T06:40:29.876 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:29.876 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:40:29.876 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:29.877 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4154", 2024-09-13T06:40:29.877 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/2406930292", 2024-09-13T06:40:29.877 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 108 2024-09-13T06:40:29.877 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.877 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:29.877 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.877 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:29.877 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.524074+0000", 2024-09-13T06:40:29.877 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:29.877 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.877 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.877 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:29.877 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.524074+0000", 2024-09-13T06:40:29.878 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:29.878 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.878 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.878 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:29.878 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.524073+0000", 2024-09-13T06:40:29.878 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:29.878 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.878 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.878 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:29.878 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.524084+0000", 2024-09-13T06:40:29.878 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1026000000000001e-05 2024-09-13T06:40:29.878 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.878 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.879 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:29.879 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.524102+0000", 2024-09-13T06:40:29.879 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7992999999999999e-05 2024-09-13T06:40:29.879 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.879 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.879 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:29.879 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.524140+0000", 2024-09-13T06:40:29.879 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.8277e-05 2024-09-13T06:40:29.879 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.880 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.880 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:29.880 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.528884+0000", 2024-09-13T06:40:29.880 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.004743761 2024-09-13T06:40:29.880 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.880 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.880 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:29.881 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.529006+0000", 2024-09-13T06:40:29.881 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000121829 2024-09-13T06:40:29.881 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.881 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.881 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 0", 2024-09-13T06:40:29.881 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.529196+0000", 2024-09-13T06:40:29.881 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000189731 2024-09-13T06:40:29.881 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.881 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.881 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:40:29.881 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.535697+0000", 2024-09-13T06:40:29.881 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0065011499999999998 2024-09-13T06:40:29.882 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.882 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.882 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-13T06:40:29.882 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.536644+0000", 2024-09-13T06:40:29.882 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00094732900000000001 2024-09-13T06:40:29.882 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.882 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.882 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-13T06:40:29.882 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.536712+0000", 2024-09-13T06:40:29.882 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.8303e-05 2024-09-13T06:40:29.882 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.882 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.882 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:29.882 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.536810+0000", 2024-09-13T06:40:29.883 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.7918999999999995e-05 2024-09-13T06:40:29.883 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:29.883 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:29.883 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:29.883 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.883 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.883 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4154.0:109 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-13T06:40:29.883 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:11.524169+0000", 2024-09-13T06:40:29.883 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 78.314859592000005, 2024-09-13T06:40:29.883 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.013995285999999999, 2024-09-13T06:40:29.883 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:29.884 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:40:29.884 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:29.884 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4154", 2024-09-13T06:40:29.884 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/2406930292", 2024-09-13T06:40:29.884 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 109 2024-09-13T06:40:29.884 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.884 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:29.884 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.884 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:29.884 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.524169+0000", 2024-09-13T06:40:29.884 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:29.885 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.885 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.888 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:29.888 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.524169+0000", 2024-09-13T06:40:29.888 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:29.889 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.889 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.889 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:29.889 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.524168+0000", 2024-09-13T06:40:29.889 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:29.889 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.889 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.889 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:29.889 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.524427+0000", 2024-09-13T06:40:29.889 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00025929799999999998 2024-09-13T06:40:29.889 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.890 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.890 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:29.890 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.524451+0000", 2024-09-13T06:40:29.890 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.3686e-05 2024-09-13T06:40:29.890 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.890 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.890 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:29.890 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.524468+0000", 2024-09-13T06:40:29.890 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7577000000000001e-05 2024-09-13T06:40:29.890 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.890 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.891 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:29.891 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.530416+0000", 2024-09-13T06:40:29.891 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0059474080000000004 2024-09-13T06:40:29.891 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.891 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.891 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:29.891 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.530553+0000", 2024-09-13T06:40:29.891 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000137742 2024-09-13T06:40:29.891 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.891 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.892 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 0", 2024-09-13T06:40:29.892 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.530749+0000", 2024-09-13T06:40:29.892 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000195608 2024-09-13T06:40:29.892 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.892 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.892 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-13T06:40:29.892 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.536836+0000", 2024-09-13T06:40:29.892 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.006086546 2024-09-13T06:40:29.892 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.892 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.892 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:40:29.892 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.538038+0000", 2024-09-13T06:40:29.892 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0012019509999999999 2024-09-13T06:40:29.892 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.893 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.893 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-13T06:40:29.893 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.538106+0000", 2024-09-13T06:40:29.893 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.8923000000000004e-05 2024-09-13T06:40:29.893 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.893 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.893 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:29.893 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.538164+0000", 2024-09-13T06:40:29.893 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.7729999999999998e-05 2024-09-13T06:40:29.893 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:29.893 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:29.893 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:29.894 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.894 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.894 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4154.0:110 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-13T06:40:29.894 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:11.524488+0000", 2024-09-13T06:40:29.894 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 78.314540115, 2024-09-13T06:40:29.894 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.013976323000000001, 2024-09-13T06:40:29.894 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:29.894 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:40:29.894 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:29.894 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4154", 2024-09-13T06:40:29.895 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/2406930292", 2024-09-13T06:40:29.895 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 110 2024-09-13T06:40:29.895 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.895 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:29.895 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.895 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:29.895 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.524488+0000", 2024-09-13T06:40:29.895 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:29.895 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.895 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.895 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:29.895 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.524488+0000", 2024-09-13T06:40:29.895 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:29.896 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.896 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.896 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:29.896 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.524487+0000", 2024-09-13T06:40:29.896 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999986 2024-09-13T06:40:29.896 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.896 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.896 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:29.896 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.524498+0000", 2024-09-13T06:40:29.896 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1579999999999999e-05 2024-09-13T06:40:29.896 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.896 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.896 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:29.897 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.524516+0000", 2024-09-13T06:40:29.897 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7776000000000001e-05 2024-09-13T06:40:29.897 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.897 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.897 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:29.897 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.524530+0000", 2024-09-13T06:40:29.897 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3896999999999999e-05 2024-09-13T06:40:29.897 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.897 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.897 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:29.897 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.532254+0000", 2024-09-13T06:40:29.897 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0077239409999999998 2024-09-13T06:40:29.897 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.898 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.898 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:29.898 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.532371+0000", 2024-09-13T06:40:29.898 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000117176 2024-09-13T06:40:29.898 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.898 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.898 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 0", 2024-09-13T06:40:29.898 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.532551+0000", 2024-09-13T06:40:29.898 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00018004100000000001 2024-09-13T06:40:29.898 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.898 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.898 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:40:29.898 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.538280+0000", 2024-09-13T06:40:29.899 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0057289230000000003 2024-09-13T06:40:29.899 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.899 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.899 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-13T06:40:29.899 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.538294+0000", 2024-09-13T06:40:29.899 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.4070000000000001e-05 2024-09-13T06:40:29.899 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.899 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.899 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-13T06:40:29.899 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.538368+0000", 2024-09-13T06:40:29.899 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.3604999999999997e-05 2024-09-13T06:40:29.899 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.899 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.900 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:29.900 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.538465+0000", 2024-09-13T06:40:29.900 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6830000000000006e-05 2024-09-13T06:40:29.900 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:29.900 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:29.900 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:29.900 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.900 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.900 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4154.0:111 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-13T06:40:29.900 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:11.524546+0000", 2024-09-13T06:40:29.900 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 78.314482681000001, 2024-09-13T06:40:29.901 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.016412307000000001, 2024-09-13T06:40:29.901 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:29.901 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:40:29.902 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:29.902 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4154", 2024-09-13T06:40:29.902 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/2406930292", 2024-09-13T06:40:29.902 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 111 2024-09-13T06:40:29.902 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.902 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:29.902 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.902 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:29.902 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.524546+0000", 2024-09-13T06:40:29.903 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:29.903 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.903 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.903 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:29.903 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.524546+0000", 2024-09-13T06:40:29.903 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:29.903 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.903 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.903 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:29.903 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.524545+0000", 2024-09-13T06:40:29.904 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:29.904 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.904 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.904 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:29.904 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.524555+0000", 2024-09-13T06:40:29.904 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0176e-05 2024-09-13T06:40:29.904 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.904 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.904 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:29.904 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.524577+0000", 2024-09-13T06:40:29.904 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.1756999999999999e-05 2024-09-13T06:40:29.904 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.905 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.905 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:29.905 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.524592+0000", 2024-09-13T06:40:29.905 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5345999999999998e-05 2024-09-13T06:40:29.905 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.905 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.905 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:29.905 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.533407+0000", 2024-09-13T06:40:29.905 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0088150559999999999 2024-09-13T06:40:29.905 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.905 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.905 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:29.905 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.533523+0000", 2024-09-13T06:40:29.906 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000116099 2024-09-13T06:40:29.906 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.906 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.906 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 0", 2024-09-13T06:40:29.906 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.533734+0000", 2024-09-13T06:40:29.906 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000211005 2024-09-13T06:40:29.906 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.906 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.906 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-13T06:40:29.906 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.538484+0000", 2024-09-13T06:40:29.906 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0047494900000000003 2024-09-13T06:40:29.906 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.906 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.907 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:40:29.907 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.540823+0000", 2024-09-13T06:40:29.907 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0023390889999999999 2024-09-13T06:40:29.907 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.907 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.907 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-13T06:40:29.907 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.540898+0000", 2024-09-13T06:40:29.907 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5449000000000002e-05 2024-09-13T06:40:29.907 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.907 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.908 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:29.908 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.540958+0000", 2024-09-13T06:40:29.908 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.9889999999999997e-05 2024-09-13T06:40:29.908 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:29.908 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:29.908 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:29.908 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.908 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.908 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4154.0:112 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-13T06:40:29.908 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:11.524610+0000", 2024-09-13T06:40:29.908 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 78.314418962000005, 2024-09-13T06:40:29.908 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.016538458999999998, 2024-09-13T06:40:29.908 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:29.909 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:40:29.909 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:29.909 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4154", 2024-09-13T06:40:29.909 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/2406930292", 2024-09-13T06:40:29.909 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 112 2024-09-13T06:40:29.909 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.909 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:29.909 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.909 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:29.909 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.524610+0000", 2024-09-13T06:40:29.909 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:29.909 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.909 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.910 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:29.910 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.524610+0000", 2024-09-13T06:40:29.910 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:29.910 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.910 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.910 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:29.910 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.524608+0000", 2024-09-13T06:40:29.910 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:29.910 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.910 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.910 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:29.910 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.524826+0000", 2024-09-13T06:40:29.910 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000217226 2024-09-13T06:40:29.911 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.911 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.911 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:29.911 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.524848+0000", 2024-09-13T06:40:29.911 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.2802999999999998e-05 2024-09-13T06:40:29.911 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.911 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.911 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:29.911 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.524906+0000", 2024-09-13T06:40:29.911 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.7878999999999999e-05 2024-09-13T06:40:29.911 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.911 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.911 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:29.911 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.534402+0000", 2024-09-13T06:40:29.911 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0094956769999999992 2024-09-13T06:40:29.912 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.912 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.912 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:29.912 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.534512+0000", 2024-09-13T06:40:29.912 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000110493 2024-09-13T06:40:29.912 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.912 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.912 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 0", 2024-09-13T06:40:29.913 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.534688+0000", 2024-09-13T06:40:29.913 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00017564499999999999 2024-09-13T06:40:29.913 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.913 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.913 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-13T06:40:29.913 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.538493+0000", 2024-09-13T06:40:29.913 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0038051399999999998 2024-09-13T06:40:29.913 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.913 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.914 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:40:29.914 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.541030+0000", 2024-09-13T06:40:29.914 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0025368080000000002 2024-09-13T06:40:29.914 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.914 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.914 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-13T06:40:29.914 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.541097+0000", 2024-09-13T06:40:29.914 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.6933000000000004e-05 2024-09-13T06:40:29.914 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.914 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.914 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:29.914 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.541148+0000", 2024-09-13T06:40:29.915 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.1008999999999999e-05 2024-09-13T06:40:29.915 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:29.915 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:29.915 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:29.915 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.915 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.916 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4154.0:113 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-13T06:40:29.916 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:11.524940+0000", 2024-09-13T06:40:29.916 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 78.314087998000005, 2024-09-13T06:40:29.916 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.017201570999999999, 2024-09-13T06:40:29.916 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:29.916 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:40:29.916 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:29.916 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4154", 2024-09-13T06:40:29.916 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/2406930292", 2024-09-13T06:40:29.916 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 113 2024-09-13T06:40:29.916 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.916 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:29.917 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.917 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:29.917 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.524940+0000", 2024-09-13T06:40:29.917 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:29.917 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.917 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.917 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:29.917 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.524940+0000", 2024-09-13T06:40:29.917 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:29.917 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.917 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.917 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:29.918 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.524938+0000", 2024-09-13T06:40:29.918 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999981 2024-09-13T06:40:29.918 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.918 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.918 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:29.918 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.524951+0000", 2024-09-13T06:40:29.918 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2993000000000001e-05 2024-09-13T06:40:29.918 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.918 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.918 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:29.918 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.524976+0000", 2024-09-13T06:40:29.918 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.4216999999999999e-05 2024-09-13T06:40:29.919 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.919 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.919 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:29.919 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.525000+0000", 2024-09-13T06:40:29.919 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.3986e-05 2024-09-13T06:40:29.919 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.919 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.919 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:29.919 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.535786+0000", 2024-09-13T06:40:29.919 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.010786733999999999 2024-09-13T06:40:29.919 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.919 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.920 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:29.920 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.535916+0000", 2024-09-13T06:40:29.920 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000129865 2024-09-13T06:40:29.920 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.920 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.920 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 0", 2024-09-13T06:40:29.920 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.536106+0000", 2024-09-13T06:40:29.920 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000190046 2024-09-13T06:40:29.920 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.920 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.920 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-13T06:40:29.921 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.540977+0000", 2024-09-13T06:40:29.921 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0048708730000000004 2024-09-13T06:40:29.921 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.921 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.921 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:40:29.921 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.542023+0000", 2024-09-13T06:40:29.921 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0010456179999999999 2024-09-13T06:40:29.921 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.921 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.921 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-13T06:40:29.921 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.542091+0000", 2024-09-13T06:40:29.922 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.7840000000000001e-05 2024-09-13T06:40:29.922 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.922 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.922 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:29.922 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.542142+0000", 2024-09-13T06:40:29.922 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.1399e-05 2024-09-13T06:40:29.922 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:29.922 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:29.922 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:29.922 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.922 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.923 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4154.0:114 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-13T06:40:29.923 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:11.525025+0000", 2024-09-13T06:40:29.923 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 78.314003119000006, 2024-09-13T06:40:29.923 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.017310847000000001, 2024-09-13T06:40:29.923 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:29.923 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:40:29.923 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:29.923 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4154", 2024-09-13T06:40:29.923 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/2406930292", 2024-09-13T06:40:29.923 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 114 2024-09-13T06:40:29.923 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.924 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:29.924 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.924 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:29.924 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.525025+0000", 2024-09-13T06:40:29.924 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:29.924 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.924 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.924 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:29.924 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.525025+0000", 2024-09-13T06:40:29.924 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:29.924 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.924 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.924 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:29.925 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.525024+0000", 2024-09-13T06:40:29.925 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999986 2024-09-13T06:40:29.925 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.925 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.925 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:29.925 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.525035+0000", 2024-09-13T06:40:29.925 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1413999999999999e-05 2024-09-13T06:40:29.925 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.925 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.925 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:29.925 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.525054+0000", 2024-09-13T06:40:29.925 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.8723e-05 2024-09-13T06:40:29.925 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.926 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.926 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:29.926 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.525068+0000", 2024-09-13T06:40:29.926 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.4022999999999999e-05 2024-09-13T06:40:29.926 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.926 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.926 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:29.926 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.536923+0000", 2024-09-13T06:40:29.926 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.011854821999999999 2024-09-13T06:40:29.926 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.926 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.926 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:29.926 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.537048+0000", 2024-09-13T06:40:29.926 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000125399 2024-09-13T06:40:29.927 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.927 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.927 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 0", 2024-09-13T06:40:29.927 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.537293+0000", 2024-09-13T06:40:29.927 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00024499500000000002 2024-09-13T06:40:29.927 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.927 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.927 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-13T06:40:29.927 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.541962+0000", 2024-09-13T06:40:29.927 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0046680940000000002 2024-09-13T06:40:29.928 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.928 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.928 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:40:29.928 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.542218+0000", 2024-09-13T06:40:29.928 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00025668199999999999 2024-09-13T06:40:29.928 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.928 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.928 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-13T06:40:29.928 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.542286+0000", 2024-09-13T06:40:29.928 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.7565999999999997e-05 2024-09-13T06:40:29.928 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.928 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.929 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:29.929 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.542336+0000", 2024-09-13T06:40:29.929 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.0429000000000001e-05 2024-09-13T06:40:29.929 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:29.929 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:29.929 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:29.929 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.929 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.929 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4154.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-13T06:40:29.929 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:11.525085+0000", 2024-09-13T06:40:29.929 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 78.313943938999998, 2024-09-13T06:40:29.930 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.019358490999999999, 2024-09-13T06:40:29.930 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:29.930 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:40:29.930 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:29.930 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4154", 2024-09-13T06:40:29.930 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/2406930292", 2024-09-13T06:40:29.931 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 115 2024-09-13T06:40:29.931 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.931 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:29.931 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.931 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:29.931 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.525085+0000", 2024-09-13T06:40:29.931 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:29.932 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.932 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.932 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:29.932 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.525085+0000", 2024-09-13T06:40:29.932 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:29.932 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.933 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.933 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:29.933 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.525083+0000", 2024-09-13T06:40:29.933 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:29.933 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.933 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.934 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:29.934 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.525302+0000", 2024-09-13T06:40:29.934 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00021804499999999999 2024-09-13T06:40:29.934 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.934 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.934 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:29.934 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.525324+0000", 2024-09-13T06:40:29.935 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.2147e-05 2024-09-13T06:40:29.935 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.935 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.935 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:29.935 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.525340+0000", 2024-09-13T06:40:29.936 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5879000000000002e-05 2024-09-13T06:40:29.936 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.936 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.936 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:29.936 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.538555+0000", 2024-09-13T06:40:29.936 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.013215499 2024-09-13T06:40:29.937 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.937 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.937 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:29.938 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.538703+0000", 2024-09-13T06:40:29.938 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00014755200000000001 2024-09-13T06:40:29.938 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.938 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.938 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 0", 2024-09-13T06:40:29.939 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.538967+0000", 2024-09-13T06:40:29.939 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00026453799999999998 2024-09-13T06:40:29.939 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.939 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.939 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-13T06:40:29.939 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.541969+0000", 2024-09-13T06:40:29.940 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00300184 2024-09-13T06:40:29.940 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.940 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.940 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:40:29.940 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.544287+0000", 2024-09-13T06:40:29.940 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0023178890000000001 2024-09-13T06:40:29.941 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.941 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.941 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-13T06:40:29.941 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.544378+0000", 2024-09-13T06:40:29.941 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.1366000000000006e-05 2024-09-13T06:40:29.942 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.942 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.942 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:29.942 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.544443+0000", 2024-09-13T06:40:29.942 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.4826000000000006e-05 2024-09-13T06:40:29.942 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:29.942 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:29.943 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:29.943 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.943 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.943 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4154.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-13T06:40:29.943 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:11.525359+0000", 2024-09-13T06:40:29.943 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 78.313669911000005, 2024-09-13T06:40:29.944 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.019359514000000001, 2024-09-13T06:40:29.944 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:29.944 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:40:29.944 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:29.944 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4154", 2024-09-13T06:40:29.944 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/2406930292", 2024-09-13T06:40:29.945 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 116 2024-09-13T06:40:29.945 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.945 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:29.945 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.945 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:29.945 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.525359+0000", 2024-09-13T06:40:29.946 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:29.946 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.946 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.946 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:29.946 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.525359+0000", 2024-09-13T06:40:29.947 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:29.947 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.947 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.947 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:29.947 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.525357+0000", 2024-09-13T06:40:29.947 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999981 2024-09-13T06:40:29.947 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.948 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.948 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:29.948 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.525369+0000", 2024-09-13T06:40:29.948 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1647e-05 2024-09-13T06:40:29.948 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.949 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.949 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:29.949 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.525386+0000", 2024-09-13T06:40:29.949 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7762999999999999e-05 2024-09-13T06:40:29.949 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.949 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.950 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:29.950 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.525400+0000", 2024-09-13T06:40:29.950 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.4053000000000001e-05 2024-09-13T06:40:29.950 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.950 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.951 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:29.951 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.539897+0000", 2024-09-13T06:40:29.951 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.014497128999999999 2024-09-13T06:40:29.951 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.951 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.951 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:29.951 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.540022+0000", 2024-09-13T06:40:29.952 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00012416599999999999 2024-09-13T06:40:29.952 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.952 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.952 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 0", 2024-09-13T06:40:29.952 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.540199+0000", 2024-09-13T06:40:29.953 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00017705499999999999 2024-09-13T06:40:29.953 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.953 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.953 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-13T06:40:29.953 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.542161+0000", 2024-09-13T06:40:29.953 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0019622210000000001 2024-09-13T06:40:29.954 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.954 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.954 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:40:29.954 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.544529+0000", 2024-09-13T06:40:29.954 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0023684690000000002 2024-09-13T06:40:29.955 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.955 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.955 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-13T06:40:29.955 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.544614+0000", 2024-09-13T06:40:29.955 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.4711999999999998e-05 2024-09-13T06:40:29.955 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.956 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.956 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:29.956 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.544718+0000", 2024-09-13T06:40:29.956 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000103986 2024-09-13T06:40:29.956 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:29.956 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:29.957 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:29.957 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.957 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.957 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4154.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-13T06:40:29.957 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:11.525416+0000", 2024-09-13T06:40:29.958 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 78.313612358, 2024-09-13T06:40:29.958 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.019501830000000001, 2024-09-13T06:40:29.958 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:29.958 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:40:29.958 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:29.958 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4154", 2024-09-13T06:40:29.959 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/2406930292", 2024-09-13T06:40:29.959 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 117 2024-09-13T06:40:29.959 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.959 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:29.959 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.959 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:29.960 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.525416+0000", 2024-09-13T06:40:29.960 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:29.960 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.960 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.960 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:29.961 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.525416+0000", 2024-09-13T06:40:29.961 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:29.961 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.961 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.961 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:29.961 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.525415+0000", 2024-09-13T06:40:29.962 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999986 2024-09-13T06:40:29.962 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.962 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.962 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:29.962 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.525426+0000", 2024-09-13T06:40:29.962 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.101e-05 2024-09-13T06:40:29.963 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.963 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.963 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:29.963 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.525444+0000", 2024-09-13T06:40:29.963 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.768e-05 2024-09-13T06:40:29.963 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.963 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.964 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:29.964 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.525463+0000", 2024-09-13T06:40:29.964 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.9026999999999999e-05 2024-09-13T06:40:29.964 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.964 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.964 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:29.965 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.541203+0000", 2024-09-13T06:40:29.965 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.015740309000000001 2024-09-13T06:40:29.965 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.965 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.965 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:29.966 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.541330+0000", 2024-09-13T06:40:29.966 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000126976 2024-09-13T06:40:29.966 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.966 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.966 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 0", 2024-09-13T06:40:29.966 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.541522+0000", 2024-09-13T06:40:29.967 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00019165100000000001 2024-09-13T06:40:29.967 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.967 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.967 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-13T06:40:29.967 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.542798+0000", 2024-09-13T06:40:29.967 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.001276424 2024-09-13T06:40:29.968 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.968 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.968 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:40:29.968 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.544795+0000", 2024-09-13T06:40:29.968 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0019966540000000001 2024-09-13T06:40:29.968 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.968 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.969 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-13T06:40:29.969 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.544868+0000", 2024-09-13T06:40:29.969 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.3096000000000006e-05 2024-09-13T06:40:29.969 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.969 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.969 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:29.969 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.544918+0000", 2024-09-13T06:40:29.970 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.0226999999999999e-05 2024-09-13T06:40:29.970 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:29.970 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:29.970 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:29.970 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.971 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.971 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4154.0:136 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-13T06:40:29.971 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:12.006369+0000", 2024-09-13T06:40:29.971 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 77.832659008999997, 2024-09-13T06:40:29.971 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.012052078000000001, 2024-09-13T06:40:29.971 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:29.971 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:40:29.971 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:29.972 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4154", 2024-09-13T06:40:29.972 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/2406930292", 2024-09-13T06:40:29.972 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 136 2024-09-13T06:40:29.972 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.972 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:29.972 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.972 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:29.972 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.006369+0000", 2024-09-13T06:40:29.972 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:29.972 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.972 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.972 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:29.973 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.006369+0000", 2024-09-13T06:40:29.973 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:29.973 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.973 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.973 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:29.973 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.006369+0000", 2024-09-13T06:40:29.973 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:29.973 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.973 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.973 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:29.973 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.006372+0000", 2024-09-13T06:40:29.973 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.0630000000000002e-06 2024-09-13T06:40:29.973 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.974 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.974 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:29.974 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.006377+0000", 2024-09-13T06:40:29.974 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.6079999999999998e-06 2024-09-13T06:40:29.974 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.974 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.974 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:29.974 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.006384+0000", 2024-09-13T06:40:29.974 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.8560000000000001e-06 2024-09-13T06:40:29.974 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.974 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.974 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:29.974 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.008357+0000", 2024-09-13T06:40:29.974 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0019733839999999999 2024-09-13T06:40:29.975 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.975 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.975 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:29.975 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.008406+0000", 2024-09-13T06:40:29.975 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.9023000000000001e-05 2024-09-13T06:40:29.975 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.975 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.975 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 0", 2024-09-13T06:40:29.975 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.008489+0000", 2024-09-13T06:40:29.975 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.2649000000000001e-05 2024-09-13T06:40:29.975 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.975 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.975 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-13T06:40:29.976 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.011012+0000", 2024-09-13T06:40:29.976 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0025236880000000001 2024-09-13T06:40:29.976 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.976 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.976 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:40:29.976 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.018382+0000", 2024-09-13T06:40:29.976 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.007369596 2024-09-13T06:40:29.976 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.976 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.976 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-13T06:40:29.976 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.018405+0000", 2024-09-13T06:40:29.976 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.2670000000000001e-05 2024-09-13T06:40:29.976 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.977 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.977 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:29.977 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.018422+0000", 2024-09-13T06:40:29.977 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6864999999999999e-05 2024-09-13T06:40:29.977 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:29.977 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:29.977 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:29.977 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.977 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.977 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4154.0:137 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-13T06:40:29.977 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:12.006450+0000", 2024-09-13T06:40:29.977 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 77.832578679999997, 2024-09-13T06:40:29.977 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.012040990999999999, 2024-09-13T06:40:29.977 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:29.978 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:40:29.978 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:29.978 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4154", 2024-09-13T06:40:29.978 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/2406930292", 2024-09-13T06:40:29.978 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 137 2024-09-13T06:40:29.978 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.978 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:29.978 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.978 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:29.978 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.006450+0000", 2024-09-13T06:40:29.978 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:29.978 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.978 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.978 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:29.978 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.006450+0000", 2024-09-13T06:40:29.979 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:29.979 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.979 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.979 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:29.979 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.006449+0000", 2024-09-13T06:40:29.979 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:29.979 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.979 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.979 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:29.979 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.006549+0000", 2024-09-13T06:40:29.979 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.9847999999999997e-05 2024-09-13T06:40:29.979 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.979 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.979 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:29.979 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.006560+0000", 2024-09-13T06:40:29.980 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1012000000000001e-05 2024-09-13T06:40:29.980 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.980 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.980 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:29.980 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.006566+0000", 2024-09-13T06:40:29.980 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.1630000000000001e-06 2024-09-13T06:40:29.980 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.980 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.980 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:29.980 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.008760+0000", 2024-09-13T06:40:29.980 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0021934659999999998 2024-09-13T06:40:29.980 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.981 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.981 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:29.981 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.008803+0000", 2024-09-13T06:40:29.981 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.3492000000000003e-05 2024-09-13T06:40:29.981 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.981 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.981 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 0", 2024-09-13T06:40:29.981 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.008879+0000", 2024-09-13T06:40:29.981 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5252000000000004e-05 2024-09-13T06:40:29.981 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.981 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.981 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-13T06:40:29.981 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.011015+0000", 2024-09-13T06:40:29.982 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0021362349999999998 2024-09-13T06:40:29.982 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.982 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.982 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:40:29.982 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.018452+0000", 2024-09-13T06:40:29.982 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.007436865 2024-09-13T06:40:29.982 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.982 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.982 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-13T06:40:29.982 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.018474+0000", 2024-09-13T06:40:29.982 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.2149000000000001e-05 2024-09-13T06:40:29.982 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.982 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.982 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:29.983 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.018491+0000", 2024-09-13T06:40:29.983 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6983999999999999e-05 2024-09-13T06:40:29.983 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:29.983 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:29.983 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:29.983 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.983 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.983 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4154.0:139 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-13T06:40:29.983 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:12.006595+0000", 2024-09-13T06:40:29.983 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 77.832433362000003, 2024-09-13T06:40:29.983 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.012024933999999999, 2024-09-13T06:40:29.983 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:29.983 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:40:29.983 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:29.984 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4154", 2024-09-13T06:40:29.984 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/2406930292", 2024-09-13T06:40:29.984 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 139 2024-09-13T06:40:29.984 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.984 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:29.984 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.984 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:29.984 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.006595+0000", 2024-09-13T06:40:29.984 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:29.984 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.984 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.984 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:29.984 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.006595+0000", 2024-09-13T06:40:29.985 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:29.985 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.985 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.985 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:29.985 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.006595+0000", 2024-09-13T06:40:29.985 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:29.985 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.985 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.985 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:29.985 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.006598+0000", 2024-09-13T06:40:29.986 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.1769999999999998e-06 2024-09-13T06:40:29.986 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.986 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.986 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:29.986 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.006612+0000", 2024-09-13T06:40:29.986 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.4177e-05 2024-09-13T06:40:29.986 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.986 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.986 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:29.986 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.006617+0000", 2024-09-13T06:40:29.986 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.561e-06 2024-09-13T06:40:29.986 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.987 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.987 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:29.987 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.009658+0000", 2024-09-13T06:40:29.987 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0030413369999999999 2024-09-13T06:40:29.987 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.987 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.987 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:29.987 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.009707+0000", 2024-09-13T06:40:29.987 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.9089999999999999e-05 2024-09-13T06:40:29.987 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.987 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.987 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 0", 2024-09-13T06:40:29.987 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.009795+0000", 2024-09-13T06:40:29.987 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.7619000000000003e-05 2024-09-13T06:40:29.988 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.988 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.988 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-13T06:40:29.988 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.011021+0000", 2024-09-13T06:40:29.988 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0012266289999999999 2024-09-13T06:40:29.988 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.988 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.988 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:40:29.988 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.018582+0000", 2024-09-13T06:40:29.988 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0075603399999999996 2024-09-13T06:40:29.988 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.988 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.988 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-13T06:40:29.989 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.018603+0000", 2024-09-13T06:40:29.989 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.1795999999999999e-05 2024-09-13T06:40:29.989 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.989 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.989 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:29.989 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.018620+0000", 2024-09-13T06:40:29.989 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6562000000000002e-05 2024-09-13T06:40:29.989 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:29.989 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:29.989 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:29.990 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.990 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.990 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4154.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-13T06:40:29.990 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:12.006689+0000", 2024-09-13T06:40:29.990 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 77.832339172999994, 2024-09-13T06:40:29.990 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.012427258, 2024-09-13T06:40:29.990 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:29.990 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:40:29.990 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:29.990 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4154", 2024-09-13T06:40:29.990 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/2406930292", 2024-09-13T06:40:29.990 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 140 2024-09-13T06:40:29.990 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.990 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:29.991 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.991 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:29.991 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.006689+0000", 2024-09-13T06:40:29.991 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:29.991 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.991 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.991 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:29.991 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.006689+0000", 2024-09-13T06:40:29.991 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:29.991 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.991 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.991 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:29.991 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.006689+0000", 2024-09-13T06:40:29.992 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:29.992 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.992 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.992 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:29.992 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.006795+0000", 2024-09-13T06:40:29.992 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00010662699999999999 2024-09-13T06:40:29.992 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.992 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.992 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:29.992 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.006804+0000", 2024-09-13T06:40:29.992 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.055e-06 2024-09-13T06:40:29.993 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.993 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.993 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:29.993 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.006808+0000", 2024-09-13T06:40:29.993 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.7450000000000003e-06 2024-09-13T06:40:29.993 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.993 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.993 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:29.993 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.010066+0000", 2024-09-13T06:40:29.993 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0032579570000000001 2024-09-13T06:40:29.993 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.993 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.994 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:29.994 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.010111+0000", 2024-09-13T06:40:29.994 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.4563e-05 2024-09-13T06:40:29.994 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.994 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.994 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 0", 2024-09-13T06:40:29.994 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.010185+0000", 2024-09-13T06:40:29.994 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.4108000000000003e-05 2024-09-13T06:40:29.994 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.994 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.994 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-13T06:40:29.994 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.011161+0000", 2024-09-13T06:40:29.995 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00097629200000000002 2024-09-13T06:40:29.995 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.995 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.995 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:40:29.995 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.019061+0000", 2024-09-13T06:40:29.995 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0079001939999999993 2024-09-13T06:40:29.995 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.995 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.995 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-13T06:40:29.995 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.019095+0000", 2024-09-13T06:40:29.995 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.3200000000000001e-05 2024-09-13T06:40:29.995 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.995 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.995 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:29.996 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.019117+0000", 2024-09-13T06:40:29.996 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.1985e-05 2024-09-13T06:40:29.996 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:29.996 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:29.996 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:29.996 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.996 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.996 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4154.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-13T06:40:29.996 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:12.006814+0000", 2024-09-13T06:40:29.996 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 77.832213988999996, 2024-09-13T06:40:29.996 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.012896405999999999, 2024-09-13T06:40:29.996 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:29.996 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:40:29.996 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:29.997 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4154", 2024-09-13T06:40:29.997 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/2406930292", 2024-09-13T06:40:29.997 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 141 2024-09-13T06:40:29.997 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.997 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:29.997 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.997 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:29.997 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.006814+0000", 2024-09-13T06:40:29.997 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:29.997 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.997 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.997 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:29.997 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.006814+0000", 2024-09-13T06:40:29.998 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:29.998 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.998 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.998 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:29.998 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.006814+0000", 2024-09-13T06:40:29.998 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:29.998 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.998 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.998 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:29.998 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.006818+0000", 2024-09-13T06:40:29.998 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.8840000000000004e-06 2024-09-13T06:40:29.998 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.998 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.999 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:29.999 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.006834+0000", 2024-09-13T06:40:29.999 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6133999999999998e-05 2024-09-13T06:40:29.999 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.999 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.999 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:29.999 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.006838+0000", 2024-09-13T06:40:29.999 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0879999999999997e-06 2024-09-13T06:40:29.999 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:29.999 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:29.999 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:29.999 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.010586+0000", 2024-09-13T06:40:29.999 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.003747954 2024-09-13T06:40:30.000 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:30.000 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:30.000 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:30.000 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.010630+0000", 2024-09-13T06:40:30.000 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.3736000000000003e-05 2024-09-13T06:40:30.000 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:30.000 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:30.000 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 0", 2024-09-13T06:40:30.000 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.010701+0000", 2024-09-13T06:40:30.001 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.1284000000000004e-05 2024-09-13T06:40:30.001 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:30.001 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:30.001 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-13T06:40:30.001 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.011593+0000", 2024-09-13T06:40:30.001 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00089209300000000005 2024-09-13T06:40:30.002 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:30.002 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:30.002 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:40:30.002 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.019665+0000", 2024-09-13T06:40:30.002 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0080716169999999997 2024-09-13T06:40:30.002 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:30.002 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:30.002 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-13T06:40:30.002 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.019691+0000", 2024-09-13T06:40:30.002 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.6514000000000001e-05 2024-09-13T06:40:30.002 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:30.002 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:30.003 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:30.003 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.019711+0000", 2024-09-13T06:40:30.003 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.9641e-05 2024-09-13T06:40:30.003 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:30.003 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:30.003 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:30.003 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:30.003 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:30.003 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:608 3.11 3:8ebac99f:::rbd_data.11214e25756e.0000000000000007:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-09-13T06:40:30.003 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:34.801988+0000", 2024-09-13T06:40:30.003 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 55.037040601000001, 2024-09-13T06:40:30.003 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.033916448000000002, 2024-09-13T06:40:30.004 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:30.004 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:40:30.004 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:30.004 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:30.004 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:30.004 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 608 2024-09-13T06:40:30.004 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:30.004 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:30.004 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:30.004 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:30.004 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:34.801988+0000", 2024-09-13T06:40:30.005 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:30.005 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:30.005 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:30.005 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:30.005 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:34.801988+0000", 2024-09-13T06:40:30.005 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:30.005 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:30.005 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:30.005 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:30.005 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:34.801985+0000", 2024-09-13T06:40:30.006 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999976 2024-09-13T06:40:30.006 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:30.006 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:30.006 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:30.006 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:34.801999+0000", 2024-09-13T06:40:30.006 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.402e-05 2024-09-13T06:40:30.006 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:30.006 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:30.006 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:30.006 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:34.802031+0000", 2024-09-13T06:40:30.006 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.1582999999999999e-05 2024-09-13T06:40:30.006 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:30.007 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:30.007 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:30.007 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:34.802052+0000", 2024-09-13T06:40:30.007 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.1310000000000001e-05 2024-09-13T06:40:30.007 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:30.007 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:30.007 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:30.007 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:34.802117+0000", 2024-09-13T06:40:30.007 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.5016000000000002e-05 2024-09-13T06:40:30.007 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:30.007 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:30.007 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:30.007 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:34.802254+0000", 2024-09-13T06:40:30.007 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000136186 2024-09-13T06:40:30.008 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:30.008 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:30.008 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 4", 2024-09-13T06:40:30.008 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:34.807944+0000", 2024-09-13T06:40:30.008 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0056906930000000001 2024-09-13T06:40:30.008 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:30.008 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:30.008 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-13T06:40:30.008 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:34.835646+0000", 2024-09-13T06:40:30.008 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.027701546000000001 2024-09-13T06:40:30.008 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:30.008 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:30.009 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:40:30.009 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:34.835754+0000", 2024-09-13T06:40:30.009 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000107889 2024-09-13T06:40:30.009 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:30.009 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:30.009 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-13T06:40:30.009 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:34.835840+0000", 2024-09-13T06:40:30.009 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6621999999999998e-05 2024-09-13T06:40:30.009 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:30.009 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:30.009 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:30.009 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:34.835904+0000", 2024-09-13T06:40:30.010 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.4022999999999993e-05 2024-09-13T06:40:30.010 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:30.010 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:30.010 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:30.010 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:30.010 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:30.010 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:40:30.012 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-13T06:40:30.012 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:40:30.008+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:40:30.113 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:40:30.110+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:40:30.142 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:40:30.143 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-13T06:40:30.143 INFO:teuthology.orchestra.run.smithi081.stdout: "num_ops": 0 2024-09-13T06:40:30.143 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:40:30.157 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-13T06:40:30.214 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:40:30.212+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:40:30.279 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:40:30.279 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-13T06:40:30.279 INFO:teuthology.orchestra.run.smithi081.stdout: "complaint_time": 30, 2024-09-13T06:40:30.279 INFO:teuthology.orchestra.run.smithi081.stdout: "num_blocked_ops": 0 2024-09-13T06:40:30.279 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:40:30.293 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-13T06:40:30.315 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-13T06:40:30.314+0000 7f86a5f06640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26387) UID: 0 2024-09-13T06:40:30.416 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:40:30.414+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:40:30.477 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:40:30.477 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 20, 2024-09-13T06:40:30.477 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 600, 2024-09-13T06:40:30.477 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [ 2024-09-13T06:40:30.477 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:30.477 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:37801 3.1 3:82e31015:::rbd_object_map.1121d8143c6e.0000000000000019:head [call] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e55)", 2024-09-13T06:40:30.477 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:05.646191+0000", 2024-09-13T06:40:30.477 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 24.829850854, 2024-09-13T06:40:30.477 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.72659507800000001, 2024-09-13T06:40:30.477 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:30.477 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:30.478 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:30.478 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:30.478 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:30.478 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 37801 2024-09-13T06:40:30.478 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:30.478 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:30.478 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:30.478 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:30.478 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:05.646191+0000", 2024-09-13T06:40:30.478 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:30.478 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:30.478 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:30.479 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:30.479 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:05.646191+0000", 2024-09-13T06:40:30.479 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:30.479 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:30.479 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:30.479 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:30.479 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:05.646188+0000", 2024-09-13T06:40:30.479 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999971 2024-09-13T06:40:30.479 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:30.479 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:30.479 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:30.479 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:05.646206+0000", 2024-09-13T06:40:30.479 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8182999999999999e-05 2024-09-13T06:40:30.479 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:30.480 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:30.480 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:30.480 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:05.646237+0000", 2024-09-13T06:40:30.480 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.1071000000000001e-05 2024-09-13T06:40:30.480 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:30.480 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:30.480 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:30.480 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:05.646251+0000", 2024-09-13T06:40:30.480 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3679000000000001e-05 2024-09-13T06:40:30.480 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:30.480 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:30.480 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:30.480 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:05.646321+0000", 2024-09-13T06:40:30.480 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.9831000000000003e-05 2024-09-13T06:40:30.481 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:30.481 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:30.481 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:40:30.481 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:05.646331+0000", 2024-09-13T06:40:30.481 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0242e-05 2024-09-13T06:40:30.481 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:30.481 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:30.481 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:30.481 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.371959+0000", 2024-09-13T06:40:30.481 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.72562817199999996 2024-09-13T06:40:30.481 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:30.481 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:30.481 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:30.482 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.372389+0000", 2024-09-13T06:40:30.482 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00042977400000000001 2024-09-13T06:40:30.482 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:30.482 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:30.482 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:30.482 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.372786+0000", 2024-09-13T06:40:30.482 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00039706099999999999 2024-09-13T06:40:30.482 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:30.482 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:30.482 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:30.482 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:30.482 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:30.482 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43009 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 489472~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:40:30.483 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.644660+0000", 2024-09-13T06:40:30.483 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 8.8313818919999996, 2024-09-13T06:40:30.483 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123376071, 2024-09-13T06:40:30.483 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:30.483 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:30.483 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:30.483 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:30.483 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:30.483 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43009 2024-09-13T06:40:30.483 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:30.483 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:30.483 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:30.483 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:30.483 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.644660+0000", 2024-09-13T06:40:30.484 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:30.484 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:30.484 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:30.484 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:30.484 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.644660+0000", 2024-09-13T06:40:30.484 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:30.484 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:30.484 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:30.484 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:30.484 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.644659+0000", 2024-09-13T06:40:30.484 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:30.484 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:30.485 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:30.485 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:30.485 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.644662+0000", 2024-09-13T06:40:30.485 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4949999999999998e-06 2024-09-13T06:40:30.485 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:30.485 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:30.485 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:30.485 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.644669+0000", 2024-09-13T06:40:30.486 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.289e-06 2024-09-13T06:40:30.486 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:30.486 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:30.486 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:30.486 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.644674+0000", 2024-09-13T06:40:30.486 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.8840000000000002e-06 2024-09-13T06:40:30.486 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:30.486 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:30.486 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:30.486 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.767602+0000", 2024-09-13T06:40:30.486 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.122928158 2024-09-13T06:40:30.486 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:30.486 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:30.487 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:30.487 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.767676+0000", 2024-09-13T06:40:30.487 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3992999999999994e-05 2024-09-13T06:40:30.487 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:30.487 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:30.487 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:30.487 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.768036+0000", 2024-09-13T06:40:30.487 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00035966200000000001 2024-09-13T06:40:30.487 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:30.487 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:30.488 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:30.488 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:30.488 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:30.488 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43010 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 503808~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:40:30.488 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.644678+0000", 2024-09-13T06:40:30.488 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 8.8313635660000003, 2024-09-13T06:40:30.488 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123728798, 2024-09-13T06:40:30.488 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:30.488 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:30.488 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:30.488 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:30.488 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:30.488 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43010 2024-09-13T06:40:30.489 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:30.489 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:30.489 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:30.489 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:30.489 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.644678+0000", 2024-09-13T06:40:30.489 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:30.489 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:30.489 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:30.489 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:30.489 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.644678+0000", 2024-09-13T06:40:30.489 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:30.489 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:30.490 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:30.490 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:30.490 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.644678+0000", 2024-09-13T06:40:30.490 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:30.490 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:30.490 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:30.490 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:30.490 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.644680+0000", 2024-09-13T06:40:30.490 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2050000000000001e-06 2024-09-13T06:40:30.490 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:30.490 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:30.490 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:30.490 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.644686+0000", 2024-09-13T06:40:30.490 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8440000000000003e-06 2024-09-13T06:40:30.491 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:30.491 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:30.491 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:30.491 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.644691+0000", 2024-09-13T06:40:30.491 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.118e-06 2024-09-13T06:40:30.491 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:30.491 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:30.491 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:30.492 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.768065+0000", 2024-09-13T06:40:30.492 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123374698 2024-09-13T06:40:30.492 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:30.492 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:30.492 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:30.492 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.768139+0000", 2024-09-13T06:40:30.492 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3934000000000001e-05 2024-09-13T06:40:30.492 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:30.492 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:30.492 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:30.492 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.768407+0000", 2024-09-13T06:40:30.492 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00026738800000000002 2024-09-13T06:40:30.492 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:30.493 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:30.493 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:30.493 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:30.493 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:30.493 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43181 3.17 3:ec5ebce4:::rbd_data.1121f5f2e1c0.0000000000000001:1f [read 319488~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:40:30.493 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.652968+0000", 2024-09-13T06:40:30.493 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 8.8230730499999996, 2024-09-13T06:40:30.493 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.12363807, 2024-09-13T06:40:30.493 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:30.493 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:30.493 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:30.493 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:30.493 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:30.494 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43181 2024-09-13T06:40:30.494 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:30.494 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:30.494 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:30.494 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:30.494 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.652968+0000", 2024-09-13T06:40:30.494 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:30.494 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:30.494 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:30.494 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:30.494 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.652968+0000", 2024-09-13T06:40:30.494 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:30.494 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:30.494 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:30.495 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:30.495 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.652968+0000", 2024-09-13T06:40:30.495 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:30.495 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:30.495 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:30.495 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:30.495 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.652970+0000", 2024-09-13T06:40:30.495 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2409999999999998e-06 2024-09-13T06:40:30.495 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:30.495 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:30.495 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:30.495 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.652976+0000", 2024-09-13T06:40:30.495 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0079999999999999e-06 2024-09-13T06:40:30.496 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:30.496 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:30.496 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:30.496 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.652981+0000", 2024-09-13T06:40:30.496 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4390000000000002e-06 2024-09-13T06:40:30.496 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:30.496 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:30.496 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:30.496 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.776275+0000", 2024-09-13T06:40:30.496 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.12329396099999999 2024-09-13T06:40:30.496 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:30.496 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:30.496 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:30.497 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.776316+0000", 2024-09-13T06:40:30.497 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.1244e-05 2024-09-13T06:40:30.497 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:30.497 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:30.497 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:30.497 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.776607+0000", 2024-09-13T06:40:30.497 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00029051199999999999 2024-09-13T06:40:30.497 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:30.497 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:30.497 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:30.497 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:30.497 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:30.497 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43182 3.17 3:ec5ebce4:::rbd_data.1121f5f2e1c0.0000000000000001:1f [read 333824~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:40:30.498 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.652985+0000", 2024-09-13T06:40:30.498 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 8.8230562409999997, 2024-09-13T06:40:30.498 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123926616, 2024-09-13T06:40:30.498 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:30.498 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:30.498 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:30.498 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:30.498 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:30.498 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43182 2024-09-13T06:40:30.498 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:30.498 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:30.498 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:30.498 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:30.499 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.652985+0000", 2024-09-13T06:40:30.499 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:30.499 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:30.499 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:30.499 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:30.499 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.652985+0000", 2024-09-13T06:40:30.499 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:30.499 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:30.499 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:30.499 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:30.499 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.652985+0000", 2024-09-13T06:40:30.499 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:30.499 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:30.499 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:30.500 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:30.500 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.652987+0000", 2024-09-13T06:40:30.500 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0899999999999999e-06 2024-09-13T06:40:30.500 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:30.500 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:30.500 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:30.500 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.652994+0000", 2024-09-13T06:40:30.500 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3100000000000003e-06 2024-09-13T06:40:30.500 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:30.500 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:30.500 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:30.500 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.653000+0000", 2024-09-13T06:40:30.501 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2020000000000003e-06 2024-09-13T06:40:30.501 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:30.501 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:30.501 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:30.501 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.776635+0000", 2024-09-13T06:40:30.501 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.12363529400000001 2024-09-13T06:40:30.501 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:30.501 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:30.501 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:30.501 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.776676+0000", 2024-09-13T06:40:30.501 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.0745999999999999e-05 2024-09-13T06:40:30.501 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:30.502 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:30.502 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:30.502 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.776912+0000", 2024-09-13T06:40:30.502 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00023631300000000001 2024-09-13T06:40:30.502 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:30.502 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:30.502 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:30.502 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:30.502 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:30.502 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43192 3.17 3:ec5ebce4:::rbd_data.1121f5f2e1c0.0000000000000001:1f [read 466944~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:40:30.502 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.656622+0000", 2024-09-13T06:40:30.502 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 8.8194191849999992, 2024-09-13T06:40:30.502 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123503136, 2024-09-13T06:40:30.503 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:30.503 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:30.503 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:30.503 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:30.503 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:30.503 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43192 2024-09-13T06:40:30.503 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:30.503 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:30.503 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:30.503 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:30.503 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656622+0000", 2024-09-13T06:40:30.503 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:30.503 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:30.503 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:30.504 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:30.504 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656622+0000", 2024-09-13T06:40:30.504 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:30.504 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:30.504 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:30.504 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:30.504 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656622+0000", 2024-09-13T06:40:30.504 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:40:30.504 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:30.504 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:30.504 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:30.504 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656623+0000", 2024-09-13T06:40:30.505 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2079999999999999e-06 2024-09-13T06:40:30.505 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:30.505 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:30.505 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:30.505 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656627+0000", 2024-09-13T06:40:30.505 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.4819999999999999e-06 2024-09-13T06:40:30.505 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:30.505 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:30.505 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:30.505 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656629+0000", 2024-09-13T06:40:30.505 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.582e-06 2024-09-13T06:40:30.505 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:30.505 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:30.505 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:30.506 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.779866+0000", 2024-09-13T06:40:30.506 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.12323638100000001 2024-09-13T06:40:30.506 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:30.506 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:30.506 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:30.506 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.779905+0000", 2024-09-13T06:40:30.506 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.9529e-05 2024-09-13T06:40:30.506 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:30.506 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:30.506 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:30.506 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.780125+0000", 2024-09-13T06:40:30.506 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000220168 2024-09-13T06:40:30.506 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:30.507 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:30.507 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:30.507 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:30.507 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:30.507 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43193 3.17 3:ec5ebce4:::rbd_data.1121f5f2e1c0.0000000000000001:1f [read 481280~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:40:30.507 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.656635+0000", 2024-09-13T06:40:30.507 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 8.8194067010000001, 2024-09-13T06:40:30.507 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.12374478999999999, 2024-09-13T06:40:30.507 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:30.507 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:30.508 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:30.508 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:30.508 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:30.508 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43193 2024-09-13T06:40:30.508 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:30.508 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:30.508 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:30.508 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:30.508 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656635+0000", 2024-09-13T06:40:30.508 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:30.508 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:30.509 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:30.509 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:30.509 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656635+0000", 2024-09-13T06:40:30.509 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:30.509 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:30.509 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:30.509 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:30.509 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656635+0000", 2024-09-13T06:40:30.509 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:40:30.509 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:30.509 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:30.509 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:30.510 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656636+0000", 2024-09-13T06:40:30.510 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.544e-06 2024-09-13T06:40:30.510 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:30.510 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:30.510 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:30.510 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656639+0000", 2024-09-13T06:40:30.510 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.0879999999999999e-06 2024-09-13T06:40:30.510 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:30.510 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:30.510 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:30.510 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656642+0000", 2024-09-13T06:40:30.510 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5799999999999999e-06 2024-09-13T06:40:30.511 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:30.511 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:30.511 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:30.511 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.780151+0000", 2024-09-13T06:40:30.511 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123509035 2024-09-13T06:40:30.511 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:30.511 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:30.511 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:30.511 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.780191+0000", 2024-09-13T06:40:30.511 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.9758000000000001e-05 2024-09-13T06:40:30.511 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:30.511 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:30.512 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:30.512 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.780380+0000", 2024-09-13T06:40:30.512 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000189023 2024-09-13T06:40:30.512 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:30.512 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:30.512 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:30.512 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:30.512 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:30.512 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43194 3.17 3:ec5ebce4:::rbd_data.1121f5f2e1c0.0000000000000001:1f [read 495616~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:40:30.512 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.656645+0000", 2024-09-13T06:40:30.512 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 8.8193960479999998, 2024-09-13T06:40:30.512 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.124088483, 2024-09-13T06:40:30.513 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:30.513 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:30.513 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:30.513 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:30.513 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:30.513 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43194 2024-09-13T06:40:30.513 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:30.513 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:30.513 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:30.513 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:30.513 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656645+0000", 2024-09-13T06:40:30.513 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:30.514 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:30.514 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:30.514 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:30.514 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656645+0000", 2024-09-13T06:40:30.514 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:30.514 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:30.514 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:30.514 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:30.514 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656645+0000", 2024-09-13T06:40:30.514 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:30.514 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:30.514 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:30.514 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:30.515 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656647+0000", 2024-09-13T06:40:30.515 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9180000000000001e-06 2024-09-13T06:40:30.515 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:30.515 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:30.515 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:30.515 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656653+0000", 2024-09-13T06:40:30.515 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7860000000000002e-06 2024-09-13T06:40:30.515 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:30.515 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:30.515 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:30.515 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656658+0000", 2024-09-13T06:40:30.515 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6949999999999999e-06 2024-09-13T06:40:30.515 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:30.516 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:30.516 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:30.516 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.780406+0000", 2024-09-13T06:40:30.516 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123748657 2024-09-13T06:40:30.516 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:30.516 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:30.516 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:30.516 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.780446+0000", 2024-09-13T06:40:30.516 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.9360999999999998e-05 2024-09-13T06:40:30.516 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:30.516 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:30.516 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:30.517 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.780734+0000", 2024-09-13T06:40:30.517 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00028838399999999998 2024-09-13T06:40:30.517 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:30.517 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:30.517 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:30.517 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:30.517 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:30.517 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43240 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 106496~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:40:30.517 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.660672+0000", 2024-09-13T06:40:30.517 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 8.8153696850000003, 2024-09-13T06:40:30.517 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123612707, 2024-09-13T06:40:30.517 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:30.517 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:30.517 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:30.518 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:30.518 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:30.518 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43240 2024-09-13T06:40:30.518 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:30.518 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:30.518 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:30.518 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:30.518 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660672+0000", 2024-09-13T06:40:30.518 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:30.518 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:30.518 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:30.518 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:30.518 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660672+0000", 2024-09-13T06:40:30.519 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:30.519 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:30.519 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:30.519 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:30.519 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660671+0000", 2024-09-13T06:40:30.519 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:30.519 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:30.519 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:30.519 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:30.519 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660673+0000", 2024-09-13T06:40:30.519 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.652e-06 2024-09-13T06:40:30.519 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:30.520 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:30.520 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:30.520 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660677+0000", 2024-09-13T06:40:30.520 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.2509999999999996e-06 2024-09-13T06:40:30.520 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:30.520 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:30.520 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:30.520 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660680+0000", 2024-09-13T06:40:30.520 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.8150000000000002e-06 2024-09-13T06:40:30.520 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:30.520 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:30.520 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:30.521 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.783596+0000", 2024-09-13T06:40:30.521 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.122915841 2024-09-13T06:40:30.521 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:30.521 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:30.521 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:30.521 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.783682+0000", 2024-09-13T06:40:30.521 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.5822999999999995e-05 2024-09-13T06:40:30.521 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:30.521 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:30.521 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:30.521 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.784285+0000", 2024-09-13T06:40:30.521 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00060276500000000001 2024-09-13T06:40:30.521 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:30.521 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:30.522 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:30.522 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:30.522 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:30.522 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43241 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 120832~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:40:30.522 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.660682+0000", 2024-09-13T06:40:30.522 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 8.8153591099999993, 2024-09-13T06:40:30.522 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123958204, 2024-09-13T06:40:30.522 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:30.522 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:30.522 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:30.522 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:30.523 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:30.523 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43241 2024-09-13T06:40:30.523 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:30.523 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:30.523 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:30.523 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:30.523 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660682+0000", 2024-09-13T06:40:30.523 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:30.523 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:30.523 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:30.523 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:30.523 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660682+0000", 2024-09-13T06:40:30.523 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:30.524 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:30.524 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:30.524 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:30.524 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660682+0000", 2024-09-13T06:40:30.524 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:30.524 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:30.524 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:30.524 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:30.524 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660683+0000", 2024-09-13T06:40:30.524 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.308e-06 2024-09-13T06:40:30.524 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:30.524 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:30.524 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:30.525 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660686+0000", 2024-09-13T06:40:30.525 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.977e-06 2024-09-13T06:40:30.525 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:30.525 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:30.525 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:30.525 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660689+0000", 2024-09-13T06:40:30.525 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5830000000000001e-06 2024-09-13T06:40:30.525 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:30.525 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:30.525 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:30.525 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.784366+0000", 2024-09-13T06:40:30.525 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.12367713599999999 2024-09-13T06:40:30.525 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:30.526 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:30.526 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:30.526 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.784451+0000", 2024-09-13T06:40:30.526 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.4629999999999994e-05 2024-09-13T06:40:30.526 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:30.526 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:30.526 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:30.526 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.784641+0000", 2024-09-13T06:40:30.526 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00018984899999999999 2024-09-13T06:40:30.526 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:30.526 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:30.526 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:30.526 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:30.527 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:30.527 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43242 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 139264~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:40:30.527 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.660691+0000", 2024-09-13T06:40:30.527 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 8.8153501320000007, 2024-09-13T06:40:30.527 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.124536443, 2024-09-13T06:40:30.527 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:30.527 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:30.527 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:30.527 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:30.527 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:30.527 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43242 2024-09-13T06:40:30.527 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:30.527 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:30.527 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:30.528 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:30.528 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660691+0000", 2024-09-13T06:40:30.528 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:30.528 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:30.528 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:30.528 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:30.528 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660691+0000", 2024-09-13T06:40:30.528 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:30.528 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:30.528 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:30.528 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:30.528 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660691+0000", 2024-09-13T06:40:30.528 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:40:30.529 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:30.529 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:30.529 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:30.529 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660696+0000", 2024-09-13T06:40:30.529 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0560000000000004e-06 2024-09-13T06:40:30.529 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:30.529 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:30.529 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:30.529 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660699+0000", 2024-09-13T06:40:30.529 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.2009999999999999e-06 2024-09-13T06:40:30.529 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:30.529 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:30.529 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:30.530 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660702+0000", 2024-09-13T06:40:30.530 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.633e-06 2024-09-13T06:40:30.530 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:30.530 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:30.530 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:30.530 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.784912+0000", 2024-09-13T06:40:30.530 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.124209497 2024-09-13T06:40:30.530 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:30.530 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:30.530 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:30.530 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.784995+0000", 2024-09-13T06:40:30.530 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.3891e-05 2024-09-13T06:40:30.530 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:30.531 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:30.531 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:30.531 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.785228+0000", 2024-09-13T06:40:30.531 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00023237400000000001 2024-09-13T06:40:30.531 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:30.531 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:30.531 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:30.531 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:30.531 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:30.531 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43243 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 153600~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:40:30.531 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.660705+0000", 2024-09-13T06:40:30.531 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 8.8153367990000007, 2024-09-13T06:40:30.531 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.124825835, 2024-09-13T06:40:30.531 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:30.532 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:30.532 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:30.532 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:30.532 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:30.532 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43243 2024-09-13T06:40:30.532 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:30.532 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:30.532 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:30.532 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:30.532 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660705+0000", 2024-09-13T06:40:30.532 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:30.532 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:30.532 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:30.533 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:30.533 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660705+0000", 2024-09-13T06:40:30.533 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:30.533 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:30.533 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:30.533 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:30.533 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660705+0000", 2024-09-13T06:40:30.533 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:40:30.533 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:30.533 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:30.533 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:30.533 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660706+0000", 2024-09-13T06:40:30.533 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4339999999999999e-06 2024-09-13T06:40:30.533 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:30.534 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:30.534 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:30.534 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660709+0000", 2024-09-13T06:40:30.534 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9000000000000002e-06 2024-09-13T06:40:30.534 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:30.534 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:30.534 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:30.534 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660712+0000", 2024-09-13T06:40:30.534 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.0589999999999998e-06 2024-09-13T06:40:30.534 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:30.534 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:30.534 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:30.534 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.785318+0000", 2024-09-13T06:40:30.535 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.124606299 2024-09-13T06:40:30.535 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:30.535 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:30.535 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:30.535 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.785361+0000", 2024-09-13T06:40:30.535 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.3214999999999999e-05 2024-09-13T06:40:30.535 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:30.535 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:30.535 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:30.535 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.785531+0000", 2024-09-13T06:40:30.535 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00016914400000000001 2024-09-13T06:40:30.535 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:30.535 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:30.535 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:30.536 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:30.536 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:30.536 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43244 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 167936~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:40:30.536 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.660714+0000", 2024-09-13T06:40:30.536 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 8.8153273859999999, 2024-09-13T06:40:30.536 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.125073248, 2024-09-13T06:40:30.536 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:30.536 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:30.536 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:30.536 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:30.536 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:30.537 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43244 2024-09-13T06:40:30.537 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:30.537 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:30.537 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:30.537 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:30.537 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660714+0000", 2024-09-13T06:40:30.537 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:30.537 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:30.537 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:30.537 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:30.537 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660714+0000", 2024-09-13T06:40:30.537 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:30.537 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:30.538 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:30.538 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:30.538 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660714+0000", 2024-09-13T06:40:30.538 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:40:30.538 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:30.538 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:30.538 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:30.538 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660715+0000", 2024-09-13T06:40:30.538 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2330000000000001e-06 2024-09-13T06:40:30.538 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:30.538 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:30.538 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:30.538 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660718+0000", 2024-09-13T06:40:30.539 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9569999999999998e-06 2024-09-13T06:40:30.539 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:30.539 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:30.539 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:30.539 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660721+0000", 2024-09-13T06:40:30.539 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.678e-06 2024-09-13T06:40:30.539 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:30.539 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:30.539 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:30.539 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.785557+0000", 2024-09-13T06:40:30.539 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.12483633199999999 2024-09-13T06:40:30.539 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:30.540 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:30.540 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:30.540 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.785618+0000", 2024-09-13T06:40:30.540 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0686000000000001e-05 2024-09-13T06:40:30.540 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:30.540 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:30.540 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:30.540 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.785787+0000", 2024-09-13T06:40:30.540 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00016957699999999999 2024-09-13T06:40:30.540 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:30.540 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:30.540 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:30.540 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:30.540 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:30.541 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43254 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 315392~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:40:30.541 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.664717+0000", 2024-09-13T06:40:30.541 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 8.8113248179999992, 2024-09-13T06:40:30.541 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.12357108, 2024-09-13T06:40:30.541 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:30.541 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:30.541 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:30.541 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:30.541 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:30.541 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43254 2024-09-13T06:40:30.541 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:30.541 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:30.542 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:30.542 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:30.542 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664717+0000", 2024-09-13T06:40:30.542 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:30.542 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:30.542 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:30.542 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:30.542 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664717+0000", 2024-09-13T06:40:30.542 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:30.542 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:30.542 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:30.542 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:30.542 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664716+0000", 2024-09-13T06:40:30.543 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:30.543 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:30.543 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:30.543 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:30.543 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664724+0000", 2024-09-13T06:40:30.543 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.7109999999999995e-06 2024-09-13T06:40:30.543 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:30.543 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:30.543 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:30.543 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664732+0000", 2024-09-13T06:40:30.543 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.8399999999999995e-06 2024-09-13T06:40:30.543 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:30.543 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:30.543 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:30.544 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664738+0000", 2024-09-13T06:40:30.544 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.879e-06 2024-09-13T06:40:30.544 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:30.544 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:30.544 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:30.544 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.788018+0000", 2024-09-13T06:40:30.544 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123280719 2024-09-13T06:40:30.544 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:30.544 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:30.544 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:30.544 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.788119+0000", 2024-09-13T06:40:30.544 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000100558 2024-09-13T06:40:30.545 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:30.545 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:30.545 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:30.545 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.788288+0000", 2024-09-13T06:40:30.545 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000168751 2024-09-13T06:40:30.545 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:30.545 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:30.545 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:30.545 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:30.545 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:30.545 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43255 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 329728~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:40:30.545 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.664743+0000", 2024-09-13T06:40:30.545 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 8.8112988219999995, 2024-09-13T06:40:30.545 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.12381711500000001, 2024-09-13T06:40:30.546 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:30.546 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:30.546 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:30.546 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:30.546 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:30.546 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43255 2024-09-13T06:40:30.546 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:30.546 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:30.546 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:30.546 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:30.546 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664743+0000", 2024-09-13T06:40:30.546 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:30.546 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:30.547 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:30.547 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:30.547 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664743+0000", 2024-09-13T06:40:30.547 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:30.547 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:30.547 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:30.547 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:30.547 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664742+0000", 2024-09-13T06:40:30.547 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:30.547 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:30.547 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:30.547 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:30.547 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664745+0000", 2024-09-13T06:40:30.548 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.7269999999999999e-06 2024-09-13T06:40:30.548 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:30.548 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:30.548 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:30.548 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664753+0000", 2024-09-13T06:40:30.548 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.8709999999999997e-06 2024-09-13T06:40:30.548 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:30.548 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:30.548 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:30.548 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664758+0000", 2024-09-13T06:40:30.548 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2220000000000001e-06 2024-09-13T06:40:30.548 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:30.548 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:30.548 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:30.549 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.788314+0000", 2024-09-13T06:40:30.549 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123555545 2024-09-13T06:40:30.549 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:30.549 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:30.549 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:30.549 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.788368+0000", 2024-09-13T06:40:30.549 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3928999999999998e-05 2024-09-13T06:40:30.549 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:30.549 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:30.549 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:30.549 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.788560+0000", 2024-09-13T06:40:30.549 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000192237 2024-09-13T06:40:30.549 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:30.550 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:30.550 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:30.550 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:30.550 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:30.550 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43256 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 344064~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:40:30.550 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.664763+0000", 2024-09-13T06:40:30.550 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 8.8112788759999994, 2024-09-13T06:40:30.550 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.12418359399999999, 2024-09-13T06:40:30.550 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:30.550 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:30.550 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:30.550 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:30.550 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:30.550 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43256 2024-09-13T06:40:30.551 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:30.551 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:30.551 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:30.551 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:30.551 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664763+0000", 2024-09-13T06:40:30.551 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:30.551 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:30.551 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:30.551 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:30.551 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664763+0000", 2024-09-13T06:40:30.551 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:30.551 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:30.551 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:30.552 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:30.552 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664762+0000", 2024-09-13T06:40:30.552 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:30.552 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:30.552 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:30.552 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:30.552 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664765+0000", 2024-09-13T06:40:30.552 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3290000000000001e-06 2024-09-13T06:40:30.552 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:30.552 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:30.552 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:30.552 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664771+0000", 2024-09-13T06:40:30.553 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.1319999999999999e-06 2024-09-13T06:40:30.553 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:30.553 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:30.553 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:30.553 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664776+0000", 2024-09-13T06:40:30.553 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.8840000000000002e-06 2024-09-13T06:40:30.553 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:30.553 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:30.553 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:30.553 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.788598+0000", 2024-09-13T06:40:30.553 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123821979 2024-09-13T06:40:30.553 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:30.553 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:30.554 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:30.554 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.788680+0000", 2024-09-13T06:40:30.554 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.2367999999999995e-05 2024-09-13T06:40:30.554 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:30.554 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:30.554 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:30.554 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.788946+0000", 2024-09-13T06:40:30.554 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00026629799999999999 2024-09-13T06:40:30.554 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:30.554 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:30.554 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:30.554 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:30.554 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:30.554 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43265 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 477184~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:40:30.555 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.669414+0000", 2024-09-13T06:40:30.555 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 8.8066272399999992, 2024-09-13T06:40:30.555 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123446973, 2024-09-13T06:40:30.555 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:30.555 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:30.555 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:30.555 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:30.555 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:30.555 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43265 2024-09-13T06:40:30.555 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:30.555 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:30.555 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:30.555 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:30.556 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669414+0000", 2024-09-13T06:40:30.556 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:30.556 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:30.556 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:30.556 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:30.556 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669414+0000", 2024-09-13T06:40:30.556 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:30.556 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:30.556 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:30.557 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:30.557 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669414+0000", 2024-09-13T06:40:30.557 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:30.557 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:30.557 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:30.557 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:30.557 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669416+0000", 2024-09-13T06:40:30.557 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.317e-06 2024-09-13T06:40:30.557 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:30.557 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:30.557 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:30.557 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669425+0000", 2024-09-13T06:40:30.557 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.0650000000000005e-06 2024-09-13T06:40:30.557 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:30.558 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:30.558 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:30.558 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669430+0000", 2024-09-13T06:40:30.558 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5079999999999999e-06 2024-09-13T06:40:30.558 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:30.558 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:30.558 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:30.558 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.792649+0000", 2024-09-13T06:40:30.558 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123219328 2024-09-13T06:40:30.558 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:30.558 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:30.558 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:30.558 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.792695+0000", 2024-09-13T06:40:30.559 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5476999999999998e-05 2024-09-13T06:40:30.559 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:30.559 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:30.559 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:30.559 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.792861+0000", 2024-09-13T06:40:30.559 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00016658999999999999 2024-09-13T06:40:30.559 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:30.559 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:30.559 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:30.559 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:30.559 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:30.559 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43266 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 491520~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:40:30.559 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.669434+0000", 2024-09-13T06:40:30.560 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 8.8066071180000005, 2024-09-13T06:40:30.560 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123685267, 2024-09-13T06:40:30.560 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:30.560 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:30.560 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:30.560 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:30.560 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:30.560 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43266 2024-09-13T06:40:30.560 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:30.560 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:30.560 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:30.560 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:30.560 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669434+0000", 2024-09-13T06:40:30.561 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:30.561 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:30.561 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:30.561 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:30.561 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669434+0000", 2024-09-13T06:40:30.561 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:30.561 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:30.561 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:30.561 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:30.561 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669434+0000", 2024-09-13T06:40:30.561 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:30.561 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:30.561 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:30.562 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:30.562 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669441+0000", 2024-09-13T06:40:30.562 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3019999999999997e-06 2024-09-13T06:40:30.562 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:30.562 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:30.562 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:30.562 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669451+0000", 2024-09-13T06:40:30.562 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.6379999999999999e-06 2024-09-13T06:40:30.562 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:30.562 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:30.562 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:30.562 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669456+0000", 2024-09-13T06:40:30.562 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.361e-06 2024-09-13T06:40:30.562 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:30.563 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:30.563 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:30.563 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.792879+0000", 2024-09-13T06:40:30.563 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123422686 2024-09-13T06:40:30.563 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:30.563 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:30.563 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:30.563 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.792923+0000", 2024-09-13T06:40:30.563 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4035000000000001e-05 2024-09-13T06:40:30.563 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:30.563 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:30.563 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:30.563 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.793120+0000", 2024-09-13T06:40:30.564 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00019660899999999999 2024-09-13T06:40:30.564 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:30.564 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:30.564 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:30.564 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:30.564 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:30.564 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43267 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 505856~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:40:30.564 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.669461+0000", 2024-09-13T06:40:30.564 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 8.8065803220000003, 2024-09-13T06:40:30.564 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123933711, 2024-09-13T06:40:30.564 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:30.564 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:30.564 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:30.565 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:30.565 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:30.565 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43267 2024-09-13T06:40:30.565 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:30.565 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:30.565 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:30.565 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:30.565 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669461+0000", 2024-09-13T06:40:30.565 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:30.565 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:30.565 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:30.565 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:30.565 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669461+0000", 2024-09-13T06:40:30.566 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:30.566 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:30.566 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:30.566 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:30.566 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669461+0000", 2024-09-13T06:40:30.566 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:30.566 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:30.566 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:30.566 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:30.566 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669463+0000", 2024-09-13T06:40:30.566 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5629999999999999e-06 2024-09-13T06:40:30.566 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:30.566 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:30.566 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:30.567 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669473+0000", 2024-09-13T06:40:30.567 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.9520000000000006e-06 2024-09-13T06:40:30.567 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:30.567 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:30.567 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:30.567 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669479+0000", 2024-09-13T06:40:30.567 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8540000000000002e-06 2024-09-13T06:40:30.567 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:30.567 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:30.567 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:30.567 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.793137+0000", 2024-09-13T06:40:30.567 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.12365825699999999 2024-09-13T06:40:30.567 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:30.568 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:30.568 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:30.568 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.793181+0000", 2024-09-13T06:40:30.568 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.3773999999999998e-05 2024-09-13T06:40:30.568 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:30.568 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:30.568 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:30.568 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.793395+0000", 2024-09-13T06:40:30.568 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00021372399999999999 2024-09-13T06:40:30.568 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:30.568 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:30.568 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:30.568 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:30.568 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:30.568 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43268 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 520192~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:40:30.569 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.669484+0000", 2024-09-13T06:40:30.569 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 8.8065575369999998, 2024-09-13T06:40:30.569 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.12441057899999999, 2024-09-13T06:40:30.569 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:30.569 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:30.569 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:30.569 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:30.569 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:30.569 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43268 2024-09-13T06:40:30.569 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:30.569 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:30.569 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:30.569 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:30.569 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669484+0000", 2024-09-13T06:40:30.570 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:30.570 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:30.570 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:30.570 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:30.570 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669484+0000", 2024-09-13T06:40:30.570 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:30.570 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:30.570 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:30.570 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:30.570 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669484+0000", 2024-09-13T06:40:30.570 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:30.570 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:30.570 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:30.571 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:30.571 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669486+0000", 2024-09-13T06:40:30.571 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6120000000000001e-06 2024-09-13T06:40:30.571 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:30.571 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:30.571 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:30.571 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669494+0000", 2024-09-13T06:40:30.571 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4819999999999997e-06 2024-09-13T06:40:30.571 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:30.571 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:30.571 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:30.571 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669497+0000", 2024-09-13T06:40:30.571 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9790000000000002e-06 2024-09-13T06:40:30.571 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:30.572 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:30.573 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:30.573 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.793559+0000", 2024-09-13T06:40:30.573 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.124062436 2024-09-13T06:40:30.573 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:30.573 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:30.573 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:30.573 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.793603+0000", 2024-09-13T06:40:30.573 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.3764999999999999e-05 2024-09-13T06:40:30.573 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:30.574 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:30.574 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:30.574 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.793895+0000", 2024-09-13T06:40:30.574 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00029168299999999999 2024-09-13T06:40:30.574 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:30.574 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:30.574 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:30.574 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:30.574 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:30.574 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:40:30.576 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-13T06:40:30.576 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:40:30.574+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:40:30.677 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-13T06:40:30.674+0000 7f86a5f06640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26387) UID: 0 2024-09-13T06:40:30.709 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:40:30.709 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-13T06:40:30.709 INFO:teuthology.orchestra.run.smithi081.stdout: "num_ops": 0 2024-09-13T06:40:30.709 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:40:30.723 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-13T06:40:30.778 INFO:tasks.ceph.osd.6.smithi139.stderr:2024-09-13T06:40:30.774+0000 7fcd02c5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26385) UID: 0 2024-09-13T06:40:30.845 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:40:30.845 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-13T06:40:30.845 INFO:teuthology.orchestra.run.smithi081.stdout: "complaint_time": 30, 2024-09-13T06:40:30.845 INFO:teuthology.orchestra.run.smithi081.stdout: "num_blocked_ops": 0 2024-09-13T06:40:30.845 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:40:30.859 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-13T06:40:30.879 INFO:tasks.ceph.osd.6.smithi139.stderr:2024-09-13T06:40:30.878+0000 7fcd02c5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26385) UID: 0 2024-09-13T06:40:30.979 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:40:30.980 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 20, 2024-09-13T06:40:30.980 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 600, 2024-09-13T06:40:30.980 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [ 2024-09-13T06:40:30.980 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:30.980 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:21979 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 14217216~4096 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:40:30.980 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.888811+0000", 2024-09-13T06:40:30.980 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 38.09085391, 2024-09-13T06:40:30.980 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049092969, 2024-09-13T06:40:30.980 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:30.980 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:30.980 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:30.981 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:30.981 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:30.981 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 21979 2024-09-13T06:40:30.981 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:30.981 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:30.981 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:30.981 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:30.981 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888811+0000", 2024-09-13T06:40:30.981 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:30.981 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:30.981 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:30.982 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:30.982 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888811+0000", 2024-09-13T06:40:30.982 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:30.982 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:30.982 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:30.982 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:30.982 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888811+0000", 2024-09-13T06:40:30.982 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:40:30.982 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:30.982 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:30.982 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:30.982 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888812+0000", 2024-09-13T06:40:30.982 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.204e-06 2024-09-13T06:40:30.983 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:30.983 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:30.983 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:30.983 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888815+0000", 2024-09-13T06:40:30.983 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9359999999999999e-06 2024-09-13T06:40:30.983 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:30.983 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:30.983 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:30.983 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888818+0000", 2024-09-13T06:40:30.983 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.7369999999999998e-06 2024-09-13T06:40:30.983 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:30.983 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:30.983 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:30.984 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.937663+0000", 2024-09-13T06:40:30.984 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.048844540999999998 2024-09-13T06:40:30.984 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:30.984 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:30.984 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:30.984 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.937709+0000", 2024-09-13T06:40:30.984 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6492999999999997e-05 2024-09-13T06:40:30.984 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:30.984 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:30.984 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:30.984 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.937904+0000", 2024-09-13T06:40:30.984 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00019526499999999999 2024-09-13T06:40:30.984 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:30.985 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:30.985 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:30.985 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:30.985 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:30.985 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:21980 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 14245888~4096 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:40:30.985 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.888820+0000", 2024-09-13T06:40:30.985 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 38.090845233000003, 2024-09-13T06:40:30.985 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049357080999999997, 2024-09-13T06:40:30.985 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:30.985 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:30.985 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:30.985 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:30.986 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:30.986 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 21980 2024-09-13T06:40:30.986 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:30.986 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:30.986 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:30.986 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:30.986 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888820+0000", 2024-09-13T06:40:30.986 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:30.986 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:30.986 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:30.986 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:30.986 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888820+0000", 2024-09-13T06:40:30.986 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:30.987 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:30.987 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:30.987 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:30.987 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888820+0000", 2024-09-13T06:40:30.987 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:40:30.987 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:30.987 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:30.987 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:30.987 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888821+0000", 2024-09-13T06:40:30.987 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.122e-06 2024-09-13T06:40:30.988 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:30.988 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:30.988 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:30.988 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888824+0000", 2024-09-13T06:40:30.988 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.0580000000000002e-06 2024-09-13T06:40:30.988 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:30.988 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:30.988 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:30.988 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888827+0000", 2024-09-13T06:40:30.988 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.666e-06 2024-09-13T06:40:30.989 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:30.989 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:30.989 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:30.989 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.937935+0000", 2024-09-13T06:40:30.989 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049108329999999999 2024-09-13T06:40:30.989 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:30.989 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:30.989 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:30.990 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.937985+0000", 2024-09-13T06:40:30.990 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9694000000000002e-05 2024-09-13T06:40:30.990 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:30.990 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:30.990 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:30.990 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.938177+0000", 2024-09-13T06:40:30.990 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00019241899999999999 2024-09-13T06:40:30.990 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:30.990 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:30.990 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:30.991 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:30.991 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:30.991 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:21984 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:snapdir [list-snaps] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:40:30.991 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.888829+0000", 2024-09-13T06:40:30.991 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 38.090836455000002, 2024-09-13T06:40:30.991 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049524545000000003, 2024-09-13T06:40:30.991 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:30.991 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:30.991 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:30.991 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:30.991 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:30.992 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 21984 2024-09-13T06:40:30.992 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:30.992 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:30.992 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:30.992 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:30.992 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888829+0000", 2024-09-13T06:40:30.992 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:30.992 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:30.992 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:30.992 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:30.992 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888829+0000", 2024-09-13T06:40:30.993 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:30.993 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:30.993 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:30.993 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:30.993 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888829+0000", 2024-09-13T06:40:30.993 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:40:30.993 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:30.993 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:30.994 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:30.994 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888830+0000", 2024-09-13T06:40:30.994 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2529999999999999e-06 2024-09-13T06:40:30.994 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:30.994 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:30.994 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:30.995 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888835+0000", 2024-09-13T06:40:30.995 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.4729999999999999e-06 2024-09-13T06:40:30.995 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:30.995 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:30.995 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:30.995 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888840+0000", 2024-09-13T06:40:30.996 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0159999999999999e-06 2024-09-13T06:40:30.996 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:30.996 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:30.996 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:30.996 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.938199+0000", 2024-09-13T06:40:30.996 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049358974999999999 2024-09-13T06:40:30.996 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:30.996 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:30.996 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:30.996 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.938268+0000", 2024-09-13T06:40:30.996 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.8876999999999998e-05 2024-09-13T06:40:30.996 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:30.996 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:30.997 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:30.997 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.938353+0000", 2024-09-13T06:40:30.997 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.5155999999999996e-05 2024-09-13T06:40:30.997 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:30.997 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:30.997 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:30.997 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:30.997 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:30.997 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:21985 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 12587008~4096 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:40:30.997 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.888858+0000", 2024-09-13T06:40:30.997 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 38.090807304999998, 2024-09-13T06:40:30.998 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049674347000000001, 2024-09-13T06:40:30.998 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:30.998 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:30.998 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:30.998 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:30.998 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:30.998 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 21985 2024-09-13T06:40:30.998 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:30.998 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:30.998 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:30.998 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:30.998 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888858+0000", 2024-09-13T06:40:30.998 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:30.999 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:30.999 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:30.999 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:30.999 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888858+0000", 2024-09-13T06:40:30.999 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:30.999 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:30.999 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:30.999 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:30.999 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888857+0000", 2024-09-13T06:40:30.999 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:30.999 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:30.999 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:30.999 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:31.000 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888860+0000", 2024-09-13T06:40:31.000 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4739999999999999e-06 2024-09-13T06:40:31.000 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:31.000 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:31.000 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:31.000 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888867+0000", 2024-09-13T06:40:31.000 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.7170000000000002e-06 2024-09-13T06:40:31.000 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:31.000 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:31.000 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:31.000 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888871+0000", 2024-09-13T06:40:31.000 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5120000000000002e-06 2024-09-13T06:40:31.000 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:31.001 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:31.001 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:31.001 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.938389+0000", 2024-09-13T06:40:31.001 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049517717000000003 2024-09-13T06:40:31.001 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:31.001 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:31.001 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:31.001 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.938449+0000", 2024-09-13T06:40:31.001 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0513999999999997e-05 2024-09-13T06:40:31.001 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:31.001 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:31.002 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:31.002 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.938532+0000", 2024-09-13T06:40:31.002 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.2936999999999996e-05 2024-09-13T06:40:31.002 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:31.002 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:31.002 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:31.002 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:31.002 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:31.002 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:21986 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 12615680~4096 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:40:31.002 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.888875+0000", 2024-09-13T06:40:31.002 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 38.090789792000002, 2024-09-13T06:40:31.002 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049881781, 2024-09-13T06:40:31.003 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:31.003 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:31.003 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:31.003 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:31.003 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:31.003 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 21986 2024-09-13T06:40:31.003 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:31.003 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:31.003 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:31.003 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:31.004 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888875+0000", 2024-09-13T06:40:31.004 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:31.004 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:31.004 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:31.004 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:31.004 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888875+0000", 2024-09-13T06:40:31.004 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:31.004 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:31.005 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:31.005 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:31.005 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888875+0000", 2024-09-13T06:40:31.005 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:31.005 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:31.005 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:31.005 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:31.005 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888880+0000", 2024-09-13T06:40:31.006 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7600000000000002e-06 2024-09-13T06:40:31.006 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:31.006 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:31.006 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:31.006 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888887+0000", 2024-09-13T06:40:31.006 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3950000000000003e-06 2024-09-13T06:40:31.006 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:31.006 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:31.006 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:31.006 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888892+0000", 2024-09-13T06:40:31.006 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0409999999999997e-06 2024-09-13T06:40:31.006 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:31.006 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:31.007 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:31.007 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.938568+0000", 2024-09-13T06:40:31.007 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049675267000000002 2024-09-13T06:40:31.007 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:31.007 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:31.007 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:31.007 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.938653+0000", 2024-09-13T06:40:31.007 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.5792999999999997e-05 2024-09-13T06:40:31.007 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:31.007 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:31.007 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:31.007 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.938757+0000", 2024-09-13T06:40:31.007 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00010387699999999999 2024-09-13T06:40:31.008 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:31.008 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:31.008 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:31.008 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:31.008 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:31.008 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:21987 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 12644352~4096 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:40:31.008 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.888899+0000", 2024-09-13T06:40:31.008 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 38.090766446000003, 2024-09-13T06:40:31.009 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.050094056999999997, 2024-09-13T06:40:31.009 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:31.009 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:31.009 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:31.009 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:31.009 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:31.010 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 21987 2024-09-13T06:40:31.010 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:31.010 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:31.010 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:31.010 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:31.010 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888899+0000", 2024-09-13T06:40:31.011 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:31.011 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:31.011 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:31.011 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:31.011 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888899+0000", 2024-09-13T06:40:31.011 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:31.011 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:31.011 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:31.011 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:31.011 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888899+0000", 2024-09-13T06:40:31.011 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:31.011 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:31.012 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:31.012 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:31.012 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888901+0000", 2024-09-13T06:40:31.012 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2539999999999999e-06 2024-09-13T06:40:31.012 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:31.012 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:31.012 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:31.012 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888907+0000", 2024-09-13T06:40:31.012 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9009999999999999e-06 2024-09-13T06:40:31.012 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:31.012 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:31.013 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:31.013 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888912+0000", 2024-09-13T06:40:31.013 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9840000000000001e-06 2024-09-13T06:40:31.013 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:31.013 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:31.013 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:31.013 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.938810+0000", 2024-09-13T06:40:31.013 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049898835000000002 2024-09-13T06:40:31.013 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:31.013 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:31.013 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:31.013 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.938890+0000", 2024-09-13T06:40:31.014 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.9215000000000006e-05 2024-09-13T06:40:31.014 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:31.014 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:31.014 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:31.014 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.938993+0000", 2024-09-13T06:40:31.014 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000103194 2024-09-13T06:40:31.014 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:31.014 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:31.014 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:31.014 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:31.014 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:31.014 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:21988 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 12673024~4096 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:40:31.014 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.888916+0000", 2024-09-13T06:40:31.014 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 38.090749430000002, 2024-09-13T06:40:31.015 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.050203036999999999, 2024-09-13T06:40:31.015 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:31.015 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:31.015 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:31.015 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:31.015 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:31.015 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 21988 2024-09-13T06:40:31.015 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:31.015 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:31.015 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:31.015 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:31.015 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888916+0000", 2024-09-13T06:40:31.015 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:31.016 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:31.016 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:31.016 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:31.016 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888916+0000", 2024-09-13T06:40:31.016 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:31.016 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:31.016 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:31.016 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:31.017 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888915+0000", 2024-09-13T06:40:31.017 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:31.017 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:31.017 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:31.017 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:31.017 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888918+0000", 2024-09-13T06:40:31.017 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1500000000000002e-06 2024-09-13T06:40:31.017 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:31.017 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:31.017 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:31.017 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888925+0000", 2024-09-13T06:40:31.017 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.9380000000000003e-06 2024-09-13T06:40:31.017 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:31.018 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:31.018 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:31.018 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888933+0000", 2024-09-13T06:40:31.018 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.0560000000000005e-06 2024-09-13T06:40:31.018 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:31.018 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:31.018 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:31.018 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.939026+0000", 2024-09-13T06:40:31.018 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.050093499999999999 2024-09-13T06:40:31.018 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:31.018 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:31.018 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:31.019 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.939068+0000", 2024-09-13T06:40:31.019 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.1705999999999997e-05 2024-09-13T06:40:31.019 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:31.019 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:31.019 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:31.019 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.939119+0000", 2024-09-13T06:40:31.019 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.1048999999999999e-05 2024-09-13T06:40:31.019 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:31.019 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:31.019 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:31.019 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:31.019 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:31.020 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:21989 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 12701696~4096 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:40:31.020 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.888938+0000", 2024-09-13T06:40:31.020 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 38.090727102999999, 2024-09-13T06:40:31.020 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.050294393999999999, 2024-09-13T06:40:31.020 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:31.020 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:31.020 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:31.020 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:31.020 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:31.020 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 21989 2024-09-13T06:40:31.021 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:31.021 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:31.021 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:31.021 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:31.021 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888938+0000", 2024-09-13T06:40:31.021 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:31.021 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:31.021 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:31.021 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:31.021 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888938+0000", 2024-09-13T06:40:31.021 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:31.021 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:31.021 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:31.022 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:31.022 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888938+0000", 2024-09-13T06:40:31.022 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:31.022 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:31.022 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:31.022 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:31.022 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888940+0000", 2024-09-13T06:40:31.022 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5330000000000001e-06 2024-09-13T06:40:31.022 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:31.022 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:31.023 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:31.023 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888947+0000", 2024-09-13T06:40:31.023 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.2389999999999999e-06 2024-09-13T06:40:31.023 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:31.023 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:31.023 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:31.023 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888952+0000", 2024-09-13T06:40:31.023 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.5720000000000002e-06 2024-09-13T06:40:31.023 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:31.023 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:31.024 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:31.024 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.939141+0000", 2024-09-13T06:40:31.024 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.050188903999999999 2024-09-13T06:40:31.024 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:31.024 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:31.024 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:31.024 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.939182+0000", 2024-09-13T06:40:31.024 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.0926000000000001e-05 2024-09-13T06:40:31.024 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:31.024 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:31.024 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:31.025 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.939233+0000", 2024-09-13T06:40:31.025 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0532999999999999e-05 2024-09-13T06:40:31.025 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:31.025 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:31.025 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:31.025 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:31.025 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:31.025 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:22006 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 13189120~4096 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:40:31.025 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.892763+0000", 2024-09-13T06:40:31.025 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 38.086902576999996, 2024-09-13T06:40:31.025 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.048963505999999997, 2024-09-13T06:40:31.025 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:31.025 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:31.026 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:31.026 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:31.026 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:31.026 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 22006 2024-09-13T06:40:31.026 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:31.026 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:31.026 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:31.026 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:31.026 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892763+0000", 2024-09-13T06:40:31.026 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:31.026 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:31.026 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:31.027 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:31.027 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892763+0000", 2024-09-13T06:40:31.027 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:31.027 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:31.027 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:31.027 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:31.027 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892763+0000", 2024-09-13T06:40:31.027 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:40:31.027 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:31.027 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:31.027 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:31.027 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892764+0000", 2024-09-13T06:40:31.027 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2410000000000001e-06 2024-09-13T06:40:31.028 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:31.028 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:31.028 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:31.028 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892767+0000", 2024-09-13T06:40:31.028 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9390000000000002e-06 2024-09-13T06:40:31.028 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:31.028 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:31.028 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:31.028 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892769+0000", 2024-09-13T06:40:31.028 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5390000000000002e-06 2024-09-13T06:40:31.028 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:31.028 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:31.029 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:31.029 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.941560+0000", 2024-09-13T06:40:31.029 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.048791221000000003 2024-09-13T06:40:31.029 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:31.029 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:31.029 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:31.029 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.941632+0000", 2024-09-13T06:40:31.029 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.1932000000000002e-05 2024-09-13T06:40:31.029 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:31.029 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:31.029 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:31.029 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.941726+0000", 2024-09-13T06:40:31.029 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.3839999999999996e-05 2024-09-13T06:40:31.029 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:31.030 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:31.030 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:31.030 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:31.030 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:31.030 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:22007 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 13217792~4096 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:40:31.030 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.892771+0000", 2024-09-13T06:40:31.030 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 38.086893996999997, 2024-09-13T06:40:31.030 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049090024000000003, 2024-09-13T06:40:31.030 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:31.030 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:31.030 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:31.030 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:31.030 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:31.030 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 22007 2024-09-13T06:40:31.031 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:31.031 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:31.031 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:31.031 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:31.031 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892771+0000", 2024-09-13T06:40:31.031 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:31.031 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:31.031 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:31.031 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:31.031 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892771+0000", 2024-09-13T06:40:31.031 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:31.031 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:31.031 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:31.032 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:31.032 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892771+0000", 2024-09-13T06:40:31.032 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:40:31.032 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:31.032 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:31.032 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:31.032 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892772+0000", 2024-09-13T06:40:31.032 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.184e-06 2024-09-13T06:40:31.032 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:31.032 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:31.032 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:31.032 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892775+0000", 2024-09-13T06:40:31.032 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9179999999999998e-06 2024-09-13T06:40:31.033 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:31.033 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:31.033 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:31.033 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892778+0000", 2024-09-13T06:40:31.033 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4990000000000001e-06 2024-09-13T06:40:31.033 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:31.033 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:31.033 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:31.033 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.941760+0000", 2024-09-13T06:40:31.033 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.048982070000000003 2024-09-13T06:40:31.033 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:31.033 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:31.033 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:31.034 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.941808+0000", 2024-09-13T06:40:31.034 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.8278000000000001e-05 2024-09-13T06:40:31.034 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:31.034 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:31.034 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:31.034 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.941861+0000", 2024-09-13T06:40:31.034 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3284e-05 2024-09-13T06:40:31.034 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:31.034 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:31.034 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:31.034 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:31.035 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:31.035 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:22008 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 13246464~4096 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:40:31.035 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.892780+0000", 2024-09-13T06:40:31.035 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 38.086885340000002, 2024-09-13T06:40:31.035 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049200477999999999, 2024-09-13T06:40:31.035 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:31.035 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:31.035 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:31.035 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:31.035 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:31.035 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 22008 2024-09-13T06:40:31.035 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:31.035 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:31.035 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:31.036 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:31.036 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892780+0000", 2024-09-13T06:40:31.036 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:31.036 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:31.036 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:31.036 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:31.036 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892780+0000", 2024-09-13T06:40:31.036 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:31.036 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:31.036 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:31.036 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:31.036 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892780+0000", 2024-09-13T06:40:31.036 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:40:31.037 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:31.037 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:31.037 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:31.037 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892781+0000", 2024-09-13T06:40:31.037 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.083e-06 2024-09-13T06:40:31.037 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:31.037 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:31.037 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:31.037 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892784+0000", 2024-09-13T06:40:31.037 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.926e-06 2024-09-13T06:40:31.037 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:31.037 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:31.038 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:31.038 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892786+0000", 2024-09-13T06:40:31.038 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4490000000000002e-06 2024-09-13T06:40:31.038 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:31.038 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:31.038 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:31.038 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.941888+0000", 2024-09-13T06:40:31.038 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049102290999999999 2024-09-13T06:40:31.038 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:31.038 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:31.038 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:31.038 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.941929+0000", 2024-09-13T06:40:31.039 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.0541999999999999e-05 2024-09-13T06:40:31.039 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:31.039 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:31.039 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:31.039 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.941980+0000", 2024-09-13T06:40:31.039 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.1391999999999999e-05 2024-09-13T06:40:31.039 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:31.039 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:31.039 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:31.039 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:31.039 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:31.040 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:22009 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 13275136~4096 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:40:31.040 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.892788+0000", 2024-09-13T06:40:31.040 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 38.086876856000003, 2024-09-13T06:40:31.040 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049311926999999998, 2024-09-13T06:40:31.040 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:31.040 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:31.040 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:31.040 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:31.040 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:31.040 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 22009 2024-09-13T06:40:31.040 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:31.041 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:31.041 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:31.041 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:31.041 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892788+0000", 2024-09-13T06:40:31.041 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:31.041 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:31.041 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:31.041 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:31.041 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892788+0000", 2024-09-13T06:40:31.041 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:31.041 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:31.041 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:31.041 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:31.042 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892788+0000", 2024-09-13T06:40:31.042 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:40:31.042 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:31.042 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:31.042 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:31.042 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892789+0000", 2024-09-13T06:40:31.042 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1850000000000001e-06 2024-09-13T06:40:31.042 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:31.042 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:31.042 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:31.042 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892793+0000", 2024-09-13T06:40:31.042 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.9099999999999998e-06 2024-09-13T06:40:31.042 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:31.043 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:31.043 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:31.043 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892798+0000", 2024-09-13T06:40:31.043 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5070000000000002e-06 2024-09-13T06:40:31.043 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:31.043 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:31.043 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:31.043 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.942007+0000", 2024-09-13T06:40:31.043 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049208904999999997 2024-09-13T06:40:31.043 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:31.043 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:31.043 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:31.043 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.942049+0000", 2024-09-13T06:40:31.044 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.1922000000000003e-05 2024-09-13T06:40:31.044 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:31.044 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:31.044 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:31.044 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.942100+0000", 2024-09-13T06:40:31.044 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.1736000000000001e-05 2024-09-13T06:40:31.044 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:31.044 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:31.044 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:31.044 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:31.044 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:31.045 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:22010 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 13303808~4096 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:40:31.045 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.892817+0000", 2024-09-13T06:40:31.045 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 38.086848660000001, 2024-09-13T06:40:31.045 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049466149000000001, 2024-09-13T06:40:31.045 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:31.045 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:31.045 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:31.045 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:31.045 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:31.045 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 22010 2024-09-13T06:40:31.046 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:31.046 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:31.046 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:31.046 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:31.046 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892817+0000", 2024-09-13T06:40:31.046 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:31.046 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:31.046 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:31.046 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:31.046 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892817+0000", 2024-09-13T06:40:31.046 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:31.047 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:31.047 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:31.047 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:31.047 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892816+0000", 2024-09-13T06:40:31.047 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:31.047 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:31.047 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:31.047 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:31.047 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892821+0000", 2024-09-13T06:40:31.047 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9459999999999997e-06 2024-09-13T06:40:31.047 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:31.047 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:31.047 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:31.048 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892828+0000", 2024-09-13T06:40:31.048 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.6780000000000003e-06 2024-09-13T06:40:31.048 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:31.048 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:31.048 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:31.048 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892833+0000", 2024-09-13T06:40:31.048 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.8389999999999997e-06 2024-09-13T06:40:31.048 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:31.048 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:31.048 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:31.048 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.942127+0000", 2024-09-13T06:40:31.048 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049294163000000002 2024-09-13T06:40:31.048 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:31.049 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:31.049 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:31.049 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.942186+0000", 2024-09-13T06:40:31.049 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9335e-05 2024-09-13T06:40:31.049 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:31.049 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:31.049 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:31.049 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.942283+0000", 2024-09-13T06:40:31.049 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.6699000000000004e-05 2024-09-13T06:40:31.049 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:31.049 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:31.049 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:31.049 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:31.049 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:31.050 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:22011 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 13332480~4096 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:40:31.050 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.892838+0000", 2024-09-13T06:40:31.050 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 38.086826973000001, 2024-09-13T06:40:31.050 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049589214, 2024-09-13T06:40:31.050 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:31.050 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:31.050 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:31.050 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:31.050 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:31.050 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 22011 2024-09-13T06:40:31.050 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:31.051 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:31.051 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:31.051 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:31.051 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892838+0000", 2024-09-13T06:40:31.051 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:31.051 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:31.051 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:31.051 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:31.051 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892838+0000", 2024-09-13T06:40:31.051 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:31.051 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:31.051 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:31.051 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:31.052 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892838+0000", 2024-09-13T06:40:31.052 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:31.052 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:31.052 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:31.052 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:31.052 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892840+0000", 2024-09-13T06:40:31.052 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.136e-06 2024-09-13T06:40:31.052 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:31.052 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:31.052 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:31.052 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892852+0000", 2024-09-13T06:40:31.052 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2122e-05 2024-09-13T06:40:31.052 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:31.053 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:31.053 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:31.053 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892862+0000", 2024-09-13T06:40:31.053 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.7049999999999994e-06 2024-09-13T06:40:31.053 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:31.053 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:31.053 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:31.053 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.942319+0000", 2024-09-13T06:40:31.053 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049456623999999998 2024-09-13T06:40:31.053 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:31.054 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:31.054 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:31.054 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.942363+0000", 2024-09-13T06:40:31.054 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4759000000000003e-05 2024-09-13T06:40:31.054 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:31.054 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:31.054 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:31.054 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.942428+0000", 2024-09-13T06:40:31.054 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.4221999999999996e-05 2024-09-13T06:40:31.054 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:31.054 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:31.054 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:31.054 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:31.054 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:31.055 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:22033 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 13963264~4096 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:40:31.055 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.896824+0000", 2024-09-13T06:40:31.055 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 38.082841080000001, 2024-09-13T06:40:31.055 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049051957, 2024-09-13T06:40:31.055 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:31.055 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:31.055 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:31.055 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:31.055 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:31.055 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 22033 2024-09-13T06:40:31.055 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:31.055 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:31.055 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:31.056 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:31.056 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.896824+0000", 2024-09-13T06:40:31.056 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:31.056 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:31.056 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:31.056 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:31.056 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.896824+0000", 2024-09-13T06:40:31.056 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:31.056 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:31.056 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:31.056 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:31.057 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.896824+0000", 2024-09-13T06:40:31.057 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:31.057 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:31.057 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:31.057 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:31.057 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.896826+0000", 2024-09-13T06:40:31.057 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1900000000000002e-06 2024-09-13T06:40:31.057 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:31.057 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:31.057 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:31.057 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.896832+0000", 2024-09-13T06:40:31.057 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.2689999999999996e-06 2024-09-13T06:40:31.057 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:31.058 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:31.058 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:31.058 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.896840+0000", 2024-09-13T06:40:31.058 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3289999999999996e-06 2024-09-13T06:40:31.058 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:31.058 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:31.058 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:31.058 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.945777+0000", 2024-09-13T06:40:31.058 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.048937188 2024-09-13T06:40:31.058 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:31.058 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:31.058 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:31.058 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.945822+0000", 2024-09-13T06:40:31.058 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4780999999999997e-05 2024-09-13T06:40:31.059 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:31.059 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:31.059 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:31.059 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.945876+0000", 2024-09-13T06:40:31.059 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.4542000000000001e-05 2024-09-13T06:40:31.059 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:31.059 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:31.059 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:31.059 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:31.059 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:31.059 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:22337 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 13582336~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:40:31.060 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.951039+0000", 2024-09-13T06:40:31.060 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 38.028626742999997, 2024-09-13T06:40:31.060 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.048942765999999999, 2024-09-13T06:40:31.060 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:31.060 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:31.060 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:31.060 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:31.060 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:31.060 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 22337 2024-09-13T06:40:31.060 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:31.060 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:31.060 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:31.060 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:31.061 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951039+0000", 2024-09-13T06:40:31.061 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:31.061 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:31.061 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:31.061 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:31.061 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951039+0000", 2024-09-13T06:40:31.061 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:31.061 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:31.061 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:31.061 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:31.061 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951038+0000", 2024-09-13T06:40:31.061 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:31.061 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:31.062 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:31.062 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:31.062 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951040+0000", 2024-09-13T06:40:31.062 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0669999999999999e-06 2024-09-13T06:40:31.062 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:31.062 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:31.062 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:31.062 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951048+0000", 2024-09-13T06:40:31.062 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.588e-06 2024-09-13T06:40:31.062 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:31.062 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:31.062 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:31.063 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951053+0000", 2024-09-13T06:40:31.063 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3669999999999996e-06 2024-09-13T06:40:31.063 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:31.063 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:31.063 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:31.063 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.999889+0000", 2024-09-13T06:40:31.064 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.048835515000000003 2024-09-13T06:40:31.064 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:31.064 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:31.064 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:31.064 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.999929+0000", 2024-09-13T06:40:31.064 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.0030000000000001e-05 2024-09-13T06:40:31.064 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:31.065 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:31.065 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:31.065 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.999981+0000", 2024-09-13T06:40:31.065 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2583999999999997e-05 2024-09-13T06:40:31.065 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:31.065 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:31.065 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:31.065 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:31.065 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:31.065 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:22338 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 13611008~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:40:31.065 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.951070+0000", 2024-09-13T06:40:31.066 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 38.028595451999998, 2024-09-13T06:40:31.066 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049135817999999998, 2024-09-13T06:40:31.066 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:31.066 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:31.066 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:31.066 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:31.066 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:31.066 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 22338 2024-09-13T06:40:31.066 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:31.066 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:31.066 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:31.066 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:31.066 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951070+0000", 2024-09-13T06:40:31.067 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:31.067 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:31.067 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:31.067 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:31.067 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951070+0000", 2024-09-13T06:40:31.067 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:31.067 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:31.067 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:31.067 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:31.067 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951069+0000", 2024-09-13T06:40:31.067 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:31.067 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:31.067 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:31.068 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:31.068 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951072+0000", 2024-09-13T06:40:31.068 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5909999999999998e-06 2024-09-13T06:40:31.068 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:31.068 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:31.068 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:31.068 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951078+0000", 2024-09-13T06:40:31.068 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.4450000000000001e-06 2024-09-13T06:40:31.068 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:31.068 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:31.068 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:31.068 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951083+0000", 2024-09-13T06:40:31.069 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7790000000000003e-06 2024-09-13T06:40:31.069 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:31.069 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:31.069 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:31.069 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:53.000020+0000", 2024-09-13T06:40:31.069 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.048936999000000002 2024-09-13T06:40:31.069 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:31.069 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:31.069 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:31.069 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:53.000106+0000", 2024-09-13T06:40:31.069 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.5532999999999996e-05 2024-09-13T06:40:31.069 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:31.069 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:31.070 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:31.070 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:53.000206+0000", 2024-09-13T06:40:31.070 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.9852999999999994e-05 2024-09-13T06:40:31.070 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:31.070 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:31.070 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:31.070 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:31.070 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:31.070 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:22339 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 13639680~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:40:31.070 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.951088+0000", 2024-09-13T06:40:31.070 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 38.028577753999997, 2024-09-13T06:40:31.070 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049238202000000002, 2024-09-13T06:40:31.070 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:31.071 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:31.071 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:31.071 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:31.071 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:31.071 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 22339 2024-09-13T06:40:31.071 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:31.071 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:31.071 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:31.071 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:31.071 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951088+0000", 2024-09-13T06:40:31.071 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:31.071 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:31.071 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:31.071 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:31.072 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951088+0000", 2024-09-13T06:40:31.072 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:31.072 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:31.072 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:31.072 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:31.072 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951087+0000", 2024-09-13T06:40:31.072 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:31.072 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:31.072 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:31.072 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:31.072 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951089+0000", 2024-09-13T06:40:31.072 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.153e-06 2024-09-13T06:40:31.073 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:31.073 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:31.073 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:31.073 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951093+0000", 2024-09-13T06:40:31.073 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.7120000000000002e-06 2024-09-13T06:40:31.073 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:31.073 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:31.073 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:31.073 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951096+0000", 2024-09-13T06:40:31.073 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.0570000000000001e-06 2024-09-13T06:40:31.073 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:31.073 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:31.073 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:31.074 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:53.000220+0000", 2024-09-13T06:40:31.074 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049123989 2024-09-13T06:40:31.074 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:31.074 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:31.075 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:31.075 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:53.000271+0000", 2024-09-13T06:40:31.075 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.062e-05 2024-09-13T06:40:31.075 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:31.075 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:31.075 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:31.076 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:53.000326+0000", 2024-09-13T06:40:31.076 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.5121000000000003e-05 2024-09-13T06:40:31.076 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:31.076 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:31.076 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:31.077 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:31.077 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:31.077 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:22340 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 13668352~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:40:31.077 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.951200+0000", 2024-09-13T06:40:31.077 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 38.028464864999997, 2024-09-13T06:40:31.078 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049352350000000003, 2024-09-13T06:40:31.078 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:31.078 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:31.078 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:31.078 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:31.078 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:31.078 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 22340 2024-09-13T06:40:31.079 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:31.079 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:31.079 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:31.079 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:31.079 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951200+0000", 2024-09-13T06:40:31.079 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:31.079 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:31.079 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:31.079 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:31.079 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951200+0000", 2024-09-13T06:40:31.079 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:31.079 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:31.079 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:31.080 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:31.080 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951098+0000", 2024-09-13T06:40:31.080 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.999898 2024-09-13T06:40:31.080 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:31.080 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:31.080 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:31.080 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951204+0000", 2024-09-13T06:40:31.080 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000105398 2024-09-13T06:40:31.080 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:31.080 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:31.081 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:31.081 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951211+0000", 2024-09-13T06:40:31.081 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.43e-06 2024-09-13T06:40:31.081 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:31.081 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:31.081 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:31.081 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951216+0000", 2024-09-13T06:40:31.081 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2800000000000003e-06 2024-09-13T06:40:31.081 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:31.081 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:31.081 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:31.081 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:53.000358+0000", 2024-09-13T06:40:31.082 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049142036 2024-09-13T06:40:31.082 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:31.082 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:31.082 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:31.082 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:53.000443+0000", 2024-09-13T06:40:31.082 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.4710999999999996e-05 2024-09-13T06:40:31.082 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:31.082 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:31.082 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:31.082 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:53.000553+0000", 2024-09-13T06:40:31.083 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000109622 2024-09-13T06:40:31.083 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:31.083 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:31.083 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:31.083 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:31.083 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:31.083 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:22348 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 13897728~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:40:31.083 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.952783+0000", 2024-09-13T06:40:31.083 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 38.026882077000003, 2024-09-13T06:40:31.083 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049120832000000003, 2024-09-13T06:40:31.083 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:31.083 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:31.083 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:31.083 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:31.084 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:31.084 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 22348 2024-09-13T06:40:31.084 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:31.084 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:31.084 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:31.084 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:31.084 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.952783+0000", 2024-09-13T06:40:31.084 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:31.084 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:31.084 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:31.084 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:31.084 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.952783+0000", 2024-09-13T06:40:31.084 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:31.085 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:31.085 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:31.085 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:31.085 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.952783+0000", 2024-09-13T06:40:31.085 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:31.085 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:31.085 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:31.085 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:31.085 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.952785+0000", 2024-09-13T06:40:31.085 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4980000000000001e-06 2024-09-13T06:40:31.085 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:31.085 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:31.085 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:31.085 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.952799+0000", 2024-09-13T06:40:31.086 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3825000000000001e-05 2024-09-13T06:40:31.086 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:31.086 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:31.086 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:31.086 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.952809+0000", 2024-09-13T06:40:31.086 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0043e-05 2024-09-13T06:40:31.086 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:31.086 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:31.086 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:31.086 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:53.001723+0000", 2024-09-13T06:40:31.086 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.048914065 2024-09-13T06:40:31.086 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:31.086 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:31.086 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:31.087 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:53.001807+0000", 2024-09-13T06:40:31.087 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.3776000000000006e-05 2024-09-13T06:40:31.087 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:31.087 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:31.087 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:31.087 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:53.001904+0000", 2024-09-13T06:40:31.087 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.7004999999999997e-05 2024-09-13T06:40:31.087 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:31.087 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:31.087 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:31.087 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:31.087 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:31.087 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:40:31.088 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-13T06:40:31.089 INFO:tasks.ceph.osd.6.smithi139.stderr:2024-09-13T06:40:30.982+0000 7fcd02c5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26385) UID: 0 2024-09-13T06:40:31.090 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-13T06:40:31.091 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-13T06:40:31.090+0000 7f86a5f06640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26387) UID: 0 2024-09-13T06:40:31.190 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:40:31.188+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:40:31.255 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:40:31.255 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [ 2024-09-13T06:40:31.255 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:31.255 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:47163 3.13 3.ed327d33 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e77)", 2024-09-13T06:40:31.256 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:30.380763+0000", 2024-09-13T06:40:31.256 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.87811715700000004, 2024-09-13T06:40:31.256 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.878140217, 2024-09-13T06:40:31.256 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:31.256 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "waiting for peered", 2024-09-13T06:40:31.256 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:31.256 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:31.256 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:31.256 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 47163 2024-09-13T06:40:31.256 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:31.256 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:31.256 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:31.257 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:31.257 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:30.380763+0000", 2024-09-13T06:40:31.257 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:31.257 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:31.257 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:31.257 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:31.257 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:30.380763+0000", 2024-09-13T06:40:31.257 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:31.257 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:31.257 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:31.257 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:31.257 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:30.380761+0000", 2024-09-13T06:40:31.257 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999976 2024-09-13T06:40:31.258 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:31.258 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:31.258 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:31.258 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:30.380772+0000", 2024-09-13T06:40:31.258 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0696999999999999e-05 2024-09-13T06:40:31.258 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:31.258 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:31.258 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:31.258 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:30.380793+0000", 2024-09-13T06:40:31.258 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1773e-05 2024-09-13T06:40:31.258 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:31.258 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:31.258 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:31.259 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:30.380806+0000", 2024-09-13T06:40:31.259 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2882e-05 2024-09-13T06:40:31.259 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:31.259 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:31.259 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:31.259 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:30.380876+0000", 2024-09-13T06:40:31.259 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.9580999999999997e-05 2024-09-13T06:40:31.259 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:31.259 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:31.259 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:40:31.259 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:30.380888+0000", 2024-09-13T06:40:31.259 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2663999999999999e-05 2024-09-13T06:40:31.259 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:31.259 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:31.260 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:31.260 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:31.260 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-13T06:40:31.260 INFO:teuthology.orchestra.run.smithi081.stdout: "num_ops": 1 2024-09-13T06:40:31.260 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:40:31.274 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-13T06:40:31.284 INFO:teuthology.orchestra.run.smithi081.stdout:osd.0: {} 2024-09-13T06:40:31.284 INFO:teuthology.orchestra.run.smithi081.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-13T06:40:31.291 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:40:31.290+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:40:31.300 INFO:teuthology.orchestra.run.smithi081.stdout:osd.1: {} 2024-09-13T06:40:31.301 INFO:teuthology.orchestra.run.smithi081.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-13T06:40:31.317 INFO:teuthology.orchestra.run.smithi081.stdout:osd.2: {} 2024-09-13T06:40:31.318 INFO:teuthology.orchestra.run.smithi081.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-13T06:40:31.334 INFO:teuthology.orchestra.run.smithi081.stdout:osd.3: {} 2024-09-13T06:40:31.334 INFO:teuthology.orchestra.run.smithi081.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-13T06:40:31.354 INFO:teuthology.orchestra.run.smithi081.stdout:osd.4: {} 2024-09-13T06:40:31.354 INFO:teuthology.orchestra.run.smithi081.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-13T06:40:31.379 INFO:teuthology.orchestra.run.smithi081.stdout:osd.5: {} 2024-09-13T06:40:31.379 INFO:teuthology.orchestra.run.smithi081.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-13T06:40:31.393 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-13T06:40:31.390+0000 7f86a5f06640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26387) UID: 0 2024-09-13T06:40:31.399 INFO:teuthology.orchestra.run.smithi081.stdout:osd.6: {} 2024-09-13T06:40:31.400 INFO:teuthology.orchestra.run.smithi081.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-13T06:40:31.403 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-13T06:40:31.403 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:40:31.404 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:40:31.419 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-13T06:40:31.420 INFO:teuthology.orchestra.run.smithi081.stdout:osd.7: {} 2024-09-13T06:40:31.421 INFO:teuthology.orchestra.run.smithi081.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-13T06:40:31.493 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:40:31.494+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:40:31.536 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:40:31.537 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:40:31.553 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-13T06:40:31.605 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:40:31.604+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:40:31.670 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:40:31.670 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:40:31.684 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-13T06:40:31.725 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:40:31.724+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:40:31.796 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:40:31.792+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:40:31.832 INFO:teuthology.orchestra.run.smithi081.stdout:checking clone #10, image image_client.0-clone10 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent11 2024-09-13T06:40:31.841 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:40:31.842 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:40:31.858 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-13T06:40:31.897 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-13T06:40:31.894+0000 7f86a5f06640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26387) UID: 0 2024-09-13T06:40:31.997 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:40:31.996+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:40:32.039 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:40:32.039 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:40:32.056 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-13T06:40:32.101 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:40:32.100+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:40:32.185 INFO:teuthology.orchestra.run.smithi081.stdout:2070 read 0x472e139 thru 0x472fab7 (0x197f bytes) 2024-09-13T06:40:32.189 INFO:teuthology.orchestra.run.smithi081.stdout:2071 trunc from 0xd909826 to 0xafb7178 2024-09-13T06:40:32.196 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:40:32.196 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:40:32.199 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:40:32.196+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:40:32.212 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-13T06:40:32.214 INFO:teuthology.orchestra.run.smithi081.stdout:2072 read 0x6b9084d thru 0x6b94a23 (0x41d7 bytes) 2024-09-13T06:40:32.216 INFO:teuthology.orchestra.run.smithi081.stdout:2073 trunc from 0xafb7178 to 0xc359781 2024-09-13T06:40:32.224 INFO:teuthology.orchestra.run.smithi081.stdout:2076 read 0x70ff33b thru 0x710e7b4 (0xf47a bytes) 2024-09-13T06:40:32.224 INFO:teuthology.orchestra.run.smithi081.stdout:2077 punch from 0x6bd347a to 0x6be2308, (0xee8e bytes) 2024-09-13T06:40:32.224 INFO:teuthology.orchestra.run.smithi081.stdout:2078 writesame 0xda7ea thru 0xdfe85 data_size 0x17(0x569c bytes) 2024-09-13T06:40:32.226 INFO:teuthology.orchestra.run.smithi081.stdout:2079 punch from 0x48c42a to 0x48e269, (0x1e3f bytes) 2024-09-13T06:40:32.226 INFO:teuthology.orchestra.run.smithi081.stdout:2080 read 0x412f1e3 thru 0x413ec1d (0xfa3b bytes) 2024-09-13T06:40:32.226 INFO:teuthology.orchestra.run.smithi081.stdout:2081 writesame 0x142f4ef thru 0x143b355 data_size 0x1(0xbe67 bytes) 2024-09-13T06:40:32.255 INFO:teuthology.orchestra.run.smithi081.stdout:2082 read 0x8dbc2f4 thru 0x8dc37d4 (0x74e1 bytes) 2024-09-13T06:40:32.255 INFO:teuthology.orchestra.run.smithi081.stdout:2083 punch from 0x590f38c to 0x59109b9, (0x162d bytes) 2024-09-13T06:40:32.255 INFO:teuthology.orchestra.run.smithi081.stdout:2084 write 0xff5c87 thru 0xffdbe7 (0x7f61 bytes) 2024-09-13T06:40:32.260 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:40:32.260 INFO:teuthology.orchestra.run.smithi081.stdout:2087 punch from 0x8144add to 0x814b1fb, (0x671e bytes) 2024-09-13T06:40:32.264 INFO:teuthology.orchestra.run.smithi081.stdout:2089 trunc from 0xc359781 to 0x926f78b 2024-09-13T06:40:32.275 INFO:teuthology.orchestra.run.smithi081.stdout:2090 punch from 0x74e9f73 to 0x74ede67, (0x3ef4 bytes) 2024-09-13T06:40:32.275 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:40:32.275 INFO:teuthology.orchestra.run.smithi081.stdout:2092 read 0x4635fa7 thru 0x464455b (0xe5b5 bytes) 2024-09-13T06:40:32.291 INFO:teuthology.orchestra.run.smithi081.stdout:2093 writesame 0xce2661d thru 0xce36035 data_size 0x41(0xfa19 bytes) 2024-09-13T06:40:32.291 INFO:teuthology.orchestra.run.smithi081.stdout:2094 punch from 0xbb652e0 to 0xbb6b816, (0x6536 bytes) 2024-09-13T06:40:32.292 INFO:teuthology.orchestra.run.smithi081.stdout:2096 write 0x8044b5f thru 0x80533b4 (0xe856 bytes) 2024-09-13T06:40:32.297 INFO:teuthology.orchestra.run.smithi081.stdout:2097 punch from 0x6e10e53 to 0x6e200d6, (0xf283 bytes) 2024-09-13T06:40:32.297 INFO:teuthology.orchestra.run.smithi081.stdout:2098 write 0xb3534a0 thru 0xb3575e8 (0x4149 bytes) 2024-09-13T06:40:32.299 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:40:32.296+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:40:32.302 INFO:teuthology.orchestra.run.smithi081.stdout:2099 read 0x552f4c6 thru 0x5531793 (0x22ce bytes) 2024-09-13T06:40:32.302 INFO:teuthology.orchestra.run.smithi081.stdout:2100 read 0x2c44643 thru 0x2c4bdf1 (0x77af bytes) 2024-09-13T06:40:32.302 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:40:32.303 INFO:teuthology.orchestra.run.smithi081.stdout:2105 writesame 0xc23d225 thru 0xc24a275 data_size 0x1(0xd051 bytes) 2024-09-13T06:40:32.343 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:40:32.343 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:40:32.358 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-13T06:40:32.378 INFO:teuthology.orchestra.run.smithi081.stdout:2106 punch from 0x859d377 to 0x85ab4b5, (0xe13e bytes) 2024-09-13T06:40:32.379 INFO:teuthology.orchestra.run.smithi081.stdout:2108 write 0x892e24d thru 0x89325b1 (0x4365 bytes) 2024-09-13T06:40:32.385 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:40:32.385 INFO:teuthology.orchestra.run.smithi081.stdout:2112 write 0xcabe74e thru 0xcac127f (0x2b32 bytes) 2024-09-13T06:40:32.395 INFO:teuthology.orchestra.run.smithi081.stdout:2116 read 0x5686dae thru 0x568ad09 (0x3f5c bytes) 2024-09-13T06:40:32.395 INFO:teuthology.orchestra.run.smithi081.stdout:2117 read 0x1603cc0 thru 0x1603e50 (0x191 bytes) 2024-09-13T06:40:32.395 INFO:teuthology.orchestra.run.smithi081.stdout:2118 write 0x14b84b4 thru 0x14bb0b8 (0x2c05 bytes) 2024-09-13T06:40:32.400 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:40:32.400+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:40:32.404 INFO:teuthology.orchestra.run.smithi081.stdout:2119 punch from 0x26ad905 to 0x26b9262, (0xb95d bytes) 2024-09-13T06:40:32.404 INFO:teuthology.orchestra.run.smithi081.stdout:2120 write 0x7245021 thru 0x724eafc (0x9adc bytes) 2024-09-13T06:40:32.416 INFO:teuthology.orchestra.run.smithi081.stdout:2121 trunc from 0xce36036 to 0xe53cab6 2024-09-13T06:40:32.426 INFO:teuthology.orchestra.run.smithi081.stdout:2122 read 0x1b47bce thru 0x1b4cb91 (0x4fc4 bytes) 2024-09-13T06:40:32.426 INFO:teuthology.orchestra.run.smithi081.stdout:2123 write 0x4074796 thru 0x4078f6c (0x47d7 bytes) 2024-09-13T06:40:32.432 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:40:32.433 INFO:teuthology.orchestra.run.smithi081.stdout:2125 read 0x924e9e2 thru 0x925e67d (0xfc9c bytes) 2024-09-13T06:40:32.433 INFO:teuthology.orchestra.run.smithi081.stdout:2127 punch from 0x9d1dafe to 0x9d24eaf, (0x73b1 bytes) 2024-09-13T06:40:32.433 INFO:teuthology.orchestra.run.smithi081.stdout:2128 write 0xc717006 thru 0xc71a435 (0x3430 bytes) 2024-09-13T06:40:32.435 INFO:teuthology.orchestra.run.smithi081.stdout:2130 writesame 0xdf0cfdd thru 0xdf0d530 data_size 0x16(0x554 bytes) 2024-09-13T06:40:32.441 INFO:teuthology.orchestra.run.smithi081.stdout:2131 write 0xa9332ab thru 0xa937825 (0x457b bytes) 2024-09-13T06:40:32.448 INFO:teuthology.orchestra.run.smithi081.stdout:2134 punch from 0x5e2b67 to 0x5ee18a, (0xb623 bytes) 2024-09-13T06:40:32.448 INFO:teuthology.orchestra.run.smithi081.stdout:2135 writesame 0x976a322 thru 0x976af17 data_size 0x1(0xbf6 bytes) 2024-09-13T06:40:32.455 INFO:teuthology.orchestra.run.smithi081.stdout:2137 write 0xb7d9ba1 thru 0xb7dbc61 (0x20c1 bytes) 2024-09-13T06:40:32.462 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:40:32.462 INFO:teuthology.orchestra.run.smithi081.stdout:2139 write 0x5d9a0cc thru 0x5d9a6b4 (0x5e9 bytes) 2024-09-13T06:40:32.469 INFO:teuthology.orchestra.run.smithi081.stdout:2140 writesame 0x4667aa5 thru 0x46740e5 data_size 0x1(0xc641 bytes) 2024-09-13T06:40:32.480 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:40:32.481 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:40:32.494 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-13T06:40:32.501 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:40:32.500+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:40:32.535 INFO:teuthology.orchestra.run.smithi081.stdout:2141 write 0x7945aa6 thru 0x794cd21 (0x727c bytes) 2024-09-13T06:40:32.542 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:40:32.542 INFO:teuthology.orchestra.run.smithi081.stdout:2143 punch from 0x2d5f082 to 0x2d68cdb, (0x9c59 bytes) 2024-09-13T06:40:32.542 INFO:teuthology.orchestra.run.smithi081.stdout:2144 punch from 0x1810381 to 0x181404b, (0x3cca bytes) 2024-09-13T06:40:32.542 INFO:teuthology.orchestra.run.smithi081.stdout:2145 read 0x82c4924 thru 0x82c5b03 (0x11e0 bytes) 2024-09-13T06:40:32.559 INFO:teuthology.orchestra.run.smithi081.stderr:noscrub is unset 2024-09-13T06:40:32.566 INFO:teuthology.orchestra.run.smithi081.stdout:2146 writesame 0xe7dae66 thru 0xe7e0454 data_size 0x1(0x55ef bytes) 2024-09-13T06:40:32.566 INFO:teuthology.orchestra.run.smithi081.stdout:2148 writesame 0x8b762b9 thru 0x8b8458c data_size 0x12(0xe2d4 bytes) 2024-09-13T06:40:32.573 INFO:teuthology.orchestra.run.smithi081.stdout:2149 read 0xc012a93 thru 0xc021762 (0xecd0 bytes) 2024-09-13T06:40:32.573 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:40:32.573 INFO:teuthology.orchestra.run.smithi081.stdout:2151 read 0x5589dc3 thru 0x559926a (0xf4a8 bytes) 2024-09-13T06:40:32.573 INFO:teuthology.orchestra.run.smithi081.stdout:2154 write 0x6dd73fa thru 0x6ddd28c (0x5e93 bytes) 2024-09-13T06:40:32.624 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:40:32.624 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:40:32.629 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:40:32.628+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:40:32.638 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-13T06:40:32.702 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:40:32.704+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:40:32.759 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:40:32.759 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:40:32.774 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-13T06:40:32.803 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:40:32.804+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:40:32.895 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:40:32.896 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:40:32.904 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-13T06:40:32.902+0000 7f86a5f06640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26387) UID: 0 2024-09-13T06:40:32.909 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-13T06:40:33.005 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:40:33.004+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:40:33.076 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:40:33.076 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:40:33.090 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-13T06:40:33.105 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:40:33.104+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:40:33.206 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:40:33.204+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:40:33.211 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:40:33.212 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:40:33.227 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-13T06:40:33.307 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-13T06:40:33.306+0000 7f86a5f06640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26387) UID: 0 2024-09-13T06:40:33.346 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:40:33.346 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:40:33.362 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-13T06:40:33.408 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:40:33.408+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:40:33.441 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-13T06:40:33.509 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-13T06:40:33.506+0000 7f86a5f06640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26387) UID: 0 2024-09-13T06:40:33.525 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:40:33.525 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:40:33.539 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-13T06:40:33.566 INFO:teuthology.orchestra.run.smithi081.stdout:2155 write 0x6d42e1f thru 0x6d492a6 (0x6488 bytes) 2024-09-13T06:40:33.571 INFO:teuthology.orchestra.run.smithi081.stdout:2156 read 0x418493e thru 0x41880cb (0x378e bytes) 2024-09-13T06:40:33.571 INFO:teuthology.orchestra.run.smithi081.stdout:2157 write 0x5afb41 thru 0x5b14df (0x199f bytes) 2024-09-13T06:40:33.573 INFO:teuthology.orchestra.run.smithi081.stdout:2160 punch from 0x7cf489f to 0x7cf80c7, (0x3828 bytes) 2024-09-13T06:40:33.593 INFO:teuthology.orchestra.run.smithi081.stdout:2161 trunc from 0xe7e0455 to 0xfaccca 2024-09-13T06:40:33.609 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:40:33.608+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:40:33.612 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:40:33.612 INFO:teuthology.orchestra.run.smithi081.stdout:2164 read 0x65a344 thru 0x65b5a3 (0x1260 bytes) 2024-09-13T06:40:33.613 INFO:teuthology.orchestra.run.smithi081.stdout:2165 punch from 0xccfcf2 to 0xcd1b12, (0x1e20 bytes) 2024-09-13T06:40:33.613 INFO:teuthology.orchestra.run.smithi081.stdout:2166 punch from 0x148695 to 0x14a688, (0x1ff3 bytes) 2024-09-13T06:40:33.613 INFO:teuthology.orchestra.run.smithi081.stdout:2168 read 0x8e48c2 thru 0x8e92bf (0x49fe bytes) 2024-09-13T06:40:33.613 INFO:teuthology.orchestra.run.smithi081.stdout:2169 punch from 0x50197d to 0x508ee0, (0x7563 bytes) 2024-09-13T06:40:33.613 INFO:teuthology.orchestra.run.smithi081.stdout:2170 punch from 0x5ce231 to 0x5d0485, (0x2254 bytes) 2024-09-13T06:40:33.614 INFO:teuthology.orchestra.run.smithi081.stdout:osd.0: {} 2024-09-13T06:40:33.614 INFO:teuthology.orchestra.run.smithi081.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-13T06:40:33.632 INFO:teuthology.orchestra.run.smithi081.stdout:osd.1: {} 2024-09-13T06:40:33.632 INFO:teuthology.orchestra.run.smithi081.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-13T06:40:33.639 INFO:teuthology.orchestra.run.smithi081.stdout:2174 write 0xe42fada thru 0xe430950 (0xe77 bytes) 2024-09-13T06:40:33.643 INFO:teuthology.orchestra.run.smithi081.stdout:2176 write 0x818f3bd thru 0x819a367 (0xafab bytes) 2024-09-13T06:40:33.646 INFO:teuthology.orchestra.run.smithi081.stdout:2177 writesame 0x1a2481d thru 0x1a25913 data_size 0x1(0x10f7 bytes) 2024-09-13T06:40:33.650 INFO:teuthology.orchestra.run.smithi081.stdout:osd.2: {} 2024-09-13T06:40:33.650 INFO:teuthology.orchestra.run.smithi081.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-13T06:40:33.650 INFO:teuthology.orchestra.run.smithi081.stdout:2179 writesame 0x560b43b thru 0x56197d6 data_size 0xe(0xe39c bytes) 2024-09-13T06:40:33.655 INFO:teuthology.orchestra.run.smithi081.stdout:2180 writesame 0x1aebc3 thru 0x1ba534 data_size 0x7(0xb972 bytes) 2024-09-13T06:40:33.659 INFO:teuthology.orchestra.run.smithi081.stdout:2184 writesame 0xc5686eb thru 0xc56d88e data_size 0x4c(0x51a4 bytes) 2024-09-13T06:40:33.663 INFO:teuthology.orchestra.run.smithi081.stdout:2185 clone 13 order 21 su 262144 sc 11 2024-09-13T06:40:33.668 INFO:teuthology.orchestra.run.smithi081.stdout:osd.3: {} 2024-09-13T06:40:33.669 INFO:teuthology.orchestra.run.smithi081.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-13T06:40:33.687 INFO:teuthology.orchestra.run.smithi081.stdout:osd.4: {} 2024-09-13T06:40:33.687 INFO:teuthology.orchestra.run.smithi081.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-13T06:40:33.707 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:40:33.707 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:40:33.707 INFO:teuthology.orchestra.run.smithi081.stdout:osd.5: {} 2024-09-13T06:40:33.707 INFO:teuthology.orchestra.run.smithi081.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-13T06:40:33.710 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:40:33.708+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:40:33.721 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-13T06:40:33.725 INFO:teuthology.orchestra.run.smithi081.stdout:osd.6: {} 2024-09-13T06:40:33.725 INFO:teuthology.orchestra.run.smithi081.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-13T06:40:33.744 INFO:teuthology.orchestra.run.smithi081.stdout:osd.7: {} 2024-09-13T06:40:33.745 INFO:teuthology.orchestra.run.smithi081.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-13T06:40:33.812 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:40:33.808+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:40:33.844 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:40:33.845 INFO:teuthology.orchestra.run.smithi139.stdout: "size": 20, 2024-09-13T06:40:33.845 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 600, 2024-09-13T06:40:33.845 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [ 2024-09-13T06:40:33.845 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:33.845 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4154.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-13T06:40:33.845 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:11.143816+0000", 2024-09-13T06:40:33.845 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 82.701565630000005, 2024-09-13T06:40:33.845 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.062483034, 2024-09-13T06:40:33.845 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:33.845 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:40:33.846 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:33.846 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4154", 2024-09-13T06:40:33.846 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/2406930292", 2024-09-13T06:40:33.846 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 1 2024-09-13T06:40:33.846 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:33.846 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:33.846 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:33.846 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:33.846 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.143816+0000", 2024-09-13T06:40:33.846 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:33.846 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:33.846 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:33.846 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:33.847 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.143816+0000", 2024-09-13T06:40:33.847 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:33.847 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:33.847 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:33.847 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:33.847 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.143814+0000", 2024-09-13T06:40:33.847 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999976 2024-09-13T06:40:33.847 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:33.847 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:33.847 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:33.847 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.143829+0000", 2024-09-13T06:40:33.847 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5316999999999999e-05 2024-09-13T06:40:33.847 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:33.847 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:33.848 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:33.848 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.143851+0000", 2024-09-13T06:40:33.848 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.1736999999999999e-05 2024-09-13T06:40:33.848 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:33.848 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:33.848 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:33.848 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.143870+0000", 2024-09-13T06:40:33.848 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.9185999999999999e-05 2024-09-13T06:40:33.848 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:33.848 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:33.848 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:33.848 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.143973+0000", 2024-09-13T06:40:33.848 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000102896 2024-09-13T06:40:33.849 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:33.849 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:33.849 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:40:33.849 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.143987+0000", 2024-09-13T06:40:33.849 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.401e-05 2024-09-13T06:40:33.849 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:33.849 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:33.849 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:33.849 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.203333+0000", 2024-09-13T06:40:33.849 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.059346614999999998 2024-09-13T06:40:33.849 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:33.849 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:33.850 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:33.850 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.203624+0000", 2024-09-13T06:40:33.850 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00029112700000000002 2024-09-13T06:40:33.850 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:33.850 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:33.850 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 0", 2024-09-13T06:40:33.850 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.203940+0000", 2024-09-13T06:40:33.850 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00031547200000000002 2024-09-13T06:40:33.850 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:33.850 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:33.850 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-13T06:40:33.850 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.205145+0000", 2024-09-13T06:40:33.850 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0012048930000000001 2024-09-13T06:40:33.850 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:33.851 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:33.851 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:40:33.851 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.206110+0000", 2024-09-13T06:40:33.851 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00096536600000000005 2024-09-13T06:40:33.851 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:33.851 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:33.851 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-13T06:40:33.851 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.206196+0000", 2024-09-13T06:40:33.851 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.5798999999999996e-05 2024-09-13T06:40:33.851 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:33.851 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:33.851 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:33.851 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.206299+0000", 2024-09-13T06:40:33.852 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00010279 2024-09-13T06:40:33.852 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:33.852 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:33.852 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:33.852 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:33.852 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:33.852 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4154.0:36 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-13T06:40:33.852 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:11.257357+0000", 2024-09-13T06:40:33.852 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 82.588024187000002, 2024-09-13T06:40:33.852 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.012807595, 2024-09-13T06:40:33.852 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:33.852 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:40:33.852 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:33.853 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4154", 2024-09-13T06:40:33.853 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/2406930292", 2024-09-13T06:40:33.853 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 36 2024-09-13T06:40:33.853 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:33.853 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:33.853 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:33.853 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:33.853 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.257357+0000", 2024-09-13T06:40:33.853 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:33.853 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:33.853 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:33.853 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:33.853 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.257357+0000", 2024-09-13T06:40:33.853 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:33.854 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:33.854 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:33.854 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:33.854 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.257356+0000", 2024-09-13T06:40:33.854 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:33.854 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:33.854 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:33.854 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:33.854 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.257378+0000", 2024-09-13T06:40:33.854 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.1988999999999999e-05 2024-09-13T06:40:33.854 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:33.854 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:33.854 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:33.855 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.257389+0000", 2024-09-13T06:40:33.855 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0343000000000001e-05 2024-09-13T06:40:33.855 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:33.855 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:33.855 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:33.855 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.257396+0000", 2024-09-13T06:40:33.855 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5839999999999997e-06 2024-09-13T06:40:33.855 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:33.855 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:33.855 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:33.855 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.264748+0000", 2024-09-13T06:40:33.855 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0073514640000000003 2024-09-13T06:40:33.855 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:33.856 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:33.856 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:33.856 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.264878+0000", 2024-09-13T06:40:33.856 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00012975500000000001 2024-09-13T06:40:33.856 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:33.856 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:33.856 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 0", 2024-09-13T06:40:33.856 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.265064+0000", 2024-09-13T06:40:33.856 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000186799 2024-09-13T06:40:33.856 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:33.856 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:33.856 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:40:33.856 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.267248+0000", 2024-09-13T06:40:33.856 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0021841230000000001 2024-09-13T06:40:33.857 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:33.857 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:33.857 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-13T06:40:33.857 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.269996+0000", 2024-09-13T06:40:33.857 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0027473419999999998 2024-09-13T06:40:33.857 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:33.857 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:33.857 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-13T06:40:33.857 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.270066+0000", 2024-09-13T06:40:33.857 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.0683000000000001e-05 2024-09-13T06:40:33.857 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:33.857 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:33.857 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:33.858 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.270165+0000", 2024-09-13T06:40:33.858 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.8319000000000005e-05 2024-09-13T06:40:33.858 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:33.858 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:33.858 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:33.858 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:33.858 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:33.858 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4154.0:37 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-13T06:40:33.858 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:11.257405+0000", 2024-09-13T06:40:33.858 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 82.587976006999995, 2024-09-13T06:40:33.858 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.012930476999999999, 2024-09-13T06:40:33.858 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:33.858 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:40:33.859 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:33.859 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4154", 2024-09-13T06:40:33.859 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/2406930292", 2024-09-13T06:40:33.859 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 37 2024-09-13T06:40:33.859 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:33.859 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:33.859 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:33.859 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:33.859 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.257405+0000", 2024-09-13T06:40:33.859 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:33.859 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:33.859 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:33.859 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:33.860 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.257405+0000", 2024-09-13T06:40:33.860 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:33.860 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:33.860 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:33.860 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:33.860 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.257405+0000", 2024-09-13T06:40:33.860 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:33.860 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:33.860 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:33.860 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:33.860 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.257411+0000", 2024-09-13T06:40:33.860 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.1500000000000004e-06 2024-09-13T06:40:33.861 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:33.861 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:33.861 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:33.861 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.257420+0000", 2024-09-13T06:40:33.861 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.986e-06 2024-09-13T06:40:33.861 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:33.861 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:33.861 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:33.861 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.257436+0000", 2024-09-13T06:40:33.861 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6433999999999999e-05 2024-09-13T06:40:33.861 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:33.861 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:33.861 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:33.862 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.265923+0000", 2024-09-13T06:40:33.862 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0084872009999999998 2024-09-13T06:40:33.862 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:33.862 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:33.862 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:33.862 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.266056+0000", 2024-09-13T06:40:33.862 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00013206599999999999 2024-09-13T06:40:33.862 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:33.862 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:33.862 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 0", 2024-09-13T06:40:33.862 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.266255+0000", 2024-09-13T06:40:33.862 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00019935100000000001 2024-09-13T06:40:33.862 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:33.863 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:33.863 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:40:33.863 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.267788+0000", 2024-09-13T06:40:33.863 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0015335380000000001 2024-09-13T06:40:33.863 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:33.863 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:33.863 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-13T06:40:33.863 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.270181+0000", 2024-09-13T06:40:33.863 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.002392136 2024-09-13T06:40:33.863 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:33.863 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:33.863 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-13T06:40:33.864 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.270245+0000", 2024-09-13T06:40:33.864 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.4401999999999998e-05 2024-09-13T06:40:33.864 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:33.864 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:33.864 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:33.864 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.270336+0000", 2024-09-13T06:40:33.864 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.0872999999999995e-05 2024-09-13T06:40:33.864 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:33.864 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:33.864 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:33.864 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:33.864 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:33.864 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4154.0:88 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-13T06:40:33.865 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:11.362174+0000", 2024-09-13T06:40:33.865 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 82.483207398999994, 2024-09-13T06:40:33.865 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.012171276, 2024-09-13T06:40:33.865 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:33.865 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:40:33.865 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:33.865 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4154", 2024-09-13T06:40:33.865 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/2406930292", 2024-09-13T06:40:33.865 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 88 2024-09-13T06:40:33.865 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:33.865 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:33.865 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:33.865 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:33.865 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.362174+0000", 2024-09-13T06:40:33.866 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:33.866 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:33.866 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:33.866 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:33.866 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.362174+0000", 2024-09-13T06:40:33.866 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:33.866 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:33.866 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:33.866 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:33.866 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.362172+0000", 2024-09-13T06:40:33.866 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999986 2024-09-13T06:40:33.866 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:33.866 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:33.867 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:33.867 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.362183+0000", 2024-09-13T06:40:33.867 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.081e-05 2024-09-13T06:40:33.867 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:33.867 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:33.867 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:33.867 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.362205+0000", 2024-09-13T06:40:33.867 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.1897000000000001e-05 2024-09-13T06:40:33.867 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:33.867 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:33.867 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:33.867 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.362221+0000", 2024-09-13T06:40:33.867 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5353e-05 2024-09-13T06:40:33.868 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:33.868 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:33.868 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:33.868 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.369202+0000", 2024-09-13T06:40:33.868 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0069816219999999998 2024-09-13T06:40:33.868 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:33.868 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:33.868 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:33.868 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.369323+0000", 2024-09-13T06:40:33.868 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000121156 2024-09-13T06:40:33.868 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:33.868 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:33.868 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 0", 2024-09-13T06:40:33.869 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.369683+0000", 2024-09-13T06:40:33.869 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00035930700000000001 2024-09-13T06:40:33.869 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:33.869 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:33.869 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:40:33.869 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.371448+0000", 2024-09-13T06:40:33.869 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.001765043 2024-09-13T06:40:33.869 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:33.869 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:33.869 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-13T06:40:33.869 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.374156+0000", 2024-09-13T06:40:33.869 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.002707999 2024-09-13T06:40:33.869 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:33.870 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:33.870 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-13T06:40:33.870 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.374243+0000", 2024-09-13T06:40:33.870 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6873000000000007e-05 2024-09-13T06:40:33.870 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:33.870 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:33.870 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:33.870 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.374345+0000", 2024-09-13T06:40:33.870 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00010272600000000001 2024-09-13T06:40:33.870 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:33.870 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:33.870 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:33.870 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:33.871 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:33.871 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4154.0:108 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-13T06:40:33.871 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:11.524074+0000", 2024-09-13T06:40:33.871 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 82.321307395000005, 2024-09-13T06:40:33.871 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.012736235, 2024-09-13T06:40:33.871 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:33.871 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:40:33.871 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:33.871 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4154", 2024-09-13T06:40:33.871 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/2406930292", 2024-09-13T06:40:33.871 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 108 2024-09-13T06:40:33.871 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:33.871 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:33.872 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:33.872 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:33.872 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.524074+0000", 2024-09-13T06:40:33.872 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:33.872 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:33.872 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:33.872 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:33.872 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.524074+0000", 2024-09-13T06:40:33.872 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:33.872 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:33.872 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:33.872 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:33.872 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.524073+0000", 2024-09-13T06:40:33.873 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:33.873 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:33.873 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:33.873 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:33.873 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.524084+0000", 2024-09-13T06:40:33.873 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1026000000000001e-05 2024-09-13T06:40:33.873 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:33.873 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:33.873 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:33.873 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.524102+0000", 2024-09-13T06:40:33.873 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7992999999999999e-05 2024-09-13T06:40:33.873 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:33.873 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:33.874 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:33.874 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.524140+0000", 2024-09-13T06:40:33.874 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.8277e-05 2024-09-13T06:40:33.874 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:33.874 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:33.874 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:33.874 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.528884+0000", 2024-09-13T06:40:33.874 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.004743761 2024-09-13T06:40:33.874 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:33.874 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:33.874 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:33.874 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.529006+0000", 2024-09-13T06:40:33.874 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000121829 2024-09-13T06:40:33.875 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:33.875 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:33.875 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 0", 2024-09-13T06:40:33.875 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.529196+0000", 2024-09-13T06:40:33.875 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000189731 2024-09-13T06:40:33.875 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:33.875 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:33.875 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:40:33.875 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.535697+0000", 2024-09-13T06:40:33.875 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0065011499999999998 2024-09-13T06:40:33.875 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:33.875 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:33.875 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-13T06:40:33.875 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.536644+0000", 2024-09-13T06:40:33.876 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00094732900000000001 2024-09-13T06:40:33.876 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:33.876 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:33.876 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-13T06:40:33.876 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.536712+0000", 2024-09-13T06:40:33.876 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.8303e-05 2024-09-13T06:40:33.876 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:33.876 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:33.876 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:33.876 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.536810+0000", 2024-09-13T06:40:33.876 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.7918999999999995e-05 2024-09-13T06:40:33.876 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:33.876 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:33.877 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:33.877 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:33.877 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:33.877 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4154.0:109 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-13T06:40:33.877 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:11.524169+0000", 2024-09-13T06:40:33.877 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 82.321212469000002, 2024-09-13T06:40:33.877 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.013995285999999999, 2024-09-13T06:40:33.877 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:33.877 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:40:33.877 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:33.877 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4154", 2024-09-13T06:40:33.877 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/2406930292", 2024-09-13T06:40:33.877 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 109 2024-09-13T06:40:33.878 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:33.878 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:33.878 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:33.878 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:33.878 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.524169+0000", 2024-09-13T06:40:33.878 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:33.878 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:33.878 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:33.878 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:33.878 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.524169+0000", 2024-09-13T06:40:33.878 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:33.878 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:33.878 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:33.878 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:33.879 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.524168+0000", 2024-09-13T06:40:33.879 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:33.879 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:33.879 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:33.879 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:33.879 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.524427+0000", 2024-09-13T06:40:33.879 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00025929799999999998 2024-09-13T06:40:33.879 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:33.879 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:33.879 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:33.879 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.524451+0000", 2024-09-13T06:40:33.879 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.3686e-05 2024-09-13T06:40:33.879 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:33.880 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:33.880 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:33.880 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.524468+0000", 2024-09-13T06:40:33.880 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7577000000000001e-05 2024-09-13T06:40:33.880 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:33.880 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:33.880 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:33.880 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.530416+0000", 2024-09-13T06:40:33.880 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0059474080000000004 2024-09-13T06:40:33.880 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:33.880 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:33.880 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:33.880 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.530553+0000", 2024-09-13T06:40:33.881 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000137742 2024-09-13T06:40:33.881 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:33.881 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:33.881 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 0", 2024-09-13T06:40:33.881 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.530749+0000", 2024-09-13T06:40:33.881 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000195608 2024-09-13T06:40:33.881 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:33.881 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:33.881 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-13T06:40:33.881 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.536836+0000", 2024-09-13T06:40:33.881 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.006086546 2024-09-13T06:40:33.881 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:33.881 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:33.882 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:40:33.882 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.538038+0000", 2024-09-13T06:40:33.882 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0012019509999999999 2024-09-13T06:40:33.882 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:33.882 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:33.882 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-13T06:40:33.882 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.538106+0000", 2024-09-13T06:40:33.882 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.8923000000000004e-05 2024-09-13T06:40:33.882 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:33.882 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:33.882 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:33.882 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.538164+0000", 2024-09-13T06:40:33.882 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.7729999999999998e-05 2024-09-13T06:40:33.883 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:33.883 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:33.883 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:33.883 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:33.883 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:33.883 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4154.0:110 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-13T06:40:33.883 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:11.524488+0000", 2024-09-13T06:40:33.883 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 82.320892991999997, 2024-09-13T06:40:33.883 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.013976323000000001, 2024-09-13T06:40:33.883 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:33.883 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:40:33.883 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:33.883 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4154", 2024-09-13T06:40:33.883 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/2406930292", 2024-09-13T06:40:33.884 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 110 2024-09-13T06:40:33.884 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:33.884 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:33.884 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:33.884 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:33.884 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.524488+0000", 2024-09-13T06:40:33.884 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:33.884 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:33.884 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:33.884 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:33.884 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.524488+0000", 2024-09-13T06:40:33.884 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:33.884 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:33.885 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:33.885 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:33.885 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.524487+0000", 2024-09-13T06:40:33.885 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999986 2024-09-13T06:40:33.885 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:33.885 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:33.885 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:33.885 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.524498+0000", 2024-09-13T06:40:33.885 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1579999999999999e-05 2024-09-13T06:40:33.886 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:33.886 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:33.886 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:33.886 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.524516+0000", 2024-09-13T06:40:33.886 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7776000000000001e-05 2024-09-13T06:40:33.886 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:33.886 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:33.886 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:33.886 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.524530+0000", 2024-09-13T06:40:33.886 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3896999999999999e-05 2024-09-13T06:40:33.886 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:33.886 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:33.886 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:33.886 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.532254+0000", 2024-09-13T06:40:33.887 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0077239409999999998 2024-09-13T06:40:33.887 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:33.887 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:33.887 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:33.887 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.532371+0000", 2024-09-13T06:40:33.887 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000117176 2024-09-13T06:40:33.887 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:33.887 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:33.887 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 0", 2024-09-13T06:40:33.887 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.532551+0000", 2024-09-13T06:40:33.887 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00018004100000000001 2024-09-13T06:40:33.887 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:33.887 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:33.887 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:40:33.888 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.538280+0000", 2024-09-13T06:40:33.888 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0057289230000000003 2024-09-13T06:40:33.888 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:33.888 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:33.888 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-13T06:40:33.888 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.538294+0000", 2024-09-13T06:40:33.888 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.4070000000000001e-05 2024-09-13T06:40:33.888 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:33.888 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:33.888 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-13T06:40:33.888 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.538368+0000", 2024-09-13T06:40:33.888 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.3604999999999997e-05 2024-09-13T06:40:33.888 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:33.889 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:33.889 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:33.889 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.538465+0000", 2024-09-13T06:40:33.889 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6830000000000006e-05 2024-09-13T06:40:33.889 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:33.889 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:33.889 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:33.889 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:33.889 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:33.889 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4154.0:111 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-13T06:40:33.889 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:11.524546+0000", 2024-09-13T06:40:33.889 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 82.320835557999999, 2024-09-13T06:40:33.889 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.016412307000000001, 2024-09-13T06:40:33.890 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:33.890 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:40:33.890 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:33.890 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4154", 2024-09-13T06:40:33.890 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/2406930292", 2024-09-13T06:40:33.890 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 111 2024-09-13T06:40:33.890 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:33.890 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:33.890 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:33.890 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:33.890 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.524546+0000", 2024-09-13T06:40:33.890 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:33.890 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:33.891 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:33.891 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:33.891 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.524546+0000", 2024-09-13T06:40:33.891 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:33.891 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:33.891 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:33.891 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:33.891 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.524545+0000", 2024-09-13T06:40:33.891 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:33.891 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:33.891 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:33.891 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:33.891 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.524555+0000", 2024-09-13T06:40:33.891 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0176e-05 2024-09-13T06:40:33.892 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:33.892 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:33.892 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:33.892 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.524577+0000", 2024-09-13T06:40:33.892 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.1756999999999999e-05 2024-09-13T06:40:33.892 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:33.892 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:33.892 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:33.892 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.524592+0000", 2024-09-13T06:40:33.892 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5345999999999998e-05 2024-09-13T06:40:33.892 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:33.892 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:33.892 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:33.893 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.533407+0000", 2024-09-13T06:40:33.893 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0088150559999999999 2024-09-13T06:40:33.893 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:33.893 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:33.893 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:33.893 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.533523+0000", 2024-09-13T06:40:33.893 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000116099 2024-09-13T06:40:33.893 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:33.893 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:33.893 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 0", 2024-09-13T06:40:33.893 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.533734+0000", 2024-09-13T06:40:33.893 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000211005 2024-09-13T06:40:33.893 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:33.894 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:33.894 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-13T06:40:33.894 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.538484+0000", 2024-09-13T06:40:33.894 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0047494900000000003 2024-09-13T06:40:33.894 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:33.894 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:33.894 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:40:33.894 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.540823+0000", 2024-09-13T06:40:33.894 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0023390889999999999 2024-09-13T06:40:33.894 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:33.894 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:33.894 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-13T06:40:33.894 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.540898+0000", 2024-09-13T06:40:33.895 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5449000000000002e-05 2024-09-13T06:40:33.895 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:33.895 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:33.895 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:33.895 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.540958+0000", 2024-09-13T06:40:33.895 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.9889999999999997e-05 2024-09-13T06:40:33.895 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:33.895 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:33.895 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:33.895 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:33.895 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:33.895 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4154.0:112 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-13T06:40:33.895 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:11.524610+0000", 2024-09-13T06:40:33.895 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 82.320771839000003, 2024-09-13T06:40:33.896 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.016538458999999998, 2024-09-13T06:40:33.896 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:33.896 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:40:33.896 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:33.896 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4154", 2024-09-13T06:40:33.896 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/2406930292", 2024-09-13T06:40:33.896 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 112 2024-09-13T06:40:33.896 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:33.896 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:33.896 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:33.896 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:33.896 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.524610+0000", 2024-09-13T06:40:33.896 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:33.897 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:33.897 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:33.897 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:33.897 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.524610+0000", 2024-09-13T06:40:33.897 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:33.897 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:33.897 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:33.897 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:33.897 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.524608+0000", 2024-09-13T06:40:33.897 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:33.897 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:33.897 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:33.897 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:33.897 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.524826+0000", 2024-09-13T06:40:33.898 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000217226 2024-09-13T06:40:33.898 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:33.898 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:33.898 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:33.898 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.524848+0000", 2024-09-13T06:40:33.898 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.2802999999999998e-05 2024-09-13T06:40:33.898 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:33.898 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:33.898 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:33.898 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.524906+0000", 2024-09-13T06:40:33.898 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.7878999999999999e-05 2024-09-13T06:40:33.898 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:33.898 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:33.898 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:33.899 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.534402+0000", 2024-09-13T06:40:33.899 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0094956769999999992 2024-09-13T06:40:33.899 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:33.899 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:33.899 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:33.899 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.534512+0000", 2024-09-13T06:40:33.899 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000110493 2024-09-13T06:40:33.899 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:33.899 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:33.899 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 0", 2024-09-13T06:40:33.899 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.534688+0000", 2024-09-13T06:40:33.899 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00017564499999999999 2024-09-13T06:40:33.900 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:33.900 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:33.900 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-13T06:40:33.900 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.538493+0000", 2024-09-13T06:40:33.900 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0038051399999999998 2024-09-13T06:40:33.900 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:33.900 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:33.900 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:40:33.900 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.541030+0000", 2024-09-13T06:40:33.900 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0025368080000000002 2024-09-13T06:40:33.900 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:33.900 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:33.900 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-13T06:40:33.900 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.541097+0000", 2024-09-13T06:40:33.901 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.6933000000000004e-05 2024-09-13T06:40:33.901 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:33.901 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:33.901 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:33.901 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.541148+0000", 2024-09-13T06:40:33.901 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.1008999999999999e-05 2024-09-13T06:40:33.901 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:33.901 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:33.901 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:33.901 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:33.901 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:33.901 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4154.0:113 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-13T06:40:33.901 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:11.524940+0000", 2024-09-13T06:40:33.902 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 82.320440875000003, 2024-09-13T06:40:33.902 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.017201570999999999, 2024-09-13T06:40:33.902 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:33.902 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:40:33.902 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:33.902 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4154", 2024-09-13T06:40:33.902 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/2406930292", 2024-09-13T06:40:33.902 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 113 2024-09-13T06:40:33.902 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:33.902 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:33.902 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:33.902 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:33.902 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.524940+0000", 2024-09-13T06:40:33.903 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:33.903 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:33.903 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:33.903 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:33.903 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.524940+0000", 2024-09-13T06:40:33.903 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:33.903 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:33.903 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:33.903 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:33.903 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.524938+0000", 2024-09-13T06:40:33.903 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999981 2024-09-13T06:40:33.903 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:33.903 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:33.904 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:33.904 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.524951+0000", 2024-09-13T06:40:33.904 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2993000000000001e-05 2024-09-13T06:40:33.904 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:33.904 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:33.904 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:33.904 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.524976+0000", 2024-09-13T06:40:33.904 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.4216999999999999e-05 2024-09-13T06:40:33.904 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:33.904 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:33.904 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:33.904 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.525000+0000", 2024-09-13T06:40:33.904 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.3986e-05 2024-09-13T06:40:33.905 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:33.905 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:33.905 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:33.905 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.535786+0000", 2024-09-13T06:40:33.905 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.010786733999999999 2024-09-13T06:40:33.905 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:33.905 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:33.905 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:33.905 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.535916+0000", 2024-09-13T06:40:33.905 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000129865 2024-09-13T06:40:33.905 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:33.905 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:33.905 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 0", 2024-09-13T06:40:33.905 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.536106+0000", 2024-09-13T06:40:33.906 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000190046 2024-09-13T06:40:33.906 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:33.906 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:33.906 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-13T06:40:33.906 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.540977+0000", 2024-09-13T06:40:33.906 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0048708730000000004 2024-09-13T06:40:33.906 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:33.906 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:33.906 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:40:33.906 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.542023+0000", 2024-09-13T06:40:33.906 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0010456179999999999 2024-09-13T06:40:33.906 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:33.906 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:33.906 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-13T06:40:33.907 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.542091+0000", 2024-09-13T06:40:33.907 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.7840000000000001e-05 2024-09-13T06:40:33.907 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:33.907 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:33.907 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:33.907 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.542142+0000", 2024-09-13T06:40:33.907 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.1399e-05 2024-09-13T06:40:33.907 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:33.907 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:33.907 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:33.907 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:33.907 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:33.907 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4154.0:114 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-13T06:40:33.907 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:11.525025+0000", 2024-09-13T06:40:33.908 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 82.320355996000004, 2024-09-13T06:40:33.908 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.017310847000000001, 2024-09-13T06:40:33.908 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:33.908 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:40:33.908 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:33.908 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4154", 2024-09-13T06:40:33.908 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/2406930292", 2024-09-13T06:40:33.908 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 114 2024-09-13T06:40:33.908 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:33.908 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:33.908 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:33.908 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:33.908 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.525025+0000", 2024-09-13T06:40:33.909 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:33.909 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:33.909 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:33.909 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:33.909 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.525025+0000", 2024-09-13T06:40:33.909 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:33.909 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:33.909 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:33.909 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:33.909 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.525024+0000", 2024-09-13T06:40:33.909 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999986 2024-09-13T06:40:33.909 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:33.909 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:33.909 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:33.910 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.525035+0000", 2024-09-13T06:40:33.910 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1413999999999999e-05 2024-09-13T06:40:33.910 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:33.910 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:33.910 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:33.910 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.525054+0000", 2024-09-13T06:40:33.910 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.8723e-05 2024-09-13T06:40:33.910 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:33.910 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:33.910 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:33.910 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.525068+0000", 2024-09-13T06:40:33.910 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.4022999999999999e-05 2024-09-13T06:40:33.910 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:33.911 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:33.911 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:33.911 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.536923+0000", 2024-09-13T06:40:33.911 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.011854821999999999 2024-09-13T06:40:33.911 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:33.911 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:33.911 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:33.911 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.537048+0000", 2024-09-13T06:40:33.911 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000125399 2024-09-13T06:40:33.911 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:33.911 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:33.911 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 0", 2024-09-13T06:40:33.911 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.537293+0000", 2024-09-13T06:40:33.912 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00024499500000000002 2024-09-13T06:40:33.912 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:33.912 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:33.912 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-13T06:40:33.912 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.541962+0000", 2024-09-13T06:40:33.912 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0046680940000000002 2024-09-13T06:40:33.912 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:33.912 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:33.912 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:40:33.912 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.542218+0000", 2024-09-13T06:40:33.912 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00025668199999999999 2024-09-13T06:40:33.912 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:33.912 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:33.913 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-13T06:40:33.913 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.542286+0000", 2024-09-13T06:40:33.913 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.7565999999999997e-05 2024-09-13T06:40:33.913 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:33.913 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:33.913 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:33.913 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.542336+0000", 2024-09-13T06:40:33.913 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.0429000000000001e-05 2024-09-13T06:40:33.913 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:33.913 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:33.913 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:33.913 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:33.913 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:33.913 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4154.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-13T06:40:33.914 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:11.525085+0000", 2024-09-13T06:40:33.914 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 82.320296815999995, 2024-09-13T06:40:33.914 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.019358490999999999, 2024-09-13T06:40:33.914 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:33.914 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:40:33.914 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:33.914 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4154", 2024-09-13T06:40:33.914 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/2406930292", 2024-09-13T06:40:33.914 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 115 2024-09-13T06:40:33.914 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:33.914 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:33.914 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:33.914 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:33.915 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.525085+0000", 2024-09-13T06:40:33.915 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:33.915 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:33.915 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:33.915 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:33.915 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.525085+0000", 2024-09-13T06:40:33.915 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:33.915 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:33.915 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:33.915 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:33.915 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.525083+0000", 2024-09-13T06:40:33.915 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:33.915 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:33.916 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:33.916 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:33.916 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.525302+0000", 2024-09-13T06:40:33.916 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00021804499999999999 2024-09-13T06:40:33.916 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:33.916 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:33.916 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:33.916 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.525324+0000", 2024-09-13T06:40:33.916 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.2147e-05 2024-09-13T06:40:33.916 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:33.916 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:33.916 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:33.916 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.525340+0000", 2024-09-13T06:40:33.917 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5879000000000002e-05 2024-09-13T06:40:33.917 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:33.917 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:33.917 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:33.917 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.538555+0000", 2024-09-13T06:40:33.917 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.013215499 2024-09-13T06:40:33.917 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:33.917 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:33.917 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:33.917 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.538703+0000", 2024-09-13T06:40:33.917 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00014755200000000001 2024-09-13T06:40:33.917 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:33.917 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:33.918 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 0", 2024-09-13T06:40:33.918 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.538967+0000", 2024-09-13T06:40:33.918 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00026453799999999998 2024-09-13T06:40:33.918 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:33.918 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:33.918 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-13T06:40:33.918 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.541969+0000", 2024-09-13T06:40:33.918 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00300184 2024-09-13T06:40:33.918 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:33.918 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:33.918 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:40:33.918 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.544287+0000", 2024-09-13T06:40:33.918 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0023178890000000001 2024-09-13T06:40:33.919 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:33.919 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:33.919 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-13T06:40:33.919 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.544378+0000", 2024-09-13T06:40:33.919 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.1366000000000006e-05 2024-09-13T06:40:33.919 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:33.919 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:33.919 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:33.919 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.544443+0000", 2024-09-13T06:40:33.919 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.4826000000000006e-05 2024-09-13T06:40:33.919 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:33.919 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:33.919 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:33.919 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:33.920 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:33.920 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4154.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-13T06:40:33.920 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:11.525359+0000", 2024-09-13T06:40:33.920 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 82.320022788000003, 2024-09-13T06:40:33.920 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.019359514000000001, 2024-09-13T06:40:33.920 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:33.920 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:40:33.920 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:33.920 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4154", 2024-09-13T06:40:33.920 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/2406930292", 2024-09-13T06:40:33.920 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 116 2024-09-13T06:40:33.920 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:33.920 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:33.921 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:33.921 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:33.921 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.525359+0000", 2024-09-13T06:40:33.921 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:33.921 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:33.921 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:33.921 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:33.921 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.525359+0000", 2024-09-13T06:40:33.921 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:33.921 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:33.921 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:33.921 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:33.921 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.525357+0000", 2024-09-13T06:40:33.922 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999981 2024-09-13T06:40:33.922 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:33.922 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:33.922 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:33.922 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.525369+0000", 2024-09-13T06:40:33.922 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1647e-05 2024-09-13T06:40:33.922 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:33.922 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:33.922 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:33.922 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.525386+0000", 2024-09-13T06:40:33.922 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7762999999999999e-05 2024-09-13T06:40:33.922 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:33.922 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:33.922 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:33.923 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.525400+0000", 2024-09-13T06:40:33.924 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.4053000000000001e-05 2024-09-13T06:40:33.924 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:33.925 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:33.925 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:33.925 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.539897+0000", 2024-09-13T06:40:33.925 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.014497128999999999 2024-09-13T06:40:33.925 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:33.925 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:33.925 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:33.925 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.540022+0000", 2024-09-13T06:40:33.925 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00012416599999999999 2024-09-13T06:40:33.925 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:33.925 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:33.925 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 0", 2024-09-13T06:40:33.925 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.540199+0000", 2024-09-13T06:40:33.926 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00017705499999999999 2024-09-13T06:40:33.926 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:33.926 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:33.926 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-13T06:40:33.926 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.542161+0000", 2024-09-13T06:40:33.926 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0019622210000000001 2024-09-13T06:40:33.926 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:33.926 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:33.926 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:40:33.926 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.544529+0000", 2024-09-13T06:40:33.926 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0023684690000000002 2024-09-13T06:40:33.926 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:33.926 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:33.927 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-13T06:40:33.927 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.544614+0000", 2024-09-13T06:40:33.927 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.4711999999999998e-05 2024-09-13T06:40:33.927 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:33.927 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:33.927 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:33.927 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.544718+0000", 2024-09-13T06:40:33.927 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000103986 2024-09-13T06:40:33.927 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:33.927 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:33.927 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:33.927 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:33.927 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:33.927 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4154.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-13T06:40:33.928 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:11.525416+0000", 2024-09-13T06:40:33.928 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 82.319965234999998, 2024-09-13T06:40:33.928 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.019501830000000001, 2024-09-13T06:40:33.928 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:33.928 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:40:33.928 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:33.928 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4154", 2024-09-13T06:40:33.928 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/2406930292", 2024-09-13T06:40:33.928 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 117 2024-09-13T06:40:33.928 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:33.928 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:33.928 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:33.928 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:33.929 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.525416+0000", 2024-09-13T06:40:33.929 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:33.929 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:33.929 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:33.929 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:33.929 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.525416+0000", 2024-09-13T06:40:33.929 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:33.929 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:33.929 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:33.929 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:33.929 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.525415+0000", 2024-09-13T06:40:33.929 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999986 2024-09-13T06:40:33.929 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:33.929 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:33.930 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:33.930 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.525426+0000", 2024-09-13T06:40:33.930 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.101e-05 2024-09-13T06:40:33.930 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:33.930 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:33.930 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:33.930 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.525444+0000", 2024-09-13T06:40:33.930 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.768e-05 2024-09-13T06:40:33.930 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:33.930 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:33.930 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:33.930 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.525463+0000", 2024-09-13T06:40:33.930 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.9026999999999999e-05 2024-09-13T06:40:33.931 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:33.931 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:33.931 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:33.931 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.541203+0000", 2024-09-13T06:40:33.931 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.015740309000000001 2024-09-13T06:40:33.931 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:33.931 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:33.931 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:33.931 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.541330+0000", 2024-09-13T06:40:33.931 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000126976 2024-09-13T06:40:33.931 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:33.932 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:33.932 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 0", 2024-09-13T06:40:33.932 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.541522+0000", 2024-09-13T06:40:33.932 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00019165100000000001 2024-09-13T06:40:33.932 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:33.932 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:33.932 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-13T06:40:33.932 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.542798+0000", 2024-09-13T06:40:33.932 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.001276424 2024-09-13T06:40:33.932 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:33.932 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:33.932 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:40:33.933 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.544795+0000", 2024-09-13T06:40:33.933 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0019966540000000001 2024-09-13T06:40:33.933 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:33.933 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:33.933 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-13T06:40:33.933 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.544868+0000", 2024-09-13T06:40:33.933 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.3096000000000006e-05 2024-09-13T06:40:33.933 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:33.933 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:33.933 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:33.933 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.544918+0000", 2024-09-13T06:40:33.933 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.0226999999999999e-05 2024-09-13T06:40:33.933 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:33.934 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:33.934 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:33.934 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:33.934 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:33.934 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4154.0:136 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-13T06:40:33.934 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:12.006369+0000", 2024-09-13T06:40:33.934 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 81.839011885999994, 2024-09-13T06:40:33.934 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.012052078000000001, 2024-09-13T06:40:33.934 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:33.934 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:40:33.934 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:33.934 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4154", 2024-09-13T06:40:33.934 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/2406930292", 2024-09-13T06:40:33.935 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 136 2024-09-13T06:40:33.935 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:33.935 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:33.935 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:33.935 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:33.935 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.006369+0000", 2024-09-13T06:40:33.935 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:33.935 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:33.935 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:33.935 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:33.935 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.006369+0000", 2024-09-13T06:40:33.935 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:33.935 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:33.935 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:33.936 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:33.936 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.006369+0000", 2024-09-13T06:40:33.936 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:33.936 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:33.936 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:33.936 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:33.936 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.006372+0000", 2024-09-13T06:40:33.936 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.0630000000000002e-06 2024-09-13T06:40:33.936 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:33.936 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:33.936 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:33.936 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.006377+0000", 2024-09-13T06:40:33.936 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.6079999999999998e-06 2024-09-13T06:40:33.937 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:33.937 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:33.937 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:33.937 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.006384+0000", 2024-09-13T06:40:33.937 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.8560000000000001e-06 2024-09-13T06:40:33.937 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:33.937 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:33.937 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:33.937 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.008357+0000", 2024-09-13T06:40:33.937 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0019733839999999999 2024-09-13T06:40:33.937 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:33.937 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:33.937 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:33.938 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.008406+0000", 2024-09-13T06:40:33.938 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.9023000000000001e-05 2024-09-13T06:40:33.938 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:33.938 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:33.938 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 0", 2024-09-13T06:40:33.938 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.008489+0000", 2024-09-13T06:40:33.938 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.2649000000000001e-05 2024-09-13T06:40:33.938 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:33.938 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:33.938 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-13T06:40:33.938 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.011012+0000", 2024-09-13T06:40:33.938 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0025236880000000001 2024-09-13T06:40:33.938 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:33.938 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:33.939 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:40:33.939 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.018382+0000", 2024-09-13T06:40:33.939 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.007369596 2024-09-13T06:40:33.939 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:33.939 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:33.939 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-13T06:40:33.939 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.018405+0000", 2024-09-13T06:40:33.939 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.2670000000000001e-05 2024-09-13T06:40:33.939 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:33.939 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:33.939 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:33.939 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.018422+0000", 2024-09-13T06:40:33.939 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6864999999999999e-05 2024-09-13T06:40:33.939 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:33.940 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:33.940 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:33.940 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:33.940 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:33.940 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4154.0:137 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-13T06:40:33.940 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:12.006450+0000", 2024-09-13T06:40:33.940 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 81.838931556999995, 2024-09-13T06:40:33.940 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.012040990999999999, 2024-09-13T06:40:33.940 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:33.940 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:40:33.940 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:33.940 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4154", 2024-09-13T06:40:33.940 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/2406930292", 2024-09-13T06:40:33.941 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 137 2024-09-13T06:40:33.941 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:33.941 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:33.941 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:33.941 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:33.941 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.006450+0000", 2024-09-13T06:40:33.941 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:33.941 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:33.941 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:33.941 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:33.941 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.006450+0000", 2024-09-13T06:40:33.941 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:33.941 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:33.942 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:33.942 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:33.942 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.006449+0000", 2024-09-13T06:40:33.942 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:33.942 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:33.942 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:33.942 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:33.942 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.006549+0000", 2024-09-13T06:40:33.942 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.9847999999999997e-05 2024-09-13T06:40:33.942 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:33.942 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:33.942 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:33.942 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.006560+0000", 2024-09-13T06:40:33.942 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1012000000000001e-05 2024-09-13T06:40:33.943 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:33.943 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:33.943 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:33.943 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.006566+0000", 2024-09-13T06:40:33.943 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.1630000000000001e-06 2024-09-13T06:40:33.943 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:33.943 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:33.943 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:33.943 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.008760+0000", 2024-09-13T06:40:33.943 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0021934659999999998 2024-09-13T06:40:33.943 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:33.943 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:33.943 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:33.943 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.008803+0000", 2024-09-13T06:40:33.944 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.3492000000000003e-05 2024-09-13T06:40:33.944 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:33.944 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:33.944 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 0", 2024-09-13T06:40:33.944 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.008879+0000", 2024-09-13T06:40:33.944 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5252000000000004e-05 2024-09-13T06:40:33.944 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:33.944 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:33.944 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-13T06:40:33.944 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.011015+0000", 2024-09-13T06:40:33.944 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0021362349999999998 2024-09-13T06:40:33.944 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:33.944 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:33.945 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:40:33.945 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.018452+0000", 2024-09-13T06:40:33.945 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.007436865 2024-09-13T06:40:33.945 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:33.945 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:33.945 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-13T06:40:33.945 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.018474+0000", 2024-09-13T06:40:33.945 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.2149000000000001e-05 2024-09-13T06:40:33.945 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:33.945 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:33.945 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:33.945 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.018491+0000", 2024-09-13T06:40:33.945 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6983999999999999e-05 2024-09-13T06:40:33.945 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:33.946 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:33.946 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:33.946 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:33.946 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:33.946 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4154.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-13T06:40:33.946 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:12.006689+0000", 2024-09-13T06:40:33.946 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 81.838692050000006, 2024-09-13T06:40:33.946 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.012427258, 2024-09-13T06:40:33.946 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:33.946 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:40:33.946 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:33.946 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4154", 2024-09-13T06:40:33.946 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/2406930292", 2024-09-13T06:40:33.947 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 140 2024-09-13T06:40:33.947 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:33.947 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:33.947 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:33.947 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:33.947 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.006689+0000", 2024-09-13T06:40:33.947 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:33.947 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:33.947 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:33.947 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:33.947 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.006689+0000", 2024-09-13T06:40:33.947 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:33.947 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:33.948 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:33.948 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:33.948 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.006689+0000", 2024-09-13T06:40:33.948 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:33.948 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:33.948 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:33.948 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:33.948 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.006795+0000", 2024-09-13T06:40:33.948 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00010662699999999999 2024-09-13T06:40:33.948 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:33.948 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:33.948 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:33.948 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.006804+0000", 2024-09-13T06:40:33.949 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.055e-06 2024-09-13T06:40:33.949 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:33.949 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:33.949 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:33.949 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.006808+0000", 2024-09-13T06:40:33.949 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.7450000000000003e-06 2024-09-13T06:40:33.949 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:33.949 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:33.949 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:33.949 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.010066+0000", 2024-09-13T06:40:33.949 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0032579570000000001 2024-09-13T06:40:33.949 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:33.949 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:33.949 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:33.950 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.010111+0000", 2024-09-13T06:40:33.950 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.4563e-05 2024-09-13T06:40:33.950 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:33.950 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:33.950 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 0", 2024-09-13T06:40:33.950 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.010185+0000", 2024-09-13T06:40:33.950 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.4108000000000003e-05 2024-09-13T06:40:33.950 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:33.950 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:33.950 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-13T06:40:33.950 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.011161+0000", 2024-09-13T06:40:33.950 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00097629200000000002 2024-09-13T06:40:33.950 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:33.951 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:33.951 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:40:33.951 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.019061+0000", 2024-09-13T06:40:33.951 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0079001939999999993 2024-09-13T06:40:33.951 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:33.951 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:33.951 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-13T06:40:33.951 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.019095+0000", 2024-09-13T06:40:33.951 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.3200000000000001e-05 2024-09-13T06:40:33.951 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:33.951 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:33.951 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:33.951 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.019117+0000", 2024-09-13T06:40:33.951 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.1985e-05 2024-09-13T06:40:33.952 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:33.952 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:33.952 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:33.952 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:33.952 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:33.952 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4154.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-13T06:40:33.952 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:12.006814+0000", 2024-09-13T06:40:33.952 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 81.838566865999994, 2024-09-13T06:40:33.952 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.012896405999999999, 2024-09-13T06:40:33.952 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:33.952 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:40:33.952 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:33.952 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4154", 2024-09-13T06:40:33.953 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/2406930292", 2024-09-13T06:40:33.953 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 141 2024-09-13T06:40:33.953 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:33.953 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:33.953 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:33.953 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:33.953 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.006814+0000", 2024-09-13T06:40:33.953 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:33.953 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:33.953 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:33.953 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:33.953 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.006814+0000", 2024-09-13T06:40:33.953 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:33.953 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:33.954 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:33.954 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:33.954 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.006814+0000", 2024-09-13T06:40:33.954 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:33.954 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:33.954 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:33.954 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:33.954 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.006818+0000", 2024-09-13T06:40:33.954 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.8840000000000004e-06 2024-09-13T06:40:33.954 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:33.954 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:33.954 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:33.954 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.006834+0000", 2024-09-13T06:40:33.955 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6133999999999998e-05 2024-09-13T06:40:33.955 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:33.955 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:33.955 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:33.955 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.006838+0000", 2024-09-13T06:40:33.955 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0879999999999997e-06 2024-09-13T06:40:33.955 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:33.955 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:33.955 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:33.955 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.010586+0000", 2024-09-13T06:40:33.955 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.003747954 2024-09-13T06:40:33.955 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:33.955 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:33.955 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:33.955 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.010630+0000", 2024-09-13T06:40:33.956 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.3736000000000003e-05 2024-09-13T06:40:33.956 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:33.956 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:33.956 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 0", 2024-09-13T06:40:33.956 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.010701+0000", 2024-09-13T06:40:33.956 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.1284000000000004e-05 2024-09-13T06:40:33.956 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:33.956 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:33.956 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-13T06:40:33.956 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.011593+0000", 2024-09-13T06:40:33.956 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00089209300000000005 2024-09-13T06:40:33.956 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:33.956 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:33.957 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:40:33.957 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.019665+0000", 2024-09-13T06:40:33.957 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0080716169999999997 2024-09-13T06:40:33.957 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:33.957 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:33.957 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-13T06:40:33.957 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.019691+0000", 2024-09-13T06:40:33.957 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.6514000000000001e-05 2024-09-13T06:40:33.957 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:33.957 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:33.957 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:33.957 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:12.019711+0000", 2024-09-13T06:40:33.957 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.9641e-05 2024-09-13T06:40:33.958 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:33.958 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:33.958 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:33.958 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:33.958 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:33.958 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:608 3.11 3:8ebac99f:::rbd_data.11214e25756e.0000000000000007:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-09-13T06:40:33.958 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:34.801988+0000", 2024-09-13T06:40:33.958 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 59.043393477999999, 2024-09-13T06:40:33.958 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.033916448000000002, 2024-09-13T06:40:33.958 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:33.958 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:40:33.958 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:33.958 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:33.959 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:33.959 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 608 2024-09-13T06:40:33.959 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:33.959 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:33.959 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:33.959 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:33.959 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:34.801988+0000", 2024-09-13T06:40:33.959 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:33.959 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:33.959 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:33.959 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:33.959 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:34.801988+0000", 2024-09-13T06:40:33.959 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:33.960 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:33.960 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:33.960 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:33.960 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:34.801985+0000", 2024-09-13T06:40:33.960 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999976 2024-09-13T06:40:33.960 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:33.960 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:33.960 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:33.960 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:34.801999+0000", 2024-09-13T06:40:33.960 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.402e-05 2024-09-13T06:40:33.960 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:33.960 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:33.960 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:33.961 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:34.802031+0000", 2024-09-13T06:40:33.961 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.1582999999999999e-05 2024-09-13T06:40:33.961 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:33.961 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:33.961 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:33.961 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:34.802052+0000", 2024-09-13T06:40:33.961 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.1310000000000001e-05 2024-09-13T06:40:33.961 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:33.961 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:33.961 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:33.961 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:34.802117+0000", 2024-09-13T06:40:33.961 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.5016000000000002e-05 2024-09-13T06:40:33.961 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:33.962 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:33.962 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:33.962 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:34.802254+0000", 2024-09-13T06:40:33.962 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000136186 2024-09-13T06:40:33.962 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:33.962 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:33.962 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 4", 2024-09-13T06:40:33.962 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:34.807944+0000", 2024-09-13T06:40:33.962 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0056906930000000001 2024-09-13T06:40:33.962 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:33.962 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:33.962 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-13T06:40:33.962 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:34.835646+0000", 2024-09-13T06:40:33.963 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.027701546000000001 2024-09-13T06:40:33.963 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:33.963 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:33.963 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:40:33.963 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:34.835754+0000", 2024-09-13T06:40:33.963 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000107889 2024-09-13T06:40:33.963 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:33.963 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:33.963 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-13T06:40:33.963 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:34.835840+0000", 2024-09-13T06:40:33.963 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6621999999999998e-05 2024-09-13T06:40:33.963 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:33.963 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:33.964 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:33.964 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:34.835904+0000", 2024-09-13T06:40:33.964 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.4022999999999993e-05 2024-09-13T06:40:33.964 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:33.964 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:33.964 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:33.964 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:33.964 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:33.964 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:47163 3.13 3.ed327d33 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e76)", 2024-09-13T06:40:33.964 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:29.544993+0000", 2024-09-13T06:40:33.964 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 4.3003878689999997, 2024-09-13T06:40:33.964 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.83273406400000005, 2024-09-13T06:40:33.964 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:33.965 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:40:33.965 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:33.965 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:33.965 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:33.965 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 47163 2024-09-13T06:40:33.965 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:33.965 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:33.965 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:33.965 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:33.965 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:29.544993+0000", 2024-09-13T06:40:33.965 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:33.965 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:33.965 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:33.965 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:33.966 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:29.544993+0000", 2024-09-13T06:40:33.966 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:33.966 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:33.966 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:33.966 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:33.966 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:29.544992+0000", 2024-09-13T06:40:33.966 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999981 2024-09-13T06:40:33.966 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:33.966 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:33.966 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:33.966 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:29.545001+0000", 2024-09-13T06:40:33.966 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.825e-06 2024-09-13T06:40:33.966 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:33.967 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:33.967 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:33.967 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:29.545022+0000", 2024-09-13T06:40:33.967 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.0285e-05 2024-09-13T06:40:33.967 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:33.967 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:33.967 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:33.967 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:29.545049+0000", 2024-09-13T06:40:33.967 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.7389000000000002e-05 2024-09-13T06:40:33.967 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:33.967 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:33.967 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:33.967 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:29.545153+0000", 2024-09-13T06:40:33.967 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0001043 2024-09-13T06:40:33.968 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:33.968 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:33.968 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:40:33.968 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:29.545164+0000", 2024-09-13T06:40:33.968 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0413e-05 2024-09-13T06:40:33.968 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:33.968 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:33.968 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:33.968 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:30.377697+0000", 2024-09-13T06:40:33.968 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.832533415 2024-09-13T06:40:33.968 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:33.968 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:33.968 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:33.968 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:30.377728+0000", 2024-09-13T06:40:33.969 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.0428000000000001e-05 2024-09-13T06:40:33.969 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:33.969 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:33.969 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:33.969 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:33.969 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:33.969 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:40:33.970 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:40:33.970+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:40:33.971 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-13T06:40:34.072 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:40:34.068+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:40:34.101 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:40:34.101 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-13T06:40:34.101 INFO:teuthology.orchestra.run.smithi081.stdout: "num_ops": 0 2024-09-13T06:40:34.101 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:40:34.115 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-13T06:40:34.173 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-13T06:40:34.170+0000 7f86a5f06640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26387) UID: 0 2024-09-13T06:40:34.274 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:40:34.274+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:40:34.280 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:40:34.280 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-13T06:40:34.280 INFO:teuthology.orchestra.run.smithi081.stdout: "complaint_time": 30, 2024-09-13T06:40:34.280 INFO:teuthology.orchestra.run.smithi081.stdout: "num_blocked_ops": 0 2024-09-13T06:40:34.280 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:40:34.294 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-13T06:40:34.375 INFO:tasks.ceph.osd.6.smithi139.stderr:2024-09-13T06:40:34.374+0000 7fcd02c5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26385) UID: 0 2024-09-13T06:40:34.402 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-13T06:40:34.403 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-13T06:40:34.403 INFO:tasks.thrashosds.thrasher:primary_affinity 2024-09-13T06:40:34.403 INFO:tasks.thrashosds.thrasher:Setting osd 0 primary_affinity to 0.485390 2024-09-13T06:40:34.403 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 0 0.48539045964209593 2024-09-13T06:40:34.419 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:40:34.419 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 20, 2024-09-13T06:40:34.419 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 600, 2024-09-13T06:40:34.419 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [ 2024-09-13T06:40:34.419 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:34.419 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:37801 3.1 3:82e31015:::rbd_object_map.1121d8143c6e.0000000000000019:head [call] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e55)", 2024-09-13T06:40:34.419 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:05.646191+0000", 2024-09-13T06:40:34.419 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 28.774307410999999, 2024-09-13T06:40:34.419 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.72659507800000001, 2024-09-13T06:40:34.419 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:34.419 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:34.419 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:34.420 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:34.420 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:34.420 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 37801 2024-09-13T06:40:34.420 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:34.420 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:34.420 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:34.420 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:34.420 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:05.646191+0000", 2024-09-13T06:40:34.420 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:34.420 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:34.420 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:34.420 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:34.420 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:05.646191+0000", 2024-09-13T06:40:34.421 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:34.421 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:34.421 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:34.421 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:34.421 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:05.646188+0000", 2024-09-13T06:40:34.421 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999971 2024-09-13T06:40:34.421 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:34.421 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:34.421 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:34.424 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:05.646206+0000", 2024-09-13T06:40:34.424 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8182999999999999e-05 2024-09-13T06:40:34.425 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:34.425 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:34.425 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:34.425 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:05.646237+0000", 2024-09-13T06:40:34.425 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.1071000000000001e-05 2024-09-13T06:40:34.425 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:34.425 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:34.425 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:34.425 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:05.646251+0000", 2024-09-13T06:40:34.425 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3679000000000001e-05 2024-09-13T06:40:34.425 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:34.425 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:34.426 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:34.426 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:05.646321+0000", 2024-09-13T06:40:34.426 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.9831000000000003e-05 2024-09-13T06:40:34.426 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:34.426 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:34.426 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:40:34.426 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:05.646331+0000", 2024-09-13T06:40:34.426 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0242e-05 2024-09-13T06:40:34.426 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:34.426 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:34.426 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:34.426 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.371959+0000", 2024-09-13T06:40:34.426 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.72562817199999996 2024-09-13T06:40:34.427 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:34.427 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:34.427 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:34.427 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.372389+0000", 2024-09-13T06:40:34.427 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00042977400000000001 2024-09-13T06:40:34.427 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:34.427 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:34.427 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:34.427 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.372786+0000", 2024-09-13T06:40:34.427 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00039706099999999999 2024-09-13T06:40:34.427 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:34.427 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:34.427 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:34.428 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:34.428 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:34.428 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43009 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 489472~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:40:34.428 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.644660+0000", 2024-09-13T06:40:34.428 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 12.775838449, 2024-09-13T06:40:34.428 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123376071, 2024-09-13T06:40:34.428 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:34.428 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:34.428 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:34.428 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:34.428 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:34.428 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43009 2024-09-13T06:40:34.429 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:34.429 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:34.429 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:34.429 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:34.429 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.644660+0000", 2024-09-13T06:40:34.429 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:34.429 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:34.429 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:34.429 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:34.429 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.644660+0000", 2024-09-13T06:40:34.429 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:34.429 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:34.429 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:34.430 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:34.430 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.644659+0000", 2024-09-13T06:40:34.430 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:34.430 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:34.430 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:34.430 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:34.430 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.644662+0000", 2024-09-13T06:40:34.430 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4949999999999998e-06 2024-09-13T06:40:34.430 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:34.430 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:34.430 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:34.430 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.644669+0000", 2024-09-13T06:40:34.430 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.289e-06 2024-09-13T06:40:34.431 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:34.431 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:34.431 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:34.431 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.644674+0000", 2024-09-13T06:40:34.431 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.8840000000000002e-06 2024-09-13T06:40:34.431 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:34.431 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:34.431 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:34.431 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.767602+0000", 2024-09-13T06:40:34.431 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.122928158 2024-09-13T06:40:34.431 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:34.431 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:34.431 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:34.431 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.767676+0000", 2024-09-13T06:40:34.432 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3992999999999994e-05 2024-09-13T06:40:34.432 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:34.432 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:34.432 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:34.432 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.768036+0000", 2024-09-13T06:40:34.432 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00035966200000000001 2024-09-13T06:40:34.432 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:34.432 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:34.432 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:34.432 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:34.433 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:34.433 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43010 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 503808~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:40:34.433 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.644678+0000", 2024-09-13T06:40:34.433 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 12.775820123000001, 2024-09-13T06:40:34.433 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123728798, 2024-09-13T06:40:34.433 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:34.433 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:34.433 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:34.433 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:34.433 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:34.433 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43010 2024-09-13T06:40:34.433 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:34.434 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:34.434 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:34.434 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:34.434 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.644678+0000", 2024-09-13T06:40:34.434 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:34.434 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:34.434 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:34.434 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:34.434 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.644678+0000", 2024-09-13T06:40:34.434 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:34.434 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:34.434 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:34.434 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:34.435 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.644678+0000", 2024-09-13T06:40:34.435 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:34.435 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:34.435 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:34.435 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:34.435 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.644680+0000", 2024-09-13T06:40:34.435 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2050000000000001e-06 2024-09-13T06:40:34.435 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:34.435 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:34.435 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:34.435 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.644686+0000", 2024-09-13T06:40:34.435 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8440000000000003e-06 2024-09-13T06:40:34.435 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:34.435 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:34.436 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:34.436 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.644691+0000", 2024-09-13T06:40:34.436 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.118e-06 2024-09-13T06:40:34.436 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:34.436 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:34.436 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:34.436 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.768065+0000", 2024-09-13T06:40:34.436 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123374698 2024-09-13T06:40:34.436 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:34.436 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:34.436 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:34.436 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.768139+0000", 2024-09-13T06:40:34.436 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3934000000000001e-05 2024-09-13T06:40:34.437 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:34.437 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:34.437 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:34.437 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.768407+0000", 2024-09-13T06:40:34.437 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00026738800000000002 2024-09-13T06:40:34.437 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:34.437 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:34.437 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:34.437 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:34.437 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:34.437 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43181 3.17 3:ec5ebce4:::rbd_data.1121f5f2e1c0.0000000000000001:1f [read 319488~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:40:34.437 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.652968+0000", 2024-09-13T06:40:34.438 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 12.767529607, 2024-09-13T06:40:34.438 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.12363807, 2024-09-13T06:40:34.438 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:34.438 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:34.438 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:34.438 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:34.438 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:34.438 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43181 2024-09-13T06:40:34.438 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:34.438 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:34.438 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:34.438 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:34.438 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.652968+0000", 2024-09-13T06:40:34.438 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:34.439 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:34.439 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:34.439 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:34.439 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.652968+0000", 2024-09-13T06:40:34.439 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:34.439 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:34.439 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:34.439 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:34.439 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.652968+0000", 2024-09-13T06:40:34.439 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:34.439 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:34.439 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:34.439 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:34.440 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.652970+0000", 2024-09-13T06:40:34.440 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2409999999999998e-06 2024-09-13T06:40:34.440 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:34.440 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:34.440 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:34.440 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.652976+0000", 2024-09-13T06:40:34.440 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0079999999999999e-06 2024-09-13T06:40:34.440 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:34.440 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:34.440 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:34.440 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.652981+0000", 2024-09-13T06:40:34.440 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4390000000000002e-06 2024-09-13T06:40:34.440 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:34.441 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:34.441 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:34.441 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.776275+0000", 2024-09-13T06:40:34.441 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.12329396099999999 2024-09-13T06:40:34.441 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:34.441 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:34.441 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:34.441 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.776316+0000", 2024-09-13T06:40:34.441 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.1244e-05 2024-09-13T06:40:34.441 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:34.441 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:34.441 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:34.441 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.776607+0000", 2024-09-13T06:40:34.441 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00029051199999999999 2024-09-13T06:40:34.442 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:34.442 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:34.442 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:34.442 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:34.442 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:34.442 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43182 3.17 3:ec5ebce4:::rbd_data.1121f5f2e1c0.0000000000000001:1f [read 333824~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:40:34.442 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.652985+0000", 2024-09-13T06:40:34.442 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 12.767512798, 2024-09-13T06:40:34.442 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123926616, 2024-09-13T06:40:34.442 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:34.442 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:34.442 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:34.442 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:34.443 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:34.443 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43182 2024-09-13T06:40:34.443 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:34.443 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:34.443 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:34.443 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:34.443 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.652985+0000", 2024-09-13T06:40:34.443 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:34.443 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:34.443 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:34.443 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:34.443 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.652985+0000", 2024-09-13T06:40:34.443 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:34.443 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:34.444 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:34.444 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:34.444 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.652985+0000", 2024-09-13T06:40:34.444 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:34.444 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:34.444 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:34.444 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:34.444 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.652987+0000", 2024-09-13T06:40:34.444 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0899999999999999e-06 2024-09-13T06:40:34.444 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:34.444 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:34.444 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:34.444 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.652994+0000", 2024-09-13T06:40:34.445 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3100000000000003e-06 2024-09-13T06:40:34.445 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:34.445 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:34.445 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:34.445 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.653000+0000", 2024-09-13T06:40:34.445 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2020000000000003e-06 2024-09-13T06:40:34.445 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:34.445 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:34.445 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:34.445 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.776635+0000", 2024-09-13T06:40:34.445 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.12363529400000001 2024-09-13T06:40:34.445 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:34.445 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:34.446 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:34.446 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.776676+0000", 2024-09-13T06:40:34.446 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.0745999999999999e-05 2024-09-13T06:40:34.446 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:34.446 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:34.446 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:34.446 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.776912+0000", 2024-09-13T06:40:34.446 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00023631300000000001 2024-09-13T06:40:34.446 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:34.446 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:34.446 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:34.446 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:34.446 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:34.446 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43192 3.17 3:ec5ebce4:::rbd_data.1121f5f2e1c0.0000000000000001:1f [read 466944~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:40:34.447 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.656622+0000", 2024-09-13T06:40:34.447 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 12.763875742, 2024-09-13T06:40:34.447 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123503136, 2024-09-13T06:40:34.447 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:34.447 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:34.447 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:34.447 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:34.447 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:34.447 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43192 2024-09-13T06:40:34.447 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:34.447 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:34.447 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:34.447 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:34.447 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656622+0000", 2024-09-13T06:40:34.448 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:34.448 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:34.448 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:34.448 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:34.448 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656622+0000", 2024-09-13T06:40:34.448 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:34.448 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:34.448 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:34.448 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:34.448 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656622+0000", 2024-09-13T06:40:34.448 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:40:34.448 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:34.448 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:34.449 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:34.449 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656623+0000", 2024-09-13T06:40:34.449 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2079999999999999e-06 2024-09-13T06:40:34.449 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:34.449 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:34.449 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:34.449 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656627+0000", 2024-09-13T06:40:34.449 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.4819999999999999e-06 2024-09-13T06:40:34.449 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:34.449 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:34.449 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:34.449 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656629+0000", 2024-09-13T06:40:34.449 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.582e-06 2024-09-13T06:40:34.449 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:34.450 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:34.450 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:34.450 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.779866+0000", 2024-09-13T06:40:34.450 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.12323638100000001 2024-09-13T06:40:34.450 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:34.450 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:34.450 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:34.450 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.779905+0000", 2024-09-13T06:40:34.450 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.9529e-05 2024-09-13T06:40:34.450 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:34.450 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:34.450 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:34.450 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.780125+0000", 2024-09-13T06:40:34.451 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000220168 2024-09-13T06:40:34.451 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:34.451 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:34.451 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:34.451 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:34.451 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:34.451 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43193 3.17 3:ec5ebce4:::rbd_data.1121f5f2e1c0.0000000000000001:1f [read 481280~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:40:34.451 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.656635+0000", 2024-09-13T06:40:34.451 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 12.763863258000001, 2024-09-13T06:40:34.451 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.12374478999999999, 2024-09-13T06:40:34.451 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:34.451 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:34.451 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:34.452 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:34.452 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:34.452 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43193 2024-09-13T06:40:34.452 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:34.452 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:34.452 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:34.452 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:34.452 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656635+0000", 2024-09-13T06:40:34.452 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:34.452 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:34.452 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:34.452 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:34.452 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656635+0000", 2024-09-13T06:40:34.453 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:34.453 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:34.453 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:34.453 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:34.453 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656635+0000", 2024-09-13T06:40:34.453 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:40:34.453 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:34.453 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:34.453 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:34.453 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656636+0000", 2024-09-13T06:40:34.453 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.544e-06 2024-09-13T06:40:34.453 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:34.453 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:34.453 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:34.454 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656639+0000", 2024-09-13T06:40:34.454 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.0879999999999999e-06 2024-09-13T06:40:34.454 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:34.454 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:34.454 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:34.454 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656642+0000", 2024-09-13T06:40:34.454 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5799999999999999e-06 2024-09-13T06:40:34.454 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:34.454 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:34.454 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:34.454 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.780151+0000", 2024-09-13T06:40:34.454 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123509035 2024-09-13T06:40:34.454 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:34.455 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:34.455 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:34.455 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.780191+0000", 2024-09-13T06:40:34.455 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.9758000000000001e-05 2024-09-13T06:40:34.455 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:34.455 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:34.455 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:34.455 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.780380+0000", 2024-09-13T06:40:34.455 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000189023 2024-09-13T06:40:34.455 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:34.455 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:34.455 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:34.455 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:34.455 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:34.456 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43194 3.17 3:ec5ebce4:::rbd_data.1121f5f2e1c0.0000000000000001:1f [read 495616~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:40:34.456 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.656645+0000", 2024-09-13T06:40:34.456 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 12.763852605, 2024-09-13T06:40:34.456 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.124088483, 2024-09-13T06:40:34.456 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:34.456 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:34.456 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:34.456 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:34.456 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:34.456 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43194 2024-09-13T06:40:34.456 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:34.456 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:34.456 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:34.457 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:34.457 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656645+0000", 2024-09-13T06:40:34.457 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:34.457 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:34.457 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:34.457 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:34.457 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656645+0000", 2024-09-13T06:40:34.457 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:34.457 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:34.457 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:34.457 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:34.457 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656645+0000", 2024-09-13T06:40:34.457 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:34.458 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:34.458 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:34.458 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:34.458 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656647+0000", 2024-09-13T06:40:34.458 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9180000000000001e-06 2024-09-13T06:40:34.458 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:34.458 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:34.458 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:34.458 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656653+0000", 2024-09-13T06:40:34.458 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7860000000000002e-06 2024-09-13T06:40:34.458 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:34.458 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:34.458 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:34.459 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656658+0000", 2024-09-13T06:40:34.459 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6949999999999999e-06 2024-09-13T06:40:34.459 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:34.459 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:34.459 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:34.459 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.780406+0000", 2024-09-13T06:40:34.459 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123748657 2024-09-13T06:40:34.459 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:34.459 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:34.459 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:34.459 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.780446+0000", 2024-09-13T06:40:34.459 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.9360999999999998e-05 2024-09-13T06:40:34.459 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:34.459 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:34.460 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:34.460 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.780734+0000", 2024-09-13T06:40:34.460 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00028838399999999998 2024-09-13T06:40:34.460 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:34.460 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:34.460 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:34.460 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:34.460 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:34.460 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43240 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 106496~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:40:34.460 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.660672+0000", 2024-09-13T06:40:34.460 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 12.759826242000001, 2024-09-13T06:40:34.460 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123612707, 2024-09-13T06:40:34.460 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:34.461 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:34.461 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:34.461 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:34.461 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:34.461 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43240 2024-09-13T06:40:34.461 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:34.461 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:34.461 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:34.461 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:34.461 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660672+0000", 2024-09-13T06:40:34.461 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:34.461 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:34.461 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:34.462 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:34.462 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660672+0000", 2024-09-13T06:40:34.462 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:34.462 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:34.462 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:34.462 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:34.462 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660671+0000", 2024-09-13T06:40:34.462 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:34.462 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:34.462 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:34.462 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:34.462 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660673+0000", 2024-09-13T06:40:34.462 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.652e-06 2024-09-13T06:40:34.463 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:34.463 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:34.463 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:34.463 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660677+0000", 2024-09-13T06:40:34.463 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.2509999999999996e-06 2024-09-13T06:40:34.463 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:34.463 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:34.463 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:34.463 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660680+0000", 2024-09-13T06:40:34.463 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.8150000000000002e-06 2024-09-13T06:40:34.463 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:34.463 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:34.464 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:34.464 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.783596+0000", 2024-09-13T06:40:34.464 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.122915841 2024-09-13T06:40:34.464 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:34.464 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:34.464 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:34.464 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.783682+0000", 2024-09-13T06:40:34.464 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.5822999999999995e-05 2024-09-13T06:40:34.464 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:34.464 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:34.464 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:34.464 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.784285+0000", 2024-09-13T06:40:34.464 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00060276500000000001 2024-09-13T06:40:34.465 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:34.465 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:34.465 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:34.465 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:34.465 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:34.465 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43241 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 120832~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:40:34.465 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.660682+0000", 2024-09-13T06:40:34.465 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 12.759815667, 2024-09-13T06:40:34.465 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123958204, 2024-09-13T06:40:34.465 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:34.465 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:34.465 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:34.465 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:34.465 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:34.466 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43241 2024-09-13T06:40:34.466 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:34.466 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:34.466 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:34.466 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:34.466 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660682+0000", 2024-09-13T06:40:34.466 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:34.466 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:34.466 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:34.466 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:34.466 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660682+0000", 2024-09-13T06:40:34.466 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:34.466 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:34.466 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:34.467 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:34.467 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660682+0000", 2024-09-13T06:40:34.467 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:34.467 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:34.467 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:34.467 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:34.467 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660683+0000", 2024-09-13T06:40:34.467 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.308e-06 2024-09-13T06:40:34.467 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:34.467 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:34.467 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:34.467 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660686+0000", 2024-09-13T06:40:34.467 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.977e-06 2024-09-13T06:40:34.468 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:34.468 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:34.468 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:34.468 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660689+0000", 2024-09-13T06:40:34.468 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5830000000000001e-06 2024-09-13T06:40:34.468 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:34.468 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:34.468 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:34.468 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.784366+0000", 2024-09-13T06:40:34.468 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.12367713599999999 2024-09-13T06:40:34.468 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:34.468 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:34.468 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:34.469 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.784451+0000", 2024-09-13T06:40:34.469 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.4629999999999994e-05 2024-09-13T06:40:34.469 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:34.469 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:34.469 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:34.469 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.784641+0000", 2024-09-13T06:40:34.469 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00018984899999999999 2024-09-13T06:40:34.469 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:34.469 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:34.469 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:34.469 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:34.469 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:34.469 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43242 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 139264~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:40:34.470 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.660691+0000", 2024-09-13T06:40:34.470 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 12.759806688999999, 2024-09-13T06:40:34.470 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.124536443, 2024-09-13T06:40:34.470 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:34.470 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:34.470 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:34.470 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:34.470 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:34.470 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43242 2024-09-13T06:40:34.470 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:34.470 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:34.470 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:34.470 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:34.470 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660691+0000", 2024-09-13T06:40:34.471 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:34.471 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:34.471 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:34.471 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:34.471 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660691+0000", 2024-09-13T06:40:34.471 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:34.471 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:34.471 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:34.471 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:34.471 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660691+0000", 2024-09-13T06:40:34.471 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:40:34.471 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:34.471 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:34.472 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:34.472 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660696+0000", 2024-09-13T06:40:34.472 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0560000000000004e-06 2024-09-13T06:40:34.472 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:34.472 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:34.472 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:34.472 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660699+0000", 2024-09-13T06:40:34.472 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.2009999999999999e-06 2024-09-13T06:40:34.472 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:34.472 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:34.472 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:34.472 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660702+0000", 2024-09-13T06:40:34.473 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.633e-06 2024-09-13T06:40:34.473 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:34.473 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:34.473 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:34.473 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.784912+0000", 2024-09-13T06:40:34.473 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.124209497 2024-09-13T06:40:34.473 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:34.473 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:34.473 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:34.473 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.784995+0000", 2024-09-13T06:40:34.473 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.3891e-05 2024-09-13T06:40:34.473 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:34.473 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:34.473 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:34.474 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.785228+0000", 2024-09-13T06:40:34.474 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00023237400000000001 2024-09-13T06:40:34.474 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:34.474 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:34.474 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:34.474 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:34.474 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:34.474 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43243 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 153600~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:40:34.474 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.660705+0000", 2024-09-13T06:40:34.474 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 12.759793355999999, 2024-09-13T06:40:34.474 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.124825835, 2024-09-13T06:40:34.474 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:34.474 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:34.475 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:34.475 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:34.475 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:34.475 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43243 2024-09-13T06:40:34.475 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:34.475 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:34.475 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:34.475 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:34.475 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660705+0000", 2024-09-13T06:40:34.475 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:34.475 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:34.475 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:34.475 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:34.475 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660705+0000", 2024-09-13T06:40:34.476 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:34.476 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:34.476 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:34.476 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:34.476 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660705+0000", 2024-09-13T06:40:34.476 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:40:34.476 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:34.476 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:34.476 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:34.476 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660706+0000", 2024-09-13T06:40:34.476 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4339999999999999e-06 2024-09-13T06:40:34.476 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:34.477 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:34.477 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:34.477 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660709+0000", 2024-09-13T06:40:34.477 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9000000000000002e-06 2024-09-13T06:40:34.477 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:34.477 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:34.477 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:34.477 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660712+0000", 2024-09-13T06:40:34.477 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.0589999999999998e-06 2024-09-13T06:40:34.477 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:34.477 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:34.477 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:34.477 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.785318+0000", 2024-09-13T06:40:34.477 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.124606299 2024-09-13T06:40:34.478 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:34.478 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:34.478 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:34.478 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.785361+0000", 2024-09-13T06:40:34.478 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.3214999999999999e-05 2024-09-13T06:40:34.478 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:34.478 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:34.478 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:34.478 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.785531+0000", 2024-09-13T06:40:34.478 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00016914400000000001 2024-09-13T06:40:34.478 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:34.478 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:34.478 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:34.478 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:34.479 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:34.479 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43244 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 167936~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:40:34.479 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.660714+0000", 2024-09-13T06:40:34.479 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 12.759783943, 2024-09-13T06:40:34.479 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.125073248, 2024-09-13T06:40:34.479 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:34.479 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:34.479 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:34.479 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:34.479 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:34.479 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43244 2024-09-13T06:40:34.479 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:34.479 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:34.479 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:34.480 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:34.480 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660714+0000", 2024-09-13T06:40:34.480 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:34.480 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:34.480 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:34.480 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:34.480 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660714+0000", 2024-09-13T06:40:34.480 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:34.480 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:34.480 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:34.480 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:34.480 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660714+0000", 2024-09-13T06:40:34.480 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:40:34.481 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:34.481 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:34.481 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:34.481 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660715+0000", 2024-09-13T06:40:34.481 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2330000000000001e-06 2024-09-13T06:40:34.481 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:34.481 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:34.481 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:34.481 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660718+0000", 2024-09-13T06:40:34.481 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9569999999999998e-06 2024-09-13T06:40:34.481 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:34.481 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:34.481 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:34.481 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660721+0000", 2024-09-13T06:40:34.482 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.678e-06 2024-09-13T06:40:34.482 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:34.482 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:34.482 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:34.482 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.785557+0000", 2024-09-13T06:40:34.482 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.12483633199999999 2024-09-13T06:40:34.482 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:34.482 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:34.482 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:34.482 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.785618+0000", 2024-09-13T06:40:34.482 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0686000000000001e-05 2024-09-13T06:40:34.482 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:34.482 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:34.483 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:34.483 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.785787+0000", 2024-09-13T06:40:34.483 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00016957699999999999 2024-09-13T06:40:34.483 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:34.483 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:34.483 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:34.483 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:34.483 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:34.483 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43254 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 315392~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:40:34.483 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.664717+0000", 2024-09-13T06:40:34.483 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 12.755781375, 2024-09-13T06:40:34.483 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.12357108, 2024-09-13T06:40:34.483 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:34.484 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:34.484 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:34.484 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:34.484 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:34.484 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43254 2024-09-13T06:40:34.484 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:34.484 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:34.484 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:34.484 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:34.484 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664717+0000", 2024-09-13T06:40:34.484 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:34.484 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:34.484 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:34.485 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:34.485 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664717+0000", 2024-09-13T06:40:34.485 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:34.485 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:34.485 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:34.485 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:34.485 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664716+0000", 2024-09-13T06:40:34.485 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:34.485 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:34.485 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:34.485 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:34.485 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664724+0000", 2024-09-13T06:40:34.485 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.7109999999999995e-06 2024-09-13T06:40:34.486 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:34.486 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:34.486 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:34.486 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664732+0000", 2024-09-13T06:40:34.486 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.8399999999999995e-06 2024-09-13T06:40:34.486 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:34.486 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:34.486 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:34.486 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664738+0000", 2024-09-13T06:40:34.486 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.879e-06 2024-09-13T06:40:34.486 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:34.486 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:34.486 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:34.487 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.788018+0000", 2024-09-13T06:40:34.487 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123280719 2024-09-13T06:40:34.487 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:34.487 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:34.487 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:34.487 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.788119+0000", 2024-09-13T06:40:34.487 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000100558 2024-09-13T06:40:34.487 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:34.488 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:34.488 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:34.488 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.788288+0000", 2024-09-13T06:40:34.488 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000168751 2024-09-13T06:40:34.488 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:34.488 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:34.488 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:34.488 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:34.488 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:34.488 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43255 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 329728~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:40:34.488 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.664743+0000", 2024-09-13T06:40:34.488 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 12.755755379, 2024-09-13T06:40:34.488 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.12381711500000001, 2024-09-13T06:40:34.489 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:34.489 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:34.489 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:34.489 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:34.489 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:34.489 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43255 2024-09-13T06:40:34.489 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:34.489 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:34.489 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:34.489 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:34.489 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664743+0000", 2024-09-13T06:40:34.489 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:34.489 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:34.490 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:34.490 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:34.490 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664743+0000", 2024-09-13T06:40:34.490 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:34.490 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:34.490 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:34.490 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:34.490 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664742+0000", 2024-09-13T06:40:34.490 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:34.490 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:34.490 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:34.490 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:34.490 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664745+0000", 2024-09-13T06:40:34.491 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.7269999999999999e-06 2024-09-13T06:40:34.491 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:34.491 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:34.491 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:34.491 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664753+0000", 2024-09-13T06:40:34.491 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.8709999999999997e-06 2024-09-13T06:40:34.491 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:34.491 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:34.491 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:34.491 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664758+0000", 2024-09-13T06:40:34.491 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2220000000000001e-06 2024-09-13T06:40:34.491 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:34.491 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:34.492 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:34.492 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.788314+0000", 2024-09-13T06:40:34.492 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123555545 2024-09-13T06:40:34.492 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:34.492 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:34.492 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:34.492 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.788368+0000", 2024-09-13T06:40:34.492 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3928999999999998e-05 2024-09-13T06:40:34.492 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:34.492 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:34.492 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:34.492 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.788560+0000", 2024-09-13T06:40:34.492 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000192237 2024-09-13T06:40:34.493 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:34.493 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:34.493 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:34.493 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:34.493 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:34.493 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43256 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 344064~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:40:34.493 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.664763+0000", 2024-09-13T06:40:34.493 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 12.755735433, 2024-09-13T06:40:34.493 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.12418359399999999, 2024-09-13T06:40:34.493 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:34.493 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:34.493 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:34.493 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:34.494 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:34.494 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43256 2024-09-13T06:40:34.494 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:34.494 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:34.494 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:34.494 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:34.494 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664763+0000", 2024-09-13T06:40:34.494 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:34.494 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:34.494 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:34.494 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:34.494 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664763+0000", 2024-09-13T06:40:34.494 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:34.494 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:34.495 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:34.495 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:34.495 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664762+0000", 2024-09-13T06:40:34.495 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:34.495 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:34.495 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:34.495 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:34.495 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664765+0000", 2024-09-13T06:40:34.495 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3290000000000001e-06 2024-09-13T06:40:34.495 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:34.495 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:34.495 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:34.495 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664771+0000", 2024-09-13T06:40:34.496 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.1319999999999999e-06 2024-09-13T06:40:34.496 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:34.496 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:34.496 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:34.496 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664776+0000", 2024-09-13T06:40:34.496 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.8840000000000002e-06 2024-09-13T06:40:34.496 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:34.496 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:34.496 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:34.496 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.788598+0000", 2024-09-13T06:40:34.496 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123821979 2024-09-13T06:40:34.496 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:34.496 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:34.497 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:34.497 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.788680+0000", 2024-09-13T06:40:34.497 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.2367999999999995e-05 2024-09-13T06:40:34.497 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:34.497 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:34.497 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:34.497 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.788946+0000", 2024-09-13T06:40:34.497 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00026629799999999999 2024-09-13T06:40:34.497 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:34.497 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:34.497 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:34.497 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:34.497 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:34.498 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43265 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 477184~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:40:34.498 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.669414+0000", 2024-09-13T06:40:34.498 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 12.751083797, 2024-09-13T06:40:34.498 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123446973, 2024-09-13T06:40:34.498 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:34.498 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:34.498 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:34.498 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:34.498 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:34.498 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43265 2024-09-13T06:40:34.498 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:34.498 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:34.498 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:34.498 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:34.499 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669414+0000", 2024-09-13T06:40:34.499 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:34.499 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:34.499 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:34.499 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:34.499 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669414+0000", 2024-09-13T06:40:34.499 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:34.499 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:34.499 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:34.499 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:34.499 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669414+0000", 2024-09-13T06:40:34.499 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:34.499 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:34.499 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:34.500 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:34.500 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669416+0000", 2024-09-13T06:40:34.500 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.317e-06 2024-09-13T06:40:34.500 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:34.500 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:34.500 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:34.500 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669425+0000", 2024-09-13T06:40:34.500 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.0650000000000005e-06 2024-09-13T06:40:34.500 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:34.500 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:34.500 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:34.500 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669430+0000", 2024-09-13T06:40:34.500 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5079999999999999e-06 2024-09-13T06:40:34.501 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:34.501 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:34.501 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:34.501 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.792649+0000", 2024-09-13T06:40:34.501 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123219328 2024-09-13T06:40:34.501 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:34.501 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:34.501 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:34.501 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.792695+0000", 2024-09-13T06:40:34.501 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5476999999999998e-05 2024-09-13T06:40:34.501 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:34.501 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:34.501 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:34.502 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.792861+0000", 2024-09-13T06:40:34.502 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00016658999999999999 2024-09-13T06:40:34.502 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:34.502 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:34.502 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:34.502 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:34.502 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:34.502 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43266 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 491520~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:40:34.502 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.669434+0000", 2024-09-13T06:40:34.502 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 12.751063674999999, 2024-09-13T06:40:34.502 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123685267, 2024-09-13T06:40:34.502 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:34.502 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:34.502 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:34.503 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:34.503 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:34.503 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43266 2024-09-13T06:40:34.503 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:34.503 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:34.503 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:34.503 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:34.503 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669434+0000", 2024-09-13T06:40:34.503 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:34.503 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:34.503 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:34.503 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:34.503 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669434+0000", 2024-09-13T06:40:34.503 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:34.504 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:34.504 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:34.504 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:34.504 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669434+0000", 2024-09-13T06:40:34.504 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:34.504 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:34.504 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:34.504 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:34.504 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669441+0000", 2024-09-13T06:40:34.504 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3019999999999997e-06 2024-09-13T06:40:34.504 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:34.504 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:34.505 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:34.505 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669451+0000", 2024-09-13T06:40:34.505 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.6379999999999999e-06 2024-09-13T06:40:34.505 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:34.505 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:34.505 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:34.505 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669456+0000", 2024-09-13T06:40:34.505 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.361e-06 2024-09-13T06:40:34.505 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:34.505 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:34.505 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:34.505 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.792879+0000", 2024-09-13T06:40:34.505 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123422686 2024-09-13T06:40:34.505 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:34.506 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:34.506 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:34.506 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.792923+0000", 2024-09-13T06:40:34.506 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4035000000000001e-05 2024-09-13T06:40:34.506 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:34.506 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:34.506 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:34.506 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.793120+0000", 2024-09-13T06:40:34.506 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00019660899999999999 2024-09-13T06:40:34.506 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:34.506 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:34.506 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:34.506 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:34.506 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:34.507 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43267 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 505856~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:40:34.507 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.669461+0000", 2024-09-13T06:40:34.507 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 12.751036879000001, 2024-09-13T06:40:34.507 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123933711, 2024-09-13T06:40:34.507 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:34.507 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:34.507 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:34.507 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:34.507 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:34.507 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43267 2024-09-13T06:40:34.507 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:34.507 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:34.507 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:34.507 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:34.508 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669461+0000", 2024-09-13T06:40:34.508 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:34.508 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:34.508 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:34.508 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:34.508 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669461+0000", 2024-09-13T06:40:34.508 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:34.508 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:34.508 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:34.508 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:34.508 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669461+0000", 2024-09-13T06:40:34.508 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:34.508 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:34.509 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:34.509 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:34.509 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669463+0000", 2024-09-13T06:40:34.509 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5629999999999999e-06 2024-09-13T06:40:34.509 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:34.509 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:34.509 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:34.509 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669473+0000", 2024-09-13T06:40:34.509 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.9520000000000006e-06 2024-09-13T06:40:34.509 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:34.509 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:34.509 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:34.509 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669479+0000", 2024-09-13T06:40:34.509 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8540000000000002e-06 2024-09-13T06:40:34.510 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:34.510 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:34.510 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:34.510 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.793137+0000", 2024-09-13T06:40:34.510 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.12365825699999999 2024-09-13T06:40:34.510 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:34.510 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:34.510 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:34.510 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.793181+0000", 2024-09-13T06:40:34.510 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.3773999999999998e-05 2024-09-13T06:40:34.510 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:34.510 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:34.510 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:34.511 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.793395+0000", 2024-09-13T06:40:34.511 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00021372399999999999 2024-09-13T06:40:34.511 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:34.511 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:34.511 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:34.511 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:34.511 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:34.511 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43268 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 520192~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:40:34.511 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.669484+0000", 2024-09-13T06:40:34.511 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 12.751014094, 2024-09-13T06:40:34.511 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.12441057899999999, 2024-09-13T06:40:34.511 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:34.511 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:34.511 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:34.512 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:34.512 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:34.512 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43268 2024-09-13T06:40:34.512 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:34.512 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:34.512 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:34.512 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:34.512 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669484+0000", 2024-09-13T06:40:34.512 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:34.512 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:34.512 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:34.512 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:34.512 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669484+0000", 2024-09-13T06:40:34.513 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:34.513 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:34.513 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:34.513 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:34.513 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669484+0000", 2024-09-13T06:40:34.513 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:34.513 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:34.513 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:34.513 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:34.513 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669486+0000", 2024-09-13T06:40:34.513 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6120000000000001e-06 2024-09-13T06:40:34.513 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:34.513 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:34.513 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:34.514 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669494+0000", 2024-09-13T06:40:34.514 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4819999999999997e-06 2024-09-13T06:40:34.514 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:34.514 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:34.514 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:34.514 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669497+0000", 2024-09-13T06:40:34.514 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9790000000000002e-06 2024-09-13T06:40:34.514 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:34.514 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:34.514 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:34.514 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.793559+0000", 2024-09-13T06:40:34.514 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.124062436 2024-09-13T06:40:34.514 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:34.514 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:34.515 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:34.515 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.793603+0000", 2024-09-13T06:40:34.515 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.3764999999999999e-05 2024-09-13T06:40:34.515 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:34.515 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:34.515 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:34.515 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.793895+0000", 2024-09-13T06:40:34.515 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00029168299999999999 2024-09-13T06:40:34.515 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:34.515 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:34.515 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:34.515 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:34.515 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:34.516 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:40:34.517 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-13T06:40:34.518 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-13T06:40:34.514+0000 7f86a5f06640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26387) UID: 0 2024-09-13T06:40:34.588 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-13T06:40:34.653 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:40:34.652+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:40:34.685 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:40:34.685 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-13T06:40:34.685 INFO:teuthology.orchestra.run.smithi081.stdout: "num_ops": 0 2024-09-13T06:40:34.685 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:40:34.699 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-13T06:40:34.741 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:40:34.744+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:40:34.821 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:40:34.824+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:40:34.848 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:40:34.848 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-13T06:40:34.848 INFO:teuthology.orchestra.run.smithi081.stdout: "complaint_time": 30, 2024-09-13T06:40:34.848 INFO:teuthology.orchestra.run.smithi081.stdout: "num_blocked_ops": 0 2024-09-13T06:40:34.848 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:40:34.860 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-13T06:40:34.949 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:40:34.952+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:40:35.011 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:40:35.012 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 20, 2024-09-13T06:40:35.012 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 600, 2024-09-13T06:40:35.012 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [ 2024-09-13T06:40:35.012 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.012 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:21979 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 14217216~4096 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:40:35.012 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.888811+0000", 2024-09-13T06:40:35.012 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 42.123277887999997, 2024-09-13T06:40:35.012 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049092969, 2024-09-13T06:40:35.012 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:35.012 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:35.012 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:35.012 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:35.012 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:35.012 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 21979 2024-09-13T06:40:35.013 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.013 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:35.013 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.013 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:35.013 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888811+0000", 2024-09-13T06:40:35.013 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:35.013 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.013 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.013 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:35.013 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888811+0000", 2024-09-13T06:40:35.013 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:35.013 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.013 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.014 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:35.014 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888811+0000", 2024-09-13T06:40:35.014 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:40:35.014 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.014 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.014 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:35.014 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888812+0000", 2024-09-13T06:40:35.014 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.204e-06 2024-09-13T06:40:35.014 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.014 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.014 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:35.014 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888815+0000", 2024-09-13T06:40:35.014 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9359999999999999e-06 2024-09-13T06:40:35.015 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.015 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.015 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:35.015 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888818+0000", 2024-09-13T06:40:35.015 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.7369999999999998e-06 2024-09-13T06:40:35.015 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.015 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.015 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:35.015 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.937663+0000", 2024-09-13T06:40:35.015 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.048844540999999998 2024-09-13T06:40:35.015 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.015 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.015 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:35.015 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.937709+0000", 2024-09-13T06:40:35.016 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6492999999999997e-05 2024-09-13T06:40:35.016 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.016 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.016 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:35.016 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.937904+0000", 2024-09-13T06:40:35.016 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00019526499999999999 2024-09-13T06:40:35.016 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:35.016 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:35.016 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:35.016 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.016 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.016 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:21980 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 14245888~4096 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:40:35.016 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.888820+0000", 2024-09-13T06:40:35.017 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 42.123269211, 2024-09-13T06:40:35.017 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049357080999999997, 2024-09-13T06:40:35.017 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:35.017 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:35.017 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:35.017 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:35.017 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:35.017 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 21980 2024-09-13T06:40:35.017 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.017 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:35.017 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.017 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:35.017 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888820+0000", 2024-09-13T06:40:35.017 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:35.018 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.018 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.018 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:35.018 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888820+0000", 2024-09-13T06:40:35.018 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:35.018 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.018 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.018 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:35.018 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888820+0000", 2024-09-13T06:40:35.018 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:40:35.018 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.018 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.018 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:35.019 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888821+0000", 2024-09-13T06:40:35.019 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.122e-06 2024-09-13T06:40:35.019 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.019 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.019 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:35.019 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888824+0000", 2024-09-13T06:40:35.019 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.0580000000000002e-06 2024-09-13T06:40:35.019 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.019 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.019 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:35.020 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888827+0000", 2024-09-13T06:40:35.020 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.666e-06 2024-09-13T06:40:35.020 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.020 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.020 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:35.020 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.937935+0000", 2024-09-13T06:40:35.020 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049108329999999999 2024-09-13T06:40:35.020 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.020 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.020 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:35.021 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.937985+0000", 2024-09-13T06:40:35.021 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9694000000000002e-05 2024-09-13T06:40:35.021 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.021 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.021 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:35.021 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.938177+0000", 2024-09-13T06:40:35.021 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00019241899999999999 2024-09-13T06:40:35.021 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:35.021 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:35.021 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:35.021 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.021 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.021 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:21984 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:snapdir [list-snaps] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:40:35.022 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.888829+0000", 2024-09-13T06:40:35.022 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 42.123260432999999, 2024-09-13T06:40:35.022 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049524545000000003, 2024-09-13T06:40:35.022 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:35.022 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:35.022 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:35.022 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:35.022 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:35.022 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 21984 2024-09-13T06:40:35.022 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.022 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:35.022 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.022 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:35.023 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888829+0000", 2024-09-13T06:40:35.023 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:35.023 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.023 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.023 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:35.023 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888829+0000", 2024-09-13T06:40:35.023 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:35.023 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.023 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.023 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:35.023 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888829+0000", 2024-09-13T06:40:35.023 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:40:35.023 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.023 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.024 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:35.024 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888830+0000", 2024-09-13T06:40:35.024 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2529999999999999e-06 2024-09-13T06:40:35.024 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.024 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.024 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:35.024 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888835+0000", 2024-09-13T06:40:35.024 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.4729999999999999e-06 2024-09-13T06:40:35.024 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.024 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.024 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:35.024 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888840+0000", 2024-09-13T06:40:35.024 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0159999999999999e-06 2024-09-13T06:40:35.025 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.025 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.025 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:35.025 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.938199+0000", 2024-09-13T06:40:35.025 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049358974999999999 2024-09-13T06:40:35.025 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.025 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.025 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:35.025 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.938268+0000", 2024-09-13T06:40:35.025 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.8876999999999998e-05 2024-09-13T06:40:35.025 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.025 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.025 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:35.025 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.938353+0000", 2024-09-13T06:40:35.026 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.5155999999999996e-05 2024-09-13T06:40:35.026 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:35.026 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:35.026 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:35.026 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.026 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.026 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:21985 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 12587008~4096 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:40:35.026 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.888858+0000", 2024-09-13T06:40:35.026 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 42.123231283000003, 2024-09-13T06:40:35.026 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049674347000000001, 2024-09-13T06:40:35.026 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:35.026 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:35.026 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:35.026 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:35.027 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:35.027 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 21985 2024-09-13T06:40:35.027 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.027 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:35.027 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.027 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:35.027 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888858+0000", 2024-09-13T06:40:35.027 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:35.027 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.027 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.027 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:35.027 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888858+0000", 2024-09-13T06:40:35.027 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:35.027 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.028 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.028 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:35.028 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888857+0000", 2024-09-13T06:40:35.028 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:35.028 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.028 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.028 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:35.028 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888860+0000", 2024-09-13T06:40:35.028 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4739999999999999e-06 2024-09-13T06:40:35.028 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.028 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.028 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:35.028 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888867+0000", 2024-09-13T06:40:35.029 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.7170000000000002e-06 2024-09-13T06:40:35.029 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.029 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.029 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:35.029 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888871+0000", 2024-09-13T06:40:35.029 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5120000000000002e-06 2024-09-13T06:40:35.029 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.029 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.029 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:35.029 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.938389+0000", 2024-09-13T06:40:35.029 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049517717000000003 2024-09-13T06:40:35.029 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.029 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.030 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:35.030 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.938449+0000", 2024-09-13T06:40:35.030 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0513999999999997e-05 2024-09-13T06:40:35.030 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.030 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.030 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:35.030 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.938532+0000", 2024-09-13T06:40:35.030 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.2936999999999996e-05 2024-09-13T06:40:35.030 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:35.030 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:35.030 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:35.030 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.030 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.031 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:21986 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 12615680~4096 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:40:35.031 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.888875+0000", 2024-09-13T06:40:35.031 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 42.12321377, 2024-09-13T06:40:35.031 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049881781, 2024-09-13T06:40:35.031 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:35.031 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:35.031 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:35.031 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:35.031 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:35.031 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 21986 2024-09-13T06:40:35.031 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.031 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:35.031 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.032 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:35.032 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888875+0000", 2024-09-13T06:40:35.032 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:35.032 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.032 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.032 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:35.032 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888875+0000", 2024-09-13T06:40:35.032 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:35.032 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.032 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.032 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:35.032 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888875+0000", 2024-09-13T06:40:35.032 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:35.033 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.033 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.033 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:35.033 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888880+0000", 2024-09-13T06:40:35.033 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7600000000000002e-06 2024-09-13T06:40:35.033 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.033 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.033 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:35.033 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888887+0000", 2024-09-13T06:40:35.033 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3950000000000003e-06 2024-09-13T06:40:35.033 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.033 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.033 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:35.034 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888892+0000", 2024-09-13T06:40:35.034 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0409999999999997e-06 2024-09-13T06:40:35.034 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.034 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.034 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:35.034 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.938568+0000", 2024-09-13T06:40:35.034 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049675267000000002 2024-09-13T06:40:35.034 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.034 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.034 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:35.034 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.938653+0000", 2024-09-13T06:40:35.034 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.5792999999999997e-05 2024-09-13T06:40:35.034 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.034 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.035 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:35.035 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.938757+0000", 2024-09-13T06:40:35.035 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00010387699999999999 2024-09-13T06:40:35.035 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:35.035 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:35.035 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:35.035 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.035 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.035 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:21987 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 12644352~4096 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:40:35.035 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.888899+0000", 2024-09-13T06:40:35.035 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 42.123190424000001, 2024-09-13T06:40:35.035 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.050094056999999997, 2024-09-13T06:40:35.035 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:35.036 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:35.036 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:35.036 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:35.036 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:35.036 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 21987 2024-09-13T06:40:35.036 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.036 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:35.036 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.036 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:35.036 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888899+0000", 2024-09-13T06:40:35.036 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:35.036 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.036 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.037 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:35.037 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888899+0000", 2024-09-13T06:40:35.037 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:35.037 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.040 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.040 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:35.040 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888899+0000", 2024-09-13T06:40:35.040 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:35.041 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.041 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.041 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:35.041 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888901+0000", 2024-09-13T06:40:35.041 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2539999999999999e-06 2024-09-13T06:40:35.041 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.041 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.041 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:35.041 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888907+0000", 2024-09-13T06:40:35.041 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9009999999999999e-06 2024-09-13T06:40:35.041 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.041 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.041 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:35.042 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888912+0000", 2024-09-13T06:40:35.042 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9840000000000001e-06 2024-09-13T06:40:35.042 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.042 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.042 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:35.042 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.938810+0000", 2024-09-13T06:40:35.042 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049898835000000002 2024-09-13T06:40:35.042 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.042 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.042 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:35.042 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.938890+0000", 2024-09-13T06:40:35.042 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.9215000000000006e-05 2024-09-13T06:40:35.042 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.043 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.043 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:35.043 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.938993+0000", 2024-09-13T06:40:35.043 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000103194 2024-09-13T06:40:35.043 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:35.043 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:35.043 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:35.043 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.043 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.043 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:21988 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 12673024~4096 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:40:35.043 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.888916+0000", 2024-09-13T06:40:35.043 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 42.123173408, 2024-09-13T06:40:35.043 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.050203036999999999, 2024-09-13T06:40:35.043 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:35.044 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:35.044 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:35.044 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:35.044 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:35.044 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 21988 2024-09-13T06:40:35.044 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.044 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:35.044 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.044 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:35.044 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888916+0000", 2024-09-13T06:40:35.044 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:35.044 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.044 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.045 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:35.045 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888916+0000", 2024-09-13T06:40:35.045 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:35.045 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.045 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.045 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:35.045 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888915+0000", 2024-09-13T06:40:35.045 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:35.045 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.045 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.045 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:35.045 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888918+0000", 2024-09-13T06:40:35.045 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1500000000000002e-06 2024-09-13T06:40:35.045 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.046 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.046 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:35.046 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888925+0000", 2024-09-13T06:40:35.046 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.9380000000000003e-06 2024-09-13T06:40:35.046 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.046 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.046 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:35.046 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888933+0000", 2024-09-13T06:40:35.046 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.0560000000000005e-06 2024-09-13T06:40:35.046 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.046 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.046 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:35.046 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.939026+0000", 2024-09-13T06:40:35.046 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.050093499999999999 2024-09-13T06:40:35.047 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.047 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.047 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:35.047 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.939068+0000", 2024-09-13T06:40:35.047 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.1705999999999997e-05 2024-09-13T06:40:35.047 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.047 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.047 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:35.047 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.939119+0000", 2024-09-13T06:40:35.047 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.1048999999999999e-05 2024-09-13T06:40:35.047 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:35.048 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:35.048 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:35.048 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.048 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.048 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:21989 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 12701696~4096 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:40:35.048 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.888938+0000", 2024-09-13T06:40:35.048 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 42.123151081000003, 2024-09-13T06:40:35.048 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.050294393999999999, 2024-09-13T06:40:35.048 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:35.048 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:35.048 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:35.049 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:35.049 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:35.049 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 21989 2024-09-13T06:40:35.049 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.049 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:35.049 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.049 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:35.049 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888938+0000", 2024-09-13T06:40:35.049 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:35.049 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.049 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.049 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:35.049 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888938+0000", 2024-09-13T06:40:35.050 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:35.050 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.050 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.050 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:35.050 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888938+0000", 2024-09-13T06:40:35.050 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:35.050 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.050 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.050 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:35.050 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888940+0000", 2024-09-13T06:40:35.050 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5330000000000001e-06 2024-09-13T06:40:35.050 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.050 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.050 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:35.051 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888947+0000", 2024-09-13T06:40:35.051 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.2389999999999999e-06 2024-09-13T06:40:35.051 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.051 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.051 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:35.051 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888952+0000", 2024-09-13T06:40:35.051 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.5720000000000002e-06 2024-09-13T06:40:35.051 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.051 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.051 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:35.051 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.939141+0000", 2024-09-13T06:40:35.051 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.050188903999999999 2024-09-13T06:40:35.051 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.051 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.051 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:35.052 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.939182+0000", 2024-09-13T06:40:35.052 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.0926000000000001e-05 2024-09-13T06:40:35.052 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.052 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.052 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:35.052 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.939233+0000", 2024-09-13T06:40:35.052 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0532999999999999e-05 2024-09-13T06:40:35.052 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:35.052 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:35.052 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:35.052 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.052 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.052 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:22006 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 13189120~4096 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:40:35.053 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.892763+0000", 2024-09-13T06:40:35.053 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 42.119326555000001, 2024-09-13T06:40:35.053 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.048963505999999997, 2024-09-13T06:40:35.053 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:35.053 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:35.053 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:35.053 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:35.053 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:35.053 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 22006 2024-09-13T06:40:35.053 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.053 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:35.053 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.053 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:35.053 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892763+0000", 2024-09-13T06:40:35.054 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:35.054 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.054 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.054 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:35.054 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892763+0000", 2024-09-13T06:40:35.054 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:35.054 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.054 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.054 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:35.054 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892763+0000", 2024-09-13T06:40:35.054 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:40:35.054 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.054 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.054 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:35.055 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892764+0000", 2024-09-13T06:40:35.055 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2410000000000001e-06 2024-09-13T06:40:35.055 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.055 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.055 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:35.055 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892767+0000", 2024-09-13T06:40:35.055 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9390000000000002e-06 2024-09-13T06:40:35.055 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.055 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.055 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:35.055 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892769+0000", 2024-09-13T06:40:35.055 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5390000000000002e-06 2024-09-13T06:40:35.055 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.055 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.056 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:35.056 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.941560+0000", 2024-09-13T06:40:35.056 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.048791221000000003 2024-09-13T06:40:35.056 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.056 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.056 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:35.056 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.941632+0000", 2024-09-13T06:40:35.056 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.1932000000000002e-05 2024-09-13T06:40:35.056 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.056 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.056 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:35.056 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.941726+0000", 2024-09-13T06:40:35.056 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.3839999999999996e-05 2024-09-13T06:40:35.056 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:35.057 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:35.057 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:35.057 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.057 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.057 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:22007 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 13217792~4096 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:40:35.057 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.892771+0000", 2024-09-13T06:40:35.057 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 42.119317975000001, 2024-09-13T06:40:35.057 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049090024000000003, 2024-09-13T06:40:35.057 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:35.057 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:35.057 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:35.057 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:35.057 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:35.058 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 22007 2024-09-13T06:40:35.058 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.058 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:35.058 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.058 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:35.058 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892771+0000", 2024-09-13T06:40:35.058 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:35.058 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.058 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.058 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:35.058 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892771+0000", 2024-09-13T06:40:35.058 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:35.058 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.059 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.059 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:35.059 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892771+0000", 2024-09-13T06:40:35.059 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:40:35.059 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.059 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.059 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:35.059 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892772+0000", 2024-09-13T06:40:35.059 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.184e-06 2024-09-13T06:40:35.059 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.059 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.059 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:35.059 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892775+0000", 2024-09-13T06:40:35.059 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9179999999999998e-06 2024-09-13T06:40:35.059 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.060 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.060 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:35.060 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892778+0000", 2024-09-13T06:40:35.060 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4990000000000001e-06 2024-09-13T06:40:35.060 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.060 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.060 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:35.060 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.941760+0000", 2024-09-13T06:40:35.060 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.048982070000000003 2024-09-13T06:40:35.060 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.060 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.060 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:35.060 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.941808+0000", 2024-09-13T06:40:35.061 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.8278000000000001e-05 2024-09-13T06:40:35.061 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.061 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.061 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:35.061 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.941861+0000", 2024-09-13T06:40:35.061 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3284e-05 2024-09-13T06:40:35.061 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:35.061 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:35.061 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:35.061 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.061 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.061 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:22008 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 13246464~4096 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:40:35.061 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.892780+0000", 2024-09-13T06:40:35.061 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 42.119309317999999, 2024-09-13T06:40:35.062 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049200477999999999, 2024-09-13T06:40:35.062 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:35.062 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:35.062 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:35.062 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:35.062 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:35.062 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 22008 2024-09-13T06:40:35.062 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.062 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:35.062 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.062 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:35.062 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892780+0000", 2024-09-13T06:40:35.062 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:35.062 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.063 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.063 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:35.063 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892780+0000", 2024-09-13T06:40:35.063 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:35.063 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.063 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.063 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:35.063 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892780+0000", 2024-09-13T06:40:35.063 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:40:35.063 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.063 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.063 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:35.063 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892781+0000", 2024-09-13T06:40:35.063 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.083e-06 2024-09-13T06:40:35.064 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.064 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.064 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:35.064 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892784+0000", 2024-09-13T06:40:35.064 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.926e-06 2024-09-13T06:40:35.064 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.064 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.064 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:35.064 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892786+0000", 2024-09-13T06:40:35.064 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4490000000000002e-06 2024-09-13T06:40:35.064 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.064 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.064 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:35.064 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.941888+0000", 2024-09-13T06:40:35.065 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049102290999999999 2024-09-13T06:40:35.065 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.065 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.065 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:35.065 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.941929+0000", 2024-09-13T06:40:35.065 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.0541999999999999e-05 2024-09-13T06:40:35.065 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.065 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.065 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:35.065 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.941980+0000", 2024-09-13T06:40:35.065 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.1391999999999999e-05 2024-09-13T06:40:35.065 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:35.065 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:35.065 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:35.066 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.066 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.066 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:22009 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 13275136~4096 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:40:35.066 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.892788+0000", 2024-09-13T06:40:35.066 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 42.119300834000001, 2024-09-13T06:40:35.066 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049311926999999998, 2024-09-13T06:40:35.066 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:35.066 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:35.066 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:35.066 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:35.066 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:35.066 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 22009 2024-09-13T06:40:35.066 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.067 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:35.067 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.067 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:35.067 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892788+0000", 2024-09-13T06:40:35.067 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:35.067 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.067 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.067 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:35.067 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892788+0000", 2024-09-13T06:40:35.067 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:35.067 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.067 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.067 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:35.067 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892788+0000", 2024-09-13T06:40:35.068 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:40:35.068 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.068 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.068 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:35.068 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892789+0000", 2024-09-13T06:40:35.068 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1850000000000001e-06 2024-09-13T06:40:35.068 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.068 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.068 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:35.068 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892793+0000", 2024-09-13T06:40:35.068 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.9099999999999998e-06 2024-09-13T06:40:35.068 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.068 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.068 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:35.069 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892798+0000", 2024-09-13T06:40:35.069 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5070000000000002e-06 2024-09-13T06:40:35.069 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.069 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.069 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:35.069 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.942007+0000", 2024-09-13T06:40:35.069 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049208904999999997 2024-09-13T06:40:35.069 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.069 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.069 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:35.069 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.942049+0000", 2024-09-13T06:40:35.069 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.1922000000000003e-05 2024-09-13T06:40:35.069 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.070 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.070 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:35.070 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.942100+0000", 2024-09-13T06:40:35.070 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.1736000000000001e-05 2024-09-13T06:40:35.070 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:35.070 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:35.070 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:35.070 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.070 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.070 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:22010 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 13303808~4096 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:40:35.070 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.892817+0000", 2024-09-13T06:40:35.070 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 42.119272637999998, 2024-09-13T06:40:35.070 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049466149000000001, 2024-09-13T06:40:35.070 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:35.071 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:35.071 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:35.071 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:35.071 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:35.071 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 22010 2024-09-13T06:40:35.071 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.071 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:35.071 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.071 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:35.071 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892817+0000", 2024-09-13T06:40:35.071 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:35.071 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.071 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.071 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:35.072 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892817+0000", 2024-09-13T06:40:35.072 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:35.072 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.072 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.072 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:35.072 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892816+0000", 2024-09-13T06:40:35.072 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:35.072 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.072 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.072 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:35.072 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892821+0000", 2024-09-13T06:40:35.072 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9459999999999997e-06 2024-09-13T06:40:35.072 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.073 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.073 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:35.073 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892828+0000", 2024-09-13T06:40:35.073 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.6780000000000003e-06 2024-09-13T06:40:35.073 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.073 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.073 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:35.073 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892833+0000", 2024-09-13T06:40:35.073 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.8389999999999997e-06 2024-09-13T06:40:35.073 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.073 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.073 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:35.073 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.942127+0000", 2024-09-13T06:40:35.073 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049294163000000002 2024-09-13T06:40:35.074 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.074 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.074 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:35.074 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.942186+0000", 2024-09-13T06:40:35.074 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9335e-05 2024-09-13T06:40:35.074 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.074 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.074 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:35.074 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.942283+0000", 2024-09-13T06:40:35.074 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.6699000000000004e-05 2024-09-13T06:40:35.074 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:35.074 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:35.074 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:35.074 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.075 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.075 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:22011 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 13332480~4096 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:40:35.075 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.892838+0000", 2024-09-13T06:40:35.075 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 42.119250950999998, 2024-09-13T06:40:35.075 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049589214, 2024-09-13T06:40:35.075 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:35.075 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:35.075 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:35.075 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:35.075 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:35.075 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 22011 2024-09-13T06:40:35.075 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.075 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:35.076 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.076 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:35.076 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892838+0000", 2024-09-13T06:40:35.076 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:35.076 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.076 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.076 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:35.076 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892838+0000", 2024-09-13T06:40:35.076 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:35.076 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.076 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.076 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:35.076 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892838+0000", 2024-09-13T06:40:35.076 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:35.077 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.077 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.077 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:35.077 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892840+0000", 2024-09-13T06:40:35.077 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.136e-06 2024-09-13T06:40:35.077 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.077 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.077 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:35.077 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892852+0000", 2024-09-13T06:40:35.077 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2122e-05 2024-09-13T06:40:35.077 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.077 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.077 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:35.077 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892862+0000", 2024-09-13T06:40:35.078 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.7049999999999994e-06 2024-09-13T06:40:35.078 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.078 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.078 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:35.078 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.942319+0000", 2024-09-13T06:40:35.078 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049456623999999998 2024-09-13T06:40:35.078 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.078 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.078 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:35.078 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.942363+0000", 2024-09-13T06:40:35.078 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4759000000000003e-05 2024-09-13T06:40:35.078 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.078 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.078 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:35.079 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.942428+0000", 2024-09-13T06:40:35.079 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.4221999999999996e-05 2024-09-13T06:40:35.079 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:35.079 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:35.079 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:35.079 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.079 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.079 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:22033 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 13963264~4096 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:40:35.079 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.896824+0000", 2024-09-13T06:40:35.079 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 42.115265057999999, 2024-09-13T06:40:35.079 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049051957, 2024-09-13T06:40:35.079 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:35.079 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:35.080 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:35.080 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:35.080 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:35.080 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 22033 2024-09-13T06:40:35.080 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.080 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:35.080 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.080 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:35.080 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.896824+0000", 2024-09-13T06:40:35.080 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:35.080 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.080 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.080 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:35.080 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.896824+0000", 2024-09-13T06:40:35.081 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:35.081 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.081 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.081 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:35.081 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.896824+0000", 2024-09-13T06:40:35.081 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:35.081 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.081 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.081 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:35.081 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.896826+0000", 2024-09-13T06:40:35.081 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1900000000000002e-06 2024-09-13T06:40:35.081 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.081 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.081 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:35.082 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.896832+0000", 2024-09-13T06:40:35.082 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.2689999999999996e-06 2024-09-13T06:40:35.082 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.082 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.082 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:35.082 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.896840+0000", 2024-09-13T06:40:35.082 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3289999999999996e-06 2024-09-13T06:40:35.082 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.082 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.082 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:35.082 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.945777+0000", 2024-09-13T06:40:35.082 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.048937188 2024-09-13T06:40:35.082 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.082 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.083 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:35.083 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.945822+0000", 2024-09-13T06:40:35.083 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4780999999999997e-05 2024-09-13T06:40:35.083 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.083 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.083 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:35.083 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.945876+0000", 2024-09-13T06:40:35.083 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.4542000000000001e-05 2024-09-13T06:40:35.083 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:35.083 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:35.083 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:35.083 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.083 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.083 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:22337 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 13582336~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:40:35.084 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.951039+0000", 2024-09-13T06:40:35.084 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 42.061050721000001, 2024-09-13T06:40:35.084 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.048942765999999999, 2024-09-13T06:40:35.084 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:35.084 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:35.084 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:35.084 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:35.084 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:35.084 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 22337 2024-09-13T06:40:35.084 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.084 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:35.084 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.084 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:35.085 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951039+0000", 2024-09-13T06:40:35.085 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:35.085 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.085 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.085 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:35.085 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951039+0000", 2024-09-13T06:40:35.085 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:35.085 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.085 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.085 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:35.085 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951038+0000", 2024-09-13T06:40:35.085 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:35.085 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.085 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.086 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:35.086 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951040+0000", 2024-09-13T06:40:35.086 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0669999999999999e-06 2024-09-13T06:40:35.086 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.086 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.086 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:35.086 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951048+0000", 2024-09-13T06:40:35.086 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.588e-06 2024-09-13T06:40:35.086 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.086 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.086 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:35.086 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951053+0000", 2024-09-13T06:40:35.086 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3669999999999996e-06 2024-09-13T06:40:35.086 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.087 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.087 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:35.087 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.999889+0000", 2024-09-13T06:40:35.087 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.048835515000000003 2024-09-13T06:40:35.087 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.087 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.087 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:35.087 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.999929+0000", 2024-09-13T06:40:35.087 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.0030000000000001e-05 2024-09-13T06:40:35.087 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.087 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.087 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:35.087 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.999981+0000", 2024-09-13T06:40:35.088 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2583999999999997e-05 2024-09-13T06:40:35.088 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:35.088 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:35.088 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:35.088 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.088 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.088 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:22338 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 13611008~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:40:35.088 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.951070+0000", 2024-09-13T06:40:35.088 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 42.061019430000002, 2024-09-13T06:40:35.088 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049135817999999998, 2024-09-13T06:40:35.088 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:35.088 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:35.088 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:35.089 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:35.089 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:35.089 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 22338 2024-09-13T06:40:35.089 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.089 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:35.089 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.090 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:35.090 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951070+0000", 2024-09-13T06:40:35.090 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:35.090 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.090 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.090 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:35.090 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951070+0000", 2024-09-13T06:40:35.090 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:35.090 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.090 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.090 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:35.090 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951069+0000", 2024-09-13T06:40:35.090 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:35.091 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.091 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.091 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:35.091 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951072+0000", 2024-09-13T06:40:35.091 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5909999999999998e-06 2024-09-13T06:40:35.091 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.091 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.091 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:35.091 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951078+0000", 2024-09-13T06:40:35.091 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.4450000000000001e-06 2024-09-13T06:40:35.091 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.091 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.091 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:35.091 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951083+0000", 2024-09-13T06:40:35.092 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7790000000000003e-06 2024-09-13T06:40:35.092 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.092 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.092 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:35.092 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:53.000020+0000", 2024-09-13T06:40:35.092 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.048936999000000002 2024-09-13T06:40:35.092 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.092 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.092 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:35.092 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:53.000106+0000", 2024-09-13T06:40:35.092 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.5532999999999996e-05 2024-09-13T06:40:35.092 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.092 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.093 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:35.093 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:53.000206+0000", 2024-09-13T06:40:35.093 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.9852999999999994e-05 2024-09-13T06:40:35.093 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:35.093 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:35.093 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:35.093 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.093 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.093 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:22339 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 13639680~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:40:35.093 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.951088+0000", 2024-09-13T06:40:35.093 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 42.061001732000001, 2024-09-13T06:40:35.093 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049238202000000002, 2024-09-13T06:40:35.093 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:35.093 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:35.094 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:35.094 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:35.094 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:35.094 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 22339 2024-09-13T06:40:35.094 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.094 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:35.094 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.094 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:35.094 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951088+0000", 2024-09-13T06:40:35.094 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:35.094 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.094 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.094 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:35.094 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951088+0000", 2024-09-13T06:40:35.095 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:35.095 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.095 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.095 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:35.095 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951087+0000", 2024-09-13T06:40:35.095 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:35.095 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.095 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.095 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:35.095 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951089+0000", 2024-09-13T06:40:35.095 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.153e-06 2024-09-13T06:40:35.095 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.095 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.095 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:35.095 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951093+0000", 2024-09-13T06:40:35.096 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.7120000000000002e-06 2024-09-13T06:40:35.096 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.096 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.096 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:35.096 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951096+0000", 2024-09-13T06:40:35.096 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.0570000000000001e-06 2024-09-13T06:40:35.096 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.096 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.096 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:35.096 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:53.000220+0000", 2024-09-13T06:40:35.096 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049123989 2024-09-13T06:40:35.096 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.096 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.097 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:35.097 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:53.000271+0000", 2024-09-13T06:40:35.097 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.062e-05 2024-09-13T06:40:35.097 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.097 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.097 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:35.097 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:53.000326+0000", 2024-09-13T06:40:35.097 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.5121000000000003e-05 2024-09-13T06:40:35.097 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:35.097 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:35.097 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:35.097 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.097 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.098 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:22340 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 13668352~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:40:35.098 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.951200+0000", 2024-09-13T06:40:35.098 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 42.060888843000001, 2024-09-13T06:40:35.098 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049352350000000003, 2024-09-13T06:40:35.098 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:35.098 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:35.098 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:35.098 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:35.098 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:35.098 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 22340 2024-09-13T06:40:35.098 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.098 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:35.098 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.098 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:35.098 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951200+0000", 2024-09-13T06:40:35.099 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:35.099 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.099 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.099 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:35.099 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951200+0000", 2024-09-13T06:40:35.099 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:35.099 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.099 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.099 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:35.099 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951098+0000", 2024-09-13T06:40:35.099 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.999898 2024-09-13T06:40:35.099 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.099 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.099 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:35.100 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951204+0000", 2024-09-13T06:40:35.100 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000105398 2024-09-13T06:40:35.100 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.100 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.100 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:35.100 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951211+0000", 2024-09-13T06:40:35.100 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.43e-06 2024-09-13T06:40:35.100 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.100 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.100 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:35.100 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951216+0000", 2024-09-13T06:40:35.100 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2800000000000003e-06 2024-09-13T06:40:35.100 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.100 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.101 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:35.101 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:53.000358+0000", 2024-09-13T06:40:35.101 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049142036 2024-09-13T06:40:35.101 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.101 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.101 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:35.101 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:53.000443+0000", 2024-09-13T06:40:35.101 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.4710999999999996e-05 2024-09-13T06:40:35.101 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.101 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.101 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:35.101 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:53.000553+0000", 2024-09-13T06:40:35.101 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000109622 2024-09-13T06:40:35.102 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:35.102 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:35.102 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:35.102 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.102 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.102 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:22348 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 13897728~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:40:35.102 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.952783+0000", 2024-09-13T06:40:35.102 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 42.059306055, 2024-09-13T06:40:35.102 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049120832000000003, 2024-09-13T06:40:35.102 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:35.102 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:35.102 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:35.102 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:35.102 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:35.102 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 22348 2024-09-13T06:40:35.103 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.103 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:35.103 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.103 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:35.103 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.952783+0000", 2024-09-13T06:40:35.103 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:35.103 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.103 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.103 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:35.103 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.952783+0000", 2024-09-13T06:40:35.103 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:35.103 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.103 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.103 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:35.104 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.952783+0000", 2024-09-13T06:40:35.104 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:35.104 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.104 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.104 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:35.104 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.952785+0000", 2024-09-13T06:40:35.104 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4980000000000001e-06 2024-09-13T06:40:35.104 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.104 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.104 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:35.104 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.952799+0000", 2024-09-13T06:40:35.104 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3825000000000001e-05 2024-09-13T06:40:35.104 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.104 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.105 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:35.105 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.952809+0000", 2024-09-13T06:40:35.105 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0043e-05 2024-09-13T06:40:35.105 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.105 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.105 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:35.105 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:53.001723+0000", 2024-09-13T06:40:35.105 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.048914065 2024-09-13T06:40:35.105 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.105 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.105 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:35.105 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:53.001807+0000", 2024-09-13T06:40:35.105 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.3776000000000006e-05 2024-09-13T06:40:35.105 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.106 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.106 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:35.106 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:53.001904+0000", 2024-09-13T06:40:35.106 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.7004999999999997e-05 2024-09-13T06:40:35.106 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:35.106 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:35.106 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:35.106 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:35.106 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:35.106 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:40:35.108 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-13T06:40:35.108 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:40:35.106+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:40:35.209 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:40:35.206+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:40:35.267 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:40:35.268 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-13T06:40:35.268 INFO:teuthology.orchestra.run.smithi081.stdout: "num_ops": 0 2024-09-13T06:40:35.268 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:40:35.281 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-13T06:40:35.329 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:40:35.332+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:40:35.398 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:40:35.399 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-13T06:40:35.399 INFO:teuthology.orchestra.run.smithi081.stdout: "complaint_time": 30, 2024-09-13T06:40:35.399 INFO:teuthology.orchestra.run.smithi081.stdout: "num_blocked_ops": 0 2024-09-13T06:40:35.399 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:40:35.410 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:40:35.412+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:40:35.412 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-13T06:40:35.511 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:40:35.510+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:40:35.574 INFO:teuthology.orchestra.run.smithi081.stderr:set osd.0 primary-affinity to 0.48539 (8318102) 2024-09-13T06:40:35.574 INFO:teuthology.orchestra.run.smithi081.stderr:nodeep-scrub is unset 2024-09-13T06:40:35.585 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:40:35.585 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 20, 2024-09-13T06:40:35.585 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 600, 2024-09-13T06:40:35.585 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [ 2024-09-13T06:40:35.585 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.585 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:36160 3.f 3:f62782c2:::rbd_object_map.11219660270d.0000000000000016:head [call] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-13T06:40:35.585 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:01.607291+0000", 2024-09-13T06:40:35.586 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 33.979065421999998, 2024-09-13T06:40:35.586 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.99619456699999998, 2024-09-13T06:40:35.586 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:35.586 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:35.586 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:35.586 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:35.586 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:35.586 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 36160 2024-09-13T06:40:35.586 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.586 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:35.586 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.586 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:35.587 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:01.607291+0000", 2024-09-13T06:40:35.587 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:35.587 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.587 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.587 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:35.587 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:01.607291+0000", 2024-09-13T06:40:35.587 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:35.587 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.587 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.587 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:35.587 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:01.607289+0000", 2024-09-13T06:40:35.587 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999976 2024-09-13T06:40:35.587 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.587 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.588 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:35.588 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:01.607302+0000", 2024-09-13T06:40:35.588 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3018e-05 2024-09-13T06:40:35.588 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.588 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.588 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:35.588 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:01.607323+0000", 2024-09-13T06:40:35.588 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1030999999999999e-05 2024-09-13T06:40:35.588 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.588 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.588 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:35.588 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:01.607342+0000", 2024-09-13T06:40:35.588 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8961e-05 2024-09-13T06:40:35.589 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.589 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.589 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:35.589 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:01.607425+0000", 2024-09-13T06:40:35.589 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.3171999999999996e-05 2024-09-13T06:40:35.589 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.589 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.589 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:40:35.589 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:01.607441+0000", 2024-09-13T06:40:35.589 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5996999999999999e-05 2024-09-13T06:40:35.589 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.589 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.589 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:35.590 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:02.596186+0000", 2024-09-13T06:40:35.590 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.98874432000000001 2024-09-13T06:40:35.590 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.590 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.590 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for missing object", 2024-09-13T06:40:35.590 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:02.596618+0000", 2024-09-13T06:40:35.590 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000432032 2024-09-13T06:40:35.590 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.590 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.590 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:35.590 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:02.600845+0000", 2024-09-13T06:40:35.590 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0042277410000000001 2024-09-13T06:40:35.590 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.590 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.591 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:35.591 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:02.601003+0000", 2024-09-13T06:40:35.591 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00015731999999999999 2024-09-13T06:40:35.591 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.591 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.591 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:35.591 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:02.603486+0000", 2024-09-13T06:40:35.591 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0024832510000000001 2024-09-13T06:40:35.591 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:35.592 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:35.592 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:35.592 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.592 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.592 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:37806 3.9 3:951cb95b:::rbd_data.1121d8143c6e.0000000000000002:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e56)", 2024-09-13T06:40:35.592 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:06.373482+0000", 2024-09-13T06:40:35.592 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 29.212874385999999, 2024-09-13T06:40:35.592 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.002476213, 2024-09-13T06:40:35.592 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:35.592 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:35.592 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:35.592 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:35.592 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:35.593 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 37806 2024-09-13T06:40:35.593 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.593 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:35.593 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.593 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:35.593 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.373482+0000", 2024-09-13T06:40:35.593 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:35.593 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.593 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.593 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:35.593 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.373482+0000", 2024-09-13T06:40:35.593 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:35.593 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.593 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.594 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:35.594 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.373479+0000", 2024-09-13T06:40:35.594 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999962 2024-09-13T06:40:35.594 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.594 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.594 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:35.594 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.373495+0000", 2024-09-13T06:40:35.594 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6640999999999999e-05 2024-09-13T06:40:35.594 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.594 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.594 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:35.594 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.373542+0000", 2024-09-13T06:40:35.594 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6229000000000001e-05 2024-09-13T06:40:35.595 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.595 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.595 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:35.595 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.373564+0000", 2024-09-13T06:40:35.595 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2684000000000002e-05 2024-09-13T06:40:35.595 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.595 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.595 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:35.595 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374268+0000", 2024-09-13T06:40:35.595 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00070363700000000001 2024-09-13T06:40:35.595 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.595 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.595 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:40:35.595 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374305+0000", 2024-09-13T06:40:35.595 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.6936e-05 2024-09-13T06:40:35.596 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.596 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.596 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:35.596 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.375175+0000", 2024-09-13T06:40:35.596 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.000870454 2024-09-13T06:40:35.596 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.596 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.596 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:35.596 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.375678+0000", 2024-09-13T06:40:35.596 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00050292499999999999 2024-09-13T06:40:35.596 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.596 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.596 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:35.597 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.375959+0000", 2024-09-13T06:40:35.597 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00028050599999999997 2024-09-13T06:40:35.597 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:35.597 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:35.597 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:35.597 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.597 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.597 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:37821 3.9 3:951cb95b:::rbd_data.1121d8143c6e.0000000000000002:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e56)", 2024-09-13T06:40:35.597 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:06.374454+0000", 2024-09-13T06:40:35.597 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 29.211903269, 2024-09-13T06:40:35.597 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.002545072, 2024-09-13T06:40:35.597 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:35.598 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:35.598 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:35.598 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:35.598 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:35.598 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 37821 2024-09-13T06:40:35.598 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.598 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:35.598 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.598 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:35.598 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374454+0000", 2024-09-13T06:40:35.598 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:35.598 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.598 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.599 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:35.599 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374454+0000", 2024-09-13T06:40:35.599 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:35.599 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.599 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.599 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:35.599 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374452+0000", 2024-09-13T06:40:35.599 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999981 2024-09-13T06:40:35.599 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.599 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.599 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:35.599 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374463+0000", 2024-09-13T06:40:35.599 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0756e-05 2024-09-13T06:40:35.599 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.600 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.600 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:35.601 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374487+0000", 2024-09-13T06:40:35.601 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4887000000000001e-05 2024-09-13T06:40:35.601 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.601 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.601 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:35.601 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374504+0000", 2024-09-13T06:40:35.601 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6852000000000001e-05 2024-09-13T06:40:35.601 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.601 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.601 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:35.601 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374829+0000", 2024-09-13T06:40:35.602 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000324684 2024-09-13T06:40:35.602 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.602 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.602 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:40:35.602 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374880+0000", 2024-09-13T06:40:35.602 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.1378000000000002e-05 2024-09-13T06:40:35.602 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.602 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.602 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:35.602 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.376423+0000", 2024-09-13T06:40:35.602 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.001542734 2024-09-13T06:40:35.602 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.602 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.603 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:35.603 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.376607+0000", 2024-09-13T06:40:35.603 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000183656 2024-09-13T06:40:35.603 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.603 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.603 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:35.603 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.376999+0000", 2024-09-13T06:40:35.603 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00039191200000000001 2024-09-13T06:40:35.603 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:35.603 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:35.603 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:35.603 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.603 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.603 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:37836 3.9 3:951cb95b:::rbd_data.1121d8143c6e.0000000000000002:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e56)", 2024-09-13T06:40:35.604 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:06.374929+0000", 2024-09-13T06:40:35.604 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 29.211427616999998, 2024-09-13T06:40:35.604 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.002778825, 2024-09-13T06:40:35.604 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:35.604 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:35.604 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:35.604 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:35.604 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:35.604 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 37836 2024-09-13T06:40:35.604 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.604 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:35.604 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.604 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:35.605 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374929+0000", 2024-09-13T06:40:35.605 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:35.605 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.605 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.605 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:35.605 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374929+0000", 2024-09-13T06:40:35.605 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:35.605 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.605 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.605 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:35.605 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374927+0000", 2024-09-13T06:40:35.605 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999981 2024-09-13T06:40:35.605 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.605 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.606 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:35.606 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374939+0000", 2024-09-13T06:40:35.606 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1846e-05 2024-09-13T06:40:35.606 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.606 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.606 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:35.606 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374962+0000", 2024-09-13T06:40:35.606 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3054e-05 2024-09-13T06:40:35.606 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.606 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.606 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:35.606 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374978+0000", 2024-09-13T06:40:35.606 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5899000000000001e-05 2024-09-13T06:40:35.607 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.607 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.607 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:35.607 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.375106+0000", 2024-09-13T06:40:35.607 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00012789 2024-09-13T06:40:35.607 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.607 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.607 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:40:35.607 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.375134+0000", 2024-09-13T06:40:35.607 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.8254000000000001e-05 2024-09-13T06:40:35.607 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.607 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.607 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:35.608 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.377082+0000", 2024-09-13T06:40:35.608 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0019471520000001 2024-09-13T06:40:35.608 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.608 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.608 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:35.608 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.377330+0000", 2024-09-13T06:40:35.608 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00024834199999999997 2024-09-13T06:40:35.608 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.608 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.608 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:35.608 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.377708+0000", 2024-09-13T06:40:35.608 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00037817100000000001 2024-09-13T06:40:35.608 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:35.608 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:35.609 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:35.609 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.609 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.609 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:37851 3.9 3:951cb95b:::rbd_data.1121d8143c6e.0000000000000002:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e56)", 2024-09-13T06:40:35.609 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:06.382636+0000", 2024-09-13T06:40:35.609 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 29.203720732000001, 2024-09-13T06:40:35.609 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.99582539400000003, 2024-09-13T06:40:35.609 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:35.609 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:35.609 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:35.609 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:35.609 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:35.609 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 37851 2024-09-13T06:40:35.609 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.610 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:35.610 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.610 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:35.610 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.382636+0000", 2024-09-13T06:40:35.610 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:35.610 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.610 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.610 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:35.610 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.382636+0000", 2024-09-13T06:40:35.610 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:35.610 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.610 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.610 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:35.610 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.382633+0000", 2024-09-13T06:40:35.611 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999971 2024-09-13T06:40:35.611 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.611 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.611 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:35.611 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.382652+0000", 2024-09-13T06:40:35.611 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8834999999999998e-05 2024-09-13T06:40:35.611 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.611 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.611 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:35.611 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.382695+0000", 2024-09-13T06:40:35.611 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.3136000000000002e-05 2024-09-13T06:40:35.611 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.611 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.612 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:35.612 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.382716+0000", 2024-09-13T06:40:35.612 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1421e-05 2024-09-13T06:40:35.612 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.612 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.612 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:35.612 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.382860+0000", 2024-09-13T06:40:35.612 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00014389200000000001 2024-09-13T06:40:35.612 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.612 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.613 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:40:35.613 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.382890+0000", 2024-09-13T06:40:35.613 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9827000000000001e-05 2024-09-13T06:40:35.613 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.613 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.613 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:35.613 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.377779+0000", 2024-09-13T06:40:35.613 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.99488842899999996 2024-09-13T06:40:35.613 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.613 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.613 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:35.613 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.378007+0000", 2024-09-13T06:40:35.613 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00022838099999999999 2024-09-13T06:40:35.613 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.614 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.614 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:35.614 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.378462+0000", 2024-09-13T06:40:35.614 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00045452300000000003 2024-09-13T06:40:35.614 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:35.614 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:35.614 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:35.614 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.614 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.614 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:37866 3.9 3:951cb95b:::rbd_data.1121d8143c6e.0000000000000002:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e56)", 2024-09-13T06:40:35.614 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:06.383951+0000", 2024-09-13T06:40:35.614 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 29.202406046, 2024-09-13T06:40:35.614 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.99517962299999996, 2024-09-13T06:40:35.615 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:35.615 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:35.615 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:35.615 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:35.615 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:35.615 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 37866 2024-09-13T06:40:35.615 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.615 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:35.615 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.615 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:35.615 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.383951+0000", 2024-09-13T06:40:35.615 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:35.615 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.615 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.616 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:35.616 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.383951+0000", 2024-09-13T06:40:35.616 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:35.616 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.616 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.616 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:35.616 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.383949+0000", 2024-09-13T06:40:35.616 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999981 2024-09-13T06:40:35.616 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.616 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.616 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:35.616 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.383961+0000", 2024-09-13T06:40:35.616 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1999e-05 2024-09-13T06:40:35.617 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.617 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.617 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:35.617 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384019+0000", 2024-09-13T06:40:35.617 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7621000000000003e-05 2024-09-13T06:40:35.617 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.617 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.617 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:35.617 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384040+0000", 2024-09-13T06:40:35.617 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1528000000000001e-05 2024-09-13T06:40:35.617 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.617 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.617 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:35.618 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384186+0000", 2024-09-13T06:40:35.618 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00014573799999999999 2024-09-13T06:40:35.618 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.618 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.618 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:40:35.618 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384204+0000", 2024-09-13T06:40:35.618 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7992e-05 2024-09-13T06:40:35.618 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.618 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.618 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:35.618 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.378536+0000", 2024-09-13T06:40:35.618 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.99433268600000002 2024-09-13T06:40:35.618 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.618 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.619 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:35.619 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.378771+0000", 2024-09-13T06:40:35.619 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00023445399999999999 2024-09-13T06:40:35.619 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.619 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.619 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:35.619 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.379130+0000", 2024-09-13T06:40:35.619 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00035954200000000002 2024-09-13T06:40:35.619 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:35.619 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:35.619 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:35.619 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.619 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.620 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:37881 3.9 3:951cb95b:::rbd_data.1121d8143c6e.0000000000000002:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e56)", 2024-09-13T06:40:35.620 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:06.384239+0000", 2024-09-13T06:40:35.620 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 29.202117632, 2024-09-13T06:40:35.620 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.99541483500000005, 2024-09-13T06:40:35.620 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:35.620 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:35.620 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:35.620 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:35.620 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:35.620 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 37881 2024-09-13T06:40:35.620 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.621 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:35.621 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.621 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:35.621 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384239+0000", 2024-09-13T06:40:35.621 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:35.621 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.621 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.621 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:35.621 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384239+0000", 2024-09-13T06:40:35.621 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:35.622 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.622 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.622 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:35.622 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384238+0000", 2024-09-13T06:40:35.622 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999986 2024-09-13T06:40:35.622 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.622 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.622 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:35.622 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384246+0000", 2024-09-13T06:40:35.622 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.2449999999999998e-06 2024-09-13T06:40:35.622 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.622 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.622 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:35.623 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384268+0000", 2024-09-13T06:40:35.623 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1518e-05 2024-09-13T06:40:35.623 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.623 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.623 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:35.623 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384282+0000", 2024-09-13T06:40:35.623 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4501999999999999e-05 2024-09-13T06:40:35.623 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.623 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.623 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:35.623 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384356+0000", 2024-09-13T06:40:35.623 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4265999999999997e-05 2024-09-13T06:40:35.623 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.624 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.624 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:40:35.624 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384370+0000", 2024-09-13T06:40:35.624 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3942e-05 2024-09-13T06:40:35.624 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.624 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.624 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:35.624 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.379199+0000", 2024-09-13T06:40:35.624 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.99482866599999997 2024-09-13T06:40:35.624 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.624 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.624 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:35.624 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.379347+0000", 2024-09-13T06:40:35.625 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00014749199999999999 2024-09-13T06:40:35.625 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.625 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.625 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:35.625 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.379654+0000", 2024-09-13T06:40:35.625 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00030752999999999998 2024-09-13T06:40:35.625 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:35.625 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:35.625 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:35.625 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.625 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.625 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:37896 3.9 3:951cb95b:::rbd_data.1121d8143c6e.0000000000000002:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e56)", 2024-09-13T06:40:35.625 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:06.384412+0000", 2024-09-13T06:40:35.626 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 29.201945199000001, 2024-09-13T06:40:35.626 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.99777835999999998, 2024-09-13T06:40:35.626 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:35.626 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:35.626 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:35.626 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:35.626 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:35.626 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 37896 2024-09-13T06:40:35.626 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.626 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:35.626 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.626 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:35.626 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384412+0000", 2024-09-13T06:40:35.626 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:35.627 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.627 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.627 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:35.627 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384412+0000", 2024-09-13T06:40:35.627 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:35.627 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.627 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.627 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:35.627 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384410+0000", 2024-09-13T06:40:35.627 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.999999 2024-09-13T06:40:35.627 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.627 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.627 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:35.627 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384418+0000", 2024-09-13T06:40:35.628 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.486e-06 2024-09-13T06:40:35.628 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.628 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.628 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:35.628 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384436+0000", 2024-09-13T06:40:35.628 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7668000000000001e-05 2024-09-13T06:40:35.628 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.628 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.628 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:35.628 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384449+0000", 2024-09-13T06:40:35.628 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3395e-05 2024-09-13T06:40:35.628 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.629 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.629 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:35.629 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384605+0000", 2024-09-13T06:40:35.629 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00015563099999999999 2024-09-13T06:40:35.629 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.629 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.629 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:40:35.629 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384635+0000", 2024-09-13T06:40:35.629 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.0383999999999999e-05 2024-09-13T06:40:35.629 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.629 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.629 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:35.629 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.379730+0000", 2024-09-13T06:40:35.629 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.99509493999999998 2024-09-13T06:40:35.630 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.630 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.630 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:35.630 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.379964+0000", 2024-09-13T06:40:35.630 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00023353499999999999 2024-09-13T06:40:35.630 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.630 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.630 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:35.630 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.382190+0000", 2024-09-13T06:40:35.630 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0022265039999999998 2024-09-13T06:40:35.630 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:35.630 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:35.630 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:35.630 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.631 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.631 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43222 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 389120~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:40:35.631 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558181+0000", 2024-09-13T06:40:35.631 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 14.028175944999999, 2024-09-13T06:40:35.631 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.06252038, 2024-09-13T06:40:35.631 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:35.631 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:35.631 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:35.631 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:35.631 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:35.631 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43222 2024-09-13T06:40:35.631 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.632 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:35.632 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.632 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:35.632 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558181+0000", 2024-09-13T06:40:35.632 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:35.632 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.632 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.632 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:35.632 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558181+0000", 2024-09-13T06:40:35.632 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:35.632 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.632 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.632 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:35.633 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558181+0000", 2024-09-13T06:40:35.633 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:35.633 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.633 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.633 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:35.633 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558183+0000", 2024-09-13T06:40:35.633 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.857e-06 2024-09-13T06:40:35.633 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.633 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.633 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:35.633 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558188+0000", 2024-09-13T06:40:35.633 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3759999999999999e-06 2024-09-13T06:40:35.633 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.633 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.634 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:35.634 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558261+0000", 2024-09-13T06:40:35.634 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3097999999999997e-05 2024-09-13T06:40:35.634 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.634 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.634 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:35.634 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.620354+0000", 2024-09-13T06:40:35.634 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.062092587999999997 2024-09-13T06:40:35.634 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.634 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.634 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:35.635 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.620428+0000", 2024-09-13T06:40:35.635 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3954000000000004e-05 2024-09-13T06:40:35.635 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.635 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.635 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:35.635 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.620701+0000", 2024-09-13T06:40:35.635 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000273773 2024-09-13T06:40:35.635 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:35.635 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:35.635 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:35.635 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.636 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.636 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43223 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 393216~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:40:35.636 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558267+0000", 2024-09-13T06:40:35.636 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 14.028089888, 2024-09-13T06:40:35.636 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.062813151999999997, 2024-09-13T06:40:35.636 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:35.636 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:35.636 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:35.636 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:35.636 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:35.636 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43223 2024-09-13T06:40:35.636 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.636 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:35.637 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.637 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:35.637 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558267+0000", 2024-09-13T06:40:35.637 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:35.637 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.637 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.637 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:35.637 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558267+0000", 2024-09-13T06:40:35.637 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:35.637 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.637 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.637 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:35.637 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558266+0000", 2024-09-13T06:40:35.638 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:35.638 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.638 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.638 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:35.638 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558270+0000", 2024-09-13T06:40:35.638 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.2389999999999998e-06 2024-09-13T06:40:35.638 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.638 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.638 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:35.638 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558277+0000", 2024-09-13T06:40:35.638 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5680000000000002e-06 2024-09-13T06:40:35.638 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.638 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.638 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:35.639 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558282+0000", 2024-09-13T06:40:35.639 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7060000000000003e-06 2024-09-13T06:40:35.639 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.639 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.639 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:35.639 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.620731+0000", 2024-09-13T06:40:35.639 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.062448661000000003 2024-09-13T06:40:35.639 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.639 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.639 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:35.639 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.620806+0000", 2024-09-13T06:40:35.639 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5862e-05 2024-09-13T06:40:35.639 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.640 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.640 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:35.640 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.621080+0000", 2024-09-13T06:40:35.640 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00027368599999999998 2024-09-13T06:40:35.640 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:35.640 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:35.640 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:35.640 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.640 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.640 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43224 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 407552~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:40:35.640 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558286+0000", 2024-09-13T06:40:35.640 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 14.028070524, 2024-09-13T06:40:35.640 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.063179052999999999, 2024-09-13T06:40:35.641 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:35.641 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:35.641 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:35.641 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:35.641 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:35.641 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43224 2024-09-13T06:40:35.641 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.641 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:35.641 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.641 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:35.641 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558286+0000", 2024-09-13T06:40:35.641 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:35.641 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.641 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.642 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:35.642 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558286+0000", 2024-09-13T06:40:35.642 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:35.642 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.642 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.642 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:35.642 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558286+0000", 2024-09-13T06:40:35.642 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:35.642 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.642 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.642 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:35.642 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558288+0000", 2024-09-13T06:40:35.642 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.227e-06 2024-09-13T06:40:35.643 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.643 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.643 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:35.643 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558292+0000", 2024-09-13T06:40:35.643 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.6289999999999999e-06 2024-09-13T06:40:35.643 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.643 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.643 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:35.643 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558294+0000", 2024-09-13T06:40:35.643 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5409999999999999e-06 2024-09-13T06:40:35.643 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.643 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.644 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:35.644 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.621110+0000", 2024-09-13T06:40:35.644 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.062815776000000004 2024-09-13T06:40:35.644 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.644 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.644 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:35.644 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.621186+0000", 2024-09-13T06:40:35.644 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5570999999999999e-05 2024-09-13T06:40:35.644 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.644 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.644 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:35.644 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.621465+0000", 2024-09-13T06:40:35.644 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00027988200000000001 2024-09-13T06:40:35.644 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:35.645 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:35.645 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:35.645 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.645 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.645 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43225 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 421888~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:40:35.645 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558296+0000", 2024-09-13T06:40:35.645 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 14.028060557, 2024-09-13T06:40:35.645 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.063551110999999993, 2024-09-13T06:40:35.645 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:35.645 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:35.646 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:35.646 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:35.646 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:35.646 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43225 2024-09-13T06:40:35.646 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.646 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:35.646 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.646 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:35.646 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558296+0000", 2024-09-13T06:40:35.646 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:35.646 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.646 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.646 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:35.647 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558296+0000", 2024-09-13T06:40:35.647 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:35.647 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.647 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.647 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:35.647 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558296+0000", 2024-09-13T06:40:35.647 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:40:35.647 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.647 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.647 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:35.647 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558305+0000", 2024-09-13T06:40:35.647 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.5290000000000008e-06 2024-09-13T06:40:35.647 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.647 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.648 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:35.648 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558308+0000", 2024-09-13T06:40:35.648 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.5619999999999999e-06 2024-09-13T06:40:35.648 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.648 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.648 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:35.648 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558311+0000", 2024-09-13T06:40:35.648 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.43e-06 2024-09-13T06:40:35.648 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.648 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.648 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:35.648 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.621495+0000", 2024-09-13T06:40:35.648 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.063184289000000005 2024-09-13T06:40:35.649 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.649 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.649 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:35.649 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.621569+0000", 2024-09-13T06:40:35.649 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4250000000000002e-05 2024-09-13T06:40:35.649 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.649 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.649 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:35.649 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.621847+0000", 2024-09-13T06:40:35.649 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00027826400000000002 2024-09-13T06:40:35.649 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:35.649 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:35.649 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:35.649 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.650 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.650 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43226 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 436224~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:40:35.650 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558313+0000", 2024-09-13T06:40:35.650 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 14.028043921, 2024-09-13T06:40:35.650 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.063914420999999999, 2024-09-13T06:40:35.650 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:35.650 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:35.650 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:35.650 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:35.650 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:35.650 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43226 2024-09-13T06:40:35.650 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.650 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:35.651 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.651 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:35.651 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558313+0000", 2024-09-13T06:40:35.651 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:35.651 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.651 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.651 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:35.651 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558313+0000", 2024-09-13T06:40:35.651 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:35.651 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.651 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.651 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:35.651 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558313+0000", 2024-09-13T06:40:35.651 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:35.652 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.652 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.652 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:35.652 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558314+0000", 2024-09-13T06:40:35.652 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3740000000000001e-06 2024-09-13T06:40:35.652 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.652 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.652 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:35.652 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558317+0000", 2024-09-13T06:40:35.652 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9730000000000002e-06 2024-09-13T06:40:35.652 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.653 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.653 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:35.653 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558319+0000", 2024-09-13T06:40:35.653 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4059999999999999e-06 2024-09-13T06:40:35.653 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.653 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.653 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:35.653 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.621877+0000", 2024-09-13T06:40:35.653 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.063557408999999995 2024-09-13T06:40:35.653 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.653 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.653 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:35.653 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.621951+0000", 2024-09-13T06:40:35.654 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4487999999999996e-05 2024-09-13T06:40:35.654 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.654 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.654 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:35.654 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.622227+0000", 2024-09-13T06:40:35.654 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000276011 2024-09-13T06:40:35.654 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:35.654 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:35.654 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:35.654 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.654 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.655 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43227 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 450560~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:40:35.655 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558322+0000", 2024-09-13T06:40:35.655 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 14.028035340000001, 2024-09-13T06:40:35.655 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.064285348000000006, 2024-09-13T06:40:35.655 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:35.655 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:35.655 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:35.655 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:35.655 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:35.655 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43227 2024-09-13T06:40:35.655 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.655 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:35.656 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.656 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:35.656 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558322+0000", 2024-09-13T06:40:35.656 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:35.656 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.656 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.656 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:35.656 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558322+0000", 2024-09-13T06:40:35.656 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:35.656 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.656 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.656 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:35.657 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558321+0000", 2024-09-13T06:40:35.657 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:40:35.657 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.657 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.657 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:35.657 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558323+0000", 2024-09-13T06:40:35.657 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.576e-06 2024-09-13T06:40:35.657 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.657 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.657 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:35.657 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558328+0000", 2024-09-13T06:40:35.657 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0719999999999999e-06 2024-09-13T06:40:35.657 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.657 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.658 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:35.658 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558332+0000", 2024-09-13T06:40:35.658 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.8130000000000002e-06 2024-09-13T06:40:35.658 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.658 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.658 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:35.658 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.622255+0000", 2024-09-13T06:40:35.658 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.063923195000000002 2024-09-13T06:40:35.658 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.658 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.658 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:35.658 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.622330+0000", 2024-09-13T06:40:35.658 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5383000000000007e-05 2024-09-13T06:40:35.659 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.659 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.659 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:35.659 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.622607+0000", 2024-09-13T06:40:35.659 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00027651999999999999 2024-09-13T06:40:35.659 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:35.659 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:35.659 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:35.659 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.659 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.659 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43228 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 464896~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:40:35.659 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558335+0000", 2024-09-13T06:40:35.659 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 14.028021431000001, 2024-09-13T06:40:35.659 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.064652253000000007, 2024-09-13T06:40:35.660 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:35.660 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:35.660 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:35.660 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:35.660 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:35.660 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43228 2024-09-13T06:40:35.660 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.660 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:35.660 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.660 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:35.660 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558335+0000", 2024-09-13T06:40:35.660 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:35.660 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.661 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.661 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:35.661 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558335+0000", 2024-09-13T06:40:35.661 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:35.661 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.661 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.661 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:35.661 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558335+0000", 2024-09-13T06:40:35.661 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:35.661 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.661 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.661 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:35.661 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558337+0000", 2024-09-13T06:40:35.661 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1380000000000001e-06 2024-09-13T06:40:35.662 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.662 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.662 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:35.662 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558343+0000", 2024-09-13T06:40:35.662 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.5140000000000001e-06 2024-09-13T06:40:35.662 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.662 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.662 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:35.662 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558348+0000", 2024-09-13T06:40:35.662 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9640000000000002e-06 2024-09-13T06:40:35.662 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.662 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.662 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:35.662 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.622636+0000", 2024-09-13T06:40:35.663 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.064288260999999999 2024-09-13T06:40:35.663 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.663 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.663 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:35.663 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.622715+0000", 2024-09-13T06:40:35.663 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.9351000000000006e-05 2024-09-13T06:40:35.663 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.663 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.663 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:35.663 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.622988+0000", 2024-09-13T06:40:35.663 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00027242599999999998 2024-09-13T06:40:35.663 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:35.663 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:35.663 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:35.664 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.664 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.664 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43229 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 479232~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:40:35.664 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558352+0000", 2024-09-13T06:40:35.664 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 14.028005016, 2024-09-13T06:40:35.664 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.065018024999999993, 2024-09-13T06:40:35.664 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:35.664 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:35.664 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:35.664 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:35.664 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:35.664 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43229 2024-09-13T06:40:35.665 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.665 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:35.665 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.665 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:35.665 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558352+0000", 2024-09-13T06:40:35.665 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:35.665 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.665 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.665 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:35.665 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558352+0000", 2024-09-13T06:40:35.665 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:35.666 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.666 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.666 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:35.666 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558352+0000", 2024-09-13T06:40:35.666 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:35.666 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.666 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.666 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:35.666 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558354+0000", 2024-09-13T06:40:35.666 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4930000000000001e-06 2024-09-13T06:40:35.666 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.666 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.666 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:35.667 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558360+0000", 2024-09-13T06:40:35.667 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.263e-06 2024-09-13T06:40:35.667 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.667 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.667 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:35.667 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558369+0000", 2024-09-13T06:40:35.667 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.0829999999999993e-06 2024-09-13T06:40:35.667 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.667 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.667 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:35.667 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.623017+0000", 2024-09-13T06:40:35.667 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.064647799000000006 2024-09-13T06:40:35.668 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.668 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.668 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:35.668 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.623090+0000", 2024-09-13T06:40:35.668 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3071000000000006e-05 2024-09-13T06:40:35.668 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.668 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.668 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:35.668 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.623370+0000", 2024-09-13T06:40:35.668 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000279661 2024-09-13T06:40:35.668 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:35.668 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:35.669 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:35.669 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.669 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.669 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43230 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 493568~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:40:35.669 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558374+0000", 2024-09-13T06:40:35.669 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 14.027982722999999, 2024-09-13T06:40:35.669 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.065410435000000003, 2024-09-13T06:40:35.669 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:35.669 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:35.669 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:35.669 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:35.670 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:35.670 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43230 2024-09-13T06:40:35.670 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.670 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:35.670 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.670 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:35.670 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558374+0000", 2024-09-13T06:40:35.670 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:35.670 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.670 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.670 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:35.670 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558374+0000", 2024-09-13T06:40:35.670 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:35.671 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.671 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.671 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:35.671 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558374+0000", 2024-09-13T06:40:35.671 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:35.671 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.671 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.671 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:35.671 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558376+0000", 2024-09-13T06:40:35.671 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4430000000000002e-06 2024-09-13T06:40:35.671 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.672 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.672 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:35.672 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558382+0000", 2024-09-13T06:40:35.672 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3029999999999996e-06 2024-09-13T06:40:35.672 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.672 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.672 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:35.672 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558387+0000", 2024-09-13T06:40:35.672 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.1699999999999999e-06 2024-09-13T06:40:35.672 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.672 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.672 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:35.672 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.623400+0000", 2024-09-13T06:40:35.672 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.065013244999999997 2024-09-13T06:40:35.673 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.673 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.673 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:35.673 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.623474+0000", 2024-09-13T06:40:35.673 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3889999999999999e-05 2024-09-13T06:40:35.673 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.673 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.673 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:35.673 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.623785+0000", 2024-09-13T06:40:35.673 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00031080099999999998 2024-09-13T06:40:35.673 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:35.673 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:35.674 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:35.674 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.674 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.674 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43231 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 507904~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:40:35.674 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558391+0000", 2024-09-13T06:40:35.674 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 14.027966038000001, 2024-09-13T06:40:35.674 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.065788597000000004, 2024-09-13T06:40:35.674 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:35.674 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:35.674 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:35.674 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:35.674 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:35.674 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43231 2024-09-13T06:40:35.674 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.675 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:35.675 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.675 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:35.675 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558391+0000", 2024-09-13T06:40:35.675 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:35.675 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.675 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.675 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:35.675 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558391+0000", 2024-09-13T06:40:35.675 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:35.675 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.675 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.675 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:35.676 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558390+0000", 2024-09-13T06:40:35.676 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:35.676 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.676 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.676 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:35.676 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558393+0000", 2024-09-13T06:40:35.676 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2570000000000002e-06 2024-09-13T06:40:35.676 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.676 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.676 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:35.676 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558399+0000", 2024-09-13T06:40:35.676 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0419999999999999e-06 2024-09-13T06:40:35.677 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.677 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.677 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:35.677 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558403+0000", 2024-09-13T06:40:35.677 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6249999999999998e-06 2024-09-13T06:40:35.677 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.677 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.677 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:35.677 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.623811+0000", 2024-09-13T06:40:35.677 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.065407549999999995 2024-09-13T06:40:35.677 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.677 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.677 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:35.678 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.623877+0000", 2024-09-13T06:40:35.678 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.5902999999999996e-05 2024-09-13T06:40:35.678 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.678 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.678 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:35.678 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.624179+0000", 2024-09-13T06:40:35.678 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00030259999999999998 2024-09-13T06:40:35.678 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:35.678 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:35.678 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:35.678 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.678 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.678 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43232 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 522240~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:40:35.678 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558422+0000", 2024-09-13T06:40:35.679 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 14.027935261, 2024-09-13T06:40:35.679 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.066176061999999994, 2024-09-13T06:40:35.679 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:35.679 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:35.679 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:35.679 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:35.679 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:35.679 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43232 2024-09-13T06:40:35.679 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.679 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:35.679 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.679 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:35.679 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558422+0000", 2024-09-13T06:40:35.680 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:35.680 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.680 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.680 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:35.680 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558422+0000", 2024-09-13T06:40:35.680 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:35.680 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.680 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.680 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:35.680 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558421+0000", 2024-09-13T06:40:35.680 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:35.681 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.681 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.681 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:35.681 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558428+0000", 2024-09-13T06:40:35.681 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.1690000000000003e-06 2024-09-13T06:40:35.681 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.681 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.681 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:35.681 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558434+0000", 2024-09-13T06:40:35.681 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9309999999999996e-06 2024-09-13T06:40:35.681 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.681 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.681 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:35.682 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558447+0000", 2024-09-13T06:40:35.682 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.271e-05 2024-09-13T06:40:35.682 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.682 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.682 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:35.682 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.624209+0000", 2024-09-13T06:40:35.682 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.065762102000000003 2024-09-13T06:40:35.682 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.682 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.682 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:35.682 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.624282+0000", 2024-09-13T06:40:35.682 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.2889e-05 2024-09-13T06:40:35.682 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.682 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.683 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:35.683 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.624598+0000", 2024-09-13T06:40:35.683 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00031591399999999998 2024-09-13T06:40:35.683 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:35.683 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:35.683 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:35.683 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.683 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.683 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43486 3.f 3:f7da9c8f:::rbd_data.1121f5f2e1c0.000000000000000b:1f [read 260096~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:40:35.683 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.569088+0000", 2024-09-13T06:40:35.683 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 14.017268538, 2024-09-13T06:40:35.683 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.062579223000000003, 2024-09-13T06:40:35.683 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:35.684 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:35.684 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:35.684 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:35.684 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:35.684 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43486 2024-09-13T06:40:35.684 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.684 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:35.684 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.684 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:35.684 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.569088+0000", 2024-09-13T06:40:35.684 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:35.685 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.685 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.685 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:35.685 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.569088+0000", 2024-09-13T06:40:35.685 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:35.685 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.685 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.685 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:35.685 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.569088+0000", 2024-09-13T06:40:35.685 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:35.685 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.685 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.686 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:35.686 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.569091+0000", 2024-09-13T06:40:35.686 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9629999999999998e-06 2024-09-13T06:40:35.686 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.686 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.686 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:35.686 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.569097+0000", 2024-09-13T06:40:35.686 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.4160000000000001e-06 2024-09-13T06:40:35.686 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.686 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.686 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:35.686 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.569102+0000", 2024-09-13T06:40:35.686 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6659999999999999e-06 2024-09-13T06:40:35.686 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.687 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.687 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:35.687 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.631346+0000", 2024-09-13T06:40:35.687 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.062243896 2024-09-13T06:40:35.687 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.687 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.687 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:35.687 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.631413+0000", 2024-09-13T06:40:35.687 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.7638000000000005e-05 2024-09-13T06:40:35.687 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.687 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.687 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:35.687 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.631668+0000", 2024-09-13T06:40:35.687 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0002541 2024-09-13T06:40:35.688 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:35.688 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:35.688 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:35.688 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:35.688 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:35.688 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:40:35.691 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-13T06:40:35.691 INFO:tasks.ceph.osd.6.smithi139.stderr:2024-09-13T06:40:35.686+0000 7fcd02c5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26385) UID: 0 2024-09-13T06:40:35.762 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-13T06:40:35.809 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:40:35.812+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:40:35.811 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:40:35.812 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [ 2024-09-13T06:40:35.812 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.812 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:48066 3.1 3.f537d461 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e82)", 2024-09-13T06:40:35.812 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:35.637973+0000", 2024-09-13T06:40:35.812 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.177096475, 2024-09-13T06:40:35.812 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.17712561099999999, 2024-09-13T06:40:35.812 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:35.812 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "waiting for peered", 2024-09-13T06:40:35.812 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:35.812 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:35.812 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:35.813 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 48066 2024-09-13T06:40:35.813 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.813 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:35.813 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.813 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:35.813 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:35.637973+0000", 2024-09-13T06:40:35.813 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:35.813 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.813 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.813 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:35.813 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:35.637973+0000", 2024-09-13T06:40:35.813 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:35.813 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.814 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.814 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:35.814 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:35.637972+0000", 2024-09-13T06:40:35.814 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.999999 2024-09-13T06:40:35.814 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.814 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.814 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:35.814 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:35.637977+0000", 2024-09-13T06:40:35.814 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9679999999999997e-06 2024-09-13T06:40:35.814 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.814 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.814 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:35.814 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:35.637989+0000", 2024-09-13T06:40:35.815 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1440999999999999e-05 2024-09-13T06:40:35.815 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.815 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.815 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:35.815 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:35.637995+0000", 2024-09-13T06:40:35.815 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0850000000000002e-06 2024-09-13T06:40:35.815 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.815 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.815 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:35.815 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:35.638055+0000", 2024-09-13T06:40:35.815 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9996e-05 2024-09-13T06:40:35.815 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.815 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.816 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:40:35.816 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:35.638066+0000", 2024-09-13T06:40:35.816 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0953e-05 2024-09-13T06:40:35.816 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:35.816 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:35.816 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:35.816 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.816 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.817 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:48075 3.1 3.f537d461 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e82)", 2024-09-13T06:40:35.817 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:35.640750+0000", 2024-09-13T06:40:35.817 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.174319417, 2024-09-13T06:40:35.817 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.174408593, 2024-09-13T06:40:35.817 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:35.817 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "waiting for peered", 2024-09-13T06:40:35.817 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:35.817 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:35.817 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:35.817 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 48075 2024-09-13T06:40:35.817 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.817 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:35.818 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.818 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:35.818 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:35.640750+0000", 2024-09-13T06:40:35.818 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:35.818 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.818 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.818 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:35.818 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:35.640750+0000", 2024-09-13T06:40:35.819 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:35.819 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.819 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.819 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:35.819 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:35.640749+0000", 2024-09-13T06:40:35.819 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.999999 2024-09-13T06:40:35.819 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.819 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.819 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:35.819 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:35.640754+0000", 2024-09-13T06:40:35.819 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6419999999999998e-06 2024-09-13T06:40:35.819 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.820 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.820 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:35.820 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:35.640766+0000", 2024-09-13T06:40:35.820 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1792e-05 2024-09-13T06:40:35.820 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.820 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.820 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:35.820 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:35.640772+0000", 2024-09-13T06:40:35.820 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3899999999999998e-06 2024-09-13T06:40:35.820 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.820 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.820 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:35.820 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:35.640815+0000", 2024-09-13T06:40:35.821 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.2449e-05 2024-09-13T06:40:35.821 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.821 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.821 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:40:35.821 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:35.640827+0000", 2024-09-13T06:40:35.821 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2143999999999999e-05 2024-09-13T06:40:35.821 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:35.821 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:35.821 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:35.821 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.821 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.821 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:48082 3.1 3.f537d461 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e82)", 2024-09-13T06:40:35.821 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:35.642111+0000", 2024-09-13T06:40:35.822 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.17295849599999999, 2024-09-13T06:40:35.822 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.173097428, 2024-09-13T06:40:35.822 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:35.822 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "waiting for peered", 2024-09-13T06:40:35.822 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:35.822 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:35.822 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:35.822 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 48082 2024-09-13T06:40:35.822 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.822 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:35.822 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.822 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:35.822 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:35.642111+0000", 2024-09-13T06:40:35.823 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:35.823 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.823 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.823 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:35.823 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:35.642111+0000", 2024-09-13T06:40:35.823 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:35.823 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.823 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.823 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:35.823 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:35.642110+0000", 2024-09-13T06:40:35.823 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.999999 2024-09-13T06:40:35.823 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.823 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.823 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:35.824 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:35.642115+0000", 2024-09-13T06:40:35.824 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5870000000000003e-06 2024-09-13T06:40:35.824 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.824 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.824 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:35.824 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:35.642126+0000", 2024-09-13T06:40:35.824 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1287999999999999e-05 2024-09-13T06:40:35.824 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.824 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.824 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:35.824 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:35.642133+0000", 2024-09-13T06:40:35.824 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.6789999999999999e-06 2024-09-13T06:40:35.825 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.825 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.825 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:35.825 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:35.642181+0000", 2024-09-13T06:40:35.825 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7895999999999997e-05 2024-09-13T06:40:35.825 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.825 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.825 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:40:35.825 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:35.642190+0000", 2024-09-13T06:40:35.825 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.9109999999999999e-06 2024-09-13T06:40:35.825 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:35.825 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:35.826 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:35.826 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.826 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.826 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:48090 3.1 3.f537d461 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e82)", 2024-09-13T06:40:35.826 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:35.642638+0000", 2024-09-13T06:40:35.826 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.172431574, 2024-09-13T06:40:35.826 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.172618248, 2024-09-13T06:40:35.826 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:35.826 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "waiting for peered", 2024-09-13T06:40:35.826 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:35.826 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:35.826 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:35.826 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 48090 2024-09-13T06:40:35.826 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.827 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:35.827 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.827 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:35.827 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:35.642638+0000", 2024-09-13T06:40:35.827 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:35.827 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.827 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.827 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:35.827 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:35.642638+0000", 2024-09-13T06:40:35.827 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:35.827 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.827 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.827 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:35.827 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:35.642637+0000", 2024-09-13T06:40:35.828 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.999999 2024-09-13T06:40:35.828 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.828 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.828 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:35.828 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:35.642643+0000", 2024-09-13T06:40:35.828 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.344e-06 2024-09-13T06:40:35.828 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.828 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.828 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:35.828 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:35.642652+0000", 2024-09-13T06:40:35.828 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.7380000000000006e-06 2024-09-13T06:40:35.828 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.829 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.829 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:35.829 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:35.642657+0000", 2024-09-13T06:40:35.829 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.3719999999999998e-06 2024-09-13T06:40:35.829 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.829 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.829 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:35.829 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:35.642703+0000", 2024-09-13T06:40:35.829 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6391999999999999e-05 2024-09-13T06:40:35.829 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:35.829 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:35.829 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:40:35.829 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:35.642713+0000", 2024-09-13T06:40:35.830 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.5000000000000005e-06 2024-09-13T06:40:35.830 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:35.830 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:35.830 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:35.830 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:35.830 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-13T06:40:35.830 INFO:teuthology.orchestra.run.smithi081.stdout: "num_ops": 4 2024-09-13T06:40:35.830 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:40:35.831 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-13T06:40:35.905 INFO:teuthology.orchestra.run.smithi081.stdout:osd.0: {} 2024-09-13T06:40:35.905 INFO:teuthology.orchestra.run.smithi081.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-13T06:40:35.905 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:40:35.908+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:40:35.921 INFO:teuthology.orchestra.run.smithi081.stdout:osd.1: {} 2024-09-13T06:40:35.921 INFO:teuthology.orchestra.run.smithi081.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-13T06:40:35.937 INFO:teuthology.orchestra.run.smithi081.stdout:osd.2: {} 2024-09-13T06:40:35.938 INFO:teuthology.orchestra.run.smithi081.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-13T06:40:35.953 INFO:teuthology.orchestra.run.smithi081.stdout:osd.3: {} 2024-09-13T06:40:35.954 INFO:teuthology.orchestra.run.smithi081.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-13T06:40:35.973 INFO:teuthology.orchestra.run.smithi081.stdout:osd.4: {} 2024-09-13T06:40:35.973 INFO:teuthology.orchestra.run.smithi081.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-13T06:40:35.983 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:40:35.983 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:40:35.993 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:40:35.990+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:40:35.993 INFO:teuthology.orchestra.run.smithi081.stdout:osd.5: {} 2024-09-13T06:40:35.993 INFO:teuthology.orchestra.run.smithi081.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-13T06:40:35.996 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-13T06:40:36.014 INFO:teuthology.orchestra.run.smithi081.stdout:osd.6: {} 2024-09-13T06:40:36.015 INFO:teuthology.orchestra.run.smithi081.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-13T06:40:36.036 INFO:teuthology.orchestra.run.smithi081.stdout:osd.7: {} 2024-09-13T06:40:36.036 INFO:teuthology.orchestra.run.smithi081.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-13T06:40:36.097 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:40:36.100+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:40:36.130 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:40:36.131 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:40:36.143 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-13T06:40:36.195 INFO:tasks.ceph.osd.6.smithi139.stderr:2024-09-13T06:40:36.194+0000 7fcd02c5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26385) UID: 0 2024-09-13T06:40:36.274 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:40:36.274 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:40:36.288 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-13T06:40:36.295 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:40:36.296+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:40:36.395 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:40:36.394+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:40:36.469 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:40:36.469 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:40:36.483 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-13T06:40:36.497 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:40:36.500+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:40:36.598 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:40:36.600+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:40:36.653 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:40:36.653 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:40:36.667 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-13T06:40:36.698 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:40:36.700+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:40:36.785 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:40:36.785 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:40:36.799 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-13T06:40:36.800 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:40:36.800+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:40:36.900 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:40:36.900+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:40:36.920 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:40:36.920 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:40:36.934 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-13T06:40:37.001 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:40:36.998+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:40:37.052 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:40:37.052 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:40:37.066 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-13T06:40:37.111 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-13T06:40:37.110+0000 7f86a5f06640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26387) UID: 0 2024-09-13T06:40:37.204 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:40:37.202+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:40:37.235 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:40:37.235 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:40:37.249 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-13T06:40:37.334 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:40:37.334+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:40:37.405 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:40:37.408+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:40:37.417 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:40:37.417 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:40:37.432 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-13T06:40:37.519 INFO:tasks.ceph.osd.6.smithi139.stderr:2024-09-13T06:40:37.518+0000 7fcd02c5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26385) UID: 0 2024-09-13T06:40:37.599 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:40:37.599 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:40:37.607 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:40:37.608+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:40:37.607 INFO:teuthology.orchestra.run.smithi081.stdout:checking clone #11, image image_client.0-clone11 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent12 2024-09-13T06:40:37.613 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-13T06:40:37.690 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-13T06:40:37.709 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-13T06:40:37.705+0000 7f86a5f06640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26387) UID: 0 2024-09-13T06:40:37.783 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:40:37.783 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:40:37.798 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-13T06:40:37.809 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:40:37.812+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:40:37.910 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-13T06:40:37.905+0000 7f86a5f06640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26387) UID: 0 2024-09-13T06:40:37.959 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:40:37.960 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:40:37.973 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-13T06:40:37.999 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:40:37.999 INFO:teuthology.orchestra.run.smithi081.stdout:2188 read 0x7db8806 thru 0x7dbb857 (0x3052 bytes) 2024-09-13T06:40:37.999 INFO:teuthology.orchestra.run.smithi081.stdout:2189 read 0x4ed8bf9 thru 0x4ee4b6d (0xbf75 bytes) 2024-09-13T06:40:38.000 INFO:teuthology.orchestra.run.smithi081.stdout:2192 writesame 0x1fb63dc thru 0x1fbfd12 data_size 0x1(0x9937 bytes) 2024-09-13T06:40:38.015 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:40:38.013+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:40:38.037 INFO:teuthology.orchestra.run.smithi081.stdout:2193 write 0xee12b5b thru 0xee220d4 (0xf57a bytes) 2024-09-13T06:40:38.042 INFO:teuthology.orchestra.run.smithi081.stdout:2195 write 0x1a778d1 thru 0x1a83013 (0xb743 bytes) 2024-09-13T06:40:38.048 INFO:teuthology.orchestra.run.smithi081.stdout:2196 write 0xccf34f8 thru 0xccf36ed (0x1f6 bytes) 2024-09-13T06:40:38.053 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:40:38.053 INFO:teuthology.orchestra.run.smithi081.stdout:2199 read 0xd3a81c4 thru 0xd3b392b (0xb768 bytes) 2024-09-13T06:40:38.053 INFO:teuthology.orchestra.run.smithi081.stdout:2201 write 0x1d329e8 thru 0x1d42765 (0xfd7e bytes) 2024-09-13T06:40:38.054 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-13T06:40:38.057 INFO:teuthology.orchestra.run.smithi081.stdout:2203 write 0x1081fd8 thru 0x108867c (0x66a5 bytes) 2024-09-13T06:40:38.076 INFO:teuthology.orchestra.run.smithi081.stdout:2204 trunc from 0xee220d5 to 0x5a72919 2024-09-13T06:40:38.093 INFO:teuthology.orchestra.run.smithi081.stdout:2206 read 0x27e5723 thru 0x27e6cbd (0x159b bytes) 2024-09-13T06:40:38.106 INFO:teuthology.orchestra.run.smithi081.stdout:2208 trunc from 0x5a72919 to 0xc05650b 2024-09-13T06:40:38.111 INFO:tasks.ceph.osd.6.smithi139.stderr:2024-09-13T06:40:38.109+0000 7fcd02c5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26385) UID: 0 2024-09-13T06:40:38.114 INFO:teuthology.orchestra.run.smithi081.stdout:2209 read 0x3004b71 thru 0x30146fc (0xfb8c bytes) 2024-09-13T06:40:38.114 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:40:38.117 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:40:38.117 INFO:teuthology.orchestra.run.smithi081.stdout:2212 write 0x7c7e778 thru 0x7c81520 (0x2da9 bytes) 2024-09-13T06:40:38.120 INFO:teuthology.orchestra.run.smithi081.stdout:2213 read 0x166527b thru 0x167081d (0xb5a3 bytes) 2024-09-13T06:40:38.120 INFO:teuthology.orchestra.run.smithi081.stdout:2214 write 0xa182a45 thru 0xa18971f (0x6cdb bytes) 2024-09-13T06:40:38.125 INFO:teuthology.orchestra.run.smithi081.stdout:2216 write 0x54729a thru 0x55123d (0x9fa4 bytes) 2024-09-13T06:40:38.133 INFO:teuthology.orchestra.run.smithi081.stdout:2217 trunc from 0xc05650b to 0xdd81885 2024-09-13T06:40:38.142 INFO:teuthology.orchestra.run.smithi081.stdout:2218 read 0x36c33f2 thru 0x36d0b8b (0xd79a bytes) 2024-09-13T06:40:38.142 INFO:teuthology.orchestra.run.smithi081.stdout:2220 read 0x8ca1b6b thru 0x8ca4539 (0x29cf bytes) 2024-09-13T06:40:38.147 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:40:38.147 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:40:38.157 INFO:teuthology.orchestra.run.smithi081.stdout:2221 trunc from 0xdd81885 to 0x5f1f09a 2024-09-13T06:40:38.162 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-13T06:40:38.176 INFO:teuthology.orchestra.run.smithi081.stdout:2222 read 0x1ea7055 thru 0x1eacb07 (0x5ab3 bytes) 2024-09-13T06:40:38.185 INFO:teuthology.orchestra.run.smithi081.stdout:2223 writesame 0x6dfe978 thru 0x6e07902 data_size 0x9(0x8f8b bytes) 2024-09-13T06:40:38.201 INFO:teuthology.orchestra.run.smithi081.stdout:2224 write 0xcd0ae21 thru 0xcd0e29d (0x347d bytes) 2024-09-13T06:40:38.205 INFO:teuthology.orchestra.run.smithi081.stdout:2226 punch from 0x8835671 to 0x883ea6f, (0x93fe bytes) 2024-09-13T06:40:38.205 INFO:teuthology.orchestra.run.smithi081.stdout:2227 punch from 0x2ff070e to 0x2ff6cec, (0x65de bytes) 2024-09-13T06:40:38.205 INFO:teuthology.orchestra.run.smithi081.stdout:2228 writesame 0x2be640e thru 0x2bf3eba data_size 0x1(0xdaad bytes) 2024-09-13T06:40:38.212 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:40:38.212+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:40:38.220 INFO:teuthology.orchestra.run.smithi081.stdout:osd.0: {} 2024-09-13T06:40:38.220 INFO:teuthology.orchestra.run.smithi081.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-13T06:40:38.238 INFO:teuthology.orchestra.run.smithi081.stdout:osd.1: {} 2024-09-13T06:40:38.238 INFO:teuthology.orchestra.run.smithi081.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-13T06:40:38.239 INFO:teuthology.orchestra.run.smithi081.stdout:2229 punch from 0x971dcb to 0x97986b, (0x7aa0 bytes) 2024-09-13T06:40:38.239 INFO:teuthology.orchestra.run.smithi081.stdout:2230 write 0x636b4f thru 0x6428f7 (0xbda9 bytes) 2024-09-13T06:40:38.243 INFO:teuthology.orchestra.run.smithi081.stdout:2231 write 0x9921215 thru 0x9929282 (0x806e bytes) 2024-09-13T06:40:38.247 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:40:38.248 INFO:teuthology.orchestra.run.smithi081.stdout:2234 read 0x1539441 thru 0x1541647 (0x8207 bytes) 2024-09-13T06:40:38.248 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:40:38.257 INFO:teuthology.orchestra.run.smithi081.stdout:osd.2: {} 2024-09-13T06:40:38.257 INFO:teuthology.orchestra.run.smithi081.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-13T06:40:38.261 INFO:teuthology.orchestra.run.smithi081.stdout:2238 trunc from 0xcd0e29e to 0x38cc2b6 2024-09-13T06:40:38.277 INFO:teuthology.orchestra.run.smithi081.stdout:osd.3: {} 2024-09-13T06:40:38.277 INFO:teuthology.orchestra.run.smithi081.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-13T06:40:38.293 INFO:teuthology.orchestra.run.smithi081.stdout:2239 trunc from 0x38cc2b6 to 0xe694676 2024-09-13T06:40:38.298 INFO:teuthology.orchestra.run.smithi081.stdout:osd.4: {} 2024-09-13T06:40:38.298 INFO:teuthology.orchestra.run.smithi081.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-13T06:40:38.299 INFO:teuthology.orchestra.run.smithi081.stdout:2240 write 0xb501c16 thru 0xb50f742 (0xdb2d bytes) 2024-09-13T06:40:38.306 INFO:teuthology.orchestra.run.smithi081.stdout:2241 read 0x4375852 thru 0x437feed (0xa69c bytes) 2024-09-13T06:40:38.306 INFO:teuthology.orchestra.run.smithi081.stdout:2242 punch from 0x397e0c8 to 0x397e273, (0x1ab bytes) 2024-09-13T06:40:38.306 INFO:teuthology.orchestra.run.smithi081.stdout:2243 punch from 0x8d46876 to 0x8d4e321, (0x7aab bytes) 2024-09-13T06:40:38.307 INFO:teuthology.orchestra.run.smithi081.stdout:2244 read 0x4c91073 thru 0x4c9832b (0x72b9 bytes) 2024-09-13T06:40:38.307 INFO:teuthology.orchestra.run.smithi081.stdout:2245 write 0x8bf4678 thru 0x8bf6e0a (0x2793 bytes) 2024-09-13T06:40:38.308 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:40:38.308 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-13T06:40:38.308 INFO:teuthology.orchestra.run.smithi081.stdout: "num_ops": 0 2024-09-13T06:40:38.308 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:40:38.311 INFO:teuthology.orchestra.run.smithi081.stdout:2246 punch from 0x3085fce to 0x308d2ec, (0x731e bytes) 2024-09-13T06:40:38.311 INFO:teuthology.orchestra.run.smithi081.stdout:2249 read 0x2e4b7f7 thru 0x2e4bdff (0x609 bytes) 2024-09-13T06:40:38.311 INFO:teuthology.orchestra.run.smithi081.stdout:2250 read 0xbd9e101 thru 0xbda03e5 (0x22e5 bytes) 2024-09-13T06:40:38.311 INFO:teuthology.orchestra.run.smithi081.stdout:2251 write 0x36977b2 thru 0x369a30d (0x2b5c bytes) 2024-09-13T06:40:38.313 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:40:38.316+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:40:38.319 INFO:teuthology.orchestra.run.smithi081.stdout:osd.5: {} 2024-09-13T06:40:38.320 INFO:teuthology.orchestra.run.smithi081.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-13T06:40:38.326 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-13T06:40:38.334 INFO:teuthology.orchestra.run.smithi081.stdout:2252 trunc from 0xe694676 to 0x3464e04 2024-09-13T06:40:38.342 INFO:teuthology.orchestra.run.smithi081.stdout:osd.6: {} 2024-09-13T06:40:38.342 INFO:teuthology.orchestra.run.smithi081.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-13T06:40:38.364 INFO:teuthology.orchestra.run.smithi081.stderr:noscrub is set 2024-09-13T06:40:38.365 INFO:teuthology.orchestra.run.smithi081.stdout:osd.7: {} 2024-09-13T06:40:38.365 INFO:teuthology.orchestra.run.smithi081.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-13T06:40:38.368 INFO:teuthology.orchestra.run.smithi081.stdout:2253 write 0x72e1dec thru 0x72e7a1f (0x5c34 bytes) 2024-09-13T06:40:38.376 INFO:teuthology.orchestra.run.smithi081.stdout:2254 punch from 0x179d73c to 0x17a8de4, (0xb6a8 bytes) 2024-09-13T06:40:38.385 INFO:teuthology.orchestra.run.smithi081.stdout:2255 writesame 0x74dbda5 thru 0x74dead7 data_size 0x39(0x2d33 bytes) 2024-09-13T06:40:38.385 INFO:teuthology.orchestra.run.smithi081.stdout:2256 punch from 0x97a6aa to 0x97c646, (0x1f9c bytes) 2024-09-13T06:40:38.385 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:40:38.385 INFO:teuthology.orchestra.run.smithi081.stdout:2258 write 0x6e45310 thru 0x6e466f0 (0x13e1 bytes) 2024-09-13T06:40:38.391 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:40:38.391 INFO:teuthology.orchestra.run.smithi081.stdout:2260 write 0x6062235 thru 0x6064c8d (0x2a59 bytes) 2024-09-13T06:40:38.397 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:40:38.414 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:40:38.413+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:40:38.415 INFO:teuthology.orchestra.run.smithi081.stdout:2262 write 0xdcf85ee thru 0xdcfe291 (0x5ca4 bytes) 2024-09-13T06:40:38.422 INFO:teuthology.orchestra.run.smithi081.stdout:2263 read 0x644d9a0 thru 0x64520f0 (0x4751 bytes) 2024-09-13T06:40:38.438 INFO:teuthology.orchestra.run.smithi081.stdout:2264 trunc from 0xdcfe292 to 0x43d5c2a 2024-09-13T06:40:38.454 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:40:38.456 INFO:teuthology.orchestra.run.smithi081.stdout:2266 trunc from 0x43d5c2a to 0x32ed233 2024-09-13T06:40:38.466 INFO:teuthology.orchestra.run.smithi081.stdout:2267 write 0x18ddefc thru 0x18e3d30 (0x5e35 bytes) 2024-09-13T06:40:38.471 INFO:teuthology.orchestra.run.smithi081.stdout:2269 read 0x5c784f thru 0x5cd698 (0x5e4a bytes) 2024-09-13T06:40:38.472 INFO:teuthology.orchestra.run.smithi081.stdout:2270 read 0xcaa562 thru 0xcb5d2e (0xb7cd bytes) 2024-09-13T06:40:38.477 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:40:38.477 INFO:teuthology.orchestra.run.smithi081.stdout:2274 read 0x3083efa thru 0x309237d (0xe484 bytes) 2024-09-13T06:40:38.480 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:40:38.480 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-13T06:40:38.480 INFO:teuthology.orchestra.run.smithi081.stdout: "complaint_time": 30, 2024-09-13T06:40:38.480 INFO:teuthology.orchestra.run.smithi081.stdout: "num_blocked_ops": 0 2024-09-13T06:40:38.480 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:40:38.485 INFO:teuthology.orchestra.run.smithi081.stdout:2275 writesame 0x35d90dc thru 0x35e7bdd data_size 0x6f(0xeb02 bytes) 2024-09-13T06:40:38.485 INFO:teuthology.orchestra.run.smithi081.stdout:2276 punch from 0x2bc7213 to 0x2bd1a92, (0xa87f bytes) 2024-09-13T06:40:38.485 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:40:38.485 INFO:teuthology.orchestra.run.smithi081.stdout:2282 read 0x1ef1dff thru 0x1f00ad0 (0xecd2 bytes) 2024-09-13T06:40:38.485 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:40:38.485 INFO:teuthology.orchestra.run.smithi081.stdout:2284 punch from 0x223ea5 to 0x22aca5, (0x6e00 bytes) 2024-09-13T06:40:38.487 INFO:teuthology.orchestra.run.smithi081.stdout:2287 trunc from 0x35e7bde to 0x519c54e 2024-09-13T06:40:38.496 INFO:teuthology.orchestra.run.smithi081.stdout:2288 write 0xd5e539 thru 0xd6e404 (0xfecc bytes) 2024-09-13T06:40:38.499 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-13T06:40:38.501 INFO:teuthology.orchestra.run.smithi081.stdout:2289 read 0x44632ee thru 0x446ec5e (0xb971 bytes) 2024-09-13T06:40:38.507 INFO:teuthology.orchestra.run.smithi081.stdout:2292 trunc from 0x519c54e to 0xf9068e 2024-09-13T06:40:38.515 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:40:38.516+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:40:38.533 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:40:38.544 INFO:teuthology.orchestra.run.smithi081.stdout:2295 trunc from 0xf9068e to 0x91b8700 2024-09-13T06:40:38.564 INFO:teuthology.orchestra.run.smithi081.stdout:2296 write 0xbdc83e0 thru 0xbdcbc0f (0x3830 bytes) 2024-09-13T06:40:38.588 INFO:teuthology.orchestra.run.smithi081.stdout:2298 trunc from 0xbdcbc10 to 0xae3a86 2024-09-13T06:40:38.616 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:40:38.616+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:40:38.616 INFO:teuthology.orchestra.run.smithi081.stdout:2299 trunc from 0xae3a86 to 0x388c862 2024-09-13T06:40:38.625 INFO:teuthology.orchestra.run.smithi081.stdout:2300 write 0xbba1a8 thru 0xbc76f8 (0xd551 bytes) 2024-09-13T06:40:38.635 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:40:38.635 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 20, 2024-09-13T06:40:38.635 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 600, 2024-09-13T06:40:38.635 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [ 2024-09-13T06:40:38.635 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:38.635 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:37801 3.1 3:82e31015:::rbd_object_map.1121d8143c6e.0000000000000019:head [call] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e55)", 2024-09-13T06:40:38.635 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:05.646191+0000", 2024-09-13T06:40:38.635 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 32.990256979999998, 2024-09-13T06:40:38.635 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.72659507800000001, 2024-09-13T06:40:38.635 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:38.635 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:38.635 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:38.636 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:38.636 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:38.636 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 37801 2024-09-13T06:40:38.636 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:38.636 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:38.636 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:38.636 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:38.636 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:05.646191+0000", 2024-09-13T06:40:38.636 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:38.636 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:38.636 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:38.636 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:38.637 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:05.646191+0000", 2024-09-13T06:40:38.637 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:38.637 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:38.637 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:38.637 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:38.637 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:05.646188+0000", 2024-09-13T06:40:38.637 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999971 2024-09-13T06:40:38.637 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:38.637 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:38.637 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:38.637 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:05.646206+0000", 2024-09-13T06:40:38.637 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8182999999999999e-05 2024-09-13T06:40:38.637 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:38.638 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:38.638 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:38.638 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:05.646237+0000", 2024-09-13T06:40:38.638 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.1071000000000001e-05 2024-09-13T06:40:38.638 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:38.638 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:38.638 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:38.638 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:05.646251+0000", 2024-09-13T06:40:38.638 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3679000000000001e-05 2024-09-13T06:40:38.638 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:38.638 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:38.638 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:38.638 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:05.646321+0000", 2024-09-13T06:40:38.639 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.9831000000000003e-05 2024-09-13T06:40:38.639 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:38.639 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:38.639 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:40:38.639 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:05.646331+0000", 2024-09-13T06:40:38.639 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0242e-05 2024-09-13T06:40:38.639 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:38.639 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:38.639 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:38.639 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.371959+0000", 2024-09-13T06:40:38.639 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.72562817199999996 2024-09-13T06:40:38.639 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:38.639 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:38.640 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:38.640 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.372389+0000", 2024-09-13T06:40:38.640 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00042977400000000001 2024-09-13T06:40:38.640 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:38.640 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:38.640 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:38.640 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.372786+0000", 2024-09-13T06:40:38.640 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00039706099999999999 2024-09-13T06:40:38.640 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:38.640 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:38.640 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:38.640 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:38.641 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:38.641 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43009 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 489472~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:40:38.641 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.644660+0000", 2024-09-13T06:40:38.641 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 16.991788018000001, 2024-09-13T06:40:38.641 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123376071, 2024-09-13T06:40:38.641 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:38.641 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:38.641 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:38.641 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:38.641 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:38.641 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43009 2024-09-13T06:40:38.641 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:38.641 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:38.642 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:38.642 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:38.642 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.644660+0000", 2024-09-13T06:40:38.642 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:38.642 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:38.642 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:38.642 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:38.642 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.644660+0000", 2024-09-13T06:40:38.642 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:38.642 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:38.642 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:38.642 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:38.642 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.644659+0000", 2024-09-13T06:40:38.642 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:38.643 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:38.643 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:38.643 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:38.643 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.644662+0000", 2024-09-13T06:40:38.643 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4949999999999998e-06 2024-09-13T06:40:38.643 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:38.643 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:38.643 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:38.643 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.644669+0000", 2024-09-13T06:40:38.643 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.289e-06 2024-09-13T06:40:38.644 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:38.644 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:38.644 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:38.644 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.644674+0000", 2024-09-13T06:40:38.644 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.8840000000000002e-06 2024-09-13T06:40:38.644 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:38.644 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:38.644 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:38.644 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.767602+0000", 2024-09-13T06:40:38.644 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.122928158 2024-09-13T06:40:38.644 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:38.644 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:38.644 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:38.644 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.767676+0000", 2024-09-13T06:40:38.645 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3992999999999994e-05 2024-09-13T06:40:38.645 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:38.645 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:38.645 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:38.645 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.768036+0000", 2024-09-13T06:40:38.645 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00035966200000000001 2024-09-13T06:40:38.645 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:38.645 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:38.645 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:38.645 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:38.645 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:38.645 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43010 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 503808~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:40:38.645 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.644678+0000", 2024-09-13T06:40:38.646 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 16.991769691999998, 2024-09-13T06:40:38.646 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123728798, 2024-09-13T06:40:38.646 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:38.646 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:38.646 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:38.646 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:38.646 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:38.646 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43010 2024-09-13T06:40:38.646 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:38.646 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:38.646 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:38.646 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:38.646 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.644678+0000", 2024-09-13T06:40:38.647 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:38.647 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:38.647 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:38.647 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:38.647 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.644678+0000", 2024-09-13T06:40:38.647 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:38.647 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:38.647 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:38.647 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:38.647 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.644678+0000", 2024-09-13T06:40:38.647 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:38.647 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:38.647 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:38.647 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:38.648 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.644680+0000", 2024-09-13T06:40:38.648 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2050000000000001e-06 2024-09-13T06:40:38.648 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:38.648 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:38.648 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:38.648 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.644686+0000", 2024-09-13T06:40:38.648 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8440000000000003e-06 2024-09-13T06:40:38.648 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:38.648 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:38.648 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:38.648 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.644691+0000", 2024-09-13T06:40:38.648 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.118e-06 2024-09-13T06:40:38.648 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:38.649 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:38.649 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:38.649 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.768065+0000", 2024-09-13T06:40:38.649 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123374698 2024-09-13T06:40:38.649 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:38.649 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:38.649 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:38.649 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.768139+0000", 2024-09-13T06:40:38.649 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3934000000000001e-05 2024-09-13T06:40:38.649 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:38.649 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:38.649 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:38.649 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.768407+0000", 2024-09-13T06:40:38.650 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00026738800000000002 2024-09-13T06:40:38.650 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:38.650 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:38.650 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:38.650 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:38.650 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:38.650 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43181 3.17 3:ec5ebce4:::rbd_data.1121f5f2e1c0.0000000000000001:1f [read 319488~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:40:38.650 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.652968+0000", 2024-09-13T06:40:38.650 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 16.983479175999999, 2024-09-13T06:40:38.650 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.12363807, 2024-09-13T06:40:38.650 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:38.650 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:38.650 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:38.650 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:38.651 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:38.651 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43181 2024-09-13T06:40:38.651 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:38.651 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:38.651 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:38.651 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:38.651 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.652968+0000", 2024-09-13T06:40:38.651 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:38.651 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:38.651 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:38.651 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:38.651 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.652968+0000", 2024-09-13T06:40:38.651 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:38.652 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:38.652 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:38.652 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:38.652 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.652968+0000", 2024-09-13T06:40:38.652 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:38.652 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:38.652 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:38.652 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:38.652 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.652970+0000", 2024-09-13T06:40:38.652 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2409999999999998e-06 2024-09-13T06:40:38.652 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:38.652 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:38.652 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:38.653 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.652976+0000", 2024-09-13T06:40:38.653 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0079999999999999e-06 2024-09-13T06:40:38.653 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:38.653 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:38.653 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:38.653 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.652981+0000", 2024-09-13T06:40:38.653 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4390000000000002e-06 2024-09-13T06:40:38.653 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:38.653 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:38.653 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:38.653 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.776275+0000", 2024-09-13T06:40:38.653 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.12329396099999999 2024-09-13T06:40:38.653 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:38.653 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:38.654 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:38.654 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.776316+0000", 2024-09-13T06:40:38.654 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.1244e-05 2024-09-13T06:40:38.654 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:38.654 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:38.654 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:38.654 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.776607+0000", 2024-09-13T06:40:38.654 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00029051199999999999 2024-09-13T06:40:38.654 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:38.654 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:38.654 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:38.654 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:38.654 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:38.655 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43182 3.17 3:ec5ebce4:::rbd_data.1121f5f2e1c0.0000000000000001:1f [read 333824~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:40:38.655 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.652985+0000", 2024-09-13T06:40:38.655 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 16.983462367000001, 2024-09-13T06:40:38.655 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123926616, 2024-09-13T06:40:38.655 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:38.655 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:38.655 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:38.655 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:38.655 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:38.655 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43182 2024-09-13T06:40:38.655 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:38.655 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:38.655 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:38.656 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:38.656 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.652985+0000", 2024-09-13T06:40:38.656 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:38.656 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:38.656 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:38.656 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:38.656 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.652985+0000", 2024-09-13T06:40:38.656 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:38.656 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:38.656 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:38.656 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:38.656 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.652985+0000", 2024-09-13T06:40:38.656 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:38.657 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:38.657 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:38.657 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:38.657 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.652987+0000", 2024-09-13T06:40:38.657 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0899999999999999e-06 2024-09-13T06:40:38.657 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:38.657 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:38.657 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:38.657 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.652994+0000", 2024-09-13T06:40:38.657 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3100000000000003e-06 2024-09-13T06:40:38.657 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:38.657 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:38.658 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:38.658 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.653000+0000", 2024-09-13T06:40:38.658 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2020000000000003e-06 2024-09-13T06:40:38.658 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:38.658 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:38.658 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:38.658 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.776635+0000", 2024-09-13T06:40:38.658 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.12363529400000001 2024-09-13T06:40:38.658 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:38.658 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:38.658 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:38.658 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.776676+0000", 2024-09-13T06:40:38.658 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.0745999999999999e-05 2024-09-13T06:40:38.659 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:38.659 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:38.659 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:38.659 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.776912+0000", 2024-09-13T06:40:38.659 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00023631300000000001 2024-09-13T06:40:38.659 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:38.659 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:38.659 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:38.659 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:38.659 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:38.659 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43192 3.17 3:ec5ebce4:::rbd_data.1121f5f2e1c0.0000000000000001:1f [read 466944~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:40:38.659 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.656622+0000", 2024-09-13T06:40:38.659 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 16.979825310999999, 2024-09-13T06:40:38.660 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123503136, 2024-09-13T06:40:38.660 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:38.660 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:38.660 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:38.660 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:38.660 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:38.660 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43192 2024-09-13T06:40:38.660 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:38.660 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:38.660 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:38.660 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:38.660 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656622+0000", 2024-09-13T06:40:38.660 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:38.661 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:38.661 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:38.661 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:38.661 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656622+0000", 2024-09-13T06:40:38.661 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:38.661 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:38.661 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:38.661 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:38.661 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656622+0000", 2024-09-13T06:40:38.661 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:40:38.661 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:38.661 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:38.661 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:38.662 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656623+0000", 2024-09-13T06:40:38.662 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2079999999999999e-06 2024-09-13T06:40:38.662 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:38.662 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:38.662 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:38.662 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656627+0000", 2024-09-13T06:40:38.662 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.4819999999999999e-06 2024-09-13T06:40:38.662 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:38.662 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:38.662 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:38.662 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656629+0000", 2024-09-13T06:40:38.662 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.582e-06 2024-09-13T06:40:38.662 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:38.662 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:38.663 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:38.663 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.779866+0000", 2024-09-13T06:40:38.663 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.12323638100000001 2024-09-13T06:40:38.663 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:38.663 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:38.663 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:38.663 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.779905+0000", 2024-09-13T06:40:38.663 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.9529e-05 2024-09-13T06:40:38.663 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:38.663 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:38.663 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:38.663 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.780125+0000", 2024-09-13T06:40:38.663 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000220168 2024-09-13T06:40:38.664 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:38.664 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:38.664 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:38.664 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:38.664 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:38.664 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43193 3.17 3:ec5ebce4:::rbd_data.1121f5f2e1c0.0000000000000001:1f [read 481280~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:40:38.664 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.656635+0000", 2024-09-13T06:40:38.664 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 16.979812827, 2024-09-13T06:40:38.664 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.12374478999999999, 2024-09-13T06:40:38.664 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:38.664 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:38.664 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:38.664 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:38.665 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:38.665 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43193 2024-09-13T06:40:38.665 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:38.665 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:38.665 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:38.665 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:38.665 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656635+0000", 2024-09-13T06:40:38.665 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:38.665 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:38.665 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:38.665 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:38.665 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656635+0000", 2024-09-13T06:40:38.665 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:38.666 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:38.666 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:38.666 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:38.666 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656635+0000", 2024-09-13T06:40:38.666 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:40:38.666 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:38.666 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:38.666 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:38.666 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656636+0000", 2024-09-13T06:40:38.666 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.544e-06 2024-09-13T06:40:38.666 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:38.666 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:38.666 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:38.666 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656639+0000", 2024-09-13T06:40:38.667 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.0879999999999999e-06 2024-09-13T06:40:38.667 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:38.667 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:38.667 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:38.667 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656642+0000", 2024-09-13T06:40:38.667 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5799999999999999e-06 2024-09-13T06:40:38.667 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:38.667 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:38.667 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:38.667 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.780151+0000", 2024-09-13T06:40:38.667 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123509035 2024-09-13T06:40:38.667 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:38.667 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:38.668 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:38.668 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.780191+0000", 2024-09-13T06:40:38.668 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.9758000000000001e-05 2024-09-13T06:40:38.668 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:38.668 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:38.668 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:38.668 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.780380+0000", 2024-09-13T06:40:38.668 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000189023 2024-09-13T06:40:38.668 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:38.668 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:38.668 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:38.668 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:38.669 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:38.669 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43194 3.17 3:ec5ebce4:::rbd_data.1121f5f2e1c0.0000000000000001:1f [read 495616~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:40:38.669 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.656645+0000", 2024-09-13T06:40:38.669 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 16.979802174, 2024-09-13T06:40:38.669 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.124088483, 2024-09-13T06:40:38.669 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:38.669 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:38.669 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:38.669 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:38.669 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:38.669 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43194 2024-09-13T06:40:38.669 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:38.670 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:38.670 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:38.670 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:38.670 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656645+0000", 2024-09-13T06:40:38.670 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:38.670 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:38.670 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:38.670 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:38.670 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656645+0000", 2024-09-13T06:40:38.670 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:38.670 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:38.670 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:38.670 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:38.670 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656645+0000", 2024-09-13T06:40:38.671 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:38.671 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:38.671 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:38.671 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:38.671 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656647+0000", 2024-09-13T06:40:38.671 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9180000000000001e-06 2024-09-13T06:40:38.671 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:38.671 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:38.671 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:38.671 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656653+0000", 2024-09-13T06:40:38.671 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7860000000000002e-06 2024-09-13T06:40:38.671 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:38.671 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:38.672 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:38.672 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656658+0000", 2024-09-13T06:40:38.672 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6949999999999999e-06 2024-09-13T06:40:38.672 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:38.672 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:38.672 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:38.672 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.780406+0000", 2024-09-13T06:40:38.672 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123748657 2024-09-13T06:40:38.672 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:38.672 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:38.672 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:38.672 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.780446+0000", 2024-09-13T06:40:38.672 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.9360999999999998e-05 2024-09-13T06:40:38.673 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:38.673 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:38.673 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:38.673 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.780734+0000", 2024-09-13T06:40:38.673 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00028838399999999998 2024-09-13T06:40:38.673 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:38.673 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:38.673 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:38.673 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:38.673 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:38.673 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43240 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 106496~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:40:38.673 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.660672+0000", 2024-09-13T06:40:38.673 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 16.975775810999998, 2024-09-13T06:40:38.674 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123612707, 2024-09-13T06:40:38.674 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:38.674 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:38.674 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:38.674 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:38.674 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:38.674 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43240 2024-09-13T06:40:38.674 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:38.674 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:38.674 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:38.674 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:38.674 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660672+0000", 2024-09-13T06:40:38.674 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:38.675 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:38.675 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:38.675 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:38.675 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660672+0000", 2024-09-13T06:40:38.675 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:38.675 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:38.675 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:38.675 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:38.675 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660671+0000", 2024-09-13T06:40:38.675 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:38.675 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:38.675 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:38.675 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:38.676 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660673+0000", 2024-09-13T06:40:38.676 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.652e-06 2024-09-13T06:40:38.676 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:38.676 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:38.676 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:38.676 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660677+0000", 2024-09-13T06:40:38.676 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.2509999999999996e-06 2024-09-13T06:40:38.676 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:38.676 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:38.676 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:38.676 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660680+0000", 2024-09-13T06:40:38.676 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.8150000000000002e-06 2024-09-13T06:40:38.676 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:38.677 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:38.677 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:38.677 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.783596+0000", 2024-09-13T06:40:38.677 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.122915841 2024-09-13T06:40:38.677 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:38.677 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:38.677 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:38.677 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.783682+0000", 2024-09-13T06:40:38.677 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.5822999999999995e-05 2024-09-13T06:40:38.677 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:38.677 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:38.677 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:38.677 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.784285+0000", 2024-09-13T06:40:38.677 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00060276500000000001 2024-09-13T06:40:38.678 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:38.678 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:38.678 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:38.678 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:38.678 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:38.678 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43241 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 120832~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:40:38.678 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.660682+0000", 2024-09-13T06:40:38.678 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 16.975765236000001, 2024-09-13T06:40:38.678 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123958204, 2024-09-13T06:40:38.678 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:38.678 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:38.678 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:38.678 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:38.679 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:38.679 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43241 2024-09-13T06:40:38.679 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:38.679 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:38.679 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:38.679 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:38.679 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660682+0000", 2024-09-13T06:40:38.679 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:38.679 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:38.679 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:38.679 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:38.679 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660682+0000", 2024-09-13T06:40:38.679 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:38.680 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:38.680 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:38.680 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:38.680 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660682+0000", 2024-09-13T06:40:38.680 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:38.680 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:38.680 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:38.680 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:38.680 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660683+0000", 2024-09-13T06:40:38.680 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.308e-06 2024-09-13T06:40:38.680 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:38.680 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:38.680 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:38.681 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660686+0000", 2024-09-13T06:40:38.681 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.977e-06 2024-09-13T06:40:38.681 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:38.681 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:38.681 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:38.681 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660689+0000", 2024-09-13T06:40:38.681 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5830000000000001e-06 2024-09-13T06:40:38.681 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:38.681 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:38.681 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:38.681 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.784366+0000", 2024-09-13T06:40:38.681 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.12367713599999999 2024-09-13T06:40:38.681 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:38.681 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:38.682 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:38.682 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.784451+0000", 2024-09-13T06:40:38.682 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.4629999999999994e-05 2024-09-13T06:40:38.682 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:38.682 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:38.682 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:38.682 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.784641+0000", 2024-09-13T06:40:38.682 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00018984899999999999 2024-09-13T06:40:38.682 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:38.682 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:38.682 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:38.682 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:38.682 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:38.683 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43242 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 139264~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:40:38.683 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.660691+0000", 2024-09-13T06:40:38.683 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 16.975756258000001, 2024-09-13T06:40:38.683 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.124536443, 2024-09-13T06:40:38.683 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:38.683 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:38.683 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:38.683 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:38.683 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:38.683 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43242 2024-09-13T06:40:38.683 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:38.683 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:38.683 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:38.684 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:38.684 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660691+0000", 2024-09-13T06:40:38.684 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:38.684 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:38.684 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:38.684 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:38.684 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660691+0000", 2024-09-13T06:40:38.684 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:38.684 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:38.684 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:38.684 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:38.684 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660691+0000", 2024-09-13T06:40:38.684 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:40:38.685 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:38.685 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:38.685 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:38.685 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660696+0000", 2024-09-13T06:40:38.685 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0560000000000004e-06 2024-09-13T06:40:38.685 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:38.685 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:38.685 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:38.685 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660699+0000", 2024-09-13T06:40:38.685 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.2009999999999999e-06 2024-09-13T06:40:38.685 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:38.685 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:38.685 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:38.685 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660702+0000", 2024-09-13T06:40:38.686 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.633e-06 2024-09-13T06:40:38.686 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:38.686 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:38.686 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:38.686 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.784912+0000", 2024-09-13T06:40:38.686 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.124209497 2024-09-13T06:40:38.686 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:38.686 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:38.686 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:38.686 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.784995+0000", 2024-09-13T06:40:38.686 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.3891e-05 2024-09-13T06:40:38.686 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:38.686 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:38.687 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:38.687 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.785228+0000", 2024-09-13T06:40:38.687 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00023237400000000001 2024-09-13T06:40:38.687 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:38.687 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:38.687 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:38.687 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:38.687 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:38.687 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43243 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 153600~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:40:38.687 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.660705+0000", 2024-09-13T06:40:38.687 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 16.975742924999999, 2024-09-13T06:40:38.687 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.124825835, 2024-09-13T06:40:38.687 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:38.687 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:38.688 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:38.688 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:38.688 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:38.688 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43243 2024-09-13T06:40:38.688 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:38.688 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:38.688 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:38.688 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:38.688 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660705+0000", 2024-09-13T06:40:38.688 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:38.688 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:38.688 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:38.688 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:38.689 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660705+0000", 2024-09-13T06:40:38.689 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:38.689 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:38.689 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:38.689 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:38.689 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660705+0000", 2024-09-13T06:40:38.689 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:40:38.689 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:38.689 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:38.689 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:38.689 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660706+0000", 2024-09-13T06:40:38.689 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4339999999999999e-06 2024-09-13T06:40:38.689 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:38.690 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:38.690 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:38.690 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660709+0000", 2024-09-13T06:40:38.690 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9000000000000002e-06 2024-09-13T06:40:38.690 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:38.690 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:38.690 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:38.690 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660712+0000", 2024-09-13T06:40:38.690 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.0589999999999998e-06 2024-09-13T06:40:38.690 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:38.690 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:38.690 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:38.690 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.785318+0000", 2024-09-13T06:40:38.690 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.124606299 2024-09-13T06:40:38.691 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:38.691 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:38.691 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:38.691 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.785361+0000", 2024-09-13T06:40:38.691 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.3214999999999999e-05 2024-09-13T06:40:38.691 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:38.691 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:38.691 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:38.691 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.785531+0000", 2024-09-13T06:40:38.691 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00016914400000000001 2024-09-13T06:40:38.691 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:38.691 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:38.691 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:38.692 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:38.692 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:38.692 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43244 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 167936~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:40:38.692 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.660714+0000", 2024-09-13T06:40:38.692 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 16.975733512000001, 2024-09-13T06:40:38.692 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.125073248, 2024-09-13T06:40:38.692 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:38.692 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:38.692 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:38.692 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:38.692 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:38.692 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43244 2024-09-13T06:40:38.692 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:38.693 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:38.693 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:38.693 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:38.693 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660714+0000", 2024-09-13T06:40:38.693 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:38.693 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:38.693 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:38.693 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:38.693 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660714+0000", 2024-09-13T06:40:38.693 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:38.693 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:38.693 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:38.693 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:38.694 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660714+0000", 2024-09-13T06:40:38.694 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:40:38.694 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:38.694 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:38.694 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:38.694 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660715+0000", 2024-09-13T06:40:38.694 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2330000000000001e-06 2024-09-13T06:40:38.694 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:38.694 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:38.694 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:38.694 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660718+0000", 2024-09-13T06:40:38.694 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9569999999999998e-06 2024-09-13T06:40:38.694 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:38.695 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:38.695 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:38.695 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660721+0000", 2024-09-13T06:40:38.695 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.678e-06 2024-09-13T06:40:38.695 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:38.695 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:38.695 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:38.695 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.785557+0000", 2024-09-13T06:40:38.695 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.12483633199999999 2024-09-13T06:40:38.695 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:38.695 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:38.695 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:38.695 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.785618+0000", 2024-09-13T06:40:38.696 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0686000000000001e-05 2024-09-13T06:40:38.696 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:38.696 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:38.696 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:38.696 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.785787+0000", 2024-09-13T06:40:38.696 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00016957699999999999 2024-09-13T06:40:38.696 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:38.696 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:38.696 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:38.696 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:38.696 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:38.696 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43254 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 315392~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:40:38.697 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.664717+0000", 2024-09-13T06:40:38.697 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 16.971730944000001, 2024-09-13T06:40:38.697 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.12357108, 2024-09-13T06:40:38.697 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:38.697 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:38.697 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:38.697 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:38.697 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:38.697 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43254 2024-09-13T06:40:38.697 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:38.697 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:38.697 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:38.697 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:38.697 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664717+0000", 2024-09-13T06:40:38.698 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:38.698 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:38.698 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:38.698 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:38.698 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664717+0000", 2024-09-13T06:40:38.698 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:38.698 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:38.698 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:38.698 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:38.698 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664716+0000", 2024-09-13T06:40:38.698 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:38.698 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:38.698 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:38.699 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:38.699 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664724+0000", 2024-09-13T06:40:38.699 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.7109999999999995e-06 2024-09-13T06:40:38.699 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:38.699 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:38.699 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:38.699 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664732+0000", 2024-09-13T06:40:38.699 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.8399999999999995e-06 2024-09-13T06:40:38.699 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:38.699 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:38.699 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:38.699 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664738+0000", 2024-09-13T06:40:38.699 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.879e-06 2024-09-13T06:40:38.700 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:38.700 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:38.700 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:38.700 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.788018+0000", 2024-09-13T06:40:38.700 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123280719 2024-09-13T06:40:38.700 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:38.700 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:38.700 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:38.700 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.788119+0000", 2024-09-13T06:40:38.700 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000100558 2024-09-13T06:40:38.700 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:38.700 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:38.700 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:38.701 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.788288+0000", 2024-09-13T06:40:38.701 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000168751 2024-09-13T06:40:38.701 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:38.701 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:38.701 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:38.701 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:38.701 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:38.701 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43255 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 329728~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:40:38.701 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.664743+0000", 2024-09-13T06:40:38.701 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 16.971704947999999, 2024-09-13T06:40:38.701 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.12381711500000001, 2024-09-13T06:40:38.701 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:38.701 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:38.702 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:38.702 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:38.702 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:38.702 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43255 2024-09-13T06:40:38.702 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:38.702 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:38.702 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:38.702 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:38.702 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664743+0000", 2024-09-13T06:40:38.702 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:38.702 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:38.702 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:38.702 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:38.702 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664743+0000", 2024-09-13T06:40:38.703 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:38.703 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:38.703 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:38.703 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:38.703 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664742+0000", 2024-09-13T06:40:38.703 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:38.703 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:38.703 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:38.703 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:38.704 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664745+0000", 2024-09-13T06:40:38.704 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.7269999999999999e-06 2024-09-13T06:40:38.704 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:38.704 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:38.704 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:38.704 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664753+0000", 2024-09-13T06:40:38.704 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.8709999999999997e-06 2024-09-13T06:40:38.704 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:38.704 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:38.704 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:38.704 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664758+0000", 2024-09-13T06:40:38.704 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2220000000000001e-06 2024-09-13T06:40:38.704 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:38.705 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:38.705 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:38.705 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.788314+0000", 2024-09-13T06:40:38.705 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123555545 2024-09-13T06:40:38.705 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:38.705 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:38.705 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:38.705 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.788368+0000", 2024-09-13T06:40:38.705 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3928999999999998e-05 2024-09-13T06:40:38.705 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:38.705 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:38.705 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:38.705 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.788560+0000", 2024-09-13T06:40:38.706 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000192237 2024-09-13T06:40:38.706 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:38.706 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:38.706 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:38.706 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:38.706 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:38.706 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43256 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 344064~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:40:38.706 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.664763+0000", 2024-09-13T06:40:38.706 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 16.971685002000001, 2024-09-13T06:40:38.706 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.12418359399999999, 2024-09-13T06:40:38.706 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:38.706 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:38.706 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:38.706 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:38.707 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:38.707 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43256 2024-09-13T06:40:38.707 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:38.707 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:38.707 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:38.707 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:38.707 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664763+0000", 2024-09-13T06:40:38.707 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:38.707 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:38.707 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:38.707 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:38.707 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664763+0000", 2024-09-13T06:40:38.707 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:38.708 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:38.708 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:38.708 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:38.708 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664762+0000", 2024-09-13T06:40:38.708 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:38.708 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:38.708 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:38.708 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:38.708 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664765+0000", 2024-09-13T06:40:38.708 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3290000000000001e-06 2024-09-13T06:40:38.708 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:38.708 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:38.708 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:38.709 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664771+0000", 2024-09-13T06:40:38.709 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.1319999999999999e-06 2024-09-13T06:40:38.709 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:38.709 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:38.709 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:38.709 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664776+0000", 2024-09-13T06:40:38.709 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.8840000000000002e-06 2024-09-13T06:40:38.709 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:38.709 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:38.709 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:38.709 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.788598+0000", 2024-09-13T06:40:38.709 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123821979 2024-09-13T06:40:38.710 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:38.710 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:38.710 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:38.710 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.788680+0000", 2024-09-13T06:40:38.710 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.2367999999999995e-05 2024-09-13T06:40:38.710 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:38.710 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:38.710 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:38.710 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.788946+0000", 2024-09-13T06:40:38.710 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00026629799999999999 2024-09-13T06:40:38.710 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:38.710 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:38.710 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:38.710 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:38.711 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:38.711 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43265 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 477184~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:40:38.711 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.669414+0000", 2024-09-13T06:40:38.711 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 16.967033365999999, 2024-09-13T06:40:38.711 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123446973, 2024-09-13T06:40:38.711 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:38.711 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:38.711 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:38.711 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:38.711 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:38.711 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43265 2024-09-13T06:40:38.711 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:38.711 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:38.711 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:38.712 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:38.712 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669414+0000", 2024-09-13T06:40:38.712 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:38.712 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:38.712 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:38.712 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:38.712 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669414+0000", 2024-09-13T06:40:38.712 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:38.712 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:38.712 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:38.712 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:38.712 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669414+0000", 2024-09-13T06:40:38.713 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:38.713 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:38.713 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:38.713 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:38.713 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669416+0000", 2024-09-13T06:40:38.713 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.317e-06 2024-09-13T06:40:38.713 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:38.713 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:38.713 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:38.713 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669425+0000", 2024-09-13T06:40:38.713 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.0650000000000005e-06 2024-09-13T06:40:38.713 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:38.713 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:38.713 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:38.714 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669430+0000", 2024-09-13T06:40:38.714 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5079999999999999e-06 2024-09-13T06:40:38.714 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:38.714 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:38.714 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:38.714 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.792649+0000", 2024-09-13T06:40:38.714 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123219328 2024-09-13T06:40:38.714 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:38.714 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:38.714 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:38.714 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.792695+0000", 2024-09-13T06:40:38.714 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5476999999999998e-05 2024-09-13T06:40:38.714 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:38.714 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:38.715 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:38.715 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.792861+0000", 2024-09-13T06:40:38.715 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00016658999999999999 2024-09-13T06:40:38.715 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:38.715 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:38.715 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:38.715 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:38.715 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:38.715 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43266 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 491520~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:40:38.715 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.669434+0000", 2024-09-13T06:40:38.715 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 16.967013244, 2024-09-13T06:40:38.715 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123685267, 2024-09-13T06:40:38.715 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:38.715 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:38.716 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:38.716 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:38.716 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:38.716 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43266 2024-09-13T06:40:38.716 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:38.716 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:38.716 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:38.716 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:38.716 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669434+0000", 2024-09-13T06:40:38.716 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:38.716 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:38.716 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:38.716 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:38.717 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669434+0000", 2024-09-13T06:40:38.717 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:38.717 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:38.717 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:38.717 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:38.717 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669434+0000", 2024-09-13T06:40:38.717 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:38.717 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:38.717 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:38.717 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:38.717 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669441+0000", 2024-09-13T06:40:38.717 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3019999999999997e-06 2024-09-13T06:40:38.717 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:38.717 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:38.718 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:38.718 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669451+0000", 2024-09-13T06:40:38.718 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.6379999999999999e-06 2024-09-13T06:40:38.718 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:38.718 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:38.718 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:38.718 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669456+0000", 2024-09-13T06:40:38.718 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.361e-06 2024-09-13T06:40:38.718 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:38.718 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:38.718 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:38.718 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.792879+0000", 2024-09-13T06:40:38.718 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123422686 2024-09-13T06:40:38.718 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:38.719 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:38.719 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:38.719 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.792923+0000", 2024-09-13T06:40:38.719 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4035000000000001e-05 2024-09-13T06:40:38.719 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:38.719 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:38.719 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:38.719 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.793120+0000", 2024-09-13T06:40:38.719 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00019660899999999999 2024-09-13T06:40:38.719 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:38.719 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:38.719 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:38.719 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:38.720 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:38.720 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43267 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 505856~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:40:38.720 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.669461+0000", 2024-09-13T06:40:38.720 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 16.966986448, 2024-09-13T06:40:38.720 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123933711, 2024-09-13T06:40:38.720 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:38.720 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:38.720 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:38.720 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:38.720 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:38.720 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43267 2024-09-13T06:40:38.720 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:38.720 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:38.720 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:38.721 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:38.721 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669461+0000", 2024-09-13T06:40:38.721 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:38.721 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:38.721 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:38.721 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:38.721 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669461+0000", 2024-09-13T06:40:38.721 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:38.721 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:38.721 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:38.721 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:38.721 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669461+0000", 2024-09-13T06:40:38.721 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:38.722 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:38.722 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:38.722 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:38.722 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669463+0000", 2024-09-13T06:40:38.722 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5629999999999999e-06 2024-09-13T06:40:38.722 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:38.722 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:38.722 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:38.722 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669473+0000", 2024-09-13T06:40:38.722 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.9520000000000006e-06 2024-09-13T06:40:38.722 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:38.722 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:38.722 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:38.722 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669479+0000", 2024-09-13T06:40:38.723 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8540000000000002e-06 2024-09-13T06:40:38.723 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:38.723 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:38.723 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:38.723 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.793137+0000", 2024-09-13T06:40:38.723 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.12365825699999999 2024-09-13T06:40:38.723 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:38.723 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:38.723 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:38.723 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.793181+0000", 2024-09-13T06:40:38.723 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.3773999999999998e-05 2024-09-13T06:40:38.723 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:38.723 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:38.724 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:38.724 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.793395+0000", 2024-09-13T06:40:38.724 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00021372399999999999 2024-09-13T06:40:38.724 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:38.724 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:38.724 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:38.724 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:38.724 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:38.724 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43268 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 520192~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:40:38.724 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.669484+0000", 2024-09-13T06:40:38.724 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 16.966963663000001, 2024-09-13T06:40:38.724 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.12441057899999999, 2024-09-13T06:40:38.724 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:38.725 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:38.725 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:38.725 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:38.725 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:38.725 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43268 2024-09-13T06:40:38.725 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:38.725 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:38.725 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:38.725 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:38.725 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669484+0000", 2024-09-13T06:40:38.725 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:38.725 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:38.725 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:38.725 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:38.726 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669484+0000", 2024-09-13T06:40:38.726 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:38.728 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:38.728 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:38.728 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:38.728 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669484+0000", 2024-09-13T06:40:38.729 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:38.729 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:38.729 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:38.729 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:38.729 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669486+0000", 2024-09-13T06:40:38.729 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6120000000000001e-06 2024-09-13T06:40:38.729 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:38.729 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:38.729 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:38.729 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669494+0000", 2024-09-13T06:40:38.729 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4819999999999997e-06 2024-09-13T06:40:38.729 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:38.729 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:38.729 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:38.730 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669497+0000", 2024-09-13T06:40:38.730 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9790000000000002e-06 2024-09-13T06:40:38.730 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:38.730 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:38.730 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:38.730 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.793559+0000", 2024-09-13T06:40:38.730 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.124062436 2024-09-13T06:40:38.730 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:38.730 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:38.730 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:38.730 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.793603+0000", 2024-09-13T06:40:38.730 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.3764999999999999e-05 2024-09-13T06:40:38.730 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:38.731 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:38.731 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:38.731 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.793895+0000", 2024-09-13T06:40:38.731 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00029168299999999999 2024-09-13T06:40:38.731 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:38.731 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:38.731 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:38.731 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:38.731 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:38.731 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:40:38.733 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-13T06:40:38.734 INFO:teuthology.orchestra.run.smithi081.stdout:2301 write 0xee35999 thru 0xee3d960 (0x7fc8 bytes) 2024-09-13T06:40:38.734 INFO:teuthology.orchestra.run.smithi081.stdout:2303 read 0x93c2ee2 thru 0x93c53df (0x24fe bytes) 2024-09-13T06:40:38.734 INFO:teuthology.orchestra.run.smithi081.stdout:2304 writesame 0x6855929 thru 0x6857384 data_size 0xe(0x1a5c bytes) 2024-09-13T06:40:38.734 INFO:teuthology.orchestra.run.smithi081.stdout:2305 trunc from 0xee3d961 to 0xd2844fa 2024-09-13T06:40:38.734 INFO:teuthology.orchestra.run.smithi081.stdout:2306 trunc from 0xd2844fa to 0x3b1ecc5 2024-09-13T06:40:38.734 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:40:38.729+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:40:38.752 INFO:teuthology.orchestra.run.smithi081.stdout:2307 trunc from 0x3b1ecc5 to 0xcd33ecb 2024-09-13T06:40:38.764 INFO:teuthology.orchestra.run.smithi081.stdout:2308 write 0x1ea2a46 thru 0x1ea6182 (0x373d bytes) 2024-09-13T06:40:38.770 INFO:teuthology.orchestra.run.smithi081.stdout:2310 write 0x64f368c thru 0x64fde74 (0xa7e9 bytes) 2024-09-13T06:40:38.777 INFO:teuthology.orchestra.run.smithi081.stdout:2312 read 0xaa4d272 thru 0xaa59e6e (0xcbfd bytes) 2024-09-13T06:40:38.777 INFO:teuthology.orchestra.run.smithi081.stdout:2313 write 0x15437c thru 0x15f2e2 (0xaf67 bytes) 2024-09-13T06:40:38.779 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:40:38.791 INFO:teuthology.orchestra.run.smithi081.stdout:2317 trunc from 0xcd33ecb to 0x5570815 2024-09-13T06:40:38.809 INFO:teuthology.orchestra.run.smithi081.stdout:2318 read 0x2c8c3df thru 0x2c9a43c (0xe05e bytes) 2024-09-13T06:40:38.809 INFO:teuthology.orchestra.run.smithi081.stdout:2320 read 0xd07b5f thru 0xd0b246 (0x36e8 bytes) 2024-09-13T06:40:38.810 INFO:teuthology.orchestra.run.smithi081.stdout:2321 trunc from 0x5570815 to 0x4f2d40f 2024-09-13T06:40:38.818 INFO:teuthology.orchestra.run.smithi081.stdout:2322 read 0x63aca8 thru 0x63d09e (0x23f7 bytes) 2024-09-13T06:40:38.819 INFO:teuthology.orchestra.run.smithi081.stdout:2323 punch from 0x2c7091b to 0x2c78d8f, (0x8474 bytes) 2024-09-13T06:40:38.819 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:40:38.831 INFO:teuthology.orchestra.run.smithi081.stdout:2325 write 0x75a18c8 thru 0x75b0290 (0xe9c9 bytes) 2024-09-13T06:40:38.833 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:40:38.836+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:40:38.838 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:40:38.838 INFO:teuthology.orchestra.run.smithi081.stdout:2329 write 0x5c53ebe thru 0x5c580e9 (0x422c bytes) 2024-09-13T06:40:38.844 INFO:teuthology.orchestra.run.smithi081.stdout:2330 write 0x5690c86 thru 0x569ef6c (0xe2e7 bytes) 2024-09-13T06:40:38.849 INFO:teuthology.orchestra.run.smithi081.stdout:2331 write 0x6b91819 thru 0x6b96117 (0x48ff bytes) 2024-09-13T06:40:38.854 INFO:teuthology.orchestra.run.smithi081.stdout:2332 write 0x4838103 thru 0x48417d7 (0x96d5 bytes) 2024-09-13T06:40:38.862 INFO:teuthology.orchestra.run.smithi081.stdout:2333 read 0x26f8031 thru 0x26fcfd0 (0x4fa0 bytes) 2024-09-13T06:40:38.862 INFO:teuthology.orchestra.run.smithi081.stdout:2334 read 0xfa5124 thru 0xfaa9f3 (0x58d0 bytes) 2024-09-13T06:40:38.863 INFO:teuthology.orchestra.run.smithi081.stdout:2335 read 0x10ffbfc thru 0x1108e35 (0x923a bytes) 2024-09-13T06:40:38.864 INFO:teuthology.orchestra.run.smithi081.stdout:2337 writesame 0x500b389 thru 0x501b09a data_size 0x1d(0xfd12 bytes) 2024-09-13T06:40:38.871 INFO:teuthology.orchestra.run.smithi081.stdout:2338 write 0x5eaed6b thru 0x5eb9bda (0xae70 bytes) 2024-09-13T06:40:38.878 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:40:38.878 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:40:38.880 INFO:teuthology.orchestra.run.smithi081.stdout:2341 trunc from 0x75b0291 to 0x5fe837c 2024-09-13T06:40:38.888 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:40:38.888 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-13T06:40:38.889 INFO:teuthology.orchestra.run.smithi081.stdout: "num_ops": 0 2024-09-13T06:40:38.889 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:40:38.907 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-13T06:40:38.918 INFO:teuthology.orchestra.run.smithi081.stdout:2342 write 0xb39622e thru 0xb3a1859 (0xb62c bytes) 2024-09-13T06:40:38.923 INFO:teuthology.orchestra.run.smithi081.stdout:2343 punch from 0x555a695 to 0x55631f2, (0x8b5d bytes) 2024-09-13T06:40:38.923 INFO:teuthology.orchestra.run.smithi081.stdout:2344 read 0xa00b1b4 thru 0xa0185a6 (0xd3f3 bytes) 2024-09-13T06:40:38.923 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:40:38.923 INFO:teuthology.orchestra.run.smithi081.stdout:2346 write 0x22ff9c6 thru 0x2303872 (0x3ead bytes) 2024-09-13T06:40:38.937 INFO:teuthology.orchestra.run.smithi081.stdout:2348 write 0x140d2e8 thru 0x141572e (0x8447 bytes) 2024-09-13T06:40:38.937 INFO:teuthology.orchestra.run.smithi081.stdout:2349 punch from 0x847eb80 to 0x84849b4, (0x5e34 bytes) 2024-09-13T06:40:38.937 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:40:38.937 INFO:teuthology.orchestra.run.smithi081.stdout:2352 writesame 0x1be5112 thru 0x1be83bf data_size 0xd(0x32ae bytes) 2024-09-13T06:40:38.938 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:40:38.940+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:40:38.940 INFO:teuthology.orchestra.run.smithi081.stdout:2353 read 0x7016f72 thru 0x701f448 (0x84d7 bytes) 2024-09-13T06:40:38.940 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:40:38.940 INFO:teuthology.orchestra.run.smithi081.stdout:2355 punch from 0x510d2ad to 0x511b106, (0xde59 bytes) 2024-09-13T06:40:38.941 INFO:teuthology.orchestra.run.smithi081.stdout:2356 write 0x1e29e9c thru 0x1e2d9b2 (0x3b17 bytes) 2024-09-13T06:40:38.944 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:40:38.945 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:40:38.945 INFO:teuthology.orchestra.run.smithi081.stdout:2361 punch from 0x8ef5e6b to 0x8efa321, (0x44b6 bytes) 2024-09-13T06:40:38.946 INFO:teuthology.orchestra.run.smithi081.stdout:2362 trunc from 0xb3a185a to 0xc0c7ca1 2024-09-13T06:40:38.954 INFO:teuthology.orchestra.run.smithi081.stdout:2364 punch from 0xae8cc9e to 0xae9c859, (0xfbbb bytes) 2024-09-13T06:40:38.954 INFO:teuthology.orchestra.run.smithi081.stdout:2365 punch from 0x43d8293 to 0x43dce0d, (0x4b7a bytes) 2024-09-13T06:40:38.954 INFO:teuthology.orchestra.run.smithi081.stdout:2366 read 0x18d6d4a thru 0x18d724c (0x503 bytes) 2024-09-13T06:40:38.954 INFO:teuthology.orchestra.run.smithi081.stdout:2367 read 0x47b506b thru 0x47c08c5 (0xb85b bytes) 2024-09-13T06:40:38.955 INFO:teuthology.orchestra.run.smithi081.stdout:2370 write 0x748076a thru 0x7481ab9 (0x1350 bytes) 2024-09-13T06:40:38.960 INFO:teuthology.orchestra.run.smithi081.stdout:2371 clone 14 order 19 su 16384 sc 11 2024-09-13T06:40:39.039 INFO:tasks.ceph.osd.6.smithi139.stderr:2024-09-13T06:40:39.037+0000 7fcd02c5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26385) UID: 0 2024-09-13T06:40:39.042 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:40:39.042 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-13T06:40:39.042 INFO:teuthology.orchestra.run.smithi081.stdout: "complaint_time": 30, 2024-09-13T06:40:39.043 INFO:teuthology.orchestra.run.smithi081.stdout: "num_blocked_ops": 0 2024-09-13T06:40:39.043 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:40:39.056 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-13T06:40:39.140 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:40:39.141+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:40:39.222 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:40:39.222 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 20, 2024-09-13T06:40:39.222 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 600, 2024-09-13T06:40:39.222 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [ 2024-09-13T06:40:39.223 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.223 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:21979 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 14217216~4096 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:40:39.223 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.888811+0000", 2024-09-13T06:40:39.223 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 46.335188782000003, 2024-09-13T06:40:39.223 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049092969, 2024-09-13T06:40:39.223 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:39.223 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:39.223 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:39.223 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:39.223 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:39.223 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 21979 2024-09-13T06:40:39.223 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.224 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:39.224 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.224 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:39.224 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888811+0000", 2024-09-13T06:40:39.224 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:39.224 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.224 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.224 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:39.224 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888811+0000", 2024-09-13T06:40:39.224 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:39.224 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.224 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.224 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:39.225 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888811+0000", 2024-09-13T06:40:39.225 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:40:39.225 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.225 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.225 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:39.225 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888812+0000", 2024-09-13T06:40:39.225 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.204e-06 2024-09-13T06:40:39.225 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.225 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.225 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:39.225 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888815+0000", 2024-09-13T06:40:39.226 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9359999999999999e-06 2024-09-13T06:40:39.226 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.226 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.226 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:39.226 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888818+0000", 2024-09-13T06:40:39.226 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.7369999999999998e-06 2024-09-13T06:40:39.226 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.226 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.226 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:39.226 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.937663+0000", 2024-09-13T06:40:39.226 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.048844540999999998 2024-09-13T06:40:39.226 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.226 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.227 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:39.227 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.937709+0000", 2024-09-13T06:40:39.227 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6492999999999997e-05 2024-09-13T06:40:39.227 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.227 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.227 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:39.227 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.937904+0000", 2024-09-13T06:40:39.227 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00019526499999999999 2024-09-13T06:40:39.227 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:39.227 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:39.227 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:39.227 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.227 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.228 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:21980 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 14245888~4096 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:40:39.228 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.888820+0000", 2024-09-13T06:40:39.228 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 46.335180104999999, 2024-09-13T06:40:39.228 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049357080999999997, 2024-09-13T06:40:39.228 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:39.228 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:39.228 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:39.228 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:39.228 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:39.228 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 21980 2024-09-13T06:40:39.228 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.228 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:39.229 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.229 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:39.229 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888820+0000", 2024-09-13T06:40:39.229 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:39.229 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.229 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.229 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:39.229 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888820+0000", 2024-09-13T06:40:39.229 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:39.229 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.229 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.229 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:39.230 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888820+0000", 2024-09-13T06:40:39.230 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:40:39.230 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.230 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.230 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:39.230 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888821+0000", 2024-09-13T06:40:39.230 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.122e-06 2024-09-13T06:40:39.230 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.230 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.230 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:39.231 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888824+0000", 2024-09-13T06:40:39.231 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.0580000000000002e-06 2024-09-13T06:40:39.231 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.231 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.231 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:39.231 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888827+0000", 2024-09-13T06:40:39.231 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.666e-06 2024-09-13T06:40:39.231 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.231 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.231 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:39.231 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.937935+0000", 2024-09-13T06:40:39.231 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049108329999999999 2024-09-13T06:40:39.232 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.232 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.232 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:39.232 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.937985+0000", 2024-09-13T06:40:39.232 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9694000000000002e-05 2024-09-13T06:40:39.232 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.232 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.232 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:39.232 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.938177+0000", 2024-09-13T06:40:39.233 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00019241899999999999 2024-09-13T06:40:39.233 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:39.233 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:39.233 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:39.233 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.233 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.233 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:21984 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:snapdir [list-snaps] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:40:39.233 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.888829+0000", 2024-09-13T06:40:39.234 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 46.335171326999998, 2024-09-13T06:40:39.234 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049524545000000003, 2024-09-13T06:40:39.234 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:39.234 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:39.234 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:39.234 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:39.234 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:39.234 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 21984 2024-09-13T06:40:39.234 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.234 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:39.234 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.235 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:39.235 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888829+0000", 2024-09-13T06:40:39.235 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:39.235 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.235 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.235 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:39.235 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888829+0000", 2024-09-13T06:40:39.235 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:39.235 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.235 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.235 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:39.235 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888829+0000", 2024-09-13T06:40:39.236 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:40:39.236 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.236 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.236 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:39.236 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888830+0000", 2024-09-13T06:40:39.236 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2529999999999999e-06 2024-09-13T06:40:39.236 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.236 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.236 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:39.236 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888835+0000", 2024-09-13T06:40:39.236 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.4729999999999999e-06 2024-09-13T06:40:39.236 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.236 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.237 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:39.237 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888840+0000", 2024-09-13T06:40:39.237 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0159999999999999e-06 2024-09-13T06:40:39.237 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.237 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.237 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:39.237 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.938199+0000", 2024-09-13T06:40:39.237 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049358974999999999 2024-09-13T06:40:39.237 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.237 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.237 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:39.237 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.938268+0000", 2024-09-13T06:40:39.238 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.8876999999999998e-05 2024-09-13T06:40:39.238 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.238 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.238 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:39.238 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.938353+0000", 2024-09-13T06:40:39.238 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.5155999999999996e-05 2024-09-13T06:40:39.238 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:39.238 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:39.238 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:39.238 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.238 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.239 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:21985 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 12587008~4096 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:40:39.239 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.888858+0000", 2024-09-13T06:40:39.239 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 46.335142177000002, 2024-09-13T06:40:39.239 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049674347000000001, 2024-09-13T06:40:39.239 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:39.239 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:39.239 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:39.239 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:39.239 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:39.239 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 21985 2024-09-13T06:40:39.239 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.239 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:39.239 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.240 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:39.240 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888858+0000", 2024-09-13T06:40:39.240 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:39.240 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.240 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.240 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:39.240 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888858+0000", 2024-09-13T06:40:39.240 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:39.240 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.240 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.240 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:39.240 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888857+0000", 2024-09-13T06:40:39.240 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:39.241 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.241 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.241 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:39.241 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888860+0000", 2024-09-13T06:40:39.241 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4739999999999999e-06 2024-09-13T06:40:39.241 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.241 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.241 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:39.241 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888867+0000", 2024-09-13T06:40:39.242 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.7170000000000002e-06 2024-09-13T06:40:39.242 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.242 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.242 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:39.242 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888871+0000", 2024-09-13T06:40:39.242 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5120000000000002e-06 2024-09-13T06:40:39.242 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.242 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.242 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:39.242 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.938389+0000", 2024-09-13T06:40:39.242 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049517717000000003 2024-09-13T06:40:39.242 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.243 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.243 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:39.243 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.938449+0000", 2024-09-13T06:40:39.243 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0513999999999997e-05 2024-09-13T06:40:39.243 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.243 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.243 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:39.243 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.938532+0000", 2024-09-13T06:40:39.243 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.2936999999999996e-05 2024-09-13T06:40:39.243 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:39.243 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:39.243 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:39.243 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.244 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.244 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:21986 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 12615680~4096 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:40:39.244 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.888875+0000", 2024-09-13T06:40:39.244 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 46.335124663999999, 2024-09-13T06:40:39.244 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049881781, 2024-09-13T06:40:39.244 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:39.244 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:39.244 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:39.244 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:39.244 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:39.245 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 21986 2024-09-13T06:40:39.245 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.245 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:39.245 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.245 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:39.245 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888875+0000", 2024-09-13T06:40:39.245 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:39.245 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.245 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.245 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:39.245 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888875+0000", 2024-09-13T06:40:39.246 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:39.246 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.246 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.246 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:39.246 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888875+0000", 2024-09-13T06:40:39.246 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:39.246 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.246 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.246 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:39.246 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888880+0000", 2024-09-13T06:40:39.246 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7600000000000002e-06 2024-09-13T06:40:39.246 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.247 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.247 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:39.247 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888887+0000", 2024-09-13T06:40:39.247 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3950000000000003e-06 2024-09-13T06:40:39.247 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.247 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.247 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:39.247 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888892+0000", 2024-09-13T06:40:39.247 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0409999999999997e-06 2024-09-13T06:40:39.247 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.248 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.248 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:39.248 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.938568+0000", 2024-09-13T06:40:39.248 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049675267000000002 2024-09-13T06:40:39.248 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.248 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.248 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:39.248 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.938653+0000", 2024-09-13T06:40:39.248 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.5792999999999997e-05 2024-09-13T06:40:39.248 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.248 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.248 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:39.249 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.938757+0000", 2024-09-13T06:40:39.249 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00010387699999999999 2024-09-13T06:40:39.249 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:39.249 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:39.249 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:39.249 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.249 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.249 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:21987 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 12644352~4096 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:40:39.249 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.888899+0000", 2024-09-13T06:40:39.249 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 46.335101318, 2024-09-13T06:40:39.250 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.050094056999999997, 2024-09-13T06:40:39.250 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:39.250 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:39.250 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:39.250 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:39.250 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:39.250 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 21987 2024-09-13T06:40:39.250 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.250 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:39.250 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.250 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:39.250 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888899+0000", 2024-09-13T06:40:39.250 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:39.250 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.251 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.251 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:39.251 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888899+0000", 2024-09-13T06:40:39.251 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:39.251 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.251 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.251 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:39.251 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888899+0000", 2024-09-13T06:40:39.251 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:39.251 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.251 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.251 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:39.252 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888901+0000", 2024-09-13T06:40:39.252 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2539999999999999e-06 2024-09-13T06:40:39.252 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.252 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.252 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:39.252 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888907+0000", 2024-09-13T06:40:39.252 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9009999999999999e-06 2024-09-13T06:40:39.252 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.252 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.252 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:39.252 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888912+0000", 2024-09-13T06:40:39.253 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9840000000000001e-06 2024-09-13T06:40:39.253 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.253 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.253 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:39.253 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.938810+0000", 2024-09-13T06:40:39.253 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049898835000000002 2024-09-13T06:40:39.253 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.253 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.253 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:39.253 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.938890+0000", 2024-09-13T06:40:39.253 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.9215000000000006e-05 2024-09-13T06:40:39.253 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.253 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.253 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:39.254 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.938993+0000", 2024-09-13T06:40:39.254 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000103194 2024-09-13T06:40:39.254 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:39.254 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:39.254 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:39.254 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.254 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.254 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:21988 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 12673024~4096 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:40:39.254 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.888916+0000", 2024-09-13T06:40:39.254 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 46.335084301999999, 2024-09-13T06:40:39.254 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.050203036999999999, 2024-09-13T06:40:39.254 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:39.254 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:39.255 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:39.255 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:39.255 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:39.255 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 21988 2024-09-13T06:40:39.255 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.255 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:39.255 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.255 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:39.255 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888916+0000", 2024-09-13T06:40:39.255 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:39.255 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.255 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.256 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:39.256 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888916+0000", 2024-09-13T06:40:39.256 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:39.256 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.256 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.256 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:39.256 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888915+0000", 2024-09-13T06:40:39.256 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:39.256 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.256 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.256 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:39.256 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888918+0000", 2024-09-13T06:40:39.256 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1500000000000002e-06 2024-09-13T06:40:39.257 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.257 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.257 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:39.257 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888925+0000", 2024-09-13T06:40:39.257 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.9380000000000003e-06 2024-09-13T06:40:39.257 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.257 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.257 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:39.257 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888933+0000", 2024-09-13T06:40:39.257 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.0560000000000005e-06 2024-09-13T06:40:39.257 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.257 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.257 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:39.257 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.939026+0000", 2024-09-13T06:40:39.258 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.050093499999999999 2024-09-13T06:40:39.258 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.258 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.258 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:39.258 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.939068+0000", 2024-09-13T06:40:39.258 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.1705999999999997e-05 2024-09-13T06:40:39.258 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.258 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.258 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:39.258 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.939119+0000", 2024-09-13T06:40:39.258 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.1048999999999999e-05 2024-09-13T06:40:39.259 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:39.259 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:39.259 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:39.259 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.259 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.259 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:21989 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 12701696~4096 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:40:39.259 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.888938+0000", 2024-09-13T06:40:39.259 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 46.335061975000002, 2024-09-13T06:40:39.259 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.050294393999999999, 2024-09-13T06:40:39.259 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:39.259 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:39.259 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:39.259 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:39.260 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:39.260 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 21989 2024-09-13T06:40:39.260 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.260 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:39.260 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.260 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:39.260 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888938+0000", 2024-09-13T06:40:39.260 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:39.260 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.260 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.260 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:39.261 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888938+0000", 2024-09-13T06:40:39.261 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:39.261 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.261 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.261 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:39.261 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888938+0000", 2024-09-13T06:40:39.261 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:39.261 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.261 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.261 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:39.261 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888940+0000", 2024-09-13T06:40:39.262 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5330000000000001e-06 2024-09-13T06:40:39.262 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.262 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.262 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:39.262 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888947+0000", 2024-09-13T06:40:39.262 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.2389999999999999e-06 2024-09-13T06:40:39.262 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.262 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.262 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:39.262 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888952+0000", 2024-09-13T06:40:39.262 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.5720000000000002e-06 2024-09-13T06:40:39.262 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.263 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.263 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:39.263 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.939141+0000", 2024-09-13T06:40:39.263 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.050188903999999999 2024-09-13T06:40:39.263 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.264 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.264 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:39.264 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.939182+0000", 2024-09-13T06:40:39.264 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.0926000000000001e-05 2024-09-13T06:40:39.264 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.264 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.264 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:39.264 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.939233+0000", 2024-09-13T06:40:39.264 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0532999999999999e-05 2024-09-13T06:40:39.264 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:39.264 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:39.264 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:39.265 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.265 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.265 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:22006 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 13189120~4096 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:40:39.265 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.892763+0000", 2024-09-13T06:40:39.265 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 46.331237449, 2024-09-13T06:40:39.265 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.048963505999999997, 2024-09-13T06:40:39.265 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:39.265 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:39.265 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:39.266 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:39.266 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:39.266 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 22006 2024-09-13T06:40:39.266 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.266 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:39.266 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.266 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:39.266 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892763+0000", 2024-09-13T06:40:39.266 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:39.266 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.266 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.266 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:39.266 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892763+0000", 2024-09-13T06:40:39.267 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:39.267 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.267 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.267 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:39.267 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892763+0000", 2024-09-13T06:40:39.267 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:40:39.267 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.267 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.267 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:39.267 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892764+0000", 2024-09-13T06:40:39.267 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2410000000000001e-06 2024-09-13T06:40:39.268 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.268 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.268 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:39.268 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892767+0000", 2024-09-13T06:40:39.268 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9390000000000002e-06 2024-09-13T06:40:39.268 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.268 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.268 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:39.268 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892769+0000", 2024-09-13T06:40:39.268 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5390000000000002e-06 2024-09-13T06:40:39.268 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.269 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.269 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:39.269 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.941560+0000", 2024-09-13T06:40:39.269 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.048791221000000003 2024-09-13T06:40:39.269 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.269 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.269 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:39.269 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.941632+0000", 2024-09-13T06:40:39.269 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.1932000000000002e-05 2024-09-13T06:40:39.269 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.269 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.270 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:39.270 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.941726+0000", 2024-09-13T06:40:39.270 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.3839999999999996e-05 2024-09-13T06:40:39.270 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:39.270 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:39.270 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:39.270 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.270 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.270 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:22007 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 13217792~4096 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:40:39.270 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.892771+0000", 2024-09-13T06:40:39.270 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 46.331228869, 2024-09-13T06:40:39.270 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049090024000000003, 2024-09-13T06:40:39.270 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:39.271 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:39.271 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:39.271 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:39.271 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:39.271 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 22007 2024-09-13T06:40:39.271 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.271 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:39.271 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.271 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:39.271 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892771+0000", 2024-09-13T06:40:39.271 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:39.271 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.272 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.272 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:39.272 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892771+0000", 2024-09-13T06:40:39.272 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:39.272 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.272 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.272 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:39.272 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892771+0000", 2024-09-13T06:40:39.272 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:40:39.272 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.273 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.273 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:39.273 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892772+0000", 2024-09-13T06:40:39.273 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.184e-06 2024-09-13T06:40:39.273 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.273 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.273 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:39.273 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892775+0000", 2024-09-13T06:40:39.273 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9179999999999998e-06 2024-09-13T06:40:39.273 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.273 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.274 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:39.274 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892778+0000", 2024-09-13T06:40:39.274 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4990000000000001e-06 2024-09-13T06:40:39.274 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.274 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.274 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:39.274 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.941760+0000", 2024-09-13T06:40:39.274 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.048982070000000003 2024-09-13T06:40:39.274 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.274 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.274 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:39.275 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.941808+0000", 2024-09-13T06:40:39.275 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.8278000000000001e-05 2024-09-13T06:40:39.275 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.275 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.275 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:39.275 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.941861+0000", 2024-09-13T06:40:39.275 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3284e-05 2024-09-13T06:40:39.275 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:39.275 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:39.275 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:39.275 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.275 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.275 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:22008 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 13246464~4096 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:40:39.276 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.892780+0000", 2024-09-13T06:40:39.276 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 46.331220211999998, 2024-09-13T06:40:39.276 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049200477999999999, 2024-09-13T06:40:39.276 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:39.276 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:39.276 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:39.276 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:39.276 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:39.276 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 22008 2024-09-13T06:40:39.276 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.276 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:39.276 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.276 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:39.277 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892780+0000", 2024-09-13T06:40:39.277 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:39.277 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.277 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.277 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:39.277 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892780+0000", 2024-09-13T06:40:39.277 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:39.277 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.277 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.277 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:39.277 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892780+0000", 2024-09-13T06:40:39.277 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:40:39.277 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.278 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.278 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:39.278 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892781+0000", 2024-09-13T06:40:39.278 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.083e-06 2024-09-13T06:40:39.278 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.278 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.278 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:39.278 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892784+0000", 2024-09-13T06:40:39.278 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.926e-06 2024-09-13T06:40:39.278 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.278 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.279 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:39.279 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892786+0000", 2024-09-13T06:40:39.279 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4490000000000002e-06 2024-09-13T06:40:39.279 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.279 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.279 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:39.279 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.941888+0000", 2024-09-13T06:40:39.279 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049102290999999999 2024-09-13T06:40:39.279 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.279 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.279 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:39.279 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.941929+0000", 2024-09-13T06:40:39.280 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.0541999999999999e-05 2024-09-13T06:40:39.280 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.280 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.280 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:39.280 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.941980+0000", 2024-09-13T06:40:39.280 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.1391999999999999e-05 2024-09-13T06:40:39.280 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:39.280 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:39.280 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:39.280 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.280 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.281 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:22009 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 13275136~4096 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:40:39.281 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.892788+0000", 2024-09-13T06:40:39.281 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 46.331211728, 2024-09-13T06:40:39.281 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049311926999999998, 2024-09-13T06:40:39.281 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:39.281 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:39.281 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:39.281 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:39.281 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:39.281 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 22009 2024-09-13T06:40:39.281 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.282 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:39.282 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.282 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:39.282 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892788+0000", 2024-09-13T06:40:39.282 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:39.282 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.282 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.282 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:39.282 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892788+0000", 2024-09-13T06:40:39.282 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:39.282 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.282 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.282 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:39.283 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892788+0000", 2024-09-13T06:40:39.283 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:40:39.283 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.283 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.283 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:39.283 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892789+0000", 2024-09-13T06:40:39.283 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1850000000000001e-06 2024-09-13T06:40:39.283 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.283 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.283 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:39.283 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892793+0000", 2024-09-13T06:40:39.283 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.9099999999999998e-06 2024-09-13T06:40:39.284 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.284 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.284 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:39.284 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892798+0000", 2024-09-13T06:40:39.284 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5070000000000002e-06 2024-09-13T06:40:39.284 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.284 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.284 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:39.284 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.942007+0000", 2024-09-13T06:40:39.284 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049208904999999997 2024-09-13T06:40:39.284 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.285 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.285 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:39.285 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.942049+0000", 2024-09-13T06:40:39.285 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.1922000000000003e-05 2024-09-13T06:40:39.285 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.285 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.285 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:39.285 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.942100+0000", 2024-09-13T06:40:39.285 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.1736000000000001e-05 2024-09-13T06:40:39.285 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:39.286 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:39.286 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:39.286 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.286 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.286 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:22010 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 13303808~4096 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:40:39.286 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.892817+0000", 2024-09-13T06:40:39.286 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 46.331183531999997, 2024-09-13T06:40:39.286 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049466149000000001, 2024-09-13T06:40:39.286 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:39.286 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:39.286 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:39.286 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:39.287 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:39.287 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 22010 2024-09-13T06:40:39.287 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.287 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:39.287 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.287 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:39.287 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892817+0000", 2024-09-13T06:40:39.287 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:39.287 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.287 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.288 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:39.288 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892817+0000", 2024-09-13T06:40:39.288 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:39.288 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.288 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.288 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:39.288 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892816+0000", 2024-09-13T06:40:39.288 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:39.288 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.288 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.288 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:39.289 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892821+0000", 2024-09-13T06:40:39.289 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9459999999999997e-06 2024-09-13T06:40:39.289 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.289 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.289 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:39.289 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892828+0000", 2024-09-13T06:40:39.289 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.6780000000000003e-06 2024-09-13T06:40:39.289 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.289 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.289 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:39.289 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892833+0000", 2024-09-13T06:40:39.290 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.8389999999999997e-06 2024-09-13T06:40:39.290 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.290 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.290 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:39.290 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.942127+0000", 2024-09-13T06:40:39.290 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049294163000000002 2024-09-13T06:40:39.290 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.290 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.290 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:39.291 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.942186+0000", 2024-09-13T06:40:39.291 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9335e-05 2024-09-13T06:40:39.291 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.291 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.291 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:39.291 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.942283+0000", 2024-09-13T06:40:39.291 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.6699000000000004e-05 2024-09-13T06:40:39.291 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:39.291 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:39.291 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:39.291 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.291 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.292 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:22011 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 13332480~4096 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:40:39.292 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.892838+0000", 2024-09-13T06:40:39.292 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 46.331161844999997, 2024-09-13T06:40:39.292 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049589214, 2024-09-13T06:40:39.292 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:39.292 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:39.292 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:39.292 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:39.292 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:39.293 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 22011 2024-09-13T06:40:39.293 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.293 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:39.293 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.293 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:39.293 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892838+0000", 2024-09-13T06:40:39.293 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:39.293 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.293 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.293 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:39.293 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892838+0000", 2024-09-13T06:40:39.293 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:39.294 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.294 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.294 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:39.294 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892838+0000", 2024-09-13T06:40:39.294 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:39.294 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.294 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.294 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:39.294 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892840+0000", 2024-09-13T06:40:39.294 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.136e-06 2024-09-13T06:40:39.294 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.294 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.295 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:39.295 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892852+0000", 2024-09-13T06:40:39.295 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2122e-05 2024-09-13T06:40:39.295 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.295 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.295 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:39.295 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892862+0000", 2024-09-13T06:40:39.295 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.7049999999999994e-06 2024-09-13T06:40:39.295 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.295 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.295 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:39.295 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.942319+0000", 2024-09-13T06:40:39.295 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049456623999999998 2024-09-13T06:40:39.295 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.296 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.296 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:39.296 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.942363+0000", 2024-09-13T06:40:39.296 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4759000000000003e-05 2024-09-13T06:40:39.296 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.296 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.296 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:39.296 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.942428+0000", 2024-09-13T06:40:39.296 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.4221999999999996e-05 2024-09-13T06:40:39.296 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:39.296 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:39.296 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:39.297 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.297 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.297 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:22033 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 13963264~4096 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:40:39.297 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.896824+0000", 2024-09-13T06:40:39.297 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 46.327175951999997, 2024-09-13T06:40:39.297 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049051957, 2024-09-13T06:40:39.297 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:39.297 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:39.297 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:39.297 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:39.297 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:39.297 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 22033 2024-09-13T06:40:39.297 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.297 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:39.298 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.298 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:39.298 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.896824+0000", 2024-09-13T06:40:39.298 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:39.298 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.298 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.298 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:39.298 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.896824+0000", 2024-09-13T06:40:39.299 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:39.299 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.299 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.299 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:39.299 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.896824+0000", 2024-09-13T06:40:39.299 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:39.299 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.299 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.299 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:39.299 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.896826+0000", 2024-09-13T06:40:39.299 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1900000000000002e-06 2024-09-13T06:40:39.300 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.300 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.300 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:39.300 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.896832+0000", 2024-09-13T06:40:39.300 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.2689999999999996e-06 2024-09-13T06:40:39.300 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.300 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.300 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:39.300 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.896840+0000", 2024-09-13T06:40:39.301 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3289999999999996e-06 2024-09-13T06:40:39.301 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.301 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.301 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:39.301 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.945777+0000", 2024-09-13T06:40:39.301 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.048937188 2024-09-13T06:40:39.301 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.301 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.301 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:39.301 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.945822+0000", 2024-09-13T06:40:39.302 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4780999999999997e-05 2024-09-13T06:40:39.302 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.302 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.302 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:39.302 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.945876+0000", 2024-09-13T06:40:39.302 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.4542000000000001e-05 2024-09-13T06:40:39.302 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:39.302 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:39.302 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:39.302 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.303 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.303 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:22337 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 13582336~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:40:39.303 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.951039+0000", 2024-09-13T06:40:39.303 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 46.272961615, 2024-09-13T06:40:39.303 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.048942765999999999, 2024-09-13T06:40:39.303 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:39.303 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:39.303 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:39.303 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:39.303 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:39.304 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 22337 2024-09-13T06:40:39.304 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.304 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:39.304 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.304 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:39.304 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951039+0000", 2024-09-13T06:40:39.304 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:39.304 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.304 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.305 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:39.305 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951039+0000", 2024-09-13T06:40:39.305 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:39.305 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.305 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.305 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:39.305 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951038+0000", 2024-09-13T06:40:39.305 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:39.306 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.306 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.306 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:39.306 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951040+0000", 2024-09-13T06:40:39.306 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0669999999999999e-06 2024-09-13T06:40:39.306 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.306 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.306 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:39.306 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951048+0000", 2024-09-13T06:40:39.306 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.588e-06 2024-09-13T06:40:39.307 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.307 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.307 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:39.307 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951053+0000", 2024-09-13T06:40:39.307 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3669999999999996e-06 2024-09-13T06:40:39.307 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.307 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.307 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:39.307 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.999889+0000", 2024-09-13T06:40:39.307 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.048835515000000003 2024-09-13T06:40:39.307 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.307 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.308 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:39.308 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.999929+0000", 2024-09-13T06:40:39.308 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.0030000000000001e-05 2024-09-13T06:40:39.308 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.308 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.308 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:39.308 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.999981+0000", 2024-09-13T06:40:39.308 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2583999999999997e-05 2024-09-13T06:40:39.308 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:39.308 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:39.308 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:39.308 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.309 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.309 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:22338 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 13611008~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:40:39.309 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.951070+0000", 2024-09-13T06:40:39.309 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 46.272930324000001, 2024-09-13T06:40:39.309 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049135817999999998, 2024-09-13T06:40:39.309 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:39.309 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:39.309 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:39.309 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:39.309 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:39.309 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 22338 2024-09-13T06:40:39.309 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.309 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:39.310 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.310 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:39.310 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951070+0000", 2024-09-13T06:40:39.310 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:39.310 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.310 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.310 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:39.310 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951070+0000", 2024-09-13T06:40:39.310 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:39.310 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.310 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.310 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:39.310 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951069+0000", 2024-09-13T06:40:39.311 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:39.311 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.311 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.311 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:39.311 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951072+0000", 2024-09-13T06:40:39.311 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5909999999999998e-06 2024-09-13T06:40:39.311 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.311 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.311 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:39.311 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951078+0000", 2024-09-13T06:40:39.311 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.4450000000000001e-06 2024-09-13T06:40:39.311 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.311 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.311 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:39.312 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951083+0000", 2024-09-13T06:40:39.312 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7790000000000003e-06 2024-09-13T06:40:39.312 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.312 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.312 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:39.312 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:53.000020+0000", 2024-09-13T06:40:39.312 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.048936999000000002 2024-09-13T06:40:39.312 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.312 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.312 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:39.313 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:53.000106+0000", 2024-09-13T06:40:39.313 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.5532999999999996e-05 2024-09-13T06:40:39.313 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.313 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.313 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:39.313 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:53.000206+0000", 2024-09-13T06:40:39.313 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.9852999999999994e-05 2024-09-13T06:40:39.313 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:39.313 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:39.313 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:39.313 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.314 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.314 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:22339 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 13639680~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:40:39.314 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.951088+0000", 2024-09-13T06:40:39.314 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 46.272912626, 2024-09-13T06:40:39.314 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049238202000000002, 2024-09-13T06:40:39.314 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:39.314 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:39.314 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:39.314 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:39.314 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:39.314 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 22339 2024-09-13T06:40:39.314 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.314 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:39.315 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.315 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:39.315 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951088+0000", 2024-09-13T06:40:39.315 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:39.315 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.315 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.315 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:39.315 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951088+0000", 2024-09-13T06:40:39.315 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:39.315 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.315 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.316 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:39.316 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951087+0000", 2024-09-13T06:40:39.316 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:39.316 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.316 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.316 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:39.316 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951089+0000", 2024-09-13T06:40:39.316 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.153e-06 2024-09-13T06:40:39.316 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.316 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.316 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:39.317 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951093+0000", 2024-09-13T06:40:39.317 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.7120000000000002e-06 2024-09-13T06:40:39.317 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.317 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.317 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:39.317 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951096+0000", 2024-09-13T06:40:39.317 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.0570000000000001e-06 2024-09-13T06:40:39.317 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.317 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.317 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:39.318 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:53.000220+0000", 2024-09-13T06:40:39.318 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049123989 2024-09-13T06:40:39.318 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.318 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.318 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:39.318 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:53.000271+0000", 2024-09-13T06:40:39.318 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.062e-05 2024-09-13T06:40:39.318 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.318 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.318 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:39.319 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:53.000326+0000", 2024-09-13T06:40:39.319 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.5121000000000003e-05 2024-09-13T06:40:39.319 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:39.319 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:39.319 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:39.319 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.319 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.319 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:22340 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 13668352~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:40:39.319 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.951200+0000", 2024-09-13T06:40:39.319 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 46.272799737, 2024-09-13T06:40:39.320 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049352350000000003, 2024-09-13T06:40:39.320 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:39.320 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:39.320 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:39.320 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:39.320 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:39.320 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 22340 2024-09-13T06:40:39.320 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.320 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:39.321 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.321 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:39.321 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951200+0000", 2024-09-13T06:40:39.321 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:39.321 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.321 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.321 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:39.321 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951200+0000", 2024-09-13T06:40:39.321 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:39.322 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.322 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.322 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:39.322 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951098+0000", 2024-09-13T06:40:39.322 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.999898 2024-09-13T06:40:39.322 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.322 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.322 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:39.322 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951204+0000", 2024-09-13T06:40:39.322 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000105398 2024-09-13T06:40:39.322 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.323 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.323 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:39.323 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951211+0000", 2024-09-13T06:40:39.323 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.43e-06 2024-09-13T06:40:39.323 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.323 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.323 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:39.323 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951216+0000", 2024-09-13T06:40:39.323 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2800000000000003e-06 2024-09-13T06:40:39.323 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.323 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.324 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:39.324 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:53.000358+0000", 2024-09-13T06:40:39.324 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049142036 2024-09-13T06:40:39.324 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.324 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.324 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:39.324 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:53.000443+0000", 2024-09-13T06:40:39.324 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.4710999999999996e-05 2024-09-13T06:40:39.324 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.324 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.324 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:39.325 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:53.000553+0000", 2024-09-13T06:40:39.325 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000109622 2024-09-13T06:40:39.325 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:39.325 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:39.325 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:39.325 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.325 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.325 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:22348 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 13897728~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:40:39.325 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.952783+0000", 2024-09-13T06:40:39.325 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 46.271216948999999, 2024-09-13T06:40:39.325 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049120832000000003, 2024-09-13T06:40:39.325 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:39.325 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:39.326 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:39.326 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:39.326 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:39.326 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 22348 2024-09-13T06:40:39.326 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.326 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:39.326 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.326 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:39.326 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.952783+0000", 2024-09-13T06:40:39.326 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:39.326 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.326 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.326 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:39.327 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.952783+0000", 2024-09-13T06:40:39.327 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:39.327 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.327 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.327 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:39.327 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.952783+0000", 2024-09-13T06:40:39.327 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:39.327 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.327 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.327 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:39.327 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.952785+0000", 2024-09-13T06:40:39.327 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4980000000000001e-06 2024-09-13T06:40:39.327 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.328 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.328 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:39.328 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.952799+0000", 2024-09-13T06:40:39.328 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3825000000000001e-05 2024-09-13T06:40:39.328 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.328 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.328 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:39.328 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.952809+0000", 2024-09-13T06:40:39.328 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0043e-05 2024-09-13T06:40:39.328 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.328 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.328 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:39.328 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:53.001723+0000", 2024-09-13T06:40:39.328 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.048914065 2024-09-13T06:40:39.329 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.329 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.329 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:39.329 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:53.001807+0000", 2024-09-13T06:40:39.329 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.3776000000000006e-05 2024-09-13T06:40:39.329 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.329 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.329 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:39.329 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:53.001904+0000", 2024-09-13T06:40:39.329 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.7004999999999997e-05 2024-09-13T06:40:39.329 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:39.329 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:39.329 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:39.330 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:39.330 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:39.330 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:40:39.331 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-13T06:40:39.332 INFO:tasks.ceph.osd.6.smithi139.stderr:2024-09-13T06:40:39.329+0000 7fcd02c5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26385) UID: 0 2024-09-13T06:40:39.432 INFO:tasks.ceph.osd.6.smithi139.stderr:2024-09-13T06:40:39.429+0000 7fcd02c5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26385) UID: 0 2024-09-13T06:40:39.467 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:40:39.467 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-13T06:40:39.467 INFO:teuthology.orchestra.run.smithi081.stdout: "num_ops": 0 2024-09-13T06:40:39.468 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:40:39.482 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-13T06:40:39.534 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:40:39.533+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:40:39.605 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:40:39.605 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-13T06:40:39.605 INFO:teuthology.orchestra.run.smithi081.stdout: "complaint_time": 30, 2024-09-13T06:40:39.605 INFO:teuthology.orchestra.run.smithi081.stdout: "num_blocked_ops": 0 2024-09-13T06:40:39.605 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:40:39.620 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-13T06:40:39.665 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:40:39.668+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:40:39.736 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:40:39.736+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:40:39.746 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:40:39.746 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 20, 2024-09-13T06:40:39.746 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 600, 2024-09-13T06:40:39.746 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [ 2024-09-13T06:40:39.746 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.746 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:36160 3.f 3:f62782c2:::rbd_object_map.11219660270d.0000000000000016:head [call] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-13T06:40:39.746 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:01.607291+0000", 2024-09-13T06:40:39.746 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 38.138809252000001, 2024-09-13T06:40:39.747 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.99619456699999998, 2024-09-13T06:40:39.747 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:39.747 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:39.747 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:39.747 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:39.747 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:39.747 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 36160 2024-09-13T06:40:39.747 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.747 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:39.747 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.747 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:39.747 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:01.607291+0000", 2024-09-13T06:40:39.747 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:39.748 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.748 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.748 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:39.748 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:01.607291+0000", 2024-09-13T06:40:39.748 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:39.748 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.748 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.748 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:39.748 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:01.607289+0000", 2024-09-13T06:40:39.748 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999976 2024-09-13T06:40:39.748 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.748 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.748 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:39.749 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:01.607302+0000", 2024-09-13T06:40:39.749 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3018e-05 2024-09-13T06:40:39.749 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.749 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.749 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:39.749 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:01.607323+0000", 2024-09-13T06:40:39.752 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1030999999999999e-05 2024-09-13T06:40:39.753 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.753 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.753 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:39.753 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:01.607342+0000", 2024-09-13T06:40:39.753 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8961e-05 2024-09-13T06:40:39.753 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.753 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.753 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:39.753 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:01.607425+0000", 2024-09-13T06:40:39.753 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.3171999999999996e-05 2024-09-13T06:40:39.753 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.753 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.754 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:40:39.754 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:01.607441+0000", 2024-09-13T06:40:39.754 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5996999999999999e-05 2024-09-13T06:40:39.754 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.754 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.754 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:39.754 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:02.596186+0000", 2024-09-13T06:40:39.754 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.98874432000000001 2024-09-13T06:40:39.754 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.754 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.754 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for missing object", 2024-09-13T06:40:39.754 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:02.596618+0000", 2024-09-13T06:40:39.754 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000432032 2024-09-13T06:40:39.754 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.755 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.755 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:39.755 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:02.600845+0000", 2024-09-13T06:40:39.755 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0042277410000000001 2024-09-13T06:40:39.755 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.755 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.755 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:39.755 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:02.601003+0000", 2024-09-13T06:40:39.755 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00015731999999999999 2024-09-13T06:40:39.755 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.755 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.755 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:39.755 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:02.603486+0000", 2024-09-13T06:40:39.756 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0024832510000000001 2024-09-13T06:40:39.756 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:39.756 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:39.756 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:39.756 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.756 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.756 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:37806 3.9 3:951cb95b:::rbd_data.1121d8143c6e.0000000000000002:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e56)", 2024-09-13T06:40:39.756 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:06.373482+0000", 2024-09-13T06:40:39.756 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 33.372618215999999, 2024-09-13T06:40:39.756 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.002476213, 2024-09-13T06:40:39.756 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:39.756 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:39.756 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:39.757 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:39.757 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:39.757 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 37806 2024-09-13T06:40:39.757 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.757 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:39.757 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.757 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:39.757 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.373482+0000", 2024-09-13T06:40:39.757 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:39.757 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.757 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.757 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:39.758 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.373482+0000", 2024-09-13T06:40:39.758 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:39.758 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.758 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.758 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:39.758 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.373479+0000", 2024-09-13T06:40:39.758 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999962 2024-09-13T06:40:39.758 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.758 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.758 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:39.758 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.373495+0000", 2024-09-13T06:40:39.758 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6640999999999999e-05 2024-09-13T06:40:39.758 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.758 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.759 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:39.759 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.373542+0000", 2024-09-13T06:40:39.759 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6229000000000001e-05 2024-09-13T06:40:39.759 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.759 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.759 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:39.759 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.373564+0000", 2024-09-13T06:40:39.759 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2684000000000002e-05 2024-09-13T06:40:39.759 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.759 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.759 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:39.759 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374268+0000", 2024-09-13T06:40:39.759 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00070363700000000001 2024-09-13T06:40:39.760 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.760 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.760 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:40:39.760 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374305+0000", 2024-09-13T06:40:39.760 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.6936e-05 2024-09-13T06:40:39.760 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.760 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.760 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:39.760 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.375175+0000", 2024-09-13T06:40:39.760 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.000870454 2024-09-13T06:40:39.760 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.760 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.760 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:39.761 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.375678+0000", 2024-09-13T06:40:39.761 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00050292499999999999 2024-09-13T06:40:39.761 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.761 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.761 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:39.761 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.375959+0000", 2024-09-13T06:40:39.761 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00028050599999999997 2024-09-13T06:40:39.761 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:39.761 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:39.761 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:39.761 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.761 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.761 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:37821 3.9 3:951cb95b:::rbd_data.1121d8143c6e.0000000000000002:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e56)", 2024-09-13T06:40:39.762 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:06.374454+0000", 2024-09-13T06:40:39.762 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 33.371647099, 2024-09-13T06:40:39.762 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.002545072, 2024-09-13T06:40:39.762 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:39.762 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:39.762 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:39.762 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:39.762 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:39.762 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 37821 2024-09-13T06:40:39.762 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.762 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:39.762 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.763 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:39.763 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374454+0000", 2024-09-13T06:40:39.763 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:39.763 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.763 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.763 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:39.763 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374454+0000", 2024-09-13T06:40:39.763 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:39.763 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.763 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.763 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:39.763 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374452+0000", 2024-09-13T06:40:39.763 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999981 2024-09-13T06:40:39.764 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.764 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.764 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:39.764 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374463+0000", 2024-09-13T06:40:39.764 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0756e-05 2024-09-13T06:40:39.764 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.764 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.764 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:39.764 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374487+0000", 2024-09-13T06:40:39.764 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4887000000000001e-05 2024-09-13T06:40:39.764 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.764 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.764 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:39.765 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374504+0000", 2024-09-13T06:40:39.765 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6852000000000001e-05 2024-09-13T06:40:39.765 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.765 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.765 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:39.765 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374829+0000", 2024-09-13T06:40:39.765 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000324684 2024-09-13T06:40:39.765 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.765 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.765 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:40:39.765 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374880+0000", 2024-09-13T06:40:39.765 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.1378000000000002e-05 2024-09-13T06:40:39.765 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.766 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.766 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:39.766 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.376423+0000", 2024-09-13T06:40:39.766 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.001542734 2024-09-13T06:40:39.766 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.766 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.766 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:39.766 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.376607+0000", 2024-09-13T06:40:39.766 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000183656 2024-09-13T06:40:39.766 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.766 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.766 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:39.766 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.376999+0000", 2024-09-13T06:40:39.767 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00039191200000000001 2024-09-13T06:40:39.767 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:39.767 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:39.767 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:39.767 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.767 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.767 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:37836 3.9 3:951cb95b:::rbd_data.1121d8143c6e.0000000000000002:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e56)", 2024-09-13T06:40:39.767 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:06.374929+0000", 2024-09-13T06:40:39.767 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 33.371171447000002, 2024-09-13T06:40:39.767 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.002778825, 2024-09-13T06:40:39.767 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:39.767 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:39.767 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:39.768 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:39.768 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:39.768 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 37836 2024-09-13T06:40:39.768 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.768 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:39.768 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.768 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:39.768 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374929+0000", 2024-09-13T06:40:39.768 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:39.768 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.768 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.768 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:39.768 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374929+0000", 2024-09-13T06:40:39.769 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:39.769 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.769 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.769 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:39.769 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374927+0000", 2024-09-13T06:40:39.769 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999981 2024-09-13T06:40:39.769 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.769 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.769 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:39.769 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374939+0000", 2024-09-13T06:40:39.769 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1846e-05 2024-09-13T06:40:39.769 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.770 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.770 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:39.770 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374962+0000", 2024-09-13T06:40:39.770 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3054e-05 2024-09-13T06:40:39.770 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.770 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.770 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:39.770 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374978+0000", 2024-09-13T06:40:39.770 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5899000000000001e-05 2024-09-13T06:40:39.770 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.770 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.770 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:39.770 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.375106+0000", 2024-09-13T06:40:39.770 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00012789 2024-09-13T06:40:39.771 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.771 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.771 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:40:39.771 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.375134+0000", 2024-09-13T06:40:39.771 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.8254000000000001e-05 2024-09-13T06:40:39.771 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.771 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.771 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:39.771 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.377082+0000", 2024-09-13T06:40:39.771 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0019471520000001 2024-09-13T06:40:39.771 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.771 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.771 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:39.771 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.377330+0000", 2024-09-13T06:40:39.772 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00024834199999999997 2024-09-13T06:40:39.772 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.772 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.772 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:39.772 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.377708+0000", 2024-09-13T06:40:39.772 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00037817100000000001 2024-09-13T06:40:39.772 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:39.772 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:39.772 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:39.772 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.772 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.772 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:37851 3.9 3:951cb95b:::rbd_data.1121d8143c6e.0000000000000002:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e56)", 2024-09-13T06:40:39.773 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:06.382636+0000", 2024-09-13T06:40:39.773 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 33.363464561999997, 2024-09-13T06:40:39.773 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.99582539400000003, 2024-09-13T06:40:39.773 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:39.773 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:39.773 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:39.773 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:39.773 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:39.773 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 37851 2024-09-13T06:40:39.773 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.773 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:39.773 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.773 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:39.773 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.382636+0000", 2024-09-13T06:40:39.774 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:39.774 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.774 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.774 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:39.774 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.382636+0000", 2024-09-13T06:40:39.774 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:39.774 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.774 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.774 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:39.774 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.382633+0000", 2024-09-13T06:40:39.774 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999971 2024-09-13T06:40:39.774 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.774 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.775 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:39.775 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.382652+0000", 2024-09-13T06:40:39.775 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8834999999999998e-05 2024-09-13T06:40:39.775 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.775 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.775 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:39.775 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.382695+0000", 2024-09-13T06:40:39.775 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.3136000000000002e-05 2024-09-13T06:40:39.775 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.775 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.775 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:39.775 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.382716+0000", 2024-09-13T06:40:39.775 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1421e-05 2024-09-13T06:40:39.775 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.776 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.776 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:39.776 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.382860+0000", 2024-09-13T06:40:39.776 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00014389200000000001 2024-09-13T06:40:39.776 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.776 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.776 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:40:39.776 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.382890+0000", 2024-09-13T06:40:39.776 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9827000000000001e-05 2024-09-13T06:40:39.776 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.776 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.776 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:39.776 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.377779+0000", 2024-09-13T06:40:39.777 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.99488842899999996 2024-09-13T06:40:39.777 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.777 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.777 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:39.777 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.378007+0000", 2024-09-13T06:40:39.777 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00022838099999999999 2024-09-13T06:40:39.777 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.777 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.777 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:39.777 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.378462+0000", 2024-09-13T06:40:39.777 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00045452300000000003 2024-09-13T06:40:39.777 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:39.777 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:39.778 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:39.778 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.778 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.778 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:37866 3.9 3:951cb95b:::rbd_data.1121d8143c6e.0000000000000002:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e56)", 2024-09-13T06:40:39.778 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:06.383951+0000", 2024-09-13T06:40:39.778 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 33.362149875999997, 2024-09-13T06:40:39.778 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.99517962299999996, 2024-09-13T06:40:39.778 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:39.778 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:39.778 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:39.778 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:39.778 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:39.778 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 37866 2024-09-13T06:40:39.778 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.779 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:39.779 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.779 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:39.779 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.383951+0000", 2024-09-13T06:40:39.779 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:39.779 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.779 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.779 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:39.779 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.383951+0000", 2024-09-13T06:40:39.779 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:39.779 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.779 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.779 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:39.780 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.383949+0000", 2024-09-13T06:40:39.780 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999981 2024-09-13T06:40:39.780 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.780 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.780 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:39.780 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.383961+0000", 2024-09-13T06:40:39.780 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1999e-05 2024-09-13T06:40:39.780 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.780 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.780 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:39.780 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384019+0000", 2024-09-13T06:40:39.780 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7621000000000003e-05 2024-09-13T06:40:39.780 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.780 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.781 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:39.781 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384040+0000", 2024-09-13T06:40:39.781 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1528000000000001e-05 2024-09-13T06:40:39.781 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.781 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.781 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:39.781 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384186+0000", 2024-09-13T06:40:39.781 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00014573799999999999 2024-09-13T06:40:39.781 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.781 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.781 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:40:39.781 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384204+0000", 2024-09-13T06:40:39.781 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7992e-05 2024-09-13T06:40:39.782 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.782 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.782 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:39.782 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.378536+0000", 2024-09-13T06:40:39.782 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.99433268600000002 2024-09-13T06:40:39.782 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.782 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.782 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:39.782 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.378771+0000", 2024-09-13T06:40:39.782 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00023445399999999999 2024-09-13T06:40:39.782 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.782 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.782 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:39.782 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.379130+0000", 2024-09-13T06:40:39.783 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00035954200000000002 2024-09-13T06:40:39.783 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:39.783 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:39.783 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:39.783 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.783 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.783 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:37881 3.9 3:951cb95b:::rbd_data.1121d8143c6e.0000000000000002:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e56)", 2024-09-13T06:40:39.783 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:06.384239+0000", 2024-09-13T06:40:39.783 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 33.361861462, 2024-09-13T06:40:39.783 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.99541483500000005, 2024-09-13T06:40:39.783 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:39.783 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:39.783 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:39.783 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:39.784 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:39.784 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 37881 2024-09-13T06:40:39.784 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.784 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:39.784 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.784 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:39.784 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384239+0000", 2024-09-13T06:40:39.784 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:39.784 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.784 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.784 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:39.784 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384239+0000", 2024-09-13T06:40:39.784 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:39.785 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.785 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.785 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:39.785 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384238+0000", 2024-09-13T06:40:39.785 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999986 2024-09-13T06:40:39.785 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.785 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.785 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:39.785 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384246+0000", 2024-09-13T06:40:39.785 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.2449999999999998e-06 2024-09-13T06:40:39.785 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.785 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.785 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:39.786 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384268+0000", 2024-09-13T06:40:39.786 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1518e-05 2024-09-13T06:40:39.786 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.786 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.786 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:39.786 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384282+0000", 2024-09-13T06:40:39.786 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4501999999999999e-05 2024-09-13T06:40:39.786 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.786 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.786 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:39.786 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384356+0000", 2024-09-13T06:40:39.786 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4265999999999997e-05 2024-09-13T06:40:39.786 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.787 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.787 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:40:39.787 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384370+0000", 2024-09-13T06:40:39.787 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3942e-05 2024-09-13T06:40:39.787 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.787 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.787 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:39.787 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.379199+0000", 2024-09-13T06:40:39.787 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.99482866599999997 2024-09-13T06:40:39.787 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.787 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.787 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:39.787 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.379347+0000", 2024-09-13T06:40:39.787 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00014749199999999999 2024-09-13T06:40:39.788 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.788 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.788 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:39.788 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.379654+0000", 2024-09-13T06:40:39.788 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00030752999999999998 2024-09-13T06:40:39.788 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:39.788 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:39.788 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:39.788 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.788 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.788 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:37896 3.9 3:951cb95b:::rbd_data.1121d8143c6e.0000000000000002:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e56)", 2024-09-13T06:40:39.788 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:06.384412+0000", 2024-09-13T06:40:39.788 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 33.361689028999997, 2024-09-13T06:40:39.788 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.99777835999999998, 2024-09-13T06:40:39.789 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:39.789 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:39.789 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:39.789 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:39.789 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:39.789 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 37896 2024-09-13T06:40:39.789 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.789 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:39.789 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.789 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:39.789 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384412+0000", 2024-09-13T06:40:39.789 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:39.789 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.789 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.790 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:39.790 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384412+0000", 2024-09-13T06:40:39.790 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:39.790 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.790 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.790 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:39.790 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384410+0000", 2024-09-13T06:40:39.790 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.999999 2024-09-13T06:40:39.790 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.790 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.790 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:39.790 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384418+0000", 2024-09-13T06:40:39.790 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.486e-06 2024-09-13T06:40:39.791 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.791 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.791 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:39.791 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384436+0000", 2024-09-13T06:40:39.791 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7668000000000001e-05 2024-09-13T06:40:39.791 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.791 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.791 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:39.791 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384449+0000", 2024-09-13T06:40:39.791 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3395e-05 2024-09-13T06:40:39.791 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.791 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.791 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:39.791 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384605+0000", 2024-09-13T06:40:39.791 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00015563099999999999 2024-09-13T06:40:39.792 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.792 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.792 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:40:39.792 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384635+0000", 2024-09-13T06:40:39.792 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.0383999999999999e-05 2024-09-13T06:40:39.792 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.792 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.792 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:39.792 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.379730+0000", 2024-09-13T06:40:39.792 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.99509493999999998 2024-09-13T06:40:39.792 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.792 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.792 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:39.793 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.379964+0000", 2024-09-13T06:40:39.793 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00023353499999999999 2024-09-13T06:40:39.793 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.793 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.793 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:39.793 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.382190+0000", 2024-09-13T06:40:39.793 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0022265039999999998 2024-09-13T06:40:39.793 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:39.793 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:39.793 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:39.793 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.793 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.793 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43222 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 389120~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:40:39.794 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558181+0000", 2024-09-13T06:40:39.794 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 18.187919775000001, 2024-09-13T06:40:39.794 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.06252038, 2024-09-13T06:40:39.794 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:39.794 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:39.794 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:39.794 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:39.794 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:39.794 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43222 2024-09-13T06:40:39.794 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.794 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:39.794 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.794 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:39.795 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558181+0000", 2024-09-13T06:40:39.795 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:39.795 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.795 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.795 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:39.795 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558181+0000", 2024-09-13T06:40:39.795 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:39.795 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.795 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.795 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:39.795 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558181+0000", 2024-09-13T06:40:39.795 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:39.795 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.795 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.796 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:39.796 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558183+0000", 2024-09-13T06:40:39.796 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.857e-06 2024-09-13T06:40:39.796 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.796 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.796 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:39.796 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558188+0000", 2024-09-13T06:40:39.796 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3759999999999999e-06 2024-09-13T06:40:39.796 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.796 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.796 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:39.796 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558261+0000", 2024-09-13T06:40:39.796 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3097999999999997e-05 2024-09-13T06:40:39.797 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.797 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.797 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:39.797 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.620354+0000", 2024-09-13T06:40:39.797 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.062092587999999997 2024-09-13T06:40:39.797 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.797 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.797 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:39.797 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.620428+0000", 2024-09-13T06:40:39.797 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3954000000000004e-05 2024-09-13T06:40:39.797 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.797 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.797 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:39.798 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.620701+0000", 2024-09-13T06:40:39.798 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000273773 2024-09-13T06:40:39.798 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:39.798 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:39.798 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:39.798 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.798 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.798 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43223 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 393216~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:40:39.798 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558267+0000", 2024-09-13T06:40:39.798 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 18.187833718, 2024-09-13T06:40:39.798 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.062813151999999997, 2024-09-13T06:40:39.798 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:39.798 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:39.799 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:39.799 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:39.799 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:39.799 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43223 2024-09-13T06:40:39.799 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.799 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:39.799 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.799 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:39.799 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558267+0000", 2024-09-13T06:40:39.799 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:39.799 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.799 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.799 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:39.799 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558267+0000", 2024-09-13T06:40:39.800 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:39.800 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.800 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.800 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:39.800 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558266+0000", 2024-09-13T06:40:39.800 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:39.800 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.800 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.800 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:39.800 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558270+0000", 2024-09-13T06:40:39.800 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.2389999999999998e-06 2024-09-13T06:40:39.800 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.800 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.801 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:39.801 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558277+0000", 2024-09-13T06:40:39.801 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5680000000000002e-06 2024-09-13T06:40:39.801 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.801 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.801 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:39.801 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558282+0000", 2024-09-13T06:40:39.801 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7060000000000003e-06 2024-09-13T06:40:39.801 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.801 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.801 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:39.801 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.620731+0000", 2024-09-13T06:40:39.801 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.062448661000000003 2024-09-13T06:40:39.802 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.802 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.802 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:39.802 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.620806+0000", 2024-09-13T06:40:39.802 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5862e-05 2024-09-13T06:40:39.802 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.802 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.802 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:39.802 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.621080+0000", 2024-09-13T06:40:39.802 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00027368599999999998 2024-09-13T06:40:39.802 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:39.802 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:39.802 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:39.803 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.803 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.803 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43224 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 407552~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:40:39.803 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558286+0000", 2024-09-13T06:40:39.803 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 18.187814354, 2024-09-13T06:40:39.803 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.063179052999999999, 2024-09-13T06:40:39.803 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:39.803 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:39.803 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:39.803 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:39.803 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:39.803 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43224 2024-09-13T06:40:39.803 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.803 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:39.804 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.804 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:39.804 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558286+0000", 2024-09-13T06:40:39.804 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:39.804 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.804 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.804 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:39.804 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558286+0000", 2024-09-13T06:40:39.804 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:39.804 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.804 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.804 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:39.804 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558286+0000", 2024-09-13T06:40:39.804 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:39.805 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.805 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.805 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:39.805 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558288+0000", 2024-09-13T06:40:39.805 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.227e-06 2024-09-13T06:40:39.805 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.805 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.805 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:39.805 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558292+0000", 2024-09-13T06:40:39.805 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.6289999999999999e-06 2024-09-13T06:40:39.805 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.805 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.805 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:39.805 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558294+0000", 2024-09-13T06:40:39.806 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5409999999999999e-06 2024-09-13T06:40:39.806 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.806 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.806 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:39.806 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.621110+0000", 2024-09-13T06:40:39.806 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.062815776000000004 2024-09-13T06:40:39.806 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.806 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.806 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:39.806 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.621186+0000", 2024-09-13T06:40:39.806 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5570999999999999e-05 2024-09-13T06:40:39.806 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.806 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.806 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:39.807 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.621465+0000", 2024-09-13T06:40:39.807 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00027988200000000001 2024-09-13T06:40:39.807 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:39.807 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:39.807 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:39.807 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.807 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.807 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43225 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 421888~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:40:39.807 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558296+0000", 2024-09-13T06:40:39.808 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 18.187804387, 2024-09-13T06:40:39.808 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.063551110999999993, 2024-09-13T06:40:39.808 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:39.808 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:39.808 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:39.808 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:39.808 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:39.808 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43225 2024-09-13T06:40:39.808 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.808 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:39.808 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.808 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:39.808 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558296+0000", 2024-09-13T06:40:39.809 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:39.809 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.809 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.809 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:39.809 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558296+0000", 2024-09-13T06:40:39.809 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:39.809 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.809 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.809 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:39.809 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558296+0000", 2024-09-13T06:40:39.809 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:40:39.809 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.809 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.810 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:39.810 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558305+0000", 2024-09-13T06:40:39.810 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.5290000000000008e-06 2024-09-13T06:40:39.810 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.810 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.810 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:39.810 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558308+0000", 2024-09-13T06:40:39.810 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.5619999999999999e-06 2024-09-13T06:40:39.810 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.810 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.810 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:39.810 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558311+0000", 2024-09-13T06:40:39.810 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.43e-06 2024-09-13T06:40:39.811 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.811 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.811 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:39.811 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.621495+0000", 2024-09-13T06:40:39.811 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.063184289000000005 2024-09-13T06:40:39.811 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.811 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.811 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:39.811 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.621569+0000", 2024-09-13T06:40:39.811 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4250000000000002e-05 2024-09-13T06:40:39.811 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.811 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.811 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:39.811 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.621847+0000", 2024-09-13T06:40:39.812 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00027826400000000002 2024-09-13T06:40:39.812 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:39.812 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:39.812 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:39.812 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.812 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.812 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43226 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 436224~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:40:39.812 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558313+0000", 2024-09-13T06:40:39.812 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 18.187787750999998, 2024-09-13T06:40:39.812 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.063914420999999999, 2024-09-13T06:40:39.812 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:39.812 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:39.812 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:39.813 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:39.813 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:39.813 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43226 2024-09-13T06:40:39.813 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.813 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:39.813 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.813 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:39.813 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558313+0000", 2024-09-13T06:40:39.813 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:39.813 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.813 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.813 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:39.813 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558313+0000", 2024-09-13T06:40:39.813 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:39.814 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.814 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.814 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:39.814 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558313+0000", 2024-09-13T06:40:39.814 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:39.814 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.814 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.814 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:39.814 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558314+0000", 2024-09-13T06:40:39.814 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3740000000000001e-06 2024-09-13T06:40:39.814 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.814 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.814 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:39.814 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558317+0000", 2024-09-13T06:40:39.815 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9730000000000002e-06 2024-09-13T06:40:39.815 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.815 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.815 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:39.815 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558319+0000", 2024-09-13T06:40:39.815 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4059999999999999e-06 2024-09-13T06:40:39.815 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.815 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.815 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:39.815 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.621877+0000", 2024-09-13T06:40:39.815 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.063557408999999995 2024-09-13T06:40:39.815 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.815 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.816 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:39.816 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.621951+0000", 2024-09-13T06:40:39.816 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4487999999999996e-05 2024-09-13T06:40:39.816 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.816 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.816 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:39.816 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.622227+0000", 2024-09-13T06:40:39.816 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000276011 2024-09-13T06:40:39.816 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:39.816 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:39.816 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:39.816 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.816 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.816 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43227 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 450560~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:40:39.817 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558322+0000", 2024-09-13T06:40:39.817 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 18.187779169999999, 2024-09-13T06:40:39.817 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.064285348000000006, 2024-09-13T06:40:39.817 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:39.817 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:39.817 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:39.817 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:39.817 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:39.817 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43227 2024-09-13T06:40:39.817 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.817 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:39.817 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.817 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:39.818 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558322+0000", 2024-09-13T06:40:39.818 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:39.818 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.818 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.818 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:39.818 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558322+0000", 2024-09-13T06:40:39.818 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:39.818 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.818 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.818 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:39.818 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558321+0000", 2024-09-13T06:40:39.818 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:40:39.818 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.818 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.819 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:39.819 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558323+0000", 2024-09-13T06:40:39.819 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.576e-06 2024-09-13T06:40:39.819 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.819 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.819 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:39.819 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558328+0000", 2024-09-13T06:40:39.819 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0719999999999999e-06 2024-09-13T06:40:39.819 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.819 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.819 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:39.819 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558332+0000", 2024-09-13T06:40:39.819 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.8130000000000002e-06 2024-09-13T06:40:39.819 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.820 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.820 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:39.820 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.622255+0000", 2024-09-13T06:40:39.820 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.063923195000000002 2024-09-13T06:40:39.820 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.820 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.820 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:39.820 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.622330+0000", 2024-09-13T06:40:39.820 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5383000000000007e-05 2024-09-13T06:40:39.820 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.820 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.820 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:39.820 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.622607+0000", 2024-09-13T06:40:39.820 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00027651999999999999 2024-09-13T06:40:39.821 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:39.821 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:39.821 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:39.821 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.821 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.821 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43228 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 464896~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:40:39.821 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558335+0000", 2024-09-13T06:40:39.821 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 18.187765260999999, 2024-09-13T06:40:39.821 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.064652253000000007, 2024-09-13T06:40:39.821 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:39.821 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:39.821 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:39.821 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:39.821 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:39.822 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43228 2024-09-13T06:40:39.822 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.822 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:39.822 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.822 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:39.822 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558335+0000", 2024-09-13T06:40:39.822 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:39.822 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.822 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.822 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:39.822 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558335+0000", 2024-09-13T06:40:39.822 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:39.823 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.823 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.823 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:39.823 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558335+0000", 2024-09-13T06:40:39.823 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:39.823 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.824 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.824 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:39.824 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558337+0000", 2024-09-13T06:40:39.824 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1380000000000001e-06 2024-09-13T06:40:39.824 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.824 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.824 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:39.824 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558343+0000", 2024-09-13T06:40:39.824 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.5140000000000001e-06 2024-09-13T06:40:39.824 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.824 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.824 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:39.824 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558348+0000", 2024-09-13T06:40:39.825 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9640000000000002e-06 2024-09-13T06:40:39.825 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.825 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.825 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:39.825 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.622636+0000", 2024-09-13T06:40:39.825 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.064288260999999999 2024-09-13T06:40:39.825 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.825 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.825 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:39.825 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.622715+0000", 2024-09-13T06:40:39.825 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.9351000000000006e-05 2024-09-13T06:40:39.825 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.825 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.826 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:39.826 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.622988+0000", 2024-09-13T06:40:39.826 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00027242599999999998 2024-09-13T06:40:39.826 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:39.826 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:39.826 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:39.826 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.826 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.826 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43229 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 479232~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:40:39.826 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558352+0000", 2024-09-13T06:40:39.826 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 18.187748846000002, 2024-09-13T06:40:39.826 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.065018024999999993, 2024-09-13T06:40:39.826 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:39.826 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:39.827 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:39.827 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:39.827 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:39.827 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43229 2024-09-13T06:40:39.827 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.827 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:39.827 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.827 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:39.827 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558352+0000", 2024-09-13T06:40:39.827 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:39.827 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.827 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.827 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:39.828 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558352+0000", 2024-09-13T06:40:39.828 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:39.828 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.828 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.828 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:39.828 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558352+0000", 2024-09-13T06:40:39.828 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:39.828 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.828 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.828 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:39.828 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558354+0000", 2024-09-13T06:40:39.828 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4930000000000001e-06 2024-09-13T06:40:39.828 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.829 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.829 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:39.829 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558360+0000", 2024-09-13T06:40:39.829 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.263e-06 2024-09-13T06:40:39.829 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.829 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.829 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:39.829 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558369+0000", 2024-09-13T06:40:39.829 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.0829999999999993e-06 2024-09-13T06:40:39.829 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.829 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.829 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:39.829 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.623017+0000", 2024-09-13T06:40:39.830 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.064647799000000006 2024-09-13T06:40:39.830 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.830 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.830 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:39.830 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.623090+0000", 2024-09-13T06:40:39.830 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3071000000000006e-05 2024-09-13T06:40:39.830 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.830 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.830 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:39.830 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.623370+0000", 2024-09-13T06:40:39.830 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000279661 2024-09-13T06:40:39.830 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:39.830 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:39.831 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:39.831 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.831 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.831 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43230 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 493568~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:40:39.831 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558374+0000", 2024-09-13T06:40:39.831 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 18.187726553000001, 2024-09-13T06:40:39.831 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.065410435000000003, 2024-09-13T06:40:39.831 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:39.831 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:39.831 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:39.831 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:39.831 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:39.831 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43230 2024-09-13T06:40:39.831 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.832 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:39.832 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.832 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:39.832 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558374+0000", 2024-09-13T06:40:39.832 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:39.832 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.832 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.832 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:39.832 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558374+0000", 2024-09-13T06:40:39.832 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:39.832 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.832 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.832 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:39.832 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558374+0000", 2024-09-13T06:40:39.833 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:39.833 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.833 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.833 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:39.833 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558376+0000", 2024-09-13T06:40:39.833 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4430000000000002e-06 2024-09-13T06:40:39.833 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.833 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.833 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:39.833 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558382+0000", 2024-09-13T06:40:39.833 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3029999999999996e-06 2024-09-13T06:40:39.833 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.833 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.834 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:39.834 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558387+0000", 2024-09-13T06:40:39.834 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.1699999999999999e-06 2024-09-13T06:40:39.834 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.834 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.834 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:39.834 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.623400+0000", 2024-09-13T06:40:39.834 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.065013244999999997 2024-09-13T06:40:39.834 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.834 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.834 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:39.834 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.623474+0000", 2024-09-13T06:40:39.834 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3889999999999999e-05 2024-09-13T06:40:39.834 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.835 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.835 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:39.835 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.623785+0000", 2024-09-13T06:40:39.835 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00031080099999999998 2024-09-13T06:40:39.835 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:39.835 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:39.835 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:39.835 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.835 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.836 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43231 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 507904~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:40:39.836 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558391+0000", 2024-09-13T06:40:39.836 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 18.187709867999999, 2024-09-13T06:40:39.836 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.065788597000000004, 2024-09-13T06:40:39.836 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:39.836 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:39.836 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:39.836 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:39.836 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:39.836 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43231 2024-09-13T06:40:39.836 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.836 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:39.836 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.837 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:39.837 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558391+0000", 2024-09-13T06:40:39.837 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:39.837 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.837 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.837 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:39.837 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558391+0000", 2024-09-13T06:40:39.837 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:39.837 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.837 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.837 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:39.837 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558390+0000", 2024-09-13T06:40:39.837 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:39.838 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.838 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.838 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:39.838 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558393+0000", 2024-09-13T06:40:39.838 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2570000000000002e-06 2024-09-13T06:40:39.838 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.838 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.838 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:39.838 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558399+0000", 2024-09-13T06:40:39.838 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0419999999999999e-06 2024-09-13T06:40:39.838 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.838 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.838 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:39.838 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558403+0000", 2024-09-13T06:40:39.839 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6249999999999998e-06 2024-09-13T06:40:39.839 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.839 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.839 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:39.839 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.623811+0000", 2024-09-13T06:40:39.839 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.065407549999999995 2024-09-13T06:40:39.839 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.839 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.839 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:39.839 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.623877+0000", 2024-09-13T06:40:39.839 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.5902999999999996e-05 2024-09-13T06:40:39.839 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.839 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.840 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:39.840 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.624179+0000", 2024-09-13T06:40:39.840 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00030259999999999998 2024-09-13T06:40:39.840 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:39.840 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:39.840 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:39.840 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.840 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.840 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43232 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 522240~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:40:39.840 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558422+0000", 2024-09-13T06:40:39.840 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 18.187679091, 2024-09-13T06:40:39.840 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.066176061999999994, 2024-09-13T06:40:39.841 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:39.841 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:39.841 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:39.841 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:39.841 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:39.841 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43232 2024-09-13T06:40:39.841 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.841 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:39.841 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.841 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:39.841 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558422+0000", 2024-09-13T06:40:39.841 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:39.841 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.842 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.842 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:39.842 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558422+0000", 2024-09-13T06:40:39.842 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:39.842 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.842 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.842 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:39.842 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558421+0000", 2024-09-13T06:40:39.842 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:39.842 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.842 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.842 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:39.842 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558428+0000", 2024-09-13T06:40:39.842 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.1690000000000003e-06 2024-09-13T06:40:39.843 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.843 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.843 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:39.843 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558434+0000", 2024-09-13T06:40:39.843 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9309999999999996e-06 2024-09-13T06:40:39.843 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.843 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.843 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:39.843 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558447+0000", 2024-09-13T06:40:39.843 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.271e-05 2024-09-13T06:40:39.843 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.843 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.844 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:39.844 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.624209+0000", 2024-09-13T06:40:39.844 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.065762102000000003 2024-09-13T06:40:39.844 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.844 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.844 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:39.844 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.624282+0000", 2024-09-13T06:40:39.844 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.2889e-05 2024-09-13T06:40:39.844 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.844 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.844 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:39.844 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.624598+0000", 2024-09-13T06:40:39.844 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00031591399999999998 2024-09-13T06:40:39.844 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:39.845 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:39.845 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:39.845 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.845 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.845 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43486 3.f 3:f7da9c8f:::rbd_data.1121f5f2e1c0.000000000000000b:1f [read 260096~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:40:39.845 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.569088+0000", 2024-09-13T06:40:39.845 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 18.177012368, 2024-09-13T06:40:39.845 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.062579223000000003, 2024-09-13T06:40:39.845 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:39.845 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:39.845 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:39.845 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:39.845 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:39.846 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43486 2024-09-13T06:40:39.846 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.846 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:39.846 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.846 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:39.846 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.569088+0000", 2024-09-13T06:40:39.846 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:39.846 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.846 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.846 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:39.846 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.569088+0000", 2024-09-13T06:40:39.846 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:39.846 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.847 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.847 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:39.847 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.569088+0000", 2024-09-13T06:40:39.847 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:39.847 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.847 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.847 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:39.847 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.569091+0000", 2024-09-13T06:40:39.847 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9629999999999998e-06 2024-09-13T06:40:39.847 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.847 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.847 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:39.847 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.569097+0000", 2024-09-13T06:40:39.847 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.4160000000000001e-06 2024-09-13T06:40:39.848 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.848 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.848 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:39.848 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.569102+0000", 2024-09-13T06:40:39.848 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6659999999999999e-06 2024-09-13T06:40:39.848 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.848 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.848 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:39.848 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.631346+0000", 2024-09-13T06:40:39.848 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.062243896 2024-09-13T06:40:39.848 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.848 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.848 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:39.848 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.631413+0000", 2024-09-13T06:40:39.849 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.7638000000000005e-05 2024-09-13T06:40:39.849 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:39.849 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:39.849 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:39.849 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.631668+0000", 2024-09-13T06:40:39.849 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0002541 2024-09-13T06:40:39.849 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:39.849 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:39.849 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:39.849 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:39.849 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:39.849 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:40:39.851 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-13T06:40:39.851 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:40:39.852+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:40:39.952 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:40:39.949+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:40:40.021 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:40:40.082 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-13T06:40:40.083 INFO:teuthology.orchestra.run.smithi081.stdout: "num_ops": 0 2024-09-13T06:40:40.083 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:40:40.084 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-13T06:40:40.085 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:40:40.085+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:40:40.186 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:40:40.188+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:40:40.201 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:40:40.201 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-13T06:40:40.201 INFO:teuthology.orchestra.run.smithi081.stdout: "complaint_time": 30, 2024-09-13T06:40:40.201 INFO:teuthology.orchestra.run.smithi081.stdout: "num_blocked_ops": 0 2024-09-13T06:40:40.202 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:40:40.215 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-13T06:40:40.301 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:40:40.304+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:40:40.382 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:40:40.382 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 20, 2024-09-13T06:40:40.382 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 600, 2024-09-13T06:40:40.382 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [ 2024-09-13T06:40:40.382 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:40.382 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:2226 3.15 3:af026987:::rbd_data.112173e2f1b7.0000000000000017:head [sparse-read 0~4194304] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-13T06:40:40.382 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:37.606562+0000", 2024-09-13T06:40:40.383 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 62.775234664000003, 2024-09-13T06:40:40.383 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.83322091700000001, 2024-09-13T06:40:40.383 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:40.383 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:40:40.383 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:40.383 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:40.383 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:40.383 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 2226 2024-09-13T06:40:40.383 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:40.383 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:40.384 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:40.384 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:40.384 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606562+0000", 2024-09-13T06:40:40.384 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:40.384 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:40.384 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:40.384 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:40.384 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606562+0000", 2024-09-13T06:40:40.384 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:40.384 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:40.384 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:40.385 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:40.385 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606561+0000", 2024-09-13T06:40:40.385 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:40.385 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:40.385 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:40.385 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:40.385 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606565+0000", 2024-09-13T06:40:40.385 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.4379999999999999e-06 2024-09-13T06:40:40.385 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:40.385 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:40.385 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:40.386 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606569+0000", 2024-09-13T06:40:40.386 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.425e-06 2024-09-13T06:40:40.386 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:40.386 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:40.386 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:40.386 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606572+0000", 2024-09-13T06:40:40.386 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.05e-06 2024-09-13T06:40:40.386 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:40.386 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:40.386 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:40.386 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606621+0000", 2024-09-13T06:40:40.387 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.8723000000000001e-05 2024-09-13T06:40:40.387 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:40.387 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:40.387 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:40:40.387 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606630+0000", 2024-09-13T06:40:40.387 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.8040000000000007e-06 2024-09-13T06:40:40.387 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:40.387 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:40.387 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:40.387 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.439648+0000", 2024-09-13T06:40:40.387 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.83301824800000002 2024-09-13T06:40:40.387 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:40.388 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:40.388 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:40.388 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.439782+0000", 2024-09-13T06:40:40.388 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00013466699999999999 2024-09-13T06:40:40.388 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:40.388 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:40.388 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:40.388 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:40.388 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:40.388 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25661 3.8 3:1180686c:::rbd_data.1121f2c5ee81.0000000000000009:13 [read 397312~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:40.388 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.436956+0000", 2024-09-13T06:40:40.389 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 43.944840130000003, 2024-09-13T06:40:40.389 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089036758999999993, 2024-09-13T06:40:40.389 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:40.389 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:40.389 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:40.389 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:40.389 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:40.389 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25661 2024-09-13T06:40:40.389 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:40.389 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:40.389 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:40.389 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:40.390 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436956+0000", 2024-09-13T06:40:40.390 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:40.390 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:40.390 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:40.390 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:40.390 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436956+0000", 2024-09-13T06:40:40.390 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:40.390 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:40.390 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:40.390 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:40.390 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436956+0000", 2024-09-13T06:40:40.390 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:40.390 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:40.391 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:40.391 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:40.391 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436958+0000", 2024-09-13T06:40:40.391 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1770000000000001e-06 2024-09-13T06:40:40.391 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:40.391 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:40.391 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:40.391 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436963+0000", 2024-09-13T06:40:40.391 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.6489999999999996e-06 2024-09-13T06:40:40.391 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:40.391 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:40.391 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:40.392 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436975+0000", 2024-09-13T06:40:40.392 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1783999999999999e-05 2024-09-13T06:40:40.392 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:40.392 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:40.392 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:40.392 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.525671+0000", 2024-09-13T06:40:40.392 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.088696292999999995 2024-09-13T06:40:40.392 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:40.392 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:40.392 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:40.393 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.525749+0000", 2024-09-13T06:40:40.393 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.7589000000000005e-05 2024-09-13T06:40:40.393 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:40.393 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:40.393 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:40.393 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.525993+0000", 2024-09-13T06:40:40.393 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00024381000000000001 2024-09-13T06:40:40.393 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:40.393 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:40.393 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:40.393 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:40.394 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:40.394 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25662 3.8 3:1180686c:::rbd_data.1121f2c5ee81.0000000000000009:13 [read 421888~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:40.394 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.436980+0000", 2024-09-13T06:40:40.394 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 43.944815818000002, 2024-09-13T06:40:40.394 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089367577000000004, 2024-09-13T06:40:40.394 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:40.394 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:40.394 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:40.394 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:40.395 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:40.395 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25662 2024-09-13T06:40:40.395 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:40.395 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:40.395 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:40.395 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:40.395 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436980+0000", 2024-09-13T06:40:40.395 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:40.395 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:40.395 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:40.395 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:40.395 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436980+0000", 2024-09-13T06:40:40.396 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:40.396 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:40.396 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:40.396 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:40.396 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436980+0000", 2024-09-13T06:40:40.396 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:40.396 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:40.396 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:40.396 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:40.397 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436982+0000", 2024-09-13T06:40:40.397 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3989999999999998e-06 2024-09-13T06:40:40.397 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:40.397 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:40.397 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:40.397 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436988+0000", 2024-09-13T06:40:40.397 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0039999999999996e-06 2024-09-13T06:40:40.397 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:40.397 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:40.398 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:40.398 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436993+0000", 2024-09-13T06:40:40.398 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6090000000000003e-06 2024-09-13T06:40:40.398 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:40.398 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:40.398 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:40.398 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.526035+0000", 2024-09-13T06:40:40.398 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089042248000000004 2024-09-13T06:40:40.398 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:40.399 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:40.399 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:40.399 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.526111+0000", 2024-09-13T06:40:40.399 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5643999999999996e-05 2024-09-13T06:40:40.399 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:40.399 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:40.399 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:40.399 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.526348+0000", 2024-09-13T06:40:40.400 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00023705800000000001 2024-09-13T06:40:40.400 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:40.400 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:40.400 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:40.400 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:40.400 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:40.400 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25663 3.8 3:1180686c:::rbd_data.1121f2c5ee81.0000000000000009:13 [read 466944~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:40.400 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.436998+0000", 2024-09-13T06:40:40.400 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 43.944798171000002, 2024-09-13T06:40:40.400 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089730867000000006, 2024-09-13T06:40:40.401 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:40.401 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:40.401 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:40.401 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:40.401 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:40.401 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25663 2024-09-13T06:40:40.401 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:40.401 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:40.401 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:40.402 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:40.402 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436998+0000", 2024-09-13T06:40:40.402 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:40.402 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:40.402 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:40.402 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:40.402 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436998+0000", 2024-09-13T06:40:40.402 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:40.402 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:40.402 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:40.402 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:40.402 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436998+0000", 2024-09-13T06:40:40.402 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:40.403 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:40.403 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:40.403 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:40.403 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437000+0000", 2024-09-13T06:40:40.403 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0940000000000002e-06 2024-09-13T06:40:40.403 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:40.403 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:40.403 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:40.403 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437005+0000", 2024-09-13T06:40:40.404 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.604e-06 2024-09-13T06:40:40.404 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:40.404 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:40.404 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:40.404 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437032+0000", 2024-09-13T06:40:40.404 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6407e-05 2024-09-13T06:40:40.404 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:40.404 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:40.404 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:40.404 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.526363+0000", 2024-09-13T06:40:40.404 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089331456000000004 2024-09-13T06:40:40.404 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:40.405 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:40.405 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:40.405 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.526404+0000", 2024-09-13T06:40:40.405 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.0887999999999999e-05 2024-09-13T06:40:40.405 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:40.405 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:40.405 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:40.405 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.526729+0000", 2024-09-13T06:40:40.405 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00032486 2024-09-13T06:40:40.405 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:40.405 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:40.405 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:40.406 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:40.406 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:40.406 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25664 3.8 3:1180686c:::rbd_data.1121f2c5ee81.0000000000000009:13 [read 491520~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:40.406 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.437040+0000", 2024-09-13T06:40:40.406 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 43.944756255999998, 2024-09-13T06:40:40.406 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.090016650000000004, 2024-09-13T06:40:40.406 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:40.406 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:40.406 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:40.406 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:40.406 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:40.406 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25664 2024-09-13T06:40:40.406 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:40.407 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:40.407 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:40.407 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:40.407 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437040+0000", 2024-09-13T06:40:40.407 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:40.407 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:40.407 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:40.407 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:40.407 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437040+0000", 2024-09-13T06:40:40.407 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:40.408 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:40.408 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:40.408 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:40.408 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437039+0000", 2024-09-13T06:40:40.408 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:40.408 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:40.408 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:40.408 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:40.408 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437047+0000", 2024-09-13T06:40:40.408 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4839999999999998e-06 2024-09-13T06:40:40.408 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:40.409 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:40.409 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:40.409 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437054+0000", 2024-09-13T06:40:40.409 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.8299999999999998e-06 2024-09-13T06:40:40.409 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:40.409 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:40.409 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:40.409 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437060+0000", 2024-09-13T06:40:40.409 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.1510000000000001e-06 2024-09-13T06:40:40.409 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:40.409 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:40.409 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:40.409 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.526772+0000", 2024-09-13T06:40:40.410 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089711737999999999 2024-09-13T06:40:40.410 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:40.410 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:40.410 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:40.410 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.526848+0000", 2024-09-13T06:40:40.410 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5870000000000004e-05 2024-09-13T06:40:40.410 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:40.410 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:40.410 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:40.411 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.527057+0000", 2024-09-13T06:40:40.411 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000209106 2024-09-13T06:40:40.411 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:40.411 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:40.411 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:40.411 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:40.411 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:40.411 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25740 3.18 3:1c662b96:::rbd_data.1121f2c5ee81.0000000000000010:13 [read 200704~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:40.411 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443352+0000", 2024-09-13T06:40:40.411 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 43.938444580999999, 2024-09-13T06:40:40.411 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089068222000000002, 2024-09-13T06:40:40.411 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:40.411 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:40.412 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:40.412 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:40.412 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:40.412 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25740 2024-09-13T06:40:40.412 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:40.412 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:40.412 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:40.412 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:40.412 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443352+0000", 2024-09-13T06:40:40.412 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:40.412 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:40.413 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:40.413 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:40.413 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443352+0000", 2024-09-13T06:40:40.413 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:40.413 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:40.413 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:40.413 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:40.413 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443351+0000", 2024-09-13T06:40:40.413 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:40.413 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:40.413 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:40.413 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:40.413 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443354+0000", 2024-09-13T06:40:40.414 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.841e-06 2024-09-13T06:40:40.414 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:40.414 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:40.414 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:40.414 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443361+0000", 2024-09-13T06:40:40.414 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.0010000000000004e-06 2024-09-13T06:40:40.414 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:40.414 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:40.414 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:40.414 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443366+0000", 2024-09-13T06:40:40.414 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7119999999999999e-06 2024-09-13T06:40:40.414 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:40.414 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:40.414 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:40.415 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532117+0000", 2024-09-13T06:40:40.415 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.088751327000000005 2024-09-13T06:40:40.415 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:40.415 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:40.415 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:40.415 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532193+0000", 2024-09-13T06:40:40.415 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5839000000000004e-05 2024-09-13T06:40:40.415 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:40.415 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:40.415 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:40.415 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532420+0000", 2024-09-13T06:40:40.415 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00022691000000000001 2024-09-13T06:40:40.415 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:40.415 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:40.416 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:40.416 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:40.416 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:40.416 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25741 3.18 3:1c662b96:::rbd_data.1121f2c5ee81.0000000000000010:13 [read 225280~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:40.416 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443378+0000", 2024-09-13T06:40:40.416 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 43.938417813999997, 2024-09-13T06:40:40.416 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089324107, 2024-09-13T06:40:40.416 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:40.416 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:40.416 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:40.416 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:40.416 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:40.417 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25741 2024-09-13T06:40:40.417 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:40.417 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:40.417 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:40.417 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:40.417 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443378+0000", 2024-09-13T06:40:40.417 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:40.417 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:40.417 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:40.417 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:40.417 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443378+0000", 2024-09-13T06:40:40.417 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:40.417 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:40.418 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:40.418 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:40.418 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443378+0000", 2024-09-13T06:40:40.418 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:40.418 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:40.418 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:40.418 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:40.418 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443380+0000", 2024-09-13T06:40:40.418 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3549999999999999e-06 2024-09-13T06:40:40.418 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:40.418 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:40.418 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:40.418 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443388+0000", 2024-09-13T06:40:40.419 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.7449999999999995e-06 2024-09-13T06:40:40.419 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:40.419 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:40.419 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:40.419 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443393+0000", 2024-09-13T06:40:40.419 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.4e-06 2024-09-13T06:40:40.419 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:40.419 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:40.419 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:40.419 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532454+0000", 2024-09-13T06:40:40.419 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089060941000000005 2024-09-13T06:40:40.419 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:40.419 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:40.420 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:40.420 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532512+0000", 2024-09-13T06:40:40.420 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7763000000000002e-05 2024-09-13T06:40:40.420 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:40.420 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:40.420 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:40.420 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532703+0000", 2024-09-13T06:40:40.420 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000190328 2024-09-13T06:40:40.420 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:40.420 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:40.420 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:40.420 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:40.420 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:40.421 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25742 3.18 3:1c662b96:::rbd_data.1121f2c5ee81.0000000000000010:13 [read 270336~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:40.421 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443398+0000", 2024-09-13T06:40:40.421 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 43.938398102000001, 2024-09-13T06:40:40.421 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089621836999999996, 2024-09-13T06:40:40.421 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:40.421 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:40.421 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:40.421 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:40.421 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:40.421 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25742 2024-09-13T06:40:40.421 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:40.421 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:40.421 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:40.422 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:40.422 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443398+0000", 2024-09-13T06:40:40.422 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:40.422 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:40.422 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:40.422 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:40.422 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443398+0000", 2024-09-13T06:40:40.422 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:40.422 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:40.422 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:40.422 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:40.422 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443398+0000", 2024-09-13T06:40:40.422 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:40.423 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:40.423 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:40.423 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:40.423 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443400+0000", 2024-09-13T06:40:40.423 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1849999999999998e-06 2024-09-13T06:40:40.423 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:40.423 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:40.423 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:40.423 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443407+0000", 2024-09-13T06:40:40.423 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3669999999999999e-06 2024-09-13T06:40:40.423 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:40.423 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:40.423 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:40.424 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443420+0000", 2024-09-13T06:40:40.424 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2645e-05 2024-09-13T06:40:40.424 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:40.424 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:40.424 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:40.424 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532742+0000", 2024-09-13T06:40:40.424 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089322200000000004 2024-09-13T06:40:40.424 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:40.424 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:40.424 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:40.424 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532818+0000", 2024-09-13T06:40:40.424 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.6019000000000005e-05 2024-09-13T06:40:40.424 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:40.425 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:40.425 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:40.425 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533020+0000", 2024-09-13T06:40:40.425 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000201721 2024-09-13T06:40:40.425 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:40.425 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:40.426 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:40.426 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:40.426 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:40.426 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25743 3.18 3:1c662b96:::rbd_data.1121f2c5ee81.0000000000000010:13 [read 294912~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:40.426 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443425+0000", 2024-09-13T06:40:40.426 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 43.938371093999997, 2024-09-13T06:40:40.426 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089864075000000002, 2024-09-13T06:40:40.426 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:40.426 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:40.427 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:40.427 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:40.427 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:40.427 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25743 2024-09-13T06:40:40.427 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:40.427 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:40.427 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:40.427 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:40.427 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443425+0000", 2024-09-13T06:40:40.427 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:40.428 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:40.428 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:40.428 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:40.428 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443425+0000", 2024-09-13T06:40:40.428 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:40.428 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:40.428 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:40.428 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:40.428 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443425+0000", 2024-09-13T06:40:40.428 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:40.429 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:40.429 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:40.429 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:40.429 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443432+0000", 2024-09-13T06:40:40.429 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3420000000000002e-06 2024-09-13T06:40:40.429 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:40.429 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:40.429 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:40.429 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443440+0000", 2024-09-13T06:40:40.429 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5689999999999999e-06 2024-09-13T06:40:40.429 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:40.429 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:40.430 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:40.430 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443445+0000", 2024-09-13T06:40:40.430 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9590000000000003e-06 2024-09-13T06:40:40.430 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:40.430 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:40.430 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:40.430 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533063+0000", 2024-09-13T06:40:40.430 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089617988999999995 2024-09-13T06:40:40.430 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:40.430 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:40.430 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:40.430 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533122+0000", 2024-09-13T06:40:40.431 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9052999999999999e-05 2024-09-13T06:40:40.431 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:40.431 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:40.431 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:40.431 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533289+0000", 2024-09-13T06:40:40.431 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00016752800000000001 2024-09-13T06:40:40.431 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:40.431 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:40.431 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:40.431 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:40.431 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:40.431 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25744 3.18 3.69d46638 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:40.431 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443449+0000", 2024-09-13T06:40:40.432 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 43.938346946999999, 2024-09-13T06:40:40.432 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089869148999999995, 2024-09-13T06:40:40.432 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:40.432 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:40:40.432 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:40.432 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:40.432 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:40.432 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25744 2024-09-13T06:40:40.432 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:40.432 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:40.432 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:40.432 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:40.433 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443449+0000", 2024-09-13T06:40:40.433 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:40.433 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:40.433 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:40.433 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:40.433 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443449+0000", 2024-09-13T06:40:40.433 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:40.433 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:40.433 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:40.433 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:40.433 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443449+0000", 2024-09-13T06:40:40.433 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:40.434 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:40.434 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:40.434 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:40.434 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443451+0000", 2024-09-13T06:40:40.434 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.244e-06 2024-09-13T06:40:40.434 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:40.434 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:40.434 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:40.434 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443457+0000", 2024-09-13T06:40:40.434 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.66e-06 2024-09-13T06:40:40.434 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:40.434 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:40.434 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:40.435 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443461+0000", 2024-09-13T06:40:40.435 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5449999999999997e-06 2024-09-13T06:40:40.435 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:40.435 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:40.435 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:40.435 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533311+0000", 2024-09-13T06:40:40.435 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089849729000000003 2024-09-13T06:40:40.435 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:40.435 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:40.435 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:40.435 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533318+0000", 2024-09-13T06:40:40.435 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.328e-06 2024-09-13T06:40:40.435 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:40.436 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:40.436 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:40.436 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:40.436 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:40.436 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25745 3.18 3.69d46638 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:40.436 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443466+0000", 2024-09-13T06:40:40.436 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 43.938329889000002, 2024-09-13T06:40:40.436 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089886743000000005, 2024-09-13T06:40:40.436 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:40.436 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:40:40.436 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:40.436 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:40.436 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:40.437 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25745 2024-09-13T06:40:40.437 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:40.437 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:40.437 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:40.437 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:40.437 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443466+0000", 2024-09-13T06:40:40.437 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:40.437 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:40.437 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:40.437 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:40.437 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443466+0000", 2024-09-13T06:40:40.437 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:40.437 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:40.438 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:40.438 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:40.438 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443466+0000", 2024-09-13T06:40:40.438 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:40.438 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:40.438 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:40.438 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:40.438 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443474+0000", 2024-09-13T06:40:40.438 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.1289999999999996e-06 2024-09-13T06:40:40.438 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:40.438 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:40.438 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:40.439 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443484+0000", 2024-09-13T06:40:40.439 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0654e-05 2024-09-13T06:40:40.439 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:40.439 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:40.439 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:40.439 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443490+0000", 2024-09-13T06:40:40.439 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8030000000000002e-06 2024-09-13T06:40:40.439 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:40.439 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:40.439 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:40.439 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533348+0000", 2024-09-13T06:40:40.439 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089857267000000005 2024-09-13T06:40:40.439 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:40.440 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:40.440 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:40.440 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533353+0000", 2024-09-13T06:40:40.440 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.5520000000000004e-06 2024-09-13T06:40:40.440 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:40.440 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:40.440 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:40.440 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:40.440 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:40.440 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25746 3.18 3.69d46638 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:40.440 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443495+0000", 2024-09-13T06:40:40.440 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 43.938300775999998, 2024-09-13T06:40:40.440 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089903725000000004, 2024-09-13T06:40:40.441 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:40.441 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:40:40.441 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:40.441 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:40.441 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:40.441 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25746 2024-09-13T06:40:40.441 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:40.441 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:40.441 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:40.441 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:40.441 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443495+0000", 2024-09-13T06:40:40.441 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:40.441 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:40.442 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:40.442 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:40.442 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443495+0000", 2024-09-13T06:40:40.442 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:40.442 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:40.442 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:40.442 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:40.442 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443495+0000", 2024-09-13T06:40:40.442 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:40.442 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:40.442 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:40.442 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:40.442 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443498+0000", 2024-09-13T06:40:40.442 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.7690000000000001e-06 2024-09-13T06:40:40.443 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:40.443 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:40.443 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:40.443 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443504+0000", 2024-09-13T06:40:40.443 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9710000000000001e-06 2024-09-13T06:40:40.443 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:40.443 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:40.443 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:40.443 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443508+0000", 2024-09-13T06:40:40.443 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4159999999999997e-06 2024-09-13T06:40:40.443 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:40.443 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:40.443 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:40.444 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533391+0000", 2024-09-13T06:40:40.444 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089882607000000003 2024-09-13T06:40:40.444 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:40.444 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:40.444 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:40.444 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533399+0000", 2024-09-13T06:40:40.444 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.4349999999999997e-06 2024-09-13T06:40:40.444 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:40.444 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:40.444 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:40.444 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:40.444 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:40.444 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25747 3.8 3.63996268 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:40.445 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443512+0000", 2024-09-13T06:40:40.445 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 43.938284045000003, 2024-09-13T06:40:40.445 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089880075000000004, 2024-09-13T06:40:40.445 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:40.445 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:40:40.445 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:40.445 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:40.445 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:40.445 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25747 2024-09-13T06:40:40.445 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:40.445 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:40.445 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:40.445 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:40.445 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443512+0000", 2024-09-13T06:40:40.446 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:40.446 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:40.446 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:40.446 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:40.446 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443512+0000", 2024-09-13T06:40:40.446 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:40.446 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:40.446 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:40.446 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:40.446 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443512+0000", 2024-09-13T06:40:40.446 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:40.446 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:40.446 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:40.447 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:40.447 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443514+0000", 2024-09-13T06:40:40.447 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0980000000000001e-06 2024-09-13T06:40:40.447 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:40.447 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:40.447 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:40.447 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443520+0000", 2024-09-13T06:40:40.447 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7069999999999997e-06 2024-09-13T06:40:40.447 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:40.447 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:40.447 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:40.447 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443524+0000", 2024-09-13T06:40:40.447 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5390000000000001e-06 2024-09-13T06:40:40.448 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:40.448 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:40.448 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:40.448 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533384+0000", 2024-09-13T06:40:40.448 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089859684999999995 2024-09-13T06:40:40.448 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:40.448 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:40.448 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:40.448 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533392+0000", 2024-09-13T06:40:40.448 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.3440000000000001e-06 2024-09-13T06:40:40.448 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:40.448 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:40.448 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:40.449 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:40.449 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:40.449 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25748 3.8 3.63996268 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:40.449 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443528+0000", 2024-09-13T06:40:40.449 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 43.938267918000001, 2024-09-13T06:40:40.449 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089890715999999996, 2024-09-13T06:40:40.449 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:40.449 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:40:40.449 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:40.449 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:40.449 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:40.449 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25748 2024-09-13T06:40:40.449 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:40.450 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:40.450 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:40.450 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:40.450 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443528+0000", 2024-09-13T06:40:40.450 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:40.450 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:40.450 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:40.450 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:40.450 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443528+0000", 2024-09-13T06:40:40.450 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:40.450 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:40.450 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:40.451 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:40.451 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443528+0000", 2024-09-13T06:40:40.451 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:40.451 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:40.451 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:40.451 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:40.451 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443530+0000", 2024-09-13T06:40:40.451 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0650000000000001e-06 2024-09-13T06:40:40.451 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:40.451 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:40.451 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:40.451 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443536+0000", 2024-09-13T06:40:40.451 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7259999999999999e-06 2024-09-13T06:40:40.451 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:40.452 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:40.452 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:40.452 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443540+0000", 2024-09-13T06:40:40.452 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5009999999999998e-06 2024-09-13T06:40:40.452 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:40.452 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:40.452 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:40.452 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533412+0000", 2024-09-13T06:40:40.452 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089871873000000005 2024-09-13T06:40:40.452 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:40.452 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:40.452 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:40.452 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533419+0000", 2024-09-13T06:40:40.453 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.883e-06 2024-09-13T06:40:40.453 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:40.453 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:40.453 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:40.453 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:40.453 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:40.453 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25749 3.8 3.63996268 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:40.453 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443545+0000", 2024-09-13T06:40:40.453 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 43.938251721999997, 2024-09-13T06:40:40.453 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089897988999999998, 2024-09-13T06:40:40.453 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:40.453 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:40:40.453 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:40.453 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:40.454 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:40.454 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25749 2024-09-13T06:40:40.454 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:40.454 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:40.454 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:40.454 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:40.454 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443545+0000", 2024-09-13T06:40:40.454 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:40.454 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:40.454 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:40.454 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:40.454 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443545+0000", 2024-09-13T06:40:40.454 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:40.455 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:40.455 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:40.455 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:40.455 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443544+0000", 2024-09-13T06:40:40.455 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:40.455 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:40.455 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:40.455 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:40.455 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443553+0000", 2024-09-13T06:40:40.455 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.4770000000000003e-06 2024-09-13T06:40:40.455 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:40.455 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:40.455 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:40.455 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443564+0000", 2024-09-13T06:40:40.456 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0986e-05 2024-09-13T06:40:40.456 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:40.456 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:40.456 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:40.456 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443569+0000", 2024-09-13T06:40:40.456 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2530000000000004e-06 2024-09-13T06:40:40.456 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:40.456 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:40.456 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:40.456 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533438+0000", 2024-09-13T06:40:40.456 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089868641999999999 2024-09-13T06:40:40.456 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:40.456 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:40.457 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:40.457 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533442+0000", 2024-09-13T06:40:40.457 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.989e-06 2024-09-13T06:40:40.457 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:40.457 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:40.457 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:40.457 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:40.457 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:40.457 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25750 3.8 3.63996268 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:40.457 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443574+0000", 2024-09-13T06:40:40.457 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 43.938222236000001, 2024-09-13T06:40:40.457 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089895143999999996, 2024-09-13T06:40:40.457 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:40.457 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:40:40.458 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:40.458 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:40.458 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:40.458 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25750 2024-09-13T06:40:40.458 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:40.458 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:40.458 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:40.458 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:40.458 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443574+0000", 2024-09-13T06:40:40.458 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:40.458 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:40.458 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:40.458 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:40.459 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443574+0000", 2024-09-13T06:40:40.459 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:40.459 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:40.459 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:40.459 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:40.459 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443574+0000", 2024-09-13T06:40:40.459 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:40.459 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:40.459 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:40.459 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:40.459 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443576+0000", 2024-09-13T06:40:40.459 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6910000000000002e-06 2024-09-13T06:40:40.459 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:40.459 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:40.460 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:40.460 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443583+0000", 2024-09-13T06:40:40.460 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.331e-06 2024-09-13T06:40:40.460 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:40.460 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:40.460 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:40.460 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443587+0000", 2024-09-13T06:40:40.460 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6129999999999997e-06 2024-09-13T06:40:40.460 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:40.460 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:40.460 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:40.460 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533464+0000", 2024-09-13T06:40:40.460 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089876605999999998 2024-09-13T06:40:40.461 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:40.461 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:40.461 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:40.461 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533469+0000", 2024-09-13T06:40:40.461 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3909999999999997e-06 2024-09-13T06:40:40.461 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:40.461 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:40.461 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:40.461 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:40.461 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:40.461 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25751 3.8 3.63996268 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:40.461 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443592+0000", 2024-09-13T06:40:40.461 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 43.938204538999997, 2024-09-13T06:40:40.461 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089913650999999997, 2024-09-13T06:40:40.462 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:40.462 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:40:40.462 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:40.462 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:40.462 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:40.462 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25751 2024-09-13T06:40:40.462 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:40.462 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:40.462 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:40.462 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:40.462 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443592+0000", 2024-09-13T06:40:40.462 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:40.462 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:40.463 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:40.463 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:40.463 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443592+0000", 2024-09-13T06:40:40.463 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:40.463 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:40.463 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:40.463 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:40.463 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443591+0000", 2024-09-13T06:40:40.463 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:40.463 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:40.463 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:40.463 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:40.463 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443594+0000", 2024-09-13T06:40:40.464 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3649999999999998e-06 2024-09-13T06:40:40.464 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:40.464 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:40.464 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:40.464 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443599+0000", 2024-09-13T06:40:40.464 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.699e-06 2024-09-13T06:40:40.464 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:40.464 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:40.464 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:40.464 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443611+0000", 2024-09-13T06:40:40.464 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1503e-05 2024-09-13T06:40:40.464 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:40.464 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:40.465 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:40.465 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533497+0000", 2024-09-13T06:40:40.465 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089886453000000005 2024-09-13T06:40:40.465 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:40.465 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:40.465 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:40.465 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533505+0000", 2024-09-13T06:40:40.465 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.9910000000000002e-06 2024-09-13T06:40:40.465 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:40.465 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:40.465 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:40.465 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:40.465 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:40.465 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25752 3.8 3.63996268 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:40.466 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443615+0000", 2024-09-13T06:40:40.466 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 43.938180758000001, 2024-09-13T06:40:40.466 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089905868999999999, 2024-09-13T06:40:40.466 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:40.466 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:40:40.466 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:40.466 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:40.466 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:40.466 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25752 2024-09-13T06:40:40.466 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:40.466 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:40.466 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:40.466 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:40.467 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443615+0000", 2024-09-13T06:40:40.467 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:40.467 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:40.467 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:40.467 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:40.467 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443615+0000", 2024-09-13T06:40:40.467 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:40.467 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:40.467 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:40.467 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:40.468 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443615+0000", 2024-09-13T06:40:40.468 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:40.468 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:40.468 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:40.468 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:40.468 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443617+0000", 2024-09-13T06:40:40.468 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3539999999999998e-06 2024-09-13T06:40:40.468 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:40.468 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:40.468 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:40.468 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443624+0000", 2024-09-13T06:40:40.469 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3600000000000001e-06 2024-09-13T06:40:40.469 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:40.469 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:40.469 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:40.469 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443628+0000", 2024-09-13T06:40:40.469 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.2350000000000001e-06 2024-09-13T06:40:40.469 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:40.469 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:40.469 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:40.469 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533517+0000", 2024-09-13T06:40:40.469 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089889029999999995 2024-09-13T06:40:40.469 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:40.469 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:40.469 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:40.470 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533521+0000", 2024-09-13T06:40:40.470 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.2529999999999998e-06 2024-09-13T06:40:40.470 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:40.470 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:40.470 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:40.470 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:40.470 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:40.470 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25755 3.8 3.63996268 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:40.470 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.444692+0000", 2024-09-13T06:40:40.470 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 43.937104052000002, 2024-09-13T06:40:40.470 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.088904186999999996, 2024-09-13T06:40:40.470 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:40.470 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:40:40.471 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:40.471 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:40.471 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:40.471 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25755 2024-09-13T06:40:40.471 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:40.471 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:40.471 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:40.471 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:40.471 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.444692+0000", 2024-09-13T06:40:40.471 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:40.471 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:40.471 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:40.471 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:40.471 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.444692+0000", 2024-09-13T06:40:40.472 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:40.472 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:40.472 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:40.472 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:40.472 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.444692+0000", 2024-09-13T06:40:40.472 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:40.472 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:40.472 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:40.472 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:40.472 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.444694+0000", 2024-09-13T06:40:40.472 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.058e-06 2024-09-13T06:40:40.472 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:40.472 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:40.472 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:40.473 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.444700+0000", 2024-09-13T06:40:40.473 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7769999999999999e-06 2024-09-13T06:40:40.473 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:40.473 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:40.473 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:40.473 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.444704+0000", 2024-09-13T06:40:40.473 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6229999999999996e-06 2024-09-13T06:40:40.473 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:40.473 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:40.473 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:40.473 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533587+0000", 2024-09-13T06:40:40.473 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.088882744999999999 2024-09-13T06:40:40.473 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:40.474 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:40.474 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:40.474 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533596+0000", 2024-09-13T06:40:40.474 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.3270000000000007e-06 2024-09-13T06:40:40.474 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:40.474 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:40.474 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:40.474 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:40.474 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:40.474 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25756 3.8 3.63996268 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:40.474 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.444709+0000", 2024-09-13T06:40:40.474 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 43.937087675999997, 2024-09-13T06:40:40.474 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.088902571, 2024-09-13T06:40:40.475 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:40.475 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:40:40.475 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:40.475 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:40.475 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:40.475 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25756 2024-09-13T06:40:40.475 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:40.475 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:40.475 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:40.475 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:40.475 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.444709+0000", 2024-09-13T06:40:40.475 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:40.475 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:40.475 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:40.476 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:40.476 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.444709+0000", 2024-09-13T06:40:40.476 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:40.476 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:40.476 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:40.476 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:40.476 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.444708+0000", 2024-09-13T06:40:40.476 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:40.476 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:40.476 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:40.476 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:40.476 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.444710+0000", 2024-09-13T06:40:40.476 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0729999999999999e-06 2024-09-13T06:40:40.476 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:40.477 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:40.477 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:40.477 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.444716+0000", 2024-09-13T06:40:40.477 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7819999999999999e-06 2024-09-13T06:40:40.477 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:40.477 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:40.477 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:40.477 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.444720+0000", 2024-09-13T06:40:40.477 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4000000000000002e-06 2024-09-13T06:40:40.477 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:40.477 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:40.477 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:40.477 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533606+0000", 2024-09-13T06:40:40.478 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.088885711000000006 2024-09-13T06:40:40.478 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:40.478 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:40.478 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:40.478 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533611+0000", 2024-09-13T06:40:40.478 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.057e-06 2024-09-13T06:40:40.478 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:40.478 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:40.478 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:40.478 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:40.478 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:40.478 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:40:40.479 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-13T06:40:40.479 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-13T06:40:40.481 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-13T06:40:40.481 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:40:40.480+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:40:40.581 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:40:40.577+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:40:40.648 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:40:40.649 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [ 2024-09-13T06:40:40.649 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:40.649 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:51650 3.a 3:5213715f:::rbd_data.11213b441054.0000000000000093:head [write 32768~38872 [fadvise_sequential+fadvise_nocache] in=38872b,write 114688~32768 [fadvise_sequential+fadvise_nocache] in=32768b,write 294912~16384 [fadvise_sequential+fadvise_nocache] in=16384b,write 376832~32768 [fadvise_sequential+fadvise_nocache] in=32768b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-09-13T06:40:40.649 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:40.649713+0000", 2024-09-13T06:40:40.649 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0011949440000000001, 2024-09-13T06:40:40.649 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.001224117, 2024-09-13T06:40:40.649 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:40.649 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "waiting for sub ops", 2024-09-13T06:40:40.649 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:40.649 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:40.649 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:40.650 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 51650 2024-09-13T06:40:40.650 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:40.650 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:40.650 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:40.650 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:40.650 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:40.649713+0000", 2024-09-13T06:40:40.650 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:40.650 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:40.650 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:40.650 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:40.650 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:40.649713+0000", 2024-09-13T06:40:40.650 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:40.650 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:40.651 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:40.651 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:40.651 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:40.649709+0000", 2024-09-13T06:40:40.651 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999957 2024-09-13T06:40:40.651 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:40.651 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:40.651 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:40.651 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:40.649840+0000", 2024-09-13T06:40:40.651 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00013133099999999999 2024-09-13T06:40:40.651 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:40.651 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:40.652 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:40.652 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:40.649858+0000", 2024-09-13T06:40:40.652 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7949e-05 2024-09-13T06:40:40.652 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:40.652 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:40.652 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:40.652 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:40.649869+0000", 2024-09-13T06:40:40.652 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0373999999999999e-05 2024-09-13T06:40:40.652 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:40.652 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:40.652 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:40.652 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:40.649932+0000", 2024-09-13T06:40:40.652 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.2982000000000001e-05 2024-09-13T06:40:40.653 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:40.653 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:40.653 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:40.653 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:40.650099+0000", 2024-09-13T06:40:40.653 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000167467 2024-09-13T06:40:40.653 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:40.653 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:40.653 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 6", 2024-09-13T06:40:40.653 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:40.650214+0000", 2024-09-13T06:40:40.653 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00011519999999999999 2024-09-13T06:40:40.653 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:40.653 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:40.653 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:40.654 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:40.654 INFO:teuthology.orchestra.run.smithi139.stdout: ], 2024-09-13T06:40:40.654 INFO:teuthology.orchestra.run.smithi139.stdout: "num_ops": 1 2024-09-13T06:40:40.654 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:40:40.667 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-13T06:40:40.690 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-13T06:40:40.690 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-13T06:40:40.691 INFO:tasks.thrashosds.thrasher:primary_affinity 2024-09-13T06:40:40.691 INFO:tasks.thrashosds.thrasher:Setting osd 5 primary_affinity to 0.115276 2024-09-13T06:40:40.691 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 5 0.11527593375794343 2024-09-13T06:40:40.714 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-13T06:40:40.713+0000 7f86a5f06640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26387) UID: 0 2024-09-13T06:40:40.723 INFO:teuthology.orchestra.run.smithi081.stdout:osd.0: {} 2024-09-13T06:40:40.723 INFO:teuthology.orchestra.run.smithi081.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-13T06:40:40.754 INFO:teuthology.orchestra.run.smithi081.stdout:osd.1: {} 2024-09-13T06:40:40.754 INFO:teuthology.orchestra.run.smithi081.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-13T06:40:40.782 INFO:teuthology.orchestra.run.smithi081.stdout:osd.2: {} 2024-09-13T06:40:40.782 INFO:teuthology.orchestra.run.smithi081.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-13T06:40:40.783 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:40:40.781+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:40:40.810 INFO:teuthology.orchestra.run.smithi081.stdout:osd.3: {} 2024-09-13T06:40:40.811 INFO:teuthology.orchestra.run.smithi081.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-13T06:40:40.839 INFO:teuthology.orchestra.run.smithi081.stdout:osd.4: {} 2024-09-13T06:40:40.840 INFO:teuthology.orchestra.run.smithi081.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-13T06:40:40.857 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:40:40.857 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:40:40.858 INFO:teuthology.orchestra.run.smithi081.stdout:osd.5: {} 2024-09-13T06:40:40.858 INFO:teuthology.orchestra.run.smithi081.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-13T06:40:40.874 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-13T06:40:40.880 INFO:teuthology.orchestra.run.smithi081.stdout:osd.6: {} 2024-09-13T06:40:40.881 INFO:teuthology.orchestra.run.smithi081.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-13T06:40:40.897 INFO:teuthology.orchestra.run.smithi081.stdout:osd.7: {} 2024-09-13T06:40:40.898 INFO:teuthology.orchestra.run.smithi081.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-13T06:40:40.915 INFO:tasks.ceph.osd.6.smithi139.stderr:2024-09-13T06:40:40.913+0000 7fcd02c5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26385) UID: 0 2024-09-13T06:40:40.984 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:40:40.981+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:40:41.033 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:40:41.033 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:40:41.048 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-13T06:40:41.091 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-13T06:40:41.089+0000 7f86a5f06640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26387) UID: 0 2024-09-13T06:40:41.185 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:40:41.188+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:40:41.216 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:40:41.216 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:40:41.230 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-13T06:40:41.286 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:40:41.288+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:40:41.352 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:40:41.353 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:40:41.367 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-13T06:40:41.410 INFO:teuthology.orchestra.run.smithi081.stderr:nodeep-scrub is set 2024-09-13T06:40:41.414 INFO:teuthology.orchestra.run.smithi081.stderr:set osd.5 primary-affinity to 0.115276 (875542) 2024-09-13T06:40:41.414 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:40:41.413+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:40:41.489 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:40:41.492+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:40:41.494 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:40:41.494 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:40:41.508 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-13T06:40:41.556 INFO:teuthology.orchestra.run.smithi081.stdout:checking clone #12, image image_client.0-clone12 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent13 2024-09-13T06:40:41.592 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:40:41.592+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:40:41.677 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:40:41.677 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:40:41.691 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-13T06:40:41.691 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:40:41.689+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:40:41.792 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:40:41.792+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:40:41.857 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:40:41.857 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:40:41.871 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-13T06:40:41.914 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:40:41.913+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:40:41.989 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:40:41.989 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:40:41.993 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:40:41.996+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:40:42.003 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-13T06:40:42.095 INFO:tasks.ceph.osd.6.smithi139.stderr:2024-09-13T06:40:42.093+0000 7fcd02c5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26385) UID: 0 2024-09-13T06:40:42.169 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:40:42.169 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:40:42.183 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-13T06:40:42.227 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-13T06:40:42.225+0000 7f86a5f06640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26387) UID: 0 2024-09-13T06:40:42.297 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:40:42.300+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:40:42.345 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:40:42.345 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:40:42.359 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-13T06:40:42.398 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:40:42.400+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:40:42.487 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:40:42.487 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:40:42.499 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:40:42.497+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:40:42.501 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-13T06:40:42.600 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:40:42.600+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:40:42.638 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:40:42.639 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:40:42.654 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-13T06:40:42.745 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:40:42.748+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:40:42.755 INFO:teuthology.orchestra.run.smithi081.stdout:2372 write 0x6e587d5 thru 0x6e62906 (0xa132 bytes) 2024-09-13T06:40:42.766 INFO:teuthology.orchestra.run.smithi081.stdout:2373 punch from 0x5e9964 to 0x5f94b8, (0xfb54 bytes) 2024-09-13T06:40:42.766 INFO:teuthology.orchestra.run.smithi081.stdout:2374 punch from 0x3c9dc31 to 0x3ca215a, (0x4529 bytes) 2024-09-13T06:40:42.766 INFO:teuthology.orchestra.run.smithi081.stdout:2375 writesame 0xb892b24 thru 0xb899a0c data_size 0x1(0x6ee9 bytes) 2024-09-13T06:40:42.782 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:40:42.782 INFO:teuthology.orchestra.run.smithi081.stdout:2377 writesame 0x9601c3c thru 0x960cfd9 data_size 0x2(0xb39e bytes) 2024-09-13T06:40:42.801 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:40:42.797+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:40:42.807 INFO:teuthology.orchestra.run.smithi081.stdout:2380 write 0xd00e07a thru 0xd012da7 (0x4d2e bytes) 2024-09-13T06:40:42.813 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:40:42.815 INFO:teuthology.orchestra.run.smithi081.stdout:2383 trunc from 0xd012da8 to 0xb59bb42 2024-09-13T06:40:42.835 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:40:42.835 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:40:42.851 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-13T06:40:42.853 INFO:teuthology.orchestra.run.smithi081.stdout:2386 write 0xe7a386d thru 0xe7b151f (0xdcb3 bytes) 2024-09-13T06:40:42.861 INFO:teuthology.orchestra.run.smithi081.stdout:2387 read 0x462fba thru 0x46e520 (0xb567 bytes) 2024-09-13T06:40:42.862 INFO:teuthology.orchestra.run.smithi081.stdout:2388 write 0x261995a thru 0x2626f01 (0xd5a8 bytes) 2024-09-13T06:40:42.866 INFO:teuthology.orchestra.run.smithi081.stdout:2389 write 0xd64e26 thru 0xd745ed (0xf7c8 bytes) 2024-09-13T06:40:42.873 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:40:42.873 INFO:teuthology.orchestra.run.smithi081.stdout:2392 punch from 0x8755847 to 0x87630a8, (0xd861 bytes) 2024-09-13T06:40:42.873 INFO:teuthology.orchestra.run.smithi081.stdout:2393 read 0x8700716 thru 0x8701736 (0x1021 bytes) 2024-09-13T06:40:42.873 INFO:teuthology.orchestra.run.smithi081.stdout:2394 write 0x21baf56 thru 0x21c86c8 (0xd773 bytes) 2024-09-13T06:40:42.875 INFO:teuthology.orchestra.run.smithi081.stdout:2396 punch from 0xa53c66 to 0xa5fb54, (0xbeee bytes) 2024-09-13T06:40:42.876 INFO:teuthology.orchestra.run.smithi081.stdout:2397 read 0xdcaec91 thru 0xdcbc7a0 (0xdb10 bytes) 2024-09-13T06:40:42.876 INFO:teuthology.orchestra.run.smithi081.stdout:2398 write 0xe6a8107 thru 0xe6b3108 (0xb002 bytes) 2024-09-13T06:40:42.884 INFO:teuthology.orchestra.run.smithi081.stdout:2399 writesame 0x7d27ab9 thru 0x7d3026c data_size 0x6(0x87b4 bytes) 2024-09-13T06:40:42.893 INFO:teuthology.orchestra.run.smithi081.stdout:2401 clone 15 order 21 su 262144 sc 13 2024-09-13T06:40:42.902 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:40:42.897+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:40:42.914 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-13T06:40:42.971 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:40:42.971 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:40:42.985 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-13T06:40:43.029 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:40:43.032+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:40:43.048 INFO:teuthology.orchestra.run.smithi081.stdout:osd.0: {} 2024-09-13T06:40:43.048 INFO:teuthology.orchestra.run.smithi081.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-13T06:40:43.065 INFO:teuthology.orchestra.run.smithi081.stdout:osd.1: {} 2024-09-13T06:40:43.065 INFO:teuthology.orchestra.run.smithi081.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-13T06:40:43.081 INFO:teuthology.orchestra.run.smithi081.stdout:osd.2: {} 2024-09-13T06:40:43.081 INFO:teuthology.orchestra.run.smithi081.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-13T06:40:43.094 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:40:43.094 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-13T06:40:43.094 INFO:teuthology.orchestra.run.smithi081.stdout: "num_ops": 0 2024-09-13T06:40:43.094 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:40:43.097 INFO:teuthology.orchestra.run.smithi081.stdout:osd.3: {} 2024-09-13T06:40:43.097 INFO:teuthology.orchestra.run.smithi081.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-13T06:40:43.103 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:40:43.104+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:40:43.107 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-13T06:40:43.117 INFO:teuthology.orchestra.run.smithi081.stdout:osd.4: {} 2024-09-13T06:40:43.118 INFO:teuthology.orchestra.run.smithi081.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-13T06:40:43.137 INFO:teuthology.orchestra.run.smithi081.stdout:osd.5: {} 2024-09-13T06:40:43.138 INFO:teuthology.orchestra.run.smithi081.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-13T06:40:43.157 INFO:teuthology.orchestra.run.smithi081.stdout:osd.6: {} 2024-09-13T06:40:43.158 INFO:teuthology.orchestra.run.smithi081.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-13T06:40:43.178 INFO:teuthology.orchestra.run.smithi081.stdout:osd.7: {} 2024-09-13T06:40:43.178 INFO:teuthology.orchestra.run.smithi081.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-13T06:40:43.223 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:40:43.223 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-13T06:40:43.223 INFO:teuthology.orchestra.run.smithi081.stdout: "complaint_time": 30, 2024-09-13T06:40:43.223 INFO:teuthology.orchestra.run.smithi081.stdout: "num_blocked_ops": 0 2024-09-13T06:40:43.224 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:40:43.224 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:40:43.224+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:40:43.237 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-13T06:40:43.306 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:40:43.301+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:40:43.405 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:40:43.405 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 20, 2024-09-13T06:40:43.405 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 600, 2024-09-13T06:40:43.405 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [ 2024-09-13T06:40:43.405 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:43.405 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:21979 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 14217216~4096 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:40:43.406 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.888811+0000", 2024-09-13T06:40:43.406 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 50.516038363, 2024-09-13T06:40:43.406 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049092969, 2024-09-13T06:40:43.406 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:43.406 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:43.406 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:43.406 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:43.406 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:43.406 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 21979 2024-09-13T06:40:43.406 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:43.406 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:43.407 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:43.407 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:43.407 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888811+0000", 2024-09-13T06:40:43.407 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:43.407 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:43.407 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:43.407 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:43.407 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888811+0000", 2024-09-13T06:40:43.407 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:43.407 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:43.407 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:43.407 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:43.407 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888811+0000", 2024-09-13T06:40:43.408 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:40:43.408 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:43.408 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:43.408 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:43.408 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888812+0000", 2024-09-13T06:40:43.408 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.204e-06 2024-09-13T06:40:43.408 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:43.408 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:43.408 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:43.408 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888815+0000", 2024-09-13T06:40:43.408 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9359999999999999e-06 2024-09-13T06:40:43.408 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:43.409 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:43.409 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:43.409 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888818+0000", 2024-09-13T06:40:43.409 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.7369999999999998e-06 2024-09-13T06:40:43.409 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:43.409 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:43.409 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:43.409 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.937663+0000", 2024-09-13T06:40:43.409 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.048844540999999998 2024-09-13T06:40:43.409 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:43.409 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:43.409 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:43.409 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.937709+0000", 2024-09-13T06:40:43.410 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6492999999999997e-05 2024-09-13T06:40:43.410 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:43.410 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:43.410 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:43.410 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.937904+0000", 2024-09-13T06:40:43.410 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00019526499999999999 2024-09-13T06:40:43.410 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:43.410 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:43.410 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:43.410 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:43.410 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:43.410 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:21980 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 14245888~4096 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:40:43.410 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.888820+0000", 2024-09-13T06:40:43.411 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 50.516029686000003, 2024-09-13T06:40:43.411 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049357080999999997, 2024-09-13T06:40:43.411 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:43.411 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:43.411 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:43.411 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:43.411 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:43.411 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 21980 2024-09-13T06:40:43.411 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:43.411 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:43.411 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:43.411 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:43.412 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888820+0000", 2024-09-13T06:40:43.412 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:43.412 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:43.412 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:43.412 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:43.412 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888820+0000", 2024-09-13T06:40:43.413 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:43.413 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:43.413 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:43.413 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:43.413 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888820+0000", 2024-09-13T06:40:43.413 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:40:43.413 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:43.413 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:43.413 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:43.413 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888821+0000", 2024-09-13T06:40:43.413 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.122e-06 2024-09-13T06:40:43.413 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:43.413 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:43.414 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:43.414 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888824+0000", 2024-09-13T06:40:43.414 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.0580000000000002e-06 2024-09-13T06:40:43.414 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:43.414 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:43.414 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:43.414 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888827+0000", 2024-09-13T06:40:43.414 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.666e-06 2024-09-13T06:40:43.414 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:43.414 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:43.414 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:43.414 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.937935+0000", 2024-09-13T06:40:43.414 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049108329999999999 2024-09-13T06:40:43.415 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:43.415 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:43.415 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:43.415 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.937985+0000", 2024-09-13T06:40:43.415 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9694000000000002e-05 2024-09-13T06:40:43.415 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:43.415 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:43.415 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:43.415 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.938177+0000", 2024-09-13T06:40:43.415 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00019241899999999999 2024-09-13T06:40:43.415 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:43.415 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:43.415 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:43.416 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:43.416 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:43.416 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:21984 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:snapdir [list-snaps] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:40:43.416 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.888829+0000", 2024-09-13T06:40:43.416 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 50.516020908000002, 2024-09-13T06:40:43.416 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049524545000000003, 2024-09-13T06:40:43.416 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:43.416 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:43.416 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:43.416 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:43.416 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:43.416 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 21984 2024-09-13T06:40:43.416 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:43.417 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:43.417 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:43.417 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:43.417 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888829+0000", 2024-09-13T06:40:43.417 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:43.417 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:43.417 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:43.417 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:43.417 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888829+0000", 2024-09-13T06:40:43.417 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:43.417 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:43.418 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:43.418 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:43.418 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888829+0000", 2024-09-13T06:40:43.418 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:40:43.418 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:43.418 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:43.418 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:43.418 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888830+0000", 2024-09-13T06:40:43.418 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2529999999999999e-06 2024-09-13T06:40:43.418 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:43.418 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:43.419 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:43.419 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888835+0000", 2024-09-13T06:40:43.420 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.4729999999999999e-06 2024-09-13T06:40:43.420 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:43.420 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:43.420 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:43.420 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888840+0000", 2024-09-13T06:40:43.420 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0159999999999999e-06 2024-09-13T06:40:43.420 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:43.420 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:43.420 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:43.421 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.938199+0000", 2024-09-13T06:40:43.421 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049358974999999999 2024-09-13T06:40:43.421 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:43.421 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:43.421 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:43.421 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.938268+0000", 2024-09-13T06:40:43.421 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.8876999999999998e-05 2024-09-13T06:40:43.421 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:43.421 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:43.421 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:43.421 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.938353+0000", 2024-09-13T06:40:43.421 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.5155999999999996e-05 2024-09-13T06:40:43.421 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:43.421 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:43.422 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:43.422 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:43.422 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:43.422 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:21985 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 12587008~4096 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:40:43.422 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.888858+0000", 2024-09-13T06:40:43.422 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 50.515991757999998, 2024-09-13T06:40:43.422 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049674347000000001, 2024-09-13T06:40:43.422 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:43.423 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:43.423 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:43.423 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:43.423 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:43.423 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 21985 2024-09-13T06:40:43.423 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:43.423 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:43.423 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:43.423 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:43.423 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888858+0000", 2024-09-13T06:40:43.423 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:43.423 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:43.423 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:43.423 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:43.424 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888858+0000", 2024-09-13T06:40:43.424 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:43.424 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:43.424 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:43.424 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:43.424 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888857+0000", 2024-09-13T06:40:43.424 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:43.424 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:43.424 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:43.424 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:43.424 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888860+0000", 2024-09-13T06:40:43.424 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4739999999999999e-06 2024-09-13T06:40:43.424 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:43.425 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:43.425 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:43.425 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888867+0000", 2024-09-13T06:40:43.425 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.7170000000000002e-06 2024-09-13T06:40:43.425 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:43.425 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:43.425 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:43.425 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888871+0000", 2024-09-13T06:40:43.425 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5120000000000002e-06 2024-09-13T06:40:43.425 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:43.425 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:43.425 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:43.425 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.938389+0000", 2024-09-13T06:40:43.426 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049517717000000003 2024-09-13T06:40:43.426 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:43.426 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:43.426 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:43.426 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.938449+0000", 2024-09-13T06:40:43.426 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0513999999999997e-05 2024-09-13T06:40:43.426 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:43.426 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:43.426 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:43.426 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.938532+0000", 2024-09-13T06:40:43.426 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.2936999999999996e-05 2024-09-13T06:40:43.426 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:43.426 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:43.426 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:43.427 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:43.427 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:43.427 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:21986 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 12615680~4096 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:40:43.427 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.888875+0000", 2024-09-13T06:40:43.427 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 50.515974245000002, 2024-09-13T06:40:43.427 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049881781, 2024-09-13T06:40:43.427 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:43.427 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:43.427 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:43.427 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:43.427 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:43.427 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 21986 2024-09-13T06:40:43.427 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:43.428 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:43.428 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:43.428 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:43.428 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888875+0000", 2024-09-13T06:40:43.428 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:43.428 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:43.428 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:43.428 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:43.428 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888875+0000", 2024-09-13T06:40:43.428 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:43.428 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:43.428 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:43.429 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:43.429 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888875+0000", 2024-09-13T06:40:43.429 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:43.429 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:43.429 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:43.429 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:43.429 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888880+0000", 2024-09-13T06:40:43.429 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7600000000000002e-06 2024-09-13T06:40:43.429 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:43.429 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:43.429 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:43.429 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888887+0000", 2024-09-13T06:40:43.430 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3950000000000003e-06 2024-09-13T06:40:43.430 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:43.430 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:43.430 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:43.430 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888892+0000", 2024-09-13T06:40:43.430 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0409999999999997e-06 2024-09-13T06:40:43.430 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:43.430 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:43.430 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:43.430 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.938568+0000", 2024-09-13T06:40:43.430 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049675267000000002 2024-09-13T06:40:43.430 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:43.430 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:43.430 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:43.431 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.938653+0000", 2024-09-13T06:40:43.431 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.5792999999999997e-05 2024-09-13T06:40:43.431 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:43.431 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:43.431 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:43.431 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.938757+0000", 2024-09-13T06:40:43.431 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00010387699999999999 2024-09-13T06:40:43.431 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:43.431 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:43.431 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:43.431 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:43.431 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:43.431 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:21987 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 12644352~4096 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:40:43.431 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.888899+0000", 2024-09-13T06:40:43.432 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 50.515950899000003, 2024-09-13T06:40:43.432 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.050094056999999997, 2024-09-13T06:40:43.432 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:43.432 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:43.432 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:43.432 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:43.433 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:43.433 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 21987 2024-09-13T06:40:43.433 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:43.433 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:43.433 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:43.433 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:43.433 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888899+0000", 2024-09-13T06:40:43.433 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:43.433 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:43.434 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:43.434 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:43.434 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888899+0000", 2024-09-13T06:40:43.434 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:43.434 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:43.434 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:43.434 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:43.434 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888899+0000", 2024-09-13T06:40:43.434 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:43.434 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:43.434 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:43.434 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:43.434 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888901+0000", 2024-09-13T06:40:43.435 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2539999999999999e-06 2024-09-13T06:40:43.435 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:43.435 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:43.435 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:43.435 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888907+0000", 2024-09-13T06:40:43.435 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9009999999999999e-06 2024-09-13T06:40:43.435 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:43.435 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:43.435 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:43.435 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888912+0000", 2024-09-13T06:40:43.435 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9840000000000001e-06 2024-09-13T06:40:43.435 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:43.436 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:43.436 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:43.436 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.938810+0000", 2024-09-13T06:40:43.436 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049898835000000002 2024-09-13T06:40:43.436 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:43.436 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:43.436 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:43.436 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.938890+0000", 2024-09-13T06:40:43.436 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.9215000000000006e-05 2024-09-13T06:40:43.436 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:43.436 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:43.436 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:43.436 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.938993+0000", 2024-09-13T06:40:43.437 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000103194 2024-09-13T06:40:43.437 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:43.437 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:43.437 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:43.437 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:43.437 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:43.437 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:21988 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 12673024~4096 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:40:43.437 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.888916+0000", 2024-09-13T06:40:43.437 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 50.515933883000002, 2024-09-13T06:40:43.437 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.050203036999999999, 2024-09-13T06:40:43.437 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:43.437 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:43.437 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:43.438 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:43.438 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:43.438 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 21988 2024-09-13T06:40:43.438 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:43.438 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:43.438 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:43.438 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:43.438 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888916+0000", 2024-09-13T06:40:43.438 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:43.438 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:43.438 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:43.438 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:43.438 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888916+0000", 2024-09-13T06:40:43.439 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:43.439 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:43.439 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:43.439 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:43.439 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888915+0000", 2024-09-13T06:40:43.439 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:43.439 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:43.439 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:43.439 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:43.439 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888918+0000", 2024-09-13T06:40:43.439 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1500000000000002e-06 2024-09-13T06:40:43.439 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:43.439 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:43.439 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:43.440 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888925+0000", 2024-09-13T06:40:43.440 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.9380000000000003e-06 2024-09-13T06:40:43.440 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:43.440 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:43.440 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:43.440 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888933+0000", 2024-09-13T06:40:43.440 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.0560000000000005e-06 2024-09-13T06:40:43.440 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:43.440 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:43.440 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:43.440 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.939026+0000", 2024-09-13T06:40:43.440 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.050093499999999999 2024-09-13T06:40:43.440 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:43.441 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:43.441 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:43.441 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.939068+0000", 2024-09-13T06:40:43.441 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.1705999999999997e-05 2024-09-13T06:40:43.441 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:43.441 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:43.441 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:43.441 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.939119+0000", 2024-09-13T06:40:43.441 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.1048999999999999e-05 2024-09-13T06:40:43.441 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:43.441 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:43.441 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:43.441 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:43.442 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:43.442 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:21989 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 12701696~4096 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:40:43.442 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.888938+0000", 2024-09-13T06:40:43.442 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 50.515911555999999, 2024-09-13T06:40:43.442 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.050294393999999999, 2024-09-13T06:40:43.442 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:43.442 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:43.442 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:43.442 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:43.442 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:43.442 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 21989 2024-09-13T06:40:43.442 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:43.442 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:43.443 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:43.443 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:43.443 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888938+0000", 2024-09-13T06:40:43.443 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:43.443 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:43.443 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:43.443 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:43.443 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888938+0000", 2024-09-13T06:40:43.443 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:43.443 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:43.443 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:43.443 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:43.443 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888938+0000", 2024-09-13T06:40:43.444 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:43.444 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:43.444 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:43.444 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:43.444 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888940+0000", 2024-09-13T06:40:43.444 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5330000000000001e-06 2024-09-13T06:40:43.444 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:43.444 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:43.444 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:43.444 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888947+0000", 2024-09-13T06:40:43.444 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.2389999999999999e-06 2024-09-13T06:40:43.444 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:43.444 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:43.444 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:43.445 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888952+0000", 2024-09-13T06:40:43.445 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.5720000000000002e-06 2024-09-13T06:40:43.445 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:43.445 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:43.445 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:43.445 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.939141+0000", 2024-09-13T06:40:43.445 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.050188903999999999 2024-09-13T06:40:43.445 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:43.445 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:43.445 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:43.445 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.939182+0000", 2024-09-13T06:40:43.445 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.0926000000000001e-05 2024-09-13T06:40:43.445 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:43.445 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:43.446 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:43.446 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.939233+0000", 2024-09-13T06:40:43.446 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0532999999999999e-05 2024-09-13T06:40:43.446 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:43.446 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:43.446 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:43.446 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:43.446 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:43.446 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:22006 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 13189120~4096 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:40:43.446 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.892763+0000", 2024-09-13T06:40:43.446 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 50.512087030000004, 2024-09-13T06:40:43.446 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.048963505999999997, 2024-09-13T06:40:43.446 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:43.446 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:43.447 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:43.447 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:43.447 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:43.447 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 22006 2024-09-13T06:40:43.447 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:43.447 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:43.447 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:43.447 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:43.447 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892763+0000", 2024-09-13T06:40:43.447 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:43.447 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:43.447 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:43.447 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:43.448 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892763+0000", 2024-09-13T06:40:43.448 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:43.448 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:43.448 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:43.448 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:43.448 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892763+0000", 2024-09-13T06:40:43.448 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:40:43.448 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:43.448 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:43.448 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:43.448 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892764+0000", 2024-09-13T06:40:43.448 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2410000000000001e-06 2024-09-13T06:40:43.448 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:43.449 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:43.449 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:43.449 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892767+0000", 2024-09-13T06:40:43.449 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9390000000000002e-06 2024-09-13T06:40:43.449 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:43.449 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:43.449 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:43.449 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892769+0000", 2024-09-13T06:40:43.449 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5390000000000002e-06 2024-09-13T06:40:43.449 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:43.449 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:43.449 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:43.449 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.941560+0000", 2024-09-13T06:40:43.449 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.048791221000000003 2024-09-13T06:40:43.450 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:43.450 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:43.450 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:43.450 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.941632+0000", 2024-09-13T06:40:43.450 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.1932000000000002e-05 2024-09-13T06:40:43.450 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:43.450 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:43.450 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:43.450 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.941726+0000", 2024-09-13T06:40:43.450 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.3839999999999996e-05 2024-09-13T06:40:43.450 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:43.450 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:43.450 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:43.450 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:43.451 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:43.451 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:22007 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 13217792~4096 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:40:43.451 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.892771+0000", 2024-09-13T06:40:43.451 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 50.512078449999997, 2024-09-13T06:40:43.451 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049090024000000003, 2024-09-13T06:40:43.451 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:43.451 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:43.451 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:43.451 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:43.451 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:43.451 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 22007 2024-09-13T06:40:43.451 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:43.451 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:43.452 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:43.452 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:43.452 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892771+0000", 2024-09-13T06:40:43.452 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:43.452 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:43.452 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:43.452 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:43.452 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892771+0000", 2024-09-13T06:40:43.452 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:43.452 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:43.452 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:43.452 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:43.453 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892771+0000", 2024-09-13T06:40:43.453 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:40:43.453 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:43.453 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:43.453 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:43.453 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892772+0000", 2024-09-13T06:40:43.453 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.184e-06 2024-09-13T06:40:43.453 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:43.453 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:43.453 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:43.453 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892775+0000", 2024-09-13T06:40:43.453 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9179999999999998e-06 2024-09-13T06:40:43.453 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:43.454 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:43.454 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:43.454 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892778+0000", 2024-09-13T06:40:43.454 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4990000000000001e-06 2024-09-13T06:40:43.454 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:43.454 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:43.454 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:43.454 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.941760+0000", 2024-09-13T06:40:43.454 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.048982070000000003 2024-09-13T06:40:43.454 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:43.454 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:43.454 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:43.454 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.941808+0000", 2024-09-13T06:40:43.454 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.8278000000000001e-05 2024-09-13T06:40:43.455 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:43.455 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:43.455 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:43.455 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.941861+0000", 2024-09-13T06:40:43.455 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3284e-05 2024-09-13T06:40:43.455 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:43.455 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:43.455 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:43.455 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:43.455 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:43.455 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:22008 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 13246464~4096 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:40:43.455 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.892780+0000", 2024-09-13T06:40:43.455 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 50.512069793000002, 2024-09-13T06:40:43.456 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049200477999999999, 2024-09-13T06:40:43.456 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:43.456 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:43.456 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:43.456 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:43.456 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:43.456 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 22008 2024-09-13T06:40:43.456 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:43.456 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:43.456 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:43.456 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:43.456 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892780+0000", 2024-09-13T06:40:43.457 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:43.457 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:43.457 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:43.457 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:43.457 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892780+0000", 2024-09-13T06:40:43.457 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:43.457 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:43.457 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:43.457 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:43.457 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892780+0000", 2024-09-13T06:40:43.457 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:40:43.457 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:43.458 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:43.458 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:43.458 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892781+0000", 2024-09-13T06:40:43.458 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.083e-06 2024-09-13T06:40:43.458 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:43.458 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:43.458 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:43.458 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892784+0000", 2024-09-13T06:40:43.458 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.926e-06 2024-09-13T06:40:43.458 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:43.458 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:43.458 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:43.458 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892786+0000", 2024-09-13T06:40:43.459 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4490000000000002e-06 2024-09-13T06:40:43.459 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:43.459 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:43.459 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:43.459 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.941888+0000", 2024-09-13T06:40:43.459 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049102290999999999 2024-09-13T06:40:43.459 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:43.459 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:43.459 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:43.459 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.941929+0000", 2024-09-13T06:40:43.459 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.0541999999999999e-05 2024-09-13T06:40:43.459 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:43.460 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:43.460 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:43.460 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.941980+0000", 2024-09-13T06:40:43.460 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.1391999999999999e-05 2024-09-13T06:40:43.460 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:43.460 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:43.460 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:43.460 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:43.460 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:43.460 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:22009 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 13275136~4096 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:40:43.460 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.892788+0000", 2024-09-13T06:40:43.460 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 50.512061309000003, 2024-09-13T06:40:43.460 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049311926999999998, 2024-09-13T06:40:43.461 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:43.461 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:43.461 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:43.461 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:43.461 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:43.461 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 22009 2024-09-13T06:40:43.461 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:43.461 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:43.461 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:43.461 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:43.461 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892788+0000", 2024-09-13T06:40:43.461 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:43.462 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:43.462 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:43.462 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:43.462 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892788+0000", 2024-09-13T06:40:43.462 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:43.462 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:43.462 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:43.462 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:43.462 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892788+0000", 2024-09-13T06:40:43.462 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:40:43.462 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:43.462 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:43.462 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:43.462 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892789+0000", 2024-09-13T06:40:43.463 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1850000000000001e-06 2024-09-13T06:40:43.463 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:43.463 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:43.463 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:43.463 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892793+0000", 2024-09-13T06:40:43.463 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.9099999999999998e-06 2024-09-13T06:40:43.463 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:43.463 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:43.463 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:43.463 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892798+0000", 2024-09-13T06:40:43.463 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5070000000000002e-06 2024-09-13T06:40:43.463 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:43.463 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:43.463 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:43.464 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.942007+0000", 2024-09-13T06:40:43.464 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049208904999999997 2024-09-13T06:40:43.464 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:43.464 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:43.464 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:43.464 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.942049+0000", 2024-09-13T06:40:43.464 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.1922000000000003e-05 2024-09-13T06:40:43.464 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:43.464 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:43.464 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:43.464 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.942100+0000", 2024-09-13T06:40:43.464 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.1736000000000001e-05 2024-09-13T06:40:43.464 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:43.464 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:43.465 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:43.465 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:43.465 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:43.465 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:22010 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 13303808~4096 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:40:43.465 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.892817+0000", 2024-09-13T06:40:43.465 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 50.512033113000001, 2024-09-13T06:40:43.465 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049466149000000001, 2024-09-13T06:40:43.465 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:43.465 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:43.465 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:43.465 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:43.465 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:43.465 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 22010 2024-09-13T06:40:43.466 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:43.466 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:43.466 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:43.466 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:43.466 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892817+0000", 2024-09-13T06:40:43.466 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:43.466 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:43.466 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:43.466 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:43.466 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892817+0000", 2024-09-13T06:40:43.466 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:43.466 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:43.466 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:43.466 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:43.467 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892816+0000", 2024-09-13T06:40:43.467 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:43.467 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:43.467 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:43.467 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:43.467 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892821+0000", 2024-09-13T06:40:43.467 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9459999999999997e-06 2024-09-13T06:40:43.467 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:43.467 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:43.467 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:43.467 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892828+0000", 2024-09-13T06:40:43.467 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.6780000000000003e-06 2024-09-13T06:40:43.467 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:43.467 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:43.468 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:43.468 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892833+0000", 2024-09-13T06:40:43.468 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.8389999999999997e-06 2024-09-13T06:40:43.468 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:43.468 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:43.468 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:43.468 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.942127+0000", 2024-09-13T06:40:43.468 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049294163000000002 2024-09-13T06:40:43.468 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:43.468 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:43.468 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:43.468 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.942186+0000", 2024-09-13T06:40:43.468 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9335e-05 2024-09-13T06:40:43.469 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:43.469 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:43.469 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:43.469 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.942283+0000", 2024-09-13T06:40:43.469 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.6699000000000004e-05 2024-09-13T06:40:43.469 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:43.469 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:43.469 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:43.469 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:43.469 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:43.469 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:22011 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 13332480~4096 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:40:43.469 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.892838+0000", 2024-09-13T06:40:43.469 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 50.512011426000001, 2024-09-13T06:40:43.469 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049589214, 2024-09-13T06:40:43.470 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:43.470 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:43.470 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:43.470 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:43.470 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:43.470 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 22011 2024-09-13T06:40:43.470 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:43.470 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:43.470 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:43.470 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:43.470 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892838+0000", 2024-09-13T06:40:43.470 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:43.470 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:43.470 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:43.471 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:43.471 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892838+0000", 2024-09-13T06:40:43.471 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:43.471 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:43.471 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:43.471 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:43.471 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892838+0000", 2024-09-13T06:40:43.471 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:43.471 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:43.471 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:43.471 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:43.471 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892840+0000", 2024-09-13T06:40:43.471 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.136e-06 2024-09-13T06:40:43.471 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:43.472 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:43.472 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:43.472 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892852+0000", 2024-09-13T06:40:43.472 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2122e-05 2024-09-13T06:40:43.472 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:43.472 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:43.472 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:43.472 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892862+0000", 2024-09-13T06:40:43.472 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.7049999999999994e-06 2024-09-13T06:40:43.472 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:43.472 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:43.472 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:43.472 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.942319+0000", 2024-09-13T06:40:43.472 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049456623999999998 2024-09-13T06:40:43.473 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:43.473 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:43.473 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:43.473 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.942363+0000", 2024-09-13T06:40:43.473 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4759000000000003e-05 2024-09-13T06:40:43.473 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:43.473 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:43.473 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:43.473 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.942428+0000", 2024-09-13T06:40:43.473 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.4221999999999996e-05 2024-09-13T06:40:43.473 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:43.473 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:43.473 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:43.474 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:43.474 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:43.474 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:22033 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 13963264~4096 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:40:43.474 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.896824+0000", 2024-09-13T06:40:43.474 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 50.508025533000001, 2024-09-13T06:40:43.474 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049051957, 2024-09-13T06:40:43.474 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:43.474 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:43.474 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:43.474 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:43.474 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:43.474 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 22033 2024-09-13T06:40:43.474 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:43.474 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:43.475 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:43.475 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:43.475 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.896824+0000", 2024-09-13T06:40:43.475 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:43.475 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:43.475 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:43.475 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:43.475 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.896824+0000", 2024-09-13T06:40:43.475 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:43.475 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:43.475 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:43.475 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:43.475 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.896824+0000", 2024-09-13T06:40:43.475 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:43.476 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:43.476 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:43.476 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:43.476 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.896826+0000", 2024-09-13T06:40:43.476 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1900000000000002e-06 2024-09-13T06:40:43.476 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:43.476 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:43.476 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:43.476 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.896832+0000", 2024-09-13T06:40:43.476 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.2689999999999996e-06 2024-09-13T06:40:43.476 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:43.476 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:43.476 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:43.477 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.896840+0000", 2024-09-13T06:40:43.477 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3289999999999996e-06 2024-09-13T06:40:43.477 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:43.477 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:43.477 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:43.477 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.945777+0000", 2024-09-13T06:40:43.477 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.048937188 2024-09-13T06:40:43.477 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:43.477 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:43.477 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:43.477 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.945822+0000", 2024-09-13T06:40:43.477 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4780999999999997e-05 2024-09-13T06:40:43.477 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:43.478 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:43.478 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:43.478 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.945876+0000", 2024-09-13T06:40:43.478 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.4542000000000001e-05 2024-09-13T06:40:43.478 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:43.478 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:43.478 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:43.478 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:43.478 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:43.478 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:22337 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 13582336~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:40:43.478 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.951039+0000", 2024-09-13T06:40:43.478 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 50.453811195999997, 2024-09-13T06:40:43.478 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.048942765999999999, 2024-09-13T06:40:43.479 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:43.479 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:43.479 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:43.479 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:43.479 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:43.479 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 22337 2024-09-13T06:40:43.479 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:43.479 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:43.479 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:43.479 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:43.479 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951039+0000", 2024-09-13T06:40:43.479 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:43.479 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:43.479 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:43.480 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:43.480 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951039+0000", 2024-09-13T06:40:43.480 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:43.480 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:43.480 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:43.480 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:43.480 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951038+0000", 2024-09-13T06:40:43.480 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:43.480 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:43.480 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:43.480 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:43.480 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951040+0000", 2024-09-13T06:40:43.480 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0669999999999999e-06 2024-09-13T06:40:43.481 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:43.481 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:43.481 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:43.481 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951048+0000", 2024-09-13T06:40:43.481 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.588e-06 2024-09-13T06:40:43.481 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:43.481 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:43.481 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:43.481 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951053+0000", 2024-09-13T06:40:43.481 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3669999999999996e-06 2024-09-13T06:40:43.481 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:43.481 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:43.481 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:43.482 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.999889+0000", 2024-09-13T06:40:43.482 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.048835515000000003 2024-09-13T06:40:43.482 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:43.482 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:43.482 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:43.482 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.999929+0000", 2024-09-13T06:40:43.482 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.0030000000000001e-05 2024-09-13T06:40:43.482 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:43.482 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:43.482 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:43.482 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.999981+0000", 2024-09-13T06:40:43.482 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2583999999999997e-05 2024-09-13T06:40:43.482 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:43.482 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:43.483 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:43.483 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:43.483 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:43.483 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:22338 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 13611008~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:40:43.483 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.951070+0000", 2024-09-13T06:40:43.483 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 50.453779904999998, 2024-09-13T06:40:43.483 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049135817999999998, 2024-09-13T06:40:43.483 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:43.483 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:43.483 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:43.483 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:43.483 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:43.484 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 22338 2024-09-13T06:40:43.484 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:43.484 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:43.484 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:43.484 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:43.484 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951070+0000", 2024-09-13T06:40:43.484 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:43.484 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:43.484 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:43.484 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:43.484 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951070+0000", 2024-09-13T06:40:43.484 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:43.484 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:43.485 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:43.485 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:43.485 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951069+0000", 2024-09-13T06:40:43.485 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:43.485 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:43.485 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:43.485 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:43.485 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951072+0000", 2024-09-13T06:40:43.485 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5909999999999998e-06 2024-09-13T06:40:43.485 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:43.485 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:43.485 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:43.486 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951078+0000", 2024-09-13T06:40:43.486 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.4450000000000001e-06 2024-09-13T06:40:43.486 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:43.486 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:43.486 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:43.486 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951083+0000", 2024-09-13T06:40:43.486 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7790000000000003e-06 2024-09-13T06:40:43.486 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:43.486 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:43.486 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:43.486 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:53.000020+0000", 2024-09-13T06:40:43.486 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.048936999000000002 2024-09-13T06:40:43.486 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:43.486 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:43.487 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:43.487 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:53.000106+0000", 2024-09-13T06:40:43.487 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.5532999999999996e-05 2024-09-13T06:40:43.487 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:43.487 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:43.487 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:43.487 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:53.000206+0000", 2024-09-13T06:40:43.487 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.9852999999999994e-05 2024-09-13T06:40:43.487 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:43.487 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:43.487 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:43.487 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:43.487 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:43.487 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:22339 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 13639680~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:40:43.488 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.951088+0000", 2024-09-13T06:40:43.488 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 50.453762206999997, 2024-09-13T06:40:43.488 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049238202000000002, 2024-09-13T06:40:43.488 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:43.488 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:43.488 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:43.488 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:43.488 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:43.488 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 22339 2024-09-13T06:40:43.488 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:43.488 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:43.488 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:43.488 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:43.489 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951088+0000", 2024-09-13T06:40:43.489 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:43.489 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:43.489 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:43.489 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:43.489 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951088+0000", 2024-09-13T06:40:43.489 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:43.489 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:43.489 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:43.489 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:43.489 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951087+0000", 2024-09-13T06:40:43.489 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:43.489 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:43.490 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:43.490 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:43.490 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951089+0000", 2024-09-13T06:40:43.490 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.153e-06 2024-09-13T06:40:43.490 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:43.490 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:43.490 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:43.490 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951093+0000", 2024-09-13T06:40:43.490 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.7120000000000002e-06 2024-09-13T06:40:43.490 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:43.490 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:43.490 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:43.490 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951096+0000", 2024-09-13T06:40:43.490 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.0570000000000001e-06 2024-09-13T06:40:43.491 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:43.491 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:43.491 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:43.491 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:53.000220+0000", 2024-09-13T06:40:43.491 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049123989 2024-09-13T06:40:43.491 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:43.491 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:43.491 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:43.491 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:53.000271+0000", 2024-09-13T06:40:43.491 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.062e-05 2024-09-13T06:40:43.491 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:43.491 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:43.491 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:43.492 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:53.000326+0000", 2024-09-13T06:40:43.492 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.5121000000000003e-05 2024-09-13T06:40:43.492 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:43.492 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:43.492 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:43.492 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:43.492 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:43.492 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:22340 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 13668352~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:40:43.492 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.951200+0000", 2024-09-13T06:40:43.492 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 50.453649317999997, 2024-09-13T06:40:43.492 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049352350000000003, 2024-09-13T06:40:43.492 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:43.492 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:43.493 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:43.493 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:43.493 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:43.493 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 22340 2024-09-13T06:40:43.493 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:43.493 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:43.493 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:43.493 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:43.493 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951200+0000", 2024-09-13T06:40:43.493 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:43.493 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:43.493 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:43.493 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:43.493 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951200+0000", 2024-09-13T06:40:43.494 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:43.494 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:43.494 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:43.494 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:43.494 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951098+0000", 2024-09-13T06:40:43.494 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.999898 2024-09-13T06:40:43.494 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:43.494 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:43.494 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:43.494 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951204+0000", 2024-09-13T06:40:43.494 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000105398 2024-09-13T06:40:43.494 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:43.494 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:43.494 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:43.495 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951211+0000", 2024-09-13T06:40:43.495 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.43e-06 2024-09-13T06:40:43.495 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:43.495 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:43.495 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:43.495 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951216+0000", 2024-09-13T06:40:43.495 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2800000000000003e-06 2024-09-13T06:40:43.495 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:43.495 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:43.495 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:43.495 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:53.000358+0000", 2024-09-13T06:40:43.495 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049142036 2024-09-13T06:40:43.495 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:43.496 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:43.496 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:43.496 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:53.000443+0000", 2024-09-13T06:40:43.496 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.4710999999999996e-05 2024-09-13T06:40:43.496 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:43.496 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:43.496 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:43.496 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:53.000553+0000", 2024-09-13T06:40:43.496 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000109622 2024-09-13T06:40:43.496 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:43.496 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:43.496 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:43.496 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:43.496 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:43.497 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:22348 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 13897728~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:40:43.497 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.952783+0000", 2024-09-13T06:40:43.497 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 50.452066530000003, 2024-09-13T06:40:43.497 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049120832000000003, 2024-09-13T06:40:43.497 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:43.497 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:43.497 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:43.497 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:43.497 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:43.497 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 22348 2024-09-13T06:40:43.497 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:43.497 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:43.497 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:43.498 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:43.498 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.952783+0000", 2024-09-13T06:40:43.498 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:43.498 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:43.498 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:43.498 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:43.498 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.952783+0000", 2024-09-13T06:40:43.498 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:43.498 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:43.498 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:43.498 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:43.498 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.952783+0000", 2024-09-13T06:40:43.498 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:43.499 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:43.499 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:43.499 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:43.499 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.952785+0000", 2024-09-13T06:40:43.499 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4980000000000001e-06 2024-09-13T06:40:43.499 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:43.499 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:43.499 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:43.499 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.952799+0000", 2024-09-13T06:40:43.499 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3825000000000001e-05 2024-09-13T06:40:43.499 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:43.499 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:43.499 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:43.499 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.952809+0000", 2024-09-13T06:40:43.500 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0043e-05 2024-09-13T06:40:43.500 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:43.500 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:43.500 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:43.500 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:53.001723+0000", 2024-09-13T06:40:43.500 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.048914065 2024-09-13T06:40:43.500 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:43.500 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:43.500 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:43.500 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:53.001807+0000", 2024-09-13T06:40:43.500 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.3776000000000006e-05 2024-09-13T06:40:43.500 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:43.500 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:43.501 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:43.501 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:53.001904+0000", 2024-09-13T06:40:43.501 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.7004999999999997e-05 2024-09-13T06:40:43.501 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:43.501 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:43.501 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:43.501 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:43.501 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:43.501 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:40:43.502 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-13T06:40:43.503 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-13T06:40:43.504 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:40:43.504+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:40:43.604 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:40:43.601+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:40:43.669 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:40:43.669 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-13T06:40:43.669 INFO:teuthology.orchestra.run.smithi081.stdout: "num_ops": 0 2024-09-13T06:40:43.669 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:40:43.682 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-13T06:40:43.705 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:40:43.705+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:40:43.793 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:40:43.793 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-13T06:40:43.793 INFO:teuthology.orchestra.run.smithi081.stdout: "complaint_time": 30, 2024-09-13T06:40:43.794 INFO:teuthology.orchestra.run.smithi081.stdout: "num_blocked_ops": 0 2024-09-13T06:40:43.794 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:40:43.805 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:40:43.808+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:40:43.808 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-13T06:40:43.906 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:40:43.905+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:40:43.970 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:40:43.970 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 20, 2024-09-13T06:40:43.970 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 600, 2024-09-13T06:40:43.970 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [ 2024-09-13T06:40:43.970 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:43.970 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:36160 3.f 3:f62782c2:::rbd_object_map.11219660270d.0000000000000016:head [call] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-13T06:40:43.970 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:01.607291+0000", 2024-09-13T06:40:43.971 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 42.362688202000001, 2024-09-13T06:40:43.971 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.99619456699999998, 2024-09-13T06:40:43.971 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:43.971 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:43.971 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:43.971 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:43.971 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:43.971 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 36160 2024-09-13T06:40:43.971 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:43.971 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:43.971 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:43.971 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:43.971 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:01.607291+0000", 2024-09-13T06:40:43.971 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:43.972 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:43.972 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:43.972 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:43.972 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:01.607291+0000", 2024-09-13T06:40:43.972 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:43.972 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:43.972 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:43.972 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:43.972 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:01.607289+0000", 2024-09-13T06:40:43.972 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999976 2024-09-13T06:40:43.972 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:43.972 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:43.972 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:43.973 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:01.607302+0000", 2024-09-13T06:40:43.973 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3018e-05 2024-09-13T06:40:43.973 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:43.973 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:43.973 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:43.973 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:01.607323+0000", 2024-09-13T06:40:43.973 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1030999999999999e-05 2024-09-13T06:40:43.973 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:43.973 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:43.973 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:43.973 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:01.607342+0000", 2024-09-13T06:40:43.973 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8961e-05 2024-09-13T06:40:43.973 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:43.973 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:43.974 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:43.974 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:01.607425+0000", 2024-09-13T06:40:43.974 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.3171999999999996e-05 2024-09-13T06:40:43.974 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:43.974 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:43.974 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:40:43.974 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:01.607441+0000", 2024-09-13T06:40:43.974 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5996999999999999e-05 2024-09-13T06:40:43.974 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:43.974 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:43.974 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:43.974 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:02.596186+0000", 2024-09-13T06:40:43.974 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.98874432000000001 2024-09-13T06:40:43.975 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:43.975 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:43.975 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for missing object", 2024-09-13T06:40:43.975 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:02.596618+0000", 2024-09-13T06:40:43.975 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000432032 2024-09-13T06:40:43.975 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:43.975 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:43.975 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:43.975 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:02.600845+0000", 2024-09-13T06:40:43.975 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0042277410000000001 2024-09-13T06:40:43.975 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:43.975 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:43.975 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:43.975 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:02.601003+0000", 2024-09-13T06:40:43.975 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00015731999999999999 2024-09-13T06:40:43.976 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:43.976 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:43.976 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:43.976 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:02.603486+0000", 2024-09-13T06:40:43.976 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0024832510000000001 2024-09-13T06:40:43.976 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:43.976 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:43.976 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:43.976 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:43.976 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:43.976 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:37806 3.9 3:951cb95b:::rbd_data.1121d8143c6e.0000000000000002:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e56)", 2024-09-13T06:40:43.976 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:06.373482+0000", 2024-09-13T06:40:43.976 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 37.596497165999999, 2024-09-13T06:40:43.976 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.002476213, 2024-09-13T06:40:43.977 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:43.977 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:43.977 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:43.977 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:43.977 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:43.977 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 37806 2024-09-13T06:40:43.977 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:43.977 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:43.977 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:43.977 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:43.977 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.373482+0000", 2024-09-13T06:40:43.977 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:43.977 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:43.978 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:43.978 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:43.978 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.373482+0000", 2024-09-13T06:40:43.978 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:43.978 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:43.978 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:43.978 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:43.978 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.373479+0000", 2024-09-13T06:40:43.978 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999962 2024-09-13T06:40:43.978 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:43.978 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:43.978 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:43.978 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.373495+0000", 2024-09-13T06:40:43.979 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6640999999999999e-05 2024-09-13T06:40:43.979 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:43.979 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:43.979 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:43.979 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.373542+0000", 2024-09-13T06:40:43.979 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6229000000000001e-05 2024-09-13T06:40:43.979 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:43.979 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:43.979 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:43.979 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.373564+0000", 2024-09-13T06:40:43.979 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2684000000000002e-05 2024-09-13T06:40:43.979 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:43.979 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:43.979 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:43.980 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374268+0000", 2024-09-13T06:40:43.980 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00070363700000000001 2024-09-13T06:40:43.980 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:43.980 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:43.980 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:40:43.980 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374305+0000", 2024-09-13T06:40:43.980 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.6936e-05 2024-09-13T06:40:43.980 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:43.980 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:43.980 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:43.980 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.375175+0000", 2024-09-13T06:40:43.980 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.000870454 2024-09-13T06:40:43.980 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:43.980 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:43.981 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:43.981 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.375678+0000", 2024-09-13T06:40:43.981 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00050292499999999999 2024-09-13T06:40:43.981 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:43.981 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:43.981 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:43.981 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.375959+0000", 2024-09-13T06:40:43.981 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00028050599999999997 2024-09-13T06:40:43.981 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:43.981 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:43.981 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:43.981 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:43.981 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:43.982 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:37821 3.9 3:951cb95b:::rbd_data.1121d8143c6e.0000000000000002:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e56)", 2024-09-13T06:40:43.982 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:06.374454+0000", 2024-09-13T06:40:43.982 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 37.595526049, 2024-09-13T06:40:43.982 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.002545072, 2024-09-13T06:40:43.982 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:43.982 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:43.982 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:43.982 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:43.982 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:43.982 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 37821 2024-09-13T06:40:43.982 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:43.982 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:43.982 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:43.982 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:43.983 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374454+0000", 2024-09-13T06:40:43.983 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:43.983 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:43.983 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:43.983 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:43.983 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374454+0000", 2024-09-13T06:40:43.983 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:43.983 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:43.983 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:43.983 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:43.983 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374452+0000", 2024-09-13T06:40:43.983 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999981 2024-09-13T06:40:43.983 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:43.984 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:43.984 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:43.984 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374463+0000", 2024-09-13T06:40:43.984 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0756e-05 2024-09-13T06:40:43.984 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:43.984 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:43.984 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:43.984 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374487+0000", 2024-09-13T06:40:43.984 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4887000000000001e-05 2024-09-13T06:40:43.984 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:43.984 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:43.984 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:43.984 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374504+0000", 2024-09-13T06:40:43.984 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6852000000000001e-05 2024-09-13T06:40:43.985 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:43.985 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:43.985 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:43.985 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374829+0000", 2024-09-13T06:40:43.985 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000324684 2024-09-13T06:40:43.985 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:43.985 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:43.985 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:40:43.985 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374880+0000", 2024-09-13T06:40:43.985 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.1378000000000002e-05 2024-09-13T06:40:43.985 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:43.985 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:43.985 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:43.986 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.376423+0000", 2024-09-13T06:40:43.986 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.001542734 2024-09-13T06:40:43.986 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:43.986 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:43.986 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:43.986 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.376607+0000", 2024-09-13T06:40:43.986 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000183656 2024-09-13T06:40:43.986 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:43.986 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:43.986 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:43.986 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.376999+0000", 2024-09-13T06:40:43.986 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00039191200000000001 2024-09-13T06:40:43.986 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:43.986 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:43.987 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:43.987 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:43.987 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:43.987 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:37836 3.9 3:951cb95b:::rbd_data.1121d8143c6e.0000000000000002:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e56)", 2024-09-13T06:40:43.987 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:06.374929+0000", 2024-09-13T06:40:43.987 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 37.595050397000001, 2024-09-13T06:40:43.987 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.002778825, 2024-09-13T06:40:43.987 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:43.987 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:43.987 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:43.987 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:43.987 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:43.987 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 37836 2024-09-13T06:40:43.988 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:43.988 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:43.988 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:43.988 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:43.988 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374929+0000", 2024-09-13T06:40:43.988 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:43.988 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:43.988 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:43.988 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:43.988 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374929+0000", 2024-09-13T06:40:43.988 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:43.988 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:43.988 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:43.988 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:43.989 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374927+0000", 2024-09-13T06:40:43.989 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999981 2024-09-13T06:40:43.989 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:43.989 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:43.989 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:43.989 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374939+0000", 2024-09-13T06:40:43.989 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1846e-05 2024-09-13T06:40:43.989 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:43.989 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:43.989 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:43.989 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374962+0000", 2024-09-13T06:40:43.989 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3054e-05 2024-09-13T06:40:43.989 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:43.990 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:43.990 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:43.990 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374978+0000", 2024-09-13T06:40:43.990 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5899000000000001e-05 2024-09-13T06:40:43.990 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:43.990 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:43.990 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:43.990 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.375106+0000", 2024-09-13T06:40:43.990 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00012789 2024-09-13T06:40:43.990 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:43.990 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:43.990 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:40:43.990 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.375134+0000", 2024-09-13T06:40:43.990 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.8254000000000001e-05 2024-09-13T06:40:43.991 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:43.991 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:43.991 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:43.991 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.377082+0000", 2024-09-13T06:40:43.991 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0019471520000001 2024-09-13T06:40:43.991 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:43.991 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:43.991 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:43.991 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.377330+0000", 2024-09-13T06:40:43.991 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00024834199999999997 2024-09-13T06:40:43.991 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:43.991 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:43.991 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:43.992 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.377708+0000", 2024-09-13T06:40:43.992 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00037817100000000001 2024-09-13T06:40:43.992 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:43.992 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:43.992 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:43.992 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:43.992 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:43.992 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:37851 3.9 3:951cb95b:::rbd_data.1121d8143c6e.0000000000000002:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e56)", 2024-09-13T06:40:43.992 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:06.382636+0000", 2024-09-13T06:40:43.992 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 37.587343511999997, 2024-09-13T06:40:43.992 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.99582539400000003, 2024-09-13T06:40:43.992 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:43.992 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:43.993 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:43.993 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:43.993 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:43.993 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 37851 2024-09-13T06:40:43.993 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:43.993 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:43.993 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:43.993 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:43.993 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.382636+0000", 2024-09-13T06:40:43.993 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:43.993 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:43.993 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:43.993 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:43.993 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.382636+0000", 2024-09-13T06:40:43.994 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:43.994 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:43.994 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:43.994 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:43.994 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.382633+0000", 2024-09-13T06:40:43.994 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999971 2024-09-13T06:40:43.994 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:43.994 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:43.994 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:43.994 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.382652+0000", 2024-09-13T06:40:43.994 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8834999999999998e-05 2024-09-13T06:40:43.994 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:43.994 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:43.995 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:43.995 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.382695+0000", 2024-09-13T06:40:43.995 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.3136000000000002e-05 2024-09-13T06:40:43.995 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:43.995 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:43.995 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:43.995 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.382716+0000", 2024-09-13T06:40:43.995 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1421e-05 2024-09-13T06:40:43.995 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:43.995 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:43.995 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:43.995 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.382860+0000", 2024-09-13T06:40:43.995 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00014389200000000001 2024-09-13T06:40:43.995 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:43.996 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:43.996 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:40:43.996 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.382890+0000", 2024-09-13T06:40:43.996 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9827000000000001e-05 2024-09-13T06:40:43.996 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:43.996 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:43.996 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:43.996 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.377779+0000", 2024-09-13T06:40:43.996 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.99488842899999996 2024-09-13T06:40:43.996 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:43.997 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:43.997 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:43.997 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.378007+0000", 2024-09-13T06:40:43.997 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00022838099999999999 2024-09-13T06:40:43.997 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:43.997 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:43.997 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:43.997 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.378462+0000", 2024-09-13T06:40:43.997 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00045452300000000003 2024-09-13T06:40:43.997 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:43.997 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:43.997 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:43.997 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:43.997 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.001 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:37866 3.9 3:951cb95b:::rbd_data.1121d8143c6e.0000000000000002:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e56)", 2024-09-13T06:40:44.001 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:06.383951+0000", 2024-09-13T06:40:44.001 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 37.586028826000003, 2024-09-13T06:40:44.001 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.99517962299999996, 2024-09-13T06:40:44.001 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:44.001 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:44.001 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:44.001 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:44.001 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:44.001 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 37866 2024-09-13T06:40:44.001 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.001 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:44.001 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.002 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:44.002 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.383951+0000", 2024-09-13T06:40:44.002 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:44.002 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.002 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.002 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:44.002 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.383951+0000", 2024-09-13T06:40:44.002 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:44.002 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.002 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.002 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:44.002 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.383949+0000", 2024-09-13T06:40:44.002 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999981 2024-09-13T06:40:44.003 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.003 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.003 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:44.003 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.383961+0000", 2024-09-13T06:40:44.003 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1999e-05 2024-09-13T06:40:44.003 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.003 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.003 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:44.003 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384019+0000", 2024-09-13T06:40:44.003 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7621000000000003e-05 2024-09-13T06:40:44.003 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.003 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.003 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:44.003 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384040+0000", 2024-09-13T06:40:44.004 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1528000000000001e-05 2024-09-13T06:40:44.004 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.004 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.004 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:44.004 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384186+0000", 2024-09-13T06:40:44.004 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00014573799999999999 2024-09-13T06:40:44.004 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.004 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.004 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:40:44.004 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384204+0000", 2024-09-13T06:40:44.004 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7992e-05 2024-09-13T06:40:44.004 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.004 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.005 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:44.005 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.378536+0000", 2024-09-13T06:40:44.005 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.99433268600000002 2024-09-13T06:40:44.005 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.005 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.005 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:44.005 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.378771+0000", 2024-09-13T06:40:44.005 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00023445399999999999 2024-09-13T06:40:44.005 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.005 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.005 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:44.005 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.379130+0000", 2024-09-13T06:40:44.005 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00035954200000000002 2024-09-13T06:40:44.005 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:44.006 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:44.006 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:44.006 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.006 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.006 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:37881 3.9 3:951cb95b:::rbd_data.1121d8143c6e.0000000000000002:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e56)", 2024-09-13T06:40:44.006 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:06.384239+0000", 2024-09-13T06:40:44.006 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 37.585740412, 2024-09-13T06:40:44.006 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.99541483500000005, 2024-09-13T06:40:44.006 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:44.006 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:44.006 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:44.006 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:44.006 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:44.007 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 37881 2024-09-13T06:40:44.007 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.007 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:44.007 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.007 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:44.007 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384239+0000", 2024-09-13T06:40:44.007 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:44.007 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.007 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.007 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:44.007 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384239+0000", 2024-09-13T06:40:44.007 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:44.007 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.007 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.007 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:44.008 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384238+0000", 2024-09-13T06:40:44.008 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999986 2024-09-13T06:40:44.008 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.008 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.008 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:44.008 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384246+0000", 2024-09-13T06:40:44.008 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.2449999999999998e-06 2024-09-13T06:40:44.008 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.008 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.009 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:44.009 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384268+0000", 2024-09-13T06:40:44.009 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1518e-05 2024-09-13T06:40:44.009 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.009 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.009 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:44.009 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384282+0000", 2024-09-13T06:40:44.009 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4501999999999999e-05 2024-09-13T06:40:44.009 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.009 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.009 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:44.009 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384356+0000", 2024-09-13T06:40:44.009 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4265999999999997e-05 2024-09-13T06:40:44.010 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.010 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.010 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:40:44.010 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384370+0000", 2024-09-13T06:40:44.010 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3942e-05 2024-09-13T06:40:44.010 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.010 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.010 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:44.010 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.379199+0000", 2024-09-13T06:40:44.010 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.99482866599999997 2024-09-13T06:40:44.010 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.010 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.010 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:44.011 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.379347+0000", 2024-09-13T06:40:44.011 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00014749199999999999 2024-09-13T06:40:44.011 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.011 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.011 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:44.011 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.379654+0000", 2024-09-13T06:40:44.011 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00030752999999999998 2024-09-13T06:40:44.011 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:44.011 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:44.011 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:44.011 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.011 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.011 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:37896 3.9 3:951cb95b:::rbd_data.1121d8143c6e.0000000000000002:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e56)", 2024-09-13T06:40:44.011 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:06.384412+0000", 2024-09-13T06:40:44.012 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 37.585567978999997, 2024-09-13T06:40:44.012 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.99777835999999998, 2024-09-13T06:40:44.012 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:44.012 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:44.012 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:44.012 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:44.012 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:44.012 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 37896 2024-09-13T06:40:44.012 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.012 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:44.012 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.012 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:44.012 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384412+0000", 2024-09-13T06:40:44.013 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:44.013 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.013 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.013 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:44.013 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384412+0000", 2024-09-13T06:40:44.013 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:44.013 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.013 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.013 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:44.013 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384410+0000", 2024-09-13T06:40:44.013 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.999999 2024-09-13T06:40:44.013 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.013 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.013 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:44.014 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384418+0000", 2024-09-13T06:40:44.014 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.486e-06 2024-09-13T06:40:44.014 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.014 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.014 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:44.014 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384436+0000", 2024-09-13T06:40:44.014 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7668000000000001e-05 2024-09-13T06:40:44.014 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.014 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.014 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:44.014 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384449+0000", 2024-09-13T06:40:44.014 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3395e-05 2024-09-13T06:40:44.014 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.014 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.015 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:44.015 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384605+0000", 2024-09-13T06:40:44.015 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00015563099999999999 2024-09-13T06:40:44.015 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.015 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.015 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:40:44.015 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384635+0000", 2024-09-13T06:40:44.015 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.0383999999999999e-05 2024-09-13T06:40:44.015 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.015 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.015 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:44.015 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.379730+0000", 2024-09-13T06:40:44.015 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.99509493999999998 2024-09-13T06:40:44.015 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.016 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.016 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:44.016 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.379964+0000", 2024-09-13T06:40:44.016 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00023353499999999999 2024-09-13T06:40:44.016 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.016 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.016 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:44.016 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.382190+0000", 2024-09-13T06:40:44.016 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0022265039999999998 2024-09-13T06:40:44.016 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:44.016 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:44.016 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:44.016 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.017 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.017 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43222 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 389120~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:40:44.017 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558181+0000", 2024-09-13T06:40:44.017 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 22.411798725000001, 2024-09-13T06:40:44.017 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.06252038, 2024-09-13T06:40:44.017 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:44.017 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:44.017 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:44.017 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:44.017 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:44.017 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43222 2024-09-13T06:40:44.017 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.017 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:44.018 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.018 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:44.018 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558181+0000", 2024-09-13T06:40:44.018 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:44.018 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.018 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.018 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:44.018 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558181+0000", 2024-09-13T06:40:44.018 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:44.018 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.018 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.018 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:44.018 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558181+0000", 2024-09-13T06:40:44.018 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:44.019 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.019 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.019 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:44.019 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558183+0000", 2024-09-13T06:40:44.019 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.857e-06 2024-09-13T06:40:44.019 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.019 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.019 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:44.019 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558188+0000", 2024-09-13T06:40:44.019 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3759999999999999e-06 2024-09-13T06:40:44.019 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.019 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.019 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:44.019 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558261+0000", 2024-09-13T06:40:44.020 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3097999999999997e-05 2024-09-13T06:40:44.020 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.020 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.020 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:44.020 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.620354+0000", 2024-09-13T06:40:44.020 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.062092587999999997 2024-09-13T06:40:44.020 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.020 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.020 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:44.020 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.620428+0000", 2024-09-13T06:40:44.020 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3954000000000004e-05 2024-09-13T06:40:44.020 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.020 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.020 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:44.021 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.620701+0000", 2024-09-13T06:40:44.021 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000273773 2024-09-13T06:40:44.021 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:44.021 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:44.021 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:44.021 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.021 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.021 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43223 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 393216~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:40:44.021 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558267+0000", 2024-09-13T06:40:44.021 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 22.411712668, 2024-09-13T06:40:44.021 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.062813151999999997, 2024-09-13T06:40:44.021 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:44.021 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:44.022 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:44.022 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:44.022 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:44.022 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43223 2024-09-13T06:40:44.022 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.022 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:44.022 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.022 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:44.022 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558267+0000", 2024-09-13T06:40:44.022 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:44.023 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.023 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.023 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:44.023 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558267+0000", 2024-09-13T06:40:44.023 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:44.023 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.023 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.023 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:44.023 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558266+0000", 2024-09-13T06:40:44.023 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:44.023 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.023 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.024 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:44.024 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558270+0000", 2024-09-13T06:40:44.024 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.2389999999999998e-06 2024-09-13T06:40:44.024 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.024 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.024 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:44.024 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558277+0000", 2024-09-13T06:40:44.024 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5680000000000002e-06 2024-09-13T06:40:44.024 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.024 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.024 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:44.024 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558282+0000", 2024-09-13T06:40:44.024 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7060000000000003e-06 2024-09-13T06:40:44.025 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.025 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.025 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:44.025 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.620731+0000", 2024-09-13T06:40:44.025 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.062448661000000003 2024-09-13T06:40:44.025 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.025 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.025 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:44.025 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.620806+0000", 2024-09-13T06:40:44.025 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5862e-05 2024-09-13T06:40:44.025 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.025 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.025 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:44.026 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.621080+0000", 2024-09-13T06:40:44.026 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00027368599999999998 2024-09-13T06:40:44.026 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:44.026 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:44.026 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:44.026 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.026 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.026 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43224 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 407552~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:40:44.026 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558286+0000", 2024-09-13T06:40:44.026 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 22.411693304, 2024-09-13T06:40:44.026 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.063179052999999999, 2024-09-13T06:40:44.026 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:44.026 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:44.026 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:44.026 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:44.027 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:44.027 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43224 2024-09-13T06:40:44.027 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.027 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:44.027 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.027 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:44.027 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558286+0000", 2024-09-13T06:40:44.027 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:44.027 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.027 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.027 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:44.027 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558286+0000", 2024-09-13T06:40:44.027 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:44.027 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.028 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.028 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:44.028 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558286+0000", 2024-09-13T06:40:44.028 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:44.028 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.028 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.028 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:44.028 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558288+0000", 2024-09-13T06:40:44.028 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.227e-06 2024-09-13T06:40:44.028 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.028 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.028 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:44.028 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558292+0000", 2024-09-13T06:40:44.029 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.6289999999999999e-06 2024-09-13T06:40:44.029 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.029 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.029 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:44.029 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558294+0000", 2024-09-13T06:40:44.029 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5409999999999999e-06 2024-09-13T06:40:44.029 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.029 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.029 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:44.029 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.621110+0000", 2024-09-13T06:40:44.029 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.062815776000000004 2024-09-13T06:40:44.029 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.029 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.029 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:44.030 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.621186+0000", 2024-09-13T06:40:44.030 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5570999999999999e-05 2024-09-13T06:40:44.030 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.030 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.030 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:44.030 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.621465+0000", 2024-09-13T06:40:44.030 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00027988200000000001 2024-09-13T06:40:44.030 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:44.030 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:44.030 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:44.030 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.030 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.030 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43225 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 421888~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:40:44.030 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558296+0000", 2024-09-13T06:40:44.030 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 22.411683336999999, 2024-09-13T06:40:44.031 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.063551110999999993, 2024-09-13T06:40:44.031 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:44.031 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:44.031 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:44.031 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:44.031 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:44.031 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43225 2024-09-13T06:40:44.031 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.031 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:44.031 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.031 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:44.031 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558296+0000", 2024-09-13T06:40:44.031 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:44.031 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.031 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.032 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:44.032 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558296+0000", 2024-09-13T06:40:44.032 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:44.032 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.032 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.032 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:44.032 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558296+0000", 2024-09-13T06:40:44.032 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:40:44.032 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.032 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.032 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:44.032 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558305+0000", 2024-09-13T06:40:44.032 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.5290000000000008e-06 2024-09-13T06:40:44.033 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.033 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.033 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:44.033 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558308+0000", 2024-09-13T06:40:44.033 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.5619999999999999e-06 2024-09-13T06:40:44.033 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.033 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.033 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:44.033 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558311+0000", 2024-09-13T06:40:44.033 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.43e-06 2024-09-13T06:40:44.033 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.033 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.033 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:44.034 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.621495+0000", 2024-09-13T06:40:44.034 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.063184289000000005 2024-09-13T06:40:44.034 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.034 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.034 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:44.034 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.621569+0000", 2024-09-13T06:40:44.034 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4250000000000002e-05 2024-09-13T06:40:44.034 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.034 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.034 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:44.034 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.621847+0000", 2024-09-13T06:40:44.034 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00027826400000000002 2024-09-13T06:40:44.034 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:44.034 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:44.035 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:44.035 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.035 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.035 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43226 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 436224~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:40:44.035 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558313+0000", 2024-09-13T06:40:44.035 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 22.411666701000001, 2024-09-13T06:40:44.035 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.063914420999999999, 2024-09-13T06:40:44.035 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:44.035 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:44.035 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:44.035 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:44.035 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:44.035 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43226 2024-09-13T06:40:44.035 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.036 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:44.036 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.036 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:44.036 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558313+0000", 2024-09-13T06:40:44.036 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:44.036 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.036 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.036 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:44.036 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558313+0000", 2024-09-13T06:40:44.036 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:44.036 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.036 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.036 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:44.036 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558313+0000", 2024-09-13T06:40:44.037 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:44.037 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.037 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.037 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:44.037 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558314+0000", 2024-09-13T06:40:44.037 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3740000000000001e-06 2024-09-13T06:40:44.037 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.037 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.037 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:44.037 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558317+0000", 2024-09-13T06:40:44.037 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9730000000000002e-06 2024-09-13T06:40:44.037 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.037 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.038 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:44.038 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558319+0000", 2024-09-13T06:40:44.038 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4059999999999999e-06 2024-09-13T06:40:44.038 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.038 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.038 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:44.038 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.621877+0000", 2024-09-13T06:40:44.038 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.063557408999999995 2024-09-13T06:40:44.038 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.038 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.038 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:44.038 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.621951+0000", 2024-09-13T06:40:44.038 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4487999999999996e-05 2024-09-13T06:40:44.038 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.039 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.039 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:44.039 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.622227+0000", 2024-09-13T06:40:44.039 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000276011 2024-09-13T06:40:44.039 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:44.039 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:44.039 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:44.039 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.039 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.039 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43227 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 450560~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:40:44.040 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558322+0000", 2024-09-13T06:40:44.040 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 22.411658119999998, 2024-09-13T06:40:44.040 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.064285348000000006, 2024-09-13T06:40:44.040 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:44.040 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:44.040 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:44.040 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:44.040 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:44.040 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43227 2024-09-13T06:40:44.040 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.040 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:44.040 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.040 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:44.041 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558322+0000", 2024-09-13T06:40:44.041 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:44.041 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.041 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.041 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:44.041 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558322+0000", 2024-09-13T06:40:44.041 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:44.041 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.041 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.041 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:44.041 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558321+0000", 2024-09-13T06:40:44.041 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:40:44.041 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.042 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.042 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:44.042 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558323+0000", 2024-09-13T06:40:44.042 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.576e-06 2024-09-13T06:40:44.042 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.042 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.042 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:44.042 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558328+0000", 2024-09-13T06:40:44.042 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0719999999999999e-06 2024-09-13T06:40:44.042 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.042 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.042 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:44.042 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558332+0000", 2024-09-13T06:40:44.042 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.8130000000000002e-06 2024-09-13T06:40:44.042 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.043 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.043 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:44.043 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.622255+0000", 2024-09-13T06:40:44.043 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.063923195000000002 2024-09-13T06:40:44.043 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.043 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.043 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:44.043 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.622330+0000", 2024-09-13T06:40:44.043 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5383000000000007e-05 2024-09-13T06:40:44.043 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.043 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.043 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:44.043 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.622607+0000", 2024-09-13T06:40:44.043 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00027651999999999999 2024-09-13T06:40:44.044 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:44.044 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:44.044 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:44.044 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.044 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.044 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43228 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 464896~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:40:44.044 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558335+0000", 2024-09-13T06:40:44.044 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 22.411644210999999, 2024-09-13T06:40:44.044 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.064652253000000007, 2024-09-13T06:40:44.044 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:44.044 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:44.044 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:44.044 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:44.045 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:44.045 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43228 2024-09-13T06:40:44.045 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.045 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:44.045 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.045 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:44.045 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558335+0000", 2024-09-13T06:40:44.045 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:44.045 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.045 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.045 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:44.045 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558335+0000", 2024-09-13T06:40:44.045 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:44.046 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.046 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.046 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:44.046 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558335+0000", 2024-09-13T06:40:44.046 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:44.046 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.046 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.046 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:44.046 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558337+0000", 2024-09-13T06:40:44.046 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1380000000000001e-06 2024-09-13T06:40:44.046 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.046 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.046 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:44.047 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558343+0000", 2024-09-13T06:40:44.047 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.5140000000000001e-06 2024-09-13T06:40:44.047 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.047 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.047 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:44.047 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558348+0000", 2024-09-13T06:40:44.047 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9640000000000002e-06 2024-09-13T06:40:44.047 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.047 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.047 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:44.047 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.622636+0000", 2024-09-13T06:40:44.047 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.064288260999999999 2024-09-13T06:40:44.047 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.047 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.048 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:44.048 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.622715+0000", 2024-09-13T06:40:44.048 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.9351000000000006e-05 2024-09-13T06:40:44.048 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.048 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.048 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:44.048 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.622988+0000", 2024-09-13T06:40:44.048 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00027242599999999998 2024-09-13T06:40:44.048 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:44.048 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:44.048 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:44.048 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.048 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.048 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43229 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 479232~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:40:44.048 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558352+0000", 2024-09-13T06:40:44.049 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 22.411627796000001, 2024-09-13T06:40:44.049 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.065018024999999993, 2024-09-13T06:40:44.049 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:44.049 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:44.049 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:44.049 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:44.049 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:44.049 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43229 2024-09-13T06:40:44.049 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.049 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:44.049 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.049 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:44.049 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558352+0000", 2024-09-13T06:40:44.050 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:44.050 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.050 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.050 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:44.050 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558352+0000", 2024-09-13T06:40:44.050 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:44.050 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.050 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.050 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:44.050 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558352+0000", 2024-09-13T06:40:44.050 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:44.050 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.050 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.051 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:44.051 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558354+0000", 2024-09-13T06:40:44.051 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4930000000000001e-06 2024-09-13T06:40:44.051 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.051 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.051 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:44.051 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558360+0000", 2024-09-13T06:40:44.051 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.263e-06 2024-09-13T06:40:44.051 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.051 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.051 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:44.051 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558369+0000", 2024-09-13T06:40:44.051 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.0829999999999993e-06 2024-09-13T06:40:44.051 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.051 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.052 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:44.052 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.623017+0000", 2024-09-13T06:40:44.052 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.064647799000000006 2024-09-13T06:40:44.052 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.052 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.052 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:44.052 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.623090+0000", 2024-09-13T06:40:44.052 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3071000000000006e-05 2024-09-13T06:40:44.052 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.052 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.052 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:44.052 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.623370+0000", 2024-09-13T06:40:44.052 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000279661 2024-09-13T06:40:44.052 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:44.053 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:44.053 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:44.053 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.053 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.053 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43230 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 493568~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:40:44.053 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558374+0000", 2024-09-13T06:40:44.053 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 22.411605503000001, 2024-09-13T06:40:44.053 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.065410435000000003, 2024-09-13T06:40:44.053 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:44.053 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:44.053 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:44.053 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:44.053 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:44.053 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43230 2024-09-13T06:40:44.054 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.054 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:44.054 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.054 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:44.054 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558374+0000", 2024-09-13T06:40:44.054 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:44.054 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.054 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.054 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:44.054 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558374+0000", 2024-09-13T06:40:44.054 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:44.054 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.054 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.054 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:44.055 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558374+0000", 2024-09-13T06:40:44.055 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:44.055 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.055 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.055 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:44.055 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558376+0000", 2024-09-13T06:40:44.055 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4430000000000002e-06 2024-09-13T06:40:44.055 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.055 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.055 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:44.055 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558382+0000", 2024-09-13T06:40:44.055 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3029999999999996e-06 2024-09-13T06:40:44.055 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.055 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.056 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:44.056 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558387+0000", 2024-09-13T06:40:44.056 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.1699999999999999e-06 2024-09-13T06:40:44.056 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.056 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.056 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:44.056 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.623400+0000", 2024-09-13T06:40:44.056 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.065013244999999997 2024-09-13T06:40:44.056 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.056 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.056 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:44.056 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.623474+0000", 2024-09-13T06:40:44.056 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3889999999999999e-05 2024-09-13T06:40:44.057 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.057 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.057 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:44.057 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.623785+0000", 2024-09-13T06:40:44.057 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00031080099999999998 2024-09-13T06:40:44.057 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:44.057 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:44.057 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:44.057 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.057 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.057 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43231 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 507904~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:40:44.057 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558391+0000", 2024-09-13T06:40:44.057 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 22.411588817999998, 2024-09-13T06:40:44.057 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.065788597000000004, 2024-09-13T06:40:44.058 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:44.058 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:44.058 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:44.058 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:44.058 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:44.058 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43231 2024-09-13T06:40:44.058 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.058 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:44.058 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.058 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:44.058 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558391+0000", 2024-09-13T06:40:44.058 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:44.058 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.059 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.059 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:44.059 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558391+0000", 2024-09-13T06:40:44.059 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:44.059 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.059 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.059 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:44.059 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558390+0000", 2024-09-13T06:40:44.059 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:44.059 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.059 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.059 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:44.059 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558393+0000", 2024-09-13T06:40:44.059 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2570000000000002e-06 2024-09-13T06:40:44.060 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.060 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.060 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:44.060 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558399+0000", 2024-09-13T06:40:44.060 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0419999999999999e-06 2024-09-13T06:40:44.060 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.060 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.060 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:44.060 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558403+0000", 2024-09-13T06:40:44.060 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6249999999999998e-06 2024-09-13T06:40:44.060 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.060 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.060 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:44.061 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.623811+0000", 2024-09-13T06:40:44.061 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.065407549999999995 2024-09-13T06:40:44.061 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.061 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.061 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:44.061 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.623877+0000", 2024-09-13T06:40:44.061 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.5902999999999996e-05 2024-09-13T06:40:44.061 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.061 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.061 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:44.061 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.624179+0000", 2024-09-13T06:40:44.061 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00030259999999999998 2024-09-13T06:40:44.061 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:44.061 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:44.062 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:44.062 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.062 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.062 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43232 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 522240~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:40:44.062 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558422+0000", 2024-09-13T06:40:44.062 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 22.411558040999999, 2024-09-13T06:40:44.062 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.066176061999999994, 2024-09-13T06:40:44.062 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:44.062 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:44.062 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:44.062 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:44.062 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:44.062 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43232 2024-09-13T06:40:44.063 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.063 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:44.063 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.063 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:44.063 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558422+0000", 2024-09-13T06:40:44.063 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:44.063 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.063 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.063 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:44.063 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558422+0000", 2024-09-13T06:40:44.063 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:44.063 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.063 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.064 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:44.064 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558421+0000", 2024-09-13T06:40:44.064 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:44.064 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.064 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.064 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:44.064 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558428+0000", 2024-09-13T06:40:44.064 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.1690000000000003e-06 2024-09-13T06:40:44.064 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.064 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.064 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:44.064 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558434+0000", 2024-09-13T06:40:44.064 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9309999999999996e-06 2024-09-13T06:40:44.064 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.065 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.065 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:44.065 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558447+0000", 2024-09-13T06:40:44.065 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.271e-05 2024-09-13T06:40:44.065 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.065 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.065 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:44.065 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.624209+0000", 2024-09-13T06:40:44.065 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.065762102000000003 2024-09-13T06:40:44.065 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.065 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.065 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:44.065 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.624282+0000", 2024-09-13T06:40:44.065 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.2889e-05 2024-09-13T06:40:44.066 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.066 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.066 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:44.066 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.624598+0000", 2024-09-13T06:40:44.066 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00031591399999999998 2024-09-13T06:40:44.066 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:44.066 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:44.066 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:44.066 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.066 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.066 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43486 3.f 3:f7da9c8f:::rbd_data.1121f5f2e1c0.000000000000000b:1f [read 260096~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:40:44.066 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.569088+0000", 2024-09-13T06:40:44.066 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 22.400891317999999, 2024-09-13T06:40:44.066 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.062579223000000003, 2024-09-13T06:40:44.067 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:44.067 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:44.067 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:44.067 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:44.067 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:44.067 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43486 2024-09-13T06:40:44.067 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.067 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:44.067 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.067 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:44.067 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.569088+0000", 2024-09-13T06:40:44.067 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:44.067 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.068 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.068 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:44.068 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.569088+0000", 2024-09-13T06:40:44.068 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:44.068 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.068 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.068 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:44.068 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.569088+0000", 2024-09-13T06:40:44.068 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:44.068 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.068 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.068 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:44.068 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.569091+0000", 2024-09-13T06:40:44.068 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9629999999999998e-06 2024-09-13T06:40:44.068 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.069 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.069 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:44.069 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.569097+0000", 2024-09-13T06:40:44.069 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.4160000000000001e-06 2024-09-13T06:40:44.069 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.069 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.069 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:44.069 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.569102+0000", 2024-09-13T06:40:44.069 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6659999999999999e-06 2024-09-13T06:40:44.069 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.069 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.069 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:44.069 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.631346+0000", 2024-09-13T06:40:44.070 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.062243896 2024-09-13T06:40:44.070 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.070 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.070 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:44.070 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.631413+0000", 2024-09-13T06:40:44.070 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.7638000000000005e-05 2024-09-13T06:40:44.070 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.070 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.070 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:44.070 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.631668+0000", 2024-09-13T06:40:44.070 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0002541 2024-09-13T06:40:44.070 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:44.070 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:44.070 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:44.071 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:44.071 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:44.071 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:40:44.072 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-13T06:40:44.073 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:40:44.069+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:40:44.173 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:40:44.176+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:40:44.196 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:40:44.197 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-13T06:40:44.197 INFO:teuthology.orchestra.run.smithi081.stdout: "num_ops": 0 2024-09-13T06:40:44.197 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:40:44.210 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-13T06:40:44.301 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:40:44.304+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:40:44.375 INFO:tasks.ceph.osd.6.smithi139.stderr:2024-09-13T06:40:44.377+0000 7fcd02c5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26385) UID: 0 2024-09-13T06:40:44.376 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:40:44.377 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-13T06:40:44.377 INFO:teuthology.orchestra.run.smithi081.stdout: "complaint_time": 30, 2024-09-13T06:40:44.377 INFO:teuthology.orchestra.run.smithi081.stdout: "num_blocked_ops": 0 2024-09-13T06:40:44.377 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:40:44.391 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-13T06:40:44.431 INFO:teuthology.orchestra.run.smithi081.stderr:noscrub is unset 2024-09-13T06:40:44.476 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:40:44.473+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:40:44.573 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:40:44.573 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 20, 2024-09-13T06:40:44.574 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 600, 2024-09-13T06:40:44.574 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [ 2024-09-13T06:40:44.574 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.574 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:2226 3.15 3:af026987:::rbd_data.112173e2f1b7.0000000000000017:head [sparse-read 0~4194304] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-13T06:40:44.574 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:37.606562+0000", 2024-09-13T06:40:44.574 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 66.967154191999995, 2024-09-13T06:40:44.574 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.83322091700000001, 2024-09-13T06:40:44.574 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:44.574 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:40:44.574 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:44.574 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:44.574 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:44.574 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 2226 2024-09-13T06:40:44.575 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.575 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:44.575 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.575 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:44.575 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606562+0000", 2024-09-13T06:40:44.575 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:44.575 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.575 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.575 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:44.575 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606562+0000", 2024-09-13T06:40:44.576 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:44.576 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.576 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.576 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:44.576 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606561+0000", 2024-09-13T06:40:44.576 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:44.576 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.576 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.576 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:44.576 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606565+0000", 2024-09-13T06:40:44.576 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.4379999999999999e-06 2024-09-13T06:40:44.576 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.577 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.577 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:44.577 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606569+0000", 2024-09-13T06:40:44.577 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.425e-06 2024-09-13T06:40:44.577 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.577 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.577 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:44.577 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606572+0000", 2024-09-13T06:40:44.577 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.05e-06 2024-09-13T06:40:44.577 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.577 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.577 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:44.577 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606621+0000", 2024-09-13T06:40:44.578 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.8723000000000001e-05 2024-09-13T06:40:44.578 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.578 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.578 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:40:44.578 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606630+0000", 2024-09-13T06:40:44.578 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.8040000000000007e-06 2024-09-13T06:40:44.578 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.578 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.578 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:44.578 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.439648+0000", 2024-09-13T06:40:44.578 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.83301824800000002 2024-09-13T06:40:44.578 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.578 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.579 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:44.579 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.439782+0000", 2024-09-13T06:40:44.579 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00013466699999999999 2024-09-13T06:40:44.579 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:44.579 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:44.579 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:44.579 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.579 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.579 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25661 3.8 3:1180686c:::rbd_data.1121f2c5ee81.0000000000000009:13 [read 397312~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:44.579 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.436956+0000", 2024-09-13T06:40:44.579 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 48.136759658000003, 2024-09-13T06:40:44.579 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089036758999999993, 2024-09-13T06:40:44.580 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:44.580 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:44.580 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:44.580 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:44.580 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:44.580 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25661 2024-09-13T06:40:44.580 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.580 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:44.580 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.580 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:44.580 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436956+0000", 2024-09-13T06:40:44.580 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:44.580 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.581 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.581 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:44.581 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436956+0000", 2024-09-13T06:40:44.581 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:44.581 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.581 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.581 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:44.581 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436956+0000", 2024-09-13T06:40:44.581 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:44.581 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.581 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.581 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:44.581 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436958+0000", 2024-09-13T06:40:44.582 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1770000000000001e-06 2024-09-13T06:40:44.582 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.582 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.582 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:44.582 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436963+0000", 2024-09-13T06:40:44.582 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.6489999999999996e-06 2024-09-13T06:40:44.582 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.582 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.582 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:44.582 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436975+0000", 2024-09-13T06:40:44.582 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1783999999999999e-05 2024-09-13T06:40:44.582 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.583 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.583 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:44.583 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.525671+0000", 2024-09-13T06:40:44.583 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.088696292999999995 2024-09-13T06:40:44.583 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.583 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.583 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:44.583 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.525749+0000", 2024-09-13T06:40:44.583 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.7589000000000005e-05 2024-09-13T06:40:44.583 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.583 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.583 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:44.583 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.525993+0000", 2024-09-13T06:40:44.584 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00024381000000000001 2024-09-13T06:40:44.584 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:44.584 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:44.584 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:44.584 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.584 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.584 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25662 3.8 3:1180686c:::rbd_data.1121f2c5ee81.0000000000000009:13 [read 421888~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:44.584 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.436980+0000", 2024-09-13T06:40:44.584 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 48.136735346000002, 2024-09-13T06:40:44.584 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089367577000000004, 2024-09-13T06:40:44.584 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:44.584 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:44.584 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:44.585 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:44.585 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:44.585 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25662 2024-09-13T06:40:44.585 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.585 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:44.585 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.585 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:44.585 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436980+0000", 2024-09-13T06:40:44.585 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:44.585 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.585 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.585 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:44.585 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436980+0000", 2024-09-13T06:40:44.586 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:44.586 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.586 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.586 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:44.586 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436980+0000", 2024-09-13T06:40:44.586 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:44.586 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.586 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.586 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:44.586 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436982+0000", 2024-09-13T06:40:44.586 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3989999999999998e-06 2024-09-13T06:40:44.586 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.586 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.587 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:44.587 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436988+0000", 2024-09-13T06:40:44.587 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0039999999999996e-06 2024-09-13T06:40:44.587 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.587 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.587 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:44.587 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436993+0000", 2024-09-13T06:40:44.587 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6090000000000003e-06 2024-09-13T06:40:44.587 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.587 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.587 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:44.587 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.526035+0000", 2024-09-13T06:40:44.587 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089042248000000004 2024-09-13T06:40:44.588 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.588 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.588 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:44.588 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.526111+0000", 2024-09-13T06:40:44.588 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5643999999999996e-05 2024-09-13T06:40:44.588 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.588 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.588 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:44.588 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.526348+0000", 2024-09-13T06:40:44.588 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00023705800000000001 2024-09-13T06:40:44.588 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:44.588 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:44.589 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:44.589 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.589 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.589 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25663 3.8 3:1180686c:::rbd_data.1121f2c5ee81.0000000000000009:13 [read 466944~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:44.589 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.436998+0000", 2024-09-13T06:40:44.589 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 48.136717699000002, 2024-09-13T06:40:44.589 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089730867000000006, 2024-09-13T06:40:44.589 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:44.589 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:44.589 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:44.589 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:44.589 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:44.589 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25663 2024-09-13T06:40:44.590 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.590 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:44.590 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.590 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:44.590 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436998+0000", 2024-09-13T06:40:44.590 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:44.590 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.590 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.590 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:44.590 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436998+0000", 2024-09-13T06:40:44.590 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:44.590 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.590 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.591 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:44.591 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436998+0000", 2024-09-13T06:40:44.591 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:44.591 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.591 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.591 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:44.591 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437000+0000", 2024-09-13T06:40:44.591 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0940000000000002e-06 2024-09-13T06:40:44.591 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.591 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.591 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:44.591 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437005+0000", 2024-09-13T06:40:44.591 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.604e-06 2024-09-13T06:40:44.592 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.592 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.592 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:44.592 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437032+0000", 2024-09-13T06:40:44.592 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6407e-05 2024-09-13T06:40:44.592 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.592 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.592 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:44.592 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.526363+0000", 2024-09-13T06:40:44.592 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089331456000000004 2024-09-13T06:40:44.592 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.592 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.592 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:44.593 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.526404+0000", 2024-09-13T06:40:44.593 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.0887999999999999e-05 2024-09-13T06:40:44.593 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.593 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.593 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:44.593 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.526729+0000", 2024-09-13T06:40:44.593 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00032486 2024-09-13T06:40:44.593 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:44.593 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:44.593 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:44.593 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.593 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.593 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25664 3.8 3:1180686c:::rbd_data.1121f2c5ee81.0000000000000009:13 [read 491520~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:44.594 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.437040+0000", 2024-09-13T06:40:44.594 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 48.136675783999998, 2024-09-13T06:40:44.594 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.090016650000000004, 2024-09-13T06:40:44.594 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:44.594 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:44.594 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:44.594 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:44.594 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:44.594 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25664 2024-09-13T06:40:44.594 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.594 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:44.594 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.594 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:44.595 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437040+0000", 2024-09-13T06:40:44.595 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:44.595 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.595 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.595 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:44.595 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437040+0000", 2024-09-13T06:40:44.595 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:44.595 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.595 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.595 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:44.595 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437039+0000", 2024-09-13T06:40:44.595 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:44.595 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.596 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.596 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:44.596 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437047+0000", 2024-09-13T06:40:44.596 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4839999999999998e-06 2024-09-13T06:40:44.596 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.596 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.596 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:44.596 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437054+0000", 2024-09-13T06:40:44.596 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.8299999999999998e-06 2024-09-13T06:40:44.596 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.596 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.596 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:44.597 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437060+0000", 2024-09-13T06:40:44.597 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.1510000000000001e-06 2024-09-13T06:40:44.597 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.597 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.597 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:44.597 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.526772+0000", 2024-09-13T06:40:44.597 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089711737999999999 2024-09-13T06:40:44.597 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.597 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.597 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:44.597 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.526848+0000", 2024-09-13T06:40:44.597 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5870000000000004e-05 2024-09-13T06:40:44.597 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.598 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.598 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:44.598 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.527057+0000", 2024-09-13T06:40:44.598 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000209106 2024-09-13T06:40:44.598 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:44.598 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:44.598 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:44.598 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.598 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.598 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25740 3.18 3:1c662b96:::rbd_data.1121f2c5ee81.0000000000000010:13 [read 200704~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:44.598 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443352+0000", 2024-09-13T06:40:44.598 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 48.130364108999999, 2024-09-13T06:40:44.598 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089068222000000002, 2024-09-13T06:40:44.598 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:44.599 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:44.599 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:44.599 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:44.599 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:44.599 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25740 2024-09-13T06:40:44.599 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.599 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:44.599 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.599 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:44.599 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443352+0000", 2024-09-13T06:40:44.599 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:44.599 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.599 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.600 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:44.600 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443352+0000", 2024-09-13T06:40:44.600 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:44.600 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.600 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.600 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:44.600 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443351+0000", 2024-09-13T06:40:44.600 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:44.600 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.600 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.600 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:44.600 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443354+0000", 2024-09-13T06:40:44.600 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.841e-06 2024-09-13T06:40:44.600 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.601 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.601 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:44.601 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443361+0000", 2024-09-13T06:40:44.601 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.0010000000000004e-06 2024-09-13T06:40:44.601 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.601 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.601 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:44.601 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443366+0000", 2024-09-13T06:40:44.601 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7119999999999999e-06 2024-09-13T06:40:44.601 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.601 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.601 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:44.601 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532117+0000", 2024-09-13T06:40:44.602 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.088751327000000005 2024-09-13T06:40:44.602 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.602 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.602 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:44.602 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532193+0000", 2024-09-13T06:40:44.602 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5839000000000004e-05 2024-09-13T06:40:44.602 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.602 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.602 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:44.602 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532420+0000", 2024-09-13T06:40:44.602 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00022691000000000001 2024-09-13T06:40:44.602 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:44.602 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:44.602 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:44.603 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.603 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.603 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25741 3.18 3:1c662b96:::rbd_data.1121f2c5ee81.0000000000000010:13 [read 225280~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:44.603 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443378+0000", 2024-09-13T06:40:44.603 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 48.130337341999997, 2024-09-13T06:40:44.603 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089324107, 2024-09-13T06:40:44.603 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:44.603 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:44.603 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:44.603 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:44.603 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:44.603 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25741 2024-09-13T06:40:44.603 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.604 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:44.604 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.604 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:44.604 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443378+0000", 2024-09-13T06:40:44.604 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:44.604 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.604 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.604 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:44.604 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443378+0000", 2024-09-13T06:40:44.604 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:44.604 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.605 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.605 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:44.605 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443378+0000", 2024-09-13T06:40:44.605 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:44.605 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.605 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.605 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:44.605 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443380+0000", 2024-09-13T06:40:44.605 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3549999999999999e-06 2024-09-13T06:40:44.605 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.605 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.605 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:44.606 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443388+0000", 2024-09-13T06:40:44.606 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.7449999999999995e-06 2024-09-13T06:40:44.606 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.606 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.606 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:44.606 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443393+0000", 2024-09-13T06:40:44.606 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.4e-06 2024-09-13T06:40:44.606 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.606 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.606 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:44.606 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532454+0000", 2024-09-13T06:40:44.606 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089060941000000005 2024-09-13T06:40:44.607 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.607 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.607 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:44.607 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532512+0000", 2024-09-13T06:40:44.607 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7763000000000002e-05 2024-09-13T06:40:44.607 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.607 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.607 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:44.607 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532703+0000", 2024-09-13T06:40:44.607 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000190328 2024-09-13T06:40:44.607 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:44.607 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:44.608 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:44.608 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.608 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.608 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25742 3.18 3:1c662b96:::rbd_data.1121f2c5ee81.0000000000000010:13 [read 270336~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:44.608 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443398+0000", 2024-09-13T06:40:44.608 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 48.13031763, 2024-09-13T06:40:44.608 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089621836999999996, 2024-09-13T06:40:44.608 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:44.608 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:44.608 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:44.608 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:44.609 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:44.609 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25742 2024-09-13T06:40:44.609 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.609 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:44.609 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.609 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:44.609 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443398+0000", 2024-09-13T06:40:44.609 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:44.609 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.609 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.609 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:44.609 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443398+0000", 2024-09-13T06:40:44.610 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:44.610 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.610 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.610 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:44.610 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443398+0000", 2024-09-13T06:40:44.610 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:44.610 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.610 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.610 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:44.610 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443400+0000", 2024-09-13T06:40:44.610 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1849999999999998e-06 2024-09-13T06:40:44.610 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.610 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.611 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:44.611 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443407+0000", 2024-09-13T06:40:44.611 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3669999999999999e-06 2024-09-13T06:40:44.611 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.611 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.611 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:44.611 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443420+0000", 2024-09-13T06:40:44.611 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2645e-05 2024-09-13T06:40:44.611 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.611 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.611 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:44.611 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532742+0000", 2024-09-13T06:40:44.612 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089322200000000004 2024-09-13T06:40:44.612 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.612 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.612 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:44.612 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532818+0000", 2024-09-13T06:40:44.612 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.6019000000000005e-05 2024-09-13T06:40:44.612 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.612 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.612 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:44.612 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533020+0000", 2024-09-13T06:40:44.612 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000201721 2024-09-13T06:40:44.613 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:44.613 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:44.613 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:44.613 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.613 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.613 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25743 3.18 3:1c662b96:::rbd_data.1121f2c5ee81.0000000000000010:13 [read 294912~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:44.613 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443425+0000", 2024-09-13T06:40:44.613 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 48.130290621999997, 2024-09-13T06:40:44.613 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089864075000000002, 2024-09-13T06:40:44.613 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:44.613 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:44.614 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:44.614 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:44.614 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:44.614 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25743 2024-09-13T06:40:44.614 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.614 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:44.614 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.614 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:44.614 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443425+0000", 2024-09-13T06:40:44.614 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:44.614 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.614 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.615 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:44.615 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443425+0000", 2024-09-13T06:40:44.615 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:44.615 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.615 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.615 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:44.615 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443425+0000", 2024-09-13T06:40:44.615 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:44.615 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.615 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.615 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:44.615 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443432+0000", 2024-09-13T06:40:44.615 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3420000000000002e-06 2024-09-13T06:40:44.615 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.616 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.616 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:44.616 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443440+0000", 2024-09-13T06:40:44.616 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5689999999999999e-06 2024-09-13T06:40:44.616 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.616 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.616 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:44.616 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443445+0000", 2024-09-13T06:40:44.616 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9590000000000003e-06 2024-09-13T06:40:44.616 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.616 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.616 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:44.617 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533063+0000", 2024-09-13T06:40:44.617 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089617988999999995 2024-09-13T06:40:44.617 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.617 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.617 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:44.617 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533122+0000", 2024-09-13T06:40:44.617 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9052999999999999e-05 2024-09-13T06:40:44.617 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.617 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.617 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:44.617 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533289+0000", 2024-09-13T06:40:44.617 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00016752800000000001 2024-09-13T06:40:44.617 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:44.618 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:44.618 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:44.618 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.618 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.618 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25744 3.18 3.69d46638 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:44.618 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443449+0000", 2024-09-13T06:40:44.618 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 48.130266474999999, 2024-09-13T06:40:44.618 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089869148999999995, 2024-09-13T06:40:44.618 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:44.618 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:40:44.618 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:44.618 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:44.618 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:44.618 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25744 2024-09-13T06:40:44.619 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.619 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:44.619 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.619 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:44.619 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443449+0000", 2024-09-13T06:40:44.619 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:44.619 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.619 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.619 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:44.619 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443449+0000", 2024-09-13T06:40:44.619 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:44.619 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.620 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.620 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:44.620 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443449+0000", 2024-09-13T06:40:44.620 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:44.620 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.620 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.620 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:44.620 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443451+0000", 2024-09-13T06:40:44.620 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.244e-06 2024-09-13T06:40:44.620 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.620 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.620 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:44.621 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443457+0000", 2024-09-13T06:40:44.621 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.66e-06 2024-09-13T06:40:44.621 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.621 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.621 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:44.621 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443461+0000", 2024-09-13T06:40:44.621 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5449999999999997e-06 2024-09-13T06:40:44.621 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.621 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.621 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:44.621 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533311+0000", 2024-09-13T06:40:44.621 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089849729000000003 2024-09-13T06:40:44.622 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.622 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.622 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:44.622 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533318+0000", 2024-09-13T06:40:44.622 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.328e-06 2024-09-13T06:40:44.622 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:44.622 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:44.622 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:44.622 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.622 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.622 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25745 3.18 3.69d46638 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:44.622 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443466+0000", 2024-09-13T06:40:44.623 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 48.130249417000002, 2024-09-13T06:40:44.623 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089886743000000005, 2024-09-13T06:40:44.623 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:44.623 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:40:44.623 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:44.623 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:44.623 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:44.623 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25745 2024-09-13T06:40:44.623 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.623 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:44.623 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.623 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:44.624 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443466+0000", 2024-09-13T06:40:44.624 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:44.624 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.624 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.624 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:44.624 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443466+0000", 2024-09-13T06:40:44.624 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:44.624 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.624 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.624 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:44.624 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443466+0000", 2024-09-13T06:40:44.625 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:44.625 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.625 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.625 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:44.625 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443474+0000", 2024-09-13T06:40:44.625 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.1289999999999996e-06 2024-09-13T06:40:44.625 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.626 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.626 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:44.626 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443484+0000", 2024-09-13T06:40:44.626 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0654e-05 2024-09-13T06:40:44.626 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.626 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.626 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:44.626 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443490+0000", 2024-09-13T06:40:44.626 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8030000000000002e-06 2024-09-13T06:40:44.626 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.626 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.626 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:44.626 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533348+0000", 2024-09-13T06:40:44.627 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089857267000000005 2024-09-13T06:40:44.627 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.627 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.627 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:44.627 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533353+0000", 2024-09-13T06:40:44.627 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.5520000000000004e-06 2024-09-13T06:40:44.627 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:44.627 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:44.627 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:44.627 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.627 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.627 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25746 3.18 3.69d46638 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:44.627 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443495+0000", 2024-09-13T06:40:44.628 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 48.130220303999998, 2024-09-13T06:40:44.628 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089903725000000004, 2024-09-13T06:40:44.628 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:44.628 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:40:44.628 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:44.628 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:44.628 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:44.628 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25746 2024-09-13T06:40:44.628 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.628 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:44.628 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.628 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:44.629 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443495+0000", 2024-09-13T06:40:44.629 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:44.629 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.629 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.629 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:44.629 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443495+0000", 2024-09-13T06:40:44.629 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:44.629 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.629 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.629 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:44.629 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443495+0000", 2024-09-13T06:40:44.629 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:44.630 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.630 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.630 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:44.630 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443498+0000", 2024-09-13T06:40:44.630 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.7690000000000001e-06 2024-09-13T06:40:44.630 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.630 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.630 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:44.630 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443504+0000", 2024-09-13T06:40:44.630 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9710000000000001e-06 2024-09-13T06:40:44.630 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.630 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.630 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:44.630 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443508+0000", 2024-09-13T06:40:44.631 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4159999999999997e-06 2024-09-13T06:40:44.631 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.631 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.631 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:44.631 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533391+0000", 2024-09-13T06:40:44.631 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089882607000000003 2024-09-13T06:40:44.631 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.631 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.631 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:44.631 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533399+0000", 2024-09-13T06:40:44.631 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.4349999999999997e-06 2024-09-13T06:40:44.631 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:44.631 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:44.632 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:44.632 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.632 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.632 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25747 3.8 3.63996268 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:44.632 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443512+0000", 2024-09-13T06:40:44.632 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 48.130203573000003, 2024-09-13T06:40:44.632 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089880075000000004, 2024-09-13T06:40:44.632 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:44.632 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:40:44.632 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:44.632 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:44.632 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:44.632 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25747 2024-09-13T06:40:44.633 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.633 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:44.633 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.633 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:44.633 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443512+0000", 2024-09-13T06:40:44.633 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:44.633 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.633 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.633 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:44.633 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443512+0000", 2024-09-13T06:40:44.633 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:44.633 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.633 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.634 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:44.634 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443512+0000", 2024-09-13T06:40:44.634 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:44.634 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.634 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.634 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:44.634 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443514+0000", 2024-09-13T06:40:44.634 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0980000000000001e-06 2024-09-13T06:40:44.634 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.634 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.634 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:44.634 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443520+0000", 2024-09-13T06:40:44.634 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7069999999999997e-06 2024-09-13T06:40:44.634 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.635 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.635 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:44.635 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443524+0000", 2024-09-13T06:40:44.635 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5390000000000001e-06 2024-09-13T06:40:44.635 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.635 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.635 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:44.635 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533384+0000", 2024-09-13T06:40:44.635 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089859684999999995 2024-09-13T06:40:44.635 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.635 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.635 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:44.635 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533392+0000", 2024-09-13T06:40:44.636 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.3440000000000001e-06 2024-09-13T06:40:44.636 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:44.636 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:44.636 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:44.636 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.636 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.636 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25748 3.8 3.63996268 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:44.636 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443528+0000", 2024-09-13T06:40:44.636 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 48.130187446000001, 2024-09-13T06:40:44.636 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089890715999999996, 2024-09-13T06:40:44.636 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:44.636 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:40:44.637 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:44.637 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:44.637 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:44.637 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25748 2024-09-13T06:40:44.637 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.637 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:44.637 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.637 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:44.637 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443528+0000", 2024-09-13T06:40:44.637 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:44.637 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.637 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.637 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:44.638 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443528+0000", 2024-09-13T06:40:44.638 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:44.638 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.638 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.638 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:44.638 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443528+0000", 2024-09-13T06:40:44.638 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:44.638 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.638 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.638 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:44.638 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443530+0000", 2024-09-13T06:40:44.638 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0650000000000001e-06 2024-09-13T06:40:44.639 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.639 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.639 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:44.639 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443536+0000", 2024-09-13T06:40:44.639 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7259999999999999e-06 2024-09-13T06:40:44.639 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.639 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.639 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:44.639 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443540+0000", 2024-09-13T06:40:44.639 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5009999999999998e-06 2024-09-13T06:40:44.639 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.639 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.639 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:44.640 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533412+0000", 2024-09-13T06:40:44.640 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089871873000000005 2024-09-13T06:40:44.640 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.640 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.640 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:44.640 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533419+0000", 2024-09-13T06:40:44.640 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.883e-06 2024-09-13T06:40:44.640 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:44.640 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:44.640 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:44.640 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.640 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.641 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25749 3.8 3.63996268 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:44.641 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443545+0000", 2024-09-13T06:40:44.641 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 48.130171249999997, 2024-09-13T06:40:44.641 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089897988999999998, 2024-09-13T06:40:44.641 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:44.641 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:40:44.641 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:44.641 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:44.641 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:44.642 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25749 2024-09-13T06:40:44.642 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.642 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:44.642 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.642 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:44.642 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443545+0000", 2024-09-13T06:40:44.642 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:44.642 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.642 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.642 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:44.642 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443545+0000", 2024-09-13T06:40:44.642 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:44.643 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.643 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.643 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:44.643 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443544+0000", 2024-09-13T06:40:44.643 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:44.643 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.643 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.643 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:44.643 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443553+0000", 2024-09-13T06:40:44.643 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.4770000000000003e-06 2024-09-13T06:40:44.643 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.643 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.644 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:44.644 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443564+0000", 2024-09-13T06:40:44.644 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0986e-05 2024-09-13T06:40:44.644 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.644 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.644 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:44.644 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443569+0000", 2024-09-13T06:40:44.644 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2530000000000004e-06 2024-09-13T06:40:44.644 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.644 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.644 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:44.644 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533438+0000", 2024-09-13T06:40:44.645 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089868641999999999 2024-09-13T06:40:44.645 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.645 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.645 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:44.645 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533442+0000", 2024-09-13T06:40:44.645 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.989e-06 2024-09-13T06:40:44.645 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:44.645 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:44.645 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:44.645 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.645 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.645 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25750 3.8 3.63996268 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:44.645 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443574+0000", 2024-09-13T06:40:44.645 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 48.130141764000001, 2024-09-13T06:40:44.646 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089895143999999996, 2024-09-13T06:40:44.646 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:44.646 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:40:44.646 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:44.646 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:44.646 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:44.646 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25750 2024-09-13T06:40:44.646 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.646 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:44.646 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.646 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:44.646 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443574+0000", 2024-09-13T06:40:44.647 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:44.647 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.647 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.647 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:44.647 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443574+0000", 2024-09-13T06:40:44.647 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:44.647 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.647 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.647 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:44.647 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443574+0000", 2024-09-13T06:40:44.647 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:44.647 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.647 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.647 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:44.648 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443576+0000", 2024-09-13T06:40:44.648 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6910000000000002e-06 2024-09-13T06:40:44.648 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.648 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.648 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:44.648 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443583+0000", 2024-09-13T06:40:44.648 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.331e-06 2024-09-13T06:40:44.648 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.648 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.648 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:44.648 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443587+0000", 2024-09-13T06:40:44.648 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6129999999999997e-06 2024-09-13T06:40:44.648 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.649 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.649 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:44.649 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533464+0000", 2024-09-13T06:40:44.649 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089876605999999998 2024-09-13T06:40:44.649 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.649 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.649 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:44.649 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533469+0000", 2024-09-13T06:40:44.649 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3909999999999997e-06 2024-09-13T06:40:44.649 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:44.649 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:44.649 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:44.649 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.650 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.650 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25751 3.8 3.63996268 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:44.650 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443592+0000", 2024-09-13T06:40:44.650 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 48.130124066999997, 2024-09-13T06:40:44.650 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089913650999999997, 2024-09-13T06:40:44.650 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:44.650 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:40:44.650 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:44.650 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:44.650 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:44.650 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25751 2024-09-13T06:40:44.650 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.650 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:44.651 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.651 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:44.651 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443592+0000", 2024-09-13T06:40:44.651 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:44.651 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.651 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.651 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:44.651 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443592+0000", 2024-09-13T06:40:44.651 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:44.651 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.651 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.651 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:44.651 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443591+0000", 2024-09-13T06:40:44.652 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:44.652 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.652 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.652 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:44.652 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443594+0000", 2024-09-13T06:40:44.652 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3649999999999998e-06 2024-09-13T06:40:44.652 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.652 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.652 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:44.652 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443599+0000", 2024-09-13T06:40:44.652 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.699e-06 2024-09-13T06:40:44.652 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.653 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.653 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:44.653 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443611+0000", 2024-09-13T06:40:44.653 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1503e-05 2024-09-13T06:40:44.653 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.653 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.653 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:44.653 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533497+0000", 2024-09-13T06:40:44.653 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089886453000000005 2024-09-13T06:40:44.653 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.653 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.653 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:44.653 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533505+0000", 2024-09-13T06:40:44.654 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.9910000000000002e-06 2024-09-13T06:40:44.654 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:44.654 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:44.654 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:44.654 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.654 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.654 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25752 3.8 3.63996268 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:44.654 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443615+0000", 2024-09-13T06:40:44.654 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 48.130100286000001, 2024-09-13T06:40:44.654 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089905868999999999, 2024-09-13T06:40:44.654 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:44.654 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:40:44.654 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:44.655 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:44.655 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:44.655 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25752 2024-09-13T06:40:44.655 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.655 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:44.655 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.655 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:44.655 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443615+0000", 2024-09-13T06:40:44.655 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:44.655 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.655 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.655 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:44.655 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443615+0000", 2024-09-13T06:40:44.655 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:44.655 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.656 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.656 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:44.656 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443615+0000", 2024-09-13T06:40:44.656 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:44.656 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.656 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.656 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:44.656 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443617+0000", 2024-09-13T06:40:44.656 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3539999999999998e-06 2024-09-13T06:40:44.656 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.656 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.656 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:44.657 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443624+0000", 2024-09-13T06:40:44.657 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3600000000000001e-06 2024-09-13T06:40:44.657 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.657 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.657 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:44.657 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443628+0000", 2024-09-13T06:40:44.657 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.2350000000000001e-06 2024-09-13T06:40:44.657 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.657 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.657 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:44.657 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533517+0000", 2024-09-13T06:40:44.657 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089889029999999995 2024-09-13T06:40:44.658 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.658 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.658 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:44.658 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533521+0000", 2024-09-13T06:40:44.658 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.2529999999999998e-06 2024-09-13T06:40:44.658 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:44.658 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:44.658 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:44.658 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.658 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.658 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25755 3.8 3.63996268 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:44.658 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.444692+0000", 2024-09-13T06:40:44.659 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 48.129023580000002, 2024-09-13T06:40:44.659 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.088904186999999996, 2024-09-13T06:40:44.659 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:44.659 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:40:44.659 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:44.659 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:44.659 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:44.659 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25755 2024-09-13T06:40:44.659 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.659 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:44.659 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.659 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:44.659 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.444692+0000", 2024-09-13T06:40:44.660 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:44.660 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.660 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.660 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:44.660 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.444692+0000", 2024-09-13T06:40:44.660 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:44.660 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.660 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.660 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:44.660 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.444692+0000", 2024-09-13T06:40:44.660 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:44.660 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.660 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.661 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:44.661 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.444694+0000", 2024-09-13T06:40:44.661 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.058e-06 2024-09-13T06:40:44.661 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.661 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.661 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:44.661 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.444700+0000", 2024-09-13T06:40:44.661 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7769999999999999e-06 2024-09-13T06:40:44.661 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.661 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.661 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:44.661 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.444704+0000", 2024-09-13T06:40:44.661 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6229999999999996e-06 2024-09-13T06:40:44.662 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.662 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.662 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:44.662 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533587+0000", 2024-09-13T06:40:44.662 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.088882744999999999 2024-09-13T06:40:44.662 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.662 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.662 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:44.662 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533596+0000", 2024-09-13T06:40:44.662 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.3270000000000007e-06 2024-09-13T06:40:44.662 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:44.662 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:44.662 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:44.663 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.663 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.663 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25756 3.8 3.63996268 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:44.663 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.444709+0000", 2024-09-13T06:40:44.663 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 48.129007203999997, 2024-09-13T06:40:44.663 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.088902571, 2024-09-13T06:40:44.663 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:44.663 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:40:44.663 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:44.663 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:44.663 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:44.663 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25756 2024-09-13T06:40:44.663 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.664 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:44.664 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.664 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:44.664 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.444709+0000", 2024-09-13T06:40:44.664 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:44.664 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.664 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.664 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:44.664 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.444709+0000", 2024-09-13T06:40:44.664 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:44.664 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.664 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.664 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:44.665 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.444708+0000", 2024-09-13T06:40:44.665 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:44.665 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.665 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.665 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:44.665 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.444710+0000", 2024-09-13T06:40:44.665 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0729999999999999e-06 2024-09-13T06:40:44.665 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.665 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.665 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:44.665 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.444716+0000", 2024-09-13T06:40:44.665 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7819999999999999e-06 2024-09-13T06:40:44.665 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.666 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.666 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:44.666 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.444720+0000", 2024-09-13T06:40:44.666 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4000000000000002e-06 2024-09-13T06:40:44.666 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.666 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.666 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:44.666 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533606+0000", 2024-09-13T06:40:44.666 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.088885711000000006 2024-09-13T06:40:44.666 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:44.666 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:44.666 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:44.666 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533611+0000", 2024-09-13T06:40:44.666 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.057e-06 2024-09-13T06:40:44.667 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:44.667 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:44.667 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:44.667 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:44.667 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:44.667 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:40:44.668 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-13T06:40:44.669 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:40:44.668+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:40:44.774 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:40:44.772+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:40:44.839 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:40:44.839 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [ 2024-09-13T06:40:44.839 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:44.839 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:57097 3.1d 3:bbfe5683:::rbd_object_map.11218ba71f0d.000000000000002f:head [call rbd.object_map_update in=38b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91)", 2024-09-13T06:40:44.840 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:44.838996+0000", 2024-09-13T06:40:44.840 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.002318166, 2024-09-13T06:40:44.840 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0024346760000000002, 2024-09-13T06:40:44.840 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:44.840 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "waiting for sub ops", 2024-09-13T06:40:44.840 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:44.840 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:44.840 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:44.840 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 57097 2024-09-13T06:40:44.840 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:44.840 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:44.840 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:44.841 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:44.841 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.838996+0000", 2024-09-13T06:40:44.841 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:44.841 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:44.841 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:44.841 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:44.841 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.838996+0000", 2024-09-13T06:40:44.841 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:44.841 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:44.841 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:44.841 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:44.841 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.838995+0000", 2024-09-13T06:40:44.841 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:44.841 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:44.842 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:44.842 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:44.842 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.839000+0000", 2024-09-13T06:40:44.842 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.1290000000000004e-06 2024-09-13T06:40:44.842 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:44.842 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:44.842 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:44.842 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.839009+0000", 2024-09-13T06:40:44.842 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.1989999999999995e-06 2024-09-13T06:40:44.843 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:44.843 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:44.843 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:44.843 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.839016+0000", 2024-09-13T06:40:44.843 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.8220000000000001e-06 2024-09-13T06:40:44.843 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:44.843 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:44.843 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:44.843 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.839658+0000", 2024-09-13T06:40:44.843 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00064251599999999999 2024-09-13T06:40:44.843 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:44.843 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:44.843 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:44.844 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.839743+0000", 2024-09-13T06:40:44.844 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.4612999999999998e-05 2024-09-13T06:40:44.844 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:44.844 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:44.844 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 5", 2024-09-13T06:40:44.844 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.840113+0000", 2024-09-13T06:40:44.844 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000369432 2024-09-13T06:40:44.844 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:44.844 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:44.844 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:44.844 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:44.844 INFO:teuthology.orchestra.run.smithi139.stdout: ], 2024-09-13T06:40:44.844 INFO:teuthology.orchestra.run.smithi139.stdout: "num_ops": 1 2024-09-13T06:40:44.844 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:40:44.865 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-13T06:40:44.915 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:40:44.913+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:40:44.974 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:40:44.969+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:40:44.984 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:40:44.984 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [], 2024-09-13T06:40:44.984 INFO:teuthology.orchestra.run.smithi139.stdout: "complaint_time": 30, 2024-09-13T06:40:44.984 INFO:teuthology.orchestra.run.smithi139.stdout: "num_blocked_ops": 0 2024-09-13T06:40:44.984 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:40:44.998 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-13T06:40:45.075 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:40:45.076+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:40:45.176 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:40:45.173+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:40:45.195 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-13T06:40:45.197 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:40:45.197 INFO:teuthology.orchestra.run.smithi139.stdout: "size": 20, 2024-09-13T06:40:45.197 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 600, 2024-09-13T06:40:45.198 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [ 2024-09-13T06:40:45.198 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:45.198 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18706 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 3346432~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:40:45.198 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.846138+0000", 2024-09-13T06:40:45.198 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 53.351782440000001, 2024-09-13T06:40:45.198 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.102018712, 2024-09-13T06:40:45.198 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:45.198 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:45.198 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:45.198 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:45.198 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:45.198 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18706 2024-09-13T06:40:45.198 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:45.198 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:45.199 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:45.199 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:45.199 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846138+0000", 2024-09-13T06:40:45.199 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:45.199 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:45.199 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:45.199 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:45.199 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846138+0000", 2024-09-13T06:40:45.199 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:45.199 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:45.199 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:45.199 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:45.199 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846138+0000", 2024-09-13T06:40:45.199 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:45.200 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:45.200 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:45.200 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:45.200 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846141+0000", 2024-09-13T06:40:45.200 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.6969999999999999e-06 2024-09-13T06:40:45.200 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:45.200 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:45.200 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:45.200 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846150+0000", 2024-09-13T06:40:45.200 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6400000000000003e-06 2024-09-13T06:40:45.200 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:45.200 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:45.201 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:45.201 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846160+0000", 2024-09-13T06:40:45.201 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.3999999999999998e-06 2024-09-13T06:40:45.201 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:45.201 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:45.201 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:45.201 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.947764+0000", 2024-09-13T06:40:45.201 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101604085 2024-09-13T06:40:45.201 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:45.201 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:45.201 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:45.201 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.947888+0000", 2024-09-13T06:40:45.202 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000124113 2024-09-13T06:40:45.202 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:45.202 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:45.202 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:45.202 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.948157+0000", 2024-09-13T06:40:45.202 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00026943399999999998 2024-09-13T06:40:45.202 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:45.202 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:45.202 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:45.202 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:45.202 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:45.202 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18707 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 3375104~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:40:45.202 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.846207+0000", 2024-09-13T06:40:45.202 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 53.351713674000003, 2024-09-13T06:40:45.203 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10238114099999999, 2024-09-13T06:40:45.203 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:45.203 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:45.203 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:45.203 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:45.203 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:45.203 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18707 2024-09-13T06:40:45.203 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:45.203 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:45.203 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:45.203 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:45.203 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846207+0000", 2024-09-13T06:40:45.203 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:45.203 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:45.204 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:45.204 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:45.204 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846207+0000", 2024-09-13T06:40:45.204 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:45.204 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:45.204 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:45.204 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:45.204 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846206+0000", 2024-09-13T06:40:45.204 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:45.204 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:45.204 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:45.204 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:45.204 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846211+0000", 2024-09-13T06:40:45.204 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.3000000000000003e-06 2024-09-13T06:40:45.205 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:45.205 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:45.205 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:45.205 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846220+0000", 2024-09-13T06:40:45.205 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6199999999999994e-06 2024-09-13T06:40:45.205 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:45.205 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:45.205 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:45.205 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846228+0000", 2024-09-13T06:40:45.205 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.7500000000000003e-06 2024-09-13T06:40:45.205 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:45.205 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:45.205 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:45.206 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.948267+0000", 2024-09-13T06:40:45.206 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10203878700000001 2024-09-13T06:40:45.206 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:45.206 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:45.206 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:45.206 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.948435+0000", 2024-09-13T06:40:45.206 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00016796500000000001 2024-09-13T06:40:45.206 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:45.206 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:45.206 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:45.206 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.948588+0000", 2024-09-13T06:40:45.206 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00015373599999999999 2024-09-13T06:40:45.206 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:45.206 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:45.206 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:45.207 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:45.207 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:45.207 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18718 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 3690496~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:40:45.207 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.850174+0000", 2024-09-13T06:40:45.207 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 53.347746520999998, 2024-09-13T06:40:45.207 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101854154, 2024-09-13T06:40:45.207 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:45.207 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:45.207 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:45.207 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:45.207 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:45.207 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18718 2024-09-13T06:40:45.207 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:45.208 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:45.208 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:45.208 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:45.208 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850174+0000", 2024-09-13T06:40:45.208 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:45.208 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:45.208 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:45.208 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:45.208 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850174+0000", 2024-09-13T06:40:45.208 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:45.208 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:45.208 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:45.208 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:45.208 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850173+0000", 2024-09-13T06:40:45.209 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:45.209 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:45.209 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:45.209 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:45.209 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850178+0000", 2024-09-13T06:40:45.209 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.4129999999999999e-06 2024-09-13T06:40:45.209 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:45.209 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:45.209 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:45.209 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850188+0000", 2024-09-13T06:40:45.209 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.8600000000000005e-06 2024-09-13T06:40:45.209 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:45.209 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:45.210 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:45.210 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850195+0000", 2024-09-13T06:40:45.210 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.8730000000000007e-06 2024-09-13T06:40:45.210 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:45.210 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:45.210 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:45.210 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.951766+0000", 2024-09-13T06:40:45.210 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.1015703 2024-09-13T06:40:45.210 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:45.210 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:45.210 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:45.210 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.951879+0000", 2024-09-13T06:40:45.210 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000112932 2024-09-13T06:40:45.210 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:45.211 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:45.211 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:45.211 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.952029+0000", 2024-09-13T06:40:45.211 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000149846 2024-09-13T06:40:45.211 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:45.211 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:45.211 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:45.211 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:45.211 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:45.211 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18719 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 3719168~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:40:45.211 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.850202+0000", 2024-09-13T06:40:45.211 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 53.347718477999997, 2024-09-13T06:40:45.211 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.102191676, 2024-09-13T06:40:45.211 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:45.212 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:45.212 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:45.212 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:45.212 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:45.212 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18719 2024-09-13T06:40:45.212 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:45.212 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:45.212 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:45.212 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:45.212 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850202+0000", 2024-09-13T06:40:45.212 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:45.212 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:45.212 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:45.213 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:45.213 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850202+0000", 2024-09-13T06:40:45.213 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:45.213 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:45.213 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:45.213 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:45.213 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850202+0000", 2024-09-13T06:40:45.213 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:45.213 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:45.213 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:45.213 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:45.213 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850205+0000", 2024-09-13T06:40:45.213 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.89e-06 2024-09-13T06:40:45.213 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:45.214 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:45.214 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:45.214 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850216+0000", 2024-09-13T06:40:45.214 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0233e-05 2024-09-13T06:40:45.214 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:45.214 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:45.214 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:45.214 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850223+0000", 2024-09-13T06:40:45.214 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5299999999999999e-06 2024-09-13T06:40:45.214 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:45.214 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:45.214 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:45.215 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.952106+0000", 2024-09-13T06:40:45.215 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10188309299999999 2024-09-13T06:40:45.215 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:45.215 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:45.215 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:45.215 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.952233+0000", 2024-09-13T06:40:45.215 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000126993 2024-09-13T06:40:45.215 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:45.215 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:45.215 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:45.215 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.952394+0000", 2024-09-13T06:40:45.215 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000160791 2024-09-13T06:40:45.215 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:45.215 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:45.216 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:45.216 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:45.216 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:45.216 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18720 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 3747840~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:40:45.216 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.850726+0000", 2024-09-13T06:40:45.216 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 53.347194649000002, 2024-09-13T06:40:45.216 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10199504299999999, 2024-09-13T06:40:45.216 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:45.216 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:45.216 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:45.216 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:45.216 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:45.216 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18720 2024-09-13T06:40:45.217 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:45.217 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:45.217 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:45.217 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:45.217 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850726+0000", 2024-09-13T06:40:45.217 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:45.217 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:45.217 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:45.217 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:45.217 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850726+0000", 2024-09-13T06:40:45.217 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:45.217 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:45.217 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:45.217 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:45.218 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850229+0000", 2024-09-13T06:40:45.218 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9995027 2024-09-13T06:40:45.218 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:45.218 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:45.218 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:45.218 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850731+0000", 2024-09-13T06:40:45.218 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00050221599999999999 2024-09-13T06:40:45.218 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:45.218 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:45.218 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:45.218 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850751+0000", 2024-09-13T06:40:45.218 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.9703000000000001e-05 2024-09-13T06:40:45.218 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:45.219 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:45.219 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:45.219 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850764+0000", 2024-09-13T06:40:45.219 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3207000000000001e-05 2024-09-13T06:40:45.219 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:45.219 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:45.219 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:45.219 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.952454+0000", 2024-09-13T06:40:45.219 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101690102 2024-09-13T06:40:45.219 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:45.219 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:45.219 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:45.219 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.952571+0000", 2024-09-13T06:40:45.219 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000116556 2024-09-13T06:40:45.220 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:45.220 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:45.220 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:45.220 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.952721+0000", 2024-09-13T06:40:45.220 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000150419 2024-09-13T06:40:45.220 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:45.220 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:45.220 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:45.220 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:45.220 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:45.220 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18730 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 4034560~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:40:45.220 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.854013+0000", 2024-09-13T06:40:45.220 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 53.343907708000003, 2024-09-13T06:40:45.221 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10186914399999999, 2024-09-13T06:40:45.221 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:45.221 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:45.221 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:45.221 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:45.221 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:45.221 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18730 2024-09-13T06:40:45.221 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:45.221 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:45.221 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:45.221 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:45.221 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.854013+0000", 2024-09-13T06:40:45.221 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:45.221 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:45.222 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:45.222 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:45.222 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.854013+0000", 2024-09-13T06:40:45.222 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:45.222 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:45.222 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:45.222 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:45.222 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.854013+0000", 2024-09-13T06:40:45.222 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:45.222 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:45.222 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:45.222 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:45.223 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.854016+0000", 2024-09-13T06:40:45.223 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.1839999999999999e-06 2024-09-13T06:40:45.223 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:45.223 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:45.223 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:45.223 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.854025+0000", 2024-09-13T06:40:45.223 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.8030000000000003e-06 2024-09-13T06:40:45.223 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:45.223 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:45.223 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:45.223 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.854033+0000", 2024-09-13T06:40:45.223 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6500000000000002e-06 2024-09-13T06:40:45.224 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:45.224 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:45.224 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:45.224 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.955546+0000", 2024-09-13T06:40:45.224 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10151296 2024-09-13T06:40:45.224 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:45.224 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:45.224 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:45.224 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.955694+0000", 2024-09-13T06:40:45.224 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000147773 2024-09-13T06:40:45.224 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:45.224 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:45.224 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:45.225 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.955882+0000", 2024-09-13T06:40:45.225 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000188371 2024-09-13T06:40:45.225 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:45.225 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:45.225 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:45.225 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:45.225 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:45.225 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18742 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 4378624~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:40:45.225 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.857984+0000", 2024-09-13T06:40:45.225 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 53.339936584999997, 2024-09-13T06:40:45.225 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10179961799999999, 2024-09-13T06:40:45.225 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:45.225 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:45.226 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:45.226 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:45.226 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:45.226 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18742 2024-09-13T06:40:45.226 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:45.226 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:45.226 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:45.226 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:45.226 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.857984+0000", 2024-09-13T06:40:45.226 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:45.226 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:45.226 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:45.226 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:45.227 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.857984+0000", 2024-09-13T06:40:45.227 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:45.227 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:45.227 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:45.227 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:45.227 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.857983+0000", 2024-09-13T06:40:45.227 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:45.228 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:45.228 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:45.228 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:45.228 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.857987+0000", 2024-09-13T06:40:45.228 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0670000000000002e-06 2024-09-13T06:40:45.228 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:45.228 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:45.228 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:45.228 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.857997+0000", 2024-09-13T06:40:45.228 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6830000000000003e-06 2024-09-13T06:40:45.228 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:45.229 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:45.229 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:45.229 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.858006+0000", 2024-09-13T06:40:45.229 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.5739999999999996e-06 2024-09-13T06:40:45.229 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:45.229 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:45.229 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:45.229 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.959453+0000", 2024-09-13T06:40:45.229 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101447339 2024-09-13T06:40:45.229 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:45.229 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:45.229 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:45.229 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.959603+0000", 2024-09-13T06:40:45.229 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000150316 2024-09-13T06:40:45.230 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:45.230 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:45.230 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:45.230 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.959784+0000", 2024-09-13T06:40:45.230 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00018065900000000001 2024-09-13T06:40:45.230 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:45.230 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:45.230 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:45.230 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:45.230 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:45.230 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18743 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 4407296~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:40:45.230 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.858012+0000", 2024-09-13T06:40:45.230 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 53.339908592, 2024-09-13T06:40:45.230 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10210024500000001, 2024-09-13T06:40:45.231 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:45.231 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:45.231 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:45.231 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:45.231 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:45.231 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18743 2024-09-13T06:40:45.231 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:45.231 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:45.231 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:45.231 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:45.231 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.858012+0000", 2024-09-13T06:40:45.231 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:45.231 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:45.231 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:45.232 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:45.232 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.858012+0000", 2024-09-13T06:40:45.232 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:45.232 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:45.232 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:45.232 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:45.232 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.858011+0000", 2024-09-13T06:40:45.232 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:45.232 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:45.232 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:45.232 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:45.232 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.858016+0000", 2024-09-13T06:40:45.233 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0659999999999997e-06 2024-09-13T06:40:45.233 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:45.233 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:45.233 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:45.233 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.858024+0000", 2024-09-13T06:40:45.233 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.7700000000000007e-06 2024-09-13T06:40:45.233 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:45.233 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:45.233 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:45.233 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.858032+0000", 2024-09-13T06:40:45.233 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.7700000000000001e-06 2024-09-13T06:40:45.233 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:45.234 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:45.234 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:45.234 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.959850+0000", 2024-09-13T06:40:45.234 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.1018182 2024-09-13T06:40:45.234 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:45.234 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:45.234 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:45.234 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.959964+0000", 2024-09-13T06:40:45.234 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00011413600000000001 2024-09-13T06:40:45.234 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:45.234 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:45.234 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:45.234 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.960113+0000", 2024-09-13T06:40:45.234 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00014813900000000001 2024-09-13T06:40:45.235 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:45.235 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:45.235 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:45.235 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:45.235 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:45.235 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18755 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 4751360~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:40:45.235 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.862061+0000", 2024-09-13T06:40:45.235 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 53.335860339999996, 2024-09-13T06:40:45.235 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101907023, 2024-09-13T06:40:45.235 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:45.235 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:45.235 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:45.235 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:45.235 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:45.236 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18755 2024-09-13T06:40:45.236 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:45.236 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:45.236 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:45.236 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:45.236 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862061+0000", 2024-09-13T06:40:45.236 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:45.236 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:45.236 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:45.236 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:45.236 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862061+0000", 2024-09-13T06:40:45.236 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:45.236 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:45.237 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:45.237 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:45.237 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862060+0000", 2024-09-13T06:40:45.237 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:45.237 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:45.237 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:45.237 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:45.237 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862064+0000", 2024-09-13T06:40:45.237 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.3229999999999999e-06 2024-09-13T06:40:45.237 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:45.237 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:45.237 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:45.238 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862078+0000", 2024-09-13T06:40:45.238 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.433e-05 2024-09-13T06:40:45.238 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:45.238 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:45.238 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:45.238 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862086+0000", 2024-09-13T06:40:45.238 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.3869999999999997e-06 2024-09-13T06:40:45.238 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:45.238 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:45.238 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:45.238 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.963635+0000", 2024-09-13T06:40:45.238 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101549606 2024-09-13T06:40:45.238 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:45.239 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:45.239 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:45.239 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.963783+0000", 2024-09-13T06:40:45.239 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000147312 2024-09-13T06:40:45.239 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:45.239 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:45.239 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:45.239 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.963968+0000", 2024-09-13T06:40:45.239 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000185028 2024-09-13T06:40:45.239 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:45.239 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:45.239 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:45.239 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:45.239 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:45.240 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18756 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 4780032~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:40:45.240 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.862132+0000", 2024-09-13T06:40:45.240 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 53.335788497000003, 2024-09-13T06:40:45.240 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.102159295, 2024-09-13T06:40:45.240 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:45.240 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:45.240 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:45.240 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:45.240 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:45.240 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18756 2024-09-13T06:40:45.240 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:45.240 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:45.240 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:45.241 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:45.241 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862132+0000", 2024-09-13T06:40:45.241 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:45.241 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:45.241 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:45.241 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:45.241 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862132+0000", 2024-09-13T06:40:45.241 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:45.241 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:45.241 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:45.241 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:45.241 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862132+0000", 2024-09-13T06:40:45.241 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:45.242 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:45.242 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:45.242 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:45.242 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862136+0000", 2024-09-13T06:40:45.242 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.9559999999999999e-06 2024-09-13T06:40:45.242 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:45.242 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:45.242 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:45.242 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862145+0000", 2024-09-13T06:40:45.242 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6169999999999996e-06 2024-09-13T06:40:45.242 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:45.242 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:45.242 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:45.243 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862153+0000", 2024-09-13T06:40:45.243 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.8359999999999992e-06 2024-09-13T06:40:45.243 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:45.243 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:45.243 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:45.243 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.964018+0000", 2024-09-13T06:40:45.243 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101865421 2024-09-13T06:40:45.243 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:45.243 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:45.243 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:45.243 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.964140+0000", 2024-09-13T06:40:45.243 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000121172 2024-09-13T06:40:45.243 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:45.244 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:45.244 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:45.244 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.964292+0000", 2024-09-13T06:40:45.244 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00015202600000000001 2024-09-13T06:40:45.244 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:45.244 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:45.244 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:45.244 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:45.244 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:45.244 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18768 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 5124096~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:40:45.244 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.866345+0000", 2024-09-13T06:40:45.244 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 53.33157619, 2024-09-13T06:40:45.244 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101779361, 2024-09-13T06:40:45.245 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:45.245 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:45.245 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:45.245 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:45.245 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:45.245 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18768 2024-09-13T06:40:45.245 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:45.245 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:45.245 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:45.245 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:45.245 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.866345+0000", 2024-09-13T06:40:45.245 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:45.245 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:45.245 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:45.246 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:45.246 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.866345+0000", 2024-09-13T06:40:45.246 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:45.246 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:45.246 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:45.246 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:45.246 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.866344+0000", 2024-09-13T06:40:45.246 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:45.246 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:45.246 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:45.246 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:45.246 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.866348+0000", 2024-09-13T06:40:45.246 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.4300000000000002e-06 2024-09-13T06:40:45.247 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:45.247 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:45.247 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:45.247 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.866356+0000", 2024-09-13T06:40:45.247 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.5930000000000006e-06 2024-09-13T06:40:45.247 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:45.247 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:45.247 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:45.247 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.866364+0000", 2024-09-13T06:40:45.247 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5599999999999996e-06 2024-09-13T06:40:45.247 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:45.247 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:45.247 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:45.247 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.967865+0000", 2024-09-13T06:40:45.248 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101501683 2024-09-13T06:40:45.248 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:45.248 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:45.248 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:45.248 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.967981+0000", 2024-09-13T06:40:45.248 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000115643 2024-09-13T06:40:45.248 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:45.248 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:45.248 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:45.248 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.968124+0000", 2024-09-13T06:40:45.248 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00014305500000000001 2024-09-13T06:40:45.248 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:45.248 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:45.249 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:45.249 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:45.249 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:45.249 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18779 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 5439488~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:40:45.249 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.869996+0000", 2024-09-13T06:40:45.249 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 53.327925305000001, 2024-09-13T06:40:45.249 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10189577399999999, 2024-09-13T06:40:45.249 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:45.249 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:45.249 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:45.249 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:45.249 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:45.249 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18779 2024-09-13T06:40:45.249 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:45.250 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:45.250 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:45.250 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:45.250 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.869996+0000", 2024-09-13T06:40:45.250 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:45.250 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:45.250 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:45.251 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:45.251 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.869996+0000", 2024-09-13T06:40:45.251 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:45.251 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:45.251 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:45.251 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:45.251 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.869995+0000", 2024-09-13T06:40:45.251 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:45.251 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:45.251 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:45.251 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:45.251 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.869998+0000", 2024-09-13T06:40:45.251 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.2729999999999998e-06 2024-09-13T06:40:45.251 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:45.252 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:45.252 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:45.252 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.870007+0000", 2024-09-13T06:40:45.252 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.5760000000000006e-06 2024-09-13T06:40:45.252 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:45.252 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:45.252 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:45.252 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.870014+0000", 2024-09-13T06:40:45.252 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.1400000000000002e-06 2024-09-13T06:40:45.252 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:45.252 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:45.252 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:45.252 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.971631+0000", 2024-09-13T06:40:45.253 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101617503 2024-09-13T06:40:45.253 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:45.253 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:45.253 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:45.253 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.971747+0000", 2024-09-13T06:40:45.253 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00011599600000000001 2024-09-13T06:40:45.253 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:45.253 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:45.253 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:45.253 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.971891+0000", 2024-09-13T06:40:45.253 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000143912 2024-09-13T06:40:45.253 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:45.253 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:45.253 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:45.254 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:45.254 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:45.254 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18792 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 5812224~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:40:45.254 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.874371+0000", 2024-09-13T06:40:45.254 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 53.323550175000001, 2024-09-13T06:40:45.254 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101736005, 2024-09-13T06:40:45.254 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:45.254 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:45.254 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:45.254 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:45.254 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:45.254 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18792 2024-09-13T06:40:45.254 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:45.254 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:45.255 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:45.255 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:45.255 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874371+0000", 2024-09-13T06:40:45.255 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:45.255 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:45.255 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:45.255 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:45.255 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874371+0000", 2024-09-13T06:40:45.255 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:45.255 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:45.255 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:45.255 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:45.255 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874370+0000", 2024-09-13T06:40:45.256 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:45.256 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:45.256 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:45.256 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:45.256 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874374+0000", 2024-09-13T06:40:45.256 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.7239999999999998e-06 2024-09-13T06:40:45.256 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:45.256 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:45.256 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:45.256 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874385+0000", 2024-09-13T06:40:45.256 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1293e-05 2024-09-13T06:40:45.256 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:45.256 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:45.257 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:45.257 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874394+0000", 2024-09-13T06:40:45.257 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.0729999999999994e-06 2024-09-13T06:40:45.257 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:45.257 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:45.257 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:45.257 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.975850+0000", 2024-09-13T06:40:45.257 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10145599700000001 2024-09-13T06:40:45.257 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:45.257 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:45.257 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:45.257 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.975963+0000", 2024-09-13T06:40:45.257 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000112689 2024-09-13T06:40:45.258 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:45.258 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:45.258 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:45.258 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.976107+0000", 2024-09-13T06:40:45.258 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000143836 2024-09-13T06:40:45.258 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:45.258 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:45.258 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:45.258 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:45.258 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:45.258 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18793 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 5840896~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:40:45.258 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.874401+0000", 2024-09-13T06:40:45.258 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 53.323520142, 2024-09-13T06:40:45.258 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.102005516, 2024-09-13T06:40:45.259 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:45.259 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:45.259 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:45.259 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:45.259 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:45.259 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18793 2024-09-13T06:40:45.259 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:45.259 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:45.259 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:45.259 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:45.259 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874401+0000", 2024-09-13T06:40:45.259 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:45.259 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:45.259 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:45.260 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:45.260 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874401+0000", 2024-09-13T06:40:45.260 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:45.260 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:45.260 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:45.260 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:45.260 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874400+0000", 2024-09-13T06:40:45.260 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:45.260 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:45.260 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:45.260 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:45.261 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874404+0000", 2024-09-13T06:40:45.261 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0069999999999999e-06 2024-09-13T06:40:45.261 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:45.261 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:45.261 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:45.261 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874412+0000", 2024-09-13T06:40:45.261 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.5399999999999996e-06 2024-09-13T06:40:45.261 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:45.261 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:45.261 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:45.261 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874420+0000", 2024-09-13T06:40:45.261 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.6199999999999999e-06 2024-09-13T06:40:45.261 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:45.262 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:45.262 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:45.262 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.976150+0000", 2024-09-13T06:40:45.262 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101729874 2024-09-13T06:40:45.262 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:45.262 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:45.262 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:45.262 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.976261+0000", 2024-09-13T06:40:45.262 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000110819 2024-09-13T06:40:45.262 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:45.262 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:45.262 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:45.262 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.976406+0000", 2024-09-13T06:40:45.262 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000145489 2024-09-13T06:40:45.263 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:45.263 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:45.263 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:45.263 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:45.263 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:45.263 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18803 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 6127616~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:40:45.263 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.877851+0000", 2024-09-13T06:40:45.263 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 53.320069648999997, 2024-09-13T06:40:45.263 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101951584, 2024-09-13T06:40:45.263 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:45.264 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:45.264 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:45.264 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:45.264 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:45.264 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18803 2024-09-13T06:40:45.264 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:45.264 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:45.264 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:45.264 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:45.264 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.877851+0000", 2024-09-13T06:40:45.264 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:45.264 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:45.264 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:45.265 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:45.265 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.877851+0000", 2024-09-13T06:40:45.265 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:45.265 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:45.265 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:45.265 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:45.265 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.877851+0000", 2024-09-13T06:40:45.265 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:45.265 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:45.265 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:45.265 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:45.265 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.877854+0000", 2024-09-13T06:40:45.265 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.7929999999999999e-06 2024-09-13T06:40:45.266 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:45.266 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:45.266 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:45.266 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.877864+0000", 2024-09-13T06:40:45.266 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.2029999999999998e-06 2024-09-13T06:40:45.266 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:45.266 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:45.266 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:45.266 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.877873+0000", 2024-09-13T06:40:45.266 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.0440000000000001e-06 2024-09-13T06:40:45.266 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:45.266 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:45.266 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:45.267 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.979544+0000", 2024-09-13T06:40:45.267 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101671198 2024-09-13T06:40:45.267 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:45.267 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:45.267 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:45.267 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.979658+0000", 2024-09-13T06:40:45.267 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000114456 2024-09-13T06:40:45.267 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:45.267 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:45.267 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:45.267 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.979803+0000", 2024-09-13T06:40:45.267 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000144506 2024-09-13T06:40:45.267 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:45.268 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:45.268 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:45.268 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:45.268 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:45.268 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18807 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 6242304~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:40:45.268 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.879235+0000", 2024-09-13T06:40:45.268 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 53.318685619, 2024-09-13T06:40:45.268 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101781258, 2024-09-13T06:40:45.268 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:45.268 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:45.268 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:45.269 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:45.269 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:45.269 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18807 2024-09-13T06:40:45.269 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:45.269 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:45.269 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:45.269 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:45.269 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879235+0000", 2024-09-13T06:40:45.269 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:45.269 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:45.269 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:45.269 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:45.269 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879235+0000", 2024-09-13T06:40:45.269 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:45.269 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:45.270 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:45.270 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:45.270 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879235+0000", 2024-09-13T06:40:45.270 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:45.270 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:45.270 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:45.270 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:45.270 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879239+0000", 2024-09-13T06:40:45.270 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.963e-06 2024-09-13T06:40:45.270 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:45.270 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:45.270 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:45.270 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879247+0000", 2024-09-13T06:40:45.271 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6470000000000004e-06 2024-09-13T06:40:45.271 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:45.271 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:45.271 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:45.271 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879255+0000", 2024-09-13T06:40:45.271 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5429999999999996e-06 2024-09-13T06:40:45.271 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:45.271 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:45.271 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:45.271 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.980756+0000", 2024-09-13T06:40:45.271 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10150165999999999 2024-09-13T06:40:45.271 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:45.271 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:45.271 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:45.272 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.980868+0000", 2024-09-13T06:40:45.272 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000111196 2024-09-13T06:40:45.272 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:45.272 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:45.272 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:45.272 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.981017+0000", 2024-09-13T06:40:45.272 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000148846 2024-09-13T06:40:45.272 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:45.272 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:45.272 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:45.272 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:45.272 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:45.272 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18808 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 6270976~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:40:45.272 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.879261+0000", 2024-09-13T06:40:45.273 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 53.318659480000001, 2024-09-13T06:40:45.273 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.102057547, 2024-09-13T06:40:45.273 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:45.273 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:45.273 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:45.273 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:45.273 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:45.273 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18808 2024-09-13T06:40:45.273 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:45.273 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:45.273 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:45.273 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:45.273 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879261+0000", 2024-09-13T06:40:45.274 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:45.274 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:45.274 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:45.274 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:45.274 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879261+0000", 2024-09-13T06:40:45.274 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:45.274 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:45.274 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:45.274 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:45.274 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879261+0000", 2024-09-13T06:40:45.274 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:45.274 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:45.274 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:45.275 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:45.275 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879264+0000", 2024-09-13T06:40:45.275 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.523e-06 2024-09-13T06:40:45.275 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:45.275 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:45.275 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:45.275 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879273+0000", 2024-09-13T06:40:45.275 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6070000000000008e-06 2024-09-13T06:40:45.275 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:45.275 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:45.275 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:45.275 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879280+0000", 2024-09-13T06:40:45.275 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.4699999999999996e-06 2024-09-13T06:40:45.275 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:45.276 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:45.276 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:45.276 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.981060+0000", 2024-09-13T06:40:45.276 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10177934800000001 2024-09-13T06:40:45.276 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:45.276 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:45.276 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:45.276 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.981174+0000", 2024-09-13T06:40:45.276 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000114456 2024-09-13T06:40:45.276 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:45.276 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:45.276 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:45.276 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.981319+0000", 2024-09-13T06:40:45.276 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00014473900000000001 2024-09-13T06:40:45.277 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:45.277 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:45.277 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:45.277 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:45.277 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:45.277 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18810 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 2662400~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:40:45.277 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.880386+0000", 2024-09-13T06:40:45.277 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 53.317535317999997, 2024-09-13T06:40:45.277 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101728022, 2024-09-13T06:40:45.277 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:45.277 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:45.277 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:45.277 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:45.277 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:45.278 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18810 2024-09-13T06:40:45.278 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:45.278 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:45.278 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:45.278 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:45.278 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880386+0000", 2024-09-13T06:40:45.278 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:45.278 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:45.278 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:45.278 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:45.278 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880386+0000", 2024-09-13T06:40:45.278 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:45.278 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:45.278 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:45.278 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:45.279 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880385+0000", 2024-09-13T06:40:45.279 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:45.279 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:45.279 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:45.279 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:45.279 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880389+0000", 2024-09-13T06:40:45.279 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.8539999999999999e-06 2024-09-13T06:40:45.279 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:45.279 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:45.279 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:45.279 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880398+0000", 2024-09-13T06:40:45.279 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.1689999999999998e-06 2024-09-13T06:40:45.279 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:45.279 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:45.279 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:45.280 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880405+0000", 2024-09-13T06:40:45.280 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5700000000000004e-06 2024-09-13T06:40:45.280 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:45.280 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:45.280 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:45.280 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.981833+0000", 2024-09-13T06:40:45.280 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10142791800000001 2024-09-13T06:40:45.280 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:45.280 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:45.280 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:45.280 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.981973+0000", 2024-09-13T06:40:45.280 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00014002900000000001 2024-09-13T06:40:45.280 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:45.280 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:45.281 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:45.281 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.982114+0000", 2024-09-13T06:40:45.281 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000140276 2024-09-13T06:40:45.281 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:45.281 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:45.281 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:45.281 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:45.281 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:45.281 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18811 3.9 3.140f5209 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:40:45.286 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.880449+0000", 2024-09-13T06:40:45.286 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 53.317471941999997, 2024-09-13T06:40:45.286 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101739355, 2024-09-13T06:40:45.286 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:45.286 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:40:45.286 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:45.286 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:45.286 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:45.286 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18811 2024-09-13T06:40:45.287 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:45.287 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:45.287 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:45.287 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:45.287 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880449+0000", 2024-09-13T06:40:45.287 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:45.287 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:45.287 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:45.287 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:45.287 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880449+0000", 2024-09-13T06:40:45.287 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:45.287 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:45.287 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:45.288 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:45.288 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880448+0000", 2024-09-13T06:40:45.288 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:45.288 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:45.288 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:45.288 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:45.288 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880452+0000", 2024-09-13T06:40:45.288 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0470000000000004e-06 2024-09-13T06:40:45.288 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:45.288 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:45.288 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:45.288 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880462+0000", 2024-09-13T06:40:45.288 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6530000000000006e-06 2024-09-13T06:40:45.289 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:45.289 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:45.289 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:45.289 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880472+0000", 2024-09-13T06:40:45.289 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0027000000000001e-05 2024-09-13T06:40:45.289 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:45.289 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:45.289 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:45.289 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.982172+0000", 2024-09-13T06:40:45.289 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10170043500000001 2024-09-13T06:40:45.289 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:45.289 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:45.289 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:45.289 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.982188+0000", 2024-09-13T06:40:45.290 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6172999999999999e-05 2024-09-13T06:40:45.290 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:45.290 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:45.290 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:45.290 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:45.290 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:45.290 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18812 3.9 3.140f5209 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:40:45.290 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.880478+0000", 2024-09-13T06:40:45.290 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 53.317442704999998, 2024-09-13T06:40:45.290 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10177795100000001, 2024-09-13T06:40:45.290 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:45.290 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:40:45.290 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:45.291 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:45.291 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:45.291 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18812 2024-09-13T06:40:45.291 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:45.291 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:45.291 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:45.291 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:45.291 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880478+0000", 2024-09-13T06:40:45.291 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:45.291 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:45.291 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:45.291 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:45.291 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880478+0000", 2024-09-13T06:40:45.291 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:45.292 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:45.292 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:45.292 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:45.292 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880477+0000", 2024-09-13T06:40:45.292 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:45.292 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:45.292 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:45.292 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:45.292 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880481+0000", 2024-09-13T06:40:45.292 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.827e-06 2024-09-13T06:40:45.292 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:45.292 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:45.292 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:45.292 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880490+0000", 2024-09-13T06:40:45.293 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6100000000000006e-06 2024-09-13T06:40:45.293 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:45.293 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:45.293 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:45.293 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880497+0000", 2024-09-13T06:40:45.293 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.7030000000000006e-06 2024-09-13T06:40:45.293 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:45.293 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:45.293 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:45.293 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.982241+0000", 2024-09-13T06:40:45.293 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10174351199999999 2024-09-13T06:40:45.293 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:45.293 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:45.293 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:45.294 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.982256+0000", 2024-09-13T06:40:45.294 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5143000000000001e-05 2024-09-13T06:40:45.294 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:45.294 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:45.294 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:45.294 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:45.294 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:45.294 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:40:45.296 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-13T06:40:45.296 INFO:tasks.ceph.osd.6.smithi139.stderr:2024-09-13T06:40:45.293+0000 7fcd02c5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26385) UID: 0 2024-09-13T06:40:45.393 INFO:teuthology.orchestra.run.smithi081.stdout:osd.0: {} 2024-09-13T06:40:45.394 INFO:teuthology.orchestra.run.smithi081.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-13T06:40:45.396 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:40:45.396+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:40:45.410 INFO:teuthology.orchestra.run.smithi081.stdout:osd.1: {} 2024-09-13T06:40:45.410 INFO:teuthology.orchestra.run.smithi081.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-13T06:40:45.426 INFO:teuthology.orchestra.run.smithi081.stdout:osd.2: {} 2024-09-13T06:40:45.426 INFO:teuthology.orchestra.run.smithi081.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-13T06:40:45.445 INFO:teuthology.orchestra.run.smithi081.stdout:osd.3: {} 2024-09-13T06:40:45.445 INFO:teuthology.orchestra.run.smithi081.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-13T06:40:45.463 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:40:45.464 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [], 2024-09-13T06:40:45.464 INFO:teuthology.orchestra.run.smithi139.stdout: "num_ops": 0 2024-09-13T06:40:45.464 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:40:45.467 INFO:teuthology.orchestra.run.smithi081.stdout:osd.4: {} 2024-09-13T06:40:45.467 INFO:teuthology.orchestra.run.smithi081.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-13T06:40:45.478 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-13T06:40:45.488 INFO:teuthology.orchestra.run.smithi081.stdout:osd.5: {} 2024-09-13T06:40:45.488 INFO:teuthology.orchestra.run.smithi081.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-13T06:40:45.497 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:40:45.500+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:40:45.505 INFO:teuthology.orchestra.run.smithi081.stdout:osd.6: {} 2024-09-13T06:40:45.506 INFO:teuthology.orchestra.run.smithi081.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-13T06:40:45.526 INFO:teuthology.orchestra.run.smithi081.stdout:osd.7: {} 2024-09-13T06:40:45.526 INFO:teuthology.orchestra.run.smithi081.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-13T06:40:45.598 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:40:45.600+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:40:45.600 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:40:45.600 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:40:45.618 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-13T06:40:45.623 INFO:teuthology.orchestra.run.smithi081.stdout:checking clone #13, image image_client.0-clone13 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent14 2024-09-13T06:40:45.700 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:40:45.697+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:40:45.741 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:40:45.741 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:40:45.755 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-13T06:40:45.801 INFO:tasks.ceph.osd.6.smithi139.stderr:2024-09-13T06:40:45.797+0000 7fcd02c5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26385) UID: 0 2024-09-13T06:40:45.902 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:40:45.904+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:40:45.924 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:40:45.924 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:40:45.938 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-13T06:40:45.956 INFO:teuthology.orchestra.run.smithi081.stdout:2402 read 0x7dc2711 thru 0x7dcf26f (0xcb5f bytes) 2024-09-13T06:40:45.957 INFO:teuthology.orchestra.run.smithi081.stdout:2404 punch from 0x8bf1f39 to 0x8bf6557, (0x461e bytes) 2024-09-13T06:40:45.963 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:40:45.963 INFO:teuthology.orchestra.run.smithi081.stdout:2409 read 0x90b9555 thru 0x90bfb71 (0x661d bytes) 2024-09-13T06:40:45.963 INFO:teuthology.orchestra.run.smithi081.stdout:2410 write 0x65a2424 thru 0x65a557b (0x3158 bytes) 2024-09-13T06:40:45.965 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:40:45.965 INFO:teuthology.orchestra.run.smithi081.stdout:2412 write 0xa9f8c9a thru 0xa9fb786 (0x2aed bytes) 2024-09-13T06:40:45.967 INFO:teuthology.orchestra.run.smithi081.stdout:2413 write 0x7809c53 thru 0x7810241 (0x65ef bytes) 2024-09-13T06:40:45.969 INFO:teuthology.orchestra.run.smithi081.stdout:2415 write 0x328d820 thru 0x328da16 (0x1f7 bytes) 2024-09-13T06:40:45.970 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:40:45.971 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:40:45.971 INFO:teuthology.orchestra.run.smithi081.stdout:2421 write 0xefc2df thru 0xf09ea0 (0xdbc2 bytes) 2024-09-13T06:40:45.972 INFO:teuthology.orchestra.run.smithi081.stdout:2422 write 0x6f7780c thru 0x6f84bfe (0xd3f3 bytes) 2024-09-13T06:40:45.975 INFO:teuthology.orchestra.run.smithi081.stdout:2423 read 0x1cada52 thru 0x1cb3d29 (0x62d8 bytes) 2024-09-13T06:40:45.976 INFO:teuthology.orchestra.run.smithi081.stdout:2424 read 0x5f7cd82 thru 0x5f8b565 (0xe7e4 bytes) 2024-09-13T06:40:45.977 INFO:teuthology.orchestra.run.smithi081.stdout:2425 writesame 0xfb5638 thru 0xfc334c data_size 0x1(0xdd15 bytes) 2024-09-13T06:40:46.002 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:40:45.997+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:40:46.008 INFO:teuthology.orchestra.run.smithi081.stdout:2426 read 0xca1cb74 thru 0xca27417 (0xa8a4 bytes) 2024-09-13T06:40:46.008 INFO:teuthology.orchestra.run.smithi081.stdout:2427 write 0xe339dfe thru 0xe33a325 (0x528 bytes) 2024-09-13T06:40:46.012 INFO:teuthology.orchestra.run.smithi081.stdout:2428 write 0x3ef7644 thru 0x3f033e5 (0xbda2 bytes) 2024-09-13T06:40:46.017 INFO:teuthology.orchestra.run.smithi081.stdout:2429 writesame 0x20faec7 thru 0x20fb513 data_size 0x1(0x64d bytes) 2024-09-13T06:40:46.019 INFO:teuthology.orchestra.run.smithi081.stdout:2430 write 0xbfcd462 thru 0xbfd1733 (0x42d2 bytes) 2024-09-13T06:40:46.038 INFO:teuthology.orchestra.run.smithi081.stdout:2431 trunc from 0xe7b1520 to 0x87e411e 2024-09-13T06:40:46.066 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:40:46.066 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:40:46.078 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:40:46.081 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-13T06:40:46.094 INFO:teuthology.orchestra.run.smithi081.stdout:2433 writesame 0x9082666 thru 0x90896a3 data_size 0x3(0x703e bytes) 2024-09-13T06:40:46.094 INFO:teuthology.orchestra.run.smithi081.stdout:2434 write 0x23a60ad thru 0x23a64ef (0x443 bytes) 2024-09-13T06:40:46.097 INFO:teuthology.orchestra.run.smithi081.stdout:2437 read 0x6b24370 thru 0x6b2cb38 (0x87c9 bytes) 2024-09-13T06:40:46.099 INFO:teuthology.orchestra.run.smithi081.stdout:2439 punch from 0xab6b11 to 0xabd037, (0x6526 bytes) 2024-09-13T06:40:46.099 INFO:teuthology.orchestra.run.smithi081.stdout:2440 read 0x406bdef thru 0x406e1f5 (0x2407 bytes) 2024-09-13T06:40:46.100 INFO:teuthology.orchestra.run.smithi081.stdout:2441 read 0x5de982 thru 0x5e3876 (0x4ef5 bytes) 2024-09-13T06:40:46.101 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:40:46.101 INFO:teuthology.orchestra.run.smithi081.stdout:2444 punch from 0x7083faf to 0x708d8ac, (0x98fd bytes) 2024-09-13T06:40:46.102 INFO:teuthology.orchestra.run.smithi081.stdout:2445 trunc from 0x90896a4 to 0x98e4fd2 2024-09-13T06:40:46.125 INFO:teuthology.orchestra.run.smithi081.stdout:2446 trunc from 0x98e4fd2 to 0xd946159 2024-09-13T06:40:46.127 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:40:46.125+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:40:46.137 INFO:teuthology.orchestra.run.smithi081.stdout:2447 write 0x2f92aa5 thru 0x2fa23e2 (0xf93e bytes) 2024-09-13T06:40:46.141 INFO:teuthology.orchestra.run.smithi081.stdout:2448 read 0xe267d1 thru 0xe35546 (0xed76 bytes) 2024-09-13T06:40:46.160 INFO:teuthology.orchestra.run.smithi081.stdout:2449 trunc from 0xd946159 to 0x6c4370e 2024-09-13T06:40:46.191 INFO:teuthology.orchestra.run.smithi081.stdout:2451 read 0x340d491 thru 0x340e405 (0xf75 bytes) 2024-09-13T06:40:46.192 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:40:46.192 INFO:teuthology.orchestra.run.smithi081.stdout:2455 read 0x2308963 thru 0x230bfdf (0x367d bytes) 2024-09-13T06:40:46.203 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-13T06:40:46.201+0000 7f86a5f06640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26387) UID: 0 2024-09-13T06:40:46.217 INFO:teuthology.orchestra.run.smithi081.stdout:2456 writesame 0xa87724f thru 0xa879f49 data_size 0x2f(0x2cfb bytes) 2024-09-13T06:40:46.241 INFO:teuthology.orchestra.run.smithi081.stdout:2457 write 0xda78229 thru 0xda87ce5 (0xfabd bytes) 2024-09-13T06:40:46.249 INFO:teuthology.orchestra.run.smithi081.stdout:2458 read 0xca5a68f thru 0xca5c3b3 (0x1d25 bytes) 2024-09-13T06:40:46.249 INFO:teuthology.orchestra.run.smithi081.stdout:2460 read 0xf662d9 thru 0xf7555b (0xf283 bytes) 2024-09-13T06:40:46.250 INFO:teuthology.orchestra.run.smithi081.stdout:2462 punch from 0x4e47c7e to 0x4e4aa2b, (0x2dad bytes) 2024-09-13T06:40:46.250 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:40:46.250 INFO:teuthology.orchestra.run.smithi081.stdout:2465 write 0x8c245cf thru 0x8c28258 (0x3c8a bytes) 2024-09-13T06:40:46.252 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:40:46.252 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:40:46.257 INFO:teuthology.orchestra.run.smithi081.stdout:2466 writesame 0x8f73dfa thru 0x8f7a8f6 data_size 0x1(0x6afd bytes) 2024-09-13T06:40:46.267 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-13T06:40:46.295 INFO:teuthology.orchestra.run.smithi081.stdout:2467 read 0x88a1877 thru 0x88af3cd (0xdb57 bytes) 2024-09-13T06:40:46.295 INFO:teuthology.orchestra.run.smithi081.stdout:2468 write 0x7855fc1 thru 0x7863372 (0xd3b2 bytes) 2024-09-13T06:40:46.311 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:40:46.313+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:40:46.329 INFO:teuthology.orchestra.run.smithi081.stdout:2469 trunc from 0xda87ce6 to 0x1de7709 2024-09-13T06:40:46.403 INFO:teuthology.orchestra.run.smithi081.stdout:2470 trunc from 0x1de7709 to 0x7c69993 2024-09-13T06:40:46.404 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:40:46.404+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:40:46.414 INFO:teuthology.orchestra.run.smithi081.stdout:2472 punch from 0x516b0ea to 0x517752f, (0xc445 bytes) 2024-09-13T06:40:46.423 INFO:teuthology.orchestra.run.smithi081.stdout:2473 trunc from 0x7c69993 to 0x426fe6d 2024-09-13T06:40:46.438 INFO:teuthology.orchestra.run.smithi081.stdout:2474 trunc from 0x426fe6d to 0x51f6621 2024-09-13T06:40:46.441 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-13T06:40:46.441 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-13T06:40:46.441 INFO:tasks.thrashosds.thrasher:Removing osd 5, in_osds are: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-13T06:40:46.441 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd out 5 2024-09-13T06:40:46.449 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:40:46.449 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:40:46.452 INFO:teuthology.orchestra.run.smithi081.stdout:2475 read 0x29a23a4 thru 0x29ae7d2 (0xc42f bytes) 2024-09-13T06:40:46.453 INFO:teuthology.orchestra.run.smithi081.stdout:2477 punch from 0x2d23d35 to 0x2d32a5e, (0xed29 bytes) 2024-09-13T06:40:46.453 INFO:teuthology.orchestra.run.smithi081.stdout:2478 read 0x37ef18a thru 0x37f257e (0x33f5 bytes) 2024-09-13T06:40:46.453 INFO:teuthology.orchestra.run.smithi081.stdout:2479 read 0x3fe3c81 thru 0x3fe877b (0x4afb bytes) 2024-09-13T06:40:46.462 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-13T06:40:46.465 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-13T06:40:46.483 INFO:teuthology.orchestra.run.smithi081.stdout:2480 write 0xd34d45c thru 0xd357a79 (0xa61e bytes) 2024-09-13T06:40:46.493 INFO:teuthology.orchestra.run.smithi081.stdout:2481 trunc from 0xd357a7a to 0x9960be0 2024-09-13T06:40:46.505 INFO:teuthology.orchestra.run.smithi081.stdout:2483 read 0x4526540 thru 0x4534685 (0xe146 bytes) 2024-09-13T06:40:46.505 INFO:teuthology.orchestra.run.smithi081.stdout:2486 read 0x53d7bc7 thru 0x53da63a (0x2a74 bytes) 2024-09-13T06:40:46.505 INFO:teuthology.orchestra.run.smithi081.stdout:2487 write 0x163d5cd thru 0x1640047 (0x2a7b bytes) 2024-09-13T06:40:46.513 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:40:46.509+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:40:46.521 INFO:teuthology.orchestra.run.smithi081.stdout:2488 writesame 0xe0a4212 thru 0xe0b00ed data_size 0x46(0xbedc bytes) 2024-09-13T06:40:46.521 INFO:teuthology.orchestra.run.smithi081.stdout:2490 punch from 0x50100b to 0x507e2f, (0x6e24 bytes) 2024-09-13T06:40:46.535 INFO:teuthology.orchestra.run.smithi081.stdout:2491 trunc from 0xe0b00ee to 0x3d73eb6 2024-09-13T06:40:46.543 INFO:teuthology.orchestra.run.smithi081.stdout:2492 write 0x17e9d9c thru 0x17f5c78 (0xbedd bytes) 2024-09-13T06:40:46.546 INFO:teuthology.orchestra.run.smithi081.stdout:2493 punch from 0x328a1ea to 0x3290c9a, (0x6ab0 bytes) 2024-09-13T06:40:46.552 INFO:teuthology.orchestra.run.smithi081.stdout:2498 trunc from 0x3d73eb6 to 0x7e8b690 2024-09-13T06:40:46.560 INFO:teuthology.orchestra.run.smithi081.stdout:2499 writesame 0x2203c42 thru 0x220e201 data_size 0x88(0xa5c0 bytes) 2024-09-13T06:40:46.564 INFO:teuthology.orchestra.run.smithi081.stdout:2500 writesame 0x2930b12 thru 0x2932047 data_size 0x6(0x1536 bytes) 2024-09-13T06:40:46.580 INFO:teuthology.orchestra.run.smithi081.stdout:2502 writesame 0xb3278e7 thru 0xb335ca5 data_size 0x1(0xe3bf bytes) 2024-09-13T06:40:46.580 INFO:teuthology.orchestra.run.smithi081.stdout:2503 write 0x1d413c7 thru 0x1d45f9a (0x4bd4 bytes) 2024-09-13T06:40:46.584 INFO:teuthology.orchestra.run.smithi081.stdout:2504 clone 16 order 18 su 65536 sc 12 2024-09-13T06:40:46.592 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:40:46.592 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:40:46.606 INFO:tasks.ceph.osd.6.smithi139.stderr:2024-09-13T06:40:46.601+0000 7fcd02c5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26385) UID: 0 2024-09-13T06:40:46.607 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-13T06:40:46.707 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:40:46.707+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:40:46.765 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-13T06:40:46.767+0000 7fcdeb9fe640 -1 mon.a@0(leader).osd e93 definitely_dead 0 2024-09-13T06:40:46.773 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:40:46.773 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:40:46.787 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-13T06:40:46.807 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-13T06:40:46.805+0000 7f86a5f06640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26387) UID: 0 2024-09-13T06:40:46.908 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:40:46.908 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:40:46.908 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:40:46.907+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:40:46.926 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-13T06:40:47.009 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:40:47.009+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:40:47.089 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:40:47.089 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:40:47.102 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-13T06:40:47.149 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:40:47.151+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:40:47.211 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:40:47.211+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:40:47.224 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:40:47.224 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:40:47.238 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-13T06:40:47.333 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:40:47.331+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:40:47.409 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:40:47.409 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:40:47.412 INFO:tasks.ceph.osd.6.smithi139.stderr:2024-09-13T06:40:47.413+0000 7fcd02c5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26385) UID: 0 2024-09-13T06:40:47.423 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-13T06:40:47.464 INFO:teuthology.orchestra.run.smithi081.stderr:nodeep-scrub is unset 2024-09-13T06:40:47.464 INFO:teuthology.orchestra.run.smithi081.stderr:marked out osd.5. 2024-09-13T06:40:47.512 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:40:47.513+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:40:47.546 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-13T06:40:47.582 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:40:47.582 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:40:47.596 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-13T06:40:47.645 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:40:47.647+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:40:47.693 INFO:teuthology.orchestra.run.smithi081.stdout:osd.0: {} 2024-09-13T06:40:47.694 INFO:teuthology.orchestra.run.smithi081.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-13T06:40:47.711 INFO:teuthology.orchestra.run.smithi081.stdout:osd.1: {} 2024-09-13T06:40:47.712 INFO:teuthology.orchestra.run.smithi081.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-13T06:40:47.714 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:40:47.713+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:40:47.728 INFO:teuthology.orchestra.run.smithi081.stdout:osd.2: {} 2024-09-13T06:40:47.728 INFO:teuthology.orchestra.run.smithi081.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-13T06:40:47.745 INFO:teuthology.orchestra.run.smithi081.stdout:osd.3: {} 2024-09-13T06:40:47.746 INFO:teuthology.orchestra.run.smithi081.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-13T06:40:47.764 INFO:teuthology.orchestra.run.smithi081.stdout:osd.4: {} 2024-09-13T06:40:47.765 INFO:teuthology.orchestra.run.smithi081.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-13T06:40:47.772 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:40:47.772 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 20, 2024-09-13T06:40:47.772 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 600, 2024-09-13T06:40:47.773 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [ 2024-09-13T06:40:47.773 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:47.773 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:21979 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 14217216~4096 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:40:47.773 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.888811+0000", 2024-09-13T06:40:47.773 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 54.885469301000001, 2024-09-13T06:40:47.773 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049092969, 2024-09-13T06:40:47.773 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:47.773 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:47.773 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:47.773 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:47.773 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:47.773 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 21979 2024-09-13T06:40:47.773 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:47.773 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:47.774 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:47.774 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:47.774 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888811+0000", 2024-09-13T06:40:47.774 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:47.774 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:47.774 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:47.774 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:47.774 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888811+0000", 2024-09-13T06:40:47.774 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:47.774 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:47.774 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:47.774 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:47.774 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888811+0000", 2024-09-13T06:40:47.775 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:40:47.775 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:47.775 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:47.775 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:47.775 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888812+0000", 2024-09-13T06:40:47.775 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.204e-06 2024-09-13T06:40:47.775 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:47.775 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:47.775 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:47.775 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888815+0000", 2024-09-13T06:40:47.775 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9359999999999999e-06 2024-09-13T06:40:47.775 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:47.775 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:47.775 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:47.776 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888818+0000", 2024-09-13T06:40:47.776 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.7369999999999998e-06 2024-09-13T06:40:47.776 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:47.776 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:47.776 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:47.776 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.937663+0000", 2024-09-13T06:40:47.776 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.048844540999999998 2024-09-13T06:40:47.776 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:47.776 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:47.776 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:47.776 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.937709+0000", 2024-09-13T06:40:47.776 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6492999999999997e-05 2024-09-13T06:40:47.777 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:47.777 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:47.777 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:47.777 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.937904+0000", 2024-09-13T06:40:47.777 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00019526499999999999 2024-09-13T06:40:47.777 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:47.777 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:47.777 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:47.777 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:47.777 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:47.777 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:21980 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 14245888~4096 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:40:47.777 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.888820+0000", 2024-09-13T06:40:47.777 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 54.885460623999997, 2024-09-13T06:40:47.778 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049357080999999997, 2024-09-13T06:40:47.778 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:47.778 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:47.778 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:47.778 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:47.778 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:47.778 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 21980 2024-09-13T06:40:47.778 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:47.778 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:47.778 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:47.778 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:47.778 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888820+0000", 2024-09-13T06:40:47.778 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:47.778 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:47.778 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:47.779 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:47.779 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888820+0000", 2024-09-13T06:40:47.779 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:47.779 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:47.779 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:47.779 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:47.779 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888820+0000", 2024-09-13T06:40:47.779 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:40:47.779 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:47.779 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:47.779 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:47.779 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888821+0000", 2024-09-13T06:40:47.779 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.122e-06 2024-09-13T06:40:47.779 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:47.780 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:47.780 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:47.780 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888824+0000", 2024-09-13T06:40:47.780 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.0580000000000002e-06 2024-09-13T06:40:47.780 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:47.780 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:47.780 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:47.780 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888827+0000", 2024-09-13T06:40:47.780 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.666e-06 2024-09-13T06:40:47.780 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:47.780 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:47.780 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:47.780 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.937935+0000", 2024-09-13T06:40:47.780 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049108329999999999 2024-09-13T06:40:47.781 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:47.781 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:47.781 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:47.781 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.937985+0000", 2024-09-13T06:40:47.781 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9694000000000002e-05 2024-09-13T06:40:47.781 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:47.781 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:47.781 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:47.781 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.938177+0000", 2024-09-13T06:40:47.781 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00019241899999999999 2024-09-13T06:40:47.781 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:47.782 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:47.782 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:47.782 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:47.782 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:47.782 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:21984 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:snapdir [list-snaps] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:40:47.782 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.888829+0000", 2024-09-13T06:40:47.782 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 54.885451846000002, 2024-09-13T06:40:47.782 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049524545000000003, 2024-09-13T06:40:47.782 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:47.782 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:47.782 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:47.783 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:47.783 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:47.783 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 21984 2024-09-13T06:40:47.783 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:47.783 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:47.783 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:47.783 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:47.783 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888829+0000", 2024-09-13T06:40:47.783 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:47.783 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:47.784 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:47.784 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:47.784 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888829+0000", 2024-09-13T06:40:47.784 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:47.784 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:47.784 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:47.784 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:47.784 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888829+0000", 2024-09-13T06:40:47.784 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:40:47.784 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:47.784 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:47.784 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:47.784 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888830+0000", 2024-09-13T06:40:47.784 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2529999999999999e-06 2024-09-13T06:40:47.785 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:47.785 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:47.785 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:47.785 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888835+0000", 2024-09-13T06:40:47.785 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.4729999999999999e-06 2024-09-13T06:40:47.785 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:47.785 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:47.785 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:47.785 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888840+0000", 2024-09-13T06:40:47.785 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0159999999999999e-06 2024-09-13T06:40:47.785 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:47.785 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:47.785 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:47.786 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.938199+0000", 2024-09-13T06:40:47.786 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049358974999999999 2024-09-13T06:40:47.786 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:47.786 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:47.786 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:47.786 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.938268+0000", 2024-09-13T06:40:47.786 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.8876999999999998e-05 2024-09-13T06:40:47.786 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:47.786 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:47.786 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:47.786 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.938353+0000", 2024-09-13T06:40:47.786 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.5155999999999996e-05 2024-09-13T06:40:47.787 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:47.787 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:47.787 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:47.787 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:47.787 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:47.787 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:21985 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 12587008~4096 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:40:47.787 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.888858+0000", 2024-09-13T06:40:47.787 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 54.885422695999999, 2024-09-13T06:40:47.787 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049674347000000001, 2024-09-13T06:40:47.787 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:47.787 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:47.787 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:47.787 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:47.788 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:47.788 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 21985 2024-09-13T06:40:47.788 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:47.788 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:47.788 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:47.788 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:47.788 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888858+0000", 2024-09-13T06:40:47.788 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:47.788 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:47.788 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:47.788 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:47.788 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888858+0000", 2024-09-13T06:40:47.788 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:47.788 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:47.789 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:47.789 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:47.789 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888857+0000", 2024-09-13T06:40:47.789 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:47.789 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:47.789 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:47.789 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:47.789 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888860+0000", 2024-09-13T06:40:47.789 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4739999999999999e-06 2024-09-13T06:40:47.789 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:47.789 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:47.790 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:47.790 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888867+0000", 2024-09-13T06:40:47.790 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.7170000000000002e-06 2024-09-13T06:40:47.790 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:47.790 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:47.790 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:47.790 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888871+0000", 2024-09-13T06:40:47.790 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5120000000000002e-06 2024-09-13T06:40:47.790 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:47.790 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:47.790 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:47.791 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.938389+0000", 2024-09-13T06:40:47.791 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049517717000000003 2024-09-13T06:40:47.791 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:47.791 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:47.791 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:47.791 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.938449+0000", 2024-09-13T06:40:47.791 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0513999999999997e-05 2024-09-13T06:40:47.791 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:47.791 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:47.791 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:47.791 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.938532+0000", 2024-09-13T06:40:47.791 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.2936999999999996e-05 2024-09-13T06:40:47.791 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:47.791 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:47.792 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:47.792 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:47.792 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:47.792 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:21986 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 12615680~4096 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:40:47.792 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.888875+0000", 2024-09-13T06:40:47.792 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 54.885405183000003, 2024-09-13T06:40:47.792 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049881781, 2024-09-13T06:40:47.792 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:47.792 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:47.792 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:47.792 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:47.792 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:47.792 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 21986 2024-09-13T06:40:47.793 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:47.793 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:47.793 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:47.793 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:47.793 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888875+0000", 2024-09-13T06:40:47.793 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:47.793 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:47.793 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:47.793 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:47.793 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888875+0000", 2024-09-13T06:40:47.793 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:47.793 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:47.793 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:47.793 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:47.794 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888875+0000", 2024-09-13T06:40:47.794 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:47.794 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:47.794 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:47.794 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:47.794 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888880+0000", 2024-09-13T06:40:47.794 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7600000000000002e-06 2024-09-13T06:40:47.794 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:47.794 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:47.794 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:47.794 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888887+0000", 2024-09-13T06:40:47.794 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3950000000000003e-06 2024-09-13T06:40:47.794 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:47.794 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:47.794 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:47.795 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888892+0000", 2024-09-13T06:40:47.795 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0409999999999997e-06 2024-09-13T06:40:47.795 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:47.795 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:47.795 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:47.795 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.938568+0000", 2024-09-13T06:40:47.795 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049675267000000002 2024-09-13T06:40:47.795 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:47.795 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:47.795 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:47.795 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.938653+0000", 2024-09-13T06:40:47.795 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.5792999999999997e-05 2024-09-13T06:40:47.795 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:47.795 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:47.796 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:47.796 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.938757+0000", 2024-09-13T06:40:47.796 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00010387699999999999 2024-09-13T06:40:47.796 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:47.796 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:47.796 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:47.796 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:47.796 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:47.796 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:21987 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 12644352~4096 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:40:47.796 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.888899+0000", 2024-09-13T06:40:47.796 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 54.885381836999997, 2024-09-13T06:40:47.796 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.050094056999999997, 2024-09-13T06:40:47.797 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:47.797 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:47.797 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:47.797 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:47.797 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:47.797 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 21987 2024-09-13T06:40:47.797 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:47.797 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:47.797 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:47.797 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:47.797 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888899+0000", 2024-09-13T06:40:47.797 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:47.797 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:47.797 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:47.798 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:47.798 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888899+0000", 2024-09-13T06:40:47.798 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:47.798 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:47.798 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:47.798 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:47.798 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888899+0000", 2024-09-13T06:40:47.798 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:47.798 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:47.798 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:47.798 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:47.798 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888901+0000", 2024-09-13T06:40:47.798 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2539999999999999e-06 2024-09-13T06:40:47.798 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:47.799 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:47.799 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:47.799 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888907+0000", 2024-09-13T06:40:47.799 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9009999999999999e-06 2024-09-13T06:40:47.799 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:47.799 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:47.799 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:47.799 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888912+0000", 2024-09-13T06:40:47.799 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9840000000000001e-06 2024-09-13T06:40:47.799 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:47.799 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:47.799 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:47.799 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.938810+0000", 2024-09-13T06:40:47.799 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049898835000000002 2024-09-13T06:40:47.799 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:47.800 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:47.800 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:47.800 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.938890+0000", 2024-09-13T06:40:47.800 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.9215000000000006e-05 2024-09-13T06:40:47.800 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:47.800 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:47.800 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:47.800 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.938993+0000", 2024-09-13T06:40:47.800 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000103194 2024-09-13T06:40:47.800 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:47.800 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:47.801 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:47.801 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:47.801 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:47.801 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:21988 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 12673024~4096 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:40:47.801 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.888916+0000", 2024-09-13T06:40:47.801 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 54.885364821000003, 2024-09-13T06:40:47.801 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.050203036999999999, 2024-09-13T06:40:47.801 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:47.801 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:47.801 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:47.801 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:47.801 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:47.801 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 21988 2024-09-13T06:40:47.802 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:47.802 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:47.802 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:47.802 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:47.802 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888916+0000", 2024-09-13T06:40:47.802 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:47.802 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:47.802 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:47.802 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:47.802 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888916+0000", 2024-09-13T06:40:47.802 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:47.802 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:47.802 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:47.802 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:47.803 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888915+0000", 2024-09-13T06:40:47.803 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:47.803 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:47.803 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:47.803 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:47.803 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888918+0000", 2024-09-13T06:40:47.803 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1500000000000002e-06 2024-09-13T06:40:47.803 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:47.803 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:47.803 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:47.803 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888925+0000", 2024-09-13T06:40:47.803 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.9380000000000003e-06 2024-09-13T06:40:47.803 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:47.803 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:47.804 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:47.804 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888933+0000", 2024-09-13T06:40:47.804 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.0560000000000005e-06 2024-09-13T06:40:47.804 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:47.804 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:47.804 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:47.804 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.939026+0000", 2024-09-13T06:40:47.804 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.050093499999999999 2024-09-13T06:40:47.804 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:47.804 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:47.804 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:47.804 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.939068+0000", 2024-09-13T06:40:47.804 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.1705999999999997e-05 2024-09-13T06:40:47.805 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:47.805 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:47.805 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:47.805 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.939119+0000", 2024-09-13T06:40:47.805 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.1048999999999999e-05 2024-09-13T06:40:47.805 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:47.805 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:47.805 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:47.805 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:47.805 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:47.805 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:21989 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 12701696~4096 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:40:47.805 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.888938+0000", 2024-09-13T06:40:47.805 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 54.885342494, 2024-09-13T06:40:47.806 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.050294393999999999, 2024-09-13T06:40:47.806 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:47.806 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:47.806 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:47.806 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:47.806 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:47.806 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 21989 2024-09-13T06:40:47.806 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:47.806 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:47.806 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:47.806 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:47.806 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888938+0000", 2024-09-13T06:40:47.806 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:47.806 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:47.807 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:47.807 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:47.807 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888938+0000", 2024-09-13T06:40:47.807 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:47.807 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:47.807 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:47.807 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:47.807 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888938+0000", 2024-09-13T06:40:47.807 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:47.807 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:47.807 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:47.807 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:47.807 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888940+0000", 2024-09-13T06:40:47.807 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5330000000000001e-06 2024-09-13T06:40:47.808 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:47.808 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:47.808 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:47.808 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888947+0000", 2024-09-13T06:40:47.808 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.2389999999999999e-06 2024-09-13T06:40:47.808 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:47.808 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:47.808 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:47.808 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888952+0000", 2024-09-13T06:40:47.808 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.5720000000000002e-06 2024-09-13T06:40:47.808 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:47.808 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:47.808 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:47.809 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.939141+0000", 2024-09-13T06:40:47.809 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.050188903999999999 2024-09-13T06:40:47.809 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:47.809 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:47.809 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:47.809 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.939182+0000", 2024-09-13T06:40:47.809 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.0926000000000001e-05 2024-09-13T06:40:47.809 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:47.809 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:47.809 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:47.809 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.939233+0000", 2024-09-13T06:40:47.809 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0532999999999999e-05 2024-09-13T06:40:47.809 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:47.810 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:47.810 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:47.810 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:47.810 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:47.810 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:22006 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 13189120~4096 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:40:47.810 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.892763+0000", 2024-09-13T06:40:47.810 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 54.881517967999997, 2024-09-13T06:40:47.810 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.048963505999999997, 2024-09-13T06:40:47.810 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:47.810 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:47.810 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:47.810 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:47.810 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:47.810 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 22006 2024-09-13T06:40:47.811 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:47.811 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:47.811 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:47.811 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:47.811 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892763+0000", 2024-09-13T06:40:47.811 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:47.811 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:47.811 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:47.811 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:47.811 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892763+0000", 2024-09-13T06:40:47.811 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:47.811 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:47.811 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:47.811 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:47.811 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892763+0000", 2024-09-13T06:40:47.811 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:40:47.812 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:47.812 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:47.812 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:47.812 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892764+0000", 2024-09-13T06:40:47.812 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2410000000000001e-06 2024-09-13T06:40:47.812 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:47.812 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:47.812 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:47.812 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892767+0000", 2024-09-13T06:40:47.812 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9390000000000002e-06 2024-09-13T06:40:47.812 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:47.812 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:47.812 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:47.812 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892769+0000", 2024-09-13T06:40:47.812 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5390000000000002e-06 2024-09-13T06:40:47.813 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:47.813 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:47.813 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:47.813 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.941560+0000", 2024-09-13T06:40:47.813 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.048791221000000003 2024-09-13T06:40:47.813 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:47.813 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:47.813 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:47.813 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.941632+0000", 2024-09-13T06:40:47.813 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.1932000000000002e-05 2024-09-13T06:40:47.813 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:47.813 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:47.813 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:47.813 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.941726+0000", 2024-09-13T06:40:47.814 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.3839999999999996e-05 2024-09-13T06:40:47.814 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:47.814 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:47.814 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:47.814 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:47.814 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:47.814 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:22007 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 13217792~4096 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:40:47.814 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.892771+0000", 2024-09-13T06:40:47.814 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 54.881509387999998, 2024-09-13T06:40:47.814 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049090024000000003, 2024-09-13T06:40:47.814 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:47.814 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:47.814 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:47.814 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:47.814 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:47.814 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 22007 2024-09-13T06:40:47.815 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:47.815 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:47.815 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:47.815 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:47.815 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892771+0000", 2024-09-13T06:40:47.815 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:47.815 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:47.815 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:47.815 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:47.815 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892771+0000", 2024-09-13T06:40:47.815 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:47.815 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:47.815 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:47.815 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:47.815 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892771+0000", 2024-09-13T06:40:47.816 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:40:47.816 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:47.816 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:47.816 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:47.816 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892772+0000", 2024-09-13T06:40:47.816 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.184e-06 2024-09-13T06:40:47.816 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:47.816 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:47.816 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:47.816 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892775+0000", 2024-09-13T06:40:47.816 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9179999999999998e-06 2024-09-13T06:40:47.816 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:47.816 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:47.816 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:47.816 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892778+0000", 2024-09-13T06:40:47.816 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4990000000000001e-06 2024-09-13T06:40:47.817 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:47.817 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:47.817 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:47.817 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.941760+0000", 2024-09-13T06:40:47.817 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.048982070000000003 2024-09-13T06:40:47.817 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:47.817 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:47.817 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:47.817 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.941808+0000", 2024-09-13T06:40:47.817 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.8278000000000001e-05 2024-09-13T06:40:47.817 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:47.817 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:47.817 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:47.818 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.941861+0000", 2024-09-13T06:40:47.818 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3284e-05 2024-09-13T06:40:47.818 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:47.818 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:47.818 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:47.818 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:47.818 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:47.818 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:22008 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 13246464~4096 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:40:47.818 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.892780+0000", 2024-09-13T06:40:47.818 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 54.881500731000003, 2024-09-13T06:40:47.818 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049200477999999999, 2024-09-13T06:40:47.818 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:47.818 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:47.818 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:47.819 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:47.819 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:47.819 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 22008 2024-09-13T06:40:47.819 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:47.819 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:47.819 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:47.819 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:47.819 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892780+0000", 2024-09-13T06:40:47.819 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:47.819 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:47.819 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:47.819 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:47.819 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892780+0000", 2024-09-13T06:40:47.819 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:47.820 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:47.820 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:47.820 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:47.820 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892780+0000", 2024-09-13T06:40:47.820 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:40:47.820 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:47.820 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:47.820 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:47.820 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892781+0000", 2024-09-13T06:40:47.820 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.083e-06 2024-09-13T06:40:47.820 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:47.820 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:47.820 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:47.820 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892784+0000", 2024-09-13T06:40:47.820 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.926e-06 2024-09-13T06:40:47.821 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:47.821 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:47.821 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:47.821 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892786+0000", 2024-09-13T06:40:47.821 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4490000000000002e-06 2024-09-13T06:40:47.821 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:47.821 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:47.821 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:47.821 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.941888+0000", 2024-09-13T06:40:47.821 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049102290999999999 2024-09-13T06:40:47.821 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:47.821 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:47.821 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:47.822 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.941929+0000", 2024-09-13T06:40:47.822 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.0541999999999999e-05 2024-09-13T06:40:47.822 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:47.822 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:47.822 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:47.822 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.941980+0000", 2024-09-13T06:40:47.822 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.1391999999999999e-05 2024-09-13T06:40:47.822 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:47.822 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:47.822 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:47.822 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:47.822 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:47.822 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:22009 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 13275136~4096 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:40:47.822 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.892788+0000", 2024-09-13T06:40:47.822 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 54.881492246999997, 2024-09-13T06:40:47.823 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049311926999999998, 2024-09-13T06:40:47.823 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:47.823 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:47.823 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:47.823 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:47.823 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:47.823 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 22009 2024-09-13T06:40:47.823 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:47.823 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:47.823 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:47.823 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:47.823 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892788+0000", 2024-09-13T06:40:47.823 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:47.823 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:47.823 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:47.823 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:47.824 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892788+0000", 2024-09-13T06:40:47.824 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:47.824 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:47.824 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:47.824 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:47.824 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892788+0000", 2024-09-13T06:40:47.824 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:40:47.824 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:47.824 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:47.824 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:47.824 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892789+0000", 2024-09-13T06:40:47.824 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1850000000000001e-06 2024-09-13T06:40:47.824 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:47.824 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:47.825 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:47.825 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892793+0000", 2024-09-13T06:40:47.825 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.9099999999999998e-06 2024-09-13T06:40:47.825 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:47.825 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:47.825 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:47.825 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892798+0000", 2024-09-13T06:40:47.825 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5070000000000002e-06 2024-09-13T06:40:47.825 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:47.825 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:47.825 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:47.825 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.942007+0000", 2024-09-13T06:40:47.825 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049208904999999997 2024-09-13T06:40:47.826 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:47.826 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:47.826 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:47.826 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.942049+0000", 2024-09-13T06:40:47.826 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.1922000000000003e-05 2024-09-13T06:40:47.826 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:47.826 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:47.826 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:47.826 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.942100+0000", 2024-09-13T06:40:47.826 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.1736000000000001e-05 2024-09-13T06:40:47.826 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:47.826 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:47.826 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:47.826 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:47.826 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:47.827 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:22010 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 13303808~4096 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:40:47.827 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.892817+0000", 2024-09-13T06:40:47.827 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 54.881464051000002, 2024-09-13T06:40:47.827 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049466149000000001, 2024-09-13T06:40:47.827 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:47.827 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:47.827 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:47.827 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:47.827 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:47.827 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 22010 2024-09-13T06:40:47.827 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:47.827 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:47.827 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:47.827 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:47.828 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892817+0000", 2024-09-13T06:40:47.828 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:47.828 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:47.828 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:47.828 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:47.828 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892817+0000", 2024-09-13T06:40:47.828 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:47.828 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:47.828 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:47.828 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:47.828 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892816+0000", 2024-09-13T06:40:47.828 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:47.828 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:47.828 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:47.828 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:47.829 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892821+0000", 2024-09-13T06:40:47.829 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9459999999999997e-06 2024-09-13T06:40:47.829 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:47.829 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:47.829 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:47.829 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892828+0000", 2024-09-13T06:40:47.829 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.6780000000000003e-06 2024-09-13T06:40:47.829 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:47.829 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:47.829 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:47.829 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892833+0000", 2024-09-13T06:40:47.829 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.8389999999999997e-06 2024-09-13T06:40:47.829 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:47.829 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:47.830 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:47.830 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.942127+0000", 2024-09-13T06:40:47.830 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049294163000000002 2024-09-13T06:40:47.830 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:47.830 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:47.830 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:47.830 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.942186+0000", 2024-09-13T06:40:47.830 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9335e-05 2024-09-13T06:40:47.830 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:47.830 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:47.830 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:47.830 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.942283+0000", 2024-09-13T06:40:47.830 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.6699000000000004e-05 2024-09-13T06:40:47.830 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:47.830 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:47.830 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:47.831 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:47.831 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:47.831 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:22011 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 13332480~4096 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:40:47.831 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.892838+0000", 2024-09-13T06:40:47.831 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 54.881442364000002, 2024-09-13T06:40:47.831 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049589214, 2024-09-13T06:40:47.831 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:47.831 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:47.831 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:47.831 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:47.831 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:47.831 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 22011 2024-09-13T06:40:47.831 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:47.831 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:47.831 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:47.832 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:47.832 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892838+0000", 2024-09-13T06:40:47.832 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:47.832 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:47.832 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:47.832 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:47.832 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892838+0000", 2024-09-13T06:40:47.832 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:47.832 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:47.832 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:47.832 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:47.832 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892838+0000", 2024-09-13T06:40:47.832 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:47.832 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:47.832 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:47.833 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:47.833 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892840+0000", 2024-09-13T06:40:47.833 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.136e-06 2024-09-13T06:40:47.833 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:47.833 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:47.833 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:47.833 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892852+0000", 2024-09-13T06:40:47.833 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2122e-05 2024-09-13T06:40:47.833 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:47.833 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:47.833 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:47.833 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892862+0000", 2024-09-13T06:40:47.833 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.7049999999999994e-06 2024-09-13T06:40:47.834 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:47.834 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:47.834 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:47.834 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.942319+0000", 2024-09-13T06:40:47.834 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049456623999999998 2024-09-13T06:40:47.834 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:47.834 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:47.834 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:47.834 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.942363+0000", 2024-09-13T06:40:47.834 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4759000000000003e-05 2024-09-13T06:40:47.834 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:47.834 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:47.834 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:47.834 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.942428+0000", 2024-09-13T06:40:47.834 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.4221999999999996e-05 2024-09-13T06:40:47.834 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:47.835 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:47.835 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:47.835 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:47.835 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:47.835 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:22033 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 13963264~4096 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:40:47.835 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.896824+0000", 2024-09-13T06:40:47.835 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 54.877456471000002, 2024-09-13T06:40:47.835 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049051957, 2024-09-13T06:40:47.835 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:47.835 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:47.835 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:47.835 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:47.835 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:47.835 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 22033 2024-09-13T06:40:47.836 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:47.836 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:47.836 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:47.836 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:47.836 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.896824+0000", 2024-09-13T06:40:47.836 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:47.836 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:47.836 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:47.836 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:47.836 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.896824+0000", 2024-09-13T06:40:47.836 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:47.836 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:47.836 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:47.836 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:47.836 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.896824+0000", 2024-09-13T06:40:47.836 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:47.837 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:47.837 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:47.837 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:47.837 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.896826+0000", 2024-09-13T06:40:47.837 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1900000000000002e-06 2024-09-13T06:40:47.837 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:47.837 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:47.837 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:47.837 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.896832+0000", 2024-09-13T06:40:47.837 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.2689999999999996e-06 2024-09-13T06:40:47.837 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:47.837 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:47.837 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:47.838 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.896840+0000", 2024-09-13T06:40:47.838 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3289999999999996e-06 2024-09-13T06:40:47.838 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:47.838 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:47.838 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:47.838 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.945777+0000", 2024-09-13T06:40:47.838 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.048937188 2024-09-13T06:40:47.838 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:47.838 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:47.838 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:47.838 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.945822+0000", 2024-09-13T06:40:47.838 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4780999999999997e-05 2024-09-13T06:40:47.838 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:47.838 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:47.838 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:47.839 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.945876+0000", 2024-09-13T06:40:47.839 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.4542000000000001e-05 2024-09-13T06:40:47.839 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:47.839 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:47.839 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:47.839 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:47.839 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:47.839 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:22337 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 13582336~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:40:47.839 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.951039+0000", 2024-09-13T06:40:47.840 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 54.823242133999997, 2024-09-13T06:40:47.840 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.048942765999999999, 2024-09-13T06:40:47.840 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:47.840 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:47.840 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:47.840 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:47.840 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:47.840 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 22337 2024-09-13T06:40:47.840 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:47.840 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:47.840 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:47.840 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:47.840 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951039+0000", 2024-09-13T06:40:47.840 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:47.841 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:47.841 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:47.841 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:47.841 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951039+0000", 2024-09-13T06:40:47.841 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:47.841 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:47.841 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:47.841 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:47.841 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951038+0000", 2024-09-13T06:40:47.841 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:47.841 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:47.841 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:47.841 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:47.841 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951040+0000", 2024-09-13T06:40:47.841 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0669999999999999e-06 2024-09-13T06:40:47.842 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:47.842 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:47.842 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:47.842 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951048+0000", 2024-09-13T06:40:47.842 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.588e-06 2024-09-13T06:40:47.842 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:47.842 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:47.842 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:47.842 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951053+0000", 2024-09-13T06:40:47.842 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3669999999999996e-06 2024-09-13T06:40:47.842 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:47.842 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:47.842 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:47.842 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.999889+0000", 2024-09-13T06:40:47.843 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.048835515000000003 2024-09-13T06:40:47.843 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:47.843 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:47.843 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:47.843 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.999929+0000", 2024-09-13T06:40:47.843 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.0030000000000001e-05 2024-09-13T06:40:47.843 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:47.843 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:47.843 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:47.843 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.999981+0000", 2024-09-13T06:40:47.843 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2583999999999997e-05 2024-09-13T06:40:47.843 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:47.843 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:47.843 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:47.844 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:47.844 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:47.844 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:22338 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 13611008~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:40:47.844 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.951070+0000", 2024-09-13T06:40:47.844 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 54.823210842999998, 2024-09-13T06:40:47.844 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049135817999999998, 2024-09-13T06:40:47.844 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:47.844 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:47.844 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:47.844 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:47.844 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:47.844 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 22338 2024-09-13T06:40:47.844 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:47.844 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:47.844 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:47.845 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:47.845 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951070+0000", 2024-09-13T06:40:47.845 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:47.845 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:47.845 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:47.845 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:47.845 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951070+0000", 2024-09-13T06:40:47.845 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:47.845 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:47.845 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:47.845 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:47.845 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951069+0000", 2024-09-13T06:40:47.845 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:47.845 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:47.845 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:47.846 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:47.846 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951072+0000", 2024-09-13T06:40:47.846 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5909999999999998e-06 2024-09-13T06:40:47.846 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:47.846 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:47.846 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:47.846 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951078+0000", 2024-09-13T06:40:47.846 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.4450000000000001e-06 2024-09-13T06:40:47.846 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:47.846 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:47.846 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:47.846 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951083+0000", 2024-09-13T06:40:47.846 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7790000000000003e-06 2024-09-13T06:40:47.847 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:47.847 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:47.847 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:47.847 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:53.000020+0000", 2024-09-13T06:40:47.847 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.048936999000000002 2024-09-13T06:40:47.847 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:47.847 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:47.847 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:47.847 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:53.000106+0000", 2024-09-13T06:40:47.847 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.5532999999999996e-05 2024-09-13T06:40:47.847 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:47.847 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:47.847 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:47.847 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:53.000206+0000", 2024-09-13T06:40:47.847 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.9852999999999994e-05 2024-09-13T06:40:47.848 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:47.848 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:47.848 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:47.848 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:47.848 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:47.848 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:22339 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 13639680~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:40:47.848 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.951088+0000", 2024-09-13T06:40:47.848 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 54.823193144999998, 2024-09-13T06:40:47.848 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049238202000000002, 2024-09-13T06:40:47.848 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:47.848 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:47.848 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:47.848 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:47.849 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:47.849 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 22339 2024-09-13T06:40:47.849 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:47.849 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:47.849 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:47.849 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:47.849 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951088+0000", 2024-09-13T06:40:47.849 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:47.849 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:47.849 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:47.849 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:47.850 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951088+0000", 2024-09-13T06:40:47.850 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:47.850 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:47.850 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:47.850 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:47.850 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951087+0000", 2024-09-13T06:40:47.850 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:47.850 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:47.850 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:47.850 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:47.850 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951089+0000", 2024-09-13T06:40:47.850 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.153e-06 2024-09-13T06:40:47.850 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:47.850 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:47.850 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:47.850 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951093+0000", 2024-09-13T06:40:47.851 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.7120000000000002e-06 2024-09-13T06:40:47.851 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:47.851 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:47.851 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:47.851 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951096+0000", 2024-09-13T06:40:47.851 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.0570000000000001e-06 2024-09-13T06:40:47.851 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:47.851 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:47.851 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:47.851 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:53.000220+0000", 2024-09-13T06:40:47.851 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049123989 2024-09-13T06:40:47.851 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:47.851 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:47.851 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:47.851 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:53.000271+0000", 2024-09-13T06:40:47.852 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.062e-05 2024-09-13T06:40:47.852 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:47.852 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:47.852 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:47.852 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:53.000326+0000", 2024-09-13T06:40:47.852 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.5121000000000003e-05 2024-09-13T06:40:47.852 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:47.852 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:47.852 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:47.852 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:47.852 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:47.852 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:22340 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 13668352~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:40:47.852 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.951200+0000", 2024-09-13T06:40:47.852 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 54.823080255999997, 2024-09-13T06:40:47.853 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049352350000000003, 2024-09-13T06:40:47.853 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:47.853 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:47.853 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:47.853 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:47.853 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:47.853 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 22340 2024-09-13T06:40:47.853 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:47.853 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:47.853 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:47.853 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:47.853 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951200+0000", 2024-09-13T06:40:47.853 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:47.853 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:47.854 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:47.854 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:47.854 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951200+0000", 2024-09-13T06:40:47.854 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:47.854 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:47.854 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:47.854 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:47.854 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951098+0000", 2024-09-13T06:40:47.854 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.999898 2024-09-13T06:40:47.854 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:47.855 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:47.855 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:47.855 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951204+0000", 2024-09-13T06:40:47.855 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000105398 2024-09-13T06:40:47.855 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:47.855 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:47.855 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:47.855 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951211+0000", 2024-09-13T06:40:47.855 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.43e-06 2024-09-13T06:40:47.855 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:47.855 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:47.855 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:47.856 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951216+0000", 2024-09-13T06:40:47.856 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2800000000000003e-06 2024-09-13T06:40:47.856 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:47.856 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:47.856 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:47.856 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:53.000358+0000", 2024-09-13T06:40:47.856 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049142036 2024-09-13T06:40:47.856 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:47.856 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:47.856 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:47.856 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:53.000443+0000", 2024-09-13T06:40:47.856 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.4710999999999996e-05 2024-09-13T06:40:47.856 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:47.857 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:47.857 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:47.857 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:53.000553+0000", 2024-09-13T06:40:47.857 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000109622 2024-09-13T06:40:47.857 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:47.857 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:47.857 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:47.857 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:47.857 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:47.857 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:22348 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 13897728~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:40:47.857 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.952783+0000", 2024-09-13T06:40:47.857 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 54.821497467999997, 2024-09-13T06:40:47.857 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049120832000000003, 2024-09-13T06:40:47.858 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:47.858 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:47.858 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:47.858 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:47.858 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:47.858 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 22348 2024-09-13T06:40:47.858 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:47.858 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:47.858 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:47.858 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:47.858 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.952783+0000", 2024-09-13T06:40:47.858 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:47.858 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:47.859 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:47.859 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:47.859 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.952783+0000", 2024-09-13T06:40:47.859 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:47.859 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:47.859 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:47.859 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:47.859 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.952783+0000", 2024-09-13T06:40:47.859 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:47.859 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:47.859 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:47.859 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:47.859 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.952785+0000", 2024-09-13T06:40:47.859 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4980000000000001e-06 2024-09-13T06:40:47.860 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:47.860 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:47.860 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:47.860 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.952799+0000", 2024-09-13T06:40:47.860 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3825000000000001e-05 2024-09-13T06:40:47.860 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:47.860 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:47.860 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:47.860 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.952809+0000", 2024-09-13T06:40:47.860 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0043e-05 2024-09-13T06:40:47.860 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:47.860 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:47.860 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:47.860 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:53.001723+0000", 2024-09-13T06:40:47.860 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.048914065 2024-09-13T06:40:47.861 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:47.861 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:47.861 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:47.861 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:53.001807+0000", 2024-09-13T06:40:47.861 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.3776000000000006e-05 2024-09-13T06:40:47.861 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:47.861 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:47.861 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:47.861 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:53.001904+0000", 2024-09-13T06:40:47.861 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.7004999999999997e-05 2024-09-13T06:40:47.861 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:47.861 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:47.861 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:47.861 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:47.861 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:47.862 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:40:47.862 INFO:teuthology.orchestra.run.smithi081.stdout:osd.5: {} 2024-09-13T06:40:47.863 INFO:teuthology.orchestra.run.smithi081.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-13T06:40:47.864 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-13T06:40:47.864 INFO:teuthology.orchestra.run.smithi081.stdout:osd.6: {} 2024-09-13T06:40:47.864 INFO:teuthology.orchestra.run.smithi081.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-13T06:40:47.864 INFO:teuthology.orchestra.run.smithi081.stdout:osd.7: {} 2024-09-13T06:40:47.865 INFO:teuthology.orchestra.run.smithi081.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-13T06:40:47.865 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:40:47.863+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:40:47.964 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:40:47.965+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:40:48.024 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:40:48.024 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-13T06:40:48.024 INFO:teuthology.orchestra.run.smithi081.stdout: "num_ops": 0 2024-09-13T06:40:48.024 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:40:48.038 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-13T06:40:48.085 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:40:48.087+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:40:48.155 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:40:48.156 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-13T06:40:48.156 INFO:teuthology.orchestra.run.smithi081.stdout: "complaint_time": 30, 2024-09-13T06:40:48.156 INFO:teuthology.orchestra.run.smithi081.stdout: "num_blocked_ops": 0 2024-09-13T06:40:48.156 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:40:48.166 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:40:48.167+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:40:48.169 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-13T06:40:48.267 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:40:48.269+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:40:48.338 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:40:48.338 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 20, 2024-09-13T06:40:48.338 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 600, 2024-09-13T06:40:48.338 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [ 2024-09-13T06:40:48.338 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.338 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:36160 3.f 3:f62782c2:::rbd_object_map.11219660270d.0000000000000016:head [call] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-13T06:40:48.338 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:01.607291+0000", 2024-09-13T06:40:48.339 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 46.730770581000002, 2024-09-13T06:40:48.339 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.99619456699999998, 2024-09-13T06:40:48.339 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:48.339 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:48.339 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:48.339 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:48.339 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:48.339 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 36160 2024-09-13T06:40:48.339 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.339 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:48.339 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.339 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:48.339 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:01.607291+0000", 2024-09-13T06:40:48.339 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:48.340 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.340 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.340 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:48.340 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:01.607291+0000", 2024-09-13T06:40:48.340 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:48.340 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.340 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.340 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:48.340 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:01.607289+0000", 2024-09-13T06:40:48.340 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999976 2024-09-13T06:40:48.340 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.340 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.341 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:48.341 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:01.607302+0000", 2024-09-13T06:40:48.341 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3018e-05 2024-09-13T06:40:48.341 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.341 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.341 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:48.341 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:01.607323+0000", 2024-09-13T06:40:48.342 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1030999999999999e-05 2024-09-13T06:40:48.342 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.342 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.342 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:48.342 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:01.607342+0000", 2024-09-13T06:40:48.342 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8961e-05 2024-09-13T06:40:48.342 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.342 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.342 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:48.342 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:01.607425+0000", 2024-09-13T06:40:48.342 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.3171999999999996e-05 2024-09-13T06:40:48.342 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.343 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.343 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:40:48.343 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:01.607441+0000", 2024-09-13T06:40:48.343 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5996999999999999e-05 2024-09-13T06:40:48.343 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.343 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.343 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:48.343 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:02.596186+0000", 2024-09-13T06:40:48.343 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.98874432000000001 2024-09-13T06:40:48.343 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.343 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.344 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for missing object", 2024-09-13T06:40:48.344 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:02.596618+0000", 2024-09-13T06:40:48.344 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000432032 2024-09-13T06:40:48.344 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.344 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.344 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:48.344 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:02.600845+0000", 2024-09-13T06:40:48.344 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0042277410000000001 2024-09-13T06:40:48.344 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.344 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.344 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:48.344 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:02.601003+0000", 2024-09-13T06:40:48.345 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00015731999999999999 2024-09-13T06:40:48.345 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.345 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.345 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:48.345 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:02.603486+0000", 2024-09-13T06:40:48.345 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0024832510000000001 2024-09-13T06:40:48.345 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:48.345 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:48.345 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:48.345 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.345 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.345 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:37806 3.9 3:951cb95b:::rbd_data.1121d8143c6e.0000000000000002:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e56)", 2024-09-13T06:40:48.345 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:06.373482+0000", 2024-09-13T06:40:48.346 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 41.964579544999999, 2024-09-13T06:40:48.346 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.002476213, 2024-09-13T06:40:48.346 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:48.346 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:48.346 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:48.346 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:48.346 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:48.346 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 37806 2024-09-13T06:40:48.346 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.346 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:48.346 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.346 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:48.346 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.373482+0000", 2024-09-13T06:40:48.346 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:48.346 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.347 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.347 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:48.347 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.373482+0000", 2024-09-13T06:40:48.347 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:48.347 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.347 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.347 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:48.347 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.373479+0000", 2024-09-13T06:40:48.347 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999962 2024-09-13T06:40:48.347 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.347 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.347 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:48.347 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.373495+0000", 2024-09-13T06:40:48.347 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6640999999999999e-05 2024-09-13T06:40:48.347 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.347 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.348 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:48.348 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.373542+0000", 2024-09-13T06:40:48.348 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6229000000000001e-05 2024-09-13T06:40:48.348 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.348 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.348 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:48.348 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.373564+0000", 2024-09-13T06:40:48.348 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2684000000000002e-05 2024-09-13T06:40:48.348 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.348 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.348 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:48.348 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374268+0000", 2024-09-13T06:40:48.348 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00070363700000000001 2024-09-13T06:40:48.348 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.349 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.349 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:40:48.349 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374305+0000", 2024-09-13T06:40:48.349 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.6936e-05 2024-09-13T06:40:48.349 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.349 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.349 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:48.349 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.375175+0000", 2024-09-13T06:40:48.349 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.000870454 2024-09-13T06:40:48.349 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.349 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.349 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:48.349 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.375678+0000", 2024-09-13T06:40:48.350 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00050292499999999999 2024-09-13T06:40:48.350 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.350 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.350 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:48.350 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.375959+0000", 2024-09-13T06:40:48.350 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00028050599999999997 2024-09-13T06:40:48.350 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:48.350 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:48.350 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:48.350 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.350 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.350 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:37821 3.9 3:951cb95b:::rbd_data.1121d8143c6e.0000000000000002:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e56)", 2024-09-13T06:40:48.350 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:06.374454+0000", 2024-09-13T06:40:48.350 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 41.963608428000001, 2024-09-13T06:40:48.350 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.002545072, 2024-09-13T06:40:48.351 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:48.351 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:48.351 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:48.351 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:48.351 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:48.351 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 37821 2024-09-13T06:40:48.351 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.351 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:48.351 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.351 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:48.351 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374454+0000", 2024-09-13T06:40:48.351 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:48.351 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.351 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.351 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:48.352 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374454+0000", 2024-09-13T06:40:48.352 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:48.352 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.352 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.352 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:48.352 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374452+0000", 2024-09-13T06:40:48.352 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999981 2024-09-13T06:40:48.352 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.352 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.352 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:48.352 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374463+0000", 2024-09-13T06:40:48.352 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0756e-05 2024-09-13T06:40:48.352 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.352 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.352 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:48.353 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374487+0000", 2024-09-13T06:40:48.353 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4887000000000001e-05 2024-09-13T06:40:48.353 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.353 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.353 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:48.353 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374504+0000", 2024-09-13T06:40:48.353 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6852000000000001e-05 2024-09-13T06:40:48.357 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.357 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.357 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:48.357 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374829+0000", 2024-09-13T06:40:48.357 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000324684 2024-09-13T06:40:48.358 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.358 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.358 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:40:48.358 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374880+0000", 2024-09-13T06:40:48.358 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.1378000000000002e-05 2024-09-13T06:40:48.358 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.358 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.358 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:48.358 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.376423+0000", 2024-09-13T06:40:48.358 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.001542734 2024-09-13T06:40:48.358 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.358 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.358 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:48.359 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.376607+0000", 2024-09-13T06:40:48.359 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000183656 2024-09-13T06:40:48.359 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.359 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.359 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:48.359 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.376999+0000", 2024-09-13T06:40:48.359 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00039191200000000001 2024-09-13T06:40:48.359 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:48.359 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:48.359 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:48.359 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.359 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.359 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:37836 3.9 3:951cb95b:::rbd_data.1121d8143c6e.0000000000000002:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e56)", 2024-09-13T06:40:48.360 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:06.374929+0000", 2024-09-13T06:40:48.360 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 41.963132776000002, 2024-09-13T06:40:48.360 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.002778825, 2024-09-13T06:40:48.360 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:48.360 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:48.360 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:48.360 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:48.360 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:48.360 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 37836 2024-09-13T06:40:48.360 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.360 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:48.360 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.360 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:48.360 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374929+0000", 2024-09-13T06:40:48.361 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:48.361 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.361 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.361 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:48.361 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374929+0000", 2024-09-13T06:40:48.361 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:48.361 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.361 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.361 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:48.361 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374927+0000", 2024-09-13T06:40:48.361 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999981 2024-09-13T06:40:48.361 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.361 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.362 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:48.362 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374939+0000", 2024-09-13T06:40:48.362 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1846e-05 2024-09-13T06:40:48.362 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.362 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.362 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:48.362 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374962+0000", 2024-09-13T06:40:48.362 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3054e-05 2024-09-13T06:40:48.362 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.362 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.362 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:48.362 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374978+0000", 2024-09-13T06:40:48.362 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5899000000000001e-05 2024-09-13T06:40:48.362 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.362 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.363 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:48.363 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.375106+0000", 2024-09-13T06:40:48.363 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00012789 2024-09-13T06:40:48.363 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.363 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.363 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:40:48.363 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.375134+0000", 2024-09-13T06:40:48.363 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.8254000000000001e-05 2024-09-13T06:40:48.363 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.363 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.363 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:48.363 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.377082+0000", 2024-09-13T06:40:48.363 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0019471520000001 2024-09-13T06:40:48.363 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.364 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.364 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:48.364 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.377330+0000", 2024-09-13T06:40:48.364 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00024834199999999997 2024-09-13T06:40:48.364 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.364 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.365 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:48.365 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.377708+0000", 2024-09-13T06:40:48.365 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00037817100000000001 2024-09-13T06:40:48.365 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:48.365 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:48.365 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:48.365 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.365 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.365 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:37851 3.9 3:951cb95b:::rbd_data.1121d8143c6e.0000000000000002:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e56)", 2024-09-13T06:40:48.366 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:06.382636+0000", 2024-09-13T06:40:48.366 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 41.955425890999997, 2024-09-13T06:40:48.366 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.99582539400000003, 2024-09-13T06:40:48.366 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:48.366 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:48.366 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:48.366 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:48.366 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:48.366 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 37851 2024-09-13T06:40:48.366 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.366 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:48.366 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.366 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:48.366 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.382636+0000", 2024-09-13T06:40:48.366 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:48.367 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.367 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.367 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:48.367 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.382636+0000", 2024-09-13T06:40:48.367 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:48.367 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.367 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.367 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:48.367 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.382633+0000", 2024-09-13T06:40:48.367 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999971 2024-09-13T06:40:48.367 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.368 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.368 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:48.368 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.382652+0000", 2024-09-13T06:40:48.368 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8834999999999998e-05 2024-09-13T06:40:48.368 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.368 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.368 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:48.368 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.382695+0000", 2024-09-13T06:40:48.368 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.3136000000000002e-05 2024-09-13T06:40:48.368 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.368 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.368 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:48.368 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.382716+0000", 2024-09-13T06:40:48.369 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1421e-05 2024-09-13T06:40:48.369 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.369 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.369 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:48.369 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.382860+0000", 2024-09-13T06:40:48.369 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00014389200000000001 2024-09-13T06:40:48.369 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.369 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.369 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:40:48.369 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.382890+0000", 2024-09-13T06:40:48.369 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9827000000000001e-05 2024-09-13T06:40:48.369 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.369 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.370 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:48.370 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.377779+0000", 2024-09-13T06:40:48.370 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.99488842899999996 2024-09-13T06:40:48.370 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.370 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.370 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:48.370 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.378007+0000", 2024-09-13T06:40:48.370 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00022838099999999999 2024-09-13T06:40:48.370 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.370 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.370 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:48.370 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.378462+0000", 2024-09-13T06:40:48.370 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00045452300000000003 2024-09-13T06:40:48.370 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:48.370 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:48.371 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:48.371 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.371 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.371 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:37866 3.9 3:951cb95b:::rbd_data.1121d8143c6e.0000000000000002:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e56)", 2024-09-13T06:40:48.371 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:06.383951+0000", 2024-09-13T06:40:48.371 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 41.954111204999997, 2024-09-13T06:40:48.371 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.99517962299999996, 2024-09-13T06:40:48.371 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:48.371 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:48.371 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:48.371 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:48.371 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:48.371 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 37866 2024-09-13T06:40:48.371 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.372 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:48.372 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.372 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:48.372 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.383951+0000", 2024-09-13T06:40:48.372 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:48.372 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.372 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.372 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:48.372 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.383951+0000", 2024-09-13T06:40:48.372 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:48.372 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.372 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.372 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:48.373 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.383949+0000", 2024-09-13T06:40:48.373 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999981 2024-09-13T06:40:48.373 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.373 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.373 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:48.373 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.383961+0000", 2024-09-13T06:40:48.373 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1999e-05 2024-09-13T06:40:48.373 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.373 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.373 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:48.373 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384019+0000", 2024-09-13T06:40:48.373 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7621000000000003e-05 2024-09-13T06:40:48.373 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.374 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.374 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:48.374 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384040+0000", 2024-09-13T06:40:48.374 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1528000000000001e-05 2024-09-13T06:40:48.374 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.374 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.374 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:48.374 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384186+0000", 2024-09-13T06:40:48.374 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00014573799999999999 2024-09-13T06:40:48.374 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.374 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.374 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:40:48.375 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384204+0000", 2024-09-13T06:40:48.375 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7992e-05 2024-09-13T06:40:48.375 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.375 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.375 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:48.375 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.378536+0000", 2024-09-13T06:40:48.375 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.99433268600000002 2024-09-13T06:40:48.375 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.375 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.375 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:48.375 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.378771+0000", 2024-09-13T06:40:48.375 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00023445399999999999 2024-09-13T06:40:48.375 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.375 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.376 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:48.376 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.379130+0000", 2024-09-13T06:40:48.376 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00035954200000000002 2024-09-13T06:40:48.376 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:48.376 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:48.376 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:48.376 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.376 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.376 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:37881 3.9 3:951cb95b:::rbd_data.1121d8143c6e.0000000000000002:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e56)", 2024-09-13T06:40:48.376 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:06.384239+0000", 2024-09-13T06:40:48.376 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 41.953822791, 2024-09-13T06:40:48.376 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.99541483500000005, 2024-09-13T06:40:48.376 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:48.377 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:48.377 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:48.377 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:48.377 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:48.377 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 37881 2024-09-13T06:40:48.377 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.377 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:48.377 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.377 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:48.377 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384239+0000", 2024-09-13T06:40:48.377 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:48.377 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.377 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.377 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:48.377 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384239+0000", 2024-09-13T06:40:48.378 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:48.378 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.378 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.378 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:48.378 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384238+0000", 2024-09-13T06:40:48.378 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999986 2024-09-13T06:40:48.378 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.378 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.378 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:48.378 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384246+0000", 2024-09-13T06:40:48.378 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.2449999999999998e-06 2024-09-13T06:40:48.378 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.378 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.378 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:48.378 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384268+0000", 2024-09-13T06:40:48.379 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1518e-05 2024-09-13T06:40:48.379 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.379 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.379 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:48.379 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384282+0000", 2024-09-13T06:40:48.379 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4501999999999999e-05 2024-09-13T06:40:48.379 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.379 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.379 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:48.379 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384356+0000", 2024-09-13T06:40:48.379 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4265999999999997e-05 2024-09-13T06:40:48.379 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.379 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.379 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:40:48.379 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384370+0000", 2024-09-13T06:40:48.380 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3942e-05 2024-09-13T06:40:48.380 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.380 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.380 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:48.380 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.379199+0000", 2024-09-13T06:40:48.380 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.99482866599999997 2024-09-13T06:40:48.380 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.380 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.380 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:48.380 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.379347+0000", 2024-09-13T06:40:48.380 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00014749199999999999 2024-09-13T06:40:48.380 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.380 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.380 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:48.381 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.379654+0000", 2024-09-13T06:40:48.381 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00030752999999999998 2024-09-13T06:40:48.381 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:48.381 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:48.381 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:48.381 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.381 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.381 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:37896 3.9 3:951cb95b:::rbd_data.1121d8143c6e.0000000000000002:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e56)", 2024-09-13T06:40:48.381 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:06.384412+0000", 2024-09-13T06:40:48.381 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 41.953650357999997, 2024-09-13T06:40:48.381 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.99777835999999998, 2024-09-13T06:40:48.381 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:48.381 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:48.381 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:48.382 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:48.382 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:48.382 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 37896 2024-09-13T06:40:48.382 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.382 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:48.382 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.382 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:48.382 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384412+0000", 2024-09-13T06:40:48.382 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:48.382 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.382 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.382 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:48.382 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384412+0000", 2024-09-13T06:40:48.382 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:48.382 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.383 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.383 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:48.383 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384410+0000", 2024-09-13T06:40:48.383 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.999999 2024-09-13T06:40:48.383 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.383 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.383 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:48.383 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384418+0000", 2024-09-13T06:40:48.383 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.486e-06 2024-09-13T06:40:48.383 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.383 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.384 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:48.384 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384436+0000", 2024-09-13T06:40:48.384 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7668000000000001e-05 2024-09-13T06:40:48.384 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.384 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.384 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:48.384 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384449+0000", 2024-09-13T06:40:48.384 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3395e-05 2024-09-13T06:40:48.384 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.384 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.384 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:48.384 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384605+0000", 2024-09-13T06:40:48.384 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00015563099999999999 2024-09-13T06:40:48.384 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.385 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.385 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:40:48.385 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384635+0000", 2024-09-13T06:40:48.385 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.0383999999999999e-05 2024-09-13T06:40:48.385 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.385 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.385 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:48.385 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.379730+0000", 2024-09-13T06:40:48.385 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.99509493999999998 2024-09-13T06:40:48.385 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.385 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.385 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:48.385 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.379964+0000", 2024-09-13T06:40:48.386 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00023353499999999999 2024-09-13T06:40:48.386 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.386 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.386 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:48.386 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.382190+0000", 2024-09-13T06:40:48.386 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0022265039999999998 2024-09-13T06:40:48.386 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:48.386 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:48.386 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:48.386 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.386 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.387 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43222 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 389120~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:40:48.387 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558181+0000", 2024-09-13T06:40:48.387 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 26.779881104000001, 2024-09-13T06:40:48.387 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.06252038, 2024-09-13T06:40:48.387 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:48.387 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:48.387 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:48.387 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:48.387 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:48.387 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43222 2024-09-13T06:40:48.387 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.387 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:48.387 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.387 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:48.387 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558181+0000", 2024-09-13T06:40:48.388 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:48.388 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.388 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.388 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:48.388 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558181+0000", 2024-09-13T06:40:48.388 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:48.388 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.388 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.388 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:48.388 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558181+0000", 2024-09-13T06:40:48.388 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:48.388 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.388 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.388 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:48.389 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558183+0000", 2024-09-13T06:40:48.389 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.857e-06 2024-09-13T06:40:48.389 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.389 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.389 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:48.389 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558188+0000", 2024-09-13T06:40:48.389 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3759999999999999e-06 2024-09-13T06:40:48.389 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.389 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.389 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:48.389 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558261+0000", 2024-09-13T06:40:48.389 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3097999999999997e-05 2024-09-13T06:40:48.389 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.389 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.389 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:48.390 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.620354+0000", 2024-09-13T06:40:48.390 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.062092587999999997 2024-09-13T06:40:48.390 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.390 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.390 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:48.390 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.620428+0000", 2024-09-13T06:40:48.390 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3954000000000004e-05 2024-09-13T06:40:48.390 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.390 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.390 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:48.390 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.620701+0000", 2024-09-13T06:40:48.390 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000273773 2024-09-13T06:40:48.391 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:48.391 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:48.391 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:48.391 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.391 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.391 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43223 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 393216~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:40:48.391 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558267+0000", 2024-09-13T06:40:48.391 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 26.779795047, 2024-09-13T06:40:48.391 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.062813151999999997, 2024-09-13T06:40:48.391 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:48.391 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:48.391 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:48.391 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:48.391 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:48.391 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43223 2024-09-13T06:40:48.392 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.392 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:48.392 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.392 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:48.392 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558267+0000", 2024-09-13T06:40:48.392 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:48.392 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.392 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.392 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:48.392 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558267+0000", 2024-09-13T06:40:48.392 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:48.392 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.392 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.392 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:48.393 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558266+0000", 2024-09-13T06:40:48.393 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:48.393 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.393 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.393 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:48.393 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558270+0000", 2024-09-13T06:40:48.393 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.2389999999999998e-06 2024-09-13T06:40:48.393 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.393 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.393 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:48.393 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558277+0000", 2024-09-13T06:40:48.393 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5680000000000002e-06 2024-09-13T06:40:48.393 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.393 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.394 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:48.394 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558282+0000", 2024-09-13T06:40:48.394 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7060000000000003e-06 2024-09-13T06:40:48.394 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.394 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.394 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:48.394 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.620731+0000", 2024-09-13T06:40:48.394 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.062448661000000003 2024-09-13T06:40:48.394 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.394 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.394 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:48.394 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.620806+0000", 2024-09-13T06:40:48.394 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5862e-05 2024-09-13T06:40:48.394 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.394 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.395 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:48.395 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.621080+0000", 2024-09-13T06:40:48.395 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00027368599999999998 2024-09-13T06:40:48.395 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:48.395 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:48.395 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:48.395 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.395 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.395 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43224 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 407552~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:40:48.395 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558286+0000", 2024-09-13T06:40:48.395 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 26.779775683, 2024-09-13T06:40:48.395 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.063179052999999999, 2024-09-13T06:40:48.395 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:48.395 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:48.395 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:48.396 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:48.396 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:48.396 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43224 2024-09-13T06:40:48.396 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.396 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:48.396 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.396 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:48.396 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558286+0000", 2024-09-13T06:40:48.396 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:48.396 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.396 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.396 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:48.396 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558286+0000", 2024-09-13T06:40:48.396 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:48.397 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.397 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.397 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:48.397 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558286+0000", 2024-09-13T06:40:48.397 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:48.397 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.397 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.397 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:48.397 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558288+0000", 2024-09-13T06:40:48.397 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.227e-06 2024-09-13T06:40:48.397 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.397 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.397 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:48.397 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558292+0000", 2024-09-13T06:40:48.398 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.6289999999999999e-06 2024-09-13T06:40:48.398 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.398 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.398 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:48.398 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558294+0000", 2024-09-13T06:40:48.398 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5409999999999999e-06 2024-09-13T06:40:48.398 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.398 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.398 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:48.398 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.621110+0000", 2024-09-13T06:40:48.398 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.062815776000000004 2024-09-13T06:40:48.398 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.398 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.398 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:48.398 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.621186+0000", 2024-09-13T06:40:48.399 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5570999999999999e-05 2024-09-13T06:40:48.399 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.399 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.399 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:48.399 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.621465+0000", 2024-09-13T06:40:48.399 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00027988200000000001 2024-09-13T06:40:48.399 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:48.399 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:48.399 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:48.399 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.399 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.399 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43225 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 421888~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:40:48.399 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558296+0000", 2024-09-13T06:40:48.399 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 26.779765716, 2024-09-13T06:40:48.399 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.063551110999999993, 2024-09-13T06:40:48.400 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:48.400 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:48.400 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:48.400 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:48.400 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:48.400 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43225 2024-09-13T06:40:48.400 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.400 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:48.400 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.400 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:48.400 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558296+0000", 2024-09-13T06:40:48.400 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:48.401 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.401 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.401 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:48.401 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558296+0000", 2024-09-13T06:40:48.401 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:48.401 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.401 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.401 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:48.401 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558296+0000", 2024-09-13T06:40:48.401 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:40:48.401 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.401 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.401 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:48.401 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558305+0000", 2024-09-13T06:40:48.401 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.5290000000000008e-06 2024-09-13T06:40:48.402 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.402 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.402 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:48.402 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558308+0000", 2024-09-13T06:40:48.402 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.5619999999999999e-06 2024-09-13T06:40:48.402 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.402 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.402 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:48.402 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558311+0000", 2024-09-13T06:40:48.402 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.43e-06 2024-09-13T06:40:48.402 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.402 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.402 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:48.402 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.621495+0000", 2024-09-13T06:40:48.403 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.063184289000000005 2024-09-13T06:40:48.403 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.403 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.403 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:48.403 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.621569+0000", 2024-09-13T06:40:48.403 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4250000000000002e-05 2024-09-13T06:40:48.403 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.403 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.403 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:48.403 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.621847+0000", 2024-09-13T06:40:48.404 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00027826400000000002 2024-09-13T06:40:48.404 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:48.404 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:48.404 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:48.404 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.404 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.404 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43226 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 436224~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:40:48.404 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558313+0000", 2024-09-13T06:40:48.404 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 26.779749079999998, 2024-09-13T06:40:48.404 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.063914420999999999, 2024-09-13T06:40:48.404 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:48.404 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:48.404 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:48.405 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:48.405 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:48.405 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43226 2024-09-13T06:40:48.405 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.405 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:48.405 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.405 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:48.405 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558313+0000", 2024-09-13T06:40:48.405 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:48.405 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.405 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.405 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:48.405 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558313+0000", 2024-09-13T06:40:48.405 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:48.406 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.406 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.406 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:48.406 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558313+0000", 2024-09-13T06:40:48.406 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:48.406 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.406 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.406 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:48.406 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558314+0000", 2024-09-13T06:40:48.406 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3740000000000001e-06 2024-09-13T06:40:48.406 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.406 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.406 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:48.406 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558317+0000", 2024-09-13T06:40:48.406 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9730000000000002e-06 2024-09-13T06:40:48.407 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.407 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.407 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:48.407 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558319+0000", 2024-09-13T06:40:48.407 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4059999999999999e-06 2024-09-13T06:40:48.407 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.407 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.407 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:48.407 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.621877+0000", 2024-09-13T06:40:48.407 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.063557408999999995 2024-09-13T06:40:48.407 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.407 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.407 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:48.407 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.621951+0000", 2024-09-13T06:40:48.407 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4487999999999996e-05 2024-09-13T06:40:48.408 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.408 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.408 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:48.408 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.622227+0000", 2024-09-13T06:40:48.408 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000276011 2024-09-13T06:40:48.408 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:48.408 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:48.408 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:48.408 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.408 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.408 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43227 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 450560~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:40:48.408 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558322+0000", 2024-09-13T06:40:48.408 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 26.779740498999999, 2024-09-13T06:40:48.408 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.064285348000000006, 2024-09-13T06:40:48.409 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:48.409 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:48.409 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:48.409 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:48.409 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:48.409 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43227 2024-09-13T06:40:48.409 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.409 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:48.409 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.409 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:48.409 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558322+0000", 2024-09-13T06:40:48.409 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:48.409 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.409 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.410 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:48.410 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558322+0000", 2024-09-13T06:40:48.410 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:48.410 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.410 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.410 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:48.410 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558321+0000", 2024-09-13T06:40:48.410 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:40:48.410 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.410 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.410 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:48.410 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558323+0000", 2024-09-13T06:40:48.411 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.576e-06 2024-09-13T06:40:48.411 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.411 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.411 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:48.411 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558328+0000", 2024-09-13T06:40:48.411 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0719999999999999e-06 2024-09-13T06:40:48.411 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.411 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.411 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:48.411 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558332+0000", 2024-09-13T06:40:48.411 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.8130000000000002e-06 2024-09-13T06:40:48.411 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.411 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.411 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:48.412 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.622255+0000", 2024-09-13T06:40:48.412 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.063923195000000002 2024-09-13T06:40:48.412 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.412 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.412 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:48.412 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.622330+0000", 2024-09-13T06:40:48.412 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5383000000000007e-05 2024-09-13T06:40:48.412 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.412 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.412 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:48.412 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.622607+0000", 2024-09-13T06:40:48.412 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00027651999999999999 2024-09-13T06:40:48.412 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:48.412 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:48.413 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:48.413 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.413 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.413 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43228 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 464896~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:40:48.413 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558335+0000", 2024-09-13T06:40:48.413 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 26.779726589999999, 2024-09-13T06:40:48.413 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.064652253000000007, 2024-09-13T06:40:48.413 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:48.413 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:48.413 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:48.413 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:48.413 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:48.413 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43228 2024-09-13T06:40:48.413 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.413 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:48.413 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.414 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:48.414 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558335+0000", 2024-09-13T06:40:48.414 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:48.414 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.414 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.414 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:48.414 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558335+0000", 2024-09-13T06:40:48.414 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:48.414 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.414 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.414 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:48.414 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558335+0000", 2024-09-13T06:40:48.414 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:48.414 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.415 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.415 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:48.415 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558337+0000", 2024-09-13T06:40:48.415 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1380000000000001e-06 2024-09-13T06:40:48.415 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.415 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.415 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:48.415 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558343+0000", 2024-09-13T06:40:48.415 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.5140000000000001e-06 2024-09-13T06:40:48.415 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.415 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.415 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:48.415 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558348+0000", 2024-09-13T06:40:48.415 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9640000000000002e-06 2024-09-13T06:40:48.415 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.416 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.416 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:48.416 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.622636+0000", 2024-09-13T06:40:48.416 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.064288260999999999 2024-09-13T06:40:48.416 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.416 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.416 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:48.416 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.622715+0000", 2024-09-13T06:40:48.416 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.9351000000000006e-05 2024-09-13T06:40:48.416 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.416 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.416 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:48.416 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.622988+0000", 2024-09-13T06:40:48.416 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00027242599999999998 2024-09-13T06:40:48.416 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:48.417 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:48.417 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:48.417 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.417 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.417 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43229 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 479232~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:40:48.417 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558352+0000", 2024-09-13T06:40:48.417 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 26.779710174999998, 2024-09-13T06:40:48.417 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.065018024999999993, 2024-09-13T06:40:48.417 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:48.417 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:48.417 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:48.417 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:48.417 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:48.417 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43229 2024-09-13T06:40:48.418 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.418 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:48.418 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.418 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:48.418 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558352+0000", 2024-09-13T06:40:48.418 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:48.418 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.418 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.418 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:48.418 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558352+0000", 2024-09-13T06:40:48.418 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:48.418 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.418 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.418 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:48.418 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558352+0000", 2024-09-13T06:40:48.419 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:48.419 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.419 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.419 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:48.419 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558354+0000", 2024-09-13T06:40:48.419 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4930000000000001e-06 2024-09-13T06:40:48.419 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.419 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.419 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:48.419 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558360+0000", 2024-09-13T06:40:48.419 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.263e-06 2024-09-13T06:40:48.419 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.419 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.419 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:48.419 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558369+0000", 2024-09-13T06:40:48.420 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.0829999999999993e-06 2024-09-13T06:40:48.420 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.420 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.420 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:48.420 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.623017+0000", 2024-09-13T06:40:48.420 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.064647799000000006 2024-09-13T06:40:48.420 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.420 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.420 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:48.420 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.623090+0000", 2024-09-13T06:40:48.420 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3071000000000006e-05 2024-09-13T06:40:48.420 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.420 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.421 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:48.421 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.623370+0000", 2024-09-13T06:40:48.421 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000279661 2024-09-13T06:40:48.421 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:48.421 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:48.421 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:48.421 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.421 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.421 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43230 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 493568~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:40:48.421 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558374+0000", 2024-09-13T06:40:48.421 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 26.779687882000001, 2024-09-13T06:40:48.421 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.065410435000000003, 2024-09-13T06:40:48.421 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:48.421 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:48.421 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:48.422 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:48.422 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:48.422 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43230 2024-09-13T06:40:48.422 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.422 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:48.422 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.422 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:48.422 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558374+0000", 2024-09-13T06:40:48.422 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:48.422 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.422 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.422 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:48.423 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558374+0000", 2024-09-13T06:40:48.423 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:48.423 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.423 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.423 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:48.423 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558374+0000", 2024-09-13T06:40:48.423 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:48.423 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.423 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.423 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:48.423 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558376+0000", 2024-09-13T06:40:48.423 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4430000000000002e-06 2024-09-13T06:40:48.423 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.423 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.423 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:48.423 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558382+0000", 2024-09-13T06:40:48.424 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3029999999999996e-06 2024-09-13T06:40:48.424 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.424 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.424 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:48.424 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558387+0000", 2024-09-13T06:40:48.424 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.1699999999999999e-06 2024-09-13T06:40:48.424 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.424 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.424 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:48.424 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.623400+0000", 2024-09-13T06:40:48.424 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.065013244999999997 2024-09-13T06:40:48.424 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.424 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.424 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:48.425 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.623474+0000", 2024-09-13T06:40:48.425 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3889999999999999e-05 2024-09-13T06:40:48.425 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.425 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.425 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:48.425 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.623785+0000", 2024-09-13T06:40:48.425 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00031080099999999998 2024-09-13T06:40:48.425 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:48.425 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:48.425 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:48.425 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.425 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.425 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43231 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 507904~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:40:48.426 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558391+0000", 2024-09-13T06:40:48.426 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 26.779671196999999, 2024-09-13T06:40:48.426 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.065788597000000004, 2024-09-13T06:40:48.426 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:48.426 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:48.426 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:48.426 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:48.426 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:48.426 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43231 2024-09-13T06:40:48.426 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.426 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:48.426 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.426 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:48.426 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558391+0000", 2024-09-13T06:40:48.426 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:48.427 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.427 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.427 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:48.427 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558391+0000", 2024-09-13T06:40:48.427 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:48.427 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.427 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.427 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:48.427 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558390+0000", 2024-09-13T06:40:48.427 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:48.427 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.427 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.427 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:48.427 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558393+0000", 2024-09-13T06:40:48.427 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2570000000000002e-06 2024-09-13T06:40:48.428 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.428 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.428 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:48.428 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558399+0000", 2024-09-13T06:40:48.428 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0419999999999999e-06 2024-09-13T06:40:48.428 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.428 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.428 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:48.428 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558403+0000", 2024-09-13T06:40:48.428 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6249999999999998e-06 2024-09-13T06:40:48.428 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.428 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.428 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:48.428 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.623811+0000", 2024-09-13T06:40:48.429 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.065407549999999995 2024-09-13T06:40:48.429 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.429 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.429 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:48.429 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.623877+0000", 2024-09-13T06:40:48.429 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.5902999999999996e-05 2024-09-13T06:40:48.429 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.429 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.429 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:48.429 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.624179+0000", 2024-09-13T06:40:48.429 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00030259999999999998 2024-09-13T06:40:48.429 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:48.430 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:48.430 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:48.430 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.430 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.430 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43232 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 522240~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:40:48.430 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558422+0000", 2024-09-13T06:40:48.430 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 26.77964042, 2024-09-13T06:40:48.430 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.066176061999999994, 2024-09-13T06:40:48.430 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:48.430 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:48.430 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:48.430 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:48.430 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:48.430 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43232 2024-09-13T06:40:48.430 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.431 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:48.431 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.431 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:48.431 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558422+0000", 2024-09-13T06:40:48.431 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:48.431 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.431 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.431 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:48.431 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558422+0000", 2024-09-13T06:40:48.431 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:48.431 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.431 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.431 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:48.431 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558421+0000", 2024-09-13T06:40:48.432 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:48.432 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.432 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.432 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:48.432 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558428+0000", 2024-09-13T06:40:48.432 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.1690000000000003e-06 2024-09-13T06:40:48.432 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.432 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.432 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:48.432 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558434+0000", 2024-09-13T06:40:48.432 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9309999999999996e-06 2024-09-13T06:40:48.432 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.432 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.433 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:48.433 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558447+0000", 2024-09-13T06:40:48.433 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.271e-05 2024-09-13T06:40:48.433 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.433 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.433 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:48.433 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.624209+0000", 2024-09-13T06:40:48.433 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.065762102000000003 2024-09-13T06:40:48.433 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.433 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.433 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:48.433 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.624282+0000", 2024-09-13T06:40:48.434 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.2889e-05 2024-09-13T06:40:48.434 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.434 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.434 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:48.434 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.624598+0000", 2024-09-13T06:40:48.434 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00031591399999999998 2024-09-13T06:40:48.434 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:48.434 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:48.434 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:48.434 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.434 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.434 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43486 3.f 3:f7da9c8f:::rbd_data.1121f5f2e1c0.000000000000000b:1f [read 260096~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:40:48.434 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.569088+0000", 2024-09-13T06:40:48.434 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 26.768973697, 2024-09-13T06:40:48.435 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.062579223000000003, 2024-09-13T06:40:48.435 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:48.435 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:48.435 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:48.435 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:48.435 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:48.435 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43486 2024-09-13T06:40:48.435 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.435 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:48.435 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.435 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:48.435 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.569088+0000", 2024-09-13T06:40:48.435 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:48.435 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.435 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.436 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:48.436 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.569088+0000", 2024-09-13T06:40:48.436 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:48.436 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.436 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.436 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:48.436 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.569088+0000", 2024-09-13T06:40:48.436 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:48.436 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.436 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.436 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:48.436 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.569091+0000", 2024-09-13T06:40:48.436 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9629999999999998e-06 2024-09-13T06:40:48.436 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.436 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.437 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:48.437 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.569097+0000", 2024-09-13T06:40:48.437 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.4160000000000001e-06 2024-09-13T06:40:48.437 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.437 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.437 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:48.437 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.569102+0000", 2024-09-13T06:40:48.437 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6659999999999999e-06 2024-09-13T06:40:48.437 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.437 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.437 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:48.437 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.631346+0000", 2024-09-13T06:40:48.437 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.062243896 2024-09-13T06:40:48.437 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.437 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.438 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:48.438 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.631413+0000", 2024-09-13T06:40:48.438 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.7638000000000005e-05 2024-09-13T06:40:48.438 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.438 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.438 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:48.438 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.631668+0000", 2024-09-13T06:40:48.438 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0002541 2024-09-13T06:40:48.438 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:48.438 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:48.438 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:48.438 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:48.438 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:48.438 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:40:48.440 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-13T06:40:48.440 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:40:48.439+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:40:48.540 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:40:48.539+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:40:48.607 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:40:48.608 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [ 2024-09-13T06:40:48.608 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.608 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:64356 3.c 3.97da1e4c (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e95)", 2024-09-13T06:40:48.608 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:48.473318+0000", 2024-09-13T06:40:48.608 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.137302914, 2024-09-13T06:40:48.608 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.13732053299999999, 2024-09-13T06:40:48.608 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:48.608 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "waiting for peered", 2024-09-13T06:40:48.608 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:48.608 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:48.608 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:48.608 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 64356 2024-09-13T06:40:48.608 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.609 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:48.609 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.609 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:48.609 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:48.473318+0000", 2024-09-13T06:40:48.609 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:48.609 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.609 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.609 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:48.609 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:48.473318+0000", 2024-09-13T06:40:48.609 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:48.609 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.609 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.610 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:48.610 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:48.473315+0000", 2024-09-13T06:40:48.610 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999971 2024-09-13T06:40:48.610 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.610 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.610 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:48.610 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:48.473329+0000", 2024-09-13T06:40:48.610 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.433e-05 2024-09-13T06:40:48.610 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.610 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.610 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:48.610 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:48.473363+0000", 2024-09-13T06:40:48.611 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.3592e-05 2024-09-13T06:40:48.611 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.611 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.611 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:48.611 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:48.473386+0000", 2024-09-13T06:40:48.611 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2708999999999999e-05 2024-09-13T06:40:48.611 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.611 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.611 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:48.611 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:48.473804+0000", 2024-09-13T06:40:48.611 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00041789399999999998 2024-09-13T06:40:48.612 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.612 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.612 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:40:48.612 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:48.473830+0000", 2024-09-13T06:40:48.612 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6869e-05 2024-09-13T06:40:48.612 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:48.612 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:48.612 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:48.612 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:48.612 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-13T06:40:48.612 INFO:teuthology.orchestra.run.smithi081.stdout: "num_ops": 1 2024-09-13T06:40:48.612 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:40:48.622 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-13T06:40:48.665 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:40:48.667+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:40:48.742 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:40:48.743+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:40:48.789 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:40:48.789 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-13T06:40:48.789 INFO:teuthology.orchestra.run.smithi081.stdout: "complaint_time": 30, 2024-09-13T06:40:48.789 INFO:teuthology.orchestra.run.smithi081.stdout: "num_blocked_ops": 0 2024-09-13T06:40:48.789 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:40:48.803 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-13T06:40:48.844 INFO:tasks.ceph.osd.6.smithi139.stderr:2024-09-13T06:40:48.845+0000 7fcd02c5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26385) UID: 0 2024-09-13T06:40:48.944 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:40:48.943+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:40:48.971 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:40:48.971 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 20, 2024-09-13T06:40:48.971 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 600, 2024-09-13T06:40:48.971 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [ 2024-09-13T06:40:48.971 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.971 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:2226 3.15 3:af026987:::rbd_data.112173e2f1b7.0000000000000017:head [sparse-read 0~4194304] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-13T06:40:48.971 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:37.606562+0000", 2024-09-13T06:40:48.972 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 71.364809945000005, 2024-09-13T06:40:48.972 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.83322091700000001, 2024-09-13T06:40:48.972 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:48.972 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:40:48.972 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:48.972 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:48.972 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:48.972 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 2226 2024-09-13T06:40:48.972 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.972 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:48.972 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.972 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:48.972 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606562+0000", 2024-09-13T06:40:48.973 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:48.973 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.973 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.973 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:48.973 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606562+0000", 2024-09-13T06:40:48.973 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:48.973 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.973 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.973 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:48.973 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606561+0000", 2024-09-13T06:40:48.973 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:48.973 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.973 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.974 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:48.974 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606565+0000", 2024-09-13T06:40:48.974 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.4379999999999999e-06 2024-09-13T06:40:48.974 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.974 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.974 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:48.974 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606569+0000", 2024-09-13T06:40:48.974 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.425e-06 2024-09-13T06:40:48.974 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.974 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.974 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:48.974 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606572+0000", 2024-09-13T06:40:48.974 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.05e-06 2024-09-13T06:40:48.975 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.975 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.975 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:48.975 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606621+0000", 2024-09-13T06:40:48.975 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.8723000000000001e-05 2024-09-13T06:40:48.975 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.975 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.975 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:40:48.976 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606630+0000", 2024-09-13T06:40:48.976 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.8040000000000007e-06 2024-09-13T06:40:48.976 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.976 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.976 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:48.976 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.439648+0000", 2024-09-13T06:40:48.976 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.83301824800000002 2024-09-13T06:40:48.976 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.976 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.976 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:48.976 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.439782+0000", 2024-09-13T06:40:48.976 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00013466699999999999 2024-09-13T06:40:48.976 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:48.976 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:48.977 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:48.977 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.977 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.977 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25661 3.8 3:1180686c:::rbd_data.1121f2c5ee81.0000000000000009:13 [read 397312~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:48.977 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.436956+0000", 2024-09-13T06:40:48.977 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 52.534415410999998, 2024-09-13T06:40:48.977 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089036758999999993, 2024-09-13T06:40:48.977 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:48.977 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:48.977 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:48.977 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:48.977 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:48.977 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25661 2024-09-13T06:40:48.978 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.978 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:48.978 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.978 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:48.978 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436956+0000", 2024-09-13T06:40:48.978 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:48.978 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.978 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.978 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:48.978 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436956+0000", 2024-09-13T06:40:48.978 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:48.978 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.978 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.979 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:48.979 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436956+0000", 2024-09-13T06:40:48.979 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:48.979 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.979 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.979 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:48.979 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436958+0000", 2024-09-13T06:40:48.979 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1770000000000001e-06 2024-09-13T06:40:48.979 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.979 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.979 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:48.979 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436963+0000", 2024-09-13T06:40:48.979 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.6489999999999996e-06 2024-09-13T06:40:48.979 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.980 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.980 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:48.980 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436975+0000", 2024-09-13T06:40:48.980 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1783999999999999e-05 2024-09-13T06:40:48.980 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.980 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.980 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:48.980 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.525671+0000", 2024-09-13T06:40:48.980 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.088696292999999995 2024-09-13T06:40:48.980 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.980 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.980 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:48.980 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.525749+0000", 2024-09-13T06:40:48.980 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.7589000000000005e-05 2024-09-13T06:40:48.981 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.981 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.981 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:48.981 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.525993+0000", 2024-09-13T06:40:48.981 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00024381000000000001 2024-09-13T06:40:48.981 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:48.981 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:48.981 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:48.981 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.981 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.981 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25662 3.8 3:1180686c:::rbd_data.1121f2c5ee81.0000000000000009:13 [read 421888~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:48.981 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.436980+0000", 2024-09-13T06:40:48.981 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 52.534391098999997, 2024-09-13T06:40:48.981 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089367577000000004, 2024-09-13T06:40:48.982 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:48.982 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:48.982 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:48.982 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:48.982 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:48.982 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25662 2024-09-13T06:40:48.982 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.982 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:48.982 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.982 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:48.982 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436980+0000", 2024-09-13T06:40:48.982 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:48.982 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.982 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.983 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:48.983 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436980+0000", 2024-09-13T06:40:48.983 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:48.983 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.983 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.983 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:48.983 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436980+0000", 2024-09-13T06:40:48.983 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:48.983 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.983 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.983 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:48.983 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436982+0000", 2024-09-13T06:40:48.983 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3989999999999998e-06 2024-09-13T06:40:48.983 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.983 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.984 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:48.984 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436988+0000", 2024-09-13T06:40:48.984 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0039999999999996e-06 2024-09-13T06:40:48.984 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.984 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.984 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:48.984 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436993+0000", 2024-09-13T06:40:48.984 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6090000000000003e-06 2024-09-13T06:40:48.984 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.984 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.984 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:48.984 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.526035+0000", 2024-09-13T06:40:48.984 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089042248000000004 2024-09-13T06:40:48.985 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.985 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.985 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:48.985 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.526111+0000", 2024-09-13T06:40:48.985 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5643999999999996e-05 2024-09-13T06:40:48.985 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.985 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.985 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:48.985 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.526348+0000", 2024-09-13T06:40:48.985 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00023705800000000001 2024-09-13T06:40:48.985 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:48.985 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:48.985 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:48.986 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.986 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.986 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25663 3.8 3:1180686c:::rbd_data.1121f2c5ee81.0000000000000009:13 [read 466944~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:48.986 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.436998+0000", 2024-09-13T06:40:48.986 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 52.534373451999997, 2024-09-13T06:40:48.986 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089730867000000006, 2024-09-13T06:40:48.986 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:48.986 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:48.986 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:48.986 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:48.986 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:48.986 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25663 2024-09-13T06:40:48.986 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.986 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:48.987 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.987 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:48.987 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436998+0000", 2024-09-13T06:40:48.987 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:48.987 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.987 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.987 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:48.987 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436998+0000", 2024-09-13T06:40:48.987 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:48.987 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.987 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.987 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:48.987 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436998+0000", 2024-09-13T06:40:48.987 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:48.988 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.988 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.988 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:48.988 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437000+0000", 2024-09-13T06:40:48.988 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0940000000000002e-06 2024-09-13T06:40:48.988 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.988 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.988 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:48.988 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437005+0000", 2024-09-13T06:40:48.988 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.604e-06 2024-09-13T06:40:48.988 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.988 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.988 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:48.988 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437032+0000", 2024-09-13T06:40:48.989 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6407e-05 2024-09-13T06:40:48.989 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.989 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.989 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:48.989 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.526363+0000", 2024-09-13T06:40:48.989 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089331456000000004 2024-09-13T06:40:48.989 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.989 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.989 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:48.989 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.526404+0000", 2024-09-13T06:40:48.989 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.0887999999999999e-05 2024-09-13T06:40:48.989 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.990 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.990 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:48.990 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.526729+0000", 2024-09-13T06:40:48.990 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00032486 2024-09-13T06:40:48.990 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:48.990 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:48.990 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:48.990 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.990 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.990 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25664 3.8 3:1180686c:::rbd_data.1121f2c5ee81.0000000000000009:13 [read 491520~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:48.990 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.437040+0000", 2024-09-13T06:40:48.990 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 52.534331537, 2024-09-13T06:40:48.990 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.090016650000000004, 2024-09-13T06:40:48.990 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:48.991 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:48.991 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:48.991 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:48.991 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:48.991 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25664 2024-09-13T06:40:48.991 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.991 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:48.991 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.991 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:48.991 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437040+0000", 2024-09-13T06:40:48.991 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:48.991 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.991 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.991 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:48.991 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437040+0000", 2024-09-13T06:40:48.992 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:48.992 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.992 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.992 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:48.992 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437039+0000", 2024-09-13T06:40:48.992 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:48.992 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.992 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.992 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:48.992 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437047+0000", 2024-09-13T06:40:48.992 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4839999999999998e-06 2024-09-13T06:40:48.992 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.993 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.993 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:48.993 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437054+0000", 2024-09-13T06:40:48.993 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.8299999999999998e-06 2024-09-13T06:40:48.993 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.993 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.993 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:48.993 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437060+0000", 2024-09-13T06:40:48.993 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.1510000000000001e-06 2024-09-13T06:40:48.993 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.993 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.993 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:48.994 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.526772+0000", 2024-09-13T06:40:48.994 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089711737999999999 2024-09-13T06:40:48.994 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.994 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.994 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:48.994 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.526848+0000", 2024-09-13T06:40:48.994 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5870000000000004e-05 2024-09-13T06:40:48.994 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.994 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.994 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:48.994 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.527057+0000", 2024-09-13T06:40:48.994 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000209106 2024-09-13T06:40:48.994 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:48.994 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:48.994 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:48.995 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.995 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.995 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25740 3.18 3:1c662b96:::rbd_data.1121f2c5ee81.0000000000000010:13 [read 200704~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:48.995 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443352+0000", 2024-09-13T06:40:48.995 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 52.528019862000001, 2024-09-13T06:40:48.995 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089068222000000002, 2024-09-13T06:40:48.995 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:48.995 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:48.995 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:48.995 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:48.995 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:48.995 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25740 2024-09-13T06:40:48.995 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.995 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:48.996 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.996 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:48.996 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443352+0000", 2024-09-13T06:40:48.996 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:48.996 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.996 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.996 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:48.996 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443352+0000", 2024-09-13T06:40:48.996 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:48.996 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.996 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.996 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:48.996 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443351+0000", 2024-09-13T06:40:48.996 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:48.996 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.997 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.997 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:48.997 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443354+0000", 2024-09-13T06:40:48.997 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.841e-06 2024-09-13T06:40:48.997 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.997 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.997 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:48.997 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443361+0000", 2024-09-13T06:40:48.997 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.0010000000000004e-06 2024-09-13T06:40:48.997 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.997 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.997 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:48.997 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443366+0000", 2024-09-13T06:40:48.997 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7119999999999999e-06 2024-09-13T06:40:48.998 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.998 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.998 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:48.998 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532117+0000", 2024-09-13T06:40:48.998 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.088751327000000005 2024-09-13T06:40:48.998 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.998 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.998 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:48.998 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532193+0000", 2024-09-13T06:40:48.998 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5839000000000004e-05 2024-09-13T06:40:48.998 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.998 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.998 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:48.998 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532420+0000", 2024-09-13T06:40:48.998 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00022691000000000001 2024-09-13T06:40:48.999 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:48.999 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:48.999 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:48.999 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:48.999 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:48.999 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25741 3.18 3:1c662b96:::rbd_data.1121f2c5ee81.0000000000000010:13 [read 225280~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:48.999 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443378+0000", 2024-09-13T06:40:48.999 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 52.527993094999999, 2024-09-13T06:40:48.999 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089324107, 2024-09-13T06:40:48.999 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:48.999 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:48.999 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:48.999 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:48.999 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:49.000 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25741 2024-09-13T06:40:49.000 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:49.000 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:49.000 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:49.000 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:49.000 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443378+0000", 2024-09-13T06:40:49.000 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:49.000 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:49.000 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:49.000 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:49.000 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443378+0000", 2024-09-13T06:40:49.000 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:49.000 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:49.000 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:49.001 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:49.001 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443378+0000", 2024-09-13T06:40:49.001 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:49.001 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:49.001 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:49.001 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:49.001 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443380+0000", 2024-09-13T06:40:49.001 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3549999999999999e-06 2024-09-13T06:40:49.001 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:49.001 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:49.001 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:49.001 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443388+0000", 2024-09-13T06:40:49.001 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.7449999999999995e-06 2024-09-13T06:40:49.001 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:49.002 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:49.002 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:49.002 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443393+0000", 2024-09-13T06:40:49.002 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.4e-06 2024-09-13T06:40:49.002 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:49.002 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:49.002 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:49.002 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532454+0000", 2024-09-13T06:40:49.002 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089060941000000005 2024-09-13T06:40:49.002 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:49.002 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:49.002 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:49.002 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532512+0000", 2024-09-13T06:40:49.002 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7763000000000002e-05 2024-09-13T06:40:49.002 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:49.003 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:49.003 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:49.003 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532703+0000", 2024-09-13T06:40:49.003 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000190328 2024-09-13T06:40:49.003 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:49.003 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:49.003 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:49.003 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:49.003 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:49.003 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25742 3.18 3:1c662b96:::rbd_data.1121f2c5ee81.0000000000000010:13 [read 270336~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:49.003 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443398+0000", 2024-09-13T06:40:49.003 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 52.527973383000003, 2024-09-13T06:40:49.003 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089621836999999996, 2024-09-13T06:40:49.003 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:49.003 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:49.004 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:49.004 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:49.004 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:49.004 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25742 2024-09-13T06:40:49.004 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:49.004 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:49.004 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:49.004 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:49.004 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443398+0000", 2024-09-13T06:40:49.004 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:49.004 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:49.004 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:49.004 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:49.004 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443398+0000", 2024-09-13T06:40:49.004 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:49.005 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:49.005 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:49.005 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:49.005 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443398+0000", 2024-09-13T06:40:49.005 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:49.005 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:49.005 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:49.005 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:49.005 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443400+0000", 2024-09-13T06:40:49.005 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1849999999999998e-06 2024-09-13T06:40:49.005 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:49.005 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:49.005 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:49.006 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443407+0000", 2024-09-13T06:40:49.006 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3669999999999999e-06 2024-09-13T06:40:49.006 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:49.006 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:49.006 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:49.006 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443420+0000", 2024-09-13T06:40:49.006 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2645e-05 2024-09-13T06:40:49.006 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:49.006 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:49.006 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:49.006 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532742+0000", 2024-09-13T06:40:49.006 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089322200000000004 2024-09-13T06:40:49.006 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:49.006 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:49.007 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:49.007 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532818+0000", 2024-09-13T06:40:49.007 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.6019000000000005e-05 2024-09-13T06:40:49.007 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:49.007 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:49.007 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:49.007 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533020+0000", 2024-09-13T06:40:49.007 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000201721 2024-09-13T06:40:49.007 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:49.007 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:49.007 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:49.007 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:49.007 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:49.007 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25743 3.18 3:1c662b96:::rbd_data.1121f2c5ee81.0000000000000010:13 [read 294912~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:49.007 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443425+0000", 2024-09-13T06:40:49.008 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 52.527946374999999, 2024-09-13T06:40:49.008 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089864075000000002, 2024-09-13T06:40:49.008 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:49.008 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:49.008 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:49.008 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:49.008 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:49.008 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25743 2024-09-13T06:40:49.008 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:49.008 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:49.008 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:49.008 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:49.008 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443425+0000", 2024-09-13T06:40:49.009 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:49.009 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:49.009 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:49.009 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:49.009 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443425+0000", 2024-09-13T06:40:49.009 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:49.009 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:49.009 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:49.009 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:49.009 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443425+0000", 2024-09-13T06:40:49.009 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:49.009 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:49.010 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:49.010 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:49.010 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443432+0000", 2024-09-13T06:40:49.010 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3420000000000002e-06 2024-09-13T06:40:49.010 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:49.010 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:49.010 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:49.010 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443440+0000", 2024-09-13T06:40:49.010 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5689999999999999e-06 2024-09-13T06:40:49.010 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:49.010 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:49.010 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:49.010 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443445+0000", 2024-09-13T06:40:49.010 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9590000000000003e-06 2024-09-13T06:40:49.010 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:49.011 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:49.011 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:49.011 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533063+0000", 2024-09-13T06:40:49.011 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089617988999999995 2024-09-13T06:40:49.011 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:49.011 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:49.011 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:49.011 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533122+0000", 2024-09-13T06:40:49.011 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9052999999999999e-05 2024-09-13T06:40:49.011 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:49.011 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:49.011 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:49.011 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533289+0000", 2024-09-13T06:40:49.011 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00016752800000000001 2024-09-13T06:40:49.011 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:49.012 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:49.012 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:49.012 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:49.012 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:49.012 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25744 3.18 3.69d46638 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:49.012 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443449+0000", 2024-09-13T06:40:49.012 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 52.527922228000001, 2024-09-13T06:40:49.012 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089869148999999995, 2024-09-13T06:40:49.012 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:49.012 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:40:49.012 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:49.012 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:49.012 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:49.012 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25744 2024-09-13T06:40:49.013 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:49.013 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:49.013 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:49.013 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:49.013 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443449+0000", 2024-09-13T06:40:49.013 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:49.013 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:49.013 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:49.013 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:49.013 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443449+0000", 2024-09-13T06:40:49.013 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:49.014 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:49.014 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:49.014 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:49.014 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443449+0000", 2024-09-13T06:40:49.014 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:49.014 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:49.014 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:49.014 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:49.014 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443451+0000", 2024-09-13T06:40:49.014 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.244e-06 2024-09-13T06:40:49.014 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:49.015 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:49.015 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:49.015 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443457+0000", 2024-09-13T06:40:49.015 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.66e-06 2024-09-13T06:40:49.015 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:49.015 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:49.015 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:49.015 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443461+0000", 2024-09-13T06:40:49.015 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5449999999999997e-06 2024-09-13T06:40:49.015 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:49.015 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:49.015 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:49.015 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533311+0000", 2024-09-13T06:40:49.015 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089849729000000003 2024-09-13T06:40:49.016 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:49.016 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:49.016 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:49.016 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533318+0000", 2024-09-13T06:40:49.016 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.328e-06 2024-09-13T06:40:49.016 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:49.016 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:49.016 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:49.016 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:49.016 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:49.016 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25745 3.18 3.69d46638 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:49.016 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443466+0000", 2024-09-13T06:40:49.016 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 52.527905169999997, 2024-09-13T06:40:49.016 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089886743000000005, 2024-09-13T06:40:49.017 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:49.017 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:40:49.017 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:49.017 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:49.017 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:49.017 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25745 2024-09-13T06:40:49.017 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:49.017 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:49.017 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:49.017 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:49.017 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443466+0000", 2024-09-13T06:40:49.017 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:49.017 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:49.017 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:49.017 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:49.018 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443466+0000", 2024-09-13T06:40:49.018 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:49.018 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:49.018 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:49.018 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:49.018 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443466+0000", 2024-09-13T06:40:49.018 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:49.018 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:49.018 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:49.018 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:49.018 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443474+0000", 2024-09-13T06:40:49.018 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.1289999999999996e-06 2024-09-13T06:40:49.018 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:49.018 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:49.019 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:49.019 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443484+0000", 2024-09-13T06:40:49.019 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0654e-05 2024-09-13T06:40:49.019 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:49.019 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:49.019 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:49.019 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443490+0000", 2024-09-13T06:40:49.019 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8030000000000002e-06 2024-09-13T06:40:49.019 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:49.019 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:49.019 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:49.019 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533348+0000", 2024-09-13T06:40:49.019 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089857267000000005 2024-09-13T06:40:49.019 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:49.020 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:49.020 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:49.020 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533353+0000", 2024-09-13T06:40:49.020 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.5520000000000004e-06 2024-09-13T06:40:49.020 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:49.020 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:49.020 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:49.020 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:49.020 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:49.020 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25746 3.18 3.69d46638 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:49.020 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443495+0000", 2024-09-13T06:40:49.020 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 52.527876057, 2024-09-13T06:40:49.020 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089903725000000004, 2024-09-13T06:40:49.021 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:49.021 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:40:49.021 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:49.021 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:49.021 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:49.021 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25746 2024-09-13T06:40:49.021 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:49.021 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:49.021 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:49.021 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:49.021 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443495+0000", 2024-09-13T06:40:49.021 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:49.022 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:49.022 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:49.022 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:49.022 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443495+0000", 2024-09-13T06:40:49.022 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:49.022 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:49.022 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:49.022 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:49.022 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443495+0000", 2024-09-13T06:40:49.022 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:49.022 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:49.022 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:49.022 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:49.023 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443498+0000", 2024-09-13T06:40:49.023 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.7690000000000001e-06 2024-09-13T06:40:49.023 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:49.023 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:49.023 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:49.023 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443504+0000", 2024-09-13T06:40:49.023 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9710000000000001e-06 2024-09-13T06:40:49.023 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:49.023 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:49.023 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:49.023 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443508+0000", 2024-09-13T06:40:49.023 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4159999999999997e-06 2024-09-13T06:40:49.023 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:49.023 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:49.023 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:49.024 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533391+0000", 2024-09-13T06:40:49.024 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089882607000000003 2024-09-13T06:40:49.024 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:49.024 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:49.024 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:49.024 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533399+0000", 2024-09-13T06:40:49.024 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.4349999999999997e-06 2024-09-13T06:40:49.024 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:49.024 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:49.024 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:49.024 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:49.024 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:49.024 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25747 3.8 3.63996268 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:49.024 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443512+0000", 2024-09-13T06:40:49.025 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 52.527859325999998, 2024-09-13T06:40:49.025 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089880075000000004, 2024-09-13T06:40:49.025 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:49.025 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:40:49.025 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:49.025 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:49.025 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:49.025 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25747 2024-09-13T06:40:49.025 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:49.025 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:49.025 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:49.025 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:49.025 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443512+0000", 2024-09-13T06:40:49.025 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:49.025 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:49.026 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:49.026 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:49.026 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443512+0000", 2024-09-13T06:40:49.026 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:49.026 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:49.026 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:49.026 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:49.026 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443512+0000", 2024-09-13T06:40:49.026 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:49.026 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:49.026 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:49.026 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:49.026 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443514+0000", 2024-09-13T06:40:49.026 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0980000000000001e-06 2024-09-13T06:40:49.026 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:49.027 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:49.027 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:49.027 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443520+0000", 2024-09-13T06:40:49.027 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7069999999999997e-06 2024-09-13T06:40:49.027 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:49.027 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:49.027 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:49.027 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443524+0000", 2024-09-13T06:40:49.027 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5390000000000001e-06 2024-09-13T06:40:49.027 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:49.027 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:49.027 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:49.027 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533384+0000", 2024-09-13T06:40:49.027 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089859684999999995 2024-09-13T06:40:49.028 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:49.028 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:49.028 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:49.028 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533392+0000", 2024-09-13T06:40:49.028 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.3440000000000001e-06 2024-09-13T06:40:49.028 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:49.028 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:49.028 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:49.028 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:49.028 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:49.028 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25748 3.8 3.63996268 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:49.028 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443528+0000", 2024-09-13T06:40:49.028 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 52.527843199000003, 2024-09-13T06:40:49.028 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089890715999999996, 2024-09-13T06:40:49.029 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:49.029 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:40:49.029 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:49.029 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:49.029 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:49.029 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25748 2024-09-13T06:40:49.029 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:49.029 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:49.029 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:49.029 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:49.029 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443528+0000", 2024-09-13T06:40:49.029 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:49.029 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:49.029 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:49.030 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:49.030 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443528+0000", 2024-09-13T06:40:49.030 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:49.030 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:49.030 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:49.030 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:49.030 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443528+0000", 2024-09-13T06:40:49.030 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:49.030 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:49.030 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:49.030 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:49.030 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443530+0000", 2024-09-13T06:40:49.030 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0650000000000001e-06 2024-09-13T06:40:49.030 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:49.031 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:49.031 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:49.031 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443536+0000", 2024-09-13T06:40:49.031 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7259999999999999e-06 2024-09-13T06:40:49.031 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:49.031 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:49.031 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:49.031 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443540+0000", 2024-09-13T06:40:49.031 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5009999999999998e-06 2024-09-13T06:40:49.031 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:49.031 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:49.031 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:49.031 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533412+0000", 2024-09-13T06:40:49.031 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089871873000000005 2024-09-13T06:40:49.031 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:49.032 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:49.032 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:49.032 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533419+0000", 2024-09-13T06:40:49.032 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.883e-06 2024-09-13T06:40:49.032 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:49.032 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:49.032 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:49.032 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:49.032 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:49.032 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25749 3.8 3.63996268 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:49.032 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443545+0000", 2024-09-13T06:40:49.032 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 52.527827002999999, 2024-09-13T06:40:49.032 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089897988999999998, 2024-09-13T06:40:49.033 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:49.033 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:40:49.033 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:49.033 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:49.033 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:49.033 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25749 2024-09-13T06:40:49.033 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:49.033 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:49.033 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:49.033 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:49.033 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443545+0000", 2024-09-13T06:40:49.033 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:49.033 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:49.033 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:49.033 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:49.034 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443545+0000", 2024-09-13T06:40:49.034 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:49.034 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:49.034 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:49.034 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:49.034 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443544+0000", 2024-09-13T06:40:49.034 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:49.034 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:49.034 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:49.034 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:49.034 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443553+0000", 2024-09-13T06:40:49.034 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.4770000000000003e-06 2024-09-13T06:40:49.034 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:49.034 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:49.034 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:49.035 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443564+0000", 2024-09-13T06:40:49.035 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0986e-05 2024-09-13T06:40:49.035 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:49.035 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:49.035 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:49.035 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443569+0000", 2024-09-13T06:40:49.035 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2530000000000004e-06 2024-09-13T06:40:49.035 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:49.035 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:49.035 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:49.035 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533438+0000", 2024-09-13T06:40:49.035 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089868641999999999 2024-09-13T06:40:49.035 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:49.035 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:49.035 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:49.036 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533442+0000", 2024-09-13T06:40:49.036 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.989e-06 2024-09-13T06:40:49.036 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:49.036 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:49.036 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:49.036 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:49.036 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:49.036 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25750 3.8 3.63996268 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:49.036 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443574+0000", 2024-09-13T06:40:49.036 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 52.527797517000003, 2024-09-13T06:40:49.036 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089895143999999996, 2024-09-13T06:40:49.036 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:49.036 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:40:49.036 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:49.037 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:49.037 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:49.037 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25750 2024-09-13T06:40:49.037 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:49.037 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:49.037 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:49.037 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:49.037 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443574+0000", 2024-09-13T06:40:49.037 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:49.037 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:49.037 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:49.037 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:49.037 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443574+0000", 2024-09-13T06:40:49.037 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:49.038 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:49.038 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:49.038 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:49.038 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443574+0000", 2024-09-13T06:40:49.038 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:49.038 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:49.038 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:49.038 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:49.038 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443576+0000", 2024-09-13T06:40:49.038 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6910000000000002e-06 2024-09-13T06:40:49.038 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:49.038 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:49.038 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:49.038 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443583+0000", 2024-09-13T06:40:49.038 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.331e-06 2024-09-13T06:40:49.039 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:49.039 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:49.039 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:49.039 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443587+0000", 2024-09-13T06:40:49.039 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6129999999999997e-06 2024-09-13T06:40:49.039 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:49.039 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:49.039 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:49.039 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533464+0000", 2024-09-13T06:40:49.039 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089876605999999998 2024-09-13T06:40:49.039 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:49.039 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:49.039 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:49.039 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533469+0000", 2024-09-13T06:40:49.039 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3909999999999997e-06 2024-09-13T06:40:49.040 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:49.040 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:49.040 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:49.040 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:49.040 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:49.040 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25751 3.8 3.63996268 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:49.040 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443592+0000", 2024-09-13T06:40:49.040 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 52.527779819999999, 2024-09-13T06:40:49.040 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089913650999999997, 2024-09-13T06:40:49.040 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:49.040 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:40:49.040 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:49.040 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:49.040 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:49.041 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25751 2024-09-13T06:40:49.041 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:49.041 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:49.041 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:49.041 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:49.041 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443592+0000", 2024-09-13T06:40:49.041 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:49.041 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:49.041 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:49.041 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:49.041 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443592+0000", 2024-09-13T06:40:49.041 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:49.041 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:49.041 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:49.041 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:49.042 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443591+0000", 2024-09-13T06:40:49.042 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:49.042 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:49.042 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:49.042 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:49.042 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443594+0000", 2024-09-13T06:40:49.042 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3649999999999998e-06 2024-09-13T06:40:49.042 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:49.042 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:49.042 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:49.042 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443599+0000", 2024-09-13T06:40:49.042 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.699e-06 2024-09-13T06:40:49.042 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:49.042 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:49.042 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:49.043 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443611+0000", 2024-09-13T06:40:49.043 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1503e-05 2024-09-13T06:40:49.043 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:49.043 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:49.043 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:49.043 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533497+0000", 2024-09-13T06:40:49.043 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089886453000000005 2024-09-13T06:40:49.043 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:49.043 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:49.043 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:49.043 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533505+0000", 2024-09-13T06:40:49.044 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.9910000000000002e-06 2024-09-13T06:40:49.044 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:49.044 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:49.044 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:49.044 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:49.044 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:49.044 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25752 3.8 3.63996268 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:49.044 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443615+0000", 2024-09-13T06:40:49.044 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 52.527756039000003, 2024-09-13T06:40:49.044 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089905868999999999, 2024-09-13T06:40:49.044 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:49.044 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:40:49.045 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:49.045 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:49.045 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:49.045 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25752 2024-09-13T06:40:49.045 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:49.045 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:49.045 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:49.045 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:49.045 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443615+0000", 2024-09-13T06:40:49.045 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:49.045 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:49.045 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:49.045 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:49.045 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443615+0000", 2024-09-13T06:40:49.045 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:49.046 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:49.046 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:49.046 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:49.046 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443615+0000", 2024-09-13T06:40:49.046 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:49.046 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:49.046 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:49.046 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:49.046 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443617+0000", 2024-09-13T06:40:49.046 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3539999999999998e-06 2024-09-13T06:40:49.046 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:49.046 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:49.047 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:49.047 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443624+0000", 2024-09-13T06:40:49.047 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3600000000000001e-06 2024-09-13T06:40:49.047 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:49.047 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:49.047 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:49.047 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443628+0000", 2024-09-13T06:40:49.047 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.2350000000000001e-06 2024-09-13T06:40:49.047 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:49.047 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:49.047 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:49.047 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533517+0000", 2024-09-13T06:40:49.048 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089889029999999995 2024-09-13T06:40:49.048 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:49.048 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:49.048 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:49.048 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533521+0000", 2024-09-13T06:40:49.048 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.2529999999999998e-06 2024-09-13T06:40:49.048 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:49.048 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:49.048 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:49.048 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:49.048 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:49.048 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25755 3.8 3.63996268 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:49.048 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.444692+0000", 2024-09-13T06:40:49.049 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 52.526679332999997, 2024-09-13T06:40:49.049 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.088904186999999996, 2024-09-13T06:40:49.049 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:49.049 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:40:49.049 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:49.049 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:49.049 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:49.049 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25755 2024-09-13T06:40:49.049 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:49.049 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:49.049 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:49.049 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:49.049 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.444692+0000", 2024-09-13T06:40:49.049 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:49.050 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:49.050 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:49.050 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:49.050 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.444692+0000", 2024-09-13T06:40:49.050 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:49.050 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:49.050 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:49.050 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:49.050 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.444692+0000", 2024-09-13T06:40:49.050 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:49.050 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:49.050 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:49.050 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:49.050 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.444694+0000", 2024-09-13T06:40:49.051 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.058e-06 2024-09-13T06:40:49.051 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:49.051 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:49.051 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:49.051 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.444700+0000", 2024-09-13T06:40:49.051 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7769999999999999e-06 2024-09-13T06:40:49.051 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:49.051 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:49.051 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:49.051 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.444704+0000", 2024-09-13T06:40:49.051 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6229999999999996e-06 2024-09-13T06:40:49.051 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:49.051 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:49.051 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:49.051 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533587+0000", 2024-09-13T06:40:49.052 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.088882744999999999 2024-09-13T06:40:49.052 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:49.052 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:49.052 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:49.052 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533596+0000", 2024-09-13T06:40:49.052 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.3270000000000007e-06 2024-09-13T06:40:49.052 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:49.052 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:49.052 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:49.052 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:49.052 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:49.052 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25756 3.8 3.63996268 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:49.052 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.444709+0000", 2024-09-13T06:40:49.052 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 52.526662956999999, 2024-09-13T06:40:49.052 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.088902571, 2024-09-13T06:40:49.053 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:49.053 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:40:49.053 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:49.053 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:49.053 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:49.053 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25756 2024-09-13T06:40:49.053 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:49.053 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:49.053 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:49.053 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:49.053 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.444709+0000", 2024-09-13T06:40:49.053 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:49.053 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:49.053 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:49.054 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:49.054 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.444709+0000", 2024-09-13T06:40:49.054 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:49.054 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:49.054 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:49.054 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:49.054 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.444708+0000", 2024-09-13T06:40:49.054 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:49.054 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:49.054 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:49.054 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:49.054 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.444710+0000", 2024-09-13T06:40:49.054 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0729999999999999e-06 2024-09-13T06:40:49.054 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:49.054 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:49.055 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:49.055 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.444716+0000", 2024-09-13T06:40:49.055 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7819999999999999e-06 2024-09-13T06:40:49.055 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:49.055 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:49.055 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:49.055 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.444720+0000", 2024-09-13T06:40:49.055 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4000000000000002e-06 2024-09-13T06:40:49.055 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:49.055 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:49.055 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:49.055 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533606+0000", 2024-09-13T06:40:49.055 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.088885711000000006 2024-09-13T06:40:49.055 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:49.055 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:49.056 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:49.056 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533611+0000", 2024-09-13T06:40:49.056 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.057e-06 2024-09-13T06:40:49.056 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:49.056 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:49.056 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:49.056 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:49.056 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:49.056 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:40:49.057 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-13T06:40:49.058 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:40:49.057+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:40:49.159 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:40:49.161+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:40:49.189 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:40:49.189 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [], 2024-09-13T06:40:49.189 INFO:teuthology.orchestra.run.smithi139.stdout: "num_ops": 0 2024-09-13T06:40:49.189 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:40:49.203 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-13T06:40:49.260 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:40:49.259+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:40:49.361 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:40:49.363+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:40:49.371 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:40:49.371 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [], 2024-09-13T06:40:49.371 INFO:teuthology.orchestra.run.smithi139.stdout: "complaint_time": 30, 2024-09-13T06:40:49.371 INFO:teuthology.orchestra.run.smithi139.stdout: "num_blocked_ops": 0 2024-09-13T06:40:49.371 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:40:49.387 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-13T06:40:49.467 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:40:49.463+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:40:49.491 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-13T06:40:49.511 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:40:49.511 INFO:teuthology.orchestra.run.smithi139.stdout: "size": 20, 2024-09-13T06:40:49.512 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 600, 2024-09-13T06:40:49.512 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [ 2024-09-13T06:40:49.512 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:49.512 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18706 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 3346432~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:40:49.512 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.846138+0000", 2024-09-13T06:40:49.512 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 57.664783755999999, 2024-09-13T06:40:49.512 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.102018712, 2024-09-13T06:40:49.512 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:49.512 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:49.512 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:49.512 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:49.512 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:49.512 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18706 2024-09-13T06:40:49.513 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:49.513 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:49.513 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:49.513 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:49.513 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846138+0000", 2024-09-13T06:40:49.513 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:49.513 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:49.513 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:49.513 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:49.513 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846138+0000", 2024-09-13T06:40:49.513 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:49.513 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:49.514 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:49.514 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:49.514 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846138+0000", 2024-09-13T06:40:49.514 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:49.514 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:49.514 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:49.514 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:49.514 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846141+0000", 2024-09-13T06:40:49.514 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.6969999999999999e-06 2024-09-13T06:40:49.514 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:49.514 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:49.514 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:49.514 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846150+0000", 2024-09-13T06:40:49.514 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6400000000000003e-06 2024-09-13T06:40:49.515 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:49.515 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:49.515 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:49.515 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846160+0000", 2024-09-13T06:40:49.515 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.3999999999999998e-06 2024-09-13T06:40:49.515 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:49.515 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:49.515 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:49.515 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.947764+0000", 2024-09-13T06:40:49.515 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101604085 2024-09-13T06:40:49.515 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:49.515 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:49.516 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:49.516 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.947888+0000", 2024-09-13T06:40:49.516 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000124113 2024-09-13T06:40:49.516 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:49.516 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:49.516 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:49.516 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.948157+0000", 2024-09-13T06:40:49.516 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00026943399999999998 2024-09-13T06:40:49.516 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:49.516 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:49.517 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:49.517 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:49.517 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:49.517 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18707 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 3375104~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:40:49.517 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.846207+0000", 2024-09-13T06:40:49.517 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 57.66471499, 2024-09-13T06:40:49.517 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10238114099999999, 2024-09-13T06:40:49.517 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:49.517 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:49.517 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:49.517 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:49.517 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:49.517 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18707 2024-09-13T06:40:49.518 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:49.518 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:49.518 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:49.518 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:49.518 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846207+0000", 2024-09-13T06:40:49.518 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:49.518 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:49.518 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:49.518 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:49.518 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846207+0000", 2024-09-13T06:40:49.518 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:49.518 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:49.518 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:49.518 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:49.518 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846206+0000", 2024-09-13T06:40:49.519 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:49.519 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:49.519 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:49.519 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:49.519 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846211+0000", 2024-09-13T06:40:49.519 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.3000000000000003e-06 2024-09-13T06:40:49.519 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:49.519 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:49.519 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:49.519 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846220+0000", 2024-09-13T06:40:49.519 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6199999999999994e-06 2024-09-13T06:40:49.519 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:49.519 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:49.519 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:49.520 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846228+0000", 2024-09-13T06:40:49.520 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.7500000000000003e-06 2024-09-13T06:40:49.520 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:49.520 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:49.520 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:49.520 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.948267+0000", 2024-09-13T06:40:49.520 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10203878700000001 2024-09-13T06:40:49.520 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:49.520 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:49.520 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:49.520 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.948435+0000", 2024-09-13T06:40:49.520 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00016796500000000001 2024-09-13T06:40:49.520 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:49.521 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:49.521 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:49.521 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.948588+0000", 2024-09-13T06:40:49.521 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00015373599999999999 2024-09-13T06:40:49.521 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:49.521 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:49.521 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:49.521 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:49.521 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:49.521 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18718 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 3690496~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:40:49.521 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.850174+0000", 2024-09-13T06:40:49.521 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 57.660747837000002, 2024-09-13T06:40:49.521 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101854154, 2024-09-13T06:40:49.522 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:49.522 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:49.522 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:49.522 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:49.522 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:49.522 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18718 2024-09-13T06:40:49.522 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:49.522 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:49.522 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:49.522 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:49.522 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850174+0000", 2024-09-13T06:40:49.522 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:49.522 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:49.522 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:49.522 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:49.522 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850174+0000", 2024-09-13T06:40:49.523 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:49.523 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:49.523 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:49.523 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:49.523 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850173+0000", 2024-09-13T06:40:49.523 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:49.523 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:49.523 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:49.523 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:49.523 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850178+0000", 2024-09-13T06:40:49.523 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.4129999999999999e-06 2024-09-13T06:40:49.523 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:49.523 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:49.524 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:49.524 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850188+0000", 2024-09-13T06:40:49.524 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.8600000000000005e-06 2024-09-13T06:40:49.524 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:49.524 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:49.524 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:49.524 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850195+0000", 2024-09-13T06:40:49.524 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.8730000000000007e-06 2024-09-13T06:40:49.524 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:49.524 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:49.524 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:49.524 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.951766+0000", 2024-09-13T06:40:49.524 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.1015703 2024-09-13T06:40:49.524 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:49.524 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:49.525 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:49.525 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.951879+0000", 2024-09-13T06:40:49.525 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000112932 2024-09-13T06:40:49.525 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:49.525 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:49.525 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:49.525 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.952029+0000", 2024-09-13T06:40:49.525 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000149846 2024-09-13T06:40:49.525 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:49.525 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:49.525 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:49.525 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:49.526 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:49.526 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18719 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 3719168~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:40:49.526 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.850202+0000", 2024-09-13T06:40:49.526 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 57.660719794000002, 2024-09-13T06:40:49.526 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.102191676, 2024-09-13T06:40:49.526 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:49.526 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:49.526 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:49.526 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:49.526 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:49.526 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18719 2024-09-13T06:40:49.526 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:49.526 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:49.526 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:49.527 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:49.527 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850202+0000", 2024-09-13T06:40:49.527 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:49.527 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:49.527 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:49.527 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:49.527 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850202+0000", 2024-09-13T06:40:49.527 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:49.527 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:49.527 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:49.527 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:49.527 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850202+0000", 2024-09-13T06:40:49.527 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:49.527 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:49.528 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:49.528 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:49.528 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850205+0000", 2024-09-13T06:40:49.528 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.89e-06 2024-09-13T06:40:49.528 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:49.528 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:49.528 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:49.528 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850216+0000", 2024-09-13T06:40:49.528 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0233e-05 2024-09-13T06:40:49.528 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:49.528 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:49.528 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:49.528 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850223+0000", 2024-09-13T06:40:49.528 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5299999999999999e-06 2024-09-13T06:40:49.528 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:49.529 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:49.529 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:49.529 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.952106+0000", 2024-09-13T06:40:49.529 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10188309299999999 2024-09-13T06:40:49.529 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:49.529 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:49.529 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:49.529 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.952233+0000", 2024-09-13T06:40:49.529 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000126993 2024-09-13T06:40:49.529 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:49.529 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:49.529 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:49.529 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.952394+0000", 2024-09-13T06:40:49.529 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000160791 2024-09-13T06:40:49.530 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:49.530 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:49.530 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:49.530 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:49.530 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:49.530 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18720 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 3747840~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:40:49.530 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.850726+0000", 2024-09-13T06:40:49.530 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 57.660195965, 2024-09-13T06:40:49.530 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10199504299999999, 2024-09-13T06:40:49.530 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:49.530 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:49.530 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:49.530 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:49.530 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:49.531 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18720 2024-09-13T06:40:49.531 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:49.531 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:49.531 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:49.531 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:49.531 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850726+0000", 2024-09-13T06:40:49.531 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:49.531 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:49.531 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:49.531 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:49.531 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850726+0000", 2024-09-13T06:40:49.531 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:49.531 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:49.531 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:49.531 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:49.532 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850229+0000", 2024-09-13T06:40:49.532 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9995027 2024-09-13T06:40:49.532 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:49.532 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:49.532 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:49.532 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850731+0000", 2024-09-13T06:40:49.532 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00050221599999999999 2024-09-13T06:40:49.532 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:49.532 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:49.532 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:49.532 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850751+0000", 2024-09-13T06:40:49.533 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.9703000000000001e-05 2024-09-13T06:40:49.533 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:49.533 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:49.533 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:49.533 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850764+0000", 2024-09-13T06:40:49.533 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3207000000000001e-05 2024-09-13T06:40:49.533 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:49.533 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:49.533 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:49.533 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.952454+0000", 2024-09-13T06:40:49.533 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101690102 2024-09-13T06:40:49.533 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:49.533 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:49.534 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:49.534 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.952571+0000", 2024-09-13T06:40:49.534 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000116556 2024-09-13T06:40:49.534 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:49.534 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:49.534 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:49.534 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.952721+0000", 2024-09-13T06:40:49.534 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000150419 2024-09-13T06:40:49.534 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:49.534 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:49.534 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:49.534 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:49.534 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:49.534 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18730 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 4034560~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:40:49.535 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.854013+0000", 2024-09-13T06:40:49.535 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 57.656909024000001, 2024-09-13T06:40:49.535 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10186914399999999, 2024-09-13T06:40:49.535 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:49.535 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:49.535 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:49.535 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:49.535 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:49.535 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18730 2024-09-13T06:40:49.535 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:49.535 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:49.535 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:49.535 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:49.535 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.854013+0000", 2024-09-13T06:40:49.535 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:49.536 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:49.536 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:49.536 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:49.536 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.854013+0000", 2024-09-13T06:40:49.536 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:49.536 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:49.536 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:49.536 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:49.536 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.854013+0000", 2024-09-13T06:40:49.536 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:49.536 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:49.536 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:49.536 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:49.536 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.854016+0000", 2024-09-13T06:40:49.537 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.1839999999999999e-06 2024-09-13T06:40:49.537 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:49.537 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:49.537 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:49.537 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.854025+0000", 2024-09-13T06:40:49.537 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.8030000000000003e-06 2024-09-13T06:40:49.537 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:49.537 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:49.537 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:49.537 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.854033+0000", 2024-09-13T06:40:49.537 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6500000000000002e-06 2024-09-13T06:40:49.537 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:49.537 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:49.538 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:49.538 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.955546+0000", 2024-09-13T06:40:49.538 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10151296 2024-09-13T06:40:49.538 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:49.538 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:49.538 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:49.538 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.955694+0000", 2024-09-13T06:40:49.538 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000147773 2024-09-13T06:40:49.538 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:49.538 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:49.538 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:49.538 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.955882+0000", 2024-09-13T06:40:49.538 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000188371 2024-09-13T06:40:49.539 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:49.539 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:49.539 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:49.539 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:49.539 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:49.539 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18742 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 4378624~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:40:49.539 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.857984+0000", 2024-09-13T06:40:49.539 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 57.652937901000001, 2024-09-13T06:40:49.539 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10179961799999999, 2024-09-13T06:40:49.539 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:49.539 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:49.539 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:49.539 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:49.539 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:49.539 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18742 2024-09-13T06:40:49.540 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:49.540 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:49.540 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:49.540 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:49.540 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.857984+0000", 2024-09-13T06:40:49.540 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:49.540 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:49.540 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:49.540 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:49.540 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.857984+0000", 2024-09-13T06:40:49.540 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:49.540 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:49.540 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:49.540 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:49.541 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.857983+0000", 2024-09-13T06:40:49.541 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:49.541 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:49.541 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:49.541 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:49.541 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.857987+0000", 2024-09-13T06:40:49.541 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0670000000000002e-06 2024-09-13T06:40:49.541 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:49.541 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:49.541 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:49.541 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.857997+0000", 2024-09-13T06:40:49.541 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6830000000000003e-06 2024-09-13T06:40:49.541 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:49.541 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:49.542 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:49.542 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.858006+0000", 2024-09-13T06:40:49.542 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.5739999999999996e-06 2024-09-13T06:40:49.542 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:49.542 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:49.542 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:49.542 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.959453+0000", 2024-09-13T06:40:49.542 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101447339 2024-09-13T06:40:49.542 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:49.542 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:49.542 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:49.542 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.959603+0000", 2024-09-13T06:40:49.542 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000150316 2024-09-13T06:40:49.542 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:49.542 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:49.543 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:49.543 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.959784+0000", 2024-09-13T06:40:49.543 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00018065900000000001 2024-09-13T06:40:49.543 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:49.543 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:49.543 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:49.543 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:49.543 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:49.543 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18743 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 4407296~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:40:49.543 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.858012+0000", 2024-09-13T06:40:49.543 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 57.652909907999998, 2024-09-13T06:40:49.543 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10210024500000001, 2024-09-13T06:40:49.543 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:49.543 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:49.543 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:49.544 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:49.544 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:49.544 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18743 2024-09-13T06:40:49.544 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:49.544 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:49.544 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:49.544 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:49.544 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.858012+0000", 2024-09-13T06:40:49.544 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:49.544 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:49.544 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:49.544 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:49.544 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.858012+0000", 2024-09-13T06:40:49.544 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:49.545 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:49.545 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:49.545 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:49.545 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.858011+0000", 2024-09-13T06:40:49.545 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:49.545 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:49.545 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:49.545 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:49.545 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.858016+0000", 2024-09-13T06:40:49.546 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0659999999999997e-06 2024-09-13T06:40:49.546 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:49.546 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:49.546 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:49.546 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.858024+0000", 2024-09-13T06:40:49.546 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.7700000000000007e-06 2024-09-13T06:40:49.546 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:49.546 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:49.546 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:49.546 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.858032+0000", 2024-09-13T06:40:49.547 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.7700000000000001e-06 2024-09-13T06:40:49.547 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:49.547 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:49.547 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:49.547 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.959850+0000", 2024-09-13T06:40:49.547 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.1018182 2024-09-13T06:40:49.547 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:49.548 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:49.548 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:49.548 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.959964+0000", 2024-09-13T06:40:49.548 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00011413600000000001 2024-09-13T06:40:49.548 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:49.548 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:49.549 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:49.549 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.960113+0000", 2024-09-13T06:40:49.549 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00014813900000000001 2024-09-13T06:40:49.549 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:49.549 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:49.549 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:49.550 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:49.550 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:49.550 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18755 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 4751360~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:40:49.550 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.862061+0000", 2024-09-13T06:40:49.550 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 57.648861656000001, 2024-09-13T06:40:49.550 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101907023, 2024-09-13T06:40:49.551 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:49.551 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:49.551 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:49.551 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:49.551 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:49.551 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18755 2024-09-13T06:40:49.551 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:49.551 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:49.551 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:49.551 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:49.552 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862061+0000", 2024-09-13T06:40:49.552 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:49.552 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:49.552 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:49.552 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:49.552 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862061+0000", 2024-09-13T06:40:49.552 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:49.552 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:49.552 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:49.552 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:49.552 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862060+0000", 2024-09-13T06:40:49.552 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:49.552 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:49.553 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:49.553 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:49.553 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862064+0000", 2024-09-13T06:40:49.553 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.3229999999999999e-06 2024-09-13T06:40:49.553 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:49.553 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:49.553 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:49.553 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862078+0000", 2024-09-13T06:40:49.553 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.433e-05 2024-09-13T06:40:49.553 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:49.553 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:49.553 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:49.554 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862086+0000", 2024-09-13T06:40:49.554 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.3869999999999997e-06 2024-09-13T06:40:49.554 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:49.554 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:49.554 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:49.554 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.963635+0000", 2024-09-13T06:40:49.554 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101549606 2024-09-13T06:40:49.554 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:49.554 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:49.554 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:49.554 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.963783+0000", 2024-09-13T06:40:49.554 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000147312 2024-09-13T06:40:49.554 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:49.554 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:49.555 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:49.555 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.963968+0000", 2024-09-13T06:40:49.555 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000185028 2024-09-13T06:40:49.555 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:49.555 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:49.555 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:49.555 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:49.555 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:49.555 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18756 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 4780032~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:40:49.555 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.862132+0000", 2024-09-13T06:40:49.555 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 57.648789813, 2024-09-13T06:40:49.555 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.102159295, 2024-09-13T06:40:49.555 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:49.555 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:49.556 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:49.556 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:49.556 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:49.556 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18756 2024-09-13T06:40:49.556 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:49.556 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:49.556 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:49.556 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:49.556 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862132+0000", 2024-09-13T06:40:49.556 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:49.556 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:49.556 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:49.556 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:49.557 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862132+0000", 2024-09-13T06:40:49.557 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:49.557 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:49.557 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:49.557 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:49.557 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862132+0000", 2024-09-13T06:40:49.557 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:49.557 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:49.557 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:49.557 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:49.557 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862136+0000", 2024-09-13T06:40:49.557 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.9559999999999999e-06 2024-09-13T06:40:49.558 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:49.558 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:49.558 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:49.558 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862145+0000", 2024-09-13T06:40:49.558 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6169999999999996e-06 2024-09-13T06:40:49.558 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:49.558 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:49.558 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:49.558 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862153+0000", 2024-09-13T06:40:49.558 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.8359999999999992e-06 2024-09-13T06:40:49.558 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:49.558 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:49.558 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:49.559 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.964018+0000", 2024-09-13T06:40:49.559 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101865421 2024-09-13T06:40:49.559 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:49.559 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:49.559 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:49.559 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.964140+0000", 2024-09-13T06:40:49.559 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000121172 2024-09-13T06:40:49.559 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:49.559 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:49.559 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:49.559 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.964292+0000", 2024-09-13T06:40:49.559 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00015202600000000001 2024-09-13T06:40:49.559 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:49.559 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:49.560 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:49.560 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:49.560 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:49.560 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18768 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 5124096~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:40:49.560 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.866345+0000", 2024-09-13T06:40:49.560 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 57.644577505999997, 2024-09-13T06:40:49.560 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101779361, 2024-09-13T06:40:49.560 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:49.560 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:49.560 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:49.560 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:49.560 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:49.560 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18768 2024-09-13T06:40:49.560 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:49.561 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:49.561 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:49.561 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:49.561 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.866345+0000", 2024-09-13T06:40:49.561 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:49.561 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:49.561 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:49.561 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:49.561 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.866345+0000", 2024-09-13T06:40:49.561 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:49.561 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:49.562 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:49.562 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:49.562 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.866344+0000", 2024-09-13T06:40:49.562 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:49.562 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:49.562 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:49.562 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:49.562 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.866348+0000", 2024-09-13T06:40:49.562 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.4300000000000002e-06 2024-09-13T06:40:49.563 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:49.563 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:49.563 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:49.563 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.866356+0000", 2024-09-13T06:40:49.563 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.5930000000000006e-06 2024-09-13T06:40:49.563 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:49.563 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:49.563 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:49.563 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.866364+0000", 2024-09-13T06:40:49.563 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5599999999999996e-06 2024-09-13T06:40:49.563 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:49.564 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:49.564 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:49.564 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.967865+0000", 2024-09-13T06:40:49.564 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101501683 2024-09-13T06:40:49.564 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:49.564 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:49.564 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:49.564 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.967981+0000", 2024-09-13T06:40:49.564 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000115643 2024-09-13T06:40:49.564 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:49.564 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:49.564 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:49.564 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.968124+0000", 2024-09-13T06:40:49.565 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00014305500000000001 2024-09-13T06:40:49.565 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:49.565 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:49.565 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:49.565 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:49.565 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:49.565 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18779 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 5439488~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:40:49.565 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.869996+0000", 2024-09-13T06:40:49.565 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 57.640926620999998, 2024-09-13T06:40:49.565 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10189577399999999, 2024-09-13T06:40:49.565 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:49.565 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:49.565 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:49.566 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:49.566 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:49.566 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18779 2024-09-13T06:40:49.566 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:49.566 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:49.566 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:49.566 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:49.566 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.869996+0000", 2024-09-13T06:40:49.566 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:49.566 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:49.566 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:49.566 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:49.566 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.869996+0000", 2024-09-13T06:40:49.566 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:49.567 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:49.567 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:49.567 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:49.567 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.869995+0000", 2024-09-13T06:40:49.567 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:49.567 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:49.567 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:49.567 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:49.567 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.869998+0000", 2024-09-13T06:40:49.567 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.2729999999999998e-06 2024-09-13T06:40:49.567 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:49.567 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:49.567 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:49.567 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.870007+0000", 2024-09-13T06:40:49.567 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.5760000000000006e-06 2024-09-13T06:40:49.568 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:49.568 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:49.568 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:49.568 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.870014+0000", 2024-09-13T06:40:49.568 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.1400000000000002e-06 2024-09-13T06:40:49.568 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:49.568 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:49.568 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:49.568 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.971631+0000", 2024-09-13T06:40:49.568 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101617503 2024-09-13T06:40:49.568 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:49.568 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:49.568 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:49.568 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.971747+0000", 2024-09-13T06:40:49.568 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00011599600000000001 2024-09-13T06:40:49.569 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:49.569 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:49.569 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:49.569 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.971891+0000", 2024-09-13T06:40:49.569 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000143912 2024-09-13T06:40:49.569 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:49.569 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:49.569 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:49.569 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:49.569 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:49.569 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18792 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 5812224~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:40:49.569 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.874371+0000", 2024-09-13T06:40:49.570 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 57.636551490999999, 2024-09-13T06:40:49.570 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101736005, 2024-09-13T06:40:49.570 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:49.570 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:49.570 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:49.570 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:49.570 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:49.570 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18792 2024-09-13T06:40:49.570 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:49.570 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:49.570 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:49.570 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:49.571 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874371+0000", 2024-09-13T06:40:49.571 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:49.571 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:49.571 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:49.571 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:49.571 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874371+0000", 2024-09-13T06:40:49.571 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:49.571 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:49.571 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:49.571 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:49.571 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874370+0000", 2024-09-13T06:40:49.571 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:49.571 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:49.572 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:49.572 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:49.572 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874374+0000", 2024-09-13T06:40:49.572 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.7239999999999998e-06 2024-09-13T06:40:49.572 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:49.572 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:49.572 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:49.572 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874385+0000", 2024-09-13T06:40:49.572 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1293e-05 2024-09-13T06:40:49.572 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:49.572 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:49.573 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:49.573 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874394+0000", 2024-09-13T06:40:49.573 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.0729999999999994e-06 2024-09-13T06:40:49.573 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:49.573 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:49.573 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:49.573 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.975850+0000", 2024-09-13T06:40:49.573 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10145599700000001 2024-09-13T06:40:49.573 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:49.573 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:49.573 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:49.573 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.975963+0000", 2024-09-13T06:40:49.573 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000112689 2024-09-13T06:40:49.574 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:49.574 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:49.574 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:49.574 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.976107+0000", 2024-09-13T06:40:49.574 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000143836 2024-09-13T06:40:49.574 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:49.574 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:49.574 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:49.574 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:49.574 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:49.574 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18793 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 5840896~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:40:49.574 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.874401+0000", 2024-09-13T06:40:49.574 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 57.636521457999997, 2024-09-13T06:40:49.574 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.102005516, 2024-09-13T06:40:49.574 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:49.575 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:49.575 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:49.575 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:49.575 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:49.575 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18793 2024-09-13T06:40:49.575 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:49.575 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:49.575 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:49.575 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:49.575 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874401+0000", 2024-09-13T06:40:49.575 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:49.575 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:49.575 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:49.576 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:49.576 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874401+0000", 2024-09-13T06:40:49.576 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:49.576 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:49.576 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:49.576 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:49.576 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874400+0000", 2024-09-13T06:40:49.576 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:49.576 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:49.576 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:49.576 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:49.577 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874404+0000", 2024-09-13T06:40:49.577 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0069999999999999e-06 2024-09-13T06:40:49.577 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:49.577 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:49.577 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:49.577 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874412+0000", 2024-09-13T06:40:49.577 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.5399999999999996e-06 2024-09-13T06:40:49.577 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:49.577 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:49.577 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:49.577 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874420+0000", 2024-09-13T06:40:49.577 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.6199999999999999e-06 2024-09-13T06:40:49.577 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:49.577 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:49.578 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:49.578 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.976150+0000", 2024-09-13T06:40:49.578 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101729874 2024-09-13T06:40:49.578 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:49.578 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:49.578 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:49.578 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.976261+0000", 2024-09-13T06:40:49.578 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000110819 2024-09-13T06:40:49.578 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:49.578 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:49.578 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:49.578 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.976406+0000", 2024-09-13T06:40:49.578 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000145489 2024-09-13T06:40:49.578 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:49.578 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:49.579 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:49.579 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:49.579 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:49.579 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18803 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 6127616~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:40:49.579 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.877851+0000", 2024-09-13T06:40:49.579 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 57.633070965000002, 2024-09-13T06:40:49.579 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101951584, 2024-09-13T06:40:49.579 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:49.579 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:49.579 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:49.580 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:49.580 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:49.580 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18803 2024-09-13T06:40:49.580 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:49.580 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:49.580 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:49.580 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:49.580 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.877851+0000", 2024-09-13T06:40:49.580 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:49.580 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:49.580 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:49.580 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:49.580 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.877851+0000", 2024-09-13T06:40:49.580 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:49.581 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:49.581 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:49.581 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:49.581 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.877851+0000", 2024-09-13T06:40:49.581 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:49.581 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:49.581 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:49.581 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:49.581 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.877854+0000", 2024-09-13T06:40:49.581 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.7929999999999999e-06 2024-09-13T06:40:49.581 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:49.581 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:49.581 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:49.581 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.877864+0000", 2024-09-13T06:40:49.582 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.2029999999999998e-06 2024-09-13T06:40:49.582 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:49.582 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:49.582 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:49.582 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.877873+0000", 2024-09-13T06:40:49.582 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.0440000000000001e-06 2024-09-13T06:40:49.582 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:49.582 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:49.582 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:49.582 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.979544+0000", 2024-09-13T06:40:49.582 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101671198 2024-09-13T06:40:49.582 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:49.582 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:49.582 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:49.582 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.979658+0000", 2024-09-13T06:40:49.583 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000114456 2024-09-13T06:40:49.583 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:49.583 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:49.583 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:49.583 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.979803+0000", 2024-09-13T06:40:49.583 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000144506 2024-09-13T06:40:49.583 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:49.583 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:49.583 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:49.583 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:49.583 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:49.583 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18807 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 6242304~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:40:49.583 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.879235+0000", 2024-09-13T06:40:49.584 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 57.631686934999998, 2024-09-13T06:40:49.584 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101781258, 2024-09-13T06:40:49.584 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:49.584 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:49.584 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:49.584 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:49.584 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:49.584 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18807 2024-09-13T06:40:49.584 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:49.584 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:49.584 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:49.584 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:49.585 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879235+0000", 2024-09-13T06:40:49.585 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:49.585 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:49.585 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:49.585 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:49.585 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879235+0000", 2024-09-13T06:40:49.585 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:49.585 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:49.585 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:49.585 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:49.585 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879235+0000", 2024-09-13T06:40:49.585 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:49.586 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:49.586 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:49.586 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:49.586 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879239+0000", 2024-09-13T06:40:49.586 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.963e-06 2024-09-13T06:40:49.586 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:49.586 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:49.586 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:49.586 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879247+0000", 2024-09-13T06:40:49.586 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6470000000000004e-06 2024-09-13T06:40:49.586 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:49.587 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:49.587 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:49.587 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879255+0000", 2024-09-13T06:40:49.587 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5429999999999996e-06 2024-09-13T06:40:49.587 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:49.587 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:49.587 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:49.587 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.980756+0000", 2024-09-13T06:40:49.587 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10150165999999999 2024-09-13T06:40:49.587 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:49.587 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:49.587 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:49.588 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.980868+0000", 2024-09-13T06:40:49.588 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000111196 2024-09-13T06:40:49.588 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:49.588 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:49.588 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:49.588 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.981017+0000", 2024-09-13T06:40:49.588 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000148846 2024-09-13T06:40:49.588 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:49.588 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:49.588 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:49.588 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:49.588 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:49.588 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18808 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 6270976~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:40:49.589 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.879261+0000", 2024-09-13T06:40:49.589 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 57.631660795999998, 2024-09-13T06:40:49.589 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.102057547, 2024-09-13T06:40:49.589 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:49.589 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:49.589 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:49.589 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:49.589 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:49.589 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18808 2024-09-13T06:40:49.589 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:49.590 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:49.590 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:49.590 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:49.590 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879261+0000", 2024-09-13T06:40:49.590 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:49.590 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:49.590 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:49.590 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:49.591 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879261+0000", 2024-09-13T06:40:49.591 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:49.591 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:49.591 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:49.591 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:49.591 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879261+0000", 2024-09-13T06:40:49.591 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:49.591 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:49.591 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:49.591 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:49.591 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879264+0000", 2024-09-13T06:40:49.592 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.523e-06 2024-09-13T06:40:49.592 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:49.592 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:49.592 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:49.592 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879273+0000", 2024-09-13T06:40:49.592 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6070000000000008e-06 2024-09-13T06:40:49.592 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:49.592 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:49.592 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:49.592 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879280+0000", 2024-09-13T06:40:49.592 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.4699999999999996e-06 2024-09-13T06:40:49.592 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:49.592 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:49.593 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:49.593 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.981060+0000", 2024-09-13T06:40:49.593 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10177934800000001 2024-09-13T06:40:49.593 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:49.593 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:49.593 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:49.593 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.981174+0000", 2024-09-13T06:40:49.593 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000114456 2024-09-13T06:40:49.593 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:49.593 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:49.593 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:49.593 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.981319+0000", 2024-09-13T06:40:49.593 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00014473900000000001 2024-09-13T06:40:49.594 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:49.594 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:49.594 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:49.594 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:49.594 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:49.594 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18810 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 2662400~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:40:49.594 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.880386+0000", 2024-09-13T06:40:49.594 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 57.630536634000002, 2024-09-13T06:40:49.594 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101728022, 2024-09-13T06:40:49.594 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:49.594 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:49.594 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:49.594 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:49.595 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:49.595 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18810 2024-09-13T06:40:49.595 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:49.595 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:49.595 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:49.595 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:49.595 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880386+0000", 2024-09-13T06:40:49.595 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:49.595 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:49.595 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:49.595 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:49.595 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880386+0000", 2024-09-13T06:40:49.595 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:49.596 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:49.596 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:49.596 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:49.596 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880385+0000", 2024-09-13T06:40:49.596 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:49.596 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:49.596 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:49.596 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:49.596 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880389+0000", 2024-09-13T06:40:49.596 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.8539999999999999e-06 2024-09-13T06:40:49.596 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:49.596 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:49.596 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:49.596 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880398+0000", 2024-09-13T06:40:49.597 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.1689999999999998e-06 2024-09-13T06:40:49.597 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:49.597 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:49.597 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:49.597 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880405+0000", 2024-09-13T06:40:49.597 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5700000000000004e-06 2024-09-13T06:40:49.597 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:49.597 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:49.597 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:49.597 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.981833+0000", 2024-09-13T06:40:49.597 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10142791800000001 2024-09-13T06:40:49.597 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:49.597 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:49.597 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:49.597 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.981973+0000", 2024-09-13T06:40:49.598 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00014002900000000001 2024-09-13T06:40:49.598 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:49.598 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:49.598 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:49.598 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.982114+0000", 2024-09-13T06:40:49.598 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000140276 2024-09-13T06:40:49.598 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:49.598 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:49.598 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:49.598 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:49.598 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:49.598 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18811 3.9 3.140f5209 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:40:49.598 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.880449+0000", 2024-09-13T06:40:49.598 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 57.630473258000002, 2024-09-13T06:40:49.598 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101739355, 2024-09-13T06:40:49.599 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:49.599 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:40:49.599 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:49.599 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:49.599 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:49.599 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18811 2024-09-13T06:40:49.599 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:49.599 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:49.599 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:49.599 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:49.599 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880449+0000", 2024-09-13T06:40:49.599 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:49.599 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:49.599 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:49.599 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:49.599 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880449+0000", 2024-09-13T06:40:49.600 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:49.600 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:49.600 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:49.600 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:49.600 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880448+0000", 2024-09-13T06:40:49.600 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:49.600 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:49.600 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:49.600 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:49.600 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880452+0000", 2024-09-13T06:40:49.600 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0470000000000004e-06 2024-09-13T06:40:49.600 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:49.600 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:49.600 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:49.601 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880462+0000", 2024-09-13T06:40:49.601 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6530000000000006e-06 2024-09-13T06:40:49.601 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:49.601 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:49.601 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:49.601 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880472+0000", 2024-09-13T06:40:49.601 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0027000000000001e-05 2024-09-13T06:40:49.601 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:49.601 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:49.601 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:49.601 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.982172+0000", 2024-09-13T06:40:49.601 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10170043500000001 2024-09-13T06:40:49.601 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:49.601 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:49.601 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:49.602 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.982188+0000", 2024-09-13T06:40:49.602 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6172999999999999e-05 2024-09-13T06:40:49.602 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:49.602 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:49.602 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:49.602 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:49.602 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:49.602 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18812 3.9 3.140f5209 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:40:49.602 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.880478+0000", 2024-09-13T06:40:49.602 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 57.630444021000002, 2024-09-13T06:40:49.602 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10177795100000001, 2024-09-13T06:40:49.602 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:49.602 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:40:49.602 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:49.602 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:49.603 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:49.603 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18812 2024-09-13T06:40:49.603 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:49.603 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:49.603 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:49.603 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:49.603 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880478+0000", 2024-09-13T06:40:49.603 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:49.603 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:49.603 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:49.603 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:49.603 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880478+0000", 2024-09-13T06:40:49.603 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:49.604 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:49.604 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:49.604 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:49.604 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880477+0000", 2024-09-13T06:40:49.604 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:49.604 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:49.604 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:49.604 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:49.604 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880481+0000", 2024-09-13T06:40:49.604 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.827e-06 2024-09-13T06:40:49.604 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:49.604 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:49.604 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:49.604 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880490+0000", 2024-09-13T06:40:49.604 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6100000000000006e-06 2024-09-13T06:40:49.605 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:49.605 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:49.605 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:49.605 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880497+0000", 2024-09-13T06:40:49.605 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.7030000000000006e-06 2024-09-13T06:40:49.605 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:49.605 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:49.605 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:49.605 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.982241+0000", 2024-09-13T06:40:49.605 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10174351199999999 2024-09-13T06:40:49.605 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:49.605 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:49.605 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:49.606 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.982256+0000", 2024-09-13T06:40:49.606 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5143000000000001e-05 2024-09-13T06:40:49.606 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:49.606 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:49.606 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:49.606 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:49.606 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:49.606 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:40:49.607 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-13T06:40:49.608 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:40:49.609+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:40:49.708 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:40:49.707+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:40:49.745 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:40:49.745 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [], 2024-09-13T06:40:49.745 INFO:teuthology.orchestra.run.smithi139.stdout: "num_ops": 0 2024-09-13T06:40:49.745 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:40:49.762 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-13T06:40:49.809 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-13T06:40:49.809+0000 7f86a5f06640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26387) UID: 0 2024-09-13T06:40:49.866 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-13T06:40:49.897 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:40:49.897 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [], 2024-09-13T06:40:49.897 INFO:teuthology.orchestra.run.smithi139.stdout: "complaint_time": 30, 2024-09-13T06:40:49.897 INFO:teuthology.orchestra.run.smithi139.stdout: "num_blocked_ops": 0 2024-09-13T06:40:49.897 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:40:49.913 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-13T06:40:49.914 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:40:49.915+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:40:50.008 INFO:teuthology.orchestra.run.smithi081.stdout:osd.0: {} 2024-09-13T06:40:50.008 INFO:teuthology.orchestra.run.smithi081.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-13T06:40:50.011 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:40:50.011+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:40:50.024 INFO:teuthology.orchestra.run.smithi081.stdout:osd.1: {} 2024-09-13T06:40:50.024 INFO:teuthology.orchestra.run.smithi081.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-13T06:40:50.040 INFO:teuthology.orchestra.run.smithi081.stdout:osd.2: {} 2024-09-13T06:40:50.040 INFO:teuthology.orchestra.run.smithi081.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-13T06:40:50.055 INFO:teuthology.orchestra.run.smithi081.stdout:osd.3: {} 2024-09-13T06:40:50.055 INFO:teuthology.orchestra.run.smithi081.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-13T06:40:50.075 INFO:teuthology.orchestra.run.smithi081.stdout:osd.4: {} 2024-09-13T06:40:50.075 INFO:teuthology.orchestra.run.smithi081.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-13T06:40:50.083 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:40:50.083 INFO:teuthology.orchestra.run.smithi139.stdout: "size": 20, 2024-09-13T06:40:50.083 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 600, 2024-09-13T06:40:50.083 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [ 2024-09-13T06:40:50.083 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:50.083 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43282 3.1d 3:bd80bfb3:::rbd_object_map.11212f44bfb1.0000000000000020:head [call rbd.object_map_update in=20b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:40:50.083 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589032+0000", 2024-09-13T06:40:50.083 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 28.493502593999999, 2024-09-13T06:40:50.083 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.076225263000000001, 2024-09-13T06:40:50.083 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:50.083 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:40:50.084 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:50.084 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:50.084 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:50.084 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43282 2024-09-13T06:40:50.084 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:50.084 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:50.084 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:50.084 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:50.084 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589032+0000", 2024-09-13T06:40:50.084 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:50.084 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:50.084 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:50.084 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:50.085 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589032+0000", 2024-09-13T06:40:50.085 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:50.085 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:50.085 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:50.085 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:50.085 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589031+0000", 2024-09-13T06:40:50.085 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:50.085 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:50.085 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:50.085 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:50.085 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589036+0000", 2024-09-13T06:40:50.085 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.2619999999999998e-06 2024-09-13T06:40:50.085 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:50.085 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:50.086 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:50.086 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589046+0000", 2024-09-13T06:40:50.086 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.8099999999999992e-06 2024-09-13T06:40:50.086 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:50.086 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:50.086 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:50.086 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589054+0000", 2024-09-13T06:40:50.086 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.2230000000000007e-06 2024-09-13T06:40:50.086 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:50.086 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:50.086 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:50.086 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.660691+0000", 2024-09-13T06:40:50.086 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.07163659 2024-09-13T06:40:50.086 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:50.086 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:50.086 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:50.087 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.660850+0000", 2024-09-13T06:40:50.087 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00015864300000000001 2024-09-13T06:40:50.087 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:50.087 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:50.087 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 4", 2024-09-13T06:40:50.087 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.661729+0000", 2024-09-13T06:40:50.087 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00087956099999999995 2024-09-13T06:40:50.087 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:50.087 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:50.087 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:40:50.087 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.664409+0000", 2024-09-13T06:40:50.087 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0026803479999999999 2024-09-13T06:40:50.087 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:50.087 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:50.088 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-13T06:40:50.088 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.665088+0000", 2024-09-13T06:40:50.088 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00067901400000000003 2024-09-13T06:40:50.088 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:50.088 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:50.088 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-13T06:40:50.088 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.665181+0000", 2024-09-13T06:40:50.088 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.2050000000000001e-05 2024-09-13T06:40:50.088 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:50.088 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:50.088 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:50.088 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.665257+0000", 2024-09-13T06:40:50.089 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.6698000000000003e-05 2024-09-13T06:40:50.089 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:50.089 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:50.089 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:50.089 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:50.089 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:50.089 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43287 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 251904~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:40:50.089 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589424+0000", 2024-09-13T06:40:50.089 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 28.493111056, 2024-09-13T06:40:50.089 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.074334281000000002, 2024-09-13T06:40:50.089 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:50.089 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:50.089 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:50.089 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:50.090 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:50.090 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43287 2024-09-13T06:40:50.090 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:50.090 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:50.090 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:50.090 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:50.090 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589424+0000", 2024-09-13T06:40:50.090 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:50.090 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:50.090 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:50.090 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:50.090 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589424+0000", 2024-09-13T06:40:50.090 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:50.090 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:50.091 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:50.091 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:50.091 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589423+0000", 2024-09-13T06:40:50.091 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:50.091 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:50.091 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:50.091 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:50.091 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589426+0000", 2024-09-13T06:40:50.091 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.9129999999999996e-06 2024-09-13T06:40:50.091 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:50.091 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:50.091 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:50.091 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589436+0000", 2024-09-13T06:40:50.091 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.2320000000000007e-06 2024-09-13T06:40:50.091 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:50.092 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:50.092 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:50.092 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589443+0000", 2024-09-13T06:40:50.092 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.7770000000000002e-06 2024-09-13T06:40:50.092 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:50.092 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:50.092 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:50.092 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.663033+0000", 2024-09-13T06:40:50.092 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.073589744999999998 2024-09-13T06:40:50.092 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:50.092 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:50.092 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:50.092 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.663334+0000", 2024-09-13T06:40:50.092 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00030028200000000002 2024-09-13T06:40:50.093 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:50.093 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:50.093 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:50.093 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.663758+0000", 2024-09-13T06:40:50.093 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000424282 2024-09-13T06:40:50.093 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:50.093 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:50.093 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:50.093 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:50.093 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:50.093 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43288 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 270336~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:40:50.093 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589449+0000", 2024-09-13T06:40:50.093 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 28.493085342000001, 2024-09-13T06:40:50.094 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.074906773999999995, 2024-09-13T06:40:50.094 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:50.094 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:50.094 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:50.094 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:50.094 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:50.094 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43288 2024-09-13T06:40:50.094 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:50.094 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:50.094 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:50.094 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:50.094 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589449+0000", 2024-09-13T06:40:50.094 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:50.094 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:50.095 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:50.095 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:50.095 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589449+0000", 2024-09-13T06:40:50.095 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:50.095 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:50.095 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:50.095 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:50.095 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589449+0000", 2024-09-13T06:40:50.095 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:50.095 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:50.095 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:50.095 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:50.096 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589452+0000", 2024-09-13T06:40:50.096 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.5769999999999998e-06 2024-09-13T06:40:50.096 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:50.096 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:50.096 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:50.096 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589461+0000", 2024-09-13T06:40:50.096 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.5720000000000003e-06 2024-09-13T06:40:50.096 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:50.096 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:50.096 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:50.096 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589468+0000", 2024-09-13T06:40:50.096 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5859999999999999e-06 2024-09-13T06:40:50.096 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:50.097 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:50.097 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:50.097 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.663827+0000", 2024-09-13T06:40:50.097 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.074358704999999997 2024-09-13T06:40:50.097 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:50.097 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:50.097 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:50.097 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.664011+0000", 2024-09-13T06:40:50.097 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00018381699999999999 2024-09-13T06:40:50.097 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:50.097 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:50.097 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:50.097 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.664356+0000", 2024-09-13T06:40:50.097 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00034510999999999998 2024-09-13T06:40:50.098 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:50.098 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:50.098 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:50.098 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:50.098 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:50.098 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43289 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 284672~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:40:50.098 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589475+0000", 2024-09-13T06:40:50.098 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 28.493059943999999, 2024-09-13T06:40:50.098 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.075789117000000003, 2024-09-13T06:40:50.098 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:50.098 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:50.098 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:50.098 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:50.098 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:50.099 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43289 2024-09-13T06:40:50.099 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:50.099 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:50.099 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:50.099 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:50.099 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589475+0000", 2024-09-13T06:40:50.099 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:50.099 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:50.099 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:50.099 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:50.099 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589475+0000", 2024-09-13T06:40:50.099 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:50.099 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:50.099 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:50.099 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:50.100 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589474+0000", 2024-09-13T06:40:50.100 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:50.100 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:50.100 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:50.100 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:50.100 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589477+0000", 2024-09-13T06:40:50.100 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.7929999999999999e-06 2024-09-13T06:40:50.100 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:50.100 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:50.100 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:50.100 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589486+0000", 2024-09-13T06:40:50.100 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.4989999999999994e-06 2024-09-13T06:40:50.100 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:50.100 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:50.101 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:50.101 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589493+0000", 2024-09-13T06:40:50.101 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5329999999999997e-06 2024-09-13T06:40:50.101 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:50.101 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:50.101 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:50.101 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.664456+0000", 2024-09-13T06:40:50.101 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.074962794999999999 2024-09-13T06:40:50.101 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:50.101 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:50.101 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:50.101 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.664653+0000", 2024-09-13T06:40:50.101 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000197107 2024-09-13T06:40:50.101 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:50.102 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:50.102 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:50.102 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.665264+0000", 2024-09-13T06:40:50.102 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00061037600000000004 2024-09-13T06:40:50.102 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:50.102 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:50.102 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:50.102 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:50.102 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:50.102 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43290 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 299008~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:40:50.102 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589500+0000", 2024-09-13T06:40:50.102 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 28.493034432000002, 2024-09-13T06:40:50.102 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.075898564000000002, 2024-09-13T06:40:50.103 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:50.103 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:50.103 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:50.103 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:50.103 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:50.103 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43290 2024-09-13T06:40:50.103 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:50.103 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:50.103 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:50.103 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:50.103 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589500+0000", 2024-09-13T06:40:50.103 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:50.103 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:50.104 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:50.104 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:50.104 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589500+0000", 2024-09-13T06:40:50.104 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:50.104 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:50.104 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:50.104 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:50.104 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589499+0000", 2024-09-13T06:40:50.104 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:50.104 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:50.104 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:50.104 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:50.104 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589503+0000", 2024-09-13T06:40:50.104 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.8330000000000004e-06 2024-09-13T06:40:50.105 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:50.105 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:50.105 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:50.105 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589511+0000", 2024-09-13T06:40:50.105 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.3359999999999995e-06 2024-09-13T06:40:50.105 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:50.105 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:50.105 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:50.105 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589519+0000", 2024-09-13T06:40:50.105 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.4760000000000001e-06 2024-09-13T06:40:50.105 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:50.105 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:50.106 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:50.106 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.665097+0000", 2024-09-13T06:40:50.106 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.075577828999999999 2024-09-13T06:40:50.106 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:50.106 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:50.106 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:50.106 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.665170+0000", 2024-09-13T06:40:50.106 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.3745000000000006e-05 2024-09-13T06:40:50.106 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:50.106 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:50.106 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:50.106 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.665399+0000", 2024-09-13T06:40:50.106 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00022826199999999999 2024-09-13T06:40:50.106 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:50.107 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:50.107 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:50.107 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:50.107 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:50.107 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43291 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 313344~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:40:50.107 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589560+0000", 2024-09-13T06:40:50.107 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 28.492974211, 2024-09-13T06:40:50.107 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.076145594999999996, 2024-09-13T06:40:50.107 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:50.107 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:50.107 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:50.107 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:50.107 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:50.108 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43291 2024-09-13T06:40:50.108 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:50.108 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:50.108 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:50.108 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:50.108 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589560+0000", 2024-09-13T06:40:50.108 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:50.108 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:50.108 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:50.108 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:50.108 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589560+0000", 2024-09-13T06:40:50.108 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:50.108 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:50.109 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:50.109 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:50.109 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589559+0000", 2024-09-13T06:40:50.109 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:50.109 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:50.109 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:50.109 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:50.109 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589564+0000", 2024-09-13T06:40:50.109 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.3989999999999997e-06 2024-09-13T06:40:50.109 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:50.109 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:50.109 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:50.110 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589574+0000", 2024-09-13T06:40:50.110 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0502999999999999e-05 2024-09-13T06:40:50.110 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:50.110 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:50.110 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:50.110 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589582+0000", 2024-09-13T06:40:50.110 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.1859999999999992e-06 2024-09-13T06:40:50.110 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:50.110 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:50.110 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:50.110 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.665423+0000", 2024-09-13T06:40:50.110 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.075840290000000005 2024-09-13T06:40:50.110 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:50.111 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:50.111 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:50.111 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.665496+0000", 2024-09-13T06:40:50.111 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.2791000000000002e-05 2024-09-13T06:40:50.111 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:50.111 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:50.111 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:50.111 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.665706+0000", 2024-09-13T06:40:50.111 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00021038200000000001 2024-09-13T06:40:50.111 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:50.111 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:50.111 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:50.112 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:50.112 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:50.112 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43292 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 327680~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:40:50.112 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589589+0000", 2024-09-13T06:40:50.112 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 28.492945670000001, 2024-09-13T06:40:50.112 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.076769537999999998, 2024-09-13T06:40:50.112 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:50.112 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:50.112 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:50.112 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:50.112 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:50.112 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43292 2024-09-13T06:40:50.113 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:50.113 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:50.113 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:50.113 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:50.113 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589589+0000", 2024-09-13T06:40:50.113 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:50.113 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:50.113 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:50.113 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:50.113 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589589+0000", 2024-09-13T06:40:50.113 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:50.113 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:50.113 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:50.114 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:50.114 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589588+0000", 2024-09-13T06:40:50.114 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:50.114 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:50.114 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:50.114 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:50.114 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589592+0000", 2024-09-13T06:40:50.114 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.6389999999999998e-06 2024-09-13T06:40:50.114 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:50.114 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:50.114 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:50.114 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589600+0000", 2024-09-13T06:40:50.114 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.4630000000000001e-06 2024-09-13T06:40:50.115 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:50.115 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:50.115 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:50.115 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589608+0000", 2024-09-13T06:40:50.115 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.2359999999999998e-06 2024-09-13T06:40:50.115 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:50.115 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:50.115 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:50.115 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.665779+0000", 2024-09-13T06:40:50.115 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.076170924000000001 2024-09-13T06:40:50.115 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:50.115 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:50.115 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:50.115 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.665977+0000", 2024-09-13T06:40:50.116 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00019891900000000001 2024-09-13T06:40:50.116 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:50.116 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:50.116 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:50.116 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.666358+0000", 2024-09-13T06:40:50.116 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000380963 2024-09-13T06:40:50.116 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:50.116 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:50.116 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:50.116 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:50.116 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:50.116 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43293 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 342016~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:40:50.116 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589616+0000", 2024-09-13T06:40:50.116 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 28.492918776, 2024-09-13T06:40:50.116 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.077030083999999999, 2024-09-13T06:40:50.117 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:50.117 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:50.117 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:50.117 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:50.117 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:50.117 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43293 2024-09-13T06:40:50.117 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:50.117 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:50.117 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:50.117 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:50.117 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589616+0000", 2024-09-13T06:40:50.117 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:50.117 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:50.117 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:50.118 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:50.118 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589616+0000", 2024-09-13T06:40:50.118 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:50.118 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:50.118 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:50.118 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:50.118 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589615+0000", 2024-09-13T06:40:50.118 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:50.118 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:50.118 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:50.118 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:50.118 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589619+0000", 2024-09-13T06:40:50.118 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.9559999999999999e-06 2024-09-13T06:40:50.118 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:50.118 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:50.119 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:50.119 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589627+0000", 2024-09-13T06:40:50.119 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.2490000000000001e-06 2024-09-13T06:40:50.119 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:50.119 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:50.119 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:50.119 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589635+0000", 2024-09-13T06:40:50.119 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.96e-06 2024-09-13T06:40:50.119 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:50.119 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:50.119 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:50.119 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.666379+0000", 2024-09-13T06:40:50.119 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.076744484000000002 2024-09-13T06:40:50.119 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:50.119 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:50.120 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:50.120 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.666454+0000", 2024-09-13T06:40:50.120 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.4623999999999996e-05 2024-09-13T06:40:50.120 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:50.120 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:50.120 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:50.120 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.666646+0000", 2024-09-13T06:40:50.120 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00019176999999999999 2024-09-13T06:40:50.120 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:50.120 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:50.120 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:50.120 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:50.120 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:50.120 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43294 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 356352~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:40:50.121 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589681+0000", 2024-09-13T06:40:50.121 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 28.492853460999999, 2024-09-13T06:40:50.121 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.077594648000000002, 2024-09-13T06:40:50.121 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:50.121 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:50.121 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:50.121 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:50.121 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:50.121 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43294 2024-09-13T06:40:50.121 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:50.121 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:50.121 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:50.121 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:50.121 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589681+0000", 2024-09-13T06:40:50.122 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:50.122 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:50.122 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:50.122 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:50.122 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589681+0000", 2024-09-13T06:40:50.122 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:50.122 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:50.122 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:50.122 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:50.122 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589680+0000", 2024-09-13T06:40:50.122 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:50.122 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:50.122 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:50.122 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:50.123 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589684+0000", 2024-09-13T06:40:50.123 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.8369999999999999e-06 2024-09-13T06:40:50.123 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:50.123 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:50.123 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:50.123 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589693+0000", 2024-09-13T06:40:50.123 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.1020000000000003e-06 2024-09-13T06:40:50.123 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:50.123 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:50.123 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:50.123 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589701+0000", 2024-09-13T06:40:50.123 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.8059999999999995e-06 2024-09-13T06:40:50.123 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:50.123 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:50.124 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:50.124 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.666714+0000", 2024-09-13T06:40:50.124 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.077013463000000004 2024-09-13T06:40:50.124 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:50.124 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:50.124 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:50.124 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.666897+0000", 2024-09-13T06:40:50.124 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000182268 2024-09-13T06:40:50.124 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:50.124 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:50.124 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:50.124 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.667276+0000", 2024-09-13T06:40:50.124 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00037907499999999998 2024-09-13T06:40:50.125 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:50.125 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:50.125 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:50.125 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:50.125 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:50.125 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43295 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 370688~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:40:50.125 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589744+0000", 2024-09-13T06:40:50.125 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 28.492790288999998, 2024-09-13T06:40:50.125 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.077854343000000006, 2024-09-13T06:40:50.125 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:50.125 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:50.125 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:50.125 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:50.125 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:50.126 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43295 2024-09-13T06:40:50.126 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:50.126 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:50.126 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:50.126 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:50.126 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589744+0000", 2024-09-13T06:40:50.126 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:50.126 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:50.126 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:50.126 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:50.126 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589744+0000", 2024-09-13T06:40:50.126 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:50.126 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:50.126 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:50.127 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:50.127 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589743+0000", 2024-09-13T06:40:50.127 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:50.127 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:50.127 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:50.127 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:50.127 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589747+0000", 2024-09-13T06:40:50.127 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0130000000000004e-06 2024-09-13T06:40:50.127 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:50.127 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:50.127 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:50.127 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589756+0000", 2024-09-13T06:40:50.127 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.003e-06 2024-09-13T06:40:50.127 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:50.128 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:50.128 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:50.128 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589766+0000", 2024-09-13T06:40:50.128 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.2820000000000002e-06 2024-09-13T06:40:50.128 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:50.128 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:50.128 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:50.128 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.667300+0000", 2024-09-13T06:40:50.128 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.077534299000000001 2024-09-13T06:40:50.128 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:50.128 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:50.128 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:50.128 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.667372+0000", 2024-09-13T06:40:50.129 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.2393999999999998e-05 2024-09-13T06:40:50.129 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:50.129 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:50.129 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:50.129 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.667599+0000", 2024-09-13T06:40:50.129 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000226269 2024-09-13T06:40:50.129 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:50.129 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:50.129 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:50.129 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:50.129 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:50.129 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43296 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 385024~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:40:50.129 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589772+0000", 2024-09-13T06:40:50.129 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 28.492762265, 2024-09-13T06:40:50.130 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.078469647000000003, 2024-09-13T06:40:50.130 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:50.130 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:50.130 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:50.130 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:50.130 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:50.130 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43296 2024-09-13T06:40:50.130 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:50.130 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:50.130 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:50.130 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:50.130 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589772+0000", 2024-09-13T06:40:50.130 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:50.131 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:50.131 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:50.131 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:50.131 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589772+0000", 2024-09-13T06:40:50.131 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:50.131 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:50.131 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:50.131 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:50.131 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589771+0000", 2024-09-13T06:40:50.131 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:50.131 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:50.131 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:50.131 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:50.131 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589775+0000", 2024-09-13T06:40:50.131 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.8530000000000002e-06 2024-09-13T06:40:50.131 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:50.132 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:50.132 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:50.132 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589784+0000", 2024-09-13T06:40:50.132 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.4300000000000006e-06 2024-09-13T06:40:50.132 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:50.132 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:50.132 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:50.132 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589791+0000", 2024-09-13T06:40:50.132 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.4660000000000002e-06 2024-09-13T06:40:50.132 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:50.132 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:50.132 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:50.132 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.667667+0000", 2024-09-13T06:40:50.133 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.077875697999999993 2024-09-13T06:40:50.133 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:50.133 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:50.133 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:50.133 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.667854+0000", 2024-09-13T06:40:50.133 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00018760099999999999 2024-09-13T06:40:50.133 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:50.133 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:50.133 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:50.133 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.668242+0000", 2024-09-13T06:40:50.133 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00038750600000000003 2024-09-13T06:40:50.133 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:50.133 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:50.134 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:50.134 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:50.134 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:50.134 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43297 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 403456~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:40:50.134 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589797+0000", 2024-09-13T06:40:50.134 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 28.492737560999998, 2024-09-13T06:40:50.134 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.078756672999999999, 2024-09-13T06:40:50.134 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:50.134 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:50.134 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:50.134 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:50.134 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:50.135 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43297 2024-09-13T06:40:50.135 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:50.135 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:50.135 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:50.135 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:50.135 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589797+0000", 2024-09-13T06:40:50.135 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:50.135 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:50.135 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:50.135 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:50.135 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589797+0000", 2024-09-13T06:40:50.135 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:50.135 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:50.135 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:50.136 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:50.136 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589796+0000", 2024-09-13T06:40:50.136 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:50.136 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:50.136 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:50.136 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:50.136 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589800+0000", 2024-09-13T06:40:50.136 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.3230000000000002e-06 2024-09-13T06:40:50.136 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:50.136 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:50.136 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:50.137 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589808+0000", 2024-09-13T06:40:50.137 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.2390000000000002e-06 2024-09-13T06:40:50.137 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:50.137 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:50.137 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:50.137 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589815+0000", 2024-09-13T06:40:50.137 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.413e-06 2024-09-13T06:40:50.137 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:50.137 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:50.137 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:50.137 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.668265+0000", 2024-09-13T06:40:50.137 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.078449873000000003 2024-09-13T06:40:50.138 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:50.138 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:50.138 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:50.138 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.668332+0000", 2024-09-13T06:40:50.138 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.7178e-05 2024-09-13T06:40:50.138 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:50.138 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:50.138 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:50.138 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.668554+0000", 2024-09-13T06:40:50.138 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00022128600000000001 2024-09-13T06:40:50.138 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:50.138 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:50.139 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:50.139 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:50.139 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:50.139 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43298 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 417792~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:40:50.139 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589821+0000", 2024-09-13T06:40:50.139 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 28.492713438999999, 2024-09-13T06:40:50.139 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.079368660999999993, 2024-09-13T06:40:50.139 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:50.139 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:50.139 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:50.139 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:50.139 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:50.139 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43298 2024-09-13T06:40:50.139 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:50.140 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:50.140 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:50.140 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:50.140 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589821+0000", 2024-09-13T06:40:50.140 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:50.140 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:50.140 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:50.140 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:50.140 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589821+0000", 2024-09-13T06:40:50.140 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:50.140 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:50.140 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:50.141 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:50.141 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589821+0000", 2024-09-13T06:40:50.141 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:50.141 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:50.141 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:50.141 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:50.141 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589830+0000", 2024-09-13T06:40:50.141 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.4860000000000003e-06 2024-09-13T06:40:50.141 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:50.141 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:50.141 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:50.141 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589839+0000", 2024-09-13T06:40:50.141 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.0159999999999997e-06 2024-09-13T06:40:50.142 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:50.142 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:50.142 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:50.142 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589847+0000", 2024-09-13T06:40:50.142 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.6059999999999997e-06 2024-09-13T06:40:50.142 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:50.142 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:50.142 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:50.142 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.668620+0000", 2024-09-13T06:40:50.142 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.078773485000000004 2024-09-13T06:40:50.142 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:50.142 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:50.142 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:50.142 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.668798+0000", 2024-09-13T06:40:50.143 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000178233 2024-09-13T06:40:50.143 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:50.143 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:50.143 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:50.143 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.669190+0000", 2024-09-13T06:40:50.143 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00039143499999999998 2024-09-13T06:40:50.143 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:50.143 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:50.143 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:50.143 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:50.143 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:50.143 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43299 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 432128~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:40:50.143 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589881+0000", 2024-09-13T06:40:50.143 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 28.492653591, 2024-09-13T06:40:50.144 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.079693849999999997, 2024-09-13T06:40:50.144 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:50.144 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:50.144 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:50.144 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:50.144 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:50.144 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43299 2024-09-13T06:40:50.144 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:50.144 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:50.144 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:50.144 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:50.144 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589881+0000", 2024-09-13T06:40:50.144 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:50.144 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:50.145 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:50.145 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:50.145 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589881+0000", 2024-09-13T06:40:50.145 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:50.145 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:50.145 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:50.145 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:50.145 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589880+0000", 2024-09-13T06:40:50.145 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:50.145 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:50.145 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:50.145 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:50.145 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589884+0000", 2024-09-13T06:40:50.145 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.053e-06 2024-09-13T06:40:50.145 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:50.145 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:50.146 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:50.146 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589893+0000", 2024-09-13T06:40:50.146 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.2129999999999997e-06 2024-09-13T06:40:50.146 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:50.146 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:50.146 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:50.146 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589901+0000", 2024-09-13T06:40:50.146 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.6399999999999997e-06 2024-09-13T06:40:50.146 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:50.146 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:50.146 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:50.146 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.669213+0000", 2024-09-13T06:40:50.146 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.079312074999999996 2024-09-13T06:40:50.146 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:50.146 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:50.147 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:50.147 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.669281+0000", 2024-09-13T06:40:50.147 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.8322000000000001e-05 2024-09-13T06:40:50.147 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:50.147 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:50.147 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:50.147 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.669575+0000", 2024-09-13T06:40:50.147 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00029349699999999999 2024-09-13T06:40:50.147 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:50.147 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:50.147 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:50.147 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:50.147 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:50.147 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43300 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 446464~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:40:50.148 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589909+0000", 2024-09-13T06:40:50.148 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 28.492625696000001, 2024-09-13T06:40:50.148 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.080339496999999996, 2024-09-13T06:40:50.148 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:50.148 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:50.148 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:50.148 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:50.148 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:50.148 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43300 2024-09-13T06:40:50.148 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:50.148 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:50.148 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:50.148 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:50.149 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589909+0000", 2024-09-13T06:40:50.149 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:50.149 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:50.149 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:50.149 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:50.149 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589909+0000", 2024-09-13T06:40:50.149 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:50.149 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:50.149 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:50.149 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:50.149 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589908+0000", 2024-09-13T06:40:50.149 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:50.149 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:50.150 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:50.150 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:50.150 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589912+0000", 2024-09-13T06:40:50.150 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.9430000000000002e-06 2024-09-13T06:40:50.150 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:50.150 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:50.150 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:50.150 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589920+0000", 2024-09-13T06:40:50.150 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.3860000000000007e-06 2024-09-13T06:40:50.150 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:50.150 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:50.150 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:50.150 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589928+0000", 2024-09-13T06:40:50.150 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.3329999999999999e-06 2024-09-13T06:40:50.151 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:50.151 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:50.151 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:50.151 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.669651+0000", 2024-09-13T06:40:50.151 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.079723204000000006 2024-09-13T06:40:50.151 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:50.151 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:50.151 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:50.151 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.669840+0000", 2024-09-13T06:40:50.151 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000189397 2024-09-13T06:40:50.151 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:50.151 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:50.151 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:50.151 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.670248+0000", 2024-09-13T06:40:50.151 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00040811100000000001 2024-09-13T06:40:50.152 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:50.152 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:50.152 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:50.152 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:50.152 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:50.152 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43301 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 460800~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:40:50.152 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589934+0000", 2024-09-13T06:40:50.152 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 28.492601021999999, 2024-09-13T06:40:50.152 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.080747474999999999, 2024-09-13T06:40:50.152 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:50.152 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:50.152 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:50.152 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:50.152 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:50.153 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43301 2024-09-13T06:40:50.153 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:50.153 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:50.153 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:50.153 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:50.153 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589934+0000", 2024-09-13T06:40:50.153 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:50.153 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:50.153 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:50.153 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:50.153 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589934+0000", 2024-09-13T06:40:50.153 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:50.153 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:50.154 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:50.154 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:50.154 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589933+0000", 2024-09-13T06:40:50.154 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:50.154 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:50.154 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:50.154 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:50.154 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589936+0000", 2024-09-13T06:40:50.154 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.4599999999999999e-06 2024-09-13T06:40:50.154 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:50.154 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:50.154 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:50.154 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589945+0000", 2024-09-13T06:40:50.155 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.2430000000000005e-06 2024-09-13T06:40:50.155 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:50.155 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:50.155 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:50.155 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589952+0000", 2024-09-13T06:40:50.155 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.3289999999999996e-06 2024-09-13T06:40:50.155 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:50.155 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:50.155 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:50.155 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.670280+0000", 2024-09-13T06:40:50.155 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.080328514000000004 2024-09-13T06:40:50.155 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:50.155 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:50.156 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:50.156 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.670376+0000", 2024-09-13T06:40:50.156 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.5752000000000001e-05 2024-09-13T06:40:50.156 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:50.156 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:50.156 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:50.156 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.670681+0000", 2024-09-13T06:40:50.156 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00030479699999999999 2024-09-13T06:40:50.156 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:50.156 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:50.156 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:50.156 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:50.156 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:50.157 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43302 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 475136~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:40:50.157 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589958+0000", 2024-09-13T06:40:50.157 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 28.492576960000001, 2024-09-13T06:40:50.157 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.081402394000000003, 2024-09-13T06:40:50.157 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:50.157 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:50.157 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:50.157 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:50.157 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:50.157 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43302 2024-09-13T06:40:50.157 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:50.157 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:50.157 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:50.158 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:50.158 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589958+0000", 2024-09-13T06:40:50.158 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:50.158 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:50.158 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:50.158 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:50.158 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589958+0000", 2024-09-13T06:40:50.158 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:50.158 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:50.158 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:50.158 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:50.158 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589957+0000", 2024-09-13T06:40:50.158 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:50.158 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:50.159 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:50.159 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:50.159 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589960+0000", 2024-09-13T06:40:50.159 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.4939999999999999e-06 2024-09-13T06:40:50.159 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:50.159 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:50.159 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:50.159 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589969+0000", 2024-09-13T06:40:50.159 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.3520000000000007e-06 2024-09-13T06:40:50.159 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:50.159 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:50.159 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:50.159 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589976+0000", 2024-09-13T06:40:50.160 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.3030000000000002e-06 2024-09-13T06:40:50.160 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:50.160 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:50.160 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:50.160 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.670765+0000", 2024-09-13T06:40:50.160 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.080789154000000002 2024-09-13T06:40:50.160 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:50.160 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:50.160 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:50.160 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.670960+0000", 2024-09-13T06:40:50.160 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00019464300000000001 2024-09-13T06:40:50.160 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:50.160 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:50.160 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:50.161 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.671360+0000", 2024-09-13T06:40:50.161 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00040005200000000002 2024-09-13T06:40:50.161 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:50.161 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:50.161 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:50.161 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:50.161 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:50.161 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43303 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 489472~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:40:50.161 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589985+0000", 2024-09-13T06:40:50.161 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 28.492550011999999, 2024-09-13T06:40:50.161 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.082024333000000005, 2024-09-13T06:40:50.161 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:50.161 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:50.162 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:50.162 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:50.162 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:50.162 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43303 2024-09-13T06:40:50.162 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:50.162 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:50.162 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:50.162 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:50.162 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589985+0000", 2024-09-13T06:40:50.162 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:50.162 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:50.162 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:50.162 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:50.162 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589985+0000", 2024-09-13T06:40:50.163 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:50.163 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:50.163 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:50.163 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:50.163 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589984+0000", 2024-09-13T06:40:50.163 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:50.163 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:50.163 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:50.163 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:50.163 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589987+0000", 2024-09-13T06:40:50.163 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.726e-06 2024-09-13T06:40:50.163 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:50.163 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:50.164 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:50.164 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589996+0000", 2024-09-13T06:40:50.164 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.5459999999999992e-06 2024-09-13T06:40:50.164 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:50.164 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:50.164 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:50.164 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590003+0000", 2024-09-13T06:40:50.164 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.4229999999999999e-06 2024-09-13T06:40:50.164 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:50.164 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:50.165 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:50.165 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.671426+0000", 2024-09-13T06:40:50.165 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.081422704999999998 2024-09-13T06:40:50.165 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:50.165 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:50.165 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:50.165 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.671615+0000", 2024-09-13T06:40:50.165 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000188875 2024-09-13T06:40:50.165 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:50.165 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:50.165 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:50.166 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.672009+0000", 2024-09-13T06:40:50.166 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000394015 2024-09-13T06:40:50.166 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:50.166 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:50.166 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:50.166 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:50.166 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:50.166 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43304 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 503808~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:40:50.166 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.590039+0000", 2024-09-13T06:40:50.166 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 28.492495467000001, 2024-09-13T06:40:50.166 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.082573880000000002, 2024-09-13T06:40:50.166 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:50.166 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:50.166 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:50.167 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:50.167 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:50.167 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43304 2024-09-13T06:40:50.167 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:50.167 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:50.167 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:50.167 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:50.167 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590039+0000", 2024-09-13T06:40:50.167 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:50.167 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:50.167 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:50.167 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:50.167 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590039+0000", 2024-09-13T06:40:50.167 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:50.168 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:50.168 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:50.168 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:50.168 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590038+0000", 2024-09-13T06:40:50.168 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:50.168 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:50.168 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:50.168 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:50.168 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590042+0000", 2024-09-13T06:40:50.168 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.9500000000000003e-06 2024-09-13T06:40:50.168 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:50.168 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:50.168 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:50.169 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590052+0000", 2024-09-13T06:40:50.169 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.3919999999999992e-06 2024-09-13T06:40:50.169 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:50.169 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:50.169 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:50.169 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590059+0000", 2024-09-13T06:40:50.169 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.7970000000000001e-06 2024-09-13T06:40:50.169 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:50.169 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:50.169 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:50.169 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.672078+0000", 2024-09-13T06:40:50.169 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.082018778000000001 2024-09-13T06:40:50.169 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:50.169 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:50.170 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:50.170 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.672266+0000", 2024-09-13T06:40:50.170 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00018807399999999999 2024-09-13T06:40:50.170 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:50.170 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:50.170 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:50.170 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.672613+0000", 2024-09-13T06:40:50.170 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00034677599999999997 2024-09-13T06:40:50.170 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:50.170 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:50.170 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:50.170 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:50.170 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:50.170 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43305 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 518144~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:40:50.171 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.590136+0000", 2024-09-13T06:40:50.171 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 28.492398279, 2024-09-13T06:40:50.171 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.082988206999999994, 2024-09-13T06:40:50.171 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:50.171 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:50.171 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:50.171 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:50.171 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:50.171 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43305 2024-09-13T06:40:50.171 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:50.171 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:50.171 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:50.172 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:50.172 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590136+0000", 2024-09-13T06:40:50.172 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:50.172 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:50.172 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:50.172 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:50.172 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590136+0000", 2024-09-13T06:40:50.172 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:50.172 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:50.172 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:50.172 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:50.172 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590135+0000", 2024-09-13T06:40:50.172 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:50.172 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:50.173 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:50.173 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:50.173 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590139+0000", 2024-09-13T06:40:50.173 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.9489999999999998e-06 2024-09-13T06:40:50.173 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:50.173 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:50.173 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:50.173 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590148+0000", 2024-09-13T06:40:50.173 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.9830000000000002e-06 2024-09-13T06:40:50.173 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:50.173 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:50.173 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:50.173 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590156+0000", 2024-09-13T06:40:50.174 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5229999999999998e-06 2024-09-13T06:40:50.174 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:50.174 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:50.174 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:50.174 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.672709+0000", 2024-09-13T06:40:50.174 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.082552886000000006 2024-09-13T06:40:50.174 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:50.174 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:50.174 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:50.174 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.672816+0000", 2024-09-13T06:40:50.174 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000107736 2024-09-13T06:40:50.174 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:50.174 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:50.175 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:50.175 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.673124+0000", 2024-09-13T06:40:50.175 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00030804900000000002 2024-09-13T06:40:50.175 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:50.175 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:50.175 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:50.175 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:50.175 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:50.175 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:40:50.176 INFO:teuthology.orchestra.run.smithi081.stdout:osd.5: {} 2024-09-13T06:40:50.176 INFO:teuthology.orchestra.run.smithi081.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-13T06:40:50.177 INFO:teuthology.orchestra.run.smithi081.stdout:osd.6: {} 2024-09-13T06:40:50.177 INFO:teuthology.orchestra.run.smithi081.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-13T06:40:50.178 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-13T06:40:50.178 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:40:50.177+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:40:50.178 INFO:teuthology.orchestra.run.smithi081.stdout:osd.7: {} 2024-09-13T06:40:50.179 INFO:teuthology.orchestra.run.smithi081.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-13T06:40:50.277 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:40:50.277+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:40:50.337 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:40:50.337 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:40:50.351 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-13T06:40:50.395 INFO:tasks.ceph.osd.6.smithi139.stderr:2024-09-13T06:40:50.397+0000 7fcd02c5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26385) UID: 0 2024-09-13T06:40:50.475 INFO:teuthology.orchestra.run.smithi081.stderr:noscrub is set 2024-09-13T06:40:50.479 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:40:50.479+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:40:50.530 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:40:50.530 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:40:50.544 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-13T06:40:50.591 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:40:50.593+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:40:50.661 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:40:50.661 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:40:50.676 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-13T06:40:50.719 INFO:tasks.ceph.osd.6.smithi139.stderr:2024-09-13T06:40:50.721+0000 7fcd02c5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26385) UID: 0 2024-09-13T06:40:50.782 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:40:50.781+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:40:50.840 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:40:50.841 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:40:50.855 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-13T06:40:50.899 INFO:tasks.ceph.osd.6.smithi139.stderr:2024-09-13T06:40:50.901+0000 7fcd02c5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26385) UID: 0 2024-09-13T06:40:50.983 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-13T06:40:50.985+0000 7f86a5f06640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26387) UID: 0 2024-09-13T06:40:51.022 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:40:51.022 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:40:51.036 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-13T06:40:51.084 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:40:51.083+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:40:51.185 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:40:51.185+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:40:51.200 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:40:51.201 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:40:51.214 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-13T06:40:51.285 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:40:51.287+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:40:51.346 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:40:51.346 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:40:51.360 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-13T06:40:51.386 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-13T06:40:51.385+0000 7f86a5f06640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26387) UID: 0 2024-09-13T06:40:51.490 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-13T06:40:51.489+0000 7f86a5f06640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26387) UID: 0 2024-09-13T06:40:51.547 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:40:51.547 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:40:51.565 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-13T06:40:51.589 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-13T06:40:51.589+0000 7f86a5f06640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26387) UID: 0 2024-09-13T06:40:51.690 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:40:51.691+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:40:51.735 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:40:51.736 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:40:51.764 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-13T06:40:51.791 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:40:51.793+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:40:51.893 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:40:51.895+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:40:51.919 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:40:51.920 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:40:51.933 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-13T06:40:52.021 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:40:52.023+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:40:52.095 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:40:52.097+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:40:52.096 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:40:52.096 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:40:52.110 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-13T06:40:52.180 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-13T06:40:52.197 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:40:52.199+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:40:52.276 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:40:52.276 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:40:52.291 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-13T06:40:52.297 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-13T06:40:52.297+0000 7f86a5f06640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26387) UID: 0 2024-09-13T06:40:52.337 INFO:teuthology.orchestra.run.smithi081.stdout:osd.0: {} 2024-09-13T06:40:52.337 INFO:teuthology.orchestra.run.smithi081.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-13T06:40:52.353 INFO:teuthology.orchestra.run.smithi081.stdout:osd.1: {} 2024-09-13T06:40:52.353 INFO:teuthology.orchestra.run.smithi081.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-13T06:40:52.368 INFO:teuthology.orchestra.run.smithi081.stdout:osd.2: {} 2024-09-13T06:40:52.369 INFO:teuthology.orchestra.run.smithi081.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-13T06:40:52.384 INFO:teuthology.orchestra.run.smithi081.stdout:osd.3: {} 2024-09-13T06:40:52.384 INFO:teuthology.orchestra.run.smithi081.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-13T06:40:52.397 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:40:52.399+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:40:52.404 INFO:teuthology.orchestra.run.smithi081.stdout:osd.4: {} 2024-09-13T06:40:52.404 INFO:teuthology.orchestra.run.smithi081.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-13T06:40:52.414 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:40:52.414 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-13T06:40:52.414 INFO:teuthology.orchestra.run.smithi081.stdout: "num_ops": 0 2024-09-13T06:40:52.414 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:40:52.424 INFO:teuthology.orchestra.run.smithi081.stdout:osd.5: {} 2024-09-13T06:40:52.424 INFO:teuthology.orchestra.run.smithi081.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-13T06:40:52.427 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-13T06:40:52.444 INFO:teuthology.orchestra.run.smithi081.stdout:osd.6: {} 2024-09-13T06:40:52.444 INFO:teuthology.orchestra.run.smithi081.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-13T06:40:52.464 INFO:teuthology.orchestra.run.smithi081.stdout:osd.7: {} 2024-09-13T06:40:52.464 INFO:teuthology.orchestra.run.smithi081.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-13T06:40:52.492 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 6, 7] out_osds: [5] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-13T06:40:52.492 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-13T06:40:52.492 INFO:tasks.thrashosds.thrasher:Adding osd 5 2024-09-13T06:40:52.492 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd in 5 2024-09-13T06:40:52.502 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-13T06:40:52.525 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:40:52.527+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:40:52.560 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:40:52.561 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-13T06:40:52.561 INFO:teuthology.orchestra.run.smithi081.stdout: "complaint_time": 30, 2024-09-13T06:40:52.561 INFO:teuthology.orchestra.run.smithi081.stdout: "num_blocked_ops": 0 2024-09-13T06:40:52.561 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:40:52.577 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-13T06:40:52.621 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:40:52.623+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:40:52.653 INFO:teuthology.orchestra.run.smithi081.stdout:checking clone #14, image image_client.0-clone14 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent15 2024-09-13T06:40:52.700 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:40:52.699+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:40:52.747 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:40:52.748 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 20, 2024-09-13T06:40:52.748 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 600, 2024-09-13T06:40:52.748 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [ 2024-09-13T06:40:52.748 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:52.748 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:36160 3.f 3:f62782c2:::rbd_object_map.11219660270d.0000000000000016:head [call] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-13T06:40:52.748 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:01.607291+0000", 2024-09-13T06:40:52.749 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 51.140346882999999, 2024-09-13T06:40:52.749 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.99619456699999998, 2024-09-13T06:40:52.749 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:52.749 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:52.749 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:52.750 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:52.750 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:52.750 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 36160 2024-09-13T06:40:52.750 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:52.750 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:52.750 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:52.751 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:52.751 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:01.607291+0000", 2024-09-13T06:40:52.751 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:52.751 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:52.751 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:52.752 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:52.752 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:01.607291+0000", 2024-09-13T06:40:52.752 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:52.752 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:52.752 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:52.752 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:52.753 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:01.607289+0000", 2024-09-13T06:40:52.753 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999976 2024-09-13T06:40:52.753 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:52.753 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:52.753 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:52.754 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:01.607302+0000", 2024-09-13T06:40:52.754 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3018e-05 2024-09-13T06:40:52.754 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:52.754 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:52.754 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:52.754 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:01.607323+0000", 2024-09-13T06:40:52.755 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1030999999999999e-05 2024-09-13T06:40:52.755 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:52.755 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:52.755 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:52.755 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:01.607342+0000", 2024-09-13T06:40:52.756 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8961e-05 2024-09-13T06:40:52.756 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:52.756 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:52.756 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:52.756 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:01.607425+0000", 2024-09-13T06:40:52.756 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.3171999999999996e-05 2024-09-13T06:40:52.757 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:52.757 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:52.757 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:40:52.757 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:01.607441+0000", 2024-09-13T06:40:52.757 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5996999999999999e-05 2024-09-13T06:40:52.758 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:52.758 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:52.758 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:52.758 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:02.596186+0000", 2024-09-13T06:40:52.758 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.98874432000000001 2024-09-13T06:40:52.758 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:52.759 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:52.759 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for missing object", 2024-09-13T06:40:52.759 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:02.596618+0000", 2024-09-13T06:40:52.759 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000432032 2024-09-13T06:40:52.759 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:52.759 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:52.760 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:52.760 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:02.600845+0000", 2024-09-13T06:40:52.760 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0042277410000000001 2024-09-13T06:40:52.760 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:52.760 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:52.761 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:52.761 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:02.601003+0000", 2024-09-13T06:40:52.761 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00015731999999999999 2024-09-13T06:40:52.761 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:52.761 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:52.761 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:52.762 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:02.603486+0000", 2024-09-13T06:40:52.762 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0024832510000000001 2024-09-13T06:40:52.762 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:52.762 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:52.762 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:52.763 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:52.763 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:52.763 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:37806 3.9 3:951cb95b:::rbd_data.1121d8143c6e.0000000000000002:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e56)", 2024-09-13T06:40:52.763 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:06.373482+0000", 2024-09-13T06:40:52.763 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 46.374155846999997, 2024-09-13T06:40:52.763 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.002476213, 2024-09-13T06:40:52.764 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:52.764 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:52.764 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:52.764 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:52.764 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:52.765 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 37806 2024-09-13T06:40:52.765 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:52.765 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:52.765 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:52.765 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:52.765 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.373482+0000", 2024-09-13T06:40:52.766 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:52.766 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:52.766 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:52.766 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:52.766 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.373482+0000", 2024-09-13T06:40:52.766 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:52.767 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:52.767 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:52.767 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:52.767 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.373479+0000", 2024-09-13T06:40:52.767 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999962 2024-09-13T06:40:52.768 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:52.768 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:52.768 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:52.768 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.373495+0000", 2024-09-13T06:40:52.768 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6640999999999999e-05 2024-09-13T06:40:52.768 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:52.769 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:52.769 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:52.769 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.373542+0000", 2024-09-13T06:40:52.769 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6229000000000001e-05 2024-09-13T06:40:52.769 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:52.770 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:52.770 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:52.770 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.373564+0000", 2024-09-13T06:40:52.770 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2684000000000002e-05 2024-09-13T06:40:52.770 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:52.770 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:52.771 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:52.771 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374268+0000", 2024-09-13T06:40:52.771 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00070363700000000001 2024-09-13T06:40:52.771 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:52.771 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:52.772 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:40:52.772 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374305+0000", 2024-09-13T06:40:52.772 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.6936e-05 2024-09-13T06:40:52.772 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:52.772 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:52.772 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:52.773 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.375175+0000", 2024-09-13T06:40:52.773 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.000870454 2024-09-13T06:40:52.773 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:52.773 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:52.773 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:52.773 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.375678+0000", 2024-09-13T06:40:52.774 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00050292499999999999 2024-09-13T06:40:52.774 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:52.774 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:52.774 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:52.774 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.375959+0000", 2024-09-13T06:40:52.774 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00028050599999999997 2024-09-13T06:40:52.774 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:52.774 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:52.774 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:52.774 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:52.775 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:52.775 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:37821 3.9 3:951cb95b:::rbd_data.1121d8143c6e.0000000000000002:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e56)", 2024-09-13T06:40:52.775 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:06.374454+0000", 2024-09-13T06:40:52.775 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 46.373184729999998, 2024-09-13T06:40:52.775 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.002545072, 2024-09-13T06:40:52.775 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:52.775 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:52.775 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:52.775 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:52.775 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:52.775 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 37821 2024-09-13T06:40:52.776 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:52.776 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:52.776 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:52.776 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:52.776 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374454+0000", 2024-09-13T06:40:52.776 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:52.776 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:52.776 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:52.776 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:52.776 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374454+0000", 2024-09-13T06:40:52.776 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:52.776 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:52.776 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:52.777 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:52.777 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374452+0000", 2024-09-13T06:40:52.777 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999981 2024-09-13T06:40:52.777 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:52.777 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:52.777 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:52.777 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374463+0000", 2024-09-13T06:40:52.777 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0756e-05 2024-09-13T06:40:52.777 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:52.777 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:52.777 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:52.777 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374487+0000", 2024-09-13T06:40:52.777 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4887000000000001e-05 2024-09-13T06:40:52.777 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:52.778 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:52.778 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:52.778 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374504+0000", 2024-09-13T06:40:52.778 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6852000000000001e-05 2024-09-13T06:40:52.778 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:52.778 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:52.778 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:52.778 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374829+0000", 2024-09-13T06:40:52.778 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000324684 2024-09-13T06:40:52.778 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:52.778 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:52.778 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:40:52.778 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374880+0000", 2024-09-13T06:40:52.778 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.1378000000000002e-05 2024-09-13T06:40:52.779 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:52.779 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:52.779 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:52.779 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.376423+0000", 2024-09-13T06:40:52.779 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.001542734 2024-09-13T06:40:52.779 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:52.779 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:52.779 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:52.779 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.376607+0000", 2024-09-13T06:40:52.779 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000183656 2024-09-13T06:40:52.779 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:52.779 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:52.779 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:52.780 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.376999+0000", 2024-09-13T06:40:52.780 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00039191200000000001 2024-09-13T06:40:52.780 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:52.780 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:52.780 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:52.780 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:52.780 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:52.780 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:37836 3.9 3:951cb95b:::rbd_data.1121d8143c6e.0000000000000002:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e56)", 2024-09-13T06:40:52.780 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:06.374929+0000", 2024-09-13T06:40:52.780 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 46.372709078, 2024-09-13T06:40:52.780 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.002778825, 2024-09-13T06:40:52.780 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:52.780 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:52.780 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:52.781 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:52.781 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:52.781 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 37836 2024-09-13T06:40:52.781 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:52.781 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:52.781 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:52.781 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:52.781 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374929+0000", 2024-09-13T06:40:52.781 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:52.781 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:52.781 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:52.781 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:52.781 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374929+0000", 2024-09-13T06:40:52.782 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:52.782 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:52.782 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:52.782 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:52.782 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374927+0000", 2024-09-13T06:40:52.782 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999981 2024-09-13T06:40:52.782 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:52.782 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:52.782 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:52.782 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374939+0000", 2024-09-13T06:40:52.782 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1846e-05 2024-09-13T06:40:52.782 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:52.782 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:52.783 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:52.783 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374962+0000", 2024-09-13T06:40:52.783 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3054e-05 2024-09-13T06:40:52.783 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:52.783 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:52.783 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:52.783 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374978+0000", 2024-09-13T06:40:52.783 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5899000000000001e-05 2024-09-13T06:40:52.784 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:52.784 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:52.784 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:52.784 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.375106+0000", 2024-09-13T06:40:52.784 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00012789 2024-09-13T06:40:52.785 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:52.785 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:52.785 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:40:52.785 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.375134+0000", 2024-09-13T06:40:52.785 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.8254000000000001e-05 2024-09-13T06:40:52.785 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:52.785 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:52.785 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:52.785 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.377082+0000", 2024-09-13T06:40:52.785 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0019471520000001 2024-09-13T06:40:52.785 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:52.786 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:52.786 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:52.786 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.377330+0000", 2024-09-13T06:40:52.786 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00024834199999999997 2024-09-13T06:40:52.786 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:52.786 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:52.786 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:52.786 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.377708+0000", 2024-09-13T06:40:52.787 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00037817100000000001 2024-09-13T06:40:52.787 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:52.787 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:52.787 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:52.787 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:52.787 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:52.787 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:37851 3.9 3:951cb95b:::rbd_data.1121d8143c6e.0000000000000002:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e56)", 2024-09-13T06:40:52.787 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:06.382636+0000", 2024-09-13T06:40:52.787 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 46.365002193000002, 2024-09-13T06:40:52.787 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.99582539400000003, 2024-09-13T06:40:52.787 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:52.787 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:52.787 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:52.788 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:52.788 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:52.788 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 37851 2024-09-13T06:40:52.788 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:52.788 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:52.788 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:52.788 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:52.788 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.382636+0000", 2024-09-13T06:40:52.788 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:52.788 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:52.788 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:52.788 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:52.788 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.382636+0000", 2024-09-13T06:40:52.789 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:52.789 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:52.789 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:52.789 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:52.789 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.382633+0000", 2024-09-13T06:40:52.789 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999971 2024-09-13T06:40:52.789 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:52.789 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:52.789 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:52.789 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.382652+0000", 2024-09-13T06:40:52.789 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8834999999999998e-05 2024-09-13T06:40:52.789 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:52.789 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:52.790 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:52.790 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.382695+0000", 2024-09-13T06:40:52.790 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.3136000000000002e-05 2024-09-13T06:40:52.790 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:52.790 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:52.790 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:52.790 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.382716+0000", 2024-09-13T06:40:52.790 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1421e-05 2024-09-13T06:40:52.790 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:52.790 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:52.790 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:52.790 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.382860+0000", 2024-09-13T06:40:52.790 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00014389200000000001 2024-09-13T06:40:52.790 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:52.791 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:52.791 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:40:52.791 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.382890+0000", 2024-09-13T06:40:52.791 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9827000000000001e-05 2024-09-13T06:40:52.791 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:52.791 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:52.791 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:52.791 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.377779+0000", 2024-09-13T06:40:52.791 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.99488842899999996 2024-09-13T06:40:52.791 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:52.791 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:52.791 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:52.791 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.378007+0000", 2024-09-13T06:40:52.792 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00022838099999999999 2024-09-13T06:40:52.792 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:52.792 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:52.792 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:52.792 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.378462+0000", 2024-09-13T06:40:52.792 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00045452300000000003 2024-09-13T06:40:52.792 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:52.792 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:52.792 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:52.792 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:52.792 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:52.792 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:37866 3.9 3:951cb95b:::rbd_data.1121d8143c6e.0000000000000002:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e56)", 2024-09-13T06:40:52.792 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:06.383951+0000", 2024-09-13T06:40:52.793 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 46.363687507000002, 2024-09-13T06:40:52.793 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.99517962299999996, 2024-09-13T06:40:52.793 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:52.793 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:52.793 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:52.793 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:52.793 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:52.793 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 37866 2024-09-13T06:40:52.793 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:52.793 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:52.793 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:52.793 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:52.793 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.383951+0000", 2024-09-13T06:40:52.793 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:52.794 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:52.794 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:52.794 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:52.794 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.383951+0000", 2024-09-13T06:40:52.794 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:52.794 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:52.794 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:52.794 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:52.794 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.383949+0000", 2024-09-13T06:40:52.794 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999981 2024-09-13T06:40:52.794 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:52.794 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:52.794 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:52.794 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.383961+0000", 2024-09-13T06:40:52.794 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1999e-05 2024-09-13T06:40:52.795 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:52.795 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:52.795 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:52.795 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384019+0000", 2024-09-13T06:40:52.795 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7621000000000003e-05 2024-09-13T06:40:52.795 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:52.795 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:52.795 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:52.795 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384040+0000", 2024-09-13T06:40:52.795 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1528000000000001e-05 2024-09-13T06:40:52.795 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:52.795 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:52.795 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:52.795 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384186+0000", 2024-09-13T06:40:52.795 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00014573799999999999 2024-09-13T06:40:52.796 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:52.796 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:52.796 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:40:52.796 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384204+0000", 2024-09-13T06:40:52.796 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7992e-05 2024-09-13T06:40:52.796 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:52.796 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:52.796 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:52.796 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.378536+0000", 2024-09-13T06:40:52.796 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.99433268600000002 2024-09-13T06:40:52.796 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:52.796 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:52.796 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:52.796 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.378771+0000", 2024-09-13T06:40:52.797 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00023445399999999999 2024-09-13T06:40:52.797 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:52.797 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:52.797 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:52.797 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.379130+0000", 2024-09-13T06:40:52.797 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00035954200000000002 2024-09-13T06:40:52.797 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:52.797 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:52.797 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:52.797 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:52.797 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:52.797 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:37881 3.9 3:951cb95b:::rbd_data.1121d8143c6e.0000000000000002:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e56)", 2024-09-13T06:40:52.797 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:06.384239+0000", 2024-09-13T06:40:52.797 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 46.363399092999998, 2024-09-13T06:40:52.798 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.99541483500000005, 2024-09-13T06:40:52.798 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:52.798 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:52.798 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:52.798 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:52.798 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:52.798 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 37881 2024-09-13T06:40:52.798 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:52.798 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:52.798 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:52.798 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:52.798 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384239+0000", 2024-09-13T06:40:52.798 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:52.798 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:52.798 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:52.799 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:52.799 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384239+0000", 2024-09-13T06:40:52.799 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:52.799 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:52.799 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:52.799 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:52.799 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384238+0000", 2024-09-13T06:40:52.799 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999986 2024-09-13T06:40:52.799 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:52.799 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:52.799 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:52.799 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384246+0000", 2024-09-13T06:40:52.799 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.2449999999999998e-06 2024-09-13T06:40:52.799 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:52.799 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:52.800 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:52.800 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384268+0000", 2024-09-13T06:40:52.800 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1518e-05 2024-09-13T06:40:52.800 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:52.800 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:52.800 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:52.801 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384282+0000", 2024-09-13T06:40:52.801 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4501999999999999e-05 2024-09-13T06:40:52.801 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:52.801 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:52.801 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:52.801 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384356+0000", 2024-09-13T06:40:52.801 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4265999999999997e-05 2024-09-13T06:40:52.801 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:52.801 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:52.801 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:40:52.801 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384370+0000", 2024-09-13T06:40:52.801 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3942e-05 2024-09-13T06:40:52.801 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:52.802 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:52.802 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:52.802 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.379199+0000", 2024-09-13T06:40:52.802 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.99482866599999997 2024-09-13T06:40:52.802 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:52.802 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:52.802 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:52.802 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.379347+0000", 2024-09-13T06:40:52.802 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00014749199999999999 2024-09-13T06:40:52.802 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:52.802 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:52.802 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:52.802 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.379654+0000", 2024-09-13T06:40:52.803 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00030752999999999998 2024-09-13T06:40:52.803 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:52.803 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:52.803 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:52.803 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:52.803 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:52.803 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:37896 3.9 3:951cb95b:::rbd_data.1121d8143c6e.0000000000000002:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e56)", 2024-09-13T06:40:52.803 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:06.384412+0000", 2024-09-13T06:40:52.803 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 46.363226660000002, 2024-09-13T06:40:52.803 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.99777835999999998, 2024-09-13T06:40:52.803 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:52.803 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:52.803 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:52.803 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:52.803 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:52.804 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 37896 2024-09-13T06:40:52.804 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:52.804 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:52.804 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:52.804 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:52.804 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384412+0000", 2024-09-13T06:40:52.804 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:52.804 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:52.804 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:52.804 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:52.804 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384412+0000", 2024-09-13T06:40:52.804 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:52.804 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:52.804 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:52.804 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:52.805 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384410+0000", 2024-09-13T06:40:52.805 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.999999 2024-09-13T06:40:52.805 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:52.805 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:52.805 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:52.805 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384418+0000", 2024-09-13T06:40:52.805 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.486e-06 2024-09-13T06:40:52.805 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:52.805 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:52.805 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:52.805 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384436+0000", 2024-09-13T06:40:52.805 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7668000000000001e-05 2024-09-13T06:40:52.805 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:52.805 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:52.805 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:52.806 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384449+0000", 2024-09-13T06:40:52.806 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3395e-05 2024-09-13T06:40:52.806 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:52.806 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:52.806 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:52.806 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384605+0000", 2024-09-13T06:40:52.806 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00015563099999999999 2024-09-13T06:40:52.806 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:52.806 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:52.806 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:40:52.806 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384635+0000", 2024-09-13T06:40:52.806 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.0383999999999999e-05 2024-09-13T06:40:52.806 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:52.807 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:52.807 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:52.807 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.379730+0000", 2024-09-13T06:40:52.807 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.99509493999999998 2024-09-13T06:40:52.807 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:52.807 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:52.807 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:52.807 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.379964+0000", 2024-09-13T06:40:52.807 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00023353499999999999 2024-09-13T06:40:52.807 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:52.807 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:52.807 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:52.807 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.382190+0000", 2024-09-13T06:40:52.808 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0022265039999999998 2024-09-13T06:40:52.808 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:52.808 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:52.808 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:52.808 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:52.808 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:52.808 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43222 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 389120~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:40:52.808 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558181+0000", 2024-09-13T06:40:52.808 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 31.189457405999999, 2024-09-13T06:40:52.808 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.06252038, 2024-09-13T06:40:52.808 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:52.808 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:52.809 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:52.809 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:52.809 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:52.809 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43222 2024-09-13T06:40:52.809 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:52.809 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:52.809 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:52.809 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:52.809 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558181+0000", 2024-09-13T06:40:52.810 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:52.810 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:52.810 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:52.810 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:52.810 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558181+0000", 2024-09-13T06:40:52.810 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:52.810 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:52.810 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:52.810 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:52.810 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558181+0000", 2024-09-13T06:40:52.810 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:52.810 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:52.810 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:52.811 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:52.811 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558183+0000", 2024-09-13T06:40:52.811 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.857e-06 2024-09-13T06:40:52.811 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:52.811 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:52.811 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:52.811 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558188+0000", 2024-09-13T06:40:52.811 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3759999999999999e-06 2024-09-13T06:40:52.811 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:52.811 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:52.811 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:52.811 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558261+0000", 2024-09-13T06:40:52.811 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3097999999999997e-05 2024-09-13T06:40:52.812 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:52.812 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:52.812 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:52.812 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.620354+0000", 2024-09-13T06:40:52.812 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.062092587999999997 2024-09-13T06:40:52.812 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:52.812 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:52.812 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:52.812 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.620428+0000", 2024-09-13T06:40:52.812 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3954000000000004e-05 2024-09-13T06:40:52.812 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:52.812 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:52.813 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:52.813 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.620701+0000", 2024-09-13T06:40:52.813 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000273773 2024-09-13T06:40:52.813 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:52.813 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:52.813 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:52.813 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:52.813 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:52.813 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43223 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 393216~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:40:52.813 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558267+0000", 2024-09-13T06:40:52.813 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 31.189371349000002, 2024-09-13T06:40:52.813 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.062813151999999997, 2024-09-13T06:40:52.813 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:52.814 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:52.814 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:52.814 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:52.814 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:52.814 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43223 2024-09-13T06:40:52.814 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:52.814 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:52.814 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:52.814 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:52.814 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558267+0000", 2024-09-13T06:40:52.814 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:52.814 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:52.814 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:52.815 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:52.815 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558267+0000", 2024-09-13T06:40:52.815 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:52.815 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:52.815 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:52.815 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:52.815 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558266+0000", 2024-09-13T06:40:52.815 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:52.815 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:52.815 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:52.815 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:52.815 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558270+0000", 2024-09-13T06:40:52.815 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.2389999999999998e-06 2024-09-13T06:40:52.815 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:52.815 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:52.816 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:52.816 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558277+0000", 2024-09-13T06:40:52.816 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5680000000000002e-06 2024-09-13T06:40:52.816 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:52.816 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:52.816 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:52.816 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558282+0000", 2024-09-13T06:40:52.816 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7060000000000003e-06 2024-09-13T06:40:52.816 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:52.817 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:52.817 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:52.817 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.620731+0000", 2024-09-13T06:40:52.817 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.062448661000000003 2024-09-13T06:40:52.817 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:52.817 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:52.817 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:52.818 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.620806+0000", 2024-09-13T06:40:52.818 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5862e-05 2024-09-13T06:40:52.818 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:52.818 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:52.818 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:52.818 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.621080+0000", 2024-09-13T06:40:52.818 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00027368599999999998 2024-09-13T06:40:52.818 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:52.818 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:52.818 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:52.818 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:52.818 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:52.818 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43224 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 407552~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:40:52.819 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558286+0000", 2024-09-13T06:40:52.819 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 31.189351984999998, 2024-09-13T06:40:52.819 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.063179052999999999, 2024-09-13T06:40:52.819 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:52.819 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:52.819 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:52.819 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:52.819 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:52.819 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43224 2024-09-13T06:40:52.819 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:52.819 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:52.819 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:52.819 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:52.819 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558286+0000", 2024-09-13T06:40:52.820 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:52.820 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:52.820 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:52.820 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:52.820 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558286+0000", 2024-09-13T06:40:52.820 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:52.820 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:52.820 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:52.820 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:52.820 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558286+0000", 2024-09-13T06:40:52.820 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:52.820 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:52.821 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:52.821 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:52.821 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558288+0000", 2024-09-13T06:40:52.821 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.227e-06 2024-09-13T06:40:52.821 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:52.821 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:52.821 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:52.821 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558292+0000", 2024-09-13T06:40:52.821 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.6289999999999999e-06 2024-09-13T06:40:52.821 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:52.821 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:52.821 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:52.821 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558294+0000", 2024-09-13T06:40:52.821 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5409999999999999e-06 2024-09-13T06:40:52.822 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:52.822 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:52.822 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:52.822 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.621110+0000", 2024-09-13T06:40:52.822 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.062815776000000004 2024-09-13T06:40:52.822 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:52.822 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:52.822 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:52.822 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.621186+0000", 2024-09-13T06:40:52.822 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5570999999999999e-05 2024-09-13T06:40:52.822 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:52.822 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:52.822 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:52.822 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.621465+0000", 2024-09-13T06:40:52.823 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00027988200000000001 2024-09-13T06:40:52.823 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:52.823 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:52.823 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:52.823 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:52.823 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:52.823 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43225 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 421888~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:40:52.823 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558296+0000", 2024-09-13T06:40:52.823 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 31.189342018000001, 2024-09-13T06:40:52.823 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.063551110999999993, 2024-09-13T06:40:52.823 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:52.823 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:52.823 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:52.824 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:52.824 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:52.824 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43225 2024-09-13T06:40:52.824 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:52.824 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:52.824 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:52.824 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:52.824 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558296+0000", 2024-09-13T06:40:52.824 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:52.824 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:52.824 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:52.824 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:52.824 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558296+0000", 2024-09-13T06:40:52.825 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:52.825 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:52.825 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:52.825 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:52.825 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558296+0000", 2024-09-13T06:40:52.825 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:40:52.825 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:52.825 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:52.825 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:52.825 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558305+0000", 2024-09-13T06:40:52.825 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.5290000000000008e-06 2024-09-13T06:40:52.825 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:52.826 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:52.826 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:52.826 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558308+0000", 2024-09-13T06:40:52.826 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.5619999999999999e-06 2024-09-13T06:40:52.826 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:52.826 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:52.826 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:52.826 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558311+0000", 2024-09-13T06:40:52.826 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.43e-06 2024-09-13T06:40:52.826 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:52.826 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:52.826 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:52.827 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.621495+0000", 2024-09-13T06:40:52.827 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.063184289000000005 2024-09-13T06:40:52.827 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:52.827 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:52.827 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:52.827 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.621569+0000", 2024-09-13T06:40:52.827 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4250000000000002e-05 2024-09-13T06:40:52.827 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:52.827 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:52.827 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:52.827 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.621847+0000", 2024-09-13T06:40:52.827 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00027826400000000002 2024-09-13T06:40:52.828 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:52.828 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:52.828 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:52.828 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:52.828 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:52.828 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43226 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 436224~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:40:52.828 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558313+0000", 2024-09-13T06:40:52.828 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 31.189325382, 2024-09-13T06:40:52.828 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.063914420999999999, 2024-09-13T06:40:52.828 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:52.828 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:52.828 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:52.828 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:52.829 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:52.829 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43226 2024-09-13T06:40:52.829 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:52.829 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:52.829 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:52.829 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:52.829 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558313+0000", 2024-09-13T06:40:52.829 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:52.829 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:52.829 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:52.829 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:52.829 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558313+0000", 2024-09-13T06:40:52.830 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:52.830 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:52.830 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:52.830 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:52.830 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558313+0000", 2024-09-13T06:40:52.830 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:52.830 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:52.830 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:52.830 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:52.830 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558314+0000", 2024-09-13T06:40:52.830 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3740000000000001e-06 2024-09-13T06:40:52.830 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:52.830 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:52.830 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:52.831 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558317+0000", 2024-09-13T06:40:52.831 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9730000000000002e-06 2024-09-13T06:40:52.831 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:52.831 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:52.831 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:52.831 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558319+0000", 2024-09-13T06:40:52.831 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4059999999999999e-06 2024-09-13T06:40:52.831 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:52.831 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:52.831 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:52.831 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.621877+0000", 2024-09-13T06:40:52.831 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.063557408999999995 2024-09-13T06:40:52.831 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:52.831 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:52.832 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:52.832 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.621951+0000", 2024-09-13T06:40:52.832 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4487999999999996e-05 2024-09-13T06:40:52.832 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:52.832 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:52.832 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:52.832 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.622227+0000", 2024-09-13T06:40:52.832 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000276011 2024-09-13T06:40:52.832 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:52.832 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:52.832 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:52.832 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:52.832 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:52.833 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43227 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 450560~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:40:52.833 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558322+0000", 2024-09-13T06:40:52.833 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 31.189316801, 2024-09-13T06:40:52.833 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.064285348000000006, 2024-09-13T06:40:52.833 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:52.834 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:52.834 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:52.834 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:52.834 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:52.834 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43227 2024-09-13T06:40:52.834 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:52.834 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:52.834 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:52.834 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:52.834 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558322+0000", 2024-09-13T06:40:52.834 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:52.835 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:52.835 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:52.835 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:52.835 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558322+0000", 2024-09-13T06:40:52.835 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:52.835 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:52.835 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:52.835 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:52.835 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558321+0000", 2024-09-13T06:40:52.835 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:40:52.835 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:52.835 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:52.835 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:52.835 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558323+0000", 2024-09-13T06:40:52.836 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.576e-06 2024-09-13T06:40:52.836 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:52.836 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:52.836 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:52.836 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558328+0000", 2024-09-13T06:40:52.836 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0719999999999999e-06 2024-09-13T06:40:52.836 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:52.836 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:52.836 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:52.836 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558332+0000", 2024-09-13T06:40:52.836 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.8130000000000002e-06 2024-09-13T06:40:52.836 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:52.837 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:52.837 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:52.837 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.622255+0000", 2024-09-13T06:40:52.837 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.063923195000000002 2024-09-13T06:40:52.837 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:52.837 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:52.837 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:52.837 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.622330+0000", 2024-09-13T06:40:52.837 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5383000000000007e-05 2024-09-13T06:40:52.837 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:52.837 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:52.837 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:52.837 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.622607+0000", 2024-09-13T06:40:52.838 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00027651999999999999 2024-09-13T06:40:52.838 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:52.838 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:52.838 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:52.838 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:52.838 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:52.838 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43228 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 464896~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:40:52.838 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558335+0000", 2024-09-13T06:40:52.838 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 31.189302892000001, 2024-09-13T06:40:52.838 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.064652253000000007, 2024-09-13T06:40:52.838 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:52.838 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:52.838 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:52.838 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:52.839 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:52.839 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43228 2024-09-13T06:40:52.839 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:52.839 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:52.839 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:52.839 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:52.839 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558335+0000", 2024-09-13T06:40:52.839 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:52.839 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:52.839 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:52.839 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:52.839 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558335+0000", 2024-09-13T06:40:52.840 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:52.840 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:52.840 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:52.840 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:52.840 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558335+0000", 2024-09-13T06:40:52.840 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:52.840 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:52.840 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:52.840 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:52.840 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558337+0000", 2024-09-13T06:40:52.840 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1380000000000001e-06 2024-09-13T06:40:52.840 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:52.840 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:52.841 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:52.841 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558343+0000", 2024-09-13T06:40:52.841 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.5140000000000001e-06 2024-09-13T06:40:52.841 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:52.841 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:52.841 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:52.841 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558348+0000", 2024-09-13T06:40:52.841 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9640000000000002e-06 2024-09-13T06:40:52.841 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:52.841 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:52.841 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:52.841 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.622636+0000", 2024-09-13T06:40:52.841 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.064288260999999999 2024-09-13T06:40:52.841 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:52.842 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:52.842 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:52.842 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.622715+0000", 2024-09-13T06:40:52.842 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.9351000000000006e-05 2024-09-13T06:40:52.842 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:52.842 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:52.842 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:52.842 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.622988+0000", 2024-09-13T06:40:52.842 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00027242599999999998 2024-09-13T06:40:52.842 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:52.842 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:52.842 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:52.842 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:52.842 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:52.843 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43229 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 479232~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:40:52.843 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558352+0000", 2024-09-13T06:40:52.843 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 31.189286477, 2024-09-13T06:40:52.843 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.065018024999999993, 2024-09-13T06:40:52.843 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:52.843 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:52.843 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:52.843 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:52.843 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:52.843 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43229 2024-09-13T06:40:52.843 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:52.843 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:52.844 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:52.844 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:52.844 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558352+0000", 2024-09-13T06:40:52.844 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:52.844 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:52.845 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:52.845 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:52.845 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558352+0000", 2024-09-13T06:40:52.845 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:52.845 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:52.845 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:52.845 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:52.845 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558352+0000", 2024-09-13T06:40:52.845 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:52.845 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:52.845 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:52.846 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:52.846 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558354+0000", 2024-09-13T06:40:52.846 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4930000000000001e-06 2024-09-13T06:40:52.846 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:52.846 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:52.846 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:52.846 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558360+0000", 2024-09-13T06:40:52.846 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.263e-06 2024-09-13T06:40:52.846 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:52.846 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:52.846 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:52.846 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558369+0000", 2024-09-13T06:40:52.846 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.0829999999999993e-06 2024-09-13T06:40:52.846 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:52.846 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:52.847 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:52.847 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.623017+0000", 2024-09-13T06:40:52.847 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.064647799000000006 2024-09-13T06:40:52.847 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:52.847 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:52.847 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:52.847 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.623090+0000", 2024-09-13T06:40:52.847 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3071000000000006e-05 2024-09-13T06:40:52.847 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:52.847 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:52.847 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:52.847 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.623370+0000", 2024-09-13T06:40:52.847 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000279661 2024-09-13T06:40:52.847 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:52.848 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:52.848 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:52.848 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:52.848 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:52.848 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43230 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 493568~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:40:52.848 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558374+0000", 2024-09-13T06:40:52.848 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 31.189264183999999, 2024-09-13T06:40:52.848 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.065410435000000003, 2024-09-13T06:40:52.848 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:52.848 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:52.848 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:52.848 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:52.848 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:52.848 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43230 2024-09-13T06:40:52.849 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:52.849 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:52.849 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:52.849 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:52.849 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558374+0000", 2024-09-13T06:40:52.849 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:52.849 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:52.849 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:52.849 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:52.849 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558374+0000", 2024-09-13T06:40:52.849 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:52.849 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:52.849 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:52.850 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:52.850 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558374+0000", 2024-09-13T06:40:52.850 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:52.850 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:52.850 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:52.850 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:52.850 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558376+0000", 2024-09-13T06:40:52.850 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4430000000000002e-06 2024-09-13T06:40:52.850 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:52.850 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:52.850 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:52.850 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558382+0000", 2024-09-13T06:40:52.850 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3029999999999996e-06 2024-09-13T06:40:52.850 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:52.851 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:52.851 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:52.851 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558387+0000", 2024-09-13T06:40:52.851 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.1699999999999999e-06 2024-09-13T06:40:52.851 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:52.851 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:52.851 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:52.851 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.623400+0000", 2024-09-13T06:40:52.851 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.065013244999999997 2024-09-13T06:40:52.851 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:52.851 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:52.851 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:52.851 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.623474+0000", 2024-09-13T06:40:52.851 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3889999999999999e-05 2024-09-13T06:40:52.851 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:52.852 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:52.852 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:52.852 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.623785+0000", 2024-09-13T06:40:52.852 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00031080099999999998 2024-09-13T06:40:52.852 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:52.852 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:52.852 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:52.852 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:52.852 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:52.852 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43231 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 507904~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:40:52.852 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558391+0000", 2024-09-13T06:40:52.852 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 31.189247499, 2024-09-13T06:40:52.852 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.065788597000000004, 2024-09-13T06:40:52.853 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:52.853 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:52.853 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:52.853 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:52.853 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:52.853 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43231 2024-09-13T06:40:52.853 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:52.853 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:52.853 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:52.853 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:52.853 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558391+0000", 2024-09-13T06:40:52.853 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:52.853 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:52.853 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:52.854 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:52.854 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558391+0000", 2024-09-13T06:40:52.854 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:52.854 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:52.854 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:52.854 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:52.854 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558390+0000", 2024-09-13T06:40:52.854 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:52.854 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:52.854 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:52.854 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:52.854 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558393+0000", 2024-09-13T06:40:52.854 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2570000000000002e-06 2024-09-13T06:40:52.855 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:52.855 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:52.855 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:52.855 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558399+0000", 2024-09-13T06:40:52.855 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0419999999999999e-06 2024-09-13T06:40:52.855 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:52.855 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:52.855 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:52.855 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558403+0000", 2024-09-13T06:40:52.855 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6249999999999998e-06 2024-09-13T06:40:52.855 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:52.855 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:52.855 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:52.855 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.623811+0000", 2024-09-13T06:40:52.856 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.065407549999999995 2024-09-13T06:40:52.856 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:52.856 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:52.856 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:52.856 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.623877+0000", 2024-09-13T06:40:52.856 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.5902999999999996e-05 2024-09-13T06:40:52.856 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:52.856 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:52.856 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:52.856 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.624179+0000", 2024-09-13T06:40:52.856 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00030259999999999998 2024-09-13T06:40:52.856 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:52.856 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:52.856 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:52.857 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:52.857 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:52.857 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43232 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 522240~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:40:52.857 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558422+0000", 2024-09-13T06:40:52.857 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 31.189216722000001, 2024-09-13T06:40:52.857 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.066176061999999994, 2024-09-13T06:40:52.857 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:52.857 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:52.857 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:52.857 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:52.857 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:52.857 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43232 2024-09-13T06:40:52.858 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:52.858 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:52.858 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:52.858 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:52.858 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558422+0000", 2024-09-13T06:40:52.858 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:52.858 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:52.858 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:52.858 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:52.858 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558422+0000", 2024-09-13T06:40:52.858 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:52.859 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:52.859 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:52.859 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:52.859 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558421+0000", 2024-09-13T06:40:52.859 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:52.859 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:52.859 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:52.859 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:52.859 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558428+0000", 2024-09-13T06:40:52.859 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.1690000000000003e-06 2024-09-13T06:40:52.859 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:52.859 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:52.859 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:52.860 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558434+0000", 2024-09-13T06:40:52.860 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9309999999999996e-06 2024-09-13T06:40:52.860 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:52.860 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:52.860 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:52.860 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558447+0000", 2024-09-13T06:40:52.860 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.271e-05 2024-09-13T06:40:52.860 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:52.860 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:52.860 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:52.860 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.624209+0000", 2024-09-13T06:40:52.860 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.065762102000000003 2024-09-13T06:40:52.860 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:52.860 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:52.861 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:52.861 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.624282+0000", 2024-09-13T06:40:52.861 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.2889e-05 2024-09-13T06:40:52.861 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:52.861 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:52.861 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:52.861 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.624598+0000", 2024-09-13T06:40:52.861 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00031591399999999998 2024-09-13T06:40:52.861 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:52.861 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:52.861 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:52.861 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:52.861 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:52.862 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43486 3.f 3:f7da9c8f:::rbd_data.1121f5f2e1c0.000000000000000b:1f [read 260096~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:40:52.862 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.569088+0000", 2024-09-13T06:40:52.862 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 31.178549999000001, 2024-09-13T06:40:52.862 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.062579223000000003, 2024-09-13T06:40:52.862 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:52.862 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:52.862 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:52.862 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:52.862 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:52.862 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43486 2024-09-13T06:40:52.862 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:52.862 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:52.862 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:52.863 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:52.863 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.569088+0000", 2024-09-13T06:40:52.863 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:52.863 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:52.863 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:52.863 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:52.863 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.569088+0000", 2024-09-13T06:40:52.863 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:52.863 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:52.863 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:52.863 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:52.863 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.569088+0000", 2024-09-13T06:40:52.863 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:52.863 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:52.863 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:52.864 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:52.864 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.569091+0000", 2024-09-13T06:40:52.864 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9629999999999998e-06 2024-09-13T06:40:52.864 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:52.864 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:52.864 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:52.864 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.569097+0000", 2024-09-13T06:40:52.864 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.4160000000000001e-06 2024-09-13T06:40:52.864 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:52.864 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:52.864 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:52.864 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.569102+0000", 2024-09-13T06:40:52.864 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6659999999999999e-06 2024-09-13T06:40:52.865 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:52.865 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:52.865 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:52.865 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.631346+0000", 2024-09-13T06:40:52.865 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.062243896 2024-09-13T06:40:52.865 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:52.865 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:52.865 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:52.865 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.631413+0000", 2024-09-13T06:40:52.865 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.7638000000000005e-05 2024-09-13T06:40:52.865 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:52.865 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:52.866 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:52.866 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.631668+0000", 2024-09-13T06:40:52.866 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0002541 2024-09-13T06:40:52.866 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:52.866 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:52.866 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:52.866 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:52.866 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:52.866 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:40:52.867 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-13T06:40:52.868 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:40:52.869+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:40:52.908 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-13T06:40:52.907+0000 7fcdeb9fe640 -1 mon.a@0(leader).osd e99 definitely_dead 0 2024-09-13T06:40:52.968 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:40:52.967+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:40:53.030 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:40:53.030 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-13T06:40:53.030 INFO:teuthology.orchestra.run.smithi081.stdout: "num_ops": 0 2024-09-13T06:40:53.030 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:40:53.043 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-13T06:40:53.069 INFO:tasks.ceph.osd.6.smithi139.stderr:2024-09-13T06:40:53.069+0000 7fcd02c5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26385) UID: 0 2024-09-13T06:40:53.107 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:40:53.107 INFO:teuthology.orchestra.run.smithi081.stdout:2506 write 0x86d2d6c thru 0x86e0b9c (0xde31 bytes) 2024-09-13T06:40:53.119 INFO:teuthology.orchestra.run.smithi081.stdout:2509 read 0x7ebf95 thru 0x7eca89 (0xaf5 bytes) 2024-09-13T06:40:53.119 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:40:53.119 INFO:teuthology.orchestra.run.smithi081.stdout:2511 writesame 0x12847e7 thru 0x1287ba6 data_size 0x40(0x33c0 bytes) 2024-09-13T06:40:53.133 INFO:teuthology.orchestra.run.smithi081.stdout:2513 trunc from 0xb335ca6 to 0x253578c 2024-09-13T06:40:53.162 INFO:teuthology.orchestra.run.smithi081.stdout:2514 punch from 0xba27f1 to 0xbac29d, (0x9aac bytes) 2024-09-13T06:40:53.169 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:40:53.169+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:40:53.174 INFO:teuthology.orchestra.run.smithi081.stdout:2521 write 0x3bf5449 thru 0x3bf6a0e (0x15c6 bytes) 2024-09-13T06:40:53.179 INFO:teuthology.orchestra.run.smithi081.stdout:2523 write 0x1810daa thru 0x181fd21 (0xef78 bytes) 2024-09-13T06:40:53.205 INFO:teuthology.orchestra.run.smithi081.stdout:2524 write 0x8368421 thru 0x83773fd (0xefdd bytes) 2024-09-13T06:40:53.207 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:40:53.207 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-13T06:40:53.207 INFO:teuthology.orchestra.run.smithi081.stdout: "complaint_time": 30, 2024-09-13T06:40:53.207 INFO:teuthology.orchestra.run.smithi081.stdout: "num_blocked_ops": 0 2024-09-13T06:40:53.207 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:40:53.222 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-13T06:40:53.227 INFO:teuthology.orchestra.run.smithi081.stdout:2525 write 0x8c62e23 thru 0x8c6ae1c (0x7ffa bytes) 2024-09-13T06:40:53.253 INFO:teuthology.orchestra.run.smithi081.stdout:2526 write 0xdc72fe9 thru 0xdc75b01 (0x2b19 bytes) 2024-09-13T06:40:53.258 INFO:teuthology.orchestra.run.smithi081.stdout:2527 read 0x290618c thru 0x290d41c (0x7291 bytes) 2024-09-13T06:40:53.258 INFO:teuthology.orchestra.run.smithi081.stdout:2528 write 0xae01c3c thru 0xae0e5f6 (0xc9bb bytes) 2024-09-13T06:40:53.261 INFO:teuthology.orchestra.run.smithi081.stdout:2529 read 0x56a7de4 thru 0x56a9c88 (0x1ea5 bytes) 2024-09-13T06:40:53.261 INFO:teuthology.orchestra.run.smithi081.stdout:2530 writesame 0x26772c0 thru 0x2677339 data_size 0x1(0x7a bytes) 2024-09-13T06:40:53.265 INFO:teuthology.orchestra.run.smithi081.stdout:2532 read 0x23d83ae thru 0x23dd7a2 (0x53f5 bytes) 2024-09-13T06:40:53.265 INFO:teuthology.orchestra.run.smithi081.stdout:2534 read 0xce9c9a thru 0xcf0755 (0x6abc bytes) 2024-09-13T06:40:53.265 INFO:teuthology.orchestra.run.smithi081.stdout:2535 writesame 0xe208d7 thru 0xe2d415 data_size 0x1(0xcb3f bytes) 2024-09-13T06:40:53.271 INFO:tasks.ceph.osd.6.smithi139.stderr:2024-09-13T06:40:53.273+0000 7fcd02c5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26385) UID: 0 2024-09-13T06:40:53.287 INFO:teuthology.orchestra.run.smithi081.stdout:2536 read 0x32b324d thru 0x32bf859 (0xc60d bytes) 2024-09-13T06:40:53.288 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:40:53.300 INFO:teuthology.orchestra.run.smithi081.stdout:2539 trunc from 0xdc75b02 to 0x441dad3 2024-09-13T06:40:53.319 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:40:53.319 INFO:teuthology.orchestra.run.smithi081.stdout:2541 writesame 0xe4185b thru 0xe4b446 data_size 0x22(0x9bec bytes) 2024-09-13T06:40:53.342 INFO:teuthology.orchestra.run.smithi081.stdout:2543 write 0x80b71b1 thru 0x80b7dbe (0xc0e bytes) 2024-09-13T06:40:53.347 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:40:53.347 INFO:teuthology.orchestra.run.smithi081.stdout:2546 punch from 0x6352b27 to 0x6353ba0, (0x1079 bytes) 2024-09-13T06:40:53.347 INFO:teuthology.orchestra.run.smithi081.stdout:2547 write 0x7315680 thru 0x7315f73 (0x8f4 bytes) 2024-09-13T06:40:53.351 INFO:teuthology.orchestra.run.smithi081.stdout:2548 read 0x45cfd01 thru 0x45d419e (0x449e bytes) 2024-09-13T06:40:53.352 INFO:teuthology.orchestra.run.smithi081.stdout:2549 write 0x3609525 thru 0x3609591 (0x6d bytes) 2024-09-13T06:40:53.356 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:40:53.356 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 20, 2024-09-13T06:40:53.356 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 600, 2024-09-13T06:40:53.356 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [ 2024-09-13T06:40:53.356 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:53.356 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:2226 3.15 3:af026987:::rbd_data.112173e2f1b7.0000000000000017:head [sparse-read 0~4194304] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-13T06:40:53.356 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:37.606562+0000", 2024-09-13T06:40:53.356 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 75.750854576999998, 2024-09-13T06:40:53.356 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.83322091700000001, 2024-09-13T06:40:53.356 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:53.357 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:40:53.357 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:53.357 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:53.357 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:53.357 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 2226 2024-09-13T06:40:53.357 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:53.357 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:53.357 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:53.357 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:53.357 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606562+0000", 2024-09-13T06:40:53.358 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:53.358 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:53.358 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:53.358 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:53.358 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606562+0000", 2024-09-13T06:40:53.358 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:53.358 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:53.358 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:53.358 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:53.358 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606561+0000", 2024-09-13T06:40:53.358 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:53.359 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:53.359 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:53.359 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:53.359 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606565+0000", 2024-09-13T06:40:53.359 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.4379999999999999e-06 2024-09-13T06:40:53.359 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:53.359 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:53.359 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:53.359 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606569+0000", 2024-09-13T06:40:53.359 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.425e-06 2024-09-13T06:40:53.359 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:53.360 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:53.360 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:53.360 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606572+0000", 2024-09-13T06:40:53.360 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.05e-06 2024-09-13T06:40:53.360 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:53.360 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:53.360 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:53.360 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606621+0000", 2024-09-13T06:40:53.360 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.8723000000000001e-05 2024-09-13T06:40:53.360 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:53.361 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:53.361 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:40:53.361 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606630+0000", 2024-09-13T06:40:53.361 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.8040000000000007e-06 2024-09-13T06:40:53.361 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:53.361 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:53.361 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:53.361 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.439648+0000", 2024-09-13T06:40:53.361 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.83301824800000002 2024-09-13T06:40:53.361 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:53.361 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:53.362 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:53.362 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.439782+0000", 2024-09-13T06:40:53.362 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00013466699999999999 2024-09-13T06:40:53.362 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:53.362 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:53.362 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:53.362 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:53.362 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:53.362 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25661 3.8 3:1180686c:::rbd_data.1121f2c5ee81.0000000000000009:13 [read 397312~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:53.362 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.436956+0000", 2024-09-13T06:40:53.363 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 56.920460042999999, 2024-09-13T06:40:53.363 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089036758999999993, 2024-09-13T06:40:53.363 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:53.363 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:53.363 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:53.363 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:53.363 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:53.363 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25661 2024-09-13T06:40:53.363 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:53.363 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:53.363 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:53.364 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:53.364 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436956+0000", 2024-09-13T06:40:53.364 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:53.364 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:53.364 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:53.364 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:53.364 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436956+0000", 2024-09-13T06:40:53.364 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:53.364 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:53.364 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:53.365 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:53.365 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436956+0000", 2024-09-13T06:40:53.365 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:53.365 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:53.365 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:53.365 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:53.365 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436958+0000", 2024-09-13T06:40:53.365 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1770000000000001e-06 2024-09-13T06:40:53.365 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:53.365 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:53.365 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:53.366 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436963+0000", 2024-09-13T06:40:53.366 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.6489999999999996e-06 2024-09-13T06:40:53.366 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:53.366 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:53.366 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:53.366 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436975+0000", 2024-09-13T06:40:53.366 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1783999999999999e-05 2024-09-13T06:40:53.366 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:53.366 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:53.366 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:53.366 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.525671+0000", 2024-09-13T06:40:53.366 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.088696292999999995 2024-09-13T06:40:53.367 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:53.367 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:53.367 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:53.367 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.525749+0000", 2024-09-13T06:40:53.367 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.7589000000000005e-05 2024-09-13T06:40:53.367 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:53.367 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:53.367 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:53.367 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.525993+0000", 2024-09-13T06:40:53.367 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00024381000000000001 2024-09-13T06:40:53.367 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:53.368 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:53.368 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:53.368 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:53.368 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:53.368 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25662 3.8 3:1180686c:::rbd_data.1121f2c5ee81.0000000000000009:13 [read 421888~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:53.368 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.436980+0000", 2024-09-13T06:40:53.368 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 56.920435730999998, 2024-09-13T06:40:53.368 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089367577000000004, 2024-09-13T06:40:53.368 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:53.368 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:53.368 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:53.368 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:53.369 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:53.369 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25662 2024-09-13T06:40:53.369 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:53.369 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:53.369 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:53.369 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:53.369 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436980+0000", 2024-09-13T06:40:53.369 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:53.369 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:53.369 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:53.369 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:53.369 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436980+0000", 2024-09-13T06:40:53.370 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:53.370 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:53.370 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:53.370 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:53.370 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436980+0000", 2024-09-13T06:40:53.370 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:53.370 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:53.370 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:53.370 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:53.370 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436982+0000", 2024-09-13T06:40:53.370 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3989999999999998e-06 2024-09-13T06:40:53.370 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:53.370 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:53.371 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:53.371 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436988+0000", 2024-09-13T06:40:53.371 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0039999999999996e-06 2024-09-13T06:40:53.371 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:53.371 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:53.371 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:53.371 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436993+0000", 2024-09-13T06:40:53.371 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6090000000000003e-06 2024-09-13T06:40:53.371 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:53.371 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:53.371 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:53.371 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.526035+0000", 2024-09-13T06:40:53.371 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089042248000000004 2024-09-13T06:40:53.372 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:53.372 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:53.372 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:53.372 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.526111+0000", 2024-09-13T06:40:53.372 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5643999999999996e-05 2024-09-13T06:40:53.372 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:53.372 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:53.372 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:53.372 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.526348+0000", 2024-09-13T06:40:53.372 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00023705800000000001 2024-09-13T06:40:53.372 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:53.373 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:53.373 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:53.373 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:53.373 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:53.373 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25663 3.8 3:1180686c:::rbd_data.1121f2c5ee81.0000000000000009:13 [read 466944~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:53.373 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.436998+0000", 2024-09-13T06:40:53.373 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 56.920418083999998, 2024-09-13T06:40:53.373 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089730867000000006, 2024-09-13T06:40:53.373 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:53.373 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:53.374 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:53.374 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:53.374 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:53.374 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25663 2024-09-13T06:40:53.374 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:53.374 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:53.374 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:53.374 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:53.374 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436998+0000", 2024-09-13T06:40:53.374 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:53.374 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:53.374 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:53.374 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:53.375 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436998+0000", 2024-09-13T06:40:53.375 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:53.375 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:53.375 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:53.375 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:53.375 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436998+0000", 2024-09-13T06:40:53.375 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:53.375 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:53.375 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:53.375 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:53.375 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437000+0000", 2024-09-13T06:40:53.375 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0940000000000002e-06 2024-09-13T06:40:53.376 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:53.376 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:53.376 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:53.376 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437005+0000", 2024-09-13T06:40:53.377 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.604e-06 2024-09-13T06:40:53.377 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:53.377 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:53.377 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:53.377 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437032+0000", 2024-09-13T06:40:53.377 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6407e-05 2024-09-13T06:40:53.377 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:53.377 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:53.377 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:53.377 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.526363+0000", 2024-09-13T06:40:53.378 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089331456000000004 2024-09-13T06:40:53.378 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:53.378 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:53.378 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:53.378 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.526404+0000", 2024-09-13T06:40:53.378 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.0887999999999999e-05 2024-09-13T06:40:53.378 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:53.378 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:53.378 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:53.378 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.526729+0000", 2024-09-13T06:40:53.378 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00032486 2024-09-13T06:40:53.378 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:53.379 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:53.379 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:53.379 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:53.379 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:53.379 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25664 3.8 3:1180686c:::rbd_data.1121f2c5ee81.0000000000000009:13 [read 491520~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:53.379 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.437040+0000", 2024-09-13T06:40:53.379 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 56.920376169000001, 2024-09-13T06:40:53.379 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.090016650000000004, 2024-09-13T06:40:53.379 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:53.379 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:53.379 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:53.379 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:53.380 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:53.380 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25664 2024-09-13T06:40:53.380 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:53.380 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:53.380 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:53.380 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:53.380 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437040+0000", 2024-09-13T06:40:53.380 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:53.380 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:53.380 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:53.380 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:53.381 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437040+0000", 2024-09-13T06:40:53.381 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:53.381 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:53.381 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:53.381 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:53.381 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437039+0000", 2024-09-13T06:40:53.381 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:53.381 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:53.381 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:53.381 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:53.381 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437047+0000", 2024-09-13T06:40:53.381 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4839999999999998e-06 2024-09-13T06:40:53.382 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:53.382 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:53.382 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:53.382 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437054+0000", 2024-09-13T06:40:53.382 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.8299999999999998e-06 2024-09-13T06:40:53.382 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:53.382 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:53.382 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:53.382 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437060+0000", 2024-09-13T06:40:53.382 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.1510000000000001e-06 2024-09-13T06:40:53.383 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:53.383 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:53.383 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:53.383 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.526772+0000", 2024-09-13T06:40:53.383 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089711737999999999 2024-09-13T06:40:53.383 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:53.383 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:53.383 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:53.383 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.526848+0000", 2024-09-13T06:40:53.383 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5870000000000004e-05 2024-09-13T06:40:53.383 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:53.384 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:53.384 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:53.384 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.527057+0000", 2024-09-13T06:40:53.384 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000209106 2024-09-13T06:40:53.384 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:53.384 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:53.384 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:53.384 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:53.384 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:53.384 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25740 3.18 3:1c662b96:::rbd_data.1121f2c5ee81.0000000000000010:13 [read 200704~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:53.384 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443352+0000", 2024-09-13T06:40:53.385 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 56.914064494000002, 2024-09-13T06:40:53.385 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089068222000000002, 2024-09-13T06:40:53.385 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:53.385 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:53.385 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:53.385 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:53.385 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:53.385 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25740 2024-09-13T06:40:53.385 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:53.385 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:53.385 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:53.386 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:53.386 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443352+0000", 2024-09-13T06:40:53.386 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:53.386 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:53.386 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:53.386 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:53.386 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443352+0000", 2024-09-13T06:40:53.386 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:53.386 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:53.386 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:53.386 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:53.387 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443351+0000", 2024-09-13T06:40:53.387 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:53.387 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:53.387 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:53.387 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:53.387 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443354+0000", 2024-09-13T06:40:53.387 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.841e-06 2024-09-13T06:40:53.387 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:53.387 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:53.387 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:53.387 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443361+0000", 2024-09-13T06:40:53.387 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.0010000000000004e-06 2024-09-13T06:40:53.387 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:53.388 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:53.388 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:53.388 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443366+0000", 2024-09-13T06:40:53.388 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7119999999999999e-06 2024-09-13T06:40:53.388 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:53.388 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:53.388 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:53.388 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532117+0000", 2024-09-13T06:40:53.388 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.088751327000000005 2024-09-13T06:40:53.388 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:53.388 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:53.389 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:53.389 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532193+0000", 2024-09-13T06:40:53.389 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5839000000000004e-05 2024-09-13T06:40:53.389 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:53.389 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:53.389 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:53.389 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532420+0000", 2024-09-13T06:40:53.389 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00022691000000000001 2024-09-13T06:40:53.389 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:53.389 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:53.389 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:53.390 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:53.390 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:53.390 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25741 3.18 3:1c662b96:::rbd_data.1121f2c5ee81.0000000000000010:13 [read 225280~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:53.390 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443378+0000", 2024-09-13T06:40:53.390 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 56.914037727, 2024-09-13T06:40:53.390 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089324107, 2024-09-13T06:40:53.390 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:53.390 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:53.390 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:53.390 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:53.390 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:53.391 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25741 2024-09-13T06:40:53.391 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:53.391 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:53.391 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:53.391 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:53.391 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443378+0000", 2024-09-13T06:40:53.391 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:53.391 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:53.391 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:53.391 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:53.392 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443378+0000", 2024-09-13T06:40:53.392 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:53.392 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:53.392 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:53.392 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:53.392 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443378+0000", 2024-09-13T06:40:53.392 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:53.392 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:53.392 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:53.392 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:53.392 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443380+0000", 2024-09-13T06:40:53.393 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3549999999999999e-06 2024-09-13T06:40:53.393 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:53.393 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:53.393 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:53.393 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443388+0000", 2024-09-13T06:40:53.393 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.7449999999999995e-06 2024-09-13T06:40:53.393 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:53.393 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:53.393 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:53.393 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443393+0000", 2024-09-13T06:40:53.394 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.4e-06 2024-09-13T06:40:53.394 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:53.394 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:53.394 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:53.394 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532454+0000", 2024-09-13T06:40:53.394 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089060941000000005 2024-09-13T06:40:53.394 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:53.394 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:53.394 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:53.394 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532512+0000", 2024-09-13T06:40:53.394 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7763000000000002e-05 2024-09-13T06:40:53.395 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:53.395 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:53.395 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:53.395 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532703+0000", 2024-09-13T06:40:53.395 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000190328 2024-09-13T06:40:53.395 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:53.395 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:53.395 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:53.395 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:53.395 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:53.395 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25742 3.18 3:1c662b96:::rbd_data.1121f2c5ee81.0000000000000010:13 [read 270336~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:53.395 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443398+0000", 2024-09-13T06:40:53.396 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 56.914018015000003, 2024-09-13T06:40:53.396 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089621836999999996, 2024-09-13T06:40:53.396 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:53.396 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:53.396 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:53.396 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:53.396 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:53.396 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25742 2024-09-13T06:40:53.396 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:53.396 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:53.396 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:53.397 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:53.397 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443398+0000", 2024-09-13T06:40:53.397 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:53.397 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:53.397 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:53.397 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:53.397 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443398+0000", 2024-09-13T06:40:53.397 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:53.397 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:53.397 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:53.397 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:53.398 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443398+0000", 2024-09-13T06:40:53.398 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:53.398 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:53.398 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:53.398 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:53.398 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443400+0000", 2024-09-13T06:40:53.398 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1849999999999998e-06 2024-09-13T06:40:53.398 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:53.398 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:53.398 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:53.398 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443407+0000", 2024-09-13T06:40:53.398 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3669999999999999e-06 2024-09-13T06:40:53.398 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:53.399 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:53.399 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:53.399 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443420+0000", 2024-09-13T06:40:53.399 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2645e-05 2024-09-13T06:40:53.399 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:53.399 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:53.399 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:53.399 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532742+0000", 2024-09-13T06:40:53.399 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089322200000000004 2024-09-13T06:40:53.399 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:53.399 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:53.399 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:53.399 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532818+0000", 2024-09-13T06:40:53.400 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.6019000000000005e-05 2024-09-13T06:40:53.400 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:53.400 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:53.400 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:53.400 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533020+0000", 2024-09-13T06:40:53.400 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000201721 2024-09-13T06:40:53.400 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:53.400 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:53.400 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:53.400 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:53.400 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:53.400 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25743 3.18 3:1c662b96:::rbd_data.1121f2c5ee81.0000000000000010:13 [read 294912~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:53.400 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443425+0000", 2024-09-13T06:40:53.401 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 56.913991007, 2024-09-13T06:40:53.401 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089864075000000002, 2024-09-13T06:40:53.401 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:53.401 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:53.401 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:53.401 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:53.401 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:53.401 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25743 2024-09-13T06:40:53.401 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:53.401 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:53.401 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:53.402 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:53.402 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443425+0000", 2024-09-13T06:40:53.402 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:53.402 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:53.402 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:53.402 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:53.402 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443425+0000", 2024-09-13T06:40:53.402 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:53.402 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:53.402 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:53.403 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:53.403 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443425+0000", 2024-09-13T06:40:53.403 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:53.403 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:53.403 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:53.403 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:53.403 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443432+0000", 2024-09-13T06:40:53.403 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3420000000000002e-06 2024-09-13T06:40:53.403 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:53.403 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:53.403 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:53.404 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443440+0000", 2024-09-13T06:40:53.404 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5689999999999999e-06 2024-09-13T06:40:53.404 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:53.404 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:53.404 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:53.404 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443445+0000", 2024-09-13T06:40:53.404 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9590000000000003e-06 2024-09-13T06:40:53.404 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:53.404 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:53.404 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:53.404 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533063+0000", 2024-09-13T06:40:53.405 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089617988999999995 2024-09-13T06:40:53.405 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:53.405 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:53.405 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:53.405 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533122+0000", 2024-09-13T06:40:53.405 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9052999999999999e-05 2024-09-13T06:40:53.405 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:53.405 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:53.405 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:53.405 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533289+0000", 2024-09-13T06:40:53.406 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00016752800000000001 2024-09-13T06:40:53.406 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:53.406 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:53.406 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:53.406 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:53.406 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:53.406 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25744 3.18 3.69d46638 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:53.406 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443449+0000", 2024-09-13T06:40:53.406 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 56.913966860000002, 2024-09-13T06:40:53.406 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089869148999999995, 2024-09-13T06:40:53.406 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:53.406 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:40:53.407 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:53.407 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:53.407 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:53.407 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25744 2024-09-13T06:40:53.407 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:53.407 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:53.407 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:53.407 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:53.407 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443449+0000", 2024-09-13T06:40:53.407 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:53.407 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:53.408 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:53.408 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:53.408 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443449+0000", 2024-09-13T06:40:53.408 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:53.408 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:53.408 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:53.408 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:53.408 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443449+0000", 2024-09-13T06:40:53.408 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:53.408 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:53.408 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:53.408 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:53.409 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443451+0000", 2024-09-13T06:40:53.409 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.244e-06 2024-09-13T06:40:53.409 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:53.409 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:53.409 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:53.409 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443457+0000", 2024-09-13T06:40:53.409 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.66e-06 2024-09-13T06:40:53.409 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:53.409 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:53.409 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:53.409 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443461+0000", 2024-09-13T06:40:53.410 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5449999999999997e-06 2024-09-13T06:40:53.410 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:53.410 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:53.410 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:53.410 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533311+0000", 2024-09-13T06:40:53.410 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089849729000000003 2024-09-13T06:40:53.410 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:53.410 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:53.410 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:53.410 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533318+0000", 2024-09-13T06:40:53.410 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.328e-06 2024-09-13T06:40:53.410 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:53.410 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:53.411 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:53.411 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:53.411 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:53.411 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25745 3.18 3.69d46638 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:53.411 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443466+0000", 2024-09-13T06:40:53.411 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 56.913949801999998, 2024-09-13T06:40:53.411 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089886743000000005, 2024-09-13T06:40:53.411 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:53.411 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:40:53.411 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:53.411 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:53.412 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:53.412 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25745 2024-09-13T06:40:53.412 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:53.412 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:53.412 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:53.412 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:53.412 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443466+0000", 2024-09-13T06:40:53.412 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:53.412 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:53.412 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:53.412 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:53.413 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443466+0000", 2024-09-13T06:40:53.413 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:53.413 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:53.413 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:53.413 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:53.413 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443466+0000", 2024-09-13T06:40:53.413 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:53.413 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:53.413 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:53.413 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:53.413 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443474+0000", 2024-09-13T06:40:53.414 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.1289999999999996e-06 2024-09-13T06:40:53.414 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:53.414 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:53.414 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:53.414 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443484+0000", 2024-09-13T06:40:53.414 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0654e-05 2024-09-13T06:40:53.414 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:53.414 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:53.414 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:53.414 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443490+0000", 2024-09-13T06:40:53.414 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8030000000000002e-06 2024-09-13T06:40:53.415 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:53.415 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:53.415 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:53.415 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533348+0000", 2024-09-13T06:40:53.415 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089857267000000005 2024-09-13T06:40:53.415 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:53.415 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:53.415 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:53.415 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533353+0000", 2024-09-13T06:40:53.415 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.5520000000000004e-06 2024-09-13T06:40:53.415 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:53.415 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:53.416 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:53.416 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:53.416 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:53.416 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25746 3.18 3.69d46638 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:53.416 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443495+0000", 2024-09-13T06:40:53.416 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 56.913920689000001, 2024-09-13T06:40:53.416 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089903725000000004, 2024-09-13T06:40:53.416 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:53.416 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:40:53.416 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:53.416 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:53.416 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:53.417 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25746 2024-09-13T06:40:53.417 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:53.417 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:53.417 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:53.417 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:53.417 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443495+0000", 2024-09-13T06:40:53.417 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:53.417 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:53.417 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:53.417 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:53.417 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443495+0000", 2024-09-13T06:40:53.418 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:53.418 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:53.418 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:53.418 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:53.418 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443495+0000", 2024-09-13T06:40:53.418 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:53.418 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:53.418 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:53.418 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:53.418 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443498+0000", 2024-09-13T06:40:53.418 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.7690000000000001e-06 2024-09-13T06:40:53.418 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:53.418 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:53.419 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:53.419 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443504+0000", 2024-09-13T06:40:53.419 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9710000000000001e-06 2024-09-13T06:40:53.419 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:53.419 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:53.419 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:53.419 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443508+0000", 2024-09-13T06:40:53.419 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4159999999999997e-06 2024-09-13T06:40:53.419 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:53.419 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:53.419 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:53.419 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533391+0000", 2024-09-13T06:40:53.420 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089882607000000003 2024-09-13T06:40:53.420 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:53.420 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:53.420 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:53.420 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533399+0000", 2024-09-13T06:40:53.420 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.4349999999999997e-06 2024-09-13T06:40:53.420 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:53.420 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:53.420 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:53.420 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:53.420 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:53.420 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25747 3.8 3.63996268 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:53.421 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443512+0000", 2024-09-13T06:40:53.421 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 56.913903957999999, 2024-09-13T06:40:53.421 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089880075000000004, 2024-09-13T06:40:53.421 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:53.421 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:40:53.421 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:53.421 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:53.421 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:53.421 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25747 2024-09-13T06:40:53.421 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:53.421 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:53.422 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:53.422 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:53.422 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443512+0000", 2024-09-13T06:40:53.422 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:53.422 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:53.422 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:53.422 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:53.422 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443512+0000", 2024-09-13T06:40:53.422 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:53.422 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:53.422 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:53.422 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:53.423 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443512+0000", 2024-09-13T06:40:53.423 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:53.423 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:53.423 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:53.423 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:53.423 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443514+0000", 2024-09-13T06:40:53.423 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0980000000000001e-06 2024-09-13T06:40:53.423 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:53.423 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:53.423 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:53.423 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443520+0000", 2024-09-13T06:40:53.424 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7069999999999997e-06 2024-09-13T06:40:53.424 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:53.424 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:53.424 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:53.424 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443524+0000", 2024-09-13T06:40:53.424 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5390000000000001e-06 2024-09-13T06:40:53.424 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:53.424 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:53.424 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:53.424 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533384+0000", 2024-09-13T06:40:53.424 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089859684999999995 2024-09-13T06:40:53.424 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:53.425 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:53.425 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:53.425 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533392+0000", 2024-09-13T06:40:53.425 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.3440000000000001e-06 2024-09-13T06:40:53.425 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:53.425 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:53.425 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:53.425 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:53.425 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:53.425 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25748 3.8 3.63996268 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:53.425 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443528+0000", 2024-09-13T06:40:53.426 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 56.913887830999997, 2024-09-13T06:40:53.426 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089890715999999996, 2024-09-13T06:40:53.426 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:53.426 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:40:53.426 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:53.426 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:53.426 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:53.426 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25748 2024-09-13T06:40:53.426 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:53.426 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:53.426 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:53.427 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:53.427 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443528+0000", 2024-09-13T06:40:53.427 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:53.427 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:53.427 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:53.427 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:53.427 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443528+0000", 2024-09-13T06:40:53.427 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:53.427 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:53.427 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:53.427 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:53.427 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443528+0000", 2024-09-13T06:40:53.428 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:53.428 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:53.428 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:53.428 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:53.428 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443530+0000", 2024-09-13T06:40:53.428 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0650000000000001e-06 2024-09-13T06:40:53.428 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:53.428 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:53.428 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:53.428 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443536+0000", 2024-09-13T06:40:53.428 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7259999999999999e-06 2024-09-13T06:40:53.428 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:53.429 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:53.429 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:53.429 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443540+0000", 2024-09-13T06:40:53.429 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5009999999999998e-06 2024-09-13T06:40:53.429 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:53.429 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:53.429 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:53.429 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533412+0000", 2024-09-13T06:40:53.429 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089871873000000005 2024-09-13T06:40:53.429 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:53.429 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:53.429 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:53.430 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533419+0000", 2024-09-13T06:40:53.430 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.883e-06 2024-09-13T06:40:53.430 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:53.430 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:53.430 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:53.430 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:53.430 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:53.430 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25749 3.8 3.63996268 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:53.430 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443545+0000", 2024-09-13T06:40:53.430 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 56.913871635, 2024-09-13T06:40:53.430 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089897988999999998, 2024-09-13T06:40:53.430 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:53.430 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:40:53.431 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:53.431 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:53.431 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:53.431 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25749 2024-09-13T06:40:53.431 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:53.431 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:53.431 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:53.431 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:53.431 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443545+0000", 2024-09-13T06:40:53.431 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:53.431 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:53.432 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:53.432 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:53.432 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443545+0000", 2024-09-13T06:40:53.432 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:53.432 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:53.432 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:53.432 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:53.432 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443544+0000", 2024-09-13T06:40:53.432 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:53.432 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:53.432 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:53.433 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:53.433 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443553+0000", 2024-09-13T06:40:53.433 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.4770000000000003e-06 2024-09-13T06:40:53.433 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:53.433 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:53.433 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:53.433 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443564+0000", 2024-09-13T06:40:53.433 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0986e-05 2024-09-13T06:40:53.433 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:53.433 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:53.433 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:53.433 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443569+0000", 2024-09-13T06:40:53.434 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2530000000000004e-06 2024-09-13T06:40:53.434 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:53.434 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:53.434 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:53.434 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533438+0000", 2024-09-13T06:40:53.434 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089868641999999999 2024-09-13T06:40:53.434 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:53.434 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:53.434 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:53.434 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533442+0000", 2024-09-13T06:40:53.434 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.989e-06 2024-09-13T06:40:53.434 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:53.434 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:53.435 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:53.435 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:53.435 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:53.435 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25750 3.8 3.63996268 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:53.435 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443574+0000", 2024-09-13T06:40:53.435 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 56.913842148999997, 2024-09-13T06:40:53.435 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089895143999999996, 2024-09-13T06:40:53.435 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:53.435 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:40:53.435 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:53.435 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:53.435 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:53.435 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25750 2024-09-13T06:40:53.436 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:53.436 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:53.436 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:53.436 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:53.436 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443574+0000", 2024-09-13T06:40:53.436 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:53.436 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:53.436 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:53.436 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:53.436 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443574+0000", 2024-09-13T06:40:53.436 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:53.436 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:53.437 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:53.437 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:53.437 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443574+0000", 2024-09-13T06:40:53.437 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:53.437 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:53.437 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:53.437 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:53.437 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443576+0000", 2024-09-13T06:40:53.437 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6910000000000002e-06 2024-09-13T06:40:53.437 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:53.437 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:53.437 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:53.438 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443583+0000", 2024-09-13T06:40:53.438 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.331e-06 2024-09-13T06:40:53.438 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:53.438 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:53.438 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:53.438 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443587+0000", 2024-09-13T06:40:53.438 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6129999999999997e-06 2024-09-13T06:40:53.438 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:53.438 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:53.438 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:53.438 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533464+0000", 2024-09-13T06:40:53.438 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089876605999999998 2024-09-13T06:40:53.438 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:53.439 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:53.439 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:53.439 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533469+0000", 2024-09-13T06:40:53.439 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3909999999999997e-06 2024-09-13T06:40:53.439 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:53.439 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:53.439 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:53.439 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:53.439 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:53.439 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25751 3.8 3.63996268 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:53.439 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443592+0000", 2024-09-13T06:40:53.439 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 56.913824452, 2024-09-13T06:40:53.439 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089913650999999997, 2024-09-13T06:40:53.440 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:53.440 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:40:53.440 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:53.440 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:53.440 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:53.440 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25751 2024-09-13T06:40:53.440 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:53.440 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:53.440 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:53.440 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:53.440 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443592+0000", 2024-09-13T06:40:53.440 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:53.440 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:53.441 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:53.441 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:53.441 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443592+0000", 2024-09-13T06:40:53.441 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:53.441 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:53.441 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:53.441 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:53.441 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443591+0000", 2024-09-13T06:40:53.441 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:53.441 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:53.441 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:53.441 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:53.442 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443594+0000", 2024-09-13T06:40:53.442 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3649999999999998e-06 2024-09-13T06:40:53.442 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:53.442 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:53.442 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:53.442 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443599+0000", 2024-09-13T06:40:53.442 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.699e-06 2024-09-13T06:40:53.442 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:53.442 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:53.442 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:53.442 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443611+0000", 2024-09-13T06:40:53.442 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1503e-05 2024-09-13T06:40:53.443 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:53.443 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:53.443 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:53.443 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533497+0000", 2024-09-13T06:40:53.443 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089886453000000005 2024-09-13T06:40:53.443 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:53.443 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:53.443 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:53.443 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533505+0000", 2024-09-13T06:40:53.443 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.9910000000000002e-06 2024-09-13T06:40:53.444 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:53.444 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:53.444 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:53.444 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:53.444 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:53.444 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25752 3.8 3.63996268 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:53.444 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443615+0000", 2024-09-13T06:40:53.444 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 56.913800670999997, 2024-09-13T06:40:53.444 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089905868999999999, 2024-09-13T06:40:53.444 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:53.444 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:40:53.445 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:53.445 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:53.445 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:53.445 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25752 2024-09-13T06:40:53.445 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:53.445 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:53.445 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:53.445 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:53.445 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443615+0000", 2024-09-13T06:40:53.445 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:53.445 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:53.446 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:53.446 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:53.446 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443615+0000", 2024-09-13T06:40:53.446 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:53.446 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:53.446 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:53.446 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:53.446 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443615+0000", 2024-09-13T06:40:53.446 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:53.446 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:53.446 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:53.446 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:53.446 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443617+0000", 2024-09-13T06:40:53.447 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3539999999999998e-06 2024-09-13T06:40:53.447 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:53.447 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:53.447 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:53.447 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443624+0000", 2024-09-13T06:40:53.447 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3600000000000001e-06 2024-09-13T06:40:53.447 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:53.447 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:53.447 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:53.447 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443628+0000", 2024-09-13T06:40:53.447 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.2350000000000001e-06 2024-09-13T06:40:53.447 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:53.447 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:53.448 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:53.448 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533517+0000", 2024-09-13T06:40:53.448 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089889029999999995 2024-09-13T06:40:53.448 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:53.448 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:53.448 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:53.448 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533521+0000", 2024-09-13T06:40:53.448 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.2529999999999998e-06 2024-09-13T06:40:53.448 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:53.448 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:53.448 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:53.449 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:53.449 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:53.449 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25755 3.8 3.63996268 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:53.449 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.444692+0000", 2024-09-13T06:40:53.449 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 56.912723964999998, 2024-09-13T06:40:53.449 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.088904186999999996, 2024-09-13T06:40:53.449 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:53.449 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:40:53.449 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:53.449 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:53.449 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:53.449 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25755 2024-09-13T06:40:53.450 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:53.450 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:53.450 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:53.450 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:53.450 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.444692+0000", 2024-09-13T06:40:53.450 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:53.450 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:53.450 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:53.450 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:53.450 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.444692+0000", 2024-09-13T06:40:53.450 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:53.450 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:53.451 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:53.451 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:53.451 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.444692+0000", 2024-09-13T06:40:53.451 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:53.451 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:53.451 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:53.451 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:53.451 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.444694+0000", 2024-09-13T06:40:53.451 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.058e-06 2024-09-13T06:40:53.451 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:53.451 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:53.451 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:53.452 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.444700+0000", 2024-09-13T06:40:53.452 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7769999999999999e-06 2024-09-13T06:40:53.452 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:53.452 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:53.452 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:53.452 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.444704+0000", 2024-09-13T06:40:53.452 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6229999999999996e-06 2024-09-13T06:40:53.452 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:53.452 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:53.452 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:53.452 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533587+0000", 2024-09-13T06:40:53.453 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.088882744999999999 2024-09-13T06:40:53.453 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:53.453 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:53.453 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:53.453 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533596+0000", 2024-09-13T06:40:53.453 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.3270000000000007e-06 2024-09-13T06:40:53.453 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:53.453 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:53.453 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:53.453 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:53.453 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:53.454 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:64356 3.c 3:32785be9:::rbd_header.11218ba71f0d:head [watch reconnect cookie 140361410387072 gen 2] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e95)", 2024-09-13T06:40:53.454 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:48.473318+0000", 2024-09-13T06:40:53.454 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 4.8840982779999997, 2024-09-13T06:40:53.454 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1458904379999999, 2024-09-13T06:40:53.454 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:53.454 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:53.454 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:53.454 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:53.454 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:53.454 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 64356 2024-09-13T06:40:53.454 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:53.454 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:53.454 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:53.455 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:53.455 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:48.473318+0000", 2024-09-13T06:40:53.455 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:53.455 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:53.455 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:53.455 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:53.455 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:48.473318+0000", 2024-09-13T06:40:53.455 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:53.455 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:53.455 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:53.455 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:53.455 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:48.473315+0000", 2024-09-13T06:40:53.455 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999971 2024-09-13T06:40:53.456 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:53.456 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:53.456 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:53.456 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:48.473329+0000", 2024-09-13T06:40:53.456 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.433e-05 2024-09-13T06:40:53.456 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:53.456 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:53.456 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:53.456 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:48.473363+0000", 2024-09-13T06:40:53.456 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.3592e-05 2024-09-13T06:40:53.456 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:53.456 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:53.457 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:53.457 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:48.473386+0000", 2024-09-13T06:40:53.457 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2708999999999999e-05 2024-09-13T06:40:53.457 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:53.457 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:53.457 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:53.457 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:48.473804+0000", 2024-09-13T06:40:53.457 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00041789399999999998 2024-09-13T06:40:53.457 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:53.457 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:53.457 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:40:53.458 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:48.473830+0000", 2024-09-13T06:40:53.458 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6869e-05 2024-09-13T06:40:53.458 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:53.458 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:53.458 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:53.458 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:49.614332+0000", 2024-09-13T06:40:53.458 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.140501107 2024-09-13T06:40:53.458 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:53.458 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:53.458 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for rw locks", 2024-09-13T06:40:53.458 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:49.614496+0000", 2024-09-13T06:40:53.458 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00016451200000000001 2024-09-13T06:40:53.459 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:53.459 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:53.459 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:53.459 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:49.617131+0000", 2024-09-13T06:40:53.459 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.002634843 2024-09-13T06:40:53.459 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:53.459 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:53.459 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:53.459 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:49.617204+0000", 2024-09-13T06:40:53.459 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.2991000000000006e-05 2024-09-13T06:40:53.459 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:53.459 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:53.460 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:53.460 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:49.619208+0000", 2024-09-13T06:40:53.460 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.002004381 2024-09-13T06:40:53.460 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:53.460 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:53.460 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:53.460 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:53.460 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:53.460 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:40:53.462 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:40:53.462 INFO:teuthology.orchestra.run.smithi081.stdout:2551 read 0x4ba4232 thru 0x4bada06 (0x97d5 bytes) 2024-09-13T06:40:53.462 INFO:teuthology.orchestra.run.smithi081.stdout:2553 read 0x3ba5be5 thru 0x3bafd32 (0xa14e bytes) 2024-09-13T06:40:53.462 INFO:teuthology.orchestra.run.smithi081.stdout:2554 write 0x41ea2e7 thru 0x41eca55 (0x276f bytes) 2024-09-13T06:40:53.462 INFO:teuthology.orchestra.run.smithi081.stdout:2555 read 0x4066b7 thru 0x40a490 (0x3dda bytes) 2024-09-13T06:40:53.462 INFO:teuthology.orchestra.run.smithi081.stdout:2556 write 0x5d9c2cf thru 0x5da2c2c (0x695e bytes) 2024-09-13T06:40:53.463 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-13T06:40:53.464 INFO:teuthology.orchestra.run.smithi081.stdout:2557 write 0xbf29fee thru 0xbf3468b (0xa69e bytes) 2024-09-13T06:40:53.464 INFO:teuthology.orchestra.run.smithi081.stdout:2558 write 0xb9a6a79 thru 0xb9b0ce2 (0xa26a bytes) 2024-09-13T06:40:53.464 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:40:53.465 INFO:teuthology.orchestra.run.smithi081.stdout:2561 trunc from 0xbf3468c to 0x1f09058 2024-09-13T06:40:53.465 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:40:53.465 INFO:teuthology.orchestra.run.smithi081.stdout:2564 read 0x702c3d thru 0x70dc7b (0xb03f bytes) 2024-09-13T06:40:53.465 INFO:teuthology.orchestra.run.smithi081.stdout:2565 punch from 0x1ea132b to 0x1eaa57b, (0x9250 bytes) 2024-09-13T06:40:53.465 INFO:teuthology.orchestra.run.smithi081.stdout:2567 punch from 0xc14232 to 0xc2397b, (0xf749 bytes) 2024-09-13T06:40:53.465 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-13T06:40:53.461+0000 7f86a5f06640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26387) UID: 0 2024-09-13T06:40:53.492 INFO:teuthology.orchestra.run.smithi081.stdout:2568 write 0xe294bf1 thru 0xe29729d (0x26ad bytes) 2024-09-13T06:40:53.507 INFO:teuthology.orchestra.run.smithi081.stderr:nodeep-scrub is set 2024-09-13T06:40:53.511 INFO:teuthology.orchestra.run.smithi081.stderr:marked in osd.5. 2024-09-13T06:40:53.529 INFO:tasks.thrashosds.thrasher:Added osd 5 2024-09-13T06:40:53.562 INFO:tasks.ceph.osd.6.smithi139.stderr:2024-09-13T06:40:53.561+0000 7fcd02c5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26385) UID: 0 2024-09-13T06:40:53.600 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:40:53.600 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [], 2024-09-13T06:40:53.600 INFO:teuthology.orchestra.run.smithi139.stdout: "num_ops": 0 2024-09-13T06:40:53.600 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:40:53.614 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-13T06:40:53.663 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:40:53.663+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:40:53.764 INFO:tasks.ceph.osd.6.smithi139.stderr:2024-09-13T06:40:53.765+0000 7fcd02c5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26385) UID: 0 2024-09-13T06:40:53.777 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:40:53.777 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [], 2024-09-13T06:40:53.777 INFO:teuthology.orchestra.run.smithi139.stdout: "complaint_time": 30, 2024-09-13T06:40:53.777 INFO:teuthology.orchestra.run.smithi139.stdout: "num_blocked_ops": 0 2024-09-13T06:40:53.777 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:40:53.791 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-13T06:40:53.883 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-13T06:40:53.885+0000 7f86a5f06640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26387) UID: 0 2024-09-13T06:40:53.960 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:40:53.961 INFO:teuthology.orchestra.run.smithi139.stdout: "size": 20, 2024-09-13T06:40:53.961 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 600, 2024-09-13T06:40:53.961 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [ 2024-09-13T06:40:53.961 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:53.961 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18706 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 3346432~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:40:53.961 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.846138+0000", 2024-09-13T06:40:53.961 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 62.113637687999997, 2024-09-13T06:40:53.961 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.102018712, 2024-09-13T06:40:53.961 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:53.962 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:53.962 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:53.962 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:53.962 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:53.962 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18706 2024-09-13T06:40:53.962 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:53.962 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:53.962 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:53.962 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:53.962 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846138+0000", 2024-09-13T06:40:53.962 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:53.963 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:53.963 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:53.963 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:53.963 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846138+0000", 2024-09-13T06:40:53.963 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:53.963 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:53.963 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:53.963 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:53.963 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846138+0000", 2024-09-13T06:40:53.963 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:53.963 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:53.964 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:53.964 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:53.964 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846141+0000", 2024-09-13T06:40:53.964 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.6969999999999999e-06 2024-09-13T06:40:53.964 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:53.964 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:53.964 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:53.964 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846150+0000", 2024-09-13T06:40:53.964 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6400000000000003e-06 2024-09-13T06:40:53.964 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:53.964 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:53.965 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:53.965 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846160+0000", 2024-09-13T06:40:53.965 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.3999999999999998e-06 2024-09-13T06:40:53.965 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:53.965 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:53.965 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:53.965 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.947764+0000", 2024-09-13T06:40:53.965 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101604085 2024-09-13T06:40:53.965 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:53.965 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:53.966 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:53.966 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.947888+0000", 2024-09-13T06:40:53.966 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000124113 2024-09-13T06:40:53.966 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:53.966 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:53.966 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:53.966 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.948157+0000", 2024-09-13T06:40:53.966 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00026943399999999998 2024-09-13T06:40:53.966 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:53.966 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:53.966 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:53.966 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:53.966 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:53.967 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18707 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 3375104~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:40:53.967 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.846207+0000", 2024-09-13T06:40:53.967 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 62.113568921999999, 2024-09-13T06:40:53.967 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10238114099999999, 2024-09-13T06:40:53.967 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:53.967 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:53.967 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:53.967 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:53.967 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:53.967 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18707 2024-09-13T06:40:53.967 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:53.968 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:53.968 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:53.968 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:53.968 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846207+0000", 2024-09-13T06:40:53.968 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:53.968 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:53.968 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:53.968 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:53.968 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846207+0000", 2024-09-13T06:40:53.968 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:53.968 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:53.968 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:53.968 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:53.969 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846206+0000", 2024-09-13T06:40:53.969 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:53.969 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:53.969 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:53.969 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:53.969 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846211+0000", 2024-09-13T06:40:53.969 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.3000000000000003e-06 2024-09-13T06:40:53.969 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:53.969 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:53.969 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:53.969 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846220+0000", 2024-09-13T06:40:53.969 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6199999999999994e-06 2024-09-13T06:40:53.970 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:53.970 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:53.970 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:53.970 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846228+0000", 2024-09-13T06:40:53.970 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.7500000000000003e-06 2024-09-13T06:40:53.970 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:53.970 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:53.970 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:53.970 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.948267+0000", 2024-09-13T06:40:53.970 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10203878700000001 2024-09-13T06:40:53.970 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:53.970 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:53.971 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:53.971 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.948435+0000", 2024-09-13T06:40:53.971 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00016796500000000001 2024-09-13T06:40:53.971 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:53.971 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:53.971 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:53.971 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.948588+0000", 2024-09-13T06:40:53.971 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00015373599999999999 2024-09-13T06:40:53.971 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:53.971 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:53.971 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:53.971 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:53.972 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:53.972 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18718 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 3690496~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:40:53.972 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.850174+0000", 2024-09-13T06:40:53.972 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 62.109601769000001, 2024-09-13T06:40:53.972 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101854154, 2024-09-13T06:40:53.972 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:53.972 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:53.972 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:53.972 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:53.972 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:53.972 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18718 2024-09-13T06:40:53.972 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:53.973 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:53.973 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:53.973 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:53.973 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850174+0000", 2024-09-13T06:40:53.973 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:53.973 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:53.973 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:53.973 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:53.973 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850174+0000", 2024-09-13T06:40:53.973 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:53.973 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:53.974 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:53.974 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:53.974 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850173+0000", 2024-09-13T06:40:53.974 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:53.974 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:53.974 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:53.974 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:53.974 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850178+0000", 2024-09-13T06:40:53.974 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.4129999999999999e-06 2024-09-13T06:40:53.974 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:53.974 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:53.974 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:53.975 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850188+0000", 2024-09-13T06:40:53.975 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.8600000000000005e-06 2024-09-13T06:40:53.975 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:53.975 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:53.975 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:53.975 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850195+0000", 2024-09-13T06:40:53.975 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.8730000000000007e-06 2024-09-13T06:40:53.975 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:53.975 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:53.975 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:53.975 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.951766+0000", 2024-09-13T06:40:53.975 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.1015703 2024-09-13T06:40:53.976 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:53.976 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:53.976 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:53.976 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.951879+0000", 2024-09-13T06:40:53.976 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000112932 2024-09-13T06:40:53.976 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:53.976 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:53.976 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:53.976 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.952029+0000", 2024-09-13T06:40:53.976 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000149846 2024-09-13T06:40:53.976 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:53.976 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:53.976 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:53.977 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:53.977 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:53.977 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18719 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 3719168~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:40:53.977 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.850202+0000", 2024-09-13T06:40:53.977 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 62.109573726000001, 2024-09-13T06:40:53.977 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.102191676, 2024-09-13T06:40:53.977 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:53.977 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:53.977 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:53.977 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:53.977 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:53.977 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18719 2024-09-13T06:40:53.978 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:53.978 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:53.978 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:53.978 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:53.978 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850202+0000", 2024-09-13T06:40:53.978 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:53.978 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:53.978 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:53.978 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:53.978 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850202+0000", 2024-09-13T06:40:53.978 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:53.979 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:53.979 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:53.979 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:53.979 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850202+0000", 2024-09-13T06:40:53.979 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:53.979 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:53.979 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:53.979 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:53.979 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850205+0000", 2024-09-13T06:40:53.979 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.89e-06 2024-09-13T06:40:53.979 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:53.980 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:53.980 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:53.980 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850216+0000", 2024-09-13T06:40:53.980 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0233e-05 2024-09-13T06:40:53.980 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:53.980 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:53.980 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:53.980 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850223+0000", 2024-09-13T06:40:53.980 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5299999999999999e-06 2024-09-13T06:40:53.980 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:53.980 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:53.980 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:53.981 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.952106+0000", 2024-09-13T06:40:53.981 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10188309299999999 2024-09-13T06:40:53.981 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:53.981 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:53.981 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:53.981 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.952233+0000", 2024-09-13T06:40:53.981 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000126993 2024-09-13T06:40:53.981 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:53.981 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:53.981 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:53.982 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.952394+0000", 2024-09-13T06:40:53.982 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000160791 2024-09-13T06:40:53.982 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:53.982 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:53.982 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:53.982 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:53.982 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:53.982 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18720 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 3747840~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:40:53.982 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.850726+0000", 2024-09-13T06:40:53.983 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 62.109049896999998, 2024-09-13T06:40:53.983 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10199504299999999, 2024-09-13T06:40:53.983 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:53.983 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:53.983 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:53.983 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:53.983 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:53.983 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18720 2024-09-13T06:40:53.983 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:53.983 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:53.983 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:53.983 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:53.984 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850726+0000", 2024-09-13T06:40:53.984 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:53.984 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:53.984 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:53.984 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:53.984 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850726+0000", 2024-09-13T06:40:53.984 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:53.984 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:53.984 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:53.984 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:53.984 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850229+0000", 2024-09-13T06:40:53.985 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9995027 2024-09-13T06:40:53.985 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:53.985 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:53.985 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:53.985 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850731+0000", 2024-09-13T06:40:53.985 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00050221599999999999 2024-09-13T06:40:53.985 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:53.985 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:53.985 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:53.985 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850751+0000", 2024-09-13T06:40:53.985 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.9703000000000001e-05 2024-09-13T06:40:53.985 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:53.986 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:53.986 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:53.986 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850764+0000", 2024-09-13T06:40:53.986 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3207000000000001e-05 2024-09-13T06:40:53.986 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:53.986 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:53.986 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:53.986 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.952454+0000", 2024-09-13T06:40:53.986 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101690102 2024-09-13T06:40:53.986 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:53.986 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:53.986 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:53.986 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.952571+0000", 2024-09-13T06:40:53.987 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000116556 2024-09-13T06:40:53.987 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:53.987 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:53.987 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:53.987 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.952721+0000", 2024-09-13T06:40:53.987 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000150419 2024-09-13T06:40:53.987 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:53.987 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:53.987 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:53.987 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:53.987 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:53.987 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18730 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 4034560~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:40:53.988 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.854013+0000", 2024-09-13T06:40:53.988 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 62.105762956, 2024-09-13T06:40:53.988 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10186914399999999, 2024-09-13T06:40:53.988 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:53.988 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:53.988 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:53.988 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:53.988 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:53.988 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18730 2024-09-13T06:40:53.988 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:53.988 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:53.989 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:53.989 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:53.989 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.854013+0000", 2024-09-13T06:40:53.989 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:53.989 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:53.989 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:53.989 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:53.989 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.854013+0000", 2024-09-13T06:40:53.989 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:53.989 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:53.989 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:53.989 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:53.989 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.854013+0000", 2024-09-13T06:40:53.990 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:53.990 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:53.990 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:53.990 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:53.990 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.854016+0000", 2024-09-13T06:40:53.990 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.1839999999999999e-06 2024-09-13T06:40:53.990 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:53.990 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:53.990 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:53.990 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.854025+0000", 2024-09-13T06:40:53.990 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.8030000000000003e-06 2024-09-13T06:40:53.990 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:53.990 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:53.991 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:53.991 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.854033+0000", 2024-09-13T06:40:53.991 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6500000000000002e-06 2024-09-13T06:40:53.991 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:53.991 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:53.991 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:53.991 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.955546+0000", 2024-09-13T06:40:53.991 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10151296 2024-09-13T06:40:53.991 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:53.991 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:53.991 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:53.992 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.955694+0000", 2024-09-13T06:40:53.992 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000147773 2024-09-13T06:40:53.992 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:53.992 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:53.992 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:53.992 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.955882+0000", 2024-09-13T06:40:53.992 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000188371 2024-09-13T06:40:53.992 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:53.992 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:53.992 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:53.992 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:53.992 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:53.992 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18742 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 4378624~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:40:53.993 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.857984+0000", 2024-09-13T06:40:53.993 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 62.101791833, 2024-09-13T06:40:53.993 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10179961799999999, 2024-09-13T06:40:53.993 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:53.993 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:53.993 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:53.993 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:53.993 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:53.993 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18742 2024-09-13T06:40:53.993 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:53.993 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:53.993 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:53.994 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:53.994 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.857984+0000", 2024-09-13T06:40:53.994 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:53.994 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:53.994 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:53.994 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:53.994 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.857984+0000", 2024-09-13T06:40:53.994 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:53.994 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:53.994 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:53.994 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:53.995 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.857983+0000", 2024-09-13T06:40:53.995 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:53.995 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:53.995 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:53.995 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:53.995 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.857987+0000", 2024-09-13T06:40:53.995 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0670000000000002e-06 2024-09-13T06:40:53.995 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:53.995 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:53.995 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:53.995 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.857997+0000", 2024-09-13T06:40:53.995 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6830000000000003e-06 2024-09-13T06:40:53.996 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:53.996 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:53.996 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:53.996 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.858006+0000", 2024-09-13T06:40:53.996 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.5739999999999996e-06 2024-09-13T06:40:53.996 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:53.996 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:53.996 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:53.996 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.959453+0000", 2024-09-13T06:40:53.996 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101447339 2024-09-13T06:40:53.996 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:53.996 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:53.997 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:53.997 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.959603+0000", 2024-09-13T06:40:53.997 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000150316 2024-09-13T06:40:53.997 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:53.997 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:53.997 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:53.997 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.959784+0000", 2024-09-13T06:40:53.997 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00018065900000000001 2024-09-13T06:40:53.997 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:53.997 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:53.997 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:53.997 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:53.998 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:53.998 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18743 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 4407296~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:40:53.998 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.858012+0000", 2024-09-13T06:40:53.998 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 62.101763839999997, 2024-09-13T06:40:53.998 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10210024500000001, 2024-09-13T06:40:53.998 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:53.998 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:53.998 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:53.998 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:53.998 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:53.998 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18743 2024-09-13T06:40:53.998 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:53.998 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:53.999 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:53.999 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:53.999 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.858012+0000", 2024-09-13T06:40:53.999 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:53.999 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:53.999 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:53.999 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:53.999 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.858012+0000", 2024-09-13T06:40:53.999 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:53.999 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:53.999 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:53.999 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:53.999 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.858011+0000", 2024-09-13T06:40:54.000 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:54.000 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.000 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.000 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:54.000 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.858016+0000", 2024-09-13T06:40:54.000 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0659999999999997e-06 2024-09-13T06:40:54.000 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.000 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.000 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:54.000 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.858024+0000", 2024-09-13T06:40:54.000 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.7700000000000007e-06 2024-09-13T06:40:54.000 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.001 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.001 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:54.001 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.858032+0000", 2024-09-13T06:40:54.001 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.7700000000000001e-06 2024-09-13T06:40:54.001 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.001 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.001 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:54.001 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.959850+0000", 2024-09-13T06:40:54.001 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.1018182 2024-09-13T06:40:54.001 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.001 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.001 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:54.002 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.959964+0000", 2024-09-13T06:40:54.002 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00011413600000000001 2024-09-13T06:40:54.002 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.002 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.002 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:54.002 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.960113+0000", 2024-09-13T06:40:54.002 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00014813900000000001 2024-09-13T06:40:54.002 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:54.002 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:54.002 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:54.002 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.002 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.002 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18755 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 4751360~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:40:54.003 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.862061+0000", 2024-09-13T06:40:54.003 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 62.097715588, 2024-09-13T06:40:54.003 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101907023, 2024-09-13T06:40:54.003 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:54.003 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:54.003 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:54.003 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:54.003 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:54.003 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18755 2024-09-13T06:40:54.003 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.003 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:54.003 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.004 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:54.004 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862061+0000", 2024-09-13T06:40:54.004 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:54.004 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.004 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.004 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:54.004 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862061+0000", 2024-09-13T06:40:54.004 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:54.004 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.004 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.004 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:54.004 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862060+0000", 2024-09-13T06:40:54.005 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:54.005 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.005 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.005 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:54.005 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862064+0000", 2024-09-13T06:40:54.005 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.3229999999999999e-06 2024-09-13T06:40:54.005 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.005 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.005 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:54.005 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862078+0000", 2024-09-13T06:40:54.005 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.433e-05 2024-09-13T06:40:54.005 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.005 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.006 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:54.006 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862086+0000", 2024-09-13T06:40:54.006 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.3869999999999997e-06 2024-09-13T06:40:54.006 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.006 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.006 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:54.006 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.963635+0000", 2024-09-13T06:40:54.006 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101549606 2024-09-13T06:40:54.006 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.006 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.006 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:54.006 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.963783+0000", 2024-09-13T06:40:54.006 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000147312 2024-09-13T06:40:54.007 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.007 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.007 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:54.007 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.963968+0000", 2024-09-13T06:40:54.007 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000185028 2024-09-13T06:40:54.007 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:54.007 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:54.007 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:54.007 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.007 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.007 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18756 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 4780032~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:40:54.007 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.862132+0000", 2024-09-13T06:40:54.007 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 62.097643744999999, 2024-09-13T06:40:54.007 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.102159295, 2024-09-13T06:40:54.008 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:54.008 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:54.008 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:54.008 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:54.008 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:54.008 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18756 2024-09-13T06:40:54.008 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.008 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:54.008 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.008 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:54.008 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862132+0000", 2024-09-13T06:40:54.009 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:54.009 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.009 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.009 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:54.009 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862132+0000", 2024-09-13T06:40:54.009 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:54.009 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.009 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.009 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:54.009 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862132+0000", 2024-09-13T06:40:54.009 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:54.009 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.009 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.010 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:54.010 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862136+0000", 2024-09-13T06:40:54.010 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.9559999999999999e-06 2024-09-13T06:40:54.010 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.010 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.010 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:54.010 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862145+0000", 2024-09-13T06:40:54.010 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6169999999999996e-06 2024-09-13T06:40:54.010 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.010 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.010 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:54.010 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862153+0000", 2024-09-13T06:40:54.010 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.8359999999999992e-06 2024-09-13T06:40:54.011 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.011 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.011 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:54.011 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.964018+0000", 2024-09-13T06:40:54.011 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101865421 2024-09-13T06:40:54.011 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.011 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.011 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:54.011 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.964140+0000", 2024-09-13T06:40:54.011 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000121172 2024-09-13T06:40:54.011 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.012 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.012 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:54.012 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.964292+0000", 2024-09-13T06:40:54.012 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00015202600000000001 2024-09-13T06:40:54.012 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:54.012 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:54.012 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:54.012 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.012 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.012 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18768 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 5124096~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:40:54.012 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.866345+0000", 2024-09-13T06:40:54.012 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 62.093431438000003, 2024-09-13T06:40:54.013 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101779361, 2024-09-13T06:40:54.013 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:54.013 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:54.013 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:54.013 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:54.013 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:54.013 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18768 2024-09-13T06:40:54.013 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.013 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:54.013 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.013 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:54.013 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.866345+0000", 2024-09-13T06:40:54.014 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:54.014 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.014 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.014 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:54.014 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.866345+0000", 2024-09-13T06:40:54.014 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:54.014 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.014 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.014 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:54.014 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.866344+0000", 2024-09-13T06:40:54.014 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:54.015 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.015 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.015 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:54.015 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.866348+0000", 2024-09-13T06:40:54.015 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.4300000000000002e-06 2024-09-13T06:40:54.015 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.015 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.015 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:54.015 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.866356+0000", 2024-09-13T06:40:54.015 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.5930000000000006e-06 2024-09-13T06:40:54.015 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.015 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.015 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:54.016 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.866364+0000", 2024-09-13T06:40:54.016 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5599999999999996e-06 2024-09-13T06:40:54.016 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.016 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.016 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:54.016 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.967865+0000", 2024-09-13T06:40:54.016 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101501683 2024-09-13T06:40:54.016 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.016 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.016 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:54.016 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.967981+0000", 2024-09-13T06:40:54.016 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000115643 2024-09-13T06:40:54.017 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.017 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.017 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:54.017 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.968124+0000", 2024-09-13T06:40:54.017 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00014305500000000001 2024-09-13T06:40:54.017 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:54.017 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:54.017 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:54.017 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.017 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.017 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18779 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 5439488~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:40:54.017 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.869996+0000", 2024-09-13T06:40:54.017 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 62.089780552999997, 2024-09-13T06:40:54.018 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10189577399999999, 2024-09-13T06:40:54.018 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:54.018 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:54.018 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:54.018 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:54.018 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:54.018 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18779 2024-09-13T06:40:54.018 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.018 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:54.019 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.019 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:54.019 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.869996+0000", 2024-09-13T06:40:54.019 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:54.019 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.019 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.019 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:54.019 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.869996+0000", 2024-09-13T06:40:54.019 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:54.019 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.019 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.020 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:54.020 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.869995+0000", 2024-09-13T06:40:54.020 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:54.020 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.020 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.020 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:54.020 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.869998+0000", 2024-09-13T06:40:54.020 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.2729999999999998e-06 2024-09-13T06:40:54.020 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.020 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.020 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:54.021 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.870007+0000", 2024-09-13T06:40:54.021 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.5760000000000006e-06 2024-09-13T06:40:54.021 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.021 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.021 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:54.021 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.870014+0000", 2024-09-13T06:40:54.021 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.1400000000000002e-06 2024-09-13T06:40:54.021 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.021 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.021 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:54.021 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.971631+0000", 2024-09-13T06:40:54.022 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101617503 2024-09-13T06:40:54.022 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.022 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.022 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:54.022 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.971747+0000", 2024-09-13T06:40:54.022 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00011599600000000001 2024-09-13T06:40:54.022 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.022 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.022 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:54.022 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.971891+0000", 2024-09-13T06:40:54.023 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000143912 2024-09-13T06:40:54.023 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:54.023 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:54.023 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:54.023 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.023 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.023 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18792 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 5812224~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:40:54.023 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.874371+0000", 2024-09-13T06:40:54.023 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 62.085405422999997, 2024-09-13T06:40:54.023 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101736005, 2024-09-13T06:40:54.023 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:54.024 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:54.024 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:54.024 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:54.024 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:54.024 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18792 2024-09-13T06:40:54.024 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.024 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:54.024 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.024 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:54.024 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874371+0000", 2024-09-13T06:40:54.024 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:54.025 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.025 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.025 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:54.025 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874371+0000", 2024-09-13T06:40:54.025 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:54.025 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.025 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.025 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:54.025 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874370+0000", 2024-09-13T06:40:54.025 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:54.025 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.025 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.026 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:54.026 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874374+0000", 2024-09-13T06:40:54.026 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.7239999999999998e-06 2024-09-13T06:40:54.026 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.026 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.026 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:54.026 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874385+0000", 2024-09-13T06:40:54.026 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1293e-05 2024-09-13T06:40:54.026 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.026 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.026 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:54.026 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874394+0000", 2024-09-13T06:40:54.027 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.0729999999999994e-06 2024-09-13T06:40:54.027 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.027 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.027 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:54.027 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.975850+0000", 2024-09-13T06:40:54.027 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10145599700000001 2024-09-13T06:40:54.027 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.027 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.027 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:54.027 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.975963+0000", 2024-09-13T06:40:54.027 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000112689 2024-09-13T06:40:54.028 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.028 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.028 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:54.028 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.976107+0000", 2024-09-13T06:40:54.028 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000143836 2024-09-13T06:40:54.028 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:54.028 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:54.028 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:54.028 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.028 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.028 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18793 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 5840896~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:40:54.029 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.874401+0000", 2024-09-13T06:40:54.029 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 62.085375390000003, 2024-09-13T06:40:54.029 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.102005516, 2024-09-13T06:40:54.029 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:54.029 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:54.029 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:54.029 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:54.029 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:54.029 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18793 2024-09-13T06:40:54.029 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.029 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:54.029 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.030 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:54.030 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874401+0000", 2024-09-13T06:40:54.030 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:54.030 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.030 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.030 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:54.030 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874401+0000", 2024-09-13T06:40:54.030 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:54.030 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.030 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.030 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:54.030 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874400+0000", 2024-09-13T06:40:54.030 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:54.031 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.031 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.031 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:54.031 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874404+0000", 2024-09-13T06:40:54.031 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0069999999999999e-06 2024-09-13T06:40:54.031 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.031 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.031 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:54.031 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874412+0000", 2024-09-13T06:40:54.031 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.5399999999999996e-06 2024-09-13T06:40:54.031 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.031 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.031 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:54.032 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874420+0000", 2024-09-13T06:40:54.032 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.6199999999999999e-06 2024-09-13T06:40:54.032 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.032 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.032 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:54.032 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.976150+0000", 2024-09-13T06:40:54.032 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101729874 2024-09-13T06:40:54.032 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.032 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.032 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:54.032 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.976261+0000", 2024-09-13T06:40:54.032 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000110819 2024-09-13T06:40:54.033 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.033 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.033 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:54.033 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.976406+0000", 2024-09-13T06:40:54.033 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000145489 2024-09-13T06:40:54.033 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:54.033 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:54.033 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:54.033 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.033 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.033 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18803 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 6127616~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:40:54.033 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.877851+0000", 2024-09-13T06:40:54.034 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 62.081924897, 2024-09-13T06:40:54.034 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101951584, 2024-09-13T06:40:54.034 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:54.034 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:54.034 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:54.034 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:54.034 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:54.034 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18803 2024-09-13T06:40:54.034 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.034 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:54.034 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.034 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:54.034 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.877851+0000", 2024-09-13T06:40:54.035 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:54.035 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.035 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.035 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:54.035 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.877851+0000", 2024-09-13T06:40:54.035 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:54.035 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.035 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.035 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:54.035 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.877851+0000", 2024-09-13T06:40:54.035 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:54.035 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.035 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.036 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:54.036 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.877854+0000", 2024-09-13T06:40:54.036 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.7929999999999999e-06 2024-09-13T06:40:54.036 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.036 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.036 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:54.036 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.877864+0000", 2024-09-13T06:40:54.036 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.2029999999999998e-06 2024-09-13T06:40:54.036 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.036 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.036 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:54.036 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.877873+0000", 2024-09-13T06:40:54.036 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.0440000000000001e-06 2024-09-13T06:40:54.037 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.037 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.037 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:54.037 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.979544+0000", 2024-09-13T06:40:54.037 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101671198 2024-09-13T06:40:54.037 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.037 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.037 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:54.037 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.979658+0000", 2024-09-13T06:40:54.037 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000114456 2024-09-13T06:40:54.037 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.037 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.038 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:54.038 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.979803+0000", 2024-09-13T06:40:54.038 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000144506 2024-09-13T06:40:54.038 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:54.038 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:54.038 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:54.038 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.038 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.038 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18807 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 6242304~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:40:54.038 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.879235+0000", 2024-09-13T06:40:54.038 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 62.080540867000003, 2024-09-13T06:40:54.038 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101781258, 2024-09-13T06:40:54.038 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:54.039 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:54.039 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:54.039 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:54.039 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:54.039 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18807 2024-09-13T06:40:54.039 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.039 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:54.039 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.039 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:54.039 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879235+0000", 2024-09-13T06:40:54.039 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:54.039 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.040 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.040 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:54.040 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879235+0000", 2024-09-13T06:40:54.040 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:54.040 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.040 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.040 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:54.040 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879235+0000", 2024-09-13T06:40:54.040 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:54.040 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.040 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.040 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:54.040 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879239+0000", 2024-09-13T06:40:54.041 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.963e-06 2024-09-13T06:40:54.041 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.041 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.041 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:54.041 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879247+0000", 2024-09-13T06:40:54.041 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6470000000000004e-06 2024-09-13T06:40:54.041 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.041 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.041 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:54.041 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879255+0000", 2024-09-13T06:40:54.041 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5429999999999996e-06 2024-09-13T06:40:54.042 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.042 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.042 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:54.042 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.980756+0000", 2024-09-13T06:40:54.042 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10150165999999999 2024-09-13T06:40:54.042 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.042 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.042 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:54.042 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.980868+0000", 2024-09-13T06:40:54.042 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000111196 2024-09-13T06:40:54.042 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.042 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.043 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:54.043 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.981017+0000", 2024-09-13T06:40:54.043 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000148846 2024-09-13T06:40:54.043 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:54.043 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:54.043 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:54.043 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.043 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.043 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18808 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 6270976~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:40:54.043 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.879261+0000", 2024-09-13T06:40:54.043 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 62.080514727999997, 2024-09-13T06:40:54.043 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.102057547, 2024-09-13T06:40:54.044 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:54.044 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:54.044 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:54.044 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:54.044 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:54.044 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18808 2024-09-13T06:40:54.044 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.044 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:54.044 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.044 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:54.044 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879261+0000", 2024-09-13T06:40:54.044 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:54.044 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.045 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.045 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:54.045 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879261+0000", 2024-09-13T06:40:54.045 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:54.045 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.045 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.045 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:54.045 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879261+0000", 2024-09-13T06:40:54.045 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:54.045 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.046 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.046 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:54.046 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879264+0000", 2024-09-13T06:40:54.046 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.523e-06 2024-09-13T06:40:54.046 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.046 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.046 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:54.046 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879273+0000", 2024-09-13T06:40:54.046 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6070000000000008e-06 2024-09-13T06:40:54.046 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.046 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.046 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:54.046 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879280+0000", 2024-09-13T06:40:54.046 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.4699999999999996e-06 2024-09-13T06:40:54.047 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.047 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.047 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:54.047 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.981060+0000", 2024-09-13T06:40:54.047 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10177934800000001 2024-09-13T06:40:54.047 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.047 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.047 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:54.047 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.981174+0000", 2024-09-13T06:40:54.047 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000114456 2024-09-13T06:40:54.047 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.047 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.048 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:54.048 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.981319+0000", 2024-09-13T06:40:54.048 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00014473900000000001 2024-09-13T06:40:54.048 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:54.048 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:54.048 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:54.048 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.048 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.048 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18810 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 2662400~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:40:54.048 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.880386+0000", 2024-09-13T06:40:54.048 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 62.079390566000001, 2024-09-13T06:40:54.048 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101728022, 2024-09-13T06:40:54.049 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:54.049 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:54.049 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:54.049 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:54.049 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:54.049 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18810 2024-09-13T06:40:54.049 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.049 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:54.049 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.049 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:54.049 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880386+0000", 2024-09-13T06:40:54.049 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:54.050 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.050 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.050 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:54.050 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880386+0000", 2024-09-13T06:40:54.050 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:54.050 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.050 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.050 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:54.050 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880385+0000", 2024-09-13T06:40:54.050 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:54.050 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.050 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.050 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:54.051 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880389+0000", 2024-09-13T06:40:54.051 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.8539999999999999e-06 2024-09-13T06:40:54.051 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.051 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.051 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:54.051 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880398+0000", 2024-09-13T06:40:54.051 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.1689999999999998e-06 2024-09-13T06:40:54.051 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.051 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.051 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:54.051 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880405+0000", 2024-09-13T06:40:54.051 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5700000000000004e-06 2024-09-13T06:40:54.052 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.052 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.052 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:54.052 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.981833+0000", 2024-09-13T06:40:54.052 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10142791800000001 2024-09-13T06:40:54.052 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.052 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.052 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:54.052 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.981973+0000", 2024-09-13T06:40:54.052 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00014002900000000001 2024-09-13T06:40:54.052 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.052 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.053 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:54.053 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.982114+0000", 2024-09-13T06:40:54.053 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000140276 2024-09-13T06:40:54.053 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:54.053 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:54.053 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:54.053 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.053 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.053 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18811 3.9 3.140f5209 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:40:54.053 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.880449+0000", 2024-09-13T06:40:54.053 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 62.079327190000001, 2024-09-13T06:40:54.054 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101739355, 2024-09-13T06:40:54.054 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:54.054 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:40:54.054 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:54.054 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:54.054 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:54.054 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18811 2024-09-13T06:40:54.054 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.054 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:54.054 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.054 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:54.054 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880449+0000", 2024-09-13T06:40:54.055 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:54.055 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.055 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.055 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:54.055 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880449+0000", 2024-09-13T06:40:54.055 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:54.055 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.055 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.055 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:54.055 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880448+0000", 2024-09-13T06:40:54.055 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:54.055 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.055 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.056 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:54.056 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880452+0000", 2024-09-13T06:40:54.056 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0470000000000004e-06 2024-09-13T06:40:54.056 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.056 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.056 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:54.056 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880462+0000", 2024-09-13T06:40:54.056 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6530000000000006e-06 2024-09-13T06:40:54.056 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.056 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.056 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:54.057 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880472+0000", 2024-09-13T06:40:54.057 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0027000000000001e-05 2024-09-13T06:40:54.057 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.057 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.057 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:54.057 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.982172+0000", 2024-09-13T06:40:54.057 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10170043500000001 2024-09-13T06:40:54.057 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.057 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.057 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:54.057 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.982188+0000", 2024-09-13T06:40:54.057 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6172999999999999e-05 2024-09-13T06:40:54.058 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:54.058 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:54.058 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:54.058 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.058 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.058 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18812 3.9 3.140f5209 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:40:54.058 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.880478+0000", 2024-09-13T06:40:54.058 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 62.079297953000001, 2024-09-13T06:40:54.058 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10177795100000001, 2024-09-13T06:40:54.058 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:54.058 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:40:54.058 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:54.059 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:54.059 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:54.059 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18812 2024-09-13T06:40:54.059 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.059 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:54.059 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.059 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:54.059 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880478+0000", 2024-09-13T06:40:54.059 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:54.059 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.059 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.059 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:54.060 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880478+0000", 2024-09-13T06:40:54.060 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:54.060 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.060 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.060 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:54.060 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880477+0000", 2024-09-13T06:40:54.060 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:54.060 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.060 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.060 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:54.060 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880481+0000", 2024-09-13T06:40:54.060 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.827e-06 2024-09-13T06:40:54.061 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.061 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.061 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:54.061 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880490+0000", 2024-09-13T06:40:54.061 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6100000000000006e-06 2024-09-13T06:40:54.061 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.061 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.061 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:54.061 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880497+0000", 2024-09-13T06:40:54.061 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.7030000000000006e-06 2024-09-13T06:40:54.061 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.061 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.062 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:54.062 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.982241+0000", 2024-09-13T06:40:54.062 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10174351199999999 2024-09-13T06:40:54.062 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.062 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.062 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:54.062 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.982256+0000", 2024-09-13T06:40:54.062 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5143000000000001e-05 2024-09-13T06:40:54.062 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:54.062 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:54.062 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:54.062 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:54.063 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:54.063 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:40:54.064 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-13T06:40:54.065 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:40:54.063+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:40:54.165 INFO:tasks.ceph.osd.6.smithi139.stderr:2024-09-13T06:40:54.165+0000 7fcd02c5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26385) UID: 0 2024-09-13T06:40:54.235 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:40:54.235 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [ 2024-09-13T06:40:54.235 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.235 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:66818 3.17 3.50afe697 (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e100)", 2024-09-13T06:40:54.235 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:53.498942+0000", 2024-09-13T06:40:54.236 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.73858312299999995, 2024-09-13T06:40:54.236 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.73865122699999997, 2024-09-13T06:40:54.236 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:54.236 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "waiting for peered", 2024-09-13T06:40:54.236 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:54.236 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:54.236 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:54.236 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 66818 2024-09-13T06:40:54.236 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.236 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:54.236 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.236 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:54.237 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:53.498942+0000", 2024-09-13T06:40:54.237 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:54.237 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.237 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.237 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:54.237 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:53.498942+0000", 2024-09-13T06:40:54.237 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:54.237 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.237 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.237 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:54.237 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:53.498939+0000", 2024-09-13T06:40:54.237 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999967 2024-09-13T06:40:54.238 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.238 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.238 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:54.238 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:53.498954+0000", 2024-09-13T06:40:54.238 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5028000000000001e-05 2024-09-13T06:40:54.238 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.238 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.238 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:54.238 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:53.498986+0000", 2024-09-13T06:40:54.238 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.1993999999999999e-05 2024-09-13T06:40:54.239 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.239 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.239 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:54.239 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:53.499001+0000", 2024-09-13T06:40:54.239 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5166e-05 2024-09-13T06:40:54.239 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.239 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.239 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:54.239 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:53.505097+0000", 2024-09-13T06:40:54.239 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0060955610000000002 2024-09-13T06:40:54.239 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.239 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.240 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:40:54.240 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:53.505108+0000", 2024-09-13T06:40:54.240 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.084e-05 2024-09-13T06:40:54.240 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:54.240 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:54.240 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:54.240 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:54.240 INFO:teuthology.orchestra.run.smithi139.stdout: ], 2024-09-13T06:40:54.240 INFO:teuthology.orchestra.run.smithi139.stdout: "num_ops": 1 2024-09-13T06:40:54.240 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:40:54.249 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-13T06:40:54.291 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-13T06:40:54.293+0000 7f86a5f06640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26387) UID: 0 2024-09-13T06:40:54.367 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-13T06:40:54.369+0000 7f86a5f06640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26387) UID: 0 2024-09-13T06:40:54.415 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:40:54.415 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [], 2024-09-13T06:40:54.416 INFO:teuthology.orchestra.run.smithi139.stdout: "complaint_time": 30, 2024-09-13T06:40:54.416 INFO:teuthology.orchestra.run.smithi139.stdout: "num_blocked_ops": 0 2024-09-13T06:40:54.416 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:40:54.430 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-13T06:40:54.468 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:40:54.467+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:40:54.484 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-13T06:40:54.569 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:40:54.567+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:40:54.602 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:40:54.602 INFO:teuthology.orchestra.run.smithi139.stdout: "size": 20, 2024-09-13T06:40:54.602 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 600, 2024-09-13T06:40:54.602 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [ 2024-09-13T06:40:54.602 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.602 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43282 3.1d 3:bd80bfb3:::rbd_object_map.11212f44bfb1.0000000000000020:head [call rbd.object_map_update in=20b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:40:54.602 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589032+0000", 2024-09-13T06:40:54.602 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 33.012537180999999, 2024-09-13T06:40:54.602 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.076225263000000001, 2024-09-13T06:40:54.602 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:54.603 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:40:54.603 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:54.603 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:54.603 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:54.603 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43282 2024-09-13T06:40:54.603 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.603 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:54.603 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.603 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:54.603 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589032+0000", 2024-09-13T06:40:54.603 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:54.603 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.603 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.603 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:54.603 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589032+0000", 2024-09-13T06:40:54.604 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:54.604 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.604 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.604 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:54.604 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589031+0000", 2024-09-13T06:40:54.604 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:54.604 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.604 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.604 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:54.604 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589036+0000", 2024-09-13T06:40:54.604 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.2619999999999998e-06 2024-09-13T06:40:54.604 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.604 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.604 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:54.605 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589046+0000", 2024-09-13T06:40:54.605 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.8099999999999992e-06 2024-09-13T06:40:54.605 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.605 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.605 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:54.605 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589054+0000", 2024-09-13T06:40:54.605 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.2230000000000007e-06 2024-09-13T06:40:54.605 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.605 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.605 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:54.605 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.660691+0000", 2024-09-13T06:40:54.605 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.07163659 2024-09-13T06:40:54.605 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.605 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.606 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:54.606 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.660850+0000", 2024-09-13T06:40:54.606 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00015864300000000001 2024-09-13T06:40:54.606 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.606 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.606 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 4", 2024-09-13T06:40:54.606 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.661729+0000", 2024-09-13T06:40:54.606 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00087956099999999995 2024-09-13T06:40:54.606 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.606 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.606 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:40:54.606 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.664409+0000", 2024-09-13T06:40:54.606 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0026803479999999999 2024-09-13T06:40:54.606 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.606 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.607 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-13T06:40:54.607 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.665088+0000", 2024-09-13T06:40:54.607 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00067901400000000003 2024-09-13T06:40:54.607 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.607 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.607 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-13T06:40:54.607 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.665181+0000", 2024-09-13T06:40:54.607 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.2050000000000001e-05 2024-09-13T06:40:54.607 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.607 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.607 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:54.607 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.665257+0000", 2024-09-13T06:40:54.607 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.6698000000000003e-05 2024-09-13T06:40:54.607 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:54.608 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:54.608 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:54.608 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.608 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.608 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43288 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 270336~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:40:54.608 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589449+0000", 2024-09-13T06:40:54.608 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 33.012119929000001, 2024-09-13T06:40:54.608 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.074906773999999995, 2024-09-13T06:40:54.608 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:54.608 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:54.608 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:54.608 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:54.608 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:54.608 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43288 2024-09-13T06:40:54.609 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.609 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:54.609 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.609 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:54.609 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589449+0000", 2024-09-13T06:40:54.609 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:54.609 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.609 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.609 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:54.609 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589449+0000", 2024-09-13T06:40:54.609 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:54.610 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.610 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.610 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:54.610 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589449+0000", 2024-09-13T06:40:54.610 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:54.610 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.610 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.610 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:54.610 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589452+0000", 2024-09-13T06:40:54.610 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.5769999999999998e-06 2024-09-13T06:40:54.610 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.610 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.610 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:54.610 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589461+0000", 2024-09-13T06:40:54.611 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.5720000000000003e-06 2024-09-13T06:40:54.611 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.611 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.611 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:54.611 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589468+0000", 2024-09-13T06:40:54.611 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5859999999999999e-06 2024-09-13T06:40:54.611 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.611 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.611 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:54.611 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.663827+0000", 2024-09-13T06:40:54.611 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.074358704999999997 2024-09-13T06:40:54.611 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.611 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.611 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:54.611 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.664011+0000", 2024-09-13T06:40:54.611 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00018381699999999999 2024-09-13T06:40:54.612 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.612 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.612 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:54.612 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.664356+0000", 2024-09-13T06:40:54.612 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00034510999999999998 2024-09-13T06:40:54.612 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:54.612 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:54.612 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:54.612 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.612 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.612 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43289 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 284672~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:40:54.612 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589475+0000", 2024-09-13T06:40:54.612 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 33.012094531000002, 2024-09-13T06:40:54.612 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.075789117000000003, 2024-09-13T06:40:54.613 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:54.613 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:54.613 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:54.613 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:54.613 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:54.613 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43289 2024-09-13T06:40:54.613 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.613 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:54.613 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.613 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:54.613 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589475+0000", 2024-09-13T06:40:54.613 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:54.613 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.613 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.613 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:54.613 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589475+0000", 2024-09-13T06:40:54.614 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:54.614 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.614 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.614 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:54.614 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589474+0000", 2024-09-13T06:40:54.614 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:54.614 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.614 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.614 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:54.614 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589477+0000", 2024-09-13T06:40:54.614 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.7929999999999999e-06 2024-09-13T06:40:54.614 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.614 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.615 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:54.615 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589486+0000", 2024-09-13T06:40:54.615 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.4989999999999994e-06 2024-09-13T06:40:54.615 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.615 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.615 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:54.615 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589493+0000", 2024-09-13T06:40:54.615 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5329999999999997e-06 2024-09-13T06:40:54.615 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.615 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.615 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:54.615 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.664456+0000", 2024-09-13T06:40:54.615 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.074962794999999999 2024-09-13T06:40:54.616 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.616 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.616 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:54.616 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.664653+0000", 2024-09-13T06:40:54.616 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000197107 2024-09-13T06:40:54.616 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.616 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.616 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:54.616 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.665264+0000", 2024-09-13T06:40:54.616 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00061037600000000004 2024-09-13T06:40:54.616 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:54.616 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:54.616 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:54.617 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.617 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.617 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43290 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 299008~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:40:54.617 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589500+0000", 2024-09-13T06:40:54.617 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 33.012069019000002, 2024-09-13T06:40:54.617 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.075898564000000002, 2024-09-13T06:40:54.617 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:54.617 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:54.617 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:54.617 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:54.617 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:54.618 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43290 2024-09-13T06:40:54.618 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.618 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:54.618 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.618 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:54.618 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589500+0000", 2024-09-13T06:40:54.618 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:54.618 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.618 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.618 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:54.618 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589500+0000", 2024-09-13T06:40:54.618 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:54.618 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.618 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.618 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:54.619 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589499+0000", 2024-09-13T06:40:54.619 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:54.619 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.619 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.619 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:54.619 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589503+0000", 2024-09-13T06:40:54.619 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.8330000000000004e-06 2024-09-13T06:40:54.619 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.619 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.619 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:54.619 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589511+0000", 2024-09-13T06:40:54.619 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.3359999999999995e-06 2024-09-13T06:40:54.619 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.619 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.619 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:54.620 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589519+0000", 2024-09-13T06:40:54.620 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.4760000000000001e-06 2024-09-13T06:40:54.620 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.620 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.620 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:54.620 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.665097+0000", 2024-09-13T06:40:54.620 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.075577828999999999 2024-09-13T06:40:54.620 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.620 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.620 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:54.620 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.665170+0000", 2024-09-13T06:40:54.620 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.3745000000000006e-05 2024-09-13T06:40:54.620 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.621 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.621 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:54.621 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.665399+0000", 2024-09-13T06:40:54.621 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00022826199999999999 2024-09-13T06:40:54.621 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:54.621 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:54.621 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:54.621 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.621 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.621 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43291 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 313344~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:40:54.621 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589560+0000", 2024-09-13T06:40:54.621 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 33.012008797999997, 2024-09-13T06:40:54.621 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.076145594999999996, 2024-09-13T06:40:54.621 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:54.622 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:54.622 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:54.622 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:54.622 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:54.622 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43291 2024-09-13T06:40:54.622 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.622 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:54.622 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.622 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:54.622 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589560+0000", 2024-09-13T06:40:54.622 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:54.622 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.622 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.622 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:54.623 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589560+0000", 2024-09-13T06:40:54.623 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:54.623 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.623 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.623 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:54.623 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589559+0000", 2024-09-13T06:40:54.623 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:54.623 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.623 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.623 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:54.623 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589564+0000", 2024-09-13T06:40:54.623 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.3989999999999997e-06 2024-09-13T06:40:54.623 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.623 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.624 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:54.624 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589574+0000", 2024-09-13T06:40:54.624 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0502999999999999e-05 2024-09-13T06:40:54.624 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.624 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.624 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:54.624 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589582+0000", 2024-09-13T06:40:54.624 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.1859999999999992e-06 2024-09-13T06:40:54.624 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.624 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.624 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:54.624 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.665423+0000", 2024-09-13T06:40:54.624 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.075840290000000005 2024-09-13T06:40:54.625 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.625 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.625 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:54.625 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.665496+0000", 2024-09-13T06:40:54.625 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.2791000000000002e-05 2024-09-13T06:40:54.625 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.625 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.625 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:54.625 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.665706+0000", 2024-09-13T06:40:54.625 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00021038200000000001 2024-09-13T06:40:54.625 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:54.625 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:54.625 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:54.626 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.626 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.626 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43292 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 327680~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:40:54.626 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589589+0000", 2024-09-13T06:40:54.626 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 33.011980256999998, 2024-09-13T06:40:54.626 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.076769537999999998, 2024-09-13T06:40:54.626 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:54.626 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:54.626 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:54.626 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:54.626 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:54.626 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43292 2024-09-13T06:40:54.626 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.627 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:54.627 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.627 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:54.627 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589589+0000", 2024-09-13T06:40:54.627 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:54.627 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.627 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.627 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:54.627 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589589+0000", 2024-09-13T06:40:54.627 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:54.627 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.627 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.627 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:54.628 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589588+0000", 2024-09-13T06:40:54.628 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:54.628 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.628 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.628 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:54.628 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589592+0000", 2024-09-13T06:40:54.628 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.6389999999999998e-06 2024-09-13T06:40:54.628 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.628 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.628 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:54.628 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589600+0000", 2024-09-13T06:40:54.628 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.4630000000000001e-06 2024-09-13T06:40:54.628 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.629 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.629 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:54.629 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589608+0000", 2024-09-13T06:40:54.629 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.2359999999999998e-06 2024-09-13T06:40:54.629 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.629 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.629 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:54.629 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.665779+0000", 2024-09-13T06:40:54.629 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.076170924000000001 2024-09-13T06:40:54.629 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.629 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.629 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:54.629 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.665977+0000", 2024-09-13T06:40:54.629 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00019891900000000001 2024-09-13T06:40:54.630 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.630 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.630 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:54.630 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.666358+0000", 2024-09-13T06:40:54.630 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000380963 2024-09-13T06:40:54.630 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:54.630 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:54.630 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:54.630 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.630 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.630 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43293 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 342016~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:40:54.630 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589616+0000", 2024-09-13T06:40:54.631 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 33.011953363000003, 2024-09-13T06:40:54.631 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.077030083999999999, 2024-09-13T06:40:54.631 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:54.631 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:54.631 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:54.631 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:54.631 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:54.631 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43293 2024-09-13T06:40:54.631 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.631 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:54.631 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.631 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:54.632 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589616+0000", 2024-09-13T06:40:54.632 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:54.632 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.632 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.632 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:54.632 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589616+0000", 2024-09-13T06:40:54.632 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:54.632 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.632 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.632 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:54.632 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589615+0000", 2024-09-13T06:40:54.632 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:54.633 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.633 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.633 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:54.633 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589619+0000", 2024-09-13T06:40:54.633 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.9559999999999999e-06 2024-09-13T06:40:54.633 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.633 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.633 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:54.633 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589627+0000", 2024-09-13T06:40:54.633 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.2490000000000001e-06 2024-09-13T06:40:54.633 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.633 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.633 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:54.634 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589635+0000", 2024-09-13T06:40:54.634 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.96e-06 2024-09-13T06:40:54.634 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.634 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.634 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:54.634 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.666379+0000", 2024-09-13T06:40:54.634 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.076744484000000002 2024-09-13T06:40:54.634 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.634 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.634 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:54.634 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.666454+0000", 2024-09-13T06:40:54.634 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.4623999999999996e-05 2024-09-13T06:40:54.634 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.634 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.635 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:54.635 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.666646+0000", 2024-09-13T06:40:54.635 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00019176999999999999 2024-09-13T06:40:54.635 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:54.635 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:54.635 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:54.635 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.635 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.635 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43294 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 356352~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:40:54.635 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589681+0000", 2024-09-13T06:40:54.635 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 33.011888048000003, 2024-09-13T06:40:54.635 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.077594648000000002, 2024-09-13T06:40:54.635 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:54.635 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:54.636 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:54.636 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:54.636 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:54.636 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43294 2024-09-13T06:40:54.636 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.636 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:54.636 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.636 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:54.636 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589681+0000", 2024-09-13T06:40:54.636 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:54.636 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.636 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.636 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:54.637 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589681+0000", 2024-09-13T06:40:54.637 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:54.637 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.637 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.637 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:54.637 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589680+0000", 2024-09-13T06:40:54.637 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:54.637 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.637 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.637 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:54.637 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589684+0000", 2024-09-13T06:40:54.637 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.8369999999999999e-06 2024-09-13T06:40:54.637 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.637 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.638 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:54.638 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589693+0000", 2024-09-13T06:40:54.638 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.1020000000000003e-06 2024-09-13T06:40:54.638 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.638 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.638 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:54.638 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589701+0000", 2024-09-13T06:40:54.638 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.8059999999999995e-06 2024-09-13T06:40:54.638 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.638 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.638 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:54.638 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.666714+0000", 2024-09-13T06:40:54.638 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.077013463000000004 2024-09-13T06:40:54.638 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.638 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.639 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:54.639 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.666897+0000", 2024-09-13T06:40:54.639 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000182268 2024-09-13T06:40:54.639 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.639 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.639 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:54.639 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.667276+0000", 2024-09-13T06:40:54.639 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00037907499999999998 2024-09-13T06:40:54.639 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:54.639 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:54.639 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:54.640 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.640 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.640 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43295 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 370688~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:40:54.640 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589744+0000", 2024-09-13T06:40:54.640 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 33.011824875999999, 2024-09-13T06:40:54.640 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.077854343000000006, 2024-09-13T06:40:54.640 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:54.640 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:54.640 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:54.640 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:54.640 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:54.640 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43295 2024-09-13T06:40:54.640 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.641 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:54.641 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.641 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:54.641 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589744+0000", 2024-09-13T06:40:54.641 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:54.641 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.641 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.641 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:54.641 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589744+0000", 2024-09-13T06:40:54.641 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:54.641 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.641 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.642 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:54.642 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589743+0000", 2024-09-13T06:40:54.642 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:54.642 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.642 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.642 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:54.642 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589747+0000", 2024-09-13T06:40:54.642 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0130000000000004e-06 2024-09-13T06:40:54.642 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.642 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.642 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:54.642 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589756+0000", 2024-09-13T06:40:54.642 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.003e-06 2024-09-13T06:40:54.643 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.643 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.643 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:54.643 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589766+0000", 2024-09-13T06:40:54.643 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.2820000000000002e-06 2024-09-13T06:40:54.643 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.643 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.643 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:54.643 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.667300+0000", 2024-09-13T06:40:54.643 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.077534299000000001 2024-09-13T06:40:54.643 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.643 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.643 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:54.643 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.667372+0000", 2024-09-13T06:40:54.643 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.2393999999999998e-05 2024-09-13T06:40:54.644 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.644 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.644 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:54.644 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.667599+0000", 2024-09-13T06:40:54.644 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000226269 2024-09-13T06:40:54.644 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:54.644 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:54.644 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:54.644 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.644 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.644 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43296 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 385024~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:40:54.644 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589772+0000", 2024-09-13T06:40:54.644 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 33.011796852000003, 2024-09-13T06:40:54.644 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.078469647000000003, 2024-09-13T06:40:54.645 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:54.645 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:54.645 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:54.645 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:54.645 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:54.645 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43296 2024-09-13T06:40:54.645 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.645 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:54.645 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.645 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:54.645 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589772+0000", 2024-09-13T06:40:54.645 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:54.645 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.645 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.646 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:54.646 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589772+0000", 2024-09-13T06:40:54.646 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:54.646 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.646 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.646 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:54.646 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589771+0000", 2024-09-13T06:40:54.646 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:54.646 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.646 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.646 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:54.646 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589775+0000", 2024-09-13T06:40:54.646 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.8530000000000002e-06 2024-09-13T06:40:54.646 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.647 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.647 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:54.647 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589784+0000", 2024-09-13T06:40:54.647 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.4300000000000006e-06 2024-09-13T06:40:54.647 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.647 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.647 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:54.647 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589791+0000", 2024-09-13T06:40:54.647 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.4660000000000002e-06 2024-09-13T06:40:54.647 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.647 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.647 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:54.647 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.667667+0000", 2024-09-13T06:40:54.647 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.077875697999999993 2024-09-13T06:40:54.648 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.648 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.648 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:54.648 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.667854+0000", 2024-09-13T06:40:54.648 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00018760099999999999 2024-09-13T06:40:54.648 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.648 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.648 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:54.648 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.668242+0000", 2024-09-13T06:40:54.648 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00038750600000000003 2024-09-13T06:40:54.648 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:54.648 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:54.648 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:54.648 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.649 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.649 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43297 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 403456~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:40:54.649 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589797+0000", 2024-09-13T06:40:54.649 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 33.011772147999999, 2024-09-13T06:40:54.649 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.078756672999999999, 2024-09-13T06:40:54.649 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:54.649 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:54.649 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:54.649 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:54.649 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:54.649 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43297 2024-09-13T06:40:54.649 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.650 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:54.650 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.650 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:54.650 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589797+0000", 2024-09-13T06:40:54.650 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:54.650 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.650 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.650 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:54.650 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589797+0000", 2024-09-13T06:40:54.650 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:54.650 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.650 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.650 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:54.650 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589796+0000", 2024-09-13T06:40:54.650 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:54.651 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.651 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.651 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:54.651 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589800+0000", 2024-09-13T06:40:54.651 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.3230000000000002e-06 2024-09-13T06:40:54.651 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.651 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.651 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:54.651 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589808+0000", 2024-09-13T06:40:54.651 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.2390000000000002e-06 2024-09-13T06:40:54.651 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.651 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.651 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:54.651 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589815+0000", 2024-09-13T06:40:54.651 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.413e-06 2024-09-13T06:40:54.652 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.652 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.652 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:54.652 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.668265+0000", 2024-09-13T06:40:54.652 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.078449873000000003 2024-09-13T06:40:54.652 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.652 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.652 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:54.652 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.668332+0000", 2024-09-13T06:40:54.652 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.7178e-05 2024-09-13T06:40:54.652 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.652 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.652 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:54.652 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.668554+0000", 2024-09-13T06:40:54.653 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00022128600000000001 2024-09-13T06:40:54.653 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:54.653 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:54.653 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:54.653 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.653 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.653 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43298 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 417792~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:40:54.653 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589821+0000", 2024-09-13T06:40:54.653 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 33.011748025999999, 2024-09-13T06:40:54.653 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.079368660999999993, 2024-09-13T06:40:54.653 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:54.654 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:54.654 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:54.654 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:54.654 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:54.654 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43298 2024-09-13T06:40:54.654 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.654 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:54.654 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.654 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:54.654 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589821+0000", 2024-09-13T06:40:54.654 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:54.654 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.654 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.654 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:54.655 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589821+0000", 2024-09-13T06:40:54.655 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:54.655 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.655 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.655 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:54.655 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589821+0000", 2024-09-13T06:40:54.655 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:54.655 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.655 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.655 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:54.655 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589830+0000", 2024-09-13T06:40:54.655 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.4860000000000003e-06 2024-09-13T06:40:54.655 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.655 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.656 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:54.656 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589839+0000", 2024-09-13T06:40:54.656 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.0159999999999997e-06 2024-09-13T06:40:54.656 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.656 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.656 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:54.656 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589847+0000", 2024-09-13T06:40:54.656 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.6059999999999997e-06 2024-09-13T06:40:54.656 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.656 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.657 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:54.657 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.668620+0000", 2024-09-13T06:40:54.657 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.078773485000000004 2024-09-13T06:40:54.657 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.657 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.657 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:54.657 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.668798+0000", 2024-09-13T06:40:54.657 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000178233 2024-09-13T06:40:54.657 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.657 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.657 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:54.657 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.669190+0000", 2024-09-13T06:40:54.657 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00039143499999999998 2024-09-13T06:40:54.657 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:54.658 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:54.658 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:54.658 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.658 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.658 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43299 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 432128~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:40:54.658 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589881+0000", 2024-09-13T06:40:54.658 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 33.011688178, 2024-09-13T06:40:54.658 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.079693849999999997, 2024-09-13T06:40:54.658 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:54.658 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:54.658 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:54.658 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:54.658 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:54.659 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43299 2024-09-13T06:40:54.659 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.659 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:54.659 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.659 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:54.659 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589881+0000", 2024-09-13T06:40:54.659 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:54.659 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.659 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.659 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:54.659 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589881+0000", 2024-09-13T06:40:54.659 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:54.659 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.659 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.659 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:54.660 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589880+0000", 2024-09-13T06:40:54.660 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:54.660 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.660 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.660 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:54.660 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589884+0000", 2024-09-13T06:40:54.660 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.053e-06 2024-09-13T06:40:54.660 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.660 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.660 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:54.660 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589893+0000", 2024-09-13T06:40:54.660 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.2129999999999997e-06 2024-09-13T06:40:54.660 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.660 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.661 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:54.661 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589901+0000", 2024-09-13T06:40:54.661 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.6399999999999997e-06 2024-09-13T06:40:54.661 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.661 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.661 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:54.661 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.669213+0000", 2024-09-13T06:40:54.661 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.079312074999999996 2024-09-13T06:40:54.661 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.661 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.661 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:54.661 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.669281+0000", 2024-09-13T06:40:54.661 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.8322000000000001e-05 2024-09-13T06:40:54.661 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.662 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.662 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:54.662 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.669575+0000", 2024-09-13T06:40:54.662 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00029349699999999999 2024-09-13T06:40:54.662 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:54.662 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:54.662 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:54.662 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.662 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.662 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43300 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 446464~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:40:54.662 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589909+0000", 2024-09-13T06:40:54.662 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 33.011660282999998, 2024-09-13T06:40:54.662 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.080339496999999996, 2024-09-13T06:40:54.662 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:54.662 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:54.663 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:54.663 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:54.663 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:54.663 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43300 2024-09-13T06:40:54.663 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.663 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:54.663 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.663 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:54.663 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589909+0000", 2024-09-13T06:40:54.663 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:54.663 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.663 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.663 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:54.663 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589909+0000", 2024-09-13T06:40:54.663 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:54.664 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.664 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.664 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:54.664 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589908+0000", 2024-09-13T06:40:54.664 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:54.664 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.664 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.664 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:54.664 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589912+0000", 2024-09-13T06:40:54.664 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.9430000000000002e-06 2024-09-13T06:40:54.664 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.664 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.664 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:54.664 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589920+0000", 2024-09-13T06:40:54.665 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.3860000000000007e-06 2024-09-13T06:40:54.665 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.665 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.665 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:54.665 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589928+0000", 2024-09-13T06:40:54.665 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.3329999999999999e-06 2024-09-13T06:40:54.665 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.665 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.665 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:54.665 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.669651+0000", 2024-09-13T06:40:54.665 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.079723204000000006 2024-09-13T06:40:54.665 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.665 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.666 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:54.666 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.669840+0000", 2024-09-13T06:40:54.666 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000189397 2024-09-13T06:40:54.666 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.666 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.666 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:54.666 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.670248+0000", 2024-09-13T06:40:54.666 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00040811100000000001 2024-09-13T06:40:54.666 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:54.666 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:54.666 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:54.666 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.666 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.667 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43301 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 460800~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:40:54.667 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589934+0000", 2024-09-13T06:40:54.667 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 33.011635609000002, 2024-09-13T06:40:54.667 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.080747474999999999, 2024-09-13T06:40:54.667 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:54.667 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:54.667 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:54.667 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:54.667 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:54.667 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43301 2024-09-13T06:40:54.667 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.667 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:54.667 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.667 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:54.667 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589934+0000", 2024-09-13T06:40:54.668 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:54.668 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.668 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.668 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:54.668 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589934+0000", 2024-09-13T06:40:54.668 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:54.668 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.668 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.668 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:54.668 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589933+0000", 2024-09-13T06:40:54.668 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:54.668 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.669 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.669 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:54.669 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589936+0000", 2024-09-13T06:40:54.669 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.4599999999999999e-06 2024-09-13T06:40:54.669 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.669 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.669 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:54.669 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589945+0000", 2024-09-13T06:40:54.669 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.2430000000000005e-06 2024-09-13T06:40:54.669 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.669 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.669 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:54.669 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589952+0000", 2024-09-13T06:40:54.669 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.3289999999999996e-06 2024-09-13T06:40:54.670 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.670 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.670 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:54.670 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.670280+0000", 2024-09-13T06:40:54.670 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.080328514000000004 2024-09-13T06:40:54.670 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.670 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.670 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:54.670 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.670376+0000", 2024-09-13T06:40:54.670 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.5752000000000001e-05 2024-09-13T06:40:54.670 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.670 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.670 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:54.670 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.670681+0000", 2024-09-13T06:40:54.671 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00030479699999999999 2024-09-13T06:40:54.671 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:54.671 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:54.671 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:54.671 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.671 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.671 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43302 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 475136~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:40:54.671 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589958+0000", 2024-09-13T06:40:54.671 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 33.011611547000001, 2024-09-13T06:40:54.671 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.081402394000000003, 2024-09-13T06:40:54.671 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:54.671 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:54.671 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:54.671 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:54.672 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:54.672 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43302 2024-09-13T06:40:54.672 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.672 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:54.672 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.672 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:54.672 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589958+0000", 2024-09-13T06:40:54.672 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:54.672 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.672 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.672 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:54.672 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589958+0000", 2024-09-13T06:40:54.672 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:54.672 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.673 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.673 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:54.673 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589957+0000", 2024-09-13T06:40:54.673 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:54.673 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.673 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.673 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:54.673 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589960+0000", 2024-09-13T06:40:54.673 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.4939999999999999e-06 2024-09-13T06:40:54.673 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.673 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.674 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:54.674 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589969+0000", 2024-09-13T06:40:54.674 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.3520000000000007e-06 2024-09-13T06:40:54.674 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.674 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.674 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:54.674 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589976+0000", 2024-09-13T06:40:54.674 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.3030000000000002e-06 2024-09-13T06:40:54.674 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.674 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.674 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:54.674 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.670765+0000", 2024-09-13T06:40:54.674 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.080789154000000002 2024-09-13T06:40:54.674 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.675 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.675 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:54.675 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.670960+0000", 2024-09-13T06:40:54.675 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00019464300000000001 2024-09-13T06:40:54.675 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.675 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.675 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:54.675 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.671360+0000", 2024-09-13T06:40:54.675 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00040005200000000002 2024-09-13T06:40:54.675 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:54.675 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:54.675 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:54.675 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.676 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.676 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43303 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 489472~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:40:54.676 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589985+0000", 2024-09-13T06:40:54.676 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 33.011584599000003, 2024-09-13T06:40:54.676 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.082024333000000005, 2024-09-13T06:40:54.676 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:54.676 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:54.676 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:54.676 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:54.676 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:54.676 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43303 2024-09-13T06:40:54.677 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.677 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:54.677 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.677 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:54.677 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589985+0000", 2024-09-13T06:40:54.677 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:54.677 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.677 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.677 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:54.677 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589985+0000", 2024-09-13T06:40:54.677 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:54.677 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.677 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.677 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:54.678 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589984+0000", 2024-09-13T06:40:54.678 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:54.678 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.678 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.678 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:54.678 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589987+0000", 2024-09-13T06:40:54.678 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.726e-06 2024-09-13T06:40:54.678 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.678 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.678 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:54.678 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589996+0000", 2024-09-13T06:40:54.678 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.5459999999999992e-06 2024-09-13T06:40:54.678 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.678 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.678 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:54.679 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590003+0000", 2024-09-13T06:40:54.679 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.4229999999999999e-06 2024-09-13T06:40:54.679 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.679 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.679 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:54.679 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.671426+0000", 2024-09-13T06:40:54.679 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.081422704999999998 2024-09-13T06:40:54.679 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.679 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.679 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:54.679 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.671615+0000", 2024-09-13T06:40:54.679 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000188875 2024-09-13T06:40:54.679 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.679 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.680 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:54.680 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.672009+0000", 2024-09-13T06:40:54.680 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000394015 2024-09-13T06:40:54.680 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:54.680 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:54.680 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:54.680 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.680 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.680 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43304 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 503808~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:40:54.680 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.590039+0000", 2024-09-13T06:40:54.680 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 33.011530053999998, 2024-09-13T06:40:54.680 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.082573880000000002, 2024-09-13T06:40:54.680 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:54.681 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:54.681 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:54.681 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:54.681 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:54.681 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43304 2024-09-13T06:40:54.681 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.681 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:54.681 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.681 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:54.681 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590039+0000", 2024-09-13T06:40:54.681 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:54.681 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.681 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.681 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:54.681 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590039+0000", 2024-09-13T06:40:54.682 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:54.682 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.682 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.682 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:54.682 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590038+0000", 2024-09-13T06:40:54.683 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:54.683 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.683 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.683 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:54.683 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590042+0000", 2024-09-13T06:40:54.683 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.9500000000000003e-06 2024-09-13T06:40:54.683 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.683 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.683 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:54.683 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590052+0000", 2024-09-13T06:40:54.683 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.3919999999999992e-06 2024-09-13T06:40:54.683 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.683 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.684 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:54.684 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590059+0000", 2024-09-13T06:40:54.684 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.7970000000000001e-06 2024-09-13T06:40:54.684 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.684 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.684 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:54.684 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.672078+0000", 2024-09-13T06:40:54.684 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.082018778000000001 2024-09-13T06:40:54.684 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.684 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.684 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:54.684 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.672266+0000", 2024-09-13T06:40:54.684 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00018807399999999999 2024-09-13T06:40:54.684 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.685 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.685 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:54.685 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.672613+0000", 2024-09-13T06:40:54.685 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00034677599999999997 2024-09-13T06:40:54.685 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:54.685 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:54.685 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:54.685 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.685 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.685 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43305 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 518144~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:40:54.685 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.590136+0000", 2024-09-13T06:40:54.685 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 33.011432866, 2024-09-13T06:40:54.685 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.082988206999999994, 2024-09-13T06:40:54.686 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:54.686 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:54.686 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:54.686 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:54.686 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:54.686 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43305 2024-09-13T06:40:54.686 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.686 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:54.686 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.686 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:54.686 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590136+0000", 2024-09-13T06:40:54.686 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:54.686 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.686 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.686 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:54.687 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590136+0000", 2024-09-13T06:40:54.687 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:54.687 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.687 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.687 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:54.687 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590135+0000", 2024-09-13T06:40:54.687 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:54.687 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.687 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.687 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:54.687 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590139+0000", 2024-09-13T06:40:54.687 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.9489999999999998e-06 2024-09-13T06:40:54.687 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.688 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.688 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:54.688 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590148+0000", 2024-09-13T06:40:54.688 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.9830000000000002e-06 2024-09-13T06:40:54.688 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.688 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.688 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:54.688 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590156+0000", 2024-09-13T06:40:54.688 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5229999999999998e-06 2024-09-13T06:40:54.688 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.689 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.689 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:54.689 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.672709+0000", 2024-09-13T06:40:54.689 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.082552886000000006 2024-09-13T06:40:54.689 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.689 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.689 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:54.689 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.672816+0000", 2024-09-13T06:40:54.689 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000107736 2024-09-13T06:40:54.689 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.689 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.690 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:54.690 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.673124+0000", 2024-09-13T06:40:54.690 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00030804900000000002 2024-09-13T06:40:54.690 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:54.690 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:54.690 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:54.690 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.690 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.690 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:66818 3.17 3.50afe697 (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e100)", 2024-09-13T06:40:54.690 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:53.498942+0000", 2024-09-13T06:40:54.690 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 1.1026266810000001, 2024-09-13T06:40:54.690 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.011231284, 2024-09-13T06:40:54.691 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:54.691 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:40:54.691 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:54.691 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:54.691 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:54.691 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 66818 2024-09-13T06:40:54.691 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.691 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:54.691 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.691 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:54.691 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:53.498942+0000", 2024-09-13T06:40:54.691 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:54.691 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.692 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.692 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:54.692 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:53.498942+0000", 2024-09-13T06:40:54.692 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:54.692 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.692 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.692 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:54.692 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:53.498939+0000", 2024-09-13T06:40:54.692 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999967 2024-09-13T06:40:54.692 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.692 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.692 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:54.693 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:53.498954+0000", 2024-09-13T06:40:54.693 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5028000000000001e-05 2024-09-13T06:40:54.693 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.693 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.693 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:54.693 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:53.498986+0000", 2024-09-13T06:40:54.693 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.1993999999999999e-05 2024-09-13T06:40:54.693 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.693 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.693 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:54.693 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:53.499001+0000", 2024-09-13T06:40:54.693 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5166e-05 2024-09-13T06:40:54.693 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.694 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.694 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:54.694 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:53.505097+0000", 2024-09-13T06:40:54.694 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0060955610000000002 2024-09-13T06:40:54.694 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.694 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.694 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:40:54.694 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:53.505108+0000", 2024-09-13T06:40:54.694 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.084e-05 2024-09-13T06:40:54.694 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.694 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.694 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:54.695 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:54.510158+0000", 2024-09-13T06:40:54.695 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0050497549999999 2024-09-13T06:40:54.695 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:54.695 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:54.695 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:54.695 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:54.510174+0000", 2024-09-13T06:40:54.695 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6164e-05 2024-09-13T06:40:54.695 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:54.695 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:54.695 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:54.695 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:54.695 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:54.695 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:40:54.696 INFO:teuthology.orchestra.run.smithi081.stdout:osd.0: {} 2024-09-13T06:40:54.697 INFO:teuthology.orchestra.run.smithi081.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-13T06:40:54.697 INFO:teuthology.orchestra.run.smithi081.stdout:osd.1: {} 2024-09-13T06:40:54.698 INFO:teuthology.orchestra.run.smithi081.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-13T06:40:54.698 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-13T06:40:54.699 INFO:teuthology.orchestra.run.smithi081.stdout:osd.2: {} 2024-09-13T06:40:54.699 INFO:teuthology.orchestra.run.smithi081.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-13T06:40:54.699 INFO:teuthology.orchestra.run.smithi081.stdout:osd.3: {} 2024-09-13T06:40:54.700 INFO:teuthology.orchestra.run.smithi081.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-13T06:40:54.700 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:40:54.695+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:40:54.708 INFO:teuthology.orchestra.run.smithi081.stdout:osd.4: {} 2024-09-13T06:40:54.708 INFO:teuthology.orchestra.run.smithi081.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-13T06:40:54.731 INFO:teuthology.orchestra.run.smithi081.stdout:osd.5: {} 2024-09-13T06:40:54.732 INFO:teuthology.orchestra.run.smithi081.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-13T06:40:54.750 INFO:teuthology.orchestra.run.smithi081.stdout:osd.6: {} 2024-09-13T06:40:54.750 INFO:teuthology.orchestra.run.smithi081.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-13T06:40:54.768 INFO:teuthology.orchestra.run.smithi081.stdout:osd.7: {} 2024-09-13T06:40:54.768 INFO:teuthology.orchestra.run.smithi081.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-13T06:40:54.826 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:40:54.826 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:40:54.829 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:40:54.831+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:40:54.840 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-13T06:40:54.899 INFO:tasks.ceph.osd.6.smithi139.stderr:2024-09-13T06:40:54.901+0000 7fcd02c5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26385) UID: 0 2024-09-13T06:40:54.964 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:40:54.964 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:40:54.978 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-13T06:40:55.023 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-13T06:40:55.025+0000 7f86a5f06640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26387) UID: 0 2024-09-13T06:40:55.101 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:40:55.099+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:40:55.144 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:40:55.144 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:40:55.158 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-13T06:40:55.202 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:40:55.203+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:40:55.275 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:40:55.275 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:40:55.289 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-13T06:40:55.302 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:40:55.303+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:40:55.403 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:40:55.403+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:40:55.412 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:40:55.412 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:40:55.427 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-13T06:40:55.504 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:40:55.503+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:40:55.530 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-13T06:40:55.567 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:40:55.567 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:40:55.582 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-13T06:40:55.583 INFO:teuthology.orchestra.run.smithi081.stdout:2569 trunc from 0xe29729e to 0xceb49e 2024-09-13T06:40:55.605 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:40:55.605+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:40:55.647 INFO:teuthology.orchestra.run.smithi081.stdout:2570 write 0xa3d2a8d thru 0xa3d4792 (0x1d06 bytes) 2024-09-13T06:40:55.651 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:40:55.651 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:40:55.651 INFO:teuthology.orchestra.run.smithi081.stdout:2573 punch from 0x20dbc09 to 0x20e41c9, (0x85c0 bytes) 2024-09-13T06:40:55.660 INFO:teuthology.orchestra.run.smithi081.stdout:2575 write 0xaa73ae9 thru 0xaa8343b (0xf953 bytes) 2024-09-13T06:40:55.683 INFO:teuthology.orchestra.run.smithi081.stdout:2576 write 0xdb44b4e thru 0xdb4d7a0 (0x8c53 bytes) 2024-09-13T06:40:55.687 INFO:teuthology.orchestra.run.smithi081.stdout:2577 write 0x7e2e206 thru 0x7e32b21 (0x491c bytes) 2024-09-13T06:40:55.693 INFO:teuthology.orchestra.run.smithi081.stdout:2581 read 0xc7a7a05 thru 0xc7acecd (0x54c9 bytes) 2024-09-13T06:40:55.693 INFO:teuthology.orchestra.run.smithi081.stdout:2582 write 0xb1ce163 thru 0xb1d1ef9 (0x3d97 bytes) 2024-09-13T06:40:55.706 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:40:55.707+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:40:55.711 INFO:teuthology.orchestra.run.smithi081.stdout:2584 trunc from 0xdb4d7a1 to 0x690e417 2024-09-13T06:40:55.730 INFO:teuthology.orchestra.run.smithi081.stdout:2585 trunc from 0x690e417 to 0x6438dba 2024-09-13T06:40:55.734 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:40:55.734 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:40:55.740 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:40:55.751 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-13T06:40:55.752 INFO:teuthology.orchestra.run.smithi081.stdout:2588 write 0x7ad0e0a thru 0x7ad59f4 (0x4beb bytes) 2024-09-13T06:40:55.758 INFO:teuthology.orchestra.run.smithi081.stdout:2589 writesame 0x7be635 thru 0x7c5918 data_size 0x81(0x72e4 bytes) 2024-09-13T06:40:55.769 INFO:teuthology.orchestra.run.smithi081.stdout:2590 trunc from 0x7ad59f5 to 0x2136057 2024-09-13T06:40:55.805 INFO:teuthology.orchestra.run.smithi081.stdout:2592 writesame 0x725d56f thru 0x72668cf data_size 0x1d(0x9361 bytes) 2024-09-13T06:40:55.805 INFO:teuthology.orchestra.run.smithi081.stdout:2594 writesame 0x2975bd8 thru 0x297934f data_size 0x47(0x3778 bytes) 2024-09-13T06:40:55.806 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-13T06:40:55.805+0000 7f86a5f06640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26387) UID: 0 2024-09-13T06:40:55.819 INFO:teuthology.orchestra.run.smithi081.stdout:2596 trunc from 0x72668d0 to 0x98ab82 2024-09-13T06:40:55.852 INFO:teuthology.orchestra.run.smithi081.stdout:2597 punch from 0x663254 to 0x66ad42, (0x7aee bytes) 2024-09-13T06:40:55.873 INFO:teuthology.orchestra.run.smithi081.stdout:2598 write 0x927c323 thru 0x927d643 (0x1321 bytes) 2024-09-13T06:40:55.886 INFO:teuthology.orchestra.run.smithi081.stdout:2599 trunc from 0x927d644 to 0x3abea2e 2024-09-13T06:40:55.889 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:40:55.889 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:40:55.903 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:40:55.904 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-13T06:40:55.912 INFO:teuthology.orchestra.run.smithi081.stdout:2601 trunc from 0x3abea2e to 0x9d63e21 2024-09-13T06:40:55.913 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:40:55.915+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:40:55.923 INFO:teuthology.orchestra.run.smithi081.stdout:2602 write 0x110febb thru 0x1119c1c (0x9d62 bytes) 2024-09-13T06:40:55.933 INFO:teuthology.orchestra.run.smithi081.stdout:2604 punch from 0x144aaa9 to 0x1452f4e, (0x84a5 bytes) 2024-09-13T06:40:55.934 INFO:teuthology.orchestra.run.smithi081.stdout:2606 trunc from 0x9d63e21 to 0xa68911c 2024-09-13T06:40:55.943 INFO:teuthology.orchestra.run.smithi081.stdout:2607 clone 17 order 20 su 262144 sc 6 2024-09-13T06:40:56.008 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:40:56.007+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:40:56.032 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:40:56.032 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:40:56.046 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-13T06:40:56.109 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-13T06:40:56.109+0000 7f86a5f06640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26387) UID: 0 2024-09-13T06:40:56.210 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-13T06:40:56.209+0000 7f86a5f06640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26387) UID: 0 2024-09-13T06:40:56.212 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:40:56.212 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:40:56.227 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-13T06:40:56.311 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:40:56.311+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:40:56.349 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:40:56.349 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:40:56.363 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-13T06:40:56.367 INFO:teuthology.orchestra.run.smithi081.stderr:noscrub is unset 2024-09-13T06:40:56.449 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:40:56.451+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:40:56.497 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:40:56.498 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:40:56.512 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-13T06:40:56.513 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:40:56.513+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:40:56.614 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:40:56.613+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:40:56.682 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:40:56.682 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:40:56.696 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-13T06:40:56.715 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:40:56.717+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:40:56.786 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-13T06:40:56.816 INFO:tasks.ceph.osd.6.smithi139.stderr:2024-09-13T06:40:56.817+0000 7fcd02c5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26385) UID: 0 2024-09-13T06:40:56.822 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:40:56.822 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:40:56.837 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-13T06:40:56.925 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:40:56.927+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:40:56.933 INFO:teuthology.orchestra.run.smithi081.stdout:osd.0: {} 2024-09-13T06:40:56.934 INFO:teuthology.orchestra.run.smithi081.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-13T06:40:56.950 INFO:teuthology.orchestra.run.smithi081.stdout:osd.1: {} 2024-09-13T06:40:56.950 INFO:teuthology.orchestra.run.smithi081.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-13T06:40:56.967 INFO:teuthology.orchestra.run.smithi081.stdout:osd.2: {} 2024-09-13T06:40:56.967 INFO:teuthology.orchestra.run.smithi081.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-13T06:40:56.984 INFO:teuthology.orchestra.run.smithi081.stdout:osd.3: {} 2024-09-13T06:40:56.984 INFO:teuthology.orchestra.run.smithi081.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-13T06:40:57.009 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:40:57.010 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 20, 2024-09-13T06:40:57.010 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 600, 2024-09-13T06:40:57.010 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [ 2024-09-13T06:40:57.010 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.010 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:36160 3.f 3:f62782c2:::rbd_object_map.11219660270d.0000000000000016:head [call] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-13T06:40:57.010 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:01.607291+0000", 2024-09-13T06:40:57.010 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 55.402086064999999, 2024-09-13T06:40:57.010 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.99619456699999998, 2024-09-13T06:40:57.010 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:57.010 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:57.010 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:57.011 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:57.011 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:57.011 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 36160 2024-09-13T06:40:57.011 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.011 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:57.011 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.011 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:57.011 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:01.607291+0000", 2024-09-13T06:40:57.011 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:57.011 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.011 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.011 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:57.012 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:01.607291+0000", 2024-09-13T06:40:57.012 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:57.012 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.012 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.012 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:57.012 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:01.607289+0000", 2024-09-13T06:40:57.012 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999976 2024-09-13T06:40:57.012 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.012 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.012 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:57.012 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:01.607302+0000", 2024-09-13T06:40:57.012 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3018e-05 2024-09-13T06:40:57.012 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.013 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.013 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:57.013 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:01.607323+0000", 2024-09-13T06:40:57.013 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1030999999999999e-05 2024-09-13T06:40:57.013 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.013 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.013 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:57.013 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:01.607342+0000", 2024-09-13T06:40:57.013 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8961e-05 2024-09-13T06:40:57.013 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.013 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.014 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:57.014 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:01.607425+0000", 2024-09-13T06:40:57.014 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.3171999999999996e-05 2024-09-13T06:40:57.014 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.014 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.014 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:40:57.014 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:01.607441+0000", 2024-09-13T06:40:57.014 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5996999999999999e-05 2024-09-13T06:40:57.014 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.014 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.014 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:57.014 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:02.596186+0000", 2024-09-13T06:40:57.014 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.98874432000000001 2024-09-13T06:40:57.014 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.014 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.015 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for missing object", 2024-09-13T06:40:57.015 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:02.596618+0000", 2024-09-13T06:40:57.015 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000432032 2024-09-13T06:40:57.015 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.015 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.015 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:57.015 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:02.600845+0000", 2024-09-13T06:40:57.015 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0042277410000000001 2024-09-13T06:40:57.015 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.015 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.015 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:57.015 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:02.601003+0000", 2024-09-13T06:40:57.015 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00015731999999999999 2024-09-13T06:40:57.015 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.016 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.016 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:57.016 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:02.603486+0000", 2024-09-13T06:40:57.016 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0024832510000000001 2024-09-13T06:40:57.016 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:57.016 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:57.016 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:57.016 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.016 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.016 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:37806 3.9 3:951cb95b:::rbd_data.1121d8143c6e.0000000000000002:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e56)", 2024-09-13T06:40:57.016 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:06.373482+0000", 2024-09-13T06:40:57.016 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 50.635895028999997, 2024-09-13T06:40:57.016 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.002476213, 2024-09-13T06:40:57.017 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:57.017 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:57.017 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:57.017 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:57.017 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:57.017 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 37806 2024-09-13T06:40:57.017 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.017 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:57.017 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.017 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:57.017 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.373482+0000", 2024-09-13T06:40:57.017 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:57.017 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.018 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.018 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:57.018 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.373482+0000", 2024-09-13T06:40:57.018 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:57.018 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.018 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.018 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:57.018 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.373479+0000", 2024-09-13T06:40:57.018 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999962 2024-09-13T06:40:57.018 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.018 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.018 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:57.018 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.373495+0000", 2024-09-13T06:40:57.019 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6640999999999999e-05 2024-09-13T06:40:57.019 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.019 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.019 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:57.019 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.373542+0000", 2024-09-13T06:40:57.019 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6229000000000001e-05 2024-09-13T06:40:57.019 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.019 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.019 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:57.019 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.373564+0000", 2024-09-13T06:40:57.019 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2684000000000002e-05 2024-09-13T06:40:57.019 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.019 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.020 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:57.020 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374268+0000", 2024-09-13T06:40:57.020 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00070363700000000001 2024-09-13T06:40:57.020 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.020 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.020 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:40:57.020 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374305+0000", 2024-09-13T06:40:57.020 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.6936e-05 2024-09-13T06:40:57.020 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.020 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.020 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:57.020 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.375175+0000", 2024-09-13T06:40:57.020 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.000870454 2024-09-13T06:40:57.020 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.021 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.021 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:57.021 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.375678+0000", 2024-09-13T06:40:57.021 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00050292499999999999 2024-09-13T06:40:57.021 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.021 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.021 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:57.021 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.375959+0000", 2024-09-13T06:40:57.021 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00028050599999999997 2024-09-13T06:40:57.021 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:57.021 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:57.021 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:57.021 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.022 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.022 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:37821 3.9 3:951cb95b:::rbd_data.1121d8143c6e.0000000000000002:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e56)", 2024-09-13T06:40:57.022 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:06.374454+0000", 2024-09-13T06:40:57.022 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 50.634923911999998, 2024-09-13T06:40:57.022 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.002545072, 2024-09-13T06:40:57.022 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:57.022 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:57.022 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:57.022 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:57.022 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:57.022 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 37821 2024-09-13T06:40:57.022 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.023 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:57.023 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.023 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:57.023 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374454+0000", 2024-09-13T06:40:57.023 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:57.023 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.023 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.023 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:57.023 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374454+0000", 2024-09-13T06:40:57.023 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:57.023 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.023 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.023 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:57.024 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374452+0000", 2024-09-13T06:40:57.024 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999981 2024-09-13T06:40:57.024 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.024 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.024 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:57.024 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374463+0000", 2024-09-13T06:40:57.024 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0756e-05 2024-09-13T06:40:57.024 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.024 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.024 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:57.024 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374487+0000", 2024-09-13T06:40:57.024 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4887000000000001e-05 2024-09-13T06:40:57.025 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.025 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.025 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:57.025 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374504+0000", 2024-09-13T06:40:57.025 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6852000000000001e-05 2024-09-13T06:40:57.025 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.025 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.025 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:57.025 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374829+0000", 2024-09-13T06:40:57.025 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000324684 2024-09-13T06:40:57.025 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.025 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.025 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:40:57.025 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374880+0000", 2024-09-13T06:40:57.026 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.1378000000000002e-05 2024-09-13T06:40:57.026 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.026 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.026 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:57.026 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.376423+0000", 2024-09-13T06:40:57.026 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.001542734 2024-09-13T06:40:57.026 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.026 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.026 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:57.026 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.376607+0000", 2024-09-13T06:40:57.026 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000183656 2024-09-13T06:40:57.026 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.026 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.026 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:57.026 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.376999+0000", 2024-09-13T06:40:57.027 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00039191200000000001 2024-09-13T06:40:57.027 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:57.027 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:57.027 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:57.027 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.027 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.027 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:37836 3.9 3:951cb95b:::rbd_data.1121d8143c6e.0000000000000002:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e56)", 2024-09-13T06:40:57.027 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:06.374929+0000", 2024-09-13T06:40:57.027 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 50.634448259999999, 2024-09-13T06:40:57.027 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.002778825, 2024-09-13T06:40:57.027 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:57.027 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:57.027 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:57.027 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:57.028 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:57.028 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 37836 2024-09-13T06:40:57.028 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.028 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:57.028 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.028 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:57.028 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374929+0000", 2024-09-13T06:40:57.028 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:57.028 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.028 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.028 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:57.028 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374929+0000", 2024-09-13T06:40:57.028 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:57.029 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.029 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.029 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:57.029 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374927+0000", 2024-09-13T06:40:57.029 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999981 2024-09-13T06:40:57.029 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.029 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.029 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:57.029 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374939+0000", 2024-09-13T06:40:57.029 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1846e-05 2024-09-13T06:40:57.029 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.029 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.030 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:57.030 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374962+0000", 2024-09-13T06:40:57.030 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3054e-05 2024-09-13T06:40:57.030 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.030 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.030 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:57.030 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374978+0000", 2024-09-13T06:40:57.030 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5899000000000001e-05 2024-09-13T06:40:57.030 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.030 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.030 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:57.030 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.375106+0000", 2024-09-13T06:40:57.030 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00012789 2024-09-13T06:40:57.030 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.031 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.031 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:40:57.031 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.375134+0000", 2024-09-13T06:40:57.031 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.8254000000000001e-05 2024-09-13T06:40:57.031 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.031 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.031 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:57.031 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.377082+0000", 2024-09-13T06:40:57.031 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0019471520000001 2024-09-13T06:40:57.031 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.031 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.031 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:57.031 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.377330+0000", 2024-09-13T06:40:57.031 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00024834199999999997 2024-09-13T06:40:57.031 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.032 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.032 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:57.032 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.377708+0000", 2024-09-13T06:40:57.032 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00037817100000000001 2024-09-13T06:40:57.032 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:57.032 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:57.032 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:57.032 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.032 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.032 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:37851 3.9 3:951cb95b:::rbd_data.1121d8143c6e.0000000000000002:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e56)", 2024-09-13T06:40:57.032 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:06.382636+0000", 2024-09-13T06:40:57.032 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 50.626741375000002, 2024-09-13T06:40:57.032 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.99582539400000003, 2024-09-13T06:40:57.033 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:57.033 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:57.033 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:57.033 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:57.033 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:57.033 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 37851 2024-09-13T06:40:57.033 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.033 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:57.033 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.033 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:57.033 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.382636+0000", 2024-09-13T06:40:57.033 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:57.033 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.034 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.034 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:57.034 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.382636+0000", 2024-09-13T06:40:57.034 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:57.034 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.034 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.034 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:57.034 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.382633+0000", 2024-09-13T06:40:57.034 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999971 2024-09-13T06:40:57.034 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.034 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.034 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:57.034 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.382652+0000", 2024-09-13T06:40:57.035 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8834999999999998e-05 2024-09-13T06:40:57.035 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.035 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.035 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:57.035 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.382695+0000", 2024-09-13T06:40:57.035 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.3136000000000002e-05 2024-09-13T06:40:57.035 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.035 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.035 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:57.035 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.382716+0000", 2024-09-13T06:40:57.035 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1421e-05 2024-09-13T06:40:57.035 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.035 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.035 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:57.036 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.382860+0000", 2024-09-13T06:40:57.036 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00014389200000000001 2024-09-13T06:40:57.036 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.036 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.036 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:40:57.036 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.382890+0000", 2024-09-13T06:40:57.036 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9827000000000001e-05 2024-09-13T06:40:57.036 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.036 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.036 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:57.036 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.377779+0000", 2024-09-13T06:40:57.036 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.99488842899999996 2024-09-13T06:40:57.036 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.036 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.036 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:57.037 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.378007+0000", 2024-09-13T06:40:57.037 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00022838099999999999 2024-09-13T06:40:57.037 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.037 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.037 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:57.037 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.378462+0000", 2024-09-13T06:40:57.037 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00045452300000000003 2024-09-13T06:40:57.037 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:57.037 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:57.037 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:57.037 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.037 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.037 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:37866 3.9 3:951cb95b:::rbd_data.1121d8143c6e.0000000000000002:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e56)", 2024-09-13T06:40:57.037 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:06.383951+0000", 2024-09-13T06:40:57.038 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 50.625426689000001, 2024-09-13T06:40:57.038 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.99517962299999996, 2024-09-13T06:40:57.038 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:57.038 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:57.038 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:57.038 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:57.038 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:57.038 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 37866 2024-09-13T06:40:57.038 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.038 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:57.038 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.038 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:57.038 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.383951+0000", 2024-09-13T06:40:57.038 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:57.039 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.039 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.039 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:57.039 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.383951+0000", 2024-09-13T06:40:57.039 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:57.039 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.039 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.039 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:57.039 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.383949+0000", 2024-09-13T06:40:57.039 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999981 2024-09-13T06:40:57.039 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.039 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.039 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:57.039 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.383961+0000", 2024-09-13T06:40:57.040 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1999e-05 2024-09-13T06:40:57.040 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.040 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.040 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:57.040 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384019+0000", 2024-09-13T06:40:57.040 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7621000000000003e-05 2024-09-13T06:40:57.040 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.040 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.040 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:57.040 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384040+0000", 2024-09-13T06:40:57.040 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1528000000000001e-05 2024-09-13T06:40:57.040 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.040 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.040 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:57.040 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384186+0000", 2024-09-13T06:40:57.041 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00014573799999999999 2024-09-13T06:40:57.041 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.041 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.041 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:40:57.041 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384204+0000", 2024-09-13T06:40:57.041 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7992e-05 2024-09-13T06:40:57.041 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.041 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.041 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:57.041 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.378536+0000", 2024-09-13T06:40:57.041 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.99433268600000002 2024-09-13T06:40:57.041 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.041 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.041 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:57.041 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.378771+0000", 2024-09-13T06:40:57.042 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00023445399999999999 2024-09-13T06:40:57.042 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.042 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.042 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:57.042 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.379130+0000", 2024-09-13T06:40:57.042 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00035954200000000002 2024-09-13T06:40:57.042 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:57.042 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:57.042 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:57.042 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.042 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.042 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:37881 3.9 3:951cb95b:::rbd_data.1121d8143c6e.0000000000000002:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e56)", 2024-09-13T06:40:57.042 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:06.384239+0000", 2024-09-13T06:40:57.043 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 50.625138274999998, 2024-09-13T06:40:57.043 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.99541483500000005, 2024-09-13T06:40:57.043 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:57.043 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:57.043 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:57.043 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:57.043 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:57.043 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 37881 2024-09-13T06:40:57.043 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.043 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:57.043 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.043 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:57.043 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384239+0000", 2024-09-13T06:40:57.044 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:57.044 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.044 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.044 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:57.044 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384239+0000", 2024-09-13T06:40:57.044 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:57.044 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.044 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.044 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:57.044 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384238+0000", 2024-09-13T06:40:57.044 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999986 2024-09-13T06:40:57.044 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.044 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.045 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:57.045 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384246+0000", 2024-09-13T06:40:57.045 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.2449999999999998e-06 2024-09-13T06:40:57.045 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.045 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.045 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:57.045 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384268+0000", 2024-09-13T06:40:57.045 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1518e-05 2024-09-13T06:40:57.045 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.045 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.045 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:57.045 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384282+0000", 2024-09-13T06:40:57.045 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4501999999999999e-05 2024-09-13T06:40:57.045 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.046 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.046 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:57.046 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384356+0000", 2024-09-13T06:40:57.046 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4265999999999997e-05 2024-09-13T06:40:57.046 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.046 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.046 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:40:57.046 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384370+0000", 2024-09-13T06:40:57.046 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3942e-05 2024-09-13T06:40:57.046 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.046 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.046 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:57.046 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.379199+0000", 2024-09-13T06:40:57.047 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.99482866599999997 2024-09-13T06:40:57.047 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.047 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.047 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:57.047 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.379347+0000", 2024-09-13T06:40:57.047 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00014749199999999999 2024-09-13T06:40:57.047 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.047 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.047 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:57.047 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.379654+0000", 2024-09-13T06:40:57.047 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00030752999999999998 2024-09-13T06:40:57.047 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:57.047 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:57.047 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:57.047 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.048 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.048 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:37896 3.9 3:951cb95b:::rbd_data.1121d8143c6e.0000000000000002:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e56)", 2024-09-13T06:40:57.048 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:06.384412+0000", 2024-09-13T06:40:57.048 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 50.624965842000002, 2024-09-13T06:40:57.048 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.99777835999999998, 2024-09-13T06:40:57.048 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:57.048 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:57.048 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:57.048 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:57.048 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:57.048 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 37896 2024-09-13T06:40:57.048 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.048 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:57.048 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.049 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:57.049 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384412+0000", 2024-09-13T06:40:57.049 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:57.049 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.049 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.049 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:57.049 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384412+0000", 2024-09-13T06:40:57.049 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:57.049 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.049 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.049 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:57.049 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384410+0000", 2024-09-13T06:40:57.049 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.999999 2024-09-13T06:40:57.049 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.050 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.050 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:57.050 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384418+0000", 2024-09-13T06:40:57.050 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.486e-06 2024-09-13T06:40:57.050 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.050 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.050 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:57.050 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384436+0000", 2024-09-13T06:40:57.050 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7668000000000001e-05 2024-09-13T06:40:57.050 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.050 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.050 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:57.050 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384449+0000", 2024-09-13T06:40:57.050 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3395e-05 2024-09-13T06:40:57.051 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.051 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.051 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:57.051 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384605+0000", 2024-09-13T06:40:57.051 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00015563099999999999 2024-09-13T06:40:57.051 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.051 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.051 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:40:57.051 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384635+0000", 2024-09-13T06:40:57.051 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.0383999999999999e-05 2024-09-13T06:40:57.051 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.051 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.051 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:57.051 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.379730+0000", 2024-09-13T06:40:57.051 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.99509493999999998 2024-09-13T06:40:57.051 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.052 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.052 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:57.052 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.379964+0000", 2024-09-13T06:40:57.052 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00023353499999999999 2024-09-13T06:40:57.052 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.052 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.052 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:57.052 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.382190+0000", 2024-09-13T06:40:57.052 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0022265039999999998 2024-09-13T06:40:57.052 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:57.052 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:57.052 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:57.052 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.052 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.053 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43222 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 389120~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:40:57.053 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558181+0000", 2024-09-13T06:40:57.053 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 35.451196588000002, 2024-09-13T06:40:57.053 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.06252038, 2024-09-13T06:40:57.053 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:57.053 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:57.053 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:57.053 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:57.053 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:57.053 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43222 2024-09-13T06:40:57.053 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.053 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:57.054 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.054 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:57.054 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558181+0000", 2024-09-13T06:40:57.054 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:57.054 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.054 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.054 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:57.054 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558181+0000", 2024-09-13T06:40:57.054 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:57.054 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.054 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.054 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:57.055 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558181+0000", 2024-09-13T06:40:57.055 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:57.055 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.055 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.055 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:57.055 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558183+0000", 2024-09-13T06:40:57.055 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.857e-06 2024-09-13T06:40:57.055 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.055 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.055 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:57.055 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558188+0000", 2024-09-13T06:40:57.055 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3759999999999999e-06 2024-09-13T06:40:57.055 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.056 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.056 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:57.056 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558261+0000", 2024-09-13T06:40:57.056 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3097999999999997e-05 2024-09-13T06:40:57.056 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.056 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.056 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:57.056 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.620354+0000", 2024-09-13T06:40:57.056 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.062092587999999997 2024-09-13T06:40:57.056 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.056 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.056 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:57.056 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.620428+0000", 2024-09-13T06:40:57.057 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3954000000000004e-05 2024-09-13T06:40:57.057 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.057 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.057 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:57.057 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.620701+0000", 2024-09-13T06:40:57.057 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000273773 2024-09-13T06:40:57.057 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:57.057 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:57.057 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:57.057 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.057 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.057 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43223 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 393216~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:40:57.057 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558267+0000", 2024-09-13T06:40:57.057 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 35.451110530999998, 2024-09-13T06:40:57.058 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.062813151999999997, 2024-09-13T06:40:57.058 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:57.058 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:57.058 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:57.058 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:57.058 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:57.058 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43223 2024-09-13T06:40:57.058 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.058 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:57.058 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.058 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:57.058 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558267+0000", 2024-09-13T06:40:57.058 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:57.059 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.059 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.059 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:57.059 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558267+0000", 2024-09-13T06:40:57.059 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:57.059 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.059 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.059 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:57.059 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558266+0000", 2024-09-13T06:40:57.059 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:57.059 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.059 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.059 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:57.059 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558270+0000", 2024-09-13T06:40:57.060 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.2389999999999998e-06 2024-09-13T06:40:57.060 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.060 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.060 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:57.060 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558277+0000", 2024-09-13T06:40:57.060 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5680000000000002e-06 2024-09-13T06:40:57.060 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.060 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.060 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:57.060 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558282+0000", 2024-09-13T06:40:57.060 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7060000000000003e-06 2024-09-13T06:40:57.060 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.060 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.060 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:57.060 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.620731+0000", 2024-09-13T06:40:57.060 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.062448661000000003 2024-09-13T06:40:57.061 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.061 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.061 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:57.061 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.620806+0000", 2024-09-13T06:40:57.061 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5862e-05 2024-09-13T06:40:57.061 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.061 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.061 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:57.061 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.621080+0000", 2024-09-13T06:40:57.061 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00027368599999999998 2024-09-13T06:40:57.061 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:57.061 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:57.061 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:57.062 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.062 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.062 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43224 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 407552~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:40:57.062 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558286+0000", 2024-09-13T06:40:57.062 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 35.451091167000001, 2024-09-13T06:40:57.062 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.063179052999999999, 2024-09-13T06:40:57.062 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:57.062 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:57.062 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:57.062 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:57.062 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:57.062 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43224 2024-09-13T06:40:57.062 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.062 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:57.062 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.063 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:57.063 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558286+0000", 2024-09-13T06:40:57.063 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:57.063 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.063 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.063 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:57.063 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558286+0000", 2024-09-13T06:40:57.063 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:57.063 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.063 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.063 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:57.063 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558286+0000", 2024-09-13T06:40:57.063 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:57.063 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.064 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.064 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:57.064 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558288+0000", 2024-09-13T06:40:57.064 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.227e-06 2024-09-13T06:40:57.064 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.064 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.064 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:57.064 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558292+0000", 2024-09-13T06:40:57.064 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.6289999999999999e-06 2024-09-13T06:40:57.064 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.064 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.064 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:57.064 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558294+0000", 2024-09-13T06:40:57.065 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5409999999999999e-06 2024-09-13T06:40:57.065 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.065 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.065 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:57.065 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.621110+0000", 2024-09-13T06:40:57.065 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.062815776000000004 2024-09-13T06:40:57.065 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.065 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.065 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:57.065 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.621186+0000", 2024-09-13T06:40:57.065 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5570999999999999e-05 2024-09-13T06:40:57.065 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.065 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.065 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:57.065 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.621465+0000", 2024-09-13T06:40:57.066 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00027988200000000001 2024-09-13T06:40:57.066 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:57.066 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:57.066 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:57.066 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.066 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.066 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43225 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 421888~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:40:57.066 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558296+0000", 2024-09-13T06:40:57.066 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 35.451081199999997, 2024-09-13T06:40:57.066 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.063551110999999993, 2024-09-13T06:40:57.066 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:57.066 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:57.066 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:57.067 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:57.067 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:57.067 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43225 2024-09-13T06:40:57.067 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.067 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:57.067 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.067 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:57.067 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558296+0000", 2024-09-13T06:40:57.067 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:57.067 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.067 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.067 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:57.067 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558296+0000", 2024-09-13T06:40:57.067 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:57.067 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.068 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.068 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:57.068 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558296+0000", 2024-09-13T06:40:57.068 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:40:57.068 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.068 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.068 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:57.068 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558305+0000", 2024-09-13T06:40:57.068 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.5290000000000008e-06 2024-09-13T06:40:57.068 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.068 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.068 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:57.068 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558308+0000", 2024-09-13T06:40:57.068 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.5619999999999999e-06 2024-09-13T06:40:57.069 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.069 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.069 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:57.069 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558311+0000", 2024-09-13T06:40:57.069 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.43e-06 2024-09-13T06:40:57.069 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.069 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.069 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:57.069 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.621495+0000", 2024-09-13T06:40:57.069 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.063184289000000005 2024-09-13T06:40:57.069 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.069 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.069 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:57.070 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.621569+0000", 2024-09-13T06:40:57.070 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4250000000000002e-05 2024-09-13T06:40:57.070 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.070 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.070 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:57.070 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.621847+0000", 2024-09-13T06:40:57.070 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00027826400000000002 2024-09-13T06:40:57.070 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:57.070 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:57.070 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:57.070 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.070 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.070 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43226 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 436224~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:40:57.070 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558313+0000", 2024-09-13T06:40:57.071 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 35.451064563999999, 2024-09-13T06:40:57.071 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.063914420999999999, 2024-09-13T06:40:57.071 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:57.071 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:57.071 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:57.071 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:57.071 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:57.071 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43226 2024-09-13T06:40:57.071 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.071 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:57.071 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.071 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:57.071 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558313+0000", 2024-09-13T06:40:57.071 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:57.072 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.072 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.072 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:57.072 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558313+0000", 2024-09-13T06:40:57.072 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:57.072 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.072 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.072 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:57.072 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558313+0000", 2024-09-13T06:40:57.072 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:57.072 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.072 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.072 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:57.073 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558314+0000", 2024-09-13T06:40:57.073 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3740000000000001e-06 2024-09-13T06:40:57.073 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.073 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.073 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:57.073 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558317+0000", 2024-09-13T06:40:57.073 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9730000000000002e-06 2024-09-13T06:40:57.073 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.073 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.073 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:57.073 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558319+0000", 2024-09-13T06:40:57.073 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4059999999999999e-06 2024-09-13T06:40:57.073 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.073 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.074 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:57.074 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.621877+0000", 2024-09-13T06:40:57.074 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.063557408999999995 2024-09-13T06:40:57.074 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.074 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.074 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:57.074 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.621951+0000", 2024-09-13T06:40:57.074 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4487999999999996e-05 2024-09-13T06:40:57.074 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.074 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.074 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:57.074 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.622227+0000", 2024-09-13T06:40:57.074 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000276011 2024-09-13T06:40:57.075 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:57.075 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:57.075 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:57.075 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.075 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.075 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43227 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 450560~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:40:57.075 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558322+0000", 2024-09-13T06:40:57.075 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 35.451055983000003, 2024-09-13T06:40:57.075 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.064285348000000006, 2024-09-13T06:40:57.075 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:57.075 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:57.075 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:57.075 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:57.075 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:57.076 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43227 2024-09-13T06:40:57.076 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.076 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:57.076 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.076 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:57.076 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558322+0000", 2024-09-13T06:40:57.076 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:57.076 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.076 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.076 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:57.076 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558322+0000", 2024-09-13T06:40:57.076 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:57.076 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.076 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.077 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:57.077 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558321+0000", 2024-09-13T06:40:57.077 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:40:57.077 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.077 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.077 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:57.077 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558323+0000", 2024-09-13T06:40:57.077 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.576e-06 2024-09-13T06:40:57.077 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.077 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.077 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:57.077 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558328+0000", 2024-09-13T06:40:57.077 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0719999999999999e-06 2024-09-13T06:40:57.077 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.078 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.078 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:57.078 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558332+0000", 2024-09-13T06:40:57.078 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.8130000000000002e-06 2024-09-13T06:40:57.078 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.078 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.078 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:57.078 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.622255+0000", 2024-09-13T06:40:57.078 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.063923195000000002 2024-09-13T06:40:57.078 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.078 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.078 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:57.078 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.622330+0000", 2024-09-13T06:40:57.079 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5383000000000007e-05 2024-09-13T06:40:57.079 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.079 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.079 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:57.079 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.622607+0000", 2024-09-13T06:40:57.079 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00027651999999999999 2024-09-13T06:40:57.079 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:57.079 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:57.079 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:57.079 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.079 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.079 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43228 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 464896~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:40:57.079 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558335+0000", 2024-09-13T06:40:57.080 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 35.451042074, 2024-09-13T06:40:57.080 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.064652253000000007, 2024-09-13T06:40:57.080 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:57.080 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:57.080 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:57.080 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:57.080 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:57.080 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43228 2024-09-13T06:40:57.080 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.080 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:57.080 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.080 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:57.080 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558335+0000", 2024-09-13T06:40:57.080 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:57.080 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.081 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.081 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:57.081 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558335+0000", 2024-09-13T06:40:57.081 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:57.081 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.081 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.081 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:57.081 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558335+0000", 2024-09-13T06:40:57.081 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:57.081 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.081 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.081 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:57.081 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558337+0000", 2024-09-13T06:40:57.081 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1380000000000001e-06 2024-09-13T06:40:57.082 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.082 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.082 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:57.082 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558343+0000", 2024-09-13T06:40:57.082 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.5140000000000001e-06 2024-09-13T06:40:57.082 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.082 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.082 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:57.082 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558348+0000", 2024-09-13T06:40:57.082 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9640000000000002e-06 2024-09-13T06:40:57.082 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.082 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.082 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:57.083 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.622636+0000", 2024-09-13T06:40:57.083 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.064288260999999999 2024-09-13T06:40:57.083 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.083 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.083 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:57.083 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.622715+0000", 2024-09-13T06:40:57.083 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.9351000000000006e-05 2024-09-13T06:40:57.083 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.083 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.083 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:57.083 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.622988+0000", 2024-09-13T06:40:57.083 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00027242599999999998 2024-09-13T06:40:57.083 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:57.084 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:57.084 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:57.084 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.084 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.084 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43229 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 479232~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:40:57.084 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558352+0000", 2024-09-13T06:40:57.084 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 35.451025659000003, 2024-09-13T06:40:57.084 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.065018024999999993, 2024-09-13T06:40:57.084 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:57.084 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:57.084 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:57.084 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:57.084 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:57.085 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43229 2024-09-13T06:40:57.085 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.085 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:57.085 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.085 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:57.085 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558352+0000", 2024-09-13T06:40:57.085 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:57.085 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.085 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.085 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:57.085 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558352+0000", 2024-09-13T06:40:57.085 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:57.086 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.086 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.086 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:57.086 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558352+0000", 2024-09-13T06:40:57.086 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:57.086 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.086 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.086 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:57.086 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558354+0000", 2024-09-13T06:40:57.086 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4930000000000001e-06 2024-09-13T06:40:57.086 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.086 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.086 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:57.087 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558360+0000", 2024-09-13T06:40:57.087 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.263e-06 2024-09-13T06:40:57.087 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.087 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.087 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:57.087 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558369+0000", 2024-09-13T06:40:57.087 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.0829999999999993e-06 2024-09-13T06:40:57.087 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.087 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.087 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:57.087 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.623017+0000", 2024-09-13T06:40:57.087 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.064647799000000006 2024-09-13T06:40:57.087 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.087 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.088 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:57.088 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.623090+0000", 2024-09-13T06:40:57.088 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3071000000000006e-05 2024-09-13T06:40:57.088 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.088 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.088 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:57.088 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.623370+0000", 2024-09-13T06:40:57.088 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000279661 2024-09-13T06:40:57.088 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:57.088 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:57.088 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:57.088 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.088 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.089 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43230 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 493568~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:40:57.089 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558374+0000", 2024-09-13T06:40:57.089 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 35.451003366000002, 2024-09-13T06:40:57.089 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.065410435000000003, 2024-09-13T06:40:57.089 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:57.089 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:57.089 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:57.089 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:57.089 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:57.089 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43230 2024-09-13T06:40:57.089 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.089 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:57.089 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.090 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:57.090 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558374+0000", 2024-09-13T06:40:57.090 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:57.090 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.090 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.090 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:57.090 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558374+0000", 2024-09-13T06:40:57.090 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:57.090 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.090 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.090 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:57.090 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558374+0000", 2024-09-13T06:40:57.090 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:57.091 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.091 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.091 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:57.091 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558376+0000", 2024-09-13T06:40:57.091 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4430000000000002e-06 2024-09-13T06:40:57.091 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.091 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.091 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:57.091 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558382+0000", 2024-09-13T06:40:57.091 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3029999999999996e-06 2024-09-13T06:40:57.092 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.092 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.092 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:57.092 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558387+0000", 2024-09-13T06:40:57.092 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.1699999999999999e-06 2024-09-13T06:40:57.092 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.092 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.092 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:57.092 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.623400+0000", 2024-09-13T06:40:57.092 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.065013244999999997 2024-09-13T06:40:57.092 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.092 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.093 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:57.093 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.623474+0000", 2024-09-13T06:40:57.093 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3889999999999999e-05 2024-09-13T06:40:57.093 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.093 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.093 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:57.093 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.623785+0000", 2024-09-13T06:40:57.093 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00031080099999999998 2024-09-13T06:40:57.093 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:57.093 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:57.093 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:57.093 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.093 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.094 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43231 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 507904~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:40:57.094 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558391+0000", 2024-09-13T06:40:57.094 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 35.450986681000003, 2024-09-13T06:40:57.094 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.065788597000000004, 2024-09-13T06:40:57.094 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:57.094 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:57.094 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:57.094 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:57.094 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:57.094 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43231 2024-09-13T06:40:57.094 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.094 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:57.094 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.095 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:57.095 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558391+0000", 2024-09-13T06:40:57.095 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:57.095 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.095 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.095 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:57.095 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558391+0000", 2024-09-13T06:40:57.095 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:57.095 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.095 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.095 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:57.095 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558390+0000", 2024-09-13T06:40:57.095 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:57.095 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.095 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.096 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:57.096 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558393+0000", 2024-09-13T06:40:57.096 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2570000000000002e-06 2024-09-13T06:40:57.096 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.096 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.096 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:57.096 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558399+0000", 2024-09-13T06:40:57.096 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0419999999999999e-06 2024-09-13T06:40:57.096 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.096 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.096 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:57.096 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558403+0000", 2024-09-13T06:40:57.096 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6249999999999998e-06 2024-09-13T06:40:57.097 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.097 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.097 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:57.097 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.623811+0000", 2024-09-13T06:40:57.097 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.065407549999999995 2024-09-13T06:40:57.097 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.097 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.097 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:57.097 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.623877+0000", 2024-09-13T06:40:57.097 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.5902999999999996e-05 2024-09-13T06:40:57.097 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.097 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.097 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:57.098 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.624179+0000", 2024-09-13T06:40:57.098 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00030259999999999998 2024-09-13T06:40:57.098 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:57.098 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:57.098 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:57.098 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.098 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.098 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43232 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 522240~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:40:57.098 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558422+0000", 2024-09-13T06:40:57.098 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 35.450955903999997, 2024-09-13T06:40:57.098 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.066176061999999994, 2024-09-13T06:40:57.098 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:57.098 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:57.098 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:57.099 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:57.099 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:57.099 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43232 2024-09-13T06:40:57.099 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.099 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:57.099 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.099 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:57.099 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558422+0000", 2024-09-13T06:40:57.099 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:57.099 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.099 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.099 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:57.100 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558422+0000", 2024-09-13T06:40:57.100 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:57.100 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.100 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.100 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:57.100 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558421+0000", 2024-09-13T06:40:57.100 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:57.100 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.100 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.100 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:57.100 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558428+0000", 2024-09-13T06:40:57.100 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.1690000000000003e-06 2024-09-13T06:40:57.100 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.100 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.101 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:57.101 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558434+0000", 2024-09-13T06:40:57.101 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9309999999999996e-06 2024-09-13T06:40:57.101 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.101 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.101 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:57.101 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558447+0000", 2024-09-13T06:40:57.101 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.271e-05 2024-09-13T06:40:57.101 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.101 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.101 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:57.101 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.624209+0000", 2024-09-13T06:40:57.101 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.065762102000000003 2024-09-13T06:40:57.102 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.102 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.102 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:57.102 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.624282+0000", 2024-09-13T06:40:57.102 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.2889e-05 2024-09-13T06:40:57.102 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.102 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.102 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:57.102 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.624598+0000", 2024-09-13T06:40:57.102 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00031591399999999998 2024-09-13T06:40:57.102 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:57.102 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:57.102 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:57.102 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.103 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.103 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43486 3.f 3:f7da9c8f:::rbd_data.1121f5f2e1c0.000000000000000b:1f [read 260096~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:40:57.103 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.569088+0000", 2024-09-13T06:40:57.103 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 35.440289180999997, 2024-09-13T06:40:57.103 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.062579223000000003, 2024-09-13T06:40:57.103 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:57.103 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:57.103 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:57.103 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:57.103 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:57.103 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43486 2024-09-13T06:40:57.103 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.103 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:57.104 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.104 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:57.104 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.569088+0000", 2024-09-13T06:40:57.104 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:57.104 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.104 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.104 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:57.104 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.569088+0000", 2024-09-13T06:40:57.104 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:57.104 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.104 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.104 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:57.105 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.569088+0000", 2024-09-13T06:40:57.105 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:57.105 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.105 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.105 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:57.105 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.569091+0000", 2024-09-13T06:40:57.105 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9629999999999998e-06 2024-09-13T06:40:57.105 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.105 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.105 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:57.105 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.569097+0000", 2024-09-13T06:40:57.105 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.4160000000000001e-06 2024-09-13T06:40:57.105 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.106 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.106 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:57.106 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.569102+0000", 2024-09-13T06:40:57.106 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6659999999999999e-06 2024-09-13T06:40:57.106 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.106 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.106 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:57.106 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.631346+0000", 2024-09-13T06:40:57.106 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.062243896 2024-09-13T06:40:57.106 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.106 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.106 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:57.106 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.631413+0000", 2024-09-13T06:40:57.106 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.7638000000000005e-05 2024-09-13T06:40:57.107 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.107 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.107 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:57.107 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.631668+0000", 2024-09-13T06:40:57.107 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0002541 2024-09-13T06:40:57.107 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:57.107 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:57.107 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:57.107 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:57.107 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:57.107 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:40:57.108 INFO:teuthology.orchestra.run.smithi081.stdout:osd.4: {} 2024-09-13T06:40:57.108 INFO:teuthology.orchestra.run.smithi081.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-13T06:40:57.109 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-13T06:40:57.110 INFO:teuthology.orchestra.run.smithi081.stdout:osd.5: {} 2024-09-13T06:40:57.110 INFO:teuthology.orchestra.run.smithi081.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-13T06:40:57.110 INFO:teuthology.orchestra.run.smithi081.stdout:osd.6: {} 2024-09-13T06:40:57.110 INFO:teuthology.orchestra.run.smithi081.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-13T06:40:57.111 INFO:teuthology.orchestra.run.smithi081.stdout:osd.7: {} 2024-09-13T06:40:57.111 INFO:teuthology.orchestra.run.smithi081.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-13T06:40:57.112 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-13T06:40:57.109+0000 7f86a5f06640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26387) UID: 0 2024-09-13T06:40:57.209 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:40:57.211+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:40:57.276 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:40:57.276 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-13T06:40:57.276 INFO:teuthology.orchestra.run.smithi081.stdout: "num_ops": 0 2024-09-13T06:40:57.276 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:40:57.290 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-13T06:40:57.310 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-13T06:40:57.309+0000 7f86a5f06640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26387) UID: 0 2024-09-13T06:40:57.411 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:40:57.411+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:40:57.464 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:40:57.464 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-13T06:40:57.465 INFO:teuthology.orchestra.run.smithi081.stdout: "complaint_time": 30, 2024-09-13T06:40:57.465 INFO:teuthology.orchestra.run.smithi081.stdout: "num_blocked_ops": 0 2024-09-13T06:40:57.465 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:40:57.478 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-13T06:40:57.512 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:40:57.513+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:40:57.612 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-13T06:40:57.613+0000 7f86a5f06640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26387) UID: 0 2024-09-13T06:40:57.649 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:40:57.650 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 20, 2024-09-13T06:40:57.650 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 600, 2024-09-13T06:40:57.650 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [ 2024-09-13T06:40:57.650 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.650 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:2226 3.15 3:af026987:::rbd_data.112173e2f1b7.0000000000000017:head [sparse-read 0~4194304] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-13T06:40:57.650 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:37.606562+0000", 2024-09-13T06:40:57.650 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 80.042979740000007, 2024-09-13T06:40:57.650 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.83322091700000001, 2024-09-13T06:40:57.650 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:57.650 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:40:57.650 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:57.650 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:57.650 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:57.651 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 2226 2024-09-13T06:40:57.651 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.651 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:57.651 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.651 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:57.651 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606562+0000", 2024-09-13T06:40:57.651 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:57.651 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.651 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.651 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:57.651 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606562+0000", 2024-09-13T06:40:57.651 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:57.651 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.652 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.652 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:57.652 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606561+0000", 2024-09-13T06:40:57.652 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:57.652 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.652 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.652 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:57.652 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606565+0000", 2024-09-13T06:40:57.652 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.4379999999999999e-06 2024-09-13T06:40:57.652 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.652 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.652 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:57.652 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606569+0000", 2024-09-13T06:40:57.653 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.425e-06 2024-09-13T06:40:57.653 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.653 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.653 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:57.653 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606572+0000", 2024-09-13T06:40:57.653 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.05e-06 2024-09-13T06:40:57.653 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.653 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.653 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:57.653 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606621+0000", 2024-09-13T06:40:57.653 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.8723000000000001e-05 2024-09-13T06:40:57.653 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.654 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.654 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:40:57.654 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606630+0000", 2024-09-13T06:40:57.654 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.8040000000000007e-06 2024-09-13T06:40:57.654 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.654 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.654 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:57.654 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.439648+0000", 2024-09-13T06:40:57.654 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.83301824800000002 2024-09-13T06:40:57.654 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.654 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.654 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:57.654 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.439782+0000", 2024-09-13T06:40:57.655 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00013466699999999999 2024-09-13T06:40:57.655 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:57.655 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:57.655 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:57.655 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.655 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.655 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25661 3.8 3:1180686c:::rbd_data.1121f2c5ee81.0000000000000009:13 [read 397312~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:57.655 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.436956+0000", 2024-09-13T06:40:57.655 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 61.212585206, 2024-09-13T06:40:57.655 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089036758999999993, 2024-09-13T06:40:57.655 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:57.655 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:57.655 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:57.656 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:57.656 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:57.656 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25661 2024-09-13T06:40:57.656 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.656 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:57.656 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.656 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:57.656 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436956+0000", 2024-09-13T06:40:57.656 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:57.656 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.656 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.656 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:57.656 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436956+0000", 2024-09-13T06:40:57.656 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:57.657 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.657 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.657 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:57.657 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436956+0000", 2024-09-13T06:40:57.657 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:57.657 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.657 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.657 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:57.657 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436958+0000", 2024-09-13T06:40:57.657 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1770000000000001e-06 2024-09-13T06:40:57.657 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.657 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.657 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:57.658 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436963+0000", 2024-09-13T06:40:57.658 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.6489999999999996e-06 2024-09-13T06:40:57.658 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.658 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.658 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:57.658 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436975+0000", 2024-09-13T06:40:57.658 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1783999999999999e-05 2024-09-13T06:40:57.658 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.658 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.658 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:57.658 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.525671+0000", 2024-09-13T06:40:57.658 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.088696292999999995 2024-09-13T06:40:57.658 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.659 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.659 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:57.659 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.525749+0000", 2024-09-13T06:40:57.659 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.7589000000000005e-05 2024-09-13T06:40:57.659 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.659 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.659 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:57.659 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.525993+0000", 2024-09-13T06:40:57.659 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00024381000000000001 2024-09-13T06:40:57.659 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:57.659 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:57.659 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:57.659 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.659 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.660 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25662 3.8 3:1180686c:::rbd_data.1121f2c5ee81.0000000000000009:13 [read 421888~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:57.660 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.436980+0000", 2024-09-13T06:40:57.660 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 61.212560893999999, 2024-09-13T06:40:57.660 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089367577000000004, 2024-09-13T06:40:57.660 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:57.660 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:57.660 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:57.660 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:57.660 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:57.660 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25662 2024-09-13T06:40:57.660 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.660 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:57.661 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.661 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:57.661 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436980+0000", 2024-09-13T06:40:57.661 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:57.661 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.661 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.661 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:57.661 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436980+0000", 2024-09-13T06:40:57.661 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:57.661 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.661 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.661 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:57.661 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436980+0000", 2024-09-13T06:40:57.661 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:57.662 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.662 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.662 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:57.662 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436982+0000", 2024-09-13T06:40:57.662 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3989999999999998e-06 2024-09-13T06:40:57.662 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.662 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.662 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:57.662 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436988+0000", 2024-09-13T06:40:57.662 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0039999999999996e-06 2024-09-13T06:40:57.662 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.662 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.662 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:57.663 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436993+0000", 2024-09-13T06:40:57.663 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6090000000000003e-06 2024-09-13T06:40:57.663 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.663 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.663 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:57.663 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.526035+0000", 2024-09-13T06:40:57.663 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089042248000000004 2024-09-13T06:40:57.663 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.663 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.663 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:57.663 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.526111+0000", 2024-09-13T06:40:57.663 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5643999999999996e-05 2024-09-13T06:40:57.663 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.664 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.664 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:57.664 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.526348+0000", 2024-09-13T06:40:57.664 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00023705800000000001 2024-09-13T06:40:57.664 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:57.664 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:57.664 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:57.664 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.664 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.664 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25663 3.8 3:1180686c:::rbd_data.1121f2c5ee81.0000000000000009:13 [read 466944~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:57.664 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.436998+0000", 2024-09-13T06:40:57.664 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 61.212543246999999, 2024-09-13T06:40:57.665 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089730867000000006, 2024-09-13T06:40:57.665 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:57.665 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:57.665 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:57.665 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:57.665 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:57.665 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25663 2024-09-13T06:40:57.665 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.665 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:57.665 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.665 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:57.665 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436998+0000", 2024-09-13T06:40:57.665 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:57.666 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.666 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.666 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:57.666 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436998+0000", 2024-09-13T06:40:57.666 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:57.666 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.666 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.666 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:57.666 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436998+0000", 2024-09-13T06:40:57.666 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:57.666 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.666 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.666 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:57.666 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437000+0000", 2024-09-13T06:40:57.667 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0940000000000002e-06 2024-09-13T06:40:57.667 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.667 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.667 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:57.667 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437005+0000", 2024-09-13T06:40:57.667 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.604e-06 2024-09-13T06:40:57.667 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.667 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.667 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:57.667 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437032+0000", 2024-09-13T06:40:57.667 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6407e-05 2024-09-13T06:40:57.667 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.667 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.668 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:57.668 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.526363+0000", 2024-09-13T06:40:57.668 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089331456000000004 2024-09-13T06:40:57.668 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.668 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.668 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:57.668 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.526404+0000", 2024-09-13T06:40:57.668 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.0887999999999999e-05 2024-09-13T06:40:57.668 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.668 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.668 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:57.668 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.526729+0000", 2024-09-13T06:40:57.668 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00032486 2024-09-13T06:40:57.669 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:57.669 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:57.669 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:57.669 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.669 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.669 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25664 3.8 3:1180686c:::rbd_data.1121f2c5ee81.0000000000000009:13 [read 491520~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:57.669 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.437040+0000", 2024-09-13T06:40:57.669 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 61.212501332000002, 2024-09-13T06:40:57.669 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.090016650000000004, 2024-09-13T06:40:57.669 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:57.669 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:57.669 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:57.669 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:57.669 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:57.670 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25664 2024-09-13T06:40:57.670 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.670 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:57.670 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.670 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:57.670 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437040+0000", 2024-09-13T06:40:57.670 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:57.670 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.670 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.670 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:57.670 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437040+0000", 2024-09-13T06:40:57.670 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:57.670 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.670 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.671 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:57.671 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437039+0000", 2024-09-13T06:40:57.671 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:57.671 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.671 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.671 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:57.671 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437047+0000", 2024-09-13T06:40:57.671 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4839999999999998e-06 2024-09-13T06:40:57.671 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.671 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.671 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:57.671 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437054+0000", 2024-09-13T06:40:57.671 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.8299999999999998e-06 2024-09-13T06:40:57.672 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.672 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.672 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:57.672 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437060+0000", 2024-09-13T06:40:57.672 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.1510000000000001e-06 2024-09-13T06:40:57.672 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.672 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.672 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:57.672 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.526772+0000", 2024-09-13T06:40:57.672 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089711737999999999 2024-09-13T06:40:57.672 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.672 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.672 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:57.673 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.526848+0000", 2024-09-13T06:40:57.673 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5870000000000004e-05 2024-09-13T06:40:57.673 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.673 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.673 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:57.673 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.527057+0000", 2024-09-13T06:40:57.673 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000209106 2024-09-13T06:40:57.673 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:57.673 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:57.673 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:57.673 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.673 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.673 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25740 3.18 3:1c662b96:::rbd_data.1121f2c5ee81.0000000000000010:13 [read 200704~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:57.674 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443352+0000", 2024-09-13T06:40:57.674 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 61.206189657000003, 2024-09-13T06:40:57.674 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089068222000000002, 2024-09-13T06:40:57.674 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:57.674 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:57.674 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:57.674 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:57.674 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:57.674 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25740 2024-09-13T06:40:57.674 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.674 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:57.674 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.674 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:57.674 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443352+0000", 2024-09-13T06:40:57.675 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:57.675 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.675 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.675 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:57.675 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443352+0000", 2024-09-13T06:40:57.675 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:57.675 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.675 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.675 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:57.675 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443351+0000", 2024-09-13T06:40:57.675 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:57.675 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.675 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.676 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:57.676 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443354+0000", 2024-09-13T06:40:57.676 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.841e-06 2024-09-13T06:40:57.676 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.676 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.676 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:57.676 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443361+0000", 2024-09-13T06:40:57.676 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.0010000000000004e-06 2024-09-13T06:40:57.676 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.676 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.676 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:57.676 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443366+0000", 2024-09-13T06:40:57.676 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7119999999999999e-06 2024-09-13T06:40:57.677 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.677 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.677 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:57.677 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532117+0000", 2024-09-13T06:40:57.677 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.088751327000000005 2024-09-13T06:40:57.677 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.677 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.677 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:57.677 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532193+0000", 2024-09-13T06:40:57.678 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5839000000000004e-05 2024-09-13T06:40:57.678 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.678 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.678 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:57.678 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532420+0000", 2024-09-13T06:40:57.678 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00022691000000000001 2024-09-13T06:40:57.678 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:57.678 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:57.678 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:57.678 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.678 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.678 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25741 3.18 3:1c662b96:::rbd_data.1121f2c5ee81.0000000000000010:13 [read 225280~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:57.678 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443378+0000", 2024-09-13T06:40:57.679 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 61.206162890000002, 2024-09-13T06:40:57.679 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089324107, 2024-09-13T06:40:57.679 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:57.679 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:57.679 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:57.679 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:57.679 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:57.679 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25741 2024-09-13T06:40:57.679 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.679 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:57.679 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.679 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:57.679 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443378+0000", 2024-09-13T06:40:57.679 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:57.680 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.680 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.680 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:57.680 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443378+0000", 2024-09-13T06:40:57.680 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:57.680 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.680 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.680 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:57.680 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443378+0000", 2024-09-13T06:40:57.680 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:57.680 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.680 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.680 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:57.681 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443380+0000", 2024-09-13T06:40:57.681 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3549999999999999e-06 2024-09-13T06:40:57.681 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.681 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.681 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:57.681 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443388+0000", 2024-09-13T06:40:57.681 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.7449999999999995e-06 2024-09-13T06:40:57.681 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.681 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.681 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:57.681 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443393+0000", 2024-09-13T06:40:57.681 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.4e-06 2024-09-13T06:40:57.681 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.681 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.682 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:57.682 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532454+0000", 2024-09-13T06:40:57.682 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089060941000000005 2024-09-13T06:40:57.682 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.682 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.682 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:57.682 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532512+0000", 2024-09-13T06:40:57.682 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7763000000000002e-05 2024-09-13T06:40:57.682 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.682 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.682 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:57.682 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532703+0000", 2024-09-13T06:40:57.682 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000190328 2024-09-13T06:40:57.683 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:57.683 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:57.683 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:57.683 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.683 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.683 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25742 3.18 3:1c662b96:::rbd_data.1121f2c5ee81.0000000000000010:13 [read 270336~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:57.683 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443398+0000", 2024-09-13T06:40:57.683 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 61.206143177999998, 2024-09-13T06:40:57.683 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089621836999999996, 2024-09-13T06:40:57.683 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:57.683 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:57.683 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:57.684 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:57.684 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:57.684 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25742 2024-09-13T06:40:57.684 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.684 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:57.684 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.684 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:57.684 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443398+0000", 2024-09-13T06:40:57.684 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:57.684 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.684 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.684 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:57.684 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443398+0000", 2024-09-13T06:40:57.685 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:57.685 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.685 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.685 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:57.685 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443398+0000", 2024-09-13T06:40:57.685 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:57.685 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.685 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.685 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:57.685 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443400+0000", 2024-09-13T06:40:57.685 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1849999999999998e-06 2024-09-13T06:40:57.685 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.686 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.686 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:57.686 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443407+0000", 2024-09-13T06:40:57.686 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3669999999999999e-06 2024-09-13T06:40:57.686 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.686 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.686 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:57.686 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443420+0000", 2024-09-13T06:40:57.686 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2645e-05 2024-09-13T06:40:57.686 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.686 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.686 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:57.686 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532742+0000", 2024-09-13T06:40:57.687 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089322200000000004 2024-09-13T06:40:57.687 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.687 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.687 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:57.687 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532818+0000", 2024-09-13T06:40:57.687 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.6019000000000005e-05 2024-09-13T06:40:57.687 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.687 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.687 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:57.687 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533020+0000", 2024-09-13T06:40:57.687 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000201721 2024-09-13T06:40:57.687 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:57.687 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:57.687 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:57.688 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.688 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.688 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25743 3.18 3:1c662b96:::rbd_data.1121f2c5ee81.0000000000000010:13 [read 294912~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:57.688 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443425+0000", 2024-09-13T06:40:57.688 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 61.206116170000001, 2024-09-13T06:40:57.688 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089864075000000002, 2024-09-13T06:40:57.688 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:57.688 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:57.688 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:57.688 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:57.688 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:57.688 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25743 2024-09-13T06:40:57.688 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.689 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:57.689 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.689 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:57.689 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443425+0000", 2024-09-13T06:40:57.689 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:57.689 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.689 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.689 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:57.689 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443425+0000", 2024-09-13T06:40:57.689 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:57.689 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.689 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.689 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:57.689 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443425+0000", 2024-09-13T06:40:57.690 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:57.690 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.690 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.690 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:57.690 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443432+0000", 2024-09-13T06:40:57.690 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3420000000000002e-06 2024-09-13T06:40:57.690 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.690 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.690 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:57.690 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443440+0000", 2024-09-13T06:40:57.690 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5689999999999999e-06 2024-09-13T06:40:57.690 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.690 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.691 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:57.691 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443445+0000", 2024-09-13T06:40:57.691 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9590000000000003e-06 2024-09-13T06:40:57.691 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.691 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.691 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:57.691 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533063+0000", 2024-09-13T06:40:57.691 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089617988999999995 2024-09-13T06:40:57.691 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.691 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.691 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:57.691 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533122+0000", 2024-09-13T06:40:57.691 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9052999999999999e-05 2024-09-13T06:40:57.692 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.692 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.692 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:57.692 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533289+0000", 2024-09-13T06:40:57.692 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00016752800000000001 2024-09-13T06:40:57.692 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:57.692 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:57.692 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:57.692 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.692 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.692 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25744 3.18 3.69d46638 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:57.692 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443449+0000", 2024-09-13T06:40:57.692 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 61.206092022999997, 2024-09-13T06:40:57.693 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089869148999999995, 2024-09-13T06:40:57.693 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:57.693 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:40:57.693 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:57.693 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:57.693 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:57.693 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25744 2024-09-13T06:40:57.693 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.693 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:57.693 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.693 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:57.693 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443449+0000", 2024-09-13T06:40:57.693 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:57.694 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.694 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.694 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:57.694 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443449+0000", 2024-09-13T06:40:57.694 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:57.694 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.694 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.694 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:57.694 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443449+0000", 2024-09-13T06:40:57.694 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:57.694 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.694 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.694 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:57.695 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443451+0000", 2024-09-13T06:40:57.695 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.244e-06 2024-09-13T06:40:57.695 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.695 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.695 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:57.695 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443457+0000", 2024-09-13T06:40:57.695 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.66e-06 2024-09-13T06:40:57.695 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.695 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.695 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:57.695 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443461+0000", 2024-09-13T06:40:57.695 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5449999999999997e-06 2024-09-13T06:40:57.695 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.695 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.696 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:57.696 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533311+0000", 2024-09-13T06:40:57.696 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089849729000000003 2024-09-13T06:40:57.696 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.696 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.696 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:57.696 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533318+0000", 2024-09-13T06:40:57.696 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.328e-06 2024-09-13T06:40:57.696 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:57.696 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:57.696 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:57.696 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.697 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.697 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25745 3.18 3.69d46638 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:57.697 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443466+0000", 2024-09-13T06:40:57.697 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 61.206074964999999, 2024-09-13T06:40:57.697 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089886743000000005, 2024-09-13T06:40:57.697 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:57.697 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:40:57.697 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:57.697 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:57.697 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:57.697 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25745 2024-09-13T06:40:57.697 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.697 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:57.698 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.698 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:57.698 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443466+0000", 2024-09-13T06:40:57.698 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:57.698 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.698 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.698 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:57.698 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443466+0000", 2024-09-13T06:40:57.698 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:57.698 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.698 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.698 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:57.698 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443466+0000", 2024-09-13T06:40:57.699 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:57.699 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.699 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.699 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:57.699 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443474+0000", 2024-09-13T06:40:57.699 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.1289999999999996e-06 2024-09-13T06:40:57.699 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.699 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.699 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:57.699 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443484+0000", 2024-09-13T06:40:57.699 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0654e-05 2024-09-13T06:40:57.699 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.699 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.700 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:57.700 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443490+0000", 2024-09-13T06:40:57.700 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8030000000000002e-06 2024-09-13T06:40:57.700 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.700 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.700 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:57.700 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533348+0000", 2024-09-13T06:40:57.700 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089857267000000005 2024-09-13T06:40:57.700 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.700 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.700 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:57.700 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533353+0000", 2024-09-13T06:40:57.700 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.5520000000000004e-06 2024-09-13T06:40:57.701 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:57.701 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:57.701 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:57.701 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.701 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.701 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25746 3.18 3.69d46638 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:57.701 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443495+0000", 2024-09-13T06:40:57.701 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 61.206045852000003, 2024-09-13T06:40:57.701 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089903725000000004, 2024-09-13T06:40:57.701 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:57.701 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:40:57.701 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:57.701 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:57.702 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:57.702 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25746 2024-09-13T06:40:57.702 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.702 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:57.702 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.702 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:57.702 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443495+0000", 2024-09-13T06:40:57.702 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:57.702 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.702 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.702 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:57.702 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443495+0000", 2024-09-13T06:40:57.702 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:57.703 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.703 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.703 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:57.703 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443495+0000", 2024-09-13T06:40:57.703 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:57.703 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.703 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.703 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:57.703 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443498+0000", 2024-09-13T06:40:57.703 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.7690000000000001e-06 2024-09-13T06:40:57.703 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.703 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.703 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:57.703 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443504+0000", 2024-09-13T06:40:57.704 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9710000000000001e-06 2024-09-13T06:40:57.704 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.704 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.704 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:57.704 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443508+0000", 2024-09-13T06:40:57.704 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4159999999999997e-06 2024-09-13T06:40:57.704 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.704 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.704 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:57.704 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533391+0000", 2024-09-13T06:40:57.704 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089882607000000003 2024-09-13T06:40:57.704 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.704 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.705 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:57.705 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533399+0000", 2024-09-13T06:40:57.705 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.4349999999999997e-06 2024-09-13T06:40:57.705 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:57.705 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:57.705 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:57.705 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.705 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.705 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25747 3.8 3.63996268 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:57.705 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443512+0000", 2024-09-13T06:40:57.705 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 61.206029121, 2024-09-13T06:40:57.705 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089880075000000004, 2024-09-13T06:40:57.705 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:57.706 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:40:57.706 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:57.706 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:57.706 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:57.706 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25747 2024-09-13T06:40:57.706 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.706 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:57.706 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.706 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:57.706 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443512+0000", 2024-09-13T06:40:57.706 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:57.706 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.706 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.707 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:57.707 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443512+0000", 2024-09-13T06:40:57.707 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:57.707 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.707 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.707 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:57.707 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443512+0000", 2024-09-13T06:40:57.707 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:57.707 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.707 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.707 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:57.707 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443514+0000", 2024-09-13T06:40:57.708 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0980000000000001e-06 2024-09-13T06:40:57.708 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.708 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.708 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:57.708 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443520+0000", 2024-09-13T06:40:57.708 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7069999999999997e-06 2024-09-13T06:40:57.708 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.708 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.708 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:57.708 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443524+0000", 2024-09-13T06:40:57.708 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5390000000000001e-06 2024-09-13T06:40:57.708 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.708 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.709 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:57.709 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533384+0000", 2024-09-13T06:40:57.709 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089859684999999995 2024-09-13T06:40:57.709 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.709 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.709 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:57.709 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533392+0000", 2024-09-13T06:40:57.709 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.3440000000000001e-06 2024-09-13T06:40:57.709 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:57.709 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:57.709 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:57.709 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.709 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.710 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25748 3.8 3.63996268 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:57.710 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443528+0000", 2024-09-13T06:40:57.710 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 61.206012993999998, 2024-09-13T06:40:57.710 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089890715999999996, 2024-09-13T06:40:57.710 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:57.710 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:40:57.710 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:57.710 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:57.710 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:57.710 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25748 2024-09-13T06:40:57.710 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.710 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:57.710 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.711 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:57.711 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443528+0000", 2024-09-13T06:40:57.711 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:57.711 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.711 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.711 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:57.711 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443528+0000", 2024-09-13T06:40:57.711 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:57.711 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.711 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.711 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:57.711 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443528+0000", 2024-09-13T06:40:57.711 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:57.711 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.712 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.712 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:57.712 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443530+0000", 2024-09-13T06:40:57.712 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0650000000000001e-06 2024-09-13T06:40:57.712 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.712 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.712 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:57.712 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443536+0000", 2024-09-13T06:40:57.712 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7259999999999999e-06 2024-09-13T06:40:57.712 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.712 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.712 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:57.712 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443540+0000", 2024-09-13T06:40:57.713 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5009999999999998e-06 2024-09-13T06:40:57.713 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.713 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.713 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:57.713 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533412+0000", 2024-09-13T06:40:57.713 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089871873000000005 2024-09-13T06:40:57.713 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.713 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.713 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:57.713 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533419+0000", 2024-09-13T06:40:57.713 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.883e-06 2024-09-13T06:40:57.713 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:57.713 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:57.713 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:57.714 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.714 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.714 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25749 3.8 3.63996268 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:57.714 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443545+0000", 2024-09-13T06:40:57.714 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 61.205996798000001, 2024-09-13T06:40:57.714 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089897988999999998, 2024-09-13T06:40:57.714 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:57.714 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:40:57.714 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:57.714 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:57.714 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:57.714 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25749 2024-09-13T06:40:57.714 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.715 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:57.715 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.715 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:57.715 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443545+0000", 2024-09-13T06:40:57.715 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:57.715 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.715 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.715 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:57.715 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443545+0000", 2024-09-13T06:40:57.715 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:57.715 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.715 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.715 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:57.715 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443544+0000", 2024-09-13T06:40:57.715 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:57.716 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.716 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.716 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:57.716 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443553+0000", 2024-09-13T06:40:57.716 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.4770000000000003e-06 2024-09-13T06:40:57.716 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.716 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.716 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:57.716 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443564+0000", 2024-09-13T06:40:57.716 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0986e-05 2024-09-13T06:40:57.716 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.716 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.716 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:57.716 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443569+0000", 2024-09-13T06:40:57.717 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2530000000000004e-06 2024-09-13T06:40:57.717 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.717 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.717 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:57.717 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533438+0000", 2024-09-13T06:40:57.717 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089868641999999999 2024-09-13T06:40:57.717 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.717 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.717 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:57.717 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533442+0000", 2024-09-13T06:40:57.717 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.989e-06 2024-09-13T06:40:57.717 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:57.717 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:57.718 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:57.718 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.718 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.718 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25750 3.8 3.63996268 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:57.718 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443574+0000", 2024-09-13T06:40:57.718 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 61.205967311999999, 2024-09-13T06:40:57.718 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089895143999999996, 2024-09-13T06:40:57.718 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:57.718 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:40:57.718 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:57.718 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:57.718 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:57.718 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25750 2024-09-13T06:40:57.718 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.718 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:57.719 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.719 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:57.719 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443574+0000", 2024-09-13T06:40:57.719 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:57.719 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.719 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.719 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:57.719 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443574+0000", 2024-09-13T06:40:57.719 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:57.719 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.719 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.719 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:57.719 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443574+0000", 2024-09-13T06:40:57.720 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:57.720 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.720 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.720 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:57.720 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443576+0000", 2024-09-13T06:40:57.720 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6910000000000002e-06 2024-09-13T06:40:57.720 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.720 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.720 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:57.720 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443583+0000", 2024-09-13T06:40:57.720 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.331e-06 2024-09-13T06:40:57.720 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.720 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.721 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:57.721 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443587+0000", 2024-09-13T06:40:57.721 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6129999999999997e-06 2024-09-13T06:40:57.721 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.721 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.721 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:57.721 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533464+0000", 2024-09-13T06:40:57.721 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089876605999999998 2024-09-13T06:40:57.721 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.721 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.721 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:57.721 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533469+0000", 2024-09-13T06:40:57.721 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3909999999999997e-06 2024-09-13T06:40:57.722 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:57.722 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:57.722 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:57.722 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.722 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.722 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25751 3.8 3.63996268 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:57.722 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443592+0000", 2024-09-13T06:40:57.722 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 61.205949615000002, 2024-09-13T06:40:57.722 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089913650999999997, 2024-09-13T06:40:57.722 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:57.722 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:40:57.722 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:57.722 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:57.722 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:57.723 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25751 2024-09-13T06:40:57.723 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.723 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:57.723 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.723 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:57.723 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443592+0000", 2024-09-13T06:40:57.723 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:57.723 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.723 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.723 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:57.723 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443592+0000", 2024-09-13T06:40:57.723 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:57.723 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.723 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.724 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:57.724 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443591+0000", 2024-09-13T06:40:57.724 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:57.724 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.724 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.724 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:57.724 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443594+0000", 2024-09-13T06:40:57.724 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3649999999999998e-06 2024-09-13T06:40:57.724 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.724 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.724 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:57.724 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443599+0000", 2024-09-13T06:40:57.725 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.699e-06 2024-09-13T06:40:57.725 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.725 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.725 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:57.725 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443611+0000", 2024-09-13T06:40:57.725 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1503e-05 2024-09-13T06:40:57.725 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.725 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.725 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:57.725 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533497+0000", 2024-09-13T06:40:57.725 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089886453000000005 2024-09-13T06:40:57.725 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.725 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.726 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:57.726 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533505+0000", 2024-09-13T06:40:57.726 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.9910000000000002e-06 2024-09-13T06:40:57.726 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:57.726 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:57.726 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:57.726 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.726 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.726 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25752 3.8 3.63996268 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:57.726 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443615+0000", 2024-09-13T06:40:57.726 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 61.205925833999999, 2024-09-13T06:40:57.726 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089905868999999999, 2024-09-13T06:40:57.726 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:57.726 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:40:57.727 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:57.727 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:57.727 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:57.727 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25752 2024-09-13T06:40:57.727 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.727 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:57.727 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.727 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:57.727 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443615+0000", 2024-09-13T06:40:57.727 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:57.727 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.727 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.727 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:57.728 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443615+0000", 2024-09-13T06:40:57.728 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:57.728 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.728 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.728 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:57.728 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443615+0000", 2024-09-13T06:40:57.728 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:57.728 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.728 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.728 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:57.728 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443617+0000", 2024-09-13T06:40:57.728 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3539999999999998e-06 2024-09-13T06:40:57.728 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.729 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.729 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:57.729 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443624+0000", 2024-09-13T06:40:57.729 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3600000000000001e-06 2024-09-13T06:40:57.729 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.729 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.729 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:57.729 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443628+0000", 2024-09-13T06:40:57.729 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.2350000000000001e-06 2024-09-13T06:40:57.729 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.729 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.729 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:57.729 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533517+0000", 2024-09-13T06:40:57.730 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089889029999999995 2024-09-13T06:40:57.730 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.730 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.730 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:57.730 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533521+0000", 2024-09-13T06:40:57.730 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.2529999999999998e-06 2024-09-13T06:40:57.730 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:57.730 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:57.730 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:57.730 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.730 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.730 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25755 3.8 3.63996268 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:40:57.730 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.444692+0000", 2024-09-13T06:40:57.731 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 61.204849127999999, 2024-09-13T06:40:57.731 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.088904186999999996, 2024-09-13T06:40:57.731 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:57.731 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:40:57.731 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:57.731 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:57.731 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:57.731 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25755 2024-09-13T06:40:57.731 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.731 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:57.731 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.731 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:57.731 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.444692+0000", 2024-09-13T06:40:57.731 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:57.732 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.732 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.732 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:57.732 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.444692+0000", 2024-09-13T06:40:57.732 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:57.732 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.732 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.732 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:57.732 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.444692+0000", 2024-09-13T06:40:57.732 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:57.732 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.732 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.733 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:57.733 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.444694+0000", 2024-09-13T06:40:57.733 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.058e-06 2024-09-13T06:40:57.733 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.733 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.733 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:57.733 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.444700+0000", 2024-09-13T06:40:57.733 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7769999999999999e-06 2024-09-13T06:40:57.733 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.733 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.733 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:57.733 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.444704+0000", 2024-09-13T06:40:57.733 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6229999999999996e-06 2024-09-13T06:40:57.733 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.734 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.734 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:57.734 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533587+0000", 2024-09-13T06:40:57.734 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.088882744999999999 2024-09-13T06:40:57.734 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.734 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.734 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:57.734 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533596+0000", 2024-09-13T06:40:57.734 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.3270000000000007e-06 2024-09-13T06:40:57.734 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:57.734 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:57.734 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:57.734 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.734 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.735 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:64356 3.c 3:32785be9:::rbd_header.11218ba71f0d:head [watch reconnect cookie 140361410387072 gen 2] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e95)", 2024-09-13T06:40:57.735 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:48.473318+0000", 2024-09-13T06:40:57.735 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 9.1762234409999994, 2024-09-13T06:40:57.735 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1458904379999999, 2024-09-13T06:40:57.735 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:40:57.735 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:40:57.735 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:40:57.735 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:40:57.735 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:57.735 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 64356 2024-09-13T06:40:57.735 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.735 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:40:57.735 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.736 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:40:57.736 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:48.473318+0000", 2024-09-13T06:40:57.736 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:57.736 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.736 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.736 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:40:57.736 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:48.473318+0000", 2024-09-13T06:40:57.736 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:40:57.736 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.736 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.736 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:40:57.736 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:48.473315+0000", 2024-09-13T06:40:57.736 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999971 2024-09-13T06:40:57.736 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.737 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.737 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:40:57.737 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:48.473329+0000", 2024-09-13T06:40:57.737 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.433e-05 2024-09-13T06:40:57.737 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.737 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.737 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:40:57.737 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:48.473363+0000", 2024-09-13T06:40:57.737 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.3592e-05 2024-09-13T06:40:57.737 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.737 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.737 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:40:57.737 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:48.473386+0000", 2024-09-13T06:40:57.738 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2708999999999999e-05 2024-09-13T06:40:57.738 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.738 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.738 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:57.738 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:48.473804+0000", 2024-09-13T06:40:57.738 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00041789399999999998 2024-09-13T06:40:57.738 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.738 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.738 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:40:57.738 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:48.473830+0000", 2024-09-13T06:40:57.738 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6869e-05 2024-09-13T06:40:57.738 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.738 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.739 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:57.739 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:49.614332+0000", 2024-09-13T06:40:57.739 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.140501107 2024-09-13T06:40:57.739 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.739 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.739 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for rw locks", 2024-09-13T06:40:57.739 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:49.614496+0000", 2024-09-13T06:40:57.739 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00016451200000000001 2024-09-13T06:40:57.739 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.739 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.739 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:40:57.739 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:49.617131+0000", 2024-09-13T06:40:57.739 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.002634843 2024-09-13T06:40:57.740 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.740 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.740 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:40:57.740 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:49.617204+0000", 2024-09-13T06:40:57.740 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.2991000000000006e-05 2024-09-13T06:40:57.740 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:40:57.740 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:40:57.740 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:40:57.740 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:49.619208+0000", 2024-09-13T06:40:57.740 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.002004381 2024-09-13T06:40:57.740 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:57.740 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:57.740 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:57.741 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:40:57.741 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:40:57.741 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:40:57.742 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-13T06:40:57.743 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:40:57.743+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:40:57.844 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:40:57.845+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:40:57.872 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:40:57.873 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [], 2024-09-13T06:40:57.873 INFO:teuthology.orchestra.run.smithi139.stdout: "num_ops": 0 2024-09-13T06:40:57.873 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:40:57.886 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-13T06:40:57.979 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-13T06:40:57.981+0000 7f86a5f06640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26387) UID: 0 2024-09-13T06:40:58.045 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:40:58.043+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:40:58.055 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:40:58.055 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [], 2024-09-13T06:40:58.055 INFO:teuthology.orchestra.run.smithi139.stdout: "complaint_time": 30, 2024-09-13T06:40:58.055 INFO:teuthology.orchestra.run.smithi139.stdout: "num_blocked_ops": 0 2024-09-13T06:40:58.055 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:40:58.069 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-13T06:40:58.159 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:40:58.161+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:40:58.240 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:40:58.240 INFO:teuthology.orchestra.run.smithi139.stdout: "size": 20, 2024-09-13T06:40:58.240 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 600, 2024-09-13T06:40:58.240 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [ 2024-09-13T06:40:58.240 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.240 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18706 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 3346432~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:40:58.241 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.846138+0000", 2024-09-13T06:40:58.241 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 66.393270592999997, 2024-09-13T06:40:58.241 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.102018712, 2024-09-13T06:40:58.241 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:58.241 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:58.241 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:58.241 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:58.241 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:58.241 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18706 2024-09-13T06:40:58.241 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.241 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:58.241 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.241 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:58.242 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846138+0000", 2024-09-13T06:40:58.242 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:58.242 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.242 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.242 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:58.242 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846138+0000", 2024-09-13T06:40:58.242 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:58.242 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.242 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.242 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:58.242 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846138+0000", 2024-09-13T06:40:58.242 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:58.242 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.243 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.243 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:58.243 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846141+0000", 2024-09-13T06:40:58.243 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.6969999999999999e-06 2024-09-13T06:40:58.243 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.243 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.243 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:58.243 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846150+0000", 2024-09-13T06:40:58.243 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6400000000000003e-06 2024-09-13T06:40:58.243 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.243 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.243 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:58.243 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846160+0000", 2024-09-13T06:40:58.244 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.3999999999999998e-06 2024-09-13T06:40:58.244 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.244 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.244 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:58.244 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.947764+0000", 2024-09-13T06:40:58.244 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101604085 2024-09-13T06:40:58.244 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.244 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.244 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:58.244 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.947888+0000", 2024-09-13T06:40:58.244 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000124113 2024-09-13T06:40:58.244 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.244 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.245 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:58.245 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.948157+0000", 2024-09-13T06:40:58.245 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00026943399999999998 2024-09-13T06:40:58.245 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:58.245 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:58.245 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:58.245 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.245 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.245 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18707 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 3375104~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:40:58.245 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.846207+0000", 2024-09-13T06:40:58.245 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 66.393201826999999, 2024-09-13T06:40:58.245 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10238114099999999, 2024-09-13T06:40:58.245 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:58.246 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:58.246 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:58.246 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:58.246 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:58.246 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18707 2024-09-13T06:40:58.246 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.246 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:58.246 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.246 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:58.246 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846207+0000", 2024-09-13T06:40:58.246 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:58.246 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.246 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.247 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:58.247 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846207+0000", 2024-09-13T06:40:58.247 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:58.247 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.247 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.247 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:58.247 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846206+0000", 2024-09-13T06:40:58.247 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:58.247 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.247 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.247 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:58.247 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846211+0000", 2024-09-13T06:40:58.247 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.3000000000000003e-06 2024-09-13T06:40:58.248 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.248 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.248 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:58.248 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846220+0000", 2024-09-13T06:40:58.248 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6199999999999994e-06 2024-09-13T06:40:58.248 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.248 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.248 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:58.248 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846228+0000", 2024-09-13T06:40:58.248 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.7500000000000003e-06 2024-09-13T06:40:58.248 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.248 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.248 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:58.248 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.948267+0000", 2024-09-13T06:40:58.249 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10203878700000001 2024-09-13T06:40:58.249 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.249 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.249 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:58.249 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.948435+0000", 2024-09-13T06:40:58.249 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00016796500000000001 2024-09-13T06:40:58.249 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.249 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.249 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:58.249 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.948588+0000", 2024-09-13T06:40:58.249 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00015373599999999999 2024-09-13T06:40:58.249 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:58.249 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:58.250 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:58.250 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.250 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.250 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18718 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 3690496~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:40:58.250 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.850174+0000", 2024-09-13T06:40:58.250 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 66.389234673999994, 2024-09-13T06:40:58.250 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101854154, 2024-09-13T06:40:58.250 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:58.250 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:58.250 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:58.250 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:58.250 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:58.250 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18718 2024-09-13T06:40:58.251 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.251 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:58.251 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.251 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:58.251 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850174+0000", 2024-09-13T06:40:58.251 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:58.251 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.251 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.251 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:58.251 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850174+0000", 2024-09-13T06:40:58.251 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:58.251 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.251 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.251 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:58.251 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850173+0000", 2024-09-13T06:40:58.252 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:58.252 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.252 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.252 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:58.252 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850178+0000", 2024-09-13T06:40:58.252 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.4129999999999999e-06 2024-09-13T06:40:58.252 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.252 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.252 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:58.252 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850188+0000", 2024-09-13T06:40:58.252 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.8600000000000005e-06 2024-09-13T06:40:58.252 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.252 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.253 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:58.253 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850195+0000", 2024-09-13T06:40:58.253 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.8730000000000007e-06 2024-09-13T06:40:58.253 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.253 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.253 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:58.253 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.951766+0000", 2024-09-13T06:40:58.253 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.1015703 2024-09-13T06:40:58.253 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.253 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.253 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:58.253 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.951879+0000", 2024-09-13T06:40:58.253 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000112932 2024-09-13T06:40:58.254 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.254 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.254 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:58.254 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.952029+0000", 2024-09-13T06:40:58.254 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000149846 2024-09-13T06:40:58.254 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:58.254 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:58.254 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:58.254 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.254 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.254 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18719 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 3719168~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:40:58.254 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.850202+0000", 2024-09-13T06:40:58.254 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 66.389206630999993, 2024-09-13T06:40:58.254 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.102191676, 2024-09-13T06:40:58.255 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:58.255 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:58.255 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:58.255 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:58.255 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:58.255 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18719 2024-09-13T06:40:58.255 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.255 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:58.255 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.255 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:58.255 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850202+0000", 2024-09-13T06:40:58.255 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:58.255 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.256 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.256 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:58.256 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850202+0000", 2024-09-13T06:40:58.256 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:58.256 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.256 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.256 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:58.256 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850202+0000", 2024-09-13T06:40:58.256 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:58.256 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.256 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.256 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:58.256 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850205+0000", 2024-09-13T06:40:58.256 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.89e-06 2024-09-13T06:40:58.257 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.257 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.257 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:58.257 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850216+0000", 2024-09-13T06:40:58.257 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0233e-05 2024-09-13T06:40:58.257 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.257 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.257 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:58.257 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850223+0000", 2024-09-13T06:40:58.257 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5299999999999999e-06 2024-09-13T06:40:58.257 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.257 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.257 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:58.257 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.952106+0000", 2024-09-13T06:40:58.258 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10188309299999999 2024-09-13T06:40:58.258 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.258 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.258 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:58.258 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.952233+0000", 2024-09-13T06:40:58.258 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000126993 2024-09-13T06:40:58.258 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.258 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.258 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:58.258 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.952394+0000", 2024-09-13T06:40:58.258 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000160791 2024-09-13T06:40:58.258 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:58.258 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:58.259 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:58.259 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.259 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.259 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18720 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 3747840~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:40:58.259 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.850726+0000", 2024-09-13T06:40:58.259 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 66.388682802000005, 2024-09-13T06:40:58.259 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10199504299999999, 2024-09-13T06:40:58.259 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:58.259 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:58.259 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:58.259 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:58.259 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:58.259 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18720 2024-09-13T06:40:58.259 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.259 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:58.260 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.260 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:58.260 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850726+0000", 2024-09-13T06:40:58.260 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:58.260 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.260 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.260 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:58.260 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850726+0000", 2024-09-13T06:40:58.260 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:58.260 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.260 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.260 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:58.260 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850229+0000", 2024-09-13T06:40:58.260 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9995027 2024-09-13T06:40:58.260 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.261 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.261 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:58.261 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850731+0000", 2024-09-13T06:40:58.261 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00050221599999999999 2024-09-13T06:40:58.261 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.261 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.261 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:58.261 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850751+0000", 2024-09-13T06:40:58.261 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.9703000000000001e-05 2024-09-13T06:40:58.261 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.261 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.261 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:58.261 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850764+0000", 2024-09-13T06:40:58.261 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3207000000000001e-05 2024-09-13T06:40:58.262 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.262 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.262 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:58.262 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.952454+0000", 2024-09-13T06:40:58.262 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101690102 2024-09-13T06:40:58.262 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.262 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.262 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:58.262 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.952571+0000", 2024-09-13T06:40:58.262 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000116556 2024-09-13T06:40:58.262 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.262 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.262 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:58.262 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.952721+0000", 2024-09-13T06:40:58.262 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000150419 2024-09-13T06:40:58.263 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:58.263 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:58.263 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:58.263 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.263 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.263 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18730 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 4034560~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:40:58.263 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.854013+0000", 2024-09-13T06:40:58.263 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 66.385395861000006, 2024-09-13T06:40:58.263 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10186914399999999, 2024-09-13T06:40:58.263 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:58.263 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:58.263 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:58.263 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:58.263 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:58.263 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18730 2024-09-13T06:40:58.264 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.264 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:58.264 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.264 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:58.264 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.854013+0000", 2024-09-13T06:40:58.264 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:58.264 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.264 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.264 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:58.264 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.854013+0000", 2024-09-13T06:40:58.264 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:58.264 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.264 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.264 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:58.265 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.854013+0000", 2024-09-13T06:40:58.265 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:58.265 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.265 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.265 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:58.265 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.854016+0000", 2024-09-13T06:40:58.265 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.1839999999999999e-06 2024-09-13T06:40:58.265 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.265 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.265 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:58.265 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.854025+0000", 2024-09-13T06:40:58.265 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.8030000000000003e-06 2024-09-13T06:40:58.265 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.265 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.266 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:58.266 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.854033+0000", 2024-09-13T06:40:58.266 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6500000000000002e-06 2024-09-13T06:40:58.266 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.266 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.266 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:58.266 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.955546+0000", 2024-09-13T06:40:58.266 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10151296 2024-09-13T06:40:58.266 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.266 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.266 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:58.266 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.955694+0000", 2024-09-13T06:40:58.266 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000147773 2024-09-13T06:40:58.266 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.267 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.267 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:58.267 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.955882+0000", 2024-09-13T06:40:58.267 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000188371 2024-09-13T06:40:58.267 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:58.267 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:58.267 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:58.267 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.267 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.267 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18742 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 4378624~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:40:58.267 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.857984+0000", 2024-09-13T06:40:58.267 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 66.381424738000007, 2024-09-13T06:40:58.267 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10179961799999999, 2024-09-13T06:40:58.267 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:58.267 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:58.268 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:58.268 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:58.268 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:58.268 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18742 2024-09-13T06:40:58.268 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.268 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:58.268 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.268 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:58.268 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.857984+0000", 2024-09-13T06:40:58.268 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:58.268 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.268 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.268 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:58.269 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.857984+0000", 2024-09-13T06:40:58.269 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:58.269 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.269 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.269 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:58.269 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.857983+0000", 2024-09-13T06:40:58.269 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:58.269 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.269 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.269 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:58.269 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.857987+0000", 2024-09-13T06:40:58.269 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0670000000000002e-06 2024-09-13T06:40:58.269 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.269 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.270 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:58.270 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.857997+0000", 2024-09-13T06:40:58.270 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6830000000000003e-06 2024-09-13T06:40:58.270 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.270 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.270 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:58.270 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.858006+0000", 2024-09-13T06:40:58.270 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.5739999999999996e-06 2024-09-13T06:40:58.270 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.270 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.270 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:58.270 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.959453+0000", 2024-09-13T06:40:58.270 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101447339 2024-09-13T06:40:58.271 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.271 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.271 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:58.271 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.959603+0000", 2024-09-13T06:40:58.271 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000150316 2024-09-13T06:40:58.271 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.271 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.271 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:58.271 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.959784+0000", 2024-09-13T06:40:58.271 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00018065900000000001 2024-09-13T06:40:58.271 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:58.271 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:58.271 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:58.271 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.272 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.272 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18743 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 4407296~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:40:58.272 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.858012+0000", 2024-09-13T06:40:58.272 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 66.381396745000004, 2024-09-13T06:40:58.272 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10210024500000001, 2024-09-13T06:40:58.272 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:58.272 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:58.272 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:58.272 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:58.272 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:58.272 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18743 2024-09-13T06:40:58.272 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.272 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:58.272 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.273 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:58.273 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.858012+0000", 2024-09-13T06:40:58.273 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:58.273 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.273 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.273 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:58.273 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.858012+0000", 2024-09-13T06:40:58.273 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:58.273 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.273 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.273 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:58.273 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.858011+0000", 2024-09-13T06:40:58.273 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:58.273 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.273 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.273 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:58.274 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.858016+0000", 2024-09-13T06:40:58.274 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0659999999999997e-06 2024-09-13T06:40:58.274 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.274 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.274 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:58.274 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.858024+0000", 2024-09-13T06:40:58.274 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.7700000000000007e-06 2024-09-13T06:40:58.274 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.274 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.274 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:58.274 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.858032+0000", 2024-09-13T06:40:58.274 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.7700000000000001e-06 2024-09-13T06:40:58.274 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.274 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.275 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:58.275 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.959850+0000", 2024-09-13T06:40:58.275 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.1018182 2024-09-13T06:40:58.275 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.275 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.275 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:58.275 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.959964+0000", 2024-09-13T06:40:58.275 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00011413600000000001 2024-09-13T06:40:58.275 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.275 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.275 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:58.275 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.960113+0000", 2024-09-13T06:40:58.275 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00014813900000000001 2024-09-13T06:40:58.275 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:58.276 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:58.276 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:58.276 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.276 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.276 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18755 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 4751360~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:40:58.276 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.862061+0000", 2024-09-13T06:40:58.276 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 66.377348493, 2024-09-13T06:40:58.276 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101907023, 2024-09-13T06:40:58.276 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:58.276 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:58.276 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:58.276 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:58.276 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:58.277 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18755 2024-09-13T06:40:58.277 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.277 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:58.277 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.277 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:58.277 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862061+0000", 2024-09-13T06:40:58.277 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:58.277 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.277 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.277 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:58.277 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862061+0000", 2024-09-13T06:40:58.277 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:58.277 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.278 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.278 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:58.278 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862060+0000", 2024-09-13T06:40:58.278 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:58.278 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.278 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.278 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:58.278 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862064+0000", 2024-09-13T06:40:58.278 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.3229999999999999e-06 2024-09-13T06:40:58.278 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.278 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.278 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:58.278 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862078+0000", 2024-09-13T06:40:58.278 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.433e-05 2024-09-13T06:40:58.279 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.279 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.279 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:58.279 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862086+0000", 2024-09-13T06:40:58.279 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.3869999999999997e-06 2024-09-13T06:40:58.279 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.279 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.279 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:58.279 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.963635+0000", 2024-09-13T06:40:58.279 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101549606 2024-09-13T06:40:58.279 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.279 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.279 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:58.279 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.963783+0000", 2024-09-13T06:40:58.280 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000147312 2024-09-13T06:40:58.280 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.280 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.280 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:58.280 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.963968+0000", 2024-09-13T06:40:58.280 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000185028 2024-09-13T06:40:58.280 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:58.280 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:58.280 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:58.280 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.280 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.280 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18756 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 4780032~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:40:58.280 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.862132+0000", 2024-09-13T06:40:58.281 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 66.377276649999999, 2024-09-13T06:40:58.281 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.102159295, 2024-09-13T06:40:58.281 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:58.281 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:58.281 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:58.281 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:58.281 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:58.281 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18756 2024-09-13T06:40:58.281 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.281 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:58.281 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.281 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:58.281 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862132+0000", 2024-09-13T06:40:58.281 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:58.282 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.282 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.282 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:58.282 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862132+0000", 2024-09-13T06:40:58.282 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:58.282 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.282 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.282 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:58.282 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862132+0000", 2024-09-13T06:40:58.282 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:58.282 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.282 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.282 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:58.282 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862136+0000", 2024-09-13T06:40:58.282 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.9559999999999999e-06 2024-09-13T06:40:58.283 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.283 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.283 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:58.283 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862145+0000", 2024-09-13T06:40:58.283 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6169999999999996e-06 2024-09-13T06:40:58.283 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.283 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.283 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:58.283 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862153+0000", 2024-09-13T06:40:58.283 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.8359999999999992e-06 2024-09-13T06:40:58.283 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.283 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.283 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:58.284 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.964018+0000", 2024-09-13T06:40:58.284 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101865421 2024-09-13T06:40:58.284 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.284 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.284 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:58.284 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.964140+0000", 2024-09-13T06:40:58.284 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000121172 2024-09-13T06:40:58.284 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.284 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.284 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:58.284 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.964292+0000", 2024-09-13T06:40:58.284 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00015202600000000001 2024-09-13T06:40:58.284 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:58.284 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:58.285 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:58.285 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.285 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.285 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18768 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 5124096~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:40:58.285 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.866345+0000", 2024-09-13T06:40:58.285 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 66.373064342999996, 2024-09-13T06:40:58.285 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101779361, 2024-09-13T06:40:58.285 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:58.285 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:58.285 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:58.285 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:58.285 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:58.286 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18768 2024-09-13T06:40:58.286 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.286 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:58.286 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.286 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:58.286 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.866345+0000", 2024-09-13T06:40:58.286 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:58.286 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.286 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.286 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:58.286 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.866345+0000", 2024-09-13T06:40:58.286 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:58.286 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.286 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.287 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:58.287 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.866344+0000", 2024-09-13T06:40:58.287 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:58.287 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.287 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.287 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:58.287 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.866348+0000", 2024-09-13T06:40:58.287 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.4300000000000002e-06 2024-09-13T06:40:58.287 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.287 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.287 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:58.287 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.866356+0000", 2024-09-13T06:40:58.287 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.5930000000000006e-06 2024-09-13T06:40:58.287 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.288 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.288 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:58.288 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.866364+0000", 2024-09-13T06:40:58.288 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5599999999999996e-06 2024-09-13T06:40:58.288 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.288 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.288 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:58.288 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.967865+0000", 2024-09-13T06:40:58.288 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101501683 2024-09-13T06:40:58.288 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.288 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.288 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:58.288 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.967981+0000", 2024-09-13T06:40:58.288 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000115643 2024-09-13T06:40:58.289 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.289 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.289 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:58.289 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.968124+0000", 2024-09-13T06:40:58.289 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00014305500000000001 2024-09-13T06:40:58.289 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:58.289 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:58.289 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:58.289 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.289 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.289 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18779 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 5439488~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:40:58.289 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.869996+0000", 2024-09-13T06:40:58.289 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 66.369413457999997, 2024-09-13T06:40:58.289 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10189577399999999, 2024-09-13T06:40:58.290 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:58.290 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:58.290 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:58.290 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:58.290 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:58.290 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18779 2024-09-13T06:40:58.290 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.290 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:58.290 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.290 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:58.290 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.869996+0000", 2024-09-13T06:40:58.290 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:58.290 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.290 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.291 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:58.291 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.869996+0000", 2024-09-13T06:40:58.291 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:58.291 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.291 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.291 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:58.291 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.869995+0000", 2024-09-13T06:40:58.291 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:58.291 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.291 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.291 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:58.291 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.869998+0000", 2024-09-13T06:40:58.291 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.2729999999999998e-06 2024-09-13T06:40:58.291 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.292 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.292 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:58.292 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.870007+0000", 2024-09-13T06:40:58.292 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.5760000000000006e-06 2024-09-13T06:40:58.292 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.292 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.292 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:58.292 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.870014+0000", 2024-09-13T06:40:58.292 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.1400000000000002e-06 2024-09-13T06:40:58.292 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.292 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.292 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:58.293 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.971631+0000", 2024-09-13T06:40:58.293 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101617503 2024-09-13T06:40:58.293 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.293 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.293 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:58.293 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.971747+0000", 2024-09-13T06:40:58.293 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00011599600000000001 2024-09-13T06:40:58.293 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.293 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.293 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:58.293 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.971891+0000", 2024-09-13T06:40:58.293 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000143912 2024-09-13T06:40:58.293 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:58.294 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:58.294 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:58.294 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.294 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.294 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18792 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 5812224~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:40:58.294 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.874371+0000", 2024-09-13T06:40:58.294 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 66.365038327999997, 2024-09-13T06:40:58.294 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101736005, 2024-09-13T06:40:58.294 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:58.294 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:58.294 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:58.294 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:58.294 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:58.294 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18792 2024-09-13T06:40:58.295 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.295 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:58.295 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.295 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:58.295 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874371+0000", 2024-09-13T06:40:58.295 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:58.295 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.295 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.295 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:58.295 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874371+0000", 2024-09-13T06:40:58.295 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:58.295 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.296 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.296 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:58.296 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874370+0000", 2024-09-13T06:40:58.296 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:58.296 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.296 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.296 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:58.296 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874374+0000", 2024-09-13T06:40:58.296 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.7239999999999998e-06 2024-09-13T06:40:58.296 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.296 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.296 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:58.296 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874385+0000", 2024-09-13T06:40:58.297 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1293e-05 2024-09-13T06:40:58.297 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.297 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.297 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:58.297 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874394+0000", 2024-09-13T06:40:58.297 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.0729999999999994e-06 2024-09-13T06:40:58.297 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.297 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.297 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:58.297 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.975850+0000", 2024-09-13T06:40:58.297 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10145599700000001 2024-09-13T06:40:58.297 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.298 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.298 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:58.298 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.975963+0000", 2024-09-13T06:40:58.298 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000112689 2024-09-13T06:40:58.298 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.298 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.298 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:58.298 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.976107+0000", 2024-09-13T06:40:58.298 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000143836 2024-09-13T06:40:58.298 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:58.298 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:58.298 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:58.298 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.299 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.299 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18793 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 5840896~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:40:58.299 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.874401+0000", 2024-09-13T06:40:58.299 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 66.365008294999996, 2024-09-13T06:40:58.299 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.102005516, 2024-09-13T06:40:58.299 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:58.299 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:58.299 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:58.299 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:58.299 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:58.299 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18793 2024-09-13T06:40:58.299 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.299 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:58.299 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.300 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:58.300 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874401+0000", 2024-09-13T06:40:58.300 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:58.300 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.300 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.300 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:58.300 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874401+0000", 2024-09-13T06:40:58.300 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:58.300 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.300 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.300 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:58.300 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874400+0000", 2024-09-13T06:40:58.300 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:58.300 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.301 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.301 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:58.301 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874404+0000", 2024-09-13T06:40:58.301 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0069999999999999e-06 2024-09-13T06:40:58.301 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.301 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.301 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:58.301 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874412+0000", 2024-09-13T06:40:58.301 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.5399999999999996e-06 2024-09-13T06:40:58.301 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.301 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.301 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:58.301 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874420+0000", 2024-09-13T06:40:58.301 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.6199999999999999e-06 2024-09-13T06:40:58.302 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.302 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.302 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:58.302 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.976150+0000", 2024-09-13T06:40:58.302 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101729874 2024-09-13T06:40:58.302 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.302 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.302 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:58.302 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.976261+0000", 2024-09-13T06:40:58.302 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000110819 2024-09-13T06:40:58.302 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.302 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.302 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:58.303 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.976406+0000", 2024-09-13T06:40:58.303 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000145489 2024-09-13T06:40:58.303 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:58.303 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:58.303 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:58.303 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.303 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.303 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18803 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 6127616~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:40:58.303 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.877851+0000", 2024-09-13T06:40:58.303 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 66.361557801999993, 2024-09-13T06:40:58.303 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101951584, 2024-09-13T06:40:58.303 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:58.303 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:58.304 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:58.304 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:58.304 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:58.304 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18803 2024-09-13T06:40:58.304 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.304 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:58.304 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.304 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:58.304 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.877851+0000", 2024-09-13T06:40:58.304 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:58.304 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.304 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.304 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:58.305 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.877851+0000", 2024-09-13T06:40:58.305 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:58.305 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.305 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.305 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:58.305 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.877851+0000", 2024-09-13T06:40:58.305 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:58.305 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.305 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.305 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:58.305 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.877854+0000", 2024-09-13T06:40:58.305 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.7929999999999999e-06 2024-09-13T06:40:58.305 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.306 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.306 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:58.306 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.877864+0000", 2024-09-13T06:40:58.306 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.2029999999999998e-06 2024-09-13T06:40:58.306 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.306 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.306 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:58.306 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.877873+0000", 2024-09-13T06:40:58.306 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.0440000000000001e-06 2024-09-13T06:40:58.306 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.306 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.306 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:58.306 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.979544+0000", 2024-09-13T06:40:58.306 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101671198 2024-09-13T06:40:58.307 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.307 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.307 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:58.307 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.979658+0000", 2024-09-13T06:40:58.307 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000114456 2024-09-13T06:40:58.307 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.307 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.307 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:58.307 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.979803+0000", 2024-09-13T06:40:58.307 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000144506 2024-09-13T06:40:58.307 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:58.307 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:58.307 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:58.307 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.308 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.308 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18807 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 6242304~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:40:58.308 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.879235+0000", 2024-09-13T06:40:58.308 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 66.360173771999996, 2024-09-13T06:40:58.308 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101781258, 2024-09-13T06:40:58.308 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:58.308 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:58.308 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:58.308 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:58.308 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:58.308 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18807 2024-09-13T06:40:58.308 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.309 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:58.309 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.309 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:58.309 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879235+0000", 2024-09-13T06:40:58.309 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:58.309 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.309 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.309 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:58.309 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879235+0000", 2024-09-13T06:40:58.309 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:58.309 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.309 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.309 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:58.310 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879235+0000", 2024-09-13T06:40:58.310 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:58.310 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.310 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.310 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:58.310 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879239+0000", 2024-09-13T06:40:58.310 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.963e-06 2024-09-13T06:40:58.310 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.310 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.310 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:58.310 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879247+0000", 2024-09-13T06:40:58.310 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6470000000000004e-06 2024-09-13T06:40:58.311 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.311 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.311 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:58.311 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879255+0000", 2024-09-13T06:40:58.311 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5429999999999996e-06 2024-09-13T06:40:58.311 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.311 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.311 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:58.311 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.980756+0000", 2024-09-13T06:40:58.311 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10150165999999999 2024-09-13T06:40:58.311 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.311 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.311 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:58.311 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.980868+0000", 2024-09-13T06:40:58.312 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000111196 2024-09-13T06:40:58.312 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.312 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.312 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:58.312 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.981017+0000", 2024-09-13T06:40:58.312 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000148846 2024-09-13T06:40:58.312 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:58.312 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:58.312 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:58.312 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.312 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.312 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18808 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 6270976~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:40:58.313 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.879261+0000", 2024-09-13T06:40:58.313 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 66.360147632999997, 2024-09-13T06:40:58.313 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.102057547, 2024-09-13T06:40:58.313 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:58.313 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:58.313 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:58.313 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:58.313 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:58.313 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18808 2024-09-13T06:40:58.313 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.313 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:58.313 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.313 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:58.313 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879261+0000", 2024-09-13T06:40:58.314 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:58.314 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.314 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.314 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:58.314 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879261+0000", 2024-09-13T06:40:58.314 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:58.314 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.314 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.314 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:58.314 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879261+0000", 2024-09-13T06:40:58.314 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:58.314 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.314 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.315 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:58.315 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879264+0000", 2024-09-13T06:40:58.315 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.523e-06 2024-09-13T06:40:58.315 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.315 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.315 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:58.315 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879273+0000", 2024-09-13T06:40:58.315 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6070000000000008e-06 2024-09-13T06:40:58.315 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.315 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.315 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:58.315 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879280+0000", 2024-09-13T06:40:58.315 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.4699999999999996e-06 2024-09-13T06:40:58.315 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.316 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.316 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:58.316 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.981060+0000", 2024-09-13T06:40:58.316 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10177934800000001 2024-09-13T06:40:58.316 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.316 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.316 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:58.316 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.981174+0000", 2024-09-13T06:40:58.316 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000114456 2024-09-13T06:40:58.316 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.316 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.316 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:58.316 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.981319+0000", 2024-09-13T06:40:58.316 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00014473900000000001 2024-09-13T06:40:58.316 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:58.317 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:58.317 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:58.317 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.317 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.317 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18810 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 2662400~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:40:58.317 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.880386+0000", 2024-09-13T06:40:58.317 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 66.359023471, 2024-09-13T06:40:58.317 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101728022, 2024-09-13T06:40:58.317 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:58.317 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:58.317 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:58.317 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:58.318 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:58.318 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18810 2024-09-13T06:40:58.318 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.318 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:58.318 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.318 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:58.318 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880386+0000", 2024-09-13T06:40:58.318 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:58.318 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.318 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.318 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:58.318 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880386+0000", 2024-09-13T06:40:58.318 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:58.318 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.319 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.319 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:58.319 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880385+0000", 2024-09-13T06:40:58.319 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:58.319 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.319 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.319 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:58.319 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880389+0000", 2024-09-13T06:40:58.319 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.8539999999999999e-06 2024-09-13T06:40:58.319 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.319 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.319 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:58.319 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880398+0000", 2024-09-13T06:40:58.319 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.1689999999999998e-06 2024-09-13T06:40:58.320 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.320 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.320 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:58.320 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880405+0000", 2024-09-13T06:40:58.320 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5700000000000004e-06 2024-09-13T06:40:58.320 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.320 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.320 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:58.320 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.981833+0000", 2024-09-13T06:40:58.320 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10142791800000001 2024-09-13T06:40:58.320 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.320 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.321 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:58.321 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.981973+0000", 2024-09-13T06:40:58.321 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00014002900000000001 2024-09-13T06:40:58.321 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.321 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.321 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:58.321 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.982114+0000", 2024-09-13T06:40:58.321 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000140276 2024-09-13T06:40:58.321 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:58.321 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:58.321 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:58.321 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.321 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.322 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18811 3.9 3.140f5209 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:40:58.322 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.880449+0000", 2024-09-13T06:40:58.322 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 66.358960095, 2024-09-13T06:40:58.322 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101739355, 2024-09-13T06:40:58.322 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:58.322 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:40:58.322 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:58.322 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:58.322 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:58.322 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18811 2024-09-13T06:40:58.322 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.322 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:58.322 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.323 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:58.323 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880449+0000", 2024-09-13T06:40:58.323 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:58.323 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.323 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.323 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:58.323 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880449+0000", 2024-09-13T06:40:58.323 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:58.323 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.323 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.323 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:58.323 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880448+0000", 2024-09-13T06:40:58.324 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:58.324 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.324 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.324 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:58.324 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880452+0000", 2024-09-13T06:40:58.324 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0470000000000004e-06 2024-09-13T06:40:58.324 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.324 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.324 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:58.324 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880462+0000", 2024-09-13T06:40:58.324 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6530000000000006e-06 2024-09-13T06:40:58.324 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.324 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.325 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:58.325 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880472+0000", 2024-09-13T06:40:58.325 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0027000000000001e-05 2024-09-13T06:40:58.325 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.325 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.325 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:58.325 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.982172+0000", 2024-09-13T06:40:58.325 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10170043500000001 2024-09-13T06:40:58.325 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.325 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.325 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:58.325 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.982188+0000", 2024-09-13T06:40:58.325 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6172999999999999e-05 2024-09-13T06:40:58.326 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:58.326 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:58.326 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:58.326 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.326 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.326 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18812 3.9 3.140f5209 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:40:58.326 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.880478+0000", 2024-09-13T06:40:58.326 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 66.358930857999994, 2024-09-13T06:40:58.326 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10177795100000001, 2024-09-13T06:40:58.326 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:58.326 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:40:58.326 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:58.326 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:58.326 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:58.327 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18812 2024-09-13T06:40:58.327 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.327 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:58.327 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.327 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:58.327 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880478+0000", 2024-09-13T06:40:58.327 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:58.327 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.327 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.327 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:58.327 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880478+0000", 2024-09-13T06:40:58.327 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:58.327 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.328 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.328 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:58.328 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880477+0000", 2024-09-13T06:40:58.328 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:58.328 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.328 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.328 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:58.328 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880481+0000", 2024-09-13T06:40:58.328 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.827e-06 2024-09-13T06:40:58.328 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.328 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.328 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:58.328 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880490+0000", 2024-09-13T06:40:58.328 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6100000000000006e-06 2024-09-13T06:40:58.328 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.329 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.329 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:58.329 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880497+0000", 2024-09-13T06:40:58.329 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.7030000000000006e-06 2024-09-13T06:40:58.329 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.329 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.329 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:58.329 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.982241+0000", 2024-09-13T06:40:58.329 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10174351199999999 2024-09-13T06:40:58.329 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.329 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.329 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:58.329 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.982256+0000", 2024-09-13T06:40:58.329 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5143000000000001e-05 2024-09-13T06:40:58.330 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:58.330 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:58.330 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:58.330 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:58.330 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:58.330 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:40:58.331 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-13T06:40:58.332 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:40:58.331+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:40:58.402 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-13T06:40:58.432 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-13T06:40:58.433+0000 7f86a5f06640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26387) UID: 0 2024-09-13T06:40:58.517 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:40:58.517 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [], 2024-09-13T06:40:58.517 INFO:teuthology.orchestra.run.smithi139.stdout: "num_ops": 0 2024-09-13T06:40:58.518 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:40:58.530 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 6, 7, 5] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-13T06:40:58.530 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-13T06:40:58.530 INFO:tasks.thrashosds.thrasher:inject_pause on osd.4 2024-09-13T06:40:58.530 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-09-13T06:40:58.530 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-09-13T06:40:58.530 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok config set filestore_inject_stall 3 2024-09-13T06:40:58.532 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-13T06:40:58.533 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:40:58.535+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:40:58.634 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:40:58.635+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:40:58.692 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:40:58.692 INFO:teuthology.orchestra.run.smithi139.stdout: "success": "filestore_inject_stall = '' (not observed, change may require restart) " 2024-09-13T06:40:58.693 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:40:58.700 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:40:58.700 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [], 2024-09-13T06:40:58.700 INFO:teuthology.orchestra.run.smithi139.stdout: "complaint_time": 30, 2024-09-13T06:40:58.701 INFO:teuthology.orchestra.run.smithi139.stdout: "num_blocked_ops": 0 2024-09-13T06:40:58.701 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:40:58.717 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-13T06:40:58.760 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:40:58.761+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:40:58.836 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:40:58.835+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:40:58.883 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:40:58.883 INFO:teuthology.orchestra.run.smithi139.stdout: "size": 20, 2024-09-13T06:40:58.883 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 600, 2024-09-13T06:40:58.883 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [ 2024-09-13T06:40:58.883 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.883 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43282 3.1d 3:bd80bfb3:::rbd_object_map.11212f44bfb1.0000000000000020:head [call rbd.object_map_update in=20b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:40:58.883 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589032+0000", 2024-09-13T06:40:58.883 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 37.293399100999999, 2024-09-13T06:40:58.883 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.076225263000000001, 2024-09-13T06:40:58.883 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:58.883 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:40:58.883 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:58.884 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:58.884 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:58.884 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43282 2024-09-13T06:40:58.884 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.884 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:58.884 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.884 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:58.884 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589032+0000", 2024-09-13T06:40:58.884 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:58.884 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.884 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.884 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:58.884 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589032+0000", 2024-09-13T06:40:58.885 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:58.885 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.885 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.885 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:58.885 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589031+0000", 2024-09-13T06:40:58.885 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:58.885 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.885 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.885 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:58.885 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589036+0000", 2024-09-13T06:40:58.885 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.2619999999999998e-06 2024-09-13T06:40:58.886 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.886 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.886 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:58.886 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589046+0000", 2024-09-13T06:40:58.886 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.8099999999999992e-06 2024-09-13T06:40:58.887 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.887 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.887 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:58.887 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589054+0000", 2024-09-13T06:40:58.887 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.2230000000000007e-06 2024-09-13T06:40:58.887 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.888 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.888 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:58.888 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.660691+0000", 2024-09-13T06:40:58.888 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.07163659 2024-09-13T06:40:58.888 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.888 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.888 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:58.888 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.660850+0000", 2024-09-13T06:40:58.888 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00015864300000000001 2024-09-13T06:40:58.888 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.888 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.889 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 4", 2024-09-13T06:40:58.889 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.661729+0000", 2024-09-13T06:40:58.889 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00087956099999999995 2024-09-13T06:40:58.889 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.889 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.889 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:40:58.889 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.664409+0000", 2024-09-13T06:40:58.889 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0026803479999999999 2024-09-13T06:40:58.889 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.889 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.889 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-13T06:40:58.889 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.665088+0000", 2024-09-13T06:40:58.889 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00067901400000000003 2024-09-13T06:40:58.889 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.890 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.890 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-13T06:40:58.890 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.665181+0000", 2024-09-13T06:40:58.890 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.2050000000000001e-05 2024-09-13T06:40:58.890 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.890 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.890 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:58.890 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.665257+0000", 2024-09-13T06:40:58.890 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.6698000000000003e-05 2024-09-13T06:40:58.890 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:58.890 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:58.890 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:58.890 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.890 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.891 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43288 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 270336~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:40:58.891 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589449+0000", 2024-09-13T06:40:58.891 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 37.292981849, 2024-09-13T06:40:58.891 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.074906773999999995, 2024-09-13T06:40:58.891 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:58.891 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:58.891 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:58.891 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:58.891 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:58.891 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43288 2024-09-13T06:40:58.891 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.891 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:58.891 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.891 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:58.891 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589449+0000", 2024-09-13T06:40:58.891 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:58.892 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.892 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.892 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:58.892 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589449+0000", 2024-09-13T06:40:58.892 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:58.892 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.892 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.892 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:58.892 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589449+0000", 2024-09-13T06:40:58.892 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:58.892 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.892 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.892 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:58.893 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589452+0000", 2024-09-13T06:40:58.893 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.5769999999999998e-06 2024-09-13T06:40:58.893 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.893 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.893 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:58.893 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589461+0000", 2024-09-13T06:40:58.893 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.5720000000000003e-06 2024-09-13T06:40:58.893 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.893 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.893 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:58.893 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589468+0000", 2024-09-13T06:40:58.893 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5859999999999999e-06 2024-09-13T06:40:58.893 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.893 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.894 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:58.894 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.663827+0000", 2024-09-13T06:40:58.894 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.074358704999999997 2024-09-13T06:40:58.894 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.894 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.894 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:58.894 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.664011+0000", 2024-09-13T06:40:58.894 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00018381699999999999 2024-09-13T06:40:58.894 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.894 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.894 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:58.895 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.664356+0000", 2024-09-13T06:40:58.895 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00034510999999999998 2024-09-13T06:40:58.895 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:58.895 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:58.895 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:58.895 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.895 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.895 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43289 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 284672~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:40:58.895 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589475+0000", 2024-09-13T06:40:58.895 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 37.292956451000002, 2024-09-13T06:40:58.895 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.075789117000000003, 2024-09-13T06:40:58.895 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:58.895 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:58.896 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:58.896 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:58.896 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:58.896 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43289 2024-09-13T06:40:58.896 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.896 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:58.896 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.896 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:58.897 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589475+0000", 2024-09-13T06:40:58.897 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:58.897 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.897 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.897 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:58.897 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589475+0000", 2024-09-13T06:40:58.897 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:58.897 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.897 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.897 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:58.897 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589474+0000", 2024-09-13T06:40:58.897 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:58.897 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.897 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.898 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:58.898 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589477+0000", 2024-09-13T06:40:58.898 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.7929999999999999e-06 2024-09-13T06:40:58.898 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.898 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.898 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:58.898 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589486+0000", 2024-09-13T06:40:58.898 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.4989999999999994e-06 2024-09-13T06:40:58.898 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.898 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.898 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:58.898 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589493+0000", 2024-09-13T06:40:58.898 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5329999999999997e-06 2024-09-13T06:40:58.899 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.899 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.899 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:58.899 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.664456+0000", 2024-09-13T06:40:58.899 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.074962794999999999 2024-09-13T06:40:58.899 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.899 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.899 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:58.899 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.664653+0000", 2024-09-13T06:40:58.899 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000197107 2024-09-13T06:40:58.899 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.899 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.900 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:58.900 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.665264+0000", 2024-09-13T06:40:58.900 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00061037600000000004 2024-09-13T06:40:58.900 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:58.900 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:58.900 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:58.900 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.900 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.900 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43290 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 299008~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:40:58.900 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589500+0000", 2024-09-13T06:40:58.900 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 37.292930939000001, 2024-09-13T06:40:58.900 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.075898564000000002, 2024-09-13T06:40:58.900 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:58.900 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:58.901 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:58.901 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:58.901 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:58.901 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43290 2024-09-13T06:40:58.901 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.901 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:58.901 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.901 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:58.901 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589500+0000", 2024-09-13T06:40:58.901 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:58.901 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.901 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.901 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:58.902 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589500+0000", 2024-09-13T06:40:58.902 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:58.902 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.902 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.902 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:58.902 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589499+0000", 2024-09-13T06:40:58.902 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:58.902 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.902 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.902 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:58.902 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589503+0000", 2024-09-13T06:40:58.902 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.8330000000000004e-06 2024-09-13T06:40:58.902 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.902 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.903 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:58.903 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589511+0000", 2024-09-13T06:40:58.903 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.3359999999999995e-06 2024-09-13T06:40:58.903 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.903 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.903 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:58.903 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589519+0000", 2024-09-13T06:40:58.903 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.4760000000000001e-06 2024-09-13T06:40:58.903 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.903 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.903 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:58.903 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.665097+0000", 2024-09-13T06:40:58.903 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.075577828999999999 2024-09-13T06:40:58.904 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.904 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.904 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:58.904 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.665170+0000", 2024-09-13T06:40:58.904 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.3745000000000006e-05 2024-09-13T06:40:58.904 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.904 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.904 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:58.904 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.665399+0000", 2024-09-13T06:40:58.904 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00022826199999999999 2024-09-13T06:40:58.904 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:58.904 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:58.904 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:58.905 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.905 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.905 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43291 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 313344~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:40:58.905 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589560+0000", 2024-09-13T06:40:58.905 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 37.292870718000003, 2024-09-13T06:40:58.905 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.076145594999999996, 2024-09-13T06:40:58.905 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:58.905 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:58.905 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:58.905 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:58.905 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:58.906 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43291 2024-09-13T06:40:58.906 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.906 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:58.906 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.906 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:58.906 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589560+0000", 2024-09-13T06:40:58.906 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:58.906 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.906 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.906 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:58.906 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589560+0000", 2024-09-13T06:40:58.906 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:58.906 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.907 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.907 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:58.907 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589559+0000", 2024-09-13T06:40:58.907 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:58.907 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.907 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.907 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:58.907 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589564+0000", 2024-09-13T06:40:58.907 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.3989999999999997e-06 2024-09-13T06:40:58.907 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.907 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.907 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:58.907 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589574+0000", 2024-09-13T06:40:58.908 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0502999999999999e-05 2024-09-13T06:40:58.908 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.908 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.908 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:58.908 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589582+0000", 2024-09-13T06:40:58.908 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.1859999999999992e-06 2024-09-13T06:40:58.908 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.908 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.908 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:58.909 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.665423+0000", 2024-09-13T06:40:58.909 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.075840290000000005 2024-09-13T06:40:58.909 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.909 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.909 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:58.909 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.665496+0000", 2024-09-13T06:40:58.909 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.2791000000000002e-05 2024-09-13T06:40:58.909 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.909 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.910 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:58.910 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.665706+0000", 2024-09-13T06:40:58.910 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00021038200000000001 2024-09-13T06:40:58.910 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:58.910 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:58.910 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:58.910 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.910 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.910 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43292 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 327680~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:40:58.910 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589589+0000", 2024-09-13T06:40:58.910 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 37.292842176999997, 2024-09-13T06:40:58.910 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.076769537999999998, 2024-09-13T06:40:58.910 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:58.910 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:58.911 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:58.911 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:58.911 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:58.911 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43292 2024-09-13T06:40:58.911 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.911 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:58.911 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.911 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:58.911 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589589+0000", 2024-09-13T06:40:58.911 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:58.911 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.911 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.911 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:58.912 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589589+0000", 2024-09-13T06:40:58.912 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:58.912 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.912 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.912 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:58.912 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589588+0000", 2024-09-13T06:40:58.912 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:58.912 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.912 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.912 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:58.912 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589592+0000", 2024-09-13T06:40:58.912 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.6389999999999998e-06 2024-09-13T06:40:58.912 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.913 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.913 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:58.913 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589600+0000", 2024-09-13T06:40:58.913 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.4630000000000001e-06 2024-09-13T06:40:58.913 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.913 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.913 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:58.913 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589608+0000", 2024-09-13T06:40:58.913 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.2359999999999998e-06 2024-09-13T06:40:58.914 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.914 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.914 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:58.914 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.665779+0000", 2024-09-13T06:40:58.914 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.076170924000000001 2024-09-13T06:40:58.914 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.914 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.914 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:58.914 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.665977+0000", 2024-09-13T06:40:58.915 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00019891900000000001 2024-09-13T06:40:58.915 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.915 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.915 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:58.915 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.666358+0000", 2024-09-13T06:40:58.915 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000380963 2024-09-13T06:40:58.915 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:58.915 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:58.915 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:58.915 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.915 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.915 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43293 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 342016~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:40:58.915 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589616+0000", 2024-09-13T06:40:58.916 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 37.292815283000003, 2024-09-13T06:40:58.916 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.077030083999999999, 2024-09-13T06:40:58.916 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:58.916 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:58.916 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:58.916 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:58.916 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:58.916 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43293 2024-09-13T06:40:58.916 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.916 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:58.916 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.916 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:58.916 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589616+0000", 2024-09-13T06:40:58.916 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:58.917 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.917 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.917 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:58.917 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589616+0000", 2024-09-13T06:40:58.917 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:58.917 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.917 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.917 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:58.917 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589615+0000", 2024-09-13T06:40:58.917 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:58.917 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.917 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.917 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:58.918 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589619+0000", 2024-09-13T06:40:58.918 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.9559999999999999e-06 2024-09-13T06:40:58.918 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.918 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.918 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:58.918 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589627+0000", 2024-09-13T06:40:58.918 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.2490000000000001e-06 2024-09-13T06:40:58.918 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.918 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.918 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:58.918 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589635+0000", 2024-09-13T06:40:58.918 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.96e-06 2024-09-13T06:40:58.918 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.919 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.919 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:58.919 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.666379+0000", 2024-09-13T06:40:58.919 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.076744484000000002 2024-09-13T06:40:58.919 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.919 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.919 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:58.919 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.666454+0000", 2024-09-13T06:40:58.919 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.4623999999999996e-05 2024-09-13T06:40:58.919 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.919 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.919 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:58.919 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.666646+0000", 2024-09-13T06:40:58.919 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00019176999999999999 2024-09-13T06:40:58.919 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:58.920 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:58.920 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:58.920 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.920 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.920 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43294 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 356352~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:40:58.920 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589681+0000", 2024-09-13T06:40:58.920 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 37.292749968000003, 2024-09-13T06:40:58.920 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.077594648000000002, 2024-09-13T06:40:58.920 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:58.920 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:58.920 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:58.920 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:58.920 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:58.920 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43294 2024-09-13T06:40:58.921 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.921 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:58.921 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.921 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:58.921 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589681+0000", 2024-09-13T06:40:58.921 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:58.921 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.921 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.921 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:58.921 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589681+0000", 2024-09-13T06:40:58.921 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:58.921 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.921 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.921 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:58.922 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589680+0000", 2024-09-13T06:40:58.922 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:58.922 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.922 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.922 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:58.922 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589684+0000", 2024-09-13T06:40:58.922 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.8369999999999999e-06 2024-09-13T06:40:58.922 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.922 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.922 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:58.922 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589693+0000", 2024-09-13T06:40:58.922 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.1020000000000003e-06 2024-09-13T06:40:58.922 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.922 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.923 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:58.923 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589701+0000", 2024-09-13T06:40:58.923 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.8059999999999995e-06 2024-09-13T06:40:58.923 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.923 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.923 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:58.923 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.666714+0000", 2024-09-13T06:40:58.923 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.077013463000000004 2024-09-13T06:40:58.923 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.923 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.923 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:58.923 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.666897+0000", 2024-09-13T06:40:58.923 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000182268 2024-09-13T06:40:58.923 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.924 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.924 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:58.924 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.667276+0000", 2024-09-13T06:40:58.924 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00037907499999999998 2024-09-13T06:40:58.924 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:58.924 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:58.924 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:58.924 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.924 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.924 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43295 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 370688~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:40:58.924 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589744+0000", 2024-09-13T06:40:58.924 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 37.292686795999998, 2024-09-13T06:40:58.924 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.077854343000000006, 2024-09-13T06:40:58.925 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:58.925 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:58.925 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:58.925 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:58.925 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:58.925 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43295 2024-09-13T06:40:58.925 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.925 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:58.925 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.926 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:58.926 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589744+0000", 2024-09-13T06:40:58.926 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:58.926 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.926 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.926 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:58.926 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589744+0000", 2024-09-13T06:40:58.926 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:58.926 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.927 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.927 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:58.927 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589743+0000", 2024-09-13T06:40:58.927 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:58.927 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.927 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.927 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:58.927 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589747+0000", 2024-09-13T06:40:58.927 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0130000000000004e-06 2024-09-13T06:40:58.927 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.927 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.927 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:58.928 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589756+0000", 2024-09-13T06:40:58.928 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.003e-06 2024-09-13T06:40:58.928 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.928 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.928 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:58.928 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589766+0000", 2024-09-13T06:40:58.928 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.2820000000000002e-06 2024-09-13T06:40:58.929 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.929 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.929 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:58.929 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.667300+0000", 2024-09-13T06:40:58.929 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.077534299000000001 2024-09-13T06:40:58.929 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.929 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.930 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:58.930 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.667372+0000", 2024-09-13T06:40:58.930 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.2393999999999998e-05 2024-09-13T06:40:58.930 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.930 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.930 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:58.931 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.667599+0000", 2024-09-13T06:40:58.931 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000226269 2024-09-13T06:40:58.931 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:58.931 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:58.931 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:58.931 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.931 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.931 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43296 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 385024~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:40:58.931 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589772+0000", 2024-09-13T06:40:58.931 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 37.292658772000003, 2024-09-13T06:40:58.932 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.078469647000000003, 2024-09-13T06:40:58.932 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:58.932 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:58.932 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:58.932 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:58.932 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:58.932 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43296 2024-09-13T06:40:58.932 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.932 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:58.932 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.932 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:58.932 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589772+0000", 2024-09-13T06:40:58.932 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:58.933 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.933 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.933 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:58.933 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589772+0000", 2024-09-13T06:40:58.933 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:58.933 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.933 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.933 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:58.933 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589771+0000", 2024-09-13T06:40:58.933 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:58.933 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.933 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.934 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:58.934 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589775+0000", 2024-09-13T06:40:58.934 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.8530000000000002e-06 2024-09-13T06:40:58.934 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.934 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.934 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:58.934 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589784+0000", 2024-09-13T06:40:58.934 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.4300000000000006e-06 2024-09-13T06:40:58.934 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.934 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.934 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:58.934 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589791+0000", 2024-09-13T06:40:58.934 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.4660000000000002e-06 2024-09-13T06:40:58.934 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.934 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.935 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:58.935 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.667667+0000", 2024-09-13T06:40:58.935 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.077875697999999993 2024-09-13T06:40:58.935 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.935 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.935 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:58.935 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.667854+0000", 2024-09-13T06:40:58.935 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00018760099999999999 2024-09-13T06:40:58.935 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.935 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.935 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:58.935 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.668242+0000", 2024-09-13T06:40:58.935 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00038750600000000003 2024-09-13T06:40:58.935 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:58.935 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:58.936 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:58.936 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.936 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.936 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43297 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 403456~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:40:58.936 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589797+0000", 2024-09-13T06:40:58.936 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 37.292634067999998, 2024-09-13T06:40:58.936 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.078756672999999999, 2024-09-13T06:40:58.936 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:58.936 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:58.936 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:58.936 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:58.936 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:58.936 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43297 2024-09-13T06:40:58.937 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.937 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:58.937 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.937 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:58.937 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589797+0000", 2024-09-13T06:40:58.937 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:58.937 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.937 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.937 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:58.937 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589797+0000", 2024-09-13T06:40:58.937 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:58.937 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.937 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.938 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:58.938 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589796+0000", 2024-09-13T06:40:58.938 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:58.938 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.938 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.938 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:58.938 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589800+0000", 2024-09-13T06:40:58.938 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.3230000000000002e-06 2024-09-13T06:40:58.938 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.938 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.938 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:58.938 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589808+0000", 2024-09-13T06:40:58.938 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.2390000000000002e-06 2024-09-13T06:40:58.938 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.939 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.939 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:58.939 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589815+0000", 2024-09-13T06:40:58.939 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.413e-06 2024-09-13T06:40:58.939 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.939 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.939 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:58.939 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.668265+0000", 2024-09-13T06:40:58.939 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.078449873000000003 2024-09-13T06:40:58.939 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.939 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.939 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:58.939 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.668332+0000", 2024-09-13T06:40:58.940 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.7178e-05 2024-09-13T06:40:58.940 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.940 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.940 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:58.940 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.668554+0000", 2024-09-13T06:40:58.940 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00022128600000000001 2024-09-13T06:40:58.940 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:58.940 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:58.940 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:58.940 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.940 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.940 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43298 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 417792~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:40:58.940 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589821+0000", 2024-09-13T06:40:58.940 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 37.292609945999999, 2024-09-13T06:40:58.941 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.079368660999999993, 2024-09-13T06:40:58.941 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:58.941 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:58.941 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:58.941 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:58.941 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:58.941 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43298 2024-09-13T06:40:58.941 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.941 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:58.941 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.942 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:58.942 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589821+0000", 2024-09-13T06:40:58.942 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:58.942 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.942 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.942 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:58.943 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589821+0000", 2024-09-13T06:40:58.943 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:58.943 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.943 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.943 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:58.943 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589821+0000", 2024-09-13T06:40:58.944 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:58.944 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.944 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.944 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:58.944 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589830+0000", 2024-09-13T06:40:58.944 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.4860000000000003e-06 2024-09-13T06:40:58.944 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.945 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.945 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:58.945 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589839+0000", 2024-09-13T06:40:58.945 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.0159999999999997e-06 2024-09-13T06:40:58.945 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.945 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.945 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:58.946 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589847+0000", 2024-09-13T06:40:58.946 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.6059999999999997e-06 2024-09-13T06:40:58.946 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.946 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.946 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:58.946 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.668620+0000", 2024-09-13T06:40:58.946 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.078773485000000004 2024-09-13T06:40:58.946 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.947 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.947 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:58.947 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.668798+0000", 2024-09-13T06:40:58.947 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000178233 2024-09-13T06:40:58.947 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.948 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.948 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:58.948 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.669190+0000", 2024-09-13T06:40:58.948 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00039143499999999998 2024-09-13T06:40:58.948 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:58.948 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:58.949 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:58.949 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.949 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.949 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43299 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 432128~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:40:58.949 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589881+0000", 2024-09-13T06:40:58.949 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 37.292550098, 2024-09-13T06:40:58.950 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.079693849999999997, 2024-09-13T06:40:58.950 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:58.950 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:58.950 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:58.950 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:58.950 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:58.950 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43299 2024-09-13T06:40:58.951 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.951 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:58.951 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.951 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:58.951 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589881+0000", 2024-09-13T06:40:58.951 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:58.951 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.951 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.951 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:58.951 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589881+0000", 2024-09-13T06:40:58.951 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:58.951 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.951 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.952 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:58.952 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589880+0000", 2024-09-13T06:40:58.952 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:58.952 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.952 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.952 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:58.952 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589884+0000", 2024-09-13T06:40:58.952 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.053e-06 2024-09-13T06:40:58.952 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.952 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.952 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:58.952 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589893+0000", 2024-09-13T06:40:58.953 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.2129999999999997e-06 2024-09-13T06:40:58.953 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.953 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.953 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:58.953 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589901+0000", 2024-09-13T06:40:58.953 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.6399999999999997e-06 2024-09-13T06:40:58.953 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.953 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.953 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:58.953 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.669213+0000", 2024-09-13T06:40:58.953 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.079312074999999996 2024-09-13T06:40:58.953 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.954 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.954 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:58.954 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.669281+0000", 2024-09-13T06:40:58.954 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.8322000000000001e-05 2024-09-13T06:40:58.954 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.954 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.954 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:58.954 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.669575+0000", 2024-09-13T06:40:58.954 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00029349699999999999 2024-09-13T06:40:58.954 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:58.954 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:58.954 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:58.955 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.955 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.955 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43300 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 446464~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:40:58.955 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589909+0000", 2024-09-13T06:40:58.955 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 37.292522202999997, 2024-09-13T06:40:58.955 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.080339496999999996, 2024-09-13T06:40:58.955 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:58.955 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:58.955 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:58.955 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:58.955 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:58.955 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43300 2024-09-13T06:40:58.955 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.955 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:58.956 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.956 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:58.956 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589909+0000", 2024-09-13T06:40:58.956 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:58.956 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.956 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.956 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:58.956 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589909+0000", 2024-09-13T06:40:58.956 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:58.956 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.956 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.957 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:58.957 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589908+0000", 2024-09-13T06:40:58.957 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:58.957 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.957 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.957 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:58.957 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589912+0000", 2024-09-13T06:40:58.957 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.9430000000000002e-06 2024-09-13T06:40:58.957 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.957 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.957 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:58.957 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589920+0000", 2024-09-13T06:40:58.958 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.3860000000000007e-06 2024-09-13T06:40:58.958 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.958 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.958 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:58.958 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589928+0000", 2024-09-13T06:40:58.958 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.3329999999999999e-06 2024-09-13T06:40:58.958 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.958 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.958 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:58.958 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.669651+0000", 2024-09-13T06:40:58.958 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.079723204000000006 2024-09-13T06:40:58.958 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.958 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.958 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:58.958 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.669840+0000", 2024-09-13T06:40:58.959 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000189397 2024-09-13T06:40:58.959 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.959 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.959 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:58.959 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.670248+0000", 2024-09-13T06:40:58.959 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00040811100000000001 2024-09-13T06:40:58.959 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:58.959 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:58.959 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:58.959 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.959 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.959 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43301 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 460800~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:40:58.959 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589934+0000", 2024-09-13T06:40:58.959 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 37.292497529000002, 2024-09-13T06:40:58.959 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.080747474999999999, 2024-09-13T06:40:58.960 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:58.960 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:58.960 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:58.960 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:58.960 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:58.960 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43301 2024-09-13T06:40:58.960 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.960 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:58.960 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.960 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:58.961 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589934+0000", 2024-09-13T06:40:58.961 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:58.961 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.961 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.961 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:58.961 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589934+0000", 2024-09-13T06:40:58.961 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:58.961 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.961 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.961 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:58.961 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589933+0000", 2024-09-13T06:40:58.961 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:58.961 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.962 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.962 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:58.962 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589936+0000", 2024-09-13T06:40:58.962 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.4599999999999999e-06 2024-09-13T06:40:58.962 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.962 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.962 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:58.962 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589945+0000", 2024-09-13T06:40:58.962 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.2430000000000005e-06 2024-09-13T06:40:58.962 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.962 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.962 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:58.962 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589952+0000", 2024-09-13T06:40:58.962 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.3289999999999996e-06 2024-09-13T06:40:58.962 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.963 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.963 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:58.963 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.670280+0000", 2024-09-13T06:40:58.963 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.080328514000000004 2024-09-13T06:40:58.963 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.963 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.963 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:58.963 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.670376+0000", 2024-09-13T06:40:58.963 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.5752000000000001e-05 2024-09-13T06:40:58.963 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.963 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.963 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:58.963 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.670681+0000", 2024-09-13T06:40:58.963 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00030479699999999999 2024-09-13T06:40:58.964 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:58.964 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:58.964 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:58.964 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.964 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.964 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43302 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 475136~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:40:58.964 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589958+0000", 2024-09-13T06:40:58.964 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 37.292473467000001, 2024-09-13T06:40:58.964 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.081402394000000003, 2024-09-13T06:40:58.964 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:58.964 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:58.964 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:58.965 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:58.965 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:58.965 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43302 2024-09-13T06:40:58.965 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.965 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:58.965 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.965 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:58.965 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589958+0000", 2024-09-13T06:40:58.965 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:58.965 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.965 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.965 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:58.966 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589958+0000", 2024-09-13T06:40:58.966 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:58.966 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.966 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.966 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:58.966 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589957+0000", 2024-09-13T06:40:58.966 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:40:58.966 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.966 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.966 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:58.966 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589960+0000", 2024-09-13T06:40:58.966 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.4939999999999999e-06 2024-09-13T06:40:58.966 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.967 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.967 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:58.967 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589969+0000", 2024-09-13T06:40:58.967 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.3520000000000007e-06 2024-09-13T06:40:58.967 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.967 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.967 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:58.967 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589976+0000", 2024-09-13T06:40:58.967 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.3030000000000002e-06 2024-09-13T06:40:58.967 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.967 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.968 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:58.968 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.670765+0000", 2024-09-13T06:40:58.968 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.080789154000000002 2024-09-13T06:40:58.968 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.968 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.968 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:58.968 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.670960+0000", 2024-09-13T06:40:58.968 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00019464300000000001 2024-09-13T06:40:58.968 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.968 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.968 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:58.968 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.671360+0000", 2024-09-13T06:40:58.969 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00040005200000000002 2024-09-13T06:40:58.969 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:58.969 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:58.969 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:58.969 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.969 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.969 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43303 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 489472~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:40:58.969 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589985+0000", 2024-09-13T06:40:58.969 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 37.292446519000002, 2024-09-13T06:40:58.969 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.082024333000000005, 2024-09-13T06:40:58.969 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:58.969 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:58.969 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:58.970 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:58.970 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:58.970 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43303 2024-09-13T06:40:58.970 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.970 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:58.970 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.970 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:58.970 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589985+0000", 2024-09-13T06:40:58.970 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:58.970 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.970 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.970 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:58.970 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589985+0000", 2024-09-13T06:40:58.971 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:58.971 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.971 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.971 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:58.971 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589984+0000", 2024-09-13T06:40:58.971 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:58.971 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.972 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.972 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:58.972 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589987+0000", 2024-09-13T06:40:58.972 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.726e-06 2024-09-13T06:40:58.972 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.972 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.972 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:58.972 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589996+0000", 2024-09-13T06:40:58.972 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.5459999999999992e-06 2024-09-13T06:40:58.972 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.972 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.972 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:58.973 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590003+0000", 2024-09-13T06:40:58.973 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.4229999999999999e-06 2024-09-13T06:40:58.973 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.973 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.973 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:58.973 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.671426+0000", 2024-09-13T06:40:58.973 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.081422704999999998 2024-09-13T06:40:58.973 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.973 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.974 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:58.974 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.671615+0000", 2024-09-13T06:40:58.974 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000188875 2024-09-13T06:40:58.974 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.974 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.974 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:58.974 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.672009+0000", 2024-09-13T06:40:58.974 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000394015 2024-09-13T06:40:58.974 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:58.974 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:58.974 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:58.974 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.974 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.974 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43304 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 503808~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:40:58.975 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.590039+0000", 2024-09-13T06:40:58.975 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 37.292391973999997, 2024-09-13T06:40:58.975 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.082573880000000002, 2024-09-13T06:40:58.975 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:58.975 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:58.975 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:58.975 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:58.975 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:58.975 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43304 2024-09-13T06:40:58.975 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.975 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:58.975 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.975 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:58.976 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590039+0000", 2024-09-13T06:40:58.976 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:58.976 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.976 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.976 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:58.976 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590039+0000", 2024-09-13T06:40:58.976 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:58.976 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.976 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.976 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:58.976 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590038+0000", 2024-09-13T06:40:58.976 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:58.976 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.976 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.977 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:58.977 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590042+0000", 2024-09-13T06:40:58.977 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.9500000000000003e-06 2024-09-13T06:40:58.977 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.977 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.977 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:58.977 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590052+0000", 2024-09-13T06:40:58.977 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.3919999999999992e-06 2024-09-13T06:40:58.977 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.977 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.977 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:58.977 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590059+0000", 2024-09-13T06:40:58.978 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.7970000000000001e-06 2024-09-13T06:40:58.978 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.978 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.978 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:58.978 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.672078+0000", 2024-09-13T06:40:58.978 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.082018778000000001 2024-09-13T06:40:58.978 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.978 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.978 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:58.978 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.672266+0000", 2024-09-13T06:40:58.978 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00018807399999999999 2024-09-13T06:40:58.978 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.978 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.978 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:58.979 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.672613+0000", 2024-09-13T06:40:58.979 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00034677599999999997 2024-09-13T06:40:58.979 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:58.979 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:58.979 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:58.979 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.979 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.979 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43305 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 518144~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:40:58.979 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.590136+0000", 2024-09-13T06:40:58.979 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 37.292294785999999, 2024-09-13T06:40:58.979 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.082988206999999994, 2024-09-13T06:40:58.979 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:58.979 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:40:58.979 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:58.980 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:58.980 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:58.980 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43305 2024-09-13T06:40:58.980 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.980 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:58.980 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.980 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:58.980 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590136+0000", 2024-09-13T06:40:58.980 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:58.980 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.980 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.981 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:58.981 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590136+0000", 2024-09-13T06:40:58.981 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:58.981 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.981 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.981 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:58.981 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590135+0000", 2024-09-13T06:40:58.981 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:40:58.981 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.981 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.981 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:58.982 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590139+0000", 2024-09-13T06:40:58.982 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.9489999999999998e-06 2024-09-13T06:40:58.982 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.982 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.982 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:58.982 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590148+0000", 2024-09-13T06:40:58.982 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.9830000000000002e-06 2024-09-13T06:40:58.982 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.982 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.982 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:58.983 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590156+0000", 2024-09-13T06:40:58.983 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5229999999999998e-06 2024-09-13T06:40:58.983 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.983 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.983 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:58.983 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.672709+0000", 2024-09-13T06:40:58.983 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.082552886000000006 2024-09-13T06:40:58.983 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.983 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.983 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:40:58.983 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.672816+0000", 2024-09-13T06:40:58.983 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000107736 2024-09-13T06:40:58.984 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.984 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.984 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:58.984 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.673124+0000", 2024-09-13T06:40:58.984 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00030804900000000002 2024-09-13T06:40:58.984 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:58.984 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:58.984 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:58.984 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.984 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.984 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:66818 3.17 3.50afe697 (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e100)", 2024-09-13T06:40:58.984 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:53.498942+0000", 2024-09-13T06:40:58.984 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 5.3834886009999998, 2024-09-13T06:40:58.984 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.011231284, 2024-09-13T06:40:58.985 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:40:58.985 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:40:58.985 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:40:58.985 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:40:58.985 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:40:58.985 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 66818 2024-09-13T06:40:58.985 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.985 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:40:58.985 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.985 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:40:58.985 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:53.498942+0000", 2024-09-13T06:40:58.985 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:58.985 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.986 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.986 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:40:58.986 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:53.498942+0000", 2024-09-13T06:40:58.986 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:40:58.986 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.986 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.986 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:40:58.986 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:53.498939+0000", 2024-09-13T06:40:58.986 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999967 2024-09-13T06:40:58.986 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.986 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.986 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:40:58.986 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:53.498954+0000", 2024-09-13T06:40:58.986 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5028000000000001e-05 2024-09-13T06:40:58.987 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.987 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.987 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:40:58.987 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:53.498986+0000", 2024-09-13T06:40:58.987 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.1993999999999999e-05 2024-09-13T06:40:58.987 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.987 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.987 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:40:58.987 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:53.499001+0000", 2024-09-13T06:40:58.987 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5166e-05 2024-09-13T06:40:58.987 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.987 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.987 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:58.987 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:53.505097+0000", 2024-09-13T06:40:58.988 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0060955610000000002 2024-09-13T06:40:58.988 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.988 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.988 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:40:58.988 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:53.505108+0000", 2024-09-13T06:40:58.988 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.084e-05 2024-09-13T06:40:58.988 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.988 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.988 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:40:58.988 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:54.510158+0000", 2024-09-13T06:40:58.988 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0050497549999999 2024-09-13T06:40:58.988 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:40:58.988 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:40:58.988 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:40:58.989 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:54.510174+0000", 2024-09-13T06:40:58.989 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6164e-05 2024-09-13T06:40:58.989 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:58.989 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:58.989 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:58.989 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:40:58.989 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:40:58.989 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:40:58.990 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-13T06:40:58.991 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:40:58.991+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:40:59.092 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-13T06:40:59.093+0000 7f86a5f06640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26387) UID: 0 2024-09-13T06:40:59.112 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-13T06:40:59.120 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:40:59.120 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [], 2024-09-13T06:40:59.120 INFO:teuthology.orchestra.run.smithi139.stdout: "num_ops": 0 2024-09-13T06:40:59.120 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:40:59.135 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-13T06:40:59.223 INFO:tasks.ceph.osd.6.smithi139.stderr:2024-09-13T06:40:59.225+0000 7fcd02c5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26385) UID: 0 2024-09-13T06:40:59.264 INFO:teuthology.orchestra.run.smithi081.stdout:osd.0: {} 2024-09-13T06:40:59.264 INFO:teuthology.orchestra.run.smithi081.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-13T06:40:59.280 INFO:teuthology.orchestra.run.smithi081.stdout:osd.1: {} 2024-09-13T06:40:59.280 INFO:teuthology.orchestra.run.smithi081.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-13T06:40:59.293 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:40:59.295+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:40:59.296 INFO:teuthology.orchestra.run.smithi081.stdout:osd.2: {} 2024-09-13T06:40:59.296 INFO:teuthology.orchestra.run.smithi081.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-13T06:40:59.305 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:40:59.305 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [], 2024-09-13T06:40:59.305 INFO:teuthology.orchestra.run.smithi139.stdout: "complaint_time": 30, 2024-09-13T06:40:59.305 INFO:teuthology.orchestra.run.smithi139.stdout: "num_blocked_ops": 0 2024-09-13T06:40:59.305 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:40:59.311 INFO:teuthology.orchestra.run.smithi081.stdout:osd.3: {} 2024-09-13T06:40:59.312 INFO:teuthology.orchestra.run.smithi081.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-13T06:40:59.319 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-13T06:40:59.330 INFO:teuthology.orchestra.run.smithi081.stdout:osd.4: {} 2024-09-13T06:40:59.330 INFO:teuthology.orchestra.run.smithi081.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-13T06:40:59.348 INFO:teuthology.orchestra.run.smithi081.stdout:osd.5: {} 2024-09-13T06:40:59.348 INFO:teuthology.orchestra.run.smithi081.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-13T06:40:59.367 INFO:teuthology.orchestra.run.smithi081.stdout:osd.6: {} 2024-09-13T06:40:59.367 INFO:teuthology.orchestra.run.smithi081.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-13T06:40:59.374 INFO:teuthology.orchestra.run.smithi081.stderr:nodeep-scrub is unset 2024-09-13T06:40:59.394 INFO:teuthology.orchestra.run.smithi081.stdout:osd.7: {} 2024-09-13T06:40:59.394 INFO:teuthology.orchestra.run.smithi081.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-13T06:40:59.395 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:40:59.395+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:40:59.489 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:40:59.489 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:40:59.495 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:40:59.495+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:40:59.504 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-13T06:40:59.516 INFO:teuthology.orchestra.run.smithi081.stdout:checking clone #15, image image_client.0-clone15 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent16 2024-09-13T06:40:59.597 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-13T06:40:59.597+0000 7f86a5f06640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26387) UID: 0 2024-09-13T06:40:59.634 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:40:59.634 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:40:59.648 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-13T06:40:59.697 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:40:59.699+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:40:59.799 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:40:59.799+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:40:59.815 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:40:59.815 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:40:59.830 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-13T06:40:59.899 INFO:teuthology.orchestra.run.smithi081.stdout:2608 punch from 0x70ec7b5 to 0x70f8daf, (0xc5fa bytes) 2024-09-13T06:40:59.899 INFO:tasks.ceph.osd.6.smithi139.stderr:2024-09-13T06:40:59.901+0000 7fcd02c5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26385) UID: 0 2024-09-13T06:40:59.904 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:40:59.904 INFO:teuthology.orchestra.run.smithi081.stdout:2610 write 0x13d83c8 thru 0x13d9fb8 (0x1bf1 bytes) 2024-09-13T06:40:59.910 INFO:teuthology.orchestra.run.smithi081.stdout:2611 write 0x92f2173 thru 0x92f8fd6 (0x6e64 bytes) 2024-09-13T06:40:59.915 INFO:teuthology.orchestra.run.smithi081.stdout:2613 read 0x66dab65 thru 0x66e690a (0xbda6 bytes) 2024-09-13T06:40:59.929 INFO:teuthology.orchestra.run.smithi081.stdout:2614 trunc from 0xa68911c to 0x101d1a1 2024-09-13T06:40:59.952 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:40:59.952 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:40:59.955 INFO:teuthology.orchestra.run.smithi081.stdout:2615 trunc from 0x101d1a1 to 0x61f8fa 2024-09-13T06:40:59.966 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-13T06:40:59.990 INFO:teuthology.orchestra.run.smithi081.stdout:2616 punch from 0x5e4629 to 0x5ef9ad, (0xb384 bytes) 2024-09-13T06:40:59.990 INFO:teuthology.orchestra.run.smithi081.stdout:2617 read 0x2d4a12 thru 0x2e119e (0xc78d bytes) 2024-09-13T06:40:59.991 INFO:teuthology.orchestra.run.smithi081.stdout:2618 punch from 0x33417 to 0x33f80, (0xb69 bytes) 2024-09-13T06:40:59.991 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:40:59.991 INFO:teuthology.orchestra.run.smithi081.stdout:2620 writesame 0xe2e7 thru 0x1afad data_size 0x1(0xccc7 bytes) 2024-09-13T06:41:00.000 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:40:59.999+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:41:00.042 INFO:teuthology.orchestra.run.smithi081.stdout:2621 read 0x449e2e thru 0x44e9b0 (0x4b83 bytes) 2024-09-13T06:41:00.055 INFO:teuthology.orchestra.run.smithi081.stdout:2622 trunc from 0x61f8fa to 0x96ef308 2024-09-13T06:41:00.074 INFO:teuthology.orchestra.run.smithi081.stdout:2623 trunc from 0x96ef308 to 0x1f8695c 2024-09-13T06:41:00.086 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:41:00.087 INFO:teuthology.orchestra.run.smithi081.stdout:2625 read 0x1c76640 thru 0x1c7c1e1 (0x5ba2 bytes) 2024-09-13T06:41:00.089 INFO:teuthology.orchestra.run.smithi081.stdout:2628 trunc from 0x1f8695c to 0x5019b8 2024-09-13T06:41:00.101 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:41:00.103+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:41:00.110 INFO:teuthology.orchestra.run.smithi081.stdout:2629 read 0x2ebc5b thru 0x2efe9d (0x4243 bytes) 2024-09-13T06:41:00.111 INFO:teuthology.orchestra.run.smithi081.stdout:2630 punch from 0x41a415 to 0x41ffda, (0x5bc5 bytes) 2024-09-13T06:41:00.127 INFO:teuthology.orchestra.run.smithi081.stdout:2631 write 0x55e455b thru 0x55f1479 (0xcf1f bytes) 2024-09-13T06:41:00.147 INFO:teuthology.orchestra.run.smithi081.stdout:2632 write 0x8563a20 thru 0x856551b (0x1afc bytes) 2024-09-13T06:41:00.160 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:41:00.160 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:41:00.161 INFO:teuthology.orchestra.run.smithi081.stdout:2634 trunc from 0x856551c to 0x1f0a67f 2024-09-13T06:41:00.174 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:41:00.174 INFO:teuthology.orchestra.run.smithi081.stdout:2638 read 0x4e9017 thru 0x4ebc43 (0x2c2d bytes) 2024-09-13T06:41:00.179 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-13T06:41:00.183 INFO:teuthology.orchestra.run.smithi081.stdout:2639 write 0x2562580 thru 0x25697aa (0x722b bytes) 2024-09-13T06:41:00.186 INFO:teuthology.orchestra.run.smithi081.stdout:2641 read 0xa6e9b1 thru 0xa77671 (0x8cc1 bytes) 2024-09-13T06:41:00.188 INFO:teuthology.orchestra.run.smithi081.stdout:2642 trunc from 0x25697ab to 0x12edecb 2024-09-13T06:41:00.203 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:41:00.203+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:41:00.214 INFO:teuthology.orchestra.run.smithi081.stdout:2643 write 0x5c5d550 thru 0x5c6a9bc (0xd46d bytes) 2024-09-13T06:41:00.218 INFO:teuthology.orchestra.run.smithi081.stdout:2644 write 0x33aad28 thru 0x33af051 (0x432a bytes) 2024-09-13T06:41:00.232 INFO:teuthology.orchestra.run.smithi081.stdout:2645 trunc from 0x5c6a9bd to 0xda92ca0 2024-09-13T06:41:00.239 INFO:teuthology.orchestra.run.smithi081.stdout:2646 clone 18 order 25 su 16777216 sc 2 2024-09-13T06:41:00.304 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-13T06:41:00.305+0000 7f86a5f06640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26387) UID: 0 2024-09-13T06:41:00.310 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:41:00.311 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:41:00.325 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-13T06:41:00.404 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:41:00.405+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:41:00.496 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:41:00.496 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:41:00.505 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:41:00.505+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:41:00.511 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-13T06:41:00.606 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:41:00.607+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:41:00.648 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:41:00.648 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:41:00.662 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-13T06:41:00.707 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:41:00.707+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:41:00.808 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:41:00.807+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:41:00.834 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:41:00.834 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:41:00.848 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-13T06:41:00.933 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:41:00.935+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:41:01.010 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:41:01.009+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:41:01.012 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:41:01.012 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:41:01.026 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-13T06:41:01.117 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:41:01.119+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:41:01.193 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:41:01.193 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:41:01.207 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-13T06:41:01.249 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:41:01.251+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:41:01.312 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:41:01.311+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:41:01.368 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:41:01.368 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:41:01.382 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-13T06:41:01.399 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-13T06:41:01.415 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-13T06:41:01.426 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:41:01.427+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:41:01.514 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-13T06:41:01.513+0000 7f86a5f06640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26387) UID: 0 2024-09-13T06:41:01.550 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:41:01.550 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:41:01.566 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-13T06:41:01.574 INFO:teuthology.orchestra.run.smithi081.stdout:osd.0: {} 2024-09-13T06:41:01.575 INFO:teuthology.orchestra.run.smithi081.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-13T06:41:01.601 INFO:teuthology.orchestra.run.smithi081.stdout:osd.1: {} 2024-09-13T06:41:01.601 INFO:teuthology.orchestra.run.smithi081.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-13T06:41:01.615 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-13T06:41:01.617+0000 7f86a5f06640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26387) UID: 0 2024-09-13T06:41:01.619 INFO:teuthology.orchestra.run.smithi081.stdout:osd.2: {} 2024-09-13T06:41:01.619 INFO:teuthology.orchestra.run.smithi081.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-13T06:41:01.639 INFO:teuthology.orchestra.run.smithi081.stdout:osd.3: {} 2024-09-13T06:41:01.639 INFO:teuthology.orchestra.run.smithi081.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-13T06:41:01.664 INFO:teuthology.orchestra.run.smithi081.stdout:osd.4: {} 2024-09-13T06:41:01.664 INFO:teuthology.orchestra.run.smithi081.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-13T06:41:01.687 INFO:teuthology.orchestra.run.smithi081.stdout:osd.5: {} 2024-09-13T06:41:01.687 INFO:teuthology.orchestra.run.smithi081.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-13T06:41:01.705 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:41:01.705 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-13T06:41:01.705 INFO:teuthology.orchestra.run.smithi081.stdout: "num_ops": 0 2024-09-13T06:41:01.705 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:41:01.707 INFO:teuthology.orchestra.run.smithi081.stdout:osd.6: {} 2024-09-13T06:41:01.708 INFO:teuthology.orchestra.run.smithi081.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-13T06:41:01.716 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:41:01.715+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:41:01.719 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-13T06:41:01.728 INFO:teuthology.orchestra.run.smithi081.stdout:osd.7: {} 2024-09-13T06:41:01.728 INFO:teuthology.orchestra.run.smithi081.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-13T06:41:01.817 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:41:01.819+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:41:01.844 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:41:01.844 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-13T06:41:01.844 INFO:teuthology.orchestra.run.smithi081.stdout: "complaint_time": 30, 2024-09-13T06:41:01.844 INFO:teuthology.orchestra.run.smithi081.stdout: "num_blocked_ops": 0 2024-09-13T06:41:01.844 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:41:01.857 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-13T06:41:01.918 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-13T06:41:01.917+0000 7f86a5f06640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26387) UID: 0 2024-09-13T06:41:02.019 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:41:02.019+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:41:02.028 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:41:02.028 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 20, 2024-09-13T06:41:02.029 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 600, 2024-09-13T06:41:02.029 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [ 2024-09-13T06:41:02.029 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:02.029 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:2226 3.15 3:af026987:::rbd_data.112173e2f1b7.0000000000000017:head [sparse-read 0~4194304] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-13T06:41:02.029 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:37.606562+0000", 2024-09-13T06:41:02.029 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 84.422072206999999, 2024-09-13T06:41:02.029 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.83322091700000001, 2024-09-13T06:41:02.029 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:02.029 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:41:02.029 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:02.029 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:02.029 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:02.030 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 2226 2024-09-13T06:41:02.030 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:02.030 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:02.030 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:02.030 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:02.030 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606562+0000", 2024-09-13T06:41:02.030 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:02.030 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:02.030 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:02.030 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:02.030 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606562+0000", 2024-09-13T06:41:02.030 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:02.031 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:02.031 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:02.031 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:02.031 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606561+0000", 2024-09-13T06:41:02.031 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:02.031 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:02.031 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:02.031 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:02.031 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606565+0000", 2024-09-13T06:41:02.032 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.4379999999999999e-06 2024-09-13T06:41:02.032 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:02.032 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:02.032 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:02.032 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606569+0000", 2024-09-13T06:41:02.032 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.425e-06 2024-09-13T06:41:02.032 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:02.032 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:02.032 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:02.032 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606572+0000", 2024-09-13T06:41:02.032 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.05e-06 2024-09-13T06:41:02.032 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:02.032 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:02.033 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:02.033 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606621+0000", 2024-09-13T06:41:02.033 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.8723000000000001e-05 2024-09-13T06:41:02.033 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:02.033 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:02.033 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:41:02.033 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606630+0000", 2024-09-13T06:41:02.033 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.8040000000000007e-06 2024-09-13T06:41:02.033 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:02.033 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:02.033 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:02.034 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.439648+0000", 2024-09-13T06:41:02.034 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.83301824800000002 2024-09-13T06:41:02.034 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:02.034 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:02.034 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:02.034 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.439782+0000", 2024-09-13T06:41:02.034 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00013466699999999999 2024-09-13T06:41:02.034 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:02.035 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:02.035 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:02.035 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:02.035 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:02.035 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25661 3.8 3:1180686c:::rbd_data.1121f2c5ee81.0000000000000009:13 [read 397312~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:02.035 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.436956+0000", 2024-09-13T06:41:02.036 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 65.591677673000007, 2024-09-13T06:41:02.036 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089036758999999993, 2024-09-13T06:41:02.036 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:02.036 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:02.036 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:02.036 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:02.036 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:02.036 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25661 2024-09-13T06:41:02.036 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:02.036 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:02.037 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:02.037 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:02.037 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436956+0000", 2024-09-13T06:41:02.037 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:02.037 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:02.037 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:02.037 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:02.037 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436956+0000", 2024-09-13T06:41:02.037 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:02.037 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:02.037 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:02.037 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:02.037 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436956+0000", 2024-09-13T06:41:02.038 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:02.038 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:02.038 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:02.038 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:02.038 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436958+0000", 2024-09-13T06:41:02.038 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1770000000000001e-06 2024-09-13T06:41:02.038 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:02.038 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:02.038 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:02.038 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436963+0000", 2024-09-13T06:41:02.038 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.6489999999999996e-06 2024-09-13T06:41:02.038 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:02.038 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:02.039 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:02.039 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436975+0000", 2024-09-13T06:41:02.039 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1783999999999999e-05 2024-09-13T06:41:02.039 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:02.039 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:02.039 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:02.039 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.525671+0000", 2024-09-13T06:41:02.039 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.088696292999999995 2024-09-13T06:41:02.039 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:02.039 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:02.039 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:02.039 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.525749+0000", 2024-09-13T06:41:02.039 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.7589000000000005e-05 2024-09-13T06:41:02.040 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:02.040 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:02.040 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:02.040 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.525993+0000", 2024-09-13T06:41:02.040 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00024381000000000001 2024-09-13T06:41:02.040 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:02.040 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:02.040 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:02.040 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:02.040 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:02.040 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25662 3.8 3:1180686c:::rbd_data.1121f2c5ee81.0000000000000009:13 [read 421888~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:02.040 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.436980+0000", 2024-09-13T06:41:02.040 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 65.591653360999999, 2024-09-13T06:41:02.041 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089367577000000004, 2024-09-13T06:41:02.041 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:02.041 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:02.041 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:02.041 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:02.041 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:02.041 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25662 2024-09-13T06:41:02.041 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:02.041 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:02.041 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:02.041 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:02.041 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436980+0000", 2024-09-13T06:41:02.041 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:02.042 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:02.042 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:02.042 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:02.042 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436980+0000", 2024-09-13T06:41:02.042 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:02.042 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:02.042 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:02.042 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:02.042 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436980+0000", 2024-09-13T06:41:02.042 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:02.042 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:02.042 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:02.042 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:02.042 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436982+0000", 2024-09-13T06:41:02.043 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3989999999999998e-06 2024-09-13T06:41:02.043 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:02.043 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:02.043 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:02.043 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436988+0000", 2024-09-13T06:41:02.043 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0039999999999996e-06 2024-09-13T06:41:02.043 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:02.043 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:02.043 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:02.043 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436993+0000", 2024-09-13T06:41:02.043 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6090000000000003e-06 2024-09-13T06:41:02.043 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:02.043 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:02.043 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:02.044 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.526035+0000", 2024-09-13T06:41:02.044 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089042248000000004 2024-09-13T06:41:02.044 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:02.044 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:02.044 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:02.044 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.526111+0000", 2024-09-13T06:41:02.044 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5643999999999996e-05 2024-09-13T06:41:02.044 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:02.044 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:02.044 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:02.044 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.526348+0000", 2024-09-13T06:41:02.044 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00023705800000000001 2024-09-13T06:41:02.045 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:02.045 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:02.045 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:02.045 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:02.045 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:02.045 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25663 3.8 3:1180686c:::rbd_data.1121f2c5ee81.0000000000000009:13 [read 466944~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:02.045 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.436998+0000", 2024-09-13T06:41:02.045 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 65.591635714000006, 2024-09-13T06:41:02.045 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089730867000000006, 2024-09-13T06:41:02.045 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:02.045 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:02.045 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:02.045 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:02.046 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:02.046 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25663 2024-09-13T06:41:02.046 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:02.046 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:02.046 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:02.046 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:02.046 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436998+0000", 2024-09-13T06:41:02.046 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:02.046 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:02.046 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:02.046 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:02.046 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436998+0000", 2024-09-13T06:41:02.047 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:02.047 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:02.047 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:02.047 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:02.047 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436998+0000", 2024-09-13T06:41:02.047 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:02.047 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:02.047 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:02.047 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:02.047 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437000+0000", 2024-09-13T06:41:02.047 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0940000000000002e-06 2024-09-13T06:41:02.047 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:02.047 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:02.048 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:02.048 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437005+0000", 2024-09-13T06:41:02.048 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.604e-06 2024-09-13T06:41:02.048 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:02.048 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:02.048 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:02.048 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437032+0000", 2024-09-13T06:41:02.048 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6407e-05 2024-09-13T06:41:02.048 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:02.048 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:02.048 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:02.048 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.526363+0000", 2024-09-13T06:41:02.049 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089331456000000004 2024-09-13T06:41:02.049 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:02.049 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:02.049 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:02.049 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.526404+0000", 2024-09-13T06:41:02.049 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.0887999999999999e-05 2024-09-13T06:41:02.049 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:02.049 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:02.049 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:02.049 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.526729+0000", 2024-09-13T06:41:02.049 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00032486 2024-09-13T06:41:02.049 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:02.049 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:02.050 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:02.050 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:02.050 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:02.050 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25664 3.8 3:1180686c:::rbd_data.1121f2c5ee81.0000000000000009:13 [read 491520~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:02.050 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.437040+0000", 2024-09-13T06:41:02.050 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 65.591593798999995, 2024-09-13T06:41:02.050 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.090016650000000004, 2024-09-13T06:41:02.050 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:02.050 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:02.050 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:02.050 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:02.051 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:02.051 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25664 2024-09-13T06:41:02.051 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:02.051 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:02.051 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:02.051 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:02.051 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437040+0000", 2024-09-13T06:41:02.051 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:02.051 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:02.051 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:02.051 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:02.051 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437040+0000", 2024-09-13T06:41:02.052 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:02.052 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:02.052 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:02.052 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:02.052 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437039+0000", 2024-09-13T06:41:02.052 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:02.052 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:02.052 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:02.052 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:02.052 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437047+0000", 2024-09-13T06:41:02.052 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4839999999999998e-06 2024-09-13T06:41:02.052 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:02.052 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:02.053 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:02.053 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437054+0000", 2024-09-13T06:41:02.053 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.8299999999999998e-06 2024-09-13T06:41:02.053 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:02.053 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:02.053 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:02.053 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437060+0000", 2024-09-13T06:41:02.053 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.1510000000000001e-06 2024-09-13T06:41:02.053 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:02.053 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:02.053 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:02.053 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.526772+0000", 2024-09-13T06:41:02.053 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089711737999999999 2024-09-13T06:41:02.054 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:02.054 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:02.054 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:02.054 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.526848+0000", 2024-09-13T06:41:02.054 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5870000000000004e-05 2024-09-13T06:41:02.054 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:02.054 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:02.054 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:02.054 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.527057+0000", 2024-09-13T06:41:02.054 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000209106 2024-09-13T06:41:02.054 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:02.054 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:02.054 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:02.055 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:02.055 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:02.055 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25740 3.18 3:1c662b96:::rbd_data.1121f2c5ee81.0000000000000010:13 [read 200704~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:02.055 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443352+0000", 2024-09-13T06:41:02.055 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 65.585282124000003, 2024-09-13T06:41:02.055 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089068222000000002, 2024-09-13T06:41:02.055 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:02.055 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:02.055 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:02.055 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:02.055 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:02.055 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25740 2024-09-13T06:41:02.055 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:02.056 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:02.056 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:02.056 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:02.056 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443352+0000", 2024-09-13T06:41:02.056 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:02.056 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:02.056 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:02.056 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:02.056 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443352+0000", 2024-09-13T06:41:02.056 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:02.056 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:02.056 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:02.056 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:02.057 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443351+0000", 2024-09-13T06:41:02.057 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:02.057 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:02.057 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:02.057 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:02.057 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443354+0000", 2024-09-13T06:41:02.057 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.841e-06 2024-09-13T06:41:02.057 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:02.057 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:02.057 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:02.057 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443361+0000", 2024-09-13T06:41:02.057 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.0010000000000004e-06 2024-09-13T06:41:02.057 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:02.058 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:02.058 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:02.058 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443366+0000", 2024-09-13T06:41:02.058 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7119999999999999e-06 2024-09-13T06:41:02.058 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:02.058 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:02.058 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:02.058 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532117+0000", 2024-09-13T06:41:02.058 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.088751327000000005 2024-09-13T06:41:02.058 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:02.058 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:02.058 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:02.058 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532193+0000", 2024-09-13T06:41:02.058 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5839000000000004e-05 2024-09-13T06:41:02.059 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:02.059 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:02.059 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:02.059 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532420+0000", 2024-09-13T06:41:02.059 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00022691000000000001 2024-09-13T06:41:02.059 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:02.059 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:02.059 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:02.059 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:02.059 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:02.059 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25741 3.18 3:1c662b96:::rbd_data.1121f2c5ee81.0000000000000010:13 [read 225280~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:02.059 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443378+0000", 2024-09-13T06:41:02.059 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 65.585255356999994, 2024-09-13T06:41:02.060 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089324107, 2024-09-13T06:41:02.060 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:02.060 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:02.060 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:02.060 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:02.060 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:02.060 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25741 2024-09-13T06:41:02.060 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:02.060 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:02.060 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:02.060 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:02.060 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443378+0000", 2024-09-13T06:41:02.060 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:02.061 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:02.061 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:02.061 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:02.061 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443378+0000", 2024-09-13T06:41:02.061 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:02.061 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:02.061 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:02.061 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:02.061 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443378+0000", 2024-09-13T06:41:02.061 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:02.061 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:02.061 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:02.062 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:02.062 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443380+0000", 2024-09-13T06:41:02.062 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3549999999999999e-06 2024-09-13T06:41:02.062 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:02.062 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:02.062 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:02.062 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443388+0000", 2024-09-13T06:41:02.062 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.7449999999999995e-06 2024-09-13T06:41:02.062 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:02.062 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:02.062 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:02.062 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443393+0000", 2024-09-13T06:41:02.062 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.4e-06 2024-09-13T06:41:02.063 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:02.063 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:02.063 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:02.063 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532454+0000", 2024-09-13T06:41:02.063 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089060941000000005 2024-09-13T06:41:02.063 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:02.063 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:02.063 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:02.063 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532512+0000", 2024-09-13T06:41:02.063 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7763000000000002e-05 2024-09-13T06:41:02.063 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:02.063 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:02.063 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:02.063 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532703+0000", 2024-09-13T06:41:02.064 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000190328 2024-09-13T06:41:02.064 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:02.064 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:02.064 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:02.064 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:02.064 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:02.064 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25742 3.18 3:1c662b96:::rbd_data.1121f2c5ee81.0000000000000010:13 [read 270336~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:02.064 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443398+0000", 2024-09-13T06:41:02.064 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 65.585235644999997, 2024-09-13T06:41:02.064 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089621836999999996, 2024-09-13T06:41:02.064 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:02.064 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:02.065 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:02.065 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:02.065 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:02.065 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25742 2024-09-13T06:41:02.065 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:02.065 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:02.065 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:02.065 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:02.065 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443398+0000", 2024-09-13T06:41:02.065 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:02.065 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:02.065 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:02.065 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:02.066 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443398+0000", 2024-09-13T06:41:02.066 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:02.066 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:02.066 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:02.066 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:02.066 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443398+0000", 2024-09-13T06:41:02.066 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:02.066 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:02.066 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:02.066 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:02.066 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443400+0000", 2024-09-13T06:41:02.066 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1849999999999998e-06 2024-09-13T06:41:02.066 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:02.067 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:02.067 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:02.067 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443407+0000", 2024-09-13T06:41:02.067 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3669999999999999e-06 2024-09-13T06:41:02.067 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:02.067 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:02.067 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:02.067 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443420+0000", 2024-09-13T06:41:02.067 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2645e-05 2024-09-13T06:41:02.067 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:02.067 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:02.067 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:02.067 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532742+0000", 2024-09-13T06:41:02.068 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089322200000000004 2024-09-13T06:41:02.068 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:02.068 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:02.068 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:02.068 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532818+0000", 2024-09-13T06:41:02.068 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.6019000000000005e-05 2024-09-13T06:41:02.068 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:02.068 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:02.068 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:02.068 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533020+0000", 2024-09-13T06:41:02.068 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000201721 2024-09-13T06:41:02.068 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:02.068 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:02.069 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:02.069 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:02.069 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:02.069 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25743 3.18 3:1c662b96:::rbd_data.1121f2c5ee81.0000000000000010:13 [read 294912~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:02.069 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443425+0000", 2024-09-13T06:41:02.069 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 65.585208636999994, 2024-09-13T06:41:02.069 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089864075000000002, 2024-09-13T06:41:02.069 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:02.069 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:02.069 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:02.069 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:02.069 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:02.069 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25743 2024-09-13T06:41:02.070 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:02.070 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:02.070 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:02.070 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:02.070 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443425+0000", 2024-09-13T06:41:02.070 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:02.070 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:02.070 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:02.070 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:02.070 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443425+0000", 2024-09-13T06:41:02.070 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:02.070 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:02.070 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:02.071 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:02.071 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443425+0000", 2024-09-13T06:41:02.071 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:02.071 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:02.071 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:02.071 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:02.071 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443432+0000", 2024-09-13T06:41:02.071 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3420000000000002e-06 2024-09-13T06:41:02.071 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:02.071 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:02.071 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:02.071 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443440+0000", 2024-09-13T06:41:02.071 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5689999999999999e-06 2024-09-13T06:41:02.071 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:02.072 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:02.072 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:02.072 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443445+0000", 2024-09-13T06:41:02.072 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9590000000000003e-06 2024-09-13T06:41:02.072 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:02.072 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:02.072 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:02.072 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533063+0000", 2024-09-13T06:41:02.072 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089617988999999995 2024-09-13T06:41:02.072 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:02.072 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:02.072 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:02.072 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533122+0000", 2024-09-13T06:41:02.073 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9052999999999999e-05 2024-09-13T06:41:02.073 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:02.073 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:02.073 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:02.073 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533289+0000", 2024-09-13T06:41:02.073 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00016752800000000001 2024-09-13T06:41:02.073 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:02.073 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:02.073 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:02.073 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:02.073 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:02.073 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25744 3.18 3.69d46638 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:02.073 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443449+0000", 2024-09-13T06:41:02.074 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 65.585184490000003, 2024-09-13T06:41:02.074 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089869148999999995, 2024-09-13T06:41:02.074 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:02.074 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:41:02.074 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:02.074 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:02.074 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:02.074 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25744 2024-09-13T06:41:02.074 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:02.074 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:02.074 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:02.074 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:02.074 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443449+0000", 2024-09-13T06:41:02.074 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:02.075 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:02.075 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:02.075 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:02.075 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443449+0000", 2024-09-13T06:41:02.075 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:02.075 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:02.075 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:02.075 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:02.075 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443449+0000", 2024-09-13T06:41:02.075 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:02.075 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:02.075 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:02.075 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:02.076 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443451+0000", 2024-09-13T06:41:02.076 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.244e-06 2024-09-13T06:41:02.076 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:02.076 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:02.076 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:02.076 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443457+0000", 2024-09-13T06:41:02.076 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.66e-06 2024-09-13T06:41:02.076 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:02.076 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:02.076 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:02.076 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443461+0000", 2024-09-13T06:41:02.076 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5449999999999997e-06 2024-09-13T06:41:02.076 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:02.077 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:02.077 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:02.077 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533311+0000", 2024-09-13T06:41:02.077 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089849729000000003 2024-09-13T06:41:02.077 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:02.077 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:02.077 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:02.077 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533318+0000", 2024-09-13T06:41:02.077 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.328e-06 2024-09-13T06:41:02.078 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:02.078 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:02.078 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:02.078 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:02.078 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:02.078 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25745 3.18 3.69d46638 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:02.078 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443466+0000", 2024-09-13T06:41:02.078 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 65.585167432000006, 2024-09-13T06:41:02.078 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089886743000000005, 2024-09-13T06:41:02.078 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:02.078 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:41:02.078 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:02.078 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:02.079 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:02.079 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25745 2024-09-13T06:41:02.079 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:02.079 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:02.079 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:02.079 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:02.079 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443466+0000", 2024-09-13T06:41:02.079 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:02.079 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:02.079 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:02.079 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:02.079 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443466+0000", 2024-09-13T06:41:02.079 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:02.080 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:02.080 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:02.080 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:02.080 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443466+0000", 2024-09-13T06:41:02.080 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:02.080 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:02.080 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:02.080 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:02.080 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443474+0000", 2024-09-13T06:41:02.080 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.1289999999999996e-06 2024-09-13T06:41:02.080 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:02.080 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:02.080 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:02.081 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443484+0000", 2024-09-13T06:41:02.081 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0654e-05 2024-09-13T06:41:02.081 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:02.081 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:02.081 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:02.081 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443490+0000", 2024-09-13T06:41:02.081 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8030000000000002e-06 2024-09-13T06:41:02.081 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:02.081 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:02.081 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:02.081 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533348+0000", 2024-09-13T06:41:02.081 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089857267000000005 2024-09-13T06:41:02.081 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:02.082 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:02.082 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:02.082 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533353+0000", 2024-09-13T06:41:02.082 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.5520000000000004e-06 2024-09-13T06:41:02.082 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:02.082 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:02.082 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:02.082 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:02.082 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:02.082 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25746 3.18 3.69d46638 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:02.082 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443495+0000", 2024-09-13T06:41:02.082 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 65.585138318999995, 2024-09-13T06:41:02.082 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089903725000000004, 2024-09-13T06:41:02.082 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:02.083 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:41:02.083 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:02.083 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:02.083 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:02.083 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25746 2024-09-13T06:41:02.083 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:02.083 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:02.083 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:02.083 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:02.083 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443495+0000", 2024-09-13T06:41:02.083 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:02.083 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:02.083 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:02.084 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:02.084 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443495+0000", 2024-09-13T06:41:02.084 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:02.084 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:02.084 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:02.084 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:02.084 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443495+0000", 2024-09-13T06:41:02.084 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:02.084 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:02.084 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:02.084 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:02.084 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443498+0000", 2024-09-13T06:41:02.084 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.7690000000000001e-06 2024-09-13T06:41:02.085 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:02.085 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:02.085 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:02.085 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443504+0000", 2024-09-13T06:41:02.085 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9710000000000001e-06 2024-09-13T06:41:02.085 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:02.085 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:02.085 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:02.085 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443508+0000", 2024-09-13T06:41:02.085 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4159999999999997e-06 2024-09-13T06:41:02.085 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:02.085 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:02.085 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:02.086 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533391+0000", 2024-09-13T06:41:02.086 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089882607000000003 2024-09-13T06:41:02.086 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:02.086 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:02.086 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:02.086 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533399+0000", 2024-09-13T06:41:02.086 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.4349999999999997e-06 2024-09-13T06:41:02.086 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:02.086 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:02.086 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:02.086 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:02.086 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:02.086 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25747 3.8 3.63996268 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:02.086 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443512+0000", 2024-09-13T06:41:02.087 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 65.585121588000007, 2024-09-13T06:41:02.087 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089880075000000004, 2024-09-13T06:41:02.087 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:02.087 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:41:02.087 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:02.087 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:02.087 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:02.087 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25747 2024-09-13T06:41:02.087 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:02.087 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:02.087 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:02.087 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:02.087 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443512+0000", 2024-09-13T06:41:02.088 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:02.088 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:02.088 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:02.088 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:02.088 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443512+0000", 2024-09-13T06:41:02.088 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:02.088 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:02.088 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:02.088 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:02.088 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443512+0000", 2024-09-13T06:41:02.088 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:02.088 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:02.089 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:02.089 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:02.089 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443514+0000", 2024-09-13T06:41:02.089 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0980000000000001e-06 2024-09-13T06:41:02.089 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:02.089 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:02.089 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:02.089 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443520+0000", 2024-09-13T06:41:02.089 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7069999999999997e-06 2024-09-13T06:41:02.090 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:02.090 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:02.090 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:02.090 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443524+0000", 2024-09-13T06:41:02.090 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5390000000000001e-06 2024-09-13T06:41:02.090 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:02.090 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:02.090 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:02.090 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533384+0000", 2024-09-13T06:41:02.090 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089859684999999995 2024-09-13T06:41:02.090 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:02.090 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:02.090 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:02.091 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533392+0000", 2024-09-13T06:41:02.091 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.3440000000000001e-06 2024-09-13T06:41:02.091 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:02.091 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:02.091 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:02.091 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:02.091 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:02.091 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25748 3.8 3.63996268 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:02.091 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443528+0000", 2024-09-13T06:41:02.091 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 65.585105460999998, 2024-09-13T06:41:02.091 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089890715999999996, 2024-09-13T06:41:02.091 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:02.092 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:41:02.092 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:02.092 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:02.092 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:02.092 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25748 2024-09-13T06:41:02.092 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:02.092 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:02.092 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:02.092 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:02.092 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443528+0000", 2024-09-13T06:41:02.092 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:02.092 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:02.092 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:02.093 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:02.093 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443528+0000", 2024-09-13T06:41:02.093 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:02.093 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:02.093 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:02.093 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:02.093 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443528+0000", 2024-09-13T06:41:02.093 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:02.093 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:02.093 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:02.093 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:02.093 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443530+0000", 2024-09-13T06:41:02.094 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0650000000000001e-06 2024-09-13T06:41:02.094 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:02.094 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:02.094 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:02.094 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443536+0000", 2024-09-13T06:41:02.094 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7259999999999999e-06 2024-09-13T06:41:02.094 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:02.094 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:02.094 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:02.094 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443540+0000", 2024-09-13T06:41:02.094 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5009999999999998e-06 2024-09-13T06:41:02.095 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:02.095 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:02.095 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:02.095 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533412+0000", 2024-09-13T06:41:02.095 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089871873000000005 2024-09-13T06:41:02.095 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:02.095 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:02.095 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:02.095 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533419+0000", 2024-09-13T06:41:02.095 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.883e-06 2024-09-13T06:41:02.095 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:02.095 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:02.096 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:02.096 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:02.096 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:02.096 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25749 3.8 3.63996268 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:02.096 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443545+0000", 2024-09-13T06:41:02.096 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 65.585089264999993, 2024-09-13T06:41:02.096 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089897988999999998, 2024-09-13T06:41:02.096 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:02.096 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:41:02.096 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:02.096 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:02.096 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:02.096 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25749 2024-09-13T06:41:02.097 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:02.097 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:02.097 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:02.097 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:02.097 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443545+0000", 2024-09-13T06:41:02.097 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:02.097 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:02.097 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:02.097 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:02.097 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443545+0000", 2024-09-13T06:41:02.097 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:02.097 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:02.097 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:02.098 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:02.098 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443544+0000", 2024-09-13T06:41:02.098 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:02.098 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:02.098 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:02.098 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:02.098 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443553+0000", 2024-09-13T06:41:02.098 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.4770000000000003e-06 2024-09-13T06:41:02.098 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:02.098 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:02.098 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:02.098 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443564+0000", 2024-09-13T06:41:02.098 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0986e-05 2024-09-13T06:41:02.098 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:02.099 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:02.099 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:02.099 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443569+0000", 2024-09-13T06:41:02.099 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2530000000000004e-06 2024-09-13T06:41:02.099 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:02.099 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:02.099 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:02.099 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533438+0000", 2024-09-13T06:41:02.099 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089868641999999999 2024-09-13T06:41:02.099 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:02.099 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:02.099 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:02.099 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533442+0000", 2024-09-13T06:41:02.100 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.989e-06 2024-09-13T06:41:02.100 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:02.100 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:02.100 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:02.100 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:02.100 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:02.100 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25750 3.8 3.63996268 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:02.100 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443574+0000", 2024-09-13T06:41:02.100 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 65.585059779000005, 2024-09-13T06:41:02.100 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089895143999999996, 2024-09-13T06:41:02.100 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:02.100 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:41:02.100 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:02.101 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:02.101 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:02.101 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25750 2024-09-13T06:41:02.101 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:02.101 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:02.101 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:02.101 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:02.101 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443574+0000", 2024-09-13T06:41:02.101 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:02.101 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:02.101 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:02.101 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:02.101 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443574+0000", 2024-09-13T06:41:02.101 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:02.102 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:02.102 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:02.102 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:02.102 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443574+0000", 2024-09-13T06:41:02.102 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:02.102 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:02.102 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:02.102 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:02.102 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443576+0000", 2024-09-13T06:41:02.102 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6910000000000002e-06 2024-09-13T06:41:02.102 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:02.102 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:02.102 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:02.103 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443583+0000", 2024-09-13T06:41:02.103 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.331e-06 2024-09-13T06:41:02.103 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:02.103 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:02.103 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:02.103 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443587+0000", 2024-09-13T06:41:02.103 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6129999999999997e-06 2024-09-13T06:41:02.103 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:02.103 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:02.103 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:02.103 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533464+0000", 2024-09-13T06:41:02.103 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089876605999999998 2024-09-13T06:41:02.103 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:02.104 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:02.104 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:02.104 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533469+0000", 2024-09-13T06:41:02.104 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3909999999999997e-06 2024-09-13T06:41:02.104 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:02.104 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:02.104 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:02.104 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:02.104 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:02.104 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25751 3.8 3.63996268 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:02.104 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443592+0000", 2024-09-13T06:41:02.104 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 65.585042082000001, 2024-09-13T06:41:02.104 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089913650999999997, 2024-09-13T06:41:02.105 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:02.105 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:41:02.105 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:02.105 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:02.105 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:02.105 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25751 2024-09-13T06:41:02.105 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:02.105 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:02.105 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:02.105 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:02.105 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443592+0000", 2024-09-13T06:41:02.105 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:02.105 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:02.106 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:02.106 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:02.106 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443592+0000", 2024-09-13T06:41:02.106 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:02.106 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:02.106 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:02.106 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:02.106 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443591+0000", 2024-09-13T06:41:02.106 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:02.106 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:02.106 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:02.106 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:02.106 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443594+0000", 2024-09-13T06:41:02.107 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3649999999999998e-06 2024-09-13T06:41:02.107 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:02.107 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:02.107 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:02.107 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443599+0000", 2024-09-13T06:41:02.107 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.699e-06 2024-09-13T06:41:02.107 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:02.107 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:02.107 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:02.107 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443611+0000", 2024-09-13T06:41:02.107 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1503e-05 2024-09-13T06:41:02.107 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:02.107 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:02.108 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:02.108 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533497+0000", 2024-09-13T06:41:02.108 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089886453000000005 2024-09-13T06:41:02.108 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:02.108 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:02.108 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:02.108 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533505+0000", 2024-09-13T06:41:02.108 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.9910000000000002e-06 2024-09-13T06:41:02.108 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:02.108 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:02.108 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:02.108 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:02.108 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:02.109 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25752 3.8 3.63996268 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:02.109 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443615+0000", 2024-09-13T06:41:02.109 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 65.585018301000005, 2024-09-13T06:41:02.109 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089905868999999999, 2024-09-13T06:41:02.109 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:02.109 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:41:02.109 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:02.109 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:02.109 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:02.109 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25752 2024-09-13T06:41:02.109 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:02.110 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:02.110 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:02.110 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:02.110 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443615+0000", 2024-09-13T06:41:02.110 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:02.110 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:02.110 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:02.110 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:02.110 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443615+0000", 2024-09-13T06:41:02.110 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:02.111 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:02.111 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:02.111 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:02.111 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443615+0000", 2024-09-13T06:41:02.111 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:02.111 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:02.111 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:02.111 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:02.111 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443617+0000", 2024-09-13T06:41:02.111 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3539999999999998e-06 2024-09-13T06:41:02.111 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:02.111 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:02.112 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:02.112 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443624+0000", 2024-09-13T06:41:02.112 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3600000000000001e-06 2024-09-13T06:41:02.112 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:02.112 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:02.112 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:02.112 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443628+0000", 2024-09-13T06:41:02.112 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.2350000000000001e-06 2024-09-13T06:41:02.112 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:02.112 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:02.112 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:02.112 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533517+0000", 2024-09-13T06:41:02.112 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089889029999999995 2024-09-13T06:41:02.113 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:02.113 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:02.113 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:02.113 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533521+0000", 2024-09-13T06:41:02.113 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.2529999999999998e-06 2024-09-13T06:41:02.113 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:02.113 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:02.113 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:02.113 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:02.113 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:02.113 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25755 3.8 3.63996268 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:02.113 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.444692+0000", 2024-09-13T06:41:02.113 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 65.583941594999999, 2024-09-13T06:41:02.114 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.088904186999999996, 2024-09-13T06:41:02.114 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:02.114 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:41:02.114 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:02.114 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:02.114 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:02.114 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25755 2024-09-13T06:41:02.114 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:02.114 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:02.114 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:02.114 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:02.114 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.444692+0000", 2024-09-13T06:41:02.114 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:02.114 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:02.115 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:02.115 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:02.115 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.444692+0000", 2024-09-13T06:41:02.115 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:02.115 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:02.115 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:02.115 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:02.115 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.444692+0000", 2024-09-13T06:41:02.115 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:02.115 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:02.115 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:02.115 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:02.115 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.444694+0000", 2024-09-13T06:41:02.115 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.058e-06 2024-09-13T06:41:02.116 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:02.116 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:02.116 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:02.116 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.444700+0000", 2024-09-13T06:41:02.116 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7769999999999999e-06 2024-09-13T06:41:02.116 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:02.116 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:02.116 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:02.116 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.444704+0000", 2024-09-13T06:41:02.116 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6229999999999996e-06 2024-09-13T06:41:02.116 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:02.116 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:02.116 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:02.117 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533587+0000", 2024-09-13T06:41:02.117 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.088882744999999999 2024-09-13T06:41:02.117 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:02.117 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:02.117 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:02.117 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533596+0000", 2024-09-13T06:41:02.117 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.3270000000000007e-06 2024-09-13T06:41:02.117 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:02.117 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:02.117 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:02.117 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:02.117 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:02.117 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:64356 3.c 3:32785be9:::rbd_header.11218ba71f0d:head [watch reconnect cookie 140361410387072 gen 2] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e95)", 2024-09-13T06:41:02.118 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:48.473318+0000", 2024-09-13T06:41:02.118 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 13.555315908000001, 2024-09-13T06:41:02.118 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1458904379999999, 2024-09-13T06:41:02.118 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:02.118 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:02.118 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:02.118 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:02.118 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:02.118 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 64356 2024-09-13T06:41:02.118 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:02.118 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:02.118 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:02.118 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:02.118 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:48.473318+0000", 2024-09-13T06:41:02.119 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:02.119 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:02.119 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:02.119 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:02.119 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:48.473318+0000", 2024-09-13T06:41:02.119 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:02.119 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:02.119 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:02.119 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:02.119 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:48.473315+0000", 2024-09-13T06:41:02.119 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999971 2024-09-13T06:41:02.119 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:02.119 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:02.120 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:02.120 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:48.473329+0000", 2024-09-13T06:41:02.120 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.433e-05 2024-09-13T06:41:02.120 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:02.120 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:02.120 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:02.120 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:48.473363+0000", 2024-09-13T06:41:02.120 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.3592e-05 2024-09-13T06:41:02.120 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:02.120 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:02.120 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:02.120 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:48.473386+0000", 2024-09-13T06:41:02.120 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2708999999999999e-05 2024-09-13T06:41:02.121 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:02.121 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:02.121 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:02.121 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:48.473804+0000", 2024-09-13T06:41:02.121 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00041789399999999998 2024-09-13T06:41:02.121 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:02.121 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:02.121 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:41:02.121 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:48.473830+0000", 2024-09-13T06:41:02.121 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6869e-05 2024-09-13T06:41:02.121 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:02.121 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:02.121 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:02.122 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:49.614332+0000", 2024-09-13T06:41:02.122 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.140501107 2024-09-13T06:41:02.122 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:02.122 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:02.122 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for rw locks", 2024-09-13T06:41:02.122 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:49.614496+0000", 2024-09-13T06:41:02.122 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00016451200000000001 2024-09-13T06:41:02.122 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:02.122 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:02.122 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:02.122 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:49.617131+0000", 2024-09-13T06:41:02.122 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.002634843 2024-09-13T06:41:02.123 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:02.123 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:02.123 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:02.123 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:49.617204+0000", 2024-09-13T06:41:02.123 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.2991000000000006e-05 2024-09-13T06:41:02.123 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:02.123 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:02.123 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:02.123 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:49.619208+0000", 2024-09-13T06:41:02.123 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.002004381 2024-09-13T06:41:02.123 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:02.123 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:02.123 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:02.124 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:02.124 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:02.124 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:41:02.126 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-13T06:41:02.126 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:41:02.127+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:41:02.227 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:41:02.227+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:41:02.259 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:41:02.259 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [], 2024-09-13T06:41:02.260 INFO:teuthology.orchestra.run.smithi139.stdout: "num_ops": 0 2024-09-13T06:41:02.260 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:41:02.274 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-13T06:41:02.327 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:41:02.327+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:41:02.399 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:41:02.399 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [], 2024-09-13T06:41:02.399 INFO:teuthology.orchestra.run.smithi139.stdout: "complaint_time": 30, 2024-09-13T06:41:02.399 INFO:teuthology.orchestra.run.smithi139.stdout: "num_blocked_ops": 0 2024-09-13T06:41:02.399 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:41:02.413 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-13T06:41:02.428 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:41:02.427+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:41:02.529 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:41:02.527+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:41:02.535 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:41:02.535 INFO:teuthology.orchestra.run.smithi139.stdout: "size": 20, 2024-09-13T06:41:02.535 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 600, 2024-09-13T06:41:02.536 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [ 2024-09-13T06:41:02.536 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:02.536 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18706 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 3346432~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:41:02.536 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.846138+0000", 2024-09-13T06:41:02.536 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 70.690021826000006, 2024-09-13T06:41:02.536 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.102018712, 2024-09-13T06:41:02.536 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:02.536 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:02.536 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:02.536 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:02.536 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:02.536 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18706 2024-09-13T06:41:02.536 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:02.537 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:02.537 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:02.537 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:02.537 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846138+0000", 2024-09-13T06:41:02.537 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:02.537 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:02.537 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:02.537 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:02.537 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846138+0000", 2024-09-13T06:41:02.537 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:02.537 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:02.537 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:02.537 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:02.537 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846138+0000", 2024-09-13T06:41:02.538 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:02.538 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:02.538 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:02.538 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:02.538 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846141+0000", 2024-09-13T06:41:02.538 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.6969999999999999e-06 2024-09-13T06:41:02.538 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:02.538 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:02.538 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:02.538 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846150+0000", 2024-09-13T06:41:02.538 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6400000000000003e-06 2024-09-13T06:41:02.538 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:02.538 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:02.538 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:02.539 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846160+0000", 2024-09-13T06:41:02.539 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.3999999999999998e-06 2024-09-13T06:41:02.539 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:02.539 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:02.539 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:02.539 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.947764+0000", 2024-09-13T06:41:02.539 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101604085 2024-09-13T06:41:02.539 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:02.539 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:02.539 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:02.539 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.947888+0000", 2024-09-13T06:41:02.539 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000124113 2024-09-13T06:41:02.539 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:02.539 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:02.540 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:02.540 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.948157+0000", 2024-09-13T06:41:02.540 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00026943399999999998 2024-09-13T06:41:02.540 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:02.540 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:02.540 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:02.540 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:02.540 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:02.540 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18707 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 3375104~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:41:02.540 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.846207+0000", 2024-09-13T06:41:02.540 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 70.689953059999993, 2024-09-13T06:41:02.540 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10238114099999999, 2024-09-13T06:41:02.540 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:02.540 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:02.541 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:02.541 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:02.541 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:02.541 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18707 2024-09-13T06:41:02.541 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:02.541 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:02.541 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:02.541 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:02.541 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846207+0000", 2024-09-13T06:41:02.541 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:02.541 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:02.541 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:02.541 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:02.541 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846207+0000", 2024-09-13T06:41:02.542 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:02.542 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:02.542 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:02.542 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:02.542 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846206+0000", 2024-09-13T06:41:02.542 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:02.542 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:02.542 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:02.542 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:02.542 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846211+0000", 2024-09-13T06:41:02.542 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.3000000000000003e-06 2024-09-13T06:41:02.542 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:02.542 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:02.543 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:02.543 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846220+0000", 2024-09-13T06:41:02.543 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6199999999999994e-06 2024-09-13T06:41:02.543 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:02.543 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:02.543 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:02.543 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846228+0000", 2024-09-13T06:41:02.543 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.7500000000000003e-06 2024-09-13T06:41:02.543 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:02.543 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:02.543 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:02.543 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.948267+0000", 2024-09-13T06:41:02.544 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10203878700000001 2024-09-13T06:41:02.544 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:02.544 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:02.544 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:02.544 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.948435+0000", 2024-09-13T06:41:02.544 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00016796500000000001 2024-09-13T06:41:02.544 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:02.544 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:02.544 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:02.544 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.948588+0000", 2024-09-13T06:41:02.544 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00015373599999999999 2024-09-13T06:41:02.544 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:02.544 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:02.544 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:02.545 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:02.545 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:02.545 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18718 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 3690496~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:41:02.545 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.850174+0000", 2024-09-13T06:41:02.545 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 70.685985907000003, 2024-09-13T06:41:02.545 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101854154, 2024-09-13T06:41:02.545 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:02.545 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:02.545 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:02.545 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:02.545 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:02.545 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18718 2024-09-13T06:41:02.545 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:02.546 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:02.546 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:02.546 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:02.546 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850174+0000", 2024-09-13T06:41:02.546 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:02.546 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:02.546 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:02.546 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:02.546 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850174+0000", 2024-09-13T06:41:02.546 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:02.546 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:02.546 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:02.546 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:02.546 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850173+0000", 2024-09-13T06:41:02.547 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:02.547 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:02.547 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:02.547 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:02.547 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850178+0000", 2024-09-13T06:41:02.547 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.4129999999999999e-06 2024-09-13T06:41:02.547 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:02.547 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:02.547 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:02.547 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850188+0000", 2024-09-13T06:41:02.547 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.8600000000000005e-06 2024-09-13T06:41:02.548 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:02.548 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:02.548 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:02.548 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850195+0000", 2024-09-13T06:41:02.548 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.8730000000000007e-06 2024-09-13T06:41:02.548 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:02.548 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:02.548 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:02.548 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.951766+0000", 2024-09-13T06:41:02.548 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.1015703 2024-09-13T06:41:02.548 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:02.548 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:02.548 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:02.549 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.951879+0000", 2024-09-13T06:41:02.549 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000112932 2024-09-13T06:41:02.549 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:02.549 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:02.549 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:02.549 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.952029+0000", 2024-09-13T06:41:02.549 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000149846 2024-09-13T06:41:02.549 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:02.549 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:02.549 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:02.549 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:02.549 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:02.549 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18719 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 3719168~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:41:02.550 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.850202+0000", 2024-09-13T06:41:02.550 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 70.685957864000002, 2024-09-13T06:41:02.550 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.102191676, 2024-09-13T06:41:02.550 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:02.550 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:02.550 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:02.550 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:02.550 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:02.550 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18719 2024-09-13T06:41:02.550 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:02.550 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:02.550 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:02.550 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:02.550 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850202+0000", 2024-09-13T06:41:02.551 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:02.551 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:02.551 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:02.551 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:02.551 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850202+0000", 2024-09-13T06:41:02.551 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:02.551 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:02.551 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:02.551 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:02.551 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850202+0000", 2024-09-13T06:41:02.551 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:02.551 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:02.551 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:02.552 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:02.552 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850205+0000", 2024-09-13T06:41:02.552 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.89e-06 2024-09-13T06:41:02.552 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:02.552 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:02.552 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:02.552 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850216+0000", 2024-09-13T06:41:02.552 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0233e-05 2024-09-13T06:41:02.552 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:02.552 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:02.552 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:02.552 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850223+0000", 2024-09-13T06:41:02.552 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5299999999999999e-06 2024-09-13T06:41:02.553 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:02.553 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:02.553 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:02.553 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.952106+0000", 2024-09-13T06:41:02.553 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10188309299999999 2024-09-13T06:41:02.553 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:02.553 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:02.553 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:02.553 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.952233+0000", 2024-09-13T06:41:02.554 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000126993 2024-09-13T06:41:02.554 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:02.554 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:02.554 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:02.554 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.952394+0000", 2024-09-13T06:41:02.554 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000160791 2024-09-13T06:41:02.554 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:02.554 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:02.554 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:02.554 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:02.554 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:02.554 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18720 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 3747840~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:41:02.554 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.850726+0000", 2024-09-13T06:41:02.555 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 70.685434035, 2024-09-13T06:41:02.555 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10199504299999999, 2024-09-13T06:41:02.555 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:02.555 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:02.555 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:02.555 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:02.555 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:02.555 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18720 2024-09-13T06:41:02.555 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:02.555 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:02.555 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:02.556 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:02.556 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850726+0000", 2024-09-13T06:41:02.556 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:02.556 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:02.556 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:02.556 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:02.556 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850726+0000", 2024-09-13T06:41:02.556 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:02.556 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:02.556 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:02.556 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:02.556 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850229+0000", 2024-09-13T06:41:02.556 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9995027 2024-09-13T06:41:02.557 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:02.557 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:02.557 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:02.557 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850731+0000", 2024-09-13T06:41:02.557 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00050221599999999999 2024-09-13T06:41:02.557 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:02.557 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:02.557 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:02.557 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850751+0000", 2024-09-13T06:41:02.557 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.9703000000000001e-05 2024-09-13T06:41:02.557 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:02.557 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:02.557 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:02.558 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850764+0000", 2024-09-13T06:41:02.558 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3207000000000001e-05 2024-09-13T06:41:02.558 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:02.558 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:02.558 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:02.558 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.952454+0000", 2024-09-13T06:41:02.558 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101690102 2024-09-13T06:41:02.558 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:02.558 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:02.558 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:02.558 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.952571+0000", 2024-09-13T06:41:02.558 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000116556 2024-09-13T06:41:02.558 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:02.558 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:02.559 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:02.559 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.952721+0000", 2024-09-13T06:41:02.559 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000150419 2024-09-13T06:41:02.559 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:02.559 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:02.559 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:02.559 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:02.559 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:02.559 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18730 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 4034560~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:41:02.559 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.854013+0000", 2024-09-13T06:41:02.559 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 70.682147094000001, 2024-09-13T06:41:02.559 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10186914399999999, 2024-09-13T06:41:02.559 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:02.560 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:02.560 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:02.560 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:02.560 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:02.560 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18730 2024-09-13T06:41:02.560 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:02.560 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:02.560 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:02.560 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:02.560 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.854013+0000", 2024-09-13T06:41:02.560 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:02.560 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:02.560 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:02.560 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:02.561 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.854013+0000", 2024-09-13T06:41:02.561 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:02.561 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:02.561 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:02.561 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:02.561 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.854013+0000", 2024-09-13T06:41:02.561 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:02.561 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:02.561 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:02.561 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:02.561 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.854016+0000", 2024-09-13T06:41:02.561 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.1839999999999999e-06 2024-09-13T06:41:02.561 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:02.561 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:02.561 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:02.562 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.854025+0000", 2024-09-13T06:41:02.562 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.8030000000000003e-06 2024-09-13T06:41:02.562 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:02.562 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:02.562 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:02.562 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.854033+0000", 2024-09-13T06:41:02.562 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6500000000000002e-06 2024-09-13T06:41:02.562 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:02.562 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:02.562 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:02.562 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.955546+0000", 2024-09-13T06:41:02.562 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10151296 2024-09-13T06:41:02.562 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:02.562 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:02.562 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:02.563 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.955694+0000", 2024-09-13T06:41:02.563 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000147773 2024-09-13T06:41:02.563 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:02.563 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:02.563 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:02.563 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.955882+0000", 2024-09-13T06:41:02.563 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000188371 2024-09-13T06:41:02.563 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:02.563 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:02.563 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:02.563 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:02.563 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:02.563 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18742 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 4378624~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:41:02.563 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.857984+0000", 2024-09-13T06:41:02.563 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 70.678175971000002, 2024-09-13T06:41:02.564 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10179961799999999, 2024-09-13T06:41:02.564 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:02.564 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:02.564 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:02.564 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:02.564 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:02.564 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18742 2024-09-13T06:41:02.564 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:02.564 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:02.564 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:02.564 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:02.564 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.857984+0000", 2024-09-13T06:41:02.564 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:02.564 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:02.565 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:02.565 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:02.565 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.857984+0000", 2024-09-13T06:41:02.565 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:02.565 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:02.565 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:02.565 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:02.565 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.857983+0000", 2024-09-13T06:41:02.565 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:02.565 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:02.565 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:02.565 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:02.565 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.857987+0000", 2024-09-13T06:41:02.565 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0670000000000002e-06 2024-09-13T06:41:02.566 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:02.566 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:02.566 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:02.566 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.857997+0000", 2024-09-13T06:41:02.566 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6830000000000003e-06 2024-09-13T06:41:02.566 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:02.566 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:02.566 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:02.566 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.858006+0000", 2024-09-13T06:41:02.566 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.5739999999999996e-06 2024-09-13T06:41:02.566 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:02.566 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:02.566 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:02.566 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.959453+0000", 2024-09-13T06:41:02.566 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101447339 2024-09-13T06:41:02.567 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:02.567 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:02.567 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:02.567 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.959603+0000", 2024-09-13T06:41:02.567 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000150316 2024-09-13T06:41:02.567 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:02.567 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:02.567 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:02.567 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.959784+0000", 2024-09-13T06:41:02.567 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00018065900000000001 2024-09-13T06:41:02.567 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:02.567 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:02.567 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:02.567 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:02.568 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:02.568 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18743 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 4407296~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:41:02.568 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.858012+0000", 2024-09-13T06:41:02.568 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 70.678147977999998, 2024-09-13T06:41:02.568 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10210024500000001, 2024-09-13T06:41:02.568 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:02.568 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:02.568 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:02.568 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:02.568 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:02.568 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18743 2024-09-13T06:41:02.568 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:02.568 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:02.568 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:02.569 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:02.569 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.858012+0000", 2024-09-13T06:41:02.569 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:02.569 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:02.569 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:02.569 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:02.569 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.858012+0000", 2024-09-13T06:41:02.569 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:02.569 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:02.569 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:02.569 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:02.569 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.858011+0000", 2024-09-13T06:41:02.569 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:02.570 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:02.570 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:02.570 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:02.570 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.858016+0000", 2024-09-13T06:41:02.570 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0659999999999997e-06 2024-09-13T06:41:02.570 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:02.570 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:02.570 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:02.570 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.858024+0000", 2024-09-13T06:41:02.570 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.7700000000000007e-06 2024-09-13T06:41:02.570 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:02.570 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:02.571 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:02.571 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.858032+0000", 2024-09-13T06:41:02.571 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.7700000000000001e-06 2024-09-13T06:41:02.571 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:02.571 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:02.571 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:02.571 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.959850+0000", 2024-09-13T06:41:02.571 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.1018182 2024-09-13T06:41:02.571 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:02.571 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:02.571 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:02.571 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.959964+0000", 2024-09-13T06:41:02.571 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00011413600000000001 2024-09-13T06:41:02.571 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:02.571 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:02.572 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:02.572 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.960113+0000", 2024-09-13T06:41:02.572 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00014813900000000001 2024-09-13T06:41:02.572 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:02.572 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:02.572 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:02.572 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:02.572 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:02.572 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18755 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 4751360~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:41:02.572 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.862061+0000", 2024-09-13T06:41:02.572 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 70.674099725999994, 2024-09-13T06:41:02.572 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101907023, 2024-09-13T06:41:02.572 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:02.573 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:02.573 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:02.573 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:02.573 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:02.573 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18755 2024-09-13T06:41:02.573 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:02.573 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:02.573 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:02.573 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:02.573 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862061+0000", 2024-09-13T06:41:02.573 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:02.573 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:02.573 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:02.574 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:02.574 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862061+0000", 2024-09-13T06:41:02.574 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:02.574 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:02.574 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:02.574 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:02.574 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862060+0000", 2024-09-13T06:41:02.574 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:02.574 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:02.574 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:02.574 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:02.574 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862064+0000", 2024-09-13T06:41:02.574 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.3229999999999999e-06 2024-09-13T06:41:02.575 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:02.575 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:02.575 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:02.575 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862078+0000", 2024-09-13T06:41:02.575 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.433e-05 2024-09-13T06:41:02.575 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:02.575 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:02.575 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:02.575 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862086+0000", 2024-09-13T06:41:02.575 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.3869999999999997e-06 2024-09-13T06:41:02.575 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:02.575 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:02.575 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:02.575 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.963635+0000", 2024-09-13T06:41:02.576 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101549606 2024-09-13T06:41:02.576 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:02.576 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:02.576 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:02.576 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.963783+0000", 2024-09-13T06:41:02.576 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000147312 2024-09-13T06:41:02.576 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:02.576 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:02.576 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:02.576 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.963968+0000", 2024-09-13T06:41:02.576 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000185028 2024-09-13T06:41:02.576 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:02.576 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:02.577 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:02.577 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:02.577 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:02.577 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18756 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 4780032~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:41:02.577 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.862132+0000", 2024-09-13T06:41:02.577 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 70.674027882999994, 2024-09-13T06:41:02.577 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.102159295, 2024-09-13T06:41:02.577 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:02.577 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:02.577 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:02.577 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:02.577 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:02.577 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18756 2024-09-13T06:41:02.578 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:02.578 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:02.578 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:02.578 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:02.578 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862132+0000", 2024-09-13T06:41:02.578 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:02.578 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:02.578 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:02.578 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:02.578 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862132+0000", 2024-09-13T06:41:02.578 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:02.578 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:02.579 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:02.579 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:02.579 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862132+0000", 2024-09-13T06:41:02.579 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:02.579 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:02.579 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:02.579 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:02.579 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862136+0000", 2024-09-13T06:41:02.579 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.9559999999999999e-06 2024-09-13T06:41:02.579 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:02.579 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:02.579 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:02.579 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862145+0000", 2024-09-13T06:41:02.579 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6169999999999996e-06 2024-09-13T06:41:02.579 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:02.580 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:02.580 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:02.580 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862153+0000", 2024-09-13T06:41:02.580 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.8359999999999992e-06 2024-09-13T06:41:02.580 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:02.580 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:02.580 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:02.580 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.964018+0000", 2024-09-13T06:41:02.580 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101865421 2024-09-13T06:41:02.580 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:02.580 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:02.580 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:02.581 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.964140+0000", 2024-09-13T06:41:02.581 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000121172 2024-09-13T06:41:02.581 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:02.581 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:02.581 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:02.581 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.964292+0000", 2024-09-13T06:41:02.581 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00015202600000000001 2024-09-13T06:41:02.581 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:02.581 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:02.581 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:02.581 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:02.581 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:02.581 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18768 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 5124096~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:41:02.582 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.866345+0000", 2024-09-13T06:41:02.582 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 70.669815576000005, 2024-09-13T06:41:02.582 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101779361, 2024-09-13T06:41:02.582 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:02.582 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:02.582 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:02.582 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:02.582 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:02.582 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18768 2024-09-13T06:41:02.582 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:02.582 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:02.582 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:02.582 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:02.583 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.866345+0000", 2024-09-13T06:41:02.583 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:02.583 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:02.583 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:02.583 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:02.583 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.866345+0000", 2024-09-13T06:41:02.583 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:02.583 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:02.583 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:02.583 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:02.583 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.866344+0000", 2024-09-13T06:41:02.583 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:02.583 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:02.584 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:02.584 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:02.584 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.866348+0000", 2024-09-13T06:41:02.584 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.4300000000000002e-06 2024-09-13T06:41:02.584 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:02.584 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:02.584 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:02.584 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.866356+0000", 2024-09-13T06:41:02.584 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.5930000000000006e-06 2024-09-13T06:41:02.584 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:02.584 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:02.584 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:02.584 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.866364+0000", 2024-09-13T06:41:02.584 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5599999999999996e-06 2024-09-13T06:41:02.585 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:02.585 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:02.585 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:02.585 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.967865+0000", 2024-09-13T06:41:02.585 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101501683 2024-09-13T06:41:02.585 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:02.585 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:02.585 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:02.585 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.967981+0000", 2024-09-13T06:41:02.585 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000115643 2024-09-13T06:41:02.585 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:02.586 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:02.586 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:02.586 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.968124+0000", 2024-09-13T06:41:02.586 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00014305500000000001 2024-09-13T06:41:02.586 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:02.586 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:02.586 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:02.586 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:02.586 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:02.587 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18779 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 5439488~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:41:02.587 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.869996+0000", 2024-09-13T06:41:02.587 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 70.666164691000006, 2024-09-13T06:41:02.587 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10189577399999999, 2024-09-13T06:41:02.587 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:02.587 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:02.587 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:02.587 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:02.587 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:02.587 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18779 2024-09-13T06:41:02.588 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:02.588 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:02.588 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:02.588 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:02.588 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.869996+0000", 2024-09-13T06:41:02.588 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:02.588 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:02.588 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:02.588 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:02.588 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.869996+0000", 2024-09-13T06:41:02.589 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:02.589 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:02.589 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:02.589 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:02.589 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.869995+0000", 2024-09-13T06:41:02.589 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:02.589 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:02.589 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:02.589 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:02.589 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.869998+0000", 2024-09-13T06:41:02.589 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.2729999999999998e-06 2024-09-13T06:41:02.589 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:02.590 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:02.590 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:02.590 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.870007+0000", 2024-09-13T06:41:02.590 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.5760000000000006e-06 2024-09-13T06:41:02.590 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:02.590 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:02.590 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:02.590 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.870014+0000", 2024-09-13T06:41:02.590 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.1400000000000002e-06 2024-09-13T06:41:02.590 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:02.590 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:02.590 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:02.590 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.971631+0000", 2024-09-13T06:41:02.591 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101617503 2024-09-13T06:41:02.591 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:02.591 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:02.591 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:02.591 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.971747+0000", 2024-09-13T06:41:02.591 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00011599600000000001 2024-09-13T06:41:02.591 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:02.591 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:02.591 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:02.591 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.971891+0000", 2024-09-13T06:41:02.591 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000143912 2024-09-13T06:41:02.591 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:02.592 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:02.592 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:02.592 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:02.592 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:02.592 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18792 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 5812224~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:41:02.592 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.874371+0000", 2024-09-13T06:41:02.592 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 70.661789561000006, 2024-09-13T06:41:02.592 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101736005, 2024-09-13T06:41:02.592 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:02.592 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:02.592 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:02.592 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:02.593 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:02.593 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18792 2024-09-13T06:41:02.593 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:02.593 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:02.593 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:02.593 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:02.593 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874371+0000", 2024-09-13T06:41:02.593 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:02.593 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:02.593 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:02.593 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:02.593 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874371+0000", 2024-09-13T06:41:02.593 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:02.594 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:02.594 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:02.594 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:02.594 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874370+0000", 2024-09-13T06:41:02.594 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:02.594 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:02.594 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:02.594 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:02.594 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874374+0000", 2024-09-13T06:41:02.594 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.7239999999999998e-06 2024-09-13T06:41:02.594 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:02.594 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:02.595 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:02.595 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874385+0000", 2024-09-13T06:41:02.595 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1293e-05 2024-09-13T06:41:02.595 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:02.595 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:02.595 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:02.595 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874394+0000", 2024-09-13T06:41:02.595 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.0729999999999994e-06 2024-09-13T06:41:02.595 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:02.595 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:02.595 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:02.595 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.975850+0000", 2024-09-13T06:41:02.595 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10145599700000001 2024-09-13T06:41:02.596 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:02.596 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:02.596 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:02.596 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.975963+0000", 2024-09-13T06:41:02.596 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000112689 2024-09-13T06:41:02.596 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:02.596 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:02.596 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:02.596 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.976107+0000", 2024-09-13T06:41:02.596 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000143836 2024-09-13T06:41:02.596 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:02.596 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:02.597 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:02.597 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:02.597 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:02.597 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18793 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 5840896~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:41:02.597 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.874401+0000", 2024-09-13T06:41:02.597 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 70.661759528000005, 2024-09-13T06:41:02.597 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.102005516, 2024-09-13T06:41:02.597 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:02.597 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:02.597 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:02.597 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:02.597 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:02.597 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18793 2024-09-13T06:41:02.598 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:02.598 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:02.598 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:02.598 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:02.598 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874401+0000", 2024-09-13T06:41:02.598 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:02.598 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:02.598 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:02.598 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:02.598 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874401+0000", 2024-09-13T06:41:02.598 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:02.598 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:02.598 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:02.599 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:02.599 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874400+0000", 2024-09-13T06:41:02.599 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:02.599 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:02.599 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:02.599 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:02.599 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874404+0000", 2024-09-13T06:41:02.599 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0069999999999999e-06 2024-09-13T06:41:02.599 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:02.599 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:02.599 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:02.599 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874412+0000", 2024-09-13T06:41:02.599 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.5399999999999996e-06 2024-09-13T06:41:02.599 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:02.600 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:02.600 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:02.600 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874420+0000", 2024-09-13T06:41:02.600 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.6199999999999999e-06 2024-09-13T06:41:02.600 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:02.600 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:02.600 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:02.600 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.976150+0000", 2024-09-13T06:41:02.600 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101729874 2024-09-13T06:41:02.600 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:02.600 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:02.600 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:02.600 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.976261+0000", 2024-09-13T06:41:02.601 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000110819 2024-09-13T06:41:02.601 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:02.601 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:02.601 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:02.601 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.976406+0000", 2024-09-13T06:41:02.601 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000145489 2024-09-13T06:41:02.601 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:02.601 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:02.601 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:02.601 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:02.601 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:02.601 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18803 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 6127616~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:41:02.601 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.877851+0000", 2024-09-13T06:41:02.601 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 70.658309035000002, 2024-09-13T06:41:02.602 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101951584, 2024-09-13T06:41:02.602 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:02.602 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:02.602 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:02.602 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:02.602 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:02.602 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18803 2024-09-13T06:41:02.602 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:02.602 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:02.602 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:02.602 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:02.602 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.877851+0000", 2024-09-13T06:41:02.602 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:02.602 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:02.602 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:02.603 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:02.603 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.877851+0000", 2024-09-13T06:41:02.603 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:02.603 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:02.603 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:02.603 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:02.603 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.877851+0000", 2024-09-13T06:41:02.603 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:02.603 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:02.603 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:02.603 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:02.603 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.877854+0000", 2024-09-13T06:41:02.603 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.7929999999999999e-06 2024-09-13T06:41:02.604 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:02.604 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:02.604 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:02.604 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.877864+0000", 2024-09-13T06:41:02.604 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.2029999999999998e-06 2024-09-13T06:41:02.604 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:02.604 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:02.604 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:02.604 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.877873+0000", 2024-09-13T06:41:02.604 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.0440000000000001e-06 2024-09-13T06:41:02.604 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:02.604 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:02.604 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:02.605 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.979544+0000", 2024-09-13T06:41:02.605 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101671198 2024-09-13T06:41:02.605 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:02.605 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:02.605 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:02.605 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.979658+0000", 2024-09-13T06:41:02.605 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000114456 2024-09-13T06:41:02.605 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:02.605 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:02.605 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:02.605 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.979803+0000", 2024-09-13T06:41:02.605 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000144506 2024-09-13T06:41:02.605 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:02.606 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:02.606 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:02.606 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:02.606 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:02.606 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18807 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 6242304~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:41:02.606 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.879235+0000", 2024-09-13T06:41:02.606 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 70.656925005000005, 2024-09-13T06:41:02.606 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101781258, 2024-09-13T06:41:02.606 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:02.606 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:02.606 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:02.606 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:02.606 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:02.606 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18807 2024-09-13T06:41:02.607 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:02.607 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:02.607 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:02.607 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:02.607 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879235+0000", 2024-09-13T06:41:02.607 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:02.607 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:02.607 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:02.607 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:02.607 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879235+0000", 2024-09-13T06:41:02.607 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:02.607 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:02.607 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:02.607 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:02.608 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879235+0000", 2024-09-13T06:41:02.608 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:02.608 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:02.608 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:02.608 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:02.608 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879239+0000", 2024-09-13T06:41:02.608 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.963e-06 2024-09-13T06:41:02.608 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:02.608 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:02.608 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:02.609 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879247+0000", 2024-09-13T06:41:02.609 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6470000000000004e-06 2024-09-13T06:41:02.609 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:02.609 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:02.609 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:02.609 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879255+0000", 2024-09-13T06:41:02.609 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5429999999999996e-06 2024-09-13T06:41:02.609 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:02.609 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:02.609 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:02.609 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.980756+0000", 2024-09-13T06:41:02.609 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10150165999999999 2024-09-13T06:41:02.610 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:02.610 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:02.610 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:02.610 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.980868+0000", 2024-09-13T06:41:02.610 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000111196 2024-09-13T06:41:02.610 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:02.610 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:02.610 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:02.610 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.981017+0000", 2024-09-13T06:41:02.610 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000148846 2024-09-13T06:41:02.610 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:02.610 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:02.610 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:02.610 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:02.611 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:02.611 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18808 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 6270976~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:41:02.611 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.879261+0000", 2024-09-13T06:41:02.611 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 70.656898866000006, 2024-09-13T06:41:02.611 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.102057547, 2024-09-13T06:41:02.611 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:02.611 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:02.611 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:02.611 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:02.611 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:02.611 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18808 2024-09-13T06:41:02.611 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:02.612 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:02.612 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:02.612 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:02.612 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879261+0000", 2024-09-13T06:41:02.612 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:02.612 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:02.612 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:02.612 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:02.612 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879261+0000", 2024-09-13T06:41:02.612 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:02.612 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:02.612 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:02.612 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:02.612 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879261+0000", 2024-09-13T06:41:02.613 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:02.613 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:02.613 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:02.613 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:02.613 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879264+0000", 2024-09-13T06:41:02.613 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.523e-06 2024-09-13T06:41:02.613 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:02.613 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:02.613 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:02.613 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879273+0000", 2024-09-13T06:41:02.613 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6070000000000008e-06 2024-09-13T06:41:02.613 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:02.614 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:02.614 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:02.614 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879280+0000", 2024-09-13T06:41:02.614 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.4699999999999996e-06 2024-09-13T06:41:02.614 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:02.614 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:02.614 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:02.614 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.981060+0000", 2024-09-13T06:41:02.614 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10177934800000001 2024-09-13T06:41:02.614 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:02.614 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:02.614 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:02.614 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.981174+0000", 2024-09-13T06:41:02.614 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000114456 2024-09-13T06:41:02.615 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:02.615 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:02.615 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:02.615 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.981319+0000", 2024-09-13T06:41:02.615 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00014473900000000001 2024-09-13T06:41:02.615 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:02.615 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:02.615 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:02.615 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:02.615 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:02.615 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18810 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 2662400~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:41:02.615 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.880386+0000", 2024-09-13T06:41:02.615 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 70.655774703999995, 2024-09-13T06:41:02.615 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101728022, 2024-09-13T06:41:02.615 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:02.616 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:02.616 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:02.616 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:02.616 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:02.616 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18810 2024-09-13T06:41:02.616 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:02.616 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:02.616 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:02.616 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:02.616 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880386+0000", 2024-09-13T06:41:02.616 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:02.616 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:02.616 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:02.616 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:02.617 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880386+0000", 2024-09-13T06:41:02.617 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:02.617 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:02.617 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:02.617 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:02.617 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880385+0000", 2024-09-13T06:41:02.617 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:02.617 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:02.617 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:02.617 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:02.617 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880389+0000", 2024-09-13T06:41:02.617 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.8539999999999999e-06 2024-09-13T06:41:02.617 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:02.617 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:02.618 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:02.618 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880398+0000", 2024-09-13T06:41:02.618 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.1689999999999998e-06 2024-09-13T06:41:02.618 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:02.618 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:02.618 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:02.618 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880405+0000", 2024-09-13T06:41:02.618 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5700000000000004e-06 2024-09-13T06:41:02.618 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:02.618 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:02.618 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:02.618 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.981833+0000", 2024-09-13T06:41:02.618 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10142791800000001 2024-09-13T06:41:02.618 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:02.618 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:02.619 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:02.619 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.981973+0000", 2024-09-13T06:41:02.619 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00014002900000000001 2024-09-13T06:41:02.619 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:02.619 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:02.619 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:02.619 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.982114+0000", 2024-09-13T06:41:02.619 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000140276 2024-09-13T06:41:02.619 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:02.619 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:02.619 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:02.619 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:02.619 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:02.619 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18811 3.9 3.140f5209 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:41:02.620 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.880449+0000", 2024-09-13T06:41:02.620 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 70.655711327999995, 2024-09-13T06:41:02.620 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101739355, 2024-09-13T06:41:02.620 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:02.620 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:41:02.620 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:02.620 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:02.620 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:02.620 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18811 2024-09-13T06:41:02.620 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:02.620 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:02.620 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:02.620 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:02.621 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880449+0000", 2024-09-13T06:41:02.621 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:02.621 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:02.621 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:02.621 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:02.621 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880449+0000", 2024-09-13T06:41:02.621 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:02.621 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:02.621 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:02.621 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:02.621 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880448+0000", 2024-09-13T06:41:02.621 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:02.621 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:02.622 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:02.622 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:02.622 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880452+0000", 2024-09-13T06:41:02.622 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0470000000000004e-06 2024-09-13T06:41:02.622 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:02.622 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:02.622 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:02.622 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880462+0000", 2024-09-13T06:41:02.622 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6530000000000006e-06 2024-09-13T06:41:02.622 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:02.622 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:02.622 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:02.622 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880472+0000", 2024-09-13T06:41:02.622 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0027000000000001e-05 2024-09-13T06:41:02.623 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:02.623 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:02.623 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:02.623 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.982172+0000", 2024-09-13T06:41:02.623 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10170043500000001 2024-09-13T06:41:02.623 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:02.623 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:02.623 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:02.623 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.982188+0000", 2024-09-13T06:41:02.623 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6172999999999999e-05 2024-09-13T06:41:02.623 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:02.623 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:02.623 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:02.624 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:02.624 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:02.624 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18812 3.9 3.140f5209 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:41:02.624 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.880478+0000", 2024-09-13T06:41:02.624 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 70.655682091000003, 2024-09-13T06:41:02.624 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10177795100000001, 2024-09-13T06:41:02.624 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:02.624 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:41:02.624 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:02.624 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:02.624 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:02.624 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18812 2024-09-13T06:41:02.625 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:02.625 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:02.625 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:02.625 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:02.625 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880478+0000", 2024-09-13T06:41:02.625 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:02.625 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:02.625 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:02.625 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:02.625 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880478+0000", 2024-09-13T06:41:02.625 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:02.625 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:02.626 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:02.626 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:02.626 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880477+0000", 2024-09-13T06:41:02.626 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:02.626 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:02.626 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:02.626 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:02.626 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880481+0000", 2024-09-13T06:41:02.626 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.827e-06 2024-09-13T06:41:02.626 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:02.626 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:02.626 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:02.627 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880490+0000", 2024-09-13T06:41:02.627 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6100000000000006e-06 2024-09-13T06:41:02.627 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:02.627 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:02.627 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:02.627 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880497+0000", 2024-09-13T06:41:02.627 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.7030000000000006e-06 2024-09-13T06:41:02.627 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:02.627 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:02.627 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:02.627 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.982241+0000", 2024-09-13T06:41:02.627 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10174351199999999 2024-09-13T06:41:02.627 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:02.628 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:02.628 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:02.628 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.982256+0000", 2024-09-13T06:41:02.628 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5143000000000001e-05 2024-09-13T06:41:02.628 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:02.628 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:02.628 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:02.628 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:02.628 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:02.628 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:41:02.630 INFO:teuthology.orchestra.run.smithi081.stderr:noscrub is set 2024-09-13T06:41:02.631 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-13T06:41:02.631 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:41:02.631+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:41:02.731 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:41:02.731+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:41:02.758 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:41:02.758 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [], 2024-09-13T06:41:02.759 INFO:teuthology.orchestra.run.smithi139.stdout: "num_ops": 0 2024-09-13T06:41:02.759 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:41:02.773 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-13T06:41:02.779 INFO:teuthology.orchestra.run.smithi081.stdout:checking clone #16, image image_client.0-clone16 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent17 2024-09-13T06:41:02.831 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-13T06:41:02.832+0000 7f86a5f06640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26387) UID: 0 2024-09-13T06:41:02.901 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:41:02.901 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [], 2024-09-13T06:41:02.901 INFO:teuthology.orchestra.run.smithi139.stdout: "complaint_time": 30, 2024-09-13T06:41:02.901 INFO:teuthology.orchestra.run.smithi139.stdout: "num_blocked_ops": 0 2024-09-13T06:41:02.901 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:41:02.916 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-13T06:41:02.932 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:41:02.931+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:41:03.033 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:41:03.035+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:41:03.082 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:41:03.083 INFO:teuthology.orchestra.run.smithi139.stdout: "size": 20, 2024-09-13T06:41:03.083 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 600, 2024-09-13T06:41:03.083 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [ 2024-09-13T06:41:03.083 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.083 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43282 3.1d 3:bd80bfb3:::rbd_object_map.11212f44bfb1.0000000000000020:head [call rbd.object_map_update in=20b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:03.083 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589032+0000", 2024-09-13T06:41:03.083 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 41.493078500000003, 2024-09-13T06:41:03.083 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.076225263000000001, 2024-09-13T06:41:03.083 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:03.083 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:41:03.083 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:03.083 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:03.084 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:03.084 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43282 2024-09-13T06:41:03.084 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.084 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:03.084 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.084 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:03.084 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589032+0000", 2024-09-13T06:41:03.084 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:03.084 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.084 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.084 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:03.084 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589032+0000", 2024-09-13T06:41:03.084 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:03.085 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.085 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.085 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:03.085 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589031+0000", 2024-09-13T06:41:03.085 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:03.085 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.085 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.085 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:03.085 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589036+0000", 2024-09-13T06:41:03.085 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.2619999999999998e-06 2024-09-13T06:41:03.085 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.085 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.085 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:03.086 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589046+0000", 2024-09-13T06:41:03.086 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.8099999999999992e-06 2024-09-13T06:41:03.086 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.086 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.086 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:03.086 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589054+0000", 2024-09-13T06:41:03.086 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.2230000000000007e-06 2024-09-13T06:41:03.086 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.086 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.086 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:03.086 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.660691+0000", 2024-09-13T06:41:03.086 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.07163659 2024-09-13T06:41:03.086 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.086 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.087 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:03.087 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.660850+0000", 2024-09-13T06:41:03.087 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00015864300000000001 2024-09-13T06:41:03.087 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.087 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.087 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 4", 2024-09-13T06:41:03.087 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.661729+0000", 2024-09-13T06:41:03.087 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00087956099999999995 2024-09-13T06:41:03.087 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.087 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.087 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:41:03.087 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.664409+0000", 2024-09-13T06:41:03.087 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0026803479999999999 2024-09-13T06:41:03.087 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.088 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.088 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-13T06:41:03.088 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.665088+0000", 2024-09-13T06:41:03.088 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00067901400000000003 2024-09-13T06:41:03.088 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.088 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.088 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-13T06:41:03.088 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.665181+0000", 2024-09-13T06:41:03.088 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.2050000000000001e-05 2024-09-13T06:41:03.088 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.088 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.088 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:03.088 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.665257+0000", 2024-09-13T06:41:03.088 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.6698000000000003e-05 2024-09-13T06:41:03.089 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:03.089 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:03.089 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:03.089 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.089 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.089 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43288 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 270336~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:03.089 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589449+0000", 2024-09-13T06:41:03.089 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 41.492661247999997, 2024-09-13T06:41:03.089 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.074906773999999995, 2024-09-13T06:41:03.089 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:03.089 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:03.089 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:03.089 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:03.089 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:03.090 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43288 2024-09-13T06:41:03.090 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.090 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:03.090 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.090 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:03.090 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589449+0000", 2024-09-13T06:41:03.090 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:03.090 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.090 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.090 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:03.090 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589449+0000", 2024-09-13T06:41:03.090 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:03.090 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.091 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.091 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:03.091 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589449+0000", 2024-09-13T06:41:03.091 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:03.091 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.091 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.091 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:03.091 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589452+0000", 2024-09-13T06:41:03.091 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.5769999999999998e-06 2024-09-13T06:41:03.091 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.091 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.091 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:03.091 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589461+0000", 2024-09-13T06:41:03.092 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.5720000000000003e-06 2024-09-13T06:41:03.092 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.092 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.092 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:03.092 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589468+0000", 2024-09-13T06:41:03.092 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5859999999999999e-06 2024-09-13T06:41:03.092 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.092 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.092 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:03.092 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.663827+0000", 2024-09-13T06:41:03.092 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.074358704999999997 2024-09-13T06:41:03.092 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.092 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.092 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:03.093 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.664011+0000", 2024-09-13T06:41:03.093 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00018381699999999999 2024-09-13T06:41:03.093 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.093 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.093 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:03.093 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.664356+0000", 2024-09-13T06:41:03.093 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00034510999999999998 2024-09-13T06:41:03.093 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:03.093 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:03.093 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:03.093 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.093 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.093 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43289 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 284672~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:03.094 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589475+0000", 2024-09-13T06:41:03.094 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 41.492635849999999, 2024-09-13T06:41:03.094 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.075789117000000003, 2024-09-13T06:41:03.094 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:03.094 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:03.094 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:03.094 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:03.094 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:03.094 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43289 2024-09-13T06:41:03.094 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.094 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:03.094 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.094 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:03.094 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589475+0000", 2024-09-13T06:41:03.095 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:03.095 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.095 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.095 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:03.095 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589475+0000", 2024-09-13T06:41:03.095 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:03.095 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.095 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.095 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:03.095 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589474+0000", 2024-09-13T06:41:03.095 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:03.095 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.095 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.096 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:03.096 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589477+0000", 2024-09-13T06:41:03.096 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.7929999999999999e-06 2024-09-13T06:41:03.096 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.096 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.096 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:03.096 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589486+0000", 2024-09-13T06:41:03.096 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.4989999999999994e-06 2024-09-13T06:41:03.096 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.096 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.096 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:03.096 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589493+0000", 2024-09-13T06:41:03.097 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5329999999999997e-06 2024-09-13T06:41:03.097 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.097 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.097 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:03.097 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.664456+0000", 2024-09-13T06:41:03.097 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.074962794999999999 2024-09-13T06:41:03.097 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.097 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.097 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:03.098 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.664653+0000", 2024-09-13T06:41:03.098 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000197107 2024-09-13T06:41:03.098 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.098 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.098 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:03.098 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.665264+0000", 2024-09-13T06:41:03.098 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00061037600000000004 2024-09-13T06:41:03.098 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:03.098 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:03.098 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:03.098 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.098 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.098 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43290 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 299008~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:03.098 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589500+0000", 2024-09-13T06:41:03.099 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 41.492610337999999, 2024-09-13T06:41:03.099 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.075898564000000002, 2024-09-13T06:41:03.099 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:03.099 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:03.099 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:03.099 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:03.099 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:03.099 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43290 2024-09-13T06:41:03.099 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.099 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:03.099 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.099 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:03.099 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589500+0000", 2024-09-13T06:41:03.099 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:03.100 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.100 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.100 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:03.100 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589500+0000", 2024-09-13T06:41:03.100 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:03.100 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.100 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.100 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:03.100 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589499+0000", 2024-09-13T06:41:03.100 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:03.100 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.100 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.100 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:03.101 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589503+0000", 2024-09-13T06:41:03.101 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.8330000000000004e-06 2024-09-13T06:41:03.101 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.101 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.101 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:03.101 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589511+0000", 2024-09-13T06:41:03.101 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.3359999999999995e-06 2024-09-13T06:41:03.101 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.101 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.101 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:03.101 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589519+0000", 2024-09-13T06:41:03.101 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.4760000000000001e-06 2024-09-13T06:41:03.101 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.102 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.102 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:03.102 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.665097+0000", 2024-09-13T06:41:03.102 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.075577828999999999 2024-09-13T06:41:03.102 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.102 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.102 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:03.102 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.665170+0000", 2024-09-13T06:41:03.102 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.3745000000000006e-05 2024-09-13T06:41:03.102 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.102 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.102 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:03.102 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.665399+0000", 2024-09-13T06:41:03.103 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00022826199999999999 2024-09-13T06:41:03.103 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:03.103 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:03.103 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:03.103 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.103 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.103 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43291 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 313344~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:03.103 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589560+0000", 2024-09-13T06:41:03.103 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 41.492550117, 2024-09-13T06:41:03.103 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.076145594999999996, 2024-09-13T06:41:03.103 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:03.103 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:03.103 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:03.104 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:03.104 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:03.104 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43291 2024-09-13T06:41:03.104 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.104 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:03.104 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.104 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:03.104 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589560+0000", 2024-09-13T06:41:03.104 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:03.104 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.104 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.104 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:03.104 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589560+0000", 2024-09-13T06:41:03.104 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:03.105 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.105 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.105 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:03.105 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589559+0000", 2024-09-13T06:41:03.105 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:03.105 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.105 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.105 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:03.105 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589564+0000", 2024-09-13T06:41:03.105 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.3989999999999997e-06 2024-09-13T06:41:03.105 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.105 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.105 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:03.105 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589574+0000", 2024-09-13T06:41:03.106 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0502999999999999e-05 2024-09-13T06:41:03.106 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.106 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.106 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:03.106 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589582+0000", 2024-09-13T06:41:03.106 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.1859999999999992e-06 2024-09-13T06:41:03.106 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.106 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.106 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:03.106 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.665423+0000", 2024-09-13T06:41:03.106 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.075840290000000005 2024-09-13T06:41:03.106 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.106 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.106 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:03.106 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.665496+0000", 2024-09-13T06:41:03.107 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.2791000000000002e-05 2024-09-13T06:41:03.107 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.107 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.107 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:03.107 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.665706+0000", 2024-09-13T06:41:03.107 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00021038200000000001 2024-09-13T06:41:03.107 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:03.107 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:03.107 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:03.107 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.107 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.107 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43292 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 327680~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:03.107 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589589+0000", 2024-09-13T06:41:03.107 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 41.492521576000001, 2024-09-13T06:41:03.108 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.076769537999999998, 2024-09-13T06:41:03.108 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:03.108 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:03.108 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:03.108 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:03.108 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:03.108 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43292 2024-09-13T06:41:03.108 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.108 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:03.108 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.108 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:03.108 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589589+0000", 2024-09-13T06:41:03.108 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:03.108 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.109 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.109 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:03.109 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589589+0000", 2024-09-13T06:41:03.109 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:03.109 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.109 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.109 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:03.109 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589588+0000", 2024-09-13T06:41:03.109 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:03.109 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.109 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.109 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:03.109 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589592+0000", 2024-09-13T06:41:03.109 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.6389999999999998e-06 2024-09-13T06:41:03.109 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.110 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.110 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:03.110 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589600+0000", 2024-09-13T06:41:03.110 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.4630000000000001e-06 2024-09-13T06:41:03.110 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.110 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.110 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:03.110 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589608+0000", 2024-09-13T06:41:03.110 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.2359999999999998e-06 2024-09-13T06:41:03.110 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.110 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.110 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:03.110 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.665779+0000", 2024-09-13T06:41:03.111 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.076170924000000001 2024-09-13T06:41:03.111 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.111 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.111 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:03.111 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.665977+0000", 2024-09-13T06:41:03.111 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00019891900000000001 2024-09-13T06:41:03.111 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.111 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.111 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:03.111 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.666358+0000", 2024-09-13T06:41:03.111 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000380963 2024-09-13T06:41:03.111 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:03.111 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:03.111 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:03.112 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.112 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.112 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43293 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 342016~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:03.112 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589616+0000", 2024-09-13T06:41:03.112 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 41.492494682, 2024-09-13T06:41:03.112 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.077030083999999999, 2024-09-13T06:41:03.112 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:03.112 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:03.112 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:03.112 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:03.112 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:03.112 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43293 2024-09-13T06:41:03.112 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.113 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:03.113 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.113 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:03.113 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589616+0000", 2024-09-13T06:41:03.113 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:03.113 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.113 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.113 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:03.113 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589616+0000", 2024-09-13T06:41:03.113 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:03.113 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.114 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.114 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:03.114 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589615+0000", 2024-09-13T06:41:03.114 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:03.114 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.114 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.114 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:03.114 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589619+0000", 2024-09-13T06:41:03.114 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.9559999999999999e-06 2024-09-13T06:41:03.114 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.114 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.115 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:03.115 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589627+0000", 2024-09-13T06:41:03.115 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.2490000000000001e-06 2024-09-13T06:41:03.115 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.115 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.115 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:03.115 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589635+0000", 2024-09-13T06:41:03.115 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.96e-06 2024-09-13T06:41:03.115 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.115 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.115 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:03.115 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.666379+0000", 2024-09-13T06:41:03.115 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.076744484000000002 2024-09-13T06:41:03.115 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.115 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.116 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:03.116 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.666454+0000", 2024-09-13T06:41:03.116 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.4623999999999996e-05 2024-09-13T06:41:03.116 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.116 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.116 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:03.116 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.666646+0000", 2024-09-13T06:41:03.116 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00019176999999999999 2024-09-13T06:41:03.116 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:03.116 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:03.116 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:03.116 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.116 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.116 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43294 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 356352~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:03.117 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589681+0000", 2024-09-13T06:41:03.117 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 41.492429367, 2024-09-13T06:41:03.117 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.077594648000000002, 2024-09-13T06:41:03.117 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:03.117 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:03.117 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:03.117 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:03.117 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:03.117 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43294 2024-09-13T06:41:03.117 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.117 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:03.117 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.117 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:03.118 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589681+0000", 2024-09-13T06:41:03.118 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:03.118 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.118 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.118 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:03.118 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589681+0000", 2024-09-13T06:41:03.118 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:03.118 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.118 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.118 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:03.118 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589680+0000", 2024-09-13T06:41:03.118 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:03.118 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.118 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.118 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:03.119 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589684+0000", 2024-09-13T06:41:03.119 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.8369999999999999e-06 2024-09-13T06:41:03.119 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.119 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.119 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:03.119 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589693+0000", 2024-09-13T06:41:03.119 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.1020000000000003e-06 2024-09-13T06:41:03.119 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.119 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.119 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:03.119 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589701+0000", 2024-09-13T06:41:03.119 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.8059999999999995e-06 2024-09-13T06:41:03.120 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.120 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.120 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:03.120 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.666714+0000", 2024-09-13T06:41:03.120 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.077013463000000004 2024-09-13T06:41:03.120 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.120 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.120 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:03.120 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.666897+0000", 2024-09-13T06:41:03.120 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000182268 2024-09-13T06:41:03.120 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.120 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.120 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:03.121 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.667276+0000", 2024-09-13T06:41:03.121 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00037907499999999998 2024-09-13T06:41:03.121 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:03.121 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:03.121 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:03.121 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.121 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.121 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43295 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 370688~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:03.121 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589744+0000", 2024-09-13T06:41:03.121 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 41.492366195000002, 2024-09-13T06:41:03.121 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.077854343000000006, 2024-09-13T06:41:03.121 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:03.121 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:03.121 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:03.122 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:03.122 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:03.122 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43295 2024-09-13T06:41:03.122 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.122 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:03.122 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.122 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:03.122 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589744+0000", 2024-09-13T06:41:03.122 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:03.122 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.122 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.122 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:03.122 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589744+0000", 2024-09-13T06:41:03.123 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:03.123 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.123 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.123 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:03.123 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589743+0000", 2024-09-13T06:41:03.123 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:03.123 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.123 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.123 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:03.123 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589747+0000", 2024-09-13T06:41:03.123 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0130000000000004e-06 2024-09-13T06:41:03.123 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.123 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.123 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:03.124 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589756+0000", 2024-09-13T06:41:03.124 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.003e-06 2024-09-13T06:41:03.124 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.124 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.124 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:03.124 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589766+0000", 2024-09-13T06:41:03.124 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.2820000000000002e-06 2024-09-13T06:41:03.124 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.124 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.124 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:03.124 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.667300+0000", 2024-09-13T06:41:03.124 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.077534299000000001 2024-09-13T06:41:03.124 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.125 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.125 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:03.125 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.667372+0000", 2024-09-13T06:41:03.125 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.2393999999999998e-05 2024-09-13T06:41:03.125 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.125 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.125 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:03.125 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.667599+0000", 2024-09-13T06:41:03.125 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000226269 2024-09-13T06:41:03.125 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:03.125 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:03.125 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:03.125 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.125 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.126 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43296 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 385024~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:03.126 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589772+0000", 2024-09-13T06:41:03.126 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 41.492338171, 2024-09-13T06:41:03.126 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.078469647000000003, 2024-09-13T06:41:03.126 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:03.126 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:03.126 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:03.126 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:03.126 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:03.126 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43296 2024-09-13T06:41:03.126 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.126 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:03.126 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.126 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:03.127 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589772+0000", 2024-09-13T06:41:03.127 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:03.127 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.127 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.127 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:03.127 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589772+0000", 2024-09-13T06:41:03.127 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:03.127 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.127 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.127 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:03.127 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589771+0000", 2024-09-13T06:41:03.127 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:03.127 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.127 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.128 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:03.128 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589775+0000", 2024-09-13T06:41:03.128 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.8530000000000002e-06 2024-09-13T06:41:03.128 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.128 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.128 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:03.128 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589784+0000", 2024-09-13T06:41:03.128 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.4300000000000006e-06 2024-09-13T06:41:03.128 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.128 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.128 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:03.128 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589791+0000", 2024-09-13T06:41:03.128 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.4660000000000002e-06 2024-09-13T06:41:03.128 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.129 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.129 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:03.129 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.667667+0000", 2024-09-13T06:41:03.129 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.077875697999999993 2024-09-13T06:41:03.129 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.129 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.129 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:03.129 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.667854+0000", 2024-09-13T06:41:03.129 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00018760099999999999 2024-09-13T06:41:03.129 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.129 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.129 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:03.129 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.668242+0000", 2024-09-13T06:41:03.130 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00038750600000000003 2024-09-13T06:41:03.130 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:03.130 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:03.130 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:03.130 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.130 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.130 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43297 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 403456~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:03.130 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589797+0000", 2024-09-13T06:41:03.130 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 41.492313467000002, 2024-09-13T06:41:03.130 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.078756672999999999, 2024-09-13T06:41:03.130 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:03.130 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:03.130 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:03.130 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:03.130 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:03.131 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43297 2024-09-13T06:41:03.131 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.131 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:03.131 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.131 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:03.131 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589797+0000", 2024-09-13T06:41:03.131 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:03.131 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.131 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.131 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:03.131 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589797+0000", 2024-09-13T06:41:03.131 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:03.131 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.131 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.132 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:03.132 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589796+0000", 2024-09-13T06:41:03.132 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:03.132 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.132 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.132 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:03.132 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589800+0000", 2024-09-13T06:41:03.132 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.3230000000000002e-06 2024-09-13T06:41:03.132 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.132 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.132 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:03.132 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589808+0000", 2024-09-13T06:41:03.132 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.2390000000000002e-06 2024-09-13T06:41:03.133 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.133 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.133 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:03.133 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589815+0000", 2024-09-13T06:41:03.133 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.413e-06 2024-09-13T06:41:03.133 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.133 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.133 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:03.133 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.668265+0000", 2024-09-13T06:41:03.133 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.078449873000000003 2024-09-13T06:41:03.133 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.133 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.133 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:03.134 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.668332+0000", 2024-09-13T06:41:03.134 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.7178e-05 2024-09-13T06:41:03.134 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.134 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.134 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:03.134 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.668554+0000", 2024-09-13T06:41:03.134 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00022128600000000001 2024-09-13T06:41:03.134 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:03.134 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:03.134 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:03.134 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.134 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.134 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43298 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 417792~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:03.135 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589821+0000", 2024-09-13T06:41:03.135 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 41.492289345000003, 2024-09-13T06:41:03.135 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.079368660999999993, 2024-09-13T06:41:03.135 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:03.135 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:03.135 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:03.135 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:03.135 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:03.135 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43298 2024-09-13T06:41:03.135 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.135 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:03.135 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.135 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:03.135 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589821+0000", 2024-09-13T06:41:03.135 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:03.135 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.136 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.136 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:03.136 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589821+0000", 2024-09-13T06:41:03.136 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:03.136 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.136 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.136 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:03.136 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589821+0000", 2024-09-13T06:41:03.136 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:03.136 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.136 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.136 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:03.136 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589830+0000", 2024-09-13T06:41:03.136 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.4860000000000003e-06 2024-09-13T06:41:03.137 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.137 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.137 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:03.137 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589839+0000", 2024-09-13T06:41:03.137 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.0159999999999997e-06 2024-09-13T06:41:03.137 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.137 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.137 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:03.137 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589847+0000", 2024-09-13T06:41:03.137 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.6059999999999997e-06 2024-09-13T06:41:03.137 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.137 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.137 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:03.138 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.668620+0000", 2024-09-13T06:41:03.138 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.078773485000000004 2024-09-13T06:41:03.138 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.138 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.138 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:03.138 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.668798+0000", 2024-09-13T06:41:03.138 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000178233 2024-09-13T06:41:03.138 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.138 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.138 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:03.138 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.669190+0000", 2024-09-13T06:41:03.138 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00039143499999999998 2024-09-13T06:41:03.138 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:03.138 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:03.139 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:03.139 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.139 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.139 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43299 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 432128~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:03.139 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589881+0000", 2024-09-13T06:41:03.139 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 41.492229496999997, 2024-09-13T06:41:03.139 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.079693849999999997, 2024-09-13T06:41:03.139 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:03.139 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:03.139 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:03.139 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:03.139 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:03.139 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43299 2024-09-13T06:41:03.140 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.140 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:03.140 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.140 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:03.140 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589881+0000", 2024-09-13T06:41:03.140 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:03.140 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.140 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.140 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:03.140 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589881+0000", 2024-09-13T06:41:03.140 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:03.140 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.140 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.140 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:03.141 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589880+0000", 2024-09-13T06:41:03.141 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:03.141 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.141 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.141 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:03.141 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589884+0000", 2024-09-13T06:41:03.141 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.053e-06 2024-09-13T06:41:03.141 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.141 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.141 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:03.141 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589893+0000", 2024-09-13T06:41:03.141 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.2129999999999997e-06 2024-09-13T06:41:03.141 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.141 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.142 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:03.142 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589901+0000", 2024-09-13T06:41:03.142 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.6399999999999997e-06 2024-09-13T06:41:03.142 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.142 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.142 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:03.142 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.669213+0000", 2024-09-13T06:41:03.142 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.079312074999999996 2024-09-13T06:41:03.142 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.142 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.142 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:03.142 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.669281+0000", 2024-09-13T06:41:03.142 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.8322000000000001e-05 2024-09-13T06:41:03.142 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.142 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.143 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:03.143 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.669575+0000", 2024-09-13T06:41:03.143 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00029349699999999999 2024-09-13T06:41:03.143 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:03.143 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:03.143 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:03.143 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.143 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.143 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43300 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 446464~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:03.143 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589909+0000", 2024-09-13T06:41:03.143 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 41.492201602000002, 2024-09-13T06:41:03.143 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.080339496999999996, 2024-09-13T06:41:03.143 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:03.143 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:03.143 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:03.144 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:03.144 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:03.144 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43300 2024-09-13T06:41:03.144 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.144 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:03.144 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.144 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:03.144 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589909+0000", 2024-09-13T06:41:03.144 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:03.144 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.144 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.144 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:03.144 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589909+0000", 2024-09-13T06:41:03.144 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:03.144 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.145 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.145 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:03.145 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589908+0000", 2024-09-13T06:41:03.145 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:03.145 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.145 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.145 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:03.145 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589912+0000", 2024-09-13T06:41:03.145 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.9430000000000002e-06 2024-09-13T06:41:03.145 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.145 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.145 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:03.145 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589920+0000", 2024-09-13T06:41:03.145 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.3860000000000007e-06 2024-09-13T06:41:03.146 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.146 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.146 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:03.146 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589928+0000", 2024-09-13T06:41:03.146 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.3329999999999999e-06 2024-09-13T06:41:03.146 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.146 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.146 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:03.146 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.669651+0000", 2024-09-13T06:41:03.146 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.079723204000000006 2024-09-13T06:41:03.146 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.146 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.146 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:03.147 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.669840+0000", 2024-09-13T06:41:03.147 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000189397 2024-09-13T06:41:03.147 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.147 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.147 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:03.147 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.670248+0000", 2024-09-13T06:41:03.147 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00040811100000000001 2024-09-13T06:41:03.147 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:03.147 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:03.147 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:03.147 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.147 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.147 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43301 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 460800~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:03.147 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589934+0000", 2024-09-13T06:41:03.147 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 41.492176927999999, 2024-09-13T06:41:03.148 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.080747474999999999, 2024-09-13T06:41:03.148 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:03.148 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:03.148 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:03.148 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:03.148 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:03.148 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43301 2024-09-13T06:41:03.148 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.148 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:03.148 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.148 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:03.148 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589934+0000", 2024-09-13T06:41:03.149 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:03.149 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.149 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.149 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:03.149 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589934+0000", 2024-09-13T06:41:03.149 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:03.149 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.149 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.149 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:03.149 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589933+0000", 2024-09-13T06:41:03.149 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:03.149 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.149 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.149 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:03.149 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589936+0000", 2024-09-13T06:41:03.150 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.4599999999999999e-06 2024-09-13T06:41:03.150 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.150 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.150 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:03.150 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589945+0000", 2024-09-13T06:41:03.150 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.2430000000000005e-06 2024-09-13T06:41:03.150 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.150 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.150 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:03.150 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589952+0000", 2024-09-13T06:41:03.150 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.3289999999999996e-06 2024-09-13T06:41:03.150 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.150 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.150 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:03.150 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.670280+0000", 2024-09-13T06:41:03.151 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.080328514000000004 2024-09-13T06:41:03.151 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.151 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.151 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:03.151 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.670376+0000", 2024-09-13T06:41:03.151 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.5752000000000001e-05 2024-09-13T06:41:03.151 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.151 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.151 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:03.151 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.670681+0000", 2024-09-13T06:41:03.151 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00030479699999999999 2024-09-13T06:41:03.151 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:03.151 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:03.151 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:03.152 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.152 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.152 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43302 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 475136~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:03.152 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589958+0000", 2024-09-13T06:41:03.152 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 41.492152865999998, 2024-09-13T06:41:03.152 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.081402394000000003, 2024-09-13T06:41:03.152 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:03.152 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:03.152 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:03.152 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:03.152 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:03.152 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43302 2024-09-13T06:41:03.152 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.153 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:03.153 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.153 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:03.153 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589958+0000", 2024-09-13T06:41:03.153 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:03.153 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.153 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.153 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:03.153 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589958+0000", 2024-09-13T06:41:03.153 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:03.153 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.153 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.153 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:03.153 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589957+0000", 2024-09-13T06:41:03.154 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:03.154 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.154 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.154 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:03.154 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589960+0000", 2024-09-13T06:41:03.154 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.4939999999999999e-06 2024-09-13T06:41:03.154 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.154 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.154 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:03.154 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589969+0000", 2024-09-13T06:41:03.154 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.3520000000000007e-06 2024-09-13T06:41:03.154 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.154 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.154 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:03.154 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589976+0000", 2024-09-13T06:41:03.155 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.3030000000000002e-06 2024-09-13T06:41:03.155 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.155 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.155 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:03.155 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.670765+0000", 2024-09-13T06:41:03.155 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.080789154000000002 2024-09-13T06:41:03.155 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.155 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.155 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:03.155 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.670960+0000", 2024-09-13T06:41:03.155 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00019464300000000001 2024-09-13T06:41:03.155 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.155 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.155 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:03.156 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.671360+0000", 2024-09-13T06:41:03.156 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00040005200000000002 2024-09-13T06:41:03.156 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:03.156 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:03.156 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:03.156 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.156 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.156 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43303 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 489472~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:03.156 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589985+0000", 2024-09-13T06:41:03.156 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 41.492125917999999, 2024-09-13T06:41:03.156 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.082024333000000005, 2024-09-13T06:41:03.156 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:03.156 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:03.157 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:03.157 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:03.157 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:03.157 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43303 2024-09-13T06:41:03.157 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.157 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:03.157 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.157 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:03.157 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589985+0000", 2024-09-13T06:41:03.157 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:03.157 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.157 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.157 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:03.157 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589985+0000", 2024-09-13T06:41:03.158 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:03.158 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.158 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.158 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:03.158 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589984+0000", 2024-09-13T06:41:03.158 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:03.158 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.158 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.158 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:03.158 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589987+0000", 2024-09-13T06:41:03.158 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.726e-06 2024-09-13T06:41:03.158 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.158 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.158 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:03.158 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589996+0000", 2024-09-13T06:41:03.159 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.5459999999999992e-06 2024-09-13T06:41:03.159 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.159 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.159 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:03.159 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590003+0000", 2024-09-13T06:41:03.159 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.4229999999999999e-06 2024-09-13T06:41:03.159 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.159 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.159 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:03.159 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.671426+0000", 2024-09-13T06:41:03.159 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.081422704999999998 2024-09-13T06:41:03.159 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.159 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.159 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:03.159 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.671615+0000", 2024-09-13T06:41:03.160 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000188875 2024-09-13T06:41:03.160 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.160 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.160 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:03.160 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.672009+0000", 2024-09-13T06:41:03.160 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000394015 2024-09-13T06:41:03.160 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:03.160 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:03.160 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:03.160 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.160 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.160 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43304 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 503808~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:03.160 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.590039+0000", 2024-09-13T06:41:03.160 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 41.492071373000002, 2024-09-13T06:41:03.161 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.082573880000000002, 2024-09-13T06:41:03.161 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:03.161 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:03.161 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:03.161 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:03.161 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:03.161 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43304 2024-09-13T06:41:03.161 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.161 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:03.161 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.161 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:03.161 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590039+0000", 2024-09-13T06:41:03.161 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:03.161 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.161 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.162 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:03.162 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590039+0000", 2024-09-13T06:41:03.162 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:03.162 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.162 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.162 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:03.162 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590038+0000", 2024-09-13T06:41:03.162 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:03.162 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.162 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.162 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:03.162 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590042+0000", 2024-09-13T06:41:03.162 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.9500000000000003e-06 2024-09-13T06:41:03.162 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.162 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.163 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:03.163 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590052+0000", 2024-09-13T06:41:03.163 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.3919999999999992e-06 2024-09-13T06:41:03.163 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.163 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.163 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:03.163 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590059+0000", 2024-09-13T06:41:03.163 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.7970000000000001e-06 2024-09-13T06:41:03.163 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.163 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.163 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:03.163 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.672078+0000", 2024-09-13T06:41:03.163 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.082018778000000001 2024-09-13T06:41:03.163 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.163 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.164 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:03.164 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.672266+0000", 2024-09-13T06:41:03.164 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00018807399999999999 2024-09-13T06:41:03.164 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.164 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.164 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:03.164 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.672613+0000", 2024-09-13T06:41:03.164 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00034677599999999997 2024-09-13T06:41:03.164 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:03.164 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:03.164 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:03.164 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.164 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.164 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43305 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 518144~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:03.165 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.590136+0000", 2024-09-13T06:41:03.165 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 41.491974184999997, 2024-09-13T06:41:03.165 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.082988206999999994, 2024-09-13T06:41:03.165 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:03.165 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:03.165 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:03.165 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:03.165 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:03.165 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43305 2024-09-13T06:41:03.165 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.165 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:03.165 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.165 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:03.165 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590136+0000", 2024-09-13T06:41:03.165 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:03.166 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.166 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.166 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:03.166 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590136+0000", 2024-09-13T06:41:03.166 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:03.166 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.166 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.166 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:03.166 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590135+0000", 2024-09-13T06:41:03.166 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:03.166 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.166 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.166 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:03.166 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590139+0000", 2024-09-13T06:41:03.167 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.9489999999999998e-06 2024-09-13T06:41:03.167 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.167 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.167 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:03.167 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590148+0000", 2024-09-13T06:41:03.167 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.9830000000000002e-06 2024-09-13T06:41:03.167 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.167 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.167 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:03.167 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590156+0000", 2024-09-13T06:41:03.167 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5229999999999998e-06 2024-09-13T06:41:03.167 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.167 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.167 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:03.167 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.672709+0000", 2024-09-13T06:41:03.168 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.082552886000000006 2024-09-13T06:41:03.168 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.168 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.168 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:03.168 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.672816+0000", 2024-09-13T06:41:03.168 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000107736 2024-09-13T06:41:03.168 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.168 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.168 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:03.168 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.673124+0000", 2024-09-13T06:41:03.168 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00030804900000000002 2024-09-13T06:41:03.168 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:03.168 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:03.168 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:03.168 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.169 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.169 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:66818 3.17 3.50afe697 (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e100)", 2024-09-13T06:41:03.169 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:53.498942+0000", 2024-09-13T06:41:03.169 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 9.5831680000000006, 2024-09-13T06:41:03.169 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.011231284, 2024-09-13T06:41:03.169 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:03.169 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:41:03.169 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:03.169 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:03.169 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:03.169 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 66818 2024-09-13T06:41:03.169 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.169 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:03.169 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.170 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:03.170 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:53.498942+0000", 2024-09-13T06:41:03.170 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:03.170 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.170 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.170 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:03.170 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:53.498942+0000", 2024-09-13T06:41:03.170 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:03.170 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.170 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.170 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:03.170 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:53.498939+0000", 2024-09-13T06:41:03.170 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999967 2024-09-13T06:41:03.170 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.170 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.171 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:03.171 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:53.498954+0000", 2024-09-13T06:41:03.171 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5028000000000001e-05 2024-09-13T06:41:03.171 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.171 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.171 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:03.171 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:53.498986+0000", 2024-09-13T06:41:03.171 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.1993999999999999e-05 2024-09-13T06:41:03.171 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.171 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.171 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:03.171 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:53.499001+0000", 2024-09-13T06:41:03.171 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5166e-05 2024-09-13T06:41:03.171 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.171 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.172 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:03.172 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:53.505097+0000", 2024-09-13T06:41:03.172 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0060955610000000002 2024-09-13T06:41:03.172 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.172 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.172 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:41:03.172 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:53.505108+0000", 2024-09-13T06:41:03.172 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.084e-05 2024-09-13T06:41:03.172 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.172 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.172 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:03.172 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:54.510158+0000", 2024-09-13T06:41:03.172 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0050497549999999 2024-09-13T06:41:03.172 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.173 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.173 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:03.173 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:54.510174+0000", 2024-09-13T06:41:03.173 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6164e-05 2024-09-13T06:41:03.173 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:03.173 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:03.173 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:03.173 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:03.173 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:03.173 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:41:03.175 INFO:teuthology.orchestra.run.smithi081.stdout:2648 read 0x8e8f06a thru 0x8e9e61c (0xf5b3 bytes) 2024-09-13T06:41:03.175 INFO:teuthology.orchestra.run.smithi081.stdout:2649 write 0xc553822 thru 0xc554106 (0x8e5 bytes) 2024-09-13T06:41:03.175 INFO:teuthology.orchestra.run.smithi081.stdout:2650 writesame 0x43c8c97 thru 0x43d275e data_size 0x4e(0x9ac8 bytes) 2024-09-13T06:41:03.175 INFO:teuthology.orchestra.run.smithi081.stdout:2652 writesame 0x802bbdb thru 0x80378bb data_size 0x1(0xbce1 bytes) 2024-09-13T06:41:03.175 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-13T06:41:03.176 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-13T06:41:03.176+0000 7f86a5f06640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26387) UID: 0 2024-09-13T06:41:03.185 INFO:teuthology.orchestra.run.smithi081.stdout:2653 writesame 0xdc1290b thru 0xdc1fbd3 data_size 0x1(0xd2c9 bytes) 2024-09-13T06:41:03.185 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:41:03.186 INFO:teuthology.orchestra.run.smithi081.stdout:2655 writesame 0x5e4884b thru 0x5e56c32 data_size 0x16(0xe3e8 bytes) 2024-09-13T06:41:03.191 INFO:teuthology.orchestra.run.smithi081.stdout:2657 read 0x51104a0 thru 0x5110f97 (0xaf8 bytes) 2024-09-13T06:41:03.192 INFO:teuthology.orchestra.run.smithi081.stdout:2658 write 0x20d8099 thru 0x20e6c54 (0xebbc bytes) 2024-09-13T06:41:03.195 INFO:teuthology.orchestra.run.smithi081.stdout:2659 write 0x134b137 thru 0x134f2f9 (0x41c3 bytes) 2024-09-13T06:41:03.198 INFO:teuthology.orchestra.run.smithi081.stdout:2660 write 0x6374608 thru 0x63835ab (0xefa4 bytes) 2024-09-13T06:41:03.214 INFO:teuthology.orchestra.run.smithi081.stdout:2662 write 0xedc9277 thru 0xedce11f (0x4ea9 bytes) 2024-09-13T06:41:03.217 INFO:teuthology.orchestra.run.smithi081.stdout:2663 write 0x55398a0 thru 0x55448f0 (0xb051 bytes) 2024-09-13T06:41:03.221 INFO:teuthology.orchestra.run.smithi081.stdout:2664 read 0x7acd65d thru 0x7acf9be (0x2362 bytes) 2024-09-13T06:41:03.221 INFO:teuthology.orchestra.run.smithi081.stdout:2665 read 0x803b7a2 thru 0x803e9d2 (0x3231 bytes) 2024-09-13T06:41:03.222 INFO:teuthology.orchestra.run.smithi081.stdout:2666 read 0xe891bf5 thru 0xe8955c9 (0x39d5 bytes) 2024-09-13T06:41:03.223 INFO:teuthology.orchestra.run.smithi081.stdout:2667 read 0x24d57b3 thru 0x24d6b12 (0x1360 bytes) 2024-09-13T06:41:03.224 INFO:teuthology.orchestra.run.smithi081.stdout:2668 write 0xb473522 thru 0xb4777fb (0x42da bytes) 2024-09-13T06:41:03.231 INFO:teuthology.orchestra.run.smithi081.stdout:2669 write 0x1372dc1 thru 0x1382aeb (0xfd2b bytes) 2024-09-13T06:41:03.261 INFO:teuthology.orchestra.run.smithi081.stdout:2670 trunc from 0xedce120 to 0x41bf89c 2024-09-13T06:41:03.275 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-13T06:41:03.276+0000 7f86a5f06640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26387) UID: 0 2024-09-13T06:41:03.295 INFO:teuthology.orchestra.run.smithi081.stdout:2671 trunc from 0x41bf89c to 0x17bcff0 2024-09-13T06:41:03.321 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:41:03.322 INFO:teuthology.orchestra.run.smithi081.stdout:2673 read 0x10e461c thru 0x10e5c77 (0x165c bytes) 2024-09-13T06:41:03.351 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:41:03.351 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [], 2024-09-13T06:41:03.351 INFO:teuthology.orchestra.run.smithi139.stdout: "num_ops": 0 2024-09-13T06:41:03.351 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:41:03.360 INFO:teuthology.orchestra.run.smithi081.stdout:2674 write 0xb74c24f thru 0xb75a268 (0xe01a bytes) 2024-09-13T06:41:03.365 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-13T06:41:03.385 INFO:teuthology.orchestra.run.smithi081.stdout:2676 writesame 0xe7d4f1d thru 0xe7da454 data_size 0x36(0x5538 bytes) 2024-09-13T06:41:03.385 INFO:teuthology.orchestra.run.smithi081.stdout:2677 read 0x34c9e thru 0x3b6fc (0x6a5f bytes) 2024-09-13T06:41:03.386 INFO:teuthology.orchestra.run.smithi081.stdout:2678 writesame 0xc552e75 thru 0xc55e6f4 data_size 0x90(0xb880 bytes) 2024-09-13T06:41:03.394 INFO:teuthology.orchestra.run.smithi081.stdout:2679 write 0x4a3d0be thru 0x4a44fc1 (0x7f04 bytes) 2024-09-13T06:41:03.400 INFO:teuthology.orchestra.run.smithi081.stdout:2680 write 0x195979e thru 0x1967ff7 (0xe85a bytes) 2024-09-13T06:41:03.407 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:41:03.408+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:41:03.414 INFO:teuthology.orchestra.run.smithi081.stdout:2682 trunc from 0xe7da455 to 0xaa14a47 2024-09-13T06:41:03.439 INFO:teuthology.orchestra.run.smithi081.stdout:2683 write 0x2e27800 thru 0x2e2fabe (0x82bf bytes) 2024-09-13T06:41:03.442 INFO:teuthology.orchestra.run.smithi081.stdout:2684 read 0x98b369a thru 0x98bfcbe (0xc625 bytes) 2024-09-13T06:41:03.450 INFO:teuthology.orchestra.run.smithi081.stdout:2685 trunc from 0xaa14a47 to 0xd27dedf 2024-09-13T06:41:03.464 INFO:teuthology.orchestra.run.smithi081.stdout:2686 read 0x1cb2fc9 thru 0x1cba867 (0x789f bytes) 2024-09-13T06:41:03.465 INFO:teuthology.orchestra.run.smithi081.stdout:2687 read 0xb7dcba0 thru 0xb7e534c (0x87ad bytes) 2024-09-13T06:41:03.467 INFO:teuthology.orchestra.run.smithi081.stdout:2688 trunc from 0xd27dedf to 0xc857c08 2024-09-13T06:41:03.477 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:41:03.475+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:41:03.481 INFO:teuthology.orchestra.run.smithi081.stdout:2689 write 0x65538e8 thru 0x655cc69 (0x9382 bytes) 2024-09-13T06:41:03.484 INFO:teuthology.orchestra.run.smithi081.stdout:2690 read 0x2e64a11 thru 0x2e74898 (0xfe88 bytes) 2024-09-13T06:41:03.485 INFO:teuthology.orchestra.run.smithi081.stdout:2691 read 0x75e0f6b thru 0x75ebb5c (0xabf2 bytes) 2024-09-13T06:41:03.485 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:41:03.485 INFO:teuthology.orchestra.run.smithi081.stdout:2694 read 0x7e5f412 thru 0x7e67061 (0x7c50 bytes) 2024-09-13T06:41:03.485 INFO:teuthology.orchestra.run.smithi081.stdout:2695 read 0x7125a8f thru 0x71313f3 (0xb965 bytes) 2024-09-13T06:41:03.486 INFO:teuthology.orchestra.run.smithi081.stdout:2696 write 0xe2c655 thru 0xe3642c (0x9dd8 bytes) 2024-09-13T06:41:03.495 INFO:teuthology.orchestra.run.smithi081.stdout:2697 trunc from 0xc857c08 to 0xeb5fdb3 2024-09-13T06:41:03.509 INFO:teuthology.orchestra.run.smithi081.stdout:2698 punch from 0x8086367 to 0x808bf08, (0x5ba1 bytes) 2024-09-13T06:41:03.509 INFO:teuthology.orchestra.run.smithi081.stdout:2700 writesame 0x7c5412d thru 0x7c5a69b data_size 0x1(0x656f bytes) 2024-09-13T06:41:03.535 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:41:03.535 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [], 2024-09-13T06:41:03.535 INFO:teuthology.orchestra.run.smithi139.stdout: "complaint_time": 30, 2024-09-13T06:41:03.535 INFO:teuthology.orchestra.run.smithi139.stdout: "num_blocked_ops": 0 2024-09-13T06:41:03.535 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:41:03.543 INFO:teuthology.orchestra.run.smithi081.stdout:2702 writesame 0x46c0fea thru 0x46cbc3b data_size 0x89(0xac52 bytes) 2024-09-13T06:41:03.547 INFO:teuthology.orchestra.run.smithi081.stdout:2703 writesame 0xbc59cb7 thru 0xbc65468 data_size 0x7(0xb7b2 bytes) 2024-09-13T06:41:03.550 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-13T06:41:03.558 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:41:03.558 INFO:teuthology.orchestra.run.smithi081.stdout:2705 read 0x6450a47 thru 0x645350d (0x2ac7 bytes) 2024-09-13T06:41:03.572 INFO:teuthology.orchestra.run.smithi081.stdout:2706 trunc from 0xeb5fdb3 to 0x9d5fc65 2024-09-13T06:41:03.578 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:41:03.579+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:41:03.614 INFO:teuthology.orchestra.run.smithi081.stdout:2707 write 0xd476419 thru 0xd47852f (0x2117 bytes) 2024-09-13T06:41:03.620 INFO:teuthology.orchestra.run.smithi081.stdout:2708 writesame 0x6c86265 thru 0x6c92d08 data_size 0x16(0xcaa4 bytes) 2024-09-13T06:41:03.626 INFO:teuthology.orchestra.run.smithi081.stdout:2710 punch from 0x1ecb4c0 to 0x1ecdd0a, (0x284a bytes) 2024-09-13T06:41:03.626 INFO:teuthology.orchestra.run.smithi081.stdout:2711 write 0x38b015b thru 0x38b8283 (0x8129 bytes) 2024-09-13T06:41:03.629 INFO:teuthology.orchestra.run.smithi081.stdout:2713 writesame 0xb70acd thru 0xb76de0 data_size 0x11(0x6314 bytes) 2024-09-13T06:41:03.634 INFO:teuthology.orchestra.run.smithi081.stdout:2714 writesame 0x2f4253 thru 0x2fe0b5 data_size 0x1(0x9e63 bytes) 2024-09-13T06:41:03.673 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:41:03.673 INFO:teuthology.orchestra.run.smithi139.stdout: "size": 20, 2024-09-13T06:41:03.673 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 600, 2024-09-13T06:41:03.674 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [ 2024-09-13T06:41:03.674 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.674 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27854 3.a 3:537b3559:::rbd_data.1121f2c5ee81.0000000000000016:13 [read 335872~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:03.674 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.658750+0000", 2024-09-13T06:41:03.674 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 67.014204358000001, 2024-09-13T06:41:03.674 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.037969532, 2024-09-13T06:41:03.674 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:03.674 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:03.674 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:03.674 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:03.674 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:03.674 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27854 2024-09-13T06:41:03.674 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.675 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:03.675 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.675 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:03.675 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658750+0000", 2024-09-13T06:41:03.675 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:03.675 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.675 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.675 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:03.675 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658750+0000", 2024-09-13T06:41:03.675 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:03.675 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.675 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.675 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:03.675 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658749+0000", 2024-09-13T06:41:03.676 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:03.676 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.676 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.676 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:03.676 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658757+0000", 2024-09-13T06:41:03.676 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.7389999999999999e-06 2024-09-13T06:41:03.676 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.676 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.676 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:03.676 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658763+0000", 2024-09-13T06:41:03.676 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.7769999999999999e-06 2024-09-13T06:41:03.676 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.677 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.677 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:03.677 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658767+0000", 2024-09-13T06:41:03.677 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.1749999999999998e-06 2024-09-13T06:41:03.677 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.677 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.677 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:03.677 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.696322+0000", 2024-09-13T06:41:03.677 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.037554772 2024-09-13T06:41:03.677 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.677 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.677 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:03.677 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.696418+0000", 2024-09-13T06:41:03.678 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6050000000000004e-05 2024-09-13T06:41:03.678 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.678 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.678 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:03.678 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.696719+0000", 2024-09-13T06:41:03.678 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00030138499999999999 2024-09-13T06:41:03.678 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:03.678 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:03.678 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:03.678 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.678 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.678 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27855 3.a 3:537b3559:::rbd_data.1121f2c5ee81.0000000000000016:13 [read 380928~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:03.678 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.658771+0000", 2024-09-13T06:41:03.679 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 67.014183114000005, 2024-09-13T06:41:03.679 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.038326354, 2024-09-13T06:41:03.679 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:03.679 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:03.679 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:03.679 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:03.679 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:03.679 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27855 2024-09-13T06:41:03.679 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.679 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:03.679 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.679 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:03.679 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658771+0000", 2024-09-13T06:41:03.679 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:03.680 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.680 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.680 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:03.680 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658771+0000", 2024-09-13T06:41:03.680 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:03.680 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.680 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.680 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:03.680 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658770+0000", 2024-09-13T06:41:03.680 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:03.680 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.681 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.681 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:03.681 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658772+0000", 2024-09-13T06:41:03.681 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.0930000000000001e-06 2024-09-13T06:41:03.681 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.681 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.681 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:03.681 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658778+0000", 2024-09-13T06:41:03.681 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.2730000000000002e-06 2024-09-13T06:41:03.681 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.681 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.681 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:03.681 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658782+0000", 2024-09-13T06:41:03.682 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0879999999999997e-06 2024-09-13T06:41:03.682 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.682 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.682 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:03.682 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.696770+0000", 2024-09-13T06:41:03.682 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.037988145000000001 2024-09-13T06:41:03.682 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.682 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.682 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:03.682 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.696852+0000", 2024-09-13T06:41:03.682 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.2039999999999994e-05 2024-09-13T06:41:03.682 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.682 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.682 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:03.683 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.697097+0000", 2024-09-13T06:41:03.683 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00024508800000000002 2024-09-13T06:41:03.683 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:03.683 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:03.683 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:03.683 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.683 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.683 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27856 3.a 3:537b3559:::rbd_data.1121f2c5ee81.0000000000000016:13 [read 405504~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:03.683 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.658786+0000", 2024-09-13T06:41:03.683 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 67.014167998000005, 2024-09-13T06:41:03.683 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.038736029999999998, 2024-09-13T06:41:03.683 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:03.683 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:03.684 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:03.684 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:03.684 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:03.684 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27856 2024-09-13T06:41:03.684 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.684 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:03.684 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.684 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:03.684 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658786+0000", 2024-09-13T06:41:03.684 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:03.684 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.685 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.685 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:03.685 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658786+0000", 2024-09-13T06:41:03.685 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:03.685 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.685 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.685 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:03.685 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658785+0000", 2024-09-13T06:41:03.685 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:03.685 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.685 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.685 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:03.685 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658787+0000", 2024-09-13T06:41:03.685 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.0040000000000002e-06 2024-09-13T06:41:03.686 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.686 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.686 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:03.686 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658793+0000", 2024-09-13T06:41:03.686 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.2410000000000003e-06 2024-09-13T06:41:03.686 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.686 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.686 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:03.686 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658797+0000", 2024-09-13T06:41:03.686 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.1330000000000001e-06 2024-09-13T06:41:03.686 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.686 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.687 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:03.687 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.697176+0000", 2024-09-13T06:41:03.687 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.038379074999999999 2024-09-13T06:41:03.687 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.687 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.687 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:03.687 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.697275+0000", 2024-09-13T06:41:03.687 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.8819000000000004e-05 2024-09-13T06:41:03.687 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.687 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.687 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:03.688 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.697522+0000", 2024-09-13T06:41:03.688 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00024719999999999999 2024-09-13T06:41:03.688 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:03.688 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:03.688 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:03.688 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.688 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.688 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27857 3.a 3:537b3559:::rbd_data.1121f2c5ee81.0000000000000016:13 [read 475136~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:03.688 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.658845+0000", 2024-09-13T06:41:03.688 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 67.014108995000001, 2024-09-13T06:41:03.688 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039112570999999999, 2024-09-13T06:41:03.688 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:03.688 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:03.689 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:03.689 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:03.689 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:03.689 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27857 2024-09-13T06:41:03.689 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.689 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:03.689 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.689 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:03.689 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658845+0000", 2024-09-13T06:41:03.690 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:03.690 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.690 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.690 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:03.690 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658845+0000", 2024-09-13T06:41:03.690 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:03.690 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.691 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.691 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:03.691 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658844+0000", 2024-09-13T06:41:03.691 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999986 2024-09-13T06:41:03.691 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.691 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.691 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:03.691 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658868+0000", 2024-09-13T06:41:03.691 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.4615000000000001e-05 2024-09-13T06:41:03.691 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.691 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.691 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:03.691 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658884+0000", 2024-09-13T06:41:03.691 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5401999999999999e-05 2024-09-13T06:41:03.692 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.692 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.692 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:03.692 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658896+0000", 2024-09-13T06:41:03.692 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2509e-05 2024-09-13T06:41:03.692 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.692 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.692 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:03.692 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.697571+0000", 2024-09-13T06:41:03.692 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.038675107 2024-09-13T06:41:03.692 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.692 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.692 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:03.693 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.697658+0000", 2024-09-13T06:41:03.693 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6349999999999998e-05 2024-09-13T06:41:03.693 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.693 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.693 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:03.693 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.697957+0000", 2024-09-13T06:41:03.693 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00029986100000000001 2024-09-13T06:41:03.693 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:03.693 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:03.693 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:03.693 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.694 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.694 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27858 3.a 3:537b3559:::rbd_data.1121f2c5ee81.0000000000000016:13 [read 499712~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:03.694 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.658905+0000", 2024-09-13T06:41:03.694 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 67.014048445, 2024-09-13T06:41:03.694 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039475392999999998, 2024-09-13T06:41:03.694 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:03.694 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:03.694 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:03.694 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:03.694 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:03.694 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27858 2024-09-13T06:41:03.694 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.694 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:03.695 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.695 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:03.695 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658905+0000", 2024-09-13T06:41:03.695 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:03.695 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.695 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.695 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:03.695 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658905+0000", 2024-09-13T06:41:03.695 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:03.695 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.696 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.696 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:03.696 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658905+0000", 2024-09-13T06:41:03.696 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:03.696 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.696 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.696 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:03.696 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658909+0000", 2024-09-13T06:41:03.696 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.831e-06 2024-09-13T06:41:03.696 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.696 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.696 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:03.696 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658920+0000", 2024-09-13T06:41:03.696 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0936e-05 2024-09-13T06:41:03.697 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.697 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.697 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:03.697 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658929+0000", 2024-09-13T06:41:03.697 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.2749999999999995e-06 2024-09-13T06:41:03.697 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.697 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.697 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:03.697 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.697990+0000", 2024-09-13T06:41:03.697 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039061625000000003 2024-09-13T06:41:03.697 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.697 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.697 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:03.698 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.698077+0000", 2024-09-13T06:41:03.698 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6922000000000006e-05 2024-09-13T06:41:03.698 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.698 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.698 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:03.698 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.698381+0000", 2024-09-13T06:41:03.698 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00030360599999999999 2024-09-13T06:41:03.698 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:03.698 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:03.698 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:03.698 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.698 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.698 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27929 3.a 3:537b3559:::rbd_data.1121f2c5ee81.0000000000000016:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:03.699 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.659338+0000", 2024-09-13T06:41:03.699 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 67.013615614000003, 2024-09-13T06:41:03.699 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039351214000000002, 2024-09-13T06:41:03.699 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:03.700 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:03.700 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:03.700 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:03.700 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:03.700 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27929 2024-09-13T06:41:03.700 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.700 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:03.700 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.700 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:03.700 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.659338+0000", 2024-09-13T06:41:03.700 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:03.700 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.700 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.701 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:03.701 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.659338+0000", 2024-09-13T06:41:03.701 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:03.701 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.701 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.701 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:03.701 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.659337+0000", 2024-09-13T06:41:03.701 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:03.701 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.701 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.701 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:03.701 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.659342+0000", 2024-09-13T06:41:03.701 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0799999999999999e-06 2024-09-13T06:41:03.702 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.702 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.702 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:03.702 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.659353+0000", 2024-09-13T06:41:03.702 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1798e-05 2024-09-13T06:41:03.702 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.702 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.702 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:03.702 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.659361+0000", 2024-09-13T06:41:03.702 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.8040000000000002e-06 2024-09-13T06:41:03.702 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.702 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.702 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:03.702 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.698449+0000", 2024-09-13T06:41:03.703 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039087519000000001 2024-09-13T06:41:03.703 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.703 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.703 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:03.703 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.698567+0000", 2024-09-13T06:41:03.703 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00011857 2024-09-13T06:41:03.703 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.703 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.703 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:03.703 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.698689+0000", 2024-09-13T06:41:03.703 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00012226699999999999 2024-09-13T06:41:03.703 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:03.703 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:03.703 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:03.704 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.704 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.704 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27974 3.a 3:537b3559:::rbd_data.1121f2c5ee81.0000000000000016:13 [read 32768~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:03.704 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.660102+0000", 2024-09-13T06:41:03.704 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 67.012851846000004, 2024-09-13T06:41:03.704 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.038972346999999997, 2024-09-13T06:41:03.704 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:03.704 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:03.704 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:03.704 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:03.704 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:03.705 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27974 2024-09-13T06:41:03.705 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.705 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:03.705 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.705 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:03.705 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660102+0000", 2024-09-13T06:41:03.705 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:03.705 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.705 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.705 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:03.705 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660102+0000", 2024-09-13T06:41:03.705 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:03.706 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.706 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.706 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:03.706 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660100+0000", 2024-09-13T06:41:03.706 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999976 2024-09-13T06:41:03.706 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.706 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.706 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:03.706 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660114+0000", 2024-09-13T06:41:03.706 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.4466e-05 2024-09-13T06:41:03.706 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.706 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.707 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:03.707 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660148+0000", 2024-09-13T06:41:03.707 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.3742999999999999e-05 2024-09-13T06:41:03.707 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.707 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.707 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:03.707 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660170+0000", 2024-09-13T06:41:03.707 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.2518e-05 2024-09-13T06:41:03.707 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.707 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.707 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:03.707 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.698719+0000", 2024-09-13T06:41:03.707 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.038548529999999998 2024-09-13T06:41:03.708 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.708 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.708 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:03.708 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.698806+0000", 2024-09-13T06:41:03.708 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.7179e-05 2024-09-13T06:41:03.708 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.708 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.708 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:03.708 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.699074+0000", 2024-09-13T06:41:03.708 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00026834800000000001 2024-09-13T06:41:03.708 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:03.708 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:03.709 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:03.709 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.709 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.709 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27975 3.a 3:537b3559:::rbd_data.1121f2c5ee81.0000000000000016:13 [read 57344~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:03.709 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.660189+0000", 2024-09-13T06:41:03.709 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 67.012765001999995, 2024-09-13T06:41:03.709 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039288678, 2024-09-13T06:41:03.709 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:03.709 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:03.709 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:03.710 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:03.710 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:03.710 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27975 2024-09-13T06:41:03.710 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.710 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:03.710 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.710 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:03.710 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660189+0000", 2024-09-13T06:41:03.710 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:03.710 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.710 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.710 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:03.710 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660189+0000", 2024-09-13T06:41:03.710 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:03.711 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.711 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.711 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:03.711 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660187+0000", 2024-09-13T06:41:03.711 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999981 2024-09-13T06:41:03.711 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.711 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.711 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:03.711 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660195+0000", 2024-09-13T06:41:03.711 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5610000000000001e-06 2024-09-13T06:41:03.711 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.711 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.712 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:03.712 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660212+0000", 2024-09-13T06:41:03.712 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7725999999999999e-05 2024-09-13T06:41:03.712 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.712 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.712 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:03.712 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660227+0000", 2024-09-13T06:41:03.712 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.43e-05 2024-09-13T06:41:03.712 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.713 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.713 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:03.713 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.699135+0000", 2024-09-13T06:41:03.713 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.038908336000000002 2024-09-13T06:41:03.713 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.713 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.713 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:03.713 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.699208+0000", 2024-09-13T06:41:03.713 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.3065000000000006e-05 2024-09-13T06:41:03.714 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.714 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.714 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:03.714 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.699478+0000", 2024-09-13T06:41:03.714 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00026946899999999999 2024-09-13T06:41:03.714 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:03.714 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:03.714 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:03.714 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.715 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.715 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27976 3.a 3:537b3559:::rbd_data.1121f2c5ee81.0000000000000016:13 [read 102400~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:03.717 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.660238+0000", 2024-09-13T06:41:03.717 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 67.012715838999995, 2024-09-13T06:41:03.717 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039636515999999997, 2024-09-13T06:41:03.717 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:03.717 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:03.717 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:03.717 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:03.717 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:03.717 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27976 2024-09-13T06:41:03.718 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.718 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:03.718 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.718 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:03.718 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660238+0000", 2024-09-13T06:41:03.718 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:03.718 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.718 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.718 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:03.718 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660238+0000", 2024-09-13T06:41:03.718 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:03.718 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.719 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.719 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:03.719 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660237+0000", 2024-09-13T06:41:03.719 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:03.719 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.719 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.719 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:03.720 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660243+0000", 2024-09-13T06:41:03.720 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.9909999999999999e-06 2024-09-13T06:41:03.720 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.720 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.720 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:03.720 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660259+0000", 2024-09-13T06:41:03.721 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6294e-05 2024-09-13T06:41:03.721 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.721 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.721 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:03.721 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660272+0000", 2024-09-13T06:41:03.722 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2714999999999999e-05 2024-09-13T06:41:03.722 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.722 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.722 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:03.722 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.699513+0000", 2024-09-13T06:41:03.723 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039240932999999999 2024-09-13T06:41:03.723 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.723 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.723 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:03.723 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.699604+0000", 2024-09-13T06:41:03.723 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.1367999999999997e-05 2024-09-13T06:41:03.723 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.724 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.724 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:03.724 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.699875+0000", 2024-09-13T06:41:03.724 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00027029499999999999 2024-09-13T06:41:03.724 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:03.724 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:03.724 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:03.724 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.725 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.725 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27977 3.a 3:537b3559:::rbd_data.1121f2c5ee81.0000000000000016:13 [read 126976~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:03.725 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.660284+0000", 2024-09-13T06:41:03.725 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 67.012670267000004, 2024-09-13T06:41:03.725 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039969945, 2024-09-13T06:41:03.725 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:03.725 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:03.726 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:03.726 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:03.726 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:03.726 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27977 2024-09-13T06:41:03.726 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.726 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:03.726 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.726 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:03.726 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660284+0000", 2024-09-13T06:41:03.727 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:03.727 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.727 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.727 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:03.727 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660284+0000", 2024-09-13T06:41:03.727 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:03.727 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.728 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.728 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:03.728 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660282+0000", 2024-09-13T06:41:03.728 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999986 2024-09-13T06:41:03.728 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.728 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.728 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:03.729 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660288+0000", 2024-09-13T06:41:03.729 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.2650000000000002e-06 2024-09-13T06:41:03.729 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.729 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.729 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:03.729 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660304+0000", 2024-09-13T06:41:03.729 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5430999999999998e-05 2024-09-13T06:41:03.729 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.729 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.729 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:03.729 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660316+0000", 2024-09-13T06:41:03.730 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.237e-05 2024-09-13T06:41:03.730 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.730 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.730 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:03.730 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.699907+0000", 2024-09-13T06:41:03.730 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039590735000000002 2024-09-13T06:41:03.730 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.730 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.730 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:03.730 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.699994+0000", 2024-09-13T06:41:03.730 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6996999999999994e-05 2024-09-13T06:41:03.730 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.730 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.730 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:03.731 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700254+0000", 2024-09-13T06:41:03.731 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000259564 2024-09-13T06:41:03.731 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:03.731 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:03.731 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:03.731 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.731 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.731 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27978 3.a 3.9aacdeca (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:03.732 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.660327+0000", 2024-09-13T06:41:03.732 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 67.012626668999999, 2024-09-13T06:41:03.732 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039984858999999998, 2024-09-13T06:41:03.732 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:03.732 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:41:03.732 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:03.732 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:03.732 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:03.732 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27978 2024-09-13T06:41:03.733 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.733 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:03.733 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.733 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:03.733 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660327+0000", 2024-09-13T06:41:03.733 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:03.733 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.733 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.733 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:03.733 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660327+0000", 2024-09-13T06:41:03.733 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:03.733 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.734 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.734 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:03.734 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660326+0000", 2024-09-13T06:41:03.734 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:03.734 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.734 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.734 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:03.734 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660366+0000", 2024-09-13T06:41:03.734 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.9691000000000003e-05 2024-09-13T06:41:03.734 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.734 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.734 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:03.734 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660399+0000", 2024-09-13T06:41:03.734 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.3262000000000001e-05 2024-09-13T06:41:03.735 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.735 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.735 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:03.735 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660414+0000", 2024-09-13T06:41:03.735 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.4775e-05 2024-09-13T06:41:03.735 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.735 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.735 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:03.735 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700298+0000", 2024-09-13T06:41:03.735 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039883759999999997 2024-09-13T06:41:03.735 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.735 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.735 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:03.736 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700312+0000", 2024-09-13T06:41:03.736 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.4374e-05 2024-09-13T06:41:03.736 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:03.736 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:03.736 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:03.736 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.736 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.736 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27979 3.a 3.9aacdeca (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:03.736 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.660429+0000", 2024-09-13T06:41:03.736 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 67.012524800999998, 2024-09-13T06:41:03.736 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039921361000000002, 2024-09-13T06:41:03.736 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:03.737 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:41:03.737 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:03.737 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:03.737 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:03.737 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27979 2024-09-13T06:41:03.737 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.737 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:03.737 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.737 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:03.737 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660429+0000", 2024-09-13T06:41:03.737 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:03.737 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.737 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.738 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:03.738 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660429+0000", 2024-09-13T06:41:03.738 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:03.738 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.738 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.738 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:03.738 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660428+0000", 2024-09-13T06:41:03.738 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999986 2024-09-13T06:41:03.738 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.738 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.738 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:03.738 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660434+0000", 2024-09-13T06:41:03.738 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.8190000000000003e-06 2024-09-13T06:41:03.739 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.739 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.739 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:03.739 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660451+0000", 2024-09-13T06:41:03.739 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6963e-05 2024-09-13T06:41:03.739 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.739 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.739 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:03.739 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660485+0000", 2024-09-13T06:41:03.739 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.3414000000000002e-05 2024-09-13T06:41:03.739 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.739 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.739 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:03.739 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700342+0000", 2024-09-13T06:41:03.740 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039857278000000003 2024-09-13T06:41:03.740 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.740 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.740 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:03.740 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700350+0000", 2024-09-13T06:41:03.740 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.2930000000000001e-06 2024-09-13T06:41:03.740 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:03.740 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:03.740 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:03.740 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.740 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.740 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27980 3.a 3.9aacdeca (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:03.740 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.660497+0000", 2024-09-13T06:41:03.741 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 67.012456589999999, 2024-09-13T06:41:03.741 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039888034000000003, 2024-09-13T06:41:03.741 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:03.741 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:41:03.741 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:03.741 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:03.741 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:03.741 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27980 2024-09-13T06:41:03.741 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.741 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:03.741 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.741 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:03.741 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660497+0000", 2024-09-13T06:41:03.742 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:03.742 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.742 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.742 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:03.742 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660497+0000", 2024-09-13T06:41:03.742 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:03.742 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.742 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.742 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:03.742 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660496+0000", 2024-09-13T06:41:03.743 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:03.743 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.743 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.743 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:03.743 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660503+0000", 2024-09-13T06:41:03.743 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.4110000000000001e-06 2024-09-13T06:41:03.743 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.743 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.743 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:03.743 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660519+0000", 2024-09-13T06:41:03.743 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6180000000000001e-05 2024-09-13T06:41:03.743 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.743 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.744 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:03.744 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660544+0000", 2024-09-13T06:41:03.744 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.5177999999999998e-05 2024-09-13T06:41:03.744 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.744 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.744 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:03.744 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700377+0000", 2024-09-13T06:41:03.744 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039833434000000001 2024-09-13T06:41:03.744 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.744 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.744 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:03.744 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700385+0000", 2024-09-13T06:41:03.744 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.8800000000000008e-06 2024-09-13T06:41:03.744 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:03.745 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:03.745 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:03.745 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.745 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.745 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27981 3.a 3.9aacdeca (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:03.745 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.660556+0000", 2024-09-13T06:41:03.745 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 67.012398243999996, 2024-09-13T06:41:03.745 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039869989000000002, 2024-09-13T06:41:03.745 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:03.745 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:41:03.745 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:03.745 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:03.746 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:03.746 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27981 2024-09-13T06:41:03.746 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.746 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:03.746 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.746 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:03.746 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660556+0000", 2024-09-13T06:41:03.746 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:03.746 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.746 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.746 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:03.746 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660556+0000", 2024-09-13T06:41:03.746 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:03.746 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.747 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.747 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:03.747 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660555+0000", 2024-09-13T06:41:03.747 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:03.747 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.747 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.747 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:03.747 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660561+0000", 2024-09-13T06:41:03.747 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.088e-06 2024-09-13T06:41:03.747 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.747 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.747 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:03.747 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660577+0000", 2024-09-13T06:41:03.747 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6147999999999999e-05 2024-09-13T06:41:03.748 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.748 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.748 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:03.748 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660589+0000", 2024-09-13T06:41:03.748 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2551999999999999e-05 2024-09-13T06:41:03.748 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.748 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.748 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:03.748 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700414+0000", 2024-09-13T06:41:03.748 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039825007000000003 2024-09-13T06:41:03.748 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.748 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.748 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:03.749 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700426+0000", 2024-09-13T06:41:03.749 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1265e-05 2024-09-13T06:41:03.749 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:03.749 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:03.749 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:03.749 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.749 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.749 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27982 3.a 3.9aacdeca (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:03.749 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.660603+0000", 2024-09-13T06:41:03.749 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 67.012350648999998, 2024-09-13T06:41:03.749 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039874779999999999, 2024-09-13T06:41:03.749 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:03.750 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:41:03.750 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:03.750 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:03.750 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:03.750 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27982 2024-09-13T06:41:03.750 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.750 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:03.750 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.750 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:03.750 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660603+0000", 2024-09-13T06:41:03.750 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:03.750 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.750 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.750 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:03.751 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660603+0000", 2024-09-13T06:41:03.751 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:03.751 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.751 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.751 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:03.751 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660602+0000", 2024-09-13T06:41:03.751 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:03.751 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.751 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.751 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:03.751 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660653+0000", 2024-09-13T06:41:03.751 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.0862000000000002e-05 2024-09-13T06:41:03.751 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.752 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.752 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:03.752 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660697+0000", 2024-09-13T06:41:03.752 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.3773000000000003e-05 2024-09-13T06:41:03.752 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.752 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.752 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:03.752 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660712+0000", 2024-09-13T06:41:03.752 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5464999999999998e-05 2024-09-13T06:41:03.752 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.752 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.752 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:03.753 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700469+0000", 2024-09-13T06:41:03.753 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039756503999999998 2024-09-13T06:41:03.753 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.753 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.753 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:03.753 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700478+0000", 2024-09-13T06:41:03.754 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.1730000000000001e-06 2024-09-13T06:41:03.754 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:03.754 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:03.754 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:03.754 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.754 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.754 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27983 3.a 3.9aacdeca (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:03.754 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.660726+0000", 2024-09-13T06:41:03.754 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 67.012227374000005, 2024-09-13T06:41:03.754 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039804357999999998, 2024-09-13T06:41:03.754 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:03.755 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:41:03.755 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:03.755 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:03.755 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:03.755 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27983 2024-09-13T06:41:03.756 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.756 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:03.756 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.756 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:03.756 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660726+0000", 2024-09-13T06:41:03.756 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:03.756 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.756 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.756 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:03.756 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660726+0000", 2024-09-13T06:41:03.756 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:03.756 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.757 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.757 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:03.757 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660725+0000", 2024-09-13T06:41:03.757 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999986 2024-09-13T06:41:03.757 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.757 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.757 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:03.757 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660733+0000", 2024-09-13T06:41:03.757 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.9359999999999999e-06 2024-09-13T06:41:03.757 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.757 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.757 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:03.757 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660751+0000", 2024-09-13T06:41:03.758 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7679000000000001e-05 2024-09-13T06:41:03.758 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.758 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.758 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:03.758 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660764+0000", 2024-09-13T06:41:03.758 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3112000000000001e-05 2024-09-13T06:41:03.758 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.758 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.758 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:03.758 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700516+0000", 2024-09-13T06:41:03.758 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039752183000000003 2024-09-13T06:41:03.758 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.759 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.759 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:03.759 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700531+0000", 2024-09-13T06:41:03.759 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.4732999999999999e-05 2024-09-13T06:41:03.759 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:03.759 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:03.759 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:03.759 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.759 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.759 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27984 3.a 3.9aacdeca (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:03.759 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.660776+0000", 2024-09-13T06:41:03.759 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 67.012178270999996, 2024-09-13T06:41:03.759 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039795697999999997, 2024-09-13T06:41:03.760 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:03.760 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:41:03.760 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:03.760 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:03.760 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:03.760 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27984 2024-09-13T06:41:03.760 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.760 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:03.760 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.760 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:03.761 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660776+0000", 2024-09-13T06:41:03.761 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:03.761 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.761 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.761 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:03.761 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660776+0000", 2024-09-13T06:41:03.761 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:03.761 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.761 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.761 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:03.762 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660775+0000", 2024-09-13T06:41:03.762 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:03.762 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.762 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.762 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:03.762 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660780+0000", 2024-09-13T06:41:03.762 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.7849999999999997e-06 2024-09-13T06:41:03.762 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.762 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.762 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:03.762 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660799+0000", 2024-09-13T06:41:03.762 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.8794e-05 2024-09-13T06:41:03.762 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.763 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.763 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:03.763 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660812+0000", 2024-09-13T06:41:03.763 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3029e-05 2024-09-13T06:41:03.763 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.763 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.763 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:03.763 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700562+0000", 2024-09-13T06:41:03.763 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039749984000000002 2024-09-13T06:41:03.763 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.763 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.763 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:03.763 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700571+0000", 2024-09-13T06:41:03.763 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.1260000000000004e-06 2024-09-13T06:41:03.764 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:03.764 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:03.764 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:03.764 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.764 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.764 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27985 3.a 3.9aacdeca (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:03.764 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.660824+0000", 2024-09-13T06:41:03.764 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 67.012130218999999, 2024-09-13T06:41:03.764 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039784462, 2024-09-13T06:41:03.764 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:03.764 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:41:03.764 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:03.764 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:03.765 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:03.765 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27985 2024-09-13T06:41:03.765 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.765 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:03.765 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.765 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:03.765 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660824+0000", 2024-09-13T06:41:03.765 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:03.765 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.765 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.765 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:03.765 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660824+0000", 2024-09-13T06:41:03.765 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:03.766 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.766 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.766 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:03.766 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660823+0000", 2024-09-13T06:41:03.766 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:03.766 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.766 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.766 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:03.766 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660829+0000", 2024-09-13T06:41:03.766 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.9440000000000002e-06 2024-09-13T06:41:03.766 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.766 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.766 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:03.767 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660922+0000", 2024-09-13T06:41:03.767 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.2958e-05 2024-09-13T06:41:03.767 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.767 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.767 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:03.767 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660964+0000", 2024-09-13T06:41:03.767 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.2407000000000002e-05 2024-09-13T06:41:03.767 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.767 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.767 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:03.767 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700600+0000", 2024-09-13T06:41:03.767 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039635581000000003 2024-09-13T06:41:03.767 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.767 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.768 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:03.768 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700608+0000", 2024-09-13T06:41:03.768 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.5890000000000003e-06 2024-09-13T06:41:03.768 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:03.768 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:03.768 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:03.768 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.768 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.768 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:28023 3.10 3:0dedc28a:::rbd_data.1121f2c5ee81.0000000000000019:13 [read 475136~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:03.768 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.662072+0000", 2024-09-13T06:41:03.768 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 67.010882233999993, 2024-09-13T06:41:03.768 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.038086508999999998, 2024-09-13T06:41:03.768 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:03.769 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:03.769 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:03.769 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:03.769 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:03.769 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 28023 2024-09-13T06:41:03.769 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.769 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:03.769 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.769 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:03.769 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.662072+0000", 2024-09-13T06:41:03.769 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:03.769 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.770 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.770 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:03.770 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.662072+0000", 2024-09-13T06:41:03.770 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:03.770 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.770 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.770 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:03.770 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.662070+0000", 2024-09-13T06:41:03.770 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999986 2024-09-13T06:41:03.770 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.770 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.770 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:03.770 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.662076+0000", 2024-09-13T06:41:03.770 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.139e-06 2024-09-13T06:41:03.771 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.771 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.771 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:03.771 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.662094+0000", 2024-09-13T06:41:03.771 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7136999999999999e-05 2024-09-13T06:41:03.771 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.771 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.771 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:03.771 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.662124+0000", 2024-09-13T06:41:03.771 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.0528999999999999e-05 2024-09-13T06:41:03.771 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.771 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.771 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:03.772 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.699843+0000", 2024-09-13T06:41:03.772 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.037718415999999998 2024-09-13T06:41:03.772 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.772 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.772 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:03.772 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.699931+0000", 2024-09-13T06:41:03.772 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.8345999999999997e-05 2024-09-13T06:41:03.772 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.772 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.772 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:03.772 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700158+0000", 2024-09-13T06:41:03.772 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00022723099999999999 2024-09-13T06:41:03.772 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:03.772 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:03.773 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:03.773 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.773 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.773 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:28024 3.10 3.5143b7b0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:03.773 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.662137+0000", 2024-09-13T06:41:03.773 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 67.010816711999993, 2024-09-13T06:41:03.773 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.038056092999999999, 2024-09-13T06:41:03.773 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:03.773 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:41:03.773 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:03.773 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:03.773 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:03.773 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 28024 2024-09-13T06:41:03.774 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.774 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:03.774 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.774 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:03.774 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.662137+0000", 2024-09-13T06:41:03.774 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:03.774 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.774 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.774 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:03.774 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.662137+0000", 2024-09-13T06:41:03.774 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:03.774 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.774 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.775 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:03.775 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.662136+0000", 2024-09-13T06:41:03.775 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999986 2024-09-13T06:41:03.775 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.775 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.775 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:03.775 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.662142+0000", 2024-09-13T06:41:03.775 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.6930000000000001e-06 2024-09-13T06:41:03.775 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.775 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.775 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:03.775 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.662160+0000", 2024-09-13T06:41:03.775 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7863000000000002e-05 2024-09-13T06:41:03.775 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.776 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.776 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:03.776 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.662189+0000", 2024-09-13T06:41:03.776 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.8486000000000001e-05 2024-09-13T06:41:03.776 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.776 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.776 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:03.776 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700187+0000", 2024-09-13T06:41:03.776 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.037998331000000003 2024-09-13T06:41:03.776 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:03.776 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:03.776 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:03.776 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700193+0000", 2024-09-13T06:41:03.777 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.0909999999999998e-06 2024-09-13T06:41:03.777 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:03.777 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:03.777 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:03.777 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:03.777 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:03.777 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:41:03.778 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 6, 7, 5] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-13T06:41:03.778 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-13T06:41:03.778 INFO:tasks.thrashosds.thrasher:Removing osd 3, in_osds are: [0, 1, 2, 3, 4, 6, 7, 5] 2024-09-13T06:41:03.778 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd out 3 2024-09-13T06:41:03.778 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-13T06:41:03.781 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-13T06:41:03.781 INFO:tasks.ceph.osd.6.smithi139.stderr:2024-09-13T06:41:03.776+0000 7fcd02c5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26385) UID: 0 2024-09-13T06:41:03.781 INFO:teuthology.orchestra.run.smithi081.stdout:2716 read 0x84f81dc thru 0x8505caa (0xdacf bytes) 2024-09-13T06:41:03.781 INFO:teuthology.orchestra.run.smithi081.stdout:2717 read 0x18dfed1 thru 0x18eede3 (0xef13 bytes) 2024-09-13T06:41:03.782 INFO:teuthology.orchestra.run.smithi081.stdout:2718 read 0x2324b9d thru 0x2326075 (0x14d9 bytes) 2024-09-13T06:41:03.782 INFO:teuthology.orchestra.run.smithi081.stdout:2719 trunc from 0xd478530 to 0x7634638 2024-09-13T06:41:03.782 INFO:teuthology.orchestra.run.smithi081.stdout:2720 write 0x15eb90a thru 0x15ee865 (0x2f5c bytes) 2024-09-13T06:41:03.782 INFO:teuthology.orchestra.run.smithi081.stdout:2721 writesame 0xcf57c3a thru 0xcf67238 data_size 0x37(0xf5ff bytes) 2024-09-13T06:41:03.782 INFO:teuthology.orchestra.run.smithi081.stdout:2723 punch from 0x382dece to 0x3835300, (0x7432 bytes) 2024-09-13T06:41:03.782 INFO:teuthology.orchestra.run.smithi081.stdout:2724 trunc from 0xcf67239 to 0x88dc527 2024-09-13T06:41:03.794 INFO:teuthology.orchestra.run.smithi081.stdout:2725 trunc from 0x88dc527 to 0xcf472b0 2024-09-13T06:41:03.802 INFO:teuthology.orchestra.run.smithi081.stdout:2726 writesame 0x3b28ac2 thru 0x3b29d09 data_size 0x1(0x1248 bytes) 2024-09-13T06:41:03.807 INFO:teuthology.orchestra.run.smithi081.stdout:2728 read 0xb28374d thru 0xb28a8d5 (0x7189 bytes) 2024-09-13T06:41:03.807 INFO:teuthology.orchestra.run.smithi081.stdout:2729 clone 19 order 25 su 4194304 sc 6 2024-09-13T06:41:03.879 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-13T06:41:03.880+0000 7f86a5f06640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26387) UID: 0 2024-09-13T06:41:03.928 INFO:teuthology.orchestra.run.smithi081.stdout:osd.0: {} 2024-09-13T06:41:03.928 INFO:teuthology.orchestra.run.smithi081.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-13T06:41:03.944 INFO:teuthology.orchestra.run.smithi081.stdout:osd.1: {} 2024-09-13T06:41:03.944 INFO:teuthology.orchestra.run.smithi081.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-13T06:41:03.952 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:41:03.953 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [], 2024-09-13T06:41:03.953 INFO:teuthology.orchestra.run.smithi139.stdout: "num_ops": 0 2024-09-13T06:41:03.953 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:41:03.959 INFO:teuthology.orchestra.run.smithi081.stdout:osd.2: {} 2024-09-13T06:41:03.960 INFO:teuthology.orchestra.run.smithi081.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-13T06:41:03.967 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-13T06:41:03.975 INFO:teuthology.orchestra.run.smithi081.stdout:osd.3: {} 2024-09-13T06:41:03.975 INFO:teuthology.orchestra.run.smithi081.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-13T06:41:03.994 INFO:teuthology.orchestra.run.smithi081.stdout:osd.4: {} 2024-09-13T06:41:03.995 INFO:teuthology.orchestra.run.smithi081.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-13T06:41:04.011 INFO:teuthology.orchestra.run.smithi081.stdout:osd.5: {} 2024-09-13T06:41:04.012 INFO:teuthology.orchestra.run.smithi081.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-13T06:41:04.015 INFO:tasks.ceph.osd.6.smithi139.stderr:2024-09-13T06:41:04.016+0000 7fcd02c5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26385) UID: 0 2024-09-13T06:41:04.029 INFO:teuthology.orchestra.run.smithi081.stdout:osd.6: {} 2024-09-13T06:41:04.029 INFO:teuthology.orchestra.run.smithi081.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-13T06:41:04.046 INFO:teuthology.orchestra.run.smithi081.stdout:osd.7: {} 2024-09-13T06:41:04.046 INFO:teuthology.orchestra.run.smithi081.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-13T06:41:04.081 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:41:04.080+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:41:04.090 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-13T06:41:04.091+0000 7fcdeb9fe640 -1 mon.a@0(leader).osd e109 definitely_dead 0 2024-09-13T06:41:04.138 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:41:04.138 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:41:04.152 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-13T06:41:04.182 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:41:04.183+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:41:04.283 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:41:04.283+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:41:04.311 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:41:04.311 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:41:04.329 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-13T06:41:04.384 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-13T06:41:04.384+0000 7f86a5f06640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26387) UID: 0 2024-09-13T06:41:04.461 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:41:04.461 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:41:04.476 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-13T06:41:04.485 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:41:04.484+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:41:04.586 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:41:04.584+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:41:04.594 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:41:04.594 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:41:04.598 INFO:teuthology.orchestra.run.smithi081.stderr:marked out osd.3. 2024-09-13T06:41:04.617 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-13T06:41:04.631 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-13T06:41:04.687 INFO:tasks.ceph.osd.6.smithi139.stderr:2024-09-13T06:41:04.688+0000 7fcd02c5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26385) UID: 0 2024-09-13T06:41:04.734 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:41:04.735 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:41:04.750 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-13T06:41:04.788 INFO:tasks.ceph.osd.6.smithi139.stderr:2024-09-13T06:41:04.788+0000 7fcd02c5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26385) UID: 0 2024-09-13T06:41:04.874 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:41:04.874 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:41:04.888 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-13T06:41:04.889 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:41:04.888+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:41:04.991 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:41:04.991+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:41:05.003 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:41:05.003 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:41:05.017 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-13T06:41:05.105 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:41:05.107+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:41:05.182 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:41:05.182 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:41:05.192 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:41:05.191+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:41:05.195 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-13T06:41:05.293 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:41:05.295+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:41:05.359 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:41:05.359 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:41:05.374 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-13T06:41:05.418 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:41:05.419+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:41:05.495 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:41:05.495+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:41:05.538 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:41:05.538 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:41:05.552 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-13T06:41:05.596 INFO:tasks.ceph.osd.6.smithi139.stderr:2024-09-13T06:41:05.596+0000 7fcd02c5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26385) UID: 0 2024-09-13T06:41:05.611 INFO:teuthology.orchestra.run.smithi081.stderr:nodeep-scrub is set 2024-09-13T06:41:05.697 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:41:05.696+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:41:05.717 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:41:05.717 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:41:05.731 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-13T06:41:05.798 INFO:tasks.ceph.osd.6.smithi139.stderr:2024-09-13T06:41:05.796+0000 7fcd02c5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26385) UID: 0 2024-09-13T06:41:05.852 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:41:05.852 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:41:05.866 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-13T06:41:05.914 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:41:05.915+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:41:05.984 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:41:05.984 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:41:05.998 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-13T06:41:06.042 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:41:06.043+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:41:06.064 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-13T06:41:06.129 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:41:06.131+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:41:06.159 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:41:06.159 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:41:06.174 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-13T06:41:06.223 INFO:teuthology.orchestra.run.smithi081.stdout:osd.0: {} 2024-09-13T06:41:06.223 INFO:teuthology.orchestra.run.smithi081.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-13T06:41:06.223 INFO:tasks.ceph.osd.6.smithi139.stderr:2024-09-13T06:41:06.224+0000 7fcd02c5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26385) UID: 0 2024-09-13T06:41:06.239 INFO:teuthology.orchestra.run.smithi081.stdout:osd.1: {} 2024-09-13T06:41:06.239 INFO:teuthology.orchestra.run.smithi081.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-13T06:41:06.255 INFO:teuthology.orchestra.run.smithi081.stdout:osd.2: {} 2024-09-13T06:41:06.255 INFO:teuthology.orchestra.run.smithi081.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-13T06:41:06.271 INFO:teuthology.orchestra.run.smithi081.stdout:osd.3: {} 2024-09-13T06:41:06.271 INFO:teuthology.orchestra.run.smithi081.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-13T06:41:06.290 INFO:teuthology.orchestra.run.smithi081.stdout:osd.4: {} 2024-09-13T06:41:06.291 INFO:teuthology.orchestra.run.smithi081.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-13T06:41:06.303 INFO:tasks.ceph.osd.6.smithi139.stderr:2024-09-13T06:41:06.304+0000 7fcd02c5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26385) UID: 0 2024-09-13T06:41:06.305 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:41:06.306 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [], 2024-09-13T06:41:06.306 INFO:teuthology.orchestra.run.smithi139.stdout: "num_ops": 0 2024-09-13T06:41:06.306 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:41:06.310 INFO:teuthology.orchestra.run.smithi081.stdout:osd.5: {} 2024-09-13T06:41:06.310 INFO:teuthology.orchestra.run.smithi081.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-13T06:41:06.321 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-13T06:41:06.329 INFO:teuthology.orchestra.run.smithi081.stdout:osd.6: {} 2024-09-13T06:41:06.329 INFO:teuthology.orchestra.run.smithi081.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-13T06:41:06.348 INFO:teuthology.orchestra.run.smithi081.stdout:osd.7: {} 2024-09-13T06:41:06.348 INFO:teuthology.orchestra.run.smithi081.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-13T06:41:06.407 INFO:tasks.ceph.osd.6.smithi139.stderr:2024-09-13T06:41:06.408+0000 7fcd02c5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26385) UID: 0 2024-09-13T06:41:06.487 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:41:06.487 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [], 2024-09-13T06:41:06.487 INFO:teuthology.orchestra.run.smithi139.stdout: "complaint_time": 30, 2024-09-13T06:41:06.487 INFO:teuthology.orchestra.run.smithi139.stdout: "num_blocked_ops": 0 2024-09-13T06:41:06.487 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:41:06.501 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-13T06:41:06.505 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:41:06.507+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:41:06.606 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:41:06.604+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:41:06.692 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:41:06.692 INFO:teuthology.orchestra.run.smithi139.stdout: "size": 20, 2024-09-13T06:41:06.692 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 600, 2024-09-13T06:41:06.693 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [ 2024-09-13T06:41:06.693 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:06.693 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18706 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 3346432~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:41:06.693 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.846138+0000", 2024-09-13T06:41:06.693 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 74.845585169000003, 2024-09-13T06:41:06.693 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.102018712, 2024-09-13T06:41:06.693 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:06.693 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:06.693 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:06.693 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:06.693 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:06.693 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18706 2024-09-13T06:41:06.693 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:06.693 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:06.694 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:06.694 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:06.694 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846138+0000", 2024-09-13T06:41:06.694 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:06.694 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:06.694 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:06.694 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:06.694 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846138+0000", 2024-09-13T06:41:06.694 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:06.694 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:06.694 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:06.694 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:06.694 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846138+0000", 2024-09-13T06:41:06.695 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:06.695 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:06.695 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:06.695 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:06.695 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846141+0000", 2024-09-13T06:41:06.695 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.6969999999999999e-06 2024-09-13T06:41:06.695 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:06.695 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:06.695 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:06.695 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846150+0000", 2024-09-13T06:41:06.695 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6400000000000003e-06 2024-09-13T06:41:06.695 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:06.695 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:06.696 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:06.696 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846160+0000", 2024-09-13T06:41:06.696 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.3999999999999998e-06 2024-09-13T06:41:06.696 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:06.696 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:06.696 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:06.696 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.947764+0000", 2024-09-13T06:41:06.696 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101604085 2024-09-13T06:41:06.696 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:06.696 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:06.696 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:06.696 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.947888+0000", 2024-09-13T06:41:06.696 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000124113 2024-09-13T06:41:06.697 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:06.697 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:06.697 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:06.697 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.948157+0000", 2024-09-13T06:41:06.697 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00026943399999999998 2024-09-13T06:41:06.697 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:06.697 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:06.697 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:06.697 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:06.697 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:06.697 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18707 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 3375104~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:41:06.697 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.846207+0000", 2024-09-13T06:41:06.697 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 74.845516403000005, 2024-09-13T06:41:06.698 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10238114099999999, 2024-09-13T06:41:06.698 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:06.698 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:06.698 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:06.698 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:06.698 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:06.698 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18707 2024-09-13T06:41:06.698 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:06.698 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:06.698 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:06.698 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:06.698 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846207+0000", 2024-09-13T06:41:06.698 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:06.699 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:06.699 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:06.699 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:06.699 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846207+0000", 2024-09-13T06:41:06.699 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:06.699 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:06.699 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:06.699 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:06.699 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846206+0000", 2024-09-13T06:41:06.699 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:06.699 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:06.699 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:06.699 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:06.700 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846211+0000", 2024-09-13T06:41:06.700 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.3000000000000003e-06 2024-09-13T06:41:06.700 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:06.700 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:06.700 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:06.700 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846220+0000", 2024-09-13T06:41:06.700 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6199999999999994e-06 2024-09-13T06:41:06.700 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:06.700 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:06.700 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:06.700 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846228+0000", 2024-09-13T06:41:06.700 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.7500000000000003e-06 2024-09-13T06:41:06.700 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:06.700 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:06.701 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:06.701 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.948267+0000", 2024-09-13T06:41:06.701 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10203878700000001 2024-09-13T06:41:06.701 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:06.701 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:06.701 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:06.701 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.948435+0000", 2024-09-13T06:41:06.701 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00016796500000000001 2024-09-13T06:41:06.701 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:06.701 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:06.701 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:06.701 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.948588+0000", 2024-09-13T06:41:06.701 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00015373599999999999 2024-09-13T06:41:06.701 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:06.702 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:06.702 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:06.702 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:06.702 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:06.702 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18718 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 3690496~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:41:06.702 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.850174+0000", 2024-09-13T06:41:06.702 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 74.84154925, 2024-09-13T06:41:06.702 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101854154, 2024-09-13T06:41:06.702 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:06.702 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:06.702 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:06.702 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:06.702 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:06.702 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18718 2024-09-13T06:41:06.703 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:06.703 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:06.703 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:06.703 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:06.703 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850174+0000", 2024-09-13T06:41:06.703 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:06.703 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:06.703 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:06.703 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:06.703 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850174+0000", 2024-09-13T06:41:06.703 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:06.703 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:06.703 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:06.703 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:06.704 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850173+0000", 2024-09-13T06:41:06.704 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:06.704 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:06.704 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:06.704 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:06.704 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850178+0000", 2024-09-13T06:41:06.704 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.4129999999999999e-06 2024-09-13T06:41:06.704 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:06.704 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:06.704 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:06.704 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850188+0000", 2024-09-13T06:41:06.704 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.8600000000000005e-06 2024-09-13T06:41:06.704 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:06.704 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:06.705 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:06.705 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850195+0000", 2024-09-13T06:41:06.705 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.8730000000000007e-06 2024-09-13T06:41:06.705 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:06.705 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:06.705 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:06.705 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.951766+0000", 2024-09-13T06:41:06.705 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.1015703 2024-09-13T06:41:06.705 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:06.705 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:06.705 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:06.705 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.951879+0000", 2024-09-13T06:41:06.705 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000112932 2024-09-13T06:41:06.706 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:06.706 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:06.706 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:06.706 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.952029+0000", 2024-09-13T06:41:06.706 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000149846 2024-09-13T06:41:06.706 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:06.706 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:06.706 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:06.706 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:06.706 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:06.706 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18719 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 3719168~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:41:06.706 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.850202+0000", 2024-09-13T06:41:06.706 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 74.841521207, 2024-09-13T06:41:06.707 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.102191676, 2024-09-13T06:41:06.707 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:06.707 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:06.707 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:06.707 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:06.707 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:06.707 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18719 2024-09-13T06:41:06.707 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:06.707 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:06.707 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:06.707 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:06.707 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850202+0000", 2024-09-13T06:41:06.707 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:06.708 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:06.708 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:06.708 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:06.708 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850202+0000", 2024-09-13T06:41:06.708 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:06.708 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:06.708 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:06.708 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:06.708 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850202+0000", 2024-09-13T06:41:06.708 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:06.708 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:06.708 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:06.708 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:06.709 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850205+0000", 2024-09-13T06:41:06.709 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.89e-06 2024-09-13T06:41:06.709 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:06.709 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:06.709 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:06.709 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850216+0000", 2024-09-13T06:41:06.709 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0233e-05 2024-09-13T06:41:06.709 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:06.709 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:06.709 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:06.709 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850223+0000", 2024-09-13T06:41:06.709 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5299999999999999e-06 2024-09-13T06:41:06.709 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:06.709 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:06.710 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:06.710 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.952106+0000", 2024-09-13T06:41:06.710 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10188309299999999 2024-09-13T06:41:06.710 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:06.710 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:06.710 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:06.710 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.952233+0000", 2024-09-13T06:41:06.710 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000126993 2024-09-13T06:41:06.710 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:06.710 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:06.710 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:06.710 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.952394+0000", 2024-09-13T06:41:06.710 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000160791 2024-09-13T06:41:06.711 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:06.711 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:06.711 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:06.711 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:06.711 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:06.711 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18720 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 3747840~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:41:06.711 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.850726+0000", 2024-09-13T06:41:06.711 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 74.840997377999997, 2024-09-13T06:41:06.711 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10199504299999999, 2024-09-13T06:41:06.711 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:06.711 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:06.711 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:06.711 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:06.712 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:06.712 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18720 2024-09-13T06:41:06.712 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:06.712 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:06.712 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:06.712 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:06.712 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850726+0000", 2024-09-13T06:41:06.712 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:06.712 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:06.712 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:06.712 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:06.712 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850726+0000", 2024-09-13T06:41:06.712 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:06.713 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:06.713 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:06.713 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:06.713 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850229+0000", 2024-09-13T06:41:06.713 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9995027 2024-09-13T06:41:06.713 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:06.713 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:06.713 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:06.713 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850731+0000", 2024-09-13T06:41:06.713 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00050221599999999999 2024-09-13T06:41:06.713 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:06.713 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:06.713 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:06.713 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850751+0000", 2024-09-13T06:41:06.714 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.9703000000000001e-05 2024-09-13T06:41:06.714 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:06.714 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:06.714 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:06.714 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850764+0000", 2024-09-13T06:41:06.714 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3207000000000001e-05 2024-09-13T06:41:06.714 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:06.714 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:06.714 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:06.714 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.952454+0000", 2024-09-13T06:41:06.714 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101690102 2024-09-13T06:41:06.714 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:06.714 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:06.714 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:06.715 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.952571+0000", 2024-09-13T06:41:06.715 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000116556 2024-09-13T06:41:06.715 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:06.715 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:06.715 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:06.715 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.952721+0000", 2024-09-13T06:41:06.715 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000150419 2024-09-13T06:41:06.715 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:06.715 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:06.715 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:06.715 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:06.715 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:06.715 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18730 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 4034560~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:41:06.716 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.854013+0000", 2024-09-13T06:41:06.716 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 74.837710436999998, 2024-09-13T06:41:06.716 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10186914399999999, 2024-09-13T06:41:06.716 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:06.716 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:06.716 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:06.716 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:06.716 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:06.716 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18730 2024-09-13T06:41:06.716 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:06.716 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:06.716 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:06.716 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:06.716 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.854013+0000", 2024-09-13T06:41:06.717 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:06.717 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:06.717 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:06.717 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:06.717 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.854013+0000", 2024-09-13T06:41:06.717 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:06.717 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:06.717 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:06.717 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:06.717 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.854013+0000", 2024-09-13T06:41:06.717 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:06.717 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:06.717 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:06.718 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:06.718 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.854016+0000", 2024-09-13T06:41:06.718 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.1839999999999999e-06 2024-09-13T06:41:06.718 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:06.718 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:06.718 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:06.718 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.854025+0000", 2024-09-13T06:41:06.718 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.8030000000000003e-06 2024-09-13T06:41:06.718 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:06.718 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:06.718 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:06.718 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.854033+0000", 2024-09-13T06:41:06.718 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6500000000000002e-06 2024-09-13T06:41:06.719 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:06.719 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:06.719 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:06.719 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.955546+0000", 2024-09-13T06:41:06.719 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10151296 2024-09-13T06:41:06.719 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:06.719 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:06.719 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:06.719 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.955694+0000", 2024-09-13T06:41:06.719 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000147773 2024-09-13T06:41:06.719 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:06.719 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:06.719 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:06.719 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.955882+0000", 2024-09-13T06:41:06.720 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000188371 2024-09-13T06:41:06.720 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:06.720 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:06.720 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:06.720 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:06.720 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:06.720 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18742 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 4378624~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:41:06.720 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.857984+0000", 2024-09-13T06:41:06.720 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 74.833739313999999, 2024-09-13T06:41:06.720 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10179961799999999, 2024-09-13T06:41:06.720 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:06.720 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:06.721 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:06.721 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:06.721 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:06.721 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18742 2024-09-13T06:41:06.721 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:06.721 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:06.721 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:06.721 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:06.721 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.857984+0000", 2024-09-13T06:41:06.721 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:06.721 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:06.721 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:06.721 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:06.722 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.857984+0000", 2024-09-13T06:41:06.722 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:06.722 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:06.722 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:06.722 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:06.722 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.857983+0000", 2024-09-13T06:41:06.722 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:06.722 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:06.722 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:06.722 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:06.722 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.857987+0000", 2024-09-13T06:41:06.722 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0670000000000002e-06 2024-09-13T06:41:06.722 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:06.723 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:06.723 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:06.723 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.857997+0000", 2024-09-13T06:41:06.723 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6830000000000003e-06 2024-09-13T06:41:06.723 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:06.723 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:06.723 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:06.723 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.858006+0000", 2024-09-13T06:41:06.723 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.5739999999999996e-06 2024-09-13T06:41:06.723 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:06.723 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:06.723 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:06.723 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.959453+0000", 2024-09-13T06:41:06.723 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101447339 2024-09-13T06:41:06.724 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:06.724 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:06.724 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:06.724 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.959603+0000", 2024-09-13T06:41:06.724 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000150316 2024-09-13T06:41:06.724 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:06.724 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:06.724 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:06.724 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.959784+0000", 2024-09-13T06:41:06.724 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00018065900000000001 2024-09-13T06:41:06.724 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:06.724 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:06.724 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:06.725 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:06.725 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:06.725 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18743 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 4407296~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:41:06.725 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.858012+0000", 2024-09-13T06:41:06.725 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 74.833711320999996, 2024-09-13T06:41:06.725 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10210024500000001, 2024-09-13T06:41:06.725 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:06.725 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:06.725 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:06.725 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:06.725 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:06.725 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18743 2024-09-13T06:41:06.725 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:06.725 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:06.726 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:06.726 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:06.726 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.858012+0000", 2024-09-13T06:41:06.726 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:06.726 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:06.726 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:06.726 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:06.726 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.858012+0000", 2024-09-13T06:41:06.726 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:06.726 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:06.726 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:06.726 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:06.726 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.858011+0000", 2024-09-13T06:41:06.727 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:06.727 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:06.727 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:06.727 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:06.727 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.858016+0000", 2024-09-13T06:41:06.727 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0659999999999997e-06 2024-09-13T06:41:06.727 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:06.727 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:06.727 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:06.727 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.858024+0000", 2024-09-13T06:41:06.727 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.7700000000000007e-06 2024-09-13T06:41:06.727 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:06.727 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:06.728 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:06.728 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.858032+0000", 2024-09-13T06:41:06.728 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.7700000000000001e-06 2024-09-13T06:41:06.728 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:06.728 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:06.728 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:06.728 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.959850+0000", 2024-09-13T06:41:06.728 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.1018182 2024-09-13T06:41:06.728 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:06.728 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:06.728 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:06.728 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.959964+0000", 2024-09-13T06:41:06.728 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00011413600000000001 2024-09-13T06:41:06.729 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:06.729 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:06.729 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:06.729 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.960113+0000", 2024-09-13T06:41:06.729 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00014813900000000001 2024-09-13T06:41:06.729 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:06.729 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:06.729 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:06.729 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:06.729 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:06.730 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18755 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 4751360~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:41:06.730 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.862061+0000", 2024-09-13T06:41:06.730 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 74.829663069000006, 2024-09-13T06:41:06.730 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101907023, 2024-09-13T06:41:06.730 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:06.730 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:06.730 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:06.730 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:06.730 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:06.730 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18755 2024-09-13T06:41:06.730 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:06.730 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:06.730 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:06.730 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:06.731 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862061+0000", 2024-09-13T06:41:06.731 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:06.731 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:06.731 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:06.731 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:06.731 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862061+0000", 2024-09-13T06:41:06.731 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:06.731 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:06.731 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:06.731 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:06.731 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862060+0000", 2024-09-13T06:41:06.731 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:06.731 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:06.731 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:06.731 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:06.732 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862064+0000", 2024-09-13T06:41:06.732 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.3229999999999999e-06 2024-09-13T06:41:06.732 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:06.732 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:06.732 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:06.732 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862078+0000", 2024-09-13T06:41:06.732 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.433e-05 2024-09-13T06:41:06.732 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:06.732 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:06.732 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:06.732 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862086+0000", 2024-09-13T06:41:06.732 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.3869999999999997e-06 2024-09-13T06:41:06.732 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:06.733 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:06.733 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:06.733 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.963635+0000", 2024-09-13T06:41:06.733 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101549606 2024-09-13T06:41:06.733 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:06.733 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:06.733 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:06.733 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.963783+0000", 2024-09-13T06:41:06.733 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000147312 2024-09-13T06:41:06.733 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:06.733 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:06.733 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:06.733 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.963968+0000", 2024-09-13T06:41:06.733 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000185028 2024-09-13T06:41:06.734 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:06.734 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:06.734 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:06.734 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:06.734 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:06.734 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18756 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 4780032~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:41:06.734 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.862132+0000", 2024-09-13T06:41:06.734 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 74.829591226000005, 2024-09-13T06:41:06.734 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.102159295, 2024-09-13T06:41:06.734 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:06.734 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:06.734 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:06.734 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:06.734 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:06.735 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18756 2024-09-13T06:41:06.735 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:06.735 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:06.735 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:06.735 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:06.735 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862132+0000", 2024-09-13T06:41:06.735 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:06.735 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:06.735 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:06.735 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:06.735 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862132+0000", 2024-09-13T06:41:06.735 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:06.735 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:06.735 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:06.735 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:06.736 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862132+0000", 2024-09-13T06:41:06.736 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:06.736 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:06.736 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:06.736 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:06.736 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862136+0000", 2024-09-13T06:41:06.736 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.9559999999999999e-06 2024-09-13T06:41:06.736 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:06.736 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:06.736 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:06.736 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862145+0000", 2024-09-13T06:41:06.736 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6169999999999996e-06 2024-09-13T06:41:06.736 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:06.737 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:06.737 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:06.737 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862153+0000", 2024-09-13T06:41:06.737 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.8359999999999992e-06 2024-09-13T06:41:06.737 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:06.737 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:06.737 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:06.737 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.964018+0000", 2024-09-13T06:41:06.737 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101865421 2024-09-13T06:41:06.737 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:06.737 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:06.737 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:06.737 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.964140+0000", 2024-09-13T06:41:06.738 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000121172 2024-09-13T06:41:06.738 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:06.738 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:06.738 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:06.738 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.964292+0000", 2024-09-13T06:41:06.738 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00015202600000000001 2024-09-13T06:41:06.738 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:06.738 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:06.738 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:06.738 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:06.738 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:06.738 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18768 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 5124096~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:41:06.738 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.866345+0000", 2024-09-13T06:41:06.738 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 74.825378919000002, 2024-09-13T06:41:06.739 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101779361, 2024-09-13T06:41:06.739 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:06.739 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:06.739 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:06.739 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:06.739 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:06.739 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18768 2024-09-13T06:41:06.739 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:06.739 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:06.739 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:06.739 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:06.739 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.866345+0000", 2024-09-13T06:41:06.739 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:06.739 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:06.740 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:06.740 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:06.740 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.866345+0000", 2024-09-13T06:41:06.740 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:06.740 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:06.740 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:06.740 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:06.740 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.866344+0000", 2024-09-13T06:41:06.740 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:06.740 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:06.741 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:06.741 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:06.741 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.866348+0000", 2024-09-13T06:41:06.741 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.4300000000000002e-06 2024-09-13T06:41:06.741 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:06.741 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:06.741 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:06.741 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.866356+0000", 2024-09-13T06:41:06.741 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.5930000000000006e-06 2024-09-13T06:41:06.741 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:06.741 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:06.741 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:06.741 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.866364+0000", 2024-09-13T06:41:06.742 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5599999999999996e-06 2024-09-13T06:41:06.742 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:06.742 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:06.742 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:06.742 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.967865+0000", 2024-09-13T06:41:06.742 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101501683 2024-09-13T06:41:06.742 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:06.742 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:06.742 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:06.742 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.967981+0000", 2024-09-13T06:41:06.742 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000115643 2024-09-13T06:41:06.742 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:06.742 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:06.743 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:06.743 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.968124+0000", 2024-09-13T06:41:06.743 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00014305500000000001 2024-09-13T06:41:06.743 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:06.743 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:06.743 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:06.743 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:06.743 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:06.743 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18779 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 5439488~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:41:06.743 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.869996+0000", 2024-09-13T06:41:06.743 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 74.821728034000003, 2024-09-13T06:41:06.743 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10189577399999999, 2024-09-13T06:41:06.743 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:06.743 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:06.743 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:06.744 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:06.744 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:06.744 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18779 2024-09-13T06:41:06.744 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:06.744 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:06.744 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:06.744 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:06.744 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.869996+0000", 2024-09-13T06:41:06.744 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:06.744 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:06.744 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:06.744 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:06.744 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.869996+0000", 2024-09-13T06:41:06.745 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:06.745 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:06.745 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:06.745 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:06.745 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.869995+0000", 2024-09-13T06:41:06.745 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:06.745 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:06.745 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:06.745 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:06.745 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.869998+0000", 2024-09-13T06:41:06.745 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.2729999999999998e-06 2024-09-13T06:41:06.745 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:06.745 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:06.746 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:06.746 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.870007+0000", 2024-09-13T06:41:06.746 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.5760000000000006e-06 2024-09-13T06:41:06.746 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:06.746 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:06.746 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:06.746 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.870014+0000", 2024-09-13T06:41:06.746 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.1400000000000002e-06 2024-09-13T06:41:06.746 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:06.746 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:06.746 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:06.746 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.971631+0000", 2024-09-13T06:41:06.746 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101617503 2024-09-13T06:41:06.746 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:06.746 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:06.747 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:06.747 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.971747+0000", 2024-09-13T06:41:06.747 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00011599600000000001 2024-09-13T06:41:06.747 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:06.747 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:06.747 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:06.747 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.971891+0000", 2024-09-13T06:41:06.747 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000143912 2024-09-13T06:41:06.747 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:06.747 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:06.747 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:06.747 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:06.747 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:06.747 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18792 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 5812224~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:41:06.747 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.874371+0000", 2024-09-13T06:41:06.748 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 74.817352904000003, 2024-09-13T06:41:06.748 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101736005, 2024-09-13T06:41:06.748 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:06.748 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:06.748 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:06.748 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:06.748 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:06.748 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18792 2024-09-13T06:41:06.748 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:06.748 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:06.748 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:06.748 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:06.748 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874371+0000", 2024-09-13T06:41:06.748 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:06.749 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:06.749 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:06.749 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:06.749 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874371+0000", 2024-09-13T06:41:06.749 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:06.749 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:06.749 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:06.749 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:06.749 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874370+0000", 2024-09-13T06:41:06.749 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:06.749 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:06.749 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:06.749 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:06.750 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874374+0000", 2024-09-13T06:41:06.750 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.7239999999999998e-06 2024-09-13T06:41:06.750 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:06.750 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:06.750 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:06.750 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874385+0000", 2024-09-13T06:41:06.750 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1293e-05 2024-09-13T06:41:06.750 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:06.750 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:06.750 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:06.750 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874394+0000", 2024-09-13T06:41:06.750 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.0729999999999994e-06 2024-09-13T06:41:06.750 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:06.750 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:06.751 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:06.751 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.975850+0000", 2024-09-13T06:41:06.751 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10145599700000001 2024-09-13T06:41:06.751 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:06.751 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:06.751 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:06.751 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.975963+0000", 2024-09-13T06:41:06.751 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000112689 2024-09-13T06:41:06.751 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:06.751 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:06.751 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:06.751 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.976107+0000", 2024-09-13T06:41:06.751 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000143836 2024-09-13T06:41:06.751 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:06.751 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:06.751 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:06.752 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:06.752 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:06.752 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18793 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 5840896~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:41:06.752 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.874401+0000", 2024-09-13T06:41:06.752 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 74.817322871000002, 2024-09-13T06:41:06.752 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.102005516, 2024-09-13T06:41:06.752 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:06.752 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:06.752 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:06.752 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:06.752 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:06.752 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18793 2024-09-13T06:41:06.752 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:06.753 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:06.753 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:06.753 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:06.753 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874401+0000", 2024-09-13T06:41:06.753 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:06.753 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:06.753 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:06.753 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:06.753 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874401+0000", 2024-09-13T06:41:06.753 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:06.753 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:06.753 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:06.753 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:06.754 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874400+0000", 2024-09-13T06:41:06.754 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:06.754 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:06.754 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:06.754 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:06.754 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874404+0000", 2024-09-13T06:41:06.754 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0069999999999999e-06 2024-09-13T06:41:06.754 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:06.754 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:06.754 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:06.754 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874412+0000", 2024-09-13T06:41:06.754 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.5399999999999996e-06 2024-09-13T06:41:06.754 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:06.754 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:06.755 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:06.755 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874420+0000", 2024-09-13T06:41:06.755 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.6199999999999999e-06 2024-09-13T06:41:06.755 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:06.755 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:06.755 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:06.755 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.976150+0000", 2024-09-13T06:41:06.755 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101729874 2024-09-13T06:41:06.755 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:06.755 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:06.755 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:06.755 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.976261+0000", 2024-09-13T06:41:06.755 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000110819 2024-09-13T06:41:06.755 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:06.756 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:06.756 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:06.756 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.976406+0000", 2024-09-13T06:41:06.756 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000145489 2024-09-13T06:41:06.756 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:06.756 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:06.756 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:06.756 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:06.756 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:06.756 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18803 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 6127616~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:41:06.756 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.877851+0000", 2024-09-13T06:41:06.756 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 74.813872377999999, 2024-09-13T06:41:06.756 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101951584, 2024-09-13T06:41:06.756 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:06.757 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:06.757 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:06.757 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:06.757 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:06.757 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18803 2024-09-13T06:41:06.757 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:06.757 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:06.757 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:06.757 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:06.757 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.877851+0000", 2024-09-13T06:41:06.757 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:06.757 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:06.757 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:06.757 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:06.758 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.877851+0000", 2024-09-13T06:41:06.758 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:06.758 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:06.758 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:06.758 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:06.758 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.877851+0000", 2024-09-13T06:41:06.758 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:06.758 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:06.758 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:06.758 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:06.758 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.877854+0000", 2024-09-13T06:41:06.758 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.7929999999999999e-06 2024-09-13T06:41:06.759 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:06.759 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:06.759 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:06.759 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.877864+0000", 2024-09-13T06:41:06.759 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.2029999999999998e-06 2024-09-13T06:41:06.759 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:06.759 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:06.759 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:06.759 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.877873+0000", 2024-09-13T06:41:06.759 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.0440000000000001e-06 2024-09-13T06:41:06.759 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:06.759 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:06.759 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:06.760 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.979544+0000", 2024-09-13T06:41:06.760 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101671198 2024-09-13T06:41:06.760 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:06.760 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:06.760 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:06.760 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.979658+0000", 2024-09-13T06:41:06.760 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000114456 2024-09-13T06:41:06.760 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:06.760 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:06.760 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:06.760 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.979803+0000", 2024-09-13T06:41:06.760 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000144506 2024-09-13T06:41:06.760 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:06.760 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:06.761 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:06.761 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:06.761 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:06.761 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18807 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 6242304~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:41:06.761 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.879235+0000", 2024-09-13T06:41:06.761 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 74.812488348000002, 2024-09-13T06:41:06.761 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101781258, 2024-09-13T06:41:06.761 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:06.761 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:06.761 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:06.761 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:06.761 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:06.761 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18807 2024-09-13T06:41:06.761 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:06.762 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:06.762 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:06.762 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:06.762 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879235+0000", 2024-09-13T06:41:06.762 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:06.762 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:06.762 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:06.762 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:06.762 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879235+0000", 2024-09-13T06:41:06.762 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:06.762 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:06.762 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:06.762 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:06.763 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879235+0000", 2024-09-13T06:41:06.763 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:06.763 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:06.763 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:06.763 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:06.763 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879239+0000", 2024-09-13T06:41:06.763 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.963e-06 2024-09-13T06:41:06.763 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:06.763 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:06.763 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:06.763 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879247+0000", 2024-09-13T06:41:06.763 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6470000000000004e-06 2024-09-13T06:41:06.763 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:06.763 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:06.764 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:06.764 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879255+0000", 2024-09-13T06:41:06.764 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5429999999999996e-06 2024-09-13T06:41:06.764 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:06.764 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:06.764 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:06.764 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.980756+0000", 2024-09-13T06:41:06.764 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10150165999999999 2024-09-13T06:41:06.764 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:06.764 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:06.764 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:06.764 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.980868+0000", 2024-09-13T06:41:06.764 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000111196 2024-09-13T06:41:06.765 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:06.765 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:06.765 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:06.765 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.981017+0000", 2024-09-13T06:41:06.765 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000148846 2024-09-13T06:41:06.765 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:06.765 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:06.765 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:06.765 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:06.765 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:06.765 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18808 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 6270976~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:41:06.765 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.879261+0000", 2024-09-13T06:41:06.765 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 74.812462209000003, 2024-09-13T06:41:06.765 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.102057547, 2024-09-13T06:41:06.766 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:06.766 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:06.766 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:06.766 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:06.766 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:06.766 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18808 2024-09-13T06:41:06.766 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:06.766 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:06.766 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:06.766 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:06.766 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879261+0000", 2024-09-13T06:41:06.766 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:06.766 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:06.766 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:06.767 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:06.767 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879261+0000", 2024-09-13T06:41:06.767 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:06.767 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:06.767 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:06.767 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:06.767 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879261+0000", 2024-09-13T06:41:06.767 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:06.767 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:06.767 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:06.767 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:06.767 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879264+0000", 2024-09-13T06:41:06.767 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.523e-06 2024-09-13T06:41:06.768 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:06.768 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:06.768 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:06.768 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879273+0000", 2024-09-13T06:41:06.768 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6070000000000008e-06 2024-09-13T06:41:06.768 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:06.768 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:06.768 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:06.768 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879280+0000", 2024-09-13T06:41:06.768 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.4699999999999996e-06 2024-09-13T06:41:06.768 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:06.768 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:06.768 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:06.769 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.981060+0000", 2024-09-13T06:41:06.769 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10177934800000001 2024-09-13T06:41:06.769 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:06.769 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:06.769 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:06.769 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.981174+0000", 2024-09-13T06:41:06.769 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000114456 2024-09-13T06:41:06.769 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:06.769 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:06.769 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:06.769 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.981319+0000", 2024-09-13T06:41:06.769 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00014473900000000001 2024-09-13T06:41:06.769 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:06.769 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:06.770 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:06.770 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:06.770 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:06.770 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18810 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 2662400~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:41:06.770 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.880386+0000", 2024-09-13T06:41:06.770 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 74.811338047000007, 2024-09-13T06:41:06.770 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101728022, 2024-09-13T06:41:06.770 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:06.770 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:06.770 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:06.770 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:06.770 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:06.770 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18810 2024-09-13T06:41:06.770 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:06.771 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:06.771 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:06.771 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:06.771 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880386+0000", 2024-09-13T06:41:06.771 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:06.771 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:06.771 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:06.771 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:06.771 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880386+0000", 2024-09-13T06:41:06.771 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:06.771 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:06.771 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:06.771 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:06.772 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880385+0000", 2024-09-13T06:41:06.772 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:06.772 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:06.772 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:06.772 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:06.772 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880389+0000", 2024-09-13T06:41:06.772 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.8539999999999999e-06 2024-09-13T06:41:06.772 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:06.772 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:06.772 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:06.772 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880398+0000", 2024-09-13T06:41:06.772 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.1689999999999998e-06 2024-09-13T06:41:06.772 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:06.772 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:06.773 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:06.773 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880405+0000", 2024-09-13T06:41:06.773 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5700000000000004e-06 2024-09-13T06:41:06.773 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:06.773 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:06.773 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:06.773 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.981833+0000", 2024-09-13T06:41:06.773 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10142791800000001 2024-09-13T06:41:06.773 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:06.773 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:06.773 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:06.773 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.981973+0000", 2024-09-13T06:41:06.773 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00014002900000000001 2024-09-13T06:41:06.773 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:06.774 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:06.774 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:06.774 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.982114+0000", 2024-09-13T06:41:06.774 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000140276 2024-09-13T06:41:06.774 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:06.774 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:06.774 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:06.774 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:06.774 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:06.774 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18811 3.9 3.140f5209 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:41:06.774 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.880449+0000", 2024-09-13T06:41:06.774 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 74.811274671000007, 2024-09-13T06:41:06.774 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101739355, 2024-09-13T06:41:06.774 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:06.774 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:41:06.775 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:06.775 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:06.775 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:06.775 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18811 2024-09-13T06:41:06.775 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:06.775 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:06.775 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:06.775 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:06.775 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880449+0000", 2024-09-13T06:41:06.775 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:06.775 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:06.775 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:06.775 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:06.775 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880449+0000", 2024-09-13T06:41:06.776 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:06.776 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:06.776 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:06.776 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:06.776 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880448+0000", 2024-09-13T06:41:06.776 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:06.776 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:06.776 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:06.776 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:06.776 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880452+0000", 2024-09-13T06:41:06.776 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0470000000000004e-06 2024-09-13T06:41:06.776 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:06.776 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:06.776 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:06.776 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880462+0000", 2024-09-13T06:41:06.777 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6530000000000006e-06 2024-09-13T06:41:06.777 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:06.777 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:06.777 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:06.777 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880472+0000", 2024-09-13T06:41:06.777 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0027000000000001e-05 2024-09-13T06:41:06.777 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:06.777 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:06.777 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:06.777 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.982172+0000", 2024-09-13T06:41:06.777 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10170043500000001 2024-09-13T06:41:06.777 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:06.777 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:06.777 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:06.778 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.982188+0000", 2024-09-13T06:41:06.778 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6172999999999999e-05 2024-09-13T06:41:06.778 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:06.778 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:06.778 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:06.778 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:06.778 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:06.778 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18812 3.9 3.140f5209 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:41:06.778 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.880478+0000", 2024-09-13T06:41:06.778 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 74.811245434, 2024-09-13T06:41:06.778 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10177795100000001, 2024-09-13T06:41:06.778 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:06.779 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:41:06.779 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:06.779 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:06.779 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:06.779 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18812 2024-09-13T06:41:06.779 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:06.779 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:06.779 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:06.779 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:06.779 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880478+0000", 2024-09-13T06:41:06.779 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:06.779 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:06.779 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:06.779 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:06.779 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880478+0000", 2024-09-13T06:41:06.780 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:06.780 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:06.780 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:06.780 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:06.780 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880477+0000", 2024-09-13T06:41:06.780 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:06.780 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:06.780 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:06.780 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:06.780 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880481+0000", 2024-09-13T06:41:06.780 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.827e-06 2024-09-13T06:41:06.780 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:06.780 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:06.780 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:06.781 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880490+0000", 2024-09-13T06:41:06.781 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6100000000000006e-06 2024-09-13T06:41:06.781 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:06.781 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:06.781 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:06.781 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880497+0000", 2024-09-13T06:41:06.781 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.7030000000000006e-06 2024-09-13T06:41:06.781 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:06.781 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:06.781 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:06.781 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.982241+0000", 2024-09-13T06:41:06.781 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10174351199999999 2024-09-13T06:41:06.781 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:06.781 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:06.782 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:06.782 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.982256+0000", 2024-09-13T06:41:06.782 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5143000000000001e-05 2024-09-13T06:41:06.782 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:06.782 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:06.782 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:06.782 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:06.782 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:06.782 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:41:06.783 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-13T06:41:06.784 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:41:06.783+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:41:06.884 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:41:06.884+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:41:06.975 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:41:06.975 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [], 2024-09-13T06:41:06.975 INFO:teuthology.orchestra.run.smithi139.stdout: "num_ops": 0 2024-09-13T06:41:06.975 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:41:06.984 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:41:06.983+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:41:06.992 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-13T06:41:07.085 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-13T06:41:07.084+0000 7f86a5f06640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26387) UID: 0 2024-09-13T06:41:07.163 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:41:07.163 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [], 2024-09-13T06:41:07.163 INFO:teuthology.orchestra.run.smithi139.stdout: "complaint_time": 30, 2024-09-13T06:41:07.164 INFO:teuthology.orchestra.run.smithi139.stdout: "num_blocked_ops": 0 2024-09-13T06:41:07.164 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:41:07.177 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-13T06:41:07.186 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:41:07.187+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:41:07.287 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:41:07.287+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:41:07.343 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:41:07.343 INFO:teuthology.orchestra.run.smithi139.stdout: "size": 20, 2024-09-13T06:41:07.343 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 600, 2024-09-13T06:41:07.343 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [ 2024-09-13T06:41:07.343 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:07.344 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43282 3.1d 3:bd80bfb3:::rbd_object_map.11212f44bfb1.0000000000000020:head [call rbd.object_map_update in=20b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:07.344 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589032+0000", 2024-09-13T06:41:07.344 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 45.753137287000001, 2024-09-13T06:41:07.344 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.076225263000000001, 2024-09-13T06:41:07.344 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:07.344 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:41:07.344 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:07.344 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:07.344 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:07.344 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43282 2024-09-13T06:41:07.344 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:07.344 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:07.344 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:07.345 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:07.345 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589032+0000", 2024-09-13T06:41:07.345 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:07.345 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:07.345 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:07.345 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:07.345 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589032+0000", 2024-09-13T06:41:07.345 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:07.345 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:07.345 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:07.345 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:07.345 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589031+0000", 2024-09-13T06:41:07.345 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:07.346 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:07.346 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:07.346 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:07.346 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589036+0000", 2024-09-13T06:41:07.346 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.2619999999999998e-06 2024-09-13T06:41:07.346 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:07.346 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:07.346 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:07.346 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589046+0000", 2024-09-13T06:41:07.346 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.8099999999999992e-06 2024-09-13T06:41:07.346 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:07.346 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:07.346 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:07.346 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589054+0000", 2024-09-13T06:41:07.347 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.2230000000000007e-06 2024-09-13T06:41:07.347 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:07.347 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:07.347 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:07.347 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.660691+0000", 2024-09-13T06:41:07.347 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.07163659 2024-09-13T06:41:07.347 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:07.347 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:07.347 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:07.347 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.660850+0000", 2024-09-13T06:41:07.347 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00015864300000000001 2024-09-13T06:41:07.347 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:07.347 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:07.348 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 4", 2024-09-13T06:41:07.348 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.661729+0000", 2024-09-13T06:41:07.348 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00087956099999999995 2024-09-13T06:41:07.348 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:07.348 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:07.348 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:41:07.348 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.664409+0000", 2024-09-13T06:41:07.348 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0026803479999999999 2024-09-13T06:41:07.348 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:07.348 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:07.348 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-13T06:41:07.348 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.665088+0000", 2024-09-13T06:41:07.348 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00067901400000000003 2024-09-13T06:41:07.348 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:07.348 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:07.349 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-13T06:41:07.349 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.665181+0000", 2024-09-13T06:41:07.349 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.2050000000000001e-05 2024-09-13T06:41:07.349 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:07.349 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:07.349 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:07.349 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.665257+0000", 2024-09-13T06:41:07.349 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.6698000000000003e-05 2024-09-13T06:41:07.349 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:07.349 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:07.349 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:07.349 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:07.349 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:07.349 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43288 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 270336~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:07.350 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589449+0000", 2024-09-13T06:41:07.350 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 45.752720035000003, 2024-09-13T06:41:07.350 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.074906773999999995, 2024-09-13T06:41:07.350 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:07.350 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:07.350 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:07.350 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:07.350 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:07.350 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43288 2024-09-13T06:41:07.350 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:07.350 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:07.350 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:07.350 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:07.351 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589449+0000", 2024-09-13T06:41:07.351 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:07.351 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:07.351 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:07.351 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:07.351 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589449+0000", 2024-09-13T06:41:07.351 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:07.351 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:07.351 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:07.351 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:07.351 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589449+0000", 2024-09-13T06:41:07.351 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:07.351 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:07.351 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:07.352 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:07.352 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589452+0000", 2024-09-13T06:41:07.352 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.5769999999999998e-06 2024-09-13T06:41:07.352 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:07.352 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:07.352 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:07.352 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589461+0000", 2024-09-13T06:41:07.352 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.5720000000000003e-06 2024-09-13T06:41:07.352 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:07.352 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:07.352 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:07.352 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589468+0000", 2024-09-13T06:41:07.352 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5859999999999999e-06 2024-09-13T06:41:07.352 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:07.353 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:07.353 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:07.353 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.663827+0000", 2024-09-13T06:41:07.353 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.074358704999999997 2024-09-13T06:41:07.353 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:07.353 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:07.353 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:07.353 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.664011+0000", 2024-09-13T06:41:07.353 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00018381699999999999 2024-09-13T06:41:07.353 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:07.353 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:07.353 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:07.353 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.664356+0000", 2024-09-13T06:41:07.354 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00034510999999999998 2024-09-13T06:41:07.354 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:07.354 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:07.354 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:07.354 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:07.354 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:07.354 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43289 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 284672~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:07.354 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589475+0000", 2024-09-13T06:41:07.354 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 45.752694636999998, 2024-09-13T06:41:07.354 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.075789117000000003, 2024-09-13T06:41:07.354 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:07.354 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:07.354 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:07.354 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:07.354 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:07.354 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43289 2024-09-13T06:41:07.355 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:07.355 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:07.355 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:07.355 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:07.355 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589475+0000", 2024-09-13T06:41:07.355 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:07.355 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:07.355 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:07.355 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:07.355 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589475+0000", 2024-09-13T06:41:07.355 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:07.355 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:07.355 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:07.355 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:07.356 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589474+0000", 2024-09-13T06:41:07.356 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:07.356 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:07.356 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:07.356 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:07.356 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589477+0000", 2024-09-13T06:41:07.356 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.7929999999999999e-06 2024-09-13T06:41:07.356 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:07.356 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:07.356 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:07.356 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589486+0000", 2024-09-13T06:41:07.356 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.4989999999999994e-06 2024-09-13T06:41:07.356 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:07.357 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:07.357 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:07.357 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589493+0000", 2024-09-13T06:41:07.357 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5329999999999997e-06 2024-09-13T06:41:07.357 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:07.357 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:07.357 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:07.357 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.664456+0000", 2024-09-13T06:41:07.357 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.074962794999999999 2024-09-13T06:41:07.357 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:07.357 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:07.357 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:07.357 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.664653+0000", 2024-09-13T06:41:07.357 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000197107 2024-09-13T06:41:07.358 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:07.358 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:07.358 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:07.358 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.665264+0000", 2024-09-13T06:41:07.358 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00061037600000000004 2024-09-13T06:41:07.358 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:07.358 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:07.358 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:07.358 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:07.358 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:07.358 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43290 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 299008~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:07.358 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589500+0000", 2024-09-13T06:41:07.358 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 45.752669124999997, 2024-09-13T06:41:07.359 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.075898564000000002, 2024-09-13T06:41:07.359 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:07.359 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:07.359 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:07.359 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:07.359 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:07.359 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43290 2024-09-13T06:41:07.359 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:07.359 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:07.359 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:07.359 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:07.359 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589500+0000", 2024-09-13T06:41:07.359 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:07.359 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:07.360 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:07.360 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:07.360 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589500+0000", 2024-09-13T06:41:07.360 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:07.360 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:07.360 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:07.360 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:07.360 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589499+0000", 2024-09-13T06:41:07.360 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:07.360 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:07.360 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:07.360 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:07.360 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589503+0000", 2024-09-13T06:41:07.360 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.8330000000000004e-06 2024-09-13T06:41:07.361 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:07.361 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:07.361 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:07.361 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589511+0000", 2024-09-13T06:41:07.361 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.3359999999999995e-06 2024-09-13T06:41:07.361 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:07.361 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:07.361 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:07.361 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589519+0000", 2024-09-13T06:41:07.361 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.4760000000000001e-06 2024-09-13T06:41:07.361 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:07.361 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:07.361 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:07.362 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.665097+0000", 2024-09-13T06:41:07.362 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.075577828999999999 2024-09-13T06:41:07.362 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:07.362 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:07.362 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:07.362 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.665170+0000", 2024-09-13T06:41:07.362 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.3745000000000006e-05 2024-09-13T06:41:07.362 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:07.362 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:07.362 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:07.362 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.665399+0000", 2024-09-13T06:41:07.362 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00022826199999999999 2024-09-13T06:41:07.362 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:07.362 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:07.363 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:07.363 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:07.363 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:07.363 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43291 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 313344~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:07.363 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589560+0000", 2024-09-13T06:41:07.363 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 45.752608903999999, 2024-09-13T06:41:07.363 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.076145594999999996, 2024-09-13T06:41:07.363 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:07.363 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:07.363 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:07.363 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:07.363 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:07.363 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43291 2024-09-13T06:41:07.363 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:07.363 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:07.364 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:07.364 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:07.364 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589560+0000", 2024-09-13T06:41:07.364 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:07.364 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:07.364 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:07.364 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:07.364 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589560+0000", 2024-09-13T06:41:07.364 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:07.364 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:07.364 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:07.364 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:07.364 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589559+0000", 2024-09-13T06:41:07.365 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:07.365 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:07.365 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:07.365 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:07.365 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589564+0000", 2024-09-13T06:41:07.365 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.3989999999999997e-06 2024-09-13T06:41:07.365 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:07.365 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:07.365 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:07.365 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589574+0000", 2024-09-13T06:41:07.365 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0502999999999999e-05 2024-09-13T06:41:07.365 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:07.365 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:07.366 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:07.366 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589582+0000", 2024-09-13T06:41:07.366 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.1859999999999992e-06 2024-09-13T06:41:07.366 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:07.366 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:07.366 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:07.366 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.665423+0000", 2024-09-13T06:41:07.366 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.075840290000000005 2024-09-13T06:41:07.366 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:07.366 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:07.366 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:07.366 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.665496+0000", 2024-09-13T06:41:07.366 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.2791000000000002e-05 2024-09-13T06:41:07.366 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:07.366 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:07.366 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:07.367 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.665706+0000", 2024-09-13T06:41:07.367 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00021038200000000001 2024-09-13T06:41:07.367 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:07.367 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:07.367 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:07.367 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:07.367 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:07.367 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43292 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 327680~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:07.367 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589589+0000", 2024-09-13T06:41:07.367 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 45.752580363, 2024-09-13T06:41:07.367 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.076769537999999998, 2024-09-13T06:41:07.367 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:07.367 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:07.368 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:07.368 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:07.368 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:07.368 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43292 2024-09-13T06:41:07.368 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:07.368 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:07.368 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:07.368 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:07.368 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589589+0000", 2024-09-13T06:41:07.368 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:07.368 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:07.368 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:07.368 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:07.369 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589589+0000", 2024-09-13T06:41:07.369 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:07.369 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:07.369 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:07.369 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:07.369 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589588+0000", 2024-09-13T06:41:07.369 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:07.369 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:07.369 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:07.369 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:07.369 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589592+0000", 2024-09-13T06:41:07.369 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.6389999999999998e-06 2024-09-13T06:41:07.369 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:07.370 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:07.370 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:07.370 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589600+0000", 2024-09-13T06:41:07.370 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.4630000000000001e-06 2024-09-13T06:41:07.370 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:07.370 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:07.370 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:07.370 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589608+0000", 2024-09-13T06:41:07.370 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.2359999999999998e-06 2024-09-13T06:41:07.370 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:07.370 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:07.370 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:07.370 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.665779+0000", 2024-09-13T06:41:07.370 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.076170924000000001 2024-09-13T06:41:07.370 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:07.371 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:07.371 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:07.371 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.665977+0000", 2024-09-13T06:41:07.371 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00019891900000000001 2024-09-13T06:41:07.371 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:07.371 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:07.371 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:07.371 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.666358+0000", 2024-09-13T06:41:07.371 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000380963 2024-09-13T06:41:07.371 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:07.371 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:07.371 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:07.371 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:07.372 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:07.372 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43293 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 342016~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:07.372 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589616+0000", 2024-09-13T06:41:07.372 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 45.752553468999999, 2024-09-13T06:41:07.372 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.077030083999999999, 2024-09-13T06:41:07.372 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:07.372 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:07.372 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:07.372 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:07.372 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:07.372 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43293 2024-09-13T06:41:07.372 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:07.372 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:07.372 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:07.373 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:07.373 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589616+0000", 2024-09-13T06:41:07.373 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:07.373 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:07.373 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:07.373 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:07.373 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589616+0000", 2024-09-13T06:41:07.373 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:07.373 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:07.373 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:07.373 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:07.373 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589615+0000", 2024-09-13T06:41:07.373 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:07.374 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:07.374 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:07.374 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:07.374 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589619+0000", 2024-09-13T06:41:07.374 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.9559999999999999e-06 2024-09-13T06:41:07.374 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:07.374 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:07.374 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:07.374 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589627+0000", 2024-09-13T06:41:07.374 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.2490000000000001e-06 2024-09-13T06:41:07.374 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:07.374 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:07.374 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:07.374 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589635+0000", 2024-09-13T06:41:07.375 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.96e-06 2024-09-13T06:41:07.375 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:07.375 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:07.375 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:07.375 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.666379+0000", 2024-09-13T06:41:07.375 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.076744484000000002 2024-09-13T06:41:07.375 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:07.375 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:07.375 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:07.375 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.666454+0000", 2024-09-13T06:41:07.375 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.4623999999999996e-05 2024-09-13T06:41:07.375 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:07.375 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:07.375 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:07.376 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.666646+0000", 2024-09-13T06:41:07.376 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00019176999999999999 2024-09-13T06:41:07.376 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:07.376 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:07.376 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:07.376 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:07.376 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:07.376 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43294 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 356352~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:07.376 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589681+0000", 2024-09-13T06:41:07.376 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 45.752488153999998, 2024-09-13T06:41:07.376 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.077594648000000002, 2024-09-13T06:41:07.376 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:07.376 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:07.377 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:07.377 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:07.377 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:07.377 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43294 2024-09-13T06:41:07.377 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:07.377 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:07.377 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:07.377 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:07.377 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589681+0000", 2024-09-13T06:41:07.377 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:07.377 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:07.377 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:07.377 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:07.378 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589681+0000", 2024-09-13T06:41:07.378 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:07.378 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:07.378 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:07.378 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:07.378 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589680+0000", 2024-09-13T06:41:07.378 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:07.378 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:07.378 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:07.378 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:07.378 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589684+0000", 2024-09-13T06:41:07.378 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.8369999999999999e-06 2024-09-13T06:41:07.378 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:07.378 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:07.379 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:07.379 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589693+0000", 2024-09-13T06:41:07.379 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.1020000000000003e-06 2024-09-13T06:41:07.379 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:07.379 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:07.379 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:07.379 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589701+0000", 2024-09-13T06:41:07.379 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.8059999999999995e-06 2024-09-13T06:41:07.379 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:07.379 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:07.379 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:07.379 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.666714+0000", 2024-09-13T06:41:07.379 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.077013463000000004 2024-09-13T06:41:07.379 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:07.380 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:07.380 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:07.380 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.666897+0000", 2024-09-13T06:41:07.380 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000182268 2024-09-13T06:41:07.380 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:07.380 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:07.380 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:07.380 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.667276+0000", 2024-09-13T06:41:07.380 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00037907499999999998 2024-09-13T06:41:07.380 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:07.380 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:07.380 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:07.380 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:07.381 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:07.381 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43295 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 370688~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:07.381 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589744+0000", 2024-09-13T06:41:07.381 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 45.752424982000001, 2024-09-13T06:41:07.381 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.077854343000000006, 2024-09-13T06:41:07.381 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:07.381 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:07.381 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:07.381 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:07.381 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:07.381 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43295 2024-09-13T06:41:07.381 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:07.381 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:07.381 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:07.382 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:07.382 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589744+0000", 2024-09-13T06:41:07.382 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:07.382 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:07.382 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:07.382 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:07.382 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589744+0000", 2024-09-13T06:41:07.382 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:07.382 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:07.382 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:07.382 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:07.382 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589743+0000", 2024-09-13T06:41:07.382 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:07.382 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:07.383 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:07.383 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:07.383 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589747+0000", 2024-09-13T06:41:07.383 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0130000000000004e-06 2024-09-13T06:41:07.383 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:07.383 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:07.383 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:07.383 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589756+0000", 2024-09-13T06:41:07.383 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.003e-06 2024-09-13T06:41:07.383 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:07.383 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:07.383 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:07.383 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589766+0000", 2024-09-13T06:41:07.383 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.2820000000000002e-06 2024-09-13T06:41:07.384 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:07.384 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:07.384 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:07.384 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.667300+0000", 2024-09-13T06:41:07.384 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.077534299000000001 2024-09-13T06:41:07.384 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:07.384 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:07.384 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:07.384 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.667372+0000", 2024-09-13T06:41:07.384 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.2393999999999998e-05 2024-09-13T06:41:07.384 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:07.384 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:07.384 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:07.384 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.667599+0000", 2024-09-13T06:41:07.385 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000226269 2024-09-13T06:41:07.385 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:07.385 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:07.385 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:07.385 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:07.385 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:07.385 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43296 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 385024~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:07.385 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589772+0000", 2024-09-13T06:41:07.385 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 45.752396957999999, 2024-09-13T06:41:07.385 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.078469647000000003, 2024-09-13T06:41:07.385 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:07.385 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:07.386 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:07.386 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:07.386 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:07.386 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43296 2024-09-13T06:41:07.386 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:07.386 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:07.386 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:07.386 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:07.386 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589772+0000", 2024-09-13T06:41:07.386 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:07.386 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:07.386 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:07.386 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:07.386 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589772+0000", 2024-09-13T06:41:07.386 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:07.387 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:07.387 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:07.387 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:07.387 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589771+0000", 2024-09-13T06:41:07.387 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:07.387 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:07.387 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:07.387 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:07.387 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589775+0000", 2024-09-13T06:41:07.387 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.8530000000000002e-06 2024-09-13T06:41:07.387 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:07.387 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:07.387 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:07.387 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589784+0000", 2024-09-13T06:41:07.388 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.4300000000000006e-06 2024-09-13T06:41:07.388 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:07.388 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:07.388 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:07.388 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589791+0000", 2024-09-13T06:41:07.388 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.4660000000000002e-06 2024-09-13T06:41:07.388 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:07.388 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:07.388 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:07.388 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.667667+0000", 2024-09-13T06:41:07.388 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.077875697999999993 2024-09-13T06:41:07.388 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:07.388 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:07.388 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:07.389 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.667854+0000", 2024-09-13T06:41:07.389 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00018760099999999999 2024-09-13T06:41:07.389 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:07.389 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:07.389 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:07.389 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.668242+0000", 2024-09-13T06:41:07.389 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00038750600000000003 2024-09-13T06:41:07.389 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:07.389 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:07.389 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:07.389 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:07.389 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:07.389 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43297 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 403456~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:07.390 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589797+0000", 2024-09-13T06:41:07.390 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 45.752372254000001, 2024-09-13T06:41:07.390 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.078756672999999999, 2024-09-13T06:41:07.390 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:07.390 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:07.390 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:07.390 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:07.390 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:07.390 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43297 2024-09-13T06:41:07.390 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:07.390 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:07.390 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:07.390 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:07.391 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589797+0000", 2024-09-13T06:41:07.391 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:07.391 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:07.391 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:07.391 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:07.391 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589797+0000", 2024-09-13T06:41:07.391 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:07.391 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:07.391 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:07.391 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:07.391 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589796+0000", 2024-09-13T06:41:07.391 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:07.391 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:07.391 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:07.392 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:07.392 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589800+0000", 2024-09-13T06:41:07.392 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.3230000000000002e-06 2024-09-13T06:41:07.392 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:07.392 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:07.392 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:07.392 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589808+0000", 2024-09-13T06:41:07.392 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.2390000000000002e-06 2024-09-13T06:41:07.392 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:07.392 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:07.392 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:07.392 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589815+0000", 2024-09-13T06:41:07.392 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.413e-06 2024-09-13T06:41:07.393 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:07.393 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:07.393 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:07.393 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.668265+0000", 2024-09-13T06:41:07.393 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.078449873000000003 2024-09-13T06:41:07.393 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:07.393 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:07.393 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:07.393 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.668332+0000", 2024-09-13T06:41:07.393 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.7178e-05 2024-09-13T06:41:07.393 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:07.393 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:07.393 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:07.393 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.668554+0000", 2024-09-13T06:41:07.394 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00022128600000000001 2024-09-13T06:41:07.394 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:07.394 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:07.394 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:07.394 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:07.394 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:07.394 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43298 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 417792~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:07.394 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589821+0000", 2024-09-13T06:41:07.394 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 45.752348132000002, 2024-09-13T06:41:07.394 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.079368660999999993, 2024-09-13T06:41:07.394 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:07.394 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:07.394 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:07.394 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:07.395 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:07.395 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43298 2024-09-13T06:41:07.395 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:07.395 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:07.395 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:07.395 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:07.395 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589821+0000", 2024-09-13T06:41:07.395 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:07.395 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:07.395 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:07.395 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:07.395 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589821+0000", 2024-09-13T06:41:07.395 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:07.395 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:07.396 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:07.396 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:07.396 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589821+0000", 2024-09-13T06:41:07.396 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:07.396 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:07.396 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:07.396 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:07.396 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589830+0000", 2024-09-13T06:41:07.396 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.4860000000000003e-06 2024-09-13T06:41:07.396 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:07.396 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:07.396 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:07.396 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589839+0000", 2024-09-13T06:41:07.396 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.0159999999999997e-06 2024-09-13T06:41:07.397 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:07.397 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:07.397 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:07.397 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589847+0000", 2024-09-13T06:41:07.397 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.6059999999999997e-06 2024-09-13T06:41:07.397 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:07.397 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:07.397 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:07.397 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.668620+0000", 2024-09-13T06:41:07.397 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.078773485000000004 2024-09-13T06:41:07.397 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:07.397 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:07.397 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:07.398 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.668798+0000", 2024-09-13T06:41:07.398 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000178233 2024-09-13T06:41:07.398 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:07.398 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:07.398 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:07.398 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.669190+0000", 2024-09-13T06:41:07.398 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00039143499999999998 2024-09-13T06:41:07.398 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:07.398 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:07.398 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:07.398 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:07.398 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:07.398 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43299 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 432128~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:07.399 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589881+0000", 2024-09-13T06:41:07.399 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 45.752288284000002, 2024-09-13T06:41:07.400 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.079693849999999997, 2024-09-13T06:41:07.400 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:07.400 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:07.400 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:07.400 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:07.400 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:07.400 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43299 2024-09-13T06:41:07.400 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:07.400 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:07.400 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:07.400 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:07.400 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589881+0000", 2024-09-13T06:41:07.401 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:07.401 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:07.401 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:07.401 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:07.401 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589881+0000", 2024-09-13T06:41:07.401 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:07.401 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:07.401 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:07.401 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:07.401 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589880+0000", 2024-09-13T06:41:07.401 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:07.401 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:07.401 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:07.402 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:07.402 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589884+0000", 2024-09-13T06:41:07.402 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.053e-06 2024-09-13T06:41:07.402 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:07.402 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:07.402 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:07.402 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589893+0000", 2024-09-13T06:41:07.402 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.2129999999999997e-06 2024-09-13T06:41:07.402 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:07.402 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:07.402 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:07.402 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589901+0000", 2024-09-13T06:41:07.402 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.6399999999999997e-06 2024-09-13T06:41:07.403 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:07.403 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:07.403 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:07.403 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.669213+0000", 2024-09-13T06:41:07.403 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.079312074999999996 2024-09-13T06:41:07.403 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:07.403 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:07.403 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:07.403 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.669281+0000", 2024-09-13T06:41:07.403 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.8322000000000001e-05 2024-09-13T06:41:07.403 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:07.403 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:07.403 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:07.403 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.669575+0000", 2024-09-13T06:41:07.403 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00029349699999999999 2024-09-13T06:41:07.404 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:07.404 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:07.404 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:07.404 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:07.404 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:07.404 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43300 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 446464~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:07.404 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589909+0000", 2024-09-13T06:41:07.404 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 45.752260389, 2024-09-13T06:41:07.404 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.080339496999999996, 2024-09-13T06:41:07.404 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:07.404 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:07.404 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:07.404 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:07.405 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:07.405 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43300 2024-09-13T06:41:07.405 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:07.405 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:07.405 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:07.405 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:07.405 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589909+0000", 2024-09-13T06:41:07.405 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:07.405 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:07.405 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:07.405 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:07.405 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589909+0000", 2024-09-13T06:41:07.405 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:07.405 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:07.406 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:07.406 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:07.406 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589908+0000", 2024-09-13T06:41:07.406 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:07.406 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:07.406 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:07.406 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:07.406 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589912+0000", 2024-09-13T06:41:07.406 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.9430000000000002e-06 2024-09-13T06:41:07.406 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:07.406 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:07.406 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:07.406 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589920+0000", 2024-09-13T06:41:07.407 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.3860000000000007e-06 2024-09-13T06:41:07.407 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:07.407 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:07.407 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:07.407 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589928+0000", 2024-09-13T06:41:07.407 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.3329999999999999e-06 2024-09-13T06:41:07.407 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:07.407 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:07.407 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:07.407 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.669651+0000", 2024-09-13T06:41:07.407 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.079723204000000006 2024-09-13T06:41:07.407 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:07.407 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:07.407 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:07.408 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.669840+0000", 2024-09-13T06:41:07.408 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000189397 2024-09-13T06:41:07.408 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:07.408 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:07.408 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:07.408 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.670248+0000", 2024-09-13T06:41:07.408 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00040811100000000001 2024-09-13T06:41:07.408 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:07.408 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:07.408 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:07.408 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:07.408 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:07.408 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43301 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 460800~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:07.409 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589934+0000", 2024-09-13T06:41:07.409 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 45.752235714999998, 2024-09-13T06:41:07.409 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.080747474999999999, 2024-09-13T06:41:07.409 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:07.409 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:07.409 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:07.409 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:07.409 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:07.409 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43301 2024-09-13T06:41:07.409 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:07.409 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:07.409 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:07.409 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:07.409 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589934+0000", 2024-09-13T06:41:07.409 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:07.410 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:07.410 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:07.410 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:07.410 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589934+0000", 2024-09-13T06:41:07.410 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:07.410 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:07.410 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:07.410 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:07.410 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589933+0000", 2024-09-13T06:41:07.410 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:07.410 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:07.410 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:07.410 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:07.410 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589936+0000", 2024-09-13T06:41:07.411 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.4599999999999999e-06 2024-09-13T06:41:07.411 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:07.411 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:07.411 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:07.411 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589945+0000", 2024-09-13T06:41:07.411 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.2430000000000005e-06 2024-09-13T06:41:07.411 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:07.411 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:07.411 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:07.411 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589952+0000", 2024-09-13T06:41:07.411 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.3289999999999996e-06 2024-09-13T06:41:07.411 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:07.411 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:07.411 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:07.412 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.670280+0000", 2024-09-13T06:41:07.412 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.080328514000000004 2024-09-13T06:41:07.412 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:07.412 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:07.412 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:07.412 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.670376+0000", 2024-09-13T06:41:07.412 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.5752000000000001e-05 2024-09-13T06:41:07.412 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:07.412 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:07.412 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:07.412 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.670681+0000", 2024-09-13T06:41:07.412 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00030479699999999999 2024-09-13T06:41:07.412 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:07.413 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:07.413 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:07.413 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:07.413 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:07.413 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43302 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 475136~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:07.413 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589958+0000", 2024-09-13T06:41:07.413 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 45.752211653000003, 2024-09-13T06:41:07.413 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.081402394000000003, 2024-09-13T06:41:07.413 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:07.413 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:07.413 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:07.413 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:07.413 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:07.413 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43302 2024-09-13T06:41:07.414 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:07.414 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:07.414 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:07.414 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:07.414 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589958+0000", 2024-09-13T06:41:07.414 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:07.414 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:07.414 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:07.414 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:07.414 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589958+0000", 2024-09-13T06:41:07.414 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:07.414 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:07.414 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:07.415 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:07.415 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589957+0000", 2024-09-13T06:41:07.415 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:07.415 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:07.415 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:07.415 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:07.415 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589960+0000", 2024-09-13T06:41:07.415 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.4939999999999999e-06 2024-09-13T06:41:07.415 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:07.415 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:07.415 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:07.415 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589969+0000", 2024-09-13T06:41:07.415 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.3520000000000007e-06 2024-09-13T06:41:07.415 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:07.416 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:07.416 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:07.416 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589976+0000", 2024-09-13T06:41:07.416 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.3030000000000002e-06 2024-09-13T06:41:07.416 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:07.416 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:07.416 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:07.416 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.670765+0000", 2024-09-13T06:41:07.416 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.080789154000000002 2024-09-13T06:41:07.416 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:07.416 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:07.416 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:07.416 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.670960+0000", 2024-09-13T06:41:07.417 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00019464300000000001 2024-09-13T06:41:07.417 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:07.417 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:07.417 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:07.417 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.671360+0000", 2024-09-13T06:41:07.417 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00040005200000000002 2024-09-13T06:41:07.417 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:07.417 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:07.417 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:07.417 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:07.417 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:07.417 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43303 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 489472~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:07.417 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589985+0000", 2024-09-13T06:41:07.417 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 45.752184704999998, 2024-09-13T06:41:07.418 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.082024333000000005, 2024-09-13T06:41:07.418 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:07.418 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:07.418 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:07.418 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:07.418 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:07.418 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43303 2024-09-13T06:41:07.418 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:07.418 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:07.418 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:07.418 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:07.418 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589985+0000", 2024-09-13T06:41:07.418 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:07.419 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:07.419 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:07.419 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:07.419 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589985+0000", 2024-09-13T06:41:07.419 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:07.419 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:07.419 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:07.419 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:07.419 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589984+0000", 2024-09-13T06:41:07.419 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:07.419 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:07.419 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:07.419 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:07.419 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589987+0000", 2024-09-13T06:41:07.419 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.726e-06 2024-09-13T06:41:07.420 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:07.420 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:07.420 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:07.420 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589996+0000", 2024-09-13T06:41:07.420 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.5459999999999992e-06 2024-09-13T06:41:07.420 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:07.420 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:07.420 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:07.420 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590003+0000", 2024-09-13T06:41:07.420 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.4229999999999999e-06 2024-09-13T06:41:07.420 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:07.420 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:07.420 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:07.420 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.671426+0000", 2024-09-13T06:41:07.421 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.081422704999999998 2024-09-13T06:41:07.421 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:07.421 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:07.421 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:07.421 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.671615+0000", 2024-09-13T06:41:07.421 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000188875 2024-09-13T06:41:07.421 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:07.421 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:07.421 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:07.421 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.672009+0000", 2024-09-13T06:41:07.421 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000394015 2024-09-13T06:41:07.421 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:07.421 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:07.421 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:07.422 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:07.422 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:07.422 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43304 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 503808~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:07.422 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.590039+0000", 2024-09-13T06:41:07.422 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 45.75213016, 2024-09-13T06:41:07.422 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.082573880000000002, 2024-09-13T06:41:07.422 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:07.422 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:07.422 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:07.422 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:07.422 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:07.422 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43304 2024-09-13T06:41:07.422 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:07.422 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:07.423 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:07.423 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:07.423 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590039+0000", 2024-09-13T06:41:07.423 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:07.423 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:07.423 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:07.423 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:07.423 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590039+0000", 2024-09-13T06:41:07.423 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:07.423 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:07.423 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:07.423 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:07.423 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590038+0000", 2024-09-13T06:41:07.423 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:07.424 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:07.424 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:07.424 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:07.424 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590042+0000", 2024-09-13T06:41:07.424 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.9500000000000003e-06 2024-09-13T06:41:07.424 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:07.424 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:07.424 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:07.424 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590052+0000", 2024-09-13T06:41:07.424 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.3919999999999992e-06 2024-09-13T06:41:07.424 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:07.424 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:07.425 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:07.425 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590059+0000", 2024-09-13T06:41:07.425 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.7970000000000001e-06 2024-09-13T06:41:07.425 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:07.425 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:07.425 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:07.425 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.672078+0000", 2024-09-13T06:41:07.425 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.082018778000000001 2024-09-13T06:41:07.425 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:07.425 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:07.425 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:07.425 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.672266+0000", 2024-09-13T06:41:07.425 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00018807399999999999 2024-09-13T06:41:07.426 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:07.426 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:07.426 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:07.426 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.672613+0000", 2024-09-13T06:41:07.426 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00034677599999999997 2024-09-13T06:41:07.426 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:07.426 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:07.426 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:07.426 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:07.426 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:07.426 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43305 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 518144~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:07.426 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.590136+0000", 2024-09-13T06:41:07.426 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 45.752032972000002, 2024-09-13T06:41:07.427 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.082988206999999994, 2024-09-13T06:41:07.427 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:07.427 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:07.427 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:07.427 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:07.427 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:07.427 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43305 2024-09-13T06:41:07.427 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:07.427 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:07.427 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:07.427 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:07.427 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590136+0000", 2024-09-13T06:41:07.427 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:07.428 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:07.428 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:07.428 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:07.428 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590136+0000", 2024-09-13T06:41:07.428 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:07.428 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:07.428 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:07.428 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:07.428 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590135+0000", 2024-09-13T06:41:07.428 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:07.428 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:07.428 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:07.428 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:07.429 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590139+0000", 2024-09-13T06:41:07.429 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.9489999999999998e-06 2024-09-13T06:41:07.429 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:07.429 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:07.429 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:07.429 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590148+0000", 2024-09-13T06:41:07.429 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.9830000000000002e-06 2024-09-13T06:41:07.429 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:07.429 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:07.429 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:07.429 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590156+0000", 2024-09-13T06:41:07.429 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5229999999999998e-06 2024-09-13T06:41:07.429 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:07.429 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:07.430 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:07.430 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.672709+0000", 2024-09-13T06:41:07.430 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.082552886000000006 2024-09-13T06:41:07.430 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:07.430 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:07.430 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:07.430 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.672816+0000", 2024-09-13T06:41:07.430 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000107736 2024-09-13T06:41:07.430 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:07.430 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:07.430 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:07.430 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.673124+0000", 2024-09-13T06:41:07.430 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00030804900000000002 2024-09-13T06:41:07.431 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:07.431 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:07.431 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:07.431 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:07.431 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:07.431 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:66818 3.17 3.50afe697 (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e100)", 2024-09-13T06:41:07.431 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:53.498942+0000", 2024-09-13T06:41:07.431 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 13.843226787000001, 2024-09-13T06:41:07.431 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.011231284, 2024-09-13T06:41:07.431 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:07.431 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:41:07.431 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:07.431 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:07.432 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:07.432 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 66818 2024-09-13T06:41:07.432 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:07.432 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:07.432 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:07.432 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:07.432 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:53.498942+0000", 2024-09-13T06:41:07.432 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:07.432 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:07.432 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:07.432 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:07.432 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:53.498942+0000", 2024-09-13T06:41:07.432 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:07.432 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:07.433 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:07.433 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:07.433 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:53.498939+0000", 2024-09-13T06:41:07.433 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999967 2024-09-13T06:41:07.433 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:07.433 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:07.433 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:07.433 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:53.498954+0000", 2024-09-13T06:41:07.433 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5028000000000001e-05 2024-09-13T06:41:07.433 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:07.433 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:07.433 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:07.433 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:53.498986+0000", 2024-09-13T06:41:07.433 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.1993999999999999e-05 2024-09-13T06:41:07.434 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:07.434 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:07.434 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:07.434 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:53.499001+0000", 2024-09-13T06:41:07.434 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5166e-05 2024-09-13T06:41:07.434 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:07.434 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:07.434 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:07.434 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:53.505097+0000", 2024-09-13T06:41:07.434 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0060955610000000002 2024-09-13T06:41:07.434 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:07.434 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:07.434 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:41:07.434 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:53.505108+0000", 2024-09-13T06:41:07.435 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.084e-05 2024-09-13T06:41:07.435 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:07.435 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:07.435 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:07.435 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:54.510158+0000", 2024-09-13T06:41:07.435 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0050497549999999 2024-09-13T06:41:07.435 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:07.435 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:07.435 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:07.435 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:54.510174+0000", 2024-09-13T06:41:07.435 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6164e-05 2024-09-13T06:41:07.435 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:07.435 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:07.436 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:07.436 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:07.436 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:07.436 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:41:07.437 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-13T06:41:07.438 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:41:07.436+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:41:07.538 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:41:07.536+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:41:07.608 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:41:07.608 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [], 2024-09-13T06:41:07.608 INFO:teuthology.orchestra.run.smithi139.stdout: "num_ops": 0 2024-09-13T06:41:07.608 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:41:07.620 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-13T06:41:07.636 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-13T06:41:07.649 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:41:07.639+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:41:07.740 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:41:07.740+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:41:07.785 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:41:07.785 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [], 2024-09-13T06:41:07.785 INFO:teuthology.orchestra.run.smithi139.stdout: "complaint_time": 30, 2024-09-13T06:41:07.785 INFO:teuthology.orchestra.run.smithi139.stdout: "num_blocked_ops": 0 2024-09-13T06:41:07.785 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:41:07.799 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-13T06:41:07.841 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:41:07.839+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:41:07.942 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:41:07.943+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:41:07.969 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:41:07.969 INFO:teuthology.orchestra.run.smithi139.stdout: "size": 20, 2024-09-13T06:41:07.969 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 600, 2024-09-13T06:41:07.969 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [ 2024-09-13T06:41:07.969 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:07.970 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27854 3.a 3:537b3559:::rbd_data.1121f2c5ee81.0000000000000016:13 [read 335872~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:07.970 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.658750+0000", 2024-09-13T06:41:07.970 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 71.309833443000002, 2024-09-13T06:41:07.970 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.037969532, 2024-09-13T06:41:07.970 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:07.970 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:07.970 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:07.970 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:07.970 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:07.970 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27854 2024-09-13T06:41:07.970 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:07.970 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:07.970 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:07.971 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:07.971 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658750+0000", 2024-09-13T06:41:07.971 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:07.971 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:07.971 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:07.971 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:07.971 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658750+0000", 2024-09-13T06:41:07.971 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:07.971 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:07.971 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:07.971 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:07.971 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658749+0000", 2024-09-13T06:41:07.971 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:07.971 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:07.971 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:07.972 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:07.972 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658757+0000", 2024-09-13T06:41:07.972 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.7389999999999999e-06 2024-09-13T06:41:07.972 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:07.972 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:07.972 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:07.972 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658763+0000", 2024-09-13T06:41:07.972 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.7769999999999999e-06 2024-09-13T06:41:07.972 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:07.972 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:07.972 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:07.972 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658767+0000", 2024-09-13T06:41:07.972 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.1749999999999998e-06 2024-09-13T06:41:07.973 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:07.973 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:07.973 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:07.973 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.696322+0000", 2024-09-13T06:41:07.973 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.037554772 2024-09-13T06:41:07.973 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:07.973 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:07.973 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:07.973 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.696418+0000", 2024-09-13T06:41:07.973 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6050000000000004e-05 2024-09-13T06:41:07.973 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:07.973 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:07.973 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:07.974 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.696719+0000", 2024-09-13T06:41:07.974 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00030138499999999999 2024-09-13T06:41:07.974 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:07.974 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:07.974 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:07.974 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:07.974 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:07.974 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27855 3.a 3:537b3559:::rbd_data.1121f2c5ee81.0000000000000016:13 [read 380928~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:07.974 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.658771+0000", 2024-09-13T06:41:07.974 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 71.309812199000007, 2024-09-13T06:41:07.974 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.038326354, 2024-09-13T06:41:07.974 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:07.974 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:07.974 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:07.975 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:07.975 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:07.975 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27855 2024-09-13T06:41:07.975 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:07.975 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:07.975 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:07.975 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:07.975 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658771+0000", 2024-09-13T06:41:07.975 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:07.975 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:07.975 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:07.975 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:07.975 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658771+0000", 2024-09-13T06:41:07.975 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:07.976 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:07.976 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:07.976 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:07.976 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658770+0000", 2024-09-13T06:41:07.976 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:07.976 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:07.976 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:07.976 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:07.976 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658772+0000", 2024-09-13T06:41:07.976 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.0930000000000001e-06 2024-09-13T06:41:07.976 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:07.976 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:07.976 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:07.976 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658778+0000", 2024-09-13T06:41:07.977 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.2730000000000002e-06 2024-09-13T06:41:07.977 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:07.977 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:07.977 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:07.977 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658782+0000", 2024-09-13T06:41:07.977 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0879999999999997e-06 2024-09-13T06:41:07.977 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:07.977 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:07.977 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:07.977 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.696770+0000", 2024-09-13T06:41:07.977 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.037988145000000001 2024-09-13T06:41:07.977 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:07.977 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:07.977 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:07.978 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.696852+0000", 2024-09-13T06:41:07.978 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.2039999999999994e-05 2024-09-13T06:41:07.978 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:07.978 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:07.978 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:07.978 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.697097+0000", 2024-09-13T06:41:07.978 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00024508800000000002 2024-09-13T06:41:07.978 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:07.978 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:07.978 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:07.978 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:07.978 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:07.978 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27856 3.a 3:537b3559:::rbd_data.1121f2c5ee81.0000000000000016:13 [read 405504~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:07.978 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.658786+0000", 2024-09-13T06:41:07.978 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 71.309797083000007, 2024-09-13T06:41:07.979 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.038736029999999998, 2024-09-13T06:41:07.979 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:07.979 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:07.979 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:07.979 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:07.979 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:07.979 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27856 2024-09-13T06:41:07.979 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:07.979 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:07.979 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:07.979 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:07.979 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658786+0000", 2024-09-13T06:41:07.979 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:07.979 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:07.980 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:07.980 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:07.980 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658786+0000", 2024-09-13T06:41:07.980 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:07.980 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:07.980 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:07.980 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:07.980 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658785+0000", 2024-09-13T06:41:07.980 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:07.980 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:07.980 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:07.980 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:07.980 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658787+0000", 2024-09-13T06:41:07.980 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.0040000000000002e-06 2024-09-13T06:41:07.980 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:07.981 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:07.981 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:07.981 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658793+0000", 2024-09-13T06:41:07.981 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.2410000000000003e-06 2024-09-13T06:41:07.981 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:07.981 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:07.981 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:07.981 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658797+0000", 2024-09-13T06:41:07.981 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.1330000000000001e-06 2024-09-13T06:41:07.981 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:07.981 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:07.981 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:07.981 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.697176+0000", 2024-09-13T06:41:07.982 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.038379074999999999 2024-09-13T06:41:07.982 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:07.982 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:07.982 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:07.982 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.697275+0000", 2024-09-13T06:41:07.982 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.8819000000000004e-05 2024-09-13T06:41:07.982 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:07.982 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:07.982 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:07.982 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.697522+0000", 2024-09-13T06:41:07.982 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00024719999999999999 2024-09-13T06:41:07.982 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:07.982 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:07.982 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:07.982 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:07.983 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:07.983 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27857 3.a 3:537b3559:::rbd_data.1121f2c5ee81.0000000000000016:13 [read 475136~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:07.983 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.658845+0000", 2024-09-13T06:41:07.983 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 71.309738080000002, 2024-09-13T06:41:07.983 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039112570999999999, 2024-09-13T06:41:07.983 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:07.983 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:07.983 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:07.983 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:07.983 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:07.983 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27857 2024-09-13T06:41:07.983 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:07.983 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:07.983 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:07.984 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:07.984 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658845+0000", 2024-09-13T06:41:07.984 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:07.984 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:07.984 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:07.984 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:07.984 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658845+0000", 2024-09-13T06:41:07.984 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:07.984 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:07.985 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:07.985 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:07.985 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658844+0000", 2024-09-13T06:41:07.985 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999986 2024-09-13T06:41:07.985 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:07.985 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:07.985 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:07.985 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658868+0000", 2024-09-13T06:41:07.985 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.4615000000000001e-05 2024-09-13T06:41:07.985 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:07.985 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:07.985 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:07.985 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658884+0000", 2024-09-13T06:41:07.986 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5401999999999999e-05 2024-09-13T06:41:07.986 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:07.986 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:07.986 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:07.986 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658896+0000", 2024-09-13T06:41:07.986 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2509e-05 2024-09-13T06:41:07.986 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:07.986 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:07.986 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:07.986 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.697571+0000", 2024-09-13T06:41:07.986 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.038675107 2024-09-13T06:41:07.986 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:07.986 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:07.986 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:07.987 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.697658+0000", 2024-09-13T06:41:07.987 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6349999999999998e-05 2024-09-13T06:41:07.987 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:07.987 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:07.987 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:07.987 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.697957+0000", 2024-09-13T06:41:07.987 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00029986100000000001 2024-09-13T06:41:07.987 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:07.987 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:07.987 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:07.987 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:07.987 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:07.987 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27858 3.a 3:537b3559:::rbd_data.1121f2c5ee81.0000000000000016:13 [read 499712~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:07.988 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.658905+0000", 2024-09-13T06:41:07.988 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 71.309677530000002, 2024-09-13T06:41:07.988 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039475392999999998, 2024-09-13T06:41:07.988 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:07.988 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:07.988 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:07.988 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:07.988 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:07.988 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27858 2024-09-13T06:41:07.989 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:07.989 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:07.989 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:07.989 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:07.989 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658905+0000", 2024-09-13T06:41:07.989 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:07.989 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:07.989 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:07.989 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:07.989 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658905+0000", 2024-09-13T06:41:07.989 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:07.989 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:07.990 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:07.990 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:07.990 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658905+0000", 2024-09-13T06:41:07.990 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:07.990 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:07.990 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:07.990 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:07.990 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658909+0000", 2024-09-13T06:41:07.990 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.831e-06 2024-09-13T06:41:07.990 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:07.990 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:07.990 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:07.990 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658920+0000", 2024-09-13T06:41:07.990 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0936e-05 2024-09-13T06:41:07.991 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:07.991 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:07.991 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:07.991 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658929+0000", 2024-09-13T06:41:07.991 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.2749999999999995e-06 2024-09-13T06:41:07.991 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:07.991 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:07.991 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:07.991 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.697990+0000", 2024-09-13T06:41:07.991 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039061625000000003 2024-09-13T06:41:07.991 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:07.991 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:07.991 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:07.992 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.698077+0000", 2024-09-13T06:41:07.992 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6922000000000006e-05 2024-09-13T06:41:07.992 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:07.992 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:07.992 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:07.992 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.698381+0000", 2024-09-13T06:41:07.992 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00030360599999999999 2024-09-13T06:41:07.992 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:07.992 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:07.992 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:07.992 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:07.992 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:07.992 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27929 3.a 3:537b3559:::rbd_data.1121f2c5ee81.0000000000000016:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:07.992 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.659338+0000", 2024-09-13T06:41:07.993 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 71.309244699000004, 2024-09-13T06:41:07.993 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039351214000000002, 2024-09-13T06:41:07.993 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:07.993 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:07.993 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:07.993 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:07.993 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:07.993 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27929 2024-09-13T06:41:07.993 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:07.993 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:07.993 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:07.993 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:07.993 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.659338+0000", 2024-09-13T06:41:07.993 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:07.994 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:07.994 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:07.994 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:07.994 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.659338+0000", 2024-09-13T06:41:07.994 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:07.994 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:07.994 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:07.994 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:07.994 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.659337+0000", 2024-09-13T06:41:07.994 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:07.994 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:07.994 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:07.995 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:07.995 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.659342+0000", 2024-09-13T06:41:07.995 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0799999999999999e-06 2024-09-13T06:41:07.995 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:07.995 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:07.995 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:07.995 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.659353+0000", 2024-09-13T06:41:07.995 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1798e-05 2024-09-13T06:41:07.995 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:07.995 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:07.995 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:07.995 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.659361+0000", 2024-09-13T06:41:07.996 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.8040000000000002e-06 2024-09-13T06:41:07.996 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:07.996 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:07.996 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:07.996 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.698449+0000", 2024-09-13T06:41:07.996 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039087519000000001 2024-09-13T06:41:07.996 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:07.996 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:07.996 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:07.996 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.698567+0000", 2024-09-13T06:41:07.996 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00011857 2024-09-13T06:41:07.996 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:07.996 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:07.997 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:07.997 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.698689+0000", 2024-09-13T06:41:07.997 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00012226699999999999 2024-09-13T06:41:07.997 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:07.997 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:07.997 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:07.997 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:07.997 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:07.997 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27974 3.a 3:537b3559:::rbd_data.1121f2c5ee81.0000000000000016:13 [read 32768~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:07.997 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.660102+0000", 2024-09-13T06:41:07.997 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 71.308480931000005, 2024-09-13T06:41:07.997 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.038972346999999997, 2024-09-13T06:41:07.997 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:07.998 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:07.998 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:07.998 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:07.998 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:07.998 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27974 2024-09-13T06:41:07.998 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:07.998 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:07.998 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:07.998 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:07.998 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660102+0000", 2024-09-13T06:41:07.998 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:07.998 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:07.999 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:07.999 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:07.999 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660102+0000", 2024-09-13T06:41:07.999 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:07.999 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:07.999 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:07.999 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:07.999 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660100+0000", 2024-09-13T06:41:07.999 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999976 2024-09-13T06:41:07.999 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:07.999 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:07.999 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:07.999 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660114+0000", 2024-09-13T06:41:07.999 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.4466e-05 2024-09-13T06:41:08.000 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.000 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.000 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:08.000 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660148+0000", 2024-09-13T06:41:08.000 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.3742999999999999e-05 2024-09-13T06:41:08.000 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.000 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.000 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:08.000 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660170+0000", 2024-09-13T06:41:08.000 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.2518e-05 2024-09-13T06:41:08.000 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.000 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.001 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:08.001 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.698719+0000", 2024-09-13T06:41:08.001 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.038548529999999998 2024-09-13T06:41:08.001 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.001 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.001 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:08.001 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.698806+0000", 2024-09-13T06:41:08.001 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.7179e-05 2024-09-13T06:41:08.001 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.001 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.001 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:08.001 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.699074+0000", 2024-09-13T06:41:08.001 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00026834800000000001 2024-09-13T06:41:08.002 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:08.002 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:08.002 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:08.002 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.002 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.002 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27975 3.a 3:537b3559:::rbd_data.1121f2c5ee81.0000000000000016:13 [read 57344~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:08.002 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.660189+0000", 2024-09-13T06:41:08.002 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 71.308394086999996, 2024-09-13T06:41:08.002 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039288678, 2024-09-13T06:41:08.002 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:08.002 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:08.002 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:08.002 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:08.003 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:08.003 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27975 2024-09-13T06:41:08.003 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.003 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:08.003 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.003 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:08.003 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660189+0000", 2024-09-13T06:41:08.003 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:08.003 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.003 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.003 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:08.003 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660189+0000", 2024-09-13T06:41:08.003 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:08.004 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.004 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.004 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:08.004 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660187+0000", 2024-09-13T06:41:08.004 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999981 2024-09-13T06:41:08.004 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.004 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.004 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:08.004 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660195+0000", 2024-09-13T06:41:08.004 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5610000000000001e-06 2024-09-13T06:41:08.004 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.004 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.005 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:08.005 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660212+0000", 2024-09-13T06:41:08.005 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7725999999999999e-05 2024-09-13T06:41:08.005 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.005 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.005 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:08.005 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660227+0000", 2024-09-13T06:41:08.005 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.43e-05 2024-09-13T06:41:08.005 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.005 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.005 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:08.005 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.699135+0000", 2024-09-13T06:41:08.005 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.038908336000000002 2024-09-13T06:41:08.005 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.006 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.006 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:08.006 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.699208+0000", 2024-09-13T06:41:08.006 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.3065000000000006e-05 2024-09-13T06:41:08.006 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.006 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.006 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:08.006 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.699478+0000", 2024-09-13T06:41:08.006 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00026946899999999999 2024-09-13T06:41:08.006 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:08.006 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:08.006 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:08.006 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.006 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.007 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27976 3.a 3:537b3559:::rbd_data.1121f2c5ee81.0000000000000016:13 [read 102400~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:08.007 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.660238+0000", 2024-09-13T06:41:08.007 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 71.308344923999996, 2024-09-13T06:41:08.007 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039636515999999997, 2024-09-13T06:41:08.007 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:08.007 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:08.007 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:08.007 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:08.007 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:08.007 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27976 2024-09-13T06:41:08.007 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.007 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:08.007 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.007 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:08.008 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660238+0000", 2024-09-13T06:41:08.008 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:08.008 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.008 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.008 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:08.008 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660238+0000", 2024-09-13T06:41:08.008 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:08.008 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.008 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.008 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:08.008 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660237+0000", 2024-09-13T06:41:08.008 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:08.008 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.009 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.009 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:08.009 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660243+0000", 2024-09-13T06:41:08.009 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.9909999999999999e-06 2024-09-13T06:41:08.009 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.009 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.009 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:08.009 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660259+0000", 2024-09-13T06:41:08.009 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6294e-05 2024-09-13T06:41:08.009 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.009 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.009 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:08.009 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660272+0000", 2024-09-13T06:41:08.010 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2714999999999999e-05 2024-09-13T06:41:08.010 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.010 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.010 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:08.010 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.699513+0000", 2024-09-13T06:41:08.010 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039240932999999999 2024-09-13T06:41:08.010 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.010 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.010 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:08.010 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.699604+0000", 2024-09-13T06:41:08.010 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.1367999999999997e-05 2024-09-13T06:41:08.010 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.010 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.010 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:08.011 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.699875+0000", 2024-09-13T06:41:08.011 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00027029499999999999 2024-09-13T06:41:08.011 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:08.011 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:08.011 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:08.011 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.011 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.011 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27977 3.a 3:537b3559:::rbd_data.1121f2c5ee81.0000000000000016:13 [read 126976~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:08.011 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.660284+0000", 2024-09-13T06:41:08.011 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 71.308299352000006, 2024-09-13T06:41:08.011 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039969945, 2024-09-13T06:41:08.011 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:08.011 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:08.011 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:08.012 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:08.012 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:08.012 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27977 2024-09-13T06:41:08.012 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.012 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:08.012 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.012 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:08.012 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660284+0000", 2024-09-13T06:41:08.012 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:08.012 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.012 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.012 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:08.013 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660284+0000", 2024-09-13T06:41:08.013 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:08.013 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.013 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.013 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:08.013 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660282+0000", 2024-09-13T06:41:08.013 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999986 2024-09-13T06:41:08.013 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.013 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.013 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:08.013 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660288+0000", 2024-09-13T06:41:08.013 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.2650000000000002e-06 2024-09-13T06:41:08.013 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.014 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.014 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:08.014 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660304+0000", 2024-09-13T06:41:08.014 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5430999999999998e-05 2024-09-13T06:41:08.014 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.014 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.014 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:08.014 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660316+0000", 2024-09-13T06:41:08.014 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.237e-05 2024-09-13T06:41:08.016 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.016 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.016 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:08.017 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.699907+0000", 2024-09-13T06:41:08.017 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039590735000000002 2024-09-13T06:41:08.017 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.017 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.017 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:08.017 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.699994+0000", 2024-09-13T06:41:08.017 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6996999999999994e-05 2024-09-13T06:41:08.017 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.017 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.017 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:08.017 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700254+0000", 2024-09-13T06:41:08.017 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000259564 2024-09-13T06:41:08.018 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:08.018 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:08.018 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:08.018 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.018 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.018 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27978 3.a 3.9aacdeca (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:08.018 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.660327+0000", 2024-09-13T06:41:08.018 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 71.308255754000001, 2024-09-13T06:41:08.018 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039984858999999998, 2024-09-13T06:41:08.018 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:08.018 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:41:08.018 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:08.018 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:08.019 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:08.019 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27978 2024-09-13T06:41:08.019 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.019 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:08.019 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.019 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:08.019 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660327+0000", 2024-09-13T06:41:08.019 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:08.019 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.019 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.019 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:08.019 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660327+0000", 2024-09-13T06:41:08.019 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:08.020 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.020 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.020 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:08.020 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660326+0000", 2024-09-13T06:41:08.020 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:08.020 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.020 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.020 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:08.020 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660366+0000", 2024-09-13T06:41:08.020 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.9691000000000003e-05 2024-09-13T06:41:08.020 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.020 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.020 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:08.021 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660399+0000", 2024-09-13T06:41:08.021 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.3262000000000001e-05 2024-09-13T06:41:08.021 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.021 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.021 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:08.021 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660414+0000", 2024-09-13T06:41:08.021 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.4775e-05 2024-09-13T06:41:08.021 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.021 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.021 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:08.021 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700298+0000", 2024-09-13T06:41:08.021 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039883759999999997 2024-09-13T06:41:08.021 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.022 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.022 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:08.022 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700312+0000", 2024-09-13T06:41:08.022 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.4374e-05 2024-09-13T06:41:08.022 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:08.022 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:08.022 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:08.022 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.022 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.022 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27979 3.a 3.9aacdeca (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:08.022 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.660429+0000", 2024-09-13T06:41:08.022 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 71.308153885999999, 2024-09-13T06:41:08.022 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039921361000000002, 2024-09-13T06:41:08.023 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:08.023 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:41:08.023 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:08.023 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:08.023 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:08.023 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27979 2024-09-13T06:41:08.023 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.023 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:08.023 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.023 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:08.023 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660429+0000", 2024-09-13T06:41:08.023 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:08.024 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.024 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.024 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:08.024 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660429+0000", 2024-09-13T06:41:08.024 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:08.024 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.024 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.024 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:08.024 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660428+0000", 2024-09-13T06:41:08.024 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999986 2024-09-13T06:41:08.024 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.024 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.024 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:08.024 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660434+0000", 2024-09-13T06:41:08.025 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.8190000000000003e-06 2024-09-13T06:41:08.025 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.025 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.025 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:08.025 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660451+0000", 2024-09-13T06:41:08.025 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6963e-05 2024-09-13T06:41:08.025 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.025 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.025 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:08.025 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660485+0000", 2024-09-13T06:41:08.025 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.3414000000000002e-05 2024-09-13T06:41:08.025 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.025 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.026 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:08.026 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700342+0000", 2024-09-13T06:41:08.026 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039857278000000003 2024-09-13T06:41:08.026 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.026 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.026 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:08.026 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700350+0000", 2024-09-13T06:41:08.026 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.2930000000000001e-06 2024-09-13T06:41:08.026 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:08.026 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:08.026 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:08.026 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.026 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.027 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27980 3.a 3.9aacdeca (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:08.027 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.660497+0000", 2024-09-13T06:41:08.027 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 71.308085675000001, 2024-09-13T06:41:08.027 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039888034000000003, 2024-09-13T06:41:08.027 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:08.027 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:41:08.027 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:08.027 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:08.027 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:08.027 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27980 2024-09-13T06:41:08.027 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.027 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:08.027 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.027 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:08.028 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660497+0000", 2024-09-13T06:41:08.028 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:08.028 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.028 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.028 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:08.028 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660497+0000", 2024-09-13T06:41:08.028 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:08.028 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.028 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.028 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:08.028 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660496+0000", 2024-09-13T06:41:08.028 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:08.028 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.029 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.029 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:08.029 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660503+0000", 2024-09-13T06:41:08.029 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.4110000000000001e-06 2024-09-13T06:41:08.029 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.029 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.029 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:08.029 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660519+0000", 2024-09-13T06:41:08.029 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6180000000000001e-05 2024-09-13T06:41:08.029 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.029 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.029 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:08.029 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660544+0000", 2024-09-13T06:41:08.030 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.5177999999999998e-05 2024-09-13T06:41:08.030 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.030 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.030 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:08.030 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700377+0000", 2024-09-13T06:41:08.030 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039833434000000001 2024-09-13T06:41:08.030 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.030 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.030 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:08.030 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700385+0000", 2024-09-13T06:41:08.030 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.8800000000000008e-06 2024-09-13T06:41:08.030 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:08.030 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:08.031 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:08.031 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.031 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.031 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27981 3.a 3.9aacdeca (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:08.031 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.660556+0000", 2024-09-13T06:41:08.031 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 71.308027328999998, 2024-09-13T06:41:08.031 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039869989000000002, 2024-09-13T06:41:08.031 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:08.031 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:41:08.031 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:08.031 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:08.031 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:08.031 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27981 2024-09-13T06:41:08.031 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.032 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:08.032 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.032 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:08.032 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660556+0000", 2024-09-13T06:41:08.032 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:08.032 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.032 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.032 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:08.032 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660556+0000", 2024-09-13T06:41:08.032 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:08.032 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.032 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.032 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:08.033 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660555+0000", 2024-09-13T06:41:08.033 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:08.033 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.033 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.033 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:08.033 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660561+0000", 2024-09-13T06:41:08.033 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.088e-06 2024-09-13T06:41:08.033 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.033 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.033 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:08.033 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660577+0000", 2024-09-13T06:41:08.033 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6147999999999999e-05 2024-09-13T06:41:08.033 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.034 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.034 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:08.034 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660589+0000", 2024-09-13T06:41:08.034 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2551999999999999e-05 2024-09-13T06:41:08.034 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.034 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.034 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:08.034 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700414+0000", 2024-09-13T06:41:08.034 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039825007000000003 2024-09-13T06:41:08.034 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.034 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.034 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:08.034 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700426+0000", 2024-09-13T06:41:08.035 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1265e-05 2024-09-13T06:41:08.035 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:08.035 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:08.035 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:08.035 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.035 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.035 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27982 3.a 3.9aacdeca (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:08.035 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.660603+0000", 2024-09-13T06:41:08.035 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 71.307979734, 2024-09-13T06:41:08.035 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039874779999999999, 2024-09-13T06:41:08.035 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:08.035 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:41:08.035 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:08.036 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:08.036 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:08.036 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27982 2024-09-13T06:41:08.036 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.036 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:08.036 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.036 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:08.036 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660603+0000", 2024-09-13T06:41:08.036 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:08.036 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.036 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.036 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:08.036 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660603+0000", 2024-09-13T06:41:08.037 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:08.037 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.037 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.037 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:08.037 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660602+0000", 2024-09-13T06:41:08.037 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:08.037 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.037 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.037 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:08.037 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660653+0000", 2024-09-13T06:41:08.037 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.0862000000000002e-05 2024-09-13T06:41:08.037 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.037 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.038 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:08.038 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660697+0000", 2024-09-13T06:41:08.038 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.3773000000000003e-05 2024-09-13T06:41:08.038 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.038 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.038 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:08.038 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660712+0000", 2024-09-13T06:41:08.038 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5464999999999998e-05 2024-09-13T06:41:08.038 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.038 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.038 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:08.038 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700469+0000", 2024-09-13T06:41:08.038 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039756503999999998 2024-09-13T06:41:08.039 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.039 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.039 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:08.039 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700478+0000", 2024-09-13T06:41:08.039 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.1730000000000001e-06 2024-09-13T06:41:08.039 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:08.039 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:08.039 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:08.039 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.039 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.039 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27983 3.a 3.9aacdeca (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:08.039 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.660726+0000", 2024-09-13T06:41:08.039 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 71.307856459000007, 2024-09-13T06:41:08.040 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039804357999999998, 2024-09-13T06:41:08.040 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:08.040 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:41:08.040 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:08.040 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:08.040 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:08.040 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27983 2024-09-13T06:41:08.040 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.040 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:08.040 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.041 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:08.041 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660726+0000", 2024-09-13T06:41:08.041 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:08.041 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.041 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.041 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:08.041 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660726+0000", 2024-09-13T06:41:08.041 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:08.041 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.041 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.041 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:08.041 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660725+0000", 2024-09-13T06:41:08.041 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999986 2024-09-13T06:41:08.042 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.042 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.042 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:08.042 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660733+0000", 2024-09-13T06:41:08.042 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.9359999999999999e-06 2024-09-13T06:41:08.042 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.042 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.042 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:08.042 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660751+0000", 2024-09-13T06:41:08.042 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7679000000000001e-05 2024-09-13T06:41:08.042 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.042 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.042 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:08.042 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660764+0000", 2024-09-13T06:41:08.043 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3112000000000001e-05 2024-09-13T06:41:08.043 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.043 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.043 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:08.043 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700516+0000", 2024-09-13T06:41:08.043 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039752183000000003 2024-09-13T06:41:08.043 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.043 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.043 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:08.043 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700531+0000", 2024-09-13T06:41:08.043 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.4732999999999999e-05 2024-09-13T06:41:08.043 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:08.043 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:08.044 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:08.044 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.044 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.044 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27984 3.a 3.9aacdeca (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:08.044 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.660776+0000", 2024-09-13T06:41:08.044 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 71.307807355999998, 2024-09-13T06:41:08.044 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039795697999999997, 2024-09-13T06:41:08.044 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:08.044 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:41:08.044 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:08.044 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:08.044 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:08.044 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27984 2024-09-13T06:41:08.045 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.045 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:08.045 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.045 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:08.045 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660776+0000", 2024-09-13T06:41:08.045 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:08.045 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.045 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.045 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:08.045 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660776+0000", 2024-09-13T06:41:08.045 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:08.045 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.045 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.046 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:08.046 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660775+0000", 2024-09-13T06:41:08.046 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:08.046 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.046 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.046 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:08.046 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660780+0000", 2024-09-13T06:41:08.046 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.7849999999999997e-06 2024-09-13T06:41:08.046 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.046 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.046 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:08.046 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660799+0000", 2024-09-13T06:41:08.046 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.8794e-05 2024-09-13T06:41:08.047 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.047 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.047 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:08.047 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660812+0000", 2024-09-13T06:41:08.047 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3029e-05 2024-09-13T06:41:08.047 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.047 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.047 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:08.047 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700562+0000", 2024-09-13T06:41:08.047 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039749984000000002 2024-09-13T06:41:08.047 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.047 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.047 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:08.048 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700571+0000", 2024-09-13T06:41:08.048 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.1260000000000004e-06 2024-09-13T06:41:08.048 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:08.048 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:08.048 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:08.048 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.048 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.048 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27985 3.a 3.9aacdeca (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:08.048 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.660824+0000", 2024-09-13T06:41:08.048 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 71.307759304000001, 2024-09-13T06:41:08.048 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039784462, 2024-09-13T06:41:08.048 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:08.048 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:41:08.049 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:08.049 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:08.049 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:08.049 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27985 2024-09-13T06:41:08.049 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.049 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:08.049 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.049 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:08.049 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660824+0000", 2024-09-13T06:41:08.049 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:08.049 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.049 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.049 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:08.050 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660824+0000", 2024-09-13T06:41:08.050 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:08.050 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.050 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.050 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:08.050 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660823+0000", 2024-09-13T06:41:08.050 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:08.050 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.050 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.050 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:08.050 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660829+0000", 2024-09-13T06:41:08.050 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.9440000000000002e-06 2024-09-13T06:41:08.050 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.051 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.051 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:08.051 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660922+0000", 2024-09-13T06:41:08.051 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.2958e-05 2024-09-13T06:41:08.051 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.051 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.051 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:08.051 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660964+0000", 2024-09-13T06:41:08.051 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.2407000000000002e-05 2024-09-13T06:41:08.051 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.051 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.051 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:08.051 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700600+0000", 2024-09-13T06:41:08.052 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039635581000000003 2024-09-13T06:41:08.052 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.052 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.052 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:08.052 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700608+0000", 2024-09-13T06:41:08.052 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.5890000000000003e-06 2024-09-13T06:41:08.052 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:08.052 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:08.052 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:08.052 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.052 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.052 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:28023 3.10 3:0dedc28a:::rbd_data.1121f2c5ee81.0000000000000019:13 [read 475136~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:08.052 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.662072+0000", 2024-09-13T06:41:08.053 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 71.306511318999995, 2024-09-13T06:41:08.053 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.038086508999999998, 2024-09-13T06:41:08.053 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:08.053 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:08.053 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:08.053 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:08.053 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:08.053 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 28023 2024-09-13T06:41:08.053 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.053 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:08.053 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.053 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:08.053 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.662072+0000", 2024-09-13T06:41:08.054 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:08.054 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.054 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.054 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:08.054 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.662072+0000", 2024-09-13T06:41:08.054 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:08.054 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.054 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.054 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:08.054 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.662070+0000", 2024-09-13T06:41:08.054 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999986 2024-09-13T06:41:08.054 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.054 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.055 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:08.055 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.662076+0000", 2024-09-13T06:41:08.055 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.139e-06 2024-09-13T06:41:08.055 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.055 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.055 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:08.055 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.662094+0000", 2024-09-13T06:41:08.055 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7136999999999999e-05 2024-09-13T06:41:08.055 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.055 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.055 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:08.055 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.662124+0000", 2024-09-13T06:41:08.055 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.0528999999999999e-05 2024-09-13T06:41:08.055 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.056 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.056 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:08.056 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.699843+0000", 2024-09-13T06:41:08.056 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.037718415999999998 2024-09-13T06:41:08.056 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.056 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.056 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:08.056 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.699931+0000", 2024-09-13T06:41:08.056 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.8345999999999997e-05 2024-09-13T06:41:08.056 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.056 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.056 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:08.056 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700158+0000", 2024-09-13T06:41:08.056 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00022723099999999999 2024-09-13T06:41:08.057 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:08.057 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:08.057 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:08.057 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.057 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.057 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:28024 3.10 3.5143b7b0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:08.057 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.662137+0000", 2024-09-13T06:41:08.057 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 71.306445796999995, 2024-09-13T06:41:08.057 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.038056092999999999, 2024-09-13T06:41:08.057 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:08.057 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:41:08.057 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:08.057 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:08.058 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:08.058 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 28024 2024-09-13T06:41:08.058 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.058 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:08.058 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.058 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:08.058 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.662137+0000", 2024-09-13T06:41:08.058 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:08.058 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.058 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.058 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:08.058 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.662137+0000", 2024-09-13T06:41:08.059 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:08.059 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.059 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.059 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:08.059 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.662136+0000", 2024-09-13T06:41:08.059 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999986 2024-09-13T06:41:08.059 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.059 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.059 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:08.059 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.662142+0000", 2024-09-13T06:41:08.059 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.6930000000000001e-06 2024-09-13T06:41:08.059 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.059 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.060 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:08.060 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.662160+0000", 2024-09-13T06:41:08.060 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7863000000000002e-05 2024-09-13T06:41:08.060 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.060 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.060 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:08.060 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.662189+0000", 2024-09-13T06:41:08.060 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.8486000000000001e-05 2024-09-13T06:41:08.060 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.060 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.060 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:08.060 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700187+0000", 2024-09-13T06:41:08.060 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.037998331000000003 2024-09-13T06:41:08.061 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.061 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.061 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:08.061 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700193+0000", 2024-09-13T06:41:08.061 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.0909999999999998e-06 2024-09-13T06:41:08.061 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:08.061 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:08.061 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:08.061 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:08.061 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:08.061 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:41:08.063 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-13T06:41:08.063 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:41:08.060+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:41:08.163 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-13T06:41:08.164+0000 7f86a5f06640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26387) UID: 0 2024-09-13T06:41:08.233 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:41:08.234 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [], 2024-09-13T06:41:08.234 INFO:teuthology.orchestra.run.smithi139.stdout: "num_ops": 0 2024-09-13T06:41:08.234 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:41:08.248 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-13T06:41:08.264 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:41:08.263+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:41:08.365 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:41:08.367+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:41:08.367 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-13T06:41:08.415 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:41:08.416 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [], 2024-09-13T06:41:08.416 INFO:teuthology.orchestra.run.smithi139.stdout: "complaint_time": 30, 2024-09-13T06:41:08.416 INFO:teuthology.orchestra.run.smithi139.stdout: "num_blocked_ops": 0 2024-09-13T06:41:08.416 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:41:08.430 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-13T06:41:08.475 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:41:08.476+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:41:08.521 INFO:teuthology.orchestra.run.smithi081.stdout:osd.0: {} 2024-09-13T06:41:08.521 INFO:teuthology.orchestra.run.smithi081.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-13T06:41:08.537 INFO:teuthology.orchestra.run.smithi081.stdout:osd.1: {} 2024-09-13T06:41:08.537 INFO:teuthology.orchestra.run.smithi081.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-13T06:41:08.552 INFO:teuthology.orchestra.run.smithi081.stdout:osd.2: {} 2024-09-13T06:41:08.553 INFO:teuthology.orchestra.run.smithi081.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-13T06:41:08.554 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:41:08.554 INFO:teuthology.orchestra.run.smithi139.stdout: "size": 20, 2024-09-13T06:41:08.554 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 600, 2024-09-13T06:41:08.554 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [ 2024-09-13T06:41:08.554 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.554 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4154.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-13T06:41:08.554 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:11.143816+0000", 2024-09-13T06:41:08.554 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 117.410712683, 2024-09-13T06:41:08.554 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.062483034, 2024-09-13T06:41:08.554 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:08.554 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:41:08.555 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:08.555 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4154", 2024-09-13T06:41:08.555 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/2406930292", 2024-09-13T06:41:08.555 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 1 2024-09-13T06:41:08.555 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.555 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:08.555 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.555 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:08.555 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.143816+0000", 2024-09-13T06:41:08.555 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:08.555 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.555 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.555 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:08.556 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.143816+0000", 2024-09-13T06:41:08.556 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:08.556 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.556 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.556 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:08.556 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.143814+0000", 2024-09-13T06:41:08.556 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999976 2024-09-13T06:41:08.556 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.556 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.556 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:08.556 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.143829+0000", 2024-09-13T06:41:08.556 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5316999999999999e-05 2024-09-13T06:41:08.556 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.557 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.557 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:08.557 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.143851+0000", 2024-09-13T06:41:08.557 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.1736999999999999e-05 2024-09-13T06:41:08.557 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.557 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.557 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:08.557 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.143870+0000", 2024-09-13T06:41:08.557 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.9185999999999999e-05 2024-09-13T06:41:08.557 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.557 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.557 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:08.557 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.143973+0000", 2024-09-13T06:41:08.558 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000102896 2024-09-13T06:41:08.558 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.558 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.558 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:41:08.558 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.143987+0000", 2024-09-13T06:41:08.558 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.401e-05 2024-09-13T06:41:08.558 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.558 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.558 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:08.558 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.203333+0000", 2024-09-13T06:41:08.558 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.059346614999999998 2024-09-13T06:41:08.558 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.558 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.559 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:08.559 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.203624+0000", 2024-09-13T06:41:08.559 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00029112700000000002 2024-09-13T06:41:08.559 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.559 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.559 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 0", 2024-09-13T06:41:08.559 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.203940+0000", 2024-09-13T06:41:08.559 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00031547200000000002 2024-09-13T06:41:08.559 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.559 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.559 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-13T06:41:08.559 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.205145+0000", 2024-09-13T06:41:08.559 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0012048930000000001 2024-09-13T06:41:08.560 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.560 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.560 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:41:08.560 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.206110+0000", 2024-09-13T06:41:08.560 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00096536600000000005 2024-09-13T06:41:08.560 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.560 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.560 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-13T06:41:08.560 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.206196+0000", 2024-09-13T06:41:08.560 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.5798999999999996e-05 2024-09-13T06:41:08.560 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.560 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.560 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:08.561 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.206299+0000", 2024-09-13T06:41:08.561 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00010279 2024-09-13T06:41:08.561 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:08.561 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:08.561 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:08.561 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.561 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.561 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:608 3.11 3:8ebac99f:::rbd_data.11214e25756e.0000000000000007:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-09-13T06:41:08.561 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:34.801988+0000", 2024-09-13T06:41:08.561 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 93.752540530999994, 2024-09-13T06:41:08.561 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.033916448000000002, 2024-09-13T06:41:08.561 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:08.561 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:41:08.561 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:08.562 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:08.562 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:08.562 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 608 2024-09-13T06:41:08.562 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.562 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:08.562 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.562 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:08.562 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:34.801988+0000", 2024-09-13T06:41:08.562 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:08.562 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.562 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.562 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:08.562 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:34.801988+0000", 2024-09-13T06:41:08.562 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:08.563 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.563 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.563 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:08.563 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:34.801985+0000", 2024-09-13T06:41:08.563 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999976 2024-09-13T06:41:08.563 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.563 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.563 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:08.563 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:34.801999+0000", 2024-09-13T06:41:08.563 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.402e-05 2024-09-13T06:41:08.563 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.563 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.563 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:08.564 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:34.802031+0000", 2024-09-13T06:41:08.564 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.1582999999999999e-05 2024-09-13T06:41:08.564 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.564 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.564 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:08.564 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:34.802052+0000", 2024-09-13T06:41:08.564 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.1310000000000001e-05 2024-09-13T06:41:08.564 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.564 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.564 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:08.564 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:34.802117+0000", 2024-09-13T06:41:08.564 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.5016000000000002e-05 2024-09-13T06:41:08.564 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.565 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.565 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:08.565 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:34.802254+0000", 2024-09-13T06:41:08.565 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000136186 2024-09-13T06:41:08.565 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.565 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.565 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 4", 2024-09-13T06:41:08.565 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:34.807944+0000", 2024-09-13T06:41:08.565 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0056906930000000001 2024-09-13T06:41:08.565 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.565 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.565 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-13T06:41:08.565 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:34.835646+0000", 2024-09-13T06:41:08.565 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.027701546000000001 2024-09-13T06:41:08.566 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.566 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.566 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:41:08.566 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:34.835754+0000", 2024-09-13T06:41:08.566 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000107889 2024-09-13T06:41:08.566 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.566 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.566 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-13T06:41:08.566 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:34.835840+0000", 2024-09-13T06:41:08.566 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6621999999999998e-05 2024-09-13T06:41:08.566 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.566 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.566 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:08.566 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:34.835904+0000", 2024-09-13T06:41:08.567 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.4022999999999993e-05 2024-09-13T06:41:08.567 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:08.567 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:08.567 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:08.567 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.567 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.567 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:47163 3.13 3.ed327d33 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e76)", 2024-09-13T06:41:08.567 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:29.544993+0000", 2024-09-13T06:41:08.567 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 39.009534922, 2024-09-13T06:41:08.567 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.83273406400000005, 2024-09-13T06:41:08.567 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:08.567 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:41:08.567 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:08.567 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:08.568 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:08.568 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 47163 2024-09-13T06:41:08.568 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.568 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:08.568 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.568 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:08.568 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:29.544993+0000", 2024-09-13T06:41:08.568 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:08.568 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.568 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.568 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:08.568 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:29.544993+0000", 2024-09-13T06:41:08.569 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:08.569 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.569 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.569 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:08.569 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:29.544992+0000", 2024-09-13T06:41:08.569 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999981 2024-09-13T06:41:08.569 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.569 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.569 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:08.569 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:29.545001+0000", 2024-09-13T06:41:08.569 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.825e-06 2024-09-13T06:41:08.569 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.569 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.570 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:08.570 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:29.545022+0000", 2024-09-13T06:41:08.570 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.0285e-05 2024-09-13T06:41:08.570 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.570 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.570 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:08.570 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:29.545049+0000", 2024-09-13T06:41:08.570 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.7389000000000002e-05 2024-09-13T06:41:08.570 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.570 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.570 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:08.570 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:29.545153+0000", 2024-09-13T06:41:08.570 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0001043 2024-09-13T06:41:08.570 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.571 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.571 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:41:08.571 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:29.545164+0000", 2024-09-13T06:41:08.571 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0413e-05 2024-09-13T06:41:08.571 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.571 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.571 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:08.571 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:30.377697+0000", 2024-09-13T06:41:08.571 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.832533415 2024-09-13T06:41:08.571 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.571 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.571 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:08.571 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:30.377728+0000", 2024-09-13T06:41:08.572 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.0428000000000001e-05 2024-09-13T06:41:08.572 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:08.572 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:08.572 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:08.572 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.572 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.572 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:54988 3.13 3:ce2ec97c:::rbd_data.11213b441054.000000000000000f:2e [read 475136~32768 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e91)", 2024-09-13T06:41:08.572 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:44.489037+0000", 2024-09-13T06:41:08.572 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 24.065491690000002, 2024-09-13T06:41:08.572 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.025682440000000001, 2024-09-13T06:41:08.572 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:08.572 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:08.572 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:08.573 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:08.573 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:08.573 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 54988 2024-09-13T06:41:08.573 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.573 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:08.573 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.573 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:08.573 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.489037+0000", 2024-09-13T06:41:08.573 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:08.573 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.573 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.573 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:08.574 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.489037+0000", 2024-09-13T06:41:08.574 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:08.574 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.574 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.574 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:08.574 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.489036+0000", 2024-09-13T06:41:08.574 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:08.574 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.574 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.574 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:08.574 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.489042+0000", 2024-09-13T06:41:08.574 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.9490000000000001e-06 2024-09-13T06:41:08.574 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.574 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.575 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:08.575 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.489057+0000", 2024-09-13T06:41:08.575 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5637e-05 2024-09-13T06:41:08.575 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.575 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.575 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:08.575 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.489072+0000", 2024-09-13T06:41:08.575 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.4219000000000001e-05 2024-09-13T06:41:08.575 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.575 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.575 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:08.575 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.513725+0000", 2024-09-13T06:41:08.575 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.024653069999999999 2024-09-13T06:41:08.576 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.576 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.576 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:08.576 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.513909+0000", 2024-09-13T06:41:08.576 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000183878 2024-09-13T06:41:08.576 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.576 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.576 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:08.576 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.514719+0000", 2024-09-13T06:41:08.576 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00081063999999999995 2024-09-13T06:41:08.576 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:08.576 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:08.576 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:08.576 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.577 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.577 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:55033 3.13 3:ce471d87:::rbd_data.11213b441054.0000000000000036:2e [read 131072~32768 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e91)", 2024-09-13T06:41:08.577 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:44.490592+0000", 2024-09-13T06:41:08.577 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 24.063936548000001, 2024-09-13T06:41:08.577 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.024752789000000001, 2024-09-13T06:41:08.577 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:08.577 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:08.577 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:08.577 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:08.577 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:08.577 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 55033 2024-09-13T06:41:08.577 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.577 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:08.578 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.578 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:08.578 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.490592+0000", 2024-09-13T06:41:08.578 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:08.578 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.578 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.578 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:08.578 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.490592+0000", 2024-09-13T06:41:08.578 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:08.578 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.578 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.578 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:08.578 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.490591+0000", 2024-09-13T06:41:08.578 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999986 2024-09-13T06:41:08.579 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.579 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.579 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:08.579 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.490632+0000", 2024-09-13T06:41:08.579 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0964999999999998e-05 2024-09-13T06:41:08.579 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.579 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.579 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:08.579 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.490668+0000", 2024-09-13T06:41:08.579 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.6068000000000001e-05 2024-09-13T06:41:08.579 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.579 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.579 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:08.579 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.490684+0000", 2024-09-13T06:41:08.580 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6728999999999999e-05 2024-09-13T06:41:08.580 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.580 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.580 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:08.580 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.515085+0000", 2024-09-13T06:41:08.580 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.02440022 2024-09-13T06:41:08.580 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.580 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.580 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:08.580 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.515186+0000", 2024-09-13T06:41:08.580 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000101094 2024-09-13T06:41:08.580 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.580 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.581 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:08.581 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.515345+0000", 2024-09-13T06:41:08.581 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00015892900000000001 2024-09-13T06:41:08.581 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:08.581 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:08.581 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:08.581 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.581 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.581 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:55040 3.13 3:cda7a632:::rbd_data.11213b441054.0000000000000003:2e [read 98304~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e91)", 2024-09-13T06:41:08.581 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:44.490818+0000", 2024-09-13T06:41:08.581 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 24.063710087, 2024-09-13T06:41:08.581 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.025155713999999999, 2024-09-13T06:41:08.581 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:08.582 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:08.582 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:08.582 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:08.582 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:08.582 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 55040 2024-09-13T06:41:08.582 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.582 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:08.582 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.582 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:08.582 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.490818+0000", 2024-09-13T06:41:08.582 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:08.582 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.582 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.583 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:08.583 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.490818+0000", 2024-09-13T06:41:08.583 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:08.583 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.583 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.583 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:08.583 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.490817+0000", 2024-09-13T06:41:08.583 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:08.583 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.583 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.583 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:08.583 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.490824+0000", 2024-09-13T06:41:08.583 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.4189999999999999e-06 2024-09-13T06:41:08.583 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.584 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.584 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:08.584 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.490844+0000", 2024-09-13T06:41:08.584 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.0285999999999999e-05 2024-09-13T06:41:08.584 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.584 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.584 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:08.584 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.490858+0000", 2024-09-13T06:41:08.584 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3939e-05 2024-09-13T06:41:08.584 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.584 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.584 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:08.585 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.515395+0000", 2024-09-13T06:41:08.585 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.024537099 2024-09-13T06:41:08.585 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.585 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.585 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:08.585 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.515564+0000", 2024-09-13T06:41:08.585 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00016896899999999999 2024-09-13T06:41:08.585 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.585 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.585 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:08.585 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.515974+0000", 2024-09-13T06:41:08.585 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00041008199999999998 2024-09-13T06:41:08.585 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:08.586 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:08.586 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:08.586 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.586 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.586 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:55041 3.13 3:cda7a632:::rbd_data.11213b441054.0000000000000003:2e [read 409600~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e91)", 2024-09-13T06:41:08.586 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:44.490870+0000", 2024-09-13T06:41:08.586 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 24.063658196999999, 2024-09-13T06:41:08.586 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.025858931000000002, 2024-09-13T06:41:08.586 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:08.586 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:08.586 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:08.586 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:08.586 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:08.586 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 55041 2024-09-13T06:41:08.587 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.587 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:08.587 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.587 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:08.587 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.490870+0000", 2024-09-13T06:41:08.587 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:08.587 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.587 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.587 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:08.587 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.490870+0000", 2024-09-13T06:41:08.587 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:08.587 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.587 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.588 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:08.588 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.490869+0000", 2024-09-13T06:41:08.588 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999986 2024-09-13T06:41:08.588 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.588 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.588 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:08.588 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.490889+0000", 2024-09-13T06:41:08.588 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.9831999999999999e-05 2024-09-13T06:41:08.588 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.588 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.588 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:08.588 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.490970+0000", 2024-09-13T06:41:08.588 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.1623000000000001e-05 2024-09-13T06:41:08.589 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.589 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.589 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:08.589 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.490988+0000", 2024-09-13T06:41:08.589 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7686e-05 2024-09-13T06:41:08.589 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.589 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.589 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:08.589 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.516059+0000", 2024-09-13T06:41:08.589 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.025070571 2024-09-13T06:41:08.589 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.589 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.590 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:08.590 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.516255+0000", 2024-09-13T06:41:08.590 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00019698400000000001 2024-09-13T06:41:08.590 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.590 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.590 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:08.590 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.516729+0000", 2024-09-13T06:41:08.590 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00047365100000000001 2024-09-13T06:41:08.590 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:08.591 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:08.591 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:08.591 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.591 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.591 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:55064 3.13 3:ce2ec97c:::rbd_data.11213b441054.000000000000000f:2e [read 196608~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e91)", 2024-09-13T06:41:08.591 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:44.491003+0000", 2024-09-13T06:41:08.591 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 24.063524942000001, 2024-09-13T06:41:08.591 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.026122157, 2024-09-13T06:41:08.591 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:08.592 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:08.592 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:08.592 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:08.592 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:08.592 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 55064 2024-09-13T06:41:08.592 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.592 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:08.592 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.592 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:08.592 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.491003+0000", 2024-09-13T06:41:08.592 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:08.592 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.592 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.593 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:08.593 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.491003+0000", 2024-09-13T06:41:08.593 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:08.593 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.593 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.593 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:08.593 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.491002+0000", 2024-09-13T06:41:08.593 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999986 2024-09-13T06:41:08.593 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.593 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.593 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:08.593 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.491011+0000", 2024-09-13T06:41:08.593 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.8659999999999995e-06 2024-09-13T06:41:08.594 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.594 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.594 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:08.594 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.491030+0000", 2024-09-13T06:41:08.594 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.9335999999999999e-05 2024-09-13T06:41:08.594 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.594 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.594 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:08.594 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.491044+0000", 2024-09-13T06:41:08.594 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3933e-05 2024-09-13T06:41:08.594 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.594 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.594 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:08.594 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.516803+0000", 2024-09-13T06:41:08.595 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.025758783 2024-09-13T06:41:08.595 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.595 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.595 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:08.595 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.516941+0000", 2024-09-13T06:41:08.595 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000138462 2024-09-13T06:41:08.595 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.595 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.595 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:08.595 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.517126+0000", 2024-09-13T06:41:08.595 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000184384 2024-09-13T06:41:08.595 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:08.596 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:08.596 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:08.596 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.596 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.596 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:55088 3.13 3:cbaea7ae:::rbd_data.11213b441054.0000000000000022:2e [read 81920~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e91)", 2024-09-13T06:41:08.596 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:44.492610+0000", 2024-09-13T06:41:08.596 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 24.061918533, 2024-09-13T06:41:08.596 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.025237315999999999, 2024-09-13T06:41:08.596 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:08.596 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:08.596 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:08.596 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:08.596 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:08.597 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 55088 2024-09-13T06:41:08.597 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.597 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:08.597 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.597 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:08.597 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.492610+0000", 2024-09-13T06:41:08.597 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:08.597 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.597 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.597 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:08.597 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.492610+0000", 2024-09-13T06:41:08.597 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:08.598 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.598 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.598 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:08.598 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.492608+0000", 2024-09-13T06:41:08.598 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999986 2024-09-13T06:41:08.598 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.598 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.598 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:08.598 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.492616+0000", 2024-09-13T06:41:08.598 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.7069999999999992e-06 2024-09-13T06:41:08.598 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.598 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.598 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:08.599 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.492660+0000", 2024-09-13T06:41:08.599 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.3741e-05 2024-09-13T06:41:08.599 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.599 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.599 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:08.599 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.492946+0000", 2024-09-13T06:41:08.599 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00028570499999999998 2024-09-13T06:41:08.599 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.599 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.599 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:08.599 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.517212+0000", 2024-09-13T06:41:08.599 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.024266378000000002 2024-09-13T06:41:08.599 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.600 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.600 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:08.600 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.517375+0000", 2024-09-13T06:41:08.600 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00016321099999999999 2024-09-13T06:41:08.600 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.600 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.600 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:08.600 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.517847+0000", 2024-09-13T06:41:08.600 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00047207400000000001 2024-09-13T06:41:08.600 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:08.600 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:08.600 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:08.600 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.601 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.601 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:55108 3.13 3:ce471d87:::rbd_data.11213b441054.0000000000000036:2e [read 163840~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e91)", 2024-09-13T06:41:08.601 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:44.493024+0000", 2024-09-13T06:41:08.601 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 24.061504748000001, 2024-09-13T06:41:08.601 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.025410097999999999, 2024-09-13T06:41:08.601 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:08.601 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:08.601 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:08.601 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:08.601 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:08.601 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 55108 2024-09-13T06:41:08.601 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.601 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:08.602 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.602 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:08.602 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.493024+0000", 2024-09-13T06:41:08.602 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:08.602 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.602 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.602 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:08.602 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.493024+0000", 2024-09-13T06:41:08.602 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:08.602 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.602 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.602 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:08.602 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.493023+0000", 2024-09-13T06:41:08.602 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:08.603 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.603 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.603 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:08.603 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.493030+0000", 2024-09-13T06:41:08.603 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.4730000000000003e-06 2024-09-13T06:41:08.603 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.603 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.603 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:08.603 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.493047+0000", 2024-09-13T06:41:08.603 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7322000000000001e-05 2024-09-13T06:41:08.603 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.603 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.603 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:08.604 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.493060+0000", 2024-09-13T06:41:08.604 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3087e-05 2024-09-13T06:41:08.604 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.604 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.604 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:08.604 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.517905+0000", 2024-09-13T06:41:08.604 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.024844442000000001 2024-09-13T06:41:08.604 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.604 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.604 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:08.604 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.518037+0000", 2024-09-13T06:41:08.604 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000132607 2024-09-13T06:41:08.604 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.604 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.605 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:08.605 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.518434+0000", 2024-09-13T06:41:08.605 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00039630299999999998 2024-09-13T06:41:08.605 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:08.605 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:08.605 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:08.605 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.605 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.605 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:55115 3.13 3:cda7a632:::rbd_data.11213b441054.0000000000000003:2e [read 114688~32768 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e91)", 2024-09-13T06:41:08.605 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:44.493193+0000", 2024-09-13T06:41:08.605 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 24.061335887999999, 2024-09-13T06:41:08.605 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.025843738000000002, 2024-09-13T06:41:08.605 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:08.605 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:08.606 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:08.606 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:08.606 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:08.606 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 55115 2024-09-13T06:41:08.606 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.606 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:08.606 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.606 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:08.606 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.493193+0000", 2024-09-13T06:41:08.606 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:08.606 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.606 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.606 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:08.606 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.493193+0000", 2024-09-13T06:41:08.607 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:08.607 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.607 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.607 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:08.607 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.493192+0000", 2024-09-13T06:41:08.607 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:08.607 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.607 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.607 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:08.607 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.493196+0000", 2024-09-13T06:41:08.607 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.6729999999999998e-06 2024-09-13T06:41:08.607 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.607 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.608 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:08.608 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.493205+0000", 2024-09-13T06:41:08.608 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.1130000000000007e-06 2024-09-13T06:41:08.608 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.608 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.608 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:08.608 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.493212+0000", 2024-09-13T06:41:08.608 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.1029999999999996e-06 2024-09-13T06:41:08.608 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.608 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.608 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:08.608 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.518524+0000", 2024-09-13T06:41:08.608 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.025312365999999999 2024-09-13T06:41:08.608 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.609 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.609 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:08.609 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.518611+0000", 2024-09-13T06:41:08.609 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6507000000000004e-05 2024-09-13T06:41:08.609 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.609 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.609 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:08.609 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.519036+0000", 2024-09-13T06:41:08.609 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00042558899999999998 2024-09-13T06:41:08.609 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:08.609 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:08.609 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:08.609 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.609 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.610 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:55116 3.13 3:cda7a632:::rbd_data.11213b441054.0000000000000003:2e [read 425984~32768 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e91)", 2024-09-13T06:41:08.610 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:44.493218+0000", 2024-09-13T06:41:08.610 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 24.061310626000001, 2024-09-13T06:41:08.610 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.026213864999999999, 2024-09-13T06:41:08.610 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:08.610 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:08.610 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:08.610 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:08.610 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:08.610 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 55116 2024-09-13T06:41:08.610 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.610 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:08.610 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.610 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:08.611 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.493218+0000", 2024-09-13T06:41:08.611 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:08.611 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.611 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.611 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:08.611 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.493218+0000", 2024-09-13T06:41:08.611 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:08.611 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.611 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.611 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:08.611 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.493217+0000", 2024-09-13T06:41:08.611 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:08.611 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.612 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.612 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:08.612 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.493220+0000", 2024-09-13T06:41:08.612 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.2370000000000001e-06 2024-09-13T06:41:08.612 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.612 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.612 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:08.612 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.493229+0000", 2024-09-13T06:41:08.612 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.9090000000000006e-06 2024-09-13T06:41:08.612 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.612 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.612 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:08.612 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.493251+0000", 2024-09-13T06:41:08.613 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.1739e-05 2024-09-13T06:41:08.613 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.613 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.613 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:08.613 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.519112+0000", 2024-09-13T06:41:08.613 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.025860478999999999 2024-09-13T06:41:08.613 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.613 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.613 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:08.613 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.519258+0000", 2024-09-13T06:41:08.613 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00014618300000000001 2024-09-13T06:41:08.613 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.613 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.613 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:08.614 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.519432+0000", 2024-09-13T06:41:08.614 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000173938 2024-09-13T06:41:08.614 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:08.614 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:08.614 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:08.614 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.614 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.614 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:55135 3.13 3:ce2ec97c:::rbd_data.11213b441054.000000000000000f:2e [read 212992~32768 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e91)", 2024-09-13T06:41:08.614 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:44.493262+0000", 2024-09-13T06:41:08.614 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 24.061266497999998, 2024-09-13T06:41:08.614 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.026775146999999999, 2024-09-13T06:41:08.614 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:08.614 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:08.615 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:08.615 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:08.615 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:08.615 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 55135 2024-09-13T06:41:08.615 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.615 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:08.615 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.615 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:08.615 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.493262+0000", 2024-09-13T06:41:08.615 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:08.615 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.615 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.615 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:08.615 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.493262+0000", 2024-09-13T06:41:08.616 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:08.616 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.616 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.616 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:08.616 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.493261+0000", 2024-09-13T06:41:08.616 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:08.616 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.616 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.616 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:08.616 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.493268+0000", 2024-09-13T06:41:08.616 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.8839999999999997e-06 2024-09-13T06:41:08.616 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.616 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.617 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:08.617 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.493287+0000", 2024-09-13T06:41:08.617 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.9032e-05 2024-09-13T06:41:08.617 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.617 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.617 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:08.617 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.493299+0000", 2024-09-13T06:41:08.617 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2748999999999999e-05 2024-09-13T06:41:08.617 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.618 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.618 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:08.618 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.519501+0000", 2024-09-13T06:41:08.618 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.026201624 2024-09-13T06:41:08.618 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.618 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.618 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:08.618 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.519636+0000", 2024-09-13T06:41:08.618 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000135263 2024-09-13T06:41:08.618 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.618 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.619 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:08.619 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.520037+0000", 2024-09-13T06:41:08.619 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000400725 2024-09-13T06:41:08.619 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:08.619 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:08.619 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:08.619 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.619 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.619 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:55180 3.13 3:ce471d87:::rbd_data.11213b441054.0000000000000036:2e [read 180224~32768 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e91)", 2024-09-13T06:41:08.619 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:44.494078+0000", 2024-09-13T06:41:08.619 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 24.060450553999999, 2024-09-13T06:41:08.619 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.026595945999999999, 2024-09-13T06:41:08.619 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:08.619 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:08.620 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:08.620 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:08.620 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:08.620 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 55180 2024-09-13T06:41:08.620 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.620 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:08.620 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.620 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:08.620 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.494078+0000", 2024-09-13T06:41:08.620 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:08.620 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.620 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.620 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:08.621 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.494078+0000", 2024-09-13T06:41:08.621 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:08.621 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.621 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.621 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:08.621 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.494076+0000", 2024-09-13T06:41:08.621 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999981 2024-09-13T06:41:08.621 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.621 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.621 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:08.621 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.494102+0000", 2024-09-13T06:41:08.621 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.6128000000000001e-05 2024-09-13T06:41:08.621 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.622 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.622 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:08.622 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.494127+0000", 2024-09-13T06:41:08.622 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.4496000000000001e-05 2024-09-13T06:41:08.622 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.622 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.622 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:08.622 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.494187+0000", 2024-09-13T06:41:08.622 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.0053999999999998e-05 2024-09-13T06:41:08.622 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.622 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.622 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:08.622 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.520100+0000", 2024-09-13T06:41:08.622 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.025913783999999999 2024-09-13T06:41:08.623 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.623 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.623 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:08.623 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.520211+0000", 2024-09-13T06:41:08.623 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000110141 2024-09-13T06:41:08.623 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.623 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.623 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:08.623 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.520674+0000", 2024-09-13T06:41:08.623 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00046317199999999998 2024-09-13T06:41:08.623 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:08.623 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:08.623 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:08.624 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.624 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.624 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:55313 3.13 3:ce471d87:::rbd_data.11213b441054.0000000000000036:2e [read 229376~32768 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e91)", 2024-09-13T06:41:08.624 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:44.499266+0000", 2024-09-13T06:41:08.624 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 24.055262236000001, 2024-09-13T06:41:08.624 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.024871526000000001, 2024-09-13T06:41:08.624 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:08.624 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:08.624 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:08.624 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:08.624 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:08.624 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 55313 2024-09-13T06:41:08.624 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.625 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:08.625 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.625 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:08.625 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.499266+0000", 2024-09-13T06:41:08.625 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:08.625 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.625 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.625 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:08.625 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.499266+0000", 2024-09-13T06:41:08.625 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:08.625 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.625 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.625 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:08.625 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.499265+0000", 2024-09-13T06:41:08.626 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:08.626 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.626 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.626 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:08.626 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.499287+0000", 2024-09-13T06:41:08.626 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.1625e-05 2024-09-13T06:41:08.626 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.626 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.626 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:08.626 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.499305+0000", 2024-09-13T06:41:08.626 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.8442999999999999e-05 2024-09-13T06:41:08.626 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.626 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.627 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:08.627 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.499336+0000", 2024-09-13T06:41:08.627 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.0769000000000003e-05 2024-09-13T06:41:08.627 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.627 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.627 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:08.627 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.523570+0000", 2024-09-13T06:41:08.627 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.024233667 2024-09-13T06:41:08.627 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.627 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.627 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:08.627 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.523715+0000", 2024-09-13T06:41:08.627 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000145224 2024-09-13T06:41:08.627 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.628 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.628 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:08.628 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.524138+0000", 2024-09-13T06:41:08.628 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00042293799999999998 2024-09-13T06:41:08.628 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:08.628 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:08.628 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:08.628 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.628 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.628 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:55320 3.13 3:cda7a632:::rbd_data.11213b441054.0000000000000003:2e [read 196608~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e91)", 2024-09-13T06:41:08.628 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:44.499446+0000", 2024-09-13T06:41:08.628 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 24.055082693999999, 2024-09-13T06:41:08.629 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.025732436000000001, 2024-09-13T06:41:08.629 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:08.629 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:08.629 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:08.629 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:08.629 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:08.629 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 55320 2024-09-13T06:41:08.629 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.629 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:08.629 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.629 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:08.629 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.499446+0000", 2024-09-13T06:41:08.632 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:08.632 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.632 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.632 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:08.632 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.499446+0000", 2024-09-13T06:41:08.632 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:08.632 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.632 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.632 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:08.632 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.499445+0000", 2024-09-13T06:41:08.632 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:08.632 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.633 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.633 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:08.633 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.499451+0000", 2024-09-13T06:41:08.633 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.7060000000000001e-06 2024-09-13T06:41:08.633 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.633 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.633 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:08.633 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.499468+0000", 2024-09-13T06:41:08.633 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7533e-05 2024-09-13T06:41:08.633 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.633 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.633 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:08.633 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.499495+0000", 2024-09-13T06:41:08.634 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.6424999999999999e-05 2024-09-13T06:41:08.634 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.634 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.634 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:08.634 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.524534+0000", 2024-09-13T06:41:08.634 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.025039715000000001 2024-09-13T06:41:08.634 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.634 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.634 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:08.634 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.525025+0000", 2024-09-13T06:41:08.634 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00049033799999999999 2024-09-13T06:41:08.634 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.634 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.635 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:08.635 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.525178+0000", 2024-09-13T06:41:08.635 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000153599 2024-09-13T06:41:08.635 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:08.635 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:08.635 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:08.635 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.635 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.635 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:55321 3.13 3:cda7a632:::rbd_data.11213b441054.0000000000000003:2e [read 507904~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e91)", 2024-09-13T06:41:08.635 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:44.499508+0000", 2024-09-13T06:41:08.635 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 24.055020003999999, 2024-09-13T06:41:08.635 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.026517458000000001, 2024-09-13T06:41:08.635 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:08.635 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:08.636 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:08.636 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:08.636 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:08.636 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 55321 2024-09-13T06:41:08.636 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.636 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:08.636 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.636 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:08.636 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.499508+0000", 2024-09-13T06:41:08.636 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:08.636 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.636 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.636 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:08.636 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.499508+0000", 2024-09-13T06:41:08.637 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:08.637 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.637 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.637 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:08.637 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.499508+0000", 2024-09-13T06:41:08.637 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:08.637 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.637 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.637 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:08.637 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.499515+0000", 2024-09-13T06:41:08.637 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.1470000000000004e-06 2024-09-13T06:41:08.637 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.637 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.638 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:08.638 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.499532+0000", 2024-09-13T06:41:08.638 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7319000000000001e-05 2024-09-13T06:41:08.638 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.638 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.638 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:08.638 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.499546+0000", 2024-09-13T06:41:08.638 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3563e-05 2024-09-13T06:41:08.638 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.638 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.638 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:08.638 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.525218+0000", 2024-09-13T06:41:08.638 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.025672665000000001 2024-09-13T06:41:08.638 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.639 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.639 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:08.639 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.525322+0000", 2024-09-13T06:41:08.639 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000103559 2024-09-13T06:41:08.639 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.639 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.639 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:08.639 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.526026+0000", 2024-09-13T06:41:08.639 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00070408500000000002 2024-09-13T06:41:08.639 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:08.639 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:08.639 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:08.639 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.639 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.640 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:55340 3.13 3:ce2ec97c:::rbd_data.11213b441054.000000000000000f:2e [read 294912~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e91)", 2024-09-13T06:41:08.640 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:44.499557+0000", 2024-09-13T06:41:08.640 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 24.054971873, 2024-09-13T06:41:08.640 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.026897266, 2024-09-13T06:41:08.640 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:08.640 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:08.640 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:08.640 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:08.640 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:08.640 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 55340 2024-09-13T06:41:08.640 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.640 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:08.640 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.641 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:08.641 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.499557+0000", 2024-09-13T06:41:08.641 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:08.641 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.641 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.641 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:08.641 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.499557+0000", 2024-09-13T06:41:08.641 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:08.641 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.641 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.641 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:08.641 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.499555+0000", 2024-09-13T06:41:08.641 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:08.641 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.642 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.642 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:08.642 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.499562+0000", 2024-09-13T06:41:08.642 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.0140000000000004e-06 2024-09-13T06:41:08.642 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.642 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.642 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:08.642 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.499579+0000", 2024-09-13T06:41:08.642 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7581999999999999e-05 2024-09-13T06:41:08.642 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.642 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.642 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:08.642 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.499593+0000", 2024-09-13T06:41:08.642 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.385e-05 2024-09-13T06:41:08.643 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.643 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.643 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:08.643 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.526053+0000", 2024-09-13T06:41:08.643 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.026459700999999999 2024-09-13T06:41:08.643 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.643 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.643 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:08.643 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.526129+0000", 2024-09-13T06:41:08.643 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.6650999999999995e-05 2024-09-13T06:41:08.643 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.643 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.643 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:08.644 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.526454+0000", 2024-09-13T06:41:08.644 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00032451799999999999 2024-09-13T06:41:08.644 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:08.644 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:08.644 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:08.644 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.644 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.644 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:55374 3.13 3:ce471d87:::rbd_data.11213b441054.0000000000000036:2e [read 262144~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e91)", 2024-09-13T06:41:08.644 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:44.499890+0000", 2024-09-13T06:41:08.644 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 24.054637987, 2024-09-13T06:41:08.644 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.026933168, 2024-09-13T06:41:08.644 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:08.644 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:08.645 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:08.645 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:08.645 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:08.645 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 55374 2024-09-13T06:41:08.645 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.645 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:08.645 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.645 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:08.645 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.499890+0000", 2024-09-13T06:41:08.645 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:08.645 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.645 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.645 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:08.645 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.499890+0000", 2024-09-13T06:41:08.646 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:08.646 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.646 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.646 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:08.646 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.499889+0000", 2024-09-13T06:41:08.646 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:08.646 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.646 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.646 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:08.646 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.499895+0000", 2024-09-13T06:41:08.646 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.7690000000000002e-06 2024-09-13T06:41:08.646 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.646 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.647 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:08.647 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.499912+0000", 2024-09-13T06:41:08.647 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6852999999999999e-05 2024-09-13T06:41:08.647 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.647 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.647 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:08.647 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.499925+0000", 2024-09-13T06:41:08.647 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2549e-05 2024-09-13T06:41:08.647 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.647 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.647 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:08.647 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.526526+0000", 2024-09-13T06:41:08.647 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.026601392000000001 2024-09-13T06:41:08.648 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.648 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.648 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:08.648 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.526664+0000", 2024-09-13T06:41:08.648 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00013789 2024-09-13T06:41:08.648 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.648 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.648 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:08.648 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.526824+0000", 2024-09-13T06:41:08.648 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00015967800000000001 2024-09-13T06:41:08.648 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:08.648 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:08.648 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:08.648 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.649 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.649 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:69017 3.f 3:f7719deb:::rbd_data.1121867cc19b.0000000000000003:head [set-alloc-hint object_size 33554432 write_size 33554432,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109)", 2024-09-13T06:41:08.649 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:41:03.515391+0000", 2024-09-13T06:41:08.649 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 5.0391372170000004, 2024-09-13T06:41:08.649 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.029766933999999998, 2024-09-13T06:41:08.649 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:08.649 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:41:08.649 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:08.649 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:08.649 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:08.649 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 69017 2024-09-13T06:41:08.649 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.649 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:08.649 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.650 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:08.650 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:03.515391+0000", 2024-09-13T06:41:08.650 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:08.650 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.650 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.650 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:08.650 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:03.515391+0000", 2024-09-13T06:41:08.650 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:08.650 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.650 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.650 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:08.650 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:03.515390+0000", 2024-09-13T06:41:08.650 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999986 2024-09-13T06:41:08.651 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.651 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.651 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:08.651 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:03.515397+0000", 2024-09-13T06:41:08.651 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.9399999999999996e-06 2024-09-13T06:41:08.651 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.651 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.651 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:08.651 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:03.515413+0000", 2024-09-13T06:41:08.651 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6248000000000001e-05 2024-09-13T06:41:08.651 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.651 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.651 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:08.651 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:03.515422+0000", 2024-09-13T06:41:08.652 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.7490000000000004e-06 2024-09-13T06:41:08.652 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.652 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.652 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:08.652 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:03.515536+0000", 2024-09-13T06:41:08.652 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00011391999999999999 2024-09-13T06:41:08.652 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.652 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.652 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:08.652 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:03.515777+0000", 2024-09-13T06:41:08.652 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00024096999999999999 2024-09-13T06:41:08.652 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.652 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.652 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 2", 2024-09-13T06:41:08.653 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:03.521255+0000", 2024-09-13T06:41:08.653 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0054784600000000001 2024-09-13T06:41:08.653 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.653 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.653 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-13T06:41:08.653 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:03.544884+0000", 2024-09-13T06:41:08.653 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.023628850999999999 2024-09-13T06:41:08.653 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.653 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.653 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:41:08.653 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:03.544990+0000", 2024-09-13T06:41:08.653 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00010615699999999999 2024-09-13T06:41:08.653 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.654 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.654 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-13T06:41:08.654 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:03.545085+0000", 2024-09-13T06:41:08.654 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.4704000000000007e-05 2024-09-13T06:41:08.654 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:08.654 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:08.654 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:08.654 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:03.545158+0000", 2024-09-13T06:41:08.654 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.3193000000000002e-05 2024-09-13T06:41:08.654 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:08.654 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:08.654 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:08.654 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:08.654 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:08.655 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:41:08.655 INFO:teuthology.orchestra.run.smithi081.stdout:osd.3: {} 2024-09-13T06:41:08.656 INFO:teuthology.orchestra.run.smithi081.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-13T06:41:08.657 INFO:teuthology.orchestra.run.smithi081.stdout:osd.4: {} 2024-09-13T06:41:08.657 INFO:teuthology.orchestra.run.smithi081.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-13T06:41:08.657 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-13T06:41:08.658 INFO:teuthology.orchestra.run.smithi081.stdout:osd.5: {} 2024-09-13T06:41:08.658 INFO:teuthology.orchestra.run.smithi081.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-13T06:41:08.658 INFO:teuthology.orchestra.run.smithi081.stdout:osd.6: {} 2024-09-13T06:41:08.659 INFO:teuthology.orchestra.run.smithi081.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-13T06:41:08.659 INFO:teuthology.orchestra.run.smithi081.stderr:noscrub is unset 2024-09-13T06:41:08.659 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:41:08.655+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:41:08.660 INFO:teuthology.orchestra.run.smithi081.stdout:osd.7: {} 2024-09-13T06:41:08.660 INFO:teuthology.orchestra.run.smithi081.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-13T06:41:08.757 INFO:tasks.ceph.osd.6.smithi139.stderr:2024-09-13T06:41:08.756+0000 7fcd02c5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26385) UID: 0 2024-09-13T06:41:08.786 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:41:08.786 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:41:08.801 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-13T06:41:08.857 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:41:08.859+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:41:08.921 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:41:08.921 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:41:08.936 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-13T06:41:08.958 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:41:08.956+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:41:09.059 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:41:09.060+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:41:09.102 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:41:09.102 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:41:09.117 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-13T06:41:09.161 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:41:09.160+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:41:09.239 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:41:09.240 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:41:09.253 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-13T06:41:09.297 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:41:09.299+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:41:09.362 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:41:09.363+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:41:09.377 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:41:09.377 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:41:09.392 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-13T06:41:09.477 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:41:09.479+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:41:09.555 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:41:09.556 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:41:09.564 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:41:09.563+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:41:09.569 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-13T06:41:09.628 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 4, 6, 7, 5] out_osds: [3] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-13T06:41:09.628 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-13T06:41:09.628 INFO:tasks.thrashosds.thrasher:Adding osd 3 2024-09-13T06:41:09.628 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd in 3 2024-09-13T06:41:09.666 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:41:09.664+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:41:09.742 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:41:09.742 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:41:09.762 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-13T06:41:09.766 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:41:09.764+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:41:09.853 INFO:teuthology.orchestra.run.smithi081.stdout:checking clone #17, image image_client.0-clone17 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent18 2024-09-13T06:41:09.867 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:41:09.867+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:41:09.887 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:41:09.888 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:41:09.917 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-13T06:41:09.980 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-13T06:41:09.979+0000 7fcdeb9fe640 -1 mon.a@0(leader).osd e115 definitely_dead 0 2024-09-13T06:41:09.980 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:41:09.979+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:41:10.070 INFO:tasks.ceph.osd.6.smithi139.stderr:2024-09-13T06:41:10.068+0000 7fcd02c5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26385) UID: 0 2024-09-13T06:41:10.080 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:41:10.080 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:41:10.096 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-13T06:41:10.171 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:41:10.168+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:41:10.248 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:41:10.249 INFO:teuthology.orchestra.run.smithi081.stdout:2731 writesame 0x361c86c thru 0x36292d2 data_size 0x2b(0xca67 bytes) 2024-09-13T06:41:10.260 INFO:teuthology.orchestra.run.smithi081.stdout:2732 read 0x5fcb1e6 thru 0x5fcb7b5 (0x5d0 bytes) 2024-09-13T06:41:10.262 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:41:10.262 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:41:10.271 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:41:10.268+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:41:10.276 INFO:teuthology.orchestra.run.smithi081.stdout:2734 write 0xe4af3cd thru 0xe4b3e79 (0x4aad bytes) 2024-09-13T06:41:10.278 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-13T06:41:10.283 INFO:teuthology.orchestra.run.smithi081.stdout:2736 read 0x52602da thru 0x526747b (0x71a2 bytes) 2024-09-13T06:41:10.284 INFO:teuthology.orchestra.run.smithi081.stdout:2737 read 0xafd8828 thru 0xafdb16b (0x2944 bytes) 2024-09-13T06:41:10.285 INFO:teuthology.orchestra.run.smithi081.stdout:2738 read 0xc988782 thru 0xc991b54 (0x93d3 bytes) 2024-09-13T06:41:10.285 INFO:teuthology.orchestra.run.smithi081.stdout:2741 read 0xc101bd1 thru 0xc10e854 (0xcc84 bytes) 2024-09-13T06:41:10.285 INFO:teuthology.orchestra.run.smithi081.stdout:2742 read 0xdcb730b thru 0xdcb9caf (0x29a5 bytes) 2024-09-13T06:41:10.285 INFO:teuthology.orchestra.run.smithi081.stdout:2743 writesame 0xaea0089 thru 0xaea69af data_size 0x1(0x6927 bytes) 2024-09-13T06:41:10.312 INFO:teuthology.orchestra.run.smithi081.stdout:2744 trunc from 0xe4b3e7a to 0x7e39cd5 2024-09-13T06:41:10.336 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:41:10.337 INFO:teuthology.orchestra.run.smithi081.stdout:2748 write 0x69bbb1 thru 0x6a5cb3 (0xa103 bytes) 2024-09-13T06:41:10.338 INFO:teuthology.orchestra.run.smithi081.stdout:2749 write 0xd47b thru 0x12b23 (0x56a9 bytes) 2024-09-13T06:41:10.342 INFO:teuthology.orchestra.run.smithi081.stdout:2750 read 0xc3ab0e thru 0xc43279 (0x876c bytes) 2024-09-13T06:41:10.343 INFO:teuthology.orchestra.run.smithi081.stdout:2752 read 0x23955ba thru 0x2395f47 (0x98e bytes) 2024-09-13T06:41:10.343 INFO:teuthology.orchestra.run.smithi081.stdout:2753 read 0x5b862f5 thru 0x5b890e0 (0x2dec bytes) 2024-09-13T06:41:10.361 INFO:teuthology.orchestra.run.smithi081.stdout:2755 write 0xaa68d3e thru 0xaa720c1 (0x9384 bytes) 2024-09-13T06:41:10.367 INFO:teuthology.orchestra.run.smithi081.stdout:2756 trunc from 0xaa720c2 to 0xcf936c0 2024-09-13T06:41:10.371 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:41:10.371+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:41:10.380 INFO:teuthology.orchestra.run.smithi081.stdout:2757 punch from 0x2be9263 to 0x2beb493, (0x2230 bytes) 2024-09-13T06:41:10.380 INFO:teuthology.orchestra.run.smithi081.stdout:2758 writesame 0xc33715f thru 0xc344163 data_size 0x9(0xd005 bytes) 2024-09-13T06:41:10.393 INFO:teuthology.orchestra.run.smithi081.stdout:2759 read 0x69c3126 thru 0x69c7fcc (0x4ea7 bytes) 2024-09-13T06:41:10.393 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:41:10.393 INFO:teuthology.orchestra.run.smithi081.stdout:2763 read 0xaf4279 thru 0xafe8d1 (0xa659 bytes) 2024-09-13T06:41:10.394 INFO:teuthology.orchestra.run.smithi081.stdout:2764 read 0xb7862a7 thru 0xb78b6ab (0x5405 bytes) 2024-09-13T06:41:10.395 INFO:teuthology.orchestra.run.smithi081.stdout:2765 writesame 0x4718f42 thru 0x47221ab data_size 0x3(0x926a bytes) 2024-09-13T06:41:10.414 INFO:teuthology.orchestra.run.smithi081.stdout:2768 write 0x5314116 thru 0x531a35c (0x6247 bytes) 2024-09-13T06:41:10.415 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:41:10.415 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:41:10.431 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-13T06:41:10.432 INFO:teuthology.orchestra.run.smithi081.stdout:2769 write 0xdf40fc8 thru 0xdf41a06 (0xa3f bytes) 2024-09-13T06:41:10.443 INFO:teuthology.orchestra.run.smithi081.stdout:2770 trunc from 0xdf41a07 to 0xbc23ec5 2024-09-13T06:41:10.472 INFO:tasks.ceph.osd.6.smithi139.stderr:2024-09-13T06:41:10.472+0000 7fcd02c5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26385) UID: 0 2024-09-13T06:41:10.488 INFO:teuthology.orchestra.run.smithi081.stdout:2771 trunc from 0xbc23ec5 to 0x202246d 2024-09-13T06:41:10.522 INFO:teuthology.orchestra.run.smithi081.stdout:2772 writesame 0x38a7a41 thru 0x38b7534 data_size 0x2(0xfaf4 bytes) 2024-09-13T06:41:10.525 INFO:teuthology.orchestra.run.smithi081.stdout:2773 write 0x3543995 thru 0x3547c0d (0x4279 bytes) 2024-09-13T06:41:10.527 INFO:teuthology.orchestra.run.smithi081.stdout:2776 punch from 0xb25941 to 0xb2703f, (0x16fe bytes) 2024-09-13T06:41:10.537 INFO:teuthology.orchestra.run.smithi081.stdout:2777 trunc from 0x38b7535 to 0x8487a56 2024-09-13T06:41:10.564 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:41:10.564 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:41:10.573 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:41:10.572+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:41:10.577 INFO:teuthology.orchestra.run.smithi081.stdout:2778 write 0xbd9ab4f thru 0xbda2db4 (0x8266 bytes) 2024-09-13T06:41:10.578 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-13T06:41:10.579 INFO:teuthology.orchestra.run.smithi081.stdout:2779 read 0x81fcd32 thru 0x8201a42 (0x4d11 bytes) 2024-09-13T06:41:10.580 INFO:teuthology.orchestra.run.smithi081.stdout:2780 read 0xa30e7c2 thru 0xa31533e (0x6b7d bytes) 2024-09-13T06:41:10.589 INFO:teuthology.orchestra.run.smithi081.stdout:2781 trunc from 0xbda2db5 to 0x754eacc 2024-09-13T06:41:10.603 INFO:teuthology.orchestra.run.smithi081.stdout:2782 write 0x1dc2077 thru 0x1dc5dd4 (0x3d5e bytes) 2024-09-13T06:41:10.604 INFO:teuthology.orchestra.run.smithi081.stdout:2783 read 0x3af55d6 thru 0x3b004fd (0xaf28 bytes) 2024-09-13T06:41:10.605 INFO:teuthology.orchestra.run.smithi081.stdout:2784 write 0x47472e4 thru 0x4751c35 (0xa952 bytes) 2024-09-13T06:41:10.607 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:41:10.621 INFO:teuthology.orchestra.run.smithi081.stdout:2787 write 0x9fe6eb7 thru 0x9feaf34 (0x407e bytes) 2024-09-13T06:41:10.623 INFO:teuthology.orchestra.run.smithi081.stdout:2788 write 0x32a2afa thru 0x32a40e9 (0x15f0 bytes) 2024-09-13T06:41:10.625 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:41:10.625 INFO:teuthology.orchestra.run.smithi081.stdout:2790 read 0x7da6b3d thru 0x7dab993 (0x4e57 bytes) 2024-09-13T06:41:10.625 INFO:teuthology.orchestra.run.smithi081.stdout:2791 punch from 0x8101bdd to 0x81068a3, (0x4cc6 bytes) 2024-09-13T06:41:10.625 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:41:10.626 INFO:teuthology.orchestra.run.smithi081.stdout:2795 write 0x70213b thru 0x70698c (0x4852 bytes) 2024-09-13T06:41:10.627 INFO:teuthology.orchestra.run.smithi081.stdout:2797 write 0x4abd02c thru 0x4abd96c (0x941 bytes) 2024-09-13T06:41:10.629 INFO:teuthology.orchestra.run.smithi081.stdout:2798 write 0x2762e21 thru 0x2766e02 (0x3fe2 bytes) 2024-09-13T06:41:10.631 INFO:teuthology.orchestra.run.smithi081.stdout:2800 punch from 0x472a8b4 to 0x4737305, (0xca51 bytes) 2024-09-13T06:41:10.631 INFO:teuthology.orchestra.run.smithi081.stdout:2801 write 0x81a0228 thru 0x81af1e2 (0xefbb bytes) 2024-09-13T06:41:10.648 INFO:teuthology.orchestra.run.smithi081.stdout:2803 writesame 0xd446ad7 thru 0xd448aa7 data_size 0x9(0x1fd1 bytes) 2024-09-13T06:41:10.648 INFO:teuthology.orchestra.run.smithi081.stdout:2806 read 0x5eaa027 thru 0x5eae66d (0x4647 bytes) 2024-09-13T06:41:10.650 INFO:teuthology.orchestra.run.smithi081.stdout:2807 read 0x9cc7fd1 thru 0x9cd0a49 (0x8a79 bytes) 2024-09-13T06:41:10.650 INFO:teuthology.orchestra.run.smithi081.stdout:2809 read 0xde3d12 thru 0xdeaac8 (0x6db7 bytes) 2024-09-13T06:41:10.650 INFO:teuthology.orchestra.run.smithi081.stdout:2810 write 0x9535275 thru 0x9543cb6 (0xea42 bytes) 2024-09-13T06:41:10.652 INFO:teuthology.orchestra.run.smithi081.stdout:2813 read 0x3ec914e thru 0x3ecca2b (0x38de bytes) 2024-09-13T06:41:10.653 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:41:10.653 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:41:10.653 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:41:10.653 INFO:teuthology.orchestra.run.smithi081.stdout:2818 writesame 0x52a4aee thru 0x52b45e3 data_size 0x1a(0xfaf6 bytes) 2024-09-13T06:41:10.656 INFO:teuthology.orchestra.run.smithi081.stdout:2820 punch from 0x9487207 to 0x9493acd, (0xc8c6 bytes) 2024-09-13T06:41:10.657 INFO:teuthology.orchestra.run.smithi081.stdout:2823 writesame 0x2af1fb9 thru 0x2af7de6 data_size 0x5(0x5e2e bytes) 2024-09-13T06:41:10.669 INFO:teuthology.orchestra.run.smithi081.stderr:marked in osd.3. 2024-09-13T06:41:10.674 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:41:10.672+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:41:10.678 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-13T06:41:10.690 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-13T06:41:10.695 INFO:tasks.thrashosds.thrasher:Added osd 3 2024-09-13T06:41:10.721 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:41:10.721 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:41:10.735 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-13T06:41:10.794 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:41:10.795+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:41:11.241 INFO:teuthology.orchestra.run.smithi081.stdout:osd.0: {} 2024-09-13T06:41:11.241 INFO:teuthology.orchestra.run.smithi081.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-13T06:41:11.242 INFO:teuthology.orchestra.run.smithi081.stdout:osd.1: {} 2024-09-13T06:41:11.242 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:41:11.242 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:41:11.242 INFO:teuthology.orchestra.run.smithi081.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-13T06:41:11.243 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-13T06:41:11.243 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:41:11.240+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:41:11.243 INFO:teuthology.orchestra.run.smithi081.stdout:osd.2: {} 2024-09-13T06:41:11.243 INFO:teuthology.orchestra.run.smithi081.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-13T06:41:11.244 INFO:teuthology.orchestra.run.smithi081.stdout:osd.3: {} 2024-09-13T06:41:11.244 INFO:teuthology.orchestra.run.smithi081.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-13T06:41:11.244 INFO:teuthology.orchestra.run.smithi081.stdout:osd.4: {} 2024-09-13T06:41:11.245 INFO:teuthology.orchestra.run.smithi081.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-13T06:41:11.245 INFO:teuthology.orchestra.run.smithi081.stdout:osd.5: {} 2024-09-13T06:41:11.245 INFO:teuthology.orchestra.run.smithi081.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-13T06:41:11.246 INFO:teuthology.orchestra.run.smithi081.stdout:osd.6: {} 2024-09-13T06:41:11.246 INFO:teuthology.orchestra.run.smithi081.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-13T06:41:11.246 INFO:teuthology.orchestra.run.smithi081.stdout:osd.7: {} 2024-09-13T06:41:11.247 INFO:teuthology.orchestra.run.smithi081.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-13T06:41:11.342 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:41:11.343+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:41:11.381 INFO:teuthology.orchestra.run.smithi081.stderr:nodeep-scrub is unset 2024-09-13T06:41:11.424 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:41:11.424 INFO:teuthology.orchestra.run.smithi139.stdout: "size": 20, 2024-09-13T06:41:11.424 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 600, 2024-09-13T06:41:11.424 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [ 2024-09-13T06:41:11.424 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:11.424 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18706 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 3346432~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:41:11.424 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.846138+0000", 2024-09-13T06:41:11.424 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 79.576578572000003, 2024-09-13T06:41:11.424 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.102018712, 2024-09-13T06:41:11.424 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:11.424 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:11.425 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:11.425 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:11.425 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:11.425 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18706 2024-09-13T06:41:11.425 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:11.425 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:11.425 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:11.425 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:11.425 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846138+0000", 2024-09-13T06:41:11.425 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:11.425 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:11.425 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:11.426 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:11.426 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846138+0000", 2024-09-13T06:41:11.426 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:11.426 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:11.426 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:11.426 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:11.426 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846138+0000", 2024-09-13T06:41:11.426 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:11.426 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:11.426 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:11.426 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:11.426 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846141+0000", 2024-09-13T06:41:11.427 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.6969999999999999e-06 2024-09-13T06:41:11.427 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:11.427 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:11.427 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:11.427 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846150+0000", 2024-09-13T06:41:11.427 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6400000000000003e-06 2024-09-13T06:41:11.427 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:11.427 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:11.427 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:11.427 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846160+0000", 2024-09-13T06:41:11.427 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.3999999999999998e-06 2024-09-13T06:41:11.427 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:11.428 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:11.428 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:11.428 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.947764+0000", 2024-09-13T06:41:11.428 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101604085 2024-09-13T06:41:11.428 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:11.428 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:11.428 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:11.428 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.947888+0000", 2024-09-13T06:41:11.428 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000124113 2024-09-13T06:41:11.428 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:11.428 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:11.428 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:11.428 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.948157+0000", 2024-09-13T06:41:11.429 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00026943399999999998 2024-09-13T06:41:11.429 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:11.429 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:11.429 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:11.429 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:11.429 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:11.429 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18707 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 3375104~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:41:11.429 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.846207+0000", 2024-09-13T06:41:11.429 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 79.576509806000004, 2024-09-13T06:41:11.429 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10238114099999999, 2024-09-13T06:41:11.429 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:11.429 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:11.430 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:11.430 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:11.430 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:11.430 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18707 2024-09-13T06:41:11.430 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:11.430 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:11.430 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:11.430 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:11.430 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846207+0000", 2024-09-13T06:41:11.430 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:11.430 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:11.430 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:11.430 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:11.431 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846207+0000", 2024-09-13T06:41:11.431 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:11.431 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:11.431 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:11.431 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:11.431 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846206+0000", 2024-09-13T06:41:11.431 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:11.431 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:11.431 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:11.431 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:11.431 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846211+0000", 2024-09-13T06:41:11.431 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.3000000000000003e-06 2024-09-13T06:41:11.432 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:11.432 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:11.432 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:11.432 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846220+0000", 2024-09-13T06:41:11.432 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6199999999999994e-06 2024-09-13T06:41:11.432 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:11.432 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:11.432 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:11.432 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846228+0000", 2024-09-13T06:41:11.432 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.7500000000000003e-06 2024-09-13T06:41:11.432 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:11.433 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:11.433 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:11.433 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.948267+0000", 2024-09-13T06:41:11.433 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10203878700000001 2024-09-13T06:41:11.433 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:11.433 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:11.433 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:11.433 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.948435+0000", 2024-09-13T06:41:11.433 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00016796500000000001 2024-09-13T06:41:11.433 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:11.433 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:11.434 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:11.434 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.948588+0000", 2024-09-13T06:41:11.434 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00015373599999999999 2024-09-13T06:41:11.434 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:11.434 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:11.434 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:11.434 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:11.434 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:11.434 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18718 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 3690496~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:41:11.434 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.850174+0000", 2024-09-13T06:41:11.434 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 79.572542652999999, 2024-09-13T06:41:11.434 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101854154, 2024-09-13T06:41:11.434 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:11.435 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:11.435 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:11.435 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:11.435 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:11.435 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18718 2024-09-13T06:41:11.435 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:11.435 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:11.435 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:11.435 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:11.435 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850174+0000", 2024-09-13T06:41:11.435 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:11.435 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:11.435 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:11.436 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:11.436 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850174+0000", 2024-09-13T06:41:11.436 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:11.436 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:11.436 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:11.436 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:11.436 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850173+0000", 2024-09-13T06:41:11.436 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:11.436 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:11.436 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:11.436 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:11.436 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850178+0000", 2024-09-13T06:41:11.437 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.4129999999999999e-06 2024-09-13T06:41:11.437 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:11.437 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:11.437 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:11.437 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850188+0000", 2024-09-13T06:41:11.437 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.8600000000000005e-06 2024-09-13T06:41:11.437 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:11.437 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:11.437 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:11.437 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850195+0000", 2024-09-13T06:41:11.437 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.8730000000000007e-06 2024-09-13T06:41:11.437 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:11.438 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:11.438 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:11.438 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.951766+0000", 2024-09-13T06:41:11.438 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.1015703 2024-09-13T06:41:11.438 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:11.438 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:11.438 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:11.438 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.951879+0000", 2024-09-13T06:41:11.438 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000112932 2024-09-13T06:41:11.438 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:11.438 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:11.438 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:11.438 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.952029+0000", 2024-09-13T06:41:11.439 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000149846 2024-09-13T06:41:11.439 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:11.439 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:11.439 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:11.439 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:11.439 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:11.439 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18719 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 3719168~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:41:11.439 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.850202+0000", 2024-09-13T06:41:11.439 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 79.572514609999999, 2024-09-13T06:41:11.439 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.102191676, 2024-09-13T06:41:11.439 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:11.439 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:11.439 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:11.440 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:11.440 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:11.440 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18719 2024-09-13T06:41:11.440 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:11.440 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:11.440 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:11.440 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:11.440 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850202+0000", 2024-09-13T06:41:11.440 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:11.440 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:11.440 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:11.441 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:11.441 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850202+0000", 2024-09-13T06:41:11.441 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:11.441 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:11.441 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:11.441 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:11.441 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850202+0000", 2024-09-13T06:41:11.441 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:11.441 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:11.441 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:11.441 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:11.441 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850205+0000", 2024-09-13T06:41:11.442 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.89e-06 2024-09-13T06:41:11.442 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:11.442 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:11.442 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:11.442 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850216+0000", 2024-09-13T06:41:11.442 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0233e-05 2024-09-13T06:41:11.442 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:11.442 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:11.442 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:11.442 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850223+0000", 2024-09-13T06:41:11.442 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5299999999999999e-06 2024-09-13T06:41:11.442 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:11.442 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:11.443 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:11.443 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.952106+0000", 2024-09-13T06:41:11.443 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10188309299999999 2024-09-13T06:41:11.443 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:11.443 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:11.443 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:11.443 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.952233+0000", 2024-09-13T06:41:11.443 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000126993 2024-09-13T06:41:11.443 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:11.443 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:11.443 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:11.443 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.952394+0000", 2024-09-13T06:41:11.443 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000160791 2024-09-13T06:41:11.444 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:11.444 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:11.444 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:11.444 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:11.444 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:11.444 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18720 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 3747840~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:41:11.444 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.850726+0000", 2024-09-13T06:41:11.444 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 79.571990780999997, 2024-09-13T06:41:11.444 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10199504299999999, 2024-09-13T06:41:11.444 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:11.444 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:11.445 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:11.445 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:11.445 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:11.445 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18720 2024-09-13T06:41:11.445 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:11.445 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:11.445 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:11.445 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:11.445 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850726+0000", 2024-09-13T06:41:11.445 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:11.445 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:11.445 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:11.445 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:11.446 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850726+0000", 2024-09-13T06:41:11.446 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:11.446 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:11.446 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:11.446 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:11.446 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850229+0000", 2024-09-13T06:41:11.446 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9995027 2024-09-13T06:41:11.446 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:11.446 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:11.446 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:11.446 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850731+0000", 2024-09-13T06:41:11.447 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00050221599999999999 2024-09-13T06:41:11.447 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:11.447 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:11.447 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:11.447 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850751+0000", 2024-09-13T06:41:11.447 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.9703000000000001e-05 2024-09-13T06:41:11.447 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:11.447 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:11.447 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:11.448 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850764+0000", 2024-09-13T06:41:11.448 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3207000000000001e-05 2024-09-13T06:41:11.448 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:11.448 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:11.448 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:11.448 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.952454+0000", 2024-09-13T06:41:11.448 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101690102 2024-09-13T06:41:11.448 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:11.448 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:11.448 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:11.448 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.952571+0000", 2024-09-13T06:41:11.449 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000116556 2024-09-13T06:41:11.449 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:11.449 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:11.449 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:11.449 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.952721+0000", 2024-09-13T06:41:11.449 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000150419 2024-09-13T06:41:11.449 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:11.449 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:11.449 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:11.449 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:11.449 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:11.449 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18730 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 4034560~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:41:11.450 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.854013+0000", 2024-09-13T06:41:11.450 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 79.568703839999998, 2024-09-13T06:41:11.450 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10186914399999999, 2024-09-13T06:41:11.450 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:11.450 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:11.450 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:11.450 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:11.450 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:11.450 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18730 2024-09-13T06:41:11.450 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:11.450 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:11.450 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:11.451 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:11.451 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.854013+0000", 2024-09-13T06:41:11.451 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:11.451 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:11.451 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:11.451 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:11.451 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.854013+0000", 2024-09-13T06:41:11.451 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:11.451 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:11.451 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:11.451 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:11.451 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.854013+0000", 2024-09-13T06:41:11.451 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:11.451 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:11.452 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:11.452 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:11.452 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.854016+0000", 2024-09-13T06:41:11.452 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.1839999999999999e-06 2024-09-13T06:41:11.452 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:11.452 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:11.452 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:11.452 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.854025+0000", 2024-09-13T06:41:11.452 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.8030000000000003e-06 2024-09-13T06:41:11.452 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:11.452 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:11.453 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:11.453 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.854033+0000", 2024-09-13T06:41:11.453 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6500000000000002e-06 2024-09-13T06:41:11.453 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:11.453 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:11.453 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:11.453 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.955546+0000", 2024-09-13T06:41:11.453 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10151296 2024-09-13T06:41:11.453 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:11.453 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:11.453 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:11.453 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.955694+0000", 2024-09-13T06:41:11.454 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000147773 2024-09-13T06:41:11.454 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:11.454 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:11.454 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:11.454 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.955882+0000", 2024-09-13T06:41:11.454 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000188371 2024-09-13T06:41:11.454 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:11.454 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:11.454 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:11.454 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:11.454 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:11.454 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18742 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 4378624~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:41:11.454 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.857984+0000", 2024-09-13T06:41:11.454 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 79.564732716999998, 2024-09-13T06:41:11.455 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10179961799999999, 2024-09-13T06:41:11.455 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:11.455 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:11.455 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:11.455 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:11.455 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:11.455 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18742 2024-09-13T06:41:11.455 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:11.455 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:11.455 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:11.455 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:11.455 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.857984+0000", 2024-09-13T06:41:11.456 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:11.456 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:11.456 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:11.456 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:11.456 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.857984+0000", 2024-09-13T06:41:11.456 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:11.456 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:11.456 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:11.456 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:11.456 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.857983+0000", 2024-09-13T06:41:11.456 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:11.457 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:11.457 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:11.457 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:11.457 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.857987+0000", 2024-09-13T06:41:11.457 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0670000000000002e-06 2024-09-13T06:41:11.457 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:11.457 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:11.457 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:11.457 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.857997+0000", 2024-09-13T06:41:11.457 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6830000000000003e-06 2024-09-13T06:41:11.457 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:11.457 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:11.458 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:11.458 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.858006+0000", 2024-09-13T06:41:11.458 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.5739999999999996e-06 2024-09-13T06:41:11.458 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:11.458 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:11.458 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:11.458 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.959453+0000", 2024-09-13T06:41:11.458 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101447339 2024-09-13T06:41:11.458 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:11.458 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:11.458 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:11.458 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.959603+0000", 2024-09-13T06:41:11.458 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000150316 2024-09-13T06:41:11.459 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:11.459 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:11.459 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:11.459 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.959784+0000", 2024-09-13T06:41:11.459 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00018065900000000001 2024-09-13T06:41:11.459 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:11.459 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:11.459 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:11.459 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:11.459 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:11.459 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18743 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 4407296~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:41:11.459 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.858012+0000", 2024-09-13T06:41:11.460 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 79.564704723999995, 2024-09-13T06:41:11.460 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10210024500000001, 2024-09-13T06:41:11.460 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:11.460 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:11.460 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:11.460 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:11.460 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:11.460 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18743 2024-09-13T06:41:11.460 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:11.460 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:11.460 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:11.461 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:11.461 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.858012+0000", 2024-09-13T06:41:11.461 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:11.461 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:11.461 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:11.461 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:11.461 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.858012+0000", 2024-09-13T06:41:11.461 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:11.461 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:11.461 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:11.461 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:11.461 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.858011+0000", 2024-09-13T06:41:11.461 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:11.462 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:11.462 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:11.462 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:11.462 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.858016+0000", 2024-09-13T06:41:11.462 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0659999999999997e-06 2024-09-13T06:41:11.462 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:11.462 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:11.462 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:11.462 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.858024+0000", 2024-09-13T06:41:11.462 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.7700000000000007e-06 2024-09-13T06:41:11.462 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:11.462 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:11.462 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:11.463 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.858032+0000", 2024-09-13T06:41:11.463 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.7700000000000001e-06 2024-09-13T06:41:11.463 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:11.463 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:11.463 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:11.463 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.959850+0000", 2024-09-13T06:41:11.463 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.1018182 2024-09-13T06:41:11.463 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:11.463 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:11.463 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:11.463 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.959964+0000", 2024-09-13T06:41:11.463 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00011413600000000001 2024-09-13T06:41:11.463 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:11.464 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:11.464 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:11.464 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.960113+0000", 2024-09-13T06:41:11.464 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00014813900000000001 2024-09-13T06:41:11.464 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:11.464 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:11.464 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:11.464 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:11.464 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:11.464 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18755 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 4751360~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:41:11.464 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.862061+0000", 2024-09-13T06:41:11.464 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 79.560656472000005, 2024-09-13T06:41:11.464 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101907023, 2024-09-13T06:41:11.465 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:11.465 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:11.465 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:11.465 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:11.465 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:11.465 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18755 2024-09-13T06:41:11.465 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:11.465 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:11.465 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:11.465 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:11.465 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862061+0000", 2024-09-13T06:41:11.465 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:11.465 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:11.466 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:11.466 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:11.466 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862061+0000", 2024-09-13T06:41:11.466 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:11.466 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:11.466 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:11.466 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:11.466 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862060+0000", 2024-09-13T06:41:11.466 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:11.466 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:11.466 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:11.466 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:11.466 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862064+0000", 2024-09-13T06:41:11.467 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.3229999999999999e-06 2024-09-13T06:41:11.467 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:11.467 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:11.467 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:11.467 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862078+0000", 2024-09-13T06:41:11.467 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.433e-05 2024-09-13T06:41:11.467 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:11.467 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:11.467 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:11.467 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862086+0000", 2024-09-13T06:41:11.467 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.3869999999999997e-06 2024-09-13T06:41:11.467 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:11.467 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:11.468 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:11.468 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.963635+0000", 2024-09-13T06:41:11.468 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101549606 2024-09-13T06:41:11.468 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:11.468 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:11.468 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:11.468 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.963783+0000", 2024-09-13T06:41:11.468 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000147312 2024-09-13T06:41:11.468 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:11.468 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:11.468 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:11.468 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.963968+0000", 2024-09-13T06:41:11.469 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000185028 2024-09-13T06:41:11.469 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:11.469 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:11.469 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:11.469 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:11.469 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:11.469 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18756 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 4780032~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:41:11.469 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.862132+0000", 2024-09-13T06:41:11.469 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 79.560584629000004, 2024-09-13T06:41:11.469 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.102159295, 2024-09-13T06:41:11.469 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:11.469 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:11.469 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:11.469 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:11.470 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:11.470 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18756 2024-09-13T06:41:11.470 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:11.470 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:11.470 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:11.470 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:11.470 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862132+0000", 2024-09-13T06:41:11.470 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:11.470 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:11.470 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:11.470 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:11.470 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862132+0000", 2024-09-13T06:41:11.470 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:11.471 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:11.471 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:11.471 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:11.471 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862132+0000", 2024-09-13T06:41:11.471 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:11.471 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:11.471 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:11.471 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:11.471 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862136+0000", 2024-09-13T06:41:11.471 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.9559999999999999e-06 2024-09-13T06:41:11.471 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:11.471 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:11.472 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:11.472 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862145+0000", 2024-09-13T06:41:11.472 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6169999999999996e-06 2024-09-13T06:41:11.472 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:11.472 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:11.472 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:11.472 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862153+0000", 2024-09-13T06:41:11.472 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.8359999999999992e-06 2024-09-13T06:41:11.472 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:11.472 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:11.472 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:11.472 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.964018+0000", 2024-09-13T06:41:11.473 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101865421 2024-09-13T06:41:11.473 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:11.473 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:11.473 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:11.473 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.964140+0000", 2024-09-13T06:41:11.473 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000121172 2024-09-13T06:41:11.473 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:11.473 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:11.473 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:11.473 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.964292+0000", 2024-09-13T06:41:11.473 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00015202600000000001 2024-09-13T06:41:11.473 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:11.473 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:11.474 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:11.474 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:11.474 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:11.474 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18768 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 5124096~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:41:11.474 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.866345+0000", 2024-09-13T06:41:11.474 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 79.556372322000001, 2024-09-13T06:41:11.474 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101779361, 2024-09-13T06:41:11.474 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:11.474 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:11.474 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:11.474 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:11.474 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:11.474 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18768 2024-09-13T06:41:11.475 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:11.475 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:11.475 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:11.475 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:11.475 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.866345+0000", 2024-09-13T06:41:11.475 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:11.475 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:11.475 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:11.475 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:11.475 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.866345+0000", 2024-09-13T06:41:11.475 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:11.475 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:11.475 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:11.476 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:11.476 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.866344+0000", 2024-09-13T06:41:11.476 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:11.476 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:11.476 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:11.476 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:11.476 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.866348+0000", 2024-09-13T06:41:11.476 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.4300000000000002e-06 2024-09-13T06:41:11.476 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:11.476 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:11.476 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:11.476 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.866356+0000", 2024-09-13T06:41:11.477 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.5930000000000006e-06 2024-09-13T06:41:11.477 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:11.477 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:11.477 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:11.477 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.866364+0000", 2024-09-13T06:41:11.477 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5599999999999996e-06 2024-09-13T06:41:11.477 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:11.477 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:11.477 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:11.477 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.967865+0000", 2024-09-13T06:41:11.477 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101501683 2024-09-13T06:41:11.477 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:11.477 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:11.477 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:11.478 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.967981+0000", 2024-09-13T06:41:11.478 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000115643 2024-09-13T06:41:11.478 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:11.478 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:11.478 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:11.478 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.968124+0000", 2024-09-13T06:41:11.478 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00014305500000000001 2024-09-13T06:41:11.478 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:11.478 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:11.478 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:11.478 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:11.478 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:11.478 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18779 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 5439488~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:41:11.478 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.869996+0000", 2024-09-13T06:41:11.479 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 79.552721437000002, 2024-09-13T06:41:11.479 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10189577399999999, 2024-09-13T06:41:11.479 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:11.479 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:11.479 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:11.479 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:11.479 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:11.479 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18779 2024-09-13T06:41:11.479 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:11.479 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:11.479 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:11.479 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:11.479 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.869996+0000", 2024-09-13T06:41:11.480 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:11.480 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:11.480 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:11.480 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:11.480 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.869996+0000", 2024-09-13T06:41:11.480 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:11.480 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:11.480 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:11.480 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:11.480 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.869995+0000", 2024-09-13T06:41:11.480 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:11.480 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:11.480 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:11.481 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:11.481 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.869998+0000", 2024-09-13T06:41:11.481 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.2729999999999998e-06 2024-09-13T06:41:11.481 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:11.481 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:11.481 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:11.481 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.870007+0000", 2024-09-13T06:41:11.481 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.5760000000000006e-06 2024-09-13T06:41:11.481 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:11.481 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:11.481 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:11.481 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.870014+0000", 2024-09-13T06:41:11.482 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.1400000000000002e-06 2024-09-13T06:41:11.482 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:11.482 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:11.482 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:11.482 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.971631+0000", 2024-09-13T06:41:11.482 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101617503 2024-09-13T06:41:11.482 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:11.482 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:11.482 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:11.482 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.971747+0000", 2024-09-13T06:41:11.482 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00011599600000000001 2024-09-13T06:41:11.482 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:11.482 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:11.482 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:11.483 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.971891+0000", 2024-09-13T06:41:11.483 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000143912 2024-09-13T06:41:11.483 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:11.483 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:11.483 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:11.483 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:11.483 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:11.483 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18792 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 5812224~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:41:11.483 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.874371+0000", 2024-09-13T06:41:11.483 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 79.548346307000003, 2024-09-13T06:41:11.483 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101736005, 2024-09-13T06:41:11.483 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:11.483 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:11.484 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:11.484 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:11.484 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:11.484 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18792 2024-09-13T06:41:11.484 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:11.484 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:11.484 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:11.484 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:11.484 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874371+0000", 2024-09-13T06:41:11.484 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:11.484 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:11.484 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:11.484 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:11.485 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874371+0000", 2024-09-13T06:41:11.485 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:11.485 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:11.485 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:11.485 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:11.485 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874370+0000", 2024-09-13T06:41:11.485 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:11.485 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:11.485 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:11.485 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:11.485 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874374+0000", 2024-09-13T06:41:11.485 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.7239999999999998e-06 2024-09-13T06:41:11.486 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:11.486 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:11.486 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:11.486 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874385+0000", 2024-09-13T06:41:11.486 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1293e-05 2024-09-13T06:41:11.486 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:11.486 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:11.486 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:11.486 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874394+0000", 2024-09-13T06:41:11.486 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.0729999999999994e-06 2024-09-13T06:41:11.486 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:11.486 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:11.486 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:11.487 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.975850+0000", 2024-09-13T06:41:11.487 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10145599700000001 2024-09-13T06:41:11.487 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:11.487 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:11.487 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:11.487 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.975963+0000", 2024-09-13T06:41:11.487 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000112689 2024-09-13T06:41:11.487 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:11.487 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:11.487 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:11.487 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.976107+0000", 2024-09-13T06:41:11.487 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000143836 2024-09-13T06:41:11.488 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:11.488 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:11.488 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:11.488 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:11.488 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:11.488 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18793 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 5840896~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:41:11.488 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.874401+0000", 2024-09-13T06:41:11.488 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 79.548316274000001, 2024-09-13T06:41:11.488 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.102005516, 2024-09-13T06:41:11.488 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:11.488 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:11.488 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:11.489 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:11.489 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:11.489 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18793 2024-09-13T06:41:11.489 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:11.489 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:11.489 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:11.489 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:11.489 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874401+0000", 2024-09-13T06:41:11.489 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:11.489 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:11.489 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:11.489 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:11.489 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874401+0000", 2024-09-13T06:41:11.490 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:11.490 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:11.490 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:11.490 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:11.490 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874400+0000", 2024-09-13T06:41:11.490 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:11.490 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:11.490 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:11.490 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:11.490 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874404+0000", 2024-09-13T06:41:11.490 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0069999999999999e-06 2024-09-13T06:41:11.490 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:11.491 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:11.491 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:11.491 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874412+0000", 2024-09-13T06:41:11.491 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.5399999999999996e-06 2024-09-13T06:41:11.491 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:11.491 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:11.491 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:11.491 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874420+0000", 2024-09-13T06:41:11.491 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.6199999999999999e-06 2024-09-13T06:41:11.491 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:11.491 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:11.491 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:11.491 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.976150+0000", 2024-09-13T06:41:11.492 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101729874 2024-09-13T06:41:11.492 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:11.492 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:11.492 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:11.492 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.976261+0000", 2024-09-13T06:41:11.492 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000110819 2024-09-13T06:41:11.492 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:11.492 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:11.492 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:11.492 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.976406+0000", 2024-09-13T06:41:11.492 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000145489 2024-09-13T06:41:11.492 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:11.493 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:11.493 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:11.493 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:11.493 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:11.493 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18803 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 6127616~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:41:11.493 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.877851+0000", 2024-09-13T06:41:11.493 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 79.544865780999999, 2024-09-13T06:41:11.493 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101951584, 2024-09-13T06:41:11.493 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:11.493 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:11.493 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:11.493 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:11.493 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:11.494 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18803 2024-09-13T06:41:11.494 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:11.494 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:11.494 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:11.494 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:11.494 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.877851+0000", 2024-09-13T06:41:11.494 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:11.494 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:11.494 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:11.494 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:11.494 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.877851+0000", 2024-09-13T06:41:11.494 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:11.495 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:11.495 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:11.495 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:11.495 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.877851+0000", 2024-09-13T06:41:11.495 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:11.495 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:11.495 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:11.495 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:11.495 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.877854+0000", 2024-09-13T06:41:11.495 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.7929999999999999e-06 2024-09-13T06:41:11.495 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:11.495 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:11.495 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:11.496 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.877864+0000", 2024-09-13T06:41:11.496 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.2029999999999998e-06 2024-09-13T06:41:11.496 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:11.496 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:11.496 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:11.496 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.877873+0000", 2024-09-13T06:41:11.496 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.0440000000000001e-06 2024-09-13T06:41:11.496 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:11.496 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:11.496 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:11.496 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.979544+0000", 2024-09-13T06:41:11.496 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101671198 2024-09-13T06:41:11.496 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:11.496 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:11.497 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:11.497 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.979658+0000", 2024-09-13T06:41:11.497 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000114456 2024-09-13T06:41:11.497 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:11.497 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:11.497 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:11.500 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.979803+0000", 2024-09-13T06:41:11.500 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000144506 2024-09-13T06:41:11.500 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:11.500 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:11.500 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:11.500 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:11.500 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:11.500 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18807 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 6242304~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:41:11.500 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.879235+0000", 2024-09-13T06:41:11.501 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 79.543481751000002, 2024-09-13T06:41:11.501 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101781258, 2024-09-13T06:41:11.501 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:11.501 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:11.501 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:11.501 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:11.501 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:11.501 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18807 2024-09-13T06:41:11.501 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:11.501 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:11.501 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:11.501 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:11.502 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879235+0000", 2024-09-13T06:41:11.502 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:11.502 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:11.502 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:11.502 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:11.502 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879235+0000", 2024-09-13T06:41:11.502 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:11.502 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:11.502 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:11.502 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:11.502 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879235+0000", 2024-09-13T06:41:11.502 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:11.502 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:11.502 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:11.503 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:11.503 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879239+0000", 2024-09-13T06:41:11.503 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.963e-06 2024-09-13T06:41:11.503 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:11.503 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:11.503 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:11.503 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879247+0000", 2024-09-13T06:41:11.503 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6470000000000004e-06 2024-09-13T06:41:11.503 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:11.503 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:11.503 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:11.503 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879255+0000", 2024-09-13T06:41:11.503 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5429999999999996e-06 2024-09-13T06:41:11.504 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:11.504 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:11.504 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:11.504 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.980756+0000", 2024-09-13T06:41:11.504 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10150165999999999 2024-09-13T06:41:11.504 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:11.504 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:11.504 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:11.504 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.980868+0000", 2024-09-13T06:41:11.504 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000111196 2024-09-13T06:41:11.504 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:11.505 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:11.505 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:11.505 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.981017+0000", 2024-09-13T06:41:11.505 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000148846 2024-09-13T06:41:11.505 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:11.505 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:11.505 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:11.505 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:11.505 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:11.505 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18808 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 6270976~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:41:11.505 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.879261+0000", 2024-09-13T06:41:11.505 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 79.543455612000002, 2024-09-13T06:41:11.505 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.102057547, 2024-09-13T06:41:11.506 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:11.506 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:11.506 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:11.506 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:11.506 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:11.506 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18808 2024-09-13T06:41:11.506 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:11.506 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:11.506 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:11.506 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:11.506 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879261+0000", 2024-09-13T06:41:11.506 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:11.506 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:11.506 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:11.506 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:11.507 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879261+0000", 2024-09-13T06:41:11.507 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:11.507 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:11.507 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:11.507 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:11.507 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879261+0000", 2024-09-13T06:41:11.507 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:11.507 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:11.507 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:11.507 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:11.507 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879264+0000", 2024-09-13T06:41:11.507 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.523e-06 2024-09-13T06:41:11.507 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:11.508 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:11.508 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:11.508 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879273+0000", 2024-09-13T06:41:11.508 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6070000000000008e-06 2024-09-13T06:41:11.508 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:11.508 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:11.508 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:11.508 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879280+0000", 2024-09-13T06:41:11.508 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.4699999999999996e-06 2024-09-13T06:41:11.508 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:11.508 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:11.508 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:11.509 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.981060+0000", 2024-09-13T06:41:11.509 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10177934800000001 2024-09-13T06:41:11.509 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:11.509 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:11.509 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:11.509 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.981174+0000", 2024-09-13T06:41:11.509 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000114456 2024-09-13T06:41:11.509 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:11.509 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:11.509 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:11.509 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.981319+0000", 2024-09-13T06:41:11.509 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00014473900000000001 2024-09-13T06:41:11.509 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:11.509 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:11.510 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:11.510 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:11.510 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:11.510 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18810 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 2662400~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:41:11.510 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.880386+0000", 2024-09-13T06:41:11.510 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 79.542331450000006, 2024-09-13T06:41:11.510 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101728022, 2024-09-13T06:41:11.510 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:11.510 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:11.510 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:11.510 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:11.510 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:11.511 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18810 2024-09-13T06:41:11.511 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:11.511 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:11.511 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:11.511 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:11.511 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880386+0000", 2024-09-13T06:41:11.511 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:11.511 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:11.511 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:11.511 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:11.512 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880386+0000", 2024-09-13T06:41:11.512 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:11.512 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:11.512 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:11.512 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:11.512 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880385+0000", 2024-09-13T06:41:11.512 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:11.512 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:11.512 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:11.512 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:11.512 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880389+0000", 2024-09-13T06:41:11.512 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.8539999999999999e-06 2024-09-13T06:41:11.512 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:11.513 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:11.513 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:11.513 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880398+0000", 2024-09-13T06:41:11.513 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.1689999999999998e-06 2024-09-13T06:41:11.513 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:11.513 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:11.513 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:11.513 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880405+0000", 2024-09-13T06:41:11.513 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5700000000000004e-06 2024-09-13T06:41:11.513 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:11.514 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:11.514 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:11.514 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.981833+0000", 2024-09-13T06:41:11.514 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10142791800000001 2024-09-13T06:41:11.514 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:11.514 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:11.514 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:11.514 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.981973+0000", 2024-09-13T06:41:11.514 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00014002900000000001 2024-09-13T06:41:11.514 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:11.514 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:11.514 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:11.514 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.982114+0000", 2024-09-13T06:41:11.515 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000140276 2024-09-13T06:41:11.515 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:11.515 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:11.515 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:11.515 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:11.515 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:11.515 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18811 3.9 3.140f5209 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:41:11.515 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.880449+0000", 2024-09-13T06:41:11.515 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 79.542268074000006, 2024-09-13T06:41:11.515 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101739355, 2024-09-13T06:41:11.515 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:11.515 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:41:11.515 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:11.516 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:11.516 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:11.516 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18811 2024-09-13T06:41:11.516 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:11.516 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:11.516 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:11.516 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:11.516 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880449+0000", 2024-09-13T06:41:11.516 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:11.516 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:11.516 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:11.516 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:11.516 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880449+0000", 2024-09-13T06:41:11.517 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:11.517 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:11.517 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:11.517 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:11.517 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880448+0000", 2024-09-13T06:41:11.517 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:11.517 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:11.517 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:11.517 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:11.517 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880452+0000", 2024-09-13T06:41:11.517 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0470000000000004e-06 2024-09-13T06:41:11.517 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:11.518 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:11.518 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:11.518 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880462+0000", 2024-09-13T06:41:11.518 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6530000000000006e-06 2024-09-13T06:41:11.518 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:11.518 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:11.518 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:11.518 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880472+0000", 2024-09-13T06:41:11.518 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0027000000000001e-05 2024-09-13T06:41:11.518 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:11.518 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:11.518 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:11.518 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.982172+0000", 2024-09-13T06:41:11.519 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10170043500000001 2024-09-13T06:41:11.519 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:11.519 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:11.519 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:11.519 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.982188+0000", 2024-09-13T06:41:11.519 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6172999999999999e-05 2024-09-13T06:41:11.519 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:11.519 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:11.519 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:11.519 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:11.519 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:11.519 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18812 3.9 3.140f5209 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:41:11.519 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.880478+0000", 2024-09-13T06:41:11.520 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 79.542238836999999, 2024-09-13T06:41:11.520 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10177795100000001, 2024-09-13T06:41:11.520 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:11.520 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:41:11.520 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:11.520 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:11.520 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:11.520 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18812 2024-09-13T06:41:11.520 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:11.520 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:11.520 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:11.520 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:11.521 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880478+0000", 2024-09-13T06:41:11.521 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:11.521 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:11.521 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:11.521 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:11.521 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880478+0000", 2024-09-13T06:41:11.521 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:11.521 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:11.521 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:11.521 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:11.521 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880477+0000", 2024-09-13T06:41:11.521 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:11.521 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:11.521 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:11.522 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:11.522 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880481+0000", 2024-09-13T06:41:11.522 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.827e-06 2024-09-13T06:41:11.522 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:11.522 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:11.522 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:11.522 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880490+0000", 2024-09-13T06:41:11.522 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6100000000000006e-06 2024-09-13T06:41:11.522 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:11.522 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:11.522 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:11.522 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880497+0000", 2024-09-13T06:41:11.523 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.7030000000000006e-06 2024-09-13T06:41:11.523 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:11.523 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:11.523 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:11.523 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.982241+0000", 2024-09-13T06:41:11.523 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10174351199999999 2024-09-13T06:41:11.523 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:11.523 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:11.523 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:11.523 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.982256+0000", 2024-09-13T06:41:11.523 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5143000000000001e-05 2024-09-13T06:41:11.523 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:11.524 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:11.524 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:11.524 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:11.524 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:11.524 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:41:11.525 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-13T06:41:11.526 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:41:11.527+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:41:11.627 INFO:tasks.ceph.osd.6.smithi139.stderr:2024-09-13T06:41:11.624+0000 7fcd02c5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26385) UID: 0 2024-09-13T06:41:11.653 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:41:11.654 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [ 2024-09-13T06:41:11.654 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:11.654 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:69764 3.2 3.1a008fe2 (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e117)", 2024-09-13T06:41:11.654 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:41:11.371147+0000", 2024-09-13T06:41:11.654 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.28405047100000003, 2024-09-13T06:41:11.654 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.28411580600000003, 2024-09-13T06:41:11.654 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:11.654 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "waiting for peered", 2024-09-13T06:41:11.654 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:11.654 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:11.654 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:11.654 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 69764 2024-09-13T06:41:11.654 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:11.655 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:11.655 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:11.655 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:11.655 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:11.371147+0000", 2024-09-13T06:41:11.655 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:11.655 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:11.655 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:11.655 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:11.655 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:11.371147+0000", 2024-09-13T06:41:11.655 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:11.655 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:11.655 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:11.655 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:11.656 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:11.371144+0000", 2024-09-13T06:41:11.656 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999967 2024-09-13T06:41:11.656 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:11.656 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:11.656 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:11.656 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:11.371161+0000", 2024-09-13T06:41:11.656 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7669e-05 2024-09-13T06:41:11.656 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:11.656 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:11.656 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:11.656 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:11.371198+0000", 2024-09-13T06:41:11.656 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.7014000000000002e-05 2024-09-13T06:41:11.656 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:11.657 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:11.657 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:11.657 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:11.371216+0000", 2024-09-13T06:41:11.657 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7425e-05 2024-09-13T06:41:11.657 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:11.657 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:11.657 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:11.657 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:11.371365+0000", 2024-09-13T06:41:11.657 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000149245 2024-09-13T06:41:11.657 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:11.657 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:11.657 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op must wait for map", 2024-09-13T06:41:11.657 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:11.371385+0000", 2024-09-13T06:41:11.657 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.0018999999999999e-05 2024-09-13T06:41:11.658 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:11.658 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:11.658 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:11.658 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:11.378406+0000", 2024-09-13T06:41:11.658 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0070207179999999996 2024-09-13T06:41:11.658 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:11.658 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:11.658 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:41:11.658 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:11.378429+0000", 2024-09-13T06:41:11.658 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.3453999999999999e-05 2024-09-13T06:41:11.658 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:11.658 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:11.658 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:11.658 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:11.659 INFO:teuthology.orchestra.run.smithi139.stdout: ], 2024-09-13T06:41:11.659 INFO:teuthology.orchestra.run.smithi139.stdout: "num_ops": 1 2024-09-13T06:41:11.659 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:41:11.667 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-13T06:41:11.728 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:41:11.727+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:41:11.829 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:41:11.828+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:41:11.829 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:41:11.829 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [], 2024-09-13T06:41:11.829 INFO:teuthology.orchestra.run.smithi139.stdout: "complaint_time": 30, 2024-09-13T06:41:11.829 INFO:teuthology.orchestra.run.smithi139.stdout: "num_blocked_ops": 0 2024-09-13T06:41:11.830 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:41:11.843 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-13T06:41:11.936 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:41:11.936+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:41:12.018 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:41:12.018 INFO:teuthology.orchestra.run.smithi139.stdout: "size": 20, 2024-09-13T06:41:12.018 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 600, 2024-09-13T06:41:12.019 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [ 2024-09-13T06:41:12.019 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.019 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43282 3.1d 3:bd80bfb3:::rbd_object_map.11212f44bfb1.0000000000000020:head [call rbd.object_map_update in=20b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:12.019 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589032+0000", 2024-09-13T06:41:12.019 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 50.427966451000003, 2024-09-13T06:41:12.019 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.076225263000000001, 2024-09-13T06:41:12.019 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:12.019 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:41:12.019 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:12.019 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:12.019 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:12.019 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43282 2024-09-13T06:41:12.019 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.020 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:12.020 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.020 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:12.020 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589032+0000", 2024-09-13T06:41:12.020 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:12.020 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.020 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.020 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:12.020 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589032+0000", 2024-09-13T06:41:12.020 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:12.020 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.020 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.020 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:12.020 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589031+0000", 2024-09-13T06:41:12.021 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:12.021 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.021 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.021 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:12.021 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589036+0000", 2024-09-13T06:41:12.021 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.2619999999999998e-06 2024-09-13T06:41:12.021 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.021 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.021 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:12.021 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589046+0000", 2024-09-13T06:41:12.021 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.8099999999999992e-06 2024-09-13T06:41:12.021 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.022 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.022 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:12.022 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589054+0000", 2024-09-13T06:41:12.022 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.2230000000000007e-06 2024-09-13T06:41:12.022 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.022 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.022 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:12.022 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.660691+0000", 2024-09-13T06:41:12.022 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.07163659 2024-09-13T06:41:12.022 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.022 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.022 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:12.022 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.660850+0000", 2024-09-13T06:41:12.023 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00015864300000000001 2024-09-13T06:41:12.023 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.023 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.023 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 4", 2024-09-13T06:41:12.023 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.661729+0000", 2024-09-13T06:41:12.023 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00087956099999999995 2024-09-13T06:41:12.023 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.023 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.023 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:41:12.023 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.664409+0000", 2024-09-13T06:41:12.023 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0026803479999999999 2024-09-13T06:41:12.023 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.023 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.024 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-13T06:41:12.024 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.665088+0000", 2024-09-13T06:41:12.024 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00067901400000000003 2024-09-13T06:41:12.024 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.024 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.024 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-13T06:41:12.024 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.665181+0000", 2024-09-13T06:41:12.024 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.2050000000000001e-05 2024-09-13T06:41:12.024 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.024 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.024 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:12.024 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.665257+0000", 2024-09-13T06:41:12.025 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.6698000000000003e-05 2024-09-13T06:41:12.025 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:12.025 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:12.025 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:12.025 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.025 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.025 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43288 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 270336~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:12.025 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589449+0000", 2024-09-13T06:41:12.025 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 50.427549198999998, 2024-09-13T06:41:12.025 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.074906773999999995, 2024-09-13T06:41:12.025 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:12.025 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:12.026 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:12.026 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:12.026 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:12.026 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43288 2024-09-13T06:41:12.026 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.026 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:12.026 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.026 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:12.026 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589449+0000", 2024-09-13T06:41:12.026 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:12.027 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.027 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.027 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:12.027 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589449+0000", 2024-09-13T06:41:12.027 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:12.027 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.027 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.027 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:12.027 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589449+0000", 2024-09-13T06:41:12.027 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:12.027 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.027 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.027 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:12.028 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589452+0000", 2024-09-13T06:41:12.028 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.5769999999999998e-06 2024-09-13T06:41:12.028 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.028 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.028 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:12.028 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589461+0000", 2024-09-13T06:41:12.028 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.5720000000000003e-06 2024-09-13T06:41:12.028 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.028 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.028 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:12.028 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589468+0000", 2024-09-13T06:41:12.028 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5859999999999999e-06 2024-09-13T06:41:12.028 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.029 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.029 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:12.029 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.663827+0000", 2024-09-13T06:41:12.029 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.074358704999999997 2024-09-13T06:41:12.029 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.029 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.029 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:12.029 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.664011+0000", 2024-09-13T06:41:12.029 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00018381699999999999 2024-09-13T06:41:12.029 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.029 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.029 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:12.030 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.664356+0000", 2024-09-13T06:41:12.030 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00034510999999999998 2024-09-13T06:41:12.030 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:12.030 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:12.030 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:12.030 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.030 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.030 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43289 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 284672~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:12.030 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589475+0000", 2024-09-13T06:41:12.030 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 50.427523801, 2024-09-13T06:41:12.030 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.075789117000000003, 2024-09-13T06:41:12.030 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:12.030 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:12.031 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:12.031 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:12.031 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:12.031 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43289 2024-09-13T06:41:12.031 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.031 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:12.031 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.031 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:12.031 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589475+0000", 2024-09-13T06:41:12.031 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:12.031 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.031 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.031 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:12.032 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589475+0000", 2024-09-13T06:41:12.032 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:12.032 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.032 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.032 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:12.032 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589474+0000", 2024-09-13T06:41:12.032 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:12.032 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.032 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.032 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:12.032 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589477+0000", 2024-09-13T06:41:12.032 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.7929999999999999e-06 2024-09-13T06:41:12.032 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.033 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.033 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:12.033 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589486+0000", 2024-09-13T06:41:12.033 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.4989999999999994e-06 2024-09-13T06:41:12.033 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.033 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.033 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:12.033 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589493+0000", 2024-09-13T06:41:12.033 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5329999999999997e-06 2024-09-13T06:41:12.033 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.033 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.033 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:12.033 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.664456+0000", 2024-09-13T06:41:12.034 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.074962794999999999 2024-09-13T06:41:12.034 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.034 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.034 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:12.034 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.664653+0000", 2024-09-13T06:41:12.034 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000197107 2024-09-13T06:41:12.034 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.034 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.034 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:12.034 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.665264+0000", 2024-09-13T06:41:12.034 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00061037600000000004 2024-09-13T06:41:12.034 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:12.034 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:12.034 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:12.035 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.035 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.035 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43290 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 299008~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:12.035 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589500+0000", 2024-09-13T06:41:12.035 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 50.427498288999999, 2024-09-13T06:41:12.035 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.075898564000000002, 2024-09-13T06:41:12.035 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:12.035 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:12.035 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:12.035 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:12.035 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:12.035 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43290 2024-09-13T06:41:12.035 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.036 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:12.036 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.036 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:12.036 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589500+0000", 2024-09-13T06:41:12.036 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:12.036 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.036 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.036 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:12.036 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589500+0000", 2024-09-13T06:41:12.036 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:12.036 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.036 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.037 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:12.037 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589499+0000", 2024-09-13T06:41:12.037 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:12.037 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.037 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.037 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:12.037 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589503+0000", 2024-09-13T06:41:12.037 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.8330000000000004e-06 2024-09-13T06:41:12.037 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.037 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.037 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:12.037 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589511+0000", 2024-09-13T06:41:12.037 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.3359999999999995e-06 2024-09-13T06:41:12.038 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.038 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.038 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:12.038 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589519+0000", 2024-09-13T06:41:12.038 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.4760000000000001e-06 2024-09-13T06:41:12.038 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.038 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.038 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:12.038 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.665097+0000", 2024-09-13T06:41:12.038 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.075577828999999999 2024-09-13T06:41:12.038 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.038 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.038 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:12.039 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.665170+0000", 2024-09-13T06:41:12.039 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.3745000000000006e-05 2024-09-13T06:41:12.039 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.039 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.039 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:12.039 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.665399+0000", 2024-09-13T06:41:12.039 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00022826199999999999 2024-09-13T06:41:12.039 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:12.039 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:12.039 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:12.039 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.039 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.039 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43291 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 313344~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:12.039 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589560+0000", 2024-09-13T06:41:12.040 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 50.427438068000001, 2024-09-13T06:41:12.040 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.076145594999999996, 2024-09-13T06:41:12.040 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:12.040 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:12.040 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:12.040 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:12.040 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:12.040 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43291 2024-09-13T06:41:12.040 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.040 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:12.040 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.040 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:12.041 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589560+0000", 2024-09-13T06:41:12.041 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:12.041 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.041 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.041 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:12.041 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589560+0000", 2024-09-13T06:41:12.041 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:12.041 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.041 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.041 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:12.041 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589559+0000", 2024-09-13T06:41:12.041 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:12.041 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.042 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.042 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:12.042 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589564+0000", 2024-09-13T06:41:12.042 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.3989999999999997e-06 2024-09-13T06:41:12.042 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.042 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.042 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:12.042 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589574+0000", 2024-09-13T06:41:12.042 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0502999999999999e-05 2024-09-13T06:41:12.042 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.042 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.042 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:12.042 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589582+0000", 2024-09-13T06:41:12.043 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.1859999999999992e-06 2024-09-13T06:41:12.043 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.043 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.043 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:12.043 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.665423+0000", 2024-09-13T06:41:12.043 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.075840290000000005 2024-09-13T06:41:12.043 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.043 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.043 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:12.043 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.665496+0000", 2024-09-13T06:41:12.043 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.2791000000000002e-05 2024-09-13T06:41:12.043 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.043 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.044 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:12.044 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.665706+0000", 2024-09-13T06:41:12.044 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00021038200000000001 2024-09-13T06:41:12.044 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:12.044 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:12.044 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:12.044 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.044 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.044 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43292 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 327680~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:12.044 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589589+0000", 2024-09-13T06:41:12.044 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 50.427409527000002, 2024-09-13T06:41:12.044 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.076769537999999998, 2024-09-13T06:41:12.044 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:12.045 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:12.045 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:12.045 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:12.045 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:12.045 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43292 2024-09-13T06:41:12.045 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.045 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:12.045 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.045 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:12.045 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589589+0000", 2024-09-13T06:41:12.045 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:12.045 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.045 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.046 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:12.046 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589589+0000", 2024-09-13T06:41:12.046 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:12.046 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.046 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.046 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:12.046 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589588+0000", 2024-09-13T06:41:12.046 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:12.046 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.046 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.046 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:12.046 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589592+0000", 2024-09-13T06:41:12.046 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.6389999999999998e-06 2024-09-13T06:41:12.047 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.047 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.047 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:12.047 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589600+0000", 2024-09-13T06:41:12.047 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.4630000000000001e-06 2024-09-13T06:41:12.047 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.047 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.047 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:12.047 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589608+0000", 2024-09-13T06:41:12.047 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.2359999999999998e-06 2024-09-13T06:41:12.047 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.047 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.047 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:12.047 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.665779+0000", 2024-09-13T06:41:12.048 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.076170924000000001 2024-09-13T06:41:12.048 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.048 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.048 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:12.048 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.665977+0000", 2024-09-13T06:41:12.048 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00019891900000000001 2024-09-13T06:41:12.048 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.048 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.048 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:12.048 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.666358+0000", 2024-09-13T06:41:12.048 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000380963 2024-09-13T06:41:12.048 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:12.048 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:12.049 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:12.049 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.049 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.049 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43293 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 342016~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:12.049 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589616+0000", 2024-09-13T06:41:12.049 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 50.427382633000001, 2024-09-13T06:41:12.049 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.077030083999999999, 2024-09-13T06:41:12.049 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:12.049 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:12.049 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:12.049 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:12.049 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:12.050 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43293 2024-09-13T06:41:12.050 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.050 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:12.050 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.050 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:12.050 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589616+0000", 2024-09-13T06:41:12.050 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:12.050 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.050 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.050 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:12.050 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589616+0000", 2024-09-13T06:41:12.050 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:12.050 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.050 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.051 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:12.051 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589615+0000", 2024-09-13T06:41:12.051 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:12.051 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.051 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.051 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:12.051 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589619+0000", 2024-09-13T06:41:12.051 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.9559999999999999e-06 2024-09-13T06:41:12.051 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.051 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.051 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:12.051 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589627+0000", 2024-09-13T06:41:12.051 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.2490000000000001e-06 2024-09-13T06:41:12.052 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.052 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.052 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:12.052 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589635+0000", 2024-09-13T06:41:12.052 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.96e-06 2024-09-13T06:41:12.052 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.052 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.052 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:12.052 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.666379+0000", 2024-09-13T06:41:12.052 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.076744484000000002 2024-09-13T06:41:12.052 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.052 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.052 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:12.053 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.666454+0000", 2024-09-13T06:41:12.053 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.4623999999999996e-05 2024-09-13T06:41:12.053 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.053 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.053 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:12.053 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.666646+0000", 2024-09-13T06:41:12.053 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00019176999999999999 2024-09-13T06:41:12.053 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:12.053 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:12.053 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:12.053 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.053 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.053 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43294 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 356352~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:12.054 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589681+0000", 2024-09-13T06:41:12.054 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 50.427317318, 2024-09-13T06:41:12.054 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.077594648000000002, 2024-09-13T06:41:12.054 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:12.054 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:12.054 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:12.054 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:12.054 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:12.054 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43294 2024-09-13T06:41:12.054 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.054 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:12.054 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.054 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:12.055 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589681+0000", 2024-09-13T06:41:12.055 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:12.055 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.055 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.055 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:12.055 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589681+0000", 2024-09-13T06:41:12.055 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:12.055 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.055 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.055 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:12.055 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589680+0000", 2024-09-13T06:41:12.055 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:12.055 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.056 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.056 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:12.056 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589684+0000", 2024-09-13T06:41:12.056 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.8369999999999999e-06 2024-09-13T06:41:12.056 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.056 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.056 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:12.056 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589693+0000", 2024-09-13T06:41:12.056 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.1020000000000003e-06 2024-09-13T06:41:12.056 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.056 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.056 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:12.057 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589701+0000", 2024-09-13T06:41:12.057 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.8059999999999995e-06 2024-09-13T06:41:12.057 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.057 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.057 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:12.057 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.666714+0000", 2024-09-13T06:41:12.057 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.077013463000000004 2024-09-13T06:41:12.057 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.057 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.057 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:12.057 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.666897+0000", 2024-09-13T06:41:12.057 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000182268 2024-09-13T06:41:12.057 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.057 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.058 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:12.058 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.667276+0000", 2024-09-13T06:41:12.058 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00037907499999999998 2024-09-13T06:41:12.058 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:12.058 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:12.058 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:12.058 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.058 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.058 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43295 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 370688~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:12.058 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589744+0000", 2024-09-13T06:41:12.058 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 50.427254146000003, 2024-09-13T06:41:12.058 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.077854343000000006, 2024-09-13T06:41:12.058 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:12.059 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:12.059 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:12.059 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:12.059 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:12.059 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43295 2024-09-13T06:41:12.059 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.059 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:12.059 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.059 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:12.059 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589744+0000", 2024-09-13T06:41:12.059 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:12.059 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.059 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.059 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:12.060 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589744+0000", 2024-09-13T06:41:12.060 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:12.060 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.060 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.060 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:12.060 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589743+0000", 2024-09-13T06:41:12.060 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:12.060 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.060 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.060 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:12.060 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589747+0000", 2024-09-13T06:41:12.060 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0130000000000004e-06 2024-09-13T06:41:12.060 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.060 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.061 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:12.061 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589756+0000", 2024-09-13T06:41:12.061 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.003e-06 2024-09-13T06:41:12.061 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.061 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.061 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:12.061 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589766+0000", 2024-09-13T06:41:12.061 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.2820000000000002e-06 2024-09-13T06:41:12.061 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.061 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.061 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:12.061 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.667300+0000", 2024-09-13T06:41:12.061 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.077534299000000001 2024-09-13T06:41:12.062 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.062 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.062 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:12.062 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.667372+0000", 2024-09-13T06:41:12.062 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.2393999999999998e-05 2024-09-13T06:41:12.062 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.062 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.062 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:12.062 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.667599+0000", 2024-09-13T06:41:12.062 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000226269 2024-09-13T06:41:12.062 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:12.062 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:12.062 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:12.062 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.063 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.063 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43296 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 385024~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:12.063 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589772+0000", 2024-09-13T06:41:12.063 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 50.427226122, 2024-09-13T06:41:12.063 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.078469647000000003, 2024-09-13T06:41:12.063 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:12.063 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:12.063 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:12.063 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:12.063 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:12.063 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43296 2024-09-13T06:41:12.063 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.063 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:12.064 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.064 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:12.064 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589772+0000", 2024-09-13T06:41:12.064 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:12.064 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.064 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.064 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:12.064 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589772+0000", 2024-09-13T06:41:12.064 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:12.064 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.064 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.064 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:12.064 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589771+0000", 2024-09-13T06:41:12.065 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:12.065 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.065 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.065 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:12.065 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589775+0000", 2024-09-13T06:41:12.065 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.8530000000000002e-06 2024-09-13T06:41:12.065 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.065 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.065 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:12.065 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589784+0000", 2024-09-13T06:41:12.065 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.4300000000000006e-06 2024-09-13T06:41:12.065 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.065 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.066 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:12.066 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589791+0000", 2024-09-13T06:41:12.066 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.4660000000000002e-06 2024-09-13T06:41:12.066 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.066 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.066 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:12.066 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.667667+0000", 2024-09-13T06:41:12.066 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.077875697999999993 2024-09-13T06:41:12.066 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.066 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.066 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:12.066 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.667854+0000", 2024-09-13T06:41:12.066 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00018760099999999999 2024-09-13T06:41:12.066 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.067 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.067 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:12.067 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.668242+0000", 2024-09-13T06:41:12.067 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00038750600000000003 2024-09-13T06:41:12.067 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:12.067 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:12.067 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:12.067 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.067 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.067 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43297 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 403456~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:12.067 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589797+0000", 2024-09-13T06:41:12.067 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 50.427201418000003, 2024-09-13T06:41:12.067 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.078756672999999999, 2024-09-13T06:41:12.068 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:12.068 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:12.068 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:12.068 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:12.068 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:12.068 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43297 2024-09-13T06:41:12.068 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.068 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:12.068 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.068 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:12.068 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589797+0000", 2024-09-13T06:41:12.068 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:12.068 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.068 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.069 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:12.069 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589797+0000", 2024-09-13T06:41:12.069 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:12.069 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.069 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.069 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:12.069 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589796+0000", 2024-09-13T06:41:12.069 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:12.069 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.069 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.069 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:12.069 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589800+0000", 2024-09-13T06:41:12.070 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.3230000000000002e-06 2024-09-13T06:41:12.070 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.070 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.070 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:12.070 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589808+0000", 2024-09-13T06:41:12.070 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.2390000000000002e-06 2024-09-13T06:41:12.070 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.070 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.070 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:12.070 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589815+0000", 2024-09-13T06:41:12.070 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.413e-06 2024-09-13T06:41:12.070 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.070 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.070 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:12.071 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.668265+0000", 2024-09-13T06:41:12.071 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.078449873000000003 2024-09-13T06:41:12.071 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.071 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.071 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:12.071 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.668332+0000", 2024-09-13T06:41:12.071 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.7178e-05 2024-09-13T06:41:12.071 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.071 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.071 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:12.071 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.668554+0000", 2024-09-13T06:41:12.071 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00022128600000000001 2024-09-13T06:41:12.072 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:12.072 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:12.072 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:12.072 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.072 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.072 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43298 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 417792~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:12.072 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589821+0000", 2024-09-13T06:41:12.072 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 50.427177295999996, 2024-09-13T06:41:12.072 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.079368660999999993, 2024-09-13T06:41:12.072 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:12.072 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:12.072 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:12.072 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:12.072 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:12.073 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43298 2024-09-13T06:41:12.073 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.073 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:12.073 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.073 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:12.073 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589821+0000", 2024-09-13T06:41:12.073 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:12.073 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.073 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.073 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:12.073 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589821+0000", 2024-09-13T06:41:12.073 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:12.073 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.074 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.074 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:12.074 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589821+0000", 2024-09-13T06:41:12.074 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:12.074 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.074 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.074 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:12.074 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589830+0000", 2024-09-13T06:41:12.074 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.4860000000000003e-06 2024-09-13T06:41:12.074 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.074 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.074 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:12.074 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589839+0000", 2024-09-13T06:41:12.074 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.0159999999999997e-06 2024-09-13T06:41:12.075 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.075 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.075 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:12.075 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589847+0000", 2024-09-13T06:41:12.075 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.6059999999999997e-06 2024-09-13T06:41:12.075 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.075 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.075 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:12.075 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.668620+0000", 2024-09-13T06:41:12.075 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.078773485000000004 2024-09-13T06:41:12.075 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.075 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.075 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:12.075 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.668798+0000", 2024-09-13T06:41:12.076 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000178233 2024-09-13T06:41:12.076 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.076 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.076 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:12.076 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.669190+0000", 2024-09-13T06:41:12.076 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00039143499999999998 2024-09-13T06:41:12.076 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:12.076 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:12.076 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:12.076 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.076 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.076 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43299 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 432128~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:12.076 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589881+0000", 2024-09-13T06:41:12.077 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 50.427117447999997, 2024-09-13T06:41:12.077 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.079693849999999997, 2024-09-13T06:41:12.077 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:12.077 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:12.077 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:12.077 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:12.077 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:12.077 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43299 2024-09-13T06:41:12.077 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.077 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:12.077 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.077 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:12.077 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589881+0000", 2024-09-13T06:41:12.078 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:12.078 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.078 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.078 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:12.078 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589881+0000", 2024-09-13T06:41:12.078 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:12.078 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.078 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.078 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:12.078 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589880+0000", 2024-09-13T06:41:12.078 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:12.078 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.078 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.078 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:12.079 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589884+0000", 2024-09-13T06:41:12.079 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.053e-06 2024-09-13T06:41:12.079 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.079 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.079 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:12.079 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589893+0000", 2024-09-13T06:41:12.079 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.2129999999999997e-06 2024-09-13T06:41:12.079 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.079 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.079 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:12.079 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589901+0000", 2024-09-13T06:41:12.079 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.6399999999999997e-06 2024-09-13T06:41:12.079 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.079 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.080 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:12.080 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.669213+0000", 2024-09-13T06:41:12.080 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.079312074999999996 2024-09-13T06:41:12.080 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.080 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.080 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:12.080 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.669281+0000", 2024-09-13T06:41:12.080 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.8322000000000001e-05 2024-09-13T06:41:12.080 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.080 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.080 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:12.080 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.669575+0000", 2024-09-13T06:41:12.081 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00029349699999999999 2024-09-13T06:41:12.081 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:12.081 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:12.081 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:12.081 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.081 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.081 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43300 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 446464~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:12.081 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589909+0000", 2024-09-13T06:41:12.081 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 50.427089553000002, 2024-09-13T06:41:12.081 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.080339496999999996, 2024-09-13T06:41:12.081 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:12.081 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:12.081 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:12.081 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:12.082 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:12.082 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43300 2024-09-13T06:41:12.082 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.082 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:12.082 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.082 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:12.082 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589909+0000", 2024-09-13T06:41:12.082 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:12.082 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.082 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.082 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:12.082 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589909+0000", 2024-09-13T06:41:12.082 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:12.083 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.083 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.083 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:12.083 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589908+0000", 2024-09-13T06:41:12.083 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:12.083 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.083 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.083 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:12.083 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589912+0000", 2024-09-13T06:41:12.083 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.9430000000000002e-06 2024-09-13T06:41:12.083 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.083 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.083 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:12.083 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589920+0000", 2024-09-13T06:41:12.084 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.3860000000000007e-06 2024-09-13T06:41:12.084 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.084 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.084 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:12.084 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589928+0000", 2024-09-13T06:41:12.084 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.3329999999999999e-06 2024-09-13T06:41:12.084 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.084 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.084 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:12.084 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.669651+0000", 2024-09-13T06:41:12.084 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.079723204000000006 2024-09-13T06:41:12.084 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.084 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.085 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:12.085 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.669840+0000", 2024-09-13T06:41:12.085 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000189397 2024-09-13T06:41:12.085 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.085 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.085 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:12.085 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.670248+0000", 2024-09-13T06:41:12.085 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00040811100000000001 2024-09-13T06:41:12.085 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:12.085 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:12.085 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:12.085 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.085 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.086 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43301 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 460800~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:12.086 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589934+0000", 2024-09-13T06:41:12.086 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 50.427064879, 2024-09-13T06:41:12.086 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.080747474999999999, 2024-09-13T06:41:12.086 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:12.086 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:12.086 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:12.086 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:12.086 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:12.086 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43301 2024-09-13T06:41:12.086 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.086 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:12.087 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.087 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:12.087 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589934+0000", 2024-09-13T06:41:12.087 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:12.087 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.087 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.087 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:12.087 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589934+0000", 2024-09-13T06:41:12.087 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:12.087 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.087 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.087 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:12.087 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589933+0000", 2024-09-13T06:41:12.088 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:12.088 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.088 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.088 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:12.088 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589936+0000", 2024-09-13T06:41:12.088 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.4599999999999999e-06 2024-09-13T06:41:12.088 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.088 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.088 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:12.088 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589945+0000", 2024-09-13T06:41:12.088 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.2430000000000005e-06 2024-09-13T06:41:12.088 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.088 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.089 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:12.089 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589952+0000", 2024-09-13T06:41:12.089 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.3289999999999996e-06 2024-09-13T06:41:12.089 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.089 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.089 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:12.089 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.670280+0000", 2024-09-13T06:41:12.089 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.080328514000000004 2024-09-13T06:41:12.089 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.089 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.089 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:12.089 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.670376+0000", 2024-09-13T06:41:12.089 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.5752000000000001e-05 2024-09-13T06:41:12.089 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.090 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.090 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:12.090 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.670681+0000", 2024-09-13T06:41:12.090 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00030479699999999999 2024-09-13T06:41:12.090 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:12.090 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:12.090 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:12.090 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.090 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.090 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43302 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 475136~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:12.090 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589958+0000", 2024-09-13T06:41:12.090 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 50.427040816999998, 2024-09-13T06:41:12.090 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.081402394000000003, 2024-09-13T06:41:12.091 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:12.091 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:12.091 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:12.091 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:12.091 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:12.091 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43302 2024-09-13T06:41:12.091 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.091 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:12.091 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.091 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:12.091 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589958+0000", 2024-09-13T06:41:12.091 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:12.091 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.092 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.092 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:12.092 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589958+0000", 2024-09-13T06:41:12.092 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:12.092 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.092 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.092 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:12.092 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589957+0000", 2024-09-13T06:41:12.092 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:12.092 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.092 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.092 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:12.092 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589960+0000", 2024-09-13T06:41:12.093 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.4939999999999999e-06 2024-09-13T06:41:12.093 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.093 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.093 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:12.093 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589969+0000", 2024-09-13T06:41:12.093 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.3520000000000007e-06 2024-09-13T06:41:12.093 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.093 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.093 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:12.093 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589976+0000", 2024-09-13T06:41:12.093 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.3030000000000002e-06 2024-09-13T06:41:12.093 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.093 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.094 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:12.094 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.670765+0000", 2024-09-13T06:41:12.094 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.080789154000000002 2024-09-13T06:41:12.094 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.094 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.094 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:12.094 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.670960+0000", 2024-09-13T06:41:12.094 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00019464300000000001 2024-09-13T06:41:12.094 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.094 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.094 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:12.094 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.671360+0000", 2024-09-13T06:41:12.094 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00040005200000000002 2024-09-13T06:41:12.094 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:12.095 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:12.095 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:12.095 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.095 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.095 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43303 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 489472~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:12.095 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589985+0000", 2024-09-13T06:41:12.095 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 50.427013869, 2024-09-13T06:41:12.095 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.082024333000000005, 2024-09-13T06:41:12.095 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:12.095 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:12.095 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:12.095 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:12.095 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:12.096 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43303 2024-09-13T06:41:12.096 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.096 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:12.096 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.096 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:12.096 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589985+0000", 2024-09-13T06:41:12.096 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:12.096 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.096 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.096 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:12.096 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589985+0000", 2024-09-13T06:41:12.096 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:12.096 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.096 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.097 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:12.097 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589984+0000", 2024-09-13T06:41:12.097 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:12.097 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.097 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.097 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:12.097 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589987+0000", 2024-09-13T06:41:12.097 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.726e-06 2024-09-13T06:41:12.097 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.097 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.097 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:12.097 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589996+0000", 2024-09-13T06:41:12.097 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.5459999999999992e-06 2024-09-13T06:41:12.098 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.098 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.098 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:12.098 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590003+0000", 2024-09-13T06:41:12.098 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.4229999999999999e-06 2024-09-13T06:41:12.098 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.098 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.098 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:12.098 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.671426+0000", 2024-09-13T06:41:12.098 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.081422704999999998 2024-09-13T06:41:12.098 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.098 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.098 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:12.099 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.671615+0000", 2024-09-13T06:41:12.099 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000188875 2024-09-13T06:41:12.099 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.099 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.099 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:12.099 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.672009+0000", 2024-09-13T06:41:12.099 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000394015 2024-09-13T06:41:12.099 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:12.099 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:12.099 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:12.099 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.099 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.099 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43304 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 503808~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:12.099 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.590039+0000", 2024-09-13T06:41:12.100 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 50.426959324000002, 2024-09-13T06:41:12.100 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.082573880000000002, 2024-09-13T06:41:12.100 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:12.100 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:12.100 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:12.100 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:12.100 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:12.100 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43304 2024-09-13T06:41:12.100 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.100 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:12.100 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.100 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:12.100 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590039+0000", 2024-09-13T06:41:12.101 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:12.101 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.101 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.101 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:12.101 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590039+0000", 2024-09-13T06:41:12.101 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:12.101 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.101 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.101 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:12.101 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590038+0000", 2024-09-13T06:41:12.101 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:12.101 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.101 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.102 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:12.102 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590042+0000", 2024-09-13T06:41:12.102 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.9500000000000003e-06 2024-09-13T06:41:12.102 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.102 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.102 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:12.102 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590052+0000", 2024-09-13T06:41:12.102 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.3919999999999992e-06 2024-09-13T06:41:12.102 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.102 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.102 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:12.102 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590059+0000", 2024-09-13T06:41:12.102 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.7970000000000001e-06 2024-09-13T06:41:12.103 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.103 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.103 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:12.103 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.672078+0000", 2024-09-13T06:41:12.103 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.082018778000000001 2024-09-13T06:41:12.103 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.103 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.103 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:12.103 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.672266+0000", 2024-09-13T06:41:12.103 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00018807399999999999 2024-09-13T06:41:12.103 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.103 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.103 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:12.104 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.672613+0000", 2024-09-13T06:41:12.104 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00034677599999999997 2024-09-13T06:41:12.104 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:12.104 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:12.104 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:12.104 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.104 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.104 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43305 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 518144~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:12.104 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.590136+0000", 2024-09-13T06:41:12.104 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 50.426862135999997, 2024-09-13T06:41:12.104 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.082988206999999994, 2024-09-13T06:41:12.104 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:12.104 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:12.105 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:12.105 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:12.105 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:12.105 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43305 2024-09-13T06:41:12.105 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.105 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:12.105 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.105 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:12.105 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590136+0000", 2024-09-13T06:41:12.105 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:12.105 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.105 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.106 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:12.106 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590136+0000", 2024-09-13T06:41:12.106 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:12.106 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.106 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.106 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:12.106 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590135+0000", 2024-09-13T06:41:12.106 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:12.106 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.106 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.106 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:12.106 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590139+0000", 2024-09-13T06:41:12.107 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.9489999999999998e-06 2024-09-13T06:41:12.107 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.107 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.107 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:12.107 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590148+0000", 2024-09-13T06:41:12.107 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.9830000000000002e-06 2024-09-13T06:41:12.107 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.107 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.107 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:12.107 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590156+0000", 2024-09-13T06:41:12.107 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5229999999999998e-06 2024-09-13T06:41:12.107 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.107 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.108 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:12.108 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.672709+0000", 2024-09-13T06:41:12.108 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.082552886000000006 2024-09-13T06:41:12.108 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.108 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.108 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:12.108 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.672816+0000", 2024-09-13T06:41:12.108 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000107736 2024-09-13T06:41:12.108 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.108 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.108 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:12.108 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.673124+0000", 2024-09-13T06:41:12.108 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00030804900000000002 2024-09-13T06:41:12.109 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:12.109 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:12.109 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:12.109 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.109 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.109 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:66818 3.17 3.50afe697 (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e100)", 2024-09-13T06:41:12.109 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:53.498942+0000", 2024-09-13T06:41:12.109 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 18.518055951000001, 2024-09-13T06:41:12.109 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.011231284, 2024-09-13T06:41:12.109 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:12.109 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:41:12.109 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:12.109 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:12.110 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:12.110 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 66818 2024-09-13T06:41:12.110 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.110 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:12.110 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.110 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:12.110 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:53.498942+0000", 2024-09-13T06:41:12.110 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:12.110 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.110 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.110 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:12.110 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:53.498942+0000", 2024-09-13T06:41:12.110 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:12.111 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.111 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.111 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:12.111 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:53.498939+0000", 2024-09-13T06:41:12.111 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999967 2024-09-13T06:41:12.111 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.111 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.111 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:12.111 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:53.498954+0000", 2024-09-13T06:41:12.111 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5028000000000001e-05 2024-09-13T06:41:12.111 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.111 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.111 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:12.112 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:53.498986+0000", 2024-09-13T06:41:12.112 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.1993999999999999e-05 2024-09-13T06:41:12.112 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.112 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.112 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:12.112 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:53.499001+0000", 2024-09-13T06:41:12.112 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5166e-05 2024-09-13T06:41:12.112 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.112 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.112 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:12.112 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:53.505097+0000", 2024-09-13T06:41:12.112 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0060955610000000002 2024-09-13T06:41:12.113 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.113 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.113 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:41:12.113 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:53.505108+0000", 2024-09-13T06:41:12.113 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.084e-05 2024-09-13T06:41:12.113 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.113 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.113 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:12.113 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:54.510158+0000", 2024-09-13T06:41:12.113 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0050497549999999 2024-09-13T06:41:12.113 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.113 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.113 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:12.114 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:54.510174+0000", 2024-09-13T06:41:12.114 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6164e-05 2024-09-13T06:41:12.114 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:12.114 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:12.114 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:12.114 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:12.114 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:12.114 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:41:12.118 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-13T06:41:12.118 INFO:tasks.ceph.osd.6.smithi139.stderr:2024-09-13T06:41:12.116+0000 7fcd02c5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26385) UID: 0 2024-09-13T06:41:12.219 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:41:12.219+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:41:12.285 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:41:12.286 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [], 2024-09-13T06:41:12.286 INFO:teuthology.orchestra.run.smithi139.stdout: "num_ops": 0 2024-09-13T06:41:12.286 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:41:12.299 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-13T06:41:12.320 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:41:12.319+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:41:12.404 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:41:12.404 INFO:teuthology.orchestra.run.smithi081.stdout:2825 write 0x7f09dcd thru 0x7f115c0 (0x77f4 bytes) 2024-09-13T06:41:12.410 INFO:teuthology.orchestra.run.smithi081.stdout:2826 read 0xc77fdf3 thru 0xc7871a4 (0x73b2 bytes) 2024-09-13T06:41:12.410 INFO:teuthology.orchestra.run.smithi081.stdout:2827 writesame 0x8fe124b thru 0x8feb522 data_size 0x48(0xa2d8 bytes) 2024-09-13T06:41:12.415 INFO:teuthology.orchestra.run.smithi081.stdout:2828 write 0x94f5952 thru 0x95005ad (0xac5c bytes) 2024-09-13T06:41:12.420 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-13T06:41:12.420+0000 7f86a5f06640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26387) UID: 0 2024-09-13T06:41:12.421 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:41:12.421 INFO:teuthology.orchestra.run.smithi081.stdout:2830 read 0xd1855e7 thru 0xd192472 (0xce8c bytes) 2024-09-13T06:41:12.431 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:41:12.431 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [], 2024-09-13T06:41:12.431 INFO:teuthology.orchestra.run.smithi139.stdout: "complaint_time": 30, 2024-09-13T06:41:12.431 INFO:teuthology.orchestra.run.smithi139.stdout: "num_blocked_ops": 0 2024-09-13T06:41:12.431 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:41:12.435 INFO:teuthology.orchestra.run.smithi081.stdout:2831 trunc from 0xd448aa8 to 0x7e7b212 2024-09-13T06:41:12.448 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-13T06:41:12.450 INFO:teuthology.orchestra.run.smithi081.stdout:2832 punch from 0x7b32bef to 0x7b3a379, (0x778a bytes) 2024-09-13T06:41:12.465 INFO:teuthology.orchestra.run.smithi081.stdout:2834 write 0xbf81d01 thru 0xbf84d1a (0x301a bytes) 2024-09-13T06:41:12.467 INFO:teuthology.orchestra.run.smithi081.stdout:2836 read 0x1b06cce thru 0x1b0981e (0x2b51 bytes) 2024-09-13T06:41:12.468 INFO:teuthology.orchestra.run.smithi081.stdout:2837 write 0x6d0cd49 thru 0x6d1a30a (0xd5c2 bytes) 2024-09-13T06:41:12.471 INFO:teuthology.orchestra.run.smithi081.stdout:2840 write 0x519b8e9 thru 0x51aa3de (0xeaf6 bytes) 2024-09-13T06:41:12.474 INFO:teuthology.orchestra.run.smithi081.stdout:2841 read 0x3f3589d thru 0x3f38d5e (0x34c2 bytes) 2024-09-13T06:41:12.491 INFO:teuthology.orchestra.run.smithi081.stdout:2842 trunc from 0xbf84d1b to 0x408bcff 2024-09-13T06:41:12.511 INFO:teuthology.orchestra.run.smithi081.stdout:2843 trunc from 0x408bcff to 0x8154023 2024-09-13T06:41:12.518 INFO:teuthology.orchestra.run.smithi081.stdout:2845 write 0x47ef0 thru 0x4bc35 (0x3d46 bytes) 2024-09-13T06:41:12.521 INFO:teuthology.orchestra.run.smithi081.stdout:2847 read 0x6530983 thru 0x65376b8 (0x6d36 bytes) 2024-09-13T06:41:12.521 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:41:12.518+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:41:12.521 INFO:teuthology.orchestra.run.smithi081.stdout:2848 read 0x43ba5ef thru 0x43c0c80 (0x6692 bytes) 2024-09-13T06:41:12.522 INFO:teuthology.orchestra.run.smithi081.stdout:2849 read 0x15010d1 thru 0x1506561 (0x5491 bytes) 2024-09-13T06:41:12.536 INFO:teuthology.orchestra.run.smithi081.stdout:2850 trunc from 0x8154023 to 0x198acb1 2024-09-13T06:41:12.548 INFO:teuthology.orchestra.run.smithi081.stdout:2851 read 0x29ff8c thru 0x2ac286 (0xc2fb bytes) 2024-09-13T06:41:12.592 INFO:teuthology.orchestra.run.smithi081.stdout:2852 write 0xeaf3e04 thru 0xeb03441 (0xf63e bytes) 2024-09-13T06:41:12.598 INFO:teuthology.orchestra.run.smithi081.stdout:2853 writesame 0x1cb4f41 thru 0x1cbafbd data_size 0x1(0x607d bytes) 2024-09-13T06:41:12.622 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:41:12.622+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:41:12.626 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:41:12.627 INFO:teuthology.orchestra.run.smithi139.stdout: "size": 20, 2024-09-13T06:41:12.627 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 600, 2024-09-13T06:41:12.627 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [ 2024-09-13T06:41:12.627 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.627 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27854 3.a 3:537b3559:::rbd_data.1121f2c5ee81.0000000000000016:13 [read 335872~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:12.627 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.658750+0000", 2024-09-13T06:41:12.627 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 75.968526334000003, 2024-09-13T06:41:12.627 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.037969532, 2024-09-13T06:41:12.627 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:12.627 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:12.628 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:12.628 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:12.628 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:12.628 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27854 2024-09-13T06:41:12.628 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.628 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:12.628 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.628 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:12.628 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658750+0000", 2024-09-13T06:41:12.628 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:12.628 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.628 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.628 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:12.629 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658750+0000", 2024-09-13T06:41:12.629 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:12.629 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.629 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.629 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:12.629 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658749+0000", 2024-09-13T06:41:12.629 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:12.629 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.629 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.629 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:12.629 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658757+0000", 2024-09-13T06:41:12.630 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.7389999999999999e-06 2024-09-13T06:41:12.630 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.630 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.630 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:12.630 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658763+0000", 2024-09-13T06:41:12.630 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.7769999999999999e-06 2024-09-13T06:41:12.630 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.630 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.630 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:12.630 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658767+0000", 2024-09-13T06:41:12.630 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.1749999999999998e-06 2024-09-13T06:41:12.630 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.630 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.631 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:12.631 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.696322+0000", 2024-09-13T06:41:12.631 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.037554772 2024-09-13T06:41:12.631 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.631 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.631 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:12.631 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.696418+0000", 2024-09-13T06:41:12.631 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6050000000000004e-05 2024-09-13T06:41:12.631 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.631 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.631 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:12.632 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.696719+0000", 2024-09-13T06:41:12.632 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00030138499999999999 2024-09-13T06:41:12.632 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:12.632 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:12.632 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:12.632 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.632 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.632 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27855 3.a 3:537b3559:::rbd_data.1121f2c5ee81.0000000000000016:13 [read 380928~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:12.632 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.658771+0000", 2024-09-13T06:41:12.632 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 75.968505089999994, 2024-09-13T06:41:12.633 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.038326354, 2024-09-13T06:41:12.633 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:12.633 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:12.633 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:12.633 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:12.633 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:12.633 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27855 2024-09-13T06:41:12.633 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.633 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:12.633 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.634 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:12.634 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658771+0000", 2024-09-13T06:41:12.634 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:12.634 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.634 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.634 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:12.634 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658771+0000", 2024-09-13T06:41:12.634 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:12.634 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.634 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.634 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:12.634 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658770+0000", 2024-09-13T06:41:12.634 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:12.634 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.635 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.635 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:12.635 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658772+0000", 2024-09-13T06:41:12.635 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.0930000000000001e-06 2024-09-13T06:41:12.635 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.635 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.635 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:12.635 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658778+0000", 2024-09-13T06:41:12.635 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.2730000000000002e-06 2024-09-13T06:41:12.635 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.635 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.635 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:12.635 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658782+0000", 2024-09-13T06:41:12.635 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0879999999999997e-06 2024-09-13T06:41:12.636 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.636 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.636 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:12.636 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.696770+0000", 2024-09-13T06:41:12.636 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.037988145000000001 2024-09-13T06:41:12.636 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.636 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.636 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:12.636 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.696852+0000", 2024-09-13T06:41:12.636 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.2039999999999994e-05 2024-09-13T06:41:12.636 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.636 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.637 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:12.637 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.697097+0000", 2024-09-13T06:41:12.637 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00024508800000000002 2024-09-13T06:41:12.637 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:12.637 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:12.637 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:12.637 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.637 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.637 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27856 3.a 3:537b3559:::rbd_data.1121f2c5ee81.0000000000000016:13 [read 405504~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:12.637 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.658786+0000", 2024-09-13T06:41:12.637 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 75.968489973999993, 2024-09-13T06:41:12.637 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.038736029999999998, 2024-09-13T06:41:12.637 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:12.638 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:12.638 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:12.638 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:12.638 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:12.638 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27856 2024-09-13T06:41:12.638 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.638 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:12.638 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.638 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:12.638 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658786+0000", 2024-09-13T06:41:12.638 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:12.638 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.638 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.639 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:12.639 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658786+0000", 2024-09-13T06:41:12.639 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:12.639 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.639 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.639 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:12.639 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658785+0000", 2024-09-13T06:41:12.639 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:12.639 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.639 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.639 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:12.640 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658787+0000", 2024-09-13T06:41:12.640 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.0040000000000002e-06 2024-09-13T06:41:12.640 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.640 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.640 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:12.640 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658793+0000", 2024-09-13T06:41:12.640 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.2410000000000003e-06 2024-09-13T06:41:12.640 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.640 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.640 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:12.640 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658797+0000", 2024-09-13T06:41:12.640 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.1330000000000001e-06 2024-09-13T06:41:12.640 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.640 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.641 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:12.641 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.697176+0000", 2024-09-13T06:41:12.641 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.038379074999999999 2024-09-13T06:41:12.641 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.641 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.641 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:12.641 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.697275+0000", 2024-09-13T06:41:12.641 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.8819000000000004e-05 2024-09-13T06:41:12.641 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.641 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.641 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:12.641 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.697522+0000", 2024-09-13T06:41:12.641 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00024719999999999999 2024-09-13T06:41:12.642 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:12.642 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:12.642 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:12.642 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.642 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.642 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27857 3.a 3:537b3559:::rbd_data.1121f2c5ee81.0000000000000016:13 [read 475136~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:12.642 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.658845+0000", 2024-09-13T06:41:12.642 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 75.968430971000004, 2024-09-13T06:41:12.642 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039112570999999999, 2024-09-13T06:41:12.642 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:12.642 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:12.642 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:12.643 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:12.643 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:12.643 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27857 2024-09-13T06:41:12.643 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.643 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:12.643 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.643 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:12.643 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658845+0000", 2024-09-13T06:41:12.643 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:12.643 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.643 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.643 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:12.643 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658845+0000", 2024-09-13T06:41:12.643 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:12.644 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.644 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.644 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:12.644 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658844+0000", 2024-09-13T06:41:12.644 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999986 2024-09-13T06:41:12.644 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.644 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.644 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:12.644 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658868+0000", 2024-09-13T06:41:12.644 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.4615000000000001e-05 2024-09-13T06:41:12.644 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.644 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.644 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:12.645 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658884+0000", 2024-09-13T06:41:12.645 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5401999999999999e-05 2024-09-13T06:41:12.645 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.645 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.645 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:12.645 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658896+0000", 2024-09-13T06:41:12.645 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2509e-05 2024-09-13T06:41:12.645 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.645 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.645 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:12.645 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.697571+0000", 2024-09-13T06:41:12.645 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.038675107 2024-09-13T06:41:12.646 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.646 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.646 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:12.646 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.697658+0000", 2024-09-13T06:41:12.646 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6349999999999998e-05 2024-09-13T06:41:12.646 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.646 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.646 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:12.646 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.697957+0000", 2024-09-13T06:41:12.646 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00029986100000000001 2024-09-13T06:41:12.646 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:12.646 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:12.647 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:12.647 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.647 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.647 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27858 3.a 3:537b3559:::rbd_data.1121f2c5ee81.0000000000000016:13 [read 499712~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:12.647 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.658905+0000", 2024-09-13T06:41:12.647 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 75.968370421000003, 2024-09-13T06:41:12.647 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039475392999999998, 2024-09-13T06:41:12.647 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:12.647 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:12.647 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:12.647 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:12.647 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:12.647 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27858 2024-09-13T06:41:12.648 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.648 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:12.648 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.648 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:12.648 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658905+0000", 2024-09-13T06:41:12.648 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:12.648 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.648 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.648 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:12.648 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658905+0000", 2024-09-13T06:41:12.648 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:12.648 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.648 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.648 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:12.649 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658905+0000", 2024-09-13T06:41:12.649 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:12.649 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.649 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.649 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:12.649 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658909+0000", 2024-09-13T06:41:12.649 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.831e-06 2024-09-13T06:41:12.649 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.649 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.649 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:12.650 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658920+0000", 2024-09-13T06:41:12.650 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0936e-05 2024-09-13T06:41:12.650 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.650 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.650 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:12.650 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658929+0000", 2024-09-13T06:41:12.650 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.2749999999999995e-06 2024-09-13T06:41:12.650 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.650 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.650 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:12.651 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.697990+0000", 2024-09-13T06:41:12.651 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039061625000000003 2024-09-13T06:41:12.651 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.651 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.651 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:12.651 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.698077+0000", 2024-09-13T06:41:12.651 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6922000000000006e-05 2024-09-13T06:41:12.651 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.651 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.651 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:12.651 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.698381+0000", 2024-09-13T06:41:12.651 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00030360599999999999 2024-09-13T06:41:12.651 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:12.652 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:12.652 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:12.652 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.652 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.652 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27929 3.a 3:537b3559:::rbd_data.1121f2c5ee81.0000000000000016:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:12.652 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.659338+0000", 2024-09-13T06:41:12.652 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 75.967937590000005, 2024-09-13T06:41:12.652 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039351214000000002, 2024-09-13T06:41:12.652 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:12.652 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:12.652 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:12.652 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:12.653 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:12.653 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27929 2024-09-13T06:41:12.653 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.653 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:12.653 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.653 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:12.653 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.659338+0000", 2024-09-13T06:41:12.653 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:12.653 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.653 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.653 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:12.653 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.659338+0000", 2024-09-13T06:41:12.653 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:12.654 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.654 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.654 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:12.654 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.659337+0000", 2024-09-13T06:41:12.654 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:12.654 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.654 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.654 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:12.654 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.659342+0000", 2024-09-13T06:41:12.654 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0799999999999999e-06 2024-09-13T06:41:12.654 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.654 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.654 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:12.654 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.659353+0000", 2024-09-13T06:41:12.655 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1798e-05 2024-09-13T06:41:12.655 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.655 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.655 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:12.655 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.659361+0000", 2024-09-13T06:41:12.655 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.8040000000000002e-06 2024-09-13T06:41:12.655 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.655 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.655 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:12.655 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.698449+0000", 2024-09-13T06:41:12.655 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039087519000000001 2024-09-13T06:41:12.655 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.655 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.656 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:12.656 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.698567+0000", 2024-09-13T06:41:12.656 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00011857 2024-09-13T06:41:12.656 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.656 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.656 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:12.656 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.698689+0000", 2024-09-13T06:41:12.656 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00012226699999999999 2024-09-13T06:41:12.656 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:12.656 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:12.656 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:12.656 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.656 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.657 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27974 3.a 3:537b3559:::rbd_data.1121f2c5ee81.0000000000000016:13 [read 32768~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:12.657 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.660102+0000", 2024-09-13T06:41:12.657 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 75.967173822000007, 2024-09-13T06:41:12.657 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.038972346999999997, 2024-09-13T06:41:12.657 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:12.657 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:12.657 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:12.657 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:12.657 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:12.657 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27974 2024-09-13T06:41:12.657 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.657 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:12.657 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.658 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:12.658 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660102+0000", 2024-09-13T06:41:12.658 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:12.658 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.658 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.658 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:12.658 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660102+0000", 2024-09-13T06:41:12.658 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:12.658 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.658 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.658 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:12.658 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660100+0000", 2024-09-13T06:41:12.659 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999976 2024-09-13T06:41:12.659 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.659 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.659 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:12.659 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660114+0000", 2024-09-13T06:41:12.659 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.4466e-05 2024-09-13T06:41:12.659 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.659 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.659 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:12.659 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660148+0000", 2024-09-13T06:41:12.659 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.3742999999999999e-05 2024-09-13T06:41:12.659 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.659 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.660 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:12.660 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660170+0000", 2024-09-13T06:41:12.660 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.2518e-05 2024-09-13T06:41:12.660 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.660 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.660 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:12.660 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.698719+0000", 2024-09-13T06:41:12.660 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.038548529999999998 2024-09-13T06:41:12.660 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.660 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.660 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:12.661 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.698806+0000", 2024-09-13T06:41:12.661 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.7179e-05 2024-09-13T06:41:12.661 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.661 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.661 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:12.661 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.699074+0000", 2024-09-13T06:41:12.661 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00026834800000000001 2024-09-13T06:41:12.661 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:12.661 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:12.661 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:12.661 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.661 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.662 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27975 3.a 3:537b3559:::rbd_data.1121f2c5ee81.0000000000000016:13 [read 57344~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:12.662 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.660189+0000", 2024-09-13T06:41:12.662 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 75.967086977999998, 2024-09-13T06:41:12.662 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039288678, 2024-09-13T06:41:12.662 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:12.662 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:12.662 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:12.662 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:12.662 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:12.662 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27975 2024-09-13T06:41:12.662 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.662 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:12.662 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.662 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:12.663 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660189+0000", 2024-09-13T06:41:12.663 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:12.663 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.663 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.663 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:12.663 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660189+0000", 2024-09-13T06:41:12.663 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:12.663 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.663 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.663 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:12.663 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660187+0000", 2024-09-13T06:41:12.663 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999981 2024-09-13T06:41:12.664 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.664 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.664 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:12.664 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660195+0000", 2024-09-13T06:41:12.664 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5610000000000001e-06 2024-09-13T06:41:12.664 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.664 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.664 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:12.664 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660212+0000", 2024-09-13T06:41:12.664 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7725999999999999e-05 2024-09-13T06:41:12.664 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.664 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.664 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:12.665 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660227+0000", 2024-09-13T06:41:12.665 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.43e-05 2024-09-13T06:41:12.665 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.665 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.665 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:12.665 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.699135+0000", 2024-09-13T06:41:12.665 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.038908336000000002 2024-09-13T06:41:12.665 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.665 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.665 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:12.665 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.699208+0000", 2024-09-13T06:41:12.665 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.3065000000000006e-05 2024-09-13T06:41:12.665 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.665 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.666 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:12.666 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.699478+0000", 2024-09-13T06:41:12.666 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00026946899999999999 2024-09-13T06:41:12.666 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:12.666 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:12.666 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:12.666 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.666 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.666 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27976 3.a 3:537b3559:::rbd_data.1121f2c5ee81.0000000000000016:13 [read 102400~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:12.666 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.660238+0000", 2024-09-13T06:41:12.666 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 75.967037814999998, 2024-09-13T06:41:12.666 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039636515999999997, 2024-09-13T06:41:12.667 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:12.667 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:12.667 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:12.667 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:12.667 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:12.667 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27976 2024-09-13T06:41:12.667 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.667 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:12.667 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.667 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:12.667 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660238+0000", 2024-09-13T06:41:12.667 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:12.668 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.668 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.668 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:12.668 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660238+0000", 2024-09-13T06:41:12.668 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:12.668 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.668 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.668 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:12.668 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660237+0000", 2024-09-13T06:41:12.668 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:12.668 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.668 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.668 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:12.669 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660243+0000", 2024-09-13T06:41:12.669 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.9909999999999999e-06 2024-09-13T06:41:12.669 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.669 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.669 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:12.669 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660259+0000", 2024-09-13T06:41:12.669 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6294e-05 2024-09-13T06:41:12.669 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.669 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.669 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:12.669 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660272+0000", 2024-09-13T06:41:12.670 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2714999999999999e-05 2024-09-13T06:41:12.670 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.670 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.670 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:12.670 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.699513+0000", 2024-09-13T06:41:12.670 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039240932999999999 2024-09-13T06:41:12.670 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.670 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.670 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:12.670 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.699604+0000", 2024-09-13T06:41:12.670 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.1367999999999997e-05 2024-09-13T06:41:12.670 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.670 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.671 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:12.671 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.699875+0000", 2024-09-13T06:41:12.671 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00027029499999999999 2024-09-13T06:41:12.671 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:12.671 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:12.671 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:12.671 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.671 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.671 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27977 3.a 3:537b3559:::rbd_data.1121f2c5ee81.0000000000000016:13 [read 126976~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:12.671 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.660284+0000", 2024-09-13T06:41:12.671 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 75.966992242999993, 2024-09-13T06:41:12.671 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039969945, 2024-09-13T06:41:12.671 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:12.672 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:12.672 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:12.672 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:12.672 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:12.672 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27977 2024-09-13T06:41:12.672 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.672 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:12.672 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.672 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:12.672 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660284+0000", 2024-09-13T06:41:12.672 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:12.672 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.672 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.673 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:12.673 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660284+0000", 2024-09-13T06:41:12.673 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:12.673 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.673 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.673 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:12.673 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660282+0000", 2024-09-13T06:41:12.673 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999986 2024-09-13T06:41:12.673 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.673 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.673 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:12.674 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660288+0000", 2024-09-13T06:41:12.674 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.2650000000000002e-06 2024-09-13T06:41:12.674 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.674 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.674 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:12.674 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660304+0000", 2024-09-13T06:41:12.674 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5430999999999998e-05 2024-09-13T06:41:12.674 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.674 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.674 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:12.674 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660316+0000", 2024-09-13T06:41:12.674 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.237e-05 2024-09-13T06:41:12.674 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.675 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.675 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:12.675 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.699907+0000", 2024-09-13T06:41:12.675 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039590735000000002 2024-09-13T06:41:12.675 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.675 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.675 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:12.675 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.699994+0000", 2024-09-13T06:41:12.675 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6996999999999994e-05 2024-09-13T06:41:12.675 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.675 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.676 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:12.676 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700254+0000", 2024-09-13T06:41:12.676 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000259564 2024-09-13T06:41:12.676 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:12.676 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:12.676 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:12.676 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.676 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.676 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27978 3.a 3.9aacdeca (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:12.676 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.660327+0000", 2024-09-13T06:41:12.676 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 75.966948645000002, 2024-09-13T06:41:12.676 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039984858999999998, 2024-09-13T06:41:12.676 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:12.677 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:41:12.677 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:12.677 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:12.677 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:12.677 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27978 2024-09-13T06:41:12.677 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.677 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:12.677 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.677 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:12.677 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660327+0000", 2024-09-13T06:41:12.677 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:12.677 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.678 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.678 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:12.678 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660327+0000", 2024-09-13T06:41:12.678 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:12.678 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.678 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.678 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:12.678 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660326+0000", 2024-09-13T06:41:12.678 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:12.678 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.678 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.678 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:12.679 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660366+0000", 2024-09-13T06:41:12.679 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.9691000000000003e-05 2024-09-13T06:41:12.679 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.679 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.679 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:12.679 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660399+0000", 2024-09-13T06:41:12.679 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.3262000000000001e-05 2024-09-13T06:41:12.679 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.679 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.679 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:12.679 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660414+0000", 2024-09-13T06:41:12.679 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.4775e-05 2024-09-13T06:41:12.679 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.680 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.680 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:12.680 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700298+0000", 2024-09-13T06:41:12.680 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039883759999999997 2024-09-13T06:41:12.680 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.680 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.680 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:12.680 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700312+0000", 2024-09-13T06:41:12.680 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.4374e-05 2024-09-13T06:41:12.680 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:12.680 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:12.681 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:12.681 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.681 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.681 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27979 3.a 3.9aacdeca (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:12.681 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.660429+0000", 2024-09-13T06:41:12.681 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 75.966846777000001, 2024-09-13T06:41:12.681 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039921361000000002, 2024-09-13T06:41:12.681 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:12.681 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:41:12.681 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:12.681 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:12.681 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:12.682 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27979 2024-09-13T06:41:12.682 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.682 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:12.682 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.682 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:12.682 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660429+0000", 2024-09-13T06:41:12.682 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:12.682 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.682 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.682 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:12.682 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660429+0000", 2024-09-13T06:41:12.682 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:12.682 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.683 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.683 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:12.683 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660428+0000", 2024-09-13T06:41:12.683 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999986 2024-09-13T06:41:12.683 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.683 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.683 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:12.683 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660434+0000", 2024-09-13T06:41:12.683 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.8190000000000003e-06 2024-09-13T06:41:12.683 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.683 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.683 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:12.683 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660451+0000", 2024-09-13T06:41:12.684 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6963e-05 2024-09-13T06:41:12.684 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.684 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.684 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:12.684 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660485+0000", 2024-09-13T06:41:12.684 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.3414000000000002e-05 2024-09-13T06:41:12.684 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.684 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.684 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:12.684 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700342+0000", 2024-09-13T06:41:12.684 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039857278000000003 2024-09-13T06:41:12.684 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.685 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.685 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:12.685 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700350+0000", 2024-09-13T06:41:12.685 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.2930000000000001e-06 2024-09-13T06:41:12.685 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:12.685 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:12.685 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:12.685 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.685 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.685 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27980 3.a 3.9aacdeca (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:12.685 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.660497+0000", 2024-09-13T06:41:12.685 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 75.966778566000002, 2024-09-13T06:41:12.686 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039888034000000003, 2024-09-13T06:41:12.686 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:12.686 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:41:12.686 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:12.686 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:12.686 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:12.686 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27980 2024-09-13T06:41:12.686 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.686 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:12.686 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.686 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:12.686 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660497+0000", 2024-09-13T06:41:12.686 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:12.687 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.687 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.687 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:12.687 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660497+0000", 2024-09-13T06:41:12.687 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:12.687 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.687 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.687 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:12.687 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660496+0000", 2024-09-13T06:41:12.687 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:12.687 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.687 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.687 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:12.688 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660503+0000", 2024-09-13T06:41:12.688 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.4110000000000001e-06 2024-09-13T06:41:12.688 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.688 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.688 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:12.688 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660519+0000", 2024-09-13T06:41:12.688 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6180000000000001e-05 2024-09-13T06:41:12.688 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.688 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.688 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:12.688 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660544+0000", 2024-09-13T06:41:12.688 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.5177999999999998e-05 2024-09-13T06:41:12.689 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.689 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.689 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:12.689 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700377+0000", 2024-09-13T06:41:12.689 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039833434000000001 2024-09-13T06:41:12.689 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.689 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.689 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:12.689 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700385+0000", 2024-09-13T06:41:12.689 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.8800000000000008e-06 2024-09-13T06:41:12.689 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:12.689 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:12.690 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:12.690 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.690 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.690 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27981 3.a 3.9aacdeca (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:12.690 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.660556+0000", 2024-09-13T06:41:12.690 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 75.966720219999999, 2024-09-13T06:41:12.690 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039869989000000002, 2024-09-13T06:41:12.690 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:12.690 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:41:12.690 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:12.690 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:12.690 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:12.691 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27981 2024-09-13T06:41:12.691 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.691 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:12.691 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.691 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:12.691 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660556+0000", 2024-09-13T06:41:12.691 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:12.691 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.691 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.691 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:12.691 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660556+0000", 2024-09-13T06:41:12.692 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:12.692 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.692 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.692 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:12.692 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660555+0000", 2024-09-13T06:41:12.692 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:12.692 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.692 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.692 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:12.692 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660561+0000", 2024-09-13T06:41:12.692 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.088e-06 2024-09-13T06:41:12.692 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.693 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.693 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:12.693 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660577+0000", 2024-09-13T06:41:12.693 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6147999999999999e-05 2024-09-13T06:41:12.693 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.693 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.693 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:12.693 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660589+0000", 2024-09-13T06:41:12.693 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2551999999999999e-05 2024-09-13T06:41:12.693 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.693 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.693 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:12.693 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700414+0000", 2024-09-13T06:41:12.693 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039825007000000003 2024-09-13T06:41:12.694 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.694 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.694 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:12.694 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700426+0000", 2024-09-13T06:41:12.694 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1265e-05 2024-09-13T06:41:12.694 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:12.694 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:12.694 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:12.694 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.694 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.695 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27982 3.a 3.9aacdeca (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:12.695 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.660603+0000", 2024-09-13T06:41:12.695 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 75.966672625000001, 2024-09-13T06:41:12.695 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039874779999999999, 2024-09-13T06:41:12.695 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:12.695 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:41:12.695 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:12.695 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:12.695 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:12.695 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27982 2024-09-13T06:41:12.695 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.695 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:12.696 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.696 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:12.696 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660603+0000", 2024-09-13T06:41:12.696 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:12.696 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.696 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.696 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:12.696 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660603+0000", 2024-09-13T06:41:12.696 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:12.696 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.696 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.696 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:12.696 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660602+0000", 2024-09-13T06:41:12.697 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:12.697 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.697 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.697 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:12.697 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660653+0000", 2024-09-13T06:41:12.697 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.0862000000000002e-05 2024-09-13T06:41:12.697 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.697 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.697 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:12.697 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660697+0000", 2024-09-13T06:41:12.698 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.3773000000000003e-05 2024-09-13T06:41:12.698 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.698 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.698 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:12.698 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660712+0000", 2024-09-13T06:41:12.698 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5464999999999998e-05 2024-09-13T06:41:12.698 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.698 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.698 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:12.699 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700469+0000", 2024-09-13T06:41:12.699 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039756503999999998 2024-09-13T06:41:12.699 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.699 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.699 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:12.699 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700478+0000", 2024-09-13T06:41:12.699 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.1730000000000001e-06 2024-09-13T06:41:12.699 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:12.699 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:12.699 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:12.699 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.700 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.700 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27983 3.a 3.9aacdeca (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:12.700 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.660726+0000", 2024-09-13T06:41:12.700 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 75.966549349999994, 2024-09-13T06:41:12.700 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039804357999999998, 2024-09-13T06:41:12.700 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:12.700 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:41:12.700 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:12.700 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:12.700 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:12.700 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27983 2024-09-13T06:41:12.700 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.701 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:12.701 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.701 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:12.701 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660726+0000", 2024-09-13T06:41:12.701 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:12.701 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.701 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.701 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:12.701 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660726+0000", 2024-09-13T06:41:12.701 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:12.701 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.701 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.701 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:12.702 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660725+0000", 2024-09-13T06:41:12.702 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999986 2024-09-13T06:41:12.702 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.702 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.702 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:12.702 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660733+0000", 2024-09-13T06:41:12.702 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.9359999999999999e-06 2024-09-13T06:41:12.702 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.702 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.702 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:12.702 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660751+0000", 2024-09-13T06:41:12.702 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7679000000000001e-05 2024-09-13T06:41:12.702 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.702 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.703 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:12.703 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660764+0000", 2024-09-13T06:41:12.703 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3112000000000001e-05 2024-09-13T06:41:12.703 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.703 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.703 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:12.703 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700516+0000", 2024-09-13T06:41:12.703 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039752183000000003 2024-09-13T06:41:12.703 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.703 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.703 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:12.703 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700531+0000", 2024-09-13T06:41:12.704 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.4732999999999999e-05 2024-09-13T06:41:12.704 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:12.704 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:12.704 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:12.704 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.704 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.704 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27984 3.a 3.9aacdeca (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:12.704 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.660776+0000", 2024-09-13T06:41:12.704 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 75.966500246999999, 2024-09-13T06:41:12.704 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039795697999999997, 2024-09-13T06:41:12.704 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:12.704 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:41:12.705 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:12.705 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:12.705 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:12.705 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27984 2024-09-13T06:41:12.705 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.705 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:12.705 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.705 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:12.705 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660776+0000", 2024-09-13T06:41:12.705 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:12.705 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.706 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.706 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:12.706 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660776+0000", 2024-09-13T06:41:12.706 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:12.706 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.706 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.706 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:12.706 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660775+0000", 2024-09-13T06:41:12.706 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:12.706 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.706 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.706 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:12.706 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660780+0000", 2024-09-13T06:41:12.706 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.7849999999999997e-06 2024-09-13T06:41:12.707 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.707 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.707 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:12.707 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660799+0000", 2024-09-13T06:41:12.707 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.8794e-05 2024-09-13T06:41:12.707 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.707 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.707 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:12.707 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660812+0000", 2024-09-13T06:41:12.707 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3029e-05 2024-09-13T06:41:12.707 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.707 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.708 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:12.708 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700562+0000", 2024-09-13T06:41:12.708 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039749984000000002 2024-09-13T06:41:12.708 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.708 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.708 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:12.708 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700571+0000", 2024-09-13T06:41:12.708 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.1260000000000004e-06 2024-09-13T06:41:12.708 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:12.708 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:12.708 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:12.708 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.709 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.709 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27985 3.a 3.9aacdeca (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:12.709 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.660824+0000", 2024-09-13T06:41:12.709 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 75.966452195000002, 2024-09-13T06:41:12.709 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039784462, 2024-09-13T06:41:12.709 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:12.709 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:41:12.709 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:12.709 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:12.709 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:12.709 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27985 2024-09-13T06:41:12.709 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.709 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:12.710 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.710 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:12.710 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660824+0000", 2024-09-13T06:41:12.710 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:12.710 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.710 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.710 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:12.710 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660824+0000", 2024-09-13T06:41:12.710 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:12.710 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.710 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.710 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:12.710 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660823+0000", 2024-09-13T06:41:12.711 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:12.711 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.711 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.711 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:12.711 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660829+0000", 2024-09-13T06:41:12.711 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.9440000000000002e-06 2024-09-13T06:41:12.711 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.711 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.711 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:12.711 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660922+0000", 2024-09-13T06:41:12.711 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.2958e-05 2024-09-13T06:41:12.711 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.711 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.711 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:12.712 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660964+0000", 2024-09-13T06:41:12.712 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.2407000000000002e-05 2024-09-13T06:41:12.712 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.712 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.712 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:12.712 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700600+0000", 2024-09-13T06:41:12.712 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039635581000000003 2024-09-13T06:41:12.712 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.712 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.712 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:12.712 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700608+0000", 2024-09-13T06:41:12.712 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.5890000000000003e-06 2024-09-13T06:41:12.712 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:12.713 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:12.713 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:12.713 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.713 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.713 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:28023 3.10 3:0dedc28a:::rbd_data.1121f2c5ee81.0000000000000019:13 [read 475136~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:12.713 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.662072+0000", 2024-09-13T06:41:12.713 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 75.965204209999996, 2024-09-13T06:41:12.713 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.038086508999999998, 2024-09-13T06:41:12.713 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:12.714 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:12.714 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:12.714 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:12.714 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:12.714 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 28023 2024-09-13T06:41:12.714 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.714 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:12.714 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.714 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:12.714 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.662072+0000", 2024-09-13T06:41:12.714 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:12.714 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.714 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.715 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:12.715 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.662072+0000", 2024-09-13T06:41:12.715 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:12.715 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.715 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.715 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:12.715 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.662070+0000", 2024-09-13T06:41:12.715 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999986 2024-09-13T06:41:12.715 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.715 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.715 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:12.715 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.662076+0000", 2024-09-13T06:41:12.716 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.139e-06 2024-09-13T06:41:12.716 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.716 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.716 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:12.716 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.662094+0000", 2024-09-13T06:41:12.716 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7136999999999999e-05 2024-09-13T06:41:12.716 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.716 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.716 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:12.716 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.662124+0000", 2024-09-13T06:41:12.716 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.0528999999999999e-05 2024-09-13T06:41:12.716 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.717 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.717 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:12.717 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.699843+0000", 2024-09-13T06:41:12.717 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.037718415999999998 2024-09-13T06:41:12.717 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.717 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.717 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:12.717 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.699931+0000", 2024-09-13T06:41:12.717 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.8345999999999997e-05 2024-09-13T06:41:12.717 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.717 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.717 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:12.718 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700158+0000", 2024-09-13T06:41:12.718 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00022723099999999999 2024-09-13T06:41:12.718 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:12.718 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:12.718 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:12.718 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.718 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.718 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:28024 3.10 3.5143b7b0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:12.718 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.662137+0000", 2024-09-13T06:41:12.718 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 75.965138687999996, 2024-09-13T06:41:12.719 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.038056092999999999, 2024-09-13T06:41:12.719 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:12.719 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:41:12.719 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:12.719 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:12.719 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:12.719 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 28024 2024-09-13T06:41:12.719 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.720 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:12.720 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.720 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:12.720 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.662137+0000", 2024-09-13T06:41:12.720 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:12.721 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.721 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.721 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:12.721 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.662137+0000", 2024-09-13T06:41:12.721 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:12.721 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.721 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.721 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:12.721 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.662136+0000", 2024-09-13T06:41:12.721 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999986 2024-09-13T06:41:12.721 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.722 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.722 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:12.722 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.662142+0000", 2024-09-13T06:41:12.722 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.6930000000000001e-06 2024-09-13T06:41:12.722 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.722 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.722 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:12.722 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.662160+0000", 2024-09-13T06:41:12.722 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7863000000000002e-05 2024-09-13T06:41:12.722 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.722 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.722 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:12.722 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.662189+0000", 2024-09-13T06:41:12.723 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.8486000000000001e-05 2024-09-13T06:41:12.723 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.723 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.723 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:12.723 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700187+0000", 2024-09-13T06:41:12.723 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.037998331000000003 2024-09-13T06:41:12.723 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.723 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.723 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:12.723 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700193+0000", 2024-09-13T06:41:12.723 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.0909999999999998e-06 2024-09-13T06:41:12.723 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:12.723 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:12.724 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:12.724 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:12.724 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:12.724 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:41:12.726 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-13T06:41:12.729 INFO:teuthology.orchestra.run.smithi081.stdout:2855 read 0x70605c9 thru 0x706821e (0x7c56 bytes) 2024-09-13T06:41:12.729 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:41:12.729 INFO:teuthology.orchestra.run.smithi081.stdout:2859 read 0x13494c5 thru 0x13587ff (0xf33b bytes) 2024-09-13T06:41:12.729 INFO:teuthology.orchestra.run.smithi081.stdout:2861 punch from 0xe88843e to 0xe88e976, (0x6538 bytes) 2024-09-13T06:41:12.729 INFO:teuthology.orchestra.run.smithi081.stdout:2862 write 0xdc9c841 thru 0xdc9de82 (0x1642 bytes) 2024-09-13T06:41:12.729 INFO:teuthology.orchestra.run.smithi081.stdout:2863 write 0x9997dd3 thru 0x99a1bac (0x9dda bytes) 2024-09-13T06:41:12.729 INFO:teuthology.orchestra.run.smithi081.stdout:2864 punch from 0xc9f852 to 0xcacdba, (0xd568 bytes) 2024-09-13T06:41:12.730 INFO:teuthology.orchestra.run.smithi081.stdout:2865 punch from 0x2afafb to 0x2b8259, (0x875e bytes) 2024-09-13T06:41:12.730 INFO:teuthology.orchestra.run.smithi081.stdout:2866 write 0x8e8730e thru 0x8e93282 (0xbf75 bytes) 2024-09-13T06:41:12.730 INFO:teuthology.orchestra.run.smithi081.stdout:2867 read 0x49346fd thru 0x493fb3e (0xb442 bytes) 2024-09-13T06:41:12.730 INFO:teuthology.orchestra.run.smithi081.stdout:2868 write 0x79369bf thru 0x794104a (0xa68c bytes) 2024-09-13T06:41:12.730 INFO:teuthology.orchestra.run.smithi081.stdout:2870 read 0xdc500e9 thru 0xdc595a6 (0x94be bytes) 2024-09-13T06:41:12.730 INFO:teuthology.orchestra.run.smithi081.stdout:2871 read 0x2d71902 thru 0x2d7f029 (0xd728 bytes) 2024-09-13T06:41:12.730 INFO:teuthology.orchestra.run.smithi081.stdout:2872 writesame 0x1338350 thru 0x133a4a9 data_size 0x3(0x215a bytes) 2024-09-13T06:41:12.731 INFO:teuthology.orchestra.run.smithi081.stdout:2875 writesame 0x8c7e3dd thru 0x8c825fd data_size 0x21(0x4221 bytes) 2024-09-13T06:41:12.731 INFO:teuthology.orchestra.run.smithi081.stdout:2876 read 0x3d20764 thru 0x3d257c4 (0x5061 bytes) 2024-09-13T06:41:12.731 INFO:teuthology.orchestra.run.smithi081.stdout:2877 write 0x7c35b4a thru 0x7c383eb (0x28a2 bytes) 2024-09-13T06:41:12.731 INFO:teuthology.orchestra.run.smithi081.stdout:2878 write 0x2c3cfd7 thru 0x2c3ed93 (0x1dbd bytes) 2024-09-13T06:41:12.731 INFO:teuthology.orchestra.run.smithi081.stdout:2879 write 0x38bbe75 thru 0x38c5adc (0x9c68 bytes) 2024-09-13T06:41:12.731 INFO:teuthology.orchestra.run.smithi081.stdout:2880 read 0x1a0b64c thru 0x1a0de51 (0x2806 bytes) 2024-09-13T06:41:12.732 INFO:teuthology.orchestra.run.smithi081.stdout:2882 write 0x6549e58 thru 0x654afce (0x1177 bytes) 2024-09-13T06:41:12.732 INFO:teuthology.orchestra.run.smithi081.stdout:2883 punch from 0xaa2eff0 to 0xaa3bb20, (0xcb30 bytes) 2024-09-13T06:41:12.732 INFO:teuthology.orchestra.run.smithi081.stdout:2885 writesame 0xa011d59 thru 0xa01a78a data_size 0x13(0x8a32 bytes) 2024-09-13T06:41:12.732 INFO:teuthology.orchestra.run.smithi081.stdout:2886 trunc from 0xeb03442 to 0xab95291 2024-09-13T06:41:12.732 INFO:teuthology.orchestra.run.smithi081.stdout:2888 punch from 0x8ca6509 to 0x8cb04ba, (0x9fb1 bytes) 2024-09-13T06:41:12.733 INFO:teuthology.orchestra.run.smithi081.stdout:2889 read 0x16fbcae thru 0x1708c8a (0xcfdd bytes) 2024-09-13T06:41:12.733 INFO:teuthology.orchestra.run.smithi081.stdout:2890 read 0x40768c5 thru 0x407b0c6 (0x4802 bytes) 2024-09-13T06:41:12.733 INFO:teuthology.orchestra.run.smithi081.stdout:2892 write 0x61df123 thru 0x61e3ec4 (0x4da2 bytes) 2024-09-13T06:41:12.733 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:41:12.733 INFO:teuthology.orchestra.run.smithi081.stdout:2894 write 0x62d0ae9 thru 0x62dde53 (0xd36b bytes) 2024-09-13T06:41:12.733 INFO:teuthology.orchestra.run.smithi081.stdout:2895 read 0x9e1d47a thru 0x9e27ddc (0xa963 bytes) 2024-09-13T06:41:12.733 INFO:teuthology.orchestra.run.smithi081.stdout:2896 read 0x557c555 thru 0x557cc9d (0x749 bytes) 2024-09-13T06:41:12.734 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:41:12.722+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:41:12.734 INFO:teuthology.orchestra.run.smithi081.stdout:2897 write 0xe76df24 thru 0xe76e0d9 (0x1b6 bytes) 2024-09-13T06:41:12.739 INFO:teuthology.orchestra.run.smithi081.stdout:2898 read 0x88d81b5 thru 0x88e2314 (0xa160 bytes) 2024-09-13T06:41:12.741 INFO:teuthology.orchestra.run.smithi081.stdout:2899 read 0x28a8f7f thru 0x28aa086 (0x1108 bytes) 2024-09-13T06:41:12.742 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:41:12.742 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:41:12.742 INFO:teuthology.orchestra.run.smithi081.stdout:2902 write 0xcf97c83 thru 0xcfa62e8 (0xe666 bytes) 2024-09-13T06:41:12.744 INFO:teuthology.orchestra.run.smithi081.stdout:2905 write 0x8001d1a thru 0x80022cf (0x5b6 bytes) 2024-09-13T06:41:12.747 INFO:teuthology.orchestra.run.smithi081.stdout:2906 read 0x7341352 thru 0x73459a9 (0x4658 bytes) 2024-09-13T06:41:12.748 INFO:teuthology.orchestra.run.smithi081.stdout:2907 read 0xe09f531 thru 0xe0a8a36 (0x9506 bytes) 2024-09-13T06:41:12.748 INFO:teuthology.orchestra.run.smithi081.stdout:2908 write 0x7f824a thru 0x7fd237 (0x4fee bytes) 2024-09-13T06:41:12.750 INFO:teuthology.orchestra.run.smithi081.stdout:2909 read 0x98459d1 thru 0x98543ee (0xea1e bytes) 2024-09-13T06:41:12.761 INFO:teuthology.orchestra.run.smithi081.stdout:2910 trunc from 0xe76e0da to 0xa505529 2024-09-13T06:41:12.780 INFO:teuthology.orchestra.run.smithi081.stdout:2913 punch from 0x8bd856e to 0x8bd90bd, (0xb4f bytes) 2024-09-13T06:41:12.781 INFO:teuthology.orchestra.run.smithi081.stdout:2914 writesame 0x671f056 thru 0x6726cbc data_size 0x1(0x7c67 bytes) 2024-09-13T06:41:12.825 INFO:teuthology.orchestra.run.smithi081.stdout:2915 trunc from 0xa505529 to 0x179b846 2024-09-13T06:41:12.826 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:41:12.826+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:41:12.857 INFO:teuthology.orchestra.run.smithi081.stdout:2917 writesame 0x5c5d1ac thru 0x5c5da71 data_size 0x1(0x8c6 bytes) 2024-09-13T06:41:12.859 INFO:teuthology.orchestra.run.smithi081.stdout:2918 read 0x336d2e8 thru 0x336fe20 (0x2b39 bytes) 2024-09-13T06:41:12.860 INFO:teuthology.orchestra.run.smithi081.stdout:2919 read 0x326559a thru 0x326d8eb (0x8352 bytes) 2024-09-13T06:41:12.872 INFO:teuthology.orchestra.run.smithi081.stdout:2921 write 0x6574d5f thru 0x65784e8 (0x378a bytes) 2024-09-13T06:41:12.875 INFO:teuthology.orchestra.run.smithi081.stdout:2924 read 0x477f6fb thru 0x478f3e2 (0xfce8 bytes) 2024-09-13T06:41:12.876 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:41:12.876 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:41:12.876 INFO:teuthology.orchestra.run.smithi081.stdout:2927 write 0x4a3ca00 thru 0x4a474e9 (0xaaea bytes) 2024-09-13T06:41:12.878 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:41:12.879 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [ 2024-09-13T06:41:12.879 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.879 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:69973 3.12 3:4d6e7031:::rbd_data.11214956a993.0000000000000000:head [write 14928384~43754 in=43754b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e118)", 2024-09-13T06:41:12.879 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:41:12.878889+0000", 2024-09-13T06:41:12.879 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0014863389999999999, 2024-09-13T06:41:12.879 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0015357019999999999, 2024-09-13T06:41:12.879 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:12.879 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "waiting for sub ops", 2024-09-13T06:41:12.879 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:12.879 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:12.879 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:12.880 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 69973 2024-09-13T06:41:12.880 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.880 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:12.880 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.880 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:12.880 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:12.878889+0000", 2024-09-13T06:41:12.880 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:12.880 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.880 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.880 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:12.880 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:12.878889+0000", 2024-09-13T06:41:12.880 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:12.881 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.881 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.881 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:12.881 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:12.878887+0000", 2024-09-13T06:41:12.881 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999986 2024-09-13T06:41:12.881 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.881 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.881 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:12.881 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:12.878915+0000", 2024-09-13T06:41:12.881 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.7582000000000001e-05 2024-09-13T06:41:12.881 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.882 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.882 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:12.882 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:12.878931+0000", 2024-09-13T06:41:12.882 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6025e-05 2024-09-13T06:41:12.882 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.882 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.882 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:12.882 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:12.878939+0000", 2024-09-13T06:41:12.882 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.7940000000000003e-06 2024-09-13T06:41:12.882 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.882 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.882 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:12.882 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:12.878986+0000", 2024-09-13T06:41:12.882 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.6925999999999998e-05 2024-09-13T06:41:12.883 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.883 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.883 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:12.883 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:12.879059+0000", 2024-09-13T06:41:12.883 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.3257999999999996e-05 2024-09-13T06:41:12.883 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.883 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.883 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 0", 2024-09-13T06:41:12.883 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:12.879171+0000", 2024-09-13T06:41:12.883 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000112009 2024-09-13T06:41:12.883 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:12.883 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:12.884 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-13T06:41:12.884 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:12.880053+0000", 2024-09-13T06:41:12.884 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00088245700000000001 2024-09-13T06:41:12.884 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:12.884 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:12.884 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:12.884 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:12.884 INFO:teuthology.orchestra.run.smithi139.stdout: ], 2024-09-13T06:41:12.884 INFO:teuthology.orchestra.run.smithi139.stdout: "num_ops": 1 2024-09-13T06:41:12.884 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:41:12.885 INFO:teuthology.orchestra.run.smithi081.stdout:2928 punch from 0x1e37ec5 to 0x1e451ab, (0xd2e6 bytes) 2024-09-13T06:41:12.885 INFO:teuthology.orchestra.run.smithi081.stdout:2929 read 0x63b8963 thru 0x63bb6f9 (0x2d97 bytes) 2024-09-13T06:41:12.885 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:41:12.885 INFO:teuthology.orchestra.run.smithi081.stdout:2932 punch from 0x15222d to 0x1580ae, (0x5e81 bytes) 2024-09-13T06:41:12.886 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:41:12.886 INFO:teuthology.orchestra.run.smithi081.stdout:2936 write 0x4e0fb4d thru 0x4e10519 (0x9cd bytes) 2024-09-13T06:41:12.893 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-13T06:41:12.905 INFO:teuthology.orchestra.run.smithi081.stdout:2937 writesame 0xbdc8b24 thru 0xbdd823e data_size 0x7(0xf71b bytes) 2024-09-13T06:41:12.907 INFO:teuthology.orchestra.run.smithi081.stdout:2938 trunc from 0xbdd823f to 0xbf3ecfe 2024-09-13T06:41:12.914 INFO:teuthology.orchestra.run.smithi081.stdout:2940 read 0x4373104 thru 0x4381d77 (0xec74 bytes) 2024-09-13T06:41:12.915 INFO:teuthology.orchestra.run.smithi081.stdout:2942 write 0x8de440c thru 0x8de73c8 (0x2fbd bytes) 2024-09-13T06:41:12.917 INFO:teuthology.orchestra.run.smithi081.stdout:2946 read 0x8ede926 thru 0x8eea72d (0xbe08 bytes) 2024-09-13T06:41:12.918 INFO:teuthology.orchestra.run.smithi081.stdout:2947 punch from 0x6aa9fcd to 0x6ab6e62, (0xce95 bytes) 2024-09-13T06:41:12.927 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:41:12.926+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:41:12.938 INFO:teuthology.orchestra.run.smithi081.stdout:2948 trunc from 0xbf3ecfe to 0x3ca2720 2024-09-13T06:41:12.969 INFO:teuthology.orchestra.run.smithi081.stdout:2951 trunc from 0x3ca2720 to 0xd7b9f29 2024-09-13T06:41:12.985 INFO:teuthology.orchestra.run.smithi081.stdout:2953 write 0xd8c051d thru 0xd8cc2b4 (0xbd98 bytes) 2024-09-13T06:41:12.991 INFO:teuthology.orchestra.run.smithi081.stdout:2954 punch from 0xa647a88 to 0xa650e3a, (0x93b2 bytes) 2024-09-13T06:41:12.991 INFO:teuthology.orchestra.run.smithi081.stdout:2955 read 0x76ea04f thru 0x76f0781 (0x6733 bytes) 2024-09-13T06:41:12.992 INFO:teuthology.orchestra.run.smithi081.stdout:2957 writesame 0x8faff03 thru 0x8fbafe4 data_size 0x3(0xb0e2 bytes) 2024-09-13T06:41:13.005 INFO:teuthology.orchestra.run.smithi081.stdout:2958 punch from 0x703435e to 0x7043162, (0xee04 bytes) 2024-09-13T06:41:13.006 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:41:13.025 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:41:13.025 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [], 2024-09-13T06:41:13.025 INFO:teuthology.orchestra.run.smithi139.stdout: "complaint_time": 30, 2024-09-13T06:41:13.026 INFO:teuthology.orchestra.run.smithi139.stdout: "num_blocked_ops": 0 2024-09-13T06:41:13.026 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:41:13.026 INFO:teuthology.orchestra.run.smithi081.stdout:2960 trunc from 0xd8cc2b5 to 0x4f058b7 2024-09-13T06:41:13.028 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:41:13.026+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:41:13.041 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-13T06:41:13.050 INFO:teuthology.orchestra.run.smithi081.stdout:2961 write 0x3c8bc thru 0x4776e (0xaeb3 bytes) 2024-09-13T06:41:13.054 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:41:13.062 INFO:teuthology.orchestra.run.smithi081.stdout:2963 trunc from 0x4f058b7 to 0x16b34fc 2024-09-13T06:41:13.101 INFO:teuthology.orchestra.run.smithi081.stdout:2964 write 0x673f55c thru 0x6745e0c (0x68b1 bytes) 2024-09-13T06:41:13.104 INFO:teuthology.orchestra.run.smithi081.stdout:2965 read 0x2788358 thru 0x279296d (0xa616 bytes) 2024-09-13T06:41:13.129 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:41:13.126+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:41:13.132 INFO:teuthology.orchestra.run.smithi081.stdout:2966 write 0xda2ceb1 thru 0xda39621 (0xc771 bytes) 2024-09-13T06:41:13.137 INFO:teuthology.orchestra.run.smithi081.stdout:2967 write 0x33a558c thru 0x33a5a7f (0x4f4 bytes) 2024-09-13T06:41:13.142 INFO:teuthology.orchestra.run.smithi081.stdout:2970 trunc from 0xda39622 to 0xeb0c24e 2024-09-13T06:41:13.152 INFO:teuthology.orchestra.run.smithi081.stdout:2971 read 0x7400195 thru 0x740efe3 (0xee4f bytes) 2024-09-13T06:41:13.153 INFO:teuthology.orchestra.run.smithi081.stdout:2972 writesame 0x802364f thru 0x8028f2e data_size 0x30(0x58e0 bytes) 2024-09-13T06:41:13.156 INFO:teuthology.orchestra.run.smithi081.stdout:2974 read 0x2aa3336 thru 0x2aa8821 (0x54ec bytes) 2024-09-13T06:41:13.157 INFO:teuthology.orchestra.run.smithi081.stdout:2976 writesame 0x746f3d4 thru 0x74727ad data_size 0x1(0x33da bytes) 2024-09-13T06:41:13.171 INFO:teuthology.orchestra.run.smithi081.stdout:2977 read 0x40138a7 thru 0x4013987 (0xe1 bytes) 2024-09-13T06:41:13.172 INFO:teuthology.orchestra.run.smithi081.stdout:2978 read 0xb12378c thru 0xb132515 (0xed8a bytes) 2024-09-13T06:41:13.173 INFO:teuthology.orchestra.run.smithi081.stdout:2979 writesame 0xb215629 thru 0xb21607f data_size 0x1(0xa57 bytes) 2024-09-13T06:41:13.175 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:41:13.175 INFO:teuthology.orchestra.run.smithi139.stdout: "size": 20, 2024-09-13T06:41:13.175 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 600, 2024-09-13T06:41:13.175 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [ 2024-09-13T06:41:13.175 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:13.175 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4154.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-13T06:41:13.175 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:11.143816+0000", 2024-09-13T06:41:13.175 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 122.029762832, 2024-09-13T06:41:13.175 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.062483034, 2024-09-13T06:41:13.176 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:13.176 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:41:13.176 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:13.176 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4154", 2024-09-13T06:41:13.176 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/2406930292", 2024-09-13T06:41:13.176 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 1 2024-09-13T06:41:13.176 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:13.176 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:13.176 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:13.176 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:13.176 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.143816+0000", 2024-09-13T06:41:13.176 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:13.176 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:13.177 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:13.177 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:13.177 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.143816+0000", 2024-09-13T06:41:13.177 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:13.177 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:13.177 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:13.177 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:13.177 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.143814+0000", 2024-09-13T06:41:13.177 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999976 2024-09-13T06:41:13.177 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:13.177 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:13.177 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:13.177 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.143829+0000", 2024-09-13T06:41:13.178 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5316999999999999e-05 2024-09-13T06:41:13.178 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:13.178 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:13.178 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:13.178 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.143851+0000", 2024-09-13T06:41:13.178 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.1736999999999999e-05 2024-09-13T06:41:13.178 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:13.178 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:13.178 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:13.178 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.143870+0000", 2024-09-13T06:41:13.178 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.9185999999999999e-05 2024-09-13T06:41:13.178 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:13.178 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:13.178 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:13.179 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.143973+0000", 2024-09-13T06:41:13.179 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000102896 2024-09-13T06:41:13.179 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:13.179 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:13.179 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:41:13.179 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.143987+0000", 2024-09-13T06:41:13.179 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.401e-05 2024-09-13T06:41:13.179 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:13.179 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:13.179 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:13.179 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.203333+0000", 2024-09-13T06:41:13.179 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.059346614999999998 2024-09-13T06:41:13.179 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:13.180 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:13.180 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:13.180 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.203624+0000", 2024-09-13T06:41:13.180 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00029112700000000002 2024-09-13T06:41:13.180 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:13.180 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:13.180 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 0", 2024-09-13T06:41:13.180 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.203940+0000", 2024-09-13T06:41:13.180 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00031547200000000002 2024-09-13T06:41:13.180 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:13.180 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:13.180 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-13T06:41:13.181 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.205145+0000", 2024-09-13T06:41:13.181 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0012048930000000001 2024-09-13T06:41:13.181 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:13.181 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:13.181 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:41:13.181 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.206110+0000", 2024-09-13T06:41:13.181 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00096536600000000005 2024-09-13T06:41:13.181 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:13.181 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:13.181 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-13T06:41:13.181 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.206196+0000", 2024-09-13T06:41:13.181 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.5798999999999996e-05 2024-09-13T06:41:13.181 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:13.181 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:13.182 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:13.182 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:11.206299+0000", 2024-09-13T06:41:13.182 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00010279 2024-09-13T06:41:13.182 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:13.182 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:13.182 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:13.182 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:13.182 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:13.182 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:608 3.11 3:8ebac99f:::rbd_data.11214e25756e.0000000000000007:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-09-13T06:41:13.182 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:34.801988+0000", 2024-09-13T06:41:13.182 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 98.371590679999997, 2024-09-13T06:41:13.182 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.033916448000000002, 2024-09-13T06:41:13.182 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:13.183 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:41:13.183 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:13.183 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:13.183 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:13.183 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 608 2024-09-13T06:41:13.183 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:13.183 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:13.183 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:13.183 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:13.183 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:34.801988+0000", 2024-09-13T06:41:13.183 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:13.183 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:13.183 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:13.184 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:13.184 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:34.801988+0000", 2024-09-13T06:41:13.184 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:13.184 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:13.184 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:13.184 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:13.184 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:34.801985+0000", 2024-09-13T06:41:13.184 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999976 2024-09-13T06:41:13.184 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:13.184 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:13.184 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:13.184 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:34.801999+0000", 2024-09-13T06:41:13.184 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.402e-05 2024-09-13T06:41:13.185 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:13.185 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:13.185 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:13.185 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:34.802031+0000", 2024-09-13T06:41:13.185 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.1582999999999999e-05 2024-09-13T06:41:13.185 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:13.185 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:13.185 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:13.185 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:34.802052+0000", 2024-09-13T06:41:13.185 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.1310000000000001e-05 2024-09-13T06:41:13.185 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:13.185 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:13.185 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:13.186 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:34.802117+0000", 2024-09-13T06:41:13.186 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.5016000000000002e-05 2024-09-13T06:41:13.186 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:13.186 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:13.186 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:13.186 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:34.802254+0000", 2024-09-13T06:41:13.186 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000136186 2024-09-13T06:41:13.186 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:13.186 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:13.186 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 4", 2024-09-13T06:41:13.186 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:34.807944+0000", 2024-09-13T06:41:13.186 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0056906930000000001 2024-09-13T06:41:13.186 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:13.186 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:13.187 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-13T06:41:13.187 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:34.835646+0000", 2024-09-13T06:41:13.187 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.027701546000000001 2024-09-13T06:41:13.187 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:13.187 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:13.187 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:41:13.187 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:34.835754+0000", 2024-09-13T06:41:13.187 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000107889 2024-09-13T06:41:13.187 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:13.187 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:13.187 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-13T06:41:13.187 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:34.835840+0000", 2024-09-13T06:41:13.187 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6621999999999998e-05 2024-09-13T06:41:13.187 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:13.188 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:13.188 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:13.188 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:34.835904+0000", 2024-09-13T06:41:13.188 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.4022999999999993e-05 2024-09-13T06:41:13.188 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:13.188 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:13.188 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:13.188 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:13.188 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:13.188 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:47163 3.13 3.ed327d33 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e76)", 2024-09-13T06:41:13.188 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:29.544993+0000", 2024-09-13T06:41:13.188 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 43.628585071000003, 2024-09-13T06:41:13.188 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.83273406400000005, 2024-09-13T06:41:13.188 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:13.189 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:41:13.189 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:13.189 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:13.189 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:13.189 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 47163 2024-09-13T06:41:13.189 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:13.189 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:13.189 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:13.189 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:13.189 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:29.544993+0000", 2024-09-13T06:41:13.189 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:13.189 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:13.189 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:13.190 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:13.190 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:29.544993+0000", 2024-09-13T06:41:13.190 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:13.190 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:13.190 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:13.190 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:13.190 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:29.544992+0000", 2024-09-13T06:41:13.190 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999981 2024-09-13T06:41:13.190 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:13.190 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:13.190 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:13.190 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:29.545001+0000", 2024-09-13T06:41:13.190 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.825e-06 2024-09-13T06:41:13.191 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:13.191 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:13.191 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:13.191 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:29.545022+0000", 2024-09-13T06:41:13.191 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.0285e-05 2024-09-13T06:41:13.191 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:13.191 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:13.191 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:13.191 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:29.545049+0000", 2024-09-13T06:41:13.191 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.7389000000000002e-05 2024-09-13T06:41:13.191 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:13.191 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:13.191 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:13.191 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:29.545153+0000", 2024-09-13T06:41:13.192 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0001043 2024-09-13T06:41:13.192 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:13.192 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:13.192 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:41:13.192 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:29.545164+0000", 2024-09-13T06:41:13.192 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0413e-05 2024-09-13T06:41:13.192 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:13.192 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:13.192 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:13.192 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:30.377697+0000", 2024-09-13T06:41:13.192 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.832533415 2024-09-13T06:41:13.192 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:13.192 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:13.192 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:13.193 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:30.377728+0000", 2024-09-13T06:41:13.193 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.0428000000000001e-05 2024-09-13T06:41:13.193 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:13.193 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:13.193 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:13.193 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:13.193 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:13.193 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:54988 3.13 3:ce2ec97c:::rbd_data.11213b441054.000000000000000f:2e [read 475136~32768 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e91)", 2024-09-13T06:41:13.193 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:44.489037+0000", 2024-09-13T06:41:13.193 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 28.684541839000001, 2024-09-13T06:41:13.193 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.025682440000000001, 2024-09-13T06:41:13.193 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:13.194 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:13.194 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:13.194 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:13.194 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:13.194 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 54988 2024-09-13T06:41:13.194 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:13.194 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:13.194 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:13.194 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:13.194 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.489037+0000", 2024-09-13T06:41:13.194 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:13.194 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:13.194 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:13.194 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:13.195 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.489037+0000", 2024-09-13T06:41:13.195 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:13.195 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:13.195 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:13.195 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:13.195 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.489036+0000", 2024-09-13T06:41:13.195 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:13.195 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:13.195 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:13.195 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:13.195 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.489042+0000", 2024-09-13T06:41:13.195 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.9490000000000001e-06 2024-09-13T06:41:13.195 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:13.196 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:13.196 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:13.196 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.489057+0000", 2024-09-13T06:41:13.196 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5637e-05 2024-09-13T06:41:13.196 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:13.196 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:13.196 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:13.196 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.489072+0000", 2024-09-13T06:41:13.196 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.4219000000000001e-05 2024-09-13T06:41:13.196 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:13.196 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:13.196 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:13.196 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.513725+0000", 2024-09-13T06:41:13.196 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.024653069999999999 2024-09-13T06:41:13.197 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:13.197 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:13.197 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:13.197 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.513909+0000", 2024-09-13T06:41:13.197 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000183878 2024-09-13T06:41:13.197 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:13.197 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:13.197 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:13.197 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.514719+0000", 2024-09-13T06:41:13.197 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00081063999999999995 2024-09-13T06:41:13.197 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:13.197 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:13.197 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:13.197 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:13.198 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:13.198 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:55033 3.13 3:ce471d87:::rbd_data.11213b441054.0000000000000036:2e [read 131072~32768 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e91)", 2024-09-13T06:41:13.198 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:44.490592+0000", 2024-09-13T06:41:13.198 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 28.682986697, 2024-09-13T06:41:13.198 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.024752789000000001, 2024-09-13T06:41:13.198 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:13.198 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:13.198 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:13.198 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:13.198 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:13.198 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 55033 2024-09-13T06:41:13.198 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:13.198 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:13.199 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:13.199 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:13.199 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.490592+0000", 2024-09-13T06:41:13.199 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:13.199 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:13.199 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:13.199 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:13.199 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.490592+0000", 2024-09-13T06:41:13.199 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:13.199 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:13.199 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:13.199 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:13.199 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.490591+0000", 2024-09-13T06:41:13.199 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999986 2024-09-13T06:41:13.200 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:13.200 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:13.200 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:13.200 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.490632+0000", 2024-09-13T06:41:13.200 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0964999999999998e-05 2024-09-13T06:41:13.200 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:13.200 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:13.200 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:13.200 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.490668+0000", 2024-09-13T06:41:13.200 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.6068000000000001e-05 2024-09-13T06:41:13.200 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:13.200 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:13.200 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:13.200 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.490684+0000", 2024-09-13T06:41:13.201 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6728999999999999e-05 2024-09-13T06:41:13.201 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:13.201 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:13.201 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:13.201 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.515085+0000", 2024-09-13T06:41:13.201 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.02440022 2024-09-13T06:41:13.201 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:13.201 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:13.201 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:13.201 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.515186+0000", 2024-09-13T06:41:13.201 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000101094 2024-09-13T06:41:13.201 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:13.201 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:13.201 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:13.202 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.515345+0000", 2024-09-13T06:41:13.202 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00015892900000000001 2024-09-13T06:41:13.202 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:13.202 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:13.202 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:13.202 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:13.202 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:13.202 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:55040 3.13 3:cda7a632:::rbd_data.11213b441054.0000000000000003:2e [read 98304~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e91)", 2024-09-13T06:41:13.202 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:44.490818+0000", 2024-09-13T06:41:13.202 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 28.682760236, 2024-09-13T06:41:13.202 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.025155713999999999, 2024-09-13T06:41:13.202 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:13.202 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:13.203 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:13.203 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:13.203 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:13.203 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 55040 2024-09-13T06:41:13.203 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:13.203 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:13.203 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:13.203 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:13.203 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.490818+0000", 2024-09-13T06:41:13.203 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:13.203 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:13.203 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:13.203 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:13.203 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.490818+0000", 2024-09-13T06:41:13.203 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:13.204 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:13.204 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:13.204 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:13.204 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.490817+0000", 2024-09-13T06:41:13.204 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:13.204 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:13.204 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:13.204 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:13.204 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.490824+0000", 2024-09-13T06:41:13.204 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.4189999999999999e-06 2024-09-13T06:41:13.204 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:13.204 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:13.204 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:13.204 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.490844+0000", 2024-09-13T06:41:13.204 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.0285999999999999e-05 2024-09-13T06:41:13.205 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:13.205 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:13.205 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:13.205 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.490858+0000", 2024-09-13T06:41:13.205 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3939e-05 2024-09-13T06:41:13.205 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:13.205 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:13.205 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:13.205 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.515395+0000", 2024-09-13T06:41:13.205 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.024537099 2024-09-13T06:41:13.205 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:13.205 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:13.205 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:13.205 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.515564+0000", 2024-09-13T06:41:13.206 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00016896899999999999 2024-09-13T06:41:13.206 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:13.206 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:13.206 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:13.206 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.515974+0000", 2024-09-13T06:41:13.206 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00041008199999999998 2024-09-13T06:41:13.206 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:13.206 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:13.206 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:13.206 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:13.206 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:13.206 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:55041 3.13 3:cda7a632:::rbd_data.11213b441054.0000000000000003:2e [read 409600~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e91)", 2024-09-13T06:41:13.206 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:44.490870+0000", 2024-09-13T06:41:13.206 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 28.682708345999998, 2024-09-13T06:41:13.207 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.025858931000000002, 2024-09-13T06:41:13.207 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:13.207 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:13.207 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:13.207 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:13.207 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:13.207 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 55041 2024-09-13T06:41:13.207 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:13.207 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:13.207 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:13.207 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:13.207 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.490870+0000", 2024-09-13T06:41:13.207 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:13.208 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:13.208 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:13.208 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:13.208 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.490870+0000", 2024-09-13T06:41:13.208 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:13.208 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:13.208 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:13.208 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:13.208 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.490869+0000", 2024-09-13T06:41:13.208 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999986 2024-09-13T06:41:13.208 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:13.208 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:13.208 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:13.209 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.490889+0000", 2024-09-13T06:41:13.209 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.9831999999999999e-05 2024-09-13T06:41:13.209 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:13.209 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:13.209 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:13.209 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.490970+0000", 2024-09-13T06:41:13.209 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.1623000000000001e-05 2024-09-13T06:41:13.209 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:13.209 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:13.209 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:13.209 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.490988+0000", 2024-09-13T06:41:13.209 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7686e-05 2024-09-13T06:41:13.209 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:13.210 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:13.210 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:13.210 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.516059+0000", 2024-09-13T06:41:13.210 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.025070571 2024-09-13T06:41:13.210 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:13.210 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:13.210 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:13.210 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.516255+0000", 2024-09-13T06:41:13.210 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00019698400000000001 2024-09-13T06:41:13.210 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:13.210 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:13.210 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:13.210 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.516729+0000", 2024-09-13T06:41:13.210 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00047365100000000001 2024-09-13T06:41:13.211 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:13.211 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:13.211 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:13.211 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:13.211 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:13.211 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:55064 3.13 3:ce2ec97c:::rbd_data.11213b441054.000000000000000f:2e [read 196608~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e91)", 2024-09-13T06:41:13.211 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:44.491003+0000", 2024-09-13T06:41:13.211 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 28.682575091, 2024-09-13T06:41:13.211 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.026122157, 2024-09-13T06:41:13.211 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:13.211 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:13.211 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:13.211 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:13.211 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:13.212 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 55064 2024-09-13T06:41:13.212 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:13.212 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:13.212 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:13.212 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:13.212 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.491003+0000", 2024-09-13T06:41:13.212 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:13.212 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:13.212 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:13.212 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:13.212 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.491003+0000", 2024-09-13T06:41:13.212 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:13.212 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:13.212 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:13.213 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:13.213 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.491002+0000", 2024-09-13T06:41:13.213 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999986 2024-09-13T06:41:13.213 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:13.213 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:13.213 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:13.213 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.491011+0000", 2024-09-13T06:41:13.213 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.8659999999999995e-06 2024-09-13T06:41:13.213 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:13.213 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:13.213 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:13.213 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.491030+0000", 2024-09-13T06:41:13.213 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.9335999999999999e-05 2024-09-13T06:41:13.214 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:13.214 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:13.214 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:13.214 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.491044+0000", 2024-09-13T06:41:13.214 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3933e-05 2024-09-13T06:41:13.214 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:13.214 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:13.214 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:13.214 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.516803+0000", 2024-09-13T06:41:13.214 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.025758783 2024-09-13T06:41:13.214 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:13.214 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:13.214 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:13.214 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.516941+0000", 2024-09-13T06:41:13.215 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000138462 2024-09-13T06:41:13.215 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:13.215 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:13.215 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:13.215 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.517126+0000", 2024-09-13T06:41:13.215 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000184384 2024-09-13T06:41:13.215 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:13.215 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:13.215 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:13.215 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:13.215 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:13.215 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:55088 3.13 3:cbaea7ae:::rbd_data.11213b441054.0000000000000022:2e [read 81920~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e91)", 2024-09-13T06:41:13.215 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:44.492610+0000", 2024-09-13T06:41:13.215 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 28.680968682, 2024-09-13T06:41:13.216 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.025237315999999999, 2024-09-13T06:41:13.216 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:13.216 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:13.216 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:13.216 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:13.216 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:13.216 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 55088 2024-09-13T06:41:13.216 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:13.216 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:13.216 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:13.216 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:13.216 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.492610+0000", 2024-09-13T06:41:13.217 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:13.217 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:13.217 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:13.217 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:13.217 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.492610+0000", 2024-09-13T06:41:13.217 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:13.217 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:13.217 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:13.217 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:13.217 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.492608+0000", 2024-09-13T06:41:13.217 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999986 2024-09-13T06:41:13.217 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:13.217 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:13.218 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:13.218 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.492616+0000", 2024-09-13T06:41:13.218 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.7069999999999992e-06 2024-09-13T06:41:13.218 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:13.218 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:13.218 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:13.218 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.492660+0000", 2024-09-13T06:41:13.218 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.3741e-05 2024-09-13T06:41:13.218 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:13.218 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:13.218 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:13.218 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.492946+0000", 2024-09-13T06:41:13.218 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00028570499999999998 2024-09-13T06:41:13.219 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:13.219 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:13.219 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:13.219 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.517212+0000", 2024-09-13T06:41:13.219 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.024266378000000002 2024-09-13T06:41:13.219 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:13.219 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:13.219 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:13.219 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.517375+0000", 2024-09-13T06:41:13.219 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00016321099999999999 2024-09-13T06:41:13.219 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:13.219 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:13.219 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:13.219 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.517847+0000", 2024-09-13T06:41:13.220 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00047207400000000001 2024-09-13T06:41:13.220 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:13.220 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:13.220 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:13.220 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:13.220 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:13.220 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:55108 3.13 3:ce471d87:::rbd_data.11213b441054.0000000000000036:2e [read 163840~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e91)", 2024-09-13T06:41:13.220 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:44.493024+0000", 2024-09-13T06:41:13.220 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 28.680554897, 2024-09-13T06:41:13.220 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.025410097999999999, 2024-09-13T06:41:13.220 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:13.220 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:13.220 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:13.221 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:13.221 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:13.221 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 55108 2024-09-13T06:41:13.221 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:13.221 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:13.221 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:13.221 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:13.221 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.493024+0000", 2024-09-13T06:41:13.221 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:13.221 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:13.221 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:13.221 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:13.221 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.493024+0000", 2024-09-13T06:41:13.222 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:13.222 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:13.222 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:13.222 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:13.222 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.493023+0000", 2024-09-13T06:41:13.222 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:13.222 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:13.222 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:13.222 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:13.222 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.493030+0000", 2024-09-13T06:41:13.222 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.4730000000000003e-06 2024-09-13T06:41:13.222 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:13.222 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:13.222 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:13.223 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.493047+0000", 2024-09-13T06:41:13.223 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7322000000000001e-05 2024-09-13T06:41:13.223 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:13.223 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:13.223 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:13.223 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.493060+0000", 2024-09-13T06:41:13.223 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3087e-05 2024-09-13T06:41:13.223 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:13.223 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:13.223 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:13.223 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.517905+0000", 2024-09-13T06:41:13.223 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.024844442000000001 2024-09-13T06:41:13.224 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:13.224 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:13.224 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:13.224 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.518037+0000", 2024-09-13T06:41:13.224 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000132607 2024-09-13T06:41:13.224 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:13.224 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:13.224 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:13.224 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.518434+0000", 2024-09-13T06:41:13.224 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00039630299999999998 2024-09-13T06:41:13.224 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:13.224 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:13.224 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:13.225 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:13.225 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:13.225 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:55115 3.13 3:cda7a632:::rbd_data.11213b441054.0000000000000003:2e [read 114688~32768 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e91)", 2024-09-13T06:41:13.225 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:44.493193+0000", 2024-09-13T06:41:13.225 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 28.680386037000002, 2024-09-13T06:41:13.225 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.025843738000000002, 2024-09-13T06:41:13.225 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:13.225 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:13.225 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:13.225 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:13.225 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:13.225 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 55115 2024-09-13T06:41:13.225 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:13.225 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:13.226 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:13.226 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:13.226 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.493193+0000", 2024-09-13T06:41:13.226 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:13.226 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:13.226 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:13.226 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:13.226 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.493193+0000", 2024-09-13T06:41:13.226 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:13.226 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:13.226 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:13.226 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:13.226 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.493192+0000", 2024-09-13T06:41:13.227 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:13.227 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:13.227 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:13.227 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:13.227 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.493196+0000", 2024-09-13T06:41:13.227 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.6729999999999998e-06 2024-09-13T06:41:13.227 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:13.227 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:13.227 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:13.227 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.493205+0000", 2024-09-13T06:41:13.227 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.1130000000000007e-06 2024-09-13T06:41:13.227 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:13.227 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:13.227 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:13.228 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.493212+0000", 2024-09-13T06:41:13.228 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.1029999999999996e-06 2024-09-13T06:41:13.228 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:13.228 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:13.228 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:13.228 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.518524+0000", 2024-09-13T06:41:13.228 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.025312365999999999 2024-09-13T06:41:13.228 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:13.228 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:13.228 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:13.228 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.518611+0000", 2024-09-13T06:41:13.228 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6507000000000004e-05 2024-09-13T06:41:13.228 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:13.228 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:13.229 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:13.229 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.519036+0000", 2024-09-13T06:41:13.229 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00042558899999999998 2024-09-13T06:41:13.229 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:13.229 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:13.229 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:13.229 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:13.229 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:13.229 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:55116 3.13 3:cda7a632:::rbd_data.11213b441054.0000000000000003:2e [read 425984~32768 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e91)", 2024-09-13T06:41:13.229 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:44.493218+0000", 2024-09-13T06:41:13.229 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 28.680360775, 2024-09-13T06:41:13.229 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.026213864999999999, 2024-09-13T06:41:13.229 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:13.229 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:13.230 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:13.230 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:13.230 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:13.230 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 55116 2024-09-13T06:41:13.230 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:13.230 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:13.230 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:13.230 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:13.230 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.493218+0000", 2024-09-13T06:41:13.230 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:13.230 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:13.230 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:13.230 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:13.230 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.493218+0000", 2024-09-13T06:41:13.231 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:13.231 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:13.231 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:13.231 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:13.231 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.493217+0000", 2024-09-13T06:41:13.231 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:13.231 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:13.231 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:13.231 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:13.231 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.493220+0000", 2024-09-13T06:41:13.231 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.2370000000000001e-06 2024-09-13T06:41:13.231 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:13.231 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:13.231 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:13.232 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.493229+0000", 2024-09-13T06:41:13.232 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.9090000000000006e-06 2024-09-13T06:41:13.232 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:13.232 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:13.232 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:13.232 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.493251+0000", 2024-09-13T06:41:13.232 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.1739e-05 2024-09-13T06:41:13.232 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:13.232 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:13.232 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:13.232 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.519112+0000", 2024-09-13T06:41:13.232 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.025860478999999999 2024-09-13T06:41:13.232 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:13.233 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:13.233 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:13.233 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.519258+0000", 2024-09-13T06:41:13.233 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00014618300000000001 2024-09-13T06:41:13.233 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:13.233 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:13.233 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:13.233 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.519432+0000", 2024-09-13T06:41:13.233 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000173938 2024-09-13T06:41:13.233 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:13.233 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:13.233 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:13.233 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:13.234 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:13.234 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:55135 3.13 3:ce2ec97c:::rbd_data.11213b441054.000000000000000f:2e [read 212992~32768 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e91)", 2024-09-13T06:41:13.234 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:44.493262+0000", 2024-09-13T06:41:13.234 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 28.680316647000001, 2024-09-13T06:41:13.234 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.026775146999999999, 2024-09-13T06:41:13.234 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:13.234 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:13.234 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:13.234 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:13.234 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:13.234 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 55135 2024-09-13T06:41:13.234 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:13.234 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:13.234 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:13.235 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:13.235 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.493262+0000", 2024-09-13T06:41:13.235 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:13.235 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:13.235 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:13.235 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:13.235 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.493262+0000", 2024-09-13T06:41:13.235 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:13.235 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:13.235 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:13.235 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:13.235 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.493261+0000", 2024-09-13T06:41:13.235 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:13.236 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:13.236 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:13.236 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:13.236 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.493268+0000", 2024-09-13T06:41:13.236 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.8839999999999997e-06 2024-09-13T06:41:13.236 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:13.236 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:13.236 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:13.236 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.493287+0000", 2024-09-13T06:41:13.236 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.9032e-05 2024-09-13T06:41:13.236 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:13.236 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:13.236 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:13.237 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.493299+0000", 2024-09-13T06:41:13.237 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2748999999999999e-05 2024-09-13T06:41:13.237 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:13.237 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:13.237 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:13.237 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.519501+0000", 2024-09-13T06:41:13.237 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.026201624 2024-09-13T06:41:13.237 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:13.237 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:13.237 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:13.237 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.519636+0000", 2024-09-13T06:41:13.237 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000135263 2024-09-13T06:41:13.237 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:13.238 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:13.238 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:13.238 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.520037+0000", 2024-09-13T06:41:13.238 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000400725 2024-09-13T06:41:13.238 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:13.238 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:13.238 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:13.238 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:13.238 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:13.238 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:55180 3.13 3:ce471d87:::rbd_data.11213b441054.0000000000000036:2e [read 180224~32768 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e91)", 2024-09-13T06:41:13.238 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:44.494078+0000", 2024-09-13T06:41:13.238 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 28.679500702999999, 2024-09-13T06:41:13.238 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.026595945999999999, 2024-09-13T06:41:13.239 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:13.239 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:13.239 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:13.239 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:13.239 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:13.239 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 55180 2024-09-13T06:41:13.239 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:13.239 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:13.239 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:13.239 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:13.239 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.494078+0000", 2024-09-13T06:41:13.239 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:13.239 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:13.239 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:13.240 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:13.240 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.494078+0000", 2024-09-13T06:41:13.240 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:13.240 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:13.240 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:13.240 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:13.240 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.494076+0000", 2024-09-13T06:41:13.240 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999981 2024-09-13T06:41:13.240 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:13.240 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:13.240 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:13.240 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.494102+0000", 2024-09-13T06:41:13.240 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.6128000000000001e-05 2024-09-13T06:41:13.240 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:13.241 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:13.241 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:13.241 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.494127+0000", 2024-09-13T06:41:13.241 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.4496000000000001e-05 2024-09-13T06:41:13.241 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:13.241 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:13.241 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:13.241 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.494187+0000", 2024-09-13T06:41:13.241 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.0053999999999998e-05 2024-09-13T06:41:13.241 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:13.241 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:13.241 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:13.241 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.520100+0000", 2024-09-13T06:41:13.241 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.025913783999999999 2024-09-13T06:41:13.241 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:13.242 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:13.242 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:13.242 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.520211+0000", 2024-09-13T06:41:13.242 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000110141 2024-09-13T06:41:13.242 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:13.242 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:13.242 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:13.242 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.520674+0000", 2024-09-13T06:41:13.242 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00046317199999999998 2024-09-13T06:41:13.242 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:13.242 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:13.242 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:13.242 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:13.243 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:13.243 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:55313 3.13 3:ce471d87:::rbd_data.11213b441054.0000000000000036:2e [read 229376~32768 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e91)", 2024-09-13T06:41:13.243 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:44.499266+0000", 2024-09-13T06:41:13.243 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 28.674312385, 2024-09-13T06:41:13.243 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.024871526000000001, 2024-09-13T06:41:13.243 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:13.243 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:13.243 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:13.243 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:13.243 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:13.243 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 55313 2024-09-13T06:41:13.243 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:13.243 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:13.243 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:13.244 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:13.244 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.499266+0000", 2024-09-13T06:41:13.244 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:13.244 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:13.244 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:13.244 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:13.244 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.499266+0000", 2024-09-13T06:41:13.244 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:13.244 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:13.244 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:13.244 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:13.244 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.499265+0000", 2024-09-13T06:41:13.244 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:13.244 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:13.245 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:13.245 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:13.245 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.499287+0000", 2024-09-13T06:41:13.245 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.1625e-05 2024-09-13T06:41:13.245 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:13.245 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:13.245 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:13.245 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.499305+0000", 2024-09-13T06:41:13.245 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.8442999999999999e-05 2024-09-13T06:41:13.245 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:13.245 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:13.245 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:13.245 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.499336+0000", 2024-09-13T06:41:13.245 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.0769000000000003e-05 2024-09-13T06:41:13.246 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:13.246 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:13.246 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:13.246 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.523570+0000", 2024-09-13T06:41:13.246 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.024233667 2024-09-13T06:41:13.246 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:13.246 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:13.246 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:13.246 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.523715+0000", 2024-09-13T06:41:13.246 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000145224 2024-09-13T06:41:13.246 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:13.246 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:13.246 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:13.246 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.524138+0000", 2024-09-13T06:41:13.247 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00042293799999999998 2024-09-13T06:41:13.247 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:13.247 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:13.247 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:13.247 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:13.247 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:13.247 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:55320 3.13 3:cda7a632:::rbd_data.11213b441054.0000000000000003:2e [read 196608~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e91)", 2024-09-13T06:41:13.247 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:44.499446+0000", 2024-09-13T06:41:13.247 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 28.674132842999999, 2024-09-13T06:41:13.247 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.025732436000000001, 2024-09-13T06:41:13.247 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:13.247 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:13.247 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:13.247 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:13.248 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:13.248 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 55320 2024-09-13T06:41:13.248 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:13.248 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:13.248 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:13.248 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:13.248 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.499446+0000", 2024-09-13T06:41:13.248 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:13.248 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:13.248 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:13.248 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:13.248 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.499446+0000", 2024-09-13T06:41:13.248 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:13.248 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:13.249 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:13.249 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:13.249 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.499445+0000", 2024-09-13T06:41:13.249 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:13.249 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:13.249 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:13.249 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:13.249 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.499451+0000", 2024-09-13T06:41:13.249 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.7060000000000001e-06 2024-09-13T06:41:13.249 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:13.249 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:13.249 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:13.249 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.499468+0000", 2024-09-13T06:41:13.249 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7533e-05 2024-09-13T06:41:13.250 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:13.250 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:13.250 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:13.250 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.499495+0000", 2024-09-13T06:41:13.250 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.6424999999999999e-05 2024-09-13T06:41:13.250 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:13.250 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:13.250 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:13.250 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.524534+0000", 2024-09-13T06:41:13.250 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.025039715000000001 2024-09-13T06:41:13.250 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:13.250 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:13.250 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:13.250 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.525025+0000", 2024-09-13T06:41:13.251 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00049033799999999999 2024-09-13T06:41:13.251 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:13.251 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:13.251 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:13.251 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.525178+0000", 2024-09-13T06:41:13.251 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000153599 2024-09-13T06:41:13.251 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:13.251 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:13.251 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:13.251 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:13.251 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:13.251 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:55321 3.13 3:cda7a632:::rbd_data.11213b441054.0000000000000003:2e [read 507904~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e91)", 2024-09-13T06:41:13.251 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:44.499508+0000", 2024-09-13T06:41:13.251 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 28.674070152999999, 2024-09-13T06:41:13.252 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.026517458000000001, 2024-09-13T06:41:13.252 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:13.252 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:13.252 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:13.252 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:13.252 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:13.252 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 55321 2024-09-13T06:41:13.252 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:13.252 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:13.252 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:13.252 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:13.252 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.499508+0000", 2024-09-13T06:41:13.252 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:13.252 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:13.253 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:13.253 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:13.253 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.499508+0000", 2024-09-13T06:41:13.253 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:13.253 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:13.253 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:13.253 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:13.253 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.499508+0000", 2024-09-13T06:41:13.253 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:13.253 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:13.253 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:13.253 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:13.253 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.499515+0000", 2024-09-13T06:41:13.253 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.1470000000000004e-06 2024-09-13T06:41:13.254 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:13.254 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:13.254 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:13.254 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.499532+0000", 2024-09-13T06:41:13.254 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7319000000000001e-05 2024-09-13T06:41:13.254 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:13.254 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:13.254 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:13.254 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.499546+0000", 2024-09-13T06:41:13.254 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3563e-05 2024-09-13T06:41:13.254 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:13.254 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:13.254 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:13.254 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.525218+0000", 2024-09-13T06:41:13.254 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.025672665000000001 2024-09-13T06:41:13.255 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:13.255 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:13.255 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:13.255 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.525322+0000", 2024-09-13T06:41:13.255 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000103559 2024-09-13T06:41:13.255 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:13.255 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:13.255 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:13.255 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.526026+0000", 2024-09-13T06:41:13.255 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00070408500000000002 2024-09-13T06:41:13.255 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:13.255 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:13.255 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:13.256 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:13.256 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:13.256 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:55340 3.13 3:ce2ec97c:::rbd_data.11213b441054.000000000000000f:2e [read 294912~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e91)", 2024-09-13T06:41:13.256 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:44.499557+0000", 2024-09-13T06:41:13.256 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 28.674022021999999, 2024-09-13T06:41:13.256 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.026897266, 2024-09-13T06:41:13.256 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:13.256 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:13.256 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:13.256 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:13.256 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:13.256 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 55340 2024-09-13T06:41:13.256 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:13.256 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:13.257 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:13.257 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:13.257 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.499557+0000", 2024-09-13T06:41:13.257 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:13.257 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:13.257 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:13.257 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:13.257 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.499557+0000", 2024-09-13T06:41:13.257 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:13.257 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:13.257 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:13.257 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:13.257 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.499555+0000", 2024-09-13T06:41:13.257 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:13.258 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:13.258 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:13.258 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:13.258 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.499562+0000", 2024-09-13T06:41:13.258 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.0140000000000004e-06 2024-09-13T06:41:13.258 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:13.258 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:13.258 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:13.258 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.499579+0000", 2024-09-13T06:41:13.258 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7581999999999999e-05 2024-09-13T06:41:13.258 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:13.258 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:13.258 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:13.258 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.499593+0000", 2024-09-13T06:41:13.258 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.385e-05 2024-09-13T06:41:13.259 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:13.259 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:13.259 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:13.259 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.526053+0000", 2024-09-13T06:41:13.259 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.026459700999999999 2024-09-13T06:41:13.259 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:13.259 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:13.259 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:13.259 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.526129+0000", 2024-09-13T06:41:13.259 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.6650999999999995e-05 2024-09-13T06:41:13.259 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:13.259 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:13.259 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:13.259 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.526454+0000", 2024-09-13T06:41:13.260 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00032451799999999999 2024-09-13T06:41:13.260 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:13.260 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:13.260 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:13.260 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:13.260 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:13.260 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:55374 3.13 3:ce471d87:::rbd_data.11213b441054.0000000000000036:2e [read 262144~16384 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e91)", 2024-09-13T06:41:13.260 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:44.499890+0000", 2024-09-13T06:41:13.260 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 28.673688135999999, 2024-09-13T06:41:13.260 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.026933168, 2024-09-13T06:41:13.260 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:13.260 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:13.260 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:13.261 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:13.261 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:13.261 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 55374 2024-09-13T06:41:13.261 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:13.261 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:13.261 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:13.261 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:13.261 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.499890+0000", 2024-09-13T06:41:13.261 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:13.261 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:13.261 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:13.261 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:13.261 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.499890+0000", 2024-09-13T06:41:13.261 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:13.262 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:13.262 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:13.262 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:13.262 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.499889+0000", 2024-09-13T06:41:13.262 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:13.262 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:13.262 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:13.262 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:13.262 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.499895+0000", 2024-09-13T06:41:13.262 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.7690000000000002e-06 2024-09-13T06:41:13.262 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:13.262 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:13.262 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:13.262 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.499912+0000", 2024-09-13T06:41:13.263 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6852999999999999e-05 2024-09-13T06:41:13.263 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:13.263 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:13.263 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:13.263 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.499925+0000", 2024-09-13T06:41:13.263 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2549e-05 2024-09-13T06:41:13.263 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:13.263 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:13.263 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:13.263 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.526526+0000", 2024-09-13T06:41:13.263 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.026601392000000001 2024-09-13T06:41:13.263 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:13.263 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:13.263 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:13.264 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.526664+0000", 2024-09-13T06:41:13.264 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00013789 2024-09-13T06:41:13.264 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:13.264 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:13.264 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:13.264 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:44.526824+0000", 2024-09-13T06:41:13.264 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00015967800000000001 2024-09-13T06:41:13.264 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:13.264 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:13.264 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:13.264 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:13.264 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:13.264 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:69017 3.f 3:f7719deb:::rbd_data.1121867cc19b.0000000000000003:head [set-alloc-hint object_size 33554432 write_size 33554432,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109)", 2024-09-13T06:41:13.264 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:41:03.515391+0000", 2024-09-13T06:41:13.265 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 9.6581873659999999, 2024-09-13T06:41:13.265 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.029766933999999998, 2024-09-13T06:41:13.265 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:13.265 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:41:13.265 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:13.265 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:13.265 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:13.265 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 69017 2024-09-13T06:41:13.265 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:13.265 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:13.265 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:13.265 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:13.265 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:03.515391+0000", 2024-09-13T06:41:13.265 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:13.266 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:13.266 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:13.266 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:13.266 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:03.515391+0000", 2024-09-13T06:41:13.266 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:13.266 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:13.266 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:13.266 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:13.266 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:03.515390+0000", 2024-09-13T06:41:13.266 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999986 2024-09-13T06:41:13.266 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:13.266 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:13.266 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:13.266 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:03.515397+0000", 2024-09-13T06:41:13.267 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.9399999999999996e-06 2024-09-13T06:41:13.267 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:13.267 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:13.267 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:13.267 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:03.515413+0000", 2024-09-13T06:41:13.267 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6248000000000001e-05 2024-09-13T06:41:13.267 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:13.267 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:13.267 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:13.267 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:03.515422+0000", 2024-09-13T06:41:13.267 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.7490000000000004e-06 2024-09-13T06:41:13.267 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:13.267 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:13.268 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:13.268 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:03.515536+0000", 2024-09-13T06:41:13.268 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00011391999999999999 2024-09-13T06:41:13.268 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:13.268 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:13.268 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:13.268 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:03.515777+0000", 2024-09-13T06:41:13.268 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00024096999999999999 2024-09-13T06:41:13.268 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:13.268 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:13.268 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 2", 2024-09-13T06:41:13.268 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:03.521255+0000", 2024-09-13T06:41:13.268 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0054784600000000001 2024-09-13T06:41:13.268 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:13.269 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:13.269 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-13T06:41:13.269 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:03.544884+0000", 2024-09-13T06:41:13.269 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.023628850999999999 2024-09-13T06:41:13.269 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:13.269 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:13.269 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:41:13.269 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:03.544990+0000", 2024-09-13T06:41:13.269 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00010615699999999999 2024-09-13T06:41:13.269 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:13.269 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:13.269 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-13T06:41:13.269 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:03.545085+0000", 2024-09-13T06:41:13.269 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.4704000000000007e-05 2024-09-13T06:41:13.270 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:13.270 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:13.270 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:13.270 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:03.545158+0000", 2024-09-13T06:41:13.270 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.3193000000000002e-05 2024-09-13T06:41:13.270 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:13.270 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:13.270 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:13.270 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:13.270 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:13.270 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:41:13.271 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-13T06:41:13.273 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:41:13.272+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:41:13.273 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-13T06:41:13.275 INFO:teuthology.orchestra.run.smithi081.stdout:2980 write 0x7fbcc14 thru 0x7fc5c8d (0x907a bytes) 2024-09-13T06:41:13.275 INFO:teuthology.orchestra.run.smithi081.stdout:2981 writesame 0x8c848cc thru 0x8c9205c data_size 0x41(0xd791 bytes) 2024-09-13T06:41:13.275 INFO:teuthology.orchestra.run.smithi081.stdout:2987 read 0x2cc2165 thru 0x2cc8407 (0x62a3 bytes) 2024-09-13T06:41:13.275 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:41:13.275 INFO:teuthology.orchestra.run.smithi081.stdout:2989 write 0xa7c0627 thru 0xa7cd925 (0xd2ff bytes) 2024-09-13T06:41:13.275 INFO:teuthology.orchestra.run.smithi081.stdout:2990 read 0x68a24f4 thru 0x68ab35e (0x8e6b bytes) 2024-09-13T06:41:13.276 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:41:13.276 INFO:teuthology.orchestra.run.smithi081.stdout:2992 write 0x79862e7 thru 0x798e11c (0x7e36 bytes) 2024-09-13T06:41:13.276 INFO:teuthology.orchestra.run.smithi081.stdout:2993 write 0x82732c6 thru 0x827921c (0x5f57 bytes) 2024-09-13T06:41:13.276 INFO:teuthology.orchestra.run.smithi081.stdout:2995 read 0xc01fbbb thru 0xc021a0f (0x1e55 bytes) 2024-09-13T06:41:13.276 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:41:13.276 INFO:teuthology.orchestra.run.smithi081.stdout:2997 write 0x29726d1 thru 0x2974f62 (0x2892 bytes) 2024-09-13T06:41:13.276 INFO:teuthology.orchestra.run.smithi081.stdout:2999 write 0x46be57 thru 0x46fd30 (0x3eda bytes) 2024-09-13T06:41:13.276 INFO:teuthology.orchestra.run.smithi081.stdout:3002 write 0x142c39f thru 0x1435632 (0x9294 bytes) 2024-09-13T06:41:13.276 INFO:teuthology.orchestra.run.smithi081.stdout:3003 writesame 0xea90a13 thru 0xea9262a data_size 0x3a(0x1c18 bytes) 2024-09-13T06:41:13.276 INFO:teuthology.orchestra.run.smithi081.stdout:3004 punch from 0x6bd18ff to 0x6bda83f, (0x8f40 bytes) 2024-09-13T06:41:13.276 INFO:teuthology.orchestra.run.smithi081.stdout:3006 read 0x42b9145 thru 0x42c4acb (0xb987 bytes) 2024-09-13T06:41:13.276 INFO:teuthology.orchestra.run.smithi081.stdout:3008 read 0x282a937 thru 0x283408e (0x9758 bytes) 2024-09-13T06:41:13.276 INFO:teuthology.orchestra.run.smithi081.stdout:3009 writesame 0xafa2bd6 thru 0xafac935 data_size 0x10(0x9d60 bytes) 2024-09-13T06:41:13.277 INFO:teuthology.orchestra.run.smithi081.stdout:3011 write 0xcf58e19 thru 0xcf5bf69 (0x3151 bytes) 2024-09-13T06:41:13.277 INFO:teuthology.orchestra.run.smithi081.stdout:3013 writesame 0x8b72c07 thru 0x8b76ccb data_size 0x1(0x40c5 bytes) 2024-09-13T06:41:13.277 INFO:teuthology.orchestra.run.smithi081.stdout:3014 trunc from 0xeb0c24e to 0xc2a97b5 2024-09-13T06:41:13.277 INFO:teuthology.orchestra.run.smithi081.stdout:3018 trunc from 0xc2a97b5 to 0xb872068 2024-09-13T06:41:13.299 INFO:teuthology.orchestra.run.smithi081.stdout:3019 write 0x6aec8ca thru 0x6af1a8a (0x51c1 bytes) 2024-09-13T06:41:13.307 INFO:teuthology.orchestra.run.smithi081.stdout:3020 writesame 0x3abe48b thru 0x3ac6a4b data_size 0x1(0x85c1 bytes) 2024-09-13T06:41:13.324 INFO:teuthology.orchestra.run.smithi081.stdout:3021 read 0x4e0e68f thru 0x4e12a69 (0x43db bytes) 2024-09-13T06:41:13.324 INFO:teuthology.orchestra.run.smithi081.stdout:3022 read 0x59cd91e thru 0x59d0be6 (0x32c9 bytes) 2024-09-13T06:41:13.326 INFO:teuthology.orchestra.run.smithi081.stdout:3024 write 0xa2d65c8 thru 0xa2d9437 (0x2e70 bytes) 2024-09-13T06:41:13.329 INFO:teuthology.orchestra.run.smithi081.stdout:3025 read 0x42464b9 thru 0x4255958 (0xf4a0 bytes) 2024-09-13T06:41:13.343 INFO:teuthology.orchestra.run.smithi081.stdout:3027 write 0xbc97774 thru 0xbc9ad38 (0x35c5 bytes) 2024-09-13T06:41:13.347 INFO:teuthology.orchestra.run.smithi081.stdout:3028 trunc from 0xbc9ad39 to 0xb5a8cd7 2024-09-13T06:41:13.363 INFO:teuthology.orchestra.run.smithi081.stdout:3030 write 0x3ddb5cb thru 0x3ddd05e (0x1a94 bytes) 2024-09-13T06:41:13.373 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:41:13.372+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:41:13.373 INFO:teuthology.orchestra.run.smithi081.stdout:3031 trunc from 0xb5a8cd7 to 0x771a3e5 2024-09-13T06:41:13.398 INFO:teuthology.orchestra.run.smithi081.stdout:3032 read 0x1dcb6dc thru 0x1dda427 (0xed4c bytes) 2024-09-13T06:41:13.399 INFO:teuthology.orchestra.run.smithi081.stdout:3033 read 0x611de60 thru 0x6121c06 (0x3da7 bytes) 2024-09-13T06:41:13.400 INFO:teuthology.orchestra.run.smithi081.stdout:3034 write 0x28cc201 thru 0x28d1d0b (0x5b0b bytes) 2024-09-13T06:41:13.403 INFO:teuthology.orchestra.run.smithi081.stdout:3035 read 0x39ed7d7 thru 0x39f5949 (0x8173 bytes) 2024-09-13T06:41:13.409 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-13T06:41:13.421 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:41:13.421 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-13T06:41:13.421 INFO:teuthology.orchestra.run.smithi081.stdout: "num_ops": 0 2024-09-13T06:41:13.421 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:41:13.439 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-13T06:41:13.462 INFO:teuthology.orchestra.run.smithi081.stdout:osd.0: {} 2024-09-13T06:41:13.462 INFO:teuthology.orchestra.run.smithi081.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-13T06:41:13.473 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:41:13.472+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:41:13.493 INFO:teuthology.orchestra.run.smithi081.stdout:osd.1: {} 2024-09-13T06:41:13.493 INFO:teuthology.orchestra.run.smithi081.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-13T06:41:13.574 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:41:13.574+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:41:13.600 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:41:13.600 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:41:13.618 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-13T06:41:13.675 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:41:13.672+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:41:13.718 INFO:teuthology.orchestra.run.smithi081.stdout:osd.2: {} 2024-09-13T06:41:13.719 INFO:teuthology.orchestra.run.smithi081.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-13T06:41:13.748 INFO:teuthology.orchestra.run.smithi081.stdout:osd.3: {} 2024-09-13T06:41:13.749 INFO:teuthology.orchestra.run.smithi081.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-13T06:41:13.774 INFO:teuthology.orchestra.run.smithi081.stdout:osd.4: {} 2024-09-13T06:41:13.774 INFO:teuthology.orchestra.run.smithi081.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-13T06:41:13.775 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:41:13.774+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:41:13.802 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:41:13.802 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:41:13.808 INFO:teuthology.orchestra.run.smithi081.stdout:osd.5: {} 2024-09-13T06:41:13.808 INFO:teuthology.orchestra.run.smithi081.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-13T06:41:13.820 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-13T06:41:13.831 INFO:teuthology.orchestra.run.smithi081.stdout:osd.6: {} 2024-09-13T06:41:13.832 INFO:teuthology.orchestra.run.smithi081.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-13T06:41:13.854 INFO:teuthology.orchestra.run.smithi081.stdout:osd.7: {} 2024-09-13T06:41:13.854 INFO:teuthology.orchestra.run.smithi081.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-13T06:41:13.918 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:41:13.918+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:41:13.946 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:41:13.946 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:41:13.960 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-13T06:41:13.978 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:41:13.976+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:41:14.079 INFO:tasks.ceph.osd.6.smithi139.stderr:2024-09-13T06:41:14.076+0000 7fcd02c5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26385) UID: 0 2024-09-13T06:41:14.120 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:41:14.121 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:41:14.136 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-13T06:41:14.180 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-13T06:41:14.180+0000 7f86a5f06640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26387) UID: 0 2024-09-13T06:41:14.258 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:41:14.258 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:41:14.272 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-13T06:41:14.318 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:41:14.318+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:41:14.382 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:41:14.382+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:41:14.390 INFO:teuthology.orchestra.run.smithi081.stderr:noscrub is set 2024-09-13T06:41:14.398 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:41:14.398 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:41:14.405 INFO:teuthology.orchestra.run.smithi081.stdout:3037 trunc from 0x771a3e5 to 0x9383c2d 2024-09-13T06:41:14.422 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-13T06:41:14.424 INFO:teuthology.orchestra.run.smithi081.stdout:3039 read 0x4f54ee4 thru 0x4f62a72 (0xdb8f bytes) 2024-09-13T06:41:14.425 INFO:teuthology.orchestra.run.smithi081.stdout:3041 write 0x1765e97 thru 0x176b7b0 (0x591a bytes) 2024-09-13T06:41:14.427 INFO:teuthology.orchestra.run.smithi081.stdout:3042 write 0x3b32bfd thru 0x3b365f3 (0x39f7 bytes) 2024-09-13T06:41:14.429 INFO:teuthology.orchestra.run.smithi081.stdout:3043 write 0x8e740cf thru 0x8e83a03 (0xf935 bytes) 2024-09-13T06:41:14.431 INFO:teuthology.orchestra.run.smithi081.stdout:3044 read 0x83c2ea5 thru 0x83d155e (0xe6ba bytes) 2024-09-13T06:41:14.432 INFO:teuthology.orchestra.run.smithi081.stdout:3047 writesame 0x19e490 thru 0x1a2f40 data_size 0x1(0x4ab1 bytes) 2024-09-13T06:41:14.459 INFO:teuthology.orchestra.run.smithi081.stdout:3048 punch from 0x17e88ab to 0x17f0b3f, (0x8294 bytes) 2024-09-13T06:41:14.459 INFO:teuthology.orchestra.run.smithi081.stdout:3049 write 0x8f3ebf8 thru 0x8f3f5ec (0x9f5 bytes) 2024-09-13T06:41:14.462 INFO:teuthology.orchestra.run.smithi081.stdout:3050 read 0x634c4aa thru 0x635af1a (0xea71 bytes) 2024-09-13T06:41:14.463 INFO:teuthology.orchestra.run.smithi081.stdout:3051 read 0x81d16a thru 0x81fa9a (0x2931 bytes) 2024-09-13T06:41:14.479 INFO:teuthology.orchestra.run.smithi081.stdout:3055 write 0xb68a1d7 thru 0xb68d637 (0x3461 bytes) 2024-09-13T06:41:14.482 INFO:teuthology.orchestra.run.smithi081.stdout:3056 punch from 0x9928354 to 0x993445e, (0xc10a bytes) 2024-09-13T06:41:14.482 INFO:teuthology.orchestra.run.smithi081.stdout:3058 punch from 0x50b47a7 to 0x50c0d06, (0xc55f bytes) 2024-09-13T06:41:14.483 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:41:14.482+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:41:14.498 INFO:teuthology.orchestra.run.smithi081.stdout:3059 writesame 0xea4c9e7 thru 0xea50b41 data_size 0x27(0x415b bytes) 2024-09-13T06:41:14.499 INFO:teuthology.orchestra.run.smithi081.stdout:3060 write 0xca236a0 thru 0xca29487 (0x5de8 bytes) 2024-09-13T06:41:14.505 INFO:teuthology.orchestra.run.smithi081.stdout:3061 read 0x2d1e209 thru 0x2d1f976 (0x176e bytes) 2024-09-13T06:41:14.506 INFO:teuthology.orchestra.run.smithi081.stdout:3062 read 0x6beeac9 thru 0x6bf804a (0x9582 bytes) 2024-09-13T06:41:14.506 INFO:teuthology.orchestra.run.smithi081.stdout:3064 writesame 0x8b9cf27 thru 0x8ba4e9f data_size 0x1(0x7f79 bytes) 2024-09-13T06:41:14.542 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:41:14.542 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:41:14.557 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-13T06:41:14.584 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-13T06:41:14.584+0000 7f86a5f06640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26387) UID: 0 2024-09-13T06:41:14.685 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:41:14.682+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:41:14.720 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:41:14.720 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:41:14.734 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-13T06:41:14.826 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:41:14.826+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:41:14.886 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:41:14.886+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:41:14.904 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:41:14.904 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:41:14.919 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-13T06:41:15.010 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:41:15.010+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:41:15.086 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:41:15.086 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:41:15.088 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:41:15.086+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:41:15.100 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-13T06:41:15.189 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:41:15.187+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:41:15.272 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:41:15.272 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:41:15.286 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-13T06:41:15.290 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:41:15.290+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:41:15.392 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:41:15.390+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:41:15.427 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:41:15.427 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:41:15.441 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-13T06:41:15.450 INFO:teuthology.orchestra.run.smithi081.stdout:3065 write 0x48b99ac thru 0x48bd493 (0x3ae8 bytes) 2024-09-13T06:41:15.453 INFO:teuthology.orchestra.run.smithi081.stdout:3066 read 0x6b0e7c1 thru 0x6b1dcfc (0xf53c bytes) 2024-09-13T06:41:15.457 INFO:teuthology.orchestra.run.smithi081.stdout:3068 punch from 0x24b4d03 to 0x24c1faa, (0xd2a7 bytes) 2024-09-13T06:41:15.458 INFO:teuthology.orchestra.run.smithi081.stdout:3069 read 0x74b244a thru 0x74b816d (0x5d24 bytes) 2024-09-13T06:41:15.483 INFO:teuthology.orchestra.run.smithi081.stdout:3070 trunc from 0xea50b42 to 0x42cf2de 2024-09-13T06:41:15.492 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:41:15.491+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:41:15.533 INFO:teuthology.orchestra.run.smithi081.stdout:3071 write 0xd2330f1 thru 0xd2409cc (0xd8dc bytes) 2024-09-13T06:41:15.539 INFO:teuthology.orchestra.run.smithi081.stdout:3072 write 0x4c7482d thru 0x4c754d9 (0xcad bytes) 2024-09-13T06:41:15.556 INFO:teuthology.orchestra.run.smithi081.stdout:3075 writesame 0xd55fb1a thru 0xd56e511 data_size 0x4(0xe9f8 bytes) 2024-09-13T06:41:15.556 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:41:15.557 INFO:teuthology.orchestra.run.smithi081.stdout:3078 write 0x8b29c1 thru 0x8beac7 (0xc107 bytes) 2024-09-13T06:41:15.560 INFO:teuthology.orchestra.run.smithi081.stdout:3080 read 0xf113a4 thru 0xf1bf38 (0xab95 bytes) 2024-09-13T06:41:15.561 INFO:teuthology.orchestra.run.smithi081.stdout:3081 read 0x16324e3 thru 0x16401f4 (0xdd12 bytes) 2024-09-13T06:41:15.562 INFO:teuthology.orchestra.run.smithi081.stdout:3082 punch from 0xb787c40 to 0xb789687, (0x1a47 bytes) 2024-09-13T06:41:15.562 INFO:teuthology.orchestra.run.smithi081.stdout:3084 writesame 0x8ebcaa0 thru 0x8ec69db data_size 0x6(0x9f3c bytes) 2024-09-13T06:41:15.563 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:41:15.563 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:41:15.570 INFO:teuthology.orchestra.run.smithi081.stdout:3087 write 0x8646eb7 thru 0x8654261 (0xd3ab bytes) 2024-09-13T06:41:15.573 INFO:teuthology.orchestra.run.smithi081.stdout:3088 read 0xaae7dd3 thru 0xaaf7270 (0xf49e bytes) 2024-09-13T06:41:15.574 INFO:teuthology.orchestra.run.smithi081.stdout:3090 read 0x9f8a697 thru 0x9f96660 (0xbfca bytes) 2024-09-13T06:41:15.580 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-13T06:41:15.586 INFO:teuthology.orchestra.run.smithi081.stdout:3091 trunc from 0xd56e512 to 0x9894985 2024-09-13T06:41:15.606 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:41:15.614 INFO:teuthology.orchestra.run.smithi081.stdout:3093 trunc from 0x9894985 to 0x6bf002b 2024-09-13T06:41:15.628 INFO:tasks.ceph.osd.6.smithi139.stderr:2024-09-13T06:41:15.627+0000 7fcd02c5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26385) UID: 0 2024-09-13T06:41:15.629 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:41:15.629 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:41:15.629 INFO:teuthology.orchestra.run.smithi081.stdout:3097 read 0x8d55a1 thru 0x8da8c8 (0x5328 bytes) 2024-09-13T06:41:15.651 INFO:teuthology.orchestra.run.smithi081.stdout:3099 write 0xae35adf thru 0xae3913d (0x365f bytes) 2024-09-13T06:41:15.655 INFO:teuthology.orchestra.run.smithi081.stdout:3100 punch from 0x45293e3 to 0x4531bdc, (0x87f9 bytes) 2024-09-13T06:41:15.655 INFO:teuthology.orchestra.run.smithi081.stdout:3103 write 0x4be5f53 thru 0x4bf365c (0xd70a bytes) 2024-09-13T06:41:15.658 INFO:teuthology.orchestra.run.smithi081.stdout:3105 clone 20 order 21 su 524288 sc 14 2024-09-13T06:41:15.694 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:41:15.694+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:41:15.696 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 4, 6, 7, 5, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-13T06:41:15.696 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-13T06:41:15.696 INFO:tasks.thrashosds.thrasher:Killing osd 7, live_osds are [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-13T06:41:15.696 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-09-13T06:41:15.697 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T06:41:15.747 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:41:15.747 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:41:15.764 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-13T06:41:15.770 INFO:tasks.ceph.osd.7:Stopped 2024-09-13T06:41:15.770 INFO:tasks.thrashosds.thrasher:Testing ceph-objectstore-tool on down osd.7 2024-09-13T06:41:15.771 INFO:tasks.thrashosds.thrasher:remote for osd 7 is ubuntu@smithi139.front.sepia.ceph.com 2024-09-13T06:41:15.771 DEBUG:teuthology.orchestra.run.smithi139:> type ceph-objectstore-tool 2024-09-13T06:41:15.816 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:41:15.815+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:41:15.819 INFO:teuthology.orchestra.run.smithi139.stdout:ceph-objectstore-tool is /usr/bin/ceph-objectstore-tool 2024-09-13T06:41:15.820 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-objectstore-tool --err-to-stderr --no-mon-config '--log-file=/var/log/ceph/objectstore_tool.$pid.log' --data-path /var/lib/ceph/osd/ceph-7 --journal-path /var/lib/ceph/osd/ceph-7/journal --op list-pgs 2024-09-13T06:41:15.872 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-13T06:41:15.880 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:41:15.880 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:41:15.896 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-13T06:41:15.922 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:41:15.922+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:41:15.997 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:41:15.994+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:41:16.028 INFO:teuthology.orchestra.run.smithi081.stdout:osd.0: {} 2024-09-13T06:41:16.029 INFO:teuthology.orchestra.run.smithi081.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-13T06:41:16.044 INFO:teuthology.orchestra.run.smithi081.stdout:osd.1: {} 2024-09-13T06:41:16.045 INFO:teuthology.orchestra.run.smithi081.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-13T06:41:16.059 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:41:16.059 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:41:16.060 INFO:teuthology.orchestra.run.smithi081.stdout:osd.2: {} 2024-09-13T06:41:16.060 INFO:teuthology.orchestra.run.smithi081.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-13T06:41:16.074 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-13T06:41:16.078 INFO:teuthology.orchestra.run.smithi081.stdout:osd.3: {} 2024-09-13T06:41:16.078 INFO:teuthology.orchestra.run.smithi081.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-13T06:41:16.096 INFO:teuthology.orchestra.run.smithi081.stdout:osd.4: {} 2024-09-13T06:41:16.096 INFO:teuthology.orchestra.run.smithi081.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-13T06:41:16.113 INFO:teuthology.orchestra.run.smithi081.stdout:osd.5: {} 2024-09-13T06:41:16.114 INFO:teuthology.orchestra.run.smithi081.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-13T06:41:16.119 INFO:tasks.ceph.osd.6.smithi139.stderr:2024-09-13T06:41:16.119+0000 7fcd02c5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26385) UID: 0 2024-09-13T06:41:16.132 INFO:teuthology.orchestra.run.smithi081.stdout:osd.6: {} 2024-09-13T06:41:16.132 INFO:teuthology.orchestra.run.smithi081.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-13T06:41:16.195 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:41:16.195 INFO:teuthology.orchestra.run.smithi139.stdout: "size": 20, 2024-09-13T06:41:16.195 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 600, 2024-09-13T06:41:16.195 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [ 2024-09-13T06:41:16.195 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.195 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43282 3.1d 3:bd80bfb3:::rbd_object_map.11212f44bfb1.0000000000000020:head [call rbd.object_map_update in=20b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:16.195 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589032+0000", 2024-09-13T06:41:16.196 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 54.605398977, 2024-09-13T06:41:16.196 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.076225263000000001, 2024-09-13T06:41:16.196 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:16.196 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:41:16.196 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:16.196 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:16.196 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:16.196 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43282 2024-09-13T06:41:16.196 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.196 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:16.196 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.196 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:16.196 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589032+0000", 2024-09-13T06:41:16.197 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:16.197 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.197 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.197 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:16.197 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589032+0000", 2024-09-13T06:41:16.197 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:16.197 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.197 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.197 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:16.197 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589031+0000", 2024-09-13T06:41:16.197 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:16.197 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.197 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.198 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:16.198 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589036+0000", 2024-09-13T06:41:16.198 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.2619999999999998e-06 2024-09-13T06:41:16.198 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.198 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.198 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:16.198 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589046+0000", 2024-09-13T06:41:16.198 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.8099999999999992e-06 2024-09-13T06:41:16.198 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.198 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.198 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:16.198 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589054+0000", 2024-09-13T06:41:16.199 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.2230000000000007e-06 2024-09-13T06:41:16.199 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.199 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.199 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:16.199 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.660691+0000", 2024-09-13T06:41:16.199 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.07163659 2024-09-13T06:41:16.199 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.199 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.199 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:16.199 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.660850+0000", 2024-09-13T06:41:16.199 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00015864300000000001 2024-09-13T06:41:16.199 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.199 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.200 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 4", 2024-09-13T06:41:16.200 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.661729+0000", 2024-09-13T06:41:16.200 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00087956099999999995 2024-09-13T06:41:16.200 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.200 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.200 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:41:16.200 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.664409+0000", 2024-09-13T06:41:16.200 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0026803479999999999 2024-09-13T06:41:16.200 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.200 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.200 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-13T06:41:16.200 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.665088+0000", 2024-09-13T06:41:16.200 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00067901400000000003 2024-09-13T06:41:16.200 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.201 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.201 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-13T06:41:16.201 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.665181+0000", 2024-09-13T06:41:16.201 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.2050000000000001e-05 2024-09-13T06:41:16.201 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.201 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.201 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:16.201 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.665257+0000", 2024-09-13T06:41:16.201 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.6698000000000003e-05 2024-09-13T06:41:16.201 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:16.201 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:16.201 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:16.201 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.202 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.202 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43289 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 284672~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:16.202 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589475+0000", 2024-09-13T06:41:16.202 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 54.604956326999996, 2024-09-13T06:41:16.202 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.075789117000000003, 2024-09-13T06:41:16.202 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:16.202 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:16.202 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:16.202 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:16.202 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:16.202 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43289 2024-09-13T06:41:16.202 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.202 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:16.203 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.203 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:16.203 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589475+0000", 2024-09-13T06:41:16.203 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:16.203 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.203 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.203 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:16.203 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589475+0000", 2024-09-13T06:41:16.203 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:16.203 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.203 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.203 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:16.203 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589474+0000", 2024-09-13T06:41:16.203 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:16.204 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.204 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.204 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:16.204 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589477+0000", 2024-09-13T06:41:16.204 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.7929999999999999e-06 2024-09-13T06:41:16.204 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.204 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.204 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:16.204 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589486+0000", 2024-09-13T06:41:16.204 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.4989999999999994e-06 2024-09-13T06:41:16.204 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.204 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.205 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:16.205 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589493+0000", 2024-09-13T06:41:16.205 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5329999999999997e-06 2024-09-13T06:41:16.205 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.205 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.205 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:16.205 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.664456+0000", 2024-09-13T06:41:16.205 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.074962794999999999 2024-09-13T06:41:16.205 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.205 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.205 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:16.205 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.664653+0000", 2024-09-13T06:41:16.205 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000197107 2024-09-13T06:41:16.205 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.206 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.206 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:16.206 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.665264+0000", 2024-09-13T06:41:16.206 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00061037600000000004 2024-09-13T06:41:16.206 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:16.206 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:16.206 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:16.206 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.206 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.206 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43290 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 299008~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:16.206 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589500+0000", 2024-09-13T06:41:16.206 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 54.604930815000003, 2024-09-13T06:41:16.206 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.075898564000000002, 2024-09-13T06:41:16.207 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:16.207 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:16.207 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:16.207 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:16.207 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:16.207 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43290 2024-09-13T06:41:16.207 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.207 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:16.207 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.207 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:16.207 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589500+0000", 2024-09-13T06:41:16.207 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:16.207 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.208 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.208 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:16.208 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589500+0000", 2024-09-13T06:41:16.208 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:16.208 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.208 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.208 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:16.208 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589499+0000", 2024-09-13T06:41:16.208 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:16.208 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.208 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.208 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:16.208 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589503+0000", 2024-09-13T06:41:16.208 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.8330000000000004e-06 2024-09-13T06:41:16.209 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.209 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.209 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:16.209 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589511+0000", 2024-09-13T06:41:16.209 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.3359999999999995e-06 2024-09-13T06:41:16.209 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.209 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.209 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:16.209 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589519+0000", 2024-09-13T06:41:16.209 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.4760000000000001e-06 2024-09-13T06:41:16.209 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.209 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.210 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:16.210 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.665097+0000", 2024-09-13T06:41:16.210 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.075577828999999999 2024-09-13T06:41:16.210 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.210 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.210 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:16.210 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.665170+0000", 2024-09-13T06:41:16.210 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.3745000000000006e-05 2024-09-13T06:41:16.210 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.210 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.210 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:16.210 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.665399+0000", 2024-09-13T06:41:16.210 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00022826199999999999 2024-09-13T06:41:16.210 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:16.211 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:16.211 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:16.211 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.211 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.211 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43291 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 313344~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:16.211 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589560+0000", 2024-09-13T06:41:16.211 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 54.604870593999998, 2024-09-13T06:41:16.211 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.076145594999999996, 2024-09-13T06:41:16.211 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:16.211 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:16.211 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:16.211 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:16.211 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:16.212 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43291 2024-09-13T06:41:16.212 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.212 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:16.212 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.212 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:16.212 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589560+0000", 2024-09-13T06:41:16.212 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:16.212 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.212 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.212 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:16.212 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589560+0000", 2024-09-13T06:41:16.212 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:16.212 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.212 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.213 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:16.213 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589559+0000", 2024-09-13T06:41:16.213 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:16.213 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.213 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.213 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:16.213 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589564+0000", 2024-09-13T06:41:16.213 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.3989999999999997e-06 2024-09-13T06:41:16.213 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.213 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.213 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:16.213 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589574+0000", 2024-09-13T06:41:16.213 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0502999999999999e-05 2024-09-13T06:41:16.213 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.214 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.214 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:16.214 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589582+0000", 2024-09-13T06:41:16.214 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.1859999999999992e-06 2024-09-13T06:41:16.214 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.214 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.214 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:16.214 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.665423+0000", 2024-09-13T06:41:16.214 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.075840290000000005 2024-09-13T06:41:16.214 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.214 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.214 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:16.214 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.665496+0000", 2024-09-13T06:41:16.215 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.2791000000000002e-05 2024-09-13T06:41:16.215 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.215 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.215 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:16.215 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.665706+0000", 2024-09-13T06:41:16.215 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00021038200000000001 2024-09-13T06:41:16.215 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:16.215 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:16.215 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:16.215 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.215 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.215 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43292 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 327680~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:16.216 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589589+0000", 2024-09-13T06:41:16.216 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 54.604842052999999, 2024-09-13T06:41:16.216 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.076769537999999998, 2024-09-13T06:41:16.216 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:16.216 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:16.216 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:16.216 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:16.216 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:16.216 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43292 2024-09-13T06:41:16.216 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.216 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:16.216 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.216 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:16.217 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589589+0000", 2024-09-13T06:41:16.217 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:16.217 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.217 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.217 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:16.217 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589589+0000", 2024-09-13T06:41:16.217 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:16.217 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.217 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.217 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:16.217 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589588+0000", 2024-09-13T06:41:16.217 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:16.218 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.218 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.218 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:16.218 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589592+0000", 2024-09-13T06:41:16.218 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.6389999999999998e-06 2024-09-13T06:41:16.218 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.218 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.218 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:16.218 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589600+0000", 2024-09-13T06:41:16.218 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.4630000000000001e-06 2024-09-13T06:41:16.218 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.218 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.218 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:16.219 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589608+0000", 2024-09-13T06:41:16.219 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.2359999999999998e-06 2024-09-13T06:41:16.219 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.219 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.219 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:16.219 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.665779+0000", 2024-09-13T06:41:16.219 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.076170924000000001 2024-09-13T06:41:16.219 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.219 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.219 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:16.219 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.665977+0000", 2024-09-13T06:41:16.219 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00019891900000000001 2024-09-13T06:41:16.219 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.219 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.220 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:16.220 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.666358+0000", 2024-09-13T06:41:16.220 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000380963 2024-09-13T06:41:16.220 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:16.220 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:16.220 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:16.220 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.220 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.220 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43293 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 342016~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:16.220 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589616+0000", 2024-09-13T06:41:16.220 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 54.604815158999997, 2024-09-13T06:41:16.220 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.077030083999999999, 2024-09-13T06:41:16.220 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:16.221 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:16.221 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:16.221 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:16.221 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:16.221 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43293 2024-09-13T06:41:16.221 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.221 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:16.221 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.221 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:16.221 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589616+0000", 2024-09-13T06:41:16.221 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:16.221 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.221 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.222 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:16.224 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589616+0000", 2024-09-13T06:41:16.224 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:16.224 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.224 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.224 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:16.224 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589615+0000", 2024-09-13T06:41:16.224 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:16.224 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.224 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.224 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:16.225 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589619+0000", 2024-09-13T06:41:16.225 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.9559999999999999e-06 2024-09-13T06:41:16.225 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.225 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.225 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:16.225 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589627+0000", 2024-09-13T06:41:16.225 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.2490000000000001e-06 2024-09-13T06:41:16.225 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.225 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.225 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:16.225 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589635+0000", 2024-09-13T06:41:16.225 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.96e-06 2024-09-13T06:41:16.225 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.225 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.226 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:16.226 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.666379+0000", 2024-09-13T06:41:16.226 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.076744484000000002 2024-09-13T06:41:16.226 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.226 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.226 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:16.226 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.666454+0000", 2024-09-13T06:41:16.226 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.4623999999999996e-05 2024-09-13T06:41:16.226 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.226 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.226 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:16.226 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.666646+0000", 2024-09-13T06:41:16.226 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00019176999999999999 2024-09-13T06:41:16.226 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:16.227 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:16.227 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:16.227 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.227 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.227 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43294 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 356352~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:16.227 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589681+0000", 2024-09-13T06:41:16.227 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 54.604749843999997, 2024-09-13T06:41:16.227 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.077594648000000002, 2024-09-13T06:41:16.227 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:16.227 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:16.227 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:16.227 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:16.227 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:16.228 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43294 2024-09-13T06:41:16.228 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.228 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:16.228 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.228 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:16.228 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589681+0000", 2024-09-13T06:41:16.228 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:16.228 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.228 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.228 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:16.228 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589681+0000", 2024-09-13T06:41:16.229 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:16.229 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.229 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.229 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:16.229 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589680+0000", 2024-09-13T06:41:16.229 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:16.229 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.229 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.229 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:16.229 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589684+0000", 2024-09-13T06:41:16.229 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.8369999999999999e-06 2024-09-13T06:41:16.229 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.230 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.230 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:16.230 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589693+0000", 2024-09-13T06:41:16.230 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.1020000000000003e-06 2024-09-13T06:41:16.230 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.230 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.230 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:16.230 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589701+0000", 2024-09-13T06:41:16.230 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.8059999999999995e-06 2024-09-13T06:41:16.230 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.230 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.230 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:16.230 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.666714+0000", 2024-09-13T06:41:16.231 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.077013463000000004 2024-09-13T06:41:16.231 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.231 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.231 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:16.231 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.666897+0000", 2024-09-13T06:41:16.231 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000182268 2024-09-13T06:41:16.231 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.231 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.231 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:16.231 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.667276+0000", 2024-09-13T06:41:16.231 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00037907499999999998 2024-09-13T06:41:16.231 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:16.232 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:16.232 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:16.232 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.232 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.232 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43295 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 370688~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:16.232 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589744+0000", 2024-09-13T06:41:16.232 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 54.604686672, 2024-09-13T06:41:16.232 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.077854343000000006, 2024-09-13T06:41:16.232 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:16.232 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:16.232 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:16.232 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:16.232 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:16.233 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43295 2024-09-13T06:41:16.233 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.233 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:16.233 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.233 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:16.233 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589744+0000", 2024-09-13T06:41:16.233 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:16.233 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.233 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.233 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:16.233 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589744+0000", 2024-09-13T06:41:16.233 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:16.233 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.233 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.234 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:16.234 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589743+0000", 2024-09-13T06:41:16.234 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:16.234 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.234 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.234 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:16.234 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589747+0000", 2024-09-13T06:41:16.234 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0130000000000004e-06 2024-09-13T06:41:16.234 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.234 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.234 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:16.234 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589756+0000", 2024-09-13T06:41:16.235 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.003e-06 2024-09-13T06:41:16.235 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.235 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.235 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:16.235 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589766+0000", 2024-09-13T06:41:16.235 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.2820000000000002e-06 2024-09-13T06:41:16.235 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.235 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.235 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:16.235 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.667300+0000", 2024-09-13T06:41:16.235 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.077534299000000001 2024-09-13T06:41:16.235 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.235 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.236 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:16.236 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.667372+0000", 2024-09-13T06:41:16.236 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.2393999999999998e-05 2024-09-13T06:41:16.236 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.236 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.236 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:16.236 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.667599+0000", 2024-09-13T06:41:16.236 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000226269 2024-09-13T06:41:16.236 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:16.236 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:16.236 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:16.236 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.236 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.237 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43296 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 385024~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:16.237 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589772+0000", 2024-09-13T06:41:16.237 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 54.604658647999997, 2024-09-13T06:41:16.237 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.078469647000000003, 2024-09-13T06:41:16.237 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:16.237 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:16.237 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:16.237 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:16.237 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:16.237 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43296 2024-09-13T06:41:16.237 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.237 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:16.237 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.238 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:16.238 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589772+0000", 2024-09-13T06:41:16.238 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:16.238 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.238 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.238 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:16.238 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589772+0000", 2024-09-13T06:41:16.238 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:16.238 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.238 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.238 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:16.238 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589771+0000", 2024-09-13T06:41:16.238 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:16.239 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.239 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.239 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:16.239 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589775+0000", 2024-09-13T06:41:16.239 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.8530000000000002e-06 2024-09-13T06:41:16.239 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.239 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.239 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:16.239 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589784+0000", 2024-09-13T06:41:16.239 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.4300000000000006e-06 2024-09-13T06:41:16.239 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.239 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.239 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:16.240 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589791+0000", 2024-09-13T06:41:16.240 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.4660000000000002e-06 2024-09-13T06:41:16.240 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.240 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.240 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:16.240 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.667667+0000", 2024-09-13T06:41:16.240 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.077875697999999993 2024-09-13T06:41:16.240 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.240 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.240 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:16.240 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.667854+0000", 2024-09-13T06:41:16.240 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00018760099999999999 2024-09-13T06:41:16.241 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.241 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.241 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:16.241 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.668242+0000", 2024-09-13T06:41:16.241 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00038750600000000003 2024-09-13T06:41:16.241 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:16.241 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:16.241 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:16.241 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.241 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.241 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43297 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 403456~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:16.241 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589797+0000", 2024-09-13T06:41:16.241 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 54.604633944, 2024-09-13T06:41:16.241 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.078756672999999999, 2024-09-13T06:41:16.242 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:16.242 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:16.242 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:16.242 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:16.242 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:16.242 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43297 2024-09-13T06:41:16.242 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.242 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:16.242 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.242 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:16.242 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589797+0000", 2024-09-13T06:41:16.242 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:16.242 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.242 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.243 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:16.243 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589797+0000", 2024-09-13T06:41:16.243 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:16.243 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.243 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.243 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:16.243 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589796+0000", 2024-09-13T06:41:16.243 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:16.243 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.243 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.243 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:16.243 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589800+0000", 2024-09-13T06:41:16.243 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.3230000000000002e-06 2024-09-13T06:41:16.244 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.244 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.244 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:16.244 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589808+0000", 2024-09-13T06:41:16.244 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.2390000000000002e-06 2024-09-13T06:41:16.244 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.244 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.244 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:16.244 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589815+0000", 2024-09-13T06:41:16.244 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.413e-06 2024-09-13T06:41:16.244 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.244 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.245 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:16.245 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.668265+0000", 2024-09-13T06:41:16.245 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.078449873000000003 2024-09-13T06:41:16.245 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.245 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.245 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:16.245 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.668332+0000", 2024-09-13T06:41:16.245 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.7178e-05 2024-09-13T06:41:16.245 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.245 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.245 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:16.245 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.668554+0000", 2024-09-13T06:41:16.245 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00022128600000000001 2024-09-13T06:41:16.246 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:16.246 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:16.246 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:16.246 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.246 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.246 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43298 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 417792~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:16.246 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589821+0000", 2024-09-13T06:41:16.246 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 54.604609822, 2024-09-13T06:41:16.246 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.079368660999999993, 2024-09-13T06:41:16.246 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:16.246 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:16.246 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:16.246 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:16.247 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:16.247 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43298 2024-09-13T06:41:16.247 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.247 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:16.247 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.247 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:16.247 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589821+0000", 2024-09-13T06:41:16.247 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:16.247 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.247 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.247 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:16.247 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589821+0000", 2024-09-13T06:41:16.247 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:16.248 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.248 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.248 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:16.248 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589821+0000", 2024-09-13T06:41:16.248 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:16.248 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.248 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.248 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:16.248 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589830+0000", 2024-09-13T06:41:16.248 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.4860000000000003e-06 2024-09-13T06:41:16.248 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.248 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.249 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:16.249 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589839+0000", 2024-09-13T06:41:16.249 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.0159999999999997e-06 2024-09-13T06:41:16.249 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.249 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.249 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:16.249 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589847+0000", 2024-09-13T06:41:16.249 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.6059999999999997e-06 2024-09-13T06:41:16.249 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.249 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.249 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:16.249 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.668620+0000", 2024-09-13T06:41:16.249 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.078773485000000004 2024-09-13T06:41:16.250 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.250 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.250 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:16.250 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.668798+0000", 2024-09-13T06:41:16.250 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000178233 2024-09-13T06:41:16.250 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.250 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.250 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:16.250 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.669190+0000", 2024-09-13T06:41:16.250 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00039143499999999998 2024-09-13T06:41:16.250 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:16.250 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:16.251 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:16.251 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.251 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.251 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43299 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 432128~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:16.251 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589881+0000", 2024-09-13T06:41:16.251 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 54.604549974000001, 2024-09-13T06:41:16.251 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.079693849999999997, 2024-09-13T06:41:16.251 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:16.251 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:16.251 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:16.251 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:16.251 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:16.251 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43299 2024-09-13T06:41:16.251 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.252 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:16.252 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.252 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:16.252 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589881+0000", 2024-09-13T06:41:16.252 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:16.252 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.252 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.252 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:16.252 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589881+0000", 2024-09-13T06:41:16.252 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:16.252 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.252 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.252 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:16.253 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589880+0000", 2024-09-13T06:41:16.253 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:16.253 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.253 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.253 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:16.253 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589884+0000", 2024-09-13T06:41:16.253 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.053e-06 2024-09-13T06:41:16.253 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.253 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.253 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:16.253 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589893+0000", 2024-09-13T06:41:16.253 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.2129999999999997e-06 2024-09-13T06:41:16.253 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.254 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.254 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:16.254 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589901+0000", 2024-09-13T06:41:16.254 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.6399999999999997e-06 2024-09-13T06:41:16.254 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.254 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.254 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:16.254 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.669213+0000", 2024-09-13T06:41:16.254 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.079312074999999996 2024-09-13T06:41:16.254 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.254 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.254 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:16.254 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.669281+0000", 2024-09-13T06:41:16.255 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.8322000000000001e-05 2024-09-13T06:41:16.255 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.255 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.255 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:16.255 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.669575+0000", 2024-09-13T06:41:16.255 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00029349699999999999 2024-09-13T06:41:16.255 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:16.255 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:16.255 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:16.255 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.255 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.255 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43300 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 446464~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:16.256 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589909+0000", 2024-09-13T06:41:16.256 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 54.604522078999999, 2024-09-13T06:41:16.256 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.080339496999999996, 2024-09-13T06:41:16.256 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:16.256 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:16.256 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:16.256 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:16.256 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:16.256 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43300 2024-09-13T06:41:16.256 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.256 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:16.256 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.257 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:16.257 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589909+0000", 2024-09-13T06:41:16.257 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:16.257 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.257 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.257 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:16.257 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589909+0000", 2024-09-13T06:41:16.257 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:16.257 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.257 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.257 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:16.257 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589908+0000", 2024-09-13T06:41:16.258 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:16.258 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.258 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.258 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:16.258 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589912+0000", 2024-09-13T06:41:16.258 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.9430000000000002e-06 2024-09-13T06:41:16.258 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.258 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.258 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:16.258 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589920+0000", 2024-09-13T06:41:16.258 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.3860000000000007e-06 2024-09-13T06:41:16.258 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.258 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.258 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:16.259 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589928+0000", 2024-09-13T06:41:16.259 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.3329999999999999e-06 2024-09-13T06:41:16.259 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.259 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.259 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:16.259 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.669651+0000", 2024-09-13T06:41:16.259 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.079723204000000006 2024-09-13T06:41:16.259 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.259 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.259 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:16.259 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.669840+0000", 2024-09-13T06:41:16.259 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000189397 2024-09-13T06:41:16.259 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.260 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.260 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:16.260 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.670248+0000", 2024-09-13T06:41:16.260 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00040811100000000001 2024-09-13T06:41:16.260 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:16.260 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:16.260 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:16.260 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.260 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.260 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43301 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 460800~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:16.260 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589934+0000", 2024-09-13T06:41:16.260 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 54.604497405000004, 2024-09-13T06:41:16.260 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.080747474999999999, 2024-09-13T06:41:16.261 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:16.261 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:16.261 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:16.261 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:16.261 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:16.261 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43301 2024-09-13T06:41:16.261 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.261 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:16.261 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.261 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:16.261 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589934+0000", 2024-09-13T06:41:16.261 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:16.261 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.262 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.262 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:16.262 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589934+0000", 2024-09-13T06:41:16.262 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:16.262 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.262 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.262 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:16.262 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589933+0000", 2024-09-13T06:41:16.262 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:16.262 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.262 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.262 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:16.263 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589936+0000", 2024-09-13T06:41:16.263 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.4599999999999999e-06 2024-09-13T06:41:16.263 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.263 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.263 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:16.263 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589945+0000", 2024-09-13T06:41:16.263 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.2430000000000005e-06 2024-09-13T06:41:16.263 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.263 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.264 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:16.264 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589952+0000", 2024-09-13T06:41:16.264 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.3289999999999996e-06 2024-09-13T06:41:16.264 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.264 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.264 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:16.264 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.670280+0000", 2024-09-13T06:41:16.264 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.080328514000000004 2024-09-13T06:41:16.264 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.264 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.264 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:16.264 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.670376+0000", 2024-09-13T06:41:16.264 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.5752000000000001e-05 2024-09-13T06:41:16.265 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.265 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.265 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:16.265 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.670681+0000", 2024-09-13T06:41:16.265 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00030479699999999999 2024-09-13T06:41:16.265 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:16.265 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:16.265 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:16.265 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.265 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.265 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43302 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 475136~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:16.265 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589958+0000", 2024-09-13T06:41:16.265 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 54.604473343000002, 2024-09-13T06:41:16.266 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.081402394000000003, 2024-09-13T06:41:16.266 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:16.266 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:16.266 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:16.266 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:16.266 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:16.266 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43302 2024-09-13T06:41:16.266 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.266 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:16.266 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.266 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:16.266 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589958+0000", 2024-09-13T06:41:16.266 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:16.267 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.267 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.267 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:16.267 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589958+0000", 2024-09-13T06:41:16.267 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:16.267 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.267 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.267 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:16.267 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589957+0000", 2024-09-13T06:41:16.267 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:16.267 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.267 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.267 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:16.268 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589960+0000", 2024-09-13T06:41:16.268 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.4939999999999999e-06 2024-09-13T06:41:16.268 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.268 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.268 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:16.268 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589969+0000", 2024-09-13T06:41:16.268 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.3520000000000007e-06 2024-09-13T06:41:16.268 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.268 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.268 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:16.268 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589976+0000", 2024-09-13T06:41:16.268 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.3030000000000002e-06 2024-09-13T06:41:16.268 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.269 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.269 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:16.269 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.670765+0000", 2024-09-13T06:41:16.269 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.080789154000000002 2024-09-13T06:41:16.269 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.269 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.269 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:16.269 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.670960+0000", 2024-09-13T06:41:16.269 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00019464300000000001 2024-09-13T06:41:16.269 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.269 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.269 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:16.270 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.671360+0000", 2024-09-13T06:41:16.270 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00040005200000000002 2024-09-13T06:41:16.270 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:16.270 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:16.270 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:16.270 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.270 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.270 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43303 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 489472~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:16.270 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589985+0000", 2024-09-13T06:41:16.270 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 54.604446394999997, 2024-09-13T06:41:16.270 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.082024333000000005, 2024-09-13T06:41:16.270 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:16.270 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:16.270 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:16.271 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:16.271 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:16.271 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43303 2024-09-13T06:41:16.271 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.271 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:16.271 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.271 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:16.271 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589985+0000", 2024-09-13T06:41:16.271 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:16.271 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.271 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.271 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:16.272 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589985+0000", 2024-09-13T06:41:16.272 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:16.272 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.272 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.272 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:16.272 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589984+0000", 2024-09-13T06:41:16.272 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:16.272 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.272 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.272 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:16.272 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589987+0000", 2024-09-13T06:41:16.272 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.726e-06 2024-09-13T06:41:16.272 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.273 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.273 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:16.273 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589996+0000", 2024-09-13T06:41:16.273 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.5459999999999992e-06 2024-09-13T06:41:16.273 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.273 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.273 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:16.273 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590003+0000", 2024-09-13T06:41:16.273 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.4229999999999999e-06 2024-09-13T06:41:16.273 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.273 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.273 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:16.273 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.671426+0000", 2024-09-13T06:41:16.273 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.081422704999999998 2024-09-13T06:41:16.274 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.274 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.274 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:16.274 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.671615+0000", 2024-09-13T06:41:16.274 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000188875 2024-09-13T06:41:16.274 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.274 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.274 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:16.274 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.672009+0000", 2024-09-13T06:41:16.274 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000394015 2024-09-13T06:41:16.274 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:16.274 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:16.275 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:16.275 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.275 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.275 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43304 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 503808~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:16.275 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.590039+0000", 2024-09-13T06:41:16.275 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 54.604391849999999, 2024-09-13T06:41:16.275 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.082573880000000002, 2024-09-13T06:41:16.275 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:16.275 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:16.275 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:16.275 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:16.275 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:16.275 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43304 2024-09-13T06:41:16.276 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.276 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:16.276 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.276 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:16.276 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590039+0000", 2024-09-13T06:41:16.276 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:16.276 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.276 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.276 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:16.276 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590039+0000", 2024-09-13T06:41:16.276 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:16.276 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.277 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.277 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:16.277 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590038+0000", 2024-09-13T06:41:16.277 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:16.277 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.277 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.277 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:16.277 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590042+0000", 2024-09-13T06:41:16.277 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.9500000000000003e-06 2024-09-13T06:41:16.277 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.277 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.277 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:16.277 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590052+0000", 2024-09-13T06:41:16.277 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.3919999999999992e-06 2024-09-13T06:41:16.278 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.278 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.278 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:16.278 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590059+0000", 2024-09-13T06:41:16.278 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.7970000000000001e-06 2024-09-13T06:41:16.278 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.278 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.278 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:16.278 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.672078+0000", 2024-09-13T06:41:16.278 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.082018778000000001 2024-09-13T06:41:16.278 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.278 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.278 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:16.278 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.672266+0000", 2024-09-13T06:41:16.279 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00018807399999999999 2024-09-13T06:41:16.279 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.279 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.279 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:16.279 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.672613+0000", 2024-09-13T06:41:16.279 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00034677599999999997 2024-09-13T06:41:16.279 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:16.279 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:16.279 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:16.279 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.279 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.279 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43305 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 518144~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:16.279 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.590136+0000", 2024-09-13T06:41:16.279 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 54.604294662000001, 2024-09-13T06:41:16.280 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.082988206999999994, 2024-09-13T06:41:16.280 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:16.280 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:16.280 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:16.280 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:16.280 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:16.280 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43305 2024-09-13T06:41:16.280 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.280 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:16.280 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.280 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:16.280 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590136+0000", 2024-09-13T06:41:16.281 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:16.281 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.281 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.281 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:16.281 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590136+0000", 2024-09-13T06:41:16.281 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:16.281 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.281 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.281 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:16.281 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590135+0000", 2024-09-13T06:41:16.281 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:16.281 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.282 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.282 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:16.282 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590139+0000", 2024-09-13T06:41:16.282 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.9489999999999998e-06 2024-09-13T06:41:16.282 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.282 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.282 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:16.282 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590148+0000", 2024-09-13T06:41:16.282 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.9830000000000002e-06 2024-09-13T06:41:16.282 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.282 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.282 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:16.282 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590156+0000", 2024-09-13T06:41:16.283 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5229999999999998e-06 2024-09-13T06:41:16.283 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.283 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.283 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:16.283 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.672709+0000", 2024-09-13T06:41:16.283 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.082552886000000006 2024-09-13T06:41:16.283 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.283 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.283 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:16.283 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.672816+0000", 2024-09-13T06:41:16.283 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000107736 2024-09-13T06:41:16.283 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.283 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.284 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:16.284 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.673124+0000", 2024-09-13T06:41:16.284 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00030804900000000002 2024-09-13T06:41:16.284 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:16.284 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:16.284 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:16.284 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.284 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.284 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:66818 3.17 3.50afe697 (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e100)", 2024-09-13T06:41:16.284 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:53.498942+0000", 2024-09-13T06:41:16.284 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 22.695488477000001, 2024-09-13T06:41:16.284 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.011231284, 2024-09-13T06:41:16.284 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:16.285 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:41:16.285 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:16.285 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:16.285 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:16.285 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 66818 2024-09-13T06:41:16.285 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.285 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:16.285 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.285 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:16.285 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:53.498942+0000", 2024-09-13T06:41:16.285 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:16.285 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.285 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.286 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:16.286 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:53.498942+0000", 2024-09-13T06:41:16.286 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:16.286 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.286 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.286 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:16.286 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:53.498939+0000", 2024-09-13T06:41:16.286 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999967 2024-09-13T06:41:16.286 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.286 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.286 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:16.286 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:53.498954+0000", 2024-09-13T06:41:16.286 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5028000000000001e-05 2024-09-13T06:41:16.286 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.287 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.287 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:16.287 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:53.498986+0000", 2024-09-13T06:41:16.287 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.1993999999999999e-05 2024-09-13T06:41:16.287 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.287 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.287 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:16.287 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:53.499001+0000", 2024-09-13T06:41:16.287 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5166e-05 2024-09-13T06:41:16.287 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.287 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.287 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:16.287 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:53.505097+0000", 2024-09-13T06:41:16.287 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0060955610000000002 2024-09-13T06:41:16.288 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.288 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.288 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:41:16.288 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:53.505108+0000", 2024-09-13T06:41:16.288 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.084e-05 2024-09-13T06:41:16.288 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.288 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.288 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:16.288 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:54.510158+0000", 2024-09-13T06:41:16.288 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0050497549999999 2024-09-13T06:41:16.288 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.288 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.288 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:16.289 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:54.510174+0000", 2024-09-13T06:41:16.289 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6164e-05 2024-09-13T06:41:16.289 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:16.289 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:16.289 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:16.289 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.289 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.289 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:69764 3.2 3:47f10058:::rbd_data.11214956a993.0000000000000004:head [write-same] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e117)", 2024-09-13T06:41:16.289 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:41:11.371147+0000", 2024-09-13T06:41:16.289 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 4.8232841669999997, 2024-09-13T06:41:16.289 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.03470167, 2024-09-13T06:41:16.289 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:16.289 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:41:16.290 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:16.290 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:16.290 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:16.290 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 69764 2024-09-13T06:41:16.290 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.290 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:16.290 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.290 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:16.290 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:11.371147+0000", 2024-09-13T06:41:16.290 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:16.290 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.290 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.290 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:16.291 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:11.371147+0000", 2024-09-13T06:41:16.291 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:16.291 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.291 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.291 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:16.291 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:11.371144+0000", 2024-09-13T06:41:16.291 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999967 2024-09-13T06:41:16.291 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.291 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.291 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:16.291 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:11.371161+0000", 2024-09-13T06:41:16.291 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7669e-05 2024-09-13T06:41:16.291 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.291 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.292 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:16.292 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:11.371198+0000", 2024-09-13T06:41:16.292 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.7014000000000002e-05 2024-09-13T06:41:16.292 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.292 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.292 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:16.292 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:11.371216+0000", 2024-09-13T06:41:16.292 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7425e-05 2024-09-13T06:41:16.292 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.292 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.292 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:16.292 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:11.371365+0000", 2024-09-13T06:41:16.292 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000149245 2024-09-13T06:41:16.292 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.293 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.293 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op must wait for map", 2024-09-13T06:41:16.293 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:11.371385+0000", 2024-09-13T06:41:16.293 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.0018999999999999e-05 2024-09-13T06:41:16.293 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.293 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.293 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:16.293 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:11.378406+0000", 2024-09-13T06:41:16.293 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0070207179999999996 2024-09-13T06:41:16.293 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.293 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.293 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:41:16.293 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:11.378429+0000", 2024-09-13T06:41:16.294 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.3453999999999999e-05 2024-09-13T06:41:16.294 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.294 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.294 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:16.294 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:12.405667+0000", 2024-09-13T06:41:16.294 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0272381690000001 2024-09-13T06:41:16.294 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.294 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.294 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:16.294 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:12.405848+0000", 2024-09-13T06:41:16.294 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00018112 2024-09-13T06:41:16.294 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:16.294 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:16.295 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:16.295 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:16.295 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:16.295 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:41:16.296 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-13T06:41:16.297 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:41:16.295+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:41:16.397 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:41:16.395+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:41:16.424 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-13T06:41:16.461 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:41:16.462 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [], 2024-09-13T06:41:16.462 INFO:teuthology.orchestra.run.smithi139.stdout: "num_ops": 0 2024-09-13T06:41:16.462 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:41:16.477 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-13T06:41:16.498 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:41:16.498+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:41:16.600 INFO:tasks.ceph.osd.6.smithi139.stderr:2024-09-13T06:41:16.599+0000 7fcd02c5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26385) UID: 0 2024-09-13T06:41:16.637 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:41:16.637 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [], 2024-09-13T06:41:16.637 INFO:teuthology.orchestra.run.smithi139.stdout: "complaint_time": 30, 2024-09-13T06:41:16.637 INFO:teuthology.orchestra.run.smithi139.stdout: "num_blocked_ops": 0 2024-09-13T06:41:16.637 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:41:16.651 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-13T06:41:16.736 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:41:16.735+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:41:16.801 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:41:16.799+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:41:16.815 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:41:16.816 INFO:teuthology.orchestra.run.smithi139.stdout: "size": 20, 2024-09-13T06:41:16.816 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 600, 2024-09-13T06:41:16.816 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [ 2024-09-13T06:41:16.816 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.816 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27854 3.a 3:537b3559:::rbd_data.1121f2c5ee81.0000000000000016:13 [read 335872~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:16.816 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.658750+0000", 2024-09-13T06:41:16.816 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 80.156971460999998, 2024-09-13T06:41:16.816 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.037969532, 2024-09-13T06:41:16.816 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:16.816 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:16.816 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:16.817 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:16.817 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:16.817 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27854 2024-09-13T06:41:16.817 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.817 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:16.817 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.817 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:16.817 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658750+0000", 2024-09-13T06:41:16.817 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:16.817 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.817 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.817 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:16.817 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658750+0000", 2024-09-13T06:41:16.818 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:16.818 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.818 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.818 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:16.818 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658749+0000", 2024-09-13T06:41:16.818 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:16.818 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.818 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.818 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:16.818 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658757+0000", 2024-09-13T06:41:16.818 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.7389999999999999e-06 2024-09-13T06:41:16.818 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.818 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.818 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:16.819 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658763+0000", 2024-09-13T06:41:16.819 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.7769999999999999e-06 2024-09-13T06:41:16.819 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.819 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.819 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:16.819 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658767+0000", 2024-09-13T06:41:16.819 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.1749999999999998e-06 2024-09-13T06:41:16.819 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.819 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.819 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:16.819 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.696322+0000", 2024-09-13T06:41:16.819 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.037554772 2024-09-13T06:41:16.820 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.820 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.820 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:16.820 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.696418+0000", 2024-09-13T06:41:16.820 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6050000000000004e-05 2024-09-13T06:41:16.820 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.820 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.820 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:16.820 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.696719+0000", 2024-09-13T06:41:16.820 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00030138499999999999 2024-09-13T06:41:16.820 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:16.820 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:16.820 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:16.821 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.821 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.821 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27855 3.a 3:537b3559:::rbd_data.1121f2c5ee81.0000000000000016:13 [read 380928~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:16.821 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.658771+0000", 2024-09-13T06:41:16.821 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 80.156950217000002, 2024-09-13T06:41:16.821 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.038326354, 2024-09-13T06:41:16.821 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:16.821 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:16.821 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:16.821 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:16.821 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:16.821 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27855 2024-09-13T06:41:16.821 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.822 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:16.822 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.822 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:16.822 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658771+0000", 2024-09-13T06:41:16.822 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:16.822 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.822 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.822 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:16.822 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658771+0000", 2024-09-13T06:41:16.822 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:16.822 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.822 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.822 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:16.823 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658770+0000", 2024-09-13T06:41:16.823 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:16.823 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.823 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.823 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:16.823 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658772+0000", 2024-09-13T06:41:16.823 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.0930000000000001e-06 2024-09-13T06:41:16.823 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.823 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.823 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:16.823 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658778+0000", 2024-09-13T06:41:16.823 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.2730000000000002e-06 2024-09-13T06:41:16.823 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.823 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.824 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:16.824 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658782+0000", 2024-09-13T06:41:16.824 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0879999999999997e-06 2024-09-13T06:41:16.824 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.824 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.824 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:16.824 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.696770+0000", 2024-09-13T06:41:16.824 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.037988145000000001 2024-09-13T06:41:16.824 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.824 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.824 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:16.824 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.696852+0000", 2024-09-13T06:41:16.824 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.2039999999999994e-05 2024-09-13T06:41:16.824 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.825 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.825 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:16.825 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.697097+0000", 2024-09-13T06:41:16.825 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00024508800000000002 2024-09-13T06:41:16.825 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:16.825 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:16.825 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:16.825 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.825 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.825 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27856 3.a 3:537b3559:::rbd_data.1121f2c5ee81.0000000000000016:13 [read 405504~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:16.825 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.658786+0000", 2024-09-13T06:41:16.825 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 80.156935101000002, 2024-09-13T06:41:16.825 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.038736029999999998, 2024-09-13T06:41:16.826 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:16.826 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:16.826 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:16.826 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:16.826 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:16.826 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27856 2024-09-13T06:41:16.826 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.826 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:16.826 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.826 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:16.826 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658786+0000", 2024-09-13T06:41:16.826 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:16.826 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.826 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.827 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:16.827 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658786+0000", 2024-09-13T06:41:16.827 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:16.827 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.827 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.827 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:16.827 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658785+0000", 2024-09-13T06:41:16.827 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:16.827 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.827 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.827 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:16.827 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658787+0000", 2024-09-13T06:41:16.827 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.0040000000000002e-06 2024-09-13T06:41:16.827 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.827 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.828 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:16.828 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658793+0000", 2024-09-13T06:41:16.828 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.2410000000000003e-06 2024-09-13T06:41:16.828 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.828 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.828 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:16.828 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658797+0000", 2024-09-13T06:41:16.828 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.1330000000000001e-06 2024-09-13T06:41:16.828 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.828 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.828 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:16.828 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.697176+0000", 2024-09-13T06:41:16.828 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.038379074999999999 2024-09-13T06:41:16.829 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.829 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.829 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:16.829 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.697275+0000", 2024-09-13T06:41:16.829 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.8819000000000004e-05 2024-09-13T06:41:16.829 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.829 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.829 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:16.829 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.697522+0000", 2024-09-13T06:41:16.829 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00024719999999999999 2024-09-13T06:41:16.829 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:16.829 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:16.829 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:16.829 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.830 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.830 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27857 3.a 3:537b3559:::rbd_data.1121f2c5ee81.0000000000000016:13 [read 475136~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:16.830 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.658845+0000", 2024-09-13T06:41:16.830 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 80.156876097999998, 2024-09-13T06:41:16.830 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039112570999999999, 2024-09-13T06:41:16.830 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:16.830 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:16.830 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:16.830 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:16.830 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:16.830 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27857 2024-09-13T06:41:16.830 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.831 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:16.831 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.831 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:16.831 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658845+0000", 2024-09-13T06:41:16.831 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:16.831 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.831 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.831 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:16.831 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658845+0000", 2024-09-13T06:41:16.831 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:16.831 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.831 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.831 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:16.831 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658844+0000", 2024-09-13T06:41:16.832 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999986 2024-09-13T06:41:16.832 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.832 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.832 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:16.832 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658868+0000", 2024-09-13T06:41:16.832 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.4615000000000001e-05 2024-09-13T06:41:16.832 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.832 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.832 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:16.832 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658884+0000", 2024-09-13T06:41:16.832 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5401999999999999e-05 2024-09-13T06:41:16.832 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.832 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.832 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:16.833 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658896+0000", 2024-09-13T06:41:16.833 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2509e-05 2024-09-13T06:41:16.833 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.833 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.833 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:16.833 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.697571+0000", 2024-09-13T06:41:16.833 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.038675107 2024-09-13T06:41:16.833 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.833 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.833 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:16.833 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.697658+0000", 2024-09-13T06:41:16.833 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6349999999999998e-05 2024-09-13T06:41:16.833 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.833 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.834 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:16.834 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.697957+0000", 2024-09-13T06:41:16.834 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00029986100000000001 2024-09-13T06:41:16.834 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:16.834 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:16.834 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:16.834 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.834 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.834 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27858 3.a 3:537b3559:::rbd_data.1121f2c5ee81.0000000000000016:13 [read 499712~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:16.834 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.658905+0000", 2024-09-13T06:41:16.834 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 80.156815547999997, 2024-09-13T06:41:16.834 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039475392999999998, 2024-09-13T06:41:16.834 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:16.834 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:16.834 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:16.835 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:16.835 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:16.835 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27858 2024-09-13T06:41:16.835 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.835 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:16.835 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.835 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:16.835 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658905+0000", 2024-09-13T06:41:16.835 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:16.835 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.835 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.835 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:16.835 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658905+0000", 2024-09-13T06:41:16.835 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:16.836 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.836 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.836 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:16.836 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658905+0000", 2024-09-13T06:41:16.836 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:16.836 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.836 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.836 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:16.836 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658909+0000", 2024-09-13T06:41:16.836 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.831e-06 2024-09-13T06:41:16.836 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.836 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.836 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:16.837 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658920+0000", 2024-09-13T06:41:16.837 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0936e-05 2024-09-13T06:41:16.837 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.837 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.837 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:16.837 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658929+0000", 2024-09-13T06:41:16.837 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.2749999999999995e-06 2024-09-13T06:41:16.837 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.837 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.837 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:16.837 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.697990+0000", 2024-09-13T06:41:16.837 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039061625000000003 2024-09-13T06:41:16.837 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.837 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.838 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:16.838 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.698077+0000", 2024-09-13T06:41:16.838 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6922000000000006e-05 2024-09-13T06:41:16.838 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.838 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.838 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:16.838 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.698381+0000", 2024-09-13T06:41:16.838 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00030360599999999999 2024-09-13T06:41:16.838 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:16.838 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:16.838 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:16.838 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.838 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.838 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27929 3.a 3:537b3559:::rbd_data.1121f2c5ee81.0000000000000016:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:16.839 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.659338+0000", 2024-09-13T06:41:16.839 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 80.156382717, 2024-09-13T06:41:16.839 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039351214000000002, 2024-09-13T06:41:16.839 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:16.839 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:16.839 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:16.839 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:16.839 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:16.839 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27929 2024-09-13T06:41:16.839 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.839 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:16.839 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.839 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:16.839 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.659338+0000", 2024-09-13T06:41:16.840 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:16.840 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.840 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.840 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:16.840 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.659338+0000", 2024-09-13T06:41:16.840 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:16.840 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.840 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.840 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:16.840 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.659337+0000", 2024-09-13T06:41:16.840 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:16.840 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.840 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.841 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:16.841 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.659342+0000", 2024-09-13T06:41:16.841 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0799999999999999e-06 2024-09-13T06:41:16.841 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.841 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.841 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:16.841 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.659353+0000", 2024-09-13T06:41:16.841 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1798e-05 2024-09-13T06:41:16.841 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.841 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.841 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:16.841 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.659361+0000", 2024-09-13T06:41:16.841 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.8040000000000002e-06 2024-09-13T06:41:16.842 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.842 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.842 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:16.842 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.698449+0000", 2024-09-13T06:41:16.842 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039087519000000001 2024-09-13T06:41:16.842 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.842 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.842 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:16.842 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.698567+0000", 2024-09-13T06:41:16.842 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00011857 2024-09-13T06:41:16.842 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.842 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.842 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:16.842 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.698689+0000", 2024-09-13T06:41:16.843 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00012226699999999999 2024-09-13T06:41:16.843 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:16.843 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:16.843 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:16.843 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.843 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.843 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27974 3.a 3:537b3559:::rbd_data.1121f2c5ee81.0000000000000016:13 [read 32768~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:16.843 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.660102+0000", 2024-09-13T06:41:16.843 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 80.155618949000001, 2024-09-13T06:41:16.843 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.038972346999999997, 2024-09-13T06:41:16.843 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:16.843 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:16.843 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:16.843 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:16.843 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:16.844 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27974 2024-09-13T06:41:16.844 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.844 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:16.844 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.844 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:16.844 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660102+0000", 2024-09-13T06:41:16.844 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:16.844 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.844 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.844 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:16.844 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660102+0000", 2024-09-13T06:41:16.844 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:16.844 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.844 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.845 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:16.845 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660100+0000", 2024-09-13T06:41:16.845 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999976 2024-09-13T06:41:16.845 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.845 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.845 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:16.845 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660114+0000", 2024-09-13T06:41:16.845 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.4466e-05 2024-09-13T06:41:16.845 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.845 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.845 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:16.845 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660148+0000", 2024-09-13T06:41:16.845 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.3742999999999999e-05 2024-09-13T06:41:16.845 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.846 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.846 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:16.846 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660170+0000", 2024-09-13T06:41:16.846 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.2518e-05 2024-09-13T06:41:16.846 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.846 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.846 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:16.846 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.698719+0000", 2024-09-13T06:41:16.846 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.038548529999999998 2024-09-13T06:41:16.846 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.846 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.846 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:16.846 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.698806+0000", 2024-09-13T06:41:16.846 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.7179e-05 2024-09-13T06:41:16.846 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.847 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.847 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:16.847 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.699074+0000", 2024-09-13T06:41:16.847 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00026834800000000001 2024-09-13T06:41:16.847 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:16.847 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:16.847 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:16.847 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.847 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.848 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27975 3.a 3:537b3559:::rbd_data.1121f2c5ee81.0000000000000016:13 [read 57344~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:16.848 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.660189+0000", 2024-09-13T06:41:16.848 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 80.155532105000006, 2024-09-13T06:41:16.848 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039288678, 2024-09-13T06:41:16.848 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:16.848 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:16.848 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:16.848 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:16.848 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:16.848 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27975 2024-09-13T06:41:16.848 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.848 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:16.849 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.849 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:16.849 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660189+0000", 2024-09-13T06:41:16.849 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:16.849 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.849 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.849 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:16.849 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660189+0000", 2024-09-13T06:41:16.849 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:16.849 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.849 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.849 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:16.850 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660187+0000", 2024-09-13T06:41:16.850 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999981 2024-09-13T06:41:16.850 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.850 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.850 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:16.850 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660195+0000", 2024-09-13T06:41:16.850 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5610000000000001e-06 2024-09-13T06:41:16.850 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.850 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.850 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:16.850 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660212+0000", 2024-09-13T06:41:16.850 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7725999999999999e-05 2024-09-13T06:41:16.850 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.851 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.851 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:16.851 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660227+0000", 2024-09-13T06:41:16.851 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.43e-05 2024-09-13T06:41:16.851 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.851 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.851 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:16.851 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.699135+0000", 2024-09-13T06:41:16.851 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.038908336000000002 2024-09-13T06:41:16.851 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.851 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.851 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:16.851 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.699208+0000", 2024-09-13T06:41:16.851 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.3065000000000006e-05 2024-09-13T06:41:16.851 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.852 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.852 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:16.852 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.699478+0000", 2024-09-13T06:41:16.852 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00026946899999999999 2024-09-13T06:41:16.852 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:16.852 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:16.852 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:16.852 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.852 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.852 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27976 3.a 3:537b3559:::rbd_data.1121f2c5ee81.0000000000000016:13 [read 102400~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:16.852 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.660238+0000", 2024-09-13T06:41:16.852 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 80.155482942000006, 2024-09-13T06:41:16.852 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039636515999999997, 2024-09-13T06:41:16.853 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:16.853 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:16.853 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:16.853 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:16.853 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:16.853 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27976 2024-09-13T06:41:16.853 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.853 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:16.853 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.853 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:16.853 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660238+0000", 2024-09-13T06:41:16.853 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:16.853 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.854 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.854 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:16.854 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660238+0000", 2024-09-13T06:41:16.854 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:16.854 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.854 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.854 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:16.854 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660237+0000", 2024-09-13T06:41:16.854 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:16.854 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.854 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.854 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:16.854 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660243+0000", 2024-09-13T06:41:16.854 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.9909999999999999e-06 2024-09-13T06:41:16.854 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.855 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.855 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:16.855 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660259+0000", 2024-09-13T06:41:16.855 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6294e-05 2024-09-13T06:41:16.855 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.855 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.855 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:16.855 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660272+0000", 2024-09-13T06:41:16.855 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2714999999999999e-05 2024-09-13T06:41:16.855 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.855 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.855 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:16.855 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.699513+0000", 2024-09-13T06:41:16.855 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039240932999999999 2024-09-13T06:41:16.856 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.856 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.856 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:16.856 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.699604+0000", 2024-09-13T06:41:16.856 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.1367999999999997e-05 2024-09-13T06:41:16.856 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.856 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.856 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:16.856 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.699875+0000", 2024-09-13T06:41:16.856 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00027029499999999999 2024-09-13T06:41:16.856 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:16.856 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:16.856 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:16.857 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.857 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.857 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27977 3.a 3:537b3559:::rbd_data.1121f2c5ee81.0000000000000016:13 [read 126976~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:16.857 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.660284+0000", 2024-09-13T06:41:16.857 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 80.155437370000001, 2024-09-13T06:41:16.857 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039969945, 2024-09-13T06:41:16.857 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:16.857 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:16.857 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:16.857 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:16.857 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:16.857 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27977 2024-09-13T06:41:16.857 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.857 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:16.858 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.858 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:16.858 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660284+0000", 2024-09-13T06:41:16.858 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:16.858 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.858 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.858 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:16.858 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660284+0000", 2024-09-13T06:41:16.858 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:16.858 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.858 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.858 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:16.859 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660282+0000", 2024-09-13T06:41:16.859 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999986 2024-09-13T06:41:16.859 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.859 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.859 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:16.859 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660288+0000", 2024-09-13T06:41:16.859 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.2650000000000002e-06 2024-09-13T06:41:16.859 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.859 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.859 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:16.859 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660304+0000", 2024-09-13T06:41:16.860 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5430999999999998e-05 2024-09-13T06:41:16.860 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.860 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.860 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:16.860 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660316+0000", 2024-09-13T06:41:16.860 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.237e-05 2024-09-13T06:41:16.860 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.860 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.860 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:16.860 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.699907+0000", 2024-09-13T06:41:16.860 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039590735000000002 2024-09-13T06:41:16.860 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.861 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.861 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:16.861 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.699994+0000", 2024-09-13T06:41:16.861 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6996999999999994e-05 2024-09-13T06:41:16.861 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.861 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.861 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:16.861 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700254+0000", 2024-09-13T06:41:16.861 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000259564 2024-09-13T06:41:16.861 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:16.861 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:16.861 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:16.862 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.862 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.862 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27978 3.a 3.9aacdeca (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:16.862 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.660327+0000", 2024-09-13T06:41:16.862 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 80.155393771999996, 2024-09-13T06:41:16.862 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039984858999999998, 2024-09-13T06:41:16.862 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:16.862 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:41:16.862 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:16.862 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:16.862 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:16.862 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27978 2024-09-13T06:41:16.862 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.862 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:16.862 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.863 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:16.863 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660327+0000", 2024-09-13T06:41:16.863 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:16.863 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.863 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.863 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:16.863 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660327+0000", 2024-09-13T06:41:16.863 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:16.863 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.863 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.863 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:16.863 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660326+0000", 2024-09-13T06:41:16.863 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:16.863 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.864 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.864 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:16.864 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660366+0000", 2024-09-13T06:41:16.864 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.9691000000000003e-05 2024-09-13T06:41:16.864 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.864 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.864 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:16.864 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660399+0000", 2024-09-13T06:41:16.864 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.3262000000000001e-05 2024-09-13T06:41:16.864 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.864 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.864 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:16.864 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660414+0000", 2024-09-13T06:41:16.865 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.4775e-05 2024-09-13T06:41:16.865 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.865 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.865 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:16.865 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700298+0000", 2024-09-13T06:41:16.865 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039883759999999997 2024-09-13T06:41:16.865 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.865 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.865 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:16.865 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700312+0000", 2024-09-13T06:41:16.865 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.4374e-05 2024-09-13T06:41:16.865 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:16.865 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:16.866 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:16.866 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.866 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.866 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27979 3.a 3.9aacdeca (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:16.866 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.660429+0000", 2024-09-13T06:41:16.866 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 80.155291903999995, 2024-09-13T06:41:16.866 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039921361000000002, 2024-09-13T06:41:16.866 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:16.866 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:41:16.866 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:16.866 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:16.866 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:16.866 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27979 2024-09-13T06:41:16.867 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.867 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:16.867 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.867 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:16.867 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660429+0000", 2024-09-13T06:41:16.867 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:16.867 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.867 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.867 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:16.867 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660429+0000", 2024-09-13T06:41:16.867 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:16.867 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.867 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.867 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:16.867 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660428+0000", 2024-09-13T06:41:16.868 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999986 2024-09-13T06:41:16.868 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.868 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.868 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:16.868 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660434+0000", 2024-09-13T06:41:16.868 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.8190000000000003e-06 2024-09-13T06:41:16.868 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.868 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.868 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:16.868 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660451+0000", 2024-09-13T06:41:16.868 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6963e-05 2024-09-13T06:41:16.868 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.868 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.869 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:16.869 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660485+0000", 2024-09-13T06:41:16.869 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.3414000000000002e-05 2024-09-13T06:41:16.869 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.869 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.869 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:16.869 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700342+0000", 2024-09-13T06:41:16.869 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039857278000000003 2024-09-13T06:41:16.869 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.869 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.869 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:16.869 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700350+0000", 2024-09-13T06:41:16.869 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.2930000000000001e-06 2024-09-13T06:41:16.870 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:16.870 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:16.870 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:16.870 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.870 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.870 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27980 3.a 3.9aacdeca (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:16.870 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.660497+0000", 2024-09-13T06:41:16.870 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 80.155223692999996, 2024-09-13T06:41:16.870 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039888034000000003, 2024-09-13T06:41:16.870 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:16.870 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:41:16.870 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:16.870 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:16.870 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:16.870 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27980 2024-09-13T06:41:16.871 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.871 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:16.871 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.871 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:16.871 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660497+0000", 2024-09-13T06:41:16.871 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:16.871 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.871 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.871 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:16.871 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660497+0000", 2024-09-13T06:41:16.871 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:16.871 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.871 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.871 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:16.872 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660496+0000", 2024-09-13T06:41:16.872 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:16.872 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.872 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.872 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:16.872 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660503+0000", 2024-09-13T06:41:16.872 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.4110000000000001e-06 2024-09-13T06:41:16.872 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.872 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.872 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:16.872 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660519+0000", 2024-09-13T06:41:16.872 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6180000000000001e-05 2024-09-13T06:41:16.872 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.872 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.873 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:16.873 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660544+0000", 2024-09-13T06:41:16.873 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.5177999999999998e-05 2024-09-13T06:41:16.873 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.873 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.873 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:16.873 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700377+0000", 2024-09-13T06:41:16.873 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039833434000000001 2024-09-13T06:41:16.873 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.873 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.873 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:16.873 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700385+0000", 2024-09-13T06:41:16.874 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.8800000000000008e-06 2024-09-13T06:41:16.874 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:16.874 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:16.874 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:16.874 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.874 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.874 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27981 3.a 3.9aacdeca (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:16.874 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.660556+0000", 2024-09-13T06:41:16.874 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 80.155165346999993, 2024-09-13T06:41:16.874 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039869989000000002, 2024-09-13T06:41:16.874 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:16.874 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:41:16.874 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:16.874 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:16.874 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:16.875 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27981 2024-09-13T06:41:16.875 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.875 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:16.875 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.875 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:16.875 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660556+0000", 2024-09-13T06:41:16.875 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:16.875 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.875 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.875 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:16.875 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660556+0000", 2024-09-13T06:41:16.875 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:16.875 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.875 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.875 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:16.876 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660555+0000", 2024-09-13T06:41:16.876 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:16.876 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.876 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.876 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:16.876 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660561+0000", 2024-09-13T06:41:16.876 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.088e-06 2024-09-13T06:41:16.876 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.876 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.876 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:16.876 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660577+0000", 2024-09-13T06:41:16.876 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6147999999999999e-05 2024-09-13T06:41:16.876 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.877 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.877 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:16.877 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660589+0000", 2024-09-13T06:41:16.877 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2551999999999999e-05 2024-09-13T06:41:16.877 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.877 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.877 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:16.877 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700414+0000", 2024-09-13T06:41:16.877 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039825007000000003 2024-09-13T06:41:16.877 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.877 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.877 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:16.878 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700426+0000", 2024-09-13T06:41:16.878 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1265e-05 2024-09-13T06:41:16.878 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:16.878 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:16.878 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:16.878 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.878 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.878 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27982 3.a 3.9aacdeca (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:16.878 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.660603+0000", 2024-09-13T06:41:16.878 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 80.155117751999995, 2024-09-13T06:41:16.878 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039874779999999999, 2024-09-13T06:41:16.878 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:16.879 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:41:16.879 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:16.879 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:16.879 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:16.879 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27982 2024-09-13T06:41:16.879 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.879 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:16.879 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.879 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:16.879 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660603+0000", 2024-09-13T06:41:16.879 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:16.879 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.879 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.879 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:16.879 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660603+0000", 2024-09-13T06:41:16.880 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:16.880 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.880 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.880 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:16.880 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660602+0000", 2024-09-13T06:41:16.880 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:16.880 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.880 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.880 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:16.880 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660653+0000", 2024-09-13T06:41:16.880 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.0862000000000002e-05 2024-09-13T06:41:16.880 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.880 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.881 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:16.881 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660697+0000", 2024-09-13T06:41:16.881 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.3773000000000003e-05 2024-09-13T06:41:16.881 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.881 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.881 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:16.881 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660712+0000", 2024-09-13T06:41:16.881 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5464999999999998e-05 2024-09-13T06:41:16.881 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.881 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.881 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:16.881 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700469+0000", 2024-09-13T06:41:16.881 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039756503999999998 2024-09-13T06:41:16.882 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.882 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.882 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:16.882 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700478+0000", 2024-09-13T06:41:16.882 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.1730000000000001e-06 2024-09-13T06:41:16.882 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:16.882 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:16.882 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:16.882 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.882 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.882 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27983 3.a 3.9aacdeca (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:16.882 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.660726+0000", 2024-09-13T06:41:16.882 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 80.154994477000002, 2024-09-13T06:41:16.882 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039804357999999998, 2024-09-13T06:41:16.882 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:16.883 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:41:16.883 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:16.883 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:16.883 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:16.883 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27983 2024-09-13T06:41:16.883 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.883 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:16.883 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.883 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:16.883 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660726+0000", 2024-09-13T06:41:16.883 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:16.883 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.883 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.884 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:16.884 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660726+0000", 2024-09-13T06:41:16.884 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:16.884 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.884 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.884 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:16.884 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660725+0000", 2024-09-13T06:41:16.884 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999986 2024-09-13T06:41:16.884 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.884 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.884 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:16.884 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660733+0000", 2024-09-13T06:41:16.884 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.9359999999999999e-06 2024-09-13T06:41:16.885 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.885 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.885 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:16.885 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660751+0000", 2024-09-13T06:41:16.885 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7679000000000001e-05 2024-09-13T06:41:16.885 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.885 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.885 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:16.885 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660764+0000", 2024-09-13T06:41:16.885 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3112000000000001e-05 2024-09-13T06:41:16.885 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.885 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.885 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:16.886 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700516+0000", 2024-09-13T06:41:16.886 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039752183000000003 2024-09-13T06:41:16.886 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.886 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.886 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:16.886 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700531+0000", 2024-09-13T06:41:16.886 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.4732999999999999e-05 2024-09-13T06:41:16.886 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:16.886 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:16.886 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:16.886 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.886 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.887 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27984 3.a 3.9aacdeca (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:16.887 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.660776+0000", 2024-09-13T06:41:16.887 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 80.154945373999993, 2024-09-13T06:41:16.887 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039795697999999997, 2024-09-13T06:41:16.887 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:16.887 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:41:16.887 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:16.887 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:16.887 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:16.887 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27984 2024-09-13T06:41:16.887 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.887 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:16.887 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.888 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:16.888 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660776+0000", 2024-09-13T06:41:16.888 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:16.888 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.888 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.888 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:16.888 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660776+0000", 2024-09-13T06:41:16.888 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:16.888 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.888 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.888 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:16.888 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660775+0000", 2024-09-13T06:41:16.888 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:16.889 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.889 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.889 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:16.889 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660780+0000", 2024-09-13T06:41:16.889 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.7849999999999997e-06 2024-09-13T06:41:16.889 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.889 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.889 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:16.889 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660799+0000", 2024-09-13T06:41:16.889 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.8794e-05 2024-09-13T06:41:16.890 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.890 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.890 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:16.890 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660812+0000", 2024-09-13T06:41:16.890 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3029e-05 2024-09-13T06:41:16.890 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.890 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.890 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:16.890 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700562+0000", 2024-09-13T06:41:16.890 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039749984000000002 2024-09-13T06:41:16.890 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.890 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.890 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:16.890 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700571+0000", 2024-09-13T06:41:16.890 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.1260000000000004e-06 2024-09-13T06:41:16.891 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:16.891 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:16.891 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:16.891 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.891 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.891 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27985 3.a 3.9aacdeca (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:16.891 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.660824+0000", 2024-09-13T06:41:16.891 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 80.154897321999997, 2024-09-13T06:41:16.891 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039784462, 2024-09-13T06:41:16.891 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:16.891 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:41:16.891 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:16.891 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:16.892 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:16.892 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27985 2024-09-13T06:41:16.892 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.892 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:16.892 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.892 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:16.892 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660824+0000", 2024-09-13T06:41:16.892 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:16.892 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.892 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.893 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:16.893 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660824+0000", 2024-09-13T06:41:16.893 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:16.893 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.893 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.893 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:16.893 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660823+0000", 2024-09-13T06:41:16.893 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:16.893 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.893 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.893 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:16.893 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660829+0000", 2024-09-13T06:41:16.893 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.9440000000000002e-06 2024-09-13T06:41:16.894 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.894 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.894 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:16.894 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660922+0000", 2024-09-13T06:41:16.894 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.2958e-05 2024-09-13T06:41:16.894 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.894 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.894 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:16.894 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660964+0000", 2024-09-13T06:41:16.894 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.2407000000000002e-05 2024-09-13T06:41:16.894 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.894 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.894 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:16.895 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700600+0000", 2024-09-13T06:41:16.895 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039635581000000003 2024-09-13T06:41:16.895 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.895 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.895 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:16.895 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700608+0000", 2024-09-13T06:41:16.895 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.5890000000000003e-06 2024-09-13T06:41:16.895 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:16.895 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:16.895 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:16.895 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.895 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.895 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:28023 3.10 3:0dedc28a:::rbd_data.1121f2c5ee81.0000000000000019:13 [read 475136~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:16.895 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.662072+0000", 2024-09-13T06:41:16.896 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 80.153649337000004, 2024-09-13T06:41:16.896 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.038086508999999998, 2024-09-13T06:41:16.896 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:16.896 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:16.896 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:16.896 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:16.896 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:16.896 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 28023 2024-09-13T06:41:16.896 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.896 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:16.896 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.896 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:16.896 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.662072+0000", 2024-09-13T06:41:16.896 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:16.897 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.897 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.897 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:16.897 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.662072+0000", 2024-09-13T06:41:16.897 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:16.897 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.897 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.897 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:16.897 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.662070+0000", 2024-09-13T06:41:16.897 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999986 2024-09-13T06:41:16.897 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.897 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.897 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:16.898 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.662076+0000", 2024-09-13T06:41:16.898 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.139e-06 2024-09-13T06:41:16.898 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.898 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.898 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:16.898 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.662094+0000", 2024-09-13T06:41:16.898 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7136999999999999e-05 2024-09-13T06:41:16.898 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.898 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.898 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:16.898 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.662124+0000", 2024-09-13T06:41:16.898 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.0528999999999999e-05 2024-09-13T06:41:16.899 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.899 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.899 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:16.899 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.699843+0000", 2024-09-13T06:41:16.899 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.037718415999999998 2024-09-13T06:41:16.899 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.899 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.899 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:16.899 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.699931+0000", 2024-09-13T06:41:16.899 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.8345999999999997e-05 2024-09-13T06:41:16.899 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.899 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.899 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:16.899 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700158+0000", 2024-09-13T06:41:16.899 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00022723099999999999 2024-09-13T06:41:16.900 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:16.900 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:16.900 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:16.900 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.900 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.900 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:28024 3.10 3.5143b7b0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:16.900 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.662137+0000", 2024-09-13T06:41:16.900 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 80.153583815000005, 2024-09-13T06:41:16.900 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.038056092999999999, 2024-09-13T06:41:16.900 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:16.900 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:41:16.900 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:16.900 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:16.901 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:16.901 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 28024 2024-09-13T06:41:16.901 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.901 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:16.901 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.901 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:16.901 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.662137+0000", 2024-09-13T06:41:16.901 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:16.901 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.901 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.901 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:16.901 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.662137+0000", 2024-09-13T06:41:16.901 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:16.901 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.902 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.902 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:16.902 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.662136+0000", 2024-09-13T06:41:16.902 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999986 2024-09-13T06:41:16.902 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.902 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.902 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:16.902 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.662142+0000", 2024-09-13T06:41:16.902 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.6930000000000001e-06 2024-09-13T06:41:16.902 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.902 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.902 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:16.902 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.662160+0000", 2024-09-13T06:41:16.902 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7863000000000002e-05 2024-09-13T06:41:16.903 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.903 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.903 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:16.903 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.662189+0000", 2024-09-13T06:41:16.903 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.8486000000000001e-05 2024-09-13T06:41:16.903 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.903 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.903 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:16.903 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700187+0000", 2024-09-13T06:41:16.903 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.037998331000000003 2024-09-13T06:41:16.903 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:16.903 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:16.903 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:16.903 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700193+0000", 2024-09-13T06:41:16.904 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.0909999999999998e-06 2024-09-13T06:41:16.904 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:16.904 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:16.904 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:16.904 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:16.904 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:16.904 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:41:16.905 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-13T06:41:16.906 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:41:16.906+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:41:17.007 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:41:17.006+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:41:17.035 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:41:17.035 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-13T06:41:17.035 INFO:teuthology.orchestra.run.smithi081.stdout: "num_ops": 0 2024-09-13T06:41:17.035 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:41:17.049 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-13T06:41:17.108 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:41:17.107+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:41:17.152 INFO:teuthology.orchestra.run.smithi139.stdout:3.f 2024-09-13T06:41:17.152 INFO:teuthology.orchestra.run.smithi139.stdout:3.e 2024-09-13T06:41:17.152 INFO:teuthology.orchestra.run.smithi139.stdout:3.d 2024-09-13T06:41:17.153 INFO:teuthology.orchestra.run.smithi139.stdout:3.7 2024-09-13T06:41:17.153 INFO:teuthology.orchestra.run.smithi139.stdout:3.16 2024-09-13T06:41:17.153 INFO:teuthology.orchestra.run.smithi139.stdout:3.13 2024-09-13T06:41:17.153 INFO:teuthology.orchestra.run.smithi139.stdout:3.9 2024-09-13T06:41:17.153 INFO:teuthology.orchestra.run.smithi139.stdout:3.12 2024-09-13T06:41:17.153 INFO:teuthology.orchestra.run.smithi139.stdout:3.11 2024-09-13T06:41:17.153 INFO:teuthology.orchestra.run.smithi139.stdout:3.15 2024-09-13T06:41:17.153 INFO:teuthology.orchestra.run.smithi139.stdout:2.7 2024-09-13T06:41:17.153 INFO:teuthology.orchestra.run.smithi139.stdout:2.5 2024-09-13T06:41:17.153 INFO:teuthology.orchestra.run.smithi139.stdout:3.14 2024-09-13T06:41:17.153 INFO:teuthology.orchestra.run.smithi139.stdout:2.0 2024-09-13T06:41:17.153 INFO:teuthology.orchestra.run.smithi139.stdout:1.0 2024-09-13T06:41:17.208 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:41:17.207+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:41:17.216 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:41:17.216 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-13T06:41:17.216 INFO:teuthology.orchestra.run.smithi081.stdout: "complaint_time": 30, 2024-09-13T06:41:17.216 INFO:teuthology.orchestra.run.smithi081.stdout: "num_blocked_ops": 0 2024-09-13T06:41:17.216 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:41:17.230 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-13T06:41:17.309 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:41:17.306+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:41:17.356 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:41:17.356 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 20, 2024-09-13T06:41:17.356 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 600, 2024-09-13T06:41:17.356 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [ 2024-09-13T06:41:17.356 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.356 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:37801 3.1 3:82e31015:::rbd_object_map.1121d8143c6e.0000000000000019:head [call] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e55)", 2024-09-13T06:41:17.356 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:05.646191+0000", 2024-09-13T06:41:17.356 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 71.709024557999996, 2024-09-13T06:41:17.357 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.72659507800000001, 2024-09-13T06:41:17.357 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:17.357 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:17.357 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:17.357 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:17.357 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:17.357 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 37801 2024-09-13T06:41:17.357 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.357 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:17.357 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.357 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:17.357 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:05.646191+0000", 2024-09-13T06:41:17.357 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:17.358 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.358 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.358 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:17.358 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:05.646191+0000", 2024-09-13T06:41:17.358 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:17.358 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.358 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.358 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:17.358 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:05.646188+0000", 2024-09-13T06:41:17.358 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999971 2024-09-13T06:41:17.358 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.358 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.358 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:17.359 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:05.646206+0000", 2024-09-13T06:41:17.359 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8182999999999999e-05 2024-09-13T06:41:17.359 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.359 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.359 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:17.359 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:05.646237+0000", 2024-09-13T06:41:17.359 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.1071000000000001e-05 2024-09-13T06:41:17.359 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.359 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.359 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:17.359 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:05.646251+0000", 2024-09-13T06:41:17.359 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3679000000000001e-05 2024-09-13T06:41:17.359 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.359 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.360 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:17.360 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:05.646321+0000", 2024-09-13T06:41:17.360 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.9831000000000003e-05 2024-09-13T06:41:17.360 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.360 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.360 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:41:17.360 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:05.646331+0000", 2024-09-13T06:41:17.360 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0242e-05 2024-09-13T06:41:17.360 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.360 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.360 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:17.360 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.371959+0000", 2024-09-13T06:41:17.361 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.72562817199999996 2024-09-13T06:41:17.361 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.361 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.361 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:17.361 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.372389+0000", 2024-09-13T06:41:17.361 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00042977400000000001 2024-09-13T06:41:17.361 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.361 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.361 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:17.361 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.372786+0000", 2024-09-13T06:41:17.361 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00039706099999999999 2024-09-13T06:41:17.361 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:17.361 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:17.362 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:17.362 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.362 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.362 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43009 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 489472~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:17.362 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.644660+0000", 2024-09-13T06:41:17.362 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 55.710555595999999, 2024-09-13T06:41:17.362 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123376071, 2024-09-13T06:41:17.362 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:17.362 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:17.362 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:17.362 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:17.362 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:17.362 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43009 2024-09-13T06:41:17.362 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.363 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:17.363 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.363 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:17.363 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.644660+0000", 2024-09-13T06:41:17.363 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:17.363 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.363 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.363 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:17.363 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.644660+0000", 2024-09-13T06:41:17.363 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:17.363 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.363 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.363 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:17.363 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.644659+0000", 2024-09-13T06:41:17.364 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:17.364 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.364 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.364 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:17.364 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.644662+0000", 2024-09-13T06:41:17.364 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4949999999999998e-06 2024-09-13T06:41:17.364 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.364 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.364 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:17.364 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.644669+0000", 2024-09-13T06:41:17.364 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.289e-06 2024-09-13T06:41:17.364 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.364 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.365 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:17.365 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.644674+0000", 2024-09-13T06:41:17.365 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.8840000000000002e-06 2024-09-13T06:41:17.365 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.365 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.365 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:17.365 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.767602+0000", 2024-09-13T06:41:17.365 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.122928158 2024-09-13T06:41:17.365 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.365 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.365 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:17.365 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.767676+0000", 2024-09-13T06:41:17.365 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3992999999999994e-05 2024-09-13T06:41:17.366 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.366 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.366 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:17.366 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.768036+0000", 2024-09-13T06:41:17.366 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00035966200000000001 2024-09-13T06:41:17.366 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:17.366 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:17.366 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:17.366 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.366 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.366 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43010 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 503808~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:17.366 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.644678+0000", 2024-09-13T06:41:17.366 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 55.710537270000003, 2024-09-13T06:41:17.366 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123728798, 2024-09-13T06:41:17.367 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:17.367 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:17.367 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:17.367 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:17.367 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:17.367 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43010 2024-09-13T06:41:17.367 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.367 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:17.367 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.367 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:17.367 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.644678+0000", 2024-09-13T06:41:17.367 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:17.367 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.368 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.368 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:17.368 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.644678+0000", 2024-09-13T06:41:17.368 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:17.368 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.368 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.368 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:17.368 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.644678+0000", 2024-09-13T06:41:17.368 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:17.368 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.368 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.368 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:17.368 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.644680+0000", 2024-09-13T06:41:17.369 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2050000000000001e-06 2024-09-13T06:41:17.369 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.369 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.369 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:17.369 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.644686+0000", 2024-09-13T06:41:17.369 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8440000000000003e-06 2024-09-13T06:41:17.369 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.369 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.369 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:17.369 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.644691+0000", 2024-09-13T06:41:17.369 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.118e-06 2024-09-13T06:41:17.369 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.369 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.369 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:17.370 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.768065+0000", 2024-09-13T06:41:17.370 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123374698 2024-09-13T06:41:17.370 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.370 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.370 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:17.370 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.768139+0000", 2024-09-13T06:41:17.370 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3934000000000001e-05 2024-09-13T06:41:17.370 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.370 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.370 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:17.370 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.768407+0000", 2024-09-13T06:41:17.370 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00026738800000000002 2024-09-13T06:41:17.370 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:17.371 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:17.371 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:17.371 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.371 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.371 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43181 3.17 3:ec5ebce4:::rbd_data.1121f5f2e1c0.0000000000000001:1f [read 319488~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:17.371 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.652968+0000", 2024-09-13T06:41:17.372 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 55.702246754000001, 2024-09-13T06:41:17.372 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.12363807, 2024-09-13T06:41:17.372 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:17.372 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:17.372 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:17.372 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:17.372 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:17.372 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43181 2024-09-13T06:41:17.372 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.373 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:17.373 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.373 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:17.373 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.652968+0000", 2024-09-13T06:41:17.373 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:17.373 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.373 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.373 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:17.373 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.652968+0000", 2024-09-13T06:41:17.373 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:17.373 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.373 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.373 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:17.374 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.652968+0000", 2024-09-13T06:41:17.374 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:17.374 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.374 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.374 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:17.374 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.652970+0000", 2024-09-13T06:41:17.374 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2409999999999998e-06 2024-09-13T06:41:17.374 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.374 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.374 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:17.374 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.652976+0000", 2024-09-13T06:41:17.374 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0079999999999999e-06 2024-09-13T06:41:17.374 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.374 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.375 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:17.375 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.652981+0000", 2024-09-13T06:41:17.375 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4390000000000002e-06 2024-09-13T06:41:17.375 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.375 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.375 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:17.375 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.776275+0000", 2024-09-13T06:41:17.375 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.12329396099999999 2024-09-13T06:41:17.375 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.375 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.375 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:17.375 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.776316+0000", 2024-09-13T06:41:17.375 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.1244e-05 2024-09-13T06:41:17.375 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.376 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.376 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:17.376 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.776607+0000", 2024-09-13T06:41:17.376 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00029051199999999999 2024-09-13T06:41:17.376 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:17.376 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:17.376 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:17.376 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.376 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.376 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43182 3.17 3:ec5ebce4:::rbd_data.1121f5f2e1c0.0000000000000001:1f [read 333824~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:17.376 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.652985+0000", 2024-09-13T06:41:17.376 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 55.702229944999999, 2024-09-13T06:41:17.376 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123926616, 2024-09-13T06:41:17.377 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:17.377 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:17.377 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:17.377 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:17.377 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:17.377 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43182 2024-09-13T06:41:17.377 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.377 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:17.377 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.377 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:17.377 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.652985+0000", 2024-09-13T06:41:17.377 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:17.377 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.377 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.378 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:17.378 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.652985+0000", 2024-09-13T06:41:17.378 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:17.378 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.378 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.378 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:17.378 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.652985+0000", 2024-09-13T06:41:17.378 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:17.378 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.378 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.378 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:17.378 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.652987+0000", 2024-09-13T06:41:17.378 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0899999999999999e-06 2024-09-13T06:41:17.379 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.379 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.379 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:17.379 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.652994+0000", 2024-09-13T06:41:17.379 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3100000000000003e-06 2024-09-13T06:41:17.379 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.379 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.379 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:17.379 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.653000+0000", 2024-09-13T06:41:17.379 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2020000000000003e-06 2024-09-13T06:41:17.379 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.379 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.379 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:17.379 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.776635+0000", 2024-09-13T06:41:17.380 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.12363529400000001 2024-09-13T06:41:17.380 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.380 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.380 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:17.380 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.776676+0000", 2024-09-13T06:41:17.380 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.0745999999999999e-05 2024-09-13T06:41:17.380 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.380 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.380 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:17.380 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.776912+0000", 2024-09-13T06:41:17.380 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00023631300000000001 2024-09-13T06:41:17.380 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:17.380 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:17.381 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:17.381 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.381 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.381 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43192 3.17 3:ec5ebce4:::rbd_data.1121f5f2e1c0.0000000000000001:1f [read 466944~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:17.381 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.656622+0000", 2024-09-13T06:41:17.381 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 55.698592888999997, 2024-09-13T06:41:17.381 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123503136, 2024-09-13T06:41:17.381 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:17.381 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:17.381 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:17.381 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:17.381 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:17.381 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43192 2024-09-13T06:41:17.382 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.382 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:17.382 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.382 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:17.382 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656622+0000", 2024-09-13T06:41:17.382 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:17.382 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.382 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.382 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:17.382 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656622+0000", 2024-09-13T06:41:17.382 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:17.382 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.382 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.382 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:17.383 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656622+0000", 2024-09-13T06:41:17.383 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:41:17.383 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.383 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.383 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:17.383 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656623+0000", 2024-09-13T06:41:17.383 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2079999999999999e-06 2024-09-13T06:41:17.383 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.383 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.383 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:17.383 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656627+0000", 2024-09-13T06:41:17.383 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.4819999999999999e-06 2024-09-13T06:41:17.383 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.384 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.384 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:17.384 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656629+0000", 2024-09-13T06:41:17.384 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.582e-06 2024-09-13T06:41:17.384 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.384 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.384 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:17.384 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.779866+0000", 2024-09-13T06:41:17.384 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.12323638100000001 2024-09-13T06:41:17.384 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.384 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.384 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:17.384 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.779905+0000", 2024-09-13T06:41:17.385 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.9529e-05 2024-09-13T06:41:17.385 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.385 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.385 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:17.385 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.780125+0000", 2024-09-13T06:41:17.385 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000220168 2024-09-13T06:41:17.385 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:17.385 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:17.385 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:17.385 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.385 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.385 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43193 3.17 3:ec5ebce4:::rbd_data.1121f5f2e1c0.0000000000000001:1f [read 481280~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:17.385 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.656635+0000", 2024-09-13T06:41:17.386 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 55.698580405000001, 2024-09-13T06:41:17.386 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.12374478999999999, 2024-09-13T06:41:17.386 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:17.386 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:17.386 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:17.386 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:17.386 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:17.386 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43193 2024-09-13T06:41:17.386 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.386 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:17.386 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.386 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:17.386 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656635+0000", 2024-09-13T06:41:17.386 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:17.387 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.387 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.387 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:17.387 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656635+0000", 2024-09-13T06:41:17.387 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:17.387 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.387 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.387 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:17.387 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656635+0000", 2024-09-13T06:41:17.387 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:41:17.387 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.387 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.387 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:17.387 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656636+0000", 2024-09-13T06:41:17.388 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.544e-06 2024-09-13T06:41:17.388 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.388 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.388 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:17.388 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656639+0000", 2024-09-13T06:41:17.388 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.0879999999999999e-06 2024-09-13T06:41:17.388 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.388 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.388 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:17.388 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656642+0000", 2024-09-13T06:41:17.388 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5799999999999999e-06 2024-09-13T06:41:17.388 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.388 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.389 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:17.389 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.780151+0000", 2024-09-13T06:41:17.389 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123509035 2024-09-13T06:41:17.389 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.389 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.389 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:17.389 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.780191+0000", 2024-09-13T06:41:17.389 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.9758000000000001e-05 2024-09-13T06:41:17.389 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.389 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.389 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:17.389 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.780380+0000", 2024-09-13T06:41:17.389 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000189023 2024-09-13T06:41:17.390 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:17.390 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:17.390 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:17.390 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.390 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.390 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43194 3.17 3:ec5ebce4:::rbd_data.1121f5f2e1c0.0000000000000001:1f [read 495616~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:17.390 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.656645+0000", 2024-09-13T06:41:17.390 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 55.698569751999997, 2024-09-13T06:41:17.390 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.124088483, 2024-09-13T06:41:17.390 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:17.390 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:17.390 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:17.390 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:17.390 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:17.391 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43194 2024-09-13T06:41:17.391 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.391 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:17.391 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.391 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:17.391 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656645+0000", 2024-09-13T06:41:17.391 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:17.391 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.391 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.391 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:17.391 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656645+0000", 2024-09-13T06:41:17.391 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:17.391 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.392 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.392 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:17.392 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656645+0000", 2024-09-13T06:41:17.392 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:17.392 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.392 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.392 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:17.392 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656647+0000", 2024-09-13T06:41:17.392 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9180000000000001e-06 2024-09-13T06:41:17.392 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.392 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.392 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:17.392 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656653+0000", 2024-09-13T06:41:17.393 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7860000000000002e-06 2024-09-13T06:41:17.393 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.393 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.393 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:17.393 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656658+0000", 2024-09-13T06:41:17.393 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6949999999999999e-06 2024-09-13T06:41:17.393 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.393 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.393 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:17.393 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.780406+0000", 2024-09-13T06:41:17.393 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123748657 2024-09-13T06:41:17.393 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.394 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.394 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:17.394 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.780446+0000", 2024-09-13T06:41:17.394 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.9360999999999998e-05 2024-09-13T06:41:17.394 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.394 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.394 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:17.394 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.780734+0000", 2024-09-13T06:41:17.394 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00028838399999999998 2024-09-13T06:41:17.394 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:17.394 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:17.394 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:17.394 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.394 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.395 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43240 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 106496~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:17.395 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.660672+0000", 2024-09-13T06:41:17.395 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 55.694543389000003, 2024-09-13T06:41:17.395 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123612707, 2024-09-13T06:41:17.395 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:17.395 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:17.395 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:17.395 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:17.395 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:17.395 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43240 2024-09-13T06:41:17.395 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.395 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:17.395 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.395 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:17.395 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660672+0000", 2024-09-13T06:41:17.396 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:17.396 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.396 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.396 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:17.396 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660672+0000", 2024-09-13T06:41:17.396 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:17.396 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.396 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.396 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:17.396 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660671+0000", 2024-09-13T06:41:17.396 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:17.396 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.396 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.396 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:17.397 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660673+0000", 2024-09-13T06:41:17.397 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.652e-06 2024-09-13T06:41:17.397 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.397 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.397 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:17.397 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660677+0000", 2024-09-13T06:41:17.397 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.2509999999999996e-06 2024-09-13T06:41:17.397 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.397 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.397 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:17.397 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660680+0000", 2024-09-13T06:41:17.397 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.8150000000000002e-06 2024-09-13T06:41:17.397 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.398 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.398 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:17.398 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.783596+0000", 2024-09-13T06:41:17.398 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.122915841 2024-09-13T06:41:17.398 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.398 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.398 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:17.398 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.783682+0000", 2024-09-13T06:41:17.398 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.5822999999999995e-05 2024-09-13T06:41:17.398 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.398 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.398 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:17.398 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.784285+0000", 2024-09-13T06:41:17.398 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00060276500000000001 2024-09-13T06:41:17.398 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:17.399 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:17.399 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:17.399 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.399 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.399 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43241 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 120832~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:17.399 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.660682+0000", 2024-09-13T06:41:17.399 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 55.694532813999999, 2024-09-13T06:41:17.399 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123958204, 2024-09-13T06:41:17.399 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:17.399 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:17.399 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:17.399 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:17.399 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:17.400 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43241 2024-09-13T06:41:17.400 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.400 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:17.400 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.400 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:17.400 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660682+0000", 2024-09-13T06:41:17.400 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:17.400 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.400 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.400 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:17.400 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660682+0000", 2024-09-13T06:41:17.400 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:17.400 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.401 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.401 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:17.401 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660682+0000", 2024-09-13T06:41:17.401 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:17.401 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.401 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.401 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:17.401 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660683+0000", 2024-09-13T06:41:17.401 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.308e-06 2024-09-13T06:41:17.401 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.401 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.401 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:17.401 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660686+0000", 2024-09-13T06:41:17.402 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.977e-06 2024-09-13T06:41:17.402 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.402 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.402 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:17.402 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660689+0000", 2024-09-13T06:41:17.402 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5830000000000001e-06 2024-09-13T06:41:17.402 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.402 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.402 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:17.402 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.784366+0000", 2024-09-13T06:41:17.402 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.12367713599999999 2024-09-13T06:41:17.402 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.402 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.403 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:17.403 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.784451+0000", 2024-09-13T06:41:17.403 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.4629999999999994e-05 2024-09-13T06:41:17.403 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.403 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.403 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:17.403 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.784641+0000", 2024-09-13T06:41:17.403 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00018984899999999999 2024-09-13T06:41:17.403 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:17.403 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:17.403 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:17.403 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.403 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.403 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43242 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 139264~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:17.404 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.660691+0000", 2024-09-13T06:41:17.404 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 55.694523836000002, 2024-09-13T06:41:17.404 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.124536443, 2024-09-13T06:41:17.404 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:17.404 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:17.404 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:17.404 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:17.404 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:17.404 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43242 2024-09-13T06:41:17.404 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.404 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:17.404 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.404 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:17.405 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660691+0000", 2024-09-13T06:41:17.405 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:17.405 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.405 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.405 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:17.405 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660691+0000", 2024-09-13T06:41:17.405 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:17.405 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.405 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.405 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:17.405 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660691+0000", 2024-09-13T06:41:17.405 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:41:17.405 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.406 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.406 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:17.406 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660696+0000", 2024-09-13T06:41:17.406 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0560000000000004e-06 2024-09-13T06:41:17.406 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.406 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.406 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:17.406 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660699+0000", 2024-09-13T06:41:17.406 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.2009999999999999e-06 2024-09-13T06:41:17.406 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.406 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.406 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:17.406 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660702+0000", 2024-09-13T06:41:17.406 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.633e-06 2024-09-13T06:41:17.407 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.407 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.407 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:17.407 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.784912+0000", 2024-09-13T06:41:17.407 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.124209497 2024-09-13T06:41:17.407 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.407 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.407 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:17.407 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.784995+0000", 2024-09-13T06:41:17.407 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.3891e-05 2024-09-13T06:41:17.407 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.407 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.407 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:17.407 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.785228+0000", 2024-09-13T06:41:17.408 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00023237400000000001 2024-09-13T06:41:17.408 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:17.408 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:17.408 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:17.408 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.408 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.408 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43243 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 153600~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:17.408 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.660705+0000", 2024-09-13T06:41:17.408 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 55.694510502999997, 2024-09-13T06:41:17.408 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.124825835, 2024-09-13T06:41:17.408 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:17.408 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:17.408 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:17.409 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:17.409 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:17.409 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43243 2024-09-13T06:41:17.409 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.409 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:17.409 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.409 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:17.409 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660705+0000", 2024-09-13T06:41:17.409 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:17.409 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.409 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.409 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:17.409 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660705+0000", 2024-09-13T06:41:17.409 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:17.410 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.410 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.410 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:17.410 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660705+0000", 2024-09-13T06:41:17.410 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:41:17.410 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.410 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.410 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:17.410 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660706+0000", 2024-09-13T06:41:17.410 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4339999999999999e-06 2024-09-13T06:41:17.410 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.410 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.410 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:17.410 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660709+0000", 2024-09-13T06:41:17.411 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9000000000000002e-06 2024-09-13T06:41:17.411 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.411 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.411 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:17.411 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660712+0000", 2024-09-13T06:41:17.411 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.0589999999999998e-06 2024-09-13T06:41:17.411 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.411 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.411 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:17.411 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.785318+0000", 2024-09-13T06:41:17.411 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.124606299 2024-09-13T06:41:17.411 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.411 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.412 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:17.412 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.785361+0000", 2024-09-13T06:41:17.412 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.3214999999999999e-05 2024-09-13T06:41:17.412 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.412 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.412 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:17.412 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.785531+0000", 2024-09-13T06:41:17.412 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00016914400000000001 2024-09-13T06:41:17.412 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:17.412 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:17.412 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:17.412 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.412 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.412 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43244 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 167936~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:17.413 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.660714+0000", 2024-09-13T06:41:17.413 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 55.694501090000003, 2024-09-13T06:41:17.413 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.125073248, 2024-09-13T06:41:17.413 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:17.413 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:17.413 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:17.413 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:17.413 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:17.413 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43244 2024-09-13T06:41:17.413 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.413 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:17.413 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.413 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:17.414 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660714+0000", 2024-09-13T06:41:17.414 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:17.414 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.414 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.414 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:17.414 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660714+0000", 2024-09-13T06:41:17.414 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:17.414 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.414 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.414 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:17.414 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660714+0000", 2024-09-13T06:41:17.414 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:41:17.414 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.415 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.415 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:17.415 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660715+0000", 2024-09-13T06:41:17.415 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2330000000000001e-06 2024-09-13T06:41:17.415 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.415 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.415 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:17.415 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660718+0000", 2024-09-13T06:41:17.415 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9569999999999998e-06 2024-09-13T06:41:17.415 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.415 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.415 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:17.415 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660721+0000", 2024-09-13T06:41:17.416 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.678e-06 2024-09-13T06:41:17.416 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.416 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.416 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:17.416 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.785557+0000", 2024-09-13T06:41:17.416 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.12483633199999999 2024-09-13T06:41:17.416 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.416 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.416 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:17.416 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.785618+0000", 2024-09-13T06:41:17.416 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0686000000000001e-05 2024-09-13T06:41:17.416 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.416 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.416 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:17.417 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.785787+0000", 2024-09-13T06:41:17.417 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00016957699999999999 2024-09-13T06:41:17.417 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:17.417 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:17.417 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:17.417 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.417 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.417 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43254 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 315392~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:17.417 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.664717+0000", 2024-09-13T06:41:17.417 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 55.690498521999999, 2024-09-13T06:41:17.417 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.12357108, 2024-09-13T06:41:17.417 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:17.417 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:17.418 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:17.418 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:17.418 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:17.418 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43254 2024-09-13T06:41:17.418 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.418 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:17.418 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.418 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:17.418 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664717+0000", 2024-09-13T06:41:17.418 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:17.418 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.418 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.418 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:17.418 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664717+0000", 2024-09-13T06:41:17.419 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:17.419 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.419 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.419 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:17.419 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664716+0000", 2024-09-13T06:41:17.419 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:17.419 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.419 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.419 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:17.419 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664724+0000", 2024-09-13T06:41:17.419 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.7109999999999995e-06 2024-09-13T06:41:17.419 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.419 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.419 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:17.420 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664732+0000", 2024-09-13T06:41:17.420 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.8399999999999995e-06 2024-09-13T06:41:17.420 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.420 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.420 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:17.420 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664738+0000", 2024-09-13T06:41:17.420 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.879e-06 2024-09-13T06:41:17.420 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.420 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.420 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:17.420 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.788018+0000", 2024-09-13T06:41:17.420 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123280719 2024-09-13T06:41:17.420 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.421 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.421 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:17.421 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.788119+0000", 2024-09-13T06:41:17.421 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000100558 2024-09-13T06:41:17.421 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.421 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.421 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:17.421 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.788288+0000", 2024-09-13T06:41:17.421 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000168751 2024-09-13T06:41:17.421 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:17.421 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:17.421 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:17.421 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.421 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.422 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43255 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 329728~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:17.422 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.664743+0000", 2024-09-13T06:41:17.422 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 55.690472526000001, 2024-09-13T06:41:17.422 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.12381711500000001, 2024-09-13T06:41:17.422 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:17.422 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:17.422 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:17.422 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:17.422 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:17.422 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43255 2024-09-13T06:41:17.422 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.422 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:17.422 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.422 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:17.423 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664743+0000", 2024-09-13T06:41:17.423 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:17.423 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.423 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.423 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:17.423 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664743+0000", 2024-09-13T06:41:17.423 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:17.423 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.423 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.423 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:17.423 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664742+0000", 2024-09-13T06:41:17.423 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:17.423 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.423 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.424 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:17.424 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664745+0000", 2024-09-13T06:41:17.424 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.7269999999999999e-06 2024-09-13T06:41:17.424 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.424 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.424 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:17.424 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664753+0000", 2024-09-13T06:41:17.424 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.8709999999999997e-06 2024-09-13T06:41:17.424 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.424 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.424 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:17.424 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664758+0000", 2024-09-13T06:41:17.424 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2220000000000001e-06 2024-09-13T06:41:17.425 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.425 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.425 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:17.425 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.788314+0000", 2024-09-13T06:41:17.425 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123555545 2024-09-13T06:41:17.425 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.425 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.425 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:17.425 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.788368+0000", 2024-09-13T06:41:17.425 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3928999999999998e-05 2024-09-13T06:41:17.425 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.425 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.425 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:17.425 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.788560+0000", 2024-09-13T06:41:17.426 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000192237 2024-09-13T06:41:17.426 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:17.426 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:17.426 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:17.426 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.426 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.426 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43256 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 344064~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:17.426 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.664763+0000", 2024-09-13T06:41:17.426 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 55.690452579999999, 2024-09-13T06:41:17.426 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.12418359399999999, 2024-09-13T06:41:17.426 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:17.426 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:17.426 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:17.427 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:17.427 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:17.427 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43256 2024-09-13T06:41:17.427 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.427 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:17.427 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.427 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:17.427 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664763+0000", 2024-09-13T06:41:17.427 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:17.427 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.427 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.427 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:17.427 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664763+0000", 2024-09-13T06:41:17.428 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:17.428 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.428 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.428 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:17.428 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664762+0000", 2024-09-13T06:41:17.428 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:17.428 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.428 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.428 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:17.428 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664765+0000", 2024-09-13T06:41:17.428 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3290000000000001e-06 2024-09-13T06:41:17.428 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.428 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.429 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:17.429 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664771+0000", 2024-09-13T06:41:17.429 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.1319999999999999e-06 2024-09-13T06:41:17.429 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.429 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.429 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:17.429 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664776+0000", 2024-09-13T06:41:17.429 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.8840000000000002e-06 2024-09-13T06:41:17.429 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.429 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.429 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:17.429 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.788598+0000", 2024-09-13T06:41:17.429 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123821979 2024-09-13T06:41:17.430 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.430 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.430 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:17.430 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.788680+0000", 2024-09-13T06:41:17.430 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.2367999999999995e-05 2024-09-13T06:41:17.430 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.430 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.430 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:17.430 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.788946+0000", 2024-09-13T06:41:17.430 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00026629799999999999 2024-09-13T06:41:17.430 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:17.430 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:17.430 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:17.430 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.431 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.431 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43265 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 477184~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:17.431 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.669414+0000", 2024-09-13T06:41:17.431 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 55.685800944, 2024-09-13T06:41:17.431 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123446973, 2024-09-13T06:41:17.431 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:17.431 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:17.431 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:17.431 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:17.431 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:17.431 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43265 2024-09-13T06:41:17.431 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.431 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:17.431 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.432 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:17.432 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669414+0000", 2024-09-13T06:41:17.432 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:17.432 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.432 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.432 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:17.432 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669414+0000", 2024-09-13T06:41:17.432 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:17.432 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.432 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.432 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:17.432 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669414+0000", 2024-09-13T06:41:17.432 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:17.433 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.433 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.433 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:17.433 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669416+0000", 2024-09-13T06:41:17.433 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.317e-06 2024-09-13T06:41:17.433 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.433 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.433 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:17.433 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669425+0000", 2024-09-13T06:41:17.433 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.0650000000000005e-06 2024-09-13T06:41:17.433 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.433 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.433 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:17.434 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669430+0000", 2024-09-13T06:41:17.434 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5079999999999999e-06 2024-09-13T06:41:17.434 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.434 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.434 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:17.434 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.792649+0000", 2024-09-13T06:41:17.434 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123219328 2024-09-13T06:41:17.434 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.434 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.434 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:17.434 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.792695+0000", 2024-09-13T06:41:17.434 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5476999999999998e-05 2024-09-13T06:41:17.434 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.434 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.435 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:17.435 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.792861+0000", 2024-09-13T06:41:17.435 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00016658999999999999 2024-09-13T06:41:17.435 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:17.435 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:17.435 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:17.435 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.435 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.435 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43266 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 491520~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:17.435 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.669434+0000", 2024-09-13T06:41:17.435 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 55.685780821999998, 2024-09-13T06:41:17.435 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123685267, 2024-09-13T06:41:17.435 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:17.435 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:17.436 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:17.436 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:17.436 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:17.436 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43266 2024-09-13T06:41:17.436 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.436 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:17.436 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.436 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:17.436 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669434+0000", 2024-09-13T06:41:17.436 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:17.436 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.436 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.436 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:17.437 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669434+0000", 2024-09-13T06:41:17.437 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:17.437 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.437 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.437 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:17.437 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669434+0000", 2024-09-13T06:41:17.437 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:17.437 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.437 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.437 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:17.437 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669441+0000", 2024-09-13T06:41:17.437 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3019999999999997e-06 2024-09-13T06:41:17.437 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.438 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.438 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:17.438 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669451+0000", 2024-09-13T06:41:17.438 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.6379999999999999e-06 2024-09-13T06:41:17.438 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.438 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.438 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:17.438 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669456+0000", 2024-09-13T06:41:17.438 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.361e-06 2024-09-13T06:41:17.438 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.438 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.438 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:17.438 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.792879+0000", 2024-09-13T06:41:17.438 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123422686 2024-09-13T06:41:17.439 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.439 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.439 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:17.439 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.792923+0000", 2024-09-13T06:41:17.439 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4035000000000001e-05 2024-09-13T06:41:17.439 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.439 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.439 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:17.439 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.793120+0000", 2024-09-13T06:41:17.439 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00019660899999999999 2024-09-13T06:41:17.439 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:17.439 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:17.439 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:17.439 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.440 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.440 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43267 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 505856~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:17.440 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.669461+0000", 2024-09-13T06:41:17.440 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 55.685754025999998, 2024-09-13T06:41:17.440 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123933711, 2024-09-13T06:41:17.440 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:17.440 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:17.440 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:17.440 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:17.440 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:17.441 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43267 2024-09-13T06:41:17.441 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.441 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:17.441 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.441 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:17.441 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669461+0000", 2024-09-13T06:41:17.441 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:17.441 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.441 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.441 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:17.441 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669461+0000", 2024-09-13T06:41:17.441 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:17.441 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.441 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.442 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:17.442 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669461+0000", 2024-09-13T06:41:17.442 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:17.442 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.442 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.442 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:17.442 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669463+0000", 2024-09-13T06:41:17.442 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5629999999999999e-06 2024-09-13T06:41:17.442 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.442 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.442 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:17.442 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669473+0000", 2024-09-13T06:41:17.442 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.9520000000000006e-06 2024-09-13T06:41:17.443 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.443 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.443 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:17.443 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669479+0000", 2024-09-13T06:41:17.443 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8540000000000002e-06 2024-09-13T06:41:17.443 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.443 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.443 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:17.443 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.793137+0000", 2024-09-13T06:41:17.443 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.12365825699999999 2024-09-13T06:41:17.443 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.444 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.444 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:17.444 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.793181+0000", 2024-09-13T06:41:17.444 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.3773999999999998e-05 2024-09-13T06:41:17.444 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.444 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.444 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:17.444 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.793395+0000", 2024-09-13T06:41:17.444 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00021372399999999999 2024-09-13T06:41:17.444 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:17.444 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:17.444 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:17.444 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.445 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.445 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43268 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 520192~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:17.445 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.669484+0000", 2024-09-13T06:41:17.445 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 55.685731240999999, 2024-09-13T06:41:17.445 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.12441057899999999, 2024-09-13T06:41:17.445 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:17.445 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:17.445 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:17.445 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:17.445 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:17.445 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43268 2024-09-13T06:41:17.445 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.445 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:17.445 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.446 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:17.446 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669484+0000", 2024-09-13T06:41:17.446 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:17.446 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.446 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.446 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:17.446 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669484+0000", 2024-09-13T06:41:17.446 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:17.446 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.446 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.446 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:17.446 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669484+0000", 2024-09-13T06:41:17.446 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:17.446 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.447 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.447 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:17.447 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669486+0000", 2024-09-13T06:41:17.447 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6120000000000001e-06 2024-09-13T06:41:17.447 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.447 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.447 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:17.447 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669494+0000", 2024-09-13T06:41:17.447 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4819999999999997e-06 2024-09-13T06:41:17.447 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.447 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.447 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:17.448 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669497+0000", 2024-09-13T06:41:17.448 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9790000000000002e-06 2024-09-13T06:41:17.448 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.448 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.448 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:17.448 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.793559+0000", 2024-09-13T06:41:17.448 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.124062436 2024-09-13T06:41:17.448 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.448 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.448 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:17.448 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.793603+0000", 2024-09-13T06:41:17.448 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.3764999999999999e-05 2024-09-13T06:41:17.448 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.448 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.449 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:17.449 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.793895+0000", 2024-09-13T06:41:17.449 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00029168299999999999 2024-09-13T06:41:17.449 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:17.449 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:17.449 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:17.449 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:17.449 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:17.449 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:41:17.451 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-13T06:41:17.452 INFO:teuthology.orchestra.run.smithi081.stderr:nodeep-scrub is set 2024-09-13T06:41:17.452 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:41:17.450+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:41:17.551 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:41:17.551+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:41:17.620 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:41:17.620 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-13T06:41:17.620 INFO:teuthology.orchestra.run.smithi081.stdout: "num_ops": 0 2024-09-13T06:41:17.620 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:41:17.634 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-13T06:41:17.652 INFO:tasks.ceph.osd.6.smithi139.stderr:2024-09-13T06:41:17.651+0000 7fcd02c5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26385) UID: 0 2024-09-13T06:41:17.690 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-objectstore-tool --err-to-stderr --no-mon-config '--log-file=/var/log/ceph/objectstore_tool.$pid.log' --data-path /var/lib/ceph/osd/ceph-7 --journal-path /var/lib/ceph/osd/ceph-7/journal --op export --pgid 3.16 --file /var/log/ceph/exp.3.16.7 2024-09-13T06:41:17.753 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:41:17.750+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:41:17.759 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:41:17.760 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-13T06:41:17.760 INFO:teuthology.orchestra.run.smithi081.stdout: "complaint_time": 30, 2024-09-13T06:41:17.760 INFO:teuthology.orchestra.run.smithi081.stdout: "num_blocked_ops": 0 2024-09-13T06:41:17.760 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:41:17.774 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-13T06:41:17.866 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:41:17.866+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:41:17.945 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:41:17.945 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 20, 2024-09-13T06:41:17.946 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 600, 2024-09-13T06:41:17.946 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [ 2024-09-13T06:41:17.946 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.946 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:21979 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 14217216~4096 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:41:17.946 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.888811+0000", 2024-09-13T06:41:17.946 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 85.056195552000005, 2024-09-13T06:41:17.946 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049092969, 2024-09-13T06:41:17.946 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:17.946 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:17.946 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:17.946 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:17.946 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:17.946 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 21979 2024-09-13T06:41:17.947 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.947 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:17.947 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.947 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:17.947 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888811+0000", 2024-09-13T06:41:17.947 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:17.947 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.947 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.947 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:17.947 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888811+0000", 2024-09-13T06:41:17.947 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:17.947 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.947 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.948 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:17.948 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888811+0000", 2024-09-13T06:41:17.948 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:41:17.948 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.948 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.948 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:17.948 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888812+0000", 2024-09-13T06:41:17.948 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.204e-06 2024-09-13T06:41:17.948 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.948 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.948 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:17.948 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888815+0000", 2024-09-13T06:41:17.949 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9359999999999999e-06 2024-09-13T06:41:17.949 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.949 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.949 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:17.949 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888818+0000", 2024-09-13T06:41:17.949 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.7369999999999998e-06 2024-09-13T06:41:17.949 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.949 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.949 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:17.949 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.937663+0000", 2024-09-13T06:41:17.949 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.048844540999999998 2024-09-13T06:41:17.949 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.950 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.950 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:17.950 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.937709+0000", 2024-09-13T06:41:17.950 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6492999999999997e-05 2024-09-13T06:41:17.950 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.950 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.950 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:17.950 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.937904+0000", 2024-09-13T06:41:17.950 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00019526499999999999 2024-09-13T06:41:17.950 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:17.950 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:17.950 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:17.950 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.950 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.951 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:21980 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 14245888~4096 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:41:17.951 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.888820+0000", 2024-09-13T06:41:17.951 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 85.056186874999995, 2024-09-13T06:41:17.951 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049357080999999997, 2024-09-13T06:41:17.951 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:17.951 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:17.951 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:17.951 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:17.951 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:17.951 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 21980 2024-09-13T06:41:17.951 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.951 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:17.952 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.952 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:17.952 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888820+0000", 2024-09-13T06:41:17.952 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:17.952 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.952 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.952 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:17.952 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888820+0000", 2024-09-13T06:41:17.952 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:17.952 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.952 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.952 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:17.952 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888820+0000", 2024-09-13T06:41:17.953 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:41:17.953 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.953 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.953 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:17.953 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888821+0000", 2024-09-13T06:41:17.953 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.122e-06 2024-09-13T06:41:17.953 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.953 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.953 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:17.953 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888824+0000", 2024-09-13T06:41:17.953 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.0580000000000002e-06 2024-09-13T06:41:17.953 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.954 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.954 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:17.954 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888827+0000", 2024-09-13T06:41:17.954 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.666e-06 2024-09-13T06:41:17.954 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.954 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.954 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:17.954 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.937935+0000", 2024-09-13T06:41:17.954 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049108329999999999 2024-09-13T06:41:17.954 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.954 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.954 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:17.954 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.937985+0000", 2024-09-13T06:41:17.955 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9694000000000002e-05 2024-09-13T06:41:17.955 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.955 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.955 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:17.955 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.938177+0000", 2024-09-13T06:41:17.955 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00019241899999999999 2024-09-13T06:41:17.955 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:17.955 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:17.955 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:17.955 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.955 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.955 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:21984 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:snapdir [list-snaps] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:41:17.955 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.888829+0000", 2024-09-13T06:41:17.956 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 85.056178097, 2024-09-13T06:41:17.956 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049524545000000003, 2024-09-13T06:41:17.956 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:17.956 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:17.956 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:17.956 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:17.956 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:17.956 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 21984 2024-09-13T06:41:17.956 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.956 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:17.956 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.956 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:17.956 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888829+0000", 2024-09-13T06:41:17.957 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:17.957 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.957 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.957 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:17.957 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888829+0000", 2024-09-13T06:41:17.957 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:17.957 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.957 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.957 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:17.957 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888829+0000", 2024-09-13T06:41:17.957 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:41:17.957 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.957 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.957 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:17.958 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888830+0000", 2024-09-13T06:41:17.958 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2529999999999999e-06 2024-09-13T06:41:17.958 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.958 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.958 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:17.958 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888835+0000", 2024-09-13T06:41:17.958 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.4729999999999999e-06 2024-09-13T06:41:17.958 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.958 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.958 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:17.958 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888840+0000", 2024-09-13T06:41:17.958 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0159999999999999e-06 2024-09-13T06:41:17.958 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.959 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.959 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:17.959 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.938199+0000", 2024-09-13T06:41:17.959 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049358974999999999 2024-09-13T06:41:17.959 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.959 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.959 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:17.959 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.938268+0000", 2024-09-13T06:41:17.959 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.8876999999999998e-05 2024-09-13T06:41:17.959 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.959 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.959 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:17.959 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.938353+0000", 2024-09-13T06:41:17.959 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.5155999999999996e-05 2024-09-13T06:41:17.960 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:17.960 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:17.960 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:17.960 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.960 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.960 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:21985 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 12587008~4096 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:41:17.960 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.888858+0000", 2024-09-13T06:41:17.960 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 85.056148946999997, 2024-09-13T06:41:17.960 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049674347000000001, 2024-09-13T06:41:17.960 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:17.960 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:17.960 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:17.961 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:17.961 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:17.961 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 21985 2024-09-13T06:41:17.961 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.961 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:17.961 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.961 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:17.961 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888858+0000", 2024-09-13T06:41:17.961 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:17.961 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.961 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.961 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:17.962 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888858+0000", 2024-09-13T06:41:17.962 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:17.962 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.962 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.962 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:17.962 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888857+0000", 2024-09-13T06:41:17.962 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:17.962 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.962 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.962 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:17.962 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888860+0000", 2024-09-13T06:41:17.962 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4739999999999999e-06 2024-09-13T06:41:17.962 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.963 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.963 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:17.963 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888867+0000", 2024-09-13T06:41:17.963 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.7170000000000002e-06 2024-09-13T06:41:17.963 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.963 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.963 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:17.963 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888871+0000", 2024-09-13T06:41:17.963 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5120000000000002e-06 2024-09-13T06:41:17.963 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.963 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.963 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:17.963 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.938389+0000", 2024-09-13T06:41:17.964 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049517717000000003 2024-09-13T06:41:17.964 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.964 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.964 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:17.964 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.938449+0000", 2024-09-13T06:41:17.964 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0513999999999997e-05 2024-09-13T06:41:17.964 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.964 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.964 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:17.964 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.938532+0000", 2024-09-13T06:41:17.964 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.2936999999999996e-05 2024-09-13T06:41:17.964 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:17.965 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:17.965 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:17.965 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.965 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.965 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:21986 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 12615680~4096 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:41:17.965 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.888875+0000", 2024-09-13T06:41:17.965 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 85.056131433999994, 2024-09-13T06:41:17.965 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049881781, 2024-09-13T06:41:17.965 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:17.965 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:17.965 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:17.965 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:17.965 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:17.966 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 21986 2024-09-13T06:41:17.966 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.966 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:17.966 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.966 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:17.966 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888875+0000", 2024-09-13T06:41:17.966 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:17.966 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.966 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.966 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:17.966 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888875+0000", 2024-09-13T06:41:17.966 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:17.966 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.967 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.967 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:17.967 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888875+0000", 2024-09-13T06:41:17.967 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:17.967 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.967 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.967 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:17.967 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888880+0000", 2024-09-13T06:41:17.967 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7600000000000002e-06 2024-09-13T06:41:17.967 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.967 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.967 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:17.967 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888887+0000", 2024-09-13T06:41:17.968 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3950000000000003e-06 2024-09-13T06:41:17.968 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.968 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.968 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:17.968 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888892+0000", 2024-09-13T06:41:17.968 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0409999999999997e-06 2024-09-13T06:41:17.968 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.968 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.968 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:17.968 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.938568+0000", 2024-09-13T06:41:17.968 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049675267000000002 2024-09-13T06:41:17.968 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.968 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.969 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:17.969 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.938653+0000", 2024-09-13T06:41:17.969 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.5792999999999997e-05 2024-09-13T06:41:17.969 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.969 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.969 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:17.969 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.938757+0000", 2024-09-13T06:41:17.969 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00010387699999999999 2024-09-13T06:41:17.969 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:17.969 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:17.969 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:17.969 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.969 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.970 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:21987 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 12644352~4096 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:41:17.970 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.888899+0000", 2024-09-13T06:41:17.970 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 85.056108088000002, 2024-09-13T06:41:17.970 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.050094056999999997, 2024-09-13T06:41:17.970 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:17.970 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:17.970 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:17.970 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:17.970 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:17.970 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 21987 2024-09-13T06:41:17.970 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.970 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:17.970 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.971 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:17.971 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888899+0000", 2024-09-13T06:41:17.971 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:17.971 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.971 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.971 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:17.971 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888899+0000", 2024-09-13T06:41:17.971 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:17.971 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.971 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.971 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:17.971 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888899+0000", 2024-09-13T06:41:17.971 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:17.971 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.972 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.972 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:17.972 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888901+0000", 2024-09-13T06:41:17.972 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2539999999999999e-06 2024-09-13T06:41:17.972 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.972 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.972 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:17.972 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888907+0000", 2024-09-13T06:41:17.972 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9009999999999999e-06 2024-09-13T06:41:17.972 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.972 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.972 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:17.972 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888912+0000", 2024-09-13T06:41:17.973 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9840000000000001e-06 2024-09-13T06:41:17.973 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.973 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.973 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:17.973 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.938810+0000", 2024-09-13T06:41:17.973 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049898835000000002 2024-09-13T06:41:17.973 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.973 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.973 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:17.973 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.938890+0000", 2024-09-13T06:41:17.973 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.9215000000000006e-05 2024-09-13T06:41:17.973 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.973 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.974 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:17.974 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.938993+0000", 2024-09-13T06:41:17.974 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000103194 2024-09-13T06:41:17.974 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:17.974 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:17.974 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:17.974 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.974 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.974 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:21988 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 12673024~4096 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:41:17.974 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.888916+0000", 2024-09-13T06:41:17.974 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 85.056091072000001, 2024-09-13T06:41:17.974 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.050203036999999999, 2024-09-13T06:41:17.974 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:17.974 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:17.975 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:17.975 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:17.975 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:17.975 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 21988 2024-09-13T06:41:17.975 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.975 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:17.975 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.975 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:17.975 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888916+0000", 2024-09-13T06:41:17.975 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:17.975 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.975 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.975 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:17.976 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888916+0000", 2024-09-13T06:41:17.976 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:17.976 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.976 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.976 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:17.976 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888915+0000", 2024-09-13T06:41:17.976 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:17.976 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.976 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.976 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:17.976 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888918+0000", 2024-09-13T06:41:17.976 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1500000000000002e-06 2024-09-13T06:41:17.976 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.977 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.977 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:17.977 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888925+0000", 2024-09-13T06:41:17.977 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.9380000000000003e-06 2024-09-13T06:41:17.977 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.977 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.977 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:17.977 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888933+0000", 2024-09-13T06:41:17.977 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.0560000000000005e-06 2024-09-13T06:41:17.977 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.977 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.977 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:17.977 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.939026+0000", 2024-09-13T06:41:17.978 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.050093499999999999 2024-09-13T06:41:17.978 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.978 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.978 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:17.978 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.939068+0000", 2024-09-13T06:41:17.978 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.1705999999999997e-05 2024-09-13T06:41:17.978 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.978 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.978 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:17.978 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.939119+0000", 2024-09-13T06:41:17.978 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.1048999999999999e-05 2024-09-13T06:41:17.978 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:17.978 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:17.978 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:17.979 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.979 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.979 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:21989 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 12701696~4096 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:41:17.979 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.888938+0000", 2024-09-13T06:41:17.979 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 85.056068745000005, 2024-09-13T06:41:17.979 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.050294393999999999, 2024-09-13T06:41:17.979 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:17.979 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:17.979 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:17.979 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:17.979 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:17.979 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 21989 2024-09-13T06:41:17.979 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.980 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:17.980 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.980 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:17.980 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888938+0000", 2024-09-13T06:41:17.980 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:17.980 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.980 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.980 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:17.980 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888938+0000", 2024-09-13T06:41:17.980 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:17.980 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.980 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.980 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:17.981 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888938+0000", 2024-09-13T06:41:17.981 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:17.981 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.981 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.981 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:17.981 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888940+0000", 2024-09-13T06:41:17.981 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5330000000000001e-06 2024-09-13T06:41:17.981 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.981 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.981 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:17.981 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888947+0000", 2024-09-13T06:41:17.981 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.2389999999999999e-06 2024-09-13T06:41:17.982 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.982 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.982 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:17.982 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888952+0000", 2024-09-13T06:41:17.982 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.5720000000000002e-06 2024-09-13T06:41:17.982 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.982 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.982 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:17.982 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.939141+0000", 2024-09-13T06:41:17.982 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.050188903999999999 2024-09-13T06:41:17.982 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.982 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.982 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:17.983 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.939182+0000", 2024-09-13T06:41:17.983 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.0926000000000001e-05 2024-09-13T06:41:17.983 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.983 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.983 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:17.983 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.939233+0000", 2024-09-13T06:41:17.983 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0532999999999999e-05 2024-09-13T06:41:17.983 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:17.983 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:17.983 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:17.983 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.983 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.984 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:22006 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 13189120~4096 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:41:17.984 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.892763+0000", 2024-09-13T06:41:17.984 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 85.052244219000002, 2024-09-13T06:41:17.984 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.048963505999999997, 2024-09-13T06:41:17.984 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:17.984 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:17.984 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:17.984 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:17.984 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:17.984 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 22006 2024-09-13T06:41:17.984 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.984 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:17.985 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.985 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:17.985 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892763+0000", 2024-09-13T06:41:17.985 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:17.985 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.985 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.985 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:17.985 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892763+0000", 2024-09-13T06:41:17.985 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:17.985 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.985 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.985 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:17.986 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892763+0000", 2024-09-13T06:41:17.986 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:41:17.986 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.986 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.986 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:17.986 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892764+0000", 2024-09-13T06:41:17.986 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2410000000000001e-06 2024-09-13T06:41:17.986 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.986 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.986 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:17.986 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892767+0000", 2024-09-13T06:41:17.986 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9390000000000002e-06 2024-09-13T06:41:17.986 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.986 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.987 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:17.987 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892769+0000", 2024-09-13T06:41:17.987 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5390000000000002e-06 2024-09-13T06:41:17.987 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.987 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.987 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:17.987 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.941560+0000", 2024-09-13T06:41:17.987 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.048791221000000003 2024-09-13T06:41:17.987 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.987 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.987 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:17.987 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.941632+0000", 2024-09-13T06:41:17.987 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.1932000000000002e-05 2024-09-13T06:41:17.988 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.988 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.988 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:17.988 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.941726+0000", 2024-09-13T06:41:17.988 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.3839999999999996e-05 2024-09-13T06:41:17.988 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:17.988 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:17.988 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:17.988 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.988 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.988 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:22007 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 13217792~4096 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:41:17.988 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.892771+0000", 2024-09-13T06:41:17.989 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 85.052235639000003, 2024-09-13T06:41:17.989 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049090024000000003, 2024-09-13T06:41:17.989 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:17.989 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:17.989 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:17.989 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:17.989 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:17.989 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 22007 2024-09-13T06:41:17.989 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.989 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:17.989 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.989 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:17.989 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892771+0000", 2024-09-13T06:41:17.990 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:17.990 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.990 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.990 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:17.990 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892771+0000", 2024-09-13T06:41:17.990 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:17.990 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.990 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.990 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:17.990 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892771+0000", 2024-09-13T06:41:17.990 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:41:17.990 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.990 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.991 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:17.991 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892772+0000", 2024-09-13T06:41:17.991 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.184e-06 2024-09-13T06:41:17.991 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.991 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.991 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:17.991 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892775+0000", 2024-09-13T06:41:17.991 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9179999999999998e-06 2024-09-13T06:41:17.991 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.991 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.991 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:17.991 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892778+0000", 2024-09-13T06:41:17.991 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4990000000000001e-06 2024-09-13T06:41:17.992 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.992 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.992 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:17.992 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.941760+0000", 2024-09-13T06:41:17.992 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.048982070000000003 2024-09-13T06:41:17.992 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.992 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.992 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:17.992 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.941808+0000", 2024-09-13T06:41:17.992 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.8278000000000001e-05 2024-09-13T06:41:17.992 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.992 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.993 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:17.993 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.941861+0000", 2024-09-13T06:41:17.993 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3284e-05 2024-09-13T06:41:17.993 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:17.993 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:17.993 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:17.993 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.993 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.993 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:22008 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 13246464~4096 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:41:17.993 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.892780+0000", 2024-09-13T06:41:17.993 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 85.052226981999993, 2024-09-13T06:41:17.993 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049200477999999999, 2024-09-13T06:41:17.993 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:17.994 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:17.994 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:17.994 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:17.994 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:17.994 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 22008 2024-09-13T06:41:17.994 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.994 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:17.994 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.994 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:17.994 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892780+0000", 2024-09-13T06:41:17.994 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:17.994 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.995 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.995 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:17.995 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892780+0000", 2024-09-13T06:41:17.995 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:17.995 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.995 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.995 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:17.995 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892780+0000", 2024-09-13T06:41:17.995 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:41:17.995 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.995 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.995 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:17.996 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892781+0000", 2024-09-13T06:41:17.996 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.083e-06 2024-09-13T06:41:17.996 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.996 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.996 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:17.996 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892784+0000", 2024-09-13T06:41:17.996 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.926e-06 2024-09-13T06:41:17.996 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.996 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.996 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:17.996 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892786+0000", 2024-09-13T06:41:17.996 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4490000000000002e-06 2024-09-13T06:41:17.997 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.997 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.997 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:17.997 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.941888+0000", 2024-09-13T06:41:17.997 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049102290999999999 2024-09-13T06:41:17.997 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.997 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.997 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:17.997 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.941929+0000", 2024-09-13T06:41:17.997 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.0541999999999999e-05 2024-09-13T06:41:17.997 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.997 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.998 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:17.998 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.941980+0000", 2024-09-13T06:41:17.998 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.1391999999999999e-05 2024-09-13T06:41:17.998 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:17.998 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:17.998 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:17.998 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.998 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.998 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:22009 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 13275136~4096 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:41:17.998 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.892788+0000", 2024-09-13T06:41:17.998 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 85.052218498000002, 2024-09-13T06:41:17.998 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049311926999999998, 2024-09-13T06:41:17.998 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:17.998 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:17.999 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:17.999 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:17.999 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:17.999 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 22009 2024-09-13T06:41:17.999 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.999 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:17.999 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.999 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:17.999 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892788+0000", 2024-09-13T06:41:17.999 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:17.999 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:17.999 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:17.999 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:18.000 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892788+0000", 2024-09-13T06:41:18.000 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:18.000 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.000 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.000 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:18.000 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892788+0000", 2024-09-13T06:41:18.000 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:41:18.000 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.000 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.000 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:18.000 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892789+0000", 2024-09-13T06:41:18.000 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1850000000000001e-06 2024-09-13T06:41:18.000 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.000 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.001 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:18.001 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892793+0000", 2024-09-13T06:41:18.001 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.9099999999999998e-06 2024-09-13T06:41:18.001 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.001 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.001 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:18.001 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892798+0000", 2024-09-13T06:41:18.001 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5070000000000002e-06 2024-09-13T06:41:18.001 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.001 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.001 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:18.001 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.942007+0000", 2024-09-13T06:41:18.002 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049208904999999997 2024-09-13T06:41:18.002 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.002 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.002 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:18.002 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.942049+0000", 2024-09-13T06:41:18.002 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.1922000000000003e-05 2024-09-13T06:41:18.002 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.002 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.002 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:18.002 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.942100+0000", 2024-09-13T06:41:18.002 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.1736000000000001e-05 2024-09-13T06:41:18.002 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:18.002 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:18.003 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:18.003 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.003 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.003 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:22010 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 13303808~4096 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:41:18.003 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.892817+0000", 2024-09-13T06:41:18.003 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 85.052190302, 2024-09-13T06:41:18.003 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049466149000000001, 2024-09-13T06:41:18.003 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:18.003 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:18.003 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:18.003 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:18.003 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:18.003 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 22010 2024-09-13T06:41:18.004 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.004 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:18.004 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.004 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:18.004 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892817+0000", 2024-09-13T06:41:18.004 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:18.004 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.004 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.004 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:18.004 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892817+0000", 2024-09-13T06:41:18.004 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:18.004 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.004 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.005 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:18.005 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892816+0000", 2024-09-13T06:41:18.005 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:18.005 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.005 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.005 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:18.005 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892821+0000", 2024-09-13T06:41:18.005 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9459999999999997e-06 2024-09-13T06:41:18.005 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.005 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.005 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:18.005 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892828+0000", 2024-09-13T06:41:18.005 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.6780000000000003e-06 2024-09-13T06:41:18.006 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.006 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.006 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:18.006 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892833+0000", 2024-09-13T06:41:18.006 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.8389999999999997e-06 2024-09-13T06:41:18.006 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.006 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.006 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:18.006 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.942127+0000", 2024-09-13T06:41:18.006 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049294163000000002 2024-09-13T06:41:18.006 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.006 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.006 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:18.007 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.942186+0000", 2024-09-13T06:41:18.007 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9335e-05 2024-09-13T06:41:18.007 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.007 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.007 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:18.007 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.942283+0000", 2024-09-13T06:41:18.007 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.6699000000000004e-05 2024-09-13T06:41:18.007 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:18.007 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:18.007 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:18.007 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.007 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.008 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:22011 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 13332480~4096 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:41:18.008 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.892838+0000", 2024-09-13T06:41:18.008 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 85.052168614999999, 2024-09-13T06:41:18.008 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049589214, 2024-09-13T06:41:18.008 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:18.008 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:18.008 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:18.008 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:18.008 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:18.008 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 22011 2024-09-13T06:41:18.008 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.008 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:18.008 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.008 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:18.009 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892838+0000", 2024-09-13T06:41:18.009 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:18.009 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.009 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.009 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:18.009 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892838+0000", 2024-09-13T06:41:18.009 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:18.009 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.009 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.009 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:18.009 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892838+0000", 2024-09-13T06:41:18.009 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:18.010 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.010 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.010 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:18.010 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892840+0000", 2024-09-13T06:41:18.010 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.136e-06 2024-09-13T06:41:18.010 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.010 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.010 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:18.010 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892852+0000", 2024-09-13T06:41:18.010 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2122e-05 2024-09-13T06:41:18.010 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.010 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.010 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:18.011 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892862+0000", 2024-09-13T06:41:18.011 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.7049999999999994e-06 2024-09-13T06:41:18.011 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.011 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.011 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:18.011 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.942319+0000", 2024-09-13T06:41:18.011 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049456623999999998 2024-09-13T06:41:18.011 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.011 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.011 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:18.011 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.942363+0000", 2024-09-13T06:41:18.011 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4759000000000003e-05 2024-09-13T06:41:18.012 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.012 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.012 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:18.012 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.942428+0000", 2024-09-13T06:41:18.012 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.4221999999999996e-05 2024-09-13T06:41:18.012 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:18.012 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:18.012 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:18.012 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.012 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.012 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:22033 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 13963264~4096 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:41:18.012 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.896824+0000", 2024-09-13T06:41:18.012 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 85.048182722000007, 2024-09-13T06:41:18.013 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049051957, 2024-09-13T06:41:18.013 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:18.013 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:18.013 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:18.013 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:18.013 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:18.013 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 22033 2024-09-13T06:41:18.013 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.013 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:18.013 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.013 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:18.013 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.896824+0000", 2024-09-13T06:41:18.014 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:18.014 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.014 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.014 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:18.014 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.896824+0000", 2024-09-13T06:41:18.014 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:18.014 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.014 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.014 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:18.014 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.896824+0000", 2024-09-13T06:41:18.014 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:18.014 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.015 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.015 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:18.015 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.896826+0000", 2024-09-13T06:41:18.015 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1900000000000002e-06 2024-09-13T06:41:18.015 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.015 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.015 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:18.015 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.896832+0000", 2024-09-13T06:41:18.015 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.2689999999999996e-06 2024-09-13T06:41:18.015 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.015 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.015 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:18.015 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.896840+0000", 2024-09-13T06:41:18.016 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3289999999999996e-06 2024-09-13T06:41:18.016 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.016 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.016 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:18.016 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.945777+0000", 2024-09-13T06:41:18.016 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.048937188 2024-09-13T06:41:18.016 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.016 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.016 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:18.016 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.945822+0000", 2024-09-13T06:41:18.016 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4780999999999997e-05 2024-09-13T06:41:18.016 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.016 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.017 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:18.017 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.945876+0000", 2024-09-13T06:41:18.017 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.4542000000000001e-05 2024-09-13T06:41:18.017 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:18.017 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:18.017 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:18.017 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.017 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.017 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:22338 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 13611008~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:41:18.017 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.951070+0000", 2024-09-13T06:41:18.017 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 84.993937094000003, 2024-09-13T06:41:18.017 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049135817999999998, 2024-09-13T06:41:18.017 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:18.018 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:18.018 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:18.018 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:18.018 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:18.018 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 22338 2024-09-13T06:41:18.018 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.018 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:18.018 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.018 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:18.018 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951070+0000", 2024-09-13T06:41:18.018 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:18.018 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.018 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.018 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:18.019 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951070+0000", 2024-09-13T06:41:18.019 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:18.019 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.019 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.019 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:18.019 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951069+0000", 2024-09-13T06:41:18.019 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:18.019 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.019 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.019 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:18.019 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951072+0000", 2024-09-13T06:41:18.019 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5909999999999998e-06 2024-09-13T06:41:18.019 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.020 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.020 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:18.020 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951078+0000", 2024-09-13T06:41:18.020 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.4450000000000001e-06 2024-09-13T06:41:18.020 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.020 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.020 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:18.020 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951083+0000", 2024-09-13T06:41:18.020 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7790000000000003e-06 2024-09-13T06:41:18.020 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.020 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.020 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:18.020 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:53.000020+0000", 2024-09-13T06:41:18.021 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.048936999000000002 2024-09-13T06:41:18.021 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.021 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.021 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:18.021 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:53.000106+0000", 2024-09-13T06:41:18.021 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.5532999999999996e-05 2024-09-13T06:41:18.021 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.021 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.021 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:18.021 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:53.000206+0000", 2024-09-13T06:41:18.021 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.9852999999999994e-05 2024-09-13T06:41:18.021 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:18.021 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:18.022 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:18.022 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.022 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.022 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:22339 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 13639680~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:41:18.022 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.951088+0000", 2024-09-13T06:41:18.022 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 84.993919395999995, 2024-09-13T06:41:18.022 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049238202000000002, 2024-09-13T06:41:18.022 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:18.022 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:18.022 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:18.022 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:18.022 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:18.023 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 22339 2024-09-13T06:41:18.023 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.023 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:18.023 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.023 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:18.023 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951088+0000", 2024-09-13T06:41:18.023 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:18.023 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.023 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.023 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:18.023 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951088+0000", 2024-09-13T06:41:18.023 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:18.023 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.024 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.024 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:18.024 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951087+0000", 2024-09-13T06:41:18.024 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:18.024 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.024 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.024 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:18.024 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951089+0000", 2024-09-13T06:41:18.024 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.153e-06 2024-09-13T06:41:18.024 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.024 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.024 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:18.025 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951093+0000", 2024-09-13T06:41:18.025 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.7120000000000002e-06 2024-09-13T06:41:18.025 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.025 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.025 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:18.025 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951096+0000", 2024-09-13T06:41:18.025 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.0570000000000001e-06 2024-09-13T06:41:18.025 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.025 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.025 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:18.025 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:53.000220+0000", 2024-09-13T06:41:18.025 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049123989 2024-09-13T06:41:18.025 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.026 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.026 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:18.026 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:53.000271+0000", 2024-09-13T06:41:18.026 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.062e-05 2024-09-13T06:41:18.026 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.026 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.026 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:18.026 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:53.000326+0000", 2024-09-13T06:41:18.026 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.5121000000000003e-05 2024-09-13T06:41:18.026 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:18.026 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:18.026 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:18.027 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.027 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.027 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:22340 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 13668352~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:41:18.027 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.951200+0000", 2024-09-13T06:41:18.027 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 84.993806507000002, 2024-09-13T06:41:18.027 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049352350000000003, 2024-09-13T06:41:18.027 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:18.027 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:18.027 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:18.027 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:18.027 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:18.027 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 22340 2024-09-13T06:41:18.027 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.028 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:18.028 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.028 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:18.028 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951200+0000", 2024-09-13T06:41:18.028 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:18.028 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.028 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.028 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:18.028 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951200+0000", 2024-09-13T06:41:18.028 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:18.028 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.028 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.029 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:18.029 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951098+0000", 2024-09-13T06:41:18.029 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.999898 2024-09-13T06:41:18.029 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.029 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.029 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:18.029 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951204+0000", 2024-09-13T06:41:18.029 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000105398 2024-09-13T06:41:18.029 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.029 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.029 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:18.029 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951211+0000", 2024-09-13T06:41:18.029 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.43e-06 2024-09-13T06:41:18.030 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.030 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.030 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:18.030 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951216+0000", 2024-09-13T06:41:18.030 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2800000000000003e-06 2024-09-13T06:41:18.030 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.030 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.030 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:18.030 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:53.000358+0000", 2024-09-13T06:41:18.030 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049142036 2024-09-13T06:41:18.030 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.030 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.030 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:18.030 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:53.000443+0000", 2024-09-13T06:41:18.031 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.4710999999999996e-05 2024-09-13T06:41:18.031 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.031 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.031 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:18.031 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:53.000553+0000", 2024-09-13T06:41:18.031 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000109622 2024-09-13T06:41:18.031 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:18.031 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:18.031 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:18.031 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.031 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.031 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:22348 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 13897728~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:41:18.031 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.952783+0000", 2024-09-13T06:41:18.032 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 84.992223718999995, 2024-09-13T06:41:18.032 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049120832000000003, 2024-09-13T06:41:18.032 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:18.032 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:18.032 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:18.032 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:18.032 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:18.032 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 22348 2024-09-13T06:41:18.032 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.032 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:18.032 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.032 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:18.032 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.952783+0000", 2024-09-13T06:41:18.033 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:18.033 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.033 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.033 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:18.033 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.952783+0000", 2024-09-13T06:41:18.033 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:18.033 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.033 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.033 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:18.033 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.952783+0000", 2024-09-13T06:41:18.033 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:18.033 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.033 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.034 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:18.034 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.952785+0000", 2024-09-13T06:41:18.034 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4980000000000001e-06 2024-09-13T06:41:18.034 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.034 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.034 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:18.034 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.952799+0000", 2024-09-13T06:41:18.034 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3825000000000001e-05 2024-09-13T06:41:18.034 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.034 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.034 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:18.034 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.952809+0000", 2024-09-13T06:41:18.034 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0043e-05 2024-09-13T06:41:18.035 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.035 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.035 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:18.035 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:53.001723+0000", 2024-09-13T06:41:18.035 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.048914065 2024-09-13T06:41:18.035 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.035 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.035 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:18.035 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:53.001807+0000", 2024-09-13T06:41:18.035 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.3776000000000006e-05 2024-09-13T06:41:18.035 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.035 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.035 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:18.036 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:53.001904+0000", 2024-09-13T06:41:18.036 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.7004999999999997e-05 2024-09-13T06:41:18.036 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:18.036 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:18.036 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:18.036 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.036 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.036 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:69045 3.0 3:05ea3821:::rbd_data.1121867cc19b.0000000000000000:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109)", 2024-09-13T06:41:18.036 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:41:03.637760+0000", 2024-09-13T06:41:18.036 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 14.307246961000001, 2024-09-13T06:41:18.036 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.052276712000000003, 2024-09-13T06:41:18.036 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:18.037 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:41:18.037 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:18.037 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:18.037 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:18.037 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 69045 2024-09-13T06:41:18.037 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.037 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:18.037 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.037 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:18.037 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:03.637760+0000", 2024-09-13T06:41:18.037 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:18.037 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.038 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.038 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:18.038 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:03.637760+0000", 2024-09-13T06:41:18.038 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:18.038 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.038 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.038 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:18.038 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:03.637758+0000", 2024-09-13T06:41:18.038 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999981 2024-09-13T06:41:18.038 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.038 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.038 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:18.039 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:03.637770+0000", 2024-09-13T06:41:18.039 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1533e-05 2024-09-13T06:41:18.039 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.039 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.039 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:18.039 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:03.637794+0000", 2024-09-13T06:41:18.039 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4243000000000002e-05 2024-09-13T06:41:18.039 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.039 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.039 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:18.039 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:03.637806+0000", 2024-09-13T06:41:18.039 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2033e-05 2024-09-13T06:41:18.039 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.039 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.040 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:18.040 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:03.637891+0000", 2024-09-13T06:41:18.040 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.5358000000000005e-05 2024-09-13T06:41:18.040 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.040 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.040 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:18.040 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:03.638042+0000", 2024-09-13T06:41:18.040 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000151073 2024-09-13T06:41:18.040 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.040 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.040 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 2", 2024-09-13T06:41:18.040 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:03.647124+0000", 2024-09-13T06:41:18.041 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0090821670000000004 2024-09-13T06:41:18.041 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.041 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.041 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:41:18.041 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:03.689849+0000", 2024-09-13T06:41:18.041 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.042724445999999999 2024-09-13T06:41:18.041 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.041 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.041 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-09-13T06:41:18.041 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:03.689871+0000", 2024-09-13T06:41:18.041 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1778999999999999e-05 2024-09-13T06:41:18.041 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.041 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.042 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:41:18.042 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:03.689965+0000", 2024-09-13T06:41:18.042 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.4312000000000001e-05 2024-09-13T06:41:18.042 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.042 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.042 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:18.042 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:03.690037+0000", 2024-09-13T06:41:18.042 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.1687999999999995e-05 2024-09-13T06:41:18.042 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:18.042 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:18.042 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:18.042 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:18.043 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:18.043 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:41:18.044 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-13T06:41:18.045 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:41:18.042+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:41:18.145 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:41:18.142+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:41:18.212 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:41:18.212 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-13T06:41:18.212 INFO:teuthology.orchestra.run.smithi081.stdout: "num_ops": 0 2024-09-13T06:41:18.212 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:41:18.227 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-13T06:41:18.270 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:41:18.270+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:41:18.348 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:41:18.343+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:41:18.389 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:41:18.389 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-13T06:41:18.389 INFO:teuthology.orchestra.run.smithi081.stdout: "complaint_time": 30, 2024-09-13T06:41:18.389 INFO:teuthology.orchestra.run.smithi081.stdout: "num_blocked_ops": 0 2024-09-13T06:41:18.389 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:41:18.403 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-13T06:41:18.450 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:41:18.450+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:41:18.549 INFO:tasks.ceph.osd.6.smithi139.stderr:2024-09-13T06:41:18.547+0000 7fcd02c5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26385) UID: 0 2024-09-13T06:41:18.561 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:41:18.561 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 20, 2024-09-13T06:41:18.561 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 600, 2024-09-13T06:41:18.561 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [ 2024-09-13T06:41:18.561 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.561 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:36160 3.f 3:f62782c2:::rbd_object_map.11219660270d.0000000000000016:head [call] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-13T06:41:18.562 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:01.607291+0000", 2024-09-13T06:41:18.562 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 76.954627888000005, 2024-09-13T06:41:18.562 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.99619456699999998, 2024-09-13T06:41:18.562 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:18.562 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:18.562 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:18.562 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:18.562 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:18.562 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 36160 2024-09-13T06:41:18.562 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.562 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:18.562 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.562 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:18.562 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:01.607291+0000", 2024-09-13T06:41:18.563 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:18.563 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.563 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.563 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:18.563 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:01.607291+0000", 2024-09-13T06:41:18.563 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:18.563 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.563 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.563 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:18.563 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:01.607289+0000", 2024-09-13T06:41:18.563 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999976 2024-09-13T06:41:18.563 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.563 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.564 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:18.564 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:01.607302+0000", 2024-09-13T06:41:18.564 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3018e-05 2024-09-13T06:41:18.564 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.564 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.564 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:18.564 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:01.607323+0000", 2024-09-13T06:41:18.564 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1030999999999999e-05 2024-09-13T06:41:18.564 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.564 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.564 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:18.564 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:01.607342+0000", 2024-09-13T06:41:18.564 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8961e-05 2024-09-13T06:41:18.565 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.565 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.565 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:18.565 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:01.607425+0000", 2024-09-13T06:41:18.565 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.3171999999999996e-05 2024-09-13T06:41:18.565 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.565 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.565 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:41:18.565 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:01.607441+0000", 2024-09-13T06:41:18.565 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5996999999999999e-05 2024-09-13T06:41:18.566 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.566 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.566 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:18.566 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:02.596186+0000", 2024-09-13T06:41:18.566 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.98874432000000001 2024-09-13T06:41:18.566 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.566 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.566 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for missing object", 2024-09-13T06:41:18.566 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:02.596618+0000", 2024-09-13T06:41:18.566 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000432032 2024-09-13T06:41:18.566 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.566 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.566 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:18.567 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:02.600845+0000", 2024-09-13T06:41:18.567 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0042277410000000001 2024-09-13T06:41:18.567 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.567 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.567 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:18.567 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:02.601003+0000", 2024-09-13T06:41:18.567 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00015731999999999999 2024-09-13T06:41:18.567 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.567 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.567 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:18.567 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:02.603486+0000", 2024-09-13T06:41:18.567 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0024832510000000001 2024-09-13T06:41:18.568 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:18.568 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:18.568 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:18.568 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.568 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.568 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:37806 3.9 3:951cb95b:::rbd_data.1121d8143c6e.0000000000000002:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e56)", 2024-09-13T06:41:18.568 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:06.373482+0000", 2024-09-13T06:41:18.568 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 72.188436851999995, 2024-09-13T06:41:18.568 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.002476213, 2024-09-13T06:41:18.568 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:18.568 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:18.568 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:18.568 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:18.569 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:18.569 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 37806 2024-09-13T06:41:18.569 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.569 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:18.569 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.569 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:18.569 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.373482+0000", 2024-09-13T06:41:18.569 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:18.569 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.569 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.569 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:18.569 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.373482+0000", 2024-09-13T06:41:18.569 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:18.570 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.570 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.570 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:18.570 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.373479+0000", 2024-09-13T06:41:18.570 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999962 2024-09-13T06:41:18.570 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.570 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.570 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:18.570 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.373495+0000", 2024-09-13T06:41:18.570 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6640999999999999e-05 2024-09-13T06:41:18.570 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.570 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.570 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:18.570 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.373542+0000", 2024-09-13T06:41:18.571 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6229000000000001e-05 2024-09-13T06:41:18.571 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.571 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.571 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:18.571 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.373564+0000", 2024-09-13T06:41:18.571 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2684000000000002e-05 2024-09-13T06:41:18.571 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.571 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.571 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:18.571 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374268+0000", 2024-09-13T06:41:18.571 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00070363700000000001 2024-09-13T06:41:18.571 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.571 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.571 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:41:18.572 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374305+0000", 2024-09-13T06:41:18.572 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.6936e-05 2024-09-13T06:41:18.572 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.572 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.572 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:18.572 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.375175+0000", 2024-09-13T06:41:18.572 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.000870454 2024-09-13T06:41:18.572 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.572 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.572 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:18.572 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.375678+0000", 2024-09-13T06:41:18.572 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00050292499999999999 2024-09-13T06:41:18.572 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.573 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.573 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:18.573 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.375959+0000", 2024-09-13T06:41:18.573 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00028050599999999997 2024-09-13T06:41:18.573 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:18.573 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:18.573 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:18.573 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.573 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.573 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:37821 3.9 3:951cb95b:::rbd_data.1121d8143c6e.0000000000000002:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e56)", 2024-09-13T06:41:18.573 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:06.374454+0000", 2024-09-13T06:41:18.573 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 72.187465735000004, 2024-09-13T06:41:18.573 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.002545072, 2024-09-13T06:41:18.574 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:18.574 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:18.574 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:18.574 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:18.574 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:18.574 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 37821 2024-09-13T06:41:18.574 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.574 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:18.574 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.574 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:18.574 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374454+0000", 2024-09-13T06:41:18.574 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:18.574 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.574 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.575 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:18.575 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374454+0000", 2024-09-13T06:41:18.575 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:18.575 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.575 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.575 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:18.575 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374452+0000", 2024-09-13T06:41:18.575 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999981 2024-09-13T06:41:18.575 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.575 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.575 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:18.575 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374463+0000", 2024-09-13T06:41:18.575 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0756e-05 2024-09-13T06:41:18.576 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.576 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.576 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:18.576 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374487+0000", 2024-09-13T06:41:18.576 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4887000000000001e-05 2024-09-13T06:41:18.576 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.576 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.576 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:18.576 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374504+0000", 2024-09-13T06:41:18.576 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6852000000000001e-05 2024-09-13T06:41:18.576 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.576 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.577 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:18.577 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374829+0000", 2024-09-13T06:41:18.577 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000324684 2024-09-13T06:41:18.577 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.577 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.577 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:41:18.577 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374880+0000", 2024-09-13T06:41:18.577 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.1378000000000002e-05 2024-09-13T06:41:18.577 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.577 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.577 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:18.577 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.376423+0000", 2024-09-13T06:41:18.577 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.001542734 2024-09-13T06:41:18.578 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.578 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.578 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:18.578 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.376607+0000", 2024-09-13T06:41:18.578 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000183656 2024-09-13T06:41:18.578 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.578 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.578 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:18.578 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.376999+0000", 2024-09-13T06:41:18.578 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00039191200000000001 2024-09-13T06:41:18.578 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:18.578 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:18.579 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:18.579 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.579 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.579 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:37836 3.9 3:951cb95b:::rbd_data.1121d8143c6e.0000000000000002:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e56)", 2024-09-13T06:41:18.579 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:06.374929+0000", 2024-09-13T06:41:18.579 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 72.186990082999998, 2024-09-13T06:41:18.579 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.002778825, 2024-09-13T06:41:18.579 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:18.579 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:18.579 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:18.579 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:18.579 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:18.579 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 37836 2024-09-13T06:41:18.579 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.580 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:18.580 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.580 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:18.580 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374929+0000", 2024-09-13T06:41:18.580 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:18.580 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.580 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.580 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:18.580 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374929+0000", 2024-09-13T06:41:18.580 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:18.580 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.581 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.581 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:18.581 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374927+0000", 2024-09-13T06:41:18.581 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999981 2024-09-13T06:41:18.581 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.581 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.581 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:18.581 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374939+0000", 2024-09-13T06:41:18.581 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1846e-05 2024-09-13T06:41:18.581 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.581 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.581 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:18.581 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374962+0000", 2024-09-13T06:41:18.581 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3054e-05 2024-09-13T06:41:18.582 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.582 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.582 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:18.582 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374978+0000", 2024-09-13T06:41:18.582 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5899000000000001e-05 2024-09-13T06:41:18.582 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.582 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.582 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:18.582 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.375106+0000", 2024-09-13T06:41:18.582 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00012789 2024-09-13T06:41:18.582 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.582 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.582 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:41:18.583 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.375134+0000", 2024-09-13T06:41:18.583 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.8254000000000001e-05 2024-09-13T06:41:18.583 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.583 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.583 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:18.583 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.377082+0000", 2024-09-13T06:41:18.583 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0019471520000001 2024-09-13T06:41:18.583 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.583 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.583 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:18.583 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.377330+0000", 2024-09-13T06:41:18.583 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00024834199999999997 2024-09-13T06:41:18.583 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.584 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.584 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:18.584 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.377708+0000", 2024-09-13T06:41:18.584 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00037817100000000001 2024-09-13T06:41:18.584 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:18.584 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:18.584 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:18.584 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.584 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.584 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:37851 3.9 3:951cb95b:::rbd_data.1121d8143c6e.0000000000000002:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e56)", 2024-09-13T06:41:18.584 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:06.382636+0000", 2024-09-13T06:41:18.584 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 72.179283197999993, 2024-09-13T06:41:18.584 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.99582539400000003, 2024-09-13T06:41:18.584 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:18.585 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:18.585 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:18.585 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:18.585 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:18.585 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 37851 2024-09-13T06:41:18.585 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.585 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:18.585 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.585 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:18.585 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.382636+0000", 2024-09-13T06:41:18.585 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:18.585 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.585 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.585 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:18.586 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.382636+0000", 2024-09-13T06:41:18.586 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:18.586 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.586 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.586 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:18.586 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.382633+0000", 2024-09-13T06:41:18.586 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999971 2024-09-13T06:41:18.586 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.586 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.586 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:18.586 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.382652+0000", 2024-09-13T06:41:18.586 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8834999999999998e-05 2024-09-13T06:41:18.586 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.587 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.587 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:18.587 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.382695+0000", 2024-09-13T06:41:18.587 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.3136000000000002e-05 2024-09-13T06:41:18.587 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.587 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.587 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:18.587 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.382716+0000", 2024-09-13T06:41:18.587 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1421e-05 2024-09-13T06:41:18.587 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.587 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.587 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:18.587 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.382860+0000", 2024-09-13T06:41:18.588 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00014389200000000001 2024-09-13T06:41:18.588 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.588 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.588 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:41:18.588 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.382890+0000", 2024-09-13T06:41:18.588 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9827000000000001e-05 2024-09-13T06:41:18.588 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.588 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.588 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:18.588 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.377779+0000", 2024-09-13T06:41:18.588 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.99488842899999996 2024-09-13T06:41:18.588 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.588 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.589 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:18.589 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.378007+0000", 2024-09-13T06:41:18.589 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00022838099999999999 2024-09-13T06:41:18.589 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.589 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.589 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:18.589 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.378462+0000", 2024-09-13T06:41:18.589 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00045452300000000003 2024-09-13T06:41:18.589 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:18.589 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:18.589 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:18.589 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.589 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.590 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:37866 3.9 3:951cb95b:::rbd_data.1121d8143c6e.0000000000000002:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e56)", 2024-09-13T06:41:18.590 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:06.383951+0000", 2024-09-13T06:41:18.590 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 72.177968512000007, 2024-09-13T06:41:18.590 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.99517962299999996, 2024-09-13T06:41:18.590 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:18.590 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:18.590 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:18.590 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:18.590 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:18.590 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 37866 2024-09-13T06:41:18.590 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.590 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:18.590 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.590 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:18.591 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.383951+0000", 2024-09-13T06:41:18.591 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:18.591 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.591 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.591 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:18.591 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.383951+0000", 2024-09-13T06:41:18.591 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:18.591 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.591 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.591 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:18.591 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.383949+0000", 2024-09-13T06:41:18.591 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999981 2024-09-13T06:41:18.591 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.592 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.592 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:18.592 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.383961+0000", 2024-09-13T06:41:18.592 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1999e-05 2024-09-13T06:41:18.592 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.592 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.592 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:18.592 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384019+0000", 2024-09-13T06:41:18.592 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7621000000000003e-05 2024-09-13T06:41:18.592 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.592 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.592 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:18.592 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384040+0000", 2024-09-13T06:41:18.592 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1528000000000001e-05 2024-09-13T06:41:18.593 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.593 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.593 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:18.593 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384186+0000", 2024-09-13T06:41:18.593 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00014573799999999999 2024-09-13T06:41:18.593 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.593 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.593 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:41:18.593 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384204+0000", 2024-09-13T06:41:18.593 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7992e-05 2024-09-13T06:41:18.593 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.593 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.593 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:18.594 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.378536+0000", 2024-09-13T06:41:18.594 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.99433268600000002 2024-09-13T06:41:18.594 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.594 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.594 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:18.594 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.378771+0000", 2024-09-13T06:41:18.594 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00023445399999999999 2024-09-13T06:41:18.594 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.594 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.594 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:18.594 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.379130+0000", 2024-09-13T06:41:18.594 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00035954200000000002 2024-09-13T06:41:18.594 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:18.595 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:18.595 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:18.595 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.595 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.595 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:37881 3.9 3:951cb95b:::rbd_data.1121d8143c6e.0000000000000002:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e56)", 2024-09-13T06:41:18.595 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:06.384239+0000", 2024-09-13T06:41:18.595 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 72.177680097999996, 2024-09-13T06:41:18.595 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.99541483500000005, 2024-09-13T06:41:18.595 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:18.595 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:18.595 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:18.595 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:18.595 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:18.595 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 37881 2024-09-13T06:41:18.596 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.596 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:18.596 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.596 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:18.596 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384239+0000", 2024-09-13T06:41:18.596 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:18.596 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.596 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.596 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:18.596 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384239+0000", 2024-09-13T06:41:18.596 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:18.596 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.597 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.597 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:18.597 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384238+0000", 2024-09-13T06:41:18.597 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999986 2024-09-13T06:41:18.597 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.597 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.597 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:18.597 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384246+0000", 2024-09-13T06:41:18.597 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.2449999999999998e-06 2024-09-13T06:41:18.597 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.597 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.597 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:18.597 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384268+0000", 2024-09-13T06:41:18.597 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1518e-05 2024-09-13T06:41:18.598 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.598 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.598 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:18.598 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384282+0000", 2024-09-13T06:41:18.598 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4501999999999999e-05 2024-09-13T06:41:18.598 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.598 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.598 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:18.598 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384356+0000", 2024-09-13T06:41:18.598 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4265999999999997e-05 2024-09-13T06:41:18.598 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.598 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.598 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:41:18.599 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384370+0000", 2024-09-13T06:41:18.599 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3942e-05 2024-09-13T06:41:18.599 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.599 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.599 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:18.599 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.379199+0000", 2024-09-13T06:41:18.599 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.99482866599999997 2024-09-13T06:41:18.599 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.599 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.599 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:18.599 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.379347+0000", 2024-09-13T06:41:18.599 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00014749199999999999 2024-09-13T06:41:18.599 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.600 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.600 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:18.600 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.379654+0000", 2024-09-13T06:41:18.600 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00030752999999999998 2024-09-13T06:41:18.600 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:18.600 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:18.600 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:18.600 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.600 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.600 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:37896 3.9 3:951cb95b:::rbd_data.1121d8143c6e.0000000000000002:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e56)", 2024-09-13T06:41:18.600 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:06.384412+0000", 2024-09-13T06:41:18.600 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 72.177507664999993, 2024-09-13T06:41:18.600 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.99777835999999998, 2024-09-13T06:41:18.600 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:18.601 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:18.601 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:18.601 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:18.601 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:18.601 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 37896 2024-09-13T06:41:18.601 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.601 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:18.601 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.601 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:18.601 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384412+0000", 2024-09-13T06:41:18.601 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:18.601 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.601 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.602 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:18.602 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384412+0000", 2024-09-13T06:41:18.602 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:18.602 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.602 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.602 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:18.602 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384410+0000", 2024-09-13T06:41:18.602 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.999999 2024-09-13T06:41:18.602 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.602 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.602 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:18.602 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384418+0000", 2024-09-13T06:41:18.602 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.486e-06 2024-09-13T06:41:18.602 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.602 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.603 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:18.603 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384436+0000", 2024-09-13T06:41:18.603 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7668000000000001e-05 2024-09-13T06:41:18.603 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.603 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.603 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:18.603 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384449+0000", 2024-09-13T06:41:18.603 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3395e-05 2024-09-13T06:41:18.603 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.603 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.603 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:18.603 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384605+0000", 2024-09-13T06:41:18.603 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00015563099999999999 2024-09-13T06:41:18.603 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.604 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.604 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:41:18.604 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384635+0000", 2024-09-13T06:41:18.604 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.0383999999999999e-05 2024-09-13T06:41:18.604 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.604 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.604 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:18.604 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.379730+0000", 2024-09-13T06:41:18.604 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.99509493999999998 2024-09-13T06:41:18.604 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.604 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.604 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:18.604 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.379964+0000", 2024-09-13T06:41:18.605 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00023353499999999999 2024-09-13T06:41:18.605 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.605 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.605 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:18.605 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.382190+0000", 2024-09-13T06:41:18.605 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0022265039999999998 2024-09-13T06:41:18.605 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:18.605 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:18.605 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:18.605 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.605 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.605 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43222 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 389120~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:18.605 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558181+0000", 2024-09-13T06:41:18.605 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 57.003738411, 2024-09-13T06:41:18.606 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.06252038, 2024-09-13T06:41:18.606 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:18.606 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:18.606 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:18.606 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:18.606 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:18.606 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43222 2024-09-13T06:41:18.606 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.606 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:18.606 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.606 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:18.606 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558181+0000", 2024-09-13T06:41:18.606 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:18.607 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.607 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.607 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:18.607 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558181+0000", 2024-09-13T06:41:18.607 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:18.607 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.607 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.607 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:18.607 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558181+0000", 2024-09-13T06:41:18.607 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:18.607 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.607 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.607 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:18.608 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558183+0000", 2024-09-13T06:41:18.608 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.857e-06 2024-09-13T06:41:18.608 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.608 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.608 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:18.608 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558188+0000", 2024-09-13T06:41:18.608 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3759999999999999e-06 2024-09-13T06:41:18.608 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.608 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.608 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:18.608 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558261+0000", 2024-09-13T06:41:18.608 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3097999999999997e-05 2024-09-13T06:41:18.608 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.608 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.609 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:18.609 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.620354+0000", 2024-09-13T06:41:18.609 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.062092587999999997 2024-09-13T06:41:18.609 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.609 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.609 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:18.609 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.620428+0000", 2024-09-13T06:41:18.609 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3954000000000004e-05 2024-09-13T06:41:18.609 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.609 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.609 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:18.609 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.620701+0000", 2024-09-13T06:41:18.610 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000273773 2024-09-13T06:41:18.610 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:18.610 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:18.610 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:18.610 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.610 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.610 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43223 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 393216~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:18.610 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558267+0000", 2024-09-13T06:41:18.610 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 57.003652354000003, 2024-09-13T06:41:18.610 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.062813151999999997, 2024-09-13T06:41:18.610 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:18.610 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:18.610 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:18.610 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:18.611 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:18.611 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43223 2024-09-13T06:41:18.611 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.611 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:18.611 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.611 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:18.611 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558267+0000", 2024-09-13T06:41:18.611 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:18.611 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.611 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.611 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:18.611 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558267+0000", 2024-09-13T06:41:18.611 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:18.611 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.612 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.612 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:18.612 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558266+0000", 2024-09-13T06:41:18.612 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:18.612 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.612 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.612 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:18.612 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558270+0000", 2024-09-13T06:41:18.612 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.2389999999999998e-06 2024-09-13T06:41:18.612 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.613 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.613 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:18.613 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558277+0000", 2024-09-13T06:41:18.613 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5680000000000002e-06 2024-09-13T06:41:18.613 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.613 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.613 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:18.613 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558282+0000", 2024-09-13T06:41:18.613 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7060000000000003e-06 2024-09-13T06:41:18.613 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.613 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.613 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:18.613 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.620731+0000", 2024-09-13T06:41:18.613 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.062448661000000003 2024-09-13T06:41:18.614 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.614 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.614 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:18.614 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.620806+0000", 2024-09-13T06:41:18.614 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5862e-05 2024-09-13T06:41:18.614 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.614 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.614 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:18.614 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.621080+0000", 2024-09-13T06:41:18.614 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00027368599999999998 2024-09-13T06:41:18.614 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:18.614 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:18.614 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:18.615 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.615 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.615 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43224 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 407552~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:18.615 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558286+0000", 2024-09-13T06:41:18.615 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 57.00363299, 2024-09-13T06:41:18.615 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.063179052999999999, 2024-09-13T06:41:18.615 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:18.615 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:18.615 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:18.615 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:18.615 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:18.615 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43224 2024-09-13T06:41:18.615 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.615 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:18.616 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.616 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:18.616 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558286+0000", 2024-09-13T06:41:18.616 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:18.616 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.616 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.616 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:18.616 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558286+0000", 2024-09-13T06:41:18.616 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:18.616 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.616 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.616 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:18.616 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558286+0000", 2024-09-13T06:41:18.617 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:18.617 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.617 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.617 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:18.617 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558288+0000", 2024-09-13T06:41:18.617 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.227e-06 2024-09-13T06:41:18.617 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.617 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.617 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:18.617 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558292+0000", 2024-09-13T06:41:18.617 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.6289999999999999e-06 2024-09-13T06:41:18.617 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.617 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.617 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:18.618 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558294+0000", 2024-09-13T06:41:18.618 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5409999999999999e-06 2024-09-13T06:41:18.618 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.618 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.618 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:18.618 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.621110+0000", 2024-09-13T06:41:18.618 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.062815776000000004 2024-09-13T06:41:18.618 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.618 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.618 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:18.618 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.621186+0000", 2024-09-13T06:41:18.618 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5570999999999999e-05 2024-09-13T06:41:18.619 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.619 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.619 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:18.619 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.621465+0000", 2024-09-13T06:41:18.619 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00027988200000000001 2024-09-13T06:41:18.619 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:18.619 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:18.619 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:18.619 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.619 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.619 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43225 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 421888~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:18.619 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558296+0000", 2024-09-13T06:41:18.619 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 57.003623023000003, 2024-09-13T06:41:18.619 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.063551110999999993, 2024-09-13T06:41:18.620 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:18.620 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:18.620 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:18.620 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:18.620 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:18.620 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43225 2024-09-13T06:41:18.620 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.620 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:18.620 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.620 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:18.620 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558296+0000", 2024-09-13T06:41:18.620 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:18.620 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.621 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.621 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:18.621 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558296+0000", 2024-09-13T06:41:18.621 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:18.621 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.621 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.621 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:18.621 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558296+0000", 2024-09-13T06:41:18.621 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:41:18.621 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.621 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.621 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:18.621 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558305+0000", 2024-09-13T06:41:18.621 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.5290000000000008e-06 2024-09-13T06:41:18.622 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.622 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.622 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:18.622 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558308+0000", 2024-09-13T06:41:18.622 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.5619999999999999e-06 2024-09-13T06:41:18.622 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.622 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.622 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:18.622 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558311+0000", 2024-09-13T06:41:18.622 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.43e-06 2024-09-13T06:41:18.622 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.622 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.623 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:18.623 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.621495+0000", 2024-09-13T06:41:18.623 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.063184289000000005 2024-09-13T06:41:18.623 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.623 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.623 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:18.623 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.621569+0000", 2024-09-13T06:41:18.623 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4250000000000002e-05 2024-09-13T06:41:18.623 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.623 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.623 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:18.623 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.621847+0000", 2024-09-13T06:41:18.624 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00027826400000000002 2024-09-13T06:41:18.624 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:18.624 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:18.624 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:18.624 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.624 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.624 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43226 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 436224~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:18.624 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558313+0000", 2024-09-13T06:41:18.624 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 57.003606386999998, 2024-09-13T06:41:18.624 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.063914420999999999, 2024-09-13T06:41:18.624 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:18.624 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:18.624 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:18.625 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:18.625 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:18.625 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43226 2024-09-13T06:41:18.625 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.625 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:18.625 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.625 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:18.625 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558313+0000", 2024-09-13T06:41:18.625 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:18.625 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.625 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.625 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:18.625 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558313+0000", 2024-09-13T06:41:18.626 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:18.626 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.626 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.626 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:18.626 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558313+0000", 2024-09-13T06:41:18.626 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:18.626 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.626 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.626 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:18.626 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558314+0000", 2024-09-13T06:41:18.626 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3740000000000001e-06 2024-09-13T06:41:18.626 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.626 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.627 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:18.627 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558317+0000", 2024-09-13T06:41:18.627 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9730000000000002e-06 2024-09-13T06:41:18.627 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.627 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.627 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:18.627 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558319+0000", 2024-09-13T06:41:18.627 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4059999999999999e-06 2024-09-13T06:41:18.627 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.627 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.627 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:18.627 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.621877+0000", 2024-09-13T06:41:18.627 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.063557408999999995 2024-09-13T06:41:18.627 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.628 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.628 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:18.628 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.621951+0000", 2024-09-13T06:41:18.628 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4487999999999996e-05 2024-09-13T06:41:18.628 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.628 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.628 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:18.628 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.622227+0000", 2024-09-13T06:41:18.628 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000276011 2024-09-13T06:41:18.628 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:18.628 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:18.628 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:18.628 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.629 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.629 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43227 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 450560~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:18.629 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558322+0000", 2024-09-13T06:41:18.629 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 57.003597806000002, 2024-09-13T06:41:18.629 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.064285348000000006, 2024-09-13T06:41:18.629 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:18.629 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:18.629 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:18.629 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:18.629 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:18.629 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43227 2024-09-13T06:41:18.629 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.629 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:18.629 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.630 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:18.630 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558322+0000", 2024-09-13T06:41:18.630 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:18.630 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.630 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.630 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:18.630 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558322+0000", 2024-09-13T06:41:18.630 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:18.630 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.630 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.630 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:18.630 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558321+0000", 2024-09-13T06:41:18.630 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:41:18.630 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.631 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.631 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:18.631 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558323+0000", 2024-09-13T06:41:18.631 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.576e-06 2024-09-13T06:41:18.631 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.631 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.631 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:18.631 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558328+0000", 2024-09-13T06:41:18.631 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0719999999999999e-06 2024-09-13T06:41:18.631 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.631 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.631 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:18.631 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558332+0000", 2024-09-13T06:41:18.631 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.8130000000000002e-06 2024-09-13T06:41:18.632 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.632 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.632 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:18.632 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.622255+0000", 2024-09-13T06:41:18.632 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.063923195000000002 2024-09-13T06:41:18.632 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.632 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.632 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:18.632 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.622330+0000", 2024-09-13T06:41:18.632 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5383000000000007e-05 2024-09-13T06:41:18.632 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.632 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.632 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:18.633 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.622607+0000", 2024-09-13T06:41:18.633 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00027651999999999999 2024-09-13T06:41:18.633 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:18.633 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:18.633 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:18.633 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.633 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.633 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43228 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 464896~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:18.633 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558335+0000", 2024-09-13T06:41:18.633 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 57.003583896999999, 2024-09-13T06:41:18.633 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.064652253000000007, 2024-09-13T06:41:18.633 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:18.633 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:18.634 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:18.634 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:18.634 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:18.634 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43228 2024-09-13T06:41:18.634 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.634 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:18.634 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.634 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:18.634 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558335+0000", 2024-09-13T06:41:18.634 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:18.634 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.634 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.634 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:18.634 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558335+0000", 2024-09-13T06:41:18.635 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:18.635 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.635 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.635 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:18.635 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558335+0000", 2024-09-13T06:41:18.635 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:18.635 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.635 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.635 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:18.635 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558337+0000", 2024-09-13T06:41:18.635 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1380000000000001e-06 2024-09-13T06:41:18.635 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.635 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.635 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:18.635 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558343+0000", 2024-09-13T06:41:18.636 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.5140000000000001e-06 2024-09-13T06:41:18.636 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.636 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.636 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:18.636 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558348+0000", 2024-09-13T06:41:18.636 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9640000000000002e-06 2024-09-13T06:41:18.636 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.636 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.636 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:18.636 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.622636+0000", 2024-09-13T06:41:18.636 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.064288260999999999 2024-09-13T06:41:18.636 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.636 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.637 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:18.637 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.622715+0000", 2024-09-13T06:41:18.637 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.9351000000000006e-05 2024-09-13T06:41:18.637 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.637 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.637 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:18.637 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.622988+0000", 2024-09-13T06:41:18.637 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00027242599999999998 2024-09-13T06:41:18.637 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:18.637 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:18.637 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:18.637 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.637 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.638 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43229 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 479232~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:18.638 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558352+0000", 2024-09-13T06:41:18.638 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 57.003567482000001, 2024-09-13T06:41:18.638 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.065018024999999993, 2024-09-13T06:41:18.638 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:18.638 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:18.638 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:18.638 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:18.638 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:18.638 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43229 2024-09-13T06:41:18.638 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.638 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:18.638 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.638 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:18.638 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558352+0000", 2024-09-13T06:41:18.639 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:18.639 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.639 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.639 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:18.639 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558352+0000", 2024-09-13T06:41:18.639 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:18.639 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.639 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.639 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:18.639 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558352+0000", 2024-09-13T06:41:18.639 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:18.639 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.639 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.639 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:18.640 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558354+0000", 2024-09-13T06:41:18.640 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4930000000000001e-06 2024-09-13T06:41:18.640 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.640 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.640 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:18.640 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558360+0000", 2024-09-13T06:41:18.640 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.263e-06 2024-09-13T06:41:18.640 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.640 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.640 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:18.640 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558369+0000", 2024-09-13T06:41:18.640 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.0829999999999993e-06 2024-09-13T06:41:18.640 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.641 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.641 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:18.641 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.623017+0000", 2024-09-13T06:41:18.641 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.064647799000000006 2024-09-13T06:41:18.641 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.641 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.641 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:18.641 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.623090+0000", 2024-09-13T06:41:18.641 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3071000000000006e-05 2024-09-13T06:41:18.641 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.641 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.641 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:18.641 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.623370+0000", 2024-09-13T06:41:18.641 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000279661 2024-09-13T06:41:18.642 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:18.642 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:18.642 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:18.642 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.642 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.642 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43230 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 493568~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:18.642 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558374+0000", 2024-09-13T06:41:18.642 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 57.003545189, 2024-09-13T06:41:18.642 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.065410435000000003, 2024-09-13T06:41:18.642 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:18.642 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:18.642 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:18.642 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:18.643 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:18.643 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43230 2024-09-13T06:41:18.643 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.643 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:18.643 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.643 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:18.643 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558374+0000", 2024-09-13T06:41:18.643 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:18.643 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.643 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.643 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:18.643 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558374+0000", 2024-09-13T06:41:18.643 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:18.644 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.644 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.644 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:18.644 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558374+0000", 2024-09-13T06:41:18.644 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:18.644 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.644 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.644 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:18.644 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558376+0000", 2024-09-13T06:41:18.644 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4430000000000002e-06 2024-09-13T06:41:18.644 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.644 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.644 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:18.644 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558382+0000", 2024-09-13T06:41:18.645 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3029999999999996e-06 2024-09-13T06:41:18.645 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.645 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.645 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:18.645 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558387+0000", 2024-09-13T06:41:18.645 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.1699999999999999e-06 2024-09-13T06:41:18.645 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.645 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.645 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:18.645 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.623400+0000", 2024-09-13T06:41:18.645 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.065013244999999997 2024-09-13T06:41:18.645 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.645 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.645 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:18.646 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.623474+0000", 2024-09-13T06:41:18.646 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3889999999999999e-05 2024-09-13T06:41:18.646 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.646 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.646 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:18.646 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.623785+0000", 2024-09-13T06:41:18.646 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00031080099999999998 2024-09-13T06:41:18.646 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:18.646 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:18.646 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:18.646 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.646 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.646 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43231 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 507904~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:18.647 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558391+0000", 2024-09-13T06:41:18.647 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 57.003528504000002, 2024-09-13T06:41:18.647 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.065788597000000004, 2024-09-13T06:41:18.647 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:18.647 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:18.647 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:18.647 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:18.647 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:18.647 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43231 2024-09-13T06:41:18.647 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.647 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:18.647 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.647 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:18.648 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558391+0000", 2024-09-13T06:41:18.648 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:18.648 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.648 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.648 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:18.648 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558391+0000", 2024-09-13T06:41:18.648 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:18.648 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.648 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.648 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:18.648 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558390+0000", 2024-09-13T06:41:18.648 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:18.648 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.649 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.649 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:18.649 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558393+0000", 2024-09-13T06:41:18.649 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2570000000000002e-06 2024-09-13T06:41:18.649 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.649 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.649 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:18.649 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558399+0000", 2024-09-13T06:41:18.649 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0419999999999999e-06 2024-09-13T06:41:18.649 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.649 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.649 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:18.649 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558403+0000", 2024-09-13T06:41:18.650 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6249999999999998e-06 2024-09-13T06:41:18.650 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.650 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.650 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:18.650 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.623811+0000", 2024-09-13T06:41:18.650 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.065407549999999995 2024-09-13T06:41:18.650 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.650 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.650 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:18.650 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.623877+0000", 2024-09-13T06:41:18.650 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.5902999999999996e-05 2024-09-13T06:41:18.650 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.650 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.651 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:18.651 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.624179+0000", 2024-09-13T06:41:18.651 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00030259999999999998 2024-09-13T06:41:18.651 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:18.651 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:18.651 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:18.651 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.651 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.651 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43232 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 522240~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:18.651 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558422+0000", 2024-09-13T06:41:18.651 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 57.003497727000003, 2024-09-13T06:41:18.651 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.066176061999999994, 2024-09-13T06:41:18.651 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:18.651 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:18.652 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:18.652 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:18.652 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:18.652 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43232 2024-09-13T06:41:18.652 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.652 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:18.652 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.652 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:18.652 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558422+0000", 2024-09-13T06:41:18.652 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:18.652 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.652 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.652 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:18.653 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558422+0000", 2024-09-13T06:41:18.653 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:18.653 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.653 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.653 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:18.653 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558421+0000", 2024-09-13T06:41:18.653 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:18.653 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.653 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.653 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:18.653 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558428+0000", 2024-09-13T06:41:18.653 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.1690000000000003e-06 2024-09-13T06:41:18.653 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.654 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.654 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:18.654 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558434+0000", 2024-09-13T06:41:18.654 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9309999999999996e-06 2024-09-13T06:41:18.654 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.654 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.654 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:18.654 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558447+0000", 2024-09-13T06:41:18.654 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.271e-05 2024-09-13T06:41:18.654 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.654 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.654 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:18.654 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.624209+0000", 2024-09-13T06:41:18.655 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.065762102000000003 2024-09-13T06:41:18.655 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.655 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.655 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:18.655 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.624282+0000", 2024-09-13T06:41:18.655 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.2889e-05 2024-09-13T06:41:18.655 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.655 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.655 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:18.655 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.624598+0000", 2024-09-13T06:41:18.655 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00031591399999999998 2024-09-13T06:41:18.655 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:18.655 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:18.655 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:18.656 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.656 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.656 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43486 3.f 3:f7da9c8f:::rbd_data.1121f5f2e1c0.000000000000000b:1f [read 260096~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:18.656 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.569088+0000", 2024-09-13T06:41:18.656 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 56.992831004000003, 2024-09-13T06:41:18.656 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.062579223000000003, 2024-09-13T06:41:18.656 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:18.656 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:18.656 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:18.656 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:18.656 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:18.656 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43486 2024-09-13T06:41:18.656 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.657 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:18.657 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.657 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:18.657 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.569088+0000", 2024-09-13T06:41:18.657 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:18.657 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.657 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.657 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:18.657 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.569088+0000", 2024-09-13T06:41:18.657 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:18.657 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.657 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.658 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:18.658 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.569088+0000", 2024-09-13T06:41:18.658 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:18.658 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.658 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.658 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:18.658 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.569091+0000", 2024-09-13T06:41:18.658 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9629999999999998e-06 2024-09-13T06:41:18.658 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.658 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.658 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:18.658 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.569097+0000", 2024-09-13T06:41:18.659 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.4160000000000001e-06 2024-09-13T06:41:18.659 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.659 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.659 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:18.659 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.569102+0000", 2024-09-13T06:41:18.659 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6659999999999999e-06 2024-09-13T06:41:18.659 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.659 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.659 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:18.659 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.631346+0000", 2024-09-13T06:41:18.659 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.062243896 2024-09-13T06:41:18.659 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.659 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.659 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:18.660 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.631413+0000", 2024-09-13T06:41:18.660 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.7638000000000005e-05 2024-09-13T06:41:18.660 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:18.660 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:18.660 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:18.660 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.631668+0000", 2024-09-13T06:41:18.660 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0002541 2024-09-13T06:41:18.660 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:18.660 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:18.660 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:18.660 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:18.660 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:18.660 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:41:18.662 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-13T06:41:18.662 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:41:18.662+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:41:18.763 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:41:18.762+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:41:18.833 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:41:18.834 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-13T06:41:18.834 INFO:teuthology.orchestra.run.smithi081.stdout: "num_ops": 0 2024-09-13T06:41:18.834 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:41:18.849 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-13T06:41:18.864 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:41:18.863+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:41:18.897 INFO:teuthology.orchestra.run.smithi139.stderr:Exporting 3.16 info 3.16( v 121'221 (0'0,121'221] local-lis/les=103/104 n=16 ec=21/21 lis/c=103/103 les/c/f=104/104/0 sis=103) 2024-09-13T06:41:18.909 INFO:teuthology.orchestra.run.smithi139.stderr:Read #3:690a2724:::rbd_data.11213b441054.00000000000001d5:head# 2024-09-13T06:41:18.910 INFO:teuthology.orchestra.run.smithi139.stderr:Read #3:69175ab1:::rbd_data.1121f2c5ee81.0000000000000184:head# 2024-09-13T06:41:18.911 INFO:teuthology.orchestra.run.smithi139.stderr:Read #3:692d7d90:::rbd_data.11218ba71f0d.000000000000000f:head# 2024-09-13T06:41:18.913 INFO:teuthology.orchestra.run.smithi139.stderr:Read #3:69523913:::rbd_data.1121904e6c4a.0000000000000010:head# 2024-09-13T06:41:18.915 INFO:teuthology.orchestra.run.smithi139.stderr:Read #3:696341ca:::rbd_data.11217e777cf4.00000000000001c3:head# 2024-09-13T06:41:18.916 INFO:teuthology.orchestra.run.smithi139.stderr:Read #3:69b4bba6:::rbd_data.11213b441054.00000000000000e1:head# 2024-09-13T06:41:18.918 INFO:teuthology.orchestra.run.smithi139.stderr:Read #3:69d35907:::rbd_object_map.11214956a993:head# 2024-09-13T06:41:18.919 INFO:teuthology.orchestra.run.smithi139.stderr:Read #3:69d8a4e4:::rbd_data.11213b441054.0000000000000166:head# 2024-09-13T06:41:18.920 INFO:teuthology.orchestra.run.smithi139.stderr:Read #3:69e8ee25:::rbd_data.11213b441054.0000000000000160:head# 2024-09-13T06:41:18.922 INFO:teuthology.orchestra.run.smithi139.stderr:Read #3:69ebf46b:::rbd_data.1121f2c5ee81.0000000000000055:head# 2024-09-13T06:41:18.924 INFO:teuthology.orchestra.run.smithi139.stderr:Read #3:6b824d40:::rbd_data.11219660270d.0000000000000039:head# 2024-09-13T06:41:18.926 INFO:teuthology.orchestra.run.smithi139.stderr:Read #3:6b875e4a:::rbd_data.1121ffaf5446.0000000000000012:head# 2024-09-13T06:41:18.929 INFO:teuthology.orchestra.run.smithi139.stderr:Read #3:6e138532:::rbd_data.1121d8143c6e.000000000000000e:head# 2024-09-13T06:41:18.939 INFO:teuthology.orchestra.run.smithi139.stderr:Read #3:6e333f1a:::rbd_data.1121ffaf5446.0000000000000002:head# 2024-09-13T06:41:18.942 INFO:teuthology.orchestra.run.smithi139.stderr:Read #3:6e402199:::rbd_data.11211200685d.00000000000000d9:head# 2024-09-13T06:41:18.943 INFO:teuthology.orchestra.run.smithi139.stderr:Read #3:6f163858:::rbd_data.1121f2c5ee81.0000000000000132:head# 2024-09-13T06:41:18.944 INFO:teuthology.orchestra.run.smithi139.stderr:Export successful 2024-09-13T06:41:18.964 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:41:18.962+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:41:19.014 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:41:19.014 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-13T06:41:19.014 INFO:teuthology.orchestra.run.smithi081.stdout: "complaint_time": 30, 2024-09-13T06:41:19.014 INFO:teuthology.orchestra.run.smithi081.stdout: "num_blocked_ops": 0 2024-09-13T06:41:19.015 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:41:19.028 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-13T06:41:19.065 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:41:19.063+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:41:19.166 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:41:19.163+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:41:19.199 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:41:19.199 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 20, 2024-09-13T06:41:19.199 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 600, 2024-09-13T06:41:19.199 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [ 2024-09-13T06:41:19.199 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:19.199 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:2226 3.15 3:af026987:::rbd_data.112173e2f1b7.0000000000000017:head [sparse-read 0~4194304] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-13T06:41:19.200 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:37.606562+0000", 2024-09-13T06:41:19.200 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 101.591872391, 2024-09-13T06:41:19.200 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.83322091700000001, 2024-09-13T06:41:19.200 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:19.200 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:41:19.200 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:19.200 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:19.200 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:19.200 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 2226 2024-09-13T06:41:19.200 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:19.200 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:19.200 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:19.201 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:19.201 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606562+0000", 2024-09-13T06:41:19.201 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:19.201 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:19.201 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:19.201 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:19.201 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606562+0000", 2024-09-13T06:41:19.201 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:19.201 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:19.201 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:19.201 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:19.201 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606561+0000", 2024-09-13T06:41:19.201 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:19.202 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:19.202 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:19.202 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:19.202 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606565+0000", 2024-09-13T06:41:19.202 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.4379999999999999e-06 2024-09-13T06:41:19.202 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:19.202 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:19.202 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:19.202 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606569+0000", 2024-09-13T06:41:19.202 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.425e-06 2024-09-13T06:41:19.202 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:19.202 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:19.202 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:19.203 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606572+0000", 2024-09-13T06:41:19.203 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.05e-06 2024-09-13T06:41:19.203 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:19.203 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:19.203 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:19.203 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606621+0000", 2024-09-13T06:41:19.203 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.8723000000000001e-05 2024-09-13T06:41:19.203 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:19.203 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:19.203 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:41:19.203 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606630+0000", 2024-09-13T06:41:19.203 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.8040000000000007e-06 2024-09-13T06:41:19.203 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:19.204 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:19.204 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:19.204 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.439648+0000", 2024-09-13T06:41:19.204 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.83301824800000002 2024-09-13T06:41:19.204 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:19.204 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:19.204 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:19.204 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.439782+0000", 2024-09-13T06:41:19.204 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00013466699999999999 2024-09-13T06:41:19.204 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:19.204 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:19.204 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:19.204 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:19.205 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:19.205 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25661 3.8 3:1180686c:::rbd_data.1121f2c5ee81.0000000000000009:13 [read 397312~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:19.205 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.436956+0000", 2024-09-13T06:41:19.205 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 82.761477857000003, 2024-09-13T06:41:19.205 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089036758999999993, 2024-09-13T06:41:19.205 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:19.205 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:19.205 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:19.205 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:19.205 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:19.205 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25661 2024-09-13T06:41:19.205 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:19.205 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:19.205 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:19.206 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:19.206 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436956+0000", 2024-09-13T06:41:19.206 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:19.206 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:19.206 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:19.206 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:19.206 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436956+0000", 2024-09-13T06:41:19.206 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:19.206 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:19.206 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:19.206 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:19.206 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436956+0000", 2024-09-13T06:41:19.206 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:19.207 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:19.207 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:19.207 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:19.207 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436958+0000", 2024-09-13T06:41:19.207 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1770000000000001e-06 2024-09-13T06:41:19.207 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:19.207 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:19.207 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:19.207 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436963+0000", 2024-09-13T06:41:19.207 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.6489999999999996e-06 2024-09-13T06:41:19.207 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:19.207 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:19.207 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:19.208 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436975+0000", 2024-09-13T06:41:19.208 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1783999999999999e-05 2024-09-13T06:41:19.208 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:19.208 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:19.208 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:19.208 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.525671+0000", 2024-09-13T06:41:19.208 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.088696292999999995 2024-09-13T06:41:19.208 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:19.208 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:19.208 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:19.208 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.525749+0000", 2024-09-13T06:41:19.208 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.7589000000000005e-05 2024-09-13T06:41:19.208 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:19.209 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:19.209 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:19.209 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.525993+0000", 2024-09-13T06:41:19.209 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00024381000000000001 2024-09-13T06:41:19.209 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:19.209 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:19.209 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:19.209 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:19.209 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:19.209 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25662 3.8 3:1180686c:::rbd_data.1121f2c5ee81.0000000000000009:13 [read 421888~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:19.209 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.436980+0000", 2024-09-13T06:41:19.209 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 82.761453544999995, 2024-09-13T06:41:19.209 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089367577000000004, 2024-09-13T06:41:19.210 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:19.210 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:19.210 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:19.210 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:19.210 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:19.210 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25662 2024-09-13T06:41:19.210 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:19.210 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:19.210 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:19.210 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:19.210 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436980+0000", 2024-09-13T06:41:19.210 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:19.210 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:19.210 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:19.211 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:19.211 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436980+0000", 2024-09-13T06:41:19.211 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:19.211 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:19.211 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:19.211 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:19.211 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436980+0000", 2024-09-13T06:41:19.211 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:19.211 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:19.211 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:19.211 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:19.211 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436982+0000", 2024-09-13T06:41:19.211 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3989999999999998e-06 2024-09-13T06:41:19.212 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:19.212 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:19.212 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:19.212 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436988+0000", 2024-09-13T06:41:19.212 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0039999999999996e-06 2024-09-13T06:41:19.212 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:19.212 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:19.212 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:19.212 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436993+0000", 2024-09-13T06:41:19.212 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6090000000000003e-06 2024-09-13T06:41:19.212 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:19.212 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:19.212 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:19.213 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.526035+0000", 2024-09-13T06:41:19.213 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089042248000000004 2024-09-13T06:41:19.213 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:19.213 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:19.213 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:19.213 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.526111+0000", 2024-09-13T06:41:19.213 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5643999999999996e-05 2024-09-13T06:41:19.213 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:19.213 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:19.213 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:19.213 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.526348+0000", 2024-09-13T06:41:19.213 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00023705800000000001 2024-09-13T06:41:19.213 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:19.213 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:19.214 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:19.214 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:19.214 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:19.214 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25663 3.8 3:1180686c:::rbd_data.1121f2c5ee81.0000000000000009:13 [read 466944~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:19.214 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.436998+0000", 2024-09-13T06:41:19.214 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 82.761435898000002, 2024-09-13T06:41:19.214 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089730867000000006, 2024-09-13T06:41:19.214 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:19.214 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:19.214 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:19.214 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:19.214 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:19.214 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25663 2024-09-13T06:41:19.215 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:19.215 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:19.215 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:19.215 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:19.215 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436998+0000", 2024-09-13T06:41:19.215 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:19.215 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:19.215 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:19.215 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:19.215 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436998+0000", 2024-09-13T06:41:19.215 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:19.215 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:19.215 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:19.216 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:19.216 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436998+0000", 2024-09-13T06:41:19.216 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:19.216 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:19.216 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:19.216 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:19.216 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437000+0000", 2024-09-13T06:41:19.216 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0940000000000002e-06 2024-09-13T06:41:19.216 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:19.216 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:19.216 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:19.216 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437005+0000", 2024-09-13T06:41:19.216 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.604e-06 2024-09-13T06:41:19.216 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:19.217 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:19.217 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:19.217 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437032+0000", 2024-09-13T06:41:19.217 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6407e-05 2024-09-13T06:41:19.217 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:19.217 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:19.217 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:19.217 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.526363+0000", 2024-09-13T06:41:19.217 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089331456000000004 2024-09-13T06:41:19.217 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:19.217 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:19.217 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:19.217 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.526404+0000", 2024-09-13T06:41:19.218 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.0887999999999999e-05 2024-09-13T06:41:19.218 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:19.218 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:19.218 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:19.218 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.526729+0000", 2024-09-13T06:41:19.218 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00032486 2024-09-13T06:41:19.218 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:19.218 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:19.218 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:19.218 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:19.218 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:19.218 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25664 3.8 3:1180686c:::rbd_data.1121f2c5ee81.0000000000000009:13 [read 491520~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:19.218 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.437040+0000", 2024-09-13T06:41:19.218 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 82.761393983000005, 2024-09-13T06:41:19.219 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.090016650000000004, 2024-09-13T06:41:19.219 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:19.219 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:19.219 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:19.219 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:19.219 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:19.219 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25664 2024-09-13T06:41:19.219 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:19.219 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:19.219 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:19.219 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:19.219 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437040+0000", 2024-09-13T06:41:19.219 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:19.220 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:19.220 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:19.220 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:19.220 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437040+0000", 2024-09-13T06:41:19.220 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:19.220 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:19.220 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:19.220 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:19.220 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437039+0000", 2024-09-13T06:41:19.220 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:19.220 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:19.220 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:19.220 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:19.221 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437047+0000", 2024-09-13T06:41:19.221 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4839999999999998e-06 2024-09-13T06:41:19.221 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:19.221 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:19.221 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:19.221 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437054+0000", 2024-09-13T06:41:19.221 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.8299999999999998e-06 2024-09-13T06:41:19.221 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:19.221 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:19.221 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:19.221 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437060+0000", 2024-09-13T06:41:19.221 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.1510000000000001e-06 2024-09-13T06:41:19.221 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:19.222 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:19.222 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:19.222 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.526772+0000", 2024-09-13T06:41:19.222 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089711737999999999 2024-09-13T06:41:19.222 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:19.222 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:19.222 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:19.222 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.526848+0000", 2024-09-13T06:41:19.222 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5870000000000004e-05 2024-09-13T06:41:19.222 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:19.222 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:19.222 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:19.222 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.527057+0000", 2024-09-13T06:41:19.222 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000209106 2024-09-13T06:41:19.223 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:19.223 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:19.223 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:19.223 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:19.223 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:19.223 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25740 3.18 3:1c662b96:::rbd_data.1121f2c5ee81.0000000000000010:13 [read 200704~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:19.223 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443352+0000", 2024-09-13T06:41:19.223 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 82.755082307999999, 2024-09-13T06:41:19.223 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089068222000000002, 2024-09-13T06:41:19.223 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:19.223 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:19.223 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:19.223 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:19.223 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:19.224 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25740 2024-09-13T06:41:19.224 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:19.224 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:19.224 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:19.224 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:19.224 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443352+0000", 2024-09-13T06:41:19.224 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:19.224 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:19.224 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:19.224 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:19.224 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443352+0000", 2024-09-13T06:41:19.224 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:19.225 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:19.225 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:19.225 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:19.225 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443351+0000", 2024-09-13T06:41:19.225 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:19.225 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:19.225 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:19.225 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:19.225 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443354+0000", 2024-09-13T06:41:19.225 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.841e-06 2024-09-13T06:41:19.225 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:19.225 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:19.225 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:19.226 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443361+0000", 2024-09-13T06:41:19.226 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.0010000000000004e-06 2024-09-13T06:41:19.226 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:19.226 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:19.226 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:19.226 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443366+0000", 2024-09-13T06:41:19.226 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7119999999999999e-06 2024-09-13T06:41:19.226 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:19.226 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:19.226 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:19.226 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532117+0000", 2024-09-13T06:41:19.226 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.088751327000000005 2024-09-13T06:41:19.226 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:19.226 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:19.227 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:19.227 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532193+0000", 2024-09-13T06:41:19.227 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5839000000000004e-05 2024-09-13T06:41:19.227 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:19.227 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:19.227 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:19.227 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532420+0000", 2024-09-13T06:41:19.227 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00022691000000000001 2024-09-13T06:41:19.227 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:19.227 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:19.227 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:19.228 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:19.228 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:19.228 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25741 3.18 3:1c662b96:::rbd_data.1121f2c5ee81.0000000000000010:13 [read 225280~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:19.228 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443378+0000", 2024-09-13T06:41:19.228 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 82.755055541000004, 2024-09-13T06:41:19.228 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089324107, 2024-09-13T06:41:19.228 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:19.228 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:19.228 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:19.228 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:19.228 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:19.228 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25741 2024-09-13T06:41:19.229 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:19.229 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:19.229 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:19.229 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:19.229 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443378+0000", 2024-09-13T06:41:19.229 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:19.229 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:19.229 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:19.229 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:19.229 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443378+0000", 2024-09-13T06:41:19.229 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:19.229 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:19.230 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:19.230 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:19.230 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443378+0000", 2024-09-13T06:41:19.230 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:19.230 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:19.230 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:19.230 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:19.230 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443380+0000", 2024-09-13T06:41:19.230 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3549999999999999e-06 2024-09-13T06:41:19.230 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:19.230 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:19.230 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:19.230 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443388+0000", 2024-09-13T06:41:19.230 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.7449999999999995e-06 2024-09-13T06:41:19.231 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:19.231 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:19.231 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:19.231 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443393+0000", 2024-09-13T06:41:19.231 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.4e-06 2024-09-13T06:41:19.231 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:19.231 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:19.231 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:19.231 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532454+0000", 2024-09-13T06:41:19.231 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089060941000000005 2024-09-13T06:41:19.231 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:19.231 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:19.231 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:19.232 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532512+0000", 2024-09-13T06:41:19.232 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7763000000000002e-05 2024-09-13T06:41:19.232 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:19.232 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:19.232 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:19.232 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532703+0000", 2024-09-13T06:41:19.232 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000190328 2024-09-13T06:41:19.232 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:19.232 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:19.232 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:19.232 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:19.232 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:19.233 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25742 3.18 3:1c662b96:::rbd_data.1121f2c5ee81.0000000000000010:13 [read 270336~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:19.233 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443398+0000", 2024-09-13T06:41:19.233 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 82.755035828999993, 2024-09-13T06:41:19.233 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089621836999999996, 2024-09-13T06:41:19.233 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:19.233 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:19.233 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:19.233 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:19.233 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:19.233 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25742 2024-09-13T06:41:19.233 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:19.233 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:19.233 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:19.234 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:19.234 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443398+0000", 2024-09-13T06:41:19.234 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:19.234 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:19.234 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:19.234 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:19.234 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443398+0000", 2024-09-13T06:41:19.234 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:19.234 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:19.234 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:19.234 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:19.234 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443398+0000", 2024-09-13T06:41:19.234 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:19.235 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:19.235 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:19.235 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:19.235 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443400+0000", 2024-09-13T06:41:19.235 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1849999999999998e-06 2024-09-13T06:41:19.235 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:19.235 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:19.235 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:19.235 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443407+0000", 2024-09-13T06:41:19.235 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3669999999999999e-06 2024-09-13T06:41:19.235 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:19.235 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:19.235 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:19.236 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443420+0000", 2024-09-13T06:41:19.236 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2645e-05 2024-09-13T06:41:19.236 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:19.236 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:19.236 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:19.236 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532742+0000", 2024-09-13T06:41:19.236 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089322200000000004 2024-09-13T06:41:19.236 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:19.236 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:19.236 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:19.236 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532818+0000", 2024-09-13T06:41:19.236 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.6019000000000005e-05 2024-09-13T06:41:19.236 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:19.237 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:19.237 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:19.237 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533020+0000", 2024-09-13T06:41:19.237 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000201721 2024-09-13T06:41:19.237 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:19.237 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:19.237 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:19.237 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:19.237 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:19.237 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25743 3.18 3:1c662b96:::rbd_data.1121f2c5ee81.0000000000000010:13 [read 294912~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:19.237 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443425+0000", 2024-09-13T06:41:19.237 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 82.755008821000004, 2024-09-13T06:41:19.238 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089864075000000002, 2024-09-13T06:41:19.238 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:19.238 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:19.238 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:19.238 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:19.238 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:19.238 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25743 2024-09-13T06:41:19.238 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:19.238 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:19.238 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:19.238 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:19.238 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443425+0000", 2024-09-13T06:41:19.238 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:19.238 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:19.239 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:19.239 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:19.239 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443425+0000", 2024-09-13T06:41:19.239 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:19.239 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:19.239 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:19.239 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:19.239 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443425+0000", 2024-09-13T06:41:19.239 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:19.239 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:19.239 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:19.239 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:19.239 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443432+0000", 2024-09-13T06:41:19.239 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3420000000000002e-06 2024-09-13T06:41:19.240 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:19.240 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:19.240 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:19.240 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443440+0000", 2024-09-13T06:41:19.240 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5689999999999999e-06 2024-09-13T06:41:19.240 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:19.240 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:19.240 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:19.240 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443445+0000", 2024-09-13T06:41:19.240 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9590000000000003e-06 2024-09-13T06:41:19.240 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:19.240 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:19.240 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:19.241 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533063+0000", 2024-09-13T06:41:19.241 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089617988999999995 2024-09-13T06:41:19.241 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:19.241 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:19.241 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:19.241 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533122+0000", 2024-09-13T06:41:19.241 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9052999999999999e-05 2024-09-13T06:41:19.241 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:19.241 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:19.241 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:19.241 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533289+0000", 2024-09-13T06:41:19.241 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00016752800000000001 2024-09-13T06:41:19.241 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:19.242 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:19.242 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:19.242 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:19.242 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:19.242 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25744 3.18 3.69d46638 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:19.242 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443449+0000", 2024-09-13T06:41:19.242 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 82.754984673999999, 2024-09-13T06:41:19.242 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089869148999999995, 2024-09-13T06:41:19.242 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:19.242 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:41:19.242 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:19.242 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:19.242 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:19.242 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25744 2024-09-13T06:41:19.243 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:19.243 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:19.243 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:19.243 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:19.243 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443449+0000", 2024-09-13T06:41:19.243 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:19.243 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:19.243 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:19.243 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:19.243 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443449+0000", 2024-09-13T06:41:19.243 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:19.243 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:19.243 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:19.244 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:19.244 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443449+0000", 2024-09-13T06:41:19.244 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:19.244 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:19.244 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:19.244 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:19.244 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443451+0000", 2024-09-13T06:41:19.244 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.244e-06 2024-09-13T06:41:19.244 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:19.244 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:19.244 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:19.244 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443457+0000", 2024-09-13T06:41:19.244 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.66e-06 2024-09-13T06:41:19.245 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:19.245 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:19.245 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:19.245 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443461+0000", 2024-09-13T06:41:19.245 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5449999999999997e-06 2024-09-13T06:41:19.245 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:19.245 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:19.245 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:19.245 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533311+0000", 2024-09-13T06:41:19.245 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089849729000000003 2024-09-13T06:41:19.245 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:19.245 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:19.245 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:19.246 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533318+0000", 2024-09-13T06:41:19.246 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.328e-06 2024-09-13T06:41:19.246 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:19.246 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:19.246 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:19.246 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:19.246 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:19.246 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25745 3.18 3.69d46638 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:19.246 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443466+0000", 2024-09-13T06:41:19.246 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 82.754967616000002, 2024-09-13T06:41:19.246 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089886743000000005, 2024-09-13T06:41:19.246 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:19.246 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:41:19.247 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:19.247 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:19.247 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:19.247 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25745 2024-09-13T06:41:19.247 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:19.247 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:19.247 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:19.247 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:19.247 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443466+0000", 2024-09-13T06:41:19.247 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:19.247 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:19.247 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:19.247 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:19.248 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443466+0000", 2024-09-13T06:41:19.248 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:19.248 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:19.248 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:19.248 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:19.248 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443466+0000", 2024-09-13T06:41:19.248 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:19.248 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:19.248 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:19.248 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:19.248 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443474+0000", 2024-09-13T06:41:19.248 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.1289999999999996e-06 2024-09-13T06:41:19.248 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:19.249 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:19.249 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:19.249 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443484+0000", 2024-09-13T06:41:19.249 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0654e-05 2024-09-13T06:41:19.249 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:19.249 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:19.249 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:19.249 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443490+0000", 2024-09-13T06:41:19.249 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8030000000000002e-06 2024-09-13T06:41:19.249 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:19.249 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:19.249 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:19.249 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533348+0000", 2024-09-13T06:41:19.249 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089857267000000005 2024-09-13T06:41:19.250 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:19.250 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:19.250 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:19.250 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533353+0000", 2024-09-13T06:41:19.250 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.5520000000000004e-06 2024-09-13T06:41:19.250 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:19.250 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:19.250 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:19.250 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:19.250 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:19.250 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25746 3.18 3.69d46638 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:19.250 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443495+0000", 2024-09-13T06:41:19.250 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 82.754938503000005, 2024-09-13T06:41:19.250 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089903725000000004, 2024-09-13T06:41:19.251 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:19.251 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:41:19.251 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:19.251 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:19.251 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:19.251 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25746 2024-09-13T06:41:19.251 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:19.251 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:19.251 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:19.251 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:19.251 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443495+0000", 2024-09-13T06:41:19.251 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:19.251 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:19.252 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:19.252 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:19.252 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443495+0000", 2024-09-13T06:41:19.252 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:19.252 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:19.252 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:19.252 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:19.252 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443495+0000", 2024-09-13T06:41:19.252 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:19.252 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:19.252 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:19.252 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:19.252 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443498+0000", 2024-09-13T06:41:19.253 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.7690000000000001e-06 2024-09-13T06:41:19.253 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:19.253 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:19.253 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:19.253 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443504+0000", 2024-09-13T06:41:19.253 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9710000000000001e-06 2024-09-13T06:41:19.253 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:19.253 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:19.253 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:19.253 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443508+0000", 2024-09-13T06:41:19.253 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4159999999999997e-06 2024-09-13T06:41:19.253 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:19.253 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:19.253 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:19.254 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533391+0000", 2024-09-13T06:41:19.254 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089882607000000003 2024-09-13T06:41:19.254 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:19.254 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:19.254 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:19.254 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533399+0000", 2024-09-13T06:41:19.254 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.4349999999999997e-06 2024-09-13T06:41:19.254 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:19.254 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:19.254 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:19.254 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:19.254 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:19.254 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25747 3.8 3.63996268 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:19.254 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443512+0000", 2024-09-13T06:41:19.255 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 82.754921772000003, 2024-09-13T06:41:19.255 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089880075000000004, 2024-09-13T06:41:19.255 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:19.255 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:41:19.255 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:19.255 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:19.255 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:19.255 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25747 2024-09-13T06:41:19.255 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:19.255 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:19.255 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:19.255 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:19.255 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443512+0000", 2024-09-13T06:41:19.256 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:19.256 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:19.256 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:19.256 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:19.256 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443512+0000", 2024-09-13T06:41:19.256 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:19.256 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:19.256 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:19.256 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:19.256 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443512+0000", 2024-09-13T06:41:19.256 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:19.256 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:19.256 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:19.256 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:19.257 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443514+0000", 2024-09-13T06:41:19.257 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0980000000000001e-06 2024-09-13T06:41:19.257 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:19.257 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:19.257 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:19.257 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443520+0000", 2024-09-13T06:41:19.257 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7069999999999997e-06 2024-09-13T06:41:19.257 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:19.257 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:19.257 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:19.257 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443524+0000", 2024-09-13T06:41:19.257 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5390000000000001e-06 2024-09-13T06:41:19.257 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:19.258 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:19.258 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:19.258 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533384+0000", 2024-09-13T06:41:19.258 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089859684999999995 2024-09-13T06:41:19.258 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:19.258 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:19.258 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:19.258 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533392+0000", 2024-09-13T06:41:19.258 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.3440000000000001e-06 2024-09-13T06:41:19.258 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:19.258 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:19.258 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:19.258 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:19.259 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:19.259 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25748 3.8 3.63996268 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:19.259 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443528+0000", 2024-09-13T06:41:19.259 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 82.754905644999994, 2024-09-13T06:41:19.259 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089890715999999996, 2024-09-13T06:41:19.259 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:19.259 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:41:19.259 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:19.259 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:19.259 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:19.259 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25748 2024-09-13T06:41:19.259 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:19.259 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:19.259 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:19.260 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:19.260 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443528+0000", 2024-09-13T06:41:19.260 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:19.260 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:19.260 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:19.260 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:19.260 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443528+0000", 2024-09-13T06:41:19.260 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:19.260 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:19.260 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:19.260 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:19.260 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443528+0000", 2024-09-13T06:41:19.260 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:19.261 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:19.261 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:19.261 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:19.261 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443530+0000", 2024-09-13T06:41:19.261 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0650000000000001e-06 2024-09-13T06:41:19.261 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:19.261 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:19.261 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:19.261 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443536+0000", 2024-09-13T06:41:19.261 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7259999999999999e-06 2024-09-13T06:41:19.261 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:19.261 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:19.261 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:19.261 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443540+0000", 2024-09-13T06:41:19.262 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5009999999999998e-06 2024-09-13T06:41:19.262 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:19.262 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:19.262 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:19.262 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533412+0000", 2024-09-13T06:41:19.262 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089871873000000005 2024-09-13T06:41:19.262 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:19.262 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:19.262 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:19.262 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533419+0000", 2024-09-13T06:41:19.262 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.883e-06 2024-09-13T06:41:19.262 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:19.262 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:19.263 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:19.263 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:19.263 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:19.263 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25749 3.8 3.63996268 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:19.263 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443545+0000", 2024-09-13T06:41:19.263 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 82.754889449000004, 2024-09-13T06:41:19.263 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089897988999999998, 2024-09-13T06:41:19.263 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:19.263 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:41:19.263 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:19.263 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:19.263 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:19.263 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25749 2024-09-13T06:41:19.264 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:19.264 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:19.264 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:19.264 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:19.264 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443545+0000", 2024-09-13T06:41:19.264 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:19.264 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:19.264 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:19.264 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:19.264 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443545+0000", 2024-09-13T06:41:19.264 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:19.264 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:19.264 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:19.264 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:19.265 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443544+0000", 2024-09-13T06:41:19.265 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:19.265 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:19.265 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:19.265 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:19.265 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443553+0000", 2024-09-13T06:41:19.265 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.4770000000000003e-06 2024-09-13T06:41:19.265 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:19.265 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:19.265 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:19.265 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443564+0000", 2024-09-13T06:41:19.265 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0986e-05 2024-09-13T06:41:19.265 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:19.266 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:19.266 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:19.266 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443569+0000", 2024-09-13T06:41:19.266 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2530000000000004e-06 2024-09-13T06:41:19.266 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:19.266 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:19.266 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:19.266 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533438+0000", 2024-09-13T06:41:19.266 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089868641999999999 2024-09-13T06:41:19.266 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:19.266 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:19.266 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:19.267 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533442+0000", 2024-09-13T06:41:19.267 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.989e-06 2024-09-13T06:41:19.267 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:19.267 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:19.267 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:19.267 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:19.267 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:19.267 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25750 3.8 3.63996268 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:19.267 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443574+0000", 2024-09-13T06:41:19.267 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 82.754859963000001, 2024-09-13T06:41:19.267 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089895143999999996, 2024-09-13T06:41:19.267 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:19.267 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:41:19.268 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:19.268 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:19.268 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:19.268 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25750 2024-09-13T06:41:19.268 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:19.268 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:19.268 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:19.268 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:19.268 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443574+0000", 2024-09-13T06:41:19.268 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:19.268 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:19.268 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:19.268 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:19.269 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443574+0000", 2024-09-13T06:41:19.269 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:19.269 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:19.269 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:19.269 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:19.269 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443574+0000", 2024-09-13T06:41:19.269 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:19.269 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:19.269 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:19.269 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:19.269 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443576+0000", 2024-09-13T06:41:19.269 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6910000000000002e-06 2024-09-13T06:41:19.269 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:19.270 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:19.270 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:19.270 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443583+0000", 2024-09-13T06:41:19.270 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.331e-06 2024-09-13T06:41:19.270 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:19.270 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:19.270 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:19.270 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443587+0000", 2024-09-13T06:41:19.270 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6129999999999997e-06 2024-09-13T06:41:19.270 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:19.270 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:19.270 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:19.270 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533464+0000", 2024-09-13T06:41:19.271 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089876605999999998 2024-09-13T06:41:19.271 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:19.271 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:19.271 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:19.271 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533469+0000", 2024-09-13T06:41:19.271 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3909999999999997e-06 2024-09-13T06:41:19.271 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:19.271 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:19.271 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:19.271 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:19.271 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:19.271 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25751 3.8 3.63996268 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:19.271 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443592+0000", 2024-09-13T06:41:19.272 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 82.754842265999997, 2024-09-13T06:41:19.272 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089913650999999997, 2024-09-13T06:41:19.272 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:19.272 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:41:19.272 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:19.272 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:19.272 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:19.272 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25751 2024-09-13T06:41:19.272 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:19.272 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:19.272 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:19.272 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:19.272 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443592+0000", 2024-09-13T06:41:19.273 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:19.273 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:19.273 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:19.273 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:19.273 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443592+0000", 2024-09-13T06:41:19.273 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:19.273 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:19.273 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:19.273 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:19.273 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443591+0000", 2024-09-13T06:41:19.273 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:19.273 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:19.273 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:19.274 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:19.274 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443594+0000", 2024-09-13T06:41:19.274 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3649999999999998e-06 2024-09-13T06:41:19.274 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:19.274 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:19.274 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:19.274 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443599+0000", 2024-09-13T06:41:19.274 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.699e-06 2024-09-13T06:41:19.274 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:19.274 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:19.274 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:19.274 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443611+0000", 2024-09-13T06:41:19.274 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1503e-05 2024-09-13T06:41:19.274 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:19.275 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:19.275 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:19.275 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533497+0000", 2024-09-13T06:41:19.275 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089886453000000005 2024-09-13T06:41:19.275 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:19.275 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:19.275 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:19.275 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533505+0000", 2024-09-13T06:41:19.275 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.9910000000000002e-06 2024-09-13T06:41:19.275 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:19.275 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:19.275 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:19.275 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:19.276 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:19.276 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25752 3.8 3.63996268 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:19.276 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443615+0000", 2024-09-13T06:41:19.276 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 82.754818485000001, 2024-09-13T06:41:19.276 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089905868999999999, 2024-09-13T06:41:19.276 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:19.276 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:41:19.276 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:19.276 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:19.276 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:19.276 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25752 2024-09-13T06:41:19.276 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:19.277 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:19.277 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:19.277 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:19.277 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443615+0000", 2024-09-13T06:41:19.277 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:19.277 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:19.277 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:19.277 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:19.277 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443615+0000", 2024-09-13T06:41:19.277 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:19.277 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:19.277 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:19.277 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:19.278 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443615+0000", 2024-09-13T06:41:19.278 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:19.278 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:19.278 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:19.278 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:19.278 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443617+0000", 2024-09-13T06:41:19.278 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3539999999999998e-06 2024-09-13T06:41:19.278 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:19.278 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:19.278 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:19.278 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443624+0000", 2024-09-13T06:41:19.278 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3600000000000001e-06 2024-09-13T06:41:19.278 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:19.278 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:19.279 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:19.279 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443628+0000", 2024-09-13T06:41:19.279 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.2350000000000001e-06 2024-09-13T06:41:19.279 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:19.279 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:19.279 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:19.279 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533517+0000", 2024-09-13T06:41:19.279 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089889029999999995 2024-09-13T06:41:19.279 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:19.279 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:19.279 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:19.279 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533521+0000", 2024-09-13T06:41:19.279 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.2529999999999998e-06 2024-09-13T06:41:19.280 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:19.280 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:19.280 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:19.280 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:19.280 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:19.280 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25755 3.8 3.63996268 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:19.280 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.444692+0000", 2024-09-13T06:41:19.280 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 82.753741778999995, 2024-09-13T06:41:19.280 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.088904186999999996, 2024-09-13T06:41:19.280 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:19.280 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:41:19.280 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:19.281 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:19.281 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:19.281 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25755 2024-09-13T06:41:19.281 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:19.281 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:19.281 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:19.281 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:19.281 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.444692+0000", 2024-09-13T06:41:19.281 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:19.281 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:19.281 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:19.281 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:19.281 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.444692+0000", 2024-09-13T06:41:19.281 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:19.282 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:19.282 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:19.282 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:19.282 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.444692+0000", 2024-09-13T06:41:19.282 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:19.282 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:19.282 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:19.282 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:19.282 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.444694+0000", 2024-09-13T06:41:19.282 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.058e-06 2024-09-13T06:41:19.282 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:19.282 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:19.282 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:19.283 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.444700+0000", 2024-09-13T06:41:19.283 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7769999999999999e-06 2024-09-13T06:41:19.283 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:19.283 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:19.283 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:19.283 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.444704+0000", 2024-09-13T06:41:19.283 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6229999999999996e-06 2024-09-13T06:41:19.283 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:19.283 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:19.283 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:19.283 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533587+0000", 2024-09-13T06:41:19.283 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.088882744999999999 2024-09-13T06:41:19.283 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:19.284 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:19.284 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:19.284 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533596+0000", 2024-09-13T06:41:19.284 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.3270000000000007e-06 2024-09-13T06:41:19.284 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:19.284 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:19.284 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:19.284 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:19.284 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:19.284 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:64356 3.c 3:32785be9:::rbd_header.11218ba71f0d:head [watch reconnect cookie 140361410387072 gen 2] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e95)", 2024-09-13T06:41:19.284 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:48.473318+0000", 2024-09-13T06:41:19.284 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 30.725116092, 2024-09-13T06:41:19.284 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1458904379999999, 2024-09-13T06:41:19.284 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:19.285 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:19.285 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:19.285 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:19.285 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:19.285 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 64356 2024-09-13T06:41:19.285 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:19.285 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:19.285 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:19.285 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:19.285 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:48.473318+0000", 2024-09-13T06:41:19.285 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:19.285 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:19.285 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:19.285 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:19.286 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:48.473318+0000", 2024-09-13T06:41:19.286 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:19.286 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:19.286 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:19.286 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:19.286 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:48.473315+0000", 2024-09-13T06:41:19.286 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999971 2024-09-13T06:41:19.286 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:19.286 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:19.286 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:19.286 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:48.473329+0000", 2024-09-13T06:41:19.286 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.433e-05 2024-09-13T06:41:19.286 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:19.287 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:19.287 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:19.287 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:48.473363+0000", 2024-09-13T06:41:19.287 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.3592e-05 2024-09-13T06:41:19.287 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:19.287 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:19.287 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:19.287 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:48.473386+0000", 2024-09-13T06:41:19.287 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2708999999999999e-05 2024-09-13T06:41:19.287 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:19.287 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:19.287 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:19.287 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:48.473804+0000", 2024-09-13T06:41:19.287 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00041789399999999998 2024-09-13T06:41:19.288 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:19.288 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:19.288 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:41:19.288 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:48.473830+0000", 2024-09-13T06:41:19.288 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6869e-05 2024-09-13T06:41:19.288 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:19.288 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:19.288 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:19.288 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:49.614332+0000", 2024-09-13T06:41:19.288 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.140501107 2024-09-13T06:41:19.288 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:19.288 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:19.288 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for rw locks", 2024-09-13T06:41:19.289 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:49.614496+0000", 2024-09-13T06:41:19.289 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00016451200000000001 2024-09-13T06:41:19.289 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:19.289 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:19.289 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:19.289 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:49.617131+0000", 2024-09-13T06:41:19.289 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.002634843 2024-09-13T06:41:19.289 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:19.289 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:19.289 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:19.289 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:49.617204+0000", 2024-09-13T06:41:19.289 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.2991000000000006e-05 2024-09-13T06:41:19.289 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:19.289 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:19.290 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:19.290 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:49.619208+0000", 2024-09-13T06:41:19.290 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.002004381 2024-09-13T06:41:19.290 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:19.290 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:19.290 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:19.290 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:19.290 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:19.290 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:41:19.292 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-13T06:41:19.292 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:41:19.290+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:41:19.393 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:41:19.390+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:41:19.424 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:41:19.425 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [], 2024-09-13T06:41:19.425 INFO:teuthology.orchestra.run.smithi139.stdout: "num_ops": 0 2024-09-13T06:41:19.425 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:41:19.440 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-13T06:41:19.453 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-13T06:41:19.498 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:41:19.498+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:41:19.522 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-objectstore-tool --err-to-stderr --no-mon-config '--log-file=/var/log/ceph/objectstore_tool.$pid.log' --data-path /var/lib/ceph/osd/ceph-7 --journal-path /var/lib/ceph/osd/ceph-7/journal --force --op remove --pgid 3.16 2024-09-13T06:41:19.564 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:41:19.564 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [], 2024-09-13T06:41:19.564 INFO:teuthology.orchestra.run.smithi139.stdout: "complaint_time": 30, 2024-09-13T06:41:19.564 INFO:teuthology.orchestra.run.smithi139.stdout: "num_blocked_ops": 0 2024-09-13T06:41:19.564 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:41:19.580 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-13T06:41:19.624 INFO:teuthology.orchestra.run.smithi081.stdout:checking clone #18, image image_client.0-clone18 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent19 2024-09-13T06:41:19.624 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:41:19.623+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:41:19.696 INFO:tasks.ceph.osd.6.smithi139.stderr:2024-09-13T06:41:19.695+0000 7fcd02c5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26385) UID: 0 2024-09-13T06:41:19.744 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:41:19.744 INFO:teuthology.orchestra.run.smithi139.stdout: "size": 20, 2024-09-13T06:41:19.745 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 600, 2024-09-13T06:41:19.745 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [ 2024-09-13T06:41:19.745 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:19.745 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18706 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 3346432~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:41:19.745 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.846138+0000", 2024-09-13T06:41:19.745 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 87.896353048999998, 2024-09-13T06:41:19.745 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.102018712, 2024-09-13T06:41:19.745 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:19.745 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:19.745 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:19.745 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:19.745 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:19.745 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18706 2024-09-13T06:41:19.746 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:19.746 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:19.746 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:19.746 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:19.746 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846138+0000", 2024-09-13T06:41:19.746 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:19.746 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:19.746 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:19.746 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:19.746 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846138+0000", 2024-09-13T06:41:19.746 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:19.746 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:19.746 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:19.746 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:19.747 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846138+0000", 2024-09-13T06:41:19.747 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:19.747 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:19.747 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:19.747 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:19.747 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846141+0000", 2024-09-13T06:41:19.747 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.6969999999999999e-06 2024-09-13T06:41:19.747 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:19.747 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:19.747 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:19.747 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846150+0000", 2024-09-13T06:41:19.747 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6400000000000003e-06 2024-09-13T06:41:19.748 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:19.748 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:19.748 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:19.748 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846160+0000", 2024-09-13T06:41:19.748 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.3999999999999998e-06 2024-09-13T06:41:19.748 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:19.748 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:19.748 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:19.748 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.947764+0000", 2024-09-13T06:41:19.748 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101604085 2024-09-13T06:41:19.748 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:19.748 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:19.749 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:19.749 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.947888+0000", 2024-09-13T06:41:19.749 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000124113 2024-09-13T06:41:19.749 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:19.749 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:19.749 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:19.749 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.948157+0000", 2024-09-13T06:41:19.749 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00026943399999999998 2024-09-13T06:41:19.749 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:19.749 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:19.749 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:19.749 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:19.750 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:19.750 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18707 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 3375104~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:41:19.750 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.846207+0000", 2024-09-13T06:41:19.750 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 87.896284283, 2024-09-13T06:41:19.750 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10238114099999999, 2024-09-13T06:41:19.750 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:19.750 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:19.750 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:19.750 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:19.750 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:19.750 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18707 2024-09-13T06:41:19.750 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:19.750 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:19.750 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:19.751 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:19.751 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846207+0000", 2024-09-13T06:41:19.751 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:19.751 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:19.751 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:19.751 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:19.751 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846207+0000", 2024-09-13T06:41:19.751 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:19.751 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:19.751 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:19.751 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:19.751 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846206+0000", 2024-09-13T06:41:19.751 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:19.752 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:19.752 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:19.752 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:19.752 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846211+0000", 2024-09-13T06:41:19.752 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.3000000000000003e-06 2024-09-13T06:41:19.752 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:19.752 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:19.752 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:19.752 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846220+0000", 2024-09-13T06:41:19.752 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6199999999999994e-06 2024-09-13T06:41:19.752 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:19.752 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:19.752 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:19.753 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846228+0000", 2024-09-13T06:41:19.753 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.7500000000000003e-06 2024-09-13T06:41:19.753 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:19.753 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:19.753 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:19.753 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.948267+0000", 2024-09-13T06:41:19.753 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10203878700000001 2024-09-13T06:41:19.753 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:19.753 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:19.753 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:19.753 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.948435+0000", 2024-09-13T06:41:19.753 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00016796500000000001 2024-09-13T06:41:19.753 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:19.753 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:19.754 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:19.754 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.948588+0000", 2024-09-13T06:41:19.754 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00015373599999999999 2024-09-13T06:41:19.754 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:19.754 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:19.754 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:19.754 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:19.754 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:19.754 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18718 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 3690496~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:41:19.754 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.850174+0000", 2024-09-13T06:41:19.754 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 87.892317129999995, 2024-09-13T06:41:19.754 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101854154, 2024-09-13T06:41:19.754 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:19.755 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:19.755 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:19.755 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:19.755 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:19.755 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18718 2024-09-13T06:41:19.755 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:19.755 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:19.755 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:19.755 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:19.755 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850174+0000", 2024-09-13T06:41:19.755 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:19.755 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:19.755 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:19.756 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:19.756 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850174+0000", 2024-09-13T06:41:19.756 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:19.756 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:19.756 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:19.756 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:19.756 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850173+0000", 2024-09-13T06:41:19.756 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:19.756 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:19.756 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:19.756 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:19.756 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850178+0000", 2024-09-13T06:41:19.756 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.4129999999999999e-06 2024-09-13T06:41:19.757 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:19.757 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:19.757 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:19.757 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850188+0000", 2024-09-13T06:41:19.757 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.8600000000000005e-06 2024-09-13T06:41:19.757 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:19.757 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:19.757 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:19.757 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850195+0000", 2024-09-13T06:41:19.757 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.8730000000000007e-06 2024-09-13T06:41:19.757 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:19.757 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:19.758 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:19.758 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.951766+0000", 2024-09-13T06:41:19.758 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.1015703 2024-09-13T06:41:19.758 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:19.758 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:19.758 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:19.758 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.951879+0000", 2024-09-13T06:41:19.758 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000112932 2024-09-13T06:41:19.758 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:19.758 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:19.758 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:19.758 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.952029+0000", 2024-09-13T06:41:19.758 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000149846 2024-09-13T06:41:19.759 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:19.759 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:19.759 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:19.759 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:19.759 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:19.759 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18719 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 3719168~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:41:19.759 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.850202+0000", 2024-09-13T06:41:19.759 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 87.892289086999995, 2024-09-13T06:41:19.759 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.102191676, 2024-09-13T06:41:19.759 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:19.759 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:19.759 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:19.760 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:19.760 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:19.760 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18719 2024-09-13T06:41:19.760 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:19.760 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:19.760 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:19.760 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:19.760 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850202+0000", 2024-09-13T06:41:19.760 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:19.760 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:19.760 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:19.760 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:19.760 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850202+0000", 2024-09-13T06:41:19.761 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:19.761 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:19.761 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:19.761 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:19.761 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850202+0000", 2024-09-13T06:41:19.761 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:19.761 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:19.761 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:19.761 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:19.761 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850205+0000", 2024-09-13T06:41:19.761 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.89e-06 2024-09-13T06:41:19.761 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:19.761 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:19.762 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:19.762 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850216+0000", 2024-09-13T06:41:19.762 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0233e-05 2024-09-13T06:41:19.762 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:19.762 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:19.762 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:19.762 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850223+0000", 2024-09-13T06:41:19.762 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5299999999999999e-06 2024-09-13T06:41:19.762 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:19.762 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:19.762 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:19.762 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.952106+0000", 2024-09-13T06:41:19.762 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10188309299999999 2024-09-13T06:41:19.763 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:19.763 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:19.763 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:19.763 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.952233+0000", 2024-09-13T06:41:19.763 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000126993 2024-09-13T06:41:19.763 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:19.763 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:19.763 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:19.763 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.952394+0000", 2024-09-13T06:41:19.763 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000160791 2024-09-13T06:41:19.763 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:19.763 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:19.763 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:19.764 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:19.764 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:19.764 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18720 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 3747840~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:41:19.764 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.850726+0000", 2024-09-13T06:41:19.764 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 87.891765258000007, 2024-09-13T06:41:19.764 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10199504299999999, 2024-09-13T06:41:19.764 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:19.764 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:19.764 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:19.764 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:19.764 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:19.764 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18720 2024-09-13T06:41:19.765 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:19.765 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:19.765 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:19.765 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:19.765 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850726+0000", 2024-09-13T06:41:19.765 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:19.765 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:19.765 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:19.765 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:19.765 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850726+0000", 2024-09-13T06:41:19.765 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:19.765 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:19.765 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:19.766 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:19.766 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850229+0000", 2024-09-13T06:41:19.766 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9995027 2024-09-13T06:41:19.766 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:19.766 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:19.766 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:19.766 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850731+0000", 2024-09-13T06:41:19.766 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00050221599999999999 2024-09-13T06:41:19.766 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:19.766 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:19.766 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:19.766 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850751+0000", 2024-09-13T06:41:19.767 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.9703000000000001e-05 2024-09-13T06:41:19.767 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:19.767 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:19.767 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:19.767 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850764+0000", 2024-09-13T06:41:19.767 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3207000000000001e-05 2024-09-13T06:41:19.767 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:19.767 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:19.767 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:19.767 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.952454+0000", 2024-09-13T06:41:19.767 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101690102 2024-09-13T06:41:19.767 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:19.767 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:19.768 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:19.768 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.952571+0000", 2024-09-13T06:41:19.768 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000116556 2024-09-13T06:41:19.768 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:19.768 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:19.768 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:19.768 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.952721+0000", 2024-09-13T06:41:19.768 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000150419 2024-09-13T06:41:19.768 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:19.768 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:19.768 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:19.768 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:19.768 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:19.769 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18730 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 4034560~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:41:19.769 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.854013+0000", 2024-09-13T06:41:19.769 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 87.888478316999993, 2024-09-13T06:41:19.769 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10186914399999999, 2024-09-13T06:41:19.769 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:19.769 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:19.769 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:19.769 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:19.769 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:19.769 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18730 2024-09-13T06:41:19.769 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:19.769 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:19.769 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:19.769 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:19.770 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.854013+0000", 2024-09-13T06:41:19.770 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:19.770 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:19.770 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:19.770 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:19.770 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.854013+0000", 2024-09-13T06:41:19.770 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:19.770 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:19.770 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:19.770 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:19.770 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.854013+0000", 2024-09-13T06:41:19.770 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:19.770 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:19.771 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:19.771 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:19.771 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.854016+0000", 2024-09-13T06:41:19.771 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.1839999999999999e-06 2024-09-13T06:41:19.771 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:19.771 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:19.771 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:19.771 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.854025+0000", 2024-09-13T06:41:19.771 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.8030000000000003e-06 2024-09-13T06:41:19.771 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:19.771 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:19.771 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:19.771 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.854033+0000", 2024-09-13T06:41:19.772 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6500000000000002e-06 2024-09-13T06:41:19.772 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:19.772 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:19.772 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:19.772 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.955546+0000", 2024-09-13T06:41:19.772 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10151296 2024-09-13T06:41:19.772 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:19.772 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:19.772 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:19.772 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.955694+0000", 2024-09-13T06:41:19.772 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000147773 2024-09-13T06:41:19.772 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:19.773 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:19.773 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:19.773 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.955882+0000", 2024-09-13T06:41:19.773 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000188371 2024-09-13T06:41:19.773 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:19.773 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:19.773 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:19.773 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:19.773 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:19.773 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18742 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 4378624~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:41:19.773 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.857984+0000", 2024-09-13T06:41:19.773 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 87.884507193999994, 2024-09-13T06:41:19.773 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10179961799999999, 2024-09-13T06:41:19.774 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:19.774 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:19.774 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:19.774 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:19.774 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:19.774 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18742 2024-09-13T06:41:19.774 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:19.774 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:19.774 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:19.774 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:19.774 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.857984+0000", 2024-09-13T06:41:19.774 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:19.775 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:19.775 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:19.775 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:19.775 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.857984+0000", 2024-09-13T06:41:19.775 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:19.775 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:19.775 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:19.775 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:19.775 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.857983+0000", 2024-09-13T06:41:19.775 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:19.775 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:19.775 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:19.776 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:19.776 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.857987+0000", 2024-09-13T06:41:19.776 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0670000000000002e-06 2024-09-13T06:41:19.776 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:19.776 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:19.776 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:19.776 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.857997+0000", 2024-09-13T06:41:19.776 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6830000000000003e-06 2024-09-13T06:41:19.776 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:19.776 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:19.777 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:19.777 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.858006+0000", 2024-09-13T06:41:19.777 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.5739999999999996e-06 2024-09-13T06:41:19.777 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:19.777 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:19.777 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:19.777 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.959453+0000", 2024-09-13T06:41:19.777 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101447339 2024-09-13T06:41:19.777 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:19.777 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:19.777 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:19.777 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.959603+0000", 2024-09-13T06:41:19.777 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000150316 2024-09-13T06:41:19.778 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:19.778 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:19.778 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:19.778 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.959784+0000", 2024-09-13T06:41:19.778 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00018065900000000001 2024-09-13T06:41:19.778 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:19.778 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:19.778 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:19.778 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:19.778 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:19.778 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18743 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 4407296~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:41:19.778 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.858012+0000", 2024-09-13T06:41:19.779 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 87.884479201000005, 2024-09-13T06:41:19.779 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10210024500000001, 2024-09-13T06:41:19.779 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:19.779 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:19.779 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:19.779 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:19.779 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:19.779 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18743 2024-09-13T06:41:19.779 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:19.779 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:19.779 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:19.779 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:19.779 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.858012+0000", 2024-09-13T06:41:19.780 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:19.780 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:19.780 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:19.780 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:19.780 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.858012+0000", 2024-09-13T06:41:19.780 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:19.780 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:19.780 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:19.780 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:19.780 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.858011+0000", 2024-09-13T06:41:19.780 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:19.780 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:19.780 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:19.780 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:19.781 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.858016+0000", 2024-09-13T06:41:19.781 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0659999999999997e-06 2024-09-13T06:41:19.781 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:19.781 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:19.781 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:19.781 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.858024+0000", 2024-09-13T06:41:19.781 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.7700000000000007e-06 2024-09-13T06:41:19.781 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:19.781 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:19.781 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:19.781 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.858032+0000", 2024-09-13T06:41:19.781 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.7700000000000001e-06 2024-09-13T06:41:19.782 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:19.782 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:19.782 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:19.782 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.959850+0000", 2024-09-13T06:41:19.782 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.1018182 2024-09-13T06:41:19.782 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:19.782 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:19.782 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:19.782 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.959964+0000", 2024-09-13T06:41:19.782 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00011413600000000001 2024-09-13T06:41:19.782 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:19.782 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:19.782 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:19.783 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.960113+0000", 2024-09-13T06:41:19.783 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00014813900000000001 2024-09-13T06:41:19.783 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:19.783 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:19.783 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:19.783 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:19.783 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:19.783 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18755 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 4751360~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:41:19.783 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.862061+0000", 2024-09-13T06:41:19.783 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 87.880430949000001, 2024-09-13T06:41:19.783 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101907023, 2024-09-13T06:41:19.783 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:19.783 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:19.783 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:19.784 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:19.784 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:19.784 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18755 2024-09-13T06:41:19.784 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:19.784 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:19.784 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:19.784 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:19.784 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862061+0000", 2024-09-13T06:41:19.784 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:19.784 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:19.784 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:19.784 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:19.784 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862061+0000", 2024-09-13T06:41:19.784 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:19.785 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:19.785 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:19.785 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:19.785 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862060+0000", 2024-09-13T06:41:19.785 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:19.785 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:19.785 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:19.785 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:19.785 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862064+0000", 2024-09-13T06:41:19.785 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.3229999999999999e-06 2024-09-13T06:41:19.785 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:19.785 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:19.785 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:19.786 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862078+0000", 2024-09-13T06:41:19.786 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.433e-05 2024-09-13T06:41:19.786 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:19.786 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:19.786 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:19.786 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862086+0000", 2024-09-13T06:41:19.786 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.3869999999999997e-06 2024-09-13T06:41:19.786 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:19.786 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:19.786 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:19.786 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.963635+0000", 2024-09-13T06:41:19.786 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101549606 2024-09-13T06:41:19.787 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:19.787 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:19.787 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:19.787 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.963783+0000", 2024-09-13T06:41:19.787 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000147312 2024-09-13T06:41:19.787 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:19.787 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:19.787 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:19.787 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.963968+0000", 2024-09-13T06:41:19.787 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000185028 2024-09-13T06:41:19.787 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:19.787 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:19.787 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:19.787 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:19.787 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:19.788 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18756 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 4780032~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:41:19.788 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.862132+0000", 2024-09-13T06:41:19.788 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 87.880359106, 2024-09-13T06:41:19.788 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.102159295, 2024-09-13T06:41:19.788 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:19.788 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:19.788 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:19.788 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:19.788 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:19.788 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18756 2024-09-13T06:41:19.788 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:19.788 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:19.788 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:19.788 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:19.788 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862132+0000", 2024-09-13T06:41:19.789 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:19.789 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:19.789 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:19.789 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:19.789 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862132+0000", 2024-09-13T06:41:19.789 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:19.789 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:19.789 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:19.789 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:19.789 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862132+0000", 2024-09-13T06:41:19.789 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:19.789 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:19.789 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:19.789 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:19.789 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862136+0000", 2024-09-13T06:41:19.790 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.9559999999999999e-06 2024-09-13T06:41:19.790 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:19.790 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:19.790 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:19.790 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862145+0000", 2024-09-13T06:41:19.790 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6169999999999996e-06 2024-09-13T06:41:19.790 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:19.790 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:19.790 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:19.790 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862153+0000", 2024-09-13T06:41:19.790 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.8359999999999992e-06 2024-09-13T06:41:19.791 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:19.791 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:19.791 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:19.791 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.964018+0000", 2024-09-13T06:41:19.791 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101865421 2024-09-13T06:41:19.791 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:19.791 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:19.791 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:19.791 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.964140+0000", 2024-09-13T06:41:19.791 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000121172 2024-09-13T06:41:19.791 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:19.791 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:19.791 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:19.791 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.964292+0000", 2024-09-13T06:41:19.791 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00015202600000000001 2024-09-13T06:41:19.792 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:19.792 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:19.792 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:19.792 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:19.792 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:19.792 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18768 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 5124096~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:41:19.792 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.866345+0000", 2024-09-13T06:41:19.792 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 87.876146798999997, 2024-09-13T06:41:19.792 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101779361, 2024-09-13T06:41:19.792 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:19.792 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:19.792 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:19.792 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:19.793 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:19.793 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18768 2024-09-13T06:41:19.793 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:19.793 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:19.793 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:19.793 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:19.793 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.866345+0000", 2024-09-13T06:41:19.793 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:19.793 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:19.793 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:19.793 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:19.793 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.866345+0000", 2024-09-13T06:41:19.793 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:19.793 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:19.794 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:19.794 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:19.794 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.866344+0000", 2024-09-13T06:41:19.794 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:19.794 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:19.794 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:19.794 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:19.794 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.866348+0000", 2024-09-13T06:41:19.794 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.4300000000000002e-06 2024-09-13T06:41:19.794 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:19.794 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:19.794 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:19.794 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.866356+0000", 2024-09-13T06:41:19.794 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.5930000000000006e-06 2024-09-13T06:41:19.794 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:19.795 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:19.795 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:19.795 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.866364+0000", 2024-09-13T06:41:19.795 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5599999999999996e-06 2024-09-13T06:41:19.795 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:19.795 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:19.795 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:19.795 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.967865+0000", 2024-09-13T06:41:19.795 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101501683 2024-09-13T06:41:19.795 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:19.795 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:19.795 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:19.795 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.967981+0000", 2024-09-13T06:41:19.795 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000115643 2024-09-13T06:41:19.796 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:19.796 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:19.796 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:19.796 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.968124+0000", 2024-09-13T06:41:19.796 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00014305500000000001 2024-09-13T06:41:19.796 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:19.796 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:19.796 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:19.796 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:19.796 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:19.796 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18779 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 5439488~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:41:19.796 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.869996+0000", 2024-09-13T06:41:19.796 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 87.872495913999998, 2024-09-13T06:41:19.796 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10189577399999999, 2024-09-13T06:41:19.796 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:19.797 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:19.797 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:19.797 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:19.797 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:19.797 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18779 2024-09-13T06:41:19.797 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:19.797 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:19.797 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:19.797 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:19.797 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.869996+0000", 2024-09-13T06:41:19.797 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:19.797 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:19.797 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:19.797 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:19.797 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.869996+0000", 2024-09-13T06:41:19.798 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:19.798 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:19.798 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:19.798 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:19.798 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.869995+0000", 2024-09-13T06:41:19.798 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:19.798 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:19.798 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:19.798 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:19.798 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.869998+0000", 2024-09-13T06:41:19.798 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.2729999999999998e-06 2024-09-13T06:41:19.798 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:19.799 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:19.799 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:19.799 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.870007+0000", 2024-09-13T06:41:19.799 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.5760000000000006e-06 2024-09-13T06:41:19.799 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:19.799 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:19.799 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:19.799 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.870014+0000", 2024-09-13T06:41:19.799 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.1400000000000002e-06 2024-09-13T06:41:19.799 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:19.799 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:19.799 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:19.799 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.971631+0000", 2024-09-13T06:41:19.800 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101617503 2024-09-13T06:41:19.800 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:19.800 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:19.800 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:19.800 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.971747+0000", 2024-09-13T06:41:19.800 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00011599600000000001 2024-09-13T06:41:19.800 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:19.800 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:19.800 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:19.800 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.971891+0000", 2024-09-13T06:41:19.800 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000143912 2024-09-13T06:41:19.800 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:19.800 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:19.801 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:19.801 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:19.801 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:19.801 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18792 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 5812224~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:41:19.801 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.874371+0000", 2024-09-13T06:41:19.801 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 87.868120783999998, 2024-09-13T06:41:19.801 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101736005, 2024-09-13T06:41:19.801 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:19.801 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:19.801 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:19.801 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:19.801 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:19.801 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18792 2024-09-13T06:41:19.801 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:19.802 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:19.802 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:19.802 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:19.802 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874371+0000", 2024-09-13T06:41:19.802 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:19.802 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:19.802 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:19.802 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:19.802 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874371+0000", 2024-09-13T06:41:19.802 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:19.802 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:19.802 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:19.802 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:19.802 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874370+0000", 2024-09-13T06:41:19.802 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:19.803 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:19.803 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:19.803 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:19.803 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874374+0000", 2024-09-13T06:41:19.803 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.7239999999999998e-06 2024-09-13T06:41:19.803 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:19.803 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:19.803 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:19.803 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874385+0000", 2024-09-13T06:41:19.803 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1293e-05 2024-09-13T06:41:19.803 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:19.803 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:19.803 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:19.803 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874394+0000", 2024-09-13T06:41:19.804 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.0729999999999994e-06 2024-09-13T06:41:19.804 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:19.804 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:19.804 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:19.804 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.975850+0000", 2024-09-13T06:41:19.804 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10145599700000001 2024-09-13T06:41:19.804 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:19.804 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:19.804 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:19.804 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.975963+0000", 2024-09-13T06:41:19.804 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000112689 2024-09-13T06:41:19.804 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:19.804 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:19.804 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:19.804 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.976107+0000", 2024-09-13T06:41:19.805 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000143836 2024-09-13T06:41:19.805 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:19.805 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:19.805 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:19.805 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:19.805 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:19.805 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18793 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 5840896~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:41:19.805 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.874401+0000", 2024-09-13T06:41:19.805 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 87.868090750999997, 2024-09-13T06:41:19.805 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.102005516, 2024-09-13T06:41:19.805 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:19.805 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:19.805 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:19.805 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:19.806 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:19.806 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18793 2024-09-13T06:41:19.806 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:19.806 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:19.806 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:19.806 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:19.806 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874401+0000", 2024-09-13T06:41:19.806 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:19.806 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:19.806 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:19.806 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:19.806 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874401+0000", 2024-09-13T06:41:19.806 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:19.806 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:19.806 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:19.807 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:19.807 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874400+0000", 2024-09-13T06:41:19.807 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:19.807 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:19.807 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:19.807 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:19.807 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874404+0000", 2024-09-13T06:41:19.807 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0069999999999999e-06 2024-09-13T06:41:19.807 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:19.807 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:19.807 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:19.807 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874412+0000", 2024-09-13T06:41:19.807 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.5399999999999996e-06 2024-09-13T06:41:19.807 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:19.808 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:19.808 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:19.808 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874420+0000", 2024-09-13T06:41:19.808 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.6199999999999999e-06 2024-09-13T06:41:19.808 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:19.808 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:19.808 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:19.808 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.976150+0000", 2024-09-13T06:41:19.808 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101729874 2024-09-13T06:41:19.808 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:19.808 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:19.808 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:19.809 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.976261+0000", 2024-09-13T06:41:19.809 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000110819 2024-09-13T06:41:19.809 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:19.809 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:19.809 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:19.809 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.976406+0000", 2024-09-13T06:41:19.809 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000145489 2024-09-13T06:41:19.809 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:19.809 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:19.809 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:19.809 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:19.809 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:19.809 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18803 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 6127616~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:41:19.809 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.877851+0000", 2024-09-13T06:41:19.809 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 87.864640257999994, 2024-09-13T06:41:19.810 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101951584, 2024-09-13T06:41:19.810 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:19.810 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:19.810 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:19.810 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:19.810 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:19.810 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18803 2024-09-13T06:41:19.810 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:19.810 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:19.810 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:19.810 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:19.810 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.877851+0000", 2024-09-13T06:41:19.810 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:19.810 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:19.810 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:19.811 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:19.811 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.877851+0000", 2024-09-13T06:41:19.811 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:19.811 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:19.811 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:19.811 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:19.811 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.877851+0000", 2024-09-13T06:41:19.811 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:19.811 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:19.811 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:19.811 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:19.811 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.877854+0000", 2024-09-13T06:41:19.811 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.7929999999999999e-06 2024-09-13T06:41:19.811 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:19.811 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:19.812 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:19.812 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.877864+0000", 2024-09-13T06:41:19.812 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.2029999999999998e-06 2024-09-13T06:41:19.812 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:19.812 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:19.812 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:19.812 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.877873+0000", 2024-09-13T06:41:19.812 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.0440000000000001e-06 2024-09-13T06:41:19.812 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:19.812 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:19.812 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:19.812 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.979544+0000", 2024-09-13T06:41:19.812 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101671198 2024-09-13T06:41:19.812 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:19.813 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:19.813 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:19.813 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.979658+0000", 2024-09-13T06:41:19.813 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000114456 2024-09-13T06:41:19.813 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:19.813 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:19.813 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:19.813 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.979803+0000", 2024-09-13T06:41:19.813 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000144506 2024-09-13T06:41:19.813 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:19.813 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:19.813 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:19.813 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:19.813 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:19.813 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18807 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 6242304~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:41:19.814 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.879235+0000", 2024-09-13T06:41:19.814 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 87.863256227999997, 2024-09-13T06:41:19.814 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101781258, 2024-09-13T06:41:19.814 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:19.814 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:19.814 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:19.814 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:19.814 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:19.814 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18807 2024-09-13T06:41:19.814 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:19.814 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:19.814 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:19.814 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:19.814 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879235+0000", 2024-09-13T06:41:19.814 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:19.815 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:19.815 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:19.815 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:19.815 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879235+0000", 2024-09-13T06:41:19.815 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:19.815 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:19.815 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:19.815 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:19.815 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879235+0000", 2024-09-13T06:41:19.815 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:19.815 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:19.815 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:19.815 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:19.816 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879239+0000", 2024-09-13T06:41:19.816 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.963e-06 2024-09-13T06:41:19.816 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:19.816 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:19.816 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:19.816 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879247+0000", 2024-09-13T06:41:19.816 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6470000000000004e-06 2024-09-13T06:41:19.816 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:19.816 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:19.816 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:19.816 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879255+0000", 2024-09-13T06:41:19.816 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5429999999999996e-06 2024-09-13T06:41:19.816 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:19.817 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:19.817 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:19.817 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.980756+0000", 2024-09-13T06:41:19.817 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10150165999999999 2024-09-13T06:41:19.817 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:19.817 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:19.817 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:19.817 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.980868+0000", 2024-09-13T06:41:19.817 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000111196 2024-09-13T06:41:19.817 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:19.817 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:19.817 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:19.817 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.981017+0000", 2024-09-13T06:41:19.817 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000148846 2024-09-13T06:41:19.818 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:19.818 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:19.818 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:19.818 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:19.818 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:19.818 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18808 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 6270976~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:41:19.818 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.879261+0000", 2024-09-13T06:41:19.818 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 87.863230088999998, 2024-09-13T06:41:19.818 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.102057547, 2024-09-13T06:41:19.818 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:19.818 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:19.818 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:19.818 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:19.819 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:19.819 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18808 2024-09-13T06:41:19.819 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:19.819 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:19.819 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:19.819 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:19.819 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879261+0000", 2024-09-13T06:41:19.819 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:19.819 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:19.819 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:19.819 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:19.819 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879261+0000", 2024-09-13T06:41:19.819 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:19.819 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:19.820 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:19.820 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:19.820 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879261+0000", 2024-09-13T06:41:19.820 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:19.820 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:19.820 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:19.820 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:19.820 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879264+0000", 2024-09-13T06:41:19.820 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.523e-06 2024-09-13T06:41:19.820 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:19.820 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:19.820 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:19.820 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879273+0000", 2024-09-13T06:41:19.820 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6070000000000008e-06 2024-09-13T06:41:19.821 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:19.821 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:19.821 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:19.821 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879280+0000", 2024-09-13T06:41:19.821 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.4699999999999996e-06 2024-09-13T06:41:19.821 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:19.821 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:19.821 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:19.821 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.981060+0000", 2024-09-13T06:41:19.821 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10177934800000001 2024-09-13T06:41:19.821 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:19.821 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:19.821 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:19.821 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.981174+0000", 2024-09-13T06:41:19.822 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000114456 2024-09-13T06:41:19.822 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:19.822 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:19.822 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:19.822 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.981319+0000", 2024-09-13T06:41:19.822 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00014473900000000001 2024-09-13T06:41:19.822 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:19.822 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:19.822 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:19.822 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:19.822 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:19.822 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18810 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 2662400~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:41:19.822 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.880386+0000", 2024-09-13T06:41:19.822 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 87.862105927000002, 2024-09-13T06:41:19.822 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101728022, 2024-09-13T06:41:19.823 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:19.823 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:19.823 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:19.823 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:19.823 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:19.823 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18810 2024-09-13T06:41:19.823 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:19.823 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:19.823 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:19.823 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:19.823 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880386+0000", 2024-09-13T06:41:19.823 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:19.823 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:19.823 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:19.823 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:19.824 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880386+0000", 2024-09-13T06:41:19.824 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:19.824 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:19.824 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:19.824 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:19.824 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880385+0000", 2024-09-13T06:41:19.824 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:19.824 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:19.824 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:19.824 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:19.824 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880389+0000", 2024-09-13T06:41:19.824 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.8539999999999999e-06 2024-09-13T06:41:19.824 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:19.825 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:19.825 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:19.825 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880398+0000", 2024-09-13T06:41:19.825 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.1689999999999998e-06 2024-09-13T06:41:19.825 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:19.825 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:19.825 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:19.825 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880405+0000", 2024-09-13T06:41:19.825 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5700000000000004e-06 2024-09-13T06:41:19.825 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:19.825 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:19.825 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:19.825 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.981833+0000", 2024-09-13T06:41:19.826 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10142791800000001 2024-09-13T06:41:19.826 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:19.826 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:19.826 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:19.826 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.981973+0000", 2024-09-13T06:41:19.826 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00014002900000000001 2024-09-13T06:41:19.826 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:19.826 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:19.826 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:19.826 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.982114+0000", 2024-09-13T06:41:19.826 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000140276 2024-09-13T06:41:19.826 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:19.826 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:19.826 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:19.826 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:19.827 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:19.827 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18811 3.9 3.140f5209 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:41:19.827 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.880449+0000", 2024-09-13T06:41:19.827 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 87.862042551000002, 2024-09-13T06:41:19.827 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101739355, 2024-09-13T06:41:19.827 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:19.827 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:41:19.827 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:19.827 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:19.827 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:19.827 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18811 2024-09-13T06:41:19.827 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:19.827 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:19.828 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:19.828 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:19.828 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880449+0000", 2024-09-13T06:41:19.828 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:19.828 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:19.828 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:19.828 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:19.828 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880449+0000", 2024-09-13T06:41:19.828 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:19.828 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:19.828 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:19.828 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:19.828 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880448+0000", 2024-09-13T06:41:19.828 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:19.829 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:19.829 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:19.829 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:19.829 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880452+0000", 2024-09-13T06:41:19.829 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0470000000000004e-06 2024-09-13T06:41:19.829 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:19.829 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:19.829 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:19.829 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880462+0000", 2024-09-13T06:41:19.829 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6530000000000006e-06 2024-09-13T06:41:19.829 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:19.829 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:19.829 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:19.829 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880472+0000", 2024-09-13T06:41:19.830 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0027000000000001e-05 2024-09-13T06:41:19.830 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:19.830 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:19.830 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:19.830 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.982172+0000", 2024-09-13T06:41:19.830 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10170043500000001 2024-09-13T06:41:19.830 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:19.830 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:19.830 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:19.830 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.982188+0000", 2024-09-13T06:41:19.830 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6172999999999999e-05 2024-09-13T06:41:19.830 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:19.830 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:19.830 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:19.831 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:19.831 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:19.831 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18812 3.9 3.140f5209 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:41:19.831 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.880478+0000", 2024-09-13T06:41:19.831 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 87.862013313999995, 2024-09-13T06:41:19.831 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10177795100000001, 2024-09-13T06:41:19.831 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:19.831 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:41:19.831 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:19.831 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:19.831 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:19.831 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18812 2024-09-13T06:41:19.831 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:19.831 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:19.832 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:19.832 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:19.832 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880478+0000", 2024-09-13T06:41:19.832 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:19.832 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:19.832 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:19.832 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:19.832 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880478+0000", 2024-09-13T06:41:19.832 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:19.832 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:19.832 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:19.832 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:19.832 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880477+0000", 2024-09-13T06:41:19.832 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:19.832 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:19.833 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:19.833 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:19.833 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880481+0000", 2024-09-13T06:41:19.833 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.827e-06 2024-09-13T06:41:19.833 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:19.833 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:19.833 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:19.833 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880490+0000", 2024-09-13T06:41:19.833 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6100000000000006e-06 2024-09-13T06:41:19.833 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:19.833 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:19.833 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:19.833 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880497+0000", 2024-09-13T06:41:19.834 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.7030000000000006e-06 2024-09-13T06:41:19.834 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:19.834 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:19.834 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:19.834 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.982241+0000", 2024-09-13T06:41:19.834 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10174351199999999 2024-09-13T06:41:19.834 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:19.834 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:19.834 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:19.834 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.982256+0000", 2024-09-13T06:41:19.834 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5143000000000001e-05 2024-09-13T06:41:19.834 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:19.834 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:19.834 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:19.834 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:19.835 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:19.835 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:41:19.836 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-13T06:41:19.837 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:41:19.834+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:41:19.937 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:41:19.934+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:41:19.992 INFO:teuthology.orchestra.run.smithi081.stdout:3107 trunc from 0xae3913e to 0x191327a 2024-09-13T06:41:19.995 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:41:19.995 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [], 2024-09-13T06:41:19.995 INFO:teuthology.orchestra.run.smithi139.stdout: "num_ops": 0 2024-09-13T06:41:19.995 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:41:20.013 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-13T06:41:20.031 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:41:20.031 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:41:20.033 INFO:teuthology.orchestra.run.smithi081.stdout:3110 trunc from 0x191327a to 0x15a4c3 2024-09-13T06:41:20.056 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:41:20.055+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:41:20.061 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:41:20.061 INFO:teuthology.orchestra.run.smithi081.stdout:3112 punch from 0x318c2 to 0x389e7, (0x7125 bytes) 2024-09-13T06:41:20.061 INFO:teuthology.orchestra.run.smithi081.stdout:3113 punch from 0xddf34 to 0xdf215, (0x12e1 bytes) 2024-09-13T06:41:20.061 INFO:teuthology.orchestra.run.smithi081.stdout:3114 punch from 0xc822d to 0xd287e, (0xa651 bytes) 2024-09-13T06:41:20.061 INFO:teuthology.orchestra.run.smithi081.stdout:3115 punch from 0x4412 to 0x8caa, (0x4898 bytes) 2024-09-13T06:41:20.081 INFO:teuthology.orchestra.run.smithi081.stdout:3116 write 0xa7da512 thru 0xa7e5142 (0xac31 bytes) 2024-09-13T06:41:20.086 INFO:teuthology.orchestra.run.smithi081.stdout:3117 read 0x40a827c thru 0x40b66e8 (0xe46d bytes) 2024-09-13T06:41:20.086 INFO:teuthology.orchestra.run.smithi081.stdout:3118 writesame 0x23040b3 thru 0x230edf1 data_size 0x1(0xad3f bytes) 2024-09-13T06:41:20.106 INFO:teuthology.orchestra.run.smithi081.stdout:3119 writesame 0x4f472bc thru 0x4f491f0 data_size 0x1(0x1f35 bytes) 2024-09-13T06:41:20.119 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:41:20.119 INFO:teuthology.orchestra.run.smithi081.stdout:3121 write 0x2ca9a3b thru 0x2cabfba (0x2580 bytes) 2024-09-13T06:41:20.124 INFO:teuthology.orchestra.run.smithi081.stdout:3122 read 0x750d54e thru 0x750f85d (0x2310 bytes) 2024-09-13T06:41:20.125 INFO:teuthology.orchestra.run.smithi081.stdout:3123 read 0x8752ba1 thru 0x875e9d3 (0xbe33 bytes) 2024-09-13T06:41:20.138 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:41:20.138+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:41:20.140 INFO:teuthology.orchestra.run.smithi081.stdout:3124 writesame 0xd1c3380 thru 0xd1c750b data_size 0xa(0x418c bytes) 2024-09-13T06:41:20.140 INFO:teuthology.orchestra.run.smithi081.stdout:3125 write 0x5be4821 thru 0x5bf0c1b (0xc3fb bytes) 2024-09-13T06:41:20.141 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:41:20.141 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [], 2024-09-13T06:41:20.141 INFO:teuthology.orchestra.run.smithi139.stdout: "complaint_time": 30, 2024-09-13T06:41:20.141 INFO:teuthology.orchestra.run.smithi139.stdout: "num_blocked_ops": 0 2024-09-13T06:41:20.142 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:41:20.147 INFO:teuthology.orchestra.run.smithi081.stdout:3126 read 0x72236d2 thru 0x7225a55 (0x2384 bytes) 2024-09-13T06:41:20.155 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-13T06:41:20.175 INFO:teuthology.orchestra.run.smithi081.stdout:3127 trunc from 0xd1c750c to 0x94a2b7 2024-09-13T06:41:20.199 INFO:teuthology.orchestra.run.smithi081.stdout:3128 read 0x223057 thru 0x2294e8 (0x6492 bytes) 2024-09-13T06:41:20.213 INFO:teuthology.orchestra.run.smithi081.stdout:3130 trunc from 0x94a2b7 to 0x5e30056 2024-09-13T06:41:20.230 INFO:teuthology.orchestra.run.smithi081.stdout:3131 trunc from 0x5e30056 to 0x74c624e 2024-09-13T06:41:20.238 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:41:20.238+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:41:20.271 INFO:teuthology.orchestra.run.smithi081.stdout:3132 write 0xd9bb954 thru 0xd9bba93 (0x140 bytes) 2024-09-13T06:41:20.280 INFO:teuthology.orchestra.run.smithi081.stdout:3134 writesame 0xd0d025b thru 0xd0d53a0 data_size 0x2(0x5146 bytes) 2024-09-13T06:41:20.297 INFO:teuthology.orchestra.run.smithi081.stdout:3135 punch from 0xa3470e4 to 0xa34ffdd, (0x8ef9 bytes) 2024-09-13T06:41:20.297 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:41:20.297 INFO:teuthology.orchestra.run.smithi081.stdout:3137 write 0x8c49cbd thru 0x8c4cc9c (0x2fe0 bytes) 2024-09-13T06:41:20.304 INFO:teuthology.orchestra.run.smithi081.stdout:3140 read 0x1ad585b thru 0x1ae4ef8 (0xf69e bytes) 2024-09-13T06:41:20.304 INFO:teuthology.orchestra.run.smithi081.stdout:3146 read 0x90f30d5 thru 0x90f958c (0x64b8 bytes) 2024-09-13T06:41:20.306 INFO:teuthology.orchestra.run.smithi081.stdout:3147 trunc from 0xd9bba94 to 0xe7cf854 2024-09-13T06:41:20.320 INFO:teuthology.orchestra.run.smithi081.stdout:3148 write 0x8aae7a5 thru 0x8aaecbf (0x51b bytes) 2024-09-13T06:41:20.324 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:41:20.324 INFO:teuthology.orchestra.run.smithi139.stdout: "size": 20, 2024-09-13T06:41:20.324 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 600, 2024-09-13T06:41:20.325 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [ 2024-09-13T06:41:20.325 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.325 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43282 3.1d 3:bd80bfb3:::rbd_object_map.11212f44bfb1.0000000000000020:head [call rbd.object_map_update in=20b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:20.325 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589032+0000", 2024-09-13T06:41:20.325 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 58.733828311000003, 2024-09-13T06:41:20.325 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.076225263000000001, 2024-09-13T06:41:20.325 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:20.325 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:41:20.325 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:20.325 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:20.325 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:20.325 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43282 2024-09-13T06:41:20.325 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.326 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:20.326 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.326 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:20.326 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589032+0000", 2024-09-13T06:41:20.326 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:20.326 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.326 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.326 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:20.326 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589032+0000", 2024-09-13T06:41:20.326 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:20.326 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.326 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.327 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:20.327 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589031+0000", 2024-09-13T06:41:20.327 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:20.327 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.327 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.327 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:20.327 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589036+0000", 2024-09-13T06:41:20.327 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.2619999999999998e-06 2024-09-13T06:41:20.327 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.327 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.327 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:20.327 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589046+0000", 2024-09-13T06:41:20.327 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.8099999999999992e-06 2024-09-13T06:41:20.328 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.328 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.328 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:20.328 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589054+0000", 2024-09-13T06:41:20.328 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.2230000000000007e-06 2024-09-13T06:41:20.328 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.328 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.328 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:20.328 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.660691+0000", 2024-09-13T06:41:20.328 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.07163659 2024-09-13T06:41:20.328 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.328 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.328 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:20.329 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.660850+0000", 2024-09-13T06:41:20.329 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00015864300000000001 2024-09-13T06:41:20.329 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.329 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.329 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 4", 2024-09-13T06:41:20.329 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.661729+0000", 2024-09-13T06:41:20.329 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00087956099999999995 2024-09-13T06:41:20.329 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.329 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.329 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:41:20.329 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.664409+0000", 2024-09-13T06:41:20.329 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0026803479999999999 2024-09-13T06:41:20.330 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.330 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.330 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-13T06:41:20.330 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.665088+0000", 2024-09-13T06:41:20.330 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00067901400000000003 2024-09-13T06:41:20.330 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.330 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.330 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-13T06:41:20.330 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.665181+0000", 2024-09-13T06:41:20.330 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.2050000000000001e-05 2024-09-13T06:41:20.330 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.330 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.330 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:20.331 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.665257+0000", 2024-09-13T06:41:20.331 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.6698000000000003e-05 2024-09-13T06:41:20.331 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:20.331 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:20.331 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:20.331 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.331 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.331 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43290 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 299008~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:20.331 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589500+0000", 2024-09-13T06:41:20.331 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 58.733360148999999, 2024-09-13T06:41:20.331 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.075898564000000002, 2024-09-13T06:41:20.331 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:20.331 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:20.332 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:20.332 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:20.332 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:20.332 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43290 2024-09-13T06:41:20.332 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.332 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:20.332 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.332 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:20.332 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589500+0000", 2024-09-13T06:41:20.332 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:20.332 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.332 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.333 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:20.333 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589500+0000", 2024-09-13T06:41:20.333 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:20.333 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.333 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.333 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:20.333 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589499+0000", 2024-09-13T06:41:20.333 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:20.333 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.333 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.333 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:20.333 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589503+0000", 2024-09-13T06:41:20.333 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.8330000000000004e-06 2024-09-13T06:41:20.334 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.334 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.334 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:20.334 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589511+0000", 2024-09-13T06:41:20.334 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.3359999999999995e-06 2024-09-13T06:41:20.334 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.334 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.334 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:20.334 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589519+0000", 2024-09-13T06:41:20.334 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.4760000000000001e-06 2024-09-13T06:41:20.334 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.334 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.335 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:20.335 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.665097+0000", 2024-09-13T06:41:20.335 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.075577828999999999 2024-09-13T06:41:20.335 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.335 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.335 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:20.335 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.665170+0000", 2024-09-13T06:41:20.335 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.3745000000000006e-05 2024-09-13T06:41:20.335 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.335 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.335 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:20.335 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.665399+0000", 2024-09-13T06:41:20.336 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00022826199999999999 2024-09-13T06:41:20.336 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:20.336 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:20.336 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:20.336 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.336 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.336 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43291 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 313344~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:20.336 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589560+0000", 2024-09-13T06:41:20.336 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 58.733299928000001, 2024-09-13T06:41:20.336 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.076145594999999996, 2024-09-13T06:41:20.336 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:20.336 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:20.336 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:20.336 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:20.337 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:20.337 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43291 2024-09-13T06:41:20.337 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.337 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:20.337 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.337 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:20.337 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589560+0000", 2024-09-13T06:41:20.337 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:20.337 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.337 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.337 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:20.337 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589560+0000", 2024-09-13T06:41:20.337 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:20.338 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.338 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.338 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:20.338 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589559+0000", 2024-09-13T06:41:20.338 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:20.338 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.338 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.338 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:20.338 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589564+0000", 2024-09-13T06:41:20.338 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.3989999999999997e-06 2024-09-13T06:41:20.338 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.338 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.338 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:20.338 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589574+0000", 2024-09-13T06:41:20.339 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0502999999999999e-05 2024-09-13T06:41:20.339 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.339 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.339 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:20.339 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589582+0000", 2024-09-13T06:41:20.339 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.1859999999999992e-06 2024-09-13T06:41:20.339 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.339 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.339 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:20.339 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.665423+0000", 2024-09-13T06:41:20.339 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.075840290000000005 2024-09-13T06:41:20.339 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.339 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.340 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:20.340 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.665496+0000", 2024-09-13T06:41:20.340 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.2791000000000002e-05 2024-09-13T06:41:20.340 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.340 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.340 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:20.340 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.665706+0000", 2024-09-13T06:41:20.340 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00021038200000000001 2024-09-13T06:41:20.340 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:20.340 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:20.340 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:20.340 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.340 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.341 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43292 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 327680~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:20.341 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589589+0000", 2024-09-13T06:41:20.341 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 58.733271387000002, 2024-09-13T06:41:20.341 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.076769537999999998, 2024-09-13T06:41:20.341 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:20.341 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:20.341 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:20.341 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:20.341 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:20.341 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43292 2024-09-13T06:41:20.341 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.341 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:20.342 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.342 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:20.342 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589589+0000", 2024-09-13T06:41:20.342 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:20.342 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.342 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.342 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:20.342 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589589+0000", 2024-09-13T06:41:20.342 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:20.342 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.342 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.342 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:20.342 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589588+0000", 2024-09-13T06:41:20.343 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:20.343 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.343 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.343 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:20.343 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589592+0000", 2024-09-13T06:41:20.343 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.6389999999999998e-06 2024-09-13T06:41:20.343 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.343 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.343 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:20.343 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589600+0000", 2024-09-13T06:41:20.343 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.4630000000000001e-06 2024-09-13T06:41:20.343 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.343 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.344 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:20.344 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589608+0000", 2024-09-13T06:41:20.344 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.2359999999999998e-06 2024-09-13T06:41:20.344 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.344 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.344 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:20.344 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.665779+0000", 2024-09-13T06:41:20.344 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.076170924000000001 2024-09-13T06:41:20.344 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.344 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.344 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:20.344 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.665977+0000", 2024-09-13T06:41:20.344 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00019891900000000001 2024-09-13T06:41:20.345 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.345 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.345 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:20.345 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.666358+0000", 2024-09-13T06:41:20.345 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000380963 2024-09-13T06:41:20.345 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:20.345 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:20.345 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:20.345 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.345 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.345 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43293 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 342016~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:20.345 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589616+0000", 2024-09-13T06:41:20.345 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 58.733244493000001, 2024-09-13T06:41:20.346 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.077030083999999999, 2024-09-13T06:41:20.346 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:20.346 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:20.346 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:20.346 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:20.346 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:20.346 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43293 2024-09-13T06:41:20.346 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.346 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:20.346 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.346 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:20.346 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589616+0000", 2024-09-13T06:41:20.346 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:20.346 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.347 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.347 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:20.347 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589616+0000", 2024-09-13T06:41:20.347 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:20.347 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.347 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.347 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:20.347 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589615+0000", 2024-09-13T06:41:20.347 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:20.347 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.347 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.347 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:20.347 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589619+0000", 2024-09-13T06:41:20.347 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.9559999999999999e-06 2024-09-13T06:41:20.348 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.348 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.348 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:20.348 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589627+0000", 2024-09-13T06:41:20.348 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.2490000000000001e-06 2024-09-13T06:41:20.348 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.348 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.348 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:20.348 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589635+0000", 2024-09-13T06:41:20.348 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.96e-06 2024-09-13T06:41:20.348 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.348 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.348 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:20.348 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.666379+0000", 2024-09-13T06:41:20.349 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.076744484000000002 2024-09-13T06:41:20.349 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.349 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.349 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:20.349 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.666454+0000", 2024-09-13T06:41:20.349 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.4623999999999996e-05 2024-09-13T06:41:20.349 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.349 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.349 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:20.349 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.666646+0000", 2024-09-13T06:41:20.349 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00019176999999999999 2024-09-13T06:41:20.349 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:20.350 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:20.350 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:20.350 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.350 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.350 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43294 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 356352~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:20.350 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589681+0000", 2024-09-13T06:41:20.350 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 58.733179178, 2024-09-13T06:41:20.350 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.077594648000000002, 2024-09-13T06:41:20.350 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:20.350 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:20.350 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:20.350 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:20.350 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:20.351 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43294 2024-09-13T06:41:20.351 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.351 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:20.351 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.351 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:20.351 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589681+0000", 2024-09-13T06:41:20.351 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:20.351 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.351 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.351 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:20.351 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589681+0000", 2024-09-13T06:41:20.351 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:20.351 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.352 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.352 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:20.352 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589680+0000", 2024-09-13T06:41:20.352 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:20.352 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.352 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.352 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:20.352 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589684+0000", 2024-09-13T06:41:20.352 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.8369999999999999e-06 2024-09-13T06:41:20.352 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.352 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.352 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:20.353 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589693+0000", 2024-09-13T06:41:20.353 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.1020000000000003e-06 2024-09-13T06:41:20.353 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.353 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.353 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:20.353 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589701+0000", 2024-09-13T06:41:20.353 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.8059999999999995e-06 2024-09-13T06:41:20.353 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.353 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.353 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:20.353 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.666714+0000", 2024-09-13T06:41:20.353 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.077013463000000004 2024-09-13T06:41:20.353 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.353 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.354 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:20.354 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.666897+0000", 2024-09-13T06:41:20.354 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000182268 2024-09-13T06:41:20.354 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.354 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.354 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:20.354 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.667276+0000", 2024-09-13T06:41:20.354 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00037907499999999998 2024-09-13T06:41:20.354 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:20.354 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:20.354 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:20.354 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.354 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.355 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43295 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 370688~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:20.355 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589744+0000", 2024-09-13T06:41:20.355 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 58.733116006000003, 2024-09-13T06:41:20.355 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.077854343000000006, 2024-09-13T06:41:20.355 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:20.355 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:20.355 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:20.355 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:20.355 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:20.355 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43295 2024-09-13T06:41:20.355 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.355 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:20.356 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.356 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:20.356 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589744+0000", 2024-09-13T06:41:20.356 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:20.356 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.356 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.356 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:20.356 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589744+0000", 2024-09-13T06:41:20.356 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:20.356 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.356 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.356 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:20.357 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589743+0000", 2024-09-13T06:41:20.357 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:20.357 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.357 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.357 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:20.357 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589747+0000", 2024-09-13T06:41:20.357 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0130000000000004e-06 2024-09-13T06:41:20.357 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.357 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.357 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:20.357 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589756+0000", 2024-09-13T06:41:20.357 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.003e-06 2024-09-13T06:41:20.357 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.358 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.358 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:20.358 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589766+0000", 2024-09-13T06:41:20.358 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.2820000000000002e-06 2024-09-13T06:41:20.358 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.358 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.358 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:20.358 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.667300+0000", 2024-09-13T06:41:20.358 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.077534299000000001 2024-09-13T06:41:20.358 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.358 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.358 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:20.359 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.667372+0000", 2024-09-13T06:41:20.359 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.2393999999999998e-05 2024-09-13T06:41:20.359 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.359 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.359 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:20.359 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.667599+0000", 2024-09-13T06:41:20.359 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000226269 2024-09-13T06:41:20.359 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:20.359 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:20.359 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:20.359 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.359 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.359 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43296 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 385024~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:20.360 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589772+0000", 2024-09-13T06:41:20.360 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 58.733087982000001, 2024-09-13T06:41:20.360 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.078469647000000003, 2024-09-13T06:41:20.360 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:20.360 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:20.360 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:20.360 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:20.360 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:20.360 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43296 2024-09-13T06:41:20.360 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.360 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:20.360 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.360 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:20.361 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589772+0000", 2024-09-13T06:41:20.361 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:20.361 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.361 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.361 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:20.361 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589772+0000", 2024-09-13T06:41:20.361 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:20.361 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.361 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.361 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:20.361 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589771+0000", 2024-09-13T06:41:20.361 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:20.361 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.362 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.362 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:20.362 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589775+0000", 2024-09-13T06:41:20.362 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.8530000000000002e-06 2024-09-13T06:41:20.362 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.362 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.362 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:20.362 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589784+0000", 2024-09-13T06:41:20.362 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.4300000000000006e-06 2024-09-13T06:41:20.362 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.362 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.362 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:20.362 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589791+0000", 2024-09-13T06:41:20.362 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.4660000000000002e-06 2024-09-13T06:41:20.363 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.363 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.363 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:20.363 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.667667+0000", 2024-09-13T06:41:20.363 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.077875697999999993 2024-09-13T06:41:20.363 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.363 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.363 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:20.363 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.667854+0000", 2024-09-13T06:41:20.363 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00018760099999999999 2024-09-13T06:41:20.363 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.363 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.363 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:20.364 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.668242+0000", 2024-09-13T06:41:20.364 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00038750600000000003 2024-09-13T06:41:20.364 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:20.364 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:20.364 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:20.364 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.364 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.364 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43297 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 403456~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:20.364 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589797+0000", 2024-09-13T06:41:20.364 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 58.733063278000003, 2024-09-13T06:41:20.364 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.078756672999999999, 2024-09-13T06:41:20.364 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:20.364 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:20.364 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:20.365 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:20.365 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:20.365 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43297 2024-09-13T06:41:20.365 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.365 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:20.365 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.365 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:20.365 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589797+0000", 2024-09-13T06:41:20.365 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:20.365 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.365 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.365 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:20.365 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589797+0000", 2024-09-13T06:41:20.366 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:20.366 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.366 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.366 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:20.366 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589796+0000", 2024-09-13T06:41:20.366 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:20.366 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.366 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.366 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:20.366 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589800+0000", 2024-09-13T06:41:20.366 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.3230000000000002e-06 2024-09-13T06:41:20.366 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.366 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.366 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:20.366 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589808+0000", 2024-09-13T06:41:20.367 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.2390000000000002e-06 2024-09-13T06:41:20.367 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.367 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.367 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:20.367 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589815+0000", 2024-09-13T06:41:20.367 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.413e-06 2024-09-13T06:41:20.367 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.367 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.367 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:20.367 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.668265+0000", 2024-09-13T06:41:20.367 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.078449873000000003 2024-09-13T06:41:20.367 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.367 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.368 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:20.368 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.668332+0000", 2024-09-13T06:41:20.368 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.7178e-05 2024-09-13T06:41:20.368 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.368 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.368 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:20.368 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.668554+0000", 2024-09-13T06:41:20.368 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00022128600000000001 2024-09-13T06:41:20.368 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:20.368 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:20.368 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:20.368 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.368 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.369 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43298 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 417792~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:20.369 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589821+0000", 2024-09-13T06:41:20.369 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 58.733039155999997, 2024-09-13T06:41:20.369 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.079368660999999993, 2024-09-13T06:41:20.369 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:20.369 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:20.369 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:20.369 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:20.369 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:20.369 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43298 2024-09-13T06:41:20.369 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.369 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:20.370 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.370 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:20.370 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589821+0000", 2024-09-13T06:41:20.370 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:20.370 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.370 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.370 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:20.370 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589821+0000", 2024-09-13T06:41:20.370 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:20.370 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.370 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.370 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:20.370 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589821+0000", 2024-09-13T06:41:20.371 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:20.371 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.371 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.371 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:20.371 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589830+0000", 2024-09-13T06:41:20.371 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.4860000000000003e-06 2024-09-13T06:41:20.371 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.371 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.371 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:20.371 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589839+0000", 2024-09-13T06:41:20.371 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.0159999999999997e-06 2024-09-13T06:41:20.371 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.371 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.372 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:20.372 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589847+0000", 2024-09-13T06:41:20.372 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.6059999999999997e-06 2024-09-13T06:41:20.372 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.372 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.372 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:20.372 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.668620+0000", 2024-09-13T06:41:20.372 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.078773485000000004 2024-09-13T06:41:20.372 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.372 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.372 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:20.372 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.668798+0000", 2024-09-13T06:41:20.373 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000178233 2024-09-13T06:41:20.373 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.373 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.373 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:20.373 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.669190+0000", 2024-09-13T06:41:20.373 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00039143499999999998 2024-09-13T06:41:20.373 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:20.373 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:20.373 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:20.373 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.373 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.373 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43299 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 432128~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:20.373 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589881+0000", 2024-09-13T06:41:20.374 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 58.732979307999997, 2024-09-13T06:41:20.374 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.079693849999999997, 2024-09-13T06:41:20.374 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:20.374 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:20.374 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:20.374 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:20.374 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:20.374 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43299 2024-09-13T06:41:20.374 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.374 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:20.374 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.374 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:20.374 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589881+0000", 2024-09-13T06:41:20.374 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:20.375 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.375 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.375 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:20.375 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589881+0000", 2024-09-13T06:41:20.375 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:20.375 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.375 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.375 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:20.375 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589880+0000", 2024-09-13T06:41:20.375 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:20.375 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.375 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.376 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:20.376 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589884+0000", 2024-09-13T06:41:20.376 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.053e-06 2024-09-13T06:41:20.376 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.376 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.376 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:20.376 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589893+0000", 2024-09-13T06:41:20.376 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.2129999999999997e-06 2024-09-13T06:41:20.376 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.376 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.376 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:20.376 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589901+0000", 2024-09-13T06:41:20.376 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.6399999999999997e-06 2024-09-13T06:41:20.376 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.377 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.377 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:20.377 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.669213+0000", 2024-09-13T06:41:20.377 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.079312074999999996 2024-09-13T06:41:20.377 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.377 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.377 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:20.377 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.669281+0000", 2024-09-13T06:41:20.377 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.8322000000000001e-05 2024-09-13T06:41:20.378 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.378 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.378 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:20.378 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.669575+0000", 2024-09-13T06:41:20.378 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00029349699999999999 2024-09-13T06:41:20.378 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:20.378 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:20.378 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:20.378 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.378 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.378 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43300 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 446464~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:20.378 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589909+0000", 2024-09-13T06:41:20.378 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 58.732951413000002, 2024-09-13T06:41:20.379 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.080339496999999996, 2024-09-13T06:41:20.379 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:20.379 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:20.379 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:20.379 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:20.379 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:20.379 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43300 2024-09-13T06:41:20.379 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.379 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:20.379 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.379 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:20.379 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589909+0000", 2024-09-13T06:41:20.379 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:20.379 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.379 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.380 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:20.380 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589909+0000", 2024-09-13T06:41:20.380 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:20.380 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.380 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.380 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:20.380 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589908+0000", 2024-09-13T06:41:20.380 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:20.380 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.380 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.380 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:20.380 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589912+0000", 2024-09-13T06:41:20.381 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.9430000000000002e-06 2024-09-13T06:41:20.381 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.381 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.381 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:20.381 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589920+0000", 2024-09-13T06:41:20.381 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.3860000000000007e-06 2024-09-13T06:41:20.381 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.381 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.381 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:20.381 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589928+0000", 2024-09-13T06:41:20.381 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.3329999999999999e-06 2024-09-13T06:41:20.381 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.381 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.382 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:20.382 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.669651+0000", 2024-09-13T06:41:20.382 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.079723204000000006 2024-09-13T06:41:20.382 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.382 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.382 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:20.382 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.669840+0000", 2024-09-13T06:41:20.382 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000189397 2024-09-13T06:41:20.382 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.382 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.382 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:20.382 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.670248+0000", 2024-09-13T06:41:20.382 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00040811100000000001 2024-09-13T06:41:20.383 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:20.383 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:20.383 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:20.383 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.383 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.383 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43301 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 460800~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:20.383 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589934+0000", 2024-09-13T06:41:20.383 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 58.732926739, 2024-09-13T06:41:20.383 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.080747474999999999, 2024-09-13T06:41:20.383 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:20.383 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:20.383 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:20.384 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:20.384 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:20.384 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43301 2024-09-13T06:41:20.384 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.384 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:20.384 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.384 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:20.384 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589934+0000", 2024-09-13T06:41:20.384 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:20.384 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.384 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.384 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:20.385 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589934+0000", 2024-09-13T06:41:20.385 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:20.385 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.385 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.385 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:20.385 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589933+0000", 2024-09-13T06:41:20.385 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:20.385 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.385 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.385 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:20.385 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589936+0000", 2024-09-13T06:41:20.385 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.4599999999999999e-06 2024-09-13T06:41:20.386 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.386 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.386 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:20.386 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589945+0000", 2024-09-13T06:41:20.386 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.2430000000000005e-06 2024-09-13T06:41:20.386 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.386 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.386 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:20.386 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589952+0000", 2024-09-13T06:41:20.386 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.3289999999999996e-06 2024-09-13T06:41:20.386 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.386 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.386 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:20.387 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.670280+0000", 2024-09-13T06:41:20.387 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.080328514000000004 2024-09-13T06:41:20.387 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.387 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.387 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:20.387 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.670376+0000", 2024-09-13T06:41:20.387 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.5752000000000001e-05 2024-09-13T06:41:20.387 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.387 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.387 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:20.387 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.670681+0000", 2024-09-13T06:41:20.387 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00030479699999999999 2024-09-13T06:41:20.387 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:20.387 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:20.388 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:20.388 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.388 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.388 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43302 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 475136~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:20.388 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589958+0000", 2024-09-13T06:41:20.388 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 58.732902676999998, 2024-09-13T06:41:20.388 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.081402394000000003, 2024-09-13T06:41:20.388 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:20.388 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:20.388 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:20.388 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:20.388 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:20.389 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43302 2024-09-13T06:41:20.389 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.389 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:20.389 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.389 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:20.389 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589958+0000", 2024-09-13T06:41:20.389 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:20.389 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.389 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.389 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:20.389 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589958+0000", 2024-09-13T06:41:20.389 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:20.390 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.390 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.390 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:20.390 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589957+0000", 2024-09-13T06:41:20.390 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:20.390 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.390 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.390 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:20.390 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589960+0000", 2024-09-13T06:41:20.390 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.4939999999999999e-06 2024-09-13T06:41:20.390 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.390 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.390 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:20.391 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589969+0000", 2024-09-13T06:41:20.391 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.3520000000000007e-06 2024-09-13T06:41:20.391 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.391 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.391 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:20.391 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589976+0000", 2024-09-13T06:41:20.391 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.3030000000000002e-06 2024-09-13T06:41:20.391 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.391 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.391 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:20.391 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.670765+0000", 2024-09-13T06:41:20.391 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.080789154000000002 2024-09-13T06:41:20.391 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.392 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.392 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:20.392 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.670960+0000", 2024-09-13T06:41:20.392 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00019464300000000001 2024-09-13T06:41:20.392 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.392 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.392 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:20.392 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.671360+0000", 2024-09-13T06:41:20.392 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00040005200000000002 2024-09-13T06:41:20.392 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:20.392 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:20.392 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:20.392 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.393 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.393 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43303 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 489472~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:20.393 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589985+0000", 2024-09-13T06:41:20.393 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 58.732875729, 2024-09-13T06:41:20.393 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.082024333000000005, 2024-09-13T06:41:20.393 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:20.393 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:20.393 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:20.393 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:20.393 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:20.393 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43303 2024-09-13T06:41:20.393 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.394 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:20.394 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.394 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:20.394 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589985+0000", 2024-09-13T06:41:20.394 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:20.394 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.394 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.394 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:20.394 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589985+0000", 2024-09-13T06:41:20.394 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:20.394 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.394 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.394 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:20.395 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589984+0000", 2024-09-13T06:41:20.395 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:20.395 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.395 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.395 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:20.395 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589987+0000", 2024-09-13T06:41:20.395 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.726e-06 2024-09-13T06:41:20.395 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.395 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.395 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:20.395 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589996+0000", 2024-09-13T06:41:20.395 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.5459999999999992e-06 2024-09-13T06:41:20.395 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.396 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.396 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:20.396 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590003+0000", 2024-09-13T06:41:20.396 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.4229999999999999e-06 2024-09-13T06:41:20.396 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.396 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.396 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:20.396 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.671426+0000", 2024-09-13T06:41:20.396 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.081422704999999998 2024-09-13T06:41:20.396 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.396 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.396 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:20.396 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.671615+0000", 2024-09-13T06:41:20.397 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000188875 2024-09-13T06:41:20.397 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.397 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.397 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:20.397 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.672009+0000", 2024-09-13T06:41:20.397 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000394015 2024-09-13T06:41:20.397 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:20.397 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:20.397 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:20.397 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.397 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.397 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43304 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 503808~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:20.397 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.590039+0000", 2024-09-13T06:41:20.398 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 58.732821184000002, 2024-09-13T06:41:20.398 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.082573880000000002, 2024-09-13T06:41:20.398 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:20.398 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:20.398 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:20.398 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:20.398 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:20.398 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43304 2024-09-13T06:41:20.398 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.398 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:20.398 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.398 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:20.398 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590039+0000", 2024-09-13T06:41:20.399 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:20.399 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.399 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.399 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:20.399 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590039+0000", 2024-09-13T06:41:20.399 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:20.399 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.399 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.399 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:20.399 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590038+0000", 2024-09-13T06:41:20.399 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:20.399 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.399 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.400 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:20.400 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590042+0000", 2024-09-13T06:41:20.400 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.9500000000000003e-06 2024-09-13T06:41:20.400 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.400 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.400 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:20.400 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590052+0000", 2024-09-13T06:41:20.400 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.3919999999999992e-06 2024-09-13T06:41:20.400 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.400 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.400 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:20.400 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590059+0000", 2024-09-13T06:41:20.401 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.7970000000000001e-06 2024-09-13T06:41:20.401 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.401 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.401 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:20.401 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.672078+0000", 2024-09-13T06:41:20.401 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.082018778000000001 2024-09-13T06:41:20.401 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.401 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.401 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:20.401 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.672266+0000", 2024-09-13T06:41:20.401 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00018807399999999999 2024-09-13T06:41:20.401 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.401 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.401 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:20.402 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.672613+0000", 2024-09-13T06:41:20.402 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00034677599999999997 2024-09-13T06:41:20.402 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:20.402 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:20.402 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:20.402 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.402 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.402 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43305 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 518144~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:20.402 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.590136+0000", 2024-09-13T06:41:20.402 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 58.732723995999997, 2024-09-13T06:41:20.402 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.082988206999999994, 2024-09-13T06:41:20.402 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:20.402 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:20.402 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:20.403 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:20.403 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:20.403 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43305 2024-09-13T06:41:20.403 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.403 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:20.403 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.403 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:20.403 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590136+0000", 2024-09-13T06:41:20.403 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:20.403 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.403 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.403 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:20.403 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590136+0000", 2024-09-13T06:41:20.403 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:20.404 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.404 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.404 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:20.404 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590135+0000", 2024-09-13T06:41:20.404 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:20.404 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.404 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.404 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:20.404 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590139+0000", 2024-09-13T06:41:20.404 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.9489999999999998e-06 2024-09-13T06:41:20.404 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.404 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.404 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:20.405 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590148+0000", 2024-09-13T06:41:20.405 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.9830000000000002e-06 2024-09-13T06:41:20.405 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.405 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.405 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:20.405 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590156+0000", 2024-09-13T06:41:20.405 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5229999999999998e-06 2024-09-13T06:41:20.405 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.405 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.405 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:20.405 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.672709+0000", 2024-09-13T06:41:20.405 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.082552886000000006 2024-09-13T06:41:20.405 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.406 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.406 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:20.406 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.672816+0000", 2024-09-13T06:41:20.406 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000107736 2024-09-13T06:41:20.406 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.406 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.406 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:20.406 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.673124+0000", 2024-09-13T06:41:20.406 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00030804900000000002 2024-09-13T06:41:20.406 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:20.406 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:20.406 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:20.406 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.407 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.407 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:66818 3.17 3.50afe697 (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e100)", 2024-09-13T06:41:20.407 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:53.498942+0000", 2024-09-13T06:41:20.407 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 26.823917811000001, 2024-09-13T06:41:20.407 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.011231284, 2024-09-13T06:41:20.407 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:20.407 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:41:20.407 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:20.407 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:20.407 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:20.407 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 66818 2024-09-13T06:41:20.407 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.407 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:20.407 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.408 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:20.408 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:53.498942+0000", 2024-09-13T06:41:20.408 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:20.408 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.408 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.408 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:20.408 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:53.498942+0000", 2024-09-13T06:41:20.408 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:20.408 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.408 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.408 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:20.408 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:53.498939+0000", 2024-09-13T06:41:20.408 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999967 2024-09-13T06:41:20.409 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.409 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.409 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:20.409 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:53.498954+0000", 2024-09-13T06:41:20.409 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5028000000000001e-05 2024-09-13T06:41:20.409 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.409 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.409 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:20.409 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:53.498986+0000", 2024-09-13T06:41:20.409 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.1993999999999999e-05 2024-09-13T06:41:20.409 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.409 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.409 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:20.410 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:53.499001+0000", 2024-09-13T06:41:20.410 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5166e-05 2024-09-13T06:41:20.410 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.410 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.410 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:20.410 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:53.505097+0000", 2024-09-13T06:41:20.410 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0060955610000000002 2024-09-13T06:41:20.410 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.410 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.410 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:41:20.410 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:53.505108+0000", 2024-09-13T06:41:20.410 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.084e-05 2024-09-13T06:41:20.410 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.410 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.411 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:20.411 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:54.510158+0000", 2024-09-13T06:41:20.411 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0050497549999999 2024-09-13T06:41:20.411 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.411 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.411 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:20.411 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:54.510174+0000", 2024-09-13T06:41:20.411 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6164e-05 2024-09-13T06:41:20.411 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:20.411 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:20.411 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:20.411 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.411 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.412 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:69764 3.2 3:47f10058:::rbd_data.11214956a993.0000000000000004:head [write-same] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e117)", 2024-09-13T06:41:20.412 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:41:11.371147+0000", 2024-09-13T06:41:20.412 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 8.9517135010000004, 2024-09-13T06:41:20.412 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.03470167, 2024-09-13T06:41:20.412 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:20.412 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:41:20.412 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:20.412 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:20.412 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:20.412 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 69764 2024-09-13T06:41:20.412 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.412 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:20.412 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.412 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:20.413 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:11.371147+0000", 2024-09-13T06:41:20.413 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:20.413 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.413 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.413 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:20.413 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:11.371147+0000", 2024-09-13T06:41:20.413 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:20.413 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.413 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.413 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:20.413 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:11.371144+0000", 2024-09-13T06:41:20.413 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999967 2024-09-13T06:41:20.413 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.414 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.414 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:20.414 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:11.371161+0000", 2024-09-13T06:41:20.414 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7669e-05 2024-09-13T06:41:20.414 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.414 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.414 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:20.414 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:11.371198+0000", 2024-09-13T06:41:20.414 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.7014000000000002e-05 2024-09-13T06:41:20.414 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.414 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.414 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:20.414 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:11.371216+0000", 2024-09-13T06:41:20.415 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7425e-05 2024-09-13T06:41:20.415 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.415 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.415 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:20.415 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:11.371365+0000", 2024-09-13T06:41:20.415 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000149245 2024-09-13T06:41:20.415 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.415 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.415 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op must wait for map", 2024-09-13T06:41:20.415 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:11.371385+0000", 2024-09-13T06:41:20.415 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.0018999999999999e-05 2024-09-13T06:41:20.415 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.415 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.416 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:20.416 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:11.378406+0000", 2024-09-13T06:41:20.416 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0070207179999999996 2024-09-13T06:41:20.416 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.416 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.416 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:41:20.416 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:11.378429+0000", 2024-09-13T06:41:20.416 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.3453999999999999e-05 2024-09-13T06:41:20.416 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.416 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.416 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:20.416 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:12.405667+0000", 2024-09-13T06:41:20.416 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0272381690000001 2024-09-13T06:41:20.416 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.417 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.417 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:20.417 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:12.405848+0000", 2024-09-13T06:41:20.417 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00018112 2024-09-13T06:41:20.417 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:20.417 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:20.417 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:20.417 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.417 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.417 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:70346 3.16 3:69d35907:::rbd_object_map.11214956a993:head [read 0~36] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e122)", 2024-09-13T06:41:20.417 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:41:16.390917+0000", 2024-09-13T06:41:20.417 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 3.9319434490000003, 2024-09-13T06:41:20.417 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.99327479799999996, 2024-09-13T06:41:20.417 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:20.418 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:20.418 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:20.418 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:20.418 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:20.418 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 70346 2024-09-13T06:41:20.418 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.418 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:20.418 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.418 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:20.418 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:16.390917+0000", 2024-09-13T06:41:20.418 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:20.418 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.418 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.419 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:20.419 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:16.390917+0000", 2024-09-13T06:41:20.419 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:20.419 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.419 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.419 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:20.419 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:16.390916+0000", 2024-09-13T06:41:20.419 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999986 2024-09-13T06:41:20.419 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.419 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.419 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:20.419 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:16.390922+0000", 2024-09-13T06:41:20.419 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.0480000000000004e-06 2024-09-13T06:41:20.419 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.420 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.420 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:20.420 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:16.390933+0000", 2024-09-13T06:41:20.420 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1387e-05 2024-09-13T06:41:20.420 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.420 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.420 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:20.420 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:16.390939+0000", 2024-09-13T06:41:20.420 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.8039999999999998e-06 2024-09-13T06:41:20.420 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.420 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.420 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:20.420 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:16.390983+0000", 2024-09-13T06:41:20.421 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.4663000000000003e-05 2024-09-13T06:41:20.421 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.421 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.421 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:41:20.421 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:16.390991+0000", 2024-09-13T06:41:20.421 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.8059999999999995e-06 2024-09-13T06:41:20.421 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.421 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.421 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:20.421 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:17.383624+0000", 2024-09-13T06:41:20.421 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.99263277299999997 2024-09-13T06:41:20.421 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.421 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.422 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:20.422 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:17.383891+0000", 2024-09-13T06:41:20.422 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00026717599999999999 2024-09-13T06:41:20.422 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.422 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.422 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:20.422 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:17.384192+0000", 2024-09-13T06:41:20.422 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00030047400000000001 2024-09-13T06:41:20.422 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:20.422 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:20.422 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:20.422 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:20.422 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:20.422 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:41:20.425 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-13T06:41:20.425 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:41:20.423+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:41:20.426 INFO:teuthology.orchestra.run.smithi081.stdout:3149 trunc from 0xe7cf854 to 0xabab4ca 2024-09-13T06:41:20.426 INFO:teuthology.orchestra.run.smithi081.stdout:3150 read 0xa0d3174 thru 0xa0dba57 (0x88e4 bytes) 2024-09-13T06:41:20.426 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:41:20.427 INFO:teuthology.orchestra.run.smithi081.stdout:3152 read 0x4b9d37a thru 0x4ba8a0c (0xb693 bytes) 2024-09-13T06:41:20.427 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:41:20.427 INFO:teuthology.orchestra.run.smithi081.stdout:3155 punch from 0x34d12f1 to 0x34df3bb, (0xe0ca bytes) 2024-09-13T06:41:20.427 INFO:teuthology.orchestra.run.smithi081.stdout:3157 write 0x392bf91 thru 0x3934c44 (0x8cb4 bytes) 2024-09-13T06:41:20.427 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:41:20.427 INFO:teuthology.orchestra.run.smithi081.stdout:3160 read 0x4c46dd9 thru 0x4c4c229 (0x5451 bytes) 2024-09-13T06:41:20.427 INFO:teuthology.orchestra.run.smithi081.stdout:3161 trunc from 0xabab4ca to 0xdb997d8 2024-09-13T06:41:20.427 INFO:teuthology.orchestra.run.smithi081.stdout:3163 read 0x88c12d8 thru 0x88cfe98 (0xebc1 bytes) 2024-09-13T06:41:20.427 INFO:teuthology.orchestra.run.smithi081.stdout:3165 read 0x27da903 thru 0x27e18bd (0x6fbb bytes) 2024-09-13T06:41:20.427 INFO:teuthology.orchestra.run.smithi081.stdout:3166 write 0xb5b507b thru 0xb5b8e8e (0x3e14 bytes) 2024-09-13T06:41:20.427 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:41:20.427 INFO:teuthology.orchestra.run.smithi081.stdout:3169 writesame 0xdcedb3f thru 0xdcfa8b1 data_size 0x5(0xcd73 bytes) 2024-09-13T06:41:20.427 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:41:20.427 INFO:teuthology.orchestra.run.smithi081.stdout:3178 write 0x9b4a289 thru 0x9b4efb8 (0x4d30 bytes) 2024-09-13T06:41:20.428 INFO:teuthology.orchestra.run.smithi081.stdout:3181 write 0x4e1bb28 thru 0x4e27c39 (0xc112 bytes) 2024-09-13T06:41:20.428 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:41:20.428 INFO:teuthology.orchestra.run.smithi081.stdout:3183 write 0xd07b240 thru 0xd08956a (0xe32b bytes) 2024-09-13T06:41:20.428 INFO:teuthology.orchestra.run.smithi081.stdout:3184 writesame 0x77af5d5 thru 0x77b2a58 data_size 0x2(0x3484 bytes) 2024-09-13T06:41:20.437 INFO:teuthology.orchestra.run.smithi081.stdout:3186 writesame 0x62ee0d6 thru 0x62fd52f data_size 0x1(0xf45a bytes) 2024-09-13T06:41:20.450 INFO:teuthology.orchestra.run.smithi081.stderr:noscrub is unset 2024-09-13T06:41:20.484 INFO:teuthology.orchestra.run.smithi081.stdout:3187 read 0x1308d4c thru 0x1311b9d (0x8e52 bytes) 2024-09-13T06:41:20.484 INFO:teuthology.orchestra.run.smithi081.stdout:3188 write 0x5411e8a thru 0x541b7b2 (0x9929 bytes) 2024-09-13T06:41:20.491 INFO:teuthology.orchestra.run.smithi081.stdout:3189 write 0x6bb2057 thru 0x6bb4d1c (0x2cc6 bytes) 2024-09-13T06:41:20.505 INFO:teuthology.orchestra.run.smithi081.stdout:3190 trunc from 0xdcfa8b2 to 0x73e59ec 2024-09-13T06:41:20.525 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:41:20.522+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:41:20.526 INFO:teuthology.orchestra.run.smithi081.stdout:3191 read 0x4bcd8e4 thru 0x4bdbe08 (0xe525 bytes) 2024-09-13T06:41:20.526 INFO:teuthology.orchestra.run.smithi081.stdout:3192 read 0x1ffb9cc thru 0x20049c9 (0x8ffe bytes) 2024-09-13T06:41:20.544 INFO:teuthology.orchestra.run.smithi081.stdout:3193 write 0xd1a492a thru 0xd1b3859 (0xef30 bytes) 2024-09-13T06:41:20.548 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:41:20.548 INFO:teuthology.orchestra.run.smithi081.stdout:3196 writesame 0x22960aa thru 0x229b15d data_size 0xa(0x50b4 bytes) 2024-09-13T06:41:20.552 INFO:teuthology.orchestra.run.smithi081.stdout:3197 read 0x1de5cc0 thru 0x1deff68 (0xa2a9 bytes) 2024-09-13T06:41:20.552 INFO:teuthology.orchestra.run.smithi081.stdout:3198 read 0x43da4e7 thru 0x43e183c (0x7356 bytes) 2024-09-13T06:41:20.552 INFO:teuthology.orchestra.run.smithi081.stdout:3200 read 0x8066f07 thru 0x8072882 (0xb97c bytes) 2024-09-13T06:41:20.552 INFO:teuthology.orchestra.run.smithi081.stdout:3202 read 0xaefe9b6 thru 0xaf03ab6 (0x5101 bytes) 2024-09-13T06:41:20.552 INFO:teuthology.orchestra.run.smithi081.stdout:3203 write 0x3414621 thru 0x3414e5a (0x83a bytes) 2024-09-13T06:41:20.555 INFO:teuthology.orchestra.run.smithi081.stdout:3204 write 0x827f01a thru 0x828b65e (0xc645 bytes) 2024-09-13T06:41:20.561 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:41:20.561 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:41:20.561 INFO:teuthology.orchestra.run.smithi081.stdout:3210 read 0x52fe69 thru 0x533942 (0x3ada bytes) 2024-09-13T06:41:20.561 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:41:20.561 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:41:20.561 INFO:teuthology.orchestra.run.smithi081.stdout:3213 read 0x6e50e8e thru 0x6e5c30d (0xb480 bytes) 2024-09-13T06:41:20.561 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:41:20.561 INFO:teuthology.orchestra.run.smithi081.stdout:3219 punch from 0xbac083c to 0xbac63d2, (0x5b96 bytes) 2024-09-13T06:41:20.561 INFO:teuthology.orchestra.run.smithi081.stdout:3220 punch from 0x150b759 to 0x1511e27, (0x66ce bytes) 2024-09-13T06:41:20.562 INFO:teuthology.orchestra.run.smithi081.stdout:3221 read 0xc6bf185 thru 0xc6c104a (0x1ec6 bytes) 2024-09-13T06:41:20.564 INFO:teuthology.orchestra.run.smithi081.stdout:3222 trunc from 0xd1b385a to 0xb55247f 2024-09-13T06:41:20.580 INFO:teuthology.orchestra.run.smithi081.stdout:3225 read 0x377c805 thru 0x3786484 (0x9c80 bytes) 2024-09-13T06:41:20.580 INFO:teuthology.orchestra.run.smithi081.stdout:3226 write 0x5d182d3 thru 0x5d206d3 (0x8401 bytes) 2024-09-13T06:41:20.586 INFO:teuthology.orchestra.run.smithi081.stdout:3227 punch from 0x1f74d2f to 0x1f78344, (0x3615 bytes) 2024-09-13T06:41:20.586 INFO:teuthology.orchestra.run.smithi081.stdout:3228 writesame 0xb4029e3 thru 0xb40b457 data_size 0x55(0x8a75 bytes) 2024-09-13T06:41:20.593 INFO:teuthology.orchestra.run.smithi081.stdout:3229 read 0xf57530 thru 0xf57750 (0x221 bytes) 2024-09-13T06:41:20.593 INFO:teuthology.orchestra.run.smithi081.stdout:3230 punch from 0x5d952de to 0x5d9690d, (0x162f bytes) 2024-09-13T06:41:20.593 INFO:teuthology.orchestra.run.smithi081.stdout:3231 write 0x9269fd8 thru 0x926e193 (0x41bc bytes) 2024-09-13T06:41:20.600 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:41:20.600 INFO:teuthology.orchestra.run.smithi081.stdout:3235 write 0x1b96489 thru 0x1ba3838 (0xd3b0 bytes) 2024-09-13T06:41:20.602 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:41:20.602 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [ 2024-09-13T06:41:20.603 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.603 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:71543 3.10 3:0b3ea07c:::rbd_object_map.11214a2cf59e:head [call lock.assert_locked in=44b,call rbd.object_map_update in=38b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e126)", 2024-09-13T06:41:20.603 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:41:20.602415+0000", 2024-09-13T06:41:20.603 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0012437220000000001, 2024-09-13T06:41:20.603 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.001294609, 2024-09-13T06:41:20.603 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:20.603 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "waiting for sub ops", 2024-09-13T06:41:20.604 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:20.604 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:20.604 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:20.604 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 71543 2024-09-13T06:41:20.604 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.604 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:20.604 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.604 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:20.604 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:20.602415+0000", 2024-09-13T06:41:20.605 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:20.605 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.605 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.605 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:20.605 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:20.602415+0000", 2024-09-13T06:41:20.605 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:20.605 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.605 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.605 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:20.605 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:20.602413+0000", 2024-09-13T06:41:20.605 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999981 2024-09-13T06:41:20.605 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.606 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.606 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:20.606 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:20.602425+0000", 2024-09-13T06:41:20.606 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1732e-05 2024-09-13T06:41:20.606 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.606 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.606 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:20.606 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:20.602454+0000", 2024-09-13T06:41:20.606 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.8659000000000001e-05 2024-09-13T06:41:20.606 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.606 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.606 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:20.607 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:20.602467+0000", 2024-09-13T06:41:20.607 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3526000000000001e-05 2024-09-13T06:41:20.607 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.607 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.607 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:20.607 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:20.602564+0000", 2024-09-13T06:41:20.607 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6827e-05 2024-09-13T06:41:20.607 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.607 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.607 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:20.607 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:20.602713+0000", 2024-09-13T06:41:20.607 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00014938399999999999 2024-09-13T06:41:20.607 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.608 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.608 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 0", 2024-09-13T06:41:20.608 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:20.603308+0000", 2024-09-13T06:41:20.608 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00059490200000000002 2024-09-13T06:41:20.608 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:20.608 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:20.608 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:20.609 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:20.609 INFO:teuthology.orchestra.run.smithi139.stdout: ], 2024-09-13T06:41:20.609 INFO:teuthology.orchestra.run.smithi139.stdout: "num_ops": 1 2024-09-13T06:41:20.609 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:41:20.609 INFO:teuthology.orchestra.run.smithi081.stdout:3236 write 0xaa2b3a0 thru 0xaa33dd9 (0x8a3a bytes) 2024-09-13T06:41:20.618 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-13T06:41:20.642 INFO:teuthology.orchestra.run.smithi081.stdout:3237 trunc from 0xb55247f to 0xe321b6 2024-09-13T06:41:20.664 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:41:20.663+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:41:20.682 INFO:teuthology.orchestra.run.smithi139.stdout: marking collection for removal 2024-09-13T06:41:20.683 INFO:teuthology.orchestra.run.smithi139.stdout:setting '_remove' omap key 2024-09-13T06:41:20.683 INFO:teuthology.orchestra.run.smithi139.stdout:finish_remove_pgs 3.16_head removing 3.16 2024-09-13T06:41:20.687 INFO:teuthology.orchestra.run.smithi139.stdout:Remove successful 2024-09-13T06:41:20.695 INFO:teuthology.orchestra.run.smithi081.stdout:3238 writesame 0x8dfe689 thru 0x8e0c51c data_size 0x6e(0xde94 bytes) 2024-09-13T06:41:20.695 INFO:teuthology.orchestra.run.smithi081.stdout:3241 punch from 0x64d1df7 to 0x64dd494, (0xb69d bytes) 2024-09-13T06:41:20.696 INFO:teuthology.orchestra.run.smithi081.stdout:3242 write 0x82b37cf thru 0x82c372c (0xff5e bytes) 2024-09-13T06:41:20.699 INFO:teuthology.orchestra.run.smithi081.stdout:3243 read 0x2df047f thru 0x2dfd9ff (0xd581 bytes) 2024-09-13T06:41:20.699 INFO:teuthology.orchestra.run.smithi081.stdout:3246 punch from 0x321d9ee to 0x3227a95, (0xa0a7 bytes) 2024-09-13T06:41:20.700 INFO:teuthology.orchestra.run.smithi081.stdout:3247 read 0x3eeb704 thru 0x3ef728b (0xbb88 bytes) 2024-09-13T06:41:20.700 INFO:teuthology.orchestra.run.smithi081.stdout:3249 read 0x889860e thru 0x88a589d (0xd290 bytes) 2024-09-13T06:41:20.700 INFO:teuthology.orchestra.run.smithi081.stdout:3252 write 0x891a0c2 thru 0x891a77a (0x6b9 bytes) 2024-09-13T06:41:20.718 INFO:teuthology.orchestra.run.smithi081.stdout:3253 writesame 0xa027161 thru 0xa0280b2 data_size 0x2(0xf52 bytes) 2024-09-13T06:41:20.718 INFO:teuthology.orchestra.run.smithi081.stdout:3254 punch from 0xd0436d to 0xd0da7d, (0x9710 bytes) 2024-09-13T06:41:20.718 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:41:20.718 INFO:teuthology.orchestra.run.smithi081.stdout:3257 read 0x32a2942 thru 0x32af5ec (0xccab bytes) 2024-09-13T06:41:20.718 INFO:teuthology.orchestra.run.smithi081.stdout:3258 write 0x9ecf14a thru 0x9ed897f (0x9836 bytes) 2024-09-13T06:41:20.724 INFO:teuthology.orchestra.run.smithi081.stdout:3259 write 0x8e7f594 thru 0x8e83522 (0x3f8f bytes) 2024-09-13T06:41:20.726 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:41:20.726+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:41:20.731 INFO:teuthology.orchestra.run.smithi081.stdout:3260 read 0x9b36519 thru 0x9b411ba (0xaca2 bytes) 2024-09-13T06:41:20.731 INFO:teuthology.orchestra.run.smithi081.stdout:3262 writesame 0x158fbab thru 0x15922f3 data_size 0x1(0x2749 bytes) 2024-09-13T06:41:20.743 INFO:teuthology.orchestra.run.smithi081.stdout:3263 write 0x7d1b345 thru 0x7d21b4b (0x6807 bytes) 2024-09-13T06:41:20.745 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:41:20.745 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [], 2024-09-13T06:41:20.745 INFO:teuthology.orchestra.run.smithi139.stdout: "complaint_time": 30, 2024-09-13T06:41:20.746 INFO:teuthology.orchestra.run.smithi139.stdout: "num_blocked_ops": 0 2024-09-13T06:41:20.746 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:41:20.749 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:41:20.749 INFO:teuthology.orchestra.run.smithi081.stdout:3265 write 0x7b3b793 thru 0x7b449e3 (0x9251 bytes) 2024-09-13T06:41:20.751 INFO:teuthology.orchestra.run.smithi081.stdout:3267 read 0x9a7e7c6 thru 0x9a83434 (0x4c6f bytes) 2024-09-13T06:41:20.752 INFO:teuthology.orchestra.run.smithi081.stdout:3268 trunc from 0xa0280b3 to 0x9c98205 2024-09-13T06:41:20.761 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-13T06:41:20.780 INFO:teuthology.orchestra.run.smithi081.stdout:3269 writesame 0xa1b2e7f thru 0xa1b5acf data_size 0x1(0x2c51 bytes) 2024-09-13T06:41:20.784 INFO:teuthology.orchestra.run.smithi081.stdout:3271 trunc from 0xa1b5ad0 to 0x8a5a493 2024-09-13T06:41:20.822 INFO:teuthology.orchestra.run.smithi081.stdout:3273 writesame 0x9e3bbb9 thru 0x9e4417b data_size 0xb(0x85c3 bytes) 2024-09-13T06:41:20.822 INFO:teuthology.orchestra.run.smithi081.stdout:3274 read 0x4fd08a3 thru 0x4fdc5ac (0xbd0a bytes) 2024-09-13T06:41:20.822 INFO:teuthology.orchestra.run.smithi081.stdout:3275 read 0x2de3a45 thru 0x2df07ab (0xcd67 bytes) 2024-09-13T06:41:20.822 INFO:teuthology.orchestra.run.smithi081.stdout:3277 write 0x9e258f9 thru 0x9e337fb (0xdf03 bytes) 2024-09-13T06:41:20.829 INFO:teuthology.orchestra.run.smithi081.stdout:3278 read 0x35a1b50 thru 0x35adc55 (0xc106 bytes) 2024-09-13T06:41:20.848 INFO:tasks.ceph.osd.6.smithi139.stderr:2024-09-13T06:41:20.847+0000 7fcd02c5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26385) UID: 0 2024-09-13T06:41:20.851 INFO:teuthology.orchestra.run.smithi081.stdout:3279 trunc from 0x9e4417c to 0x1d59a93 2024-09-13T06:41:20.873 INFO:teuthology.orchestra.run.smithi081.stdout:3280 write 0x134e1b thru 0x13b05e (0x6244 bytes) 2024-09-13T06:41:20.905 INFO:teuthology.orchestra.run.smithi081.stdout:3281 trunc from 0x1d59a93 to 0xcf6aade 2024-09-13T06:41:20.918 INFO:teuthology.orchestra.run.smithi081.stdout:3282 read 0x2a13328 thru 0x2a20684 (0xd35d bytes) 2024-09-13T06:41:20.918 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:41:20.921 INFO:teuthology.orchestra.run.smithi081.stdout:3286 trunc from 0xcf6aade to 0xb898771 2024-09-13T06:41:20.927 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:41:20.926+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:41:20.929 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:41:20.930 INFO:teuthology.orchestra.run.smithi139.stdout: "size": 20, 2024-09-13T06:41:20.930 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 600, 2024-09-13T06:41:20.930 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [ 2024-09-13T06:41:20.930 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.930 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27854 3.a 3:537b3559:::rbd_data.1121f2c5ee81.0000000000000016:13 [read 335872~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:20.930 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.658750+0000", 2024-09-13T06:41:20.930 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 84.269445285000003, 2024-09-13T06:41:20.930 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.037969532, 2024-09-13T06:41:20.930 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:20.930 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:20.930 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:20.930 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:20.930 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:20.930 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27854 2024-09-13T06:41:20.931 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.931 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:20.931 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.931 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:20.931 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658750+0000", 2024-09-13T06:41:20.931 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:20.931 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.931 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.931 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:20.931 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658750+0000", 2024-09-13T06:41:20.931 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:20.931 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.931 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.932 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:20.932 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658749+0000", 2024-09-13T06:41:20.932 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:20.932 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.932 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.932 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:20.932 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658757+0000", 2024-09-13T06:41:20.932 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.7389999999999999e-06 2024-09-13T06:41:20.932 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.932 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.932 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:20.932 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658763+0000", 2024-09-13T06:41:20.932 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.7769999999999999e-06 2024-09-13T06:41:20.933 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.933 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.933 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:20.933 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658767+0000", 2024-09-13T06:41:20.933 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.1749999999999998e-06 2024-09-13T06:41:20.933 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.933 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.933 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:20.933 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.696322+0000", 2024-09-13T06:41:20.933 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.037554772 2024-09-13T06:41:20.933 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.933 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.933 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:20.934 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.696418+0000", 2024-09-13T06:41:20.934 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6050000000000004e-05 2024-09-13T06:41:20.934 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.934 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.934 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:20.934 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.696719+0000", 2024-09-13T06:41:20.934 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00030138499999999999 2024-09-13T06:41:20.934 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:20.934 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:20.934 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:20.934 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.934 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.934 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27855 3.a 3:537b3559:::rbd_data.1121f2c5ee81.0000000000000016:13 [read 380928~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:20.935 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.658771+0000", 2024-09-13T06:41:20.935 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 84.269424040999994, 2024-09-13T06:41:20.935 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.038326354, 2024-09-13T06:41:20.935 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:20.935 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:20.935 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:20.935 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:20.935 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:20.935 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27855 2024-09-13T06:41:20.935 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.935 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:20.935 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.935 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:20.936 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658771+0000", 2024-09-13T06:41:20.936 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:20.936 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.936 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.936 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:20.936 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658771+0000", 2024-09-13T06:41:20.936 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:20.936 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.936 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.937 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:20.937 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658770+0000", 2024-09-13T06:41:20.937 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:20.937 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.937 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.937 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:20.940 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658772+0000", 2024-09-13T06:41:20.940 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.0930000000000001e-06 2024-09-13T06:41:20.940 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.940 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.941 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:20.941 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658778+0000", 2024-09-13T06:41:20.941 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.2730000000000002e-06 2024-09-13T06:41:20.941 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.941 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.941 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:20.941 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658782+0000", 2024-09-13T06:41:20.941 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0879999999999997e-06 2024-09-13T06:41:20.941 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.941 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.941 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:20.941 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.696770+0000", 2024-09-13T06:41:20.941 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.037988145000000001 2024-09-13T06:41:20.941 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.942 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.942 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:20.942 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.696852+0000", 2024-09-13T06:41:20.942 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.2039999999999994e-05 2024-09-13T06:41:20.942 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.942 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.942 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:20.942 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.697097+0000", 2024-09-13T06:41:20.942 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00024508800000000002 2024-09-13T06:41:20.942 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:20.942 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:20.942 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:20.942 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.943 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.943 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27856 3.a 3:537b3559:::rbd_data.1121f2c5ee81.0000000000000016:13 [read 405504~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:20.943 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.658786+0000", 2024-09-13T06:41:20.943 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 84.269408924999993, 2024-09-13T06:41:20.943 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.038736029999999998, 2024-09-13T06:41:20.943 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:20.943 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:20.943 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:20.943 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:20.943 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:20.943 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27856 2024-09-13T06:41:20.943 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.943 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:20.943 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.944 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:20.944 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658786+0000", 2024-09-13T06:41:20.944 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:20.944 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.944 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.944 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:20.944 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658786+0000", 2024-09-13T06:41:20.944 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:20.944 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.944 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.944 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:20.944 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658785+0000", 2024-09-13T06:41:20.944 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:20.945 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.945 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.945 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:20.945 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658787+0000", 2024-09-13T06:41:20.945 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.0040000000000002e-06 2024-09-13T06:41:20.945 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.945 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.945 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:20.945 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658793+0000", 2024-09-13T06:41:20.945 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.2410000000000003e-06 2024-09-13T06:41:20.945 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.945 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.945 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:20.946 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658797+0000", 2024-09-13T06:41:20.946 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.1330000000000001e-06 2024-09-13T06:41:20.946 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.946 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.946 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:20.946 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.697176+0000", 2024-09-13T06:41:20.946 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.038379074999999999 2024-09-13T06:41:20.946 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.946 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.946 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:20.946 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.697275+0000", 2024-09-13T06:41:20.946 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.8819000000000004e-05 2024-09-13T06:41:20.946 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.946 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.947 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:20.947 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.697522+0000", 2024-09-13T06:41:20.947 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00024719999999999999 2024-09-13T06:41:20.947 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:20.947 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:20.947 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:20.947 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.947 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.947 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27857 3.a 3:537b3559:::rbd_data.1121f2c5ee81.0000000000000016:13 [read 475136~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:20.947 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.658845+0000", 2024-09-13T06:41:20.947 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 84.269349922000004, 2024-09-13T06:41:20.947 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039112570999999999, 2024-09-13T06:41:20.947 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:20.948 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:20.948 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:20.948 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:20.948 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:20.948 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27857 2024-09-13T06:41:20.948 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.948 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:20.948 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.948 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:20.948 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658845+0000", 2024-09-13T06:41:20.948 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:20.948 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.948 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.949 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:20.949 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658845+0000", 2024-09-13T06:41:20.949 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:20.949 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.949 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.949 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:20.949 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658844+0000", 2024-09-13T06:41:20.949 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999986 2024-09-13T06:41:20.949 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.949 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.949 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:20.949 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658868+0000", 2024-09-13T06:41:20.949 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.4615000000000001e-05 2024-09-13T06:41:20.950 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.950 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.950 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:20.950 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658884+0000", 2024-09-13T06:41:20.950 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5401999999999999e-05 2024-09-13T06:41:20.950 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.950 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.950 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:20.950 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658896+0000", 2024-09-13T06:41:20.950 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2509e-05 2024-09-13T06:41:20.950 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.950 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.950 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:20.951 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.697571+0000", 2024-09-13T06:41:20.951 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.038675107 2024-09-13T06:41:20.951 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.951 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.951 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:20.951 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.697658+0000", 2024-09-13T06:41:20.951 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6349999999999998e-05 2024-09-13T06:41:20.951 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.951 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.951 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:20.951 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.697957+0000", 2024-09-13T06:41:20.951 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00029986100000000001 2024-09-13T06:41:20.951 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:20.951 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:20.952 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:20.952 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.952 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.952 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27858 3.a 3:537b3559:::rbd_data.1121f2c5ee81.0000000000000016:13 [read 499712~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:20.952 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.658905+0000", 2024-09-13T06:41:20.952 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 84.269289372000003, 2024-09-13T06:41:20.952 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039475392999999998, 2024-09-13T06:41:20.952 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:20.952 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:20.952 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:20.952 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:20.952 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:20.952 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27858 2024-09-13T06:41:20.953 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.953 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:20.953 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.953 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:20.953 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658905+0000", 2024-09-13T06:41:20.953 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:20.953 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.953 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.953 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:20.953 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658905+0000", 2024-09-13T06:41:20.953 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:20.953 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.953 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.954 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:20.954 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658905+0000", 2024-09-13T06:41:20.954 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:20.954 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.954 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.954 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:20.954 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658909+0000", 2024-09-13T06:41:20.954 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.831e-06 2024-09-13T06:41:20.954 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.954 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.954 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:20.954 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658920+0000", 2024-09-13T06:41:20.954 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0936e-05 2024-09-13T06:41:20.955 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.955 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.955 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:20.955 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658929+0000", 2024-09-13T06:41:20.955 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.2749999999999995e-06 2024-09-13T06:41:20.955 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.955 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.955 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:20.955 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.697990+0000", 2024-09-13T06:41:20.955 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039061625000000003 2024-09-13T06:41:20.955 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.955 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.955 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:20.955 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.698077+0000", 2024-09-13T06:41:20.955 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6922000000000006e-05 2024-09-13T06:41:20.956 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.956 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.956 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:20.956 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.698381+0000", 2024-09-13T06:41:20.956 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00030360599999999999 2024-09-13T06:41:20.956 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:20.956 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:20.956 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:20.956 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.956 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.956 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27929 3.a 3:537b3559:::rbd_data.1121f2c5ee81.0000000000000016:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:20.956 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.659338+0000", 2024-09-13T06:41:20.956 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 84.268856541000005, 2024-09-13T06:41:20.957 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039351214000000002, 2024-09-13T06:41:20.957 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:20.957 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:20.957 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:20.957 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:20.957 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:20.957 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27929 2024-09-13T06:41:20.957 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.957 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:20.957 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.957 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:20.957 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.659338+0000", 2024-09-13T06:41:20.957 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:20.958 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.958 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.958 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:20.958 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.659338+0000", 2024-09-13T06:41:20.958 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:20.958 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.958 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.958 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:20.958 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.659337+0000", 2024-09-13T06:41:20.958 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:20.958 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.958 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.958 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:20.959 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.659342+0000", 2024-09-13T06:41:20.959 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0799999999999999e-06 2024-09-13T06:41:20.959 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.959 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.959 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:20.959 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.659353+0000", 2024-09-13T06:41:20.959 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1798e-05 2024-09-13T06:41:20.959 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.959 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.959 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:20.959 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.659361+0000", 2024-09-13T06:41:20.959 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.8040000000000002e-06 2024-09-13T06:41:20.959 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.960 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.960 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:20.960 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.698449+0000", 2024-09-13T06:41:20.960 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039087519000000001 2024-09-13T06:41:20.960 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.960 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.960 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:20.960 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.698567+0000", 2024-09-13T06:41:20.960 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00011857 2024-09-13T06:41:20.960 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.960 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.960 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:20.960 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.698689+0000", 2024-09-13T06:41:20.961 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00012226699999999999 2024-09-13T06:41:20.961 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:20.961 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:20.961 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:20.961 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.961 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.961 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27974 3.a 3:537b3559:::rbd_data.1121f2c5ee81.0000000000000016:13 [read 32768~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:20.961 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.660102+0000", 2024-09-13T06:41:20.961 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 84.268092773000006, 2024-09-13T06:41:20.961 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.038972346999999997, 2024-09-13T06:41:20.961 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:20.961 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:20.961 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:20.962 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:20.962 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:20.962 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27974 2024-09-13T06:41:20.962 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.962 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:20.962 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.962 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:20.962 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660102+0000", 2024-09-13T06:41:20.962 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:20.962 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.962 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.962 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:20.962 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660102+0000", 2024-09-13T06:41:20.963 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:20.963 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.963 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.963 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:20.963 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660100+0000", 2024-09-13T06:41:20.963 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999976 2024-09-13T06:41:20.963 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.963 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.963 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:20.963 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660114+0000", 2024-09-13T06:41:20.963 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.4466e-05 2024-09-13T06:41:20.963 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.963 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.964 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:20.964 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660148+0000", 2024-09-13T06:41:20.964 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.3742999999999999e-05 2024-09-13T06:41:20.964 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.964 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.964 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:20.964 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660170+0000", 2024-09-13T06:41:20.964 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.2518e-05 2024-09-13T06:41:20.964 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.964 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.964 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:20.964 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.698719+0000", 2024-09-13T06:41:20.964 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.038548529999999998 2024-09-13T06:41:20.964 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.965 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.965 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:20.965 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.698806+0000", 2024-09-13T06:41:20.965 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.7179e-05 2024-09-13T06:41:20.965 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.965 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.965 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:20.965 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.699074+0000", 2024-09-13T06:41:20.965 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00026834800000000001 2024-09-13T06:41:20.965 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:20.965 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:20.965 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:20.965 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.966 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.966 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27975 3.a 3:537b3559:::rbd_data.1121f2c5ee81.0000000000000016:13 [read 57344~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:20.966 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.660189+0000", 2024-09-13T06:41:20.966 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 84.268005928999997, 2024-09-13T06:41:20.966 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039288678, 2024-09-13T06:41:20.966 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:20.966 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:20.966 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:20.966 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:20.966 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:20.966 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27975 2024-09-13T06:41:20.966 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.966 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:20.967 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.967 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:20.967 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660189+0000", 2024-09-13T06:41:20.967 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:20.967 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.967 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.967 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:20.967 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660189+0000", 2024-09-13T06:41:20.967 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:20.967 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.967 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.967 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:20.968 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660187+0000", 2024-09-13T06:41:20.968 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999981 2024-09-13T06:41:20.968 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.968 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.968 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:20.968 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660195+0000", 2024-09-13T06:41:20.968 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5610000000000001e-06 2024-09-13T06:41:20.968 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.968 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.968 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:20.968 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660212+0000", 2024-09-13T06:41:20.968 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7725999999999999e-05 2024-09-13T06:41:20.968 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.969 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.969 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:20.969 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660227+0000", 2024-09-13T06:41:20.969 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.43e-05 2024-09-13T06:41:20.969 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.969 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.969 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:20.969 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.699135+0000", 2024-09-13T06:41:20.969 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.038908336000000002 2024-09-13T06:41:20.969 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.969 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.969 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:20.969 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.699208+0000", 2024-09-13T06:41:20.970 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.3065000000000006e-05 2024-09-13T06:41:20.970 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.970 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.970 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:20.970 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.699478+0000", 2024-09-13T06:41:20.970 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00026946899999999999 2024-09-13T06:41:20.970 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:20.970 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:20.970 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:20.970 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.970 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.970 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27976 3.a 3:537b3559:::rbd_data.1121f2c5ee81.0000000000000016:13 [read 102400~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:20.970 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.660238+0000", 2024-09-13T06:41:20.970 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 84.267956765999998, 2024-09-13T06:41:20.971 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039636515999999997, 2024-09-13T06:41:20.971 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:20.971 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:20.971 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:20.971 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:20.971 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:20.971 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27976 2024-09-13T06:41:20.971 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.971 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:20.971 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.971 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:20.971 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660238+0000", 2024-09-13T06:41:20.971 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:20.972 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.972 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.972 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:20.972 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660238+0000", 2024-09-13T06:41:20.972 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:20.972 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.972 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.972 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:20.972 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660237+0000", 2024-09-13T06:41:20.972 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:20.972 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.972 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.972 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:20.973 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660243+0000", 2024-09-13T06:41:20.973 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.9909999999999999e-06 2024-09-13T06:41:20.973 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.973 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.973 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:20.973 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660259+0000", 2024-09-13T06:41:20.973 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6294e-05 2024-09-13T06:41:20.973 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.973 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.973 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:20.973 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660272+0000", 2024-09-13T06:41:20.973 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2714999999999999e-05 2024-09-13T06:41:20.973 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.973 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.974 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:20.974 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.699513+0000", 2024-09-13T06:41:20.974 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039240932999999999 2024-09-13T06:41:20.974 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.974 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.974 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:20.974 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.699604+0000", 2024-09-13T06:41:20.974 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.1367999999999997e-05 2024-09-13T06:41:20.974 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.974 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.974 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:20.974 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.699875+0000", 2024-09-13T06:41:20.974 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00027029499999999999 2024-09-13T06:41:20.974 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:20.975 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:20.975 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:20.975 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.975 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.975 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27977 3.a 3:537b3559:::rbd_data.1121f2c5ee81.0000000000000016:13 [read 126976~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:20.975 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.660284+0000", 2024-09-13T06:41:20.975 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 84.267911194000007, 2024-09-13T06:41:20.975 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039969945, 2024-09-13T06:41:20.975 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:20.975 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:20.975 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:20.975 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:20.975 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:20.975 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27977 2024-09-13T06:41:20.976 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.976 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:20.976 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.976 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:20.976 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660284+0000", 2024-09-13T06:41:20.976 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:20.976 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.976 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.976 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:20.976 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660284+0000", 2024-09-13T06:41:20.976 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:20.976 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.976 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.976 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:20.976 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660282+0000", 2024-09-13T06:41:20.977 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999986 2024-09-13T06:41:20.977 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.977 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.977 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:20.977 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660288+0000", 2024-09-13T06:41:20.977 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.2650000000000002e-06 2024-09-13T06:41:20.977 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.977 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.977 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:20.977 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660304+0000", 2024-09-13T06:41:20.977 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5430999999999998e-05 2024-09-13T06:41:20.977 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.977 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.978 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:20.978 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660316+0000", 2024-09-13T06:41:20.978 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.237e-05 2024-09-13T06:41:20.978 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.978 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.978 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:20.978 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.699907+0000", 2024-09-13T06:41:20.978 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039590735000000002 2024-09-13T06:41:20.978 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.978 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.978 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:20.978 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.699994+0000", 2024-09-13T06:41:20.978 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6996999999999994e-05 2024-09-13T06:41:20.979 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.979 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.979 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:20.979 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700254+0000", 2024-09-13T06:41:20.979 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000259564 2024-09-13T06:41:20.979 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:20.979 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:20.979 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:20.979 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.979 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.979 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27978 3.a 3.9aacdeca (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:20.979 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.660327+0000", 2024-09-13T06:41:20.980 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 84.267867596000002, 2024-09-13T06:41:20.980 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039984858999999998, 2024-09-13T06:41:20.980 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:20.980 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:41:20.980 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:20.980 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:20.980 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:20.980 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27978 2024-09-13T06:41:20.980 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.981 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:20.981 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.981 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:20.981 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660327+0000", 2024-09-13T06:41:20.981 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:20.981 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.981 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.981 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:20.981 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660327+0000", 2024-09-13T06:41:20.981 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:20.981 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.981 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.981 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:20.982 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660326+0000", 2024-09-13T06:41:20.982 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:20.982 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.982 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.982 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:20.982 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660366+0000", 2024-09-13T06:41:20.982 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.9691000000000003e-05 2024-09-13T06:41:20.982 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.982 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.982 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:20.982 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660399+0000", 2024-09-13T06:41:20.982 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.3262000000000001e-05 2024-09-13T06:41:20.982 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.983 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.983 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:20.983 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660414+0000", 2024-09-13T06:41:20.983 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.4775e-05 2024-09-13T06:41:20.983 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.983 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.983 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:20.983 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700298+0000", 2024-09-13T06:41:20.983 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039883759999999997 2024-09-13T06:41:20.983 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.983 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.983 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:20.983 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700312+0000", 2024-09-13T06:41:20.984 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.4374e-05 2024-09-13T06:41:20.984 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:20.984 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:20.984 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:20.984 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.984 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.984 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27979 3.a 3.9aacdeca (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:20.984 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.660429+0000", 2024-09-13T06:41:20.984 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 84.267765728000001, 2024-09-13T06:41:20.984 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039921361000000002, 2024-09-13T06:41:20.984 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:20.984 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:41:20.984 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:20.985 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:20.985 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:20.985 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27979 2024-09-13T06:41:20.985 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.985 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:20.985 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.985 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:20.985 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660429+0000", 2024-09-13T06:41:20.985 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:20.985 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.985 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.985 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:20.985 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660429+0000", 2024-09-13T06:41:20.986 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:20.986 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.986 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.986 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:20.986 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660428+0000", 2024-09-13T06:41:20.986 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999986 2024-09-13T06:41:20.986 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.986 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.986 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:20.986 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660434+0000", 2024-09-13T06:41:20.986 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.8190000000000003e-06 2024-09-13T06:41:20.986 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.986 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.987 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:20.987 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660451+0000", 2024-09-13T06:41:20.987 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6963e-05 2024-09-13T06:41:20.987 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.987 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.987 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:20.987 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660485+0000", 2024-09-13T06:41:20.987 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.3414000000000002e-05 2024-09-13T06:41:20.987 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.987 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.987 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:20.987 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700342+0000", 2024-09-13T06:41:20.987 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039857278000000003 2024-09-13T06:41:20.987 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.988 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.988 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:20.988 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700350+0000", 2024-09-13T06:41:20.988 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.2930000000000001e-06 2024-09-13T06:41:20.988 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:20.988 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:20.988 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:20.988 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.988 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.988 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27980 3.a 3.9aacdeca (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:20.988 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.660497+0000", 2024-09-13T06:41:20.988 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 84.267697517000002, 2024-09-13T06:41:20.988 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039888034000000003, 2024-09-13T06:41:20.989 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:20.989 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:41:20.989 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:20.989 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:20.989 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:20.989 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27980 2024-09-13T06:41:20.989 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.989 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:20.989 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.989 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:20.989 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660497+0000", 2024-09-13T06:41:20.990 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:20.990 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.990 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.990 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:20.990 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660497+0000", 2024-09-13T06:41:20.990 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:20.990 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.990 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.990 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:20.990 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660496+0000", 2024-09-13T06:41:20.990 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:20.990 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.990 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.990 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:20.991 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660503+0000", 2024-09-13T06:41:20.991 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.4110000000000001e-06 2024-09-13T06:41:20.991 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.991 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.991 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:20.991 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660519+0000", 2024-09-13T06:41:20.991 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6180000000000001e-05 2024-09-13T06:41:20.991 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.991 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.991 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:20.991 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660544+0000", 2024-09-13T06:41:20.991 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.5177999999999998e-05 2024-09-13T06:41:20.991 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.992 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.992 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:20.992 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700377+0000", 2024-09-13T06:41:20.992 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039833434000000001 2024-09-13T06:41:20.992 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.992 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.992 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:20.992 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700385+0000", 2024-09-13T06:41:20.992 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.8800000000000008e-06 2024-09-13T06:41:20.992 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:20.992 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:20.992 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:20.992 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.993 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.993 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27981 3.a 3.9aacdeca (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:20.993 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.660556+0000", 2024-09-13T06:41:20.993 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 84.267639170999999, 2024-09-13T06:41:20.993 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039869989000000002, 2024-09-13T06:41:20.993 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:20.993 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:41:20.993 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:20.993 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:20.993 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:20.993 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27981 2024-09-13T06:41:20.993 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.993 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:20.994 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.994 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:20.994 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660556+0000", 2024-09-13T06:41:20.994 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:20.994 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.994 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.994 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:20.994 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660556+0000", 2024-09-13T06:41:20.994 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:20.994 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.994 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.994 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:20.994 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660555+0000", 2024-09-13T06:41:20.995 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:20.995 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.995 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.995 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:20.995 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660561+0000", 2024-09-13T06:41:20.995 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.088e-06 2024-09-13T06:41:20.995 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.995 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.995 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:20.995 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660577+0000", 2024-09-13T06:41:20.995 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6147999999999999e-05 2024-09-13T06:41:20.995 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.995 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.996 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:20.996 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660589+0000", 2024-09-13T06:41:20.996 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2551999999999999e-05 2024-09-13T06:41:20.996 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.996 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.996 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:20.996 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700414+0000", 2024-09-13T06:41:20.996 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039825007000000003 2024-09-13T06:41:20.996 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.996 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.996 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:20.996 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700426+0000", 2024-09-13T06:41:20.996 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1265e-05 2024-09-13T06:41:20.997 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:20.997 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:20.997 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:20.997 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.997 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.997 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27982 3.a 3.9aacdeca (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:20.997 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.660603+0000", 2024-09-13T06:41:20.997 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 84.267591576000001, 2024-09-13T06:41:20.997 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039874779999999999, 2024-09-13T06:41:20.997 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:20.997 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:41:20.997 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:20.997 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:20.998 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:20.998 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27982 2024-09-13T06:41:20.998 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.998 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:20.998 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.998 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:20.998 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660603+0000", 2024-09-13T06:41:20.998 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:20.998 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.998 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.998 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:20.998 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660603+0000", 2024-09-13T06:41:20.998 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:20.999 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.999 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.999 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:20.999 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660602+0000", 2024-09-13T06:41:20.999 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:20.999 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.999 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.999 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:20.999 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660653+0000", 2024-09-13T06:41:20.999 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.0862000000000002e-05 2024-09-13T06:41:20.999 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:20.999 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:20.999 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:21.000 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660697+0000", 2024-09-13T06:41:21.000 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.3773000000000003e-05 2024-09-13T06:41:21.000 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:21.000 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:21.000 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:21.000 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660712+0000", 2024-09-13T06:41:21.000 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5464999999999998e-05 2024-09-13T06:41:21.000 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:21.000 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:21.000 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:21.000 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700469+0000", 2024-09-13T06:41:21.000 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039756503999999998 2024-09-13T06:41:21.000 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:21.001 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:21.001 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:21.001 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700478+0000", 2024-09-13T06:41:21.001 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.1730000000000001e-06 2024-09-13T06:41:21.001 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:21.001 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:21.001 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:21.001 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:21.001 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:21.001 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27983 3.a 3.9aacdeca (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:21.001 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.660726+0000", 2024-09-13T06:41:21.001 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 84.267468300999994, 2024-09-13T06:41:21.001 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039804357999999998, 2024-09-13T06:41:21.002 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:21.002 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:41:21.002 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:21.002 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:21.002 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:21.002 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27983 2024-09-13T06:41:21.002 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:21.002 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:21.002 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:21.002 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:21.002 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660726+0000", 2024-09-13T06:41:21.002 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:21.002 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:21.003 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:21.003 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:21.003 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660726+0000", 2024-09-13T06:41:21.003 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:21.003 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:21.003 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:21.003 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:21.003 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660725+0000", 2024-09-13T06:41:21.003 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999986 2024-09-13T06:41:21.003 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:21.003 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:21.003 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:21.003 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660733+0000", 2024-09-13T06:41:21.003 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.9359999999999999e-06 2024-09-13T06:41:21.004 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:21.004 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:21.004 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:21.004 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660751+0000", 2024-09-13T06:41:21.004 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7679000000000001e-05 2024-09-13T06:41:21.004 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:21.004 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:21.004 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:21.004 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660764+0000", 2024-09-13T06:41:21.004 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3112000000000001e-05 2024-09-13T06:41:21.004 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:21.004 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:21.004 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:21.004 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700516+0000", 2024-09-13T06:41:21.005 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039752183000000003 2024-09-13T06:41:21.005 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:21.005 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:21.005 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:21.005 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700531+0000", 2024-09-13T06:41:21.005 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.4732999999999999e-05 2024-09-13T06:41:21.005 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:21.005 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:21.005 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:21.005 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:21.005 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:21.005 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27984 3.a 3.9aacdeca (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:21.005 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.660776+0000", 2024-09-13T06:41:21.006 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 84.267419197999999, 2024-09-13T06:41:21.006 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039795697999999997, 2024-09-13T06:41:21.006 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:21.006 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:41:21.006 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:21.006 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:21.006 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:21.006 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27984 2024-09-13T06:41:21.006 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:21.006 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:21.006 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:21.006 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:21.007 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660776+0000", 2024-09-13T06:41:21.007 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:21.007 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:21.007 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:21.007 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:21.007 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660776+0000", 2024-09-13T06:41:21.007 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:21.007 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:21.007 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:21.007 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:21.007 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660775+0000", 2024-09-13T06:41:21.007 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:21.007 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:21.007 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:21.008 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:21.008 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660780+0000", 2024-09-13T06:41:21.008 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.7849999999999997e-06 2024-09-13T06:41:21.008 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:21.008 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:21.008 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:21.008 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660799+0000", 2024-09-13T06:41:21.008 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.8794e-05 2024-09-13T06:41:21.008 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:21.008 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:21.008 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:21.008 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660812+0000", 2024-09-13T06:41:21.008 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3029e-05 2024-09-13T06:41:21.009 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:21.009 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:21.009 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:21.009 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700562+0000", 2024-09-13T06:41:21.009 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039749984000000002 2024-09-13T06:41:21.009 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:21.009 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:21.009 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:21.009 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700571+0000", 2024-09-13T06:41:21.009 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.1260000000000004e-06 2024-09-13T06:41:21.009 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:21.009 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:21.009 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:21.010 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:21.010 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:21.010 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27985 3.a 3.9aacdeca (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:21.010 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.660824+0000", 2024-09-13T06:41:21.010 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 84.267371146000002, 2024-09-13T06:41:21.010 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039784462, 2024-09-13T06:41:21.010 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:21.010 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:41:21.010 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:21.010 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:21.010 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:21.010 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27985 2024-09-13T06:41:21.010 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:21.010 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:21.011 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:21.011 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:21.011 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660824+0000", 2024-09-13T06:41:21.011 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:21.011 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:21.011 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:21.011 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:21.011 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660824+0000", 2024-09-13T06:41:21.011 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:21.011 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:21.011 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:21.011 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:21.011 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660823+0000", 2024-09-13T06:41:21.012 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:21.012 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:21.012 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:21.012 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:21.012 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660829+0000", 2024-09-13T06:41:21.012 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.9440000000000002e-06 2024-09-13T06:41:21.012 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:21.012 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:21.012 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:21.012 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660922+0000", 2024-09-13T06:41:21.012 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.2958e-05 2024-09-13T06:41:21.012 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:21.012 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:21.013 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:21.013 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660964+0000", 2024-09-13T06:41:21.013 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.2407000000000002e-05 2024-09-13T06:41:21.013 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:21.013 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:21.013 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:21.013 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700600+0000", 2024-09-13T06:41:21.013 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039635581000000003 2024-09-13T06:41:21.013 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:21.013 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:21.013 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:21.013 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700608+0000", 2024-09-13T06:41:21.013 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.5890000000000003e-06 2024-09-13T06:41:21.014 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:21.014 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:21.014 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:21.014 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:21.014 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:21.014 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:28023 3.10 3:0dedc28a:::rbd_data.1121f2c5ee81.0000000000000019:13 [read 475136~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:21.014 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.662072+0000", 2024-09-13T06:41:21.014 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 84.266123160999996, 2024-09-13T06:41:21.014 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.038086508999999998, 2024-09-13T06:41:21.014 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:21.014 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:21.014 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:21.015 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:21.015 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:21.015 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 28023 2024-09-13T06:41:21.015 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:21.015 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:21.015 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:21.015 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:21.015 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.662072+0000", 2024-09-13T06:41:21.015 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:21.015 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:21.015 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:21.015 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:21.015 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.662072+0000", 2024-09-13T06:41:21.016 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:21.016 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:21.016 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:21.016 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:21.016 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.662070+0000", 2024-09-13T06:41:21.016 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999986 2024-09-13T06:41:21.016 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:21.016 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:21.016 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:21.016 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.662076+0000", 2024-09-13T06:41:21.016 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.139e-06 2024-09-13T06:41:21.016 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:21.017 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:21.017 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:21.017 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.662094+0000", 2024-09-13T06:41:21.017 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7136999999999999e-05 2024-09-13T06:41:21.017 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:21.017 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:21.017 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:21.017 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.662124+0000", 2024-09-13T06:41:21.017 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.0528999999999999e-05 2024-09-13T06:41:21.017 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:21.017 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:21.017 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:21.017 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.699843+0000", 2024-09-13T06:41:21.017 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.037718415999999998 2024-09-13T06:41:21.018 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:21.018 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:21.018 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:21.018 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.699931+0000", 2024-09-13T06:41:21.018 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.8345999999999997e-05 2024-09-13T06:41:21.018 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:21.018 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:21.018 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:21.018 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700158+0000", 2024-09-13T06:41:21.018 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00022723099999999999 2024-09-13T06:41:21.018 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:21.018 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:21.018 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:21.019 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:21.019 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:21.019 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:28024 3.10 3.5143b7b0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:21.019 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.662137+0000", 2024-09-13T06:41:21.019 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 84.266057638999996, 2024-09-13T06:41:21.019 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.038056092999999999, 2024-09-13T06:41:21.019 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:21.019 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:41:21.019 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:21.019 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:21.019 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:21.019 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 28024 2024-09-13T06:41:21.019 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:21.019 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:21.019 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:21.020 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:21.020 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.662137+0000", 2024-09-13T06:41:21.020 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:21.020 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:21.020 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:21.020 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:21.020 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.662137+0000", 2024-09-13T06:41:21.020 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:21.020 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:21.020 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:21.020 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:21.020 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.662136+0000", 2024-09-13T06:41:21.020 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999986 2024-09-13T06:41:21.021 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:21.021 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:21.021 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:21.021 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.662142+0000", 2024-09-13T06:41:21.021 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.6930000000000001e-06 2024-09-13T06:41:21.021 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:21.021 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:21.021 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:21.021 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.662160+0000", 2024-09-13T06:41:21.021 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7863000000000002e-05 2024-09-13T06:41:21.021 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:21.021 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:21.021 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:21.022 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.662189+0000", 2024-09-13T06:41:21.022 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.8486000000000001e-05 2024-09-13T06:41:21.022 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:21.022 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:21.022 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:21.022 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700187+0000", 2024-09-13T06:41:21.022 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.037998331000000003 2024-09-13T06:41:21.022 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:21.022 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:21.022 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:21.022 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700193+0000", 2024-09-13T06:41:21.022 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.0909999999999998e-06 2024-09-13T06:41:21.022 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:21.023 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:21.023 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:21.023 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:21.023 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:21.023 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:41:21.024 INFO:teuthology.orchestra.run.smithi081.stdout:3287 writesame 0x533ea96 thru 0x5342e7e data_size 0x3d(0x43e9 bytes) 2024-09-13T06:41:21.025 INFO:teuthology.orchestra.run.smithi081.stdout:3288 write 0x6eef69c thru 0x6ef6bc6 (0x752b bytes) 2024-09-13T06:41:21.025 INFO:teuthology.orchestra.run.smithi081.stdout:3289 writesame 0xd84ac32 thru 0xd855e6e data_size 0x1(0xb23d bytes) 2024-09-13T06:41:21.025 INFO:teuthology.orchestra.run.smithi081.stdout:3290 trunc from 0xd855e6f to 0xcc35a5f 2024-09-13T06:41:21.025 INFO:teuthology.orchestra.run.smithi081.stdout:3291 writesame 0x554fedc thru 0x55577e5 data_size 0x1(0x790a bytes) 2024-09-13T06:41:21.025 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-13T06:41:21.026 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-13T06:41:21.026 INFO:teuthology.orchestra.run.smithi081.stderr:Error ENXIO: problem getting command descriptions from osd.7 2024-09-13T06:41:21.027 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-13T06:41:21.027 INFO:teuthology.orchestra.run.smithi081.stdout:3292 punch from 0xaeaaa8f to 0xaeb0350, (0x58c1 bytes) 2024-09-13T06:41:21.027 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:41:21.027 INFO:teuthology.orchestra.run.smithi081.stdout:3294 write 0x8e5e629 thru 0x8e69989 (0xb361 bytes) 2024-09-13T06:41:21.049 INFO:teuthology.orchestra.run.smithi081.stdout:3295 trunc from 0xcc35a5f to 0x211649b 2024-09-13T06:41:21.051 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:41:21.050+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:41:21.086 INFO:teuthology.orchestra.run.smithi081.stdout:3296 write 0x83a1087 thru 0x83aa967 (0x98e1 bytes) 2024-09-13T06:41:21.092 INFO:teuthology.orchestra.run.smithi081.stdout:3297 read 0x310dac6 thru 0x3118d9b (0xb2d6 bytes) 2024-09-13T06:41:21.092 INFO:teuthology.orchestra.run.smithi081.stdout:3300 read 0x5f94a1d thru 0x5f97844 (0x2e28 bytes) 2024-09-13T06:41:21.092 INFO:teuthology.orchestra.run.smithi081.stdout:3301 write 0x46ff8c5 thru 0x470535a (0x5a96 bytes) 2024-09-13T06:41:21.098 INFO:teuthology.orchestra.run.smithi081.stdout:3302 read 0x1bee556 thru 0x1bf3e9b (0x5946 bytes) 2024-09-13T06:41:21.111 INFO:teuthology.orchestra.run.smithi081.stdout:3303 trunc from 0x83aa968 to 0xd0bab4 2024-09-13T06:41:21.129 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:41:21.127+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:41:21.154 INFO:teuthology.orchestra.run.smithi081.stdout:3304 write 0x9e409c4 thru 0x9e4d318 (0xc955 bytes) 2024-09-13T06:41:21.160 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:41:21.160 INFO:teuthology.orchestra.run.smithi081.stdout:3306 writesame 0x820f68f thru 0x82142f4 data_size 0x4d(0x4c66 bytes) 2024-09-13T06:41:21.165 INFO:teuthology.orchestra.run.smithi081.stdout:3307 punch from 0x7e15698 to 0x7e1b9fb, (0x6363 bytes) 2024-09-13T06:41:21.165 INFO:teuthology.orchestra.run.smithi081.stdout:3309 write 0x20aec46 thru 0x20b3e04 (0x51bf bytes) 2024-09-13T06:41:21.185 INFO:teuthology.orchestra.run.smithi081.stdout:3310 writesame 0xcb17f8e thru 0xcb25e77 data_size 0x3(0xdeea bytes) 2024-09-13T06:41:21.185 INFO:teuthology.orchestra.run.smithi081.stdout:3312 write 0x21b10cf thru 0x21baf3a (0x9e6c bytes) 2024-09-13T06:41:21.191 INFO:teuthology.orchestra.run.smithi081.stdout:3314 write 0x4d5a1da thru 0x4d613a6 (0x71cd bytes) 2024-09-13T06:41:21.194 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:41:21.195 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-13T06:41:21.195 INFO:teuthology.orchestra.run.smithi081.stdout: "num_ops": 0 2024-09-13T06:41:21.195 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:41:21.197 INFO:teuthology.orchestra.run.smithi081.stdout:3316 writesame 0x994994b thru 0x994e50a data_size 0x20(0x4bc0 bytes) 2024-09-13T06:41:21.204 INFO:teuthology.orchestra.run.smithi081.stdout:3317 write 0x7612f1d thru 0x76130e1 (0x1c5 bytes) 2024-09-13T06:41:21.211 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-13T06:41:21.211 INFO:teuthology.orchestra.run.smithi081.stdout:3318 punch from 0xad367f8 to 0xad42f28, (0xc730 bytes) 2024-09-13T06:41:21.211 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:41:21.216 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-objectstore-tool --err-to-stderr --data-path /var/lib/ceph/osd/ceph-7 --journal-path /var/lib/ceph/osd/ceph-7/journal '--log-file=/var/log/ceph/objectstore_tool.$pid.log' --op import --file /var/log/ceph/exp.3.16.7 2024-09-13T06:41:21.231 INFO:teuthology.orchestra.run.smithi081.stdout:3320 trunc from 0xcb25e78 to 0x22b7eb5 2024-09-13T06:41:21.259 INFO:teuthology.orchestra.run.smithi081.stdout:3321 trunc from 0x22b7eb5 to 0x6859504 2024-09-13T06:41:21.260 INFO:tasks.ceph.osd.6.smithi139.stderr:2024-09-13T06:41:21.259+0000 7fcd02c5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26385) UID: 0 2024-09-13T06:41:21.266 INFO:teuthology.orchestra.run.smithi081.stdout:3323 punch from 0x1eb87b5 to 0x1ebd1da, (0x4a25 bytes) 2024-09-13T06:41:21.266 INFO:teuthology.orchestra.run.smithi081.stdout:3324 read 0x49be7d5 thru 0x49c118c (0x29b8 bytes) 2024-09-13T06:41:21.266 INFO:teuthology.orchestra.run.smithi081.stdout:3325 writesame 0x4a5eb0e thru 0x4a6aa68 data_size 0x3(0xbf5b bytes) 2024-09-13T06:41:21.279 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:41:21.279 INFO:teuthology.orchestra.run.smithi081.stdout:3327 writesame 0x61babb9 thru 0x61c8d7a data_size 0x4a(0xe1c2 bytes) 2024-09-13T06:41:21.284 INFO:teuthology.orchestra.run.smithi081.stdout:3329 write 0x384c453 thru 0x38584c8 (0xc076 bytes) 2024-09-13T06:41:21.290 INFO:teuthology.orchestra.run.smithi081.stdout:3331 read 0xf3f0c2 thru 0xf473b5 (0x82f4 bytes) 2024-09-13T06:41:21.291 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:41:21.291 INFO:teuthology.orchestra.run.smithi081.stdout:3334 write 0x2d494d0 thru 0x2d4aa5f (0x1590 bytes) 2024-09-13T06:41:21.296 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:41:21.296 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:41:21.310 INFO:teuthology.orchestra.run.smithi081.stdout:3337 write 0x9d616e8 thru 0x9d6baa5 (0xa3be bytes) 2024-09-13T06:41:21.314 INFO:teuthology.orchestra.run.smithi081.stdout:3339 write 0x382484d thru 0x382b92b (0x70df bytes) 2024-09-13T06:41:21.316 INFO:teuthology.orchestra.run.smithi081.stdout:3340 punch from 0x19a5986 to 0x19ace10, (0x748a bytes) 2024-09-13T06:41:21.330 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:41:21.330+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:41:21.333 INFO:teuthology.orchestra.run.smithi081.stdout:3341 write 0xe0b83af thru 0xe0b8b69 (0x7bb bytes) 2024-09-13T06:41:21.337 INFO:teuthology.orchestra.run.smithi081.stdout:3342 write 0xa443c54 thru 0xa44c147 (0x84f4 bytes) 2024-09-13T06:41:21.339 INFO:teuthology.orchestra.run.smithi081.stdout:3344 read 0xd51b8a0 thru 0xd51d386 (0x1ae7 bytes) 2024-09-13T06:41:21.340 INFO:teuthology.orchestra.run.smithi081.stdout:3345 writesame 0x4cd9af9 thru 0x4ce451c data_size 0x2(0xaa24 bytes) 2024-09-13T06:41:21.365 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:41:21.365 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-13T06:41:21.365 INFO:teuthology.orchestra.run.smithi081.stdout: "complaint_time": 30, 2024-09-13T06:41:21.365 INFO:teuthology.orchestra.run.smithi081.stdout: "num_blocked_ops": 0 2024-09-13T06:41:21.365 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:41:21.387 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-13T06:41:21.390 INFO:teuthology.orchestra.run.smithi081.stdout:3346 trunc from 0xe0b8b6a to 0x156e751 2024-09-13T06:41:21.413 INFO:teuthology.orchestra.run.smithi081.stdout:3347 punch from 0xfae9ee to 0xfb2032, (0x3644 bytes) 2024-09-13T06:41:21.413 INFO:teuthology.orchestra.run.smithi081.stdout:3348 read 0xd4a86c thru 0xd52199 (0x792e bytes) 2024-09-13T06:41:21.413 INFO:teuthology.orchestra.run.smithi081.stdout:3354 read 0x195bb3 thru 0x1983c0 (0x280e bytes) 2024-09-13T06:41:21.431 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:41:21.430+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:41:21.438 INFO:teuthology.orchestra.run.smithi081.stdout:3355 write 0xd15fccc thru 0xd16540e (0x5743 bytes) 2024-09-13T06:41:21.443 INFO:teuthology.orchestra.run.smithi081.stdout:3358 write 0x45b411 thru 0x46b325 (0xff15 bytes) 2024-09-13T06:41:21.449 INFO:teuthology.orchestra.run.smithi081.stdout:3359 write 0x735b3f0 thru 0x7366720 (0xb331 bytes) 2024-09-13T06:41:21.454 INFO:teuthology.orchestra.run.smithi081.stdout:3361 punch from 0xa0aae65 to 0xa0b00c6, (0x5261 bytes) 2024-09-13T06:41:21.454 INFO:teuthology.orchestra.run.smithi081.stdout:3364 write 0x25c8d99 thru 0x25cf846 (0x6aae bytes) 2024-09-13T06:41:21.474 INFO:teuthology.orchestra.run.smithi081.stdout:3365 trunc from 0xd16540f to 0x3abd4c0 2024-09-13T06:41:21.508 INFO:teuthology.orchestra.run.smithi081.stdout:3367 write 0xb526ac1 thru 0xb534b42 (0xe082 bytes) 2024-09-13T06:41:21.525 INFO:teuthology.orchestra.run.smithi081.stdout:3369 write 0xea5e98a thru 0xea6c3c4 (0xda3b bytes) 2024-09-13T06:41:21.532 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:41:21.530+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:41:21.534 INFO:teuthology.orchestra.run.smithi081.stdout:3370 trunc from 0xea6c3c5 to 0xc9e2f2e 2024-09-13T06:41:21.535 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:41:21.535 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 20, 2024-09-13T06:41:21.535 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 600, 2024-09-13T06:41:21.535 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [ 2024-09-13T06:41:21.535 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:21.535 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:37801 3.1 3:82e31015:::rbd_object_map.1121d8143c6e.0000000000000019:head [call] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e55)", 2024-09-13T06:41:21.535 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:05.646191+0000", 2024-09-13T06:41:21.535 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 75.888462582000002, 2024-09-13T06:41:21.536 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.72659507800000001, 2024-09-13T06:41:21.536 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:21.536 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:21.536 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:21.536 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:21.536 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:21.536 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 37801 2024-09-13T06:41:21.536 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:21.536 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:21.536 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:21.536 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:21.536 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:05.646191+0000", 2024-09-13T06:41:21.537 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:21.537 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:21.537 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:21.537 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:21.537 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:05.646191+0000", 2024-09-13T06:41:21.537 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:21.537 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:21.537 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:21.537 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:21.537 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:05.646188+0000", 2024-09-13T06:41:21.537 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999971 2024-09-13T06:41:21.537 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:21.537 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:21.538 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:21.538 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:05.646206+0000", 2024-09-13T06:41:21.538 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8182999999999999e-05 2024-09-13T06:41:21.538 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:21.538 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:21.538 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:21.538 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:05.646237+0000", 2024-09-13T06:41:21.538 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.1071000000000001e-05 2024-09-13T06:41:21.538 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:21.538 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:21.538 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:21.538 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:05.646251+0000", 2024-09-13T06:41:21.538 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3679000000000001e-05 2024-09-13T06:41:21.539 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:21.539 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:21.539 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:21.539 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:05.646321+0000", 2024-09-13T06:41:21.539 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.9831000000000003e-05 2024-09-13T06:41:21.539 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:21.539 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:21.539 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:41:21.539 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:05.646331+0000", 2024-09-13T06:41:21.539 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0242e-05 2024-09-13T06:41:21.539 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:21.539 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:21.539 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:21.539 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.371959+0000", 2024-09-13T06:41:21.539 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.72562817199999996 2024-09-13T06:41:21.540 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:21.540 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:21.540 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:21.540 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.372389+0000", 2024-09-13T06:41:21.540 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00042977400000000001 2024-09-13T06:41:21.540 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:21.540 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:21.540 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:21.540 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.372786+0000", 2024-09-13T06:41:21.540 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00039706099999999999 2024-09-13T06:41:21.540 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:21.540 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:21.540 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:21.540 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:21.541 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:21.541 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43009 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 489472~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:21.541 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.644660+0000", 2024-09-13T06:41:21.541 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 59.889993619999998, 2024-09-13T06:41:21.541 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123376071, 2024-09-13T06:41:21.541 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:21.541 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:21.541 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:21.541 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:21.541 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:21.541 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43009 2024-09-13T06:41:21.541 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:21.541 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:21.542 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:21.542 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:21.542 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.644660+0000", 2024-09-13T06:41:21.542 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:21.542 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:21.542 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:21.542 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:21.542 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.644660+0000", 2024-09-13T06:41:21.542 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:21.542 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:21.542 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:21.542 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:21.542 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.644659+0000", 2024-09-13T06:41:21.543 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:21.543 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:21.543 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:21.543 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:21.543 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.644662+0000", 2024-09-13T06:41:21.543 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4949999999999998e-06 2024-09-13T06:41:21.543 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:21.543 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:21.543 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:21.543 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.644669+0000", 2024-09-13T06:41:21.543 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.289e-06 2024-09-13T06:41:21.543 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:21.543 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:21.543 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:21.544 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.644674+0000", 2024-09-13T06:41:21.544 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.8840000000000002e-06 2024-09-13T06:41:21.544 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:21.544 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:21.544 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:21.544 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.767602+0000", 2024-09-13T06:41:21.544 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.122928158 2024-09-13T06:41:21.544 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:21.544 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:21.544 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:21.544 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.767676+0000", 2024-09-13T06:41:21.544 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3992999999999994e-05 2024-09-13T06:41:21.544 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:21.545 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:21.545 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:21.545 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.768036+0000", 2024-09-13T06:41:21.545 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00035966200000000001 2024-09-13T06:41:21.545 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:21.545 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:21.545 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:21.545 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:21.545 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:21.545 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43010 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 503808~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:21.545 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.644678+0000", 2024-09-13T06:41:21.545 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 59.889975294000003, 2024-09-13T06:41:21.545 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123728798, 2024-09-13T06:41:21.545 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:21.546 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:21.546 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:21.546 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:21.546 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:21.546 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43010 2024-09-13T06:41:21.546 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:21.546 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:21.546 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:21.546 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:21.546 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.644678+0000", 2024-09-13T06:41:21.546 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:21.546 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:21.546 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:21.546 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:21.547 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.644678+0000", 2024-09-13T06:41:21.547 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:21.547 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:21.547 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:21.547 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:21.547 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.644678+0000", 2024-09-13T06:41:21.547 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:21.547 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:21.547 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:21.547 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:21.547 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.644680+0000", 2024-09-13T06:41:21.547 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2050000000000001e-06 2024-09-13T06:41:21.547 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:21.547 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:21.547 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:21.548 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.644686+0000", 2024-09-13T06:41:21.548 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8440000000000003e-06 2024-09-13T06:41:21.548 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:21.548 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:21.548 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:21.548 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.644691+0000", 2024-09-13T06:41:21.548 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.118e-06 2024-09-13T06:41:21.548 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:21.548 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:21.548 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:21.548 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.768065+0000", 2024-09-13T06:41:21.548 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123374698 2024-09-13T06:41:21.548 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:21.549 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:21.549 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:21.549 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.768139+0000", 2024-09-13T06:41:21.549 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3934000000000001e-05 2024-09-13T06:41:21.549 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:21.549 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:21.549 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:21.549 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.768407+0000", 2024-09-13T06:41:21.549 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00026738800000000002 2024-09-13T06:41:21.549 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:21.549 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:21.549 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:21.550 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:21.550 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:21.550 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43181 3.17 3:ec5ebce4:::rbd_data.1121f5f2e1c0.0000000000000001:1f [read 319488~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:21.550 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.652968+0000", 2024-09-13T06:41:21.550 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 59.881684778, 2024-09-13T06:41:21.550 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.12363807, 2024-09-13T06:41:21.550 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:21.550 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:21.550 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:21.550 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:21.550 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:21.550 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43181 2024-09-13T06:41:21.550 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:21.551 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:21.551 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:21.551 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:21.551 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.652968+0000", 2024-09-13T06:41:21.551 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:21.551 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:21.551 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:21.551 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:21.551 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.652968+0000", 2024-09-13T06:41:21.551 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:21.551 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:21.551 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:21.551 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:21.552 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.652968+0000", 2024-09-13T06:41:21.552 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:21.552 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:21.552 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:21.552 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:21.552 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.652970+0000", 2024-09-13T06:41:21.552 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2409999999999998e-06 2024-09-13T06:41:21.552 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:21.552 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:21.552 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:21.552 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.652976+0000", 2024-09-13T06:41:21.552 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0079999999999999e-06 2024-09-13T06:41:21.552 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:21.553 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:21.553 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:21.553 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.652981+0000", 2024-09-13T06:41:21.553 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4390000000000002e-06 2024-09-13T06:41:21.553 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:21.553 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:21.553 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:21.553 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.776275+0000", 2024-09-13T06:41:21.553 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.12329396099999999 2024-09-13T06:41:21.553 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:21.553 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:21.553 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:21.553 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.776316+0000", 2024-09-13T06:41:21.554 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.1244e-05 2024-09-13T06:41:21.554 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:21.554 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:21.554 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:21.554 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.776607+0000", 2024-09-13T06:41:21.554 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00029051199999999999 2024-09-13T06:41:21.554 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:21.554 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:21.554 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:21.554 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:21.554 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:21.554 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43182 3.17 3:ec5ebce4:::rbd_data.1121f5f2e1c0.0000000000000001:1f [read 333824~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:21.554 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.652985+0000", 2024-09-13T06:41:21.555 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 59.881667968999999, 2024-09-13T06:41:21.555 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123926616, 2024-09-13T06:41:21.555 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:21.555 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:21.555 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:21.555 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:21.555 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:21.555 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43182 2024-09-13T06:41:21.555 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:21.555 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:21.555 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:21.555 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:21.555 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.652985+0000", 2024-09-13T06:41:21.556 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:21.556 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:21.556 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:21.556 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:21.556 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.652985+0000", 2024-09-13T06:41:21.556 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:21.556 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:21.556 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:21.556 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:21.556 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.652985+0000", 2024-09-13T06:41:21.556 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:21.556 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:21.556 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:21.557 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:21.557 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.652987+0000", 2024-09-13T06:41:21.557 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0899999999999999e-06 2024-09-13T06:41:21.557 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:21.557 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:21.557 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:21.557 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.652994+0000", 2024-09-13T06:41:21.557 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3100000000000003e-06 2024-09-13T06:41:21.557 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:21.557 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:21.557 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:21.557 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.653000+0000", 2024-09-13T06:41:21.557 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2020000000000003e-06 2024-09-13T06:41:21.558 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:21.558 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:21.558 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:21.558 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.776635+0000", 2024-09-13T06:41:21.558 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.12363529400000001 2024-09-13T06:41:21.558 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:21.558 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:21.558 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:21.558 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.776676+0000", 2024-09-13T06:41:21.558 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.0745999999999999e-05 2024-09-13T06:41:21.558 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:21.558 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:21.558 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:21.559 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.776912+0000", 2024-09-13T06:41:21.559 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00023631300000000001 2024-09-13T06:41:21.559 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:21.559 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:21.559 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:21.559 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:21.559 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:21.559 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43192 3.17 3:ec5ebce4:::rbd_data.1121f5f2e1c0.0000000000000001:1f [read 466944~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:21.559 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.656622+0000", 2024-09-13T06:41:21.559 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 59.878030913000003, 2024-09-13T06:41:21.559 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123503136, 2024-09-13T06:41:21.559 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:21.559 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:21.560 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:21.560 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:21.560 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:21.560 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43192 2024-09-13T06:41:21.560 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:21.560 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:21.560 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:21.560 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:21.560 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656622+0000", 2024-09-13T06:41:21.560 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:21.560 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:21.560 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:21.560 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:21.561 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656622+0000", 2024-09-13T06:41:21.561 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:21.561 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:21.561 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:21.561 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:21.561 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656622+0000", 2024-09-13T06:41:21.561 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:41:21.561 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:21.561 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:21.561 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:21.561 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656623+0000", 2024-09-13T06:41:21.561 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2079999999999999e-06 2024-09-13T06:41:21.561 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:21.562 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:21.562 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:21.562 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656627+0000", 2024-09-13T06:41:21.562 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.4819999999999999e-06 2024-09-13T06:41:21.562 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:21.562 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:21.562 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:21.562 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656629+0000", 2024-09-13T06:41:21.562 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.582e-06 2024-09-13T06:41:21.562 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:21.562 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:21.562 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:21.562 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.779866+0000", 2024-09-13T06:41:21.562 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.12323638100000001 2024-09-13T06:41:21.563 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:21.563 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:21.563 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:21.563 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.779905+0000", 2024-09-13T06:41:21.563 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.9529e-05 2024-09-13T06:41:21.563 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:21.563 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:21.563 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:21.563 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.780125+0000", 2024-09-13T06:41:21.563 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000220168 2024-09-13T06:41:21.563 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:21.563 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:21.564 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:21.564 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:21.564 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:21.564 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43193 3.17 3:ec5ebce4:::rbd_data.1121f5f2e1c0.0000000000000001:1f [read 481280~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:21.564 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.656635+0000", 2024-09-13T06:41:21.564 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 59.878018429000001, 2024-09-13T06:41:21.564 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.12374478999999999, 2024-09-13T06:41:21.564 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:21.564 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:21.564 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:21.564 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:21.564 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:21.564 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43193 2024-09-13T06:41:21.565 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:21.565 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:21.565 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:21.565 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:21.565 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656635+0000", 2024-09-13T06:41:21.565 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:21.565 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:21.565 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:21.565 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:21.565 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656635+0000", 2024-09-13T06:41:21.565 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:21.565 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:21.566 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:21.566 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:21.566 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656635+0000", 2024-09-13T06:41:21.566 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:41:21.566 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:21.566 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:21.566 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:21.566 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656636+0000", 2024-09-13T06:41:21.566 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.544e-06 2024-09-13T06:41:21.566 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:21.566 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:21.566 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:21.566 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656639+0000", 2024-09-13T06:41:21.566 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.0879999999999999e-06 2024-09-13T06:41:21.566 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:21.567 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:21.567 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:21.567 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656642+0000", 2024-09-13T06:41:21.567 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5799999999999999e-06 2024-09-13T06:41:21.567 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:21.567 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:21.567 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:21.567 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.780151+0000", 2024-09-13T06:41:21.567 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123509035 2024-09-13T06:41:21.567 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:21.567 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:21.567 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:21.567 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.780191+0000", 2024-09-13T06:41:21.567 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.9758000000000001e-05 2024-09-13T06:41:21.568 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:21.568 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:21.568 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:21.568 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.780380+0000", 2024-09-13T06:41:21.568 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000189023 2024-09-13T06:41:21.568 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:21.568 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:21.568 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:21.568 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:21.568 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:21.568 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43194 3.17 3:ec5ebce4:::rbd_data.1121f5f2e1c0.0000000000000001:1f [read 495616~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:21.568 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.656645+0000", 2024-09-13T06:41:21.568 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 59.878007775999997, 2024-09-13T06:41:21.569 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.124088483, 2024-09-13T06:41:21.569 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:21.569 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:21.569 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:21.569 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:21.569 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:21.569 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43194 2024-09-13T06:41:21.569 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:21.569 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:21.569 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:21.569 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:21.569 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656645+0000", 2024-09-13T06:41:21.570 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:21.570 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:21.570 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:21.570 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:21.570 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656645+0000", 2024-09-13T06:41:21.570 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:21.570 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:21.570 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:21.570 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:21.570 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656645+0000", 2024-09-13T06:41:21.570 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:21.570 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:21.570 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:21.570 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:21.571 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656647+0000", 2024-09-13T06:41:21.571 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9180000000000001e-06 2024-09-13T06:41:21.571 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:21.571 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:21.571 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:21.571 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656653+0000", 2024-09-13T06:41:21.571 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7860000000000002e-06 2024-09-13T06:41:21.571 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:21.571 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:21.571 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:21.571 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656658+0000", 2024-09-13T06:41:21.571 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6949999999999999e-06 2024-09-13T06:41:21.571 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:21.572 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:21.572 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:21.572 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.780406+0000", 2024-09-13T06:41:21.572 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123748657 2024-09-13T06:41:21.572 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:21.572 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:21.572 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:21.572 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.780446+0000", 2024-09-13T06:41:21.572 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.9360999999999998e-05 2024-09-13T06:41:21.572 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:21.572 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:21.572 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:21.573 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.780734+0000", 2024-09-13T06:41:21.573 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00028838399999999998 2024-09-13T06:41:21.573 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:21.573 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:21.573 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:21.573 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:21.573 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:21.573 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43240 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 106496~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:21.573 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.660672+0000", 2024-09-13T06:41:21.573 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 59.873981413000003, 2024-09-13T06:41:21.573 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123612707, 2024-09-13T06:41:21.573 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:21.573 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:21.574 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:21.574 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:21.574 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:21.574 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43240 2024-09-13T06:41:21.574 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:21.574 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:21.574 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:21.574 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:21.574 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660672+0000", 2024-09-13T06:41:21.574 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:21.574 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:21.574 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:21.574 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:21.574 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660672+0000", 2024-09-13T06:41:21.575 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:21.575 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:21.575 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:21.575 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:21.575 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660671+0000", 2024-09-13T06:41:21.575 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:21.575 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:21.575 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:21.575 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:21.575 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660673+0000", 2024-09-13T06:41:21.575 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.652e-06 2024-09-13T06:41:21.575 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:21.575 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:21.576 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:21.576 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660677+0000", 2024-09-13T06:41:21.576 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.2509999999999996e-06 2024-09-13T06:41:21.576 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:21.576 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:21.576 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:21.576 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660680+0000", 2024-09-13T06:41:21.576 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.8150000000000002e-06 2024-09-13T06:41:21.576 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:21.576 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:21.576 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:21.576 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.783596+0000", 2024-09-13T06:41:21.576 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.122915841 2024-09-13T06:41:21.576 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:21.577 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:21.577 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:21.577 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.783682+0000", 2024-09-13T06:41:21.577 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.5822999999999995e-05 2024-09-13T06:41:21.577 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:21.577 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:21.577 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:21.577 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.784285+0000", 2024-09-13T06:41:21.577 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00060276500000000001 2024-09-13T06:41:21.577 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:21.577 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:21.577 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:21.577 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:21.578 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:21.578 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43241 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 120832~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:21.578 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.660682+0000", 2024-09-13T06:41:21.578 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 59.873970837999998, 2024-09-13T06:41:21.578 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123958204, 2024-09-13T06:41:21.578 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:21.578 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:21.578 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:21.578 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:21.578 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:21.578 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43241 2024-09-13T06:41:21.578 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:21.578 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:21.579 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:21.579 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:21.579 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660682+0000", 2024-09-13T06:41:21.579 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:21.579 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:21.579 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:21.579 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:21.579 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660682+0000", 2024-09-13T06:41:21.579 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:21.579 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:21.579 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:21.579 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:21.579 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660682+0000", 2024-09-13T06:41:21.580 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:21.580 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:21.580 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:21.580 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:21.580 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660683+0000", 2024-09-13T06:41:21.580 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.308e-06 2024-09-13T06:41:21.580 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:21.580 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:21.580 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:21.581 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660686+0000", 2024-09-13T06:41:21.581 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.977e-06 2024-09-13T06:41:21.581 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:21.581 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:21.581 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:21.581 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660689+0000", 2024-09-13T06:41:21.581 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5830000000000001e-06 2024-09-13T06:41:21.581 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:21.581 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:21.581 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:21.581 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.784366+0000", 2024-09-13T06:41:21.581 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.12367713599999999 2024-09-13T06:41:21.581 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:21.582 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:21.582 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:21.582 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.784451+0000", 2024-09-13T06:41:21.582 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.4629999999999994e-05 2024-09-13T06:41:21.582 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:21.582 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:21.583 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:21.583 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.784641+0000", 2024-09-13T06:41:21.583 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00018984899999999999 2024-09-13T06:41:21.583 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:21.583 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:21.583 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:21.583 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:21.583 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:21.583 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43242 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 139264~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:21.583 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.660691+0000", 2024-09-13T06:41:21.583 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 59.873961860000001, 2024-09-13T06:41:21.583 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.124536443, 2024-09-13T06:41:21.583 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:21.584 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:21.584 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:21.584 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:21.584 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:21.584 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43242 2024-09-13T06:41:21.584 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:21.584 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:21.584 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:21.584 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:21.584 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660691+0000", 2024-09-13T06:41:21.584 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:21.584 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:21.584 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:21.585 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:21.585 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660691+0000", 2024-09-13T06:41:21.585 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:21.585 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:21.585 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:21.585 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:21.585 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660691+0000", 2024-09-13T06:41:21.585 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:41:21.585 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:21.585 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:21.585 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:21.585 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660696+0000", 2024-09-13T06:41:21.585 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0560000000000004e-06 2024-09-13T06:41:21.586 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:21.586 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:21.586 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:21.586 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660699+0000", 2024-09-13T06:41:21.586 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.2009999999999999e-06 2024-09-13T06:41:21.586 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:21.586 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:21.586 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:21.586 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660702+0000", 2024-09-13T06:41:21.586 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.633e-06 2024-09-13T06:41:21.586 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:21.586 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:21.586 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:21.586 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.784912+0000", 2024-09-13T06:41:21.587 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.124209497 2024-09-13T06:41:21.587 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:21.587 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:21.587 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:21.587 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.784995+0000", 2024-09-13T06:41:21.587 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.3891e-05 2024-09-13T06:41:21.587 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:21.587 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:21.587 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:21.587 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.785228+0000", 2024-09-13T06:41:21.587 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00023237400000000001 2024-09-13T06:41:21.587 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:21.587 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:21.588 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:21.588 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:21.588 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:21.588 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43243 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 153600~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:21.588 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.660705+0000", 2024-09-13T06:41:21.588 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 59.873948527000003, 2024-09-13T06:41:21.588 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.124825835, 2024-09-13T06:41:21.588 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:21.588 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:21.588 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:21.588 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:21.588 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:21.588 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43243 2024-09-13T06:41:21.589 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:21.589 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:21.589 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:21.589 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:21.589 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660705+0000", 2024-09-13T06:41:21.589 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:21.589 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:21.589 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:21.589 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:21.589 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660705+0000", 2024-09-13T06:41:21.589 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:21.589 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:21.589 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:21.590 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:21.590 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660705+0000", 2024-09-13T06:41:21.590 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:41:21.590 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:21.590 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:21.590 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:21.590 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660706+0000", 2024-09-13T06:41:21.590 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4339999999999999e-06 2024-09-13T06:41:21.590 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:21.590 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:21.590 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:21.590 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660709+0000", 2024-09-13T06:41:21.590 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9000000000000002e-06 2024-09-13T06:41:21.591 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:21.591 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:21.591 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:21.591 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660712+0000", 2024-09-13T06:41:21.591 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.0589999999999998e-06 2024-09-13T06:41:21.591 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:21.591 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:21.591 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:21.591 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.785318+0000", 2024-09-13T06:41:21.591 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.124606299 2024-09-13T06:41:21.591 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:21.591 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:21.591 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:21.592 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.785361+0000", 2024-09-13T06:41:21.592 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.3214999999999999e-05 2024-09-13T06:41:21.592 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:21.592 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:21.592 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:21.592 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.785531+0000", 2024-09-13T06:41:21.592 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00016914400000000001 2024-09-13T06:41:21.592 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:21.592 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:21.592 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:21.592 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:21.592 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:21.592 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43244 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 167936~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:21.592 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.660714+0000", 2024-09-13T06:41:21.593 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 59.873939114000002, 2024-09-13T06:41:21.593 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.125073248, 2024-09-13T06:41:21.593 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:21.593 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:21.593 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:21.593 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:21.593 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:21.593 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43244 2024-09-13T06:41:21.593 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:21.593 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:21.593 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:21.593 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:21.593 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660714+0000", 2024-09-13T06:41:21.594 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:21.594 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:21.594 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:21.594 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:21.594 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660714+0000", 2024-09-13T06:41:21.594 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:21.594 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:21.594 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:21.594 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:21.594 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660714+0000", 2024-09-13T06:41:21.594 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:41:21.594 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:21.594 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:21.594 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:21.595 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660715+0000", 2024-09-13T06:41:21.595 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2330000000000001e-06 2024-09-13T06:41:21.595 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:21.595 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:21.595 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:21.595 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660718+0000", 2024-09-13T06:41:21.595 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9569999999999998e-06 2024-09-13T06:41:21.595 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:21.595 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:21.595 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:21.595 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660721+0000", 2024-09-13T06:41:21.595 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.678e-06 2024-09-13T06:41:21.595 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:21.596 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:21.596 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:21.596 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.785557+0000", 2024-09-13T06:41:21.596 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.12483633199999999 2024-09-13T06:41:21.596 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:21.596 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:21.596 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:21.596 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.785618+0000", 2024-09-13T06:41:21.596 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0686000000000001e-05 2024-09-13T06:41:21.596 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:21.596 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:21.596 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:21.596 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.785787+0000", 2024-09-13T06:41:21.597 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00016957699999999999 2024-09-13T06:41:21.597 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:21.597 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:21.597 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:21.597 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:21.597 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:21.597 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43254 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 315392~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:21.597 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.664717+0000", 2024-09-13T06:41:21.597 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 59.869936545999998, 2024-09-13T06:41:21.597 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.12357108, 2024-09-13T06:41:21.597 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:21.597 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:21.597 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:21.598 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:21.598 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:21.598 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43254 2024-09-13T06:41:21.598 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:21.598 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:21.598 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:21.598 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:21.598 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664717+0000", 2024-09-13T06:41:21.598 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:21.598 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:21.598 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:21.598 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:21.598 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664717+0000", 2024-09-13T06:41:21.599 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:21.599 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:21.599 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:21.599 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:21.599 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664716+0000", 2024-09-13T06:41:21.599 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:21.599 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:21.599 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:21.599 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:21.599 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664724+0000", 2024-09-13T06:41:21.599 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.7109999999999995e-06 2024-09-13T06:41:21.599 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:21.599 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:21.600 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:21.600 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664732+0000", 2024-09-13T06:41:21.600 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.8399999999999995e-06 2024-09-13T06:41:21.600 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:21.600 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:21.600 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:21.600 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664738+0000", 2024-09-13T06:41:21.600 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.879e-06 2024-09-13T06:41:21.600 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:21.600 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:21.600 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:21.600 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.788018+0000", 2024-09-13T06:41:21.600 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123280719 2024-09-13T06:41:21.601 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:21.601 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:21.601 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:21.601 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.788119+0000", 2024-09-13T06:41:21.601 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000100558 2024-09-13T06:41:21.601 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:21.601 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:21.601 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:21.601 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.788288+0000", 2024-09-13T06:41:21.601 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000168751 2024-09-13T06:41:21.601 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:21.601 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:21.601 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:21.602 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:21.602 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:21.602 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43255 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 329728~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:21.602 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.664743+0000", 2024-09-13T06:41:21.602 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 59.86991055, 2024-09-13T06:41:21.602 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.12381711500000001, 2024-09-13T06:41:21.602 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:21.602 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:21.602 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:21.602 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:21.602 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:21.602 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43255 2024-09-13T06:41:21.602 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:21.603 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:21.603 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:21.603 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:21.603 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664743+0000", 2024-09-13T06:41:21.603 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:21.603 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:21.603 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:21.603 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:21.603 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664743+0000", 2024-09-13T06:41:21.603 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:21.603 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:21.603 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:21.603 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:21.603 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664742+0000", 2024-09-13T06:41:21.604 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:21.604 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:21.604 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:21.604 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:21.604 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664745+0000", 2024-09-13T06:41:21.604 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.7269999999999999e-06 2024-09-13T06:41:21.604 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:21.604 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:21.604 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:21.604 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664753+0000", 2024-09-13T06:41:21.604 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.8709999999999997e-06 2024-09-13T06:41:21.604 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:21.604 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:21.605 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:21.605 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664758+0000", 2024-09-13T06:41:21.605 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2220000000000001e-06 2024-09-13T06:41:21.605 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:21.605 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:21.605 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:21.605 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.788314+0000", 2024-09-13T06:41:21.605 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123555545 2024-09-13T06:41:21.605 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:21.605 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:21.605 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:21.605 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.788368+0000", 2024-09-13T06:41:21.605 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3928999999999998e-05 2024-09-13T06:41:21.606 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:21.606 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:21.606 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:21.606 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.788560+0000", 2024-09-13T06:41:21.606 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000192237 2024-09-13T06:41:21.606 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:21.606 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:21.606 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:21.606 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:21.606 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:21.606 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43256 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 344064~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:21.606 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.664763+0000", 2024-09-13T06:41:21.606 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 59.869890603999998, 2024-09-13T06:41:21.607 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.12418359399999999, 2024-09-13T06:41:21.607 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:21.607 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:21.607 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:21.607 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:21.607 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:21.607 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43256 2024-09-13T06:41:21.607 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:21.607 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:21.607 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:21.607 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:21.607 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664763+0000", 2024-09-13T06:41:21.607 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:21.608 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:21.608 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:21.608 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:21.608 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664763+0000", 2024-09-13T06:41:21.608 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:21.608 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:21.608 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:21.608 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:21.608 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664762+0000", 2024-09-13T06:41:21.608 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:21.608 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:21.608 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:21.608 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:21.609 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664765+0000", 2024-09-13T06:41:21.609 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3290000000000001e-06 2024-09-13T06:41:21.609 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:21.609 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:21.609 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:21.609 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664771+0000", 2024-09-13T06:41:21.609 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.1319999999999999e-06 2024-09-13T06:41:21.609 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:21.609 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:21.609 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:21.609 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664776+0000", 2024-09-13T06:41:21.609 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.8840000000000002e-06 2024-09-13T06:41:21.610 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:21.610 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:21.610 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:21.610 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.788598+0000", 2024-09-13T06:41:21.610 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123821979 2024-09-13T06:41:21.610 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:21.610 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:21.610 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:21.610 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.788680+0000", 2024-09-13T06:41:21.610 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.2367999999999995e-05 2024-09-13T06:41:21.610 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:21.610 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:21.610 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:21.611 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.788946+0000", 2024-09-13T06:41:21.611 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00026629799999999999 2024-09-13T06:41:21.611 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:21.611 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:21.611 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:21.611 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:21.611 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:21.611 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43265 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 477184~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:21.611 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.669414+0000", 2024-09-13T06:41:21.611 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 59.865238968, 2024-09-13T06:41:21.611 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123446973, 2024-09-13T06:41:21.611 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:21.611 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:21.611 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:21.612 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:21.612 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:21.612 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43265 2024-09-13T06:41:21.612 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:21.612 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:21.612 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:21.612 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:21.612 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669414+0000", 2024-09-13T06:41:21.612 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:21.612 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:21.612 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:21.612 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:21.612 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669414+0000", 2024-09-13T06:41:21.612 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:21.613 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:21.613 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:21.613 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:21.613 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669414+0000", 2024-09-13T06:41:21.613 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:21.613 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:21.613 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:21.613 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:21.613 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669416+0000", 2024-09-13T06:41:21.613 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.317e-06 2024-09-13T06:41:21.613 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:21.613 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:21.613 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:21.614 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669425+0000", 2024-09-13T06:41:21.614 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.0650000000000005e-06 2024-09-13T06:41:21.614 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:21.614 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:21.614 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:21.614 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669430+0000", 2024-09-13T06:41:21.614 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5079999999999999e-06 2024-09-13T06:41:21.614 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:21.614 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:21.614 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:21.614 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.792649+0000", 2024-09-13T06:41:21.614 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123219328 2024-09-13T06:41:21.614 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:21.614 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:21.614 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:21.615 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.792695+0000", 2024-09-13T06:41:21.615 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5476999999999998e-05 2024-09-13T06:41:21.615 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:21.615 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:21.615 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:21.615 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.792861+0000", 2024-09-13T06:41:21.615 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00016658999999999999 2024-09-13T06:41:21.615 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:21.615 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:21.615 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:21.615 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:21.615 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:21.615 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43266 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 491520~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:21.615 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.669434+0000", 2024-09-13T06:41:21.616 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 59.865218845999998, 2024-09-13T06:41:21.616 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123685267, 2024-09-13T06:41:21.616 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:21.616 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:21.616 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:21.616 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:21.616 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:21.616 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43266 2024-09-13T06:41:21.616 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:21.616 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:21.616 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:21.616 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:21.616 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669434+0000", 2024-09-13T06:41:21.617 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:21.617 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:21.617 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:21.617 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:21.617 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669434+0000", 2024-09-13T06:41:21.617 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:21.617 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:21.617 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:21.617 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:21.617 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669434+0000", 2024-09-13T06:41:21.617 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:21.617 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:21.617 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:21.618 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:21.618 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669441+0000", 2024-09-13T06:41:21.618 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3019999999999997e-06 2024-09-13T06:41:21.618 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:21.618 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:21.618 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:21.618 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669451+0000", 2024-09-13T06:41:21.618 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.6379999999999999e-06 2024-09-13T06:41:21.618 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:21.618 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:21.618 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:21.618 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669456+0000", 2024-09-13T06:41:21.618 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.361e-06 2024-09-13T06:41:21.618 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:21.619 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:21.619 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:21.619 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.792879+0000", 2024-09-13T06:41:21.619 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123422686 2024-09-13T06:41:21.619 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:21.619 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:21.619 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:21.619 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.792923+0000", 2024-09-13T06:41:21.619 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4035000000000001e-05 2024-09-13T06:41:21.619 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:21.619 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:21.619 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:21.619 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.793120+0000", 2024-09-13T06:41:21.620 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00019660899999999999 2024-09-13T06:41:21.620 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:21.620 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:21.620 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:21.620 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:21.620 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:21.620 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43267 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 505856~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:21.620 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.669461+0000", 2024-09-13T06:41:21.620 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 59.865192049999997, 2024-09-13T06:41:21.620 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123933711, 2024-09-13T06:41:21.620 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:21.620 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:21.620 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:21.621 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:21.621 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:21.621 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43267 2024-09-13T06:41:21.621 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:21.621 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:21.621 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:21.621 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:21.621 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669461+0000", 2024-09-13T06:41:21.621 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:21.621 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:21.621 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:21.621 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:21.621 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669461+0000", 2024-09-13T06:41:21.621 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:21.622 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:21.622 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:21.622 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:21.622 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669461+0000", 2024-09-13T06:41:21.622 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:21.622 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:21.622 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:21.622 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:21.622 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669463+0000", 2024-09-13T06:41:21.622 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5629999999999999e-06 2024-09-13T06:41:21.622 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:21.622 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:21.622 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:21.623 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669473+0000", 2024-09-13T06:41:21.623 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.9520000000000006e-06 2024-09-13T06:41:21.623 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:21.623 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:21.623 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:21.623 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669479+0000", 2024-09-13T06:41:21.623 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8540000000000002e-06 2024-09-13T06:41:21.623 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:21.623 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:21.623 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:21.623 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.793137+0000", 2024-09-13T06:41:21.623 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.12365825699999999 2024-09-13T06:41:21.624 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:21.624 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:21.624 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:21.624 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.793181+0000", 2024-09-13T06:41:21.624 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.3773999999999998e-05 2024-09-13T06:41:21.624 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:21.624 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:21.624 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:21.624 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.793395+0000", 2024-09-13T06:41:21.624 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00021372399999999999 2024-09-13T06:41:21.624 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:21.624 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:21.624 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:21.625 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:21.625 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:21.625 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43268 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 520192~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:21.625 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.669484+0000", 2024-09-13T06:41:21.625 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 59.865169264999999, 2024-09-13T06:41:21.625 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.12441057899999999, 2024-09-13T06:41:21.625 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:21.625 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:21.625 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:21.625 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:21.625 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:21.625 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43268 2024-09-13T06:41:21.625 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:21.626 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:21.626 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:21.626 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:21.626 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669484+0000", 2024-09-13T06:41:21.626 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:21.626 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:21.626 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:21.626 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:21.626 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669484+0000", 2024-09-13T06:41:21.626 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:21.626 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:21.626 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:21.626 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:21.626 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669484+0000", 2024-09-13T06:41:21.627 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:21.627 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:21.627 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:21.627 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:21.627 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669486+0000", 2024-09-13T06:41:21.627 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6120000000000001e-06 2024-09-13T06:41:21.627 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:21.627 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:21.627 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:21.627 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669494+0000", 2024-09-13T06:41:21.627 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4819999999999997e-06 2024-09-13T06:41:21.627 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:21.627 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:21.628 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:21.628 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669497+0000", 2024-09-13T06:41:21.628 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9790000000000002e-06 2024-09-13T06:41:21.628 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:21.628 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:21.628 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:21.628 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.793559+0000", 2024-09-13T06:41:21.628 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.124062436 2024-09-13T06:41:21.628 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:21.628 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:21.628 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:21.628 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.793603+0000", 2024-09-13T06:41:21.628 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.3764999999999999e-05 2024-09-13T06:41:21.628 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:21.629 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:21.629 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:21.629 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.793895+0000", 2024-09-13T06:41:21.629 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00029168299999999999 2024-09-13T06:41:21.629 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:21.629 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:21.629 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:21.629 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:21.629 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:21.629 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:41:21.631 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-13T06:41:21.632 INFO:teuthology.orchestra.run.smithi081.stdout:3371 trunc from 0xc9e2f2e to 0xa1c08ad 2024-09-13T06:41:21.632 INFO:teuthology.orchestra.run.smithi081.stdout:3372 read 0x6e9a57e thru 0x6e9df83 (0x3a06 bytes) 2024-09-13T06:41:21.632 INFO:teuthology.orchestra.run.smithi081.stdout:3373 read 0x1aec972 thru 0x1af9673 (0xcd02 bytes) 2024-09-13T06:41:21.632 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:41:21.633 INFO:teuthology.orchestra.run.smithi081.stdout:3377 trunc from 0xa1c08ad to 0xa9550eb 2024-09-13T06:41:21.633 INFO:teuthology.orchestra.run.smithi081.stdout:3378 trunc from 0xa9550eb to 0xe01e4be 2024-09-13T06:41:21.633 INFO:teuthology.orchestra.run.smithi081.stdout:3380 trunc from 0xe01e4be to 0x2d9e274 2024-09-13T06:41:21.633 INFO:teuthology.orchestra.run.smithi081.stdout:3381 write 0x14cde59 thru 0x14d535c (0x7504 bytes) 2024-09-13T06:41:21.633 INFO:teuthology.orchestra.run.smithi081.stdout:3384 read 0x221d9e0 thru 0x2221390 (0x39b1 bytes) 2024-09-13T06:41:21.633 INFO:teuthology.orchestra.run.smithi081.stdout:3385 read 0x1a6ab49 thru 0x1a745c1 (0x9a79 bytes) 2024-09-13T06:41:21.633 INFO:teuthology.orchestra.run.smithi081.stdout:3386 punch from 0x2c6e438 to 0x2c75cf0, (0x78b8 bytes) 2024-09-13T06:41:21.633 INFO:teuthology.orchestra.run.smithi081.stdout:3389 read 0x2837fea thru 0x283a674 (0x268b bytes) 2024-09-13T06:41:21.633 INFO:teuthology.orchestra.run.smithi081.stdout:3390 trunc from 0x2d9e274 to 0x5ba8fbc 2024-09-13T06:41:21.634 INFO:tasks.ceph.osd.6.smithi139.stderr:2024-09-13T06:41:21.631+0000 7fcd02c5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26385) UID: 0 2024-09-13T06:41:21.642 INFO:teuthology.orchestra.run.smithi081.stdout:3391 write 0x5d826f4 thru 0x5d90545 (0xde52 bytes) 2024-09-13T06:41:21.656 INFO:teuthology.orchestra.run.smithi081.stdout:3393 writesame 0x5fb0b52 thru 0x5fb7e7a data_size 0x1f(0x7329 bytes) 2024-09-13T06:41:21.676 INFO:teuthology.orchestra.run.smithi081.stdout:3394 write 0xca78ea2 thru 0xca7a00b (0x116a bytes) 2024-09-13T06:41:21.683 INFO:teuthology.orchestra.run.smithi081.stdout:3395 write 0xc22c02f thru 0xc2356f1 (0x96c3 bytes) 2024-09-13T06:41:21.688 INFO:teuthology.orchestra.run.smithi081.stdout:3396 read 0xc950bd5 thru 0xc9532c8 (0x26f4 bytes) 2024-09-13T06:41:21.699 INFO:teuthology.orchestra.run.smithi081.stdout:3397 trunc from 0xca7a00c to 0x689debd 2024-09-13T06:41:21.729 INFO:teuthology.orchestra.run.smithi081.stdout:3398 writesame 0x7088a13 thru 0x708c3a1 data_size 0x7(0x398f bytes) 2024-09-13T06:41:21.735 INFO:teuthology.orchestra.run.smithi081.stdout:3399 trunc from 0x708c3a2 to 0xb470433 2024-09-13T06:41:21.735 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:41:21.734+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:41:21.745 INFO:teuthology.orchestra.run.smithi081.stdout:3400 trunc from 0xb470433 to 0xc530af0 2024-09-13T06:41:21.757 INFO:teuthology.orchestra.run.smithi081.stdout:3401 read 0x9d80377 thru 0x9d8c8f3 (0xc57d bytes) 2024-09-13T06:41:21.757 INFO:teuthology.orchestra.run.smithi081.stdout:3402 writesame 0x4cc9d26 thru 0x4cccc0a data_size 0x23(0x2ee5 bytes) 2024-09-13T06:41:21.760 INFO:teuthology.orchestra.run.smithi081.stdout:3403 punch from 0xc2ec600 to 0xc2f83aa, (0xbdaa bytes) 2024-09-13T06:41:21.760 INFO:teuthology.orchestra.run.smithi081.stdout:3405 write 0x376a6d7 thru 0x3772b36 (0x8460 bytes) 2024-09-13T06:41:21.765 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:41:21.765 INFO:teuthology.orchestra.run.smithi081.stdout:3407 write 0x58bdb73 thru 0x58c48a1 (0x6d2f bytes) 2024-09-13T06:41:21.771 INFO:teuthology.orchestra.run.smithi081.stdout:3408 write 0xc2ccb58 thru 0xc2db611 (0xeaba bytes) 2024-09-13T06:41:21.781 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:41:21.782 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-13T06:41:21.782 INFO:teuthology.orchestra.run.smithi081.stdout: "num_ops": 0 2024-09-13T06:41:21.782 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:41:21.784 INFO:teuthology.orchestra.run.smithi081.stdout:3409 trunc from 0xc530af0 to 0x83bf37f 2024-09-13T06:41:21.800 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-13T06:41:21.801 INFO:teuthology.orchestra.run.smithi081.stdout:3410 write 0x2a859b9 thru 0x2a88427 (0x2a6f bytes) 2024-09-13T06:41:21.807 INFO:teuthology.orchestra.run.smithi081.stdout:3412 read 0x52047c3 thru 0x5211071 (0xc8af bytes) 2024-09-13T06:41:21.825 INFO:teuthology.orchestra.run.smithi081.stdout:3413 write 0xe4a8000 thru 0xe4b5c9d (0xdc9e bytes) 2024-09-13T06:41:21.832 INFO:teuthology.orchestra.run.smithi081.stdout:3414 read 0x6d78ba5 thru 0x6d7ecbd (0x6119 bytes) 2024-09-13T06:41:21.832 INFO:teuthology.orchestra.run.smithi081.stdout:3416 writesame 0x7efa24e thru 0x7f073ce data_size 0x1(0xd181 bytes) 2024-09-13T06:41:21.836 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:41:21.834+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:41:21.869 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:41:21.892 INFO:teuthology.orchestra.run.smithi081.stdout:3419 trunc from 0xe4b5c9e to 0x30eaf9e 2024-09-13T06:41:21.916 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:41:21.916 INFO:teuthology.orchestra.run.smithi081.stdout:3421 punch from 0x1517ed1 to 0x151fef3, (0x8022 bytes) 2024-09-13T06:41:21.917 INFO:teuthology.orchestra.run.smithi081.stdout:3422 punch from 0x3539ed to 0x35fbf0, (0xc203 bytes) 2024-09-13T06:41:21.917 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:41:21.917 INFO:teuthology.orchestra.run.smithi081.stdout:3425 clone 21 order 22 su 16384 sc 13 2024-09-13T06:41:21.929 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:41:21.929 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-13T06:41:21.929 INFO:teuthology.orchestra.run.smithi081.stdout: "complaint_time": 30, 2024-09-13T06:41:21.930 INFO:teuthology.orchestra.run.smithi081.stdout: "num_blocked_ops": 0 2024-09-13T06:41:21.930 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:41:21.937 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:41:21.934+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:41:21.944 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-13T06:41:22.038 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:41:22.035+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:41:22.113 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:41:22.113 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 20, 2024-09-13T06:41:22.113 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 600, 2024-09-13T06:41:22.113 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [ 2024-09-13T06:41:22.114 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.114 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:21979 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 14217216~4096 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:41:22.114 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.888811+0000", 2024-09-13T06:41:22.114 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 89.223568268999998, 2024-09-13T06:41:22.114 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049092969, 2024-09-13T06:41:22.114 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:22.114 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:22.114 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:22.114 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:22.114 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:22.114 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 21979 2024-09-13T06:41:22.114 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.114 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:22.115 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.115 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:22.115 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888811+0000", 2024-09-13T06:41:22.115 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:22.115 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.115 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.115 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:22.115 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888811+0000", 2024-09-13T06:41:22.115 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:22.115 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.115 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.115 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:22.115 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888811+0000", 2024-09-13T06:41:22.116 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:41:22.116 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.116 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.116 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:22.116 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888812+0000", 2024-09-13T06:41:22.116 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.204e-06 2024-09-13T06:41:22.116 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.116 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.116 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:22.116 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888815+0000", 2024-09-13T06:41:22.116 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9359999999999999e-06 2024-09-13T06:41:22.116 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.117 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.117 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:22.117 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888818+0000", 2024-09-13T06:41:22.117 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.7369999999999998e-06 2024-09-13T06:41:22.117 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.117 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.117 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:22.117 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.937663+0000", 2024-09-13T06:41:22.117 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.048844540999999998 2024-09-13T06:41:22.117 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.117 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.117 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:22.117 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.937709+0000", 2024-09-13T06:41:22.118 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6492999999999997e-05 2024-09-13T06:41:22.118 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.118 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.118 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:22.118 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.937904+0000", 2024-09-13T06:41:22.118 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00019526499999999999 2024-09-13T06:41:22.118 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:22.118 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:22.118 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:22.118 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.118 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.118 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:21980 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 14245888~4096 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:41:22.118 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.888820+0000", 2024-09-13T06:41:22.119 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 89.223559592000001, 2024-09-13T06:41:22.119 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049357080999999997, 2024-09-13T06:41:22.119 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:22.119 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:22.119 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:22.119 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:22.119 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:22.119 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 21980 2024-09-13T06:41:22.119 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.119 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:22.119 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.119 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:22.119 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888820+0000", 2024-09-13T06:41:22.120 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:22.120 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.120 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.120 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:22.120 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888820+0000", 2024-09-13T06:41:22.120 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:22.120 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.120 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.120 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:22.120 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888820+0000", 2024-09-13T06:41:22.120 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:41:22.120 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.120 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.121 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:22.121 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888821+0000", 2024-09-13T06:41:22.121 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.122e-06 2024-09-13T06:41:22.121 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.121 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.121 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:22.121 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888824+0000", 2024-09-13T06:41:22.121 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.0580000000000002e-06 2024-09-13T06:41:22.121 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.121 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.121 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:22.121 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888827+0000", 2024-09-13T06:41:22.121 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.666e-06 2024-09-13T06:41:22.122 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.122 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.122 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:22.122 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.937935+0000", 2024-09-13T06:41:22.122 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049108329999999999 2024-09-13T06:41:22.122 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.122 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.122 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:22.122 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.937985+0000", 2024-09-13T06:41:22.122 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9694000000000002e-05 2024-09-13T06:41:22.122 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.122 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.123 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:22.123 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.938177+0000", 2024-09-13T06:41:22.123 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00019241899999999999 2024-09-13T06:41:22.123 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:22.123 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:22.123 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:22.123 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.123 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.123 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:21984 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:snapdir [list-snaps] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:41:22.123 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.888829+0000", 2024-09-13T06:41:22.123 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 89.223550814000006, 2024-09-13T06:41:22.123 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049524545000000003, 2024-09-13T06:41:22.123 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:22.124 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:22.124 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:22.124 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:22.124 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:22.124 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 21984 2024-09-13T06:41:22.124 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.124 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:22.124 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.124 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:22.124 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888829+0000", 2024-09-13T06:41:22.124 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:22.124 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.125 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.125 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:22.125 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888829+0000", 2024-09-13T06:41:22.125 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:22.125 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.125 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.125 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:22.125 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888829+0000", 2024-09-13T06:41:22.125 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:41:22.125 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.125 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.125 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:22.125 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888830+0000", 2024-09-13T06:41:22.126 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2529999999999999e-06 2024-09-13T06:41:22.126 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.126 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.126 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:22.126 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888835+0000", 2024-09-13T06:41:22.126 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.4729999999999999e-06 2024-09-13T06:41:22.126 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.126 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.126 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:22.126 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888840+0000", 2024-09-13T06:41:22.126 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0159999999999999e-06 2024-09-13T06:41:22.126 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.126 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.126 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:22.127 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.938199+0000", 2024-09-13T06:41:22.127 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049358974999999999 2024-09-13T06:41:22.127 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.127 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.127 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:22.127 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.938268+0000", 2024-09-13T06:41:22.127 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.8876999999999998e-05 2024-09-13T06:41:22.127 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.127 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.127 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:22.127 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.938353+0000", 2024-09-13T06:41:22.127 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.5155999999999996e-05 2024-09-13T06:41:22.127 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:22.128 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:22.128 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:22.128 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.128 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.128 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:21985 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 12587008~4096 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:41:22.128 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.888858+0000", 2024-09-13T06:41:22.128 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 89.223521664000003, 2024-09-13T06:41:22.128 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049674347000000001, 2024-09-13T06:41:22.128 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:22.128 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:22.128 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:22.128 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:22.129 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:22.129 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 21985 2024-09-13T06:41:22.129 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.129 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:22.129 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.129 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:22.129 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888858+0000", 2024-09-13T06:41:22.129 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:22.129 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.129 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.129 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:22.129 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888858+0000", 2024-09-13T06:41:22.129 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:22.130 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.130 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.130 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:22.130 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888857+0000", 2024-09-13T06:41:22.130 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:22.130 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.130 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.130 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:22.130 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888860+0000", 2024-09-13T06:41:22.130 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4739999999999999e-06 2024-09-13T06:41:22.131 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.131 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.131 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:22.131 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888867+0000", 2024-09-13T06:41:22.131 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.7170000000000002e-06 2024-09-13T06:41:22.131 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.131 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.131 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:22.131 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888871+0000", 2024-09-13T06:41:22.131 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5120000000000002e-06 2024-09-13T06:41:22.131 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.131 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.131 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:22.132 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.938389+0000", 2024-09-13T06:41:22.132 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049517717000000003 2024-09-13T06:41:22.132 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.132 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.132 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:22.132 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.938449+0000", 2024-09-13T06:41:22.132 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0513999999999997e-05 2024-09-13T06:41:22.132 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.132 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.132 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:22.132 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.938532+0000", 2024-09-13T06:41:22.132 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.2936999999999996e-05 2024-09-13T06:41:22.133 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:22.133 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:22.133 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:22.133 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.133 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.133 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:21986 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 12615680~4096 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:41:22.133 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.888875+0000", 2024-09-13T06:41:22.133 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 89.223504151, 2024-09-13T06:41:22.133 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049881781, 2024-09-13T06:41:22.133 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:22.133 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:22.134 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:22.134 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:22.134 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:22.134 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 21986 2024-09-13T06:41:22.134 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.134 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:22.134 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.134 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:22.134 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888875+0000", 2024-09-13T06:41:22.134 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:22.134 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.134 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.134 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:22.135 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888875+0000", 2024-09-13T06:41:22.135 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:22.135 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.135 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.135 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:22.135 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888875+0000", 2024-09-13T06:41:22.135 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:22.135 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.135 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.135 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:22.135 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888880+0000", 2024-09-13T06:41:22.135 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7600000000000002e-06 2024-09-13T06:41:22.135 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.135 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.136 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:22.136 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888887+0000", 2024-09-13T06:41:22.136 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3950000000000003e-06 2024-09-13T06:41:22.136 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.136 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.136 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:22.136 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888892+0000", 2024-09-13T06:41:22.136 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0409999999999997e-06 2024-09-13T06:41:22.136 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.136 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.136 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:22.136 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.938568+0000", 2024-09-13T06:41:22.137 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049675267000000002 2024-09-13T06:41:22.137 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.137 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.137 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:22.137 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.938653+0000", 2024-09-13T06:41:22.137 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.5792999999999997e-05 2024-09-13T06:41:22.137 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.137 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.137 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:22.137 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.938757+0000", 2024-09-13T06:41:22.137 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00010387699999999999 2024-09-13T06:41:22.138 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:22.138 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:22.138 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:22.138 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.138 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.138 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:21987 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 12644352~4096 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:41:22.138 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.888899+0000", 2024-09-13T06:41:22.138 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 89.223480804999994, 2024-09-13T06:41:22.138 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.050094056999999997, 2024-09-13T06:41:22.138 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:22.138 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:22.138 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:22.138 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:22.139 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:22.139 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 21987 2024-09-13T06:41:22.139 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.139 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:22.139 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.139 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:22.139 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888899+0000", 2024-09-13T06:41:22.139 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:22.139 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.140 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.140 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:22.140 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888899+0000", 2024-09-13T06:41:22.140 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:22.140 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.140 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.140 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:22.140 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888899+0000", 2024-09-13T06:41:22.140 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:22.140 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.140 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.140 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:22.140 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888901+0000", 2024-09-13T06:41:22.141 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2539999999999999e-06 2024-09-13T06:41:22.141 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.141 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.141 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:22.141 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888907+0000", 2024-09-13T06:41:22.141 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9009999999999999e-06 2024-09-13T06:41:22.141 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.141 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.141 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:22.141 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888912+0000", 2024-09-13T06:41:22.141 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9840000000000001e-06 2024-09-13T06:41:22.141 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.142 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.142 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:22.142 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.938810+0000", 2024-09-13T06:41:22.142 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049898835000000002 2024-09-13T06:41:22.142 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.142 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.142 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:22.142 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.938890+0000", 2024-09-13T06:41:22.142 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.9215000000000006e-05 2024-09-13T06:41:22.142 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.142 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.142 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:22.143 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.938993+0000", 2024-09-13T06:41:22.143 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000103194 2024-09-13T06:41:22.143 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:22.143 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:22.143 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:22.143 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.143 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.143 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:21988 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 12673024~4096 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:41:22.143 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.888916+0000", 2024-09-13T06:41:22.143 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 89.223463788999993, 2024-09-13T06:41:22.143 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.050203036999999999, 2024-09-13T06:41:22.144 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:22.144 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:22.144 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:22.144 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:22.144 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:22.144 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 21988 2024-09-13T06:41:22.144 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.144 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:22.144 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.144 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:22.144 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888916+0000", 2024-09-13T06:41:22.145 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:22.145 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.145 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.145 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:22.145 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888916+0000", 2024-09-13T06:41:22.145 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:22.145 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.145 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.145 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:22.145 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888915+0000", 2024-09-13T06:41:22.145 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:22.145 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.146 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.146 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:22.146 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888918+0000", 2024-09-13T06:41:22.146 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1500000000000002e-06 2024-09-13T06:41:22.146 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.146 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.146 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:22.146 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888925+0000", 2024-09-13T06:41:22.146 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.9380000000000003e-06 2024-09-13T06:41:22.146 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.146 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.147 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:22.147 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888933+0000", 2024-09-13T06:41:22.147 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.0560000000000005e-06 2024-09-13T06:41:22.147 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.147 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.147 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:22.147 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.939026+0000", 2024-09-13T06:41:22.147 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.050093499999999999 2024-09-13T06:41:22.148 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.148 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.148 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:22.148 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.939068+0000", 2024-09-13T06:41:22.148 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.1705999999999997e-05 2024-09-13T06:41:22.148 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.148 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.148 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:22.149 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.939119+0000", 2024-09-13T06:41:22.149 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.1048999999999999e-05 2024-09-13T06:41:22.149 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:22.149 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:22.149 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:22.149 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.149 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.149 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:21989 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 12701696~4096 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:41:22.149 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.888938+0000", 2024-09-13T06:41:22.149 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 89.223441461999997, 2024-09-13T06:41:22.149 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.050294393999999999, 2024-09-13T06:41:22.149 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:22.149 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:22.150 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:22.150 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:22.150 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:22.150 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 21989 2024-09-13T06:41:22.150 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.150 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:22.150 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.150 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:22.150 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888938+0000", 2024-09-13T06:41:22.150 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:22.150 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.150 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.150 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:22.150 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888938+0000", 2024-09-13T06:41:22.151 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:22.151 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.151 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.151 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:22.151 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888938+0000", 2024-09-13T06:41:22.151 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:22.151 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.151 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.151 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:22.151 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888940+0000", 2024-09-13T06:41:22.151 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5330000000000001e-06 2024-09-13T06:41:22.151 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.152 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.152 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:22.152 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888947+0000", 2024-09-13T06:41:22.152 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.2389999999999999e-06 2024-09-13T06:41:22.152 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.152 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.152 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:22.152 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888952+0000", 2024-09-13T06:41:22.152 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.5720000000000002e-06 2024-09-13T06:41:22.152 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.152 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.152 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:22.153 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.939141+0000", 2024-09-13T06:41:22.153 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.050188903999999999 2024-09-13T06:41:22.153 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.153 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.153 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:22.153 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.939182+0000", 2024-09-13T06:41:22.153 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.0926000000000001e-05 2024-09-13T06:41:22.153 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.153 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.153 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:22.154 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.939233+0000", 2024-09-13T06:41:22.154 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0532999999999999e-05 2024-09-13T06:41:22.154 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:22.154 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:22.154 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:22.154 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.154 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.154 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:22006 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 13189120~4096 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:41:22.154 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.892763+0000", 2024-09-13T06:41:22.154 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 89.219616935999994, 2024-09-13T06:41:22.154 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.048963505999999997, 2024-09-13T06:41:22.154 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:22.155 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:22.155 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:22.155 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:22.155 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:22.155 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 22006 2024-09-13T06:41:22.155 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.155 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:22.155 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.155 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:22.155 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892763+0000", 2024-09-13T06:41:22.155 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:22.155 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.155 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.156 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:22.156 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892763+0000", 2024-09-13T06:41:22.156 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:22.156 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.156 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.156 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:22.156 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892763+0000", 2024-09-13T06:41:22.156 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:41:22.156 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.156 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.156 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:22.156 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892764+0000", 2024-09-13T06:41:22.156 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2410000000000001e-06 2024-09-13T06:41:22.157 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.157 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.157 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:22.157 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892767+0000", 2024-09-13T06:41:22.157 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9390000000000002e-06 2024-09-13T06:41:22.157 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.157 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.157 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:22.157 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892769+0000", 2024-09-13T06:41:22.157 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5390000000000002e-06 2024-09-13T06:41:22.157 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.157 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.157 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:22.158 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.941560+0000", 2024-09-13T06:41:22.158 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.048791221000000003 2024-09-13T06:41:22.158 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.158 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.158 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:22.158 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.941632+0000", 2024-09-13T06:41:22.158 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.1932000000000002e-05 2024-09-13T06:41:22.158 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.158 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.158 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:22.158 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.941726+0000", 2024-09-13T06:41:22.158 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.3839999999999996e-05 2024-09-13T06:41:22.159 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:22.159 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:22.159 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:22.159 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.159 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.159 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:22007 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 13217792~4096 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:41:22.159 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.892771+0000", 2024-09-13T06:41:22.159 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 89.219608355999995, 2024-09-13T06:41:22.159 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049090024000000003, 2024-09-13T06:41:22.159 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:22.159 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:22.160 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:22.160 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:22.160 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:22.160 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 22007 2024-09-13T06:41:22.160 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.160 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:22.160 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.160 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:22.160 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892771+0000", 2024-09-13T06:41:22.160 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:22.160 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.160 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.161 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:22.161 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892771+0000", 2024-09-13T06:41:22.161 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:22.161 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.161 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.161 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:22.161 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892771+0000", 2024-09-13T06:41:22.161 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:41:22.161 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.161 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.161 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:22.161 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892772+0000", 2024-09-13T06:41:22.162 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.184e-06 2024-09-13T06:41:22.162 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.162 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.162 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:22.162 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892775+0000", 2024-09-13T06:41:22.162 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9179999999999998e-06 2024-09-13T06:41:22.162 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.162 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.162 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:22.162 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892778+0000", 2024-09-13T06:41:22.162 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4990000000000001e-06 2024-09-13T06:41:22.162 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.162 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.162 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:22.163 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.941760+0000", 2024-09-13T06:41:22.163 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.048982070000000003 2024-09-13T06:41:22.163 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.163 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.163 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:22.163 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.941808+0000", 2024-09-13T06:41:22.163 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.8278000000000001e-05 2024-09-13T06:41:22.163 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.163 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.163 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:22.163 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.941861+0000", 2024-09-13T06:41:22.163 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3284e-05 2024-09-13T06:41:22.163 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:22.164 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:22.164 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:22.164 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.164 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.164 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:22008 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 13246464~4096 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:41:22.164 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.892780+0000", 2024-09-13T06:41:22.164 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 89.219599699, 2024-09-13T06:41:22.164 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049200477999999999, 2024-09-13T06:41:22.164 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:22.164 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:22.164 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:22.164 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:22.165 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:22.165 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 22008 2024-09-13T06:41:22.165 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.165 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:22.165 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.165 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:22.165 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892780+0000", 2024-09-13T06:41:22.165 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:22.165 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.165 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.165 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:22.165 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892780+0000", 2024-09-13T06:41:22.166 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:22.166 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.166 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.166 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:22.166 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892780+0000", 2024-09-13T06:41:22.166 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:41:22.166 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.166 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.166 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:22.166 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892781+0000", 2024-09-13T06:41:22.166 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.083e-06 2024-09-13T06:41:22.166 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.166 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.167 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:22.167 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892784+0000", 2024-09-13T06:41:22.167 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.926e-06 2024-09-13T06:41:22.167 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.167 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.167 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:22.167 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892786+0000", 2024-09-13T06:41:22.167 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4490000000000002e-06 2024-09-13T06:41:22.167 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.167 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.167 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:22.167 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.941888+0000", 2024-09-13T06:41:22.167 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049102290999999999 2024-09-13T06:41:22.168 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.168 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.168 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:22.168 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.941929+0000", 2024-09-13T06:41:22.168 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.0541999999999999e-05 2024-09-13T06:41:22.168 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.168 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.168 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:22.168 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.941980+0000", 2024-09-13T06:41:22.168 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.1391999999999999e-05 2024-09-13T06:41:22.168 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:22.168 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:22.168 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:22.169 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.169 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.169 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:22009 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 13275136~4096 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:41:22.169 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.892788+0000", 2024-09-13T06:41:22.169 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 89.219591214999994, 2024-09-13T06:41:22.169 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049311926999999998, 2024-09-13T06:41:22.169 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:22.169 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:22.169 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:22.169 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:22.169 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:22.169 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 22009 2024-09-13T06:41:22.170 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.170 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:22.172 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.172 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:22.172 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892788+0000", 2024-09-13T06:41:22.172 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:22.172 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.172 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.173 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:22.173 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892788+0000", 2024-09-13T06:41:22.173 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:22.173 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.173 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.173 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:22.173 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892788+0000", 2024-09-13T06:41:22.173 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:41:22.173 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.173 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.173 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:22.173 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892789+0000", 2024-09-13T06:41:22.173 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1850000000000001e-06 2024-09-13T06:41:22.174 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.174 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.174 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:22.174 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892793+0000", 2024-09-13T06:41:22.174 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.9099999999999998e-06 2024-09-13T06:41:22.174 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.174 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.174 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:22.174 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892798+0000", 2024-09-13T06:41:22.174 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5070000000000002e-06 2024-09-13T06:41:22.174 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.174 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.174 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:22.175 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.942007+0000", 2024-09-13T06:41:22.175 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049208904999999997 2024-09-13T06:41:22.175 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.175 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.175 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:22.175 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.942049+0000", 2024-09-13T06:41:22.175 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.1922000000000003e-05 2024-09-13T06:41:22.175 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.175 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.175 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:22.175 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.942100+0000", 2024-09-13T06:41:22.175 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.1736000000000001e-05 2024-09-13T06:41:22.175 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:22.175 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:22.176 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:22.176 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.176 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.176 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:22010 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 13303808~4096 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:41:22.176 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.892817+0000", 2024-09-13T06:41:22.176 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 89.219563019000006, 2024-09-13T06:41:22.176 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049466149000000001, 2024-09-13T06:41:22.176 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:22.176 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:22.176 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:22.177 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:22.177 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:22.177 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 22010 2024-09-13T06:41:22.177 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.177 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:22.177 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.177 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:22.177 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892817+0000", 2024-09-13T06:41:22.177 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:22.177 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.177 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.177 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:22.177 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892817+0000", 2024-09-13T06:41:22.178 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:22.178 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.178 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.178 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:22.178 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892816+0000", 2024-09-13T06:41:22.178 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:22.178 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.178 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.178 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:22.178 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892821+0000", 2024-09-13T06:41:22.178 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9459999999999997e-06 2024-09-13T06:41:22.179 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.179 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.179 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:22.179 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892828+0000", 2024-09-13T06:41:22.179 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.6780000000000003e-06 2024-09-13T06:41:22.179 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.179 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.179 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:22.179 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892833+0000", 2024-09-13T06:41:22.179 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.8389999999999997e-06 2024-09-13T06:41:22.179 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.179 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.179 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:22.179 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.942127+0000", 2024-09-13T06:41:22.179 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049294163000000002 2024-09-13T06:41:22.180 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.180 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.180 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:22.180 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.942186+0000", 2024-09-13T06:41:22.180 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9335e-05 2024-09-13T06:41:22.180 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.180 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.180 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:22.180 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.942283+0000", 2024-09-13T06:41:22.180 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.6699000000000004e-05 2024-09-13T06:41:22.180 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:22.180 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:22.180 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:22.180 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.181 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.181 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:22011 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 13332480~4096 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:41:22.181 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.892838+0000", 2024-09-13T06:41:22.181 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 89.219541332000006, 2024-09-13T06:41:22.181 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049589214, 2024-09-13T06:41:22.181 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:22.181 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:22.181 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:22.181 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:22.181 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:22.181 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 22011 2024-09-13T06:41:22.181 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.182 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:22.182 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.182 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:22.182 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892838+0000", 2024-09-13T06:41:22.182 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:22.182 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.182 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.182 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:22.182 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892838+0000", 2024-09-13T06:41:22.182 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:22.182 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.182 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.182 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:22.183 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892838+0000", 2024-09-13T06:41:22.183 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:22.183 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.183 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.183 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:22.183 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892840+0000", 2024-09-13T06:41:22.183 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.136e-06 2024-09-13T06:41:22.183 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.183 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.183 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:22.183 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892852+0000", 2024-09-13T06:41:22.183 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2122e-05 2024-09-13T06:41:22.184 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.184 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.184 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:22.184 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892862+0000", 2024-09-13T06:41:22.184 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.7049999999999994e-06 2024-09-13T06:41:22.184 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.184 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.184 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:22.184 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.942319+0000", 2024-09-13T06:41:22.185 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049456623999999998 2024-09-13T06:41:22.185 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.185 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.185 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:22.185 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.942363+0000", 2024-09-13T06:41:22.185 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4759000000000003e-05 2024-09-13T06:41:22.185 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.185 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.185 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:22.185 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.942428+0000", 2024-09-13T06:41:22.185 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.4221999999999996e-05 2024-09-13T06:41:22.185 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:22.185 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:22.186 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:22.186 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.186 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.186 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:22033 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 13963264~4096 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:41:22.186 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.896824+0000", 2024-09-13T06:41:22.186 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 89.215555438999999, 2024-09-13T06:41:22.186 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049051957, 2024-09-13T06:41:22.186 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:22.186 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:22.186 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:22.186 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:22.186 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:22.186 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 22033 2024-09-13T06:41:22.187 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.187 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:22.187 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.187 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:22.187 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.896824+0000", 2024-09-13T06:41:22.187 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:22.187 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.187 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.187 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:22.187 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.896824+0000", 2024-09-13T06:41:22.187 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:22.187 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.188 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.188 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:22.188 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.896824+0000", 2024-09-13T06:41:22.188 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:22.188 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.188 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.188 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:22.188 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.896826+0000", 2024-09-13T06:41:22.188 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1900000000000002e-06 2024-09-13T06:41:22.188 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.188 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.188 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:22.188 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.896832+0000", 2024-09-13T06:41:22.189 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.2689999999999996e-06 2024-09-13T06:41:22.189 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.189 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.189 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:22.189 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.896840+0000", 2024-09-13T06:41:22.189 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3289999999999996e-06 2024-09-13T06:41:22.189 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.189 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.189 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:22.189 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.945777+0000", 2024-09-13T06:41:22.189 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.048937188 2024-09-13T06:41:22.189 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.189 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.190 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:22.190 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.945822+0000", 2024-09-13T06:41:22.190 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4780999999999997e-05 2024-09-13T06:41:22.190 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.190 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.190 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:22.190 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.945876+0000", 2024-09-13T06:41:22.190 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.4542000000000001e-05 2024-09-13T06:41:22.190 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:22.190 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:22.190 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:22.190 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.190 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.191 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:22338 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 13611008~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:41:22.191 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.951070+0000", 2024-09-13T06:41:22.191 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 89.161309810999995, 2024-09-13T06:41:22.191 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049135817999999998, 2024-09-13T06:41:22.191 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:22.191 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:22.191 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:22.191 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:22.191 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:22.191 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 22338 2024-09-13T06:41:22.191 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.191 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:22.191 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.191 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:22.192 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951070+0000", 2024-09-13T06:41:22.192 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:22.192 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.192 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.192 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:22.192 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951070+0000", 2024-09-13T06:41:22.192 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:22.192 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.192 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.192 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:22.192 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951069+0000", 2024-09-13T06:41:22.193 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:22.193 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.193 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.193 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:22.193 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951072+0000", 2024-09-13T06:41:22.193 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5909999999999998e-06 2024-09-13T06:41:22.193 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.193 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.193 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:22.193 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951078+0000", 2024-09-13T06:41:22.193 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.4450000000000001e-06 2024-09-13T06:41:22.193 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.194 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.194 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:22.194 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951083+0000", 2024-09-13T06:41:22.194 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7790000000000003e-06 2024-09-13T06:41:22.194 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.194 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.194 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:22.194 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:53.000020+0000", 2024-09-13T06:41:22.194 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.048936999000000002 2024-09-13T06:41:22.194 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.194 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.194 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:22.194 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:53.000106+0000", 2024-09-13T06:41:22.195 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.5532999999999996e-05 2024-09-13T06:41:22.195 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.195 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.195 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:22.195 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:53.000206+0000", 2024-09-13T06:41:22.195 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.9852999999999994e-05 2024-09-13T06:41:22.195 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:22.195 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:22.195 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:22.195 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.195 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.195 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:22339 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 13639680~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:41:22.196 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.951088+0000", 2024-09-13T06:41:22.196 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 89.161292113000002, 2024-09-13T06:41:22.196 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049238202000000002, 2024-09-13T06:41:22.196 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:22.196 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:22.196 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:22.196 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:22.196 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:22.196 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 22339 2024-09-13T06:41:22.196 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.196 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:22.196 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.196 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:22.197 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951088+0000", 2024-09-13T06:41:22.197 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:22.197 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.197 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.197 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:22.197 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951088+0000", 2024-09-13T06:41:22.197 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:22.197 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.197 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.197 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:22.197 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951087+0000", 2024-09-13T06:41:22.197 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:22.198 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.198 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.198 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:22.198 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951089+0000", 2024-09-13T06:41:22.198 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.153e-06 2024-09-13T06:41:22.198 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.198 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.198 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:22.198 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951093+0000", 2024-09-13T06:41:22.198 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.7120000000000002e-06 2024-09-13T06:41:22.198 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.198 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.199 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:22.199 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951096+0000", 2024-09-13T06:41:22.199 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.0570000000000001e-06 2024-09-13T06:41:22.199 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.199 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.199 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:22.199 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:53.000220+0000", 2024-09-13T06:41:22.199 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049123989 2024-09-13T06:41:22.199 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.199 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.199 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:22.199 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:53.000271+0000", 2024-09-13T06:41:22.199 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.062e-05 2024-09-13T06:41:22.199 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.200 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.200 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:22.200 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:53.000326+0000", 2024-09-13T06:41:22.200 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.5121000000000003e-05 2024-09-13T06:41:22.200 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:22.200 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:22.200 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:22.200 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.200 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.200 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:22340 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 13668352~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:41:22.200 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.951200+0000", 2024-09-13T06:41:22.200 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 89.161179223999994, 2024-09-13T06:41:22.201 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049352350000000003, 2024-09-13T06:41:22.201 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:22.201 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:22.201 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:22.201 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:22.201 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:22.201 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 22340 2024-09-13T06:41:22.201 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.201 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:22.202 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.202 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:22.202 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951200+0000", 2024-09-13T06:41:22.202 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:22.202 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.202 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.202 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:22.202 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951200+0000", 2024-09-13T06:41:22.202 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:22.202 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.202 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.202 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:22.202 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951098+0000", 2024-09-13T06:41:22.203 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.999898 2024-09-13T06:41:22.203 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.203 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.203 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:22.203 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951204+0000", 2024-09-13T06:41:22.203 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000105398 2024-09-13T06:41:22.203 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.203 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.203 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:22.203 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951211+0000", 2024-09-13T06:41:22.203 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.43e-06 2024-09-13T06:41:22.203 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.203 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.204 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:22.204 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951216+0000", 2024-09-13T06:41:22.204 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2800000000000003e-06 2024-09-13T06:41:22.204 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.204 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.204 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:22.204 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:53.000358+0000", 2024-09-13T06:41:22.204 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049142036 2024-09-13T06:41:22.204 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.204 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.204 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:22.204 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:53.000443+0000", 2024-09-13T06:41:22.205 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.4710999999999996e-05 2024-09-13T06:41:22.205 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.205 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.205 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:22.205 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:53.000553+0000", 2024-09-13T06:41:22.205 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000109622 2024-09-13T06:41:22.205 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:22.205 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:22.205 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:22.205 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.205 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.205 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:22348 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 13897728~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:41:22.206 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.952783+0000", 2024-09-13T06:41:22.206 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 89.159596436000001, 2024-09-13T06:41:22.206 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049120832000000003, 2024-09-13T06:41:22.206 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:22.206 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:22.206 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:22.206 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:22.206 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:22.206 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 22348 2024-09-13T06:41:22.206 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.206 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:22.206 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.207 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:22.207 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.952783+0000", 2024-09-13T06:41:22.207 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:22.207 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.207 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.207 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:22.207 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.952783+0000", 2024-09-13T06:41:22.207 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:22.207 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.207 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.207 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:22.207 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.952783+0000", 2024-09-13T06:41:22.207 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:22.208 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.208 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.208 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:22.208 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.952785+0000", 2024-09-13T06:41:22.208 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4980000000000001e-06 2024-09-13T06:41:22.208 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.208 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.208 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:22.208 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.952799+0000", 2024-09-13T06:41:22.208 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3825000000000001e-05 2024-09-13T06:41:22.208 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.208 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.208 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:22.209 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.952809+0000", 2024-09-13T06:41:22.209 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0043e-05 2024-09-13T06:41:22.209 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.209 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.209 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:22.209 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:53.001723+0000", 2024-09-13T06:41:22.209 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.048914065 2024-09-13T06:41:22.209 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.209 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.209 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:22.209 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:53.001807+0000", 2024-09-13T06:41:22.209 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.3776000000000006e-05 2024-09-13T06:41:22.209 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.210 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.210 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:22.210 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:53.001904+0000", 2024-09-13T06:41:22.210 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.7004999999999997e-05 2024-09-13T06:41:22.210 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:22.210 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:22.210 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:22.210 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.210 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.210 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:69045 3.0 3:05ea3821:::rbd_data.1121867cc19b.0000000000000000:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109)", 2024-09-13T06:41:22.210 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:41:03.637760+0000", 2024-09-13T06:41:22.211 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 18.474619678, 2024-09-13T06:41:22.211 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.052276712000000003, 2024-09-13T06:41:22.211 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:22.211 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:41:22.211 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:22.211 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:22.211 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:22.211 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 69045 2024-09-13T06:41:22.211 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.211 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:22.211 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.211 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:22.211 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:03.637760+0000", 2024-09-13T06:41:22.211 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:22.212 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.212 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.212 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:22.212 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:03.637760+0000", 2024-09-13T06:41:22.212 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:22.212 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.212 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.212 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:22.212 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:03.637758+0000", 2024-09-13T06:41:22.212 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999981 2024-09-13T06:41:22.212 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.212 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.212 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:22.213 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:03.637770+0000", 2024-09-13T06:41:22.213 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1533e-05 2024-09-13T06:41:22.213 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.213 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.213 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:22.213 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:03.637794+0000", 2024-09-13T06:41:22.213 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4243000000000002e-05 2024-09-13T06:41:22.213 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.213 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.213 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:22.214 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:03.637806+0000", 2024-09-13T06:41:22.214 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2033e-05 2024-09-13T06:41:22.214 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.214 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.214 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:22.214 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:03.637891+0000", 2024-09-13T06:41:22.214 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.5358000000000005e-05 2024-09-13T06:41:22.214 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.214 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.214 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:22.214 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:03.638042+0000", 2024-09-13T06:41:22.214 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000151073 2024-09-13T06:41:22.214 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.215 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.215 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 2", 2024-09-13T06:41:22.215 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:03.647124+0000", 2024-09-13T06:41:22.215 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0090821670000000004 2024-09-13T06:41:22.215 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.215 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.215 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:41:22.215 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:03.689849+0000", 2024-09-13T06:41:22.215 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.042724445999999999 2024-09-13T06:41:22.215 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.215 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.215 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-09-13T06:41:22.216 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:03.689871+0000", 2024-09-13T06:41:22.216 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1778999999999999e-05 2024-09-13T06:41:22.216 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.216 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.216 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:41:22.216 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:03.689965+0000", 2024-09-13T06:41:22.216 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.4312000000000001e-05 2024-09-13T06:41:22.216 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.216 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.216 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:22.216 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:03.690037+0000", 2024-09-13T06:41:22.216 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.1687999999999995e-05 2024-09-13T06:41:22.216 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:22.217 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:22.217 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:22.217 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:22.217 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:22.217 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:41:22.219 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-13T06:41:22.219 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:41:22.215+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:41:22.320 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:41:22.318+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:41:22.343 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:41:22.343 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-13T06:41:22.344 INFO:teuthology.orchestra.run.smithi081.stdout: "num_ops": 0 2024-09-13T06:41:22.344 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:41:22.357 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-13T06:41:22.401 INFO:teuthology.orchestra.run.smithi139.stdout:get_pg_num_history pg_num_history pg_num_history(e121 pg_nums {1={14=1},2={17=8},3={21=32}} deleted_pools ) 2024-09-13T06:41:22.402 INFO:teuthology.orchestra.run.smithi139.stdout:Importing pgid 3.16 2024-09-13T06:41:22.402 INFO:teuthology.orchestra.run.smithi139.stdout:Write #3:690a2724:::rbd_data.11213b441054.00000000000001d5:head# 2024-09-13T06:41:22.402 INFO:teuthology.orchestra.run.smithi139.stdout:snapset 0=[]:{} 2024-09-13T06:41:22.403 INFO:teuthology.orchestra.run.smithi139.stdout:Write #3:69175ab1:::rbd_data.1121f2c5ee81.0000000000000184:head# 2024-09-13T06:41:22.403 INFO:teuthology.orchestra.run.smithi139.stdout:snapset 0=[]:{} 2024-09-13T06:41:22.403 INFO:teuthology.orchestra.run.smithi139.stdout:Write #3:692d7d90:::rbd_data.11218ba71f0d.000000000000000f:head# 2024-09-13T06:41:22.404 INFO:teuthology.orchestra.run.smithi139.stdout:snapset 0=[]:{} 2024-09-13T06:41:22.404 INFO:teuthology.orchestra.run.smithi139.stdout:Write #3:69523913:::rbd_data.1121904e6c4a.0000000000000010:head# 2024-09-13T06:41:22.405 INFO:teuthology.orchestra.run.smithi139.stdout:snapset 0=[]:{} 2024-09-13T06:41:22.405 INFO:teuthology.orchestra.run.smithi139.stdout:Write #3:696341ca:::rbd_data.11217e777cf4.00000000000001c3:head# 2024-09-13T06:41:22.405 INFO:teuthology.orchestra.run.smithi139.stdout:snapset 0=[]:{} 2024-09-13T06:41:22.406 INFO:teuthology.orchestra.run.smithi139.stdout:Write #3:69b4bba6:::rbd_data.11213b441054.00000000000000e1:head# 2024-09-13T06:41:22.406 INFO:teuthology.orchestra.run.smithi139.stdout:snapset 0=[]:{} 2024-09-13T06:41:22.406 INFO:teuthology.orchestra.run.smithi139.stdout:Write #3:69d35907:::rbd_object_map.11214956a993:head# 2024-09-13T06:41:22.407 INFO:teuthology.orchestra.run.smithi139.stdout:snapset 0=[]:{} 2024-09-13T06:41:22.407 INFO:teuthology.orchestra.run.smithi139.stdout:Write #3:69d8a4e4:::rbd_data.11213b441054.0000000000000166:head# 2024-09-13T06:41:22.407 INFO:teuthology.orchestra.run.smithi139.stdout:snapset 0=[]:{} 2024-09-13T06:41:22.408 INFO:teuthology.orchestra.run.smithi139.stdout:Write #3:69e8ee25:::rbd_data.11213b441054.0000000000000160:head# 2024-09-13T06:41:22.408 INFO:teuthology.orchestra.run.smithi139.stdout:snapset 0=[]:{} 2024-09-13T06:41:22.408 INFO:teuthology.orchestra.run.smithi139.stdout:Write #3:69ebf46b:::rbd_data.1121f2c5ee81.0000000000000055:head# 2024-09-13T06:41:22.408 INFO:teuthology.orchestra.run.smithi139.stdout:snapset 0=[]:{} 2024-09-13T06:41:22.409 INFO:teuthology.orchestra.run.smithi139.stdout:Write #3:6b824d40:::rbd_data.11219660270d.0000000000000039:head# 2024-09-13T06:41:22.409 INFO:teuthology.orchestra.run.smithi139.stdout:snapset 0=[]:{} 2024-09-13T06:41:22.410 INFO:teuthology.orchestra.run.smithi139.stdout:Write #3:6b875e4a:::rbd_data.1121ffaf5446.0000000000000012:head# 2024-09-13T06:41:22.411 INFO:teuthology.orchestra.run.smithi139.stdout:snapset 0=[]:{} 2024-09-13T06:41:22.412 INFO:teuthology.orchestra.run.smithi139.stdout:Write #3:6e138532:::rbd_data.1121d8143c6e.000000000000000e:head# 2024-09-13T06:41:22.414 INFO:teuthology.orchestra.run.smithi139.stdout:snapset 0=[]:{} 2024-09-13T06:41:22.418 INFO:teuthology.orchestra.run.smithi139.stdout:Write #3:6e333f1a:::rbd_data.1121ffaf5446.0000000000000002:head# 2024-09-13T06:41:22.418 INFO:teuthology.orchestra.run.smithi139.stdout:snapset 0=[]:{} 2024-09-13T06:41:22.419 INFO:teuthology.orchestra.run.smithi139.stdout:Write #3:6e402199:::rbd_data.11211200685d.00000000000000d9:head# 2024-09-13T06:41:22.420 INFO:teuthology.orchestra.run.smithi139.stdout:snapset 0=[]:{} 2024-09-13T06:41:22.420 INFO:teuthology.orchestra.run.smithi139.stdout:Write #3:6f163858:::rbd_data.1121f2c5ee81.0000000000000132:head# 2024-09-13T06:41:22.420 INFO:teuthology.orchestra.run.smithi139.stdout:snapset 0=[]:{} 2024-09-13T06:41:22.421 INFO:teuthology.orchestra.run.smithi139.stdout:write_pg epoch 121 info 3.16( v 121'221 (0'0,121'221] local-lis/les=103/104 n=16 ec=21/21 lis/c=103/103 les/c/f=104/104/0 sis=103) 2024-09-13T06:41:22.422 INFO:teuthology.orchestra.run.smithi139.stdout:Import successful 2024-09-13T06:41:22.446 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:41:22.446+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:41:22.475 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-13T06:41:22.522 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:41:22.522+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:41:22.528 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:41:22.529 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-13T06:41:22.529 INFO:teuthology.orchestra.run.smithi081.stdout: "complaint_time": 30, 2024-09-13T06:41:22.529 INFO:teuthology.orchestra.run.smithi081.stdout: "num_blocked_ops": 0 2024-09-13T06:41:22.529 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:41:22.544 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-13T06:41:22.622 INFO:tasks.ceph.osd.6.smithi139.stderr:2024-09-13T06:41:22.619+0000 7fcd02c5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26385) UID: 0 2024-09-13T06:41:22.710 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:41:22.710 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 20, 2024-09-13T06:41:22.710 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 600, 2024-09-13T06:41:22.710 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [ 2024-09-13T06:41:22.710 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.710 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:36160 3.f 3:f62782c2:::rbd_object_map.11219660270d.0000000000000016:head [call] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-13T06:41:22.710 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:01.607291+0000", 2024-09-13T06:41:22.711 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 81.101399538999999, 2024-09-13T06:41:22.711 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.99619456699999998, 2024-09-13T06:41:22.711 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:22.711 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:22.711 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:22.711 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:22.711 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:22.711 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 36160 2024-09-13T06:41:22.711 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.711 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:22.711 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.712 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:22.712 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:01.607291+0000", 2024-09-13T06:41:22.712 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:22.712 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.712 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.712 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:22.712 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:01.607291+0000", 2024-09-13T06:41:22.712 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:22.712 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.712 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.712 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:22.712 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:01.607289+0000", 2024-09-13T06:41:22.712 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999976 2024-09-13T06:41:22.713 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.713 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.713 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:22.713 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:01.607302+0000", 2024-09-13T06:41:22.713 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3018e-05 2024-09-13T06:41:22.713 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.713 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.713 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:22.713 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:01.607323+0000", 2024-09-13T06:41:22.713 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1030999999999999e-05 2024-09-13T06:41:22.713 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.713 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.713 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:22.714 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:01.607342+0000", 2024-09-13T06:41:22.714 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8961e-05 2024-09-13T06:41:22.714 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.714 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.714 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:22.714 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:01.607425+0000", 2024-09-13T06:41:22.714 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.3171999999999996e-05 2024-09-13T06:41:22.714 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.714 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.714 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:41:22.714 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:01.607441+0000", 2024-09-13T06:41:22.714 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5996999999999999e-05 2024-09-13T06:41:22.714 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.714 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.715 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:22.715 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:02.596186+0000", 2024-09-13T06:41:22.715 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.98874432000000001 2024-09-13T06:41:22.715 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.715 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.715 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for missing object", 2024-09-13T06:41:22.715 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:02.596618+0000", 2024-09-13T06:41:22.715 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000432032 2024-09-13T06:41:22.715 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.715 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.715 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:22.715 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:02.600845+0000", 2024-09-13T06:41:22.716 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0042277410000000001 2024-09-13T06:41:22.716 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.716 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.716 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:22.716 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:02.601003+0000", 2024-09-13T06:41:22.716 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00015731999999999999 2024-09-13T06:41:22.716 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.716 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.716 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:22.716 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:02.603486+0000", 2024-09-13T06:41:22.716 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0024832510000000001 2024-09-13T06:41:22.716 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:22.716 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:22.716 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:22.717 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.717 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.717 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:37806 3.9 3:951cb95b:::rbd_data.1121d8143c6e.0000000000000002:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e56)", 2024-09-13T06:41:22.717 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:06.373482+0000", 2024-09-13T06:41:22.717 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 76.335208503000004, 2024-09-13T06:41:22.717 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.002476213, 2024-09-13T06:41:22.717 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:22.717 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:22.717 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:22.717 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:22.717 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:22.717 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 37806 2024-09-13T06:41:22.718 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.718 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:22.718 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.718 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:22.718 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.373482+0000", 2024-09-13T06:41:22.718 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:22.718 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.718 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.718 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:22.718 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.373482+0000", 2024-09-13T06:41:22.718 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:22.718 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.718 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.719 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:22.719 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.373479+0000", 2024-09-13T06:41:22.719 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999962 2024-09-13T06:41:22.719 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.719 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.719 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:22.719 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.373495+0000", 2024-09-13T06:41:22.719 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6640999999999999e-05 2024-09-13T06:41:22.719 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.719 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.719 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:22.719 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.373542+0000", 2024-09-13T06:41:22.720 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6229000000000001e-05 2024-09-13T06:41:22.720 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.720 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.720 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:22.720 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.373564+0000", 2024-09-13T06:41:22.720 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2684000000000002e-05 2024-09-13T06:41:22.720 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.720 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.720 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:22.720 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374268+0000", 2024-09-13T06:41:22.720 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00070363700000000001 2024-09-13T06:41:22.720 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.721 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.721 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:41:22.721 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374305+0000", 2024-09-13T06:41:22.721 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.6936e-05 2024-09-13T06:41:22.721 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.721 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.721 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:22.721 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.375175+0000", 2024-09-13T06:41:22.721 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.000870454 2024-09-13T06:41:22.721 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.721 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.721 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:22.721 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.375678+0000", 2024-09-13T06:41:22.722 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00050292499999999999 2024-09-13T06:41:22.722 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.722 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.722 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:22.722 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.375959+0000", 2024-09-13T06:41:22.722 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00028050599999999997 2024-09-13T06:41:22.722 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:22.722 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:22.722 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:22.722 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.722 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.722 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:37821 3.9 3:951cb95b:::rbd_data.1121d8143c6e.0000000000000002:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e56)", 2024-09-13T06:41:22.723 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:06.374454+0000", 2024-09-13T06:41:22.723 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 76.334237385999998, 2024-09-13T06:41:22.723 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.002545072, 2024-09-13T06:41:22.723 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:22.723 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:22.723 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:22.723 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:22.723 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:22.723 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 37821 2024-09-13T06:41:22.723 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.723 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:22.723 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.723 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:22.724 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374454+0000", 2024-09-13T06:41:22.724 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:22.724 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.724 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.724 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:22.724 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374454+0000", 2024-09-13T06:41:22.724 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:22.724 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.724 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.724 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:22.724 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374452+0000", 2024-09-13T06:41:22.724 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999981 2024-09-13T06:41:22.725 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.725 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.725 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:22.725 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374463+0000", 2024-09-13T06:41:22.725 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0756e-05 2024-09-13T06:41:22.725 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.725 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.725 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:22.725 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374487+0000", 2024-09-13T06:41:22.725 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4887000000000001e-05 2024-09-13T06:41:22.725 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.725 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.726 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:22.726 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374504+0000", 2024-09-13T06:41:22.726 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6852000000000001e-05 2024-09-13T06:41:22.726 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.726 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.726 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:22.726 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374829+0000", 2024-09-13T06:41:22.726 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000324684 2024-09-13T06:41:22.726 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.726 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.727 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:41:22.727 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374880+0000", 2024-09-13T06:41:22.727 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.1378000000000002e-05 2024-09-13T06:41:22.727 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.727 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.727 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:22.727 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.376423+0000", 2024-09-13T06:41:22.727 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.001542734 2024-09-13T06:41:22.727 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.727 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.727 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:22.728 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.376607+0000", 2024-09-13T06:41:22.728 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000183656 2024-09-13T06:41:22.728 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.728 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.728 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:22.728 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.376999+0000", 2024-09-13T06:41:22.728 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00039191200000000001 2024-09-13T06:41:22.728 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:22.728 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:22.728 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:22.728 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.728 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.728 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:37836 3.9 3:951cb95b:::rbd_data.1121d8143c6e.0000000000000002:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e56)", 2024-09-13T06:41:22.729 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:06.374929+0000", 2024-09-13T06:41:22.729 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 76.333761734000007, 2024-09-13T06:41:22.729 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.002778825, 2024-09-13T06:41:22.729 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:22.729 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:22.729 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:22.729 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:22.729 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:22.729 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 37836 2024-09-13T06:41:22.729 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.729 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:22.729 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.729 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:22.730 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374929+0000", 2024-09-13T06:41:22.730 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:22.730 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.730 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.730 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:22.730 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374929+0000", 2024-09-13T06:41:22.730 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:22.730 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.730 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.730 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:22.730 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374927+0000", 2024-09-13T06:41:22.730 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999981 2024-09-13T06:41:22.730 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.731 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.731 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:22.731 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374939+0000", 2024-09-13T06:41:22.731 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1846e-05 2024-09-13T06:41:22.731 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.731 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.731 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:22.731 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374962+0000", 2024-09-13T06:41:22.731 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3054e-05 2024-09-13T06:41:22.731 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.731 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.731 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:22.731 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374978+0000", 2024-09-13T06:41:22.732 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5899000000000001e-05 2024-09-13T06:41:22.732 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.732 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.732 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:22.732 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.375106+0000", 2024-09-13T06:41:22.732 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00012789 2024-09-13T06:41:22.732 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.732 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.732 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:41:22.732 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.375134+0000", 2024-09-13T06:41:22.733 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.8254000000000001e-05 2024-09-13T06:41:22.733 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.733 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.733 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:22.733 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.377082+0000", 2024-09-13T06:41:22.733 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0019471520000001 2024-09-13T06:41:22.733 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.733 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.733 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:22.734 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.377330+0000", 2024-09-13T06:41:22.734 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00024834199999999997 2024-09-13T06:41:22.734 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.734 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.734 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:22.734 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.377708+0000", 2024-09-13T06:41:22.734 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00037817100000000001 2024-09-13T06:41:22.734 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:22.734 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:22.734 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:22.734 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.734 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.735 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:37851 3.9 3:951cb95b:::rbd_data.1121d8143c6e.0000000000000002:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e56)", 2024-09-13T06:41:22.735 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:06.382636+0000", 2024-09-13T06:41:22.735 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 76.326054849000002, 2024-09-13T06:41:22.735 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.99582539400000003, 2024-09-13T06:41:22.735 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:22.735 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:22.735 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:22.735 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:22.735 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:22.735 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 37851 2024-09-13T06:41:22.735 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.735 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:22.736 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.736 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:22.736 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.382636+0000", 2024-09-13T06:41:22.736 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:22.736 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.736 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.736 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:22.736 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.382636+0000", 2024-09-13T06:41:22.736 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:22.736 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.736 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.737 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:22.737 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.382633+0000", 2024-09-13T06:41:22.737 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999971 2024-09-13T06:41:22.737 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.737 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.737 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:22.737 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.382652+0000", 2024-09-13T06:41:22.737 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8834999999999998e-05 2024-09-13T06:41:22.737 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.737 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.737 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:22.737 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.382695+0000", 2024-09-13T06:41:22.737 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.3136000000000002e-05 2024-09-13T06:41:22.737 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.738 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.738 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:22.738 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.382716+0000", 2024-09-13T06:41:22.738 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1421e-05 2024-09-13T06:41:22.738 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.738 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.738 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:22.738 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.382860+0000", 2024-09-13T06:41:22.738 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00014389200000000001 2024-09-13T06:41:22.738 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.738 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.738 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:41:22.738 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.382890+0000", 2024-09-13T06:41:22.738 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9827000000000001e-05 2024-09-13T06:41:22.738 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.739 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.739 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:22.739 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.377779+0000", 2024-09-13T06:41:22.739 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.99488842899999996 2024-09-13T06:41:22.739 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.739 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.739 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:22.739 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.378007+0000", 2024-09-13T06:41:22.739 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00022838099999999999 2024-09-13T06:41:22.739 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.739 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.739 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:22.740 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.378462+0000", 2024-09-13T06:41:22.740 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00045452300000000003 2024-09-13T06:41:22.740 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:22.740 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:22.740 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:22.740 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.740 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.740 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:37866 3.9 3:951cb95b:::rbd_data.1121d8143c6e.0000000000000002:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e56)", 2024-09-13T06:41:22.740 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:06.383951+0000", 2024-09-13T06:41:22.740 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 76.324740163000001, 2024-09-13T06:41:22.740 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.99517962299999996, 2024-09-13T06:41:22.740 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:22.740 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:22.741 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:22.741 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:22.741 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:22.741 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 37866 2024-09-13T06:41:22.741 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.741 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:22.741 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.741 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:22.741 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.383951+0000", 2024-09-13T06:41:22.741 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:22.741 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.741 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.741 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:22.741 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.383951+0000", 2024-09-13T06:41:22.742 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:22.742 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.742 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.742 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:22.742 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.383949+0000", 2024-09-13T06:41:22.742 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999981 2024-09-13T06:41:22.742 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.742 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.742 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:22.743 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.383961+0000", 2024-09-13T06:41:22.743 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1999e-05 2024-09-13T06:41:22.743 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.743 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.743 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:22.743 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384019+0000", 2024-09-13T06:41:22.743 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7621000000000003e-05 2024-09-13T06:41:22.743 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.743 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.743 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:22.743 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384040+0000", 2024-09-13T06:41:22.743 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1528000000000001e-05 2024-09-13T06:41:22.743 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.743 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.744 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:22.744 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384186+0000", 2024-09-13T06:41:22.744 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00014573799999999999 2024-09-13T06:41:22.744 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.744 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.744 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:41:22.744 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384204+0000", 2024-09-13T06:41:22.744 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7992e-05 2024-09-13T06:41:22.744 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.744 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.744 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:22.744 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.378536+0000", 2024-09-13T06:41:22.744 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.99433268600000002 2024-09-13T06:41:22.745 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.745 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.745 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:22.745 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.378771+0000", 2024-09-13T06:41:22.745 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00023445399999999999 2024-09-13T06:41:22.745 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.745 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.745 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:22.745 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.379130+0000", 2024-09-13T06:41:22.745 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00035954200000000002 2024-09-13T06:41:22.745 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:22.745 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:22.746 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:22.746 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.746 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.746 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:37881 3.9 3:951cb95b:::rbd_data.1121d8143c6e.0000000000000002:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e56)", 2024-09-13T06:41:22.746 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:06.384239+0000", 2024-09-13T06:41:22.746 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 76.324451749000005, 2024-09-13T06:41:22.746 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.99541483500000005, 2024-09-13T06:41:22.746 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:22.746 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:22.746 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:22.746 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:22.747 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:22.747 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 37881 2024-09-13T06:41:22.747 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.747 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:22.747 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.747 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:22.747 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384239+0000", 2024-09-13T06:41:22.747 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:22.747 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.747 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.747 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:22.747 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384239+0000", 2024-09-13T06:41:22.747 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:22.748 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.748 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.748 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:22.748 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384238+0000", 2024-09-13T06:41:22.748 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999986 2024-09-13T06:41:22.748 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.748 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.748 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:22.748 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384246+0000", 2024-09-13T06:41:22.748 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.2449999999999998e-06 2024-09-13T06:41:22.748 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.748 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.748 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:22.748 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384268+0000", 2024-09-13T06:41:22.749 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1518e-05 2024-09-13T06:41:22.749 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.749 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.749 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:22.749 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384282+0000", 2024-09-13T06:41:22.749 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4501999999999999e-05 2024-09-13T06:41:22.749 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.749 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.749 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:22.749 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384356+0000", 2024-09-13T06:41:22.749 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4265999999999997e-05 2024-09-13T06:41:22.749 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.750 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.750 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:41:22.750 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384370+0000", 2024-09-13T06:41:22.750 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3942e-05 2024-09-13T06:41:22.750 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.750 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.750 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:22.750 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.379199+0000", 2024-09-13T06:41:22.750 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.99482866599999997 2024-09-13T06:41:22.750 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.750 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.750 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:22.750 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.379347+0000", 2024-09-13T06:41:22.750 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00014749199999999999 2024-09-13T06:41:22.751 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.751 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.751 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:22.751 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.379654+0000", 2024-09-13T06:41:22.751 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00030752999999999998 2024-09-13T06:41:22.751 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:22.751 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:22.751 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:22.751 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.751 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.751 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:37896 3.9 3:951cb95b:::rbd_data.1121d8143c6e.0000000000000002:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e56)", 2024-09-13T06:41:22.751 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:06.384412+0000", 2024-09-13T06:41:22.751 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 76.324279316000002, 2024-09-13T06:41:22.751 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.99777835999999998, 2024-09-13T06:41:22.751 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:22.752 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:22.752 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:22.752 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:22.752 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:22.752 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 37896 2024-09-13T06:41:22.752 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.752 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:22.752 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.752 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:22.752 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384412+0000", 2024-09-13T06:41:22.752 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:22.752 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.752 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.752 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:22.753 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384412+0000", 2024-09-13T06:41:22.753 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:22.753 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.753 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.753 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:22.753 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384410+0000", 2024-09-13T06:41:22.753 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.999999 2024-09-13T06:41:22.753 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.753 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.753 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:22.753 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384418+0000", 2024-09-13T06:41:22.753 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.486e-06 2024-09-13T06:41:22.754 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.754 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.754 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:22.754 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384436+0000", 2024-09-13T06:41:22.754 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7668000000000001e-05 2024-09-13T06:41:22.754 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.754 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.754 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:22.754 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384449+0000", 2024-09-13T06:41:22.754 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3395e-05 2024-09-13T06:41:22.754 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.754 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.754 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:22.755 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384605+0000", 2024-09-13T06:41:22.755 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00015563099999999999 2024-09-13T06:41:22.755 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.755 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.755 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:41:22.755 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384635+0000", 2024-09-13T06:41:22.755 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.0383999999999999e-05 2024-09-13T06:41:22.755 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.755 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.755 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:22.755 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.379730+0000", 2024-09-13T06:41:22.755 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.99509493999999998 2024-09-13T06:41:22.756 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.756 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.756 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:22.756 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.379964+0000", 2024-09-13T06:41:22.756 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00023353499999999999 2024-09-13T06:41:22.756 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.756 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.756 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:22.756 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.382190+0000", 2024-09-13T06:41:22.756 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0022265039999999998 2024-09-13T06:41:22.756 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:22.756 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:22.756 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:22.756 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.757 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.757 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43222 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 389120~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:22.757 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558181+0000", 2024-09-13T06:41:22.757 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 61.150510062000002, 2024-09-13T06:41:22.757 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.06252038, 2024-09-13T06:41:22.757 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:22.757 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:22.757 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:22.757 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:22.757 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:22.757 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43222 2024-09-13T06:41:22.757 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.757 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:22.757 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.758 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:22.758 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558181+0000", 2024-09-13T06:41:22.758 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:22.758 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.758 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.758 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:22.758 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558181+0000", 2024-09-13T06:41:22.758 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:22.758 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.758 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.758 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:22.758 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558181+0000", 2024-09-13T06:41:22.758 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:22.758 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.758 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.759 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:22.759 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558183+0000", 2024-09-13T06:41:22.759 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.857e-06 2024-09-13T06:41:22.759 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.759 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.759 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:22.759 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558188+0000", 2024-09-13T06:41:22.759 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3759999999999999e-06 2024-09-13T06:41:22.759 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.759 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.759 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:22.759 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558261+0000", 2024-09-13T06:41:22.759 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3097999999999997e-05 2024-09-13T06:41:22.760 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.760 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.760 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:22.760 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.620354+0000", 2024-09-13T06:41:22.760 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.062092587999999997 2024-09-13T06:41:22.760 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.760 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.760 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:22.760 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.620428+0000", 2024-09-13T06:41:22.760 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3954000000000004e-05 2024-09-13T06:41:22.760 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.760 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.760 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:22.761 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.620701+0000", 2024-09-13T06:41:22.761 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000273773 2024-09-13T06:41:22.761 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:22.761 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:22.761 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:22.761 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.761 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.761 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43223 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 393216~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:22.761 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558267+0000", 2024-09-13T06:41:22.761 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 61.150424004999998, 2024-09-13T06:41:22.761 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.062813151999999997, 2024-09-13T06:41:22.761 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:22.761 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:22.761 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:22.761 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:22.762 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:22.762 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43223 2024-09-13T06:41:22.762 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.762 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:22.762 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.762 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:22.762 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558267+0000", 2024-09-13T06:41:22.762 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:22.762 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.762 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.762 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:22.762 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558267+0000", 2024-09-13T06:41:22.763 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:22.763 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.763 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.763 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:22.763 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558266+0000", 2024-09-13T06:41:22.763 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:22.763 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.763 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.763 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:22.763 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558270+0000", 2024-09-13T06:41:22.763 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.2389999999999998e-06 2024-09-13T06:41:22.763 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.764 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.764 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:22.764 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558277+0000", 2024-09-13T06:41:22.764 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5680000000000002e-06 2024-09-13T06:41:22.764 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.764 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.764 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:22.764 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558282+0000", 2024-09-13T06:41:22.764 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7060000000000003e-06 2024-09-13T06:41:22.764 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.764 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.764 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:22.764 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.620731+0000", 2024-09-13T06:41:22.765 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.062448661000000003 2024-09-13T06:41:22.765 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.765 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.765 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:22.765 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.620806+0000", 2024-09-13T06:41:22.765 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5862e-05 2024-09-13T06:41:22.765 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.765 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.765 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:22.765 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.621080+0000", 2024-09-13T06:41:22.765 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00027368599999999998 2024-09-13T06:41:22.765 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:22.765 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:22.766 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:22.766 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.766 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.766 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43224 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 407552~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:22.766 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558286+0000", 2024-09-13T06:41:22.766 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 61.150404641000002, 2024-09-13T06:41:22.766 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.063179052999999999, 2024-09-13T06:41:22.766 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:22.766 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:22.766 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:22.766 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:22.766 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:22.766 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43224 2024-09-13T06:41:22.766 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.767 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:22.767 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.767 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:22.767 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558286+0000", 2024-09-13T06:41:22.767 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:22.767 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.767 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.767 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:22.767 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558286+0000", 2024-09-13T06:41:22.767 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:22.767 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.767 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.767 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:22.767 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558286+0000", 2024-09-13T06:41:22.768 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:22.768 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.768 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.768 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:22.768 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558288+0000", 2024-09-13T06:41:22.768 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.227e-06 2024-09-13T06:41:22.768 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.768 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.768 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:22.768 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558292+0000", 2024-09-13T06:41:22.768 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.6289999999999999e-06 2024-09-13T06:41:22.768 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.769 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.769 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:22.769 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558294+0000", 2024-09-13T06:41:22.769 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5409999999999999e-06 2024-09-13T06:41:22.769 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.769 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.769 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:22.769 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.621110+0000", 2024-09-13T06:41:22.769 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.062815776000000004 2024-09-13T06:41:22.769 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.769 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.769 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:22.769 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.621186+0000", 2024-09-13T06:41:22.770 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5570999999999999e-05 2024-09-13T06:41:22.770 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.770 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.770 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:22.770 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.621465+0000", 2024-09-13T06:41:22.770 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00027988200000000001 2024-09-13T06:41:22.770 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:22.770 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:22.771 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:22.771 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.771 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.771 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43225 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 421888~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:22.771 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558296+0000", 2024-09-13T06:41:22.771 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 61.150394673999998, 2024-09-13T06:41:22.771 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.063551110999999993, 2024-09-13T06:41:22.771 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:22.771 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:22.771 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:22.771 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:22.771 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:22.771 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43225 2024-09-13T06:41:22.772 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.772 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:22.772 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.772 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:22.772 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558296+0000", 2024-09-13T06:41:22.772 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:22.772 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.772 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.772 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:22.773 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558296+0000", 2024-09-13T06:41:22.773 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:22.773 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.773 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.773 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:22.773 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558296+0000", 2024-09-13T06:41:22.773 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:41:22.773 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.773 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.773 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:22.773 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558305+0000", 2024-09-13T06:41:22.773 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.5290000000000008e-06 2024-09-13T06:41:22.773 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.773 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.774 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:22.774 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558308+0000", 2024-09-13T06:41:22.774 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.5619999999999999e-06 2024-09-13T06:41:22.774 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.774 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.774 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:22.774 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558311+0000", 2024-09-13T06:41:22.774 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.43e-06 2024-09-13T06:41:22.774 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.775 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.775 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:22.775 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.621495+0000", 2024-09-13T06:41:22.775 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.063184289000000005 2024-09-13T06:41:22.775 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.775 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.775 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:22.775 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.621569+0000", 2024-09-13T06:41:22.775 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4250000000000002e-05 2024-09-13T06:41:22.775 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.775 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.775 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:22.775 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.621847+0000", 2024-09-13T06:41:22.775 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00027826400000000002 2024-09-13T06:41:22.776 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:22.776 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:22.776 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:22.776 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.776 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.776 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43226 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 436224~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:22.776 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558313+0000", 2024-09-13T06:41:22.776 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 61.150378037999999, 2024-09-13T06:41:22.776 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.063914420999999999, 2024-09-13T06:41:22.776 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:22.776 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:22.776 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:22.776 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:22.776 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:22.776 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43226 2024-09-13T06:41:22.777 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.777 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:22.777 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.777 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:22.777 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558313+0000", 2024-09-13T06:41:22.777 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:22.777 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.777 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.777 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:22.777 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558313+0000", 2024-09-13T06:41:22.778 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:22.778 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.778 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.778 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:22.778 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558313+0000", 2024-09-13T06:41:22.778 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:22.778 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.778 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.778 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:22.778 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558314+0000", 2024-09-13T06:41:22.778 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3740000000000001e-06 2024-09-13T06:41:22.778 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.778 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.778 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:22.778 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558317+0000", 2024-09-13T06:41:22.779 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9730000000000002e-06 2024-09-13T06:41:22.779 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.779 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.779 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:22.779 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558319+0000", 2024-09-13T06:41:22.779 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4059999999999999e-06 2024-09-13T06:41:22.779 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.779 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.779 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:22.779 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.621877+0000", 2024-09-13T06:41:22.779 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.063557408999999995 2024-09-13T06:41:22.779 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.779 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.779 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:22.780 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.621951+0000", 2024-09-13T06:41:22.780 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4487999999999996e-05 2024-09-13T06:41:22.780 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.780 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.780 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:22.780 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.622227+0000", 2024-09-13T06:41:22.780 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000276011 2024-09-13T06:41:22.780 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:22.780 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:22.780 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:22.780 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.780 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.781 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43227 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 450560~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:22.781 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558322+0000", 2024-09-13T06:41:22.781 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 61.150369456999996, 2024-09-13T06:41:22.781 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.064285348000000006, 2024-09-13T06:41:22.781 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:22.781 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:22.781 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:22.781 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:22.781 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:22.781 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43227 2024-09-13T06:41:22.781 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.781 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:22.781 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.781 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:22.782 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558322+0000", 2024-09-13T06:41:22.782 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:22.782 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.782 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.782 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:22.782 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558322+0000", 2024-09-13T06:41:22.782 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:22.782 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.782 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.782 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:22.782 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558321+0000", 2024-09-13T06:41:22.782 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:41:22.782 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.782 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.783 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:22.783 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558323+0000", 2024-09-13T06:41:22.783 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.576e-06 2024-09-13T06:41:22.783 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.783 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.783 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:22.783 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558328+0000", 2024-09-13T06:41:22.783 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0719999999999999e-06 2024-09-13T06:41:22.783 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.783 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.783 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:22.783 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558332+0000", 2024-09-13T06:41:22.783 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.8130000000000002e-06 2024-09-13T06:41:22.783 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.784 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.784 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:22.784 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.622255+0000", 2024-09-13T06:41:22.784 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.063923195000000002 2024-09-13T06:41:22.784 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.784 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.784 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:22.784 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.622330+0000", 2024-09-13T06:41:22.784 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5383000000000007e-05 2024-09-13T06:41:22.784 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.784 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.785 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:22.785 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.622607+0000", 2024-09-13T06:41:22.785 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00027651999999999999 2024-09-13T06:41:22.785 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:22.785 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:22.785 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:22.785 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.785 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.785 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43228 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 464896~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:22.785 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558335+0000", 2024-09-13T06:41:22.785 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 61.150355548, 2024-09-13T06:41:22.785 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.064652253000000007, 2024-09-13T06:41:22.785 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:22.785 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:22.785 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:22.786 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:22.786 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:22.786 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43228 2024-09-13T06:41:22.786 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.786 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:22.786 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.786 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:22.786 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558335+0000", 2024-09-13T06:41:22.787 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:22.787 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.787 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.787 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:22.787 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558335+0000", 2024-09-13T06:41:22.787 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:22.787 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.787 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.787 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:22.787 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558335+0000", 2024-09-13T06:41:22.787 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:22.787 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.788 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.788 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:22.788 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558337+0000", 2024-09-13T06:41:22.788 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1380000000000001e-06 2024-09-13T06:41:22.788 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.788 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.788 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:22.788 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558343+0000", 2024-09-13T06:41:22.788 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.5140000000000001e-06 2024-09-13T06:41:22.788 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.788 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.788 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:22.788 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558348+0000", 2024-09-13T06:41:22.789 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9640000000000002e-06 2024-09-13T06:41:22.789 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.789 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.789 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:22.789 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.622636+0000", 2024-09-13T06:41:22.789 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.064288260999999999 2024-09-13T06:41:22.789 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.789 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.789 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:22.789 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.622715+0000", 2024-09-13T06:41:22.789 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.9351000000000006e-05 2024-09-13T06:41:22.789 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.789 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.790 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:22.790 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.622988+0000", 2024-09-13T06:41:22.790 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00027242599999999998 2024-09-13T06:41:22.790 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:22.790 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:22.790 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:22.790 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.790 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.790 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43229 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 479232~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:22.790 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558352+0000", 2024-09-13T06:41:22.790 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 61.150339133000003, 2024-09-13T06:41:22.790 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.065018024999999993, 2024-09-13T06:41:22.790 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:22.791 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:22.791 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:22.791 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:22.791 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:22.791 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43229 2024-09-13T06:41:22.791 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.791 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:22.791 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.791 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:22.791 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558352+0000", 2024-09-13T06:41:22.791 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:22.791 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.791 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.792 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:22.792 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558352+0000", 2024-09-13T06:41:22.792 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:22.792 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.792 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.792 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:22.792 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558352+0000", 2024-09-13T06:41:22.792 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:22.792 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.792 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.792 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:22.792 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558354+0000", 2024-09-13T06:41:22.793 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4930000000000001e-06 2024-09-13T06:41:22.793 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.793 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.793 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:22.793 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558360+0000", 2024-09-13T06:41:22.793 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.263e-06 2024-09-13T06:41:22.793 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.793 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.793 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:22.793 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558369+0000", 2024-09-13T06:41:22.793 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.0829999999999993e-06 2024-09-13T06:41:22.793 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.793 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.794 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:22.794 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.623017+0000", 2024-09-13T06:41:22.794 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.064647799000000006 2024-09-13T06:41:22.794 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.794 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.794 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:22.794 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.623090+0000", 2024-09-13T06:41:22.794 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3071000000000006e-05 2024-09-13T06:41:22.794 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.794 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.794 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:22.794 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.623370+0000", 2024-09-13T06:41:22.794 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000279661 2024-09-13T06:41:22.794 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:22.795 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:22.795 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:22.795 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.795 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.795 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43230 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 493568~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:22.795 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558374+0000", 2024-09-13T06:41:22.795 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 61.150316840000002, 2024-09-13T06:41:22.795 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.065410435000000003, 2024-09-13T06:41:22.795 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:22.795 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:22.795 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:22.795 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:22.795 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:22.795 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43230 2024-09-13T06:41:22.796 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.796 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:22.796 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.796 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:22.796 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558374+0000", 2024-09-13T06:41:22.796 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:22.796 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.796 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.796 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:22.796 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558374+0000", 2024-09-13T06:41:22.796 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:22.796 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.797 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.797 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:22.797 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558374+0000", 2024-09-13T06:41:22.797 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:22.797 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.797 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.797 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:22.797 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558376+0000", 2024-09-13T06:41:22.797 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4430000000000002e-06 2024-09-13T06:41:22.797 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.797 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.797 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:22.797 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558382+0000", 2024-09-13T06:41:22.798 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3029999999999996e-06 2024-09-13T06:41:22.798 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.798 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.798 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:22.798 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558387+0000", 2024-09-13T06:41:22.798 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.1699999999999999e-06 2024-09-13T06:41:22.798 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.798 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.798 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:22.798 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.623400+0000", 2024-09-13T06:41:22.799 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.065013244999999997 2024-09-13T06:41:22.799 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.799 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.799 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:22.799 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.623474+0000", 2024-09-13T06:41:22.799 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3889999999999999e-05 2024-09-13T06:41:22.799 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.799 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.799 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:22.799 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.623785+0000", 2024-09-13T06:41:22.799 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00031080099999999998 2024-09-13T06:41:22.799 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:22.799 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:22.800 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:22.800 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.800 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.800 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43231 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 507904~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:22.800 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558391+0000", 2024-09-13T06:41:22.800 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 61.150300154999996, 2024-09-13T06:41:22.800 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.065788597000000004, 2024-09-13T06:41:22.800 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:22.800 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:22.800 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:22.801 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:22.801 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:22.801 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43231 2024-09-13T06:41:22.801 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.801 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:22.801 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.801 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:22.801 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558391+0000", 2024-09-13T06:41:22.801 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:22.801 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.801 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.801 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:22.801 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558391+0000", 2024-09-13T06:41:22.802 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:22.802 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.802 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.802 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:22.802 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558390+0000", 2024-09-13T06:41:22.802 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:22.802 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.802 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.802 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:22.802 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558393+0000", 2024-09-13T06:41:22.802 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2570000000000002e-06 2024-09-13T06:41:22.802 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.803 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.803 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:22.803 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558399+0000", 2024-09-13T06:41:22.803 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0419999999999999e-06 2024-09-13T06:41:22.803 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.803 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.803 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:22.803 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558403+0000", 2024-09-13T06:41:22.803 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6249999999999998e-06 2024-09-13T06:41:22.803 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.803 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.804 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:22.804 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.623811+0000", 2024-09-13T06:41:22.804 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.065407549999999995 2024-09-13T06:41:22.804 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.804 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.804 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:22.804 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.623877+0000", 2024-09-13T06:41:22.804 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.5902999999999996e-05 2024-09-13T06:41:22.804 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.805 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.805 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:22.805 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.624179+0000", 2024-09-13T06:41:22.805 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00030259999999999998 2024-09-13T06:41:22.805 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:22.805 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:22.805 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:22.805 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.805 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.805 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43232 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 522240~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:22.805 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558422+0000", 2024-09-13T06:41:22.806 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 61.150269377999997, 2024-09-13T06:41:22.806 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.066176061999999994, 2024-09-13T06:41:22.806 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:22.806 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:22.806 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:22.806 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:22.806 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:22.806 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43232 2024-09-13T06:41:22.806 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.807 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:22.807 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.807 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:22.807 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558422+0000", 2024-09-13T06:41:22.807 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:22.807 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.807 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.807 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:22.807 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558422+0000", 2024-09-13T06:41:22.807 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:22.808 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.808 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.808 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:22.808 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558421+0000", 2024-09-13T06:41:22.808 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:22.808 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.808 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.808 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:22.808 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558428+0000", 2024-09-13T06:41:22.808 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.1690000000000003e-06 2024-09-13T06:41:22.809 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.809 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.809 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:22.809 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558434+0000", 2024-09-13T06:41:22.809 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9309999999999996e-06 2024-09-13T06:41:22.809 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.809 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.809 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:22.810 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558447+0000", 2024-09-13T06:41:22.810 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.271e-05 2024-09-13T06:41:22.810 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.810 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.810 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:22.810 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.624209+0000", 2024-09-13T06:41:22.810 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.065762102000000003 2024-09-13T06:41:22.810 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.810 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.810 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:22.810 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.624282+0000", 2024-09-13T06:41:22.810 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.2889e-05 2024-09-13T06:41:22.810 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.811 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.811 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:22.811 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.624598+0000", 2024-09-13T06:41:22.811 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00031591399999999998 2024-09-13T06:41:22.811 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:22.811 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:22.811 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:22.811 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.811 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.811 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43486 3.f 3:f7da9c8f:::rbd_data.1121f5f2e1c0.000000000000000b:1f [read 260096~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:22.811 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.569088+0000", 2024-09-13T06:41:22.811 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 61.139602654999997, 2024-09-13T06:41:22.811 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.062579223000000003, 2024-09-13T06:41:22.812 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:22.812 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:22.812 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:22.812 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:22.812 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:22.812 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43486 2024-09-13T06:41:22.812 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.812 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:22.812 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.812 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:22.812 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.569088+0000", 2024-09-13T06:41:22.812 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:22.813 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.813 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.813 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:22.813 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.569088+0000", 2024-09-13T06:41:22.813 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:22.813 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.813 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.813 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:22.813 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.569088+0000", 2024-09-13T06:41:22.813 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:22.813 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.814 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.814 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:22.814 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.569091+0000", 2024-09-13T06:41:22.814 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9629999999999998e-06 2024-09-13T06:41:22.814 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.814 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.814 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:22.814 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.569097+0000", 2024-09-13T06:41:22.814 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.4160000000000001e-06 2024-09-13T06:41:22.814 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.814 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.814 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:22.815 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.569102+0000", 2024-09-13T06:41:22.815 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6659999999999999e-06 2024-09-13T06:41:22.815 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.815 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.815 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:22.815 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.631346+0000", 2024-09-13T06:41:22.815 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.062243896 2024-09-13T06:41:22.815 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.815 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.815 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:22.815 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.631413+0000", 2024-09-13T06:41:22.815 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.7638000000000005e-05 2024-09-13T06:41:22.816 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:22.816 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:22.816 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:22.816 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.631668+0000", 2024-09-13T06:41:22.816 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0002541 2024-09-13T06:41:22.816 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:22.816 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:22.816 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:22.816 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:22.816 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:22.816 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:41:22.818 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-13T06:41:22.818 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:41:22.818+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:41:22.918 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:41:22.919+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:41:22.974 DEBUG:teuthology.orchestra.run.smithi139:> sudo rm -f /var/log/ceph/exp.3.16.7 2024-09-13T06:41:22.988 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:41:22.988 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-13T06:41:22.988 INFO:teuthology.orchestra.run.smithi081.stdout: "num_ops": 0 2024-09-13T06:41:22.988 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:41:23.002 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-13T06:41:23.028 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-13T06:41:23.050 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:41:23.050+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:41:23.120 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:41:23.118+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:41:23.125 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:41:23.125 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-13T06:41:23.125 INFO:teuthology.orchestra.run.smithi081.stdout: "complaint_time": 30, 2024-09-13T06:41:23.125 INFO:teuthology.orchestra.run.smithi081.stdout: "num_blocked_ops": 0 2024-09-13T06:41:23.126 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:41:23.140 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-13T06:41:23.186 INFO:teuthology.orchestra.run.smithi081.stdout:osd.0: {} 2024-09-13T06:41:23.187 INFO:teuthology.orchestra.run.smithi081.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-13T06:41:23.203 INFO:teuthology.orchestra.run.smithi081.stdout:osd.1: {} 2024-09-13T06:41:23.203 INFO:teuthology.orchestra.run.smithi081.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-13T06:41:23.219 INFO:teuthology.orchestra.run.smithi081.stdout:osd.2: {} 2024-09-13T06:41:23.219 INFO:teuthology.orchestra.run.smithi081.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-13T06:41:23.220 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:41:23.218+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:41:23.235 INFO:teuthology.orchestra.run.smithi081.stdout:osd.3: {} 2024-09-13T06:41:23.236 INFO:teuthology.orchestra.run.smithi081.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-13T06:41:23.256 INFO:teuthology.orchestra.run.smithi081.stdout:osd.4: {} 2024-09-13T06:41:23.256 INFO:teuthology.orchestra.run.smithi081.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-13T06:41:23.276 INFO:teuthology.orchestra.run.smithi081.stdout:osd.5: {} 2024-09-13T06:41:23.276 INFO:teuthology.orchestra.run.smithi081.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-13T06:41:23.295 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:41:23.295 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:41:23.297 INFO:teuthology.orchestra.run.smithi081.stdout:osd.6: {} 2024-09-13T06:41:23.298 INFO:teuthology.orchestra.run.smithi081.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-13T06:41:23.298 INFO:teuthology.orchestra.run.smithi081.stderr:Error ENXIO: problem getting command descriptions from osd.7 2024-09-13T06:41:23.301 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-13T06:41:23.302 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-13T06:41:23.310 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-13T06:41:23.354 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:41:23.354+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:41:23.423 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:41:23.419+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:41:23.441 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:41:23.442 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:41:23.456 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-13T06:41:23.466 INFO:teuthology.orchestra.run.smithi081.stderr:nodeep-scrub is unset 2024-09-13T06:41:23.544 INFO:tasks.ceph.osd.6.smithi139.stderr:2024-09-13T06:41:23.543+0000 7fcd02c5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26385) UID: 0 2024-09-13T06:41:23.625 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:41:23.622+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:41:23.634 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:41:23.634 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:41:23.649 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-13T06:41:23.736 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:41:23.735+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:41:23.811 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:41:23.811 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:41:23.825 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-13T06:41:23.868 INFO:tasks.ceph.osd.6.smithi139.stderr:2024-09-13T06:41:23.867+0000 7fcd02c5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26385) UID: 0 2024-09-13T06:41:23.927 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:41:23.923+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:41:23.993 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:41:23.993 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:41:24.007 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-13T06:41:24.052 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:41:24.051+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:41:24.129 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:41:24.130+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:41:24.175 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:41:24.175 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:41:24.189 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-13T06:41:24.229 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:41:24.226+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:41:24.312 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:41:24.312 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:41:24.326 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-13T06:41:24.329 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:41:24.330+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:41:24.430 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:41:24.427+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:41:24.449 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:41:24.449 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:41:24.464 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-13T06:41:24.556 INFO:tasks.ceph.osd.6.smithi139.stderr:2024-09-13T06:41:24.555+0000 7fcd02c5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26385) UID: 0 2024-09-13T06:41:24.596 INFO:teuthology.orchestra.run.smithi081.stdout:checking clone #19, image image_client.0-clone19 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent20 2024-09-13T06:41:24.631 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:41:24.627+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:41:24.634 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:41:24.634 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:41:24.649 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-13T06:41:24.736 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:41:24.735+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:41:24.820 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:41:24.820 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:41:24.833 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:41:24.830+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:41:24.834 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-13T06:41:24.934 INFO:tasks.ceph.osd.6.smithi139.stderr:2024-09-13T06:41:24.931+0000 7fcd02c5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26385) UID: 0 2024-09-13T06:41:24.960 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:41:24.960 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:41:24.975 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-13T06:41:25.001 INFO:teuthology.orchestra.run.smithi081.stdout:3426 trunc from 0x30eaf9e to 0xf01b1b 2024-09-13T06:41:25.033 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:41:25.035 INFO:tasks.ceph.osd.6.smithi139.stderr:2024-09-13T06:41:25.031+0000 7fcd02c5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26385) UID: 0 2024-09-13T06:41:25.050 INFO:teuthology.orchestra.run.smithi081.stdout:3428 writesame 0x6e48618 thru 0x6e54692 data_size 0x2d(0xc07b bytes) 2024-09-13T06:41:25.050 INFO:teuthology.orchestra.run.smithi081.stdout:3430 read 0x5054030 thru 0x505ec76 (0xac47 bytes) 2024-09-13T06:41:25.050 INFO:teuthology.orchestra.run.smithi081.stdout:3431 read 0x6435e5b thru 0x64389b8 (0x2b5e bytes) 2024-09-13T06:41:25.063 INFO:teuthology.orchestra.run.smithi081.stdout:3432 write 0x8008a72 thru 0x80129ac (0x9f3b bytes) 2024-09-13T06:41:25.074 INFO:teuthology.orchestra.run.smithi081.stdout:3433 read 0x3cc9170 thru 0x3cd80fd (0xef8e bytes) 2024-09-13T06:41:25.089 INFO:teuthology.orchestra.run.smithi081.stdout:3434 write 0x9457bb5 thru 0x9464192 (0xc5de bytes) 2024-09-13T06:41:25.097 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:41:25.098 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:41:25.098 INFO:teuthology.orchestra.run.smithi081.stdout:3435 writesame 0x38329c2 thru 0x3837642 data_size 0x1(0x4c81 bytes) 2024-09-13T06:41:25.113 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-13T06:41:25.121 INFO:teuthology.orchestra.run.smithi081.stdout:3436 read 0x3ced77f thru 0x3cf5b14 (0x8396 bytes) 2024-09-13T06:41:25.121 INFO:teuthology.orchestra.run.smithi081.stdout:3437 writesame 0x6b21f11 thru 0x6b3128f data_size 0x5b(0xf37f bytes) 2024-09-13T06:41:25.134 INFO:teuthology.orchestra.run.smithi081.stdout:3438 trunc from 0x9464193 to 0xad8d7a2 2024-09-13T06:41:25.135 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:41:25.134+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:41:25.146 INFO:teuthology.orchestra.run.smithi081.stdout:3439 write 0x3e4679d thru 0x3e4991e (0x3182 bytes) 2024-09-13T06:41:25.168 INFO:teuthology.orchestra.run.smithi081.stdout:3440 write 0xce944ed thru 0xcea302e (0xeb42 bytes) 2024-09-13T06:41:25.183 INFO:teuthology.orchestra.run.smithi081.stdout:3441 punch from 0x9112e42 to 0x911e15b, (0xb319 bytes) 2024-09-13T06:41:25.183 INFO:teuthology.orchestra.run.smithi081.stdout:3442 writesame 0x8556025 thru 0x855c5e4 data_size 0x58(0x65c0 bytes) 2024-09-13T06:41:25.187 INFO:teuthology.orchestra.run.smithi081.stdout:3443 read 0x5bad99b thru 0x5bbab66 (0xd1cc bytes) 2024-09-13T06:41:25.188 INFO:teuthology.orchestra.run.smithi081.stdout:3444 read 0x4d7ca00 thru 0x4d8542d (0x8a2e bytes) 2024-09-13T06:41:25.192 INFO:teuthology.orchestra.run.smithi081.stdout:3445 trunc from 0xcea302f to 0xad64e4e 2024-09-13T06:41:25.208 INFO:teuthology.orchestra.run.smithi081.stdout:3446 read 0x558747c thru 0x55892d6 (0x1e5b bytes) 2024-09-13T06:41:25.208 INFO:teuthology.orchestra.run.smithi081.stdout:3447 punch from 0x3b5add2 to 0x3b63437, (0x8665 bytes) 2024-09-13T06:41:25.218 INFO:teuthology.orchestra.run.smithi081.stdout:3448 trunc from 0xad64e4e to 0x466cc09 2024-09-13T06:41:25.236 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:41:25.234+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:41:25.246 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:41:25.247 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:41:25.247 INFO:teuthology.orchestra.run.smithi081.stdout:3449 write 0x316b643 thru 0x316bea6 (0x864 bytes) 2024-09-13T06:41:25.257 INFO:teuthology.orchestra.run.smithi081.stdout:3451 trunc from 0x466cc09 to 0x17c9b34 2024-09-13T06:41:25.265 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-13T06:41:25.287 INFO:teuthology.orchestra.run.smithi081.stdout:3453 read 0x291304 thru 0x29d0ad (0xbdaa bytes) 2024-09-13T06:41:25.303 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-13T06:41:25.308 INFO:teuthology.orchestra.run.smithi081.stdout:3454 trunc from 0x17c9b34 to 0x9abbe0a 2024-09-13T06:41:25.321 INFO:teuthology.orchestra.run.smithi081.stdout:3455 read 0x92019b4 thru 0x920bebd (0xa50a bytes) 2024-09-13T06:41:25.321 INFO:teuthology.orchestra.run.smithi081.stdout:3456 write 0x76a55e thru 0x76ba19 (0x14bc bytes) 2024-09-13T06:41:25.330 INFO:teuthology.orchestra.run.smithi081.stdout:3457 trunc from 0x9abbe0a to 0xd4a0192 2024-09-13T06:41:25.338 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:41:25.335+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:41:25.342 INFO:teuthology.orchestra.run.smithi081.stdout:3458 read 0x8049eca thru 0x804c902 (0x2a39 bytes) 2024-09-13T06:41:25.342 INFO:teuthology.orchestra.run.smithi081.stdout:3459 writesame 0xa059273 thru 0xa066cfc data_size 0xb(0xda8a bytes) 2024-09-13T06:41:25.355 INFO:teuthology.orchestra.run.smithi081.stdout:3460 writesame 0x50a4841 thru 0x50ad1d3 data_size 0x1(0x8993 bytes) 2024-09-13T06:41:25.384 INFO:teuthology.orchestra.run.smithi081.stdout:3464 trunc from 0xd4a0192 to 0xaa578bf 2024-09-13T06:41:25.399 INFO:teuthology.orchestra.run.smithi081.stdout:3466 write 0x62e79c2 thru 0x62ec0d1 (0x4710 bytes) 2024-09-13T06:41:25.416 INFO:teuthology.orchestra.run.smithi081.stdout:3468 trunc from 0xaa578bf to 0x5ed1e12 2024-09-13T06:41:25.427 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:41:25.428 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:41:25.438 INFO:teuthology.orchestra.run.smithi081.stdout:3469 writesame 0x55f3c8d thru 0x5602058 data_size 0x3d(0xe3cc bytes) 2024-09-13T06:41:25.439 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:41:25.435+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:41:25.444 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-13T06:41:25.455 INFO:teuthology.orchestra.run.smithi081.stdout:3471 trunc from 0x5ed1e12 to 0x814d0b2 2024-09-13T06:41:25.464 INFO:teuthology.orchestra.run.smithi081.stdout:osd.0: {} 2024-09-13T06:41:25.464 INFO:teuthology.orchestra.run.smithi081.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-13T06:41:25.466 INFO:teuthology.orchestra.run.smithi081.stdout:3472 punch from 0x6e63aed to 0x6e6e497, (0xa9aa bytes) 2024-09-13T06:41:25.466 INFO:teuthology.orchestra.run.smithi081.stdout:3473 read 0x2c1e105 thru 0x2c20360 (0x225c bytes) 2024-09-13T06:41:25.482 INFO:teuthology.orchestra.run.smithi081.stdout:osd.1: {} 2024-09-13T06:41:25.482 INFO:teuthology.orchestra.run.smithi081.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-13T06:41:25.486 INFO:teuthology.orchestra.run.smithi081.stdout:3475 write 0xdf8fef2 thru 0xdf9a376 (0xa485 bytes) 2024-09-13T06:41:25.499 INFO:teuthology.orchestra.run.smithi081.stdout:osd.2: {} 2024-09-13T06:41:25.499 INFO:teuthology.orchestra.run.smithi081.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-13T06:41:25.502 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-13T06:41:25.514 INFO:teuthology.orchestra.run.smithi081.stdout:3476 trunc from 0xdf9a377 to 0x46e8095 2024-09-13T06:41:25.516 INFO:teuthology.orchestra.run.smithi081.stdout:osd.3: {} 2024-09-13T06:41:25.516 INFO:teuthology.orchestra.run.smithi081.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-13T06:41:25.540 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:41:25.538+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:41:25.546 INFO:teuthology.orchestra.run.smithi081.stdout:3477 trunc from 0x46e8095 to 0x14d105 2024-09-13T06:41:25.553 INFO:teuthology.orchestra.run.smithi081.stdout:osd.4: {} 2024-09-13T06:41:25.553 INFO:teuthology.orchestra.run.smithi081.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-13T06:41:25.579 INFO:teuthology.orchestra.run.smithi081.stdout:3479 trunc from 0x14d105 to 0x41c709a 2024-09-13T06:41:25.590 INFO:teuthology.orchestra.run.smithi081.stdout:osd.5: {} 2024-09-13T06:41:25.590 INFO:teuthology.orchestra.run.smithi081.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-13T06:41:25.591 INFO:teuthology.orchestra.run.smithi081.stdout:3480 read 0x239417b thru 0x239efeb (0xae71 bytes) 2024-09-13T06:41:25.591 INFO:teuthology.orchestra.run.smithi081.stdout:3481 read 0xee27e2 thru 0xee8eae (0x66cd bytes) 2024-09-13T06:41:25.592 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:41:25.592 INFO:teuthology.orchestra.run.smithi081.stdout:3486 read 0x272b3a thru 0x275353 (0x281a bytes) 2024-09-13T06:41:25.604 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:41:25.604 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-13T06:41:25.604 INFO:teuthology.orchestra.run.smithi081.stdout: "complaint_time": 30, 2024-09-13T06:41:25.604 INFO:teuthology.orchestra.run.smithi081.stdout: "num_blocked_ops": 0 2024-09-13T06:41:25.604 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:41:25.612 INFO:teuthology.orchestra.run.smithi081.stdout:osd.6: {} 2024-09-13T06:41:25.612 INFO:teuthology.orchestra.run.smithi081.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-13T06:41:25.612 INFO:teuthology.orchestra.run.smithi081.stderr:Error ENXIO: problem getting command descriptions from osd.7 2024-09-13T06:41:25.617 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-13T06:41:25.617 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-13T06:41:25.621 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-13T06:41:25.621 INFO:teuthology.orchestra.run.smithi081.stdout:3487 write 0xca3ccca thru 0xca41aed (0x4e24 bytes) 2024-09-13T06:41:25.629 INFO:teuthology.orchestra.run.smithi081.stdout:3488 read 0x7b024a4 thru 0x7b11a04 (0xf561 bytes) 2024-09-13T06:41:25.641 INFO:teuthology.orchestra.run.smithi081.stdout:3490 trunc from 0xca41aee to 0x4ed2a1f 2024-09-13T06:41:25.641 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:41:25.638+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:41:25.661 INFO:teuthology.orchestra.run.smithi081.stdout:3491 punch from 0x4f5d82 to 0x503662, (0xd8e0 bytes) 2024-09-13T06:41:25.684 INFO:teuthology.orchestra.run.smithi081.stdout:3493 writesame 0xd34042a thru 0xd34dc3a data_size 0x1(0xd811 bytes) 2024-09-13T06:41:25.695 INFO:teuthology.orchestra.run.smithi081.stdout:3494 trunc from 0xd34dc3b to 0x5f91d3b 2024-09-13T06:41:25.707 INFO:teuthology.orchestra.run.smithi081.stdout:3495 punch from 0x506e22d to 0x507c479, (0xe24c bytes) 2024-09-13T06:41:25.708 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:41:25.708 INFO:teuthology.orchestra.run.smithi081.stdout:3497 read 0x3f849ff thru 0x3f8a325 (0x5927 bytes) 2024-09-13T06:41:25.708 INFO:teuthology.orchestra.run.smithi081.stdout:3498 writesame 0x27c980d thru 0x27c9eb0 data_size 0x19(0x6a4 bytes) 2024-09-13T06:41:25.710 INFO:teuthology.orchestra.run.smithi081.stdout:3499 read 0x4843e70 thru 0x4848f7a (0x510b bytes) 2024-09-13T06:41:25.710 INFO:teuthology.orchestra.run.smithi081.stdout:3500 punch from 0x5cff08c to 0x5d09c23, (0xab97 bytes) 2024-09-13T06:41:25.710 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:41:25.710 INFO:teuthology.orchestra.run.smithi081.stdout:3502 read 0x2193ee6 thru 0x219b742 (0x785d bytes) 2024-09-13T06:41:25.710 INFO:teuthology.orchestra.run.smithi081.stdout:3503 punch from 0x35db038 to 0x35e9579, (0xe541 bytes) 2024-09-13T06:41:25.711 INFO:teuthology.orchestra.run.smithi081.stdout:3504 read 0x37a09a9 thru 0x37a88c3 (0x7f1b bytes) 2024-09-13T06:41:25.711 INFO:teuthology.orchestra.run.smithi081.stdout:3505 write 0x1429351 thru 0x14357b1 (0xc461 bytes) 2024-09-13T06:41:25.715 INFO:teuthology.orchestra.run.smithi081.stdout:3506 writesame 0x1d06a71 thru 0x1d1692c data_size 0x89(0xfebc bytes) 2024-09-13T06:41:25.718 INFO:teuthology.orchestra.run.smithi081.stdout:3507 writesame 0x557730c thru 0x5585ae1 data_size 0x19(0xe7d6 bytes) 2024-09-13T06:41:25.742 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:41:25.742+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:41:25.747 INFO:teuthology.orchestra.run.smithi081.stdout:3509 writesame 0x774bffb thru 0x7754518 data_size 0xb(0x851e bytes) 2024-09-13T06:41:25.747 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:41:25.747 INFO:teuthology.orchestra.run.smithi081.stdout:3511 punch from 0x191507f to 0x191ab4c, (0x5acd bytes) 2024-09-13T06:41:25.759 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:41:25.759 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 20, 2024-09-13T06:41:25.759 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 600, 2024-09-13T06:41:25.759 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [ 2024-09-13T06:41:25.759 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:25.759 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:21979 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 14217216~4096 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:41:25.760 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.888811+0000", 2024-09-13T06:41:25.760 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 92.870222420000005, 2024-09-13T06:41:25.760 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049092969, 2024-09-13T06:41:25.760 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:25.760 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:25.760 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:25.760 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:25.760 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:25.760 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 21979 2024-09-13T06:41:25.760 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:25.760 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:25.760 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:25.760 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:25.761 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888811+0000", 2024-09-13T06:41:25.761 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:25.761 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:25.761 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:25.761 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:25.761 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888811+0000", 2024-09-13T06:41:25.761 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:25.761 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:25.761 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:25.761 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:25.761 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888811+0000", 2024-09-13T06:41:25.761 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:41:25.761 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:25.761 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:25.762 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:25.762 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888812+0000", 2024-09-13T06:41:25.762 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.204e-06 2024-09-13T06:41:25.762 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:25.762 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:25.762 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:25.762 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888815+0000", 2024-09-13T06:41:25.762 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9359999999999999e-06 2024-09-13T06:41:25.762 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:25.762 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:25.763 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:25.763 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888818+0000", 2024-09-13T06:41:25.763 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.7369999999999998e-06 2024-09-13T06:41:25.763 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:25.763 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:25.763 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:25.763 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.937663+0000", 2024-09-13T06:41:25.763 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.048844540999999998 2024-09-13T06:41:25.763 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:25.763 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:25.763 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:25.763 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.937709+0000", 2024-09-13T06:41:25.763 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6492999999999997e-05 2024-09-13T06:41:25.763 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:25.764 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:25.764 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:25.764 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.937904+0000", 2024-09-13T06:41:25.764 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00019526499999999999 2024-09-13T06:41:25.764 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:25.764 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:25.764 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:25.764 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:25.764 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:25.764 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:21980 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 14245888~4096 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:41:25.764 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.888820+0000", 2024-09-13T06:41:25.764 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 92.870213742999994, 2024-09-13T06:41:25.764 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049357080999999997, 2024-09-13T06:41:25.764 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:25.765 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:25.765 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:25.765 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:25.765 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:25.765 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 21980 2024-09-13T06:41:25.765 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:25.765 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:25.765 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:25.765 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:25.765 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888820+0000", 2024-09-13T06:41:25.765 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:25.765 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:25.765 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:25.766 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:25.766 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888820+0000", 2024-09-13T06:41:25.766 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:25.766 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:25.766 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:25.766 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:25.766 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888820+0000", 2024-09-13T06:41:25.766 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:41:25.766 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:25.766 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:25.766 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:25.766 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888821+0000", 2024-09-13T06:41:25.766 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.122e-06 2024-09-13T06:41:25.767 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:25.767 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:25.767 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:25.767 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888824+0000", 2024-09-13T06:41:25.767 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.0580000000000002e-06 2024-09-13T06:41:25.767 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:25.767 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:25.767 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:25.767 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888827+0000", 2024-09-13T06:41:25.767 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.666e-06 2024-09-13T06:41:25.767 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:25.767 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:25.767 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:25.767 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.937935+0000", 2024-09-13T06:41:25.767 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049108329999999999 2024-09-13T06:41:25.768 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:25.768 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:25.768 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:25.768 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.937985+0000", 2024-09-13T06:41:25.768 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9694000000000002e-05 2024-09-13T06:41:25.768 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:25.768 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:25.768 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:25.768 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.938177+0000", 2024-09-13T06:41:25.768 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00019241899999999999 2024-09-13T06:41:25.768 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:25.768 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:25.768 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:25.769 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:25.769 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:25.769 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:21984 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:snapdir [list-snaps] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:41:25.769 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.888829+0000", 2024-09-13T06:41:25.769 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 92.870204964999999, 2024-09-13T06:41:25.769 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049524545000000003, 2024-09-13T06:41:25.769 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:25.769 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:25.769 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:25.769 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:25.769 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:25.769 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 21984 2024-09-13T06:41:25.769 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:25.770 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:25.770 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:25.770 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:25.770 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888829+0000", 2024-09-13T06:41:25.770 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:25.770 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:25.770 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:25.770 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:25.770 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888829+0000", 2024-09-13T06:41:25.770 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:25.770 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:25.770 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:25.770 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:25.770 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888829+0000", 2024-09-13T06:41:25.771 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:41:25.771 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:25.771 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:25.771 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:25.771 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888830+0000", 2024-09-13T06:41:25.771 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2529999999999999e-06 2024-09-13T06:41:25.771 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:25.771 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:25.771 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:25.771 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888835+0000", 2024-09-13T06:41:25.771 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.4729999999999999e-06 2024-09-13T06:41:25.771 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:25.771 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:25.771 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:25.772 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888840+0000", 2024-09-13T06:41:25.772 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0159999999999999e-06 2024-09-13T06:41:25.772 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:25.772 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:25.772 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:25.772 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.938199+0000", 2024-09-13T06:41:25.772 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049358974999999999 2024-09-13T06:41:25.772 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:25.772 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:25.772 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:25.772 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.938268+0000", 2024-09-13T06:41:25.772 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.8876999999999998e-05 2024-09-13T06:41:25.772 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:25.772 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:25.773 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:25.773 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.938353+0000", 2024-09-13T06:41:25.773 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.5155999999999996e-05 2024-09-13T06:41:25.773 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:25.773 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:25.773 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:25.773 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:25.773 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:25.773 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:21985 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 12587008~4096 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:41:25.773 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.888858+0000", 2024-09-13T06:41:25.773 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 92.870175814999996, 2024-09-13T06:41:25.773 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049674347000000001, 2024-09-13T06:41:25.773 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:25.773 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:25.774 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:25.774 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:25.774 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:25.774 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 21985 2024-09-13T06:41:25.774 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:25.774 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:25.774 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:25.774 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:25.774 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888858+0000", 2024-09-13T06:41:25.774 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:25.774 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:25.774 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:25.774 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:25.774 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888858+0000", 2024-09-13T06:41:25.774 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:25.775 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:25.775 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:25.775 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:25.775 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888857+0000", 2024-09-13T06:41:25.775 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:25.775 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:25.775 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:25.775 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:25.775 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888860+0000", 2024-09-13T06:41:25.775 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4739999999999999e-06 2024-09-13T06:41:25.775 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:25.775 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:25.775 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:25.775 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888867+0000", 2024-09-13T06:41:25.775 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.7170000000000002e-06 2024-09-13T06:41:25.776 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:25.776 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:25.776 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:25.776 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888871+0000", 2024-09-13T06:41:25.776 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5120000000000002e-06 2024-09-13T06:41:25.776 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:25.776 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:25.776 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:25.776 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.938389+0000", 2024-09-13T06:41:25.776 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049517717000000003 2024-09-13T06:41:25.776 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:25.776 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:25.776 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:25.777 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.938449+0000", 2024-09-13T06:41:25.777 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0513999999999997e-05 2024-09-13T06:41:25.777 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:25.777 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:25.777 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:25.777 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.938532+0000", 2024-09-13T06:41:25.777 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.2936999999999996e-05 2024-09-13T06:41:25.777 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:25.777 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:25.777 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:25.777 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:25.777 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:25.777 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:21986 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 12615680~4096 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:41:25.778 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.888875+0000", 2024-09-13T06:41:25.778 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 92.870158301999993, 2024-09-13T06:41:25.778 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049881781, 2024-09-13T06:41:25.778 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:25.778 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:25.778 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:25.778 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:25.778 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:25.778 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 21986 2024-09-13T06:41:25.778 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:25.778 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:25.778 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:25.778 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:25.778 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888875+0000", 2024-09-13T06:41:25.779 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:25.779 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:25.779 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:25.779 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:25.779 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888875+0000", 2024-09-13T06:41:25.779 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:25.779 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:25.779 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:25.779 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:25.779 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888875+0000", 2024-09-13T06:41:25.779 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:25.779 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:25.779 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:25.779 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:25.779 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888880+0000", 2024-09-13T06:41:25.780 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7600000000000002e-06 2024-09-13T06:41:25.780 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:25.780 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:25.780 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:25.780 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888887+0000", 2024-09-13T06:41:25.780 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3950000000000003e-06 2024-09-13T06:41:25.780 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:25.780 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:25.780 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:25.781 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888892+0000", 2024-09-13T06:41:25.781 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0409999999999997e-06 2024-09-13T06:41:25.781 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:25.781 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:25.781 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:25.781 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.938568+0000", 2024-09-13T06:41:25.781 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049675267000000002 2024-09-13T06:41:25.781 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:25.781 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:25.781 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:25.781 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.938653+0000", 2024-09-13T06:41:25.781 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.5792999999999997e-05 2024-09-13T06:41:25.781 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:25.781 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:25.782 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:25.782 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.938757+0000", 2024-09-13T06:41:25.782 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00010387699999999999 2024-09-13T06:41:25.782 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:25.782 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:25.782 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:25.782 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:25.782 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:25.782 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:21987 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 12644352~4096 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:41:25.782 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.888899+0000", 2024-09-13T06:41:25.782 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 92.870134956000001, 2024-09-13T06:41:25.782 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.050094056999999997, 2024-09-13T06:41:25.782 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:25.783 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:25.783 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:25.783 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:25.783 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:25.783 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 21987 2024-09-13T06:41:25.783 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:25.783 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:25.783 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:25.783 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:25.783 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888899+0000", 2024-09-13T06:41:25.783 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:25.783 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:25.783 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:25.784 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:25.784 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888899+0000", 2024-09-13T06:41:25.784 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:25.784 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:25.784 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:25.784 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:25.784 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888899+0000", 2024-09-13T06:41:25.784 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:25.784 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:25.784 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:25.784 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:25.784 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888901+0000", 2024-09-13T06:41:25.784 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2539999999999999e-06 2024-09-13T06:41:25.784 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:25.784 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:25.785 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:25.785 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888907+0000", 2024-09-13T06:41:25.785 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9009999999999999e-06 2024-09-13T06:41:25.785 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:25.785 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:25.785 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:25.785 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888912+0000", 2024-09-13T06:41:25.785 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9840000000000001e-06 2024-09-13T06:41:25.785 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:25.785 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:25.785 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:25.785 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.938810+0000", 2024-09-13T06:41:25.785 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049898835000000002 2024-09-13T06:41:25.785 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:25.786 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:25.786 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:25.786 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.938890+0000", 2024-09-13T06:41:25.786 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.9215000000000006e-05 2024-09-13T06:41:25.786 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:25.786 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:25.786 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:25.786 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.938993+0000", 2024-09-13T06:41:25.786 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000103194 2024-09-13T06:41:25.786 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:25.786 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:25.786 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:25.786 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:25.787 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:25.787 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:21988 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 12673024~4096 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:41:25.787 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.888916+0000", 2024-09-13T06:41:25.787 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 92.87011794, 2024-09-13T06:41:25.787 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.050203036999999999, 2024-09-13T06:41:25.787 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:25.787 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:25.787 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:25.787 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:25.787 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:25.787 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 21988 2024-09-13T06:41:25.787 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:25.787 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:25.787 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:25.788 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:25.788 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888916+0000", 2024-09-13T06:41:25.788 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:25.788 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:25.788 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:25.788 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:25.788 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888916+0000", 2024-09-13T06:41:25.788 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:25.788 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:25.788 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:25.788 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:25.788 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888915+0000", 2024-09-13T06:41:25.788 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:25.788 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:25.789 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:25.789 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:25.789 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888918+0000", 2024-09-13T06:41:25.789 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1500000000000002e-06 2024-09-13T06:41:25.789 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:25.789 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:25.789 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:25.789 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888925+0000", 2024-09-13T06:41:25.789 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.9380000000000003e-06 2024-09-13T06:41:25.789 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:25.789 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:25.789 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:25.789 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888933+0000", 2024-09-13T06:41:25.789 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.0560000000000005e-06 2024-09-13T06:41:25.790 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:25.790 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:25.790 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:25.790 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.939026+0000", 2024-09-13T06:41:25.790 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.050093499999999999 2024-09-13T06:41:25.790 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:25.790 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:25.790 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:25.790 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.939068+0000", 2024-09-13T06:41:25.790 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.1705999999999997e-05 2024-09-13T06:41:25.790 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:25.790 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:25.790 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:25.791 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.939119+0000", 2024-09-13T06:41:25.791 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.1048999999999999e-05 2024-09-13T06:41:25.791 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:25.791 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:25.791 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:25.791 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:25.791 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:25.791 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:21989 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 12701696~4096 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:41:25.791 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.888938+0000", 2024-09-13T06:41:25.791 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 92.870095613000004, 2024-09-13T06:41:25.791 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.050294393999999999, 2024-09-13T06:41:25.791 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:25.792 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:25.792 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:25.792 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:25.792 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:25.792 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 21989 2024-09-13T06:41:25.792 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:25.792 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:25.792 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:25.792 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:25.792 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888938+0000", 2024-09-13T06:41:25.792 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:25.792 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:25.792 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:25.793 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:25.793 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888938+0000", 2024-09-13T06:41:25.793 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:25.793 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:25.793 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:25.793 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:25.793 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888938+0000", 2024-09-13T06:41:25.793 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:25.793 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:25.793 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:25.793 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:25.793 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888940+0000", 2024-09-13T06:41:25.793 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5330000000000001e-06 2024-09-13T06:41:25.794 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:25.794 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:25.794 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:25.794 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888947+0000", 2024-09-13T06:41:25.794 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.2389999999999999e-06 2024-09-13T06:41:25.794 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:25.794 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:25.794 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:25.794 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888952+0000", 2024-09-13T06:41:25.794 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.5720000000000002e-06 2024-09-13T06:41:25.794 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:25.794 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:25.794 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:25.795 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.939141+0000", 2024-09-13T06:41:25.795 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.050188903999999999 2024-09-13T06:41:25.795 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:25.795 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:25.795 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:25.795 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.939182+0000", 2024-09-13T06:41:25.795 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.0926000000000001e-05 2024-09-13T06:41:25.795 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:25.795 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:25.795 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:25.795 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.939233+0000", 2024-09-13T06:41:25.795 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0532999999999999e-05 2024-09-13T06:41:25.795 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:25.795 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:25.796 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:25.796 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:25.796 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:25.796 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:22006 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 13189120~4096 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:41:25.796 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.892763+0000", 2024-09-13T06:41:25.796 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 92.866271087000001, 2024-09-13T06:41:25.796 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.048963505999999997, 2024-09-13T06:41:25.796 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:25.796 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:25.796 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:25.796 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:25.796 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:25.796 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 22006 2024-09-13T06:41:25.796 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:25.797 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:25.797 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:25.797 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:25.797 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892763+0000", 2024-09-13T06:41:25.797 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:25.797 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:25.797 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:25.797 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:25.797 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892763+0000", 2024-09-13T06:41:25.797 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:25.797 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:25.797 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:25.797 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:25.798 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892763+0000", 2024-09-13T06:41:25.798 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:41:25.798 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:25.798 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:25.798 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:25.798 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892764+0000", 2024-09-13T06:41:25.798 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2410000000000001e-06 2024-09-13T06:41:25.798 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:25.798 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:25.798 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:25.798 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892767+0000", 2024-09-13T06:41:25.798 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9390000000000002e-06 2024-09-13T06:41:25.798 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:25.798 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:25.799 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:25.799 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892769+0000", 2024-09-13T06:41:25.799 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5390000000000002e-06 2024-09-13T06:41:25.799 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:25.799 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:25.799 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:25.799 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.941560+0000", 2024-09-13T06:41:25.799 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.048791221000000003 2024-09-13T06:41:25.799 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:25.799 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:25.799 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:25.799 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.941632+0000", 2024-09-13T06:41:25.799 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.1932000000000002e-05 2024-09-13T06:41:25.799 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:25.799 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:25.800 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:25.800 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.941726+0000", 2024-09-13T06:41:25.800 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.3839999999999996e-05 2024-09-13T06:41:25.800 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:25.800 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:25.800 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:25.800 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:25.800 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:25.800 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:22007 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 13217792~4096 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:41:25.800 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.892771+0000", 2024-09-13T06:41:25.800 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 92.866262507000002, 2024-09-13T06:41:25.800 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049090024000000003, 2024-09-13T06:41:25.800 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:25.800 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:25.801 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:25.801 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:25.801 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:25.801 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 22007 2024-09-13T06:41:25.801 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:25.801 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:25.801 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:25.801 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:25.801 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892771+0000", 2024-09-13T06:41:25.801 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:25.801 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:25.801 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:25.801 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:25.802 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892771+0000", 2024-09-13T06:41:25.802 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:25.802 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:25.802 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:25.802 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:25.802 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892771+0000", 2024-09-13T06:41:25.802 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:41:25.802 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:25.802 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:25.802 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:25.802 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892772+0000", 2024-09-13T06:41:25.802 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.184e-06 2024-09-13T06:41:25.802 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:25.803 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:25.803 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:25.803 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892775+0000", 2024-09-13T06:41:25.803 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9179999999999998e-06 2024-09-13T06:41:25.803 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:25.803 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:25.803 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:25.803 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892778+0000", 2024-09-13T06:41:25.803 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4990000000000001e-06 2024-09-13T06:41:25.803 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:25.803 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:25.803 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:25.804 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.941760+0000", 2024-09-13T06:41:25.804 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.048982070000000003 2024-09-13T06:41:25.804 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:25.804 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:25.804 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:25.804 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.941808+0000", 2024-09-13T06:41:25.804 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.8278000000000001e-05 2024-09-13T06:41:25.804 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:25.804 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:25.804 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:25.804 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.941861+0000", 2024-09-13T06:41:25.804 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3284e-05 2024-09-13T06:41:25.804 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:25.804 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:25.805 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:25.805 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:25.805 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:25.805 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:22008 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 13246464~4096 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:41:25.805 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.892780+0000", 2024-09-13T06:41:25.805 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 92.866253850000007, 2024-09-13T06:41:25.805 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049200477999999999, 2024-09-13T06:41:25.805 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:25.805 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:25.805 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:25.805 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:25.805 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:25.805 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 22008 2024-09-13T06:41:25.805 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:25.806 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:25.806 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:25.806 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:25.806 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892780+0000", 2024-09-13T06:41:25.806 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:25.806 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:25.806 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:25.806 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:25.806 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892780+0000", 2024-09-13T06:41:25.806 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:25.806 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:25.806 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:25.806 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:25.806 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892780+0000", 2024-09-13T06:41:25.806 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:41:25.807 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:25.807 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:25.807 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:25.807 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892781+0000", 2024-09-13T06:41:25.807 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.083e-06 2024-09-13T06:41:25.807 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:25.807 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:25.807 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:25.807 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892784+0000", 2024-09-13T06:41:25.807 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.926e-06 2024-09-13T06:41:25.807 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:25.807 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:25.807 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:25.807 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892786+0000", 2024-09-13T06:41:25.807 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4490000000000002e-06 2024-09-13T06:41:25.808 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:25.808 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:25.808 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:25.808 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.941888+0000", 2024-09-13T06:41:25.808 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049102290999999999 2024-09-13T06:41:25.808 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:25.808 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:25.808 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:25.808 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.941929+0000", 2024-09-13T06:41:25.808 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.0541999999999999e-05 2024-09-13T06:41:25.808 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:25.808 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:25.809 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:25.809 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.941980+0000", 2024-09-13T06:41:25.809 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.1391999999999999e-05 2024-09-13T06:41:25.809 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:25.809 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:25.809 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:25.809 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:25.809 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:25.809 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:22009 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 13275136~4096 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:41:25.809 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.892788+0000", 2024-09-13T06:41:25.809 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 92.866245366000001, 2024-09-13T06:41:25.809 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049311926999999998, 2024-09-13T06:41:25.809 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:25.809 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:25.810 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:25.810 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:25.810 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:25.810 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 22009 2024-09-13T06:41:25.810 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:25.810 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:25.810 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:25.810 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:25.810 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892788+0000", 2024-09-13T06:41:25.810 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:25.810 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:25.810 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:25.810 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:25.811 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892788+0000", 2024-09-13T06:41:25.811 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:25.811 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:25.811 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:25.811 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:25.811 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892788+0000", 2024-09-13T06:41:25.811 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:41:25.811 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:25.811 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:25.811 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:25.811 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892789+0000", 2024-09-13T06:41:25.811 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1850000000000001e-06 2024-09-13T06:41:25.811 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:25.812 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:25.812 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:25.812 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892793+0000", 2024-09-13T06:41:25.812 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.9099999999999998e-06 2024-09-13T06:41:25.812 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:25.812 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:25.812 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:25.812 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892798+0000", 2024-09-13T06:41:25.812 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5070000000000002e-06 2024-09-13T06:41:25.812 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:25.812 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:25.812 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:25.812 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.942007+0000", 2024-09-13T06:41:25.812 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049208904999999997 2024-09-13T06:41:25.813 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:25.813 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:25.813 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:25.813 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.942049+0000", 2024-09-13T06:41:25.813 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.1922000000000003e-05 2024-09-13T06:41:25.813 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:25.813 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:25.813 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:25.813 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.942100+0000", 2024-09-13T06:41:25.813 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.1736000000000001e-05 2024-09-13T06:41:25.813 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:25.813 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:25.813 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:25.814 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:25.814 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:25.814 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:22010 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 13303808~4096 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:41:25.814 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.892817+0000", 2024-09-13T06:41:25.814 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 92.866217169999999, 2024-09-13T06:41:25.814 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049466149000000001, 2024-09-13T06:41:25.814 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:25.814 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:25.814 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:25.814 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:25.814 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:25.814 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 22010 2024-09-13T06:41:25.814 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:25.814 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:25.815 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:25.815 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:25.815 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892817+0000", 2024-09-13T06:41:25.815 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:25.815 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:25.815 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:25.815 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:25.815 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892817+0000", 2024-09-13T06:41:25.815 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:25.815 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:25.815 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:25.815 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:25.815 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892816+0000", 2024-09-13T06:41:25.815 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:25.815 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:25.816 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:25.816 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:25.816 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892821+0000", 2024-09-13T06:41:25.816 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9459999999999997e-06 2024-09-13T06:41:25.816 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:25.816 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:25.816 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:25.816 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892828+0000", 2024-09-13T06:41:25.816 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.6780000000000003e-06 2024-09-13T06:41:25.816 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:25.816 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:25.816 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:25.816 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892833+0000", 2024-09-13T06:41:25.816 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.8389999999999997e-06 2024-09-13T06:41:25.817 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:25.817 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:25.817 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:25.817 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.942127+0000", 2024-09-13T06:41:25.817 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049294163000000002 2024-09-13T06:41:25.817 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:25.817 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:25.817 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:25.817 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.942186+0000", 2024-09-13T06:41:25.817 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9335e-05 2024-09-13T06:41:25.817 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:25.817 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:25.817 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:25.818 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.942283+0000", 2024-09-13T06:41:25.818 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.6699000000000004e-05 2024-09-13T06:41:25.818 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:25.818 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:25.818 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:25.818 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:25.818 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:25.818 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:22011 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 13332480~4096 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:41:25.818 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.892838+0000", 2024-09-13T06:41:25.818 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 92.866195482999998, 2024-09-13T06:41:25.818 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049589214, 2024-09-13T06:41:25.818 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:25.819 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:25.819 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:25.819 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:25.819 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:25.819 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 22011 2024-09-13T06:41:25.819 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:25.819 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:25.819 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:25.819 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:25.819 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892838+0000", 2024-09-13T06:41:25.819 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:25.819 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:25.819 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:25.819 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:25.819 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892838+0000", 2024-09-13T06:41:25.820 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:25.820 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:25.820 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:25.820 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:25.820 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892838+0000", 2024-09-13T06:41:25.820 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:25.820 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:25.820 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:25.820 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:25.820 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892840+0000", 2024-09-13T06:41:25.820 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.136e-06 2024-09-13T06:41:25.820 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:25.820 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:25.820 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:25.820 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892852+0000", 2024-09-13T06:41:25.821 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2122e-05 2024-09-13T06:41:25.821 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:25.821 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:25.821 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:25.821 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892862+0000", 2024-09-13T06:41:25.821 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.7049999999999994e-06 2024-09-13T06:41:25.821 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:25.821 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:25.821 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:25.821 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.942319+0000", 2024-09-13T06:41:25.821 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049456623999999998 2024-09-13T06:41:25.821 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:25.821 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:25.822 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:25.822 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.942363+0000", 2024-09-13T06:41:25.822 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4759000000000003e-05 2024-09-13T06:41:25.822 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:25.822 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:25.822 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:25.822 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.942428+0000", 2024-09-13T06:41:25.822 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.4221999999999996e-05 2024-09-13T06:41:25.822 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:25.822 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:25.822 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:25.822 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:25.822 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:25.822 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:22033 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 13963264~4096 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:41:25.823 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.896824+0000", 2024-09-13T06:41:25.823 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 92.862209590000006, 2024-09-13T06:41:25.823 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049051957, 2024-09-13T06:41:25.823 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:25.823 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:25.823 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:25.823 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:25.823 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:25.823 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 22033 2024-09-13T06:41:25.823 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:25.823 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:25.823 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:25.823 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:25.823 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.896824+0000", 2024-09-13T06:41:25.823 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:25.824 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:25.824 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:25.824 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:25.824 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.896824+0000", 2024-09-13T06:41:25.824 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:25.824 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:25.824 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:25.824 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:25.824 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.896824+0000", 2024-09-13T06:41:25.824 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:25.824 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:25.824 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:25.824 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:25.824 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.896826+0000", 2024-09-13T06:41:25.825 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1900000000000002e-06 2024-09-13T06:41:25.825 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:25.825 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:25.825 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:25.825 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.896832+0000", 2024-09-13T06:41:25.825 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.2689999999999996e-06 2024-09-13T06:41:25.825 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:25.825 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:25.825 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:25.825 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.896840+0000", 2024-09-13T06:41:25.825 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3289999999999996e-06 2024-09-13T06:41:25.825 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:25.825 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:25.825 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:25.825 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.945777+0000", 2024-09-13T06:41:25.826 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.048937188 2024-09-13T06:41:25.826 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:25.826 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:25.826 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:25.826 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.945822+0000", 2024-09-13T06:41:25.826 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4780999999999997e-05 2024-09-13T06:41:25.826 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:25.826 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:25.826 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:25.826 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.945876+0000", 2024-09-13T06:41:25.826 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.4542000000000001e-05 2024-09-13T06:41:25.826 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:25.826 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:25.826 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:25.827 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:25.827 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:25.827 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:22338 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 13611008~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:41:25.827 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.951070+0000", 2024-09-13T06:41:25.827 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 92.807963962000002, 2024-09-13T06:41:25.827 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049135817999999998, 2024-09-13T06:41:25.827 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:25.827 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:25.827 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:25.827 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:25.827 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:25.827 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 22338 2024-09-13T06:41:25.827 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:25.828 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:25.828 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:25.828 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:25.828 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951070+0000", 2024-09-13T06:41:25.828 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:25.828 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:25.828 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:25.828 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:25.828 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951070+0000", 2024-09-13T06:41:25.828 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:25.828 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:25.828 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:25.828 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:25.829 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951069+0000", 2024-09-13T06:41:25.829 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:25.829 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:25.829 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:25.829 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:25.829 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951072+0000", 2024-09-13T06:41:25.829 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5909999999999998e-06 2024-09-13T06:41:25.829 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:25.829 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:25.829 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:25.829 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951078+0000", 2024-09-13T06:41:25.829 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.4450000000000001e-06 2024-09-13T06:41:25.829 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:25.829 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:25.830 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:25.830 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951083+0000", 2024-09-13T06:41:25.830 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7790000000000003e-06 2024-09-13T06:41:25.830 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:25.830 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:25.830 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:25.830 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:53.000020+0000", 2024-09-13T06:41:25.830 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.048936999000000002 2024-09-13T06:41:25.830 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:25.830 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:25.830 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:25.830 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:53.000106+0000", 2024-09-13T06:41:25.830 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.5532999999999996e-05 2024-09-13T06:41:25.830 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:25.831 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:25.831 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:25.831 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:53.000206+0000", 2024-09-13T06:41:25.831 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.9852999999999994e-05 2024-09-13T06:41:25.831 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:25.831 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:25.831 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:25.831 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:25.831 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:25.831 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:22339 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 13639680~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:41:25.831 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.951088+0000", 2024-09-13T06:41:25.831 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 92.807946263999995, 2024-09-13T06:41:25.831 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049238202000000002, 2024-09-13T06:41:25.831 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:25.831 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:25.832 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:25.832 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:25.832 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:25.832 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 22339 2024-09-13T06:41:25.832 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:25.832 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:25.832 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:25.832 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:25.832 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951088+0000", 2024-09-13T06:41:25.832 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:25.832 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:25.832 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:25.832 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:25.832 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951088+0000", 2024-09-13T06:41:25.833 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:25.833 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:25.833 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:25.833 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:25.833 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951087+0000", 2024-09-13T06:41:25.833 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:25.833 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:25.833 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:25.833 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:25.833 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951089+0000", 2024-09-13T06:41:25.833 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.153e-06 2024-09-13T06:41:25.833 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:25.834 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:25.834 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:25.834 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951093+0000", 2024-09-13T06:41:25.834 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.7120000000000002e-06 2024-09-13T06:41:25.834 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:25.834 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:25.834 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:25.834 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951096+0000", 2024-09-13T06:41:25.834 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.0570000000000001e-06 2024-09-13T06:41:25.834 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:25.834 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:25.834 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:25.834 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:53.000220+0000", 2024-09-13T06:41:25.834 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049123989 2024-09-13T06:41:25.834 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:25.835 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:25.835 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:25.835 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:53.000271+0000", 2024-09-13T06:41:25.835 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.062e-05 2024-09-13T06:41:25.835 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:25.835 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:25.835 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:25.835 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:53.000326+0000", 2024-09-13T06:41:25.835 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.5121000000000003e-05 2024-09-13T06:41:25.835 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:25.835 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:25.835 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:25.835 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:25.835 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:25.835 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:22340 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 13668352~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:41:25.836 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.951200+0000", 2024-09-13T06:41:25.836 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 92.807833375000001, 2024-09-13T06:41:25.836 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049352350000000003, 2024-09-13T06:41:25.836 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:25.836 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:25.836 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:25.836 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:25.836 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:25.836 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 22340 2024-09-13T06:41:25.836 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:25.836 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:25.836 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:25.836 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:25.836 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951200+0000", 2024-09-13T06:41:25.837 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:25.837 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:25.837 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:25.837 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:25.837 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951200+0000", 2024-09-13T06:41:25.837 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:25.837 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:25.837 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:25.837 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:25.837 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951098+0000", 2024-09-13T06:41:25.837 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.999898 2024-09-13T06:41:25.837 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:25.837 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:25.837 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:25.838 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951204+0000", 2024-09-13T06:41:25.838 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000105398 2024-09-13T06:41:25.838 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:25.838 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:25.838 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:25.838 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951211+0000", 2024-09-13T06:41:25.838 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.43e-06 2024-09-13T06:41:25.838 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:25.838 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:25.839 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:25.839 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951216+0000", 2024-09-13T06:41:25.839 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2800000000000003e-06 2024-09-13T06:41:25.839 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:25.839 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:25.839 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:25.839 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:53.000358+0000", 2024-09-13T06:41:25.839 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049142036 2024-09-13T06:41:25.839 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:25.839 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:25.839 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:25.839 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:53.000443+0000", 2024-09-13T06:41:25.839 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.4710999999999996e-05 2024-09-13T06:41:25.840 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:25.840 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:25.840 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:25.840 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:53.000553+0000", 2024-09-13T06:41:25.840 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000109622 2024-09-13T06:41:25.840 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:25.840 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:25.840 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:25.840 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:25.840 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:25.840 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:22348 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 13897728~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:41:25.840 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.952783+0000", 2024-09-13T06:41:25.840 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 92.806250586999994, 2024-09-13T06:41:25.840 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049120832000000003, 2024-09-13T06:41:25.841 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:25.841 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:25.841 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:25.841 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:25.841 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:25.841 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 22348 2024-09-13T06:41:25.841 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:25.841 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:25.841 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:25.841 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:25.841 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.952783+0000", 2024-09-13T06:41:25.841 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:25.841 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:25.841 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:25.842 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:25.842 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.952783+0000", 2024-09-13T06:41:25.842 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:25.842 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:25.842 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:25.842 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:25.842 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.952783+0000", 2024-09-13T06:41:25.842 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:25.842 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:25.842 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:25.842 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:25.842 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.952785+0000", 2024-09-13T06:41:25.842 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4980000000000001e-06 2024-09-13T06:41:25.842 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:25.843 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:25.843 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:25.843 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.952799+0000", 2024-09-13T06:41:25.843 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3825000000000001e-05 2024-09-13T06:41:25.843 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:25.843 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:25.843 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:25.843 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.952809+0000", 2024-09-13T06:41:25.843 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0043e-05 2024-09-13T06:41:25.843 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:25.843 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:25.843 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:25.843 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:53.001723+0000", 2024-09-13T06:41:25.843 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.048914065 2024-09-13T06:41:25.843 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:25.844 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:25.844 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:25.844 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:53.001807+0000", 2024-09-13T06:41:25.844 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.3776000000000006e-05 2024-09-13T06:41:25.844 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:25.844 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:25.844 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:25.844 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:53.001904+0000", 2024-09-13T06:41:25.844 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.7004999999999997e-05 2024-09-13T06:41:25.844 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:25.844 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:25.844 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:25.844 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:25.845 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:25.845 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:69045 3.0 3:05ea3821:::rbd_data.1121867cc19b.0000000000000000:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109)", 2024-09-13T06:41:25.845 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:41:03.637760+0000", 2024-09-13T06:41:25.845 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 22.121273829, 2024-09-13T06:41:25.845 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.052276712000000003, 2024-09-13T06:41:25.845 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:25.845 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:41:25.845 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:25.845 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:25.845 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:25.845 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 69045 2024-09-13T06:41:25.845 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:25.845 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:25.845 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:25.846 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:25.846 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:03.637760+0000", 2024-09-13T06:41:25.846 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:25.846 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:25.846 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:25.846 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:25.846 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:03.637760+0000", 2024-09-13T06:41:25.846 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:25.846 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:25.846 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:25.846 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:25.846 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:03.637758+0000", 2024-09-13T06:41:25.846 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999981 2024-09-13T06:41:25.846 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:25.847 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:25.847 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:25.847 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:03.637770+0000", 2024-09-13T06:41:25.847 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1533e-05 2024-09-13T06:41:25.847 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:25.847 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:25.847 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:25.847 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:03.637794+0000", 2024-09-13T06:41:25.847 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4243000000000002e-05 2024-09-13T06:41:25.847 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:25.847 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:25.847 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:25.847 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:03.637806+0000", 2024-09-13T06:41:25.847 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2033e-05 2024-09-13T06:41:25.847 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:25.848 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:25.848 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:25.848 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:03.637891+0000", 2024-09-13T06:41:25.848 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.5358000000000005e-05 2024-09-13T06:41:25.848 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:25.848 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:25.848 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:25.848 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:03.638042+0000", 2024-09-13T06:41:25.848 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000151073 2024-09-13T06:41:25.848 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:25.848 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:25.848 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 2", 2024-09-13T06:41:25.848 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:03.647124+0000", 2024-09-13T06:41:25.848 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0090821670000000004 2024-09-13T06:41:25.848 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:25.849 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:25.849 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:41:25.849 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:03.689849+0000", 2024-09-13T06:41:25.849 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.042724445999999999 2024-09-13T06:41:25.849 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:25.849 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:25.849 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-09-13T06:41:25.849 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:03.689871+0000", 2024-09-13T06:41:25.849 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1778999999999999e-05 2024-09-13T06:41:25.849 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:25.849 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:25.849 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:41:25.850 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:03.689965+0000", 2024-09-13T06:41:25.850 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.4312000000000001e-05 2024-09-13T06:41:25.850 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:25.850 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:25.850 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:25.850 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:03.690037+0000", 2024-09-13T06:41:25.850 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.1687999999999995e-05 2024-09-13T06:41:25.850 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:25.852 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:25.852 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:25.852 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:25.852 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:25.852 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:41:25.853 INFO:teuthology.orchestra.run.smithi081.stdout:3512 write 0x8257599 thru 0x82674a8 (0xff10 bytes) 2024-09-13T06:41:25.854 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-13T06:41:25.855 INFO:teuthology.orchestra.run.smithi081.stdout:3513 read 0x2a3fa8c thru 0x2a49f7b (0xa4f0 bytes) 2024-09-13T06:41:25.855 INFO:teuthology.orchestra.run.smithi081.stdout:3514 read 0x3205b0f thru 0x3208c01 (0x30f3 bytes) 2024-09-13T06:41:25.855 INFO:teuthology.orchestra.run.smithi081.stdout:3515 write 0xd958b04 thru 0xd95ed5d (0x625a bytes) 2024-09-13T06:41:25.855 INFO:teuthology.orchestra.run.smithi081.stdout:3518 punch from 0x551ba58 to 0x55270fa, (0xb6a2 bytes) 2024-09-13T06:41:25.855 INFO:teuthology.orchestra.run.smithi081.stdout:3519 write 0x8a0ab55 thru 0x8a11393 (0x683f bytes) 2024-09-13T06:41:25.855 INFO:teuthology.orchestra.run.smithi081.stdout:3520 write 0xc6220c6 thru 0xc63191d (0xf858 bytes) 2024-09-13T06:41:25.855 INFO:teuthology.orchestra.run.smithi081.stdout:3521 write 0x9da340a thru 0x9dabffd (0x8bf4 bytes) 2024-09-13T06:41:25.855 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:41:25.850+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:41:25.864 INFO:teuthology.orchestra.run.smithi081.stdout:3522 trunc from 0xd95ed5e to 0x2eec701 2024-09-13T06:41:25.897 INFO:teuthology.orchestra.run.smithi081.stdout:3524 write 0x23f64e9 thru 0x23ff8c4 (0x93dc bytes) 2024-09-13T06:41:25.901 INFO:teuthology.orchestra.run.smithi081.stdout:3525 punch from 0x1ca3a6e to 0x1ca58d6, (0x1e68 bytes) 2024-09-13T06:41:25.901 INFO:teuthology.orchestra.run.smithi081.stdout:3526 trunc from 0x2eec701 to 0x28d4baf 2024-09-13T06:41:25.916 INFO:teuthology.orchestra.run.smithi081.stdout:3527 read 0x1b0dcc4 thru 0x1b158b9 (0x7bf6 bytes) 2024-09-13T06:41:25.917 INFO:teuthology.orchestra.run.smithi081.stdout:3528 punch from 0xe27d7f to 0xe29262, (0x14e3 bytes) 2024-09-13T06:41:25.917 INFO:teuthology.orchestra.run.smithi081.stdout:3529 writesame 0x11bb52f thru 0x11c8aa1 data_size 0x1(0xd573 bytes) 2024-09-13T06:41:25.955 INFO:tasks.ceph.osd.6.smithi139.stderr:2024-09-13T06:41:25.951+0000 7fcd02c5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26385) UID: 0 2024-09-13T06:41:25.970 INFO:teuthology.orchestra.run.smithi081.stdout:3530 write 0xd70887d thru 0xd70a864 (0x1fe8 bytes) 2024-09-13T06:41:25.976 INFO:teuthology.orchestra.run.smithi081.stdout:3531 write 0x4a7d6d8 thru 0x4a7f142 (0x1a6b bytes) 2024-09-13T06:41:25.981 INFO:teuthology.orchestra.run.smithi081.stdout:3532 writesame 0x74822a8 thru 0x748ec8b data_size 0x49(0xc9e4 bytes) 2024-09-13T06:41:25.993 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:41:25.993 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-13T06:41:25.993 INFO:teuthology.orchestra.run.smithi081.stdout: "num_ops": 0 2024-09-13T06:41:25.993 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:41:25.998 INFO:teuthology.orchestra.run.smithi081.stdout:3533 trunc from 0xd70a865 to 0xe474f48 2024-09-13T06:41:26.010 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-13T06:41:26.011 INFO:teuthology.orchestra.run.smithi081.stdout:3534 write 0x86c2d35 thru 0x86c9ecc (0x7198 bytes) 2024-09-13T06:41:26.021 INFO:teuthology.orchestra.run.smithi081.stdout:3535 write 0x4d2c7e thru 0x4d52b0 (0x2633 bytes) 2024-09-13T06:41:26.024 INFO:teuthology.orchestra.run.smithi081.stdout:3536 punch from 0x67d0d3c to 0x67db092, (0xa356 bytes) 2024-09-13T06:41:26.031 INFO:teuthology.orchestra.run.smithi081.stdout:3537 trunc from 0xe474f48 to 0xa1c2e41 2024-09-13T06:41:26.056 INFO:teuthology.orchestra.run.smithi081.stdout:3538 writesame 0x147ac47 thru 0x14825f5 data_size 0x1(0x79af bytes) 2024-09-13T06:41:26.057 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:41:26.055+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:41:26.066 INFO:teuthology.orchestra.run.smithi081.stdout:3539 write 0x22b0213 thru 0x22b92af (0x909d bytes) 2024-09-13T06:41:26.070 INFO:teuthology.orchestra.run.smithi081.stdout:3540 writesame 0x221e529 thru 0x2223055 data_size 0x5(0x4b2d bytes) 2024-09-13T06:41:26.073 INFO:teuthology.orchestra.run.smithi081.stdout:3541 trunc from 0xa1c2e41 to 0x9fc0f41 2024-09-13T06:41:26.084 INFO:teuthology.orchestra.run.smithi081.stdout:3545 clone 22 order 18 su 16384 sc 15 2024-09-13T06:41:26.137 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:41:26.138 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-13T06:41:26.138 INFO:teuthology.orchestra.run.smithi081.stdout: "complaint_time": 30, 2024-09-13T06:41:26.138 INFO:teuthology.orchestra.run.smithi081.stdout: "num_blocked_ops": 0 2024-09-13T06:41:26.138 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:41:26.152 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-13T06:41:26.157 INFO:tasks.ceph.osd.6.smithi139.stderr:2024-09-13T06:41:26.155+0000 7fcd02c5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26385) UID: 0 2024-09-13T06:41:26.259 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:41:26.255+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:41:26.318 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:41:26.318 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 20, 2024-09-13T06:41:26.318 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 600, 2024-09-13T06:41:26.318 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [ 2024-09-13T06:41:26.318 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.318 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:36160 3.f 3:f62782c2:::rbd_object_map.11219660270d.0000000000000016:head [call] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-13T06:41:26.318 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:01.607291+0000", 2024-09-13T06:41:26.319 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 84.709493465999998, 2024-09-13T06:41:26.319 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.99619456699999998, 2024-09-13T06:41:26.319 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:26.319 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:26.319 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:26.319 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:26.319 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:26.319 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 36160 2024-09-13T06:41:26.319 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.319 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:26.319 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.319 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:26.319 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:01.607291+0000", 2024-09-13T06:41:26.320 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:26.320 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.320 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.320 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:26.320 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:01.607291+0000", 2024-09-13T06:41:26.320 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:26.320 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.320 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.320 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:26.320 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:01.607289+0000", 2024-09-13T06:41:26.320 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999976 2024-09-13T06:41:26.320 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.320 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.321 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:26.321 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:01.607302+0000", 2024-09-13T06:41:26.321 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3018e-05 2024-09-13T06:41:26.321 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.321 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.321 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:26.321 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:01.607323+0000", 2024-09-13T06:41:26.321 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1030999999999999e-05 2024-09-13T06:41:26.321 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.321 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.321 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:26.321 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:01.607342+0000", 2024-09-13T06:41:26.322 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8961e-05 2024-09-13T06:41:26.322 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.322 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.322 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:26.322 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:01.607425+0000", 2024-09-13T06:41:26.322 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.3171999999999996e-05 2024-09-13T06:41:26.322 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.322 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.322 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:41:26.322 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:01.607441+0000", 2024-09-13T06:41:26.322 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5996999999999999e-05 2024-09-13T06:41:26.322 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.322 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.322 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:26.323 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:02.596186+0000", 2024-09-13T06:41:26.323 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.98874432000000001 2024-09-13T06:41:26.323 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.323 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.323 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for missing object", 2024-09-13T06:41:26.323 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:02.596618+0000", 2024-09-13T06:41:26.323 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000432032 2024-09-13T06:41:26.323 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.323 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.323 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:26.323 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:02.600845+0000", 2024-09-13T06:41:26.323 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0042277410000000001 2024-09-13T06:41:26.324 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.324 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.324 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:26.324 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:02.601003+0000", 2024-09-13T06:41:26.324 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00015731999999999999 2024-09-13T06:41:26.324 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.324 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.324 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:26.324 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:02.603486+0000", 2024-09-13T06:41:26.324 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0024832510000000001 2024-09-13T06:41:26.324 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:26.324 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:26.325 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:26.325 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.325 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.325 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:37806 3.9 3:951cb95b:::rbd_data.1121d8143c6e.0000000000000002:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e56)", 2024-09-13T06:41:26.325 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:06.373482+0000", 2024-09-13T06:41:26.325 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 79.943302430000003, 2024-09-13T06:41:26.325 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.002476213, 2024-09-13T06:41:26.325 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:26.325 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:26.325 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:26.325 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:26.325 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:26.325 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 37806 2024-09-13T06:41:26.326 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.326 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:26.326 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.326 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:26.326 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.373482+0000", 2024-09-13T06:41:26.326 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:26.326 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.326 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.326 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:26.326 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.373482+0000", 2024-09-13T06:41:26.326 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:26.326 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.327 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.327 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:26.327 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.373479+0000", 2024-09-13T06:41:26.327 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999962 2024-09-13T06:41:26.327 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.327 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.327 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:26.327 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.373495+0000", 2024-09-13T06:41:26.327 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6640999999999999e-05 2024-09-13T06:41:26.327 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.327 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.327 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:26.327 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.373542+0000", 2024-09-13T06:41:26.327 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6229000000000001e-05 2024-09-13T06:41:26.328 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.328 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.328 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:26.328 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.373564+0000", 2024-09-13T06:41:26.328 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2684000000000002e-05 2024-09-13T06:41:26.328 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.328 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.328 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:26.328 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374268+0000", 2024-09-13T06:41:26.328 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00070363700000000001 2024-09-13T06:41:26.328 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.328 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.328 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:41:26.329 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374305+0000", 2024-09-13T06:41:26.329 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.6936e-05 2024-09-13T06:41:26.329 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.329 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.329 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:26.329 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.375175+0000", 2024-09-13T06:41:26.329 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.000870454 2024-09-13T06:41:26.329 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.329 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.329 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:26.329 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.375678+0000", 2024-09-13T06:41:26.329 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00050292499999999999 2024-09-13T06:41:26.329 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.330 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.330 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:26.330 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.375959+0000", 2024-09-13T06:41:26.330 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00028050599999999997 2024-09-13T06:41:26.330 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:26.330 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:26.330 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:26.330 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.330 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.330 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:37821 3.9 3:951cb95b:::rbd_data.1121d8143c6e.0000000000000002:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e56)", 2024-09-13T06:41:26.330 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:06.374454+0000", 2024-09-13T06:41:26.330 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 79.942331312999997, 2024-09-13T06:41:26.330 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.002545072, 2024-09-13T06:41:26.331 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:26.331 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:26.331 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:26.331 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:26.331 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:26.331 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 37821 2024-09-13T06:41:26.331 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.331 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:26.331 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.331 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:26.331 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374454+0000", 2024-09-13T06:41:26.331 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:26.331 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.331 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.332 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:26.332 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374454+0000", 2024-09-13T06:41:26.332 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:26.332 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.332 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.332 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:26.332 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374452+0000", 2024-09-13T06:41:26.332 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999981 2024-09-13T06:41:26.332 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.332 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.332 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:26.332 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374463+0000", 2024-09-13T06:41:26.333 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0756e-05 2024-09-13T06:41:26.333 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.333 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.333 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:26.333 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374487+0000", 2024-09-13T06:41:26.333 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4887000000000001e-05 2024-09-13T06:41:26.333 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.333 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.333 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:26.333 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374504+0000", 2024-09-13T06:41:26.333 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6852000000000001e-05 2024-09-13T06:41:26.333 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.333 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.334 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:26.334 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374829+0000", 2024-09-13T06:41:26.334 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000324684 2024-09-13T06:41:26.334 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.334 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.334 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:41:26.334 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374880+0000", 2024-09-13T06:41:26.334 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.1378000000000002e-05 2024-09-13T06:41:26.334 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.334 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.334 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:26.334 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.376423+0000", 2024-09-13T06:41:26.335 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.001542734 2024-09-13T06:41:26.335 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.335 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.335 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:26.335 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.376607+0000", 2024-09-13T06:41:26.335 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000183656 2024-09-13T06:41:26.335 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.335 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.335 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:26.335 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.376999+0000", 2024-09-13T06:41:26.335 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00039191200000000001 2024-09-13T06:41:26.335 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:26.335 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:26.335 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:26.336 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.336 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.336 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:37836 3.9 3:951cb95b:::rbd_data.1121d8143c6e.0000000000000002:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e56)", 2024-09-13T06:41:26.336 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:06.374929+0000", 2024-09-13T06:41:26.336 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 79.941855661000005, 2024-09-13T06:41:26.336 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.002778825, 2024-09-13T06:41:26.336 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:26.336 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:26.336 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:26.336 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:26.336 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:26.336 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 37836 2024-09-13T06:41:26.337 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.337 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:26.337 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.337 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:26.337 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374929+0000", 2024-09-13T06:41:26.337 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:26.337 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.337 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.337 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:26.337 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374929+0000", 2024-09-13T06:41:26.337 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:26.337 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.337 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.337 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:26.338 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374927+0000", 2024-09-13T06:41:26.338 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999981 2024-09-13T06:41:26.338 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.338 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.338 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:26.338 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374939+0000", 2024-09-13T06:41:26.338 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1846e-05 2024-09-13T06:41:26.338 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.338 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.338 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:26.338 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374962+0000", 2024-09-13T06:41:26.338 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3054e-05 2024-09-13T06:41:26.338 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.339 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.339 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:26.339 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374978+0000", 2024-09-13T06:41:26.339 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5899000000000001e-05 2024-09-13T06:41:26.339 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.339 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.339 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:26.339 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.375106+0000", 2024-09-13T06:41:26.339 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00012789 2024-09-13T06:41:26.339 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.339 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.339 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:41:26.339 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.375134+0000", 2024-09-13T06:41:26.339 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.8254000000000001e-05 2024-09-13T06:41:26.340 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.340 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.340 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:26.340 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.377082+0000", 2024-09-13T06:41:26.340 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0019471520000001 2024-09-13T06:41:26.340 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.340 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.340 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:26.340 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.377330+0000", 2024-09-13T06:41:26.341 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00024834199999999997 2024-09-13T06:41:26.341 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.341 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.341 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:26.341 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.377708+0000", 2024-09-13T06:41:26.341 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00037817100000000001 2024-09-13T06:41:26.341 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:26.341 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:26.341 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:26.341 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.341 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.341 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:37851 3.9 3:951cb95b:::rbd_data.1121d8143c6e.0000000000000002:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e56)", 2024-09-13T06:41:26.341 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:06.382636+0000", 2024-09-13T06:41:26.342 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 79.934148776000001, 2024-09-13T06:41:26.342 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.99582539400000003, 2024-09-13T06:41:26.342 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:26.342 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:26.342 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:26.342 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:26.342 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:26.342 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 37851 2024-09-13T06:41:26.342 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.342 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:26.342 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.342 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:26.342 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.382636+0000", 2024-09-13T06:41:26.343 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:26.343 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.343 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.343 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:26.343 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.382636+0000", 2024-09-13T06:41:26.343 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:26.343 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.343 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.343 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:26.343 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.382633+0000", 2024-09-13T06:41:26.343 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999971 2024-09-13T06:41:26.343 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.343 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.343 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:26.344 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.382652+0000", 2024-09-13T06:41:26.344 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8834999999999998e-05 2024-09-13T06:41:26.344 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.344 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.344 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:26.344 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.382695+0000", 2024-09-13T06:41:26.344 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.3136000000000002e-05 2024-09-13T06:41:26.344 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.344 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.344 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:26.344 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.382716+0000", 2024-09-13T06:41:26.344 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1421e-05 2024-09-13T06:41:26.344 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.344 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.345 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:26.345 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.382860+0000", 2024-09-13T06:41:26.345 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00014389200000000001 2024-09-13T06:41:26.345 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.345 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.345 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:41:26.345 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.382890+0000", 2024-09-13T06:41:26.345 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9827000000000001e-05 2024-09-13T06:41:26.345 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.345 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.345 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:26.345 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.377779+0000", 2024-09-13T06:41:26.345 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.99488842899999996 2024-09-13T06:41:26.345 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.346 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.346 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:26.346 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.378007+0000", 2024-09-13T06:41:26.346 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00022838099999999999 2024-09-13T06:41:26.346 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.346 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.346 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:26.346 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.378462+0000", 2024-09-13T06:41:26.346 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00045452300000000003 2024-09-13T06:41:26.346 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:26.346 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:26.346 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:26.346 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.346 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.347 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:37866 3.9 3:951cb95b:::rbd_data.1121d8143c6e.0000000000000002:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e56)", 2024-09-13T06:41:26.347 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:06.383951+0000", 2024-09-13T06:41:26.347 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 79.93283409, 2024-09-13T06:41:26.347 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.99517962299999996, 2024-09-13T06:41:26.347 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:26.347 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:26.347 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:26.347 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:26.347 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:26.347 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 37866 2024-09-13T06:41:26.347 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.347 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:26.347 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.347 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:26.347 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.383951+0000", 2024-09-13T06:41:26.348 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:26.348 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.348 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.348 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:26.348 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.383951+0000", 2024-09-13T06:41:26.348 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:26.348 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.348 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.348 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:26.348 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.383949+0000", 2024-09-13T06:41:26.348 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999981 2024-09-13T06:41:26.348 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.348 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.348 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:26.349 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.383961+0000", 2024-09-13T06:41:26.349 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1999e-05 2024-09-13T06:41:26.349 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.349 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.349 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:26.349 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384019+0000", 2024-09-13T06:41:26.349 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7621000000000003e-05 2024-09-13T06:41:26.349 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.349 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.349 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:26.349 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384040+0000", 2024-09-13T06:41:26.349 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1528000000000001e-05 2024-09-13T06:41:26.349 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.350 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.350 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:26.350 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384186+0000", 2024-09-13T06:41:26.350 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00014573799999999999 2024-09-13T06:41:26.350 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.350 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.350 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:41:26.350 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384204+0000", 2024-09-13T06:41:26.350 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7992e-05 2024-09-13T06:41:26.350 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.350 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.350 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:26.350 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.378536+0000", 2024-09-13T06:41:26.351 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.99433268600000002 2024-09-13T06:41:26.351 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.351 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.351 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:26.351 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.378771+0000", 2024-09-13T06:41:26.351 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00023445399999999999 2024-09-13T06:41:26.351 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.351 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.351 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:26.351 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.379130+0000", 2024-09-13T06:41:26.351 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00035954200000000002 2024-09-13T06:41:26.351 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:26.351 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:26.352 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:26.352 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.352 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.352 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:37881 3.9 3:951cb95b:::rbd_data.1121d8143c6e.0000000000000002:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e56)", 2024-09-13T06:41:26.352 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:06.384239+0000", 2024-09-13T06:41:26.352 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 79.932545676000004, 2024-09-13T06:41:26.352 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.99541483500000005, 2024-09-13T06:41:26.352 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:26.352 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:26.352 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:26.352 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:26.352 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:26.352 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 37881 2024-09-13T06:41:26.353 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.353 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:26.353 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.353 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:26.353 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384239+0000", 2024-09-13T06:41:26.353 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:26.353 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.353 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.353 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:26.353 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384239+0000", 2024-09-13T06:41:26.353 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:26.353 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.353 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.354 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:26.354 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384238+0000", 2024-09-13T06:41:26.354 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999986 2024-09-13T06:41:26.354 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.354 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.354 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:26.354 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384246+0000", 2024-09-13T06:41:26.354 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.2449999999999998e-06 2024-09-13T06:41:26.354 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.354 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.355 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:26.355 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384268+0000", 2024-09-13T06:41:26.355 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1518e-05 2024-09-13T06:41:26.355 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.355 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.355 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:26.355 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384282+0000", 2024-09-13T06:41:26.355 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4501999999999999e-05 2024-09-13T06:41:26.355 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.355 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.355 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:26.355 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384356+0000", 2024-09-13T06:41:26.355 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4265999999999997e-05 2024-09-13T06:41:26.356 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.356 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.356 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:41:26.356 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384370+0000", 2024-09-13T06:41:26.356 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3942e-05 2024-09-13T06:41:26.356 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.356 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.356 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:26.356 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.379199+0000", 2024-09-13T06:41:26.356 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.99482866599999997 2024-09-13T06:41:26.356 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.356 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.356 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:26.356 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.379347+0000", 2024-09-13T06:41:26.357 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00014749199999999999 2024-09-13T06:41:26.357 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.357 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.357 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:26.357 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.379654+0000", 2024-09-13T06:41:26.357 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00030752999999999998 2024-09-13T06:41:26.357 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:26.357 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:26.357 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:26.357 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.357 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.357 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:37896 3.9 3:951cb95b:::rbd_data.1121d8143c6e.0000000000000002:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e56)", 2024-09-13T06:41:26.357 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:06.384412+0000", 2024-09-13T06:41:26.358 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 79.932373243000001, 2024-09-13T06:41:26.358 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.99777835999999998, 2024-09-13T06:41:26.358 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:26.358 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:26.358 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:26.358 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:26.358 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:26.358 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 37896 2024-09-13T06:41:26.358 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.358 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:26.358 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.358 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:26.358 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384412+0000", 2024-09-13T06:41:26.358 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:26.359 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.359 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.359 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:26.359 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384412+0000", 2024-09-13T06:41:26.359 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:26.359 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.359 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.359 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:26.359 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384410+0000", 2024-09-13T06:41:26.359 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.999999 2024-09-13T06:41:26.359 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.359 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.359 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:26.360 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384418+0000", 2024-09-13T06:41:26.360 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.486e-06 2024-09-13T06:41:26.360 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.360 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.360 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:26.360 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384436+0000", 2024-09-13T06:41:26.360 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7668000000000001e-05 2024-09-13T06:41:26.360 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.360 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.360 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:26.360 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384449+0000", 2024-09-13T06:41:26.360 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3395e-05 2024-09-13T06:41:26.360 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.361 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.361 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:26.361 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384605+0000", 2024-09-13T06:41:26.361 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00015563099999999999 2024-09-13T06:41:26.361 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.361 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.361 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:41:26.361 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384635+0000", 2024-09-13T06:41:26.361 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.0383999999999999e-05 2024-09-13T06:41:26.361 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.361 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.361 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:26.362 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.379730+0000", 2024-09-13T06:41:26.362 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.99509493999999998 2024-09-13T06:41:26.362 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.362 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.362 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:26.362 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.379964+0000", 2024-09-13T06:41:26.362 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00023353499999999999 2024-09-13T06:41:26.362 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.362 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.362 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:26.362 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.382190+0000", 2024-09-13T06:41:26.362 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0022265039999999998 2024-09-13T06:41:26.362 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:26.362 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:26.363 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:26.363 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.363 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.363 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43222 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 389120~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:26.363 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558181+0000", 2024-09-13T06:41:26.363 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 64.758603988999994, 2024-09-13T06:41:26.363 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.06252038, 2024-09-13T06:41:26.363 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:26.363 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:26.363 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:26.363 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:26.364 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:26.364 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43222 2024-09-13T06:41:26.364 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.364 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:26.364 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.364 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:26.364 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558181+0000", 2024-09-13T06:41:26.364 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:26.364 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.364 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.364 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:26.364 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558181+0000", 2024-09-13T06:41:26.365 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:26.365 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.365 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.365 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:26.365 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558181+0000", 2024-09-13T06:41:26.365 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:26.365 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.365 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.365 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:26.365 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558183+0000", 2024-09-13T06:41:26.365 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.857e-06 2024-09-13T06:41:26.365 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.365 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.366 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:26.366 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558188+0000", 2024-09-13T06:41:26.366 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3759999999999999e-06 2024-09-13T06:41:26.366 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.366 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.366 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:26.366 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558261+0000", 2024-09-13T06:41:26.366 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3097999999999997e-05 2024-09-13T06:41:26.366 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.366 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.366 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:26.366 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.620354+0000", 2024-09-13T06:41:26.366 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.062092587999999997 2024-09-13T06:41:26.366 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.366 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.367 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:26.367 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.620428+0000", 2024-09-13T06:41:26.367 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3954000000000004e-05 2024-09-13T06:41:26.367 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.367 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.367 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:26.367 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.620701+0000", 2024-09-13T06:41:26.367 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000273773 2024-09-13T06:41:26.367 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:26.367 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:26.367 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:26.367 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.367 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.368 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43223 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 393216~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:26.368 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558267+0000", 2024-09-13T06:41:26.368 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 64.758517932000004, 2024-09-13T06:41:26.368 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.062813151999999997, 2024-09-13T06:41:26.368 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:26.368 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:26.368 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:26.368 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:26.368 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:26.368 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43223 2024-09-13T06:41:26.368 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.368 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:26.368 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.368 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:26.369 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558267+0000", 2024-09-13T06:41:26.369 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:26.369 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.369 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.369 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:26.369 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558267+0000", 2024-09-13T06:41:26.369 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:26.369 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.369 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.369 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:26.369 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558266+0000", 2024-09-13T06:41:26.369 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:26.369 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.369 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.370 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:26.370 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558270+0000", 2024-09-13T06:41:26.370 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.2389999999999998e-06 2024-09-13T06:41:26.370 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.370 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.370 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:26.370 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558277+0000", 2024-09-13T06:41:26.370 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5680000000000002e-06 2024-09-13T06:41:26.370 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.370 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.370 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:26.370 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558282+0000", 2024-09-13T06:41:26.370 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7060000000000003e-06 2024-09-13T06:41:26.371 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.371 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.371 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:26.371 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.620731+0000", 2024-09-13T06:41:26.371 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.062448661000000003 2024-09-13T06:41:26.371 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.371 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.371 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:26.371 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.620806+0000", 2024-09-13T06:41:26.371 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5862e-05 2024-09-13T06:41:26.371 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.371 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.371 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:26.371 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.621080+0000", 2024-09-13T06:41:26.371 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00027368599999999998 2024-09-13T06:41:26.372 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:26.372 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:26.372 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:26.372 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.372 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.372 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43224 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 407552~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:26.372 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558286+0000", 2024-09-13T06:41:26.372 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 64.758498567999993, 2024-09-13T06:41:26.372 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.063179052999999999, 2024-09-13T06:41:26.372 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:26.372 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:26.372 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:26.372 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:26.373 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:26.373 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43224 2024-09-13T06:41:26.373 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.373 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:26.373 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.373 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:26.373 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558286+0000", 2024-09-13T06:41:26.373 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:26.373 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.373 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.373 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:26.373 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558286+0000", 2024-09-13T06:41:26.373 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:26.374 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.374 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.374 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:26.374 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558286+0000", 2024-09-13T06:41:26.374 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:26.374 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.374 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.374 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:26.374 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558288+0000", 2024-09-13T06:41:26.374 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.227e-06 2024-09-13T06:41:26.374 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.374 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.374 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:26.374 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558292+0000", 2024-09-13T06:41:26.375 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.6289999999999999e-06 2024-09-13T06:41:26.375 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.375 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.375 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:26.375 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558294+0000", 2024-09-13T06:41:26.375 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5409999999999999e-06 2024-09-13T06:41:26.375 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.375 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.375 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:26.375 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.621110+0000", 2024-09-13T06:41:26.375 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.062815776000000004 2024-09-13T06:41:26.375 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.375 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.376 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:26.376 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.621186+0000", 2024-09-13T06:41:26.376 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5570999999999999e-05 2024-09-13T06:41:26.376 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.376 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.376 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:26.376 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.621465+0000", 2024-09-13T06:41:26.376 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00027988200000000001 2024-09-13T06:41:26.376 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:26.376 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:26.376 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:26.376 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.376 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.377 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43225 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 421888~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:26.377 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558296+0000", 2024-09-13T06:41:26.377 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 64.758488600999996, 2024-09-13T06:41:26.377 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.063551110999999993, 2024-09-13T06:41:26.377 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:26.377 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:26.377 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:26.377 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:26.377 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:26.377 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43225 2024-09-13T06:41:26.377 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.377 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:26.377 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.378 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:26.378 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558296+0000", 2024-09-13T06:41:26.378 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:26.378 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.378 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.378 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:26.378 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558296+0000", 2024-09-13T06:41:26.378 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:26.378 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.378 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.378 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:26.378 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558296+0000", 2024-09-13T06:41:26.378 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:41:26.379 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.379 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.379 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:26.379 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558305+0000", 2024-09-13T06:41:26.379 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.5290000000000008e-06 2024-09-13T06:41:26.379 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.379 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.379 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:26.379 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558308+0000", 2024-09-13T06:41:26.379 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.5619999999999999e-06 2024-09-13T06:41:26.379 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.379 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.379 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:26.380 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558311+0000", 2024-09-13T06:41:26.380 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.43e-06 2024-09-13T06:41:26.380 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.380 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.380 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:26.380 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.621495+0000", 2024-09-13T06:41:26.380 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.063184289000000005 2024-09-13T06:41:26.380 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.380 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.380 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:26.380 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.621569+0000", 2024-09-13T06:41:26.380 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4250000000000002e-05 2024-09-13T06:41:26.381 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.381 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.381 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:26.381 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.621847+0000", 2024-09-13T06:41:26.381 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00027826400000000002 2024-09-13T06:41:26.381 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:26.381 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:26.381 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:26.381 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.381 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.381 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43226 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 436224~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:26.381 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558313+0000", 2024-09-13T06:41:26.381 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 64.758471964999998, 2024-09-13T06:41:26.382 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.063914420999999999, 2024-09-13T06:41:26.382 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:26.382 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:26.382 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:26.382 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:26.382 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:26.382 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43226 2024-09-13T06:41:26.382 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.382 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:26.382 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.382 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:26.382 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558313+0000", 2024-09-13T06:41:26.382 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:26.383 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.383 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.383 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:26.383 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558313+0000", 2024-09-13T06:41:26.383 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:26.383 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.383 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.383 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:26.383 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558313+0000", 2024-09-13T06:41:26.383 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:26.383 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.383 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.383 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:26.383 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558314+0000", 2024-09-13T06:41:26.384 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3740000000000001e-06 2024-09-13T06:41:26.384 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.384 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.384 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:26.384 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558317+0000", 2024-09-13T06:41:26.384 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9730000000000002e-06 2024-09-13T06:41:26.384 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.384 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.384 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:26.384 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558319+0000", 2024-09-13T06:41:26.384 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4059999999999999e-06 2024-09-13T06:41:26.384 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.384 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.385 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:26.385 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.621877+0000", 2024-09-13T06:41:26.385 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.063557408999999995 2024-09-13T06:41:26.385 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.385 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.385 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:26.385 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.621951+0000", 2024-09-13T06:41:26.385 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4487999999999996e-05 2024-09-13T06:41:26.385 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.385 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.385 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:26.385 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.622227+0000", 2024-09-13T06:41:26.385 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000276011 2024-09-13T06:41:26.385 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:26.386 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:26.386 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:26.386 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.386 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.386 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43227 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 450560~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:26.386 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558322+0000", 2024-09-13T06:41:26.386 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 64.758463383999995, 2024-09-13T06:41:26.386 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.064285348000000006, 2024-09-13T06:41:26.386 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:26.386 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:26.386 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:26.386 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:26.386 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:26.386 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43227 2024-09-13T06:41:26.387 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.387 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:26.387 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.387 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:26.387 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558322+0000", 2024-09-13T06:41:26.387 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:26.387 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.387 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.387 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:26.387 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558322+0000", 2024-09-13T06:41:26.387 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:26.387 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.387 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.387 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:26.387 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558321+0000", 2024-09-13T06:41:26.387 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:41:26.388 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.388 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.388 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:26.388 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558323+0000", 2024-09-13T06:41:26.388 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.576e-06 2024-09-13T06:41:26.388 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.388 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.388 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:26.388 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558328+0000", 2024-09-13T06:41:26.388 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0719999999999999e-06 2024-09-13T06:41:26.388 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.388 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.388 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:26.388 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558332+0000", 2024-09-13T06:41:26.389 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.8130000000000002e-06 2024-09-13T06:41:26.389 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.389 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.389 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:26.389 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.622255+0000", 2024-09-13T06:41:26.389 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.063923195000000002 2024-09-13T06:41:26.389 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.389 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.389 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:26.389 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.622330+0000", 2024-09-13T06:41:26.389 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5383000000000007e-05 2024-09-13T06:41:26.389 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.389 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.389 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:26.390 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.622607+0000", 2024-09-13T06:41:26.390 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00027651999999999999 2024-09-13T06:41:26.390 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:26.390 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:26.390 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:26.390 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.390 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.390 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43228 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 464896~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:26.390 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558335+0000", 2024-09-13T06:41:26.390 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 64.758449475000006, 2024-09-13T06:41:26.390 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.064652253000000007, 2024-09-13T06:41:26.390 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:26.390 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:26.390 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:26.391 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:26.391 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:26.391 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43228 2024-09-13T06:41:26.391 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.391 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:26.391 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.391 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:26.391 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558335+0000", 2024-09-13T06:41:26.391 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:26.391 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.391 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.391 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:26.391 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558335+0000", 2024-09-13T06:41:26.392 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:26.392 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.392 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.392 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:26.392 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558335+0000", 2024-09-13T06:41:26.392 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:26.392 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.392 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.392 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:26.392 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558337+0000", 2024-09-13T06:41:26.392 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1380000000000001e-06 2024-09-13T06:41:26.392 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.392 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.393 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:26.393 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558343+0000", 2024-09-13T06:41:26.393 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.5140000000000001e-06 2024-09-13T06:41:26.393 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.393 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.393 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:26.393 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558348+0000", 2024-09-13T06:41:26.393 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9640000000000002e-06 2024-09-13T06:41:26.393 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.393 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.393 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:26.393 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.622636+0000", 2024-09-13T06:41:26.393 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.064288260999999999 2024-09-13T06:41:26.393 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.393 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.394 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:26.394 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.622715+0000", 2024-09-13T06:41:26.394 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.9351000000000006e-05 2024-09-13T06:41:26.394 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.394 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.394 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:26.394 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.622988+0000", 2024-09-13T06:41:26.394 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00027242599999999998 2024-09-13T06:41:26.394 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:26.394 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:26.394 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:26.394 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.394 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.395 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43229 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 479232~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:26.395 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558352+0000", 2024-09-13T06:41:26.395 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 64.758433060000002, 2024-09-13T06:41:26.395 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.065018024999999993, 2024-09-13T06:41:26.395 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:26.395 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:26.395 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:26.395 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:26.395 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:26.395 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43229 2024-09-13T06:41:26.395 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.395 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:26.395 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.396 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:26.396 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558352+0000", 2024-09-13T06:41:26.396 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:26.396 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.396 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.396 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:26.396 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558352+0000", 2024-09-13T06:41:26.396 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:26.396 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.396 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.396 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:26.396 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558352+0000", 2024-09-13T06:41:26.396 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:26.396 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.396 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.397 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:26.397 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558354+0000", 2024-09-13T06:41:26.397 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4930000000000001e-06 2024-09-13T06:41:26.397 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.397 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.397 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:26.397 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558360+0000", 2024-09-13T06:41:26.397 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.263e-06 2024-09-13T06:41:26.397 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.397 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.397 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:26.397 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558369+0000", 2024-09-13T06:41:26.397 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.0829999999999993e-06 2024-09-13T06:41:26.398 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.398 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.398 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:26.398 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.623017+0000", 2024-09-13T06:41:26.398 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.064647799000000006 2024-09-13T06:41:26.398 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.398 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.398 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:26.398 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.623090+0000", 2024-09-13T06:41:26.398 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3071000000000006e-05 2024-09-13T06:41:26.398 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.398 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.398 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:26.398 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.623370+0000", 2024-09-13T06:41:26.399 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000279661 2024-09-13T06:41:26.399 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:26.399 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:26.399 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:26.399 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.399 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.399 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43230 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 493568~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:26.399 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558374+0000", 2024-09-13T06:41:26.399 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 64.758410767000001, 2024-09-13T06:41:26.399 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.065410435000000003, 2024-09-13T06:41:26.399 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:26.399 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:26.399 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:26.400 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:26.400 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:26.400 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43230 2024-09-13T06:41:26.400 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.400 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:26.400 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.400 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:26.400 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558374+0000", 2024-09-13T06:41:26.400 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:26.400 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.400 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.400 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:26.401 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558374+0000", 2024-09-13T06:41:26.401 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:26.401 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.401 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.401 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:26.401 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558374+0000", 2024-09-13T06:41:26.401 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:26.401 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.401 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.401 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:26.401 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558376+0000", 2024-09-13T06:41:26.401 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4430000000000002e-06 2024-09-13T06:41:26.401 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.401 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.402 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:26.402 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558382+0000", 2024-09-13T06:41:26.402 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3029999999999996e-06 2024-09-13T06:41:26.402 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.402 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.402 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:26.402 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558387+0000", 2024-09-13T06:41:26.402 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.1699999999999999e-06 2024-09-13T06:41:26.402 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.402 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.402 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:26.402 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.623400+0000", 2024-09-13T06:41:26.402 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.065013244999999997 2024-09-13T06:41:26.402 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.403 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.403 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:26.403 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.623474+0000", 2024-09-13T06:41:26.403 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3889999999999999e-05 2024-09-13T06:41:26.403 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.403 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.403 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:26.403 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.623785+0000", 2024-09-13T06:41:26.403 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00031080099999999998 2024-09-13T06:41:26.403 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:26.403 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:26.403 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:26.403 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.403 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.404 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43231 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 507904~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:26.404 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558391+0000", 2024-09-13T06:41:26.404 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 64.758394081999995, 2024-09-13T06:41:26.404 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.065788597000000004, 2024-09-13T06:41:26.404 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:26.404 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:26.404 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:26.404 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:26.404 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:26.404 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43231 2024-09-13T06:41:26.404 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.404 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:26.404 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.404 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:26.405 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558391+0000", 2024-09-13T06:41:26.405 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:26.405 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.405 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.405 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:26.405 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558391+0000", 2024-09-13T06:41:26.405 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:26.405 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.405 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.405 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:26.405 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558390+0000", 2024-09-13T06:41:26.405 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:26.405 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.406 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.406 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:26.406 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558393+0000", 2024-09-13T06:41:26.406 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2570000000000002e-06 2024-09-13T06:41:26.406 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.406 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.406 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:26.406 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558399+0000", 2024-09-13T06:41:26.406 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0419999999999999e-06 2024-09-13T06:41:26.406 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.406 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.406 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:26.406 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558403+0000", 2024-09-13T06:41:26.407 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6249999999999998e-06 2024-09-13T06:41:26.407 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.407 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.407 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:26.407 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.623811+0000", 2024-09-13T06:41:26.407 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.065407549999999995 2024-09-13T06:41:26.407 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.407 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.407 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:26.407 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.623877+0000", 2024-09-13T06:41:26.407 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.5902999999999996e-05 2024-09-13T06:41:26.407 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.407 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.408 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:26.408 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.624179+0000", 2024-09-13T06:41:26.408 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00030259999999999998 2024-09-13T06:41:26.408 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:26.408 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:26.408 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:26.408 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.408 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.408 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43232 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 522240~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:26.408 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558422+0000", 2024-09-13T06:41:26.408 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 64.758363305000003, 2024-09-13T06:41:26.408 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.066176061999999994, 2024-09-13T06:41:26.409 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:26.409 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:26.409 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:26.409 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:26.409 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:26.409 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43232 2024-09-13T06:41:26.409 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.409 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:26.409 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.409 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:26.409 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558422+0000", 2024-09-13T06:41:26.409 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:26.409 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.410 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.410 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:26.410 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558422+0000", 2024-09-13T06:41:26.410 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:26.410 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.410 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.410 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:26.410 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558421+0000", 2024-09-13T06:41:26.410 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:26.410 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.410 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.410 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:26.410 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558428+0000", 2024-09-13T06:41:26.410 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.1690000000000003e-06 2024-09-13T06:41:26.411 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.411 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.411 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:26.411 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558434+0000", 2024-09-13T06:41:26.411 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9309999999999996e-06 2024-09-13T06:41:26.411 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.411 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.411 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:26.411 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558447+0000", 2024-09-13T06:41:26.411 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.271e-05 2024-09-13T06:41:26.411 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.411 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.411 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:26.411 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.624209+0000", 2024-09-13T06:41:26.412 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.065762102000000003 2024-09-13T06:41:26.412 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.412 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.412 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:26.412 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.624282+0000", 2024-09-13T06:41:26.412 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.2889e-05 2024-09-13T06:41:26.412 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.412 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.412 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:26.412 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.624598+0000", 2024-09-13T06:41:26.412 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00031591399999999998 2024-09-13T06:41:26.412 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:26.413 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:26.413 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:26.413 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.413 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.413 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43486 3.f 3:f7da9c8f:::rbd_data.1121f5f2e1c0.000000000000000b:1f [read 260096~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:26.413 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.569088+0000", 2024-09-13T06:41:26.413 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 64.747696582000003, 2024-09-13T06:41:26.413 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.062579223000000003, 2024-09-13T06:41:26.413 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:26.413 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:26.413 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:26.413 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:26.413 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:26.414 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43486 2024-09-13T06:41:26.414 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.414 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:26.414 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.414 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:26.414 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.569088+0000", 2024-09-13T06:41:26.414 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:26.414 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.414 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.414 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:26.414 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.569088+0000", 2024-09-13T06:41:26.414 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:26.414 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.415 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.415 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:26.415 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.569088+0000", 2024-09-13T06:41:26.415 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:26.415 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.415 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.415 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:26.415 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.569091+0000", 2024-09-13T06:41:26.415 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9629999999999998e-06 2024-09-13T06:41:26.415 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.415 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.415 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:26.416 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.569097+0000", 2024-09-13T06:41:26.416 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.4160000000000001e-06 2024-09-13T06:41:26.416 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.416 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.416 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:26.416 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.569102+0000", 2024-09-13T06:41:26.416 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6659999999999999e-06 2024-09-13T06:41:26.416 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.416 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.416 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:26.416 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.631346+0000", 2024-09-13T06:41:26.416 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.062243896 2024-09-13T06:41:26.416 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.417 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.417 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:26.417 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.631413+0000", 2024-09-13T06:41:26.417 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.7638000000000005e-05 2024-09-13T06:41:26.417 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.417 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.417 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:26.417 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.631668+0000", 2024-09-13T06:41:26.417 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0002541 2024-09-13T06:41:26.417 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:26.417 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:26.417 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:26.417 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:26.418 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:26.418 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:41:26.419 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-13T06:41:26.420 INFO:teuthology.orchestra.run.smithi081.stderr:noscrub is set 2024-09-13T06:41:26.420 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:41:26.418+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:41:26.519 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:41:26.518+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:41:26.586 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:41:26.587 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-13T06:41:26.587 INFO:teuthology.orchestra.run.smithi081.stdout: "num_ops": 0 2024-09-13T06:41:26.587 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:41:26.601 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-13T06:41:26.620 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:41:26.619+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:41:26.721 INFO:tasks.ceph.osd.6.smithi139.stderr:2024-09-13T06:41:26.719+0000 7fcd02c5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26385) UID: 0 2024-09-13T06:41:26.767 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:41:26.767 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-13T06:41:26.768 INFO:teuthology.orchestra.run.smithi081.stdout: "complaint_time": 30, 2024-09-13T06:41:26.768 INFO:teuthology.orchestra.run.smithi081.stdout: "num_blocked_ops": 0 2024-09-13T06:41:26.768 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:41:26.782 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-13T06:41:26.826 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:41:26.826+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:41:26.900 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:41:26.901 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 20, 2024-09-13T06:41:26.901 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 600, 2024-09-13T06:41:26.901 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [ 2024-09-13T06:41:26.901 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.901 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:2226 3.15 3:af026987:::rbd_data.112173e2f1b7.0000000000000017:head [sparse-read 0~4194304] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-13T06:41:26.901 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:37.606562+0000", 2024-09-13T06:41:26.901 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 109.29344063000001, 2024-09-13T06:41:26.901 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.83322091700000001, 2024-09-13T06:41:26.902 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:26.902 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:41:26.902 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:26.902 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:26.902 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:26.902 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 2226 2024-09-13T06:41:26.902 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.902 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:26.902 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.902 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:26.902 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606562+0000", 2024-09-13T06:41:26.902 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:26.903 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.903 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.903 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:26.903 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606562+0000", 2024-09-13T06:41:26.903 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:26.903 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.903 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.903 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:26.903 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606561+0000", 2024-09-13T06:41:26.903 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:26.903 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.903 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.903 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:26.904 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606565+0000", 2024-09-13T06:41:26.904 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.4379999999999999e-06 2024-09-13T06:41:26.904 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.904 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.904 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:26.904 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606569+0000", 2024-09-13T06:41:26.904 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.425e-06 2024-09-13T06:41:26.904 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.904 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.904 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:26.904 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606572+0000", 2024-09-13T06:41:26.904 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.05e-06 2024-09-13T06:41:26.904 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.904 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.904 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:26.905 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606621+0000", 2024-09-13T06:41:26.905 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.8723000000000001e-05 2024-09-13T06:41:26.905 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.905 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.905 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:41:26.905 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606630+0000", 2024-09-13T06:41:26.905 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.8040000000000007e-06 2024-09-13T06:41:26.905 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.905 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.905 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:26.905 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.439648+0000", 2024-09-13T06:41:26.905 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.83301824800000002 2024-09-13T06:41:26.906 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.906 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.906 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:26.906 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.439782+0000", 2024-09-13T06:41:26.906 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00013466699999999999 2024-09-13T06:41:26.906 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:26.906 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:26.906 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:26.906 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.906 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.906 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25661 3.8 3:1180686c:::rbd_data.1121f2c5ee81.0000000000000009:13 [read 397312~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:26.906 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.436956+0000", 2024-09-13T06:41:26.907 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 90.463046095999999, 2024-09-13T06:41:26.907 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089036758999999993, 2024-09-13T06:41:26.907 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:26.907 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:26.907 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:26.907 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:26.907 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:26.907 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25661 2024-09-13T06:41:26.907 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.907 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:26.907 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.907 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:26.907 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436956+0000", 2024-09-13T06:41:26.907 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:26.908 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.908 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.908 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:26.908 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436956+0000", 2024-09-13T06:41:26.908 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:26.908 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.908 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.908 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:26.908 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436956+0000", 2024-09-13T06:41:26.908 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:26.908 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.908 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.909 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:26.909 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436958+0000", 2024-09-13T06:41:26.909 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1770000000000001e-06 2024-09-13T06:41:26.909 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.909 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.909 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:26.909 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436963+0000", 2024-09-13T06:41:26.909 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.6489999999999996e-06 2024-09-13T06:41:26.909 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.909 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.909 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:26.909 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436975+0000", 2024-09-13T06:41:26.909 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1783999999999999e-05 2024-09-13T06:41:26.910 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.910 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.910 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:26.910 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.525671+0000", 2024-09-13T06:41:26.910 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.088696292999999995 2024-09-13T06:41:26.910 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.910 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.910 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:26.910 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.525749+0000", 2024-09-13T06:41:26.910 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.7589000000000005e-05 2024-09-13T06:41:26.910 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.910 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.910 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:26.911 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.525993+0000", 2024-09-13T06:41:26.911 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00024381000000000001 2024-09-13T06:41:26.911 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:26.911 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:26.911 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:26.911 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.911 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.911 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25662 3.8 3:1180686c:::rbd_data.1121f2c5ee81.0000000000000009:13 [read 421888~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:26.911 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.436980+0000", 2024-09-13T06:41:26.911 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 90.463021784000006, 2024-09-13T06:41:26.911 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089367577000000004, 2024-09-13T06:41:26.911 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:26.911 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:26.912 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:26.912 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:26.912 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:26.912 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25662 2024-09-13T06:41:26.912 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.912 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:26.912 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.912 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:26.912 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436980+0000", 2024-09-13T06:41:26.912 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:26.912 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.912 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.912 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:26.913 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436980+0000", 2024-09-13T06:41:26.913 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:26.913 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.913 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.913 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:26.913 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436980+0000", 2024-09-13T06:41:26.913 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:26.913 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.913 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.913 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:26.913 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436982+0000", 2024-09-13T06:41:26.913 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3989999999999998e-06 2024-09-13T06:41:26.913 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.914 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.914 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:26.914 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436988+0000", 2024-09-13T06:41:26.914 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0039999999999996e-06 2024-09-13T06:41:26.914 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.914 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.914 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:26.914 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436993+0000", 2024-09-13T06:41:26.914 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6090000000000003e-06 2024-09-13T06:41:26.914 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.914 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.914 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:26.915 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.526035+0000", 2024-09-13T06:41:26.915 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089042248000000004 2024-09-13T06:41:26.915 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.915 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.915 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:26.915 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.526111+0000", 2024-09-13T06:41:26.915 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5643999999999996e-05 2024-09-13T06:41:26.915 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.915 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.915 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:26.915 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.526348+0000", 2024-09-13T06:41:26.915 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00023705800000000001 2024-09-13T06:41:26.915 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:26.915 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:26.916 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:26.916 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.916 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.916 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25663 3.8 3:1180686c:::rbd_data.1121f2c5ee81.0000000000000009:13 [read 466944~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:26.916 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.436998+0000", 2024-09-13T06:41:26.916 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 90.463004136999999, 2024-09-13T06:41:26.916 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089730867000000006, 2024-09-13T06:41:26.916 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:26.916 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:26.916 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:26.916 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:26.916 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:26.917 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25663 2024-09-13T06:41:26.917 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.917 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:26.917 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.917 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:26.917 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436998+0000", 2024-09-13T06:41:26.917 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:26.917 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.917 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.917 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:26.917 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436998+0000", 2024-09-13T06:41:26.917 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:26.918 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.918 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.918 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:26.918 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436998+0000", 2024-09-13T06:41:26.918 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:26.918 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.918 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.918 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:26.918 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437000+0000", 2024-09-13T06:41:26.918 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0940000000000002e-06 2024-09-13T06:41:26.918 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.918 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.918 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:26.918 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437005+0000", 2024-09-13T06:41:26.919 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.604e-06 2024-09-13T06:41:26.919 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.919 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.919 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:26.919 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437032+0000", 2024-09-13T06:41:26.919 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6407e-05 2024-09-13T06:41:26.919 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.919 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.919 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:26.919 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.526363+0000", 2024-09-13T06:41:26.919 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089331456000000004 2024-09-13T06:41:26.919 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.920 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.920 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:26.920 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.526404+0000", 2024-09-13T06:41:26.920 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.0887999999999999e-05 2024-09-13T06:41:26.920 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.920 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.920 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:26.920 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.526729+0000", 2024-09-13T06:41:26.920 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00032486 2024-09-13T06:41:26.920 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:26.920 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:26.920 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:26.920 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.921 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.921 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25664 3.8 3:1180686c:::rbd_data.1121f2c5ee81.0000000000000009:13 [read 491520~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:26.921 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.437040+0000", 2024-09-13T06:41:26.921 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 90.462962222000002, 2024-09-13T06:41:26.921 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.090016650000000004, 2024-09-13T06:41:26.921 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:26.921 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:26.921 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:26.921 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:26.921 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:26.921 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25664 2024-09-13T06:41:26.921 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.921 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:26.921 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.922 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:26.922 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437040+0000", 2024-09-13T06:41:26.922 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:26.922 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.922 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.922 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:26.922 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437040+0000", 2024-09-13T06:41:26.922 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:26.922 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.922 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.922 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:26.922 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437039+0000", 2024-09-13T06:41:26.922 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:26.922 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.923 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.923 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:26.923 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437047+0000", 2024-09-13T06:41:26.923 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4839999999999998e-06 2024-09-13T06:41:26.923 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.923 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.923 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:26.923 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437054+0000", 2024-09-13T06:41:26.923 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.8299999999999998e-06 2024-09-13T06:41:26.923 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.923 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.923 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:26.923 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437060+0000", 2024-09-13T06:41:26.923 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.1510000000000001e-06 2024-09-13T06:41:26.924 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.924 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.924 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:26.924 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.526772+0000", 2024-09-13T06:41:26.924 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089711737999999999 2024-09-13T06:41:26.924 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.924 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.924 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:26.924 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.526848+0000", 2024-09-13T06:41:26.924 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5870000000000004e-05 2024-09-13T06:41:26.924 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.924 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.924 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:26.925 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.527057+0000", 2024-09-13T06:41:26.925 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000209106 2024-09-13T06:41:26.925 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:26.925 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:26.925 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:26.925 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.925 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.925 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25740 3.18 3:1c662b96:::rbd_data.1121f2c5ee81.0000000000000010:13 [read 200704~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:26.925 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443352+0000", 2024-09-13T06:41:26.925 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 90.456650546999995, 2024-09-13T06:41:26.925 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089068222000000002, 2024-09-13T06:41:26.925 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:26.925 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:26.926 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:26.926 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:26.926 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:26.926 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25740 2024-09-13T06:41:26.926 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.926 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:26.926 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.926 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:26.926 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443352+0000", 2024-09-13T06:41:26.926 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:26.926 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.926 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.926 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:26.927 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443352+0000", 2024-09-13T06:41:26.927 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:26.927 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.927 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.927 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:26.927 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443351+0000", 2024-09-13T06:41:26.927 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:26.927 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.927 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.927 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:26.927 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443354+0000", 2024-09-13T06:41:26.927 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.841e-06 2024-09-13T06:41:26.927 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.928 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.928 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:26.928 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443361+0000", 2024-09-13T06:41:26.928 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.0010000000000004e-06 2024-09-13T06:41:26.928 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.928 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.928 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:26.928 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443366+0000", 2024-09-13T06:41:26.928 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7119999999999999e-06 2024-09-13T06:41:26.928 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.928 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.928 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:26.928 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532117+0000", 2024-09-13T06:41:26.929 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.088751327000000005 2024-09-13T06:41:26.929 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.929 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.929 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:26.929 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532193+0000", 2024-09-13T06:41:26.929 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5839000000000004e-05 2024-09-13T06:41:26.929 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.929 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.929 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:26.929 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532420+0000", 2024-09-13T06:41:26.929 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00022691000000000001 2024-09-13T06:41:26.929 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:26.929 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:26.930 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:26.930 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.930 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.930 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25741 3.18 3:1c662b96:::rbd_data.1121f2c5ee81.0000000000000010:13 [read 225280~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:26.930 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443378+0000", 2024-09-13T06:41:26.930 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 90.456623780000001, 2024-09-13T06:41:26.930 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089324107, 2024-09-13T06:41:26.930 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:26.930 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:26.930 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:26.930 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:26.930 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:26.930 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25741 2024-09-13T06:41:26.931 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.931 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:26.931 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.931 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:26.931 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443378+0000", 2024-09-13T06:41:26.931 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:26.931 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.931 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.931 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:26.931 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443378+0000", 2024-09-13T06:41:26.931 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:26.931 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.931 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.931 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:26.932 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443378+0000", 2024-09-13T06:41:26.932 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:26.932 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.932 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.932 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:26.932 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443380+0000", 2024-09-13T06:41:26.932 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3549999999999999e-06 2024-09-13T06:41:26.932 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.932 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.932 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:26.932 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443388+0000", 2024-09-13T06:41:26.932 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.7449999999999995e-06 2024-09-13T06:41:26.933 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.933 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.933 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:26.933 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443393+0000", 2024-09-13T06:41:26.933 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.4e-06 2024-09-13T06:41:26.933 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.933 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.933 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:26.933 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532454+0000", 2024-09-13T06:41:26.933 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089060941000000005 2024-09-13T06:41:26.933 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.933 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.933 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:26.934 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532512+0000", 2024-09-13T06:41:26.934 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7763000000000002e-05 2024-09-13T06:41:26.934 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.934 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.934 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:26.934 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532703+0000", 2024-09-13T06:41:26.934 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000190328 2024-09-13T06:41:26.934 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:26.934 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:26.934 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:26.934 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.934 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.934 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25742 3.18 3:1c662b96:::rbd_data.1121f2c5ee81.0000000000000010:13 [read 270336~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:26.935 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443398+0000", 2024-09-13T06:41:26.935 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 90.456604068000004, 2024-09-13T06:41:26.935 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089621836999999996, 2024-09-13T06:41:26.935 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:26.935 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:26.935 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:26.935 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:26.935 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:26.935 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25742 2024-09-13T06:41:26.935 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.935 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:26.935 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.935 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:26.935 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443398+0000", 2024-09-13T06:41:26.936 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:26.936 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.936 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.936 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:26.936 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443398+0000", 2024-09-13T06:41:26.936 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:26.936 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.936 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.936 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:26.936 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443398+0000", 2024-09-13T06:41:26.936 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:26.936 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.936 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.937 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:26.937 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443400+0000", 2024-09-13T06:41:26.937 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1849999999999998e-06 2024-09-13T06:41:26.937 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.937 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.937 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:26.937 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443407+0000", 2024-09-13T06:41:26.937 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3669999999999999e-06 2024-09-13T06:41:26.937 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.937 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.937 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:26.937 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443420+0000", 2024-09-13T06:41:26.937 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2645e-05 2024-09-13T06:41:26.938 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.938 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.938 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:26.938 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532742+0000", 2024-09-13T06:41:26.938 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089322200000000004 2024-09-13T06:41:26.938 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.938 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.938 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:26.938 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532818+0000", 2024-09-13T06:41:26.938 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.6019000000000005e-05 2024-09-13T06:41:26.938 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.938 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.938 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:26.938 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533020+0000", 2024-09-13T06:41:26.939 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000201721 2024-09-13T06:41:26.939 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:26.939 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:26.939 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:26.939 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.939 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.939 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25743 3.18 3:1c662b96:::rbd_data.1121f2c5ee81.0000000000000010:13 [read 294912~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:26.939 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443425+0000", 2024-09-13T06:41:26.939 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 90.456577060000001, 2024-09-13T06:41:26.939 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089864075000000002, 2024-09-13T06:41:26.939 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:26.939 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:26.939 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:26.940 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:26.940 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:26.940 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25743 2024-09-13T06:41:26.940 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.940 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:26.940 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.940 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:26.940 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443425+0000", 2024-09-13T06:41:26.940 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:26.940 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.940 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.940 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:26.940 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443425+0000", 2024-09-13T06:41:26.941 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:26.941 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.941 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.941 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:26.941 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443425+0000", 2024-09-13T06:41:26.941 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:26.941 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.941 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.941 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:26.941 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443432+0000", 2024-09-13T06:41:26.941 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3420000000000002e-06 2024-09-13T06:41:26.941 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.942 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.942 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:26.942 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443440+0000", 2024-09-13T06:41:26.942 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5689999999999999e-06 2024-09-13T06:41:26.942 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.942 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.942 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:26.942 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443445+0000", 2024-09-13T06:41:26.942 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9590000000000003e-06 2024-09-13T06:41:26.943 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.943 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.943 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:26.943 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533063+0000", 2024-09-13T06:41:26.943 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089617988999999995 2024-09-13T06:41:26.943 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.943 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.943 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:26.943 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533122+0000", 2024-09-13T06:41:26.943 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9052999999999999e-05 2024-09-13T06:41:26.943 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.943 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.943 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:26.944 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533289+0000", 2024-09-13T06:41:26.944 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00016752800000000001 2024-09-13T06:41:26.944 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:26.944 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:26.944 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:26.944 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.944 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.944 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25744 3.18 3.69d46638 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:26.944 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443449+0000", 2024-09-13T06:41:26.944 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 90.456552912999996, 2024-09-13T06:41:26.944 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089869148999999995, 2024-09-13T06:41:26.944 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:26.944 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:41:26.945 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:26.945 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:26.945 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:26.945 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25744 2024-09-13T06:41:26.945 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.945 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:26.945 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.945 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:26.945 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443449+0000", 2024-09-13T06:41:26.945 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:26.945 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.945 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.945 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:26.946 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443449+0000", 2024-09-13T06:41:26.946 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:26.946 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.946 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.946 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:26.946 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443449+0000", 2024-09-13T06:41:26.946 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:26.946 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.946 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.946 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:26.946 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443451+0000", 2024-09-13T06:41:26.946 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.244e-06 2024-09-13T06:41:26.946 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.947 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.947 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:26.947 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443457+0000", 2024-09-13T06:41:26.947 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.66e-06 2024-09-13T06:41:26.947 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.947 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.947 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:26.947 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443461+0000", 2024-09-13T06:41:26.947 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5449999999999997e-06 2024-09-13T06:41:26.947 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.947 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.947 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:26.947 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533311+0000", 2024-09-13T06:41:26.948 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089849729000000003 2024-09-13T06:41:26.948 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.948 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.948 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:26.948 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533318+0000", 2024-09-13T06:41:26.948 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.328e-06 2024-09-13T06:41:26.948 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:26.948 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:26.948 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:26.948 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.948 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.948 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25745 3.18 3.69d46638 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:26.948 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443466+0000", 2024-09-13T06:41:26.949 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 90.456535854999998, 2024-09-13T06:41:26.949 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089886743000000005, 2024-09-13T06:41:26.949 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:26.949 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:41:26.949 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:26.949 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:26.949 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:26.949 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25745 2024-09-13T06:41:26.949 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.949 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:26.949 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.949 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:26.949 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443466+0000", 2024-09-13T06:41:26.950 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:26.950 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.950 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.950 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:26.950 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443466+0000", 2024-09-13T06:41:26.950 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:26.950 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.950 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.950 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:26.950 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443466+0000", 2024-09-13T06:41:26.950 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:26.950 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.950 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.951 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:26.951 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443474+0000", 2024-09-13T06:41:26.951 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.1289999999999996e-06 2024-09-13T06:41:26.951 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.951 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.951 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:26.951 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443484+0000", 2024-09-13T06:41:26.951 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0654e-05 2024-09-13T06:41:26.951 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.951 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.951 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:26.951 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443490+0000", 2024-09-13T06:41:26.951 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8030000000000002e-06 2024-09-13T06:41:26.952 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.952 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.952 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:26.952 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533348+0000", 2024-09-13T06:41:26.952 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089857267000000005 2024-09-13T06:41:26.952 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.952 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.952 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:26.952 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533353+0000", 2024-09-13T06:41:26.952 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.5520000000000004e-06 2024-09-13T06:41:26.952 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:26.952 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:26.952 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:26.953 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.953 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.953 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25746 3.18 3.69d46638 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:26.953 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443495+0000", 2024-09-13T06:41:26.953 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 90.456506742000002, 2024-09-13T06:41:26.953 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089903725000000004, 2024-09-13T06:41:26.953 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:26.953 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:41:26.953 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:26.953 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:26.953 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:26.953 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25746 2024-09-13T06:41:26.953 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.954 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:26.954 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.954 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:26.954 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443495+0000", 2024-09-13T06:41:26.954 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:26.954 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.954 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.954 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:26.954 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443495+0000", 2024-09-13T06:41:26.954 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:26.954 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.954 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.954 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:26.955 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443495+0000", 2024-09-13T06:41:26.955 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:26.955 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.955 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.955 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:26.955 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443498+0000", 2024-09-13T06:41:26.955 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.7690000000000001e-06 2024-09-13T06:41:26.955 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.955 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.955 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:26.955 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443504+0000", 2024-09-13T06:41:26.956 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9710000000000001e-06 2024-09-13T06:41:26.956 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.956 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.956 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:26.956 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443508+0000", 2024-09-13T06:41:26.956 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4159999999999997e-06 2024-09-13T06:41:26.956 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.956 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.956 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:26.956 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533391+0000", 2024-09-13T06:41:26.956 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089882607000000003 2024-09-13T06:41:26.956 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.957 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.957 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:26.957 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533399+0000", 2024-09-13T06:41:26.957 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.4349999999999997e-06 2024-09-13T06:41:26.957 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:26.957 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:26.957 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:26.957 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.957 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.957 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25747 3.8 3.63996268 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:26.957 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443512+0000", 2024-09-13T06:41:26.957 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 90.456490011, 2024-09-13T06:41:26.957 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089880075000000004, 2024-09-13T06:41:26.957 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:26.958 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:41:26.958 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:26.958 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:26.958 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:26.958 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25747 2024-09-13T06:41:26.958 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.958 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:26.958 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.958 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:26.958 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443512+0000", 2024-09-13T06:41:26.958 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:26.958 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.958 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.958 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:26.959 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443512+0000", 2024-09-13T06:41:26.959 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:26.959 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.959 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.959 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:26.959 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443512+0000", 2024-09-13T06:41:26.959 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:26.959 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.959 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.959 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:26.959 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443514+0000", 2024-09-13T06:41:26.959 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0980000000000001e-06 2024-09-13T06:41:26.959 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.960 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.960 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:26.960 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443520+0000", 2024-09-13T06:41:26.960 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7069999999999997e-06 2024-09-13T06:41:26.960 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.960 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.960 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:26.960 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443524+0000", 2024-09-13T06:41:26.960 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5390000000000001e-06 2024-09-13T06:41:26.960 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.960 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.960 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:26.960 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533384+0000", 2024-09-13T06:41:26.961 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089859684999999995 2024-09-13T06:41:26.961 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.961 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.961 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:26.961 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533392+0000", 2024-09-13T06:41:26.961 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.3440000000000001e-06 2024-09-13T06:41:26.961 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:26.961 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:26.961 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:26.961 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.961 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.961 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25748 3.8 3.63996268 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:26.962 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443528+0000", 2024-09-13T06:41:26.962 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 90.456473884000005, 2024-09-13T06:41:26.962 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089890715999999996, 2024-09-13T06:41:26.962 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:26.962 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:41:26.962 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:26.962 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:26.962 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:26.962 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25748 2024-09-13T06:41:26.962 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.962 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:26.962 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.962 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:26.962 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443528+0000", 2024-09-13T06:41:26.963 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:26.963 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.963 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.963 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:26.963 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443528+0000", 2024-09-13T06:41:26.963 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:26.963 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.963 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.963 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:26.963 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443528+0000", 2024-09-13T06:41:26.963 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:26.963 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.964 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.964 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:26.964 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443530+0000", 2024-09-13T06:41:26.964 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0650000000000001e-06 2024-09-13T06:41:26.964 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.964 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.964 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:26.964 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443536+0000", 2024-09-13T06:41:26.964 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7259999999999999e-06 2024-09-13T06:41:26.964 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.964 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.964 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:26.964 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443540+0000", 2024-09-13T06:41:26.964 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5009999999999998e-06 2024-09-13T06:41:26.965 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.965 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.965 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:26.965 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533412+0000", 2024-09-13T06:41:26.965 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089871873000000005 2024-09-13T06:41:26.965 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.965 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.965 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:26.965 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533419+0000", 2024-09-13T06:41:26.965 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.883e-06 2024-09-13T06:41:26.965 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:26.965 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:26.966 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:26.966 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.966 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.966 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25749 3.8 3.63996268 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:26.966 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443545+0000", 2024-09-13T06:41:26.966 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 90.456457688, 2024-09-13T06:41:26.966 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089897988999999998, 2024-09-13T06:41:26.966 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:26.966 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:41:26.966 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:26.966 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:26.966 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:26.966 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25749 2024-09-13T06:41:26.967 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.967 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:26.967 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.967 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:26.967 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443545+0000", 2024-09-13T06:41:26.967 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:26.967 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.967 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.967 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:26.967 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443545+0000", 2024-09-13T06:41:26.967 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:26.967 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.967 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.967 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:26.968 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443544+0000", 2024-09-13T06:41:26.968 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:26.968 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.968 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.968 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:26.968 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443553+0000", 2024-09-13T06:41:26.968 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.4770000000000003e-06 2024-09-13T06:41:26.968 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.968 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.968 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:26.968 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443564+0000", 2024-09-13T06:41:26.968 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0986e-05 2024-09-13T06:41:26.968 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.969 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.969 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:26.969 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443569+0000", 2024-09-13T06:41:26.969 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2530000000000004e-06 2024-09-13T06:41:26.969 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.969 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.969 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:26.969 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533438+0000", 2024-09-13T06:41:26.969 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089868641999999999 2024-09-13T06:41:26.969 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.969 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.969 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:26.969 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533442+0000", 2024-09-13T06:41:26.970 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.989e-06 2024-09-13T06:41:26.970 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:26.970 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:26.970 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:26.970 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.970 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.970 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25750 3.8 3.63996268 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:26.970 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443574+0000", 2024-09-13T06:41:26.970 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 90.456428201999998, 2024-09-13T06:41:26.970 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089895143999999996, 2024-09-13T06:41:26.970 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:26.970 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:41:26.970 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:26.971 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:26.971 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:26.971 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25750 2024-09-13T06:41:26.971 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.971 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:26.971 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.971 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:26.971 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443574+0000", 2024-09-13T06:41:26.971 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:26.971 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.971 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.971 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:26.971 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443574+0000", 2024-09-13T06:41:26.971 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:26.972 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.972 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.972 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:26.972 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443574+0000", 2024-09-13T06:41:26.972 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:26.972 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.972 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.972 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:26.972 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443576+0000", 2024-09-13T06:41:26.972 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6910000000000002e-06 2024-09-13T06:41:26.972 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.972 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.972 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:26.973 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443583+0000", 2024-09-13T06:41:26.973 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.331e-06 2024-09-13T06:41:26.973 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.973 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.973 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:26.973 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443587+0000", 2024-09-13T06:41:26.973 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6129999999999997e-06 2024-09-13T06:41:26.973 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.973 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.973 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:26.973 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533464+0000", 2024-09-13T06:41:26.973 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089876605999999998 2024-09-13T06:41:26.973 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.974 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.974 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:26.974 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533469+0000", 2024-09-13T06:41:26.974 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3909999999999997e-06 2024-09-13T06:41:26.974 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:26.974 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:26.974 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:26.974 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.974 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.974 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25751 3.8 3.63996268 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:26.974 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443592+0000", 2024-09-13T06:41:26.974 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 90.456410504999994, 2024-09-13T06:41:26.974 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089913650999999997, 2024-09-13T06:41:26.975 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:26.975 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:41:26.975 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:26.975 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:26.975 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:26.975 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25751 2024-09-13T06:41:26.975 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.975 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:26.975 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.975 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:26.975 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443592+0000", 2024-09-13T06:41:26.975 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:26.975 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.976 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.976 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:26.976 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443592+0000", 2024-09-13T06:41:26.976 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:26.976 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.976 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.976 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:26.976 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443591+0000", 2024-09-13T06:41:26.976 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:26.976 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.976 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.976 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:26.977 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443594+0000", 2024-09-13T06:41:26.977 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3649999999999998e-06 2024-09-13T06:41:26.977 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.977 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.977 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:26.977 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443599+0000", 2024-09-13T06:41:26.977 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.699e-06 2024-09-13T06:41:26.977 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.977 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.977 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:26.977 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443611+0000", 2024-09-13T06:41:26.977 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1503e-05 2024-09-13T06:41:26.977 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.977 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.978 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:26.978 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533497+0000", 2024-09-13T06:41:26.978 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089886453000000005 2024-09-13T06:41:26.978 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.978 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.978 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:26.978 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533505+0000", 2024-09-13T06:41:26.978 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.9910000000000002e-06 2024-09-13T06:41:26.978 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:26.978 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:26.978 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:26.978 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.978 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.979 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25752 3.8 3.63996268 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:26.979 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443615+0000", 2024-09-13T06:41:26.979 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 90.456386723999998, 2024-09-13T06:41:26.979 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089905868999999999, 2024-09-13T06:41:26.979 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:26.979 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:41:26.979 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:26.979 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:26.979 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:26.979 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25752 2024-09-13T06:41:26.979 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.979 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:26.979 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.980 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:26.980 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443615+0000", 2024-09-13T06:41:26.980 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:26.980 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.980 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.980 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:26.980 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443615+0000", 2024-09-13T06:41:26.980 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:26.980 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.980 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.980 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:26.980 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443615+0000", 2024-09-13T06:41:26.980 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:26.981 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.981 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.981 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:26.981 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443617+0000", 2024-09-13T06:41:26.981 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3539999999999998e-06 2024-09-13T06:41:26.981 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.981 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.981 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:26.981 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443624+0000", 2024-09-13T06:41:26.981 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3600000000000001e-06 2024-09-13T06:41:26.981 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.981 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.982 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:26.982 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443628+0000", 2024-09-13T06:41:26.982 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.2350000000000001e-06 2024-09-13T06:41:26.982 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.982 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.982 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:26.982 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533517+0000", 2024-09-13T06:41:26.982 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089889029999999995 2024-09-13T06:41:26.982 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.982 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.982 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:26.982 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533521+0000", 2024-09-13T06:41:26.982 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.2529999999999998e-06 2024-09-13T06:41:26.982 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:26.983 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:26.983 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:26.983 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.983 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.983 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25755 3.8 3.63996268 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:26.983 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.444692+0000", 2024-09-13T06:41:26.983 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 90.455310018000006, 2024-09-13T06:41:26.983 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.088904186999999996, 2024-09-13T06:41:26.983 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:26.983 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:41:26.983 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:26.983 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:26.984 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:26.984 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25755 2024-09-13T06:41:26.984 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.984 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:26.984 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.984 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:26.984 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.444692+0000", 2024-09-13T06:41:26.984 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:26.984 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.984 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.984 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:26.984 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.444692+0000", 2024-09-13T06:41:26.984 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:26.985 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.985 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.985 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:26.985 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.444692+0000", 2024-09-13T06:41:26.985 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:26.985 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.985 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.985 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:26.985 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.444694+0000", 2024-09-13T06:41:26.985 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.058e-06 2024-09-13T06:41:26.985 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.985 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.985 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:26.986 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.444700+0000", 2024-09-13T06:41:26.986 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7769999999999999e-06 2024-09-13T06:41:26.986 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.986 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.986 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:26.986 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.444704+0000", 2024-09-13T06:41:26.986 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6229999999999996e-06 2024-09-13T06:41:26.986 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.986 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.986 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:26.986 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533587+0000", 2024-09-13T06:41:26.986 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.088882744999999999 2024-09-13T06:41:26.986 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.986 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.987 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:26.987 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533596+0000", 2024-09-13T06:41:26.987 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.3270000000000007e-06 2024-09-13T06:41:26.987 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:26.987 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:26.987 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:26.987 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.987 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.987 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:64356 3.c 3:32785be9:::rbd_header.11218ba71f0d:head [watch reconnect cookie 140361410387072 gen 2] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e95)", 2024-09-13T06:41:26.987 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:48.473318+0000", 2024-09-13T06:41:26.987 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 38.426684330999997, 2024-09-13T06:41:26.987 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1458904379999999, 2024-09-13T06:41:26.987 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:26.988 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:26.988 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:26.988 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:26.988 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:26.988 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 64356 2024-09-13T06:41:26.988 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.988 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:26.988 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.988 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:26.988 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:48.473318+0000", 2024-09-13T06:41:26.988 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:26.988 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.988 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.989 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:26.989 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:48.473318+0000", 2024-09-13T06:41:26.989 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:26.989 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.989 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.989 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:26.989 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:48.473315+0000", 2024-09-13T06:41:26.989 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999971 2024-09-13T06:41:26.989 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.989 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.989 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:26.989 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:48.473329+0000", 2024-09-13T06:41:26.989 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.433e-05 2024-09-13T06:41:26.989 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.990 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.990 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:26.990 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:48.473363+0000", 2024-09-13T06:41:26.990 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.3592e-05 2024-09-13T06:41:26.990 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.990 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.990 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:26.990 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:48.473386+0000", 2024-09-13T06:41:26.990 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2708999999999999e-05 2024-09-13T06:41:26.990 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.990 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.990 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:26.990 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:48.473804+0000", 2024-09-13T06:41:26.991 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00041789399999999998 2024-09-13T06:41:26.991 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.991 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.991 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:41:26.991 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:48.473830+0000", 2024-09-13T06:41:26.991 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6869e-05 2024-09-13T06:41:26.991 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.991 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.991 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:26.991 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:49.614332+0000", 2024-09-13T06:41:26.991 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.140501107 2024-09-13T06:41:26.991 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.991 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.992 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for rw locks", 2024-09-13T06:41:26.992 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:49.614496+0000", 2024-09-13T06:41:26.992 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00016451200000000001 2024-09-13T06:41:26.992 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.992 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.992 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:26.992 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:49.617131+0000", 2024-09-13T06:41:26.992 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.002634843 2024-09-13T06:41:26.992 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.992 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.992 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:26.992 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:49.617204+0000", 2024-09-13T06:41:26.993 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.2991000000000006e-05 2024-09-13T06:41:26.993 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:26.993 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:26.993 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:26.993 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:49.619208+0000", 2024-09-13T06:41:26.993 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.002004381 2024-09-13T06:41:26.993 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:26.993 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:26.993 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:26.993 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:26.993 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:26.993 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:41:26.995 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-13T06:41:26.995 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:41:26.994+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:41:27.096 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:41:27.091+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:41:27.126 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:41:27.127 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [], 2024-09-13T06:41:27.127 INFO:teuthology.orchestra.run.smithi139.stdout: "num_ops": 0 2024-09-13T06:41:27.127 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:41:27.141 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-13T06:41:27.228 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:41:27.227+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:41:27.297 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:41:27.298+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:41:27.305 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:41:27.305 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [], 2024-09-13T06:41:27.306 INFO:teuthology.orchestra.run.smithi139.stdout: "complaint_time": 30, 2024-09-13T06:41:27.306 INFO:teuthology.orchestra.run.smithi139.stdout: "num_blocked_ops": 0 2024-09-13T06:41:27.306 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:41:27.320 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-13T06:41:27.398 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:41:27.398+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:41:27.499 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:41:27.498+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:41:27.523 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:41:27.523 INFO:teuthology.orchestra.run.smithi139.stdout: "size": 20, 2024-09-13T06:41:27.524 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 600, 2024-09-13T06:41:27.524 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [ 2024-09-13T06:41:27.524 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:27.524 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18706 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 3346432~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:41:27.524 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.846138+0000", 2024-09-13T06:41:27.524 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 95.676722955000002, 2024-09-13T06:41:27.524 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.102018712, 2024-09-13T06:41:27.524 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:27.524 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:27.524 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:27.524 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:27.524 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:27.524 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18706 2024-09-13T06:41:27.525 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:27.525 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:27.525 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:27.525 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:27.525 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846138+0000", 2024-09-13T06:41:27.525 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:27.525 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:27.525 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:27.525 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:27.525 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846138+0000", 2024-09-13T06:41:27.525 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:27.525 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:27.526 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:27.526 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:27.526 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846138+0000", 2024-09-13T06:41:27.526 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:27.526 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:27.526 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:27.526 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:27.526 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846141+0000", 2024-09-13T06:41:27.526 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.6969999999999999e-06 2024-09-13T06:41:27.526 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:27.526 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:27.526 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:27.526 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846150+0000", 2024-09-13T06:41:27.527 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6400000000000003e-06 2024-09-13T06:41:27.527 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:27.527 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:27.527 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:27.527 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846160+0000", 2024-09-13T06:41:27.527 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.3999999999999998e-06 2024-09-13T06:41:27.527 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:27.527 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:27.527 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:27.527 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.947764+0000", 2024-09-13T06:41:27.527 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101604085 2024-09-13T06:41:27.527 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:27.527 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:27.528 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:27.528 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.947888+0000", 2024-09-13T06:41:27.528 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000124113 2024-09-13T06:41:27.528 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:27.528 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:27.528 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:27.528 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.948157+0000", 2024-09-13T06:41:27.528 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00026943399999999998 2024-09-13T06:41:27.528 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:27.528 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:27.528 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:27.528 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:27.528 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:27.529 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18707 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 3375104~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:41:27.529 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.846207+0000", 2024-09-13T06:41:27.529 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 95.676654189000004, 2024-09-13T06:41:27.529 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10238114099999999, 2024-09-13T06:41:27.529 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:27.529 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:27.529 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:27.529 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:27.529 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:27.529 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18707 2024-09-13T06:41:27.529 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:27.529 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:27.529 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:27.529 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:27.530 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846207+0000", 2024-09-13T06:41:27.530 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:27.530 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:27.530 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:27.530 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:27.530 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846207+0000", 2024-09-13T06:41:27.530 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:27.530 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:27.530 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:27.530 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:27.530 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846206+0000", 2024-09-13T06:41:27.530 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:27.530 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:27.531 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:27.531 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:27.531 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846211+0000", 2024-09-13T06:41:27.531 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.3000000000000003e-06 2024-09-13T06:41:27.531 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:27.531 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:27.531 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:27.531 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846220+0000", 2024-09-13T06:41:27.531 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6199999999999994e-06 2024-09-13T06:41:27.531 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:27.531 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:27.531 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:27.531 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846228+0000", 2024-09-13T06:41:27.531 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.7500000000000003e-06 2024-09-13T06:41:27.531 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:27.532 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:27.532 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:27.532 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.948267+0000", 2024-09-13T06:41:27.532 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10203878700000001 2024-09-13T06:41:27.532 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:27.532 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:27.532 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:27.532 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.948435+0000", 2024-09-13T06:41:27.532 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00016796500000000001 2024-09-13T06:41:27.532 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:27.532 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:27.532 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:27.532 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.948588+0000", 2024-09-13T06:41:27.533 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00015373599999999999 2024-09-13T06:41:27.533 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:27.533 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:27.533 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:27.533 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:27.533 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:27.533 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18718 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 3690496~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:41:27.533 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.850174+0000", 2024-09-13T06:41:27.533 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 95.672687035999999, 2024-09-13T06:41:27.533 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101854154, 2024-09-13T06:41:27.533 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:27.533 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:27.534 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:27.534 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:27.534 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:27.534 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18718 2024-09-13T06:41:27.534 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:27.534 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:27.534 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:27.534 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:27.534 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850174+0000", 2024-09-13T06:41:27.534 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:27.534 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:27.534 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:27.534 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:27.535 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850174+0000", 2024-09-13T06:41:27.535 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:27.535 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:27.535 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:27.535 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:27.535 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850173+0000", 2024-09-13T06:41:27.535 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:27.535 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:27.535 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:27.535 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:27.535 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850178+0000", 2024-09-13T06:41:27.535 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.4129999999999999e-06 2024-09-13T06:41:27.536 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:27.536 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:27.536 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:27.536 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850188+0000", 2024-09-13T06:41:27.536 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.8600000000000005e-06 2024-09-13T06:41:27.536 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:27.536 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:27.536 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:27.536 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850195+0000", 2024-09-13T06:41:27.536 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.8730000000000007e-06 2024-09-13T06:41:27.536 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:27.536 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:27.536 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:27.536 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.951766+0000", 2024-09-13T06:41:27.537 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.1015703 2024-09-13T06:41:27.537 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:27.537 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:27.537 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:27.537 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.951879+0000", 2024-09-13T06:41:27.537 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000112932 2024-09-13T06:41:27.537 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:27.537 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:27.537 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:27.537 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.952029+0000", 2024-09-13T06:41:27.537 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000149846 2024-09-13T06:41:27.537 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:27.537 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:27.538 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:27.538 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:27.538 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:27.538 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18719 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 3719168~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:41:27.538 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.850202+0000", 2024-09-13T06:41:27.538 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 95.672658992999999, 2024-09-13T06:41:27.538 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.102191676, 2024-09-13T06:41:27.538 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:27.538 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:27.538 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:27.538 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:27.538 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:27.538 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18719 2024-09-13T06:41:27.538 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:27.539 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:27.539 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:27.539 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:27.539 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850202+0000", 2024-09-13T06:41:27.539 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:27.539 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:27.539 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:27.539 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:27.539 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850202+0000", 2024-09-13T06:41:27.539 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:27.539 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:27.539 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:27.539 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:27.539 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850202+0000", 2024-09-13T06:41:27.540 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:27.540 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:27.540 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:27.540 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:27.540 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850205+0000", 2024-09-13T06:41:27.540 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.89e-06 2024-09-13T06:41:27.540 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:27.540 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:27.540 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:27.540 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850216+0000", 2024-09-13T06:41:27.540 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0233e-05 2024-09-13T06:41:27.540 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:27.540 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:27.541 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:27.541 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850223+0000", 2024-09-13T06:41:27.541 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5299999999999999e-06 2024-09-13T06:41:27.541 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:27.541 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:27.541 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:27.541 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.952106+0000", 2024-09-13T06:41:27.541 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10188309299999999 2024-09-13T06:41:27.541 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:27.541 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:27.541 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:27.541 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.952233+0000", 2024-09-13T06:41:27.541 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000126993 2024-09-13T06:41:27.541 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:27.542 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:27.542 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:27.542 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.952394+0000", 2024-09-13T06:41:27.542 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000160791 2024-09-13T06:41:27.542 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:27.542 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:27.542 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:27.542 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:27.542 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:27.542 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18720 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 3747840~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:41:27.542 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.850726+0000", 2024-09-13T06:41:27.542 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 95.672135163999997, 2024-09-13T06:41:27.542 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10199504299999999, 2024-09-13T06:41:27.543 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:27.543 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:27.543 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:27.543 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:27.543 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:27.543 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18720 2024-09-13T06:41:27.543 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:27.543 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:27.543 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:27.543 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:27.543 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850726+0000", 2024-09-13T06:41:27.544 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:27.544 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:27.544 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:27.544 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:27.544 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850726+0000", 2024-09-13T06:41:27.544 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:27.544 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:27.544 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:27.544 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:27.544 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850229+0000", 2024-09-13T06:41:27.544 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9995027 2024-09-13T06:41:27.544 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:27.545 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:27.545 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:27.545 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850731+0000", 2024-09-13T06:41:27.545 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00050221599999999999 2024-09-13T06:41:27.545 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:27.545 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:27.545 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:27.545 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850751+0000", 2024-09-13T06:41:27.545 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.9703000000000001e-05 2024-09-13T06:41:27.545 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:27.545 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:27.545 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:27.546 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850764+0000", 2024-09-13T06:41:27.546 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3207000000000001e-05 2024-09-13T06:41:27.546 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:27.546 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:27.546 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:27.546 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.952454+0000", 2024-09-13T06:41:27.546 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101690102 2024-09-13T06:41:27.546 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:27.546 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:27.546 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:27.546 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.952571+0000", 2024-09-13T06:41:27.547 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000116556 2024-09-13T06:41:27.547 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:27.547 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:27.547 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:27.547 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.952721+0000", 2024-09-13T06:41:27.547 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000150419 2024-09-13T06:41:27.547 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:27.547 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:27.547 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:27.547 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:27.547 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:27.547 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18730 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 4034560~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:41:27.548 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.854013+0000", 2024-09-13T06:41:27.548 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 95.668848222999998, 2024-09-13T06:41:27.548 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10186914399999999, 2024-09-13T06:41:27.548 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:27.548 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:27.548 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:27.548 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:27.548 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:27.548 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18730 2024-09-13T06:41:27.548 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:27.548 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:27.548 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:27.549 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:27.549 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.854013+0000", 2024-09-13T06:41:27.549 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:27.549 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:27.549 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:27.549 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:27.549 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.854013+0000", 2024-09-13T06:41:27.549 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:27.549 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:27.549 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:27.549 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:27.549 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.854013+0000", 2024-09-13T06:41:27.549 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:27.550 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:27.550 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:27.550 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:27.550 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.854016+0000", 2024-09-13T06:41:27.550 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.1839999999999999e-06 2024-09-13T06:41:27.550 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:27.550 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:27.550 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:27.550 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.854025+0000", 2024-09-13T06:41:27.550 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.8030000000000003e-06 2024-09-13T06:41:27.550 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:27.550 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:27.550 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:27.551 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.854033+0000", 2024-09-13T06:41:27.551 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6500000000000002e-06 2024-09-13T06:41:27.551 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:27.551 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:27.551 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:27.551 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.955546+0000", 2024-09-13T06:41:27.551 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10151296 2024-09-13T06:41:27.551 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:27.551 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:27.551 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:27.551 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.955694+0000", 2024-09-13T06:41:27.551 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000147773 2024-09-13T06:41:27.551 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:27.551 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:27.552 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:27.552 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.955882+0000", 2024-09-13T06:41:27.552 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000188371 2024-09-13T06:41:27.552 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:27.552 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:27.552 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:27.552 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:27.552 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:27.552 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18742 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 4378624~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:41:27.552 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.857984+0000", 2024-09-13T06:41:27.552 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 95.664877099999998, 2024-09-13T06:41:27.552 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10179961799999999, 2024-09-13T06:41:27.553 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:27.553 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:27.553 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:27.553 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:27.553 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:27.553 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18742 2024-09-13T06:41:27.553 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:27.553 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:27.553 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:27.553 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:27.553 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.857984+0000", 2024-09-13T06:41:27.553 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:27.554 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:27.554 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:27.554 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:27.554 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.857984+0000", 2024-09-13T06:41:27.554 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:27.554 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:27.554 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:27.554 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:27.554 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.857983+0000", 2024-09-13T06:41:27.554 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:27.554 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:27.554 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:27.554 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:27.554 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.857987+0000", 2024-09-13T06:41:27.555 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0670000000000002e-06 2024-09-13T06:41:27.555 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:27.555 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:27.555 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:27.555 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.857997+0000", 2024-09-13T06:41:27.555 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6830000000000003e-06 2024-09-13T06:41:27.555 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:27.555 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:27.555 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:27.555 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.858006+0000", 2024-09-13T06:41:27.555 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.5739999999999996e-06 2024-09-13T06:41:27.556 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:27.556 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:27.556 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:27.556 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.959453+0000", 2024-09-13T06:41:27.556 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101447339 2024-09-13T06:41:27.556 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:27.556 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:27.556 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:27.556 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.959603+0000", 2024-09-13T06:41:27.556 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000150316 2024-09-13T06:41:27.556 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:27.556 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:27.556 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:27.556 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.959784+0000", 2024-09-13T06:41:27.557 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00018065900000000001 2024-09-13T06:41:27.557 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:27.557 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:27.557 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:27.557 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:27.557 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:27.557 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18743 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 4407296~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:41:27.557 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.858012+0000", 2024-09-13T06:41:27.557 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 95.664849106999995, 2024-09-13T06:41:27.557 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10210024500000001, 2024-09-13T06:41:27.557 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:27.557 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:27.557 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:27.558 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:27.558 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:27.558 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18743 2024-09-13T06:41:27.558 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:27.558 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:27.558 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:27.558 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:27.558 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.858012+0000", 2024-09-13T06:41:27.558 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:27.558 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:27.558 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:27.558 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:27.558 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.858012+0000", 2024-09-13T06:41:27.558 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:27.559 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:27.559 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:27.559 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:27.559 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.858011+0000", 2024-09-13T06:41:27.559 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:27.559 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:27.559 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:27.559 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:27.559 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.858016+0000", 2024-09-13T06:41:27.559 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0659999999999997e-06 2024-09-13T06:41:27.559 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:27.559 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:27.559 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:27.560 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.858024+0000", 2024-09-13T06:41:27.560 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.7700000000000007e-06 2024-09-13T06:41:27.560 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:27.560 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:27.560 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:27.560 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.858032+0000", 2024-09-13T06:41:27.560 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.7700000000000001e-06 2024-09-13T06:41:27.560 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:27.560 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:27.560 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:27.560 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.959850+0000", 2024-09-13T06:41:27.560 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.1018182 2024-09-13T06:41:27.560 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:27.561 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:27.561 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:27.561 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.959964+0000", 2024-09-13T06:41:27.561 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00011413600000000001 2024-09-13T06:41:27.561 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:27.561 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:27.561 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:27.561 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.960113+0000", 2024-09-13T06:41:27.561 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00014813900000000001 2024-09-13T06:41:27.561 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:27.561 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:27.561 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:27.561 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:27.561 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:27.562 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18755 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 4751360~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:41:27.562 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.862061+0000", 2024-09-13T06:41:27.562 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 95.660800855000005, 2024-09-13T06:41:27.562 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101907023, 2024-09-13T06:41:27.562 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:27.562 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:27.562 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:27.562 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:27.562 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:27.562 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18755 2024-09-13T06:41:27.562 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:27.562 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:27.562 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:27.563 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:27.563 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862061+0000", 2024-09-13T06:41:27.563 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:27.563 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:27.563 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:27.563 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:27.563 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862061+0000", 2024-09-13T06:41:27.563 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:27.563 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:27.563 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:27.563 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:27.563 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862060+0000", 2024-09-13T06:41:27.563 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:27.563 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:27.564 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:27.564 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:27.564 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862064+0000", 2024-09-13T06:41:27.564 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.3229999999999999e-06 2024-09-13T06:41:27.564 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:27.564 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:27.564 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:27.564 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862078+0000", 2024-09-13T06:41:27.564 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.433e-05 2024-09-13T06:41:27.564 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:27.565 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:27.565 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:27.565 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862086+0000", 2024-09-13T06:41:27.565 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.3869999999999997e-06 2024-09-13T06:41:27.565 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:27.565 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:27.565 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:27.565 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.963635+0000", 2024-09-13T06:41:27.565 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101549606 2024-09-13T06:41:27.565 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:27.565 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:27.565 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:27.565 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.963783+0000", 2024-09-13T06:41:27.565 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000147312 2024-09-13T06:41:27.566 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:27.566 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:27.566 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:27.566 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.963968+0000", 2024-09-13T06:41:27.566 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000185028 2024-09-13T06:41:27.566 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:27.566 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:27.566 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:27.566 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:27.566 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:27.566 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18756 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 4780032~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:41:27.566 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.862132+0000", 2024-09-13T06:41:27.566 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 95.660729012000004, 2024-09-13T06:41:27.567 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.102159295, 2024-09-13T06:41:27.567 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:27.567 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:27.567 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:27.567 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:27.567 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:27.567 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18756 2024-09-13T06:41:27.567 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:27.567 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:27.567 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:27.567 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:27.567 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862132+0000", 2024-09-13T06:41:27.567 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:27.567 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:27.568 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:27.568 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:27.568 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862132+0000", 2024-09-13T06:41:27.568 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:27.568 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:27.568 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:27.568 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:27.568 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862132+0000", 2024-09-13T06:41:27.568 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:27.568 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:27.568 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:27.568 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:27.568 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862136+0000", 2024-09-13T06:41:27.569 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.9559999999999999e-06 2024-09-13T06:41:27.569 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:27.569 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:27.569 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:27.569 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862145+0000", 2024-09-13T06:41:27.569 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6169999999999996e-06 2024-09-13T06:41:27.569 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:27.569 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:27.569 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:27.569 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862153+0000", 2024-09-13T06:41:27.569 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.8359999999999992e-06 2024-09-13T06:41:27.569 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:27.569 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:27.569 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:27.570 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.964018+0000", 2024-09-13T06:41:27.570 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101865421 2024-09-13T06:41:27.570 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:27.570 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:27.570 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:27.570 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.964140+0000", 2024-09-13T06:41:27.570 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000121172 2024-09-13T06:41:27.570 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:27.570 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:27.570 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:27.570 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.964292+0000", 2024-09-13T06:41:27.570 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00015202600000000001 2024-09-13T06:41:27.570 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:27.571 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:27.571 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:27.571 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:27.571 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:27.571 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18768 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 5124096~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:41:27.571 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.866345+0000", 2024-09-13T06:41:27.571 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 95.656516705000001, 2024-09-13T06:41:27.571 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101779361, 2024-09-13T06:41:27.571 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:27.571 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:27.571 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:27.571 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:27.571 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:27.572 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18768 2024-09-13T06:41:27.572 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:27.572 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:27.572 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:27.572 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:27.572 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.866345+0000", 2024-09-13T06:41:27.572 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:27.572 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:27.572 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:27.572 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:27.572 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.866345+0000", 2024-09-13T06:41:27.572 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:27.572 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:27.573 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:27.573 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:27.573 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.866344+0000", 2024-09-13T06:41:27.573 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:27.573 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:27.573 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:27.573 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:27.573 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.866348+0000", 2024-09-13T06:41:27.573 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.4300000000000002e-06 2024-09-13T06:41:27.573 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:27.573 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:27.573 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:27.574 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.866356+0000", 2024-09-13T06:41:27.574 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.5930000000000006e-06 2024-09-13T06:41:27.574 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:27.574 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:27.574 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:27.574 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.866364+0000", 2024-09-13T06:41:27.574 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5599999999999996e-06 2024-09-13T06:41:27.574 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:27.574 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:27.574 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:27.574 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.967865+0000", 2024-09-13T06:41:27.574 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101501683 2024-09-13T06:41:27.574 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:27.574 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:27.575 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:27.575 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.967981+0000", 2024-09-13T06:41:27.575 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000115643 2024-09-13T06:41:27.575 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:27.575 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:27.575 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:27.575 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.968124+0000", 2024-09-13T06:41:27.575 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00014305500000000001 2024-09-13T06:41:27.575 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:27.575 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:27.575 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:27.575 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:27.575 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:27.576 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18779 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 5439488~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:41:27.576 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.869996+0000", 2024-09-13T06:41:27.576 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 95.652865820000002, 2024-09-13T06:41:27.576 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10189577399999999, 2024-09-13T06:41:27.576 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:27.576 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:27.576 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:27.576 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:27.576 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:27.576 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18779 2024-09-13T06:41:27.576 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:27.576 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:27.577 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:27.577 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:27.577 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.869996+0000", 2024-09-13T06:41:27.577 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:27.577 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:27.577 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:27.577 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:27.577 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.869996+0000", 2024-09-13T06:41:27.577 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:27.577 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:27.577 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:27.577 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:27.578 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.869995+0000", 2024-09-13T06:41:27.578 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:27.578 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:27.578 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:27.578 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:27.578 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.869998+0000", 2024-09-13T06:41:27.578 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.2729999999999998e-06 2024-09-13T06:41:27.578 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:27.578 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:27.578 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:27.578 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.870007+0000", 2024-09-13T06:41:27.578 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.5760000000000006e-06 2024-09-13T06:41:27.579 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:27.579 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:27.579 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:27.579 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.870014+0000", 2024-09-13T06:41:27.579 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.1400000000000002e-06 2024-09-13T06:41:27.579 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:27.579 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:27.579 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:27.579 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.971631+0000", 2024-09-13T06:41:27.579 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101617503 2024-09-13T06:41:27.579 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:27.579 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:27.580 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:27.580 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.971747+0000", 2024-09-13T06:41:27.580 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00011599600000000001 2024-09-13T06:41:27.580 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:27.580 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:27.580 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:27.580 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.971891+0000", 2024-09-13T06:41:27.580 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000143912 2024-09-13T06:41:27.580 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:27.580 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:27.580 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:27.580 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:27.580 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:27.580 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18792 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 5812224~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:41:27.581 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.874371+0000", 2024-09-13T06:41:27.581 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 95.648490690000003, 2024-09-13T06:41:27.581 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101736005, 2024-09-13T06:41:27.581 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:27.581 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:27.581 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:27.581 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:27.581 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:27.581 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18792 2024-09-13T06:41:27.581 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:27.581 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:27.581 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:27.581 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:27.581 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874371+0000", 2024-09-13T06:41:27.581 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:27.582 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:27.582 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:27.582 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:27.582 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874371+0000", 2024-09-13T06:41:27.582 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:27.582 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:27.582 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:27.582 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:27.582 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874370+0000", 2024-09-13T06:41:27.582 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:27.582 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:27.582 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:27.582 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:27.582 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874374+0000", 2024-09-13T06:41:27.583 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.7239999999999998e-06 2024-09-13T06:41:27.583 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:27.583 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:27.583 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:27.583 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874385+0000", 2024-09-13T06:41:27.583 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1293e-05 2024-09-13T06:41:27.583 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:27.583 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:27.583 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:27.583 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874394+0000", 2024-09-13T06:41:27.583 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.0729999999999994e-06 2024-09-13T06:41:27.583 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:27.584 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:27.584 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:27.584 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.975850+0000", 2024-09-13T06:41:27.584 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10145599700000001 2024-09-13T06:41:27.584 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:27.584 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:27.584 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:27.584 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.975963+0000", 2024-09-13T06:41:27.584 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000112689 2024-09-13T06:41:27.584 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:27.584 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:27.584 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:27.584 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.976107+0000", 2024-09-13T06:41:27.584 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000143836 2024-09-13T06:41:27.585 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:27.585 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:27.585 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:27.585 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:27.585 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:27.585 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18793 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 5840896~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:41:27.585 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.874401+0000", 2024-09-13T06:41:27.585 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 95.648460657000001, 2024-09-13T06:41:27.585 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.102005516, 2024-09-13T06:41:27.585 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:27.585 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:27.585 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:27.585 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:27.586 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:27.586 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18793 2024-09-13T06:41:27.586 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:27.586 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:27.586 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:27.586 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:27.586 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874401+0000", 2024-09-13T06:41:27.586 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:27.586 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:27.586 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:27.586 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:27.586 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874401+0000", 2024-09-13T06:41:27.586 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:27.586 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:27.587 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:27.587 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:27.587 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874400+0000", 2024-09-13T06:41:27.587 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:27.587 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:27.587 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:27.587 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:27.587 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874404+0000", 2024-09-13T06:41:27.587 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0069999999999999e-06 2024-09-13T06:41:27.587 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:27.587 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:27.587 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:27.588 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874412+0000", 2024-09-13T06:41:27.588 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.5399999999999996e-06 2024-09-13T06:41:27.588 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:27.588 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:27.588 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:27.588 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874420+0000", 2024-09-13T06:41:27.588 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.6199999999999999e-06 2024-09-13T06:41:27.588 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:27.588 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:27.588 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:27.588 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.976150+0000", 2024-09-13T06:41:27.588 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101729874 2024-09-13T06:41:27.588 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:27.588 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:27.588 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:27.589 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.976261+0000", 2024-09-13T06:41:27.589 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000110819 2024-09-13T06:41:27.589 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:27.589 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:27.589 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:27.589 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.976406+0000", 2024-09-13T06:41:27.589 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000145489 2024-09-13T06:41:27.589 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:27.589 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:27.589 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:27.589 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:27.589 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:27.589 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18803 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 6127616~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:41:27.589 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.877851+0000", 2024-09-13T06:41:27.590 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 95.645010163999999, 2024-09-13T06:41:27.590 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101951584, 2024-09-13T06:41:27.590 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:27.590 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:27.590 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:27.590 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:27.590 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:27.590 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18803 2024-09-13T06:41:27.590 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:27.590 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:27.590 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:27.590 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:27.590 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.877851+0000", 2024-09-13T06:41:27.590 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:27.591 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:27.591 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:27.591 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:27.591 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.877851+0000", 2024-09-13T06:41:27.591 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:27.591 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:27.591 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:27.591 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:27.591 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.877851+0000", 2024-09-13T06:41:27.591 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:27.591 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:27.591 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:27.591 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:27.591 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.877854+0000", 2024-09-13T06:41:27.592 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.7929999999999999e-06 2024-09-13T06:41:27.592 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:27.592 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:27.592 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:27.592 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.877864+0000", 2024-09-13T06:41:27.592 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.2029999999999998e-06 2024-09-13T06:41:27.592 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:27.592 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:27.592 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:27.592 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.877873+0000", 2024-09-13T06:41:27.592 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.0440000000000001e-06 2024-09-13T06:41:27.592 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:27.592 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:27.593 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:27.593 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.979544+0000", 2024-09-13T06:41:27.593 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101671198 2024-09-13T06:41:27.593 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:27.593 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:27.593 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:27.593 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.979658+0000", 2024-09-13T06:41:27.593 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000114456 2024-09-13T06:41:27.593 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:27.593 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:27.593 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:27.593 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.979803+0000", 2024-09-13T06:41:27.594 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000144506 2024-09-13T06:41:27.594 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:27.594 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:27.594 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:27.594 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:27.594 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:27.594 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18807 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 6242304~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:41:27.594 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.879235+0000", 2024-09-13T06:41:27.594 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 95.643626134000002, 2024-09-13T06:41:27.594 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101781258, 2024-09-13T06:41:27.594 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:27.594 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:27.594 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:27.594 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:27.594 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:27.595 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18807 2024-09-13T06:41:27.595 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:27.595 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:27.595 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:27.595 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:27.595 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879235+0000", 2024-09-13T06:41:27.595 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:27.595 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:27.595 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:27.595 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:27.595 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879235+0000", 2024-09-13T06:41:27.595 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:27.595 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:27.595 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:27.596 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:27.596 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879235+0000", 2024-09-13T06:41:27.596 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:27.596 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:27.596 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:27.596 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:27.596 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879239+0000", 2024-09-13T06:41:27.596 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.963e-06 2024-09-13T06:41:27.596 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:27.596 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:27.596 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:27.596 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879247+0000", 2024-09-13T06:41:27.597 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6470000000000004e-06 2024-09-13T06:41:27.597 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:27.597 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:27.597 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:27.597 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879255+0000", 2024-09-13T06:41:27.597 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5429999999999996e-06 2024-09-13T06:41:27.597 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:27.597 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:27.597 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:27.597 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.980756+0000", 2024-09-13T06:41:27.597 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10150165999999999 2024-09-13T06:41:27.597 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:27.597 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:27.598 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:27.598 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.980868+0000", 2024-09-13T06:41:27.598 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000111196 2024-09-13T06:41:27.598 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:27.598 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:27.598 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:27.598 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.981017+0000", 2024-09-13T06:41:27.598 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000148846 2024-09-13T06:41:27.598 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:27.598 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:27.598 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:27.598 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:27.599 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:27.599 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18808 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 6270976~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:41:27.599 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.879261+0000", 2024-09-13T06:41:27.599 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 95.643599995000002, 2024-09-13T06:41:27.599 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.102057547, 2024-09-13T06:41:27.599 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:27.599 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:27.599 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:27.599 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:27.599 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:27.599 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18808 2024-09-13T06:41:27.599 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:27.599 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:27.599 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:27.600 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:27.600 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879261+0000", 2024-09-13T06:41:27.600 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:27.600 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:27.600 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:27.600 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:27.600 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879261+0000", 2024-09-13T06:41:27.600 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:27.600 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:27.600 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:27.600 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:27.600 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879261+0000", 2024-09-13T06:41:27.600 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:27.601 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:27.601 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:27.601 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:27.601 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879264+0000", 2024-09-13T06:41:27.601 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.523e-06 2024-09-13T06:41:27.601 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:27.601 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:27.601 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:27.601 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879273+0000", 2024-09-13T06:41:27.601 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6070000000000008e-06 2024-09-13T06:41:27.601 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:27.601 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:27.601 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:27.602 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879280+0000", 2024-09-13T06:41:27.602 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.4699999999999996e-06 2024-09-13T06:41:27.602 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:27.602 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:27.602 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:27.602 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.981060+0000", 2024-09-13T06:41:27.602 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10177934800000001 2024-09-13T06:41:27.602 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:27.602 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:27.602 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:27.602 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.981174+0000", 2024-09-13T06:41:27.602 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000114456 2024-09-13T06:41:27.602 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:27.603 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:27.603 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:27.603 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.981319+0000", 2024-09-13T06:41:27.603 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00014473900000000001 2024-09-13T06:41:27.603 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:27.603 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:27.603 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:27.603 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:27.603 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:27.603 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18810 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 2662400~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:41:27.603 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.880386+0000", 2024-09-13T06:41:27.603 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 95.642475833000006, 2024-09-13T06:41:27.603 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101728022, 2024-09-13T06:41:27.604 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:27.604 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:27.604 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:27.604 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:27.604 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:27.604 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18810 2024-09-13T06:41:27.604 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:27.604 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:27.604 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:27.604 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:27.604 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880386+0000", 2024-09-13T06:41:27.604 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:27.604 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:27.605 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:27.605 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:27.605 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880386+0000", 2024-09-13T06:41:27.605 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:27.605 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:27.605 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:27.605 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:27.605 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880385+0000", 2024-09-13T06:41:27.605 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:27.605 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:27.605 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:27.605 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:27.605 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880389+0000", 2024-09-13T06:41:27.605 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.8539999999999999e-06 2024-09-13T06:41:27.606 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:27.606 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:27.606 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:27.606 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880398+0000", 2024-09-13T06:41:27.606 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.1689999999999998e-06 2024-09-13T06:41:27.606 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:27.606 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:27.606 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:27.606 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880405+0000", 2024-09-13T06:41:27.606 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5700000000000004e-06 2024-09-13T06:41:27.606 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:27.606 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:27.606 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:27.607 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.981833+0000", 2024-09-13T06:41:27.607 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10142791800000001 2024-09-13T06:41:27.607 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:27.607 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:27.607 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:27.607 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.981973+0000", 2024-09-13T06:41:27.607 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00014002900000000001 2024-09-13T06:41:27.607 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:27.607 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:27.607 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:27.607 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.982114+0000", 2024-09-13T06:41:27.607 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000140276 2024-09-13T06:41:27.607 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:27.608 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:27.608 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:27.608 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:27.608 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:27.608 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18811 3.9 3.140f5209 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:41:27.608 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.880449+0000", 2024-09-13T06:41:27.608 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 95.642412457000006, 2024-09-13T06:41:27.608 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101739355, 2024-09-13T06:41:27.608 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:27.608 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:41:27.608 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:27.608 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:27.608 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:27.608 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18811 2024-09-13T06:41:27.609 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:27.609 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:27.609 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:27.609 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:27.609 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880449+0000", 2024-09-13T06:41:27.609 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:27.609 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:27.609 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:27.609 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:27.609 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880449+0000", 2024-09-13T06:41:27.609 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:27.609 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:27.609 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:27.609 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:27.610 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880448+0000", 2024-09-13T06:41:27.610 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:27.610 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:27.610 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:27.610 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:27.610 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880452+0000", 2024-09-13T06:41:27.610 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0470000000000004e-06 2024-09-13T06:41:27.610 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:27.610 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:27.610 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:27.610 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880462+0000", 2024-09-13T06:41:27.610 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6530000000000006e-06 2024-09-13T06:41:27.611 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:27.611 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:27.611 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:27.611 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880472+0000", 2024-09-13T06:41:27.611 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0027000000000001e-05 2024-09-13T06:41:27.611 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:27.611 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:27.611 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:27.611 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.982172+0000", 2024-09-13T06:41:27.611 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10170043500000001 2024-09-13T06:41:27.611 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:27.611 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:27.611 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:27.612 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.982188+0000", 2024-09-13T06:41:27.612 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6172999999999999e-05 2024-09-13T06:41:27.612 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:27.612 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:27.612 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:27.612 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:27.612 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:27.612 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18812 3.9 3.140f5209 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:41:27.612 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.880478+0000", 2024-09-13T06:41:27.612 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 95.642383219999999, 2024-09-13T06:41:27.612 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10177795100000001, 2024-09-13T06:41:27.612 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:27.613 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:41:27.613 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:27.613 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:27.613 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:27.613 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18812 2024-09-13T06:41:27.613 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:27.613 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:27.613 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:27.613 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:27.613 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880478+0000", 2024-09-13T06:41:27.613 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:27.613 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:27.614 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:27.614 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:27.614 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880478+0000", 2024-09-13T06:41:27.614 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:27.614 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:27.614 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:27.614 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:27.614 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880477+0000", 2024-09-13T06:41:27.614 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:27.614 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:27.614 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:27.614 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:27.614 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880481+0000", 2024-09-13T06:41:27.614 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.827e-06 2024-09-13T06:41:27.615 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:27.615 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:27.615 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:27.615 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880490+0000", 2024-09-13T06:41:27.615 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6100000000000006e-06 2024-09-13T06:41:27.615 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:27.615 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:27.615 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:27.615 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880497+0000", 2024-09-13T06:41:27.615 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.7030000000000006e-06 2024-09-13T06:41:27.615 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:27.615 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:27.615 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:27.616 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.982241+0000", 2024-09-13T06:41:27.616 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10174351199999999 2024-09-13T06:41:27.616 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:27.616 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:27.616 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:27.616 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.982256+0000", 2024-09-13T06:41:27.616 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5143000000000001e-05 2024-09-13T06:41:27.616 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:27.616 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:27.616 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:27.616 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:27.616 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:27.616 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:41:27.618 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-13T06:41:27.618 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-13T06:41:27.619 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:41:27.618+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:41:27.719 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:41:27.715+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:41:27.782 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:41:27.782 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [ 2024-09-13T06:41:27.782 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:27.782 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:80183 3.d 3:b534a6e9:::rbd_object_map.1121141fb990.0000000000000044:head [call rbd.object_map_update in=38b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131)", 2024-09-13T06:41:27.782 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:41:27.781327+0000", 2024-09-13T06:41:27.783 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.001401556, 2024-09-13T06:41:27.783 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0014305889999999999, 2024-09-13T06:41:27.783 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:27.783 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:27.783 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:27.783 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:27.783 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:27.783 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 80183 2024-09-13T06:41:27.783 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:27.783 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:27.783 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:27.783 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:27.784 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:27.781327+0000", 2024-09-13T06:41:27.784 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:27.784 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:27.784 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:27.784 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:27.784 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:27.781327+0000", 2024-09-13T06:41:27.784 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:27.784 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:27.784 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:27.784 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:27.784 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:27.781326+0000", 2024-09-13T06:41:27.784 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:27.784 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:27.785 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:27.785 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:27.785 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:27.781332+0000", 2024-09-13T06:41:27.785 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.7900000000000002e-06 2024-09-13T06:41:27.785 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:27.785 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:27.785 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:27.785 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:27.781348+0000", 2024-09-13T06:41:27.785 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5420000000000001e-05 2024-09-13T06:41:27.785 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:27.785 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:27.785 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:27.786 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:27.781356+0000", 2024-09-13T06:41:27.786 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.3550000000000005e-06 2024-09-13T06:41:27.786 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:27.786 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:27.786 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:27.786 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:27.781393+0000", 2024-09-13T06:41:27.786 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.6539999999999999e-05 2024-09-13T06:41:27.786 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:27.786 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:27.786 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:27.787 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:27.781445+0000", 2024-09-13T06:41:27.787 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.2655999999999999e-05 2024-09-13T06:41:27.787 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:27.787 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:27.787 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:27.787 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:27.787 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:27.787 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:80185 3.d 3:b534a6e9:::rbd_object_map.1121141fb990.0000000000000044:head [call rbd.object_map_update in=38b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131)", 2024-09-13T06:41:27.787 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:41:27.781542+0000", 2024-09-13T06:41:27.787 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.0011858439999999999, 2024-09-13T06:41:27.788 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0012871340000000001, 2024-09-13T06:41:27.788 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:27.788 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:27.788 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:27.788 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:27.788 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:27.788 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 80185 2024-09-13T06:41:27.788 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:27.788 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:27.789 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:27.789 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:27.789 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:27.781542+0000", 2024-09-13T06:41:27.789 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:27.789 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:27.789 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:27.789 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:27.789 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:27.781542+0000", 2024-09-13T06:41:27.789 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:27.789 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:27.789 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:27.790 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:27.790 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:27.781542+0000", 2024-09-13T06:41:27.790 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:27.790 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:27.790 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:27.790 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:27.790 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:27.781547+0000", 2024-09-13T06:41:27.790 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.4650000000000002e-06 2024-09-13T06:41:27.790 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:27.790 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:27.791 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:27.791 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:27.781559+0000", 2024-09-13T06:41:27.791 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1569000000000001e-05 2024-09-13T06:41:27.791 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:27.791 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:27.791 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:27.791 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:27.781568+0000", 2024-09-13T06:41:27.791 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.8800000000000003e-06 2024-09-13T06:41:27.791 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:27.791 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:27.791 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:27.792 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:27.781936+0000", 2024-09-13T06:41:27.792 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00036718800000000001 2024-09-13T06:41:27.792 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:27.792 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:27.792 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:27.792 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:27.781988+0000", 2024-09-13T06:41:27.792 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.1999999999999997e-05 2024-09-13T06:41:27.792 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:27.792 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:27.792 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:27.792 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:27.793 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:27.793 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:80186 3.d 3:b534a6e9:::rbd_object_map.1121141fb990.0000000000000044:head [call rbd.object_map_update in=38b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131)", 2024-09-13T06:41:27.793 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:41:27.781925+0000", 2024-09-13T06:41:27.793 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.00080290299999999999, 2024-09-13T06:41:27.793 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00098328499999999998, 2024-09-13T06:41:27.793 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:27.793 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:27.793 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:27.793 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:27.793 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:27.793 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 80186 2024-09-13T06:41:27.794 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:27.794 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:27.794 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:27.794 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:27.794 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:27.781925+0000", 2024-09-13T06:41:27.794 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:27.794 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:27.794 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:27.794 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:27.794 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:27.781925+0000", 2024-09-13T06:41:27.794 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:27.794 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:27.795 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:27.795 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:27.795 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:27.781925+0000", 2024-09-13T06:41:27.795 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:27.795 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:27.795 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:27.795 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:27.795 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:27.781930+0000", 2024-09-13T06:41:27.795 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.2050000000000001e-06 2024-09-13T06:41:27.795 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:27.795 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:27.795 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:27.796 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:27.781940+0000", 2024-09-13T06:41:27.796 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0251000000000001e-05 2024-09-13T06:41:27.796 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:27.796 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:27.796 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:27.796 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:27.781947+0000", 2024-09-13T06:41:27.796 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.024e-06 2024-09-13T06:41:27.796 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:27.796 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:27.796 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:27.796 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:27.782498+0000", 2024-09-13T06:41:27.796 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00055079599999999999 2024-09-13T06:41:27.797 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:27.797 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:27.797 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:27.797 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:27.782545+0000", 2024-09-13T06:41:27.797 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.7117999999999998e-05 2024-09-13T06:41:27.797 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:27.797 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:27.797 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:27.797 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:27.797 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:27.797 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:80187 3.d 3.97652cad (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e131)", 2024-09-13T06:41:27.798 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:41:27.782038+0000", 2024-09-13T06:41:27.798 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.00069033400000000002, 2024-09-13T06:41:27.798 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00094225899999999998, 2024-09-13T06:41:27.798 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:27.798 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "queued for pg", 2024-09-13T06:41:27.798 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:27.798 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:27.798 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:27.798 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 80187 2024-09-13T06:41:27.798 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:27.798 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:27.798 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:27.798 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:27.799 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:27.782038+0000", 2024-09-13T06:41:27.799 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:27.799 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:27.799 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:27.799 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:27.799 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:27.782038+0000", 2024-09-13T06:41:27.799 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:27.799 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:27.799 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:27.799 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:27.799 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:27.782037+0000", 2024-09-13T06:41:27.799 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:27.800 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:27.800 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:27.800 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:27.800 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:27.782043+0000", 2024-09-13T06:41:27.800 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.575e-06 2024-09-13T06:41:27.800 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:27.800 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:27.800 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:27.800 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:27.782054+0000", 2024-09-13T06:41:27.800 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1344e-05 2024-09-13T06:41:27.800 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:27.800 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:27.800 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:27.801 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:27.782061+0000", 2024-09-13T06:41:27.801 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.5690000000000001e-06 2024-09-13T06:41:27.801 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:27.801 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:27.801 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:27.801 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:27.782990+0000", 2024-09-13T06:41:27.801 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00092906300000000005 2024-09-13T06:41:27.801 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:27.801 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:27.801 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:27.801 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:27.801 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:27.802 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:80188 3.d 3.97652cad (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e131)", 2024-09-13T06:41:27.802 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:41:27.782202+0000", 2024-09-13T06:41:27.802 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.00052608899999999998, 2024-09-13T06:41:27.802 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00084619899999999995, 2024-09-13T06:41:27.802 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:27.802 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "queued for pg", 2024-09-13T06:41:27.802 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:27.802 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:27.802 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:27.802 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 80188 2024-09-13T06:41:27.802 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:27.802 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:27.802 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:27.803 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:27.803 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:27.782202+0000", 2024-09-13T06:41:27.803 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:27.803 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:27.803 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:27.803 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:27.803 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:27.782202+0000", 2024-09-13T06:41:27.803 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:27.803 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:27.803 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:27.803 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:27.803 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:27.782202+0000", 2024-09-13T06:41:27.804 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:27.804 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:27.804 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:27.804 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:27.804 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:27.782207+0000", 2024-09-13T06:41:27.804 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.0579999999999997e-06 2024-09-13T06:41:27.804 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:27.804 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:27.804 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:27.804 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:27.782217+0000", 2024-09-13T06:41:27.804 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0242e-05 2024-09-13T06:41:27.804 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:27.805 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:27.805 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:27.805 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:27.782226+0000", 2024-09-13T06:41:27.805 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6780000000000006e-06 2024-09-13T06:41:27.805 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:27.805 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:27.805 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:27.805 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:27.805 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:27.805 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:80191 3.d 3.97652cad (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e131)", 2024-09-13T06:41:27.805 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:41:27.782660+0000", 2024-09-13T06:41:27.805 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 6.7891000000000004e-05, 2024-09-13T06:41:27.805 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00044603200000000001, 2024-09-13T06:41:27.806 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:27.806 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "queued for pg", 2024-09-13T06:41:27.806 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:27.806 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:27.806 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:27.806 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 80191 2024-09-13T06:41:27.806 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:27.806 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:27.806 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:27.806 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:27.806 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:27.782660+0000", 2024-09-13T06:41:27.806 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:27.807 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:27.807 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:27.807 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:27.807 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:27.782660+0000", 2024-09-13T06:41:27.807 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:27.807 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:27.807 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:27.807 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:27.807 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:27.782660+0000", 2024-09-13T06:41:27.807 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:27.807 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:27.808 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:27.808 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:27.808 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:27.782665+0000", 2024-09-13T06:41:27.808 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.1279999999999999e-06 2024-09-13T06:41:27.808 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:27.808 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:27.808 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:27.808 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:27.782674+0000", 2024-09-13T06:41:27.808 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.0270000000000001e-06 2024-09-13T06:41:27.808 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:27.808 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:27.809 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:27.809 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:27.782679+0000", 2024-09-13T06:41:27.809 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.2680000000000002e-06 2024-09-13T06:41:27.809 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:27.809 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:27.809 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:27.809 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:27.809 INFO:teuthology.orchestra.run.smithi139.stdout: ], 2024-09-13T06:41:27.809 INFO:teuthology.orchestra.run.smithi139.stdout: "num_ops": 6 2024-09-13T06:41:27.809 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:41:27.811 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-13T06:41:27.822 INFO:teuthology.orchestra.run.smithi081.stdout:osd.0: {} 2024-09-13T06:41:27.822 INFO:teuthology.orchestra.run.smithi081.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-13T06:41:27.838 INFO:teuthology.orchestra.run.smithi081.stdout:osd.1: {} 2024-09-13T06:41:27.838 INFO:teuthology.orchestra.run.smithi081.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-13T06:41:27.852 INFO:tasks.ceph.osd.6.smithi139.stderr:2024-09-13T06:41:27.851+0000 7fcd02c5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26385) UID: 0 2024-09-13T06:41:27.854 INFO:teuthology.orchestra.run.smithi081.stdout:osd.2: {} 2024-09-13T06:41:27.854 INFO:teuthology.orchestra.run.smithi081.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-13T06:41:27.869 INFO:teuthology.orchestra.run.smithi081.stdout:osd.3: {} 2024-09-13T06:41:27.870 INFO:teuthology.orchestra.run.smithi081.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-13T06:41:27.886 INFO:teuthology.orchestra.run.smithi081.stdout:osd.4: {} 2024-09-13T06:41:27.886 INFO:teuthology.orchestra.run.smithi081.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-13T06:41:27.903 INFO:teuthology.orchestra.run.smithi081.stdout:osd.5: {} 2024-09-13T06:41:27.904 INFO:teuthology.orchestra.run.smithi081.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-13T06:41:27.920 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:41:27.918+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:41:27.920 INFO:teuthology.orchestra.run.smithi081.stdout:osd.6: {} 2024-09-13T06:41:27.921 INFO:teuthology.orchestra.run.smithi081.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-13T06:41:27.921 INFO:teuthology.orchestra.run.smithi081.stderr:Error ENXIO: problem getting command descriptions from osd.7 2024-09-13T06:41:27.924 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-13T06:41:27.924 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-13T06:41:27.968 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:41:27.968 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:41:27.982 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-13T06:41:28.028 INFO:tasks.ceph.osd.6.smithi139.stderr:2024-09-13T06:41:28.027+0000 7fcd02c5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26385) UID: 0 2024-09-13T06:41:28.032 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 4, 6, 7, 5, 3] out_osds: [] dead_osds: [7] live_osds: [0, 1, 2, 3, 4, 5, 6] 2024-09-13T06:41:28.033 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-13T06:41:28.033 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap_items 2024-09-13T06:41:28.033 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-09-13T06:41:28.122 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:41:28.119+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:41:28.135 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:41:28.135 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:41:28.152 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-13T06:41:28.223 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:41:28.222+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:41:28.323 INFO:tasks.ceph.osd.6.smithi139.stderr:2024-09-13T06:41:28.319+0000 7fcd02c5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26385) UID: 0 2024-09-13T06:41:28.354 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:41:28.354 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:41:28.371 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-13T06:41:28.421 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-13T06:41:28.461 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T06:41:28.461 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:41:28.461 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 131, 2024-09-13T06:41:28.461 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "e5612297-d004-4957-927e-afa37f30d6cf", 2024-09-13T06:41:28.461 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-09-13T06:38:56.670231+0000", 2024-09-13T06:41:28.462 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-09-13T06:41:27.374379+0000", 2024-09-13T06:41:28.462 INFO:teuthology.orchestra.run.smithi081.stdout: "last_up_change": "2024-09-13T06:41:16.368018+0000", 2024-09-13T06:41:28.462 INFO:teuthology.orchestra.run.smithi081.stdout: "last_in_change": "2024-09-13T06:41:10.658104+0000", 2024-09-13T06:41:28.462 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": "noscrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-13T06:41:28.462 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_num": 5801984, 2024-09-13T06:41:28.462 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_set": [ 2024-09-13T06:41:28.462 INFO:teuthology.orchestra.run.smithi081.stdout: "noscrub", 2024-09-13T06:41:28.462 INFO:teuthology.orchestra.run.smithi081.stdout: "pglog_hardlimit", 2024-09-13T06:41:28.462 INFO:teuthology.orchestra.run.smithi081.stdout: "purged_snapdirs", 2024-09-13T06:41:28.462 INFO:teuthology.orchestra.run.smithi081.stdout: "recovery_deletes", 2024-09-13T06:41:28.462 INFO:teuthology.orchestra.run.smithi081.stdout: "sortbitwise" 2024-09-13T06:41:28.463 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-13T06:41:28.463 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_version": 4, 2024-09-13T06:41:28.463 INFO:teuthology.orchestra.run.smithi081.stdout: "full_ratio": 0.94999998807907104, 2024-09-13T06:41:28.463 INFO:teuthology.orchestra.run.smithi081.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-09-13T06:41:28.463 INFO:teuthology.orchestra.run.smithi081.stdout: "nearfull_ratio": 0.85000002384185791, 2024-09-13T06:41:28.463 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_snapshot": "", 2024-09-13T06:41:28.463 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_max": 3, 2024-09-13T06:41:28.463 INFO:teuthology.orchestra.run.smithi081.stdout: "max_osd": 8, 2024-09-13T06:41:28.463 INFO:teuthology.orchestra.run.smithi081.stdout: "require_min_compat_client": "luminous", 2024-09-13T06:41:28.463 INFO:teuthology.orchestra.run.smithi081.stdout: "min_compat_client": "luminous", 2024-09-13T06:41:28.463 INFO:teuthology.orchestra.run.smithi081.stdout: "require_osd_release": "reef", 2024-09-13T06:41:28.463 INFO:teuthology.orchestra.run.smithi081.stdout: "allow_crimson": false, 2024-09-13T06:41:28.463 INFO:teuthology.orchestra.run.smithi081.stdout: "pools": [ 2024-09-13T06:41:28.464 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:28.464 INFO:teuthology.orchestra.run.smithi081.stdout: "pool": 1, 2024-09-13T06:41:28.464 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_name": ".mgr", 2024-09-13T06:41:28.464 INFO:teuthology.orchestra.run.smithi081.stdout: "create_time": "2024-09-13T06:39:09.600726+0000", 2024-09-13T06:41:28.464 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-13T06:41:28.464 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_names": "hashpspool", 2024-09-13T06:41:28.464 INFO:teuthology.orchestra.run.smithi081.stdout: "type": 1, 2024-09-13T06:41:28.464 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 2, 2024-09-13T06:41:28.464 INFO:teuthology.orchestra.run.smithi081.stdout: "min_size": 1, 2024-09-13T06:41:28.464 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_rule": 0, 2024-09-13T06:41:28.464 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_count": 0, 2024-09-13T06:41:28.464 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_target": 0, 2024-09-13T06:41:28.464 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_barrier": 0, 2024-09-13T06:41:28.465 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-13T06:41:28.465 INFO:teuthology.orchestra.run.smithi081.stdout: "object_hash": 2, 2024-09-13T06:41:28.465 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_mode": "off", 2024-09-13T06:41:28.465 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num": 1, 2024-09-13T06:41:28.465 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num": 1, 2024-09-13T06:41:28.465 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num_target": 1, 2024-09-13T06:41:28.465 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_target": 1, 2024-09-13T06:41:28.465 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_pending": 1, 2024-09-13T06:41:28.465 INFO:teuthology.orchestra.run.smithi081.stdout: "last_pg_merge_meta": { 2024-09-13T06:41:28.465 INFO:teuthology.orchestra.run.smithi081.stdout: "source_pgid": "0.0", 2024-09-13T06:41:28.466 INFO:teuthology.orchestra.run.smithi081.stdout: "ready_epoch": 0, 2024-09-13T06:41:28.466 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_started": 0, 2024-09-13T06:41:28.466 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_clean": 0, 2024-09-13T06:41:28.466 INFO:teuthology.orchestra.run.smithi081.stdout: "source_version": "0'0", 2024-09-13T06:41:28.466 INFO:teuthology.orchestra.run.smithi081.stdout: "target_version": "0'0" 2024-09-13T06:41:28.466 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:28.466 INFO:teuthology.orchestra.run.smithi081.stdout: "last_change": "16", 2024-09-13T06:41:28.466 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend": "0", 2024-09-13T06:41:28.466 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-13T06:41:28.466 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_preluminous": "0", 2024-09-13T06:41:28.466 INFO:teuthology.orchestra.run.smithi081.stdout: "auid": 0, 2024-09-13T06:41:28.466 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_mode": "selfmanaged", 2024-09-13T06:41:28.466 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_seq": 0, 2024-09-13T06:41:28.467 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_epoch": 0, 2024-09-13T06:41:28.467 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_snaps": [], 2024-09-13T06:41:28.467 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps": "[]", 2024-09-13T06:41:28.467 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_bytes": 0, 2024-09-13T06:41:28.467 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_objects": 0, 2024-09-13T06:41:28.467 INFO:teuthology.orchestra.run.smithi081.stdout: "tiers": [], 2024-09-13T06:41:28.467 INFO:teuthology.orchestra.run.smithi081.stdout: "tier_of": -1, 2024-09-13T06:41:28.467 INFO:teuthology.orchestra.run.smithi081.stdout: "read_tier": -1, 2024-09-13T06:41:28.467 INFO:teuthology.orchestra.run.smithi081.stdout: "write_tier": -1, 2024-09-13T06:41:28.467 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_mode": "none", 2024-09-13T06:41:28.467 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_bytes": 0, 2024-09-13T06:41:28.467 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_objects": 0, 2024-09-13T06:41:28.468 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-13T06:41:28.468 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-13T06:41:28.468 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-13T06:41:28.468 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_flush_age": 0, 2024-09-13T06:41:28.468 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_evict_age": 0, 2024-09-13T06:41:28.468 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profile": "", 2024-09-13T06:41:28.468 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_params": { 2024-09-13T06:41:28.468 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "none" 2024-09-13T06:41:28.468 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:28.468 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_period": 0, 2024-09-13T06:41:28.468 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_count": 0, 2024-09-13T06:41:28.468 INFO:teuthology.orchestra.run.smithi081.stdout: "use_gmt_hitset": true, 2024-09-13T06:41:28.468 INFO:teuthology.orchestra.run.smithi081.stdout: "min_read_recency_for_promote": 0, 2024-09-13T06:41:28.469 INFO:teuthology.orchestra.run.smithi081.stdout: "min_write_recency_for_promote": 0, 2024-09-13T06:41:28.469 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_grade_decay_rate": 0, 2024-09-13T06:41:28.469 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_search_last_n": 0, 2024-09-13T06:41:28.469 INFO:teuthology.orchestra.run.smithi081.stdout: "grade_table": [], 2024-09-13T06:41:28.469 INFO:teuthology.orchestra.run.smithi081.stdout: "stripe_width": 0, 2024-09-13T06:41:28.469 INFO:teuthology.orchestra.run.smithi081.stdout: "expected_num_objects": 0, 2024-09-13T06:41:28.469 INFO:teuthology.orchestra.run.smithi081.stdout: "fast_read": false, 2024-09-13T06:41:28.469 INFO:teuthology.orchestra.run.smithi081.stdout: "options": { 2024-09-13T06:41:28.469 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_max": 32, 2024-09-13T06:41:28.470 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_min": 1 2024-09-13T06:41:28.470 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:28.470 INFO:teuthology.orchestra.run.smithi081.stdout: "application_metadata": { 2024-09-13T06:41:28.470 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": {} 2024-09-13T06:41:28.470 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:28.470 INFO:teuthology.orchestra.run.smithi081.stdout: "read_balance": { 2024-09-13T06:41:28.470 INFO:teuthology.orchestra.run.smithi081.stdout: "score_acting": 7.690000057220459, 2024-09-13T06:41:28.470 INFO:teuthology.orchestra.run.smithi081.stdout: "score_stable": 7.690000057220459, 2024-09-13T06:41:28.470 INFO:teuthology.orchestra.run.smithi081.stdout: "optimal_score": 0.12999999523162842, 2024-09-13T06:41:28.471 INFO:teuthology.orchestra.run.smithi081.stdout: "raw_score_acting": 1, 2024-09-13T06:41:28.471 INFO:teuthology.orchestra.run.smithi081.stdout: "raw_score_stable": 1, 2024-09-13T06:41:28.471 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity_weighted": 0.76841545104980469, 2024-09-13T06:41:28.471 INFO:teuthology.orchestra.run.smithi081.stdout: "average_primary_affinity": 0.76999998092651367, 2024-09-13T06:41:28.471 INFO:teuthology.orchestra.run.smithi081.stdout: "average_primary_affinity_weighted": 0.76999998092651367 2024-09-13T06:41:28.471 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:28.472 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:28.472 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:28.472 INFO:teuthology.orchestra.run.smithi081.stdout: "pool": 2, 2024-09-13T06:41:28.472 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_name": "rbd", 2024-09-13T06:41:28.472 INFO:teuthology.orchestra.run.smithi081.stdout: "create_time": "2024-09-13T06:39:15.802118+0000", 2024-09-13T06:41:28.472 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 8193, 2024-09-13T06:41:28.472 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-13T06:41:28.472 INFO:teuthology.orchestra.run.smithi081.stdout: "type": 1, 2024-09-13T06:41:28.472 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 2, 2024-09-13T06:41:28.472 INFO:teuthology.orchestra.run.smithi081.stdout: "min_size": 1, 2024-09-13T06:41:28.472 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_rule": 0, 2024-09-13T06:41:28.472 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_count": 0, 2024-09-13T06:41:28.473 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_target": 0, 2024-09-13T06:41:28.473 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_barrier": 0, 2024-09-13T06:41:28.473 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-13T06:41:28.473 INFO:teuthology.orchestra.run.smithi081.stdout: "object_hash": 2, 2024-09-13T06:41:28.473 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_mode": "off", 2024-09-13T06:41:28.473 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num": 8, 2024-09-13T06:41:28.473 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num": 8, 2024-09-13T06:41:28.473 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num_target": 8, 2024-09-13T06:41:28.473 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_target": 8, 2024-09-13T06:41:28.473 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_pending": 8, 2024-09-13T06:41:28.473 INFO:teuthology.orchestra.run.smithi081.stdout: "last_pg_merge_meta": { 2024-09-13T06:41:28.473 INFO:teuthology.orchestra.run.smithi081.stdout: "source_pgid": "0.0", 2024-09-13T06:41:28.474 INFO:teuthology.orchestra.run.smithi081.stdout: "ready_epoch": 0, 2024-09-13T06:41:28.474 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_started": 0, 2024-09-13T06:41:28.474 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_clean": 0, 2024-09-13T06:41:28.474 INFO:teuthology.orchestra.run.smithi081.stdout: "source_version": "0'0", 2024-09-13T06:41:28.474 INFO:teuthology.orchestra.run.smithi081.stdout: "target_version": "0'0" 2024-09-13T06:41:28.474 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:28.474 INFO:teuthology.orchestra.run.smithi081.stdout: "last_change": "20", 2024-09-13T06:41:28.474 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend": "0", 2024-09-13T06:41:28.474 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-13T06:41:28.474 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_preluminous": "0", 2024-09-13T06:41:28.474 INFO:teuthology.orchestra.run.smithi081.stdout: "auid": 0, 2024-09-13T06:41:28.474 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_mode": "selfmanaged", 2024-09-13T06:41:28.474 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_seq": 3, 2024-09-13T06:41:28.474 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_epoch": 20, 2024-09-13T06:41:28.474 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_snaps": [], 2024-09-13T06:41:28.475 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps": "[]", 2024-09-13T06:41:28.475 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_bytes": 0, 2024-09-13T06:41:28.475 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_objects": 0, 2024-09-13T06:41:28.475 INFO:teuthology.orchestra.run.smithi081.stdout: "tiers": [], 2024-09-13T06:41:28.475 INFO:teuthology.orchestra.run.smithi081.stdout: "tier_of": -1, 2024-09-13T06:41:28.475 INFO:teuthology.orchestra.run.smithi081.stdout: "read_tier": -1, 2024-09-13T06:41:28.475 INFO:teuthology.orchestra.run.smithi081.stdout: "write_tier": -1, 2024-09-13T06:41:28.475 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_mode": "none", 2024-09-13T06:41:28.475 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_bytes": 0, 2024-09-13T06:41:28.475 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_objects": 0, 2024-09-13T06:41:28.475 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-13T06:41:28.475 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-13T06:41:28.475 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-13T06:41:28.475 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_flush_age": 0, 2024-09-13T06:41:28.476 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_evict_age": 0, 2024-09-13T06:41:28.476 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profile": "", 2024-09-13T06:41:28.476 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_params": { 2024-09-13T06:41:28.476 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "none" 2024-09-13T06:41:28.476 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:28.476 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_period": 0, 2024-09-13T06:41:28.476 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_count": 0, 2024-09-13T06:41:28.476 INFO:teuthology.orchestra.run.smithi081.stdout: "use_gmt_hitset": true, 2024-09-13T06:41:28.476 INFO:teuthology.orchestra.run.smithi081.stdout: "min_read_recency_for_promote": 0, 2024-09-13T06:41:28.476 INFO:teuthology.orchestra.run.smithi081.stdout: "min_write_recency_for_promote": 0, 2024-09-13T06:41:28.476 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_grade_decay_rate": 0, 2024-09-13T06:41:28.476 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_search_last_n": 0, 2024-09-13T06:41:28.476 INFO:teuthology.orchestra.run.smithi081.stdout: "grade_table": [], 2024-09-13T06:41:28.476 INFO:teuthology.orchestra.run.smithi081.stdout: "stripe_width": 0, 2024-09-13T06:41:28.476 INFO:teuthology.orchestra.run.smithi081.stdout: "expected_num_objects": 0, 2024-09-13T06:41:28.477 INFO:teuthology.orchestra.run.smithi081.stdout: "fast_read": false, 2024-09-13T06:41:28.477 INFO:teuthology.orchestra.run.smithi081.stdout: "options": {}, 2024-09-13T06:41:28.477 INFO:teuthology.orchestra.run.smithi081.stdout: "application_metadata": { 2024-09-13T06:41:28.477 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd": {} 2024-09-13T06:41:28.477 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:28.477 INFO:teuthology.orchestra.run.smithi081.stdout: "read_balance": { 2024-09-13T06:41:28.477 INFO:teuthology.orchestra.run.smithi081.stdout: "score_acting": 4, 2024-09-13T06:41:28.477 INFO:teuthology.orchestra.run.smithi081.stdout: "score_stable": 4, 2024-09-13T06:41:28.477 INFO:teuthology.orchestra.run.smithi081.stdout: "optimal_score": 0.75, 2024-09-13T06:41:28.477 INFO:teuthology.orchestra.run.smithi081.stdout: "raw_score_acting": 3, 2024-09-13T06:41:28.477 INFO:teuthology.orchestra.run.smithi081.stdout: "raw_score_stable": 3, 2024-09-13T06:41:28.477 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity_weighted": 0.76841545104980469, 2024-09-13T06:41:28.477 INFO:teuthology.orchestra.run.smithi081.stdout: "average_primary_affinity": 0.76999998092651367, 2024-09-13T06:41:28.478 INFO:teuthology.orchestra.run.smithi081.stdout: "average_primary_affinity_weighted": 0.76999998092651367 2024-09-13T06:41:28.478 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:28.478 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:28.478 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:28.478 INFO:teuthology.orchestra.run.smithi081.stdout: "pool": 3, 2024-09-13T06:41:28.478 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_name": "pool_client.0", 2024-09-13T06:41:28.478 INFO:teuthology.orchestra.run.smithi081.stdout: "create_time": "2024-09-13T06:39:25.648942+0000", 2024-09-13T06:41:28.478 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 8193, 2024-09-13T06:41:28.478 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-13T06:41:28.478 INFO:teuthology.orchestra.run.smithi081.stdout: "type": 1, 2024-09-13T06:41:28.478 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 2, 2024-09-13T06:41:28.478 INFO:teuthology.orchestra.run.smithi081.stdout: "min_size": 1, 2024-09-13T06:41:28.478 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_rule": 0, 2024-09-13T06:41:28.478 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_count": 0, 2024-09-13T06:41:28.478 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_target": 0, 2024-09-13T06:41:28.479 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_barrier": 0, 2024-09-13T06:41:28.479 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-13T06:41:28.479 INFO:teuthology.orchestra.run.smithi081.stdout: "object_hash": 2, 2024-09-13T06:41:28.479 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_mode": "off", 2024-09-13T06:41:28.479 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num": 32, 2024-09-13T06:41:28.479 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num": 32, 2024-09-13T06:41:28.479 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num_target": 32, 2024-09-13T06:41:28.479 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_target": 32, 2024-09-13T06:41:28.479 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_pending": 32, 2024-09-13T06:41:28.479 INFO:teuthology.orchestra.run.smithi081.stdout: "last_pg_merge_meta": { 2024-09-13T06:41:28.479 INFO:teuthology.orchestra.run.smithi081.stdout: "source_pgid": "0.0", 2024-09-13T06:41:28.479 INFO:teuthology.orchestra.run.smithi081.stdout: "ready_epoch": 0, 2024-09-13T06:41:28.479 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_started": 0, 2024-09-13T06:41:28.479 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_clean": 0, 2024-09-13T06:41:28.480 INFO:teuthology.orchestra.run.smithi081.stdout: "source_version": "0'0", 2024-09-13T06:41:28.480 INFO:teuthology.orchestra.run.smithi081.stdout: "target_version": "0'0" 2024-09-13T06:41:28.480 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:28.480 INFO:teuthology.orchestra.run.smithi081.stdout: "last_change": "131", 2024-09-13T06:41:28.480 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend": "0", 2024-09-13T06:41:28.480 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-13T06:41:28.480 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_preluminous": "0", 2024-09-13T06:41:28.480 INFO:teuthology.orchestra.run.smithi081.stdout: "auid": 0, 2024-09-13T06:41:28.480 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_mode": "selfmanaged", 2024-09-13T06:41:28.480 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_seq": 68, 2024-09-13T06:41:28.480 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_epoch": 131, 2024-09-13T06:41:28.480 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_snaps": [], 2024-09-13T06:41:28.480 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps": "[]", 2024-09-13T06:41:28.480 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_bytes": 0, 2024-09-13T06:41:28.481 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_objects": 0, 2024-09-13T06:41:28.481 INFO:teuthology.orchestra.run.smithi081.stdout: "tiers": [], 2024-09-13T06:41:28.481 INFO:teuthology.orchestra.run.smithi081.stdout: "tier_of": -1, 2024-09-13T06:41:28.481 INFO:teuthology.orchestra.run.smithi081.stdout: "read_tier": -1, 2024-09-13T06:41:28.481 INFO:teuthology.orchestra.run.smithi081.stdout: "write_tier": -1, 2024-09-13T06:41:28.481 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_mode": "none", 2024-09-13T06:41:28.481 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_bytes": 0, 2024-09-13T06:41:28.481 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_objects": 0, 2024-09-13T06:41:28.481 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-13T06:41:28.481 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-13T06:41:28.481 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-13T06:41:28.481 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_flush_age": 0, 2024-09-13T06:41:28.481 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_evict_age": 0, 2024-09-13T06:41:28.482 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profile": "", 2024-09-13T06:41:28.482 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_params": { 2024-09-13T06:41:28.482 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "none" 2024-09-13T06:41:28.482 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:28.482 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_period": 0, 2024-09-13T06:41:28.482 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_count": 0, 2024-09-13T06:41:28.482 INFO:teuthology.orchestra.run.smithi081.stdout: "use_gmt_hitset": true, 2024-09-13T06:41:28.482 INFO:teuthology.orchestra.run.smithi081.stdout: "min_read_recency_for_promote": 0, 2024-09-13T06:41:28.482 INFO:teuthology.orchestra.run.smithi081.stdout: "min_write_recency_for_promote": 0, 2024-09-13T06:41:28.482 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_grade_decay_rate": 0, 2024-09-13T06:41:28.482 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_search_last_n": 0, 2024-09-13T06:41:28.482 INFO:teuthology.orchestra.run.smithi081.stdout: "grade_table": [], 2024-09-13T06:41:28.482 INFO:teuthology.orchestra.run.smithi081.stdout: "stripe_width": 0, 2024-09-13T06:41:28.483 INFO:teuthology.orchestra.run.smithi081.stdout: "expected_num_objects": 0, 2024-09-13T06:41:28.483 INFO:teuthology.orchestra.run.smithi081.stdout: "fast_read": false, 2024-09-13T06:41:28.483 INFO:teuthology.orchestra.run.smithi081.stdout: "options": {}, 2024-09-13T06:41:28.483 INFO:teuthology.orchestra.run.smithi081.stdout: "application_metadata": { 2024-09-13T06:41:28.483 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd": {} 2024-09-13T06:41:28.483 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:28.483 INFO:teuthology.orchestra.run.smithi081.stdout: "read_balance": { 2024-09-13T06:41:28.483 INFO:teuthology.orchestra.run.smithi081.stdout: "score_acting": 2.4900000095367432, 2024-09-13T06:41:28.483 INFO:teuthology.orchestra.run.smithi081.stdout: "score_stable": 2.4900000095367432, 2024-09-13T06:41:28.483 INFO:teuthology.orchestra.run.smithi081.stdout: "optimal_score": 0.87999999523162842, 2024-09-13T06:41:28.483 INFO:teuthology.orchestra.run.smithi081.stdout: "raw_score_acting": 2.190000057220459, 2024-09-13T06:41:28.483 INFO:teuthology.orchestra.run.smithi081.stdout: "raw_score_stable": 2.190000057220459, 2024-09-13T06:41:28.484 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity_weighted": 0.76841545104980469, 2024-09-13T06:41:28.484 INFO:teuthology.orchestra.run.smithi081.stdout: "average_primary_affinity": 0.76999998092651367, 2024-09-13T06:41:28.484 INFO:teuthology.orchestra.run.smithi081.stdout: "average_primary_affinity_weighted": 0.76999998092651367 2024-09-13T06:41:28.484 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:28.484 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:28.484 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-13T06:41:28.484 INFO:teuthology.orchestra.run.smithi081.stdout: "osds": [ 2024-09-13T06:41:28.484 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:28.484 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 0, 2024-09-13T06:41:28.484 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "54b0a3e4-58ad-4f95-86dc-29a11c9a1964", 2024-09-13T06:41:28.484 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2024-09-13T06:41:28.484 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2024-09-13T06:41:28.484 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2024-09-13T06:41:28.485 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 0.485382080078125, 2024-09-13T06:41:28.485 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2024-09-13T06:41:28.485 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2024-09-13T06:41:28.485 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2024-09-13T06:41:28.485 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 122, 2024-09-13T06:41:28.485 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2024-09-13T06:41:28.485 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2024-09-13T06:41:28.485 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-13T06:41:28.485 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:41:28.485 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:28.485 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:41:28.485 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6808", 2024-09-13T06:41:28.485 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 1904727940 2024-09-13T06:41:28.486 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:28.486 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:28.486 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:41:28.486 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6809", 2024-09-13T06:41:28.486 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 1904727940 2024-09-13T06:41:28.486 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:28.486 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:28.486 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:28.486 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2024-09-13T06:41:28.486 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:41:28.486 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:28.486 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:41:28.487 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6810", 2024-09-13T06:41:28.487 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 1904727940 2024-09-13T06:41:28.487 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:28.487 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:28.487 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:41:28.487 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6811", 2024-09-13T06:41:28.487 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 1904727940 2024-09-13T06:41:28.487 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:28.487 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:28.487 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:28.487 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2024-09-13T06:41:28.487 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:41:28.487 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:28.488 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:41:28.488 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6814", 2024-09-13T06:41:28.488 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 1904727940 2024-09-13T06:41:28.488 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:28.488 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:28.488 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:41:28.488 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6815", 2024-09-13T06:41:28.488 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 1904727940 2024-09-13T06:41:28.488 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:28.488 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:28.488 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:28.488 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2024-09-13T06:41:28.489 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:41:28.489 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:28.489 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:41:28.489 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6812", 2024-09-13T06:41:28.489 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 1904727940 2024-09-13T06:41:28.489 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:28.489 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:28.489 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:41:28.489 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6813", 2024-09-13T06:41:28.489 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 1904727940 2024-09-13T06:41:28.489 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:28.489 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:28.490 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:28.490 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6809/1904727940", 2024-09-13T06:41:28.490 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.81:6811/1904727940", 2024-09-13T06:41:28.490 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.81:6815/1904727940", 2024-09-13T06:41:28.490 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.81:6813/1904727940", 2024-09-13T06:41:28.490 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2024-09-13T06:41:28.490 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2024-09-13T06:41:28.490 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2024-09-13T06:41:28.490 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:28.490 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:28.490 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:28.490 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 1, 2024-09-13T06:41:28.491 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "a6dba5b9-c833-465e-a8a5-1741528b24c0", 2024-09-13T06:41:28.491 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2024-09-13T06:41:28.491 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2024-09-13T06:41:28.491 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2024-09-13T06:41:28.491 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2024-09-13T06:41:28.491 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2024-09-13T06:41:28.491 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2024-09-13T06:41:28.491 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2024-09-13T06:41:28.491 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 122, 2024-09-13T06:41:28.491 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2024-09-13T06:41:28.491 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2024-09-13T06:41:28.491 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-13T06:41:28.492 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:41:28.492 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:28.492 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:41:28.492 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6817", 2024-09-13T06:41:28.492 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 738205570 2024-09-13T06:41:28.492 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:28.492 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:28.492 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:41:28.492 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6819", 2024-09-13T06:41:28.492 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 738205570 2024-09-13T06:41:28.492 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:28.492 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:28.492 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:28.492 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2024-09-13T06:41:28.493 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:41:28.493 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:28.493 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:41:28.493 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6822", 2024-09-13T06:41:28.493 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 738205570 2024-09-13T06:41:28.493 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:28.493 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:28.493 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:41:28.493 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6824", 2024-09-13T06:41:28.493 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 738205570 2024-09-13T06:41:28.493 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:28.493 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:28.493 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:28.494 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2024-09-13T06:41:28.494 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:41:28.494 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:28.494 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:41:28.494 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6830", 2024-09-13T06:41:28.494 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 738205570 2024-09-13T06:41:28.494 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:28.494 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:28.494 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:41:28.494 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6831", 2024-09-13T06:41:28.494 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 738205570 2024-09-13T06:41:28.494 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:28.494 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:28.494 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:28.494 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2024-09-13T06:41:28.494 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:41:28.495 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:28.495 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:41:28.495 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6826", 2024-09-13T06:41:28.495 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 738205570 2024-09-13T06:41:28.495 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:28.495 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:28.495 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:41:28.495 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6829", 2024-09-13T06:41:28.495 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 738205570 2024-09-13T06:41:28.495 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:28.495 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:28.495 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:28.496 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6819/738205570", 2024-09-13T06:41:28.496 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.81:6824/738205570", 2024-09-13T06:41:28.496 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.81:6831/738205570", 2024-09-13T06:41:28.496 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.81:6829/738205570", 2024-09-13T06:41:28.496 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2024-09-13T06:41:28.496 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2024-09-13T06:41:28.497 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2024-09-13T06:41:28.497 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:28.497 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:28.497 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:28.497 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 2, 2024-09-13T06:41:28.497 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "6c45097e-44a2-454f-80a4-0fe879ccd52f", 2024-09-13T06:41:28.497 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2024-09-13T06:41:28.497 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2024-09-13T06:41:28.498 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2024-09-13T06:41:28.498 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2024-09-13T06:41:28.498 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2024-09-13T06:41:28.498 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2024-09-13T06:41:28.498 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2024-09-13T06:41:28.498 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 122, 2024-09-13T06:41:28.498 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2024-09-13T06:41:28.498 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2024-09-13T06:41:28.498 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-13T06:41:28.498 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:41:28.498 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:28.498 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:41:28.498 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6816", 2024-09-13T06:41:28.498 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 3558674335 2024-09-13T06:41:28.498 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:28.499 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:28.499 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:41:28.499 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6818", 2024-09-13T06:41:28.499 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 3558674335 2024-09-13T06:41:28.499 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:28.499 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:28.499 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:28.499 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2024-09-13T06:41:28.499 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:41:28.499 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:28.499 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:41:28.499 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6820", 2024-09-13T06:41:28.499 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 3558674335 2024-09-13T06:41:28.499 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:28.499 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:28.500 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:41:28.500 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6821", 2024-09-13T06:41:28.500 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 3558674335 2024-09-13T06:41:28.500 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:28.500 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:28.500 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:28.500 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2024-09-13T06:41:28.500 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:41:28.500 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:28.500 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:41:28.500 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6827", 2024-09-13T06:41:28.500 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 3558674335 2024-09-13T06:41:28.500 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:28.500 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:28.501 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:41:28.501 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6828", 2024-09-13T06:41:28.501 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 3558674335 2024-09-13T06:41:28.501 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:28.501 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:28.501 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:28.501 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2024-09-13T06:41:28.501 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:41:28.501 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:28.501 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:41:28.501 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6823", 2024-09-13T06:41:28.501 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 3558674335 2024-09-13T06:41:28.501 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:28.501 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:28.502 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:41:28.502 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6825", 2024-09-13T06:41:28.502 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 3558674335 2024-09-13T06:41:28.502 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:28.502 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:28.502 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:28.502 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6818/3558674335", 2024-09-13T06:41:28.502 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.81:6821/3558674335", 2024-09-13T06:41:28.502 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.81:6828/3558674335", 2024-09-13T06:41:28.502 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.81:6825/3558674335", 2024-09-13T06:41:28.502 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2024-09-13T06:41:28.502 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2024-09-13T06:41:28.502 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2024-09-13T06:41:28.502 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:28.503 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:28.503 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:28.503 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 3, 2024-09-13T06:41:28.503 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "31952760-06f3-4618-a5c4-f5c4fed3aadb", 2024-09-13T06:41:28.503 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2024-09-13T06:41:28.503 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2024-09-13T06:41:28.503 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2024-09-13T06:41:28.503 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2024-09-13T06:41:28.503 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2024-09-13T06:41:28.503 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2024-09-13T06:41:28.503 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2024-09-13T06:41:28.503 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 122, 2024-09-13T06:41:28.504 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2024-09-13T06:41:28.504 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2024-09-13T06:41:28.504 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-13T06:41:28.504 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:41:28.504 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:28.504 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:41:28.504 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6800", 2024-09-13T06:41:28.504 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 1886327229 2024-09-13T06:41:28.504 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:28.505 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:28.505 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:41:28.505 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6801", 2024-09-13T06:41:28.505 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 1886327229 2024-09-13T06:41:28.505 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:28.505 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:28.505 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:28.505 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2024-09-13T06:41:28.505 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:41:28.505 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:28.506 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:41:28.506 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6802", 2024-09-13T06:41:28.506 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 1886327229 2024-09-13T06:41:28.506 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:28.506 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:28.506 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:41:28.506 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6803", 2024-09-13T06:41:28.506 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 1886327229 2024-09-13T06:41:28.506 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:28.506 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:28.506 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:28.506 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2024-09-13T06:41:28.507 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:41:28.507 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:28.507 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:41:28.507 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6806", 2024-09-13T06:41:28.507 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 1886327229 2024-09-13T06:41:28.507 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:28.507 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:28.507 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:41:28.507 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6807", 2024-09-13T06:41:28.507 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 1886327229 2024-09-13T06:41:28.507 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:28.508 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:28.508 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:28.508 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2024-09-13T06:41:28.508 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:41:28.508 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:28.508 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:41:28.508 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6804", 2024-09-13T06:41:28.508 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 1886327229 2024-09-13T06:41:28.509 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:28.509 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:28.509 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:41:28.509 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6805", 2024-09-13T06:41:28.509 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 1886327229 2024-09-13T06:41:28.509 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:28.509 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:28.509 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:28.509 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6801/1886327229", 2024-09-13T06:41:28.509 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.81:6803/1886327229", 2024-09-13T06:41:28.509 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.81:6807/1886327229", 2024-09-13T06:41:28.509 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.81:6805/1886327229", 2024-09-13T06:41:28.509 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2024-09-13T06:41:28.509 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2024-09-13T06:41:28.510 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2024-09-13T06:41:28.510 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:28.510 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:28.510 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:28.510 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 4, 2024-09-13T06:41:28.510 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "c9bd2751-c836-43dc-b844-e13678cb2fd9", 2024-09-13T06:41:28.510 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2024-09-13T06:41:28.510 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2024-09-13T06:41:28.510 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0.58685302734375, 2024-09-13T06:41:28.510 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2024-09-13T06:41:28.510 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2024-09-13T06:41:28.510 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2024-09-13T06:41:28.510 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2024-09-13T06:41:28.510 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 122, 2024-09-13T06:41:28.511 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2024-09-13T06:41:28.511 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2024-09-13T06:41:28.511 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-13T06:41:28.511 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:41:28.511 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:28.511 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:41:28.511 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6817", 2024-09-13T06:41:28.511 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2184515621 2024-09-13T06:41:28.511 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:28.511 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:28.511 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:41:28.511 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6819", 2024-09-13T06:41:28.511 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2184515621 2024-09-13T06:41:28.511 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:28.511 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:28.512 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:28.512 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2024-09-13T06:41:28.512 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:41:28.512 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:28.512 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:41:28.512 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6820", 2024-09-13T06:41:28.512 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2184515621 2024-09-13T06:41:28.512 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:28.512 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:28.512 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:41:28.512 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6822", 2024-09-13T06:41:28.513 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2184515621 2024-09-13T06:41:28.513 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:28.513 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:28.513 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:28.513 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2024-09-13T06:41:28.513 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:41:28.513 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:28.513 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:41:28.513 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6827", 2024-09-13T06:41:28.513 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2184515621 2024-09-13T06:41:28.513 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:28.513 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:28.514 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:41:28.514 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6829", 2024-09-13T06:41:28.514 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2184515621 2024-09-13T06:41:28.514 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:28.514 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:28.514 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:28.514 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2024-09-13T06:41:28.514 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:41:28.514 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:28.514 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:41:28.514 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6824", 2024-09-13T06:41:28.514 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2184515621 2024-09-13T06:41:28.515 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:28.515 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:28.515 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:41:28.515 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6826", 2024-09-13T06:41:28.515 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2184515621 2024-09-13T06:41:28.515 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:28.515 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:28.515 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:28.515 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.139:6819/2184515621", 2024-09-13T06:41:28.515 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.139:6822/2184515621", 2024-09-13T06:41:28.515 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.139:6829/2184515621", 2024-09-13T06:41:28.515 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.139:6826/2184515621", 2024-09-13T06:41:28.515 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2024-09-13T06:41:28.515 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2024-09-13T06:41:28.516 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2024-09-13T06:41:28.516 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:28.516 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:28.516 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:28.516 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 5, 2024-09-13T06:41:28.516 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "2971b93a-6c9f-4b77-b526-4eac788fabf9", 2024-09-13T06:41:28.516 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2024-09-13T06:41:28.516 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2024-09-13T06:41:28.516 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2024-09-13T06:41:28.516 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 0.115264892578125, 2024-09-13T06:41:28.516 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2024-09-13T06:41:28.516 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2024-09-13T06:41:28.516 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2024-09-13T06:41:28.516 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 122, 2024-09-13T06:41:28.516 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2024-09-13T06:41:28.517 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2024-09-13T06:41:28.517 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-13T06:41:28.517 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:41:28.517 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:28.517 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:41:28.517 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6816", 2024-09-13T06:41:28.517 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 3982901834 2024-09-13T06:41:28.517 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:28.517 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:28.517 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:41:28.517 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6818", 2024-09-13T06:41:28.518 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 3982901834 2024-09-13T06:41:28.518 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:28.518 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:28.518 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:28.518 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2024-09-13T06:41:28.518 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:41:28.518 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:28.518 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:41:28.518 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6821", 2024-09-13T06:41:28.518 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 3982901834 2024-09-13T06:41:28.518 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:28.518 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:28.518 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:41:28.519 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6823", 2024-09-13T06:41:28.519 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 3982901834 2024-09-13T06:41:28.519 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:28.519 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:28.519 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:28.519 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2024-09-13T06:41:28.519 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:41:28.519 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:28.519 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:41:28.519 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6830", 2024-09-13T06:41:28.519 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 3982901834 2024-09-13T06:41:28.519 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:28.519 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:28.519 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:41:28.520 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6831", 2024-09-13T06:41:28.520 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 3982901834 2024-09-13T06:41:28.520 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:28.520 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:28.520 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:28.520 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2024-09-13T06:41:28.520 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:41:28.520 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:28.520 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:41:28.520 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6825", 2024-09-13T06:41:28.520 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 3982901834 2024-09-13T06:41:28.521 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:28.521 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:28.521 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:41:28.521 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6828", 2024-09-13T06:41:28.521 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 3982901834 2024-09-13T06:41:28.521 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:28.521 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:28.521 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:28.521 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.139:6818/3982901834", 2024-09-13T06:41:28.521 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.139:6823/3982901834", 2024-09-13T06:41:28.521 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.139:6831/3982901834", 2024-09-13T06:41:28.521 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.139:6828/3982901834", 2024-09-13T06:41:28.521 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2024-09-13T06:41:28.522 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2024-09-13T06:41:28.522 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2024-09-13T06:41:28.522 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:28.522 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:28.522 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:28.522 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 6, 2024-09-13T06:41:28.522 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "e1f786ce-579e-48cc-b212-83f881b94184", 2024-09-13T06:41:28.522 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2024-09-13T06:41:28.522 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2024-09-13T06:41:28.522 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2024-09-13T06:41:28.522 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 0.5466766357421875, 2024-09-13T06:41:28.522 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2024-09-13T06:41:28.522 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2024-09-13T06:41:28.523 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2024-09-13T06:41:28.523 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 122, 2024-09-13T06:41:28.523 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2024-09-13T06:41:28.523 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2024-09-13T06:41:28.523 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-13T06:41:28.523 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:41:28.523 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:28.523 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:41:28.523 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6800", 2024-09-13T06:41:28.523 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2283932666 2024-09-13T06:41:28.523 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:28.523 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:28.523 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:41:28.523 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6801", 2024-09-13T06:41:28.524 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2283932666 2024-09-13T06:41:28.524 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:28.524 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:28.524 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:28.524 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2024-09-13T06:41:28.524 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:41:28.524 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:28.524 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:41:28.524 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6802", 2024-09-13T06:41:28.524 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2283932666 2024-09-13T06:41:28.524 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:28.524 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:28.524 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:41:28.525 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6803", 2024-09-13T06:41:28.525 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2283932666 2024-09-13T06:41:28.525 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:28.525 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:28.525 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:28.525 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2024-09-13T06:41:28.525 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:41:28.525 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:28.525 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:41:28.525 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6806", 2024-09-13T06:41:28.525 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2283932666 2024-09-13T06:41:28.525 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:28.525 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:28.526 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:41:28.526 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6807", 2024-09-13T06:41:28.526 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2283932666 2024-09-13T06:41:28.526 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:28.526 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:28.526 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:28.526 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2024-09-13T06:41:28.526 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:41:28.526 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:28.526 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:41:28.526 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6804", 2024-09-13T06:41:28.526 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2283932666 2024-09-13T06:41:28.526 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:28.526 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:28.527 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:41:28.527 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6805", 2024-09-13T06:41:28.527 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2283932666 2024-09-13T06:41:28.527 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:28.527 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:28.527 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:28.527 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.139:6801/2283932666", 2024-09-13T06:41:28.527 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.139:6803/2283932666", 2024-09-13T06:41:28.527 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.139:6807/2283932666", 2024-09-13T06:41:28.527 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.139:6805/2283932666", 2024-09-13T06:41:28.527 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2024-09-13T06:41:28.527 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2024-09-13T06:41:28.527 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2024-09-13T06:41:28.527 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:28.528 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:28.528 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:28.528 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 7, 2024-09-13T06:41:28.528 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "a287ddf6-84eb-4225-b267-25eee1657625", 2024-09-13T06:41:28.528 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 0, 2024-09-13T06:41:28.528 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2024-09-13T06:41:28.528 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2024-09-13T06:41:28.528 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2024-09-13T06:41:28.528 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2024-09-13T06:41:28.528 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2024-09-13T06:41:28.528 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2024-09-13T06:41:28.528 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 113, 2024-09-13T06:41:28.528 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 122, 2024-09-13T06:41:28.529 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2024-09-13T06:41:28.529 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-13T06:41:28.529 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:41:28.529 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:28.529 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:41:28.529 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6808", 2024-09-13T06:41:28.529 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2348111157 2024-09-13T06:41:28.529 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:28.529 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:28.529 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:41:28.529 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6809", 2024-09-13T06:41:28.529 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2348111157 2024-09-13T06:41:28.529 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:28.530 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:28.530 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:28.530 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2024-09-13T06:41:28.530 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:41:28.530 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:28.530 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:41:28.530 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6810", 2024-09-13T06:41:28.530 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2348111157 2024-09-13T06:41:28.530 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:28.530 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:28.530 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:41:28.531 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6811", 2024-09-13T06:41:28.531 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2348111157 2024-09-13T06:41:28.531 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:28.531 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:28.531 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:28.531 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2024-09-13T06:41:28.531 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:41:28.531 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:28.531 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:41:28.531 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6814", 2024-09-13T06:41:28.531 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2348111157 2024-09-13T06:41:28.531 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:28.531 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:28.531 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:41:28.532 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6815", 2024-09-13T06:41:28.532 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2348111157 2024-09-13T06:41:28.532 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:28.532 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:28.532 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:28.532 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2024-09-13T06:41:28.532 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:41:28.532 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:28.532 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:41:28.532 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6812", 2024-09-13T06:41:28.532 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2348111157 2024-09-13T06:41:28.532 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:28.532 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:28.533 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:41:28.533 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6813", 2024-09-13T06:41:28.533 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2348111157 2024-09-13T06:41:28.533 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:28.533 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:28.533 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:28.533 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.139:6809/2348111157", 2024-09-13T06:41:28.533 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.139:6811/2348111157", 2024-09-13T06:41:28.533 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.139:6815/2348111157", 2024-09-13T06:41:28.533 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.139:6813/2348111157", 2024-09-13T06:41:28.533 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2024-09-13T06:41:28.533 INFO:teuthology.orchestra.run.smithi081.stdout: "exists" 2024-09-13T06:41:28.534 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:28.534 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:28.534 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-13T06:41:28.534 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_xinfo": [ 2024-09-13T06:41:28.534 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:28.534 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 0, 2024-09-13T06:41:28.534 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2024-09-13T06:41:28.534 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2024-09-13T06:41:28.534 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2024-09-13T06:41:28.534 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138322906710015, 2024-09-13T06:41:28.534 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2024-09-13T06:41:28.534 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2024-09-13T06:39:05.476871+0000", 2024-09-13T06:41:28.534 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2024-09-13T06:41:28.534 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:28.535 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:28.535 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 1, 2024-09-13T06:41:28.535 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2024-09-13T06:41:28.535 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2024-09-13T06:41:28.535 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2024-09-13T06:41:28.535 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138322906710015, 2024-09-13T06:41:28.535 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2024-09-13T06:41:28.535 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2024-09-13T06:39:05.455183+0000", 2024-09-13T06:41:28.535 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2024-09-13T06:41:28.535 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:28.535 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:28.535 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 2, 2024-09-13T06:41:28.535 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2024-09-13T06:41:28.535 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2024-09-13T06:41:28.535 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2024-09-13T06:41:28.536 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138322906710015, 2024-09-13T06:41:28.536 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2024-09-13T06:41:28.536 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2024-09-13T06:39:05.504853+0000", 2024-09-13T06:41:28.536 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2024-09-13T06:41:28.536 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:28.536 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:28.536 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 3, 2024-09-13T06:41:28.536 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2024-09-13T06:41:28.536 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2024-09-13T06:41:28.536 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2024-09-13T06:41:28.536 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138322906710015, 2024-09-13T06:41:28.536 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2024-09-13T06:41:28.537 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2024-09-13T06:39:05.372429+0000", 2024-09-13T06:41:28.537 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2024-09-13T06:41:28.537 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:28.537 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:28.537 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 4, 2024-09-13T06:41:28.537 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2024-09-13T06:41:28.537 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2024-09-13T06:41:28.537 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2024-09-13T06:41:28.537 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138322906710015, 2024-09-13T06:41:28.537 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2024-09-13T06:41:28.537 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2024-09-13T06:39:05.421023+0000", 2024-09-13T06:41:28.537 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2024-09-13T06:41:28.537 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:28.537 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:28.537 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 5, 2024-09-13T06:41:28.538 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2024-09-13T06:41:28.538 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2024-09-13T06:41:28.538 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2024-09-13T06:41:28.538 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138322906710015, 2024-09-13T06:41:28.538 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2024-09-13T06:41:28.538 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2024-09-13T06:39:05.477489+0000", 2024-09-13T06:41:28.538 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2024-09-13T06:41:28.538 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:28.538 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:28.538 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 6, 2024-09-13T06:41:28.538 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2024-09-13T06:41:28.538 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2024-09-13T06:41:28.538 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2024-09-13T06:41:28.538 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138322906710015, 2024-09-13T06:41:28.538 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2024-09-13T06:41:28.539 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2024-09-13T06:39:05.314700+0000", 2024-09-13T06:41:28.539 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2024-09-13T06:41:28.539 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:28.539 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:28.539 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 7, 2024-09-13T06:41:28.539 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2024-09-13T06:41:28.539 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2024-09-13T06:41:28.539 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2024-09-13T06:41:28.539 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138322906710015, 2024-09-13T06:41:28.539 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2024-09-13T06:41:28.539 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2024-09-13T06:39:05.462229+0000", 2024-09-13T06:41:28.539 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 122 2024-09-13T06:41:28.539 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:28.539 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-13T06:41:28.539 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_upmap": [ 2024-09-13T06:41:28.540 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:28.540 INFO:teuthology.orchestra.run.smithi081.stdout: "pgid": "3.15", 2024-09-13T06:41:28.540 INFO:teuthology.orchestra.run.smithi081.stdout: "osds": [ 2024-09-13T06:41:28.540 INFO:teuthology.orchestra.run.smithi081.stdout: 3, 2024-09-13T06:41:28.540 INFO:teuthology.orchestra.run.smithi081.stdout: 7 2024-09-13T06:41:28.540 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:28.540 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:28.540 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:28.540 INFO:teuthology.orchestra.run.smithi081.stdout: "pgid": "3.1a", 2024-09-13T06:41:28.540 INFO:teuthology.orchestra.run.smithi081.stdout: "osds": [ 2024-09-13T06:41:28.540 INFO:teuthology.orchestra.run.smithi081.stdout: 2, 2024-09-13T06:41:28.540 INFO:teuthology.orchestra.run.smithi081.stdout: 6 2024-09-13T06:41:28.540 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:28.540 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:28.541 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-13T06:41:28.541 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_upmap_items": [ 2024-09-13T06:41:28.541 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:28.541 INFO:teuthology.orchestra.run.smithi081.stdout: "pgid": "3.f", 2024-09-13T06:41:28.541 INFO:teuthology.orchestra.run.smithi081.stdout: "mappings": [ 2024-09-13T06:41:28.541 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:28.541 INFO:teuthology.orchestra.run.smithi081.stdout: "from": 4, 2024-09-13T06:41:28.541 INFO:teuthology.orchestra.run.smithi081.stdout: "to": 2 2024-09-13T06:41:28.541 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:28.541 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:28.541 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:28.541 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-13T06:41:28.541 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_upmap_primaries": [], 2024-09-13T06:41:28.542 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_temp": [], 2024-09-13T06:41:28.542 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_temp": [], 2024-09-13T06:41:28.542 INFO:teuthology.orchestra.run.smithi081.stdout: "blocklist": {}, 2024-09-13T06:41:28.542 INFO:teuthology.orchestra.run.smithi081.stdout: "range_blocklist": {}, 2024-09-13T06:41:28.542 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profiles": { 2024-09-13T06:41:28.542 INFO:teuthology.orchestra.run.smithi081.stdout: "default": { 2024-09-13T06:41:28.542 INFO:teuthology.orchestra.run.smithi081.stdout: "crush-failure-domain": "osd", 2024-09-13T06:41:28.542 INFO:teuthology.orchestra.run.smithi081.stdout: "k": "2", 2024-09-13T06:41:28.542 INFO:teuthology.orchestra.run.smithi081.stdout: "m": "1", 2024-09-13T06:41:28.542 INFO:teuthology.orchestra.run.smithi081.stdout: "plugin": "jerasure", 2024-09-13T06:41:28.542 INFO:teuthology.orchestra.run.smithi081.stdout: "technique": "reed_sol_van" 2024-09-13T06:41:28.542 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:28.543 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:28.543 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps_queue": [ 2024-09-13T06:41:28.543 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:28.543 INFO:teuthology.orchestra.run.smithi081.stdout: "pool": 3, 2024-09-13T06:41:28.543 INFO:teuthology.orchestra.run.smithi081.stdout: "snaps": [ 2024-09-13T06:41:28.543 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:28.543 INFO:teuthology.orchestra.run.smithi081.stdout: "begin": 62, 2024-09-13T06:41:28.543 INFO:teuthology.orchestra.run.smithi081.stdout: "length": 1 2024-09-13T06:41:28.543 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:28.543 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:28.543 INFO:teuthology.orchestra.run.smithi081.stdout: "begin": 65, 2024-09-13T06:41:28.544 INFO:teuthology.orchestra.run.smithi081.stdout: "length": 1 2024-09-13T06:41:28.544 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:28.544 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:28.544 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:28.544 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-13T06:41:28.544 INFO:teuthology.orchestra.run.smithi081.stdout: "new_removed_snaps": [], 2024-09-13T06:41:28.544 INFO:teuthology.orchestra.run.smithi081.stdout: "new_purged_snaps": [], 2024-09-13T06:41:28.544 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_node_flags": {}, 2024-09-13T06:41:28.544 INFO:teuthology.orchestra.run.smithi081.stdout: "device_class_flags": {}, 2024-09-13T06:41:28.544 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": { 2024-09-13T06:41:28.544 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode_enabled": false, 2024-09-13T06:41:28.544 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_bucket_count": 0, 2024-09-13T06:41:28.544 INFO:teuthology.orchestra.run.smithi081.stdout: "degraded_stretch_mode": 0, 2024-09-13T06:41:28.545 INFO:teuthology.orchestra.run.smithi081.stdout: "recovering_stretch_mode": 0, 2024-09-13T06:41:28.545 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode_bucket": 0 2024-09-13T06:41:28.545 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:28.545 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:41:28.545 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:41:28.458+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:41:28.546 INFO:tasks.thrashosds.thrasher:j is {'epoch': 131, 'fsid': 'e5612297-d004-4957-927e-afa37f30d6cf', 'created': '2024-09-13T06:38:56.670231+0000', 'modified': '2024-09-13T06:41:27.374379+0000', 'last_up_change': '2024-09-13T06:41:16.368018+0000', 'last_in_change': '2024-09-13T06:41:10.658104+0000', 'flags': 'noscrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5801984, 'flags_set': ['noscrub', 'pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 4, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 3, 'max_osd': 8, 'require_min_compat_client': 'luminous', 'min_compat_client': 'luminous', 'require_osd_release': 'reef', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T06:39:09.600726+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 7.690000057220459, 'score_stable': 7.690000057220459, 'optimal_score': 0.12999999523162842, 'raw_score_acting': 1, 'raw_score_stable': 1, 'primary_affinity_weighted': 0.7684154510498047, 'average_primary_affinity': 0.7699999809265137, 'average_primary_affinity_weighted': 0.7699999809265137}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-09-13T06:39:15.802118+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 3, 'snap_epoch': 20, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 4, 'score_stable': 4, 'optimal_score': 0.75, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.7684154510498047, 'average_primary_affinity': 0.7699999809265137, 'average_primary_affinity_weighted': 0.7699999809265137}}, {'pool': 3, 'pool_name': 'pool_client.0', 'create_time': '2024-09-13T06:39:25.648942+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '131', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 68, 'snap_epoch': 131, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2.490000009536743, 'score_stable': 2.490000009536743, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 2.190000057220459, 'raw_score_stable': 2.190000057220459, 'primary_affinity_weighted': 0.7684154510498047, 'average_primary_affinity': 0.7699999809265137, 'average_primary_affinity_weighted': 0.7699999809265137}}], 'osds': [{'osd': 0, 'uuid': '54b0a3e4-58ad-4f95-86dc-29a11c9a1964', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 0.485382080078125, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 122, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6808', 'nonce': 1904727940}, {'type': 'v1', 'addr': '172.21.15.81:6809', 'nonce': 1904727940}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6810', 'nonce': 1904727940}, {'type': 'v1', 'addr': '172.21.15.81:6811', 'nonce': 1904727940}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6814', 'nonce': 1904727940}, {'type': 'v1', 'addr': '172.21.15.81:6815', 'nonce': 1904727940}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6812', 'nonce': 1904727940}, {'type': 'v1', 'addr': '172.21.15.81:6813', 'nonce': 1904727940}]}, 'public_addr': '172.21.15.81:6809/1904727940', 'cluster_addr': '172.21.15.81:6811/1904727940', 'heartbeat_back_addr': '172.21.15.81:6815/1904727940', 'heartbeat_front_addr': '172.21.15.81:6813/1904727940', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': 'a6dba5b9-c833-465e-a8a5-1741528b24c0', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 122, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6817', 'nonce': 738205570}, {'type': 'v1', 'addr': '172.21.15.81:6819', 'nonce': 738205570}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6822', 'nonce': 738205570}, {'type': 'v1', 'addr': '172.21.15.81:6824', 'nonce': 738205570}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6830', 'nonce': 738205570}, {'type': 'v1', 'addr': '172.21.15.81:6831', 'nonce': 738205570}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6826', 'nonce': 738205570}, {'type': 'v1', 'addr': '172.21.15.81:6829', 'nonce': 738205570}]}, 'public_addr': '172.21.15.81:6819/738205570', 'cluster_addr': '172.21.15.81:6824/738205570', 'heartbeat_back_addr': '172.21.15.81:6831/738205570', 'heartbeat_front_addr': '172.21.15.81:6829/738205570', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': '6c45097e-44a2-454f-80a4-0fe879ccd52f', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 122, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6816', 'nonce': 3558674335}, {'type': 'v1', 'addr': '172.21.15.81:6818', 'nonce': 3558674335}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6820', 'nonce': 3558674335}, {'type': 'v1', 'addr': '172.21.15.81:6821', 'nonce': 3558674335}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6827', 'nonce': 3558674335}, {'type': 'v1', 'addr': '172.21.15.81:6828', 'nonce': 3558674335}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6823', 'nonce': 3558674335}, {'type': 'v1', 'addr': '172.21.15.81:6825', 'nonce': 3558674335}]}, 'public_addr': '172.21.15.81:6818/3558674335', 'cluster_addr': '172.21.15.81:6821/3558674335', 'heartbeat_back_addr': '172.21.15.81:6828/3558674335', 'heartbeat_front_addr': '172.21.15.81:6825/3558674335', 'state': ['exists', 'up']}, {'osd': 3, 'uuid': '31952760-06f3-4618-a5c4-f5c4fed3aadb', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 122, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6800', 'nonce': 1886327229}, {'type': 'v1', 'addr': '172.21.15.81:6801', 'nonce': 1886327229}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6802', 'nonce': 1886327229}, {'type': 'v1', 'addr': '172.21.15.81:6803', 'nonce': 1886327229}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6806', 'nonce': 1886327229}, {'type': 'v1', 'addr': '172.21.15.81:6807', 'nonce': 1886327229}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6804', 'nonce': 1886327229}, {'type': 'v1', 'addr': '172.21.15.81:6805', 'nonce': 1886327229}]}, 'public_addr': '172.21.15.81:6801/1886327229', 'cluster_addr': '172.21.15.81:6803/1886327229', 'heartbeat_back_addr': '172.21.15.81:6807/1886327229', 'heartbeat_front_addr': '172.21.15.81:6805/1886327229', 'state': ['exists', 'up']}, {'osd': 4, 'uuid': 'c9bd2751-c836-43dc-b844-e13678cb2fd9', 'up': 1, 'in': 1, 'weight': 0.58685302734375, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 122, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.139:6817', 'nonce': 2184515621}, {'type': 'v1', 'addr': '172.21.15.139:6819', 'nonce': 2184515621}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.139:6820', 'nonce': 2184515621}, {'type': 'v1', 'addr': '172.21.15.139:6822', 'nonce': 2184515621}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.139:6827', 'nonce': 2184515621}, {'type': 'v1', 'addr': '172.21.15.139:6829', 'nonce': 2184515621}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.139:6824', 'nonce': 2184515621}, {'type': 'v1', 'addr': '172.21.15.139:6826', 'nonce': 2184515621}]}, 'public_addr': '172.21.15.139:6819/2184515621', 'cluster_addr': '172.21.15.139:6822/2184515621', 'heartbeat_back_addr': '172.21.15.139:6829/2184515621', 'heartbeat_front_addr': '172.21.15.139:6826/2184515621', 'state': ['exists', 'up']}, {'osd': 5, 'uuid': '2971b93a-6c9f-4b77-b526-4eac788fabf9', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 0.115264892578125, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 122, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.139:6816', 'nonce': 3982901834}, {'type': 'v1', 'addr': '172.21.15.139:6818', 'nonce': 3982901834}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.139:6821', 'nonce': 3982901834}, {'type': 'v1', 'addr': '172.21.15.139:6823', 'nonce': 3982901834}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.139:6830', 'nonce': 3982901834}, {'type': 'v1', 'addr': '172.21.15.139:6831', 'nonce': 3982901834}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.139:6825', 'nonce': 3982901834}, {'type': 'v1', 'addr': '172.21.15.139:6828', 'nonce': 3982901834}]}, 'public_addr': '172.21.15.139:6818/3982901834', 'cluster_addr': '172.21.15.139:6823/3982901834', 'heartbeat_back_addr': '172.21.15.139:6831/3982901834', 'heartbeat_front_addr': '172.21.15.139:6828/3982901834', 'state': ['exists', 'up']}, {'osd': 6, 'uuid': 'e1f786ce-579e-48cc-b212-83f881b94184', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 0.5466766357421875, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 122, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.139:6800', 'nonce': 2283932666}, {'type': 'v1', 'addr': '172.21.15.139:6801', 'nonce': 2283932666}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.139:6802', 'nonce': 2283932666}, {'type': 'v1', 'addr': '172.21.15.139:6803', 'nonce': 2283932666}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.139:6806', 'nonce': 2283932666}, {'type': 'v1', 'addr': '172.21.15.139:6807', 'nonce': 2283932666}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.139:6804', 'nonce': 2283932666}, {'type': 'v1', 'addr': '172.21.15.139:6805', 'nonce': 2283932666}]}, 'public_addr': '172.21.15.139:6801/2283932666', 'cluster_addr': '172.21.15.139:6803/2283932666', 'heartbeat_back_addr': '172.21.15.139:6807/2283932666', 'heartbeat_front_addr': '172.21.15.139:6805/2283932666', 'state': ['exists', 'up']}, {'osd': 7, 'uuid': 'a287ddf6-84eb-4225-b267-25eee1657625', 'up': 0, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 113, 'down_at': 122, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.139:6808', 'nonce': 2348111157}, {'type': 'v1', 'addr': '172.21.15.139:6809', 'nonce': 2348111157}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.139:6810', 'nonce': 2348111157}, {'type': 'v1', 'addr': '172.21.15.139:6811', 'nonce': 2348111157}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.139:6814', 'nonce': 2348111157}, {'type': 'v1', 'addr': '172.21.15.139:6815', 'nonce': 2348111157}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.139:6812', 'nonce': 2348111157}, {'type': 'v1', 'addr': '172.21.15.139:6813', 'nonce': 2348111157}]}, 'public_addr': '172.21.15.139:6809/2348111157', 'cluster_addr': '172.21.15.139:6811/2348111157', 'heartbeat_back_addr': '172.21.15.139:6815/2348111157', 'heartbeat_front_addr': '172.21.15.139:6813/2348111157', 'state': ['exists']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-13T06:39:05.476871+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-13T06:39:05.455183+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-13T06:39:05.504853+0000', 'dead_epoch': 0}, {'osd': 3, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-13T06:39:05.372429+0000', 'dead_epoch': 0}, {'osd': 4, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-13T06:39:05.421023+0000', 'dead_epoch': 0}, {'osd': 5, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-13T06:39:05.477489+0000', 'dead_epoch': 0}, {'osd': 6, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-13T06:39:05.314700+0000', 'dead_epoch': 0}, {'osd': 7, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-13T06:39:05.462229+0000', 'dead_epoch': 122}], 'pg_upmap': [{'pgid': '3.15', 'osds': [3, 7]}, {'pgid': '3.1a', 'osds': [2, 6]}], 'pg_upmap_items': [{'pgid': '3.f', 'mappings': [{'from': 4, 'to': 2}]}], 'pg_upmap_primaries': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [{'pool': 3, 'snaps': [{'begin': 62, 'length': 1}, {'begin': 65, 'length': 1}]}], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-09-13T06:41:28.547 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T06:41:28.548 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:41:28.548 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:41:28.548 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-13T06:41:28.594 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:41:28.594+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:41:28.649 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:41:28.647+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:41:28.670 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:41:28.673 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:41:28.684 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-13T06:41:28.749 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:41:28.747+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:41:28.803 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:41:28.803 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:41:28.817 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-13T06:41:28.862 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:41:28.862+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:41:28.888 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T06:41:28.889 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-09-13T06:41:28.904 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":193,"stamp":"2024-09-13T06:41:27.559250+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":687218290,"num_objects":674,"num_object_clones":0,"num_object_copies":1348,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":226,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":674,"num_whiteouts":0,"num_read":77290,"num_read_kb":522737,"num_write":13294,"num_write_kb":367645,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2356,"num_bytes_recovered":196295547,"num_keys_recovered":353,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9170,"ondisk_log_size":9170,"up":67,"acting":67,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":83,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":638456,"kb_used_data":346880,"kb_used_omap":12,"kb_used_meta":291443,"kb_avail":754336264,"statfs":{"total":773094113280,"available":772440334336,"internally_reserved":0,"allocated":355205120,"data_stored":346871247,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":298438200},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,1],"upper_bound":8},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":41593952,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":4,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3226,"num_read_kb":20424,"num_write":826,"num_write_kb":14460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.096002"},"pg_stats":[{"pgid":"3.1f","version":"126'274","reported_seq":1925,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-13T06:41:24.483265+0000","last_change":"2024-09-13T06:41:24.483582+0000","last_active":"2024-09-13T06:41:24.483265+0000","last_peered":"2024-09-13T06:41:24.483265+0000","last_clean":"2024-09-13T06:41:24.483265+0000","last_became_active":"2024-09-13T06:40:57.385213+0000","last_became_peered":"2024-09-13T06:40:57.385213+0000","last_unstale":"2024-09-13T06:41:24.483265+0000","last_undegraded":"2024-09-13T06:41:24.483265+0000","last_fullsized":"2024-09-13T06:41:24.483265+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":274,"log_dups_size":0,"ondisk_log_size":274,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:46:17.100560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00072629599999999997,"stat_sum":{"num_bytes":10867020,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":2100,"num_read_kb":11456,"num_write":371,"num_write_kb":11104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":72,"num_bytes_recovered":6114482,"num_keys_recovered":44,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"3b","length":"1"},{"start":"3e","length":"1"},{"start":"41","length":"1"}]},{"pgid":"3.1e","version":"128'304","reported_seq":2269,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-13T06:41:24.478087+0000","last_change":"2024-09-13T06:41:24.478737+0000","last_active":"2024-09-13T06:41:24.478087+0000","last_peered":"2024-09-13T06:41:24.478087+0000","last_clean":"2024-09-13T06:41:24.478087+0000","last_became_active":"2024-09-13T06:41:15.402576+0000","last_became_peered":"2024-09-13T06:41:15.402576+0000","last_unstale":"2024-09-13T06:41:24.478087+0000","last_undegraded":"2024-09-13T06:41:24.478087+0000","last_fullsized":"2024-09-13T06:41:24.478087+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":304,"log_dups_size":0,"ondisk_log_size":304,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:43:20.517533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0032370580000000001,"stat_sum":{"num_bytes":16359423,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":2683,"num_read_kb":17655,"num_write":492,"num_write_kb":10358,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":95,"num_bytes_recovered":9208990,"num_keys_recovered":22,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"3b","length":"1"},{"start":"3e","length":"1"},{"start":"41","length":"1"}]},{"pgid":"3.1d","version":"129'288","reported_seq":1446,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-13T06:41:24.486303+0000","last_change":"2024-09-13T06:41:24.486303+0000","last_active":"2024-09-13T06:41:24.486303+0000","last_peered":"2024-09-13T06:41:24.486303+0000","last_clean":"2024-09-13T06:41:24.486303+0000","last_became_active":"2024-09-13T06:40:58.381974+0000","last_became_peered":"2024-09-13T06:40:58.381974+0000","last_unstale":"2024-09-13T06:41:24.486303+0000","last_undegraded":"2024-09-13T06:41:24.486303+0000","last_fullsized":"2024-09-13T06:41:24.486303+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":288,"log_dups_size":0,"ondisk_log_size":288,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:25:14.036553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001855301,"stat_sum":{"num_bytes":8574178,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":1435,"num_read_kb":8862,"num_write":478,"num_write_kb":9221,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":89,"num_bytes_recovered":3676876,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"3b","length":"1"},{"start":"3e","length":"1"},{"start":"41","length":"1"}]},{"pgid":"3.1c","version":"129'336","reported_seq":2529,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-13T06:41:24.594924+0000","last_change":"2024-09-13T06:41:24.485089+0000","last_active":"2024-09-13T06:41:24.594924+0000","last_peered":"2024-09-13T06:41:24.594924+0000","last_clean":"2024-09-13T06:41:24.594924+0000","last_became_active":"2024-09-13T06:40:57.386207+0000","last_became_peered":"2024-09-13T06:40:57.386207+0000","last_unstale":"2024-09-13T06:41:24.594924+0000","last_undegraded":"2024-09-13T06:41:24.594924+0000","last_fullsized":"2024-09-13T06:41:24.594924+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":336,"log_dups_size":0,"ondisk_log_size":336,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:26:17.455121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00045566200000000002,"stat_sum":{"num_bytes":15199331,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":3450,"num_read_kb":31093,"num_write":394,"num_write_kb":14509,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":106,"num_bytes_recovered":17590210,"num_keys_recovered":90,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"3b","length":"1"},{"start":"3e","length":"1"},{"start":"41","length":"1"}]},{"pgid":"3.1b","version":"126'447","reported_seq":1881,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-13T06:41:24.483787+0000","last_change":"2024-09-13T06:41:24.484270+0000","last_active":"2024-09-13T06:41:24.483787+0000","last_peered":"2024-09-13T06:41:24.483787+0000","last_clean":"2024-09-13T06:41:24.483787+0000","last_became_active":"2024-09-13T06:39:27.371776+0000","last_became_peered":"2024-09-13T06:39:27.371776+0000","last_unstale":"2024-09-13T06:41:24.483787+0000","last_undegraded":"2024-09-13T06:41:24.483787+0000","last_fullsized":"2024-09-13T06:41:24.483787+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:25:31.311656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00086552199999999997,"stat_sum":{"num_bytes":16660301,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":2969,"num_read_kb":22977,"num_write":646,"num_write_kb":14226,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"3b","length":"1"},{"start":"3e","length":"1"},{"start":"41","length":"1"}]},{"pgid":"3.1a","version":"128'185","reported_seq":1313,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-13T06:41:24.579631+0000","last_change":"2024-09-13T06:41:24.476501+0000","last_active":"2024-09-13T06:41:24.579631+0000","last_peered":"2024-09-13T06:41:24.579631+0000","last_clean":"2024-09-13T06:41:24.579631+0000","last_became_active":"2024-09-13T06:40:19.001208+0000","last_became_peered":"2024-09-13T06:40:19.001208+0000","last_unstale":"2024-09-13T06:41:24.579631+0000","last_undegraded":"2024-09-13T06:41:24.579631+0000","last_fullsized":"2024-09-13T06:41:24.579631+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":185,"log_dups_size":0,"ondisk_log_size":185,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:20:12.983408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001032558,"stat_sum":{"num_bytes":12881978,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":1675,"num_read_kb":13256,"num_write":301,"num_write_kb":12913,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":1515392,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"3b","length":"1"},{"start":"3e","length":"1"},{"start":"41","length":"1"}]},{"pgid":"3.19","version":"126'171","reported_seq":3470,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-13T06:41:24.587457+0000","last_change":"2024-09-13T06:41:24.562904+0000","last_active":"2024-09-13T06:41:24.587457+0000","last_peered":"2024-09-13T06:41:24.587457+0000","last_clean":"2024-09-13T06:41:24.587457+0000","last_became_active":"2024-09-13T06:41:14.401959+0000","last_became_peered":"2024-09-13T06:41:14.401959+0000","last_unstale":"2024-09-13T06:41:24.587457+0000","last_undegraded":"2024-09-13T06:41:24.587457+0000","last_fullsized":"2024-09-13T06:41:24.587457+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":171,"log_dups_size":0,"ondisk_log_size":171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:33:48.514049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00091193600000000002,"stat_sum":{"num_bytes":37233235,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":2859,"num_read_kb":21748,"num_write":178,"num_write_kb":11509,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":102,"num_bytes_recovered":11654030,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"3b","length":"1"},{"start":"3e","length":"1"},{"start":"41","length":"1"}]},{"pgid":"3.18","version":"125'213","reported_seq":2580,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-13T06:41:24.475725+0000","last_change":"2024-09-13T06:41:24.476737+0000","last_active":"2024-09-13T06:41:24.475725+0000","last_peered":"2024-09-13T06:41:24.475725+0000","last_clean":"2024-09-13T06:41:24.475725+0000","last_became_active":"2024-09-13T06:41:14.395301+0000","last_became_peered":"2024-09-13T06:41:14.395301+0000","last_unstale":"2024-09-13T06:41:24.475725+0000","last_undegraded":"2024-09-13T06:41:24.475725+0000","last_fullsized":"2024-09-13T06:41:24.475725+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":213,"log_dups_size":0,"ondisk_log_size":213,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:10:49.528345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0017257959999999999,"stat_sum":{"num_bytes":13262354,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":2425,"num_read_kb":21676,"num_write":239,"num_write_kb":12860,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":117,"num_bytes_recovered":13142180,"num_keys_recovered":22,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"3b","length":"1"},{"start":"3e","length":"1"},{"start":"41","length":"1"}]},{"pgid":"3.17","version":"126'897","reported_seq":2907,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-13T06:41:24.489412+0000","last_change":"2024-09-13T06:41:24.489601+0000","last_active":"2024-09-13T06:41:24.489412+0000","last_peered":"2024-09-13T06:41:24.489412+0000","last_clean":"2024-09-13T06:41:24.489412+0000","last_became_active":"2024-09-13T06:40:58.380438+0000","last_became_peered":"2024-09-13T06:40:58.380438+0000","last_unstale":"2024-09-13T06:41:24.489412+0000","last_undegraded":"2024-09-13T06:41:24.489412+0000","last_fullsized":"2024-09-13T06:41:24.489412+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":897,"log_dups_size":0,"ondisk_log_size":897,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:14:38.348390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00033992799999999997,"stat_sum":{"num_bytes":12967682,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":5914,"num_read_kb":23143,"num_write":1449,"num_write_kb":16727,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":112,"num_bytes_recovered":14950263,"num_keys_recovered":22,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"3b","length":"1"},{"start":"3e","length":"1"},{"start":"41","length":"1"}]},{"pgid":"3.16","version":"128'232","reported_seq":1551,"reported_epoch":128,"state":"active+undersized+degraded","last_fresh":"2024-09-13T06:41:23.554509+0000","last_change":"2024-09-13T06:41:17.381810+0000","last_active":"2024-09-13T06:41:23.554509+0000","last_peered":"2024-09-13T06:41:23.554509+0000","last_clean":"2024-09-13T06:41:15.626296+0000","last_became_active":"2024-09-13T06:41:17.381810+0000","last_became_peered":"2024-09-13T06:41:17.381810+0000","last_unstale":"2024-09-13T06:41:23.554509+0000","last_undegraded":"2024-09-13T06:41:17.380252+0000","last_fullsized":"2024-09-13T06:41:17.379987+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":232,"log_dups_size":0,"ondisk_log_size":232,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":2,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:13:44.596949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0023312189999999998,"stat_sum":{"num_bytes":13322758,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":17,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":1134,"num_read_kb":8868,"num_write":302,"num_write_kb":6588,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":134,"num_bytes_recovered":4533762,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5],"acting":[5],"avail_no_missing":["5"],"object_location_counts":[{"shards":"5","objects":17}],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"3b","length":"1"}]},{"pgid":"3.15","version":"128'113","reported_seq":1370,"reported_epoch":128,"state":"active+undersized+degraded","last_fresh":"2024-09-13T06:41:23.558674+0000","last_change":"2024-09-13T06:41:17.380707+0000","last_active":"2024-09-13T06:41:23.558674+0000","last_peered":"2024-09-13T06:41:23.558674+0000","last_clean":"2024-09-13T06:41:15.392451+0000","last_became_active":"2024-09-13T06:41:17.380707+0000","last_became_peered":"2024-09-13T06:41:17.380707+0000","last_unstale":"2024-09-13T06:41:23.558674+0000","last_undegraded":"2024-09-13T06:41:17.379772+0000","last_fullsized":"2024-09-13T06:41:17.379641+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":113,"log_dups_size":0,"ondisk_log_size":113,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":2,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:19:39.210960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0024455200000000001,"stat_sum":{"num_bytes":14522980,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":22,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":955,"num_read_kb":11771,"num_write":150,"num_write_kb":9804,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":88,"num_bytes_recovered":6317277,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3],"acting":[3],"avail_no_missing":["3"],"object_location_counts":[{"shards":"3","objects":22}],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"3b","length":"1"}]},{"pgid":"3.14","version":"128'212","reported_seq":1072,"reported_epoch":128,"state":"active+undersized+degraded","last_fresh":"2024-09-13T06:41:23.543792+0000","last_change":"2024-09-13T06:41:17.389503+0000","last_active":"2024-09-13T06:41:23.543792+0000","last_peered":"2024-09-13T06:41:23.543792+0000","last_clean":"2024-09-13T06:41:15.389299+0000","last_became_active":"2024-09-13T06:41:17.389503+0000","last_became_peered":"2024-09-13T06:41:17.389503+0000","last_unstale":"2024-09-13T06:41:23.543792+0000","last_undegraded":"2024-09-13T06:41:17.386473+0000","last_fullsized":"2024-09-13T06:41:17.386173+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":212,"log_dups_size":0,"ondisk_log_size":212,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":2,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:46:29.581789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002646799,"stat_sum":{"num_bytes":15212056,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":17,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":977,"num_read_kb":13444,"num_write":350,"num_write_kb":9017,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":43,"num_bytes_recovered":1911643,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4],"acting":[4],"avail_no_missing":["4"],"object_location_counts":[{"shards":"4","objects":17}],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"3b","length":"1"}]},{"pgid":"2.7","version":"0'0","reported_seq":146,"reported_epoch":128,"state":"active+undersized","last_fresh":"2024-09-13T06:41:23.472165+0000","last_change":"2024-09-13T06:41:17.386625+0000","last_active":"2024-09-13T06:41:23.472165+0000","last_peered":"2024-09-13T06:41:23.472165+0000","last_clean":"2024-09-13T06:41:15.398847+0000","last_became_active":"2024-09-13T06:41:17.386625+0000","last_became_peered":"2024-09-13T06:41:17.386625+0000","last_unstale":"2024-09-13T06:41:23.472165+0000","last_undegraded":"2024-09-13T06:41:23.472165+0000","last_fullsized":"2024-09-13T06:41:17.385107+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_clean_scrub_stamp":"2024-09-13T06:39:16.508974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:09:25.297677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00080324699999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6],"acting":[6],"avail_no_missing":["6"],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"126'226","reported_seq":1352,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-13T06:41:24.483143+0000","last_change":"2024-09-13T06:41:24.483581+0000","last_active":"2024-09-13T06:41:24.483143+0000","last_peered":"2024-09-13T06:41:24.483143+0000","last_clean":"2024-09-13T06:41:24.483143+0000","last_became_active":"2024-09-13T06:39:27.352170+0000","last_became_peered":"2024-09-13T06:39:27.352170+0000","last_unstale":"2024-09-13T06:41:24.483143+0000","last_undegraded":"2024-09-13T06:41:24.483143+0000","last_fullsized":"2024-09-13T06:41:24.483143+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":226,"log_dups_size":0,"ondisk_log_size":226,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:54:20.547109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00078639599999999997,"stat_sum":{"num_bytes":6093939,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":1248,"num_read_kb":7141,"num_write":369,"num_write_kb":8420,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"3b","length":"1"},{"start":"3e","length":"1"},{"start":"41","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":125,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-13T06:41:23.467794+0000","last_change":"2024-09-13T06:39:19.567201+0000","last_active":"2024-09-13T06:41:23.467794+0000","last_peered":"2024-09-13T06:41:23.467794+0000","last_clean":"2024-09-13T06:41:23.467794+0000","last_became_active":"2024-09-13T06:39:17.535411+0000","last_became_peered":"2024-09-13T06:39:17.535411+0000","last_unstale":"2024-09-13T06:41:23.467794+0000","last_undegraded":"2024-09-13T06:41:23.467794+0000","last_fullsized":"2024-09-13T06:41:23.467794+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_clean_scrub_stamp":"2024-09-13T06:39:16.508974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:44:11.617809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00097079800000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"128'215","reported_seq":1367,"reported_epoch":128,"state":"active+undersized+degraded","last_fresh":"2024-09-13T06:41:23.610441+0000","last_change":"2024-09-13T06:41:17.382117+0000","last_active":"2024-09-13T06:41:23.610441+0000","last_peered":"2024-09-13T06:41:23.610441+0000","last_clean":"2024-09-13T06:41:15.406415+0000","last_became_active":"2024-09-13T06:41:17.382117+0000","last_became_peered":"2024-09-13T06:41:17.382117+0000","last_unstale":"2024-09-13T06:41:23.610441+0000","last_undegraded":"2024-09-13T06:41:17.379441+0000","last_fullsized":"2024-09-13T06:41:17.379323+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":215,"log_dups_size":0,"ondisk_log_size":215,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":2,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:07:09.212542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0027543749999999999,"stat_sum":{"num_bytes":9140122,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":17,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":1175,"num_read_kb":11472,"num_write":318,"num_write_kb":8881,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":135,"num_bytes_recovered":11638948,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3],"acting":[3],"avail_no_missing":["3"],"object_location_counts":[{"shards":"3","objects":17}],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"3b","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":57,"reported_epoch":128,"state":"active+undersized","last_fresh":"2024-09-13T06:41:23.475829+0000","last_change":"2024-09-13T06:41:17.387921+0000","last_active":"2024-09-13T06:41:23.475829+0000","last_peered":"2024-09-13T06:41:23.475829+0000","last_clean":"2024-09-13T06:40:28.366174+0000","last_became_active":"2024-09-13T06:41:17.387921+0000","last_became_peered":"2024-09-13T06:41:17.387921+0000","last_unstale":"2024-09-13T06:41:23.475829+0000","last_undegraded":"2024-09-13T06:41:23.475829+0000","last_fullsized":"2024-09-13T06:41:17.386803+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_clean_scrub_stamp":"2024-09-13T06:39:16.508974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:53:38.541996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"126'231","reported_seq":1543,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-13T06:41:24.562333+0000","last_change":"2024-09-13T06:41:24.562698+0000","last_active":"2024-09-13T06:41:24.562333+0000","last_peered":"2024-09-13T06:41:24.562333+0000","last_clean":"2024-09-13T06:41:24.562333+0000","last_became_active":"2024-09-13T06:39:27.452904+0000","last_became_peered":"2024-09-13T06:39:27.452904+0000","last_unstale":"2024-09-13T06:41:24.562333+0000","last_undegraded":"2024-09-13T06:41:24.562333+0000","last_fullsized":"2024-09-13T06:41:24.562333+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":231,"log_dups_size":0,"ondisk_log_size":231,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:44:12.553212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00070373400000000002,"stat_sum":{"num_bytes":13551710,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":1686,"num_read_kb":17335,"num_write":303,"num_write_kb":12693,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"3b","length":"1"},{"start":"3e","length":"1"},{"start":"41","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":126,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-13T06:41:24.561984+0000","last_change":"2024-09-13T06:39:19.567043+0000","last_active":"2024-09-13T06:41:24.561984+0000","last_peered":"2024-09-13T06:41:24.561984+0000","last_clean":"2024-09-13T06:41:24.561984+0000","last_became_active":"2024-09-13T06:39:17.721287+0000","last_became_peered":"2024-09-13T06:39:17.721287+0000","last_unstale":"2024-09-13T06:41:24.561984+0000","last_undegraded":"2024-09-13T06:41:24.561984+0000","last_fullsized":"2024-09-13T06:41:24.561984+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_clean_scrub_stamp":"2024-09-13T06:39:16.508974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:14:34.131074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000890396,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"128'144","reported_seq":814,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-13T06:41:24.479244+0000","last_change":"2024-09-13T06:41:24.479638+0000","last_active":"2024-09-13T06:41:24.479244+0000","last_peered":"2024-09-13T06:41:24.479244+0000","last_clean":"2024-09-13T06:41:24.479244+0000","last_became_active":"2024-09-13T06:41:14.403171+0000","last_became_peered":"2024-09-13T06:41:14.403171+0000","last_unstale":"2024-09-13T06:41:24.479244+0000","last_undegraded":"2024-09-13T06:41:24.479244+0000","last_fullsized":"2024-09-13T06:41:24.479244+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:19:47.780898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0036191420000000001,"stat_sum":{"num_bytes":6606597,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":387,"num_read_kb":3534,"num_write":209,"num_write_kb":6473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":158,"num_bytes_recovered":4212424,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"3b","length":"1"},{"start":"3e","length":"1"},{"start":"41","length":"1"}]},{"pgid":"3.3","version":"128'258","reported_seq":4171,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-13T06:41:24.485813+0000","last_change":"2024-09-13T06:41:24.485813+0000","last_active":"2024-09-13T06:41:24.485813+0000","last_peered":"2024-09-13T06:41:24.485813+0000","last_clean":"2024-09-13T06:41:24.485813+0000","last_became_active":"2024-09-13T06:39:27.372337+0000","last_became_peered":"2024-09-13T06:39:27.372337+0000","last_unstale":"2024-09-13T06:41:24.485813+0000","last_undegraded":"2024-09-13T06:41:24.485813+0000","last_fullsized":"2024-09-13T06:41:24.485813+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":258,"log_dups_size":0,"ondisk_log_size":258,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:17:49.242059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00074235999999999996,"stat_sum":{"num_bytes":37406004,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":4275,"num_read_kb":19325,"num_write":394,"num_write_kb":9613,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"3b","length":"1"},{"start":"3e","length":"1"},{"start":"41","length":"1"}]},{"pgid":"2.2","version":"20'2","reported_seq":88,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-13T06:41:23.466707+0000","last_change":"2024-09-13T06:40:54.527527+0000","last_active":"2024-09-13T06:41:23.466707+0000","last_peered":"2024-09-13T06:41:23.466707+0000","last_clean":"2024-09-13T06:41:23.466707+0000","last_became_active":"2024-09-13T06:40:54.521224+0000","last_became_peered":"2024-09-13T06:40:54.521224+0000","last_unstale":"2024-09-13T06:41:23.466707+0000","last_undegraded":"2024-09-13T06:41:23.466707+0000","last_fullsized":"2024-09-13T06:41:23.466707+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_clean_scrub_stamp":"2024-09-13T06:39:16.508974+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:03:26.244154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":38,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"129'575","reported_seq":5248,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-13T06:41:24.712601+0000","last_change":"2024-09-13T06:41:24.564762+0000","last_active":"2024-09-13T06:41:24.712601+0000","last_peered":"2024-09-13T06:41:24.712601+0000","last_clean":"2024-09-13T06:41:24.712601+0000","last_became_active":"2024-09-13T06:39:27.453029+0000","last_became_peered":"2024-09-13T06:39:27.453029+0000","last_unstale":"2024-09-13T06:41:24.712601+0000","last_undegraded":"2024-09-13T06:41:24.712601+0000","last_fullsized":"2024-09-13T06:41:24.712601+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":575,"log_dups_size":0,"ondisk_log_size":575,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:30:11.714805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0025049249999999999,"stat_sum":{"num_bytes":84676972,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":6806,"num_read_kb":37880,"num_write":873,"num_write_kb":17116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"3b","length":"1"},{"start":"3e","length":"1"},{"start":"41","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":142,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-13T06:41:24.475989+0000","last_change":"2024-09-13T06:41:11.392095+0000","last_active":"2024-09-13T06:41:24.475989+0000","last_peered":"2024-09-13T06:41:24.475989+0000","last_clean":"2024-09-13T06:41:24.475989+0000","last_became_active":"2024-09-13T06:41:11.391688+0000","last_became_peered":"2024-09-13T06:41:11.391688+0000","last_unstale":"2024-09-13T06:41:24.475989+0000","last_undegraded":"2024-09-13T06:41:24.475989+0000","last_fullsized":"2024-09-13T06:41:24.475989+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_clean_scrub_stamp":"2024-09-13T06:39:16.508974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:41:17.729629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00033592499999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"128'336","reported_seq":1247,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-13T06:41:24.478495+0000","last_change":"2024-09-13T06:41:24.478892+0000","last_active":"2024-09-13T06:41:24.478495+0000","last_peered":"2024-09-13T06:41:24.478495+0000","last_clean":"2024-09-13T06:41:24.478495+0000","last_became_active":"2024-09-13T06:41:15.399065+0000","last_became_peered":"2024-09-13T06:41:15.399065+0000","last_unstale":"2024-09-13T06:41:24.478495+0000","last_undegraded":"2024-09-13T06:41:24.478495+0000","last_fullsized":"2024-09-13T06:41:24.478495+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":336,"log_dups_size":0,"ondisk_log_size":336,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:56:49.571998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.003301464,"stat_sum":{"num_bytes":10476163,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":1609,"num_read_kb":9198,"num_write":507,"num_write_kb":10946,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":110,"num_bytes_recovered":7863454,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"3b","length":"1"},{"start":"3e","length":"1"},{"start":"41","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":57,"reported_epoch":128,"state":"active+undersized","last_fresh":"2024-09-13T06:41:23.466829+0000","last_change":"2024-09-13T06:41:17.380432+0000","last_active":"2024-09-13T06:41:23.466829+0000","last_peered":"2024-09-13T06:41:23.466829+0000","last_clean":"2024-09-13T06:39:16.508974+0000","last_became_active":"2024-09-13T06:41:17.380432+0000","last_became_peered":"2024-09-13T06:41:17.380432+0000","last_unstale":"2024-09-13T06:41:23.466829+0000","last_undegraded":"2024-09-13T06:41:23.466829+0000","last_fullsized":"2024-09-13T06:41:17.379040+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_clean_scrub_stamp":"2024-09-13T06:39:16.508974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:13:26.779263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"126'135","reported_seq":1455,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-13T06:41:24.476889+0000","last_change":"2024-09-13T06:41:24.476889+0000","last_active":"2024-09-13T06:41:24.476889+0000","last_peered":"2024-09-13T06:41:24.476889+0000","last_clean":"2024-09-13T06:41:24.476889+0000","last_became_active":"2024-09-13T06:41:15.399301+0000","last_became_peered":"2024-09-13T06:41:15.399301+0000","last_unstale":"2024-09-13T06:41:24.476889+0000","last_undegraded":"2024-09-13T06:41:24.476889+0000","last_fullsized":"2024-09-13T06:41:24.476889+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:53:18.137873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001808586,"stat_sum":{"num_bytes":25117091,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":883,"num_read_kb":6460,"num_write":150,"num_write_kb":5362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":169,"num_bytes_recovered":5233325,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"3b","length":"1"},{"start":"3e","length":"1"},{"start":"41","length":"1"}]},{"pgid":"2.3","version":"18'1","reported_seq":82,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-13T06:41:23.486170+0000","last_change":"2024-09-13T06:40:54.530159+0000","last_active":"2024-09-13T06:41:23.486170+0000","last_peered":"2024-09-13T06:41:23.486170+0000","last_clean":"2024-09-13T06:41:23.486170+0000","last_became_active":"2024-09-13T06:40:54.525969+0000","last_became_peered":"2024-09-13T06:40:54.525969+0000","last_unstale":"2024-09-13T06:41:23.486170+0000","last_undegraded":"2024-09-13T06:41:23.486170+0000","last_fullsized":"2024-09-13T06:41:23.486170+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_clean_scrub_stamp":"2024-09-13T06:39:16.508974+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:51:26.690993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":240,"reported_epoch":128,"state":"active+undersized+degraded","last_fresh":"2024-09-13T06:41:23.475816+0000","last_change":"2024-09-13T06:41:17.387135+0000","last_active":"2024-09-13T06:41:23.475816+0000","last_peered":"2024-09-13T06:41:23.475816+0000","last_clean":"2024-09-13T06:40:28.365669+0000","last_became_active":"2024-09-13T06:41:17.387135+0000","last_became_peered":"2024-09-13T06:41:17.387135+0000","last_unstale":"2024-09-13T06:41:23.475816+0000","last_undegraded":"2024-09-13T06:41:17.386473+0000","last_fullsized":"2024-09-13T06:41:17.386335+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:10.110558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:10.110558+0000","last_clean_scrub_stamp":"2024-09-13T06:39:10.110558+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:22:17.256446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":2,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":2}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"126'163","reported_seq":3764,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-13T06:41:24.475580+0000","last_change":"2024-09-13T06:41:24.476266+0000","last_active":"2024-09-13T06:41:24.475580+0000","last_peered":"2024-09-13T06:41:24.475580+0000","last_clean":"2024-09-13T06:41:24.475580+0000","last_became_active":"2024-09-13T06:41:14.402355+0000","last_became_peered":"2024-09-13T06:41:14.402355+0000","last_unstale":"2024-09-13T06:41:24.475580+0000","last_undegraded":"2024-09-13T06:41:24.475580+0000","last_fullsized":"2024-09-13T06:41:24.475580+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:12:43.502655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013357659999999999,"stat_sum":{"num_bytes":18172634,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":3258,"num_read_kb":20733,"num_write":187,"num_write_kb":10413,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":120,"num_bytes_recovered":7985058,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"3b","length":"1"},{"start":"3e","length":"1"},{"start":"41","length":"1"}]},{"pgid":"3.9","version":"127'228","reported_seq":5834,"reported_epoch":129,"state":"active+undersized+degraded","last_fresh":"2024-09-13T06:41:24.571209+0000","last_change":"2024-09-13T06:41:17.387237+0000","last_active":"2024-09-13T06:41:24.571209+0000","last_peered":"2024-09-13T06:41:24.571209+0000","last_clean":"2024-09-13T06:41:15.395223+0000","last_became_active":"2024-09-13T06:41:17.387237+0000","last_became_peered":"2024-09-13T06:41:17.387237+0000","last_unstale":"2024-09-13T06:41:24.571209+0000","last_undegraded":"2024-09-13T06:41:17.386076+0000","last_fullsized":"2024-09-13T06:41:17.385974+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":228,"log_dups_size":0,"ondisk_log_size":228,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":2,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:00:00.745099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060404600000000001,"stat_sum":{"num_bytes":29682833,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":21,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":5501,"num_read_kb":33989,"num_write":326,"num_write_kb":16282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":60,"num_bytes_recovered":11981779,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":21}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"3b","length":"1"}]},{"pgid":"3.a","version":"126'324","reported_seq":1905,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-13T06:41:24.484461+0000","last_change":"2024-09-13T06:41:24.484731+0000","last_active":"2024-09-13T06:41:24.484461+0000","last_peered":"2024-09-13T06:41:24.484461+0000","last_clean":"2024-09-13T06:41:24.484461+0000","last_became_active":"2024-09-13T06:40:24.510441+0000","last_became_peered":"2024-09-13T06:40:24.510441+0000","last_unstale":"2024-09-13T06:41:24.484461+0000","last_undegraded":"2024-09-13T06:41:24.484461+0000","last_fullsized":"2024-09-13T06:41:24.484461+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":324,"log_dups_size":0,"ondisk_log_size":324,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:58:40.338734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00040468900000000001,"stat_sum":{"num_bytes":10325778,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":2904,"num_read_kb":14775,"num_write":337,"num_write_kb":9674,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"3b","length":"1"},{"start":"3e","length":"1"},{"start":"41","length":"1"}]},{"pgid":"3.b","version":"125'491","reported_seq":1525,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-13T06:41:24.477129+0000","last_change":"2024-09-13T06:41:24.477494+0000","last_active":"2024-09-13T06:41:24.477129+0000","last_peered":"2024-09-13T06:41:24.477129+0000","last_clean":"2024-09-13T06:41:24.477129+0000","last_became_active":"2024-09-13T06:41:15.399204+0000","last_became_peered":"2024-09-13T06:41:15.399204+0000","last_unstale":"2024-09-13T06:41:24.477129+0000","last_undegraded":"2024-09-13T06:41:24.477129+0000","last_fullsized":"2024-09-13T06:41:24.477129+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":491,"log_dups_size":0,"ondisk_log_size":491,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:27:03.298272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00235578,"stat_sum":{"num_bytes":10005019,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":2882,"num_read_kb":18051,"num_write":790,"num_write_kb":14191,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":117,"num_bytes_recovered":13256568,"num_keys_recovered":44,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"3b","length":"1"},{"start":"3e","length":"1"},{"start":"41","length":"1"}]},{"pgid":"3.c","version":"128'219","reported_seq":4315,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-13T06:41:24.477900+0000","last_change":"2024-09-13T06:41:24.478361+0000","last_active":"2024-09-13T06:41:24.477900+0000","last_peered":"2024-09-13T06:41:24.477900+0000","last_clean":"2024-09-13T06:41:24.477900+0000","last_became_active":"2024-09-13T06:41:14.402410+0000","last_became_peered":"2024-09-13T06:41:14.402410+0000","last_unstale":"2024-09-13T06:41:24.477900+0000","last_undegraded":"2024-09-13T06:41:24.477900+0000","last_fullsized":"2024-09-13T06:41:24.477900+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":219,"log_dups_size":0,"ondisk_log_size":219,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:58:50.947568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.003210409,"stat_sum":{"num_bytes":25172633,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":4075,"num_read_kb":20604,"num_write":290,"num_write_kb":10932,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":184,"num_bytes_recovered":16410936,"num_keys_recovered":88,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"3b","length":"1"},{"start":"3e","length":"1"},{"start":"41","length":"1"}]},{"pgid":"3.d","version":"128'123","reported_seq":466,"reported_epoch":128,"state":"active+undersized+degraded","last_fresh":"2024-09-13T06:41:23.563312+0000","last_change":"2024-09-13T06:41:17.381026+0000","last_active":"2024-09-13T06:41:23.563312+0000","last_peered":"2024-09-13T06:41:23.563312+0000","last_clean":"2024-09-13T06:40:53.426822+0000","last_became_active":"2024-09-13T06:41:17.381026+0000","last_became_peered":"2024-09-13T06:41:17.381026+0000","last_unstale":"2024-09-13T06:41:23.563312+0000","last_undegraded":"2024-09-13T06:41:17.380074+0000","last_fullsized":"2024-09-13T06:41:17.379919+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":123,"log_dups_size":0,"ondisk_log_size":123,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":2,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:41:13.801218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0024008639999999999,"stat_sum":{"num_bytes":14315763,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":19,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":770,"num_read_kb":11757,"num_write":277,"num_write_kb":16945,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":76,"num_bytes_recovered":8633919,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5],"acting":[5],"avail_no_missing":["5"],"object_location_counts":[{"shards":"5","objects":19}],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"3b","length":"1"}]},{"pgid":"3.e","version":"126'179","reported_seq":521,"reported_epoch":129,"state":"active+undersized+degraded","last_fresh":"2024-09-13T06:41:24.562133+0000","last_change":"2024-09-13T06:41:17.380525+0000","last_active":"2024-09-13T06:41:24.562133+0000","last_peered":"2024-09-13T06:41:24.562133+0000","last_clean":"2024-09-13T06:41:15.598689+0000","last_became_active":"2024-09-13T06:41:17.380525+0000","last_became_peered":"2024-09-13T06:41:17.380525+0000","last_unstale":"2024-09-13T06:41:24.562133+0000","last_undegraded":"2024-09-13T06:41:17.379550+0000","last_fullsized":"2024-09-13T06:41:17.379281+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":179,"log_dups_size":0,"ondisk_log_size":179,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":2,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:44:02.348351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0023001440000000001,"stat_sum":{"num_bytes":25629911,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":19,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":1099,"num_read_kb":8258,"num_write":233,"num_write_kb":7536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":45,"num_bytes_recovered":5671270,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[{"shards":"1","objects":19}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"3b","length":"1"}]},{"pgid":"3.f","version":"128'312","reported_seq":1414,"reported_epoch":128,"state":"active+undersized+degraded","last_fresh":"2024-09-13T06:41:23.566186+0000","last_change":"2024-09-13T06:41:17.387229+0000","last_active":"2024-09-13T06:41:23.566186+0000","last_peered":"2024-09-13T06:41:23.566186+0000","last_clean":"2024-09-13T06:41:03.545088+0000","last_became_active":"2024-09-13T06:41:17.387229+0000","last_became_peered":"2024-09-13T06:41:17.387229+0000","last_unstale":"2024-09-13T06:41:23.566186+0000","last_undegraded":"2024-09-13T06:41:17.386644+0000","last_fullsized":"2024-09-13T06:41:17.386558+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":312,"log_dups_size":0,"ondisk_log_size":312,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":2,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:02:54.528972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0018736289999999999,"stat_sum":{"num_bytes":47048728,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":26,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":1966,"num_read_kb":24644,"num_write":510,"num_write_kb":17123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":79,"num_bytes_recovered":9398959,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":26}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"3b","length":"1"}]},{"pgid":"3.10","version":"129'387","reported_seq":1694,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-13T06:41:24.579287+0000","last_change":"2024-09-13T06:41:24.474174+0000","last_active":"2024-09-13T06:41:24.579287+0000","last_peered":"2024-09-13T06:41:24.579287+0000","last_clean":"2024-09-13T06:41:24.579287+0000","last_became_active":"2024-09-13T06:39:27.361949+0000","last_became_peered":"2024-09-13T06:39:27.361949+0000","last_unstale":"2024-09-13T06:41:24.579287+0000","last_undegraded":"2024-09-13T06:41:24.579287+0000","last_fullsized":"2024-09-13T06:41:24.579287+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":387,"log_dups_size":0,"ondisk_log_size":387,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:37:21.237288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00065638299999999997,"stat_sum":{"num_bytes":14982677,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":2555,"num_read_kb":12355,"num_write":594,"num_write_kb":8763,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"3b","length":"1"},{"start":"3e","length":"1"},{"start":"41","length":"1"}]},{"pgid":"3.11","version":"126'233","reported_seq":1057,"reported_epoch":128,"state":"active+undersized+degraded","last_fresh":"2024-09-13T06:41:23.461917+0000","last_change":"2024-09-13T06:41:17.387630+0000","last_active":"2024-09-13T06:41:23.461917+0000","last_peered":"2024-09-13T06:41:23.461917+0000","last_clean":"2024-09-13T06:41:03.561611+0000","last_became_active":"2024-09-13T06:41:17.387630+0000","last_became_peered":"2024-09-13T06:41:17.387630+0000","last_unstale":"2024-09-13T06:41:23.461917+0000","last_undegraded":"2024-09-13T06:41:17.385141+0000","last_fullsized":"2024-09-13T06:41:17.384778+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":233,"log_dups_size":0,"ondisk_log_size":233,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":2,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:13:53.718436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015217570000000001,"stat_sum":{"num_bytes":37971054,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":20,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":926,"num_read_kb":7972,"num_write":316,"num_write_kb":9881,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":51,"num_bytes_recovered":113535,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4],"acting":[4],"avail_no_missing":["4"],"object_location_counts":[{"shards":"4","objects":20}],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"3b","length":"1"}]},{"pgid":"3.12","version":"126'322","reported_seq":2600,"reported_epoch":129,"state":"active+undersized+degraded","last_fresh":"2024-09-13T06:41:24.482797+0000","last_change":"2024-09-13T06:41:17.387765+0000","last_active":"2024-09-13T06:41:24.482797+0000","last_peered":"2024-09-13T06:41:24.482797+0000","last_clean":"2024-09-13T06:41:15.619432+0000","last_became_active":"2024-09-13T06:41:17.387765+0000","last_became_peered":"2024-09-13T06:41:17.387765+0000","last_unstale":"2024-09-13T06:41:24.482797+0000","last_undegraded":"2024-09-13T06:41:17.386223+0000","last_fullsized":"2024-09-13T06:41:17.386083+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":322,"log_dups_size":0,"ondisk_log_size":322,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":2,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:01:56.837774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0026205450000000002,"stat_sum":{"num_bytes":62954104,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":25,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":2930,"num_read_kb":22664,"num_write":330,"num_write_kb":16036,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":33,"num_bytes_recovered":1691057,"num_keys_recovered":21,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":25}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"3b","length":"1"}]},{"pgid":"3.13","version":"128'277","reported_seq":1189,"reported_epoch":128,"state":"active+undersized+degraded","last_fresh":"2024-09-13T06:41:23.559207+0000","last_change":"2024-09-13T06:41:17.387239+0000","last_active":"2024-09-13T06:41:23.559207+0000","last_peered":"2024-09-13T06:41:23.559207+0000","last_clean":"2024-09-13T06:40:55.525143+0000","last_became_active":"2024-09-13T06:41:17.387239+0000","last_became_peered":"2024-09-13T06:41:17.387239+0000","last_unstale":"2024-09-13T06:41:23.559207+0000","last_undegraded":"2024-09-13T06:41:17.385187+0000","last_fullsized":"2024-09-13T06:41:17.384844+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":277,"log_dups_size":0,"ondisk_log_size":277,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":2,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:06:40.687222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00086804600000000003,"stat_sum":{"num_bytes":10234875,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":21,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":1663,"num_read_kb":8541,"num_write":470,"num_write_kb":9111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":29,"num_bytes_recovered":408436,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4],"acting":[4],"avail_no_missing":["4"],"object_location_counts":[{"shards":"4","objects":21}],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"3b","length":"1"}]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":686627903,"num_objects":670,"num_object_clones":0,"num_object_copies":1340,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":224,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":670,"num_whiteouts":0,"num_read":77174,"num_read_kb":522637,"num_write":13133,"num_write_kb":365227,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2348,"num_bytes_recovered":195114773,"num_keys_recovered":353,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":337825792,"data_stored":335832244,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9050,"ondisk_log_size":9050,"up":53,"acting":53,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":38,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":13,"acting":13,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":2,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":1,"acting":1,"num_store_stats":3}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574878,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":95744,"kb_used_data":60532,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94276096,"statfs":{"total":96636764160,"available":96538722304,"internally_reserved":0,"allocated":61984768,"data_stored":60898047,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":36043211},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 06:41:13 2024","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.75,"15min":0.754},"min":{"1min":0.52700000000000002,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":1.0629999999999999,"5min":1.121,"15min":1.121},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.80300000000000005,"15min":0.80500000000000005},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":1.611,"5min":1.611,"15min":1.611},"last":0.68200000000000005}]},{"osd":1,"last update":"Fri Sep 13 06:41:13 2024","interfaces":[{"interface":"back","average":{"1min":0.90900000000000003,"5min":0.82499999999999996,"15min":0.81100000000000005},"min":{"1min":0.48599999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":3.8159999999999998,"5min":3.8159999999999998,"15min":3.8159999999999998},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.749,"5min":0.75900000000000001,"15min":0.76100000000000001},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.321,"5min":1.321,"15min":1.321},"last":0.84199999999999997}]},{"osd":2,"last update":"Fri Sep 13 06:41:13 2024","interfaces":[{"interface":"back","average":{"1min":0.90200000000000002,"5min":0.93799999999999994,"15min":0.94399999999999995},"min":{"1min":0.441,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.089,"5min":1.881,"15min":1.881},"last":0.92800000000000005},{"interface":"front","average":{"1min":0.874,"5min":0.91800000000000004,"15min":0.92500000000000004},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":1.4970000000000001,"5min":1.627,"15min":1.627},"last":0.95199999999999996}]},{"osd":3,"last update":"Fri Sep 13 06:41:13 2024","interfaces":[{"interface":"back","average":{"1min":1.0549999999999999,"5min":0.875,"15min":0.84499999999999997},"min":{"1min":0.54100000000000004,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":3.9399999999999999,"5min":3.9399999999999999,"15min":3.9399999999999999},"last":0.57799999999999996},{"interface":"front","average":{"1min":1.024,"5min":1.01,"15min":1.008},"min":{"1min":0.75800000000000001,"5min":0.505,"15min":0.505},"max":{"1min":1.373,"5min":1.373,"15min":1.373},"last":1}]},{"osd":4,"last update":"Fri Sep 13 06:41:13 2024","interfaces":[{"interface":"back","average":{"1min":0.82599999999999996,"5min":0.86599999999999999,"15min":0.873},"min":{"1min":0.376,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.244,"5min":1.351,"15min":1.351},"last":1.1080000000000001},{"interface":"front","average":{"1min":0.997,"5min":0.90400000000000003,"15min":0.88800000000000001},"min":{"1min":0.46500000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":4.0119999999999996,"5min":4.0119999999999996,"15min":4.0119999999999996},"last":0.80100000000000005}]},{"osd":5,"last update":"Fri Sep 13 06:41:13 2024","interfaces":[{"interface":"back","average":{"1min":1.014,"5min":0.95599999999999996,"15min":0.94599999999999995},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.4279999999999999,"5min":1.4279999999999999,"15min":1.4279999999999999},"last":1.1659999999999999},{"interface":"front","average":{"1min":1.016,"5min":0.98699999999999999,"15min":0.98199999999999998},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":1.8680000000000001,"5min":1.8680000000000001,"15min":1.8680000000000001},"last":1.3620000000000001}]},{"osd":6,"last update":"Fri Sep 13 06:41:13 2024","interfaces":[{"interface":"back","average":{"1min":1.008,"5min":0.999,"15min":0.997},"min":{"1min":0.437,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.6899999999999999,"5min":1.7070000000000001,"15min":1.7070000000000001},"last":1.202},{"interface":"front","average":{"1min":1.163,"5min":0.999,"15min":0.97199999999999998},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":4.5659999999999998,"5min":4.5659999999999998,"15min":4.5659999999999998},"last":1.0700000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574877,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59404,"kb_used_data":20096,"kb_used_omap":1,"kb_used_meta":39294,"kb_avail":94312436,"statfs":{"total":96636764160,"available":96575934464,"internally_reserved":0,"allocated":20578304,"data_stored":19641028,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40237511},"hb_peers":[0,1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,1],"upper_bound":8},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 06:41:10 2024","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.73899999999999999,"15min":0.74299999999999999},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.03,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.83199999999999996},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.78900000000000003,"15min":0.79300000000000004},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":1.252,"5min":1.258,"15min":1.258},"last":0.98699999999999999}]},{"osd":1,"last update":"Fri Sep 13 06:41:10 2024","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.67800000000000005,"15min":0.67400000000000004},"min":{"1min":0.40400000000000003,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":1.008,"5min":1.081,"15min":1.081},"last":0.80300000000000005},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.84799999999999998,"15min":0.85099999999999998},"min":{"1min":0.60899999999999999,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.1000000000000001,"5min":1.5660000000000001,"15min":1.5660000000000001},"last":0.622}]},{"osd":2,"last update":"Fri Sep 13 06:41:10 2024","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.83999999999999997,"15min":0.85399999999999998},"min":{"1min":0.53600000000000003,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.0609999999999999,"5min":1.3140000000000001,"15min":1.3140000000000001},"last":1.014},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.91300000000000003,"15min":0.93100000000000005},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.179,"5min":1.5229999999999999,"15min":1.5229999999999999},"last":1.2170000000000001}]},{"osd":3,"last update":"Fri Sep 13 06:41:10 2024","interfaces":[{"interface":"back","average":{"1min":1.133,"5min":0.91400000000000003,"15min":0.878},"min":{"1min":0.47599999999999998,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":6.2999999999999998,"5min":6.2999999999999998,"15min":6.2999999999999998},"last":0.72599999999999998},{"interface":"front","average":{"1min":1.169,"5min":0.92200000000000004,"15min":0.88100000000000001},"min":{"1min":0.51500000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":6.2850000000000001,"5min":6.2850000000000001,"15min":6.2850000000000001},"last":1.173}]},{"osd":4,"last update":"Fri Sep 13 06:41:10 2024","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.93200000000000005,"15min":0.95099999999999996},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":1.141,"5min":1.748,"15min":1.748},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.89600000000000002,"5min":0.99399999999999999,"15min":1.01},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.2949999999999999,"5min":1.3480000000000001,"15min":1.3480000000000001},"last":1.0589999999999999}]},{"osd":5,"last update":"Fri Sep 13 06:41:10 2024","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.94199999999999995,"15min":0.95799999999999996},"min":{"1min":0.64400000000000002,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.234,"5min":1.387,"15min":1.387},"last":0.90700000000000003},{"interface":"front","average":{"1min":0.96399999999999997,"5min":1.0449999999999999,"15min":1.0589999999999999},"min":{"1min":0.41399999999999998,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.202,"5min":1.4830000000000001,"15min":1.4830000000000001},"last":1.1399999999999999}]},{"osd":7,"last update":"Fri Sep 13 06:41:10 2024","interfaces":[{"interface":"back","average":{"1min":1.048,"5min":1.1439999999999999,"15min":1.1599999999999999},"min":{"1min":0.63400000000000001,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.6799999999999999,"5min":1.8999999999999999,"15min":1.8999999999999999},"last":1.071},{"interface":"front","average":{"1min":0.98999999999999999,"5min":1.0860000000000001,"15min":1.1020000000000001},"min":{"1min":0.59699999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.4790000000000001,"5min":1.6020000000000001,"15min":1.6020000000000001},"last":1.0269999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574878,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":68612,"kb_used_data":41584,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94303228,"statfs":{"total":96636764160,"available":96566505472,"internally_reserved":0,"allocated":42582016,"data_stored":41536371,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 06:41:10 2024","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.77400000000000002,"15min":0.78500000000000003},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.2250000000000001,"5min":1.6679999999999999,"15min":1.6679999999999999},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.82699999999999996,"5min":0.81599999999999995,"15min":0.81399999999999995},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":1.3700000000000001,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":0.57299999999999995}]},{"osd":1,"last update":"Fri Sep 13 06:41:10 2024","interfaces":[{"interface":"back","average":{"1min":0.82399999999999995,"5min":0.77000000000000002,"15min":0.76100000000000001},"min":{"1min":0.54000000000000004,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.341,"5min":1.341,"15min":1.341},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.74099999999999999,"15min":0.754},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.97899999999999998,"5min":1.081,"15min":1.081},"last":0.83999999999999997}]},{"osd":2,"last update":"Fri Sep 13 06:41:10 2024","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.871,"15min":0.88100000000000001},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.147,"5min":1.246,"15min":1.246},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.79900000000000004,"15min":0.80000000000000004},"min":{"1min":0.51900000000000002,"5min":0.435,"15min":0.435},"max":{"1min":1.1419999999999999,"5min":1.4279999999999999,"15min":1.4279999999999999},"last":0.72699999999999998}]},{"osd":3,"last update":"Fri Sep 13 06:41:10 2024","interfaces":[{"interface":"back","average":{"1min":0.878,"5min":0.78600000000000003,"15min":0.77000000000000002},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.327,"5min":1.327,"15min":1.327},"last":0.89100000000000001},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.85699999999999998,"15min":0.86299999999999999},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.0649999999999999,"5min":1.2190000000000001,"15min":1.2190000000000001},"last":0.93300000000000005}]},{"osd":4,"last update":"Fri Sep 13 06:41:10 2024","interfaces":[{"interface":"back","average":{"1min":0.85199999999999998,"5min":0.80200000000000005,"15min":0.79400000000000004},"min":{"1min":0.41099999999999998,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.379,"5min":1.754,"15min":1.754},"last":0.96299999999999997},{"interface":"front","average":{"1min":0.98699999999999999,"5min":0.86799999999999999,"15min":0.84799999999999998},"min":{"1min":0.42299999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":1.778,"5min":1.778,"15min":1.778},"last":0.997}]},{"osd":6,"last update":"Fri Sep 13 06:41:10 2024","interfaces":[{"interface":"back","average":{"1min":0.91100000000000003,"5min":0.88900000000000001,"15min":0.88500000000000001},"min":{"1min":0.38,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.375,"5min":1.375,"15min":1.375},"last":1.0529999999999999},{"interface":"front","average":{"1min":0.90000000000000002,"5min":0.88,"15min":0.876},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.3200000000000001,"5min":1.968,"15min":1.968},"last":1.0289999999999999}]},{"osd":7,"last update":"Fri Sep 13 06:41:10 2024","interfaces":[{"interface":"back","average":{"1min":1.0880000000000001,"5min":0.93999999999999995,"15min":0.91600000000000004},"min":{"1min":0.46100000000000002,"5min":0.314,"15min":0.314},"max":{"1min":1.923,"5min":1.923,"15min":1.923},"last":0.81299999999999994},{"interface":"front","average":{"1min":1.0089999999999999,"5min":0.99099999999999999,"15min":0.98799999999999999},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.4059999999999999,"5min":1.4790000000000001,"15min":1.4790000000000001},"last":0.83699999999999997}]}]},{"osd":4,"up_from":13,"seq":55834574878,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":78988,"kb_used_data":39676,"kb_used_omap":1,"kb_used_meta":39294,"kb_avail":94292852,"statfs":{"total":96636764160,"available":96555880448,"internally_reserved":0,"allocated":40628224,"data_stored":39616339,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40237510},"hb_peers":[0,1,2,3,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 06:41:11 2024","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":1.03,"15min":1.069},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.3959999999999999,"5min":5.8230000000000004,"15min":5.8230000000000004},"last":0.90300000000000002},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.75800000000000001,"15min":0.76400000000000001},"min":{"1min":0.47799999999999998,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.96999999999999997,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":0.88}]},{"osd":1,"last update":"Fri Sep 13 06:41:11 2024","interfaces":[{"interface":"back","average":{"1min":1.2390000000000001,"5min":0.83099999999999996,"15min":0.76300000000000001},"min":{"1min":0.45400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":10.156000000000001,"5min":10.156000000000001,"15min":10.156000000000001},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.84799999999999998,"15min":0.85999999999999999},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.256,"5min":1.286,"15min":1.286},"last":0.68100000000000005}]},{"osd":2,"last update":"Fri Sep 13 06:41:11 2024","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.83499999999999996,"15min":0.85099999999999998},"min":{"1min":0.48799999999999999,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.0349999999999999,"5min":1.5209999999999999,"15min":1.5209999999999999},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.81699999999999995,"15min":0.82099999999999995},"min":{"1min":0.55500000000000005,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.331,"5min":1.3540000000000001,"15min":1.3540000000000001},"last":0.80300000000000005}]},{"osd":3,"last update":"Fri Sep 13 06:41:11 2024","interfaces":[{"interface":"back","average":{"1min":0.84299999999999997,"5min":0.91200000000000003,"15min":0.92400000000000004},"min":{"1min":0.69699999999999995,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.0680000000000001,"5min":1.4810000000000001,"15min":1.4810000000000001},"last":0.745},{"interface":"front","average":{"1min":1.355,"5min":0.999,"15min":0.93999999999999995},"min":{"1min":0.61299999999999999,"5min":0.374,"15min":0.374},"max":{"1min":10.195,"5min":10.195,"15min":10.195},"last":0.82799999999999996}]},{"osd":5,"last update":"Fri Sep 13 06:41:11 2024","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.86399999999999999,"15min":0.873},"min":{"1min":0.432,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":1.1739999999999999,"5min":2.9790000000000001,"15min":2.9790000000000001},"last":0.94099999999999995},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.92000000000000004,"15min":0.93899999999999995},"min":{"1min":0.47799999999999998,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.093,"5min":1.8779999999999999,"15min":1.8779999999999999},"last":0.92800000000000005}]},{"osd":6,"last update":"Fri Sep 13 06:41:11 2024","interfaces":[{"interface":"back","average":{"1min":1.3580000000000001,"5min":0.89800000000000002,"15min":0.82099999999999995},"min":{"1min":0.48499999999999999,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":10.016999999999999,"5min":10.016999999999999,"15min":10.016999999999999},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.876,"5min":0.95399999999999996,"15min":0.96699999999999997},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":1.284,"5min":2.0750000000000002,"15min":2.0750000000000002},"last":0.85899999999999999}]},{"osd":7,"last update":"Fri Sep 13 06:41:11 2024","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.95899999999999996,"15min":0.98299999999999998},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":1.143,"5min":1.583,"15min":1.583},"last":1.5609999999999999},{"interface":"front","average":{"1min":1.4139999999999999,"5min":1.036,"15min":0.97299999999999998},"min":{"1min":0.53300000000000003,"5min":0.439,"15min":0.439},"max":{"1min":10.117000000000001,"5min":10.117000000000001,"15min":10.117000000000001},"last":1.5089999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574880,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":80536,"kb_used_data":53520,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94291304,"statfs":{"total":96636764160,"available":96554295296,"internally_reserved":0,"allocated":54804480,"data_stored":53699056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 06:41:10 2024","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.29499999999999998,"5min":0.191,"15min":0.191},"max":{"1min":1.0940000000000001,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.626,"5min":0.66700000000000004,"15min":0.67400000000000004},"min":{"1min":0.27900000000000003,"5min":0.251,"15min":0.251},"max":{"1min":1.0109999999999999,"5min":1.2789999999999999,"15min":1.2789999999999999},"last":0.34799999999999998}]},{"osd":1,"last update":"Fri Sep 13 06:41:10 2024","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.58499999999999996,"15min":0.59799999999999998},"min":{"1min":0.247,"5min":0.222,"15min":0.222},"max":{"1min":0.94499999999999995,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.67600000000000005,"15min":0.69299999999999995},"min":{"1min":0.28299999999999997,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":1.008,"5min":1.589,"15min":1.589},"last":0.40200000000000002}]},{"osd":2,"last update":"Fri Sep 13 06:41:10 2024","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.65300000000000002,"15min":0.66000000000000003},"min":{"1min":0.36099999999999999,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.1679999999999999,"5min":1.323,"15min":1.323},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.63100000000000001,"15min":0.63800000000000001},"min":{"1min":0.377,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.88900000000000001,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.42399999999999999}]},{"osd":4,"last update":"Fri Sep 13 06:41:10 2024","interfaces":[{"interface":"back","average":{"1min":0.88400000000000001,"5min":0.92000000000000004,"15min":0.92600000000000005},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.1679999999999999,"5min":1.7929999999999999,"15min":1.7929999999999999},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"min":{"1min":0.56100000000000005,"5min":0.439,"15min":0.439},"max":{"1min":1.0349999999999999,"5min":1.3240000000000001,"15min":1.3240000000000001},"last":0.66300000000000003}]},{"osd":5,"last update":"Fri Sep 13 06:41:10 2024","interfaces":[{"interface":"back","average":{"1min":0.88200000000000001,"5min":0.872,"15min":0.87},"min":{"1min":0.57699999999999996,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.3069999999999999,"5min":1.3799999999999999,"15min":1.3799999999999999},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.86199999999999999,"15min":0.872},"min":{"1min":0.55600000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.0449999999999999,"5min":1.204,"15min":1.204},"last":0.64900000000000002}]},{"osd":6,"last update":"Fri Sep 13 06:41:10 2024","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":0.91600000000000004,"15min":0.92100000000000004},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.5209999999999999,"5min":1.532,"15min":1.532},"last":0.83899999999999997},{"interface":"front","average":{"1min":0.96499999999999997,"5min":1,"15min":1.006},"min":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.5680000000000001,"5min":1.825,"15min":1.825},"last":0.78300000000000003}]},{"osd":7,"last update":"Fri Sep 13 06:41:10 2024","interfaces":[{"interface":"back","average":{"1min":1.012,"5min":1.0429999999999999,"15min":1.048},"min":{"1min":0.70199999999999996,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.5640000000000001,"5min":1.7430000000000001,"15min":1.7430000000000001},"last":0.85699999999999998},{"interface":"front","average":{"1min":0.89500000000000002,"5min":0.94599999999999995,"15min":0.95399999999999996},"min":{"1min":0.63600000000000001,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.2849999999999999,"5min":1.8859999999999999,"15min":1.8859999999999999},"last":0.67800000000000005}]}]},{"osd":2,"up_from":13,"seq":55834574878,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":77840,"kb_used_data":42624,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94294000,"statfs":{"total":96636764160,"available":96557056000,"internally_reserved":0,"allocated":43646976,"data_stored":42629662,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36043206},"hb_peers":[0,1,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 06:41:10 2024","interfaces":[{"interface":"back","average":{"1min":1.1419999999999999,"5min":0.63600000000000001,"15min":0.55200000000000005},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":8.6449999999999996,"5min":8.6449999999999996,"15min":8.6449999999999996},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.63800000000000001,"15min":0.60599999999999998},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":4.0380000000000003,"5min":4.0380000000000003,"15min":4.0380000000000003},"last":0.57199999999999995}]},{"osd":1,"last update":"Fri Sep 13 06:41:10 2024","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.65200000000000002,"15min":0.624},"min":{"1min":0.39300000000000002,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":3.4649999999999999,"5min":3.4649999999999999,"15min":3.4649999999999999},"last":0.91300000000000003},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.623,"15min":0.58899999999999997},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":3.8159999999999998,"5min":3.8159999999999998,"15min":3.8159999999999998},"last":0.78800000000000003}]},{"osd":3,"last update":"Fri Sep 13 06:41:10 2024","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.59499999999999997,"15min":0.56799999999999995},"min":{"1min":0.38600000000000001,"5min":0.249,"15min":0.249},"max":{"1min":3.407,"5min":3.407,"15min":3.407},"last":0.93600000000000005},{"interface":"front","average":{"1min":0.88700000000000001,"5min":0.70699999999999996,"15min":0.67700000000000005},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":3.2639999999999998,"5min":3.2639999999999998,"15min":3.2639999999999998},"last":1.002}]},{"osd":4,"last update":"Fri Sep 13 06:41:10 2024","interfaces":[{"interface":"back","average":{"1min":1.0640000000000001,"5min":0.92400000000000004,"15min":0.90000000000000002},"min":{"1min":0.64300000000000002,"5min":0.44,"15min":0.44},"max":{"1min":3.1179999999999999,"5min":3.1179999999999999,"15min":3.1179999999999999},"last":0.85899999999999999},{"interface":"front","average":{"1min":1.9419999999999999,"5min":1.093,"15min":0.95099999999999996},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":21.081,"5min":21.081,"15min":21.081},"last":0.97999999999999998}]},{"osd":5,"last update":"Fri Sep 13 06:41:10 2024","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"min":{"1min":0.60999999999999999,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":1.216,"5min":1.607,"15min":1.607},"last":0.63300000000000001},{"interface":"front","average":{"1min":1.0980000000000001,"5min":0.90200000000000002,"15min":0.87},"min":{"1min":0.61199999999999999,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":3.3290000000000002,"5min":3.3290000000000002,"15min":3.3290000000000002},"last":0.96099999999999997}]},{"osd":6,"last update":"Fri Sep 13 06:41:10 2024","interfaces":[{"interface":"back","average":{"1min":1.091,"5min":0.95199999999999996,"15min":0.92900000000000005},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":3.923,"5min":3.923,"15min":3.923},"last":0.88700000000000001},{"interface":"front","average":{"1min":0.95299999999999996,"5min":0.88300000000000001,"15min":0.871},"min":{"1min":0.57499999999999996,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":2.2120000000000002,"5min":2.2120000000000002,"15min":2.2120000000000002},"last":0.82599999999999996}]},{"osd":7,"last update":"Fri Sep 13 06:41:10 2024","interfaces":[{"interface":"back","average":{"1min":1.077,"5min":0.96599999999999997,"15min":0.94799999999999995},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":3.8599999999999999,"5min":3.8599999999999999,"15min":3.8599999999999999},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.97199999999999998,"5min":0.91600000000000004,"15min":0.90600000000000003},"min":{"1min":0.60399999999999998,"5min":0.442,"15min":0.442},"max":{"1min":2.2959999999999998,"5min":2.2959999999999998,"15min":2.2959999999999998},"last":1.119}]}]},{"osd":1,"up_from":13,"seq":55834574878,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":71736,"kb_used_data":32420,"kb_used_omap":1,"kb_used_meta":39294,"kb_avail":94300104,"statfs":{"total":96636764160,"available":96563306496,"internally_reserved":0,"allocated":33198080,"data_stored":32180118,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40237510},"hb_peers":[0,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 06:41:18 2024","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.56999999999999995,"15min":0.57799999999999996},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.92000000000000004,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.65700000000000003,"15min":0.66400000000000003},"min":{"1min":0.20899999999999999,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":1.155,"5min":1.387,"15min":1.387},"last":0.60799999999999998}]},{"osd":2,"last update":"Fri Sep 13 06:41:18 2024","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.64100000000000001,"15min":0.64500000000000002},"min":{"1min":0.22,"5min":0.22,"15min":0.22},"max":{"1min":1.3959999999999999,"5min":2.113,"15min":2.113},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":1.276,"5min":1.2989999999999999,"15min":1.2989999999999999},"last":0.751}]},{"osd":3,"last update":"Fri Sep 13 06:41:18 2024","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.72299999999999998,"15min":0.73199999999999998},"min":{"1min":0.35099999999999998,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":1.3600000000000001,"5min":1.3640000000000001,"15min":1.3640000000000001},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.69099999999999995,"15min":0.69899999999999995},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":1.1919999999999999,"5min":1.427,"15min":1.427},"last":0.97999999999999998}]},{"osd":4,"last update":"Fri Sep 13 06:41:18 2024","interfaces":[{"interface":"back","average":{"1min":0.79900000000000004,"5min":0.82399999999999995,"15min":0.82799999999999996},"min":{"1min":0.53300000000000003,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.0549999999999999,"5min":1.226,"15min":1.226},"last":0.83299999999999996},{"interface":"front","average":{"1min":0.83099999999999996,"5min":0.91100000000000003,"15min":0.92500000000000004},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.3260000000000001,"5min":1.4359999999999999,"15min":1.4359999999999999},"last":0.86599999999999999}]},{"osd":5,"last update":"Fri Sep 13 06:41:18 2024","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.91700000000000004,"15min":0.93000000000000005},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.262,"5min":1.7849999999999999,"15min":1.7849999999999999},"last":0.78800000000000003},{"interface":"front","average":{"1min":0.81999999999999995,"5min":0.872,"15min":0.88100000000000001},"min":{"1min":0.39500000000000002,"5min":0.378,"15min":0.378},"max":{"1min":1.323,"5min":2.036,"15min":2.036},"last":1.0129999999999999}]},{"osd":6,"last update":"Fri Sep 13 06:41:18 2024","interfaces":[{"interface":"back","average":{"1min":0.875,"5min":0.93899999999999995,"15min":0.94999999999999996},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.3169999999999999,"5min":1.8149999999999999,"15min":1.8149999999999999},"last":0.90000000000000002},{"interface":"front","average":{"1min":0.90200000000000002,"5min":0.91800000000000004,"15min":0.92100000000000004},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.3180000000000001,"5min":1.9490000000000001,"15min":1.9490000000000001},"last":0.93799999999999994}]},{"osd":7,"last update":"Fri Sep 13 06:40:13 2024","interfaces":[{"interface":"back","average":{"1min":1,"5min":1,"15min":1},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.5509999999999999,"5min":1.5509999999999999,"15min":1.5509999999999999},"last":0.93899999999999995},{"interface":"front","average":{"1min":1.024,"5min":1.024,"15min":1.024},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.748,"5min":1.748,"15min":1.748},"last":1.238}]}]},{"osd":0,"up_from":13,"seq":55834574877,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":105596,"kb_used_data":56428,"kb_used_omap":1,"kb_used_meta":49150,"kb_avail":94266244,"statfs":{"total":96636764160,"available":96528633856,"internally_reserved":0,"allocated":57782272,"data_stored":56670626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":50330054},"hb_peers":[1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 06:41:10 2024","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.52900000000000003,"15min":0.52300000000000002},"min":{"1min":0.247,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.84799999999999998,"5min":1.2270000000000001,"15min":1.2270000000000001},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.52700000000000002,"15min":0.52900000000000003},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.83399999999999996,"5min":1.222,"15min":1.222},"last":0.79900000000000004}]},{"osd":2,"last update":"Fri Sep 13 06:41:10 2024","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.54000000000000004,"15min":0.53400000000000003},"min":{"1min":0.316,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.97299999999999998,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.56200000000000006,"15min":0.55800000000000005},"min":{"1min":0.25900000000000001,"5min":0.245,"15min":0.245},"max":{"1min":0.93400000000000005,"5min":1.359,"15min":1.359},"last":1.0620000000000001}]},{"osd":3,"last update":"Fri Sep 13 06:41:10 2024","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.53600000000000003,"15min":0.53700000000000003},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.81899999999999995,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.66500000000000004,"15min":0.67300000000000004},"min":{"1min":0.34200000000000003,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":1.0669999999999999,"5min":1.51,"15min":1.51},"last":0.90000000000000002}]},{"osd":4,"last update":"Fri Sep 13 06:41:10 2024","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":0.79400000000000004,"15min":0.79000000000000004},"min":{"1min":0.61599999999999999,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.0529999999999999,"5min":1.5449999999999999,"15min":1.5449999999999999},"last":0.97299999999999998},{"interface":"front","average":{"1min":0.749,"5min":0.79600000000000004,"15min":0.80400000000000005},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.0529999999999999,"5min":1.6319999999999999,"15min":1.6319999999999999},"last":0.88}]},{"osd":5,"last update":"Fri Sep 13 06:41:10 2024","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.84599999999999997,"15min":0.84799999999999998},"min":{"1min":0.55500000000000005,"5min":0.378,"15min":0.378},"max":{"1min":1.4059999999999999,"5min":1.4059999999999999,"15min":1.4059999999999999},"last":0.95099999999999996},{"interface":"front","average":{"1min":0.89900000000000002,"5min":0.88100000000000001,"15min":0.878},"min":{"1min":0.64700000000000002,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.4319999999999999,"5min":1.5740000000000001,"15min":1.5740000000000001},"last":1.141}]},{"osd":6,"last update":"Fri Sep 13 06:41:10 2024","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.92000000000000004,"15min":0.93400000000000005},"min":{"1min":0.63800000000000001,"5min":0.499,"15min":0.499},"max":{"1min":1.1200000000000001,"5min":2.4969999999999999,"15min":2.4969999999999999},"last":0.92800000000000005},{"interface":"front","average":{"1min":0.871,"5min":0.90300000000000002,"15min":0.90800000000000003},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.4670000000000001,"5min":2.0419999999999998,"15min":2.0419999999999998},"last":0.85399999999999998}]},{"osd":7,"last update":"Fri Sep 13 06:41:10 2024","interfaces":[{"interface":"back","average":{"1min":0.89900000000000002,"5min":0.91100000000000003,"15min":0.91300000000000003},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.1819999999999999,"5min":1.6020000000000001,"15min":1.6020000000000001},"last":1.1339999999999999},{"interface":"front","average":{"1min":0.88300000000000001,"5min":0.95999999999999996,"15min":0.97299999999999998},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":1.264,"5min":2.4049999999999998,"15min":2.4049999999999998},"last":1.0589999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":55656448,"data_stored":55340763,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":31649792,"data_stored":31434258,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":42115072,"data_stored":41890167,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":53260288,"data_stored":52953215,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":39096320,"data_stored":38876844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":41033728,"data_stored":40790511,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":19046400,"data_stored":18901533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":55967744,"data_stored":55644953,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T06:41:28.907 INFO:tasks.thrashosds.thrasher:Setting 2.4 to [6, 1, 5, 0] 2024-09-13T06:41:28.907 INFO:tasks.thrashosds.thrasher:cmd ['osd', 'pg-upmap-items', '2.4', '6', '1', '5', '0'] 2024-09-13T06:41:28.908 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pg-upmap-items 2.4 6 1 5 0 2024-09-13T06:41:28.930 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:41:28.931 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:41:28.944 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-13T06:41:28.990 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:41:28.990+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:41:29.052 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:41:29.050+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:41:29.105 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:41:29.105 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:41:29.119 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-13T06:41:29.153 INFO:tasks.ceph.osd.6.smithi139.stderr:2024-09-13T06:41:29.151+0000 7fcd02c5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26385) UID: 0 2024-09-13T06:41:29.255 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:41:29.254+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:41:29.275 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:41:29.275 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:41:29.287 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-13T06:41:29.374 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:41:29.374+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:41:29.394 INFO:teuthology.orchestra.run.smithi081.stderr:nodeep-scrub is set 2024-09-13T06:41:29.394 INFO:teuthology.orchestra.run.smithi081.stderr:set 2.4 pg_upmap_items mapping to [6->1,5->0] 2024-09-13T06:41:29.453 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:41:29.454 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:41:29.456 INFO:tasks.ceph.osd.6.smithi139.stderr:2024-09-13T06:41:29.455+0000 7fcd02c5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26385) UID: 0 2024-09-13T06:41:29.469 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-13T06:41:29.540 INFO:teuthology.orchestra.run.smithi081.stdout:checking clone #20, image image_client.0-clone20 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent21 2024-09-13T06:41:29.557 INFO:tasks.ceph.osd.6.smithi139.stderr:2024-09-13T06:41:29.555+0000 7fcd02c5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26385) UID: 0 2024-09-13T06:41:29.625 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:41:29.625 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:41:29.626 INFO:teuthology.orchestra.run.smithi081.stdout:3546 read 0x191b15 thru 0x19d89a (0xbd86 bytes) 2024-09-13T06:41:29.640 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-13T06:41:29.649 INFO:teuthology.orchestra.run.smithi081.stdout:3547 writesame 0xac67074 thru 0xac72321 data_size 0x1(0xb2ae bytes) 2024-09-13T06:41:29.649 INFO:teuthology.orchestra.run.smithi081.stdout:3549 punch from 0x38362af to 0x383e4b8, (0x8209 bytes) 2024-09-13T06:41:29.649 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:41:29.649 INFO:teuthology.orchestra.run.smithi081.stdout:3552 read 0x93be254 thru 0x93c57fd (0x75aa bytes) 2024-09-13T06:41:29.658 INFO:teuthology.orchestra.run.smithi081.stdout:3554 trunc from 0xac72322 to 0x394284d 2024-09-13T06:41:29.658 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:41:29.658+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:41:29.743 INFO:teuthology.orchestra.run.smithi081.stdout:3556 trunc from 0x394284d to 0x7e4a9a1 2024-09-13T06:41:29.751 INFO:teuthology.orchestra.run.smithi081.stdout:3557 read 0x3a5d610 thru 0x3a6bc6c (0xe65d bytes) 2024-09-13T06:41:29.758 INFO:tasks.ceph.osd.6.smithi139.stderr:2024-09-13T06:41:29.755+0000 7fcd02c5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26385) UID: 0 2024-09-13T06:41:29.760 INFO:teuthology.orchestra.run.smithi081.stdout:3558 trunc from 0x7e4a9a1 to 0x127b1a2 2024-09-13T06:41:29.806 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:41:29.806 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:41:29.813 INFO:teuthology.orchestra.run.smithi081.stdout:3559 punch from 0x75721d to 0x75bd8a, (0x4b6d bytes) 2024-09-13T06:41:29.821 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-13T06:41:29.832 INFO:teuthology.orchestra.run.smithi081.stdout:3560 writesame 0x732707b thru 0x73315f6 data_size 0x77(0xa57c bytes) 2024-09-13T06:41:29.832 INFO:teuthology.orchestra.run.smithi081.stdout:3562 write 0x7276dc8 thru 0x727e4eb (0x7724 bytes) 2024-09-13T06:41:29.838 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:41:29.844 INFO:teuthology.orchestra.run.smithi081.stdout:3564 trunc from 0x73315f7 to 0xb604968 2024-09-13T06:41:29.857 INFO:teuthology.orchestra.run.smithi081.stdout:3565 punch from 0x27e78b4 to 0x27f4329, (0xca75 bytes) 2024-09-13T06:41:29.857 INFO:teuthology.orchestra.run.smithi081.stdout:3566 read 0x1742824 thru 0x174e97b (0xc158 bytes) 2024-09-13T06:41:29.857 INFO:teuthology.orchestra.run.smithi081.stdout:3567 punch from 0xa6de107 to 0xa6df1a0, (0x1099 bytes) 2024-09-13T06:41:29.857 INFO:teuthology.orchestra.run.smithi081.stdout:3568 writesame 0xacbbd03 thru 0xacbf6b1 data_size 0x1(0x39af bytes) 2024-09-13T06:41:29.859 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:41:29.858+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:41:29.893 INFO:teuthology.orchestra.run.smithi081.stdout:3569 write 0xe7a65f4 thru 0xe7b5627 (0xf034 bytes) 2024-09-13T06:41:29.903 INFO:teuthology.orchestra.run.smithi081.stdout:3572 write 0xc9c8ac2 thru 0xc9cdb37 (0x5076 bytes) 2024-09-13T06:41:29.909 INFO:teuthology.orchestra.run.smithi081.stdout:3573 write 0x10b729 thru 0x10f354 (0x3c2c bytes) 2024-09-13T06:41:29.911 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:41:29.911 INFO:teuthology.orchestra.run.smithi081.stdout:3575 read 0xe769316 thru 0xe76ab5c (0x1847 bytes) 2024-09-13T06:41:29.912 INFO:teuthology.orchestra.run.smithi081.stdout:3576 writesame 0xc929f78 thru 0xc933035 data_size 0x61(0x90be bytes) 2024-09-13T06:41:29.919 INFO:teuthology.orchestra.run.smithi081.stdout:3577 read 0x944aece thru 0x944ed3d (0x3e70 bytes) 2024-09-13T06:41:29.919 INFO:teuthology.orchestra.run.smithi081.stdout:3579 write 0x710ab62 thru 0x710e02a (0x34c9 bytes) 2024-09-13T06:41:29.924 INFO:teuthology.orchestra.run.smithi081.stdout:3580 writesame 0xd2a3862 thru 0xd2af01b data_size 0x36(0xb7ba bytes) 2024-09-13T06:41:29.925 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-13T06:41:29.934 INFO:teuthology.orchestra.run.smithi081.stdout:3581 read 0x5ffe4a1 thru 0x600c5c1 (0xe121 bytes) 2024-09-13T06:41:29.934 INFO:teuthology.orchestra.run.smithi081.stdout:3582 punch from 0x7a3588e to 0x7a3bea8, (0x661a bytes) 2024-09-13T06:41:29.934 INFO:teuthology.orchestra.run.smithi081.stdout:3583 punch from 0xb8b709f to 0xb8c6382, (0xf2e3 bytes) 2024-09-13T06:41:29.934 INFO:teuthology.orchestra.run.smithi081.stdout:3584 read 0x2638fee thru 0x263e2c0 (0x52d3 bytes) 2024-09-13T06:41:29.949 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:41:29.949 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:41:29.953 INFO:teuthology.orchestra.run.smithi081.stdout:3585 trunc from 0xe7b5628 to 0x1fd2e75 2024-09-13T06:41:29.960 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:41:29.959+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:41:29.969 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-13T06:41:29.978 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:41:29.979 INFO:teuthology.orchestra.run.smithi081.stdout:3589 trunc from 0x1fd2e75 to 0xcbfc0c 2024-09-13T06:41:30.006 INFO:teuthology.orchestra.run.smithi081.stdout:3590 read 0x52d0a3 thru 0x5349f8 (0x7956 bytes) 2024-09-13T06:41:30.021 INFO:teuthology.orchestra.run.smithi081.stdout:3592 write 0xfeda4d thru 0xff332a (0x58de bytes) 2024-09-13T06:41:30.058 INFO:teuthology.orchestra.run.smithi081.stdout:3593 writesame 0xea1473a thru 0xea19085 data_size 0x2(0x494c bytes) 2024-09-13T06:41:30.061 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:41:30.058+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:41:30.062 INFO:teuthology.orchestra.run.smithi081.stdout:3594 trunc from 0xea19086 to 0xc23b59b 2024-09-13T06:41:30.070 INFO:teuthology.orchestra.run.smithi081.stdout:osd.0: {} 2024-09-13T06:41:30.071 INFO:teuthology.orchestra.run.smithi081.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-13T06:41:30.074 INFO:teuthology.orchestra.run.smithi081.stdout:3596 write 0x9e3d9a0 thru 0x9e4ad6d (0xd3ce bytes) 2024-09-13T06:41:30.082 INFO:teuthology.orchestra.run.smithi081.stdout:3597 write 0x499a4e thru 0x4a2cfb (0x92ae bytes) 2024-09-13T06:41:30.085 INFO:teuthology.orchestra.run.smithi081.stdout:3598 punch from 0x7dc9ef2 to 0x7dd0fc9, (0x70d7 bytes) 2024-09-13T06:41:30.090 INFO:teuthology.orchestra.run.smithi081.stdout:osd.1: {} 2024-09-13T06:41:30.090 INFO:teuthology.orchestra.run.smithi081.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-13T06:41:30.099 INFO:teuthology.orchestra.run.smithi081.stdout:3599 trunc from 0xc23b59b to 0x27a2231 2024-09-13T06:41:30.107 INFO:teuthology.orchestra.run.smithi081.stdout:osd.2: {} 2024-09-13T06:41:30.107 INFO:teuthology.orchestra.run.smithi081.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-13T06:41:30.117 INFO:teuthology.orchestra.run.smithi081.stdout:3600 read 0xec6d45 thru 0xed3736 (0xc9f2 bytes) 2024-09-13T06:41:30.118 INFO:teuthology.orchestra.run.smithi081.stdout:3602 read 0x1669720 thru 0x167793e (0xe21f bytes) 2024-09-13T06:41:30.125 INFO:teuthology.orchestra.run.smithi081.stdout:osd.3: {} 2024-09-13T06:41:30.125 INFO:teuthology.orchestra.run.smithi081.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-13T06:41:30.127 INFO:teuthology.orchestra.run.smithi081.stdout:3604 trunc from 0x27a2231 to 0xa1f1e24 2024-09-13T06:41:30.129 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:41:30.129 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 20, 2024-09-13T06:41:30.129 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 600, 2024-09-13T06:41:30.129 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [ 2024-09-13T06:41:30.129 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.129 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:36160 3.f 3:f62782c2:::rbd_object_map.11219660270d.0000000000000016:head [call] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-13T06:41:30.129 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:01.607291+0000", 2024-09-13T06:41:30.129 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 88.522342408, 2024-09-13T06:41:30.130 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.99619456699999998, 2024-09-13T06:41:30.130 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:30.130 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:30.130 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:30.130 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:30.130 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:30.130 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 36160 2024-09-13T06:41:30.130 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.130 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:30.130 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.130 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:30.130 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:01.607291+0000", 2024-09-13T06:41:30.130 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:30.130 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.130 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.131 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:30.131 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:01.607291+0000", 2024-09-13T06:41:30.131 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:30.131 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.131 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.131 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:30.131 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:01.607289+0000", 2024-09-13T06:41:30.131 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999976 2024-09-13T06:41:30.131 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.131 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.131 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:30.131 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:01.607302+0000", 2024-09-13T06:41:30.131 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3018e-05 2024-09-13T06:41:30.131 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.131 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.132 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:30.132 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:01.607323+0000", 2024-09-13T06:41:30.132 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1030999999999999e-05 2024-09-13T06:41:30.132 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.132 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.132 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:30.132 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:01.607342+0000", 2024-09-13T06:41:30.132 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8961e-05 2024-09-13T06:41:30.132 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.132 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.132 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:30.132 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:01.607425+0000", 2024-09-13T06:41:30.132 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.3171999999999996e-05 2024-09-13T06:41:30.132 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.133 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.133 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:41:30.133 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:01.607441+0000", 2024-09-13T06:41:30.133 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5996999999999999e-05 2024-09-13T06:41:30.133 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.133 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.133 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:30.133 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:02.596186+0000", 2024-09-13T06:41:30.133 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.98874432000000001 2024-09-13T06:41:30.133 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.133 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.133 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for missing object", 2024-09-13T06:41:30.133 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:02.596618+0000", 2024-09-13T06:41:30.133 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000432032 2024-09-13T06:41:30.134 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.134 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.134 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:30.134 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:02.600845+0000", 2024-09-13T06:41:30.134 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0042277410000000001 2024-09-13T06:41:30.134 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.134 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.134 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:30.134 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:02.601003+0000", 2024-09-13T06:41:30.134 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00015731999999999999 2024-09-13T06:41:30.134 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.134 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.134 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:30.135 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:02.603486+0000", 2024-09-13T06:41:30.135 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0024832510000000001 2024-09-13T06:41:30.135 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:30.135 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:30.135 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:30.135 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.135 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.135 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:37806 3.9 3:951cb95b:::rbd_data.1121d8143c6e.0000000000000002:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e56)", 2024-09-13T06:41:30.135 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:06.373482+0000", 2024-09-13T06:41:30.135 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 83.756151372000005, 2024-09-13T06:41:30.135 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.002476213, 2024-09-13T06:41:30.135 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:30.135 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:30.136 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:30.136 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:30.136 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:30.136 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 37806 2024-09-13T06:41:30.136 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.136 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:30.136 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.136 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:30.136 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.373482+0000", 2024-09-13T06:41:30.136 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:30.136 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.136 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.136 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:30.136 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.373482+0000", 2024-09-13T06:41:30.137 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:30.137 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.137 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.137 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:30.137 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.373479+0000", 2024-09-13T06:41:30.137 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999962 2024-09-13T06:41:30.137 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.137 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.137 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:30.137 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.373495+0000", 2024-09-13T06:41:30.137 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6640999999999999e-05 2024-09-13T06:41:30.137 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.137 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.138 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:30.138 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.373542+0000", 2024-09-13T06:41:30.138 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6229000000000001e-05 2024-09-13T06:41:30.138 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.138 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.138 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:30.138 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.373564+0000", 2024-09-13T06:41:30.138 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2684000000000002e-05 2024-09-13T06:41:30.138 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.138 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.138 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:30.138 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374268+0000", 2024-09-13T06:41:30.138 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00070363700000000001 2024-09-13T06:41:30.138 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.139 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.139 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:41:30.139 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374305+0000", 2024-09-13T06:41:30.139 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.6936e-05 2024-09-13T06:41:30.139 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.139 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.139 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:30.139 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.375175+0000", 2024-09-13T06:41:30.139 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.000870454 2024-09-13T06:41:30.139 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.139 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.139 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:30.140 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.375678+0000", 2024-09-13T06:41:30.140 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00050292499999999999 2024-09-13T06:41:30.140 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.140 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.140 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:30.140 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.375959+0000", 2024-09-13T06:41:30.140 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00028050599999999997 2024-09-13T06:41:30.140 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:30.140 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:30.140 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:30.140 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.140 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.141 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:37821 3.9 3:951cb95b:::rbd_data.1121d8143c6e.0000000000000002:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e56)", 2024-09-13T06:41:30.141 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:06.374454+0000", 2024-09-13T06:41:30.141 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 83.755180254999999, 2024-09-13T06:41:30.141 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.002545072, 2024-09-13T06:41:30.141 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:30.141 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:30.141 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:30.141 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:30.141 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:30.141 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 37821 2024-09-13T06:41:30.141 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.141 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:30.141 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.141 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:30.142 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374454+0000", 2024-09-13T06:41:30.142 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:30.142 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.142 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.142 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:30.142 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374454+0000", 2024-09-13T06:41:30.142 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:30.142 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.142 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.142 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:30.142 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374452+0000", 2024-09-13T06:41:30.142 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999981 2024-09-13T06:41:30.142 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.142 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.142 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:30.143 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374463+0000", 2024-09-13T06:41:30.143 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0756e-05 2024-09-13T06:41:30.143 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.143 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.143 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:30.143 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374487+0000", 2024-09-13T06:41:30.143 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4887000000000001e-05 2024-09-13T06:41:30.143 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.143 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.143 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:30.143 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374504+0000", 2024-09-13T06:41:30.143 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6852000000000001e-05 2024-09-13T06:41:30.143 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.143 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.144 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:30.144 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374829+0000", 2024-09-13T06:41:30.144 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000324684 2024-09-13T06:41:30.144 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.144 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.144 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:41:30.144 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374880+0000", 2024-09-13T06:41:30.144 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.1378000000000002e-05 2024-09-13T06:41:30.144 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.144 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.144 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:30.144 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.376423+0000", 2024-09-13T06:41:30.144 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.001542734 2024-09-13T06:41:30.144 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.145 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.145 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:30.145 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.376607+0000", 2024-09-13T06:41:30.145 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000183656 2024-09-13T06:41:30.145 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.145 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.145 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:30.145 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.376999+0000", 2024-09-13T06:41:30.145 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00039191200000000001 2024-09-13T06:41:30.145 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:30.145 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:30.145 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:30.145 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.146 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.146 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:37836 3.9 3:951cb95b:::rbd_data.1121d8143c6e.0000000000000002:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e56)", 2024-09-13T06:41:30.146 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:06.374929+0000", 2024-09-13T06:41:30.146 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 83.754704602999993, 2024-09-13T06:41:30.146 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.002778825, 2024-09-13T06:41:30.146 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:30.146 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:30.146 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:30.146 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:30.146 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:30.146 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 37836 2024-09-13T06:41:30.146 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.146 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:30.147 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.147 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:30.147 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374929+0000", 2024-09-13T06:41:30.147 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:30.147 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.147 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.147 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:30.147 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374929+0000", 2024-09-13T06:41:30.147 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:30.147 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.147 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.147 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:30.147 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374927+0000", 2024-09-13T06:41:30.147 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999981 2024-09-13T06:41:30.147 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.148 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.148 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:30.148 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374939+0000", 2024-09-13T06:41:30.148 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1846e-05 2024-09-13T06:41:30.148 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.148 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.148 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:30.148 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374962+0000", 2024-09-13T06:41:30.148 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3054e-05 2024-09-13T06:41:30.148 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.148 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.148 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:30.148 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374978+0000", 2024-09-13T06:41:30.148 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5899000000000001e-05 2024-09-13T06:41:30.149 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.149 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.149 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:30.149 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.375106+0000", 2024-09-13T06:41:30.149 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00012789 2024-09-13T06:41:30.149 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.149 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.149 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:41:30.149 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.375134+0000", 2024-09-13T06:41:30.149 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.8254000000000001e-05 2024-09-13T06:41:30.149 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.149 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.149 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:30.149 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.377082+0000", 2024-09-13T06:41:30.149 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0019471520000001 2024-09-13T06:41:30.150 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.150 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.150 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:30.150 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.377330+0000", 2024-09-13T06:41:30.150 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00024834199999999997 2024-09-13T06:41:30.150 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.150 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.150 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:30.150 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.377708+0000", 2024-09-13T06:41:30.150 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00037817100000000001 2024-09-13T06:41:30.150 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:30.150 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:30.150 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:30.150 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.151 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.151 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:37851 3.9 3:951cb95b:::rbd_data.1121d8143c6e.0000000000000002:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e56)", 2024-09-13T06:41:30.151 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:06.382636+0000", 2024-09-13T06:41:30.151 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 83.746997718000003, 2024-09-13T06:41:30.151 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.99582539400000003, 2024-09-13T06:41:30.151 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:30.151 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:30.151 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:30.151 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:30.151 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:30.151 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 37851 2024-09-13T06:41:30.151 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.151 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:30.151 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.151 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:30.152 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.382636+0000", 2024-09-13T06:41:30.152 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:30.152 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.152 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.152 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:30.152 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.382636+0000", 2024-09-13T06:41:30.152 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:30.152 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.152 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.152 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:30.152 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.382633+0000", 2024-09-13T06:41:30.152 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999971 2024-09-13T06:41:30.152 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.152 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.153 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:30.153 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.382652+0000", 2024-09-13T06:41:30.153 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8834999999999998e-05 2024-09-13T06:41:30.153 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.153 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.153 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:30.153 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.382695+0000", 2024-09-13T06:41:30.153 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.3136000000000002e-05 2024-09-13T06:41:30.153 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.153 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.153 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:30.153 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.382716+0000", 2024-09-13T06:41:30.153 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1421e-05 2024-09-13T06:41:30.154 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.154 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.154 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:30.154 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.382860+0000", 2024-09-13T06:41:30.154 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00014389200000000001 2024-09-13T06:41:30.154 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.154 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.154 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:41:30.154 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.382890+0000", 2024-09-13T06:41:30.154 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9827000000000001e-05 2024-09-13T06:41:30.154 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.154 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.154 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:30.154 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.377779+0000", 2024-09-13T06:41:30.155 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.99488842899999996 2024-09-13T06:41:30.155 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.155 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.155 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:30.155 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.378007+0000", 2024-09-13T06:41:30.155 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00022838099999999999 2024-09-13T06:41:30.155 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.155 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.155 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:30.155 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.378462+0000", 2024-09-13T06:41:30.155 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00045452300000000003 2024-09-13T06:41:30.155 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:30.155 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:30.155 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:30.156 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.156 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.156 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:37866 3.9 3:951cb95b:::rbd_data.1121d8143c6e.0000000000000002:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e56)", 2024-09-13T06:41:30.156 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:06.383951+0000", 2024-09-13T06:41:30.156 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 83.745683032000002, 2024-09-13T06:41:30.156 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.99517962299999996, 2024-09-13T06:41:30.156 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:30.156 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:30.156 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:30.156 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:30.156 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:30.156 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 37866 2024-09-13T06:41:30.156 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.157 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:30.157 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.157 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:30.157 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.383951+0000", 2024-09-13T06:41:30.157 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:30.157 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.157 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.157 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:30.157 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.383951+0000", 2024-09-13T06:41:30.157 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:30.157 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.157 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.157 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:30.157 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.383949+0000", 2024-09-13T06:41:30.158 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999981 2024-09-13T06:41:30.158 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.158 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.158 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:30.158 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.383961+0000", 2024-09-13T06:41:30.158 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1999e-05 2024-09-13T06:41:30.158 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.158 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.158 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:30.158 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384019+0000", 2024-09-13T06:41:30.158 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7621000000000003e-05 2024-09-13T06:41:30.158 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.158 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.159 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:30.159 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384040+0000", 2024-09-13T06:41:30.159 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1528000000000001e-05 2024-09-13T06:41:30.159 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.159 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.159 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:30.159 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384186+0000", 2024-09-13T06:41:30.159 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00014573799999999999 2024-09-13T06:41:30.159 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.159 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.159 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:41:30.159 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384204+0000", 2024-09-13T06:41:30.159 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7992e-05 2024-09-13T06:41:30.160 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.160 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.160 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:30.160 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.378536+0000", 2024-09-13T06:41:30.160 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.99433268600000002 2024-09-13T06:41:30.160 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.160 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.160 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:30.160 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.378771+0000", 2024-09-13T06:41:30.160 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00023445399999999999 2024-09-13T06:41:30.160 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.160 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.160 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:30.161 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.379130+0000", 2024-09-13T06:41:30.161 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00035954200000000002 2024-09-13T06:41:30.161 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:30.161 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:30.161 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:30.161 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.161 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.161 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:37881 3.9 3:951cb95b:::rbd_data.1121d8143c6e.0000000000000002:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e56)", 2024-09-13T06:41:30.161 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:06.384239+0000", 2024-09-13T06:41:30.161 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 83.745394618000006, 2024-09-13T06:41:30.161 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.99541483500000005, 2024-09-13T06:41:30.161 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:30.161 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:30.162 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:30.162 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:30.162 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:30.162 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 37881 2024-09-13T06:41:30.162 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.162 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:30.162 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.162 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:30.162 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384239+0000", 2024-09-13T06:41:30.162 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:30.162 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.162 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.163 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:30.163 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384239+0000", 2024-09-13T06:41:30.163 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:30.163 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.163 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.163 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:30.163 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384238+0000", 2024-09-13T06:41:30.163 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999986 2024-09-13T06:41:30.163 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.163 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.163 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:30.163 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384246+0000", 2024-09-13T06:41:30.163 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.2449999999999998e-06 2024-09-13T06:41:30.163 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.164 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.164 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:30.164 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384268+0000", 2024-09-13T06:41:30.164 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1518e-05 2024-09-13T06:41:30.164 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.164 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.164 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:30.164 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384282+0000", 2024-09-13T06:41:30.164 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4501999999999999e-05 2024-09-13T06:41:30.164 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.164 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.164 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:30.165 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384356+0000", 2024-09-13T06:41:30.165 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4265999999999997e-05 2024-09-13T06:41:30.165 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.165 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.165 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:41:30.165 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384370+0000", 2024-09-13T06:41:30.165 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3942e-05 2024-09-13T06:41:30.165 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.165 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.165 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:30.165 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.379199+0000", 2024-09-13T06:41:30.166 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.99482866599999997 2024-09-13T06:41:30.166 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.166 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.166 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:30.166 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.379347+0000", 2024-09-13T06:41:30.166 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00014749199999999999 2024-09-13T06:41:30.166 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.166 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.166 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:30.166 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.379654+0000", 2024-09-13T06:41:30.166 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00030752999999999998 2024-09-13T06:41:30.166 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:30.166 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:30.166 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:30.167 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.167 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.167 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:37896 3.9 3:951cb95b:::rbd_data.1121d8143c6e.0000000000000002:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e56)", 2024-09-13T06:41:30.167 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:06.384412+0000", 2024-09-13T06:41:30.167 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 83.745222185000003, 2024-09-13T06:41:30.167 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.99777835999999998, 2024-09-13T06:41:30.167 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:30.167 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:30.167 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:30.167 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:30.167 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:30.167 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 37896 2024-09-13T06:41:30.167 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.167 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:30.167 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.168 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:30.168 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384412+0000", 2024-09-13T06:41:30.168 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:30.168 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.168 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.168 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:30.168 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384412+0000", 2024-09-13T06:41:30.168 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:30.168 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.168 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.168 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:30.168 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384410+0000", 2024-09-13T06:41:30.168 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.999999 2024-09-13T06:41:30.168 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.169 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.169 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:30.169 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384418+0000", 2024-09-13T06:41:30.169 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.486e-06 2024-09-13T06:41:30.169 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.169 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.169 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:30.169 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384436+0000", 2024-09-13T06:41:30.169 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7668000000000001e-05 2024-09-13T06:41:30.169 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.169 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.169 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:30.169 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384449+0000", 2024-09-13T06:41:30.170 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3395e-05 2024-09-13T06:41:30.170 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.170 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.170 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:30.170 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384605+0000", 2024-09-13T06:41:30.170 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00015563099999999999 2024-09-13T06:41:30.170 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.170 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.170 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:41:30.170 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384635+0000", 2024-09-13T06:41:30.170 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.0383999999999999e-05 2024-09-13T06:41:30.170 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.170 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.170 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:30.170 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.379730+0000", 2024-09-13T06:41:30.170 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.99509493999999998 2024-09-13T06:41:30.171 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.171 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.171 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:30.171 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.379964+0000", 2024-09-13T06:41:30.171 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00023353499999999999 2024-09-13T06:41:30.171 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.171 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.171 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:30.171 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.382190+0000", 2024-09-13T06:41:30.171 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0022265039999999998 2024-09-13T06:41:30.171 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:30.171 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:30.171 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:30.171 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.171 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.172 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43222 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 389120~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:30.172 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558181+0000", 2024-09-13T06:41:30.172 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 68.571452930999996, 2024-09-13T06:41:30.172 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.06252038, 2024-09-13T06:41:30.172 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:30.172 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:30.172 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:30.172 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:30.172 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:30.172 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43222 2024-09-13T06:41:30.172 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.172 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:30.173 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.173 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:30.173 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558181+0000", 2024-09-13T06:41:30.173 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:30.173 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.173 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.173 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:30.173 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558181+0000", 2024-09-13T06:41:30.173 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:30.173 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.173 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.173 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:30.174 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558181+0000", 2024-09-13T06:41:30.174 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:30.174 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.174 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.174 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:30.174 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558183+0000", 2024-09-13T06:41:30.174 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.857e-06 2024-09-13T06:41:30.174 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.174 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.174 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:30.174 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558188+0000", 2024-09-13T06:41:30.174 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3759999999999999e-06 2024-09-13T06:41:30.174 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.174 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.175 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:30.175 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558261+0000", 2024-09-13T06:41:30.175 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3097999999999997e-05 2024-09-13T06:41:30.175 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.175 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.175 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:30.175 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.620354+0000", 2024-09-13T06:41:30.175 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.062092587999999997 2024-09-13T06:41:30.175 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.175 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.175 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:30.175 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.620428+0000", 2024-09-13T06:41:30.175 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3954000000000004e-05 2024-09-13T06:41:30.175 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.176 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.176 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:30.176 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.620701+0000", 2024-09-13T06:41:30.176 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000273773 2024-09-13T06:41:30.176 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:30.176 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:30.176 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:30.176 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.176 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.176 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43223 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 393216~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:30.176 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558267+0000", 2024-09-13T06:41:30.176 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 68.571366874000006, 2024-09-13T06:41:30.176 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.062813151999999997, 2024-09-13T06:41:30.176 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:30.177 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:30.177 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:30.177 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:30.177 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:30.177 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43223 2024-09-13T06:41:30.177 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.177 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:30.177 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.177 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:30.177 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558267+0000", 2024-09-13T06:41:30.177 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:30.177 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.177 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.178 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:30.178 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558267+0000", 2024-09-13T06:41:30.178 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:30.178 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.178 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.178 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:30.178 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558266+0000", 2024-09-13T06:41:30.178 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:30.178 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.178 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.178 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:30.178 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558270+0000", 2024-09-13T06:41:30.178 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.2389999999999998e-06 2024-09-13T06:41:30.178 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.179 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.179 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:30.179 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558277+0000", 2024-09-13T06:41:30.179 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5680000000000002e-06 2024-09-13T06:41:30.179 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.179 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.179 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:30.179 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558282+0000", 2024-09-13T06:41:30.179 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7060000000000003e-06 2024-09-13T06:41:30.179 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.179 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.179 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:30.179 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.620731+0000", 2024-09-13T06:41:30.179 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.062448661000000003 2024-09-13T06:41:30.179 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.179 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.180 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:30.180 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.620806+0000", 2024-09-13T06:41:30.180 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5862e-05 2024-09-13T06:41:30.180 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.180 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.180 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:30.180 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.621080+0000", 2024-09-13T06:41:30.180 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00027368599999999998 2024-09-13T06:41:30.180 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:30.180 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:30.180 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:30.180 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.180 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.181 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43224 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 407552~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:30.181 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558286+0000", 2024-09-13T06:41:30.181 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 68.571347509999995, 2024-09-13T06:41:30.181 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.063179052999999999, 2024-09-13T06:41:30.181 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:30.181 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:30.181 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:30.181 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:30.181 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:30.181 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43224 2024-09-13T06:41:30.181 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.181 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:30.181 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.181 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:30.182 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558286+0000", 2024-09-13T06:41:30.182 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:30.182 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.182 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.182 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:30.182 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558286+0000", 2024-09-13T06:41:30.182 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:30.182 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.182 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.182 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:30.182 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558286+0000", 2024-09-13T06:41:30.182 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:30.182 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.182 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.182 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:30.183 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558288+0000", 2024-09-13T06:41:30.183 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.227e-06 2024-09-13T06:41:30.183 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.183 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.183 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:30.183 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558292+0000", 2024-09-13T06:41:30.183 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.6289999999999999e-06 2024-09-13T06:41:30.183 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.183 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.183 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:30.183 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558294+0000", 2024-09-13T06:41:30.183 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5409999999999999e-06 2024-09-13T06:41:30.183 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.183 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.183 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:30.184 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.621110+0000", 2024-09-13T06:41:30.184 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.062815776000000004 2024-09-13T06:41:30.184 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.184 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.184 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:30.184 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.621186+0000", 2024-09-13T06:41:30.184 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5570999999999999e-05 2024-09-13T06:41:30.184 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.184 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.184 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:30.184 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.621465+0000", 2024-09-13T06:41:30.184 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00027988200000000001 2024-09-13T06:41:30.184 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:30.184 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:30.184 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:30.185 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.185 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.185 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43225 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 421888~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:30.185 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558296+0000", 2024-09-13T06:41:30.185 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 68.571337542999999, 2024-09-13T06:41:30.185 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.063551110999999993, 2024-09-13T06:41:30.185 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:30.185 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:30.185 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:30.185 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:30.185 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:30.185 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43225 2024-09-13T06:41:30.185 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.185 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:30.186 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.186 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:30.186 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558296+0000", 2024-09-13T06:41:30.186 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:30.186 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.186 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.186 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:30.186 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558296+0000", 2024-09-13T06:41:30.186 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:30.186 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.186 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.186 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:30.186 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558296+0000", 2024-09-13T06:41:30.186 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:41:30.186 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.187 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.187 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:30.187 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558305+0000", 2024-09-13T06:41:30.187 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.5290000000000008e-06 2024-09-13T06:41:30.187 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.187 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.187 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:30.187 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558308+0000", 2024-09-13T06:41:30.187 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.5619999999999999e-06 2024-09-13T06:41:30.187 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.187 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.187 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:30.187 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558311+0000", 2024-09-13T06:41:30.187 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.43e-06 2024-09-13T06:41:30.187 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.188 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.188 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:30.188 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.621495+0000", 2024-09-13T06:41:30.188 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.063184289000000005 2024-09-13T06:41:30.188 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.188 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.188 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:30.188 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.621569+0000", 2024-09-13T06:41:30.188 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4250000000000002e-05 2024-09-13T06:41:30.188 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.188 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.188 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:30.188 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.621847+0000", 2024-09-13T06:41:30.188 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00027826400000000002 2024-09-13T06:41:30.189 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:30.189 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:30.189 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:30.189 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.189 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.189 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43226 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 436224~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:30.189 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558313+0000", 2024-09-13T06:41:30.189 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 68.571320907, 2024-09-13T06:41:30.189 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.063914420999999999, 2024-09-13T06:41:30.189 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:30.189 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:30.189 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:30.190 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:30.190 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:30.190 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43226 2024-09-13T06:41:30.190 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.190 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:30.190 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.190 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:30.190 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558313+0000", 2024-09-13T06:41:30.190 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:30.190 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.190 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.190 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:30.190 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558313+0000", 2024-09-13T06:41:30.190 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:30.191 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.191 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.191 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:30.191 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558313+0000", 2024-09-13T06:41:30.191 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:30.191 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.191 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.191 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:30.191 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558314+0000", 2024-09-13T06:41:30.191 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3740000000000001e-06 2024-09-13T06:41:30.191 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.191 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.191 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:30.191 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558317+0000", 2024-09-13T06:41:30.192 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9730000000000002e-06 2024-09-13T06:41:30.192 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.192 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.192 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:30.192 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558319+0000", 2024-09-13T06:41:30.192 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4059999999999999e-06 2024-09-13T06:41:30.192 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.192 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.192 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:30.192 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.621877+0000", 2024-09-13T06:41:30.192 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.063557408999999995 2024-09-13T06:41:30.192 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.192 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.193 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:30.193 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.621951+0000", 2024-09-13T06:41:30.193 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4487999999999996e-05 2024-09-13T06:41:30.193 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.193 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.193 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:30.193 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.622227+0000", 2024-09-13T06:41:30.193 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000276011 2024-09-13T06:41:30.193 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:30.193 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:30.193 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:30.193 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.193 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.193 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43227 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 450560~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:30.193 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558322+0000", 2024-09-13T06:41:30.194 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 68.571312325999997, 2024-09-13T06:41:30.194 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.064285348000000006, 2024-09-13T06:41:30.194 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:30.194 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:30.194 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:30.194 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:30.194 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:30.194 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43227 2024-09-13T06:41:30.194 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.194 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:30.194 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.194 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:30.194 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558322+0000", 2024-09-13T06:41:30.194 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:30.194 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.194 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.195 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:30.195 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558322+0000", 2024-09-13T06:41:30.195 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:30.195 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.195 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.195 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:30.195 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558321+0000", 2024-09-13T06:41:30.195 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:41:30.195 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.195 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.195 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:30.195 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558323+0000", 2024-09-13T06:41:30.195 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.576e-06 2024-09-13T06:41:30.195 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.195 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.196 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:30.196 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558328+0000", 2024-09-13T06:41:30.196 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0719999999999999e-06 2024-09-13T06:41:30.196 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.196 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.196 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:30.196 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558332+0000", 2024-09-13T06:41:30.196 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.8130000000000002e-06 2024-09-13T06:41:30.196 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.196 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.196 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:30.196 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.622255+0000", 2024-09-13T06:41:30.196 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.063923195000000002 2024-09-13T06:41:30.197 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.197 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.197 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:30.197 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.622330+0000", 2024-09-13T06:41:30.197 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5383000000000007e-05 2024-09-13T06:41:30.197 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.197 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.197 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:30.197 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.622607+0000", 2024-09-13T06:41:30.197 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00027651999999999999 2024-09-13T06:41:30.197 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:30.197 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:30.197 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:30.198 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.198 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.198 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43228 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 464896~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:30.198 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558335+0000", 2024-09-13T06:41:30.198 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 68.571298416999994, 2024-09-13T06:41:30.198 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.064652253000000007, 2024-09-13T06:41:30.198 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:30.198 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:30.198 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:30.198 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:30.198 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:30.198 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43228 2024-09-13T06:41:30.198 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.199 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:30.199 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.199 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:30.199 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558335+0000", 2024-09-13T06:41:30.199 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:30.199 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.199 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.199 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:30.199 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558335+0000", 2024-09-13T06:41:30.199 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:30.199 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.199 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.199 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:30.200 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558335+0000", 2024-09-13T06:41:30.200 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:30.200 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.200 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.200 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:30.200 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558337+0000", 2024-09-13T06:41:30.200 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1380000000000001e-06 2024-09-13T06:41:30.200 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.200 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.200 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:30.200 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558343+0000", 2024-09-13T06:41:30.200 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.5140000000000001e-06 2024-09-13T06:41:30.200 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.200 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.200 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:30.201 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558348+0000", 2024-09-13T06:41:30.201 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9640000000000002e-06 2024-09-13T06:41:30.201 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.201 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.201 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:30.201 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.622636+0000", 2024-09-13T06:41:30.201 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.064288260999999999 2024-09-13T06:41:30.201 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.201 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.201 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:30.201 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.622715+0000", 2024-09-13T06:41:30.201 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.9351000000000006e-05 2024-09-13T06:41:30.201 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.201 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.202 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:30.202 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.622988+0000", 2024-09-13T06:41:30.202 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00027242599999999998 2024-09-13T06:41:30.202 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:30.202 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:30.202 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:30.202 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.202 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.202 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43229 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 479232~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:30.202 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558352+0000", 2024-09-13T06:41:30.202 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 68.571282002000004, 2024-09-13T06:41:30.202 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.065018024999999993, 2024-09-13T06:41:30.202 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:30.203 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:30.203 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:30.203 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:30.203 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:30.203 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43229 2024-09-13T06:41:30.203 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.203 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:30.203 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.203 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:30.203 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558352+0000", 2024-09-13T06:41:30.203 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:30.203 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.203 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.203 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:30.204 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558352+0000", 2024-09-13T06:41:30.204 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:30.204 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.204 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.204 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:30.204 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558352+0000", 2024-09-13T06:41:30.204 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:30.204 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.204 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.204 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:30.204 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558354+0000", 2024-09-13T06:41:30.204 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4930000000000001e-06 2024-09-13T06:41:30.204 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.204 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.205 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:30.205 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558360+0000", 2024-09-13T06:41:30.205 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.263e-06 2024-09-13T06:41:30.205 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.205 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.205 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:30.205 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558369+0000", 2024-09-13T06:41:30.205 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.0829999999999993e-06 2024-09-13T06:41:30.205 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.205 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.205 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:30.205 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.623017+0000", 2024-09-13T06:41:30.206 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.064647799000000006 2024-09-13T06:41:30.206 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.206 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.206 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:30.206 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.623090+0000", 2024-09-13T06:41:30.206 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3071000000000006e-05 2024-09-13T06:41:30.206 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.206 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.206 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:30.206 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.623370+0000", 2024-09-13T06:41:30.206 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000279661 2024-09-13T06:41:30.206 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:30.206 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:30.206 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:30.206 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.207 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.207 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43230 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 493568~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:30.207 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558374+0000", 2024-09-13T06:41:30.207 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 68.571259709000003, 2024-09-13T06:41:30.207 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.065410435000000003, 2024-09-13T06:41:30.207 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:30.207 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:30.207 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:30.207 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:30.207 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:30.207 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43230 2024-09-13T06:41:30.207 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.207 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:30.207 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.208 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:30.208 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558374+0000", 2024-09-13T06:41:30.208 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:30.208 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.208 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.208 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:30.208 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558374+0000", 2024-09-13T06:41:30.208 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:30.208 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.208 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.208 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:30.208 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558374+0000", 2024-09-13T06:41:30.209 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:30.209 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.209 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.209 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:30.209 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558376+0000", 2024-09-13T06:41:30.209 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4430000000000002e-06 2024-09-13T06:41:30.209 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.209 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.209 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:30.209 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558382+0000", 2024-09-13T06:41:30.209 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3029999999999996e-06 2024-09-13T06:41:30.209 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.209 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.209 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:30.210 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558387+0000", 2024-09-13T06:41:30.210 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.1699999999999999e-06 2024-09-13T06:41:30.210 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.210 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.210 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:30.210 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.623400+0000", 2024-09-13T06:41:30.210 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.065013244999999997 2024-09-13T06:41:30.210 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.210 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.210 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:30.210 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.623474+0000", 2024-09-13T06:41:30.210 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3889999999999999e-05 2024-09-13T06:41:30.210 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.210 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.210 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:30.211 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.623785+0000", 2024-09-13T06:41:30.211 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00031080099999999998 2024-09-13T06:41:30.211 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:30.211 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:30.211 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:30.211 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.211 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.211 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43231 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 507904~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:30.211 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558391+0000", 2024-09-13T06:41:30.211 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 68.571243023999997, 2024-09-13T06:41:30.211 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.065788597000000004, 2024-09-13T06:41:30.211 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:30.211 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:30.211 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:30.211 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:30.212 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:30.212 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43231 2024-09-13T06:41:30.212 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.212 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:30.212 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.212 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:30.212 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558391+0000", 2024-09-13T06:41:30.212 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:30.212 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.212 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.212 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:30.212 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558391+0000", 2024-09-13T06:41:30.213 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:30.213 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.213 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.213 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:30.213 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558390+0000", 2024-09-13T06:41:30.213 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:30.213 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.213 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.213 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:30.213 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558393+0000", 2024-09-13T06:41:30.213 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2570000000000002e-06 2024-09-13T06:41:30.213 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.213 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.214 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:30.214 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558399+0000", 2024-09-13T06:41:30.214 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0419999999999999e-06 2024-09-13T06:41:30.214 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.214 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.214 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:30.214 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558403+0000", 2024-09-13T06:41:30.214 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6249999999999998e-06 2024-09-13T06:41:30.214 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.214 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.214 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:30.214 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.623811+0000", 2024-09-13T06:41:30.214 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.065407549999999995 2024-09-13T06:41:30.214 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.215 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.215 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:30.215 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.623877+0000", 2024-09-13T06:41:30.215 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.5902999999999996e-05 2024-09-13T06:41:30.215 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.215 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.215 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:30.215 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.624179+0000", 2024-09-13T06:41:30.215 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00030259999999999998 2024-09-13T06:41:30.215 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:30.215 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:30.215 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:30.215 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.215 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.215 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43232 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 522240~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:30.216 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558422+0000", 2024-09-13T06:41:30.216 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 68.571212247000005, 2024-09-13T06:41:30.216 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.066176061999999994, 2024-09-13T06:41:30.216 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:30.216 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:30.216 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:30.216 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:30.216 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:30.216 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43232 2024-09-13T06:41:30.216 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.216 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:30.216 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.216 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:30.216 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558422+0000", 2024-09-13T06:41:30.217 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:30.217 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.217 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.217 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:30.217 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558422+0000", 2024-09-13T06:41:30.217 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:30.217 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.217 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.217 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:30.217 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558421+0000", 2024-09-13T06:41:30.217 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:30.217 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.217 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.217 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:30.217 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558428+0000", 2024-09-13T06:41:30.218 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.1690000000000003e-06 2024-09-13T06:41:30.218 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.218 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.218 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:30.218 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558434+0000", 2024-09-13T06:41:30.218 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9309999999999996e-06 2024-09-13T06:41:30.218 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.218 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.218 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:30.218 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558447+0000", 2024-09-13T06:41:30.218 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.271e-05 2024-09-13T06:41:30.218 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.218 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.219 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:30.219 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.624209+0000", 2024-09-13T06:41:30.219 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.065762102000000003 2024-09-13T06:41:30.219 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.219 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.219 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:30.219 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.624282+0000", 2024-09-13T06:41:30.219 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.2889e-05 2024-09-13T06:41:30.219 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.219 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.219 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:30.219 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.624598+0000", 2024-09-13T06:41:30.219 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00031591399999999998 2024-09-13T06:41:30.219 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:30.220 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:30.220 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:30.220 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.220 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.220 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43486 3.f 3:f7da9c8f:::rbd_data.1121f5f2e1c0.000000000000000b:1f [read 260096~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:30.220 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.569088+0000", 2024-09-13T06:41:30.220 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 68.560545524000005, 2024-09-13T06:41:30.220 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.062579223000000003, 2024-09-13T06:41:30.220 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:30.220 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:30.220 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:30.220 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:30.220 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:30.221 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43486 2024-09-13T06:41:30.221 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.221 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:30.221 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.221 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:30.221 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.569088+0000", 2024-09-13T06:41:30.221 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:30.221 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.221 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.221 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:30.221 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.569088+0000", 2024-09-13T06:41:30.221 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:30.221 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.222 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.222 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:30.222 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.569088+0000", 2024-09-13T06:41:30.222 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:30.222 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.222 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.222 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:30.222 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.569091+0000", 2024-09-13T06:41:30.222 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9629999999999998e-06 2024-09-13T06:41:30.222 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.222 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.222 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:30.222 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.569097+0000", 2024-09-13T06:41:30.223 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.4160000000000001e-06 2024-09-13T06:41:30.223 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.223 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.223 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:30.223 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.569102+0000", 2024-09-13T06:41:30.223 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6659999999999999e-06 2024-09-13T06:41:30.223 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.223 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.223 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:30.223 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.631346+0000", 2024-09-13T06:41:30.223 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.062243896 2024-09-13T06:41:30.223 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.223 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.223 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:30.224 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.631413+0000", 2024-09-13T06:41:30.224 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.7638000000000005e-05 2024-09-13T06:41:30.224 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.224 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.224 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:30.224 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.631668+0000", 2024-09-13T06:41:30.224 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0002541 2024-09-13T06:41:30.224 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:30.224 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:30.224 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:30.224 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:30.224 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:30.224 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:41:30.225 INFO:teuthology.orchestra.run.smithi081.stdout:3605 punch from 0x41b4825 to 0x41bd750, (0x8f2b bytes) 2024-09-13T06:41:30.226 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:41:30.226 INFO:teuthology.orchestra.run.smithi081.stdout:3607 read 0xd936d4 thru 0xd9f690 (0xbfbd bytes) 2024-09-13T06:41:30.226 INFO:teuthology.orchestra.run.smithi081.stdout:3608 writesame 0x99fba89 thru 0x9a09cf0 data_size 0x54(0xe268 bytes) 2024-09-13T06:41:30.227 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-13T06:41:30.227 INFO:teuthology.orchestra.run.smithi081.stdout:osd.4: {} 2024-09-13T06:41:30.227 INFO:teuthology.orchestra.run.smithi081.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-13T06:41:30.228 INFO:teuthology.orchestra.run.smithi081.stdout:3612 trunc from 0xa1f1e24 to 0x7baf53d 2024-09-13T06:41:30.228 INFO:teuthology.orchestra.run.smithi081.stdout:osd.5: {} 2024-09-13T06:41:30.228 INFO:teuthology.orchestra.run.smithi081.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-13T06:41:30.229 INFO:teuthology.orchestra.run.smithi081.stdout:osd.6: {} 2024-09-13T06:41:30.229 INFO:teuthology.orchestra.run.smithi081.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-13T06:41:30.229 INFO:teuthology.orchestra.run.smithi081.stderr:Error ENXIO: problem getting command descriptions from osd.7 2024-09-13T06:41:30.230 INFO:teuthology.orchestra.run.smithi081.stdout:3613 writesame 0xd2995fd thru 0xd2a241b data_size 0x1(0x8e1f bytes) 2024-09-13T06:41:30.230 INFO:teuthology.orchestra.run.smithi081.stdout:3614 read 0x5c5f268 thru 0x5c6bc91 (0xca2a bytes) 2024-09-13T06:41:30.230 INFO:teuthology.orchestra.run.smithi081.stdout:3615 punch from 0x2e460d9 to 0x2e472a3, (0x11ca bytes) 2024-09-13T06:41:30.230 INFO:teuthology.orchestra.run.smithi081.stdout:3617 punch from 0xc43863b to 0xc44266d, (0xa032 bytes) 2024-09-13T06:41:30.230 INFO:teuthology.orchestra.run.smithi081.stdout:3618 write 0x65fa587 thru 0x6607c36 (0xd6b0 bytes) 2024-09-13T06:41:30.230 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-13T06:41:30.231 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-13T06:41:30.231 INFO:teuthology.orchestra.run.smithi081.stdout:3619 read 0xc94f281 thru 0xc95f0ff (0xfe7f bytes) 2024-09-13T06:41:30.231 INFO:teuthology.orchestra.run.smithi081.stdout:3621 write 0xd27466a thru 0xd276366 (0x1cfd bytes) 2024-09-13T06:41:30.231 INFO:teuthology.orchestra.run.smithi081.stdout:3623 write 0xf7184d thru 0xf78bdd (0x7391 bytes) 2024-09-13T06:41:30.231 INFO:teuthology.orchestra.run.smithi081.stdout:3624 write 0x8876e12 thru 0x887d3ec (0x65db bytes) 2024-09-13T06:41:30.232 INFO:teuthology.orchestra.run.smithi081.stdout:3625 trunc from 0xd2a241c to 0xc7f58e7 2024-09-13T06:41:30.232 INFO:tasks.ceph.osd.6.smithi139.stderr:2024-09-13T06:41:30.223+0000 7fcd02c5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26385) UID: 0 2024-09-13T06:41:30.237 INFO:teuthology.orchestra.run.smithi081.stdout:3627 read 0xb79f489 thru 0xb7a1fa0 (0x2b18 bytes) 2024-09-13T06:41:30.237 INFO:teuthology.orchestra.run.smithi081.stdout:3628 punch from 0x27d7182 to 0x27dc089, (0x4f07 bytes) 2024-09-13T06:41:30.237 INFO:teuthology.orchestra.run.smithi081.stdout:3629 punch from 0x943f5f3 to 0x94491d8, (0x9be5 bytes) 2024-09-13T06:41:30.237 INFO:teuthology.orchestra.run.smithi081.stdout:3630 writesame 0x6710fcc thru 0x6714f32 data_size 0x1(0x3f67 bytes) 2024-09-13T06:41:30.254 INFO:teuthology.orchestra.run.smithi081.stdout:3631 write 0x476e6d0 thru 0x47735ad (0x4ede bytes) 2024-09-13T06:41:30.260 INFO:teuthology.orchestra.run.smithi081.stdout:3632 read 0x386e5e3 thru 0x3876000 (0x7a1e bytes) 2024-09-13T06:41:30.260 INFO:teuthology.orchestra.run.smithi081.stdout:3637 writesame 0x2995443 thru 0x299d397 data_size 0x1(0x7f55 bytes) 2024-09-13T06:41:30.272 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:41:30.286 INFO:teuthology.orchestra.run.smithi081.stdout:3639 write 0xec7a546 thru 0xec83695 (0x9150 bytes) 2024-09-13T06:41:30.294 INFO:teuthology.orchestra.run.smithi081.stdout:3640 read 0xbb78197 thru 0xbb82135 (0x9f9f bytes) 2024-09-13T06:41:30.294 INFO:teuthology.orchestra.run.smithi081.stdout:3641 writesame 0x4410fed thru 0x4415ac6 data_size 0x43(0x4ada bytes) 2024-09-13T06:41:30.299 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:41:30.300 INFO:teuthology.orchestra.run.smithi081.stdout:3643 write 0x521ffbd thru 0x5226f91 (0x6fd5 bytes) 2024-09-13T06:41:30.314 INFO:teuthology.orchestra.run.smithi081.stdout:3644 trunc from 0xec83696 to 0x90f1284 2024-09-13T06:41:30.326 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:41:30.326+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:41:30.334 INFO:teuthology.orchestra.run.smithi081.stdout:3645 write 0x6e3237c thru 0x6e390a8 (0x6d2d bytes) 2024-09-13T06:41:30.353 INFO:teuthology.orchestra.run.smithi081.stdout:3646 trunc from 0x90f1284 to 0x33c7d3 2024-09-13T06:41:30.360 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:41:30.360 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [ 2024-09-13T06:41:30.360 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.360 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:87460 3.c 3:303b4304:::rbd_data.1121141fb990.0000000000000011:head [delete] snapc 44=[] ondisk+write+known_if_redirected+supports_pool_eio e132)", 2024-09-13T06:41:30.361 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:41:30.359393+0000", 2024-09-13T06:41:30.361 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.0030005489999999999, 2024-09-13T06:41:30.361 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0030437530000000002, 2024-09-13T06:41:30.361 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:30.361 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "waiting for sub ops", 2024-09-13T06:41:30.361 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:30.361 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:30.361 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:30.361 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 87460 2024-09-13T06:41:30.361 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.361 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:30.361 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.362 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:30.362 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:30.359393+0000", 2024-09-13T06:41:30.362 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:30.362 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.362 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.362 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:30.362 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:30.359393+0000", 2024-09-13T06:41:30.362 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:30.362 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.362 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.362 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:30.362 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:30.359392+0000", 2024-09-13T06:41:30.362 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:30.362 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.363 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.363 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:30.363 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:30.359396+0000", 2024-09-13T06:41:30.363 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.0879999999999997e-06 2024-09-13T06:41:30.363 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.363 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.363 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:30.363 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:30.359407+0000", 2024-09-13T06:41:30.363 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0202e-05 2024-09-13T06:41:30.363 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.363 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.363 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:30.363 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:30.359413+0000", 2024-09-13T06:41:30.364 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.8889999999999996e-06 2024-09-13T06:41:30.364 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.364 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.364 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:30.364 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:30.359548+0000", 2024-09-13T06:41:30.364 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000134096 2024-09-13T06:41:30.364 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.364 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.364 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:30.364 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:30.359730+0000", 2024-09-13T06:41:30.364 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000182153 2024-09-13T06:41:30.364 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.364 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.365 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 5", 2024-09-13T06:41:30.365 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:30.359995+0000", 2024-09-13T06:41:30.365 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00026522500000000001 2024-09-13T06:41:30.365 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.365 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.365 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-09-13T06:41:30.365 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:30.361698+0000", 2024-09-13T06:41:30.365 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0017035419999999999 2024-09-13T06:41:30.365 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:30.365 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:30.365 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:30.365 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.365 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.366 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:87462 3.c 3:32a47b50:::rbd_data.1121141fb990.0000000000000013:head [delete] snapc 44=[] ondisk+write+known_if_redirected+supports_pool_eio e132)", 2024-09-13T06:41:30.366 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:41:30.359429+0000", 2024-09-13T06:41:30.368 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.0029641580000000002, 2024-09-13T06:41:30.369 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0031810279999999998, 2024-09-13T06:41:30.369 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:30.369 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "waiting for sub ops", 2024-09-13T06:41:30.369 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:30.369 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:30.369 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:30.369 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 87462 2024-09-13T06:41:30.369 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.369 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:30.369 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.369 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:30.370 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:30.359429+0000", 2024-09-13T06:41:30.370 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:30.370 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.370 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.370 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:30.370 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:30.359429+0000", 2024-09-13T06:41:30.370 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:30.370 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.370 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.370 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:30.370 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:30.359429+0000", 2024-09-13T06:41:30.370 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:30.370 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.370 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.371 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:30.371 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:30.359432+0000", 2024-09-13T06:41:30.371 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.2030000000000001e-06 2024-09-13T06:41:30.371 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.371 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.371 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:30.371 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:30.359440+0000", 2024-09-13T06:41:30.371 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.1589999999999993e-06 2024-09-13T06:41:30.371 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.371 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.371 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:30.371 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:30.359446+0000", 2024-09-13T06:41:30.371 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3369999999999996e-06 2024-09-13T06:41:30.372 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.372 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.372 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:30.372 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:30.360855+0000", 2024-09-13T06:41:30.372 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.001408117 2024-09-13T06:41:30.372 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.372 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.372 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:30.372 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:30.360993+0000", 2024-09-13T06:41:30.372 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000137971 2024-09-13T06:41:30.372 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.372 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.372 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 5", 2024-09-13T06:41:30.373 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:30.361197+0000", 2024-09-13T06:41:30.373 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000204219 2024-09-13T06:41:30.373 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.373 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.373 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-09-13T06:41:30.373 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:30.361922+0000", 2024-09-13T06:41:30.373 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00072488100000000003 2024-09-13T06:41:30.373 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:30.373 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:30.373 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:30.373 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:30.373 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-13T06:41:30.374 INFO:teuthology.orchestra.run.smithi081.stdout: "num_ops": 2 2024-09-13T06:41:30.374 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:41:30.381 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-13T06:41:30.428 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:41:30.426+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:41:30.428 INFO:teuthology.orchestra.run.smithi081.stdout:3647 write 0xaac52af thru 0xaac8978 (0x36ca bytes) 2024-09-13T06:41:30.433 INFO:teuthology.orchestra.run.smithi081.stdout:3649 write 0x5d2fad0 thru 0x5d36e78 (0x73a9 bytes) 2024-09-13T06:41:30.447 INFO:teuthology.orchestra.run.smithi081.stdout:3654 trunc from 0xaac8979 to 0x5fabac1 2024-09-13T06:41:30.465 INFO:teuthology.orchestra.run.smithi081.stdout:3655 write 0x2f20ce0 thru 0x2f28e39 (0x815a bytes) 2024-09-13T06:41:30.471 INFO:teuthology.orchestra.run.smithi081.stdout:3657 read 0x4264fda thru 0x4265a87 (0xaae bytes) 2024-09-13T06:41:30.472 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:41:30.495 INFO:teuthology.orchestra.run.smithi081.stdout:3660 write 0xec39d36 thru 0xec3a6d0 (0x99b bytes) 2024-09-13T06:41:30.501 INFO:teuthology.orchestra.run.smithi081.stdout:3662 write 0xd248480 thru 0xd250fc9 (0x8b4a bytes) 2024-09-13T06:41:30.508 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:41:30.508 INFO:teuthology.orchestra.run.smithi081.stdout:3666 write 0xbc45e04 thru 0xbc4d8d1 (0x7ace bytes) 2024-09-13T06:41:30.528 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:41:30.526+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:41:30.535 INFO:teuthology.orchestra.run.smithi081.stdout:3667 trunc from 0xec3a6d1 to 0xcf221d 2024-09-13T06:41:30.556 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:41:30.556 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-13T06:41:30.556 INFO:teuthology.orchestra.run.smithi081.stdout: "complaint_time": 30, 2024-09-13T06:41:30.556 INFO:teuthology.orchestra.run.smithi081.stdout: "num_blocked_ops": 0 2024-09-13T06:41:30.556 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:41:30.557 INFO:teuthology.orchestra.run.smithi081.stdout:3668 read 0x63ebcd thru 0x643307 (0x473b bytes) 2024-09-13T06:41:30.573 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-13T06:41:30.573 INFO:teuthology.orchestra.run.smithi081.stdout:3669 write 0x20ab958 thru 0x20b18e5 (0x5f8e bytes) 2024-09-13T06:41:30.580 INFO:teuthology.orchestra.run.smithi081.stdout:3671 read 0x1f7622b thru 0x1f789c8 (0x279e bytes) 2024-09-13T06:41:30.580 INFO:teuthology.orchestra.run.smithi081.stdout:3672 read 0xca43de thru 0xca8cd5 (0x48f8 bytes) 2024-09-13T06:41:30.602 INFO:teuthology.orchestra.run.smithi081.stdout:3673 write 0x9a9b8ce thru 0x9a9e054 (0x2787 bytes) 2024-09-13T06:41:30.609 INFO:teuthology.orchestra.run.smithi081.stdout:3674 read 0x878b241 thru 0x87907ae (0x556e bytes) 2024-09-13T06:41:30.609 INFO:teuthology.orchestra.run.smithi081.stdout:3675 read 0x2adfda4 thru 0x2aee62c (0xe889 bytes) 2024-09-13T06:41:30.613 INFO:teuthology.orchestra.run.smithi081.stdout:3677 trunc from 0x9a9e055 to 0x67c0a5e 2024-09-13T06:41:30.629 INFO:tasks.ceph.osd.6.smithi139.stderr:2024-09-13T06:41:30.627+0000 7fcd02c5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26385) UID: 0 2024-09-13T06:41:30.654 INFO:teuthology.orchestra.run.smithi081.stdout:3678 writesame 0xe31e75c thru 0xe328e63 data_size 0x14(0xa708 bytes) 2024-09-13T06:41:30.654 INFO:teuthology.orchestra.run.smithi081.stdout:3680 read 0x20f835b thru 0x2106005 (0xdcab bytes) 2024-09-13T06:41:30.654 INFO:teuthology.orchestra.run.smithi081.stdout:3681 write 0x6b8daf2 thru 0x6b958b3 (0x7dc2 bytes) 2024-09-13T06:41:30.661 INFO:teuthology.orchestra.run.smithi081.stdout:3684 write 0xa02e1c4 thru 0xa036949 (0x8786 bytes) 2024-09-13T06:41:30.670 INFO:teuthology.orchestra.run.smithi081.stdout:3685 write 0xba5c381 thru 0xba614bc (0x513c bytes) 2024-09-13T06:41:30.678 INFO:teuthology.orchestra.run.smithi081.stdout:3686 punch from 0xc772aaa to 0xc77b413, (0x8969 bytes) 2024-09-13T06:41:30.678 INFO:teuthology.orchestra.run.smithi081.stdout:3687 clone 23 order 22 su 65536 sc 5 2024-09-13T06:41:30.702 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:41:30.702 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 20, 2024-09-13T06:41:30.702 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 600, 2024-09-13T06:41:30.702 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [ 2024-09-13T06:41:30.702 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.702 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:2226 3.15 3:af026987:::rbd_data.112173e2f1b7.0000000000000017:head [sparse-read 0~4194304] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-13T06:41:30.702 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:37.606562+0000", 2024-09-13T06:41:30.702 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 113.096139674, 2024-09-13T06:41:30.702 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.83322091700000001, 2024-09-13T06:41:30.703 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:30.703 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:41:30.703 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:30.703 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:30.703 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:30.703 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 2226 2024-09-13T06:41:30.703 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.703 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:30.703 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.703 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:30.703 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606562+0000", 2024-09-13T06:41:30.703 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:30.703 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.703 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.704 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:30.704 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606562+0000", 2024-09-13T06:41:30.704 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:30.704 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.704 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.704 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:30.704 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606561+0000", 2024-09-13T06:41:30.704 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:30.704 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.704 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.704 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:30.704 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606565+0000", 2024-09-13T06:41:30.705 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.4379999999999999e-06 2024-09-13T06:41:30.705 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.705 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.705 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:30.705 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606569+0000", 2024-09-13T06:41:30.705 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.425e-06 2024-09-13T06:41:30.705 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.705 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.705 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:30.705 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606572+0000", 2024-09-13T06:41:30.705 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.05e-06 2024-09-13T06:41:30.705 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.705 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.706 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:30.706 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606621+0000", 2024-09-13T06:41:30.706 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.8723000000000001e-05 2024-09-13T06:41:30.706 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.706 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.706 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:41:30.706 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606630+0000", 2024-09-13T06:41:30.706 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.8040000000000007e-06 2024-09-13T06:41:30.706 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.706 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.706 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:30.706 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.439648+0000", 2024-09-13T06:41:30.706 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.83301824800000002 2024-09-13T06:41:30.707 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.707 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.707 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:30.707 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.439782+0000", 2024-09-13T06:41:30.707 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00013466699999999999 2024-09-13T06:41:30.707 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:30.707 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:30.707 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:30.707 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.707 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.707 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25661 3.8 3:1180686c:::rbd_data.1121f2c5ee81.0000000000000009:13 [read 397312~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:30.707 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.436956+0000", 2024-09-13T06:41:30.707 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 94.265745140000007, 2024-09-13T06:41:30.708 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089036758999999993, 2024-09-13T06:41:30.708 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:30.708 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:30.708 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:30.708 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:30.708 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:30.708 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25661 2024-09-13T06:41:30.708 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.708 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:30.708 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.708 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:30.708 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436956+0000", 2024-09-13T06:41:30.708 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:30.708 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.709 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.709 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:30.709 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436956+0000", 2024-09-13T06:41:30.709 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:30.709 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.709 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.709 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:30.709 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436956+0000", 2024-09-13T06:41:30.709 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:30.709 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.709 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.709 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:30.709 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436958+0000", 2024-09-13T06:41:30.710 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1770000000000001e-06 2024-09-13T06:41:30.710 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.710 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.710 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:30.710 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436963+0000", 2024-09-13T06:41:30.710 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.6489999999999996e-06 2024-09-13T06:41:30.710 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.710 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.710 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:30.710 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436975+0000", 2024-09-13T06:41:30.710 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1783999999999999e-05 2024-09-13T06:41:30.710 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.710 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.710 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:30.711 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.525671+0000", 2024-09-13T06:41:30.711 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.088696292999999995 2024-09-13T06:41:30.711 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.711 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.711 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:30.711 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.525749+0000", 2024-09-13T06:41:30.711 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.7589000000000005e-05 2024-09-13T06:41:30.711 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.711 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.711 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:30.711 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.525993+0000", 2024-09-13T06:41:30.711 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00024381000000000001 2024-09-13T06:41:30.711 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:30.711 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:30.712 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:30.712 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.712 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.712 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25662 3.8 3:1180686c:::rbd_data.1121f2c5ee81.0000000000000009:13 [read 421888~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:30.712 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.436980+0000", 2024-09-13T06:41:30.712 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 94.265720827999999, 2024-09-13T06:41:30.712 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089367577000000004, 2024-09-13T06:41:30.712 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:30.712 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:30.712 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:30.712 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:30.712 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:30.712 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25662 2024-09-13T06:41:30.712 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.713 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:30.713 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.713 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:30.713 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436980+0000", 2024-09-13T06:41:30.713 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:30.713 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.713 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.713 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:30.713 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436980+0000", 2024-09-13T06:41:30.713 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:30.713 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.713 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.713 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:30.714 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436980+0000", 2024-09-13T06:41:30.714 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:30.714 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.714 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.714 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:30.714 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436982+0000", 2024-09-13T06:41:30.714 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3989999999999998e-06 2024-09-13T06:41:30.714 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.714 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.714 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:30.714 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436988+0000", 2024-09-13T06:41:30.714 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0039999999999996e-06 2024-09-13T06:41:30.714 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.715 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.715 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:30.715 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436993+0000", 2024-09-13T06:41:30.715 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6090000000000003e-06 2024-09-13T06:41:30.715 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.715 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.715 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:30.715 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.526035+0000", 2024-09-13T06:41:30.715 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089042248000000004 2024-09-13T06:41:30.715 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.715 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.715 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:30.716 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.526111+0000", 2024-09-13T06:41:30.716 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5643999999999996e-05 2024-09-13T06:41:30.716 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.716 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.716 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:30.716 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.526348+0000", 2024-09-13T06:41:30.716 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00023705800000000001 2024-09-13T06:41:30.716 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:30.716 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:30.716 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:30.716 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.716 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.716 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25663 3.8 3:1180686c:::rbd_data.1121f2c5ee81.0000000000000009:13 [read 466944~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:30.717 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.436998+0000", 2024-09-13T06:41:30.717 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 94.265703181000006, 2024-09-13T06:41:30.717 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089730867000000006, 2024-09-13T06:41:30.717 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:30.717 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:30.717 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:30.717 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:30.717 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:30.717 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25663 2024-09-13T06:41:30.717 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.717 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:30.717 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.718 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:30.718 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436998+0000", 2024-09-13T06:41:30.718 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:30.718 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.718 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.718 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:30.718 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436998+0000", 2024-09-13T06:41:30.718 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:30.718 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.718 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.718 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:30.718 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436998+0000", 2024-09-13T06:41:30.718 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:30.718 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.719 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.719 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:30.719 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437000+0000", 2024-09-13T06:41:30.719 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0940000000000002e-06 2024-09-13T06:41:30.719 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.719 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.719 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:30.719 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437005+0000", 2024-09-13T06:41:30.719 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.604e-06 2024-09-13T06:41:30.719 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.719 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.719 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:30.719 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437032+0000", 2024-09-13T06:41:30.719 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6407e-05 2024-09-13T06:41:30.720 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.720 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.720 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:30.720 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.526363+0000", 2024-09-13T06:41:30.720 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089331456000000004 2024-09-13T06:41:30.720 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.720 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.720 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:30.720 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.526404+0000", 2024-09-13T06:41:30.720 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.0887999999999999e-05 2024-09-13T06:41:30.720 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.720 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.721 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:30.721 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.526729+0000", 2024-09-13T06:41:30.721 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00032486 2024-09-13T06:41:30.721 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:30.721 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:30.721 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:30.721 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.721 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.721 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25664 3.8 3:1180686c:::rbd_data.1121f2c5ee81.0000000000000009:13 [read 491520~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:30.721 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.437040+0000", 2024-09-13T06:41:30.721 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 94.265661265999995, 2024-09-13T06:41:30.721 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.090016650000000004, 2024-09-13T06:41:30.721 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:30.722 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:30.722 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:30.722 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:30.722 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:30.722 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25664 2024-09-13T06:41:30.722 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.722 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:30.722 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.722 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:30.722 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437040+0000", 2024-09-13T06:41:30.722 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:30.722 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.722 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.723 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:30.723 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437040+0000", 2024-09-13T06:41:30.723 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:30.723 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.723 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.723 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:30.723 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437039+0000", 2024-09-13T06:41:30.723 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:30.723 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.723 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.723 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:30.723 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437047+0000", 2024-09-13T06:41:30.723 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4839999999999998e-06 2024-09-13T06:41:30.724 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.724 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.724 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:30.724 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437054+0000", 2024-09-13T06:41:30.724 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.8299999999999998e-06 2024-09-13T06:41:30.724 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.724 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.724 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:30.724 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437060+0000", 2024-09-13T06:41:30.724 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.1510000000000001e-06 2024-09-13T06:41:30.724 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.724 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.724 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:30.725 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.526772+0000", 2024-09-13T06:41:30.725 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089711737999999999 2024-09-13T06:41:30.725 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.725 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.725 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:30.725 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.526848+0000", 2024-09-13T06:41:30.725 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5870000000000004e-05 2024-09-13T06:41:30.725 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.725 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.725 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:30.725 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.527057+0000", 2024-09-13T06:41:30.725 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000209106 2024-09-13T06:41:30.725 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:30.725 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:30.725 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:30.726 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.726 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.726 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25740 3.18 3:1c662b96:::rbd_data.1121f2c5ee81.0000000000000010:13 [read 200704~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:30.726 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443352+0000", 2024-09-13T06:41:30.726 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 94.259349591000003, 2024-09-13T06:41:30.726 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089068222000000002, 2024-09-13T06:41:30.726 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:30.726 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:30.726 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:30.726 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:30.726 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:30.726 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25740 2024-09-13T06:41:30.726 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.727 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:30.727 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.727 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:30.727 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443352+0000", 2024-09-13T06:41:30.727 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:30.727 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.727 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.727 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:30.727 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443352+0000", 2024-09-13T06:41:30.727 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:30.727 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.727 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.727 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:30.727 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443351+0000", 2024-09-13T06:41:30.728 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:30.728 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.728 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.728 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:30.728 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443354+0000", 2024-09-13T06:41:30.728 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.841e-06 2024-09-13T06:41:30.728 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.728 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.728 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:30.728 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443361+0000", 2024-09-13T06:41:30.728 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.0010000000000004e-06 2024-09-13T06:41:30.728 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.728 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.729 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:30.729 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443366+0000", 2024-09-13T06:41:30.729 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7119999999999999e-06 2024-09-13T06:41:30.729 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.729 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.729 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:30.729 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532117+0000", 2024-09-13T06:41:30.729 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.088751327000000005 2024-09-13T06:41:30.729 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.729 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.729 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:30.729 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532193+0000", 2024-09-13T06:41:30.729 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5839000000000004e-05 2024-09-13T06:41:30.729 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.730 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.730 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:30.730 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532420+0000", 2024-09-13T06:41:30.730 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00022691000000000001 2024-09-13T06:41:30.730 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:30.730 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:30.730 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:30.730 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.730 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.730 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25741 3.18 3:1c662b96:::rbd_data.1121f2c5ee81.0000000000000010:13 [read 225280~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:30.730 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443378+0000", 2024-09-13T06:41:30.730 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 94.259322823999995, 2024-09-13T06:41:30.730 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089324107, 2024-09-13T06:41:30.730 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:30.731 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:30.731 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:30.731 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:30.731 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:30.731 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25741 2024-09-13T06:41:30.731 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.731 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:30.731 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.731 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:30.731 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443378+0000", 2024-09-13T06:41:30.731 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:30.731 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.731 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.731 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:30.732 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443378+0000", 2024-09-13T06:41:30.732 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:30.732 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.732 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.732 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:30.732 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443378+0000", 2024-09-13T06:41:30.732 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:30.732 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.732 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.732 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:30.732 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443380+0000", 2024-09-13T06:41:30.732 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3549999999999999e-06 2024-09-13T06:41:30.732 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.732 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.733 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:30.733 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443388+0000", 2024-09-13T06:41:30.733 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.7449999999999995e-06 2024-09-13T06:41:30.733 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.733 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.733 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:30.733 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443393+0000", 2024-09-13T06:41:30.733 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.4e-06 2024-09-13T06:41:30.733 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.733 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.733 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:30.733 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532454+0000", 2024-09-13T06:41:30.733 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089060941000000005 2024-09-13T06:41:30.733 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.734 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.734 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:30.734 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532512+0000", 2024-09-13T06:41:30.734 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7763000000000002e-05 2024-09-13T06:41:30.734 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.734 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.734 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:30.734 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532703+0000", 2024-09-13T06:41:30.734 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000190328 2024-09-13T06:41:30.734 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:30.734 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:30.734 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:30.734 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.734 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.734 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25742 3.18 3:1c662b96:::rbd_data.1121f2c5ee81.0000000000000010:13 [read 270336~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:30.735 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443398+0000", 2024-09-13T06:41:30.735 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 94.259303111999998, 2024-09-13T06:41:30.735 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089621836999999996, 2024-09-13T06:41:30.735 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:30.735 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:30.735 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:30.735 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:30.735 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:30.735 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25742 2024-09-13T06:41:30.735 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.735 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:30.735 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.735 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:30.735 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443398+0000", 2024-09-13T06:41:30.735 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:30.736 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.736 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.736 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:30.736 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443398+0000", 2024-09-13T06:41:30.736 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:30.736 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.736 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.736 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:30.736 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443398+0000", 2024-09-13T06:41:30.736 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:30.736 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.736 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.737 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:30.737 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443400+0000", 2024-09-13T06:41:30.737 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1849999999999998e-06 2024-09-13T06:41:30.737 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.737 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.737 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:30.737 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443407+0000", 2024-09-13T06:41:30.737 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3669999999999999e-06 2024-09-13T06:41:30.737 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.737 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.737 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:30.737 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443420+0000", 2024-09-13T06:41:30.737 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2645e-05 2024-09-13T06:41:30.737 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.738 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.738 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:30.738 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532742+0000", 2024-09-13T06:41:30.738 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089322200000000004 2024-09-13T06:41:30.738 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.738 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.738 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:30.738 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532818+0000", 2024-09-13T06:41:30.738 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.6019000000000005e-05 2024-09-13T06:41:30.738 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.738 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.738 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:30.738 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533020+0000", 2024-09-13T06:41:30.739 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000201721 2024-09-13T06:41:30.739 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:30.739 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:30.739 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:30.739 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.739 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.739 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25743 3.18 3:1c662b96:::rbd_data.1121f2c5ee81.0000000000000010:13 [read 294912~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:30.739 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443425+0000", 2024-09-13T06:41:30.739 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 94.259276103999994, 2024-09-13T06:41:30.739 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089864075000000002, 2024-09-13T06:41:30.739 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:30.739 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:30.739 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:30.739 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:30.739 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:30.740 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25743 2024-09-13T06:41:30.740 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.740 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:30.740 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.740 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:30.740 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443425+0000", 2024-09-13T06:41:30.740 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:30.740 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.740 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.740 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:30.740 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443425+0000", 2024-09-13T06:41:30.740 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:30.740 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.740 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.741 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:30.741 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443425+0000", 2024-09-13T06:41:30.741 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:30.741 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.741 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.741 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:30.741 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443432+0000", 2024-09-13T06:41:30.741 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3420000000000002e-06 2024-09-13T06:41:30.741 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.741 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.741 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:30.741 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443440+0000", 2024-09-13T06:41:30.741 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5689999999999999e-06 2024-09-13T06:41:30.741 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.742 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.742 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:30.742 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443445+0000", 2024-09-13T06:41:30.742 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9590000000000003e-06 2024-09-13T06:41:30.742 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.742 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.742 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:30.742 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533063+0000", 2024-09-13T06:41:30.742 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089617988999999995 2024-09-13T06:41:30.742 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.742 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.742 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:30.742 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533122+0000", 2024-09-13T06:41:30.742 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9052999999999999e-05 2024-09-13T06:41:30.742 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.742 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.743 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:30.743 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533289+0000", 2024-09-13T06:41:30.743 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00016752800000000001 2024-09-13T06:41:30.743 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:30.743 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:30.743 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:30.743 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.743 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.743 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25744 3.18 3.69d46638 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:30.743 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443449+0000", 2024-09-13T06:41:30.743 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 94.259251957000004, 2024-09-13T06:41:30.743 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089869148999999995, 2024-09-13T06:41:30.743 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:30.743 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:41:30.744 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:30.744 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:30.744 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:30.744 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25744 2024-09-13T06:41:30.744 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.744 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:30.744 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.744 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:30.744 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443449+0000", 2024-09-13T06:41:30.744 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:30.744 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.744 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.745 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:30.745 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443449+0000", 2024-09-13T06:41:30.745 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:30.745 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.745 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.745 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:30.745 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443449+0000", 2024-09-13T06:41:30.745 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:30.745 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.745 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.745 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:30.745 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443451+0000", 2024-09-13T06:41:30.745 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.244e-06 2024-09-13T06:41:30.746 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.746 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.746 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:30.746 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443457+0000", 2024-09-13T06:41:30.746 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.66e-06 2024-09-13T06:41:30.746 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.746 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.746 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:30.746 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443461+0000", 2024-09-13T06:41:30.746 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5449999999999997e-06 2024-09-13T06:41:30.746 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.746 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.746 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:30.747 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533311+0000", 2024-09-13T06:41:30.747 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089849729000000003 2024-09-13T06:41:30.747 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.747 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.747 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:30.747 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533318+0000", 2024-09-13T06:41:30.747 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.328e-06 2024-09-13T06:41:30.747 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:30.747 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:30.747 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:30.747 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.747 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.747 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25745 3.18 3.69d46638 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:30.747 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443466+0000", 2024-09-13T06:41:30.747 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 94.259234899000006, 2024-09-13T06:41:30.748 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089886743000000005, 2024-09-13T06:41:30.748 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:30.748 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:41:30.748 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:30.748 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:30.748 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:30.748 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25745 2024-09-13T06:41:30.748 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.748 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:30.748 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.748 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:30.748 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443466+0000", 2024-09-13T06:41:30.748 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:30.748 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.749 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.749 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:30.749 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443466+0000", 2024-09-13T06:41:30.749 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:30.749 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.749 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.749 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:30.749 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443466+0000", 2024-09-13T06:41:30.749 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:30.749 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.749 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.749 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:30.749 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443474+0000", 2024-09-13T06:41:30.750 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.1289999999999996e-06 2024-09-13T06:41:30.750 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.750 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.750 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:30.750 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443484+0000", 2024-09-13T06:41:30.750 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0654e-05 2024-09-13T06:41:30.750 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.750 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.750 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:30.750 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443490+0000", 2024-09-13T06:41:30.750 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8030000000000002e-06 2024-09-13T06:41:30.750 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.750 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.750 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:30.750 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533348+0000", 2024-09-13T06:41:30.751 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089857267000000005 2024-09-13T06:41:30.751 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.751 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.751 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:30.751 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533353+0000", 2024-09-13T06:41:30.751 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.5520000000000004e-06 2024-09-13T06:41:30.751 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:30.751 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:30.751 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:30.751 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.751 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.751 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25746 3.18 3.69d46638 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:30.751 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443495+0000", 2024-09-13T06:41:30.751 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 94.259205785999995, 2024-09-13T06:41:30.751 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089903725000000004, 2024-09-13T06:41:30.752 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:30.752 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:41:30.752 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:30.752 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:30.752 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:30.752 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25746 2024-09-13T06:41:30.752 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.752 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:30.752 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.752 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:30.752 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443495+0000", 2024-09-13T06:41:30.752 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:30.752 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.752 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.753 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:30.753 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443495+0000", 2024-09-13T06:41:30.753 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:30.753 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.753 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.753 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:30.753 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443495+0000", 2024-09-13T06:41:30.753 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:30.753 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.753 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.753 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:30.753 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443498+0000", 2024-09-13T06:41:30.753 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.7690000000000001e-06 2024-09-13T06:41:30.753 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.754 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.754 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:30.754 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443504+0000", 2024-09-13T06:41:30.754 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9710000000000001e-06 2024-09-13T06:41:30.754 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.754 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.754 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:30.754 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443508+0000", 2024-09-13T06:41:30.754 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4159999999999997e-06 2024-09-13T06:41:30.754 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.754 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.754 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:30.754 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533391+0000", 2024-09-13T06:41:30.755 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089882607000000003 2024-09-13T06:41:30.755 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.755 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.755 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:30.755 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533399+0000", 2024-09-13T06:41:30.755 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.4349999999999997e-06 2024-09-13T06:41:30.755 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:30.755 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:30.755 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:30.755 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.755 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.755 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25747 3.8 3.63996268 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:30.755 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443512+0000", 2024-09-13T06:41:30.756 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 94.259189054999993, 2024-09-13T06:41:30.756 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089880075000000004, 2024-09-13T06:41:30.756 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:30.756 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:41:30.756 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:30.756 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:30.756 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:30.756 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25747 2024-09-13T06:41:30.756 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.756 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:30.756 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.756 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:30.756 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443512+0000", 2024-09-13T06:41:30.756 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:30.757 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.757 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.757 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:30.757 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443512+0000", 2024-09-13T06:41:30.757 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:30.757 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.757 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.757 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:30.757 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443512+0000", 2024-09-13T06:41:30.757 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:30.757 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.757 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.757 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:30.758 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443514+0000", 2024-09-13T06:41:30.758 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0980000000000001e-06 2024-09-13T06:41:30.758 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.758 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.758 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:30.758 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443520+0000", 2024-09-13T06:41:30.758 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7069999999999997e-06 2024-09-13T06:41:30.758 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.758 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.758 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:30.758 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443524+0000", 2024-09-13T06:41:30.758 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5390000000000001e-06 2024-09-13T06:41:30.758 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.759 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.759 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:30.759 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533384+0000", 2024-09-13T06:41:30.759 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089859684999999995 2024-09-13T06:41:30.759 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.759 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.759 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:30.759 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533392+0000", 2024-09-13T06:41:30.759 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.3440000000000001e-06 2024-09-13T06:41:30.759 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:30.759 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:30.759 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:30.760 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.760 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.760 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25748 3.8 3.63996268 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:30.760 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443528+0000", 2024-09-13T06:41:30.760 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 94.259172927999998, 2024-09-13T06:41:30.760 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089890715999999996, 2024-09-13T06:41:30.760 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:30.760 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:41:30.760 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:30.760 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:30.760 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:30.760 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25748 2024-09-13T06:41:30.761 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.761 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:30.761 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.761 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:30.761 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443528+0000", 2024-09-13T06:41:30.761 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:30.761 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.761 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.761 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:30.761 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443528+0000", 2024-09-13T06:41:30.762 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:30.762 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.762 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.762 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:30.762 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443528+0000", 2024-09-13T06:41:30.762 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:30.762 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.762 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.762 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:30.762 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443530+0000", 2024-09-13T06:41:30.762 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0650000000000001e-06 2024-09-13T06:41:30.762 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.762 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.763 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:30.763 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443536+0000", 2024-09-13T06:41:30.763 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7259999999999999e-06 2024-09-13T06:41:30.763 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.763 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.763 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:30.763 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443540+0000", 2024-09-13T06:41:30.763 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5009999999999998e-06 2024-09-13T06:41:30.763 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.763 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.763 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:30.763 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533412+0000", 2024-09-13T06:41:30.763 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089871873000000005 2024-09-13T06:41:30.764 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.764 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.764 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:30.764 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533419+0000", 2024-09-13T06:41:30.764 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.883e-06 2024-09-13T06:41:30.764 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:30.764 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:30.764 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:30.764 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.764 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.764 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25749 3.8 3.63996268 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:30.764 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443545+0000", 2024-09-13T06:41:30.764 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 94.259156731999994, 2024-09-13T06:41:30.765 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089897988999999998, 2024-09-13T06:41:30.765 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:30.765 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:41:30.765 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:30.765 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:30.765 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:30.765 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25749 2024-09-13T06:41:30.765 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.765 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:30.765 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.765 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:30.765 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443545+0000", 2024-09-13T06:41:30.765 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:30.766 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.766 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.766 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:30.766 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443545+0000", 2024-09-13T06:41:30.766 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:30.766 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.766 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.766 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:30.766 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443544+0000", 2024-09-13T06:41:30.766 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:30.766 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.766 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.766 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:30.767 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443553+0000", 2024-09-13T06:41:30.767 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.4770000000000003e-06 2024-09-13T06:41:30.767 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.767 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.767 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:30.767 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443564+0000", 2024-09-13T06:41:30.767 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0986e-05 2024-09-13T06:41:30.767 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.767 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.767 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:30.767 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443569+0000", 2024-09-13T06:41:30.767 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2530000000000004e-06 2024-09-13T06:41:30.767 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.768 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.768 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:30.768 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533438+0000", 2024-09-13T06:41:30.768 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089868641999999999 2024-09-13T06:41:30.768 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.768 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.768 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:30.768 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533442+0000", 2024-09-13T06:41:30.768 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.989e-06 2024-09-13T06:41:30.768 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:30.768 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:30.768 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:30.769 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.769 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.769 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25750 3.8 3.63996268 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:30.769 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443574+0000", 2024-09-13T06:41:30.769 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 94.259127246000006, 2024-09-13T06:41:30.769 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089895143999999996, 2024-09-13T06:41:30.769 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:30.769 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:41:30.769 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:30.769 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:30.769 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:30.769 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25750 2024-09-13T06:41:30.769 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.770 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:30.770 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.770 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:30.770 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443574+0000", 2024-09-13T06:41:30.770 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:30.770 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.770 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.770 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:30.770 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443574+0000", 2024-09-13T06:41:30.770 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:30.770 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.770 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.770 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:30.771 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443574+0000", 2024-09-13T06:41:30.771 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:30.771 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.771 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.771 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:30.771 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443576+0000", 2024-09-13T06:41:30.771 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6910000000000002e-06 2024-09-13T06:41:30.771 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.771 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.771 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:30.771 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443583+0000", 2024-09-13T06:41:30.771 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.331e-06 2024-09-13T06:41:30.771 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.771 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.772 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:30.772 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443587+0000", 2024-09-13T06:41:30.772 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6129999999999997e-06 2024-09-13T06:41:30.772 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.772 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.772 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:30.772 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533464+0000", 2024-09-13T06:41:30.772 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089876605999999998 2024-09-13T06:41:30.772 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.772 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.772 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:30.772 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533469+0000", 2024-09-13T06:41:30.772 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3909999999999997e-06 2024-09-13T06:41:30.773 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:30.773 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:30.773 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:30.773 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.773 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.773 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25751 3.8 3.63996268 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:30.773 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443592+0000", 2024-09-13T06:41:30.773 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 94.259109549000001, 2024-09-13T06:41:30.773 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089913650999999997, 2024-09-13T06:41:30.773 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:30.773 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:41:30.773 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:30.774 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:30.774 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:30.774 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25751 2024-09-13T06:41:30.774 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.774 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:30.774 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.774 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:30.774 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443592+0000", 2024-09-13T06:41:30.774 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:30.774 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.774 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.774 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:30.774 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443592+0000", 2024-09-13T06:41:30.774 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:30.775 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.775 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.775 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:30.775 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443591+0000", 2024-09-13T06:41:30.775 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:30.775 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.775 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.775 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:30.775 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443594+0000", 2024-09-13T06:41:30.775 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3649999999999998e-06 2024-09-13T06:41:30.775 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.775 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.775 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:30.775 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443599+0000", 2024-09-13T06:41:30.776 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.699e-06 2024-09-13T06:41:30.776 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.776 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.776 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:30.776 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443611+0000", 2024-09-13T06:41:30.776 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1503e-05 2024-09-13T06:41:30.776 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.776 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.776 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:30.776 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533497+0000", 2024-09-13T06:41:30.776 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089886453000000005 2024-09-13T06:41:30.776 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.776 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.776 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:30.777 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533505+0000", 2024-09-13T06:41:30.777 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.9910000000000002e-06 2024-09-13T06:41:30.777 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:30.777 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:30.777 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:30.777 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.777 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.777 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25752 3.8 3.63996268 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:30.777 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443615+0000", 2024-09-13T06:41:30.777 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 94.259085768000006, 2024-09-13T06:41:30.777 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089905868999999999, 2024-09-13T06:41:30.777 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:30.777 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:41:30.778 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:30.778 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:30.778 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:30.778 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25752 2024-09-13T06:41:30.778 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.778 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:30.778 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.778 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:30.778 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443615+0000", 2024-09-13T06:41:30.778 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:30.778 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.778 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.778 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:30.778 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443615+0000", 2024-09-13T06:41:30.779 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:30.779 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.779 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.779 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:30.779 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443615+0000", 2024-09-13T06:41:30.779 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:30.779 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.779 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.779 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:30.779 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443617+0000", 2024-09-13T06:41:30.779 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3539999999999998e-06 2024-09-13T06:41:30.779 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.779 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.779 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:30.780 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443624+0000", 2024-09-13T06:41:30.780 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3600000000000001e-06 2024-09-13T06:41:30.780 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.780 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.780 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:30.780 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443628+0000", 2024-09-13T06:41:30.780 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.2350000000000001e-06 2024-09-13T06:41:30.780 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.780 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.780 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:30.780 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533517+0000", 2024-09-13T06:41:30.780 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089889029999999995 2024-09-13T06:41:30.780 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.781 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.781 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:30.781 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533521+0000", 2024-09-13T06:41:30.781 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.2529999999999998e-06 2024-09-13T06:41:30.781 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:30.781 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:30.781 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:30.781 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.781 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.781 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25755 3.8 3.63996268 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:30.781 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.444692+0000", 2024-09-13T06:41:30.781 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 94.258009061999999, 2024-09-13T06:41:30.781 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.088904186999999996, 2024-09-13T06:41:30.781 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:30.782 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:41:30.782 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:30.782 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:30.782 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:30.782 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25755 2024-09-13T06:41:30.782 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.782 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:30.782 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.782 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:30.782 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.444692+0000", 2024-09-13T06:41:30.782 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:30.782 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.782 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.782 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:30.783 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.444692+0000", 2024-09-13T06:41:30.783 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:30.783 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.783 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.783 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:30.783 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.444692+0000", 2024-09-13T06:41:30.783 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:30.783 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.783 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.783 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:30.783 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.444694+0000", 2024-09-13T06:41:30.783 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.058e-06 2024-09-13T06:41:30.783 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.784 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.784 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:30.784 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.444700+0000", 2024-09-13T06:41:30.784 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7769999999999999e-06 2024-09-13T06:41:30.784 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.784 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.784 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:30.784 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.444704+0000", 2024-09-13T06:41:30.784 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6229999999999996e-06 2024-09-13T06:41:30.784 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.784 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.784 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:30.785 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533587+0000", 2024-09-13T06:41:30.785 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.088882744999999999 2024-09-13T06:41:30.785 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.785 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.785 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:30.785 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533596+0000", 2024-09-13T06:41:30.785 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.3270000000000007e-06 2024-09-13T06:41:30.785 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:30.785 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:30.785 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:30.785 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.785 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.785 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:64356 3.c 3:32785be9:::rbd_header.11218ba71f0d:head [watch reconnect cookie 140361410387072 gen 2] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e95)", 2024-09-13T06:41:30.786 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:48.473318+0000", 2024-09-13T06:41:30.786 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 42.229383374999998, 2024-09-13T06:41:30.786 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1458904379999999, 2024-09-13T06:41:30.786 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:30.786 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:30.786 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:30.786 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:30.786 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:30.786 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 64356 2024-09-13T06:41:30.786 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.786 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:30.786 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.787 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:30.787 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:48.473318+0000", 2024-09-13T06:41:30.787 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:30.787 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.787 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.787 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:30.787 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:48.473318+0000", 2024-09-13T06:41:30.787 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:30.787 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.787 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.787 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:30.787 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:48.473315+0000", 2024-09-13T06:41:30.787 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999971 2024-09-13T06:41:30.788 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.788 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.788 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:30.788 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:48.473329+0000", 2024-09-13T06:41:30.788 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.433e-05 2024-09-13T06:41:30.788 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.788 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.788 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:30.788 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:48.473363+0000", 2024-09-13T06:41:30.788 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.3592e-05 2024-09-13T06:41:30.788 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.788 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.788 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:30.789 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:48.473386+0000", 2024-09-13T06:41:30.789 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2708999999999999e-05 2024-09-13T06:41:30.789 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.789 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.789 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:30.789 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:48.473804+0000", 2024-09-13T06:41:30.789 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00041789399999999998 2024-09-13T06:41:30.789 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.789 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.789 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:41:30.789 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:48.473830+0000", 2024-09-13T06:41:30.789 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6869e-05 2024-09-13T06:41:30.789 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.790 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.790 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:30.790 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:49.614332+0000", 2024-09-13T06:41:30.790 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.140501107 2024-09-13T06:41:30.790 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.790 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.790 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for rw locks", 2024-09-13T06:41:30.790 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:49.614496+0000", 2024-09-13T06:41:30.790 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00016451200000000001 2024-09-13T06:41:30.790 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.790 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.790 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:30.791 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:49.617131+0000", 2024-09-13T06:41:30.791 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.002634843 2024-09-13T06:41:30.791 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.791 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.791 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:30.791 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:49.617204+0000", 2024-09-13T06:41:30.791 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.2991000000000006e-05 2024-09-13T06:41:30.791 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:30.791 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:30.791 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:30.791 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:49.619208+0000", 2024-09-13T06:41:30.791 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.002004381 2024-09-13T06:41:30.791 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:30.791 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:30.792 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:30.792 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:30.792 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:30.792 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:41:30.793 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-13T06:41:30.794 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:41:30.791+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:41:30.895 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:41:30.894+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:41:30.925 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:41:30.926 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [], 2024-09-13T06:41:30.926 INFO:teuthology.orchestra.run.smithi139.stdout: "num_ops": 0 2024-09-13T06:41:30.926 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:41:30.939 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-13T06:41:30.995 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:41:30.991+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:41:31.061 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:41:31.061 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [], 2024-09-13T06:41:31.061 INFO:teuthology.orchestra.run.smithi139.stdout: "complaint_time": 30, 2024-09-13T06:41:31.061 INFO:teuthology.orchestra.run.smithi139.stdout: "num_blocked_ops": 0 2024-09-13T06:41:31.061 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:41:31.075 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-13T06:41:31.116 INFO:tasks.ceph.osd.6.smithi139.stderr:2024-09-13T06:41:31.115+0000 7fcd02c5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26385) UID: 0 2024-09-13T06:41:31.197 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:41:31.194+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:41:31.235 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:41:31.236 INFO:teuthology.orchestra.run.smithi139.stdout: "size": 20, 2024-09-13T06:41:31.236 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 600, 2024-09-13T06:41:31.236 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [ 2024-09-13T06:41:31.236 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.236 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18706 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 3346432~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:41:31.236 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.846138+0000", 2024-09-13T06:41:31.236 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 99.387339905000005, 2024-09-13T06:41:31.236 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.102018712, 2024-09-13T06:41:31.236 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:31.236 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:31.236 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:31.236 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:31.236 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:31.237 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18706 2024-09-13T06:41:31.237 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.237 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:31.237 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.237 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:31.237 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846138+0000", 2024-09-13T06:41:31.237 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:31.237 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.237 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.237 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:31.237 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846138+0000", 2024-09-13T06:41:31.237 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:31.237 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.237 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.238 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:31.238 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846138+0000", 2024-09-13T06:41:31.238 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:31.238 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.238 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.238 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:31.238 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846141+0000", 2024-09-13T06:41:31.238 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.6969999999999999e-06 2024-09-13T06:41:31.238 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.238 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.238 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:31.238 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846150+0000", 2024-09-13T06:41:31.238 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6400000000000003e-06 2024-09-13T06:41:31.238 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.239 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.239 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:31.239 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846160+0000", 2024-09-13T06:41:31.239 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.3999999999999998e-06 2024-09-13T06:41:31.239 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.239 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.239 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:31.239 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.947764+0000", 2024-09-13T06:41:31.239 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101604085 2024-09-13T06:41:31.239 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.239 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.239 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:31.239 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.947888+0000", 2024-09-13T06:41:31.240 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000124113 2024-09-13T06:41:31.240 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.240 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.240 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:31.240 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.948157+0000", 2024-09-13T06:41:31.240 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00026943399999999998 2024-09-13T06:41:31.240 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:31.240 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:31.240 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:31.240 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.240 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.240 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18707 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 3375104~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:41:31.240 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.846207+0000", 2024-09-13T06:41:31.241 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 99.387271139000006, 2024-09-13T06:41:31.241 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10238114099999999, 2024-09-13T06:41:31.241 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:31.241 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:31.241 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:31.241 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:31.241 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:31.241 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18707 2024-09-13T06:41:31.241 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.241 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:31.241 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.241 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:31.241 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846207+0000", 2024-09-13T06:41:31.242 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:31.242 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.242 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.242 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:31.242 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846207+0000", 2024-09-13T06:41:31.242 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:31.242 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.242 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.242 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:31.242 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846206+0000", 2024-09-13T06:41:31.242 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:31.242 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.242 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.243 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:31.243 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846211+0000", 2024-09-13T06:41:31.243 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.3000000000000003e-06 2024-09-13T06:41:31.243 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.243 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.243 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:31.243 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846220+0000", 2024-09-13T06:41:31.243 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6199999999999994e-06 2024-09-13T06:41:31.243 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.243 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.243 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:31.243 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846228+0000", 2024-09-13T06:41:31.243 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.7500000000000003e-06 2024-09-13T06:41:31.243 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.243 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.244 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:31.244 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.948267+0000", 2024-09-13T06:41:31.244 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10203878700000001 2024-09-13T06:41:31.244 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.244 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.244 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:31.244 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.948435+0000", 2024-09-13T06:41:31.244 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00016796500000000001 2024-09-13T06:41:31.244 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.244 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.244 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:31.244 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.948588+0000", 2024-09-13T06:41:31.244 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00015373599999999999 2024-09-13T06:41:31.244 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:31.245 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:31.245 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:31.245 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.245 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.245 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18718 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 3690496~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:41:31.245 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.850174+0000", 2024-09-13T06:41:31.245 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 99.383303986000001, 2024-09-13T06:41:31.245 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101854154, 2024-09-13T06:41:31.245 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:31.245 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:31.245 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:31.245 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:31.245 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:31.245 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18718 2024-09-13T06:41:31.246 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.246 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:31.246 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.246 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:31.246 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850174+0000", 2024-09-13T06:41:31.246 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:31.246 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.246 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.246 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:31.246 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850174+0000", 2024-09-13T06:41:31.246 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:31.246 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.246 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.247 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:31.247 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850173+0000", 2024-09-13T06:41:31.247 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:31.247 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.247 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.247 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:31.247 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850178+0000", 2024-09-13T06:41:31.247 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.4129999999999999e-06 2024-09-13T06:41:31.247 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.247 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.247 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:31.247 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850188+0000", 2024-09-13T06:41:31.248 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.8600000000000005e-06 2024-09-13T06:41:31.248 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.248 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.248 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:31.248 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850195+0000", 2024-09-13T06:41:31.248 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.8730000000000007e-06 2024-09-13T06:41:31.248 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.248 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.248 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:31.248 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.951766+0000", 2024-09-13T06:41:31.248 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.1015703 2024-09-13T06:41:31.248 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.248 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.248 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:31.249 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.951879+0000", 2024-09-13T06:41:31.249 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000112932 2024-09-13T06:41:31.249 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.249 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.249 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:31.249 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.952029+0000", 2024-09-13T06:41:31.249 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000149846 2024-09-13T06:41:31.249 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:31.249 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:31.249 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:31.249 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.249 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.249 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18719 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 3719168~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:41:31.249 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.850202+0000", 2024-09-13T06:41:31.250 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 99.383275943000001, 2024-09-13T06:41:31.250 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.102191676, 2024-09-13T06:41:31.250 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:31.250 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:31.250 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:31.250 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:31.250 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:31.250 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18719 2024-09-13T06:41:31.250 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.250 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:31.250 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.250 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:31.250 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850202+0000", 2024-09-13T06:41:31.250 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:31.251 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.251 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.251 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:31.251 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850202+0000", 2024-09-13T06:41:31.251 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:31.251 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.251 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.251 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:31.251 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850202+0000", 2024-09-13T06:41:31.251 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:31.251 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.251 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.251 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:31.251 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850205+0000", 2024-09-13T06:41:31.252 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.89e-06 2024-09-13T06:41:31.252 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.252 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.252 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:31.252 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850216+0000", 2024-09-13T06:41:31.252 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0233e-05 2024-09-13T06:41:31.252 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.252 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.252 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:31.252 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850223+0000", 2024-09-13T06:41:31.252 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5299999999999999e-06 2024-09-13T06:41:31.252 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.252 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.253 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:31.253 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.952106+0000", 2024-09-13T06:41:31.253 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10188309299999999 2024-09-13T06:41:31.253 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.253 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.253 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:31.253 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.952233+0000", 2024-09-13T06:41:31.253 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000126993 2024-09-13T06:41:31.253 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.253 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.253 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:31.253 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.952394+0000", 2024-09-13T06:41:31.253 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000160791 2024-09-13T06:41:31.253 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:31.254 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:31.254 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:31.254 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.254 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.254 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18720 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 3747840~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:41:31.254 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.850726+0000", 2024-09-13T06:41:31.254 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 99.382752113999999, 2024-09-13T06:41:31.254 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10199504299999999, 2024-09-13T06:41:31.254 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:31.254 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:31.254 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:31.254 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:31.254 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:31.254 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18720 2024-09-13T06:41:31.254 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.255 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:31.255 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.255 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:31.255 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850726+0000", 2024-09-13T06:41:31.255 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:31.255 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.255 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.255 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:31.255 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850726+0000", 2024-09-13T06:41:31.255 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:31.255 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.255 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.255 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:31.256 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850229+0000", 2024-09-13T06:41:31.256 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9995027 2024-09-13T06:41:31.256 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.256 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.256 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:31.256 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850731+0000", 2024-09-13T06:41:31.256 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00050221599999999999 2024-09-13T06:41:31.256 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.256 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.256 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:31.256 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850751+0000", 2024-09-13T06:41:31.256 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.9703000000000001e-05 2024-09-13T06:41:31.256 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.256 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.257 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:31.257 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850764+0000", 2024-09-13T06:41:31.257 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3207000000000001e-05 2024-09-13T06:41:31.257 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.257 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.257 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:31.257 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.952454+0000", 2024-09-13T06:41:31.257 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101690102 2024-09-13T06:41:31.257 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.257 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.257 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:31.257 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.952571+0000", 2024-09-13T06:41:31.257 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000116556 2024-09-13T06:41:31.258 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.258 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.258 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:31.258 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.952721+0000", 2024-09-13T06:41:31.258 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000150419 2024-09-13T06:41:31.258 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:31.258 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:31.258 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:31.258 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.258 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.258 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18730 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 4034560~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:41:31.258 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.854013+0000", 2024-09-13T06:41:31.258 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 99.379465173, 2024-09-13T06:41:31.259 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10186914399999999, 2024-09-13T06:41:31.259 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:31.259 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:31.259 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:31.259 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:31.259 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:31.259 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18730 2024-09-13T06:41:31.259 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.259 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:31.259 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.259 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:31.259 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.854013+0000", 2024-09-13T06:41:31.259 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:31.260 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.260 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.260 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:31.260 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.854013+0000", 2024-09-13T06:41:31.260 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:31.260 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.260 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.260 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:31.260 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.854013+0000", 2024-09-13T06:41:31.260 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:31.260 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.260 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.260 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:31.261 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.854016+0000", 2024-09-13T06:41:31.261 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.1839999999999999e-06 2024-09-13T06:41:31.261 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.261 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.261 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:31.261 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.854025+0000", 2024-09-13T06:41:31.261 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.8030000000000003e-06 2024-09-13T06:41:31.261 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.261 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.261 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:31.261 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.854033+0000", 2024-09-13T06:41:31.261 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6500000000000002e-06 2024-09-13T06:41:31.261 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.261 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.262 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:31.262 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.955546+0000", 2024-09-13T06:41:31.262 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10151296 2024-09-13T06:41:31.262 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.262 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.262 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:31.262 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.955694+0000", 2024-09-13T06:41:31.262 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000147773 2024-09-13T06:41:31.262 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.262 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.262 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:31.262 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.955882+0000", 2024-09-13T06:41:31.262 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000188371 2024-09-13T06:41:31.262 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:31.263 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:31.263 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:31.263 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.263 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.263 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18742 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 4378624~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:41:31.263 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.857984+0000", 2024-09-13T06:41:31.263 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 99.37549405, 2024-09-13T06:41:31.263 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10179961799999999, 2024-09-13T06:41:31.263 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:31.263 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:31.263 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:31.263 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:31.263 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:31.264 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18742 2024-09-13T06:41:31.264 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.264 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:31.264 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.264 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:31.264 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.857984+0000", 2024-09-13T06:41:31.264 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:31.264 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.264 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.264 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:31.264 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.857984+0000", 2024-09-13T06:41:31.264 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:31.264 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.265 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.265 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:31.265 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.857983+0000", 2024-09-13T06:41:31.265 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:31.265 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.265 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.265 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:31.265 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.857987+0000", 2024-09-13T06:41:31.265 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0670000000000002e-06 2024-09-13T06:41:31.265 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.265 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.265 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:31.265 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.857997+0000", 2024-09-13T06:41:31.266 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6830000000000003e-06 2024-09-13T06:41:31.266 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.266 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.266 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:31.266 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.858006+0000", 2024-09-13T06:41:31.266 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.5739999999999996e-06 2024-09-13T06:41:31.266 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.266 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.266 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:31.266 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.959453+0000", 2024-09-13T06:41:31.266 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101447339 2024-09-13T06:41:31.266 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.266 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.266 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:31.267 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.959603+0000", 2024-09-13T06:41:31.267 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000150316 2024-09-13T06:41:31.267 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.267 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.267 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:31.267 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.959784+0000", 2024-09-13T06:41:31.267 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00018065900000000001 2024-09-13T06:41:31.267 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:31.267 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:31.267 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:31.267 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.267 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.267 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18743 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 4407296~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:41:31.267 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.858012+0000", 2024-09-13T06:41:31.268 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 99.375466056999997, 2024-09-13T06:41:31.268 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10210024500000001, 2024-09-13T06:41:31.268 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:31.268 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:31.268 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:31.268 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:31.268 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:31.268 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18743 2024-09-13T06:41:31.268 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.268 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:31.268 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.268 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:31.268 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.858012+0000", 2024-09-13T06:41:31.269 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:31.269 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.269 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.269 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:31.269 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.858012+0000", 2024-09-13T06:41:31.269 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:31.269 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.269 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.269 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:31.269 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.858011+0000", 2024-09-13T06:41:31.269 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:31.269 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.269 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.270 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:31.270 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.858016+0000", 2024-09-13T06:41:31.270 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0659999999999997e-06 2024-09-13T06:41:31.270 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.270 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.270 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:31.270 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.858024+0000", 2024-09-13T06:41:31.270 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.7700000000000007e-06 2024-09-13T06:41:31.270 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.270 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.270 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:31.270 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.858032+0000", 2024-09-13T06:41:31.270 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.7700000000000001e-06 2024-09-13T06:41:31.270 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.270 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.271 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:31.271 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.959850+0000", 2024-09-13T06:41:31.271 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.1018182 2024-09-13T06:41:31.271 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.271 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.271 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:31.271 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.959964+0000", 2024-09-13T06:41:31.271 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00011413600000000001 2024-09-13T06:41:31.271 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.271 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.271 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:31.271 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.960113+0000", 2024-09-13T06:41:31.271 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00014813900000000001 2024-09-13T06:41:31.271 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:31.272 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:31.272 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:31.272 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.272 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.272 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18755 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 4751360~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:41:31.272 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.862061+0000", 2024-09-13T06:41:31.272 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 99.371417804999993, 2024-09-13T06:41:31.272 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101907023, 2024-09-13T06:41:31.272 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:31.272 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:31.272 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:31.272 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:31.272 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:31.273 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18755 2024-09-13T06:41:31.273 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.273 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:31.273 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.273 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:31.273 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862061+0000", 2024-09-13T06:41:31.273 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:31.273 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.273 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.273 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:31.273 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862061+0000", 2024-09-13T06:41:31.273 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:31.274 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.274 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.274 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:31.274 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862060+0000", 2024-09-13T06:41:31.274 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:31.274 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.274 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.274 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:31.274 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862064+0000", 2024-09-13T06:41:31.274 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.3229999999999999e-06 2024-09-13T06:41:31.274 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.274 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.274 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:31.274 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862078+0000", 2024-09-13T06:41:31.275 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.433e-05 2024-09-13T06:41:31.275 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.275 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.275 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:31.275 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862086+0000", 2024-09-13T06:41:31.275 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.3869999999999997e-06 2024-09-13T06:41:31.275 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.275 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.275 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:31.275 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.963635+0000", 2024-09-13T06:41:31.275 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101549606 2024-09-13T06:41:31.275 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.275 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.276 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:31.276 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.963783+0000", 2024-09-13T06:41:31.276 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000147312 2024-09-13T06:41:31.276 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.276 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.276 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:31.276 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.963968+0000", 2024-09-13T06:41:31.276 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000185028 2024-09-13T06:41:31.276 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:31.276 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:31.276 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:31.276 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.276 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.277 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18756 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 4780032~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:41:31.277 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.862132+0000", 2024-09-13T06:41:31.277 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 99.371345962000007, 2024-09-13T06:41:31.277 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.102159295, 2024-09-13T06:41:31.277 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:31.277 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:31.277 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:31.277 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:31.277 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:31.277 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18756 2024-09-13T06:41:31.277 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.277 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:31.277 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.278 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:31.278 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862132+0000", 2024-09-13T06:41:31.278 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:31.278 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.278 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.278 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:31.278 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862132+0000", 2024-09-13T06:41:31.278 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:31.278 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.278 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.278 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:31.278 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862132+0000", 2024-09-13T06:41:31.278 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:31.278 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.279 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.279 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:31.279 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862136+0000", 2024-09-13T06:41:31.279 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.9559999999999999e-06 2024-09-13T06:41:31.279 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.279 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.279 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:31.279 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862145+0000", 2024-09-13T06:41:31.279 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6169999999999996e-06 2024-09-13T06:41:31.279 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.279 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.279 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:31.279 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862153+0000", 2024-09-13T06:41:31.280 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.8359999999999992e-06 2024-09-13T06:41:31.280 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.280 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.280 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:31.280 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.964018+0000", 2024-09-13T06:41:31.280 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101865421 2024-09-13T06:41:31.280 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.280 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.280 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:31.280 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.964140+0000", 2024-09-13T06:41:31.280 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000121172 2024-09-13T06:41:31.280 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.281 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.281 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:31.281 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.964292+0000", 2024-09-13T06:41:31.281 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00015202600000000001 2024-09-13T06:41:31.281 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:31.281 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:31.281 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:31.281 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.281 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.281 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18768 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 5124096~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:41:31.281 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.866345+0000", 2024-09-13T06:41:31.281 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 99.367133655000004, 2024-09-13T06:41:31.281 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101779361, 2024-09-13T06:41:31.282 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:31.282 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:31.282 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:31.282 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:31.282 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:31.282 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18768 2024-09-13T06:41:31.282 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.282 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:31.282 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.282 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:31.282 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.866345+0000", 2024-09-13T06:41:31.282 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:31.282 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.283 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.283 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:31.283 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.866345+0000", 2024-09-13T06:41:31.283 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:31.283 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.283 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.283 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:31.283 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.866344+0000", 2024-09-13T06:41:31.283 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:31.283 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.283 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.283 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:31.283 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.866348+0000", 2024-09-13T06:41:31.284 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.4300000000000002e-06 2024-09-13T06:41:31.284 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.284 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.284 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:31.284 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.866356+0000", 2024-09-13T06:41:31.284 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.5930000000000006e-06 2024-09-13T06:41:31.284 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.284 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.284 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:31.284 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.866364+0000", 2024-09-13T06:41:31.284 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5599999999999996e-06 2024-09-13T06:41:31.284 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.284 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.285 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:31.285 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.967865+0000", 2024-09-13T06:41:31.285 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101501683 2024-09-13T06:41:31.285 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.285 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.285 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:31.285 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.967981+0000", 2024-09-13T06:41:31.285 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000115643 2024-09-13T06:41:31.285 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.285 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.285 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:31.285 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.968124+0000", 2024-09-13T06:41:31.285 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00014305500000000001 2024-09-13T06:41:31.285 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:31.286 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:31.286 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:31.286 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.286 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.286 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18779 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 5439488~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:41:31.286 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.869996+0000", 2024-09-13T06:41:31.286 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 99.363482770000005, 2024-09-13T06:41:31.286 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10189577399999999, 2024-09-13T06:41:31.286 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:31.286 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:31.286 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:31.286 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:31.286 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:31.287 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18779 2024-09-13T06:41:31.287 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.287 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:31.287 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.287 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:31.287 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.869996+0000", 2024-09-13T06:41:31.287 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:31.287 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.287 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.287 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:31.287 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.869996+0000", 2024-09-13T06:41:31.287 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:31.287 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.287 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.288 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:31.288 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.869995+0000", 2024-09-13T06:41:31.288 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:31.288 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.288 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.288 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:31.288 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.869998+0000", 2024-09-13T06:41:31.288 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.2729999999999998e-06 2024-09-13T06:41:31.288 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.288 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.288 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:31.288 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.870007+0000", 2024-09-13T06:41:31.289 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.5760000000000006e-06 2024-09-13T06:41:31.289 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.289 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.289 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:31.289 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.870014+0000", 2024-09-13T06:41:31.289 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.1400000000000002e-06 2024-09-13T06:41:31.289 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.289 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.289 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:31.289 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.971631+0000", 2024-09-13T06:41:31.289 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101617503 2024-09-13T06:41:31.289 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.289 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.290 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:31.290 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.971747+0000", 2024-09-13T06:41:31.290 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00011599600000000001 2024-09-13T06:41:31.290 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.290 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.290 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:31.290 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.971891+0000", 2024-09-13T06:41:31.290 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000143912 2024-09-13T06:41:31.290 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:31.290 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:31.290 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:31.290 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.291 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.291 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18792 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 5812224~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:41:31.291 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.874371+0000", 2024-09-13T06:41:31.291 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 99.359107640000005, 2024-09-13T06:41:31.291 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101736005, 2024-09-13T06:41:31.291 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:31.291 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:31.291 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:31.291 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:31.291 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:31.291 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18792 2024-09-13T06:41:31.291 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.292 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:31.292 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.292 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:31.292 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874371+0000", 2024-09-13T06:41:31.292 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:31.292 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.292 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.292 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:31.292 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874371+0000", 2024-09-13T06:41:31.292 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:31.292 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.292 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.292 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:31.292 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874370+0000", 2024-09-13T06:41:31.293 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:31.293 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.293 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.293 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:31.293 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874374+0000", 2024-09-13T06:41:31.293 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.7239999999999998e-06 2024-09-13T06:41:31.293 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.293 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.293 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:31.293 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874385+0000", 2024-09-13T06:41:31.293 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1293e-05 2024-09-13T06:41:31.293 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.293 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.294 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:31.294 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874394+0000", 2024-09-13T06:41:31.294 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.0729999999999994e-06 2024-09-13T06:41:31.294 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.294 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.294 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:31.294 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.975850+0000", 2024-09-13T06:41:31.294 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10145599700000001 2024-09-13T06:41:31.294 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.294 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.294 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:31.294 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.975963+0000", 2024-09-13T06:41:31.294 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000112689 2024-09-13T06:41:31.295 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.295 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.295 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:31.295 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.976107+0000", 2024-09-13T06:41:31.295 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000143836 2024-09-13T06:41:31.295 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:31.295 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:31.295 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:31.295 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.295 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.295 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18793 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 5840896~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:41:31.295 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.874401+0000", 2024-09-13T06:41:31.295 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 99.359077607000003, 2024-09-13T06:41:31.296 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.102005516, 2024-09-13T06:41:31.296 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:31.296 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:31.296 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:31.296 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:31.296 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:31.296 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18793 2024-09-13T06:41:31.296 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.296 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:31.296 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.296 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:31.296 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874401+0000", 2024-09-13T06:41:31.296 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:31.297 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.297 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.297 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:31.297 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874401+0000", 2024-09-13T06:41:31.297 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:31.297 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.297 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.297 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:31.297 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874400+0000", 2024-09-13T06:41:31.297 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:31.297 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.297 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.298 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:31.298 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874404+0000", 2024-09-13T06:41:31.298 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0069999999999999e-06 2024-09-13T06:41:31.298 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.298 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.298 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:31.298 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874412+0000", 2024-09-13T06:41:31.298 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.5399999999999996e-06 2024-09-13T06:41:31.298 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.298 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.298 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:31.298 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874420+0000", 2024-09-13T06:41:31.298 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.6199999999999999e-06 2024-09-13T06:41:31.299 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.299 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.299 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:31.299 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.976150+0000", 2024-09-13T06:41:31.299 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101729874 2024-09-13T06:41:31.299 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.299 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.299 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:31.299 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.976261+0000", 2024-09-13T06:41:31.299 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000110819 2024-09-13T06:41:31.299 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.299 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.299 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:31.299 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.976406+0000", 2024-09-13T06:41:31.300 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000145489 2024-09-13T06:41:31.300 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:31.300 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:31.300 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:31.300 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.300 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.300 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18803 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 6127616~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:41:31.300 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.877851+0000", 2024-09-13T06:41:31.300 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 99.355627114000001, 2024-09-13T06:41:31.300 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101951584, 2024-09-13T06:41:31.300 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:31.300 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:31.300 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:31.301 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:31.301 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:31.301 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18803 2024-09-13T06:41:31.301 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.301 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:31.301 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.301 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:31.301 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.877851+0000", 2024-09-13T06:41:31.301 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:31.301 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.301 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.301 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:31.302 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.877851+0000", 2024-09-13T06:41:31.302 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:31.302 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.302 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.302 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:31.302 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.877851+0000", 2024-09-13T06:41:31.302 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:31.302 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.302 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.302 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:31.302 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.877854+0000", 2024-09-13T06:41:31.302 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.7929999999999999e-06 2024-09-13T06:41:31.302 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.303 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.303 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:31.303 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.877864+0000", 2024-09-13T06:41:31.303 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.2029999999999998e-06 2024-09-13T06:41:31.303 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.303 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.303 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:31.303 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.877873+0000", 2024-09-13T06:41:31.303 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.0440000000000001e-06 2024-09-13T06:41:31.303 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.303 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.303 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:31.303 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.979544+0000", 2024-09-13T06:41:31.303 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101671198 2024-09-13T06:41:31.304 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.304 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.304 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:31.304 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.979658+0000", 2024-09-13T06:41:31.304 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000114456 2024-09-13T06:41:31.304 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.304 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.304 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:31.304 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.979803+0000", 2024-09-13T06:41:31.304 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000144506 2024-09-13T06:41:31.304 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:31.304 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:31.304 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:31.304 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.305 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.305 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18807 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 6242304~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:41:31.305 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.879235+0000", 2024-09-13T06:41:31.305 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 99.354243084000004, 2024-09-13T06:41:31.305 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101781258, 2024-09-13T06:41:31.305 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:31.305 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:31.305 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:31.305 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:31.305 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:31.305 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18807 2024-09-13T06:41:31.305 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.305 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:31.305 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.306 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:31.306 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879235+0000", 2024-09-13T06:41:31.306 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:31.306 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.306 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.306 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:31.306 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879235+0000", 2024-09-13T06:41:31.306 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:31.306 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.306 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.306 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:31.306 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879235+0000", 2024-09-13T06:41:31.306 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:31.307 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.307 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.307 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:31.307 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879239+0000", 2024-09-13T06:41:31.307 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.963e-06 2024-09-13T06:41:31.307 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.307 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.307 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:31.307 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879247+0000", 2024-09-13T06:41:31.307 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6470000000000004e-06 2024-09-13T06:41:31.307 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.307 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.307 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:31.307 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879255+0000", 2024-09-13T06:41:31.308 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5429999999999996e-06 2024-09-13T06:41:31.308 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.308 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.308 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:31.308 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.980756+0000", 2024-09-13T06:41:31.308 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10150165999999999 2024-09-13T06:41:31.308 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.308 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.308 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:31.308 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.980868+0000", 2024-09-13T06:41:31.308 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000111196 2024-09-13T06:41:31.308 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.308 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.309 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:31.309 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.981017+0000", 2024-09-13T06:41:31.309 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000148846 2024-09-13T06:41:31.309 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:31.309 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:31.309 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:31.309 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.309 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.309 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18808 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 6270976~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:41:31.309 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.879261+0000", 2024-09-13T06:41:31.309 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 99.354216945000005, 2024-09-13T06:41:31.309 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.102057547, 2024-09-13T06:41:31.310 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:31.310 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:31.310 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:31.310 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:31.310 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:31.310 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18808 2024-09-13T06:41:31.310 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.310 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:31.310 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.310 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:31.310 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879261+0000", 2024-09-13T06:41:31.310 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:31.310 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.311 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.311 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:31.311 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879261+0000", 2024-09-13T06:41:31.311 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:31.311 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.311 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.311 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:31.311 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879261+0000", 2024-09-13T06:41:31.311 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:31.311 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.311 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.311 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:31.311 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879264+0000", 2024-09-13T06:41:31.311 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.523e-06 2024-09-13T06:41:31.312 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.312 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.312 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:31.312 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879273+0000", 2024-09-13T06:41:31.312 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6070000000000008e-06 2024-09-13T06:41:31.312 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.312 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.312 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:31.312 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879280+0000", 2024-09-13T06:41:31.312 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.4699999999999996e-06 2024-09-13T06:41:31.312 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.312 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.312 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:31.313 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.981060+0000", 2024-09-13T06:41:31.313 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10177934800000001 2024-09-13T06:41:31.313 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.313 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.313 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:31.313 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.981174+0000", 2024-09-13T06:41:31.313 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000114456 2024-09-13T06:41:31.313 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.313 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.313 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:31.313 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.981319+0000", 2024-09-13T06:41:31.313 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00014473900000000001 2024-09-13T06:41:31.313 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:31.313 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:31.314 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:31.314 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.314 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.314 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18810 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 2662400~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:41:31.314 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.880386+0000", 2024-09-13T06:41:31.314 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 99.353092782999994, 2024-09-13T06:41:31.314 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101728022, 2024-09-13T06:41:31.314 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:31.314 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:31.314 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:31.314 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:31.314 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:31.314 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18810 2024-09-13T06:41:31.315 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.315 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:31.315 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.315 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:31.315 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880386+0000", 2024-09-13T06:41:31.315 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:31.315 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.315 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.315 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:31.315 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880386+0000", 2024-09-13T06:41:31.315 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:31.315 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.315 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.315 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:31.316 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880385+0000", 2024-09-13T06:41:31.316 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:31.316 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.316 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.316 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:31.316 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880389+0000", 2024-09-13T06:41:31.316 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.8539999999999999e-06 2024-09-13T06:41:31.316 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.316 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.316 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:31.316 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880398+0000", 2024-09-13T06:41:31.316 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.1689999999999998e-06 2024-09-13T06:41:31.317 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.317 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.317 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:31.317 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880405+0000", 2024-09-13T06:41:31.317 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5700000000000004e-06 2024-09-13T06:41:31.317 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.317 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.317 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:31.317 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.981833+0000", 2024-09-13T06:41:31.317 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10142791800000001 2024-09-13T06:41:31.317 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.317 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.317 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:31.317 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.981973+0000", 2024-09-13T06:41:31.318 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00014002900000000001 2024-09-13T06:41:31.318 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.318 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.318 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:31.318 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.982114+0000", 2024-09-13T06:41:31.318 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000140276 2024-09-13T06:41:31.318 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:31.318 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:31.318 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:31.318 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.318 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.318 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18811 3.9 3.140f5209 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:41:31.318 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.880449+0000", 2024-09-13T06:41:31.319 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 99.353029406999994, 2024-09-13T06:41:31.319 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101739355, 2024-09-13T06:41:31.319 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:31.319 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:41:31.319 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:31.319 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:31.319 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:31.319 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18811 2024-09-13T06:41:31.319 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.319 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:31.319 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.319 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:31.319 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880449+0000", 2024-09-13T06:41:31.320 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:31.320 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.320 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.320 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:31.320 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880449+0000", 2024-09-13T06:41:31.320 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:31.320 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.320 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.320 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:31.320 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880448+0000", 2024-09-13T06:41:31.320 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:31.320 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.320 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.320 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:31.321 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880452+0000", 2024-09-13T06:41:31.321 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0470000000000004e-06 2024-09-13T06:41:31.321 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.321 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.321 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:31.321 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880462+0000", 2024-09-13T06:41:31.321 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6530000000000006e-06 2024-09-13T06:41:31.321 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.321 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.321 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:31.321 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880472+0000", 2024-09-13T06:41:31.321 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0027000000000001e-05 2024-09-13T06:41:31.321 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.322 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.322 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:31.322 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.982172+0000", 2024-09-13T06:41:31.322 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10170043500000001 2024-09-13T06:41:31.322 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.322 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.322 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:31.322 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.982188+0000", 2024-09-13T06:41:31.322 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6172999999999999e-05 2024-09-13T06:41:31.322 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:31.322 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:31.322 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:31.323 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.323 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.323 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18812 3.9 3.140f5209 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:41:31.323 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.880478+0000", 2024-09-13T06:41:31.323 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 99.353000170000001, 2024-09-13T06:41:31.323 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10177795100000001, 2024-09-13T06:41:31.323 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:31.323 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:41:31.323 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:31.323 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:31.323 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:31.323 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18812 2024-09-13T06:41:31.323 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.324 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:31.324 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.324 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:31.324 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880478+0000", 2024-09-13T06:41:31.324 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:31.324 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.324 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.324 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:31.324 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880478+0000", 2024-09-13T06:41:31.324 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:31.324 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.324 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.324 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:31.325 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880477+0000", 2024-09-13T06:41:31.325 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:31.325 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.325 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.325 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:31.325 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880481+0000", 2024-09-13T06:41:31.325 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.827e-06 2024-09-13T06:41:31.325 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.325 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.325 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:31.325 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880490+0000", 2024-09-13T06:41:31.325 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6100000000000006e-06 2024-09-13T06:41:31.325 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.325 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.326 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:31.326 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880497+0000", 2024-09-13T06:41:31.326 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.7030000000000006e-06 2024-09-13T06:41:31.326 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.326 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.326 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:31.326 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.982241+0000", 2024-09-13T06:41:31.326 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10174351199999999 2024-09-13T06:41:31.326 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.326 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.326 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:31.326 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.982256+0000", 2024-09-13T06:41:31.326 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5143000000000001e-05 2024-09-13T06:41:31.327 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:31.327 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:31.327 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:31.327 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:31.327 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:31.327 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:41:31.328 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-13T06:41:31.329 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:41:31.326+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:41:31.419 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-13T06:41:31.459 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:41:31.460 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [], 2024-09-13T06:41:31.460 INFO:teuthology.orchestra.run.smithi139.stdout: "num_ops": 0 2024-09-13T06:41:31.460 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:41:31.466 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:41:31.466+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:41:31.474 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-13T06:41:31.530 INFO:tasks.ceph.osd.6.smithi139.stderr:2024-09-13T06:41:31.527+0000 7fcd02c5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26385) UID: 0 2024-09-13T06:41:31.594 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:41:31.595 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [], 2024-09-13T06:41:31.595 INFO:teuthology.orchestra.run.smithi139.stdout: "complaint_time": 30, 2024-09-13T06:41:31.595 INFO:teuthology.orchestra.run.smithi139.stdout: "num_blocked_ops": 0 2024-09-13T06:41:31.595 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:41:31.608 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-13T06:41:31.652 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:41:31.651+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:41:31.732 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:41:31.730+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:41:31.781 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:41:31.781 INFO:teuthology.orchestra.run.smithi139.stdout: "size": 20, 2024-09-13T06:41:31.781 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 600, 2024-09-13T06:41:31.781 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [ 2024-09-13T06:41:31.781 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.781 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43282 3.1d 3:bd80bfb3:::rbd_object_map.11212f44bfb1.0000000000000020:head [call rbd.object_map_update in=20b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:31.781 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589032+0000", 2024-09-13T06:41:31.781 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 70.189426276000006, 2024-09-13T06:41:31.781 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.076225263000000001, 2024-09-13T06:41:31.781 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:31.781 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:41:31.782 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:31.782 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:31.782 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:31.782 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43282 2024-09-13T06:41:31.782 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.782 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:31.782 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.782 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:31.782 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589032+0000", 2024-09-13T06:41:31.782 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:31.782 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.782 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.782 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:31.783 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589032+0000", 2024-09-13T06:41:31.783 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:31.783 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.783 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.783 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:31.783 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589031+0000", 2024-09-13T06:41:31.783 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:31.783 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.783 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.783 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:31.783 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589036+0000", 2024-09-13T06:41:31.783 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.2619999999999998e-06 2024-09-13T06:41:31.784 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.784 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.784 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:31.784 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589046+0000", 2024-09-13T06:41:31.784 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.8099999999999992e-06 2024-09-13T06:41:31.784 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.784 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.784 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:31.784 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589054+0000", 2024-09-13T06:41:31.784 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.2230000000000007e-06 2024-09-13T06:41:31.784 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.784 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.784 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:31.785 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.660691+0000", 2024-09-13T06:41:31.785 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.07163659 2024-09-13T06:41:31.785 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.785 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.785 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:31.785 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.660850+0000", 2024-09-13T06:41:31.785 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00015864300000000001 2024-09-13T06:41:31.785 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.785 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.785 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 4", 2024-09-13T06:41:31.785 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.661729+0000", 2024-09-13T06:41:31.785 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00087956099999999995 2024-09-13T06:41:31.785 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.785 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.786 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:41:31.786 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.664409+0000", 2024-09-13T06:41:31.786 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0026803479999999999 2024-09-13T06:41:31.786 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.786 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.786 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-13T06:41:31.786 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.665088+0000", 2024-09-13T06:41:31.786 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00067901400000000003 2024-09-13T06:41:31.786 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.786 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.786 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-13T06:41:31.786 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.665181+0000", 2024-09-13T06:41:31.786 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.2050000000000001e-05 2024-09-13T06:41:31.787 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.787 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.787 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:31.787 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.665257+0000", 2024-09-13T06:41:31.787 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.6698000000000003e-05 2024-09-13T06:41:31.787 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:31.787 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:31.787 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:31.787 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.787 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.787 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43290 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 299008~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:31.787 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589500+0000", 2024-09-13T06:41:31.787 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 70.188958114000002, 2024-09-13T06:41:31.788 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.075898564000000002, 2024-09-13T06:41:31.788 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:31.788 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:31.788 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:31.788 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:31.788 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:31.788 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43290 2024-09-13T06:41:31.788 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.788 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:31.788 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.788 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:31.788 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589500+0000", 2024-09-13T06:41:31.788 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:31.789 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.789 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.789 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:31.789 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589500+0000", 2024-09-13T06:41:31.789 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:31.789 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.789 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.789 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:31.789 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589499+0000", 2024-09-13T06:41:31.789 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:31.789 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.789 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.789 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:31.790 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589503+0000", 2024-09-13T06:41:31.790 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.8330000000000004e-06 2024-09-13T06:41:31.790 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.790 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.790 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:31.790 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589511+0000", 2024-09-13T06:41:31.790 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.3359999999999995e-06 2024-09-13T06:41:31.790 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.790 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.790 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:31.790 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589519+0000", 2024-09-13T06:41:31.790 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.4760000000000001e-06 2024-09-13T06:41:31.790 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.790 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.791 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:31.791 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.665097+0000", 2024-09-13T06:41:31.791 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.075577828999999999 2024-09-13T06:41:31.791 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.791 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.791 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:31.791 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.665170+0000", 2024-09-13T06:41:31.791 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.3745000000000006e-05 2024-09-13T06:41:31.791 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.791 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.791 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:31.791 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.665399+0000", 2024-09-13T06:41:31.791 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00022826199999999999 2024-09-13T06:41:31.791 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:31.792 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:31.792 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:31.792 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.792 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.792 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43291 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 313344~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:31.792 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589560+0000", 2024-09-13T06:41:31.792 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 70.188897893000004, 2024-09-13T06:41:31.792 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.076145594999999996, 2024-09-13T06:41:31.792 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:31.792 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:31.792 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:31.792 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:31.792 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:31.793 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43291 2024-09-13T06:41:31.793 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.793 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:31.793 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.793 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:31.793 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589560+0000", 2024-09-13T06:41:31.793 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:31.793 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.793 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.794 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:31.794 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589560+0000", 2024-09-13T06:41:31.794 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:31.794 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.794 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.794 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:31.794 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589559+0000", 2024-09-13T06:41:31.794 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:31.794 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.794 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.794 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:31.794 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589564+0000", 2024-09-13T06:41:31.794 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.3989999999999997e-06 2024-09-13T06:41:31.794 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.795 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.795 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:31.795 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589574+0000", 2024-09-13T06:41:31.795 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0502999999999999e-05 2024-09-13T06:41:31.795 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.795 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.795 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:31.795 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589582+0000", 2024-09-13T06:41:31.795 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.1859999999999992e-06 2024-09-13T06:41:31.795 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.795 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.795 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:31.795 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.665423+0000", 2024-09-13T06:41:31.796 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.075840290000000005 2024-09-13T06:41:31.796 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.796 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.796 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:31.796 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.665496+0000", 2024-09-13T06:41:31.796 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.2791000000000002e-05 2024-09-13T06:41:31.796 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.796 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.796 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:31.796 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.665706+0000", 2024-09-13T06:41:31.796 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00021038200000000001 2024-09-13T06:41:31.796 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:31.796 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:31.797 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:31.797 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.797 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.797 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43292 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 327680~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:31.797 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589589+0000", 2024-09-13T06:41:31.797 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 70.188869351999998, 2024-09-13T06:41:31.797 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.076769537999999998, 2024-09-13T06:41:31.797 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:31.797 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:31.797 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:31.797 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:31.797 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:31.797 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43292 2024-09-13T06:41:31.797 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.798 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:31.798 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.798 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:31.798 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589589+0000", 2024-09-13T06:41:31.798 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:31.798 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.798 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.798 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:31.798 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589589+0000", 2024-09-13T06:41:31.798 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:31.798 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.798 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.798 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:31.799 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589588+0000", 2024-09-13T06:41:31.799 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:31.799 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.799 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.799 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:31.799 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589592+0000", 2024-09-13T06:41:31.799 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.6389999999999998e-06 2024-09-13T06:41:31.799 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.799 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.799 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:31.799 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589600+0000", 2024-09-13T06:41:31.799 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.4630000000000001e-06 2024-09-13T06:41:31.799 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.799 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.800 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:31.800 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589608+0000", 2024-09-13T06:41:31.800 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.2359999999999998e-06 2024-09-13T06:41:31.800 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.800 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.800 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:31.800 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.665779+0000", 2024-09-13T06:41:31.800 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.076170924000000001 2024-09-13T06:41:31.800 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.800 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.800 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:31.800 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.665977+0000", 2024-09-13T06:41:31.800 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00019891900000000001 2024-09-13T06:41:31.801 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.801 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.801 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:31.801 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.666358+0000", 2024-09-13T06:41:31.801 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000380963 2024-09-13T06:41:31.801 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:31.801 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:31.801 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:31.801 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.801 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.801 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43293 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 342016~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:31.801 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589616+0000", 2024-09-13T06:41:31.801 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 70.188842457999996, 2024-09-13T06:41:31.801 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.077030083999999999, 2024-09-13T06:41:31.802 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:31.802 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:31.802 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:31.802 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:31.802 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:31.802 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43293 2024-09-13T06:41:31.802 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.802 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:31.802 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.802 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:31.802 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589616+0000", 2024-09-13T06:41:31.802 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:31.802 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.802 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.803 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:31.803 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589616+0000", 2024-09-13T06:41:31.803 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:31.803 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.803 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.803 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:31.803 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589615+0000", 2024-09-13T06:41:31.803 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:31.803 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.803 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.803 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:31.803 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589619+0000", 2024-09-13T06:41:31.803 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.9559999999999999e-06 2024-09-13T06:41:31.804 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.804 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.804 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:31.804 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589627+0000", 2024-09-13T06:41:31.804 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.2490000000000001e-06 2024-09-13T06:41:31.804 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.804 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.804 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:31.804 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589635+0000", 2024-09-13T06:41:31.804 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.96e-06 2024-09-13T06:41:31.804 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.804 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.805 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:31.805 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.666379+0000", 2024-09-13T06:41:31.805 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.076744484000000002 2024-09-13T06:41:31.805 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.805 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.805 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:31.805 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.666454+0000", 2024-09-13T06:41:31.805 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.4623999999999996e-05 2024-09-13T06:41:31.805 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.805 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.805 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:31.805 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.666646+0000", 2024-09-13T06:41:31.805 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00019176999999999999 2024-09-13T06:41:31.806 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:31.806 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:31.806 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:31.806 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.806 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.806 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43294 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 356352~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:31.806 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589681+0000", 2024-09-13T06:41:31.806 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 70.188777142999996, 2024-09-13T06:41:31.806 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.077594648000000002, 2024-09-13T06:41:31.806 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:31.806 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:31.806 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:31.806 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:31.806 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:31.807 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43294 2024-09-13T06:41:31.807 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.807 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:31.807 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.807 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:31.807 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589681+0000", 2024-09-13T06:41:31.807 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:31.807 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.807 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.807 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:31.807 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589681+0000", 2024-09-13T06:41:31.807 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:31.807 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.808 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.808 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:31.808 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589680+0000", 2024-09-13T06:41:31.808 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:31.808 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.808 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.808 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:31.808 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589684+0000", 2024-09-13T06:41:31.808 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.8369999999999999e-06 2024-09-13T06:41:31.808 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.808 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.808 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:31.808 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589693+0000", 2024-09-13T06:41:31.808 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.1020000000000003e-06 2024-09-13T06:41:31.809 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.809 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.809 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:31.809 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589701+0000", 2024-09-13T06:41:31.809 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.8059999999999995e-06 2024-09-13T06:41:31.809 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.809 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.809 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:31.809 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.666714+0000", 2024-09-13T06:41:31.809 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.077013463000000004 2024-09-13T06:41:31.809 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.809 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.809 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:31.810 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.666897+0000", 2024-09-13T06:41:31.810 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000182268 2024-09-13T06:41:31.810 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.810 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.810 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:31.810 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.667276+0000", 2024-09-13T06:41:31.810 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00037907499999999998 2024-09-13T06:41:31.810 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:31.810 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:31.810 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:31.810 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.810 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.810 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43295 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 370688~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:31.811 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589744+0000", 2024-09-13T06:41:31.811 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 70.188713970999999, 2024-09-13T06:41:31.811 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.077854343000000006, 2024-09-13T06:41:31.811 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:31.811 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:31.811 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:31.811 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:31.811 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:31.811 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43295 2024-09-13T06:41:31.811 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.811 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:31.811 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.811 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:31.812 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589744+0000", 2024-09-13T06:41:31.812 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:31.812 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.812 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.812 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:31.812 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589744+0000", 2024-09-13T06:41:31.812 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:31.812 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.812 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.812 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:31.812 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589743+0000", 2024-09-13T06:41:31.812 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:31.812 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.813 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.813 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:31.813 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589747+0000", 2024-09-13T06:41:31.813 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0130000000000004e-06 2024-09-13T06:41:31.813 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.813 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.813 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:31.813 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589756+0000", 2024-09-13T06:41:31.813 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.003e-06 2024-09-13T06:41:31.813 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.813 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.813 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:31.813 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589766+0000", 2024-09-13T06:41:31.814 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.2820000000000002e-06 2024-09-13T06:41:31.814 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.814 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.814 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:31.814 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.667300+0000", 2024-09-13T06:41:31.814 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.077534299000000001 2024-09-13T06:41:31.814 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.814 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.814 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:31.814 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.667372+0000", 2024-09-13T06:41:31.814 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.2393999999999998e-05 2024-09-13T06:41:31.814 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.814 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.814 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:31.815 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.667599+0000", 2024-09-13T06:41:31.815 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000226269 2024-09-13T06:41:31.815 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:31.815 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:31.815 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:31.815 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.815 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.815 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43296 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 385024~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:31.815 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589772+0000", 2024-09-13T06:41:31.815 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 70.188685946999996, 2024-09-13T06:41:31.815 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.078469647000000003, 2024-09-13T06:41:31.815 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:31.815 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:31.816 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:31.816 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:31.816 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:31.816 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43296 2024-09-13T06:41:31.816 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.816 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:31.816 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.816 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:31.816 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589772+0000", 2024-09-13T06:41:31.816 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:31.816 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.816 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.816 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:31.817 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589772+0000", 2024-09-13T06:41:31.817 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:31.817 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.817 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.817 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:31.817 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589771+0000", 2024-09-13T06:41:31.817 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:31.817 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.817 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.817 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:31.817 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589775+0000", 2024-09-13T06:41:31.817 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.8530000000000002e-06 2024-09-13T06:41:31.817 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.818 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.818 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:31.818 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589784+0000", 2024-09-13T06:41:31.818 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.4300000000000006e-06 2024-09-13T06:41:31.818 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.818 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.818 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:31.818 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589791+0000", 2024-09-13T06:41:31.818 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.4660000000000002e-06 2024-09-13T06:41:31.818 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.818 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.818 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:31.818 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.667667+0000", 2024-09-13T06:41:31.819 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.077875697999999993 2024-09-13T06:41:31.819 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.819 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.819 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:31.819 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.667854+0000", 2024-09-13T06:41:31.819 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00018760099999999999 2024-09-13T06:41:31.819 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.819 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.819 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:31.819 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.668242+0000", 2024-09-13T06:41:31.819 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00038750600000000003 2024-09-13T06:41:31.819 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:31.819 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:31.820 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:31.820 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.820 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.820 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43297 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 403456~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:31.820 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589797+0000", 2024-09-13T06:41:31.820 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 70.188661242999999, 2024-09-13T06:41:31.820 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.078756672999999999, 2024-09-13T06:41:31.820 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:31.820 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:31.820 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:31.820 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:31.820 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:31.820 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43297 2024-09-13T06:41:31.821 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.821 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:31.821 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.821 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:31.821 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589797+0000", 2024-09-13T06:41:31.821 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:31.821 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.821 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.821 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:31.821 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589797+0000", 2024-09-13T06:41:31.821 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:31.821 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.821 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.821 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:31.822 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589796+0000", 2024-09-13T06:41:31.822 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:31.822 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.822 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.822 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:31.822 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589800+0000", 2024-09-13T06:41:31.822 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.3230000000000002e-06 2024-09-13T06:41:31.822 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.822 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.822 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:31.822 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589808+0000", 2024-09-13T06:41:31.822 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.2390000000000002e-06 2024-09-13T06:41:31.822 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.822 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.823 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:31.823 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589815+0000", 2024-09-13T06:41:31.823 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.413e-06 2024-09-13T06:41:31.823 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.823 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.823 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:31.823 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.668265+0000", 2024-09-13T06:41:31.823 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.078449873000000003 2024-09-13T06:41:31.823 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.823 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.823 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:31.823 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.668332+0000", 2024-09-13T06:41:31.823 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.7178e-05 2024-09-13T06:41:31.824 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.824 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.824 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:31.824 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.668554+0000", 2024-09-13T06:41:31.824 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00022128600000000001 2024-09-13T06:41:31.824 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:31.824 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:31.824 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:31.824 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.824 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.824 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43298 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 417792~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:31.824 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589821+0000", 2024-09-13T06:41:31.824 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 70.188637120999999, 2024-09-13T06:41:31.825 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.079368660999999993, 2024-09-13T06:41:31.825 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:31.825 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:31.825 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:31.825 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:31.825 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:31.825 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43298 2024-09-13T06:41:31.825 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.825 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:31.825 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.825 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:31.825 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589821+0000", 2024-09-13T06:41:31.825 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:31.826 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.826 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.826 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:31.826 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589821+0000", 2024-09-13T06:41:31.826 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:31.826 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.826 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.826 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:31.826 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589821+0000", 2024-09-13T06:41:31.826 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:31.826 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.826 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.826 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:31.827 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589830+0000", 2024-09-13T06:41:31.827 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.4860000000000003e-06 2024-09-13T06:41:31.827 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.827 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.827 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:31.827 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589839+0000", 2024-09-13T06:41:31.827 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.0159999999999997e-06 2024-09-13T06:41:31.827 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.827 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.827 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:31.827 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589847+0000", 2024-09-13T06:41:31.827 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.6059999999999997e-06 2024-09-13T06:41:31.827 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.827 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.828 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:31.828 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.668620+0000", 2024-09-13T06:41:31.828 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.078773485000000004 2024-09-13T06:41:31.828 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.828 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.828 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:31.828 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.668798+0000", 2024-09-13T06:41:31.828 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000178233 2024-09-13T06:41:31.828 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.828 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.828 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:31.828 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.669190+0000", 2024-09-13T06:41:31.829 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00039143499999999998 2024-09-13T06:41:31.829 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:31.829 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:31.829 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:31.829 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.829 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.829 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43299 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 432128~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:31.829 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589881+0000", 2024-09-13T06:41:31.829 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 70.188577273000007, 2024-09-13T06:41:31.829 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.079693849999999997, 2024-09-13T06:41:31.829 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:31.829 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:31.829 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:31.829 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:31.830 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:31.830 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43299 2024-09-13T06:41:31.830 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.830 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:31.830 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.830 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:31.830 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589881+0000", 2024-09-13T06:41:31.830 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:31.830 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.830 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.830 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:31.830 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589881+0000", 2024-09-13T06:41:31.830 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:31.831 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.831 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.831 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:31.831 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589880+0000", 2024-09-13T06:41:31.831 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:31.831 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.831 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.831 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:31.831 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589884+0000", 2024-09-13T06:41:31.831 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.053e-06 2024-09-13T06:41:31.831 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.831 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.831 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:31.831 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589893+0000", 2024-09-13T06:41:31.832 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.2129999999999997e-06 2024-09-13T06:41:31.832 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.832 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.832 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:31.832 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589901+0000", 2024-09-13T06:41:31.832 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.6399999999999997e-06 2024-09-13T06:41:31.832 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.832 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.832 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:31.832 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.669213+0000", 2024-09-13T06:41:31.832 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.079312074999999996 2024-09-13T06:41:31.832 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.832 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.833 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:31.833 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.669281+0000", 2024-09-13T06:41:31.833 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.8322000000000001e-05 2024-09-13T06:41:31.833 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.833 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.833 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:31.833 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.669575+0000", 2024-09-13T06:41:31.833 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00029349699999999999 2024-09-13T06:41:31.833 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:31.833 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:31.833 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:31.833 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.833 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.834 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43300 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 446464~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:31.834 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589909+0000", 2024-09-13T06:41:31.834 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 70.188549378000005, 2024-09-13T06:41:31.834 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.080339496999999996, 2024-09-13T06:41:31.834 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:31.834 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:31.834 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:31.834 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:31.834 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:31.834 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43300 2024-09-13T06:41:31.834 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.834 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:31.834 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.834 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:31.835 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589909+0000", 2024-09-13T06:41:31.835 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:31.835 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.835 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.835 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:31.835 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589909+0000", 2024-09-13T06:41:31.835 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:31.835 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.835 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.835 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:31.835 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589908+0000", 2024-09-13T06:41:31.835 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:31.835 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.835 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.836 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:31.836 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589912+0000", 2024-09-13T06:41:31.836 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.9430000000000002e-06 2024-09-13T06:41:31.836 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.836 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.836 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:31.836 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589920+0000", 2024-09-13T06:41:31.836 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.3860000000000007e-06 2024-09-13T06:41:31.836 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.836 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.836 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:31.836 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589928+0000", 2024-09-13T06:41:31.836 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.3329999999999999e-06 2024-09-13T06:41:31.837 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.837 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.837 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:31.837 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.669651+0000", 2024-09-13T06:41:31.837 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.079723204000000006 2024-09-13T06:41:31.837 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.837 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.837 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:31.837 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.669840+0000", 2024-09-13T06:41:31.837 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000189397 2024-09-13T06:41:31.837 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.837 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.837 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:31.837 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.670248+0000", 2024-09-13T06:41:31.838 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00040811100000000001 2024-09-13T06:41:31.838 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:31.838 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:31.838 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:31.838 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.838 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.838 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43301 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 460800~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:31.838 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589934+0000", 2024-09-13T06:41:31.838 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 70.188524704000002, 2024-09-13T06:41:31.838 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.080747474999999999, 2024-09-13T06:41:31.838 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:31.838 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:31.838 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:31.839 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:31.839 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:31.839 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43301 2024-09-13T06:41:31.839 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.839 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:31.839 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.839 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:31.839 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589934+0000", 2024-09-13T06:41:31.839 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:31.839 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.839 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.839 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:31.839 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589934+0000", 2024-09-13T06:41:31.840 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:31.840 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.840 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.840 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:31.840 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589933+0000", 2024-09-13T06:41:31.840 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:31.840 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.840 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.840 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:31.840 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589936+0000", 2024-09-13T06:41:31.840 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.4599999999999999e-06 2024-09-13T06:41:31.840 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.840 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.840 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:31.841 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589945+0000", 2024-09-13T06:41:31.841 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.2430000000000005e-06 2024-09-13T06:41:31.841 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.841 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.841 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:31.841 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589952+0000", 2024-09-13T06:41:31.841 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.3289999999999996e-06 2024-09-13T06:41:31.841 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.841 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.841 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:31.841 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.670280+0000", 2024-09-13T06:41:31.841 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.080328514000000004 2024-09-13T06:41:31.841 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.842 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.842 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:31.842 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.670376+0000", 2024-09-13T06:41:31.842 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.5752000000000001e-05 2024-09-13T06:41:31.842 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.842 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.842 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:31.842 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.670681+0000", 2024-09-13T06:41:31.842 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00030479699999999999 2024-09-13T06:41:31.842 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:31.842 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:31.842 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:31.842 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.842 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.843 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43302 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 475136~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:31.843 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589958+0000", 2024-09-13T06:41:31.843 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 70.188500641999994, 2024-09-13T06:41:31.843 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.081402394000000003, 2024-09-13T06:41:31.843 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:31.843 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:31.843 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:31.843 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:31.843 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:31.843 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43302 2024-09-13T06:41:31.843 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.843 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:31.843 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.844 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:31.844 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589958+0000", 2024-09-13T06:41:31.844 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:31.844 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.844 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.844 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:31.844 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589958+0000", 2024-09-13T06:41:31.844 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:31.844 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.844 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.844 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:31.844 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589957+0000", 2024-09-13T06:41:31.844 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:31.845 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.845 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.845 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:31.845 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589960+0000", 2024-09-13T06:41:31.845 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.4939999999999999e-06 2024-09-13T06:41:31.845 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.845 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.845 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:31.845 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589969+0000", 2024-09-13T06:41:31.845 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.3520000000000007e-06 2024-09-13T06:41:31.845 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.845 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.845 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:31.846 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589976+0000", 2024-09-13T06:41:31.846 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.3030000000000002e-06 2024-09-13T06:41:31.846 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.846 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.846 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:31.846 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.670765+0000", 2024-09-13T06:41:31.846 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.080789154000000002 2024-09-13T06:41:31.846 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.846 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.846 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:31.846 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.670960+0000", 2024-09-13T06:41:31.846 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00019464300000000001 2024-09-13T06:41:31.846 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.846 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.847 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:31.847 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.671360+0000", 2024-09-13T06:41:31.847 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00040005200000000002 2024-09-13T06:41:31.847 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:31.847 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:31.847 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:31.847 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.847 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.847 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43303 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 489472~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:31.847 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589985+0000", 2024-09-13T06:41:31.847 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 70.188473693999995, 2024-09-13T06:41:31.847 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.082024333000000005, 2024-09-13T06:41:31.847 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:31.847 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:31.848 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:31.848 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:31.848 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:31.848 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43303 2024-09-13T06:41:31.848 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.848 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:31.848 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.848 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:31.848 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589985+0000", 2024-09-13T06:41:31.848 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:31.848 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.848 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.848 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:31.848 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589985+0000", 2024-09-13T06:41:31.849 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:31.849 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.849 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.849 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:31.849 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589984+0000", 2024-09-13T06:41:31.849 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:31.849 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.849 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.849 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:31.849 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589987+0000", 2024-09-13T06:41:31.849 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.726e-06 2024-09-13T06:41:31.849 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.849 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.850 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:31.850 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589996+0000", 2024-09-13T06:41:31.850 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.5459999999999992e-06 2024-09-13T06:41:31.850 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.850 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.850 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:31.850 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590003+0000", 2024-09-13T06:41:31.850 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.4229999999999999e-06 2024-09-13T06:41:31.850 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.850 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.850 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:31.850 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.671426+0000", 2024-09-13T06:41:31.850 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.081422704999999998 2024-09-13T06:41:31.850 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.851 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.851 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:31.851 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.671615+0000", 2024-09-13T06:41:31.851 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000188875 2024-09-13T06:41:31.851 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.851 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.851 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:31.851 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.672009+0000", 2024-09-13T06:41:31.851 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000394015 2024-09-13T06:41:31.851 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:31.851 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:31.851 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:31.851 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.852 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.852 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43304 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 503808~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:31.852 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.590039+0000", 2024-09-13T06:41:31.852 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 70.188419148999998, 2024-09-13T06:41:31.852 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.082573880000000002, 2024-09-13T06:41:31.852 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:31.852 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:31.852 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:31.852 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:31.852 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:31.852 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43304 2024-09-13T06:41:31.852 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.852 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:31.852 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.853 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:31.853 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590039+0000", 2024-09-13T06:41:31.853 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:31.853 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.853 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.853 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:31.853 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590039+0000", 2024-09-13T06:41:31.853 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:31.853 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.853 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.853 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:31.853 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590038+0000", 2024-09-13T06:41:31.853 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:31.854 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.854 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.854 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:31.854 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590042+0000", 2024-09-13T06:41:31.854 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.9500000000000003e-06 2024-09-13T06:41:31.854 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.854 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.854 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:31.854 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590052+0000", 2024-09-13T06:41:31.854 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.3919999999999992e-06 2024-09-13T06:41:31.854 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.854 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.854 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:31.855 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590059+0000", 2024-09-13T06:41:31.855 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.7970000000000001e-06 2024-09-13T06:41:31.855 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.855 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.855 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:31.855 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.672078+0000", 2024-09-13T06:41:31.855 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.082018778000000001 2024-09-13T06:41:31.855 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.855 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.855 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:31.855 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.672266+0000", 2024-09-13T06:41:31.855 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00018807399999999999 2024-09-13T06:41:31.855 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.856 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.856 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:31.856 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.672613+0000", 2024-09-13T06:41:31.856 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00034677599999999997 2024-09-13T06:41:31.856 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:31.856 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:31.856 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:31.856 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.856 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.856 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43305 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 518144~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:31.856 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.590136+0000", 2024-09-13T06:41:31.856 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 70.188321961, 2024-09-13T06:41:31.856 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.082988206999999994, 2024-09-13T06:41:31.857 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:31.857 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:31.857 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:31.857 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:31.857 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:31.857 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43305 2024-09-13T06:41:31.857 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.857 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:31.857 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.857 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:31.857 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590136+0000", 2024-09-13T06:41:31.857 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:31.857 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.857 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.858 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:31.858 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590136+0000", 2024-09-13T06:41:31.858 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:31.858 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.858 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.858 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:31.858 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590135+0000", 2024-09-13T06:41:31.858 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:31.858 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.858 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.858 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:31.858 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590139+0000", 2024-09-13T06:41:31.858 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.9489999999999998e-06 2024-09-13T06:41:31.858 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.859 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.859 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:31.859 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590148+0000", 2024-09-13T06:41:31.859 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.9830000000000002e-06 2024-09-13T06:41:31.859 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.859 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.859 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:31.859 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590156+0000", 2024-09-13T06:41:31.859 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5229999999999998e-06 2024-09-13T06:41:31.859 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.859 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.859 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:31.859 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.672709+0000", 2024-09-13T06:41:31.860 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.082552886000000006 2024-09-13T06:41:31.860 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.860 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.860 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:31.860 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.672816+0000", 2024-09-13T06:41:31.860 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000107736 2024-09-13T06:41:31.860 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.860 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.860 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:31.860 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.673124+0000", 2024-09-13T06:41:31.860 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00030804900000000002 2024-09-13T06:41:31.860 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:31.860 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:31.861 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:31.861 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.861 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.861 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:66818 3.17 3.50afe697 (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e100)", 2024-09-13T06:41:31.861 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:53.498942+0000", 2024-09-13T06:41:31.861 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 38.279515775999997, 2024-09-13T06:41:31.861 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.011231284, 2024-09-13T06:41:31.861 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:31.861 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:41:31.861 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:31.861 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:31.861 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:31.861 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 66818 2024-09-13T06:41:31.862 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.862 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:31.862 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.862 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:31.862 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:53.498942+0000", 2024-09-13T06:41:31.862 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:31.862 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.862 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.862 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:31.862 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:53.498942+0000", 2024-09-13T06:41:31.862 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:31.862 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.862 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.863 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:31.863 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:53.498939+0000", 2024-09-13T06:41:31.863 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999967 2024-09-13T06:41:31.863 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.863 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.863 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:31.863 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:53.498954+0000", 2024-09-13T06:41:31.863 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5028000000000001e-05 2024-09-13T06:41:31.863 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.863 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.863 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:31.863 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:53.498986+0000", 2024-09-13T06:41:31.863 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.1993999999999999e-05 2024-09-13T06:41:31.863 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.864 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.864 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:31.864 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:53.499001+0000", 2024-09-13T06:41:31.864 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5166e-05 2024-09-13T06:41:31.864 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.864 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.864 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:31.864 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:53.505097+0000", 2024-09-13T06:41:31.864 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0060955610000000002 2024-09-13T06:41:31.864 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.864 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.864 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:41:31.864 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:53.505108+0000", 2024-09-13T06:41:31.865 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.084e-05 2024-09-13T06:41:31.865 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.865 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.865 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:31.865 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:54.510158+0000", 2024-09-13T06:41:31.865 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0050497549999999 2024-09-13T06:41:31.865 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.865 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.865 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:31.865 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:54.510174+0000", 2024-09-13T06:41:31.865 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6164e-05 2024-09-13T06:41:31.865 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:31.865 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:31.866 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:31.866 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.866 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.866 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:69764 3.2 3:47f10058:::rbd_data.11214956a993.0000000000000004:head [write-same] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e117)", 2024-09-13T06:41:31.866 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:41:11.371147+0000", 2024-09-13T06:41:31.866 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 20.407311465999999, 2024-09-13T06:41:31.866 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.03470167, 2024-09-13T06:41:31.866 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:31.866 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:41:31.866 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:31.866 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:31.866 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:31.866 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 69764 2024-09-13T06:41:31.866 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.867 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:31.867 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.867 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:31.867 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:11.371147+0000", 2024-09-13T06:41:31.867 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:31.867 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.867 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.867 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:31.867 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:11.371147+0000", 2024-09-13T06:41:31.867 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:31.867 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.867 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.867 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:31.868 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:11.371144+0000", 2024-09-13T06:41:31.868 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999967 2024-09-13T06:41:31.868 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.868 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.868 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:31.868 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:11.371161+0000", 2024-09-13T06:41:31.868 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7669e-05 2024-09-13T06:41:31.868 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.868 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.868 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:31.868 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:11.371198+0000", 2024-09-13T06:41:31.868 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.7014000000000002e-05 2024-09-13T06:41:31.868 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.868 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.869 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:31.869 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:11.371216+0000", 2024-09-13T06:41:31.869 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7425e-05 2024-09-13T06:41:31.869 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.869 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.869 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:31.869 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:11.371365+0000", 2024-09-13T06:41:31.869 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000149245 2024-09-13T06:41:31.869 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.869 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.869 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op must wait for map", 2024-09-13T06:41:31.869 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:11.371385+0000", 2024-09-13T06:41:31.869 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.0018999999999999e-05 2024-09-13T06:41:31.870 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.870 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.870 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:31.870 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:11.378406+0000", 2024-09-13T06:41:31.870 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0070207179999999996 2024-09-13T06:41:31.870 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.870 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.870 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:41:31.870 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:11.378429+0000", 2024-09-13T06:41:31.870 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.3453999999999999e-05 2024-09-13T06:41:31.870 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.870 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.870 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:31.871 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:12.405667+0000", 2024-09-13T06:41:31.871 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0272381690000001 2024-09-13T06:41:31.871 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.871 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.871 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:31.871 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:12.405848+0000", 2024-09-13T06:41:31.871 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00018112 2024-09-13T06:41:31.871 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:31.871 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:31.871 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:31.871 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.871 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.871 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:70346 3.16 3:69d35907:::rbd_object_map.11214956a993:head [read 0~36] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e122)", 2024-09-13T06:41:31.871 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:41:16.390917+0000", 2024-09-13T06:41:31.872 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 15.387541413999999, 2024-09-13T06:41:31.872 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.99327479799999996, 2024-09-13T06:41:31.872 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:31.872 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:31.872 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:31.872 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:31.872 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:31.872 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 70346 2024-09-13T06:41:31.872 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.872 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:31.872 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.872 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:31.872 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:16.390917+0000", 2024-09-13T06:41:31.873 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:31.873 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.873 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.873 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:31.873 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:16.390917+0000", 2024-09-13T06:41:31.873 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:31.873 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.873 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.873 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:31.873 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:16.390916+0000", 2024-09-13T06:41:31.873 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999986 2024-09-13T06:41:31.873 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.873 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.874 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:31.874 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:16.390922+0000", 2024-09-13T06:41:31.874 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.0480000000000004e-06 2024-09-13T06:41:31.874 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.874 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.874 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:31.874 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:16.390933+0000", 2024-09-13T06:41:31.874 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1387e-05 2024-09-13T06:41:31.874 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.874 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.874 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:31.874 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:16.390939+0000", 2024-09-13T06:41:31.874 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.8039999999999998e-06 2024-09-13T06:41:31.875 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.875 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.875 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:31.875 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:16.390983+0000", 2024-09-13T06:41:31.875 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.4663000000000003e-05 2024-09-13T06:41:31.875 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.875 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.875 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:41:31.875 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:16.390991+0000", 2024-09-13T06:41:31.875 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.8059999999999995e-06 2024-09-13T06:41:31.875 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.875 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.875 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:31.876 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:17.383624+0000", 2024-09-13T06:41:31.876 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.99263277299999997 2024-09-13T06:41:31.876 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.876 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.876 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:31.876 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:17.383891+0000", 2024-09-13T06:41:31.876 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00026717599999999999 2024-09-13T06:41:31.876 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:31.876 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:31.876 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:31.876 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:17.384192+0000", 2024-09-13T06:41:31.876 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00030047400000000001 2024-09-13T06:41:31.876 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:31.876 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:31.877 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:31.877 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:31.877 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:31.877 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:41:31.878 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-13T06:41:31.879 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:41:31.878+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:41:31.979 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:41:31.978+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:41:32.004 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:41:32.004 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [], 2024-09-13T06:41:32.005 INFO:teuthology.orchestra.run.smithi139.stdout: "num_ops": 0 2024-09-13T06:41:32.005 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:41:32.018 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-13T06:41:32.081 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:41:32.078+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:41:32.140 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:41:32.140 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [], 2024-09-13T06:41:32.140 INFO:teuthology.orchestra.run.smithi139.stdout: "complaint_time": 30, 2024-09-13T06:41:32.140 INFO:teuthology.orchestra.run.smithi139.stdout: "num_blocked_ops": 0 2024-09-13T06:41:32.140 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:41:32.154 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-13T06:41:32.181 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:41:32.178+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:41:32.232 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-13T06:41:32.273 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:41:32.273 INFO:teuthology.orchestra.run.smithi139.stdout: "size": 20, 2024-09-13T06:41:32.274 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 600, 2024-09-13T06:41:32.274 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [ 2024-09-13T06:41:32.274 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:32.274 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27854 3.a 3:537b3559:::rbd_data.1121f2c5ee81.0000000000000016:13 [read 335872~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:32.274 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.658750+0000", 2024-09-13T06:41:32.274 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 95.612894574999999, 2024-09-13T06:41:32.274 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.037969532, 2024-09-13T06:41:32.274 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:32.274 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:32.274 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:32.274 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:32.274 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:32.274 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27854 2024-09-13T06:41:32.275 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:32.275 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:32.275 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:32.275 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:32.275 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658750+0000", 2024-09-13T06:41:32.275 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:32.275 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:32.275 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:32.275 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:32.275 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658750+0000", 2024-09-13T06:41:32.275 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:32.275 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:32.275 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:32.276 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:32.276 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658749+0000", 2024-09-13T06:41:32.276 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:32.276 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:32.276 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:32.276 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:32.276 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658757+0000", 2024-09-13T06:41:32.276 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.7389999999999999e-06 2024-09-13T06:41:32.276 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:32.276 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:32.276 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:32.276 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658763+0000", 2024-09-13T06:41:32.276 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.7769999999999999e-06 2024-09-13T06:41:32.277 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:32.277 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:32.277 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:32.277 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658767+0000", 2024-09-13T06:41:32.277 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.1749999999999998e-06 2024-09-13T06:41:32.277 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:32.277 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:32.277 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:32.277 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.696322+0000", 2024-09-13T06:41:32.277 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.037554772 2024-09-13T06:41:32.277 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:32.277 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:32.278 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:32.278 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.696418+0000", 2024-09-13T06:41:32.278 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6050000000000004e-05 2024-09-13T06:41:32.278 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:32.278 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:32.278 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:32.278 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.696719+0000", 2024-09-13T06:41:32.278 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00030138499999999999 2024-09-13T06:41:32.278 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:32.278 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:32.278 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:32.278 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:32.278 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:32.279 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27855 3.a 3:537b3559:::rbd_data.1121f2c5ee81.0000000000000016:13 [read 380928~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:32.279 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.658771+0000", 2024-09-13T06:41:32.279 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 95.612873331000003, 2024-09-13T06:41:32.279 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.038326354, 2024-09-13T06:41:32.279 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:32.279 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:32.279 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:32.279 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:32.279 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:32.279 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27855 2024-09-13T06:41:32.279 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:32.279 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:32.279 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:32.279 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:32.280 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658771+0000", 2024-09-13T06:41:32.280 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:32.280 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:32.280 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:32.280 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:32.280 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658771+0000", 2024-09-13T06:41:32.280 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:32.280 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:32.280 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:32.280 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:32.280 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658770+0000", 2024-09-13T06:41:32.280 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:32.280 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:32.281 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:32.281 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:32.281 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658772+0000", 2024-09-13T06:41:32.281 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.0930000000000001e-06 2024-09-13T06:41:32.281 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:32.281 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:32.281 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:32.281 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658778+0000", 2024-09-13T06:41:32.281 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.2730000000000002e-06 2024-09-13T06:41:32.281 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:32.281 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:32.281 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:32.281 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658782+0000", 2024-09-13T06:41:32.281 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0879999999999997e-06 2024-09-13T06:41:32.282 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:32.282 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:32.282 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:32.282 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.696770+0000", 2024-09-13T06:41:32.282 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.037988145000000001 2024-09-13T06:41:32.282 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:32.282 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:32.282 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:32.282 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.696852+0000", 2024-09-13T06:41:32.282 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.2039999999999994e-05 2024-09-13T06:41:32.282 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:32.282 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:32.282 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:32.283 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.697097+0000", 2024-09-13T06:41:32.283 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00024508800000000002 2024-09-13T06:41:32.283 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:32.283 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:32.283 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:32.283 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:32.283 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:32.283 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27856 3.a 3:537b3559:::rbd_data.1121f2c5ee81.0000000000000016:13 [read 405504~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:32.283 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.658786+0000", 2024-09-13T06:41:32.283 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 95.612858215000003, 2024-09-13T06:41:32.283 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.038736029999999998, 2024-09-13T06:41:32.283 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:32.283 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:32.283 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:32.284 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:32.284 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:32.284 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27856 2024-09-13T06:41:32.284 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:32.284 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:32.284 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:32.284 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:32.284 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658786+0000", 2024-09-13T06:41:32.284 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:32.284 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:32.284 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:32.284 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:32.284 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658786+0000", 2024-09-13T06:41:32.285 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:32.285 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:32.285 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:32.285 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:32.285 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658785+0000", 2024-09-13T06:41:32.285 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:32.285 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:32.285 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:32.285 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:32.285 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658787+0000", 2024-09-13T06:41:32.285 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.0040000000000002e-06 2024-09-13T06:41:32.285 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:32.285 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:32.286 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:32.286 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658793+0000", 2024-09-13T06:41:32.286 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.2410000000000003e-06 2024-09-13T06:41:32.286 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:32.286 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:32.286 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:32.286 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658797+0000", 2024-09-13T06:41:32.286 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.1330000000000001e-06 2024-09-13T06:41:32.286 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:32.286 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:32.286 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:32.286 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.697176+0000", 2024-09-13T06:41:32.286 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.038379074999999999 2024-09-13T06:41:32.287 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:32.287 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:32.287 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:32.287 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.697275+0000", 2024-09-13T06:41:32.287 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.8819000000000004e-05 2024-09-13T06:41:32.287 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:32.287 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:32.287 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:32.287 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.697522+0000", 2024-09-13T06:41:32.287 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00024719999999999999 2024-09-13T06:41:32.287 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:32.287 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:32.287 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:32.288 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:32.288 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:32.288 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27857 3.a 3:537b3559:::rbd_data.1121f2c5ee81.0000000000000016:13 [read 475136~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:32.288 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.658845+0000", 2024-09-13T06:41:32.288 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 95.612799211999999, 2024-09-13T06:41:32.288 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039112570999999999, 2024-09-13T06:41:32.288 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:32.288 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:32.288 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:32.288 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:32.288 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:32.288 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27857 2024-09-13T06:41:32.288 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:32.289 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:32.289 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:32.289 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:32.289 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658845+0000", 2024-09-13T06:41:32.289 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:32.289 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:32.289 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:32.289 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:32.289 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658845+0000", 2024-09-13T06:41:32.289 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:32.289 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:32.289 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:32.289 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:32.290 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658844+0000", 2024-09-13T06:41:32.290 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999986 2024-09-13T06:41:32.290 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:32.290 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:32.290 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:32.290 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658868+0000", 2024-09-13T06:41:32.290 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.4615000000000001e-05 2024-09-13T06:41:32.290 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:32.290 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:32.290 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:32.290 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658884+0000", 2024-09-13T06:41:32.290 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5401999999999999e-05 2024-09-13T06:41:32.290 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:32.290 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:32.291 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:32.291 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658896+0000", 2024-09-13T06:41:32.291 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2509e-05 2024-09-13T06:41:32.291 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:32.291 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:32.291 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:32.291 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.697571+0000", 2024-09-13T06:41:32.291 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.038675107 2024-09-13T06:41:32.291 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:32.291 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:32.291 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:32.291 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.697658+0000", 2024-09-13T06:41:32.291 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6349999999999998e-05 2024-09-13T06:41:32.291 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:32.291 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:32.292 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:32.292 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.697957+0000", 2024-09-13T06:41:32.292 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00029986100000000001 2024-09-13T06:41:32.292 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:32.292 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:32.292 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:32.292 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:32.292 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:32.292 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27858 3.a 3:537b3559:::rbd_data.1121f2c5ee81.0000000000000016:13 [read 499712~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:32.292 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.658905+0000", 2024-09-13T06:41:32.292 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 95.612738661999998, 2024-09-13T06:41:32.292 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039475392999999998, 2024-09-13T06:41:32.292 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:32.292 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:32.293 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:32.293 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:32.293 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:32.293 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27858 2024-09-13T06:41:32.293 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:32.293 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:32.293 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:32.293 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:32.293 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658905+0000", 2024-09-13T06:41:32.293 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:32.293 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:32.293 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:32.293 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:32.293 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658905+0000", 2024-09-13T06:41:32.294 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:32.294 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:32.294 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:32.294 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:32.294 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658905+0000", 2024-09-13T06:41:32.294 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:32.294 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:32.294 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:32.294 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:32.294 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658909+0000", 2024-09-13T06:41:32.294 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.831e-06 2024-09-13T06:41:32.294 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:32.294 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:32.294 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:32.295 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658920+0000", 2024-09-13T06:41:32.295 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0936e-05 2024-09-13T06:41:32.295 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:32.295 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:32.295 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:32.295 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658929+0000", 2024-09-13T06:41:32.295 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.2749999999999995e-06 2024-09-13T06:41:32.295 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:32.295 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:32.295 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:32.295 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.697990+0000", 2024-09-13T06:41:32.295 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039061625000000003 2024-09-13T06:41:32.296 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:32.296 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:32.296 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:32.296 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.698077+0000", 2024-09-13T06:41:32.296 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6922000000000006e-05 2024-09-13T06:41:32.296 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:32.296 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:32.296 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:32.296 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.698381+0000", 2024-09-13T06:41:32.296 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00030360599999999999 2024-09-13T06:41:32.296 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:32.296 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:32.296 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:32.296 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:32.297 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:32.297 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27929 3.a 3:537b3559:::rbd_data.1121f2c5ee81.0000000000000016:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:32.297 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.659338+0000", 2024-09-13T06:41:32.297 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 95.612305831, 2024-09-13T06:41:32.297 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039351214000000002, 2024-09-13T06:41:32.297 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:32.297 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:32.297 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:32.297 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:32.297 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:32.297 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27929 2024-09-13T06:41:32.297 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:32.297 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:32.297 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:32.298 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:32.298 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.659338+0000", 2024-09-13T06:41:32.298 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:32.298 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:32.298 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:32.298 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:32.298 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.659338+0000", 2024-09-13T06:41:32.298 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:32.298 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:32.298 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:32.298 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:32.298 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.659337+0000", 2024-09-13T06:41:32.298 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:32.298 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:32.298 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:32.299 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:32.299 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.659342+0000", 2024-09-13T06:41:32.299 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0799999999999999e-06 2024-09-13T06:41:32.299 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:32.299 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:32.299 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:32.299 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.659353+0000", 2024-09-13T06:41:32.299 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1798e-05 2024-09-13T06:41:32.299 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:32.299 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:32.299 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:32.299 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.659361+0000", 2024-09-13T06:41:32.299 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.8040000000000002e-06 2024-09-13T06:41:32.299 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:32.299 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:32.300 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:32.300 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.698449+0000", 2024-09-13T06:41:32.300 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039087519000000001 2024-09-13T06:41:32.300 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:32.300 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:32.300 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:32.300 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.698567+0000", 2024-09-13T06:41:32.300 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00011857 2024-09-13T06:41:32.300 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:32.300 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:32.300 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:32.300 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.698689+0000", 2024-09-13T06:41:32.300 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00012226699999999999 2024-09-13T06:41:32.301 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:32.301 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:32.301 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:32.301 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:32.301 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:32.301 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27974 3.a 3:537b3559:::rbd_data.1121f2c5ee81.0000000000000016:13 [read 32768~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:32.301 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.660102+0000", 2024-09-13T06:41:32.301 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 95.611542063000002, 2024-09-13T06:41:32.301 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.038972346999999997, 2024-09-13T06:41:32.301 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:32.301 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:32.301 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:32.301 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:32.301 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:32.302 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27974 2024-09-13T06:41:32.302 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:32.302 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:32.302 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:32.302 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:32.302 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660102+0000", 2024-09-13T06:41:32.302 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:32.302 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:32.302 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:32.302 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:32.302 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660102+0000", 2024-09-13T06:41:32.302 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:32.302 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:32.302 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:32.303 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:32.303 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660100+0000", 2024-09-13T06:41:32.303 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999976 2024-09-13T06:41:32.303 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:32.303 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:32.303 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:32.303 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660114+0000", 2024-09-13T06:41:32.303 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.4466e-05 2024-09-13T06:41:32.303 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:32.303 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:32.303 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:32.303 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660148+0000", 2024-09-13T06:41:32.303 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.3742999999999999e-05 2024-09-13T06:41:32.304 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:32.304 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:32.304 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:32.304 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660170+0000", 2024-09-13T06:41:32.304 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.2518e-05 2024-09-13T06:41:32.304 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:32.304 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:32.304 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:32.304 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.698719+0000", 2024-09-13T06:41:32.304 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.038548529999999998 2024-09-13T06:41:32.304 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:32.304 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:32.304 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:32.304 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.698806+0000", 2024-09-13T06:41:32.305 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.7179e-05 2024-09-13T06:41:32.305 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:32.305 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:32.305 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:32.305 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.699074+0000", 2024-09-13T06:41:32.305 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00026834800000000001 2024-09-13T06:41:32.305 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:32.305 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:32.305 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:32.305 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:32.305 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:32.305 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27975 3.a 3:537b3559:::rbd_data.1121f2c5ee81.0000000000000016:13 [read 57344~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:32.305 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.660189+0000", 2024-09-13T06:41:32.306 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 95.611455219000007, 2024-09-13T06:41:32.306 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039288678, 2024-09-13T06:41:32.306 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:32.306 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:32.306 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:32.306 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:32.306 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:32.306 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27975 2024-09-13T06:41:32.306 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:32.306 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:32.306 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:32.306 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:32.306 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660189+0000", 2024-09-13T06:41:32.306 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:32.306 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:32.307 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:32.307 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:32.307 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660189+0000", 2024-09-13T06:41:32.307 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:32.307 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:32.307 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:32.307 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:32.307 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660187+0000", 2024-09-13T06:41:32.307 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999981 2024-09-13T06:41:32.307 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:32.307 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:32.307 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:32.307 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660195+0000", 2024-09-13T06:41:32.307 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5610000000000001e-06 2024-09-13T06:41:32.307 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:32.308 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:32.308 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:32.308 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660212+0000", 2024-09-13T06:41:32.308 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7725999999999999e-05 2024-09-13T06:41:32.308 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:32.308 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:32.308 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:32.308 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660227+0000", 2024-09-13T06:41:32.308 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.43e-05 2024-09-13T06:41:32.308 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:32.308 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:32.308 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:32.308 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.699135+0000", 2024-09-13T06:41:32.309 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.038908336000000002 2024-09-13T06:41:32.309 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:32.309 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:32.309 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:32.309 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.699208+0000", 2024-09-13T06:41:32.309 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.3065000000000006e-05 2024-09-13T06:41:32.309 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:32.309 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:32.309 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:32.309 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.699478+0000", 2024-09-13T06:41:32.309 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00026946899999999999 2024-09-13T06:41:32.309 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:32.309 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:32.310 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:32.310 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:32.310 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:32.310 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27976 3.a 3:537b3559:::rbd_data.1121f2c5ee81.0000000000000016:13 [read 102400~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:32.310 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.660238+0000", 2024-09-13T06:41:32.310 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 95.611406056000007, 2024-09-13T06:41:32.310 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039636515999999997, 2024-09-13T06:41:32.310 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:32.310 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:32.311 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:32.311 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:32.311 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:32.311 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27976 2024-09-13T06:41:32.311 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:32.311 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:32.311 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:32.311 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:32.311 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660238+0000", 2024-09-13T06:41:32.311 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:32.311 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:32.311 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:32.311 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:32.312 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660238+0000", 2024-09-13T06:41:32.312 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:32.312 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:32.312 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:32.312 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:32.312 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660237+0000", 2024-09-13T06:41:32.312 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:32.312 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:32.312 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:32.312 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:32.312 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660243+0000", 2024-09-13T06:41:32.312 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.9909999999999999e-06 2024-09-13T06:41:32.312 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:32.313 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:32.313 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:32.313 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660259+0000", 2024-09-13T06:41:32.313 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6294e-05 2024-09-13T06:41:32.313 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:32.313 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:32.313 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:32.313 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660272+0000", 2024-09-13T06:41:32.313 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2714999999999999e-05 2024-09-13T06:41:32.313 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:32.313 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:32.313 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:32.313 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.699513+0000", 2024-09-13T06:41:32.313 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039240932999999999 2024-09-13T06:41:32.314 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:32.314 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:32.314 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:32.314 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.699604+0000", 2024-09-13T06:41:32.314 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.1367999999999997e-05 2024-09-13T06:41:32.314 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:32.314 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:32.314 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:32.314 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.699875+0000", 2024-09-13T06:41:32.314 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00027029499999999999 2024-09-13T06:41:32.314 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:32.314 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:32.314 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:32.315 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:32.315 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:32.315 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27977 3.a 3:537b3559:::rbd_data.1121f2c5ee81.0000000000000016:13 [read 126976~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:32.315 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.660284+0000", 2024-09-13T06:41:32.315 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 95.611360484000002, 2024-09-13T06:41:32.315 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039969945, 2024-09-13T06:41:32.315 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:32.315 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:32.315 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:32.315 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:32.315 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:32.315 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27977 2024-09-13T06:41:32.315 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:32.315 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:32.316 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:32.316 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:32.316 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660284+0000", 2024-09-13T06:41:32.316 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:32.316 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:32.316 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:32.316 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:32.316 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660284+0000", 2024-09-13T06:41:32.316 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:32.316 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:32.316 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:32.316 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:32.316 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660282+0000", 2024-09-13T06:41:32.316 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999986 2024-09-13T06:41:32.317 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:32.317 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:32.317 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:32.317 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660288+0000", 2024-09-13T06:41:32.317 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.2650000000000002e-06 2024-09-13T06:41:32.317 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:32.317 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:32.317 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:32.317 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660304+0000", 2024-09-13T06:41:32.317 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5430999999999998e-05 2024-09-13T06:41:32.317 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:32.317 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:32.317 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:32.317 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660316+0000", 2024-09-13T06:41:32.318 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.237e-05 2024-09-13T06:41:32.318 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:32.318 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:32.318 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:32.318 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.699907+0000", 2024-09-13T06:41:32.318 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039590735000000002 2024-09-13T06:41:32.318 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:32.318 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:32.318 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:32.318 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.699994+0000", 2024-09-13T06:41:32.318 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6996999999999994e-05 2024-09-13T06:41:32.318 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:32.318 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:32.318 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:32.318 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700254+0000", 2024-09-13T06:41:32.319 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000259564 2024-09-13T06:41:32.319 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:32.319 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:32.319 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:32.319 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:32.319 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:32.319 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27978 3.a 3.9aacdeca (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:32.319 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.660327+0000", 2024-09-13T06:41:32.319 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 95.611316885999997, 2024-09-13T06:41:32.319 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039984858999999998, 2024-09-13T06:41:32.319 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:32.319 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:41:32.319 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:32.319 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:32.319 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:32.320 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27978 2024-09-13T06:41:32.320 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:32.320 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:32.320 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:32.320 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:32.320 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660327+0000", 2024-09-13T06:41:32.320 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:32.320 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:32.320 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:32.320 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:32.320 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660327+0000", 2024-09-13T06:41:32.320 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:32.320 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:32.321 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:32.321 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:32.321 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660326+0000", 2024-09-13T06:41:32.321 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:32.321 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:32.321 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:32.321 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:32.321 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660366+0000", 2024-09-13T06:41:32.321 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.9691000000000003e-05 2024-09-13T06:41:32.321 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:32.321 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:32.321 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:32.321 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660399+0000", 2024-09-13T06:41:32.322 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.3262000000000001e-05 2024-09-13T06:41:32.322 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:32.322 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:32.322 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:32.322 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660414+0000", 2024-09-13T06:41:32.322 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.4775e-05 2024-09-13T06:41:32.322 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:32.322 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:32.322 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:32.322 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700298+0000", 2024-09-13T06:41:32.322 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039883759999999997 2024-09-13T06:41:32.322 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:32.323 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:32.323 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:32.323 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700312+0000", 2024-09-13T06:41:32.323 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.4374e-05 2024-09-13T06:41:32.323 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:32.323 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:32.323 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:32.323 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:32.323 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:32.323 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27979 3.a 3.9aacdeca (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:32.323 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.660429+0000", 2024-09-13T06:41:32.323 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 95.611215017999996, 2024-09-13T06:41:32.323 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039921361000000002, 2024-09-13T06:41:32.323 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:32.323 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:41:32.324 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:32.324 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:32.324 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:32.324 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27979 2024-09-13T06:41:32.324 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:32.324 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:32.324 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:32.324 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:32.324 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660429+0000", 2024-09-13T06:41:32.324 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:32.324 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:32.324 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:32.324 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:32.324 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660429+0000", 2024-09-13T06:41:32.325 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:32.325 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:32.325 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:32.325 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:32.325 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660428+0000", 2024-09-13T06:41:32.325 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999986 2024-09-13T06:41:32.325 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:32.325 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:32.325 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:32.325 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660434+0000", 2024-09-13T06:41:32.325 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.8190000000000003e-06 2024-09-13T06:41:32.325 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:32.325 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:32.326 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:32.326 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660451+0000", 2024-09-13T06:41:32.326 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6963e-05 2024-09-13T06:41:32.326 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:32.326 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:32.326 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:32.326 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660485+0000", 2024-09-13T06:41:32.326 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.3414000000000002e-05 2024-09-13T06:41:32.326 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:32.326 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:32.326 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:32.326 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700342+0000", 2024-09-13T06:41:32.326 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039857278000000003 2024-09-13T06:41:32.327 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:32.327 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:32.327 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:32.327 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700350+0000", 2024-09-13T06:41:32.327 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.2930000000000001e-06 2024-09-13T06:41:32.327 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:32.327 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:32.327 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:32.327 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:32.327 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:32.328 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27980 3.a 3.9aacdeca (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:32.328 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.660497+0000", 2024-09-13T06:41:32.328 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 95.611146806999997, 2024-09-13T06:41:32.328 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039888034000000003, 2024-09-13T06:41:32.328 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:32.328 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:41:32.328 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:32.328 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:32.328 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:32.328 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27980 2024-09-13T06:41:32.328 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:32.328 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:32.328 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:32.328 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:32.329 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660497+0000", 2024-09-13T06:41:32.329 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:32.329 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:32.329 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:32.329 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:32.329 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660497+0000", 2024-09-13T06:41:32.329 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:32.329 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:32.329 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:32.329 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:32.329 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660496+0000", 2024-09-13T06:41:32.329 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:32.329 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:32.330 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:32.330 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:32.330 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660503+0000", 2024-09-13T06:41:32.330 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.4110000000000001e-06 2024-09-13T06:41:32.330 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:32.330 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:32.330 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:32.330 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660519+0000", 2024-09-13T06:41:32.330 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6180000000000001e-05 2024-09-13T06:41:32.330 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:32.330 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:32.330 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:32.330 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660544+0000", 2024-09-13T06:41:32.331 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.5177999999999998e-05 2024-09-13T06:41:32.331 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:32.331 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:32.331 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:32.331 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700377+0000", 2024-09-13T06:41:32.331 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039833434000000001 2024-09-13T06:41:32.331 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:32.331 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:32.331 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:32.331 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700385+0000", 2024-09-13T06:41:32.331 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.8800000000000008e-06 2024-09-13T06:41:32.331 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:32.331 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:32.331 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:32.332 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:32.332 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:32.332 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27981 3.a 3.9aacdeca (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:32.332 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.660556+0000", 2024-09-13T06:41:32.332 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 95.611088460999994, 2024-09-13T06:41:32.332 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039869989000000002, 2024-09-13T06:41:32.332 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:32.332 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:41:32.332 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:32.332 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:32.332 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:32.332 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27981 2024-09-13T06:41:32.332 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:32.332 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:32.333 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:32.333 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:32.333 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660556+0000", 2024-09-13T06:41:32.333 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:32.333 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:32.333 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:32.333 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:32.333 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660556+0000", 2024-09-13T06:41:32.333 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:32.333 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:32.333 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:32.333 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:32.333 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660555+0000", 2024-09-13T06:41:32.334 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:32.334 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:32.334 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:32.334 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:32.334 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660561+0000", 2024-09-13T06:41:32.334 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.088e-06 2024-09-13T06:41:32.334 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:32.334 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:32.334 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:32.334 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660577+0000", 2024-09-13T06:41:32.334 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6147999999999999e-05 2024-09-13T06:41:32.334 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:32.334 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:32.335 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:32.335 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660589+0000", 2024-09-13T06:41:32.335 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2551999999999999e-05 2024-09-13T06:41:32.335 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:32.335 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:32.335 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:32.335 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700414+0000", 2024-09-13T06:41:32.335 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039825007000000003 2024-09-13T06:41:32.335 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:32.335 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:32.335 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:32.335 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700426+0000", 2024-09-13T06:41:32.335 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1265e-05 2024-09-13T06:41:32.335 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:32.336 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:32.336 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:32.336 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:32.336 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:32.336 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27982 3.a 3.9aacdeca (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:32.336 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.660603+0000", 2024-09-13T06:41:32.336 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 95.611040865999996, 2024-09-13T06:41:32.336 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039874779999999999, 2024-09-13T06:41:32.336 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:32.336 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:41:32.336 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:32.336 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:32.336 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:32.336 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27982 2024-09-13T06:41:32.337 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:32.337 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:32.337 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:32.337 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:32.337 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660603+0000", 2024-09-13T06:41:32.337 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:32.337 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:32.337 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:32.337 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:32.337 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660603+0000", 2024-09-13T06:41:32.337 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:32.337 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:32.337 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:32.338 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:32.338 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660602+0000", 2024-09-13T06:41:32.338 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:32.338 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:32.338 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:32.338 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:32.338 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660653+0000", 2024-09-13T06:41:32.338 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.0862000000000002e-05 2024-09-13T06:41:32.338 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:32.338 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:32.338 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:32.338 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660697+0000", 2024-09-13T06:41:32.338 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.3773000000000003e-05 2024-09-13T06:41:32.338 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:32.338 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:32.338 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:32.339 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660712+0000", 2024-09-13T06:41:32.339 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5464999999999998e-05 2024-09-13T06:41:32.339 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:32.339 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:32.339 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:32.339 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700469+0000", 2024-09-13T06:41:32.339 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039756503999999998 2024-09-13T06:41:32.339 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:32.339 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:32.339 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:32.339 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700478+0000", 2024-09-13T06:41:32.339 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.1730000000000001e-06 2024-09-13T06:41:32.340 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:32.340 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:32.340 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:32.340 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:32.340 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:32.340 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27983 3.a 3.9aacdeca (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:32.340 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.660726+0000", 2024-09-13T06:41:32.340 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 95.610917591000003, 2024-09-13T06:41:32.340 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039804357999999998, 2024-09-13T06:41:32.340 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:32.340 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:41:32.340 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:32.340 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:32.341 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:32.341 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27983 2024-09-13T06:41:32.341 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:32.341 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:32.341 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:32.341 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:32.341 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660726+0000", 2024-09-13T06:41:32.341 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:32.341 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:32.341 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:32.341 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:32.341 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660726+0000", 2024-09-13T06:41:32.341 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:32.342 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:32.342 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:32.342 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:32.342 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660725+0000", 2024-09-13T06:41:32.342 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999986 2024-09-13T06:41:32.342 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:32.342 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:32.342 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:32.342 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660733+0000", 2024-09-13T06:41:32.342 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.9359999999999999e-06 2024-09-13T06:41:32.342 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:32.342 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:32.342 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:32.343 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660751+0000", 2024-09-13T06:41:32.343 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7679000000000001e-05 2024-09-13T06:41:32.343 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:32.343 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:32.343 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:32.343 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660764+0000", 2024-09-13T06:41:32.343 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3112000000000001e-05 2024-09-13T06:41:32.343 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:32.343 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:32.343 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:32.343 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700516+0000", 2024-09-13T06:41:32.343 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039752183000000003 2024-09-13T06:41:32.343 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:32.344 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:32.344 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:32.344 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700531+0000", 2024-09-13T06:41:32.344 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.4732999999999999e-05 2024-09-13T06:41:32.344 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:32.344 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:32.344 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:32.344 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:32.344 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:32.344 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27984 3.a 3.9aacdeca (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:32.344 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.660776+0000", 2024-09-13T06:41:32.344 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 95.610868487999994, 2024-09-13T06:41:32.344 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039795697999999997, 2024-09-13T06:41:32.345 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:32.345 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:41:32.345 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:32.345 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:32.345 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:32.345 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27984 2024-09-13T06:41:32.345 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:32.345 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:32.345 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:32.345 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:32.345 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660776+0000", 2024-09-13T06:41:32.345 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:32.345 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:32.346 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:32.346 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:32.346 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660776+0000", 2024-09-13T06:41:32.346 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:32.346 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:32.346 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:32.346 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:32.346 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660775+0000", 2024-09-13T06:41:32.346 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:32.346 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:32.346 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:32.346 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:32.347 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660780+0000", 2024-09-13T06:41:32.347 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.7849999999999997e-06 2024-09-13T06:41:32.347 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:32.347 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:32.347 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:32.347 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660799+0000", 2024-09-13T06:41:32.347 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.8794e-05 2024-09-13T06:41:32.347 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:32.347 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:32.347 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:32.347 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660812+0000", 2024-09-13T06:41:32.347 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3029e-05 2024-09-13T06:41:32.348 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:32.348 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:32.348 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:32.348 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700562+0000", 2024-09-13T06:41:32.348 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039749984000000002 2024-09-13T06:41:32.348 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:32.348 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:32.348 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:32.348 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700571+0000", 2024-09-13T06:41:32.348 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.1260000000000004e-06 2024-09-13T06:41:32.348 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:32.348 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:32.348 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:32.348 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:32.348 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:32.349 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27985 3.a 3.9aacdeca (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:32.349 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.660824+0000", 2024-09-13T06:41:32.349 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 95.610820435999997, 2024-09-13T06:41:32.349 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039784462, 2024-09-13T06:41:32.349 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:32.349 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:41:32.349 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:32.349 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:32.349 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:32.349 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27985 2024-09-13T06:41:32.349 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:32.349 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:32.349 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:32.349 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:32.350 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660824+0000", 2024-09-13T06:41:32.350 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:32.350 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:32.350 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:32.350 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:32.350 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660824+0000", 2024-09-13T06:41:32.350 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:32.350 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:32.350 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:32.350 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:32.350 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660823+0000", 2024-09-13T06:41:32.350 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:32.351 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:32.351 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:32.351 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:32.351 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660829+0000", 2024-09-13T06:41:32.351 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.9440000000000002e-06 2024-09-13T06:41:32.351 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:32.351 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:32.351 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:32.351 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660922+0000", 2024-09-13T06:41:32.351 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.2958e-05 2024-09-13T06:41:32.351 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:32.351 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:32.351 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:32.352 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660964+0000", 2024-09-13T06:41:32.352 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.2407000000000002e-05 2024-09-13T06:41:32.352 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:32.352 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:32.352 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:32.352 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700600+0000", 2024-09-13T06:41:32.352 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039635581000000003 2024-09-13T06:41:32.352 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:32.352 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:32.352 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:32.352 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700608+0000", 2024-09-13T06:41:32.352 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.5890000000000003e-06 2024-09-13T06:41:32.352 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:32.353 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:32.353 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:32.353 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:32.353 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:32.353 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:28023 3.10 3:0dedc28a:::rbd_data.1121f2c5ee81.0000000000000019:13 [read 475136~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:32.353 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.662072+0000", 2024-09-13T06:41:32.353 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 95.609572451000005, 2024-09-13T06:41:32.353 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.038086508999999998, 2024-09-13T06:41:32.353 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:32.353 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:32.353 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:32.353 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:32.353 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:32.354 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 28023 2024-09-13T06:41:32.354 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:32.354 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:32.354 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:32.354 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:32.354 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.662072+0000", 2024-09-13T06:41:32.354 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:32.354 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:32.354 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:32.354 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:32.354 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.662072+0000", 2024-09-13T06:41:32.354 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:32.354 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:32.355 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:32.355 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:32.355 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.662070+0000", 2024-09-13T06:41:32.355 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999986 2024-09-13T06:41:32.355 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:32.355 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:32.355 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:32.355 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.662076+0000", 2024-09-13T06:41:32.355 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.139e-06 2024-09-13T06:41:32.355 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:32.355 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:32.355 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:32.355 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.662094+0000", 2024-09-13T06:41:32.356 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7136999999999999e-05 2024-09-13T06:41:32.356 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:32.356 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:32.356 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:32.356 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.662124+0000", 2024-09-13T06:41:32.356 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.0528999999999999e-05 2024-09-13T06:41:32.356 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:32.356 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:32.356 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:32.356 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.699843+0000", 2024-09-13T06:41:32.356 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.037718415999999998 2024-09-13T06:41:32.356 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:32.356 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:32.357 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:32.357 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.699931+0000", 2024-09-13T06:41:32.357 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.8345999999999997e-05 2024-09-13T06:41:32.357 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:32.357 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:32.357 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:32.357 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700158+0000", 2024-09-13T06:41:32.357 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00022723099999999999 2024-09-13T06:41:32.357 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:32.357 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:32.357 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:32.357 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:32.357 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:32.358 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:28024 3.10 3.5143b7b0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:32.358 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.662137+0000", 2024-09-13T06:41:32.358 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 95.609506929000005, 2024-09-13T06:41:32.358 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.038056092999999999, 2024-09-13T06:41:32.358 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:32.358 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:41:32.358 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:32.358 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:32.358 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:32.358 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 28024 2024-09-13T06:41:32.358 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:32.358 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:32.358 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:32.359 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:32.359 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.662137+0000", 2024-09-13T06:41:32.359 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:32.359 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:32.359 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:32.359 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:32.359 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.662137+0000", 2024-09-13T06:41:32.359 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:32.359 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:32.359 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:32.359 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:32.359 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.662136+0000", 2024-09-13T06:41:32.360 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999986 2024-09-13T06:41:32.360 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:32.360 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:32.360 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:32.360 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.662142+0000", 2024-09-13T06:41:32.360 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.6930000000000001e-06 2024-09-13T06:41:32.360 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:32.360 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:32.360 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:32.360 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.662160+0000", 2024-09-13T06:41:32.360 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7863000000000002e-05 2024-09-13T06:41:32.360 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:32.360 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:32.360 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:32.361 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.662189+0000", 2024-09-13T06:41:32.361 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.8486000000000001e-05 2024-09-13T06:41:32.361 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:32.361 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:32.361 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:32.361 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700187+0000", 2024-09-13T06:41:32.361 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.037998331000000003 2024-09-13T06:41:32.361 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:32.361 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:32.361 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:32.361 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700193+0000", 2024-09-13T06:41:32.361 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.0909999999999998e-06 2024-09-13T06:41:32.361 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:32.362 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:32.362 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:32.362 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:32.362 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:32.362 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:41:32.363 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-13T06:41:32.364 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:41:32.362+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:41:32.387 INFO:teuthology.orchestra.run.smithi081.stdout:osd.0: {} 2024-09-13T06:41:32.387 INFO:teuthology.orchestra.run.smithi081.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-13T06:41:32.403 INFO:teuthology.orchestra.run.smithi081.stdout:osd.1: {} 2024-09-13T06:41:32.403 INFO:teuthology.orchestra.run.smithi081.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-13T06:41:32.419 INFO:teuthology.orchestra.run.smithi081.stderr:noscrub is unset 2024-09-13T06:41:32.426 INFO:teuthology.orchestra.run.smithi081.stdout:osd.2: {} 2024-09-13T06:41:32.426 INFO:teuthology.orchestra.run.smithi081.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-13T06:41:32.457 INFO:teuthology.orchestra.run.smithi081.stdout:osd.3: {} 2024-09-13T06:41:32.457 INFO:teuthology.orchestra.run.smithi081.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-13T06:41:32.465 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:41:32.462+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:41:32.492 INFO:teuthology.orchestra.run.smithi081.stdout:osd.4: {} 2024-09-13T06:41:32.493 INFO:teuthology.orchestra.run.smithi081.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-13T06:41:32.532 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:41:32.532 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:41:32.537 INFO:teuthology.orchestra.run.smithi081.stdout:osd.5: {} 2024-09-13T06:41:32.537 INFO:teuthology.orchestra.run.smithi081.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-13T06:41:32.562 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-13T06:41:32.565 INFO:tasks.ceph.osd.6.smithi139.stderr:2024-09-13T06:41:32.562+0000 7fcd02c5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26385) UID: 0 2024-09-13T06:41:32.572 INFO:teuthology.orchestra.run.smithi081.stdout:osd.6: {} 2024-09-13T06:41:32.573 INFO:teuthology.orchestra.run.smithi081.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-13T06:41:32.573 INFO:teuthology.orchestra.run.smithi081.stderr:Error ENXIO: problem getting command descriptions from osd.7 2024-09-13T06:41:32.577 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-13T06:41:32.577 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-13T06:41:32.667 INFO:tasks.ceph.osd.6.smithi139.stderr:2024-09-13T06:41:32.662+0000 7fcd02c5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26385) UID: 0 2024-09-13T06:41:32.686 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:41:32.687 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:41:32.701 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-13T06:41:32.768 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:41:32.762+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:41:32.822 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:41:32.822 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:41:32.836 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-13T06:41:32.882 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:41:32.882+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:41:32.953 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:41:32.954 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:41:32.967 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-13T06:41:33.010 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:41:33.010+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:41:33.071 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:41:33.070+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:41:33.128 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:41:33.128 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:41:33.140 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-13T06:41:33.182 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:41:33.182+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:41:33.273 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:41:33.270+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:41:33.300 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:41:33.301 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:41:33.314 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-13T06:41:33.404 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:41:33.402+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:41:33.475 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:41:33.474+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:41:33.500 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:41:33.501 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:41:33.518 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-13T06:41:33.576 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:41:33.574+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:41:33.618 INFO:teuthology.orchestra.run.smithi081.stdout:checking clone #21, image image_client.0-clone21 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent22 2024-09-13T06:41:33.677 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:41:33.674+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:41:33.698 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:41:33.698 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:41:33.715 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-13T06:41:33.778 INFO:tasks.ceph.osd.6.smithi139.stderr:2024-09-13T06:41:33.774+0000 7fcd02c5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26385) UID: 0 2024-09-13T06:41:33.869 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:41:33.869 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:41:33.879 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:41:33.878+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:41:33.883 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-13T06:41:33.898 INFO:teuthology.orchestra.run.smithi081.stdout:3688 punch from 0x901385e to 0x901869b, (0x4e3d bytes) 2024-09-13T06:41:33.912 INFO:teuthology.orchestra.run.smithi081.stdout:3689 writesame 0xed11b49 thru 0xed1a811 data_size 0x1(0x8cc9 bytes) 2024-09-13T06:41:33.912 INFO:teuthology.orchestra.run.smithi081.stdout:3690 read 0xdb86b2a thru 0xdb8fc62 (0x9139 bytes) 2024-09-13T06:41:33.912 INFO:teuthology.orchestra.run.smithi081.stdout:3692 read 0x48ade94 thru 0x48b7d3b (0x9ea8 bytes) 2024-09-13T06:41:33.912 INFO:teuthology.orchestra.run.smithi081.stdout:3693 trunc from 0xed1a812 to 0xea540aa 2024-09-13T06:41:33.918 INFO:teuthology.orchestra.run.smithi081.stdout:3695 write 0x43613a7 thru 0x436a182 (0x8ddc bytes) 2024-09-13T06:41:33.922 INFO:teuthology.orchestra.run.smithi081.stdout:3696 read 0x2c6b1a6 thru 0x2c70ff0 (0x5e4b bytes) 2024-09-13T06:41:33.922 INFO:teuthology.orchestra.run.smithi081.stdout:3698 write 0x3ce4963 thru 0x3cf472e (0xfdcc bytes) 2024-09-13T06:41:33.930 INFO:teuthology.orchestra.run.smithi081.stdout:3699 write 0x3eac5f thru 0x3f02ad (0x564f bytes) 2024-09-13T06:41:33.933 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:41:33.934 INFO:teuthology.orchestra.run.smithi081.stdout:3701 write 0x41b8a12 thru 0x41bc320 (0x390f bytes) 2024-09-13T06:41:33.940 INFO:teuthology.orchestra.run.smithi081.stdout:3702 write 0x51924bc thru 0x5193c7f (0x17c4 bytes) 2024-09-13T06:41:33.946 INFO:teuthology.orchestra.run.smithi081.stdout:3703 write 0x433fa3b thru 0x4349718 (0x9cde bytes) 2024-09-13T06:41:33.949 INFO:teuthology.orchestra.run.smithi081.stdout:3704 writesame 0x31507ec thru 0x315cea1 data_size 0x5(0xc6b6 bytes) 2024-09-13T06:41:33.959 INFO:teuthology.orchestra.run.smithi081.stdout:3705 read 0x48b0a7d thru 0x48b2339 (0x18bd bytes) 2024-09-13T06:41:33.960 INFO:teuthology.orchestra.run.smithi081.stdout:3706 read 0x27c5c24 thru 0x27cd8de (0x7cbb bytes) 2024-09-13T06:41:33.978 INFO:teuthology.orchestra.run.smithi081.stdout:3707 trunc from 0xea540aa to 0x2e67f2d 2024-09-13T06:41:33.979 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:41:33.978+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:41:34.030 INFO:teuthology.orchestra.run.smithi081.stdout:3709 write 0xcb2eb71 thru 0xcb39b5d (0xafed bytes) 2024-09-13T06:41:34.034 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:41:34.034 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:41:34.039 INFO:teuthology.orchestra.run.smithi081.stdout:3710 read 0x22276e0 thru 0x2236547 (0xee68 bytes) 2024-09-13T06:41:34.040 INFO:teuthology.orchestra.run.smithi081.stdout:3711 write 0xc6506bc thru 0xc65691e (0x6263 bytes) 2024-09-13T06:41:34.047 INFO:teuthology.orchestra.run.smithi081.stdout:3712 write 0x9ef406 thru 0x9fa448 (0xb043 bytes) 2024-09-13T06:41:34.049 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-13T06:41:34.050 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:41:34.050 INFO:teuthology.orchestra.run.smithi081.stdout:3714 clone 24 order 18 su 4096 sc 7 2024-09-13T06:41:34.090 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:41:34.090+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:41:34.181 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:41:34.178+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:41:34.205 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:41:34.205 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:41:34.220 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-13T06:41:34.306 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:41:34.306+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:41:34.382 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:41:34.382 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:41:34.382 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:41:34.378+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:41:34.397 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-13T06:41:34.421 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 4, 6, 7, 5, 3] out_osds: [] dead_osds: [7] live_osds: [0, 1, 2, 3, 4, 5, 6] 2024-09-13T06:41:34.421 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-13T06:41:34.421 INFO:tasks.thrashosds.thrasher:primary_affinity 2024-09-13T06:41:34.421 INFO:tasks.thrashosds.thrasher:Setting osd 0 primary_affinity to 0.000000 2024-09-13T06:41:34.421 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 0 0 2024-09-13T06:41:34.451 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-13T06:41:34.482 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:41:34.478+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:41:34.535 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:41:34.535 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:41:34.549 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-13T06:41:34.578 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-13T06:41:34.622 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:41:34.622+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:41:34.685 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:41:34.682+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:41:34.708 INFO:teuthology.orchestra.run.smithi081.stdout:osd.0: {} 2024-09-13T06:41:34.708 INFO:teuthology.orchestra.run.smithi081.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-13T06:41:34.713 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:41:34.713 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:41:34.724 INFO:teuthology.orchestra.run.smithi081.stdout:osd.1: {} 2024-09-13T06:41:34.725 INFO:teuthology.orchestra.run.smithi081.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-13T06:41:34.728 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-13T06:41:34.741 INFO:teuthology.orchestra.run.smithi081.stdout:osd.2: {} 2024-09-13T06:41:34.741 INFO:teuthology.orchestra.run.smithi081.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-13T06:41:34.759 INFO:teuthology.orchestra.run.smithi081.stdout:osd.3: {} 2024-09-13T06:41:34.759 INFO:teuthology.orchestra.run.smithi081.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-13T06:41:34.777 INFO:teuthology.orchestra.run.smithi081.stdout:osd.4: {} 2024-09-13T06:41:34.777 INFO:teuthology.orchestra.run.smithi081.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-13T06:41:34.793 INFO:teuthology.orchestra.run.smithi081.stdout:osd.5: {} 2024-09-13T06:41:34.793 INFO:teuthology.orchestra.run.smithi081.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-13T06:41:34.810 INFO:teuthology.orchestra.run.smithi081.stdout:osd.6: {} 2024-09-13T06:41:34.810 INFO:teuthology.orchestra.run.smithi081.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-13T06:41:34.810 INFO:teuthology.orchestra.run.smithi081.stderr:Error ENXIO: problem getting command descriptions from osd.7 2024-09-13T06:41:34.812 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:41:34.810+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:41:34.813 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-13T06:41:34.814 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-13T06:41:34.886 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:41:34.882+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:41:34.892 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:41:34.892 INFO:teuthology.orchestra.run.smithi139.stdout: "size": 20, 2024-09-13T06:41:34.892 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 600, 2024-09-13T06:41:34.892 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [ 2024-09-13T06:41:34.892 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:34.892 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18706 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 3346432~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:41:34.892 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.846138+0000", 2024-09-13T06:41:34.893 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 103.04471533500001, 2024-09-13T06:41:34.893 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.102018712, 2024-09-13T06:41:34.893 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:34.893 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:34.893 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:34.893 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:34.893 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:34.893 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18706 2024-09-13T06:41:34.893 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:34.893 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:34.893 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:34.893 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:34.894 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846138+0000", 2024-09-13T06:41:34.894 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:34.894 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:34.894 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:34.894 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:34.894 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846138+0000", 2024-09-13T06:41:34.894 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:34.894 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:34.894 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:34.894 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:34.894 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846138+0000", 2024-09-13T06:41:34.894 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:34.894 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:34.894 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:34.894 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:34.895 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846141+0000", 2024-09-13T06:41:34.895 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.6969999999999999e-06 2024-09-13T06:41:34.895 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:34.895 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:34.895 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:34.895 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846150+0000", 2024-09-13T06:41:34.895 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6400000000000003e-06 2024-09-13T06:41:34.895 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:34.895 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:34.895 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:34.895 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846160+0000", 2024-09-13T06:41:34.895 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.3999999999999998e-06 2024-09-13T06:41:34.895 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:34.895 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:34.896 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:34.896 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.947764+0000", 2024-09-13T06:41:34.896 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101604085 2024-09-13T06:41:34.896 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:34.896 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:34.896 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:34.896 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.947888+0000", 2024-09-13T06:41:34.896 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000124113 2024-09-13T06:41:34.896 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:34.896 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:34.896 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:34.896 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.948157+0000", 2024-09-13T06:41:34.896 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00026943399999999998 2024-09-13T06:41:34.896 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:34.897 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:34.897 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:34.897 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:34.897 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:34.897 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18707 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 3375104~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:41:34.897 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.846207+0000", 2024-09-13T06:41:34.897 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 103.04464656899999, 2024-09-13T06:41:34.897 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10238114099999999, 2024-09-13T06:41:34.897 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:34.897 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:34.897 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:34.897 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:34.897 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:34.897 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18707 2024-09-13T06:41:34.898 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:34.898 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:34.898 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:34.898 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:34.898 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846207+0000", 2024-09-13T06:41:34.898 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:34.898 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:34.898 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:34.898 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:34.898 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846207+0000", 2024-09-13T06:41:34.898 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:34.898 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:34.898 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:34.898 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:34.898 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846206+0000", 2024-09-13T06:41:34.899 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:34.899 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:34.899 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:34.899 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:34.899 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846211+0000", 2024-09-13T06:41:34.899 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.3000000000000003e-06 2024-09-13T06:41:34.899 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:34.899 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:34.899 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:34.899 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846220+0000", 2024-09-13T06:41:34.899 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6199999999999994e-06 2024-09-13T06:41:34.899 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:34.899 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:34.899 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:34.899 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846228+0000", 2024-09-13T06:41:34.900 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.7500000000000003e-06 2024-09-13T06:41:34.900 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:34.900 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:34.900 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:34.900 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.948267+0000", 2024-09-13T06:41:34.900 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10203878700000001 2024-09-13T06:41:34.900 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:34.900 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:34.900 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:34.900 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.948435+0000", 2024-09-13T06:41:34.900 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00016796500000000001 2024-09-13T06:41:34.900 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:34.900 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:34.900 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:34.900 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.948588+0000", 2024-09-13T06:41:34.901 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00015373599999999999 2024-09-13T06:41:34.901 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:34.901 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:34.901 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:34.901 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:34.901 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:34.901 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18718 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 3690496~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:41:34.901 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.850174+0000", 2024-09-13T06:41:34.901 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 103.040679416, 2024-09-13T06:41:34.901 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101854154, 2024-09-13T06:41:34.901 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:34.901 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:34.901 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:34.901 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:34.902 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:34.902 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18718 2024-09-13T06:41:34.902 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:34.902 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:34.902 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:34.902 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:34.902 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850174+0000", 2024-09-13T06:41:34.902 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:34.902 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:34.902 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:34.902 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:34.902 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850174+0000", 2024-09-13T06:41:34.902 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:34.902 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:34.903 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:34.903 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:34.903 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850173+0000", 2024-09-13T06:41:34.903 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:34.903 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:34.903 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:34.903 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:34.903 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850178+0000", 2024-09-13T06:41:34.903 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.4129999999999999e-06 2024-09-13T06:41:34.903 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:34.903 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:34.903 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:34.903 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850188+0000", 2024-09-13T06:41:34.903 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.8600000000000005e-06 2024-09-13T06:41:34.904 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:34.904 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:34.904 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:34.904 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850195+0000", 2024-09-13T06:41:34.904 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.8730000000000007e-06 2024-09-13T06:41:34.904 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:34.904 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:34.904 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:34.904 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.951766+0000", 2024-09-13T06:41:34.904 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.1015703 2024-09-13T06:41:34.904 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:34.904 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:34.904 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:34.904 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.951879+0000", 2024-09-13T06:41:34.905 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000112932 2024-09-13T06:41:34.905 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:34.905 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:34.905 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:34.905 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.952029+0000", 2024-09-13T06:41:34.905 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000149846 2024-09-13T06:41:34.905 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:34.905 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:34.905 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:34.905 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:34.905 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:34.905 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18719 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 3719168~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:41:34.905 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.850202+0000", 2024-09-13T06:41:34.905 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 103.040651373, 2024-09-13T06:41:34.905 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.102191676, 2024-09-13T06:41:34.906 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:34.906 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:34.906 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:34.906 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:34.906 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:34.906 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18719 2024-09-13T06:41:34.906 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:34.906 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:34.906 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:34.906 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:34.906 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850202+0000", 2024-09-13T06:41:34.906 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:34.906 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:34.906 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:34.907 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:34.907 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850202+0000", 2024-09-13T06:41:34.907 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:34.907 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:34.907 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:34.907 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:34.907 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850202+0000", 2024-09-13T06:41:34.907 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:34.907 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:34.907 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:34.907 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:34.907 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850205+0000", 2024-09-13T06:41:34.907 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.89e-06 2024-09-13T06:41:34.907 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:34.907 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:34.908 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:34.908 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850216+0000", 2024-09-13T06:41:34.908 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0233e-05 2024-09-13T06:41:34.908 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:34.908 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:34.908 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:34.908 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850223+0000", 2024-09-13T06:41:34.908 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5299999999999999e-06 2024-09-13T06:41:34.908 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:34.908 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:34.908 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:34.908 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.952106+0000", 2024-09-13T06:41:34.908 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10188309299999999 2024-09-13T06:41:34.908 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:34.908 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:34.908 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:34.909 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.952233+0000", 2024-09-13T06:41:34.909 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000126993 2024-09-13T06:41:34.909 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:34.909 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:34.909 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:34.909 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.952394+0000", 2024-09-13T06:41:34.909 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000160791 2024-09-13T06:41:34.909 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:34.909 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:34.909 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:34.909 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:34.909 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:34.909 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18720 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 3747840~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:41:34.909 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.850726+0000", 2024-09-13T06:41:34.909 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 103.040127544, 2024-09-13T06:41:34.910 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10199504299999999, 2024-09-13T06:41:34.910 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:34.910 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:34.910 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:34.910 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:34.910 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:34.910 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18720 2024-09-13T06:41:34.910 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:34.910 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:34.910 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:34.910 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:34.910 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850726+0000", 2024-09-13T06:41:34.910 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:34.911 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:34.911 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:34.911 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:34.911 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850726+0000", 2024-09-13T06:41:34.911 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:34.911 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:34.911 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:34.911 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:34.911 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850229+0000", 2024-09-13T06:41:34.911 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9995027 2024-09-13T06:41:34.911 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:34.911 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:34.911 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:34.911 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850731+0000", 2024-09-13T06:41:34.911 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00050221599999999999 2024-09-13T06:41:34.912 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:34.912 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:34.912 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:34.912 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850751+0000", 2024-09-13T06:41:34.912 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.9703000000000001e-05 2024-09-13T06:41:34.912 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:34.912 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:34.912 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:34.912 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850764+0000", 2024-09-13T06:41:34.912 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3207000000000001e-05 2024-09-13T06:41:34.912 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:34.912 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:34.912 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:34.912 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.952454+0000", 2024-09-13T06:41:34.913 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101690102 2024-09-13T06:41:34.913 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:34.913 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:34.913 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:34.913 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.952571+0000", 2024-09-13T06:41:34.913 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000116556 2024-09-13T06:41:34.913 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:34.913 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:34.913 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:34.913 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.952721+0000", 2024-09-13T06:41:34.913 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000150419 2024-09-13T06:41:34.913 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:34.913 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:34.914 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:34.914 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:34.914 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:34.914 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18730 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 4034560~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:41:34.914 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.854013+0000", 2024-09-13T06:41:34.914 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 103.036840603, 2024-09-13T06:41:34.914 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10186914399999999, 2024-09-13T06:41:34.914 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:34.914 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:34.914 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:34.914 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:34.914 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:34.914 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18730 2024-09-13T06:41:34.914 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:34.915 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:34.915 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:34.915 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:34.915 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.854013+0000", 2024-09-13T06:41:34.915 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:34.915 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:34.915 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:34.915 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:34.915 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.854013+0000", 2024-09-13T06:41:34.915 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:34.915 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:34.915 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:34.915 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:34.915 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.854013+0000", 2024-09-13T06:41:34.916 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:34.916 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:34.916 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:34.916 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:34.916 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.854016+0000", 2024-09-13T06:41:34.916 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.1839999999999999e-06 2024-09-13T06:41:34.916 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:34.916 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:34.916 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:34.916 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.854025+0000", 2024-09-13T06:41:34.916 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.8030000000000003e-06 2024-09-13T06:41:34.916 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:34.916 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:34.916 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:34.917 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.854033+0000", 2024-09-13T06:41:34.917 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6500000000000002e-06 2024-09-13T06:41:34.917 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:34.917 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:34.917 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:34.917 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.955546+0000", 2024-09-13T06:41:34.917 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10151296 2024-09-13T06:41:34.917 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:34.917 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:34.917 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:34.917 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.955694+0000", 2024-09-13T06:41:34.917 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000147773 2024-09-13T06:41:34.917 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:34.917 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:34.918 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:34.918 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.955882+0000", 2024-09-13T06:41:34.918 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000188371 2024-09-13T06:41:34.918 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:34.918 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:34.918 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:34.918 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:34.918 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:34.918 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18742 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 4378624~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:41:34.918 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.857984+0000", 2024-09-13T06:41:34.918 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 103.03286948, 2024-09-13T06:41:34.918 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10179961799999999, 2024-09-13T06:41:34.918 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:34.918 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:34.918 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:34.919 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:34.919 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:34.919 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18742 2024-09-13T06:41:34.919 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:34.919 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:34.919 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:34.919 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:34.919 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.857984+0000", 2024-09-13T06:41:34.919 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:34.919 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:34.919 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:34.919 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:34.919 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.857984+0000", 2024-09-13T06:41:34.919 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:34.920 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:34.920 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:34.920 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:34.920 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.857983+0000", 2024-09-13T06:41:34.920 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:34.920 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:34.920 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:34.920 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:34.920 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.857987+0000", 2024-09-13T06:41:34.920 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0670000000000002e-06 2024-09-13T06:41:34.920 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:34.920 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:34.920 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:34.920 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.857997+0000", 2024-09-13T06:41:34.921 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6830000000000003e-06 2024-09-13T06:41:34.921 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:34.921 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:34.921 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:34.921 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.858006+0000", 2024-09-13T06:41:34.921 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.5739999999999996e-06 2024-09-13T06:41:34.921 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:34.921 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:34.921 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:34.921 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.959453+0000", 2024-09-13T06:41:34.921 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101447339 2024-09-13T06:41:34.921 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:34.921 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:34.921 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:34.921 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.959603+0000", 2024-09-13T06:41:34.922 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000150316 2024-09-13T06:41:34.922 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:34.922 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:34.922 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:34.922 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.959784+0000", 2024-09-13T06:41:34.922 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00018065900000000001 2024-09-13T06:41:34.922 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:34.922 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:34.922 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:34.922 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:34.922 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:34.922 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18743 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 4407296~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:41:34.922 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.858012+0000", 2024-09-13T06:41:34.922 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 103.032841487, 2024-09-13T06:41:34.923 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10210024500000001, 2024-09-13T06:41:34.923 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:34.923 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:34.923 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:34.923 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:34.923 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:34.923 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18743 2024-09-13T06:41:34.923 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:34.923 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:34.923 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:34.923 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:34.923 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.858012+0000", 2024-09-13T06:41:34.923 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:34.923 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:34.924 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:34.924 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:34.924 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.858012+0000", 2024-09-13T06:41:34.924 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:34.924 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:34.924 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:34.924 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:34.924 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.858011+0000", 2024-09-13T06:41:34.924 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:34.924 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:34.924 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:34.924 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:34.924 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.858016+0000", 2024-09-13T06:41:34.924 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0659999999999997e-06 2024-09-13T06:41:34.924 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:34.925 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:34.925 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:34.925 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.858024+0000", 2024-09-13T06:41:34.925 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.7700000000000007e-06 2024-09-13T06:41:34.925 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:34.925 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:34.925 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:34.925 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.858032+0000", 2024-09-13T06:41:34.925 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.7700000000000001e-06 2024-09-13T06:41:34.925 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:34.925 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:34.925 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:34.925 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.959850+0000", 2024-09-13T06:41:34.925 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.1018182 2024-09-13T06:41:34.926 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:34.926 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:34.926 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:34.926 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.959964+0000", 2024-09-13T06:41:34.926 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00011413600000000001 2024-09-13T06:41:34.926 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:34.926 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:34.926 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:34.926 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.960113+0000", 2024-09-13T06:41:34.926 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00014813900000000001 2024-09-13T06:41:34.926 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:34.926 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:34.926 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:34.926 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:34.926 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:34.927 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18755 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 4751360~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:41:34.927 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.862061+0000", 2024-09-13T06:41:34.927 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 103.02879323499999, 2024-09-13T06:41:34.927 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101907023, 2024-09-13T06:41:34.927 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:34.927 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:34.927 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:34.927 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:34.927 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:34.927 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18755 2024-09-13T06:41:34.927 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:34.927 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:34.927 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:34.928 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:34.928 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862061+0000", 2024-09-13T06:41:34.928 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:34.928 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:34.928 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:34.928 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:34.928 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862061+0000", 2024-09-13T06:41:34.928 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:34.928 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:34.928 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:34.928 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:34.928 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862060+0000", 2024-09-13T06:41:34.928 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:34.929 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:34.929 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:34.929 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:34.929 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862064+0000", 2024-09-13T06:41:34.929 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.3229999999999999e-06 2024-09-13T06:41:34.929 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:34.929 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:34.929 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:34.929 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862078+0000", 2024-09-13T06:41:34.929 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.433e-05 2024-09-13T06:41:34.929 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:34.929 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:34.929 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:34.929 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862086+0000", 2024-09-13T06:41:34.930 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.3869999999999997e-06 2024-09-13T06:41:34.930 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:34.930 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:34.930 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:34.930 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.963635+0000", 2024-09-13T06:41:34.930 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101549606 2024-09-13T06:41:34.930 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:34.930 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:34.930 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:34.930 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.963783+0000", 2024-09-13T06:41:34.930 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000147312 2024-09-13T06:41:34.930 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:34.930 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:34.931 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:34.931 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.963968+0000", 2024-09-13T06:41:34.931 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000185028 2024-09-13T06:41:34.931 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:34.931 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:34.931 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:34.931 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:34.931 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:34.931 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18756 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 4780032~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:41:34.931 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.862132+0000", 2024-09-13T06:41:34.931 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 103.02872139199999, 2024-09-13T06:41:34.931 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.102159295, 2024-09-13T06:41:34.931 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:34.932 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:34.932 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:34.932 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:34.932 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:34.932 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18756 2024-09-13T06:41:34.932 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:34.932 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:34.932 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:34.932 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:34.932 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862132+0000", 2024-09-13T06:41:34.932 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:34.932 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:34.932 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:34.932 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:34.933 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862132+0000", 2024-09-13T06:41:34.933 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:34.933 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:34.933 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:34.933 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:34.933 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862132+0000", 2024-09-13T06:41:34.933 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:34.933 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:34.933 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:34.933 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:34.933 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862136+0000", 2024-09-13T06:41:34.933 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.9559999999999999e-06 2024-09-13T06:41:34.933 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:34.934 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:34.934 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:34.934 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862145+0000", 2024-09-13T06:41:34.934 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6169999999999996e-06 2024-09-13T06:41:34.934 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:34.934 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:34.934 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:34.934 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862153+0000", 2024-09-13T06:41:34.934 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.8359999999999992e-06 2024-09-13T06:41:34.934 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:34.934 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:34.934 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:34.934 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.964018+0000", 2024-09-13T06:41:34.934 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101865421 2024-09-13T06:41:34.935 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:34.935 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:34.935 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:34.935 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.964140+0000", 2024-09-13T06:41:34.935 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000121172 2024-09-13T06:41:34.935 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:34.935 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:34.935 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:34.935 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.964292+0000", 2024-09-13T06:41:34.935 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00015202600000000001 2024-09-13T06:41:34.935 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:34.935 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:34.935 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:34.935 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:34.936 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:34.936 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18768 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 5124096~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:41:34.936 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.866345+0000", 2024-09-13T06:41:34.936 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 103.02450908500001, 2024-09-13T06:41:34.936 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101779361, 2024-09-13T06:41:34.936 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:34.936 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:34.936 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:34.936 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:34.936 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:34.936 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18768 2024-09-13T06:41:34.936 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:34.936 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:34.937 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:34.937 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:34.937 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.866345+0000", 2024-09-13T06:41:34.937 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:34.937 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:34.937 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:34.937 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:34.937 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.866345+0000", 2024-09-13T06:41:34.937 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:34.937 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:34.937 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:34.938 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:34.938 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.866344+0000", 2024-09-13T06:41:34.938 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:34.938 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:34.938 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:34.938 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:34.938 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.866348+0000", 2024-09-13T06:41:34.938 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.4300000000000002e-06 2024-09-13T06:41:34.938 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:34.938 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:34.938 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:34.938 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.866356+0000", 2024-09-13T06:41:34.938 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.5930000000000006e-06 2024-09-13T06:41:34.939 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:34.939 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:34.939 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:34.939 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.866364+0000", 2024-09-13T06:41:34.939 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5599999999999996e-06 2024-09-13T06:41:34.939 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:34.939 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:34.939 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:34.939 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.967865+0000", 2024-09-13T06:41:34.939 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101501683 2024-09-13T06:41:34.939 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:34.939 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:34.939 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:34.940 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.967981+0000", 2024-09-13T06:41:34.940 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000115643 2024-09-13T06:41:34.940 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:34.940 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:34.940 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:34.940 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.968124+0000", 2024-09-13T06:41:34.940 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00014305500000000001 2024-09-13T06:41:34.940 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:34.940 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:34.940 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:34.940 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:34.940 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:34.940 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18779 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 5439488~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:41:34.941 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.869996+0000", 2024-09-13T06:41:34.941 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 103.02085820000001, 2024-09-13T06:41:34.941 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10189577399999999, 2024-09-13T06:41:34.941 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:34.941 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:34.941 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:34.941 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:34.941 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:34.941 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18779 2024-09-13T06:41:34.941 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:34.941 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:34.941 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:34.941 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:34.941 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.869996+0000", 2024-09-13T06:41:34.941 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:34.942 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:34.942 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:34.942 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:34.942 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.869996+0000", 2024-09-13T06:41:34.942 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:34.942 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:34.942 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:34.942 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:34.942 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.869995+0000", 2024-09-13T06:41:34.942 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:34.942 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:34.942 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:34.942 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:34.942 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.869998+0000", 2024-09-13T06:41:34.943 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.2729999999999998e-06 2024-09-13T06:41:34.943 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:34.943 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:34.943 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:34.943 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.870007+0000", 2024-09-13T06:41:34.943 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.5760000000000006e-06 2024-09-13T06:41:34.943 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:34.943 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:34.943 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:34.943 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.870014+0000", 2024-09-13T06:41:34.943 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.1400000000000002e-06 2024-09-13T06:41:34.943 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:34.943 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:34.943 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:34.944 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.971631+0000", 2024-09-13T06:41:34.944 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101617503 2024-09-13T06:41:34.944 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:34.944 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:34.944 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:34.944 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.971747+0000", 2024-09-13T06:41:34.944 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00011599600000000001 2024-09-13T06:41:34.944 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:34.944 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:34.944 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:34.944 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.971891+0000", 2024-09-13T06:41:34.944 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000143912 2024-09-13T06:41:34.944 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:34.944 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:34.945 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:34.945 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:34.945 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:34.945 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18792 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 5812224~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:41:34.945 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.874371+0000", 2024-09-13T06:41:34.945 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 103.01648307000001, 2024-09-13T06:41:34.945 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101736005, 2024-09-13T06:41:34.945 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:34.945 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:34.945 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:34.945 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:34.945 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:34.945 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18792 2024-09-13T06:41:34.946 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:34.946 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:34.946 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:34.946 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:34.946 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874371+0000", 2024-09-13T06:41:34.946 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:34.946 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:34.946 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:34.946 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:34.946 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874371+0000", 2024-09-13T06:41:34.946 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:34.946 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:34.946 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:34.946 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:34.947 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874370+0000", 2024-09-13T06:41:34.947 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:34.947 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:34.947 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:34.947 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:34.947 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874374+0000", 2024-09-13T06:41:34.947 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.7239999999999998e-06 2024-09-13T06:41:34.947 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:34.947 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:34.947 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:34.947 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874385+0000", 2024-09-13T06:41:34.947 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1293e-05 2024-09-13T06:41:34.947 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:34.947 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:34.947 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:34.948 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874394+0000", 2024-09-13T06:41:34.948 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.0729999999999994e-06 2024-09-13T06:41:34.948 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:34.948 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:34.948 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:34.948 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.975850+0000", 2024-09-13T06:41:34.948 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10145599700000001 2024-09-13T06:41:34.948 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:34.948 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:34.948 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:34.948 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.975963+0000", 2024-09-13T06:41:34.948 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000112689 2024-09-13T06:41:34.948 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:34.948 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:34.949 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:34.949 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.976107+0000", 2024-09-13T06:41:34.949 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000143836 2024-09-13T06:41:34.949 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:34.949 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:34.949 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:34.949 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:34.949 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:34.949 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18793 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 5840896~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:41:34.949 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.874401+0000", 2024-09-13T06:41:34.949 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 103.01645303700001, 2024-09-13T06:41:34.949 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.102005516, 2024-09-13T06:41:34.950 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:34.950 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:34.950 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:34.950 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:34.950 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:34.950 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18793 2024-09-13T06:41:34.950 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:34.950 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:34.950 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:34.950 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:34.950 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874401+0000", 2024-09-13T06:41:34.950 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:34.950 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:34.950 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:34.950 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:34.951 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874401+0000", 2024-09-13T06:41:34.951 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:34.951 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:34.951 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:34.951 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:34.951 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874400+0000", 2024-09-13T06:41:34.951 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:34.951 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:34.951 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:34.951 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:34.951 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874404+0000", 2024-09-13T06:41:34.951 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0069999999999999e-06 2024-09-13T06:41:34.951 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:34.951 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:34.952 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:34.952 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874412+0000", 2024-09-13T06:41:34.952 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.5399999999999996e-06 2024-09-13T06:41:34.952 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:34.952 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:34.952 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:34.952 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874420+0000", 2024-09-13T06:41:34.952 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.6199999999999999e-06 2024-09-13T06:41:34.952 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:34.952 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:34.952 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:34.952 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.976150+0000", 2024-09-13T06:41:34.952 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101729874 2024-09-13T06:41:34.953 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:34.953 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:34.953 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:34.953 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.976261+0000", 2024-09-13T06:41:34.953 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000110819 2024-09-13T06:41:34.953 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:34.953 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:34.953 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:34.953 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.976406+0000", 2024-09-13T06:41:34.953 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000145489 2024-09-13T06:41:34.953 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:34.953 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:34.953 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:34.953 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:34.954 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:34.954 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18803 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 6127616~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:41:34.954 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.877851+0000", 2024-09-13T06:41:34.954 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 103.013002544, 2024-09-13T06:41:34.954 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101951584, 2024-09-13T06:41:34.954 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:34.954 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:34.954 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:34.954 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:34.954 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:34.954 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18803 2024-09-13T06:41:34.954 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:34.954 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:34.954 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:34.955 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:34.955 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.877851+0000", 2024-09-13T06:41:34.955 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:34.955 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:34.955 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:34.955 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:34.955 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.877851+0000", 2024-09-13T06:41:34.955 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:34.955 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:34.955 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:34.955 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:34.955 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.877851+0000", 2024-09-13T06:41:34.955 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:34.955 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:34.956 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:34.956 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:34.956 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.877854+0000", 2024-09-13T06:41:34.956 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.7929999999999999e-06 2024-09-13T06:41:34.956 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:34.956 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:34.956 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:34.956 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.877864+0000", 2024-09-13T06:41:34.956 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.2029999999999998e-06 2024-09-13T06:41:34.956 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:34.956 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:34.956 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:34.956 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.877873+0000", 2024-09-13T06:41:34.956 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.0440000000000001e-06 2024-09-13T06:41:34.956 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:34.957 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:34.957 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:34.957 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.979544+0000", 2024-09-13T06:41:34.957 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101671198 2024-09-13T06:41:34.957 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:34.957 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:34.957 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:34.957 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.979658+0000", 2024-09-13T06:41:34.957 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000114456 2024-09-13T06:41:34.957 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:34.957 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:34.957 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:34.958 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.979803+0000", 2024-09-13T06:41:34.958 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000144506 2024-09-13T06:41:34.958 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:34.958 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:34.958 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:34.958 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:34.958 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:34.958 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18807 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 6242304~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:41:34.958 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.879235+0000", 2024-09-13T06:41:34.958 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 103.01161851400001, 2024-09-13T06:41:34.958 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101781258, 2024-09-13T06:41:34.958 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:34.958 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:34.958 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:34.959 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:34.959 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:34.959 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18807 2024-09-13T06:41:34.959 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:34.959 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:34.959 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:34.959 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:34.959 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879235+0000", 2024-09-13T06:41:34.959 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:34.959 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:34.959 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:34.959 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:34.959 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879235+0000", 2024-09-13T06:41:34.959 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:34.960 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:34.960 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:34.960 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:34.960 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879235+0000", 2024-09-13T06:41:34.960 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:34.960 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:34.960 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:34.960 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:34.960 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879239+0000", 2024-09-13T06:41:34.960 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.963e-06 2024-09-13T06:41:34.960 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:34.960 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:34.960 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:34.960 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879247+0000", 2024-09-13T06:41:34.960 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6470000000000004e-06 2024-09-13T06:41:34.961 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:34.961 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:34.961 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:34.961 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879255+0000", 2024-09-13T06:41:34.961 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5429999999999996e-06 2024-09-13T06:41:34.961 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:34.961 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:34.961 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:34.961 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.980756+0000", 2024-09-13T06:41:34.961 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10150165999999999 2024-09-13T06:41:34.961 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:34.961 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:34.961 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:34.961 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.980868+0000", 2024-09-13T06:41:34.962 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000111196 2024-09-13T06:41:34.962 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:34.962 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:34.962 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:34.962 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.981017+0000", 2024-09-13T06:41:34.962 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000148846 2024-09-13T06:41:34.962 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:34.962 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:34.962 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:34.962 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:34.962 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:34.962 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18808 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 6270976~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:41:34.962 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.879261+0000", 2024-09-13T06:41:34.962 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 103.01159237500001, 2024-09-13T06:41:34.962 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.102057547, 2024-09-13T06:41:34.963 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:34.963 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:34.963 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:34.963 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:34.963 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:34.963 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18808 2024-09-13T06:41:34.963 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:34.963 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:34.963 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:34.963 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:34.963 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879261+0000", 2024-09-13T06:41:34.963 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:34.963 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:34.964 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:34.964 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:34.964 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879261+0000", 2024-09-13T06:41:34.964 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:34.964 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:34.964 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:34.964 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:34.964 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879261+0000", 2024-09-13T06:41:34.964 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:34.964 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:34.964 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:34.964 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:34.964 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879264+0000", 2024-09-13T06:41:34.964 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.523e-06 2024-09-13T06:41:34.965 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:34.965 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:34.965 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:34.965 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879273+0000", 2024-09-13T06:41:34.965 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6070000000000008e-06 2024-09-13T06:41:34.965 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:34.965 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:34.965 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:34.965 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879280+0000", 2024-09-13T06:41:34.965 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.4699999999999996e-06 2024-09-13T06:41:34.965 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:34.965 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:34.965 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:34.965 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.981060+0000", 2024-09-13T06:41:34.965 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10177934800000001 2024-09-13T06:41:34.966 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:34.966 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:34.966 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:34.966 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.981174+0000", 2024-09-13T06:41:34.966 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000114456 2024-09-13T06:41:34.966 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:34.966 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:34.966 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:34.966 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.981319+0000", 2024-09-13T06:41:34.966 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00014473900000000001 2024-09-13T06:41:34.966 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:34.966 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:34.966 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:34.966 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:34.967 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:34.967 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18810 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 2662400~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:41:34.967 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.880386+0000", 2024-09-13T06:41:34.967 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 103.010468213, 2024-09-13T06:41:34.967 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101728022, 2024-09-13T06:41:34.967 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:34.967 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:34.967 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:34.967 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:34.967 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:34.967 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18810 2024-09-13T06:41:34.967 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:34.967 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:34.967 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:34.967 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:34.968 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880386+0000", 2024-09-13T06:41:34.968 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:34.968 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:34.968 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:34.968 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:34.968 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880386+0000", 2024-09-13T06:41:34.968 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:34.968 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:34.968 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:34.968 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:34.968 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880385+0000", 2024-09-13T06:41:34.968 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:34.968 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:34.968 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:34.968 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:34.969 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880389+0000", 2024-09-13T06:41:34.969 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.8539999999999999e-06 2024-09-13T06:41:34.969 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:34.969 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:34.969 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:34.969 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880398+0000", 2024-09-13T06:41:34.969 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.1689999999999998e-06 2024-09-13T06:41:34.969 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:34.969 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:34.969 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:34.969 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880405+0000", 2024-09-13T06:41:34.969 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5700000000000004e-06 2024-09-13T06:41:34.969 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:34.969 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:34.969 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:34.970 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.981833+0000", 2024-09-13T06:41:34.970 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10142791800000001 2024-09-13T06:41:34.970 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:34.970 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:34.970 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:34.970 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.981973+0000", 2024-09-13T06:41:34.970 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00014002900000000001 2024-09-13T06:41:34.970 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:34.970 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:34.970 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:34.970 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.982114+0000", 2024-09-13T06:41:34.970 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000140276 2024-09-13T06:41:34.970 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:34.970 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:34.971 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:34.971 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:34.971 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:34.971 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18811 3.9 3.140f5209 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:41:34.971 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.880449+0000", 2024-09-13T06:41:34.971 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 103.010404837, 2024-09-13T06:41:34.971 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101739355, 2024-09-13T06:41:34.971 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:34.971 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:41:34.971 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:34.971 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:34.971 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:34.971 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18811 2024-09-13T06:41:34.972 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:34.972 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:34.972 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:34.972 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:34.972 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880449+0000", 2024-09-13T06:41:34.972 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:34.972 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:34.972 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:34.972 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:34.972 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880449+0000", 2024-09-13T06:41:34.972 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:34.972 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:34.972 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:34.972 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:34.972 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880448+0000", 2024-09-13T06:41:34.973 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:34.973 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:34.973 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:34.973 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:34.973 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880452+0000", 2024-09-13T06:41:34.973 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0470000000000004e-06 2024-09-13T06:41:34.973 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:34.973 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:34.973 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:34.973 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880462+0000", 2024-09-13T06:41:34.973 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6530000000000006e-06 2024-09-13T06:41:34.973 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:34.973 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:34.973 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:34.974 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880472+0000", 2024-09-13T06:41:34.974 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0027000000000001e-05 2024-09-13T06:41:34.974 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:34.974 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:34.974 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:34.974 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.982172+0000", 2024-09-13T06:41:34.974 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10170043500000001 2024-09-13T06:41:34.974 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:34.974 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:34.974 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:34.974 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.982188+0000", 2024-09-13T06:41:34.974 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6172999999999999e-05 2024-09-13T06:41:34.974 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:34.974 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:34.974 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:34.974 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:34.975 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:34.975 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18812 3.9 3.140f5209 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:41:34.975 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.880478+0000", 2024-09-13T06:41:34.975 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 103.0103756, 2024-09-13T06:41:34.975 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10177795100000001, 2024-09-13T06:41:34.975 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:34.975 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:41:34.975 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:34.975 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:34.975 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:34.975 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18812 2024-09-13T06:41:34.975 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:34.975 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:34.975 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:34.976 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:34.976 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880478+0000", 2024-09-13T06:41:34.976 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:34.976 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:34.976 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:34.976 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:34.976 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880478+0000", 2024-09-13T06:41:34.976 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:34.976 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:34.976 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:34.976 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:34.976 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880477+0000", 2024-09-13T06:41:34.976 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:34.977 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:34.977 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:34.977 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:34.977 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880481+0000", 2024-09-13T06:41:34.977 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.827e-06 2024-09-13T06:41:34.977 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:34.977 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:34.977 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:34.977 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880490+0000", 2024-09-13T06:41:34.977 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6100000000000006e-06 2024-09-13T06:41:34.977 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:34.977 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:34.977 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:34.977 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880497+0000", 2024-09-13T06:41:34.978 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.7030000000000006e-06 2024-09-13T06:41:34.978 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:34.978 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:34.978 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:34.978 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.982241+0000", 2024-09-13T06:41:34.978 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10174351199999999 2024-09-13T06:41:34.978 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:34.978 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:34.978 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:34.978 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.982256+0000", 2024-09-13T06:41:34.978 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5143000000000001e-05 2024-09-13T06:41:34.978 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:34.978 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:34.978 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:34.979 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:34.979 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:34.979 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:41:34.980 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-13T06:41:34.987 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:41:34.986+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:41:35.088 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:41:35.086+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:41:35.150 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:41:35.150 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [], 2024-09-13T06:41:35.151 INFO:teuthology.orchestra.run.smithi139.stdout: "num_ops": 0 2024-09-13T06:41:35.151 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:41:35.164 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-13T06:41:35.189 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:41:35.186+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:41:35.282 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:41:35.283 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [], 2024-09-13T06:41:35.283 INFO:teuthology.orchestra.run.smithi139.stdout: "complaint_time": 30, 2024-09-13T06:41:35.283 INFO:teuthology.orchestra.run.smithi139.stdout: "num_blocked_ops": 0 2024-09-13T06:41:35.283 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:41:35.290 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:41:35.290+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:41:35.296 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-13T06:41:35.391 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:41:35.386+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:41:35.423 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:41:35.423 INFO:teuthology.orchestra.run.smithi139.stdout: "size": 20, 2024-09-13T06:41:35.423 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 600, 2024-09-13T06:41:35.423 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [ 2024-09-13T06:41:35.423 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:35.423 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43282 3.1d 3:bd80bfb3:::rbd_object_map.11212f44bfb1.0000000000000020:head [call rbd.object_map_update in=20b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:35.424 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589032+0000", 2024-09-13T06:41:35.424 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 73.833434131000004, 2024-09-13T06:41:35.424 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.076225263000000001, 2024-09-13T06:41:35.424 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:35.424 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:41:35.424 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:35.424 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:35.424 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:35.424 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43282 2024-09-13T06:41:35.424 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:35.424 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:35.424 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:35.425 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:35.425 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589032+0000", 2024-09-13T06:41:35.425 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:35.425 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:35.425 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:35.425 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:35.425 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589032+0000", 2024-09-13T06:41:35.425 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:35.425 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:35.425 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:35.425 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:35.425 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589031+0000", 2024-09-13T06:41:35.425 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:35.426 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:35.426 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:35.426 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:35.426 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589036+0000", 2024-09-13T06:41:35.426 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.2619999999999998e-06 2024-09-13T06:41:35.426 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:35.426 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:35.426 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:35.426 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589046+0000", 2024-09-13T06:41:35.426 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.8099999999999992e-06 2024-09-13T06:41:35.426 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:35.426 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:35.426 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:35.427 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589054+0000", 2024-09-13T06:41:35.427 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.2230000000000007e-06 2024-09-13T06:41:35.427 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:35.427 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:35.427 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:35.427 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.660691+0000", 2024-09-13T06:41:35.427 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.07163659 2024-09-13T06:41:35.427 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:35.427 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:35.427 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:35.427 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.660850+0000", 2024-09-13T06:41:35.427 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00015864300000000001 2024-09-13T06:41:35.427 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:35.428 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:35.428 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 4", 2024-09-13T06:41:35.428 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.661729+0000", 2024-09-13T06:41:35.428 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00087956099999999995 2024-09-13T06:41:35.428 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:35.428 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:35.428 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:41:35.428 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.664409+0000", 2024-09-13T06:41:35.428 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0026803479999999999 2024-09-13T06:41:35.428 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:35.428 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:35.428 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-13T06:41:35.429 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.665088+0000", 2024-09-13T06:41:35.429 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00067901400000000003 2024-09-13T06:41:35.429 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:35.429 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:35.429 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-13T06:41:35.429 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.665181+0000", 2024-09-13T06:41:35.429 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.2050000000000001e-05 2024-09-13T06:41:35.429 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:35.429 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:35.429 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:35.429 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.665257+0000", 2024-09-13T06:41:35.429 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.6698000000000003e-05 2024-09-13T06:41:35.429 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:35.430 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:35.430 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:35.430 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:35.430 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:35.430 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43290 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 299008~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:35.430 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589500+0000", 2024-09-13T06:41:35.430 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 73.832965969, 2024-09-13T06:41:35.430 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.075898564000000002, 2024-09-13T06:41:35.430 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:35.430 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:35.430 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:35.430 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:35.430 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:35.431 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43290 2024-09-13T06:41:35.431 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:35.431 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:35.431 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:35.431 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:35.431 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589500+0000", 2024-09-13T06:41:35.431 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:35.431 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:35.431 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:35.431 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:35.432 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589500+0000", 2024-09-13T06:41:35.432 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:35.432 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:35.432 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:35.432 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:35.432 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589499+0000", 2024-09-13T06:41:35.432 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:35.432 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:35.432 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:35.433 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:35.433 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589503+0000", 2024-09-13T06:41:35.433 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.8330000000000004e-06 2024-09-13T06:41:35.433 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:35.433 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:35.433 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:35.433 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589511+0000", 2024-09-13T06:41:35.433 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.3359999999999995e-06 2024-09-13T06:41:35.433 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:35.433 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:35.433 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:35.433 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589519+0000", 2024-09-13T06:41:35.434 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.4760000000000001e-06 2024-09-13T06:41:35.434 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:35.434 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:35.434 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:35.434 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.665097+0000", 2024-09-13T06:41:35.434 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.075577828999999999 2024-09-13T06:41:35.434 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:35.434 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:35.434 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:35.434 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.665170+0000", 2024-09-13T06:41:35.434 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.3745000000000006e-05 2024-09-13T06:41:35.434 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:35.434 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:35.434 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:35.435 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.665399+0000", 2024-09-13T06:41:35.435 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00022826199999999999 2024-09-13T06:41:35.435 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:35.435 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:35.435 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:35.435 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:35.435 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:35.435 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43291 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 313344~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:35.435 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589560+0000", 2024-09-13T06:41:35.435 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 73.832905748000002, 2024-09-13T06:41:35.435 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.076145594999999996, 2024-09-13T06:41:35.435 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:35.435 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:35.435 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:35.436 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:35.436 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:35.436 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43291 2024-09-13T06:41:35.436 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:35.436 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:35.436 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:35.436 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:35.436 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589560+0000", 2024-09-13T06:41:35.436 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:35.436 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:35.436 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:35.436 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:35.436 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589560+0000", 2024-09-13T06:41:35.437 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:35.437 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:35.437 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:35.437 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:35.437 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589559+0000", 2024-09-13T06:41:35.437 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:35.437 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:35.437 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:35.437 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:35.437 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589564+0000", 2024-09-13T06:41:35.437 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.3989999999999997e-06 2024-09-13T06:41:35.438 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:35.438 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:35.438 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:35.438 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589574+0000", 2024-09-13T06:41:35.438 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0502999999999999e-05 2024-09-13T06:41:35.438 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:35.438 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:35.438 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:35.438 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589582+0000", 2024-09-13T06:41:35.438 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.1859999999999992e-06 2024-09-13T06:41:35.438 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:35.438 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:35.438 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:35.438 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.665423+0000", 2024-09-13T06:41:35.439 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.075840290000000005 2024-09-13T06:41:35.439 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:35.439 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:35.439 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:35.439 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.665496+0000", 2024-09-13T06:41:35.439 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.2791000000000002e-05 2024-09-13T06:41:35.439 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:35.439 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:35.439 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:35.439 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.665706+0000", 2024-09-13T06:41:35.439 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00021038200000000001 2024-09-13T06:41:35.439 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:35.439 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:35.439 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:35.439 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:35.440 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:35.440 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43292 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 327680~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:35.440 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589589+0000", 2024-09-13T06:41:35.440 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 73.832877206999996, 2024-09-13T06:41:35.440 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.076769537999999998, 2024-09-13T06:41:35.440 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:35.440 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:35.440 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:35.440 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:35.440 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:35.440 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43292 2024-09-13T06:41:35.440 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:35.441 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:35.441 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:35.441 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:35.441 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589589+0000", 2024-09-13T06:41:35.441 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:35.441 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:35.441 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:35.441 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:35.441 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589589+0000", 2024-09-13T06:41:35.441 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:35.441 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:35.441 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:35.441 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:35.441 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589588+0000", 2024-09-13T06:41:35.441 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:35.442 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:35.442 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:35.442 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:35.442 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589592+0000", 2024-09-13T06:41:35.442 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.6389999999999998e-06 2024-09-13T06:41:35.442 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:35.442 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:35.442 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:35.442 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589600+0000", 2024-09-13T06:41:35.442 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.4630000000000001e-06 2024-09-13T06:41:35.442 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:35.442 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:35.442 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:35.443 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589608+0000", 2024-09-13T06:41:35.443 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.2359999999999998e-06 2024-09-13T06:41:35.443 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:35.443 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:35.443 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:35.443 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.665779+0000", 2024-09-13T06:41:35.443 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.076170924000000001 2024-09-13T06:41:35.443 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:35.443 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:35.443 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:35.443 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.665977+0000", 2024-09-13T06:41:35.443 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00019891900000000001 2024-09-13T06:41:35.443 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:35.443 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:35.444 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:35.444 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.666358+0000", 2024-09-13T06:41:35.444 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000380963 2024-09-13T06:41:35.444 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:35.444 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:35.444 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:35.444 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:35.444 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:35.444 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43293 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 342016~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:35.444 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589616+0000", 2024-09-13T06:41:35.444 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 73.832850312999994, 2024-09-13T06:41:35.444 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.077030083999999999, 2024-09-13T06:41:35.444 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:35.445 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:35.445 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:35.445 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:35.448 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:35.448 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43293 2024-09-13T06:41:35.448 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:35.448 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:35.448 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:35.449 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:35.449 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589616+0000", 2024-09-13T06:41:35.449 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:35.449 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:35.449 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:35.449 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:35.449 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589616+0000", 2024-09-13T06:41:35.449 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:35.449 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:35.449 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:35.449 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:35.449 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589615+0000", 2024-09-13T06:41:35.449 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:35.450 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:35.450 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:35.450 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:35.450 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589619+0000", 2024-09-13T06:41:35.450 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.9559999999999999e-06 2024-09-13T06:41:35.450 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:35.450 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:35.450 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:35.450 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589627+0000", 2024-09-13T06:41:35.450 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.2490000000000001e-06 2024-09-13T06:41:35.450 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:35.450 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:35.450 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:35.451 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589635+0000", 2024-09-13T06:41:35.451 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.96e-06 2024-09-13T06:41:35.451 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:35.451 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:35.451 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:35.451 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.666379+0000", 2024-09-13T06:41:35.451 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.076744484000000002 2024-09-13T06:41:35.451 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:35.451 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:35.451 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:35.451 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.666454+0000", 2024-09-13T06:41:35.451 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.4623999999999996e-05 2024-09-13T06:41:35.451 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:35.452 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:35.452 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:35.452 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.666646+0000", 2024-09-13T06:41:35.452 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00019176999999999999 2024-09-13T06:41:35.452 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:35.452 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:35.452 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:35.452 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:35.452 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:35.452 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43294 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 356352~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:35.452 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589681+0000", 2024-09-13T06:41:35.453 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 73.832784997999994, 2024-09-13T06:41:35.453 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.077594648000000002, 2024-09-13T06:41:35.453 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:35.453 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:35.453 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:35.453 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:35.453 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:35.453 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43294 2024-09-13T06:41:35.453 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:35.453 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:35.453 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:35.453 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:35.454 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589681+0000", 2024-09-13T06:41:35.454 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:35.454 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:35.454 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:35.454 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:35.454 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589681+0000", 2024-09-13T06:41:35.454 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:35.454 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:35.454 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:35.454 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:35.454 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589680+0000", 2024-09-13T06:41:35.454 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:35.454 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:35.454 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:35.455 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:35.455 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589684+0000", 2024-09-13T06:41:35.455 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.8369999999999999e-06 2024-09-13T06:41:35.455 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:35.455 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:35.455 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:35.455 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589693+0000", 2024-09-13T06:41:35.455 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.1020000000000003e-06 2024-09-13T06:41:35.455 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:35.455 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:35.455 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:35.455 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589701+0000", 2024-09-13T06:41:35.456 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.8059999999999995e-06 2024-09-13T06:41:35.456 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:35.456 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:35.456 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:35.456 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.666714+0000", 2024-09-13T06:41:35.456 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.077013463000000004 2024-09-13T06:41:35.456 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:35.456 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:35.456 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:35.456 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.666897+0000", 2024-09-13T06:41:35.456 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000182268 2024-09-13T06:41:35.456 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:35.456 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:35.457 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:35.457 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.667276+0000", 2024-09-13T06:41:35.457 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00037907499999999998 2024-09-13T06:41:35.457 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:35.457 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:35.457 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:35.457 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:35.457 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:35.457 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43295 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 370688~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:35.457 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589744+0000", 2024-09-13T06:41:35.457 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 73.832721825999997, 2024-09-13T06:41:35.457 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.077854343000000006, 2024-09-13T06:41:35.458 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:35.458 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:35.458 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:35.458 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:35.458 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:35.458 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43295 2024-09-13T06:41:35.458 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:35.458 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:35.458 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:35.458 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:35.458 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589744+0000", 2024-09-13T06:41:35.458 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:35.458 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:35.458 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:35.459 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:35.459 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589744+0000", 2024-09-13T06:41:35.459 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:35.459 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:35.459 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:35.459 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:35.459 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589743+0000", 2024-09-13T06:41:35.459 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:35.459 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:35.459 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:35.459 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:35.459 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589747+0000", 2024-09-13T06:41:35.459 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0130000000000004e-06 2024-09-13T06:41:35.459 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:35.459 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:35.460 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:35.460 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589756+0000", 2024-09-13T06:41:35.460 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.003e-06 2024-09-13T06:41:35.460 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:35.460 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:35.460 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:35.460 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589766+0000", 2024-09-13T06:41:35.460 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.2820000000000002e-06 2024-09-13T06:41:35.460 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:35.460 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:35.460 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:35.460 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.667300+0000", 2024-09-13T06:41:35.460 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.077534299000000001 2024-09-13T06:41:35.461 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:35.461 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:35.461 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:35.461 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.667372+0000", 2024-09-13T06:41:35.461 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.2393999999999998e-05 2024-09-13T06:41:35.461 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:35.461 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:35.461 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:35.461 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.667599+0000", 2024-09-13T06:41:35.461 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000226269 2024-09-13T06:41:35.461 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:35.461 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:35.461 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:35.461 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:35.462 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:35.462 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43296 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 385024~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:35.462 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589772+0000", 2024-09-13T06:41:35.462 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 73.832693801999994, 2024-09-13T06:41:35.462 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.078469647000000003, 2024-09-13T06:41:35.462 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:35.462 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:35.462 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:35.462 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:35.462 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:35.462 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43296 2024-09-13T06:41:35.462 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:35.462 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:35.462 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:35.463 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:35.463 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589772+0000", 2024-09-13T06:41:35.463 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:35.463 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:35.463 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:35.463 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:35.463 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589772+0000", 2024-09-13T06:41:35.463 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:35.463 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:35.463 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:35.463 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:35.463 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589771+0000", 2024-09-13T06:41:35.463 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:35.463 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:35.464 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:35.464 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:35.464 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589775+0000", 2024-09-13T06:41:35.464 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.8530000000000002e-06 2024-09-13T06:41:35.464 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:35.464 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:35.464 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:35.464 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589784+0000", 2024-09-13T06:41:35.464 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.4300000000000006e-06 2024-09-13T06:41:35.464 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:35.464 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:35.464 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:35.464 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589791+0000", 2024-09-13T06:41:35.465 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.4660000000000002e-06 2024-09-13T06:41:35.465 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:35.465 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:35.465 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:35.465 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.667667+0000", 2024-09-13T06:41:35.465 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.077875697999999993 2024-09-13T06:41:35.465 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:35.465 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:35.465 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:35.465 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.667854+0000", 2024-09-13T06:41:35.466 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00018760099999999999 2024-09-13T06:41:35.466 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:35.466 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:35.466 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:35.466 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.668242+0000", 2024-09-13T06:41:35.466 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00038750600000000003 2024-09-13T06:41:35.466 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:35.466 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:35.466 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:35.466 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:35.466 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:35.466 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43297 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 403456~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:35.466 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589797+0000", 2024-09-13T06:41:35.467 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 73.832669097999997, 2024-09-13T06:41:35.467 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.078756672999999999, 2024-09-13T06:41:35.467 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:35.467 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:35.467 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:35.467 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:35.467 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:35.467 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43297 2024-09-13T06:41:35.467 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:35.467 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:35.467 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:35.467 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:35.467 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589797+0000", 2024-09-13T06:41:35.467 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:35.468 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:35.468 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:35.468 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:35.468 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589797+0000", 2024-09-13T06:41:35.468 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:35.468 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:35.468 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:35.468 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:35.468 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589796+0000", 2024-09-13T06:41:35.468 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:35.468 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:35.468 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:35.468 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:35.468 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589800+0000", 2024-09-13T06:41:35.469 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.3230000000000002e-06 2024-09-13T06:41:35.469 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:35.469 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:35.469 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:35.469 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589808+0000", 2024-09-13T06:41:35.469 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.2390000000000002e-06 2024-09-13T06:41:35.469 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:35.469 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:35.469 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:35.469 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589815+0000", 2024-09-13T06:41:35.469 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.413e-06 2024-09-13T06:41:35.469 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:35.469 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:35.469 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:35.470 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.668265+0000", 2024-09-13T06:41:35.470 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.078449873000000003 2024-09-13T06:41:35.470 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:35.470 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:35.470 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:35.470 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.668332+0000", 2024-09-13T06:41:35.470 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.7178e-05 2024-09-13T06:41:35.470 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:35.470 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:35.470 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:35.470 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.668554+0000", 2024-09-13T06:41:35.470 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00022128600000000001 2024-09-13T06:41:35.470 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:35.470 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:35.471 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:35.471 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:35.471 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:35.471 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43298 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 417792~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:35.471 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589821+0000", 2024-09-13T06:41:35.471 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 73.832644975999997, 2024-09-13T06:41:35.471 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.079368660999999993, 2024-09-13T06:41:35.471 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:35.471 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:35.471 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:35.471 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:35.471 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:35.471 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43298 2024-09-13T06:41:35.472 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:35.472 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:35.472 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:35.472 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:35.472 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589821+0000", 2024-09-13T06:41:35.472 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:35.472 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:35.472 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:35.472 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:35.472 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589821+0000", 2024-09-13T06:41:35.472 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:35.472 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:35.472 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:35.473 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:35.473 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589821+0000", 2024-09-13T06:41:35.473 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:35.473 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:35.473 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:35.473 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:35.473 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589830+0000", 2024-09-13T06:41:35.473 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.4860000000000003e-06 2024-09-13T06:41:35.473 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:35.473 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:35.474 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:35.474 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589839+0000", 2024-09-13T06:41:35.474 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.0159999999999997e-06 2024-09-13T06:41:35.474 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:35.474 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:35.474 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:35.474 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589847+0000", 2024-09-13T06:41:35.474 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.6059999999999997e-06 2024-09-13T06:41:35.474 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:35.474 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:35.474 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:35.474 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.668620+0000", 2024-09-13T06:41:35.474 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.078773485000000004 2024-09-13T06:41:35.475 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:35.475 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:35.475 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:35.475 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.668798+0000", 2024-09-13T06:41:35.475 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000178233 2024-09-13T06:41:35.475 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:35.475 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:35.475 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:35.475 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.669190+0000", 2024-09-13T06:41:35.475 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00039143499999999998 2024-09-13T06:41:35.475 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:35.475 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:35.475 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:35.475 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:35.476 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:35.476 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43299 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 432128~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:35.476 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589881+0000", 2024-09-13T06:41:35.476 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 73.832585128000005, 2024-09-13T06:41:35.476 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.079693849999999997, 2024-09-13T06:41:35.476 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:35.476 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:35.476 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:35.476 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:35.476 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:35.476 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43299 2024-09-13T06:41:35.476 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:35.476 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:35.477 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:35.477 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:35.477 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589881+0000", 2024-09-13T06:41:35.477 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:35.477 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:35.477 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:35.477 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:35.477 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589881+0000", 2024-09-13T06:41:35.477 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:35.477 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:35.477 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:35.478 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:35.478 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589880+0000", 2024-09-13T06:41:35.478 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:35.478 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:35.478 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:35.478 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:35.478 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589884+0000", 2024-09-13T06:41:35.478 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.053e-06 2024-09-13T06:41:35.478 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:35.478 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:35.478 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:35.478 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589893+0000", 2024-09-13T06:41:35.478 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.2129999999999997e-06 2024-09-13T06:41:35.478 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:35.478 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:35.479 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:35.479 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589901+0000", 2024-09-13T06:41:35.479 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.6399999999999997e-06 2024-09-13T06:41:35.479 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:35.479 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:35.479 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:35.479 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.669213+0000", 2024-09-13T06:41:35.479 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.079312074999999996 2024-09-13T06:41:35.479 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:35.479 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:35.479 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:35.479 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.669281+0000", 2024-09-13T06:41:35.479 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.8322000000000001e-05 2024-09-13T06:41:35.480 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:35.480 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:35.480 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:35.480 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.669575+0000", 2024-09-13T06:41:35.480 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00029349699999999999 2024-09-13T06:41:35.480 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:35.480 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:35.480 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:35.480 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:35.480 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:35.480 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43300 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 446464~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:35.480 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589909+0000", 2024-09-13T06:41:35.480 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 73.832557233000003, 2024-09-13T06:41:35.480 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.080339496999999996, 2024-09-13T06:41:35.481 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:35.481 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:35.481 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:35.481 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:35.481 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:35.481 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43300 2024-09-13T06:41:35.481 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:35.481 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:35.481 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:35.481 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:35.481 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589909+0000", 2024-09-13T06:41:35.481 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:35.481 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:35.481 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:35.481 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:35.482 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589909+0000", 2024-09-13T06:41:35.482 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:35.482 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:35.482 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:35.482 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:35.482 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589908+0000", 2024-09-13T06:41:35.482 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:35.482 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:35.482 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:35.482 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:35.482 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589912+0000", 2024-09-13T06:41:35.482 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.9430000000000002e-06 2024-09-13T06:41:35.482 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:35.482 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:35.483 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:35.483 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589920+0000", 2024-09-13T06:41:35.483 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.3860000000000007e-06 2024-09-13T06:41:35.483 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:35.483 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:35.483 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:35.483 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589928+0000", 2024-09-13T06:41:35.483 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.3329999999999999e-06 2024-09-13T06:41:35.483 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:35.483 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:35.483 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:35.483 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.669651+0000", 2024-09-13T06:41:35.483 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.079723204000000006 2024-09-13T06:41:35.484 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:35.484 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:35.484 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:35.484 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.669840+0000", 2024-09-13T06:41:35.484 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000189397 2024-09-13T06:41:35.484 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:35.484 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:35.484 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:35.484 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.670248+0000", 2024-09-13T06:41:35.484 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00040811100000000001 2024-09-13T06:41:35.484 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:35.484 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:35.484 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:35.484 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:35.484 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:35.485 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43301 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 460800~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:35.485 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589934+0000", 2024-09-13T06:41:35.485 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 73.832532559000001, 2024-09-13T06:41:35.485 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.080747474999999999, 2024-09-13T06:41:35.485 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:35.485 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:35.485 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:35.485 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:35.485 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:35.485 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43301 2024-09-13T06:41:35.485 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:35.485 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:35.485 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:35.485 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:35.486 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589934+0000", 2024-09-13T06:41:35.486 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:35.486 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:35.486 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:35.486 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:35.486 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589934+0000", 2024-09-13T06:41:35.486 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:35.486 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:35.486 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:35.486 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:35.486 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589933+0000", 2024-09-13T06:41:35.486 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:35.486 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:35.486 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:35.486 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:35.487 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589936+0000", 2024-09-13T06:41:35.487 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.4599999999999999e-06 2024-09-13T06:41:35.487 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:35.487 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:35.487 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:35.487 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589945+0000", 2024-09-13T06:41:35.487 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.2430000000000005e-06 2024-09-13T06:41:35.487 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:35.487 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:35.487 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:35.487 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589952+0000", 2024-09-13T06:41:35.487 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.3289999999999996e-06 2024-09-13T06:41:35.487 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:35.487 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:35.488 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:35.488 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.670280+0000", 2024-09-13T06:41:35.488 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.080328514000000004 2024-09-13T06:41:35.488 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:35.488 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:35.488 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:35.488 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.670376+0000", 2024-09-13T06:41:35.488 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.5752000000000001e-05 2024-09-13T06:41:35.488 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:35.488 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:35.488 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:35.488 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.670681+0000", 2024-09-13T06:41:35.488 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00030479699999999999 2024-09-13T06:41:35.488 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:35.489 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:35.489 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:35.489 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:35.489 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:35.489 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43302 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 475136~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:35.489 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589958+0000", 2024-09-13T06:41:35.489 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 73.832508497000006, 2024-09-13T06:41:35.489 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.081402394000000003, 2024-09-13T06:41:35.489 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:35.489 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:35.489 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:35.489 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:35.489 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:35.489 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43302 2024-09-13T06:41:35.489 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:35.490 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:35.490 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:35.490 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:35.490 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589958+0000", 2024-09-13T06:41:35.490 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:35.490 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:35.490 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:35.490 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:35.490 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589958+0000", 2024-09-13T06:41:35.490 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:35.490 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:35.490 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:35.490 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:35.490 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589957+0000", 2024-09-13T06:41:35.491 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:35.491 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:35.491 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:35.491 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:35.491 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589960+0000", 2024-09-13T06:41:35.491 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.4939999999999999e-06 2024-09-13T06:41:35.491 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:35.491 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:35.491 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:35.491 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589969+0000", 2024-09-13T06:41:35.491 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.3520000000000007e-06 2024-09-13T06:41:35.491 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:35.491 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:35.491 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:35.491 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589976+0000", 2024-09-13T06:41:35.492 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.3030000000000002e-06 2024-09-13T06:41:35.492 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:35.492 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:35.492 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:35.492 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.670765+0000", 2024-09-13T06:41:35.492 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.080789154000000002 2024-09-13T06:41:35.492 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:35.492 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:35.492 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:35.492 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.670960+0000", 2024-09-13T06:41:35.492 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00019464300000000001 2024-09-13T06:41:35.492 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:35.492 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:35.493 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:35.493 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.671360+0000", 2024-09-13T06:41:35.493 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00040005200000000002 2024-09-13T06:41:35.493 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:35.493 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:35.493 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:35.493 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:35.493 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:35.493 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43303 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 489472~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:35.493 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589985+0000", 2024-09-13T06:41:35.493 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 73.832481548999993, 2024-09-13T06:41:35.493 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.082024333000000005, 2024-09-13T06:41:35.493 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:35.493 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:35.494 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:35.494 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:35.494 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:35.494 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43303 2024-09-13T06:41:35.494 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:35.494 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:35.494 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:35.494 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:35.494 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589985+0000", 2024-09-13T06:41:35.494 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:35.494 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:35.494 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:35.494 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:35.494 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589985+0000", 2024-09-13T06:41:35.495 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:35.495 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:35.495 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:35.495 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:35.495 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589984+0000", 2024-09-13T06:41:35.495 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:35.495 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:35.495 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:35.495 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:35.495 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589987+0000", 2024-09-13T06:41:35.495 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.726e-06 2024-09-13T06:41:35.495 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:35.495 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:35.495 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:35.496 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589996+0000", 2024-09-13T06:41:35.496 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.5459999999999992e-06 2024-09-13T06:41:35.496 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:35.496 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:35.496 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:35.496 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590003+0000", 2024-09-13T06:41:35.496 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.4229999999999999e-06 2024-09-13T06:41:35.496 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:35.496 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:35.496 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:35.496 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.671426+0000", 2024-09-13T06:41:35.496 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.081422704999999998 2024-09-13T06:41:35.496 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:35.496 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:35.497 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:35.497 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.671615+0000", 2024-09-13T06:41:35.497 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000188875 2024-09-13T06:41:35.497 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:35.497 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:35.497 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:35.497 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.672009+0000", 2024-09-13T06:41:35.497 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000394015 2024-09-13T06:41:35.497 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:35.497 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:35.497 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:35.497 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:35.497 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:35.497 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43304 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 503808~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:35.497 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.590039+0000", 2024-09-13T06:41:35.498 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 73.832427003999996, 2024-09-13T06:41:35.498 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.082573880000000002, 2024-09-13T06:41:35.498 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:35.498 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:35.498 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:35.498 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:35.498 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:35.498 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43304 2024-09-13T06:41:35.498 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:35.498 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:35.498 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:35.498 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:35.498 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590039+0000", 2024-09-13T06:41:35.498 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:35.499 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:35.499 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:35.499 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:35.499 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590039+0000", 2024-09-13T06:41:35.499 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:35.499 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:35.499 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:35.499 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:35.499 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590038+0000", 2024-09-13T06:41:35.499 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:35.499 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:35.499 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:35.499 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:35.499 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590042+0000", 2024-09-13T06:41:35.500 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.9500000000000003e-06 2024-09-13T06:41:35.500 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:35.500 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:35.500 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:35.500 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590052+0000", 2024-09-13T06:41:35.500 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.3919999999999992e-06 2024-09-13T06:41:35.500 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:35.500 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:35.500 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:35.500 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590059+0000", 2024-09-13T06:41:35.500 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.7970000000000001e-06 2024-09-13T06:41:35.500 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:35.500 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:35.500 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:35.501 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.672078+0000", 2024-09-13T06:41:35.501 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.082018778000000001 2024-09-13T06:41:35.501 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:35.501 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:35.501 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:35.501 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.672266+0000", 2024-09-13T06:41:35.501 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00018807399999999999 2024-09-13T06:41:35.501 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:35.501 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:35.501 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:35.501 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.672613+0000", 2024-09-13T06:41:35.501 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00034677599999999997 2024-09-13T06:41:35.501 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:35.502 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:35.502 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:35.502 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:35.502 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:35.502 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43305 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 518144~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:35.502 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.590136+0000", 2024-09-13T06:41:35.502 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 73.832329815999998, 2024-09-13T06:41:35.502 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.082988206999999994, 2024-09-13T06:41:35.502 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:35.502 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:35.502 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:35.502 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:35.502 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:35.503 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43305 2024-09-13T06:41:35.503 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:35.503 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:35.503 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:35.503 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:35.503 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590136+0000", 2024-09-13T06:41:35.503 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:35.503 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:35.503 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:35.503 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:35.503 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590136+0000", 2024-09-13T06:41:35.503 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:35.503 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:35.503 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:35.504 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:35.504 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590135+0000", 2024-09-13T06:41:35.504 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:35.504 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:35.504 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:35.504 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:35.504 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590139+0000", 2024-09-13T06:41:35.504 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.9489999999999998e-06 2024-09-13T06:41:35.504 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:35.504 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:35.504 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:35.504 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590148+0000", 2024-09-13T06:41:35.504 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.9830000000000002e-06 2024-09-13T06:41:35.504 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:35.505 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:35.505 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:35.505 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590156+0000", 2024-09-13T06:41:35.505 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5229999999999998e-06 2024-09-13T06:41:35.505 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:35.505 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:35.505 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:35.505 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.672709+0000", 2024-09-13T06:41:35.505 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.082552886000000006 2024-09-13T06:41:35.505 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:35.505 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:35.505 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:35.505 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.672816+0000", 2024-09-13T06:41:35.505 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000107736 2024-09-13T06:41:35.505 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:35.506 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:35.506 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:35.506 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.673124+0000", 2024-09-13T06:41:35.506 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00030804900000000002 2024-09-13T06:41:35.506 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:35.506 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:35.506 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:35.506 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:35.506 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:35.506 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:66818 3.17 3.50afe697 (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e100)", 2024-09-13T06:41:35.506 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:53.498942+0000", 2024-09-13T06:41:35.506 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 41.923523631000002, 2024-09-13T06:41:35.506 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.011231284, 2024-09-13T06:41:35.506 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:35.506 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:41:35.507 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:35.507 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:35.507 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:35.507 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 66818 2024-09-13T06:41:35.507 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:35.507 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:35.507 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:35.507 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:35.507 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:53.498942+0000", 2024-09-13T06:41:35.507 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:35.507 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:35.507 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:35.507 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:35.507 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:53.498942+0000", 2024-09-13T06:41:35.507 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:35.508 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:35.508 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:35.508 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:35.508 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:53.498939+0000", 2024-09-13T06:41:35.508 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999967 2024-09-13T06:41:35.508 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:35.508 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:35.508 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:35.508 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:53.498954+0000", 2024-09-13T06:41:35.508 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5028000000000001e-05 2024-09-13T06:41:35.508 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:35.508 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:35.508 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:35.508 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:53.498986+0000", 2024-09-13T06:41:35.508 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.1993999999999999e-05 2024-09-13T06:41:35.509 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:35.509 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:35.509 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:35.509 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:53.499001+0000", 2024-09-13T06:41:35.509 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5166e-05 2024-09-13T06:41:35.509 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:35.509 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:35.509 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:35.509 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:53.505097+0000", 2024-09-13T06:41:35.509 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0060955610000000002 2024-09-13T06:41:35.509 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:35.509 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:35.509 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:41:35.509 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:53.505108+0000", 2024-09-13T06:41:35.510 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.084e-05 2024-09-13T06:41:35.510 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:35.510 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:35.510 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:35.510 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:54.510158+0000", 2024-09-13T06:41:35.510 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0050497549999999 2024-09-13T06:41:35.510 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:35.510 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:35.510 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:35.510 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:54.510174+0000", 2024-09-13T06:41:35.510 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6164e-05 2024-09-13T06:41:35.510 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:35.510 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:35.510 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:35.511 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:35.511 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:35.511 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:69764 3.2 3:47f10058:::rbd_data.11214956a993.0000000000000004:head [write-same] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e117)", 2024-09-13T06:41:35.511 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:41:11.371147+0000", 2024-09-13T06:41:35.511 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 24.051319321000001, 2024-09-13T06:41:35.511 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.03470167, 2024-09-13T06:41:35.511 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:35.511 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:41:35.511 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:35.511 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:35.511 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:35.511 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 69764 2024-09-13T06:41:35.511 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:35.511 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:35.511 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:35.512 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:35.512 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:11.371147+0000", 2024-09-13T06:41:35.512 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:35.512 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:35.512 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:35.512 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:35.512 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:11.371147+0000", 2024-09-13T06:41:35.512 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:35.512 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:35.512 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:35.512 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:35.512 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:11.371144+0000", 2024-09-13T06:41:35.512 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999967 2024-09-13T06:41:35.512 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:35.512 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:35.513 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:35.513 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:11.371161+0000", 2024-09-13T06:41:35.513 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7669e-05 2024-09-13T06:41:35.513 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:35.513 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:35.513 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:35.513 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:11.371198+0000", 2024-09-13T06:41:35.513 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.7014000000000002e-05 2024-09-13T06:41:35.513 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:35.513 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:35.513 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:35.513 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:11.371216+0000", 2024-09-13T06:41:35.513 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7425e-05 2024-09-13T06:41:35.513 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:35.514 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:35.514 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:35.514 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:11.371365+0000", 2024-09-13T06:41:35.514 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000149245 2024-09-13T06:41:35.514 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:35.514 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:35.514 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op must wait for map", 2024-09-13T06:41:35.514 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:11.371385+0000", 2024-09-13T06:41:35.514 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.0018999999999999e-05 2024-09-13T06:41:35.514 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:35.514 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:35.514 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:35.514 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:11.378406+0000", 2024-09-13T06:41:35.514 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0070207179999999996 2024-09-13T06:41:35.515 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:35.515 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:35.515 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:41:35.515 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:11.378429+0000", 2024-09-13T06:41:35.515 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.3453999999999999e-05 2024-09-13T06:41:35.515 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:35.515 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:35.515 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:35.515 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:12.405667+0000", 2024-09-13T06:41:35.515 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0272381690000001 2024-09-13T06:41:35.515 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:35.515 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:35.515 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:35.515 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:12.405848+0000", 2024-09-13T06:41:35.515 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00018112 2024-09-13T06:41:35.515 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:35.516 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:35.516 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:35.516 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:35.516 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:35.516 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:70346 3.16 3:69d35907:::rbd_object_map.11214956a993:head [read 0~36] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e122)", 2024-09-13T06:41:35.516 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:41:16.390917+0000", 2024-09-13T06:41:35.516 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 19.031549268999999, 2024-09-13T06:41:35.516 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.99327479799999996, 2024-09-13T06:41:35.516 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:35.516 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:35.516 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:35.516 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:35.516 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:35.517 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 70346 2024-09-13T06:41:35.517 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:35.517 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:35.517 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:35.517 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:35.517 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:16.390917+0000", 2024-09-13T06:41:35.517 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:35.517 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:35.517 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:35.517 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:35.517 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:16.390917+0000", 2024-09-13T06:41:35.517 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:35.517 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:35.517 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:35.517 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:35.518 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:16.390916+0000", 2024-09-13T06:41:35.518 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999986 2024-09-13T06:41:35.518 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:35.518 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:35.518 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:35.518 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:16.390922+0000", 2024-09-13T06:41:35.518 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.0480000000000004e-06 2024-09-13T06:41:35.518 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:35.518 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:35.518 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:35.518 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:16.390933+0000", 2024-09-13T06:41:35.518 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1387e-05 2024-09-13T06:41:35.518 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:35.518 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:35.519 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:35.519 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:16.390939+0000", 2024-09-13T06:41:35.519 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.8039999999999998e-06 2024-09-13T06:41:35.519 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:35.519 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:35.519 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:35.519 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:16.390983+0000", 2024-09-13T06:41:35.519 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.4663000000000003e-05 2024-09-13T06:41:35.519 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:35.519 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:35.519 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:41:35.519 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:16.390991+0000", 2024-09-13T06:41:35.519 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.8059999999999995e-06 2024-09-13T06:41:35.519 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:35.519 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:35.520 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:35.520 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:17.383624+0000", 2024-09-13T06:41:35.520 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.99263277299999997 2024-09-13T06:41:35.520 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:35.520 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:35.520 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:35.520 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:17.383891+0000", 2024-09-13T06:41:35.520 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00026717599999999999 2024-09-13T06:41:35.520 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:35.520 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:35.520 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:35.520 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:17.384192+0000", 2024-09-13T06:41:35.520 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00030047400000000001 2024-09-13T06:41:35.520 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:35.520 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:35.521 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:35.521 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:35.521 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:35.521 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:41:35.522 INFO:teuthology.orchestra.run.smithi081.stderr:nodeep-scrub is unset 2024-09-13T06:41:35.522 INFO:teuthology.orchestra.run.smithi081.stderr:set osd.0 primary-affinity to 0 (802) 2024-09-13T06:41:35.523 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-13T06:41:35.524 INFO:tasks.ceph.osd.6.smithi139.stderr:2024-09-13T06:41:35.518+0000 7fcd02c5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26385) UID: 0 2024-09-13T06:41:35.624 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:41:35.622+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:41:35.691 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:41:35.691 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [], 2024-09-13T06:41:35.691 INFO:teuthology.orchestra.run.smithi139.stdout: "num_ops": 0 2024-09-13T06:41:35.692 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:41:35.705 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-13T06:41:35.724 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:41:35.722+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:41:35.822 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:41:35.823 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [], 2024-09-13T06:41:35.823 INFO:teuthology.orchestra.run.smithi139.stdout: "complaint_time": 30, 2024-09-13T06:41:35.823 INFO:teuthology.orchestra.run.smithi139.stdout: "num_blocked_ops": 0 2024-09-13T06:41:35.823 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:41:35.825 INFO:tasks.ceph.osd.6.smithi139.stderr:2024-09-13T06:41:35.822+0000 7fcd02c5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26385) UID: 0 2024-09-13T06:41:35.836 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-13T06:41:35.926 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:41:35.922+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:41:36.004 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:41:36.004 INFO:teuthology.orchestra.run.smithi139.stdout: "size": 20, 2024-09-13T06:41:36.004 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 600, 2024-09-13T06:41:36.005 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [ 2024-09-13T06:41:36.005 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:36.005 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27854 3.a 3:537b3559:::rbd_data.1121f2c5ee81.0000000000000016:13 [read 335872~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:36.005 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.658750+0000", 2024-09-13T06:41:36.005 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 99.343671310000005, 2024-09-13T06:41:36.005 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.037969532, 2024-09-13T06:41:36.005 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:36.005 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:36.005 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:36.005 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:36.005 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:36.005 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27854 2024-09-13T06:41:36.006 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:36.006 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:36.006 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:36.006 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:36.006 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658750+0000", 2024-09-13T06:41:36.006 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:36.006 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:36.006 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:36.006 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:36.006 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658750+0000", 2024-09-13T06:41:36.006 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:36.006 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:36.006 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:36.007 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:36.007 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658749+0000", 2024-09-13T06:41:36.007 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:36.007 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:36.007 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:36.007 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:36.007 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658757+0000", 2024-09-13T06:41:36.007 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.7389999999999999e-06 2024-09-13T06:41:36.007 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:36.007 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:36.007 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:36.007 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658763+0000", 2024-09-13T06:41:36.007 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.7769999999999999e-06 2024-09-13T06:41:36.008 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:36.008 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:36.008 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:36.008 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658767+0000", 2024-09-13T06:41:36.008 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.1749999999999998e-06 2024-09-13T06:41:36.008 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:36.008 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:36.008 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:36.008 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.696322+0000", 2024-09-13T06:41:36.008 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.037554772 2024-09-13T06:41:36.008 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:36.008 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:36.008 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:36.008 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.696418+0000", 2024-09-13T06:41:36.009 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6050000000000004e-05 2024-09-13T06:41:36.009 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:36.009 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:36.009 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:36.009 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.696719+0000", 2024-09-13T06:41:36.009 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00030138499999999999 2024-09-13T06:41:36.009 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:36.009 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:36.009 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:36.009 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:36.009 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:36.009 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27855 3.a 3:537b3559:::rbd_data.1121f2c5ee81.0000000000000016:13 [read 380928~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:36.009 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.658771+0000", 2024-09-13T06:41:36.010 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 99.343650065999995, 2024-09-13T06:41:36.010 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.038326354, 2024-09-13T06:41:36.010 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:36.010 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:36.010 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:36.010 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:36.010 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:36.010 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27855 2024-09-13T06:41:36.010 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:36.010 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:36.010 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:36.010 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:36.010 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658771+0000", 2024-09-13T06:41:36.010 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:36.011 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:36.011 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:36.011 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:36.011 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658771+0000", 2024-09-13T06:41:36.011 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:36.011 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:36.011 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:36.011 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:36.011 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658770+0000", 2024-09-13T06:41:36.011 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:36.011 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:36.011 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:36.011 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:36.011 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658772+0000", 2024-09-13T06:41:36.011 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.0930000000000001e-06 2024-09-13T06:41:36.012 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:36.012 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:36.012 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:36.012 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658778+0000", 2024-09-13T06:41:36.012 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.2730000000000002e-06 2024-09-13T06:41:36.012 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:36.012 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:36.012 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:36.012 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658782+0000", 2024-09-13T06:41:36.012 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0879999999999997e-06 2024-09-13T06:41:36.012 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:36.012 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:36.012 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:36.012 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.696770+0000", 2024-09-13T06:41:36.013 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.037988145000000001 2024-09-13T06:41:36.013 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:36.013 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:36.013 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:36.013 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.696852+0000", 2024-09-13T06:41:36.013 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.2039999999999994e-05 2024-09-13T06:41:36.013 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:36.013 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:36.013 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:36.013 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.697097+0000", 2024-09-13T06:41:36.013 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00024508800000000002 2024-09-13T06:41:36.013 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:36.013 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:36.014 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:36.014 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:36.014 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:36.014 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27856 3.a 3:537b3559:::rbd_data.1121f2c5ee81.0000000000000016:13 [read 405504~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:36.014 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.658786+0000", 2024-09-13T06:41:36.014 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 99.343634949999995, 2024-09-13T06:41:36.014 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.038736029999999998, 2024-09-13T06:41:36.014 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:36.014 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:36.014 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:36.014 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:36.014 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:36.014 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27856 2024-09-13T06:41:36.014 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:36.014 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:36.015 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:36.015 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:36.015 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658786+0000", 2024-09-13T06:41:36.015 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:36.015 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:36.015 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:36.015 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:36.015 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658786+0000", 2024-09-13T06:41:36.015 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:36.015 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:36.015 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:36.015 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:36.015 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658785+0000", 2024-09-13T06:41:36.015 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:36.015 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:36.016 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:36.016 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:36.016 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658787+0000", 2024-09-13T06:41:36.016 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.0040000000000002e-06 2024-09-13T06:41:36.016 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:36.016 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:36.016 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:36.016 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658793+0000", 2024-09-13T06:41:36.016 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.2410000000000003e-06 2024-09-13T06:41:36.016 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:36.016 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:36.016 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:36.016 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658797+0000", 2024-09-13T06:41:36.016 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.1330000000000001e-06 2024-09-13T06:41:36.016 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:36.017 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:36.017 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:36.017 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.697176+0000", 2024-09-13T06:41:36.017 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.038379074999999999 2024-09-13T06:41:36.017 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:36.017 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:36.017 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:36.017 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.697275+0000", 2024-09-13T06:41:36.017 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.8819000000000004e-05 2024-09-13T06:41:36.017 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:36.017 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:36.017 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:36.017 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.697522+0000", 2024-09-13T06:41:36.017 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00024719999999999999 2024-09-13T06:41:36.017 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:36.017 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:36.018 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:36.018 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:36.018 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:36.018 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27857 3.a 3:537b3559:::rbd_data.1121f2c5ee81.0000000000000016:13 [read 475136~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:36.018 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.658845+0000", 2024-09-13T06:41:36.018 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 99.343575947000005, 2024-09-13T06:41:36.018 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039112570999999999, 2024-09-13T06:41:36.018 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:36.018 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:36.019 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:36.019 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:36.019 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:36.019 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27857 2024-09-13T06:41:36.019 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:36.019 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:36.019 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:36.019 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:36.019 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658845+0000", 2024-09-13T06:41:36.019 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:36.020 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:36.020 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:36.020 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:36.020 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658845+0000", 2024-09-13T06:41:36.020 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:36.020 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:36.020 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:36.020 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:36.020 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658844+0000", 2024-09-13T06:41:36.020 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999986 2024-09-13T06:41:36.020 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:36.020 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:36.020 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:36.021 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658868+0000", 2024-09-13T06:41:36.021 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.4615000000000001e-05 2024-09-13T06:41:36.021 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:36.021 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:36.021 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:36.021 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658884+0000", 2024-09-13T06:41:36.021 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5401999999999999e-05 2024-09-13T06:41:36.021 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:36.021 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:36.021 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:36.021 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658896+0000", 2024-09-13T06:41:36.021 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2509e-05 2024-09-13T06:41:36.022 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:36.022 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:36.022 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:36.022 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.697571+0000", 2024-09-13T06:41:36.022 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.038675107 2024-09-13T06:41:36.022 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:36.022 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:36.022 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:36.022 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.697658+0000", 2024-09-13T06:41:36.022 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6349999999999998e-05 2024-09-13T06:41:36.022 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:36.022 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:36.022 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:36.022 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.697957+0000", 2024-09-13T06:41:36.023 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00029986100000000001 2024-09-13T06:41:36.023 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:36.023 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:36.023 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:36.023 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:36.023 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:36.023 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27858 3.a 3:537b3559:::rbd_data.1121f2c5ee81.0000000000000016:13 [read 499712~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:36.023 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.658905+0000", 2024-09-13T06:41:36.023 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 99.343515397000004, 2024-09-13T06:41:36.023 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039475392999999998, 2024-09-13T06:41:36.023 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:36.023 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:36.023 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:36.024 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:36.024 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:36.024 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27858 2024-09-13T06:41:36.024 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:36.024 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:36.024 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:36.024 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:36.024 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658905+0000", 2024-09-13T06:41:36.024 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:36.024 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:36.024 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:36.024 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:36.024 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658905+0000", 2024-09-13T06:41:36.025 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:36.025 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:36.025 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:36.025 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:36.025 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658905+0000", 2024-09-13T06:41:36.025 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:36.025 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:36.025 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:36.025 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:36.025 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658909+0000", 2024-09-13T06:41:36.025 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.831e-06 2024-09-13T06:41:36.025 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:36.026 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:36.026 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:36.026 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658920+0000", 2024-09-13T06:41:36.026 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0936e-05 2024-09-13T06:41:36.026 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:36.026 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:36.026 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:36.026 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658929+0000", 2024-09-13T06:41:36.026 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.2749999999999995e-06 2024-09-13T06:41:36.026 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:36.026 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:36.026 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:36.026 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.697990+0000", 2024-09-13T06:41:36.026 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039061625000000003 2024-09-13T06:41:36.027 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:36.027 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:36.027 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:36.027 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.698077+0000", 2024-09-13T06:41:36.027 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6922000000000006e-05 2024-09-13T06:41:36.027 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:36.027 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:36.027 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:36.027 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.698381+0000", 2024-09-13T06:41:36.027 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00030360599999999999 2024-09-13T06:41:36.027 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:36.027 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:36.027 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:36.028 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:36.028 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:36.028 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27929 3.a 3:537b3559:::rbd_data.1121f2c5ee81.0000000000000016:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:36.028 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.659338+0000", 2024-09-13T06:41:36.028 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 99.343082566000007, 2024-09-13T06:41:36.028 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039351214000000002, 2024-09-13T06:41:36.028 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:36.028 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:36.028 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:36.028 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:36.028 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:36.028 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27929 2024-09-13T06:41:36.028 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:36.029 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:36.029 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:36.029 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:36.029 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.659338+0000", 2024-09-13T06:41:36.029 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:36.029 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:36.029 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:36.029 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:36.029 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.659338+0000", 2024-09-13T06:41:36.029 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:36.029 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:36.029 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:36.029 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:36.029 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.659337+0000", 2024-09-13T06:41:36.030 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:36.030 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:36.030 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:36.030 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:36.030 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.659342+0000", 2024-09-13T06:41:36.030 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0799999999999999e-06 2024-09-13T06:41:36.030 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:36.030 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:36.030 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:36.030 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.659353+0000", 2024-09-13T06:41:36.030 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1798e-05 2024-09-13T06:41:36.030 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:36.030 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:36.030 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:36.031 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.659361+0000", 2024-09-13T06:41:36.031 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.8040000000000002e-06 2024-09-13T06:41:36.031 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:36.031 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:36.031 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:36.031 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.698449+0000", 2024-09-13T06:41:36.031 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039087519000000001 2024-09-13T06:41:36.031 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:36.031 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:36.031 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:36.031 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.698567+0000", 2024-09-13T06:41:36.031 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00011857 2024-09-13T06:41:36.031 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:36.031 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:36.032 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:36.032 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.698689+0000", 2024-09-13T06:41:36.032 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00012226699999999999 2024-09-13T06:41:36.032 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:36.032 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:36.032 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:36.032 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:36.032 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:36.032 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27974 3.a 3:537b3559:::rbd_data.1121f2c5ee81.0000000000000016:13 [read 32768~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:36.032 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.660102+0000", 2024-09-13T06:41:36.032 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 99.342318797999994, 2024-09-13T06:41:36.032 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.038972346999999997, 2024-09-13T06:41:36.032 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:36.033 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:36.033 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:36.033 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:36.033 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:36.033 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27974 2024-09-13T06:41:36.033 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:36.033 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:36.033 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:36.033 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:36.033 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660102+0000", 2024-09-13T06:41:36.033 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:36.034 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:36.034 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:36.034 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:36.034 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660102+0000", 2024-09-13T06:41:36.034 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:36.034 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:36.034 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:36.034 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:36.034 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660100+0000", 2024-09-13T06:41:36.034 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999976 2024-09-13T06:41:36.034 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:36.034 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:36.034 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:36.035 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660114+0000", 2024-09-13T06:41:36.035 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.4466e-05 2024-09-13T06:41:36.035 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:36.035 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:36.035 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:36.035 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660148+0000", 2024-09-13T06:41:36.035 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.3742999999999999e-05 2024-09-13T06:41:36.035 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:36.035 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:36.035 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:36.035 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660170+0000", 2024-09-13T06:41:36.035 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.2518e-05 2024-09-13T06:41:36.036 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:36.036 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:36.036 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:36.036 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.698719+0000", 2024-09-13T06:41:36.036 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.038548529999999998 2024-09-13T06:41:36.036 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:36.036 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:36.036 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:36.036 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.698806+0000", 2024-09-13T06:41:36.036 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.7179e-05 2024-09-13T06:41:36.036 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:36.036 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:36.036 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:36.037 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.699074+0000", 2024-09-13T06:41:36.037 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00026834800000000001 2024-09-13T06:41:36.037 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:36.037 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:36.037 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:36.037 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:36.037 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:36.037 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27975 3.a 3:537b3559:::rbd_data.1121f2c5ee81.0000000000000016:13 [read 57344~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:36.037 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.660189+0000", 2024-09-13T06:41:36.037 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 99.342231953999999, 2024-09-13T06:41:36.037 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039288678, 2024-09-13T06:41:36.037 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:36.037 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:36.038 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:36.038 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:36.038 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:36.038 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27975 2024-09-13T06:41:36.038 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:36.038 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:36.038 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:36.038 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:36.038 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660189+0000", 2024-09-13T06:41:36.038 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:36.038 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:36.038 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:36.038 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:36.038 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660189+0000", 2024-09-13T06:41:36.039 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:36.039 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:36.039 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:36.039 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:36.039 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660187+0000", 2024-09-13T06:41:36.039 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999981 2024-09-13T06:41:36.039 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:36.039 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:36.039 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:36.039 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660195+0000", 2024-09-13T06:41:36.039 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5610000000000001e-06 2024-09-13T06:41:36.039 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:36.039 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:36.040 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:36.040 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660212+0000", 2024-09-13T06:41:36.040 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7725999999999999e-05 2024-09-13T06:41:36.040 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:36.040 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:36.040 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:36.040 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660227+0000", 2024-09-13T06:41:36.040 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.43e-05 2024-09-13T06:41:36.040 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:36.040 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:36.040 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:36.040 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.699135+0000", 2024-09-13T06:41:36.040 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.038908336000000002 2024-09-13T06:41:36.040 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:36.041 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:36.041 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:36.041 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.699208+0000", 2024-09-13T06:41:36.041 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.3065000000000006e-05 2024-09-13T06:41:36.041 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:36.041 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:36.041 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:36.041 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.699478+0000", 2024-09-13T06:41:36.041 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00026946899999999999 2024-09-13T06:41:36.041 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:36.041 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:36.041 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:36.041 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:36.042 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:36.042 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27976 3.a 3:537b3559:::rbd_data.1121f2c5ee81.0000000000000016:13 [read 102400~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:36.042 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.660238+0000", 2024-09-13T06:41:36.042 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 99.342182790999999, 2024-09-13T06:41:36.042 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039636515999999997, 2024-09-13T06:41:36.042 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:36.042 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:36.042 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:36.042 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:36.042 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:36.042 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27976 2024-09-13T06:41:36.042 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:36.042 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:36.043 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:36.043 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:36.043 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660238+0000", 2024-09-13T06:41:36.043 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:36.043 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:36.043 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:36.043 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:36.043 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660238+0000", 2024-09-13T06:41:36.043 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:36.043 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:36.043 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:36.043 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:36.043 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660237+0000", 2024-09-13T06:41:36.044 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:36.044 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:36.044 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:36.044 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:36.044 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660243+0000", 2024-09-13T06:41:36.044 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.9909999999999999e-06 2024-09-13T06:41:36.044 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:36.044 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:36.044 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:36.044 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660259+0000", 2024-09-13T06:41:36.044 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6294e-05 2024-09-13T06:41:36.044 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:36.044 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:36.044 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:36.045 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660272+0000", 2024-09-13T06:41:36.045 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2714999999999999e-05 2024-09-13T06:41:36.045 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:36.045 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:36.045 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:36.045 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.699513+0000", 2024-09-13T06:41:36.045 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039240932999999999 2024-09-13T06:41:36.045 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:36.045 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:36.045 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:36.045 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.699604+0000", 2024-09-13T06:41:36.045 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.1367999999999997e-05 2024-09-13T06:41:36.045 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:36.046 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:36.046 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:36.046 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.699875+0000", 2024-09-13T06:41:36.046 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00027029499999999999 2024-09-13T06:41:36.046 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:36.046 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:36.046 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:36.046 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:36.046 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:36.046 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27977 3.a 3:537b3559:::rbd_data.1121f2c5ee81.0000000000000016:13 [read 126976~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:36.046 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.660284+0000", 2024-09-13T06:41:36.046 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 99.342137218999994, 2024-09-13T06:41:36.046 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039969945, 2024-09-13T06:41:36.047 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:36.047 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:36.047 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:36.047 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:36.047 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:36.047 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27977 2024-09-13T06:41:36.047 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:36.047 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:36.047 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:36.047 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:36.047 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660284+0000", 2024-09-13T06:41:36.047 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:36.047 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:36.048 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:36.048 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:36.048 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660284+0000", 2024-09-13T06:41:36.048 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:36.048 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:36.048 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:36.048 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:36.048 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660282+0000", 2024-09-13T06:41:36.048 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999986 2024-09-13T06:41:36.048 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:36.048 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:36.048 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:36.048 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660288+0000", 2024-09-13T06:41:36.049 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.2650000000000002e-06 2024-09-13T06:41:36.049 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:36.049 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:36.049 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:36.049 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660304+0000", 2024-09-13T06:41:36.049 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5430999999999998e-05 2024-09-13T06:41:36.049 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:36.049 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:36.049 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:36.049 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660316+0000", 2024-09-13T06:41:36.049 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.237e-05 2024-09-13T06:41:36.049 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:36.049 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:36.050 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:36.050 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.699907+0000", 2024-09-13T06:41:36.050 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039590735000000002 2024-09-13T06:41:36.050 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:36.050 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:36.050 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:36.050 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.699994+0000", 2024-09-13T06:41:36.050 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6996999999999994e-05 2024-09-13T06:41:36.050 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:36.050 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:36.050 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:36.050 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700254+0000", 2024-09-13T06:41:36.050 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000259564 2024-09-13T06:41:36.050 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:36.051 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:36.051 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:36.051 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:36.051 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:36.051 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27978 3.a 3.9aacdeca (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:36.051 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.660327+0000", 2024-09-13T06:41:36.051 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 99.342093621000004, 2024-09-13T06:41:36.051 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039984858999999998, 2024-09-13T06:41:36.051 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:36.051 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:41:36.051 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:36.051 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:36.051 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:36.052 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27978 2024-09-13T06:41:36.052 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:36.052 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:36.052 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:36.052 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:36.052 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660327+0000", 2024-09-13T06:41:36.052 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:36.052 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:36.052 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:36.052 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:36.052 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660327+0000", 2024-09-13T06:41:36.052 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:36.052 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:36.053 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:36.053 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:36.053 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660326+0000", 2024-09-13T06:41:36.053 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:36.053 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:36.053 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:36.053 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:36.053 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660366+0000", 2024-09-13T06:41:36.053 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.9691000000000003e-05 2024-09-13T06:41:36.053 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:36.053 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:36.053 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:36.054 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660399+0000", 2024-09-13T06:41:36.054 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.3262000000000001e-05 2024-09-13T06:41:36.054 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:36.054 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:36.054 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:36.054 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660414+0000", 2024-09-13T06:41:36.054 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.4775e-05 2024-09-13T06:41:36.054 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:36.054 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:36.054 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:36.054 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700298+0000", 2024-09-13T06:41:36.054 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039883759999999997 2024-09-13T06:41:36.054 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:36.054 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:36.055 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:36.055 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700312+0000", 2024-09-13T06:41:36.055 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.4374e-05 2024-09-13T06:41:36.055 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:36.055 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:36.055 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:36.055 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:36.055 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:36.055 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27979 3.a 3.9aacdeca (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:36.055 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.660429+0000", 2024-09-13T06:41:36.055 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 99.341991753000002, 2024-09-13T06:41:36.055 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039921361000000002, 2024-09-13T06:41:36.055 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:36.056 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:41:36.056 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:36.056 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:36.056 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:36.056 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27979 2024-09-13T06:41:36.056 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:36.056 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:36.056 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:36.056 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:36.056 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660429+0000", 2024-09-13T06:41:36.056 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:36.056 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:36.056 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:36.057 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:36.057 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660429+0000", 2024-09-13T06:41:36.057 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:36.057 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:36.057 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:36.057 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:36.057 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660428+0000", 2024-09-13T06:41:36.057 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999986 2024-09-13T06:41:36.057 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:36.057 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:36.057 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:36.057 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660434+0000", 2024-09-13T06:41:36.057 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.8190000000000003e-06 2024-09-13T06:41:36.057 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:36.058 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:36.058 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:36.058 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660451+0000", 2024-09-13T06:41:36.058 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6963e-05 2024-09-13T06:41:36.058 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:36.058 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:36.058 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:36.058 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660485+0000", 2024-09-13T06:41:36.058 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.3414000000000002e-05 2024-09-13T06:41:36.058 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:36.058 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:36.058 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:36.058 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700342+0000", 2024-09-13T06:41:36.058 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039857278000000003 2024-09-13T06:41:36.059 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:36.059 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:36.059 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:36.059 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700350+0000", 2024-09-13T06:41:36.059 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.2930000000000001e-06 2024-09-13T06:41:36.059 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:36.059 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:36.059 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:36.059 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:36.059 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:36.059 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27980 3.a 3.9aacdeca (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:36.059 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.660497+0000", 2024-09-13T06:41:36.059 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 99.341923542000004, 2024-09-13T06:41:36.059 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039888034000000003, 2024-09-13T06:41:36.060 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:36.060 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:41:36.060 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:36.060 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:36.060 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:36.060 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27980 2024-09-13T06:41:36.060 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:36.060 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:36.060 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:36.060 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:36.060 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660497+0000", 2024-09-13T06:41:36.060 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:36.060 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:36.060 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:36.061 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:36.061 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660497+0000", 2024-09-13T06:41:36.061 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:36.061 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:36.061 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:36.061 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:36.061 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660496+0000", 2024-09-13T06:41:36.061 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:36.061 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:36.061 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:36.061 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:36.061 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660503+0000", 2024-09-13T06:41:36.061 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.4110000000000001e-06 2024-09-13T06:41:36.062 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:36.062 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:36.062 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:36.062 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660519+0000", 2024-09-13T06:41:36.062 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6180000000000001e-05 2024-09-13T06:41:36.062 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:36.062 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:36.062 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:36.062 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660544+0000", 2024-09-13T06:41:36.062 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.5177999999999998e-05 2024-09-13T06:41:36.062 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:36.062 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:36.062 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:36.062 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700377+0000", 2024-09-13T06:41:36.063 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039833434000000001 2024-09-13T06:41:36.063 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:36.063 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:36.063 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:36.063 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700385+0000", 2024-09-13T06:41:36.063 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.8800000000000008e-06 2024-09-13T06:41:36.063 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:36.063 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:36.063 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:36.063 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:36.063 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:36.063 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27981 3.a 3.9aacdeca (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:36.064 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.660556+0000", 2024-09-13T06:41:36.064 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 99.341865196000001, 2024-09-13T06:41:36.064 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039869989000000002, 2024-09-13T06:41:36.064 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:36.064 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:41:36.064 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:36.064 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:36.064 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:36.064 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27981 2024-09-13T06:41:36.064 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:36.064 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:36.064 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:36.064 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:36.065 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660556+0000", 2024-09-13T06:41:36.065 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:36.065 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:36.065 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:36.065 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:36.065 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660556+0000", 2024-09-13T06:41:36.065 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:36.065 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:36.065 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:36.065 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:36.065 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660555+0000", 2024-09-13T06:41:36.065 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:36.065 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:36.065 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:36.066 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:36.066 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660561+0000", 2024-09-13T06:41:36.066 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.088e-06 2024-09-13T06:41:36.066 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:36.066 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:36.066 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:36.066 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660577+0000", 2024-09-13T06:41:36.066 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6147999999999999e-05 2024-09-13T06:41:36.066 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:36.066 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:36.066 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:36.066 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660589+0000", 2024-09-13T06:41:36.066 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2551999999999999e-05 2024-09-13T06:41:36.067 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:36.067 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:36.067 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:36.067 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700414+0000", 2024-09-13T06:41:36.067 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039825007000000003 2024-09-13T06:41:36.067 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:36.067 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:36.067 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:36.067 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700426+0000", 2024-09-13T06:41:36.067 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1265e-05 2024-09-13T06:41:36.067 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:36.067 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:36.067 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:36.067 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:36.068 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:36.068 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27982 3.a 3.9aacdeca (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:36.068 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.660603+0000", 2024-09-13T06:41:36.068 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 99.341817601000002, 2024-09-13T06:41:36.068 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039874779999999999, 2024-09-13T06:41:36.068 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:36.068 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:41:36.068 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:36.068 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:36.068 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:36.068 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27982 2024-09-13T06:41:36.068 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:36.068 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:36.069 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:36.069 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:36.069 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660603+0000", 2024-09-13T06:41:36.069 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:36.069 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:36.069 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:36.069 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:36.069 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660603+0000", 2024-09-13T06:41:36.069 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:36.069 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:36.069 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:36.069 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:36.069 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660602+0000", 2024-09-13T06:41:36.070 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:36.070 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:36.070 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:36.070 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:36.070 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660653+0000", 2024-09-13T06:41:36.070 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.0862000000000002e-05 2024-09-13T06:41:36.070 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:36.070 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:36.070 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:36.070 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660697+0000", 2024-09-13T06:41:36.070 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.3773000000000003e-05 2024-09-13T06:41:36.070 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:36.070 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:36.071 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:36.071 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660712+0000", 2024-09-13T06:41:36.071 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5464999999999998e-05 2024-09-13T06:41:36.071 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:36.071 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:36.071 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:36.071 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700469+0000", 2024-09-13T06:41:36.071 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039756503999999998 2024-09-13T06:41:36.071 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:36.071 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:36.071 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:36.071 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700478+0000", 2024-09-13T06:41:36.072 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.1730000000000001e-06 2024-09-13T06:41:36.072 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:36.072 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:36.072 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:36.072 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:36.072 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:36.072 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27983 3.a 3.9aacdeca (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:36.072 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.660726+0000", 2024-09-13T06:41:36.072 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 99.341694325999995, 2024-09-13T06:41:36.072 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039804357999999998, 2024-09-13T06:41:36.072 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:36.072 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:41:36.072 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:36.073 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:36.073 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:36.073 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27983 2024-09-13T06:41:36.073 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:36.073 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:36.073 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:36.073 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:36.073 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660726+0000", 2024-09-13T06:41:36.073 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:36.073 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:36.073 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:36.073 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:36.073 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660726+0000", 2024-09-13T06:41:36.074 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:36.074 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:36.074 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:36.074 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:36.074 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660725+0000", 2024-09-13T06:41:36.074 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999986 2024-09-13T06:41:36.074 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:36.074 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:36.074 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:36.074 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660733+0000", 2024-09-13T06:41:36.074 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.9359999999999999e-06 2024-09-13T06:41:36.074 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:36.074 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:36.074 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:36.075 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660751+0000", 2024-09-13T06:41:36.075 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7679000000000001e-05 2024-09-13T06:41:36.075 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:36.075 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:36.075 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:36.075 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660764+0000", 2024-09-13T06:41:36.075 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3112000000000001e-05 2024-09-13T06:41:36.075 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:36.075 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:36.075 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:36.075 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700516+0000", 2024-09-13T06:41:36.075 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039752183000000003 2024-09-13T06:41:36.075 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:36.076 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:36.076 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:36.076 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700531+0000", 2024-09-13T06:41:36.076 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.4732999999999999e-05 2024-09-13T06:41:36.076 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:36.076 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:36.076 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:36.076 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:36.076 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:36.076 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27984 3.a 3.9aacdeca (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:36.076 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.660776+0000", 2024-09-13T06:41:36.076 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 99.341645223, 2024-09-13T06:41:36.077 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039795697999999997, 2024-09-13T06:41:36.077 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:36.077 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:41:36.077 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:36.077 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:36.077 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:36.077 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27984 2024-09-13T06:41:36.077 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:36.077 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:36.077 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:36.077 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:36.077 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660776+0000", 2024-09-13T06:41:36.077 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:36.077 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:36.078 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:36.078 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:36.078 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660776+0000", 2024-09-13T06:41:36.078 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:36.078 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:36.078 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:36.078 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:36.078 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660775+0000", 2024-09-13T06:41:36.078 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:36.078 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:36.078 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:36.078 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:36.078 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660780+0000", 2024-09-13T06:41:36.079 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.7849999999999997e-06 2024-09-13T06:41:36.079 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:36.079 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:36.079 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:36.079 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660799+0000", 2024-09-13T06:41:36.079 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.8794e-05 2024-09-13T06:41:36.079 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:36.079 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:36.079 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:36.079 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660812+0000", 2024-09-13T06:41:36.079 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3029e-05 2024-09-13T06:41:36.079 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:36.079 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:36.080 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:36.080 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700562+0000", 2024-09-13T06:41:36.080 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039749984000000002 2024-09-13T06:41:36.080 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:36.080 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:36.080 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:36.080 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700571+0000", 2024-09-13T06:41:36.080 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.1260000000000004e-06 2024-09-13T06:41:36.080 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:36.080 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:36.080 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:36.080 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:36.080 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:36.081 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27985 3.a 3.9aacdeca (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:36.081 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.660824+0000", 2024-09-13T06:41:36.081 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 99.341597171000004, 2024-09-13T06:41:36.081 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039784462, 2024-09-13T06:41:36.081 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:36.081 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:41:36.081 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:36.081 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:36.081 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:36.081 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27985 2024-09-13T06:41:36.081 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:36.081 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:36.082 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:36.082 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:36.082 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660824+0000", 2024-09-13T06:41:36.082 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:36.082 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:36.082 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:36.082 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:36.082 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660824+0000", 2024-09-13T06:41:36.082 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:36.082 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:36.082 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:36.082 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:36.082 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660823+0000", 2024-09-13T06:41:36.083 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:36.083 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:36.083 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:36.083 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:36.083 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660829+0000", 2024-09-13T06:41:36.083 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.9440000000000002e-06 2024-09-13T06:41:36.083 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:36.083 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:36.083 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:36.083 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660922+0000", 2024-09-13T06:41:36.083 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.2958e-05 2024-09-13T06:41:36.083 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:36.083 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:36.084 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:36.084 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660964+0000", 2024-09-13T06:41:36.084 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.2407000000000002e-05 2024-09-13T06:41:36.084 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:36.084 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:36.084 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:36.084 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700600+0000", 2024-09-13T06:41:36.084 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039635581000000003 2024-09-13T06:41:36.084 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:36.084 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:36.084 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:36.084 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700608+0000", 2024-09-13T06:41:36.085 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.5890000000000003e-06 2024-09-13T06:41:36.085 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:36.085 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:36.085 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:36.085 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:36.085 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:36.085 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:28023 3.10 3:0dedc28a:::rbd_data.1121f2c5ee81.0000000000000019:13 [read 475136~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:36.085 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.662072+0000", 2024-09-13T06:41:36.085 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 99.340349185999997, 2024-09-13T06:41:36.085 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.038086508999999998, 2024-09-13T06:41:36.085 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:36.085 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:36.086 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:36.086 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:36.086 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:36.086 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 28023 2024-09-13T06:41:36.086 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:36.086 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:36.086 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:36.086 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:36.086 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.662072+0000", 2024-09-13T06:41:36.086 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:36.087 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:36.087 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:36.087 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:36.087 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.662072+0000", 2024-09-13T06:41:36.087 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:36.087 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:36.087 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:36.087 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:36.087 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.662070+0000", 2024-09-13T06:41:36.087 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999986 2024-09-13T06:41:36.087 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:36.087 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:36.087 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:36.087 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.662076+0000", 2024-09-13T06:41:36.088 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.139e-06 2024-09-13T06:41:36.088 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:36.088 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:36.088 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:36.088 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.662094+0000", 2024-09-13T06:41:36.088 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7136999999999999e-05 2024-09-13T06:41:36.088 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:36.088 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:36.088 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:36.088 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.662124+0000", 2024-09-13T06:41:36.088 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.0528999999999999e-05 2024-09-13T06:41:36.088 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:36.089 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:36.089 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:36.089 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.699843+0000", 2024-09-13T06:41:36.089 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.037718415999999998 2024-09-13T06:41:36.089 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:36.089 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:36.089 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:36.089 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.699931+0000", 2024-09-13T06:41:36.089 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.8345999999999997e-05 2024-09-13T06:41:36.089 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:36.089 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:36.089 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:36.089 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700158+0000", 2024-09-13T06:41:36.089 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00022723099999999999 2024-09-13T06:41:36.090 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:36.090 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:36.090 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:36.090 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:36.090 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:36.090 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:28024 3.10 3.5143b7b0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:36.090 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.662137+0000", 2024-09-13T06:41:36.090 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 99.340283663999998, 2024-09-13T06:41:36.090 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.038056092999999999, 2024-09-13T06:41:36.090 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:36.090 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:41:36.090 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:36.091 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:36.091 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:36.091 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 28024 2024-09-13T06:41:36.091 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:36.091 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:36.091 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:36.091 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:36.091 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.662137+0000", 2024-09-13T06:41:36.091 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:36.091 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:36.091 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:36.091 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:36.091 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.662137+0000", 2024-09-13T06:41:36.092 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:36.092 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:36.092 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:36.092 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:36.092 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.662136+0000", 2024-09-13T06:41:36.092 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999986 2024-09-13T06:41:36.092 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:36.092 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:36.092 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:36.092 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.662142+0000", 2024-09-13T06:41:36.092 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.6930000000000001e-06 2024-09-13T06:41:36.092 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:36.092 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:36.092 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:36.093 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.662160+0000", 2024-09-13T06:41:36.093 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7863000000000002e-05 2024-09-13T06:41:36.093 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:36.093 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:36.093 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:36.093 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.662189+0000", 2024-09-13T06:41:36.093 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.8486000000000001e-05 2024-09-13T06:41:36.093 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:36.093 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:36.093 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:36.093 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700187+0000", 2024-09-13T06:41:36.093 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.037998331000000003 2024-09-13T06:41:36.093 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:36.094 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:36.094 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:36.094 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700193+0000", 2024-09-13T06:41:36.094 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.0909999999999998e-06 2024-09-13T06:41:36.094 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:36.094 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:36.094 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:36.094 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:36.094 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:36.094 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:41:36.096 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:41:36.090+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:41:36.096 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-13T06:41:36.196 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:41:36.194+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:41:36.227 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:41:36.227 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-13T06:41:36.227 INFO:teuthology.orchestra.run.smithi081.stdout: "num_ops": 0 2024-09-13T06:41:36.227 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:41:36.242 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-13T06:41:36.297 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:41:36.293+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:41:36.361 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:41:36.361 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-13T06:41:36.361 INFO:teuthology.orchestra.run.smithi081.stdout: "complaint_time": 30, 2024-09-13T06:41:36.361 INFO:teuthology.orchestra.run.smithi081.stdout: "num_blocked_ops": 0 2024-09-13T06:41:36.361 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:41:36.375 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-13T06:41:36.418 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:41:36.417+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:41:36.499 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:41:36.497+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:41:36.594 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:41:36.595 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 20, 2024-09-13T06:41:36.595 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 600, 2024-09-13T06:41:36.595 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [ 2024-09-13T06:41:36.595 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:36.595 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:37801 3.1 3:82e31015:::rbd_object_map.1121d8143c6e.0000000000000019:head [call] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e55)", 2024-09-13T06:41:36.595 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:05.646191+0000", 2024-09-13T06:41:36.595 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 90.948070068999996, 2024-09-13T06:41:36.595 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.72659507800000001, 2024-09-13T06:41:36.595 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:36.595 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:36.595 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:36.595 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:36.596 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:36.596 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 37801 2024-09-13T06:41:36.596 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:36.596 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:36.596 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:36.596 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:36.596 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:05.646191+0000", 2024-09-13T06:41:36.596 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:36.596 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:36.596 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:36.596 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:36.597 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:05.646191+0000", 2024-09-13T06:41:36.597 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:36.597 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:36.597 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:36.597 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:36.597 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:05.646188+0000", 2024-09-13T06:41:36.597 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999971 2024-09-13T06:41:36.597 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:36.597 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:36.597 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:36.597 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:05.646206+0000", 2024-09-13T06:41:36.597 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8182999999999999e-05 2024-09-13T06:41:36.597 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:36.598 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:36.598 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:36.598 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:05.646237+0000", 2024-09-13T06:41:36.598 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.1071000000000001e-05 2024-09-13T06:41:36.598 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:36.598 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:36.598 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:36.598 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:05.646251+0000", 2024-09-13T06:41:36.598 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3679000000000001e-05 2024-09-13T06:41:36.598 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:36.598 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:36.598 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:36.598 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:05.646321+0000", 2024-09-13T06:41:36.598 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.9831000000000003e-05 2024-09-13T06:41:36.598 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:36.599 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:36.599 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:41:36.599 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:05.646331+0000", 2024-09-13T06:41:36.599 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0242e-05 2024-09-13T06:41:36.599 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:36.599 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:36.599 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:36.599 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.371959+0000", 2024-09-13T06:41:36.599 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.72562817199999996 2024-09-13T06:41:36.599 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:36.599 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:36.599 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:36.599 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.372389+0000", 2024-09-13T06:41:36.600 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00042977400000000001 2024-09-13T06:41:36.600 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:36.600 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:36.600 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:36.600 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.372786+0000", 2024-09-13T06:41:36.600 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00039706099999999999 2024-09-13T06:41:36.600 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:36.600 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:36.600 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:36.600 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:36.601 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:36.601 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43009 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 489472~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:36.601 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.644660+0000", 2024-09-13T06:41:36.601 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 74.949601107000007, 2024-09-13T06:41:36.601 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123376071, 2024-09-13T06:41:36.601 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:36.601 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:36.601 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:36.601 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:36.601 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:36.601 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43009 2024-09-13T06:41:36.601 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:36.601 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:36.602 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:36.602 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:36.602 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.644660+0000", 2024-09-13T06:41:36.602 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:36.602 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:36.602 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:36.602 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:36.602 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.644660+0000", 2024-09-13T06:41:36.602 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:36.602 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:36.602 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:36.602 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:36.602 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.644659+0000", 2024-09-13T06:41:36.602 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:36.602 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:36.603 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:36.603 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:36.603 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.644662+0000", 2024-09-13T06:41:36.603 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4949999999999998e-06 2024-09-13T06:41:36.603 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:36.603 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:36.603 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:36.603 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.644669+0000", 2024-09-13T06:41:36.603 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.289e-06 2024-09-13T06:41:36.603 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:36.603 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:36.603 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:36.603 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.644674+0000", 2024-09-13T06:41:36.603 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.8840000000000002e-06 2024-09-13T06:41:36.603 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:36.604 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:36.604 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:36.604 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.767602+0000", 2024-09-13T06:41:36.604 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.122928158 2024-09-13T06:41:36.604 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:36.604 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:36.604 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:36.604 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.767676+0000", 2024-09-13T06:41:36.604 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3992999999999994e-05 2024-09-13T06:41:36.604 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:36.604 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:36.604 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:36.604 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.768036+0000", 2024-09-13T06:41:36.604 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00035966200000000001 2024-09-13T06:41:36.604 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:36.605 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:36.605 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:36.605 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:36.605 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:36.605 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43010 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 503808~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:36.605 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.644678+0000", 2024-09-13T06:41:36.605 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 74.949582781000004, 2024-09-13T06:41:36.605 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123728798, 2024-09-13T06:41:36.605 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:36.605 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:36.605 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:36.605 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:36.605 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:36.605 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43010 2024-09-13T06:41:36.606 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:36.606 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:36.606 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:36.606 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:36.606 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.644678+0000", 2024-09-13T06:41:36.606 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:36.606 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:36.606 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:36.606 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:36.606 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.644678+0000", 2024-09-13T06:41:36.606 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:36.606 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:36.606 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:36.606 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:36.606 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.644678+0000", 2024-09-13T06:41:36.607 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:36.607 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:36.607 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:36.607 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:36.607 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.644680+0000", 2024-09-13T06:41:36.607 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2050000000000001e-06 2024-09-13T06:41:36.607 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:36.607 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:36.607 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:36.607 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.644686+0000", 2024-09-13T06:41:36.607 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8440000000000003e-06 2024-09-13T06:41:36.607 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:36.607 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:36.607 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:36.607 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.644691+0000", 2024-09-13T06:41:36.608 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.118e-06 2024-09-13T06:41:36.608 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:36.608 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:36.608 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:36.608 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.768065+0000", 2024-09-13T06:41:36.608 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123374698 2024-09-13T06:41:36.608 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:36.608 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:36.608 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:36.608 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.768139+0000", 2024-09-13T06:41:36.608 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3934000000000001e-05 2024-09-13T06:41:36.608 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:36.608 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:36.608 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:36.608 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.768407+0000", 2024-09-13T06:41:36.609 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00026738800000000002 2024-09-13T06:41:36.609 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:36.609 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:36.609 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:36.609 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:36.609 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:36.609 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43181 3.17 3:ec5ebce4:::rbd_data.1121f5f2e1c0.0000000000000001:1f [read 319488~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:36.609 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.652968+0000", 2024-09-13T06:41:36.609 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 74.941292265000001, 2024-09-13T06:41:36.609 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.12363807, 2024-09-13T06:41:36.609 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:36.609 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:36.610 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:36.610 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:36.610 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:36.610 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43181 2024-09-13T06:41:36.610 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:36.610 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:36.610 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:36.610 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:36.610 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.652968+0000", 2024-09-13T06:41:36.610 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:36.610 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:36.610 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:36.610 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:36.610 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.652968+0000", 2024-09-13T06:41:36.610 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:36.611 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:36.611 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:36.611 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:36.611 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.652968+0000", 2024-09-13T06:41:36.611 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:36.611 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:36.611 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:36.611 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:36.611 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.652970+0000", 2024-09-13T06:41:36.611 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2409999999999998e-06 2024-09-13T06:41:36.611 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:36.611 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:36.611 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:36.611 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.652976+0000", 2024-09-13T06:41:36.612 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0079999999999999e-06 2024-09-13T06:41:36.612 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:36.612 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:36.612 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:36.612 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.652981+0000", 2024-09-13T06:41:36.612 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4390000000000002e-06 2024-09-13T06:41:36.612 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:36.612 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:36.612 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:36.612 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.776275+0000", 2024-09-13T06:41:36.612 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.12329396099999999 2024-09-13T06:41:36.613 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:36.613 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:36.613 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:36.613 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.776316+0000", 2024-09-13T06:41:36.613 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.1244e-05 2024-09-13T06:41:36.613 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:36.613 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:36.613 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:36.613 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.776607+0000", 2024-09-13T06:41:36.614 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00029051199999999999 2024-09-13T06:41:36.614 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:36.614 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:36.614 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:36.614 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:36.614 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:36.614 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43182 3.17 3:ec5ebce4:::rbd_data.1121f5f2e1c0.0000000000000001:1f [read 333824~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:36.614 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.652985+0000", 2024-09-13T06:41:36.614 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 74.941275456, 2024-09-13T06:41:36.614 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123926616, 2024-09-13T06:41:36.615 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:36.615 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:36.615 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:36.615 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:36.615 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:36.615 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43182 2024-09-13T06:41:36.615 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:36.615 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:36.615 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:36.615 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:36.615 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.652985+0000", 2024-09-13T06:41:36.615 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:36.615 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:36.615 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:36.616 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:36.616 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.652985+0000", 2024-09-13T06:41:36.616 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:36.616 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:36.616 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:36.616 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:36.616 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.652985+0000", 2024-09-13T06:41:36.616 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:36.616 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:36.616 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:36.616 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:36.616 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.652987+0000", 2024-09-13T06:41:36.616 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0899999999999999e-06 2024-09-13T06:41:36.616 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:36.617 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:36.617 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:36.617 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.652994+0000", 2024-09-13T06:41:36.617 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3100000000000003e-06 2024-09-13T06:41:36.617 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:36.617 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:36.617 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:36.617 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.653000+0000", 2024-09-13T06:41:36.617 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2020000000000003e-06 2024-09-13T06:41:36.617 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:36.617 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:36.617 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:36.617 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.776635+0000", 2024-09-13T06:41:36.617 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.12363529400000001 2024-09-13T06:41:36.618 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:36.618 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:36.618 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:36.618 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.776676+0000", 2024-09-13T06:41:36.618 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.0745999999999999e-05 2024-09-13T06:41:36.618 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:36.618 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:36.618 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:36.618 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.776912+0000", 2024-09-13T06:41:36.618 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00023631300000000001 2024-09-13T06:41:36.618 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:36.618 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:36.618 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:36.619 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:36.619 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:36.619 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43192 3.17 3:ec5ebce4:::rbd_data.1121f5f2e1c0.0000000000000001:1f [read 466944~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:36.619 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.656622+0000", 2024-09-13T06:41:36.619 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 74.937638399999997, 2024-09-13T06:41:36.619 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123503136, 2024-09-13T06:41:36.619 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:36.619 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:36.619 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:36.619 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:36.619 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:36.619 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43192 2024-09-13T06:41:36.619 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:36.619 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:36.620 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:36.620 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:36.620 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656622+0000", 2024-09-13T06:41:36.620 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:36.620 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:36.620 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:36.620 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:36.620 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656622+0000", 2024-09-13T06:41:36.621 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:36.621 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:36.621 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:36.621 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:36.621 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656622+0000", 2024-09-13T06:41:36.621 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:41:36.621 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:36.621 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:36.621 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:36.621 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656623+0000", 2024-09-13T06:41:36.621 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2079999999999999e-06 2024-09-13T06:41:36.621 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:36.621 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:36.622 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:36.622 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656627+0000", 2024-09-13T06:41:36.622 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.4819999999999999e-06 2024-09-13T06:41:36.622 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:36.622 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:36.622 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:36.622 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656629+0000", 2024-09-13T06:41:36.622 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.582e-06 2024-09-13T06:41:36.622 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:36.622 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:36.622 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:36.622 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.779866+0000", 2024-09-13T06:41:36.622 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.12323638100000001 2024-09-13T06:41:36.622 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:36.622 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:36.623 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:36.623 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.779905+0000", 2024-09-13T06:41:36.623 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.9529e-05 2024-09-13T06:41:36.623 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:36.623 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:36.623 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:36.623 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.780125+0000", 2024-09-13T06:41:36.623 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000220168 2024-09-13T06:41:36.623 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:36.623 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:36.623 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:36.623 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:36.623 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:36.623 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43193 3.17 3:ec5ebce4:::rbd_data.1121f5f2e1c0.0000000000000001:1f [read 481280~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:36.623 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.656635+0000", 2024-09-13T06:41:36.624 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 74.937625916000002, 2024-09-13T06:41:36.624 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.12374478999999999, 2024-09-13T06:41:36.624 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:36.624 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:36.624 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:36.624 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:36.624 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:36.624 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43193 2024-09-13T06:41:36.624 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:36.624 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:36.624 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:36.624 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:36.624 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656635+0000", 2024-09-13T06:41:36.624 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:36.625 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:36.625 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:36.625 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:36.625 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656635+0000", 2024-09-13T06:41:36.625 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:36.625 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:36.625 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:36.625 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:36.625 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656635+0000", 2024-09-13T06:41:36.625 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:41:36.625 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:36.625 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:36.626 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:36.626 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656636+0000", 2024-09-13T06:41:36.626 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.544e-06 2024-09-13T06:41:36.626 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:36.626 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:36.626 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:36.626 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656639+0000", 2024-09-13T06:41:36.626 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.0879999999999999e-06 2024-09-13T06:41:36.626 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:36.626 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:36.626 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:36.626 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656642+0000", 2024-09-13T06:41:36.626 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5799999999999999e-06 2024-09-13T06:41:36.626 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:36.626 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:36.627 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:36.627 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.780151+0000", 2024-09-13T06:41:36.627 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123509035 2024-09-13T06:41:36.627 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:36.627 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:36.627 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:36.627 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.780191+0000", 2024-09-13T06:41:36.627 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.9758000000000001e-05 2024-09-13T06:41:36.627 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:36.627 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:36.627 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:36.627 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.780380+0000", 2024-09-13T06:41:36.627 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000189023 2024-09-13T06:41:36.628 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:36.628 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:36.628 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:36.628 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:36.628 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:36.628 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43194 3.17 3:ec5ebce4:::rbd_data.1121f5f2e1c0.0000000000000001:1f [read 495616~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:36.628 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.656645+0000", 2024-09-13T06:41:36.628 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 74.937615262999998, 2024-09-13T06:41:36.628 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.124088483, 2024-09-13T06:41:36.628 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:36.628 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:36.628 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:36.628 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:36.628 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:36.628 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43194 2024-09-13T06:41:36.629 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:36.629 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:36.629 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:36.629 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:36.629 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656645+0000", 2024-09-13T06:41:36.629 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:36.629 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:36.629 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:36.629 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:36.629 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656645+0000", 2024-09-13T06:41:36.629 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:36.629 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:36.629 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:36.630 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:36.630 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656645+0000", 2024-09-13T06:41:36.630 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:36.630 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:36.630 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:36.630 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:36.630 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656647+0000", 2024-09-13T06:41:36.631 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9180000000000001e-06 2024-09-13T06:41:36.631 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:36.631 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:36.631 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:36.631 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656653+0000", 2024-09-13T06:41:36.631 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7860000000000002e-06 2024-09-13T06:41:36.632 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:36.632 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:36.632 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:36.632 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656658+0000", 2024-09-13T06:41:36.632 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6949999999999999e-06 2024-09-13T06:41:36.632 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:36.633 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:36.633 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:36.633 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.780406+0000", 2024-09-13T06:41:36.633 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123748657 2024-09-13T06:41:36.633 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:36.633 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:36.633 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:36.634 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.780446+0000", 2024-09-13T06:41:36.634 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.9360999999999998e-05 2024-09-13T06:41:36.634 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:36.634 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:36.634 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:36.634 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.780734+0000", 2024-09-13T06:41:36.634 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00028838399999999998 2024-09-13T06:41:36.634 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:36.634 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:36.635 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:36.635 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:36.635 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:36.635 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43240 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 106496~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:36.635 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.660672+0000", 2024-09-13T06:41:36.635 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 74.933588900000004, 2024-09-13T06:41:36.635 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123612707, 2024-09-13T06:41:36.635 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:36.635 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:36.635 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:36.635 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:36.635 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:36.635 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43240 2024-09-13T06:41:36.636 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:36.636 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:36.636 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:36.636 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:36.636 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660672+0000", 2024-09-13T06:41:36.636 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:36.636 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:36.636 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:36.636 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:36.636 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660672+0000", 2024-09-13T06:41:36.637 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:36.637 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:36.637 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:36.637 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:36.637 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660671+0000", 2024-09-13T06:41:36.637 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:36.637 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:36.637 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:36.637 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:36.637 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660673+0000", 2024-09-13T06:41:36.637 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.652e-06 2024-09-13T06:41:36.638 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:36.638 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:36.638 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:36.638 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660677+0000", 2024-09-13T06:41:36.638 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.2509999999999996e-06 2024-09-13T06:41:36.638 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:36.638 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:36.638 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:36.638 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660680+0000", 2024-09-13T06:41:36.638 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.8150000000000002e-06 2024-09-13T06:41:36.638 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:36.638 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:36.638 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:36.639 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.783596+0000", 2024-09-13T06:41:36.639 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.122915841 2024-09-13T06:41:36.639 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:36.639 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:36.639 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:36.639 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.783682+0000", 2024-09-13T06:41:36.639 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.5822999999999995e-05 2024-09-13T06:41:36.639 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:36.639 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:36.639 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:36.639 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.784285+0000", 2024-09-13T06:41:36.640 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00060276500000000001 2024-09-13T06:41:36.640 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:36.640 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:36.640 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:36.640 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:36.640 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:36.640 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43241 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 120832~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:36.641 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.660682+0000", 2024-09-13T06:41:36.641 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 74.933578324999999, 2024-09-13T06:41:36.641 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123958204, 2024-09-13T06:41:36.641 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:36.641 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:36.641 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:36.641 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:36.641 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:36.641 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43241 2024-09-13T06:41:36.641 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:36.641 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:36.641 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:36.642 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:36.642 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660682+0000", 2024-09-13T06:41:36.642 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:36.642 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:36.642 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:36.642 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:36.642 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660682+0000", 2024-09-13T06:41:36.642 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:36.642 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:36.642 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:36.643 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:36.643 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660682+0000", 2024-09-13T06:41:36.643 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:36.643 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:36.643 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:36.643 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:36.643 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660683+0000", 2024-09-13T06:41:36.643 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.308e-06 2024-09-13T06:41:36.643 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:36.643 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:36.643 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:36.644 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660686+0000", 2024-09-13T06:41:36.644 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.977e-06 2024-09-13T06:41:36.644 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:36.644 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:36.644 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:36.644 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660689+0000", 2024-09-13T06:41:36.644 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5830000000000001e-06 2024-09-13T06:41:36.644 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:36.644 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:36.644 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:36.644 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.784366+0000", 2024-09-13T06:41:36.644 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.12367713599999999 2024-09-13T06:41:36.645 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:36.645 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:36.645 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:36.645 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.784451+0000", 2024-09-13T06:41:36.645 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.4629999999999994e-05 2024-09-13T06:41:36.645 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:36.645 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:36.645 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:36.645 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.784641+0000", 2024-09-13T06:41:36.645 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00018984899999999999 2024-09-13T06:41:36.645 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:36.645 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:36.645 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:36.646 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:36.646 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:36.646 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43242 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 139264~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:36.646 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.660691+0000", 2024-09-13T06:41:36.646 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 74.933569347000002, 2024-09-13T06:41:36.646 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.124536443, 2024-09-13T06:41:36.646 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:36.646 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:36.646 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:36.646 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:36.646 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:36.646 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43242 2024-09-13T06:41:36.647 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:36.647 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:36.647 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:36.647 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:36.647 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660691+0000", 2024-09-13T06:41:36.647 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:36.647 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:36.648 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:36.648 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:36.648 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660691+0000", 2024-09-13T06:41:36.648 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:36.649 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:36.649 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:36.649 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:36.649 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660691+0000", 2024-09-13T06:41:36.649 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:41:36.649 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:36.649 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:36.650 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:36.650 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660696+0000", 2024-09-13T06:41:36.650 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0560000000000004e-06 2024-09-13T06:41:36.650 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:36.650 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:36.650 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:36.650 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660699+0000", 2024-09-13T06:41:36.650 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.2009999999999999e-06 2024-09-13T06:41:36.650 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:36.650 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:36.650 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:36.650 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660702+0000", 2024-09-13T06:41:36.651 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.633e-06 2024-09-13T06:41:36.651 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:36.651 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:36.651 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:36.651 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.784912+0000", 2024-09-13T06:41:36.651 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.124209497 2024-09-13T06:41:36.651 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:36.651 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:36.651 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:36.651 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.784995+0000", 2024-09-13T06:41:36.651 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.3891e-05 2024-09-13T06:41:36.651 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:36.651 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:36.651 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:36.652 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.785228+0000", 2024-09-13T06:41:36.652 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00023237400000000001 2024-09-13T06:41:36.652 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:36.652 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:36.652 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:36.652 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:36.652 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:36.652 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43243 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 153600~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:36.652 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.660705+0000", 2024-09-13T06:41:36.652 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 74.933556014000004, 2024-09-13T06:41:36.652 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.124825835, 2024-09-13T06:41:36.652 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:36.652 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:36.653 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:36.653 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:36.653 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:36.653 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43243 2024-09-13T06:41:36.653 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:36.653 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:36.653 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:36.653 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:36.653 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660705+0000", 2024-09-13T06:41:36.653 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:36.653 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:36.653 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:36.653 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:36.654 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660705+0000", 2024-09-13T06:41:36.654 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:36.654 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:36.654 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:36.654 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:36.654 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660705+0000", 2024-09-13T06:41:36.654 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:41:36.654 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:36.654 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:36.654 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:36.654 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660706+0000", 2024-09-13T06:41:36.654 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4339999999999999e-06 2024-09-13T06:41:36.654 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:36.654 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:36.655 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:36.655 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660709+0000", 2024-09-13T06:41:36.655 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9000000000000002e-06 2024-09-13T06:41:36.655 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:36.655 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:36.655 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:36.655 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660712+0000", 2024-09-13T06:41:36.655 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.0589999999999998e-06 2024-09-13T06:41:36.655 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:36.655 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:36.655 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:36.656 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.785318+0000", 2024-09-13T06:41:36.656 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.124606299 2024-09-13T06:41:36.656 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:36.656 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:36.656 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:36.656 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.785361+0000", 2024-09-13T06:41:36.656 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.3214999999999999e-05 2024-09-13T06:41:36.656 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:36.656 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:36.656 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:36.656 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.785531+0000", 2024-09-13T06:41:36.656 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00016914400000000001 2024-09-13T06:41:36.656 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:36.656 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:36.657 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:36.657 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:36.657 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:36.657 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43244 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 167936~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:36.657 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.660714+0000", 2024-09-13T06:41:36.657 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 74.933546601000003, 2024-09-13T06:41:36.657 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.125073248, 2024-09-13T06:41:36.657 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:36.657 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:36.657 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:36.657 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:36.657 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:36.658 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43244 2024-09-13T06:41:36.658 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:36.658 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:36.658 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:36.658 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:36.658 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660714+0000", 2024-09-13T06:41:36.658 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:36.658 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:36.658 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:36.658 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:36.658 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660714+0000", 2024-09-13T06:41:36.658 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:36.659 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:36.659 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:36.659 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:36.659 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660714+0000", 2024-09-13T06:41:36.659 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:41:36.659 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:36.659 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:36.659 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:36.659 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660715+0000", 2024-09-13T06:41:36.659 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2330000000000001e-06 2024-09-13T06:41:36.659 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:36.659 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:36.659 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:36.660 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660718+0000", 2024-09-13T06:41:36.660 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9569999999999998e-06 2024-09-13T06:41:36.660 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:36.660 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:36.660 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:36.660 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660721+0000", 2024-09-13T06:41:36.660 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.678e-06 2024-09-13T06:41:36.660 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:36.660 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:36.660 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:36.660 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.785557+0000", 2024-09-13T06:41:36.660 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.12483633199999999 2024-09-13T06:41:36.660 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:36.660 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:36.661 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:36.661 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.785618+0000", 2024-09-13T06:41:36.661 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0686000000000001e-05 2024-09-13T06:41:36.661 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:36.661 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:36.661 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:36.661 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.785787+0000", 2024-09-13T06:41:36.661 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00016957699999999999 2024-09-13T06:41:36.661 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:36.661 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:36.661 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:36.661 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:36.661 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:36.662 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43254 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 315392~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:36.662 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.664717+0000", 2024-09-13T06:41:36.662 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 74.929544032999999, 2024-09-13T06:41:36.662 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.12357108, 2024-09-13T06:41:36.662 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:36.662 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:36.662 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:36.662 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:36.662 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:36.662 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43254 2024-09-13T06:41:36.662 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:36.662 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:36.662 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:36.662 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:36.663 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664717+0000", 2024-09-13T06:41:36.663 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:36.663 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:36.663 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:36.663 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:36.663 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664717+0000", 2024-09-13T06:41:36.663 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:36.663 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:36.663 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:36.663 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:36.663 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664716+0000", 2024-09-13T06:41:36.663 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:36.664 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:36.664 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:36.664 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:36.664 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664724+0000", 2024-09-13T06:41:36.664 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.7109999999999995e-06 2024-09-13T06:41:36.664 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:36.664 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:36.664 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:36.664 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664732+0000", 2024-09-13T06:41:36.664 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.8399999999999995e-06 2024-09-13T06:41:36.664 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:36.664 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:36.664 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:36.664 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664738+0000", 2024-09-13T06:41:36.664 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.879e-06 2024-09-13T06:41:36.665 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:36.665 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:36.665 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:36.665 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.788018+0000", 2024-09-13T06:41:36.665 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123280719 2024-09-13T06:41:36.665 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:36.665 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:36.665 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:36.665 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.788119+0000", 2024-09-13T06:41:36.666 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000100558 2024-09-13T06:41:36.666 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:36.666 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:36.666 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:36.666 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.788288+0000", 2024-09-13T06:41:36.666 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000168751 2024-09-13T06:41:36.666 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:36.666 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:36.666 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:36.666 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:36.666 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:36.666 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43255 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 329728~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:36.666 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.664743+0000", 2024-09-13T06:41:36.667 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 74.929518036999994, 2024-09-13T06:41:36.667 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.12381711500000001, 2024-09-13T06:41:36.667 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:36.667 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:36.667 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:36.667 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:36.667 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:36.667 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43255 2024-09-13T06:41:36.667 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:36.667 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:36.667 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:36.667 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:36.667 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664743+0000", 2024-09-13T06:41:36.668 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:36.668 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:36.668 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:36.668 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:36.668 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664743+0000", 2024-09-13T06:41:36.668 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:36.668 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:36.668 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:36.668 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:36.668 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664742+0000", 2024-09-13T06:41:36.668 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:36.668 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:36.668 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:36.669 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:36.669 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664745+0000", 2024-09-13T06:41:36.669 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.7269999999999999e-06 2024-09-13T06:41:36.669 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:36.669 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:36.669 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:36.669 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664753+0000", 2024-09-13T06:41:36.669 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.8709999999999997e-06 2024-09-13T06:41:36.669 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:36.669 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:36.669 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:36.669 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664758+0000", 2024-09-13T06:41:36.669 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2220000000000001e-06 2024-09-13T06:41:36.670 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:36.670 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:36.670 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:36.670 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.788314+0000", 2024-09-13T06:41:36.670 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123555545 2024-09-13T06:41:36.670 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:36.670 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:36.670 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:36.670 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.788368+0000", 2024-09-13T06:41:36.670 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3928999999999998e-05 2024-09-13T06:41:36.670 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:36.670 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:36.670 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:36.670 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.788560+0000", 2024-09-13T06:41:36.671 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000192237 2024-09-13T06:41:36.671 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:36.671 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:36.671 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:36.671 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:36.671 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:36.671 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43256 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 344064~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:36.671 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.664763+0000", 2024-09-13T06:41:36.671 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 74.929498090999999, 2024-09-13T06:41:36.671 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.12418359399999999, 2024-09-13T06:41:36.671 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:36.671 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:36.671 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:36.671 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:36.672 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:36.672 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43256 2024-09-13T06:41:36.672 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:36.672 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:36.672 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:36.672 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:36.672 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664763+0000", 2024-09-13T06:41:36.672 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:36.672 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:36.672 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:36.672 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:36.672 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664763+0000", 2024-09-13T06:41:36.673 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:36.673 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:36.673 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:36.673 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:36.673 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664762+0000", 2024-09-13T06:41:36.673 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:36.673 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:36.673 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:36.673 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:36.673 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664765+0000", 2024-09-13T06:41:36.673 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3290000000000001e-06 2024-09-13T06:41:36.673 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:36.673 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:36.674 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:36.674 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664771+0000", 2024-09-13T06:41:36.674 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.1319999999999999e-06 2024-09-13T06:41:36.674 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:36.674 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:36.674 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:36.674 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664776+0000", 2024-09-13T06:41:36.674 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.8840000000000002e-06 2024-09-13T06:41:36.674 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:36.674 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:36.674 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:36.674 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.788598+0000", 2024-09-13T06:41:36.674 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123821979 2024-09-13T06:41:36.674 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:36.675 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:36.675 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:36.675 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.788680+0000", 2024-09-13T06:41:36.675 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.2367999999999995e-05 2024-09-13T06:41:36.675 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:36.675 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:36.675 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:36.675 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.788946+0000", 2024-09-13T06:41:36.675 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00026629799999999999 2024-09-13T06:41:36.675 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:36.675 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:36.676 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:36.676 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:36.676 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:36.676 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43265 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 477184~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:36.676 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.669414+0000", 2024-09-13T06:41:36.676 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 74.924846454999994, 2024-09-13T06:41:36.676 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123446973, 2024-09-13T06:41:36.676 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:36.676 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:36.676 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:36.676 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:36.676 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:36.677 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43265 2024-09-13T06:41:36.677 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:36.677 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:36.677 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:36.677 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:36.677 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669414+0000", 2024-09-13T06:41:36.677 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:36.677 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:36.677 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:36.677 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:36.677 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669414+0000", 2024-09-13T06:41:36.677 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:36.677 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:36.678 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:36.678 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:36.678 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669414+0000", 2024-09-13T06:41:36.678 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:36.678 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:36.678 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:36.678 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:36.678 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669416+0000", 2024-09-13T06:41:36.678 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.317e-06 2024-09-13T06:41:36.678 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:36.678 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:36.679 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:36.679 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669425+0000", 2024-09-13T06:41:36.679 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.0650000000000005e-06 2024-09-13T06:41:36.679 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:36.679 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:36.679 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:36.679 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669430+0000", 2024-09-13T06:41:36.679 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5079999999999999e-06 2024-09-13T06:41:36.679 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:36.679 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:36.679 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:36.679 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.792649+0000", 2024-09-13T06:41:36.679 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123219328 2024-09-13T06:41:36.680 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:36.680 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:36.680 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:36.680 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.792695+0000", 2024-09-13T06:41:36.680 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5476999999999998e-05 2024-09-13T06:41:36.680 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:36.680 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:36.680 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:36.680 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.792861+0000", 2024-09-13T06:41:36.680 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00016658999999999999 2024-09-13T06:41:36.680 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:36.680 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:36.680 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:36.680 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:36.681 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:36.681 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43266 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 491520~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:36.681 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.669434+0000", 2024-09-13T06:41:36.681 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 74.924826332999999, 2024-09-13T06:41:36.681 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123685267, 2024-09-13T06:41:36.681 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:36.681 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:36.681 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:36.681 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:36.681 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:36.681 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43266 2024-09-13T06:41:36.681 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:36.681 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:36.682 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:36.682 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:36.682 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669434+0000", 2024-09-13T06:41:36.682 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:36.682 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:36.682 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:36.682 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:36.682 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669434+0000", 2024-09-13T06:41:36.682 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:36.682 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:36.682 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:36.683 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:36.683 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669434+0000", 2024-09-13T06:41:36.683 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:36.683 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:36.683 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:36.683 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:36.683 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669441+0000", 2024-09-13T06:41:36.683 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3019999999999997e-06 2024-09-13T06:41:36.683 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:36.683 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:36.683 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:36.683 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669451+0000", 2024-09-13T06:41:36.683 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.6379999999999999e-06 2024-09-13T06:41:36.683 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:36.684 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:36.684 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:36.684 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669456+0000", 2024-09-13T06:41:36.684 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.361e-06 2024-09-13T06:41:36.684 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:36.684 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:36.684 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:36.684 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.792879+0000", 2024-09-13T06:41:36.684 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123422686 2024-09-13T06:41:36.684 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:36.684 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:36.684 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:36.684 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.792923+0000", 2024-09-13T06:41:36.684 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4035000000000001e-05 2024-09-13T06:41:36.684 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:36.685 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:36.685 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:36.685 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.793120+0000", 2024-09-13T06:41:36.685 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00019660899999999999 2024-09-13T06:41:36.685 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:36.685 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:36.685 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:36.685 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:36.685 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:36.685 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43267 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 505856~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:36.685 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.669461+0000", 2024-09-13T06:41:36.685 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 74.924799536999998, 2024-09-13T06:41:36.686 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123933711, 2024-09-13T06:41:36.686 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:36.686 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:36.686 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:36.686 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:36.686 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:36.686 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43267 2024-09-13T06:41:36.686 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:36.686 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:36.686 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:36.686 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:36.686 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669461+0000", 2024-09-13T06:41:36.687 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:36.687 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:36.687 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:36.687 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:36.687 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669461+0000", 2024-09-13T06:41:36.687 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:36.687 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:36.687 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:36.687 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:36.687 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669461+0000", 2024-09-13T06:41:36.687 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:36.687 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:36.687 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:36.687 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:36.688 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669463+0000", 2024-09-13T06:41:36.688 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5629999999999999e-06 2024-09-13T06:41:36.688 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:36.688 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:36.688 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:36.688 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669473+0000", 2024-09-13T06:41:36.688 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.9520000000000006e-06 2024-09-13T06:41:36.688 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:36.688 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:36.689 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:36.689 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669479+0000", 2024-09-13T06:41:36.689 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8540000000000002e-06 2024-09-13T06:41:36.689 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:36.689 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:36.689 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:36.689 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.793137+0000", 2024-09-13T06:41:36.689 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.12365825699999999 2024-09-13T06:41:36.689 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:36.689 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:36.689 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:36.689 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.793181+0000", 2024-09-13T06:41:36.689 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.3773999999999998e-05 2024-09-13T06:41:36.690 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:36.690 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:36.690 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:36.690 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.793395+0000", 2024-09-13T06:41:36.690 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00021372399999999999 2024-09-13T06:41:36.690 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:36.690 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:36.690 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:36.690 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:36.690 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:36.690 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43268 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 520192~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:36.690 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.669484+0000", 2024-09-13T06:41:36.690 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 74.924776752, 2024-09-13T06:41:36.690 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.12441057899999999, 2024-09-13T06:41:36.690 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:36.691 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:36.691 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:36.691 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:36.691 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:36.691 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43268 2024-09-13T06:41:36.691 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:36.691 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:36.691 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:36.691 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:36.691 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669484+0000", 2024-09-13T06:41:36.691 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:36.691 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:36.691 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:36.692 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:36.692 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669484+0000", 2024-09-13T06:41:36.692 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:36.692 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:36.692 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:36.692 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:36.692 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669484+0000", 2024-09-13T06:41:36.693 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:36.693 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:36.693 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:36.693 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:36.693 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669486+0000", 2024-09-13T06:41:36.693 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6120000000000001e-06 2024-09-13T06:41:36.693 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:36.693 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:36.693 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:36.693 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669494+0000", 2024-09-13T06:41:36.693 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4819999999999997e-06 2024-09-13T06:41:36.694 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:36.694 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:36.694 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:36.694 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669497+0000", 2024-09-13T06:41:36.694 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9790000000000002e-06 2024-09-13T06:41:36.694 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:36.694 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:36.694 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:36.694 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.793559+0000", 2024-09-13T06:41:36.694 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.124062436 2024-09-13T06:41:36.694 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:36.694 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:36.694 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:36.694 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.793603+0000", 2024-09-13T06:41:36.694 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.3764999999999999e-05 2024-09-13T06:41:36.695 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:36.695 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:36.695 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:36.695 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.793895+0000", 2024-09-13T06:41:36.695 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00029168299999999999 2024-09-13T06:41:36.695 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:36.695 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:36.695 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:36.695 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:36.695 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:36.695 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:41:36.697 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-13T06:41:36.697 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:41:36.693+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:41:36.799 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:41:36.797+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:41:36.815 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-13T06:41:36.898 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:41:36.897+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:41:36.916 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:41:36.916 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-13T06:41:36.917 INFO:teuthology.orchestra.run.smithi081.stdout: "num_ops": 0 2024-09-13T06:41:36.917 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:41:36.937 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-13T06:41:37.026 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:41:37.025+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:41:37.040 INFO:teuthology.orchestra.run.smithi081.stdout:osd.0: {} 2024-09-13T06:41:37.040 INFO:teuthology.orchestra.run.smithi081.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-13T06:41:37.070 INFO:teuthology.orchestra.run.smithi081.stdout:osd.1: {} 2024-09-13T06:41:37.070 INFO:teuthology.orchestra.run.smithi081.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-13T06:41:37.092 INFO:teuthology.orchestra.run.smithi081.stdout:osd.2: {} 2024-09-13T06:41:37.092 INFO:teuthology.orchestra.run.smithi081.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-13T06:41:37.100 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:41:37.097+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:41:37.117 INFO:teuthology.orchestra.run.smithi081.stdout:osd.3: {} 2024-09-13T06:41:37.117 INFO:teuthology.orchestra.run.smithi081.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-13T06:41:37.143 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:41:37.143 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:41:37.145 INFO:teuthology.orchestra.run.smithi081.stdout:osd.4: {} 2024-09-13T06:41:37.145 INFO:teuthology.orchestra.run.smithi081.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-13T06:41:37.166 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-13T06:41:37.175 INFO:teuthology.orchestra.run.smithi081.stdout:osd.5: {} 2024-09-13T06:41:37.175 INFO:teuthology.orchestra.run.smithi081.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-13T06:41:37.201 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:41:37.198+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:41:37.206 INFO:teuthology.orchestra.run.smithi081.stdout:osd.6: {} 2024-09-13T06:41:37.206 INFO:teuthology.orchestra.run.smithi081.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-13T06:41:37.207 INFO:teuthology.orchestra.run.smithi081.stderr:Error ENXIO: problem getting command descriptions from osd.7 2024-09-13T06:41:37.211 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-13T06:41:37.212 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-13T06:41:37.302 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:41:37.298+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:41:37.324 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:41:37.325 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:41:37.338 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-13T06:41:37.403 INFO:tasks.ceph.osd.6.smithi139.stderr:2024-09-13T06:41:37.398+0000 7fcd02c5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26385) UID: 0 2024-09-13T06:41:37.459 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:41:37.459 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:41:37.473 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-13T06:41:37.518 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:41:37.517+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:41:37.525 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-13T06:41:37.591 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:41:37.591 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:41:37.604 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:41:37.601+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:41:37.606 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-13T06:41:37.617 INFO:teuthology.orchestra.run.smithi081.stdout:checking clone #22, image image_client.0-clone22 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent23 2024-09-13T06:41:37.706 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:41:37.705+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:41:37.745 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:41:37.746 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:41:37.760 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-13T06:41:37.807 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:41:37.805+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:41:37.908 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:41:37.905+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:41:37.922 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:41:37.922 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:41:37.937 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-13T06:41:38.009 INFO:teuthology.orchestra.run.smithi081.stdout:3715 punch from 0x16e71fe to 0x16f26e5, (0xb4e7 bytes) 2024-09-13T06:41:38.009 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:41:38.006+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:41:38.016 INFO:teuthology.orchestra.run.smithi081.stdout:3716 writesame 0xb28598d thru 0xb28852c data_size 0x4(0x2ba0 bytes) 2024-09-13T06:41:38.020 INFO:teuthology.orchestra.run.smithi081.stdout:3717 writesame 0x864a4c5 thru 0x864e8bf data_size 0x1(0x43fb bytes) 2024-09-13T06:41:38.047 INFO:teuthology.orchestra.run.smithi081.stdout:3718 writesame 0x8946432 thru 0x894dd7f data_size 0x1(0x794e bytes) 2024-09-13T06:41:38.086 INFO:teuthology.orchestra.run.smithi081.stdout:3719 trunc from 0xcb39b5e to 0x2ae9e6e 2024-09-13T06:41:38.094 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:41:38.094 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:41:38.110 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:41:38.105+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:41:38.113 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-13T06:41:38.167 INFO:teuthology.orchestra.run.smithi081.stdout:3720 write 0x5dca605 thru 0x5dd3327 (0x8d23 bytes) 2024-09-13T06:41:38.186 INFO:teuthology.orchestra.run.smithi081.stdout:3721 read 0x4806da8 thru 0x481642b (0xf684 bytes) 2024-09-13T06:41:38.202 INFO:teuthology.orchestra.run.smithi081.stdout:3722 writesame 0xbb8d5f1 thru 0xbb9adc1 data_size 0x1(0xd7d1 bytes) 2024-09-13T06:41:38.202 INFO:teuthology.orchestra.run.smithi081.stdout:3723 write 0x3d8036 thru 0x3de675 (0x6640 bytes) 2024-09-13T06:41:38.210 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:41:38.209+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:41:38.217 INFO:teuthology.orchestra.run.smithi081.stdout:3726 writesame 0xed496b9 thru 0xed55739 data_size 0x1(0xc081 bytes) 2024-09-13T06:41:38.217 INFO:teuthology.orchestra.run.smithi081.stdout:3728 write 0x9296b9f thru 0x929e95c (0x7dbe bytes) 2024-09-13T06:41:38.237 INFO:teuthology.orchestra.run.smithi081.stdout:3729 punch from 0x2037e37 to 0x2041015, (0x91de bytes) 2024-09-13T06:41:38.238 INFO:teuthology.orchestra.run.smithi081.stdout:3730 read 0x27f258d thru 0x27fa90e (0x8382 bytes) 2024-09-13T06:41:38.238 INFO:teuthology.orchestra.run.smithi081.stdout:3731 read 0xdbd56de thru 0xdbdea48 (0x936b bytes) 2024-09-13T06:41:38.238 INFO:teuthology.orchestra.run.smithi081.stdout:3732 write 0x69d552 thru 0x6a2a8b (0x553a bytes) 2024-09-13T06:41:38.241 INFO:teuthology.orchestra.run.smithi081.stdout:3734 read 0x229b561 thru 0x22a9175 (0xdc15 bytes) 2024-09-13T06:41:38.241 INFO:teuthology.orchestra.run.smithi081.stdout:3735 punch from 0x3824f12 to 0x38275e4, (0x26d2 bytes) 2024-09-13T06:41:38.255 INFO:teuthology.orchestra.run.smithi081.stdout:3736 trunc from 0xed5573a to 0x38fa25a 2024-09-13T06:41:38.284 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:41:38.284 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:41:38.296 INFO:teuthology.orchestra.run.smithi081.stdout:3737 writesame 0x8ccf228 thru 0x8cd3278 data_size 0x25(0x4051 bytes) 2024-09-13T06:41:38.298 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-13T06:41:38.309 INFO:teuthology.orchestra.run.smithi081.stdout:3739 write 0xa75d556 thru 0xa7605d4 (0x307f bytes) 2024-09-13T06:41:38.310 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:41:38.309+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:41:38.322 INFO:teuthology.orchestra.run.smithi081.stdout:3740 writesame 0x41c274e thru 0x41c7f4b data_size 0x7(0x57fe bytes) 2024-09-13T06:41:38.339 INFO:teuthology.orchestra.run.smithi081.stdout:3741 write 0x4c25995 thru 0x4c2ca4b (0x70b7 bytes) 2024-09-13T06:41:38.355 INFO:teuthology.orchestra.run.smithi081.stdout:3742 read 0x244c2ec thru 0x244f027 (0x2d3c bytes) 2024-09-13T06:41:38.355 INFO:teuthology.orchestra.run.smithi081.stdout:3743 write 0x7d33504 thru 0x7d345c2 (0x10bf bytes) 2024-09-13T06:41:38.361 INFO:teuthology.orchestra.run.smithi081.stdout:3744 writesame 0x1041679 thru 0x104a2c6 data_size 0x1(0x8c4e bytes) 2024-09-13T06:41:38.376 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:41:38.376 INFO:teuthology.orchestra.run.smithi081.stdout:3747 write 0x2a99efb thru 0x2aa1d06 (0x7e0c bytes) 2024-09-13T06:41:38.380 INFO:teuthology.orchestra.run.smithi081.stdout:3749 read 0x3f5a654 thru 0x3f65f37 (0xb8e4 bytes) 2024-09-13T06:41:38.380 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:41:38.380 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:41:38.380 INFO:teuthology.orchestra.run.smithi081.stdout:3757 writesame 0x12781a9 thru 0x12803a6 data_size 0x7(0x81fe bytes) 2024-09-13T06:41:38.411 INFO:teuthology.orchestra.run.smithi081.stdout:3758 write 0xc953062 thru 0xc95b939 (0x88d8 bytes) 2024-09-13T06:41:38.411 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:41:38.409+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:41:38.424 INFO:teuthology.orchestra.run.smithi081.stdout:3759 read 0x396a3f1 thru 0x396c3d7 (0x1fe7 bytes) 2024-09-13T06:41:38.433 INFO:teuthology.orchestra.run.smithi081.stdout:3760 trunc from 0xc95b93a to 0x898e429 2024-09-13T06:41:38.447 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:41:38.447 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:41:38.453 INFO:teuthology.orchestra.run.smithi081.stdout:3761 read 0x4ac61d2 thru 0x4acd79c (0x75cb bytes) 2024-09-13T06:41:38.454 INFO:teuthology.orchestra.run.smithi081.stdout:3763 read 0x6fa2ac9 thru 0x6fa6382 (0x38ba bytes) 2024-09-13T06:41:38.454 INFO:teuthology.orchestra.run.smithi081.stdout:3764 writesame 0x3e58219 thru 0x3e63fdc data_size 0x46(0xbdc4 bytes) 2024-09-13T06:41:38.463 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-13T06:41:38.473 INFO:teuthology.orchestra.run.smithi081.stderr:noscrub is set 2024-09-13T06:41:38.481 INFO:teuthology.orchestra.run.smithi081.stdout:3768 punch from 0x316fd14 to 0x317f376, (0xf662 bytes) 2024-09-13T06:41:38.481 INFO:teuthology.orchestra.run.smithi081.stdout:3769 read 0x396a2ec thru 0x3975b35 (0xb84a bytes) 2024-09-13T06:41:38.482 INFO:teuthology.orchestra.run.smithi081.stdout:3771 write 0x6582de6 thru 0x658b12a (0x8345 bytes) 2024-09-13T06:41:38.495 INFO:teuthology.orchestra.run.smithi081.stdout:3772 read 0x6a47290 thru 0x6a4ae37 (0x3ba8 bytes) 2024-09-13T06:41:38.498 INFO:teuthology.orchestra.run.smithi081.stdout:3773 trunc from 0x898e429 to 0x9c47ac9 2024-09-13T06:41:38.504 INFO:teuthology.orchestra.run.smithi081.stdout:3774 write 0x9049143 thru 0x9056f9c (0xde5a bytes) 2024-09-13T06:41:38.512 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:41:38.509+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:41:38.516 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:41:38.516 INFO:teuthology.orchestra.run.smithi081.stdout:3777 punch from 0x363602d to 0x3636495, (0x468 bytes) 2024-09-13T06:41:38.516 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:41:38.516 INFO:teuthology.orchestra.run.smithi081.stdout:3779 write 0x7a15eaf thru 0x7a180d9 (0x222b bytes) 2024-09-13T06:41:38.525 INFO:teuthology.orchestra.run.smithi081.stdout:3780 read 0x6490065 thru 0x64926e7 (0x2683 bytes) 2024-09-13T06:41:38.544 INFO:teuthology.orchestra.run.smithi081.stdout:3781 writesame 0xe9e9f09 thru 0xe9ed1d6 data_size 0x7(0x32ce bytes) 2024-09-13T06:41:38.544 INFO:teuthology.orchestra.run.smithi081.stdout:3784 writesame 0x5f86f19 thru 0x5f8f3c4 data_size 0xe(0x84ac bytes) 2024-09-13T06:41:38.558 INFO:teuthology.orchestra.run.smithi081.stdout:3786 write 0xb104870 thru 0xb113aa2 (0xf233 bytes) 2024-09-13T06:41:38.571 INFO:teuthology.orchestra.run.smithi081.stdout:3787 read 0x4bc8063 thru 0x4bca9c4 (0x2962 bytes) 2024-09-13T06:41:38.572 INFO:teuthology.orchestra.run.smithi081.stdout:3788 punch from 0x9840ec3 to 0x985032f, (0xf46c bytes) 2024-09-13T06:41:38.572 INFO:teuthology.orchestra.run.smithi081.stdout:3790 writesame 0x29f90c4 thru 0x2a08250 data_size 0x1(0xf18d bytes) 2024-09-13T06:41:38.593 INFO:teuthology.orchestra.run.smithi081.stdout:3791 write 0xd21797f thru 0xd21c620 (0x4ca2 bytes) 2024-09-13T06:41:38.606 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:41:38.606 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:41:38.607 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:41:38.607 INFO:teuthology.orchestra.run.smithi081.stdout:3794 punch from 0x4c043e9 to 0x4c0476e, (0x385 bytes) 2024-09-13T06:41:38.607 INFO:teuthology.orchestra.run.smithi081.stdout:3796 read 0xdaf806f thru 0xdb07826 (0xf7b8 bytes) 2024-09-13T06:41:38.607 INFO:teuthology.orchestra.run.smithi081.stdout:3797 punch from 0x8494168 to 0x84a39f0, (0xf888 bytes) 2024-09-13T06:41:38.607 INFO:teuthology.orchestra.run.smithi081.stdout:3798 write 0xca0f1b2 thru 0xca165cd (0x741c bytes) 2024-09-13T06:41:38.613 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:41:38.609+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:41:38.623 INFO:teuthology.orchestra.run.smithi081.stdout:3800 punch from 0x9a99ad2 to 0x9aa7fb5, (0xe4e3 bytes) 2024-09-13T06:41:38.623 INFO:teuthology.orchestra.run.smithi081.stdout:3801 punch from 0xc3f775d to 0xc407489, (0xfd2c bytes) 2024-09-13T06:41:38.623 INFO:teuthology.orchestra.run.smithi081.stdout:3803 read 0x3dc18a thru 0x3e15d4 (0x544b bytes) 2024-09-13T06:41:38.624 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-13T06:41:38.624 INFO:teuthology.orchestra.run.smithi081.stdout:3804 write 0xdd95a17 thru 0xdd95e3b (0x425 bytes) 2024-09-13T06:41:38.629 INFO:teuthology.orchestra.run.smithi081.stdout:3805 read 0x4284419 thru 0x429331c (0xef04 bytes) 2024-09-13T06:41:38.629 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:41:38.629 INFO:teuthology.orchestra.run.smithi081.stdout:3807 writesame 0x9eeddba thru 0x9ef2536 data_size 0x1(0x477d bytes) 2024-09-13T06:41:38.643 INFO:teuthology.orchestra.run.smithi081.stdout:3808 read 0xa9f07d0 thru 0xa9f9197 (0x89c8 bytes) 2024-09-13T06:41:38.644 INFO:teuthology.orchestra.run.smithi081.stdout:3809 write 0xde440a1 thru 0xde4e024 (0x9f84 bytes) 2024-09-13T06:41:38.659 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:41:38.659 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:41:38.659 INFO:teuthology.orchestra.run.smithi081.stdout:3814 read 0xc9d31be thru 0xc9d9952 (0x6795 bytes) 2024-09-13T06:41:38.661 INFO:teuthology.orchestra.run.smithi081.stdout:3815 read 0xb87418b thru 0xb88373c (0xf5b2 bytes) 2024-09-13T06:41:38.661 INFO:teuthology.orchestra.run.smithi081.stdout:3818 read 0x255ea02 thru 0x25602ba (0x18b9 bytes) 2024-09-13T06:41:38.661 INFO:teuthology.orchestra.run.smithi081.stdout:3821 punch from 0x3873cc7 to 0x3877421, (0x375a bytes) 2024-09-13T06:41:38.680 INFO:teuthology.orchestra.run.smithi081.stdout:3823 trunc from 0xe9ed1d7 to 0x38f2921 2024-09-13T06:41:38.714 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:41:38.713+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:41:38.749 INFO:teuthology.orchestra.run.smithi081.stdout:3824 write 0xaa99eb4 thru 0xaa9a32b (0x478 bytes) 2024-09-13T06:41:38.757 INFO:teuthology.orchestra.run.smithi081.stdout:3825 write 0x75a71fc thru 0x75af293 (0x8098 bytes) 2024-09-13T06:41:38.760 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:41:38.760 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:41:38.775 INFO:teuthology.orchestra.run.smithi081.stdout:3826 punch from 0x50ffc7c to 0x5108fbd, (0x9341 bytes) 2024-09-13T06:41:38.776 INFO:teuthology.orchestra.run.smithi081.stdout:3828 punch from 0x7954726 to 0x79608af, (0xc189 bytes) 2024-09-13T06:41:38.776 INFO:teuthology.orchestra.run.smithi081.stdout:3829 write 0x33bd85b thru 0x33c3329 (0x5acf bytes) 2024-09-13T06:41:38.778 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-13T06:41:38.791 INFO:teuthology.orchestra.run.smithi081.stdout:3830 punch from 0x3983c7b to 0x398ed20, (0xb0a5 bytes) 2024-09-13T06:41:38.792 INFO:teuthology.orchestra.run.smithi081.stdout:3831 write 0xa3f12dc thru 0xa3f15e9 (0x30e bytes) 2024-09-13T06:41:38.796 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:41:38.796 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:41:38.796 INFO:teuthology.orchestra.run.smithi081.stdout:3835 write 0x3f70ab9 thru 0x3f749ff (0x3f47 bytes) 2024-09-13T06:41:38.805 INFO:teuthology.orchestra.run.smithi081.stdout:3836 clone 25 order 18 su 4096 sc 13 2024-09-13T06:41:38.828 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:41:38.826+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:41:38.901 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:41:38.902 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:41:38.917 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-13T06:41:38.918 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:41:38.914+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:41:39.018 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:41:39.014+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:41:39.081 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:41:39.081 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:41:39.095 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-13T06:41:39.137 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:41:39.134+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:41:39.212 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-13T06:41:39.253 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:41:39.253 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:41:39.262 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:41:39.261+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:41:39.266 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-13T06:41:39.320 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:41:39.317+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:41:39.365 INFO:teuthology.orchestra.run.smithi081.stdout:osd.0: {} 2024-09-13T06:41:39.365 INFO:teuthology.orchestra.run.smithi081.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-13T06:41:39.383 INFO:teuthology.orchestra.run.smithi081.stdout:osd.1: {} 2024-09-13T06:41:39.383 INFO:teuthology.orchestra.run.smithi081.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-13T06:41:39.383 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:41:39.383 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:41:39.397 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-13T06:41:39.400 INFO:teuthology.orchestra.run.smithi081.stdout:osd.2: {} 2024-09-13T06:41:39.400 INFO:teuthology.orchestra.run.smithi081.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-13T06:41:39.416 INFO:teuthology.orchestra.run.smithi081.stdout:osd.3: {} 2024-09-13T06:41:39.416 INFO:teuthology.orchestra.run.smithi081.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-13T06:41:39.421 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:41:39.417+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:41:39.434 INFO:teuthology.orchestra.run.smithi081.stdout:osd.4: {} 2024-09-13T06:41:39.434 INFO:teuthology.orchestra.run.smithi081.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-13T06:41:39.453 INFO:teuthology.orchestra.run.smithi081.stdout:osd.5: {} 2024-09-13T06:41:39.453 INFO:teuthology.orchestra.run.smithi081.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-13T06:41:39.473 INFO:teuthology.orchestra.run.smithi081.stdout:osd.6: {} 2024-09-13T06:41:39.473 INFO:teuthology.orchestra.run.smithi081.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-13T06:41:39.473 INFO:teuthology.orchestra.run.smithi081.stderr:Error ENXIO: problem getting command descriptions from osd.7 2024-09-13T06:41:39.479 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-13T06:41:39.479 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-13T06:41:39.517 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:41:39.518 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [], 2024-09-13T06:41:39.518 INFO:teuthology.orchestra.run.smithi139.stdout: "complaint_time": 30, 2024-09-13T06:41:39.518 INFO:teuthology.orchestra.run.smithi139.stdout: "num_blocked_ops": 0 2024-09-13T06:41:39.518 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:41:39.522 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:41:39.521+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:41:39.533 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-13T06:41:39.624 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:41:39.621+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:41:39.657 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:41:39.657 INFO:teuthology.orchestra.run.smithi139.stdout: "size": 20, 2024-09-13T06:41:39.657 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 600, 2024-09-13T06:41:39.658 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [ 2024-09-13T06:41:39.658 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:39.658 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27854 3.a 3:537b3559:::rbd_data.1121f2c5ee81.0000000000000016:13 [read 335872~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:39.658 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.658750+0000", 2024-09-13T06:41:39.658 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 102.996432537, 2024-09-13T06:41:39.658 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.037969532, 2024-09-13T06:41:39.658 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:39.658 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:39.658 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:39.658 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:39.658 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:39.658 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27854 2024-09-13T06:41:39.658 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:39.659 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:39.659 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:39.659 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:39.659 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658750+0000", 2024-09-13T06:41:39.659 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:39.659 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:39.659 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:39.659 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:39.659 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658750+0000", 2024-09-13T06:41:39.659 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:39.659 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:39.659 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:39.659 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:39.660 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658749+0000", 2024-09-13T06:41:39.660 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:39.660 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:39.660 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:39.660 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:39.660 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658757+0000", 2024-09-13T06:41:39.660 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.7389999999999999e-06 2024-09-13T06:41:39.660 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:39.660 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:39.660 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:39.660 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658763+0000", 2024-09-13T06:41:39.660 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.7769999999999999e-06 2024-09-13T06:41:39.660 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:39.661 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:39.661 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:39.661 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658767+0000", 2024-09-13T06:41:39.661 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.1749999999999998e-06 2024-09-13T06:41:39.661 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:39.661 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:39.661 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:39.661 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.696322+0000", 2024-09-13T06:41:39.661 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.037554772 2024-09-13T06:41:39.661 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:39.661 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:39.662 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:39.662 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.696418+0000", 2024-09-13T06:41:39.662 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6050000000000004e-05 2024-09-13T06:41:39.662 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:39.662 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:39.662 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:39.662 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.696719+0000", 2024-09-13T06:41:39.662 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00030138499999999999 2024-09-13T06:41:39.662 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:39.662 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:39.663 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:39.663 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:39.663 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:39.663 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27855 3.a 3:537b3559:::rbd_data.1121f2c5ee81.0000000000000016:13 [read 380928~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:39.663 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.658771+0000", 2024-09-13T06:41:39.663 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 102.99641129299999, 2024-09-13T06:41:39.663 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.038326354, 2024-09-13T06:41:39.663 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:39.663 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:39.663 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:39.663 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:39.663 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:39.663 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27855 2024-09-13T06:41:39.663 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:39.664 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:39.664 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:39.664 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:39.664 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658771+0000", 2024-09-13T06:41:39.664 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:39.664 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:39.664 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:39.664 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:39.664 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658771+0000", 2024-09-13T06:41:39.664 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:39.665 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:39.665 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:39.665 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:39.665 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658770+0000", 2024-09-13T06:41:39.665 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:39.665 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:39.665 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:39.665 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:39.665 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658772+0000", 2024-09-13T06:41:39.665 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.0930000000000001e-06 2024-09-13T06:41:39.665 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:39.665 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:39.665 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:39.666 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658778+0000", 2024-09-13T06:41:39.666 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.2730000000000002e-06 2024-09-13T06:41:39.666 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:39.666 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:39.666 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:39.666 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658782+0000", 2024-09-13T06:41:39.666 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0879999999999997e-06 2024-09-13T06:41:39.666 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:39.666 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:39.666 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:39.666 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.696770+0000", 2024-09-13T06:41:39.666 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.037988145000000001 2024-09-13T06:41:39.666 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:39.666 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:39.667 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:39.667 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.696852+0000", 2024-09-13T06:41:39.667 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.2039999999999994e-05 2024-09-13T06:41:39.667 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:39.667 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:39.667 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:39.667 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.697097+0000", 2024-09-13T06:41:39.667 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00024508800000000002 2024-09-13T06:41:39.667 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:39.667 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:39.667 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:39.667 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:39.668 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:39.668 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27856 3.a 3:537b3559:::rbd_data.1121f2c5ee81.0000000000000016:13 [read 405504~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:39.668 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.658786+0000", 2024-09-13T06:41:39.668 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 102.99639617699999, 2024-09-13T06:41:39.668 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.038736029999999998, 2024-09-13T06:41:39.668 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:39.668 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:39.668 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:39.668 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:39.668 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:39.668 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27856 2024-09-13T06:41:39.668 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:39.668 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:39.669 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:39.669 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:39.669 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658786+0000", 2024-09-13T06:41:39.669 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:39.669 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:39.669 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:39.669 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:39.669 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658786+0000", 2024-09-13T06:41:39.669 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:39.669 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:39.669 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:39.670 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:39.670 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658785+0000", 2024-09-13T06:41:39.670 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:39.670 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:39.670 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:39.670 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:39.670 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658787+0000", 2024-09-13T06:41:39.670 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.0040000000000002e-06 2024-09-13T06:41:39.670 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:39.670 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:39.670 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:39.670 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658793+0000", 2024-09-13T06:41:39.670 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.2410000000000003e-06 2024-09-13T06:41:39.671 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:39.671 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:39.671 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:39.671 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658797+0000", 2024-09-13T06:41:39.671 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.1330000000000001e-06 2024-09-13T06:41:39.671 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:39.671 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:39.671 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:39.671 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.697176+0000", 2024-09-13T06:41:39.671 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.038379074999999999 2024-09-13T06:41:39.671 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:39.671 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:39.671 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:39.671 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.697275+0000", 2024-09-13T06:41:39.671 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.8819000000000004e-05 2024-09-13T06:41:39.672 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:39.672 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:39.672 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:39.672 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.697522+0000", 2024-09-13T06:41:39.672 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00024719999999999999 2024-09-13T06:41:39.672 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:39.672 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:39.672 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:39.672 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:39.672 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:39.672 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27857 3.a 3:537b3559:::rbd_data.1121f2c5ee81.0000000000000016:13 [read 475136~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:39.672 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.658845+0000", 2024-09-13T06:41:39.672 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 102.996337174, 2024-09-13T06:41:39.673 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039112570999999999, 2024-09-13T06:41:39.673 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:39.673 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:39.673 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:39.673 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:39.673 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:39.673 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27857 2024-09-13T06:41:39.673 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:39.673 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:39.673 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:39.673 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:39.673 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658845+0000", 2024-09-13T06:41:39.673 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:39.673 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:39.674 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:39.674 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:39.674 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658845+0000", 2024-09-13T06:41:39.674 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:39.674 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:39.674 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:39.674 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:39.674 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658844+0000", 2024-09-13T06:41:39.674 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999986 2024-09-13T06:41:39.674 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:39.674 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:39.674 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:39.674 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658868+0000", 2024-09-13T06:41:39.674 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.4615000000000001e-05 2024-09-13T06:41:39.675 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:39.675 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:39.675 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:39.675 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658884+0000", 2024-09-13T06:41:39.675 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5401999999999999e-05 2024-09-13T06:41:39.675 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:39.675 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:39.675 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:39.675 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658896+0000", 2024-09-13T06:41:39.675 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2509e-05 2024-09-13T06:41:39.675 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:39.675 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:39.675 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:39.675 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.697571+0000", 2024-09-13T06:41:39.676 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.038675107 2024-09-13T06:41:39.676 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:39.676 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:39.676 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:39.676 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.697658+0000", 2024-09-13T06:41:39.676 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6349999999999998e-05 2024-09-13T06:41:39.676 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:39.676 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:39.676 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:39.676 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.697957+0000", 2024-09-13T06:41:39.676 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00029986100000000001 2024-09-13T06:41:39.676 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:39.676 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:39.677 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:39.677 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:39.677 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:39.677 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27858 3.a 3:537b3559:::rbd_data.1121f2c5ee81.0000000000000016:13 [read 499712~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:39.677 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.658905+0000", 2024-09-13T06:41:39.677 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 102.996276624, 2024-09-13T06:41:39.677 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039475392999999998, 2024-09-13T06:41:39.677 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:39.677 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:39.677 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:39.677 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:39.677 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:39.677 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27858 2024-09-13T06:41:39.678 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:39.678 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:39.678 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:39.678 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:39.678 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658905+0000", 2024-09-13T06:41:39.678 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:39.678 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:39.678 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:39.678 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:39.678 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658905+0000", 2024-09-13T06:41:39.678 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:39.678 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:39.678 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:39.678 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:39.678 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658905+0000", 2024-09-13T06:41:39.679 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:39.679 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:39.679 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:39.679 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:39.679 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658909+0000", 2024-09-13T06:41:39.679 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.831e-06 2024-09-13T06:41:39.679 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:39.679 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:39.679 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:39.679 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658920+0000", 2024-09-13T06:41:39.679 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0936e-05 2024-09-13T06:41:39.679 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:39.679 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:39.679 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:39.679 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658929+0000", 2024-09-13T06:41:39.680 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.2749999999999995e-06 2024-09-13T06:41:39.680 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:39.680 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:39.680 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:39.680 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.697990+0000", 2024-09-13T06:41:39.680 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039061625000000003 2024-09-13T06:41:39.680 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:39.680 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:39.680 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:39.680 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.698077+0000", 2024-09-13T06:41:39.680 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6922000000000006e-05 2024-09-13T06:41:39.680 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:39.680 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:39.681 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:39.681 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.698381+0000", 2024-09-13T06:41:39.681 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00030360599999999999 2024-09-13T06:41:39.681 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:39.681 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:39.681 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:39.681 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:39.681 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:39.681 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27929 3.a 3:537b3559:::rbd_data.1121f2c5ee81.0000000000000016:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:39.681 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.659338+0000", 2024-09-13T06:41:39.681 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 102.99584379300001, 2024-09-13T06:41:39.681 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039351214000000002, 2024-09-13T06:41:39.681 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:39.681 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:39.682 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:39.682 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:39.682 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:39.682 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27929 2024-09-13T06:41:39.682 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:39.682 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:39.682 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:39.682 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:39.682 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.659338+0000", 2024-09-13T06:41:39.682 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:39.682 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:39.682 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:39.682 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:39.682 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.659338+0000", 2024-09-13T06:41:39.682 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:39.683 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:39.683 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:39.683 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:39.683 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.659337+0000", 2024-09-13T06:41:39.683 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:39.683 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:39.683 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:39.683 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:39.683 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.659342+0000", 2024-09-13T06:41:39.683 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0799999999999999e-06 2024-09-13T06:41:39.683 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:39.683 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:39.683 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:39.683 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.659353+0000", 2024-09-13T06:41:39.684 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1798e-05 2024-09-13T06:41:39.684 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:39.684 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:39.684 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:39.684 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.659361+0000", 2024-09-13T06:41:39.684 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.8040000000000002e-06 2024-09-13T06:41:39.684 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:39.684 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:39.684 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:39.684 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.698449+0000", 2024-09-13T06:41:39.684 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039087519000000001 2024-09-13T06:41:39.684 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:39.684 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:39.684 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:39.684 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.698567+0000", 2024-09-13T06:41:39.685 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00011857 2024-09-13T06:41:39.685 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:39.685 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:39.685 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:39.685 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.698689+0000", 2024-09-13T06:41:39.685 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00012226699999999999 2024-09-13T06:41:39.685 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:39.685 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:39.685 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:39.685 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:39.685 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:39.685 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27974 3.a 3:537b3559:::rbd_data.1121f2c5ee81.0000000000000016:13 [read 32768~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:39.685 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.660102+0000", 2024-09-13T06:41:39.686 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 102.99508002499999, 2024-09-13T06:41:39.686 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.038972346999999997, 2024-09-13T06:41:39.686 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:39.686 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:39.686 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:39.686 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:39.686 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:39.686 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27974 2024-09-13T06:41:39.686 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:39.686 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:39.686 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:39.686 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:39.686 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660102+0000", 2024-09-13T06:41:39.687 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:39.687 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:39.687 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:39.687 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:39.687 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660102+0000", 2024-09-13T06:41:39.687 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:39.687 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:39.687 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:39.687 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:39.687 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660100+0000", 2024-09-13T06:41:39.687 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999976 2024-09-13T06:41:39.687 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:39.687 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:39.688 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:39.688 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660114+0000", 2024-09-13T06:41:39.688 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.4466e-05 2024-09-13T06:41:39.688 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:39.688 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:39.688 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:39.688 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660148+0000", 2024-09-13T06:41:39.688 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.3742999999999999e-05 2024-09-13T06:41:39.688 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:39.688 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:39.688 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:39.688 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660170+0000", 2024-09-13T06:41:39.688 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.2518e-05 2024-09-13T06:41:39.689 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:39.689 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:39.689 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:39.689 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.698719+0000", 2024-09-13T06:41:39.689 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.038548529999999998 2024-09-13T06:41:39.689 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:39.689 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:39.689 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:39.689 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.698806+0000", 2024-09-13T06:41:39.689 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.7179e-05 2024-09-13T06:41:39.689 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:39.689 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:39.689 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:39.690 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.699074+0000", 2024-09-13T06:41:39.690 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00026834800000000001 2024-09-13T06:41:39.690 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:39.690 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:39.690 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:39.690 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:39.690 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:39.690 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27975 3.a 3:537b3559:::rbd_data.1121f2c5ee81.0000000000000016:13 [read 57344~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:39.690 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.660189+0000", 2024-09-13T06:41:39.690 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 102.994993181, 2024-09-13T06:41:39.690 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039288678, 2024-09-13T06:41:39.690 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:39.690 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:39.690 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:39.691 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:39.691 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:39.691 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27975 2024-09-13T06:41:39.691 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:39.691 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:39.691 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:39.691 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:39.691 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660189+0000", 2024-09-13T06:41:39.691 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:39.691 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:39.691 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:39.691 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:39.691 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660189+0000", 2024-09-13T06:41:39.692 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:39.692 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:39.692 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:39.692 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:39.692 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660187+0000", 2024-09-13T06:41:39.692 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999981 2024-09-13T06:41:39.692 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:39.692 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:39.692 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:39.692 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660195+0000", 2024-09-13T06:41:39.692 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5610000000000001e-06 2024-09-13T06:41:39.692 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:39.692 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:39.693 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:39.693 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660212+0000", 2024-09-13T06:41:39.693 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7725999999999999e-05 2024-09-13T06:41:39.693 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:39.693 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:39.693 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:39.693 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660227+0000", 2024-09-13T06:41:39.693 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.43e-05 2024-09-13T06:41:39.693 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:39.693 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:39.693 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:39.693 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.699135+0000", 2024-09-13T06:41:39.694 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.038908336000000002 2024-09-13T06:41:39.694 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:39.694 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:39.694 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:39.694 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.699208+0000", 2024-09-13T06:41:39.694 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.3065000000000006e-05 2024-09-13T06:41:39.694 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:39.694 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:39.694 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:39.694 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.699478+0000", 2024-09-13T06:41:39.694 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00026946899999999999 2024-09-13T06:41:39.694 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:39.694 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:39.695 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:39.695 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:39.695 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:39.695 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27976 3.a 3:537b3559:::rbd_data.1121f2c5ee81.0000000000000016:13 [read 102400~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:39.695 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.660238+0000", 2024-09-13T06:41:39.695 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 102.994944018, 2024-09-13T06:41:39.695 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039636515999999997, 2024-09-13T06:41:39.695 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:39.695 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:39.695 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:39.695 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:39.695 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:39.695 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27976 2024-09-13T06:41:39.696 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:39.696 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:39.696 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:39.696 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:39.696 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660238+0000", 2024-09-13T06:41:39.696 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:39.696 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:39.696 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:39.696 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:39.696 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660238+0000", 2024-09-13T06:41:39.696 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:39.696 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:39.697 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:39.697 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:39.697 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660237+0000", 2024-09-13T06:41:39.697 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:39.697 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:39.697 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:39.697 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:39.697 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660243+0000", 2024-09-13T06:41:39.697 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.9909999999999999e-06 2024-09-13T06:41:39.697 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:39.697 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:39.697 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:39.697 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660259+0000", 2024-09-13T06:41:39.698 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6294e-05 2024-09-13T06:41:39.698 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:39.698 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:39.698 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:39.698 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660272+0000", 2024-09-13T06:41:39.698 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2714999999999999e-05 2024-09-13T06:41:39.698 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:39.698 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:39.698 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:39.698 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.699513+0000", 2024-09-13T06:41:39.698 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039240932999999999 2024-09-13T06:41:39.698 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:39.698 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:39.699 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:39.699 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.699604+0000", 2024-09-13T06:41:39.699 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.1367999999999997e-05 2024-09-13T06:41:39.699 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:39.699 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:39.699 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:39.699 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.699875+0000", 2024-09-13T06:41:39.699 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00027029499999999999 2024-09-13T06:41:39.699 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:39.699 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:39.699 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:39.699 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:39.699 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:39.700 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27977 3.a 3:537b3559:::rbd_data.1121f2c5ee81.0000000000000016:13 [read 126976~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:39.700 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.660284+0000", 2024-09-13T06:41:39.700 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 102.99489844599999, 2024-09-13T06:41:39.700 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039969945, 2024-09-13T06:41:39.700 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:39.700 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:39.700 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:39.700 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:39.700 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:39.700 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27977 2024-09-13T06:41:39.700 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:39.700 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:39.700 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:39.700 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:39.701 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660284+0000", 2024-09-13T06:41:39.701 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:39.701 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:39.701 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:39.701 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:39.701 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660284+0000", 2024-09-13T06:41:39.701 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:39.701 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:39.701 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:39.701 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:39.701 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660282+0000", 2024-09-13T06:41:39.701 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999986 2024-09-13T06:41:39.701 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:39.702 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:39.702 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:39.702 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660288+0000", 2024-09-13T06:41:39.702 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.2650000000000002e-06 2024-09-13T06:41:39.702 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:39.702 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:39.702 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:39.702 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660304+0000", 2024-09-13T06:41:39.702 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5430999999999998e-05 2024-09-13T06:41:39.702 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:39.702 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:39.702 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:39.702 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660316+0000", 2024-09-13T06:41:39.702 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.237e-05 2024-09-13T06:41:39.703 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:39.703 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:39.703 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:39.703 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.699907+0000", 2024-09-13T06:41:39.703 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039590735000000002 2024-09-13T06:41:39.703 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:39.703 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:39.703 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:39.703 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.699994+0000", 2024-09-13T06:41:39.703 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6996999999999994e-05 2024-09-13T06:41:39.703 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:39.703 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:39.703 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:39.704 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700254+0000", 2024-09-13T06:41:39.704 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000259564 2024-09-13T06:41:39.704 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:39.704 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:39.704 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:39.704 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:39.704 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:39.704 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27978 3.a 3.9aacdeca (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:39.704 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.660327+0000", 2024-09-13T06:41:39.704 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 102.994854848, 2024-09-13T06:41:39.704 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039984858999999998, 2024-09-13T06:41:39.704 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:39.704 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:41:39.705 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:39.705 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:39.705 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:39.705 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27978 2024-09-13T06:41:39.705 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:39.705 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:39.705 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:39.705 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:39.705 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660327+0000", 2024-09-13T06:41:39.705 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:39.705 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:39.705 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:39.706 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:39.706 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660327+0000", 2024-09-13T06:41:39.706 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:39.706 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:39.706 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:39.706 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:39.706 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660326+0000", 2024-09-13T06:41:39.706 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:39.706 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:39.706 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:39.706 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:39.706 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660366+0000", 2024-09-13T06:41:39.706 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.9691000000000003e-05 2024-09-13T06:41:39.707 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:39.707 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:39.707 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:39.707 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660399+0000", 2024-09-13T06:41:39.707 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.3262000000000001e-05 2024-09-13T06:41:39.707 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:39.707 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:39.707 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:39.707 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660414+0000", 2024-09-13T06:41:39.707 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.4775e-05 2024-09-13T06:41:39.707 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:39.707 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:39.707 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:39.708 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700298+0000", 2024-09-13T06:41:39.708 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039883759999999997 2024-09-13T06:41:39.708 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:39.708 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:39.708 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:39.708 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700312+0000", 2024-09-13T06:41:39.708 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.4374e-05 2024-09-13T06:41:39.708 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:39.708 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:39.708 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:39.708 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:39.708 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:39.709 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27979 3.a 3.9aacdeca (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:39.709 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.660429+0000", 2024-09-13T06:41:39.709 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 102.99475298, 2024-09-13T06:41:39.709 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039921361000000002, 2024-09-13T06:41:39.709 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:39.709 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:41:39.709 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:39.709 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:39.709 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:39.709 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27979 2024-09-13T06:41:39.709 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:39.709 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:39.709 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:39.709 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:39.710 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660429+0000", 2024-09-13T06:41:39.710 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:39.710 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:39.710 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:39.710 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:39.710 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660429+0000", 2024-09-13T06:41:39.710 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:39.710 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:39.710 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:39.710 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:39.710 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660428+0000", 2024-09-13T06:41:39.710 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999986 2024-09-13T06:41:39.710 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:39.710 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:39.711 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:39.711 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660434+0000", 2024-09-13T06:41:39.711 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.8190000000000003e-06 2024-09-13T06:41:39.711 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:39.711 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:39.711 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:39.711 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660451+0000", 2024-09-13T06:41:39.711 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6963e-05 2024-09-13T06:41:39.711 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:39.711 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:39.711 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:39.711 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660485+0000", 2024-09-13T06:41:39.711 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.3414000000000002e-05 2024-09-13T06:41:39.711 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:39.712 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:39.712 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:39.712 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700342+0000", 2024-09-13T06:41:39.712 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039857278000000003 2024-09-13T06:41:39.712 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:39.712 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:39.712 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:39.712 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700350+0000", 2024-09-13T06:41:39.712 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.2930000000000001e-06 2024-09-13T06:41:39.712 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:39.712 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:39.712 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:39.713 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:39.713 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:39.713 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27980 3.a 3.9aacdeca (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:39.713 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.660497+0000", 2024-09-13T06:41:39.713 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 102.994684769, 2024-09-13T06:41:39.713 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039888034000000003, 2024-09-13T06:41:39.713 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:39.713 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:41:39.713 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:39.713 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:39.713 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:39.713 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27980 2024-09-13T06:41:39.714 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:39.714 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:39.714 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:39.714 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:39.714 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660497+0000", 2024-09-13T06:41:39.714 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:39.714 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:39.714 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:39.714 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:39.714 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660497+0000", 2024-09-13T06:41:39.714 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:39.714 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:39.714 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:39.715 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:39.715 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660496+0000", 2024-09-13T06:41:39.715 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:39.715 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:39.715 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:39.715 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:39.715 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660503+0000", 2024-09-13T06:41:39.715 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.4110000000000001e-06 2024-09-13T06:41:39.715 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:39.715 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:39.715 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:39.715 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660519+0000", 2024-09-13T06:41:39.716 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6180000000000001e-05 2024-09-13T06:41:39.716 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:39.716 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:39.716 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:39.716 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660544+0000", 2024-09-13T06:41:39.716 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.5177999999999998e-05 2024-09-13T06:41:39.716 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:39.716 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:39.716 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:39.716 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700377+0000", 2024-09-13T06:41:39.716 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039833434000000001 2024-09-13T06:41:39.716 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:39.716 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:39.717 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:39.717 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700385+0000", 2024-09-13T06:41:39.717 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.8800000000000008e-06 2024-09-13T06:41:39.717 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:39.717 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:39.717 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:39.717 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:39.717 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:39.717 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27981 3.a 3.9aacdeca (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:39.717 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.660556+0000", 2024-09-13T06:41:39.717 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 102.994626423, 2024-09-13T06:41:39.717 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039869989000000002, 2024-09-13T06:41:39.717 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:39.717 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:41:39.718 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:39.718 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:39.718 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:39.718 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27981 2024-09-13T06:41:39.718 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:39.718 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:39.718 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:39.718 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:39.718 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660556+0000", 2024-09-13T06:41:39.718 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:39.718 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:39.718 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:39.718 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:39.718 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660556+0000", 2024-09-13T06:41:39.719 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:39.719 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:39.719 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:39.719 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:39.719 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660555+0000", 2024-09-13T06:41:39.719 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:39.719 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:39.719 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:39.719 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:39.719 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660561+0000", 2024-09-13T06:41:39.719 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.088e-06 2024-09-13T06:41:39.719 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:39.719 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:39.719 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:39.720 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660577+0000", 2024-09-13T06:41:39.720 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6147999999999999e-05 2024-09-13T06:41:39.720 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:39.720 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:39.720 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:39.720 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660589+0000", 2024-09-13T06:41:39.720 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2551999999999999e-05 2024-09-13T06:41:39.720 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:39.720 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:39.720 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:39.720 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700414+0000", 2024-09-13T06:41:39.720 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039825007000000003 2024-09-13T06:41:39.720 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:39.721 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:39.721 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:39.721 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700426+0000", 2024-09-13T06:41:39.721 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1265e-05 2024-09-13T06:41:39.721 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:39.721 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:39.721 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:39.721 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:39.721 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:39.721 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27982 3.a 3.9aacdeca (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:39.721 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.660603+0000", 2024-09-13T06:41:39.721 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 102.994578828, 2024-09-13T06:41:39.721 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039874779999999999, 2024-09-13T06:41:39.721 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:39.722 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:41:39.722 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:39.722 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:39.722 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:39.722 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27982 2024-09-13T06:41:39.722 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:39.722 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:39.722 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:39.722 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:39.722 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660603+0000", 2024-09-13T06:41:39.722 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:39.722 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:39.722 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:39.723 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:39.723 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660603+0000", 2024-09-13T06:41:39.723 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:39.723 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:39.723 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:39.723 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:39.723 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660602+0000", 2024-09-13T06:41:39.723 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:39.723 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:39.723 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:39.723 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:39.723 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660653+0000", 2024-09-13T06:41:39.723 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.0862000000000002e-05 2024-09-13T06:41:39.723 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:39.723 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:39.724 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:39.724 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660697+0000", 2024-09-13T06:41:39.724 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.3773000000000003e-05 2024-09-13T06:41:39.724 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:39.724 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:39.724 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:39.724 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660712+0000", 2024-09-13T06:41:39.724 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5464999999999998e-05 2024-09-13T06:41:39.724 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:39.724 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:39.724 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:39.724 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700469+0000", 2024-09-13T06:41:39.724 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039756503999999998 2024-09-13T06:41:39.725 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:39.725 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:39.725 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:39.725 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700478+0000", 2024-09-13T06:41:39.725 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.1730000000000001e-06 2024-09-13T06:41:39.725 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:39.725 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:39.725 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:39.725 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:39.725 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:39.725 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27983 3.a 3.9aacdeca (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:39.725 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.660726+0000", 2024-09-13T06:41:39.725 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 102.99445555299999, 2024-09-13T06:41:39.725 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039804357999999998, 2024-09-13T06:41:39.726 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:39.726 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:41:39.726 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:39.726 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:39.726 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:39.726 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27983 2024-09-13T06:41:39.726 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:39.726 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:39.726 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:39.726 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:39.726 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660726+0000", 2024-09-13T06:41:39.726 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:39.727 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:39.727 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:39.727 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:39.727 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660726+0000", 2024-09-13T06:41:39.727 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:39.727 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:39.727 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:39.727 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:39.727 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660725+0000", 2024-09-13T06:41:39.727 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999986 2024-09-13T06:41:39.727 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:39.727 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:39.727 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:39.727 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660733+0000", 2024-09-13T06:41:39.728 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.9359999999999999e-06 2024-09-13T06:41:39.728 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:39.728 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:39.728 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:39.728 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660751+0000", 2024-09-13T06:41:39.728 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7679000000000001e-05 2024-09-13T06:41:39.728 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:39.728 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:39.728 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:39.728 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660764+0000", 2024-09-13T06:41:39.728 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3112000000000001e-05 2024-09-13T06:41:39.728 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:39.729 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:39.729 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:39.729 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700516+0000", 2024-09-13T06:41:39.729 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039752183000000003 2024-09-13T06:41:39.729 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:39.729 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:39.729 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:39.729 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700531+0000", 2024-09-13T06:41:39.729 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.4732999999999999e-05 2024-09-13T06:41:39.729 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:39.729 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:39.729 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:39.729 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:39.730 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:39.730 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27984 3.a 3.9aacdeca (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:39.730 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.660776+0000", 2024-09-13T06:41:39.730 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 102.99440645, 2024-09-13T06:41:39.730 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039795697999999997, 2024-09-13T06:41:39.730 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:39.730 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:41:39.730 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:39.730 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:39.730 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:39.730 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27984 2024-09-13T06:41:39.730 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:39.730 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:39.730 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:39.731 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:39.731 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660776+0000", 2024-09-13T06:41:39.731 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:39.731 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:39.731 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:39.731 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:39.731 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660776+0000", 2024-09-13T06:41:39.731 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:39.731 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:39.731 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:39.731 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:39.731 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660775+0000", 2024-09-13T06:41:39.731 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:39.732 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:39.732 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:39.732 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:39.732 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660780+0000", 2024-09-13T06:41:39.732 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.7849999999999997e-06 2024-09-13T06:41:39.732 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:39.732 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:39.732 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:39.733 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660799+0000", 2024-09-13T06:41:39.733 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.8794e-05 2024-09-13T06:41:39.733 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:39.733 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:39.733 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:39.733 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660812+0000", 2024-09-13T06:41:39.733 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3029e-05 2024-09-13T06:41:39.733 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:39.733 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:39.733 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:39.733 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700562+0000", 2024-09-13T06:41:39.733 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039749984000000002 2024-09-13T06:41:39.733 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:39.734 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:39.734 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:39.734 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700571+0000", 2024-09-13T06:41:39.734 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.1260000000000004e-06 2024-09-13T06:41:39.734 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:39.734 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:39.734 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:39.734 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:39.734 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:39.734 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27985 3.a 3.9aacdeca (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:39.734 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.660824+0000", 2024-09-13T06:41:39.734 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 102.994358398, 2024-09-13T06:41:39.734 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039784462, 2024-09-13T06:41:39.735 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:39.735 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:41:39.735 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:39.735 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:39.735 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:39.735 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27985 2024-09-13T06:41:39.735 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:39.735 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:39.735 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:39.735 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:39.735 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660824+0000", 2024-09-13T06:41:39.735 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:39.735 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:39.736 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:39.736 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:39.736 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660824+0000", 2024-09-13T06:41:39.736 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:39.736 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:39.736 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:39.736 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:39.736 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660823+0000", 2024-09-13T06:41:39.736 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:39.736 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:39.736 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:39.736 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:39.737 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660829+0000", 2024-09-13T06:41:39.737 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.9440000000000002e-06 2024-09-13T06:41:39.737 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:39.737 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:39.737 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:39.737 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660922+0000", 2024-09-13T06:41:39.737 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.2958e-05 2024-09-13T06:41:39.737 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:39.737 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:39.737 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:39.737 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660964+0000", 2024-09-13T06:41:39.737 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.2407000000000002e-05 2024-09-13T06:41:39.737 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:39.738 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:39.738 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:39.738 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700600+0000", 2024-09-13T06:41:39.738 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039635581000000003 2024-09-13T06:41:39.738 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:39.738 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:39.738 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:39.738 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700608+0000", 2024-09-13T06:41:39.738 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.5890000000000003e-06 2024-09-13T06:41:39.738 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:39.738 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:39.738 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:39.738 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:39.739 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:39.739 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:28023 3.10 3:0dedc28a:::rbd_data.1121f2c5ee81.0000000000000019:13 [read 475136~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:39.739 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.662072+0000", 2024-09-13T06:41:39.739 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 102.993110413, 2024-09-13T06:41:39.739 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.038086508999999998, 2024-09-13T06:41:39.739 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:39.739 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:39.739 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:39.739 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:39.739 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:39.739 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 28023 2024-09-13T06:41:39.739 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:39.739 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:39.739 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:39.739 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:39.740 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.662072+0000", 2024-09-13T06:41:39.740 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:39.740 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:39.740 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:39.740 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:39.740 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.662072+0000", 2024-09-13T06:41:39.740 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:39.740 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:39.740 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:39.740 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:39.740 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.662070+0000", 2024-09-13T06:41:39.740 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999986 2024-09-13T06:41:39.740 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:39.740 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:39.741 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:39.741 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.662076+0000", 2024-09-13T06:41:39.741 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.139e-06 2024-09-13T06:41:39.741 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:39.741 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:39.741 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:39.741 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.662094+0000", 2024-09-13T06:41:39.741 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7136999999999999e-05 2024-09-13T06:41:39.741 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:39.741 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:39.741 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:39.741 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.662124+0000", 2024-09-13T06:41:39.741 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.0528999999999999e-05 2024-09-13T06:41:39.741 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:39.741 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:39.742 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:39.742 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.699843+0000", 2024-09-13T06:41:39.742 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.037718415999999998 2024-09-13T06:41:39.742 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:39.742 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:39.742 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:39.742 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.699931+0000", 2024-09-13T06:41:39.742 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.8345999999999997e-05 2024-09-13T06:41:39.742 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:39.742 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:39.742 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:39.742 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700158+0000", 2024-09-13T06:41:39.742 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00022723099999999999 2024-09-13T06:41:39.742 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:39.743 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:39.743 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:39.743 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:39.743 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:39.743 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:28024 3.10 3.5143b7b0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:39.743 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.662137+0000", 2024-09-13T06:41:39.743 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 102.993044891, 2024-09-13T06:41:39.743 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.038056092999999999, 2024-09-13T06:41:39.743 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:39.743 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:41:39.743 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:39.743 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:39.743 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:39.743 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 28024 2024-09-13T06:41:39.744 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:39.744 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:39.744 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:39.744 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:39.744 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.662137+0000", 2024-09-13T06:41:39.744 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:39.744 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:39.744 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:39.744 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:39.744 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.662137+0000", 2024-09-13T06:41:39.744 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:39.744 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:39.744 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:39.744 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:39.745 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.662136+0000", 2024-09-13T06:41:39.745 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999986 2024-09-13T06:41:39.745 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:39.745 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:39.745 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:39.745 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.662142+0000", 2024-09-13T06:41:39.745 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.6930000000000001e-06 2024-09-13T06:41:39.745 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:39.745 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:39.745 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:39.745 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.662160+0000", 2024-09-13T06:41:39.745 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7863000000000002e-05 2024-09-13T06:41:39.745 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:39.745 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:39.745 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:39.746 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.662189+0000", 2024-09-13T06:41:39.746 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.8486000000000001e-05 2024-09-13T06:41:39.746 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:39.746 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:39.746 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:39.746 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700187+0000", 2024-09-13T06:41:39.746 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.037998331000000003 2024-09-13T06:41:39.746 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:39.746 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:39.746 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:39.746 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700193+0000", 2024-09-13T06:41:39.746 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.0909999999999998e-06 2024-09-13T06:41:39.746 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:39.746 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:39.747 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:39.747 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:39.747 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:39.747 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:41:39.748 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-13T06:41:39.749 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:41:39.745+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:41:39.850 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:41:39.845+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:41:39.881 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:41:39.881 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-13T06:41:39.881 INFO:teuthology.orchestra.run.smithi081.stdout: "num_ops": 0 2024-09-13T06:41:39.881 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:41:39.895 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-13T06:41:39.986 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:41:39.985+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:41:40.051 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:41:40.049+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:41:40.066 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:41:40.066 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-13T06:41:40.066 INFO:teuthology.orchestra.run.smithi081.stdout: "complaint_time": 30, 2024-09-13T06:41:40.067 INFO:teuthology.orchestra.run.smithi081.stdout: "num_blocked_ops": 0 2024-09-13T06:41:40.067 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:41:40.080 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-13T06:41:40.152 INFO:tasks.ceph.osd.6.smithi139.stderr:2024-09-13T06:41:40.146+0000 7fcd02c5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26385) UID: 0 2024-09-13T06:41:40.245 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:41:40.245 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 20, 2024-09-13T06:41:40.245 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 600, 2024-09-13T06:41:40.245 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [ 2024-09-13T06:41:40.246 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.246 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:37801 3.1 3:82e31015:::rbd_object_map.1121d8143c6e.0000000000000019:head [call] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e55)", 2024-09-13T06:41:40.246 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:05.646191+0000", 2024-09-13T06:41:40.246 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 94.598096350000006, 2024-09-13T06:41:40.246 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.72659507800000001, 2024-09-13T06:41:40.246 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:40.246 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:40.246 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:40.246 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:40.246 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:40.246 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 37801 2024-09-13T06:41:40.246 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.246 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:40.247 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.247 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:40.247 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:05.646191+0000", 2024-09-13T06:41:40.247 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:40.247 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.247 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.247 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:40.247 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:05.646191+0000", 2024-09-13T06:41:40.247 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:40.247 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.247 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.247 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:40.247 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:05.646188+0000", 2024-09-13T06:41:40.247 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999971 2024-09-13T06:41:40.248 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.248 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.248 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:40.248 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:05.646206+0000", 2024-09-13T06:41:40.248 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8182999999999999e-05 2024-09-13T06:41:40.248 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.248 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.248 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:40.248 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:05.646237+0000", 2024-09-13T06:41:40.248 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.1071000000000001e-05 2024-09-13T06:41:40.248 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.248 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.248 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:40.248 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:05.646251+0000", 2024-09-13T06:41:40.249 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3679000000000001e-05 2024-09-13T06:41:40.249 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.249 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.249 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:40.249 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:05.646321+0000", 2024-09-13T06:41:40.249 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.9831000000000003e-05 2024-09-13T06:41:40.249 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.249 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.249 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:41:40.249 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:05.646331+0000", 2024-09-13T06:41:40.249 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0242e-05 2024-09-13T06:41:40.249 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.249 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.250 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:40.250 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.371959+0000", 2024-09-13T06:41:40.250 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.72562817199999996 2024-09-13T06:41:40.250 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.250 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.250 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:40.250 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.372389+0000", 2024-09-13T06:41:40.250 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00042977400000000001 2024-09-13T06:41:40.250 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.250 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.250 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:40.250 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.372786+0000", 2024-09-13T06:41:40.250 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00039706099999999999 2024-09-13T06:41:40.251 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:40.251 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:40.251 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:40.251 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.251 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.251 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43009 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 489472~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:40.251 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.644660+0000", 2024-09-13T06:41:40.251 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 78.599627388000002, 2024-09-13T06:41:40.251 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123376071, 2024-09-13T06:41:40.251 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:40.251 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:40.251 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:40.251 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:40.251 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:40.251 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43009 2024-09-13T06:41:40.251 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.252 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:40.252 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.252 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:40.252 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.644660+0000", 2024-09-13T06:41:40.252 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:40.252 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.252 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.252 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:40.252 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.644660+0000", 2024-09-13T06:41:40.252 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:40.252 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.252 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.252 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:40.253 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.644659+0000", 2024-09-13T06:41:40.253 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:40.253 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.253 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.253 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:40.253 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.644662+0000", 2024-09-13T06:41:40.253 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4949999999999998e-06 2024-09-13T06:41:40.253 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.253 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.253 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:40.253 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.644669+0000", 2024-09-13T06:41:40.253 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.289e-06 2024-09-13T06:41:40.253 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.253 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.253 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:40.253 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.644674+0000", 2024-09-13T06:41:40.254 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.8840000000000002e-06 2024-09-13T06:41:40.254 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.254 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.254 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:40.254 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.767602+0000", 2024-09-13T06:41:40.254 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.122928158 2024-09-13T06:41:40.254 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.254 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.254 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:40.254 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.767676+0000", 2024-09-13T06:41:40.254 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3992999999999994e-05 2024-09-13T06:41:40.254 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.254 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.254 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:40.254 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.768036+0000", 2024-09-13T06:41:40.255 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00035966200000000001 2024-09-13T06:41:40.255 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:40.255 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:40.255 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:40.255 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.255 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.255 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43010 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 503808~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:40.255 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.644678+0000", 2024-09-13T06:41:40.255 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 78.599609061999999, 2024-09-13T06:41:40.255 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123728798, 2024-09-13T06:41:40.255 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:40.255 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:40.255 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:40.255 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:40.255 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:40.256 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43010 2024-09-13T06:41:40.256 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.256 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:40.256 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.256 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:40.256 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.644678+0000", 2024-09-13T06:41:40.256 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:40.256 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.256 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.256 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:40.256 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.644678+0000", 2024-09-13T06:41:40.256 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:40.256 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.256 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.256 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:40.257 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.644678+0000", 2024-09-13T06:41:40.257 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:40.257 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.257 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.257 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:40.257 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.644680+0000", 2024-09-13T06:41:40.257 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2050000000000001e-06 2024-09-13T06:41:40.257 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.257 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.257 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:40.257 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.644686+0000", 2024-09-13T06:41:40.257 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8440000000000003e-06 2024-09-13T06:41:40.257 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.258 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.258 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:40.258 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.644691+0000", 2024-09-13T06:41:40.258 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.118e-06 2024-09-13T06:41:40.258 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.258 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.258 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:40.258 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.768065+0000", 2024-09-13T06:41:40.258 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123374698 2024-09-13T06:41:40.258 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.258 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.258 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:40.258 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.768139+0000", 2024-09-13T06:41:40.259 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3934000000000001e-05 2024-09-13T06:41:40.259 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.259 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.259 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:40.259 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.768407+0000", 2024-09-13T06:41:40.259 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00026738800000000002 2024-09-13T06:41:40.259 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:40.259 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:40.259 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:40.259 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.259 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.259 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43181 3.17 3:ec5ebce4:::rbd_data.1121f5f2e1c0.0000000000000001:1f [read 319488~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:40.259 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.652968+0000", 2024-09-13T06:41:40.259 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 78.591318545999997, 2024-09-13T06:41:40.260 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.12363807, 2024-09-13T06:41:40.260 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:40.260 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:40.260 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:40.260 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:40.260 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:40.260 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43181 2024-09-13T06:41:40.260 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.260 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:40.260 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.260 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:40.260 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.652968+0000", 2024-09-13T06:41:40.260 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:40.261 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.261 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.261 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:40.261 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.652968+0000", 2024-09-13T06:41:40.261 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:40.261 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.261 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.261 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:40.261 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.652968+0000", 2024-09-13T06:41:40.261 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:40.261 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.261 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.261 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:40.261 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.652970+0000", 2024-09-13T06:41:40.261 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2409999999999998e-06 2024-09-13T06:41:40.262 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.262 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.262 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:40.262 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.652976+0000", 2024-09-13T06:41:40.262 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0079999999999999e-06 2024-09-13T06:41:40.262 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.262 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.262 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:40.262 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.652981+0000", 2024-09-13T06:41:40.262 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4390000000000002e-06 2024-09-13T06:41:40.262 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.262 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.262 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:40.262 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.776275+0000", 2024-09-13T06:41:40.262 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.12329396099999999 2024-09-13T06:41:40.263 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.263 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.263 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:40.263 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.776316+0000", 2024-09-13T06:41:40.263 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.1244e-05 2024-09-13T06:41:40.263 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.263 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.263 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:40.263 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.776607+0000", 2024-09-13T06:41:40.263 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00029051199999999999 2024-09-13T06:41:40.263 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:40.263 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:40.263 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:40.263 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.263 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.264 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43182 3.17 3:ec5ebce4:::rbd_data.1121f5f2e1c0.0000000000000001:1f [read 333824~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:40.264 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.652985+0000", 2024-09-13T06:41:40.264 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 78.591301736999995, 2024-09-13T06:41:40.264 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123926616, 2024-09-13T06:41:40.264 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:40.264 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:40.264 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:40.264 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:40.264 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:40.264 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43182 2024-09-13T06:41:40.264 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.264 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:40.264 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.265 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:40.265 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.652985+0000", 2024-09-13T06:41:40.265 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:40.265 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.265 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.265 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:40.265 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.652985+0000", 2024-09-13T06:41:40.265 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:40.265 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.265 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.265 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:40.265 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.652985+0000", 2024-09-13T06:41:40.265 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:40.265 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.265 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.266 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:40.266 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.652987+0000", 2024-09-13T06:41:40.266 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0899999999999999e-06 2024-09-13T06:41:40.266 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.266 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.266 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:40.266 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.652994+0000", 2024-09-13T06:41:40.266 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3100000000000003e-06 2024-09-13T06:41:40.266 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.266 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.266 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:40.266 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.653000+0000", 2024-09-13T06:41:40.266 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2020000000000003e-06 2024-09-13T06:41:40.266 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.266 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.267 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:40.267 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.776635+0000", 2024-09-13T06:41:40.267 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.12363529400000001 2024-09-13T06:41:40.267 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.267 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.267 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:40.267 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.776676+0000", 2024-09-13T06:41:40.267 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.0745999999999999e-05 2024-09-13T06:41:40.267 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.267 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.267 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:40.267 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.776912+0000", 2024-09-13T06:41:40.267 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00023631300000000001 2024-09-13T06:41:40.267 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:40.268 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:40.268 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:40.268 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.268 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.268 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43192 3.17 3:ec5ebce4:::rbd_data.1121f5f2e1c0.0000000000000001:1f [read 466944~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:40.268 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.656622+0000", 2024-09-13T06:41:40.268 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 78.587664681000007, 2024-09-13T06:41:40.268 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123503136, 2024-09-13T06:41:40.268 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:40.268 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:40.268 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:40.268 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:40.269 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:40.269 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43192 2024-09-13T06:41:40.269 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.269 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:40.269 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.269 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:40.269 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656622+0000", 2024-09-13T06:41:40.269 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:40.269 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.269 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.269 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:40.269 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656622+0000", 2024-09-13T06:41:40.269 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:40.269 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.270 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.270 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:40.270 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656622+0000", 2024-09-13T06:41:40.270 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:41:40.270 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.270 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.270 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:40.270 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656623+0000", 2024-09-13T06:41:40.270 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2079999999999999e-06 2024-09-13T06:41:40.270 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.270 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.270 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:40.270 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656627+0000", 2024-09-13T06:41:40.271 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.4819999999999999e-06 2024-09-13T06:41:40.271 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.271 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.271 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:40.271 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656629+0000", 2024-09-13T06:41:40.271 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.582e-06 2024-09-13T06:41:40.271 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.271 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.271 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:40.271 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.779866+0000", 2024-09-13T06:41:40.271 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.12323638100000001 2024-09-13T06:41:40.271 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.271 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.271 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:40.272 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.779905+0000", 2024-09-13T06:41:40.272 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.9529e-05 2024-09-13T06:41:40.272 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.272 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.272 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:40.272 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.780125+0000", 2024-09-13T06:41:40.272 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000220168 2024-09-13T06:41:40.272 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:40.272 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:40.272 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:40.272 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.272 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.272 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43193 3.17 3:ec5ebce4:::rbd_data.1121f5f2e1c0.0000000000000001:1f [read 481280~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:40.272 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.656635+0000", 2024-09-13T06:41:40.273 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 78.587652196999997, 2024-09-13T06:41:40.273 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.12374478999999999, 2024-09-13T06:41:40.273 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:40.273 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:40.273 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:40.273 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:40.273 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:40.273 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43193 2024-09-13T06:41:40.273 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.273 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:40.273 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.273 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:40.273 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656635+0000", 2024-09-13T06:41:40.273 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:40.274 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.274 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.274 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:40.274 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656635+0000", 2024-09-13T06:41:40.274 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:40.274 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.274 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.274 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:40.274 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656635+0000", 2024-09-13T06:41:40.274 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:41:40.274 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.274 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.274 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:40.274 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656636+0000", 2024-09-13T06:41:40.275 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.544e-06 2024-09-13T06:41:40.275 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.275 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.275 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:40.275 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656639+0000", 2024-09-13T06:41:40.275 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.0879999999999999e-06 2024-09-13T06:41:40.275 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.275 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.275 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:40.275 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656642+0000", 2024-09-13T06:41:40.275 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5799999999999999e-06 2024-09-13T06:41:40.275 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.275 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.275 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:40.275 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.780151+0000", 2024-09-13T06:41:40.275 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123509035 2024-09-13T06:41:40.276 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.276 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.276 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:40.276 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.780191+0000", 2024-09-13T06:41:40.276 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.9758000000000001e-05 2024-09-13T06:41:40.276 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.276 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.276 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:40.276 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.780380+0000", 2024-09-13T06:41:40.276 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000189023 2024-09-13T06:41:40.276 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:40.276 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:40.276 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:40.276 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.277 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.277 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43194 3.17 3:ec5ebce4:::rbd_data.1121f5f2e1c0.0000000000000001:1f [read 495616~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:40.277 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.656645+0000", 2024-09-13T06:41:40.277 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 78.587641543999993, 2024-09-13T06:41:40.277 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.124088483, 2024-09-13T06:41:40.277 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:40.277 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:40.277 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:40.277 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:40.277 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:40.277 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43194 2024-09-13T06:41:40.277 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.277 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:40.278 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.278 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:40.278 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656645+0000", 2024-09-13T06:41:40.278 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:40.278 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.278 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.278 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:40.278 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656645+0000", 2024-09-13T06:41:40.278 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:40.278 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.278 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.278 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:40.279 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656645+0000", 2024-09-13T06:41:40.279 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:40.279 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.279 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.279 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:40.279 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656647+0000", 2024-09-13T06:41:40.279 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9180000000000001e-06 2024-09-13T06:41:40.279 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.279 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.279 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:40.279 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656653+0000", 2024-09-13T06:41:40.279 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7860000000000002e-06 2024-09-13T06:41:40.279 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.279 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.280 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:40.280 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656658+0000", 2024-09-13T06:41:40.280 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6949999999999999e-06 2024-09-13T06:41:40.280 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.280 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.280 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:40.280 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.780406+0000", 2024-09-13T06:41:40.280 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123748657 2024-09-13T06:41:40.280 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.280 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.280 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:40.280 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.780446+0000", 2024-09-13T06:41:40.280 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.9360999999999998e-05 2024-09-13T06:41:40.280 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.280 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.281 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:40.281 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.780734+0000", 2024-09-13T06:41:40.281 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00028838399999999998 2024-09-13T06:41:40.281 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:40.281 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:40.281 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:40.281 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.281 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.281 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43240 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 106496~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:40.281 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.660672+0000", 2024-09-13T06:41:40.281 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 78.583615180999999, 2024-09-13T06:41:40.281 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123612707, 2024-09-13T06:41:40.281 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:40.281 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:40.282 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:40.282 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:40.282 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:40.282 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43240 2024-09-13T06:41:40.282 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.282 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:40.282 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.282 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:40.282 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660672+0000", 2024-09-13T06:41:40.282 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:40.282 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.282 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.282 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:40.282 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660672+0000", 2024-09-13T06:41:40.282 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:40.282 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.283 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.283 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:40.283 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660671+0000", 2024-09-13T06:41:40.283 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:40.283 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.283 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.283 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:40.283 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660673+0000", 2024-09-13T06:41:40.283 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.652e-06 2024-09-13T06:41:40.283 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.283 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.283 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:40.283 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660677+0000", 2024-09-13T06:41:40.283 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.2509999999999996e-06 2024-09-13T06:41:40.283 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.284 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.284 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:40.284 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660680+0000", 2024-09-13T06:41:40.284 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.8150000000000002e-06 2024-09-13T06:41:40.284 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.284 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.284 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:40.284 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.783596+0000", 2024-09-13T06:41:40.284 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.122915841 2024-09-13T06:41:40.284 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.284 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.284 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:40.284 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.783682+0000", 2024-09-13T06:41:40.285 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.5822999999999995e-05 2024-09-13T06:41:40.285 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.285 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.285 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:40.285 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.784285+0000", 2024-09-13T06:41:40.285 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00060276500000000001 2024-09-13T06:41:40.285 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:40.285 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:40.285 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:40.285 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.285 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.285 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43241 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 120832~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:40.285 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.660682+0000", 2024-09-13T06:41:40.285 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 78.583604605999994, 2024-09-13T06:41:40.286 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123958204, 2024-09-13T06:41:40.286 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:40.286 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:40.286 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:40.286 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:40.286 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:40.286 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43241 2024-09-13T06:41:40.286 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.286 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:40.286 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.286 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:40.286 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660682+0000", 2024-09-13T06:41:40.286 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:40.286 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.286 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.287 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:40.287 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660682+0000", 2024-09-13T06:41:40.287 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:40.287 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.287 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.287 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:40.287 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660682+0000", 2024-09-13T06:41:40.287 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:40.287 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.287 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.287 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:40.287 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660683+0000", 2024-09-13T06:41:40.287 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.308e-06 2024-09-13T06:41:40.287 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.287 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.288 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:40.288 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660686+0000", 2024-09-13T06:41:40.288 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.977e-06 2024-09-13T06:41:40.288 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.288 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.288 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:40.288 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660689+0000", 2024-09-13T06:41:40.288 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5830000000000001e-06 2024-09-13T06:41:40.288 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.288 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.288 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:40.288 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.784366+0000", 2024-09-13T06:41:40.288 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.12367713599999999 2024-09-13T06:41:40.289 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.289 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.289 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:40.289 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.784451+0000", 2024-09-13T06:41:40.289 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.4629999999999994e-05 2024-09-13T06:41:40.289 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.289 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.289 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:40.289 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.784641+0000", 2024-09-13T06:41:40.289 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00018984899999999999 2024-09-13T06:41:40.289 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:40.289 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:40.289 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:40.290 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.290 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.290 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43242 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 139264~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:40.290 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.660691+0000", 2024-09-13T06:41:40.290 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 78.583595627999998, 2024-09-13T06:41:40.290 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.124536443, 2024-09-13T06:41:40.290 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:40.290 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:40.290 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:40.290 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:40.290 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:40.290 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43242 2024-09-13T06:41:40.290 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.291 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:40.291 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.291 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:40.291 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660691+0000", 2024-09-13T06:41:40.291 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:40.291 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.291 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.291 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:40.291 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660691+0000", 2024-09-13T06:41:40.291 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:40.291 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.291 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.291 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:40.291 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660691+0000", 2024-09-13T06:41:40.291 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:41:40.292 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.292 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.292 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:40.292 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660696+0000", 2024-09-13T06:41:40.292 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0560000000000004e-06 2024-09-13T06:41:40.292 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.292 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.292 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:40.292 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660699+0000", 2024-09-13T06:41:40.292 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.2009999999999999e-06 2024-09-13T06:41:40.292 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.292 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.292 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:40.293 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660702+0000", 2024-09-13T06:41:40.293 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.633e-06 2024-09-13T06:41:40.293 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.293 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.293 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:40.293 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.784912+0000", 2024-09-13T06:41:40.293 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.124209497 2024-09-13T06:41:40.293 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.293 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.293 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:40.293 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.784995+0000", 2024-09-13T06:41:40.293 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.3891e-05 2024-09-13T06:41:40.293 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.294 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.294 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:40.294 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.785228+0000", 2024-09-13T06:41:40.294 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00023237400000000001 2024-09-13T06:41:40.294 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:40.294 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:40.294 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:40.294 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.294 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.294 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43243 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 153600~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:40.294 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.660705+0000", 2024-09-13T06:41:40.294 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 78.583582294999999, 2024-09-13T06:41:40.294 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.124825835, 2024-09-13T06:41:40.294 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:40.294 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:40.295 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:40.295 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:40.295 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:40.295 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43243 2024-09-13T06:41:40.295 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.295 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:40.295 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.295 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:40.295 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660705+0000", 2024-09-13T06:41:40.295 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:40.295 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.295 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.295 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:40.296 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660705+0000", 2024-09-13T06:41:40.296 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:40.296 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.296 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.296 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:40.296 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660705+0000", 2024-09-13T06:41:40.296 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:41:40.296 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.296 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.296 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:40.296 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660706+0000", 2024-09-13T06:41:40.296 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4339999999999999e-06 2024-09-13T06:41:40.296 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.296 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.296 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:40.297 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660709+0000", 2024-09-13T06:41:40.297 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9000000000000002e-06 2024-09-13T06:41:40.297 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.297 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.297 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:40.297 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660712+0000", 2024-09-13T06:41:40.297 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.0589999999999998e-06 2024-09-13T06:41:40.297 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.297 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.297 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:40.297 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.785318+0000", 2024-09-13T06:41:40.297 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.124606299 2024-09-13T06:41:40.298 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.298 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.298 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:40.298 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.785361+0000", 2024-09-13T06:41:40.298 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.3214999999999999e-05 2024-09-13T06:41:40.298 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.298 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.298 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:40.298 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.785531+0000", 2024-09-13T06:41:40.298 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00016914400000000001 2024-09-13T06:41:40.298 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:40.298 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:40.298 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:40.299 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.299 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.299 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43244 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 167936~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:40.299 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.660714+0000", 2024-09-13T06:41:40.299 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 78.583572881999999, 2024-09-13T06:41:40.299 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.125073248, 2024-09-13T06:41:40.299 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:40.299 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:40.299 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:40.299 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:40.299 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:40.299 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43244 2024-09-13T06:41:40.299 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.299 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:40.299 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.300 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:40.300 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660714+0000", 2024-09-13T06:41:40.300 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:40.300 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.300 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.300 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:40.300 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660714+0000", 2024-09-13T06:41:40.300 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:40.300 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.300 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.300 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:40.300 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660714+0000", 2024-09-13T06:41:40.300 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:41:40.300 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.301 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.301 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:40.301 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660715+0000", 2024-09-13T06:41:40.301 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2330000000000001e-06 2024-09-13T06:41:40.301 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.301 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.301 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:40.301 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660718+0000", 2024-09-13T06:41:40.301 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9569999999999998e-06 2024-09-13T06:41:40.301 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.301 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.301 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:40.301 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660721+0000", 2024-09-13T06:41:40.302 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.678e-06 2024-09-13T06:41:40.302 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.302 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.302 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:40.302 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.785557+0000", 2024-09-13T06:41:40.302 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.12483633199999999 2024-09-13T06:41:40.302 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.302 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.302 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:40.302 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.785618+0000", 2024-09-13T06:41:40.302 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0686000000000001e-05 2024-09-13T06:41:40.302 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.302 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.302 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:40.302 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.785787+0000", 2024-09-13T06:41:40.303 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00016957699999999999 2024-09-13T06:41:40.303 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:40.303 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:40.303 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:40.303 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.303 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.303 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43254 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 315392~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:40.303 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.664717+0000", 2024-09-13T06:41:40.303 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 78.579570313999994, 2024-09-13T06:41:40.303 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.12357108, 2024-09-13T06:41:40.303 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:40.303 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:40.303 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:40.303 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:40.304 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:40.304 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43254 2024-09-13T06:41:40.304 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.304 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:40.304 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.304 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:40.304 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664717+0000", 2024-09-13T06:41:40.304 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:40.304 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.304 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.304 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:40.304 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664717+0000", 2024-09-13T06:41:40.304 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:40.305 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.305 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.305 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:40.305 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664716+0000", 2024-09-13T06:41:40.305 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:40.305 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.305 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.305 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:40.305 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664724+0000", 2024-09-13T06:41:40.305 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.7109999999999995e-06 2024-09-13T06:41:40.306 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.306 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.306 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:40.306 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664732+0000", 2024-09-13T06:41:40.306 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.8399999999999995e-06 2024-09-13T06:41:40.306 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.306 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.306 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:40.306 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664738+0000", 2024-09-13T06:41:40.306 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.879e-06 2024-09-13T06:41:40.306 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.306 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.306 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:40.306 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.788018+0000", 2024-09-13T06:41:40.306 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123280719 2024-09-13T06:41:40.307 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.307 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.307 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:40.307 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.788119+0000", 2024-09-13T06:41:40.307 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000100558 2024-09-13T06:41:40.307 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.307 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.307 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:40.307 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.788288+0000", 2024-09-13T06:41:40.307 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000168751 2024-09-13T06:41:40.307 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:40.307 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:40.307 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:40.307 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.307 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.308 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43255 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 329728~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:40.308 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.664743+0000", 2024-09-13T06:41:40.308 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 78.579544318000003, 2024-09-13T06:41:40.308 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.12381711500000001, 2024-09-13T06:41:40.308 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:40.308 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:40.308 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:40.308 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:40.308 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:40.308 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43255 2024-09-13T06:41:40.308 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.308 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:40.308 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.308 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:40.309 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664743+0000", 2024-09-13T06:41:40.309 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:40.309 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.309 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.309 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:40.309 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664743+0000", 2024-09-13T06:41:40.309 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:40.309 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.309 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.309 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:40.309 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664742+0000", 2024-09-13T06:41:40.309 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:40.310 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.310 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.310 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:40.310 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664745+0000", 2024-09-13T06:41:40.310 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.7269999999999999e-06 2024-09-13T06:41:40.310 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.310 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.310 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:40.310 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664753+0000", 2024-09-13T06:41:40.310 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.8709999999999997e-06 2024-09-13T06:41:40.310 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.310 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.310 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:40.310 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664758+0000", 2024-09-13T06:41:40.310 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2220000000000001e-06 2024-09-13T06:41:40.311 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.311 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.311 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:40.311 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.788314+0000", 2024-09-13T06:41:40.311 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123555545 2024-09-13T06:41:40.311 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.311 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.311 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:40.311 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.788368+0000", 2024-09-13T06:41:40.311 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3928999999999998e-05 2024-09-13T06:41:40.311 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.311 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.311 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:40.311 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.788560+0000", 2024-09-13T06:41:40.312 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000192237 2024-09-13T06:41:40.312 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:40.312 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:40.312 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:40.312 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.312 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.312 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43256 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 344064~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:40.312 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.664763+0000", 2024-09-13T06:41:40.312 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 78.579524371999995, 2024-09-13T06:41:40.312 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.12418359399999999, 2024-09-13T06:41:40.312 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:40.312 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:40.312 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:40.312 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:40.312 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:40.313 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43256 2024-09-13T06:41:40.313 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.313 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:40.313 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.313 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:40.313 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664763+0000", 2024-09-13T06:41:40.313 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:40.313 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.313 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.313 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:40.313 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664763+0000", 2024-09-13T06:41:40.313 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:40.313 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.314 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.314 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:40.314 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664762+0000", 2024-09-13T06:41:40.314 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:40.314 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.314 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.314 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:40.314 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664765+0000", 2024-09-13T06:41:40.314 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3290000000000001e-06 2024-09-13T06:41:40.314 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.314 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.314 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:40.314 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664771+0000", 2024-09-13T06:41:40.314 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.1319999999999999e-06 2024-09-13T06:41:40.315 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.315 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.315 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:40.315 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664776+0000", 2024-09-13T06:41:40.315 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.8840000000000002e-06 2024-09-13T06:41:40.315 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.315 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.315 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:40.315 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.788598+0000", 2024-09-13T06:41:40.315 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123821979 2024-09-13T06:41:40.315 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.315 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.315 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:40.315 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.788680+0000", 2024-09-13T06:41:40.316 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.2367999999999995e-05 2024-09-13T06:41:40.316 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.316 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.316 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:40.316 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.788946+0000", 2024-09-13T06:41:40.316 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00026629799999999999 2024-09-13T06:41:40.316 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:40.316 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:40.316 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:40.316 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.316 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.316 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43265 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 477184~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:40.316 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.669414+0000", 2024-09-13T06:41:40.316 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 78.574872736000003, 2024-09-13T06:41:40.317 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123446973, 2024-09-13T06:41:40.317 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:40.317 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:40.317 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:40.317 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:40.317 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:40.317 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43265 2024-09-13T06:41:40.317 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.317 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:40.317 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.317 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:40.317 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669414+0000", 2024-09-13T06:41:40.317 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:40.317 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.318 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.318 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:40.318 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669414+0000", 2024-09-13T06:41:40.318 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:40.318 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.318 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.318 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:40.318 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669414+0000", 2024-09-13T06:41:40.318 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:40.318 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.318 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.318 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:40.318 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669416+0000", 2024-09-13T06:41:40.318 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.317e-06 2024-09-13T06:41:40.318 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.319 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.319 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:40.319 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669425+0000", 2024-09-13T06:41:40.319 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.0650000000000005e-06 2024-09-13T06:41:40.319 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.319 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.319 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:40.319 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669430+0000", 2024-09-13T06:41:40.319 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5079999999999999e-06 2024-09-13T06:41:40.319 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.319 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.319 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:40.319 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.792649+0000", 2024-09-13T06:41:40.319 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123219328 2024-09-13T06:41:40.319 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.320 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.320 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:40.320 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.792695+0000", 2024-09-13T06:41:40.320 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5476999999999998e-05 2024-09-13T06:41:40.320 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.320 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.320 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:40.320 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.792861+0000", 2024-09-13T06:41:40.320 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00016658999999999999 2024-09-13T06:41:40.320 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:40.320 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:40.320 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:40.320 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.320 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.321 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43266 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 491520~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:40.321 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.669434+0000", 2024-09-13T06:41:40.321 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 78.574852613999994, 2024-09-13T06:41:40.321 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123685267, 2024-09-13T06:41:40.321 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:40.321 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:40.321 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:40.321 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:40.321 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:40.321 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43266 2024-09-13T06:41:40.321 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.321 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:40.321 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.321 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:40.322 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669434+0000", 2024-09-13T06:41:40.322 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:40.322 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.322 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.322 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:40.322 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669434+0000", 2024-09-13T06:41:40.322 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:40.322 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.322 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.322 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:40.322 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669434+0000", 2024-09-13T06:41:40.322 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:40.322 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.322 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.322 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:40.322 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669441+0000", 2024-09-13T06:41:40.323 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3019999999999997e-06 2024-09-13T06:41:40.323 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.323 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.323 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:40.323 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669451+0000", 2024-09-13T06:41:40.323 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.6379999999999999e-06 2024-09-13T06:41:40.323 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.323 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.323 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:40.323 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669456+0000", 2024-09-13T06:41:40.323 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.361e-06 2024-09-13T06:41:40.323 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.323 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.323 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:40.323 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.792879+0000", 2024-09-13T06:41:40.324 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123422686 2024-09-13T06:41:40.324 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.324 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.324 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:40.324 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.792923+0000", 2024-09-13T06:41:40.324 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4035000000000001e-05 2024-09-13T06:41:40.324 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.324 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.324 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:40.324 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.793120+0000", 2024-09-13T06:41:40.324 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00019660899999999999 2024-09-13T06:41:40.324 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:40.324 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:40.324 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:40.324 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.325 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.325 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43267 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 505856~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:40.325 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.669461+0000", 2024-09-13T06:41:40.325 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 78.574825817999994, 2024-09-13T06:41:40.325 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123933711, 2024-09-13T06:41:40.325 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:40.325 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:40.325 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:40.325 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:40.325 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:40.325 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43267 2024-09-13T06:41:40.325 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.325 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:40.325 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.326 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:40.326 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669461+0000", 2024-09-13T06:41:40.326 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:40.326 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.326 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.326 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:40.326 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669461+0000", 2024-09-13T06:41:40.326 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:40.326 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.326 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.326 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:40.326 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669461+0000", 2024-09-13T06:41:40.326 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:40.326 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.326 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.327 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:40.327 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669463+0000", 2024-09-13T06:41:40.327 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5629999999999999e-06 2024-09-13T06:41:40.327 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.327 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.327 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:40.327 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669473+0000", 2024-09-13T06:41:40.327 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.9520000000000006e-06 2024-09-13T06:41:40.327 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.327 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.327 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:40.327 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669479+0000", 2024-09-13T06:41:40.327 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8540000000000002e-06 2024-09-13T06:41:40.327 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.328 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.328 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:40.328 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.793137+0000", 2024-09-13T06:41:40.328 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.12365825699999999 2024-09-13T06:41:40.328 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.328 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.328 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:40.328 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.793181+0000", 2024-09-13T06:41:40.328 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.3773999999999998e-05 2024-09-13T06:41:40.328 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.328 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.328 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:40.328 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.793395+0000", 2024-09-13T06:41:40.328 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00021372399999999999 2024-09-13T06:41:40.328 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:40.329 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:40.329 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:40.329 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.329 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.329 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43268 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 520192~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:40.329 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.669484+0000", 2024-09-13T06:41:40.329 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 78.574803032999995, 2024-09-13T06:41:40.329 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.12441057899999999, 2024-09-13T06:41:40.329 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:40.329 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:40.329 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:40.329 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:40.329 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:40.329 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43268 2024-09-13T06:41:40.329 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.330 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:40.330 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.330 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:40.330 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669484+0000", 2024-09-13T06:41:40.330 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:40.330 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.330 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.330 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:40.330 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669484+0000", 2024-09-13T06:41:40.330 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:40.330 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.330 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.330 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:40.330 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669484+0000", 2024-09-13T06:41:40.331 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:40.331 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.331 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.331 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:40.331 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669486+0000", 2024-09-13T06:41:40.331 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6120000000000001e-06 2024-09-13T06:41:40.331 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.331 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.331 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:40.331 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669494+0000", 2024-09-13T06:41:40.331 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4819999999999997e-06 2024-09-13T06:41:40.331 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.331 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.332 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:40.332 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669497+0000", 2024-09-13T06:41:40.332 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9790000000000002e-06 2024-09-13T06:41:40.332 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.332 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.332 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:40.332 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.793559+0000", 2024-09-13T06:41:40.332 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.124062436 2024-09-13T06:41:40.332 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.332 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.332 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:40.332 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.793603+0000", 2024-09-13T06:41:40.332 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.3764999999999999e-05 2024-09-13T06:41:40.333 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.333 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.333 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:40.333 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.793895+0000", 2024-09-13T06:41:40.333 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00029168299999999999 2024-09-13T06:41:40.333 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:40.333 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:40.333 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:40.333 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:40.333 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:40.333 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:41:40.335 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-13T06:41:40.335 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:41:40.333+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:41:40.436 INFO:tasks.ceph.osd.6.smithi139.stderr:2024-09-13T06:41:40.430+0000 7fcd02c5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26385) UID: 0 2024-09-13T06:41:40.495 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-13T06:41:40.524 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:41:40.524 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [ 2024-09-13T06:41:40.524 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.524 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:101756 3.6 3.fd483166 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e142)", 2024-09-13T06:41:40.524 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:41:40.522777+0000", 2024-09-13T06:41:40.524 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.00077889500000000004, 2024-09-13T06:41:40.525 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00080555000000000004, 2024-09-13T06:41:40.525 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:40.525 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-13T06:41:40.525 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:40.525 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:40.525 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:40.525 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 101756 2024-09-13T06:41:40.525 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.525 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:40.525 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.525 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:40.525 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:40.522777+0000", 2024-09-13T06:41:40.526 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:40.526 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.526 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.526 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:40.526 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:40.522777+0000", 2024-09-13T06:41:40.526 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:40.526 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.526 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.526 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:40.526 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:40.522777+0000", 2024-09-13T06:41:40.526 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:40.526 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.526 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.526 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:40.526 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:40.522780+0000", 2024-09-13T06:41:40.527 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4760000000000001e-06 2024-09-13T06:41:40.527 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.527 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.527 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:40.527 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:40.522786+0000", 2024-09-13T06:41:40.527 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.178e-06 2024-09-13T06:41:40.527 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.527 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.527 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:40.527 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:40.522791+0000", 2024-09-13T06:41:40.527 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0259999999999998e-06 2024-09-13T06:41:40.527 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:40.527 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:40.527 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:40.528 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.528 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.528 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:101757 3.6 3.fd483166 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e142)", 2024-09-13T06:41:40.528 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:41:40.522795+0000", 2024-09-13T06:41:40.528 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.00076121000000000001, 2024-09-13T06:41:40.528 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000859981, 2024-09-13T06:41:40.528 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:40.528 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-13T06:41:40.528 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:40.528 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:40.528 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:40.528 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 101757 2024-09-13T06:41:40.528 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.529 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:40.529 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.529 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:40.529 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:40.522795+0000", 2024-09-13T06:41:40.529 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:40.529 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.529 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.529 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:40.529 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:40.522795+0000", 2024-09-13T06:41:40.529 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:40.529 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.529 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.529 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:40.530 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:40.522795+0000", 2024-09-13T06:41:40.530 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:40.530 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.530 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.530 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:40.530 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:40.522798+0000", 2024-09-13T06:41:40.530 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.7539999999999998e-06 2024-09-13T06:41:40.530 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.530 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.530 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:40.530 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:40.522804+0000", 2024-09-13T06:41:40.530 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.4320000000000004e-06 2024-09-13T06:41:40.530 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.530 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.531 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:40.531 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:40.522809+0000", 2024-09-13T06:41:40.531 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0690000000000001e-06 2024-09-13T06:41:40.531 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:40.531 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:40.531 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:40.531 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.531 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.531 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:101758 3.6 3.fd483166 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e142)", 2024-09-13T06:41:40.531 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:41:40.522814+0000", 2024-09-13T06:41:40.531 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.00074269799999999997, 2024-09-13T06:41:40.531 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00090060300000000004, 2024-09-13T06:41:40.531 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:40.531 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-13T06:41:40.532 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:40.532 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:40.532 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:40.532 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 101758 2024-09-13T06:41:40.532 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.532 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:40.532 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.532 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:40.532 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:40.522814+0000", 2024-09-13T06:41:40.532 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:40.532 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.532 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.532 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:40.533 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:40.522814+0000", 2024-09-13T06:41:40.533 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:40.533 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.533 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.533 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:40.533 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:40.522813+0000", 2024-09-13T06:41:40.533 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:40.533 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.533 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.533 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:40.533 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:40.522816+0000", 2024-09-13T06:41:40.533 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6900000000000001e-06 2024-09-13T06:41:40.534 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.534 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.534 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:40.534 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:40.522822+0000", 2024-09-13T06:41:40.534 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.4559999999999997e-06 2024-09-13T06:41:40.534 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.534 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.534 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:40.534 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:40.522827+0000", 2024-09-13T06:41:40.534 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9099999999999996e-06 2024-09-13T06:41:40.534 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:40.534 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:40.534 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:40.534 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.535 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.535 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:101759 3.6 3.fd483166 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e142)", 2024-09-13T06:41:40.535 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:41:40.522832+0000", 2024-09-13T06:41:40.535 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.00072479300000000005, 2024-09-13T06:41:40.535 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00093812599999999996, 2024-09-13T06:41:40.535 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:40.535 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-13T06:41:40.535 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:40.535 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:40.535 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:40.535 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 101759 2024-09-13T06:41:40.535 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.535 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:40.535 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.536 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:40.536 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:40.522832+0000", 2024-09-13T06:41:40.536 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:40.536 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.536 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.536 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:40.536 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:40.522832+0000", 2024-09-13T06:41:40.536 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:40.536 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.536 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.536 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:40.536 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:40.522831+0000", 2024-09-13T06:41:40.536 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:40.536 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.536 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.537 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:40.537 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:40.522834+0000", 2024-09-13T06:41:40.537 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5780000000000001e-06 2024-09-13T06:41:40.537 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.537 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.537 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:40.537 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:40.522840+0000", 2024-09-13T06:41:40.537 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.139e-06 2024-09-13T06:41:40.537 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.537 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.537 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:40.537 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:40.522845+0000", 2024-09-13T06:41:40.537 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7879999999999997e-06 2024-09-13T06:41:40.538 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:40.538 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:40.538 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:40.538 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.538 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.538 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:101760 3.6 3.fd483166 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e142)", 2024-09-13T06:41:40.538 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:41:40.522849+0000", 2024-09-13T06:41:40.538 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.00070737999999999997, 2024-09-13T06:41:40.538 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00097127599999999998, 2024-09-13T06:41:40.538 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:40.538 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-13T06:41:40.538 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:40.538 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:40.538 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:40.539 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 101760 2024-09-13T06:41:40.539 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.539 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:40.539 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.539 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:40.539 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:40.522849+0000", 2024-09-13T06:41:40.539 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:40.539 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.539 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.539 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:40.539 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:40.522849+0000", 2024-09-13T06:41:40.539 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:40.539 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.539 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.540 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:40.540 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:40.522849+0000", 2024-09-13T06:41:40.540 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:40.540 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.540 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.540 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:40.540 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:40.522851+0000", 2024-09-13T06:41:40.540 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5289999999999998e-06 2024-09-13T06:41:40.540 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.541 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.541 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:40.541 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:40.522857+0000", 2024-09-13T06:41:40.541 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.463e-06 2024-09-13T06:41:40.541 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.541 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.541 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:40.541 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:40.522867+0000", 2024-09-13T06:41:40.541 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0488e-05 2024-09-13T06:41:40.541 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:40.541 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:40.541 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:40.541 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.542 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.542 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:101766 3.0 3.79b7a0c0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e142)", 2024-09-13T06:41:40.542 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:41:40.522872+0000", 2024-09-13T06:41:40.542 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.00068471999999999999, 2024-09-13T06:41:40.542 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0009840719999999999, 2024-09-13T06:41:40.542 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:40.542 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-13T06:41:40.542 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:40.542 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:40.542 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:40.542 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 101766 2024-09-13T06:41:40.542 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.542 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:40.542 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.542 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:40.543 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:40.522872+0000", 2024-09-13T06:41:40.543 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:40.543 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.543 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.543 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:40.543 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:40.522872+0000", 2024-09-13T06:41:40.543 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:40.543 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.543 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.543 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:40.543 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:40.522871+0000", 2024-09-13T06:41:40.543 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:40.543 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.543 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.544 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:40.544 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:40.522874+0000", 2024-09-13T06:41:40.544 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6749999999999998e-06 2024-09-13T06:41:40.544 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.544 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.544 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:40.544 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:40.522880+0000", 2024-09-13T06:41:40.544 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.4980000000000003e-06 2024-09-13T06:41:40.544 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.544 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.544 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:40.544 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:40.522885+0000", 2024-09-13T06:41:40.544 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9860000000000002e-06 2024-09-13T06:41:40.545 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:40.545 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:40.545 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:40.545 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.545 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.545 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:101767 3.0 3.79b7a0c0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e142)", 2024-09-13T06:41:40.545 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:41:40.522896+0000", 2024-09-13T06:41:40.548 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.00066004900000000001, 2024-09-13T06:41:40.548 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0010144259999999999, 2024-09-13T06:41:40.548 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:40.548 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-13T06:41:40.548 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:40.548 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:40.548 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:40.549 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 101767 2024-09-13T06:41:40.549 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.549 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:40.549 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.549 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:40.549 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:40.522896+0000", 2024-09-13T06:41:40.549 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:40.549 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.549 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.549 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:40.549 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:40.522896+0000", 2024-09-13T06:41:40.549 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:40.549 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.549 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.550 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:40.550 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:40.522896+0000", 2024-09-13T06:41:40.550 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:40.550 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.550 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.550 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:40.550 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:40.522899+0000", 2024-09-13T06:41:40.550 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.667e-06 2024-09-13T06:41:40.550 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.550 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.550 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:40.550 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:40.522906+0000", 2024-09-13T06:41:40.550 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.2760000000000003e-06 2024-09-13T06:41:40.551 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.551 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.551 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:40.551 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:40.522911+0000", 2024-09-13T06:41:40.551 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.096e-06 2024-09-13T06:41:40.551 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:40.551 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:40.551 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:40.551 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.551 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.551 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:101768 3.0 3.79b7a0c0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e142)", 2024-09-13T06:41:40.551 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:41:40.522916+0000", 2024-09-13T06:41:40.552 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.00064080500000000004, 2024-09-13T06:41:40.552 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0010532549999999999, 2024-09-13T06:41:40.552 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:40.552 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-13T06:41:40.552 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:40.552 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:40.552 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:40.552 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 101768 2024-09-13T06:41:40.552 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.552 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:40.552 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.552 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:40.552 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:40.522916+0000", 2024-09-13T06:41:40.552 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:40.553 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.553 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.553 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:40.553 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:40.522916+0000", 2024-09-13T06:41:40.553 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:40.553 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.553 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.553 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:40.553 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:40.522915+0000", 2024-09-13T06:41:40.553 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:40.553 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.553 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.553 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:40.553 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:40.522925+0000", 2024-09-13T06:41:40.554 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.8320000000000001e-06 2024-09-13T06:41:40.554 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.554 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.554 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:40.554 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:40.522932+0000", 2024-09-13T06:41:40.554 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.7020000000000004e-06 2024-09-13T06:41:40.554 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.554 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.554 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:40.554 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:40.522937+0000", 2024-09-13T06:41:40.554 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9080000000000003e-06 2024-09-13T06:41:40.554 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:40.554 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:40.554 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:40.554 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.554 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.555 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:101769 3.0 3.79b7a0c0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e142)", 2024-09-13T06:41:40.555 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:41:40.522941+0000", 2024-09-13T06:41:40.555 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.00061517400000000002, 2024-09-13T06:41:40.555 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.001096365, 2024-09-13T06:41:40.555 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:40.555 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-13T06:41:40.555 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:40.555 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:40.555 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:40.555 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 101769 2024-09-13T06:41:40.555 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.555 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:40.555 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.555 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:40.556 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:40.522941+0000", 2024-09-13T06:41:40.556 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:40.556 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.556 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.556 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:40.556 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:40.522941+0000", 2024-09-13T06:41:40.556 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:40.556 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.556 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.556 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:40.556 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:40.522941+0000", 2024-09-13T06:41:40.556 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:40.556 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.557 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.557 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:40.557 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:40.522943+0000", 2024-09-13T06:41:40.557 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4430000000000002e-06 2024-09-13T06:41:40.557 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.557 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.557 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:40.557 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:40.522949+0000", 2024-09-13T06:41:40.557 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.2149999999999998e-06 2024-09-13T06:41:40.557 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.557 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.557 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:40.557 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:40.522954+0000", 2024-09-13T06:41:40.558 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.8359999999999999e-06 2024-09-13T06:41:40.558 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:40.558 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:40.558 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:40.558 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.558 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.558 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:101770 3.0 3.79b7a0c0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e142)", 2024-09-13T06:41:40.558 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:41:40.522958+0000", 2024-09-13T06:41:40.558 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.00059804699999999999, 2024-09-13T06:41:40.558 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0011415279999999999, 2024-09-13T06:41:40.558 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:40.558 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-13T06:41:40.558 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:40.558 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:40.559 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:40.559 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 101770 2024-09-13T06:41:40.559 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.559 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:40.559 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.559 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:40.559 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:40.522958+0000", 2024-09-13T06:41:40.559 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:40.559 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.559 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.559 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:40.559 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:40.522958+0000", 2024-09-13T06:41:40.560 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:40.560 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.560 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.560 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:40.560 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:40.522958+0000", 2024-09-13T06:41:40.560 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:40.560 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.560 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.560 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:40.560 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:40.522960+0000", 2024-09-13T06:41:40.560 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4880000000000001e-06 2024-09-13T06:41:40.560 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.560 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.560 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:40.561 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:40.522966+0000", 2024-09-13T06:41:40.561 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9100000000000002e-06 2024-09-13T06:41:40.561 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.561 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.561 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:40.561 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:40.522971+0000", 2024-09-13T06:41:40.561 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5240000000000002e-06 2024-09-13T06:41:40.561 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:40.561 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:40.561 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:40.561 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.561 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.561 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:101772 3.4 3:24f9c433:::rbd_data.1121de81beae.0000000000000003:4c [read 90112~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e142)", 2024-09-13T06:41:40.562 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:41:40.523000+0000", 2024-09-13T06:41:40.562 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.00055647800000000001, 2024-09-13T06:41:40.562 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0011640680000000001, 2024-09-13T06:41:40.562 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:40.562 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:40.562 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:40.562 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:40.562 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:40.562 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 101772 2024-09-13T06:41:40.562 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.562 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:40.562 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.562 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:40.562 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:40.523000+0000", 2024-09-13T06:41:40.563 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:40.563 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.563 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.563 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:40.563 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:40.523000+0000", 2024-09-13T06:41:40.563 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:40.563 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.563 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.563 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:40.563 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:40.522999+0000", 2024-09-13T06:41:40.563 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:40.563 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.563 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.563 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:40.564 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:40.523002+0000", 2024-09-13T06:41:40.564 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.915e-06 2024-09-13T06:41:40.564 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.564 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.564 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:40.564 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:40.523009+0000", 2024-09-13T06:41:40.564 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3740000000000003e-06 2024-09-13T06:41:40.564 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.564 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.564 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:40.564 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:40.523013+0000", 2024-09-13T06:41:40.564 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5430000000000004e-06 2024-09-13T06:41:40.564 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.564 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.565 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:40.565 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:40.523592+0000", 2024-09-13T06:41:40.565 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000578788 2024-09-13T06:41:40.565 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.565 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.565 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:40.565 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:40.523686+0000", 2024-09-13T06:41:40.565 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.3957999999999997e-05 2024-09-13T06:41:40.565 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:40.565 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:40.565 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:40.565 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.565 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.565 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:101773 3.4 3.cc239f24 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e142)", 2024-09-13T06:41:40.565 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:41:40.523490+0000", 2024-09-13T06:41:40.566 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 6.6167000000000005e-05, 2024-09-13T06:41:40.566 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00074261599999999998, 2024-09-13T06:41:40.566 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:40.566 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-13T06:41:40.566 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:40.566 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:40.566 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:40.566 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 101773 2024-09-13T06:41:40.566 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.566 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:40.566 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.566 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:40.566 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:40.523490+0000", 2024-09-13T06:41:40.566 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:40.567 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.567 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.567 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:40.567 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:40.523490+0000", 2024-09-13T06:41:40.567 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:40.567 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.567 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.567 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:40.567 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:40.523489+0000", 2024-09-13T06:41:40.567 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:40.567 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.567 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.567 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:40.567 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:40.523494+0000", 2024-09-13T06:41:40.567 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9679999999999997e-06 2024-09-13T06:41:40.568 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.568 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.568 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:40.568 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:40.523506+0000", 2024-09-13T06:41:40.568 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1202999999999999e-05 2024-09-13T06:41:40.568 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.568 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.568 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:40.568 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:40.523513+0000", 2024-09-13T06:41:40.568 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5830000000000001e-06 2024-09-13T06:41:40.568 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:40.568 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:40.568 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:40.568 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.569 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.569 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:101774 3.4 3.cc239f24 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e142)", 2024-09-13T06:41:40.569 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:41:40.523519+0000", 2024-09-13T06:41:40.569 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 3.7460999999999999e-05, 2024-09-13T06:41:40.569 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00076919, 2024-09-13T06:41:40.569 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:40.569 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-13T06:41:40.569 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:40.569 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:40.569 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:40.569 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 101774 2024-09-13T06:41:40.569 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.569 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:40.569 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.570 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:40.570 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:40.523519+0000", 2024-09-13T06:41:40.570 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:40.570 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.570 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.570 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:40.570 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:40.523519+0000", 2024-09-13T06:41:40.570 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:40.570 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.570 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.570 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:40.570 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:40.523518+0000", 2024-09-13T06:41:40.570 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:40.570 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.571 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.571 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:40.571 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:40.523521+0000", 2024-09-13T06:41:40.571 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.7719999999999999e-06 2024-09-13T06:41:40.571 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.571 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.571 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:40.571 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:40.523528+0000", 2024-09-13T06:41:40.571 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3670000000000002e-06 2024-09-13T06:41:40.571 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.571 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.571 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:40.571 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:40.523532+0000", 2024-09-13T06:41:40.572 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.826e-06 2024-09-13T06:41:40.572 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:40.572 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:40.572 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:40.572 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.572 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.572 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:101775 3.4 3.cc239f24 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e142)", 2024-09-13T06:41:40.572 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:41:40.523537+0000", 2024-09-13T06:41:40.572 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 1.893e-05, 2024-09-13T06:41:40.572 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00081181500000000002, 2024-09-13T06:41:40.572 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:40.572 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-13T06:41:40.572 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:40.573 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:40.573 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:40.573 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 101775 2024-09-13T06:41:40.573 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.573 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:40.573 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.573 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:40.573 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:40.523537+0000", 2024-09-13T06:41:40.573 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:40.573 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.573 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.573 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:40.573 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:40.523537+0000", 2024-09-13T06:41:40.573 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:40.574 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.574 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.574 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:40.574 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:40.523537+0000", 2024-09-13T06:41:40.574 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:40.574 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.574 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.574 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:40.574 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:40.523540+0000", 2024-09-13T06:41:40.574 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5349999999999999e-06 2024-09-13T06:41:40.574 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.574 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.574 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:40.574 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:40.523545+0000", 2024-09-13T06:41:40.575 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.4990000000000002e-06 2024-09-13T06:41:40.575 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.575 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.575 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:40.575 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:40.523549+0000", 2024-09-13T06:41:40.575 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.3640000000000001e-06 2024-09-13T06:41:40.575 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:40.575 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:40.575 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:40.575 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.575 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.575 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:101791 3.6 3.75937786 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e142)", 2024-09-13T06:41:40.575 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:41:40.523554+0000", 2024-09-13T06:41:40.576 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 2.7499999999999999e-06, 2024-09-13T06:41:40.576 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00084635899999999998, 2024-09-13T06:41:40.576 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:40.576 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-13T06:41:40.576 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:40.576 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:40.576 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:40.576 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 101791 2024-09-13T06:41:40.576 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.576 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:40.576 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.576 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:40.576 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:40.523554+0000", 2024-09-13T06:41:40.576 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:40.576 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.577 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.577 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:40.577 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:40.523554+0000", 2024-09-13T06:41:40.577 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:40.577 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.577 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.577 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:40.577 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:40.523553+0000", 2024-09-13T06:41:40.577 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:40.577 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.577 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.577 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:40.577 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:40.523556+0000", 2024-09-13T06:41:40.577 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4980000000000001e-06 2024-09-13T06:41:40.577 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.578 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.578 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:40.578 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:40.523562+0000", 2024-09-13T06:41:40.578 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.2689999999999996e-06 2024-09-13T06:41:40.578 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.578 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.578 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:40.578 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:40.523567+0000", 2024-09-13T06:41:40.578 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6739999999999996e-06 2024-09-13T06:41:40.578 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:40.578 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:40.578 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:40.578 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.578 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.579 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:101792 3.6 3.75937786 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e142)", 2024-09-13T06:41:40.579 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:41:40.523571+0000", 2024-09-13T06:41:40.579 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 4294967295.9999852, 2024-09-13T06:41:40.579 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00088547400000000003, 2024-09-13T06:41:40.579 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:40.579 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-13T06:41:40.579 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:40.579 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:40.579 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:40.579 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 101792 2024-09-13T06:41:40.579 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.579 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:40.579 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.579 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:40.580 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:40.523571+0000", 2024-09-13T06:41:40.580 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:40.580 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.580 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.580 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:40.580 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:40.523571+0000", 2024-09-13T06:41:40.580 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:40.580 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.580 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.580 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:40.580 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:40.523571+0000", 2024-09-13T06:41:40.580 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:40.580 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.581 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.581 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:40.581 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:40.523573+0000", 2024-09-13T06:41:40.581 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4870000000000001e-06 2024-09-13T06:41:40.581 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.581 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.581 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:40.581 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:40.523579+0000", 2024-09-13T06:41:40.581 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7440000000000004e-06 2024-09-13T06:41:40.581 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.581 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.581 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:40.581 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:40.523583+0000", 2024-09-13T06:41:40.581 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5220000000000001e-06 2024-09-13T06:41:40.582 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:40.582 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:40.582 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:40.582 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.582 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.582 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:101793 3.6 3.75937786 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e142)", 2024-09-13T06:41:40.582 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:41:40.523587+0000", 2024-09-13T06:41:40.582 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 4294967295.999969, 2024-09-13T06:41:40.582 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00093562599999999995, 2024-09-13T06:41:40.582 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:40.582 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-13T06:41:40.582 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:40.582 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:40.582 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:40.582 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 101793 2024-09-13T06:41:40.582 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.583 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:40.583 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.583 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:40.583 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:40.523587+0000", 2024-09-13T06:41:40.583 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:40.583 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.583 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.583 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:40.583 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:40.523587+0000", 2024-09-13T06:41:40.583 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:40.583 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.583 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.583 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:40.583 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:40.523587+0000", 2024-09-13T06:41:40.583 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:40.584 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.584 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.584 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:40.584 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:40.523589+0000", 2024-09-13T06:41:40.584 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2259999999999999e-06 2024-09-13T06:41:40.584 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.584 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.584 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:40.584 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:40.523595+0000", 2024-09-13T06:41:40.584 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.4349999999999996e-06 2024-09-13T06:41:40.584 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.584 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.584 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:40.584 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:40.523605+0000", 2024-09-13T06:41:40.584 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0016e-05 2024-09-13T06:41:40.585 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:40.585 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:40.585 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:40.585 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.585 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.585 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:101794 3.6 3.75937786 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e142)", 2024-09-13T06:41:40.585 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:41:40.523609+0000", 2024-09-13T06:41:40.585 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 4294967295.9999471, 2024-09-13T06:41:40.585 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00097679199999999998, 2024-09-13T06:41:40.585 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:40.585 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-13T06:41:40.585 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:40.586 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:40.586 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:40.586 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 101794 2024-09-13T06:41:40.586 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.586 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:40.586 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.586 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:40.586 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:40.523609+0000", 2024-09-13T06:41:40.586 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:40.586 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.586 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.586 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:40.586 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:40.523609+0000", 2024-09-13T06:41:40.586 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:40.586 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.587 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.587 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:40.587 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:40.523609+0000", 2024-09-13T06:41:40.587 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:40.587 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.587 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.587 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:40.587 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:40.523611+0000", 2024-09-13T06:41:40.587 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4679999999999999e-06 2024-09-13T06:41:40.587 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.587 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.587 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:40.587 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:40.523617+0000", 2024-09-13T06:41:40.587 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0909999999999998e-06 2024-09-13T06:41:40.588 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.588 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.588 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:40.588 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:40.523622+0000", 2024-09-13T06:41:40.588 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4850000000000003e-06 2024-09-13T06:41:40.588 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:40.588 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:40.588 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:40.588 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.588 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.588 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:101820 3.6 3.fd483166 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e142)", 2024-09-13T06:41:40.588 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:41:40.523626+0000", 2024-09-13T06:41:40.589 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 4294967295.9999304, 2024-09-13T06:41:40.589 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.001019645, 2024-09-13T06:41:40.589 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:40.589 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-13T06:41:40.589 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:40.589 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:40.589 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:40.589 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 101820 2024-09-13T06:41:40.589 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.589 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:40.589 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.589 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:40.589 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:40.523626+0000", 2024-09-13T06:41:40.590 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:40.590 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.590 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.590 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:40.590 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:40.523626+0000", 2024-09-13T06:41:40.590 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:40.590 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.590 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.590 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:40.590 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:40.523626+0000", 2024-09-13T06:41:40.590 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:40.590 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.590 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.590 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:40.590 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:40.523633+0000", 2024-09-13T06:41:40.590 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.2989999999999999e-06 2024-09-13T06:41:40.591 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.591 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.591 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:40.591 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:40.523654+0000", 2024-09-13T06:41:40.591 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1209e-05 2024-09-13T06:41:40.591 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.591 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.591 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:40.591 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:40.523660+0000", 2024-09-13T06:41:40.591 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.5809999999999996e-06 2024-09-13T06:41:40.591 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:40.591 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:40.591 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:40.591 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.591 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.592 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:101821 3.6 3.fd483166 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e142)", 2024-09-13T06:41:40.592 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:41:40.523665+0000", 2024-09-13T06:41:40.592 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 4294967295.9998913, 2024-09-13T06:41:40.592 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0010449879999999999, 2024-09-13T06:41:40.592 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:40.592 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-13T06:41:40.592 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:40.592 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:40.592 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:40.592 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 101821 2024-09-13T06:41:40.592 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.592 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:40.592 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.592 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:40.593 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:40.523665+0000", 2024-09-13T06:41:40.593 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:40.593 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.593 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.593 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:40.593 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:40.523665+0000", 2024-09-13T06:41:40.593 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:40.593 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.593 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.593 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:40.593 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:40.523665+0000", 2024-09-13T06:41:40.593 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:40.593 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.594 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.594 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:40.594 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:40.523668+0000", 2024-09-13T06:41:40.594 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.106e-06 2024-09-13T06:41:40.594 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.594 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.594 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:40.594 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:40.523674+0000", 2024-09-13T06:41:40.594 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.2539999999999998e-06 2024-09-13T06:41:40.594 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.594 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.594 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:40.594 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:40.523679+0000", 2024-09-13T06:41:40.594 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.403e-06 2024-09-13T06:41:40.594 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:40.594 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:40.595 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:40.595 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.595 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.595 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:101822 3.6 3.fd483166 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e142)", 2024-09-13T06:41:40.595 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:41:40.523683+0000", 2024-09-13T06:41:40.595 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 4294967295.9998736, 2024-09-13T06:41:40.595 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0010849690000000001, 2024-09-13T06:41:40.595 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:40.595 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-13T06:41:40.595 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:40.595 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:40.595 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:40.595 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 101822 2024-09-13T06:41:40.595 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.595 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:40.596 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.596 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:40.596 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:40.523683+0000", 2024-09-13T06:41:40.596 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:40.596 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.596 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.596 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:40.596 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:40.523683+0000", 2024-09-13T06:41:40.596 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:40.596 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.596 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.596 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:40.596 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:40.523682+0000", 2024-09-13T06:41:40.596 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:40.596 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.597 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.597 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:40.597 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:40.523684+0000", 2024-09-13T06:41:40.597 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2800000000000002e-06 2024-09-13T06:41:40.597 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.597 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.597 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:40.597 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:40.523690+0000", 2024-09-13T06:41:40.597 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8440000000000003e-06 2024-09-13T06:41:40.597 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.597 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.597 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:40.597 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:40.523695+0000", 2024-09-13T06:41:40.597 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6759999999999998e-06 2024-09-13T06:41:40.598 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:40.598 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:40.598 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:40.598 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.598 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.598 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:101823 3.6 3.fd483166 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e142)", 2024-09-13T06:41:40.598 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:41:40.523699+0000", 2024-09-13T06:41:40.598 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 4294967295.9998574, 2024-09-13T06:41:40.598 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0011229009999999999, 2024-09-13T06:41:40.598 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:40.598 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-13T06:41:40.598 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:40.598 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:40.598 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:40.599 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 101823 2024-09-13T06:41:40.599 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.599 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:40.599 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.599 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:40.599 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:40.523699+0000", 2024-09-13T06:41:40.599 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:40.599 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.599 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.599 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:40.599 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:40.523699+0000", 2024-09-13T06:41:40.599 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:40.599 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.599 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.600 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:40.600 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:40.523699+0000", 2024-09-13T06:41:40.600 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:40.600 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.600 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.600 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:40.600 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:40.523701+0000", 2024-09-13T06:41:40.600 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1260000000000001e-06 2024-09-13T06:41:40.600 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.600 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.600 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:40.601 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:40.523706+0000", 2024-09-13T06:41:40.601 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.6529999999999999e-06 2024-09-13T06:41:40.601 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.601 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.601 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:40.601 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:40.523711+0000", 2024-09-13T06:41:40.601 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5109999999999997e-06 2024-09-13T06:41:40.601 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:40.601 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:40.601 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:40.601 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.601 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.601 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:101824 3.6 3.fd483166 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e142)", 2024-09-13T06:41:40.601 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:41:40.523949+0000", 2024-09-13T06:41:40.601 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 4294967295.999608, 2024-09-13T06:41:40.602 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000911763, 2024-09-13T06:41:40.602 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:40.602 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-13T06:41:40.602 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:40.602 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:40.602 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:40.602 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 101824 2024-09-13T06:41:40.602 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.602 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:40.602 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.603 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:40.603 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:40.523949+0000", 2024-09-13T06:41:40.603 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:40.603 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.603 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.603 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:40.603 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:40.523949+0000", 2024-09-13T06:41:40.603 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:40.603 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.603 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.603 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:40.603 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:40.523948+0000", 2024-09-13T06:41:40.603 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:40.603 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.603 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.604 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:40.604 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:40.523953+0000", 2024-09-13T06:41:40.604 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.809e-06 2024-09-13T06:41:40.604 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.604 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.604 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:40.604 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:40.523961+0000", 2024-09-13T06:41:40.604 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.653e-06 2024-09-13T06:41:40.604 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.604 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.604 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:40.604 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:40.523968+0000", 2024-09-13T06:41:40.604 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.4960000000000001e-06 2024-09-13T06:41:40.604 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:40.604 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:40.605 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:40.605 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.605 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.605 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:101830 3.0 3.79b7a0c0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e142)", 2024-09-13T06:41:40.605 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:41:40.524179+0000", 2024-09-13T06:41:40.605 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 4294967295.9993777, 2024-09-13T06:41:40.605 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00072756000000000003, 2024-09-13T06:41:40.605 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:40.605 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-13T06:41:40.605 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:40.605 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:40.605 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:40.606 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 101830 2024-09-13T06:41:40.606 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.606 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:40.606 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.606 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:40.606 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:40.524179+0000", 2024-09-13T06:41:40.606 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:40.606 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.606 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.606 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:40.606 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:40.524179+0000", 2024-09-13T06:41:40.606 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:40.606 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.606 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.607 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:40.607 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:40.524178+0000", 2024-09-13T06:41:40.607 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.999999 2024-09-13T06:41:40.607 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.607 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.607 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:40.607 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:40.524183+0000", 2024-09-13T06:41:40.607 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.8080000000000004e-06 2024-09-13T06:41:40.607 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.607 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.607 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:40.607 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:40.524199+0000", 2024-09-13T06:41:40.607 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6257999999999999e-05 2024-09-13T06:41:40.607 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.607 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.608 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:40.608 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:40.524207+0000", 2024-09-13T06:41:40.608 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.1650000000000006e-06 2024-09-13T06:41:40.608 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:40.608 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:40.608 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:40.608 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.608 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.608 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:101831 3.0 3.79b7a0c0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e142)", 2024-09-13T06:41:40.608 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:41:40.524213+0000", 2024-09-13T06:41:40.608 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 4294967295.9993429, 2024-09-13T06:41:40.608 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00072274399999999999, 2024-09-13T06:41:40.608 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:40.608 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-13T06:41:40.609 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:40.609 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:40.609 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:40.609 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 101831 2024-09-13T06:41:40.609 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.609 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:40.609 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.609 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:40.609 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:40.524213+0000", 2024-09-13T06:41:40.609 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:40.609 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.609 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.609 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:40.610 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:40.524213+0000", 2024-09-13T06:41:40.610 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:40.610 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.610 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.610 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:40.610 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:40.524213+0000", 2024-09-13T06:41:40.610 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:40.610 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.610 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.610 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:40.610 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:40.524216+0000", 2024-09-13T06:41:40.610 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.1030000000000002e-06 2024-09-13T06:41:40.610 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.610 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.611 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:40.611 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:40.524223+0000", 2024-09-13T06:41:40.611 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.1829999999999997e-06 2024-09-13T06:41:40.611 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.611 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.611 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:40.611 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:40.524228+0000", 2024-09-13T06:41:40.611 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7469999999999996e-06 2024-09-13T06:41:40.611 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:40.611 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:40.611 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:40.611 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.611 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.611 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:101832 3.0 3.79b7a0c0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e142)", 2024-09-13T06:41:40.611 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:41:40.524231+0000", 2024-09-13T06:41:40.612 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 4294967295.9993258, 2024-09-13T06:41:40.612 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00075198599999999995, 2024-09-13T06:41:40.612 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:40.612 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-13T06:41:40.612 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:40.612 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:40.612 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:40.612 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 101832 2024-09-13T06:41:40.612 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.612 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:40.612 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.612 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:40.612 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:40.524231+0000", 2024-09-13T06:41:40.612 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:40.613 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.613 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.613 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:40.613 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:40.524231+0000", 2024-09-13T06:41:40.613 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:40.613 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.613 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.613 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:40.613 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:40.524230+0000", 2024-09-13T06:41:40.613 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:40.613 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.613 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.613 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:40.613 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:40.524232+0000", 2024-09-13T06:41:40.614 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.773e-06 2024-09-13T06:41:40.614 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.614 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.614 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:40.614 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:40.524243+0000", 2024-09-13T06:41:40.614 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.082e-05 2024-09-13T06:41:40.614 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.614 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.614 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:40.614 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:40.524248+0000", 2024-09-13T06:41:40.614 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0119999999999996e-06 2024-09-13T06:41:40.614 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:40.614 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:40.614 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:40.614 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.615 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.615 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:101833 3.0 3.79b7a0c0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e142)", 2024-09-13T06:41:40.615 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:41:40.524271+0000", 2024-09-13T06:41:40.615 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 4294967295.9992852, 2024-09-13T06:41:40.615 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00075897099999999999, 2024-09-13T06:41:40.615 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:40.615 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-13T06:41:40.615 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:40.615 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:40.615 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:40.615 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 101833 2024-09-13T06:41:40.615 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.615 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:40.616 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.616 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:40.616 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:40.524271+0000", 2024-09-13T06:41:40.616 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:40.616 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.616 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.616 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:40.616 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:40.524271+0000", 2024-09-13T06:41:40.616 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:40.616 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.616 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.616 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:40.616 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:40.524271+0000", 2024-09-13T06:41:40.617 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:40.617 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.617 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.617 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:40.617 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:40.524274+0000", 2024-09-13T06:41:40.617 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.1499999999999999e-06 2024-09-13T06:41:40.617 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.617 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.617 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:40.617 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:40.524281+0000", 2024-09-13T06:41:40.617 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.1319999999999996e-06 2024-09-13T06:41:40.617 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.617 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.617 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:40.618 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:40.524286+0000", 2024-09-13T06:41:40.618 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3229999999999997e-06 2024-09-13T06:41:40.618 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:40.618 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:40.618 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:40.618 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.618 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.618 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:101834 3.0 3.79b7a0c0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e142)", 2024-09-13T06:41:40.618 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:41:40.524291+0000", 2024-09-13T06:41:40.618 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 4294967295.9992652, 2024-09-13T06:41:40.618 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00079201100000000002, 2024-09-13T06:41:40.618 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:40.618 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-13T06:41:40.619 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:40.619 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:40.619 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:40.619 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 101834 2024-09-13T06:41:40.619 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.619 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:40.619 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.619 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:40.619 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:40.524291+0000", 2024-09-13T06:41:40.619 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:40.619 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.619 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.619 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:40.619 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:40.524291+0000", 2024-09-13T06:41:40.620 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:40.620 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.620 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.620 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:40.620 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:40.524291+0000", 2024-09-13T06:41:40.620 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:40.620 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.620 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.620 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:40.620 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:40.524293+0000", 2024-09-13T06:41:40.620 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.548e-06 2024-09-13T06:41:40.620 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.620 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.620 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:40.621 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:40.524299+0000", 2024-09-13T06:41:40.621 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.891e-06 2024-09-13T06:41:40.621 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.621 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.621 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:40.621 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:40.524308+0000", 2024-09-13T06:41:40.621 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.6799999999999999e-06 2024-09-13T06:41:40.621 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:40.621 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:40.621 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:40.621 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.621 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.621 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:101729 3.6 3:61eec9ae:::rbd_data.1121de81beae.0000000000000007:4c [read 110592~4096 [fadvise_nocache] out=4096b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e142)", 2024-09-13T06:41:40.621 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:41:40.522694+0000", 2024-09-13T06:41:40.622 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.00086232300000000002, 2024-09-13T06:41:40.622 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0024510740000000001, 2024-09-13T06:41:40.622 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:40.622 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:40.622 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:40.622 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:40.622 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:40.622 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 101729 2024-09-13T06:41:40.622 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.622 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:40.622 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.622 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:40.622 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:40.522694+0000", 2024-09-13T06:41:40.622 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:40.623 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.623 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.623 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:40.623 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:40.522694+0000", 2024-09-13T06:41:40.623 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:40.623 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.623 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.623 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:40.623 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:40.522693+0000", 2024-09-13T06:41:40.623 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.999999 2024-09-13T06:41:40.623 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.623 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.623 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:40.623 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:40.522699+0000", 2024-09-13T06:41:40.624 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.4110000000000004e-06 2024-09-13T06:41:40.624 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.624 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.624 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:40.624 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:40.522711+0000", 2024-09-13T06:41:40.624 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2193e-05 2024-09-13T06:41:40.624 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.624 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.624 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:40.624 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:40.522719+0000", 2024-09-13T06:41:40.624 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.8189999999999992e-06 2024-09-13T06:41:40.624 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.624 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.624 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:40.625 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:40.523995+0000", 2024-09-13T06:41:40.625 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.001276236 2024-09-13T06:41:40.625 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.625 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.625 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:40.625 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:40.524077+0000", 2024-09-13T06:41:40.625 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.195e-05 2024-09-13T06:41:40.625 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:40.625 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:40.625 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:40.625 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.625 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.625 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:101835 3.4 3.cc239f24 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e142)", 2024-09-13T06:41:40.626 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:41:40.524313+0000", 2024-09-13T06:41:40.626 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 4294967295.9992437, 2024-09-13T06:41:40.626 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00089487099999999999, 2024-09-13T06:41:40.626 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:40.626 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-13T06:41:40.626 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:40.626 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:40.626 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:40.626 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 101835 2024-09-13T06:41:40.626 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.626 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:40.626 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.626 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:40.626 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:40.524313+0000", 2024-09-13T06:41:40.626 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:40.627 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.627 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.627 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:40.627 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:40.524313+0000", 2024-09-13T06:41:40.627 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:40.627 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.627 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.627 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:40.627 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:40.524312+0000", 2024-09-13T06:41:40.627 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:40.627 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.627 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.627 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:40.628 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:40.524315+0000", 2024-09-13T06:41:40.628 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9119999999999998e-06 2024-09-13T06:41:40.628 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.628 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.628 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:40.628 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:40.524321+0000", 2024-09-13T06:41:40.628 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0070000000000003e-06 2024-09-13T06:41:40.628 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.628 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.628 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:40.628 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:40.524324+0000", 2024-09-13T06:41:40.628 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.807e-06 2024-09-13T06:41:40.629 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:40.629 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:40.629 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:40.629 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.629 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.629 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:101730 3.6 3.75937786 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e142)", 2024-09-13T06:41:40.629 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:41:40.522738+0000", 2024-09-13T06:41:40.629 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.00081802600000000002, 2024-09-13T06:41:40.629 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0025194290000000001, 2024-09-13T06:41:40.629 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:40.629 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-13T06:41:40.629 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:40.629 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:40.629 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:40.630 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 101730 2024-09-13T06:41:40.630 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.630 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:40.630 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.630 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:40.630 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:40.522738+0000", 2024-09-13T06:41:40.630 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:40.630 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.630 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.630 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:40.630 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:40.522738+0000", 2024-09-13T06:41:40.630 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:40.630 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.631 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.631 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:40.631 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:40.522738+0000", 2024-09-13T06:41:40.631 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:40.631 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.631 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.631 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:40.631 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:40.522741+0000", 2024-09-13T06:41:40.631 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.3960000000000002e-06 2024-09-13T06:41:40.631 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.631 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.631 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:40.631 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:40.522749+0000", 2024-09-13T06:41:40.631 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.6709999999999999e-06 2024-09-13T06:41:40.632 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.632 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.632 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:40.632 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:40.522755+0000", 2024-09-13T06:41:40.632 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9819999999999996e-06 2024-09-13T06:41:40.632 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:40.632 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:40.632 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:40.632 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.632 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.632 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:101836 3.4 3.cc239f24 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e142)", 2024-09-13T06:41:40.632 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:41:40.524327+0000", 2024-09-13T06:41:40.632 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 4294967295.9992294, 2024-09-13T06:41:40.633 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00097161899999999995, 2024-09-13T06:41:40.633 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:40.633 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-13T06:41:40.633 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:40.633 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:40.633 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:40.633 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 101836 2024-09-13T06:41:40.633 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.633 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:40.633 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.633 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:40.633 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:40.524327+0000", 2024-09-13T06:41:40.633 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:40.633 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.634 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.634 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:40.634 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:40.524327+0000", 2024-09-13T06:41:40.634 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:40.634 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.634 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.634 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:40.634 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:40.524327+0000", 2024-09-13T06:41:40.634 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:40.634 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.634 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.634 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:40.634 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:40.524329+0000", 2024-09-13T06:41:40.634 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2479999999999999e-06 2024-09-13T06:41:40.635 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.635 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.635 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:40.635 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:40.524334+0000", 2024-09-13T06:41:40.635 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3669999999999996e-06 2024-09-13T06:41:40.635 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.635 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.635 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:40.635 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:40.524339+0000", 2024-09-13T06:41:40.635 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.3769999999999998e-06 2024-09-13T06:41:40.635 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:40.635 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:40.635 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:40.636 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.636 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.636 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:101731 3.6 3.75937786 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e142)", 2024-09-13T06:41:40.636 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:41:40.522760+0000", 2024-09-13T06:41:40.636 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.00079667599999999996, 2024-09-13T06:41:40.636 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0025831780000000002, 2024-09-13T06:41:40.636 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:40.636 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-13T06:41:40.636 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:40.636 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:40.636 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:40.636 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 101731 2024-09-13T06:41:40.636 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.637 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:40.637 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.637 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:40.637 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:40.522760+0000", 2024-09-13T06:41:40.637 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:40.637 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.637 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.637 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:40.637 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:40.522760+0000", 2024-09-13T06:41:40.637 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:40.637 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.637 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.637 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:40.637 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:40.522759+0000", 2024-09-13T06:41:40.638 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:40.638 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.638 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.638 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:40.638 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:40.522762+0000", 2024-09-13T06:41:40.638 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.711e-06 2024-09-13T06:41:40.638 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.638 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.638 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:40.638 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:40.522768+0000", 2024-09-13T06:41:40.638 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.1659999999999999e-06 2024-09-13T06:41:40.638 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.638 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.638 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:40.639 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:40.522773+0000", 2024-09-13T06:41:40.639 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9320000000000004e-06 2024-09-13T06:41:40.639 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:40.639 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:40.639 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:40.639 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.639 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.639 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:101837 3.4 3.cc239f24 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e142)", 2024-09-13T06:41:40.639 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:41:40.524343+0000", 2024-09-13T06:41:40.639 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 4294967295.9992137, 2024-09-13T06:41:40.639 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.001058884, 2024-09-13T06:41:40.639 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:40.639 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "queued for pg", 2024-09-13T06:41:40.639 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:40.640 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:40.640 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:40.640 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 101837 2024-09-13T06:41:40.640 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.640 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:40.640 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.640 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:40.640 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:40.524343+0000", 2024-09-13T06:41:40.640 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:40.640 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.640 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.640 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:40.640 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:40.524343+0000", 2024-09-13T06:41:40.640 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:40.641 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.641 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.641 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:40.641 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:40.524342+0000", 2024-09-13T06:41:40.641 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:40.641 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.641 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.641 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:40.641 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:40.524349+0000", 2024-09-13T06:41:40.642 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.0389999999999999e-06 2024-09-13T06:41:40.642 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.642 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.642 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:40.642 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:40.524356+0000", 2024-09-13T06:41:40.642 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0889999999999996e-06 2024-09-13T06:41:40.642 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:40.642 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:40.642 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:40.642 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:40.524360+0000", 2024-09-13T06:41:40.642 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.8590000000000004e-06 2024-09-13T06:41:40.642 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:40.642 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:40.643 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:40.643 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:40.643 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-13T06:41:40.643 INFO:teuthology.orchestra.run.smithi081.stdout: "num_ops": 34 2024-09-13T06:41:40.643 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:41:40.643 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 4, 6, 7, 5, 3] out_osds: [] dead_osds: [7] live_osds: [0, 1, 2, 3, 4, 5, 6] 2024-09-13T06:41:40.643 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-13T06:41:40.643 INFO:tasks.thrashosds.thrasher:inject_pause on osd.6 2024-09-13T06:41:40.643 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-09-13T06:41:40.644 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-09-13T06:41:40.644 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok config set filestore_inject_stall 3 2024-09-13T06:41:40.646 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-13T06:41:40.646 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:41:40.641+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:41:40.747 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:41:40.745+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:41:40.796 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:41:40.796 INFO:teuthology.orchestra.run.smithi139.stdout: "success": "" 2024-09-13T06:41:40.796 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:41:40.851 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:41:40.845+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:41:40.883 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:41:40.884 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-13T06:41:40.884 INFO:teuthology.orchestra.run.smithi081.stdout: "complaint_time": 30, 2024-09-13T06:41:40.884 INFO:teuthology.orchestra.run.smithi081.stdout: "num_blocked_ops": 0 2024-09-13T06:41:40.884 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:41:40.902 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-13T06:41:40.948 INFO:tasks.ceph.osd.6.smithi139.stderr:2024-09-13T06:41:40.942+0000 7fcd02c5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26385) UID: 0 2024-09-13T06:41:41.049 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:41:41.045+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:41:41.125 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:41:41.125 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 20, 2024-09-13T06:41:41.125 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 600, 2024-09-13T06:41:41.125 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [ 2024-09-13T06:41:41.125 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:41.125 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:21979 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 14217216~4096 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:41:41.125 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.888811+0000", 2024-09-13T06:41:41.126 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 108.235928094, 2024-09-13T06:41:41.126 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049092969, 2024-09-13T06:41:41.126 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:41.126 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:41.126 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:41.126 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:41.126 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:41.126 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 21979 2024-09-13T06:41:41.126 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:41.126 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:41.126 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:41.126 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:41.126 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888811+0000", 2024-09-13T06:41:41.127 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:41.127 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:41.127 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:41.127 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:41.127 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888811+0000", 2024-09-13T06:41:41.127 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:41.127 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:41.127 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:41.127 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:41.127 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888811+0000", 2024-09-13T06:41:41.127 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:41:41.127 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:41.127 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:41.128 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:41.128 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888812+0000", 2024-09-13T06:41:41.128 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.204e-06 2024-09-13T06:41:41.128 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:41.128 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:41.128 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:41.128 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888815+0000", 2024-09-13T06:41:41.128 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9359999999999999e-06 2024-09-13T06:41:41.128 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:41.128 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:41.128 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:41.128 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888818+0000", 2024-09-13T06:41:41.129 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.7369999999999998e-06 2024-09-13T06:41:41.129 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:41.129 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:41.129 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:41.129 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.937663+0000", 2024-09-13T06:41:41.129 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.048844540999999998 2024-09-13T06:41:41.129 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:41.129 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:41.129 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:41.129 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.937709+0000", 2024-09-13T06:41:41.129 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6492999999999997e-05 2024-09-13T06:41:41.129 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:41.130 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:41.130 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:41.130 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.937904+0000", 2024-09-13T06:41:41.130 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00019526499999999999 2024-09-13T06:41:41.130 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:41.130 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:41.130 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:41.130 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:41.130 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:41.130 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:21980 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 14245888~4096 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:41:41.130 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.888820+0000", 2024-09-13T06:41:41.130 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 108.23591941700001, 2024-09-13T06:41:41.130 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049357080999999997, 2024-09-13T06:41:41.130 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:41.131 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:41.131 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:41.131 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:41.131 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:41.131 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 21980 2024-09-13T06:41:41.131 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:41.131 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:41.131 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:41.131 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:41.131 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888820+0000", 2024-09-13T06:41:41.131 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:41.131 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:41.131 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:41.131 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:41.131 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888820+0000", 2024-09-13T06:41:41.132 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:41.132 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:41.132 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:41.132 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:41.132 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888820+0000", 2024-09-13T06:41:41.132 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:41:41.132 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:41.132 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:41.132 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:41.132 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888821+0000", 2024-09-13T06:41:41.132 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.122e-06 2024-09-13T06:41:41.132 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:41.132 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:41.133 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:41.133 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888824+0000", 2024-09-13T06:41:41.133 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.0580000000000002e-06 2024-09-13T06:41:41.133 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:41.133 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:41.133 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:41.133 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888827+0000", 2024-09-13T06:41:41.133 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.666e-06 2024-09-13T06:41:41.133 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:41.133 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:41.133 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:41.133 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.937935+0000", 2024-09-13T06:41:41.133 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049108329999999999 2024-09-13T06:41:41.134 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:41.134 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:41.134 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:41.134 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.937985+0000", 2024-09-13T06:41:41.134 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9694000000000002e-05 2024-09-13T06:41:41.134 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:41.134 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:41.134 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:41.134 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.938177+0000", 2024-09-13T06:41:41.134 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00019241899999999999 2024-09-13T06:41:41.134 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:41.134 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:41.134 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:41.134 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:41.135 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:41.135 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:21984 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:snapdir [list-snaps] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:41:41.135 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.888829+0000", 2024-09-13T06:41:41.135 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 108.235910639, 2024-09-13T06:41:41.135 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049524545000000003, 2024-09-13T06:41:41.135 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:41.135 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:41.135 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:41.135 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:41.135 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:41.135 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 21984 2024-09-13T06:41:41.135 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:41.135 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:41.136 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:41.136 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:41.136 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888829+0000", 2024-09-13T06:41:41.136 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:41.136 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:41.136 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:41.136 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:41.136 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888829+0000", 2024-09-13T06:41:41.136 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:41.136 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:41.136 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:41.136 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:41.136 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888829+0000", 2024-09-13T06:41:41.137 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:41:41.137 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:41.137 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:41.137 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:41.137 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888830+0000", 2024-09-13T06:41:41.137 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2529999999999999e-06 2024-09-13T06:41:41.137 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:41.137 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:41.137 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:41.137 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888835+0000", 2024-09-13T06:41:41.137 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.4729999999999999e-06 2024-09-13T06:41:41.137 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:41.137 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:41.138 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:41.138 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888840+0000", 2024-09-13T06:41:41.138 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0159999999999999e-06 2024-09-13T06:41:41.138 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:41.138 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:41.138 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:41.138 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.938199+0000", 2024-09-13T06:41:41.138 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049358974999999999 2024-09-13T06:41:41.138 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:41.138 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:41.138 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:41.138 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.938268+0000", 2024-09-13T06:41:41.138 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.8876999999999998e-05 2024-09-13T06:41:41.138 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:41.138 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:41.139 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:41.139 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.938353+0000", 2024-09-13T06:41:41.139 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.5155999999999996e-05 2024-09-13T06:41:41.139 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:41.139 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:41.139 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:41.139 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:41.139 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:41.139 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:21985 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 12587008~4096 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:41:41.139 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.888858+0000", 2024-09-13T06:41:41.139 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 108.23588148899999, 2024-09-13T06:41:41.139 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049674347000000001, 2024-09-13T06:41:41.139 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:41.139 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:41.140 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:41.140 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:41.140 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:41.140 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 21985 2024-09-13T06:41:41.140 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:41.140 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:41.140 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:41.140 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:41.140 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888858+0000", 2024-09-13T06:41:41.140 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:41.140 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:41.140 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:41.140 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:41.140 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888858+0000", 2024-09-13T06:41:41.140 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:41.141 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:41.141 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:41.141 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:41.141 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888857+0000", 2024-09-13T06:41:41.141 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:41.141 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:41.141 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:41.141 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:41.141 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888860+0000", 2024-09-13T06:41:41.141 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4739999999999999e-06 2024-09-13T06:41:41.141 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:41.141 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:41.141 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:41.142 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888867+0000", 2024-09-13T06:41:41.142 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.7170000000000002e-06 2024-09-13T06:41:41.142 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:41.142 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:41.142 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:41.142 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888871+0000", 2024-09-13T06:41:41.142 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5120000000000002e-06 2024-09-13T06:41:41.142 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:41.142 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:41.142 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:41.142 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.938389+0000", 2024-09-13T06:41:41.142 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049517717000000003 2024-09-13T06:41:41.142 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:41.143 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:41.143 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:41.143 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.938449+0000", 2024-09-13T06:41:41.143 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0513999999999997e-05 2024-09-13T06:41:41.143 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:41.143 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:41.143 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:41.143 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.938532+0000", 2024-09-13T06:41:41.143 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.2936999999999996e-05 2024-09-13T06:41:41.143 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:41.143 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:41.143 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:41.143 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:41.144 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:41.144 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:21986 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 12615680~4096 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:41:41.144 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.888875+0000", 2024-09-13T06:41:41.144 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 108.235863976, 2024-09-13T06:41:41.144 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049881781, 2024-09-13T06:41:41.144 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:41.144 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:41.144 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:41.144 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:41.144 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:41.144 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 21986 2024-09-13T06:41:41.144 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:41.144 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:41.144 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:41.145 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:41.145 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888875+0000", 2024-09-13T06:41:41.145 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:41.145 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:41.145 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:41.145 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:41.145 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888875+0000", 2024-09-13T06:41:41.145 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:41.145 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:41.145 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:41.145 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:41.145 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888875+0000", 2024-09-13T06:41:41.145 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:41.146 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:41.146 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:41.146 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:41.146 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888880+0000", 2024-09-13T06:41:41.146 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7600000000000002e-06 2024-09-13T06:41:41.146 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:41.146 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:41.146 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:41.146 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888887+0000", 2024-09-13T06:41:41.146 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3950000000000003e-06 2024-09-13T06:41:41.146 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:41.146 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:41.147 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:41.147 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888892+0000", 2024-09-13T06:41:41.147 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0409999999999997e-06 2024-09-13T06:41:41.147 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:41.147 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:41.147 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:41.147 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.938568+0000", 2024-09-13T06:41:41.147 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049675267000000002 2024-09-13T06:41:41.147 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:41.147 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:41.147 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:41.147 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.938653+0000", 2024-09-13T06:41:41.147 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.5792999999999997e-05 2024-09-13T06:41:41.147 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:41.147 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:41.148 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:41.148 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.938757+0000", 2024-09-13T06:41:41.148 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00010387699999999999 2024-09-13T06:41:41.148 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:41.148 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:41.148 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:41.148 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:41.148 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:41.148 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:21987 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 12644352~4096 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:41:41.148 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.888899+0000", 2024-09-13T06:41:41.148 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 108.23584063, 2024-09-13T06:41:41.148 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.050094056999999997, 2024-09-13T06:41:41.149 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:41.149 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:41.149 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:41.149 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:41.149 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:41.149 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 21987 2024-09-13T06:41:41.149 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:41.149 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:41.149 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:41.149 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:41.149 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888899+0000", 2024-09-13T06:41:41.149 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:41.149 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:41.150 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:41.150 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:41.150 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888899+0000", 2024-09-13T06:41:41.150 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:41.150 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:41.150 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:41.150 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:41.150 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888899+0000", 2024-09-13T06:41:41.150 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:41.150 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:41.150 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:41.150 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:41.150 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888901+0000", 2024-09-13T06:41:41.150 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2539999999999999e-06 2024-09-13T06:41:41.151 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:41.151 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:41.151 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:41.151 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888907+0000", 2024-09-13T06:41:41.151 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9009999999999999e-06 2024-09-13T06:41:41.151 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:41.151 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:41.151 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:41.151 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888912+0000", 2024-09-13T06:41:41.151 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9840000000000001e-06 2024-09-13T06:41:41.151 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:41.151 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:41.151 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:41.151 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.938810+0000", 2024-09-13T06:41:41.152 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049898835000000002 2024-09-13T06:41:41.152 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:41.152 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:41.152 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:41.152 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.938890+0000", 2024-09-13T06:41:41.152 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.9215000000000006e-05 2024-09-13T06:41:41.152 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:41.152 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:41.152 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:41.152 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.938993+0000", 2024-09-13T06:41:41.152 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000103194 2024-09-13T06:41:41.152 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:41.152 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:41.153 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:41.153 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:41.153 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:41.153 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:21988 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 12673024~4096 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:41:41.153 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.888916+0000", 2024-09-13T06:41:41.153 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 108.235823614, 2024-09-13T06:41:41.153 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.050203036999999999, 2024-09-13T06:41:41.153 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:41.153 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:41.153 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:41.153 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:41.153 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:41.153 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 21988 2024-09-13T06:41:41.153 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:41.154 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:41.154 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:41.154 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:41.154 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888916+0000", 2024-09-13T06:41:41.154 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:41.154 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:41.154 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:41.154 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:41.154 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888916+0000", 2024-09-13T06:41:41.154 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:41.154 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:41.154 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:41.154 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:41.155 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888915+0000", 2024-09-13T06:41:41.155 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:41.155 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:41.155 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:41.155 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:41.155 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888918+0000", 2024-09-13T06:41:41.155 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1500000000000002e-06 2024-09-13T06:41:41.155 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:41.155 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:41.155 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:41.155 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888925+0000", 2024-09-13T06:41:41.155 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.9380000000000003e-06 2024-09-13T06:41:41.155 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:41.155 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:41.155 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:41.156 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888933+0000", 2024-09-13T06:41:41.156 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.0560000000000005e-06 2024-09-13T06:41:41.156 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:41.156 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:41.156 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:41.156 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.939026+0000", 2024-09-13T06:41:41.156 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.050093499999999999 2024-09-13T06:41:41.156 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:41.156 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:41.156 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:41.156 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.939068+0000", 2024-09-13T06:41:41.156 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.1705999999999997e-05 2024-09-13T06:41:41.156 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:41.156 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:41.157 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:41.157 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.939119+0000", 2024-09-13T06:41:41.157 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.1048999999999999e-05 2024-09-13T06:41:41.157 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:41.157 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:41.157 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:41.160 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:41.160 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:41.160 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:21989 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 12701696~4096 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:41:41.160 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.888938+0000", 2024-09-13T06:41:41.161 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 108.235801287, 2024-09-13T06:41:41.161 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.050294393999999999, 2024-09-13T06:41:41.161 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:41.161 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:41.161 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:41.161 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:41.161 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:41.161 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 21989 2024-09-13T06:41:41.161 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:41.161 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:41.161 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:41.161 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:41.161 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888938+0000", 2024-09-13T06:41:41.162 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:41.162 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:41.162 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:41.162 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:41.162 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888938+0000", 2024-09-13T06:41:41.162 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:41.162 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:41.162 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:41.162 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:41.162 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888938+0000", 2024-09-13T06:41:41.162 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:41.162 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:41.162 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:41.162 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:41.163 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888940+0000", 2024-09-13T06:41:41.163 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5330000000000001e-06 2024-09-13T06:41:41.163 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:41.163 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:41.163 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:41.163 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888947+0000", 2024-09-13T06:41:41.163 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.2389999999999999e-06 2024-09-13T06:41:41.163 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:41.163 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:41.163 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:41.163 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888952+0000", 2024-09-13T06:41:41.163 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.5720000000000002e-06 2024-09-13T06:41:41.163 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:41.164 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:41.164 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:41.164 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.939141+0000", 2024-09-13T06:41:41.164 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.050188903999999999 2024-09-13T06:41:41.164 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:41.164 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:41.164 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:41.164 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.939182+0000", 2024-09-13T06:41:41.164 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.0926000000000001e-05 2024-09-13T06:41:41.164 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:41.164 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:41.164 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:41.164 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.939233+0000", 2024-09-13T06:41:41.165 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0532999999999999e-05 2024-09-13T06:41:41.165 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:41.165 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:41.165 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:41.165 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:41.165 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:41.165 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:22007 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 13217792~4096 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:41:41.165 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.892771+0000", 2024-09-13T06:41:41.165 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 108.231968181, 2024-09-13T06:41:41.165 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049090024000000003, 2024-09-13T06:41:41.165 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:41.165 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:41.165 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:41.166 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:41.166 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:41.166 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 22007 2024-09-13T06:41:41.166 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:41.166 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:41.166 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:41.166 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:41.166 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892771+0000", 2024-09-13T06:41:41.166 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:41.166 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:41.166 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:41.166 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:41.166 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892771+0000", 2024-09-13T06:41:41.167 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:41.167 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:41.167 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:41.167 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:41.167 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892771+0000", 2024-09-13T06:41:41.167 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:41:41.167 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:41.167 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:41.167 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:41.167 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892772+0000", 2024-09-13T06:41:41.167 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.184e-06 2024-09-13T06:41:41.167 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:41.167 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:41.167 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:41.168 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892775+0000", 2024-09-13T06:41:41.168 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9179999999999998e-06 2024-09-13T06:41:41.168 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:41.168 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:41.168 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:41.168 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892778+0000", 2024-09-13T06:41:41.168 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4990000000000001e-06 2024-09-13T06:41:41.168 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:41.168 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:41.168 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:41.168 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.941760+0000", 2024-09-13T06:41:41.168 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.048982070000000003 2024-09-13T06:41:41.168 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:41.168 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:41.169 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:41.169 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.941808+0000", 2024-09-13T06:41:41.169 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.8278000000000001e-05 2024-09-13T06:41:41.169 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:41.169 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:41.169 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:41.169 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.941861+0000", 2024-09-13T06:41:41.169 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3284e-05 2024-09-13T06:41:41.169 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:41.169 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:41.169 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:41.169 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:41.169 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:41.170 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:22008 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 13246464~4096 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:41:41.170 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.892780+0000", 2024-09-13T06:41:41.170 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 108.231959524, 2024-09-13T06:41:41.170 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049200477999999999, 2024-09-13T06:41:41.170 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:41.170 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:41.170 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:41.170 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:41.170 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:41.170 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 22008 2024-09-13T06:41:41.170 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:41.170 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:41.170 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:41.170 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:41.170 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892780+0000", 2024-09-13T06:41:41.171 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:41.171 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:41.171 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:41.171 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:41.171 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892780+0000", 2024-09-13T06:41:41.171 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:41.171 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:41.171 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:41.171 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:41.171 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892780+0000", 2024-09-13T06:41:41.171 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:41:41.171 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:41.171 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:41.172 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:41.172 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892781+0000", 2024-09-13T06:41:41.172 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.083e-06 2024-09-13T06:41:41.172 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:41.172 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:41.172 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:41.172 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892784+0000", 2024-09-13T06:41:41.172 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.926e-06 2024-09-13T06:41:41.172 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:41.172 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:41.172 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:41.172 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892786+0000", 2024-09-13T06:41:41.172 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4490000000000002e-06 2024-09-13T06:41:41.172 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:41.173 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:41.173 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:41.173 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.941888+0000", 2024-09-13T06:41:41.173 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049102290999999999 2024-09-13T06:41:41.173 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:41.173 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:41.173 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:41.173 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.941929+0000", 2024-09-13T06:41:41.173 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.0541999999999999e-05 2024-09-13T06:41:41.173 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:41.173 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:41.173 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:41.173 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.941980+0000", 2024-09-13T06:41:41.174 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.1391999999999999e-05 2024-09-13T06:41:41.174 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:41.174 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:41.174 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:41.174 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:41.174 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:41.174 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:22009 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 13275136~4096 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:41:41.174 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.892788+0000", 2024-09-13T06:41:41.174 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 108.23195104, 2024-09-13T06:41:41.174 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049311926999999998, 2024-09-13T06:41:41.174 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:41.174 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:41.174 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:41.174 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:41.175 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:41.175 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 22009 2024-09-13T06:41:41.175 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:41.175 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:41.175 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:41.175 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:41.175 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892788+0000", 2024-09-13T06:41:41.175 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:41.175 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:41.175 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:41.175 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:41.175 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892788+0000", 2024-09-13T06:41:41.175 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:41.175 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:41.176 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:41.176 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:41.176 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892788+0000", 2024-09-13T06:41:41.176 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:41:41.176 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:41.176 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:41.176 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:41.176 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892789+0000", 2024-09-13T06:41:41.176 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1850000000000001e-06 2024-09-13T06:41:41.176 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:41.176 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:41.176 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:41.176 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892793+0000", 2024-09-13T06:41:41.177 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.9099999999999998e-06 2024-09-13T06:41:41.177 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:41.177 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:41.177 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:41.177 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892798+0000", 2024-09-13T06:41:41.177 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5070000000000002e-06 2024-09-13T06:41:41.177 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:41.177 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:41.177 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:41.177 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.942007+0000", 2024-09-13T06:41:41.177 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049208904999999997 2024-09-13T06:41:41.177 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:41.177 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:41.178 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:41.178 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.942049+0000", 2024-09-13T06:41:41.178 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.1922000000000003e-05 2024-09-13T06:41:41.178 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:41.178 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:41.178 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:41.178 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.942100+0000", 2024-09-13T06:41:41.178 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.1736000000000001e-05 2024-09-13T06:41:41.178 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:41.178 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:41.178 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:41.178 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:41.178 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:41.178 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:22010 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 13303808~4096 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:41:41.179 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.892817+0000", 2024-09-13T06:41:41.179 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 108.231922844, 2024-09-13T06:41:41.179 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049466149000000001, 2024-09-13T06:41:41.179 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:41.179 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:41.179 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:41.179 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:41.179 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:41.179 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 22010 2024-09-13T06:41:41.179 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:41.179 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:41.179 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:41.179 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:41.180 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892817+0000", 2024-09-13T06:41:41.180 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:41.180 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:41.180 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:41.180 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:41.180 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892817+0000", 2024-09-13T06:41:41.180 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:41.180 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:41.180 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:41.180 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:41.180 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892816+0000", 2024-09-13T06:41:41.180 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:41.180 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:41.181 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:41.181 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:41.181 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892821+0000", 2024-09-13T06:41:41.181 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9459999999999997e-06 2024-09-13T06:41:41.181 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:41.181 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:41.181 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:41.181 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892828+0000", 2024-09-13T06:41:41.181 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.6780000000000003e-06 2024-09-13T06:41:41.181 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:41.181 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:41.181 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:41.181 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892833+0000", 2024-09-13T06:41:41.182 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.8389999999999997e-06 2024-09-13T06:41:41.182 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:41.182 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:41.182 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:41.182 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.942127+0000", 2024-09-13T06:41:41.182 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049294163000000002 2024-09-13T06:41:41.182 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:41.182 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:41.182 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:41.182 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.942186+0000", 2024-09-13T06:41:41.182 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9335e-05 2024-09-13T06:41:41.182 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:41.182 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:41.182 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:41.182 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.942283+0000", 2024-09-13T06:41:41.183 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.6699000000000004e-05 2024-09-13T06:41:41.183 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:41.183 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:41.183 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:41.183 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:41.183 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:41.183 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:22011 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 13332480~4096 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:41:41.183 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.892838+0000", 2024-09-13T06:41:41.183 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 108.231901157, 2024-09-13T06:41:41.183 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049589214, 2024-09-13T06:41:41.183 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:41.183 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:41.183 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:41.184 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:41.184 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:41.184 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 22011 2024-09-13T06:41:41.184 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:41.184 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:41.184 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:41.184 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:41.184 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892838+0000", 2024-09-13T06:41:41.184 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:41.184 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:41.184 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:41.184 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:41.184 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892838+0000", 2024-09-13T06:41:41.185 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:41.185 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:41.185 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:41.185 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:41.185 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892838+0000", 2024-09-13T06:41:41.185 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:41.185 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:41.185 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:41.185 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:41.185 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892840+0000", 2024-09-13T06:41:41.185 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.136e-06 2024-09-13T06:41:41.185 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:41.185 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:41.186 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:41.186 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892852+0000", 2024-09-13T06:41:41.186 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2122e-05 2024-09-13T06:41:41.186 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:41.186 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:41.186 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:41.186 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892862+0000", 2024-09-13T06:41:41.186 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.7049999999999994e-06 2024-09-13T06:41:41.186 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:41.186 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:41.186 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:41.186 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.942319+0000", 2024-09-13T06:41:41.186 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049456623999999998 2024-09-13T06:41:41.186 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:41.187 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:41.187 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:41.187 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.942363+0000", 2024-09-13T06:41:41.187 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4759000000000003e-05 2024-09-13T06:41:41.187 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:41.187 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:41.187 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:41.187 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.942428+0000", 2024-09-13T06:41:41.187 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.4221999999999996e-05 2024-09-13T06:41:41.187 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:41.187 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:41.187 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:41.187 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:41.188 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:41.188 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:22033 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 13963264~4096 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:41:41.188 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.896824+0000", 2024-09-13T06:41:41.188 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 108.227915264, 2024-09-13T06:41:41.188 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049051957, 2024-09-13T06:41:41.188 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:41.188 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:41.188 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:41.188 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:41.188 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:41.188 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 22033 2024-09-13T06:41:41.188 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:41.188 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:41.189 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:41.189 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:41.189 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.896824+0000", 2024-09-13T06:41:41.189 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:41.189 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:41.189 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:41.189 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:41.189 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.896824+0000", 2024-09-13T06:41:41.189 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:41.189 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:41.189 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:41.189 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:41.189 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.896824+0000", 2024-09-13T06:41:41.189 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:41.190 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:41.190 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:41.190 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:41.190 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.896826+0000", 2024-09-13T06:41:41.190 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1900000000000002e-06 2024-09-13T06:41:41.190 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:41.190 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:41.190 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:41.190 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.896832+0000", 2024-09-13T06:41:41.190 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.2689999999999996e-06 2024-09-13T06:41:41.190 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:41.190 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:41.190 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:41.190 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.896840+0000", 2024-09-13T06:41:41.191 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3289999999999996e-06 2024-09-13T06:41:41.191 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:41.191 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:41.191 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:41.191 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.945777+0000", 2024-09-13T06:41:41.191 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.048937188 2024-09-13T06:41:41.191 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:41.191 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:41.191 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:41.191 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.945822+0000", 2024-09-13T06:41:41.191 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4780999999999997e-05 2024-09-13T06:41:41.191 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:41.191 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:41.192 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:41.192 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.945876+0000", 2024-09-13T06:41:41.192 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.4542000000000001e-05 2024-09-13T06:41:41.192 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:41.192 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:41.192 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:41.192 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:41.192 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:41.192 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:22338 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 13611008~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:41:41.192 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.951070+0000", 2024-09-13T06:41:41.192 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 108.173669636, 2024-09-13T06:41:41.192 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049135817999999998, 2024-09-13T06:41:41.192 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:41.192 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:41.193 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:41.193 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:41.193 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:41.193 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 22338 2024-09-13T06:41:41.193 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:41.193 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:41.193 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:41.193 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:41.193 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951070+0000", 2024-09-13T06:41:41.193 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:41.193 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:41.193 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:41.193 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:41.194 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951070+0000", 2024-09-13T06:41:41.194 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:41.194 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:41.194 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:41.194 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:41.194 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951069+0000", 2024-09-13T06:41:41.194 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:41.194 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:41.194 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:41.194 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:41.194 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951072+0000", 2024-09-13T06:41:41.194 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5909999999999998e-06 2024-09-13T06:41:41.194 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:41.194 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:41.195 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:41.195 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951078+0000", 2024-09-13T06:41:41.195 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.4450000000000001e-06 2024-09-13T06:41:41.195 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:41.195 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:41.195 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:41.195 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951083+0000", 2024-09-13T06:41:41.195 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7790000000000003e-06 2024-09-13T06:41:41.195 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:41.195 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:41.195 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:41.195 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:53.000020+0000", 2024-09-13T06:41:41.195 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.048936999000000002 2024-09-13T06:41:41.196 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:41.196 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:41.196 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:41.196 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:53.000106+0000", 2024-09-13T06:41:41.196 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.5532999999999996e-05 2024-09-13T06:41:41.196 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:41.196 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:41.196 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:41.196 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:53.000206+0000", 2024-09-13T06:41:41.196 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.9852999999999994e-05 2024-09-13T06:41:41.196 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:41.196 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:41.196 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:41.196 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:41.197 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:41.197 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:22339 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 13639680~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:41:41.197 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.951088+0000", 2024-09-13T06:41:41.197 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 108.17365193800001, 2024-09-13T06:41:41.197 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049238202000000002, 2024-09-13T06:41:41.197 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:41.197 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:41.197 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:41.197 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:41.197 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:41.197 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 22339 2024-09-13T06:41:41.197 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:41.197 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:41.198 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:41.198 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:41.198 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951088+0000", 2024-09-13T06:41:41.198 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:41.198 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:41.198 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:41.198 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:41.198 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951088+0000", 2024-09-13T06:41:41.198 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:41.198 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:41.198 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:41.198 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:41.198 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951087+0000", 2024-09-13T06:41:41.199 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:41.199 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:41.199 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:41.199 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:41.199 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951089+0000", 2024-09-13T06:41:41.199 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.153e-06 2024-09-13T06:41:41.199 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:41.199 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:41.199 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:41.199 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951093+0000", 2024-09-13T06:41:41.199 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.7120000000000002e-06 2024-09-13T06:41:41.199 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:41.199 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:41.199 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:41.200 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951096+0000", 2024-09-13T06:41:41.200 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.0570000000000001e-06 2024-09-13T06:41:41.200 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:41.200 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:41.200 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:41.200 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:53.000220+0000", 2024-09-13T06:41:41.200 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049123989 2024-09-13T06:41:41.200 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:41.200 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:41.200 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:41.200 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:53.000271+0000", 2024-09-13T06:41:41.200 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.062e-05 2024-09-13T06:41:41.201 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:41.201 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:41.201 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:41.201 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:53.000326+0000", 2024-09-13T06:41:41.201 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.5121000000000003e-05 2024-09-13T06:41:41.201 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:41.201 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:41.201 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:41.201 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:41.201 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:41.201 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:22340 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 13668352~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:41:41.201 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.951200+0000", 2024-09-13T06:41:41.201 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 108.173539049, 2024-09-13T06:41:41.202 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049352350000000003, 2024-09-13T06:41:41.202 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:41.202 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:41.202 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:41.202 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:41.202 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:41.202 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 22340 2024-09-13T06:41:41.202 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:41.202 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:41.202 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:41.202 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:41.202 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951200+0000", 2024-09-13T06:41:41.202 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:41.202 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:41.203 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:41.203 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:41.203 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951200+0000", 2024-09-13T06:41:41.203 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:41.203 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:41.203 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:41.203 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:41.203 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951098+0000", 2024-09-13T06:41:41.203 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.999898 2024-09-13T06:41:41.203 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:41.203 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:41.203 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:41.203 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951204+0000", 2024-09-13T06:41:41.204 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000105398 2024-09-13T06:41:41.204 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:41.204 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:41.204 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:41.204 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951211+0000", 2024-09-13T06:41:41.204 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.43e-06 2024-09-13T06:41:41.204 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:41.204 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:41.204 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:41.204 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951216+0000", 2024-09-13T06:41:41.204 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2800000000000003e-06 2024-09-13T06:41:41.204 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:41.205 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:41.205 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:41.205 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:53.000358+0000", 2024-09-13T06:41:41.205 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049142036 2024-09-13T06:41:41.205 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:41.205 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:41.205 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:41.205 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:53.000443+0000", 2024-09-13T06:41:41.205 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.4710999999999996e-05 2024-09-13T06:41:41.205 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:41.205 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:41.205 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:41.205 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:53.000553+0000", 2024-09-13T06:41:41.205 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000109622 2024-09-13T06:41:41.206 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:41.206 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:41.206 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:41.206 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:41.206 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:41.206 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:22348 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 13897728~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:41:41.206 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.952783+0000", 2024-09-13T06:41:41.206 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 108.17195626100001, 2024-09-13T06:41:41.206 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049120832000000003, 2024-09-13T06:41:41.206 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:41.206 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:41.206 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:41.206 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:41.207 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:41.207 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 22348 2024-09-13T06:41:41.207 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:41.207 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:41.207 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:41.207 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:41.207 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.952783+0000", 2024-09-13T06:41:41.207 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:41.207 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:41.207 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:41.207 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:41.207 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.952783+0000", 2024-09-13T06:41:41.207 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:41.208 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:41.208 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:41.208 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:41.208 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.952783+0000", 2024-09-13T06:41:41.208 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:41.208 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:41.208 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:41.208 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:41.208 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.952785+0000", 2024-09-13T06:41:41.208 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4980000000000001e-06 2024-09-13T06:41:41.208 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:41.208 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:41.208 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:41.209 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.952799+0000", 2024-09-13T06:41:41.209 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3825000000000001e-05 2024-09-13T06:41:41.209 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:41.209 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:41.209 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:41.209 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.952809+0000", 2024-09-13T06:41:41.209 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0043e-05 2024-09-13T06:41:41.209 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:41.209 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:41.209 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:41.209 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:53.001723+0000", 2024-09-13T06:41:41.209 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.048914065 2024-09-13T06:41:41.209 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:41.209 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:41.210 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:41.210 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:53.001807+0000", 2024-09-13T06:41:41.210 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.3776000000000006e-05 2024-09-13T06:41:41.210 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:41.210 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:41.210 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:41.210 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:53.001904+0000", 2024-09-13T06:41:41.210 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.7004999999999997e-05 2024-09-13T06:41:41.210 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:41.210 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:41.210 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:41.210 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:41.210 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:41.210 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:69045 3.0 3:05ea3821:::rbd_data.1121867cc19b.0000000000000000:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109)", 2024-09-13T06:41:41.211 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:41:03.637760+0000", 2024-09-13T06:41:41.211 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 37.486979503000001, 2024-09-13T06:41:41.211 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.052276712000000003, 2024-09-13T06:41:41.211 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:41.211 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:41:41.211 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:41.211 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:41.211 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:41.211 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 69045 2024-09-13T06:41:41.211 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:41.211 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:41.211 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:41.211 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:41.211 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:03.637760+0000", 2024-09-13T06:41:41.212 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:41.212 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:41.212 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:41.212 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:41.212 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:03.637760+0000", 2024-09-13T06:41:41.212 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:41.212 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:41.212 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:41.212 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:41.212 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:03.637758+0000", 2024-09-13T06:41:41.212 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999981 2024-09-13T06:41:41.212 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:41.212 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:41.213 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:41.213 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:03.637770+0000", 2024-09-13T06:41:41.213 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1533e-05 2024-09-13T06:41:41.213 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:41.213 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:41.213 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:41.213 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:03.637794+0000", 2024-09-13T06:41:41.213 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4243000000000002e-05 2024-09-13T06:41:41.213 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:41.213 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:41.213 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:41.213 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:03.637806+0000", 2024-09-13T06:41:41.213 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2033e-05 2024-09-13T06:41:41.214 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:41.214 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:41.214 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:41.214 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:03.637891+0000", 2024-09-13T06:41:41.214 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.5358000000000005e-05 2024-09-13T06:41:41.214 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:41.214 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:41.214 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:41.214 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:03.638042+0000", 2024-09-13T06:41:41.214 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000151073 2024-09-13T06:41:41.214 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:41.214 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:41.214 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 2", 2024-09-13T06:41:41.215 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:03.647124+0000", 2024-09-13T06:41:41.215 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0090821670000000004 2024-09-13T06:41:41.215 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:41.215 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:41.215 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:41:41.215 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:03.689849+0000", 2024-09-13T06:41:41.215 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.042724445999999999 2024-09-13T06:41:41.215 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:41.215 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:41.215 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-09-13T06:41:41.215 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:03.689871+0000", 2024-09-13T06:41:41.215 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1778999999999999e-05 2024-09-13T06:41:41.215 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:41.215 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:41.215 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:41:41.216 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:03.689965+0000", 2024-09-13T06:41:41.216 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.4312000000000001e-05 2024-09-13T06:41:41.216 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:41.216 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:41.216 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:41.216 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:03.690037+0000", 2024-09-13T06:41:41.216 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.1687999999999995e-05 2024-09-13T06:41:41.216 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:41.216 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:41.216 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:41.216 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:41.216 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:41.216 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:90987 3.6 3:6263dd97:::rbd_object_map.11212443ae03.0000000000000049:head [call] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-13T06:41:41.216 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:41:35.460333+0000", 2024-09-13T06:41:41.217 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 5.6644061160000003, 2024-09-13T06:41:41.217 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0001633640000001, 2024-09-13T06:41:41.217 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:41.217 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:41.217 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:41.217 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:41.217 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:41.217 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 90987 2024-09-13T06:41:41.217 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:41.217 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:41.217 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:41.217 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:41.217 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:35.460333+0000", 2024-09-13T06:41:41.218 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:41.218 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:41.218 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:41.218 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:41.218 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:35.460333+0000", 2024-09-13T06:41:41.218 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:41.218 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:41.218 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:41.218 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:41.218 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:35.460330+0000", 2024-09-13T06:41:41.218 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999971 2024-09-13T06:41:41.218 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:41.218 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:41.218 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:41.219 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:35.460343+0000", 2024-09-13T06:41:41.219 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2695e-05 2024-09-13T06:41:41.219 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:41.219 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:41.219 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:41.219 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:35.460365+0000", 2024-09-13T06:41:41.219 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2473999999999999e-05 2024-09-13T06:41:41.219 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:41.219 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:41.219 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:41.219 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:35.460376+0000", 2024-09-13T06:41:41.219 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0383999999999999e-05 2024-09-13T06:41:41.219 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:41.220 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:41.220 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:41.220 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:35.460435+0000", 2024-09-13T06:41:41.220 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8650000000000003e-05 2024-09-13T06:41:41.220 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:41.220 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:41.220 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:41:41.220 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:35.460444+0000", 2024-09-13T06:41:41.220 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.0380000000000005e-06 2024-09-13T06:41:41.220 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:41.220 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:41.220 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:41.220 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:36.459433+0000", 2024-09-13T06:41:41.221 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.99898895799999998 2024-09-13T06:41:41.221 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:41.221 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:41.221 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:41.221 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:36.459622+0000", 2024-09-13T06:41:41.221 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00018940299999999999 2024-09-13T06:41:41.221 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:41.221 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:41.221 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:41.221 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:36.460497+0000", 2024-09-13T06:41:41.221 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00087481199999999999 2024-09-13T06:41:41.221 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:41.221 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:41.222 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:41.222 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:41.222 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:41.222 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:41:41.223 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-13T06:41:41.224 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:41:41.221+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:41:41.324 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:41:41.321+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:41:41.410 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:41:41.411 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-13T06:41:41.411 INFO:teuthology.orchestra.run.smithi081.stdout: "num_ops": 0 2024-09-13T06:41:41.411 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:41:41.423 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-13T06:41:41.425 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:41:41.422+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:41:41.480 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-13T06:41:41.489 INFO:teuthology.orchestra.run.smithi081.stderr:nodeep-scrub is set 2024-09-13T06:41:41.526 INFO:tasks.ceph.osd.6.smithi139.stderr:2024-09-13T06:41:41.522+0000 7fcd02c5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26385) UID: 0 2024-09-13T06:41:41.587 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:41:41.587 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-13T06:41:41.587 INFO:teuthology.orchestra.run.smithi081.stdout: "complaint_time": 30, 2024-09-13T06:41:41.587 INFO:teuthology.orchestra.run.smithi081.stdout: "num_blocked_ops": 0 2024-09-13T06:41:41.587 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:41:41.603 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-13T06:41:41.627 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:41:41.622+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:41:41.633 INFO:teuthology.orchestra.run.smithi081.stdout:checking clone #23, image image_client.0-clone23 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent24 2024-09-13T06:41:41.633 INFO:teuthology.orchestra.run.smithi081.stdout:osd.0: {} 2024-09-13T06:41:41.633 INFO:teuthology.orchestra.run.smithi081.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-13T06:41:41.652 INFO:teuthology.orchestra.run.smithi081.stdout:osd.1: {} 2024-09-13T06:41:41.652 INFO:teuthology.orchestra.run.smithi081.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-13T06:41:41.669 INFO:teuthology.orchestra.run.smithi081.stdout:osd.2: {} 2024-09-13T06:41:41.670 INFO:teuthology.orchestra.run.smithi081.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-13T06:41:41.687 INFO:teuthology.orchestra.run.smithi081.stdout:osd.3: {} 2024-09-13T06:41:41.687 INFO:teuthology.orchestra.run.smithi081.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-13T06:41:41.707 INFO:teuthology.orchestra.run.smithi081.stdout:osd.4: {} 2024-09-13T06:41:41.707 INFO:teuthology.orchestra.run.smithi081.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-13T06:41:41.723 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:41:41.724 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:41:41.728 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:41:41.725+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:41:41.734 INFO:teuthology.orchestra.run.smithi081.stdout:osd.5: {} 2024-09-13T06:41:41.734 INFO:teuthology.orchestra.run.smithi081.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-13T06:41:41.738 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-13T06:41:41.754 INFO:teuthology.orchestra.run.smithi081.stdout:osd.6: {} 2024-09-13T06:41:41.755 INFO:teuthology.orchestra.run.smithi081.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-13T06:41:41.755 INFO:teuthology.orchestra.run.smithi081.stderr:Error ENXIO: problem getting command descriptions from osd.7 2024-09-13T06:41:41.758 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-13T06:41:41.758 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-13T06:41:41.829 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:41:41.825+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:41:41.863 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:41:41.863 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:41:41.877 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-13T06:41:41.966 INFO:teuthology.orchestra.run.smithi081.stdout:3837 trunc from 0xaa9a32c to 0xd982a30 2024-09-13T06:41:41.966 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:41:41.965+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:41:41.980 INFO:teuthology.orchestra.run.smithi081.stdout:3838 punch from 0x231a3d0 to 0x232263e, (0x826e bytes) 2024-09-13T06:41:41.996 INFO:teuthology.orchestra.run.smithi081.stdout:3842 trunc from 0xd982a30 to 0x8192cc 2024-09-13T06:41:42.032 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:41:42.026+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:41:42.070 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:41:42.070 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:41:42.099 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-13T06:41:42.105 INFO:teuthology.orchestra.run.smithi081.stdout:3844 write 0xdaba96d thru 0xdac739b (0xca2f bytes) 2024-09-13T06:41:42.128 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:41:42.128 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:41:42.128 INFO:teuthology.orchestra.run.smithi081.stdout:3847 punch from 0xa62c718 to 0xa6377e3, (0xb0cb bytes) 2024-09-13T06:41:42.128 INFO:teuthology.orchestra.run.smithi081.stdout:3849 read 0x1c8281a thru 0x1c86fd7 (0x47be bytes) 2024-09-13T06:41:42.128 INFO:teuthology.orchestra.run.smithi081.stdout:3850 write 0x224cbf5 thru 0x2257574 (0xa980 bytes) 2024-09-13T06:41:42.132 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:41:42.129+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:41:42.145 INFO:teuthology.orchestra.run.smithi081.stdout:3851 read 0x320ceb5 thru 0x3216878 (0x99c4 bytes) 2024-09-13T06:41:42.145 INFO:teuthology.orchestra.run.smithi081.stdout:3852 writesame 0xe8502 thru 0xf133b data_size 0x37(0x8e3a bytes) 2024-09-13T06:41:42.150 INFO:teuthology.orchestra.run.smithi081.stdout:3853 write 0x14f9475 thru 0x14fa61f (0x11ab bytes) 2024-09-13T06:41:42.157 INFO:teuthology.orchestra.run.smithi081.stdout:3854 write 0xcf8fb21 thru 0xcf924c7 (0x29a7 bytes) 2024-09-13T06:41:42.177 INFO:teuthology.orchestra.run.smithi081.stdout:3856 write 0xe7636bf thru 0xe772a04 (0xf346 bytes) 2024-09-13T06:41:42.199 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:41:42.199 INFO:teuthology.orchestra.run.smithi081.stdout:3858 write 0x800fe25 thru 0x801f1e7 (0xf3c3 bytes) 2024-09-13T06:41:42.217 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:41:42.217 INFO:teuthology.orchestra.run.smithi081.stdout:3860 punch from 0x9e31338 to 0x9e3d2e7, (0xbfaf bytes) 2024-09-13T06:41:42.217 INFO:teuthology.orchestra.run.smithi081.stdout:3863 writesame 0x2217804 thru 0x2223c6c data_size 0xb(0xc469 bytes) 2024-09-13T06:41:42.225 INFO:teuthology.orchestra.run.smithi081.stdout:3864 trunc from 0xe772a05 to 0xdfb997b 2024-09-13T06:41:42.234 INFO:tasks.ceph.osd.6.smithi139.stderr:2024-09-13T06:41:42.230+0000 7fcd02c5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26385) UID: 0 2024-09-13T06:41:42.239 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:41:42.239 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:41:42.244 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:41:42.244 INFO:teuthology.orchestra.run.smithi081.stdout:3866 read 0x969e946 thru 0x96a1df6 (0x34b1 bytes) 2024-09-13T06:41:42.244 INFO:teuthology.orchestra.run.smithi081.stdout:3867 read 0xca3d024 thru 0xca41727 (0x4704 bytes) 2024-09-13T06:41:42.244 INFO:teuthology.orchestra.run.smithi081.stdout:3869 writesame 0x2b46788 thru 0x2b5104b data_size 0xe(0xa8c4 bytes) 2024-09-13T06:41:42.256 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-13T06:41:42.261 INFO:teuthology.orchestra.run.smithi081.stdout:3870 write 0xd32f147 thru 0xd3315da (0x2494 bytes) 2024-09-13T06:41:42.267 INFO:teuthology.orchestra.run.smithi081.stdout:3871 punch from 0x23a7207 to 0x23abfc4, (0x4dbd bytes) 2024-09-13T06:41:42.271 INFO:teuthology.orchestra.run.smithi081.stdout:3874 trunc from 0xdfb997b to 0xa8b283c 2024-09-13T06:41:42.288 INFO:teuthology.orchestra.run.smithi081.stdout:3875 read 0x1c58f80 thru 0x1c64d66 (0xbde7 bytes) 2024-09-13T06:41:42.288 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:41:42.288 INFO:teuthology.orchestra.run.smithi081.stdout:3877 read 0x983372 thru 0x985657 (0x22e6 bytes) 2024-09-13T06:41:42.296 INFO:teuthology.orchestra.run.smithi081.stdout:3880 write 0xabdacf5 thru 0xabe48b7 (0x9bc3 bytes) 2024-09-13T06:41:42.310 INFO:teuthology.orchestra.run.smithi081.stdout:3881 write 0x9a9a2c5 thru 0x9aa2c38 (0x8974 bytes) 2024-09-13T06:41:42.325 INFO:teuthology.orchestra.run.smithi081.stdout:3883 read 0xa8c2297 thru 0xa8c8825 (0x658f bytes) 2024-09-13T06:41:42.325 INFO:teuthology.orchestra.run.smithi081.stdout:3885 read 0x6551199 thru 0x655ebc3 (0xda2b bytes) 2024-09-13T06:41:42.325 INFO:teuthology.orchestra.run.smithi081.stdout:3886 read 0x5d42f5c thru 0x5d4aa54 (0x7af9 bytes) 2024-09-13T06:41:42.325 INFO:teuthology.orchestra.run.smithi081.stdout:3887 write 0x63b7039 thru 0x63c4102 (0xd0ca bytes) 2024-09-13T06:41:42.334 INFO:tasks.ceph.osd.6.smithi139.stderr:2024-09-13T06:41:42.330+0000 7fcd02c5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26385) UID: 0 2024-09-13T06:41:42.342 INFO:teuthology.orchestra.run.smithi081.stdout:3889 read 0x32c7d89 thru 0x32d034f (0x85c7 bytes) 2024-09-13T06:41:42.355 INFO:teuthology.orchestra.run.smithi081.stdout:3890 writesame 0xea1bf5e thru 0xea27f5c data_size 0x1(0xbfff bytes) 2024-09-13T06:41:42.355 INFO:teuthology.orchestra.run.smithi081.stdout:3891 punch from 0x83f5003 to 0x83f5a69, (0xa66 bytes) 2024-09-13T06:41:42.355 INFO:teuthology.orchestra.run.smithi081.stdout:3893 write 0x97f70ad thru 0x980654e (0xf4a2 bytes) 2024-09-13T06:41:42.373 INFO:teuthology.orchestra.run.smithi081.stdout:3894 read 0xd04aeb4 thru 0xd056143 (0xb290 bytes) 2024-09-13T06:41:42.373 INFO:teuthology.orchestra.run.smithi081.stdout:3895 read 0x76fd600 thru 0x76fe648 (0x1049 bytes) 2024-09-13T06:41:42.373 INFO:teuthology.orchestra.run.smithi081.stdout:3897 write 0x9b9db41 thru 0x9b9ed24 (0x11e4 bytes) 2024-09-13T06:41:42.377 INFO:teuthology.orchestra.run.smithi081.stdout:3899 read 0x87cb075 thru 0x87ce51e (0x34aa bytes) 2024-09-13T06:41:42.377 INFO:teuthology.orchestra.run.smithi081.stdout:3900 clone 26 order 23 su 262144 sc 15 2024-09-13T06:41:42.394 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:41:42.394 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:41:42.408 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-13T06:41:42.436 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:41:42.433+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:41:42.537 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:41:42.533+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:41:42.582 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:41:42.582 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:41:42.597 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-13T06:41:42.637 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:41:42.633+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:41:42.719 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:41:42.719 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:41:42.734 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-13T06:41:42.738 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:41:42.737+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:41:42.839 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:41:42.837+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:41:42.857 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:41:42.857 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:41:42.871 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-13T06:41:42.939 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:41:42.934+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:41:42.988 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:41:42.988 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:41:43.002 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-13T06:41:43.040 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:41:43.037+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:41:43.141 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:41:43.137+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:41:43.167 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:41:43.167 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:41:43.181 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-13T06:41:43.242 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:41:43.238+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:41:43.304 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:41:43.304 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:41:43.318 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-13T06:41:43.343 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:41:43.341+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:41:43.444 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:41:43.441+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:41:43.484 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:41:43.485 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:41:43.498 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-13T06:41:43.513 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-13T06:41:43.559 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:41:43.557+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:41:43.631 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:41:43.631 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:41:43.645 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:41:43.642+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:41:43.647 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-13T06:41:43.746 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:41:43.745+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:41:43.758 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-13T06:41:43.814 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:41:43.814 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:41:43.830 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-13T06:41:43.847 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:41:43.842+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:41:43.928 INFO:teuthology.orchestra.run.smithi081.stdout:osd.0: {} 2024-09-13T06:41:43.928 INFO:teuthology.orchestra.run.smithi081.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-13T06:41:43.951 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:41:43.945+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:41:43.983 INFO:teuthology.orchestra.run.smithi081.stdout:osd.1: {} 2024-09-13T06:41:43.983 INFO:teuthology.orchestra.run.smithi081.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-13T06:41:44.017 INFO:teuthology.orchestra.run.smithi081.stdout:osd.2: {} 2024-09-13T06:41:44.018 INFO:teuthology.orchestra.run.smithi081.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-13T06:41:44.025 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:41:44.025 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-13T06:41:44.025 INFO:teuthology.orchestra.run.smithi081.stdout: "complaint_time": 30, 2024-09-13T06:41:44.025 INFO:teuthology.orchestra.run.smithi081.stdout: "num_blocked_ops": 0 2024-09-13T06:41:44.025 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:41:44.049 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:41:44.046+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:41:44.061 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-13T06:41:44.086 INFO:teuthology.orchestra.run.smithi081.stdout:osd.3: {} 2024-09-13T06:41:44.086 INFO:teuthology.orchestra.run.smithi081.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-13T06:41:44.119 INFO:teuthology.orchestra.run.smithi081.stdout:osd.4: {} 2024-09-13T06:41:44.119 INFO:teuthology.orchestra.run.smithi081.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-13T06:41:44.150 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:41:44.146+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:41:44.167 INFO:teuthology.orchestra.run.smithi081.stdout:osd.5: {} 2024-09-13T06:41:44.167 INFO:teuthology.orchestra.run.smithi081.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-13T06:41:44.201 INFO:teuthology.orchestra.run.smithi081.stdout:osd.6: {} 2024-09-13T06:41:44.201 INFO:teuthology.orchestra.run.smithi081.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-13T06:41:44.203 INFO:teuthology.orchestra.run.smithi081.stderr:Error ENXIO: problem getting command descriptions from osd.7 2024-09-13T06:41:44.208 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-13T06:41:44.209 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-13T06:41:44.252 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:41:44.249+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:41:44.293 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:41:44.293 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 20, 2024-09-13T06:41:44.293 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 600, 2024-09-13T06:41:44.293 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [ 2024-09-13T06:41:44.293 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.293 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:37801 3.1 3:82e31015:::rbd_object_map.1121d8143c6e.0000000000000019:head [call] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e55)", 2024-09-13T06:41:44.293 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:05.646191+0000", 2024-09-13T06:41:44.293 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 98.646618391000004, 2024-09-13T06:41:44.293 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.72659507800000001, 2024-09-13T06:41:44.293 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:44.293 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:44.293 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:44.294 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:44.294 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:44.294 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 37801 2024-09-13T06:41:44.294 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.294 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:44.294 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.294 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:44.294 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:05.646191+0000", 2024-09-13T06:41:44.294 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:44.294 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.294 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.294 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:44.294 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:05.646191+0000", 2024-09-13T06:41:44.294 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:44.295 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.295 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.295 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:44.295 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:05.646188+0000", 2024-09-13T06:41:44.295 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999971 2024-09-13T06:41:44.295 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.295 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.295 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:44.295 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:05.646206+0000", 2024-09-13T06:41:44.295 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8182999999999999e-05 2024-09-13T06:41:44.295 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.295 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.295 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:44.295 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:05.646237+0000", 2024-09-13T06:41:44.295 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.1071000000000001e-05 2024-09-13T06:41:44.296 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.296 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.296 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:44.296 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:05.646251+0000", 2024-09-13T06:41:44.296 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3679000000000001e-05 2024-09-13T06:41:44.296 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.296 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.296 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:44.296 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:05.646321+0000", 2024-09-13T06:41:44.296 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.9831000000000003e-05 2024-09-13T06:41:44.296 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.296 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.296 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:41:44.296 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:05.646331+0000", 2024-09-13T06:41:44.297 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0242e-05 2024-09-13T06:41:44.297 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.297 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.297 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:44.297 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.371959+0000", 2024-09-13T06:41:44.297 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.72562817199999996 2024-09-13T06:41:44.297 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.297 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.297 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:44.297 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.372389+0000", 2024-09-13T06:41:44.297 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00042977400000000001 2024-09-13T06:41:44.297 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.298 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.298 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:44.298 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.372786+0000", 2024-09-13T06:41:44.298 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00039706099999999999 2024-09-13T06:41:44.298 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:44.298 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:44.298 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:44.298 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.298 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.298 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43009 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 489472~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:44.298 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.644660+0000", 2024-09-13T06:41:44.298 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 82.648149429, 2024-09-13T06:41:44.298 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123376071, 2024-09-13T06:41:44.298 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:44.298 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:44.299 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:44.299 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:44.299 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:44.299 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43009 2024-09-13T06:41:44.299 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.299 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:44.299 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.299 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:44.299 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.644660+0000", 2024-09-13T06:41:44.299 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:44.299 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.299 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.299 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:44.299 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.644660+0000", 2024-09-13T06:41:44.300 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:44.300 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.300 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.300 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:44.300 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.644659+0000", 2024-09-13T06:41:44.300 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:44.300 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.300 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.300 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:44.300 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.644662+0000", 2024-09-13T06:41:44.300 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4949999999999998e-06 2024-09-13T06:41:44.300 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.300 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.300 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:44.300 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.644669+0000", 2024-09-13T06:41:44.301 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.289e-06 2024-09-13T06:41:44.301 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.301 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.301 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:44.301 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.644674+0000", 2024-09-13T06:41:44.301 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.8840000000000002e-06 2024-09-13T06:41:44.301 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.301 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.301 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:44.301 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.767602+0000", 2024-09-13T06:41:44.301 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.122928158 2024-09-13T06:41:44.301 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.301 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.301 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:44.301 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.767676+0000", 2024-09-13T06:41:44.302 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3992999999999994e-05 2024-09-13T06:41:44.302 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.302 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.302 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:44.302 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.768036+0000", 2024-09-13T06:41:44.302 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00035966200000000001 2024-09-13T06:41:44.302 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:44.302 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:44.302 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:44.302 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.302 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.302 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43010 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 503808~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:44.302 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.644678+0000", 2024-09-13T06:41:44.302 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 82.648131102999997, 2024-09-13T06:41:44.302 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123728798, 2024-09-13T06:41:44.303 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:44.303 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:44.303 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:44.303 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:44.303 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:44.303 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43010 2024-09-13T06:41:44.303 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.303 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:44.303 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.303 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:44.303 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.644678+0000", 2024-09-13T06:41:44.303 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:44.304 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.304 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.304 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:44.304 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.644678+0000", 2024-09-13T06:41:44.304 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:44.304 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.304 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.304 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:44.304 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.644678+0000", 2024-09-13T06:41:44.304 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:44.304 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.304 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.304 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:44.304 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.644680+0000", 2024-09-13T06:41:44.305 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2050000000000001e-06 2024-09-13T06:41:44.305 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.305 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.305 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:44.305 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.644686+0000", 2024-09-13T06:41:44.305 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8440000000000003e-06 2024-09-13T06:41:44.305 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.305 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.305 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:44.305 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.644691+0000", 2024-09-13T06:41:44.305 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.118e-06 2024-09-13T06:41:44.305 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.306 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.306 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:44.306 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.768065+0000", 2024-09-13T06:41:44.306 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123374698 2024-09-13T06:41:44.306 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.306 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.306 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:44.306 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.768139+0000", 2024-09-13T06:41:44.306 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3934000000000001e-05 2024-09-13T06:41:44.306 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.306 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.306 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:44.306 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.768407+0000", 2024-09-13T06:41:44.306 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00026738800000000002 2024-09-13T06:41:44.307 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:44.307 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:44.307 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:44.307 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.307 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.307 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43181 3.17 3:ec5ebce4:::rbd_data.1121f5f2e1c0.0000000000000001:1f [read 319488~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:44.307 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.652968+0000", 2024-09-13T06:41:44.307 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 82.639840586999995, 2024-09-13T06:41:44.307 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.12363807, 2024-09-13T06:41:44.307 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:44.307 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:44.307 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:44.307 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:44.308 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:44.308 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43181 2024-09-13T06:41:44.308 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.308 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:44.308 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.308 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:44.308 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.652968+0000", 2024-09-13T06:41:44.308 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:44.308 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.308 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.308 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:44.308 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.652968+0000", 2024-09-13T06:41:44.309 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:44.309 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.309 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.309 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:44.309 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.652968+0000", 2024-09-13T06:41:44.309 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:44.309 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.309 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.309 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:44.309 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.652970+0000", 2024-09-13T06:41:44.309 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2409999999999998e-06 2024-09-13T06:41:44.309 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.309 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.309 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:44.310 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.652976+0000", 2024-09-13T06:41:44.310 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0079999999999999e-06 2024-09-13T06:41:44.310 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.310 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.310 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:44.310 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.652981+0000", 2024-09-13T06:41:44.310 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4390000000000002e-06 2024-09-13T06:41:44.310 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.310 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.310 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:44.310 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.776275+0000", 2024-09-13T06:41:44.310 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.12329396099999999 2024-09-13T06:41:44.310 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.311 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.311 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:44.311 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.776316+0000", 2024-09-13T06:41:44.311 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.1244e-05 2024-09-13T06:41:44.311 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.311 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.311 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:44.311 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.776607+0000", 2024-09-13T06:41:44.311 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00029051199999999999 2024-09-13T06:41:44.311 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:44.311 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:44.311 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:44.311 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.312 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.312 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43182 3.17 3:ec5ebce4:::rbd_data.1121f5f2e1c0.0000000000000001:1f [read 333824~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:44.312 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.652985+0000", 2024-09-13T06:41:44.312 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 82.639823777999993, 2024-09-13T06:41:44.312 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123926616, 2024-09-13T06:41:44.312 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:44.312 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:44.312 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:44.312 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:44.312 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:44.313 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43182 2024-09-13T06:41:44.313 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.313 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:44.313 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.313 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:44.313 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.652985+0000", 2024-09-13T06:41:44.313 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:44.313 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.313 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.313 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:44.313 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.652985+0000", 2024-09-13T06:41:44.313 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:44.314 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.314 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.314 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:44.314 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.652985+0000", 2024-09-13T06:41:44.314 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:44.314 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.314 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.314 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:44.314 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.652987+0000", 2024-09-13T06:41:44.314 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0899999999999999e-06 2024-09-13T06:41:44.314 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.314 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.315 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:44.315 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.652994+0000", 2024-09-13T06:41:44.315 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3100000000000003e-06 2024-09-13T06:41:44.315 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.315 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.315 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:44.315 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.653000+0000", 2024-09-13T06:41:44.315 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2020000000000003e-06 2024-09-13T06:41:44.315 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.315 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.315 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:44.315 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.776635+0000", 2024-09-13T06:41:44.315 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.12363529400000001 2024-09-13T06:41:44.315 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.316 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.316 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:44.316 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.776676+0000", 2024-09-13T06:41:44.316 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.0745999999999999e-05 2024-09-13T06:41:44.316 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.316 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.316 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:44.316 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.776912+0000", 2024-09-13T06:41:44.316 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00023631300000000001 2024-09-13T06:41:44.316 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:44.316 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:44.316 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:44.316 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.317 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.317 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43192 3.17 3:ec5ebce4:::rbd_data.1121f5f2e1c0.0000000000000001:1f [read 466944~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:44.317 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.656622+0000", 2024-09-13T06:41:44.317 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 82.636186722000005, 2024-09-13T06:41:44.317 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123503136, 2024-09-13T06:41:44.317 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:44.317 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:44.317 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:44.317 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:44.317 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:44.317 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43192 2024-09-13T06:41:44.317 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.317 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:44.317 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.317 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:44.318 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656622+0000", 2024-09-13T06:41:44.318 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:44.318 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.318 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.318 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:44.318 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656622+0000", 2024-09-13T06:41:44.318 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:44.318 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.318 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.318 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:44.318 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656622+0000", 2024-09-13T06:41:44.318 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:41:44.318 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.318 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.318 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:44.319 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656623+0000", 2024-09-13T06:41:44.319 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2079999999999999e-06 2024-09-13T06:41:44.319 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.319 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.319 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:44.319 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656627+0000", 2024-09-13T06:41:44.319 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.4819999999999999e-06 2024-09-13T06:41:44.319 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.319 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.319 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:44.319 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656629+0000", 2024-09-13T06:41:44.319 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.582e-06 2024-09-13T06:41:44.319 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.319 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.320 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:44.320 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.779866+0000", 2024-09-13T06:41:44.320 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.12323638100000001 2024-09-13T06:41:44.320 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.320 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.320 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:44.320 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.779905+0000", 2024-09-13T06:41:44.320 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.9529e-05 2024-09-13T06:41:44.320 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.320 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.320 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:44.320 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.780125+0000", 2024-09-13T06:41:44.320 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000220168 2024-09-13T06:41:44.321 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:44.321 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:44.321 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:44.321 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.321 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.321 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43193 3.17 3:ec5ebce4:::rbd_data.1121f5f2e1c0.0000000000000001:1f [read 481280~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:44.321 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.656635+0000", 2024-09-13T06:41:44.321 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 82.636174237999995, 2024-09-13T06:41:44.321 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.12374478999999999, 2024-09-13T06:41:44.321 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:44.321 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:44.322 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:44.322 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:44.322 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:44.322 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43193 2024-09-13T06:41:44.322 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.322 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:44.322 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.322 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:44.322 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656635+0000", 2024-09-13T06:41:44.322 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:44.322 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.322 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.322 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:44.322 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656635+0000", 2024-09-13T06:41:44.322 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:44.323 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.323 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.323 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:44.323 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656635+0000", 2024-09-13T06:41:44.323 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:41:44.323 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.323 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.323 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:44.323 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656636+0000", 2024-09-13T06:41:44.323 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.544e-06 2024-09-13T06:41:44.323 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.323 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.323 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:44.323 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656639+0000", 2024-09-13T06:41:44.323 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.0879999999999999e-06 2024-09-13T06:41:44.324 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.324 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.324 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:44.324 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656642+0000", 2024-09-13T06:41:44.324 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5799999999999999e-06 2024-09-13T06:41:44.324 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.324 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.324 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:44.324 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.780151+0000", 2024-09-13T06:41:44.324 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123509035 2024-09-13T06:41:44.324 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.324 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.324 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:44.324 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.780191+0000", 2024-09-13T06:41:44.325 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.9758000000000001e-05 2024-09-13T06:41:44.325 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.325 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.325 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:44.325 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.780380+0000", 2024-09-13T06:41:44.325 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000189023 2024-09-13T06:41:44.325 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:44.325 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:44.325 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:44.325 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.325 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.325 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43194 3.17 3:ec5ebce4:::rbd_data.1121f5f2e1c0.0000000000000001:1f [read 495616~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:44.325 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.656645+0000", 2024-09-13T06:41:44.325 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 82.636163585000006, 2024-09-13T06:41:44.325 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.124088483, 2024-09-13T06:41:44.326 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:44.326 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:44.326 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:44.326 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:44.326 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:44.326 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43194 2024-09-13T06:41:44.326 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.326 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:44.326 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.326 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:44.326 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656645+0000", 2024-09-13T06:41:44.326 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:44.326 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.326 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.327 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:44.327 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656645+0000", 2024-09-13T06:41:44.327 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:44.327 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.327 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.327 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:44.327 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656645+0000", 2024-09-13T06:41:44.327 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:44.327 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.327 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.327 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:44.327 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656647+0000", 2024-09-13T06:41:44.327 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9180000000000001e-06 2024-09-13T06:41:44.327 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.328 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.328 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:44.328 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656653+0000", 2024-09-13T06:41:44.328 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7860000000000002e-06 2024-09-13T06:41:44.328 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.328 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.328 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:44.328 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656658+0000", 2024-09-13T06:41:44.328 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6949999999999999e-06 2024-09-13T06:41:44.328 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.328 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.328 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:44.328 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.780406+0000", 2024-09-13T06:41:44.329 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123748657 2024-09-13T06:41:44.329 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.329 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.329 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:44.329 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.780446+0000", 2024-09-13T06:41:44.329 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.9360999999999998e-05 2024-09-13T06:41:44.329 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.329 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.329 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:44.329 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.780734+0000", 2024-09-13T06:41:44.329 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00028838399999999998 2024-09-13T06:41:44.329 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:44.329 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:44.329 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:44.329 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.330 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.330 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43240 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 106496~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:44.330 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.660672+0000", 2024-09-13T06:41:44.330 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 82.632137221999997, 2024-09-13T06:41:44.330 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123612707, 2024-09-13T06:41:44.330 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:44.330 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:44.330 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:44.330 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:44.330 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:44.330 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43240 2024-09-13T06:41:44.330 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.330 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:44.330 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.330 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:44.331 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660672+0000", 2024-09-13T06:41:44.331 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:44.331 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.331 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.331 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:44.331 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660672+0000", 2024-09-13T06:41:44.331 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:44.331 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.331 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.331 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:44.331 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660671+0000", 2024-09-13T06:41:44.331 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:44.331 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.332 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.332 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:44.332 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660673+0000", 2024-09-13T06:41:44.332 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.652e-06 2024-09-13T06:41:44.332 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.332 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.332 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:44.332 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660677+0000", 2024-09-13T06:41:44.332 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.2509999999999996e-06 2024-09-13T06:41:44.332 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.332 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.332 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:44.332 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660680+0000", 2024-09-13T06:41:44.332 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.8150000000000002e-06 2024-09-13T06:41:44.333 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.333 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.333 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:44.333 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.783596+0000", 2024-09-13T06:41:44.333 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.122915841 2024-09-13T06:41:44.333 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.333 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.333 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:44.333 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.783682+0000", 2024-09-13T06:41:44.333 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.5822999999999995e-05 2024-09-13T06:41:44.333 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.333 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.333 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:44.333 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.784285+0000", 2024-09-13T06:41:44.334 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00060276500000000001 2024-09-13T06:41:44.334 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:44.334 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:44.334 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:44.334 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.334 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.334 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43241 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 120832~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:44.334 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.660682+0000", 2024-09-13T06:41:44.334 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 82.632126647000007, 2024-09-13T06:41:44.334 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123958204, 2024-09-13T06:41:44.334 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:44.334 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:44.334 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:44.334 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:44.334 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:44.335 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43241 2024-09-13T06:41:44.335 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.335 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:44.335 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.335 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:44.335 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660682+0000", 2024-09-13T06:41:44.335 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:44.335 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.335 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.335 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:44.335 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660682+0000", 2024-09-13T06:41:44.335 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:44.335 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.335 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.336 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:44.336 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660682+0000", 2024-09-13T06:41:44.336 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:44.336 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.336 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.336 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:44.336 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660683+0000", 2024-09-13T06:41:44.336 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.308e-06 2024-09-13T06:41:44.336 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.336 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.336 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:44.336 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660686+0000", 2024-09-13T06:41:44.336 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.977e-06 2024-09-13T06:41:44.337 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.337 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.337 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:44.337 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660689+0000", 2024-09-13T06:41:44.337 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5830000000000001e-06 2024-09-13T06:41:44.337 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.337 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.337 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:44.337 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.784366+0000", 2024-09-13T06:41:44.337 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.12367713599999999 2024-09-13T06:41:44.337 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.337 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.337 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:44.337 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.784451+0000", 2024-09-13T06:41:44.338 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.4629999999999994e-05 2024-09-13T06:41:44.338 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.338 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.338 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:44.338 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.784641+0000", 2024-09-13T06:41:44.338 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00018984899999999999 2024-09-13T06:41:44.338 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:44.338 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:44.338 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:44.338 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.338 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.338 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43242 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 139264~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:44.338 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.660691+0000", 2024-09-13T06:41:44.338 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 82.632117668999996, 2024-09-13T06:41:44.339 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.124536443, 2024-09-13T06:41:44.339 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:44.339 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:44.339 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:44.339 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:44.339 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:44.339 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43242 2024-09-13T06:41:44.339 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.339 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:44.339 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.339 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:44.339 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660691+0000", 2024-09-13T06:41:44.339 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:44.339 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.340 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.340 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:44.340 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660691+0000", 2024-09-13T06:41:44.340 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:44.340 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.340 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.340 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:44.340 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660691+0000", 2024-09-13T06:41:44.340 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:41:44.340 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.340 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.340 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:44.340 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660696+0000", 2024-09-13T06:41:44.341 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0560000000000004e-06 2024-09-13T06:41:44.341 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.341 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.341 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:44.341 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660699+0000", 2024-09-13T06:41:44.341 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.2009999999999999e-06 2024-09-13T06:41:44.341 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.341 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.341 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:44.341 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660702+0000", 2024-09-13T06:41:44.341 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.633e-06 2024-09-13T06:41:44.341 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.341 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.341 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:44.342 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.784912+0000", 2024-09-13T06:41:44.342 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.124209497 2024-09-13T06:41:44.342 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.342 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.342 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:44.342 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.784995+0000", 2024-09-13T06:41:44.342 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.3891e-05 2024-09-13T06:41:44.342 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.342 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.342 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:44.342 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.785228+0000", 2024-09-13T06:41:44.342 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00023237400000000001 2024-09-13T06:41:44.342 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:44.342 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:44.342 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:44.343 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.343 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.343 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43243 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 153600~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:44.343 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.660705+0000", 2024-09-13T06:41:44.343 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 82.632104335999998, 2024-09-13T06:41:44.343 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.124825835, 2024-09-13T06:41:44.343 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:44.343 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:44.343 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:44.343 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:44.343 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:44.343 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43243 2024-09-13T06:41:44.343 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.343 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:44.344 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.344 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:44.344 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660705+0000", 2024-09-13T06:41:44.344 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:44.344 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.344 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.344 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:44.344 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660705+0000", 2024-09-13T06:41:44.344 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:44.344 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.344 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.344 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:44.344 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660705+0000", 2024-09-13T06:41:44.344 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:41:44.345 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.345 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.345 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:44.345 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660706+0000", 2024-09-13T06:41:44.345 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4339999999999999e-06 2024-09-13T06:41:44.345 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.345 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.345 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:44.345 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660709+0000", 2024-09-13T06:41:44.345 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9000000000000002e-06 2024-09-13T06:41:44.345 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.345 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.346 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:44.346 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660712+0000", 2024-09-13T06:41:44.346 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.0589999999999998e-06 2024-09-13T06:41:44.346 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.346 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.346 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:44.346 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.785318+0000", 2024-09-13T06:41:44.346 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.124606299 2024-09-13T06:41:44.346 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.346 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.346 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:44.346 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.785361+0000", 2024-09-13T06:41:44.346 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.3214999999999999e-05 2024-09-13T06:41:44.346 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.346 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.347 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:44.347 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.785531+0000", 2024-09-13T06:41:44.347 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00016914400000000001 2024-09-13T06:41:44.347 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:44.347 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:44.347 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:44.347 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.347 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.347 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43244 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 167936~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:44.347 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.660714+0000", 2024-09-13T06:41:44.347 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 82.632094922999997, 2024-09-13T06:41:44.347 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.125073248, 2024-09-13T06:41:44.347 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:44.347 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:44.347 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:44.348 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:44.348 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:44.348 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43244 2024-09-13T06:41:44.348 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.348 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:44.348 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.348 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:44.348 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660714+0000", 2024-09-13T06:41:44.348 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:44.348 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.348 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.348 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:44.348 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660714+0000", 2024-09-13T06:41:44.349 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:44.349 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.349 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.349 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:44.349 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660714+0000", 2024-09-13T06:41:44.349 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:41:44.349 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.349 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.349 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:44.349 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660715+0000", 2024-09-13T06:41:44.349 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2330000000000001e-06 2024-09-13T06:41:44.349 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.349 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.350 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:44.350 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660718+0000", 2024-09-13T06:41:44.350 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9569999999999998e-06 2024-09-13T06:41:44.350 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.350 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.350 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:44.350 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660721+0000", 2024-09-13T06:41:44.350 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.678e-06 2024-09-13T06:41:44.350 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.350 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.350 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:44.350 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.785557+0000", 2024-09-13T06:41:44.350 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.12483633199999999 2024-09-13T06:41:44.350 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.351 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.351 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:44.351 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.785618+0000", 2024-09-13T06:41:44.351 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0686000000000001e-05 2024-09-13T06:41:44.351 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.351 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.351 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:44.351 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.785787+0000", 2024-09-13T06:41:44.351 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00016957699999999999 2024-09-13T06:41:44.351 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:44.351 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:44.351 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:44.351 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.351 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.351 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43254 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 315392~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:44.352 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.664717+0000", 2024-09-13T06:41:44.352 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 82.628092355000007, 2024-09-13T06:41:44.352 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.12357108, 2024-09-13T06:41:44.352 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:44.352 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:44.352 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:44.352 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:44.352 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:44.352 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43254 2024-09-13T06:41:44.352 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.352 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:44.352 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.352 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:44.353 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664717+0000", 2024-09-13T06:41:44.353 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:44.353 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.353 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.353 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:44.353 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664717+0000", 2024-09-13T06:41:44.353 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:44.353 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.353 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.353 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:44.353 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664716+0000", 2024-09-13T06:41:44.353 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:44.354 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.354 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.354 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:44.354 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664724+0000", 2024-09-13T06:41:44.354 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.7109999999999995e-06 2024-09-13T06:41:44.354 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.354 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.354 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:44.354 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664732+0000", 2024-09-13T06:41:44.354 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.8399999999999995e-06 2024-09-13T06:41:44.354 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.354 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.354 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:44.355 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664738+0000", 2024-09-13T06:41:44.355 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.879e-06 2024-09-13T06:41:44.355 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.355 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.355 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:44.355 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.788018+0000", 2024-09-13T06:41:44.355 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123280719 2024-09-13T06:41:44.355 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.355 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.355 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:44.355 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.788119+0000", 2024-09-13T06:41:44.355 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000100558 2024-09-13T06:41:44.355 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.355 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.356 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:44.356 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.788288+0000", 2024-09-13T06:41:44.356 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000168751 2024-09-13T06:41:44.356 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:44.356 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:44.356 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:44.356 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.356 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.356 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43255 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 329728~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:44.356 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.664743+0000", 2024-09-13T06:41:44.356 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 82.628066359000002, 2024-09-13T06:41:44.356 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.12381711500000001, 2024-09-13T06:41:44.356 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:44.357 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:44.357 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:44.357 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:44.357 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:44.357 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43255 2024-09-13T06:41:44.357 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.357 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:44.357 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.357 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:44.357 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664743+0000", 2024-09-13T06:41:44.357 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:44.357 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.358 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.358 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:44.358 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664743+0000", 2024-09-13T06:41:44.358 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:44.358 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.358 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.358 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:44.358 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664742+0000", 2024-09-13T06:41:44.358 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:44.358 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.358 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.358 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:44.358 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664745+0000", 2024-09-13T06:41:44.359 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.7269999999999999e-06 2024-09-13T06:41:44.359 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.359 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.359 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:44.359 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664753+0000", 2024-09-13T06:41:44.359 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.8709999999999997e-06 2024-09-13T06:41:44.359 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.359 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.359 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:44.359 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664758+0000", 2024-09-13T06:41:44.359 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2220000000000001e-06 2024-09-13T06:41:44.359 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.359 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.359 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:44.360 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.788314+0000", 2024-09-13T06:41:44.360 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123555545 2024-09-13T06:41:44.360 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.360 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.360 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:44.360 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.788368+0000", 2024-09-13T06:41:44.360 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3928999999999998e-05 2024-09-13T06:41:44.360 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.360 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.360 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:44.360 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.788560+0000", 2024-09-13T06:41:44.360 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000192237 2024-09-13T06:41:44.360 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:44.361 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:44.361 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:44.361 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.361 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.361 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43256 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 344064~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:44.361 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.664763+0000", 2024-09-13T06:41:44.361 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 82.628046413000007, 2024-09-13T06:41:44.361 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.12418359399999999, 2024-09-13T06:41:44.361 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:44.361 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:44.361 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:44.362 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:44.362 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:44.362 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43256 2024-09-13T06:41:44.362 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.362 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:44.362 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.362 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:44.362 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664763+0000", 2024-09-13T06:41:44.362 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:44.362 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.362 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.362 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:44.362 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664763+0000", 2024-09-13T06:41:44.363 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:44.363 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.363 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.363 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:44.363 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664762+0000", 2024-09-13T06:41:44.363 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:44.363 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.363 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.363 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:44.363 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664765+0000", 2024-09-13T06:41:44.363 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3290000000000001e-06 2024-09-13T06:41:44.363 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.363 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.364 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:44.364 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664771+0000", 2024-09-13T06:41:44.364 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.1319999999999999e-06 2024-09-13T06:41:44.364 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.364 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.364 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:44.364 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664776+0000", 2024-09-13T06:41:44.364 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.8840000000000002e-06 2024-09-13T06:41:44.364 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.364 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.364 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:44.364 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.788598+0000", 2024-09-13T06:41:44.365 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123821979 2024-09-13T06:41:44.365 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.365 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.365 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:44.365 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.788680+0000", 2024-09-13T06:41:44.365 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.2367999999999995e-05 2024-09-13T06:41:44.365 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.365 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.365 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:44.365 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.788946+0000", 2024-09-13T06:41:44.365 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00026629799999999999 2024-09-13T06:41:44.365 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:44.365 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:44.365 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:44.366 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.366 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.366 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43265 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 477184~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:44.366 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.669414+0000", 2024-09-13T06:41:44.366 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 82.623394777000001, 2024-09-13T06:41:44.366 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123446973, 2024-09-13T06:41:44.366 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:44.366 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:44.366 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:44.366 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:44.366 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:44.366 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43265 2024-09-13T06:41:44.366 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.367 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:44.367 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.367 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:44.367 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669414+0000", 2024-09-13T06:41:44.367 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:44.367 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.367 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.367 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:44.367 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669414+0000", 2024-09-13T06:41:44.367 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:44.367 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.367 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.367 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:44.368 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669414+0000", 2024-09-13T06:41:44.368 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:44.368 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.368 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.368 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:44.368 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669416+0000", 2024-09-13T06:41:44.368 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.317e-06 2024-09-13T06:41:44.368 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.368 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.368 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:44.368 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669425+0000", 2024-09-13T06:41:44.368 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.0650000000000005e-06 2024-09-13T06:41:44.369 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.369 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.369 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:44.369 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669430+0000", 2024-09-13T06:41:44.369 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5079999999999999e-06 2024-09-13T06:41:44.369 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.369 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.369 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:44.369 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.792649+0000", 2024-09-13T06:41:44.369 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123219328 2024-09-13T06:41:44.369 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.369 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.370 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:44.370 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.792695+0000", 2024-09-13T06:41:44.370 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5476999999999998e-05 2024-09-13T06:41:44.370 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.370 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.370 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:44.370 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.792861+0000", 2024-09-13T06:41:44.370 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00016658999999999999 2024-09-13T06:41:44.370 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:44.370 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:44.370 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:44.370 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.370 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.371 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43266 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 491520~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:44.371 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.669434+0000", 2024-09-13T06:41:44.371 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 82.623374655000006, 2024-09-13T06:41:44.371 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123685267, 2024-09-13T06:41:44.371 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:44.371 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:44.371 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:44.371 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:44.371 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:44.371 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43266 2024-09-13T06:41:44.371 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.371 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:44.371 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.371 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:44.372 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669434+0000", 2024-09-13T06:41:44.372 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:44.372 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.372 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.372 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:44.372 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669434+0000", 2024-09-13T06:41:44.372 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:44.372 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.372 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.372 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:44.372 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669434+0000", 2024-09-13T06:41:44.372 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:44.373 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.373 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.373 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:44.373 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669441+0000", 2024-09-13T06:41:44.373 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3019999999999997e-06 2024-09-13T06:41:44.373 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.373 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.373 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:44.373 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669451+0000", 2024-09-13T06:41:44.373 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.6379999999999999e-06 2024-09-13T06:41:44.373 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.373 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.373 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:44.373 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669456+0000", 2024-09-13T06:41:44.374 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.361e-06 2024-09-13T06:41:44.374 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.374 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.374 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:44.374 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.792879+0000", 2024-09-13T06:41:44.374 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123422686 2024-09-13T06:41:44.374 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.374 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.374 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:44.374 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.792923+0000", 2024-09-13T06:41:44.374 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4035000000000001e-05 2024-09-13T06:41:44.374 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.374 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.375 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:44.375 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.793120+0000", 2024-09-13T06:41:44.375 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00019660899999999999 2024-09-13T06:41:44.375 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:44.375 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:44.375 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:44.375 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.375 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.375 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43267 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 505856~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:44.375 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.669461+0000", 2024-09-13T06:41:44.375 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 82.623347859000006, 2024-09-13T06:41:44.375 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123933711, 2024-09-13T06:41:44.375 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:44.376 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:44.376 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:44.376 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:44.376 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:44.376 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43267 2024-09-13T06:41:44.376 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.376 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:44.376 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.376 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:44.376 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669461+0000", 2024-09-13T06:41:44.376 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:44.376 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.376 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.377 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:44.377 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669461+0000", 2024-09-13T06:41:44.377 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:44.377 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.377 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.377 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:44.377 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669461+0000", 2024-09-13T06:41:44.377 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:44.377 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.377 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.377 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:44.377 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669463+0000", 2024-09-13T06:41:44.377 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5629999999999999e-06 2024-09-13T06:41:44.377 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.378 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.378 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:44.378 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669473+0000", 2024-09-13T06:41:44.378 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.9520000000000006e-06 2024-09-13T06:41:44.378 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.378 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.378 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:44.378 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669479+0000", 2024-09-13T06:41:44.378 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8540000000000002e-06 2024-09-13T06:41:44.378 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.378 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.378 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:44.378 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.793137+0000", 2024-09-13T06:41:44.378 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.12365825699999999 2024-09-13T06:41:44.379 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.379 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.379 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:44.379 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.793181+0000", 2024-09-13T06:41:44.379 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.3773999999999998e-05 2024-09-13T06:41:44.379 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.379 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.379 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:44.379 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.793395+0000", 2024-09-13T06:41:44.379 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00021372399999999999 2024-09-13T06:41:44.379 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:44.379 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:44.379 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:44.379 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.380 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.380 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43268 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 520192~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:44.380 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.669484+0000", 2024-09-13T06:41:44.380 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 82.623325073999993, 2024-09-13T06:41:44.380 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.12441057899999999, 2024-09-13T06:41:44.380 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:44.380 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:44.380 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:44.380 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:44.380 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:44.380 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43268 2024-09-13T06:41:44.380 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.380 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:44.380 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.381 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:44.381 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669484+0000", 2024-09-13T06:41:44.381 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:44.381 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.381 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.381 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:44.381 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669484+0000", 2024-09-13T06:41:44.381 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:44.381 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.381 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.381 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:44.381 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669484+0000", 2024-09-13T06:41:44.381 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:44.381 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.381 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.382 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:44.382 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669486+0000", 2024-09-13T06:41:44.382 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6120000000000001e-06 2024-09-13T06:41:44.382 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.382 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.382 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:44.382 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669494+0000", 2024-09-13T06:41:44.382 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4819999999999997e-06 2024-09-13T06:41:44.382 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.382 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.382 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:44.382 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669497+0000", 2024-09-13T06:41:44.382 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9790000000000002e-06 2024-09-13T06:41:44.382 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.382 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.383 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:44.383 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.793559+0000", 2024-09-13T06:41:44.383 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.124062436 2024-09-13T06:41:44.383 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.383 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.383 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:44.383 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.793603+0000", 2024-09-13T06:41:44.383 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.3764999999999999e-05 2024-09-13T06:41:44.383 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.383 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.383 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:44.383 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.793895+0000", 2024-09-13T06:41:44.383 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00029168299999999999 2024-09-13T06:41:44.383 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:44.383 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:44.383 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:44.384 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:44.384 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:44.384 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:41:44.385 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-13T06:41:44.386 INFO:tasks.ceph.osd.6.smithi139.stderr:2024-09-13T06:41:44.382+0000 7fcd02c5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26385) UID: 0 2024-09-13T06:41:44.486 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:41:44.485+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:41:44.525 INFO:teuthology.orchestra.run.smithi081.stderr:noscrub is unset 2024-09-13T06:41:44.547 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:41:44.548 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-13T06:41:44.548 INFO:teuthology.orchestra.run.smithi081.stdout: "num_ops": 0 2024-09-13T06:41:44.548 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:41:44.562 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-13T06:41:44.610 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:41:44.609+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:41:44.687 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:41:44.685+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:41:44.708 INFO:teuthology.orchestra.run.smithi081.stdout:checking clone #24, image image_client.0-clone24 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent25 2024-09-13T06:41:44.735 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:41:44.736 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-13T06:41:44.736 INFO:teuthology.orchestra.run.smithi081.stdout: "complaint_time": 30, 2024-09-13T06:41:44.736 INFO:teuthology.orchestra.run.smithi081.stdout: "num_blocked_ops": 0 2024-09-13T06:41:44.736 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:41:44.752 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-13T06:41:44.794 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:41:44.793+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:41:44.890 INFO:tasks.ceph.osd.6.smithi139.stderr:2024-09-13T06:41:44.886+0000 7fcd02c5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26385) UID: 0 2024-09-13T06:41:44.932 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:41:44.932 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 20, 2024-09-13T06:41:44.932 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 600, 2024-09-13T06:41:44.932 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [ 2024-09-13T06:41:44.932 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.933 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:21979 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 14217216~4096 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:41:44.933 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.888811+0000", 2024-09-13T06:41:44.933 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 112.044183907, 2024-09-13T06:41:44.933 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049092969, 2024-09-13T06:41:44.933 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:44.933 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:44.933 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:44.933 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:44.933 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:44.933 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 21979 2024-09-13T06:41:44.933 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.933 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:44.934 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.934 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:44.934 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888811+0000", 2024-09-13T06:41:44.934 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:44.934 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.934 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.934 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:44.934 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888811+0000", 2024-09-13T06:41:44.934 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:44.934 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.934 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.934 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:44.934 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888811+0000", 2024-09-13T06:41:44.934 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:41:44.935 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.935 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.935 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:44.935 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888812+0000", 2024-09-13T06:41:44.935 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.204e-06 2024-09-13T06:41:44.935 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.935 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.935 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:44.935 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888815+0000", 2024-09-13T06:41:44.935 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9359999999999999e-06 2024-09-13T06:41:44.935 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.935 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.935 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:44.935 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888818+0000", 2024-09-13T06:41:44.936 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.7369999999999998e-06 2024-09-13T06:41:44.936 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.936 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.936 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:44.936 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.937663+0000", 2024-09-13T06:41:44.936 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.048844540999999998 2024-09-13T06:41:44.936 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.936 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.936 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:44.936 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.937709+0000", 2024-09-13T06:41:44.936 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6492999999999997e-05 2024-09-13T06:41:44.936 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.936 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.937 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:44.937 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.937904+0000", 2024-09-13T06:41:44.937 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00019526499999999999 2024-09-13T06:41:44.937 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:44.937 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:44.937 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:44.937 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.937 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.937 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:21980 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 14245888~4096 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:41:44.937 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.888820+0000", 2024-09-13T06:41:44.937 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 112.04417522999999, 2024-09-13T06:41:44.937 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049357080999999997, 2024-09-13T06:41:44.938 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:44.938 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:44.938 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:44.938 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:44.938 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:44.938 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 21980 2024-09-13T06:41:44.938 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.938 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:44.938 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.938 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:44.938 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888820+0000", 2024-09-13T06:41:44.938 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:44.938 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.939 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.939 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:44.939 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888820+0000", 2024-09-13T06:41:44.939 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:44.939 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.939 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.939 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:44.939 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888820+0000", 2024-09-13T06:41:44.939 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:41:44.939 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.939 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.939 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:44.939 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888821+0000", 2024-09-13T06:41:44.939 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.122e-06 2024-09-13T06:41:44.940 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.940 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.940 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:44.940 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888824+0000", 2024-09-13T06:41:44.940 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.0580000000000002e-06 2024-09-13T06:41:44.940 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.940 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.940 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:44.940 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888827+0000", 2024-09-13T06:41:44.940 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.666e-06 2024-09-13T06:41:44.940 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.940 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.940 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:44.941 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.937935+0000", 2024-09-13T06:41:44.941 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049108329999999999 2024-09-13T06:41:44.941 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.941 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.941 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:44.941 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.937985+0000", 2024-09-13T06:41:44.941 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9694000000000002e-05 2024-09-13T06:41:44.941 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.941 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.941 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:44.941 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.938177+0000", 2024-09-13T06:41:44.941 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00019241899999999999 2024-09-13T06:41:44.941 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:44.941 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:44.942 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:44.942 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.942 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.942 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:21984 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:snapdir [list-snaps] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:41:44.942 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.888829+0000", 2024-09-13T06:41:44.942 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 112.044166452, 2024-09-13T06:41:44.942 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049524545000000003, 2024-09-13T06:41:44.942 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:44.942 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:44.942 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:44.942 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:44.942 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:44.942 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 21984 2024-09-13T06:41:44.942 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.942 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:44.943 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.943 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:44.943 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888829+0000", 2024-09-13T06:41:44.943 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:44.943 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.943 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.943 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:44.943 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888829+0000", 2024-09-13T06:41:44.943 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:44.943 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.943 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.943 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:44.943 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888829+0000", 2024-09-13T06:41:44.943 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:41:44.943 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.944 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.944 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:44.944 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888830+0000", 2024-09-13T06:41:44.944 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2529999999999999e-06 2024-09-13T06:41:44.944 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.944 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.944 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:44.944 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888835+0000", 2024-09-13T06:41:44.944 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.4729999999999999e-06 2024-09-13T06:41:44.944 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.944 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.944 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:44.944 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888840+0000", 2024-09-13T06:41:44.944 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0159999999999999e-06 2024-09-13T06:41:44.945 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.945 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.945 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:44.945 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.938199+0000", 2024-09-13T06:41:44.945 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049358974999999999 2024-09-13T06:41:44.945 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.945 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.945 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:44.945 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.938268+0000", 2024-09-13T06:41:44.945 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.8876999999999998e-05 2024-09-13T06:41:44.945 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.945 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.945 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:44.945 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.938353+0000", 2024-09-13T06:41:44.946 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.5155999999999996e-05 2024-09-13T06:41:44.946 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:44.946 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:44.946 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:44.946 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.946 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.946 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:21985 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 12587008~4096 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:41:44.946 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.888858+0000", 2024-09-13T06:41:44.946 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 112.044137302, 2024-09-13T06:41:44.946 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049674347000000001, 2024-09-13T06:41:44.946 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:44.946 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:44.946 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:44.946 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:44.946 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:44.947 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 21985 2024-09-13T06:41:44.947 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.947 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:44.947 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.947 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:44.947 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888858+0000", 2024-09-13T06:41:44.947 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:44.947 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.947 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.947 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:44.947 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888858+0000", 2024-09-13T06:41:44.947 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:44.947 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.948 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.948 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:44.948 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888857+0000", 2024-09-13T06:41:44.948 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:44.948 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.948 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.948 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:44.948 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888860+0000", 2024-09-13T06:41:44.948 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4739999999999999e-06 2024-09-13T06:41:44.948 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.948 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.948 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:44.948 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888867+0000", 2024-09-13T06:41:44.949 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.7170000000000002e-06 2024-09-13T06:41:44.949 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.949 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.949 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:44.949 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888871+0000", 2024-09-13T06:41:44.949 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5120000000000002e-06 2024-09-13T06:41:44.949 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.949 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.949 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:44.949 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.938389+0000", 2024-09-13T06:41:44.949 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049517717000000003 2024-09-13T06:41:44.949 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.949 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.949 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:44.949 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.938449+0000", 2024-09-13T06:41:44.950 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0513999999999997e-05 2024-09-13T06:41:44.950 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.950 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.950 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:44.950 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.938532+0000", 2024-09-13T06:41:44.950 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.2936999999999996e-05 2024-09-13T06:41:44.950 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:44.950 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:44.950 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:44.950 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.950 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.950 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:21986 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 12615680~4096 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:41:44.950 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.888875+0000", 2024-09-13T06:41:44.951 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 112.04411978900001, 2024-09-13T06:41:44.951 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049881781, 2024-09-13T06:41:44.951 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:44.951 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:44.951 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:44.951 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:44.951 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:44.951 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 21986 2024-09-13T06:41:44.951 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.951 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:44.951 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.951 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:44.951 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888875+0000", 2024-09-13T06:41:44.952 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:44.952 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.952 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.952 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:44.952 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888875+0000", 2024-09-13T06:41:44.952 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:44.952 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.952 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.952 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:44.952 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888875+0000", 2024-09-13T06:41:44.952 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:44.952 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.952 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.952 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:44.953 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888880+0000", 2024-09-13T06:41:44.953 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7600000000000002e-06 2024-09-13T06:41:44.953 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.953 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.953 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:44.953 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888887+0000", 2024-09-13T06:41:44.953 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3950000000000003e-06 2024-09-13T06:41:44.953 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.953 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.953 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:44.953 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888892+0000", 2024-09-13T06:41:44.953 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0409999999999997e-06 2024-09-13T06:41:44.953 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.954 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.954 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:44.954 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.938568+0000", 2024-09-13T06:41:44.954 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049675267000000002 2024-09-13T06:41:44.954 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.954 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.954 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:44.954 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.938653+0000", 2024-09-13T06:41:44.954 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.5792999999999997e-05 2024-09-13T06:41:44.954 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.954 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.954 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:44.954 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.938757+0000", 2024-09-13T06:41:44.954 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00010387699999999999 2024-09-13T06:41:44.955 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:44.955 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:44.955 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:44.955 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.955 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.955 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:21987 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 12644352~4096 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:41:44.955 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.888899+0000", 2024-09-13T06:41:44.955 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 112.044096443, 2024-09-13T06:41:44.955 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.050094056999999997, 2024-09-13T06:41:44.955 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:44.955 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:44.955 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:44.955 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:44.955 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:44.956 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 21987 2024-09-13T06:41:44.956 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.956 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:44.956 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.956 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:44.956 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888899+0000", 2024-09-13T06:41:44.956 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:44.956 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.956 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.956 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:44.956 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888899+0000", 2024-09-13T06:41:44.956 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:44.956 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.956 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.956 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:44.957 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888899+0000", 2024-09-13T06:41:44.957 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:44.957 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.957 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.957 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:44.957 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888901+0000", 2024-09-13T06:41:44.957 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2539999999999999e-06 2024-09-13T06:41:44.957 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.957 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.957 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:44.957 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888907+0000", 2024-09-13T06:41:44.957 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9009999999999999e-06 2024-09-13T06:41:44.957 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.957 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.958 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:44.958 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888912+0000", 2024-09-13T06:41:44.958 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9840000000000001e-06 2024-09-13T06:41:44.958 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.958 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.958 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:44.958 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.938810+0000", 2024-09-13T06:41:44.958 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049898835000000002 2024-09-13T06:41:44.958 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.958 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.958 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:44.958 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.938890+0000", 2024-09-13T06:41:44.958 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.9215000000000006e-05 2024-09-13T06:41:44.958 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.958 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.958 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:44.959 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.938993+0000", 2024-09-13T06:41:44.959 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000103194 2024-09-13T06:41:44.959 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:44.959 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:44.959 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:44.959 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.959 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.959 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:21988 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 12673024~4096 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:41:44.959 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.888916+0000", 2024-09-13T06:41:44.959 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 112.044079427, 2024-09-13T06:41:44.959 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.050203036999999999, 2024-09-13T06:41:44.959 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:44.959 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:44.959 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:44.959 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:44.960 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:44.960 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 21988 2024-09-13T06:41:44.960 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.960 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:44.960 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.960 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:44.960 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888916+0000", 2024-09-13T06:41:44.960 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:44.960 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.960 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.961 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:44.961 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888916+0000", 2024-09-13T06:41:44.961 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:44.961 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.961 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.961 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:44.961 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888915+0000", 2024-09-13T06:41:44.961 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:44.961 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.961 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.961 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:44.962 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888918+0000", 2024-09-13T06:41:44.962 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1500000000000002e-06 2024-09-13T06:41:44.962 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.962 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.962 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:44.962 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888925+0000", 2024-09-13T06:41:44.962 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.9380000000000003e-06 2024-09-13T06:41:44.962 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.962 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.962 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:44.962 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888933+0000", 2024-09-13T06:41:44.962 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.0560000000000005e-06 2024-09-13T06:41:44.962 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.963 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.963 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:44.963 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.939026+0000", 2024-09-13T06:41:44.963 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.050093499999999999 2024-09-13T06:41:44.963 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.963 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.963 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:44.963 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.939068+0000", 2024-09-13T06:41:44.963 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.1705999999999997e-05 2024-09-13T06:41:44.963 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.963 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.963 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:44.963 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.939119+0000", 2024-09-13T06:41:44.963 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.1048999999999999e-05 2024-09-13T06:41:44.964 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:44.964 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:44.964 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:44.964 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.964 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.964 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:21989 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 12701696~4096 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:41:44.964 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.888938+0000", 2024-09-13T06:41:44.964 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 112.0440571, 2024-09-13T06:41:44.964 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.050294393999999999, 2024-09-13T06:41:44.964 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:44.964 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:44.964 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:44.964 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:44.964 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:44.965 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 21989 2024-09-13T06:41:44.965 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.965 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:44.965 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.965 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:44.965 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888938+0000", 2024-09-13T06:41:44.965 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:44.965 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.965 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.965 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:44.965 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888938+0000", 2024-09-13T06:41:44.965 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:44.965 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.965 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.965 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:44.966 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888938+0000", 2024-09-13T06:41:44.966 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:44.966 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.966 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.966 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:44.966 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888940+0000", 2024-09-13T06:41:44.966 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5330000000000001e-06 2024-09-13T06:41:44.966 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.966 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.966 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:44.966 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888947+0000", 2024-09-13T06:41:44.966 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.2389999999999999e-06 2024-09-13T06:41:44.966 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.966 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.967 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:44.967 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888952+0000", 2024-09-13T06:41:44.967 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.5720000000000002e-06 2024-09-13T06:41:44.967 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.967 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.967 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:44.967 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.939141+0000", 2024-09-13T06:41:44.967 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.050188903999999999 2024-09-13T06:41:44.967 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.967 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.967 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:44.967 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.939182+0000", 2024-09-13T06:41:44.967 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.0926000000000001e-05 2024-09-13T06:41:44.967 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.967 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.967 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:44.968 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.939233+0000", 2024-09-13T06:41:44.968 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0532999999999999e-05 2024-09-13T06:41:44.968 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:44.968 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:44.968 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:44.968 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.968 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.968 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:22007 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 13217792~4096 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:41:44.968 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.892771+0000", 2024-09-13T06:41:44.968 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 112.040223994, 2024-09-13T06:41:44.968 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049090024000000003, 2024-09-13T06:41:44.968 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:44.969 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:44.969 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:44.969 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:44.969 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:44.969 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 22007 2024-09-13T06:41:44.969 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.969 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:44.969 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.969 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:44.969 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892771+0000", 2024-09-13T06:41:44.969 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:44.969 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.969 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.970 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:44.970 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892771+0000", 2024-09-13T06:41:44.970 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:44.970 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.970 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.970 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:44.970 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892771+0000", 2024-09-13T06:41:44.970 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:41:44.970 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.970 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.970 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:44.970 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892772+0000", 2024-09-13T06:41:44.970 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.184e-06 2024-09-13T06:41:44.971 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.971 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.971 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:44.971 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892775+0000", 2024-09-13T06:41:44.971 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9179999999999998e-06 2024-09-13T06:41:44.971 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.971 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.971 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:44.971 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892778+0000", 2024-09-13T06:41:44.971 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4990000000000001e-06 2024-09-13T06:41:44.971 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.971 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.971 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:44.971 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.941760+0000", 2024-09-13T06:41:44.972 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.048982070000000003 2024-09-13T06:41:44.972 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.972 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.972 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:44.972 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.941808+0000", 2024-09-13T06:41:44.972 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.8278000000000001e-05 2024-09-13T06:41:44.972 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.972 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.972 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:44.972 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.941861+0000", 2024-09-13T06:41:44.972 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3284e-05 2024-09-13T06:41:44.972 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:44.972 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:44.973 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:44.973 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.973 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.973 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:22008 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 13246464~4096 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:41:44.973 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.892780+0000", 2024-09-13T06:41:44.973 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 112.04021533700001, 2024-09-13T06:41:44.973 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049200477999999999, 2024-09-13T06:41:44.973 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:44.973 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:44.973 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:44.974 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:44.974 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:44.974 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 22008 2024-09-13T06:41:44.974 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.974 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:44.974 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.974 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:44.974 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892780+0000", 2024-09-13T06:41:44.974 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:44.974 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.974 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.974 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:44.974 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892780+0000", 2024-09-13T06:41:44.975 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:44.975 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.975 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.975 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:44.975 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892780+0000", 2024-09-13T06:41:44.975 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:41:44.975 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.975 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.975 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:44.975 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892781+0000", 2024-09-13T06:41:44.975 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.083e-06 2024-09-13T06:41:44.975 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.975 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.975 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:44.976 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892784+0000", 2024-09-13T06:41:44.976 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.926e-06 2024-09-13T06:41:44.976 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.976 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.976 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:44.976 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892786+0000", 2024-09-13T06:41:44.976 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4490000000000002e-06 2024-09-13T06:41:44.976 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.976 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.976 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:44.976 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.941888+0000", 2024-09-13T06:41:44.976 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049102290999999999 2024-09-13T06:41:44.976 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.976 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.977 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:44.977 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.941929+0000", 2024-09-13T06:41:44.977 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.0541999999999999e-05 2024-09-13T06:41:44.977 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.977 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.977 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:44.977 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.941980+0000", 2024-09-13T06:41:44.977 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.1391999999999999e-05 2024-09-13T06:41:44.977 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:44.977 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:44.977 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:44.977 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.978 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.978 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:22009 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 13275136~4096 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:41:44.978 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.892788+0000", 2024-09-13T06:41:44.978 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 112.040206853, 2024-09-13T06:41:44.978 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049311926999999998, 2024-09-13T06:41:44.978 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:44.978 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:44.978 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:44.978 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:44.978 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:44.978 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 22009 2024-09-13T06:41:44.978 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.978 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:44.979 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.979 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:44.979 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892788+0000", 2024-09-13T06:41:44.979 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:44.979 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.979 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.979 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:44.979 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892788+0000", 2024-09-13T06:41:44.979 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:44.979 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.979 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.979 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:44.979 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892788+0000", 2024-09-13T06:41:44.980 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:41:44.980 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.980 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.980 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:44.980 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892789+0000", 2024-09-13T06:41:44.980 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1850000000000001e-06 2024-09-13T06:41:44.980 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.980 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.980 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:44.980 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892793+0000", 2024-09-13T06:41:44.980 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.9099999999999998e-06 2024-09-13T06:41:44.980 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.980 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.981 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:44.981 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892798+0000", 2024-09-13T06:41:44.981 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5070000000000002e-06 2024-09-13T06:41:44.981 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.981 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.981 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:44.981 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.942007+0000", 2024-09-13T06:41:44.981 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049208904999999997 2024-09-13T06:41:44.981 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.981 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.981 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:44.981 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.942049+0000", 2024-09-13T06:41:44.981 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.1922000000000003e-05 2024-09-13T06:41:44.982 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.982 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.982 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:44.982 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.942100+0000", 2024-09-13T06:41:44.982 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.1736000000000001e-05 2024-09-13T06:41:44.982 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:44.982 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:44.982 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:44.982 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.982 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.982 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:22010 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 13303808~4096 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:41:44.982 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.892817+0000", 2024-09-13T06:41:44.982 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 112.040178657, 2024-09-13T06:41:44.982 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049466149000000001, 2024-09-13T06:41:44.983 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:44.983 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:44.983 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:44.983 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:44.983 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:44.983 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 22010 2024-09-13T06:41:44.983 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.983 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:44.983 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.983 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:44.983 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892817+0000", 2024-09-13T06:41:44.983 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:44.983 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.983 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.984 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:44.984 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892817+0000", 2024-09-13T06:41:44.984 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:44.984 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.984 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.984 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:44.984 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892816+0000", 2024-09-13T06:41:44.984 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:44.984 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.984 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.984 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:44.984 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892821+0000", 2024-09-13T06:41:44.984 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9459999999999997e-06 2024-09-13T06:41:44.984 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.985 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.985 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:44.985 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892828+0000", 2024-09-13T06:41:44.985 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.6780000000000003e-06 2024-09-13T06:41:44.985 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.985 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.985 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:44.985 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892833+0000", 2024-09-13T06:41:44.985 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.8389999999999997e-06 2024-09-13T06:41:44.985 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.985 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.985 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:44.985 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.942127+0000", 2024-09-13T06:41:44.985 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049294163000000002 2024-09-13T06:41:44.986 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.986 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.986 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:44.986 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.942186+0000", 2024-09-13T06:41:44.986 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9335e-05 2024-09-13T06:41:44.986 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.986 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.986 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:44.986 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.942283+0000", 2024-09-13T06:41:44.986 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.6699000000000004e-05 2024-09-13T06:41:44.986 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:44.986 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:44.986 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:44.986 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.986 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.987 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:22011 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 13332480~4096 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:41:44.987 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.892838+0000", 2024-09-13T06:41:44.987 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 112.04015697, 2024-09-13T06:41:44.987 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049589214, 2024-09-13T06:41:44.987 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:44.987 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:44.987 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:44.987 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:44.987 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:44.987 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 22011 2024-09-13T06:41:44.987 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.987 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:44.987 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.987 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:44.987 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892838+0000", 2024-09-13T06:41:44.988 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:44.988 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.988 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.988 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:44.988 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892838+0000", 2024-09-13T06:41:44.988 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:44.988 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.988 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.988 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:44.988 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892838+0000", 2024-09-13T06:41:44.988 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:44.988 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.988 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.989 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:44.989 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892840+0000", 2024-09-13T06:41:44.989 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.136e-06 2024-09-13T06:41:44.989 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.989 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.989 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:44.989 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892852+0000", 2024-09-13T06:41:44.989 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2122e-05 2024-09-13T06:41:44.989 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.989 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.989 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:44.989 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892862+0000", 2024-09-13T06:41:44.989 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.7049999999999994e-06 2024-09-13T06:41:44.989 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.989 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.990 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:44.990 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.942319+0000", 2024-09-13T06:41:44.990 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049456623999999998 2024-09-13T06:41:44.990 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.990 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.990 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:44.990 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.942363+0000", 2024-09-13T06:41:44.990 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4759000000000003e-05 2024-09-13T06:41:44.990 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.990 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.990 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:44.990 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.942428+0000", 2024-09-13T06:41:44.990 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.4221999999999996e-05 2024-09-13T06:41:44.990 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:44.990 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:44.991 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:44.991 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.991 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.991 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:22033 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 13963264~4096 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:41:44.991 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.896824+0000", 2024-09-13T06:41:44.991 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 112.03617107700001, 2024-09-13T06:41:44.991 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049051957, 2024-09-13T06:41:44.991 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:44.991 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:44.991 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:44.991 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:44.991 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:44.991 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 22033 2024-09-13T06:41:44.991 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.991 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:44.992 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.992 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:44.992 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.896824+0000", 2024-09-13T06:41:44.992 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:44.992 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.992 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.992 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:44.992 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.896824+0000", 2024-09-13T06:41:44.992 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:44.992 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.992 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.992 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:44.992 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.896824+0000", 2024-09-13T06:41:44.992 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:44.992 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.993 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.993 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:44.993 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.896826+0000", 2024-09-13T06:41:44.993 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1900000000000002e-06 2024-09-13T06:41:44.993 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.993 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.993 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:44.993 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.896832+0000", 2024-09-13T06:41:44.993 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.2689999999999996e-06 2024-09-13T06:41:44.993 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.993 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.993 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:44.993 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.896840+0000", 2024-09-13T06:41:44.993 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3289999999999996e-06 2024-09-13T06:41:44.994 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.994 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.994 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:44.994 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.945777+0000", 2024-09-13T06:41:44.994 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.048937188 2024-09-13T06:41:44.994 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.994 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.994 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:44.994 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.945822+0000", 2024-09-13T06:41:44.994 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4780999999999997e-05 2024-09-13T06:41:44.994 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.994 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.994 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:44.994 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.945876+0000", 2024-09-13T06:41:44.994 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.4542000000000001e-05 2024-09-13T06:41:44.995 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:44.995 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:44.995 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:44.995 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.995 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.995 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:22338 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 13611008~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:41:44.995 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.951070+0000", 2024-09-13T06:41:44.995 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 111.981925449, 2024-09-13T06:41:44.995 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049135817999999998, 2024-09-13T06:41:44.995 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:44.995 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:44.995 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:44.995 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:44.995 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:44.995 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 22338 2024-09-13T06:41:44.996 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.996 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:44.996 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.996 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:44.996 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951070+0000", 2024-09-13T06:41:44.996 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:44.996 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.996 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.996 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:44.996 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951070+0000", 2024-09-13T06:41:44.996 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:44.996 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.996 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.997 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:44.997 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951069+0000", 2024-09-13T06:41:44.997 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:44.997 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.997 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.997 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:44.997 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951072+0000", 2024-09-13T06:41:44.997 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5909999999999998e-06 2024-09-13T06:41:44.997 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.997 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.997 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:44.997 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951078+0000", 2024-09-13T06:41:44.997 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.4450000000000001e-06 2024-09-13T06:41:44.997 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.997 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.998 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:44.998 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951083+0000", 2024-09-13T06:41:44.998 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7790000000000003e-06 2024-09-13T06:41:44.998 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.998 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.998 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:44.998 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:53.000020+0000", 2024-09-13T06:41:44.998 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.048936999000000002 2024-09-13T06:41:44.998 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.998 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.998 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:44.998 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:53.000106+0000", 2024-09-13T06:41:44.998 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.5532999999999996e-05 2024-09-13T06:41:44.998 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.998 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.999 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:44.999 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:53.000206+0000", 2024-09-13T06:41:44.999 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.9852999999999994e-05 2024-09-13T06:41:44.999 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:44.999 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:44.999 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:44.999 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:44.999 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:44.999 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:22339 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 13639680~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:41:44.999 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.951088+0000", 2024-09-13T06:41:44.999 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 111.98190775099999, 2024-09-13T06:41:44.999 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049238202000000002, 2024-09-13T06:41:44.999 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:44.999 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:44.999 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:45.000 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:45.000 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:45.000 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 22339 2024-09-13T06:41:45.000 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:45.000 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:45.000 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:45.000 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:45.000 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951088+0000", 2024-09-13T06:41:45.000 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:45.000 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:45.000 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:45.000 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:45.001 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951088+0000", 2024-09-13T06:41:45.001 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:45.001 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:45.001 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:45.001 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:45.001 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951087+0000", 2024-09-13T06:41:45.001 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:45.001 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:45.001 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:45.001 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:45.001 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951089+0000", 2024-09-13T06:41:45.001 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.153e-06 2024-09-13T06:41:45.001 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:45.001 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:45.001 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:45.002 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951093+0000", 2024-09-13T06:41:45.002 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.7120000000000002e-06 2024-09-13T06:41:45.002 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:45.002 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:45.002 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:45.002 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951096+0000", 2024-09-13T06:41:45.002 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.0570000000000001e-06 2024-09-13T06:41:45.002 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:45.002 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:45.002 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:45.002 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:53.000220+0000", 2024-09-13T06:41:45.002 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049123989 2024-09-13T06:41:45.002 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:45.002 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:45.002 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:45.003 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:53.000271+0000", 2024-09-13T06:41:45.003 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.062e-05 2024-09-13T06:41:45.003 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:45.003 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:45.003 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:45.003 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:53.000326+0000", 2024-09-13T06:41:45.003 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.5121000000000003e-05 2024-09-13T06:41:45.003 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:45.003 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:45.003 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:45.003 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:45.003 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:45.003 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:22340 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 13668352~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:41:45.004 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.951200+0000", 2024-09-13T06:41:45.004 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 111.981794862, 2024-09-13T06:41:45.004 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049352350000000003, 2024-09-13T06:41:45.004 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:45.004 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:45.004 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:45.004 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:45.004 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:45.004 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 22340 2024-09-13T06:41:45.004 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:45.004 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:45.004 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:45.004 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:45.005 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951200+0000", 2024-09-13T06:41:45.005 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:45.005 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:45.005 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:45.005 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:45.005 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951200+0000", 2024-09-13T06:41:45.005 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:45.005 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:45.005 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:45.005 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:45.005 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951098+0000", 2024-09-13T06:41:45.005 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.999898 2024-09-13T06:41:45.005 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:45.005 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:45.006 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:45.006 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951204+0000", 2024-09-13T06:41:45.006 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000105398 2024-09-13T06:41:45.006 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:45.006 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:45.006 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:45.006 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951211+0000", 2024-09-13T06:41:45.006 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.43e-06 2024-09-13T06:41:45.006 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:45.006 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:45.006 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:45.006 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951216+0000", 2024-09-13T06:41:45.006 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2800000000000003e-06 2024-09-13T06:41:45.006 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:45.006 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:45.007 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:45.007 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:53.000358+0000", 2024-09-13T06:41:45.007 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049142036 2024-09-13T06:41:45.007 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:45.007 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:45.007 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:45.007 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:53.000443+0000", 2024-09-13T06:41:45.007 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.4710999999999996e-05 2024-09-13T06:41:45.007 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:45.007 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:45.007 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:45.007 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:53.000553+0000", 2024-09-13T06:41:45.007 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000109622 2024-09-13T06:41:45.007 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:45.007 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:45.008 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:45.008 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:45.008 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:45.008 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:22348 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 13897728~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:41:45.008 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.952783+0000", 2024-09-13T06:41:45.008 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 111.98021207399999, 2024-09-13T06:41:45.008 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049120832000000003, 2024-09-13T06:41:45.008 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:45.008 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:45.008 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:45.008 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:45.008 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:45.008 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 22348 2024-09-13T06:41:45.009 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:45.009 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:45.009 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:45.009 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:45.009 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.952783+0000", 2024-09-13T06:41:45.009 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:45.009 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:45.009 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:45.009 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:45.009 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.952783+0000", 2024-09-13T06:41:45.009 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:45.009 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:45.009 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:45.009 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:45.010 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.952783+0000", 2024-09-13T06:41:45.010 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:45.010 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:45.010 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:45.010 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:45.010 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.952785+0000", 2024-09-13T06:41:45.010 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4980000000000001e-06 2024-09-13T06:41:45.010 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:45.010 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:45.010 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:45.010 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.952799+0000", 2024-09-13T06:41:45.010 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3825000000000001e-05 2024-09-13T06:41:45.010 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:45.011 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:45.011 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:45.011 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.952809+0000", 2024-09-13T06:41:45.011 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0043e-05 2024-09-13T06:41:45.011 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:45.011 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:45.011 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:45.011 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:53.001723+0000", 2024-09-13T06:41:45.011 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.048914065 2024-09-13T06:41:45.011 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:45.011 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:45.011 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:45.011 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:53.001807+0000", 2024-09-13T06:41:45.011 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.3776000000000006e-05 2024-09-13T06:41:45.012 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:45.012 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:45.012 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:45.012 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:53.001904+0000", 2024-09-13T06:41:45.012 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.7004999999999997e-05 2024-09-13T06:41:45.012 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:45.012 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:45.012 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:45.012 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:45.012 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:45.012 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:69045 3.0 3:05ea3821:::rbd_data.1121867cc19b.0000000000000000:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109)", 2024-09-13T06:41:45.012 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:41:03.637760+0000", 2024-09-13T06:41:45.012 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 41.295235316000003, 2024-09-13T06:41:45.013 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.052276712000000003, 2024-09-13T06:41:45.013 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:45.013 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:41:45.013 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:45.013 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:45.013 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:45.013 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 69045 2024-09-13T06:41:45.013 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:45.013 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:45.013 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:45.013 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:45.013 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:03.637760+0000", 2024-09-13T06:41:45.014 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:45.014 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:45.014 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:45.014 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:45.014 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:03.637760+0000", 2024-09-13T06:41:45.014 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:45.014 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:45.014 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:45.014 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:45.014 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:03.637758+0000", 2024-09-13T06:41:45.014 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999981 2024-09-13T06:41:45.014 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:45.014 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:45.014 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:45.015 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:03.637770+0000", 2024-09-13T06:41:45.015 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1533e-05 2024-09-13T06:41:45.015 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:45.015 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:45.015 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:45.015 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:03.637794+0000", 2024-09-13T06:41:45.015 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4243000000000002e-05 2024-09-13T06:41:45.015 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:45.015 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:45.015 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:45.015 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:03.637806+0000", 2024-09-13T06:41:45.015 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2033e-05 2024-09-13T06:41:45.015 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:45.015 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:45.016 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:45.016 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:03.637891+0000", 2024-09-13T06:41:45.016 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.5358000000000005e-05 2024-09-13T06:41:45.016 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:45.016 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:45.016 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:45.016 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:03.638042+0000", 2024-09-13T06:41:45.016 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000151073 2024-09-13T06:41:45.016 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:45.016 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:45.016 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 2", 2024-09-13T06:41:45.016 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:03.647124+0000", 2024-09-13T06:41:45.016 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0090821670000000004 2024-09-13T06:41:45.016 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:45.017 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:45.017 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:41:45.017 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:03.689849+0000", 2024-09-13T06:41:45.017 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.042724445999999999 2024-09-13T06:41:45.017 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:45.017 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:45.017 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-09-13T06:41:45.017 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:03.689871+0000", 2024-09-13T06:41:45.017 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1778999999999999e-05 2024-09-13T06:41:45.017 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:45.017 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:45.017 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:41:45.017 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:03.689965+0000", 2024-09-13T06:41:45.017 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.4312000000000001e-05 2024-09-13T06:41:45.017 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:45.018 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:45.018 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:45.018 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:03.690037+0000", 2024-09-13T06:41:45.018 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.1687999999999995e-05 2024-09-13T06:41:45.018 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:45.018 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:45.018 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:45.018 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:45.018 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:45.018 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:90987 3.6 3:6263dd97:::rbd_object_map.11212443ae03.0000000000000049:head [call] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-13T06:41:45.018 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:41:35.460333+0000", 2024-09-13T06:41:45.018 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 9.4726619289999991, 2024-09-13T06:41:45.018 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0001633640000001, 2024-09-13T06:41:45.018 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:45.019 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:45.019 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:45.019 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:45.019 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:45.019 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 90987 2024-09-13T06:41:45.019 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:45.019 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:45.019 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:45.019 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:45.019 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:35.460333+0000", 2024-09-13T06:41:45.019 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:45.019 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:45.019 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:45.019 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:45.019 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:35.460333+0000", 2024-09-13T06:41:45.020 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:45.020 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:45.020 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:45.020 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:45.020 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:35.460330+0000", 2024-09-13T06:41:45.020 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999971 2024-09-13T06:41:45.020 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:45.020 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:45.020 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:45.020 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:35.460343+0000", 2024-09-13T06:41:45.020 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2695e-05 2024-09-13T06:41:45.020 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:45.020 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:45.020 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:45.021 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:35.460365+0000", 2024-09-13T06:41:45.021 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2473999999999999e-05 2024-09-13T06:41:45.021 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:45.021 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:45.021 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:45.021 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:35.460376+0000", 2024-09-13T06:41:45.021 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0383999999999999e-05 2024-09-13T06:41:45.021 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:45.021 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:45.021 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:45.021 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:35.460435+0000", 2024-09-13T06:41:45.021 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8650000000000003e-05 2024-09-13T06:41:45.021 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:45.021 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:45.022 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:41:45.022 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:35.460444+0000", 2024-09-13T06:41:45.022 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.0380000000000005e-06 2024-09-13T06:41:45.022 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:45.022 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:45.022 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:45.022 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:36.459433+0000", 2024-09-13T06:41:45.022 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.99898895799999998 2024-09-13T06:41:45.022 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:45.022 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:45.022 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:45.022 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:36.459622+0000", 2024-09-13T06:41:45.022 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00018940299999999999 2024-09-13T06:41:45.022 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:45.022 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:45.023 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:45.023 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:36.460497+0000", 2024-09-13T06:41:45.023 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00087481199999999999 2024-09-13T06:41:45.023 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:45.023 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:45.023 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:45.023 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:45.023 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:45.023 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:41:45.025 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-13T06:41:45.025 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:41:45.021+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:41:45.051 INFO:teuthology.orchestra.run.smithi081.stdout:3901 punch from 0xd30ef1e to 0xd3164c9, (0x75ab bytes) 2024-09-13T06:41:45.057 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:41:45.057 INFO:teuthology.orchestra.run.smithi081.stdout:3903 punch from 0x14be9e5 to 0x14ce5df, (0xfbfa bytes) 2024-09-13T06:41:45.057 INFO:teuthology.orchestra.run.smithi081.stdout:3904 write 0x921052c thru 0x921129f (0xd74 bytes) 2024-09-13T06:41:45.058 INFO:teuthology.orchestra.run.smithi081.stdout:3905 read 0x3d88259 thru 0x3d94c07 (0xc9af bytes) 2024-09-13T06:41:45.059 INFO:teuthology.orchestra.run.smithi081.stdout:3906 punch from 0x780c84d to 0x7819972, (0xd125 bytes) 2024-09-13T06:41:45.059 INFO:teuthology.orchestra.run.smithi081.stdout:3907 punch from 0x202ce53 to 0x2032282, (0x542f bytes) 2024-09-13T06:41:45.065 INFO:teuthology.orchestra.run.smithi081.stdout:3908 writesame 0xecb5aaa thru 0xecbc403 data_size 0x1d(0x695a bytes) 2024-09-13T06:41:45.068 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:41:45.068 INFO:teuthology.orchestra.run.smithi081.stdout:3911 write 0xa633f34 thru 0xa643bc0 (0xfc8d bytes) 2024-09-13T06:41:45.087 INFO:teuthology.orchestra.run.smithi081.stdout:3912 trunc from 0xecbc404 to 0x240d49a 2024-09-13T06:41:45.125 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:41:45.121+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:41:45.128 INFO:teuthology.orchestra.run.smithi081.stdout:3915 write 0x24552cf thru 0x2463f8c (0xecbe bytes) 2024-09-13T06:41:45.129 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:41:45.147 INFO:teuthology.orchestra.run.smithi081.stdout:3919 writesame 0xb202932 thru 0xb20dec1 data_size 0x1c(0xb590 bytes) 2024-09-13T06:41:45.158 INFO:teuthology.orchestra.run.smithi081.stdout:3921 writesame 0xe62c7ee thru 0xe635e60 data_size 0x1(0x9673 bytes) 2024-09-13T06:41:45.158 INFO:teuthology.orchestra.run.smithi081.stdout:3923 read 0x169845f thru 0x169914e (0xcf0 bytes) 2024-09-13T06:41:45.158 INFO:teuthology.orchestra.run.smithi081.stdout:3924 write 0x7f6932e thru 0x7f6ce79 (0x3b4c bytes) 2024-09-13T06:41:45.165 INFO:teuthology.orchestra.run.smithi081.stdout:3925 trunc from 0xe635e61 to 0xc1eb317 2024-09-13T06:41:45.173 INFO:teuthology.orchestra.run.smithi081.stdout:3926 read 0x2a15c14 thru 0x2a21437 (0xb824 bytes) 2024-09-13T06:41:45.174 INFO:teuthology.orchestra.run.smithi081.stdout:3928 read 0x77605de thru 0x7765ce4 (0x5707 bytes) 2024-09-13T06:41:45.178 INFO:teuthology.orchestra.run.smithi081.stdout:3929 trunc from 0xc1eb317 to 0xe7ab1f4 2024-09-13T06:41:45.181 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:41:45.181 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-13T06:41:45.181 INFO:teuthology.orchestra.run.smithi081.stdout: "num_ops": 0 2024-09-13T06:41:45.181 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:41:45.185 INFO:teuthology.orchestra.run.smithi081.stdout:3931 write 0x6a3bbf1 thru 0x6a43c1e (0x802e bytes) 2024-09-13T06:41:45.188 INFO:teuthology.orchestra.run.smithi081.stdout:3933 punch from 0xd6f7a53 to 0xd6fc9c9, (0x4f76 bytes) 2024-09-13T06:41:45.188 INFO:teuthology.orchestra.run.smithi081.stdout:3934 write 0x8de1d6a thru 0x8de3c35 (0x1ecc bytes) 2024-09-13T06:41:45.192 INFO:teuthology.orchestra.run.smithi081.stdout:3935 punch from 0x9b007fb to 0x9b07761, (0x6f66 bytes) 2024-09-13T06:41:45.192 INFO:teuthology.orchestra.run.smithi081.stdout:3936 writesame 0xbd6117e thru 0xbd6ac16 data_size 0x1(0x9a99 bytes) 2024-09-13T06:41:45.195 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-13T06:41:45.225 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:41:45.222+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:41:45.246 INFO:teuthology.orchestra.run.smithi081.stdout:3937 read 0xc5d3a93 thru 0xc5e0123 (0xc691 bytes) 2024-09-13T06:41:45.246 INFO:teuthology.orchestra.run.smithi081.stdout:3938 writesame 0xc3538bb thru 0xc356dfe data_size 0xe(0x3544 bytes) 2024-09-13T06:41:45.253 INFO:teuthology.orchestra.run.smithi081.stdout:3939 punch from 0xaf8c52a to 0xaf95e30, (0x9906 bytes) 2024-09-13T06:41:45.254 INFO:teuthology.orchestra.run.smithi081.stdout:3940 write 0x87dcc0d thru 0x87e0470 (0x3864 bytes) 2024-09-13T06:41:45.259 INFO:teuthology.orchestra.run.smithi081.stdout:3941 writesame 0x25ad50c thru 0x25bc4a7 data_size 0xa(0xef9c bytes) 2024-09-13T06:41:45.268 INFO:teuthology.orchestra.run.smithi081.stdout:3942 read 0x571c6f8 thru 0x571f47f (0x2d88 bytes) 2024-09-13T06:41:45.269 INFO:teuthology.orchestra.run.smithi081.stdout:3943 punch from 0x6417212 to 0x641d10a, (0x5ef8 bytes) 2024-09-13T06:41:45.276 INFO:teuthology.orchestra.run.smithi081.stdout:3944 trunc from 0xe7ab1f4 to 0xa014f11 2024-09-13T06:41:45.302 INFO:teuthology.orchestra.run.smithi081.stdout:3945 write 0xe4ee85e thru 0xe4fb7d9 (0xcf7c bytes) 2024-09-13T06:41:45.307 INFO:teuthology.orchestra.run.smithi081.stdout:3947 read 0x83c8a02 thru 0x83d5a37 (0xd036 bytes) 2024-09-13T06:41:45.307 INFO:teuthology.orchestra.run.smithi081.stdout:3948 punch from 0x38ca90a to 0x38cba7c, (0x1172 bytes) 2024-09-13T06:41:45.307 INFO:teuthology.orchestra.run.smithi081.stdout:3950 write 0xcf1313a thru 0xcf1e2ed (0xb1b4 bytes) 2024-09-13T06:41:45.310 INFO:teuthology.orchestra.run.smithi081.stdout:3951 punch from 0x4898d53 to 0x489bef5, (0x31a2 bytes) 2024-09-13T06:41:45.310 INFO:teuthology.orchestra.run.smithi081.stdout:3952 write 0x1caf1a8 thru 0x1cb0a0d (0x1866 bytes) 2024-09-13T06:41:45.312 INFO:teuthology.orchestra.run.smithi081.stdout:3953 writesame 0x2fd273c thru 0x2fd5891 data_size 0xf(0x3156 bytes) 2024-09-13T06:41:45.317 INFO:teuthology.orchestra.run.smithi081.stdout:3954 punch from 0x6e6e1e4 to 0x6e71ebf, (0x3cdb bytes) 2024-09-13T06:41:45.317 INFO:teuthology.orchestra.run.smithi081.stdout:3955 read 0x2bace8d thru 0x2bb0ab3 (0x3c27 bytes) 2024-09-13T06:41:45.317 INFO:teuthology.orchestra.run.smithi081.stdout:3956 write 0x3bdf55a thru 0x3bea528 (0xafcf bytes) 2024-09-13T06:41:45.320 INFO:teuthology.orchestra.run.smithi081.stdout:3957 writesame 0x79cfda5 thru 0x79dedd0 data_size 0x26(0xf02c bytes) 2024-09-13T06:41:45.325 INFO:teuthology.orchestra.run.smithi081.stdout:3958 write 0x69aad23 thru 0x69af371 (0x464f bytes) 2024-09-13T06:41:45.326 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:41:45.322+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:41:45.327 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:41:45.327 INFO:teuthology.orchestra.run.smithi081.stdout:3960 write 0x872caf thru 0x875ea2 (0x31f4 bytes) 2024-09-13T06:41:45.330 INFO:teuthology.orchestra.run.smithi081.stdout:3964 writesame 0x2a6c65e thru 0x2a72594 data_size 0x5(0x5f37 bytes) 2024-09-13T06:41:45.334 INFO:teuthology.orchestra.run.smithi081.stdout:3965 writesame 0x81b7011 thru 0x81be81e data_size 0x16(0x780e bytes) 2024-09-13T06:41:45.341 INFO:teuthology.orchestra.run.smithi081.stdout:3966 writesame 0x11e1cd8 thru 0x11e628f data_size 0x17(0x45b8 bytes) 2024-09-13T06:41:45.345 INFO:teuthology.orchestra.run.smithi081.stdout:3967 write 0x99588a2 thru 0x995f522 (0x6c81 bytes) 2024-09-13T06:41:45.353 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:41:45.353 INFO:teuthology.orchestra.run.smithi081.stdout:3971 read 0xcce8888 thru 0xccf6f62 (0xe6db bytes) 2024-09-13T06:41:45.353 INFO:teuthology.orchestra.run.smithi081.stdout:3973 punch from 0x840e33c to 0x8412da0, (0x4a64 bytes) 2024-09-13T06:41:45.353 INFO:teuthology.orchestra.run.smithi081.stdout:3974 read 0x8137b9f thru 0x813e312 (0x6774 bytes) 2024-09-13T06:41:45.353 INFO:teuthology.orchestra.run.smithi081.stdout:3976 write 0xd2050d5 thru 0xd209881 (0x47ad bytes) 2024-09-13T06:41:45.354 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:41:45.355 INFO:teuthology.orchestra.run.smithi081.stdout:3978 writesame 0x83988ba thru 0x83a860c data_size 0x1(0xfd53 bytes) 2024-09-13T06:41:45.368 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:41:45.368 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-13T06:41:45.368 INFO:teuthology.orchestra.run.smithi081.stdout: "complaint_time": 30, 2024-09-13T06:41:45.368 INFO:teuthology.orchestra.run.smithi081.stdout: "num_blocked_ops": 0 2024-09-13T06:41:45.368 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:41:45.383 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-13T06:41:45.402 INFO:teuthology.orchestra.run.smithi081.stdout:3979 writesame 0x940649d thru 0x940fddd data_size 0x1(0x9941 bytes) 2024-09-13T06:41:45.427 INFO:tasks.ceph.osd.6.smithi139.stderr:2024-09-13T06:41:45.422+0000 7fcd02c5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26385) UID: 0 2024-09-13T06:41:45.446 INFO:teuthology.orchestra.run.smithi081.stdout:3980 read 0xbfc3745 thru 0xbfd2f23 (0xf7df bytes) 2024-09-13T06:41:45.446 INFO:teuthology.orchestra.run.smithi081.stdout:3981 write 0xe2f8fe7 thru 0xe3055e9 (0xc603 bytes) 2024-09-13T06:41:45.452 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:41:45.452 INFO:teuthology.orchestra.run.smithi081.stdout:3983 write 0x161f263 thru 0x162bccb (0xca69 bytes) 2024-09-13T06:41:45.467 INFO:teuthology.orchestra.run.smithi081.stdout:3984 trunc from 0xe4fb7da to 0x8c948da 2024-09-13T06:41:45.483 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:41:45.483 INFO:teuthology.orchestra.run.smithi081.stdout:3986 write 0x1f58ee6 thru 0x1f62860 (0x997b bytes) 2024-09-13T06:41:45.486 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:41:45.494 INFO:teuthology.orchestra.run.smithi081.stdout:3989 trunc from 0x8c948da to 0x54da8c7 2024-09-13T06:41:45.526 INFO:teuthology.orchestra.run.smithi081.stdout:3990 read 0xc928e4 thru 0xc9753c (0x4c59 bytes) 2024-09-13T06:41:45.527 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:41:45.522+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:41:45.536 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:41:45.536 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 20, 2024-09-13T06:41:45.537 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 600, 2024-09-13T06:41:45.537 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [ 2024-09-13T06:41:45.537 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:45.537 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:36160 3.f 3:f62782c2:::rbd_object_map.11219660270d.0000000000000016:head [call] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-13T06:41:45.537 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:01.607291+0000", 2024-09-13T06:41:45.537 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 103.92799306800001, 2024-09-13T06:41:45.537 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.99619456699999998, 2024-09-13T06:41:45.537 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:45.537 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:45.537 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:45.537 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:45.537 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:45.537 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 36160 2024-09-13T06:41:45.537 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:45.538 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:45.538 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:45.538 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:45.538 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:01.607291+0000", 2024-09-13T06:41:45.538 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:45.538 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:45.538 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:45.538 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:45.538 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:01.607291+0000", 2024-09-13T06:41:45.538 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:45.538 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:45.538 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:45.538 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:45.538 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:01.607289+0000", 2024-09-13T06:41:45.539 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999976 2024-09-13T06:41:45.539 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:45.539 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:45.539 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:45.539 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:01.607302+0000", 2024-09-13T06:41:45.539 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3018e-05 2024-09-13T06:41:45.539 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:45.539 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:45.539 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:45.539 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:01.607323+0000", 2024-09-13T06:41:45.539 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1030999999999999e-05 2024-09-13T06:41:45.539 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:45.540 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:45.540 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:45.540 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:01.607342+0000", 2024-09-13T06:41:45.540 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8961e-05 2024-09-13T06:41:45.540 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:45.540 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:45.540 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:45.540 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:01.607425+0000", 2024-09-13T06:41:45.540 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.3171999999999996e-05 2024-09-13T06:41:45.540 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:45.540 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:45.540 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:41:45.540 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:01.607441+0000", 2024-09-13T06:41:45.540 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5996999999999999e-05 2024-09-13T06:41:45.541 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:45.541 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:45.541 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:45.541 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:02.596186+0000", 2024-09-13T06:41:45.541 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.98874432000000001 2024-09-13T06:41:45.541 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:45.541 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:45.541 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for missing object", 2024-09-13T06:41:45.541 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:02.596618+0000", 2024-09-13T06:41:45.541 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000432032 2024-09-13T06:41:45.541 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:45.541 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:45.541 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:45.541 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:02.600845+0000", 2024-09-13T06:41:45.541 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0042277410000000001 2024-09-13T06:41:45.542 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:45.542 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:45.542 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:45.542 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:02.601003+0000", 2024-09-13T06:41:45.542 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00015731999999999999 2024-09-13T06:41:45.542 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:45.542 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:45.542 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:45.542 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:02.603486+0000", 2024-09-13T06:41:45.542 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0024832510000000001 2024-09-13T06:41:45.542 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:45.542 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:45.543 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:45.543 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:45.543 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:45.543 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:37806 3.9 3:951cb95b:::rbd_data.1121d8143c6e.0000000000000002:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e56)", 2024-09-13T06:41:45.543 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:06.373482+0000", 2024-09-13T06:41:45.543 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 99.161802031999997, 2024-09-13T06:41:45.543 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.002476213, 2024-09-13T06:41:45.543 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:45.543 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:45.543 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:45.543 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:45.543 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:45.543 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 37806 2024-09-13T06:41:45.543 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:45.543 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:45.544 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:45.544 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:45.544 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.373482+0000", 2024-09-13T06:41:45.544 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:45.544 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:45.544 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:45.544 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:45.544 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.373482+0000", 2024-09-13T06:41:45.544 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:45.544 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:45.544 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:45.544 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:45.544 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.373479+0000", 2024-09-13T06:41:45.544 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999962 2024-09-13T06:41:45.545 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:45.545 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:45.545 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:45.545 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.373495+0000", 2024-09-13T06:41:45.545 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6640999999999999e-05 2024-09-13T06:41:45.545 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:45.545 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:45.545 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:45.545 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.373542+0000", 2024-09-13T06:41:45.545 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6229000000000001e-05 2024-09-13T06:41:45.545 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:45.545 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:45.545 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:45.545 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.373564+0000", 2024-09-13T06:41:45.546 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2684000000000002e-05 2024-09-13T06:41:45.546 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:45.546 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:45.546 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:45.546 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374268+0000", 2024-09-13T06:41:45.546 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00070363700000000001 2024-09-13T06:41:45.546 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:45.546 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:45.546 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:41:45.546 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374305+0000", 2024-09-13T06:41:45.546 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.6936e-05 2024-09-13T06:41:45.546 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:45.546 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:45.546 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:45.546 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.375175+0000", 2024-09-13T06:41:45.547 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.000870454 2024-09-13T06:41:45.547 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:45.547 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:45.547 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:45.547 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.375678+0000", 2024-09-13T06:41:45.547 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00050292499999999999 2024-09-13T06:41:45.547 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:45.547 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:45.547 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:45.547 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.375959+0000", 2024-09-13T06:41:45.547 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00028050599999999997 2024-09-13T06:41:45.547 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:45.547 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:45.547 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:45.547 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:45.547 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:45.548 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:37821 3.9 3:951cb95b:::rbd_data.1121d8143c6e.0000000000000002:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e56)", 2024-09-13T06:41:45.548 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:06.374454+0000", 2024-09-13T06:41:45.548 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 99.160830915000005, 2024-09-13T06:41:45.548 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.002545072, 2024-09-13T06:41:45.548 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:45.548 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:45.548 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:45.548 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:45.548 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:45.548 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 37821 2024-09-13T06:41:45.548 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:45.548 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:45.548 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:45.548 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:45.549 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374454+0000", 2024-09-13T06:41:45.549 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:45.549 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:45.549 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:45.549 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:45.549 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374454+0000", 2024-09-13T06:41:45.549 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:45.549 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:45.549 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:45.549 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:45.549 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374452+0000", 2024-09-13T06:41:45.549 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999981 2024-09-13T06:41:45.549 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:45.549 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:45.550 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:45.550 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374463+0000", 2024-09-13T06:41:45.550 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0756e-05 2024-09-13T06:41:45.550 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:45.550 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:45.550 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:45.550 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374487+0000", 2024-09-13T06:41:45.550 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4887000000000001e-05 2024-09-13T06:41:45.550 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:45.550 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:45.550 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:45.550 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374504+0000", 2024-09-13T06:41:45.550 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6852000000000001e-05 2024-09-13T06:41:45.551 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:45.551 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:45.551 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:45.551 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374829+0000", 2024-09-13T06:41:45.551 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000324684 2024-09-13T06:41:45.551 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:45.551 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:45.551 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:41:45.551 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374880+0000", 2024-09-13T06:41:45.551 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.1378000000000002e-05 2024-09-13T06:41:45.551 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:45.551 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:45.551 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:45.551 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.376423+0000", 2024-09-13T06:41:45.551 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.001542734 2024-09-13T06:41:45.552 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:45.552 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:45.552 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:45.552 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.376607+0000", 2024-09-13T06:41:45.552 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000183656 2024-09-13T06:41:45.552 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:45.552 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:45.552 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:45.552 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.376999+0000", 2024-09-13T06:41:45.552 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00039191200000000001 2024-09-13T06:41:45.552 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:45.552 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:45.552 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:45.553 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:45.553 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:45.553 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:37836 3.9 3:951cb95b:::rbd_data.1121d8143c6e.0000000000000002:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e56)", 2024-09-13T06:41:45.553 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:06.374929+0000", 2024-09-13T06:41:45.553 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 99.160355263, 2024-09-13T06:41:45.553 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.002778825, 2024-09-13T06:41:45.553 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:45.553 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:45.553 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:45.553 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:45.554 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:45.554 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 37836 2024-09-13T06:41:45.554 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:45.554 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:45.554 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:45.554 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:45.554 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374929+0000", 2024-09-13T06:41:45.554 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:45.554 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:45.554 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:45.554 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:45.554 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374929+0000", 2024-09-13T06:41:45.555 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:45.555 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:45.555 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:45.555 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:45.555 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374927+0000", 2024-09-13T06:41:45.555 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999981 2024-09-13T06:41:45.555 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:45.555 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:45.555 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:45.555 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374939+0000", 2024-09-13T06:41:45.555 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1846e-05 2024-09-13T06:41:45.555 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:45.555 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:45.556 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:45.556 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374962+0000", 2024-09-13T06:41:45.556 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3054e-05 2024-09-13T06:41:45.556 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:45.556 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:45.556 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:45.556 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374978+0000", 2024-09-13T06:41:45.556 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5899000000000001e-05 2024-09-13T06:41:45.556 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:45.556 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:45.556 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:45.556 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.375106+0000", 2024-09-13T06:41:45.556 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00012789 2024-09-13T06:41:45.557 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:45.557 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:45.557 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:41:45.557 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.375134+0000", 2024-09-13T06:41:45.557 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.8254000000000001e-05 2024-09-13T06:41:45.557 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:45.557 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:45.557 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:45.557 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.377082+0000", 2024-09-13T06:41:45.557 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0019471520000001 2024-09-13T06:41:45.557 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:45.557 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:45.557 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:45.557 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.377330+0000", 2024-09-13T06:41:45.558 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00024834199999999997 2024-09-13T06:41:45.558 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:45.558 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:45.558 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:45.558 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.377708+0000", 2024-09-13T06:41:45.558 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00037817100000000001 2024-09-13T06:41:45.558 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:45.558 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:45.558 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:45.558 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:45.558 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:45.558 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:37851 3.9 3:951cb95b:::rbd_data.1121d8143c6e.0000000000000002:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e56)", 2024-09-13T06:41:45.558 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:06.382636+0000", 2024-09-13T06:41:45.559 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 99.152648377999995, 2024-09-13T06:41:45.559 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.99582539400000003, 2024-09-13T06:41:45.559 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:45.559 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:45.559 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:45.559 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:45.559 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:45.559 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 37851 2024-09-13T06:41:45.559 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:45.559 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:45.559 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:45.559 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:45.559 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.382636+0000", 2024-09-13T06:41:45.559 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:45.559 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:45.560 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:45.560 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:45.560 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.382636+0000", 2024-09-13T06:41:45.560 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:45.560 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:45.560 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:45.560 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:45.560 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.382633+0000", 2024-09-13T06:41:45.560 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999971 2024-09-13T06:41:45.560 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:45.560 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:45.560 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:45.560 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.382652+0000", 2024-09-13T06:41:45.560 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8834999999999998e-05 2024-09-13T06:41:45.561 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:45.561 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:45.561 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:45.561 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.382695+0000", 2024-09-13T06:41:45.561 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.3136000000000002e-05 2024-09-13T06:41:45.561 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:45.561 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:45.561 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:45.561 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.382716+0000", 2024-09-13T06:41:45.561 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1421e-05 2024-09-13T06:41:45.561 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:45.561 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:45.561 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:45.562 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.382860+0000", 2024-09-13T06:41:45.562 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00014389200000000001 2024-09-13T06:41:45.562 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:45.562 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:45.562 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:41:45.562 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.382890+0000", 2024-09-13T06:41:45.562 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9827000000000001e-05 2024-09-13T06:41:45.562 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:45.562 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:45.562 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:45.562 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.377779+0000", 2024-09-13T06:41:45.562 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.99488842899999996 2024-09-13T06:41:45.562 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:45.563 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:45.563 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:45.563 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.378007+0000", 2024-09-13T06:41:45.563 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00022838099999999999 2024-09-13T06:41:45.563 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:45.563 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:45.563 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:45.563 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.378462+0000", 2024-09-13T06:41:45.563 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00045452300000000003 2024-09-13T06:41:45.563 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:45.563 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:45.563 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:45.563 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:45.564 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:45.564 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:37866 3.9 3:951cb95b:::rbd_data.1121d8143c6e.0000000000000002:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e56)", 2024-09-13T06:41:45.564 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:06.383951+0000", 2024-09-13T06:41:45.564 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 99.151333691999994, 2024-09-13T06:41:45.564 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.99517962299999996, 2024-09-13T06:41:45.564 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:45.564 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:45.564 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:45.564 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:45.564 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:45.564 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 37866 2024-09-13T06:41:45.564 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:45.564 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:45.565 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:45.565 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:45.565 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.383951+0000", 2024-09-13T06:41:45.565 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:45.565 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:45.565 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:45.565 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:45.565 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.383951+0000", 2024-09-13T06:41:45.565 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:45.565 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:45.565 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:45.565 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:45.565 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.383949+0000", 2024-09-13T06:41:45.565 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999981 2024-09-13T06:41:45.566 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:45.566 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:45.566 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:45.566 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.383961+0000", 2024-09-13T06:41:45.566 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1999e-05 2024-09-13T06:41:45.566 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:45.566 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:45.566 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:45.566 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384019+0000", 2024-09-13T06:41:45.566 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7621000000000003e-05 2024-09-13T06:41:45.566 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:45.566 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:45.566 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:45.566 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384040+0000", 2024-09-13T06:41:45.566 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1528000000000001e-05 2024-09-13T06:41:45.567 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:45.567 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:45.567 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:45.567 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384186+0000", 2024-09-13T06:41:45.567 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00014573799999999999 2024-09-13T06:41:45.567 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:45.567 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:45.567 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:41:45.567 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384204+0000", 2024-09-13T06:41:45.567 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7992e-05 2024-09-13T06:41:45.567 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:45.567 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:45.567 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:45.567 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.378536+0000", 2024-09-13T06:41:45.567 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.99433268600000002 2024-09-13T06:41:45.568 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:45.568 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:45.568 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:45.568 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.378771+0000", 2024-09-13T06:41:45.568 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00023445399999999999 2024-09-13T06:41:45.568 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:45.568 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:45.568 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:45.568 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.379130+0000", 2024-09-13T06:41:45.568 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00035954200000000002 2024-09-13T06:41:45.568 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:45.568 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:45.568 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:45.568 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:45.569 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:45.569 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:37881 3.9 3:951cb95b:::rbd_data.1121d8143c6e.0000000000000002:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e56)", 2024-09-13T06:41:45.569 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:06.384239+0000", 2024-09-13T06:41:45.569 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 99.151045277999998, 2024-09-13T06:41:45.569 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.99541483500000005, 2024-09-13T06:41:45.569 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:45.569 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:45.569 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:45.569 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:45.569 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:45.569 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 37881 2024-09-13T06:41:45.569 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:45.569 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:45.570 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:45.570 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:45.570 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384239+0000", 2024-09-13T06:41:45.570 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:45.570 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:45.570 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:45.570 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:45.570 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384239+0000", 2024-09-13T06:41:45.570 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:45.570 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:45.570 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:45.570 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:45.570 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384238+0000", 2024-09-13T06:41:45.570 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999986 2024-09-13T06:41:45.571 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:45.571 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:45.571 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:45.571 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384246+0000", 2024-09-13T06:41:45.571 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.2449999999999998e-06 2024-09-13T06:41:45.571 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:45.571 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:45.571 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:45.571 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384268+0000", 2024-09-13T06:41:45.571 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1518e-05 2024-09-13T06:41:45.571 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:45.571 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:45.571 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:45.572 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384282+0000", 2024-09-13T06:41:45.572 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4501999999999999e-05 2024-09-13T06:41:45.572 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:45.572 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:45.572 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:45.572 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384356+0000", 2024-09-13T06:41:45.572 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4265999999999997e-05 2024-09-13T06:41:45.572 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:45.572 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:45.572 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:41:45.572 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384370+0000", 2024-09-13T06:41:45.572 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3942e-05 2024-09-13T06:41:45.572 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:45.572 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:45.573 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:45.573 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.379199+0000", 2024-09-13T06:41:45.573 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.99482866599999997 2024-09-13T06:41:45.573 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:45.573 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:45.573 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:45.573 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.379347+0000", 2024-09-13T06:41:45.573 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00014749199999999999 2024-09-13T06:41:45.573 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:45.573 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:45.573 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:45.573 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.379654+0000", 2024-09-13T06:41:45.573 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00030752999999999998 2024-09-13T06:41:45.574 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:45.574 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:45.574 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:45.574 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:45.574 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:45.574 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:37896 3.9 3:951cb95b:::rbd_data.1121d8143c6e.0000000000000002:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e56)", 2024-09-13T06:41:45.574 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:06.384412+0000", 2024-09-13T06:41:45.574 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 99.150872844999995, 2024-09-13T06:41:45.574 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.99777835999999998, 2024-09-13T06:41:45.574 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:45.574 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:45.574 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:45.574 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:45.574 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:45.575 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 37896 2024-09-13T06:41:45.575 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:45.575 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:45.575 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:45.575 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:45.575 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384412+0000", 2024-09-13T06:41:45.575 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:45.575 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:45.575 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:45.575 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:45.575 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384412+0000", 2024-09-13T06:41:45.575 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:45.576 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:45.576 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:45.576 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:45.576 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384410+0000", 2024-09-13T06:41:45.576 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.999999 2024-09-13T06:41:45.576 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:45.576 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:45.576 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:45.576 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384418+0000", 2024-09-13T06:41:45.576 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.486e-06 2024-09-13T06:41:45.576 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:45.576 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:45.576 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:45.577 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384436+0000", 2024-09-13T06:41:45.577 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7668000000000001e-05 2024-09-13T06:41:45.577 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:45.577 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:45.577 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:45.577 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384449+0000", 2024-09-13T06:41:45.577 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3395e-05 2024-09-13T06:41:45.577 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:45.577 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:45.577 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:45.577 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384605+0000", 2024-09-13T06:41:45.577 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00015563099999999999 2024-09-13T06:41:45.577 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:45.578 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:45.578 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:41:45.578 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384635+0000", 2024-09-13T06:41:45.578 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.0383999999999999e-05 2024-09-13T06:41:45.578 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:45.578 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:45.578 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:45.578 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.379730+0000", 2024-09-13T06:41:45.578 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.99509493999999998 2024-09-13T06:41:45.578 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:45.578 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:45.578 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:45.578 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.379964+0000", 2024-09-13T06:41:45.578 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00023353499999999999 2024-09-13T06:41:45.578 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:45.579 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:45.579 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:45.579 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.382190+0000", 2024-09-13T06:41:45.579 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0022265039999999998 2024-09-13T06:41:45.579 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:45.579 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:45.579 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:45.579 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:45.579 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:45.579 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43222 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 389120~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:45.579 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558181+0000", 2024-09-13T06:41:45.579 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 83.977103591000002, 2024-09-13T06:41:45.579 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.06252038, 2024-09-13T06:41:45.580 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:45.580 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:45.580 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:45.580 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:45.580 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:45.580 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43222 2024-09-13T06:41:45.580 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:45.580 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:45.580 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:45.580 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:45.580 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558181+0000", 2024-09-13T06:41:45.580 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:45.581 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:45.581 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:45.581 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:45.581 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558181+0000", 2024-09-13T06:41:45.581 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:45.581 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:45.581 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:45.581 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:45.581 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558181+0000", 2024-09-13T06:41:45.581 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:45.581 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:45.581 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:45.581 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:45.582 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558183+0000", 2024-09-13T06:41:45.582 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.857e-06 2024-09-13T06:41:45.582 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:45.582 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:45.582 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:45.582 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558188+0000", 2024-09-13T06:41:45.582 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3759999999999999e-06 2024-09-13T06:41:45.582 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:45.582 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:45.582 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:45.582 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558261+0000", 2024-09-13T06:41:45.582 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3097999999999997e-05 2024-09-13T06:41:45.582 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:45.582 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:45.583 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:45.583 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.620354+0000", 2024-09-13T06:41:45.583 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.062092587999999997 2024-09-13T06:41:45.583 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:45.583 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:45.583 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:45.583 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.620428+0000", 2024-09-13T06:41:45.583 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3954000000000004e-05 2024-09-13T06:41:45.583 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:45.583 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:45.583 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:45.583 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.620701+0000", 2024-09-13T06:41:45.583 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000273773 2024-09-13T06:41:45.584 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:45.584 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:45.584 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:45.584 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:45.584 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:45.584 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43223 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 393216~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:45.584 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558267+0000", 2024-09-13T06:41:45.584 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 83.977017533999998, 2024-09-13T06:41:45.584 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.062813151999999997, 2024-09-13T06:41:45.584 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:45.584 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:45.584 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:45.584 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:45.584 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:45.585 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43223 2024-09-13T06:41:45.585 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:45.585 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:45.585 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:45.585 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:45.585 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558267+0000", 2024-09-13T06:41:45.585 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:45.585 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:45.585 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:45.585 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:45.585 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558267+0000", 2024-09-13T06:41:45.585 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:45.585 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:45.586 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:45.586 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:45.586 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558266+0000", 2024-09-13T06:41:45.586 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:45.586 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:45.586 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:45.586 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:45.586 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558270+0000", 2024-09-13T06:41:45.586 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.2389999999999998e-06 2024-09-13T06:41:45.586 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:45.586 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:45.586 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:45.586 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558277+0000", 2024-09-13T06:41:45.586 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5680000000000002e-06 2024-09-13T06:41:45.587 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:45.587 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:45.587 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:45.587 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558282+0000", 2024-09-13T06:41:45.587 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7060000000000003e-06 2024-09-13T06:41:45.587 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:45.587 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:45.587 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:45.587 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.620731+0000", 2024-09-13T06:41:45.587 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.062448661000000003 2024-09-13T06:41:45.587 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:45.587 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:45.587 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:45.588 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.620806+0000", 2024-09-13T06:41:45.588 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5862e-05 2024-09-13T06:41:45.588 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:45.588 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:45.588 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:45.588 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.621080+0000", 2024-09-13T06:41:45.588 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00027368599999999998 2024-09-13T06:41:45.588 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:45.588 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:45.588 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:45.588 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:45.588 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:45.588 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43224 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 407552~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:45.588 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558286+0000", 2024-09-13T06:41:45.589 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 83.976998170000002, 2024-09-13T06:41:45.589 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.063179052999999999, 2024-09-13T06:41:45.589 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:45.589 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:45.589 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:45.589 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:45.589 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:45.589 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43224 2024-09-13T06:41:45.589 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:45.589 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:45.589 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:45.589 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:45.589 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558286+0000", 2024-09-13T06:41:45.590 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:45.590 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:45.590 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:45.590 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:45.590 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558286+0000", 2024-09-13T06:41:45.590 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:45.590 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:45.590 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:45.590 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:45.590 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558286+0000", 2024-09-13T06:41:45.590 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:45.590 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:45.590 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:45.590 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:45.590 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558288+0000", 2024-09-13T06:41:45.591 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.227e-06 2024-09-13T06:41:45.591 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:45.591 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:45.591 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:45.591 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558292+0000", 2024-09-13T06:41:45.591 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.6289999999999999e-06 2024-09-13T06:41:45.591 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:45.591 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:45.591 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:45.591 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558294+0000", 2024-09-13T06:41:45.591 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5409999999999999e-06 2024-09-13T06:41:45.591 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:45.591 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:45.591 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:45.592 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.621110+0000", 2024-09-13T06:41:45.592 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.062815776000000004 2024-09-13T06:41:45.592 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:45.592 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:45.592 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:45.592 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.621186+0000", 2024-09-13T06:41:45.592 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5570999999999999e-05 2024-09-13T06:41:45.592 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:45.592 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:45.592 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:45.592 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.621465+0000", 2024-09-13T06:41:45.592 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00027988200000000001 2024-09-13T06:41:45.592 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:45.593 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:45.593 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:45.593 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:45.593 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:45.593 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43225 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 421888~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:45.593 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558296+0000", 2024-09-13T06:41:45.593 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 83.976988203000005, 2024-09-13T06:41:45.593 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.063551110999999993, 2024-09-13T06:41:45.593 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:45.593 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:45.593 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:45.593 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:45.593 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:45.594 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43225 2024-09-13T06:41:45.594 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:45.594 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:45.594 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:45.594 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:45.594 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558296+0000", 2024-09-13T06:41:45.594 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:45.594 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:45.594 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:45.594 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:45.594 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558296+0000", 2024-09-13T06:41:45.594 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:45.594 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:45.594 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:45.595 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:45.595 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558296+0000", 2024-09-13T06:41:45.595 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:41:45.595 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:45.595 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:45.595 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:45.595 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558305+0000", 2024-09-13T06:41:45.595 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.5290000000000008e-06 2024-09-13T06:41:45.595 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:45.595 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:45.595 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:45.595 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558308+0000", 2024-09-13T06:41:45.595 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.5619999999999999e-06 2024-09-13T06:41:45.595 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:45.596 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:45.596 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:45.596 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558311+0000", 2024-09-13T06:41:45.596 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.43e-06 2024-09-13T06:41:45.596 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:45.596 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:45.596 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:45.596 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.621495+0000", 2024-09-13T06:41:45.596 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.063184289000000005 2024-09-13T06:41:45.596 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:45.596 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:45.596 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:45.596 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.621569+0000", 2024-09-13T06:41:45.597 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4250000000000002e-05 2024-09-13T06:41:45.597 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:45.597 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:45.597 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:45.597 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.621847+0000", 2024-09-13T06:41:45.597 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00027826400000000002 2024-09-13T06:41:45.597 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:45.597 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:45.597 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:45.597 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:45.597 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:45.597 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43226 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 436224~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:45.597 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558313+0000", 2024-09-13T06:41:45.598 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 83.976971567000007, 2024-09-13T06:41:45.598 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.063914420999999999, 2024-09-13T06:41:45.598 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:45.598 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:45.598 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:45.598 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:45.598 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:45.598 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43226 2024-09-13T06:41:45.598 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:45.598 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:45.598 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:45.598 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:45.598 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558313+0000", 2024-09-13T06:41:45.599 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:45.599 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:45.599 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:45.599 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:45.599 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558313+0000", 2024-09-13T06:41:45.599 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:45.599 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:45.599 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:45.599 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:45.599 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558313+0000", 2024-09-13T06:41:45.599 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:45.599 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:45.599 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:45.600 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:45.600 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558314+0000", 2024-09-13T06:41:45.600 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3740000000000001e-06 2024-09-13T06:41:45.600 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:45.600 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:45.600 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:45.600 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558317+0000", 2024-09-13T06:41:45.600 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9730000000000002e-06 2024-09-13T06:41:45.600 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:45.600 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:45.600 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:45.600 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558319+0000", 2024-09-13T06:41:45.600 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4059999999999999e-06 2024-09-13T06:41:45.600 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:45.601 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:45.601 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:45.601 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.621877+0000", 2024-09-13T06:41:45.601 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.063557408999999995 2024-09-13T06:41:45.601 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:45.601 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:45.601 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:45.601 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.621951+0000", 2024-09-13T06:41:45.601 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4487999999999996e-05 2024-09-13T06:41:45.601 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:45.601 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:45.601 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:45.601 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.622227+0000", 2024-09-13T06:41:45.601 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000276011 2024-09-13T06:41:45.602 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:45.602 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:45.602 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:45.602 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:45.602 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:45.602 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43227 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 450560~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:45.602 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558322+0000", 2024-09-13T06:41:45.602 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 83.976962986000004, 2024-09-13T06:41:45.602 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.064285348000000006, 2024-09-13T06:41:45.602 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:45.602 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:45.602 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:45.602 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:45.602 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:45.603 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43227 2024-09-13T06:41:45.603 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:45.603 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:45.603 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:45.603 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:45.603 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558322+0000", 2024-09-13T06:41:45.603 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:45.603 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:45.603 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:45.603 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:45.603 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558322+0000", 2024-09-13T06:41:45.603 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:45.603 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:45.603 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:45.604 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:45.604 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558321+0000", 2024-09-13T06:41:45.604 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:41:45.604 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:45.604 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:45.604 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:45.604 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558323+0000", 2024-09-13T06:41:45.604 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.576e-06 2024-09-13T06:41:45.604 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:45.604 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:45.604 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:45.604 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558328+0000", 2024-09-13T06:41:45.604 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0719999999999999e-06 2024-09-13T06:41:45.604 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:45.605 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:45.605 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:45.605 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558332+0000", 2024-09-13T06:41:45.605 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.8130000000000002e-06 2024-09-13T06:41:45.605 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:45.605 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:45.605 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:45.605 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.622255+0000", 2024-09-13T06:41:45.605 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.063923195000000002 2024-09-13T06:41:45.605 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:45.605 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:45.605 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:45.605 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.622330+0000", 2024-09-13T06:41:45.606 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5383000000000007e-05 2024-09-13T06:41:45.606 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:45.606 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:45.606 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:45.606 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.622607+0000", 2024-09-13T06:41:45.606 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00027651999999999999 2024-09-13T06:41:45.606 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:45.606 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:45.606 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:45.606 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:45.606 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:45.606 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43228 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 464896~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:45.606 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558335+0000", 2024-09-13T06:41:45.607 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 83.976949077, 2024-09-13T06:41:45.607 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.064652253000000007, 2024-09-13T06:41:45.607 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:45.607 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:45.607 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:45.607 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:45.607 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:45.607 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43228 2024-09-13T06:41:45.607 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:45.607 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:45.607 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:45.607 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:45.607 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558335+0000", 2024-09-13T06:41:45.607 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:45.607 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:45.608 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:45.608 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:45.608 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558335+0000", 2024-09-13T06:41:45.608 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:45.608 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:45.608 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:45.608 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:45.608 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558335+0000", 2024-09-13T06:41:45.608 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:45.608 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:45.608 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:45.608 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:45.608 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558337+0000", 2024-09-13T06:41:45.609 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1380000000000001e-06 2024-09-13T06:41:45.609 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:45.609 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:45.609 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:45.609 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558343+0000", 2024-09-13T06:41:45.609 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.5140000000000001e-06 2024-09-13T06:41:45.609 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:45.609 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:45.609 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:45.609 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558348+0000", 2024-09-13T06:41:45.609 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9640000000000002e-06 2024-09-13T06:41:45.609 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:45.610 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:45.610 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:45.610 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.622636+0000", 2024-09-13T06:41:45.610 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.064288260999999999 2024-09-13T06:41:45.610 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:45.610 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:45.610 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:45.610 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.622715+0000", 2024-09-13T06:41:45.610 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.9351000000000006e-05 2024-09-13T06:41:45.610 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:45.610 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:45.610 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:45.610 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.622988+0000", 2024-09-13T06:41:45.610 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00027242599999999998 2024-09-13T06:41:45.611 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:45.611 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:45.611 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:45.611 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:45.611 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:45.611 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43229 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 479232~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:45.611 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558352+0000", 2024-09-13T06:41:45.611 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 83.976932661999996, 2024-09-13T06:41:45.611 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.065018024999999993, 2024-09-13T06:41:45.611 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:45.611 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:45.611 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:45.611 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:45.612 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:45.612 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43229 2024-09-13T06:41:45.612 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:45.612 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:45.612 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:45.612 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:45.612 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558352+0000", 2024-09-13T06:41:45.612 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:45.612 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:45.612 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:45.612 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:45.612 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558352+0000", 2024-09-13T06:41:45.612 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:45.613 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:45.613 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:45.613 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:45.613 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558352+0000", 2024-09-13T06:41:45.613 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:45.613 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:45.613 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:45.613 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:45.613 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558354+0000", 2024-09-13T06:41:45.613 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4930000000000001e-06 2024-09-13T06:41:45.613 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:45.613 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:45.613 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:45.613 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558360+0000", 2024-09-13T06:41:45.614 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.263e-06 2024-09-13T06:41:45.614 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:45.614 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:45.614 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:45.614 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558369+0000", 2024-09-13T06:41:45.614 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.0829999999999993e-06 2024-09-13T06:41:45.614 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:45.614 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:45.614 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:45.614 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.623017+0000", 2024-09-13T06:41:45.614 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.064647799000000006 2024-09-13T06:41:45.614 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:45.614 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:45.615 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:45.615 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.623090+0000", 2024-09-13T06:41:45.615 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3071000000000006e-05 2024-09-13T06:41:45.615 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:45.615 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:45.615 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:45.615 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.623370+0000", 2024-09-13T06:41:45.615 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000279661 2024-09-13T06:41:45.615 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:45.615 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:45.615 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:45.615 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:45.615 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:45.616 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43230 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 493568~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:45.616 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558374+0000", 2024-09-13T06:41:45.616 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 83.976910368999995, 2024-09-13T06:41:45.616 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.065410435000000003, 2024-09-13T06:41:45.616 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:45.616 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:45.616 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:45.616 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:45.616 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:45.616 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43230 2024-09-13T06:41:45.616 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:45.616 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:45.616 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:45.616 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:45.617 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558374+0000", 2024-09-13T06:41:45.617 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:45.617 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:45.617 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:45.617 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:45.617 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558374+0000", 2024-09-13T06:41:45.617 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:45.617 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:45.617 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:45.617 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:45.617 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558374+0000", 2024-09-13T06:41:45.617 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:45.618 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:45.618 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:45.618 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:45.618 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558376+0000", 2024-09-13T06:41:45.618 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4430000000000002e-06 2024-09-13T06:41:45.618 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:45.618 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:45.618 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:45.618 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558382+0000", 2024-09-13T06:41:45.618 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3029999999999996e-06 2024-09-13T06:41:45.618 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:45.618 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:45.618 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:45.618 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558387+0000", 2024-09-13T06:41:45.619 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.1699999999999999e-06 2024-09-13T06:41:45.619 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:45.619 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:45.619 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:45.619 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.623400+0000", 2024-09-13T06:41:45.619 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.065013244999999997 2024-09-13T06:41:45.619 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:45.619 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:45.619 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:45.619 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.623474+0000", 2024-09-13T06:41:45.619 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3889999999999999e-05 2024-09-13T06:41:45.619 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:45.619 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:45.620 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:45.620 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.623785+0000", 2024-09-13T06:41:45.620 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00031080099999999998 2024-09-13T06:41:45.620 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:45.620 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:45.620 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:45.620 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:45.620 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:45.620 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43231 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 507904~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:45.620 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558391+0000", 2024-09-13T06:41:45.620 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 83.976893684000004, 2024-09-13T06:41:45.620 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.065788597000000004, 2024-09-13T06:41:45.620 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:45.620 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:45.621 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:45.621 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:45.621 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:45.621 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43231 2024-09-13T06:41:45.621 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:45.621 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:45.621 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:45.621 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:45.621 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558391+0000", 2024-09-13T06:41:45.621 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:45.621 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:45.621 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:45.621 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:45.622 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558391+0000", 2024-09-13T06:41:45.622 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:45.622 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:45.622 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:45.622 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:45.622 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558390+0000", 2024-09-13T06:41:45.622 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:45.622 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:45.622 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:45.622 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:45.622 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558393+0000", 2024-09-13T06:41:45.622 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2570000000000002e-06 2024-09-13T06:41:45.622 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:45.623 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:45.623 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:45.623 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558399+0000", 2024-09-13T06:41:45.623 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0419999999999999e-06 2024-09-13T06:41:45.623 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:45.623 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:45.623 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:45.623 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558403+0000", 2024-09-13T06:41:45.623 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6249999999999998e-06 2024-09-13T06:41:45.623 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:45.623 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:45.623 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:45.623 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.623811+0000", 2024-09-13T06:41:45.623 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.065407549999999995 2024-09-13T06:41:45.624 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:45.624 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:45.624 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:45.624 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.623877+0000", 2024-09-13T06:41:45.624 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.5902999999999996e-05 2024-09-13T06:41:45.624 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:45.624 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:45.624 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:45.624 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.624179+0000", 2024-09-13T06:41:45.624 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00030259999999999998 2024-09-13T06:41:45.624 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:45.624 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:45.624 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:45.625 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:45.625 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:45.625 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43232 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 522240~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:45.625 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558422+0000", 2024-09-13T06:41:45.625 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 83.976862906999997, 2024-09-13T06:41:45.625 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.066176061999999994, 2024-09-13T06:41:45.625 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:45.625 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:45.625 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:45.625 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:45.625 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:45.625 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43232 2024-09-13T06:41:45.625 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:45.626 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:45.626 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:45.626 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:45.626 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558422+0000", 2024-09-13T06:41:45.626 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:45.626 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:45.626 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:45.626 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:45.626 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558422+0000", 2024-09-13T06:41:45.626 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:45.626 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:45.626 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:45.626 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:45.627 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558421+0000", 2024-09-13T06:41:45.627 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:45.627 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:45.627 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:45.627 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:45.627 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558428+0000", 2024-09-13T06:41:45.627 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.1690000000000003e-06 2024-09-13T06:41:45.627 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:45.627 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:45.627 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:45.627 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558434+0000", 2024-09-13T06:41:45.627 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9309999999999996e-06 2024-09-13T06:41:45.627 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:45.627 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:45.628 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:45.628 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558447+0000", 2024-09-13T06:41:45.628 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.271e-05 2024-09-13T06:41:45.628 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:45.628 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:45.628 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:45.628 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.624209+0000", 2024-09-13T06:41:45.628 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.065762102000000003 2024-09-13T06:41:45.628 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:45.628 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:45.628 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:45.628 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.624282+0000", 2024-09-13T06:41:45.628 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.2889e-05 2024-09-13T06:41:45.629 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:45.629 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:45.629 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:45.629 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.624598+0000", 2024-09-13T06:41:45.629 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00031591399999999998 2024-09-13T06:41:45.629 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:45.629 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:45.629 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:45.629 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:45.629 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:45.629 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43486 3.f 3:f7da9c8f:::rbd_data.1121f5f2e1c0.000000000000000b:1f [read 260096~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:45.629 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.569088+0000", 2024-09-13T06:41:45.629 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 83.966196183999998, 2024-09-13T06:41:45.630 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.062579223000000003, 2024-09-13T06:41:45.630 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:45.630 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:45.630 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:45.630 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:45.630 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:45.630 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43486 2024-09-13T06:41:45.630 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:45.630 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:45.630 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:45.630 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:45.630 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.569088+0000", 2024-09-13T06:41:45.630 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:45.630 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:45.631 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:45.631 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:45.631 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.569088+0000", 2024-09-13T06:41:45.631 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:45.631 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:45.631 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:45.631 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:45.631 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.569088+0000", 2024-09-13T06:41:45.631 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:45.631 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:45.631 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:45.631 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:45.631 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.569091+0000", 2024-09-13T06:41:45.631 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9629999999999998e-06 2024-09-13T06:41:45.632 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:45.632 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:45.632 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:45.632 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.569097+0000", 2024-09-13T06:41:45.632 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.4160000000000001e-06 2024-09-13T06:41:45.632 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:45.632 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:45.632 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:45.632 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.569102+0000", 2024-09-13T06:41:45.632 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6659999999999999e-06 2024-09-13T06:41:45.632 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:45.632 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:45.632 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:45.632 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.631346+0000", 2024-09-13T06:41:45.633 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.062243896 2024-09-13T06:41:45.633 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:45.633 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:45.633 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:45.633 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.631413+0000", 2024-09-13T06:41:45.633 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.7638000000000005e-05 2024-09-13T06:41:45.633 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:45.633 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:45.633 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:45.633 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.631668+0000", 2024-09-13T06:41:45.633 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0002541 2024-09-13T06:41:45.633 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:45.633 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:45.634 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:45.634 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:45.634 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:45.634 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:41:45.635 INFO:teuthology.orchestra.run.smithi081.stdout:3991 trunc from 0x54da8c7 to 0x246c 2024-09-13T06:41:45.636 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-13T06:41:45.636 INFO:teuthology.orchestra.run.smithi081.stdout:3992 read 0x486 thru 0x246b (0x1fe6 bytes) 2024-09-13T06:41:45.636 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:41:45.633+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:41:45.638 INFO:teuthology.orchestra.run.smithi081.stdout:3993 write 0x19c3190 thru 0x19c945e (0x62cf bytes) 2024-09-13T06:41:45.662 INFO:teuthology.orchestra.run.smithi081.stdout:3994 write 0x491592c thru 0x491ab9d (0x5272 bytes) 2024-09-13T06:41:45.668 INFO:teuthology.orchestra.run.smithi081.stdout:3995 write 0x1e109a1 thru 0x1e1c56e (0xbbce bytes) 2024-09-13T06:41:45.681 INFO:teuthology.orchestra.run.smithi081.stdout:3996 writesame 0x56acb1b thru 0x56ad5cf data_size 0x1(0xab5 bytes) 2024-09-13T06:41:45.682 INFO:teuthology.orchestra.run.smithi081.stdout:3997 punch from 0xcf778e to 0xcf7b2d, (0x39f bytes) 2024-09-13T06:41:45.682 INFO:teuthology.orchestra.run.smithi081.stdout:3998 read 0x3c880ab thru 0x3c8931e (0x1274 bytes) 2024-09-13T06:41:45.689 INFO:teuthology.orchestra.run.smithi081.stdout:3999 trunc from 0x56ad5d0 to 0xac9bb80 2024-09-13T06:41:45.698 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:41:45.698 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:41:45.712 INFO:teuthology.orchestra.run.smithi081.stdout:4002 trunc from 0xac9bb80 to 0x27fda31 2024-09-13T06:41:45.724 INFO:teuthology.orchestra.run.smithi081.stdout:4003 clone 27 order 24 su 131072 sc 9 2024-09-13T06:41:45.736 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:41:45.733+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:41:45.776 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:41:45.776 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-13T06:41:45.776 INFO:teuthology.orchestra.run.smithi081.stdout: "num_ops": 0 2024-09-13T06:41:45.776 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:41:45.790 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-13T06:41:45.813 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 4, 6, 7, 5, 3] out_osds: [] dead_osds: [7] live_osds: [0, 1, 2, 3, 4, 5, 6] 2024-09-13T06:41:45.813 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-13T06:41:45.813 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap 2024-09-13T06:41:45.814 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-09-13T06:41:45.837 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:41:45.833+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:41:45.937 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:41:45.933+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:41:45.951 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:41:45.951 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-13T06:41:45.951 INFO:teuthology.orchestra.run.smithi081.stdout: "complaint_time": 30, 2024-09-13T06:41:45.951 INFO:teuthology.orchestra.run.smithi081.stdout: "num_blocked_ops": 0 2024-09-13T06:41:45.952 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:41:45.966 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-13T06:41:46.060 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:41:46.057+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:41:46.132 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:41:46.132 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 20, 2024-09-13T06:41:46.132 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 600, 2024-09-13T06:41:46.132 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [ 2024-09-13T06:41:46.132 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.132 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:2226 3.15 3:af026987:::rbd_data.112173e2f1b7.0000000000000017:head [sparse-read 0~4194304] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-13T06:41:46.133 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:37.606562+0000", 2024-09-13T06:41:46.133 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 128.524583025, 2024-09-13T06:41:46.133 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.83322091700000001, 2024-09-13T06:41:46.133 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:46.133 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:41:46.133 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:46.133 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:46.133 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:46.133 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 2226 2024-09-13T06:41:46.133 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.133 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:46.133 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.133 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:46.134 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606562+0000", 2024-09-13T06:41:46.134 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:46.134 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.134 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.134 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:46.134 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606562+0000", 2024-09-13T06:41:46.134 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:46.134 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.134 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.134 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:46.134 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606561+0000", 2024-09-13T06:41:46.134 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:46.134 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.134 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.134 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:46.135 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606565+0000", 2024-09-13T06:41:46.135 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.4379999999999999e-06 2024-09-13T06:41:46.135 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.135 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.135 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:46.135 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606569+0000", 2024-09-13T06:41:46.135 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.425e-06 2024-09-13T06:41:46.135 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.135 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.135 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:46.135 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606572+0000", 2024-09-13T06:41:46.135 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.05e-06 2024-09-13T06:41:46.135 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.136 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.136 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:46.136 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606621+0000", 2024-09-13T06:41:46.136 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.8723000000000001e-05 2024-09-13T06:41:46.136 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.136 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.136 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:41:46.136 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606630+0000", 2024-09-13T06:41:46.136 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.8040000000000007e-06 2024-09-13T06:41:46.136 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.136 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.136 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:46.136 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.439648+0000", 2024-09-13T06:41:46.137 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.83301824800000002 2024-09-13T06:41:46.137 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.137 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.137 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:46.137 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.439782+0000", 2024-09-13T06:41:46.137 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00013466699999999999 2024-09-13T06:41:46.137 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:46.137 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:46.137 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:46.137 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.137 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.137 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25661 3.8 3:1180686c:::rbd_data.1121f2c5ee81.0000000000000009:13 [read 397312~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:46.138 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.436956+0000", 2024-09-13T06:41:46.138 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 109.69418849100001, 2024-09-13T06:41:46.138 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089036758999999993, 2024-09-13T06:41:46.138 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:46.138 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:46.138 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:46.138 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:46.138 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:46.138 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25661 2024-09-13T06:41:46.138 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.138 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:46.138 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.138 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:46.138 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436956+0000", 2024-09-13T06:41:46.138 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:46.139 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.139 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.139 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:46.139 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436956+0000", 2024-09-13T06:41:46.139 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:46.139 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.139 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.139 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:46.139 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436956+0000", 2024-09-13T06:41:46.139 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:46.139 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.139 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.139 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:46.139 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436958+0000", 2024-09-13T06:41:46.139 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1770000000000001e-06 2024-09-13T06:41:46.139 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.140 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.140 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:46.140 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436963+0000", 2024-09-13T06:41:46.140 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.6489999999999996e-06 2024-09-13T06:41:46.140 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.140 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.140 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:46.140 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436975+0000", 2024-09-13T06:41:46.140 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1783999999999999e-05 2024-09-13T06:41:46.140 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.140 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.140 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:46.140 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.525671+0000", 2024-09-13T06:41:46.140 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.088696292999999995 2024-09-13T06:41:46.141 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.141 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.141 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:46.141 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.525749+0000", 2024-09-13T06:41:46.141 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.7589000000000005e-05 2024-09-13T06:41:46.141 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.141 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.141 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:46.141 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.525993+0000", 2024-09-13T06:41:46.141 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00024381000000000001 2024-09-13T06:41:46.141 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:46.141 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:46.141 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:46.141 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.142 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.142 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25662 3.8 3:1180686c:::rbd_data.1121f2c5ee81.0000000000000009:13 [read 421888~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:46.142 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.436980+0000", 2024-09-13T06:41:46.142 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 109.694164179, 2024-09-13T06:41:46.142 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089367577000000004, 2024-09-13T06:41:46.142 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:46.142 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:46.142 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:46.142 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:46.142 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:46.142 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25662 2024-09-13T06:41:46.142 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.142 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:46.143 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.143 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:46.143 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436980+0000", 2024-09-13T06:41:46.143 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:46.143 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.143 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.143 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:46.143 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436980+0000", 2024-09-13T06:41:46.143 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:46.143 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.143 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.143 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:46.143 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436980+0000", 2024-09-13T06:41:46.143 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:46.143 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.144 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.144 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:46.144 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436982+0000", 2024-09-13T06:41:46.144 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3989999999999998e-06 2024-09-13T06:41:46.144 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.144 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.144 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:46.144 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436988+0000", 2024-09-13T06:41:46.144 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0039999999999996e-06 2024-09-13T06:41:46.144 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.144 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.144 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:46.144 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436993+0000", 2024-09-13T06:41:46.144 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6090000000000003e-06 2024-09-13T06:41:46.145 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.145 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.145 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:46.145 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.526035+0000", 2024-09-13T06:41:46.145 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089042248000000004 2024-09-13T06:41:46.145 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.145 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.145 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:46.145 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.526111+0000", 2024-09-13T06:41:46.145 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5643999999999996e-05 2024-09-13T06:41:46.145 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.145 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.145 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:46.146 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.526348+0000", 2024-09-13T06:41:46.146 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00023705800000000001 2024-09-13T06:41:46.146 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:46.146 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:46.146 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:46.146 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.146 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.146 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25663 3.8 3:1180686c:::rbd_data.1121f2c5ee81.0000000000000009:13 [read 466944~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:46.146 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.436998+0000", 2024-09-13T06:41:46.146 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 109.694146532, 2024-09-13T06:41:46.146 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089730867000000006, 2024-09-13T06:41:46.146 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:46.146 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:46.146 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:46.147 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:46.147 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:46.147 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25663 2024-09-13T06:41:46.147 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.147 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:46.147 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.147 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:46.147 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436998+0000", 2024-09-13T06:41:46.147 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:46.147 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.147 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.147 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:46.147 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436998+0000", 2024-09-13T06:41:46.148 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:46.148 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.148 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.148 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:46.148 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436998+0000", 2024-09-13T06:41:46.148 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:46.148 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.148 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.148 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:46.148 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437000+0000", 2024-09-13T06:41:46.148 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0940000000000002e-06 2024-09-13T06:41:46.148 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.149 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.149 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:46.149 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437005+0000", 2024-09-13T06:41:46.149 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.604e-06 2024-09-13T06:41:46.149 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.149 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.149 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:46.149 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437032+0000", 2024-09-13T06:41:46.149 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6407e-05 2024-09-13T06:41:46.149 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.149 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.149 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:46.150 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.526363+0000", 2024-09-13T06:41:46.150 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089331456000000004 2024-09-13T06:41:46.150 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.150 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.150 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:46.150 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.526404+0000", 2024-09-13T06:41:46.150 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.0887999999999999e-05 2024-09-13T06:41:46.150 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.150 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.150 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:46.150 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.526729+0000", 2024-09-13T06:41:46.150 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00032486 2024-09-13T06:41:46.150 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:46.150 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:46.151 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:46.151 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.151 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.151 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25664 3.8 3:1180686c:::rbd_data.1121f2c5ee81.0000000000000009:13 [read 491520~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:46.151 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.437040+0000", 2024-09-13T06:41:46.151 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 109.69410461699999, 2024-09-13T06:41:46.151 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.090016650000000004, 2024-09-13T06:41:46.151 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:46.151 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:46.151 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:46.151 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:46.151 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:46.152 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25664 2024-09-13T06:41:46.152 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.152 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:46.152 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.152 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:46.152 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437040+0000", 2024-09-13T06:41:46.152 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:46.152 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.152 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.152 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:46.152 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437040+0000", 2024-09-13T06:41:46.152 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:46.152 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.152 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.153 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:46.153 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437039+0000", 2024-09-13T06:41:46.153 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:46.153 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.153 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.153 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:46.153 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437047+0000", 2024-09-13T06:41:46.153 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4839999999999998e-06 2024-09-13T06:41:46.153 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.153 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.153 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:46.153 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437054+0000", 2024-09-13T06:41:46.153 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.8299999999999998e-06 2024-09-13T06:41:46.154 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.154 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.154 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:46.154 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437060+0000", 2024-09-13T06:41:46.154 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.1510000000000001e-06 2024-09-13T06:41:46.154 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.154 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.154 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:46.154 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.526772+0000", 2024-09-13T06:41:46.154 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089711737999999999 2024-09-13T06:41:46.154 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.154 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.154 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:46.154 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.526848+0000", 2024-09-13T06:41:46.155 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5870000000000004e-05 2024-09-13T06:41:46.155 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.155 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.155 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:46.155 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.527057+0000", 2024-09-13T06:41:46.155 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000209106 2024-09-13T06:41:46.155 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:46.155 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:46.155 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:46.155 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.155 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.155 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25740 3.18 3:1c662b96:::rbd_data.1121f2c5ee81.0000000000000010:13 [read 200704~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:46.156 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443352+0000", 2024-09-13T06:41:46.156 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 109.687792942, 2024-09-13T06:41:46.156 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089068222000000002, 2024-09-13T06:41:46.156 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:46.156 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:46.156 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:46.156 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:46.156 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:46.156 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25740 2024-09-13T06:41:46.156 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.156 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:46.156 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.156 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:46.156 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443352+0000", 2024-09-13T06:41:46.157 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:46.157 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.157 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.157 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:46.157 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443352+0000", 2024-09-13T06:41:46.157 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:46.157 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.157 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.157 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:46.157 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443351+0000", 2024-09-13T06:41:46.157 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:46.157 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.157 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.157 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:46.157 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443354+0000", 2024-09-13T06:41:46.158 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.841e-06 2024-09-13T06:41:46.158 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.158 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.158 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:46.158 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443361+0000", 2024-09-13T06:41:46.158 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.0010000000000004e-06 2024-09-13T06:41:46.158 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.158 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.158 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:46.158 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443366+0000", 2024-09-13T06:41:46.158 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7119999999999999e-06 2024-09-13T06:41:46.158 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.158 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.158 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:46.158 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532117+0000", 2024-09-13T06:41:46.158 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.088751327000000005 2024-09-13T06:41:46.159 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.159 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.159 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:46.159 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532193+0000", 2024-09-13T06:41:46.159 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5839000000000004e-05 2024-09-13T06:41:46.159 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.159 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.159 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:46.159 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532420+0000", 2024-09-13T06:41:46.159 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00022691000000000001 2024-09-13T06:41:46.159 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:46.159 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:46.159 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:46.159 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.159 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.160 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25741 3.18 3:1c662b96:::rbd_data.1121f2c5ee81.0000000000000010:13 [read 225280~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:46.160 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443378+0000", 2024-09-13T06:41:46.160 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 109.68776617499999, 2024-09-13T06:41:46.160 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089324107, 2024-09-13T06:41:46.160 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:46.160 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:46.160 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:46.160 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:46.160 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:46.160 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25741 2024-09-13T06:41:46.160 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.160 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:46.160 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.161 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:46.161 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443378+0000", 2024-09-13T06:41:46.161 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:46.161 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.161 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.161 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:46.161 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443378+0000", 2024-09-13T06:41:46.161 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:46.161 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.161 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.161 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:46.161 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443378+0000", 2024-09-13T06:41:46.161 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:46.161 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.162 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.162 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:46.162 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443380+0000", 2024-09-13T06:41:46.162 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3549999999999999e-06 2024-09-13T06:41:46.162 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.162 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.162 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:46.162 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443388+0000", 2024-09-13T06:41:46.162 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.7449999999999995e-06 2024-09-13T06:41:46.162 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.162 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.162 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:46.162 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443393+0000", 2024-09-13T06:41:46.162 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.4e-06 2024-09-13T06:41:46.162 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.163 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.163 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:46.163 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532454+0000", 2024-09-13T06:41:46.163 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089060941000000005 2024-09-13T06:41:46.163 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.163 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.163 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:46.163 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532512+0000", 2024-09-13T06:41:46.163 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7763000000000002e-05 2024-09-13T06:41:46.163 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.163 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.163 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:46.163 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532703+0000", 2024-09-13T06:41:46.163 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000190328 2024-09-13T06:41:46.164 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:46.164 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:46.164 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:46.164 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.164 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.164 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25742 3.18 3:1c662b96:::rbd_data.1121f2c5ee81.0000000000000010:13 [read 270336~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:46.164 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443398+0000", 2024-09-13T06:41:46.164 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 109.687746463, 2024-09-13T06:41:46.164 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089621836999999996, 2024-09-13T06:41:46.164 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:46.164 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:46.164 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:46.164 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:46.164 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:46.165 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25742 2024-09-13T06:41:46.165 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.165 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:46.165 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.165 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:46.165 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443398+0000", 2024-09-13T06:41:46.165 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:46.165 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.165 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.165 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:46.165 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443398+0000", 2024-09-13T06:41:46.165 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:46.165 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.166 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.166 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:46.166 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443398+0000", 2024-09-13T06:41:46.166 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:46.166 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.166 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.166 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:46.166 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443400+0000", 2024-09-13T06:41:46.166 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1849999999999998e-06 2024-09-13T06:41:46.166 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.166 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.166 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:46.166 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443407+0000", 2024-09-13T06:41:46.167 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3669999999999999e-06 2024-09-13T06:41:46.167 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.167 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.167 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:46.167 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443420+0000", 2024-09-13T06:41:46.167 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2645e-05 2024-09-13T06:41:46.167 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.167 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.167 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:46.167 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532742+0000", 2024-09-13T06:41:46.167 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089322200000000004 2024-09-13T06:41:46.167 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.167 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.167 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:46.168 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532818+0000", 2024-09-13T06:41:46.168 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.6019000000000005e-05 2024-09-13T06:41:46.168 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.168 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.168 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:46.168 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533020+0000", 2024-09-13T06:41:46.168 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000201721 2024-09-13T06:41:46.168 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:46.168 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:46.168 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:46.168 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.168 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.168 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25743 3.18 3:1c662b96:::rbd_data.1121f2c5ee81.0000000000000010:13 [read 294912~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:46.168 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443425+0000", 2024-09-13T06:41:46.168 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 109.68771945500001, 2024-09-13T06:41:46.169 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089864075000000002, 2024-09-13T06:41:46.169 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:46.169 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:46.169 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:46.169 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:46.169 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:46.169 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25743 2024-09-13T06:41:46.169 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.169 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:46.169 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.169 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:46.169 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443425+0000", 2024-09-13T06:41:46.169 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:46.169 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.169 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.170 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:46.170 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443425+0000", 2024-09-13T06:41:46.170 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:46.170 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.170 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.170 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:46.170 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443425+0000", 2024-09-13T06:41:46.170 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:46.170 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.170 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.170 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:46.170 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443432+0000", 2024-09-13T06:41:46.170 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3420000000000002e-06 2024-09-13T06:41:46.170 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.171 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.171 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:46.171 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443440+0000", 2024-09-13T06:41:46.171 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5689999999999999e-06 2024-09-13T06:41:46.171 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.171 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.171 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:46.171 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443445+0000", 2024-09-13T06:41:46.171 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9590000000000003e-06 2024-09-13T06:41:46.171 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.171 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.171 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:46.171 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533063+0000", 2024-09-13T06:41:46.171 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089617988999999995 2024-09-13T06:41:46.171 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.171 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.172 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:46.172 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533122+0000", 2024-09-13T06:41:46.172 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9052999999999999e-05 2024-09-13T06:41:46.172 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.172 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.172 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:46.172 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533289+0000", 2024-09-13T06:41:46.172 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00016752800000000001 2024-09-13T06:41:46.172 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:46.172 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:46.172 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:46.172 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.172 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.173 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25744 3.18 3.69d46638 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:46.173 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443449+0000", 2024-09-13T06:41:46.173 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 109.687695308, 2024-09-13T06:41:46.173 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089869148999999995, 2024-09-13T06:41:46.173 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:46.173 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:41:46.173 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:46.173 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:46.173 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:46.173 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25744 2024-09-13T06:41:46.173 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.173 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:46.173 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.174 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:46.174 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443449+0000", 2024-09-13T06:41:46.174 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:46.174 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.174 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.174 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:46.174 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443449+0000", 2024-09-13T06:41:46.174 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:46.174 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.174 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.174 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:46.174 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443449+0000", 2024-09-13T06:41:46.174 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:46.174 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.175 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.175 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:46.175 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443451+0000", 2024-09-13T06:41:46.175 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.244e-06 2024-09-13T06:41:46.175 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.175 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.175 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:46.175 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443457+0000", 2024-09-13T06:41:46.175 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.66e-06 2024-09-13T06:41:46.175 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.175 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.175 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:46.175 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443461+0000", 2024-09-13T06:41:46.176 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5449999999999997e-06 2024-09-13T06:41:46.176 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.176 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.176 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:46.176 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533311+0000", 2024-09-13T06:41:46.176 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089849729000000003 2024-09-13T06:41:46.176 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.176 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.176 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:46.176 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533318+0000", 2024-09-13T06:41:46.176 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.328e-06 2024-09-13T06:41:46.176 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:46.176 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:46.176 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:46.177 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.177 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.177 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25745 3.18 3.69d46638 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:46.177 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443466+0000", 2024-09-13T06:41:46.177 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 109.68767825, 2024-09-13T06:41:46.177 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089886743000000005, 2024-09-13T06:41:46.177 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:46.177 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:41:46.177 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:46.177 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:46.177 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:46.177 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25745 2024-09-13T06:41:46.177 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.177 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:46.178 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.178 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:46.178 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443466+0000", 2024-09-13T06:41:46.178 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:46.178 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.178 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.178 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:46.178 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443466+0000", 2024-09-13T06:41:46.178 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:46.178 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.178 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.178 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:46.178 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443466+0000", 2024-09-13T06:41:46.178 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:46.179 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.179 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.179 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:46.179 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443474+0000", 2024-09-13T06:41:46.179 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.1289999999999996e-06 2024-09-13T06:41:46.179 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.179 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.179 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:46.179 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443484+0000", 2024-09-13T06:41:46.179 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0654e-05 2024-09-13T06:41:46.179 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.179 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.179 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:46.179 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443490+0000", 2024-09-13T06:41:46.180 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8030000000000002e-06 2024-09-13T06:41:46.180 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.180 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.180 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:46.180 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533348+0000", 2024-09-13T06:41:46.180 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089857267000000005 2024-09-13T06:41:46.180 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.180 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.180 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:46.180 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533353+0000", 2024-09-13T06:41:46.180 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.5520000000000004e-06 2024-09-13T06:41:46.180 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:46.180 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:46.180 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:46.181 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.181 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.181 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25746 3.18 3.69d46638 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:46.181 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443495+0000", 2024-09-13T06:41:46.181 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 109.68764913699999, 2024-09-13T06:41:46.181 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089903725000000004, 2024-09-13T06:41:46.181 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:46.181 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:41:46.181 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:46.181 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:46.181 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:46.181 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25746 2024-09-13T06:41:46.181 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.181 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:46.182 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.182 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:46.182 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443495+0000", 2024-09-13T06:41:46.182 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:46.182 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.182 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.182 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:46.182 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443495+0000", 2024-09-13T06:41:46.182 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:46.182 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.182 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.182 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:46.182 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443495+0000", 2024-09-13T06:41:46.182 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:46.183 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.183 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.183 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:46.183 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443498+0000", 2024-09-13T06:41:46.183 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.7690000000000001e-06 2024-09-13T06:41:46.183 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.183 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.183 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:46.183 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443504+0000", 2024-09-13T06:41:46.183 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9710000000000001e-06 2024-09-13T06:41:46.183 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.183 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.183 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:46.184 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443508+0000", 2024-09-13T06:41:46.184 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4159999999999997e-06 2024-09-13T06:41:46.184 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.184 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.184 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:46.184 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533391+0000", 2024-09-13T06:41:46.184 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089882607000000003 2024-09-13T06:41:46.184 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.184 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.184 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:46.184 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533399+0000", 2024-09-13T06:41:46.184 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.4349999999999997e-06 2024-09-13T06:41:46.184 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:46.184 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:46.185 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:46.185 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.185 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.185 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25747 3.8 3.63996268 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:46.185 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443512+0000", 2024-09-13T06:41:46.185 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 109.68763240600001, 2024-09-13T06:41:46.185 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089880075000000004, 2024-09-13T06:41:46.185 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:46.185 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:41:46.185 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:46.185 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:46.185 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:46.185 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25747 2024-09-13T06:41:46.185 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.186 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:46.186 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.186 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:46.186 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443512+0000", 2024-09-13T06:41:46.186 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:46.186 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.186 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.186 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:46.186 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443512+0000", 2024-09-13T06:41:46.186 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:46.186 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.186 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.186 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:46.186 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443512+0000", 2024-09-13T06:41:46.187 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:46.187 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.187 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.187 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:46.187 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443514+0000", 2024-09-13T06:41:46.187 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0980000000000001e-06 2024-09-13T06:41:46.187 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.187 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.187 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:46.187 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443520+0000", 2024-09-13T06:41:46.187 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7069999999999997e-06 2024-09-13T06:41:46.187 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.187 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.187 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:46.187 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443524+0000", 2024-09-13T06:41:46.188 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5390000000000001e-06 2024-09-13T06:41:46.188 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.188 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.188 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:46.188 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533384+0000", 2024-09-13T06:41:46.188 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089859684999999995 2024-09-13T06:41:46.188 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.188 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.188 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:46.188 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533392+0000", 2024-09-13T06:41:46.188 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.3440000000000001e-06 2024-09-13T06:41:46.188 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:46.188 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:46.188 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:46.189 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.189 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.189 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25748 3.8 3.63996268 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:46.189 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443528+0000", 2024-09-13T06:41:46.189 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 109.687616279, 2024-09-13T06:41:46.189 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089890715999999996, 2024-09-13T06:41:46.189 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:46.189 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:41:46.189 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:46.189 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:46.189 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:46.189 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25748 2024-09-13T06:41:46.189 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.189 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:46.190 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.190 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:46.190 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443528+0000", 2024-09-13T06:41:46.190 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:46.190 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.190 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.190 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:46.190 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443528+0000", 2024-09-13T06:41:46.190 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:46.190 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.190 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.190 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:46.190 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443528+0000", 2024-09-13T06:41:46.190 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:46.190 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.190 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.191 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:46.191 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443530+0000", 2024-09-13T06:41:46.191 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0650000000000001e-06 2024-09-13T06:41:46.191 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.191 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.191 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:46.191 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443536+0000", 2024-09-13T06:41:46.191 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7259999999999999e-06 2024-09-13T06:41:46.191 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.191 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.191 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:46.191 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443540+0000", 2024-09-13T06:41:46.191 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5009999999999998e-06 2024-09-13T06:41:46.191 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.191 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.192 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:46.192 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533412+0000", 2024-09-13T06:41:46.192 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089871873000000005 2024-09-13T06:41:46.192 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.192 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.192 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:46.192 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533419+0000", 2024-09-13T06:41:46.192 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.883e-06 2024-09-13T06:41:46.192 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:46.192 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:46.192 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:46.193 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.193 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.193 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25749 3.8 3.63996268 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:46.193 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443545+0000", 2024-09-13T06:41:46.193 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 109.68760008300001, 2024-09-13T06:41:46.193 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089897988999999998, 2024-09-13T06:41:46.193 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:46.193 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:41:46.193 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:46.193 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:46.193 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:46.193 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25749 2024-09-13T06:41:46.193 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.193 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:46.194 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.194 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:46.194 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443545+0000", 2024-09-13T06:41:46.194 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:46.194 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.194 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.194 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:46.194 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443545+0000", 2024-09-13T06:41:46.194 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:46.194 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.194 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.194 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:46.194 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443544+0000", 2024-09-13T06:41:46.194 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:46.194 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.195 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.195 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:46.195 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443553+0000", 2024-09-13T06:41:46.195 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.4770000000000003e-06 2024-09-13T06:41:46.195 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.195 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.195 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:46.195 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443564+0000", 2024-09-13T06:41:46.195 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0986e-05 2024-09-13T06:41:46.195 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.195 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.195 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:46.195 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443569+0000", 2024-09-13T06:41:46.195 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2530000000000004e-06 2024-09-13T06:41:46.196 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.196 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.196 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:46.196 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533438+0000", 2024-09-13T06:41:46.196 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089868641999999999 2024-09-13T06:41:46.196 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.196 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.196 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:46.196 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533442+0000", 2024-09-13T06:41:46.196 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.989e-06 2024-09-13T06:41:46.196 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:46.196 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:46.197 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:46.197 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.197 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.197 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25750 3.8 3.63996268 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:46.197 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443574+0000", 2024-09-13T06:41:46.197 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 109.687570597, 2024-09-13T06:41:46.197 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089895143999999996, 2024-09-13T06:41:46.197 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:46.197 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:41:46.197 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:46.197 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:46.198 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:46.198 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25750 2024-09-13T06:41:46.198 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.198 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:46.198 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.198 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:46.198 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443574+0000", 2024-09-13T06:41:46.198 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:46.198 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.198 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.198 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:46.198 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443574+0000", 2024-09-13T06:41:46.199 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:46.199 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.199 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.199 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:46.199 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443574+0000", 2024-09-13T06:41:46.199 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:46.199 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.199 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.199 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:46.199 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443576+0000", 2024-09-13T06:41:46.199 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6910000000000002e-06 2024-09-13T06:41:46.199 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.199 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.200 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:46.200 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443583+0000", 2024-09-13T06:41:46.200 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.331e-06 2024-09-13T06:41:46.200 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.200 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.200 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:46.200 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443587+0000", 2024-09-13T06:41:46.200 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6129999999999997e-06 2024-09-13T06:41:46.200 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.200 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.200 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:46.200 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533464+0000", 2024-09-13T06:41:46.200 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089876605999999998 2024-09-13T06:41:46.201 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.201 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.201 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:46.201 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533469+0000", 2024-09-13T06:41:46.201 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3909999999999997e-06 2024-09-13T06:41:46.201 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:46.201 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:46.201 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:46.201 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.201 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.201 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25751 3.8 3.63996268 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:46.201 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443592+0000", 2024-09-13T06:41:46.202 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 109.6875529, 2024-09-13T06:41:46.202 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089913650999999997, 2024-09-13T06:41:46.202 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:46.202 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:41:46.202 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:46.202 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:46.202 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:46.202 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25751 2024-09-13T06:41:46.202 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.202 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:46.202 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.202 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:46.202 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443592+0000", 2024-09-13T06:41:46.203 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:46.203 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.203 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.203 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:46.203 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443592+0000", 2024-09-13T06:41:46.203 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:46.203 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.203 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.203 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:46.203 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443591+0000", 2024-09-13T06:41:46.203 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:46.203 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.204 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.204 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:46.204 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443594+0000", 2024-09-13T06:41:46.204 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3649999999999998e-06 2024-09-13T06:41:46.204 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.204 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.204 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:46.204 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443599+0000", 2024-09-13T06:41:46.204 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.699e-06 2024-09-13T06:41:46.204 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.204 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.204 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:46.204 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443611+0000", 2024-09-13T06:41:46.205 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1503e-05 2024-09-13T06:41:46.205 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.205 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.205 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:46.205 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533497+0000", 2024-09-13T06:41:46.205 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089886453000000005 2024-09-13T06:41:46.205 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.205 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.205 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:46.205 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533505+0000", 2024-09-13T06:41:46.205 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.9910000000000002e-06 2024-09-13T06:41:46.205 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:46.205 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:46.205 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:46.205 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.206 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.206 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25752 3.8 3.63996268 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:46.206 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443615+0000", 2024-09-13T06:41:46.206 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 109.687529119, 2024-09-13T06:41:46.206 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089905868999999999, 2024-09-13T06:41:46.206 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:46.206 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:41:46.206 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:46.206 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:46.206 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:46.206 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25752 2024-09-13T06:41:46.206 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.206 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:46.206 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.207 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:46.207 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443615+0000", 2024-09-13T06:41:46.207 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:46.207 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.207 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.207 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:46.207 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443615+0000", 2024-09-13T06:41:46.207 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:46.207 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.207 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.207 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:46.207 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443615+0000", 2024-09-13T06:41:46.207 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:46.208 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.208 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.208 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:46.208 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443617+0000", 2024-09-13T06:41:46.208 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3539999999999998e-06 2024-09-13T06:41:46.208 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.208 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.208 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:46.208 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443624+0000", 2024-09-13T06:41:46.208 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3600000000000001e-06 2024-09-13T06:41:46.208 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.208 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.208 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:46.209 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443628+0000", 2024-09-13T06:41:46.209 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.2350000000000001e-06 2024-09-13T06:41:46.209 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.209 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.209 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:46.209 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533517+0000", 2024-09-13T06:41:46.209 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089889029999999995 2024-09-13T06:41:46.209 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.209 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.209 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:46.209 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533521+0000", 2024-09-13T06:41:46.209 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.2529999999999998e-06 2024-09-13T06:41:46.209 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:46.209 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:46.210 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:46.210 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.210 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.210 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25755 3.8 3.63996268 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:46.210 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.444692+0000", 2024-09-13T06:41:46.210 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 109.686452413, 2024-09-13T06:41:46.210 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.088904186999999996, 2024-09-13T06:41:46.210 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:46.210 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:41:46.210 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:46.210 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:46.210 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:46.210 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25755 2024-09-13T06:41:46.210 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.210 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:46.211 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.211 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:46.211 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.444692+0000", 2024-09-13T06:41:46.211 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:46.211 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.211 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.211 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:46.211 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.444692+0000", 2024-09-13T06:41:46.211 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:46.211 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.211 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.211 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:46.211 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.444692+0000", 2024-09-13T06:41:46.211 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:46.212 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.212 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.212 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:46.212 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.444694+0000", 2024-09-13T06:41:46.212 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.058e-06 2024-09-13T06:41:46.212 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.212 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.212 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:46.212 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.444700+0000", 2024-09-13T06:41:46.212 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7769999999999999e-06 2024-09-13T06:41:46.212 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.212 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.212 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:46.212 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.444704+0000", 2024-09-13T06:41:46.213 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6229999999999996e-06 2024-09-13T06:41:46.213 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.213 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.213 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:46.213 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533587+0000", 2024-09-13T06:41:46.213 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.088882744999999999 2024-09-13T06:41:46.213 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.213 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.213 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:46.213 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533596+0000", 2024-09-13T06:41:46.213 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.3270000000000007e-06 2024-09-13T06:41:46.213 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:46.213 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:46.213 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:46.214 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.214 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.214 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:64356 3.c 3:32785be9:::rbd_header.11218ba71f0d:head [watch reconnect cookie 140361410387072 gen 2] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e95)", 2024-09-13T06:41:46.214 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:48.473318+0000", 2024-09-13T06:41:46.214 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 57.657826726000003, 2024-09-13T06:41:46.214 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1458904379999999, 2024-09-13T06:41:46.214 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:46.214 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:46.214 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:46.214 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:46.214 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:46.214 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 64356 2024-09-13T06:41:46.214 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.215 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:46.215 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.215 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:46.215 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:48.473318+0000", 2024-09-13T06:41:46.215 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:46.215 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.215 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.215 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:46.215 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:48.473318+0000", 2024-09-13T06:41:46.215 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:46.215 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.215 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.216 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:46.216 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:48.473315+0000", 2024-09-13T06:41:46.216 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999971 2024-09-13T06:41:46.216 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.216 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.216 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:46.216 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:48.473329+0000", 2024-09-13T06:41:46.216 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.433e-05 2024-09-13T06:41:46.216 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.216 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.216 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:46.216 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:48.473363+0000", 2024-09-13T06:41:46.216 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.3592e-05 2024-09-13T06:41:46.217 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.217 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.217 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:46.217 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:48.473386+0000", 2024-09-13T06:41:46.217 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2708999999999999e-05 2024-09-13T06:41:46.217 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.217 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.217 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:46.217 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:48.473804+0000", 2024-09-13T06:41:46.217 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00041789399999999998 2024-09-13T06:41:46.217 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.217 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.217 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:41:46.218 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:48.473830+0000", 2024-09-13T06:41:46.218 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6869e-05 2024-09-13T06:41:46.218 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.218 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.218 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:46.218 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:49.614332+0000", 2024-09-13T06:41:46.218 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.140501107 2024-09-13T06:41:46.218 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.218 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.218 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for rw locks", 2024-09-13T06:41:46.218 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:49.614496+0000", 2024-09-13T06:41:46.218 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00016451200000000001 2024-09-13T06:41:46.218 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.218 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.219 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:46.219 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:49.617131+0000", 2024-09-13T06:41:46.219 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.002634843 2024-09-13T06:41:46.219 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.219 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.219 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:46.219 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:49.617204+0000", 2024-09-13T06:41:46.219 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.2991000000000006e-05 2024-09-13T06:41:46.219 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.219 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.219 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:46.219 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:49.619208+0000", 2024-09-13T06:41:46.219 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.002004381 2024-09-13T06:41:46.219 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:46.219 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:46.219 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:46.220 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:46.220 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:46.220 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:41:46.220 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-13T06:41:46.221 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T06:41:46.221 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:41:46.221 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 146, 2024-09-13T06:41:46.222 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "e5612297-d004-4957-927e-afa37f30d6cf", 2024-09-13T06:41:46.222 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-09-13T06:38:56.670231+0000", 2024-09-13T06:41:46.222 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-09-13T06:41:44.516870+0000", 2024-09-13T06:41:46.222 INFO:teuthology.orchestra.run.smithi081.stdout: "last_up_change": "2024-09-13T06:41:16.368018+0000", 2024-09-13T06:41:46.222 INFO:teuthology.orchestra.run.smithi081.stdout: "last_in_change": "2024-09-13T06:41:10.658104+0000", 2024-09-13T06:41:46.222 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": "nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-13T06:41:46.222 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_num": 5804032, 2024-09-13T06:41:46.222 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_set": [ 2024-09-13T06:41:46.222 INFO:teuthology.orchestra.run.smithi081.stdout: "nodeep-scrub", 2024-09-13T06:41:46.222 INFO:teuthology.orchestra.run.smithi081.stdout: "pglog_hardlimit", 2024-09-13T06:41:46.222 INFO:teuthology.orchestra.run.smithi081.stdout: "purged_snapdirs", 2024-09-13T06:41:46.222 INFO:teuthology.orchestra.run.smithi081.stdout: "recovery_deletes", 2024-09-13T06:41:46.222 INFO:teuthology.orchestra.run.smithi081.stdout: "sortbitwise" 2024-09-13T06:41:46.223 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-13T06:41:46.223 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_version": 4, 2024-09-13T06:41:46.223 INFO:teuthology.orchestra.run.smithi081.stdout: "full_ratio": 0.94999998807907104, 2024-09-13T06:41:46.223 INFO:teuthology.orchestra.run.smithi081.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-09-13T06:41:46.223 INFO:teuthology.orchestra.run.smithi081.stdout: "nearfull_ratio": 0.85000002384185791, 2024-09-13T06:41:46.223 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_snapshot": "", 2024-09-13T06:41:46.223 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_max": 3, 2024-09-13T06:41:46.223 INFO:teuthology.orchestra.run.smithi081.stdout: "max_osd": 8, 2024-09-13T06:41:46.223 INFO:teuthology.orchestra.run.smithi081.stdout: "require_min_compat_client": "luminous", 2024-09-13T06:41:46.223 INFO:teuthology.orchestra.run.smithi081.stdout: "min_compat_client": "luminous", 2024-09-13T06:41:46.223 INFO:teuthology.orchestra.run.smithi081.stdout: "require_osd_release": "reef", 2024-09-13T06:41:46.223 INFO:teuthology.orchestra.run.smithi081.stdout: "allow_crimson": false, 2024-09-13T06:41:46.223 INFO:teuthology.orchestra.run.smithi081.stdout: "pools": [ 2024-09-13T06:41:46.223 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.223 INFO:teuthology.orchestra.run.smithi081.stdout: "pool": 1, 2024-09-13T06:41:46.224 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_name": ".mgr", 2024-09-13T06:41:46.224 INFO:teuthology.orchestra.run.smithi081.stdout: "create_time": "2024-09-13T06:39:09.600726+0000", 2024-09-13T06:41:46.224 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-13T06:41:46.224 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_names": "hashpspool", 2024-09-13T06:41:46.224 INFO:teuthology.orchestra.run.smithi081.stdout: "type": 1, 2024-09-13T06:41:46.224 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 2, 2024-09-13T06:41:46.224 INFO:teuthology.orchestra.run.smithi081.stdout: "min_size": 1, 2024-09-13T06:41:46.224 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_rule": 0, 2024-09-13T06:41:46.224 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_count": 0, 2024-09-13T06:41:46.224 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_target": 0, 2024-09-13T06:41:46.224 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_barrier": 0, 2024-09-13T06:41:46.224 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-13T06:41:46.224 INFO:teuthology.orchestra.run.smithi081.stdout: "object_hash": 2, 2024-09-13T06:41:46.224 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_mode": "off", 2024-09-13T06:41:46.225 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num": 1, 2024-09-13T06:41:46.225 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num": 1, 2024-09-13T06:41:46.225 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num_target": 1, 2024-09-13T06:41:46.225 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_target": 1, 2024-09-13T06:41:46.225 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_pending": 1, 2024-09-13T06:41:46.225 INFO:teuthology.orchestra.run.smithi081.stdout: "last_pg_merge_meta": { 2024-09-13T06:41:46.225 INFO:teuthology.orchestra.run.smithi081.stdout: "source_pgid": "0.0", 2024-09-13T06:41:46.225 INFO:teuthology.orchestra.run.smithi081.stdout: "ready_epoch": 0, 2024-09-13T06:41:46.225 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_started": 0, 2024-09-13T06:41:46.225 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_clean": 0, 2024-09-13T06:41:46.225 INFO:teuthology.orchestra.run.smithi081.stdout: "source_version": "0'0", 2024-09-13T06:41:46.225 INFO:teuthology.orchestra.run.smithi081.stdout: "target_version": "0'0" 2024-09-13T06:41:46.225 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.225 INFO:teuthology.orchestra.run.smithi081.stdout: "last_change": "16", 2024-09-13T06:41:46.226 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend": "0", 2024-09-13T06:41:46.226 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-13T06:41:46.226 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_preluminous": "0", 2024-09-13T06:41:46.226 INFO:teuthology.orchestra.run.smithi081.stdout: "auid": 0, 2024-09-13T06:41:46.226 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_mode": "selfmanaged", 2024-09-13T06:41:46.226 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_seq": 0, 2024-09-13T06:41:46.226 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_epoch": 0, 2024-09-13T06:41:46.226 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_snaps": [], 2024-09-13T06:41:46.226 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps": "[]", 2024-09-13T06:41:46.226 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_bytes": 0, 2024-09-13T06:41:46.226 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_objects": 0, 2024-09-13T06:41:46.226 INFO:teuthology.orchestra.run.smithi081.stdout: "tiers": [], 2024-09-13T06:41:46.226 INFO:teuthology.orchestra.run.smithi081.stdout: "tier_of": -1, 2024-09-13T06:41:46.226 INFO:teuthology.orchestra.run.smithi081.stdout: "read_tier": -1, 2024-09-13T06:41:46.226 INFO:teuthology.orchestra.run.smithi081.stdout: "write_tier": -1, 2024-09-13T06:41:46.227 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_mode": "none", 2024-09-13T06:41:46.227 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_bytes": 0, 2024-09-13T06:41:46.227 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_objects": 0, 2024-09-13T06:41:46.227 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-13T06:41:46.227 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-13T06:41:46.227 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-13T06:41:46.227 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_flush_age": 0, 2024-09-13T06:41:46.227 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_evict_age": 0, 2024-09-13T06:41:46.227 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profile": "", 2024-09-13T06:41:46.227 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_params": { 2024-09-13T06:41:46.227 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "none" 2024-09-13T06:41:46.227 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.227 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_period": 0, 2024-09-13T06:41:46.228 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_count": 0, 2024-09-13T06:41:46.228 INFO:teuthology.orchestra.run.smithi081.stdout: "use_gmt_hitset": true, 2024-09-13T06:41:46.228 INFO:teuthology.orchestra.run.smithi081.stdout: "min_read_recency_for_promote": 0, 2024-09-13T06:41:46.228 INFO:teuthology.orchestra.run.smithi081.stdout: "min_write_recency_for_promote": 0, 2024-09-13T06:41:46.228 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_grade_decay_rate": 0, 2024-09-13T06:41:46.228 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_search_last_n": 0, 2024-09-13T06:41:46.228 INFO:teuthology.orchestra.run.smithi081.stdout: "grade_table": [], 2024-09-13T06:41:46.228 INFO:teuthology.orchestra.run.smithi081.stdout: "stripe_width": 0, 2024-09-13T06:41:46.228 INFO:teuthology.orchestra.run.smithi081.stdout: "expected_num_objects": 0, 2024-09-13T06:41:46.228 INFO:teuthology.orchestra.run.smithi081.stdout: "fast_read": false, 2024-09-13T06:41:46.228 INFO:teuthology.orchestra.run.smithi081.stdout: "options": { 2024-09-13T06:41:46.228 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_max": 32, 2024-09-13T06:41:46.228 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_min": 1 2024-09-13T06:41:46.229 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.229 INFO:teuthology.orchestra.run.smithi081.stdout: "application_metadata": { 2024-09-13T06:41:46.229 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": {} 2024-09-13T06:41:46.229 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.229 INFO:teuthology.orchestra.run.smithi081.stdout: "read_balance": { 2024-09-13T06:41:46.229 INFO:teuthology.orchestra.run.smithi081.stdout: "error_message": "pool 1 has some PGs where all OSDs are with primary_affinity 0 (at least pg 1.0), read balance score may not be reliable", 2024-09-13T06:41:46.229 INFO:teuthology.orchestra.run.smithi081.stdout: "score_acting": 0, 2024-09-13T06:41:46.229 INFO:teuthology.orchestra.run.smithi081.stdout: "score_stable": 0 2024-09-13T06:41:46.229 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:46.229 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.229 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.229 INFO:teuthology.orchestra.run.smithi081.stdout: "pool": 2, 2024-09-13T06:41:46.229 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_name": "rbd", 2024-09-13T06:41:46.229 INFO:teuthology.orchestra.run.smithi081.stdout: "create_time": "2024-09-13T06:39:15.802118+0000", 2024-09-13T06:41:46.230 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 8193, 2024-09-13T06:41:46.230 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-13T06:41:46.230 INFO:teuthology.orchestra.run.smithi081.stdout: "type": 1, 2024-09-13T06:41:46.230 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 2, 2024-09-13T06:41:46.230 INFO:teuthology.orchestra.run.smithi081.stdout: "min_size": 1, 2024-09-13T06:41:46.230 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_rule": 0, 2024-09-13T06:41:46.230 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_count": 0, 2024-09-13T06:41:46.230 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_target": 0, 2024-09-13T06:41:46.230 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_barrier": 0, 2024-09-13T06:41:46.230 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-13T06:41:46.230 INFO:teuthology.orchestra.run.smithi081.stdout: "object_hash": 2, 2024-09-13T06:41:46.230 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_mode": "off", 2024-09-13T06:41:46.230 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num": 8, 2024-09-13T06:41:46.230 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num": 8, 2024-09-13T06:41:46.231 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num_target": 8, 2024-09-13T06:41:46.231 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_target": 8, 2024-09-13T06:41:46.231 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_pending": 8, 2024-09-13T06:41:46.231 INFO:teuthology.orchestra.run.smithi081.stdout: "last_pg_merge_meta": { 2024-09-13T06:41:46.231 INFO:teuthology.orchestra.run.smithi081.stdout: "source_pgid": "0.0", 2024-09-13T06:41:46.231 INFO:teuthology.orchestra.run.smithi081.stdout: "ready_epoch": 0, 2024-09-13T06:41:46.231 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_started": 0, 2024-09-13T06:41:46.231 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_clean": 0, 2024-09-13T06:41:46.231 INFO:teuthology.orchestra.run.smithi081.stdout: "source_version": "0'0", 2024-09-13T06:41:46.231 INFO:teuthology.orchestra.run.smithi081.stdout: "target_version": "0'0" 2024-09-13T06:41:46.231 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.231 INFO:teuthology.orchestra.run.smithi081.stdout: "last_change": "20", 2024-09-13T06:41:46.231 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend": "0", 2024-09-13T06:41:46.231 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-13T06:41:46.231 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_preluminous": "0", 2024-09-13T06:41:46.232 INFO:teuthology.orchestra.run.smithi081.stdout: "auid": 0, 2024-09-13T06:41:46.232 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_mode": "selfmanaged", 2024-09-13T06:41:46.232 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_seq": 3, 2024-09-13T06:41:46.232 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_epoch": 20, 2024-09-13T06:41:46.232 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_snaps": [], 2024-09-13T06:41:46.232 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps": "[]", 2024-09-13T06:41:46.232 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_bytes": 0, 2024-09-13T06:41:46.232 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_objects": 0, 2024-09-13T06:41:46.232 INFO:teuthology.orchestra.run.smithi081.stdout: "tiers": [], 2024-09-13T06:41:46.232 INFO:teuthology.orchestra.run.smithi081.stdout: "tier_of": -1, 2024-09-13T06:41:46.232 INFO:teuthology.orchestra.run.smithi081.stdout: "read_tier": -1, 2024-09-13T06:41:46.232 INFO:teuthology.orchestra.run.smithi081.stdout: "write_tier": -1, 2024-09-13T06:41:46.232 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_mode": "none", 2024-09-13T06:41:46.232 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_bytes": 0, 2024-09-13T06:41:46.232 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_objects": 0, 2024-09-13T06:41:46.233 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-13T06:41:46.233 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-13T06:41:46.233 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-13T06:41:46.233 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_flush_age": 0, 2024-09-13T06:41:46.233 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_evict_age": 0, 2024-09-13T06:41:46.233 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profile": "", 2024-09-13T06:41:46.233 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_params": { 2024-09-13T06:41:46.233 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "none" 2024-09-13T06:41:46.233 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.233 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_period": 0, 2024-09-13T06:41:46.233 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_count": 0, 2024-09-13T06:41:46.233 INFO:teuthology.orchestra.run.smithi081.stdout: "use_gmt_hitset": true, 2024-09-13T06:41:46.233 INFO:teuthology.orchestra.run.smithi081.stdout: "min_read_recency_for_promote": 0, 2024-09-13T06:41:46.233 INFO:teuthology.orchestra.run.smithi081.stdout: "min_write_recency_for_promote": 0, 2024-09-13T06:41:46.234 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_grade_decay_rate": 0, 2024-09-13T06:41:46.234 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_search_last_n": 0, 2024-09-13T06:41:46.234 INFO:teuthology.orchestra.run.smithi081.stdout: "grade_table": [], 2024-09-13T06:41:46.234 INFO:teuthology.orchestra.run.smithi081.stdout: "stripe_width": 0, 2024-09-13T06:41:46.234 INFO:teuthology.orchestra.run.smithi081.stdout: "expected_num_objects": 0, 2024-09-13T06:41:46.234 INFO:teuthology.orchestra.run.smithi081.stdout: "fast_read": false, 2024-09-13T06:41:46.234 INFO:teuthology.orchestra.run.smithi081.stdout: "options": {}, 2024-09-13T06:41:46.234 INFO:teuthology.orchestra.run.smithi081.stdout: "application_metadata": { 2024-09-13T06:41:46.234 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd": {} 2024-09-13T06:41:46.234 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.234 INFO:teuthology.orchestra.run.smithi081.stdout: "read_balance": { 2024-09-13T06:41:46.234 INFO:teuthology.orchestra.run.smithi081.stdout: "error_message": "pool 2 has some PGs where all OSDs are with primary_affinity 0 (at least pg 2.5), read balance score may not be reliable", 2024-09-13T06:41:46.234 INFO:teuthology.orchestra.run.smithi081.stdout: "score_acting": 0, 2024-09-13T06:41:46.234 INFO:teuthology.orchestra.run.smithi081.stdout: "score_stable": 0 2024-09-13T06:41:46.234 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:46.235 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.235 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.235 INFO:teuthology.orchestra.run.smithi081.stdout: "pool": 3, 2024-09-13T06:41:46.235 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_name": "pool_client.0", 2024-09-13T06:41:46.235 INFO:teuthology.orchestra.run.smithi081.stdout: "create_time": "2024-09-13T06:39:25.648942+0000", 2024-09-13T06:41:46.235 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 8193, 2024-09-13T06:41:46.235 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-13T06:41:46.235 INFO:teuthology.orchestra.run.smithi081.stdout: "type": 1, 2024-09-13T06:41:46.235 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 2, 2024-09-13T06:41:46.235 INFO:teuthology.orchestra.run.smithi081.stdout: "min_size": 1, 2024-09-13T06:41:46.235 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_rule": 0, 2024-09-13T06:41:46.235 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_count": 0, 2024-09-13T06:41:46.235 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_target": 0, 2024-09-13T06:41:46.235 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_barrier": 0, 2024-09-13T06:41:46.235 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-13T06:41:46.236 INFO:teuthology.orchestra.run.smithi081.stdout: "object_hash": 2, 2024-09-13T06:41:46.236 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_mode": "off", 2024-09-13T06:41:46.236 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num": 32, 2024-09-13T06:41:46.236 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num": 32, 2024-09-13T06:41:46.236 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num_target": 32, 2024-09-13T06:41:46.236 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_target": 32, 2024-09-13T06:41:46.236 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_pending": 32, 2024-09-13T06:41:46.236 INFO:teuthology.orchestra.run.smithi081.stdout: "last_pg_merge_meta": { 2024-09-13T06:41:46.236 INFO:teuthology.orchestra.run.smithi081.stdout: "source_pgid": "0.0", 2024-09-13T06:41:46.236 INFO:teuthology.orchestra.run.smithi081.stdout: "ready_epoch": 0, 2024-09-13T06:41:46.236 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_started": 0, 2024-09-13T06:41:46.236 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_clean": 0, 2024-09-13T06:41:46.236 INFO:teuthology.orchestra.run.smithi081.stdout: "source_version": "0'0", 2024-09-13T06:41:46.236 INFO:teuthology.orchestra.run.smithi081.stdout: "target_version": "0'0" 2024-09-13T06:41:46.236 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.237 INFO:teuthology.orchestra.run.smithi081.stdout: "last_change": "146", 2024-09-13T06:41:46.237 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend": "0", 2024-09-13T06:41:46.237 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-13T06:41:46.237 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_preluminous": "0", 2024-09-13T06:41:46.237 INFO:teuthology.orchestra.run.smithi081.stdout: "auid": 0, 2024-09-13T06:41:46.237 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_mode": "selfmanaged", 2024-09-13T06:41:46.237 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_seq": 81, 2024-09-13T06:41:46.237 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_epoch": 146, 2024-09-13T06:41:46.237 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_snaps": [], 2024-09-13T06:41:46.237 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps": "[]", 2024-09-13T06:41:46.237 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_bytes": 0, 2024-09-13T06:41:46.237 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_objects": 0, 2024-09-13T06:41:46.237 INFO:teuthology.orchestra.run.smithi081.stdout: "tiers": [], 2024-09-13T06:41:46.238 INFO:teuthology.orchestra.run.smithi081.stdout: "tier_of": -1, 2024-09-13T06:41:46.238 INFO:teuthology.orchestra.run.smithi081.stdout: "read_tier": -1, 2024-09-13T06:41:46.238 INFO:teuthology.orchestra.run.smithi081.stdout: "write_tier": -1, 2024-09-13T06:41:46.238 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_mode": "none", 2024-09-13T06:41:46.238 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_bytes": 0, 2024-09-13T06:41:46.238 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_objects": 0, 2024-09-13T06:41:46.238 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-13T06:41:46.238 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-13T06:41:46.238 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-13T06:41:46.238 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_flush_age": 0, 2024-09-13T06:41:46.238 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_evict_age": 0, 2024-09-13T06:41:46.238 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profile": "", 2024-09-13T06:41:46.238 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_params": { 2024-09-13T06:41:46.238 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "none" 2024-09-13T06:41:46.238 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.239 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_period": 0, 2024-09-13T06:41:46.239 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_count": 0, 2024-09-13T06:41:46.239 INFO:teuthology.orchestra.run.smithi081.stdout: "use_gmt_hitset": true, 2024-09-13T06:41:46.239 INFO:teuthology.orchestra.run.smithi081.stdout: "min_read_recency_for_promote": 0, 2024-09-13T06:41:46.239 INFO:teuthology.orchestra.run.smithi081.stdout: "min_write_recency_for_promote": 0, 2024-09-13T06:41:46.239 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_grade_decay_rate": 0, 2024-09-13T06:41:46.239 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_search_last_n": 0, 2024-09-13T06:41:46.239 INFO:teuthology.orchestra.run.smithi081.stdout: "grade_table": [], 2024-09-13T06:41:46.239 INFO:teuthology.orchestra.run.smithi081.stdout: "stripe_width": 0, 2024-09-13T06:41:46.239 INFO:teuthology.orchestra.run.smithi081.stdout: "expected_num_objects": 0, 2024-09-13T06:41:46.239 INFO:teuthology.orchestra.run.smithi081.stdout: "fast_read": false, 2024-09-13T06:41:46.239 INFO:teuthology.orchestra.run.smithi081.stdout: "options": {}, 2024-09-13T06:41:46.239 INFO:teuthology.orchestra.run.smithi081.stdout: "application_metadata": { 2024-09-13T06:41:46.239 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd": {} 2024-09-13T06:41:46.239 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.240 INFO:teuthology.orchestra.run.smithi081.stdout: "read_balance": { 2024-09-13T06:41:46.240 INFO:teuthology.orchestra.run.smithi081.stdout: "error_message": "pool 3 has some PGs where all OSDs are with primary_affinity 0 (at least pg 3.12), read balance score may not be reliable", 2024-09-13T06:41:46.240 INFO:teuthology.orchestra.run.smithi081.stdout: "score_acting": 0, 2024-09-13T06:41:46.240 INFO:teuthology.orchestra.run.smithi081.stdout: "score_stable": 0 2024-09-13T06:41:46.240 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:46.240 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:46.240 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-13T06:41:46.240 INFO:teuthology.orchestra.run.smithi081.stdout: "osds": [ 2024-09-13T06:41:46.240 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.240 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 0, 2024-09-13T06:41:46.240 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "54b0a3e4-58ad-4f95-86dc-29a11c9a1964", 2024-09-13T06:41:46.240 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2024-09-13T06:41:46.240 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2024-09-13T06:41:46.240 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2024-09-13T06:41:46.240 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 0, 2024-09-13T06:41:46.241 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2024-09-13T06:41:46.241 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2024-09-13T06:41:46.241 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2024-09-13T06:41:46.241 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 122, 2024-09-13T06:41:46.241 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2024-09-13T06:41:46.241 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2024-09-13T06:41:46.241 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-13T06:41:46.241 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:41:46.241 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.241 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:41:46.241 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6808", 2024-09-13T06:41:46.241 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 1904727940 2024-09-13T06:41:46.241 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.241 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.242 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:41:46.242 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6809", 2024-09-13T06:41:46.242 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 1904727940 2024-09-13T06:41:46.242 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:46.242 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:46.242 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.242 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2024-09-13T06:41:46.242 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:41:46.242 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.242 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:41:46.242 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6810", 2024-09-13T06:41:46.242 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 1904727940 2024-09-13T06:41:46.242 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.242 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.243 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:41:46.243 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6811", 2024-09-13T06:41:46.243 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 1904727940 2024-09-13T06:41:46.243 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:46.243 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:46.243 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.243 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2024-09-13T06:41:46.243 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:41:46.243 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.243 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:41:46.243 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6814", 2024-09-13T06:41:46.243 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 1904727940 2024-09-13T06:41:46.243 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.243 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.243 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:41:46.244 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6815", 2024-09-13T06:41:46.244 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 1904727940 2024-09-13T06:41:46.244 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:46.244 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:46.244 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.244 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2024-09-13T06:41:46.244 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:41:46.244 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.244 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:41:46.244 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6812", 2024-09-13T06:41:46.244 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 1904727940 2024-09-13T06:41:46.244 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.244 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.244 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:41:46.244 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6813", 2024-09-13T06:41:46.245 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 1904727940 2024-09-13T06:41:46.245 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:46.245 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:46.245 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.245 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6809/1904727940", 2024-09-13T06:41:46.245 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.81:6811/1904727940", 2024-09-13T06:41:46.245 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.81:6815/1904727940", 2024-09-13T06:41:46.245 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.81:6813/1904727940", 2024-09-13T06:41:46.245 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2024-09-13T06:41:46.245 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2024-09-13T06:41:46.245 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2024-09-13T06:41:46.245 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:46.245 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.245 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.246 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 1, 2024-09-13T06:41:46.246 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "a6dba5b9-c833-465e-a8a5-1741528b24c0", 2024-09-13T06:41:46.246 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2024-09-13T06:41:46.246 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2024-09-13T06:41:46.246 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2024-09-13T06:41:46.246 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2024-09-13T06:41:46.246 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2024-09-13T06:41:46.246 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2024-09-13T06:41:46.246 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2024-09-13T06:41:46.246 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 137, 2024-09-13T06:41:46.246 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2024-09-13T06:41:46.246 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2024-09-13T06:41:46.246 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-13T06:41:46.246 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:41:46.247 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.247 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:41:46.247 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6817", 2024-09-13T06:41:46.247 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 738205570 2024-09-13T06:41:46.247 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.247 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.247 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:41:46.247 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6819", 2024-09-13T06:41:46.247 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 738205570 2024-09-13T06:41:46.247 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:46.247 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:46.247 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.247 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2024-09-13T06:41:46.247 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:41:46.247 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.248 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:41:46.248 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6822", 2024-09-13T06:41:46.248 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 738205570 2024-09-13T06:41:46.248 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.248 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.248 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:41:46.248 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6824", 2024-09-13T06:41:46.248 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 738205570 2024-09-13T06:41:46.248 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:46.248 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:46.248 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.248 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2024-09-13T06:41:46.248 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:41:46.248 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.248 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:41:46.249 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6830", 2024-09-13T06:41:46.249 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 738205570 2024-09-13T06:41:46.249 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.249 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.249 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:41:46.249 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6831", 2024-09-13T06:41:46.249 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 738205570 2024-09-13T06:41:46.249 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:46.249 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:46.249 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.249 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2024-09-13T06:41:46.249 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:41:46.249 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.249 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:41:46.250 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6826", 2024-09-13T06:41:46.250 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 738205570 2024-09-13T06:41:46.250 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.250 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.250 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:41:46.250 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6829", 2024-09-13T06:41:46.250 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 738205570 2024-09-13T06:41:46.250 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:46.250 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:46.250 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.250 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6819/738205570", 2024-09-13T06:41:46.250 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.81:6824/738205570", 2024-09-13T06:41:46.250 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.81:6831/738205570", 2024-09-13T06:41:46.250 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.81:6829/738205570", 2024-09-13T06:41:46.250 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2024-09-13T06:41:46.250 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2024-09-13T06:41:46.251 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2024-09-13T06:41:46.251 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:46.251 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.251 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.251 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 2, 2024-09-13T06:41:46.251 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "6c45097e-44a2-454f-80a4-0fe879ccd52f", 2024-09-13T06:41:46.251 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2024-09-13T06:41:46.251 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2024-09-13T06:41:46.251 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2024-09-13T06:41:46.251 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2024-09-13T06:41:46.251 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2024-09-13T06:41:46.251 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2024-09-13T06:41:46.251 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2024-09-13T06:41:46.251 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 122, 2024-09-13T06:41:46.252 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2024-09-13T06:41:46.252 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2024-09-13T06:41:46.252 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-13T06:41:46.252 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:41:46.252 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.252 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:41:46.252 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6816", 2024-09-13T06:41:46.252 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 3558674335 2024-09-13T06:41:46.252 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.252 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.252 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:41:46.252 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6818", 2024-09-13T06:41:46.252 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 3558674335 2024-09-13T06:41:46.253 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:46.253 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:46.253 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.253 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2024-09-13T06:41:46.253 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:41:46.253 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.253 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:41:46.253 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6820", 2024-09-13T06:41:46.253 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 3558674335 2024-09-13T06:41:46.253 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.253 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.253 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:41:46.253 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6821", 2024-09-13T06:41:46.253 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 3558674335 2024-09-13T06:41:46.253 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:46.254 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:46.254 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.254 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2024-09-13T06:41:46.254 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:41:46.254 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.254 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:41:46.254 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6827", 2024-09-13T06:41:46.254 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 3558674335 2024-09-13T06:41:46.254 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.254 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.254 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:41:46.254 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6828", 2024-09-13T06:41:46.254 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 3558674335 2024-09-13T06:41:46.254 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:46.255 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:46.255 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.255 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2024-09-13T06:41:46.255 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:41:46.255 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.255 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:41:46.255 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6823", 2024-09-13T06:41:46.255 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 3558674335 2024-09-13T06:41:46.255 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.255 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.255 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:41:46.255 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6825", 2024-09-13T06:41:46.255 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 3558674335 2024-09-13T06:41:46.256 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:46.256 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:46.256 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.256 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6818/3558674335", 2024-09-13T06:41:46.256 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.81:6821/3558674335", 2024-09-13T06:41:46.256 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.81:6828/3558674335", 2024-09-13T06:41:46.256 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.81:6825/3558674335", 2024-09-13T06:41:46.256 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2024-09-13T06:41:46.256 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2024-09-13T06:41:46.256 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2024-09-13T06:41:46.256 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:46.256 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.256 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.256 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 3, 2024-09-13T06:41:46.257 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "31952760-06f3-4618-a5c4-f5c4fed3aadb", 2024-09-13T06:41:46.257 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2024-09-13T06:41:46.257 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2024-09-13T06:41:46.257 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2024-09-13T06:41:46.257 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2024-09-13T06:41:46.257 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2024-09-13T06:41:46.257 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2024-09-13T06:41:46.257 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2024-09-13T06:41:46.257 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 122, 2024-09-13T06:41:46.257 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2024-09-13T06:41:46.257 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2024-09-13T06:41:46.257 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-13T06:41:46.257 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:41:46.257 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.257 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:41:46.258 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6800", 2024-09-13T06:41:46.258 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 1886327229 2024-09-13T06:41:46.258 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.258 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.258 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:41:46.258 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6801", 2024-09-13T06:41:46.258 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 1886327229 2024-09-13T06:41:46.258 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:46.258 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:46.258 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.258 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2024-09-13T06:41:46.258 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:41:46.258 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.258 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:41:46.258 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6802", 2024-09-13T06:41:46.259 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 1886327229 2024-09-13T06:41:46.259 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.259 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.259 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:41:46.259 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6803", 2024-09-13T06:41:46.259 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 1886327229 2024-09-13T06:41:46.259 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:46.259 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:46.259 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.259 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2024-09-13T06:41:46.259 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:41:46.259 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.259 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:41:46.259 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6806", 2024-09-13T06:41:46.259 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 1886327229 2024-09-13T06:41:46.260 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.260 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.260 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:41:46.260 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6807", 2024-09-13T06:41:46.260 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 1886327229 2024-09-13T06:41:46.260 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:46.260 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:46.260 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.260 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2024-09-13T06:41:46.260 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:41:46.260 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.260 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:41:46.260 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6804", 2024-09-13T06:41:46.260 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 1886327229 2024-09-13T06:41:46.261 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.261 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.261 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:41:46.261 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6805", 2024-09-13T06:41:46.261 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 1886327229 2024-09-13T06:41:46.261 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:46.261 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:46.261 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.261 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6801/1886327229", 2024-09-13T06:41:46.261 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.81:6803/1886327229", 2024-09-13T06:41:46.261 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.81:6807/1886327229", 2024-09-13T06:41:46.261 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.81:6805/1886327229", 2024-09-13T06:41:46.261 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2024-09-13T06:41:46.262 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2024-09-13T06:41:46.262 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2024-09-13T06:41:46.262 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:46.262 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.262 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.262 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 4, 2024-09-13T06:41:46.262 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "c9bd2751-c836-43dc-b844-e13678cb2fd9", 2024-09-13T06:41:46.262 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2024-09-13T06:41:46.262 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2024-09-13T06:41:46.262 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0.58685302734375, 2024-09-13T06:41:46.262 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2024-09-13T06:41:46.262 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2024-09-13T06:41:46.262 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2024-09-13T06:41:46.262 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2024-09-13T06:41:46.262 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 137, 2024-09-13T06:41:46.263 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2024-09-13T06:41:46.263 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2024-09-13T06:41:46.263 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-13T06:41:46.263 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:41:46.263 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.263 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:41:46.263 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6817", 2024-09-13T06:41:46.263 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2184515621 2024-09-13T06:41:46.263 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.263 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.263 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:41:46.263 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6819", 2024-09-13T06:41:46.263 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2184515621 2024-09-13T06:41:46.263 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:46.264 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:46.264 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.264 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2024-09-13T06:41:46.264 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:41:46.264 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.264 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:41:46.264 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6820", 2024-09-13T06:41:46.264 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2184515621 2024-09-13T06:41:46.264 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.264 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.264 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:41:46.264 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6822", 2024-09-13T06:41:46.264 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2184515621 2024-09-13T06:41:46.264 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:46.265 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:46.265 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.265 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2024-09-13T06:41:46.265 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:41:46.265 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.265 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:41:46.265 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6827", 2024-09-13T06:41:46.265 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2184515621 2024-09-13T06:41:46.265 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.265 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.265 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:41:46.265 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6829", 2024-09-13T06:41:46.265 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2184515621 2024-09-13T06:41:46.265 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:46.265 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:46.266 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.266 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2024-09-13T06:41:46.266 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:41:46.266 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.266 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:41:46.266 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6824", 2024-09-13T06:41:46.266 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2184515621 2024-09-13T06:41:46.266 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.266 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.266 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:41:46.266 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6826", 2024-09-13T06:41:46.266 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2184515621 2024-09-13T06:41:46.266 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:46.266 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:46.267 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.267 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.139:6819/2184515621", 2024-09-13T06:41:46.267 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.139:6822/2184515621", 2024-09-13T06:41:46.267 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.139:6829/2184515621", 2024-09-13T06:41:46.267 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.139:6826/2184515621", 2024-09-13T06:41:46.267 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2024-09-13T06:41:46.267 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2024-09-13T06:41:46.267 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2024-09-13T06:41:46.267 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:46.267 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.267 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.267 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 5, 2024-09-13T06:41:46.267 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "2971b93a-6c9f-4b77-b526-4eac788fabf9", 2024-09-13T06:41:46.267 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2024-09-13T06:41:46.267 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2024-09-13T06:41:46.268 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2024-09-13T06:41:46.268 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 0.115264892578125, 2024-09-13T06:41:46.268 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2024-09-13T06:41:46.268 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2024-09-13T06:41:46.268 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2024-09-13T06:41:46.268 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 122, 2024-09-13T06:41:46.268 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2024-09-13T06:41:46.268 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2024-09-13T06:41:46.268 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-13T06:41:46.268 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:41:46.268 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.268 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:41:46.268 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6816", 2024-09-13T06:41:46.268 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 3982901834 2024-09-13T06:41:46.269 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.269 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.269 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:41:46.269 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6818", 2024-09-13T06:41:46.269 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 3982901834 2024-09-13T06:41:46.269 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:46.269 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:46.269 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.269 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2024-09-13T06:41:46.269 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:41:46.269 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.269 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:41:46.269 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6821", 2024-09-13T06:41:46.269 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 3982901834 2024-09-13T06:41:46.269 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.270 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.270 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:41:46.270 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6823", 2024-09-13T06:41:46.270 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 3982901834 2024-09-13T06:41:46.270 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:46.270 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:46.270 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.270 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2024-09-13T06:41:46.270 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:41:46.270 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.270 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:41:46.270 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6830", 2024-09-13T06:41:46.270 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 3982901834 2024-09-13T06:41:46.270 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.270 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.271 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:41:46.271 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6831", 2024-09-13T06:41:46.271 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 3982901834 2024-09-13T06:41:46.271 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:46.271 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:46.271 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.271 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2024-09-13T06:41:46.271 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:41:46.271 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.271 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:41:46.271 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6825", 2024-09-13T06:41:46.271 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 3982901834 2024-09-13T06:41:46.271 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.271 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.271 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:41:46.272 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6828", 2024-09-13T06:41:46.272 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 3982901834 2024-09-13T06:41:46.272 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:46.272 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:46.272 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.272 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.139:6818/3982901834", 2024-09-13T06:41:46.272 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.139:6823/3982901834", 2024-09-13T06:41:46.272 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.139:6831/3982901834", 2024-09-13T06:41:46.272 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.139:6828/3982901834", 2024-09-13T06:41:46.272 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2024-09-13T06:41:46.272 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2024-09-13T06:41:46.272 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2024-09-13T06:41:46.272 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:46.272 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.272 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.273 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 6, 2024-09-13T06:41:46.273 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "e1f786ce-579e-48cc-b212-83f881b94184", 2024-09-13T06:41:46.273 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2024-09-13T06:41:46.273 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2024-09-13T06:41:46.273 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2024-09-13T06:41:46.273 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 0.5466766357421875, 2024-09-13T06:41:46.273 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2024-09-13T06:41:46.273 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2024-09-13T06:41:46.273 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2024-09-13T06:41:46.273 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 122, 2024-09-13T06:41:46.273 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2024-09-13T06:41:46.273 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2024-09-13T06:41:46.273 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-13T06:41:46.274 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:41:46.274 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.274 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:41:46.274 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6800", 2024-09-13T06:41:46.274 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2283932666 2024-09-13T06:41:46.274 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.274 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.274 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:41:46.274 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6801", 2024-09-13T06:41:46.274 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2283932666 2024-09-13T06:41:46.274 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:46.274 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:46.274 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.274 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2024-09-13T06:41:46.274 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:41:46.275 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.275 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:41:46.275 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6802", 2024-09-13T06:41:46.275 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2283932666 2024-09-13T06:41:46.275 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.275 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.275 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:41:46.275 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6803", 2024-09-13T06:41:46.275 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2283932666 2024-09-13T06:41:46.275 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:46.275 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:46.275 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.275 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2024-09-13T06:41:46.276 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:41:46.276 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.276 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:41:46.276 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6806", 2024-09-13T06:41:46.276 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2283932666 2024-09-13T06:41:46.276 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.276 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.276 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:41:46.276 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6807", 2024-09-13T06:41:46.276 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2283932666 2024-09-13T06:41:46.276 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:46.276 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:46.276 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.276 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2024-09-13T06:41:46.276 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:41:46.277 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.277 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:41:46.277 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6804", 2024-09-13T06:41:46.277 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2283932666 2024-09-13T06:41:46.277 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.277 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.277 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:41:46.277 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6805", 2024-09-13T06:41:46.277 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2283932666 2024-09-13T06:41:46.277 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:46.277 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:46.277 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.277 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.139:6801/2283932666", 2024-09-13T06:41:46.278 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.139:6803/2283932666", 2024-09-13T06:41:46.278 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.139:6807/2283932666", 2024-09-13T06:41:46.278 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.139:6805/2283932666", 2024-09-13T06:41:46.278 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2024-09-13T06:41:46.278 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2024-09-13T06:41:46.278 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2024-09-13T06:41:46.278 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:46.278 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.278 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.278 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 7, 2024-09-13T06:41:46.278 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "a287ddf6-84eb-4225-b267-25eee1657625", 2024-09-13T06:41:46.278 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 0, 2024-09-13T06:41:46.279 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2024-09-13T06:41:46.279 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2024-09-13T06:41:46.279 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2024-09-13T06:41:46.279 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2024-09-13T06:41:46.279 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2024-09-13T06:41:46.279 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2024-09-13T06:41:46.279 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 113, 2024-09-13T06:41:46.279 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 122, 2024-09-13T06:41:46.279 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2024-09-13T06:41:46.279 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-13T06:41:46.279 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:41:46.279 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.279 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:41:46.280 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6808", 2024-09-13T06:41:46.280 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2348111157 2024-09-13T06:41:46.280 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.280 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.280 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:41:46.280 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6809", 2024-09-13T06:41:46.280 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2348111157 2024-09-13T06:41:46.280 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:46.280 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:46.280 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.280 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2024-09-13T06:41:46.280 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:41:46.280 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.280 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:41:46.281 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6810", 2024-09-13T06:41:46.281 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2348111157 2024-09-13T06:41:46.281 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.281 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.281 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:41:46.281 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6811", 2024-09-13T06:41:46.281 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2348111157 2024-09-13T06:41:46.281 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:46.281 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:46.281 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.281 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2024-09-13T06:41:46.281 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:41:46.281 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.282 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:41:46.282 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6814", 2024-09-13T06:41:46.282 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2348111157 2024-09-13T06:41:46.282 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.282 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.282 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:41:46.282 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6815", 2024-09-13T06:41:46.282 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2348111157 2024-09-13T06:41:46.282 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:46.282 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:46.282 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.282 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2024-09-13T06:41:46.282 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:41:46.282 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.282 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:41:46.283 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6812", 2024-09-13T06:41:46.283 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2348111157 2024-09-13T06:41:46.283 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.283 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.283 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:41:46.283 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6813", 2024-09-13T06:41:46.283 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2348111157 2024-09-13T06:41:46.283 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:46.283 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:46.283 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.283 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.139:6809/2348111157", 2024-09-13T06:41:46.283 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.139:6811/2348111157", 2024-09-13T06:41:46.283 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.139:6815/2348111157", 2024-09-13T06:41:46.283 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.139:6813/2348111157", 2024-09-13T06:41:46.283 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2024-09-13T06:41:46.284 INFO:teuthology.orchestra.run.smithi081.stdout: "exists" 2024-09-13T06:41:46.284 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:46.284 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:46.284 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-13T06:41:46.284 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_xinfo": [ 2024-09-13T06:41:46.284 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.284 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 0, 2024-09-13T06:41:46.284 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2024-09-13T06:41:46.284 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2024-09-13T06:41:46.284 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2024-09-13T06:41:46.284 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138322906710015, 2024-09-13T06:41:46.284 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2024-09-13T06:41:46.284 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2024-09-13T06:39:05.476871+0000", 2024-09-13T06:41:46.284 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2024-09-13T06:41:46.284 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.285 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.285 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 1, 2024-09-13T06:41:46.285 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2024-09-13T06:41:46.285 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2024-09-13T06:41:46.285 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2024-09-13T06:41:46.285 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138322906710015, 2024-09-13T06:41:46.285 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2024-09-13T06:41:46.285 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2024-09-13T06:39:05.455183+0000", 2024-09-13T06:41:46.285 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2024-09-13T06:41:46.285 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.285 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.285 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 2, 2024-09-13T06:41:46.285 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2024-09-13T06:41:46.285 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2024-09-13T06:41:46.286 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2024-09-13T06:41:46.286 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138322906710015, 2024-09-13T06:41:46.286 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2024-09-13T06:41:46.286 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2024-09-13T06:39:05.504853+0000", 2024-09-13T06:41:46.286 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2024-09-13T06:41:46.286 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.286 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.286 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 3, 2024-09-13T06:41:46.286 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2024-09-13T06:41:46.286 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2024-09-13T06:41:46.286 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2024-09-13T06:41:46.286 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138322906710015, 2024-09-13T06:41:46.286 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2024-09-13T06:41:46.286 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2024-09-13T06:39:05.372429+0000", 2024-09-13T06:41:46.286 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2024-09-13T06:41:46.287 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.287 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.287 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 4, 2024-09-13T06:41:46.287 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2024-09-13T06:41:46.287 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2024-09-13T06:41:46.287 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2024-09-13T06:41:46.287 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138322906710015, 2024-09-13T06:41:46.287 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2024-09-13T06:41:46.287 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2024-09-13T06:39:05.421023+0000", 2024-09-13T06:41:46.287 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2024-09-13T06:41:46.287 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.287 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.287 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 5, 2024-09-13T06:41:46.287 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2024-09-13T06:41:46.287 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2024-09-13T06:41:46.288 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2024-09-13T06:41:46.288 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138322906710015, 2024-09-13T06:41:46.288 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2024-09-13T06:41:46.288 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2024-09-13T06:39:05.477489+0000", 2024-09-13T06:41:46.288 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2024-09-13T06:41:46.288 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.288 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.288 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 6, 2024-09-13T06:41:46.288 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2024-09-13T06:41:46.288 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2024-09-13T06:41:46.288 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2024-09-13T06:41:46.288 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138322906710015, 2024-09-13T06:41:46.288 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2024-09-13T06:41:46.288 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2024-09-13T06:39:05.314700+0000", 2024-09-13T06:41:46.289 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2024-09-13T06:41:46.289 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.289 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.289 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 7, 2024-09-13T06:41:46.289 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2024-09-13T06:41:46.289 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2024-09-13T06:41:46.289 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2024-09-13T06:41:46.289 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138322906710015, 2024-09-13T06:41:46.289 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2024-09-13T06:41:46.289 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2024-09-13T06:39:05.462229+0000", 2024-09-13T06:41:46.289 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 122 2024-09-13T06:41:46.289 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:46.289 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-13T06:41:46.289 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_upmap": [ 2024-09-13T06:41:46.290 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.290 INFO:teuthology.orchestra.run.smithi081.stdout: "pgid": "3.15", 2024-09-13T06:41:46.290 INFO:teuthology.orchestra.run.smithi081.stdout: "osds": [ 2024-09-13T06:41:46.290 INFO:teuthology.orchestra.run.smithi081.stdout: 3, 2024-09-13T06:41:46.290 INFO:teuthology.orchestra.run.smithi081.stdout: 7 2024-09-13T06:41:46.290 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:46.290 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.290 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.290 INFO:teuthology.orchestra.run.smithi081.stdout: "pgid": "3.1a", 2024-09-13T06:41:46.290 INFO:teuthology.orchestra.run.smithi081.stdout: "osds": [ 2024-09-13T06:41:46.290 INFO:teuthology.orchestra.run.smithi081.stdout: 2, 2024-09-13T06:41:46.290 INFO:teuthology.orchestra.run.smithi081.stdout: 6 2024-09-13T06:41:46.290 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:46.290 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:46.290 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-13T06:41:46.291 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_upmap_items": [ 2024-09-13T06:41:46.291 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.291 INFO:teuthology.orchestra.run.smithi081.stdout: "pgid": "3.f", 2024-09-13T06:41:46.291 INFO:teuthology.orchestra.run.smithi081.stdout: "mappings": [ 2024-09-13T06:41:46.291 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.291 INFO:teuthology.orchestra.run.smithi081.stdout: "from": 4, 2024-09-13T06:41:46.291 INFO:teuthology.orchestra.run.smithi081.stdout: "to": 2 2024-09-13T06:41:46.291 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:46.291 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:46.291 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:46.291 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-13T06:41:46.291 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_upmap_primaries": [], 2024-09-13T06:41:46.291 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_temp": [], 2024-09-13T06:41:46.291 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_temp": [], 2024-09-13T06:41:46.292 INFO:teuthology.orchestra.run.smithi081.stdout: "blocklist": {}, 2024-09-13T06:41:46.292 INFO:teuthology.orchestra.run.smithi081.stdout: "range_blocklist": {}, 2024-09-13T06:41:46.292 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profiles": { 2024-09-13T06:41:46.292 INFO:teuthology.orchestra.run.smithi081.stdout: "default": { 2024-09-13T06:41:46.292 INFO:teuthology.orchestra.run.smithi081.stdout: "crush-failure-domain": "osd", 2024-09-13T06:41:46.292 INFO:teuthology.orchestra.run.smithi081.stdout: "k": "2", 2024-09-13T06:41:46.292 INFO:teuthology.orchestra.run.smithi081.stdout: "m": "1", 2024-09-13T06:41:46.292 INFO:teuthology.orchestra.run.smithi081.stdout: "plugin": "jerasure", 2024-09-13T06:41:46.292 INFO:teuthology.orchestra.run.smithi081.stdout: "technique": "reed_sol_van" 2024-09-13T06:41:46.292 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:46.292 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.292 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps_queue": [ 2024-09-13T06:41:46.292 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.292 INFO:teuthology.orchestra.run.smithi081.stdout: "pool": 3, 2024-09-13T06:41:46.292 INFO:teuthology.orchestra.run.smithi081.stdout: "snaps": [ 2024-09-13T06:41:46.293 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.293 INFO:teuthology.orchestra.run.smithi081.stdout: "begin": 62, 2024-09-13T06:41:46.293 INFO:teuthology.orchestra.run.smithi081.stdout: "length": 1 2024-09-13T06:41:46.293 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.293 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.293 INFO:teuthology.orchestra.run.smithi081.stdout: "begin": 65, 2024-09-13T06:41:46.293 INFO:teuthology.orchestra.run.smithi081.stdout: "length": 1 2024-09-13T06:41:46.293 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.293 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.293 INFO:teuthology.orchestra.run.smithi081.stdout: "begin": 68, 2024-09-13T06:41:46.293 INFO:teuthology.orchestra.run.smithi081.stdout: "length": 1 2024-09-13T06:41:46.293 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.293 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.293 INFO:teuthology.orchestra.run.smithi081.stdout: "begin": 71, 2024-09-13T06:41:46.293 INFO:teuthology.orchestra.run.smithi081.stdout: "length": 1 2024-09-13T06:41:46.294 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.294 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.294 INFO:teuthology.orchestra.run.smithi081.stdout: "begin": 74, 2024-09-13T06:41:46.294 INFO:teuthology.orchestra.run.smithi081.stdout: "length": 1 2024-09-13T06:41:46.294 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.294 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.294 INFO:teuthology.orchestra.run.smithi081.stdout: "begin": 77, 2024-09-13T06:41:46.294 INFO:teuthology.orchestra.run.smithi081.stdout: "length": 1 2024-09-13T06:41:46.294 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:46.294 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.294 INFO:teuthology.orchestra.run.smithi081.stdout: "begin": 80, 2024-09-13T06:41:46.294 INFO:teuthology.orchestra.run.smithi081.stdout: "length": 1 2024-09-13T06:41:46.294 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:46.294 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:46.294 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:46.295 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-13T06:41:46.295 INFO:teuthology.orchestra.run.smithi081.stdout: "new_removed_snaps": [ 2024-09-13T06:41:46.295 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.295 INFO:teuthology.orchestra.run.smithi081.stdout: "pool": 3, 2024-09-13T06:41:46.295 INFO:teuthology.orchestra.run.smithi081.stdout: "snaps": [ 2024-09-13T06:41:46.295 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:46.295 INFO:teuthology.orchestra.run.smithi081.stdout: "begin": 80, 2024-09-13T06:41:46.295 INFO:teuthology.orchestra.run.smithi081.stdout: "length": 1 2024-09-13T06:41:46.295 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:46.295 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:46.295 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:46.295 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-13T06:41:46.295 INFO:teuthology.orchestra.run.smithi081.stdout: "new_purged_snaps": [], 2024-09-13T06:41:46.295 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_node_flags": {}, 2024-09-13T06:41:46.296 INFO:teuthology.orchestra.run.smithi081.stdout: "device_class_flags": {}, 2024-09-13T06:41:46.296 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": { 2024-09-13T06:41:46.296 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode_enabled": false, 2024-09-13T06:41:46.296 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_bucket_count": 0, 2024-09-13T06:41:46.296 INFO:teuthology.orchestra.run.smithi081.stdout: "degraded_stretch_mode": 0, 2024-09-13T06:41:46.296 INFO:teuthology.orchestra.run.smithi081.stdout: "recovering_stretch_mode": 0, 2024-09-13T06:41:46.296 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode_bucket": 0 2024-09-13T06:41:46.296 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:46.296 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:41:46.297 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-13T06:41:46.299 INFO:tasks.thrashosds.thrasher:j is {'epoch': 146, 'fsid': 'e5612297-d004-4957-927e-afa37f30d6cf', 'created': '2024-09-13T06:38:56.670231+0000', 'modified': '2024-09-13T06:41:44.516870+0000', 'last_up_change': '2024-09-13T06:41:16.368018+0000', 'last_in_change': '2024-09-13T06:41:10.658104+0000', 'flags': 'nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5804032, 'flags_set': ['nodeep-scrub', 'pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 4, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 3, 'max_osd': 8, 'require_min_compat_client': 'luminous', 'min_compat_client': 'luminous', 'require_osd_release': 'reef', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T06:39:09.600726+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'error_message': 'pool 1 has some PGs where all OSDs are with primary_affinity 0 (at least pg 1.0), read balance score may not be reliable', 'score_acting': 0, 'score_stable': 0}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-09-13T06:39:15.802118+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 3, 'snap_epoch': 20, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'error_message': 'pool 2 has some PGs where all OSDs are with primary_affinity 0 (at least pg 2.5), read balance score may not be reliable', 'score_acting': 0, 'score_stable': 0}}, {'pool': 3, 'pool_name': 'pool_client.0', 'create_time': '2024-09-13T06:39:25.648942+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '146', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 81, 'snap_epoch': 146, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'error_message': 'pool 3 has some PGs where all OSDs are with primary_affinity 0 (at least pg 3.12), read balance score may not be reliable', 'score_acting': 0, 'score_stable': 0}}], 'osds': [{'osd': 0, 'uuid': '54b0a3e4-58ad-4f95-86dc-29a11c9a1964', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 0, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 122, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6808', 'nonce': 1904727940}, {'type': 'v1', 'addr': '172.21.15.81:6809', 'nonce': 1904727940}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6810', 'nonce': 1904727940}, {'type': 'v1', 'addr': '172.21.15.81:6811', 'nonce': 1904727940}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6814', 'nonce': 1904727940}, {'type': 'v1', 'addr': '172.21.15.81:6815', 'nonce': 1904727940}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6812', 'nonce': 1904727940}, {'type': 'v1', 'addr': '172.21.15.81:6813', 'nonce': 1904727940}]}, 'public_addr': '172.21.15.81:6809/1904727940', 'cluster_addr': '172.21.15.81:6811/1904727940', 'heartbeat_back_addr': '172.21.15.81:6815/1904727940', 'heartbeat_front_addr': '172.21.15.81:6813/1904727940', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': 'a6dba5b9-c833-465e-a8a5-1741528b24c0', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 137, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6817', 'nonce': 738205570}, {'type': 'v1', 'addr': '172.21.15.81:6819', 'nonce': 738205570}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6822', 'nonce': 738205570}, {'type': 'v1', 'addr': '172.21.15.81:6824', 'nonce': 738205570}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6830', 'nonce': 738205570}, {'type': 'v1', 'addr': '172.21.15.81:6831', 'nonce': 738205570}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6826', 'nonce': 738205570}, {'type': 'v1', 'addr': '172.21.15.81:6829', 'nonce': 738205570}]}, 'public_addr': '172.21.15.81:6819/738205570', 'cluster_addr': '172.21.15.81:6824/738205570', 'heartbeat_back_addr': '172.21.15.81:6831/738205570', 'heartbeat_front_addr': '172.21.15.81:6829/738205570', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': '6c45097e-44a2-454f-80a4-0fe879ccd52f', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 122, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6816', 'nonce': 3558674335}, {'type': 'v1', 'addr': '172.21.15.81:6818', 'nonce': 3558674335}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6820', 'nonce': 3558674335}, {'type': 'v1', 'addr': '172.21.15.81:6821', 'nonce': 3558674335}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6827', 'nonce': 3558674335}, {'type': 'v1', 'addr': '172.21.15.81:6828', 'nonce': 3558674335}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6823', 'nonce': 3558674335}, {'type': 'v1', 'addr': '172.21.15.81:6825', 'nonce': 3558674335}]}, 'public_addr': '172.21.15.81:6818/3558674335', 'cluster_addr': '172.21.15.81:6821/3558674335', 'heartbeat_back_addr': '172.21.15.81:6828/3558674335', 'heartbeat_front_addr': '172.21.15.81:6825/3558674335', 'state': ['exists', 'up']}, {'osd': 3, 'uuid': '31952760-06f3-4618-a5c4-f5c4fed3aadb', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 122, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6800', 'nonce': 1886327229}, {'type': 'v1', 'addr': '172.21.15.81:6801', 'nonce': 1886327229}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6802', 'nonce': 1886327229}, {'type': 'v1', 'addr': '172.21.15.81:6803', 'nonce': 1886327229}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6806', 'nonce': 1886327229}, {'type': 'v1', 'addr': '172.21.15.81:6807', 'nonce': 1886327229}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6804', 'nonce': 1886327229}, {'type': 'v1', 'addr': '172.21.15.81:6805', 'nonce': 1886327229}]}, 'public_addr': '172.21.15.81:6801/1886327229', 'cluster_addr': '172.21.15.81:6803/1886327229', 'heartbeat_back_addr': '172.21.15.81:6807/1886327229', 'heartbeat_front_addr': '172.21.15.81:6805/1886327229', 'state': ['exists', 'up']}, {'osd': 4, 'uuid': 'c9bd2751-c836-43dc-b844-e13678cb2fd9', 'up': 1, 'in': 1, 'weight': 0.58685302734375, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 137, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.139:6817', 'nonce': 2184515621}, {'type': 'v1', 'addr': '172.21.15.139:6819', 'nonce': 2184515621}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.139:6820', 'nonce': 2184515621}, {'type': 'v1', 'addr': '172.21.15.139:6822', 'nonce': 2184515621}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.139:6827', 'nonce': 2184515621}, {'type': 'v1', 'addr': '172.21.15.139:6829', 'nonce': 2184515621}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.139:6824', 'nonce': 2184515621}, {'type': 'v1', 'addr': '172.21.15.139:6826', 'nonce': 2184515621}]}, 'public_addr': '172.21.15.139:6819/2184515621', 'cluster_addr': '172.21.15.139:6822/2184515621', 'heartbeat_back_addr': '172.21.15.139:6829/2184515621', 'heartbeat_front_addr': '172.21.15.139:6826/2184515621', 'state': ['exists', 'up']}, {'osd': 5, 'uuid': '2971b93a-6c9f-4b77-b526-4eac788fabf9', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 0.115264892578125, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 122, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.139:6816', 'nonce': 3982901834}, {'type': 'v1', 'addr': '172.21.15.139:6818', 'nonce': 3982901834}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.139:6821', 'nonce': 3982901834}, {'type': 'v1', 'addr': '172.21.15.139:6823', 'nonce': 3982901834}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.139:6830', 'nonce': 3982901834}, {'type': 'v1', 'addr': '172.21.15.139:6831', 'nonce': 3982901834}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.139:6825', 'nonce': 3982901834}, {'type': 'v1', 'addr': '172.21.15.139:6828', 'nonce': 3982901834}]}, 'public_addr': '172.21.15.139:6818/3982901834', 'cluster_addr': '172.21.15.139:6823/3982901834', 'heartbeat_back_addr': '172.21.15.139:6831/3982901834', 'heartbeat_front_addr': '172.21.15.139:6828/3982901834', 'state': ['exists', 'up']}, {'osd': 6, 'uuid': 'e1f786ce-579e-48cc-b212-83f881b94184', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 0.5466766357421875, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 122, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.139:6800', 'nonce': 2283932666}, {'type': 'v1', 'addr': '172.21.15.139:6801', 'nonce': 2283932666}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.139:6802', 'nonce': 2283932666}, {'type': 'v1', 'addr': '172.21.15.139:6803', 'nonce': 2283932666}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.139:6806', 'nonce': 2283932666}, {'type': 'v1', 'addr': '172.21.15.139:6807', 'nonce': 2283932666}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.139:6804', 'nonce': 2283932666}, {'type': 'v1', 'addr': '172.21.15.139:6805', 'nonce': 2283932666}]}, 'public_addr': '172.21.15.139:6801/2283932666', 'cluster_addr': '172.21.15.139:6803/2283932666', 'heartbeat_back_addr': '172.21.15.139:6807/2283932666', 'heartbeat_front_addr': '172.21.15.139:6805/2283932666', 'state': ['exists', 'up']}, {'osd': 7, 'uuid': 'a287ddf6-84eb-4225-b267-25eee1657625', 'up': 0, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 113, 'down_at': 122, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.139:6808', 'nonce': 2348111157}, {'type': 'v1', 'addr': '172.21.15.139:6809', 'nonce': 2348111157}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.139:6810', 'nonce': 2348111157}, {'type': 'v1', 'addr': '172.21.15.139:6811', 'nonce': 2348111157}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.139:6814', 'nonce': 2348111157}, {'type': 'v1', 'addr': '172.21.15.139:6815', 'nonce': 2348111157}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.139:6812', 'nonce': 2348111157}, {'type': 'v1', 'addr': '172.21.15.139:6813', 'nonce': 2348111157}]}, 'public_addr': '172.21.15.139:6809/2348111157', 'cluster_addr': '172.21.15.139:6811/2348111157', 'heartbeat_back_addr': '172.21.15.139:6815/2348111157', 'heartbeat_front_addr': '172.21.15.139:6813/2348111157', 'state': ['exists']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-13T06:39:05.476871+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-13T06:39:05.455183+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-13T06:39:05.504853+0000', 'dead_epoch': 0}, {'osd': 3, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-13T06:39:05.372429+0000', 'dead_epoch': 0}, {'osd': 4, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-13T06:39:05.421023+0000', 'dead_epoch': 0}, {'osd': 5, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-13T06:39:05.477489+0000', 'dead_epoch': 0}, {'osd': 6, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-13T06:39:05.314700+0000', 'dead_epoch': 0}, {'osd': 7, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-13T06:39:05.462229+0000', 'dead_epoch': 122}], 'pg_upmap': [{'pgid': '3.15', 'osds': [3, 7]}, {'pgid': '3.1a', 'osds': [2, 6]}], 'pg_upmap_items': [{'pgid': '3.f', 'mappings': [{'from': 4, 'to': 2}]}], 'pg_upmap_primaries': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [{'pool': 3, 'snaps': [{'begin': 62, 'length': 1}, {'begin': 65, 'length': 1}, {'begin': 68, 'length': 1}, {'begin': 71, 'length': 1}, {'begin': 74, 'length': 1}, {'begin': 77, 'length': 1}, {'begin': 80, 'length': 1}]}], 'new_removed_snaps': [{'pool': 3, 'snaps': [{'begin': 80, 'length': 1}]}], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-09-13T06:41:46.299 INFO:tasks.thrashosds.thrasher:Clearing pg_upmap on 3.15 2024-09-13T06:41:46.299 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd rm-pg-upmap 3.15 2024-09-13T06:41:46.299 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:41:46.217+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:41:46.340 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:41:46.337+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:41:46.423 INFO:tasks.ceph.osd.6.smithi139.stderr:2024-09-13T06:41:46.418+0000 7fcd02c5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26385) UID: 0 2024-09-13T06:41:46.430 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:41:46.430 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [], 2024-09-13T06:41:46.430 INFO:teuthology.orchestra.run.smithi139.stdout: "num_ops": 0 2024-09-13T06:41:46.430 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:41:46.444 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-13T06:41:46.496 INFO:teuthology.orchestra.run.smithi081.stdout:osd.0: {} 2024-09-13T06:41:46.497 INFO:teuthology.orchestra.run.smithi081.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-13T06:41:46.512 INFO:teuthology.orchestra.run.smithi081.stdout:osd.1: {} 2024-09-13T06:41:46.512 INFO:teuthology.orchestra.run.smithi081.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-13T06:41:46.527 INFO:teuthology.orchestra.run.smithi081.stdout:osd.2: {} 2024-09-13T06:41:46.528 INFO:teuthology.orchestra.run.smithi081.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-13T06:41:46.528 INFO:tasks.ceph.osd.6.smithi139.stderr:2024-09-13T06:41:46.526+0000 7fcd02c5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26385) UID: 0 2024-09-13T06:41:46.545 INFO:teuthology.orchestra.run.smithi081.stdout:osd.3: {} 2024-09-13T06:41:46.546 INFO:teuthology.orchestra.run.smithi081.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-13T06:41:46.548 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-13T06:41:46.566 INFO:teuthology.orchestra.run.smithi081.stdout:osd.4: {} 2024-09-13T06:41:46.566 INFO:teuthology.orchestra.run.smithi081.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-13T06:41:46.585 INFO:teuthology.orchestra.run.smithi081.stdout:osd.5: {} 2024-09-13T06:41:46.586 INFO:teuthology.orchestra.run.smithi081.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-13T06:41:46.607 INFO:teuthology.orchestra.run.smithi081.stdout:osd.6: {} 2024-09-13T06:41:46.607 INFO:teuthology.orchestra.run.smithi081.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-13T06:41:46.607 INFO:teuthology.orchestra.run.smithi081.stderr:Error ENXIO: problem getting command descriptions from osd.7 2024-09-13T06:41:46.611 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:41:46.611 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:41:46.612 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-13T06:41:46.612 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-13T06:41:46.625 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-13T06:41:46.658 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:41:46.657+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:41:46.724 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:41:46.721+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:41:46.796 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:41:46.796 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:41:46.811 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-13T06:41:46.825 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:41:46.821+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:41:46.925 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:41:46.922+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:41:46.931 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:41:46.931 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:41:46.945 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-13T06:41:47.033 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:41:47.030+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:41:47.110 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:41:47.110 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:41:47.125 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-13T06:41:47.127 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:41:47.125+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:41:47.227 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:41:47.225+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:41:47.289 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:41:47.289 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:41:47.303 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-13T06:41:47.328 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:41:47.325+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:41:47.426 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:41:47.426 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:41:47.429 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:41:47.426+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:41:47.440 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-13T06:41:47.531 INFO:tasks.ceph.osd.6.smithi139.stderr:2024-09-13T06:41:47.526+0000 7fcd02c5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26385) UID: 0 2024-09-13T06:41:47.547 INFO:teuthology.orchestra.run.smithi081.stderr:nodeep-scrub is unset 2024-09-13T06:41:47.547 INFO:teuthology.orchestra.run.smithi081.stderr:clear 3.15 pg_upmap mapping 2024-09-13T06:41:47.611 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:41:47.611 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:41:47.627 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-13T06:41:47.631 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:41:47.629+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:41:47.732 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:41:47.733+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:41:47.794 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:41:47.794 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:41:47.808 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-13T06:41:47.854 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:41:47.853+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:41:47.933 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:41:47.929+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:41:47.939 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:41:47.940 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:41:47.954 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-13T06:41:48.034 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:41:48.030+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:41:48.122 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:41:48.122 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:41:48.135 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:41:48.133+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:41:48.136 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-13T06:41:48.235 INFO:tasks.ceph.osd.6.smithi139.stderr:2024-09-13T06:41:48.230+0000 7fcd02c5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26385) UID: 0 2024-09-13T06:41:48.301 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:41:48.301 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:41:48.315 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-13T06:41:48.336 INFO:tasks.ceph.osd.6.smithi139.stderr:2024-09-13T06:41:48.334+0000 7fcd02c5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26385) UID: 0 2024-09-13T06:41:48.432 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:41:48.433 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:41:48.437 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:41:48.434+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:41:48.446 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-13T06:41:48.538 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:41:48.537+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:41:48.572 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:41:48.572 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:41:48.588 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-13T06:41:48.613 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-13T06:41:48.639 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:41:48.634+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:41:48.661 INFO:teuthology.orchestra.run.smithi081.stdout:checking clone #25, image image_client.0-clone25 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent26 2024-09-13T06:41:48.740 INFO:tasks.ceph.osd.6.smithi139.stderr:2024-09-13T06:41:48.734+0000 7fcd02c5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26385) UID: 0 2024-09-13T06:41:48.758 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:41:48.758 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:41:48.783 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-13T06:41:48.789 INFO:teuthology.orchestra.run.smithi081.stdout:osd.0: {} 2024-09-13T06:41:48.789 INFO:teuthology.orchestra.run.smithi081.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-13T06:41:48.827 INFO:teuthology.orchestra.run.smithi081.stdout:osd.1: {} 2024-09-13T06:41:48.827 INFO:teuthology.orchestra.run.smithi081.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-13T06:41:48.841 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:41:48.837+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:41:48.858 INFO:teuthology.orchestra.run.smithi081.stdout:osd.2: {} 2024-09-13T06:41:48.858 INFO:teuthology.orchestra.run.smithi081.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-13T06:41:48.888 INFO:teuthology.orchestra.run.smithi081.stdout:osd.3: {} 2024-09-13T06:41:48.889 INFO:teuthology.orchestra.run.smithi081.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-13T06:41:48.908 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:41:48.908 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-13T06:41:48.908 INFO:teuthology.orchestra.run.smithi081.stdout: "num_ops": 0 2024-09-13T06:41:48.908 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:41:48.922 INFO:teuthology.orchestra.run.smithi081.stdout:osd.4: {} 2024-09-13T06:41:48.923 INFO:teuthology.orchestra.run.smithi081.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-13T06:41:48.924 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-13T06:41:48.942 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:41:48.938+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:41:48.953 INFO:teuthology.orchestra.run.smithi081.stdout:osd.5: {} 2024-09-13T06:41:48.954 INFO:teuthology.orchestra.run.smithi081.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-13T06:41:48.974 INFO:teuthology.orchestra.run.smithi081.stdout:osd.6: {} 2024-09-13T06:41:48.974 INFO:teuthology.orchestra.run.smithi081.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-13T06:41:48.974 INFO:teuthology.orchestra.run.smithi081.stderr:Error ENXIO: problem getting command descriptions from osd.7 2024-09-13T06:41:48.978 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-13T06:41:48.979 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-13T06:41:49.043 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:41:49.042+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:41:49.072 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:41:49.072 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-13T06:41:49.072 INFO:teuthology.orchestra.run.smithi081.stdout: "complaint_time": 30, 2024-09-13T06:41:49.072 INFO:teuthology.orchestra.run.smithi081.stdout: "num_blocked_ops": 0 2024-09-13T06:41:49.072 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:41:49.089 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-13T06:41:49.143 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:41:49.141+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:41:49.144 INFO:teuthology.orchestra.run.smithi081.stdout:4004 write 0x1f13442 thru 0x1f18e85 (0x5a44 bytes) 2024-09-13T06:41:49.155 INFO:teuthology.orchestra.run.smithi081.stdout:4005 read 0x18a3210 thru 0x18adb98 (0xa989 bytes) 2024-09-13T06:41:49.162 INFO:teuthology.orchestra.run.smithi081.stdout:4006 trunc from 0x27fda31 to 0x79a3cdb 2024-09-13T06:41:49.183 INFO:teuthology.orchestra.run.smithi081.stdout:4007 write 0xca4b195 thru 0xca4e02e (0x2e9a bytes) 2024-09-13T06:41:49.187 INFO:teuthology.orchestra.run.smithi081.stdout:4008 punch from 0x52fc4fb to 0x5305788, (0x928d bytes) 2024-09-13T06:41:49.198 INFO:teuthology.orchestra.run.smithi081.stdout:4010 trunc from 0xca4e02f to 0x43044c9 2024-09-13T06:41:49.221 INFO:teuthology.orchestra.run.smithi081.stdout:4011 punch from 0x31e8fd3 to 0x31f15fa, (0x8627 bytes) 2024-09-13T06:41:49.221 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:41:49.221 INFO:teuthology.orchestra.run.smithi081.stdout:4013 punch from 0x6a7a2f to 0x6b3f1d, (0xc4ee bytes) 2024-09-13T06:41:49.221 INFO:teuthology.orchestra.run.smithi081.stdout:4014 read 0x3fb7c4e thru 0x3fc0422 (0x87d5 bytes) 2024-09-13T06:41:49.222 INFO:teuthology.orchestra.run.smithi081.stdout:4015 read 0x2ecaf71 thru 0x2eccfa3 (0x2033 bytes) 2024-09-13T06:41:49.223 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:41:49.223 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 20, 2024-09-13T06:41:49.223 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 600, 2024-09-13T06:41:49.223 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [ 2024-09-13T06:41:49.223 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.223 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:36160 3.f 3:f62782c2:::rbd_object_map.11219660270d.0000000000000016:head [call] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-13T06:41:49.223 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:01.607291+0000", 2024-09-13T06:41:49.223 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 107.616508462, 2024-09-13T06:41:49.224 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.99619456699999998, 2024-09-13T06:41:49.224 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:49.224 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:49.224 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:49.224 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:49.224 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:49.224 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 36160 2024-09-13T06:41:49.224 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.224 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:49.224 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.224 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:49.224 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:01.607291+0000", 2024-09-13T06:41:49.225 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:49.225 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.225 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.225 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:49.225 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:01.607291+0000", 2024-09-13T06:41:49.225 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:49.225 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.225 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.225 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:49.225 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:01.607289+0000", 2024-09-13T06:41:49.225 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999976 2024-09-13T06:41:49.225 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.225 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.226 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:49.226 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:01.607302+0000", 2024-09-13T06:41:49.226 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3018e-05 2024-09-13T06:41:49.226 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.226 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.226 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:49.226 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:01.607323+0000", 2024-09-13T06:41:49.226 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1030999999999999e-05 2024-09-13T06:41:49.226 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.226 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.226 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:49.226 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:01.607342+0000", 2024-09-13T06:41:49.226 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8961e-05 2024-09-13T06:41:49.226 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.227 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.227 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:49.227 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:01.607425+0000", 2024-09-13T06:41:49.227 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.3171999999999996e-05 2024-09-13T06:41:49.227 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.227 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.227 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:41:49.227 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:01.607441+0000", 2024-09-13T06:41:49.227 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5996999999999999e-05 2024-09-13T06:41:49.227 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.227 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.227 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:49.227 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:02.596186+0000", 2024-09-13T06:41:49.228 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.98874432000000001 2024-09-13T06:41:49.228 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.228 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.228 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for missing object", 2024-09-13T06:41:49.228 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:02.596618+0000", 2024-09-13T06:41:49.228 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000432032 2024-09-13T06:41:49.228 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.228 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.228 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:49.228 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:02.600845+0000", 2024-09-13T06:41:49.228 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0042277410000000001 2024-09-13T06:41:49.228 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.228 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.229 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:49.229 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:02.601003+0000", 2024-09-13T06:41:49.229 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00015731999999999999 2024-09-13T06:41:49.229 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.229 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.229 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:49.229 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:02.603486+0000", 2024-09-13T06:41:49.229 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0024832510000000001 2024-09-13T06:41:49.229 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:49.229 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:49.229 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:49.229 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.230 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.230 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:37806 3.9 3:951cb95b:::rbd_data.1121d8143c6e.0000000000000002:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e56)", 2024-09-13T06:41:49.230 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:06.373482+0000", 2024-09-13T06:41:49.230 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 102.850317426, 2024-09-13T06:41:49.230 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.002476213, 2024-09-13T06:41:49.230 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:49.230 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:49.230 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:49.230 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:49.230 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:49.230 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 37806 2024-09-13T06:41:49.230 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.230 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:49.230 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.231 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:49.231 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.373482+0000", 2024-09-13T06:41:49.231 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:49.231 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.231 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.231 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:49.231 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.373482+0000", 2024-09-13T06:41:49.231 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:49.231 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.231 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.231 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:49.231 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.373479+0000", 2024-09-13T06:41:49.231 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999962 2024-09-13T06:41:49.231 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.232 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.232 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:49.232 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.373495+0000", 2024-09-13T06:41:49.232 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6640999999999999e-05 2024-09-13T06:41:49.232 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.232 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.232 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:49.232 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.373542+0000", 2024-09-13T06:41:49.232 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6229000000000001e-05 2024-09-13T06:41:49.232 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.232 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.232 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:49.232 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.373564+0000", 2024-09-13T06:41:49.233 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2684000000000002e-05 2024-09-13T06:41:49.233 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.233 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.233 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:49.233 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374268+0000", 2024-09-13T06:41:49.233 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00070363700000000001 2024-09-13T06:41:49.233 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.233 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.233 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:41:49.233 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374305+0000", 2024-09-13T06:41:49.233 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.6936e-05 2024-09-13T06:41:49.233 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.233 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.234 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:49.234 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.375175+0000", 2024-09-13T06:41:49.234 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.000870454 2024-09-13T06:41:49.234 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.234 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.234 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:49.234 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.375678+0000", 2024-09-13T06:41:49.234 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00050292499999999999 2024-09-13T06:41:49.234 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.234 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.234 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:49.234 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.375959+0000", 2024-09-13T06:41:49.234 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00028050599999999997 2024-09-13T06:41:49.235 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:49.235 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:49.235 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:49.235 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.235 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.235 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:37821 3.9 3:951cb95b:::rbd_data.1121d8143c6e.0000000000000002:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e56)", 2024-09-13T06:41:49.235 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:06.374454+0000", 2024-09-13T06:41:49.235 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 102.849346309, 2024-09-13T06:41:49.235 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.002545072, 2024-09-13T06:41:49.235 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:49.235 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:49.235 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:49.235 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:49.236 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:49.236 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 37821 2024-09-13T06:41:49.236 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.236 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:49.236 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.236 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:49.236 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374454+0000", 2024-09-13T06:41:49.236 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:49.236 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.236 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.236 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:49.236 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374454+0000", 2024-09-13T06:41:49.236 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:49.237 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.237 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.237 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:49.237 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374452+0000", 2024-09-13T06:41:49.237 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999981 2024-09-13T06:41:49.237 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.237 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.237 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:49.237 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374463+0000", 2024-09-13T06:41:49.237 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0756e-05 2024-09-13T06:41:49.237 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.237 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.237 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:49.237 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374487+0000", 2024-09-13T06:41:49.238 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4887000000000001e-05 2024-09-13T06:41:49.238 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.238 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.238 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:49.238 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374504+0000", 2024-09-13T06:41:49.238 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6852000000000001e-05 2024-09-13T06:41:49.238 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.238 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.238 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:49.238 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374829+0000", 2024-09-13T06:41:49.238 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000324684 2024-09-13T06:41:49.238 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.238 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.239 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:41:49.239 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374880+0000", 2024-09-13T06:41:49.239 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.1378000000000002e-05 2024-09-13T06:41:49.239 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.239 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.239 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:49.239 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.376423+0000", 2024-09-13T06:41:49.239 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.001542734 2024-09-13T06:41:49.239 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.239 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.239 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:49.239 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.376607+0000", 2024-09-13T06:41:49.239 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000183656 2024-09-13T06:41:49.240 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.240 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.240 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:49.240 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.376999+0000", 2024-09-13T06:41:49.240 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00039191200000000001 2024-09-13T06:41:49.240 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:49.240 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:49.240 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:49.240 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.240 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.240 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:37836 3.9 3:951cb95b:::rbd_data.1121d8143c6e.0000000000000002:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e56)", 2024-09-13T06:41:49.240 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:06.374929+0000", 2024-09-13T06:41:49.241 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 102.84887065700001, 2024-09-13T06:41:49.241 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.002778825, 2024-09-13T06:41:49.241 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:49.241 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:49.241 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:49.241 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:49.241 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:49.241 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 37836 2024-09-13T06:41:49.241 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.241 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:49.241 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.241 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:49.241 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374929+0000", 2024-09-13T06:41:49.242 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:49.242 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.242 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.242 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:49.242 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374929+0000", 2024-09-13T06:41:49.242 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:49.243 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.243 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.243 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:49.243 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374927+0000", 2024-09-13T06:41:49.243 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999981 2024-09-13T06:41:49.243 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.243 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.243 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:49.243 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374939+0000", 2024-09-13T06:41:49.243 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1846e-05 2024-09-13T06:41:49.243 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.243 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.243 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:49.244 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374962+0000", 2024-09-13T06:41:49.244 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3054e-05 2024-09-13T06:41:49.244 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.244 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.244 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:49.244 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374978+0000", 2024-09-13T06:41:49.244 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5899000000000001e-05 2024-09-13T06:41:49.244 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.244 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.244 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:49.244 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.375106+0000", 2024-09-13T06:41:49.244 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00012789 2024-09-13T06:41:49.244 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.245 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.245 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:41:49.245 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.375134+0000", 2024-09-13T06:41:49.245 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.8254000000000001e-05 2024-09-13T06:41:49.245 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.245 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.245 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:49.245 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.377082+0000", 2024-09-13T06:41:49.245 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0019471520000001 2024-09-13T06:41:49.245 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.245 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.245 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:49.245 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.377330+0000", 2024-09-13T06:41:49.246 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00024834199999999997 2024-09-13T06:41:49.246 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.246 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.246 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:49.246 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.377708+0000", 2024-09-13T06:41:49.246 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00037817100000000001 2024-09-13T06:41:49.246 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:49.246 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:49.246 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:49.246 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.246 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.246 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:37851 3.9 3:951cb95b:::rbd_data.1121d8143c6e.0000000000000002:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e56)", 2024-09-13T06:41:49.246 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:06.382636+0000", 2024-09-13T06:41:49.247 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 102.841163772, 2024-09-13T06:41:49.247 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.99582539400000003, 2024-09-13T06:41:49.247 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:49.247 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:49.247 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:49.247 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:49.247 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:49.247 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 37851 2024-09-13T06:41:49.247 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.247 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:49.247 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.247 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:49.247 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.382636+0000", 2024-09-13T06:41:49.247 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:49.248 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.248 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.248 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:49.248 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.382636+0000", 2024-09-13T06:41:49.248 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:49.248 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.248 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.248 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:49.248 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.382633+0000", 2024-09-13T06:41:49.248 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999971 2024-09-13T06:41:49.248 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.248 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.248 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:49.249 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.382652+0000", 2024-09-13T06:41:49.249 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8834999999999998e-05 2024-09-13T06:41:49.249 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.249 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.249 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:49.249 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.382695+0000", 2024-09-13T06:41:49.249 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.3136000000000002e-05 2024-09-13T06:41:49.249 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.249 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.249 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:49.249 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.382716+0000", 2024-09-13T06:41:49.249 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1421e-05 2024-09-13T06:41:49.249 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.249 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.250 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:49.250 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.382860+0000", 2024-09-13T06:41:49.250 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00014389200000000001 2024-09-13T06:41:49.250 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.250 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.250 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:41:49.250 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.382890+0000", 2024-09-13T06:41:49.250 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9827000000000001e-05 2024-09-13T06:41:49.250 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.250 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.250 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:49.250 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.377779+0000", 2024-09-13T06:41:49.250 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.99488842899999996 2024-09-13T06:41:49.251 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.251 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.251 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:49.251 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.378007+0000", 2024-09-13T06:41:49.251 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00022838099999999999 2024-09-13T06:41:49.251 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.251 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.251 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:49.251 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.378462+0000", 2024-09-13T06:41:49.251 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00045452300000000003 2024-09-13T06:41:49.251 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:49.251 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:49.251 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:49.251 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.252 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.252 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:37866 3.9 3:951cb95b:::rbd_data.1121d8143c6e.0000000000000002:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e56)", 2024-09-13T06:41:49.252 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:06.383951+0000", 2024-09-13T06:41:49.252 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 102.839849086, 2024-09-13T06:41:49.252 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.99517962299999996, 2024-09-13T06:41:49.252 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:49.252 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:49.252 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:49.252 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:49.252 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:49.252 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 37866 2024-09-13T06:41:49.252 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.253 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:49.253 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.253 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:49.253 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.383951+0000", 2024-09-13T06:41:49.253 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:49.253 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.253 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.253 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:49.253 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.383951+0000", 2024-09-13T06:41:49.253 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:49.253 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.253 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.253 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:49.254 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.383949+0000", 2024-09-13T06:41:49.254 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999981 2024-09-13T06:41:49.254 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.254 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.254 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:49.254 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.383961+0000", 2024-09-13T06:41:49.254 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1999e-05 2024-09-13T06:41:49.254 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.254 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.254 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:49.254 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384019+0000", 2024-09-13T06:41:49.254 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7621000000000003e-05 2024-09-13T06:41:49.254 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.254 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.255 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:49.255 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384040+0000", 2024-09-13T06:41:49.255 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1528000000000001e-05 2024-09-13T06:41:49.255 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.255 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.255 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:49.255 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384186+0000", 2024-09-13T06:41:49.255 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00014573799999999999 2024-09-13T06:41:49.255 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.255 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.255 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:41:49.255 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384204+0000", 2024-09-13T06:41:49.255 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7992e-05 2024-09-13T06:41:49.256 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.256 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.256 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:49.256 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.378536+0000", 2024-09-13T06:41:49.256 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.99433268600000002 2024-09-13T06:41:49.256 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.256 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.256 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:49.256 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.378771+0000", 2024-09-13T06:41:49.256 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00023445399999999999 2024-09-13T06:41:49.256 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.256 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.256 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:49.257 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.379130+0000", 2024-09-13T06:41:49.257 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00035954200000000002 2024-09-13T06:41:49.257 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:49.257 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:49.257 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:49.257 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.257 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.257 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:37881 3.9 3:951cb95b:::rbd_data.1121d8143c6e.0000000000000002:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e56)", 2024-09-13T06:41:49.257 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:06.384239+0000", 2024-09-13T06:41:49.257 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 102.839560672, 2024-09-13T06:41:49.257 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.99541483500000005, 2024-09-13T06:41:49.257 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:49.257 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:49.258 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:49.258 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:49.258 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:49.258 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 37881 2024-09-13T06:41:49.258 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.258 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:49.258 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.258 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:49.258 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384239+0000", 2024-09-13T06:41:49.258 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:49.258 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.258 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.258 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:49.258 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384239+0000", 2024-09-13T06:41:49.259 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:49.259 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.259 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.259 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:49.259 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384238+0000", 2024-09-13T06:41:49.259 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999986 2024-09-13T06:41:49.259 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.259 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.259 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:49.259 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384246+0000", 2024-09-13T06:41:49.259 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.2449999999999998e-06 2024-09-13T06:41:49.259 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.259 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.260 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:49.260 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384268+0000", 2024-09-13T06:41:49.260 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1518e-05 2024-09-13T06:41:49.260 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.260 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.260 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:49.260 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384282+0000", 2024-09-13T06:41:49.260 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4501999999999999e-05 2024-09-13T06:41:49.260 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.260 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.260 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:49.260 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384356+0000", 2024-09-13T06:41:49.260 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4265999999999997e-05 2024-09-13T06:41:49.261 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.261 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.261 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:41:49.261 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384370+0000", 2024-09-13T06:41:49.261 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3942e-05 2024-09-13T06:41:49.261 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.261 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.261 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:49.261 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.379199+0000", 2024-09-13T06:41:49.261 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.99482866599999997 2024-09-13T06:41:49.261 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.261 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.261 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:49.261 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.379347+0000", 2024-09-13T06:41:49.262 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00014749199999999999 2024-09-13T06:41:49.262 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.262 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.262 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:49.262 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.379654+0000", 2024-09-13T06:41:49.262 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00030752999999999998 2024-09-13T06:41:49.262 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:49.262 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:49.262 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:49.262 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.262 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.262 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:37896 3.9 3:951cb95b:::rbd_data.1121d8143c6e.0000000000000002:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e56)", 2024-09-13T06:41:49.262 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:06.384412+0000", 2024-09-13T06:41:49.263 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 102.839388239, 2024-09-13T06:41:49.263 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.99777835999999998, 2024-09-13T06:41:49.263 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:49.263 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:49.263 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:49.263 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:49.263 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:49.263 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 37896 2024-09-13T06:41:49.263 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.263 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:49.263 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.263 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:49.263 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384412+0000", 2024-09-13T06:41:49.264 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:49.264 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.264 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.264 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:49.264 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384412+0000", 2024-09-13T06:41:49.264 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:49.264 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.264 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.264 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:49.264 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384410+0000", 2024-09-13T06:41:49.264 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.999999 2024-09-13T06:41:49.264 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.264 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.264 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:49.265 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384418+0000", 2024-09-13T06:41:49.265 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.486e-06 2024-09-13T06:41:49.265 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.265 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.265 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:49.265 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384436+0000", 2024-09-13T06:41:49.265 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7668000000000001e-05 2024-09-13T06:41:49.265 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.265 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.265 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:49.265 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384449+0000", 2024-09-13T06:41:49.265 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3395e-05 2024-09-13T06:41:49.265 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.266 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.266 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:49.266 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384605+0000", 2024-09-13T06:41:49.266 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00015563099999999999 2024-09-13T06:41:49.266 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.266 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.266 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:41:49.266 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384635+0000", 2024-09-13T06:41:49.266 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.0383999999999999e-05 2024-09-13T06:41:49.266 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.266 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.266 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:49.266 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.379730+0000", 2024-09-13T06:41:49.266 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.99509493999999998 2024-09-13T06:41:49.267 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.267 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.267 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:49.267 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.379964+0000", 2024-09-13T06:41:49.267 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00023353499999999999 2024-09-13T06:41:49.267 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.267 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.267 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:49.267 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.382190+0000", 2024-09-13T06:41:49.267 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0022265039999999998 2024-09-13T06:41:49.267 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:49.267 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:49.267 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:49.268 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.268 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.268 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43222 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 389120~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:49.268 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558181+0000", 2024-09-13T06:41:49.268 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 87.665618984999995, 2024-09-13T06:41:49.268 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.06252038, 2024-09-13T06:41:49.268 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:49.268 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:49.268 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:49.268 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:49.268 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:49.268 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43222 2024-09-13T06:41:49.269 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.269 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:49.269 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.269 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:49.269 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558181+0000", 2024-09-13T06:41:49.269 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:49.269 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.269 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.269 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:49.269 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558181+0000", 2024-09-13T06:41:49.269 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:49.269 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.269 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.270 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:49.270 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558181+0000", 2024-09-13T06:41:49.270 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:49.270 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.270 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.270 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:49.270 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558183+0000", 2024-09-13T06:41:49.270 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.857e-06 2024-09-13T06:41:49.270 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.270 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.270 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:49.270 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558188+0000", 2024-09-13T06:41:49.271 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3759999999999999e-06 2024-09-13T06:41:49.271 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.271 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.271 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:49.271 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558261+0000", 2024-09-13T06:41:49.271 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3097999999999997e-05 2024-09-13T06:41:49.271 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.271 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.271 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:49.271 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.620354+0000", 2024-09-13T06:41:49.271 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.062092587999999997 2024-09-13T06:41:49.271 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.271 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.271 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:49.272 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.620428+0000", 2024-09-13T06:41:49.272 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3954000000000004e-05 2024-09-13T06:41:49.272 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.272 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.272 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:49.272 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.620701+0000", 2024-09-13T06:41:49.272 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000273773 2024-09-13T06:41:49.272 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:49.272 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:49.272 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:49.272 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.272 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.272 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43223 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 393216~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:49.273 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558267+0000", 2024-09-13T06:41:49.273 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 87.665532928000005, 2024-09-13T06:41:49.273 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.062813151999999997, 2024-09-13T06:41:49.273 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:49.273 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:49.273 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:49.273 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:49.273 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:49.273 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43223 2024-09-13T06:41:49.273 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.273 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:49.273 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.273 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:49.274 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558267+0000", 2024-09-13T06:41:49.274 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:49.274 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.274 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.274 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:49.274 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558267+0000", 2024-09-13T06:41:49.274 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:49.274 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.274 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.274 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:49.274 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558266+0000", 2024-09-13T06:41:49.274 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:49.274 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.275 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.275 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:49.275 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558270+0000", 2024-09-13T06:41:49.275 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.2389999999999998e-06 2024-09-13T06:41:49.275 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.275 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.275 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:49.275 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558277+0000", 2024-09-13T06:41:49.275 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5680000000000002e-06 2024-09-13T06:41:49.275 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.275 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.275 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:49.275 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558282+0000", 2024-09-13T06:41:49.275 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7060000000000003e-06 2024-09-13T06:41:49.276 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.276 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.276 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:49.276 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.620731+0000", 2024-09-13T06:41:49.276 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.062448661000000003 2024-09-13T06:41:49.276 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.276 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.276 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:49.276 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.620806+0000", 2024-09-13T06:41:49.276 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5862e-05 2024-09-13T06:41:49.276 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.276 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.276 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:49.277 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.621080+0000", 2024-09-13T06:41:49.277 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00027368599999999998 2024-09-13T06:41:49.277 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:49.277 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:49.277 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:49.277 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.277 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.277 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43224 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 407552~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:49.277 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558286+0000", 2024-09-13T06:41:49.277 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 87.665513563999994, 2024-09-13T06:41:49.277 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.063179052999999999, 2024-09-13T06:41:49.277 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:49.277 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:49.278 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:49.278 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:49.278 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:49.278 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43224 2024-09-13T06:41:49.278 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.278 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:49.278 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.278 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:49.278 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558286+0000", 2024-09-13T06:41:49.278 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:49.278 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.278 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.278 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:49.278 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558286+0000", 2024-09-13T06:41:49.279 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:49.279 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.279 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.279 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:49.279 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558286+0000", 2024-09-13T06:41:49.279 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:49.279 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.279 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.279 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:49.279 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558288+0000", 2024-09-13T06:41:49.279 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.227e-06 2024-09-13T06:41:49.279 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.279 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.280 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:49.280 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558292+0000", 2024-09-13T06:41:49.280 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.6289999999999999e-06 2024-09-13T06:41:49.280 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.280 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.280 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:49.280 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558294+0000", 2024-09-13T06:41:49.280 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5409999999999999e-06 2024-09-13T06:41:49.280 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.280 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.280 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:49.280 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.621110+0000", 2024-09-13T06:41:49.280 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.062815776000000004 2024-09-13T06:41:49.280 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.281 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.281 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:49.281 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.621186+0000", 2024-09-13T06:41:49.281 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5570999999999999e-05 2024-09-13T06:41:49.281 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.281 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.281 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:49.281 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.621465+0000", 2024-09-13T06:41:49.281 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00027988200000000001 2024-09-13T06:41:49.281 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:49.281 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:49.281 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:49.281 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.282 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.282 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43225 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 421888~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:49.282 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558296+0000", 2024-09-13T06:41:49.282 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 87.665503596999997, 2024-09-13T06:41:49.282 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.063551110999999993, 2024-09-13T06:41:49.282 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:49.282 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:49.282 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:49.282 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:49.282 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:49.282 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43225 2024-09-13T06:41:49.282 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.282 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:49.283 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.283 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:49.283 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558296+0000", 2024-09-13T06:41:49.283 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:49.283 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.283 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.283 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:49.283 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558296+0000", 2024-09-13T06:41:49.283 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:49.283 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.284 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.284 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:49.284 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558296+0000", 2024-09-13T06:41:49.284 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:41:49.284 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.284 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.284 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:49.284 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558305+0000", 2024-09-13T06:41:49.284 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.5290000000000008e-06 2024-09-13T06:41:49.284 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.284 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.284 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:49.285 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558308+0000", 2024-09-13T06:41:49.285 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.5619999999999999e-06 2024-09-13T06:41:49.285 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.285 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.285 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:49.285 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558311+0000", 2024-09-13T06:41:49.285 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.43e-06 2024-09-13T06:41:49.285 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.285 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.285 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:49.285 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.621495+0000", 2024-09-13T06:41:49.285 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.063184289000000005 2024-09-13T06:41:49.285 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.286 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.286 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:49.286 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.621569+0000", 2024-09-13T06:41:49.286 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4250000000000002e-05 2024-09-13T06:41:49.286 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.286 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.286 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:49.286 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.621847+0000", 2024-09-13T06:41:49.286 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00027826400000000002 2024-09-13T06:41:49.286 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:49.286 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:49.286 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:49.286 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.287 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.287 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43226 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 436224~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:49.287 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558313+0000", 2024-09-13T06:41:49.287 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 87.665486960999999, 2024-09-13T06:41:49.287 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.063914420999999999, 2024-09-13T06:41:49.287 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:49.287 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:49.287 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:49.287 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:49.287 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:49.287 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43226 2024-09-13T06:41:49.287 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.287 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:49.287 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.288 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:49.288 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558313+0000", 2024-09-13T06:41:49.288 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:49.288 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.288 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.288 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:49.288 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558313+0000", 2024-09-13T06:41:49.288 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:49.288 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.288 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.288 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:49.288 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558313+0000", 2024-09-13T06:41:49.288 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:49.289 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.289 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.289 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:49.289 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558314+0000", 2024-09-13T06:41:49.289 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3740000000000001e-06 2024-09-13T06:41:49.289 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.289 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.289 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:49.289 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558317+0000", 2024-09-13T06:41:49.289 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9730000000000002e-06 2024-09-13T06:41:49.289 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.289 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.289 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:49.290 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558319+0000", 2024-09-13T06:41:49.290 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4059999999999999e-06 2024-09-13T06:41:49.290 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.290 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.290 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:49.290 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.621877+0000", 2024-09-13T06:41:49.290 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.063557408999999995 2024-09-13T06:41:49.290 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.290 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.290 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:49.290 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.621951+0000", 2024-09-13T06:41:49.290 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4487999999999996e-05 2024-09-13T06:41:49.290 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.291 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.291 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:49.291 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.622227+0000", 2024-09-13T06:41:49.291 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000276011 2024-09-13T06:41:49.291 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:49.291 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:49.291 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:49.291 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.291 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.291 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43227 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 450560~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:49.291 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558322+0000", 2024-09-13T06:41:49.291 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 87.665478379999996, 2024-09-13T06:41:49.291 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.064285348000000006, 2024-09-13T06:41:49.291 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:49.292 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:49.292 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:49.292 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:49.292 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:49.292 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43227 2024-09-13T06:41:49.292 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.292 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:49.292 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.292 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:49.292 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558322+0000", 2024-09-13T06:41:49.292 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:49.293 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.293 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.293 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:49.293 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558322+0000", 2024-09-13T06:41:49.293 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:49.293 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.293 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.293 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:49.293 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558321+0000", 2024-09-13T06:41:49.293 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:41:49.293 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.293 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.293 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:49.294 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558323+0000", 2024-09-13T06:41:49.294 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.576e-06 2024-09-13T06:41:49.294 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.294 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.294 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:49.294 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558328+0000", 2024-09-13T06:41:49.294 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0719999999999999e-06 2024-09-13T06:41:49.294 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.294 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.294 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:49.294 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558332+0000", 2024-09-13T06:41:49.294 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.8130000000000002e-06 2024-09-13T06:41:49.294 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.294 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.295 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:49.295 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.622255+0000", 2024-09-13T06:41:49.295 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.063923195000000002 2024-09-13T06:41:49.295 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.295 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.295 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:49.295 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.622330+0000", 2024-09-13T06:41:49.295 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5383000000000007e-05 2024-09-13T06:41:49.295 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.295 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.295 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:49.295 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.622607+0000", 2024-09-13T06:41:49.295 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00027651999999999999 2024-09-13T06:41:49.296 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:49.296 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:49.296 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:49.296 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.296 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.296 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43228 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 464896~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:49.296 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558335+0000", 2024-09-13T06:41:49.296 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 87.665464471000007, 2024-09-13T06:41:49.296 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.064652253000000007, 2024-09-13T06:41:49.296 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:49.296 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:49.296 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:49.296 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:49.297 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:49.297 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43228 2024-09-13T06:41:49.297 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.297 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:49.297 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.297 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:49.297 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558335+0000", 2024-09-13T06:41:49.297 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:49.297 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.297 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.297 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:49.297 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558335+0000", 2024-09-13T06:41:49.297 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:49.298 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.298 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.298 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:49.298 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558335+0000", 2024-09-13T06:41:49.298 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:49.298 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.298 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.298 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:49.298 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558337+0000", 2024-09-13T06:41:49.298 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1380000000000001e-06 2024-09-13T06:41:49.298 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.298 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.298 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:49.299 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558343+0000", 2024-09-13T06:41:49.299 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.5140000000000001e-06 2024-09-13T06:41:49.299 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.299 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.299 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:49.299 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558348+0000", 2024-09-13T06:41:49.299 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9640000000000002e-06 2024-09-13T06:41:49.299 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.299 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.299 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:49.299 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.622636+0000", 2024-09-13T06:41:49.299 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.064288260999999999 2024-09-13T06:41:49.299 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.299 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.300 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:49.300 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.622715+0000", 2024-09-13T06:41:49.300 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.9351000000000006e-05 2024-09-13T06:41:49.300 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.300 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.300 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:49.300 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.622988+0000", 2024-09-13T06:41:49.300 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00027242599999999998 2024-09-13T06:41:49.300 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:49.300 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:49.300 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:49.300 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.300 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.301 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43229 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 479232~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:49.301 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558352+0000", 2024-09-13T06:41:49.301 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 87.665448056000002, 2024-09-13T06:41:49.301 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.065018024999999993, 2024-09-13T06:41:49.301 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:49.301 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:49.301 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:49.301 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:49.301 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:49.301 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43229 2024-09-13T06:41:49.301 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.301 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:49.301 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.302 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:49.302 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558352+0000", 2024-09-13T06:41:49.302 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:49.302 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.302 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.302 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:49.302 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558352+0000", 2024-09-13T06:41:49.302 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:49.302 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.302 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.302 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:49.302 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558352+0000", 2024-09-13T06:41:49.303 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:49.303 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.303 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.303 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:49.303 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558354+0000", 2024-09-13T06:41:49.303 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4930000000000001e-06 2024-09-13T06:41:49.303 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.303 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.303 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:49.303 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558360+0000", 2024-09-13T06:41:49.303 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.263e-06 2024-09-13T06:41:49.303 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.303 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.303 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:49.304 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558369+0000", 2024-09-13T06:41:49.304 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.0829999999999993e-06 2024-09-13T06:41:49.304 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.304 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.304 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:49.304 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.623017+0000", 2024-09-13T06:41:49.304 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.064647799000000006 2024-09-13T06:41:49.304 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.304 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.304 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:49.304 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.623090+0000", 2024-09-13T06:41:49.304 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3071000000000006e-05 2024-09-13T06:41:49.304 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.305 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.305 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:49.305 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.623370+0000", 2024-09-13T06:41:49.305 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000279661 2024-09-13T06:41:49.305 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:49.305 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:49.305 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:49.305 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.305 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.305 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43230 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 493568~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:49.305 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558374+0000", 2024-09-13T06:41:49.305 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 87.665425763000002, 2024-09-13T06:41:49.305 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.065410435000000003, 2024-09-13T06:41:49.306 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:49.306 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:49.306 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:49.306 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:49.306 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:49.306 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43230 2024-09-13T06:41:49.306 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.306 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:49.306 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.306 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:49.306 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558374+0000", 2024-09-13T06:41:49.306 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:49.306 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.306 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.307 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:49.307 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558374+0000", 2024-09-13T06:41:49.307 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:49.307 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.307 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.307 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:49.307 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558374+0000", 2024-09-13T06:41:49.307 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:49.307 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.307 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.307 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:49.307 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558376+0000", 2024-09-13T06:41:49.307 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4430000000000002e-06 2024-09-13T06:41:49.308 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.308 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.308 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:49.308 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558382+0000", 2024-09-13T06:41:49.308 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3029999999999996e-06 2024-09-13T06:41:49.308 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.308 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.308 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:49.308 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558387+0000", 2024-09-13T06:41:49.308 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.1699999999999999e-06 2024-09-13T06:41:49.308 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.308 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.308 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:49.309 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.623400+0000", 2024-09-13T06:41:49.309 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.065013244999999997 2024-09-13T06:41:49.309 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.309 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.309 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:49.309 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.623474+0000", 2024-09-13T06:41:49.309 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3889999999999999e-05 2024-09-13T06:41:49.309 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.309 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.309 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:49.309 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.623785+0000", 2024-09-13T06:41:49.309 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00031080099999999998 2024-09-13T06:41:49.309 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:49.309 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:49.310 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:49.310 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.310 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.310 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43231 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 507904~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:49.310 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558391+0000", 2024-09-13T06:41:49.310 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 87.665409077999996, 2024-09-13T06:41:49.310 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.065788597000000004, 2024-09-13T06:41:49.310 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:49.310 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:49.310 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:49.310 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:49.310 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:49.310 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43231 2024-09-13T06:41:49.311 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.311 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:49.311 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.311 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:49.311 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558391+0000", 2024-09-13T06:41:49.311 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:49.311 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.311 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.311 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:49.311 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558391+0000", 2024-09-13T06:41:49.311 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:49.311 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.311 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.312 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:49.312 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558390+0000", 2024-09-13T06:41:49.312 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:49.312 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.312 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.312 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:49.312 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558393+0000", 2024-09-13T06:41:49.312 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2570000000000002e-06 2024-09-13T06:41:49.312 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.312 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.312 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:49.312 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558399+0000", 2024-09-13T06:41:49.313 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0419999999999999e-06 2024-09-13T06:41:49.313 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.313 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.313 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:49.313 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558403+0000", 2024-09-13T06:41:49.313 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6249999999999998e-06 2024-09-13T06:41:49.313 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.313 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.313 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:49.313 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.623811+0000", 2024-09-13T06:41:49.313 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.065407549999999995 2024-09-13T06:41:49.313 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.313 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.314 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:49.314 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.623877+0000", 2024-09-13T06:41:49.314 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.5902999999999996e-05 2024-09-13T06:41:49.314 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.314 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.314 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:49.314 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.624179+0000", 2024-09-13T06:41:49.314 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00030259999999999998 2024-09-13T06:41:49.314 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:49.314 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:49.314 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:49.314 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.315 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.315 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43232 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 522240~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:49.315 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558422+0000", 2024-09-13T06:41:49.315 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 87.665378301000004, 2024-09-13T06:41:49.315 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.066176061999999994, 2024-09-13T06:41:49.315 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:49.315 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:49.315 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:49.315 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:49.315 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:49.315 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43232 2024-09-13T06:41:49.315 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.315 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:49.315 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.316 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:49.316 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558422+0000", 2024-09-13T06:41:49.316 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:49.316 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.316 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.316 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:49.316 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558422+0000", 2024-09-13T06:41:49.316 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:49.316 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.316 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.316 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:49.316 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558421+0000", 2024-09-13T06:41:49.317 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:49.317 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.317 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.317 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:49.317 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558428+0000", 2024-09-13T06:41:49.317 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.1690000000000003e-06 2024-09-13T06:41:49.317 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.317 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.317 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:49.317 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558434+0000", 2024-09-13T06:41:49.317 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9309999999999996e-06 2024-09-13T06:41:49.317 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.317 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.318 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:49.318 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558447+0000", 2024-09-13T06:41:49.318 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.271e-05 2024-09-13T06:41:49.318 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.318 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.318 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:49.318 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.624209+0000", 2024-09-13T06:41:49.318 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.065762102000000003 2024-09-13T06:41:49.318 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.318 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.318 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:49.318 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.624282+0000", 2024-09-13T06:41:49.318 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.2889e-05 2024-09-13T06:41:49.319 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.319 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.319 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:49.319 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.624598+0000", 2024-09-13T06:41:49.319 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00031591399999999998 2024-09-13T06:41:49.319 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:49.319 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:49.319 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:49.319 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.319 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.319 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43486 3.f 3:f7da9c8f:::rbd_data.1121f5f2e1c0.000000000000000b:1f [read 260096~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:49.319 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.569088+0000", 2024-09-13T06:41:49.319 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 87.654711578000004, 2024-09-13T06:41:49.319 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.062579223000000003, 2024-09-13T06:41:49.320 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:49.320 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:49.320 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:49.320 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:49.320 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:49.320 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43486 2024-09-13T06:41:49.320 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.320 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:49.320 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.320 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:49.320 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.569088+0000", 2024-09-13T06:41:49.320 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:49.320 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.321 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.321 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:49.321 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.569088+0000", 2024-09-13T06:41:49.321 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:49.321 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.321 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.321 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:49.321 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.569088+0000", 2024-09-13T06:41:49.321 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:49.321 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.321 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.321 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:49.321 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.569091+0000", 2024-09-13T06:41:49.322 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9629999999999998e-06 2024-09-13T06:41:49.322 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.322 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.322 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:49.322 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.569097+0000", 2024-09-13T06:41:49.324 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.4160000000000001e-06 2024-09-13T06:41:49.324 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.324 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.324 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:49.324 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.569102+0000", 2024-09-13T06:41:49.324 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6659999999999999e-06 2024-09-13T06:41:49.324 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.325 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.325 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:49.325 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.631346+0000", 2024-09-13T06:41:49.325 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.062243896 2024-09-13T06:41:49.325 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.325 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.325 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:49.325 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.631413+0000", 2024-09-13T06:41:49.325 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.7638000000000005e-05 2024-09-13T06:41:49.325 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.325 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.325 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:49.325 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.631668+0000", 2024-09-13T06:41:49.326 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0002541 2024-09-13T06:41:49.326 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:49.326 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:49.326 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:49.326 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:49.326 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:49.326 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:41:49.327 INFO:teuthology.orchestra.run.smithi081.stdout:4016 write 0xdbd2cea thru 0xdbd63bb (0x36d2 bytes) 2024-09-13T06:41:49.328 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-13T06:41:49.330 INFO:teuthology.orchestra.run.smithi081.stdout:4017 write 0xa83f785 thru 0xa8461ed (0x6a69 bytes) 2024-09-13T06:41:49.330 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:41:49.330 INFO:teuthology.orchestra.run.smithi081.stdout:4021 writesame 0x9804afd thru 0x980a30b data_size 0x1(0x580f bytes) 2024-09-13T06:41:49.330 INFO:teuthology.orchestra.run.smithi081.stdout:4022 write 0x989155f thru 0x9891743 (0x1e5 bytes) 2024-09-13T06:41:49.330 INFO:teuthology.orchestra.run.smithi081.stdout:4023 write 0xa64243b thru 0xa64c95e (0xa524 bytes) 2024-09-13T06:41:49.330 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:41:49.330 INFO:teuthology.orchestra.run.smithi081.stdout:4025 write 0x14842e9 thru 0x1485192 (0xeaa bytes) 2024-09-13T06:41:49.330 INFO:teuthology.orchestra.run.smithi081.stdout:4026 read 0xdb92736 thru 0xdb9f9e6 (0xd2b1 bytes) 2024-09-13T06:41:49.331 INFO:teuthology.orchestra.run.smithi081.stdout:4027 writesame 0x5a62c0d thru 0x5a63823 data_size 0x1(0xc17 bytes) 2024-09-13T06:41:49.331 INFO:teuthology.orchestra.run.smithi081.stdout:4028 read 0x8d28cc2 thru 0x8d2d883 (0x4bc2 bytes) 2024-09-13T06:41:49.331 INFO:teuthology.orchestra.run.smithi081.stdout:4029 write 0x66afaaf thru 0x66b58e8 (0x5e3a bytes) 2024-09-13T06:41:49.331 INFO:teuthology.orchestra.run.smithi081.stdout:4030 punch from 0x65fd808 to 0x66078f1, (0xa0e9 bytes) 2024-09-13T06:41:49.331 INFO:teuthology.orchestra.run.smithi081.stdout:4032 read 0x3fcb639 thru 0x3fd366a (0x8032 bytes) 2024-09-13T06:41:49.331 INFO:teuthology.orchestra.run.smithi081.stdout:4034 read 0x6493d69 thru 0x64a332f (0xf5c7 bytes) 2024-09-13T06:41:49.331 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:41:49.331 INFO:teuthology.orchestra.run.smithi081.stdout:4036 punch from 0x64dc818 to 0x64e8a62, (0xc24a bytes) 2024-09-13T06:41:49.331 INFO:teuthology.orchestra.run.smithi081.stdout:4037 punch from 0x4b30019 to 0x4b3279f, (0x2786 bytes) 2024-09-13T06:41:49.331 INFO:teuthology.orchestra.run.smithi081.stdout:4039 read 0x5d37516 thru 0x5d400dc (0x8bc7 bytes) 2024-09-13T06:41:49.331 INFO:teuthology.orchestra.run.smithi081.stdout:4040 read 0x7f37a49 thru 0x7f42d03 (0xb2bb bytes) 2024-09-13T06:41:49.331 INFO:teuthology.orchestra.run.smithi081.stdout:4041 punch from 0x1d188c7 to 0x1d1d056, (0x478f bytes) 2024-09-13T06:41:49.331 INFO:teuthology.orchestra.run.smithi081.stdout:4043 trunc from 0xdbd63bc to 0xbe6ca19 2024-09-13T06:41:49.332 INFO:teuthology.orchestra.run.smithi081.stdout:4044 trunc from 0xbe6ca19 to 0x4f2482b 2024-09-13T06:41:49.332 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:41:49.325+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:41:49.362 INFO:teuthology.orchestra.run.smithi081.stdout:4045 trunc from 0x4f2482b to 0xbe1aaa4 2024-09-13T06:41:49.372 INFO:teuthology.orchestra.run.smithi081.stdout:4046 writesame 0x297c449 thru 0x297cf17 data_size 0x1(0xacf bytes) 2024-09-13T06:41:49.376 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:41:49.383 INFO:teuthology.orchestra.run.smithi081.stdout:4048 trunc from 0xbe1aaa4 to 0xe8cf07c 2024-09-13T06:41:49.391 INFO:teuthology.orchestra.run.smithi081.stdout:4049 write 0x5c29f4a thru 0x5c2cd66 (0x2e1d bytes) 2024-09-13T06:41:49.393 INFO:teuthology.orchestra.run.smithi081.stdout:4051 read 0x99924e2 thru 0x99940bc (0x1bdb bytes) 2024-09-13T06:41:49.393 INFO:teuthology.orchestra.run.smithi081.stdout:4053 writesame 0xa18a9db thru 0xa18c230 data_size 0x23(0x1856 bytes) 2024-09-13T06:41:49.398 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:41:49.398 INFO:teuthology.orchestra.run.smithi081.stdout:4056 punch from 0x4e6612a to 0x4e722dd, (0xc1b3 bytes) 2024-09-13T06:41:49.398 INFO:teuthology.orchestra.run.smithi081.stdout:4057 read 0x895e7f9 thru 0x895efb4 (0x7bc bytes) 2024-09-13T06:41:49.399 INFO:teuthology.orchestra.run.smithi081.stdout:4058 punch from 0x4fa3523 to 0x4fabc6d, (0x874a bytes) 2024-09-13T06:41:49.399 INFO:teuthology.orchestra.run.smithi081.stdout:4060 write 0x725350 thru 0x72e2c5 (0x8f76 bytes) 2024-09-13T06:41:49.401 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:41:49.401 INFO:teuthology.orchestra.run.smithi081.stdout:4062 punch from 0xb5579b9 to 0xb560338, (0x897f bytes) 2024-09-13T06:41:49.401 INFO:teuthology.orchestra.run.smithi081.stdout:4064 writesame 0x223d6 thru 0x2aa6c data_size 0x5(0x8697 bytes) 2024-09-13T06:41:49.408 INFO:teuthology.orchestra.run.smithi081.stdout:4065 writesame 0x7b6f6d7 thru 0x7b7592c data_size 0x29(0x6256 bytes) 2024-09-13T06:41:49.412 INFO:teuthology.orchestra.run.smithi081.stdout:4066 writesame 0x63eefdd thru 0x63fc4da data_size 0x2(0xd4fe bytes) 2024-09-13T06:41:49.428 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:41:49.425+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:41:49.441 INFO:teuthology.orchestra.run.smithi081.stdout:4067 read 0xcf6b73b thru 0xcf79ab7 (0xe37d bytes) 2024-09-13T06:41:49.441 INFO:teuthology.orchestra.run.smithi081.stdout:4069 write 0x5a77b83 thru 0x5a83cc3 (0xc141 bytes) 2024-09-13T06:41:49.443 INFO:teuthology.orchestra.run.smithi081.stdout:4070 writesame 0xa4732 thru 0xae95d data_size 0x6b(0xa22c bytes) 2024-09-13T06:41:49.456 INFO:teuthology.orchestra.run.smithi081.stdout:4071 write 0xed5d0cd thru 0xed5f9ef (0x2923 bytes) 2024-09-13T06:41:49.461 INFO:teuthology.orchestra.run.smithi081.stdout:4072 writesame 0x60f4564 thru 0x6101c90 data_size 0x17(0xd72d bytes) 2024-09-13T06:41:49.466 INFO:teuthology.orchestra.run.smithi081.stdout:4073 read 0x17ef3a3 thru 0x17fc842 (0xd4a0 bytes) 2024-09-13T06:41:49.467 INFO:teuthology.orchestra.run.smithi081.stdout:4074 punch from 0x698a883 to 0x6999de3, (0xf560 bytes) 2024-09-13T06:41:49.467 INFO:teuthology.orchestra.run.smithi081.stdout:4076 read 0xa0f3dc3 thru 0xa0fa64d (0x688b bytes) 2024-09-13T06:41:49.467 INFO:teuthology.orchestra.run.smithi081.stdout:4078 read 0xbb49f00 thru 0xbb4af6b (0x106c bytes) 2024-09-13T06:41:49.467 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:41:49.467 INFO:teuthology.orchestra.run.smithi081.stdout:4080 write 0xbb03d6d thru 0xbb08fa0 (0x5234 bytes) 2024-09-13T06:41:49.473 INFO:teuthology.orchestra.run.smithi081.stdout:4081 write 0x3f7d513 thru 0x3f81903 (0x43f1 bytes) 2024-09-13T06:41:49.476 INFO:teuthology.orchestra.run.smithi081.stdout:4082 read 0x9c1429e thru 0x9c1bb7a (0x78dd bytes) 2024-09-13T06:41:49.477 INFO:teuthology.orchestra.run.smithi081.stdout:4083 write 0x19a6e09 thru 0x19b5d04 (0xeefc bytes) 2024-09-13T06:41:49.482 INFO:teuthology.orchestra.run.smithi081.stdout:4084 trunc from 0xed5f9f0 to 0xdc91a0d 2024-09-13T06:41:49.496 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:41:49.496 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [ 2024-09-13T06:41:49.496 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.496 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:131388 3.1e 3:7a13855e:::rbd_header.11218c1d974c:head [call rbd.get_size in=19b out=9b,call rbd.get_features in=24b out=16b,call rbd.get_flags in=20b out=8b,call rbd.get_snapcontext in=18b out=12b,call lock.get_info in=30b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e149)", 2024-09-13T06:41:49.496 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:41:49.496695+0000", 2024-09-13T06:41:49.496 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.0012736010000000001, 2024-09-13T06:41:49.496 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0012982250000000001, 2024-09-13T06:41:49.496 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:49.496 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:49.496 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:49.497 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:49.497 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:49.497 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 131388 2024-09-13T06:41:49.497 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.497 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:49.497 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.497 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:49.497 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:49.496695+0000", 2024-09-13T06:41:49.497 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:49.497 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.497 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.497 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:49.498 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:49.496695+0000", 2024-09-13T06:41:49.498 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:49.498 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.498 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.498 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:49.498 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:49.496693+0000", 2024-09-13T06:41:49.498 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999986 2024-09-13T06:41:49.498 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.498 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.498 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:49.498 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:49.496702+0000", 2024-09-13T06:41:49.498 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.5760000000000006e-06 2024-09-13T06:41:49.498 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.499 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.499 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:49.499 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:49.496720+0000", 2024-09-13T06:41:49.499 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8006999999999999e-05 2024-09-13T06:41:49.499 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.499 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.499 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:49.499 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:49.496730+0000", 2024-09-13T06:41:49.499 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0103e-05 2024-09-13T06:41:49.499 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.499 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.499 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:49.499 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:49.496835+0000", 2024-09-13T06:41:49.499 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000104521 2024-09-13T06:41:49.499 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.499 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.500 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:49.500 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:49.497116+0000", 2024-09-13T06:41:49.500 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00028142 2024-09-13T06:41:49.500 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:49.500 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:49.500 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:49.500 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:49.500 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-13T06:41:49.500 INFO:teuthology.orchestra.run.smithi081.stdout: "num_ops": 1 2024-09-13T06:41:49.500 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:41:49.501 INFO:teuthology.orchestra.run.smithi081.stdout:4085 read 0x833a316 thru 0x83406ff (0x63ea bytes) 2024-09-13T06:41:49.501 INFO:teuthology.orchestra.run.smithi081.stdout:4087 write 0x2901130 thru 0x2903253 (0x2124 bytes) 2024-09-13T06:41:49.512 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-13T06:41:49.524 INFO:teuthology.orchestra.run.smithi081.stdout:4088 trunc from 0xdc91a0d to 0x4268706 2024-09-13T06:41:49.562 INFO:teuthology.orchestra.run.smithi081.stdout:4089 writesame 0xd6d2dbe thru 0xd6e0560 data_size 0x1(0xd7a3 bytes) 2024-09-13T06:41:49.563 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:41:49.561+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:41:49.573 INFO:teuthology.orchestra.run.smithi081.stdout:4090 writesame 0xdec53de thru 0xded3b20 data_size 0x1(0xe743 bytes) 2024-09-13T06:41:49.573 INFO:teuthology.orchestra.run.smithi081.stdout:4092 read 0x1d3e303 thru 0x1d3f78e (0x148c bytes) 2024-09-13T06:41:49.574 INFO:teuthology.orchestra.run.smithi081.stdout:4093 write 0x2eda448 thru 0x2ee6d39 (0xc8f2 bytes) 2024-09-13T06:41:49.577 INFO:teuthology.orchestra.run.smithi081.stdout:truncating to largest ever: 0xee17e92 2024-09-13T06:41:49.579 INFO:teuthology.orchestra.run.smithi081.stdout:4094 trunc from 0xded3b21 to 0xee17e92 2024-09-13T06:41:49.583 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-13T06:41:49.588 INFO:teuthology.orchestra.run.smithi081.stdout:4095 punch from 0x908b3c8 to 0x908fecc, (0x4b04 bytes) 2024-09-13T06:41:49.588 INFO:teuthology.orchestra.run.smithi081.stdout:4096 read 0xea86c22 thru 0xea8c518 (0x58f7 bytes) 2024-09-13T06:41:49.601 INFO:teuthology.orchestra.run.smithi081.stdout:4098 trunc from 0xee17e92 to 0x78a5289 2024-09-13T06:41:49.612 INFO:teuthology.orchestra.run.smithi081.stdout:4099 read 0x38bcd73 thru 0x38cac62 (0xdef0 bytes) 2024-09-13T06:41:49.613 INFO:teuthology.orchestra.run.smithi081.stdout:4102 punch from 0x6eb81fb to 0x6ec3d1d, (0xbb22 bytes) 2024-09-13T06:41:49.614 INFO:teuthology.orchestra.run.smithi081.stdout:4103 punch from 0x4eea962 to 0x4eece5f, (0x24fd bytes) 2024-09-13T06:41:49.622 INFO:teuthology.orchestra.run.smithi081.stdout:4104 write 0x833ba26 thru 0x834b681 (0xfc5c bytes) 2024-09-13T06:41:49.626 INFO:teuthology.orchestra.run.smithi081.stdout:4105 write 0x1d52ae thru 0x1d744b (0x219e bytes) 2024-09-13T06:41:49.627 INFO:teuthology.orchestra.run.smithi081.stdout:4106 read 0x5492c4a thru 0x54a0aab (0xde62 bytes) 2024-09-13T06:41:49.628 INFO:teuthology.orchestra.run.smithi081.stdout:4107 punch from 0x820a169 to 0x820eef0, (0x4d87 bytes) 2024-09-13T06:41:49.628 INFO:teuthology.orchestra.run.smithi081.stdout:4108 punch from 0x6e68e84 to 0x6e6d1aa, (0x4326 bytes) 2024-09-13T06:41:49.631 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:41:49.626+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:41:49.646 INFO:teuthology.orchestra.run.smithi081.stdout:4109 write 0xdf5d6ce thru 0xdf5e269 (0xb9c bytes) 2024-09-13T06:41:49.650 INFO:teuthology.orchestra.run.smithi081.stdout:4110 write 0xc9dbfa8 thru 0xc9ea580 (0xe5d9 bytes) 2024-09-13T06:41:49.655 INFO:teuthology.orchestra.run.smithi081.stdout:4112 write 0x467a382 thru 0x467acd2 (0x951 bytes) 2024-09-13T06:41:49.670 INFO:teuthology.orchestra.run.smithi081.stdout:4114 trunc from 0xdf5e26a to 0x6889921 2024-09-13T06:41:49.671 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:41:49.671 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-13T06:41:49.672 INFO:teuthology.orchestra.run.smithi081.stdout: "complaint_time": 30, 2024-09-13T06:41:49.672 INFO:teuthology.orchestra.run.smithi081.stdout: "num_blocked_ops": 0 2024-09-13T06:41:49.672 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:41:49.689 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-13T06:41:49.690 INFO:teuthology.orchestra.run.smithi081.stdout:4115 punch from 0x3f8e46 to 0x3fcadf, (0x3c99 bytes) 2024-09-13T06:41:49.690 INFO:teuthology.orchestra.run.smithi081.stdout:4116 read 0x5fb7a5f thru 0x5fc1b43 (0xa0e5 bytes) 2024-09-13T06:41:49.691 INFO:teuthology.orchestra.run.smithi081.stdout:4117 read 0x6567a71 thru 0x656f0d9 (0x7669 bytes) 2024-09-13T06:41:49.692 INFO:teuthology.orchestra.run.smithi081.stdout:4118 punch from 0x453dcf1 to 0x45444c5, (0x67d4 bytes) 2024-09-13T06:41:49.692 INFO:teuthology.orchestra.run.smithi081.stdout:4119 read 0x42357f6 thru 0x4244c80 (0xf48b bytes) 2024-09-13T06:41:49.692 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:41:49.693 INFO:teuthology.orchestra.run.smithi081.stdout:4121 trunc from 0x6889921 to 0x6ea125c 2024-09-13T06:41:49.702 INFO:teuthology.orchestra.run.smithi081.stdout:4122 write 0x382afdf thru 0x382f702 (0x4724 bytes) 2024-09-13T06:41:49.713 INFO:teuthology.orchestra.run.smithi081.stdout:4123 trunc from 0x6ea125c to 0x5218c0 2024-09-13T06:41:49.725 INFO:teuthology.orchestra.run.smithi081.stdout:4125 punch from 0x4cfa0 to 0x4fd8c, (0x2dec bytes) 2024-09-13T06:41:49.725 INFO:teuthology.orchestra.run.smithi081.stdout:4127 read 0x116eb9 thru 0x123931 (0xca79 bytes) 2024-09-13T06:41:49.725 INFO:teuthology.orchestra.run.smithi081.stdout:4128 read 0xd4702 thru 0xdf3cb (0xacca bytes) 2024-09-13T06:41:49.726 INFO:teuthology.orchestra.run.smithi081.stdout:4130 read 0x3ba9de thru 0x3c7bd7 (0xd1fa bytes) 2024-09-13T06:41:49.727 INFO:teuthology.orchestra.run.smithi081.stdout:4132 read 0x4551e6 thru 0x45765d (0x2478 bytes) 2024-09-13T06:41:49.728 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:41:49.730 INFO:teuthology.orchestra.run.smithi081.stdout:4135 trunc from 0x5218c0 to 0x1d76fed 2024-09-13T06:41:49.731 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:41:49.726+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:41:49.737 INFO:teuthology.orchestra.run.smithi081.stdout:4136 read 0x1b8b7fd thru 0x1b9a15d (0xe961 bytes) 2024-09-13T06:41:49.737 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:41:49.737 INFO:teuthology.orchestra.run.smithi081.stdout:4139 punch from 0xa6aa9e to 0xa6cf20, (0x2482 bytes) 2024-09-13T06:41:49.737 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:41:49.738 INFO:teuthology.orchestra.run.smithi081.stdout:4144 punch from 0x57932d to 0x57a2bf, (0xf92 bytes) 2024-09-13T06:41:49.745 INFO:teuthology.orchestra.run.smithi081.stdout:4145 writesame 0x25dbf21 thru 0x25df8da data_size 0x3(0x39ba bytes) 2024-09-13T06:41:49.752 INFO:teuthology.orchestra.run.smithi081.stdout:4148 trunc from 0x25df8db to 0x6134503 2024-09-13T06:41:49.773 INFO:teuthology.orchestra.run.smithi081.stdout:4149 writesame 0x9fff4f7 thru 0xa000333 data_size 0x3(0xe3d bytes) 2024-09-13T06:41:49.773 INFO:teuthology.orchestra.run.smithi081.stdout:4150 write 0x48fdafd thru 0x490ae1d (0xd321 bytes) 2024-09-13T06:41:49.775 INFO:teuthology.orchestra.run.smithi081.stdout:4151 read 0x92f3d6 thru 0x93900c (0x9c37 bytes) 2024-09-13T06:41:49.775 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:41:49.776 INFO:teuthology.orchestra.run.smithi081.stdout:4153 writesame 0xa59ef3 thru 0xa68791 data_size 0x1f(0xe89f bytes) 2024-09-13T06:41:49.778 INFO:teuthology.orchestra.run.smithi081.stdout:4154 write 0x2c96450 thru 0x2c9e7f8 (0x83a9 bytes) 2024-09-13T06:41:49.794 INFO:teuthology.orchestra.run.smithi081.stdout:4155 writesame 0xe84a33e thru 0xe84fbbb data_size 0x5e(0x587e bytes) 2024-09-13T06:41:49.794 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:41:49.794 INFO:teuthology.orchestra.run.smithi081.stdout:4157 write 0x641ffe5 thru 0x642faf2 (0xfb0e bytes) 2024-09-13T06:41:49.798 INFO:teuthology.orchestra.run.smithi081.stdout:4158 clone 28 order 18 su 8192 sc 2 2024-09-13T06:41:49.822 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:41:49.822 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 20, 2024-09-13T06:41:49.822 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 600, 2024-09-13T06:41:49.822 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [ 2024-09-13T06:41:49.822 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.823 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:2226 3.15 3:af026987:::rbd_data.112173e2f1b7.0000000000000017:head [sparse-read 0~4194304] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-13T06:41:49.823 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:37.606562+0000", 2024-09-13T06:41:49.823 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 132.21629546700001, 2024-09-13T06:41:49.823 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.83322091700000001, 2024-09-13T06:41:49.823 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:49.823 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:41:49.823 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:49.823 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:49.823 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:49.823 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 2226 2024-09-13T06:41:49.823 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.823 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:49.823 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.824 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:49.824 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606562+0000", 2024-09-13T06:41:49.824 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:49.824 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.824 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.824 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:49.824 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606562+0000", 2024-09-13T06:41:49.824 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:49.824 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.824 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.824 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:49.824 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606561+0000", 2024-09-13T06:41:49.824 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:49.825 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.825 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.825 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:49.825 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606565+0000", 2024-09-13T06:41:49.825 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.4379999999999999e-06 2024-09-13T06:41:49.825 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.825 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.825 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:49.825 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606569+0000", 2024-09-13T06:41:49.825 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.425e-06 2024-09-13T06:41:49.825 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.825 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.825 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:49.826 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606572+0000", 2024-09-13T06:41:49.826 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.05e-06 2024-09-13T06:41:49.826 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.826 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.826 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:49.826 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606621+0000", 2024-09-13T06:41:49.826 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.8723000000000001e-05 2024-09-13T06:41:49.826 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.826 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.826 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:41:49.826 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606630+0000", 2024-09-13T06:41:49.826 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.8040000000000007e-06 2024-09-13T06:41:49.826 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.827 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.827 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:49.827 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.439648+0000", 2024-09-13T06:41:49.827 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.83301824800000002 2024-09-13T06:41:49.827 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.827 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.827 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:49.827 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.439782+0000", 2024-09-13T06:41:49.827 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00013466699999999999 2024-09-13T06:41:49.827 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:49.827 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:49.827 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:49.827 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.828 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.828 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25661 3.8 3:1180686c:::rbd_data.1121f2c5ee81.0000000000000009:13 [read 397312~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:49.828 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.436956+0000", 2024-09-13T06:41:49.828 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 113.385900933, 2024-09-13T06:41:49.828 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089036758999999993, 2024-09-13T06:41:49.828 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:49.828 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:49.828 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:49.828 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:49.828 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:49.828 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25661 2024-09-13T06:41:49.828 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.828 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:49.829 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.829 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:49.829 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436956+0000", 2024-09-13T06:41:49.829 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:49.829 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.829 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.829 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:49.829 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436956+0000", 2024-09-13T06:41:49.829 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:49.829 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.829 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.829 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:49.829 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436956+0000", 2024-09-13T06:41:49.830 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:49.830 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.830 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.830 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:49.830 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436958+0000", 2024-09-13T06:41:49.830 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1770000000000001e-06 2024-09-13T06:41:49.830 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.830 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.830 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:49.830 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436963+0000", 2024-09-13T06:41:49.830 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.6489999999999996e-06 2024-09-13T06:41:49.830 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.830 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.831 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:49.831 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436975+0000", 2024-09-13T06:41:49.831 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1783999999999999e-05 2024-09-13T06:41:49.831 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.831 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.831 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:49.831 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.525671+0000", 2024-09-13T06:41:49.831 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.088696292999999995 2024-09-13T06:41:49.831 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.831 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.831 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:49.831 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.525749+0000", 2024-09-13T06:41:49.831 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.7589000000000005e-05 2024-09-13T06:41:49.831 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.832 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.832 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:49.832 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.525993+0000", 2024-09-13T06:41:49.832 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00024381000000000001 2024-09-13T06:41:49.832 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:49.832 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:49.832 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:49.832 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.832 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.832 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25662 3.8 3:1180686c:::rbd_data.1121f2c5ee81.0000000000000009:13 [read 421888~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:49.832 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.436980+0000", 2024-09-13T06:41:49.832 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 113.38587662099999, 2024-09-13T06:41:49.832 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089367577000000004, 2024-09-13T06:41:49.832 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:49.832 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:49.833 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:49.833 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:49.833 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:49.833 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25662 2024-09-13T06:41:49.833 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.833 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:49.833 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.833 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:49.833 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436980+0000", 2024-09-13T06:41:49.833 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:49.833 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.833 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.833 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:49.833 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436980+0000", 2024-09-13T06:41:49.833 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:49.834 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.834 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.834 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:49.834 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436980+0000", 2024-09-13T06:41:49.834 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:49.834 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.834 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.834 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:49.834 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436982+0000", 2024-09-13T06:41:49.834 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3989999999999998e-06 2024-09-13T06:41:49.834 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.834 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.834 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:49.834 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436988+0000", 2024-09-13T06:41:49.834 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0039999999999996e-06 2024-09-13T06:41:49.835 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.835 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.835 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:49.835 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436993+0000", 2024-09-13T06:41:49.835 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6090000000000003e-06 2024-09-13T06:41:49.835 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.835 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.835 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:49.835 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.526035+0000", 2024-09-13T06:41:49.835 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089042248000000004 2024-09-13T06:41:49.835 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.835 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.835 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:49.836 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.526111+0000", 2024-09-13T06:41:49.836 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5643999999999996e-05 2024-09-13T06:41:49.836 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.836 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.836 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:49.836 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.526348+0000", 2024-09-13T06:41:49.836 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00023705800000000001 2024-09-13T06:41:49.836 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:49.836 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:49.836 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:49.836 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.836 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.836 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25663 3.8 3:1180686c:::rbd_data.1121f2c5ee81.0000000000000009:13 [read 466944~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:49.836 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.436998+0000", 2024-09-13T06:41:49.837 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 113.385858974, 2024-09-13T06:41:49.837 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089730867000000006, 2024-09-13T06:41:49.837 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:49.837 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:49.837 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:49.837 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:49.837 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:49.837 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25663 2024-09-13T06:41:49.837 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.837 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:49.837 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.837 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:49.837 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436998+0000", 2024-09-13T06:41:49.837 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:49.838 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.838 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.838 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:49.838 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436998+0000", 2024-09-13T06:41:49.838 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:49.838 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.838 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.838 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:49.838 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436998+0000", 2024-09-13T06:41:49.838 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:49.838 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.838 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.838 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:49.838 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437000+0000", 2024-09-13T06:41:49.838 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0940000000000002e-06 2024-09-13T06:41:49.839 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.839 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.839 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:49.839 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437005+0000", 2024-09-13T06:41:49.839 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.604e-06 2024-09-13T06:41:49.839 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.839 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.839 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:49.839 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437032+0000", 2024-09-13T06:41:49.839 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6407e-05 2024-09-13T06:41:49.839 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.839 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.839 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:49.840 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.526363+0000", 2024-09-13T06:41:49.840 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089331456000000004 2024-09-13T06:41:49.840 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.840 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.840 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:49.840 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.526404+0000", 2024-09-13T06:41:49.840 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.0887999999999999e-05 2024-09-13T06:41:49.840 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.840 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.840 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:49.840 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.526729+0000", 2024-09-13T06:41:49.840 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00032486 2024-09-13T06:41:49.840 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:49.841 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:49.841 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:49.841 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.841 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.841 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25664 3.8 3:1180686c:::rbd_data.1121f2c5ee81.0000000000000009:13 [read 491520~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:49.841 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.437040+0000", 2024-09-13T06:41:49.841 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 113.385817059, 2024-09-13T06:41:49.841 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.090016650000000004, 2024-09-13T06:41:49.841 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:49.841 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:49.841 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:49.841 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:49.841 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:49.842 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25664 2024-09-13T06:41:49.842 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.842 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:49.842 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.842 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:49.842 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437040+0000", 2024-09-13T06:41:49.842 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:49.842 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.842 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.842 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:49.842 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437040+0000", 2024-09-13T06:41:49.842 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:49.842 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.842 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.843 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:49.843 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437039+0000", 2024-09-13T06:41:49.843 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:49.843 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.843 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.843 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:49.843 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437047+0000", 2024-09-13T06:41:49.843 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4839999999999998e-06 2024-09-13T06:41:49.843 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.843 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.843 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:49.843 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437054+0000", 2024-09-13T06:41:49.843 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.8299999999999998e-06 2024-09-13T06:41:49.843 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.844 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.844 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:49.844 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437060+0000", 2024-09-13T06:41:49.844 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.1510000000000001e-06 2024-09-13T06:41:49.844 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.844 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.844 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:49.844 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.526772+0000", 2024-09-13T06:41:49.844 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089711737999999999 2024-09-13T06:41:49.844 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.844 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.844 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:49.844 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.526848+0000", 2024-09-13T06:41:49.844 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5870000000000004e-05 2024-09-13T06:41:49.844 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.845 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.845 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:49.845 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.527057+0000", 2024-09-13T06:41:49.845 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000209106 2024-09-13T06:41:49.845 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:49.845 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:49.845 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:49.845 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.845 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.845 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25740 3.18 3:1c662b96:::rbd_data.1121f2c5ee81.0000000000000010:13 [read 200704~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:49.845 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443352+0000", 2024-09-13T06:41:49.845 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 113.379505384, 2024-09-13T06:41:49.845 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089068222000000002, 2024-09-13T06:41:49.846 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:49.846 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:49.846 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:49.846 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:49.846 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:49.846 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25740 2024-09-13T06:41:49.846 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.846 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:49.846 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.846 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:49.846 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443352+0000", 2024-09-13T06:41:49.846 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:49.846 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.846 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.846 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:49.847 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443352+0000", 2024-09-13T06:41:49.847 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:49.847 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.847 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.847 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:49.847 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443351+0000", 2024-09-13T06:41:49.847 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:49.847 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.847 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.847 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:49.847 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443354+0000", 2024-09-13T06:41:49.847 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.841e-06 2024-09-13T06:41:49.847 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.847 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.848 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:49.848 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443361+0000", 2024-09-13T06:41:49.848 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.0010000000000004e-06 2024-09-13T06:41:49.848 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.848 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.848 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:49.848 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443366+0000", 2024-09-13T06:41:49.848 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7119999999999999e-06 2024-09-13T06:41:49.848 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.848 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.848 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:49.848 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532117+0000", 2024-09-13T06:41:49.848 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.088751327000000005 2024-09-13T06:41:49.848 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.849 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.849 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:49.849 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532193+0000", 2024-09-13T06:41:49.849 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5839000000000004e-05 2024-09-13T06:41:49.849 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.849 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.849 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:49.849 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532420+0000", 2024-09-13T06:41:49.849 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00022691000000000001 2024-09-13T06:41:49.849 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:49.849 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:49.849 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:49.849 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.850 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.850 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25741 3.18 3:1c662b96:::rbd_data.1121f2c5ee81.0000000000000010:13 [read 225280~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:49.850 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443378+0000", 2024-09-13T06:41:49.850 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 113.379478617, 2024-09-13T06:41:49.850 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089324107, 2024-09-13T06:41:49.850 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:49.850 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:49.850 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:49.850 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:49.850 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:49.850 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25741 2024-09-13T06:41:49.850 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.850 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:49.850 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.851 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:49.851 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443378+0000", 2024-09-13T06:41:49.851 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:49.851 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.851 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.851 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:49.851 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443378+0000", 2024-09-13T06:41:49.851 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:49.851 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.851 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.851 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:49.851 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443378+0000", 2024-09-13T06:41:49.851 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:49.852 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.852 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.852 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:49.852 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443380+0000", 2024-09-13T06:41:49.852 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3549999999999999e-06 2024-09-13T06:41:49.852 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.852 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.852 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:49.852 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443388+0000", 2024-09-13T06:41:49.852 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.7449999999999995e-06 2024-09-13T06:41:49.852 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.852 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.853 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:49.853 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443393+0000", 2024-09-13T06:41:49.853 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.4e-06 2024-09-13T06:41:49.853 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.853 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.853 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:49.853 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532454+0000", 2024-09-13T06:41:49.853 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089060941000000005 2024-09-13T06:41:49.853 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.853 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.853 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:49.853 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532512+0000", 2024-09-13T06:41:49.853 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7763000000000002e-05 2024-09-13T06:41:49.853 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.854 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.854 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:49.854 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532703+0000", 2024-09-13T06:41:49.854 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000190328 2024-09-13T06:41:49.854 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:49.854 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:49.854 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:49.854 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.854 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.854 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25742 3.18 3:1c662b96:::rbd_data.1121f2c5ee81.0000000000000010:13 [read 270336~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:49.854 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443398+0000", 2024-09-13T06:41:49.854 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 113.37945890500001, 2024-09-13T06:41:49.854 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089621836999999996, 2024-09-13T06:41:49.854 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:49.855 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:49.855 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:49.855 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:49.855 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:49.855 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25742 2024-09-13T06:41:49.855 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.855 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:49.855 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.855 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:49.855 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443398+0000", 2024-09-13T06:41:49.855 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:49.855 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.855 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.855 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:49.855 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443398+0000", 2024-09-13T06:41:49.856 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:49.856 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.856 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.856 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:49.856 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443398+0000", 2024-09-13T06:41:49.856 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:49.856 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.856 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.856 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:49.856 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443400+0000", 2024-09-13T06:41:49.856 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1849999999999998e-06 2024-09-13T06:41:49.856 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.856 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.856 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:49.857 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443407+0000", 2024-09-13T06:41:49.857 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3669999999999999e-06 2024-09-13T06:41:49.857 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.857 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.857 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:49.857 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443420+0000", 2024-09-13T06:41:49.857 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2645e-05 2024-09-13T06:41:49.857 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.857 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.857 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:49.857 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532742+0000", 2024-09-13T06:41:49.857 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089322200000000004 2024-09-13T06:41:49.857 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.857 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.858 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:49.858 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532818+0000", 2024-09-13T06:41:49.858 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.6019000000000005e-05 2024-09-13T06:41:49.858 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.858 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.858 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:49.858 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533020+0000", 2024-09-13T06:41:49.858 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000201721 2024-09-13T06:41:49.858 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:49.858 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:49.858 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:49.858 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.858 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.858 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25743 3.18 3:1c662b96:::rbd_data.1121f2c5ee81.0000000000000010:13 [read 294912~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:49.859 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443425+0000", 2024-09-13T06:41:49.859 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 113.379431897, 2024-09-13T06:41:49.859 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089864075000000002, 2024-09-13T06:41:49.859 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:49.859 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:49.859 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:49.859 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:49.859 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:49.859 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25743 2024-09-13T06:41:49.859 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.859 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:49.859 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.859 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:49.859 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443425+0000", 2024-09-13T06:41:49.859 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:49.860 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.860 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.860 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:49.860 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443425+0000", 2024-09-13T06:41:49.860 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:49.860 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.860 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.860 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:49.860 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443425+0000", 2024-09-13T06:41:49.860 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:49.860 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.860 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.860 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:49.860 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443432+0000", 2024-09-13T06:41:49.861 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3420000000000002e-06 2024-09-13T06:41:49.861 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.861 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.861 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:49.861 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443440+0000", 2024-09-13T06:41:49.861 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5689999999999999e-06 2024-09-13T06:41:49.861 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.861 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.861 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:49.861 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443445+0000", 2024-09-13T06:41:49.861 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9590000000000003e-06 2024-09-13T06:41:49.861 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.861 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.861 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:49.862 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533063+0000", 2024-09-13T06:41:49.862 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089617988999999995 2024-09-13T06:41:49.862 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.862 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.862 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:49.862 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533122+0000", 2024-09-13T06:41:49.862 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9052999999999999e-05 2024-09-13T06:41:49.862 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.862 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.862 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:49.862 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533289+0000", 2024-09-13T06:41:49.862 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00016752800000000001 2024-09-13T06:41:49.862 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:49.862 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:49.863 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:49.863 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.863 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.863 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25744 3.18 3.69d46638 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:49.863 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443449+0000", 2024-09-13T06:41:49.863 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 113.37940775, 2024-09-13T06:41:49.863 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089869148999999995, 2024-09-13T06:41:49.863 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:49.863 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:41:49.863 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:49.863 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:49.863 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:49.863 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25744 2024-09-13T06:41:49.863 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.863 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:49.863 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.864 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:49.864 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443449+0000", 2024-09-13T06:41:49.864 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:49.864 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.864 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.864 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:49.864 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443449+0000", 2024-09-13T06:41:49.864 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:49.864 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.864 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.864 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:49.864 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443449+0000", 2024-09-13T06:41:49.864 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:49.864 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.865 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.865 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:49.865 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443451+0000", 2024-09-13T06:41:49.865 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.244e-06 2024-09-13T06:41:49.865 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.865 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.865 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:49.865 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443457+0000", 2024-09-13T06:41:49.865 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.66e-06 2024-09-13T06:41:49.865 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.865 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.865 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:49.865 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443461+0000", 2024-09-13T06:41:49.866 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5449999999999997e-06 2024-09-13T06:41:49.866 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.866 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.866 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:49.866 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533311+0000", 2024-09-13T06:41:49.866 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089849729000000003 2024-09-13T06:41:49.866 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.866 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.866 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:49.866 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533318+0000", 2024-09-13T06:41:49.866 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.328e-06 2024-09-13T06:41:49.866 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:49.866 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:49.866 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:49.867 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.867 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.867 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25745 3.18 3.69d46638 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:49.867 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443466+0000", 2024-09-13T06:41:49.867 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 113.379390692, 2024-09-13T06:41:49.867 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089886743000000005, 2024-09-13T06:41:49.867 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:49.867 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:41:49.867 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:49.867 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:49.867 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:49.867 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25745 2024-09-13T06:41:49.867 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.868 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:49.868 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.868 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:49.868 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443466+0000", 2024-09-13T06:41:49.868 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:49.868 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.868 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.868 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:49.868 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443466+0000", 2024-09-13T06:41:49.868 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:49.868 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.869 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.869 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:49.869 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443466+0000", 2024-09-13T06:41:49.869 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:49.869 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.869 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.869 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:49.869 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443474+0000", 2024-09-13T06:41:49.869 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.1289999999999996e-06 2024-09-13T06:41:49.869 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.869 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.869 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:49.869 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443484+0000", 2024-09-13T06:41:49.869 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0654e-05 2024-09-13T06:41:49.870 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.870 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.870 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:49.870 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443490+0000", 2024-09-13T06:41:49.870 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8030000000000002e-06 2024-09-13T06:41:49.870 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.870 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.870 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:49.870 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533348+0000", 2024-09-13T06:41:49.870 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089857267000000005 2024-09-13T06:41:49.870 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.870 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.870 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:49.870 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533353+0000", 2024-09-13T06:41:49.871 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.5520000000000004e-06 2024-09-13T06:41:49.871 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:49.871 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:49.871 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:49.871 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.871 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.871 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25746 3.18 3.69d46638 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:49.871 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443495+0000", 2024-09-13T06:41:49.871 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 113.379361579, 2024-09-13T06:41:49.871 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089903725000000004, 2024-09-13T06:41:49.871 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:49.871 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:41:49.871 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:49.871 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:49.872 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:49.872 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25746 2024-09-13T06:41:49.872 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.872 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:49.872 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.872 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:49.872 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443495+0000", 2024-09-13T06:41:49.872 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:49.872 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.872 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.872 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:49.872 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443495+0000", 2024-09-13T06:41:49.872 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:49.873 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.873 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.873 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:49.873 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443495+0000", 2024-09-13T06:41:49.873 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:49.873 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.873 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.873 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:49.873 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443498+0000", 2024-09-13T06:41:49.873 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.7690000000000001e-06 2024-09-13T06:41:49.873 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.873 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.873 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:49.873 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443504+0000", 2024-09-13T06:41:49.874 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9710000000000001e-06 2024-09-13T06:41:49.874 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.874 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.874 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:49.874 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443508+0000", 2024-09-13T06:41:49.874 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4159999999999997e-06 2024-09-13T06:41:49.874 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.874 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.874 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:49.874 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533391+0000", 2024-09-13T06:41:49.874 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089882607000000003 2024-09-13T06:41:49.874 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.874 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.874 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:49.874 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533399+0000", 2024-09-13T06:41:49.875 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.4349999999999997e-06 2024-09-13T06:41:49.875 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:49.875 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:49.875 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:49.875 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.875 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.875 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25747 3.8 3.63996268 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:49.875 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443512+0000", 2024-09-13T06:41:49.875 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 113.379344848, 2024-09-13T06:41:49.875 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089880075000000004, 2024-09-13T06:41:49.875 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:49.875 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:41:49.875 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:49.875 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:49.875 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:49.876 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25747 2024-09-13T06:41:49.876 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.876 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:49.876 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.876 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:49.876 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443512+0000", 2024-09-13T06:41:49.876 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:49.876 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.876 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.876 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:49.876 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443512+0000", 2024-09-13T06:41:49.876 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:49.876 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.876 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.876 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:49.877 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443512+0000", 2024-09-13T06:41:49.877 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:49.877 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.877 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.877 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:49.877 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443514+0000", 2024-09-13T06:41:49.877 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0980000000000001e-06 2024-09-13T06:41:49.877 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.877 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.877 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:49.877 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443520+0000", 2024-09-13T06:41:49.877 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7069999999999997e-06 2024-09-13T06:41:49.877 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.878 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.878 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:49.878 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443524+0000", 2024-09-13T06:41:49.878 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5390000000000001e-06 2024-09-13T06:41:49.878 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.878 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.878 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:49.878 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533384+0000", 2024-09-13T06:41:49.878 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089859684999999995 2024-09-13T06:41:49.878 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.878 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.878 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:49.878 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533392+0000", 2024-09-13T06:41:49.878 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.3440000000000001e-06 2024-09-13T06:41:49.879 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:49.879 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:49.879 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:49.879 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.879 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.879 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25748 3.8 3.63996268 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:49.879 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443528+0000", 2024-09-13T06:41:49.879 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 113.37932872099999, 2024-09-13T06:41:49.879 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089890715999999996, 2024-09-13T06:41:49.879 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:49.879 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:41:49.879 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:49.879 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:49.879 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:49.879 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25748 2024-09-13T06:41:49.880 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.880 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:49.880 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.880 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:49.880 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443528+0000", 2024-09-13T06:41:49.880 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:49.880 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.880 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.880 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:49.880 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443528+0000", 2024-09-13T06:41:49.880 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:49.880 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.880 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.880 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:49.881 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443528+0000", 2024-09-13T06:41:49.881 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:49.881 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.881 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.881 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:49.881 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443530+0000", 2024-09-13T06:41:49.881 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0650000000000001e-06 2024-09-13T06:41:49.881 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.881 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.881 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:49.881 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443536+0000", 2024-09-13T06:41:49.881 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7259999999999999e-06 2024-09-13T06:41:49.881 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.881 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.882 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:49.882 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443540+0000", 2024-09-13T06:41:49.882 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5009999999999998e-06 2024-09-13T06:41:49.882 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.882 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.882 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:49.882 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533412+0000", 2024-09-13T06:41:49.882 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089871873000000005 2024-09-13T06:41:49.882 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.882 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.882 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:49.882 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533419+0000", 2024-09-13T06:41:49.882 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.883e-06 2024-09-13T06:41:49.882 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:49.883 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:49.883 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:49.883 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.883 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.883 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25749 3.8 3.63996268 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:49.883 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443545+0000", 2024-09-13T06:41:49.883 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 113.379312525, 2024-09-13T06:41:49.883 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089897988999999998, 2024-09-13T06:41:49.883 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:49.883 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:41:49.883 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:49.883 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:49.883 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:49.883 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25749 2024-09-13T06:41:49.884 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.884 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:49.884 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.884 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:49.884 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443545+0000", 2024-09-13T06:41:49.884 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:49.884 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.884 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.884 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:49.884 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443545+0000", 2024-09-13T06:41:49.884 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:49.884 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.884 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.885 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:49.885 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443544+0000", 2024-09-13T06:41:49.885 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:49.885 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.885 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.885 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:49.885 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443553+0000", 2024-09-13T06:41:49.885 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.4770000000000003e-06 2024-09-13T06:41:49.885 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.885 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.885 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:49.885 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443564+0000", 2024-09-13T06:41:49.885 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0986e-05 2024-09-13T06:41:49.886 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.886 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.886 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:49.886 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443569+0000", 2024-09-13T06:41:49.886 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2530000000000004e-06 2024-09-13T06:41:49.886 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.886 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.886 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:49.886 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533438+0000", 2024-09-13T06:41:49.886 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089868641999999999 2024-09-13T06:41:49.886 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.886 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.886 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:49.886 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533442+0000", 2024-09-13T06:41:49.887 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.989e-06 2024-09-13T06:41:49.887 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:49.887 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:49.887 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:49.887 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.887 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.887 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25750 3.8 3.63996268 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:49.887 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443574+0000", 2024-09-13T06:41:49.887 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 113.379283039, 2024-09-13T06:41:49.887 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089895143999999996, 2024-09-13T06:41:49.887 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:49.887 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:41:49.887 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:49.887 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:49.887 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:49.887 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25750 2024-09-13T06:41:49.888 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.888 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:49.888 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.888 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:49.888 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443574+0000", 2024-09-13T06:41:49.888 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:49.888 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.888 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.888 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:49.888 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443574+0000", 2024-09-13T06:41:49.888 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:49.888 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.888 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.889 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:49.889 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443574+0000", 2024-09-13T06:41:49.889 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:49.889 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.889 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.889 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:49.889 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443576+0000", 2024-09-13T06:41:49.889 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6910000000000002e-06 2024-09-13T06:41:49.889 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.889 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.889 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:49.889 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443583+0000", 2024-09-13T06:41:49.889 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.331e-06 2024-09-13T06:41:49.890 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.890 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.890 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:49.890 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443587+0000", 2024-09-13T06:41:49.890 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6129999999999997e-06 2024-09-13T06:41:49.890 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.890 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.890 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:49.890 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533464+0000", 2024-09-13T06:41:49.890 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089876605999999998 2024-09-13T06:41:49.890 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.890 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.890 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:49.891 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533469+0000", 2024-09-13T06:41:49.891 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3909999999999997e-06 2024-09-13T06:41:49.891 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:49.891 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:49.891 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:49.891 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.891 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.891 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25751 3.8 3.63996268 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:49.891 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443592+0000", 2024-09-13T06:41:49.891 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 113.379265342, 2024-09-13T06:41:49.891 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089913650999999997, 2024-09-13T06:41:49.891 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:49.891 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:41:49.891 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:49.892 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:49.892 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:49.892 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25751 2024-09-13T06:41:49.892 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.892 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:49.892 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.892 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:49.892 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443592+0000", 2024-09-13T06:41:49.892 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:49.892 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.892 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.892 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:49.892 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443592+0000", 2024-09-13T06:41:49.892 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:49.893 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.893 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.893 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:49.893 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443591+0000", 2024-09-13T06:41:49.893 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:49.893 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.893 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.893 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:49.893 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443594+0000", 2024-09-13T06:41:49.893 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3649999999999998e-06 2024-09-13T06:41:49.893 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.893 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.893 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:49.894 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443599+0000", 2024-09-13T06:41:49.894 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.699e-06 2024-09-13T06:41:49.894 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.894 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.894 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:49.894 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443611+0000", 2024-09-13T06:41:49.894 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1503e-05 2024-09-13T06:41:49.894 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.894 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.894 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:49.894 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533497+0000", 2024-09-13T06:41:49.894 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089886453000000005 2024-09-13T06:41:49.894 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.894 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.895 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:49.895 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533505+0000", 2024-09-13T06:41:49.895 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.9910000000000002e-06 2024-09-13T06:41:49.895 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:49.895 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:49.895 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:49.895 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.895 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.895 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25752 3.8 3.63996268 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:49.895 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443615+0000", 2024-09-13T06:41:49.895 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 113.379241561, 2024-09-13T06:41:49.895 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089905868999999999, 2024-09-13T06:41:49.895 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:49.896 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:41:49.896 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:49.896 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:49.896 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:49.896 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25752 2024-09-13T06:41:49.896 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.896 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:49.896 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.896 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:49.896 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443615+0000", 2024-09-13T06:41:49.896 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:49.896 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.896 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.896 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:49.897 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443615+0000", 2024-09-13T06:41:49.897 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:49.897 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.897 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.897 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:49.897 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443615+0000", 2024-09-13T06:41:49.897 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:49.897 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.897 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.897 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:49.897 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443617+0000", 2024-09-13T06:41:49.897 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3539999999999998e-06 2024-09-13T06:41:49.897 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.897 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.898 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:49.898 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443624+0000", 2024-09-13T06:41:49.898 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3600000000000001e-06 2024-09-13T06:41:49.898 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.898 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.898 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:49.898 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443628+0000", 2024-09-13T06:41:49.898 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.2350000000000001e-06 2024-09-13T06:41:49.898 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.898 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.898 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:49.898 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533517+0000", 2024-09-13T06:41:49.898 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089889029999999995 2024-09-13T06:41:49.899 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.899 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.899 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:49.899 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533521+0000", 2024-09-13T06:41:49.899 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.2529999999999998e-06 2024-09-13T06:41:49.899 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:49.899 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:49.899 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:49.899 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.899 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.899 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25755 3.8 3.63996268 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:49.899 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.444692+0000", 2024-09-13T06:41:49.899 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 113.37816485499999, 2024-09-13T06:41:49.900 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.088904186999999996, 2024-09-13T06:41:49.900 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:49.900 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:41:49.900 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:49.900 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:49.900 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:49.900 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25755 2024-09-13T06:41:49.900 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.900 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:49.900 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.900 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:49.900 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.444692+0000", 2024-09-13T06:41:49.900 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:49.901 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.901 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.901 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:49.901 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.444692+0000", 2024-09-13T06:41:49.901 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:49.901 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.901 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.901 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:49.901 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.444692+0000", 2024-09-13T06:41:49.901 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:49.901 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.901 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.901 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:49.901 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.444694+0000", 2024-09-13T06:41:49.901 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.058e-06 2024-09-13T06:41:49.902 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.902 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.902 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:49.902 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.444700+0000", 2024-09-13T06:41:49.902 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7769999999999999e-06 2024-09-13T06:41:49.902 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.902 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.902 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:49.902 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.444704+0000", 2024-09-13T06:41:49.902 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6229999999999996e-06 2024-09-13T06:41:49.902 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.902 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.902 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:49.902 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533587+0000", 2024-09-13T06:41:49.902 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.088882744999999999 2024-09-13T06:41:49.903 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.903 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.903 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:49.903 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533596+0000", 2024-09-13T06:41:49.903 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.3270000000000007e-06 2024-09-13T06:41:49.903 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:49.903 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:49.903 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:49.903 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.903 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.903 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:64356 3.c 3:32785be9:::rbd_header.11218ba71f0d:head [watch reconnect cookie 140361410387072 gen 2] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e95)", 2024-09-13T06:41:49.903 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:48.473318+0000", 2024-09-13T06:41:49.903 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 61.349539168, 2024-09-13T06:41:49.904 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1458904379999999, 2024-09-13T06:41:49.904 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:49.904 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:49.904 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:49.904 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:49.904 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:49.904 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 64356 2024-09-13T06:41:49.904 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.904 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:49.904 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.904 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:49.904 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:48.473318+0000", 2024-09-13T06:41:49.904 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:49.904 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.904 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.905 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:49.905 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:48.473318+0000", 2024-09-13T06:41:49.905 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:49.905 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.905 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.905 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:49.905 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:48.473315+0000", 2024-09-13T06:41:49.905 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999971 2024-09-13T06:41:49.905 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.905 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.905 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:49.905 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:48.473329+0000", 2024-09-13T06:41:49.905 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.433e-05 2024-09-13T06:41:49.905 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.905 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.906 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:49.906 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:48.473363+0000", 2024-09-13T06:41:49.906 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.3592e-05 2024-09-13T06:41:49.906 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.906 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.906 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:49.906 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:48.473386+0000", 2024-09-13T06:41:49.906 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2708999999999999e-05 2024-09-13T06:41:49.906 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.906 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.906 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:49.906 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:48.473804+0000", 2024-09-13T06:41:49.906 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00041789399999999998 2024-09-13T06:41:49.906 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.907 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.907 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:41:49.907 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:48.473830+0000", 2024-09-13T06:41:49.907 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6869e-05 2024-09-13T06:41:49.907 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.907 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.907 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:49.907 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:49.614332+0000", 2024-09-13T06:41:49.907 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.140501107 2024-09-13T06:41:49.907 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.907 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.907 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for rw locks", 2024-09-13T06:41:49.907 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:49.614496+0000", 2024-09-13T06:41:49.907 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00016451200000000001 2024-09-13T06:41:49.908 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.908 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.908 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:49.908 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:49.617131+0000", 2024-09-13T06:41:49.908 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.002634843 2024-09-13T06:41:49.908 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.908 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.908 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:49.908 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:49.617204+0000", 2024-09-13T06:41:49.908 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.2991000000000006e-05 2024-09-13T06:41:49.908 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:49.908 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:49.908 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:49.908 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:49.619208+0000", 2024-09-13T06:41:49.909 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.002004381 2024-09-13T06:41:49.909 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:49.909 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:49.909 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:49.909 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:49.909 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:49.909 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:41:49.910 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-13T06:41:49.911 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:41:49.910+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:41:50.012 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:41:50.009+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:41:50.045 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:41:50.045 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [], 2024-09-13T06:41:50.045 INFO:teuthology.orchestra.run.smithi139.stdout: "num_ops": 0 2024-09-13T06:41:50.045 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:41:50.059 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-13T06:41:50.113 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:41:50.109+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:41:50.185 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:41:50.185 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [], 2024-09-13T06:41:50.186 INFO:teuthology.orchestra.run.smithi139.stdout: "complaint_time": 30, 2024-09-13T06:41:50.186 INFO:teuthology.orchestra.run.smithi139.stdout: "num_blocked_ops": 0 2024-09-13T06:41:50.186 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:41:50.200 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-13T06:41:50.214 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:41:50.213+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:41:50.315 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:41:50.310+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:41:50.319 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:41:50.319 INFO:teuthology.orchestra.run.smithi139.stdout: "size": 20, 2024-09-13T06:41:50.319 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 600, 2024-09-13T06:41:50.319 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [ 2024-09-13T06:41:50.319 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.319 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18706 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 3346432~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:41:50.320 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.846138+0000", 2024-09-13T06:41:50.320 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 118.470596696, 2024-09-13T06:41:50.320 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.102018712, 2024-09-13T06:41:50.320 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:50.320 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:50.320 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:50.320 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:50.320 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:50.320 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18706 2024-09-13T06:41:50.320 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.320 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:50.321 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.321 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:50.321 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846138+0000", 2024-09-13T06:41:50.321 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:50.321 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.321 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.321 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:50.321 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846138+0000", 2024-09-13T06:41:50.321 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:50.321 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.321 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.321 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:50.322 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846138+0000", 2024-09-13T06:41:50.322 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:50.322 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.322 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.322 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:50.322 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846141+0000", 2024-09-13T06:41:50.322 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.6969999999999999e-06 2024-09-13T06:41:50.322 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.322 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.322 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:50.322 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846150+0000", 2024-09-13T06:41:50.322 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6400000000000003e-06 2024-09-13T06:41:50.322 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.322 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.323 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:50.323 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846160+0000", 2024-09-13T06:41:50.323 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.3999999999999998e-06 2024-09-13T06:41:50.323 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.323 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.323 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:50.323 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.947764+0000", 2024-09-13T06:41:50.323 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101604085 2024-09-13T06:41:50.323 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.323 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.323 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:50.323 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.947888+0000", 2024-09-13T06:41:50.323 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000124113 2024-09-13T06:41:50.324 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.324 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.324 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:50.324 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.948157+0000", 2024-09-13T06:41:50.324 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00026943399999999998 2024-09-13T06:41:50.324 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:50.324 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:50.324 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:50.324 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.324 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.324 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18707 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 3375104~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:41:50.324 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.846207+0000", 2024-09-13T06:41:50.324 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 118.47052793, 2024-09-13T06:41:50.325 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10238114099999999, 2024-09-13T06:41:50.325 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:50.325 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:50.325 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:50.325 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:50.325 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:50.325 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18707 2024-09-13T06:41:50.325 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.325 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:50.325 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.325 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:50.325 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846207+0000", 2024-09-13T06:41:50.326 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:50.326 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.326 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.326 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:50.326 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846207+0000", 2024-09-13T06:41:50.326 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:50.326 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.326 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.327 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:50.327 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846206+0000", 2024-09-13T06:41:50.327 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:50.327 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.327 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.327 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:50.327 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846211+0000", 2024-09-13T06:41:50.327 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.3000000000000003e-06 2024-09-13T06:41:50.327 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.327 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.327 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:50.327 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846220+0000", 2024-09-13T06:41:50.328 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6199999999999994e-06 2024-09-13T06:41:50.328 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.328 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.328 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:50.328 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846228+0000", 2024-09-13T06:41:50.328 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.7500000000000003e-06 2024-09-13T06:41:50.328 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.328 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.328 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:50.328 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.948267+0000", 2024-09-13T06:41:50.328 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10203878700000001 2024-09-13T06:41:50.329 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.329 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.329 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:50.329 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.948435+0000", 2024-09-13T06:41:50.329 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00016796500000000001 2024-09-13T06:41:50.329 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.329 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.329 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:50.329 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.948588+0000", 2024-09-13T06:41:50.329 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00015373599999999999 2024-09-13T06:41:50.329 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:50.329 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:50.330 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:50.330 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.330 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.330 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18718 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 3690496~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:41:50.330 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.850174+0000", 2024-09-13T06:41:50.330 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 118.466560777, 2024-09-13T06:41:50.330 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101854154, 2024-09-13T06:41:50.330 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:50.330 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:50.330 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:50.330 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:50.330 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:50.330 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18718 2024-09-13T06:41:50.331 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.331 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:50.331 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.331 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:50.331 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850174+0000", 2024-09-13T06:41:50.331 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:50.331 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.331 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.331 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:50.331 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850174+0000", 2024-09-13T06:41:50.331 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:50.331 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.331 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.332 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:50.332 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850173+0000", 2024-09-13T06:41:50.332 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:50.332 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.332 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.332 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:50.332 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850178+0000", 2024-09-13T06:41:50.332 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.4129999999999999e-06 2024-09-13T06:41:50.332 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.332 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.332 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:50.332 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850188+0000", 2024-09-13T06:41:50.333 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.8600000000000005e-06 2024-09-13T06:41:50.333 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.333 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.333 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:50.333 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850195+0000", 2024-09-13T06:41:50.333 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.8730000000000007e-06 2024-09-13T06:41:50.333 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.333 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.333 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:50.333 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.951766+0000", 2024-09-13T06:41:50.333 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.1015703 2024-09-13T06:41:50.333 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.333 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.334 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:50.334 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.951879+0000", 2024-09-13T06:41:50.334 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000112932 2024-09-13T06:41:50.334 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.334 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.334 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:50.334 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.952029+0000", 2024-09-13T06:41:50.334 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000149846 2024-09-13T06:41:50.334 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:50.334 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:50.334 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:50.334 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.335 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.335 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18719 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 3719168~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:41:50.335 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.850202+0000", 2024-09-13T06:41:50.335 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 118.466532734, 2024-09-13T06:41:50.335 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.102191676, 2024-09-13T06:41:50.335 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:50.335 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:50.335 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:50.335 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:50.335 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:50.335 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18719 2024-09-13T06:41:50.335 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.336 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:50.336 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.336 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:50.336 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850202+0000", 2024-09-13T06:41:50.336 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:50.336 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.336 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.336 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:50.336 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850202+0000", 2024-09-13T06:41:50.337 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:50.337 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.337 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.337 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:50.337 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850202+0000", 2024-09-13T06:41:50.337 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:50.337 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.337 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.337 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:50.337 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850205+0000", 2024-09-13T06:41:50.337 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.89e-06 2024-09-13T06:41:50.337 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.338 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.338 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:50.338 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850216+0000", 2024-09-13T06:41:50.338 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0233e-05 2024-09-13T06:41:50.338 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.338 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.338 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:50.338 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850223+0000", 2024-09-13T06:41:50.338 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5299999999999999e-06 2024-09-13T06:41:50.338 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.338 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.338 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:50.338 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.952106+0000", 2024-09-13T06:41:50.339 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10188309299999999 2024-09-13T06:41:50.339 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.339 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.339 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:50.339 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.952233+0000", 2024-09-13T06:41:50.339 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000126993 2024-09-13T06:41:50.339 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.339 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.339 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:50.339 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.952394+0000", 2024-09-13T06:41:50.339 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000160791 2024-09-13T06:41:50.339 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:50.339 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:50.340 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:50.340 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.340 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.340 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18720 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 3747840~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:41:50.340 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.850726+0000", 2024-09-13T06:41:50.340 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 118.466008905, 2024-09-13T06:41:50.340 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10199504299999999, 2024-09-13T06:41:50.340 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:50.340 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:50.340 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:50.341 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:50.341 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:50.341 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18720 2024-09-13T06:41:50.341 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.341 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:50.341 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.341 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:50.341 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850726+0000", 2024-09-13T06:41:50.341 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:50.341 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.341 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.341 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:50.342 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850726+0000", 2024-09-13T06:41:50.342 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:50.342 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.342 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.342 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:50.342 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850229+0000", 2024-09-13T06:41:50.342 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9995027 2024-09-13T06:41:50.342 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.342 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.342 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:50.342 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850731+0000", 2024-09-13T06:41:50.342 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00050221599999999999 2024-09-13T06:41:50.342 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.343 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.343 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:50.343 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850751+0000", 2024-09-13T06:41:50.343 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.9703000000000001e-05 2024-09-13T06:41:50.343 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.343 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.343 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:50.343 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850764+0000", 2024-09-13T06:41:50.343 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3207000000000001e-05 2024-09-13T06:41:50.343 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.343 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.343 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:50.343 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.952454+0000", 2024-09-13T06:41:50.343 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101690102 2024-09-13T06:41:50.343 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.344 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.344 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:50.344 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.952571+0000", 2024-09-13T06:41:50.344 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000116556 2024-09-13T06:41:50.344 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.344 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.344 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:50.344 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.952721+0000", 2024-09-13T06:41:50.344 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000150419 2024-09-13T06:41:50.344 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:50.344 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:50.345 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:50.345 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.345 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.345 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18730 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 4034560~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:41:50.345 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.854013+0000", 2024-09-13T06:41:50.345 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 118.462721964, 2024-09-13T06:41:50.345 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10186914399999999, 2024-09-13T06:41:50.345 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:50.345 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:50.345 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:50.345 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:50.345 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:50.345 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18730 2024-09-13T06:41:50.346 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.346 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:50.346 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.346 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:50.346 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.854013+0000", 2024-09-13T06:41:50.346 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:50.346 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.346 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.346 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:50.346 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.854013+0000", 2024-09-13T06:41:50.346 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:50.346 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.346 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.347 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:50.347 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.854013+0000", 2024-09-13T06:41:50.347 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:50.347 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.347 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.347 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:50.347 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.854016+0000", 2024-09-13T06:41:50.347 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.1839999999999999e-06 2024-09-13T06:41:50.347 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.347 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.347 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:50.347 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.854025+0000", 2024-09-13T06:41:50.347 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.8030000000000003e-06 2024-09-13T06:41:50.347 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.348 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.348 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:50.348 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.854033+0000", 2024-09-13T06:41:50.348 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6500000000000002e-06 2024-09-13T06:41:50.348 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.348 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.348 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:50.348 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.955546+0000", 2024-09-13T06:41:50.348 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10151296 2024-09-13T06:41:50.348 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.348 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.348 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:50.348 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.955694+0000", 2024-09-13T06:41:50.349 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000147773 2024-09-13T06:41:50.349 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.349 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.349 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:50.349 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.955882+0000", 2024-09-13T06:41:50.349 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000188371 2024-09-13T06:41:50.349 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:50.349 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:50.349 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:50.349 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.349 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.349 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18742 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 4378624~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:41:50.349 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.857984+0000", 2024-09-13T06:41:50.349 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 118.458750841, 2024-09-13T06:41:50.350 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10179961799999999, 2024-09-13T06:41:50.352 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:50.352 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:50.352 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:50.352 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:50.353 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:50.353 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18742 2024-09-13T06:41:50.353 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.353 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:50.353 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.353 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:50.353 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.857984+0000", 2024-09-13T06:41:50.353 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:50.353 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.353 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.353 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:50.353 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.857984+0000", 2024-09-13T06:41:50.354 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:50.354 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.354 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.354 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:50.354 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.857983+0000", 2024-09-13T06:41:50.354 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:50.354 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.355 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.355 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:50.355 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.857987+0000", 2024-09-13T06:41:50.355 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0670000000000002e-06 2024-09-13T06:41:50.355 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.355 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.355 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:50.355 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.857997+0000", 2024-09-13T06:41:50.355 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6830000000000003e-06 2024-09-13T06:41:50.355 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.355 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.356 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:50.356 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.858006+0000", 2024-09-13T06:41:50.356 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.5739999999999996e-06 2024-09-13T06:41:50.356 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.356 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.356 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:50.356 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.959453+0000", 2024-09-13T06:41:50.356 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101447339 2024-09-13T06:41:50.357 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.357 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.357 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:50.357 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.959603+0000", 2024-09-13T06:41:50.357 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000150316 2024-09-13T06:41:50.357 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.357 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.357 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:50.357 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.959784+0000", 2024-09-13T06:41:50.357 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00018065900000000001 2024-09-13T06:41:50.357 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:50.357 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:50.358 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:50.358 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.358 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.358 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18743 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 4407296~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:41:50.358 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.858012+0000", 2024-09-13T06:41:50.358 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 118.45872284799999, 2024-09-13T06:41:50.358 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10210024500000001, 2024-09-13T06:41:50.358 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:50.358 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:50.358 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:50.358 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:50.358 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:50.358 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18743 2024-09-13T06:41:50.358 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.359 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:50.359 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.359 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:50.359 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.858012+0000", 2024-09-13T06:41:50.359 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:50.359 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.359 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.359 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:50.360 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.858012+0000", 2024-09-13T06:41:50.360 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:50.360 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.360 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.360 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:50.360 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.858011+0000", 2024-09-13T06:41:50.360 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:50.360 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.360 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.360 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:50.360 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.858016+0000", 2024-09-13T06:41:50.360 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0659999999999997e-06 2024-09-13T06:41:50.360 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.361 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.361 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:50.361 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.858024+0000", 2024-09-13T06:41:50.361 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.7700000000000007e-06 2024-09-13T06:41:50.361 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.361 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.361 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:50.361 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.858032+0000", 2024-09-13T06:41:50.361 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.7700000000000001e-06 2024-09-13T06:41:50.361 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.361 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.361 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:50.362 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.959850+0000", 2024-09-13T06:41:50.362 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.1018182 2024-09-13T06:41:50.362 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.362 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.362 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:50.362 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.959964+0000", 2024-09-13T06:41:50.362 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00011413600000000001 2024-09-13T06:41:50.362 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.362 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.362 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:50.362 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.960113+0000", 2024-09-13T06:41:50.362 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00014813900000000001 2024-09-13T06:41:50.362 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:50.363 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:50.363 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:50.363 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.363 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.363 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18755 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 4751360~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:41:50.363 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.862061+0000", 2024-09-13T06:41:50.363 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 118.454674596, 2024-09-13T06:41:50.363 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101907023, 2024-09-13T06:41:50.363 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:50.363 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:50.363 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:50.363 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:50.363 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:50.363 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18755 2024-09-13T06:41:50.364 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.364 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:50.364 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.364 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:50.364 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862061+0000", 2024-09-13T06:41:50.364 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:50.364 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.364 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.364 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:50.364 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862061+0000", 2024-09-13T06:41:50.364 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:50.364 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.365 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.365 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:50.365 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862060+0000", 2024-09-13T06:41:50.365 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:50.365 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.365 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.365 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:50.365 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862064+0000", 2024-09-13T06:41:50.365 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.3229999999999999e-06 2024-09-13T06:41:50.365 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.365 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.365 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:50.365 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862078+0000", 2024-09-13T06:41:50.366 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.433e-05 2024-09-13T06:41:50.366 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.366 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.366 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:50.366 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862086+0000", 2024-09-13T06:41:50.366 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.3869999999999997e-06 2024-09-13T06:41:50.366 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.366 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.366 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:50.366 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.963635+0000", 2024-09-13T06:41:50.366 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101549606 2024-09-13T06:41:50.366 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.366 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.367 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:50.367 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.963783+0000", 2024-09-13T06:41:50.367 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000147312 2024-09-13T06:41:50.367 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.367 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.367 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:50.367 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.963968+0000", 2024-09-13T06:41:50.367 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000185028 2024-09-13T06:41:50.367 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:50.367 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:50.367 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:50.367 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.367 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.368 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18756 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 4780032~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:41:50.368 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.862132+0000", 2024-09-13T06:41:50.368 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 118.454602753, 2024-09-13T06:41:50.368 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.102159295, 2024-09-13T06:41:50.368 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:50.368 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:50.368 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:50.368 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:50.368 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:50.368 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18756 2024-09-13T06:41:50.368 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.368 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:50.369 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.369 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:50.369 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862132+0000", 2024-09-13T06:41:50.369 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:50.369 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.369 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.369 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:50.369 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862132+0000", 2024-09-13T06:41:50.369 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:50.369 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.369 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.369 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:50.369 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862132+0000", 2024-09-13T06:41:50.370 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:50.370 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.370 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.370 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:50.370 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862136+0000", 2024-09-13T06:41:50.370 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.9559999999999999e-06 2024-09-13T06:41:50.370 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.370 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.370 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:50.370 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862145+0000", 2024-09-13T06:41:50.370 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6169999999999996e-06 2024-09-13T06:41:50.370 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.370 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.371 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:50.371 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862153+0000", 2024-09-13T06:41:50.371 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.8359999999999992e-06 2024-09-13T06:41:50.371 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.371 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.371 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:50.371 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.964018+0000", 2024-09-13T06:41:50.371 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101865421 2024-09-13T06:41:50.371 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.371 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.371 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:50.371 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.964140+0000", 2024-09-13T06:41:50.372 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000121172 2024-09-13T06:41:50.372 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.372 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.372 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:50.372 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.964292+0000", 2024-09-13T06:41:50.372 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00015202600000000001 2024-09-13T06:41:50.372 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:50.372 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:50.372 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:50.372 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.372 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.372 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18768 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 5124096~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:41:50.373 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.866345+0000", 2024-09-13T06:41:50.373 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 118.450390446, 2024-09-13T06:41:50.373 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101779361, 2024-09-13T06:41:50.373 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:50.373 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:50.373 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:50.373 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:50.373 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:50.373 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18768 2024-09-13T06:41:50.373 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.373 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:50.373 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.374 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:50.374 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.866345+0000", 2024-09-13T06:41:50.374 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:50.374 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.374 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.374 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:50.374 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.866345+0000", 2024-09-13T06:41:50.374 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:50.374 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.374 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.374 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:50.374 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.866344+0000", 2024-09-13T06:41:50.375 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:50.375 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.375 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.375 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:50.375 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.866348+0000", 2024-09-13T06:41:50.375 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.4300000000000002e-06 2024-09-13T06:41:50.375 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.375 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.375 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:50.375 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.866356+0000", 2024-09-13T06:41:50.375 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.5930000000000006e-06 2024-09-13T06:41:50.375 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.375 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.376 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:50.376 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.866364+0000", 2024-09-13T06:41:50.376 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5599999999999996e-06 2024-09-13T06:41:50.376 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.376 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.376 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:50.376 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.967865+0000", 2024-09-13T06:41:50.376 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101501683 2024-09-13T06:41:50.376 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.376 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.376 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:50.376 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.967981+0000", 2024-09-13T06:41:50.376 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000115643 2024-09-13T06:41:50.377 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.377 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.377 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:50.377 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.968124+0000", 2024-09-13T06:41:50.377 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00014305500000000001 2024-09-13T06:41:50.377 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:50.377 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:50.377 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:50.377 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.377 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.377 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18779 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 5439488~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:41:50.377 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.869996+0000", 2024-09-13T06:41:50.377 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 118.446739561, 2024-09-13T06:41:50.378 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10189577399999999, 2024-09-13T06:41:50.378 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:50.378 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:50.378 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:50.378 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:50.378 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:50.378 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18779 2024-09-13T06:41:50.378 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.378 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:50.378 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.378 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:50.378 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.869996+0000", 2024-09-13T06:41:50.378 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:50.379 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.379 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.379 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:50.379 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.869996+0000", 2024-09-13T06:41:50.379 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:50.379 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.379 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.379 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:50.379 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.869995+0000", 2024-09-13T06:41:50.379 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:50.379 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.379 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.379 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:50.380 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.869998+0000", 2024-09-13T06:41:50.380 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.2729999999999998e-06 2024-09-13T06:41:50.380 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.380 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.380 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:50.380 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.870007+0000", 2024-09-13T06:41:50.380 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.5760000000000006e-06 2024-09-13T06:41:50.380 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.380 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.380 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:50.380 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.870014+0000", 2024-09-13T06:41:50.380 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.1400000000000002e-06 2024-09-13T06:41:50.380 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.380 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.381 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:50.381 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.971631+0000", 2024-09-13T06:41:50.381 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101617503 2024-09-13T06:41:50.381 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.381 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.381 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:50.381 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.971747+0000", 2024-09-13T06:41:50.381 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00011599600000000001 2024-09-13T06:41:50.381 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.381 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.381 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:50.381 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.971891+0000", 2024-09-13T06:41:50.381 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000143912 2024-09-13T06:41:50.382 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:50.382 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:50.382 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:50.382 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.382 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.382 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18792 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 5812224~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:41:50.382 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.874371+0000", 2024-09-13T06:41:50.382 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 118.442364431, 2024-09-13T06:41:50.382 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101736005, 2024-09-13T06:41:50.382 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:50.382 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:50.382 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:50.382 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:50.383 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:50.383 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18792 2024-09-13T06:41:50.383 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.383 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:50.383 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.383 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:50.383 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874371+0000", 2024-09-13T06:41:50.383 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:50.383 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.383 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.383 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:50.383 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874371+0000", 2024-09-13T06:41:50.384 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:50.384 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.384 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.384 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:50.384 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874370+0000", 2024-09-13T06:41:50.384 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:50.384 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.384 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.384 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:50.384 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874374+0000", 2024-09-13T06:41:50.384 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.7239999999999998e-06 2024-09-13T06:41:50.384 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.385 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.385 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:50.385 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874385+0000", 2024-09-13T06:41:50.385 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1293e-05 2024-09-13T06:41:50.385 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.385 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.385 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:50.385 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874394+0000", 2024-09-13T06:41:50.385 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.0729999999999994e-06 2024-09-13T06:41:50.385 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.385 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.385 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:50.385 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.975850+0000", 2024-09-13T06:41:50.385 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10145599700000001 2024-09-13T06:41:50.386 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.386 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.386 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:50.386 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.975963+0000", 2024-09-13T06:41:50.386 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000112689 2024-09-13T06:41:50.386 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.386 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.386 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:50.386 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.976107+0000", 2024-09-13T06:41:50.386 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000143836 2024-09-13T06:41:50.386 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:50.386 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:50.386 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:50.386 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.387 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.387 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18793 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 5840896~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:41:50.387 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.874401+0000", 2024-09-13T06:41:50.387 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 118.442334398, 2024-09-13T06:41:50.387 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.102005516, 2024-09-13T06:41:50.387 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:50.387 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:50.387 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:50.387 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:50.388 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:50.388 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18793 2024-09-13T06:41:50.388 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.388 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:50.388 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.388 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:50.388 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874401+0000", 2024-09-13T06:41:50.388 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:50.388 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.388 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.388 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:50.388 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874401+0000", 2024-09-13T06:41:50.388 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:50.389 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.389 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.389 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:50.389 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874400+0000", 2024-09-13T06:41:50.389 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:50.389 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.389 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.389 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:50.389 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874404+0000", 2024-09-13T06:41:50.389 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0069999999999999e-06 2024-09-13T06:41:50.389 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.389 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.389 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:50.389 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874412+0000", 2024-09-13T06:41:50.390 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.5399999999999996e-06 2024-09-13T06:41:50.390 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.390 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.390 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:50.390 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874420+0000", 2024-09-13T06:41:50.390 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.6199999999999999e-06 2024-09-13T06:41:50.390 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.390 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.390 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:50.390 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.976150+0000", 2024-09-13T06:41:50.390 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101729874 2024-09-13T06:41:50.390 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.390 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.390 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:50.391 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.976261+0000", 2024-09-13T06:41:50.391 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000110819 2024-09-13T06:41:50.391 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.391 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.391 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:50.391 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.976406+0000", 2024-09-13T06:41:50.391 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000145489 2024-09-13T06:41:50.391 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:50.391 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:50.391 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:50.391 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.391 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.391 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18803 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 6127616~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:41:50.391 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.877851+0000", 2024-09-13T06:41:50.392 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 118.438883905, 2024-09-13T06:41:50.392 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101951584, 2024-09-13T06:41:50.392 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:50.392 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:50.392 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:50.392 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:50.392 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:50.392 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18803 2024-09-13T06:41:50.392 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.392 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:50.392 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.392 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:50.392 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.877851+0000", 2024-09-13T06:41:50.393 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:50.393 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.393 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.393 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:50.393 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.877851+0000", 2024-09-13T06:41:50.393 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:50.393 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.393 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.393 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:50.393 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.877851+0000", 2024-09-13T06:41:50.393 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:50.393 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.393 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.393 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:50.393 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.877854+0000", 2024-09-13T06:41:50.394 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.7929999999999999e-06 2024-09-13T06:41:50.394 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.394 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.394 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:50.394 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.877864+0000", 2024-09-13T06:41:50.394 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.2029999999999998e-06 2024-09-13T06:41:50.394 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.394 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.394 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:50.394 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.877873+0000", 2024-09-13T06:41:50.394 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.0440000000000001e-06 2024-09-13T06:41:50.394 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.394 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.394 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:50.395 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.979544+0000", 2024-09-13T06:41:50.395 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101671198 2024-09-13T06:41:50.395 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.395 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.395 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:50.395 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.979658+0000", 2024-09-13T06:41:50.395 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000114456 2024-09-13T06:41:50.395 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.395 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.395 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:50.395 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.979803+0000", 2024-09-13T06:41:50.395 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000144506 2024-09-13T06:41:50.395 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:50.395 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:50.396 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:50.396 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.396 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.396 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18807 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 6242304~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:41:50.396 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.879235+0000", 2024-09-13T06:41:50.396 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 118.437499875, 2024-09-13T06:41:50.396 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101781258, 2024-09-13T06:41:50.396 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:50.396 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:50.396 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:50.396 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:50.396 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:50.396 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18807 2024-09-13T06:41:50.396 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.397 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:50.397 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.397 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:50.397 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879235+0000", 2024-09-13T06:41:50.397 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:50.397 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.397 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.397 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:50.397 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879235+0000", 2024-09-13T06:41:50.397 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:50.397 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.397 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.397 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:50.397 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879235+0000", 2024-09-13T06:41:50.398 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:50.398 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.398 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.398 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:50.398 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879239+0000", 2024-09-13T06:41:50.398 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.963e-06 2024-09-13T06:41:50.398 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.398 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.398 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:50.398 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879247+0000", 2024-09-13T06:41:50.398 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6470000000000004e-06 2024-09-13T06:41:50.398 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.398 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.398 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:50.398 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879255+0000", 2024-09-13T06:41:50.399 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5429999999999996e-06 2024-09-13T06:41:50.399 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.399 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.399 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:50.399 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.980756+0000", 2024-09-13T06:41:50.399 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10150165999999999 2024-09-13T06:41:50.399 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.399 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.399 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:50.399 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.980868+0000", 2024-09-13T06:41:50.399 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000111196 2024-09-13T06:41:50.399 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.399 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.400 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:50.400 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.981017+0000", 2024-09-13T06:41:50.400 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000148846 2024-09-13T06:41:50.400 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:50.400 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:50.400 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:50.400 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.400 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.400 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18808 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 6270976~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:41:50.400 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.879261+0000", 2024-09-13T06:41:50.400 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 118.437473736, 2024-09-13T06:41:50.400 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.102057547, 2024-09-13T06:41:50.400 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:50.401 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:50.401 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:50.401 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:50.401 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:50.401 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18808 2024-09-13T06:41:50.401 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.401 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:50.401 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.401 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:50.401 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879261+0000", 2024-09-13T06:41:50.401 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:50.401 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.401 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.401 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:50.402 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879261+0000", 2024-09-13T06:41:50.402 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:50.402 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.402 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.402 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:50.402 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879261+0000", 2024-09-13T06:41:50.402 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:50.402 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.402 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.402 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:50.402 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879264+0000", 2024-09-13T06:41:50.402 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.523e-06 2024-09-13T06:41:50.402 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.402 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.402 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:50.403 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879273+0000", 2024-09-13T06:41:50.403 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6070000000000008e-06 2024-09-13T06:41:50.403 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.403 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.403 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:50.403 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879280+0000", 2024-09-13T06:41:50.403 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.4699999999999996e-06 2024-09-13T06:41:50.403 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.403 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.403 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:50.403 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.981060+0000", 2024-09-13T06:41:50.403 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10177934800000001 2024-09-13T06:41:50.403 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.404 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.404 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:50.404 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.981174+0000", 2024-09-13T06:41:50.404 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000114456 2024-09-13T06:41:50.404 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.404 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.404 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:50.404 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.981319+0000", 2024-09-13T06:41:50.404 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00014473900000000001 2024-09-13T06:41:50.404 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:50.404 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:50.404 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:50.404 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.404 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.405 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18810 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 2662400~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:41:50.405 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.880386+0000", 2024-09-13T06:41:50.405 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 118.436349574, 2024-09-13T06:41:50.405 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101728022, 2024-09-13T06:41:50.405 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:50.405 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:50.405 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:50.405 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:50.405 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:50.405 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18810 2024-09-13T06:41:50.405 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.405 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:50.405 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.405 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:50.406 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880386+0000", 2024-09-13T06:41:50.406 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:50.406 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.406 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.406 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:50.406 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880386+0000", 2024-09-13T06:41:50.406 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:50.406 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.406 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.406 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:50.406 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880385+0000", 2024-09-13T06:41:50.406 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:50.407 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.407 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.407 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:50.407 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880389+0000", 2024-09-13T06:41:50.407 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.8539999999999999e-06 2024-09-13T06:41:50.407 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.407 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.407 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:50.407 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880398+0000", 2024-09-13T06:41:50.407 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.1689999999999998e-06 2024-09-13T06:41:50.407 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.407 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.407 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:50.408 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880405+0000", 2024-09-13T06:41:50.408 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5700000000000004e-06 2024-09-13T06:41:50.408 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.408 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.408 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:50.408 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.981833+0000", 2024-09-13T06:41:50.408 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10142791800000001 2024-09-13T06:41:50.408 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.408 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.408 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:50.408 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.981973+0000", 2024-09-13T06:41:50.408 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00014002900000000001 2024-09-13T06:41:50.408 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.409 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.409 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:50.409 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.982114+0000", 2024-09-13T06:41:50.409 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000140276 2024-09-13T06:41:50.409 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:50.409 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:50.409 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:50.409 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.409 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.409 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18811 3.9 3.140f5209 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:41:50.409 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.880449+0000", 2024-09-13T06:41:50.409 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 118.436286198, 2024-09-13T06:41:50.409 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101739355, 2024-09-13T06:41:50.410 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:50.410 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:41:50.410 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:50.410 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:50.410 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:50.410 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18811 2024-09-13T06:41:50.410 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.410 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:50.410 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.410 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:50.410 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880449+0000", 2024-09-13T06:41:50.410 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:50.410 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.410 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.411 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:50.411 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880449+0000", 2024-09-13T06:41:50.411 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:50.411 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.411 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.411 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:50.411 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880448+0000", 2024-09-13T06:41:50.411 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:50.411 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.411 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.411 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:50.411 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880452+0000", 2024-09-13T06:41:50.411 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0470000000000004e-06 2024-09-13T06:41:50.411 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.411 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.411 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:50.412 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880462+0000", 2024-09-13T06:41:50.412 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6530000000000006e-06 2024-09-13T06:41:50.412 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.412 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.412 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:50.412 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880472+0000", 2024-09-13T06:41:50.412 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0027000000000001e-05 2024-09-13T06:41:50.412 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.412 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.412 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:50.412 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.982172+0000", 2024-09-13T06:41:50.412 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10170043500000001 2024-09-13T06:41:50.412 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.412 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.412 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:50.413 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.982188+0000", 2024-09-13T06:41:50.413 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6172999999999999e-05 2024-09-13T06:41:50.413 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:50.413 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:50.413 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:50.413 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.413 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.413 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18812 3.9 3.140f5209 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:41:50.413 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.880478+0000", 2024-09-13T06:41:50.413 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 118.436256961, 2024-09-13T06:41:50.413 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10177795100000001, 2024-09-13T06:41:50.413 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:50.414 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:41:50.414 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:50.414 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:50.414 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:50.414 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18812 2024-09-13T06:41:50.414 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.414 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:50.414 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.414 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:50.414 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880478+0000", 2024-09-13T06:41:50.414 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:50.414 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.414 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.414 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:50.415 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880478+0000", 2024-09-13T06:41:50.415 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:50.415 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.415 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.415 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:50.415 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880477+0000", 2024-09-13T06:41:50.415 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:50.415 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.415 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.415 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:50.415 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880481+0000", 2024-09-13T06:41:50.415 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.827e-06 2024-09-13T06:41:50.416 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.416 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.416 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:50.416 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880490+0000", 2024-09-13T06:41:50.416 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6100000000000006e-06 2024-09-13T06:41:50.416 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.416 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.416 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:50.416 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880497+0000", 2024-09-13T06:41:50.416 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.7030000000000006e-06 2024-09-13T06:41:50.416 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.416 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.416 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:50.416 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.982241+0000", 2024-09-13T06:41:50.416 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10174351199999999 2024-09-13T06:41:50.417 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.417 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.417 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:50.417 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.982256+0000", 2024-09-13T06:41:50.417 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5143000000000001e-05 2024-09-13T06:41:50.417 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:50.417 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:50.417 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:50.417 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:50.417 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:50.417 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:41:50.419 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-13T06:41:50.419 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:41:50.417+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:41:50.520 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:41:50.521+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:41:50.579 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:41:50.579 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [], 2024-09-13T06:41:50.579 INFO:teuthology.orchestra.run.smithi139.stdout: "num_ops": 0 2024-09-13T06:41:50.579 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:41:50.594 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-13T06:41:50.620 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:41:50.617+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:41:50.625 INFO:teuthology.orchestra.run.smithi081.stderr:noscrub is set 2024-09-13T06:41:50.720 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:41:50.720 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [], 2024-09-13T06:41:50.720 INFO:teuthology.orchestra.run.smithi139.stdout: "complaint_time": 30, 2024-09-13T06:41:50.721 INFO:teuthology.orchestra.run.smithi139.stdout: "num_blocked_ops": 0 2024-09-13T06:41:50.721 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:41:50.721 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:41:50.718+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:41:50.735 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-13T06:41:50.822 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:41:50.818+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:41:50.902 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:41:50.902 INFO:teuthology.orchestra.run.smithi139.stdout: "size": 20, 2024-09-13T06:41:50.902 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 600, 2024-09-13T06:41:50.902 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [ 2024-09-13T06:41:50.902 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.902 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43282 3.1d 3:bd80bfb3:::rbd_object_map.11212f44bfb1.0000000000000020:head [call rbd.object_map_update in=20b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:50.902 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589032+0000", 2024-09-13T06:41:50.903 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 89.310401489, 2024-09-13T06:41:50.903 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.076225263000000001, 2024-09-13T06:41:50.903 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:50.903 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:41:50.903 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:50.903 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:50.903 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:50.903 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43282 2024-09-13T06:41:50.903 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.903 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:50.903 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.903 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:50.903 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589032+0000", 2024-09-13T06:41:50.904 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:50.904 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.904 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.904 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:50.904 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589032+0000", 2024-09-13T06:41:50.904 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:50.904 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.904 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.904 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:50.904 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589031+0000", 2024-09-13T06:41:50.904 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:50.904 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.904 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.905 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:50.905 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589036+0000", 2024-09-13T06:41:50.905 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.2619999999999998e-06 2024-09-13T06:41:50.905 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.905 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.905 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:50.905 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589046+0000", 2024-09-13T06:41:50.905 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.8099999999999992e-06 2024-09-13T06:41:50.905 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.905 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.905 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:50.905 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589054+0000", 2024-09-13T06:41:50.906 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.2230000000000007e-06 2024-09-13T06:41:50.906 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.906 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.906 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:50.906 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.660691+0000", 2024-09-13T06:41:50.906 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.07163659 2024-09-13T06:41:50.906 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.906 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.906 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:50.906 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.660850+0000", 2024-09-13T06:41:50.906 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00015864300000000001 2024-09-13T06:41:50.906 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.906 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.907 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 4", 2024-09-13T06:41:50.907 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.661729+0000", 2024-09-13T06:41:50.907 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00087956099999999995 2024-09-13T06:41:50.907 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.907 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.907 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:41:50.907 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.664409+0000", 2024-09-13T06:41:50.907 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0026803479999999999 2024-09-13T06:41:50.907 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.907 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.907 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-13T06:41:50.907 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.665088+0000", 2024-09-13T06:41:50.907 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00067901400000000003 2024-09-13T06:41:50.908 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.908 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.908 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-13T06:41:50.908 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.665181+0000", 2024-09-13T06:41:50.908 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.2050000000000001e-05 2024-09-13T06:41:50.908 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.908 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.908 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:50.908 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.665257+0000", 2024-09-13T06:41:50.908 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.6698000000000003e-05 2024-09-13T06:41:50.908 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:50.908 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:50.909 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:50.909 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.909 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.909 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43290 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 299008~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:50.909 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589500+0000", 2024-09-13T06:41:50.909 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 89.309933326999996, 2024-09-13T06:41:50.909 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.075898564000000002, 2024-09-13T06:41:50.909 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:50.909 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:50.909 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:50.909 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:50.909 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:50.909 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43290 2024-09-13T06:41:50.909 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.910 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:50.910 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.910 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:50.910 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589500+0000", 2024-09-13T06:41:50.910 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:50.910 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.910 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.910 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:50.910 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589500+0000", 2024-09-13T06:41:50.910 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:50.910 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.910 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.910 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:50.911 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589499+0000", 2024-09-13T06:41:50.911 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:50.911 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.911 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.911 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:50.911 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589503+0000", 2024-09-13T06:41:50.911 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.8330000000000004e-06 2024-09-13T06:41:50.911 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.911 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.911 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:50.911 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589511+0000", 2024-09-13T06:41:50.911 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.3359999999999995e-06 2024-09-13T06:41:50.911 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.911 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.912 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:50.912 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589519+0000", 2024-09-13T06:41:50.912 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.4760000000000001e-06 2024-09-13T06:41:50.912 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.912 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.912 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:50.912 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.665097+0000", 2024-09-13T06:41:50.912 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.075577828999999999 2024-09-13T06:41:50.912 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.912 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.912 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:50.912 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.665170+0000", 2024-09-13T06:41:50.912 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.3745000000000006e-05 2024-09-13T06:41:50.913 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.913 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.913 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:50.913 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.665399+0000", 2024-09-13T06:41:50.913 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00022826199999999999 2024-09-13T06:41:50.913 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:50.913 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:50.913 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:50.913 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.913 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.913 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43291 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 313344~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:50.913 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589560+0000", 2024-09-13T06:41:50.913 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 89.309873105999998, 2024-09-13T06:41:50.914 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.076145594999999996, 2024-09-13T06:41:50.914 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:50.914 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:50.914 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:50.914 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:50.914 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:50.914 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43291 2024-09-13T06:41:50.914 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.914 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:50.914 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.914 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:50.914 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589560+0000", 2024-09-13T06:41:50.914 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:50.915 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.915 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.915 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:50.915 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589560+0000", 2024-09-13T06:41:50.915 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:50.915 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.915 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.915 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:50.915 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589559+0000", 2024-09-13T06:41:50.915 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:50.915 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.915 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.915 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:50.916 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589564+0000", 2024-09-13T06:41:50.916 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.3989999999999997e-06 2024-09-13T06:41:50.916 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.916 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.916 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:50.916 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589574+0000", 2024-09-13T06:41:50.916 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0502999999999999e-05 2024-09-13T06:41:50.916 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.916 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.916 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:50.916 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589582+0000", 2024-09-13T06:41:50.916 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.1859999999999992e-06 2024-09-13T06:41:50.916 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.917 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.917 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:50.917 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.665423+0000", 2024-09-13T06:41:50.917 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.075840290000000005 2024-09-13T06:41:50.917 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.917 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.917 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:50.917 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.665496+0000", 2024-09-13T06:41:50.917 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.2791000000000002e-05 2024-09-13T06:41:50.917 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.917 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.917 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:50.918 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.665706+0000", 2024-09-13T06:41:50.918 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00021038200000000001 2024-09-13T06:41:50.918 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:50.918 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:50.918 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:50.918 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.918 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.918 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43292 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 327680~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:50.918 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589589+0000", 2024-09-13T06:41:50.918 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 89.309844565000006, 2024-09-13T06:41:50.918 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.076769537999999998, 2024-09-13T06:41:50.918 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:50.918 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:50.918 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:50.919 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:50.919 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:50.919 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43292 2024-09-13T06:41:50.919 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.919 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:50.919 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.919 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:50.919 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589589+0000", 2024-09-13T06:41:50.919 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:50.919 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.919 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.919 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:50.919 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589589+0000", 2024-09-13T06:41:50.920 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:50.920 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.920 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.920 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:50.920 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589588+0000", 2024-09-13T06:41:50.920 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:50.920 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.920 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.920 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:50.920 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589592+0000", 2024-09-13T06:41:50.920 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.6389999999999998e-06 2024-09-13T06:41:50.920 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.920 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.920 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:50.921 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589600+0000", 2024-09-13T06:41:50.921 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.4630000000000001e-06 2024-09-13T06:41:50.921 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.921 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.921 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:50.921 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589608+0000", 2024-09-13T06:41:50.921 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.2359999999999998e-06 2024-09-13T06:41:50.921 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.921 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.921 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:50.921 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.665779+0000", 2024-09-13T06:41:50.921 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.076170924000000001 2024-09-13T06:41:50.921 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.922 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.922 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:50.922 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.665977+0000", 2024-09-13T06:41:50.922 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00019891900000000001 2024-09-13T06:41:50.922 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.922 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.922 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:50.922 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.666358+0000", 2024-09-13T06:41:50.922 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000380963 2024-09-13T06:41:50.922 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:50.922 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:50.922 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:50.922 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.923 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.923 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43293 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 342016~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:50.923 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589616+0000", 2024-09-13T06:41:50.923 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 89.309817671000005, 2024-09-13T06:41:50.923 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.077030083999999999, 2024-09-13T06:41:50.923 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:50.923 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:50.923 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:50.923 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:50.923 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:50.923 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43293 2024-09-13T06:41:50.923 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.923 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:50.924 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.924 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:50.924 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589616+0000", 2024-09-13T06:41:50.924 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:50.924 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.924 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.924 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:50.924 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589616+0000", 2024-09-13T06:41:50.924 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:50.924 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.924 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.924 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:50.924 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589615+0000", 2024-09-13T06:41:50.924 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:50.925 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.925 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.925 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:50.925 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589619+0000", 2024-09-13T06:41:50.925 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.9559999999999999e-06 2024-09-13T06:41:50.925 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.925 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.925 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:50.925 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589627+0000", 2024-09-13T06:41:50.925 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.2490000000000001e-06 2024-09-13T06:41:50.925 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.925 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.925 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:50.926 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589635+0000", 2024-09-13T06:41:50.926 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.96e-06 2024-09-13T06:41:50.926 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.926 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.926 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:50.926 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.666379+0000", 2024-09-13T06:41:50.926 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.076744484000000002 2024-09-13T06:41:50.926 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.926 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.926 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:50.926 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.666454+0000", 2024-09-13T06:41:50.926 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.4623999999999996e-05 2024-09-13T06:41:50.926 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.927 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.927 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:50.927 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.666646+0000", 2024-09-13T06:41:50.927 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00019176999999999999 2024-09-13T06:41:50.927 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:50.927 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:50.927 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:50.927 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.927 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.927 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43294 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 356352~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:50.927 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589681+0000", 2024-09-13T06:41:50.927 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 89.309752356000004, 2024-09-13T06:41:50.927 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.077594648000000002, 2024-09-13T06:41:50.927 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:50.928 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:50.928 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:50.928 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:50.928 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:50.928 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43294 2024-09-13T06:41:50.928 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.928 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:50.928 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.928 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:50.928 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589681+0000", 2024-09-13T06:41:50.928 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:50.928 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.928 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.929 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:50.929 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589681+0000", 2024-09-13T06:41:50.929 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:50.929 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.929 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.929 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:50.929 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589680+0000", 2024-09-13T06:41:50.929 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:50.929 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.929 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.929 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:50.929 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589684+0000", 2024-09-13T06:41:50.929 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.8369999999999999e-06 2024-09-13T06:41:50.929 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.930 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.930 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:50.930 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589693+0000", 2024-09-13T06:41:50.930 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.1020000000000003e-06 2024-09-13T06:41:50.930 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.930 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.930 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:50.930 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589701+0000", 2024-09-13T06:41:50.930 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.8059999999999995e-06 2024-09-13T06:41:50.930 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.930 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.930 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:50.930 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.666714+0000", 2024-09-13T06:41:50.931 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.077013463000000004 2024-09-13T06:41:50.931 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.931 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.931 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:50.931 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.666897+0000", 2024-09-13T06:41:50.931 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000182268 2024-09-13T06:41:50.931 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.931 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.931 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:50.931 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.667276+0000", 2024-09-13T06:41:50.932 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00037907499999999998 2024-09-13T06:41:50.932 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:50.932 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:50.932 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:50.932 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.932 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.932 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43295 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 370688~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:50.932 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589744+0000", 2024-09-13T06:41:50.932 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 89.309689184000007, 2024-09-13T06:41:50.932 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.077854343000000006, 2024-09-13T06:41:50.932 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:50.932 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:50.933 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:50.933 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:50.933 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:50.933 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43295 2024-09-13T06:41:50.933 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.933 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:50.933 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.933 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:50.933 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589744+0000", 2024-09-13T06:41:50.933 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:50.933 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.933 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.933 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:50.934 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589744+0000", 2024-09-13T06:41:50.934 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:50.934 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.934 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.934 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:50.934 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589743+0000", 2024-09-13T06:41:50.934 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:50.934 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.934 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.934 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:50.935 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589747+0000", 2024-09-13T06:41:50.935 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0130000000000004e-06 2024-09-13T06:41:50.935 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.935 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.935 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:50.935 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589756+0000", 2024-09-13T06:41:50.935 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.003e-06 2024-09-13T06:41:50.935 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.935 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.936 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:50.936 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589766+0000", 2024-09-13T06:41:50.936 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.2820000000000002e-06 2024-09-13T06:41:50.936 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.936 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.936 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:50.936 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.667300+0000", 2024-09-13T06:41:50.936 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.077534299000000001 2024-09-13T06:41:50.936 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.936 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.936 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:50.936 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.667372+0000", 2024-09-13T06:41:50.936 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.2393999999999998e-05 2024-09-13T06:41:50.937 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.937 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.937 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:50.937 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.667599+0000", 2024-09-13T06:41:50.937 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000226269 2024-09-13T06:41:50.937 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:50.937 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:50.937 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:50.937 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.937 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.937 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43296 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 385024~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:50.937 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589772+0000", 2024-09-13T06:41:50.937 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 89.309661160000005, 2024-09-13T06:41:50.938 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.078469647000000003, 2024-09-13T06:41:50.938 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:50.938 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:50.938 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:50.938 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:50.938 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:50.938 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43296 2024-09-13T06:41:50.938 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.938 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:50.938 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.938 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:50.938 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589772+0000", 2024-09-13T06:41:50.938 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:50.938 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.939 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.939 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:50.939 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589772+0000", 2024-09-13T06:41:50.939 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:50.939 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.939 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.939 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:50.939 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589771+0000", 2024-09-13T06:41:50.939 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:50.939 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.939 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.939 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:50.939 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589775+0000", 2024-09-13T06:41:50.939 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.8530000000000002e-06 2024-09-13T06:41:50.940 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.940 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.940 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:50.940 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589784+0000", 2024-09-13T06:41:50.940 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.4300000000000006e-06 2024-09-13T06:41:50.940 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.940 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.940 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:50.940 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589791+0000", 2024-09-13T06:41:50.940 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.4660000000000002e-06 2024-09-13T06:41:50.940 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.940 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.940 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:50.941 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.667667+0000", 2024-09-13T06:41:50.941 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.077875697999999993 2024-09-13T06:41:50.941 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.941 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.941 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:50.941 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.667854+0000", 2024-09-13T06:41:50.941 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00018760099999999999 2024-09-13T06:41:50.941 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.941 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.941 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:50.941 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.668242+0000", 2024-09-13T06:41:50.941 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00038750600000000003 2024-09-13T06:41:50.941 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:50.942 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:50.942 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:50.942 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.942 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.942 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43297 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 403456~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:50.942 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589797+0000", 2024-09-13T06:41:50.942 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 89.309636456000007, 2024-09-13T06:41:50.942 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.078756672999999999, 2024-09-13T06:41:50.942 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:50.942 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:50.942 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:50.942 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:50.942 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:50.942 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43297 2024-09-13T06:41:50.943 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.943 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:50.943 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.943 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:50.943 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589797+0000", 2024-09-13T06:41:50.943 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:50.943 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.943 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.943 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:50.943 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589797+0000", 2024-09-13T06:41:50.943 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:50.943 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.943 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.944 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:50.944 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589796+0000", 2024-09-13T06:41:50.944 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:50.944 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.944 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.944 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:50.944 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589800+0000", 2024-09-13T06:41:50.944 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.3230000000000002e-06 2024-09-13T06:41:50.944 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.944 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.944 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:50.944 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589808+0000", 2024-09-13T06:41:50.944 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.2390000000000002e-06 2024-09-13T06:41:50.944 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.945 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.945 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:50.945 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589815+0000", 2024-09-13T06:41:50.945 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.413e-06 2024-09-13T06:41:50.945 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.945 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.945 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:50.945 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.668265+0000", 2024-09-13T06:41:50.945 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.078449873000000003 2024-09-13T06:41:50.945 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.945 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.945 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:50.945 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.668332+0000", 2024-09-13T06:41:50.946 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.7178e-05 2024-09-13T06:41:50.946 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.946 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.946 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:50.946 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.668554+0000", 2024-09-13T06:41:50.946 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00022128600000000001 2024-09-13T06:41:50.946 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:50.946 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:50.946 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:50.946 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.947 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.947 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43298 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 417792~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:50.947 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589821+0000", 2024-09-13T06:41:50.947 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 89.309612333999993, 2024-09-13T06:41:50.947 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.079368660999999993, 2024-09-13T06:41:50.947 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:50.947 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:50.947 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:50.947 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:50.947 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:50.947 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43298 2024-09-13T06:41:50.947 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.947 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:50.948 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.948 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:50.948 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589821+0000", 2024-09-13T06:41:50.948 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:50.948 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.948 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.948 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:50.948 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589821+0000", 2024-09-13T06:41:50.948 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:50.948 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.948 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.948 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:50.948 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589821+0000", 2024-09-13T06:41:50.949 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:50.949 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.949 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.949 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:50.949 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589830+0000", 2024-09-13T06:41:50.949 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.4860000000000003e-06 2024-09-13T06:41:50.949 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.949 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.949 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:50.949 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589839+0000", 2024-09-13T06:41:50.949 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.0159999999999997e-06 2024-09-13T06:41:50.950 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.950 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.950 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:50.950 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589847+0000", 2024-09-13T06:41:50.950 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.6059999999999997e-06 2024-09-13T06:41:50.950 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.950 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.950 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:50.950 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.668620+0000", 2024-09-13T06:41:50.950 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.078773485000000004 2024-09-13T06:41:50.950 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.950 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.950 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:50.951 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.668798+0000", 2024-09-13T06:41:50.951 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000178233 2024-09-13T06:41:50.951 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.951 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.951 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:50.951 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.669190+0000", 2024-09-13T06:41:50.951 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00039143499999999998 2024-09-13T06:41:50.951 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:50.951 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:50.951 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:50.951 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.951 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.951 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43299 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 432128~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:50.952 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589881+0000", 2024-09-13T06:41:50.952 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 89.309552486000001, 2024-09-13T06:41:50.952 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.079693849999999997, 2024-09-13T06:41:50.952 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:50.952 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:50.952 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:50.952 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:50.952 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:50.952 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43299 2024-09-13T06:41:50.952 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.952 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:50.952 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.952 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:50.953 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589881+0000", 2024-09-13T06:41:50.953 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:50.953 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.953 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.953 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:50.953 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589881+0000", 2024-09-13T06:41:50.953 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:50.953 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.953 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.953 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:50.953 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589880+0000", 2024-09-13T06:41:50.953 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:50.953 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.954 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.954 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:50.954 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589884+0000", 2024-09-13T06:41:50.954 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.053e-06 2024-09-13T06:41:50.954 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.954 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.954 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:50.954 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589893+0000", 2024-09-13T06:41:50.954 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.2129999999999997e-06 2024-09-13T06:41:50.954 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.954 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.954 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:50.954 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589901+0000", 2024-09-13T06:41:50.954 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.6399999999999997e-06 2024-09-13T06:41:50.955 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.955 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.955 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:50.955 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.669213+0000", 2024-09-13T06:41:50.955 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.079312074999999996 2024-09-13T06:41:50.955 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.955 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.955 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:50.955 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.669281+0000", 2024-09-13T06:41:50.955 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.8322000000000001e-05 2024-09-13T06:41:50.955 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.955 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.955 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:50.955 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.669575+0000", 2024-09-13T06:41:50.956 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00029349699999999999 2024-09-13T06:41:50.956 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:50.956 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:50.956 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:50.956 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.956 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.956 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43300 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 446464~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:50.956 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589909+0000", 2024-09-13T06:41:50.956 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 89.309524590999999, 2024-09-13T06:41:50.956 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.080339496999999996, 2024-09-13T06:41:50.956 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:50.956 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:50.956 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:50.957 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:50.957 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:50.957 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43300 2024-09-13T06:41:50.957 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.957 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:50.957 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.957 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:50.957 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589909+0000", 2024-09-13T06:41:50.957 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:50.957 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.957 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.957 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:50.957 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589909+0000", 2024-09-13T06:41:50.958 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:50.958 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.958 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.958 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:50.958 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589908+0000", 2024-09-13T06:41:50.958 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:50.958 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.958 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.958 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:50.958 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589912+0000", 2024-09-13T06:41:50.958 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.9430000000000002e-06 2024-09-13T06:41:50.958 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.958 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.959 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:50.959 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589920+0000", 2024-09-13T06:41:50.959 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.3860000000000007e-06 2024-09-13T06:41:50.959 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.959 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.959 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:50.959 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589928+0000", 2024-09-13T06:41:50.959 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.3329999999999999e-06 2024-09-13T06:41:50.959 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.959 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.959 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:50.959 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.669651+0000", 2024-09-13T06:41:50.959 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.079723204000000006 2024-09-13T06:41:50.959 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.960 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.960 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:50.960 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.669840+0000", 2024-09-13T06:41:50.960 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000189397 2024-09-13T06:41:50.960 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.960 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.960 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:50.960 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.670248+0000", 2024-09-13T06:41:50.960 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00040811100000000001 2024-09-13T06:41:50.960 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:50.960 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:50.960 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:50.960 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.960 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.961 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43301 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 460800~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:50.961 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589934+0000", 2024-09-13T06:41:50.961 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 89.309499916999997, 2024-09-13T06:41:50.961 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.080747474999999999, 2024-09-13T06:41:50.961 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:50.964 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:50.964 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:50.964 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:50.964 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:50.964 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43301 2024-09-13T06:41:50.965 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.965 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:50.965 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.965 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:50.965 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589934+0000", 2024-09-13T06:41:50.965 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:50.965 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.965 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.965 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:50.965 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589934+0000", 2024-09-13T06:41:50.965 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:50.965 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.965 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.966 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:50.966 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589933+0000", 2024-09-13T06:41:50.966 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:50.966 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.966 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.966 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:50.966 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589936+0000", 2024-09-13T06:41:50.966 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.4599999999999999e-06 2024-09-13T06:41:50.966 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.966 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.966 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:50.966 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589945+0000", 2024-09-13T06:41:50.966 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.2430000000000005e-06 2024-09-13T06:41:50.967 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.967 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.967 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:50.967 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589952+0000", 2024-09-13T06:41:50.967 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.3289999999999996e-06 2024-09-13T06:41:50.967 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.967 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.967 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:50.967 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.670280+0000", 2024-09-13T06:41:50.967 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.080328514000000004 2024-09-13T06:41:50.968 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.968 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.968 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:50.968 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.670376+0000", 2024-09-13T06:41:50.968 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.5752000000000001e-05 2024-09-13T06:41:50.968 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.968 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.968 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:50.968 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.670681+0000", 2024-09-13T06:41:50.968 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00030479699999999999 2024-09-13T06:41:50.968 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:50.968 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:50.969 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:50.969 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.969 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.969 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43302 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 475136~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:50.969 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589958+0000", 2024-09-13T06:41:50.969 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 89.309475855000002, 2024-09-13T06:41:50.969 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.081402394000000003, 2024-09-13T06:41:50.969 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:50.969 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:50.969 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:50.969 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:50.970 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:50.970 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43302 2024-09-13T06:41:50.970 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.970 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:50.970 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.970 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:50.970 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589958+0000", 2024-09-13T06:41:50.970 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:50.970 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.970 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.970 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:50.970 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589958+0000", 2024-09-13T06:41:50.970 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:50.971 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.971 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.971 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:50.971 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589957+0000", 2024-09-13T06:41:50.971 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:50.971 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.971 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.971 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:50.971 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589960+0000", 2024-09-13T06:41:50.972 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.4939999999999999e-06 2024-09-13T06:41:50.972 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.972 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.972 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:50.972 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589969+0000", 2024-09-13T06:41:50.972 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.3520000000000007e-06 2024-09-13T06:41:50.972 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.972 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.972 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:50.972 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589976+0000", 2024-09-13T06:41:50.972 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.3030000000000002e-06 2024-09-13T06:41:50.972 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.972 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.973 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:50.973 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.670765+0000", 2024-09-13T06:41:50.973 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.080789154000000002 2024-09-13T06:41:50.973 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.973 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.973 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:50.973 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.670960+0000", 2024-09-13T06:41:50.973 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00019464300000000001 2024-09-13T06:41:50.973 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.974 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.974 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:50.974 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.671360+0000", 2024-09-13T06:41:50.974 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00040005200000000002 2024-09-13T06:41:50.974 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:50.974 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:50.974 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:50.974 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.974 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.974 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43303 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 489472~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:50.974 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589985+0000", 2024-09-13T06:41:50.974 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 89.309448907000004, 2024-09-13T06:41:50.974 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.082024333000000005, 2024-09-13T06:41:50.975 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:50.975 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:50.975 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:50.975 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:50.975 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:50.975 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43303 2024-09-13T06:41:50.975 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.975 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:50.975 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.975 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:50.975 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589985+0000", 2024-09-13T06:41:50.975 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:50.975 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.976 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.976 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:50.976 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589985+0000", 2024-09-13T06:41:50.976 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:50.976 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.976 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.976 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:50.976 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589984+0000", 2024-09-13T06:41:50.976 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:50.976 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.977 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.977 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:50.977 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589987+0000", 2024-09-13T06:41:50.977 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.726e-06 2024-09-13T06:41:50.977 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.977 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.977 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:50.977 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589996+0000", 2024-09-13T06:41:50.977 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.5459999999999992e-06 2024-09-13T06:41:50.977 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.977 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.977 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:50.977 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590003+0000", 2024-09-13T06:41:50.977 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.4229999999999999e-06 2024-09-13T06:41:50.978 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.978 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.978 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:50.978 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.671426+0000", 2024-09-13T06:41:50.978 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.081422704999999998 2024-09-13T06:41:50.978 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.978 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.978 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:50.978 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.671615+0000", 2024-09-13T06:41:50.978 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000188875 2024-09-13T06:41:50.978 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.978 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.978 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:50.978 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.672009+0000", 2024-09-13T06:41:50.979 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000394015 2024-09-13T06:41:50.979 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:50.979 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:50.979 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:50.979 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.979 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.979 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43304 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 503808~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:50.979 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.590039+0000", 2024-09-13T06:41:50.979 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 89.309394362000006, 2024-09-13T06:41:50.979 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.082573880000000002, 2024-09-13T06:41:50.979 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:50.979 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:50.979 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:50.980 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:50.980 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:50.980 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43304 2024-09-13T06:41:50.980 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.980 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:50.980 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.980 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:50.980 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590039+0000", 2024-09-13T06:41:50.980 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:50.980 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.980 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.980 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:50.981 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590039+0000", 2024-09-13T06:41:50.981 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:50.981 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.981 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.981 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:50.981 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590038+0000", 2024-09-13T06:41:50.981 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:50.981 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.981 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.981 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:50.981 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590042+0000", 2024-09-13T06:41:50.981 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.9500000000000003e-06 2024-09-13T06:41:50.981 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.982 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.982 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:50.982 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590052+0000", 2024-09-13T06:41:50.982 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.3919999999999992e-06 2024-09-13T06:41:50.982 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.982 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.982 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:50.982 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590059+0000", 2024-09-13T06:41:50.982 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.7970000000000001e-06 2024-09-13T06:41:50.982 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.983 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.983 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:50.983 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.672078+0000", 2024-09-13T06:41:50.983 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.082018778000000001 2024-09-13T06:41:50.983 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.983 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.983 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:50.983 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.672266+0000", 2024-09-13T06:41:50.983 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00018807399999999999 2024-09-13T06:41:50.983 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.983 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.983 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:50.983 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.672613+0000", 2024-09-13T06:41:50.984 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00034677599999999997 2024-09-13T06:41:50.984 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:50.984 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:50.984 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:50.984 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.984 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.984 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43305 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 518144~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:50.984 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.590136+0000", 2024-09-13T06:41:50.984 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 89.309297173999994, 2024-09-13T06:41:50.984 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.082988206999999994, 2024-09-13T06:41:50.984 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:50.984 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:50.984 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:50.985 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:50.985 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:50.985 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43305 2024-09-13T06:41:50.985 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.985 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:50.985 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.985 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:50.985 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590136+0000", 2024-09-13T06:41:50.985 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:50.985 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.985 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.985 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:50.985 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590136+0000", 2024-09-13T06:41:50.986 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:50.986 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.986 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.986 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:50.986 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590135+0000", 2024-09-13T06:41:50.986 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:50.986 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.986 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.986 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:50.987 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590139+0000", 2024-09-13T06:41:50.987 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.9489999999999998e-06 2024-09-13T06:41:50.987 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.987 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.987 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:50.987 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590148+0000", 2024-09-13T06:41:50.987 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.9830000000000002e-06 2024-09-13T06:41:50.987 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.987 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.987 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:50.987 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590156+0000", 2024-09-13T06:41:50.987 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5229999999999998e-06 2024-09-13T06:41:50.987 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.987 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.988 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:50.988 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.672709+0000", 2024-09-13T06:41:50.988 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.082552886000000006 2024-09-13T06:41:50.988 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.988 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.988 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:50.988 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.672816+0000", 2024-09-13T06:41:50.988 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000107736 2024-09-13T06:41:50.988 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.988 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.988 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:50.988 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.673124+0000", 2024-09-13T06:41:50.988 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00030804900000000002 2024-09-13T06:41:50.989 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:50.989 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:50.989 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:50.989 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.989 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.989 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:66818 3.17 3.50afe697 (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e100)", 2024-09-13T06:41:50.989 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:53.498942+0000", 2024-09-13T06:41:50.989 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 57.400490988999998, 2024-09-13T06:41:50.989 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.011231284, 2024-09-13T06:41:50.989 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:50.989 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:41:50.989 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:50.989 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:50.990 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:50.990 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 66818 2024-09-13T06:41:50.990 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.990 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:50.990 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.990 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:50.990 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:53.498942+0000", 2024-09-13T06:41:50.990 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:50.990 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.990 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.990 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:50.990 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:53.498942+0000", 2024-09-13T06:41:50.990 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:50.991 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.991 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.991 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:50.991 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:53.498939+0000", 2024-09-13T06:41:50.991 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999967 2024-09-13T06:41:50.991 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.991 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.991 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:50.991 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:53.498954+0000", 2024-09-13T06:41:50.991 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5028000000000001e-05 2024-09-13T06:41:50.992 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.992 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.992 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:50.992 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:53.498986+0000", 2024-09-13T06:41:50.992 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.1993999999999999e-05 2024-09-13T06:41:50.992 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.992 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.992 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:50.992 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:53.499001+0000", 2024-09-13T06:41:50.992 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5166e-05 2024-09-13T06:41:50.992 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.992 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.992 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:50.993 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:53.505097+0000", 2024-09-13T06:41:50.993 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0060955610000000002 2024-09-13T06:41:50.993 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.993 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.993 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:41:50.993 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:53.505108+0000", 2024-09-13T06:41:50.993 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.084e-05 2024-09-13T06:41:50.993 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.993 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.993 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:50.993 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:54.510158+0000", 2024-09-13T06:41:50.993 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0050497549999999 2024-09-13T06:41:50.993 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.994 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.994 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:50.994 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:54.510174+0000", 2024-09-13T06:41:50.994 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6164e-05 2024-09-13T06:41:50.994 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:50.994 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:50.994 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:50.994 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.994 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.994 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:69764 3.2 3:47f10058:::rbd_data.11214956a993.0000000000000004:head [write-same] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e117)", 2024-09-13T06:41:50.994 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:41:11.371147+0000", 2024-09-13T06:41:50.994 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 39.528286678999997, 2024-09-13T06:41:50.994 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.03470167, 2024-09-13T06:41:50.994 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:50.995 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:41:50.995 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:50.995 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:50.995 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:50.995 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 69764 2024-09-13T06:41:50.995 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.995 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:50.995 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.995 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:50.995 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:11.371147+0000", 2024-09-13T06:41:50.995 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:50.995 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.995 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.996 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:50.996 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:11.371147+0000", 2024-09-13T06:41:50.996 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:50.996 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.996 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.996 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:50.996 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:11.371144+0000", 2024-09-13T06:41:50.996 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999967 2024-09-13T06:41:50.996 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.996 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.996 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:50.996 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:11.371161+0000", 2024-09-13T06:41:50.996 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7669e-05 2024-09-13T06:41:50.997 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.997 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.997 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:50.997 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:11.371198+0000", 2024-09-13T06:41:50.997 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.7014000000000002e-05 2024-09-13T06:41:50.997 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.997 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.997 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:50.997 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:11.371216+0000", 2024-09-13T06:41:50.997 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7425e-05 2024-09-13T06:41:50.997 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.997 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.997 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:50.998 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:11.371365+0000", 2024-09-13T06:41:50.998 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000149245 2024-09-13T06:41:50.998 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.998 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.998 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op must wait for map", 2024-09-13T06:41:50.998 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:11.371385+0000", 2024-09-13T06:41:50.998 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.0018999999999999e-05 2024-09-13T06:41:50.998 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.998 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.998 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:50.998 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:11.378406+0000", 2024-09-13T06:41:50.998 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0070207179999999996 2024-09-13T06:41:50.998 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.998 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.999 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:41:50.999 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:11.378429+0000", 2024-09-13T06:41:50.999 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.3453999999999999e-05 2024-09-13T06:41:50.999 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.999 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.999 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:50.999 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:12.405667+0000", 2024-09-13T06:41:50.999 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0272381690000001 2024-09-13T06:41:50.999 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:50.999 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:50.999 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:50.999 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:12.405848+0000", 2024-09-13T06:41:50.999 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00018112 2024-09-13T06:41:51.000 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:51.000 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:51.000 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:51.000 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:51.000 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:51.000 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:70346 3.16 3:69d35907:::rbd_object_map.11214956a993:head [read 0~36] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e122)", 2024-09-13T06:41:51.000 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:41:16.390917+0000", 2024-09-13T06:41:51.000 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 34.508516626999999, 2024-09-13T06:41:51.000 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.99327479799999996, 2024-09-13T06:41:51.000 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:51.000 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:51.000 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:51.000 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:51.001 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:51.001 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 70346 2024-09-13T06:41:51.001 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:51.001 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:51.001 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:51.001 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:51.001 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:16.390917+0000", 2024-09-13T06:41:51.001 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:51.001 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:51.001 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:51.001 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:51.001 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:16.390917+0000", 2024-09-13T06:41:51.001 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:51.002 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:51.002 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:51.002 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:51.002 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:16.390916+0000", 2024-09-13T06:41:51.002 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999986 2024-09-13T06:41:51.002 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:51.002 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:51.002 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:51.002 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:16.390922+0000", 2024-09-13T06:41:51.002 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.0480000000000004e-06 2024-09-13T06:41:51.002 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:51.002 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:51.002 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:51.003 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:16.390933+0000", 2024-09-13T06:41:51.003 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1387e-05 2024-09-13T06:41:51.003 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:51.003 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:51.003 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:51.003 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:16.390939+0000", 2024-09-13T06:41:51.003 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.8039999999999998e-06 2024-09-13T06:41:51.003 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:51.003 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:51.003 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:51.003 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:16.390983+0000", 2024-09-13T06:41:51.003 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.4663000000000003e-05 2024-09-13T06:41:51.003 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:51.004 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:51.004 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:41:51.004 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:16.390991+0000", 2024-09-13T06:41:51.004 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.8059999999999995e-06 2024-09-13T06:41:51.004 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:51.004 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:51.004 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:51.004 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:17.383624+0000", 2024-09-13T06:41:51.004 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.99263277299999997 2024-09-13T06:41:51.004 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:51.004 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:51.004 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:51.004 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:17.383891+0000", 2024-09-13T06:41:51.004 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00026717599999999999 2024-09-13T06:41:51.005 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:51.005 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:51.005 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:51.005 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:17.384192+0000", 2024-09-13T06:41:51.005 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00030047400000000001 2024-09-13T06:41:51.005 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:51.005 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:51.005 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:51.005 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:51.005 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:51.005 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:41:51.006 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-13T06:41:51.007 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-13T06:41:51.008 INFO:tasks.ceph.osd.6.smithi139.stderr:2024-09-13T06:41:51.006+0000 7fcd02c5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26385) UID: 0 2024-09-13T06:41:51.107 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:41:51.105+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:41:51.161 INFO:teuthology.orchestra.run.smithi081.stdout:osd.0: {} 2024-09-13T06:41:51.161 INFO:teuthology.orchestra.run.smithi081.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-13T06:41:51.177 INFO:teuthology.orchestra.run.smithi081.stdout:osd.1: {} 2024-09-13T06:41:51.177 INFO:teuthology.orchestra.run.smithi081.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-13T06:41:51.177 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:41:51.177 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [], 2024-09-13T06:41:51.177 INFO:teuthology.orchestra.run.smithi139.stdout: "num_ops": 0 2024-09-13T06:41:51.177 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:41:51.191 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-13T06:41:51.192 INFO:teuthology.orchestra.run.smithi081.stdout:osd.2: {} 2024-09-13T06:41:51.193 INFO:teuthology.orchestra.run.smithi081.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-13T06:41:51.207 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:41:51.205+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:41:51.208 INFO:teuthology.orchestra.run.smithi081.stdout:osd.3: {} 2024-09-13T06:41:51.209 INFO:teuthology.orchestra.run.smithi081.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-13T06:41:51.225 INFO:teuthology.orchestra.run.smithi081.stdout:osd.4: {} 2024-09-13T06:41:51.225 INFO:teuthology.orchestra.run.smithi081.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-13T06:41:51.242 INFO:teuthology.orchestra.run.smithi081.stdout:osd.5: {} 2024-09-13T06:41:51.242 INFO:teuthology.orchestra.run.smithi081.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-13T06:41:51.261 INFO:teuthology.orchestra.run.smithi081.stdout:osd.6: {} 2024-09-13T06:41:51.261 INFO:teuthology.orchestra.run.smithi081.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-13T06:41:51.261 INFO:teuthology.orchestra.run.smithi081.stderr:Error ENXIO: problem getting command descriptions from osd.7 2024-09-13T06:41:51.265 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-13T06:41:51.265 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-13T06:41:51.309 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:41:51.306+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:41:51.314 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:41:51.314 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:41:51.328 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-13T06:41:51.410 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:41:51.409+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:41:51.494 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:41:51.494 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:41:51.508 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-13T06:41:51.510 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:41:51.509+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:41:51.612 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:41:51.609+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:41:51.640 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:41:51.640 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:41:51.659 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-13T06:41:51.712 INFO:tasks.ceph.osd.6.smithi139.stderr:2024-09-13T06:41:51.710+0000 7fcd02c5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26385) UID: 0 2024-09-13T06:41:51.813 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:41:51.810+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:41:51.885 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:41:51.885 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:41:51.914 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:41:51.909+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:41:51.915 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-13T06:41:52.015 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:41:52.013+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:41:52.115 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:41:52.113+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:41:52.142 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:41:52.142 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:41:52.164 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-13T06:41:52.250 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:41:52.249+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:41:52.317 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:41:52.313+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:41:52.335 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:41:52.335 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:41:52.347 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-13T06:41:52.419 INFO:tasks.ceph.osd.6.smithi139.stderr:2024-09-13T06:41:52.418+0000 7fcd02c5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26385) UID: 0 2024-09-13T06:41:52.494 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:41:52.494 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:41:52.506 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-13T06:41:52.550 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:41:52.549+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:41:52.581 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 4, 6, 7, 5, 3] out_osds: [] dead_osds: [7] live_osds: [0, 1, 2, 3, 4, 5, 6] 2024-09-13T06:41:52.582 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-13T06:41:52.582 INFO:tasks.thrashosds.thrasher:inject_pause on osd.0 2024-09-13T06:41:52.582 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-09-13T06:41:52.582 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-09-13T06:41:52.582 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok config set filestore_inject_stall 3 2024-09-13T06:41:52.616 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:41:52.616 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:41:52.620 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:41:52.617+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:41:52.629 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-13T06:41:52.652 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-13T06:41:52.699 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:41:52.699 INFO:teuthology.orchestra.run.smithi081.stdout: "success": "filestore_inject_stall = '' (not observed, change may require restart) " 2024-09-13T06:41:52.699 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:41:52.758 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:41:52.757+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:41:52.785 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:41:52.785 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:41:52.805 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-13T06:41:52.833 INFO:teuthology.orchestra.run.smithi081.stdout:checking clone #26, image image_client.0-clone26 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent27 2024-09-13T06:41:52.833 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:41:52.829+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:41:52.916 INFO:teuthology.orchestra.run.smithi081.stdout:4159 write 0xa39d532 thru 0xa3a9bdc (0xc6ab bytes) 2024-09-13T06:41:52.923 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:41:52.918+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:41:52.929 INFO:teuthology.orchestra.run.smithi081.stdout:4161 punch from 0xd66f7e4 to 0xd671005, (0x1821 bytes) 2024-09-13T06:41:52.929 INFO:teuthology.orchestra.run.smithi081.stdout:4162 read 0x8966bf2 thru 0x896badc (0x4eeb bytes) 2024-09-13T06:41:52.929 INFO:teuthology.orchestra.run.smithi081.stdout:4163 read 0x6eac71e thru 0x6eacf97 (0x87a bytes) 2024-09-13T06:41:52.929 INFO:teuthology.orchestra.run.smithi081.stdout:4164 read 0xb63e867 thru 0xb640a0f (0x21a9 bytes) 2024-09-13T06:41:52.932 INFO:teuthology.orchestra.run.smithi081.stdout:4165 trunc from 0xe84fbbc to 0xb9c9dd4 2024-09-13T06:41:52.942 INFO:teuthology.orchestra.run.smithi081.stdout:4166 trunc from 0xb9c9dd4 to 0xa30b956 2024-09-13T06:41:52.958 INFO:teuthology.orchestra.run.smithi081.stdout:4167 clone 29 order 22 su 262144 sc 13 2024-09-13T06:41:52.964 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:41:52.964 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:41:52.977 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-13T06:41:53.024 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:41:53.021+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:41:53.081 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:41:53.081 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:41:53.093 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-13T06:41:53.125 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:41:53.122+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:41:53.226 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:41:53.225+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:41:53.249 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:41:53.249 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:41:53.262 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-13T06:41:53.266 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-13T06:41:53.350 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:41:53.349+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:41:53.416 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:41:53.417 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:41:53.427 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-13T06:41:53.428 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:41:53.422+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:41:53.447 INFO:teuthology.orchestra.run.smithi081.stdout:osd.0: {} 2024-09-13T06:41:53.448 INFO:teuthology.orchestra.run.smithi081.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-13T06:41:53.463 INFO:teuthology.orchestra.run.smithi081.stdout:osd.1: {} 2024-09-13T06:41:53.463 INFO:teuthology.orchestra.run.smithi081.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-13T06:41:53.479 INFO:teuthology.orchestra.run.smithi081.stdout:osd.2: {} 2024-09-13T06:41:53.479 INFO:teuthology.orchestra.run.smithi081.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-13T06:41:53.494 INFO:teuthology.orchestra.run.smithi081.stdout:osd.3: {} 2024-09-13T06:41:53.494 INFO:teuthology.orchestra.run.smithi081.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-13T06:41:53.513 INFO:teuthology.orchestra.run.smithi081.stdout:osd.4: {} 2024-09-13T06:41:53.513 INFO:teuthology.orchestra.run.smithi081.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-13T06:41:53.528 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:41:53.525+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:41:53.533 INFO:teuthology.orchestra.run.smithi081.stdout:osd.5: {} 2024-09-13T06:41:53.533 INFO:teuthology.orchestra.run.smithi081.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-13T06:41:53.553 INFO:teuthology.orchestra.run.smithi081.stdout:osd.6: {} 2024-09-13T06:41:53.554 INFO:teuthology.orchestra.run.smithi081.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-13T06:41:53.554 INFO:teuthology.orchestra.run.smithi081.stderr:Error ENXIO: problem getting command descriptions from osd.7 2024-09-13T06:41:53.556 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:41:53.556 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 20, 2024-09-13T06:41:53.556 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 600, 2024-09-13T06:41:53.556 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [ 2024-09-13T06:41:53.557 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:53.557 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:2226 3.15 3:af026987:::rbd_data.112173e2f1b7.0000000000000017:head [sparse-read 0~4194304] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-13T06:41:53.557 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:37.606562+0000", 2024-09-13T06:41:53.557 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 135.94912706299999, 2024-09-13T06:41:53.557 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.83322091700000001, 2024-09-13T06:41:53.557 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:53.557 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:41:53.557 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:53.557 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:53.557 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:53.557 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 2226 2024-09-13T06:41:53.557 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:53.557 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:53.558 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:53.558 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:53.558 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606562+0000", 2024-09-13T06:41:53.558 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:53.558 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:53.558 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:53.558 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:53.558 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606562+0000", 2024-09-13T06:41:53.558 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:53.558 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:53.558 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:53.558 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:53.558 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606561+0000", 2024-09-13T06:41:53.559 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:53.559 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:53.559 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:53.559 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:53.559 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606565+0000", 2024-09-13T06:41:53.559 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.4379999999999999e-06 2024-09-13T06:41:53.559 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:53.559 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:53.559 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:53.559 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606569+0000", 2024-09-13T06:41:53.559 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.425e-06 2024-09-13T06:41:53.559 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:53.559 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:53.559 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:53.560 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606572+0000", 2024-09-13T06:41:53.560 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.05e-06 2024-09-13T06:41:53.560 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:53.560 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:53.560 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:53.560 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606621+0000", 2024-09-13T06:41:53.560 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.8723000000000001e-05 2024-09-13T06:41:53.560 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:53.560 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:53.560 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:41:53.560 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606630+0000", 2024-09-13T06:41:53.560 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.8040000000000007e-06 2024-09-13T06:41:53.560 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:53.561 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:53.561 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:53.561 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.439648+0000", 2024-09-13T06:41:53.561 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.83301824800000002 2024-09-13T06:41:53.561 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:53.561 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:53.561 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:53.561 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.439782+0000", 2024-09-13T06:41:53.561 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00013466699999999999 2024-09-13T06:41:53.561 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:53.561 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:53.561 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:53.561 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:53.561 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:53.562 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25661 3.8 3:1180686c:::rbd_data.1121f2c5ee81.0000000000000009:13 [read 397312~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:53.562 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.436956+0000", 2024-09-13T06:41:53.562 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 117.118732529, 2024-09-13T06:41:53.562 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089036758999999993, 2024-09-13T06:41:53.562 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:53.562 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:53.562 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:53.562 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:53.562 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:53.562 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25661 2024-09-13T06:41:53.562 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:53.562 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:53.563 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:53.563 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:53.563 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436956+0000", 2024-09-13T06:41:53.563 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:53.563 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:53.563 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:53.563 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:53.563 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436956+0000", 2024-09-13T06:41:53.563 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:53.563 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:53.563 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:53.563 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:53.563 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436956+0000", 2024-09-13T06:41:53.564 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:53.564 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:53.564 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:53.564 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:53.564 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436958+0000", 2024-09-13T06:41:53.564 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1770000000000001e-06 2024-09-13T06:41:53.564 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:53.564 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:53.564 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:53.564 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436963+0000", 2024-09-13T06:41:53.564 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.6489999999999996e-06 2024-09-13T06:41:53.564 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:53.564 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:53.565 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:53.565 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436975+0000", 2024-09-13T06:41:53.565 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1783999999999999e-05 2024-09-13T06:41:53.565 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:53.565 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:53.565 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:53.565 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.525671+0000", 2024-09-13T06:41:53.565 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.088696292999999995 2024-09-13T06:41:53.565 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:53.565 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:53.565 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:53.565 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.525749+0000", 2024-09-13T06:41:53.565 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.7589000000000005e-05 2024-09-13T06:41:53.565 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:53.566 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:53.566 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:53.566 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.525993+0000", 2024-09-13T06:41:53.566 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00024381000000000001 2024-09-13T06:41:53.566 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:53.566 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:53.566 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:53.566 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:53.566 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:53.566 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25662 3.8 3:1180686c:::rbd_data.1121f2c5ee81.0000000000000009:13 [read 421888~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:53.566 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.436980+0000", 2024-09-13T06:41:53.566 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 117.11870821700001, 2024-09-13T06:41:53.566 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089367577000000004, 2024-09-13T06:41:53.566 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:53.566 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:53.567 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:53.567 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:53.567 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:53.567 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25662 2024-09-13T06:41:53.567 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:53.567 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:53.567 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:53.567 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:53.567 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436980+0000", 2024-09-13T06:41:53.567 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:53.567 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:53.567 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:53.567 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:53.567 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436980+0000", 2024-09-13T06:41:53.567 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:53.568 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:53.568 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:53.568 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:53.568 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436980+0000", 2024-09-13T06:41:53.568 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:53.568 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:53.568 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:53.568 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:53.568 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436982+0000", 2024-09-13T06:41:53.568 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3989999999999998e-06 2024-09-13T06:41:53.568 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:53.568 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:53.568 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:53.568 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436988+0000", 2024-09-13T06:41:53.568 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0039999999999996e-06 2024-09-13T06:41:53.569 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:53.569 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:53.569 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:53.569 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436993+0000", 2024-09-13T06:41:53.569 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6090000000000003e-06 2024-09-13T06:41:53.569 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:53.569 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:53.569 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:53.569 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.526035+0000", 2024-09-13T06:41:53.569 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089042248000000004 2024-09-13T06:41:53.569 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:53.569 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:53.569 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:53.569 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.526111+0000", 2024-09-13T06:41:53.570 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5643999999999996e-05 2024-09-13T06:41:53.570 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:53.570 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:53.570 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:53.570 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.526348+0000", 2024-09-13T06:41:53.570 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00023705800000000001 2024-09-13T06:41:53.570 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:53.570 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:53.570 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:53.570 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:53.570 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:53.570 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25663 3.8 3:1180686c:::rbd_data.1121f2c5ee81.0000000000000009:13 [read 466944~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:53.570 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.436998+0000", 2024-09-13T06:41:53.570 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 117.11869057, 2024-09-13T06:41:53.570 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089730867000000006, 2024-09-13T06:41:53.570 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:53.571 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:53.571 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:53.571 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:53.571 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:53.571 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25663 2024-09-13T06:41:53.571 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:53.571 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:53.571 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:53.571 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:53.571 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436998+0000", 2024-09-13T06:41:53.571 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:53.571 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:53.571 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:53.571 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:53.572 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436998+0000", 2024-09-13T06:41:53.572 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:53.572 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:53.572 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:53.572 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:53.572 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436998+0000", 2024-09-13T06:41:53.572 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:53.572 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:53.572 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:53.572 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:53.572 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437000+0000", 2024-09-13T06:41:53.572 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0940000000000002e-06 2024-09-13T06:41:53.572 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:53.573 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:53.573 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:53.573 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437005+0000", 2024-09-13T06:41:53.573 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.604e-06 2024-09-13T06:41:53.573 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:53.573 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:53.573 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:53.573 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437032+0000", 2024-09-13T06:41:53.573 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6407e-05 2024-09-13T06:41:53.574 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:53.574 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:53.574 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:53.574 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.526363+0000", 2024-09-13T06:41:53.574 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089331456000000004 2024-09-13T06:41:53.574 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:53.574 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:53.574 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:53.574 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.526404+0000", 2024-09-13T06:41:53.574 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.0887999999999999e-05 2024-09-13T06:41:53.574 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:53.574 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:53.574 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:53.574 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.526729+0000", 2024-09-13T06:41:53.575 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00032486 2024-09-13T06:41:53.575 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:53.575 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:53.575 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:53.575 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:53.575 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:53.575 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25664 3.8 3:1180686c:::rbd_data.1121f2c5ee81.0000000000000009:13 [read 491520~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:53.575 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.437040+0000", 2024-09-13T06:41:53.575 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 117.118648655, 2024-09-13T06:41:53.575 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.090016650000000004, 2024-09-13T06:41:53.575 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:53.575 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:53.575 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:53.576 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:53.576 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:53.576 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25664 2024-09-13T06:41:53.576 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:53.576 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:53.576 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:53.576 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:53.576 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437040+0000", 2024-09-13T06:41:53.576 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:53.577 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:53.577 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:53.577 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:53.577 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437040+0000", 2024-09-13T06:41:53.577 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:53.577 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:53.577 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:53.577 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:53.577 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437039+0000", 2024-09-13T06:41:53.577 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:53.577 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:53.577 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:53.577 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:53.578 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437047+0000", 2024-09-13T06:41:53.578 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4839999999999998e-06 2024-09-13T06:41:53.578 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:53.578 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:53.578 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:53.578 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437054+0000", 2024-09-13T06:41:53.578 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.8299999999999998e-06 2024-09-13T06:41:53.578 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:53.578 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:53.578 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:53.578 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437060+0000", 2024-09-13T06:41:53.578 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.1510000000000001e-06 2024-09-13T06:41:53.578 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:53.578 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:53.579 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:53.579 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.526772+0000", 2024-09-13T06:41:53.579 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089711737999999999 2024-09-13T06:41:53.579 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:53.579 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:53.579 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:53.579 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.526848+0000", 2024-09-13T06:41:53.579 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5870000000000004e-05 2024-09-13T06:41:53.579 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:53.579 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:53.579 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:53.579 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.527057+0000", 2024-09-13T06:41:53.579 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000209106 2024-09-13T06:41:53.580 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:53.580 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:53.580 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:53.580 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:53.580 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:53.580 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25740 3.18 3:1c662b96:::rbd_data.1121f2c5ee81.0000000000000010:13 [read 200704~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:53.580 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443352+0000", 2024-09-13T06:41:53.580 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 117.11233697999999, 2024-09-13T06:41:53.580 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089068222000000002, 2024-09-13T06:41:53.580 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:53.580 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:53.580 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:53.580 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:53.581 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:53.581 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25740 2024-09-13T06:41:53.581 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:53.581 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:53.581 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:53.581 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:53.581 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443352+0000", 2024-09-13T06:41:53.581 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:53.581 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:53.581 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:53.581 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:53.581 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443352+0000", 2024-09-13T06:41:53.582 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:53.582 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:53.582 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:53.582 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:53.582 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443351+0000", 2024-09-13T06:41:53.582 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:53.582 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:53.582 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:53.582 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:53.582 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443354+0000", 2024-09-13T06:41:53.582 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.841e-06 2024-09-13T06:41:53.582 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:53.583 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:53.583 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:53.583 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443361+0000", 2024-09-13T06:41:53.583 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.0010000000000004e-06 2024-09-13T06:41:53.583 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:53.583 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:53.583 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:53.583 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443366+0000", 2024-09-13T06:41:53.583 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7119999999999999e-06 2024-09-13T06:41:53.583 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:53.583 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:53.583 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:53.584 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532117+0000", 2024-09-13T06:41:53.584 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.088751327000000005 2024-09-13T06:41:53.584 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:53.584 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:53.584 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:53.584 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532193+0000", 2024-09-13T06:41:53.584 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5839000000000004e-05 2024-09-13T06:41:53.584 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:53.584 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:53.584 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:53.585 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532420+0000", 2024-09-13T06:41:53.585 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00022691000000000001 2024-09-13T06:41:53.585 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:53.585 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:53.585 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:53.585 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:53.585 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:53.585 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25741 3.18 3:1c662b96:::rbd_data.1121f2c5ee81.0000000000000010:13 [read 225280~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:53.585 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443378+0000", 2024-09-13T06:41:53.585 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 117.112310213, 2024-09-13T06:41:53.585 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089324107, 2024-09-13T06:41:53.585 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:53.585 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:53.586 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:53.586 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:53.586 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:53.586 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25741 2024-09-13T06:41:53.586 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:53.586 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:53.586 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:53.586 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:53.586 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443378+0000", 2024-09-13T06:41:53.586 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:53.586 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:53.586 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:53.586 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:53.587 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443378+0000", 2024-09-13T06:41:53.587 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:53.587 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:53.587 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:53.587 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:53.587 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443378+0000", 2024-09-13T06:41:53.587 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:53.587 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:53.587 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:53.587 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:53.587 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443380+0000", 2024-09-13T06:41:53.587 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3549999999999999e-06 2024-09-13T06:41:53.587 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:53.588 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:53.588 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:53.588 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443388+0000", 2024-09-13T06:41:53.588 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.7449999999999995e-06 2024-09-13T06:41:53.588 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:53.588 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:53.588 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:53.588 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443393+0000", 2024-09-13T06:41:53.588 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.4e-06 2024-09-13T06:41:53.588 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:53.588 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:53.588 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:53.588 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532454+0000", 2024-09-13T06:41:53.588 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089060941000000005 2024-09-13T06:41:53.588 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:53.589 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:53.589 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:53.589 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532512+0000", 2024-09-13T06:41:53.589 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7763000000000002e-05 2024-09-13T06:41:53.589 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:53.589 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:53.589 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:53.589 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532703+0000", 2024-09-13T06:41:53.589 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000190328 2024-09-13T06:41:53.589 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:53.589 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:53.589 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:53.589 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:53.589 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:53.590 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25742 3.18 3:1c662b96:::rbd_data.1121f2c5ee81.0000000000000010:13 [read 270336~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:53.590 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443398+0000", 2024-09-13T06:41:53.590 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 117.112290501, 2024-09-13T06:41:53.590 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089621836999999996, 2024-09-13T06:41:53.590 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:53.591 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:53.591 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:53.591 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:53.591 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:53.591 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25742 2024-09-13T06:41:53.592 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:53.592 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:53.592 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:53.592 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:53.592 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443398+0000", 2024-09-13T06:41:53.592 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:53.592 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:53.593 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:53.593 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:53.593 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443398+0000", 2024-09-13T06:41:53.593 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:53.593 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:53.593 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:53.593 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:53.593 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443398+0000", 2024-09-13T06:41:53.594 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:53.594 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:53.594 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:53.594 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:53.594 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443400+0000", 2024-09-13T06:41:53.595 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1849999999999998e-06 2024-09-13T06:41:53.595 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:53.595 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:53.595 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:53.595 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443407+0000", 2024-09-13T06:41:53.596 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3669999999999999e-06 2024-09-13T06:41:53.596 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:53.596 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:53.596 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:53.596 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443420+0000", 2024-09-13T06:41:53.596 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2645e-05 2024-09-13T06:41:53.597 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:53.597 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:53.597 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:53.597 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532742+0000", 2024-09-13T06:41:53.597 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089322200000000004 2024-09-13T06:41:53.597 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:53.597 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:53.597 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:53.597 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532818+0000", 2024-09-13T06:41:53.597 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.6019000000000005e-05 2024-09-13T06:41:53.598 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:53.598 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:53.598 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:53.598 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533020+0000", 2024-09-13T06:41:53.598 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000201721 2024-09-13T06:41:53.598 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:53.598 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:53.598 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:53.598 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:53.598 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:53.598 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25743 3.18 3:1c662b96:::rbd_data.1121f2c5ee81.0000000000000010:13 [read 294912~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:53.598 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443425+0000", 2024-09-13T06:41:53.598 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 117.112263493, 2024-09-13T06:41:53.599 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089864075000000002, 2024-09-13T06:41:53.599 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:53.599 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:53.599 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:53.599 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:53.599 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:53.599 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25743 2024-09-13T06:41:53.599 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:53.599 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:53.599 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:53.599 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:53.599 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443425+0000", 2024-09-13T06:41:53.599 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:53.599 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:53.600 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:53.600 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:53.600 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443425+0000", 2024-09-13T06:41:53.600 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:53.600 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:53.600 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:53.600 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:53.600 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443425+0000", 2024-09-13T06:41:53.600 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:53.600 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:53.600 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:53.600 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:53.600 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443432+0000", 2024-09-13T06:41:53.600 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3420000000000002e-06 2024-09-13T06:41:53.601 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:53.601 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:53.601 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:53.601 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443440+0000", 2024-09-13T06:41:53.601 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5689999999999999e-06 2024-09-13T06:41:53.601 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:53.601 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:53.601 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:53.601 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443445+0000", 2024-09-13T06:41:53.602 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9590000000000003e-06 2024-09-13T06:41:53.602 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:53.602 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:53.602 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:53.602 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533063+0000", 2024-09-13T06:41:53.602 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089617988999999995 2024-09-13T06:41:53.602 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:53.602 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:53.602 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:53.602 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533122+0000", 2024-09-13T06:41:53.602 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9052999999999999e-05 2024-09-13T06:41:53.602 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:53.603 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:53.603 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:53.603 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533289+0000", 2024-09-13T06:41:53.603 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00016752800000000001 2024-09-13T06:41:53.603 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:53.603 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:53.603 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:53.603 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:53.603 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:53.603 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25744 3.18 3.69d46638 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:53.603 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443449+0000", 2024-09-13T06:41:53.603 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 117.112239346, 2024-09-13T06:41:53.603 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089869148999999995, 2024-09-13T06:41:53.603 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:53.604 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:41:53.604 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:53.604 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:53.604 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:53.604 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25744 2024-09-13T06:41:53.604 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:53.604 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:53.604 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:53.604 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:53.604 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443449+0000", 2024-09-13T06:41:53.604 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:53.604 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:53.604 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:53.605 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:53.605 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443449+0000", 2024-09-13T06:41:53.605 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:53.605 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:53.605 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:53.605 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:53.605 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443449+0000", 2024-09-13T06:41:53.605 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:53.605 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:53.605 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:53.605 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:53.605 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443451+0000", 2024-09-13T06:41:53.605 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.244e-06 2024-09-13T06:41:53.606 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:53.606 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:53.606 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:53.606 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443457+0000", 2024-09-13T06:41:53.606 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.66e-06 2024-09-13T06:41:53.606 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:53.606 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:53.606 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:53.606 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443461+0000", 2024-09-13T06:41:53.606 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5449999999999997e-06 2024-09-13T06:41:53.606 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:53.606 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:53.606 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:53.607 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533311+0000", 2024-09-13T06:41:53.607 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089849729000000003 2024-09-13T06:41:53.607 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:53.607 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:53.607 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:53.607 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533318+0000", 2024-09-13T06:41:53.607 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.328e-06 2024-09-13T06:41:53.607 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:53.607 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:53.607 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:53.607 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:53.607 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:53.607 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25745 3.18 3.69d46638 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:53.608 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443466+0000", 2024-09-13T06:41:53.608 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 117.112222288, 2024-09-13T06:41:53.608 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089886743000000005, 2024-09-13T06:41:53.608 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:53.608 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:41:53.608 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:53.608 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:53.608 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:53.608 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25745 2024-09-13T06:41:53.608 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:53.608 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:53.608 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:53.608 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:53.609 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443466+0000", 2024-09-13T06:41:53.609 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:53.609 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:53.609 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:53.609 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:53.609 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443466+0000", 2024-09-13T06:41:53.609 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:53.609 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:53.609 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:53.609 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:53.609 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443466+0000", 2024-09-13T06:41:53.609 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:53.609 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:53.610 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:53.610 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:53.610 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443474+0000", 2024-09-13T06:41:53.610 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.1289999999999996e-06 2024-09-13T06:41:53.610 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:53.610 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:53.610 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:53.610 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443484+0000", 2024-09-13T06:41:53.610 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0654e-05 2024-09-13T06:41:53.610 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:53.610 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:53.610 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:53.610 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443490+0000", 2024-09-13T06:41:53.610 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8030000000000002e-06 2024-09-13T06:41:53.610 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:53.611 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:53.611 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:53.611 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533348+0000", 2024-09-13T06:41:53.611 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089857267000000005 2024-09-13T06:41:53.611 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:53.611 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:53.611 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:53.611 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533353+0000", 2024-09-13T06:41:53.611 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.5520000000000004e-06 2024-09-13T06:41:53.611 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:53.611 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:53.611 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:53.611 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:53.612 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:53.612 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25746 3.18 3.69d46638 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:53.612 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443495+0000", 2024-09-13T06:41:53.612 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 117.112193175, 2024-09-13T06:41:53.612 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089903725000000004, 2024-09-13T06:41:53.612 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:53.612 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:41:53.612 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:53.612 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:53.612 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:53.612 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25746 2024-09-13T06:41:53.612 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:53.612 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:53.612 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:53.613 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:53.613 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443495+0000", 2024-09-13T06:41:53.613 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:53.613 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:53.613 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:53.613 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:53.613 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443495+0000", 2024-09-13T06:41:53.613 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:53.613 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:53.613 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:53.613 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:53.613 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443495+0000", 2024-09-13T06:41:53.613 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:53.614 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:53.614 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:53.614 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:53.614 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443498+0000", 2024-09-13T06:41:53.614 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.7690000000000001e-06 2024-09-13T06:41:53.614 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:53.614 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:53.614 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:53.614 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443504+0000", 2024-09-13T06:41:53.614 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9710000000000001e-06 2024-09-13T06:41:53.614 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:53.614 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:53.614 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:53.615 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443508+0000", 2024-09-13T06:41:53.615 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4159999999999997e-06 2024-09-13T06:41:53.615 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:53.615 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:53.615 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:53.615 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533391+0000", 2024-09-13T06:41:53.615 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089882607000000003 2024-09-13T06:41:53.615 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:53.615 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:53.615 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:53.615 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533399+0000", 2024-09-13T06:41:53.615 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.4349999999999997e-06 2024-09-13T06:41:53.615 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:53.616 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:53.616 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:53.616 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:53.616 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:53.616 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25747 3.8 3.63996268 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:53.616 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443512+0000", 2024-09-13T06:41:53.616 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 117.112176444, 2024-09-13T06:41:53.616 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089880075000000004, 2024-09-13T06:41:53.616 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:53.616 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:41:53.616 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:53.616 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:53.616 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:53.616 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25747 2024-09-13T06:41:53.617 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:53.617 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:53.617 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:53.617 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:53.617 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443512+0000", 2024-09-13T06:41:53.617 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:53.617 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:53.617 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:53.617 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:53.617 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443512+0000", 2024-09-13T06:41:53.617 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:53.617 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:53.617 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:53.618 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:53.618 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443512+0000", 2024-09-13T06:41:53.618 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:53.618 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:53.618 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:53.618 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:53.618 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443514+0000", 2024-09-13T06:41:53.618 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0980000000000001e-06 2024-09-13T06:41:53.618 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:53.618 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:53.618 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:53.618 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443520+0000", 2024-09-13T06:41:53.618 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7069999999999997e-06 2024-09-13T06:41:53.618 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:53.619 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:53.619 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:53.619 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443524+0000", 2024-09-13T06:41:53.619 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5390000000000001e-06 2024-09-13T06:41:53.619 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:53.619 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:53.619 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:53.619 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533384+0000", 2024-09-13T06:41:53.619 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089859684999999995 2024-09-13T06:41:53.619 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:53.619 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:53.619 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:53.619 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533392+0000", 2024-09-13T06:41:53.619 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.3440000000000001e-06 2024-09-13T06:41:53.620 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:53.620 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:53.620 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:53.620 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:53.620 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:53.620 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25748 3.8 3.63996268 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:53.620 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443528+0000", 2024-09-13T06:41:53.620 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 117.112160317, 2024-09-13T06:41:53.620 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089890715999999996, 2024-09-13T06:41:53.620 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:53.620 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:41:53.620 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:53.620 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:53.621 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:53.621 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25748 2024-09-13T06:41:53.621 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:53.621 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:53.621 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:53.621 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:53.621 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443528+0000", 2024-09-13T06:41:53.621 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:53.621 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:53.621 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:53.621 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:53.621 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443528+0000", 2024-09-13T06:41:53.621 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:53.621 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:53.622 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:53.622 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:53.622 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443528+0000", 2024-09-13T06:41:53.622 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:53.622 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:53.622 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:53.622 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:53.622 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443530+0000", 2024-09-13T06:41:53.622 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0650000000000001e-06 2024-09-13T06:41:53.622 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:53.622 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:53.622 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:53.622 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443536+0000", 2024-09-13T06:41:53.622 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7259999999999999e-06 2024-09-13T06:41:53.623 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:53.623 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:53.623 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:53.623 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443540+0000", 2024-09-13T06:41:53.623 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5009999999999998e-06 2024-09-13T06:41:53.623 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:53.623 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:53.623 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:53.623 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533412+0000", 2024-09-13T06:41:53.623 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089871873000000005 2024-09-13T06:41:53.623 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:53.623 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:53.623 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:53.624 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533419+0000", 2024-09-13T06:41:53.624 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.883e-06 2024-09-13T06:41:53.624 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:53.624 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:53.624 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:53.624 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:53.624 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:53.624 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25749 3.8 3.63996268 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:53.624 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443545+0000", 2024-09-13T06:41:53.624 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 117.112144121, 2024-09-13T06:41:53.624 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089897988999999998, 2024-09-13T06:41:53.624 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:53.624 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:41:53.624 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:53.625 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:53.625 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:53.625 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25749 2024-09-13T06:41:53.625 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:53.625 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:53.625 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:53.625 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:53.625 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443545+0000", 2024-09-13T06:41:53.625 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:53.625 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:53.625 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:53.625 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:53.625 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443545+0000", 2024-09-13T06:41:53.625 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:53.626 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:53.626 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:53.626 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:53.626 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443544+0000", 2024-09-13T06:41:53.626 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:53.626 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:53.626 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:53.626 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:53.626 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443553+0000", 2024-09-13T06:41:53.626 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.4770000000000003e-06 2024-09-13T06:41:53.626 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:53.626 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:53.626 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:53.627 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443564+0000", 2024-09-13T06:41:53.627 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0986e-05 2024-09-13T06:41:53.627 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:53.627 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:53.627 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:53.627 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443569+0000", 2024-09-13T06:41:53.627 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2530000000000004e-06 2024-09-13T06:41:53.627 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:53.627 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:53.627 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:53.627 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533438+0000", 2024-09-13T06:41:53.627 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089868641999999999 2024-09-13T06:41:53.627 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:53.627 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:53.628 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:53.628 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533442+0000", 2024-09-13T06:41:53.628 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.989e-06 2024-09-13T06:41:53.628 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:53.628 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:53.628 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:53.628 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:53.628 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:53.628 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25750 3.8 3.63996268 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:53.628 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443574+0000", 2024-09-13T06:41:53.628 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 117.112114635, 2024-09-13T06:41:53.628 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089895143999999996, 2024-09-13T06:41:53.628 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:53.629 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:41:53.629 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:53.629 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:53.629 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:53.629 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25750 2024-09-13T06:41:53.629 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:53.629 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:53.629 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:53.629 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:53.629 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443574+0000", 2024-09-13T06:41:53.629 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:53.630 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:53.630 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:53.630 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:53.630 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443574+0000", 2024-09-13T06:41:53.630 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:53.630 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:53.630 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:53.630 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:53.630 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443574+0000", 2024-09-13T06:41:53.630 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:53.630 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:53.630 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:53.630 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:53.630 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443576+0000", 2024-09-13T06:41:53.631 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6910000000000002e-06 2024-09-13T06:41:53.631 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:53.631 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:53.631 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:53.631 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443583+0000", 2024-09-13T06:41:53.631 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.331e-06 2024-09-13T06:41:53.631 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:53.631 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:53.631 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:53.631 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443587+0000", 2024-09-13T06:41:53.631 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6129999999999997e-06 2024-09-13T06:41:53.631 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:53.631 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:53.631 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:53.631 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533464+0000", 2024-09-13T06:41:53.632 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089876605999999998 2024-09-13T06:41:53.632 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:53.632 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:53.632 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:53.632 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533469+0000", 2024-09-13T06:41:53.632 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3909999999999997e-06 2024-09-13T06:41:53.632 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:53.632 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:53.632 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:53.632 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:53.632 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:53.632 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25751 3.8 3.63996268 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:53.632 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443592+0000", 2024-09-13T06:41:53.633 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 117.11209693799999, 2024-09-13T06:41:53.633 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089913650999999997, 2024-09-13T06:41:53.633 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:53.633 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:41:53.633 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:53.633 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:53.633 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:53.633 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25751 2024-09-13T06:41:53.633 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:53.633 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:53.633 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:53.633 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:53.633 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443592+0000", 2024-09-13T06:41:53.633 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:53.633 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:53.634 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:53.634 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:53.634 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443592+0000", 2024-09-13T06:41:53.634 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:53.634 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:53.634 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:53.634 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:53.634 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443591+0000", 2024-09-13T06:41:53.634 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:53.634 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:53.634 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:53.634 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:53.634 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443594+0000", 2024-09-13T06:41:53.634 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3649999999999998e-06 2024-09-13T06:41:53.635 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:53.635 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:53.635 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:53.635 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443599+0000", 2024-09-13T06:41:53.635 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.699e-06 2024-09-13T06:41:53.635 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:53.635 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:53.635 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:53.635 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443611+0000", 2024-09-13T06:41:53.635 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1503e-05 2024-09-13T06:41:53.635 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:53.635 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:53.635 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:53.635 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533497+0000", 2024-09-13T06:41:53.635 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089886453000000005 2024-09-13T06:41:53.636 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:53.636 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:53.636 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:53.636 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533505+0000", 2024-09-13T06:41:53.636 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.9910000000000002e-06 2024-09-13T06:41:53.636 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:53.636 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:53.636 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:53.636 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:53.636 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:53.636 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25752 3.8 3.63996268 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:53.636 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443615+0000", 2024-09-13T06:41:53.636 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 117.112073157, 2024-09-13T06:41:53.636 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089905868999999999, 2024-09-13T06:41:53.637 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:53.637 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:41:53.637 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:53.637 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:53.637 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:53.637 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25752 2024-09-13T06:41:53.637 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:53.637 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:53.637 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:53.637 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:53.637 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443615+0000", 2024-09-13T06:41:53.637 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:53.637 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:53.637 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:53.638 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:53.638 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443615+0000", 2024-09-13T06:41:53.638 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:53.638 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:53.638 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:53.638 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:53.638 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443615+0000", 2024-09-13T06:41:53.638 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:53.638 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:53.638 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:53.638 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:53.638 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443617+0000", 2024-09-13T06:41:53.638 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3539999999999998e-06 2024-09-13T06:41:53.638 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:53.638 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:53.639 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:53.639 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443624+0000", 2024-09-13T06:41:53.639 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3600000000000001e-06 2024-09-13T06:41:53.639 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:53.639 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:53.639 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:53.639 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443628+0000", 2024-09-13T06:41:53.639 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.2350000000000001e-06 2024-09-13T06:41:53.639 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:53.639 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:53.639 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:53.639 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533517+0000", 2024-09-13T06:41:53.639 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089889029999999995 2024-09-13T06:41:53.639 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:53.640 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:53.640 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:53.640 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533521+0000", 2024-09-13T06:41:53.640 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.2529999999999998e-06 2024-09-13T06:41:53.640 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:53.640 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:53.640 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:53.640 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:53.640 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:53.640 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25755 3.8 3.63996268 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:53.640 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.444692+0000", 2024-09-13T06:41:53.640 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 117.11099645100001, 2024-09-13T06:41:53.640 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.088904186999999996, 2024-09-13T06:41:53.641 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:53.641 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:41:53.641 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:53.641 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:53.641 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:53.641 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25755 2024-09-13T06:41:53.641 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:53.641 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:53.641 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:53.641 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:53.641 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.444692+0000", 2024-09-13T06:41:53.641 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:53.641 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:53.641 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:53.642 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:53.642 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.444692+0000", 2024-09-13T06:41:53.642 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:53.642 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:53.642 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:53.642 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:53.642 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.444692+0000", 2024-09-13T06:41:53.642 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:53.642 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:53.642 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:53.642 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:53.642 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.444694+0000", 2024-09-13T06:41:53.642 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.058e-06 2024-09-13T06:41:53.643 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:53.643 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:53.643 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:53.643 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.444700+0000", 2024-09-13T06:41:53.643 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7769999999999999e-06 2024-09-13T06:41:53.643 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:53.643 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:53.643 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:53.643 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.444704+0000", 2024-09-13T06:41:53.643 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6229999999999996e-06 2024-09-13T06:41:53.643 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:53.643 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:53.643 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:53.643 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533587+0000", 2024-09-13T06:41:53.643 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.088882744999999999 2024-09-13T06:41:53.644 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:53.644 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:53.644 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:53.644 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533596+0000", 2024-09-13T06:41:53.644 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.3270000000000007e-06 2024-09-13T06:41:53.644 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:53.644 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:53.644 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:53.644 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:53.644 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:53.644 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:64356 3.c 3:32785be9:::rbd_header.11218ba71f0d:head [watch reconnect cookie 140361410387072 gen 2] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e95)", 2024-09-13T06:41:53.644 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:48.473318+0000", 2024-09-13T06:41:53.644 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 65.082370764000004, 2024-09-13T06:41:53.644 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1458904379999999, 2024-09-13T06:41:53.645 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:53.645 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:53.645 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:53.645 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:53.645 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:53.645 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 64356 2024-09-13T06:41:53.645 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:53.645 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:53.645 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:53.645 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:53.645 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:48.473318+0000", 2024-09-13T06:41:53.645 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:53.646 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:53.646 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:53.646 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:53.646 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:48.473318+0000", 2024-09-13T06:41:53.646 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:53.646 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:53.646 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:53.646 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:53.646 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:48.473315+0000", 2024-09-13T06:41:53.646 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999971 2024-09-13T06:41:53.646 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:53.646 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:53.646 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:53.646 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:48.473329+0000", 2024-09-13T06:41:53.647 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.433e-05 2024-09-13T06:41:53.647 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:53.647 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:53.647 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:53.647 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:48.473363+0000", 2024-09-13T06:41:53.647 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.3592e-05 2024-09-13T06:41:53.647 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:53.647 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:53.647 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:53.647 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:48.473386+0000", 2024-09-13T06:41:53.647 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2708999999999999e-05 2024-09-13T06:41:53.647 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:53.647 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:53.648 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:53.648 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:48.473804+0000", 2024-09-13T06:41:53.648 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00041789399999999998 2024-09-13T06:41:53.648 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:53.648 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:53.648 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:41:53.648 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:48.473830+0000", 2024-09-13T06:41:53.648 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6869e-05 2024-09-13T06:41:53.648 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:53.648 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:53.648 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:53.649 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:49.614332+0000", 2024-09-13T06:41:53.649 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.140501107 2024-09-13T06:41:53.649 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:53.649 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:53.649 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for rw locks", 2024-09-13T06:41:53.649 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:49.614496+0000", 2024-09-13T06:41:53.649 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00016451200000000001 2024-09-13T06:41:53.649 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:53.649 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:53.649 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:53.649 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:49.617131+0000", 2024-09-13T06:41:53.649 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.002634843 2024-09-13T06:41:53.649 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:53.650 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:53.650 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:53.650 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:49.617204+0000", 2024-09-13T06:41:53.650 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.2991000000000006e-05 2024-09-13T06:41:53.650 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:53.650 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:53.650 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:53.650 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:49.619208+0000", 2024-09-13T06:41:53.650 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.002004381 2024-09-13T06:41:53.650 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:53.650 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:53.650 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:53.650 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:53.651 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:53.651 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:41:53.652 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-13T06:41:53.652 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-13T06:41:53.653 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-13T06:41:53.653 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:41:53.646+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:41:53.665 INFO:teuthology.orchestra.run.smithi081.stderr:nodeep-scrub is set 2024-09-13T06:41:53.753 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:41:53.749+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:41:53.786 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:41:53.786 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [], 2024-09-13T06:41:53.786 INFO:teuthology.orchestra.run.smithi139.stdout: "num_ops": 0 2024-09-13T06:41:53.786 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:41:53.800 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-13T06:41:53.854 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:41:53.850+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:41:53.921 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:41:53.921 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [], 2024-09-13T06:41:53.921 INFO:teuthology.orchestra.run.smithi139.stdout: "complaint_time": 30, 2024-09-13T06:41:53.921 INFO:teuthology.orchestra.run.smithi139.stdout: "num_blocked_ops": 0 2024-09-13T06:41:53.921 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:41:53.935 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-13T06:41:53.955 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:41:53.953+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:41:54.056 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:41:54.057+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:41:54.102 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:41:54.102 INFO:teuthology.orchestra.run.smithi139.stdout: "size": 20, 2024-09-13T06:41:54.102 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 600, 2024-09-13T06:41:54.102 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [ 2024-09-13T06:41:54.102 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.103 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18706 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 3346432~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:41:54.103 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.846138+0000", 2024-09-13T06:41:54.103 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 122.254092703, 2024-09-13T06:41:54.103 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.102018712, 2024-09-13T06:41:54.103 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:54.103 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:54.103 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:54.103 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:54.103 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:54.103 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18706 2024-09-13T06:41:54.103 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.103 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:54.104 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.104 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:54.104 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846138+0000", 2024-09-13T06:41:54.104 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:54.104 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.104 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.104 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:54.104 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846138+0000", 2024-09-13T06:41:54.104 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:54.104 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.104 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.104 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:54.105 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846138+0000", 2024-09-13T06:41:54.105 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:54.105 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.105 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.105 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:54.105 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846141+0000", 2024-09-13T06:41:54.105 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.6969999999999999e-06 2024-09-13T06:41:54.105 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.105 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.105 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:54.105 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846150+0000", 2024-09-13T06:41:54.105 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6400000000000003e-06 2024-09-13T06:41:54.105 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.106 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.106 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:54.106 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846160+0000", 2024-09-13T06:41:54.106 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.3999999999999998e-06 2024-09-13T06:41:54.106 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.106 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.106 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:54.106 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.947764+0000", 2024-09-13T06:41:54.106 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101604085 2024-09-13T06:41:54.106 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.106 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.106 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:54.106 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.947888+0000", 2024-09-13T06:41:54.106 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000124113 2024-09-13T06:41:54.107 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.107 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.107 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:54.107 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.948157+0000", 2024-09-13T06:41:54.107 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00026943399999999998 2024-09-13T06:41:54.107 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:54.107 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:54.107 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:54.107 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.107 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.107 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18707 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 3375104~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:41:54.107 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.846207+0000", 2024-09-13T06:41:54.107 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 122.254023937, 2024-09-13T06:41:54.107 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10238114099999999, 2024-09-13T06:41:54.108 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:54.108 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:54.108 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:54.108 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:54.108 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:54.108 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18707 2024-09-13T06:41:54.108 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.108 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:54.108 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.108 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:54.108 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846207+0000", 2024-09-13T06:41:54.108 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:54.108 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.109 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.109 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:54.109 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846207+0000", 2024-09-13T06:41:54.109 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:54.109 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.109 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.109 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:54.109 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846206+0000", 2024-09-13T06:41:54.109 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:54.109 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.109 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.109 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:54.109 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846211+0000", 2024-09-13T06:41:54.109 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.3000000000000003e-06 2024-09-13T06:41:54.110 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.110 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.110 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:54.110 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846220+0000", 2024-09-13T06:41:54.110 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6199999999999994e-06 2024-09-13T06:41:54.110 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.110 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.110 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:54.110 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846228+0000", 2024-09-13T06:41:54.110 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.7500000000000003e-06 2024-09-13T06:41:54.111 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.111 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.111 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:54.111 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.948267+0000", 2024-09-13T06:41:54.111 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10203878700000001 2024-09-13T06:41:54.111 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.111 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.111 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:54.111 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.948435+0000", 2024-09-13T06:41:54.111 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00016796500000000001 2024-09-13T06:41:54.111 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.112 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.112 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:54.112 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.948588+0000", 2024-09-13T06:41:54.112 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00015373599999999999 2024-09-13T06:41:54.112 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:54.112 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:54.112 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:54.112 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.112 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.112 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18718 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 3690496~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:41:54.112 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.850174+0000", 2024-09-13T06:41:54.112 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 122.25005678399999, 2024-09-13T06:41:54.112 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101854154, 2024-09-13T06:41:54.113 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:54.113 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:54.113 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:54.113 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:54.113 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:54.113 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18718 2024-09-13T06:41:54.113 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.113 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:54.113 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.113 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:54.113 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850174+0000", 2024-09-13T06:41:54.113 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:54.113 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.113 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.114 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:54.114 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850174+0000", 2024-09-13T06:41:54.114 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:54.114 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.114 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.114 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:54.114 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850173+0000", 2024-09-13T06:41:54.114 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:54.114 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.114 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.114 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:54.114 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850178+0000", 2024-09-13T06:41:54.114 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.4129999999999999e-06 2024-09-13T06:41:54.114 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.115 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.115 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:54.115 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850188+0000", 2024-09-13T06:41:54.115 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.8600000000000005e-06 2024-09-13T06:41:54.115 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.115 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.115 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:54.115 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850195+0000", 2024-09-13T06:41:54.115 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.8730000000000007e-06 2024-09-13T06:41:54.115 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.115 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.115 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:54.115 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.951766+0000", 2024-09-13T06:41:54.115 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.1015703 2024-09-13T06:41:54.115 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.116 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.116 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:54.116 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.951879+0000", 2024-09-13T06:41:54.116 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000112932 2024-09-13T06:41:54.116 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.116 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.116 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:54.116 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.952029+0000", 2024-09-13T06:41:54.116 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000149846 2024-09-13T06:41:54.116 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:54.116 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:54.116 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:54.116 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.116 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.117 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18719 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 3719168~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:41:54.117 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.850202+0000", 2024-09-13T06:41:54.117 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 122.25002874099999, 2024-09-13T06:41:54.117 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.102191676, 2024-09-13T06:41:54.117 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:54.117 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:54.117 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:54.117 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:54.117 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:54.117 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18719 2024-09-13T06:41:54.117 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.117 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:54.117 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.117 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:54.118 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850202+0000", 2024-09-13T06:41:54.118 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:54.118 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.118 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.118 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:54.118 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850202+0000", 2024-09-13T06:41:54.118 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:54.118 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.118 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.118 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:54.118 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850202+0000", 2024-09-13T06:41:54.118 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:54.118 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.119 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.119 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:54.119 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850205+0000", 2024-09-13T06:41:54.119 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.89e-06 2024-09-13T06:41:54.119 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.119 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.119 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:54.119 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850216+0000", 2024-09-13T06:41:54.119 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0233e-05 2024-09-13T06:41:54.119 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.119 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.119 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:54.119 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850223+0000", 2024-09-13T06:41:54.119 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5299999999999999e-06 2024-09-13T06:41:54.120 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.120 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.120 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:54.120 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.952106+0000", 2024-09-13T06:41:54.120 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10188309299999999 2024-09-13T06:41:54.120 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.120 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.120 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:54.120 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.952233+0000", 2024-09-13T06:41:54.120 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000126993 2024-09-13T06:41:54.120 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.120 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.120 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:54.121 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.952394+0000", 2024-09-13T06:41:54.121 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000160791 2024-09-13T06:41:54.121 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:54.121 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:54.121 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:54.121 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.121 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.121 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18720 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 3747840~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:41:54.121 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.850726+0000", 2024-09-13T06:41:54.121 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 122.24950491200001, 2024-09-13T06:41:54.121 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10199504299999999, 2024-09-13T06:41:54.121 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:54.121 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:54.122 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:54.122 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:54.122 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:54.122 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18720 2024-09-13T06:41:54.122 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.122 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:54.122 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.122 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:54.122 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850726+0000", 2024-09-13T06:41:54.122 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:54.122 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.122 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.122 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:54.123 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850726+0000", 2024-09-13T06:41:54.123 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:54.123 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.123 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.123 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:54.123 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850229+0000", 2024-09-13T06:41:54.123 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9995027 2024-09-13T06:41:54.123 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.123 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.123 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:54.123 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850731+0000", 2024-09-13T06:41:54.123 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00050221599999999999 2024-09-13T06:41:54.123 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.123 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.124 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:54.124 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850751+0000", 2024-09-13T06:41:54.124 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.9703000000000001e-05 2024-09-13T06:41:54.124 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.124 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.124 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:54.124 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850764+0000", 2024-09-13T06:41:54.124 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3207000000000001e-05 2024-09-13T06:41:54.124 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.124 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.124 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:54.124 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.952454+0000", 2024-09-13T06:41:54.124 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101690102 2024-09-13T06:41:54.125 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.125 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.125 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:54.125 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.952571+0000", 2024-09-13T06:41:54.125 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000116556 2024-09-13T06:41:54.125 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.125 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.125 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:54.125 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.952721+0000", 2024-09-13T06:41:54.125 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000150419 2024-09-13T06:41:54.125 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:54.125 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:54.125 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:54.126 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.126 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.126 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18730 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 4034560~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:41:54.126 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.854013+0000", 2024-09-13T06:41:54.126 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 122.24621797099999, 2024-09-13T06:41:54.126 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10186914399999999, 2024-09-13T06:41:54.126 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:54.126 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:54.126 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:54.126 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:54.126 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:54.126 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18730 2024-09-13T06:41:54.126 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.126 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:54.127 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.127 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:54.127 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.854013+0000", 2024-09-13T06:41:54.127 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:54.127 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.127 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.127 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:54.127 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.854013+0000", 2024-09-13T06:41:54.127 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:54.127 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.127 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.127 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:54.127 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.854013+0000", 2024-09-13T06:41:54.128 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:54.128 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.128 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.128 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:54.128 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.854016+0000", 2024-09-13T06:41:54.128 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.1839999999999999e-06 2024-09-13T06:41:54.128 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.128 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.128 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:54.128 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.854025+0000", 2024-09-13T06:41:54.128 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.8030000000000003e-06 2024-09-13T06:41:54.128 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.128 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.129 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:54.129 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.854033+0000", 2024-09-13T06:41:54.129 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6500000000000002e-06 2024-09-13T06:41:54.129 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.129 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.129 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:54.129 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.955546+0000", 2024-09-13T06:41:54.129 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10151296 2024-09-13T06:41:54.129 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.129 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.129 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:54.129 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.955694+0000", 2024-09-13T06:41:54.129 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000147773 2024-09-13T06:41:54.130 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.130 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.130 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:54.130 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.955882+0000", 2024-09-13T06:41:54.130 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000188371 2024-09-13T06:41:54.130 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:54.130 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:54.130 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:54.130 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.130 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.130 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18742 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 4378624~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:41:54.130 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.857984+0000", 2024-09-13T06:41:54.130 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 122.24224684799999, 2024-09-13T06:41:54.131 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10179961799999999, 2024-09-13T06:41:54.131 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:54.131 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:54.131 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:54.131 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:54.131 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:54.131 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18742 2024-09-13T06:41:54.131 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.131 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:54.131 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.131 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:54.131 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.857984+0000", 2024-09-13T06:41:54.131 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:54.132 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.132 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.132 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:54.132 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.857984+0000", 2024-09-13T06:41:54.132 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:54.132 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.132 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.132 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:54.132 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.857983+0000", 2024-09-13T06:41:54.132 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:54.132 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.132 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.132 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:54.133 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.857987+0000", 2024-09-13T06:41:54.133 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0670000000000002e-06 2024-09-13T06:41:54.133 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.133 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.133 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:54.133 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.857997+0000", 2024-09-13T06:41:54.133 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6830000000000003e-06 2024-09-13T06:41:54.133 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.133 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.133 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:54.133 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.858006+0000", 2024-09-13T06:41:54.133 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.5739999999999996e-06 2024-09-13T06:41:54.133 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.133 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.134 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:54.134 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.959453+0000", 2024-09-13T06:41:54.134 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101447339 2024-09-13T06:41:54.134 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.134 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.134 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:54.134 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.959603+0000", 2024-09-13T06:41:54.134 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000150316 2024-09-13T06:41:54.134 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.134 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.134 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:54.134 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.959784+0000", 2024-09-13T06:41:54.134 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00018065900000000001 2024-09-13T06:41:54.135 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:54.135 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:54.135 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:54.135 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.135 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.135 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18743 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 4407296~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:41:54.135 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.858012+0000", 2024-09-13T06:41:54.135 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 122.242218855, 2024-09-13T06:41:54.135 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10210024500000001, 2024-09-13T06:41:54.135 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:54.135 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:54.135 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:54.135 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:54.135 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:54.136 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18743 2024-09-13T06:41:54.136 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.136 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:54.136 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.136 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:54.136 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.858012+0000", 2024-09-13T06:41:54.136 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:54.136 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.136 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.136 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:54.136 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.858012+0000", 2024-09-13T06:41:54.136 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:54.136 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.137 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.137 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:54.137 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.858011+0000", 2024-09-13T06:41:54.137 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:54.137 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.137 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.137 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:54.137 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.858016+0000", 2024-09-13T06:41:54.137 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0659999999999997e-06 2024-09-13T06:41:54.137 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.137 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.137 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:54.137 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.858024+0000", 2024-09-13T06:41:54.137 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.7700000000000007e-06 2024-09-13T06:41:54.138 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.138 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.138 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:54.138 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.858032+0000", 2024-09-13T06:41:54.138 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.7700000000000001e-06 2024-09-13T06:41:54.138 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.138 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.138 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:54.138 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.959850+0000", 2024-09-13T06:41:54.138 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.1018182 2024-09-13T06:41:54.138 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.138 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.138 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:54.139 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.959964+0000", 2024-09-13T06:41:54.139 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00011413600000000001 2024-09-13T06:41:54.139 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.139 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.139 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:54.139 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.960113+0000", 2024-09-13T06:41:54.139 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00014813900000000001 2024-09-13T06:41:54.139 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:54.139 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:54.139 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:54.139 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.139 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.139 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18755 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 4751360~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:41:54.139 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.862061+0000", 2024-09-13T06:41:54.139 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 122.238170603, 2024-09-13T06:41:54.140 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101907023, 2024-09-13T06:41:54.140 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:54.140 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:54.140 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:54.140 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:54.140 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:54.140 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18755 2024-09-13T06:41:54.140 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.140 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:54.140 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.140 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:54.140 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862061+0000", 2024-09-13T06:41:54.140 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:54.141 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.141 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.141 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:54.141 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862061+0000", 2024-09-13T06:41:54.141 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:54.141 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.141 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.141 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:54.141 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862060+0000", 2024-09-13T06:41:54.141 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:54.141 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.141 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.141 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:54.141 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862064+0000", 2024-09-13T06:41:54.141 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.3229999999999999e-06 2024-09-13T06:41:54.142 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.142 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.142 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:54.142 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862078+0000", 2024-09-13T06:41:54.142 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.433e-05 2024-09-13T06:41:54.142 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.142 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.142 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:54.142 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862086+0000", 2024-09-13T06:41:54.142 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.3869999999999997e-06 2024-09-13T06:41:54.142 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.142 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.142 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:54.143 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.963635+0000", 2024-09-13T06:41:54.143 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101549606 2024-09-13T06:41:54.143 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.143 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.143 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:54.143 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.963783+0000", 2024-09-13T06:41:54.143 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000147312 2024-09-13T06:41:54.143 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.143 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.143 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:54.143 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.963968+0000", 2024-09-13T06:41:54.143 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000185028 2024-09-13T06:41:54.143 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:54.144 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:54.144 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:54.144 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.144 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.144 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18756 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 4780032~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:41:54.144 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.862132+0000", 2024-09-13T06:41:54.144 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 122.23809876, 2024-09-13T06:41:54.144 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.102159295, 2024-09-13T06:41:54.144 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:54.144 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:54.144 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:54.144 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:54.144 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:54.145 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18756 2024-09-13T06:41:54.145 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.145 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:54.145 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.145 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:54.145 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862132+0000", 2024-09-13T06:41:54.145 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:54.145 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.145 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.145 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:54.145 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862132+0000", 2024-09-13T06:41:54.145 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:54.145 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.145 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.146 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:54.146 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862132+0000", 2024-09-13T06:41:54.146 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:54.146 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.146 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.146 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:54.146 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862136+0000", 2024-09-13T06:41:54.146 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.9559999999999999e-06 2024-09-13T06:41:54.146 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.146 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.146 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:54.146 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862145+0000", 2024-09-13T06:41:54.146 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6169999999999996e-06 2024-09-13T06:41:54.146 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.146 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.147 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:54.147 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862153+0000", 2024-09-13T06:41:54.147 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.8359999999999992e-06 2024-09-13T06:41:54.147 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.147 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.147 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:54.147 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.964018+0000", 2024-09-13T06:41:54.147 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101865421 2024-09-13T06:41:54.147 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.147 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.147 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:54.147 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.964140+0000", 2024-09-13T06:41:54.147 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000121172 2024-09-13T06:41:54.147 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.147 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.148 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:54.148 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.964292+0000", 2024-09-13T06:41:54.148 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00015202600000000001 2024-09-13T06:41:54.148 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:54.148 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:54.148 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:54.148 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.148 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.148 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18768 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 5124096~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:41:54.148 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.866345+0000", 2024-09-13T06:41:54.148 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 122.233886453, 2024-09-13T06:41:54.148 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101779361, 2024-09-13T06:41:54.148 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:54.149 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:54.149 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:54.149 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:54.149 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:54.149 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18768 2024-09-13T06:41:54.149 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.149 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:54.149 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.149 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:54.149 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.866345+0000", 2024-09-13T06:41:54.149 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:54.149 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.149 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.149 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:54.149 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.866345+0000", 2024-09-13T06:41:54.150 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:54.150 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.150 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.150 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:54.150 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.866344+0000", 2024-09-13T06:41:54.150 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:54.150 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.150 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.150 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:54.150 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.866348+0000", 2024-09-13T06:41:54.150 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.4300000000000002e-06 2024-09-13T06:41:54.150 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.150 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.150 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:54.150 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.866356+0000", 2024-09-13T06:41:54.151 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.5930000000000006e-06 2024-09-13T06:41:54.151 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.151 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.151 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:54.151 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.866364+0000", 2024-09-13T06:41:54.151 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5599999999999996e-06 2024-09-13T06:41:54.151 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.151 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.151 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:54.151 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.967865+0000", 2024-09-13T06:41:54.151 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101501683 2024-09-13T06:41:54.151 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.151 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.152 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:54.152 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.967981+0000", 2024-09-13T06:41:54.152 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000115643 2024-09-13T06:41:54.152 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.152 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.152 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:54.152 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.968124+0000", 2024-09-13T06:41:54.152 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00014305500000000001 2024-09-13T06:41:54.152 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:54.152 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:54.152 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:54.152 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.152 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.153 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18779 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 5439488~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:41:54.153 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.869996+0000", 2024-09-13T06:41:54.153 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 122.230235568, 2024-09-13T06:41:54.153 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10189577399999999, 2024-09-13T06:41:54.153 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:54.153 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:54.153 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:54.153 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:54.153 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:54.153 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18779 2024-09-13T06:41:54.153 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.153 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:54.154 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.154 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:54.154 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.869996+0000", 2024-09-13T06:41:54.154 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:54.154 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.154 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.154 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:54.154 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.869996+0000", 2024-09-13T06:41:54.154 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:54.154 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.154 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.154 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:54.154 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.869995+0000", 2024-09-13T06:41:54.154 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:54.155 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.155 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.155 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:54.155 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.869998+0000", 2024-09-13T06:41:54.155 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.2729999999999998e-06 2024-09-13T06:41:54.155 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.155 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.155 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:54.155 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.870007+0000", 2024-09-13T06:41:54.155 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.5760000000000006e-06 2024-09-13T06:41:54.155 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.155 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.155 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:54.155 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.870014+0000", 2024-09-13T06:41:54.155 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.1400000000000002e-06 2024-09-13T06:41:54.156 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.156 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.156 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:54.156 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.971631+0000", 2024-09-13T06:41:54.156 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101617503 2024-09-13T06:41:54.156 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.156 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.156 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:54.156 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.971747+0000", 2024-09-13T06:41:54.156 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00011599600000000001 2024-09-13T06:41:54.156 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.156 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.157 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:54.157 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.971891+0000", 2024-09-13T06:41:54.157 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000143912 2024-09-13T06:41:54.157 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:54.157 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:54.157 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:54.157 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.157 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.157 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18792 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 5812224~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:41:54.157 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.874371+0000", 2024-09-13T06:41:54.157 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 122.225860438, 2024-09-13T06:41:54.157 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101736005, 2024-09-13T06:41:54.157 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:54.157 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:54.158 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:54.158 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:54.158 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:54.158 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18792 2024-09-13T06:41:54.158 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.158 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:54.158 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.158 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:54.158 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874371+0000", 2024-09-13T06:41:54.158 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:54.158 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.158 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.158 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:54.159 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874371+0000", 2024-09-13T06:41:54.159 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:54.159 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.159 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.159 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:54.159 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874370+0000", 2024-09-13T06:41:54.159 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:54.159 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.159 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.159 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:54.159 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874374+0000", 2024-09-13T06:41:54.159 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.7239999999999998e-06 2024-09-13T06:41:54.159 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.160 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.160 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:54.160 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874385+0000", 2024-09-13T06:41:54.160 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1293e-05 2024-09-13T06:41:54.160 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.160 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.160 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:54.160 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874394+0000", 2024-09-13T06:41:54.160 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.0729999999999994e-06 2024-09-13T06:41:54.160 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.160 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.160 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:54.160 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.975850+0000", 2024-09-13T06:41:54.161 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10145599700000001 2024-09-13T06:41:54.161 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.161 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.161 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:54.161 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.975963+0000", 2024-09-13T06:41:54.161 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000112689 2024-09-13T06:41:54.161 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.161 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.161 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:54.161 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.976107+0000", 2024-09-13T06:41:54.161 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000143836 2024-09-13T06:41:54.161 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:54.161 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:54.161 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:54.162 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.162 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.162 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18793 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 5840896~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:41:54.162 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.874401+0000", 2024-09-13T06:41:54.162 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 122.225830405, 2024-09-13T06:41:54.162 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.102005516, 2024-09-13T06:41:54.162 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:54.162 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:54.162 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:54.162 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:54.162 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:54.162 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18793 2024-09-13T06:41:54.162 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.162 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:54.163 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.163 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:54.163 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874401+0000", 2024-09-13T06:41:54.163 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:54.163 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.163 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.163 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:54.163 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874401+0000", 2024-09-13T06:41:54.163 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:54.163 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.163 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.163 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:54.163 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874400+0000", 2024-09-13T06:41:54.163 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:54.164 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.164 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.164 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:54.164 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874404+0000", 2024-09-13T06:41:54.164 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0069999999999999e-06 2024-09-13T06:41:54.164 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.164 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.164 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:54.164 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874412+0000", 2024-09-13T06:41:54.164 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.5399999999999996e-06 2024-09-13T06:41:54.164 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.164 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.164 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:54.164 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874420+0000", 2024-09-13T06:41:54.165 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.6199999999999999e-06 2024-09-13T06:41:54.165 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.165 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.165 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:54.165 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.976150+0000", 2024-09-13T06:41:54.165 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101729874 2024-09-13T06:41:54.165 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.165 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.165 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:54.165 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.976261+0000", 2024-09-13T06:41:54.165 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000110819 2024-09-13T06:41:54.165 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.165 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.166 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:54.166 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.976406+0000", 2024-09-13T06:41:54.166 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000145489 2024-09-13T06:41:54.166 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:54.166 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:54.166 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:54.166 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.166 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.166 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18803 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 6127616~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:41:54.166 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.877851+0000", 2024-09-13T06:41:54.166 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 122.22237991199999, 2024-09-13T06:41:54.166 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101951584, 2024-09-13T06:41:54.166 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:54.166 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:54.166 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:54.167 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:54.167 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:54.167 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18803 2024-09-13T06:41:54.167 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.167 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:54.167 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.167 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:54.167 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.877851+0000", 2024-09-13T06:41:54.167 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:54.167 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.167 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.167 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:54.167 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.877851+0000", 2024-09-13T06:41:54.167 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:54.168 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.168 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.168 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:54.168 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.877851+0000", 2024-09-13T06:41:54.168 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:54.168 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.168 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.168 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:54.168 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.877854+0000", 2024-09-13T06:41:54.168 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.7929999999999999e-06 2024-09-13T06:41:54.168 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.168 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.168 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:54.169 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.877864+0000", 2024-09-13T06:41:54.169 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.2029999999999998e-06 2024-09-13T06:41:54.169 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.169 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.169 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:54.169 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.877873+0000", 2024-09-13T06:41:54.169 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.0440000000000001e-06 2024-09-13T06:41:54.169 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.169 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.169 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:54.169 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.979544+0000", 2024-09-13T06:41:54.169 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101671198 2024-09-13T06:41:54.169 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.170 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.170 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:54.170 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.979658+0000", 2024-09-13T06:41:54.170 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000114456 2024-09-13T06:41:54.170 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.170 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.170 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:54.170 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.979803+0000", 2024-09-13T06:41:54.170 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000144506 2024-09-13T06:41:54.170 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:54.170 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:54.170 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:54.170 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.170 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.171 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18807 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 6242304~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:41:54.171 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.879235+0000", 2024-09-13T06:41:54.171 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 122.220995882, 2024-09-13T06:41:54.171 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101781258, 2024-09-13T06:41:54.171 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:54.171 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:54.171 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:54.171 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:54.171 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:54.171 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18807 2024-09-13T06:41:54.171 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.171 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:54.171 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.171 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:54.172 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879235+0000", 2024-09-13T06:41:54.172 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:54.172 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.172 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.172 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:54.172 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879235+0000", 2024-09-13T06:41:54.172 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:54.172 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.172 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.172 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:54.172 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879235+0000", 2024-09-13T06:41:54.172 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:54.172 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.172 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.172 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:54.173 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879239+0000", 2024-09-13T06:41:54.173 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.963e-06 2024-09-13T06:41:54.173 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.173 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.173 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:54.173 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879247+0000", 2024-09-13T06:41:54.173 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6470000000000004e-06 2024-09-13T06:41:54.173 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.173 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.173 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:54.173 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879255+0000", 2024-09-13T06:41:54.173 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5429999999999996e-06 2024-09-13T06:41:54.173 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.173 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.173 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:54.174 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.980756+0000", 2024-09-13T06:41:54.174 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10150165999999999 2024-09-13T06:41:54.174 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.174 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.174 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:54.174 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.980868+0000", 2024-09-13T06:41:54.174 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000111196 2024-09-13T06:41:54.174 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.174 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.174 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:54.174 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.981017+0000", 2024-09-13T06:41:54.174 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000148846 2024-09-13T06:41:54.174 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:54.174 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:54.174 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:54.175 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.175 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.175 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18808 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 6270976~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:41:54.175 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.879261+0000", 2024-09-13T06:41:54.175 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 122.220969743, 2024-09-13T06:41:54.175 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.102057547, 2024-09-13T06:41:54.175 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:54.175 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:54.175 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:54.175 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:54.175 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:54.175 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18808 2024-09-13T06:41:54.175 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.175 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:54.175 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.176 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:54.176 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879261+0000", 2024-09-13T06:41:54.176 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:54.176 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.176 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.176 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:54.176 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879261+0000", 2024-09-13T06:41:54.176 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:54.176 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.176 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.176 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:54.176 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879261+0000", 2024-09-13T06:41:54.176 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:54.176 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.177 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.177 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:54.177 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879264+0000", 2024-09-13T06:41:54.177 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.523e-06 2024-09-13T06:41:54.177 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.177 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.177 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:54.177 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879273+0000", 2024-09-13T06:41:54.177 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6070000000000008e-06 2024-09-13T06:41:54.177 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.177 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.177 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:54.177 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879280+0000", 2024-09-13T06:41:54.178 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.4699999999999996e-06 2024-09-13T06:41:54.178 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.178 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.178 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:54.178 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.981060+0000", 2024-09-13T06:41:54.178 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10177934800000001 2024-09-13T06:41:54.178 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.178 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.178 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:54.178 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.981174+0000", 2024-09-13T06:41:54.178 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000114456 2024-09-13T06:41:54.178 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.178 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.178 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:54.179 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.981319+0000", 2024-09-13T06:41:54.179 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00014473900000000001 2024-09-13T06:41:54.179 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:54.179 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:54.179 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:54.179 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.179 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.179 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18810 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 2662400~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:41:54.179 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.880386+0000", 2024-09-13T06:41:54.179 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 122.219845581, 2024-09-13T06:41:54.179 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101728022, 2024-09-13T06:41:54.179 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:54.179 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:54.179 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:54.180 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:54.180 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:54.180 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18810 2024-09-13T06:41:54.180 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.180 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:54.180 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.180 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:54.180 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880386+0000", 2024-09-13T06:41:54.180 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:54.180 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.180 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.180 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:54.180 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880386+0000", 2024-09-13T06:41:54.181 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:54.181 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.181 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.181 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:54.181 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880385+0000", 2024-09-13T06:41:54.181 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:54.181 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.181 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.181 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:54.181 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880389+0000", 2024-09-13T06:41:54.181 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.8539999999999999e-06 2024-09-13T06:41:54.181 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.181 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.181 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:54.181 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880398+0000", 2024-09-13T06:41:54.182 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.1689999999999998e-06 2024-09-13T06:41:54.182 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.182 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.182 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:54.182 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880405+0000", 2024-09-13T06:41:54.182 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5700000000000004e-06 2024-09-13T06:41:54.182 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.182 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.182 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:54.182 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.981833+0000", 2024-09-13T06:41:54.182 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10142791800000001 2024-09-13T06:41:54.182 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.182 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.182 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:54.182 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.981973+0000", 2024-09-13T06:41:54.183 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00014002900000000001 2024-09-13T06:41:54.183 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.183 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.183 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:54.183 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.982114+0000", 2024-09-13T06:41:54.183 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000140276 2024-09-13T06:41:54.183 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:54.183 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:54.183 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:54.183 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.183 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.183 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18811 3.9 3.140f5209 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:41:54.183 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.880449+0000", 2024-09-13T06:41:54.184 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 122.219782205, 2024-09-13T06:41:54.184 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101739355, 2024-09-13T06:41:54.184 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:54.184 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:41:54.184 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:54.184 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:54.184 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:54.184 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18811 2024-09-13T06:41:54.184 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.184 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:54.184 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.184 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:54.184 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880449+0000", 2024-09-13T06:41:54.185 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:54.185 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.185 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.185 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:54.185 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880449+0000", 2024-09-13T06:41:54.185 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:54.185 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.185 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.185 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:54.185 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880448+0000", 2024-09-13T06:41:54.185 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:54.185 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.185 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.186 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:54.186 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880452+0000", 2024-09-13T06:41:54.186 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0470000000000004e-06 2024-09-13T06:41:54.186 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.186 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.186 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:54.186 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880462+0000", 2024-09-13T06:41:54.186 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6530000000000006e-06 2024-09-13T06:41:54.186 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.186 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.186 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:54.186 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880472+0000", 2024-09-13T06:41:54.186 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0027000000000001e-05 2024-09-13T06:41:54.186 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.187 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.187 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:54.187 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.982172+0000", 2024-09-13T06:41:54.187 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10170043500000001 2024-09-13T06:41:54.187 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.187 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.187 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:54.187 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.982188+0000", 2024-09-13T06:41:54.187 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6172999999999999e-05 2024-09-13T06:41:54.187 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:54.187 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:54.187 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:54.187 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.188 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.188 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18812 3.9 3.140f5209 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:41:54.188 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.880478+0000", 2024-09-13T06:41:54.188 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 122.21975296799999, 2024-09-13T06:41:54.188 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10177795100000001, 2024-09-13T06:41:54.188 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:54.188 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:41:54.188 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:54.188 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:54.188 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:54.188 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18812 2024-09-13T06:41:54.188 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.188 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:54.189 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.189 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:54.189 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880478+0000", 2024-09-13T06:41:54.189 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:54.189 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.189 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.189 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:54.189 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880478+0000", 2024-09-13T06:41:54.189 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:54.189 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.189 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.189 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:54.190 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880477+0000", 2024-09-13T06:41:54.190 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:54.190 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.190 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.190 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:54.190 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880481+0000", 2024-09-13T06:41:54.190 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.827e-06 2024-09-13T06:41:54.190 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.190 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.190 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:54.190 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880490+0000", 2024-09-13T06:41:54.190 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6100000000000006e-06 2024-09-13T06:41:54.190 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.190 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.191 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:54.191 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880497+0000", 2024-09-13T06:41:54.191 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.7030000000000006e-06 2024-09-13T06:41:54.191 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.191 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.191 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:54.191 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.982241+0000", 2024-09-13T06:41:54.191 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10174351199999999 2024-09-13T06:41:54.191 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.191 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.191 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:54.191 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.982256+0000", 2024-09-13T06:41:54.191 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5143000000000001e-05 2024-09-13T06:41:54.191 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:54.192 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:54.192 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:54.192 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:54.192 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:54.192 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:41:54.194 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-13T06:41:54.194 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:41:54.189+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:41:54.295 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:41:54.293+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:41:54.319 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:41:54.320 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [], 2024-09-13T06:41:54.320 INFO:teuthology.orchestra.run.smithi139.stdout: "num_ops": 0 2024-09-13T06:41:54.320 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:41:54.334 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-13T06:41:54.396 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:41:54.393+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:41:54.449 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:41:54.450 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [], 2024-09-13T06:41:54.450 INFO:teuthology.orchestra.run.smithi139.stdout: "complaint_time": 30, 2024-09-13T06:41:54.450 INFO:teuthology.orchestra.run.smithi139.stdout: "num_blocked_ops": 0 2024-09-13T06:41:54.450 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:41:54.464 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-13T06:41:54.497 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:41:54.497+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:41:54.589 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:41:54.589 INFO:teuthology.orchestra.run.smithi139.stdout: "size": 20, 2024-09-13T06:41:54.590 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 600, 2024-09-13T06:41:54.590 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [ 2024-09-13T06:41:54.590 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.590 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43282 3.1d 3:bd80bfb3:::rbd_object_map.11212f44bfb1.0000000000000020:head [call rbd.object_map_update in=20b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:54.590 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589032+0000", 2024-09-13T06:41:54.590 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 92.998112359000004, 2024-09-13T06:41:54.590 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.076225263000000001, 2024-09-13T06:41:54.590 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:54.590 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:41:54.590 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:54.590 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:54.590 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:54.591 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43282 2024-09-13T06:41:54.591 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.591 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:54.591 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.591 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:54.591 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589032+0000", 2024-09-13T06:41:54.591 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:54.591 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.591 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.591 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:54.591 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589032+0000", 2024-09-13T06:41:54.591 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:54.591 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.592 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.592 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:54.592 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589031+0000", 2024-09-13T06:41:54.592 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:54.592 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.592 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.592 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:54.592 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589036+0000", 2024-09-13T06:41:54.592 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.2619999999999998e-06 2024-09-13T06:41:54.592 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.592 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.592 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:54.593 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589046+0000", 2024-09-13T06:41:54.593 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.8099999999999992e-06 2024-09-13T06:41:54.593 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.593 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.593 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:54.593 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589054+0000", 2024-09-13T06:41:54.593 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.2230000000000007e-06 2024-09-13T06:41:54.593 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.593 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.593 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:54.593 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.660691+0000", 2024-09-13T06:41:54.593 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.07163659 2024-09-13T06:41:54.593 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.594 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.594 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:54.594 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.660850+0000", 2024-09-13T06:41:54.594 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00015864300000000001 2024-09-13T06:41:54.594 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.594 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.594 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 4", 2024-09-13T06:41:54.594 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.661729+0000", 2024-09-13T06:41:54.595 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00087956099999999995 2024-09-13T06:41:54.595 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.595 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.595 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:41:54.595 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.664409+0000", 2024-09-13T06:41:54.595 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0026803479999999999 2024-09-13T06:41:54.595 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.595 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.595 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-13T06:41:54.595 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.665088+0000", 2024-09-13T06:41:54.595 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00067901400000000003 2024-09-13T06:41:54.595 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.595 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.596 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-13T06:41:54.596 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.665181+0000", 2024-09-13T06:41:54.596 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.2050000000000001e-05 2024-09-13T06:41:54.596 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.596 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.596 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:54.596 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.665257+0000", 2024-09-13T06:41:54.596 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.6698000000000003e-05 2024-09-13T06:41:54.596 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:54.596 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:54.596 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:54.596 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.596 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.597 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43290 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 299008~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:54.597 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589500+0000", 2024-09-13T06:41:54.597 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 92.997644197, 2024-09-13T06:41:54.597 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.075898564000000002, 2024-09-13T06:41:54.597 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:54.597 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:54.597 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:54.597 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:54.597 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:54.597 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43290 2024-09-13T06:41:54.597 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.597 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:54.597 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.598 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:54.598 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589500+0000", 2024-09-13T06:41:54.598 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:54.598 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.598 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.598 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:54.598 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589500+0000", 2024-09-13T06:41:54.598 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:54.598 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.598 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.598 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:54.598 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589499+0000", 2024-09-13T06:41:54.598 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:54.598 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.599 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.599 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:54.599 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589503+0000", 2024-09-13T06:41:54.599 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.8330000000000004e-06 2024-09-13T06:41:54.599 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.599 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.599 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:54.599 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589511+0000", 2024-09-13T06:41:54.599 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.3359999999999995e-06 2024-09-13T06:41:54.599 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.599 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.599 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:54.599 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589519+0000", 2024-09-13T06:41:54.600 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.4760000000000001e-06 2024-09-13T06:41:54.600 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.600 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.600 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:54.600 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.665097+0000", 2024-09-13T06:41:54.600 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.075577828999999999 2024-09-13T06:41:54.600 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.600 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.600 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:54.600 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.665170+0000", 2024-09-13T06:41:54.600 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.3745000000000006e-05 2024-09-13T06:41:54.600 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.600 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.601 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:54.601 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.665399+0000", 2024-09-13T06:41:54.601 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00022826199999999999 2024-09-13T06:41:54.601 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:54.601 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:54.601 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:54.601 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.601 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.601 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43291 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 313344~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:54.601 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589560+0000", 2024-09-13T06:41:54.601 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 92.997583976000001, 2024-09-13T06:41:54.601 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.076145594999999996, 2024-09-13T06:41:54.601 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:54.602 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:54.602 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:54.602 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:54.602 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:54.602 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43291 2024-09-13T06:41:54.602 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.602 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:54.602 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.602 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:54.602 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589560+0000", 2024-09-13T06:41:54.602 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:54.602 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.602 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.602 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:54.603 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589560+0000", 2024-09-13T06:41:54.603 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:54.603 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.603 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.603 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:54.603 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589559+0000", 2024-09-13T06:41:54.603 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:54.603 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.603 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.603 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:54.603 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589564+0000", 2024-09-13T06:41:54.603 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.3989999999999997e-06 2024-09-13T06:41:54.603 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.604 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.604 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:54.604 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589574+0000", 2024-09-13T06:41:54.604 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0502999999999999e-05 2024-09-13T06:41:54.604 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.604 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.604 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:54.604 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589582+0000", 2024-09-13T06:41:54.604 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.1859999999999992e-06 2024-09-13T06:41:54.604 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.604 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.604 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:54.604 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.665423+0000", 2024-09-13T06:41:54.605 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.075840290000000005 2024-09-13T06:41:54.605 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.605 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.605 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:54.605 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.665496+0000", 2024-09-13T06:41:54.605 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.2791000000000002e-05 2024-09-13T06:41:54.605 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.605 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.605 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:54.605 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.665706+0000", 2024-09-13T06:41:54.605 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00021038200000000001 2024-09-13T06:41:54.605 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:54.605 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:54.606 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:54.606 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.606 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.606 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43292 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 327680~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:54.606 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589589+0000", 2024-09-13T06:41:54.606 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 92.997555434999995, 2024-09-13T06:41:54.606 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.076769537999999998, 2024-09-13T06:41:54.606 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:54.606 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:54.606 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:54.606 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:54.606 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:54.606 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43292 2024-09-13T06:41:54.606 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.607 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:54.607 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.607 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:54.607 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589589+0000", 2024-09-13T06:41:54.607 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:54.607 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.607 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.607 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:54.607 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589589+0000", 2024-09-13T06:41:54.607 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:54.607 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.607 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.607 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:54.608 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589588+0000", 2024-09-13T06:41:54.608 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:54.608 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.608 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.608 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:54.608 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589592+0000", 2024-09-13T06:41:54.608 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.6389999999999998e-06 2024-09-13T06:41:54.608 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.608 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.608 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:54.608 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589600+0000", 2024-09-13T06:41:54.608 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.4630000000000001e-06 2024-09-13T06:41:54.608 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.609 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.609 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:54.609 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589608+0000", 2024-09-13T06:41:54.609 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.2359999999999998e-06 2024-09-13T06:41:54.609 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.609 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.609 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:54.609 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.665779+0000", 2024-09-13T06:41:54.609 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.076170924000000001 2024-09-13T06:41:54.609 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.609 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.609 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:54.609 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.665977+0000", 2024-09-13T06:41:54.609 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00019891900000000001 2024-09-13T06:41:54.610 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.610 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.610 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:54.610 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.666358+0000", 2024-09-13T06:41:54.610 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000380963 2024-09-13T06:41:54.610 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:54.610 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:54.610 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:54.610 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.610 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.610 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43293 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 342016~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:54.610 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589616+0000", 2024-09-13T06:41:54.610 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 92.997528540999994, 2024-09-13T06:41:54.611 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.077030083999999999, 2024-09-13T06:41:54.611 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:54.611 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:54.611 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:54.611 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:54.611 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:54.611 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43293 2024-09-13T06:41:54.611 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.611 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:54.611 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.611 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:54.611 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589616+0000", 2024-09-13T06:41:54.611 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:54.611 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.612 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.612 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:54.612 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589616+0000", 2024-09-13T06:41:54.612 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:54.612 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.612 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.612 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:54.612 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589615+0000", 2024-09-13T06:41:54.612 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:54.612 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.612 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.612 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:54.613 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589619+0000", 2024-09-13T06:41:54.613 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.9559999999999999e-06 2024-09-13T06:41:54.613 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.613 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.613 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:54.613 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589627+0000", 2024-09-13T06:41:54.613 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.2490000000000001e-06 2024-09-13T06:41:54.613 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.613 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.613 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:54.613 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589635+0000", 2024-09-13T06:41:54.613 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.96e-06 2024-09-13T06:41:54.613 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.613 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.614 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:54.614 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.666379+0000", 2024-09-13T06:41:54.614 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.076744484000000002 2024-09-13T06:41:54.614 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.614 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.614 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:54.614 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.666454+0000", 2024-09-13T06:41:54.614 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.4623999999999996e-05 2024-09-13T06:41:54.614 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.614 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.614 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:54.614 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.666646+0000", 2024-09-13T06:41:54.614 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00019176999999999999 2024-09-13T06:41:54.614 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:54.615 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:54.615 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:54.615 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.615 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.615 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43294 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 356352~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:54.615 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589681+0000", 2024-09-13T06:41:54.615 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 92.997463225999994, 2024-09-13T06:41:54.615 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.077594648000000002, 2024-09-13T06:41:54.615 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:54.615 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:54.615 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:54.615 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:54.615 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:54.615 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43294 2024-09-13T06:41:54.615 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.616 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:54.616 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.616 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:54.616 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589681+0000", 2024-09-13T06:41:54.616 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:54.616 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.616 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.616 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:54.616 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589681+0000", 2024-09-13T06:41:54.616 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:54.616 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.616 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.616 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:54.616 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589680+0000", 2024-09-13T06:41:54.617 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:54.617 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.617 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.617 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:54.617 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589684+0000", 2024-09-13T06:41:54.617 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.8369999999999999e-06 2024-09-13T06:41:54.617 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.617 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.617 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:54.617 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589693+0000", 2024-09-13T06:41:54.617 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.1020000000000003e-06 2024-09-13T06:41:54.617 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.617 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.618 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:54.618 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589701+0000", 2024-09-13T06:41:54.618 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.8059999999999995e-06 2024-09-13T06:41:54.618 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.618 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.618 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:54.618 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.666714+0000", 2024-09-13T06:41:54.618 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.077013463000000004 2024-09-13T06:41:54.618 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.618 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.618 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:54.618 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.666897+0000", 2024-09-13T06:41:54.618 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000182268 2024-09-13T06:41:54.618 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.619 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.619 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:54.619 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.667276+0000", 2024-09-13T06:41:54.619 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00037907499999999998 2024-09-13T06:41:54.619 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:54.619 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:54.619 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:54.619 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.619 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.619 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43295 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 370688~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:54.619 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589744+0000", 2024-09-13T06:41:54.619 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 92.997400053999996, 2024-09-13T06:41:54.619 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.077854343000000006, 2024-09-13T06:41:54.620 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:54.620 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:54.620 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:54.620 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:54.620 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:54.620 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43295 2024-09-13T06:41:54.620 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.620 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:54.620 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.620 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:54.620 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589744+0000", 2024-09-13T06:41:54.620 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:54.620 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.620 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.621 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:54.621 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589744+0000", 2024-09-13T06:41:54.621 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:54.621 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.621 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.621 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:54.621 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589743+0000", 2024-09-13T06:41:54.621 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:54.621 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.621 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.621 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:54.621 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589747+0000", 2024-09-13T06:41:54.621 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0130000000000004e-06 2024-09-13T06:41:54.621 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.622 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.622 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:54.622 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589756+0000", 2024-09-13T06:41:54.622 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.003e-06 2024-09-13T06:41:54.622 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.622 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.622 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:54.622 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589766+0000", 2024-09-13T06:41:54.622 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.2820000000000002e-06 2024-09-13T06:41:54.622 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.622 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.622 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:54.622 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.667300+0000", 2024-09-13T06:41:54.623 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.077534299000000001 2024-09-13T06:41:54.623 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.623 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.623 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:54.623 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.667372+0000", 2024-09-13T06:41:54.623 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.2393999999999998e-05 2024-09-13T06:41:54.623 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.623 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.623 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:54.623 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.667599+0000", 2024-09-13T06:41:54.623 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000226269 2024-09-13T06:41:54.623 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:54.623 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:54.624 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:54.624 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.624 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.624 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43296 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 385024~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:54.624 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589772+0000", 2024-09-13T06:41:54.624 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 92.997372029999994, 2024-09-13T06:41:54.624 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.078469647000000003, 2024-09-13T06:41:54.624 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:54.624 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:54.624 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:54.624 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:54.624 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:54.624 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43296 2024-09-13T06:41:54.624 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.625 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:54.625 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.625 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:54.625 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589772+0000", 2024-09-13T06:41:54.625 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:54.625 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.625 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.625 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:54.625 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589772+0000", 2024-09-13T06:41:54.625 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:54.625 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.625 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.625 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:54.626 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589771+0000", 2024-09-13T06:41:54.626 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:54.626 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.626 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.626 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:54.626 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589775+0000", 2024-09-13T06:41:54.626 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.8530000000000002e-06 2024-09-13T06:41:54.626 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.626 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.626 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:54.626 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589784+0000", 2024-09-13T06:41:54.626 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.4300000000000006e-06 2024-09-13T06:41:54.626 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.626 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.627 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:54.627 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589791+0000", 2024-09-13T06:41:54.627 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.4660000000000002e-06 2024-09-13T06:41:54.627 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.627 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.627 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:54.627 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.667667+0000", 2024-09-13T06:41:54.627 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.077875697999999993 2024-09-13T06:41:54.627 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.627 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.627 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:54.627 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.667854+0000", 2024-09-13T06:41:54.627 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00018760099999999999 2024-09-13T06:41:54.627 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.628 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.628 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:54.628 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.668242+0000", 2024-09-13T06:41:54.628 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00038750600000000003 2024-09-13T06:41:54.628 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:54.628 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:54.628 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:54.628 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.628 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.628 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43297 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 403456~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:54.628 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589797+0000", 2024-09-13T06:41:54.628 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 92.997347325999996, 2024-09-13T06:41:54.628 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.078756672999999999, 2024-09-13T06:41:54.629 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:54.629 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:54.629 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:54.629 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:54.629 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:54.629 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43297 2024-09-13T06:41:54.629 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.629 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:54.629 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.629 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:54.629 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589797+0000", 2024-09-13T06:41:54.629 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:54.629 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.629 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.630 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:54.630 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589797+0000", 2024-09-13T06:41:54.630 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:54.630 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.630 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.630 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:54.630 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589796+0000", 2024-09-13T06:41:54.630 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:54.630 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.630 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.630 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:54.630 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589800+0000", 2024-09-13T06:41:54.630 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.3230000000000002e-06 2024-09-13T06:41:54.631 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.631 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.631 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:54.631 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589808+0000", 2024-09-13T06:41:54.631 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.2390000000000002e-06 2024-09-13T06:41:54.631 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.631 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.631 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:54.631 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589815+0000", 2024-09-13T06:41:54.631 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.413e-06 2024-09-13T06:41:54.631 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.631 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.631 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:54.632 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.668265+0000", 2024-09-13T06:41:54.632 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.078449873000000003 2024-09-13T06:41:54.632 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.632 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.632 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:54.632 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.668332+0000", 2024-09-13T06:41:54.632 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.7178e-05 2024-09-13T06:41:54.632 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.632 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.632 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:54.632 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.668554+0000", 2024-09-13T06:41:54.632 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00022128600000000001 2024-09-13T06:41:54.632 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:54.633 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:54.633 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:54.633 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.633 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.633 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43298 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 417792~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:54.633 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589821+0000", 2024-09-13T06:41:54.633 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 92.997323203999997, 2024-09-13T06:41:54.633 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.079368660999999993, 2024-09-13T06:41:54.633 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:54.633 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:54.633 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:54.633 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:54.634 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:54.634 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43298 2024-09-13T06:41:54.634 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.634 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:54.634 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.634 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:54.634 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589821+0000", 2024-09-13T06:41:54.634 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:54.634 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.634 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.634 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:54.634 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589821+0000", 2024-09-13T06:41:54.635 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:54.635 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.635 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.635 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:54.635 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589821+0000", 2024-09-13T06:41:54.635 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:54.635 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.635 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.635 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:54.635 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589830+0000", 2024-09-13T06:41:54.635 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.4860000000000003e-06 2024-09-13T06:41:54.635 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.635 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.635 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:54.636 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589839+0000", 2024-09-13T06:41:54.636 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.0159999999999997e-06 2024-09-13T06:41:54.636 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.636 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.636 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:54.636 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589847+0000", 2024-09-13T06:41:54.636 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.6059999999999997e-06 2024-09-13T06:41:54.636 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.636 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.636 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:54.636 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.668620+0000", 2024-09-13T06:41:54.636 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.078773485000000004 2024-09-13T06:41:54.636 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.637 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.637 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:54.637 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.668798+0000", 2024-09-13T06:41:54.637 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000178233 2024-09-13T06:41:54.637 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.637 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.637 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:54.637 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.669190+0000", 2024-09-13T06:41:54.637 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00039143499999999998 2024-09-13T06:41:54.637 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:54.637 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:54.637 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:54.637 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.638 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.638 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43299 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 432128~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:54.638 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589881+0000", 2024-09-13T06:41:54.638 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 92.997263356000005, 2024-09-13T06:41:54.638 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.079693849999999997, 2024-09-13T06:41:54.638 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:54.638 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:54.638 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:54.638 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:54.638 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:54.638 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43299 2024-09-13T06:41:54.638 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.638 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:54.638 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.639 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:54.639 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589881+0000", 2024-09-13T06:41:54.639 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:54.639 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.639 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.639 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:54.639 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589881+0000", 2024-09-13T06:41:54.639 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:54.639 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.639 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.639 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:54.639 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589880+0000", 2024-09-13T06:41:54.639 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:54.640 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.640 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.640 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:54.640 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589884+0000", 2024-09-13T06:41:54.640 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.053e-06 2024-09-13T06:41:54.640 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.640 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.640 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:54.640 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589893+0000", 2024-09-13T06:41:54.640 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.2129999999999997e-06 2024-09-13T06:41:54.640 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.640 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.640 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:54.640 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589901+0000", 2024-09-13T06:41:54.641 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.6399999999999997e-06 2024-09-13T06:41:54.641 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.641 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.641 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:54.641 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.669213+0000", 2024-09-13T06:41:54.641 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.079312074999999996 2024-09-13T06:41:54.641 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.641 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.641 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:54.641 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.669281+0000", 2024-09-13T06:41:54.641 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.8322000000000001e-05 2024-09-13T06:41:54.641 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.642 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.642 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:54.642 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.669575+0000", 2024-09-13T06:41:54.642 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00029349699999999999 2024-09-13T06:41:54.642 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:54.642 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:54.642 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:54.642 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.642 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.642 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43300 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 446464~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:54.642 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589909+0000", 2024-09-13T06:41:54.642 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 92.997235461000002, 2024-09-13T06:41:54.642 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.080339496999999996, 2024-09-13T06:41:54.642 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:54.643 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:54.643 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:54.643 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:54.643 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:54.643 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43300 2024-09-13T06:41:54.643 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.643 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:54.643 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.643 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:54.643 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589909+0000", 2024-09-13T06:41:54.643 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:54.643 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.643 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.643 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:54.644 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589909+0000", 2024-09-13T06:41:54.644 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:54.644 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.644 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.644 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:54.644 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589908+0000", 2024-09-13T06:41:54.644 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:54.644 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.644 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.644 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:54.644 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589912+0000", 2024-09-13T06:41:54.644 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.9430000000000002e-06 2024-09-13T06:41:54.644 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.645 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.645 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:54.645 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589920+0000", 2024-09-13T06:41:54.645 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.3860000000000007e-06 2024-09-13T06:41:54.645 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.645 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.645 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:54.645 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589928+0000", 2024-09-13T06:41:54.645 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.3329999999999999e-06 2024-09-13T06:41:54.645 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.645 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.645 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:54.645 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.669651+0000", 2024-09-13T06:41:54.646 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.079723204000000006 2024-09-13T06:41:54.646 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.646 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.646 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:54.646 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.669840+0000", 2024-09-13T06:41:54.646 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000189397 2024-09-13T06:41:54.646 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.646 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.646 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:54.646 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.670248+0000", 2024-09-13T06:41:54.646 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00040811100000000001 2024-09-13T06:41:54.646 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:54.646 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:54.646 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:54.646 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.647 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.647 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43301 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 460800~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:54.647 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589934+0000", 2024-09-13T06:41:54.647 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 92.997210787, 2024-09-13T06:41:54.647 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.080747474999999999, 2024-09-13T06:41:54.647 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:54.647 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:54.647 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:54.647 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:54.647 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:54.647 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43301 2024-09-13T06:41:54.647 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.647 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:54.648 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.648 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:54.648 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589934+0000", 2024-09-13T06:41:54.648 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:54.648 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.648 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.648 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:54.648 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589934+0000", 2024-09-13T06:41:54.648 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:54.648 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.648 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.648 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:54.648 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589933+0000", 2024-09-13T06:41:54.649 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:54.649 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.649 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.649 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:54.649 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589936+0000", 2024-09-13T06:41:54.649 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.4599999999999999e-06 2024-09-13T06:41:54.649 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.649 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.649 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:54.649 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589945+0000", 2024-09-13T06:41:54.649 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.2430000000000005e-06 2024-09-13T06:41:54.649 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.650 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.650 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:54.650 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589952+0000", 2024-09-13T06:41:54.650 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.3289999999999996e-06 2024-09-13T06:41:54.650 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.650 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.650 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:54.650 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.670280+0000", 2024-09-13T06:41:54.650 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.080328514000000004 2024-09-13T06:41:54.650 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.650 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.650 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:54.650 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.670376+0000", 2024-09-13T06:41:54.651 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.5752000000000001e-05 2024-09-13T06:41:54.651 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.651 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.651 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:54.651 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.670681+0000", 2024-09-13T06:41:54.651 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00030479699999999999 2024-09-13T06:41:54.651 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:54.651 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:54.651 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:54.651 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.651 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.651 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43302 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 475136~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:54.651 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589958+0000", 2024-09-13T06:41:54.652 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 92.997186725000006, 2024-09-13T06:41:54.652 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.081402394000000003, 2024-09-13T06:41:54.652 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:54.652 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:54.652 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:54.652 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:54.652 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:54.652 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43302 2024-09-13T06:41:54.652 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.652 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:54.652 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.652 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:54.652 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589958+0000", 2024-09-13T06:41:54.653 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:54.653 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.653 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.653 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:54.653 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589958+0000", 2024-09-13T06:41:54.653 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:54.653 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.653 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.653 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:54.653 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589957+0000", 2024-09-13T06:41:54.653 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:54.653 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.654 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.654 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:54.654 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589960+0000", 2024-09-13T06:41:54.654 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.4939999999999999e-06 2024-09-13T06:41:54.654 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.654 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.654 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:54.654 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589969+0000", 2024-09-13T06:41:54.654 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.3520000000000007e-06 2024-09-13T06:41:54.654 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.654 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.654 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:54.654 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589976+0000", 2024-09-13T06:41:54.655 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.3030000000000002e-06 2024-09-13T06:41:54.655 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.655 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.655 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:54.655 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.670765+0000", 2024-09-13T06:41:54.655 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.080789154000000002 2024-09-13T06:41:54.655 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.655 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.655 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:54.655 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.670960+0000", 2024-09-13T06:41:54.655 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00019464300000000001 2024-09-13T06:41:54.655 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.655 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.655 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:54.656 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.671360+0000", 2024-09-13T06:41:54.656 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00040005200000000002 2024-09-13T06:41:54.656 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:54.656 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:54.656 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:54.656 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.656 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.656 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43303 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 489472~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:54.656 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589985+0000", 2024-09-13T06:41:54.656 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 92.997159776999993, 2024-09-13T06:41:54.656 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.082024333000000005, 2024-09-13T06:41:54.656 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:54.656 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:54.657 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:54.657 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:54.657 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:54.657 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43303 2024-09-13T06:41:54.657 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.657 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:54.657 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.657 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:54.657 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589985+0000", 2024-09-13T06:41:54.657 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:54.657 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.657 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.657 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:54.658 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589985+0000", 2024-09-13T06:41:54.658 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:54.658 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.658 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.658 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:54.658 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589984+0000", 2024-09-13T06:41:54.658 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:54.658 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.658 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.658 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:54.658 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589987+0000", 2024-09-13T06:41:54.658 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.726e-06 2024-09-13T06:41:54.658 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.658 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.659 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:54.659 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589996+0000", 2024-09-13T06:41:54.659 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.5459999999999992e-06 2024-09-13T06:41:54.659 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.659 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.659 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:54.659 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590003+0000", 2024-09-13T06:41:54.659 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.4229999999999999e-06 2024-09-13T06:41:54.659 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.659 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.659 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:54.659 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.671426+0000", 2024-09-13T06:41:54.659 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.081422704999999998 2024-09-13T06:41:54.660 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.660 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.660 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:54.660 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.671615+0000", 2024-09-13T06:41:54.660 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000188875 2024-09-13T06:41:54.660 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.660 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.660 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:54.660 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.672009+0000", 2024-09-13T06:41:54.660 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000394015 2024-09-13T06:41:54.660 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:54.660 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:54.660 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:54.660 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.661 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.661 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43304 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 503808~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:54.661 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.590039+0000", 2024-09-13T06:41:54.661 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 92.997105231999996, 2024-09-13T06:41:54.661 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.082573880000000002, 2024-09-13T06:41:54.661 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:54.661 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:54.661 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:54.661 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:54.661 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:54.661 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43304 2024-09-13T06:41:54.661 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.662 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:54.662 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.662 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:54.662 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590039+0000", 2024-09-13T06:41:54.662 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:54.662 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.662 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.662 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:54.662 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590039+0000", 2024-09-13T06:41:54.662 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:54.662 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.662 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.662 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:54.663 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590038+0000", 2024-09-13T06:41:54.663 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:54.663 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.663 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.663 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:54.663 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590042+0000", 2024-09-13T06:41:54.663 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.9500000000000003e-06 2024-09-13T06:41:54.663 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.663 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.663 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:54.663 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590052+0000", 2024-09-13T06:41:54.663 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.3919999999999992e-06 2024-09-13T06:41:54.663 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.664 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.664 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:54.664 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590059+0000", 2024-09-13T06:41:54.664 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.7970000000000001e-06 2024-09-13T06:41:54.664 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.664 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.664 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:54.664 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.672078+0000", 2024-09-13T06:41:54.664 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.082018778000000001 2024-09-13T06:41:54.664 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.664 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.664 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:54.664 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.672266+0000", 2024-09-13T06:41:54.665 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00018807399999999999 2024-09-13T06:41:54.665 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.665 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.665 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:54.665 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.672613+0000", 2024-09-13T06:41:54.665 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00034677599999999997 2024-09-13T06:41:54.665 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:54.665 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:54.665 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:54.665 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.665 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.665 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43305 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 518144~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:54.666 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.590136+0000", 2024-09-13T06:41:54.666 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 92.997008043999998, 2024-09-13T06:41:54.666 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.082988206999999994, 2024-09-13T06:41:54.666 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:54.666 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:54.666 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:54.666 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:54.666 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:54.666 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43305 2024-09-13T06:41:54.666 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.666 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:54.666 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.666 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:54.667 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590136+0000", 2024-09-13T06:41:54.667 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:54.667 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.667 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.667 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:54.667 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590136+0000", 2024-09-13T06:41:54.667 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:54.667 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.667 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.667 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:54.667 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590135+0000", 2024-09-13T06:41:54.667 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:54.667 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.668 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.668 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:54.668 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590139+0000", 2024-09-13T06:41:54.668 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.9489999999999998e-06 2024-09-13T06:41:54.668 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.668 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.668 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:54.668 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590148+0000", 2024-09-13T06:41:54.668 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.9830000000000002e-06 2024-09-13T06:41:54.668 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.668 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.668 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:54.668 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590156+0000", 2024-09-13T06:41:54.668 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5229999999999998e-06 2024-09-13T06:41:54.669 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.669 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.669 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:54.669 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.672709+0000", 2024-09-13T06:41:54.669 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.082552886000000006 2024-09-13T06:41:54.669 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.669 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.669 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:54.669 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.672816+0000", 2024-09-13T06:41:54.669 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000107736 2024-09-13T06:41:54.669 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.669 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.669 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:54.670 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.673124+0000", 2024-09-13T06:41:54.670 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00030804900000000002 2024-09-13T06:41:54.670 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:54.670 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:54.670 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:54.670 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.670 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.670 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:66818 3.17 3.50afe697 (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e100)", 2024-09-13T06:41:54.670 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:53.498942+0000", 2024-09-13T06:41:54.670 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 61.088201859000002, 2024-09-13T06:41:54.670 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.011231284, 2024-09-13T06:41:54.670 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:54.670 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:41:54.670 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:54.671 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:54.671 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:54.671 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 66818 2024-09-13T06:41:54.671 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.671 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:54.671 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.671 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:54.671 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:53.498942+0000", 2024-09-13T06:41:54.671 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:54.671 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.671 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.671 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:54.671 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:53.498942+0000", 2024-09-13T06:41:54.672 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:54.672 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.672 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.672 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:54.672 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:53.498939+0000", 2024-09-13T06:41:54.672 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999967 2024-09-13T06:41:54.672 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.672 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.672 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:54.672 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:53.498954+0000", 2024-09-13T06:41:54.672 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5028000000000001e-05 2024-09-13T06:41:54.672 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.672 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.673 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:54.673 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:53.498986+0000", 2024-09-13T06:41:54.673 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.1993999999999999e-05 2024-09-13T06:41:54.673 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.673 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.673 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:54.673 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:53.499001+0000", 2024-09-13T06:41:54.673 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5166e-05 2024-09-13T06:41:54.673 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.673 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.673 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:54.673 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:53.505097+0000", 2024-09-13T06:41:54.674 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0060955610000000002 2024-09-13T06:41:54.674 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.674 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.674 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:41:54.674 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:53.505108+0000", 2024-09-13T06:41:54.674 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.084e-05 2024-09-13T06:41:54.674 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.674 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.674 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:54.674 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:54.510158+0000", 2024-09-13T06:41:54.674 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0050497549999999 2024-09-13T06:41:54.674 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.674 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.674 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:54.674 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:54.510174+0000", 2024-09-13T06:41:54.675 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6164e-05 2024-09-13T06:41:54.675 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:54.675 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:54.675 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:54.675 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.675 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.675 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:69764 3.2 3:47f10058:::rbd_data.11214956a993.0000000000000004:head [write-same] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e117)", 2024-09-13T06:41:54.675 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:41:11.371147+0000", 2024-09-13T06:41:54.675 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 43.215997549000001, 2024-09-13T06:41:54.675 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.03470167, 2024-09-13T06:41:54.675 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:54.675 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:41:54.675 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:54.675 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:54.676 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:54.676 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 69764 2024-09-13T06:41:54.676 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.676 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:54.676 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.676 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:54.676 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:11.371147+0000", 2024-09-13T06:41:54.676 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:54.676 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.676 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.676 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:54.676 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:11.371147+0000", 2024-09-13T06:41:54.676 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:54.677 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.677 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.677 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:54.677 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:11.371144+0000", 2024-09-13T06:41:54.677 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999967 2024-09-13T06:41:54.677 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.677 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.677 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:54.677 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:11.371161+0000", 2024-09-13T06:41:54.677 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7669e-05 2024-09-13T06:41:54.677 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.677 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.677 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:54.677 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:11.371198+0000", 2024-09-13T06:41:54.678 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.7014000000000002e-05 2024-09-13T06:41:54.678 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.678 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.678 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:54.678 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:11.371216+0000", 2024-09-13T06:41:54.678 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7425e-05 2024-09-13T06:41:54.678 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.678 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.678 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:54.678 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:11.371365+0000", 2024-09-13T06:41:54.678 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000149245 2024-09-13T06:41:54.678 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.678 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.679 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op must wait for map", 2024-09-13T06:41:54.679 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:11.371385+0000", 2024-09-13T06:41:54.679 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.0018999999999999e-05 2024-09-13T06:41:54.679 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.679 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.679 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:54.679 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:11.378406+0000", 2024-09-13T06:41:54.679 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0070207179999999996 2024-09-13T06:41:54.679 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.679 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.679 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:41:54.680 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:11.378429+0000", 2024-09-13T06:41:54.680 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.3453999999999999e-05 2024-09-13T06:41:54.680 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.680 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.680 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:54.680 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:12.405667+0000", 2024-09-13T06:41:54.680 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0272381690000001 2024-09-13T06:41:54.680 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.680 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.680 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:54.680 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:12.405848+0000", 2024-09-13T06:41:54.681 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00018112 2024-09-13T06:41:54.681 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:54.681 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:54.681 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:54.681 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.681 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.681 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:70346 3.16 3:69d35907:::rbd_object_map.11214956a993:head [read 0~36] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e122)", 2024-09-13T06:41:54.681 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:41:16.390917+0000", 2024-09-13T06:41:54.681 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 38.196227497000002, 2024-09-13T06:41:54.681 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.99327479799999996, 2024-09-13T06:41:54.681 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:54.681 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:54.681 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:54.681 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:54.682 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:54.682 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 70346 2024-09-13T06:41:54.682 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.682 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:54.682 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.682 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:54.682 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:16.390917+0000", 2024-09-13T06:41:54.682 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:54.682 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.682 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.682 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:54.682 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:16.390917+0000", 2024-09-13T06:41:54.682 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:54.682 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.683 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.683 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:54.683 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:16.390916+0000", 2024-09-13T06:41:54.683 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999986 2024-09-13T06:41:54.683 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.683 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.683 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:54.683 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:16.390922+0000", 2024-09-13T06:41:54.683 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.0480000000000004e-06 2024-09-13T06:41:54.683 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.683 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.683 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:54.683 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:16.390933+0000", 2024-09-13T06:41:54.683 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1387e-05 2024-09-13T06:41:54.684 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.684 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.684 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:54.684 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:16.390939+0000", 2024-09-13T06:41:54.684 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.8039999999999998e-06 2024-09-13T06:41:54.684 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.684 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.684 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:54.684 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:16.390983+0000", 2024-09-13T06:41:54.684 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.4663000000000003e-05 2024-09-13T06:41:54.684 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.684 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.684 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:41:54.684 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:16.390991+0000", 2024-09-13T06:41:54.684 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.8059999999999995e-06 2024-09-13T06:41:54.685 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.685 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.685 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:54.685 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:17.383624+0000", 2024-09-13T06:41:54.685 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.99263277299999997 2024-09-13T06:41:54.685 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.685 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.685 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:54.685 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:17.383891+0000", 2024-09-13T06:41:54.685 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00026717599999999999 2024-09-13T06:41:54.685 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:54.685 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:54.685 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:54.686 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:17.384192+0000", 2024-09-13T06:41:54.686 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00030047400000000001 2024-09-13T06:41:54.686 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:54.686 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:54.686 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:54.686 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:54.686 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:54.686 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:41:54.688 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-13T06:41:54.688 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:41:54.682+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:41:54.788 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:41:54.785+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:41:54.888 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:41:54.885+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:41:54.894 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:41:54.894 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [], 2024-09-13T06:41:54.894 INFO:teuthology.orchestra.run.smithi139.stdout: "num_ops": 0 2024-09-13T06:41:54.894 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:41:54.908 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-13T06:41:54.989 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:41:54.985+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:41:55.023 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:41:55.023 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [], 2024-09-13T06:41:55.023 INFO:teuthology.orchestra.run.smithi139.stdout: "complaint_time": 30, 2024-09-13T06:41:55.023 INFO:teuthology.orchestra.run.smithi139.stdout: "num_blocked_ops": 0 2024-09-13T06:41:55.023 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:41:55.037 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-13T06:41:55.090 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:41:55.089+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:41:55.162 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:41:55.162 INFO:teuthology.orchestra.run.smithi139.stdout: "size": 20, 2024-09-13T06:41:55.162 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 600, 2024-09-13T06:41:55.163 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [ 2024-09-13T06:41:55.163 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:55.163 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27854 3.a 3:537b3559:::rbd_data.1121f2c5ee81.0000000000000016:13 [read 335872~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:55.163 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.658750+0000", 2024-09-13T06:41:55.163 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 118.502960383, 2024-09-13T06:41:55.163 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.037969532, 2024-09-13T06:41:55.163 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:55.163 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:55.163 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:55.163 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:55.163 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:55.163 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27854 2024-09-13T06:41:55.164 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:55.164 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:55.164 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:55.164 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:55.164 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658750+0000", 2024-09-13T06:41:55.164 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:55.164 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:55.164 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:55.164 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:55.164 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658750+0000", 2024-09-13T06:41:55.164 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:55.164 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:55.165 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:55.165 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:55.165 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658749+0000", 2024-09-13T06:41:55.165 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:55.165 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:55.165 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:55.165 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:55.165 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658757+0000", 2024-09-13T06:41:55.165 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.7389999999999999e-06 2024-09-13T06:41:55.165 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:55.165 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:55.165 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:55.165 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658763+0000", 2024-09-13T06:41:55.166 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.7769999999999999e-06 2024-09-13T06:41:55.166 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:55.166 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:55.166 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:55.166 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658767+0000", 2024-09-13T06:41:55.166 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.1749999999999998e-06 2024-09-13T06:41:55.166 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:55.166 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:55.166 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:55.166 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.696322+0000", 2024-09-13T06:41:55.166 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.037554772 2024-09-13T06:41:55.166 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:55.166 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:55.166 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:55.167 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.696418+0000", 2024-09-13T06:41:55.167 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6050000000000004e-05 2024-09-13T06:41:55.167 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:55.167 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:55.167 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:55.167 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.696719+0000", 2024-09-13T06:41:55.167 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00030138499999999999 2024-09-13T06:41:55.167 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:55.167 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:55.167 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:55.167 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:55.167 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:55.167 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27855 3.a 3:537b3559:::rbd_data.1121f2c5ee81.0000000000000016:13 [read 380928~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:55.168 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.658771+0000", 2024-09-13T06:41:55.168 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 118.50293913900001, 2024-09-13T06:41:55.168 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.038326354, 2024-09-13T06:41:55.168 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:55.168 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:55.168 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:55.168 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:55.168 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:55.168 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27855 2024-09-13T06:41:55.168 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:55.168 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:55.168 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:55.168 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:55.168 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658771+0000", 2024-09-13T06:41:55.169 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:55.169 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:55.169 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:55.169 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:55.169 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658771+0000", 2024-09-13T06:41:55.169 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:55.169 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:55.169 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:55.169 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:55.169 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658770+0000", 2024-09-13T06:41:55.169 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:55.169 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:55.169 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:55.169 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:55.170 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658772+0000", 2024-09-13T06:41:55.170 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.0930000000000001e-06 2024-09-13T06:41:55.170 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:55.170 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:55.170 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:55.170 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658778+0000", 2024-09-13T06:41:55.170 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.2730000000000002e-06 2024-09-13T06:41:55.170 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:55.170 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:55.170 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:55.170 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658782+0000", 2024-09-13T06:41:55.170 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0879999999999997e-06 2024-09-13T06:41:55.170 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:55.170 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:55.171 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:55.171 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.696770+0000", 2024-09-13T06:41:55.171 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.037988145000000001 2024-09-13T06:41:55.171 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:55.171 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:55.171 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:55.171 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.696852+0000", 2024-09-13T06:41:55.171 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.2039999999999994e-05 2024-09-13T06:41:55.171 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:55.171 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:55.171 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:55.171 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.697097+0000", 2024-09-13T06:41:55.171 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00024508800000000002 2024-09-13T06:41:55.171 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:55.171 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:55.172 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:55.172 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:55.172 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:55.172 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27856 3.a 3:537b3559:::rbd_data.1121f2c5ee81.0000000000000016:13 [read 405504~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:55.172 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.658786+0000", 2024-09-13T06:41:55.172 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 118.50292402300001, 2024-09-13T06:41:55.172 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.038736029999999998, 2024-09-13T06:41:55.172 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:55.172 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:55.172 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:55.172 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:55.172 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:55.172 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27856 2024-09-13T06:41:55.173 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:55.173 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:55.173 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:55.173 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:55.173 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658786+0000", 2024-09-13T06:41:55.173 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:55.173 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:55.173 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:55.173 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:55.173 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658786+0000", 2024-09-13T06:41:55.173 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:55.173 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:55.173 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:55.174 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:55.174 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658785+0000", 2024-09-13T06:41:55.174 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:55.174 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:55.174 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:55.174 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:55.174 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658787+0000", 2024-09-13T06:41:55.174 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.0040000000000002e-06 2024-09-13T06:41:55.174 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:55.174 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:55.174 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:55.174 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658793+0000", 2024-09-13T06:41:55.174 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.2410000000000003e-06 2024-09-13T06:41:55.174 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:55.175 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:55.175 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:55.175 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658797+0000", 2024-09-13T06:41:55.175 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.1330000000000001e-06 2024-09-13T06:41:55.175 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:55.175 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:55.175 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:55.175 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.697176+0000", 2024-09-13T06:41:55.175 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.038379074999999999 2024-09-13T06:41:55.175 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:55.175 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:55.175 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:55.175 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.697275+0000", 2024-09-13T06:41:55.175 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.8819000000000004e-05 2024-09-13T06:41:55.176 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:55.176 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:55.176 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:55.176 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.697522+0000", 2024-09-13T06:41:55.176 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00024719999999999999 2024-09-13T06:41:55.176 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:55.176 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:55.176 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:55.176 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:55.176 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:55.176 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27857 3.a 3:537b3559:::rbd_data.1121f2c5ee81.0000000000000016:13 [read 475136~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:55.176 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.658845+0000", 2024-09-13T06:41:55.176 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 118.50286502, 2024-09-13T06:41:55.177 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039112570999999999, 2024-09-13T06:41:55.177 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:55.177 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:55.177 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:55.177 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:55.177 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:55.177 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27857 2024-09-13T06:41:55.177 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:55.177 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:55.177 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:55.177 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:55.177 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658845+0000", 2024-09-13T06:41:55.177 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:55.177 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:55.178 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:55.178 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:55.178 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658845+0000", 2024-09-13T06:41:55.178 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:55.178 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:55.178 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:55.178 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:55.178 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658844+0000", 2024-09-13T06:41:55.178 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999986 2024-09-13T06:41:55.178 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:55.178 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:55.178 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:55.178 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658868+0000", 2024-09-13T06:41:55.178 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.4615000000000001e-05 2024-09-13T06:41:55.179 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:55.179 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:55.179 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:55.179 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658884+0000", 2024-09-13T06:41:55.179 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5401999999999999e-05 2024-09-13T06:41:55.179 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:55.179 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:55.179 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:55.179 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658896+0000", 2024-09-13T06:41:55.179 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2509e-05 2024-09-13T06:41:55.179 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:55.179 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:55.179 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:55.179 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.697571+0000", 2024-09-13T06:41:55.180 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.038675107 2024-09-13T06:41:55.180 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:55.180 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:55.180 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:55.180 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.697658+0000", 2024-09-13T06:41:55.180 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6349999999999998e-05 2024-09-13T06:41:55.180 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:55.180 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:55.180 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:55.180 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.697957+0000", 2024-09-13T06:41:55.180 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00029986100000000001 2024-09-13T06:41:55.180 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:55.180 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:55.180 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:55.181 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:55.181 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:55.181 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27858 3.a 3:537b3559:::rbd_data.1121f2c5ee81.0000000000000016:13 [read 499712~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:55.181 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.658905+0000", 2024-09-13T06:41:55.181 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 118.50280447, 2024-09-13T06:41:55.181 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039475392999999998, 2024-09-13T06:41:55.181 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:55.181 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:55.181 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:55.181 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:55.181 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:55.181 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27858 2024-09-13T06:41:55.181 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:55.182 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:55.182 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:55.182 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:55.182 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658905+0000", 2024-09-13T06:41:55.182 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:55.182 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:55.182 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:55.182 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:55.182 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658905+0000", 2024-09-13T06:41:55.182 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:55.182 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:55.182 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:55.182 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:55.182 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658905+0000", 2024-09-13T06:41:55.183 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:55.183 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:55.183 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:55.183 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:55.183 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658909+0000", 2024-09-13T06:41:55.183 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.831e-06 2024-09-13T06:41:55.183 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:55.183 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:55.183 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:55.183 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658920+0000", 2024-09-13T06:41:55.183 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0936e-05 2024-09-13T06:41:55.183 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:55.183 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:55.183 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:55.184 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658929+0000", 2024-09-13T06:41:55.184 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.2749999999999995e-06 2024-09-13T06:41:55.184 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:55.184 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:55.184 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:55.184 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.697990+0000", 2024-09-13T06:41:55.184 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039061625000000003 2024-09-13T06:41:55.184 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:55.184 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:55.184 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:55.184 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.698077+0000", 2024-09-13T06:41:55.184 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6922000000000006e-05 2024-09-13T06:41:55.184 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:55.184 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:55.185 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:55.185 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.698381+0000", 2024-09-13T06:41:55.185 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00030360599999999999 2024-09-13T06:41:55.185 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:55.185 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:55.185 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:55.185 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:55.185 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:55.185 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27929 3.a 3:537b3559:::rbd_data.1121f2c5ee81.0000000000000016:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:55.185 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.659338+0000", 2024-09-13T06:41:55.185 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 118.502371639, 2024-09-13T06:41:55.185 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039351214000000002, 2024-09-13T06:41:55.185 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:55.185 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:55.186 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:55.186 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:55.186 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:55.186 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27929 2024-09-13T06:41:55.186 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:55.186 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:55.186 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:55.186 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:55.186 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.659338+0000", 2024-09-13T06:41:55.186 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:55.186 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:55.186 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:55.186 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:55.186 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.659338+0000", 2024-09-13T06:41:55.187 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:55.187 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:55.187 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:55.187 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:55.187 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.659337+0000", 2024-09-13T06:41:55.187 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:55.187 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:55.187 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:55.187 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:55.187 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.659342+0000", 2024-09-13T06:41:55.187 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0799999999999999e-06 2024-09-13T06:41:55.187 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:55.187 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:55.187 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:55.188 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.659353+0000", 2024-09-13T06:41:55.188 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1798e-05 2024-09-13T06:41:55.188 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:55.188 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:55.188 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:55.188 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.659361+0000", 2024-09-13T06:41:55.188 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.8040000000000002e-06 2024-09-13T06:41:55.188 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:55.188 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:55.188 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:55.188 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.698449+0000", 2024-09-13T06:41:55.188 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039087519000000001 2024-09-13T06:41:55.188 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:55.188 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:55.189 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:55.189 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.698567+0000", 2024-09-13T06:41:55.189 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00011857 2024-09-13T06:41:55.189 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:55.189 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:55.189 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:55.189 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.698689+0000", 2024-09-13T06:41:55.189 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00012226699999999999 2024-09-13T06:41:55.189 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:55.189 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:55.189 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:55.189 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:55.189 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:55.189 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27974 3.a 3:537b3559:::rbd_data.1121f2c5ee81.0000000000000016:13 [read 32768~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:55.190 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.660102+0000", 2024-09-13T06:41:55.190 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 118.501607871, 2024-09-13T06:41:55.190 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.038972346999999997, 2024-09-13T06:41:55.190 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:55.190 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:55.190 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:55.190 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:55.190 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:55.190 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27974 2024-09-13T06:41:55.190 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:55.190 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:55.190 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:55.190 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:55.191 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660102+0000", 2024-09-13T06:41:55.191 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:55.191 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:55.191 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:55.191 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:55.191 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660102+0000", 2024-09-13T06:41:55.191 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:55.191 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:55.191 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:55.191 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:55.191 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660100+0000", 2024-09-13T06:41:55.191 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999976 2024-09-13T06:41:55.191 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:55.191 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:55.192 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:55.192 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660114+0000", 2024-09-13T06:41:55.192 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.4466e-05 2024-09-13T06:41:55.192 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:55.192 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:55.192 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:55.192 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660148+0000", 2024-09-13T06:41:55.192 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.3742999999999999e-05 2024-09-13T06:41:55.192 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:55.192 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:55.192 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:55.192 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660170+0000", 2024-09-13T06:41:55.192 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.2518e-05 2024-09-13T06:41:55.193 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:55.193 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:55.193 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:55.193 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.698719+0000", 2024-09-13T06:41:55.193 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.038548529999999998 2024-09-13T06:41:55.193 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:55.193 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:55.193 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:55.193 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.698806+0000", 2024-09-13T06:41:55.193 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.7179e-05 2024-09-13T06:41:55.193 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:55.193 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:55.193 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:55.193 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.699074+0000", 2024-09-13T06:41:55.194 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00026834800000000001 2024-09-13T06:41:55.194 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:55.194 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:55.194 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:55.194 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:55.194 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:55.194 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27975 3.a 3:537b3559:::rbd_data.1121f2c5ee81.0000000000000016:13 [read 57344~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:55.194 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.660189+0000", 2024-09-13T06:41:55.194 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 118.501521027, 2024-09-13T06:41:55.194 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039288678, 2024-09-13T06:41:55.194 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:55.194 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:55.194 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:55.194 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:55.195 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:55.195 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27975 2024-09-13T06:41:55.195 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:55.195 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:55.195 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:55.195 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:55.195 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660189+0000", 2024-09-13T06:41:55.195 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:55.195 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:55.195 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:55.195 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:55.195 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660189+0000", 2024-09-13T06:41:55.195 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:55.195 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:55.196 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:55.196 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:55.196 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660187+0000", 2024-09-13T06:41:55.196 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999981 2024-09-13T06:41:55.196 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:55.196 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:55.196 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:55.196 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660195+0000", 2024-09-13T06:41:55.196 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5610000000000001e-06 2024-09-13T06:41:55.196 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:55.197 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:55.197 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:55.197 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660212+0000", 2024-09-13T06:41:55.197 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7725999999999999e-05 2024-09-13T06:41:55.197 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:55.197 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:55.197 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:55.197 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660227+0000", 2024-09-13T06:41:55.197 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.43e-05 2024-09-13T06:41:55.197 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:55.197 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:55.198 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:55.198 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.699135+0000", 2024-09-13T06:41:55.198 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.038908336000000002 2024-09-13T06:41:55.198 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:55.198 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:55.198 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:55.198 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.699208+0000", 2024-09-13T06:41:55.198 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.3065000000000006e-05 2024-09-13T06:41:55.198 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:55.198 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:55.198 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:55.198 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.699478+0000", 2024-09-13T06:41:55.198 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00026946899999999999 2024-09-13T06:41:55.198 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:55.199 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:55.199 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:55.199 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:55.199 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:55.199 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27976 3.a 3:537b3559:::rbd_data.1121f2c5ee81.0000000000000016:13 [read 102400~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:55.199 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.660238+0000", 2024-09-13T06:41:55.199 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 118.501471864, 2024-09-13T06:41:55.199 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039636515999999997, 2024-09-13T06:41:55.199 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:55.199 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:55.199 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:55.199 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:55.199 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:55.199 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27976 2024-09-13T06:41:55.200 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:55.200 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:55.200 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:55.200 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:55.200 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660238+0000", 2024-09-13T06:41:55.200 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:55.200 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:55.200 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:55.200 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:55.200 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660238+0000", 2024-09-13T06:41:55.200 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:55.200 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:55.200 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:55.200 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:55.200 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660237+0000", 2024-09-13T06:41:55.201 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:55.201 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:55.201 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:55.201 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:55.201 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660243+0000", 2024-09-13T06:41:55.201 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.9909999999999999e-06 2024-09-13T06:41:55.201 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:55.201 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:55.201 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:55.201 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660259+0000", 2024-09-13T06:41:55.201 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6294e-05 2024-09-13T06:41:55.201 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:55.201 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:55.201 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:55.202 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660272+0000", 2024-09-13T06:41:55.202 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2714999999999999e-05 2024-09-13T06:41:55.202 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:55.202 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:55.202 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:55.202 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.699513+0000", 2024-09-13T06:41:55.202 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039240932999999999 2024-09-13T06:41:55.202 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:55.202 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:55.202 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:55.202 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.699604+0000", 2024-09-13T06:41:55.202 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.1367999999999997e-05 2024-09-13T06:41:55.202 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:55.203 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:55.203 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:55.203 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.699875+0000", 2024-09-13T06:41:55.203 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00027029499999999999 2024-09-13T06:41:55.203 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:55.203 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:55.203 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:55.203 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:55.203 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:55.203 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27977 3.a 3:537b3559:::rbd_data.1121f2c5ee81.0000000000000016:13 [read 126976~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:55.203 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.660284+0000", 2024-09-13T06:41:55.203 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 118.501426292, 2024-09-13T06:41:55.203 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039969945, 2024-09-13T06:41:55.203 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:55.204 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:55.204 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:55.204 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:55.204 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:55.204 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27977 2024-09-13T06:41:55.204 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:55.204 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:55.204 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:55.204 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:55.204 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660284+0000", 2024-09-13T06:41:55.204 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:55.204 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:55.204 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:55.205 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:55.205 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660284+0000", 2024-09-13T06:41:55.205 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:55.205 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:55.205 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:55.205 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:55.205 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660282+0000", 2024-09-13T06:41:55.205 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999986 2024-09-13T06:41:55.205 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:55.205 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:55.205 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:55.205 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660288+0000", 2024-09-13T06:41:55.205 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.2650000000000002e-06 2024-09-13T06:41:55.206 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:55.206 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:55.206 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:55.206 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660304+0000", 2024-09-13T06:41:55.206 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5430999999999998e-05 2024-09-13T06:41:55.206 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:55.206 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:55.206 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:55.206 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660316+0000", 2024-09-13T06:41:55.206 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.237e-05 2024-09-13T06:41:55.206 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:55.206 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:55.206 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:55.206 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.699907+0000", 2024-09-13T06:41:55.207 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039590735000000002 2024-09-13T06:41:55.207 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:55.207 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:55.207 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:55.207 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.699994+0000", 2024-09-13T06:41:55.207 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6996999999999994e-05 2024-09-13T06:41:55.207 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:55.207 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:55.207 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:55.207 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700254+0000", 2024-09-13T06:41:55.207 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000259564 2024-09-13T06:41:55.207 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:55.207 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:55.207 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:55.208 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:55.208 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:55.208 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27978 3.a 3.9aacdeca (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:55.208 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.660327+0000", 2024-09-13T06:41:55.208 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 118.501382694, 2024-09-13T06:41:55.208 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039984858999999998, 2024-09-13T06:41:55.208 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:55.208 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:41:55.208 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:55.208 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:55.208 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:55.208 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27978 2024-09-13T06:41:55.208 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:55.208 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:55.209 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:55.209 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:55.209 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660327+0000", 2024-09-13T06:41:55.209 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:55.209 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:55.209 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:55.209 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:55.209 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660327+0000", 2024-09-13T06:41:55.209 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:55.209 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:55.209 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:55.209 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:55.209 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660326+0000", 2024-09-13T06:41:55.210 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:55.210 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:55.210 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:55.210 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:55.210 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660366+0000", 2024-09-13T06:41:55.210 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.9691000000000003e-05 2024-09-13T06:41:55.210 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:55.210 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:55.210 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:55.210 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660399+0000", 2024-09-13T06:41:55.210 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.3262000000000001e-05 2024-09-13T06:41:55.210 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:55.210 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:55.210 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:55.211 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660414+0000", 2024-09-13T06:41:55.211 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.4775e-05 2024-09-13T06:41:55.211 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:55.211 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:55.211 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:55.211 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700298+0000", 2024-09-13T06:41:55.211 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039883759999999997 2024-09-13T06:41:55.211 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:55.211 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:55.211 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:55.211 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700312+0000", 2024-09-13T06:41:55.211 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.4374e-05 2024-09-13T06:41:55.211 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:55.211 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:55.211 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:55.212 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:55.212 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:55.212 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27979 3.a 3.9aacdeca (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:55.212 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.660429+0000", 2024-09-13T06:41:55.212 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 118.501280826, 2024-09-13T06:41:55.212 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039921361000000002, 2024-09-13T06:41:55.212 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:55.212 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:41:55.212 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:55.212 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:55.212 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:55.212 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27979 2024-09-13T06:41:55.213 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:55.213 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:55.213 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:55.213 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:55.213 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660429+0000", 2024-09-13T06:41:55.213 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:55.213 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:55.213 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:55.213 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:55.213 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660429+0000", 2024-09-13T06:41:55.213 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:55.213 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:55.213 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:55.213 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:55.214 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660428+0000", 2024-09-13T06:41:55.214 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999986 2024-09-13T06:41:55.214 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:55.214 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:55.214 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:55.214 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660434+0000", 2024-09-13T06:41:55.214 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.8190000000000003e-06 2024-09-13T06:41:55.214 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:55.214 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:55.214 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:55.214 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660451+0000", 2024-09-13T06:41:55.214 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6963e-05 2024-09-13T06:41:55.214 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:55.214 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:55.214 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:55.215 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660485+0000", 2024-09-13T06:41:55.215 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.3414000000000002e-05 2024-09-13T06:41:55.215 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:55.215 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:55.215 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:55.215 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700342+0000", 2024-09-13T06:41:55.215 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039857278000000003 2024-09-13T06:41:55.215 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:55.215 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:55.215 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:55.215 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700350+0000", 2024-09-13T06:41:55.215 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.2930000000000001e-06 2024-09-13T06:41:55.215 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:55.215 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:55.216 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:55.216 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:55.216 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:55.216 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27980 3.a 3.9aacdeca (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:55.216 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.660497+0000", 2024-09-13T06:41:55.216 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 118.501212615, 2024-09-13T06:41:55.216 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039888034000000003, 2024-09-13T06:41:55.216 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:55.216 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:41:55.216 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:55.216 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:55.216 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:55.216 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27980 2024-09-13T06:41:55.217 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:55.217 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:55.217 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:55.217 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:55.217 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660497+0000", 2024-09-13T06:41:55.217 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:55.217 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:55.217 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:55.217 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:55.217 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660497+0000", 2024-09-13T06:41:55.217 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:55.217 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:55.217 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:55.217 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:55.218 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660496+0000", 2024-09-13T06:41:55.218 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:55.218 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:55.218 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:55.218 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:55.218 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660503+0000", 2024-09-13T06:41:55.218 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.4110000000000001e-06 2024-09-13T06:41:55.218 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:55.218 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:55.218 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:55.218 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660519+0000", 2024-09-13T06:41:55.218 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6180000000000001e-05 2024-09-13T06:41:55.218 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:55.219 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:55.219 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:55.219 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660544+0000", 2024-09-13T06:41:55.219 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.5177999999999998e-05 2024-09-13T06:41:55.219 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:55.219 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:55.219 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:55.219 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700377+0000", 2024-09-13T06:41:55.219 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039833434000000001 2024-09-13T06:41:55.219 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:55.219 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:55.219 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:55.219 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700385+0000", 2024-09-13T06:41:55.220 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.8800000000000008e-06 2024-09-13T06:41:55.220 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:55.220 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:55.220 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:55.220 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:55.220 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:55.220 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27981 3.a 3.9aacdeca (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:55.220 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.660556+0000", 2024-09-13T06:41:55.220 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 118.501154269, 2024-09-13T06:41:55.220 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039869989000000002, 2024-09-13T06:41:55.220 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:55.220 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:41:55.221 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:55.221 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:55.221 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:55.221 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27981 2024-09-13T06:41:55.221 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:55.221 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:55.221 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:55.221 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:55.221 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660556+0000", 2024-09-13T06:41:55.221 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:55.221 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:55.221 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:55.221 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:55.222 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660556+0000", 2024-09-13T06:41:55.222 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:55.222 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:55.222 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:55.222 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:55.222 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660555+0000", 2024-09-13T06:41:55.222 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:55.222 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:55.222 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:55.222 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:55.222 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660561+0000", 2024-09-13T06:41:55.222 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.088e-06 2024-09-13T06:41:55.222 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:55.222 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:55.223 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:55.223 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660577+0000", 2024-09-13T06:41:55.223 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6147999999999999e-05 2024-09-13T06:41:55.223 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:55.223 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:55.223 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:55.223 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660589+0000", 2024-09-13T06:41:55.223 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2551999999999999e-05 2024-09-13T06:41:55.223 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:55.223 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:55.223 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:55.223 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700414+0000", 2024-09-13T06:41:55.223 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039825007000000003 2024-09-13T06:41:55.224 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:55.224 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:55.224 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:55.224 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700426+0000", 2024-09-13T06:41:55.224 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1265e-05 2024-09-13T06:41:55.224 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:55.224 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:55.224 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:55.224 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:55.224 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:55.224 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27982 3.a 3.9aacdeca (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:55.224 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.660603+0000", 2024-09-13T06:41:55.224 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 118.501106674, 2024-09-13T06:41:55.224 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039874779999999999, 2024-09-13T06:41:55.225 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:55.225 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:41:55.225 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:55.225 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:55.225 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:55.225 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27982 2024-09-13T06:41:55.225 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:55.225 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:55.225 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:55.225 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:55.225 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660603+0000", 2024-09-13T06:41:55.225 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:55.225 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:55.225 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:55.226 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:55.226 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660603+0000", 2024-09-13T06:41:55.226 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:55.226 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:55.226 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:55.226 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:55.226 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660602+0000", 2024-09-13T06:41:55.226 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:55.226 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:55.226 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:55.226 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:55.226 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660653+0000", 2024-09-13T06:41:55.226 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.0862000000000002e-05 2024-09-13T06:41:55.226 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:55.227 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:55.227 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:55.227 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660697+0000", 2024-09-13T06:41:55.227 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.3773000000000003e-05 2024-09-13T06:41:55.227 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:55.227 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:55.227 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:55.227 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660712+0000", 2024-09-13T06:41:55.227 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5464999999999998e-05 2024-09-13T06:41:55.227 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:55.227 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:55.227 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:55.227 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700469+0000", 2024-09-13T06:41:55.227 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039756503999999998 2024-09-13T06:41:55.228 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:55.228 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:55.228 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:55.228 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700478+0000", 2024-09-13T06:41:55.228 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.1730000000000001e-06 2024-09-13T06:41:55.228 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:55.228 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:55.228 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:55.228 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:55.228 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:55.228 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27983 3.a 3.9aacdeca (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:55.228 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.660726+0000", 2024-09-13T06:41:55.228 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 118.50098339900001, 2024-09-13T06:41:55.228 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039804357999999998, 2024-09-13T06:41:55.229 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:55.229 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:41:55.229 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:55.229 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:55.229 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:55.229 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27983 2024-09-13T06:41:55.229 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:55.229 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:55.229 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:55.229 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:55.229 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660726+0000", 2024-09-13T06:41:55.229 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:55.229 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:55.229 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:55.230 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:55.230 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660726+0000", 2024-09-13T06:41:55.230 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:55.230 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:55.230 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:55.230 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:55.230 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660725+0000", 2024-09-13T06:41:55.230 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999986 2024-09-13T06:41:55.230 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:55.230 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:55.230 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:55.230 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660733+0000", 2024-09-13T06:41:55.230 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.9359999999999999e-06 2024-09-13T06:41:55.231 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:55.231 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:55.231 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:55.231 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660751+0000", 2024-09-13T06:41:55.231 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7679000000000001e-05 2024-09-13T06:41:55.231 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:55.231 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:55.231 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:55.231 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660764+0000", 2024-09-13T06:41:55.231 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3112000000000001e-05 2024-09-13T06:41:55.231 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:55.231 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:55.231 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:55.231 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700516+0000", 2024-09-13T06:41:55.232 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039752183000000003 2024-09-13T06:41:55.232 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:55.232 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:55.232 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:55.232 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700531+0000", 2024-09-13T06:41:55.232 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.4732999999999999e-05 2024-09-13T06:41:55.232 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:55.232 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:55.232 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:55.232 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:55.232 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:55.232 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27984 3.a 3.9aacdeca (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:55.232 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.660776+0000", 2024-09-13T06:41:55.233 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 118.500934296, 2024-09-13T06:41:55.233 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039795697999999997, 2024-09-13T06:41:55.233 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:55.233 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:41:55.233 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:55.233 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:55.233 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:55.233 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27984 2024-09-13T06:41:55.233 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:55.233 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:55.233 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:55.233 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:55.233 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660776+0000", 2024-09-13T06:41:55.233 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:55.234 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:55.234 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:55.234 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:55.234 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660776+0000", 2024-09-13T06:41:55.234 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:55.234 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:55.234 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:55.234 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:55.234 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660775+0000", 2024-09-13T06:41:55.234 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:55.234 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:55.234 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:55.234 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:55.234 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660780+0000", 2024-09-13T06:41:55.235 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.7849999999999997e-06 2024-09-13T06:41:55.235 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:55.235 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:55.235 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:55.235 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660799+0000", 2024-09-13T06:41:55.235 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.8794e-05 2024-09-13T06:41:55.235 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:55.235 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:55.235 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:55.235 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660812+0000", 2024-09-13T06:41:55.235 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3029e-05 2024-09-13T06:41:55.235 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:55.235 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:55.235 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:55.236 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700562+0000", 2024-09-13T06:41:55.236 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039749984000000002 2024-09-13T06:41:55.236 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:55.236 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:55.236 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:55.236 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700571+0000", 2024-09-13T06:41:55.236 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.1260000000000004e-06 2024-09-13T06:41:55.236 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:55.236 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:55.236 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:55.236 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:55.236 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:55.236 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27985 3.a 3.9aacdeca (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:55.236 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.660824+0000", 2024-09-13T06:41:55.237 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 118.500886244, 2024-09-13T06:41:55.237 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039784462, 2024-09-13T06:41:55.237 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:55.237 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:41:55.237 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:55.237 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:55.237 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:55.237 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27985 2024-09-13T06:41:55.237 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:55.237 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:55.237 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:55.237 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:55.237 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660824+0000", 2024-09-13T06:41:55.237 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:55.238 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:55.238 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:55.238 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:55.238 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660824+0000", 2024-09-13T06:41:55.238 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:55.238 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:55.238 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:55.238 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:55.238 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660823+0000", 2024-09-13T06:41:55.238 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:55.238 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:55.238 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:55.238 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:55.239 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660829+0000", 2024-09-13T06:41:55.239 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.9440000000000002e-06 2024-09-13T06:41:55.239 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:55.239 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:55.239 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:55.239 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660922+0000", 2024-09-13T06:41:55.239 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.2958e-05 2024-09-13T06:41:55.239 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:55.239 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:55.239 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:55.239 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660964+0000", 2024-09-13T06:41:55.239 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.2407000000000002e-05 2024-09-13T06:41:55.239 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:55.239 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:55.240 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:55.240 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700600+0000", 2024-09-13T06:41:55.240 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039635581000000003 2024-09-13T06:41:55.240 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:55.240 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:55.240 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:55.240 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700608+0000", 2024-09-13T06:41:55.240 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.5890000000000003e-06 2024-09-13T06:41:55.240 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:55.240 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:55.240 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:55.240 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:55.240 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:55.240 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:28023 3.10 3:0dedc28a:::rbd_data.1121f2c5ee81.0000000000000019:13 [read 475136~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:55.241 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.662072+0000", 2024-09-13T06:41:55.241 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 118.49963825899999, 2024-09-13T06:41:55.241 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.038086508999999998, 2024-09-13T06:41:55.241 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:55.241 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:55.241 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:55.241 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:55.241 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:55.241 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 28023 2024-09-13T06:41:55.241 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:55.241 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:55.241 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:55.241 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:55.241 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.662072+0000", 2024-09-13T06:41:55.242 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:55.242 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:55.242 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:55.242 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:55.242 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.662072+0000", 2024-09-13T06:41:55.242 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:55.242 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:55.242 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:55.242 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:55.242 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.662070+0000", 2024-09-13T06:41:55.242 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999986 2024-09-13T06:41:55.242 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:55.242 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:55.242 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:55.243 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.662076+0000", 2024-09-13T06:41:55.243 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.139e-06 2024-09-13T06:41:55.243 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:55.243 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:55.243 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:55.243 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.662094+0000", 2024-09-13T06:41:55.243 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7136999999999999e-05 2024-09-13T06:41:55.243 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:55.243 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:55.243 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:55.243 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.662124+0000", 2024-09-13T06:41:55.243 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.0528999999999999e-05 2024-09-13T06:41:55.243 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:55.243 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:55.244 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:55.244 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.699843+0000", 2024-09-13T06:41:55.244 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.037718415999999998 2024-09-13T06:41:55.244 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:55.244 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:55.244 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:55.244 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.699931+0000", 2024-09-13T06:41:55.244 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.8345999999999997e-05 2024-09-13T06:41:55.244 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:55.244 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:55.244 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:55.244 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700158+0000", 2024-09-13T06:41:55.244 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00022723099999999999 2024-09-13T06:41:55.245 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:55.245 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:55.245 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:55.245 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:55.245 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:55.245 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:28024 3.10 3.5143b7b0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:55.245 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.662137+0000", 2024-09-13T06:41:55.245 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 118.49957273699999, 2024-09-13T06:41:55.245 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.038056092999999999, 2024-09-13T06:41:55.245 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:55.245 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:41:55.245 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:55.245 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:55.245 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:55.246 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 28024 2024-09-13T06:41:55.246 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:55.246 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:55.246 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:55.246 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:55.246 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.662137+0000", 2024-09-13T06:41:55.246 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:55.246 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:55.246 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:55.246 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:55.246 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.662137+0000", 2024-09-13T06:41:55.246 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:55.246 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:55.246 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:55.247 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:55.247 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.662136+0000", 2024-09-13T06:41:55.247 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999986 2024-09-13T06:41:55.247 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:55.247 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:55.247 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:55.247 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.662142+0000", 2024-09-13T06:41:55.247 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.6930000000000001e-06 2024-09-13T06:41:55.247 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:55.247 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:55.247 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:55.247 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.662160+0000", 2024-09-13T06:41:55.247 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7863000000000002e-05 2024-09-13T06:41:55.248 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:55.248 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:55.248 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:55.248 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.662189+0000", 2024-09-13T06:41:55.248 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.8486000000000001e-05 2024-09-13T06:41:55.248 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:55.248 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:55.248 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:55.248 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700187+0000", 2024-09-13T06:41:55.248 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.037998331000000003 2024-09-13T06:41:55.248 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:55.248 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:55.248 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:55.249 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700193+0000", 2024-09-13T06:41:55.249 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.0909999999999998e-06 2024-09-13T06:41:55.249 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:55.249 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:55.249 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:55.249 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:55.249 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:55.249 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:41:55.250 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:41:55.246+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:41:55.251 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-13T06:41:55.351 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:41:55.349+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:41:55.381 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:41:55.381 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-13T06:41:55.382 INFO:teuthology.orchestra.run.smithi081.stdout: "num_ops": 0 2024-09-13T06:41:55.382 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:41:55.396 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-13T06:41:55.490 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:41:55.489+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:41:55.553 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:41:55.549+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:41:55.562 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:41:55.562 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-13T06:41:55.562 INFO:teuthology.orchestra.run.smithi081.stdout: "complaint_time": 30, 2024-09-13T06:41:55.562 INFO:teuthology.orchestra.run.smithi081.stdout: "num_blocked_ops": 0 2024-09-13T06:41:55.563 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:41:55.576 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-13T06:41:55.654 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-13T06:41:55.654 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:41:55.650+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:41:55.685 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-13T06:41:55.755 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:41:55.756 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 20, 2024-09-13T06:41:55.756 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 600, 2024-09-13T06:41:55.756 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [ 2024-09-13T06:41:55.756 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:55.756 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:37801 3.1 3:82e31015:::rbd_object_map.1121d8143c6e.0000000000000019:head [call] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e55)", 2024-09-13T06:41:55.756 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:05.646191+0000", 2024-09-13T06:41:55.756 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 110.10779025399999, 2024-09-13T06:41:55.756 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.72659507800000001, 2024-09-13T06:41:55.756 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:55.757 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:55.757 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:55.757 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:55.757 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:55.757 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 37801 2024-09-13T06:41:55.757 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:55.757 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:55.757 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:55.757 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:55.757 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:05.646191+0000", 2024-09-13T06:41:55.757 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:55.758 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:55.758 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:55.758 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:55.758 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:05.646191+0000", 2024-09-13T06:41:55.758 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:55.758 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:55.758 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:55.758 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:55.758 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:05.646188+0000", 2024-09-13T06:41:55.758 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999971 2024-09-13T06:41:55.758 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:55.759 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:55.759 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:55.759 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:05.646206+0000", 2024-09-13T06:41:55.759 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8182999999999999e-05 2024-09-13T06:41:55.759 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:55.759 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:55.759 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:55.759 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:05.646237+0000", 2024-09-13T06:41:55.759 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.1071000000000001e-05 2024-09-13T06:41:55.759 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:55.760 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:55.760 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:55.760 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:05.646251+0000", 2024-09-13T06:41:55.760 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3679000000000001e-05 2024-09-13T06:41:55.760 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:55.760 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:55.760 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:55.760 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:05.646321+0000", 2024-09-13T06:41:55.760 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.9831000000000003e-05 2024-09-13T06:41:55.760 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:55.760 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:55.761 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:41:55.761 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:05.646331+0000", 2024-09-13T06:41:55.761 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0242e-05 2024-09-13T06:41:55.761 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:55.761 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:55.761 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:55.761 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.371959+0000", 2024-09-13T06:41:55.761 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.72562817199999996 2024-09-13T06:41:55.761 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:55.761 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:55.762 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:55.762 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.372389+0000", 2024-09-13T06:41:55.762 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00042977400000000001 2024-09-13T06:41:55.762 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:55.762 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:55.762 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:55.762 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.372786+0000", 2024-09-13T06:41:55.762 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00039706099999999999 2024-09-13T06:41:55.762 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:55.762 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:55.763 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:55.763 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:55.763 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:55.763 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43009 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 489472~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:55.763 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.644660+0000", 2024-09-13T06:41:55.763 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 94.109321292000004, 2024-09-13T06:41:55.763 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123376071, 2024-09-13T06:41:55.763 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:55.763 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:55.763 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:55.763 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:55.764 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:55.764 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43009 2024-09-13T06:41:55.764 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:55.764 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:55.764 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:55.764 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:55.764 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.644660+0000", 2024-09-13T06:41:55.764 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:55.764 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:55.764 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:55.765 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:55.765 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.644660+0000", 2024-09-13T06:41:55.765 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:55.765 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:55.765 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:55.765 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:55.765 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.644659+0000", 2024-09-13T06:41:55.765 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:55.765 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:55.765 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:55.765 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:55.766 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.644662+0000", 2024-09-13T06:41:55.766 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4949999999999998e-06 2024-09-13T06:41:55.766 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:55.766 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:55.766 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:55.766 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.644669+0000", 2024-09-13T06:41:55.766 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.289e-06 2024-09-13T06:41:55.766 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:55.766 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:55.766 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:55.766 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.644674+0000", 2024-09-13T06:41:55.766 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.8840000000000002e-06 2024-09-13T06:41:55.767 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:55.767 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:55.767 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:55.767 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.767602+0000", 2024-09-13T06:41:55.767 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.122928158 2024-09-13T06:41:55.767 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:55.767 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:55.767 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:55.767 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.767676+0000", 2024-09-13T06:41:55.767 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3992999999999994e-05 2024-09-13T06:41:55.767 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:55.768 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:55.768 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:55.768 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.768036+0000", 2024-09-13T06:41:55.768 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00035966200000000001 2024-09-13T06:41:55.768 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:55.768 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:55.768 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:55.768 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:55.768 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:55.768 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43010 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 503808~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:55.768 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.644678+0000", 2024-09-13T06:41:55.769 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 94.109302966000001, 2024-09-13T06:41:55.769 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123728798, 2024-09-13T06:41:55.769 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:55.769 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:55.769 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:55.769 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:55.769 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:55.769 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43010 2024-09-13T06:41:55.769 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:55.769 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:55.769 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:55.770 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:55.770 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.644678+0000", 2024-09-13T06:41:55.770 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:55.770 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:55.770 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:55.770 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:55.770 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.644678+0000", 2024-09-13T06:41:55.770 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:55.770 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:55.770 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:55.770 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:55.770 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.644678+0000", 2024-09-13T06:41:55.771 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:55.771 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:55.771 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:55.771 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:55.771 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.644680+0000", 2024-09-13T06:41:55.771 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2050000000000001e-06 2024-09-13T06:41:55.771 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:55.771 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:55.771 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:55.771 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.644686+0000", 2024-09-13T06:41:55.771 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8440000000000003e-06 2024-09-13T06:41:55.772 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:55.772 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:55.772 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:55.772 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.644691+0000", 2024-09-13T06:41:55.772 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.118e-06 2024-09-13T06:41:55.772 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:55.772 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:55.772 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:55.772 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.768065+0000", 2024-09-13T06:41:55.772 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123374698 2024-09-13T06:41:55.772 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:55.772 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:55.772 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:55.773 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.768139+0000", 2024-09-13T06:41:55.773 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3934000000000001e-05 2024-09-13T06:41:55.773 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:55.773 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:55.773 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:55.773 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.768407+0000", 2024-09-13T06:41:55.773 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00026738800000000002 2024-09-13T06:41:55.773 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:55.773 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:55.773 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:55.773 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:55.774 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:55.774 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43181 3.17 3:ec5ebce4:::rbd_data.1121f5f2e1c0.0000000000000001:1f [read 319488~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:55.774 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.652968+0000", 2024-09-13T06:41:55.774 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 94.101012449999999, 2024-09-13T06:41:55.774 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.12363807, 2024-09-13T06:41:55.774 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:55.774 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:55.774 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:55.774 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:55.774 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:55.774 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43181 2024-09-13T06:41:55.774 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:55.774 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:55.775 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:55.775 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:55.775 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.652968+0000", 2024-09-13T06:41:55.775 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:55.775 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:55.775 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:55.775 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:55.775 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.652968+0000", 2024-09-13T06:41:55.775 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:55.775 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:55.775 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:55.775 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:55.776 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.652968+0000", 2024-09-13T06:41:55.776 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:55.776 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:55.776 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:55.776 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:55.776 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.652970+0000", 2024-09-13T06:41:55.776 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2409999999999998e-06 2024-09-13T06:41:55.776 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:55.776 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:55.776 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:55.776 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.652976+0000", 2024-09-13T06:41:55.777 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0079999999999999e-06 2024-09-13T06:41:55.777 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:55.777 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:55.777 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:55.777 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.652981+0000", 2024-09-13T06:41:55.777 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4390000000000002e-06 2024-09-13T06:41:55.777 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:55.777 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:55.777 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:55.777 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.776275+0000", 2024-09-13T06:41:55.777 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.12329396099999999 2024-09-13T06:41:55.777 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:55.778 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:55.778 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:55.778 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.776316+0000", 2024-09-13T06:41:55.778 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.1244e-05 2024-09-13T06:41:55.778 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:55.778 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:55.778 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:55.778 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.776607+0000", 2024-09-13T06:41:55.778 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00029051199999999999 2024-09-13T06:41:55.778 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:55.778 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:55.778 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:55.779 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:55.779 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:55.779 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43182 3.17 3:ec5ebce4:::rbd_data.1121f5f2e1c0.0000000000000001:1f [read 333824~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:55.779 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.652985+0000", 2024-09-13T06:41:55.779 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 94.100995640999997, 2024-09-13T06:41:55.779 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123926616, 2024-09-13T06:41:55.779 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:55.779 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:55.779 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:55.779 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:55.779 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:55.779 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43182 2024-09-13T06:41:55.779 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:55.780 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:55.780 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:55.780 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:55.780 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.652985+0000", 2024-09-13T06:41:55.780 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:55.780 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:55.780 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:55.780 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:55.780 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.652985+0000", 2024-09-13T06:41:55.780 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:55.781 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:55.781 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:55.781 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:55.781 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.652985+0000", 2024-09-13T06:41:55.781 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:55.781 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:55.781 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:55.781 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:55.781 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.652987+0000", 2024-09-13T06:41:55.781 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0899999999999999e-06 2024-09-13T06:41:55.781 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:55.781 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:55.782 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:55.782 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.652994+0000", 2024-09-13T06:41:55.782 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3100000000000003e-06 2024-09-13T06:41:55.782 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:55.782 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:55.782 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:55.782 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.653000+0000", 2024-09-13T06:41:55.782 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2020000000000003e-06 2024-09-13T06:41:55.782 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:55.782 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:55.782 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:55.783 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.776635+0000", 2024-09-13T06:41:55.783 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.12363529400000001 2024-09-13T06:41:55.783 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:55.783 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:55.783 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:55.783 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.776676+0000", 2024-09-13T06:41:55.783 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.0745999999999999e-05 2024-09-13T06:41:55.783 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:55.783 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:55.783 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:55.783 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.776912+0000", 2024-09-13T06:41:55.783 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00023631300000000001 2024-09-13T06:41:55.784 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:55.784 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:55.784 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:55.784 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:55.784 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:55.784 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43192 3.17 3:ec5ebce4:::rbd_data.1121f5f2e1c0.0000000000000001:1f [read 466944~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:55.784 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.656622+0000", 2024-09-13T06:41:55.784 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 94.097358584999995, 2024-09-13T06:41:55.784 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123503136, 2024-09-13T06:41:55.784 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:55.784 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:55.785 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:55.785 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:55.785 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:55.785 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43192 2024-09-13T06:41:55.785 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:55.785 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:55.785 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:55.785 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:55.785 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656622+0000", 2024-09-13T06:41:55.785 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:55.785 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:55.785 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:55.786 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:55.786 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656622+0000", 2024-09-13T06:41:55.786 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:55.786 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:55.786 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:55.786 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:55.786 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656622+0000", 2024-09-13T06:41:55.786 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:41:55.786 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:55.786 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:55.786 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:55.786 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656623+0000", 2024-09-13T06:41:55.787 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2079999999999999e-06 2024-09-13T06:41:55.787 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:55.787 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:55.787 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:55.787 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656627+0000", 2024-09-13T06:41:55.787 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.4819999999999999e-06 2024-09-13T06:41:55.787 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:55.787 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:55.787 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:55.787 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656629+0000", 2024-09-13T06:41:55.787 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.582e-06 2024-09-13T06:41:55.787 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:55.788 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:55.788 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:55.788 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.779866+0000", 2024-09-13T06:41:55.788 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.12323638100000001 2024-09-13T06:41:55.788 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:55.788 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:55.788 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:55.788 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.779905+0000", 2024-09-13T06:41:55.788 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.9529e-05 2024-09-13T06:41:55.788 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:55.788 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:55.789 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:55.789 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.780125+0000", 2024-09-13T06:41:55.789 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000220168 2024-09-13T06:41:55.789 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:55.789 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:55.789 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:55.789 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:55.789 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:55.789 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43193 3.17 3:ec5ebce4:::rbd_data.1121f5f2e1c0.0000000000000001:1f [read 481280~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:55.789 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.656635+0000", 2024-09-13T06:41:55.789 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 94.097346100999999, 2024-09-13T06:41:55.790 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.12374478999999999, 2024-09-13T06:41:55.790 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:55.790 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:55.790 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:55.790 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:55.790 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:55.790 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43193 2024-09-13T06:41:55.790 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:55.790 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:55.790 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:55.790 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:55.791 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656635+0000", 2024-09-13T06:41:55.791 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:55.791 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:55.791 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:55.791 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:55.791 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656635+0000", 2024-09-13T06:41:55.791 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:55.791 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:55.791 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:55.791 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:55.791 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656635+0000", 2024-09-13T06:41:55.792 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:41:55.792 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:55.792 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:55.792 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:55.792 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656636+0000", 2024-09-13T06:41:55.792 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.544e-06 2024-09-13T06:41:55.792 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:55.792 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:55.792 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:55.792 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656639+0000", 2024-09-13T06:41:55.792 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.0879999999999999e-06 2024-09-13T06:41:55.793 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:55.793 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:55.793 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:55.793 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656642+0000", 2024-09-13T06:41:55.793 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5799999999999999e-06 2024-09-13T06:41:55.793 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:55.793 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:55.793 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:55.793 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.780151+0000", 2024-09-13T06:41:55.793 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123509035 2024-09-13T06:41:55.793 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:55.794 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:55.794 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:55.794 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.780191+0000", 2024-09-13T06:41:55.794 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.9758000000000001e-05 2024-09-13T06:41:55.794 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:55.794 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:55.794 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:55.794 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.780380+0000", 2024-09-13T06:41:55.794 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000189023 2024-09-13T06:41:55.794 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:55.794 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:55.795 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:55.795 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:55.795 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:55.795 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43194 3.17 3:ec5ebce4:::rbd_data.1121f5f2e1c0.0000000000000001:1f [read 495616~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:55.795 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.656645+0000", 2024-09-13T06:41:55.795 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 94.097335447999995, 2024-09-13T06:41:55.795 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.124088483, 2024-09-13T06:41:55.795 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:55.795 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:55.795 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:55.795 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:55.795 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:55.796 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43194 2024-09-13T06:41:55.796 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:55.796 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:55.796 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:55.796 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:55.796 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656645+0000", 2024-09-13T06:41:55.796 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:55.796 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:55.796 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:55.796 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:55.796 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656645+0000", 2024-09-13T06:41:55.797 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:55.797 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:55.797 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:55.797 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:55.797 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656645+0000", 2024-09-13T06:41:55.797 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:55.797 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:55.797 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:55.797 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:55.797 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656647+0000", 2024-09-13T06:41:55.797 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9180000000000001e-06 2024-09-13T06:41:55.798 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:55.798 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:55.798 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:55.798 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656653+0000", 2024-09-13T06:41:55.798 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7860000000000002e-06 2024-09-13T06:41:55.798 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:55.798 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:55.798 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:55.798 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656658+0000", 2024-09-13T06:41:55.798 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6949999999999999e-06 2024-09-13T06:41:55.798 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:55.799 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:55.799 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:55.799 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.780406+0000", 2024-09-13T06:41:55.799 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123748657 2024-09-13T06:41:55.799 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:55.799 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:55.799 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:55.799 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.780446+0000", 2024-09-13T06:41:55.799 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.9360999999999998e-05 2024-09-13T06:41:55.799 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:55.799 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:55.800 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:55.800 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.780734+0000", 2024-09-13T06:41:55.800 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00028838399999999998 2024-09-13T06:41:55.800 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:55.800 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:55.800 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:55.800 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:55.800 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:55.800 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43240 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 106496~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:55.800 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.660672+0000", 2024-09-13T06:41:55.800 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 94.093309085000001, 2024-09-13T06:41:55.800 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123612707, 2024-09-13T06:41:55.800 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:55.801 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:55.801 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:55.801 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:55.801 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:55.801 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43240 2024-09-13T06:41:55.801 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:55.801 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:55.801 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:55.801 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:55.801 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660672+0000", 2024-09-13T06:41:55.802 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:55.802 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:55.802 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:55.802 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:55.802 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660672+0000", 2024-09-13T06:41:55.802 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:55.802 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:55.802 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:55.802 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:55.802 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660671+0000", 2024-09-13T06:41:55.802 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:55.803 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:55.803 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:55.803 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:55.803 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660673+0000", 2024-09-13T06:41:55.803 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.652e-06 2024-09-13T06:41:55.803 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:55.803 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:55.803 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:55.803 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660677+0000", 2024-09-13T06:41:55.803 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.2509999999999996e-06 2024-09-13T06:41:55.803 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:55.803 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:55.804 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:55.804 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660680+0000", 2024-09-13T06:41:55.804 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.8150000000000002e-06 2024-09-13T06:41:55.804 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:55.804 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:55.804 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:55.804 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.783596+0000", 2024-09-13T06:41:55.804 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.122915841 2024-09-13T06:41:55.804 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:55.804 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:55.804 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:55.805 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.783682+0000", 2024-09-13T06:41:55.805 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.5822999999999995e-05 2024-09-13T06:41:55.805 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:55.805 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:55.805 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:55.805 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.784285+0000", 2024-09-13T06:41:55.805 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00060276500000000001 2024-09-13T06:41:55.805 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:55.805 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:55.805 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:55.805 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:55.805 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:55.805 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43241 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 120832~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:55.805 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.660682+0000", 2024-09-13T06:41:55.806 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 94.093298509999997, 2024-09-13T06:41:55.806 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123958204, 2024-09-13T06:41:55.806 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:55.806 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:55.806 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:55.806 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:55.806 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:55.806 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43241 2024-09-13T06:41:55.806 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:55.806 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:55.806 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:55.806 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:55.807 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660682+0000", 2024-09-13T06:41:55.807 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:55.807 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:55.807 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:55.807 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:55.807 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660682+0000", 2024-09-13T06:41:55.807 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:55.807 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:55.807 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:55.807 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:55.807 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660682+0000", 2024-09-13T06:41:55.807 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:55.808 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:55.808 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:55.808 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:55.808 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660683+0000", 2024-09-13T06:41:55.808 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.308e-06 2024-09-13T06:41:55.808 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:55.808 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:55.808 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:55.808 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660686+0000", 2024-09-13T06:41:55.808 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.977e-06 2024-09-13T06:41:55.808 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:55.809 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:55.809 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:55.809 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660689+0000", 2024-09-13T06:41:55.809 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5830000000000001e-06 2024-09-13T06:41:55.809 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:55.809 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:55.809 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:55.809 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.784366+0000", 2024-09-13T06:41:55.809 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.12367713599999999 2024-09-13T06:41:55.809 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:55.809 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:55.809 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:55.810 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.784451+0000", 2024-09-13T06:41:55.810 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.4629999999999994e-05 2024-09-13T06:41:55.810 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:55.810 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:55.810 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:55.810 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.784641+0000", 2024-09-13T06:41:55.810 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00018984899999999999 2024-09-13T06:41:55.810 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:55.810 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:55.810 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:55.810 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:55.810 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:55.811 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43242 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 139264~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:55.811 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.660691+0000", 2024-09-13T06:41:55.811 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 94.093289532, 2024-09-13T06:41:55.811 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.124536443, 2024-09-13T06:41:55.811 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:55.811 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:55.811 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:55.811 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:55.811 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:55.811 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43242 2024-09-13T06:41:55.811 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:55.811 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:55.812 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:55.812 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:55.812 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660691+0000", 2024-09-13T06:41:55.812 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:55.812 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:55.812 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:55.812 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:55.812 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660691+0000", 2024-09-13T06:41:55.812 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:55.812 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:55.812 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:55.812 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:55.813 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660691+0000", 2024-09-13T06:41:55.813 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:41:55.813 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:55.813 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:55.813 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:55.813 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660696+0000", 2024-09-13T06:41:55.813 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0560000000000004e-06 2024-09-13T06:41:55.813 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:55.813 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:55.813 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:55.813 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660699+0000", 2024-09-13T06:41:55.814 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.2009999999999999e-06 2024-09-13T06:41:55.814 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:55.814 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:55.814 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:55.814 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660702+0000", 2024-09-13T06:41:55.814 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.633e-06 2024-09-13T06:41:55.814 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:55.814 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:55.814 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:55.814 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.784912+0000", 2024-09-13T06:41:55.814 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.124209497 2024-09-13T06:41:55.814 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:55.814 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:55.815 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:55.815 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.784995+0000", 2024-09-13T06:41:55.815 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.3891e-05 2024-09-13T06:41:55.815 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:55.815 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:55.815 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:55.815 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.785228+0000", 2024-09-13T06:41:55.815 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00023237400000000001 2024-09-13T06:41:55.815 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:55.815 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:55.815 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:55.815 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:55.816 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:55.816 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43243 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 153600~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:55.816 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.660705+0000", 2024-09-13T06:41:55.816 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 94.093276199000002, 2024-09-13T06:41:55.816 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.124825835, 2024-09-13T06:41:55.816 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:55.816 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:55.816 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:55.816 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:55.816 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:55.816 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43243 2024-09-13T06:41:55.817 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:55.817 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:55.817 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:55.817 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:55.817 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660705+0000", 2024-09-13T06:41:55.817 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:55.817 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:55.817 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:55.817 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:55.817 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660705+0000", 2024-09-13T06:41:55.817 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:55.817 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:55.818 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:55.818 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:55.818 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660705+0000", 2024-09-13T06:41:55.818 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:41:55.818 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:55.818 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:55.818 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:55.818 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660706+0000", 2024-09-13T06:41:55.818 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4339999999999999e-06 2024-09-13T06:41:55.818 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:55.818 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:55.818 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:55.819 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660709+0000", 2024-09-13T06:41:55.819 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9000000000000002e-06 2024-09-13T06:41:55.819 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:55.819 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:55.819 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:55.819 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660712+0000", 2024-09-13T06:41:55.819 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.0589999999999998e-06 2024-09-13T06:41:55.819 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:55.819 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:55.819 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:55.819 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.785318+0000", 2024-09-13T06:41:55.819 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.124606299 2024-09-13T06:41:55.819 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:55.820 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:55.820 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:55.820 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.785361+0000", 2024-09-13T06:41:55.820 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.3214999999999999e-05 2024-09-13T06:41:55.820 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:55.820 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:55.820 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:55.820 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.785531+0000", 2024-09-13T06:41:55.820 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00016914400000000001 2024-09-13T06:41:55.820 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:55.820 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:55.820 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:55.821 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:55.821 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:55.821 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43244 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 167936~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:55.821 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.660714+0000", 2024-09-13T06:41:55.821 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 94.093266786000001, 2024-09-13T06:41:55.821 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.125073248, 2024-09-13T06:41:55.821 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:55.821 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:55.821 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:55.821 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:55.821 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:55.821 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43244 2024-09-13T06:41:55.822 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:55.822 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:55.822 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:55.822 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:55.822 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660714+0000", 2024-09-13T06:41:55.822 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:55.822 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:55.822 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:55.822 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:55.822 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660714+0000", 2024-09-13T06:41:55.822 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:55.823 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:55.823 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:55.823 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:55.823 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660714+0000", 2024-09-13T06:41:55.823 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:41:55.823 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:55.823 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:55.823 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:55.823 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660715+0000", 2024-09-13T06:41:55.823 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2330000000000001e-06 2024-09-13T06:41:55.823 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:55.824 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:55.824 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:55.824 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660718+0000", 2024-09-13T06:41:55.824 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9569999999999998e-06 2024-09-13T06:41:55.824 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:55.824 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:55.824 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:55.824 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660721+0000", 2024-09-13T06:41:55.824 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.678e-06 2024-09-13T06:41:55.824 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:55.824 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:55.825 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:55.825 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.785557+0000", 2024-09-13T06:41:55.825 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.12483633199999999 2024-09-13T06:41:55.825 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:55.825 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:55.825 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:55.825 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.785618+0000", 2024-09-13T06:41:55.825 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0686000000000001e-05 2024-09-13T06:41:55.825 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:55.825 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:55.826 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:55.826 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.785787+0000", 2024-09-13T06:41:55.826 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00016957699999999999 2024-09-13T06:41:55.826 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:55.826 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:55.826 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:55.826 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:55.826 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:55.826 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43254 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 315392~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:55.826 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.664717+0000", 2024-09-13T06:41:55.827 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 94.089264217999997, 2024-09-13T06:41:55.827 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.12357108, 2024-09-13T06:41:55.827 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:55.827 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:55.827 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:55.827 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:55.827 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:55.827 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43254 2024-09-13T06:41:55.827 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:55.827 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:55.827 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:55.828 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:55.828 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664717+0000", 2024-09-13T06:41:55.828 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:55.828 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:55.828 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:55.828 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:55.828 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664717+0000", 2024-09-13T06:41:55.828 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:55.828 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:55.828 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:55.828 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:55.828 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664716+0000", 2024-09-13T06:41:55.829 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:55.829 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:55.829 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:55.829 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:55.829 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664724+0000", 2024-09-13T06:41:55.829 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.7109999999999995e-06 2024-09-13T06:41:55.829 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:55.829 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:55.829 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:55.829 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664732+0000", 2024-09-13T06:41:55.829 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.8399999999999995e-06 2024-09-13T06:41:55.830 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:55.830 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:55.830 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:55.830 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664738+0000", 2024-09-13T06:41:55.830 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.879e-06 2024-09-13T06:41:55.830 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:55.830 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:55.830 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:55.830 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.788018+0000", 2024-09-13T06:41:55.830 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123280719 2024-09-13T06:41:55.830 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:55.830 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:55.831 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:55.831 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.788119+0000", 2024-09-13T06:41:55.831 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000100558 2024-09-13T06:41:55.831 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:55.831 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:55.831 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:55.831 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.788288+0000", 2024-09-13T06:41:55.831 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000168751 2024-09-13T06:41:55.831 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:55.831 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:55.831 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:55.831 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:55.831 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:55.832 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43255 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 329728~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:55.832 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.664743+0000", 2024-09-13T06:41:55.832 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 94.089238222000006, 2024-09-13T06:41:55.832 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.12381711500000001, 2024-09-13T06:41:55.832 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:55.832 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:55.832 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:55.832 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:55.832 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:55.832 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43255 2024-09-13T06:41:55.833 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:55.833 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:55.833 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:55.833 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:55.833 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664743+0000", 2024-09-13T06:41:55.833 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:55.833 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:55.833 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:55.833 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:55.834 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664743+0000", 2024-09-13T06:41:55.834 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:55.834 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:55.834 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:55.834 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:55.834 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664742+0000", 2024-09-13T06:41:55.834 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:55.834 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:55.834 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:55.834 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:55.834 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664745+0000", 2024-09-13T06:41:55.835 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.7269999999999999e-06 2024-09-13T06:41:55.835 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:55.835 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:55.835 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:55.835 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664753+0000", 2024-09-13T06:41:55.835 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.8709999999999997e-06 2024-09-13T06:41:55.835 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:55.835 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:55.835 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:55.835 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664758+0000", 2024-09-13T06:41:55.836 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2220000000000001e-06 2024-09-13T06:41:55.836 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:55.836 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:55.836 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:55.836 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.788314+0000", 2024-09-13T06:41:55.836 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123555545 2024-09-13T06:41:55.836 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:55.836 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:55.836 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:55.836 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.788368+0000", 2024-09-13T06:41:55.836 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3928999999999998e-05 2024-09-13T06:41:55.836 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:55.837 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:55.837 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:55.837 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.788560+0000", 2024-09-13T06:41:55.837 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000192237 2024-09-13T06:41:55.837 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:55.837 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:55.837 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:55.837 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:55.837 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:55.837 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43256 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 344064~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:55.837 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.664763+0000", 2024-09-13T06:41:55.838 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 94.089218275999997, 2024-09-13T06:41:55.838 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.12418359399999999, 2024-09-13T06:41:55.838 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:55.838 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:55.838 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:55.838 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:55.838 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:55.838 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43256 2024-09-13T06:41:55.838 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:55.838 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:55.838 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:55.838 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:55.839 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664763+0000", 2024-09-13T06:41:55.839 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:55.839 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:55.839 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:55.839 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:55.839 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664763+0000", 2024-09-13T06:41:55.839 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:55.839 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:55.839 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:55.839 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:55.839 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664762+0000", 2024-09-13T06:41:55.839 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:55.840 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:55.840 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:55.840 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:55.840 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664765+0000", 2024-09-13T06:41:55.840 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3290000000000001e-06 2024-09-13T06:41:55.840 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:55.840 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:55.840 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:55.840 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664771+0000", 2024-09-13T06:41:55.840 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.1319999999999999e-06 2024-09-13T06:41:55.840 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:55.841 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:55.841 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:55.841 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664776+0000", 2024-09-13T06:41:55.841 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.8840000000000002e-06 2024-09-13T06:41:55.841 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:55.841 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:55.841 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:55.841 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.788598+0000", 2024-09-13T06:41:55.841 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123821979 2024-09-13T06:41:55.841 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:55.841 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:55.842 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:55.842 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.788680+0000", 2024-09-13T06:41:55.842 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.2367999999999995e-05 2024-09-13T06:41:55.842 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:55.842 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:55.842 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:55.842 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.788946+0000", 2024-09-13T06:41:55.842 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00026629799999999999 2024-09-13T06:41:55.842 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:55.842 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:55.842 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:55.843 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:55.843 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:55.843 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43265 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 477184~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:55.843 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.669414+0000", 2024-09-13T06:41:55.843 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 94.084566640000006, 2024-09-13T06:41:55.843 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123446973, 2024-09-13T06:41:55.843 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:55.843 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:55.843 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:55.843 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:55.844 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:55.844 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43265 2024-09-13T06:41:55.844 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:55.844 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:55.844 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:55.844 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:55.844 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669414+0000", 2024-09-13T06:41:55.844 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:55.844 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:55.844 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:55.844 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:55.845 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669414+0000", 2024-09-13T06:41:55.845 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:55.845 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:55.845 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:55.845 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:55.845 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669414+0000", 2024-09-13T06:41:55.845 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:55.845 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:55.845 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:55.845 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:55.845 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669416+0000", 2024-09-13T06:41:55.845 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.317e-06 2024-09-13T06:41:55.845 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:55.846 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:55.846 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:55.846 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669425+0000", 2024-09-13T06:41:55.846 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.0650000000000005e-06 2024-09-13T06:41:55.846 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:55.846 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:55.846 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:55.846 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669430+0000", 2024-09-13T06:41:55.846 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5079999999999999e-06 2024-09-13T06:41:55.846 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:55.847 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:55.847 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:55.847 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.792649+0000", 2024-09-13T06:41:55.847 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123219328 2024-09-13T06:41:55.847 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:55.847 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:55.847 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:55.847 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.792695+0000", 2024-09-13T06:41:55.847 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5476999999999998e-05 2024-09-13T06:41:55.847 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:55.847 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:55.848 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:55.848 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.792861+0000", 2024-09-13T06:41:55.848 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00016658999999999999 2024-09-13T06:41:55.848 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:55.848 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:55.848 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:55.848 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:55.848 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:55.848 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43266 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 491520~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:55.848 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.669434+0000", 2024-09-13T06:41:55.848 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 94.084546517999996, 2024-09-13T06:41:55.848 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123685267, 2024-09-13T06:41:55.849 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:55.849 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:55.849 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:55.849 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:55.849 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:55.849 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43266 2024-09-13T06:41:55.849 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:55.849 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:55.849 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:55.850 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:55.850 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669434+0000", 2024-09-13T06:41:55.850 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:55.850 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:55.850 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:55.850 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:55.850 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669434+0000", 2024-09-13T06:41:55.850 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:55.850 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:55.850 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:55.850 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:55.851 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669434+0000", 2024-09-13T06:41:55.851 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:55.851 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:55.851 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:55.851 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:55.851 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669441+0000", 2024-09-13T06:41:55.851 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3019999999999997e-06 2024-09-13T06:41:55.851 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:55.851 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:55.851 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:55.851 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669451+0000", 2024-09-13T06:41:55.851 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.6379999999999999e-06 2024-09-13T06:41:55.852 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:55.852 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:55.852 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:55.852 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669456+0000", 2024-09-13T06:41:55.852 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.361e-06 2024-09-13T06:41:55.852 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:55.852 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:55.852 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:55.852 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.792879+0000", 2024-09-13T06:41:55.852 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123422686 2024-09-13T06:41:55.852 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:55.853 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:55.853 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:55.853 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.792923+0000", 2024-09-13T06:41:55.853 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4035000000000001e-05 2024-09-13T06:41:55.853 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:55.853 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:55.853 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:55.853 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.793120+0000", 2024-09-13T06:41:55.853 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00019660899999999999 2024-09-13T06:41:55.853 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:55.853 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:55.854 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:55.854 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:55.854 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:55.854 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43267 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 505856~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:55.854 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.669461+0000", 2024-09-13T06:41:55.854 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 94.084519721999996, 2024-09-13T06:41:55.854 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123933711, 2024-09-13T06:41:55.854 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:55.854 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:55.854 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:55.854 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:55.855 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:55.855 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43267 2024-09-13T06:41:55.855 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:55.855 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:55.855 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:55.855 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:55.855 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669461+0000", 2024-09-13T06:41:55.855 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:55.855 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:55.855 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:55.855 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:55.855 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669461+0000", 2024-09-13T06:41:55.856 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:55.856 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:55.856 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:55.856 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:55.856 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669461+0000", 2024-09-13T06:41:55.856 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:55.856 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:55.856 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:55.856 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:55.856 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669463+0000", 2024-09-13T06:41:55.856 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5629999999999999e-06 2024-09-13T06:41:55.856 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:55.857 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:55.857 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:55.857 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669473+0000", 2024-09-13T06:41:55.857 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.9520000000000006e-06 2024-09-13T06:41:55.857 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:55.857 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:55.857 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:55.857 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669479+0000", 2024-09-13T06:41:55.857 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8540000000000002e-06 2024-09-13T06:41:55.857 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:55.857 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:55.858 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:55.858 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.793137+0000", 2024-09-13T06:41:55.858 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.12365825699999999 2024-09-13T06:41:55.858 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:55.858 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:55.858 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:55.858 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.793181+0000", 2024-09-13T06:41:55.858 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.3773999999999998e-05 2024-09-13T06:41:55.858 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:55.858 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:55.858 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:55.859 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.793395+0000", 2024-09-13T06:41:55.859 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00021372399999999999 2024-09-13T06:41:55.859 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:55.859 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:55.859 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:55.859 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:55.859 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:55.859 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43268 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 520192~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:55.859 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.669484+0000", 2024-09-13T06:41:55.859 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 94.084496936999997, 2024-09-13T06:41:55.859 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.12441057899999999, 2024-09-13T06:41:55.859 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:55.860 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:55.860 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:55.860 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:55.860 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:55.860 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43268 2024-09-13T06:41:55.860 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:55.860 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:55.860 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:55.860 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:55.860 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669484+0000", 2024-09-13T06:41:55.860 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:55.861 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:55.861 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:55.861 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:55.861 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669484+0000", 2024-09-13T06:41:55.861 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:55.861 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:55.861 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:55.861 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:55.861 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669484+0000", 2024-09-13T06:41:55.861 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:55.861 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:55.862 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:55.862 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:55.862 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669486+0000", 2024-09-13T06:41:55.862 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6120000000000001e-06 2024-09-13T06:41:55.862 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:55.862 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:55.862 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:55.862 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669494+0000", 2024-09-13T06:41:55.862 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4819999999999997e-06 2024-09-13T06:41:55.862 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:55.862 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:55.862 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:55.863 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669497+0000", 2024-09-13T06:41:55.863 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9790000000000002e-06 2024-09-13T06:41:55.863 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:55.863 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:55.863 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:55.863 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.793559+0000", 2024-09-13T06:41:55.863 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.124062436 2024-09-13T06:41:55.863 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:55.863 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:55.863 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:55.863 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.793603+0000", 2024-09-13T06:41:55.863 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.3764999999999999e-05 2024-09-13T06:41:55.864 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:55.864 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:55.864 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:55.864 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.793895+0000", 2024-09-13T06:41:55.864 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00029168299999999999 2024-09-13T06:41:55.864 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:55.864 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:55.864 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:55.864 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:55.864 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:55.864 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:41:55.865 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:41:55.753+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:41:55.866 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-13T06:41:55.866 INFO:teuthology.orchestra.run.smithi081.stdout:osd.0: {} 2024-09-13T06:41:55.867 INFO:teuthology.orchestra.run.smithi081.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-13T06:41:55.867 INFO:teuthology.orchestra.run.smithi081.stdout:osd.1: {} 2024-09-13T06:41:55.867 INFO:teuthology.orchestra.run.smithi081.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-13T06:41:55.868 INFO:teuthology.orchestra.run.smithi081.stdout:osd.2: {} 2024-09-13T06:41:55.868 INFO:teuthology.orchestra.run.smithi081.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-13T06:41:55.868 INFO:teuthology.orchestra.run.smithi081.stdout:checking clone #27, image image_client.0-clone27 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent28 2024-09-13T06:41:55.872 INFO:teuthology.orchestra.run.smithi081.stdout:osd.3: {} 2024-09-13T06:41:55.873 INFO:teuthology.orchestra.run.smithi081.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-13T06:41:55.873 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:41:55.869+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:41:55.906 INFO:teuthology.orchestra.run.smithi081.stdout:osd.4: {} 2024-09-13T06:41:55.906 INFO:teuthology.orchestra.run.smithi081.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-13T06:41:55.941 INFO:teuthology.orchestra.run.smithi081.stdout:osd.5: {} 2024-09-13T06:41:55.942 INFO:teuthology.orchestra.run.smithi081.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-13T06:41:55.962 INFO:teuthology.orchestra.run.smithi081.stdout:osd.6: {} 2024-09-13T06:41:55.963 INFO:teuthology.orchestra.run.smithi081.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-13T06:41:55.963 INFO:teuthology.orchestra.run.smithi081.stderr:Error ENXIO: problem getting command descriptions from osd.7 2024-09-13T06:41:55.966 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-13T06:41:55.967 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-13T06:41:55.971 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:41:55.966+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:41:55.994 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:41:55.994 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:41:56.011 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-13T06:41:56.102 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:41:56.101+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:41:56.172 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:41:56.170+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:41:56.177 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:41:56.177 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:41:56.193 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-13T06:41:56.273 INFO:tasks.ceph.osd.6.smithi139.stderr:2024-09-13T06:41:56.270+0000 7fcd02c5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26385) UID: 0 2024-09-13T06:41:56.283 INFO:teuthology.orchestra.run.smithi081.stdout:4168 write 0xdf78c13 thru 0xdf7ff8c (0x737a bytes) 2024-09-13T06:41:56.290 INFO:teuthology.orchestra.run.smithi081.stdout:4169 writesame 0x4bc0bef thru 0x4bc9b53 data_size 0x1(0x8f65 bytes) 2024-09-13T06:41:56.317 INFO:teuthology.orchestra.run.smithi081.stdout:4171 read 0x67c78f1 thru 0x67d6dd5 (0xf4e5 bytes) 2024-09-13T06:41:56.318 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:41:56.318 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:41:56.319 INFO:teuthology.orchestra.run.smithi081.stdout:4174 punch from 0x8329340 to 0x833766d, (0xe32d bytes) 2024-09-13T06:41:56.319 INFO:teuthology.orchestra.run.smithi081.stdout:4176 writesame 0x24b2a69 thru 0x24bafa3 data_size 0x1(0x853b bytes) 2024-09-13T06:41:56.360 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:41:56.361 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:41:56.365 INFO:teuthology.orchestra.run.smithi081.stdout:4177 write 0x271510c thru 0x272425d (0xf152 bytes) 2024-09-13T06:41:56.369 INFO:teuthology.orchestra.run.smithi081.stdout:4178 punch from 0x6c4268f to 0x6c50d0f, (0xe680 bytes) 2024-09-13T06:41:56.369 INFO:teuthology.orchestra.run.smithi081.stdout:4179 read 0x897279 thru 0x898506 (0x128e bytes) 2024-09-13T06:41:56.371 INFO:teuthology.orchestra.run.smithi081.stdout:4181 read 0x75a79ea thru 0x75b63eb (0xea02 bytes) 2024-09-13T06:41:56.371 INFO:teuthology.orchestra.run.smithi081.stdout:4182 write 0xc5c2cec thru 0xc5c6f48 (0x425d bytes) 2024-09-13T06:41:56.374 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:41:56.373+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:41:56.375 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-13T06:41:56.400 INFO:teuthology.orchestra.run.smithi081.stdout:4183 trunc from 0xdf7ff8d to 0x3a01cf5 2024-09-13T06:41:56.425 INFO:teuthology.orchestra.run.smithi081.stdout:4184 read 0x26e8069 thru 0x26ed082 (0x501a bytes) 2024-09-13T06:41:56.437 INFO:teuthology.orchestra.run.smithi081.stdout:4186 trunc from 0x3a01cf5 to 0xb8700f9 2024-09-13T06:41:56.446 INFO:teuthology.orchestra.run.smithi081.stdout:4187 write 0xaf1a4cd thru 0xaf1c6ad (0x21e1 bytes) 2024-09-13T06:41:56.450 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:41:56.453 INFO:teuthology.orchestra.run.smithi081.stdout:4190 trunc from 0xb8700f9 to 0x9744eca 2024-09-13T06:41:56.475 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:41:56.473+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:41:56.488 INFO:teuthology.orchestra.run.smithi081.stdout:4192 trunc from 0x9744eca to 0x112f1 2024-09-13T06:41:56.537 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:41:56.537 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:41:56.552 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-13T06:41:56.576 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:41:56.570+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:41:56.602 INFO:teuthology.orchestra.run.smithi081.stdout:4193 writesame 0x5bed551 thru 0x5bf0a23 data_size 0x1(0x34d3 bytes) 2024-09-13T06:41:56.602 INFO:teuthology.orchestra.run.smithi081.stdout:4194 read 0x28d5fce thru 0x28e3bba (0xdbed bytes) 2024-09-13T06:41:56.602 INFO:teuthology.orchestra.run.smithi081.stdout:4195 punch from 0x523fb4c to 0x5246ab6, (0x6f6a bytes) 2024-09-13T06:41:56.618 INFO:teuthology.orchestra.run.smithi081.stdout:4197 writesame 0x7fbe4a1 thru 0x7fcb65d data_size 0x1(0xd1bd bytes) 2024-09-13T06:41:56.640 INFO:teuthology.orchestra.run.smithi081.stdout:4198 write 0xc4799dd thru 0xc47f81e (0x5e42 bytes) 2024-09-13T06:41:56.647 INFO:teuthology.orchestra.run.smithi081.stdout:4199 punch from 0x95d695a to 0x95dc716, (0x5dbc bytes) 2024-09-13T06:41:56.647 INFO:teuthology.orchestra.run.smithi081.stdout:4200 write 0x61bf9a7 thru 0x61caaff (0xb159 bytes) 2024-09-13T06:41:56.666 INFO:teuthology.orchestra.run.smithi081.stdout:4201 writesame 0xd0853c8 thru 0xd095104 data_size 0x1(0xfd3d bytes) 2024-09-13T06:41:56.666 INFO:teuthology.orchestra.run.smithi081.stdout:4202 punch from 0xa11f7cb to 0xa125a2c, (0x6261 bytes) 2024-09-13T06:41:56.666 INFO:teuthology.orchestra.run.smithi081.stdout:4203 writesame 0xa3aa398 thru 0xa3b222f data_size 0x4(0x7e98 bytes) 2024-09-13T06:41:56.676 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:41:56.673+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:41:56.677 INFO:teuthology.orchestra.run.smithi081.stdout:4204 read 0x6ea6451 thru 0x6eacd92 (0x6942 bytes) 2024-09-13T06:41:56.677 INFO:teuthology.orchestra.run.smithi081.stdout:4206 write 0x8f94912 thru 0x8f9ff3e (0xb62d bytes) 2024-09-13T06:41:56.687 INFO:teuthology.orchestra.run.smithi081.stdout:4208 read 0xbf80808 thru 0xbf89c19 (0x9412 bytes) 2024-09-13T06:41:56.687 INFO:teuthology.orchestra.run.smithi081.stdout:4210 writesame 0x41c7121 thru 0x41c82ab data_size 0x3(0x118b bytes) 2024-09-13T06:41:56.693 INFO:teuthology.orchestra.run.smithi081.stdout:4211 read 0x9b03e20 thru 0x9b0d1a2 (0x9383 bytes) 2024-09-13T06:41:56.694 INFO:teuthology.orchestra.run.smithi081.stdout:4212 punch from 0x63dfc6c to 0x63ecbe4, (0xcf78 bytes) 2024-09-13T06:41:56.694 INFO:teuthology.orchestra.run.smithi081.stdout:4213 read 0x1c2690f thru 0x1c27317 (0xa09 bytes) 2024-09-13T06:41:56.694 INFO:teuthology.orchestra.run.smithi081.stdout:4214 read 0x1402f0a thru 0x140a49e (0x7595 bytes) 2024-09-13T06:41:56.694 INFO:teuthology.orchestra.run.smithi081.stdout:4215 writesame 0x5c49584 thru 0x5c58d3b data_size 0x4(0xf7b8 bytes) 2024-09-13T06:41:56.702 INFO:teuthology.orchestra.run.smithi081.stderr:noscrub is unset 2024-09-13T06:41:56.712 INFO:teuthology.orchestra.run.smithi081.stdout:4216 writesame 0x44758e5 thru 0x44848e5 data_size 0x1(0xf001 bytes) 2024-09-13T06:41:56.731 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:41:56.731 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:41:56.738 INFO:teuthology.orchestra.run.smithi081.stdout:4218 read 0x4109d01 thru 0x4117a0e (0xdd0e bytes) 2024-09-13T06:41:56.738 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:41:56.739 INFO:teuthology.orchestra.run.smithi081.stdout:4220 write 0x5c3305f thru 0x5c3faf3 (0xca95 bytes) 2024-09-13T06:41:56.744 INFO:teuthology.orchestra.run.smithi081.stdout:4221 punch from 0xb9f5542 to 0xb9fbc8d, (0x674b bytes) 2024-09-13T06:41:56.746 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-13T06:41:56.754 INFO:teuthology.orchestra.run.smithi081.stdout:4222 writesame 0xdb3f580 thru 0xdb4eafa data_size 0x1d(0xf57b bytes) 2024-09-13T06:41:56.754 INFO:teuthology.orchestra.run.smithi081.stdout:4223 punch from 0x546cffe to 0x546df35, (0xf37 bytes) 2024-09-13T06:41:56.754 INFO:teuthology.orchestra.run.smithi081.stdout:4224 write 0x8fbb013 thru 0x8fc5240 (0xa22e bytes) 2024-09-13T06:41:56.769 INFO:teuthology.orchestra.run.smithi081.stdout:4225 write 0xddbb53f thru 0xddc3cc8 (0x878a bytes) 2024-09-13T06:41:56.777 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:41:56.773+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:41:56.778 INFO:teuthology.orchestra.run.smithi081.stdout:4226 read 0xa45658d thru 0xa45fa6f (0x94e3 bytes) 2024-09-13T06:41:56.778 INFO:teuthology.orchestra.run.smithi081.stdout:4227 write 0xcf75dfe thru 0xcf7ed9f (0x8fa2 bytes) 2024-09-13T06:41:56.784 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:41:56.784 INFO:teuthology.orchestra.run.smithi081.stdout:4229 read 0x1e04533 thru 0x1e13226 (0xecf4 bytes) 2024-09-13T06:41:56.784 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:41:56.784 INFO:teuthology.orchestra.run.smithi081.stdout:4231 write 0xc2dd23c thru 0xc2ec9c9 (0xf78e bytes) 2024-09-13T06:41:56.790 INFO:teuthology.orchestra.run.smithi081.stdout:4232 write 0x811a5b8 thru 0x8123f3f (0x9988 bytes) 2024-09-13T06:41:56.800 INFO:teuthology.orchestra.run.smithi081.stdout:4233 trunc from 0xddc3cc9 to 0xbb2504a 2024-09-13T06:41:56.831 INFO:teuthology.orchestra.run.smithi081.stdout:4235 trunc from 0xbb2504a to 0x478d8bd 2024-09-13T06:41:56.855 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:41:56.871 INFO:teuthology.orchestra.run.smithi081.stdout:4237 write 0x8116855 thru 0x811f5eb (0x8d97 bytes) 2024-09-13T06:41:56.878 INFO:teuthology.orchestra.run.smithi081.stdout:4238 read 0x7ceda3d thru 0x7cf6772 (0x8d36 bytes) 2024-09-13T06:41:56.878 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:41:56.877+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:41:56.879 INFO:teuthology.orchestra.run.smithi081.stdout:4239 read 0x6c17926 thru 0x6c225a9 (0xac84 bytes) 2024-09-13T06:41:56.879 INFO:teuthology.orchestra.run.smithi081.stdout:4240 read 0x7f0c303 thru 0x7f15489 (0x9187 bytes) 2024-09-13T06:41:56.879 INFO:teuthology.orchestra.run.smithi081.stdout:4241 write 0x59bc5df thru 0x59c3916 (0x7338 bytes) 2024-09-13T06:41:56.884 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:41:56.885 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:41:56.904 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-13T06:41:56.905 INFO:teuthology.orchestra.run.smithi081.stdout:4242 write 0xbba375c thru 0xbbaeca8 (0xb54d bytes) 2024-09-13T06:41:56.912 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:41:56.912 INFO:teuthology.orchestra.run.smithi081.stdout:4245 read 0xb757226 thru 0xb7649ac (0xd787 bytes) 2024-09-13T06:41:56.913 INFO:teuthology.orchestra.run.smithi081.stdout:4246 write 0x81e412f thru 0x81f3c49 (0xfb1b bytes) 2024-09-13T06:41:56.931 INFO:teuthology.orchestra.run.smithi081.stdout:4247 writesame 0xd06a37d thru 0xd079e4a data_size 0x7b(0xface bytes) 2024-09-13T06:41:56.931 INFO:teuthology.orchestra.run.smithi081.stdout:4248 writesame 0x328e382 thru 0x32942a5 data_size 0x2(0x5f24 bytes) 2024-09-13T06:41:56.948 INFO:teuthology.orchestra.run.smithi081.stdout:4250 read 0x9ffc106 thru 0xa006de2 (0xacdd bytes) 2024-09-13T06:41:56.949 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:41:56.949 INFO:teuthology.orchestra.run.smithi081.stdout:4253 punch from 0xafdcd7a to 0xafe10df, (0x4365 bytes) 2024-09-13T06:41:56.949 INFO:teuthology.orchestra.run.smithi081.stdout:4254 read 0x8b10d21 thru 0x8b11d3e (0x101e bytes) 2024-09-13T06:41:56.949 INFO:teuthology.orchestra.run.smithi081.stdout:4255 punch from 0x9355541 to 0x9355675, (0x134 bytes) 2024-09-13T06:41:56.949 INFO:teuthology.orchestra.run.smithi081.stdout:4256 read 0x99259ee thru 0x992a675 (0x4c88 bytes) 2024-09-13T06:41:56.949 INFO:teuthology.orchestra.run.smithi081.stdout:4259 clone 30 order 21 su 32768 sc 5 2024-09-13T06:41:56.979 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:41:56.977+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:41:57.021 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:41:57.022 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:41:57.036 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-13T06:41:57.080 INFO:tasks.ceph.osd.6.smithi139.stderr:2024-09-13T06:41:57.078+0000 7fcd02c5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26385) UID: 0 2024-09-13T06:41:57.181 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:41:57.177+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:41:57.201 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:41:57.201 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:41:57.215 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-13T06:41:57.302 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:41:57.301+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:41:57.382 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:41:57.382 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:41:57.383 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:41:57.381+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:41:57.396 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-13T06:41:57.483 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:41:57.478+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:41:57.530 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:41:57.530 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:41:57.544 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-13T06:41:57.585 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:41:57.582+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:41:57.686 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:41:57.685+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:41:57.701 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:41:57.701 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:41:57.716 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 4, 6, 7, 5, 3] out_osds: [] dead_osds: [7] live_osds: [0, 1, 2, 3, 4, 5, 6] 2024-09-13T06:41:57.716 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-13T06:41:57.716 INFO:tasks.thrashosds.thrasher:reset_purged_snaps_last 2024-09-13T06:41:57.717 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 reset_purged_snaps_last 2024-09-13T06:41:57.718 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-13T06:41:57.787 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:41:57.782+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:41:57.839 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:41:57.840 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:41:57.854 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-13T06:41:57.888 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:41:57.885+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:41:57.896 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 reset_purged_snaps_last 2024-09-13T06:41:57.968 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-13T06:41:58.017 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:41:58.018 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:41:58.026 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:41:58.025+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:41:58.031 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-13T06:41:58.090 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:41:58.086+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:41:58.099 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 reset_purged_snaps_last 2024-09-13T06:41:58.118 INFO:teuthology.orchestra.run.smithi081.stdout:osd.0: {} 2024-09-13T06:41:58.119 INFO:teuthology.orchestra.run.smithi081.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-13T06:41:58.136 INFO:teuthology.orchestra.run.smithi081.stdout:osd.1: {} 2024-09-13T06:41:58.137 INFO:teuthology.orchestra.run.smithi081.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-13T06:41:58.148 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:41:58.148 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:41:58.152 INFO:teuthology.orchestra.run.smithi081.stdout:osd.2: {} 2024-09-13T06:41:58.153 INFO:teuthology.orchestra.run.smithi081.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-13T06:41:58.162 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-13T06:41:58.169 INFO:teuthology.orchestra.run.smithi081.stdout:osd.3: {} 2024-09-13T06:41:58.169 INFO:teuthology.orchestra.run.smithi081.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-13T06:41:58.189 INFO:teuthology.orchestra.run.smithi081.stdout:osd.4: {} 2024-09-13T06:41:58.189 INFO:teuthology.orchestra.run.smithi081.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-13T06:41:58.190 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:41:58.189+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:41:58.206 INFO:teuthology.orchestra.run.smithi081.stdout:osd.5: {} 2024-09-13T06:41:58.207 INFO:teuthology.orchestra.run.smithi081.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-13T06:41:58.224 INFO:teuthology.orchestra.run.smithi081.stdout:osd.6: {} 2024-09-13T06:41:58.225 INFO:teuthology.orchestra.run.smithi081.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-13T06:41:58.225 INFO:teuthology.orchestra.run.smithi081.stderr:Error ENXIO: problem getting command descriptions from osd.7 2024-09-13T06:41:58.229 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-13T06:41:58.229 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-13T06:41:58.277 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 reset_purged_snaps_last 2024-09-13T06:41:58.291 INFO:tasks.ceph.osd.6.smithi139.stderr:2024-09-13T06:41:58.286+0000 7fcd02c5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26385) UID: 0 2024-09-13T06:41:58.332 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:41:58.332 INFO:teuthology.orchestra.run.smithi139.stdout: "size": 20, 2024-09-13T06:41:58.332 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 600, 2024-09-13T06:41:58.332 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [ 2024-09-13T06:41:58.333 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:58.333 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43282 3.1d 3:bd80bfb3:::rbd_object_map.11212f44bfb1.0000000000000020:head [call rbd.object_map_update in=20b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:58.333 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589032+0000", 2024-09-13T06:41:58.333 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 96.740658475000004, 2024-09-13T06:41:58.333 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.076225263000000001, 2024-09-13T06:41:58.333 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:58.333 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:41:58.333 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:58.333 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:58.333 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:58.333 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43282 2024-09-13T06:41:58.333 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:58.334 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:58.334 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:58.334 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:58.334 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589032+0000", 2024-09-13T06:41:58.334 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:58.334 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:58.334 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:58.334 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:58.334 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589032+0000", 2024-09-13T06:41:58.335 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:58.335 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:58.335 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:58.335 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:58.335 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589031+0000", 2024-09-13T06:41:58.335 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:58.335 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:58.335 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:58.335 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:58.335 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589036+0000", 2024-09-13T06:41:58.335 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.2619999999999998e-06 2024-09-13T06:41:58.335 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:58.335 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:58.336 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:58.336 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589046+0000", 2024-09-13T06:41:58.336 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.8099999999999992e-06 2024-09-13T06:41:58.336 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:58.336 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:58.336 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:58.336 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589054+0000", 2024-09-13T06:41:58.336 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.2230000000000007e-06 2024-09-13T06:41:58.336 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:58.336 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:58.336 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:58.336 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.660691+0000", 2024-09-13T06:41:58.336 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.07163659 2024-09-13T06:41:58.337 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:58.337 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:58.337 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:58.337 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.660850+0000", 2024-09-13T06:41:58.337 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00015864300000000001 2024-09-13T06:41:58.337 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:58.337 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:58.337 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 4", 2024-09-13T06:41:58.337 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.661729+0000", 2024-09-13T06:41:58.337 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00087956099999999995 2024-09-13T06:41:58.337 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:58.337 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:58.337 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:41:58.338 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.664409+0000", 2024-09-13T06:41:58.338 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0026803479999999999 2024-09-13T06:41:58.338 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:58.338 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:58.338 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-13T06:41:58.338 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.665088+0000", 2024-09-13T06:41:58.338 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00067901400000000003 2024-09-13T06:41:58.338 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:58.338 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:58.338 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-13T06:41:58.338 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.665181+0000", 2024-09-13T06:41:58.338 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.2050000000000001e-05 2024-09-13T06:41:58.338 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:58.339 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:58.339 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:58.339 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.665257+0000", 2024-09-13T06:41:58.339 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.6698000000000003e-05 2024-09-13T06:41:58.339 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:58.339 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:58.339 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:58.339 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:58.339 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:58.339 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43290 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 299008~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:58.339 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589500+0000", 2024-09-13T06:41:58.339 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 96.740190312999999, 2024-09-13T06:41:58.339 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.075898564000000002, 2024-09-13T06:41:58.340 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:58.340 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:58.340 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:58.340 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:58.340 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:58.340 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43290 2024-09-13T06:41:58.340 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:58.340 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:58.340 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:58.340 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:58.340 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589500+0000", 2024-09-13T06:41:58.340 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:58.341 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:58.341 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:58.341 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:58.341 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589500+0000", 2024-09-13T06:41:58.341 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:58.341 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:58.341 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:58.341 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:58.341 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589499+0000", 2024-09-13T06:41:58.341 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:58.341 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:58.341 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:58.341 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:58.342 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589503+0000", 2024-09-13T06:41:58.342 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.8330000000000004e-06 2024-09-13T06:41:58.342 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:58.342 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:58.342 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:58.342 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589511+0000", 2024-09-13T06:41:58.342 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.3359999999999995e-06 2024-09-13T06:41:58.342 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:58.342 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:58.342 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:58.342 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589519+0000", 2024-09-13T06:41:58.342 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.4760000000000001e-06 2024-09-13T06:41:58.342 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:58.342 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:58.343 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:58.343 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.665097+0000", 2024-09-13T06:41:58.343 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.075577828999999999 2024-09-13T06:41:58.343 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:58.343 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:58.343 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:58.343 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.665170+0000", 2024-09-13T06:41:58.343 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.3745000000000006e-05 2024-09-13T06:41:58.343 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:58.343 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:58.343 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:58.343 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.665399+0000", 2024-09-13T06:41:58.343 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00022826199999999999 2024-09-13T06:41:58.343 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:58.344 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:58.344 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:58.344 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:58.344 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:58.344 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43291 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 313344~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:58.344 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589560+0000", 2024-09-13T06:41:58.344 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 96.740130092000001, 2024-09-13T06:41:58.344 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.076145594999999996, 2024-09-13T06:41:58.345 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:58.345 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:58.345 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:58.345 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:58.345 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:58.345 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43291 2024-09-13T06:41:58.345 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:58.345 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:58.345 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:58.345 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:58.345 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589560+0000", 2024-09-13T06:41:58.345 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:58.345 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:58.346 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:58.346 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:58.346 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589560+0000", 2024-09-13T06:41:58.346 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:58.346 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:58.346 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:58.346 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:58.346 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589559+0000", 2024-09-13T06:41:58.346 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:58.346 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:58.346 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:58.346 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:58.346 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589564+0000", 2024-09-13T06:41:58.346 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.3989999999999997e-06 2024-09-13T06:41:58.347 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:58.347 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:58.347 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:58.347 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589574+0000", 2024-09-13T06:41:58.347 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0502999999999999e-05 2024-09-13T06:41:58.347 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:58.347 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:58.347 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:58.347 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589582+0000", 2024-09-13T06:41:58.347 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.1859999999999992e-06 2024-09-13T06:41:58.347 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:58.347 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:58.347 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:58.348 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.665423+0000", 2024-09-13T06:41:58.348 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.075840290000000005 2024-09-13T06:41:58.348 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:58.348 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:58.348 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:58.348 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.665496+0000", 2024-09-13T06:41:58.348 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.2791000000000002e-05 2024-09-13T06:41:58.348 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:58.348 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:58.348 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:58.348 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.665706+0000", 2024-09-13T06:41:58.348 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00021038200000000001 2024-09-13T06:41:58.348 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:58.349 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:58.349 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:58.349 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:58.349 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:58.349 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43292 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 327680~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:58.349 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589589+0000", 2024-09-13T06:41:58.349 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 96.740101550999995, 2024-09-13T06:41:58.349 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.076769537999999998, 2024-09-13T06:41:58.349 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:58.349 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:58.349 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:58.349 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:58.349 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:58.350 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43292 2024-09-13T06:41:58.350 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:58.350 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:58.350 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:58.350 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:58.350 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589589+0000", 2024-09-13T06:41:58.350 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:58.350 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:58.350 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:58.350 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:58.350 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589589+0000", 2024-09-13T06:41:58.350 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:58.350 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:58.350 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:58.351 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:58.351 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589588+0000", 2024-09-13T06:41:58.351 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:58.351 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:58.351 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:58.351 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:58.351 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589592+0000", 2024-09-13T06:41:58.351 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.6389999999999998e-06 2024-09-13T06:41:58.351 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:58.351 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:58.351 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:58.351 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589600+0000", 2024-09-13T06:41:58.351 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.4630000000000001e-06 2024-09-13T06:41:58.351 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:58.352 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:58.352 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:58.352 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589608+0000", 2024-09-13T06:41:58.352 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.2359999999999998e-06 2024-09-13T06:41:58.352 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:58.352 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:58.352 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:58.352 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.665779+0000", 2024-09-13T06:41:58.352 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.076170924000000001 2024-09-13T06:41:58.352 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:58.352 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:58.352 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:58.352 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.665977+0000", 2024-09-13T06:41:58.353 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00019891900000000001 2024-09-13T06:41:58.353 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:58.353 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:58.353 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:58.353 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.666358+0000", 2024-09-13T06:41:58.353 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000380963 2024-09-13T06:41:58.353 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:58.353 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:58.353 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:58.353 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:58.353 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:58.353 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43293 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 342016~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:58.353 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589616+0000", 2024-09-13T06:41:58.354 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 96.740074656999994, 2024-09-13T06:41:58.354 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.077030083999999999, 2024-09-13T06:41:58.354 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:58.354 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:58.354 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:58.354 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:58.354 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:58.354 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43293 2024-09-13T06:41:58.354 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:58.354 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:58.355 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:58.355 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:58.355 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589616+0000", 2024-09-13T06:41:58.355 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:58.355 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:58.355 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:58.355 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:58.355 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589616+0000", 2024-09-13T06:41:58.355 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:58.355 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:58.355 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:58.355 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:58.356 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589615+0000", 2024-09-13T06:41:58.356 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:58.356 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:58.356 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:58.356 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:58.356 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589619+0000", 2024-09-13T06:41:58.356 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.9559999999999999e-06 2024-09-13T06:41:58.356 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:58.356 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:58.356 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:58.356 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589627+0000", 2024-09-13T06:41:58.356 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.2490000000000001e-06 2024-09-13T06:41:58.356 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:58.357 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:58.357 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:58.357 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589635+0000", 2024-09-13T06:41:58.357 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.96e-06 2024-09-13T06:41:58.357 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:58.357 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:58.357 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:58.357 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.666379+0000", 2024-09-13T06:41:58.357 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.076744484000000002 2024-09-13T06:41:58.357 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:58.357 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:58.357 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:58.357 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.666454+0000", 2024-09-13T06:41:58.357 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.4623999999999996e-05 2024-09-13T06:41:58.358 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:58.358 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:58.358 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:58.358 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.666646+0000", 2024-09-13T06:41:58.358 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00019176999999999999 2024-09-13T06:41:58.358 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:58.358 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:58.358 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:58.358 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:58.358 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:58.358 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43294 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 356352~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:58.358 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589681+0000", 2024-09-13T06:41:58.358 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 96.740009341999993, 2024-09-13T06:41:58.359 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.077594648000000002, 2024-09-13T06:41:58.359 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:58.359 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:58.359 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:58.359 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:58.359 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:58.359 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43294 2024-09-13T06:41:58.359 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:58.359 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:58.359 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:58.359 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:58.359 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589681+0000", 2024-09-13T06:41:58.359 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:58.360 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:58.360 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:58.360 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:58.360 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589681+0000", 2024-09-13T06:41:58.360 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:58.360 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:58.360 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:58.360 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:58.360 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589680+0000", 2024-09-13T06:41:58.360 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:58.360 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:58.360 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:58.361 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:58.361 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589684+0000", 2024-09-13T06:41:58.361 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.8369999999999999e-06 2024-09-13T06:41:58.361 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:58.361 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:58.361 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:58.361 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589693+0000", 2024-09-13T06:41:58.361 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.1020000000000003e-06 2024-09-13T06:41:58.361 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:58.361 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:58.361 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:58.361 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589701+0000", 2024-09-13T06:41:58.361 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.8059999999999995e-06 2024-09-13T06:41:58.362 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:58.362 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:58.362 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:58.362 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.666714+0000", 2024-09-13T06:41:58.362 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.077013463000000004 2024-09-13T06:41:58.362 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:58.362 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:58.362 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:58.362 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.666897+0000", 2024-09-13T06:41:58.362 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000182268 2024-09-13T06:41:58.362 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:58.362 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:58.362 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:58.363 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.667276+0000", 2024-09-13T06:41:58.363 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00037907499999999998 2024-09-13T06:41:58.363 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:58.363 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:58.363 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:58.363 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:58.363 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:58.363 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43295 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 370688~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:58.363 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589744+0000", 2024-09-13T06:41:58.363 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 96.739946169999996, 2024-09-13T06:41:58.363 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.077854343000000006, 2024-09-13T06:41:58.363 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:58.363 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:58.363 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:58.364 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:58.364 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:58.364 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43295 2024-09-13T06:41:58.364 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:58.364 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:58.364 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:58.364 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:58.364 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589744+0000", 2024-09-13T06:41:58.364 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:58.364 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:58.364 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:58.364 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:58.364 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589744+0000", 2024-09-13T06:41:58.365 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:58.365 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:58.365 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:58.365 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:58.365 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589743+0000", 2024-09-13T06:41:58.365 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:58.365 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:58.365 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:58.365 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:58.366 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589747+0000", 2024-09-13T06:41:58.366 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0130000000000004e-06 2024-09-13T06:41:58.366 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:58.366 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:58.366 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:58.366 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589756+0000", 2024-09-13T06:41:58.366 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.003e-06 2024-09-13T06:41:58.366 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:58.366 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:58.366 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:58.366 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589766+0000", 2024-09-13T06:41:58.366 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.2820000000000002e-06 2024-09-13T06:41:58.366 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:58.367 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:58.367 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:58.367 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.667300+0000", 2024-09-13T06:41:58.367 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.077534299000000001 2024-09-13T06:41:58.367 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:58.367 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:58.367 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:58.367 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.667372+0000", 2024-09-13T06:41:58.367 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.2393999999999998e-05 2024-09-13T06:41:58.367 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:58.367 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:58.367 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:58.367 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.667599+0000", 2024-09-13T06:41:58.367 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000226269 2024-09-13T06:41:58.368 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:58.368 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:58.368 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:58.368 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:58.368 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:58.368 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43296 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 385024~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:58.368 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589772+0000", 2024-09-13T06:41:58.368 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 96.739918145999994, 2024-09-13T06:41:58.368 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.078469647000000003, 2024-09-13T06:41:58.368 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:58.368 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:58.368 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:58.368 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:58.369 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:58.369 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43296 2024-09-13T06:41:58.369 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:58.369 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:58.369 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:58.369 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:58.369 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589772+0000", 2024-09-13T06:41:58.369 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:58.369 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:58.369 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:58.369 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:58.369 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589772+0000", 2024-09-13T06:41:58.369 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:58.370 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:58.370 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:58.370 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:58.370 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589771+0000", 2024-09-13T06:41:58.370 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:58.370 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:58.370 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:58.370 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:58.370 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589775+0000", 2024-09-13T06:41:58.370 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.8530000000000002e-06 2024-09-13T06:41:58.370 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:58.370 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:58.370 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:58.370 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589784+0000", 2024-09-13T06:41:58.371 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.4300000000000006e-06 2024-09-13T06:41:58.371 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:58.371 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:58.371 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:58.371 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589791+0000", 2024-09-13T06:41:58.371 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.4660000000000002e-06 2024-09-13T06:41:58.371 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:58.371 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:58.371 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:58.371 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.667667+0000", 2024-09-13T06:41:58.371 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.077875697999999993 2024-09-13T06:41:58.371 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:58.371 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:58.372 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:58.372 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.667854+0000", 2024-09-13T06:41:58.372 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00018760099999999999 2024-09-13T06:41:58.372 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:58.372 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:58.372 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:58.372 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.668242+0000", 2024-09-13T06:41:58.372 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00038750600000000003 2024-09-13T06:41:58.372 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:58.372 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:58.372 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:58.372 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:58.372 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:58.373 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43297 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 403456~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:58.373 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589797+0000", 2024-09-13T06:41:58.373 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 96.739893441999996, 2024-09-13T06:41:58.373 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.078756672999999999, 2024-09-13T06:41:58.373 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:58.373 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:58.373 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:58.373 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:58.373 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:58.373 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43297 2024-09-13T06:41:58.373 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:58.373 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:58.373 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:58.374 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:58.374 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589797+0000", 2024-09-13T06:41:58.374 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:58.374 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:58.374 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:58.374 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:58.374 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589797+0000", 2024-09-13T06:41:58.374 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:58.374 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:58.374 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:58.374 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:58.374 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589796+0000", 2024-09-13T06:41:58.374 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:58.375 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:58.375 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:58.375 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:58.375 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589800+0000", 2024-09-13T06:41:58.375 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.3230000000000002e-06 2024-09-13T06:41:58.375 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:58.375 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:58.375 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:58.375 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589808+0000", 2024-09-13T06:41:58.376 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.2390000000000002e-06 2024-09-13T06:41:58.376 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:58.376 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:58.376 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:58.376 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589815+0000", 2024-09-13T06:41:58.376 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.413e-06 2024-09-13T06:41:58.376 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:58.376 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:58.376 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:58.376 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.668265+0000", 2024-09-13T06:41:58.376 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.078449873000000003 2024-09-13T06:41:58.376 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:58.377 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:58.377 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:58.377 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.668332+0000", 2024-09-13T06:41:58.377 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.7178e-05 2024-09-13T06:41:58.377 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:58.377 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:58.377 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:58.377 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.668554+0000", 2024-09-13T06:41:58.377 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00022128600000000001 2024-09-13T06:41:58.377 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:58.377 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:58.377 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:58.377 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:58.377 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:58.378 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43298 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 417792~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:58.378 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589821+0000", 2024-09-13T06:41:58.378 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 96.739869319999997, 2024-09-13T06:41:58.378 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.079368660999999993, 2024-09-13T06:41:58.378 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:58.378 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:58.378 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:58.378 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:58.378 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:58.378 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43298 2024-09-13T06:41:58.378 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:58.378 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:58.378 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:58.379 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:58.379 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589821+0000", 2024-09-13T06:41:58.379 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:58.379 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:58.379 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:58.379 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:58.379 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589821+0000", 2024-09-13T06:41:58.379 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:58.379 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:58.379 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:58.379 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:58.379 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589821+0000", 2024-09-13T06:41:58.379 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:58.380 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:58.380 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:58.380 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:58.380 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589830+0000", 2024-09-13T06:41:58.380 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.4860000000000003e-06 2024-09-13T06:41:58.380 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:58.380 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:58.380 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:58.380 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589839+0000", 2024-09-13T06:41:58.380 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.0159999999999997e-06 2024-09-13T06:41:58.380 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:58.380 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:58.380 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:58.381 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589847+0000", 2024-09-13T06:41:58.381 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.6059999999999997e-06 2024-09-13T06:41:58.381 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:58.381 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:58.381 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:58.381 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.668620+0000", 2024-09-13T06:41:58.381 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.078773485000000004 2024-09-13T06:41:58.381 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:58.381 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:58.381 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:58.381 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.668798+0000", 2024-09-13T06:41:58.381 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000178233 2024-09-13T06:41:58.381 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:58.382 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:58.382 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:58.382 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.669190+0000", 2024-09-13T06:41:58.382 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00039143499999999998 2024-09-13T06:41:58.382 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:58.382 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:58.382 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:58.382 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:58.382 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:58.382 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43299 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 432128~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:58.382 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589881+0000", 2024-09-13T06:41:58.382 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 96.739809472000005, 2024-09-13T06:41:58.382 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.079693849999999997, 2024-09-13T06:41:58.383 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:58.383 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:58.383 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:58.383 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:58.383 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:58.383 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43299 2024-09-13T06:41:58.383 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:58.383 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:58.383 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:58.383 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:58.383 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589881+0000", 2024-09-13T06:41:58.383 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:58.383 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:58.383 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:58.384 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:58.384 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589881+0000", 2024-09-13T06:41:58.384 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:58.384 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:58.384 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:58.384 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:58.384 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589880+0000", 2024-09-13T06:41:58.384 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:58.384 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:58.384 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:58.384 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:58.384 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589884+0000", 2024-09-13T06:41:58.384 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.053e-06 2024-09-13T06:41:58.385 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:58.385 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:58.385 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:58.385 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589893+0000", 2024-09-13T06:41:58.385 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.2129999999999997e-06 2024-09-13T06:41:58.385 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:58.385 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:58.385 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:58.385 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589901+0000", 2024-09-13T06:41:58.385 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.6399999999999997e-06 2024-09-13T06:41:58.385 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:58.385 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:58.385 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:58.386 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.669213+0000", 2024-09-13T06:41:58.386 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.079312074999999996 2024-09-13T06:41:58.386 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:58.386 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:58.386 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:58.386 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.669281+0000", 2024-09-13T06:41:58.386 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.8322000000000001e-05 2024-09-13T06:41:58.386 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:58.386 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:58.386 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:58.386 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.669575+0000", 2024-09-13T06:41:58.386 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00029349699999999999 2024-09-13T06:41:58.386 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:58.386 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:58.387 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:58.387 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:58.387 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:58.387 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43300 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 446464~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:58.387 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589909+0000", 2024-09-13T06:41:58.387 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 96.739781577000002, 2024-09-13T06:41:58.387 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.080339496999999996, 2024-09-13T06:41:58.387 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:58.387 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:58.387 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:58.387 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:58.387 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:58.388 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43300 2024-09-13T06:41:58.388 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:58.388 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:58.388 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:58.388 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:58.388 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589909+0000", 2024-09-13T06:41:58.388 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:58.388 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:58.388 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:58.388 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:58.388 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589909+0000", 2024-09-13T06:41:58.388 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:58.388 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:58.388 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:58.389 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:58.389 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589908+0000", 2024-09-13T06:41:58.389 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:58.389 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:58.389 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:58.389 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:58.389 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589912+0000", 2024-09-13T06:41:58.389 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.9430000000000002e-06 2024-09-13T06:41:58.389 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:58.389 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:58.389 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:58.389 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589920+0000", 2024-09-13T06:41:58.389 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.3860000000000007e-06 2024-09-13T06:41:58.390 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:58.390 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:58.390 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:58.390 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589928+0000", 2024-09-13T06:41:58.390 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.3329999999999999e-06 2024-09-13T06:41:58.390 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:58.390 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:58.390 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:58.390 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.669651+0000", 2024-09-13T06:41:58.390 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.079723204000000006 2024-09-13T06:41:58.390 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:58.390 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:58.390 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:58.390 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.669840+0000", 2024-09-13T06:41:58.391 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000189397 2024-09-13T06:41:58.391 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:58.391 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:58.391 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:58.391 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.670248+0000", 2024-09-13T06:41:58.391 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00040811100000000001 2024-09-13T06:41:58.391 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:58.391 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:58.391 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:58.391 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:58.391 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:58.391 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43301 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 460800~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:58.391 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589934+0000", 2024-09-13T06:41:58.392 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 96.739756903, 2024-09-13T06:41:58.392 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.080747474999999999, 2024-09-13T06:41:58.392 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:58.392 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:58.392 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:58.392 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:58.392 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:58.392 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43301 2024-09-13T06:41:58.392 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:58.392 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:58.392 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:58.392 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:58.392 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589934+0000", 2024-09-13T06:41:58.393 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:58.393 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:58.393 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:58.393 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:58.393 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589934+0000", 2024-09-13T06:41:58.393 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:58.393 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:58.393 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:58.393 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:58.393 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589933+0000", 2024-09-13T06:41:58.393 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:58.393 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:58.393 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:58.394 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:58.394 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589936+0000", 2024-09-13T06:41:58.394 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.4599999999999999e-06 2024-09-13T06:41:58.394 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:58.394 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:58.394 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:58.394 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589945+0000", 2024-09-13T06:41:58.394 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.2430000000000005e-06 2024-09-13T06:41:58.394 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:58.394 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:58.394 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:58.394 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589952+0000", 2024-09-13T06:41:58.394 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.3289999999999996e-06 2024-09-13T06:41:58.394 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:58.395 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:58.395 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:58.395 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.670280+0000", 2024-09-13T06:41:58.395 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.080328514000000004 2024-09-13T06:41:58.395 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:58.395 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:58.395 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:58.395 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.670376+0000", 2024-09-13T06:41:58.395 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.5752000000000001e-05 2024-09-13T06:41:58.395 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:58.395 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:58.395 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:58.395 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.670681+0000", 2024-09-13T06:41:58.396 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00030479699999999999 2024-09-13T06:41:58.396 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:58.396 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:58.396 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:58.396 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:58.396 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:58.396 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43302 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 475136~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:58.396 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589958+0000", 2024-09-13T06:41:58.396 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 96.739732841000006, 2024-09-13T06:41:58.396 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.081402394000000003, 2024-09-13T06:41:58.396 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:58.396 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:58.396 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:58.397 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:58.397 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:58.397 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43302 2024-09-13T06:41:58.397 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:58.397 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:58.397 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:58.397 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:58.397 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589958+0000", 2024-09-13T06:41:58.397 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:58.397 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:58.397 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:58.397 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:58.397 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589958+0000", 2024-09-13T06:41:58.398 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:58.398 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:58.398 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:58.398 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:58.398 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589957+0000", 2024-09-13T06:41:58.398 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:58.398 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:58.398 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:58.398 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:58.398 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589960+0000", 2024-09-13T06:41:58.398 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.4939999999999999e-06 2024-09-13T06:41:58.398 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:58.398 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:58.399 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:58.399 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589969+0000", 2024-09-13T06:41:58.399 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.3520000000000007e-06 2024-09-13T06:41:58.399 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:58.399 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:58.399 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:58.399 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589976+0000", 2024-09-13T06:41:58.399 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.3030000000000002e-06 2024-09-13T06:41:58.399 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:58.399 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:58.399 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:58.399 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.670765+0000", 2024-09-13T06:41:58.399 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.080789154000000002 2024-09-13T06:41:58.399 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:58.400 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:58.400 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:58.400 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.670960+0000", 2024-09-13T06:41:58.400 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00019464300000000001 2024-09-13T06:41:58.400 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:58.400 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:58.400 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:58.400 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.671360+0000", 2024-09-13T06:41:58.400 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00040005200000000002 2024-09-13T06:41:58.400 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:58.400 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:58.400 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:58.400 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:58.401 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:58.401 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43303 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 489472~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:58.401 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589985+0000", 2024-09-13T06:41:58.401 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 96.739705893000007, 2024-09-13T06:41:58.401 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.082024333000000005, 2024-09-13T06:41:58.401 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:58.401 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:58.401 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:58.401 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:58.401 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:58.401 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43303 2024-09-13T06:41:58.401 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:58.401 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:58.402 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:58.402 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:58.402 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589985+0000", 2024-09-13T06:41:58.402 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:58.402 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:58.402 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:58.402 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:58.402 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589985+0000", 2024-09-13T06:41:58.402 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:58.402 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:58.402 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:58.402 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:58.402 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589984+0000", 2024-09-13T06:41:58.403 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:58.403 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:58.403 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:58.403 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:58.403 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589987+0000", 2024-09-13T06:41:58.403 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.726e-06 2024-09-13T06:41:58.403 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:58.403 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:58.403 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:58.403 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589996+0000", 2024-09-13T06:41:58.403 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.5459999999999992e-06 2024-09-13T06:41:58.403 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:58.403 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:58.404 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:58.404 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590003+0000", 2024-09-13T06:41:58.404 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.4229999999999999e-06 2024-09-13T06:41:58.404 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:58.404 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:58.404 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:58.404 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.671426+0000", 2024-09-13T06:41:58.404 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.081422704999999998 2024-09-13T06:41:58.404 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:58.404 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:58.404 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:58.404 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.671615+0000", 2024-09-13T06:41:58.404 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000188875 2024-09-13T06:41:58.405 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:58.405 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:58.405 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:58.405 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.672009+0000", 2024-09-13T06:41:58.405 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000394015 2024-09-13T06:41:58.405 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:58.405 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:58.405 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:58.405 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:58.405 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:58.405 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43304 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 503808~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:58.405 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.590039+0000", 2024-09-13T06:41:58.405 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 96.739651347999995, 2024-09-13T06:41:58.406 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.082573880000000002, 2024-09-13T06:41:58.406 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:58.406 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:58.406 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:58.406 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:58.406 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:58.406 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43304 2024-09-13T06:41:58.406 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:58.406 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:58.406 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:58.406 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:58.406 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590039+0000", 2024-09-13T06:41:58.406 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:58.407 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:58.407 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:58.407 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:58.407 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590039+0000", 2024-09-13T06:41:58.407 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:58.407 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:58.407 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:58.407 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:58.407 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590038+0000", 2024-09-13T06:41:58.407 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:58.407 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:58.407 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:58.407 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:58.407 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590042+0000", 2024-09-13T06:41:58.408 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.9500000000000003e-06 2024-09-13T06:41:58.408 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:58.408 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:58.408 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:58.408 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590052+0000", 2024-09-13T06:41:58.408 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.3919999999999992e-06 2024-09-13T06:41:58.408 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:58.408 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:58.408 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:58.408 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590059+0000", 2024-09-13T06:41:58.408 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.7970000000000001e-06 2024-09-13T06:41:58.408 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:58.408 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:58.409 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:58.409 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.672078+0000", 2024-09-13T06:41:58.409 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.082018778000000001 2024-09-13T06:41:58.409 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:58.409 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:58.409 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:58.409 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.672266+0000", 2024-09-13T06:41:58.409 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00018807399999999999 2024-09-13T06:41:58.409 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:58.409 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:58.409 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:58.409 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.672613+0000", 2024-09-13T06:41:58.409 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00034677599999999997 2024-09-13T06:41:58.410 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:58.410 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:58.410 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:58.410 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:58.410 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:58.410 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43305 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 518144~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:58.410 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.590136+0000", 2024-09-13T06:41:58.410 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 96.739554159999997, 2024-09-13T06:41:58.410 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.082988206999999994, 2024-09-13T06:41:58.410 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:58.410 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:58.410 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:58.410 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:58.411 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:58.411 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43305 2024-09-13T06:41:58.411 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:58.411 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:58.411 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:58.411 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:58.411 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590136+0000", 2024-09-13T06:41:58.411 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:58.411 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:58.411 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:58.411 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:58.411 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590136+0000", 2024-09-13T06:41:58.411 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:58.412 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:58.412 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:58.412 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:58.412 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590135+0000", 2024-09-13T06:41:58.412 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:58.412 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:58.412 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:58.412 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:58.412 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590139+0000", 2024-09-13T06:41:58.412 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.9489999999999998e-06 2024-09-13T06:41:58.412 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:58.412 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:58.412 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:58.413 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590148+0000", 2024-09-13T06:41:58.413 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.9830000000000002e-06 2024-09-13T06:41:58.413 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:58.413 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:58.413 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:58.413 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590156+0000", 2024-09-13T06:41:58.413 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5229999999999998e-06 2024-09-13T06:41:58.413 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:58.413 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:58.413 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:58.413 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.672709+0000", 2024-09-13T06:41:58.413 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.082552886000000006 2024-09-13T06:41:58.413 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:58.414 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:58.414 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:58.414 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.672816+0000", 2024-09-13T06:41:58.414 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000107736 2024-09-13T06:41:58.414 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:58.414 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:58.414 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:58.414 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.673124+0000", 2024-09-13T06:41:58.414 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00030804900000000002 2024-09-13T06:41:58.414 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:58.414 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:58.414 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:58.414 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:58.414 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:58.415 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:66818 3.17 3.50afe697 (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e100)", 2024-09-13T06:41:58.415 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:53.498942+0000", 2024-09-13T06:41:58.415 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 64.830747974999994, 2024-09-13T06:41:58.415 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.011231284, 2024-09-13T06:41:58.415 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:58.415 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:41:58.415 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:58.415 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:58.415 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:58.415 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 66818 2024-09-13T06:41:58.415 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:58.415 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:58.415 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:58.415 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:58.416 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:53.498942+0000", 2024-09-13T06:41:58.416 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:58.416 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:58.416 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:58.416 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:58.416 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:53.498942+0000", 2024-09-13T06:41:58.416 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:58.416 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:58.416 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:58.416 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:58.416 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:53.498939+0000", 2024-09-13T06:41:58.416 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999967 2024-09-13T06:41:58.416 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:58.417 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:58.417 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:58.417 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:53.498954+0000", 2024-09-13T06:41:58.417 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5028000000000001e-05 2024-09-13T06:41:58.417 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:58.417 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:58.417 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:58.417 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:53.498986+0000", 2024-09-13T06:41:58.417 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.1993999999999999e-05 2024-09-13T06:41:58.417 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:58.417 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:58.417 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:58.417 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:53.499001+0000", 2024-09-13T06:41:58.417 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5166e-05 2024-09-13T06:41:58.418 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:58.418 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:58.418 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:58.418 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:53.505097+0000", 2024-09-13T06:41:58.418 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0060955610000000002 2024-09-13T06:41:58.418 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:58.418 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:58.418 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:41:58.418 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:53.505108+0000", 2024-09-13T06:41:58.418 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.084e-05 2024-09-13T06:41:58.418 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:58.418 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:58.418 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:58.419 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:54.510158+0000", 2024-09-13T06:41:58.419 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0050497549999999 2024-09-13T06:41:58.419 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:58.419 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:58.419 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:58.419 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:54.510174+0000", 2024-09-13T06:41:58.419 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6164e-05 2024-09-13T06:41:58.419 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:58.419 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:58.419 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:58.419 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:58.419 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:58.419 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:69764 3.2 3:47f10058:::rbd_data.11214956a993.0000000000000004:head [write-same] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e117)", 2024-09-13T06:41:58.419 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:41:11.371147+0000", 2024-09-13T06:41:58.420 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 46.958543665000001, 2024-09-13T06:41:58.420 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.03470167, 2024-09-13T06:41:58.420 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:58.420 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:41:58.420 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:58.420 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:58.420 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:58.420 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 69764 2024-09-13T06:41:58.420 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:58.420 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:58.420 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:58.420 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:58.420 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:11.371147+0000", 2024-09-13T06:41:58.421 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:58.421 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:58.421 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:58.421 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:58.421 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:11.371147+0000", 2024-09-13T06:41:58.421 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:58.421 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:58.421 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:58.421 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:58.421 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:11.371144+0000", 2024-09-13T06:41:58.421 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999967 2024-09-13T06:41:58.421 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:58.422 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:58.422 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:58.422 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:11.371161+0000", 2024-09-13T06:41:58.422 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7669e-05 2024-09-13T06:41:58.422 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:58.422 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:58.422 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:58.422 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:11.371198+0000", 2024-09-13T06:41:58.422 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.7014000000000002e-05 2024-09-13T06:41:58.422 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:58.422 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:58.422 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:58.422 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:11.371216+0000", 2024-09-13T06:41:58.423 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7425e-05 2024-09-13T06:41:58.423 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:58.423 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:58.423 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:58.423 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:11.371365+0000", 2024-09-13T06:41:58.423 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000149245 2024-09-13T06:41:58.423 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:58.423 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:58.423 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op must wait for map", 2024-09-13T06:41:58.423 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:11.371385+0000", 2024-09-13T06:41:58.423 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.0018999999999999e-05 2024-09-13T06:41:58.423 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:58.423 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:58.423 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:58.424 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:11.378406+0000", 2024-09-13T06:41:58.424 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0070207179999999996 2024-09-13T06:41:58.424 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:58.424 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:58.424 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:41:58.424 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:11.378429+0000", 2024-09-13T06:41:58.424 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.3453999999999999e-05 2024-09-13T06:41:58.424 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:58.424 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:58.424 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:58.424 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:12.405667+0000", 2024-09-13T06:41:58.424 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0272381690000001 2024-09-13T06:41:58.424 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:58.424 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:58.425 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:58.425 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:12.405848+0000", 2024-09-13T06:41:58.425 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00018112 2024-09-13T06:41:58.425 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:58.425 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:58.425 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:58.425 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:58.425 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:58.425 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:70346 3.16 3:69d35907:::rbd_object_map.11214956a993:head [read 0~36] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e122)", 2024-09-13T06:41:58.426 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:41:16.390917+0000", 2024-09-13T06:41:58.426 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 41.938773613000002, 2024-09-13T06:41:58.426 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.99327479799999996, 2024-09-13T06:41:58.426 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:58.426 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:58.426 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:58.426 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:58.426 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:58.426 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 70346 2024-09-13T06:41:58.426 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:58.426 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:58.426 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:58.426 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:58.427 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:16.390917+0000", 2024-09-13T06:41:58.427 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:58.427 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:58.427 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:58.427 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:58.427 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:16.390917+0000", 2024-09-13T06:41:58.427 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:58.427 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:58.427 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:58.427 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:58.428 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:16.390916+0000", 2024-09-13T06:41:58.428 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999986 2024-09-13T06:41:58.428 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:58.428 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:58.428 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:58.428 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:16.390922+0000", 2024-09-13T06:41:58.428 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.0480000000000004e-06 2024-09-13T06:41:58.428 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:58.428 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:58.428 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:58.428 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:16.390933+0000", 2024-09-13T06:41:58.428 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1387e-05 2024-09-13T06:41:58.428 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:58.429 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:58.429 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:58.429 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:16.390939+0000", 2024-09-13T06:41:58.429 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.8039999999999998e-06 2024-09-13T06:41:58.429 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:58.429 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:58.429 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:58.429 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:16.390983+0000", 2024-09-13T06:41:58.429 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.4663000000000003e-05 2024-09-13T06:41:58.429 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:58.429 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:58.429 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:41:58.429 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:16.390991+0000", 2024-09-13T06:41:58.429 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.8059999999999995e-06 2024-09-13T06:41:58.430 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:58.430 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:58.430 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:58.430 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:17.383624+0000", 2024-09-13T06:41:58.430 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.99263277299999997 2024-09-13T06:41:58.430 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:58.430 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:58.430 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:58.430 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:17.383891+0000", 2024-09-13T06:41:58.430 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00026717599999999999 2024-09-13T06:41:58.430 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:58.430 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:58.430 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:58.431 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:17.384192+0000", 2024-09-13T06:41:58.431 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00030047400000000001 2024-09-13T06:41:58.431 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:58.431 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:58.431 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:58.431 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:58.431 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:58.431 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:41:58.433 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-13T06:41:58.433 INFO:tasks.ceph.osd.6.smithi139.stderr:2024-09-13T06:41:58.430+0000 7fcd02c5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26385) UID: 0 2024-09-13T06:41:58.434 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 reset_purged_snaps_last 2024-09-13T06:41:58.533 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:41:58.529+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:41:58.594 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 reset_purged_snaps_last 2024-09-13T06:41:58.604 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:41:58.604 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [], 2024-09-13T06:41:58.604 INFO:teuthology.orchestra.run.smithi139.stdout: "num_ops": 0 2024-09-13T06:41:58.604 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:41:58.619 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-13T06:41:58.664 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:41:58.662+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:41:58.725 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-13T06:41:58.737 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:41:58.734+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:41:58.746 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:41:58.746 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [], 2024-09-13T06:41:58.746 INFO:teuthology.orchestra.run.smithi139.stdout: "complaint_time": 30, 2024-09-13T06:41:58.746 INFO:teuthology.orchestra.run.smithi139.stdout: "num_blocked_ops": 0 2024-09-13T06:41:58.746 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:41:58.767 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-13T06:41:58.782 INFO:teuthology.orchestra.run.smithi081.stderr:Error ENXIO: problem getting command descriptions from osd.7 2024-09-13T06:41:58.787 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-13T06:41:58.787 INFO:tasks.thrashosds.thrasher:Failed to reset_purged_snaps_last, ignoring 2024-09-13T06:41:58.787 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 reset_purged_snaps_last 2024-09-13T06:41:58.837 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:41:58.833+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:41:58.938 INFO:tasks.ceph.osd.6.smithi139.stderr:2024-09-13T06:41:58.934+0000 7fcd02c5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26385) UID: 0 2024-09-13T06:41:58.974 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:41:58.974 INFO:teuthology.orchestra.run.smithi139.stdout: "size": 20, 2024-09-13T06:41:58.974 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 600, 2024-09-13T06:41:58.974 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [ 2024-09-13T06:41:58.974 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:58.974 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27854 3.a 3:537b3559:::rbd_data.1121f2c5ee81.0000000000000016:13 [read 335872~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:58.974 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.658750+0000", 2024-09-13T06:41:58.974 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 122.314664478, 2024-09-13T06:41:58.975 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.037969532, 2024-09-13T06:41:58.975 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:58.975 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:58.975 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:58.975 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:58.975 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:58.975 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27854 2024-09-13T06:41:58.975 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:58.975 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:58.975 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:58.975 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:58.975 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658750+0000", 2024-09-13T06:41:58.975 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:58.976 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:58.976 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:58.976 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:58.976 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658750+0000", 2024-09-13T06:41:58.976 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:58.976 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:58.976 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:58.976 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:58.976 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658749+0000", 2024-09-13T06:41:58.976 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:58.976 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:58.976 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:58.976 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:58.977 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658757+0000", 2024-09-13T06:41:58.977 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.7389999999999999e-06 2024-09-13T06:41:58.977 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:58.977 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:58.977 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:58.977 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658763+0000", 2024-09-13T06:41:58.977 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.7769999999999999e-06 2024-09-13T06:41:58.977 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:58.977 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:58.977 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:58.977 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658767+0000", 2024-09-13T06:41:58.978 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.1749999999999998e-06 2024-09-13T06:41:58.978 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:58.978 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:58.978 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:58.978 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.696322+0000", 2024-09-13T06:41:58.978 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.037554772 2024-09-13T06:41:58.978 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:58.978 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:58.978 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:58.978 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.696418+0000", 2024-09-13T06:41:58.978 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6050000000000004e-05 2024-09-13T06:41:58.978 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:58.978 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:58.979 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:58.979 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.696719+0000", 2024-09-13T06:41:58.979 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00030138499999999999 2024-09-13T06:41:58.979 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:58.979 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:58.979 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:58.979 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:58.979 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:58.979 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27855 3.a 3:537b3559:::rbd_data.1121f2c5ee81.0000000000000016:13 [read 380928~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:58.979 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.658771+0000", 2024-09-13T06:41:58.979 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 122.314643234, 2024-09-13T06:41:58.979 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.038326354, 2024-09-13T06:41:58.979 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:58.980 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:58.980 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:58.980 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:58.980 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:58.980 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27855 2024-09-13T06:41:58.980 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:58.980 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:58.980 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:58.980 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:58.980 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658771+0000", 2024-09-13T06:41:58.980 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:58.980 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:58.981 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:58.981 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:58.981 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658771+0000", 2024-09-13T06:41:58.981 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:58.981 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:58.981 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:58.981 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:58.981 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658770+0000", 2024-09-13T06:41:58.981 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:58.981 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:58.981 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:58.981 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:58.981 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658772+0000", 2024-09-13T06:41:58.982 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.0930000000000001e-06 2024-09-13T06:41:58.982 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:58.982 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:58.982 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:58.982 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658778+0000", 2024-09-13T06:41:58.982 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.2730000000000002e-06 2024-09-13T06:41:58.982 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:58.982 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:58.982 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:58.982 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658782+0000", 2024-09-13T06:41:58.982 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0879999999999997e-06 2024-09-13T06:41:58.982 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:58.982 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:58.982 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:58.983 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.696770+0000", 2024-09-13T06:41:58.983 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.037988145000000001 2024-09-13T06:41:58.983 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:58.983 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:58.983 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:58.983 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.696852+0000", 2024-09-13T06:41:58.983 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.2039999999999994e-05 2024-09-13T06:41:58.983 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:58.983 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:58.983 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:58.983 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.697097+0000", 2024-09-13T06:41:58.983 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00024508800000000002 2024-09-13T06:41:58.983 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:58.984 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:58.984 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:58.984 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:58.984 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:58.984 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27856 3.a 3:537b3559:::rbd_data.1121f2c5ee81.0000000000000016:13 [read 405504~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:58.984 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.658786+0000", 2024-09-13T06:41:58.984 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 122.314628118, 2024-09-13T06:41:58.984 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.038736029999999998, 2024-09-13T06:41:58.984 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:58.984 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:58.984 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:58.984 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:58.984 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:58.985 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27856 2024-09-13T06:41:58.985 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:58.985 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:58.985 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:58.985 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:58.985 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658786+0000", 2024-09-13T06:41:58.985 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:58.985 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:58.985 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:58.985 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:58.985 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658786+0000", 2024-09-13T06:41:58.985 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:58.985 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:58.986 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:58.986 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:58.986 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658785+0000", 2024-09-13T06:41:58.986 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:58.986 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:58.986 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:58.986 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:58.986 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658787+0000", 2024-09-13T06:41:58.986 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.0040000000000002e-06 2024-09-13T06:41:58.986 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:58.986 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:58.986 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:58.986 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658793+0000", 2024-09-13T06:41:58.987 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.2410000000000003e-06 2024-09-13T06:41:58.987 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:58.987 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:58.987 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:58.987 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658797+0000", 2024-09-13T06:41:58.987 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.1330000000000001e-06 2024-09-13T06:41:58.987 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:58.987 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:58.987 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:58.987 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.697176+0000", 2024-09-13T06:41:58.987 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.038379074999999999 2024-09-13T06:41:58.987 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:58.987 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:58.988 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:58.988 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.697275+0000", 2024-09-13T06:41:58.988 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.8819000000000004e-05 2024-09-13T06:41:58.988 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:58.988 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:58.988 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:58.988 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.697522+0000", 2024-09-13T06:41:58.988 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00024719999999999999 2024-09-13T06:41:58.988 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:58.988 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:58.988 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:58.988 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:58.988 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:58.989 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27857 3.a 3:537b3559:::rbd_data.1121f2c5ee81.0000000000000016:13 [read 475136~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:58.989 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.658845+0000", 2024-09-13T06:41:58.989 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 122.314569115, 2024-09-13T06:41:58.989 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039112570999999999, 2024-09-13T06:41:58.989 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:58.989 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:58.989 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:58.989 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:58.989 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:58.989 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27857 2024-09-13T06:41:58.989 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:58.989 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:58.990 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:58.990 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:58.990 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658845+0000", 2024-09-13T06:41:58.990 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:58.990 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:58.990 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:58.990 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:58.990 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658845+0000", 2024-09-13T06:41:58.990 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:58.990 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:58.990 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:58.990 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:58.990 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658844+0000", 2024-09-13T06:41:58.991 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999986 2024-09-13T06:41:58.991 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:58.991 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:58.991 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:58.991 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658868+0000", 2024-09-13T06:41:58.991 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.4615000000000001e-05 2024-09-13T06:41:58.991 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:58.991 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:58.991 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:58.991 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658884+0000", 2024-09-13T06:41:58.991 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5401999999999999e-05 2024-09-13T06:41:58.991 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:58.991 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:58.991 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:58.992 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658896+0000", 2024-09-13T06:41:58.992 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2509e-05 2024-09-13T06:41:58.992 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:58.992 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:58.992 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:58.992 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.697571+0000", 2024-09-13T06:41:58.992 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.038675107 2024-09-13T06:41:58.992 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:58.992 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:58.992 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:58.992 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.697658+0000", 2024-09-13T06:41:58.992 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6349999999999998e-05 2024-09-13T06:41:58.992 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:58.993 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:58.993 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:58.993 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.697957+0000", 2024-09-13T06:41:58.993 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00029986100000000001 2024-09-13T06:41:58.993 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:58.993 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:58.993 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:58.993 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:58.993 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:58.993 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27858 3.a 3:537b3559:::rbd_data.1121f2c5ee81.0000000000000016:13 [read 499712~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:58.993 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.658905+0000", 2024-09-13T06:41:58.993 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 122.314508565, 2024-09-13T06:41:58.994 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039475392999999998, 2024-09-13T06:41:58.994 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:58.994 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:58.994 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:58.994 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:58.994 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:58.994 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27858 2024-09-13T06:41:58.994 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:58.994 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:58.994 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:58.994 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:58.994 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658905+0000", 2024-09-13T06:41:58.994 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:58.994 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:58.995 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:58.995 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:58.995 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658905+0000", 2024-09-13T06:41:58.995 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:58.995 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:58.995 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:58.995 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:58.995 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658905+0000", 2024-09-13T06:41:58.995 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:58.995 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:58.995 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:58.995 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:58.995 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658909+0000", 2024-09-13T06:41:58.995 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.831e-06 2024-09-13T06:41:58.996 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:58.996 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:58.996 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:58.996 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658920+0000", 2024-09-13T06:41:58.996 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0936e-05 2024-09-13T06:41:58.996 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:58.996 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:58.996 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:58.996 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658929+0000", 2024-09-13T06:41:58.996 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.2749999999999995e-06 2024-09-13T06:41:58.996 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:58.996 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:58.996 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:58.997 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.697990+0000", 2024-09-13T06:41:58.997 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039061625000000003 2024-09-13T06:41:58.997 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:58.997 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:58.997 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:58.997 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.698077+0000", 2024-09-13T06:41:58.997 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6922000000000006e-05 2024-09-13T06:41:58.997 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:58.997 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:58.997 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:58.997 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.698381+0000", 2024-09-13T06:41:58.997 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00030360599999999999 2024-09-13T06:41:58.997 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:58.998 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:58.998 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:58.998 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:58.998 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:58.998 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27929 3.a 3:537b3559:::rbd_data.1121f2c5ee81.0000000000000016:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:58.998 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.659338+0000", 2024-09-13T06:41:58.998 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 122.314075734, 2024-09-13T06:41:58.998 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039351214000000002, 2024-09-13T06:41:58.998 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:58.998 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:58.998 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:58.998 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:58.998 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:58.999 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27929 2024-09-13T06:41:58.999 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:58.999 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:58.999 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:58.999 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:58.999 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.659338+0000", 2024-09-13T06:41:58.999 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:58.999 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:58.999 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:58.999 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:58.999 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.659338+0000", 2024-09-13T06:41:58.999 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:58.999 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:59.000 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:59.000 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:59.000 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.659337+0000", 2024-09-13T06:41:59.000 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:59.000 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:59.000 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:59.000 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:59.000 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.659342+0000", 2024-09-13T06:41:59.000 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0799999999999999e-06 2024-09-13T06:41:59.000 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:59.000 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:59.000 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:59.000 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.659353+0000", 2024-09-13T06:41:59.001 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1798e-05 2024-09-13T06:41:59.001 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:59.001 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:59.001 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:59.001 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.659361+0000", 2024-09-13T06:41:59.001 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.8040000000000002e-06 2024-09-13T06:41:59.001 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:59.001 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:59.001 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:59.001 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.698449+0000", 2024-09-13T06:41:59.001 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039087519000000001 2024-09-13T06:41:59.001 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:59.001 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:59.001 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:59.002 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.698567+0000", 2024-09-13T06:41:59.002 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00011857 2024-09-13T06:41:59.002 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:59.002 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:59.002 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:59.002 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.698689+0000", 2024-09-13T06:41:59.002 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00012226699999999999 2024-09-13T06:41:59.002 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:59.002 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:59.002 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:59.002 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:59.002 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:59.002 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27974 3.a 3:537b3559:::rbd_data.1121f2c5ee81.0000000000000016:13 [read 32768~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:59.002 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.660102+0000", 2024-09-13T06:41:59.003 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 122.313311966, 2024-09-13T06:41:59.003 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.038972346999999997, 2024-09-13T06:41:59.003 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:59.003 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:59.003 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:59.003 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:59.003 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:59.003 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27974 2024-09-13T06:41:59.003 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:59.003 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:59.003 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:59.003 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:59.003 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660102+0000", 2024-09-13T06:41:59.004 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:59.004 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:59.004 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:59.004 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:59.004 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660102+0000", 2024-09-13T06:41:59.004 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:59.004 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:59.004 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:59.004 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:59.004 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660100+0000", 2024-09-13T06:41:59.004 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999976 2024-09-13T06:41:59.004 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:59.004 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:59.005 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:59.005 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660114+0000", 2024-09-13T06:41:59.005 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.4466e-05 2024-09-13T06:41:59.005 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:59.005 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:59.005 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:59.005 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660148+0000", 2024-09-13T06:41:59.005 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.3742999999999999e-05 2024-09-13T06:41:59.005 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:59.005 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:59.005 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:59.005 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660170+0000", 2024-09-13T06:41:59.005 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.2518e-05 2024-09-13T06:41:59.005 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:59.006 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:59.006 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:59.006 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.698719+0000", 2024-09-13T06:41:59.006 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.038548529999999998 2024-09-13T06:41:59.006 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:59.006 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:59.006 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:59.006 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.698806+0000", 2024-09-13T06:41:59.006 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.7179e-05 2024-09-13T06:41:59.006 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:59.006 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:59.006 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:59.006 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.699074+0000", 2024-09-13T06:41:59.007 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00026834800000000001 2024-09-13T06:41:59.007 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:59.007 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:59.007 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:59.007 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:59.007 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:59.007 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27975 3.a 3:537b3559:::rbd_data.1121f2c5ee81.0000000000000016:13 [read 57344~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:59.007 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.660189+0000", 2024-09-13T06:41:59.007 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 122.31322512200001, 2024-09-13T06:41:59.007 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039288678, 2024-09-13T06:41:59.007 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:59.007 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:59.007 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:59.008 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:59.008 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:59.008 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27975 2024-09-13T06:41:59.008 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:59.008 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:59.008 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:59.008 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:59.008 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660189+0000", 2024-09-13T06:41:59.008 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:59.008 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:59.008 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:59.008 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:59.009 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660189+0000", 2024-09-13T06:41:59.009 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:59.009 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:59.009 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:59.009 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:59.009 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660187+0000", 2024-09-13T06:41:59.009 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999981 2024-09-13T06:41:59.009 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:59.009 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:59.009 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:59.009 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660195+0000", 2024-09-13T06:41:59.009 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5610000000000001e-06 2024-09-13T06:41:59.009 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:59.010 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:59.010 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:59.010 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660212+0000", 2024-09-13T06:41:59.010 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7725999999999999e-05 2024-09-13T06:41:59.010 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:59.010 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:59.010 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:59.010 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660227+0000", 2024-09-13T06:41:59.010 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.43e-05 2024-09-13T06:41:59.010 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:59.010 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:59.010 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:59.010 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.699135+0000", 2024-09-13T06:41:59.011 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.038908336000000002 2024-09-13T06:41:59.011 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:59.011 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:59.011 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:59.011 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.699208+0000", 2024-09-13T06:41:59.011 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.3065000000000006e-05 2024-09-13T06:41:59.011 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:59.011 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:59.011 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:59.011 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.699478+0000", 2024-09-13T06:41:59.011 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00026946899999999999 2024-09-13T06:41:59.011 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:59.011 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:59.012 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:59.012 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:59.012 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:59.012 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27976 3.a 3:537b3559:::rbd_data.1121f2c5ee81.0000000000000016:13 [read 102400~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:59.012 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.660238+0000", 2024-09-13T06:41:59.012 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 122.31317595900001, 2024-09-13T06:41:59.012 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039636515999999997, 2024-09-13T06:41:59.012 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:59.012 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:59.012 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:59.012 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:59.012 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:59.012 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27976 2024-09-13T06:41:59.013 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:59.013 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:59.013 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:59.013 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:59.013 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660238+0000", 2024-09-13T06:41:59.013 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:59.013 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:59.013 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:59.013 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:59.013 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660238+0000", 2024-09-13T06:41:59.013 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:59.013 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:59.013 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:59.014 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:59.014 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660237+0000", 2024-09-13T06:41:59.014 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:59.014 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:59.014 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:59.014 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:59.014 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660243+0000", 2024-09-13T06:41:59.014 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.9909999999999999e-06 2024-09-13T06:41:59.014 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:59.014 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:59.014 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:59.014 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660259+0000", 2024-09-13T06:41:59.014 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6294e-05 2024-09-13T06:41:59.014 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:59.015 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:59.015 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:59.015 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660272+0000", 2024-09-13T06:41:59.015 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2714999999999999e-05 2024-09-13T06:41:59.015 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:59.015 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:59.015 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:59.015 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.699513+0000", 2024-09-13T06:41:59.015 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039240932999999999 2024-09-13T06:41:59.015 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:59.015 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:59.015 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:59.015 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.699604+0000", 2024-09-13T06:41:59.015 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.1367999999999997e-05 2024-09-13T06:41:59.016 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:59.016 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:59.016 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:59.016 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.699875+0000", 2024-09-13T06:41:59.016 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00027029499999999999 2024-09-13T06:41:59.016 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:59.016 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:59.016 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:59.016 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:59.016 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:59.016 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27977 3.a 3:537b3559:::rbd_data.1121f2c5ee81.0000000000000016:13 [read 126976~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:59.016 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.660284+0000", 2024-09-13T06:41:59.016 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 122.313130387, 2024-09-13T06:41:59.017 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039969945, 2024-09-13T06:41:59.017 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:59.017 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:59.017 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:59.017 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:59.017 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:59.017 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27977 2024-09-13T06:41:59.017 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:59.017 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:59.017 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:59.017 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:59.017 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660284+0000", 2024-09-13T06:41:59.017 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:59.018 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:59.018 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:59.018 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:59.018 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660284+0000", 2024-09-13T06:41:59.018 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:59.018 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:59.018 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:59.018 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:59.018 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660282+0000", 2024-09-13T06:41:59.018 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999986 2024-09-13T06:41:59.018 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:59.018 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:59.018 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:59.019 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660288+0000", 2024-09-13T06:41:59.019 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.2650000000000002e-06 2024-09-13T06:41:59.019 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:59.019 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:59.019 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:59.019 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660304+0000", 2024-09-13T06:41:59.019 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5430999999999998e-05 2024-09-13T06:41:59.019 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:59.019 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:59.019 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:59.019 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660316+0000", 2024-09-13T06:41:59.019 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.237e-05 2024-09-13T06:41:59.019 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:59.019 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:59.020 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:59.020 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.699907+0000", 2024-09-13T06:41:59.020 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039590735000000002 2024-09-13T06:41:59.020 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:59.020 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:59.020 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:59.020 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.699994+0000", 2024-09-13T06:41:59.020 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6996999999999994e-05 2024-09-13T06:41:59.020 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:59.020 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:59.020 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:59.020 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700254+0000", 2024-09-13T06:41:59.020 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000259564 2024-09-13T06:41:59.020 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:59.021 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:59.021 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:59.021 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:59.021 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:59.021 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27978 3.a 3.9aacdeca (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:59.021 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.660327+0000", 2024-09-13T06:41:59.021 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 122.313086789, 2024-09-13T06:41:59.021 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039984858999999998, 2024-09-13T06:41:59.021 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:59.021 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:41:59.021 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:59.021 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:59.021 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:59.022 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27978 2024-09-13T06:41:59.022 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:59.022 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:59.022 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:59.022 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:59.022 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660327+0000", 2024-09-13T06:41:59.022 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:59.022 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:59.022 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:59.022 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:59.022 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660327+0000", 2024-09-13T06:41:59.022 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:59.022 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:59.023 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:59.023 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:59.023 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660326+0000", 2024-09-13T06:41:59.023 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:59.023 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:59.023 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:59.023 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:59.023 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660366+0000", 2024-09-13T06:41:59.023 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.9691000000000003e-05 2024-09-13T06:41:59.023 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:59.023 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:59.023 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:59.023 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660399+0000", 2024-09-13T06:41:59.023 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.3262000000000001e-05 2024-09-13T06:41:59.024 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:59.024 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:59.024 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:59.024 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660414+0000", 2024-09-13T06:41:59.024 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.4775e-05 2024-09-13T06:41:59.024 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:59.024 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:59.024 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:59.024 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700298+0000", 2024-09-13T06:41:59.024 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039883759999999997 2024-09-13T06:41:59.024 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:59.024 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:59.024 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:59.025 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700312+0000", 2024-09-13T06:41:59.025 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.4374e-05 2024-09-13T06:41:59.025 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:59.025 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:59.025 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:59.025 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:59.025 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:59.025 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27979 3.a 3.9aacdeca (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:59.025 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.660429+0000", 2024-09-13T06:41:59.025 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 122.31298492099999, 2024-09-13T06:41:59.025 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039921361000000002, 2024-09-13T06:41:59.025 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:59.025 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:41:59.026 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:59.026 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:59.026 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:59.026 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27979 2024-09-13T06:41:59.026 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:59.026 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:59.026 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:59.026 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:59.026 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660429+0000", 2024-09-13T06:41:59.026 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:59.026 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:59.026 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:59.026 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:59.026 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660429+0000", 2024-09-13T06:41:59.027 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:59.027 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:59.027 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:59.027 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:59.027 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660428+0000", 2024-09-13T06:41:59.027 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999986 2024-09-13T06:41:59.027 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:59.027 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:59.027 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:59.027 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660434+0000", 2024-09-13T06:41:59.028 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.8190000000000003e-06 2024-09-13T06:41:59.028 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:59.028 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:59.028 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:59.028 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660451+0000", 2024-09-13T06:41:59.028 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6963e-05 2024-09-13T06:41:59.028 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:59.028 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:59.028 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:59.028 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660485+0000", 2024-09-13T06:41:59.028 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.3414000000000002e-05 2024-09-13T06:41:59.028 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:59.028 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:59.029 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:59.029 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700342+0000", 2024-09-13T06:41:59.029 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039857278000000003 2024-09-13T06:41:59.029 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:59.029 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:59.029 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:59.029 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700350+0000", 2024-09-13T06:41:59.029 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.2930000000000001e-06 2024-09-13T06:41:59.029 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:59.030 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:59.030 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:59.030 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:59.030 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:59.030 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27980 3.a 3.9aacdeca (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:59.030 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.660497+0000", 2024-09-13T06:41:59.030 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 122.31291671, 2024-09-13T06:41:59.030 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039888034000000003, 2024-09-13T06:41:59.030 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:59.030 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:41:59.030 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:59.030 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:59.030 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:59.031 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27980 2024-09-13T06:41:59.031 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:59.031 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:59.031 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:59.031 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:59.031 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660497+0000", 2024-09-13T06:41:59.031 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:59.031 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:59.031 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:59.031 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:59.031 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660497+0000", 2024-09-13T06:41:59.031 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:59.031 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:59.032 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:59.032 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:59.032 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660496+0000", 2024-09-13T06:41:59.032 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:59.032 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:59.032 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:59.032 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:59.032 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660503+0000", 2024-09-13T06:41:59.032 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.4110000000000001e-06 2024-09-13T06:41:59.032 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:59.032 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:59.032 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:59.032 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660519+0000", 2024-09-13T06:41:59.032 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6180000000000001e-05 2024-09-13T06:41:59.033 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:59.033 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:59.033 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:59.033 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660544+0000", 2024-09-13T06:41:59.033 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.5177999999999998e-05 2024-09-13T06:41:59.033 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:59.033 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:59.033 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:59.033 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700377+0000", 2024-09-13T06:41:59.033 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039833434000000001 2024-09-13T06:41:59.033 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:59.033 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:59.033 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:59.034 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700385+0000", 2024-09-13T06:41:59.034 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.8800000000000008e-06 2024-09-13T06:41:59.034 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:59.034 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:59.034 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:59.034 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:59.034 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:59.034 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27981 3.a 3.9aacdeca (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:59.034 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.660556+0000", 2024-09-13T06:41:59.034 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 122.31285836399999, 2024-09-13T06:41:59.034 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039869989000000002, 2024-09-13T06:41:59.034 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:59.035 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:41:59.035 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:59.035 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:59.035 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:59.035 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27981 2024-09-13T06:41:59.035 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:59.035 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:59.035 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:59.035 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:59.035 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660556+0000", 2024-09-13T06:41:59.035 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:59.035 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:59.035 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:59.036 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:59.036 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660556+0000", 2024-09-13T06:41:59.036 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:59.036 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:59.036 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:59.036 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:59.036 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660555+0000", 2024-09-13T06:41:59.036 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:59.036 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:59.036 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:59.036 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:59.036 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660561+0000", 2024-09-13T06:41:59.036 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.088e-06 2024-09-13T06:41:59.037 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:59.037 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:59.037 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:59.037 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660577+0000", 2024-09-13T06:41:59.037 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6147999999999999e-05 2024-09-13T06:41:59.037 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:59.037 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:59.037 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:59.037 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660589+0000", 2024-09-13T06:41:59.037 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2551999999999999e-05 2024-09-13T06:41:59.037 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:59.037 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:59.037 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:59.037 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700414+0000", 2024-09-13T06:41:59.038 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039825007000000003 2024-09-13T06:41:59.038 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:59.038 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:59.038 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:59.038 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700426+0000", 2024-09-13T06:41:59.038 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1265e-05 2024-09-13T06:41:59.038 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:59.038 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:59.038 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:59.038 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:59.038 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:59.038 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27982 3.a 3.9aacdeca (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:59.038 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.660603+0000", 2024-09-13T06:41:59.039 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 122.312810769, 2024-09-13T06:41:59.039 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039874779999999999, 2024-09-13T06:41:59.039 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:59.039 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:41:59.039 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:59.039 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:59.039 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:59.039 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27982 2024-09-13T06:41:59.039 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:59.039 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:59.039 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:59.039 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:59.039 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660603+0000", 2024-09-13T06:41:59.039 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:59.040 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:59.040 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:59.040 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:59.040 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660603+0000", 2024-09-13T06:41:59.040 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:59.040 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:59.040 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:59.040 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:59.040 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660602+0000", 2024-09-13T06:41:59.040 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:59.040 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:59.040 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:59.040 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:59.041 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660653+0000", 2024-09-13T06:41:59.041 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.0862000000000002e-05 2024-09-13T06:41:59.041 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:59.041 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:59.041 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:59.041 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660697+0000", 2024-09-13T06:41:59.041 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.3773000000000003e-05 2024-09-13T06:41:59.041 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:59.041 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:59.041 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:59.041 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660712+0000", 2024-09-13T06:41:59.041 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5464999999999998e-05 2024-09-13T06:41:59.041 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:59.041 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:59.042 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:59.042 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700469+0000", 2024-09-13T06:41:59.042 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039756503999999998 2024-09-13T06:41:59.042 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:59.042 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:59.042 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:59.042 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700478+0000", 2024-09-13T06:41:59.042 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.1730000000000001e-06 2024-09-13T06:41:59.042 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:59.042 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:59.042 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:59.042 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:59.042 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:59.042 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27983 3.a 3.9aacdeca (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:59.043 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.660726+0000", 2024-09-13T06:41:59.043 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 122.312687494, 2024-09-13T06:41:59.043 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039804357999999998, 2024-09-13T06:41:59.043 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:59.043 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:41:59.043 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:59.043 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:59.043 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:59.043 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27983 2024-09-13T06:41:59.043 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:59.043 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:59.043 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:59.043 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:59.043 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660726+0000", 2024-09-13T06:41:59.044 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:59.044 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:59.044 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:59.044 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:59.044 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660726+0000", 2024-09-13T06:41:59.044 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:59.044 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:59.044 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:59.044 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:59.044 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660725+0000", 2024-09-13T06:41:59.044 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999986 2024-09-13T06:41:59.044 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:59.044 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:59.045 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:59.045 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660733+0000", 2024-09-13T06:41:59.045 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.9359999999999999e-06 2024-09-13T06:41:59.045 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:59.045 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:59.045 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:59.045 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660751+0000", 2024-09-13T06:41:59.045 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7679000000000001e-05 2024-09-13T06:41:59.045 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:59.045 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:59.045 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:59.045 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660764+0000", 2024-09-13T06:41:59.045 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3112000000000001e-05 2024-09-13T06:41:59.045 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:59.046 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:59.046 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:59.046 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700516+0000", 2024-09-13T06:41:59.046 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039752183000000003 2024-09-13T06:41:59.046 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:59.046 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:59.046 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:59.046 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700531+0000", 2024-09-13T06:41:59.046 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.4732999999999999e-05 2024-09-13T06:41:59.046 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:59.046 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:59.046 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:59.046 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:59.046 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:59.047 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27984 3.a 3.9aacdeca (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:59.047 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.660776+0000", 2024-09-13T06:41:59.047 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 122.31263839099999, 2024-09-13T06:41:59.047 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039795697999999997, 2024-09-13T06:41:59.047 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:59.047 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:41:59.047 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:59.047 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:59.047 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:59.047 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27984 2024-09-13T06:41:59.047 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:59.047 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:59.047 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:59.048 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:59.048 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660776+0000", 2024-09-13T06:41:59.048 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:59.048 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:59.048 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:59.048 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:59.048 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660776+0000", 2024-09-13T06:41:59.048 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:59.048 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:59.048 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:59.048 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:59.048 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660775+0000", 2024-09-13T06:41:59.048 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:59.048 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:59.049 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:59.049 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:59.049 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660780+0000", 2024-09-13T06:41:59.049 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.7849999999999997e-06 2024-09-13T06:41:59.049 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:59.049 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:59.049 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:59.049 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660799+0000", 2024-09-13T06:41:59.049 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.8794e-05 2024-09-13T06:41:59.049 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:59.049 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:59.049 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:59.049 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660812+0000", 2024-09-13T06:41:59.050 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3029e-05 2024-09-13T06:41:59.050 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:59.050 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:59.050 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:59.050 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700562+0000", 2024-09-13T06:41:59.050 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039749984000000002 2024-09-13T06:41:59.050 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:59.050 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:59.050 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:59.050 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700571+0000", 2024-09-13T06:41:59.050 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.1260000000000004e-06 2024-09-13T06:41:59.050 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:59.050 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:59.050 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:59.051 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:59.051 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:59.051 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27985 3.a 3.9aacdeca (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:59.051 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.660824+0000", 2024-09-13T06:41:59.051 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 122.312590339, 2024-09-13T06:41:59.051 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039784462, 2024-09-13T06:41:59.051 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:59.051 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:41:59.051 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:59.051 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:59.051 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:59.051 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27985 2024-09-13T06:41:59.051 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:59.052 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:59.052 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:59.052 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:59.052 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660824+0000", 2024-09-13T06:41:59.052 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:59.052 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:59.052 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:59.052 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:59.052 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660824+0000", 2024-09-13T06:41:59.052 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:59.052 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:59.052 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:59.052 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:59.053 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660823+0000", 2024-09-13T06:41:59.053 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:41:59.053 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:59.053 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:59.053 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:59.053 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660829+0000", 2024-09-13T06:41:59.053 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.9440000000000002e-06 2024-09-13T06:41:59.053 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:59.053 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:59.053 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:59.053 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660922+0000", 2024-09-13T06:41:59.053 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.2958e-05 2024-09-13T06:41:59.053 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:59.054 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:59.054 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:59.054 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660964+0000", 2024-09-13T06:41:59.054 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.2407000000000002e-05 2024-09-13T06:41:59.054 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:59.054 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:59.054 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:59.054 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700600+0000", 2024-09-13T06:41:59.054 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039635581000000003 2024-09-13T06:41:59.054 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:59.054 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:59.054 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:59.054 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700608+0000", 2024-09-13T06:41:59.054 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.5890000000000003e-06 2024-09-13T06:41:59.055 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:59.055 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:59.055 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:59.055 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:59.055 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:59.055 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:28023 3.10 3:0dedc28a:::rbd_data.1121f2c5ee81.0000000000000019:13 [read 475136~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:59.055 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.662072+0000", 2024-09-13T06:41:59.055 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 122.311342354, 2024-09-13T06:41:59.055 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.038086508999999998, 2024-09-13T06:41:59.055 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:59.055 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:41:59.055 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:59.055 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:59.056 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:59.056 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 28023 2024-09-13T06:41:59.056 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:59.056 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:59.056 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:59.056 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:59.056 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.662072+0000", 2024-09-13T06:41:59.056 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:59.056 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:59.056 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:59.056 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:59.056 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.662072+0000", 2024-09-13T06:41:59.056 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:59.057 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:59.057 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:59.057 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:59.057 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.662070+0000", 2024-09-13T06:41:59.057 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999986 2024-09-13T06:41:59.057 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:59.057 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:59.057 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:59.057 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.662076+0000", 2024-09-13T06:41:59.057 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.139e-06 2024-09-13T06:41:59.057 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:59.057 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:59.057 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:59.058 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.662094+0000", 2024-09-13T06:41:59.058 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7136999999999999e-05 2024-09-13T06:41:59.058 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:59.058 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:59.058 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:59.058 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.662124+0000", 2024-09-13T06:41:59.058 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.0528999999999999e-05 2024-09-13T06:41:59.058 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:59.058 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:59.058 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:59.058 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.699843+0000", 2024-09-13T06:41:59.058 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.037718415999999998 2024-09-13T06:41:59.058 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:59.059 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:59.059 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:41:59.059 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.699931+0000", 2024-09-13T06:41:59.059 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.8345999999999997e-05 2024-09-13T06:41:59.059 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:59.059 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:59.059 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:59.059 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700158+0000", 2024-09-13T06:41:59.059 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00022723099999999999 2024-09-13T06:41:59.059 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:59.059 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:59.059 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:59.059 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:59.059 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:59.060 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:28024 3.10 3.5143b7b0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:41:59.060 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.662137+0000", 2024-09-13T06:41:59.060 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 122.311276832, 2024-09-13T06:41:59.060 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.038056092999999999, 2024-09-13T06:41:59.060 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:41:59.060 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:41:59.060 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:41:59.060 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:41:59.060 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:59.060 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 28024 2024-09-13T06:41:59.060 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:59.060 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:41:59.060 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:59.060 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:41:59.061 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.662137+0000", 2024-09-13T06:41:59.061 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:59.061 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:59.061 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:59.061 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:41:59.061 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.662137+0000", 2024-09-13T06:41:59.061 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:41:59.061 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:59.061 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:59.061 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:41:59.061 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.662136+0000", 2024-09-13T06:41:59.061 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999986 2024-09-13T06:41:59.061 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:59.062 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:59.062 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:41:59.062 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.662142+0000", 2024-09-13T06:41:59.062 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.6930000000000001e-06 2024-09-13T06:41:59.062 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:59.062 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:59.062 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:41:59.062 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.662160+0000", 2024-09-13T06:41:59.062 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7863000000000002e-05 2024-09-13T06:41:59.062 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:59.062 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:59.062 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:41:59.062 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.662189+0000", 2024-09-13T06:41:59.063 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.8486000000000001e-05 2024-09-13T06:41:59.063 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:59.063 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:59.063 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:41:59.063 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700187+0000", 2024-09-13T06:41:59.063 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.037998331000000003 2024-09-13T06:41:59.063 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:41:59.063 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:41:59.063 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:41:59.063 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700193+0000", 2024-09-13T06:41:59.063 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.0909999999999998e-06 2024-09-13T06:41:59.063 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:59.063 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:59.064 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:59.064 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:41:59.064 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:41:59.064 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:41:59.066 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 reset_purged_snaps_last 2024-09-13T06:41:59.066 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:41:59.062+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:41:59.066 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-13T06:41:59.166 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:41:59.165+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:41:59.219 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:41:59.219 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-13T06:41:59.219 INFO:teuthology.orchestra.run.smithi081.stdout: "num_ops": 0 2024-09-13T06:41:59.219 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:41:59.232 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-13T06:41:59.311 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:41:59.309+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:41:59.368 INFO:tasks.ceph.osd.6.smithi139.stderr:2024-09-13T06:41:59.362+0000 7fcd02c5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26385) UID: 0 2024-09-13T06:41:59.415 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:41:59.416 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-13T06:41:59.416 INFO:teuthology.orchestra.run.smithi081.stdout: "complaint_time": 30, 2024-09-13T06:41:59.416 INFO:teuthology.orchestra.run.smithi081.stdout: "num_blocked_ops": 0 2024-09-13T06:41:59.416 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:41:59.428 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-13T06:41:59.468 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:41:59.466+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:41:59.550 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:41:59.551 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 20, 2024-09-13T06:41:59.551 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 600, 2024-09-13T06:41:59.551 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [ 2024-09-13T06:41:59.551 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:59.551 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:37801 3.1 3:82e31015:::rbd_object_map.1121d8143c6e.0000000000000019:head [call] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e55)", 2024-09-13T06:41:59.551 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:05.646191+0000", 2024-09-13T06:41:59.551 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 113.90382452, 2024-09-13T06:41:59.551 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.72659507800000001, 2024-09-13T06:41:59.551 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:59.551 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:59.551 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:59.551 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:59.551 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:59.552 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 37801 2024-09-13T06:41:59.552 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:59.552 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:59.552 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:59.552 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:59.552 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:05.646191+0000", 2024-09-13T06:41:59.552 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:59.552 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:59.552 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:59.552 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:59.552 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:05.646191+0000", 2024-09-13T06:41:59.552 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:59.552 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:59.553 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:59.553 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:59.553 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:05.646188+0000", 2024-09-13T06:41:59.553 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999971 2024-09-13T06:41:59.553 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:59.553 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:59.553 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:59.553 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:05.646206+0000", 2024-09-13T06:41:59.553 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8182999999999999e-05 2024-09-13T06:41:59.553 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:59.553 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:59.553 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:59.554 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:05.646237+0000", 2024-09-13T06:41:59.554 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.1071000000000001e-05 2024-09-13T06:41:59.554 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:59.554 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:59.554 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:59.554 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:05.646251+0000", 2024-09-13T06:41:59.554 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3679000000000001e-05 2024-09-13T06:41:59.554 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:59.554 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:59.554 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:59.554 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:05.646321+0000", 2024-09-13T06:41:59.554 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.9831000000000003e-05 2024-09-13T06:41:59.554 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:59.554 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:59.555 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:41:59.555 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:05.646331+0000", 2024-09-13T06:41:59.555 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0242e-05 2024-09-13T06:41:59.555 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:59.555 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:59.555 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:59.555 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.371959+0000", 2024-09-13T06:41:59.555 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.72562817199999996 2024-09-13T06:41:59.555 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:59.555 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:59.555 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:59.555 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.372389+0000", 2024-09-13T06:41:59.555 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00042977400000000001 2024-09-13T06:41:59.555 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:59.556 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:59.556 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:59.556 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.372786+0000", 2024-09-13T06:41:59.556 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00039706099999999999 2024-09-13T06:41:59.556 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:59.556 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:59.556 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:59.556 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:59.556 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:59.556 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43009 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 489472~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:59.556 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.644660+0000", 2024-09-13T06:41:59.556 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 97.905355557999997, 2024-09-13T06:41:59.557 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123376071, 2024-09-13T06:41:59.557 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:59.557 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:59.557 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:59.557 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:59.557 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:59.557 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43009 2024-09-13T06:41:59.557 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:59.557 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:59.557 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:59.557 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:59.557 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.644660+0000", 2024-09-13T06:41:59.557 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:59.557 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:59.558 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:59.558 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:59.558 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.644660+0000", 2024-09-13T06:41:59.558 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:59.558 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:59.558 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:59.558 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:59.558 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.644659+0000", 2024-09-13T06:41:59.558 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:59.558 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:59.558 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:59.558 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:59.558 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.644662+0000", 2024-09-13T06:41:59.559 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4949999999999998e-06 2024-09-13T06:41:59.559 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:59.559 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:59.559 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:59.559 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.644669+0000", 2024-09-13T06:41:59.559 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.289e-06 2024-09-13T06:41:59.559 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:59.559 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:59.559 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:59.559 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.644674+0000", 2024-09-13T06:41:59.559 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.8840000000000002e-06 2024-09-13T06:41:59.559 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:59.559 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:59.560 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:59.560 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.767602+0000", 2024-09-13T06:41:59.560 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.122928158 2024-09-13T06:41:59.560 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:59.560 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:59.560 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:59.560 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.767676+0000", 2024-09-13T06:41:59.560 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3992999999999994e-05 2024-09-13T06:41:59.560 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:59.560 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:59.560 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:59.560 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.768036+0000", 2024-09-13T06:41:59.560 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00035966200000000001 2024-09-13T06:41:59.560 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:59.561 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:59.561 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:59.561 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:59.561 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:59.561 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43010 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 503808~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:59.561 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.644678+0000", 2024-09-13T06:41:59.561 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 97.905337231999994, 2024-09-13T06:41:59.561 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123728798, 2024-09-13T06:41:59.561 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:59.561 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:59.561 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:59.561 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:59.561 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:59.562 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43010 2024-09-13T06:41:59.562 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:59.562 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:59.562 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:59.562 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:59.562 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.644678+0000", 2024-09-13T06:41:59.562 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:59.562 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:59.562 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:59.562 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:59.562 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.644678+0000", 2024-09-13T06:41:59.562 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:59.562 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:59.563 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:59.563 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:59.563 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.644678+0000", 2024-09-13T06:41:59.563 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:59.563 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:59.563 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:59.563 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:59.563 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.644680+0000", 2024-09-13T06:41:59.563 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2050000000000001e-06 2024-09-13T06:41:59.563 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:59.563 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:59.563 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:59.563 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.644686+0000", 2024-09-13T06:41:59.563 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8440000000000003e-06 2024-09-13T06:41:59.564 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:59.564 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:59.564 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:59.564 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.644691+0000", 2024-09-13T06:41:59.564 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.118e-06 2024-09-13T06:41:59.564 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:59.564 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:59.564 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:59.564 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.768065+0000", 2024-09-13T06:41:59.564 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123374698 2024-09-13T06:41:59.564 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:59.564 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:59.564 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:59.565 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.768139+0000", 2024-09-13T06:41:59.565 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3934000000000001e-05 2024-09-13T06:41:59.565 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:59.565 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:59.565 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:59.565 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.768407+0000", 2024-09-13T06:41:59.565 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00026738800000000002 2024-09-13T06:41:59.565 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:59.565 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:59.565 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:59.565 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:59.565 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:59.565 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43181 3.17 3:ec5ebce4:::rbd_data.1121f5f2e1c0.0000000000000001:1f [read 319488~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:59.566 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.652968+0000", 2024-09-13T06:41:59.566 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 97.897046716000006, 2024-09-13T06:41:59.566 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.12363807, 2024-09-13T06:41:59.566 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:59.566 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:59.566 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:59.566 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:59.566 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:59.566 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43181 2024-09-13T06:41:59.566 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:59.566 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:59.566 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:59.566 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:59.567 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.652968+0000", 2024-09-13T06:41:59.567 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:59.567 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:59.567 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:59.567 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:59.567 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.652968+0000", 2024-09-13T06:41:59.567 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:59.567 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:59.567 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:59.567 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:59.567 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.652968+0000", 2024-09-13T06:41:59.567 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:59.567 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:59.567 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:59.568 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:59.568 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.652970+0000", 2024-09-13T06:41:59.568 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2409999999999998e-06 2024-09-13T06:41:59.568 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:59.568 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:59.568 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:59.568 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.652976+0000", 2024-09-13T06:41:59.568 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0079999999999999e-06 2024-09-13T06:41:59.568 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:59.568 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:59.568 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:59.568 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.652981+0000", 2024-09-13T06:41:59.568 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4390000000000002e-06 2024-09-13T06:41:59.568 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:59.569 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:59.569 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:59.569 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.776275+0000", 2024-09-13T06:41:59.569 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.12329396099999999 2024-09-13T06:41:59.569 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:59.569 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:59.569 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:59.569 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.776316+0000", 2024-09-13T06:41:59.569 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.1244e-05 2024-09-13T06:41:59.569 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:59.569 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:59.569 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:59.570 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.776607+0000", 2024-09-13T06:41:59.570 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00029051199999999999 2024-09-13T06:41:59.570 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:59.570 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:59.570 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:59.570 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:59.570 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:59.570 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43182 3.17 3:ec5ebce4:::rbd_data.1121f5f2e1c0.0000000000000001:1f [read 333824~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:59.570 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.652985+0000", 2024-09-13T06:41:59.570 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 97.897029907000004, 2024-09-13T06:41:59.570 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123926616, 2024-09-13T06:41:59.570 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:59.570 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:59.570 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:59.571 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:59.571 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:59.571 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43182 2024-09-13T06:41:59.571 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:59.571 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:59.571 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:59.571 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:59.571 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.652985+0000", 2024-09-13T06:41:59.571 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:59.571 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:59.571 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:59.571 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:59.571 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.652985+0000", 2024-09-13T06:41:59.572 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:59.572 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:59.572 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:59.572 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:59.572 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.652985+0000", 2024-09-13T06:41:59.572 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:59.572 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:59.572 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:59.572 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:59.572 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.652987+0000", 2024-09-13T06:41:59.572 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0899999999999999e-06 2024-09-13T06:41:59.572 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:59.572 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:59.573 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:59.573 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.652994+0000", 2024-09-13T06:41:59.573 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3100000000000003e-06 2024-09-13T06:41:59.573 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:59.573 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:59.573 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:59.573 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.653000+0000", 2024-09-13T06:41:59.573 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2020000000000003e-06 2024-09-13T06:41:59.573 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:59.573 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:59.573 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:59.573 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.776635+0000", 2024-09-13T06:41:59.573 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.12363529400000001 2024-09-13T06:41:59.574 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:59.574 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:59.574 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:59.574 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.776676+0000", 2024-09-13T06:41:59.574 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.0745999999999999e-05 2024-09-13T06:41:59.574 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:59.574 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:59.574 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:59.574 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.776912+0000", 2024-09-13T06:41:59.574 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00023631300000000001 2024-09-13T06:41:59.574 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:59.574 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:59.574 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:59.574 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:59.575 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:59.575 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43192 3.17 3:ec5ebce4:::rbd_data.1121f5f2e1c0.0000000000000001:1f [read 466944~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:59.575 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.656622+0000", 2024-09-13T06:41:59.575 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 97.893392851000002, 2024-09-13T06:41:59.575 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123503136, 2024-09-13T06:41:59.575 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:59.575 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:59.575 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:59.575 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:59.575 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:59.575 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43192 2024-09-13T06:41:59.575 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:59.575 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:59.575 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:59.576 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:59.576 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656622+0000", 2024-09-13T06:41:59.576 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:59.576 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:59.576 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:59.576 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:59.576 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656622+0000", 2024-09-13T06:41:59.576 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:59.576 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:59.576 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:59.576 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:59.576 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656622+0000", 2024-09-13T06:41:59.577 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:41:59.577 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:59.577 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:59.577 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:59.577 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656623+0000", 2024-09-13T06:41:59.577 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2079999999999999e-06 2024-09-13T06:41:59.577 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:59.577 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:59.577 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:59.577 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656627+0000", 2024-09-13T06:41:59.577 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.4819999999999999e-06 2024-09-13T06:41:59.577 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:59.577 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:59.578 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:59.578 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656629+0000", 2024-09-13T06:41:59.578 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.582e-06 2024-09-13T06:41:59.578 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:59.578 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:59.578 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:59.578 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.779866+0000", 2024-09-13T06:41:59.578 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.12323638100000001 2024-09-13T06:41:59.578 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:59.578 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:59.579 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:59.579 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.779905+0000", 2024-09-13T06:41:59.579 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.9529e-05 2024-09-13T06:41:59.579 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:59.579 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:59.579 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:59.579 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.780125+0000", 2024-09-13T06:41:59.579 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000220168 2024-09-13T06:41:59.579 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:59.579 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:59.579 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:59.579 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:59.579 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:59.580 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43193 3.17 3:ec5ebce4:::rbd_data.1121f5f2e1c0.0000000000000001:1f [read 481280~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:59.580 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.656635+0000", 2024-09-13T06:41:59.580 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 97.893380367000006, 2024-09-13T06:41:59.580 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.12374478999999999, 2024-09-13T06:41:59.580 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:59.580 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:59.580 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:59.580 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:59.580 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:59.580 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43193 2024-09-13T06:41:59.580 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:59.581 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:59.581 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:59.581 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:59.581 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656635+0000", 2024-09-13T06:41:59.581 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:59.581 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:59.581 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:59.581 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:59.581 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656635+0000", 2024-09-13T06:41:59.581 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:59.581 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:59.581 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:59.581 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:59.582 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656635+0000", 2024-09-13T06:41:59.582 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:41:59.582 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:59.582 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:59.582 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:59.582 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656636+0000", 2024-09-13T06:41:59.582 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.544e-06 2024-09-13T06:41:59.582 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:59.582 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:59.582 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:59.582 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656639+0000", 2024-09-13T06:41:59.582 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.0879999999999999e-06 2024-09-13T06:41:59.582 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:59.582 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:59.583 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:59.583 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656642+0000", 2024-09-13T06:41:59.583 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5799999999999999e-06 2024-09-13T06:41:59.583 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:59.583 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:59.583 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:59.583 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.780151+0000", 2024-09-13T06:41:59.583 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123509035 2024-09-13T06:41:59.583 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:59.583 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:59.583 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:59.583 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.780191+0000", 2024-09-13T06:41:59.583 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.9758000000000001e-05 2024-09-13T06:41:59.583 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:59.584 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:59.584 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:59.584 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.780380+0000", 2024-09-13T06:41:59.584 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000189023 2024-09-13T06:41:59.584 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:59.584 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:59.584 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:59.584 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:59.584 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:59.584 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43194 3.17 3:ec5ebce4:::rbd_data.1121f5f2e1c0.0000000000000001:1f [read 495616~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:59.584 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.656645+0000", 2024-09-13T06:41:59.584 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 97.893369714000002, 2024-09-13T06:41:59.584 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.124088483, 2024-09-13T06:41:59.585 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:59.585 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:59.585 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:59.585 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:59.585 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:59.585 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43194 2024-09-13T06:41:59.585 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:59.585 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:59.585 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:59.585 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:59.585 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656645+0000", 2024-09-13T06:41:59.585 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:59.585 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:59.586 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:59.586 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:59.586 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656645+0000", 2024-09-13T06:41:59.586 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:59.586 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:59.586 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:59.586 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:59.586 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656645+0000", 2024-09-13T06:41:59.586 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:59.586 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:59.586 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:59.586 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:59.586 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656647+0000", 2024-09-13T06:41:59.586 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9180000000000001e-06 2024-09-13T06:41:59.587 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:59.587 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:59.587 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:59.587 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656653+0000", 2024-09-13T06:41:59.587 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7860000000000002e-06 2024-09-13T06:41:59.587 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:59.587 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:59.587 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:59.587 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656658+0000", 2024-09-13T06:41:59.587 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6949999999999999e-06 2024-09-13T06:41:59.587 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:59.587 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:59.587 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:59.587 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.780406+0000", 2024-09-13T06:41:59.588 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123748657 2024-09-13T06:41:59.588 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:59.588 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:59.588 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:59.588 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.780446+0000", 2024-09-13T06:41:59.588 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.9360999999999998e-05 2024-09-13T06:41:59.588 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:59.588 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:59.588 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:59.588 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.780734+0000", 2024-09-13T06:41:59.588 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00028838399999999998 2024-09-13T06:41:59.588 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:59.588 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:59.589 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:59.589 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:59.589 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:59.589 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43240 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 106496~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:59.589 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.660672+0000", 2024-09-13T06:41:59.589 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 97.889343350999994, 2024-09-13T06:41:59.589 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123612707, 2024-09-13T06:41:59.589 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:59.589 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:59.589 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:59.589 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:59.589 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:59.589 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43240 2024-09-13T06:41:59.590 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:59.590 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:59.590 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:59.590 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:59.590 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660672+0000", 2024-09-13T06:41:59.590 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:59.590 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:59.590 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:59.590 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:59.590 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660672+0000", 2024-09-13T06:41:59.590 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:59.590 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:59.590 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:59.590 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:59.591 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660671+0000", 2024-09-13T06:41:59.591 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:59.591 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:59.591 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:59.591 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:59.591 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660673+0000", 2024-09-13T06:41:59.591 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.652e-06 2024-09-13T06:41:59.591 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:59.591 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:59.591 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:59.591 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660677+0000", 2024-09-13T06:41:59.591 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.2509999999999996e-06 2024-09-13T06:41:59.591 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:59.591 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:59.592 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:59.592 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660680+0000", 2024-09-13T06:41:59.592 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.8150000000000002e-06 2024-09-13T06:41:59.592 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:59.592 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:59.592 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:59.592 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.783596+0000", 2024-09-13T06:41:59.592 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.122915841 2024-09-13T06:41:59.592 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:59.592 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:59.592 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:59.592 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.783682+0000", 2024-09-13T06:41:59.593 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.5822999999999995e-05 2024-09-13T06:41:59.593 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:59.593 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:59.593 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:59.593 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.784285+0000", 2024-09-13T06:41:59.593 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00060276500000000001 2024-09-13T06:41:59.593 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:59.593 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:59.593 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:59.593 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:59.593 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:59.593 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43241 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 120832~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:59.593 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.660682+0000", 2024-09-13T06:41:59.593 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 97.889332776000003, 2024-09-13T06:41:59.594 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123958204, 2024-09-13T06:41:59.594 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:59.594 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:59.594 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:59.594 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:59.594 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:59.594 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43241 2024-09-13T06:41:59.594 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:59.594 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:59.594 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:59.594 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:59.594 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660682+0000", 2024-09-13T06:41:59.594 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:59.595 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:59.595 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:59.595 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:59.595 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660682+0000", 2024-09-13T06:41:59.595 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:59.595 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:59.595 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:59.595 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:59.595 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660682+0000", 2024-09-13T06:41:59.595 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:59.595 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:59.595 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:59.595 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:59.595 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660683+0000", 2024-09-13T06:41:59.596 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.308e-06 2024-09-13T06:41:59.596 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:59.596 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:59.596 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:59.596 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660686+0000", 2024-09-13T06:41:59.596 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.977e-06 2024-09-13T06:41:59.596 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:59.596 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:59.596 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:59.596 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660689+0000", 2024-09-13T06:41:59.596 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5830000000000001e-06 2024-09-13T06:41:59.596 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:59.597 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:59.597 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:59.597 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.784366+0000", 2024-09-13T06:41:59.597 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.12367713599999999 2024-09-13T06:41:59.597 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:59.597 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:59.597 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:59.597 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.784451+0000", 2024-09-13T06:41:59.597 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.4629999999999994e-05 2024-09-13T06:41:59.597 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:59.597 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:59.597 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:59.597 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.784641+0000", 2024-09-13T06:41:59.598 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00018984899999999999 2024-09-13T06:41:59.598 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:59.598 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:59.598 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:59.598 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:59.598 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:59.598 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43242 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 139264~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:59.598 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.660691+0000", 2024-09-13T06:41:59.598 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 97.889323798000007, 2024-09-13T06:41:59.598 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.124536443, 2024-09-13T06:41:59.598 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:59.598 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:59.598 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:59.598 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:59.599 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:59.599 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43242 2024-09-13T06:41:59.599 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:59.599 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:59.599 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:59.599 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:59.599 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660691+0000", 2024-09-13T06:41:59.599 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:59.599 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:59.599 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:59.599 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:59.599 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660691+0000", 2024-09-13T06:41:59.599 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:59.599 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:59.600 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:59.600 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:59.600 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660691+0000", 2024-09-13T06:41:59.600 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:41:59.600 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:59.600 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:59.600 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:59.600 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660696+0000", 2024-09-13T06:41:59.600 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0560000000000004e-06 2024-09-13T06:41:59.600 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:59.600 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:59.600 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:59.600 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660699+0000", 2024-09-13T06:41:59.601 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.2009999999999999e-06 2024-09-13T06:41:59.601 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:59.601 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:59.601 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:59.601 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660702+0000", 2024-09-13T06:41:59.601 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.633e-06 2024-09-13T06:41:59.601 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:59.601 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:59.601 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:59.601 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.784912+0000", 2024-09-13T06:41:59.601 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.124209497 2024-09-13T06:41:59.601 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:59.601 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:59.601 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:59.602 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.784995+0000", 2024-09-13T06:41:59.602 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.3891e-05 2024-09-13T06:41:59.602 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:59.602 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:59.602 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:59.602 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.785228+0000", 2024-09-13T06:41:59.602 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00023237400000000001 2024-09-13T06:41:59.602 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:59.602 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:59.602 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:59.602 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:59.602 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:59.602 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43243 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 153600~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:59.602 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.660705+0000", 2024-09-13T06:41:59.603 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 97.889310464999994, 2024-09-13T06:41:59.603 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.124825835, 2024-09-13T06:41:59.603 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:59.603 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:59.603 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:59.603 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:59.603 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:59.603 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43243 2024-09-13T06:41:59.603 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:59.603 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:59.603 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:59.603 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:59.603 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660705+0000", 2024-09-13T06:41:59.604 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:59.604 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:59.604 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:59.604 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:59.604 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660705+0000", 2024-09-13T06:41:59.604 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:59.604 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:59.604 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:59.604 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:59.604 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660705+0000", 2024-09-13T06:41:59.604 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:41:59.604 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:59.604 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:59.605 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:59.605 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660706+0000", 2024-09-13T06:41:59.605 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4339999999999999e-06 2024-09-13T06:41:59.605 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:59.605 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:59.605 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:59.605 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660709+0000", 2024-09-13T06:41:59.605 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9000000000000002e-06 2024-09-13T06:41:59.605 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:59.605 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:59.605 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:59.605 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660712+0000", 2024-09-13T06:41:59.606 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.0589999999999998e-06 2024-09-13T06:41:59.606 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:59.606 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:59.606 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:59.606 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.785318+0000", 2024-09-13T06:41:59.606 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.124606299 2024-09-13T06:41:59.606 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:59.606 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:59.606 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:59.606 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.785361+0000", 2024-09-13T06:41:59.606 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.3214999999999999e-05 2024-09-13T06:41:59.606 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:59.606 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:59.606 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:59.607 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.785531+0000", 2024-09-13T06:41:59.607 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00016914400000000001 2024-09-13T06:41:59.607 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:59.607 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:59.607 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:59.607 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:59.607 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:59.607 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43244 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 167936~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:59.607 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.660714+0000", 2024-09-13T06:41:59.607 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 97.889301051999993, 2024-09-13T06:41:59.607 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.125073248, 2024-09-13T06:41:59.607 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:59.607 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:59.607 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:59.608 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:59.608 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:59.608 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43244 2024-09-13T06:41:59.608 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:59.608 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:59.608 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:59.608 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:59.608 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660714+0000", 2024-09-13T06:41:59.608 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:59.608 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:59.608 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:59.608 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:59.608 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660714+0000", 2024-09-13T06:41:59.609 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:59.609 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:59.609 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:59.609 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:59.609 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660714+0000", 2024-09-13T06:41:59.609 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:41:59.609 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:59.609 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:59.609 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:59.609 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660715+0000", 2024-09-13T06:41:59.609 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2330000000000001e-06 2024-09-13T06:41:59.609 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:59.610 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:59.610 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:59.610 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660718+0000", 2024-09-13T06:41:59.610 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9569999999999998e-06 2024-09-13T06:41:59.610 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:59.610 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:59.610 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:59.610 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660721+0000", 2024-09-13T06:41:59.610 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.678e-06 2024-09-13T06:41:59.610 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:59.610 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:59.610 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:59.610 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.785557+0000", 2024-09-13T06:41:59.611 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.12483633199999999 2024-09-13T06:41:59.611 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:59.611 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:59.611 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:59.611 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.785618+0000", 2024-09-13T06:41:59.611 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0686000000000001e-05 2024-09-13T06:41:59.611 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:59.611 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:59.611 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:59.611 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.785787+0000", 2024-09-13T06:41:59.611 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00016957699999999999 2024-09-13T06:41:59.611 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:59.611 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:59.611 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:59.612 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:59.612 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:59.612 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43254 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 315392~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:59.612 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.664717+0000", 2024-09-13T06:41:59.612 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 97.885298484000003, 2024-09-13T06:41:59.612 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.12357108, 2024-09-13T06:41:59.612 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:59.612 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:59.612 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:59.612 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:59.612 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:59.612 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43254 2024-09-13T06:41:59.612 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:59.613 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:59.613 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:59.613 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:59.613 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664717+0000", 2024-09-13T06:41:59.613 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:59.613 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:59.613 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:59.613 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:59.613 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664717+0000", 2024-09-13T06:41:59.613 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:59.613 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:59.613 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:59.614 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:59.614 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664716+0000", 2024-09-13T06:41:59.614 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:59.614 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:59.614 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:59.614 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:59.614 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664724+0000", 2024-09-13T06:41:59.614 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.7109999999999995e-06 2024-09-13T06:41:59.614 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:59.614 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:59.614 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:59.614 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664732+0000", 2024-09-13T06:41:59.614 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.8399999999999995e-06 2024-09-13T06:41:59.614 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:59.615 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:59.615 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:59.615 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664738+0000", 2024-09-13T06:41:59.615 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.879e-06 2024-09-13T06:41:59.615 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:59.615 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:59.615 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:59.615 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.788018+0000", 2024-09-13T06:41:59.615 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123280719 2024-09-13T06:41:59.615 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:59.615 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:59.615 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:59.615 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.788119+0000", 2024-09-13T06:41:59.616 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000100558 2024-09-13T06:41:59.616 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:59.616 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:59.616 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:59.616 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.788288+0000", 2024-09-13T06:41:59.616 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000168751 2024-09-13T06:41:59.616 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:59.616 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:59.616 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:59.616 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:59.616 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:59.616 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43255 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 329728~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:59.616 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.664743+0000", 2024-09-13T06:41:59.617 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 97.885272487999998, 2024-09-13T06:41:59.617 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.12381711500000001, 2024-09-13T06:41:59.617 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:59.617 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:59.617 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:59.617 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:59.617 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:59.617 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43255 2024-09-13T06:41:59.617 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:59.617 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:59.617 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:59.617 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:59.617 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664743+0000", 2024-09-13T06:41:59.618 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:59.618 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:59.618 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:59.618 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:59.618 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664743+0000", 2024-09-13T06:41:59.618 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:59.618 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:59.618 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:59.618 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:59.618 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664742+0000", 2024-09-13T06:41:59.618 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:59.618 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:59.618 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:59.618 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:59.619 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664745+0000", 2024-09-13T06:41:59.619 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.7269999999999999e-06 2024-09-13T06:41:59.619 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:59.619 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:59.619 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:59.619 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664753+0000", 2024-09-13T06:41:59.619 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.8709999999999997e-06 2024-09-13T06:41:59.619 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:59.619 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:59.619 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:59.619 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664758+0000", 2024-09-13T06:41:59.619 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2220000000000001e-06 2024-09-13T06:41:59.619 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:59.620 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:59.620 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:59.620 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.788314+0000", 2024-09-13T06:41:59.620 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123555545 2024-09-13T06:41:59.620 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:59.620 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:59.620 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:59.620 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.788368+0000", 2024-09-13T06:41:59.620 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3928999999999998e-05 2024-09-13T06:41:59.620 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:59.620 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:59.620 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:59.620 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.788560+0000", 2024-09-13T06:41:59.621 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000192237 2024-09-13T06:41:59.621 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:59.621 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:59.621 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:59.621 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:59.621 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:59.621 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43256 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 344064~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:59.621 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.664763+0000", 2024-09-13T06:41:59.621 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 97.885252542000003, 2024-09-13T06:41:59.621 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.12418359399999999, 2024-09-13T06:41:59.621 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:59.621 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:59.621 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:59.622 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:59.622 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:59.622 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43256 2024-09-13T06:41:59.622 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:59.622 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:59.622 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:59.622 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:59.622 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664763+0000", 2024-09-13T06:41:59.622 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:59.622 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:59.622 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:59.622 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:59.622 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664763+0000", 2024-09-13T06:41:59.623 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:59.623 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:59.623 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:59.623 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:59.623 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664762+0000", 2024-09-13T06:41:59.623 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:59.623 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:59.623 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:59.623 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:59.623 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664765+0000", 2024-09-13T06:41:59.623 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3290000000000001e-06 2024-09-13T06:41:59.623 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:59.623 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:59.623 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:59.624 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664771+0000", 2024-09-13T06:41:59.624 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.1319999999999999e-06 2024-09-13T06:41:59.624 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:59.624 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:59.624 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:59.624 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664776+0000", 2024-09-13T06:41:59.624 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.8840000000000002e-06 2024-09-13T06:41:59.624 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:59.624 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:59.624 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:59.624 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.788598+0000", 2024-09-13T06:41:59.624 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123821979 2024-09-13T06:41:59.624 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:59.625 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:59.625 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:59.625 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.788680+0000", 2024-09-13T06:41:59.625 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.2367999999999995e-05 2024-09-13T06:41:59.625 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:59.625 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:59.625 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:59.625 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.788946+0000", 2024-09-13T06:41:59.625 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00026629799999999999 2024-09-13T06:41:59.625 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:59.625 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:59.625 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:59.626 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:59.626 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:59.626 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43265 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 477184~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:59.626 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.669414+0000", 2024-09-13T06:41:59.626 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 97.880600905999998, 2024-09-13T06:41:59.626 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123446973, 2024-09-13T06:41:59.626 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:59.626 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:59.626 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:59.626 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:59.626 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:59.626 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43265 2024-09-13T06:41:59.626 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:59.626 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:59.627 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:59.627 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:59.627 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669414+0000", 2024-09-13T06:41:59.627 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:59.627 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:59.627 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:59.627 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:59.627 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669414+0000", 2024-09-13T06:41:59.627 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:59.627 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:59.627 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:59.627 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:59.627 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669414+0000", 2024-09-13T06:41:59.628 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:59.628 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:59.628 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:59.628 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:59.628 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669416+0000", 2024-09-13T06:41:59.628 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.317e-06 2024-09-13T06:41:59.628 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:59.628 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:59.628 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:59.628 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669425+0000", 2024-09-13T06:41:59.628 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.0650000000000005e-06 2024-09-13T06:41:59.628 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:59.628 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:59.629 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:59.629 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669430+0000", 2024-09-13T06:41:59.629 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5079999999999999e-06 2024-09-13T06:41:59.629 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:59.629 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:59.629 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:59.629 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.792649+0000", 2024-09-13T06:41:59.629 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123219328 2024-09-13T06:41:59.629 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:59.629 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:59.629 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:59.629 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.792695+0000", 2024-09-13T06:41:59.629 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5476999999999998e-05 2024-09-13T06:41:59.629 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:59.630 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:59.630 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:59.630 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.792861+0000", 2024-09-13T06:41:59.630 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00016658999999999999 2024-09-13T06:41:59.630 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:59.630 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:59.630 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:59.630 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:59.630 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:59.630 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43266 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 491520~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:59.630 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.669434+0000", 2024-09-13T06:41:59.630 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 97.880580784000003, 2024-09-13T06:41:59.630 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123685267, 2024-09-13T06:41:59.631 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:59.631 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:59.631 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:59.631 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:59.631 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:59.631 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43266 2024-09-13T06:41:59.631 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:59.631 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:59.631 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:59.631 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:59.631 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669434+0000", 2024-09-13T06:41:59.631 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:59.631 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:59.632 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:59.632 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:59.632 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669434+0000", 2024-09-13T06:41:59.632 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:59.632 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:59.632 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:59.632 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:59.632 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669434+0000", 2024-09-13T06:41:59.632 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:59.632 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:59.632 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:59.632 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:59.632 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669441+0000", 2024-09-13T06:41:59.633 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3019999999999997e-06 2024-09-13T06:41:59.633 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:59.633 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:59.633 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:59.633 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669451+0000", 2024-09-13T06:41:59.633 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.6379999999999999e-06 2024-09-13T06:41:59.633 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:59.633 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:59.633 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:59.633 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669456+0000", 2024-09-13T06:41:59.633 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.361e-06 2024-09-13T06:41:59.633 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:59.633 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:59.634 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:59.634 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.792879+0000", 2024-09-13T06:41:59.634 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123422686 2024-09-13T06:41:59.634 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:59.634 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:59.634 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:59.634 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.792923+0000", 2024-09-13T06:41:59.634 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4035000000000001e-05 2024-09-13T06:41:59.634 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:59.634 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:59.634 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:59.634 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.793120+0000", 2024-09-13T06:41:59.634 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00019660899999999999 2024-09-13T06:41:59.634 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:59.635 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:59.635 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:59.635 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:59.635 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:59.635 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43267 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 505856~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:59.635 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.669461+0000", 2024-09-13T06:41:59.635 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 97.880553988000003, 2024-09-13T06:41:59.635 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123933711, 2024-09-13T06:41:59.635 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:59.635 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:59.635 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:59.635 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:59.635 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:59.635 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43267 2024-09-13T06:41:59.636 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:59.636 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:59.636 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:59.636 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:59.636 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669461+0000", 2024-09-13T06:41:59.636 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:59.636 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:59.636 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:59.636 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:59.636 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669461+0000", 2024-09-13T06:41:59.636 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:59.636 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:59.636 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:59.637 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:59.637 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669461+0000", 2024-09-13T06:41:59.637 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:59.637 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:59.637 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:59.637 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:59.637 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669463+0000", 2024-09-13T06:41:59.637 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5629999999999999e-06 2024-09-13T06:41:59.637 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:59.637 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:59.637 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:59.637 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669473+0000", 2024-09-13T06:41:59.637 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.9520000000000006e-06 2024-09-13T06:41:59.637 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:59.638 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:59.638 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:59.638 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669479+0000", 2024-09-13T06:41:59.638 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8540000000000002e-06 2024-09-13T06:41:59.638 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:59.638 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:59.638 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:59.638 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.793137+0000", 2024-09-13T06:41:59.638 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.12365825699999999 2024-09-13T06:41:59.638 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:59.638 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:59.638 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:59.638 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.793181+0000", 2024-09-13T06:41:59.639 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.3773999999999998e-05 2024-09-13T06:41:59.639 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:59.639 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:59.639 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:59.639 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.793395+0000", 2024-09-13T06:41:59.639 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00021372399999999999 2024-09-13T06:41:59.639 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:59.639 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:59.639 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:59.639 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:59.639 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:59.639 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43268 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 520192~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:41:59.639 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.669484+0000", 2024-09-13T06:41:59.640 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 97.880531203000004, 2024-09-13T06:41:59.640 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.12441057899999999, 2024-09-13T06:41:59.640 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:41:59.640 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:41:59.640 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:41:59.640 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:41:59.640 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:41:59.640 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43268 2024-09-13T06:41:59.640 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:59.640 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:41:59.640 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:59.640 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:41:59.640 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669484+0000", 2024-09-13T06:41:59.640 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:59.641 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:59.641 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:59.641 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:41:59.641 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669484+0000", 2024-09-13T06:41:59.641 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:41:59.641 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:59.641 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:59.641 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:41:59.641 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669484+0000", 2024-09-13T06:41:59.641 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:41:59.641 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:59.641 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:59.641 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:41:59.642 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669486+0000", 2024-09-13T06:41:59.642 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6120000000000001e-06 2024-09-13T06:41:59.642 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:59.642 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:59.642 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:41:59.642 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669494+0000", 2024-09-13T06:41:59.642 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4819999999999997e-06 2024-09-13T06:41:59.642 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:59.642 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:59.642 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:41:59.642 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669497+0000", 2024-09-13T06:41:59.642 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9790000000000002e-06 2024-09-13T06:41:59.642 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:59.643 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:59.643 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:41:59.643 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.793559+0000", 2024-09-13T06:41:59.643 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.124062436 2024-09-13T06:41:59.643 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:59.643 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:59.643 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:41:59.643 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.793603+0000", 2024-09-13T06:41:59.643 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.3764999999999999e-05 2024-09-13T06:41:59.643 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:41:59.643 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:41:59.643 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:41:59.643 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.793895+0000", 2024-09-13T06:41:59.644 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00029168299999999999 2024-09-13T06:41:59.644 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:59.644 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:59.644 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:59.644 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:41:59.644 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:41:59.644 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:41:59.645 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-13T06:41:59.646 INFO:tasks.ceph.osd.6.smithi139.stderr:2024-09-13T06:41:59.642+0000 7fcd02c5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26385) UID: 0 2024-09-13T06:41:59.729 INFO:teuthology.orchestra.run.smithi081.stderr:nodeep-scrub is unset 2024-09-13T06:41:59.746 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:41:59.745+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:41:59.780 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:41:59.780 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-13T06:41:59.780 INFO:teuthology.orchestra.run.smithi081.stdout: "num_ops": 0 2024-09-13T06:41:59.780 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:41:59.796 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-13T06:41:59.847 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:41:59.846+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:41:59.918 INFO:teuthology.orchestra.run.smithi081.stdout:checking clone #28, image image_client.0-clone28 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent29 2024-09-13T06:41:59.948 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:41:59.945+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:41:59.966 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:41:59.966 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-13T06:41:59.966 INFO:teuthology.orchestra.run.smithi081.stdout: "complaint_time": 30, 2024-09-13T06:41:59.966 INFO:teuthology.orchestra.run.smithi081.stdout: "num_blocked_ops": 0 2024-09-13T06:41:59.966 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:41:59.984 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-13T06:42:00.070 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:42:00.069+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:42:00.145 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:42:00.145 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 20, 2024-09-13T06:42:00.145 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 600, 2024-09-13T06:42:00.146 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [ 2024-09-13T06:42:00.146 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:00.146 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:21979 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 14217216~4096 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:42:00.146 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.888811+0000", 2024-09-13T06:42:00.146 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 127.25603821599999, 2024-09-13T06:42:00.146 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049092969, 2024-09-13T06:42:00.146 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:00.146 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:00.146 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:00.146 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:00.146 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:00.146 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 21979 2024-09-13T06:42:00.146 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:00.147 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:00.147 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:00.147 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:00.147 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888811+0000", 2024-09-13T06:42:00.147 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:00.147 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:00.147 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:00.147 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:00.147 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888811+0000", 2024-09-13T06:42:00.147 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:00.147 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:00.147 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:00.147 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:00.147 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888811+0000", 2024-09-13T06:42:00.148 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:42:00.148 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:00.148 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:00.148 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:00.148 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888812+0000", 2024-09-13T06:42:00.148 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.204e-06 2024-09-13T06:42:00.148 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:00.148 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:00.148 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:00.148 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888815+0000", 2024-09-13T06:42:00.148 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9359999999999999e-06 2024-09-13T06:42:00.148 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:00.148 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:00.149 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:00.149 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888818+0000", 2024-09-13T06:42:00.149 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.7369999999999998e-06 2024-09-13T06:42:00.149 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:00.149 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:00.149 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:00.149 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.937663+0000", 2024-09-13T06:42:00.149 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.048844540999999998 2024-09-13T06:42:00.149 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:00.149 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:00.149 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:00.149 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.937709+0000", 2024-09-13T06:42:00.149 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6492999999999997e-05 2024-09-13T06:42:00.150 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:00.150 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:00.150 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:00.150 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.937904+0000", 2024-09-13T06:42:00.150 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00019526499999999999 2024-09-13T06:42:00.150 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:00.150 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:00.150 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:00.150 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:00.150 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:00.150 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:21980 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 14245888~4096 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:42:00.150 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.888820+0000", 2024-09-13T06:42:00.151 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 127.256029539, 2024-09-13T06:42:00.151 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049357080999999997, 2024-09-13T06:42:00.151 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:00.151 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:00.151 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:00.151 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:00.151 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:00.151 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 21980 2024-09-13T06:42:00.151 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:00.151 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:00.151 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:00.151 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:00.151 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888820+0000", 2024-09-13T06:42:00.152 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:00.152 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:00.152 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:00.152 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:00.152 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888820+0000", 2024-09-13T06:42:00.152 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:00.152 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:00.152 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:00.152 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:00.152 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888820+0000", 2024-09-13T06:42:00.152 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:42:00.152 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:00.152 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:00.152 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:00.153 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888821+0000", 2024-09-13T06:42:00.153 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.122e-06 2024-09-13T06:42:00.153 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:00.153 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:00.153 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:00.153 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888824+0000", 2024-09-13T06:42:00.153 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.0580000000000002e-06 2024-09-13T06:42:00.153 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:00.153 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:00.153 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:00.153 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888827+0000", 2024-09-13T06:42:00.153 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.666e-06 2024-09-13T06:42:00.154 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:00.154 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:00.154 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:00.154 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.937935+0000", 2024-09-13T06:42:00.154 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049108329999999999 2024-09-13T06:42:00.154 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:00.154 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:00.154 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:00.154 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.937985+0000", 2024-09-13T06:42:00.154 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9694000000000002e-05 2024-09-13T06:42:00.154 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:00.154 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:00.154 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:00.155 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.938177+0000", 2024-09-13T06:42:00.155 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00019241899999999999 2024-09-13T06:42:00.155 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:00.155 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:00.155 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:00.155 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:00.155 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:00.155 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:21984 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:snapdir [list-snaps] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:42:00.155 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.888829+0000", 2024-09-13T06:42:00.155 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 127.256020761, 2024-09-13T06:42:00.155 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049524545000000003, 2024-09-13T06:42:00.155 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:00.155 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:00.155 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:00.156 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:00.156 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:00.156 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 21984 2024-09-13T06:42:00.156 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:00.156 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:00.156 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:00.156 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:00.156 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888829+0000", 2024-09-13T06:42:00.156 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:00.156 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:00.156 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:00.156 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:00.156 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888829+0000", 2024-09-13T06:42:00.157 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:00.157 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:00.157 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:00.157 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:00.157 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888829+0000", 2024-09-13T06:42:00.157 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:42:00.157 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:00.157 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:00.157 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:00.157 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888830+0000", 2024-09-13T06:42:00.157 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2529999999999999e-06 2024-09-13T06:42:00.157 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:00.157 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:00.157 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:00.158 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888835+0000", 2024-09-13T06:42:00.158 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.4729999999999999e-06 2024-09-13T06:42:00.158 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:00.158 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:00.158 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:00.158 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888840+0000", 2024-09-13T06:42:00.158 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0159999999999999e-06 2024-09-13T06:42:00.158 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:00.158 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:00.158 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:00.158 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.938199+0000", 2024-09-13T06:42:00.158 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049358974999999999 2024-09-13T06:42:00.158 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:00.158 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:00.159 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:00.159 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.938268+0000", 2024-09-13T06:42:00.159 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.8876999999999998e-05 2024-09-13T06:42:00.159 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:00.159 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:00.159 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:00.159 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.938353+0000", 2024-09-13T06:42:00.159 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.5155999999999996e-05 2024-09-13T06:42:00.159 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:00.159 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:00.159 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:00.159 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:00.159 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:00.159 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:21985 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 12587008~4096 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:42:00.160 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.888858+0000", 2024-09-13T06:42:00.160 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 127.255991611, 2024-09-13T06:42:00.160 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049674347000000001, 2024-09-13T06:42:00.160 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:00.160 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:00.160 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:00.160 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:00.160 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:00.160 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 21985 2024-09-13T06:42:00.160 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:00.160 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:00.160 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:00.161 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:00.161 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888858+0000", 2024-09-13T06:42:00.161 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:00.161 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:00.161 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:00.161 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:00.161 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888858+0000", 2024-09-13T06:42:00.161 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:00.161 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:00.161 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:00.161 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:00.161 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888857+0000", 2024-09-13T06:42:00.161 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:00.161 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:00.162 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:00.162 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:00.162 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888860+0000", 2024-09-13T06:42:00.162 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4739999999999999e-06 2024-09-13T06:42:00.162 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:00.162 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:00.162 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:00.162 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888867+0000", 2024-09-13T06:42:00.162 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.7170000000000002e-06 2024-09-13T06:42:00.162 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:00.162 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:00.162 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:00.162 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888871+0000", 2024-09-13T06:42:00.163 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5120000000000002e-06 2024-09-13T06:42:00.163 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:00.163 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:00.163 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:00.163 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.938389+0000", 2024-09-13T06:42:00.163 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049517717000000003 2024-09-13T06:42:00.163 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:00.163 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:00.163 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:00.163 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.938449+0000", 2024-09-13T06:42:00.163 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0513999999999997e-05 2024-09-13T06:42:00.163 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:00.163 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:00.163 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:00.163 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.938532+0000", 2024-09-13T06:42:00.164 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.2936999999999996e-05 2024-09-13T06:42:00.164 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:00.164 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:00.164 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:00.164 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:00.164 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:00.164 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:21986 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 12615680~4096 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:42:00.164 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.888875+0000", 2024-09-13T06:42:00.164 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 127.255974098, 2024-09-13T06:42:00.164 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049881781, 2024-09-13T06:42:00.164 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:00.164 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:00.165 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:00.165 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:00.165 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:00.165 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 21986 2024-09-13T06:42:00.165 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:00.165 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:00.165 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:00.165 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:00.165 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888875+0000", 2024-09-13T06:42:00.165 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:00.166 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:00.166 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:00.166 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:00.166 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888875+0000", 2024-09-13T06:42:00.166 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:00.166 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:00.166 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:00.166 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:00.166 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888875+0000", 2024-09-13T06:42:00.166 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:00.166 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:00.166 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:00.166 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:00.167 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888880+0000", 2024-09-13T06:42:00.167 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7600000000000002e-06 2024-09-13T06:42:00.167 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:00.167 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:00.167 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:00.167 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888887+0000", 2024-09-13T06:42:00.167 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3950000000000003e-06 2024-09-13T06:42:00.167 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:00.167 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:00.167 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:00.167 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888892+0000", 2024-09-13T06:42:00.167 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0409999999999997e-06 2024-09-13T06:42:00.167 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:00.167 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:00.168 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:00.168 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.938568+0000", 2024-09-13T06:42:00.168 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049675267000000002 2024-09-13T06:42:00.168 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:00.168 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:00.168 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:00.168 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.938653+0000", 2024-09-13T06:42:00.168 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.5792999999999997e-05 2024-09-13T06:42:00.168 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:00.168 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:00.168 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:00.168 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.938757+0000", 2024-09-13T06:42:00.168 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00010387699999999999 2024-09-13T06:42:00.169 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:00.169 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:00.169 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:00.169 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:00.169 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:00.169 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:21987 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 12644352~4096 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:42:00.169 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.888899+0000", 2024-09-13T06:42:00.169 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 127.255950752, 2024-09-13T06:42:00.169 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.050094056999999997, 2024-09-13T06:42:00.169 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:00.169 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:00.169 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:00.169 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:00.170 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:00.170 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 21987 2024-09-13T06:42:00.170 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:00.170 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:00.170 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:00.170 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:00.170 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888899+0000", 2024-09-13T06:42:00.170 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:00.170 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:00.170 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:00.170 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:00.170 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888899+0000", 2024-09-13T06:42:00.170 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:00.171 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:00.171 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:00.171 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:00.171 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888899+0000", 2024-09-13T06:42:00.171 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:00.171 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:00.171 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:00.171 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:00.171 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888901+0000", 2024-09-13T06:42:00.171 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2539999999999999e-06 2024-09-13T06:42:00.171 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:00.171 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:00.171 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:00.171 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888907+0000", 2024-09-13T06:42:00.172 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9009999999999999e-06 2024-09-13T06:42:00.172 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:00.172 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:00.172 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:00.172 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888912+0000", 2024-09-13T06:42:00.172 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9840000000000001e-06 2024-09-13T06:42:00.172 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:00.172 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:00.172 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:00.172 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.938810+0000", 2024-09-13T06:42:00.172 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049898835000000002 2024-09-13T06:42:00.172 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:00.172 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:00.173 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:00.173 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.938890+0000", 2024-09-13T06:42:00.173 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.9215000000000006e-05 2024-09-13T06:42:00.173 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:00.173 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:00.173 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:00.173 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.938993+0000", 2024-09-13T06:42:00.173 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000103194 2024-09-13T06:42:00.173 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:00.173 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:00.173 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:00.173 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:00.173 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:00.174 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:21988 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 12673024~4096 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:42:00.174 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.888916+0000", 2024-09-13T06:42:00.174 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 127.255933736, 2024-09-13T06:42:00.174 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.050203036999999999, 2024-09-13T06:42:00.174 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:00.174 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:00.174 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:00.174 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:00.174 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:00.174 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 21988 2024-09-13T06:42:00.174 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:00.174 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:00.174 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:00.174 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:00.175 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888916+0000", 2024-09-13T06:42:00.175 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:00.175 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:00.175 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:00.175 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:00.175 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888916+0000", 2024-09-13T06:42:00.175 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:00.175 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:00.175 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:00.175 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:00.175 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888915+0000", 2024-09-13T06:42:00.175 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:00.175 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:00.175 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:00.176 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:00.176 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888918+0000", 2024-09-13T06:42:00.176 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1500000000000002e-06 2024-09-13T06:42:00.176 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:00.176 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:00.176 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:00.176 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888925+0000", 2024-09-13T06:42:00.176 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.9380000000000003e-06 2024-09-13T06:42:00.176 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:00.176 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:00.176 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:00.176 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888933+0000", 2024-09-13T06:42:00.177 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.0560000000000005e-06 2024-09-13T06:42:00.177 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:00.177 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:00.177 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:00.177 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.939026+0000", 2024-09-13T06:42:00.177 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.050093499999999999 2024-09-13T06:42:00.177 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:00.177 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:00.177 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:00.177 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.939068+0000", 2024-09-13T06:42:00.177 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.1705999999999997e-05 2024-09-13T06:42:00.177 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:00.177 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:00.178 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:00.178 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.939119+0000", 2024-09-13T06:42:00.178 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.1048999999999999e-05 2024-09-13T06:42:00.178 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:00.178 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:00.178 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:00.178 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:00.178 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:00.178 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:21989 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 12701696~4096 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:42:00.178 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.888938+0000", 2024-09-13T06:42:00.178 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 127.25591140900001, 2024-09-13T06:42:00.178 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.050294393999999999, 2024-09-13T06:42:00.178 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:00.178 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:00.179 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:00.179 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:00.179 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:00.179 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 21989 2024-09-13T06:42:00.179 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:00.179 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:00.179 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:00.179 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:00.179 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888938+0000", 2024-09-13T06:42:00.179 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:00.179 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:00.179 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:00.180 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:00.180 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888938+0000", 2024-09-13T06:42:00.180 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:00.180 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:00.180 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:00.180 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:00.180 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888938+0000", 2024-09-13T06:42:00.180 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:00.180 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:00.180 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:00.180 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:00.180 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888940+0000", 2024-09-13T06:42:00.180 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5330000000000001e-06 2024-09-13T06:42:00.180 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:00.181 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:00.181 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:00.181 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888947+0000", 2024-09-13T06:42:00.181 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.2389999999999999e-06 2024-09-13T06:42:00.181 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:00.181 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:00.181 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:00.181 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888952+0000", 2024-09-13T06:42:00.181 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.5720000000000002e-06 2024-09-13T06:42:00.181 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:00.181 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:00.181 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:00.181 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.939141+0000", 2024-09-13T06:42:00.182 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.050188903999999999 2024-09-13T06:42:00.182 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:00.182 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:00.182 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:00.182 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.939182+0000", 2024-09-13T06:42:00.182 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.0926000000000001e-05 2024-09-13T06:42:00.182 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:00.182 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:00.182 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:00.182 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.939233+0000", 2024-09-13T06:42:00.182 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0532999999999999e-05 2024-09-13T06:42:00.182 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:00.182 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:00.182 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:00.183 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:00.183 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:00.183 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:22007 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 13217792~4096 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:42:00.183 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.892771+0000", 2024-09-13T06:42:00.183 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 127.252078303, 2024-09-13T06:42:00.183 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049090024000000003, 2024-09-13T06:42:00.183 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:00.183 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:00.183 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:00.183 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:00.183 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:00.183 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 22007 2024-09-13T06:42:00.183 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:00.183 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:00.184 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:00.184 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:00.184 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892771+0000", 2024-09-13T06:42:00.184 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:00.184 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:00.184 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:00.184 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:00.184 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892771+0000", 2024-09-13T06:42:00.184 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:00.184 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:00.184 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:00.184 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:00.184 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892771+0000", 2024-09-13T06:42:00.185 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:42:00.185 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:00.185 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:00.185 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:00.185 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892772+0000", 2024-09-13T06:42:00.185 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.184e-06 2024-09-13T06:42:00.185 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:00.185 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:00.185 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:00.185 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892775+0000", 2024-09-13T06:42:00.185 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9179999999999998e-06 2024-09-13T06:42:00.185 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:00.185 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:00.186 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:00.186 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892778+0000", 2024-09-13T06:42:00.186 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4990000000000001e-06 2024-09-13T06:42:00.186 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:00.186 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:00.186 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:00.186 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.941760+0000", 2024-09-13T06:42:00.186 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.048982070000000003 2024-09-13T06:42:00.186 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:00.186 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:00.186 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:00.186 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.941808+0000", 2024-09-13T06:42:00.186 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.8278000000000001e-05 2024-09-13T06:42:00.186 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:00.187 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:00.187 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:00.187 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.941861+0000", 2024-09-13T06:42:00.187 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3284e-05 2024-09-13T06:42:00.187 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:00.187 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:00.187 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:00.187 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:00.187 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:00.187 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:22008 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 13246464~4096 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:42:00.187 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.892780+0000", 2024-09-13T06:42:00.187 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 127.252069646, 2024-09-13T06:42:00.188 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049200477999999999, 2024-09-13T06:42:00.188 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:00.188 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:00.188 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:00.188 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:00.188 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:00.188 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 22008 2024-09-13T06:42:00.188 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:00.188 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:00.188 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:00.188 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:00.188 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892780+0000", 2024-09-13T06:42:00.188 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:00.189 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:00.189 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:00.189 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:00.189 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892780+0000", 2024-09-13T06:42:00.189 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:00.189 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:00.189 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:00.189 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:00.189 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892780+0000", 2024-09-13T06:42:00.189 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:42:00.189 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:00.189 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:00.189 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:00.189 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892781+0000", 2024-09-13T06:42:00.190 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.083e-06 2024-09-13T06:42:00.190 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:00.190 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:00.190 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:00.190 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892784+0000", 2024-09-13T06:42:00.190 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.926e-06 2024-09-13T06:42:00.190 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:00.190 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:00.190 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:00.190 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892786+0000", 2024-09-13T06:42:00.190 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4490000000000002e-06 2024-09-13T06:42:00.190 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:00.191 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:00.191 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:00.191 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.941888+0000", 2024-09-13T06:42:00.191 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049102290999999999 2024-09-13T06:42:00.191 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:00.191 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:00.191 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:00.191 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.941929+0000", 2024-09-13T06:42:00.191 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.0541999999999999e-05 2024-09-13T06:42:00.191 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:00.191 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:00.191 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:00.191 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.941980+0000", 2024-09-13T06:42:00.192 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.1391999999999999e-05 2024-09-13T06:42:00.192 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:00.192 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:00.192 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:00.192 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:00.192 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:00.192 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:22009 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 13275136~4096 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:42:00.192 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.892788+0000", 2024-09-13T06:42:00.192 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 127.252061162, 2024-09-13T06:42:00.192 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049311926999999998, 2024-09-13T06:42:00.192 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:00.192 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:00.192 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:00.192 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:00.193 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:00.193 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 22009 2024-09-13T06:42:00.193 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:00.193 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:00.193 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:00.193 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:00.193 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892788+0000", 2024-09-13T06:42:00.193 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:00.193 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:00.193 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:00.193 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:00.193 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892788+0000", 2024-09-13T06:42:00.193 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:00.194 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:00.194 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:00.194 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:00.194 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892788+0000", 2024-09-13T06:42:00.194 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:42:00.194 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:00.194 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:00.194 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:00.194 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892789+0000", 2024-09-13T06:42:00.194 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1850000000000001e-06 2024-09-13T06:42:00.194 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:00.194 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:00.194 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:00.194 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892793+0000", 2024-09-13T06:42:00.195 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.9099999999999998e-06 2024-09-13T06:42:00.195 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:00.195 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:00.195 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:00.195 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892798+0000", 2024-09-13T06:42:00.195 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5070000000000002e-06 2024-09-13T06:42:00.195 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:00.195 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:00.195 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:00.195 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.942007+0000", 2024-09-13T06:42:00.195 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049208904999999997 2024-09-13T06:42:00.195 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:00.195 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:00.195 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:00.196 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.942049+0000", 2024-09-13T06:42:00.196 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.1922000000000003e-05 2024-09-13T06:42:00.196 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:00.196 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:00.196 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:00.196 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.942100+0000", 2024-09-13T06:42:00.196 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.1736000000000001e-05 2024-09-13T06:42:00.196 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:00.196 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:00.196 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:00.196 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:00.196 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:00.196 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:22010 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 13303808~4096 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:42:00.197 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.892817+0000", 2024-09-13T06:42:00.197 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 127.252032966, 2024-09-13T06:42:00.197 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049466149000000001, 2024-09-13T06:42:00.197 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:00.197 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:00.197 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:00.197 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:00.197 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:00.197 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 22010 2024-09-13T06:42:00.197 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:00.197 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:00.197 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:00.197 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:00.197 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892817+0000", 2024-09-13T06:42:00.198 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:00.198 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:00.198 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:00.198 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:00.198 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892817+0000", 2024-09-13T06:42:00.198 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:00.198 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:00.198 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:00.198 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:00.198 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892816+0000", 2024-09-13T06:42:00.198 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:00.198 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:00.198 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:00.198 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:00.198 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892821+0000", 2024-09-13T06:42:00.199 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9459999999999997e-06 2024-09-13T06:42:00.199 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:00.199 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:00.199 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:00.199 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892828+0000", 2024-09-13T06:42:00.199 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.6780000000000003e-06 2024-09-13T06:42:00.199 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:00.199 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:00.199 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:00.199 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892833+0000", 2024-09-13T06:42:00.199 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.8389999999999997e-06 2024-09-13T06:42:00.199 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:00.199 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:00.200 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:00.200 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.942127+0000", 2024-09-13T06:42:00.200 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049294163000000002 2024-09-13T06:42:00.200 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:00.200 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:00.200 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:00.200 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.942186+0000", 2024-09-13T06:42:00.200 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9335e-05 2024-09-13T06:42:00.200 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:00.200 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:00.200 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:00.200 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.942283+0000", 2024-09-13T06:42:00.200 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.6699000000000004e-05 2024-09-13T06:42:00.200 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:00.201 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:00.201 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:00.201 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:00.201 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:00.201 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:22011 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 13332480~4096 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:42:00.201 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.892838+0000", 2024-09-13T06:42:00.201 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 127.252011279, 2024-09-13T06:42:00.201 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049589214, 2024-09-13T06:42:00.201 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:00.201 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:00.201 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:00.201 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:00.201 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:00.202 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 22011 2024-09-13T06:42:00.202 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:00.202 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:00.202 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:00.202 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:00.202 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892838+0000", 2024-09-13T06:42:00.202 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:00.202 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:00.202 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:00.202 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:00.202 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892838+0000", 2024-09-13T06:42:00.202 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:00.202 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:00.202 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:00.203 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:00.203 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892838+0000", 2024-09-13T06:42:00.203 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:00.203 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:00.203 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:00.203 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:00.203 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892840+0000", 2024-09-13T06:42:00.203 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.136e-06 2024-09-13T06:42:00.203 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:00.203 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:00.203 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:00.203 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892852+0000", 2024-09-13T06:42:00.203 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2122e-05 2024-09-13T06:42:00.203 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:00.204 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:00.204 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:00.204 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892862+0000", 2024-09-13T06:42:00.204 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.7049999999999994e-06 2024-09-13T06:42:00.204 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:00.204 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:00.204 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:00.204 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.942319+0000", 2024-09-13T06:42:00.204 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049456623999999998 2024-09-13T06:42:00.204 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:00.204 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:00.204 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:00.205 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.942363+0000", 2024-09-13T06:42:00.205 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4759000000000003e-05 2024-09-13T06:42:00.205 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:00.205 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:00.205 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:00.205 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.942428+0000", 2024-09-13T06:42:00.205 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.4221999999999996e-05 2024-09-13T06:42:00.205 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:00.205 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:00.205 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:00.205 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:00.206 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:00.206 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:22033 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 13963264~4096 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:42:00.206 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.896824+0000", 2024-09-13T06:42:00.206 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 127.24802538599999, 2024-09-13T06:42:00.206 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049051957, 2024-09-13T06:42:00.206 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:00.206 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:00.206 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:00.206 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:00.206 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:00.206 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 22033 2024-09-13T06:42:00.206 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:00.206 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:00.207 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:00.207 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:00.207 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.896824+0000", 2024-09-13T06:42:00.207 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:00.207 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:00.207 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:00.207 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:00.207 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.896824+0000", 2024-09-13T06:42:00.207 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:00.207 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:00.207 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:00.207 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:00.207 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.896824+0000", 2024-09-13T06:42:00.208 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:00.208 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:00.208 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:00.208 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:00.208 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.896826+0000", 2024-09-13T06:42:00.208 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1900000000000002e-06 2024-09-13T06:42:00.208 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:00.208 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:00.208 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:00.208 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.896832+0000", 2024-09-13T06:42:00.208 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.2689999999999996e-06 2024-09-13T06:42:00.208 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:00.208 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:00.208 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:00.209 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.896840+0000", 2024-09-13T06:42:00.209 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3289999999999996e-06 2024-09-13T06:42:00.209 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:00.209 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:00.209 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:00.209 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.945777+0000", 2024-09-13T06:42:00.209 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.048937188 2024-09-13T06:42:00.209 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:00.209 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:00.209 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:00.209 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.945822+0000", 2024-09-13T06:42:00.209 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4780999999999997e-05 2024-09-13T06:42:00.209 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:00.209 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:00.210 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:00.210 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.945876+0000", 2024-09-13T06:42:00.210 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.4542000000000001e-05 2024-09-13T06:42:00.210 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:00.210 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:00.210 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:00.210 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:00.210 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:00.210 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:22338 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 13611008~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:42:00.210 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.951070+0000", 2024-09-13T06:42:00.210 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 127.19377975800001, 2024-09-13T06:42:00.210 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049135817999999998, 2024-09-13T06:42:00.210 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:00.210 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:00.211 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:00.211 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:00.211 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:00.211 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 22338 2024-09-13T06:42:00.211 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:00.211 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:00.211 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:00.211 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:00.211 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951070+0000", 2024-09-13T06:42:00.211 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:00.211 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:00.211 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:00.211 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:00.211 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951070+0000", 2024-09-13T06:42:00.212 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:00.212 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:00.212 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:00.212 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:00.212 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951069+0000", 2024-09-13T06:42:00.212 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:00.212 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:00.212 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:00.212 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:00.212 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951072+0000", 2024-09-13T06:42:00.212 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5909999999999998e-06 2024-09-13T06:42:00.212 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:00.212 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:00.213 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:00.213 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951078+0000", 2024-09-13T06:42:00.213 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.4450000000000001e-06 2024-09-13T06:42:00.213 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:00.213 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:00.213 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:00.213 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951083+0000", 2024-09-13T06:42:00.213 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7790000000000003e-06 2024-09-13T06:42:00.213 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:00.213 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:00.213 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:00.213 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:53.000020+0000", 2024-09-13T06:42:00.213 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.048936999000000002 2024-09-13T06:42:00.214 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:00.214 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:00.214 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:00.214 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:53.000106+0000", 2024-09-13T06:42:00.214 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.5532999999999996e-05 2024-09-13T06:42:00.214 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:00.214 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:00.214 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:00.214 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:53.000206+0000", 2024-09-13T06:42:00.214 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.9852999999999994e-05 2024-09-13T06:42:00.214 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:00.214 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:00.214 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:00.214 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:00.215 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:00.215 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:22339 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 13639680~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:42:00.215 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.951088+0000", 2024-09-13T06:42:00.215 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 127.19376206, 2024-09-13T06:42:00.215 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049238202000000002, 2024-09-13T06:42:00.215 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:00.215 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:00.215 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:00.215 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:00.215 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:00.215 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 22339 2024-09-13T06:42:00.215 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:00.215 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:00.216 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:00.216 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:00.216 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951088+0000", 2024-09-13T06:42:00.216 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:00.216 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:00.216 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:00.216 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:00.216 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951088+0000", 2024-09-13T06:42:00.216 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:00.216 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:00.216 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:00.216 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:00.216 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951087+0000", 2024-09-13T06:42:00.217 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:00.217 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:00.217 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:00.217 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:00.217 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951089+0000", 2024-09-13T06:42:00.217 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.153e-06 2024-09-13T06:42:00.217 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:00.217 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:00.217 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:00.217 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951093+0000", 2024-09-13T06:42:00.217 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.7120000000000002e-06 2024-09-13T06:42:00.217 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:00.217 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:00.217 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:00.218 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951096+0000", 2024-09-13T06:42:00.218 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.0570000000000001e-06 2024-09-13T06:42:00.218 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:00.218 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:00.218 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:00.218 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:53.000220+0000", 2024-09-13T06:42:00.218 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049123989 2024-09-13T06:42:00.218 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:00.218 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:00.218 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:00.218 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:53.000271+0000", 2024-09-13T06:42:00.218 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.062e-05 2024-09-13T06:42:00.218 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:00.219 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:00.219 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:00.219 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:53.000326+0000", 2024-09-13T06:42:00.219 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.5121000000000003e-05 2024-09-13T06:42:00.219 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:00.219 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:00.219 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:00.219 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:00.219 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:00.219 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:22340 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 13668352~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:42:00.219 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.951200+0000", 2024-09-13T06:42:00.219 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 127.193649171, 2024-09-13T06:42:00.219 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049352350000000003, 2024-09-13T06:42:00.220 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:00.220 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:00.220 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:00.220 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:00.220 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:00.220 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 22340 2024-09-13T06:42:00.220 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:00.220 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:00.220 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:00.220 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:00.220 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951200+0000", 2024-09-13T06:42:00.220 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:00.220 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:00.220 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:00.221 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:00.221 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951200+0000", 2024-09-13T06:42:00.221 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:00.221 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:00.221 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:00.221 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:00.221 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951098+0000", 2024-09-13T06:42:00.221 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.999898 2024-09-13T06:42:00.221 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:00.221 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:00.221 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:00.221 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951204+0000", 2024-09-13T06:42:00.221 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000105398 2024-09-13T06:42:00.222 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:00.222 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:00.222 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:00.222 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951211+0000", 2024-09-13T06:42:00.222 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.43e-06 2024-09-13T06:42:00.222 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:00.222 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:00.222 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:00.222 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951216+0000", 2024-09-13T06:42:00.222 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2800000000000003e-06 2024-09-13T06:42:00.222 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:00.222 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:00.222 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:00.222 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:53.000358+0000", 2024-09-13T06:42:00.223 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049142036 2024-09-13T06:42:00.223 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:00.223 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:00.223 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:00.223 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:53.000443+0000", 2024-09-13T06:42:00.223 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.4710999999999996e-05 2024-09-13T06:42:00.223 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:00.223 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:00.223 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:00.223 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:53.000553+0000", 2024-09-13T06:42:00.223 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000109622 2024-09-13T06:42:00.223 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:00.223 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:00.224 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:00.224 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:00.224 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:00.224 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:22348 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 13897728~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:42:00.224 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.952783+0000", 2024-09-13T06:42:00.224 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 127.192066383, 2024-09-13T06:42:00.224 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049120832000000003, 2024-09-13T06:42:00.224 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:00.224 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:00.224 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:00.224 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:00.224 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:00.224 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 22348 2024-09-13T06:42:00.225 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:00.225 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:00.225 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:00.225 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:00.225 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.952783+0000", 2024-09-13T06:42:00.225 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:00.225 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:00.225 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:00.225 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:00.225 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.952783+0000", 2024-09-13T06:42:00.225 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:00.225 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:00.225 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:00.226 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:00.226 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.952783+0000", 2024-09-13T06:42:00.226 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:00.226 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:00.226 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:00.226 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:00.226 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.952785+0000", 2024-09-13T06:42:00.226 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4980000000000001e-06 2024-09-13T06:42:00.226 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:00.226 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:00.226 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:00.226 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.952799+0000", 2024-09-13T06:42:00.226 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3825000000000001e-05 2024-09-13T06:42:00.226 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:00.227 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:00.227 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:00.227 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.952809+0000", 2024-09-13T06:42:00.227 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0043e-05 2024-09-13T06:42:00.227 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:00.227 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:00.227 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:00.227 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:53.001723+0000", 2024-09-13T06:42:00.227 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.048914065 2024-09-13T06:42:00.227 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:00.227 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:00.227 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:00.227 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:53.001807+0000", 2024-09-13T06:42:00.228 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.3776000000000006e-05 2024-09-13T06:42:00.228 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:00.228 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:00.228 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:00.228 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:53.001904+0000", 2024-09-13T06:42:00.228 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.7004999999999997e-05 2024-09-13T06:42:00.228 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:00.228 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:00.228 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:00.228 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:00.228 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:00.228 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:69045 3.0 3:05ea3821:::rbd_data.1121867cc19b.0000000000000000:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109)", 2024-09-13T06:42:00.228 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:41:03.637760+0000", 2024-09-13T06:42:00.229 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 56.507089624999999, 2024-09-13T06:42:00.229 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.052276712000000003, 2024-09-13T06:42:00.229 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:00.229 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:42:00.229 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:00.229 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:00.229 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:00.229 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 69045 2024-09-13T06:42:00.229 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:00.229 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:00.229 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:00.229 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:00.229 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:03.637760+0000", 2024-09-13T06:42:00.230 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:00.230 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:00.230 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:00.230 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:00.230 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:03.637760+0000", 2024-09-13T06:42:00.230 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:00.230 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:00.230 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:00.230 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:00.230 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:03.637758+0000", 2024-09-13T06:42:00.230 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999981 2024-09-13T06:42:00.230 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:00.230 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:00.231 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:00.231 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:03.637770+0000", 2024-09-13T06:42:00.231 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1533e-05 2024-09-13T06:42:00.231 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:00.231 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:00.231 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:00.231 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:03.637794+0000", 2024-09-13T06:42:00.231 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4243000000000002e-05 2024-09-13T06:42:00.231 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:00.231 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:00.231 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:00.231 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:03.637806+0000", 2024-09-13T06:42:00.231 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2033e-05 2024-09-13T06:42:00.232 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:00.232 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:00.232 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:00.232 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:03.637891+0000", 2024-09-13T06:42:00.232 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.5358000000000005e-05 2024-09-13T06:42:00.232 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:00.232 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:00.232 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:00.232 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:03.638042+0000", 2024-09-13T06:42:00.232 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000151073 2024-09-13T06:42:00.232 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:00.232 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:00.233 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 2", 2024-09-13T06:42:00.233 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:03.647124+0000", 2024-09-13T06:42:00.233 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0090821670000000004 2024-09-13T06:42:00.233 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:00.233 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:00.233 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:42:00.233 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:03.689849+0000", 2024-09-13T06:42:00.233 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.042724445999999999 2024-09-13T06:42:00.233 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:00.233 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:00.233 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-09-13T06:42:00.233 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:03.689871+0000", 2024-09-13T06:42:00.233 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1778999999999999e-05 2024-09-13T06:42:00.233 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:00.234 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:00.234 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:42:00.234 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:03.689965+0000", 2024-09-13T06:42:00.234 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.4312000000000001e-05 2024-09-13T06:42:00.234 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:00.234 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:00.234 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:00.234 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:03.690037+0000", 2024-09-13T06:42:00.234 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.1687999999999995e-05 2024-09-13T06:42:00.234 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:00.234 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:00.234 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:00.234 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:00.235 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:00.235 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:90987 3.6 3:6263dd97:::rbd_object_map.11212443ae03.0000000000000049:head [call] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-13T06:42:00.235 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:41:35.460333+0000", 2024-09-13T06:42:00.235 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 24.684516238, 2024-09-13T06:42:00.235 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0001633640000001, 2024-09-13T06:42:00.235 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:00.235 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:00.235 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:00.235 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:00.235 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:00.235 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 90987 2024-09-13T06:42:00.235 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:00.235 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:00.236 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:00.236 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:00.236 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:35.460333+0000", 2024-09-13T06:42:00.236 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:00.236 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:00.236 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:00.236 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:00.236 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:35.460333+0000", 2024-09-13T06:42:00.236 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:00.236 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:00.236 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:00.236 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:00.236 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:35.460330+0000", 2024-09-13T06:42:00.237 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999971 2024-09-13T06:42:00.237 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:00.237 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:00.237 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:00.237 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:35.460343+0000", 2024-09-13T06:42:00.237 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2695e-05 2024-09-13T06:42:00.237 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:00.237 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:00.237 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:00.237 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:35.460365+0000", 2024-09-13T06:42:00.237 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2473999999999999e-05 2024-09-13T06:42:00.237 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:00.237 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:00.238 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:00.238 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:35.460376+0000", 2024-09-13T06:42:00.238 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0383999999999999e-05 2024-09-13T06:42:00.238 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:00.238 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:00.238 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:00.238 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:35.460435+0000", 2024-09-13T06:42:00.238 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8650000000000003e-05 2024-09-13T06:42:00.238 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:00.238 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:00.238 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:42:00.238 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:35.460444+0000", 2024-09-13T06:42:00.238 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.0380000000000005e-06 2024-09-13T06:42:00.238 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:00.238 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:00.239 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:00.239 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:36.459433+0000", 2024-09-13T06:42:00.239 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.99898895799999998 2024-09-13T06:42:00.239 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:00.239 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:00.239 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:00.239 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:36.459622+0000", 2024-09-13T06:42:00.239 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00018940299999999999 2024-09-13T06:42:00.239 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:00.239 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:00.239 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:00.239 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:36.460497+0000", 2024-09-13T06:42:00.239 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00087481199999999999 2024-09-13T06:42:00.239 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:00.240 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:00.240 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:00.240 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:00.240 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:00.240 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:42:00.240 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-13T06:42:00.242 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-13T06:42:00.242 INFO:teuthology.orchestra.run.smithi081.stdout:4261 punch from 0x130e8c0 to 0x1319fdc, (0xb71c bytes) 2024-09-13T06:42:00.242 INFO:teuthology.orchestra.run.smithi081.stdout:4263 writesame 0xa3daec7 thru 0xa3e91f8 data_size 0xd(0xe332 bytes) 2024-09-13T06:42:00.243 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:42:00.237+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:42:00.244 INFO:teuthology.orchestra.run.smithi081.stdout:4266 writesame 0xc2641f9 thru 0xc271fb4 data_size 0x2e(0xddbc bytes) 2024-09-13T06:42:00.251 INFO:teuthology.orchestra.run.smithi081.stdout:4267 read 0x2c2409c thru 0x2c2890c (0x4871 bytes) 2024-09-13T06:42:00.252 INFO:teuthology.orchestra.run.smithi081.stdout:4268 read 0x69e80ed thru 0x69ea8bb (0x27cf bytes) 2024-09-13T06:42:00.253 INFO:teuthology.orchestra.run.smithi081.stdout:4269 trunc from 0xd079e4b to 0xd0970d1 2024-09-13T06:42:00.264 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:42:00.264 INFO:teuthology.orchestra.run.smithi081.stdout:4271 write 0x5e5abb4 thru 0x5e661d7 (0xb624 bytes) 2024-09-13T06:42:00.269 INFO:teuthology.orchestra.run.smithi081.stdout:4272 read 0x8c7e924 thru 0x8c88a12 (0xa0ef bytes) 2024-09-13T06:42:00.269 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:42:00.269 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:42:00.269 INFO:teuthology.orchestra.run.smithi081.stdout:4275 read 0x7f778b4 thru 0x7f7edd1 (0x751e bytes) 2024-09-13T06:42:00.281 INFO:teuthology.orchestra.run.smithi081.stdout:4276 writesame 0xe1dc480 thru 0xe1dfda4 data_size 0x1(0x3925 bytes) 2024-09-13T06:42:00.281 INFO:teuthology.orchestra.run.smithi081.stdout:4277 read 0x6b4e5c0 thru 0x6b4f869 (0x12aa bytes) 2024-09-13T06:42:00.289 INFO:teuthology.orchestra.run.smithi081.stdout:4281 trunc from 0xe1dfda5 to 0x983b3d5 2024-09-13T06:42:00.320 INFO:teuthology.orchestra.run.smithi081.stdout:4282 trunc from 0x983b3d5 to 0x6671d40 2024-09-13T06:42:00.341 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:42:00.337+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:42:00.345 INFO:teuthology.orchestra.run.smithi081.stdout:4283 read 0x51b55d6 thru 0x51bb164 (0x5b8f bytes) 2024-09-13T06:42:00.346 INFO:teuthology.orchestra.run.smithi081.stdout:4284 read 0x1f50390 thru 0x1f54a78 (0x46e9 bytes) 2024-09-13T06:42:00.367 INFO:teuthology.orchestra.run.smithi081.stdout:4285 write 0xd5c4ec0 thru 0xd5ccc80 (0x7dc1 bytes) 2024-09-13T06:42:00.367 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:42:00.368 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-13T06:42:00.368 INFO:teuthology.orchestra.run.smithi081.stdout: "num_ops": 0 2024-09-13T06:42:00.368 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:42:00.376 INFO:teuthology.orchestra.run.smithi081.stdout:4287 trunc from 0xd5ccc81 to 0xea7adfb 2024-09-13T06:42:00.385 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-13T06:42:00.390 INFO:teuthology.orchestra.run.smithi081.stdout:4289 writesame 0x1a559df thru 0x1a584d2 data_size 0x2(0x2af4 bytes) 2024-09-13T06:42:00.396 INFO:teuthology.orchestra.run.smithi081.stdout:4291 read 0x3bb8fd3 thru 0x3bbe088 (0x50b6 bytes) 2024-09-13T06:42:00.397 INFO:teuthology.orchestra.run.smithi081.stdout:4292 writesame 0xbe85654 thru 0xbe870e6 data_size 0x1(0x1a93 bytes) 2024-09-13T06:42:00.399 INFO:teuthology.orchestra.run.smithi081.stdout:osd.0: {} 2024-09-13T06:42:00.399 INFO:teuthology.orchestra.run.smithi081.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-13T06:42:00.402 INFO:teuthology.orchestra.run.smithi081.stdout:4294 write 0x1720d18 thru 0x173028a (0xf573 bytes) 2024-09-13T06:42:00.419 INFO:teuthology.orchestra.run.smithi081.stdout:osd.1: {} 2024-09-13T06:42:00.419 INFO:teuthology.orchestra.run.smithi081.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-13T06:42:00.421 INFO:teuthology.orchestra.run.smithi081.stdout:4295 trunc from 0xea7adfb to 0x1a74ff1 2024-09-13T06:42:00.443 INFO:tasks.ceph.osd.6.smithi139.stderr:2024-09-13T06:42:00.438+0000 7fcd02c5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26385) UID: 0 2024-09-13T06:42:00.451 INFO:teuthology.orchestra.run.smithi081.stdout:osd.2: {} 2024-09-13T06:42:00.452 INFO:teuthology.orchestra.run.smithi081.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-13T06:42:00.456 INFO:teuthology.orchestra.run.smithi081.stdout:4296 read 0x44bfcf thru 0x45b919 (0xf94b bytes) 2024-09-13T06:42:00.457 INFO:teuthology.orchestra.run.smithi081.stdout:4298 punch from 0xf3a049 to 0xf47347, (0xd2fe bytes) 2024-09-13T06:42:00.478 INFO:teuthology.orchestra.run.smithi081.stdout:4299 writesame 0x8cf8aad thru 0x8cf8e5e data_size 0x2(0x3b2 bytes) 2024-09-13T06:42:00.478 INFO:teuthology.orchestra.run.smithi081.stdout:4300 punch from 0xa1e314 to 0xa270e5, (0x8dd1 bytes) 2024-09-13T06:42:00.481 INFO:teuthology.orchestra.run.smithi081.stdout:osd.3: {} 2024-09-13T06:42:00.482 INFO:teuthology.orchestra.run.smithi081.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-13T06:42:00.490 INFO:teuthology.orchestra.run.smithi081.stdout:4301 writesame 0xa6a7c99 thru 0xa6a861b data_size 0x1(0x983 bytes) 2024-09-13T06:42:00.491 INFO:teuthology.orchestra.run.smithi081.stdout:4302 punch from 0x6e4da6 to 0x6f039f, (0xb5f9 bytes) 2024-09-13T06:42:00.491 INFO:teuthology.orchestra.run.smithi081.stdout:4304 read 0x6f14b16 thru 0x6f15565 (0xa50 bytes) 2024-09-13T06:42:00.498 INFO:teuthology.orchestra.run.smithi081.stdout:4305 trunc from 0xa6a861c to 0x52538a5 2024-09-13T06:42:00.508 INFO:teuthology.orchestra.run.smithi081.stdout:4306 read 0x15547ea thru 0x1556bf2 (0x2409 bytes) 2024-09-13T06:42:00.517 INFO:teuthology.orchestra.run.smithi081.stdout:osd.4: {} 2024-09-13T06:42:00.517 INFO:teuthology.orchestra.run.smithi081.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-13T06:42:00.520 INFO:teuthology.orchestra.run.smithi081.stdout:4307 trunc from 0x52538a5 to 0xcabf884 2024-09-13T06:42:00.532 INFO:teuthology.orchestra.run.smithi081.stdout:4308 trunc from 0xcabf884 to 0xc1f3a46 2024-09-13T06:42:00.538 INFO:teuthology.orchestra.run.smithi081.stdout:osd.5: {} 2024-09-13T06:42:00.538 INFO:teuthology.orchestra.run.smithi081.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-13T06:42:00.540 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:42:00.540 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:42:00.543 INFO:teuthology.orchestra.run.smithi081.stdout:4309 clone 31 order 18 su 2048 sc 8 2024-09-13T06:42:00.543 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:42:00.541+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:42:00.554 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-13T06:42:00.559 INFO:teuthology.orchestra.run.smithi081.stdout:osd.6: {} 2024-09-13T06:42:00.560 INFO:teuthology.orchestra.run.smithi081.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-13T06:42:00.560 INFO:teuthology.orchestra.run.smithi081.stderr:Error ENXIO: problem getting command descriptions from osd.7 2024-09-13T06:42:00.562 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-13T06:42:00.563 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-13T06:42:00.645 INFO:tasks.ceph.osd.6.smithi139.stderr:2024-09-13T06:42:00.642+0000 7fcd02c5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26385) UID: 0 2024-09-13T06:42:00.663 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:42:00.663 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:42:00.675 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-13T06:42:00.745 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:42:00.741+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:42:00.797 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:42:00.797 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:42:00.812 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-13T06:42:00.858 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:42:00.857+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:42:00.948 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:42:00.945+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:42:00.972 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:42:00.972 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:42:00.986 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-13T06:42:01.049 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:42:01.046+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:42:01.141 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:42:01.142 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:42:01.151 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:42:01.150+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:42:01.154 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-13T06:42:01.251 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:42:01.246+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:42:01.283 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:42:01.284 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:42:01.297 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-13T06:42:01.352 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:42:01.349+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:42:01.453 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:42:01.450+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:42:01.463 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:42:01.463 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:42:01.477 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-13T06:42:01.564 INFO:tasks.ceph.osd.6.smithi139.stderr:2024-09-13T06:42:01.562+0000 7fcd02c5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26385) UID: 0 2024-09-13T06:42:01.645 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:42:01.645 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:42:01.655 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:42:01.653+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:42:01.659 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-13T06:42:01.751 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-13T06:42:01.798 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:42:01.797+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:42:01.833 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:42:01.833 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:42:01.848 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-13T06:42:01.892 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:42:01.890+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:42:01.959 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:42:01.954+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:42:02.141 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:42:02.142 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:42:02.142 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-13T06:42:02.145 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:42:02.137+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:42:02.242 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:42:02.238+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:42:02.338 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:42:02.338 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:42:02.343 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:42:02.341+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:42:02.357 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-13T06:42:02.444 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:42:02.441+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:42:02.544 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:42:02.541+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:42:02.550 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:42:02.551 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:42:02.564 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-13T06:42:02.567 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-13T06:42:02.645 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:42:02.641+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:42:02.712 INFO:teuthology.orchestra.run.smithi081.stdout:osd.0: {} 2024-09-13T06:42:02.713 INFO:teuthology.orchestra.run.smithi081.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-13T06:42:02.713 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:42:02.713 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:42:02.728 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-13T06:42:02.735 INFO:teuthology.orchestra.run.smithi081.stdout:osd.1: {} 2024-09-13T06:42:02.735 INFO:teuthology.orchestra.run.smithi081.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-13T06:42:02.746 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:42:02.745+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:42:02.749 INFO:teuthology.orchestra.run.smithi081.stderr:noscrub is set 2024-09-13T06:42:02.759 INFO:teuthology.orchestra.run.smithi081.stdout:osd.2: {} 2024-09-13T06:42:02.760 INFO:teuthology.orchestra.run.smithi081.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-13T06:42:02.781 INFO:teuthology.orchestra.run.smithi081.stdout:osd.3: {} 2024-09-13T06:42:02.781 INFO:teuthology.orchestra.run.smithi081.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-13T06:42:02.805 INFO:teuthology.orchestra.run.smithi081.stdout:osd.4: {} 2024-09-13T06:42:02.805 INFO:teuthology.orchestra.run.smithi081.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-13T06:42:02.826 INFO:teuthology.orchestra.run.smithi081.stdout:osd.5: {} 2024-09-13T06:42:02.827 INFO:teuthology.orchestra.run.smithi081.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-13T06:42:02.844 INFO:teuthology.orchestra.run.smithi081.stdout:osd.6: {} 2024-09-13T06:42:02.844 INFO:teuthology.orchestra.run.smithi081.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-13T06:42:02.844 INFO:teuthology.orchestra.run.smithi081.stderr:Error ENXIO: problem getting command descriptions from osd.7 2024-09-13T06:42:02.847 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:42:02.845+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:42:02.848 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-13T06:42:02.848 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-13T06:42:02.878 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:42:02.879 INFO:teuthology.orchestra.run.smithi139.stdout: "size": 20, 2024-09-13T06:42:02.879 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 600, 2024-09-13T06:42:02.879 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [ 2024-09-13T06:42:02.879 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:02.879 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27854 3.a 3:537b3559:::rbd_data.1121f2c5ee81.0000000000000016:13 [read 335872~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:42:02.879 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.658750+0000", 2024-09-13T06:42:02.879 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 126.21932469799999, 2024-09-13T06:42:02.879 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.037969532, 2024-09-13T06:42:02.879 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:02.879 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:02.879 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:02.879 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:02.879 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:02.880 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27854 2024-09-13T06:42:02.880 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:02.880 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:02.880 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:02.880 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:02.880 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658750+0000", 2024-09-13T06:42:02.880 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:02.880 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:02.880 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:02.880 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:02.881 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658750+0000", 2024-09-13T06:42:02.881 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:02.881 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:02.881 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:02.881 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:02.881 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658749+0000", 2024-09-13T06:42:02.881 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:02.881 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:02.881 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:02.881 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:02.881 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658757+0000", 2024-09-13T06:42:02.881 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.7389999999999999e-06 2024-09-13T06:42:02.881 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:02.882 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:02.882 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:02.882 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658763+0000", 2024-09-13T06:42:02.882 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.7769999999999999e-06 2024-09-13T06:42:02.882 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:02.882 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:02.882 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:02.882 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658767+0000", 2024-09-13T06:42:02.882 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.1749999999999998e-06 2024-09-13T06:42:02.882 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:02.882 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:02.882 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:02.882 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.696322+0000", 2024-09-13T06:42:02.882 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.037554772 2024-09-13T06:42:02.883 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:02.883 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:02.883 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:02.883 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.696418+0000", 2024-09-13T06:42:02.883 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6050000000000004e-05 2024-09-13T06:42:02.883 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:02.883 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:02.883 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:02.883 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.696719+0000", 2024-09-13T06:42:02.883 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00030138499999999999 2024-09-13T06:42:02.883 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:02.884 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:02.884 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:02.884 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:02.884 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:02.884 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27855 3.a 3:537b3559:::rbd_data.1121f2c5ee81.0000000000000016:13 [read 380928~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:42:02.884 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.658771+0000", 2024-09-13T06:42:02.884 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 126.219303454, 2024-09-13T06:42:02.884 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.038326354, 2024-09-13T06:42:02.884 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:02.884 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:02.884 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:02.884 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:02.884 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:02.885 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27855 2024-09-13T06:42:02.885 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:02.885 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:02.885 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:02.885 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:02.885 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658771+0000", 2024-09-13T06:42:02.885 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:02.885 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:02.885 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:02.885 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:02.885 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658771+0000", 2024-09-13T06:42:02.885 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:02.885 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:02.886 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:02.886 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:02.886 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658770+0000", 2024-09-13T06:42:02.886 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:02.886 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:02.886 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:02.886 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:02.886 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658772+0000", 2024-09-13T06:42:02.886 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.0930000000000001e-06 2024-09-13T06:42:02.886 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:02.886 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:02.886 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:02.886 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658778+0000", 2024-09-13T06:42:02.887 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.2730000000000002e-06 2024-09-13T06:42:02.887 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:02.887 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:02.887 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:02.887 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658782+0000", 2024-09-13T06:42:02.887 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0879999999999997e-06 2024-09-13T06:42:02.887 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:02.887 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:02.887 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:02.887 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.696770+0000", 2024-09-13T06:42:02.887 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.037988145000000001 2024-09-13T06:42:02.887 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:02.888 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:02.888 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:02.888 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.696852+0000", 2024-09-13T06:42:02.888 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.2039999999999994e-05 2024-09-13T06:42:02.888 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:02.888 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:02.888 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:02.888 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.697097+0000", 2024-09-13T06:42:02.888 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00024508800000000002 2024-09-13T06:42:02.888 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:02.888 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:02.889 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:02.889 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:02.889 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:02.889 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27856 3.a 3:537b3559:::rbd_data.1121f2c5ee81.0000000000000016:13 [read 405504~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:42:02.889 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.658786+0000", 2024-09-13T06:42:02.889 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 126.219288338, 2024-09-13T06:42:02.889 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.038736029999999998, 2024-09-13T06:42:02.889 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:02.889 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:02.889 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:02.889 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:02.889 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:02.890 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27856 2024-09-13T06:42:02.890 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:02.890 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:02.890 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:02.890 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:02.890 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658786+0000", 2024-09-13T06:42:02.890 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:02.890 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:02.890 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:02.890 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:02.890 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658786+0000", 2024-09-13T06:42:02.890 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:02.890 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:02.891 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:02.891 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:02.891 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658785+0000", 2024-09-13T06:42:02.891 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:02.891 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:02.891 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:02.891 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:02.891 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658787+0000", 2024-09-13T06:42:02.891 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.0040000000000002e-06 2024-09-13T06:42:02.891 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:02.891 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:02.891 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:02.891 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658793+0000", 2024-09-13T06:42:02.892 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.2410000000000003e-06 2024-09-13T06:42:02.892 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:02.892 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:02.892 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:02.892 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658797+0000", 2024-09-13T06:42:02.892 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.1330000000000001e-06 2024-09-13T06:42:02.892 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:02.892 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:02.892 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:02.892 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.697176+0000", 2024-09-13T06:42:02.892 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.038379074999999999 2024-09-13T06:42:02.892 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:02.892 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:02.893 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:02.893 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.697275+0000", 2024-09-13T06:42:02.893 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.8819000000000004e-05 2024-09-13T06:42:02.893 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:02.893 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:02.893 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:02.893 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.697522+0000", 2024-09-13T06:42:02.893 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00024719999999999999 2024-09-13T06:42:02.893 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:02.893 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:02.893 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:02.893 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:02.893 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:02.894 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27857 3.a 3:537b3559:::rbd_data.1121f2c5ee81.0000000000000016:13 [read 475136~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:42:02.894 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.658845+0000", 2024-09-13T06:42:02.894 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 126.21922933499999, 2024-09-13T06:42:02.894 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039112570999999999, 2024-09-13T06:42:02.894 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:02.894 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:02.894 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:02.894 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:02.894 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:02.894 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27857 2024-09-13T06:42:02.894 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:02.894 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:02.894 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:02.895 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:02.895 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658845+0000", 2024-09-13T06:42:02.895 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:02.895 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:02.895 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:02.895 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:02.895 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658845+0000", 2024-09-13T06:42:02.895 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:02.895 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:02.895 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:02.895 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:02.895 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658844+0000", 2024-09-13T06:42:02.895 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999986 2024-09-13T06:42:02.896 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:02.896 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:02.896 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:02.896 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658868+0000", 2024-09-13T06:42:02.896 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.4615000000000001e-05 2024-09-13T06:42:02.896 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:02.896 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:02.896 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:02.896 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658884+0000", 2024-09-13T06:42:02.896 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5401999999999999e-05 2024-09-13T06:42:02.896 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:02.896 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:02.896 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:02.897 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658896+0000", 2024-09-13T06:42:02.897 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2509e-05 2024-09-13T06:42:02.897 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:02.897 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:02.897 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:02.897 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.697571+0000", 2024-09-13T06:42:02.897 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.038675107 2024-09-13T06:42:02.897 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:02.897 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:02.897 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:02.897 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.697658+0000", 2024-09-13T06:42:02.897 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6349999999999998e-05 2024-09-13T06:42:02.897 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:02.898 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:02.898 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:02.898 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.697957+0000", 2024-09-13T06:42:02.898 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00029986100000000001 2024-09-13T06:42:02.898 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:02.898 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:02.898 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:02.898 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:02.898 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:02.898 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27858 3.a 3:537b3559:::rbd_data.1121f2c5ee81.0000000000000016:13 [read 499712~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:42:02.898 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.658905+0000", 2024-09-13T06:42:02.898 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 126.21916878499999, 2024-09-13T06:42:02.898 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039475392999999998, 2024-09-13T06:42:02.898 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:02.899 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:02.899 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:02.899 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:02.899 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:02.899 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27858 2024-09-13T06:42:02.899 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:02.899 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:02.899 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:02.899 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:02.899 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658905+0000", 2024-09-13T06:42:02.899 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:02.899 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:02.899 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:02.899 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:02.900 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658905+0000", 2024-09-13T06:42:02.900 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:02.900 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:02.900 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:02.900 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:02.900 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658905+0000", 2024-09-13T06:42:02.900 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:42:02.900 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:02.900 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:02.900 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:02.900 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658909+0000", 2024-09-13T06:42:02.900 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.831e-06 2024-09-13T06:42:02.900 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:02.900 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:02.901 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:02.901 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658920+0000", 2024-09-13T06:42:02.901 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0936e-05 2024-09-13T06:42:02.901 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:02.901 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:02.901 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:02.901 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658929+0000", 2024-09-13T06:42:02.901 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.2749999999999995e-06 2024-09-13T06:42:02.901 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:02.901 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:02.901 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:02.901 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.697990+0000", 2024-09-13T06:42:02.901 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039061625000000003 2024-09-13T06:42:02.901 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:02.902 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:02.902 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:02.902 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.698077+0000", 2024-09-13T06:42:02.902 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6922000000000006e-05 2024-09-13T06:42:02.902 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:02.902 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:02.902 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:02.902 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.698381+0000", 2024-09-13T06:42:02.902 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00030360599999999999 2024-09-13T06:42:02.902 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:02.902 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:02.902 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:02.902 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:02.903 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:02.903 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27929 3.a 3:537b3559:::rbd_data.1121f2c5ee81.0000000000000016:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:42:02.903 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.659338+0000", 2024-09-13T06:42:02.903 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 126.218735954, 2024-09-13T06:42:02.903 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039351214000000002, 2024-09-13T06:42:02.903 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:02.903 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:02.903 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:02.903 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:02.903 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:02.903 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27929 2024-09-13T06:42:02.903 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:02.904 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:02.904 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:02.904 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:02.904 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.659338+0000", 2024-09-13T06:42:02.904 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:02.904 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:02.904 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:02.904 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:02.904 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.659338+0000", 2024-09-13T06:42:02.904 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:02.904 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:02.904 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:02.904 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:02.905 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.659337+0000", 2024-09-13T06:42:02.905 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:42:02.905 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:02.905 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:02.905 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:02.905 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.659342+0000", 2024-09-13T06:42:02.905 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0799999999999999e-06 2024-09-13T06:42:02.905 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:02.905 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:02.905 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:02.905 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.659353+0000", 2024-09-13T06:42:02.905 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1798e-05 2024-09-13T06:42:02.905 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:02.906 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:02.906 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:02.906 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.659361+0000", 2024-09-13T06:42:02.906 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.8040000000000002e-06 2024-09-13T06:42:02.906 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:02.906 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:02.906 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:02.906 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.698449+0000", 2024-09-13T06:42:02.906 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039087519000000001 2024-09-13T06:42:02.906 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:02.906 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:02.906 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:02.907 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.698567+0000", 2024-09-13T06:42:02.907 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00011857 2024-09-13T06:42:02.907 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:02.907 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:02.907 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:02.907 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.698689+0000", 2024-09-13T06:42:02.907 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00012226699999999999 2024-09-13T06:42:02.907 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:02.907 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:02.907 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:02.907 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:02.907 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:02.907 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27974 3.a 3:537b3559:::rbd_data.1121f2c5ee81.0000000000000016:13 [read 32768~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:42:02.908 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.660102+0000", 2024-09-13T06:42:02.908 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 126.217972186, 2024-09-13T06:42:02.908 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.038972346999999997, 2024-09-13T06:42:02.908 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:02.908 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:02.908 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:02.908 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:02.908 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:02.908 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27974 2024-09-13T06:42:02.908 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:02.908 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:02.908 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:02.908 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:02.909 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660102+0000", 2024-09-13T06:42:02.909 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:02.909 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:02.909 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:02.909 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:02.909 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660102+0000", 2024-09-13T06:42:02.909 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:02.909 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:02.909 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:02.909 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:02.909 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660100+0000", 2024-09-13T06:42:02.909 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999976 2024-09-13T06:42:02.910 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:02.910 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:02.910 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:02.910 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660114+0000", 2024-09-13T06:42:02.910 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.4466e-05 2024-09-13T06:42:02.910 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:02.910 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:02.910 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:02.910 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660148+0000", 2024-09-13T06:42:02.910 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.3742999999999999e-05 2024-09-13T06:42:02.910 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:02.910 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:02.910 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:02.910 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660170+0000", 2024-09-13T06:42:02.910 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.2518e-05 2024-09-13T06:42:02.911 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:02.911 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:02.911 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:02.911 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.698719+0000", 2024-09-13T06:42:02.911 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.038548529999999998 2024-09-13T06:42:02.911 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:02.911 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:02.911 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:02.911 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.698806+0000", 2024-09-13T06:42:02.911 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.7179e-05 2024-09-13T06:42:02.911 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:02.911 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:02.911 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:02.912 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.699074+0000", 2024-09-13T06:42:02.912 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00026834800000000001 2024-09-13T06:42:02.912 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:02.912 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:02.912 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:02.912 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:02.912 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:02.912 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27975 3.a 3:537b3559:::rbd_data.1121f2c5ee81.0000000000000016:13 [read 57344~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:42:02.912 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.660189+0000", 2024-09-13T06:42:02.912 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 126.217885342, 2024-09-13T06:42:02.912 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039288678, 2024-09-13T06:42:02.912 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:02.912 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:02.913 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:02.913 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:02.913 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:02.913 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27975 2024-09-13T06:42:02.913 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:02.913 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:02.913 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:02.913 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:02.913 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660189+0000", 2024-09-13T06:42:02.913 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:02.913 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:02.913 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:02.913 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:02.914 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660189+0000", 2024-09-13T06:42:02.914 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:02.914 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:02.914 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:02.914 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:02.914 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660187+0000", 2024-09-13T06:42:02.914 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999981 2024-09-13T06:42:02.914 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:02.914 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:02.914 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:02.915 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660195+0000", 2024-09-13T06:42:02.915 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5610000000000001e-06 2024-09-13T06:42:02.915 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:02.915 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:02.915 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:02.915 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660212+0000", 2024-09-13T06:42:02.915 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7725999999999999e-05 2024-09-13T06:42:02.915 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:02.915 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:02.915 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:02.915 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660227+0000", 2024-09-13T06:42:02.915 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.43e-05 2024-09-13T06:42:02.916 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:02.916 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:02.916 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:02.916 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.699135+0000", 2024-09-13T06:42:02.916 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.038908336000000002 2024-09-13T06:42:02.916 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:02.916 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:02.916 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:02.916 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.699208+0000", 2024-09-13T06:42:02.916 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.3065000000000006e-05 2024-09-13T06:42:02.916 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:02.916 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:02.916 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:02.916 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.699478+0000", 2024-09-13T06:42:02.917 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00026946899999999999 2024-09-13T06:42:02.917 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:02.917 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:02.917 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:02.917 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:02.917 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:02.917 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27976 3.a 3:537b3559:::rbd_data.1121f2c5ee81.0000000000000016:13 [read 102400~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:42:02.917 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.660238+0000", 2024-09-13T06:42:02.917 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 126.217836179, 2024-09-13T06:42:02.917 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039636515999999997, 2024-09-13T06:42:02.917 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:02.917 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:02.917 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:02.917 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:02.918 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:02.918 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27976 2024-09-13T06:42:02.918 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:02.918 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:02.918 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:02.918 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:02.918 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660238+0000", 2024-09-13T06:42:02.918 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:02.918 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:02.918 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:02.918 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:02.918 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660238+0000", 2024-09-13T06:42:02.918 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:02.919 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:02.919 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:02.919 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:02.919 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660237+0000", 2024-09-13T06:42:02.919 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:42:02.919 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:02.919 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:02.919 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:02.919 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660243+0000", 2024-09-13T06:42:02.919 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.9909999999999999e-06 2024-09-13T06:42:02.919 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:02.919 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:02.919 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:02.919 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660259+0000", 2024-09-13T06:42:02.920 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6294e-05 2024-09-13T06:42:02.920 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:02.920 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:02.920 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:02.920 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660272+0000", 2024-09-13T06:42:02.920 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2714999999999999e-05 2024-09-13T06:42:02.920 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:02.920 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:02.920 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:02.920 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.699513+0000", 2024-09-13T06:42:02.920 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039240932999999999 2024-09-13T06:42:02.920 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:02.920 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:02.921 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:02.921 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.699604+0000", 2024-09-13T06:42:02.921 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.1367999999999997e-05 2024-09-13T06:42:02.921 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:02.921 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:02.921 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:02.921 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.699875+0000", 2024-09-13T06:42:02.921 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00027029499999999999 2024-09-13T06:42:02.921 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:02.921 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:02.921 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:02.921 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:02.922 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:02.922 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27977 3.a 3:537b3559:::rbd_data.1121f2c5ee81.0000000000000016:13 [read 126976~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:42:02.922 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.660284+0000", 2024-09-13T06:42:02.922 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 126.217790607, 2024-09-13T06:42:02.922 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039969945, 2024-09-13T06:42:02.922 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:02.922 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:02.922 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:02.922 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:02.922 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:02.922 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27977 2024-09-13T06:42:02.923 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:02.923 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:02.923 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:02.923 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:02.923 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660284+0000", 2024-09-13T06:42:02.923 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:02.923 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:02.923 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:02.923 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:02.923 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660284+0000", 2024-09-13T06:42:02.923 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:02.923 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:02.923 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:02.923 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:02.924 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660282+0000", 2024-09-13T06:42:02.924 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999986 2024-09-13T06:42:02.924 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:02.924 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:02.924 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:02.924 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660288+0000", 2024-09-13T06:42:02.924 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.2650000000000002e-06 2024-09-13T06:42:02.924 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:02.924 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:02.924 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:02.924 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660304+0000", 2024-09-13T06:42:02.924 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5430999999999998e-05 2024-09-13T06:42:02.924 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:02.924 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:02.925 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:02.925 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660316+0000", 2024-09-13T06:42:02.925 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.237e-05 2024-09-13T06:42:02.925 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:02.925 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:02.925 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:02.925 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.699907+0000", 2024-09-13T06:42:02.925 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039590735000000002 2024-09-13T06:42:02.925 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:02.925 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:02.925 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:02.925 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.699994+0000", 2024-09-13T06:42:02.925 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6996999999999994e-05 2024-09-13T06:42:02.926 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:02.926 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:02.926 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:02.926 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700254+0000", 2024-09-13T06:42:02.926 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000259564 2024-09-13T06:42:02.926 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:02.926 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:02.926 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:02.926 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:02.926 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:02.926 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27978 3.a 3.9aacdeca (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:42:02.926 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.660327+0000", 2024-09-13T06:42:02.926 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 126.21774700899999, 2024-09-13T06:42:02.926 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039984858999999998, 2024-09-13T06:42:02.927 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:02.927 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:42:02.927 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:02.927 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:02.927 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:02.927 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27978 2024-09-13T06:42:02.927 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:02.927 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:02.927 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:02.927 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:02.927 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660327+0000", 2024-09-13T06:42:02.927 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:02.927 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:02.928 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:02.928 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:02.928 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660327+0000", 2024-09-13T06:42:02.928 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:02.928 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:02.928 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:02.928 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:02.928 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660326+0000", 2024-09-13T06:42:02.928 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:42:02.928 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:02.928 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:02.928 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:02.928 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660366+0000", 2024-09-13T06:42:02.929 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.9691000000000003e-05 2024-09-13T06:42:02.929 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:02.929 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:02.929 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:02.929 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660399+0000", 2024-09-13T06:42:02.929 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.3262000000000001e-05 2024-09-13T06:42:02.929 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:02.929 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:02.929 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:02.929 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660414+0000", 2024-09-13T06:42:02.929 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.4775e-05 2024-09-13T06:42:02.929 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:02.929 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:02.930 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:02.930 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700298+0000", 2024-09-13T06:42:02.930 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039883759999999997 2024-09-13T06:42:02.930 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:02.930 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:02.930 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:02.930 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700312+0000", 2024-09-13T06:42:02.930 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.4374e-05 2024-09-13T06:42:02.930 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:02.930 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:02.930 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:02.930 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:02.930 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:02.930 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27979 3.a 3.9aacdeca (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:42:02.931 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.660429+0000", 2024-09-13T06:42:02.931 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 126.21764514100001, 2024-09-13T06:42:02.931 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039921361000000002, 2024-09-13T06:42:02.931 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:02.931 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:42:02.931 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:02.931 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:02.931 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:02.931 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27979 2024-09-13T06:42:02.931 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:02.931 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:02.931 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:02.931 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:02.932 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660429+0000", 2024-09-13T06:42:02.932 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:02.932 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:02.932 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:02.932 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:02.932 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660429+0000", 2024-09-13T06:42:02.932 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:02.932 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:02.932 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:02.932 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:02.932 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660428+0000", 2024-09-13T06:42:02.932 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999986 2024-09-13T06:42:02.932 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:02.933 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:02.933 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:02.933 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660434+0000", 2024-09-13T06:42:02.933 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.8190000000000003e-06 2024-09-13T06:42:02.933 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:02.933 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:02.933 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:02.933 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660451+0000", 2024-09-13T06:42:02.933 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6963e-05 2024-09-13T06:42:02.933 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:02.933 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:02.933 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:02.934 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660485+0000", 2024-09-13T06:42:02.934 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.3414000000000002e-05 2024-09-13T06:42:02.934 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:02.934 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:02.934 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:02.934 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700342+0000", 2024-09-13T06:42:02.934 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039857278000000003 2024-09-13T06:42:02.934 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:02.934 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:02.934 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:02.935 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700350+0000", 2024-09-13T06:42:02.935 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.2930000000000001e-06 2024-09-13T06:42:02.935 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:02.935 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:02.935 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:02.935 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:02.935 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:02.935 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27980 3.a 3.9aacdeca (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:42:02.935 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.660497+0000", 2024-09-13T06:42:02.935 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 126.21757693000001, 2024-09-13T06:42:02.935 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039888034000000003, 2024-09-13T06:42:02.935 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:02.935 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:42:02.935 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:02.936 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:02.936 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:02.936 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27980 2024-09-13T06:42:02.936 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:02.936 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:02.936 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:02.936 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:02.936 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660497+0000", 2024-09-13T06:42:02.936 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:02.936 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:02.936 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:02.936 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:02.937 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660497+0000", 2024-09-13T06:42:02.937 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:02.937 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:02.937 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:02.937 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:02.937 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660496+0000", 2024-09-13T06:42:02.937 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:42:02.937 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:02.937 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:02.937 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:02.937 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660503+0000", 2024-09-13T06:42:02.937 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.4110000000000001e-06 2024-09-13T06:42:02.937 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:02.937 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:02.937 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:02.938 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660519+0000", 2024-09-13T06:42:02.938 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6180000000000001e-05 2024-09-13T06:42:02.938 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:02.938 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:02.938 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:02.938 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660544+0000", 2024-09-13T06:42:02.938 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.5177999999999998e-05 2024-09-13T06:42:02.938 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:02.938 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:02.938 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:02.938 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700377+0000", 2024-09-13T06:42:02.938 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039833434000000001 2024-09-13T06:42:02.938 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:02.939 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:02.939 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:02.939 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700385+0000", 2024-09-13T06:42:02.939 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.8800000000000008e-06 2024-09-13T06:42:02.939 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:02.939 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:02.939 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:02.939 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:02.939 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:02.939 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27981 3.a 3.9aacdeca (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:42:02.939 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.660556+0000", 2024-09-13T06:42:02.939 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 126.217518584, 2024-09-13T06:42:02.940 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039869989000000002, 2024-09-13T06:42:02.940 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:02.940 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:42:02.940 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:02.940 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:02.940 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:02.940 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27981 2024-09-13T06:42:02.940 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:02.940 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:02.940 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:02.940 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:02.940 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660556+0000", 2024-09-13T06:42:02.941 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:02.941 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:02.941 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:02.941 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:02.941 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660556+0000", 2024-09-13T06:42:02.941 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:02.941 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:02.941 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:02.941 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:02.941 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660555+0000", 2024-09-13T06:42:02.941 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:42:02.941 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:02.941 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:02.941 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:02.942 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660561+0000", 2024-09-13T06:42:02.942 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.088e-06 2024-09-13T06:42:02.942 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:02.942 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:02.942 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:02.942 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660577+0000", 2024-09-13T06:42:02.942 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6147999999999999e-05 2024-09-13T06:42:02.942 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:02.942 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:02.942 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:02.943 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660589+0000", 2024-09-13T06:42:02.943 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2551999999999999e-05 2024-09-13T06:42:02.943 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:02.943 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:02.943 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:02.943 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700414+0000", 2024-09-13T06:42:02.943 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039825007000000003 2024-09-13T06:42:02.943 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:02.943 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:02.943 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:02.943 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700426+0000", 2024-09-13T06:42:02.943 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1265e-05 2024-09-13T06:42:02.943 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:02.944 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:02.944 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:02.944 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:02.944 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:02.944 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27982 3.a 3.9aacdeca (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:42:02.944 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.660603+0000", 2024-09-13T06:42:02.944 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 126.21747098900001, 2024-09-13T06:42:02.944 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039874779999999999, 2024-09-13T06:42:02.944 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:02.944 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:42:02.944 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:02.944 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:02.944 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:02.945 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27982 2024-09-13T06:42:02.945 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:02.945 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:02.945 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:02.945 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:02.945 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660603+0000", 2024-09-13T06:42:02.945 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:02.945 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:02.945 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:02.945 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:02.945 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660603+0000", 2024-09-13T06:42:02.945 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:02.945 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:02.946 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:02.946 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:02.946 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660602+0000", 2024-09-13T06:42:02.946 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:42:02.946 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:02.946 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:02.946 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:02.946 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660653+0000", 2024-09-13T06:42:02.946 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.0862000000000002e-05 2024-09-13T06:42:02.946 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:02.946 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:02.946 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:02.946 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660697+0000", 2024-09-13T06:42:02.946 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.3773000000000003e-05 2024-09-13T06:42:02.947 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:02.947 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:02.947 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:02.947 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660712+0000", 2024-09-13T06:42:02.947 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5464999999999998e-05 2024-09-13T06:42:02.947 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:02.947 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:02.947 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:02.947 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700469+0000", 2024-09-13T06:42:02.947 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039756503999999998 2024-09-13T06:42:02.947 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:02.947 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:02.947 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:02.947 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700478+0000", 2024-09-13T06:42:02.948 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.1730000000000001e-06 2024-09-13T06:42:02.948 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:02.948 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:02.948 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:02.948 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:02.948 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:02.948 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27983 3.a 3.9aacdeca (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:42:02.948 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.660726+0000", 2024-09-13T06:42:02.948 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 126.217347714, 2024-09-13T06:42:02.948 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039804357999999998, 2024-09-13T06:42:02.948 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:02.948 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:42:02.948 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:02.949 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:02.949 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:02.949 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27983 2024-09-13T06:42:02.949 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:02.949 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:02.949 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:02.949 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:02.949 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660726+0000", 2024-09-13T06:42:02.949 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:02.949 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:02.949 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:02.949 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:02.949 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660726+0000", 2024-09-13T06:42:02.950 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:02.950 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:02.950 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:02.950 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:02.950 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660725+0000", 2024-09-13T06:42:02.950 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999986 2024-09-13T06:42:02.950 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:02.950 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:02.950 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:02.950 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660733+0000", 2024-09-13T06:42:02.950 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.9359999999999999e-06 2024-09-13T06:42:02.950 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:02.951 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:02.951 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:02.951 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660751+0000", 2024-09-13T06:42:02.951 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7679000000000001e-05 2024-09-13T06:42:02.951 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:02.951 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:02.951 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:02.951 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660764+0000", 2024-09-13T06:42:02.951 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3112000000000001e-05 2024-09-13T06:42:02.951 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:02.951 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:02.951 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:02.952 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700516+0000", 2024-09-13T06:42:02.952 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039752183000000003 2024-09-13T06:42:02.952 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:02.952 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:02.952 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:02.952 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700531+0000", 2024-09-13T06:42:02.952 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.4732999999999999e-05 2024-09-13T06:42:02.952 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:02.952 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:02.952 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:02.952 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:02.952 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:02.953 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27984 3.a 3.9aacdeca (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:42:02.953 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.660776+0000", 2024-09-13T06:42:02.953 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 126.217298611, 2024-09-13T06:42:02.953 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039795697999999997, 2024-09-13T06:42:02.953 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:02.953 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:42:02.953 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:02.953 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:02.953 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:02.953 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27984 2024-09-13T06:42:02.953 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:02.953 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:02.954 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:02.954 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:02.954 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660776+0000", 2024-09-13T06:42:02.954 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:02.954 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:02.954 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:02.954 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:02.954 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660776+0000", 2024-09-13T06:42:02.954 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:02.954 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:02.954 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:02.954 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:02.954 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660775+0000", 2024-09-13T06:42:02.955 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:42:02.955 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:02.955 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:02.955 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:02.955 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660780+0000", 2024-09-13T06:42:02.955 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.7849999999999997e-06 2024-09-13T06:42:02.955 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:02.955 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:02.955 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:02.955 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660799+0000", 2024-09-13T06:42:02.955 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.8794e-05 2024-09-13T06:42:02.955 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:02.956 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:02.956 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:02.956 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660812+0000", 2024-09-13T06:42:02.956 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3029e-05 2024-09-13T06:42:02.956 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:02.956 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:02.956 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:02.956 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700562+0000", 2024-09-13T06:42:02.956 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039749984000000002 2024-09-13T06:42:02.956 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:02.956 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:02.957 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:02.957 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700571+0000", 2024-09-13T06:42:02.957 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.1260000000000004e-06 2024-09-13T06:42:02.957 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:02.957 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:02.957 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:02.957 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:02.957 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:02.957 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27985 3.a 3.9aacdeca (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:42:02.957 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.660824+0000", 2024-09-13T06:42:02.957 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 126.21725055900001, 2024-09-13T06:42:02.957 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039784462, 2024-09-13T06:42:02.958 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:02.958 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:42:02.958 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:02.958 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:02.958 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:02.958 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27985 2024-09-13T06:42:02.958 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:02.958 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:02.958 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:02.958 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:02.958 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660824+0000", 2024-09-13T06:42:02.958 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:02.958 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:02.958 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:02.959 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:02.959 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660824+0000", 2024-09-13T06:42:02.959 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:02.959 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:02.959 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:02.959 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:02.959 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660823+0000", 2024-09-13T06:42:02.959 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:42:02.959 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:02.959 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:02.959 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:02.959 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660829+0000", 2024-09-13T06:42:02.959 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.9440000000000002e-06 2024-09-13T06:42:02.959 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:02.960 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:02.960 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:02.960 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660922+0000", 2024-09-13T06:42:02.960 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.2958e-05 2024-09-13T06:42:02.960 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:02.960 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:02.960 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:02.960 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660964+0000", 2024-09-13T06:42:02.960 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.2407000000000002e-05 2024-09-13T06:42:02.960 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:02.960 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:02.960 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:02.960 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700600+0000", 2024-09-13T06:42:02.961 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039635581000000003 2024-09-13T06:42:02.961 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:02.961 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:02.961 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:02.961 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700608+0000", 2024-09-13T06:42:02.961 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.5890000000000003e-06 2024-09-13T06:42:02.961 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:02.961 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:02.961 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:02.961 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:02.961 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:02.961 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:28023 3.10 3:0dedc28a:::rbd_data.1121f2c5ee81.0000000000000019:13 [read 475136~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:42:02.961 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.662072+0000", 2024-09-13T06:42:02.961 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 126.216002574, 2024-09-13T06:42:02.962 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.038086508999999998, 2024-09-13T06:42:02.962 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:02.962 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:02.962 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:02.962 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:02.962 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:02.962 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 28023 2024-09-13T06:42:02.962 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:02.962 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:02.962 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:02.962 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:02.962 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.662072+0000", 2024-09-13T06:42:02.963 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:02.963 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:02.963 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:02.963 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:02.963 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.662072+0000", 2024-09-13T06:42:02.963 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:02.963 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:02.963 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:02.963 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:02.963 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.662070+0000", 2024-09-13T06:42:02.963 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999986 2024-09-13T06:42:02.963 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:02.964 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:02.964 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:02.964 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.662076+0000", 2024-09-13T06:42:02.964 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.139e-06 2024-09-13T06:42:02.964 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:02.964 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:02.964 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:02.964 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.662094+0000", 2024-09-13T06:42:02.964 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7136999999999999e-05 2024-09-13T06:42:02.964 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:02.964 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:02.964 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:02.964 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.662124+0000", 2024-09-13T06:42:02.965 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.0528999999999999e-05 2024-09-13T06:42:02.965 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:02.965 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:02.965 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:02.965 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.699843+0000", 2024-09-13T06:42:02.965 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.037718415999999998 2024-09-13T06:42:02.965 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:02.965 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:02.965 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:02.965 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.699931+0000", 2024-09-13T06:42:02.965 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.8345999999999997e-05 2024-09-13T06:42:02.965 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:02.966 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:02.966 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:02.966 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700158+0000", 2024-09-13T06:42:02.966 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00022723099999999999 2024-09-13T06:42:02.966 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:02.966 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:02.966 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:02.966 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:02.966 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:02.966 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:28024 3.10 3.5143b7b0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:42:02.966 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.662137+0000", 2024-09-13T06:42:02.966 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 126.215937052, 2024-09-13T06:42:02.966 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.038056092999999999, 2024-09-13T06:42:02.966 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:02.966 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:42:02.967 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:02.967 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:02.967 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:02.967 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 28024 2024-09-13T06:42:02.967 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:02.967 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:02.967 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:02.967 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:02.967 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.662137+0000", 2024-09-13T06:42:02.967 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:02.967 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:02.967 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:02.967 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:02.968 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.662137+0000", 2024-09-13T06:42:02.968 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:02.968 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:02.968 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:02.968 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:02.968 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.662136+0000", 2024-09-13T06:42:02.968 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999986 2024-09-13T06:42:02.968 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:02.968 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:02.968 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:02.968 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.662142+0000", 2024-09-13T06:42:02.969 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.6930000000000001e-06 2024-09-13T06:42:02.969 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:02.969 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:02.969 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:02.969 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.662160+0000", 2024-09-13T06:42:02.969 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7863000000000002e-05 2024-09-13T06:42:02.969 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:02.969 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:02.969 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:02.969 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.662189+0000", 2024-09-13T06:42:02.969 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.8486000000000001e-05 2024-09-13T06:42:02.969 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:02.969 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:02.969 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:02.970 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700187+0000", 2024-09-13T06:42:02.970 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.037998331000000003 2024-09-13T06:42:02.970 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:02.970 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:02.970 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:02.970 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700193+0000", 2024-09-13T06:42:02.970 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.0909999999999998e-06 2024-09-13T06:42:02.970 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:02.970 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:02.970 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:02.970 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:02.970 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:02.971 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:42:02.972 INFO:tasks.ceph.osd.6.smithi139.stderr:2024-09-13T06:42:02.966+0000 7fcd02c5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26385) UID: 0 2024-09-13T06:42:02.972 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-13T06:42:03.073 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:42:03.070+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:42:03.088 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:42:03.088 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-13T06:42:03.089 INFO:teuthology.orchestra.run.smithi081.stdout: "num_ops": 0 2024-09-13T06:42:03.089 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:42:03.102 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-13T06:42:03.174 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:42:03.170+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:42:03.215 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:42:03.215 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-13T06:42:03.215 INFO:teuthology.orchestra.run.smithi081.stdout: "complaint_time": 30, 2024-09-13T06:42:03.215 INFO:teuthology.orchestra.run.smithi081.stdout: "num_blocked_ops": 0 2024-09-13T06:42:03.215 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:42:03.228 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-13T06:42:03.275 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:42:03.270+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:42:03.337 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:42:03.337 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 20, 2024-09-13T06:42:03.337 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 600, 2024-09-13T06:42:03.337 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [ 2024-09-13T06:42:03.337 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.338 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:37801 3.1 3:82e31015:::rbd_object_map.1121d8143c6e.0000000000000019:head [call] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e55)", 2024-09-13T06:42:03.338 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:05.646191+0000", 2024-09-13T06:42:03.338 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 117.690175389, 2024-09-13T06:42:03.338 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.72659507800000001, 2024-09-13T06:42:03.338 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:03.338 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:03.338 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:03.338 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:03.338 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:03.338 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 37801 2024-09-13T06:42:03.338 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.338 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:03.339 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.339 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:03.339 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:05.646191+0000", 2024-09-13T06:42:03.339 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:03.339 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.339 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.339 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:03.339 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:05.646191+0000", 2024-09-13T06:42:03.339 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:03.339 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.339 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.339 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:03.339 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:05.646188+0000", 2024-09-13T06:42:03.340 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999971 2024-09-13T06:42:03.340 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.340 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.340 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:03.340 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:05.646206+0000", 2024-09-13T06:42:03.340 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8182999999999999e-05 2024-09-13T06:42:03.340 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.340 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.340 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:03.340 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:05.646237+0000", 2024-09-13T06:42:03.340 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.1071000000000001e-05 2024-09-13T06:42:03.340 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.340 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.341 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:03.341 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:05.646251+0000", 2024-09-13T06:42:03.341 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3679000000000001e-05 2024-09-13T06:42:03.341 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.341 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.341 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:03.341 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:05.646321+0000", 2024-09-13T06:42:03.341 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.9831000000000003e-05 2024-09-13T06:42:03.341 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.341 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.341 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:42:03.341 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:05.646331+0000", 2024-09-13T06:42:03.341 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0242e-05 2024-09-13T06:42:03.341 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.342 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.342 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:03.342 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.371959+0000", 2024-09-13T06:42:03.342 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.72562817199999996 2024-09-13T06:42:03.342 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.342 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.342 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:03.342 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.372389+0000", 2024-09-13T06:42:03.342 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00042977400000000001 2024-09-13T06:42:03.342 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.342 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.342 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:03.342 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.372786+0000", 2024-09-13T06:42:03.343 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00039706099999999999 2024-09-13T06:42:03.343 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:03.343 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:03.343 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:03.343 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.343 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.343 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43009 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 489472~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:42:03.343 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.644660+0000", 2024-09-13T06:42:03.343 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 101.691706427, 2024-09-13T06:42:03.343 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123376071, 2024-09-13T06:42:03.343 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:03.343 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:03.343 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:03.343 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:03.344 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:03.344 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43009 2024-09-13T06:42:03.344 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.344 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:03.344 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.344 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:03.344 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.644660+0000", 2024-09-13T06:42:03.344 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:03.344 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.344 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.344 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:03.344 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.644660+0000", 2024-09-13T06:42:03.344 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:03.345 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.345 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.345 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:03.345 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.644659+0000", 2024-09-13T06:42:03.345 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:03.345 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.345 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.345 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:03.345 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.644662+0000", 2024-09-13T06:42:03.345 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4949999999999998e-06 2024-09-13T06:42:03.345 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.345 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.345 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:03.346 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.644669+0000", 2024-09-13T06:42:03.346 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.289e-06 2024-09-13T06:42:03.346 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.346 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.346 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:03.346 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.644674+0000", 2024-09-13T06:42:03.346 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.8840000000000002e-06 2024-09-13T06:42:03.346 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.346 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.346 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:03.346 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.767602+0000", 2024-09-13T06:42:03.346 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.122928158 2024-09-13T06:42:03.346 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.347 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.347 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:03.347 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.767676+0000", 2024-09-13T06:42:03.347 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3992999999999994e-05 2024-09-13T06:42:03.347 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.347 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.347 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:03.347 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.768036+0000", 2024-09-13T06:42:03.347 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00035966200000000001 2024-09-13T06:42:03.347 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:03.347 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:03.347 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:03.348 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.348 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.348 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43010 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 503808~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:42:03.348 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.644678+0000", 2024-09-13T06:42:03.348 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 101.691688101, 2024-09-13T06:42:03.348 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123728798, 2024-09-13T06:42:03.348 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:03.348 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:03.348 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:03.348 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:03.348 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:03.348 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43010 2024-09-13T06:42:03.349 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.349 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:03.349 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.349 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:03.349 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.644678+0000", 2024-09-13T06:42:03.349 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:03.349 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.349 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.349 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:03.349 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.644678+0000", 2024-09-13T06:42:03.349 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:03.349 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.349 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.350 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:03.350 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.644678+0000", 2024-09-13T06:42:03.350 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:03.350 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.350 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.350 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:03.350 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.644680+0000", 2024-09-13T06:42:03.350 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2050000000000001e-06 2024-09-13T06:42:03.350 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.350 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.350 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:03.350 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.644686+0000", 2024-09-13T06:42:03.350 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8440000000000003e-06 2024-09-13T06:42:03.350 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.351 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.351 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:03.351 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.644691+0000", 2024-09-13T06:42:03.351 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.118e-06 2024-09-13T06:42:03.351 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.351 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.351 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:03.351 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.768065+0000", 2024-09-13T06:42:03.351 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123374698 2024-09-13T06:42:03.351 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.351 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.351 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:03.351 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.768139+0000", 2024-09-13T06:42:03.352 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3934000000000001e-05 2024-09-13T06:42:03.352 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.352 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.352 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:03.352 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.768407+0000", 2024-09-13T06:42:03.352 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00026738800000000002 2024-09-13T06:42:03.352 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:03.352 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:03.352 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:03.352 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.352 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.352 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43181 3.17 3:ec5ebce4:::rbd_data.1121f5f2e1c0.0000000000000001:1f [read 319488~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:42:03.353 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.652968+0000", 2024-09-13T06:42:03.353 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 101.68339758499999, 2024-09-13T06:42:03.353 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.12363807, 2024-09-13T06:42:03.353 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:03.353 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:03.353 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:03.353 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:03.353 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:03.353 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43181 2024-09-13T06:42:03.353 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.353 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:03.353 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.354 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:03.354 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.652968+0000", 2024-09-13T06:42:03.354 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:03.354 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.354 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.354 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:03.354 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.652968+0000", 2024-09-13T06:42:03.354 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:03.354 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.354 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.354 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:03.354 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.652968+0000", 2024-09-13T06:42:03.354 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:03.354 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.355 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.355 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:03.355 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.652970+0000", 2024-09-13T06:42:03.355 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2409999999999998e-06 2024-09-13T06:42:03.355 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.355 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.355 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:03.355 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.652976+0000", 2024-09-13T06:42:03.355 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0079999999999999e-06 2024-09-13T06:42:03.355 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.355 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.355 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:03.356 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.652981+0000", 2024-09-13T06:42:03.356 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4390000000000002e-06 2024-09-13T06:42:03.356 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.356 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.356 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:03.356 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.776275+0000", 2024-09-13T06:42:03.356 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.12329396099999999 2024-09-13T06:42:03.356 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.356 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.356 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:03.356 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.776316+0000", 2024-09-13T06:42:03.356 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.1244e-05 2024-09-13T06:42:03.356 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.357 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.357 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:03.357 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.776607+0000", 2024-09-13T06:42:03.357 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00029051199999999999 2024-09-13T06:42:03.357 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:03.357 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:03.357 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:03.357 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.357 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.357 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43182 3.17 3:ec5ebce4:::rbd_data.1121f5f2e1c0.0000000000000001:1f [read 333824~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:42:03.357 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.652985+0000", 2024-09-13T06:42:03.357 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 101.68338077600001, 2024-09-13T06:42:03.357 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123926616, 2024-09-13T06:42:03.358 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:03.358 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:03.358 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:03.358 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:03.358 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:03.358 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43182 2024-09-13T06:42:03.358 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.358 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:03.358 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.358 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:03.358 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.652985+0000", 2024-09-13T06:42:03.358 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:03.358 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.359 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.359 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:03.359 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.652985+0000", 2024-09-13T06:42:03.359 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:03.359 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.359 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.359 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:03.359 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.652985+0000", 2024-09-13T06:42:03.359 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:03.359 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.359 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.359 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:03.360 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.652987+0000", 2024-09-13T06:42:03.360 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0899999999999999e-06 2024-09-13T06:42:03.360 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.360 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.360 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:03.360 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.652994+0000", 2024-09-13T06:42:03.360 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3100000000000003e-06 2024-09-13T06:42:03.360 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.360 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.360 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:03.360 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.653000+0000", 2024-09-13T06:42:03.360 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2020000000000003e-06 2024-09-13T06:42:03.360 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.361 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.361 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:03.361 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.776635+0000", 2024-09-13T06:42:03.361 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.12363529400000001 2024-09-13T06:42:03.361 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.361 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.361 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:03.361 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.776676+0000", 2024-09-13T06:42:03.361 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.0745999999999999e-05 2024-09-13T06:42:03.361 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.361 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.361 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:03.361 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.776912+0000", 2024-09-13T06:42:03.361 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00023631300000000001 2024-09-13T06:42:03.362 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:03.362 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:03.362 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:03.362 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.362 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.362 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43192 3.17 3:ec5ebce4:::rbd_data.1121f5f2e1c0.0000000000000001:1f [read 466944~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:42:03.362 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.656622+0000", 2024-09-13T06:42:03.362 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 101.67974372, 2024-09-13T06:42:03.362 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123503136, 2024-09-13T06:42:03.362 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:03.362 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:03.362 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:03.362 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:03.363 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:03.363 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43192 2024-09-13T06:42:03.363 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.363 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:03.363 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.363 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:03.363 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656622+0000", 2024-09-13T06:42:03.363 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:03.363 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.363 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.363 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:03.363 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656622+0000", 2024-09-13T06:42:03.363 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:03.363 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.364 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.364 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:03.364 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656622+0000", 2024-09-13T06:42:03.364 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:42:03.364 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.364 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.364 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:03.364 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656623+0000", 2024-09-13T06:42:03.364 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2079999999999999e-06 2024-09-13T06:42:03.364 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.364 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.364 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:03.364 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656627+0000", 2024-09-13T06:42:03.364 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.4819999999999999e-06 2024-09-13T06:42:03.365 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.365 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.365 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:03.365 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656629+0000", 2024-09-13T06:42:03.365 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.582e-06 2024-09-13T06:42:03.365 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.365 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.365 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:03.365 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.779866+0000", 2024-09-13T06:42:03.365 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.12323638100000001 2024-09-13T06:42:03.365 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.365 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.365 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:03.365 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.779905+0000", 2024-09-13T06:42:03.366 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.9529e-05 2024-09-13T06:42:03.366 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.366 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.366 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:03.366 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.780125+0000", 2024-09-13T06:42:03.366 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000220168 2024-09-13T06:42:03.366 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:03.366 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:03.366 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:03.366 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.366 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.366 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43193 3.17 3:ec5ebce4:::rbd_data.1121f5f2e1c0.0000000000000001:1f [read 481280~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:42:03.366 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.656635+0000", 2024-09-13T06:42:03.367 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 101.67973123599999, 2024-09-13T06:42:03.367 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.12374478999999999, 2024-09-13T06:42:03.367 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:03.367 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:03.367 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:03.367 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:03.367 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:03.367 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43193 2024-09-13T06:42:03.367 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.367 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:03.367 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.367 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:03.367 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656635+0000", 2024-09-13T06:42:03.367 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:03.367 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.368 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.368 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:03.368 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656635+0000", 2024-09-13T06:42:03.368 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:03.368 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.368 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.368 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:03.368 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656635+0000", 2024-09-13T06:42:03.368 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:42:03.368 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.368 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.368 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:03.368 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656636+0000", 2024-09-13T06:42:03.368 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.544e-06 2024-09-13T06:42:03.369 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.369 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.369 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:03.369 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656639+0000", 2024-09-13T06:42:03.369 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.0879999999999999e-06 2024-09-13T06:42:03.369 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.369 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.369 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:03.369 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656642+0000", 2024-09-13T06:42:03.369 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5799999999999999e-06 2024-09-13T06:42:03.369 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.369 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.369 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:03.369 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.780151+0000", 2024-09-13T06:42:03.369 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123509035 2024-09-13T06:42:03.370 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.370 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.370 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:03.370 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.780191+0000", 2024-09-13T06:42:03.370 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.9758000000000001e-05 2024-09-13T06:42:03.370 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.370 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.370 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:03.370 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.780380+0000", 2024-09-13T06:42:03.370 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000189023 2024-09-13T06:42:03.370 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:03.370 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:03.370 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:03.370 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.371 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.371 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43194 3.17 3:ec5ebce4:::rbd_data.1121f5f2e1c0.0000000000000001:1f [read 495616~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:42:03.371 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.656645+0000", 2024-09-13T06:42:03.371 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 101.67972058300001, 2024-09-13T06:42:03.371 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.124088483, 2024-09-13T06:42:03.371 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:03.371 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:03.371 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:03.371 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:03.371 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:03.371 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43194 2024-09-13T06:42:03.371 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.371 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:03.371 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.371 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:03.372 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656645+0000", 2024-09-13T06:42:03.372 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:03.372 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.372 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.372 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:03.372 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656645+0000", 2024-09-13T06:42:03.372 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:03.372 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.372 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.372 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:03.372 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656645+0000", 2024-09-13T06:42:03.372 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:03.372 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.373 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.373 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:03.373 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656647+0000", 2024-09-13T06:42:03.373 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9180000000000001e-06 2024-09-13T06:42:03.373 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.373 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.373 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:03.373 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656653+0000", 2024-09-13T06:42:03.373 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7860000000000002e-06 2024-09-13T06:42:03.373 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.373 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.373 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:03.373 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656658+0000", 2024-09-13T06:42:03.373 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6949999999999999e-06 2024-09-13T06:42:03.374 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.374 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.374 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:03.374 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.780406+0000", 2024-09-13T06:42:03.374 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123748657 2024-09-13T06:42:03.374 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.374 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.374 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:03.374 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.780446+0000", 2024-09-13T06:42:03.374 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.9360999999999998e-05 2024-09-13T06:42:03.374 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.374 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.374 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:03.374 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.780734+0000", 2024-09-13T06:42:03.375 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00028838399999999998 2024-09-13T06:42:03.375 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:03.375 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:03.375 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:03.375 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.375 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.375 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43240 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 106496~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:42:03.375 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.660672+0000", 2024-09-13T06:42:03.375 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 101.67569422, 2024-09-13T06:42:03.375 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123612707, 2024-09-13T06:42:03.375 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:03.375 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:03.375 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:03.375 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:03.375 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:03.376 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43240 2024-09-13T06:42:03.376 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.376 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:03.376 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.376 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:03.376 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660672+0000", 2024-09-13T06:42:03.376 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:03.376 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.376 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.376 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:03.376 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660672+0000", 2024-09-13T06:42:03.376 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:03.376 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.377 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.377 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:03.377 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660671+0000", 2024-09-13T06:42:03.377 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:03.377 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.377 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.377 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:03.377 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660673+0000", 2024-09-13T06:42:03.377 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.652e-06 2024-09-13T06:42:03.377 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.377 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.377 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:03.377 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660677+0000", 2024-09-13T06:42:03.377 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.2509999999999996e-06 2024-09-13T06:42:03.377 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.378 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.378 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:03.378 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660680+0000", 2024-09-13T06:42:03.378 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.8150000000000002e-06 2024-09-13T06:42:03.378 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.378 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.378 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:03.378 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.783596+0000", 2024-09-13T06:42:03.378 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.122915841 2024-09-13T06:42:03.378 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.378 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.378 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:03.378 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.783682+0000", 2024-09-13T06:42:03.378 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.5822999999999995e-05 2024-09-13T06:42:03.379 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.379 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.379 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:03.379 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.784285+0000", 2024-09-13T06:42:03.379 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00060276500000000001 2024-09-13T06:42:03.379 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:03.379 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:03.379 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:03.379 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.379 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.379 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43241 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 120832~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:42:03.379 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.660682+0000", 2024-09-13T06:42:03.379 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 101.67568364500001, 2024-09-13T06:42:03.380 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123958204, 2024-09-13T06:42:03.380 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:03.380 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:03.380 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:03.380 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:03.380 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:03.380 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43241 2024-09-13T06:42:03.380 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.380 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:03.380 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.380 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:03.380 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660682+0000", 2024-09-13T06:42:03.381 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:03.381 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.381 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.381 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:03.381 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660682+0000", 2024-09-13T06:42:03.381 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:03.381 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.381 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.381 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:03.381 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660682+0000", 2024-09-13T06:42:03.381 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:03.381 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.381 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.381 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:03.382 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660683+0000", 2024-09-13T06:42:03.382 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.308e-06 2024-09-13T06:42:03.382 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.382 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.382 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:03.382 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660686+0000", 2024-09-13T06:42:03.382 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.977e-06 2024-09-13T06:42:03.382 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.382 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.382 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:03.382 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660689+0000", 2024-09-13T06:42:03.382 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5830000000000001e-06 2024-09-13T06:42:03.382 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.382 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.383 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:03.383 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.784366+0000", 2024-09-13T06:42:03.383 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.12367713599999999 2024-09-13T06:42:03.383 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.383 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.383 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:03.383 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.784451+0000", 2024-09-13T06:42:03.383 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.4629999999999994e-05 2024-09-13T06:42:03.383 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.383 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.383 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:03.383 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.784641+0000", 2024-09-13T06:42:03.383 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00018984899999999999 2024-09-13T06:42:03.384 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:03.384 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:03.384 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:03.384 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.384 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.384 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43242 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 139264~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:42:03.384 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.660691+0000", 2024-09-13T06:42:03.384 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 101.675674667, 2024-09-13T06:42:03.384 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.124536443, 2024-09-13T06:42:03.384 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:03.384 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:03.384 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:03.384 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:03.385 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:03.385 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43242 2024-09-13T06:42:03.385 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.385 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:03.385 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.385 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:03.385 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660691+0000", 2024-09-13T06:42:03.385 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:03.385 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.385 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.385 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:03.385 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660691+0000", 2024-09-13T06:42:03.385 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:03.385 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.386 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.386 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:03.386 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660691+0000", 2024-09-13T06:42:03.386 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:42:03.386 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.386 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.386 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:03.386 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660696+0000", 2024-09-13T06:42:03.386 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0560000000000004e-06 2024-09-13T06:42:03.386 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.386 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.386 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:03.386 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660699+0000", 2024-09-13T06:42:03.387 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.2009999999999999e-06 2024-09-13T06:42:03.387 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.387 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.387 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:03.387 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660702+0000", 2024-09-13T06:42:03.387 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.633e-06 2024-09-13T06:42:03.387 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.387 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.387 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:03.387 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.784912+0000", 2024-09-13T06:42:03.387 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.124209497 2024-09-13T06:42:03.387 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.387 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.387 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:03.388 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.784995+0000", 2024-09-13T06:42:03.388 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.3891e-05 2024-09-13T06:42:03.388 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.388 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.388 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:03.388 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.785228+0000", 2024-09-13T06:42:03.388 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00023237400000000001 2024-09-13T06:42:03.388 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:03.388 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:03.388 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:03.388 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.388 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.389 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43243 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 153600~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:42:03.389 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.660705+0000", 2024-09-13T06:42:03.389 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 101.675661334, 2024-09-13T06:42:03.389 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.124825835, 2024-09-13T06:42:03.389 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:03.389 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:03.389 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:03.389 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:03.389 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:03.389 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43243 2024-09-13T06:42:03.389 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.389 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:03.389 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.390 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:03.390 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660705+0000", 2024-09-13T06:42:03.390 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:03.390 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.390 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.390 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:03.390 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660705+0000", 2024-09-13T06:42:03.390 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:03.390 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.390 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.390 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:03.390 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660705+0000", 2024-09-13T06:42:03.390 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:42:03.390 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.391 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.391 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:03.391 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660706+0000", 2024-09-13T06:42:03.391 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4339999999999999e-06 2024-09-13T06:42:03.391 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.391 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.391 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:03.391 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660709+0000", 2024-09-13T06:42:03.391 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9000000000000002e-06 2024-09-13T06:42:03.391 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.391 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.391 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:03.391 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660712+0000", 2024-09-13T06:42:03.392 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.0589999999999998e-06 2024-09-13T06:42:03.392 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.392 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.392 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:03.392 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.785318+0000", 2024-09-13T06:42:03.392 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.124606299 2024-09-13T06:42:03.392 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.392 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.392 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:03.392 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.785361+0000", 2024-09-13T06:42:03.392 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.3214999999999999e-05 2024-09-13T06:42:03.392 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.392 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.393 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:03.393 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.785531+0000", 2024-09-13T06:42:03.393 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00016914400000000001 2024-09-13T06:42:03.393 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:03.393 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:03.393 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:03.393 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.393 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.393 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43244 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 167936~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:42:03.393 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.660714+0000", 2024-09-13T06:42:03.393 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 101.675651921, 2024-09-13T06:42:03.393 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.125073248, 2024-09-13T06:42:03.393 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:03.394 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:03.394 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:03.394 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:03.394 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:03.394 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43244 2024-09-13T06:42:03.394 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.394 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:03.394 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.394 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:03.394 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660714+0000", 2024-09-13T06:42:03.394 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:03.394 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.394 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.395 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:03.395 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660714+0000", 2024-09-13T06:42:03.395 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:03.395 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.395 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.395 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:03.395 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660714+0000", 2024-09-13T06:42:03.395 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:42:03.395 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.395 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.395 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:03.395 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660715+0000", 2024-09-13T06:42:03.396 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2330000000000001e-06 2024-09-13T06:42:03.396 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.396 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.396 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:03.396 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660718+0000", 2024-09-13T06:42:03.396 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9569999999999998e-06 2024-09-13T06:42:03.396 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.396 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.396 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:03.396 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660721+0000", 2024-09-13T06:42:03.396 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.678e-06 2024-09-13T06:42:03.396 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.396 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.397 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:03.397 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.785557+0000", 2024-09-13T06:42:03.397 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.12483633199999999 2024-09-13T06:42:03.397 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.397 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.397 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:03.397 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.785618+0000", 2024-09-13T06:42:03.397 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0686000000000001e-05 2024-09-13T06:42:03.397 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.397 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.397 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:03.397 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.785787+0000", 2024-09-13T06:42:03.397 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00016957699999999999 2024-09-13T06:42:03.398 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:03.398 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:03.398 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:03.398 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.398 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.398 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43254 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 315392~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:42:03.398 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.664717+0000", 2024-09-13T06:42:03.398 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 101.67164935300001, 2024-09-13T06:42:03.398 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.12357108, 2024-09-13T06:42:03.398 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:03.398 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:03.398 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:03.399 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:03.399 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:03.399 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43254 2024-09-13T06:42:03.399 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.399 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:03.399 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.399 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:03.399 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664717+0000", 2024-09-13T06:42:03.399 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:03.399 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.399 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.399 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:03.399 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664717+0000", 2024-09-13T06:42:03.400 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:03.400 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.400 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.400 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:03.400 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664716+0000", 2024-09-13T06:42:03.400 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:03.400 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.400 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.400 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:03.400 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664724+0000", 2024-09-13T06:42:03.400 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.7109999999999995e-06 2024-09-13T06:42:03.400 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.400 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.400 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:03.401 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664732+0000", 2024-09-13T06:42:03.401 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.8399999999999995e-06 2024-09-13T06:42:03.401 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.401 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.401 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:03.401 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664738+0000", 2024-09-13T06:42:03.401 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.879e-06 2024-09-13T06:42:03.401 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.401 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.401 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:03.401 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.788018+0000", 2024-09-13T06:42:03.401 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123280719 2024-09-13T06:42:03.401 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.402 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.402 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:03.402 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.788119+0000", 2024-09-13T06:42:03.402 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000100558 2024-09-13T06:42:03.402 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.402 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.402 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:03.402 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.788288+0000", 2024-09-13T06:42:03.402 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000168751 2024-09-13T06:42:03.402 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:03.402 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:03.402 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:03.402 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.403 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.403 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43255 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 329728~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:42:03.403 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.664743+0000", 2024-09-13T06:42:03.403 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 101.671623357, 2024-09-13T06:42:03.403 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.12381711500000001, 2024-09-13T06:42:03.403 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:03.403 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:03.403 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:03.403 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:03.403 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:03.403 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43255 2024-09-13T06:42:03.403 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.403 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:03.403 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.404 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:03.404 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664743+0000", 2024-09-13T06:42:03.404 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:03.404 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.404 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.404 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:03.404 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664743+0000", 2024-09-13T06:42:03.404 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:03.404 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.404 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.404 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:03.404 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664742+0000", 2024-09-13T06:42:03.404 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:03.404 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.405 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.405 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:03.405 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664745+0000", 2024-09-13T06:42:03.405 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.7269999999999999e-06 2024-09-13T06:42:03.405 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.405 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.405 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:03.405 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664753+0000", 2024-09-13T06:42:03.405 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.8709999999999997e-06 2024-09-13T06:42:03.405 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.405 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.405 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:03.405 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664758+0000", 2024-09-13T06:42:03.405 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2220000000000001e-06 2024-09-13T06:42:03.406 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.406 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.406 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:03.406 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.788314+0000", 2024-09-13T06:42:03.406 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123555545 2024-09-13T06:42:03.406 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.406 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.406 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:03.406 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.788368+0000", 2024-09-13T06:42:03.406 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3928999999999998e-05 2024-09-13T06:42:03.406 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.406 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.407 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:03.407 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.788560+0000", 2024-09-13T06:42:03.407 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000192237 2024-09-13T06:42:03.407 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:03.407 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:03.407 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:03.407 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.407 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.407 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43256 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 344064~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:42:03.407 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.664763+0000", 2024-09-13T06:42:03.407 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 101.67160341100001, 2024-09-13T06:42:03.407 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.12418359399999999, 2024-09-13T06:42:03.407 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:03.407 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:03.408 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:03.408 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:03.408 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:03.408 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43256 2024-09-13T06:42:03.408 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.408 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:03.408 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.408 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:03.408 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664763+0000", 2024-09-13T06:42:03.408 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:03.408 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.408 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.408 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:03.408 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664763+0000", 2024-09-13T06:42:03.409 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:03.409 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.409 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.409 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:03.409 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664762+0000", 2024-09-13T06:42:03.409 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:03.409 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.409 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.409 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:03.409 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664765+0000", 2024-09-13T06:42:03.409 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3290000000000001e-06 2024-09-13T06:42:03.409 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.409 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.409 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:03.410 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664771+0000", 2024-09-13T06:42:03.410 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.1319999999999999e-06 2024-09-13T06:42:03.410 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.410 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.410 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:03.410 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664776+0000", 2024-09-13T06:42:03.410 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.8840000000000002e-06 2024-09-13T06:42:03.410 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.410 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.410 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:03.410 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.788598+0000", 2024-09-13T06:42:03.410 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123821979 2024-09-13T06:42:03.410 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.411 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.411 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:03.411 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.788680+0000", 2024-09-13T06:42:03.411 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.2367999999999995e-05 2024-09-13T06:42:03.411 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.411 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.411 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:03.411 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.788946+0000", 2024-09-13T06:42:03.411 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00026629799999999999 2024-09-13T06:42:03.411 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:03.411 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:03.411 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:03.411 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.412 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.412 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43265 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 477184~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:42:03.412 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.669414+0000", 2024-09-13T06:42:03.412 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 101.666951775, 2024-09-13T06:42:03.412 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123446973, 2024-09-13T06:42:03.412 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:03.412 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:03.412 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:03.412 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:03.412 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:03.412 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43265 2024-09-13T06:42:03.412 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.412 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:03.412 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.413 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:03.413 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669414+0000", 2024-09-13T06:42:03.413 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:03.413 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.413 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.413 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:03.413 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669414+0000", 2024-09-13T06:42:03.413 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:03.413 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.413 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.413 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:03.413 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669414+0000", 2024-09-13T06:42:03.413 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:03.414 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.414 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.414 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:03.414 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669416+0000", 2024-09-13T06:42:03.414 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.317e-06 2024-09-13T06:42:03.414 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.414 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.414 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:03.414 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669425+0000", 2024-09-13T06:42:03.414 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.0650000000000005e-06 2024-09-13T06:42:03.414 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.414 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.415 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:03.415 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669430+0000", 2024-09-13T06:42:03.415 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5079999999999999e-06 2024-09-13T06:42:03.415 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.415 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.415 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:03.415 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.792649+0000", 2024-09-13T06:42:03.415 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123219328 2024-09-13T06:42:03.415 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.415 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.415 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:03.415 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.792695+0000", 2024-09-13T06:42:03.416 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5476999999999998e-05 2024-09-13T06:42:03.416 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.416 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.416 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:03.416 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.792861+0000", 2024-09-13T06:42:03.416 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00016658999999999999 2024-09-13T06:42:03.416 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:03.416 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:03.416 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:03.416 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.416 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.416 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43266 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 491520~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:42:03.417 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.669434+0000", 2024-09-13T06:42:03.417 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 101.66693165300001, 2024-09-13T06:42:03.417 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123685267, 2024-09-13T06:42:03.417 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:03.417 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:03.417 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:03.417 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:03.417 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:03.417 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43266 2024-09-13T06:42:03.417 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.417 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:03.417 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.417 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:03.418 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669434+0000", 2024-09-13T06:42:03.418 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:03.418 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.418 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.418 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:03.418 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669434+0000", 2024-09-13T06:42:03.418 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:03.418 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.418 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.418 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:03.418 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669434+0000", 2024-09-13T06:42:03.418 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:03.418 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.419 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.419 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:03.419 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669441+0000", 2024-09-13T06:42:03.419 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3019999999999997e-06 2024-09-13T06:42:03.419 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.419 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.419 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:03.419 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669451+0000", 2024-09-13T06:42:03.419 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.6379999999999999e-06 2024-09-13T06:42:03.419 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.419 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.419 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:03.419 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669456+0000", 2024-09-13T06:42:03.420 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.361e-06 2024-09-13T06:42:03.420 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.420 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.420 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:03.420 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.792879+0000", 2024-09-13T06:42:03.420 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123422686 2024-09-13T06:42:03.420 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.420 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.420 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:03.420 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.792923+0000", 2024-09-13T06:42:03.420 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4035000000000001e-05 2024-09-13T06:42:03.420 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.420 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.420 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:03.421 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.793120+0000", 2024-09-13T06:42:03.421 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00019660899999999999 2024-09-13T06:42:03.421 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:03.421 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:03.421 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:03.421 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.421 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.421 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43267 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 505856~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:42:03.421 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.669461+0000", 2024-09-13T06:42:03.421 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 101.66690485700001, 2024-09-13T06:42:03.421 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123933711, 2024-09-13T06:42:03.421 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:03.421 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:03.422 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:03.422 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:03.422 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:03.422 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43267 2024-09-13T06:42:03.422 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.422 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:03.422 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.422 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:03.422 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669461+0000", 2024-09-13T06:42:03.422 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:03.422 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.422 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.422 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:03.422 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669461+0000", 2024-09-13T06:42:03.423 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:03.423 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.423 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.423 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:03.423 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669461+0000", 2024-09-13T06:42:03.423 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:03.423 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.423 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.423 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:03.423 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669463+0000", 2024-09-13T06:42:03.423 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5629999999999999e-06 2024-09-13T06:42:03.423 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.423 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.424 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:03.424 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669473+0000", 2024-09-13T06:42:03.424 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.9520000000000006e-06 2024-09-13T06:42:03.424 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.424 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.424 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:03.424 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669479+0000", 2024-09-13T06:42:03.424 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8540000000000002e-06 2024-09-13T06:42:03.424 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.424 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.424 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:03.424 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.793137+0000", 2024-09-13T06:42:03.424 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.12365825699999999 2024-09-13T06:42:03.425 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.425 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.425 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:03.425 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.793181+0000", 2024-09-13T06:42:03.425 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.3773999999999998e-05 2024-09-13T06:42:03.425 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.425 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.425 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:03.425 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.793395+0000", 2024-09-13T06:42:03.425 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00021372399999999999 2024-09-13T06:42:03.425 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:03.425 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:03.425 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:03.425 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.426 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.426 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43268 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 520192~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:42:03.426 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.669484+0000", 2024-09-13T06:42:03.426 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 101.66688207200001, 2024-09-13T06:42:03.426 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.12441057899999999, 2024-09-13T06:42:03.426 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:03.426 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:03.426 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:03.426 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:03.426 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:03.426 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43268 2024-09-13T06:42:03.426 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.427 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:03.427 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.427 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:03.427 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669484+0000", 2024-09-13T06:42:03.427 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:03.427 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.427 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.427 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:03.427 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669484+0000", 2024-09-13T06:42:03.427 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:03.427 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.427 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.427 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:03.428 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669484+0000", 2024-09-13T06:42:03.428 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:03.428 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.428 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.428 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:03.428 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669486+0000", 2024-09-13T06:42:03.428 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6120000000000001e-06 2024-09-13T06:42:03.428 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.428 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.428 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:03.428 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669494+0000", 2024-09-13T06:42:03.428 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4819999999999997e-06 2024-09-13T06:42:03.428 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.428 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.429 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:03.429 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669497+0000", 2024-09-13T06:42:03.429 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9790000000000002e-06 2024-09-13T06:42:03.429 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.429 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.429 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:03.429 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.793559+0000", 2024-09-13T06:42:03.429 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.124062436 2024-09-13T06:42:03.429 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.429 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.429 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:03.429 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.793603+0000", 2024-09-13T06:42:03.429 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.3764999999999999e-05 2024-09-13T06:42:03.430 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.430 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.430 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:03.430 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.793895+0000", 2024-09-13T06:42:03.430 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00029168299999999999 2024-09-13T06:42:03.430 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:03.430 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:03.430 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:03.430 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:03.430 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:03.430 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:42:03.432 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-13T06:42:03.432 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:42:03.433+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:42:03.532 INFO:tasks.ceph.osd.6.smithi139.stderr:2024-09-13T06:42:03.530+0000 7fcd02c5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26385) UID: 0 2024-09-13T06:42:03.594 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:42:03.594 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-13T06:42:03.594 INFO:teuthology.orchestra.run.smithi081.stdout: "num_ops": 0 2024-09-13T06:42:03.594 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:42:03.606 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-13T06:42:03.650 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:42:03.649+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:42:03.720 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:42:03.720 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-13T06:42:03.720 INFO:teuthology.orchestra.run.smithi081.stdout: "complaint_time": 30, 2024-09-13T06:42:03.721 INFO:teuthology.orchestra.run.smithi081.stdout: "num_blocked_ops": 0 2024-09-13T06:42:03.721 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:42:03.733 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-13T06:42:03.734 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:42:03.730+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:42:03.835 INFO:tasks.ceph.osd.6.smithi139.stderr:2024-09-13T06:42:03.834+0000 7fcd02c5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26385) UID: 0 2024-09-13T06:42:03.893 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:42:03.894 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 20, 2024-09-13T06:42:03.894 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 600, 2024-09-13T06:42:03.894 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [ 2024-09-13T06:42:03.894 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.894 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:21979 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 14217216~4096 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:42:03.894 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.888811+0000", 2024-09-13T06:42:03.894 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 131.005213164, 2024-09-13T06:42:03.894 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049092969, 2024-09-13T06:42:03.894 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:03.894 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:03.894 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:03.895 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:03.895 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:03.895 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 21979 2024-09-13T06:42:03.895 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.895 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:03.895 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.895 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:03.895 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888811+0000", 2024-09-13T06:42:03.895 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:03.895 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.895 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.895 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:03.895 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888811+0000", 2024-09-13T06:42:03.896 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:03.896 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.896 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.896 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:03.896 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888811+0000", 2024-09-13T06:42:03.896 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:42:03.896 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.896 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.896 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:03.896 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888812+0000", 2024-09-13T06:42:03.896 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.204e-06 2024-09-13T06:42:03.896 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.896 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.897 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:03.897 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888815+0000", 2024-09-13T06:42:03.897 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9359999999999999e-06 2024-09-13T06:42:03.897 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.897 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.897 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:03.897 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888818+0000", 2024-09-13T06:42:03.897 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.7369999999999998e-06 2024-09-13T06:42:03.897 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.897 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.897 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:03.898 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.937663+0000", 2024-09-13T06:42:03.898 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.048844540999999998 2024-09-13T06:42:03.898 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.898 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.898 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:03.898 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.937709+0000", 2024-09-13T06:42:03.898 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6492999999999997e-05 2024-09-13T06:42:03.898 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.898 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.898 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:03.898 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.937904+0000", 2024-09-13T06:42:03.898 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00019526499999999999 2024-09-13T06:42:03.898 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:03.899 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:03.899 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:03.899 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.899 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.899 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:21980 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 14245888~4096 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:42:03.899 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.888820+0000", 2024-09-13T06:42:03.899 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 131.00520448699999, 2024-09-13T06:42:03.899 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049357080999999997, 2024-09-13T06:42:03.899 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:03.899 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:03.899 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:03.899 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:03.899 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:03.899 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 21980 2024-09-13T06:42:03.900 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.900 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:03.900 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.900 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:03.900 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888820+0000", 2024-09-13T06:42:03.900 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:03.900 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.900 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.900 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:03.900 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888820+0000", 2024-09-13T06:42:03.900 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:03.900 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.900 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.901 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:03.901 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888820+0000", 2024-09-13T06:42:03.901 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:42:03.901 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.901 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.901 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:03.901 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888821+0000", 2024-09-13T06:42:03.901 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.122e-06 2024-09-13T06:42:03.901 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.901 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.901 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:03.901 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888824+0000", 2024-09-13T06:42:03.901 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.0580000000000002e-06 2024-09-13T06:42:03.902 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.902 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.902 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:03.902 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888827+0000", 2024-09-13T06:42:03.902 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.666e-06 2024-09-13T06:42:03.902 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.902 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.902 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:03.902 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.937935+0000", 2024-09-13T06:42:03.902 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049108329999999999 2024-09-13T06:42:03.902 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.902 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.902 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:03.903 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.937985+0000", 2024-09-13T06:42:03.903 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9694000000000002e-05 2024-09-13T06:42:03.903 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.903 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.903 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:03.903 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.938177+0000", 2024-09-13T06:42:03.903 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00019241899999999999 2024-09-13T06:42:03.903 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:03.903 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:03.903 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:03.903 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.903 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.903 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:21984 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:snapdir [list-snaps] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:42:03.904 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.888829+0000", 2024-09-13T06:42:03.904 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 131.00519570899999, 2024-09-13T06:42:03.904 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049524545000000003, 2024-09-13T06:42:03.904 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:03.904 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:03.904 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:03.904 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:03.904 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:03.904 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 21984 2024-09-13T06:42:03.904 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.904 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:03.904 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.904 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:03.905 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888829+0000", 2024-09-13T06:42:03.905 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:03.905 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.905 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.905 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:03.905 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888829+0000", 2024-09-13T06:42:03.905 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:03.905 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.905 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.905 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:03.905 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888829+0000", 2024-09-13T06:42:03.905 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:42:03.905 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.906 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.906 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:03.906 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888830+0000", 2024-09-13T06:42:03.906 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2529999999999999e-06 2024-09-13T06:42:03.906 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.906 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.906 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:03.906 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888835+0000", 2024-09-13T06:42:03.906 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.4729999999999999e-06 2024-09-13T06:42:03.906 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.906 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.906 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:03.906 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888840+0000", 2024-09-13T06:42:03.906 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0159999999999999e-06 2024-09-13T06:42:03.907 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.907 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.907 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:03.907 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.938199+0000", 2024-09-13T06:42:03.907 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049358974999999999 2024-09-13T06:42:03.907 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.907 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.907 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:03.907 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.938268+0000", 2024-09-13T06:42:03.907 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.8876999999999998e-05 2024-09-13T06:42:03.907 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.907 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.907 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:03.908 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.938353+0000", 2024-09-13T06:42:03.908 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.5155999999999996e-05 2024-09-13T06:42:03.908 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:03.908 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:03.908 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:03.908 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.908 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.908 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:21985 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 12587008~4096 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:42:03.908 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.888858+0000", 2024-09-13T06:42:03.908 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 131.005166559, 2024-09-13T06:42:03.908 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049674347000000001, 2024-09-13T06:42:03.909 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:03.909 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:03.909 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:03.909 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:03.909 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:03.909 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 21985 2024-09-13T06:42:03.909 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.909 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:03.909 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.909 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:03.909 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888858+0000", 2024-09-13T06:42:03.909 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:03.909 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.910 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.910 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:03.910 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888858+0000", 2024-09-13T06:42:03.910 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:03.910 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.910 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.910 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:03.910 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888857+0000", 2024-09-13T06:42:03.910 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:03.910 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.910 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.910 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:03.910 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888860+0000", 2024-09-13T06:42:03.911 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4739999999999999e-06 2024-09-13T06:42:03.911 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.911 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.911 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:03.911 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888867+0000", 2024-09-13T06:42:03.911 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.7170000000000002e-06 2024-09-13T06:42:03.911 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.911 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.911 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:03.911 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888871+0000", 2024-09-13T06:42:03.911 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5120000000000002e-06 2024-09-13T06:42:03.911 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.911 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.912 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:03.912 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.938389+0000", 2024-09-13T06:42:03.912 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049517717000000003 2024-09-13T06:42:03.912 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.912 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.912 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:03.912 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.938449+0000", 2024-09-13T06:42:03.912 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0513999999999997e-05 2024-09-13T06:42:03.912 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.912 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.912 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:03.912 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.938532+0000", 2024-09-13T06:42:03.912 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.2936999999999996e-05 2024-09-13T06:42:03.913 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:03.913 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:03.913 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:03.913 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.913 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.913 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:21986 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 12615680~4096 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:42:03.913 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.888875+0000", 2024-09-13T06:42:03.913 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 131.00514904600001, 2024-09-13T06:42:03.913 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049881781, 2024-09-13T06:42:03.913 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:03.913 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:03.913 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:03.913 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:03.914 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:03.914 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 21986 2024-09-13T06:42:03.914 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.914 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:03.914 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.914 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:03.914 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888875+0000", 2024-09-13T06:42:03.914 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:03.914 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.914 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.914 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:03.914 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888875+0000", 2024-09-13T06:42:03.914 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:03.915 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.915 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.915 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:03.915 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888875+0000", 2024-09-13T06:42:03.915 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:03.915 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.915 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.915 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:03.915 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888880+0000", 2024-09-13T06:42:03.915 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7600000000000002e-06 2024-09-13T06:42:03.915 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.915 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.915 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:03.916 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888887+0000", 2024-09-13T06:42:03.916 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3950000000000003e-06 2024-09-13T06:42:03.916 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.916 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.916 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:03.916 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888892+0000", 2024-09-13T06:42:03.916 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0409999999999997e-06 2024-09-13T06:42:03.916 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.916 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.916 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:03.916 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.938568+0000", 2024-09-13T06:42:03.916 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049675267000000002 2024-09-13T06:42:03.917 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.917 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.917 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:03.917 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.938653+0000", 2024-09-13T06:42:03.917 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.5792999999999997e-05 2024-09-13T06:42:03.917 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.917 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.917 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:03.917 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.938757+0000", 2024-09-13T06:42:03.917 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00010387699999999999 2024-09-13T06:42:03.917 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:03.917 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:03.917 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:03.917 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.918 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.918 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:21987 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 12644352~4096 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:42:03.918 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.888899+0000", 2024-09-13T06:42:03.918 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 131.00512570000001, 2024-09-13T06:42:03.918 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.050094056999999997, 2024-09-13T06:42:03.918 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:03.918 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:03.918 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:03.918 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:03.918 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:03.918 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 21987 2024-09-13T06:42:03.919 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.919 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:03.919 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.919 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:03.919 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888899+0000", 2024-09-13T06:42:03.919 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:03.919 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.919 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.919 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:03.919 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888899+0000", 2024-09-13T06:42:03.919 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:03.919 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.920 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.920 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:03.920 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888899+0000", 2024-09-13T06:42:03.920 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:03.920 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.920 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.920 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:03.920 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888901+0000", 2024-09-13T06:42:03.920 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2539999999999999e-06 2024-09-13T06:42:03.920 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.920 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.920 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:03.920 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888907+0000", 2024-09-13T06:42:03.921 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9009999999999999e-06 2024-09-13T06:42:03.921 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.921 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.921 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:03.921 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888912+0000", 2024-09-13T06:42:03.921 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9840000000000001e-06 2024-09-13T06:42:03.921 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.921 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.921 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:03.921 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.938810+0000", 2024-09-13T06:42:03.921 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049898835000000002 2024-09-13T06:42:03.921 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.921 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.922 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:03.922 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.938890+0000", 2024-09-13T06:42:03.922 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.9215000000000006e-05 2024-09-13T06:42:03.922 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.922 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.922 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:03.922 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.938993+0000", 2024-09-13T06:42:03.922 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000103194 2024-09-13T06:42:03.922 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:03.922 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:03.922 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:03.922 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.922 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.923 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:21988 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 12673024~4096 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:42:03.923 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.888916+0000", 2024-09-13T06:42:03.923 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 131.00510868399999, 2024-09-13T06:42:03.923 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.050203036999999999, 2024-09-13T06:42:03.923 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:03.923 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:03.923 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:03.923 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:03.923 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:03.923 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 21988 2024-09-13T06:42:03.923 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.923 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:03.923 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.924 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:03.924 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888916+0000", 2024-09-13T06:42:03.924 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:03.924 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.924 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.924 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:03.924 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888916+0000", 2024-09-13T06:42:03.924 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:03.924 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.924 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.924 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:03.924 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888915+0000", 2024-09-13T06:42:03.924 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:03.925 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.925 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.925 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:03.925 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888918+0000", 2024-09-13T06:42:03.925 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1500000000000002e-06 2024-09-13T06:42:03.925 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.925 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.925 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:03.925 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888925+0000", 2024-09-13T06:42:03.925 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.9380000000000003e-06 2024-09-13T06:42:03.925 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.925 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.925 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:03.925 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888933+0000", 2024-09-13T06:42:03.926 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.0560000000000005e-06 2024-09-13T06:42:03.926 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.926 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.926 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:03.926 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.939026+0000", 2024-09-13T06:42:03.926 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.050093499999999999 2024-09-13T06:42:03.926 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.926 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.926 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:03.926 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.939068+0000", 2024-09-13T06:42:03.927 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.1705999999999997e-05 2024-09-13T06:42:03.927 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.927 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.927 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:03.927 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.939119+0000", 2024-09-13T06:42:03.927 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.1048999999999999e-05 2024-09-13T06:42:03.927 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:03.927 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:03.927 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:03.927 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.927 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.928 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:21989 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 12701696~4096 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:42:03.928 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.888938+0000", 2024-09-13T06:42:03.928 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 131.00508635700001, 2024-09-13T06:42:03.928 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.050294393999999999, 2024-09-13T06:42:03.928 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:03.928 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:03.928 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:03.928 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:03.928 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:03.928 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 21989 2024-09-13T06:42:03.928 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.929 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:03.929 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.929 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:03.929 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888938+0000", 2024-09-13T06:42:03.929 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:03.929 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.929 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.929 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:03.929 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888938+0000", 2024-09-13T06:42:03.929 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:03.929 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.929 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.929 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:03.930 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888938+0000", 2024-09-13T06:42:03.930 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:03.930 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.930 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.930 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:03.930 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888940+0000", 2024-09-13T06:42:03.930 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5330000000000001e-06 2024-09-13T06:42:03.930 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.930 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.930 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:03.930 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888947+0000", 2024-09-13T06:42:03.930 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.2389999999999999e-06 2024-09-13T06:42:03.930 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.930 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.931 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:03.931 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888952+0000", 2024-09-13T06:42:03.931 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.5720000000000002e-06 2024-09-13T06:42:03.931 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.931 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.931 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:03.931 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.939141+0000", 2024-09-13T06:42:03.931 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.050188903999999999 2024-09-13T06:42:03.931 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.931 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.931 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:03.931 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.939182+0000", 2024-09-13T06:42:03.931 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.0926000000000001e-05 2024-09-13T06:42:03.932 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.932 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.932 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:03.932 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.939233+0000", 2024-09-13T06:42:03.932 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0532999999999999e-05 2024-09-13T06:42:03.932 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:03.932 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:03.932 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:03.932 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.932 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.932 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:22007 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 13217792~4096 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:42:03.932 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.892771+0000", 2024-09-13T06:42:03.932 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 131.00125325100001, 2024-09-13T06:42:03.932 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049090024000000003, 2024-09-13T06:42:03.933 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:03.933 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:03.933 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:03.933 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:03.933 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:03.933 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 22007 2024-09-13T06:42:03.933 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.933 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:03.933 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.933 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:03.933 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892771+0000", 2024-09-13T06:42:03.933 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:03.934 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.934 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.934 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:03.934 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892771+0000", 2024-09-13T06:42:03.934 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:03.934 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.934 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.934 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:03.934 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892771+0000", 2024-09-13T06:42:03.934 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:42:03.934 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.934 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.934 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:03.934 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892772+0000", 2024-09-13T06:42:03.935 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.184e-06 2024-09-13T06:42:03.935 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.935 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.935 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:03.935 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892775+0000", 2024-09-13T06:42:03.935 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9179999999999998e-06 2024-09-13T06:42:03.935 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.935 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.935 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:03.935 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892778+0000", 2024-09-13T06:42:03.935 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4990000000000001e-06 2024-09-13T06:42:03.935 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.935 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.935 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:03.936 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.941760+0000", 2024-09-13T06:42:03.936 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.048982070000000003 2024-09-13T06:42:03.936 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.936 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.936 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:03.936 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.941808+0000", 2024-09-13T06:42:03.936 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.8278000000000001e-05 2024-09-13T06:42:03.936 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.936 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.936 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:03.936 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.941861+0000", 2024-09-13T06:42:03.936 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3284e-05 2024-09-13T06:42:03.936 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:03.936 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:03.936 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:03.937 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.937 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.937 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:22008 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 13246464~4096 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:42:03.937 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.892780+0000", 2024-09-13T06:42:03.937 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 131.00124459400001, 2024-09-13T06:42:03.937 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049200477999999999, 2024-09-13T06:42:03.937 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:03.937 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:03.937 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:03.938 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:03.938 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:03.938 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 22008 2024-09-13T06:42:03.938 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.938 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:03.938 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.938 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:03.938 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892780+0000", 2024-09-13T06:42:03.938 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:03.938 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.938 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.938 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:03.938 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892780+0000", 2024-09-13T06:42:03.939 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:03.939 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.939 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.939 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:03.939 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892780+0000", 2024-09-13T06:42:03.939 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:42:03.939 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.939 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.939 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:03.939 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892781+0000", 2024-09-13T06:42:03.939 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.083e-06 2024-09-13T06:42:03.939 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.939 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.940 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:03.940 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892784+0000", 2024-09-13T06:42:03.940 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.926e-06 2024-09-13T06:42:03.940 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.940 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.940 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:03.940 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892786+0000", 2024-09-13T06:42:03.940 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4490000000000002e-06 2024-09-13T06:42:03.940 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.941 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.941 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:03.941 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.941888+0000", 2024-09-13T06:42:03.941 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049102290999999999 2024-09-13T06:42:03.941 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.941 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.941 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:03.941 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.941929+0000", 2024-09-13T06:42:03.941 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.0541999999999999e-05 2024-09-13T06:42:03.941 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.941 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.941 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:03.941 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.941980+0000", 2024-09-13T06:42:03.942 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.1391999999999999e-05 2024-09-13T06:42:03.942 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:03.942 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:03.942 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:03.942 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.942 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.942 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:22009 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 13275136~4096 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:42:03.942 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.892788+0000", 2024-09-13T06:42:03.942 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 131.00123611000001, 2024-09-13T06:42:03.942 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049311926999999998, 2024-09-13T06:42:03.942 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:03.942 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:03.942 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:03.943 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:03.943 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:03.943 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 22009 2024-09-13T06:42:03.943 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.943 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:03.943 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.943 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:03.943 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892788+0000", 2024-09-13T06:42:03.943 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:03.943 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.943 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.943 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:03.944 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892788+0000", 2024-09-13T06:42:03.944 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:03.944 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.944 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.944 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:03.944 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892788+0000", 2024-09-13T06:42:03.944 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:42:03.944 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.944 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.944 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:03.944 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892789+0000", 2024-09-13T06:42:03.944 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1850000000000001e-06 2024-09-13T06:42:03.944 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.945 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.945 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:03.945 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892793+0000", 2024-09-13T06:42:03.945 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.9099999999999998e-06 2024-09-13T06:42:03.945 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.945 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.945 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:03.945 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892798+0000", 2024-09-13T06:42:03.945 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5070000000000002e-06 2024-09-13T06:42:03.945 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.945 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.945 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:03.945 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.942007+0000", 2024-09-13T06:42:03.946 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049208904999999997 2024-09-13T06:42:03.946 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.946 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.946 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:03.946 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.942049+0000", 2024-09-13T06:42:03.946 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.1922000000000003e-05 2024-09-13T06:42:03.946 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.946 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.946 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:03.946 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.942100+0000", 2024-09-13T06:42:03.946 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.1736000000000001e-05 2024-09-13T06:42:03.946 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:03.946 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:03.946 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:03.947 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.947 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.947 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:22010 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 13303808~4096 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:42:03.947 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.892817+0000", 2024-09-13T06:42:03.947 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 131.00120791399999, 2024-09-13T06:42:03.947 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049466149000000001, 2024-09-13T06:42:03.947 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:03.947 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:03.947 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:03.947 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:03.947 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:03.947 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 22010 2024-09-13T06:42:03.947 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.948 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:03.948 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.948 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:03.948 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892817+0000", 2024-09-13T06:42:03.948 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:03.948 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.948 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.948 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:03.948 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892817+0000", 2024-09-13T06:42:03.948 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:03.948 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.948 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.948 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:03.948 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892816+0000", 2024-09-13T06:42:03.949 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:03.949 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.949 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.949 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:03.949 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892821+0000", 2024-09-13T06:42:03.949 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9459999999999997e-06 2024-09-13T06:42:03.949 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.949 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.949 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:03.949 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892828+0000", 2024-09-13T06:42:03.949 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.6780000000000003e-06 2024-09-13T06:42:03.949 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.949 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.950 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:03.950 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892833+0000", 2024-09-13T06:42:03.950 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.8389999999999997e-06 2024-09-13T06:42:03.950 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.950 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.950 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:03.950 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.942127+0000", 2024-09-13T06:42:03.950 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049294163000000002 2024-09-13T06:42:03.950 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.950 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.950 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:03.950 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.942186+0000", 2024-09-13T06:42:03.950 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9335e-05 2024-09-13T06:42:03.950 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.951 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.951 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:03.951 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.942283+0000", 2024-09-13T06:42:03.951 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.6699000000000004e-05 2024-09-13T06:42:03.951 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:03.951 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:03.951 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:03.951 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.951 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.951 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:22011 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 13332480~4096 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:42:03.951 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.892838+0000", 2024-09-13T06:42:03.951 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 131.00118622700001, 2024-09-13T06:42:03.951 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049589214, 2024-09-13T06:42:03.951 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:03.952 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:03.952 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:03.952 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:03.952 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:03.952 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 22011 2024-09-13T06:42:03.952 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.952 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:03.952 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.952 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:03.952 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892838+0000", 2024-09-13T06:42:03.952 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:03.952 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.953 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.953 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:03.953 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892838+0000", 2024-09-13T06:42:03.953 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:03.953 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.953 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.953 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:03.953 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892838+0000", 2024-09-13T06:42:03.953 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:03.953 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.953 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.953 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:03.954 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892840+0000", 2024-09-13T06:42:03.954 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.136e-06 2024-09-13T06:42:03.954 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.954 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.954 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:03.954 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892852+0000", 2024-09-13T06:42:03.954 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2122e-05 2024-09-13T06:42:03.954 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.954 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.954 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:03.954 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892862+0000", 2024-09-13T06:42:03.954 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.7049999999999994e-06 2024-09-13T06:42:03.955 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.955 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.955 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:03.955 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.942319+0000", 2024-09-13T06:42:03.955 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049456623999999998 2024-09-13T06:42:03.955 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.955 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.955 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:03.955 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.942363+0000", 2024-09-13T06:42:03.955 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4759000000000003e-05 2024-09-13T06:42:03.955 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.955 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.955 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:03.956 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.942428+0000", 2024-09-13T06:42:03.956 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.4221999999999996e-05 2024-09-13T06:42:03.956 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:03.956 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:03.956 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:03.956 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.956 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.956 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:22033 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 13963264~4096 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:42:03.956 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.896824+0000", 2024-09-13T06:42:03.956 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 130.99720033400001, 2024-09-13T06:42:03.957 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049051957, 2024-09-13T06:42:03.957 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:03.957 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:03.957 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:03.957 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:03.957 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:03.957 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 22033 2024-09-13T06:42:03.957 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.957 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:03.957 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.957 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:03.957 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.896824+0000", 2024-09-13T06:42:03.957 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:03.957 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.958 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.958 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:03.958 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.896824+0000", 2024-09-13T06:42:03.958 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:03.958 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.958 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.958 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:03.958 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.896824+0000", 2024-09-13T06:42:03.958 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:03.958 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.958 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.958 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:03.958 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.896826+0000", 2024-09-13T06:42:03.958 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1900000000000002e-06 2024-09-13T06:42:03.959 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.959 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.959 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:03.959 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.896832+0000", 2024-09-13T06:42:03.959 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.2689999999999996e-06 2024-09-13T06:42:03.959 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.959 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.959 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:03.959 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.896840+0000", 2024-09-13T06:42:03.959 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3289999999999996e-06 2024-09-13T06:42:03.959 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.959 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.959 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:03.960 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.945777+0000", 2024-09-13T06:42:03.960 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.048937188 2024-09-13T06:42:03.960 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.960 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.960 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:03.960 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.945822+0000", 2024-09-13T06:42:03.960 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4780999999999997e-05 2024-09-13T06:42:03.960 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.960 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.960 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:03.960 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.945876+0000", 2024-09-13T06:42:03.960 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.4542000000000001e-05 2024-09-13T06:42:03.960 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:03.961 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:03.961 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:03.961 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.961 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.961 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:22338 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 13611008~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:42:03.961 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.951070+0000", 2024-09-13T06:42:03.961 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 130.94295470599999, 2024-09-13T06:42:03.961 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049135817999999998, 2024-09-13T06:42:03.961 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:03.961 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:03.961 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:03.961 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:03.961 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:03.961 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 22338 2024-09-13T06:42:03.962 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.962 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:03.962 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.962 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:03.962 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951070+0000", 2024-09-13T06:42:03.962 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:03.962 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.962 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.962 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:03.962 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951070+0000", 2024-09-13T06:42:03.962 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:03.962 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.962 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.963 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:03.963 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951069+0000", 2024-09-13T06:42:03.963 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:03.963 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.963 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.963 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:03.963 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951072+0000", 2024-09-13T06:42:03.963 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5909999999999998e-06 2024-09-13T06:42:03.963 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.963 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.963 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:03.963 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951078+0000", 2024-09-13T06:42:03.963 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.4450000000000001e-06 2024-09-13T06:42:03.964 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.964 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.964 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:03.964 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951083+0000", 2024-09-13T06:42:03.964 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7790000000000003e-06 2024-09-13T06:42:03.964 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.964 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.964 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:03.964 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:53.000020+0000", 2024-09-13T06:42:03.964 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.048936999000000002 2024-09-13T06:42:03.964 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.964 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.964 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:03.964 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:53.000106+0000", 2024-09-13T06:42:03.965 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.5532999999999996e-05 2024-09-13T06:42:03.965 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.965 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.965 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:03.965 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:53.000206+0000", 2024-09-13T06:42:03.965 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.9852999999999994e-05 2024-09-13T06:42:03.965 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:03.965 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:03.965 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:03.965 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.965 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.965 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:22339 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 13639680~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:42:03.965 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.951088+0000", 2024-09-13T06:42:03.966 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 130.942937008, 2024-09-13T06:42:03.966 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049238202000000002, 2024-09-13T06:42:03.966 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:03.966 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:03.966 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:03.966 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:03.966 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:03.966 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 22339 2024-09-13T06:42:03.966 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.966 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:03.966 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.966 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:03.966 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951088+0000", 2024-09-13T06:42:03.967 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:03.967 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.967 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.967 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:03.967 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951088+0000", 2024-09-13T06:42:03.967 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:03.967 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.967 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.967 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:03.967 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951087+0000", 2024-09-13T06:42:03.967 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:03.967 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.967 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.967 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:03.968 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951089+0000", 2024-09-13T06:42:03.968 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.153e-06 2024-09-13T06:42:03.968 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.968 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.968 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:03.968 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951093+0000", 2024-09-13T06:42:03.968 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.7120000000000002e-06 2024-09-13T06:42:03.968 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.968 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.968 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:03.968 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951096+0000", 2024-09-13T06:42:03.968 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.0570000000000001e-06 2024-09-13T06:42:03.969 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.969 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.969 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:03.969 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:53.000220+0000", 2024-09-13T06:42:03.969 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049123989 2024-09-13T06:42:03.969 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.969 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.969 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:03.969 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:53.000271+0000", 2024-09-13T06:42:03.969 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.062e-05 2024-09-13T06:42:03.969 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.969 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.969 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:03.970 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:53.000326+0000", 2024-09-13T06:42:03.970 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.5121000000000003e-05 2024-09-13T06:42:03.970 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:03.970 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:03.970 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:03.970 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.970 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.970 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:22340 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 13668352~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:42:03.970 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.951200+0000", 2024-09-13T06:42:03.970 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 130.94282411899999, 2024-09-13T06:42:03.970 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049352350000000003, 2024-09-13T06:42:03.970 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:03.970 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:03.970 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:03.971 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:03.971 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:03.971 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 22340 2024-09-13T06:42:03.971 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.971 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:03.971 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.971 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:03.971 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951200+0000", 2024-09-13T06:42:03.971 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:03.971 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.971 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.971 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:03.971 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951200+0000", 2024-09-13T06:42:03.971 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:03.972 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.972 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.972 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:03.972 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951098+0000", 2024-09-13T06:42:03.972 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.999898 2024-09-13T06:42:03.972 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.972 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.972 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:03.972 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951204+0000", 2024-09-13T06:42:03.972 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000105398 2024-09-13T06:42:03.972 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.972 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.972 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:03.973 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951211+0000", 2024-09-13T06:42:03.973 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.43e-06 2024-09-13T06:42:03.973 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.973 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.973 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:03.973 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951216+0000", 2024-09-13T06:42:03.973 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2800000000000003e-06 2024-09-13T06:42:03.973 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.973 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.973 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:03.973 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:53.000358+0000", 2024-09-13T06:42:03.973 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049142036 2024-09-13T06:42:03.973 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.974 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.974 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:03.974 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:53.000443+0000", 2024-09-13T06:42:03.974 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.4710999999999996e-05 2024-09-13T06:42:03.974 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.974 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.974 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:03.974 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:53.000553+0000", 2024-09-13T06:42:03.974 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000109622 2024-09-13T06:42:03.974 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:03.974 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:03.974 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:03.974 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.975 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.975 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:22348 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 13897728~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:42:03.975 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.952783+0000", 2024-09-13T06:42:03.975 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 130.94124133099999, 2024-09-13T06:42:03.975 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049120832000000003, 2024-09-13T06:42:03.975 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:03.975 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:03.975 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:03.975 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:03.975 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:03.975 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 22348 2024-09-13T06:42:03.975 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.975 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:03.976 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.976 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:03.976 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.952783+0000", 2024-09-13T06:42:03.976 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:03.976 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.976 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.976 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:03.976 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.952783+0000", 2024-09-13T06:42:03.976 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:03.976 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.976 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.976 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:03.976 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.952783+0000", 2024-09-13T06:42:03.976 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:03.977 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.977 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.977 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:03.977 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.952785+0000", 2024-09-13T06:42:03.977 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4980000000000001e-06 2024-09-13T06:42:03.977 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.977 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.977 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:03.977 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.952799+0000", 2024-09-13T06:42:03.977 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3825000000000001e-05 2024-09-13T06:42:03.977 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.977 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.977 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:03.977 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.952809+0000", 2024-09-13T06:42:03.977 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0043e-05 2024-09-13T06:42:03.978 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.978 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.978 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:03.978 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:53.001723+0000", 2024-09-13T06:42:03.978 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.048914065 2024-09-13T06:42:03.978 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.978 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.978 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:03.978 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:53.001807+0000", 2024-09-13T06:42:03.978 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.3776000000000006e-05 2024-09-13T06:42:03.978 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.978 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.978 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:03.978 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:53.001904+0000", 2024-09-13T06:42:03.979 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.7004999999999997e-05 2024-09-13T06:42:03.979 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:03.979 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:03.979 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:03.979 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.979 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.979 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:69045 3.0 3:05ea3821:::rbd_data.1121867cc19b.0000000000000000:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109)", 2024-09-13T06:42:03.979 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:41:03.637760+0000", 2024-09-13T06:42:03.979 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 60.256264573000003, 2024-09-13T06:42:03.979 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.052276712000000003, 2024-09-13T06:42:03.979 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:03.979 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:42:03.979 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:03.979 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:03.980 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:03.980 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 69045 2024-09-13T06:42:03.980 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.980 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:03.980 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.980 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:03.980 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:03.637760+0000", 2024-09-13T06:42:03.980 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:03.980 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.980 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.980 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:03.980 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:03.637760+0000", 2024-09-13T06:42:03.981 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:03.981 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.981 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.981 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:03.981 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:03.637758+0000", 2024-09-13T06:42:03.981 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999981 2024-09-13T06:42:03.981 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.981 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.981 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:03.981 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:03.637770+0000", 2024-09-13T06:42:03.981 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1533e-05 2024-09-13T06:42:03.981 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.981 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.982 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:03.982 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:03.637794+0000", 2024-09-13T06:42:03.982 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4243000000000002e-05 2024-09-13T06:42:03.982 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.982 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.982 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:03.982 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:03.637806+0000", 2024-09-13T06:42:03.982 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2033e-05 2024-09-13T06:42:03.982 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.982 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.982 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:03.982 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:03.637891+0000", 2024-09-13T06:42:03.982 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.5358000000000005e-05 2024-09-13T06:42:03.983 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.983 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.983 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:03.983 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:03.638042+0000", 2024-09-13T06:42:03.983 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000151073 2024-09-13T06:42:03.983 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.983 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.983 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 2", 2024-09-13T06:42:03.983 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:03.647124+0000", 2024-09-13T06:42:03.983 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0090821670000000004 2024-09-13T06:42:03.983 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.983 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.984 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:42:03.984 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:03.689849+0000", 2024-09-13T06:42:03.984 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.042724445999999999 2024-09-13T06:42:03.984 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.984 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.984 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-09-13T06:42:03.984 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:03.689871+0000", 2024-09-13T06:42:03.984 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1778999999999999e-05 2024-09-13T06:42:03.984 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.984 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.984 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:42:03.984 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:03.689965+0000", 2024-09-13T06:42:03.984 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.4312000000000001e-05 2024-09-13T06:42:03.985 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.985 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.985 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:03.985 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:03.690037+0000", 2024-09-13T06:42:03.985 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.1687999999999995e-05 2024-09-13T06:42:03.985 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:03.985 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:03.985 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:03.985 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.985 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.985 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:90987 3.6 3:6263dd97:::rbd_object_map.11212443ae03.0000000000000049:head [call] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-13T06:42:03.985 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:41:35.460333+0000", 2024-09-13T06:42:03.985 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 28.433691186000001, 2024-09-13T06:42:03.985 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0001633640000001, 2024-09-13T06:42:03.986 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:03.986 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:03.986 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:03.986 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:03.986 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:03.986 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 90987 2024-09-13T06:42:03.986 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.986 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:03.986 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.986 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:03.986 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:35.460333+0000", 2024-09-13T06:42:03.986 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:03.986 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.987 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.987 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:03.987 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:35.460333+0000", 2024-09-13T06:42:03.987 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:03.987 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.987 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.987 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:03.987 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:35.460330+0000", 2024-09-13T06:42:03.987 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999971 2024-09-13T06:42:03.987 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.987 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.987 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:03.987 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:35.460343+0000", 2024-09-13T06:42:03.987 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2695e-05 2024-09-13T06:42:03.988 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.988 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.988 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:03.988 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:35.460365+0000", 2024-09-13T06:42:03.988 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2473999999999999e-05 2024-09-13T06:42:03.988 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.988 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.988 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:03.988 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:35.460376+0000", 2024-09-13T06:42:03.988 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0383999999999999e-05 2024-09-13T06:42:03.988 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.988 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.989 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:03.989 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:35.460435+0000", 2024-09-13T06:42:03.989 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8650000000000003e-05 2024-09-13T06:42:03.989 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.989 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.989 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:42:03.989 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:35.460444+0000", 2024-09-13T06:42:03.989 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.0380000000000005e-06 2024-09-13T06:42:03.989 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.989 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.989 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:03.989 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:36.459433+0000", 2024-09-13T06:42:03.989 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.99898895799999998 2024-09-13T06:42:03.989 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.990 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.990 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:03.990 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:36.459622+0000", 2024-09-13T06:42:03.990 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00018940299999999999 2024-09-13T06:42:03.990 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:03.990 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:03.990 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:03.990 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:36.460497+0000", 2024-09-13T06:42:03.990 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00087481199999999999 2024-09-13T06:42:03.990 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:03.990 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:03.990 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:03.990 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:03.991 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:03.991 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:42:03.992 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-13T06:42:03.993 INFO:teuthology.orchestra.run.smithi081.stdout:checking clone #29, image image_client.0-clone29 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent30 2024-09-13T06:42:03.993 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:42:03.989+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:42:04.093 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:42:04.089+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:42:04.160 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:42:04.161 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-13T06:42:04.161 INFO:teuthology.orchestra.run.smithi081.stdout: "num_ops": 0 2024-09-13T06:42:04.161 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:42:04.177 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-13T06:42:04.218 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:42:04.217+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:42:04.266 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 4, 6, 7, 5, 3] out_osds: [] dead_osds: [7] live_osds: [0, 1, 2, 3, 4, 5, 6] 2024-09-13T06:42:04.267 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-13T06:42:04.267 INFO:tasks.thrashosds.thrasher:Removing osd 4, in_osds are: [0, 1, 2, 4, 6, 7, 5, 3] 2024-09-13T06:42:04.267 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd out 4 2024-09-13T06:42:04.271 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:42:04.271 INFO:teuthology.orchestra.run.smithi081.stdout:4312 read 0xb8b8dce thru 0xb8c5bf4 (0xce27 bytes) 2024-09-13T06:42:04.272 INFO:teuthology.orchestra.run.smithi081.stdout:4314 write 0x61098ec thru 0x6119597 (0xfcac bytes) 2024-09-13T06:42:04.295 INFO:tasks.ceph.osd.6.smithi139.stderr:2024-09-13T06:42:04.290+0000 7fcd02c5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26385) UID: 0 2024-09-13T06:42:04.296 INFO:teuthology.orchestra.run.smithi081.stdout:4315 punch from 0x3faad24 to 0x3fab258, (0x534 bytes) 2024-09-13T06:42:04.296 INFO:teuthology.orchestra.run.smithi081.stdout:4316 write 0x850a389 thru 0x8515005 (0xac7d bytes) 2024-09-13T06:42:04.313 INFO:teuthology.orchestra.run.smithi081.stdout:4317 read 0x58f4d5e thru 0x58f6333 (0x15d6 bytes) 2024-09-13T06:42:04.325 INFO:teuthology.orchestra.run.smithi081.stdout:4318 writesame 0xca0cb52 thru 0xca17574 data_size 0x1f(0xaa23 bytes) 2024-09-13T06:42:04.325 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:42:04.325 INFO:teuthology.orchestra.run.smithi081.stdout:4320 read 0xc9a32c4 thru 0xc9ad5e1 (0xa31e bytes) 2024-09-13T06:42:04.326 INFO:teuthology.orchestra.run.smithi081.stdout:4321 punch from 0x1bb7d6e to 0x1bbb752, (0x39e4 bytes) 2024-09-13T06:42:04.341 INFO:teuthology.orchestra.run.smithi081.stdout:4325 writesame 0xe6b7727 thru 0xe6b9654 data_size 0xd(0x1f2e bytes) 2024-09-13T06:42:04.341 INFO:teuthology.orchestra.run.smithi081.stdout:4326 punch from 0xba878ab to 0xba8818b, (0x8e0 bytes) 2024-09-13T06:42:04.341 INFO:teuthology.orchestra.run.smithi081.stdout:4327 write 0x5c0faf8 thru 0x5c12bf9 (0x3102 bytes) 2024-09-13T06:42:04.349 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:42:04.349 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-13T06:42:04.349 INFO:teuthology.orchestra.run.smithi081.stdout: "complaint_time": 30, 2024-09-13T06:42:04.349 INFO:teuthology.orchestra.run.smithi081.stdout: "num_blocked_ops": 0 2024-09-13T06:42:04.349 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:42:04.356 INFO:teuthology.orchestra.run.smithi081.stdout:4328 trunc from 0xe6b9655 to 0xd7add06 2024-09-13T06:42:04.367 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-13T06:42:04.371 INFO:teuthology.orchestra.run.smithi081.stdout:4329 read 0x67f28bf thru 0x67fd564 (0xaca6 bytes) 2024-09-13T06:42:04.371 INFO:teuthology.orchestra.run.smithi081.stdout:4330 writesame 0x11cadc6 thru 0x11d2d14 data_size 0x17(0x7f4f bytes) 2024-09-13T06:42:04.381 INFO:teuthology.orchestra.run.smithi081.stdout:4331 read 0x1156aff thru 0x115e49f (0x79a1 bytes) 2024-09-13T06:42:04.383 INFO:teuthology.orchestra.run.smithi081.stdout:4332 read 0xb9efd1a thru 0xb9f112f (0x1416 bytes) 2024-09-13T06:42:04.383 INFO:teuthology.orchestra.run.smithi081.stdout:4333 write 0x4adeb83 thru 0x4ae200a (0x3488 bytes) 2024-09-13T06:42:04.395 INFO:tasks.ceph.osd.6.smithi139.stderr:2024-09-13T06:42:04.390+0000 7fcd02c5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26385) UID: 0 2024-09-13T06:42:04.415 INFO:teuthology.orchestra.run.smithi081.stdout:4335 trunc from 0xd7add06 to 0x3f39f43 2024-09-13T06:42:04.446 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:42:04.451 INFO:teuthology.orchestra.run.smithi081.stdout:4339 trunc from 0x3f39f43 to 0x4a5e12 2024-09-13T06:42:04.496 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:42:04.493+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:42:04.508 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:42:04.517 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:42:04.517 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 20, 2024-09-13T06:42:04.517 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 600, 2024-09-13T06:42:04.518 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [ 2024-09-13T06:42:04.518 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:04.518 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:36160 3.f 3:f62782c2:::rbd_object_map.11219660270d.0000000000000016:head [call] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-13T06:42:04.518 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:01.607291+0000", 2024-09-13T06:42:04.518 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 122.910668917, 2024-09-13T06:42:04.518 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.99619456699999998, 2024-09-13T06:42:04.518 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:04.518 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:04.518 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:04.518 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:04.518 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:04.518 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 36160 2024-09-13T06:42:04.519 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:04.519 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:04.519 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:04.519 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:04.519 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:01.607291+0000", 2024-09-13T06:42:04.519 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:04.519 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:04.519 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:04.519 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:04.519 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:01.607291+0000", 2024-09-13T06:42:04.519 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:04.519 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:04.519 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:04.519 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:04.520 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:01.607289+0000", 2024-09-13T06:42:04.520 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999976 2024-09-13T06:42:04.520 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:04.520 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:04.520 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:04.520 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:01.607302+0000", 2024-09-13T06:42:04.520 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3018e-05 2024-09-13T06:42:04.520 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:04.520 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:04.520 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:04.520 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:01.607323+0000", 2024-09-13T06:42:04.520 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1030999999999999e-05 2024-09-13T06:42:04.520 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:04.521 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:04.521 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:04.521 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:01.607342+0000", 2024-09-13T06:42:04.521 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8961e-05 2024-09-13T06:42:04.521 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:04.521 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:04.521 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:04.521 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:01.607425+0000", 2024-09-13T06:42:04.521 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.3171999999999996e-05 2024-09-13T06:42:04.521 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:04.521 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:04.521 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:42:04.521 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:01.607441+0000", 2024-09-13T06:42:04.522 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5996999999999999e-05 2024-09-13T06:42:04.522 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:04.522 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:04.522 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:04.522 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:02.596186+0000", 2024-09-13T06:42:04.522 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.98874432000000001 2024-09-13T06:42:04.522 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:04.522 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:04.522 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for missing object", 2024-09-13T06:42:04.522 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:02.596618+0000", 2024-09-13T06:42:04.522 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000432032 2024-09-13T06:42:04.522 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:04.522 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:04.522 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:04.523 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:02.600845+0000", 2024-09-13T06:42:04.523 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0042277410000000001 2024-09-13T06:42:04.523 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:04.523 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:04.523 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:04.523 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:02.601003+0000", 2024-09-13T06:42:04.523 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00015731999999999999 2024-09-13T06:42:04.523 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:04.523 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:04.523 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:04.523 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:02.603486+0000", 2024-09-13T06:42:04.523 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0024832510000000001 2024-09-13T06:42:04.523 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:04.523 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:04.524 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:04.524 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:04.524 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:04.524 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:37806 3.9 3:951cb95b:::rbd_data.1121d8143c6e.0000000000000002:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e56)", 2024-09-13T06:42:04.524 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:06.373482+0000", 2024-09-13T06:42:04.524 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 118.144477881, 2024-09-13T06:42:04.524 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.002476213, 2024-09-13T06:42:04.524 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:04.524 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:04.524 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:04.524 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:04.524 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:04.524 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 37806 2024-09-13T06:42:04.525 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:04.525 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:04.525 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:04.525 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:04.525 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.373482+0000", 2024-09-13T06:42:04.525 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:04.525 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:04.525 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:04.525 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:04.525 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.373482+0000", 2024-09-13T06:42:04.525 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:04.525 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:04.525 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:04.525 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:04.526 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.373479+0000", 2024-09-13T06:42:04.526 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999962 2024-09-13T06:42:04.526 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:04.526 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:04.526 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:04.526 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.373495+0000", 2024-09-13T06:42:04.526 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6640999999999999e-05 2024-09-13T06:42:04.526 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:04.526 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:04.526 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:04.526 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.373542+0000", 2024-09-13T06:42:04.526 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6229000000000001e-05 2024-09-13T06:42:04.526 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:04.527 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:04.527 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:04.527 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.373564+0000", 2024-09-13T06:42:04.527 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2684000000000002e-05 2024-09-13T06:42:04.527 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:04.527 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:04.527 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:04.527 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374268+0000", 2024-09-13T06:42:04.527 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00070363700000000001 2024-09-13T06:42:04.527 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:04.527 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:04.527 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:42:04.527 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374305+0000", 2024-09-13T06:42:04.527 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.6936e-05 2024-09-13T06:42:04.528 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:04.528 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:04.528 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:04.528 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.375175+0000", 2024-09-13T06:42:04.528 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.000870454 2024-09-13T06:42:04.528 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:04.528 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:04.528 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:04.528 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.375678+0000", 2024-09-13T06:42:04.528 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00050292499999999999 2024-09-13T06:42:04.528 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:04.528 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:04.528 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:04.529 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.375959+0000", 2024-09-13T06:42:04.529 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00028050599999999997 2024-09-13T06:42:04.529 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:04.529 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:04.529 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:04.529 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:04.529 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:04.529 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:37821 3.9 3:951cb95b:::rbd_data.1121d8143c6e.0000000000000002:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e56)", 2024-09-13T06:42:04.529 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:06.374454+0000", 2024-09-13T06:42:04.529 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 118.14350676399999, 2024-09-13T06:42:04.529 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.002545072, 2024-09-13T06:42:04.529 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:04.529 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:04.529 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:04.530 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:04.530 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:04.530 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 37821 2024-09-13T06:42:04.530 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:04.530 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:04.530 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:04.530 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:04.530 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374454+0000", 2024-09-13T06:42:04.530 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:04.530 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:04.530 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:04.530 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:04.530 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374454+0000", 2024-09-13T06:42:04.530 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:04.531 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:04.531 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:04.531 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:04.531 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374452+0000", 2024-09-13T06:42:04.531 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999981 2024-09-13T06:42:04.531 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:04.531 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:04.531 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:04.531 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374463+0000", 2024-09-13T06:42:04.531 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0756e-05 2024-09-13T06:42:04.531 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:04.531 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:04.531 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:04.531 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374487+0000", 2024-09-13T06:42:04.532 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4887000000000001e-05 2024-09-13T06:42:04.532 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:04.532 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:04.532 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:04.532 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374504+0000", 2024-09-13T06:42:04.532 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6852000000000001e-05 2024-09-13T06:42:04.532 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:04.532 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:04.532 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:04.532 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374829+0000", 2024-09-13T06:42:04.532 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000324684 2024-09-13T06:42:04.532 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:04.532 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:04.533 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:42:04.533 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374880+0000", 2024-09-13T06:42:04.533 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.1378000000000002e-05 2024-09-13T06:42:04.533 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:04.533 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:04.533 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:04.533 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.376423+0000", 2024-09-13T06:42:04.533 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.001542734 2024-09-13T06:42:04.533 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:04.533 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:04.533 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:04.533 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.376607+0000", 2024-09-13T06:42:04.533 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000183656 2024-09-13T06:42:04.533 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:04.534 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:04.534 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:04.534 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.376999+0000", 2024-09-13T06:42:04.534 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00039191200000000001 2024-09-13T06:42:04.534 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:04.534 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:04.534 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:04.534 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:04.534 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:04.534 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:37836 3.9 3:951cb95b:::rbd_data.1121d8143c6e.0000000000000002:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e56)", 2024-09-13T06:42:04.534 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:06.374929+0000", 2024-09-13T06:42:04.534 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 118.143031112, 2024-09-13T06:42:04.534 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.002778825, 2024-09-13T06:42:04.535 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:04.535 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:04.535 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:04.535 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:04.535 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:04.535 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 37836 2024-09-13T06:42:04.535 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:04.535 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:04.535 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:04.535 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:04.535 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374929+0000", 2024-09-13T06:42:04.535 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:04.535 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:04.535 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:04.535 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:04.536 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374929+0000", 2024-09-13T06:42:04.536 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:04.536 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:04.536 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:04.536 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:04.536 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374927+0000", 2024-09-13T06:42:04.536 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999981 2024-09-13T06:42:04.536 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:04.536 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:04.536 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:04.536 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374939+0000", 2024-09-13T06:42:04.536 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1846e-05 2024-09-13T06:42:04.536 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:04.537 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:04.537 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:04.537 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374962+0000", 2024-09-13T06:42:04.537 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3054e-05 2024-09-13T06:42:04.537 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:04.537 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:04.537 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:04.537 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374978+0000", 2024-09-13T06:42:04.537 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5899000000000001e-05 2024-09-13T06:42:04.537 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:04.537 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:04.537 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:04.537 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.375106+0000", 2024-09-13T06:42:04.537 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00012789 2024-09-13T06:42:04.538 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:04.538 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:04.538 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:42:04.538 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.375134+0000", 2024-09-13T06:42:04.538 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.8254000000000001e-05 2024-09-13T06:42:04.538 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:04.538 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:04.538 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:04.538 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.377082+0000", 2024-09-13T06:42:04.538 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0019471520000001 2024-09-13T06:42:04.538 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:04.538 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:04.538 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:04.539 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.377330+0000", 2024-09-13T06:42:04.539 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00024834199999999997 2024-09-13T06:42:04.539 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:04.539 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:04.539 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:04.539 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.377708+0000", 2024-09-13T06:42:04.539 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00037817100000000001 2024-09-13T06:42:04.539 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:04.539 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:04.539 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:04.539 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:04.539 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:04.539 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:37851 3.9 3:951cb95b:::rbd_data.1121d8143c6e.0000000000000002:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e56)", 2024-09-13T06:42:04.540 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:06.382636+0000", 2024-09-13T06:42:04.540 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 118.135324227, 2024-09-13T06:42:04.540 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.99582539400000003, 2024-09-13T06:42:04.540 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:04.540 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:04.540 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:04.540 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:04.540 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:04.540 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 37851 2024-09-13T06:42:04.540 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:04.540 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:04.540 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:04.540 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:04.541 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.382636+0000", 2024-09-13T06:42:04.541 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:04.541 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:04.541 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:04.541 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:04.541 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.382636+0000", 2024-09-13T06:42:04.541 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:04.541 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:04.541 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:04.541 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:04.541 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.382633+0000", 2024-09-13T06:42:04.541 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999971 2024-09-13T06:42:04.541 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:04.541 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:04.542 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:04.542 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.382652+0000", 2024-09-13T06:42:04.542 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8834999999999998e-05 2024-09-13T06:42:04.542 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:04.542 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:04.542 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:04.542 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.382695+0000", 2024-09-13T06:42:04.542 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.3136000000000002e-05 2024-09-13T06:42:04.542 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:04.542 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:04.542 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:04.542 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.382716+0000", 2024-09-13T06:42:04.542 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1421e-05 2024-09-13T06:42:04.542 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:04.543 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:04.543 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:04.543 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.382860+0000", 2024-09-13T06:42:04.543 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00014389200000000001 2024-09-13T06:42:04.543 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:04.543 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:04.543 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:42:04.543 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.382890+0000", 2024-09-13T06:42:04.543 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9827000000000001e-05 2024-09-13T06:42:04.543 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:04.543 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:04.543 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:04.543 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.377779+0000", 2024-09-13T06:42:04.544 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.99488842899999996 2024-09-13T06:42:04.544 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:04.544 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:04.544 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:04.544 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.378007+0000", 2024-09-13T06:42:04.544 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00022838099999999999 2024-09-13T06:42:04.544 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:04.544 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:04.544 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:04.544 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.378462+0000", 2024-09-13T06:42:04.544 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00045452300000000003 2024-09-13T06:42:04.544 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:04.544 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:04.545 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:04.545 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:04.545 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:04.545 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:37866 3.9 3:951cb95b:::rbd_data.1121d8143c6e.0000000000000002:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e56)", 2024-09-13T06:42:04.545 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:06.383951+0000", 2024-09-13T06:42:04.545 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 118.134009541, 2024-09-13T06:42:04.545 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.99517962299999996, 2024-09-13T06:42:04.545 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:04.545 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:04.545 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:04.545 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:04.545 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:04.546 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 37866 2024-09-13T06:42:04.546 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:04.546 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:04.546 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:04.546 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:04.546 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.383951+0000", 2024-09-13T06:42:04.546 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:04.546 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:04.546 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:04.546 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:04.546 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.383951+0000", 2024-09-13T06:42:04.546 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:04.546 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:04.546 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:04.546 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:04.547 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.383949+0000", 2024-09-13T06:42:04.547 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999981 2024-09-13T06:42:04.547 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:04.547 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:04.547 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:04.547 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.383961+0000", 2024-09-13T06:42:04.547 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1999e-05 2024-09-13T06:42:04.547 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:04.547 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:04.547 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:04.547 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384019+0000", 2024-09-13T06:42:04.547 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7621000000000003e-05 2024-09-13T06:42:04.547 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:04.548 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:04.548 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:04.548 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384040+0000", 2024-09-13T06:42:04.548 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1528000000000001e-05 2024-09-13T06:42:04.548 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:04.548 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:04.548 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:04.548 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384186+0000", 2024-09-13T06:42:04.548 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00014573799999999999 2024-09-13T06:42:04.548 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:04.548 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:04.548 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:42:04.548 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384204+0000", 2024-09-13T06:42:04.548 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7992e-05 2024-09-13T06:42:04.549 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:04.549 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:04.549 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:04.549 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.378536+0000", 2024-09-13T06:42:04.549 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.99433268600000002 2024-09-13T06:42:04.549 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:04.549 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:04.549 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:04.549 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.378771+0000", 2024-09-13T06:42:04.549 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00023445399999999999 2024-09-13T06:42:04.549 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:04.549 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:04.549 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:04.549 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.379130+0000", 2024-09-13T06:42:04.550 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00035954200000000002 2024-09-13T06:42:04.550 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:04.550 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:04.550 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:04.550 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:04.550 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:04.550 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:37881 3.9 3:951cb95b:::rbd_data.1121d8143c6e.0000000000000002:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e56)", 2024-09-13T06:42:04.550 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:06.384239+0000", 2024-09-13T06:42:04.550 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 118.133721127, 2024-09-13T06:42:04.550 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.99541483500000005, 2024-09-13T06:42:04.550 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:04.550 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:04.550 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:04.551 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:04.551 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:04.551 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 37881 2024-09-13T06:42:04.551 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:04.551 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:04.551 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:04.551 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:04.551 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384239+0000", 2024-09-13T06:42:04.551 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:04.551 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:04.551 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:04.551 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:04.551 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384239+0000", 2024-09-13T06:42:04.552 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:04.552 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:04.552 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:04.552 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:04.552 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384238+0000", 2024-09-13T06:42:04.552 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999986 2024-09-13T06:42:04.552 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:04.552 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:04.552 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:04.552 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384246+0000", 2024-09-13T06:42:04.552 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.2449999999999998e-06 2024-09-13T06:42:04.552 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:04.552 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:04.553 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:04.553 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384268+0000", 2024-09-13T06:42:04.553 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1518e-05 2024-09-13T06:42:04.553 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:04.553 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:04.553 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:04.553 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384282+0000", 2024-09-13T06:42:04.553 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4501999999999999e-05 2024-09-13T06:42:04.553 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:04.553 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:04.553 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:04.553 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384356+0000", 2024-09-13T06:42:04.553 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4265999999999997e-05 2024-09-13T06:42:04.553 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:04.554 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:04.554 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:42:04.554 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384370+0000", 2024-09-13T06:42:04.554 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3942e-05 2024-09-13T06:42:04.554 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:04.554 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:04.554 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:04.554 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.379199+0000", 2024-09-13T06:42:04.554 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.99482866599999997 2024-09-13T06:42:04.554 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:04.554 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:04.554 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:04.554 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.379347+0000", 2024-09-13T06:42:04.554 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00014749199999999999 2024-09-13T06:42:04.555 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:04.555 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:04.555 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:04.555 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.379654+0000", 2024-09-13T06:42:04.555 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00030752999999999998 2024-09-13T06:42:04.555 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:04.555 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:04.555 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:04.555 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:04.555 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:04.555 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:37896 3.9 3:951cb95b:::rbd_data.1121d8143c6e.0000000000000002:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e56)", 2024-09-13T06:42:04.555 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:06.384412+0000", 2024-09-13T06:42:04.555 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 118.133548694, 2024-09-13T06:42:04.556 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.99777835999999998, 2024-09-13T06:42:04.556 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:04.556 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:04.556 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:04.556 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:04.556 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:04.556 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 37896 2024-09-13T06:42:04.556 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:04.556 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:04.556 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:04.556 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:04.556 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384412+0000", 2024-09-13T06:42:04.556 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:04.556 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:04.557 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:04.557 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:04.557 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384412+0000", 2024-09-13T06:42:04.557 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:04.557 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:04.557 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:04.557 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:04.557 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384410+0000", 2024-09-13T06:42:04.557 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.999999 2024-09-13T06:42:04.557 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:04.557 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:04.557 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:04.557 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384418+0000", 2024-09-13T06:42:04.557 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.486e-06 2024-09-13T06:42:04.558 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:04.558 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:04.558 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:04.558 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384436+0000", 2024-09-13T06:42:04.558 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7668000000000001e-05 2024-09-13T06:42:04.558 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:04.558 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:04.558 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:04.558 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384449+0000", 2024-09-13T06:42:04.558 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3395e-05 2024-09-13T06:42:04.558 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:04.558 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:04.558 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:04.558 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384605+0000", 2024-09-13T06:42:04.559 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00015563099999999999 2024-09-13T06:42:04.559 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:04.559 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:04.559 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:42:04.559 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384635+0000", 2024-09-13T06:42:04.559 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.0383999999999999e-05 2024-09-13T06:42:04.559 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:04.559 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:04.559 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:04.559 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.379730+0000", 2024-09-13T06:42:04.559 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.99509493999999998 2024-09-13T06:42:04.559 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:04.559 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:04.559 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:04.560 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.379964+0000", 2024-09-13T06:42:04.560 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00023353499999999999 2024-09-13T06:42:04.560 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:04.560 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:04.560 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:04.560 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.382190+0000", 2024-09-13T06:42:04.560 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0022265039999999998 2024-09-13T06:42:04.560 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:04.560 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:04.560 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:04.560 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:04.560 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:04.560 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43222 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 389120~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:42:04.561 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558181+0000", 2024-09-13T06:42:04.561 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 102.95977944000001, 2024-09-13T06:42:04.561 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.06252038, 2024-09-13T06:42:04.561 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:04.561 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:04.561 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:04.561 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:04.561 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:04.561 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43222 2024-09-13T06:42:04.561 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:04.561 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:04.561 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:04.562 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:04.562 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558181+0000", 2024-09-13T06:42:04.562 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:04.562 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:04.562 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:04.562 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:04.562 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558181+0000", 2024-09-13T06:42:04.562 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:04.562 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:04.562 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:04.562 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:04.562 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558181+0000", 2024-09-13T06:42:04.562 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:04.562 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:04.563 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:04.563 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:04.563 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558183+0000", 2024-09-13T06:42:04.563 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.857e-06 2024-09-13T06:42:04.563 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:04.563 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:04.563 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:04.563 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558188+0000", 2024-09-13T06:42:04.563 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3759999999999999e-06 2024-09-13T06:42:04.563 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:04.563 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:04.563 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:04.563 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558261+0000", 2024-09-13T06:42:04.564 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3097999999999997e-05 2024-09-13T06:42:04.564 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:04.564 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:04.564 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:04.564 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.620354+0000", 2024-09-13T06:42:04.564 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.062092587999999997 2024-09-13T06:42:04.564 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:04.564 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:04.564 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:04.564 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.620428+0000", 2024-09-13T06:42:04.564 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3954000000000004e-05 2024-09-13T06:42:04.564 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:04.564 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:04.565 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:04.565 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.620701+0000", 2024-09-13T06:42:04.565 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000273773 2024-09-13T06:42:04.565 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:04.565 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:04.565 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:04.565 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:04.565 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:04.565 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43223 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 393216~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:42:04.565 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558267+0000", 2024-09-13T06:42:04.565 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 102.959693383, 2024-09-13T06:42:04.565 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.062813151999999997, 2024-09-13T06:42:04.565 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:04.565 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:04.565 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:04.565 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:04.566 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:04.566 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43223 2024-09-13T06:42:04.566 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:04.566 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:04.566 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:04.566 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:04.566 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558267+0000", 2024-09-13T06:42:04.566 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:04.566 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:04.566 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:04.566 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:04.566 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558267+0000", 2024-09-13T06:42:04.566 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:04.566 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:04.567 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:04.567 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:04.567 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558266+0000", 2024-09-13T06:42:04.567 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:04.567 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:04.567 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:04.567 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:04.567 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558270+0000", 2024-09-13T06:42:04.567 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.2389999999999998e-06 2024-09-13T06:42:04.567 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:04.567 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:04.567 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:04.567 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558277+0000", 2024-09-13T06:42:04.568 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5680000000000002e-06 2024-09-13T06:42:04.568 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:04.568 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:04.568 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:04.568 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558282+0000", 2024-09-13T06:42:04.568 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7060000000000003e-06 2024-09-13T06:42:04.568 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:04.568 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:04.568 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:04.568 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.620731+0000", 2024-09-13T06:42:04.568 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.062448661000000003 2024-09-13T06:42:04.568 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:04.568 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:04.568 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:04.569 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.620806+0000", 2024-09-13T06:42:04.569 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5862e-05 2024-09-13T06:42:04.569 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:04.569 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:04.569 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:04.569 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.621080+0000", 2024-09-13T06:42:04.569 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00027368599999999998 2024-09-13T06:42:04.569 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:04.569 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:04.569 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:04.569 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:04.569 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:04.569 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43224 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 407552~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:42:04.570 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558286+0000", 2024-09-13T06:42:04.570 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 102.959674019, 2024-09-13T06:42:04.570 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.063179052999999999, 2024-09-13T06:42:04.570 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:04.570 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:04.570 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:04.570 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:04.570 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:04.570 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43224 2024-09-13T06:42:04.570 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:04.570 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:04.570 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:04.570 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:04.571 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558286+0000", 2024-09-13T06:42:04.571 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:04.571 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:04.571 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:04.571 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:04.571 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558286+0000", 2024-09-13T06:42:04.571 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:04.571 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:04.571 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:04.571 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:04.571 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558286+0000", 2024-09-13T06:42:04.571 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:04.571 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:04.572 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:04.572 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:04.572 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558288+0000", 2024-09-13T06:42:04.572 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.227e-06 2024-09-13T06:42:04.572 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:04.572 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:04.572 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:04.572 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558292+0000", 2024-09-13T06:42:04.572 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.6289999999999999e-06 2024-09-13T06:42:04.572 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:04.572 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:04.572 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:04.572 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558294+0000", 2024-09-13T06:42:04.572 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5409999999999999e-06 2024-09-13T06:42:04.573 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:04.573 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:04.573 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:04.573 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.621110+0000", 2024-09-13T06:42:04.573 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.062815776000000004 2024-09-13T06:42:04.573 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:04.573 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:04.573 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:04.573 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.621186+0000", 2024-09-13T06:42:04.573 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5570999999999999e-05 2024-09-13T06:42:04.573 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:04.573 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:04.573 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:04.573 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.621465+0000", 2024-09-13T06:42:04.573 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00027988200000000001 2024-09-13T06:42:04.574 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:04.574 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:04.574 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:04.574 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:04.574 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:04.574 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43225 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 421888~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:42:04.574 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558296+0000", 2024-09-13T06:42:04.574 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 102.95966405199999, 2024-09-13T06:42:04.574 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.063551110999999993, 2024-09-13T06:42:04.574 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:04.574 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:04.574 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:04.575 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:04.575 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:04.575 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43225 2024-09-13T06:42:04.575 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:04.575 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:04.575 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:04.575 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:04.575 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558296+0000", 2024-09-13T06:42:04.575 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:04.575 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:04.575 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:04.575 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:04.575 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558296+0000", 2024-09-13T06:42:04.575 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:04.576 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:04.576 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:04.576 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:04.576 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558296+0000", 2024-09-13T06:42:04.576 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:42:04.576 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:04.576 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:04.576 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:04.576 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558305+0000", 2024-09-13T06:42:04.576 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.5290000000000008e-06 2024-09-13T06:42:04.576 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:04.576 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:04.576 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:04.577 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558308+0000", 2024-09-13T06:42:04.577 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.5619999999999999e-06 2024-09-13T06:42:04.577 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:04.577 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:04.577 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:04.577 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558311+0000", 2024-09-13T06:42:04.577 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.43e-06 2024-09-13T06:42:04.577 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:04.577 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:04.577 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:04.577 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.621495+0000", 2024-09-13T06:42:04.577 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.063184289000000005 2024-09-13T06:42:04.577 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:04.578 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:04.578 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:04.578 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.621569+0000", 2024-09-13T06:42:04.578 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4250000000000002e-05 2024-09-13T06:42:04.578 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:04.578 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:04.578 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:04.578 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.621847+0000", 2024-09-13T06:42:04.578 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00027826400000000002 2024-09-13T06:42:04.578 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:04.578 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:04.578 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:04.578 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:04.578 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:04.579 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43226 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 436224~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:42:04.579 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558313+0000", 2024-09-13T06:42:04.579 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 102.959647416, 2024-09-13T06:42:04.579 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.063914420999999999, 2024-09-13T06:42:04.579 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:04.579 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:04.579 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:04.579 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:04.579 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:04.579 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43226 2024-09-13T06:42:04.579 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:04.579 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:04.579 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:04.580 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:04.580 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558313+0000", 2024-09-13T06:42:04.580 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:04.580 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:04.580 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:04.580 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:04.580 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558313+0000", 2024-09-13T06:42:04.580 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:04.580 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:04.580 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:04.580 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:04.580 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558313+0000", 2024-09-13T06:42:04.580 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:04.581 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:04.581 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:04.581 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:04.581 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558314+0000", 2024-09-13T06:42:04.581 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3740000000000001e-06 2024-09-13T06:42:04.581 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:04.581 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:04.581 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:04.581 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558317+0000", 2024-09-13T06:42:04.581 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9730000000000002e-06 2024-09-13T06:42:04.581 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:04.581 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:04.581 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:04.581 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558319+0000", 2024-09-13T06:42:04.582 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4059999999999999e-06 2024-09-13T06:42:04.582 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:04.582 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:04.582 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:04.582 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.621877+0000", 2024-09-13T06:42:04.582 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.063557408999999995 2024-09-13T06:42:04.582 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:04.582 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:04.582 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:04.582 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.621951+0000", 2024-09-13T06:42:04.582 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4487999999999996e-05 2024-09-13T06:42:04.582 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:04.582 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:04.583 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:04.583 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.622227+0000", 2024-09-13T06:42:04.583 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000276011 2024-09-13T06:42:04.583 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:04.583 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:04.583 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:04.583 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:04.583 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:04.583 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43227 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 450560~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:42:04.583 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558322+0000", 2024-09-13T06:42:04.583 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 102.95963883500001, 2024-09-13T06:42:04.583 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.064285348000000006, 2024-09-13T06:42:04.583 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:04.583 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:04.584 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:04.584 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:04.584 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:04.584 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43227 2024-09-13T06:42:04.584 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:04.584 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:04.584 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:04.584 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:04.584 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558322+0000", 2024-09-13T06:42:04.584 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:04.584 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:04.584 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:04.584 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:04.585 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558322+0000", 2024-09-13T06:42:04.585 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:04.585 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:04.585 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:04.585 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:04.585 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558321+0000", 2024-09-13T06:42:04.585 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:42:04.585 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:04.585 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:04.585 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:04.585 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558323+0000", 2024-09-13T06:42:04.585 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.576e-06 2024-09-13T06:42:04.585 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:04.586 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:04.586 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:04.586 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558328+0000", 2024-09-13T06:42:04.586 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0719999999999999e-06 2024-09-13T06:42:04.586 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:04.586 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:04.586 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:04.586 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558332+0000", 2024-09-13T06:42:04.586 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.8130000000000002e-06 2024-09-13T06:42:04.586 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:04.586 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:04.586 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:04.586 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.622255+0000", 2024-09-13T06:42:04.586 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.063923195000000002 2024-09-13T06:42:04.587 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:04.587 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:04.587 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:04.587 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.622330+0000", 2024-09-13T06:42:04.587 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5383000000000007e-05 2024-09-13T06:42:04.587 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:04.587 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:04.587 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:04.587 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.622607+0000", 2024-09-13T06:42:04.587 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00027651999999999999 2024-09-13T06:42:04.587 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:04.587 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:04.587 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:04.587 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:04.588 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:04.588 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43228 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 464896~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:42:04.588 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558335+0000", 2024-09-13T06:42:04.588 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 102.959624926, 2024-09-13T06:42:04.588 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.064652253000000007, 2024-09-13T06:42:04.588 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:04.588 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:04.588 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:04.588 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:04.588 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:04.588 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43228 2024-09-13T06:42:04.588 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:04.588 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:04.588 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:04.589 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:04.589 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558335+0000", 2024-09-13T06:42:04.589 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:04.589 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:04.589 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:04.589 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:04.589 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558335+0000", 2024-09-13T06:42:04.589 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:04.589 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:04.589 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:04.589 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:04.589 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558335+0000", 2024-09-13T06:42:04.589 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:04.590 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:04.590 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:04.590 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:04.590 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558337+0000", 2024-09-13T06:42:04.590 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1380000000000001e-06 2024-09-13T06:42:04.590 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:04.590 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:04.590 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:04.590 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558343+0000", 2024-09-13T06:42:04.590 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.5140000000000001e-06 2024-09-13T06:42:04.590 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:04.590 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:04.590 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:04.590 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558348+0000", 2024-09-13T06:42:04.591 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9640000000000002e-06 2024-09-13T06:42:04.591 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:04.591 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:04.591 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:04.591 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.622636+0000", 2024-09-13T06:42:04.591 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.064288260999999999 2024-09-13T06:42:04.591 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:04.591 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:04.591 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:04.591 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.622715+0000", 2024-09-13T06:42:04.591 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.9351000000000006e-05 2024-09-13T06:42:04.591 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:04.591 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:04.592 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:04.592 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.622988+0000", 2024-09-13T06:42:04.592 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00027242599999999998 2024-09-13T06:42:04.592 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:04.592 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:04.592 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:04.592 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:04.592 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:04.592 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43229 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 479232~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:42:04.592 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558352+0000", 2024-09-13T06:42:04.592 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 102.959608511, 2024-09-13T06:42:04.592 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.065018024999999993, 2024-09-13T06:42:04.592 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:04.593 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:04.593 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:04.593 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:04.593 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:04.593 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43229 2024-09-13T06:42:04.593 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:04.593 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:04.593 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:04.593 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:04.593 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558352+0000", 2024-09-13T06:42:04.593 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:04.593 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:04.593 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:04.594 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:04.594 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558352+0000", 2024-09-13T06:42:04.594 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:04.594 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:04.594 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:04.594 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:04.594 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558352+0000", 2024-09-13T06:42:04.594 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:04.594 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:04.594 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:04.594 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:04.594 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558354+0000", 2024-09-13T06:42:04.594 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4930000000000001e-06 2024-09-13T06:42:04.594 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:04.595 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:04.595 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:04.595 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558360+0000", 2024-09-13T06:42:04.595 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.263e-06 2024-09-13T06:42:04.595 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:04.595 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:04.595 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:04.595 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558369+0000", 2024-09-13T06:42:04.595 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.0829999999999993e-06 2024-09-13T06:42:04.595 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:04.595 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:04.595 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:04.595 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.623017+0000", 2024-09-13T06:42:04.595 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.064647799000000006 2024-09-13T06:42:04.596 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:04.596 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:04.596 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:04.596 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.623090+0000", 2024-09-13T06:42:04.596 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3071000000000006e-05 2024-09-13T06:42:04.596 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:04.596 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:04.596 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:04.596 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.623370+0000", 2024-09-13T06:42:04.596 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000279661 2024-09-13T06:42:04.596 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:04.596 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:04.597 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:04.597 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:04.597 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:04.597 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43230 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 493568~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:42:04.597 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558374+0000", 2024-09-13T06:42:04.597 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 102.959586218, 2024-09-13T06:42:04.597 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.065410435000000003, 2024-09-13T06:42:04.597 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:04.597 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:04.597 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:04.597 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:04.597 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:04.597 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43230 2024-09-13T06:42:04.597 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:04.598 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:04.598 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:04.598 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:04.598 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558374+0000", 2024-09-13T06:42:04.598 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:04.598 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:04.598 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:04.598 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:04.598 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558374+0000", 2024-09-13T06:42:04.598 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:04.598 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:04.598 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:04.598 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:04.598 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558374+0000", 2024-09-13T06:42:04.598 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:04.599 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:04.599 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:04.599 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:04.599 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558376+0000", 2024-09-13T06:42:04.599 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4430000000000002e-06 2024-09-13T06:42:04.599 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:04.599 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:04.599 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:04.599 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558382+0000", 2024-09-13T06:42:04.599 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3029999999999996e-06 2024-09-13T06:42:04.599 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:04.599 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:04.599 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:04.600 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558387+0000", 2024-09-13T06:42:04.600 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.1699999999999999e-06 2024-09-13T06:42:04.600 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:04.600 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:04.600 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:04.600 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.623400+0000", 2024-09-13T06:42:04.600 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.065013244999999997 2024-09-13T06:42:04.600 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:04.600 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:04.600 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:04.600 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.623474+0000", 2024-09-13T06:42:04.600 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3889999999999999e-05 2024-09-13T06:42:04.600 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:04.601 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:04.601 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:04.601 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.623785+0000", 2024-09-13T06:42:04.601 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00031080099999999998 2024-09-13T06:42:04.601 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:04.601 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:04.601 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:04.601 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:04.601 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:04.601 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43231 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 507904~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:42:04.601 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558391+0000", 2024-09-13T06:42:04.601 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 102.95956953300001, 2024-09-13T06:42:04.601 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.065788597000000004, 2024-09-13T06:42:04.601 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:04.602 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:04.602 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:04.602 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:04.602 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:04.602 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43231 2024-09-13T06:42:04.602 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:04.602 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:04.602 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:04.602 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:04.602 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558391+0000", 2024-09-13T06:42:04.602 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:04.602 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:04.602 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:04.603 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:04.603 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558391+0000", 2024-09-13T06:42:04.603 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:04.603 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:04.603 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:04.603 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:04.603 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558390+0000", 2024-09-13T06:42:04.603 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:04.603 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:04.603 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:04.603 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:04.603 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558393+0000", 2024-09-13T06:42:04.603 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2570000000000002e-06 2024-09-13T06:42:04.603 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:04.604 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:04.604 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:04.604 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558399+0000", 2024-09-13T06:42:04.604 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0419999999999999e-06 2024-09-13T06:42:04.604 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:04.604 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:04.604 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:04.604 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558403+0000", 2024-09-13T06:42:04.604 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6249999999999998e-06 2024-09-13T06:42:04.604 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:04.604 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:04.604 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:04.604 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.623811+0000", 2024-09-13T06:42:04.604 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.065407549999999995 2024-09-13T06:42:04.605 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:04.605 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:04.605 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:04.605 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.623877+0000", 2024-09-13T06:42:04.605 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.5902999999999996e-05 2024-09-13T06:42:04.605 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:04.605 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:04.605 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:04.605 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.624179+0000", 2024-09-13T06:42:04.605 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00030259999999999998 2024-09-13T06:42:04.605 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:04.605 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:04.605 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:04.606 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:04.606 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:04.606 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43232 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 522240~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:42:04.606 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558422+0000", 2024-09-13T06:42:04.606 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 102.959538756, 2024-09-13T06:42:04.606 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.066176061999999994, 2024-09-13T06:42:04.606 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:04.606 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:04.606 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:04.606 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:04.606 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:04.606 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43232 2024-09-13T06:42:04.606 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:04.606 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:04.606 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:04.607 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:04.607 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558422+0000", 2024-09-13T06:42:04.607 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:04.607 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:04.607 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:04.607 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:04.607 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558422+0000", 2024-09-13T06:42:04.607 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:04.607 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:04.607 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:04.607 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:04.607 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558421+0000", 2024-09-13T06:42:04.607 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:04.607 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:04.608 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:04.608 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:04.608 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558428+0000", 2024-09-13T06:42:04.608 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.1690000000000003e-06 2024-09-13T06:42:04.608 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:04.608 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:04.608 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:04.608 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558434+0000", 2024-09-13T06:42:04.608 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9309999999999996e-06 2024-09-13T06:42:04.608 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:04.608 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:04.608 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:04.608 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558447+0000", 2024-09-13T06:42:04.608 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.271e-05 2024-09-13T06:42:04.609 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:04.609 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:04.609 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:04.609 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.624209+0000", 2024-09-13T06:42:04.609 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.065762102000000003 2024-09-13T06:42:04.609 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:04.609 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:04.609 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:04.609 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.624282+0000", 2024-09-13T06:42:04.609 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.2889e-05 2024-09-13T06:42:04.609 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:04.609 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:04.609 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:04.610 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.624598+0000", 2024-09-13T06:42:04.610 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00031591399999999998 2024-09-13T06:42:04.610 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:04.610 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:04.610 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:04.610 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:04.610 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:04.610 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43486 3.f 3:f7da9c8f:::rbd_data.1121f5f2e1c0.000000000000000b:1f [read 260096~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:42:04.610 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.569088+0000", 2024-09-13T06:42:04.610 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 102.948872033, 2024-09-13T06:42:04.610 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.062579223000000003, 2024-09-13T06:42:04.610 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:04.610 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:04.611 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:04.611 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:04.611 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:04.611 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43486 2024-09-13T06:42:04.611 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:04.611 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:04.611 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:04.611 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:04.611 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.569088+0000", 2024-09-13T06:42:04.611 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:04.611 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:04.611 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:04.612 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:04.612 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.569088+0000", 2024-09-13T06:42:04.612 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:04.612 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:04.612 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:04.612 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:04.612 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.569088+0000", 2024-09-13T06:42:04.612 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:04.612 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:04.612 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:04.612 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:04.612 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.569091+0000", 2024-09-13T06:42:04.612 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9629999999999998e-06 2024-09-13T06:42:04.612 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:04.613 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:04.613 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:04.613 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.569097+0000", 2024-09-13T06:42:04.613 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.4160000000000001e-06 2024-09-13T06:42:04.613 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:04.613 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:04.613 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:04.613 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.569102+0000", 2024-09-13T06:42:04.613 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6659999999999999e-06 2024-09-13T06:42:04.613 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:04.613 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:04.613 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:04.613 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.631346+0000", 2024-09-13T06:42:04.614 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.062243896 2024-09-13T06:42:04.614 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:04.614 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:04.614 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:04.614 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.631413+0000", 2024-09-13T06:42:04.614 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.7638000000000005e-05 2024-09-13T06:42:04.614 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:04.614 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:04.614 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:04.614 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.631668+0000", 2024-09-13T06:42:04.614 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0002541 2024-09-13T06:42:04.614 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:04.614 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:04.614 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:04.615 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:04.615 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:04.615 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:42:04.615 INFO:teuthology.orchestra.run.smithi081.stdout:4344 write 0xafee276 thru 0xaffa549 (0xc2d4 bytes) 2024-09-13T06:42:04.617 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-13T06:42:04.617 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:42:04.618 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:42:04.618 INFO:teuthology.orchestra.run.smithi081.stdout:4349 trunc from 0xaffa54a to 0x96cb252 2024-09-13T06:42:04.618 INFO:teuthology.orchestra.run.smithi081.stdout:4351 read 0x260fa6f thru 0x261aa59 (0xafeb bytes) 2024-09-13T06:42:04.618 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:42:04.618 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:42:04.618 INFO:teuthology.orchestra.run.smithi081.stdout:4356 punch from 0x7cd22fb to 0x7cd6280, (0x3f85 bytes) 2024-09-13T06:42:04.618 INFO:teuthology.orchestra.run.smithi081.stdout:4358 write 0x7b0cccb thru 0x7b1281b (0x5b51 bytes) 2024-09-13T06:42:04.618 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:42:04.618 INFO:teuthology.orchestra.run.smithi081.stdout:4363 trunc from 0x96cb252 to 0x3040c72 2024-09-13T06:42:04.619 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-13T06:42:04.613+0000 7fcdeb9fe640 -1 mon.a@0(leader).osd e163 definitely_dead 0 2024-09-13T06:42:04.619 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:42:04.613+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:42:04.637 INFO:teuthology.orchestra.run.smithi081.stdout:4366 write 0x3ec073d thru 0x3ec5a2e (0x52f2 bytes) 2024-09-13T06:42:04.651 INFO:teuthology.orchestra.run.smithi081.stdout:4367 read 0xe96235 thru 0xea0281 (0xa04d bytes) 2024-09-13T06:42:04.652 INFO:teuthology.orchestra.run.smithi081.stdout:4368 punch from 0x2fa8a23 to 0x2fb4775, (0xbd52 bytes) 2024-09-13T06:42:04.653 INFO:teuthology.orchestra.run.smithi081.stdout:4371 trunc from 0x3ec5a2f to 0x29b0f10 2024-09-13T06:42:04.675 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:42:04.675 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:42:04.675 INFO:teuthology.orchestra.run.smithi081.stdout:4376 punch from 0xe6b54f to 0xe711fa, (0x5cab bytes) 2024-09-13T06:42:04.676 INFO:teuthology.orchestra.run.smithi081.stdout:4377 trunc from 0x29b0f10 to 0x3ca7e4a 2024-09-13T06:42:04.688 INFO:teuthology.orchestra.run.smithi081.stdout:4379 read 0x283a835 thru 0x283ac69 (0x435 bytes) 2024-09-13T06:42:04.701 INFO:teuthology.orchestra.run.smithi081.stdout:4380 write 0x4c9ae5f thru 0x4ca1174 (0x6316 bytes) 2024-09-13T06:42:04.717 INFO:teuthology.orchestra.run.smithi081.stdout:4381 trunc from 0x4ca1175 to 0x493ba26 2024-09-13T06:42:04.717 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:42:04.713+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:42:04.738 INFO:teuthology.orchestra.run.smithi081.stdout:4382 write 0x426ee71 thru 0x427691c (0x7aac bytes) 2024-09-13T06:42:04.753 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:42:04.753 INFO:teuthology.orchestra.run.smithi081.stdout:4385 read 0x977338 thru 0x9847e8 (0xd4b1 bytes) 2024-09-13T06:42:04.754 INFO:teuthology.orchestra.run.smithi081.stdout:4386 punch from 0x25fc913 to 0x26097df, (0xcecc bytes) 2024-09-13T06:42:04.766 INFO:teuthology.orchestra.run.smithi081.stderr:marked out osd.4. 2024-09-13T06:42:04.771 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:42:04.772 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-13T06:42:04.772 INFO:teuthology.orchestra.run.smithi081.stdout: "num_ops": 0 2024-09-13T06:42:04.772 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:42:04.774 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-13T06:42:04.787 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-13T06:42:04.834 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:42:04.833+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:42:04.849 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-13T06:42:04.930 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:42:04.929+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:42:04.955 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:42:04.955 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-13T06:42:04.955 INFO:teuthology.orchestra.run.smithi081.stdout: "complaint_time": 30, 2024-09-13T06:42:04.955 INFO:teuthology.orchestra.run.smithi081.stdout: "num_blocked_ops": 0 2024-09-13T06:42:04.955 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:42:04.968 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-13T06:42:05.012 INFO:teuthology.orchestra.run.smithi081.stdout:osd.0: {} 2024-09-13T06:42:05.013 INFO:teuthology.orchestra.run.smithi081.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-13T06:42:05.019 INFO:tasks.ceph.osd.6.smithi139.stderr:2024-09-13T06:42:05.013+0000 7fcd02c5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26385) UID: 0 2024-09-13T06:42:05.028 INFO:teuthology.orchestra.run.smithi081.stdout:osd.1: {} 2024-09-13T06:42:05.029 INFO:teuthology.orchestra.run.smithi081.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-13T06:42:05.044 INFO:teuthology.orchestra.run.smithi081.stdout:osd.2: {} 2024-09-13T06:42:05.045 INFO:teuthology.orchestra.run.smithi081.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-13T06:42:05.060 INFO:teuthology.orchestra.run.smithi081.stdout:osd.3: {} 2024-09-13T06:42:05.060 INFO:teuthology.orchestra.run.smithi081.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-13T06:42:05.080 INFO:teuthology.orchestra.run.smithi081.stdout:osd.4: {} 2024-09-13T06:42:05.080 INFO:teuthology.orchestra.run.smithi081.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-13T06:42:05.099 INFO:teuthology.orchestra.run.smithi081.stdout:osd.5: {} 2024-09-13T06:42:05.100 INFO:teuthology.orchestra.run.smithi081.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-13T06:42:05.119 INFO:teuthology.orchestra.run.smithi081.stdout:osd.6: {} 2024-09-13T06:42:05.120 INFO:teuthology.orchestra.run.smithi081.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-13T06:42:05.120 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:42:05.120 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:42:05.121 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:42:05.117+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:42:05.121 INFO:teuthology.orchestra.run.smithi081.stderr:Error ENXIO: problem getting command descriptions from osd.7 2024-09-13T06:42:05.123 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-13T06:42:05.124 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-13T06:42:05.134 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-13T06:42:05.221 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:42:05.217+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:42:05.264 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:42:05.264 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:42:05.280 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-13T06:42:05.322 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:42:05.321+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:42:05.404 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:42:05.404 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:42:05.419 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-13T06:42:05.465 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:42:05.461+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:42:05.524 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:42:05.521+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:42:05.536 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:42:05.536 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:42:05.550 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-13T06:42:05.624 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:42:05.621+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:42:05.713 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:42:05.714 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:42:05.725 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:42:05.721+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:42:05.728 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-13T06:42:05.768 INFO:teuthology.orchestra.run.smithi081.stderr:nodeep-scrub is set 2024-09-13T06:42:05.825 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:42:05.821+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:42:05.892 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:42:05.892 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:42:05.906 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-13T06:42:05.953 INFO:tasks.ceph.osd.6.smithi139.stderr:2024-09-13T06:42:05.949+0000 7fcd02c5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26385) UID: 0 2024-09-13T06:42:06.027 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:42:06.029+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:42:06.078 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:42:06.078 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:42:06.093 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-13T06:42:06.129 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:42:06.125+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:42:06.217 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:42:06.217 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:42:06.230 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:42:06.225+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:42:06.232 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-13T06:42:06.331 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:42:06.329+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:42:06.353 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:42:06.354 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:42:06.368 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-13T06:42:06.432 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:42:06.425+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:42:06.488 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:42:06.488 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:42:06.502 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-13T06:42:06.549 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:42:06.545+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:42:06.633 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:42:06.633 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:42:06.634 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:42:06.629+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:42:06.648 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-13T06:42:06.738 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:42:06.737+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:42:06.826 INFO:teuthology.orchestra.run.smithi081.stdout:4388 write 0x704ea7d thru 0x705c836 (0xddba bytes) 2024-09-13T06:42:06.832 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:42:06.833 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:42:06.836 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:42:06.833+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:42:06.855 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-13T06:42:06.859 INFO:teuthology.orchestra.run.smithi081.stdout:4390 write 0x824825b thru 0x8255122 (0xcec8 bytes) 2024-09-13T06:42:06.875 INFO:teuthology.orchestra.run.smithi081.stdout:4392 read 0x811ae02 thru 0x811e71c (0x391b bytes) 2024-09-13T06:42:06.883 INFO:teuthology.orchestra.run.smithi081.stdout:4393 trunc from 0x8255123 to 0x39de121 2024-09-13T06:42:06.927 INFO:teuthology.orchestra.run.smithi081.stdout:4394 writesame 0x5e65271 thru 0x5e73bb1 data_size 0x1(0xe941 bytes) 2024-09-13T06:42:06.933 INFO:teuthology.orchestra.run.smithi081.stdout:4395 trunc from 0x5e73bb2 to 0x9cdbeee 2024-09-13T06:42:06.937 INFO:tasks.ceph.osd.6.smithi139.stderr:2024-09-13T06:42:06.933+0000 7fcd02c5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26385) UID: 0 2024-09-13T06:42:06.946 INFO:teuthology.orchestra.run.smithi081.stdout:4398 writesame 0x506e5b6 thru 0x507dc9b data_size 0x22(0xf6e6 bytes) 2024-09-13T06:42:06.962 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:42:06.962 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:42:06.968 INFO:teuthology.orchestra.run.smithi081.stdout:4404 trunc from 0x9cdbeee to 0xdf64c07 2024-09-13T06:42:06.982 INFO:teuthology.orchestra.run.smithi081.stdout:4405 punch from 0x1cbd538 to 0x1cc750e, (0x9fd6 bytes) 2024-09-13T06:42:06.988 INFO:teuthology.orchestra.run.smithi081.stdout:4408 trunc from 0xdf64c07 to 0x9a82485 2024-09-13T06:42:07.002 INFO:teuthology.orchestra.run.smithi081.stdout:4409 read 0x6d0d96c thru 0x6d1bb51 (0xe1e6 bytes) 2024-09-13T06:42:07.002 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:42:07.003 INFO:teuthology.orchestra.run.smithi081.stdout:4411 read 0x402bde5 thru 0x402edcb (0x2fe7 bytes) 2024-09-13T06:42:07.003 INFO:teuthology.orchestra.run.smithi081.stdout:4413 punch from 0x806d3db to 0x8077062, (0x9c87 bytes) 2024-09-13T06:42:07.014 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:42:07.015 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:42:07.016 INFO:teuthology.orchestra.run.smithi081.stdout:4414 writesame 0xa564ba1 thru 0xa567e2d data_size 0x1(0x328d bytes) 2024-09-13T06:42:07.016 INFO:teuthology.orchestra.run.smithi081.stdout:4416 write 0x6a8e18a thru 0x6a94dcc (0x6c43 bytes) 2024-09-13T06:42:07.035 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-13T06:42:07.036 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:42:07.037 INFO:teuthology.orchestra.run.smithi081.stdout:4418 write 0x8337113 thru 0x83416da (0xa5c8 bytes) 2024-09-13T06:42:07.038 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:42:07.037+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:42:07.052 INFO:teuthology.orchestra.run.smithi081.stdout:4421 read 0x987576a thru 0x9883d42 (0xe5d9 bytes) 2024-09-13T06:42:07.056 INFO:teuthology.orchestra.run.smithi081.stdout:4422 trunc from 0xa567e2e to 0x7a6ab3e 2024-09-13T06:42:07.083 INFO:teuthology.orchestra.run.smithi081.stdout:4423 writesame 0x44dc495 thru 0x44e73e3 data_size 0x1(0xaf4f bytes) 2024-09-13T06:42:07.110 INFO:teuthology.orchestra.run.smithi081.stdout:4424 punch from 0x32f11ba to 0x32faa85, (0x98cb bytes) 2024-09-13T06:42:07.110 INFO:teuthology.orchestra.run.smithi081.stdout:4425 read 0x6187e21 thru 0x618f5c6 (0x77a6 bytes) 2024-09-13T06:42:07.110 INFO:teuthology.orchestra.run.smithi081.stdout:4426 write 0x73ea5d6 thru 0x73f69ea (0xc415 bytes) 2024-09-13T06:42:07.125 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-13T06:42:07.127 INFO:teuthology.orchestra.run.smithi081.stdout:4427 trunc from 0x7a6ab3e to 0x7dfbe38 2024-09-13T06:42:07.137 INFO:teuthology.orchestra.run.smithi081.stdout:4430 read 0x5bb3033 thru 0x5bbdf31 (0xaeff bytes) 2024-09-13T06:42:07.137 INFO:teuthology.orchestra.run.smithi081.stdout:4432 read 0x2c57be5 thru 0x2c582ea (0x706 bytes) 2024-09-13T06:42:07.137 INFO:teuthology.orchestra.run.smithi081.stdout:4433 writesame 0x5cdc573 thru 0x5ce41eb data_size 0x1(0x7c79 bytes) 2024-09-13T06:42:07.140 INFO:tasks.ceph.osd.6.smithi139.stderr:2024-09-13T06:42:07.133+0000 7fcd02c5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26385) UID: 0 2024-09-13T06:42:07.162 INFO:teuthology.orchestra.run.smithi081.stdout:4434 punch from 0x465630b to 0x4662bcd, (0xc8c2 bytes) 2024-09-13T06:42:07.162 INFO:teuthology.orchestra.run.smithi081.stdout:4435 read 0x1cf16d5 thru 0x1cf65bd (0x4ee9 bytes) 2024-09-13T06:42:07.178 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:42:07.178 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:42:07.180 INFO:teuthology.orchestra.run.smithi081.stdout:4437 write 0xb8bae36 thru 0xb8bdb36 (0x2d01 bytes) 2024-09-13T06:42:07.195 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:42:07.195 INFO:teuthology.orchestra.run.smithi081.stdout:4439 writesame 0x84702f thru 0x856c59 data_size 0x1(0xfc2b bytes) 2024-09-13T06:42:07.199 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-13T06:42:07.224 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:42:07.224 INFO:teuthology.orchestra.run.smithi081.stdout:4441 write 0x40d2f63 thru 0x40e049b (0xd539 bytes) 2024-09-13T06:42:07.238 INFO:teuthology.orchestra.run.smithi081.stdout:4443 read 0x776a698 thru 0x776f581 (0x4eea bytes) 2024-09-13T06:42:07.239 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:42:07.237+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:42:07.239 INFO:teuthology.orchestra.run.smithi081.stdout:4444 trunc from 0xb8bdb37 to 0xc9df09c 2024-09-13T06:42:07.250 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:42:07.251 INFO:teuthology.orchestra.run.smithi081.stdout:4447 punch from 0x7871134 to 0x7879254, (0x8120 bytes) 2024-09-13T06:42:07.251 INFO:teuthology.orchestra.run.smithi081.stdout:4448 read 0x7237b1d thru 0x7239392 (0x1876 bytes) 2024-09-13T06:42:07.252 INFO:teuthology.orchestra.run.smithi081.stdout:4449 read 0x563d0e4 thru 0x56464e9 (0x9406 bytes) 2024-09-13T06:42:07.252 INFO:teuthology.orchestra.run.smithi081.stdout:4450 write 0x3df338e thru 0x3df68af (0x3522 bytes) 2024-09-13T06:42:07.267 INFO:teuthology.orchestra.run.smithi081.stdout:4452 write 0x7c667fb thru 0x7c72797 (0xbf9d bytes) 2024-09-13T06:42:07.284 INFO:teuthology.orchestra.run.smithi081.stdout:4453 write 0x5fc32d7 thru 0x5fca6a4 (0x73ce bytes) 2024-09-13T06:42:07.300 INFO:teuthology.orchestra.run.smithi081.stdout:4455 read 0x6f9d41a thru 0x6fa9782 (0xc369 bytes) 2024-09-13T06:42:07.311 INFO:teuthology.orchestra.run.smithi081.stdout:osd.0: {} 2024-09-13T06:42:07.311 INFO:teuthology.orchestra.run.smithi081.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-13T06:42:07.317 INFO:teuthology.orchestra.run.smithi081.stdout:4456 trunc from 0xc9df09c to 0x16819f7 2024-09-13T06:42:07.339 INFO:teuthology.orchestra.run.smithi081.stdout:osd.1: {} 2024-09-13T06:42:07.339 INFO:teuthology.orchestra.run.smithi081.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-13T06:42:07.340 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:42:07.337+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:42:07.364 INFO:teuthology.orchestra.run.smithi081.stdout:osd.2: {} 2024-09-13T06:42:07.364 INFO:teuthology.orchestra.run.smithi081.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-13T06:42:07.375 INFO:teuthology.orchestra.run.smithi081.stdout:4457 trunc from 0x16819f7 to 0xbaa45bf 2024-09-13T06:42:07.384 INFO:teuthology.orchestra.run.smithi081.stdout:osd.3: {} 2024-09-13T06:42:07.385 INFO:teuthology.orchestra.run.smithi081.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-13T06:42:07.385 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:42:07.385 INFO:teuthology.orchestra.run.smithi081.stdout:4459 writesame 0x8527f95 thru 0x853018a data_size 0xf(0x81f6 bytes) 2024-09-13T06:42:07.389 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:42:07.390 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-13T06:42:07.390 INFO:teuthology.orchestra.run.smithi081.stdout: "complaint_time": 30, 2024-09-13T06:42:07.390 INFO:teuthology.orchestra.run.smithi081.stdout: "num_blocked_ops": 0 2024-09-13T06:42:07.390 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:42:07.405 INFO:teuthology.orchestra.run.smithi081.stdout:4460 write 0x8b22e27 thru 0x8b26037 (0x3211 bytes) 2024-09-13T06:42:07.407 INFO:teuthology.orchestra.run.smithi081.stdout:osd.4: {} 2024-09-13T06:42:07.407 INFO:teuthology.orchestra.run.smithi081.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-13T06:42:07.410 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-13T06:42:07.423 INFO:teuthology.orchestra.run.smithi081.stdout:4461 read 0x3628073 thru 0x363778a (0xf718 bytes) 2024-09-13T06:42:07.423 INFO:teuthology.orchestra.run.smithi081.stdout:4463 write 0x4895da thru 0x4970ac (0xdad3 bytes) 2024-09-13T06:42:07.428 INFO:teuthology.orchestra.run.smithi081.stdout:4464 write 0x1de60e thru 0x1e239e (0x3d91 bytes) 2024-09-13T06:42:07.434 INFO:teuthology.orchestra.run.smithi081.stdout:4465 read 0x4c38bf2 thru 0x4c43adc (0xaeeb bytes) 2024-09-13T06:42:07.434 INFO:teuthology.orchestra.run.smithi081.stdout:4466 punch from 0x9cffd3e to 0x9d08b77, (0x8e39 bytes) 2024-09-13T06:42:07.434 INFO:teuthology.orchestra.run.smithi081.stdout:4468 clone 32 order 20 su 524288 sc 12 2024-09-13T06:42:07.435 INFO:teuthology.orchestra.run.smithi081.stdout:osd.5: {} 2024-09-13T06:42:07.435 INFO:teuthology.orchestra.run.smithi081.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-13T06:42:07.440 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:42:07.437+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:42:07.456 INFO:teuthology.orchestra.run.smithi081.stdout:osd.6: {} 2024-09-13T06:42:07.457 INFO:teuthology.orchestra.run.smithi081.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-13T06:42:07.457 INFO:teuthology.orchestra.run.smithi081.stderr:Error ENXIO: problem getting command descriptions from osd.7 2024-09-13T06:42:07.461 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-13T06:42:07.461 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-13T06:42:07.541 INFO:tasks.ceph.osd.6.smithi139.stderr:2024-09-13T06:42:07.537+0000 7fcd02c5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26385) UID: 0 2024-09-13T06:42:07.548 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:42:07.548 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 20, 2024-09-13T06:42:07.548 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 600, 2024-09-13T06:42:07.548 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [ 2024-09-13T06:42:07.548 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:07.548 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:21979 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 14217216~4096 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:42:07.548 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.888811+0000", 2024-09-13T06:42:07.549 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 134.65994204399999, 2024-09-13T06:42:07.549 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049092969, 2024-09-13T06:42:07.549 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:07.549 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:07.549 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:07.549 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:07.549 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:07.549 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 21979 2024-09-13T06:42:07.549 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:07.549 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:07.549 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:07.549 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:07.550 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888811+0000", 2024-09-13T06:42:07.550 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:07.550 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:07.550 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:07.550 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:07.550 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888811+0000", 2024-09-13T06:42:07.550 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:07.550 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:07.550 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:07.550 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:07.550 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888811+0000", 2024-09-13T06:42:07.550 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:42:07.550 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:07.551 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:07.551 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:07.551 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888812+0000", 2024-09-13T06:42:07.551 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.204e-06 2024-09-13T06:42:07.551 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:07.551 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:07.551 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:07.551 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888815+0000", 2024-09-13T06:42:07.551 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9359999999999999e-06 2024-09-13T06:42:07.551 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:07.551 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:07.551 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:07.552 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888818+0000", 2024-09-13T06:42:07.552 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.7369999999999998e-06 2024-09-13T06:42:07.552 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:07.552 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:07.552 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:07.552 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.937663+0000", 2024-09-13T06:42:07.552 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.048844540999999998 2024-09-13T06:42:07.552 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:07.552 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:07.552 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:07.552 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.937709+0000", 2024-09-13T06:42:07.552 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6492999999999997e-05 2024-09-13T06:42:07.553 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:07.553 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:07.553 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:07.553 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.937904+0000", 2024-09-13T06:42:07.553 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00019526499999999999 2024-09-13T06:42:07.553 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:07.553 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:07.553 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:07.553 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:07.553 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:07.553 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:21980 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 14245888~4096 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:42:07.553 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.888820+0000", 2024-09-13T06:42:07.553 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 134.65993336700001, 2024-09-13T06:42:07.554 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049357080999999997, 2024-09-13T06:42:07.554 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:07.554 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:07.554 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:07.554 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:07.554 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:07.554 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 21980 2024-09-13T06:42:07.554 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:07.554 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:07.554 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:07.554 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:07.554 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888820+0000", 2024-09-13T06:42:07.555 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:07.555 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:07.555 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:07.555 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:07.555 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888820+0000", 2024-09-13T06:42:07.555 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:07.555 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:07.555 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:07.555 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:07.555 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888820+0000", 2024-09-13T06:42:07.555 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:42:07.555 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:07.555 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:07.555 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:07.556 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888821+0000", 2024-09-13T06:42:07.556 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.122e-06 2024-09-13T06:42:07.556 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:07.556 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:07.556 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:07.556 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888824+0000", 2024-09-13T06:42:07.556 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.0580000000000002e-06 2024-09-13T06:42:07.556 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:07.556 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:07.556 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:07.556 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888827+0000", 2024-09-13T06:42:07.556 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.666e-06 2024-09-13T06:42:07.557 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:07.557 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:07.557 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:07.557 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.937935+0000", 2024-09-13T06:42:07.557 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049108329999999999 2024-09-13T06:42:07.557 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:07.557 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:07.557 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:07.557 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.937985+0000", 2024-09-13T06:42:07.557 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9694000000000002e-05 2024-09-13T06:42:07.557 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:07.557 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:07.557 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:07.557 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.938177+0000", 2024-09-13T06:42:07.558 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00019241899999999999 2024-09-13T06:42:07.558 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:07.558 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:07.558 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:07.558 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:07.558 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:07.558 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:21984 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:snapdir [list-snaps] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:42:07.558 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.888829+0000", 2024-09-13T06:42:07.558 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 134.65992458900001, 2024-09-13T06:42:07.558 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049524545000000003, 2024-09-13T06:42:07.558 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:07.558 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:07.558 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:07.559 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:07.559 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:07.559 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 21984 2024-09-13T06:42:07.559 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:07.559 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:07.559 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:07.559 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:07.559 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888829+0000", 2024-09-13T06:42:07.559 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:07.559 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:07.559 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:07.559 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:07.560 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888829+0000", 2024-09-13T06:42:07.560 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:07.560 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:07.560 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:07.560 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:07.560 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888829+0000", 2024-09-13T06:42:07.560 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:42:07.560 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:07.560 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:07.560 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:07.560 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888830+0000", 2024-09-13T06:42:07.561 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2529999999999999e-06 2024-09-13T06:42:07.561 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:07.561 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:07.561 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:07.561 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888835+0000", 2024-09-13T06:42:07.561 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.4729999999999999e-06 2024-09-13T06:42:07.561 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:07.561 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:07.561 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:07.561 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888840+0000", 2024-09-13T06:42:07.561 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0159999999999999e-06 2024-09-13T06:42:07.561 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:07.562 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:07.562 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:07.562 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.938199+0000", 2024-09-13T06:42:07.562 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049358974999999999 2024-09-13T06:42:07.562 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:07.562 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:07.562 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:07.562 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.938268+0000", 2024-09-13T06:42:07.562 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.8876999999999998e-05 2024-09-13T06:42:07.562 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:07.562 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:07.562 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:07.563 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.938353+0000", 2024-09-13T06:42:07.563 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.5155999999999996e-05 2024-09-13T06:42:07.563 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:07.563 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:07.563 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:07.563 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:07.563 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:07.563 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:21985 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 12587008~4096 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:42:07.563 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.888858+0000", 2024-09-13T06:42:07.563 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 134.659895439, 2024-09-13T06:42:07.563 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049674347000000001, 2024-09-13T06:42:07.563 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:07.564 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:07.564 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:07.564 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:07.564 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:07.564 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 21985 2024-09-13T06:42:07.564 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:07.564 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:07.564 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:07.564 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:07.564 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888858+0000", 2024-09-13T06:42:07.564 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:07.564 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:07.564 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:07.565 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:07.565 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888858+0000", 2024-09-13T06:42:07.565 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:07.565 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:07.565 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:07.565 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:07.565 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888857+0000", 2024-09-13T06:42:07.565 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:07.565 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:07.565 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:07.565 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:07.566 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888860+0000", 2024-09-13T06:42:07.566 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4739999999999999e-06 2024-09-13T06:42:07.566 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:07.566 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:07.566 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:07.566 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888867+0000", 2024-09-13T06:42:07.566 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.7170000000000002e-06 2024-09-13T06:42:07.566 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:07.566 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:07.566 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:07.566 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888871+0000", 2024-09-13T06:42:07.566 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5120000000000002e-06 2024-09-13T06:42:07.566 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:07.567 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:07.567 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:07.567 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.938389+0000", 2024-09-13T06:42:07.567 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049517717000000003 2024-09-13T06:42:07.567 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:07.567 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:07.567 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:07.567 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.938449+0000", 2024-09-13T06:42:07.567 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0513999999999997e-05 2024-09-13T06:42:07.567 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:07.567 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:07.568 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:07.568 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.938532+0000", 2024-09-13T06:42:07.568 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.2936999999999996e-05 2024-09-13T06:42:07.568 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:07.568 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:07.568 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:07.568 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:07.568 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:07.568 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:21986 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 12615680~4096 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:42:07.568 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.888875+0000", 2024-09-13T06:42:07.568 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 134.65987792600001, 2024-09-13T06:42:07.568 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049881781, 2024-09-13T06:42:07.568 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:07.569 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:07.569 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:07.569 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:07.569 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:07.569 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 21986 2024-09-13T06:42:07.569 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:07.569 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:07.569 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:07.569 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:07.569 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888875+0000", 2024-09-13T06:42:07.569 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:07.570 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:07.570 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:07.570 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:07.570 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888875+0000", 2024-09-13T06:42:07.570 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:07.570 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:07.570 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:07.570 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:07.570 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888875+0000", 2024-09-13T06:42:07.570 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:07.571 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:07.571 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:07.571 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:07.571 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888880+0000", 2024-09-13T06:42:07.571 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7600000000000002e-06 2024-09-13T06:42:07.571 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:07.571 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:07.571 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:07.571 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888887+0000", 2024-09-13T06:42:07.571 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3950000000000003e-06 2024-09-13T06:42:07.571 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:07.571 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:07.571 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:07.571 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888892+0000", 2024-09-13T06:42:07.572 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0409999999999997e-06 2024-09-13T06:42:07.572 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:07.572 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:07.572 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:07.572 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.938568+0000", 2024-09-13T06:42:07.572 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049675267000000002 2024-09-13T06:42:07.572 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:07.572 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:07.572 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:07.572 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.938653+0000", 2024-09-13T06:42:07.572 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.5792999999999997e-05 2024-09-13T06:42:07.572 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:07.572 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:07.573 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:07.573 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.938757+0000", 2024-09-13T06:42:07.573 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00010387699999999999 2024-09-13T06:42:07.573 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:07.573 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:07.573 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:07.573 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:07.573 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:07.573 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:21987 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 12644352~4096 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:42:07.573 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.888899+0000", 2024-09-13T06:42:07.573 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 134.65985458, 2024-09-13T06:42:07.573 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.050094056999999997, 2024-09-13T06:42:07.573 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:07.574 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:07.574 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:07.574 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:07.574 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:07.574 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 21987 2024-09-13T06:42:07.574 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:07.574 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:07.574 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:07.574 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:07.574 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888899+0000", 2024-09-13T06:42:07.574 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:07.574 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:07.574 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:07.574 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:07.575 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888899+0000", 2024-09-13T06:42:07.575 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:07.575 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:07.575 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:07.575 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:07.575 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888899+0000", 2024-09-13T06:42:07.575 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:07.575 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:07.575 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:07.575 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:07.575 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888901+0000", 2024-09-13T06:42:07.575 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2539999999999999e-06 2024-09-13T06:42:07.576 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:07.576 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:07.576 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:07.576 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888907+0000", 2024-09-13T06:42:07.576 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9009999999999999e-06 2024-09-13T06:42:07.576 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:07.576 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:07.576 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:07.576 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888912+0000", 2024-09-13T06:42:07.576 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9840000000000001e-06 2024-09-13T06:42:07.576 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:07.576 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:07.576 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:07.576 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.938810+0000", 2024-09-13T06:42:07.577 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049898835000000002 2024-09-13T06:42:07.577 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:07.577 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:07.577 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:07.577 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.938890+0000", 2024-09-13T06:42:07.577 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.9215000000000006e-05 2024-09-13T06:42:07.577 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:07.577 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:07.577 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:07.578 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.938993+0000", 2024-09-13T06:42:07.578 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000103194 2024-09-13T06:42:07.578 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:07.578 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:07.578 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:07.578 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:07.578 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:07.578 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:21988 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 12673024~4096 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:42:07.578 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.888916+0000", 2024-09-13T06:42:07.578 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 134.65983756399999, 2024-09-13T06:42:07.578 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.050203036999999999, 2024-09-13T06:42:07.578 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:07.578 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:07.578 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:07.579 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:07.579 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:07.579 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 21988 2024-09-13T06:42:07.579 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:07.579 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:07.579 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:07.579 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:07.579 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888916+0000", 2024-09-13T06:42:07.579 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:07.579 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:07.579 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:07.579 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:07.580 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888916+0000", 2024-09-13T06:42:07.580 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:07.580 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:07.580 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:07.580 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:07.580 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888915+0000", 2024-09-13T06:42:07.580 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:07.580 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:07.580 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:07.580 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:07.580 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888918+0000", 2024-09-13T06:42:07.580 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1500000000000002e-06 2024-09-13T06:42:07.581 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:07.581 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:07.581 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:07.581 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888925+0000", 2024-09-13T06:42:07.581 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.9380000000000003e-06 2024-09-13T06:42:07.581 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:07.581 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:07.581 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:07.581 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888933+0000", 2024-09-13T06:42:07.581 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.0560000000000005e-06 2024-09-13T06:42:07.582 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:07.582 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:07.582 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:07.582 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.939026+0000", 2024-09-13T06:42:07.582 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.050093499999999999 2024-09-13T06:42:07.582 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:07.582 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:07.582 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:07.582 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.939068+0000", 2024-09-13T06:42:07.582 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.1705999999999997e-05 2024-09-13T06:42:07.582 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:07.582 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:07.583 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:07.583 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.939119+0000", 2024-09-13T06:42:07.583 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.1048999999999999e-05 2024-09-13T06:42:07.583 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:07.583 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:07.583 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:07.583 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:07.583 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:07.583 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:21989 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 12701696~4096 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:42:07.583 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.888938+0000", 2024-09-13T06:42:07.583 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 134.659815237, 2024-09-13T06:42:07.583 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.050294393999999999, 2024-09-13T06:42:07.583 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:07.584 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:07.584 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:07.584 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:07.584 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:07.584 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 21989 2024-09-13T06:42:07.584 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:07.584 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:07.584 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:07.584 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:07.584 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888938+0000", 2024-09-13T06:42:07.585 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:07.585 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:07.585 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:07.585 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:07.585 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888938+0000", 2024-09-13T06:42:07.585 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:07.585 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:07.585 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:07.585 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:07.585 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888938+0000", 2024-09-13T06:42:07.585 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:07.585 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:07.585 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:07.586 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:07.586 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888940+0000", 2024-09-13T06:42:07.586 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5330000000000001e-06 2024-09-13T06:42:07.586 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:07.586 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:07.586 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:07.586 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888947+0000", 2024-09-13T06:42:07.586 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.2389999999999999e-06 2024-09-13T06:42:07.586 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:07.586 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:07.586 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:07.586 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888952+0000", 2024-09-13T06:42:07.586 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.5720000000000002e-06 2024-09-13T06:42:07.586 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:07.587 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:07.587 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:07.587 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.939141+0000", 2024-09-13T06:42:07.587 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.050188903999999999 2024-09-13T06:42:07.587 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:07.587 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:07.587 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:07.587 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.939182+0000", 2024-09-13T06:42:07.587 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.0926000000000001e-05 2024-09-13T06:42:07.587 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:07.587 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:07.587 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:07.587 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.939233+0000", 2024-09-13T06:42:07.588 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0532999999999999e-05 2024-09-13T06:42:07.588 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:07.588 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:07.588 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:07.588 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:07.588 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:07.588 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:22007 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 13217792~4096 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:42:07.588 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.892771+0000", 2024-09-13T06:42:07.588 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 134.655982131, 2024-09-13T06:42:07.588 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049090024000000003, 2024-09-13T06:42:07.588 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:07.588 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:07.589 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:07.589 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:07.589 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:07.589 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 22007 2024-09-13T06:42:07.589 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:07.589 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:07.589 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:07.589 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:07.589 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892771+0000", 2024-09-13T06:42:07.589 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:07.589 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:07.589 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:07.590 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:07.590 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892771+0000", 2024-09-13T06:42:07.590 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:07.590 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:07.590 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:07.590 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:07.590 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892771+0000", 2024-09-13T06:42:07.590 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:42:07.590 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:07.590 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:07.590 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:07.590 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892772+0000", 2024-09-13T06:42:07.590 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.184e-06 2024-09-13T06:42:07.591 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:07.591 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:07.591 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:07.591 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892775+0000", 2024-09-13T06:42:07.591 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9179999999999998e-06 2024-09-13T06:42:07.591 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:07.591 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:07.591 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:07.591 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892778+0000", 2024-09-13T06:42:07.591 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4990000000000001e-06 2024-09-13T06:42:07.591 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:07.592 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:07.592 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:07.592 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.941760+0000", 2024-09-13T06:42:07.592 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.048982070000000003 2024-09-13T06:42:07.592 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:07.592 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:07.592 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:07.592 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.941808+0000", 2024-09-13T06:42:07.592 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.8278000000000001e-05 2024-09-13T06:42:07.592 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:07.592 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:07.593 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:07.593 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.941861+0000", 2024-09-13T06:42:07.593 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3284e-05 2024-09-13T06:42:07.593 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:07.593 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:07.593 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:07.593 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:07.593 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:07.593 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:22008 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 13246464~4096 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:42:07.593 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.892780+0000", 2024-09-13T06:42:07.593 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 134.65597347400001, 2024-09-13T06:42:07.594 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049200477999999999, 2024-09-13T06:42:07.594 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:07.594 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:07.594 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:07.594 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:07.594 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:07.594 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 22008 2024-09-13T06:42:07.594 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:07.594 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:07.594 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:07.594 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:07.594 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892780+0000", 2024-09-13T06:42:07.595 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:07.595 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:07.595 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:07.595 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:07.595 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892780+0000", 2024-09-13T06:42:07.595 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:07.595 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:07.595 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:07.595 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:07.595 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892780+0000", 2024-09-13T06:42:07.595 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:42:07.595 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:07.596 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:07.596 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:07.596 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892781+0000", 2024-09-13T06:42:07.596 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.083e-06 2024-09-13T06:42:07.596 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:07.596 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:07.596 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:07.596 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892784+0000", 2024-09-13T06:42:07.596 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.926e-06 2024-09-13T06:42:07.596 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:07.596 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:07.596 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:07.596 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892786+0000", 2024-09-13T06:42:07.597 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4490000000000002e-06 2024-09-13T06:42:07.597 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:07.597 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:07.597 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:07.597 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.941888+0000", 2024-09-13T06:42:07.597 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049102290999999999 2024-09-13T06:42:07.597 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:07.597 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:07.597 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:07.597 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.941929+0000", 2024-09-13T06:42:07.597 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.0541999999999999e-05 2024-09-13T06:42:07.597 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:07.597 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:07.597 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:07.598 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.941980+0000", 2024-09-13T06:42:07.598 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.1391999999999999e-05 2024-09-13T06:42:07.598 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:07.598 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:07.598 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:07.598 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:07.598 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:07.598 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:22009 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 13275136~4096 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:42:07.598 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.892788+0000", 2024-09-13T06:42:07.598 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 134.65596499, 2024-09-13T06:42:07.598 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049311926999999998, 2024-09-13T06:42:07.598 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:07.598 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:07.599 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:07.599 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:07.599 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:07.599 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 22009 2024-09-13T06:42:07.599 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:07.599 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:07.599 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:07.599 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:07.599 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892788+0000", 2024-09-13T06:42:07.599 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:07.599 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:07.599 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:07.599 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:07.600 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892788+0000", 2024-09-13T06:42:07.600 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:07.600 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:07.600 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:07.600 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:07.600 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892788+0000", 2024-09-13T06:42:07.600 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:42:07.600 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:07.600 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:07.600 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:07.600 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892789+0000", 2024-09-13T06:42:07.600 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1850000000000001e-06 2024-09-13T06:42:07.600 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:07.601 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:07.601 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:07.601 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892793+0000", 2024-09-13T06:42:07.601 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.9099999999999998e-06 2024-09-13T06:42:07.601 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:07.601 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:07.601 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:07.601 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892798+0000", 2024-09-13T06:42:07.601 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5070000000000002e-06 2024-09-13T06:42:07.601 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:07.601 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:07.601 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:07.601 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.942007+0000", 2024-09-13T06:42:07.602 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049208904999999997 2024-09-13T06:42:07.602 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:07.602 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:07.602 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:07.602 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.942049+0000", 2024-09-13T06:42:07.602 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.1922000000000003e-05 2024-09-13T06:42:07.602 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:07.602 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:07.602 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:07.602 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.942100+0000", 2024-09-13T06:42:07.602 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.1736000000000001e-05 2024-09-13T06:42:07.602 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:07.602 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:07.603 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:07.603 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:07.603 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:07.603 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:22010 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 13303808~4096 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:42:07.603 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.892817+0000", 2024-09-13T06:42:07.603 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 134.65593679400001, 2024-09-13T06:42:07.603 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049466149000000001, 2024-09-13T06:42:07.603 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:07.603 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:07.603 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:07.603 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:07.603 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:07.604 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 22010 2024-09-13T06:42:07.604 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:07.604 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:07.604 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:07.604 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:07.604 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892817+0000", 2024-09-13T06:42:07.604 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:07.604 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:07.604 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:07.604 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:07.604 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892817+0000", 2024-09-13T06:42:07.604 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:07.605 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:07.605 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:07.605 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:07.605 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892816+0000", 2024-09-13T06:42:07.605 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:07.605 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:07.605 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:07.605 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:07.605 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892821+0000", 2024-09-13T06:42:07.605 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9459999999999997e-06 2024-09-13T06:42:07.605 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:07.605 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:07.606 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:07.606 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892828+0000", 2024-09-13T06:42:07.606 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.6780000000000003e-06 2024-09-13T06:42:07.606 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:07.606 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:07.606 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:07.606 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892833+0000", 2024-09-13T06:42:07.606 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.8389999999999997e-06 2024-09-13T06:42:07.606 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:07.606 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:07.606 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:07.606 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.942127+0000", 2024-09-13T06:42:07.606 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049294163000000002 2024-09-13T06:42:07.607 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:07.607 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:07.607 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:07.607 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.942186+0000", 2024-09-13T06:42:07.607 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9335e-05 2024-09-13T06:42:07.607 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:07.607 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:07.607 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:07.607 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.942283+0000", 2024-09-13T06:42:07.607 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.6699000000000004e-05 2024-09-13T06:42:07.607 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:07.607 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:07.607 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:07.608 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:07.608 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:07.608 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:22011 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 13332480~4096 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:42:07.608 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.892838+0000", 2024-09-13T06:42:07.608 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 134.655915107, 2024-09-13T06:42:07.608 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049589214, 2024-09-13T06:42:07.608 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:07.608 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:07.608 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:07.608 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:07.608 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:07.608 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 22011 2024-09-13T06:42:07.608 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:07.609 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:07.609 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:07.609 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:07.609 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892838+0000", 2024-09-13T06:42:07.609 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:07.609 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:07.609 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:07.609 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:07.609 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892838+0000", 2024-09-13T06:42:07.609 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:07.609 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:07.609 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:07.609 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:07.610 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892838+0000", 2024-09-13T06:42:07.610 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:07.610 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:07.610 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:07.610 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:07.610 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892840+0000", 2024-09-13T06:42:07.610 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.136e-06 2024-09-13T06:42:07.610 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:07.610 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:07.610 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:07.610 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892852+0000", 2024-09-13T06:42:07.610 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2122e-05 2024-09-13T06:42:07.611 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:07.611 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:07.611 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:07.611 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892862+0000", 2024-09-13T06:42:07.611 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.7049999999999994e-06 2024-09-13T06:42:07.611 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:07.611 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:07.611 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:07.611 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.942319+0000", 2024-09-13T06:42:07.611 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049456623999999998 2024-09-13T06:42:07.611 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:07.611 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:07.611 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:07.612 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.942363+0000", 2024-09-13T06:42:07.612 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4759000000000003e-05 2024-09-13T06:42:07.612 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:07.612 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:07.612 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:07.612 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.942428+0000", 2024-09-13T06:42:07.612 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.4221999999999996e-05 2024-09-13T06:42:07.612 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:07.612 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:07.612 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:07.612 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:07.612 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:07.612 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:22033 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 13963264~4096 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:42:07.613 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.896824+0000", 2024-09-13T06:42:07.613 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 134.65192921400001, 2024-09-13T06:42:07.613 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049051957, 2024-09-13T06:42:07.613 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:07.613 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:07.613 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:07.613 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:07.613 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:07.613 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 22033 2024-09-13T06:42:07.613 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:07.613 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:07.613 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:07.614 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:07.614 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.896824+0000", 2024-09-13T06:42:07.614 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:07.614 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:07.614 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:07.614 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:07.614 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.896824+0000", 2024-09-13T06:42:07.614 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:07.614 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:07.614 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:07.614 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:07.614 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.896824+0000", 2024-09-13T06:42:07.614 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:07.615 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:07.615 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:07.615 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:07.615 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.896826+0000", 2024-09-13T06:42:07.615 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1900000000000002e-06 2024-09-13T06:42:07.615 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:07.615 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:07.615 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:07.615 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.896832+0000", 2024-09-13T06:42:07.615 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.2689999999999996e-06 2024-09-13T06:42:07.615 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:07.615 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:07.616 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:07.616 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.896840+0000", 2024-09-13T06:42:07.616 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3289999999999996e-06 2024-09-13T06:42:07.616 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:07.616 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:07.616 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:07.616 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.945777+0000", 2024-09-13T06:42:07.616 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.048937188 2024-09-13T06:42:07.616 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:07.616 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:07.616 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:07.616 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.945822+0000", 2024-09-13T06:42:07.617 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4780999999999997e-05 2024-09-13T06:42:07.617 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:07.617 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:07.617 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:07.617 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.945876+0000", 2024-09-13T06:42:07.617 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.4542000000000001e-05 2024-09-13T06:42:07.617 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:07.617 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:07.617 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:07.617 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:07.617 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:07.617 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:22338 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 13611008~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:42:07.617 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.951070+0000", 2024-09-13T06:42:07.618 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 134.59768358599999, 2024-09-13T06:42:07.618 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049135817999999998, 2024-09-13T06:42:07.618 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:07.618 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:07.618 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:07.618 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:07.618 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:07.618 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 22338 2024-09-13T06:42:07.618 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:07.618 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:07.618 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:07.618 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:07.618 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951070+0000", 2024-09-13T06:42:07.619 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:07.619 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:07.619 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:07.619 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:07.619 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951070+0000", 2024-09-13T06:42:07.619 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:07.619 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:07.619 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:07.619 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:07.619 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951069+0000", 2024-09-13T06:42:07.619 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:07.619 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:07.619 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:07.620 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:07.620 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951072+0000", 2024-09-13T06:42:07.620 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5909999999999998e-06 2024-09-13T06:42:07.620 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:07.620 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:07.620 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:07.620 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951078+0000", 2024-09-13T06:42:07.620 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.4450000000000001e-06 2024-09-13T06:42:07.620 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:07.620 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:07.620 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:07.620 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951083+0000", 2024-09-13T06:42:07.620 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7790000000000003e-06 2024-09-13T06:42:07.621 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:07.621 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:07.621 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:07.621 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:53.000020+0000", 2024-09-13T06:42:07.621 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.048936999000000002 2024-09-13T06:42:07.621 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:07.621 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:07.621 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:07.621 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:53.000106+0000", 2024-09-13T06:42:07.621 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.5532999999999996e-05 2024-09-13T06:42:07.621 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:07.621 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:07.622 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:07.622 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:53.000206+0000", 2024-09-13T06:42:07.622 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.9852999999999994e-05 2024-09-13T06:42:07.622 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:07.622 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:07.622 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:07.622 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:07.622 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:07.622 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:22339 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 13639680~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:42:07.622 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.951088+0000", 2024-09-13T06:42:07.622 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 134.59766588799999, 2024-09-13T06:42:07.622 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049238202000000002, 2024-09-13T06:42:07.622 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:07.622 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:07.623 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:07.623 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:07.623 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:07.623 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 22339 2024-09-13T06:42:07.623 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:07.623 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:07.623 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:07.623 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:07.623 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951088+0000", 2024-09-13T06:42:07.623 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:07.623 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:07.623 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:07.623 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:07.624 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951088+0000", 2024-09-13T06:42:07.624 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:07.624 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:07.624 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:07.624 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:07.624 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951087+0000", 2024-09-13T06:42:07.624 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:07.624 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:07.624 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:07.624 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:07.624 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951089+0000", 2024-09-13T06:42:07.624 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.153e-06 2024-09-13T06:42:07.624 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:07.625 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:07.625 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:07.625 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951093+0000", 2024-09-13T06:42:07.625 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.7120000000000002e-06 2024-09-13T06:42:07.625 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:07.625 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:07.625 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:07.625 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951096+0000", 2024-09-13T06:42:07.625 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.0570000000000001e-06 2024-09-13T06:42:07.625 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:07.625 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:07.625 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:07.625 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:53.000220+0000", 2024-09-13T06:42:07.626 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049123989 2024-09-13T06:42:07.626 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:07.626 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:07.626 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:07.626 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:53.000271+0000", 2024-09-13T06:42:07.626 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.062e-05 2024-09-13T06:42:07.626 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:07.626 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:07.626 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:07.626 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:53.000326+0000", 2024-09-13T06:42:07.626 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.5121000000000003e-05 2024-09-13T06:42:07.626 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:07.626 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:07.626 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:07.627 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:07.627 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:07.627 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:22340 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 13668352~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:42:07.627 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.951200+0000", 2024-09-13T06:42:07.627 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 134.59755299899999, 2024-09-13T06:42:07.627 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049352350000000003, 2024-09-13T06:42:07.627 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:07.627 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:07.627 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:07.627 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:07.627 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:07.627 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 22340 2024-09-13T06:42:07.627 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:07.628 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:07.628 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:07.628 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:07.628 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951200+0000", 2024-09-13T06:42:07.628 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:07.628 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:07.628 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:07.628 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:07.628 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951200+0000", 2024-09-13T06:42:07.628 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:07.628 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:07.628 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:07.629 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:07.629 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951098+0000", 2024-09-13T06:42:07.629 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.999898 2024-09-13T06:42:07.629 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:07.629 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:07.629 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:07.629 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951204+0000", 2024-09-13T06:42:07.629 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000105398 2024-09-13T06:42:07.629 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:07.629 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:07.629 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:07.629 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951211+0000", 2024-09-13T06:42:07.629 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.43e-06 2024-09-13T06:42:07.629 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:07.630 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:07.630 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:07.630 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951216+0000", 2024-09-13T06:42:07.630 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2800000000000003e-06 2024-09-13T06:42:07.630 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:07.630 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:07.630 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:07.630 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:53.000358+0000", 2024-09-13T06:42:07.630 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049142036 2024-09-13T06:42:07.630 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:07.630 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:07.630 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:07.631 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:53.000443+0000", 2024-09-13T06:42:07.631 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.4710999999999996e-05 2024-09-13T06:42:07.631 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:07.631 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:07.631 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:07.631 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:53.000553+0000", 2024-09-13T06:42:07.631 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000109622 2024-09-13T06:42:07.631 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:07.631 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:07.631 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:07.631 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:07.631 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:07.631 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:22348 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 13897728~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:42:07.632 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.952783+0000", 2024-09-13T06:42:07.632 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 134.59597021100001, 2024-09-13T06:42:07.632 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049120832000000003, 2024-09-13T06:42:07.632 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:07.632 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:07.632 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:07.632 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:07.632 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:07.632 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 22348 2024-09-13T06:42:07.632 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:07.632 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:07.632 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:07.633 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:07.633 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.952783+0000", 2024-09-13T06:42:07.633 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:07.633 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:07.633 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:07.633 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:07.633 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.952783+0000", 2024-09-13T06:42:07.633 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:07.633 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:07.633 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:07.633 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:07.633 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.952783+0000", 2024-09-13T06:42:07.634 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:07.634 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:07.634 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:07.634 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:07.634 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.952785+0000", 2024-09-13T06:42:07.634 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4980000000000001e-06 2024-09-13T06:42:07.634 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:07.634 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:07.634 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:07.634 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.952799+0000", 2024-09-13T06:42:07.634 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3825000000000001e-05 2024-09-13T06:42:07.634 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:07.634 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:07.635 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:07.635 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.952809+0000", 2024-09-13T06:42:07.635 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0043e-05 2024-09-13T06:42:07.635 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:07.635 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:07.635 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:07.635 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:53.001723+0000", 2024-09-13T06:42:07.635 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.048914065 2024-09-13T06:42:07.635 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:07.635 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:07.635 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:07.635 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:53.001807+0000", 2024-09-13T06:42:07.635 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.3776000000000006e-05 2024-09-13T06:42:07.635 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:07.636 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:07.636 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:07.636 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:53.001904+0000", 2024-09-13T06:42:07.636 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.7004999999999997e-05 2024-09-13T06:42:07.636 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:07.636 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:07.636 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:07.636 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:07.636 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:07.636 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:69045 3.0 3:05ea3821:::rbd_data.1121867cc19b.0000000000000000:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109)", 2024-09-13T06:42:07.636 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:41:03.637760+0000", 2024-09-13T06:42:07.636 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 63.910993453000003, 2024-09-13T06:42:07.636 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.052276712000000003, 2024-09-13T06:42:07.636 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:07.637 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:42:07.637 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:07.637 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:07.637 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:07.637 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 69045 2024-09-13T06:42:07.637 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:07.637 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:07.637 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:07.637 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:07.637 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:03.637760+0000", 2024-09-13T06:42:07.637 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:07.637 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:07.637 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:07.638 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:07.638 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:03.637760+0000", 2024-09-13T06:42:07.638 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:07.638 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:07.638 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:07.638 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:07.638 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:03.637758+0000", 2024-09-13T06:42:07.638 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999981 2024-09-13T06:42:07.638 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:07.638 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:07.638 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:07.638 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:03.637770+0000", 2024-09-13T06:42:07.639 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1533e-05 2024-09-13T06:42:07.639 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:07.639 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:07.639 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:07.639 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:03.637794+0000", 2024-09-13T06:42:07.639 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4243000000000002e-05 2024-09-13T06:42:07.639 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:07.639 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:07.639 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:07.639 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:03.637806+0000", 2024-09-13T06:42:07.639 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2033e-05 2024-09-13T06:42:07.639 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:07.639 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:07.640 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:07.640 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:03.637891+0000", 2024-09-13T06:42:07.640 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.5358000000000005e-05 2024-09-13T06:42:07.640 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:07.640 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:07.640 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:07.640 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:03.638042+0000", 2024-09-13T06:42:07.640 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000151073 2024-09-13T06:42:07.640 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:07.640 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:07.640 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 2", 2024-09-13T06:42:07.640 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:03.647124+0000", 2024-09-13T06:42:07.640 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0090821670000000004 2024-09-13T06:42:07.640 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:07.641 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:07.641 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:42:07.641 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:03.689849+0000", 2024-09-13T06:42:07.641 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.042724445999999999 2024-09-13T06:42:07.641 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:07.641 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:07.641 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-09-13T06:42:07.641 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:03.689871+0000", 2024-09-13T06:42:07.641 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1778999999999999e-05 2024-09-13T06:42:07.641 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:07.641 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:07.641 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:42:07.642 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:03.689965+0000", 2024-09-13T06:42:07.642 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.4312000000000001e-05 2024-09-13T06:42:07.642 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:07.642 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:07.642 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:07.642 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:03.690037+0000", 2024-09-13T06:42:07.642 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.1687999999999995e-05 2024-09-13T06:42:07.642 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:07.642 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:07.642 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:07.642 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:07.642 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:07.643 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:90987 3.6 3:6263dd97:::rbd_object_map.11212443ae03.0000000000000049:head [call] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-13T06:42:07.643 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:41:35.460333+0000", 2024-09-13T06:42:07.643 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 32.088420065999998, 2024-09-13T06:42:07.643 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0001633640000001, 2024-09-13T06:42:07.643 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:07.643 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:07.643 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:07.643 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:07.643 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:07.643 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 90987 2024-09-13T06:42:07.643 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:07.643 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:07.643 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:07.643 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:07.644 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:35.460333+0000", 2024-09-13T06:42:07.644 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:07.644 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:07.644 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:07.644 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:07.644 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:35.460333+0000", 2024-09-13T06:42:07.644 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:07.644 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:07.644 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:07.644 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:07.644 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:35.460330+0000", 2024-09-13T06:42:07.644 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999971 2024-09-13T06:42:07.644 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:07.645 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:07.645 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:07.645 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:35.460343+0000", 2024-09-13T06:42:07.645 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2695e-05 2024-09-13T06:42:07.645 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:07.645 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:07.645 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:07.645 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:35.460365+0000", 2024-09-13T06:42:07.645 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2473999999999999e-05 2024-09-13T06:42:07.645 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:07.645 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:07.645 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:07.646 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:35.460376+0000", 2024-09-13T06:42:07.646 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0383999999999999e-05 2024-09-13T06:42:07.646 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:07.646 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:07.646 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:07.646 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:35.460435+0000", 2024-09-13T06:42:07.646 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8650000000000003e-05 2024-09-13T06:42:07.646 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:07.646 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:07.646 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:42:07.646 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:35.460444+0000", 2024-09-13T06:42:07.646 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.0380000000000005e-06 2024-09-13T06:42:07.646 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:07.647 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:07.647 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:07.647 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:36.459433+0000", 2024-09-13T06:42:07.647 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.99898895799999998 2024-09-13T06:42:07.647 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:07.647 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:07.647 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:07.647 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:36.459622+0000", 2024-09-13T06:42:07.647 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00018940299999999999 2024-09-13T06:42:07.647 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:07.647 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:07.647 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:07.647 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:36.460497+0000", 2024-09-13T06:42:07.647 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00087481199999999999 2024-09-13T06:42:07.647 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:07.648 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:07.648 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:07.648 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:07.648 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:07.648 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:42:07.649 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-13T06:42:07.650 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:42:07.645+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:42:07.750 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:42:07.749+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:42:07.797 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-13T06:42:07.822 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:42:07.822 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-13T06:42:07.822 INFO:teuthology.orchestra.run.smithi081.stdout: "num_ops": 0 2024-09-13T06:42:07.822 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:42:07.837 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-13T06:42:07.850 INFO:tasks.ceph.osd.6.smithi139.stderr:2024-09-13T06:42:07.845+0000 7fcd02c5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26385) UID: 0 2024-09-13T06:42:07.952 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:42:07.949+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:42:07.996 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:42:07.996 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-13T06:42:07.997 INFO:teuthology.orchestra.run.smithi081.stdout: "complaint_time": 30, 2024-09-13T06:42:07.997 INFO:teuthology.orchestra.run.smithi081.stdout: "num_blocked_ops": 0 2024-09-13T06:42:07.997 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:42:08.010 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-13T06:42:08.058 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:42:08.057+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:42:08.153 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:42:08.149+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:42:08.173 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:42:08.173 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 20, 2024-09-13T06:42:08.173 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 600, 2024-09-13T06:42:08.173 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [ 2024-09-13T06:42:08.173 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.173 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:36160 3.f 3:f62782c2:::rbd_object_map.11219660270d.0000000000000016:head [call] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-13T06:42:08.173 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:01.607291+0000", 2024-09-13T06:42:08.173 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 126.564700418, 2024-09-13T06:42:08.173 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.99619456699999998, 2024-09-13T06:42:08.173 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:08.174 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:08.174 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:08.174 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:08.174 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:08.174 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 36160 2024-09-13T06:42:08.174 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.174 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:08.174 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.174 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:08.174 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:01.607291+0000", 2024-09-13T06:42:08.174 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:08.174 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.174 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.175 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:08.175 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:01.607291+0000", 2024-09-13T06:42:08.175 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:08.175 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.175 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.175 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:08.175 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:01.607289+0000", 2024-09-13T06:42:08.175 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999976 2024-09-13T06:42:08.175 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.175 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.175 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:08.175 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:01.607302+0000", 2024-09-13T06:42:08.175 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3018e-05 2024-09-13T06:42:08.175 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.176 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.176 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:08.176 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:01.607323+0000", 2024-09-13T06:42:08.176 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1030999999999999e-05 2024-09-13T06:42:08.176 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.176 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.176 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:08.176 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:01.607342+0000", 2024-09-13T06:42:08.176 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8961e-05 2024-09-13T06:42:08.176 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.176 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.176 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:08.176 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:01.607425+0000", 2024-09-13T06:42:08.177 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.3171999999999996e-05 2024-09-13T06:42:08.177 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.177 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.177 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:42:08.177 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:01.607441+0000", 2024-09-13T06:42:08.177 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5996999999999999e-05 2024-09-13T06:42:08.177 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.177 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.177 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:08.177 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:02.596186+0000", 2024-09-13T06:42:08.177 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.98874432000000001 2024-09-13T06:42:08.177 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.177 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.177 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for missing object", 2024-09-13T06:42:08.178 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:02.596618+0000", 2024-09-13T06:42:08.178 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000432032 2024-09-13T06:42:08.178 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.178 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.178 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:08.178 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:02.600845+0000", 2024-09-13T06:42:08.178 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0042277410000000001 2024-09-13T06:42:08.178 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.178 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.178 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:08.178 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:02.601003+0000", 2024-09-13T06:42:08.178 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00015731999999999999 2024-09-13T06:42:08.178 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.178 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.179 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:08.179 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:02.603486+0000", 2024-09-13T06:42:08.179 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0024832510000000001 2024-09-13T06:42:08.179 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:08.179 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:08.179 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:08.179 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.179 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.179 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:37806 3.9 3:951cb95b:::rbd_data.1121d8143c6e.0000000000000002:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e56)", 2024-09-13T06:42:08.179 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:06.373482+0000", 2024-09-13T06:42:08.179 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 121.79850938200001, 2024-09-13T06:42:08.179 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.002476213, 2024-09-13T06:42:08.179 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:08.179 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:08.180 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:08.180 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:08.180 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:08.180 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 37806 2024-09-13T06:42:08.180 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.180 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:08.180 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.180 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:08.180 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.373482+0000", 2024-09-13T06:42:08.180 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:08.180 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.180 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.180 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:08.180 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.373482+0000", 2024-09-13T06:42:08.181 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:08.181 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.181 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.181 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:08.181 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.373479+0000", 2024-09-13T06:42:08.181 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999962 2024-09-13T06:42:08.181 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.181 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.181 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:08.181 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.373495+0000", 2024-09-13T06:42:08.181 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6640999999999999e-05 2024-09-13T06:42:08.181 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.181 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.181 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:08.181 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.373542+0000", 2024-09-13T06:42:08.182 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6229000000000001e-05 2024-09-13T06:42:08.182 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.182 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.182 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:08.182 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.373564+0000", 2024-09-13T06:42:08.182 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2684000000000002e-05 2024-09-13T06:42:08.182 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.182 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.182 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:08.182 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374268+0000", 2024-09-13T06:42:08.182 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00070363700000000001 2024-09-13T06:42:08.182 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.182 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.183 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:42:08.183 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374305+0000", 2024-09-13T06:42:08.183 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.6936e-05 2024-09-13T06:42:08.183 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.183 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.183 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:08.183 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.375175+0000", 2024-09-13T06:42:08.183 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.000870454 2024-09-13T06:42:08.183 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.183 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.183 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:08.183 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.375678+0000", 2024-09-13T06:42:08.183 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00050292499999999999 2024-09-13T06:42:08.184 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.184 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.184 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:08.184 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.375959+0000", 2024-09-13T06:42:08.184 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00028050599999999997 2024-09-13T06:42:08.184 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:08.184 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:08.184 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:08.184 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.184 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.184 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:37821 3.9 3:951cb95b:::rbd_data.1121d8143c6e.0000000000000002:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e56)", 2024-09-13T06:42:08.184 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:06.374454+0000", 2024-09-13T06:42:08.184 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 121.797538265, 2024-09-13T06:42:08.185 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.002545072, 2024-09-13T06:42:08.185 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:08.185 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:08.185 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:08.185 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:08.185 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:08.185 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 37821 2024-09-13T06:42:08.185 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.185 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:08.185 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.185 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:08.185 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374454+0000", 2024-09-13T06:42:08.186 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:08.186 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.186 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.186 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:08.186 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374454+0000", 2024-09-13T06:42:08.186 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:08.186 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.186 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.186 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:08.186 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374452+0000", 2024-09-13T06:42:08.186 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999981 2024-09-13T06:42:08.186 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.186 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.187 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:08.187 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374463+0000", 2024-09-13T06:42:08.187 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0756e-05 2024-09-13T06:42:08.187 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.187 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.187 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:08.187 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374487+0000", 2024-09-13T06:42:08.187 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4887000000000001e-05 2024-09-13T06:42:08.187 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.187 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.187 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:08.187 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374504+0000", 2024-09-13T06:42:08.187 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6852000000000001e-05 2024-09-13T06:42:08.187 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.188 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.188 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:08.188 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374829+0000", 2024-09-13T06:42:08.188 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000324684 2024-09-13T06:42:08.188 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.188 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.188 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:42:08.188 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374880+0000", 2024-09-13T06:42:08.188 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.1378000000000002e-05 2024-09-13T06:42:08.188 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.188 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.188 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:08.188 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.376423+0000", 2024-09-13T06:42:08.189 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.001542734 2024-09-13T06:42:08.189 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.189 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.189 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:08.189 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.376607+0000", 2024-09-13T06:42:08.189 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000183656 2024-09-13T06:42:08.189 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.189 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.190 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:08.190 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.376999+0000", 2024-09-13T06:42:08.190 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00039191200000000001 2024-09-13T06:42:08.190 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:08.190 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:08.190 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:08.190 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.190 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.190 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:37836 3.9 3:951cb95b:::rbd_data.1121d8143c6e.0000000000000002:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e56)", 2024-09-13T06:42:08.190 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:06.374929+0000", 2024-09-13T06:42:08.190 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 121.79706261299999, 2024-09-13T06:42:08.190 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.002778825, 2024-09-13T06:42:08.191 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:08.191 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:08.191 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:08.191 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:08.191 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:08.191 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 37836 2024-09-13T06:42:08.191 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.191 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:08.191 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.191 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:08.191 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374929+0000", 2024-09-13T06:42:08.191 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:08.191 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.191 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.192 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:08.192 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374929+0000", 2024-09-13T06:42:08.192 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:08.192 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.192 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.192 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:08.192 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374927+0000", 2024-09-13T06:42:08.192 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999981 2024-09-13T06:42:08.192 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.192 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.192 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:08.192 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374939+0000", 2024-09-13T06:42:08.193 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1846e-05 2024-09-13T06:42:08.193 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.193 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.193 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:08.193 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374962+0000", 2024-09-13T06:42:08.193 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3054e-05 2024-09-13T06:42:08.193 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.193 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.193 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:08.193 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374978+0000", 2024-09-13T06:42:08.193 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5899000000000001e-05 2024-09-13T06:42:08.193 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.193 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.194 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:08.194 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.375106+0000", 2024-09-13T06:42:08.194 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00012789 2024-09-13T06:42:08.194 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.194 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.194 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:42:08.194 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.375134+0000", 2024-09-13T06:42:08.194 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.8254000000000001e-05 2024-09-13T06:42:08.194 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.194 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.195 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:08.195 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.377082+0000", 2024-09-13T06:42:08.195 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0019471520000001 2024-09-13T06:42:08.195 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.195 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.195 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:08.195 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.377330+0000", 2024-09-13T06:42:08.195 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00024834199999999997 2024-09-13T06:42:08.195 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.195 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.195 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:08.195 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.377708+0000", 2024-09-13T06:42:08.195 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00037817100000000001 2024-09-13T06:42:08.195 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:08.196 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:08.196 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:08.196 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.196 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.196 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:37851 3.9 3:951cb95b:::rbd_data.1121d8143c6e.0000000000000002:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e56)", 2024-09-13T06:42:08.196 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:06.382636+0000", 2024-09-13T06:42:08.196 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 121.789355728, 2024-09-13T06:42:08.196 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.99582539400000003, 2024-09-13T06:42:08.196 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:08.196 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:08.196 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:08.196 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:08.196 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:08.197 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 37851 2024-09-13T06:42:08.197 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.197 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:08.197 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.197 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:08.197 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.382636+0000", 2024-09-13T06:42:08.197 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:08.197 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.197 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.197 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:08.197 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.382636+0000", 2024-09-13T06:42:08.197 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:08.197 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.197 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.198 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:08.198 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.382633+0000", 2024-09-13T06:42:08.198 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999971 2024-09-13T06:42:08.198 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.198 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.198 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:08.198 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.382652+0000", 2024-09-13T06:42:08.198 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8834999999999998e-05 2024-09-13T06:42:08.198 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.198 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.198 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:08.198 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.382695+0000", 2024-09-13T06:42:08.198 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.3136000000000002e-05 2024-09-13T06:42:08.199 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.199 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.199 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:08.199 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.382716+0000", 2024-09-13T06:42:08.199 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1421e-05 2024-09-13T06:42:08.199 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.199 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.199 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:08.199 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.382860+0000", 2024-09-13T06:42:08.199 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00014389200000000001 2024-09-13T06:42:08.199 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.199 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.199 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:42:08.199 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.382890+0000", 2024-09-13T06:42:08.200 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9827000000000001e-05 2024-09-13T06:42:08.200 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.200 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.200 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:08.200 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.377779+0000", 2024-09-13T06:42:08.200 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.99488842899999996 2024-09-13T06:42:08.200 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.200 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.200 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:08.200 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.378007+0000", 2024-09-13T06:42:08.200 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00022838099999999999 2024-09-13T06:42:08.200 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.200 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.201 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:08.201 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.378462+0000", 2024-09-13T06:42:08.201 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00045452300000000003 2024-09-13T06:42:08.201 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:08.201 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:08.201 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:08.201 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.201 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.201 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:37866 3.9 3:951cb95b:::rbd_data.1121d8143c6e.0000000000000002:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e56)", 2024-09-13T06:42:08.201 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:06.383951+0000", 2024-09-13T06:42:08.201 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 121.788041042, 2024-09-13T06:42:08.201 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.99517962299999996, 2024-09-13T06:42:08.201 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:08.202 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:08.202 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:08.202 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:08.202 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:08.202 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 37866 2024-09-13T06:42:08.202 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.202 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:08.202 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.202 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:08.202 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.383951+0000", 2024-09-13T06:42:08.202 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:08.202 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.202 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.202 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:08.203 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.383951+0000", 2024-09-13T06:42:08.203 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:08.203 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.203 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.203 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:08.203 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.383949+0000", 2024-09-13T06:42:08.203 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999981 2024-09-13T06:42:08.203 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.203 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.203 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:08.203 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.383961+0000", 2024-09-13T06:42:08.203 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1999e-05 2024-09-13T06:42:08.203 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.204 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.204 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:08.204 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384019+0000", 2024-09-13T06:42:08.204 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7621000000000003e-05 2024-09-13T06:42:08.204 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.204 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.204 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:08.204 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384040+0000", 2024-09-13T06:42:08.204 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1528000000000001e-05 2024-09-13T06:42:08.204 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.204 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.204 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:08.204 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384186+0000", 2024-09-13T06:42:08.205 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00014573799999999999 2024-09-13T06:42:08.205 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.205 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.205 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:42:08.205 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384204+0000", 2024-09-13T06:42:08.205 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7992e-05 2024-09-13T06:42:08.205 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.205 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.205 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:08.205 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.378536+0000", 2024-09-13T06:42:08.205 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.99433268600000002 2024-09-13T06:42:08.206 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.206 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.206 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:08.206 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.378771+0000", 2024-09-13T06:42:08.206 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00023445399999999999 2024-09-13T06:42:08.206 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.206 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.206 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:08.206 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.379130+0000", 2024-09-13T06:42:08.206 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00035954200000000002 2024-09-13T06:42:08.206 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:08.206 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:08.206 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:08.206 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.206 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.207 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:37881 3.9 3:951cb95b:::rbd_data.1121d8143c6e.0000000000000002:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e56)", 2024-09-13T06:42:08.207 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:06.384239+0000", 2024-09-13T06:42:08.207 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 121.78775262800001, 2024-09-13T06:42:08.207 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.99541483500000005, 2024-09-13T06:42:08.207 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:08.207 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:08.207 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:08.207 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:08.207 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:08.207 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 37881 2024-09-13T06:42:08.207 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.207 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:08.207 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.208 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:08.208 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384239+0000", 2024-09-13T06:42:08.208 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:08.208 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.208 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.208 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:08.208 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384239+0000", 2024-09-13T06:42:08.208 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:08.208 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.208 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.208 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:08.208 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384238+0000", 2024-09-13T06:42:08.208 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999986 2024-09-13T06:42:08.208 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.208 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.209 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:08.209 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384246+0000", 2024-09-13T06:42:08.209 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.2449999999999998e-06 2024-09-13T06:42:08.209 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.209 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.209 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:08.209 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384268+0000", 2024-09-13T06:42:08.209 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1518e-05 2024-09-13T06:42:08.209 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.209 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.209 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:08.209 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384282+0000", 2024-09-13T06:42:08.209 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4501999999999999e-05 2024-09-13T06:42:08.209 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.209 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.210 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:08.210 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384356+0000", 2024-09-13T06:42:08.210 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4265999999999997e-05 2024-09-13T06:42:08.210 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.210 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.210 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:42:08.210 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384370+0000", 2024-09-13T06:42:08.210 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3942e-05 2024-09-13T06:42:08.210 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.210 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.210 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:08.210 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.379199+0000", 2024-09-13T06:42:08.210 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.99482866599999997 2024-09-13T06:42:08.210 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.210 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.211 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:08.211 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.379347+0000", 2024-09-13T06:42:08.211 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00014749199999999999 2024-09-13T06:42:08.211 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.211 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.211 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:08.211 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.379654+0000", 2024-09-13T06:42:08.211 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00030752999999999998 2024-09-13T06:42:08.211 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:08.211 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:08.211 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:08.211 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.211 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.211 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:37896 3.9 3:951cb95b:::rbd_data.1121d8143c6e.0000000000000002:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e56)", 2024-09-13T06:42:08.212 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:06.384412+0000", 2024-09-13T06:42:08.212 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 121.787580195, 2024-09-13T06:42:08.212 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.99777835999999998, 2024-09-13T06:42:08.212 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:08.212 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:08.212 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:08.212 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:08.212 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:08.212 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 37896 2024-09-13T06:42:08.212 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.212 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:08.212 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.212 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:08.212 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384412+0000", 2024-09-13T06:42:08.213 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:08.213 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.213 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.213 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:08.213 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384412+0000", 2024-09-13T06:42:08.213 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:08.213 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.213 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.213 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:08.213 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384410+0000", 2024-09-13T06:42:08.213 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.999999 2024-09-13T06:42:08.213 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.213 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.213 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:08.214 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384418+0000", 2024-09-13T06:42:08.214 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.486e-06 2024-09-13T06:42:08.214 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.214 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.214 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:08.214 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384436+0000", 2024-09-13T06:42:08.214 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7668000000000001e-05 2024-09-13T06:42:08.214 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.214 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.214 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:08.214 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384449+0000", 2024-09-13T06:42:08.214 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3395e-05 2024-09-13T06:42:08.214 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.215 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.215 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:08.215 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384605+0000", 2024-09-13T06:42:08.215 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00015563099999999999 2024-09-13T06:42:08.215 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.215 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.215 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:42:08.215 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384635+0000", 2024-09-13T06:42:08.215 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.0383999999999999e-05 2024-09-13T06:42:08.215 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.215 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.215 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:08.215 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.379730+0000", 2024-09-13T06:42:08.216 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.99509493999999998 2024-09-13T06:42:08.216 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.216 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.216 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:08.216 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.379964+0000", 2024-09-13T06:42:08.216 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00023353499999999999 2024-09-13T06:42:08.216 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.216 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.216 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:08.216 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.382190+0000", 2024-09-13T06:42:08.216 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0022265039999999998 2024-09-13T06:42:08.216 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:08.216 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:08.216 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:08.217 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.217 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.217 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43222 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 389120~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:42:08.217 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558181+0000", 2024-09-13T06:42:08.217 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 106.613810941, 2024-09-13T06:42:08.217 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.06252038, 2024-09-13T06:42:08.217 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:08.217 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:08.217 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:08.217 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:08.217 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:08.217 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43222 2024-09-13T06:42:08.217 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.218 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:08.218 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.218 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:08.218 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558181+0000", 2024-09-13T06:42:08.218 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:08.218 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.218 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.218 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:08.218 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558181+0000", 2024-09-13T06:42:08.218 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:08.218 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.218 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.218 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:08.219 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558181+0000", 2024-09-13T06:42:08.219 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:08.219 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.219 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.219 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:08.219 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558183+0000", 2024-09-13T06:42:08.219 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.857e-06 2024-09-13T06:42:08.219 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.219 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.219 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:08.219 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558188+0000", 2024-09-13T06:42:08.219 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3759999999999999e-06 2024-09-13T06:42:08.220 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.220 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.220 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:08.220 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558261+0000", 2024-09-13T06:42:08.220 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3097999999999997e-05 2024-09-13T06:42:08.220 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.220 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.220 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:08.220 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.620354+0000", 2024-09-13T06:42:08.220 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.062092587999999997 2024-09-13T06:42:08.220 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.220 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.220 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:08.221 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.620428+0000", 2024-09-13T06:42:08.221 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3954000000000004e-05 2024-09-13T06:42:08.221 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.221 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.221 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:08.221 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.620701+0000", 2024-09-13T06:42:08.221 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000273773 2024-09-13T06:42:08.221 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:08.221 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:08.221 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:08.221 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.221 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.221 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43223 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 393216~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:42:08.222 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558267+0000", 2024-09-13T06:42:08.222 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 106.61372488400001, 2024-09-13T06:42:08.222 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.062813151999999997, 2024-09-13T06:42:08.222 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:08.222 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:08.222 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:08.222 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:08.222 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:08.222 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43223 2024-09-13T06:42:08.222 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.222 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:08.222 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.222 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:08.222 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558267+0000", 2024-09-13T06:42:08.223 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:08.223 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.223 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.223 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:08.223 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558267+0000", 2024-09-13T06:42:08.223 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:08.223 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.223 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.223 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:08.223 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558266+0000", 2024-09-13T06:42:08.223 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:08.223 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.223 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.224 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:08.224 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558270+0000", 2024-09-13T06:42:08.224 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.2389999999999998e-06 2024-09-13T06:42:08.224 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.224 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.224 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:08.224 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558277+0000", 2024-09-13T06:42:08.224 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5680000000000002e-06 2024-09-13T06:42:08.224 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.224 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.224 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:08.224 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558282+0000", 2024-09-13T06:42:08.225 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7060000000000003e-06 2024-09-13T06:42:08.225 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.225 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.225 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:08.225 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.620731+0000", 2024-09-13T06:42:08.225 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.062448661000000003 2024-09-13T06:42:08.225 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.225 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.225 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:08.225 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.620806+0000", 2024-09-13T06:42:08.225 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5862e-05 2024-09-13T06:42:08.225 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.225 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.226 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:08.226 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.621080+0000", 2024-09-13T06:42:08.226 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00027368599999999998 2024-09-13T06:42:08.226 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:08.226 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:08.226 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:08.226 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.226 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.226 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43224 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 407552~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:42:08.226 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558286+0000", 2024-09-13T06:42:08.226 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 106.61370552, 2024-09-13T06:42:08.226 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.063179052999999999, 2024-09-13T06:42:08.226 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:08.226 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:08.227 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:08.227 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:08.227 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:08.227 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43224 2024-09-13T06:42:08.227 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.227 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:08.227 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.227 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:08.227 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558286+0000", 2024-09-13T06:42:08.227 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:08.227 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.227 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.227 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:08.227 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558286+0000", 2024-09-13T06:42:08.228 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:08.228 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.228 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.228 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:08.228 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558286+0000", 2024-09-13T06:42:08.228 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:08.228 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.228 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.228 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:08.228 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558288+0000", 2024-09-13T06:42:08.228 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.227e-06 2024-09-13T06:42:08.228 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.228 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.228 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:08.229 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558292+0000", 2024-09-13T06:42:08.229 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.6289999999999999e-06 2024-09-13T06:42:08.229 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.229 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.229 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:08.229 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558294+0000", 2024-09-13T06:42:08.229 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5409999999999999e-06 2024-09-13T06:42:08.229 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.229 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.229 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:08.229 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.621110+0000", 2024-09-13T06:42:08.229 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.062815776000000004 2024-09-13T06:42:08.229 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.230 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.230 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:08.230 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.621186+0000", 2024-09-13T06:42:08.230 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5570999999999999e-05 2024-09-13T06:42:08.230 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.230 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.230 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:08.230 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.621465+0000", 2024-09-13T06:42:08.230 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00027988200000000001 2024-09-13T06:42:08.230 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:08.230 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:08.230 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:08.230 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.230 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.231 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43225 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 421888~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:42:08.231 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558296+0000", 2024-09-13T06:42:08.231 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 106.613695553, 2024-09-13T06:42:08.231 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.063551110999999993, 2024-09-13T06:42:08.231 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:08.231 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:08.231 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:08.231 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:08.231 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:08.231 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43225 2024-09-13T06:42:08.231 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.231 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:08.231 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.231 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:08.232 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558296+0000", 2024-09-13T06:42:08.232 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:08.232 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.232 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.232 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:08.232 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558296+0000", 2024-09-13T06:42:08.232 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:08.232 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.232 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.232 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:08.232 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558296+0000", 2024-09-13T06:42:08.232 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:42:08.232 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.233 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.233 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:08.233 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558305+0000", 2024-09-13T06:42:08.233 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.5290000000000008e-06 2024-09-13T06:42:08.233 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.233 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.233 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:08.233 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558308+0000", 2024-09-13T06:42:08.233 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.5619999999999999e-06 2024-09-13T06:42:08.233 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.233 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.233 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:08.233 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558311+0000", 2024-09-13T06:42:08.234 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.43e-06 2024-09-13T06:42:08.234 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.234 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.234 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:08.234 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.621495+0000", 2024-09-13T06:42:08.234 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.063184289000000005 2024-09-13T06:42:08.234 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.234 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.234 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:08.234 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.621569+0000", 2024-09-13T06:42:08.234 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4250000000000002e-05 2024-09-13T06:42:08.234 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.234 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.234 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:08.234 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.621847+0000", 2024-09-13T06:42:08.235 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00027826400000000002 2024-09-13T06:42:08.235 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:08.235 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:08.235 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:08.235 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.235 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.235 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43226 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 436224~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:42:08.235 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558313+0000", 2024-09-13T06:42:08.235 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 106.613678917, 2024-09-13T06:42:08.235 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.063914420999999999, 2024-09-13T06:42:08.235 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:08.235 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:08.235 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:08.235 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:08.235 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:08.235 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43226 2024-09-13T06:42:08.236 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.236 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:08.236 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.236 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:08.236 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558313+0000", 2024-09-13T06:42:08.236 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:08.236 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.236 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.236 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:08.236 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558313+0000", 2024-09-13T06:42:08.236 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:08.236 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.236 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.236 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:08.236 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558313+0000", 2024-09-13T06:42:08.237 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:08.237 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.237 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.237 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:08.237 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558314+0000", 2024-09-13T06:42:08.237 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3740000000000001e-06 2024-09-13T06:42:08.237 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.237 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.237 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:08.237 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558317+0000", 2024-09-13T06:42:08.237 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9730000000000002e-06 2024-09-13T06:42:08.237 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.237 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.237 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:08.238 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558319+0000", 2024-09-13T06:42:08.238 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4059999999999999e-06 2024-09-13T06:42:08.238 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.238 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.238 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:08.238 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.621877+0000", 2024-09-13T06:42:08.238 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.063557408999999995 2024-09-13T06:42:08.238 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.238 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.238 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:08.238 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.621951+0000", 2024-09-13T06:42:08.238 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4487999999999996e-05 2024-09-13T06:42:08.238 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.239 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.239 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:08.239 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.622227+0000", 2024-09-13T06:42:08.239 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000276011 2024-09-13T06:42:08.239 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:08.239 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:08.239 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:08.239 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.239 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.239 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43227 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 450560~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:42:08.239 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558322+0000", 2024-09-13T06:42:08.239 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 106.613670336, 2024-09-13T06:42:08.239 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.064285348000000006, 2024-09-13T06:42:08.239 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:08.239 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:08.239 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:08.240 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:08.240 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:08.240 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43227 2024-09-13T06:42:08.240 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.240 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:08.240 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.240 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:08.240 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558322+0000", 2024-09-13T06:42:08.240 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:08.240 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.240 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.240 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:08.240 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558322+0000", 2024-09-13T06:42:08.241 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:08.241 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.241 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.241 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:08.241 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558321+0000", 2024-09-13T06:42:08.241 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:42:08.241 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.241 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.241 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:08.241 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558323+0000", 2024-09-13T06:42:08.241 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.576e-06 2024-09-13T06:42:08.241 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.241 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.242 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:08.242 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558328+0000", 2024-09-13T06:42:08.242 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0719999999999999e-06 2024-09-13T06:42:08.242 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.242 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.242 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:08.242 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558332+0000", 2024-09-13T06:42:08.242 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.8130000000000002e-06 2024-09-13T06:42:08.242 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.242 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.242 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:08.242 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.622255+0000", 2024-09-13T06:42:08.242 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.063923195000000002 2024-09-13T06:42:08.242 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.243 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.243 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:08.243 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.622330+0000", 2024-09-13T06:42:08.243 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5383000000000007e-05 2024-09-13T06:42:08.243 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.243 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.243 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:08.243 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.622607+0000", 2024-09-13T06:42:08.243 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00027651999999999999 2024-09-13T06:42:08.243 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:08.243 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:08.243 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:08.243 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.243 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.244 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43228 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 464896~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:42:08.244 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558335+0000", 2024-09-13T06:42:08.244 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 106.613656427, 2024-09-13T06:42:08.244 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.064652253000000007, 2024-09-13T06:42:08.244 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:08.244 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:08.244 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:08.244 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:08.244 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:08.244 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43228 2024-09-13T06:42:08.244 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.244 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:08.244 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.244 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:08.245 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558335+0000", 2024-09-13T06:42:08.245 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:08.245 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.245 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.245 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:08.245 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558335+0000", 2024-09-13T06:42:08.245 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:08.245 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.245 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.245 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:08.245 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558335+0000", 2024-09-13T06:42:08.245 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:08.245 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.246 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.246 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:08.246 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558337+0000", 2024-09-13T06:42:08.246 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1380000000000001e-06 2024-09-13T06:42:08.246 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.246 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.246 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:08.246 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558343+0000", 2024-09-13T06:42:08.246 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.5140000000000001e-06 2024-09-13T06:42:08.246 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.246 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.246 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:08.246 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558348+0000", 2024-09-13T06:42:08.247 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9640000000000002e-06 2024-09-13T06:42:08.247 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.247 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.247 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:08.247 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.622636+0000", 2024-09-13T06:42:08.247 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.064288260999999999 2024-09-13T06:42:08.247 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.247 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.247 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:08.247 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.622715+0000", 2024-09-13T06:42:08.247 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.9351000000000006e-05 2024-09-13T06:42:08.247 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.247 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.248 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:08.248 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.622988+0000", 2024-09-13T06:42:08.248 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00027242599999999998 2024-09-13T06:42:08.248 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:08.248 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:08.248 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:08.248 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.248 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.248 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43229 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 479232~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:42:08.248 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558352+0000", 2024-09-13T06:42:08.248 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 106.613640012, 2024-09-13T06:42:08.248 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.065018024999999993, 2024-09-13T06:42:08.248 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:08.248 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:08.249 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:08.249 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:08.249 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:08.249 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43229 2024-09-13T06:42:08.249 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.249 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:08.249 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.249 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:08.249 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558352+0000", 2024-09-13T06:42:08.249 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:08.249 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.249 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.249 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:08.249 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558352+0000", 2024-09-13T06:42:08.250 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:08.250 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.250 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.250 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:08.250 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558352+0000", 2024-09-13T06:42:08.250 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:08.250 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.250 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.250 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:08.250 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558354+0000", 2024-09-13T06:42:08.250 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4930000000000001e-06 2024-09-13T06:42:08.250 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.250 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.251 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:08.251 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558360+0000", 2024-09-13T06:42:08.251 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.263e-06 2024-09-13T06:42:08.251 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.251 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.251 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:08.251 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558369+0000", 2024-09-13T06:42:08.251 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.0829999999999993e-06 2024-09-13T06:42:08.251 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.251 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.251 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:08.251 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.623017+0000", 2024-09-13T06:42:08.251 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.064647799000000006 2024-09-13T06:42:08.251 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.252 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.252 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:08.252 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.623090+0000", 2024-09-13T06:42:08.252 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3071000000000006e-05 2024-09-13T06:42:08.252 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.252 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.252 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:08.252 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.623370+0000", 2024-09-13T06:42:08.252 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000279661 2024-09-13T06:42:08.252 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:08.252 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:08.252 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:08.252 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.253 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.253 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43230 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 493568~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:42:08.253 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558374+0000", 2024-09-13T06:42:08.253 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 106.613617719, 2024-09-13T06:42:08.253 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.065410435000000003, 2024-09-13T06:42:08.253 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:08.253 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:08.253 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:08.253 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:08.253 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:08.253 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43230 2024-09-13T06:42:08.253 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.253 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:08.254 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.254 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:08.254 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558374+0000", 2024-09-13T06:42:08.254 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:08.254 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.254 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.254 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:08.254 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558374+0000", 2024-09-13T06:42:08.254 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:08.254 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.254 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.254 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:08.254 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558374+0000", 2024-09-13T06:42:08.254 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:08.255 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.255 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.255 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:08.255 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558376+0000", 2024-09-13T06:42:08.255 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4430000000000002e-06 2024-09-13T06:42:08.255 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.255 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.255 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:08.255 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558382+0000", 2024-09-13T06:42:08.255 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3029999999999996e-06 2024-09-13T06:42:08.255 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.255 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.255 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:08.256 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558387+0000", 2024-09-13T06:42:08.256 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.1699999999999999e-06 2024-09-13T06:42:08.256 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.256 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.256 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:08.256 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.623400+0000", 2024-09-13T06:42:08.256 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.065013244999999997 2024-09-13T06:42:08.256 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.256 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.256 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:08.256 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.623474+0000", 2024-09-13T06:42:08.256 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3889999999999999e-05 2024-09-13T06:42:08.256 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.256 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.257 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:08.257 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.623785+0000", 2024-09-13T06:42:08.257 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00031080099999999998 2024-09-13T06:42:08.257 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:08.257 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:08.257 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:08.257 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.257 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.257 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43231 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 507904~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:42:08.257 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558391+0000", 2024-09-13T06:42:08.257 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 106.613601034, 2024-09-13T06:42:08.257 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.065788597000000004, 2024-09-13T06:42:08.257 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:08.258 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:08.258 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:08.258 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:08.258 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:08.258 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43231 2024-09-13T06:42:08.258 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.258 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:08.258 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.258 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:08.258 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558391+0000", 2024-09-13T06:42:08.258 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:08.258 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.258 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.258 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:08.259 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558391+0000", 2024-09-13T06:42:08.259 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:08.259 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.259 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.259 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:08.259 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558390+0000", 2024-09-13T06:42:08.259 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:08.259 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.259 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.259 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:08.259 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558393+0000", 2024-09-13T06:42:08.259 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2570000000000002e-06 2024-09-13T06:42:08.259 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.260 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.260 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:08.260 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558399+0000", 2024-09-13T06:42:08.260 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0419999999999999e-06 2024-09-13T06:42:08.260 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.260 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.260 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:08.260 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558403+0000", 2024-09-13T06:42:08.260 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6249999999999998e-06 2024-09-13T06:42:08.260 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.260 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.260 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:08.261 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.623811+0000", 2024-09-13T06:42:08.261 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.065407549999999995 2024-09-13T06:42:08.261 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.261 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.261 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:08.261 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.623877+0000", 2024-09-13T06:42:08.261 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.5902999999999996e-05 2024-09-13T06:42:08.261 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.261 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.261 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:08.261 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.624179+0000", 2024-09-13T06:42:08.261 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00030259999999999998 2024-09-13T06:42:08.261 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:08.262 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:08.262 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:08.262 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.262 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.262 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43232 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 522240~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:42:08.262 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558422+0000", 2024-09-13T06:42:08.262 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 106.61357025700001, 2024-09-13T06:42:08.262 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.066176061999999994, 2024-09-13T06:42:08.262 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:08.262 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:08.262 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:08.262 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:08.262 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:08.263 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43232 2024-09-13T06:42:08.263 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.263 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:08.263 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.263 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:08.263 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558422+0000", 2024-09-13T06:42:08.263 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:08.263 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.263 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.263 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:08.263 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558422+0000", 2024-09-13T06:42:08.263 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:08.263 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.264 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.264 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:08.264 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558421+0000", 2024-09-13T06:42:08.264 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:08.264 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.264 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.264 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:08.264 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558428+0000", 2024-09-13T06:42:08.264 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.1690000000000003e-06 2024-09-13T06:42:08.264 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.264 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.264 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:08.264 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558434+0000", 2024-09-13T06:42:08.264 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9309999999999996e-06 2024-09-13T06:42:08.265 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.265 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.265 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:08.265 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558447+0000", 2024-09-13T06:42:08.265 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.271e-05 2024-09-13T06:42:08.265 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.265 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.265 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:08.265 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.624209+0000", 2024-09-13T06:42:08.265 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.065762102000000003 2024-09-13T06:42:08.265 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.265 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.265 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:08.266 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.624282+0000", 2024-09-13T06:42:08.266 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.2889e-05 2024-09-13T06:42:08.266 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.266 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.266 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:08.266 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.624598+0000", 2024-09-13T06:42:08.266 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00031591399999999998 2024-09-13T06:42:08.266 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:08.266 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:08.266 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:08.266 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.266 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.266 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43486 3.f 3:f7da9c8f:::rbd_data.1121f5f2e1c0.000000000000000b:1f [read 260096~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:42:08.267 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.569088+0000", 2024-09-13T06:42:08.267 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 106.60290353400001, 2024-09-13T06:42:08.267 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.062579223000000003, 2024-09-13T06:42:08.267 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:08.267 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:08.267 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:08.267 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:08.267 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:08.267 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43486 2024-09-13T06:42:08.267 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.267 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:08.267 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.267 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:08.267 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.569088+0000", 2024-09-13T06:42:08.268 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:08.268 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.268 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.268 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:08.268 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.569088+0000", 2024-09-13T06:42:08.268 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:08.268 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.268 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.268 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:08.268 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.569088+0000", 2024-09-13T06:42:08.268 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:08.268 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.268 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.269 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:08.269 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.569091+0000", 2024-09-13T06:42:08.269 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9629999999999998e-06 2024-09-13T06:42:08.269 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.269 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.269 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:08.269 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.569097+0000", 2024-09-13T06:42:08.269 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.4160000000000001e-06 2024-09-13T06:42:08.269 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.269 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.269 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:08.269 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.569102+0000", 2024-09-13T06:42:08.269 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6659999999999999e-06 2024-09-13T06:42:08.270 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.270 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.270 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:08.270 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.631346+0000", 2024-09-13T06:42:08.270 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.062243896 2024-09-13T06:42:08.270 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.270 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.270 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:08.270 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.631413+0000", 2024-09-13T06:42:08.270 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.7638000000000005e-05 2024-09-13T06:42:08.270 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.270 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.270 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:08.270 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.631668+0000", 2024-09-13T06:42:08.271 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0002541 2024-09-13T06:42:08.271 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:08.271 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:08.271 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:08.271 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:08.271 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:08.271 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:42:08.272 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-13T06:42:08.273 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:42:08.269+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:42:08.373 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:42:08.369+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:42:08.440 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:42:08.440 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-13T06:42:08.440 INFO:teuthology.orchestra.run.smithi081.stdout: "num_ops": 0 2024-09-13T06:42:08.441 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:42:08.455 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-13T06:42:08.498 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:42:08.497+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:42:08.575 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:42:08.573+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:42:08.614 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:42:08.615 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-13T06:42:08.615 INFO:teuthology.orchestra.run.smithi081.stdout: "complaint_time": 30, 2024-09-13T06:42:08.615 INFO:teuthology.orchestra.run.smithi081.stdout: "num_blocked_ops": 0 2024-09-13T06:42:08.615 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:42:08.629 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-13T06:42:08.718 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:42:08.717+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:42:08.777 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:42:08.773+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:42:08.789 INFO:teuthology.orchestra.run.smithi081.stderr:noscrub is unset 2024-09-13T06:42:08.801 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:42:08.801 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 20, 2024-09-13T06:42:08.802 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 600, 2024-09-13T06:42:08.802 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [ 2024-09-13T06:42:08.802 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.802 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:2226 3.15 3:af026987:::rbd_data.112173e2f1b7.0000000000000017:head [sparse-read 0~4194304] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-13T06:42:08.802 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:37.606562+0000", 2024-09-13T06:42:08.802 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 151.194978255, 2024-09-13T06:42:08.802 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.83322091700000001, 2024-09-13T06:42:08.802 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:08.802 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:42:08.802 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:08.803 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:08.803 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:08.803 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 2226 2024-09-13T06:42:08.803 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.803 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:08.803 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.803 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:08.803 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606562+0000", 2024-09-13T06:42:08.803 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:08.803 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.803 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.804 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:08.804 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606562+0000", 2024-09-13T06:42:08.804 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:08.804 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.804 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.804 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:08.804 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606561+0000", 2024-09-13T06:42:08.804 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:08.804 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.804 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.804 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:08.804 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606565+0000", 2024-09-13T06:42:08.805 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.4379999999999999e-06 2024-09-13T06:42:08.805 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.805 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.805 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:08.805 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606569+0000", 2024-09-13T06:42:08.805 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.425e-06 2024-09-13T06:42:08.805 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.805 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.805 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:08.805 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606572+0000", 2024-09-13T06:42:08.805 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.05e-06 2024-09-13T06:42:08.806 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.806 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.806 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:08.806 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606621+0000", 2024-09-13T06:42:08.806 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.8723000000000001e-05 2024-09-13T06:42:08.806 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.806 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.806 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:42:08.806 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606630+0000", 2024-09-13T06:42:08.806 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.8040000000000007e-06 2024-09-13T06:42:08.806 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.806 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.807 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:08.807 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.439648+0000", 2024-09-13T06:42:08.807 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.83301824800000002 2024-09-13T06:42:08.807 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.807 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.807 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:08.807 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.439782+0000", 2024-09-13T06:42:08.807 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00013466699999999999 2024-09-13T06:42:08.807 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:08.807 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:08.807 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:08.807 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.808 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.808 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25661 3.8 3:1180686c:::rbd_data.1121f2c5ee81.0000000000000009:13 [read 397312~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:42:08.808 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.436956+0000", 2024-09-13T06:42:08.808 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 132.364583721, 2024-09-13T06:42:08.808 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089036758999999993, 2024-09-13T06:42:08.808 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:08.808 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:08.808 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:08.808 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:08.808 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:08.808 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25661 2024-09-13T06:42:08.809 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.809 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:08.809 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.809 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:08.809 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436956+0000", 2024-09-13T06:42:08.809 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:08.809 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.809 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.809 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:08.809 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436956+0000", 2024-09-13T06:42:08.809 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:08.809 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.810 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.810 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:08.810 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436956+0000", 2024-09-13T06:42:08.810 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:08.810 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.810 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.810 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:08.810 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436958+0000", 2024-09-13T06:42:08.810 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1770000000000001e-06 2024-09-13T06:42:08.810 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.810 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.810 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:08.811 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436963+0000", 2024-09-13T06:42:08.811 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.6489999999999996e-06 2024-09-13T06:42:08.811 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.811 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.811 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:08.811 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436975+0000", 2024-09-13T06:42:08.811 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1783999999999999e-05 2024-09-13T06:42:08.811 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.811 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.811 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:08.811 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.525671+0000", 2024-09-13T06:42:08.811 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.088696292999999995 2024-09-13T06:42:08.812 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.812 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.812 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:08.812 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.525749+0000", 2024-09-13T06:42:08.812 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.7589000000000005e-05 2024-09-13T06:42:08.812 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.812 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.812 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:08.812 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.525993+0000", 2024-09-13T06:42:08.812 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00024381000000000001 2024-09-13T06:42:08.812 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:08.813 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:08.813 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:08.813 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.813 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.813 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25662 3.8 3:1180686c:::rbd_data.1121f2c5ee81.0000000000000009:13 [read 421888~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:42:08.813 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.436980+0000", 2024-09-13T06:42:08.813 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 132.36455940900001, 2024-09-13T06:42:08.813 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089367577000000004, 2024-09-13T06:42:08.813 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:08.813 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:08.813 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:08.813 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:08.814 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:08.814 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25662 2024-09-13T06:42:08.814 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.814 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:08.814 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.814 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:08.814 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436980+0000", 2024-09-13T06:42:08.814 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:08.814 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.814 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.814 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:08.814 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436980+0000", 2024-09-13T06:42:08.815 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:08.815 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.815 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.815 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:08.815 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436980+0000", 2024-09-13T06:42:08.815 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:08.815 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.815 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.815 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:08.815 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436982+0000", 2024-09-13T06:42:08.815 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3989999999999998e-06 2024-09-13T06:42:08.815 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.816 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.816 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:08.816 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436988+0000", 2024-09-13T06:42:08.816 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0039999999999996e-06 2024-09-13T06:42:08.816 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.816 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.816 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:08.816 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436993+0000", 2024-09-13T06:42:08.816 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6090000000000003e-06 2024-09-13T06:42:08.816 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.816 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.817 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:08.817 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.526035+0000", 2024-09-13T06:42:08.817 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089042248000000004 2024-09-13T06:42:08.817 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.817 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.817 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:08.817 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.526111+0000", 2024-09-13T06:42:08.817 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5643999999999996e-05 2024-09-13T06:42:08.817 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.817 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.817 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:08.817 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.526348+0000", 2024-09-13T06:42:08.818 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00023705800000000001 2024-09-13T06:42:08.818 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:08.818 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:08.818 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:08.818 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.818 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.818 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25663 3.8 3:1180686c:::rbd_data.1121f2c5ee81.0000000000000009:13 [read 466944~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:42:08.818 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.436998+0000", 2024-09-13T06:42:08.818 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 132.36454176199999, 2024-09-13T06:42:08.818 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089730867000000006, 2024-09-13T06:42:08.818 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:08.819 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:08.819 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:08.819 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:08.819 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:08.819 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25663 2024-09-13T06:42:08.819 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.819 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:08.819 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.819 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:08.819 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436998+0000", 2024-09-13T06:42:08.819 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:08.820 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.820 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.820 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:08.820 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436998+0000", 2024-09-13T06:42:08.820 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:08.820 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.820 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.820 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:08.820 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436998+0000", 2024-09-13T06:42:08.820 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:08.820 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.820 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.821 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:08.821 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437000+0000", 2024-09-13T06:42:08.821 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0940000000000002e-06 2024-09-13T06:42:08.821 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.821 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.821 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:08.821 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437005+0000", 2024-09-13T06:42:08.821 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.604e-06 2024-09-13T06:42:08.821 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.821 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.822 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:08.822 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437032+0000", 2024-09-13T06:42:08.822 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6407e-05 2024-09-13T06:42:08.822 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.822 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.822 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:08.822 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.526363+0000", 2024-09-13T06:42:08.822 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089331456000000004 2024-09-13T06:42:08.822 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.822 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.822 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:08.823 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.526404+0000", 2024-09-13T06:42:08.823 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.0887999999999999e-05 2024-09-13T06:42:08.823 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.823 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.823 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:08.823 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.526729+0000", 2024-09-13T06:42:08.823 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00032486 2024-09-13T06:42:08.823 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:08.823 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:08.823 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:08.823 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.824 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.824 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25664 3.8 3:1180686c:::rbd_data.1121f2c5ee81.0000000000000009:13 [read 491520~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:42:08.824 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.437040+0000", 2024-09-13T06:42:08.824 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 132.36449984699999, 2024-09-13T06:42:08.824 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.090016650000000004, 2024-09-13T06:42:08.824 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:08.824 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:08.824 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:08.824 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:08.824 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:08.825 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25664 2024-09-13T06:42:08.825 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.825 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:08.825 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.825 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:08.825 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437040+0000", 2024-09-13T06:42:08.825 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:08.825 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.825 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.825 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:08.825 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437040+0000", 2024-09-13T06:42:08.826 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:08.826 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.826 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.826 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:08.826 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437039+0000", 2024-09-13T06:42:08.826 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:08.826 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.826 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.826 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:08.826 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437047+0000", 2024-09-13T06:42:08.827 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4839999999999998e-06 2024-09-13T06:42:08.827 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.827 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.827 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:08.827 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437054+0000", 2024-09-13T06:42:08.827 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.8299999999999998e-06 2024-09-13T06:42:08.827 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.827 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.827 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:08.827 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437060+0000", 2024-09-13T06:42:08.827 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.1510000000000001e-06 2024-09-13T06:42:08.828 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.828 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.828 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:08.828 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.526772+0000", 2024-09-13T06:42:08.828 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089711737999999999 2024-09-13T06:42:08.828 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.828 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.828 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:08.828 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.526848+0000", 2024-09-13T06:42:08.828 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5870000000000004e-05 2024-09-13T06:42:08.828 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.829 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.829 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:08.829 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.527057+0000", 2024-09-13T06:42:08.829 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000209106 2024-09-13T06:42:08.829 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:08.829 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:08.829 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:08.829 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.829 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.829 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25740 3.18 3:1c662b96:::rbd_data.1121f2c5ee81.0000000000000010:13 [read 200704~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:42:08.829 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443352+0000", 2024-09-13T06:42:08.830 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 132.35818817200001, 2024-09-13T06:42:08.830 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089068222000000002, 2024-09-13T06:42:08.830 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:08.830 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:08.830 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:08.830 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:08.830 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:08.830 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25740 2024-09-13T06:42:08.830 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.830 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:08.830 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.830 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:08.831 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443352+0000", 2024-09-13T06:42:08.831 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:08.831 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.831 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.831 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:08.831 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443352+0000", 2024-09-13T06:42:08.831 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:08.831 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.831 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.831 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:08.831 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443351+0000", 2024-09-13T06:42:08.831 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:08.832 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.832 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.832 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:08.832 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443354+0000", 2024-09-13T06:42:08.832 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.841e-06 2024-09-13T06:42:08.832 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.832 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.832 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:08.832 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443361+0000", 2024-09-13T06:42:08.832 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.0010000000000004e-06 2024-09-13T06:42:08.832 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.833 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.833 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:08.833 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443366+0000", 2024-09-13T06:42:08.833 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7119999999999999e-06 2024-09-13T06:42:08.833 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.833 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.833 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:08.833 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532117+0000", 2024-09-13T06:42:08.833 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.088751327000000005 2024-09-13T06:42:08.833 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.833 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.833 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:08.834 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532193+0000", 2024-09-13T06:42:08.834 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5839000000000004e-05 2024-09-13T06:42:08.834 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.834 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.834 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:08.834 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532420+0000", 2024-09-13T06:42:08.834 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00022691000000000001 2024-09-13T06:42:08.834 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:08.834 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:08.834 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:08.834 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.835 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.835 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25741 3.18 3:1c662b96:::rbd_data.1121f2c5ee81.0000000000000010:13 [read 225280~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:42:08.835 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443378+0000", 2024-09-13T06:42:08.835 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 132.358161405, 2024-09-13T06:42:08.835 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089324107, 2024-09-13T06:42:08.835 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:08.835 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:08.835 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:08.835 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:08.835 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:08.835 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25741 2024-09-13T06:42:08.836 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.836 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:08.836 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.836 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:08.836 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443378+0000", 2024-09-13T06:42:08.836 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:08.836 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.836 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.836 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:08.836 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443378+0000", 2024-09-13T06:42:08.836 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:08.837 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.837 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.837 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:08.837 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443378+0000", 2024-09-13T06:42:08.837 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:08.837 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.837 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.837 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:08.837 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443380+0000", 2024-09-13T06:42:08.837 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3549999999999999e-06 2024-09-13T06:42:08.837 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.838 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.838 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:08.838 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443388+0000", 2024-09-13T06:42:08.838 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.7449999999999995e-06 2024-09-13T06:42:08.838 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.838 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.838 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:08.838 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443393+0000", 2024-09-13T06:42:08.838 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.4e-06 2024-09-13T06:42:08.838 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.838 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.838 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:08.839 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532454+0000", 2024-09-13T06:42:08.839 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089060941000000005 2024-09-13T06:42:08.839 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.839 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.839 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:08.839 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532512+0000", 2024-09-13T06:42:08.839 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7763000000000002e-05 2024-09-13T06:42:08.839 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.839 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.839 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:08.839 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532703+0000", 2024-09-13T06:42:08.839 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000190328 2024-09-13T06:42:08.840 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:08.840 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:08.840 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:08.840 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.840 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.840 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25742 3.18 3:1c662b96:::rbd_data.1121f2c5ee81.0000000000000010:13 [read 270336~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:42:08.840 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443398+0000", 2024-09-13T06:42:08.840 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 132.35814169299999, 2024-09-13T06:42:08.840 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089621836999999996, 2024-09-13T06:42:08.840 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:08.841 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:08.841 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:08.841 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:08.841 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:08.841 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25742 2024-09-13T06:42:08.841 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.841 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:08.841 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.841 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:08.841 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443398+0000", 2024-09-13T06:42:08.842 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:08.842 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.842 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.842 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:08.842 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443398+0000", 2024-09-13T06:42:08.842 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:08.842 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.842 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.842 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:08.842 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443398+0000", 2024-09-13T06:42:08.842 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:08.843 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.843 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.843 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:08.843 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443400+0000", 2024-09-13T06:42:08.843 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1849999999999998e-06 2024-09-13T06:42:08.843 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.843 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.843 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:08.843 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443407+0000", 2024-09-13T06:42:08.843 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3669999999999999e-06 2024-09-13T06:42:08.844 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.844 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.844 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:08.844 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443420+0000", 2024-09-13T06:42:08.844 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2645e-05 2024-09-13T06:42:08.844 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.844 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.844 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:08.844 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532742+0000", 2024-09-13T06:42:08.844 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089322200000000004 2024-09-13T06:42:08.844 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.844 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.845 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:08.845 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532818+0000", 2024-09-13T06:42:08.845 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.6019000000000005e-05 2024-09-13T06:42:08.845 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.845 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.845 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:08.845 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533020+0000", 2024-09-13T06:42:08.845 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000201721 2024-09-13T06:42:08.845 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:08.846 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:08.846 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:08.846 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.846 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.846 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25743 3.18 3:1c662b96:::rbd_data.1121f2c5ee81.0000000000000010:13 [read 294912~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:42:08.846 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443425+0000", 2024-09-13T06:42:08.846 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 132.358114685, 2024-09-13T06:42:08.846 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089864075000000002, 2024-09-13T06:42:08.846 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:08.846 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:08.846 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:08.847 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:08.847 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:08.847 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25743 2024-09-13T06:42:08.847 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.847 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:08.847 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.847 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:08.847 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443425+0000", 2024-09-13T06:42:08.847 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:08.847 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.847 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.847 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:08.848 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443425+0000", 2024-09-13T06:42:08.848 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:08.848 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.848 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.848 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:08.848 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443425+0000", 2024-09-13T06:42:08.849 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:08.849 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.849 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.849 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:08.849 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443432+0000", 2024-09-13T06:42:08.849 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3420000000000002e-06 2024-09-13T06:42:08.849 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.849 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.849 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:08.849 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443440+0000", 2024-09-13T06:42:08.849 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5689999999999999e-06 2024-09-13T06:42:08.850 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.850 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.850 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:08.850 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443445+0000", 2024-09-13T06:42:08.850 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9590000000000003e-06 2024-09-13T06:42:08.850 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.850 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.850 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:08.850 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533063+0000", 2024-09-13T06:42:08.850 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089617988999999995 2024-09-13T06:42:08.850 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.850 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.851 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:08.851 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533122+0000", 2024-09-13T06:42:08.851 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9052999999999999e-05 2024-09-13T06:42:08.851 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.851 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.851 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:08.851 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533289+0000", 2024-09-13T06:42:08.851 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00016752800000000001 2024-09-13T06:42:08.851 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:08.851 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:08.851 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:08.852 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.852 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.852 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25744 3.18 3.69d46638 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:42:08.852 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443449+0000", 2024-09-13T06:42:08.852 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 132.358090538, 2024-09-13T06:42:08.852 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089869148999999995, 2024-09-13T06:42:08.852 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:08.852 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:42:08.852 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:08.852 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:08.852 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:08.852 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25744 2024-09-13T06:42:08.853 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.853 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:08.853 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.853 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:08.853 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443449+0000", 2024-09-13T06:42:08.853 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:08.853 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.853 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.853 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:08.853 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443449+0000", 2024-09-13T06:42:08.853 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:08.854 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.854 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.854 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:08.854 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443449+0000", 2024-09-13T06:42:08.854 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:08.854 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.854 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.854 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:08.854 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443451+0000", 2024-09-13T06:42:08.854 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.244e-06 2024-09-13T06:42:08.854 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.855 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.855 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:08.855 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443457+0000", 2024-09-13T06:42:08.855 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.66e-06 2024-09-13T06:42:08.855 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.855 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.855 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:08.855 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443461+0000", 2024-09-13T06:42:08.855 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5449999999999997e-06 2024-09-13T06:42:08.855 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.855 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.856 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:08.856 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533311+0000", 2024-09-13T06:42:08.856 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089849729000000003 2024-09-13T06:42:08.856 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.856 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.856 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:08.856 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533318+0000", 2024-09-13T06:42:08.856 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.328e-06 2024-09-13T06:42:08.856 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:08.856 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:08.856 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:08.856 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.857 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.857 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25745 3.18 3.69d46638 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:42:08.857 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443466+0000", 2024-09-13T06:42:08.857 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 132.35807348, 2024-09-13T06:42:08.857 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089886743000000005, 2024-09-13T06:42:08.857 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:08.857 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:42:08.857 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:08.857 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:08.857 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:08.857 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25745 2024-09-13T06:42:08.858 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.858 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:08.858 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.858 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:08.858 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443466+0000", 2024-09-13T06:42:08.858 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:08.858 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.858 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.858 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:08.858 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443466+0000", 2024-09-13T06:42:08.858 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:08.858 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.858 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.859 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:08.859 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443466+0000", 2024-09-13T06:42:08.859 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:08.859 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.859 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.859 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:08.859 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443474+0000", 2024-09-13T06:42:08.859 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.1289999999999996e-06 2024-09-13T06:42:08.859 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.859 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.859 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:08.859 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443484+0000", 2024-09-13T06:42:08.860 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0654e-05 2024-09-13T06:42:08.860 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.860 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.860 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:08.860 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443490+0000", 2024-09-13T06:42:08.860 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8030000000000002e-06 2024-09-13T06:42:08.860 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.860 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.860 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:08.860 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533348+0000", 2024-09-13T06:42:08.860 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089857267000000005 2024-09-13T06:42:08.861 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.861 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.861 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:08.861 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533353+0000", 2024-09-13T06:42:08.861 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.5520000000000004e-06 2024-09-13T06:42:08.861 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:08.861 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:08.861 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:08.861 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.861 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.861 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25746 3.18 3.69d46638 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:42:08.862 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443495+0000", 2024-09-13T06:42:08.862 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 132.35804436699999, 2024-09-13T06:42:08.862 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089903725000000004, 2024-09-13T06:42:08.862 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:08.862 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:42:08.862 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:08.862 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:08.862 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:08.862 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25746 2024-09-13T06:42:08.862 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.862 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:08.863 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.863 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:08.863 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443495+0000", 2024-09-13T06:42:08.863 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:08.863 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.863 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.863 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:08.863 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443495+0000", 2024-09-13T06:42:08.863 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:08.863 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.863 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.864 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:08.864 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443495+0000", 2024-09-13T06:42:08.864 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:08.864 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.864 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.864 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:08.864 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443498+0000", 2024-09-13T06:42:08.864 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.7690000000000001e-06 2024-09-13T06:42:08.864 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.864 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.865 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:08.865 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443504+0000", 2024-09-13T06:42:08.865 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9710000000000001e-06 2024-09-13T06:42:08.865 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.865 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.865 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:08.865 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443508+0000", 2024-09-13T06:42:08.865 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4159999999999997e-06 2024-09-13T06:42:08.865 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.865 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.865 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:08.866 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533391+0000", 2024-09-13T06:42:08.866 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089882607000000003 2024-09-13T06:42:08.866 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.866 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.866 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:08.866 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533399+0000", 2024-09-13T06:42:08.866 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.4349999999999997e-06 2024-09-13T06:42:08.866 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:08.866 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:08.867 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:08.867 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.867 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.867 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25747 3.8 3.63996268 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:42:08.867 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443512+0000", 2024-09-13T06:42:08.867 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 132.358027636, 2024-09-13T06:42:08.867 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089880075000000004, 2024-09-13T06:42:08.867 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:08.867 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:42:08.867 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:08.867 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:08.868 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:08.868 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25747 2024-09-13T06:42:08.868 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.868 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:08.868 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.868 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:08.868 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443512+0000", 2024-09-13T06:42:08.868 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:08.868 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.868 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.869 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:08.869 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443512+0000", 2024-09-13T06:42:08.869 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:08.869 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.869 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.869 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:08.869 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443512+0000", 2024-09-13T06:42:08.869 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:08.869 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.869 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.869 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:08.869 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443514+0000", 2024-09-13T06:42:08.870 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0980000000000001e-06 2024-09-13T06:42:08.870 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.870 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.870 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:08.870 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443520+0000", 2024-09-13T06:42:08.870 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7069999999999997e-06 2024-09-13T06:42:08.870 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.870 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.870 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:08.870 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443524+0000", 2024-09-13T06:42:08.870 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5390000000000001e-06 2024-09-13T06:42:08.870 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.871 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.871 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:08.871 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533384+0000", 2024-09-13T06:42:08.871 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089859684999999995 2024-09-13T06:42:08.871 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.871 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.871 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:08.871 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533392+0000", 2024-09-13T06:42:08.871 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.3440000000000001e-06 2024-09-13T06:42:08.871 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:08.871 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:08.871 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:08.872 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.872 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.872 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25748 3.8 3.63996268 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:42:08.872 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443528+0000", 2024-09-13T06:42:08.872 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 132.35801150899999, 2024-09-13T06:42:08.872 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089890715999999996, 2024-09-13T06:42:08.872 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:08.872 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:42:08.872 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:08.872 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:08.872 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:08.873 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25748 2024-09-13T06:42:08.873 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.873 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:08.873 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.873 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:08.873 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443528+0000", 2024-09-13T06:42:08.873 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:08.873 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.873 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.874 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:08.874 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443528+0000", 2024-09-13T06:42:08.874 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:08.874 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.874 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.874 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:08.874 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443528+0000", 2024-09-13T06:42:08.874 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:08.874 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.874 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.874 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:08.874 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443530+0000", 2024-09-13T06:42:08.875 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0650000000000001e-06 2024-09-13T06:42:08.875 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.875 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.875 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:08.875 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443536+0000", 2024-09-13T06:42:08.875 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7259999999999999e-06 2024-09-13T06:42:08.875 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.875 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.875 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:08.875 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443540+0000", 2024-09-13T06:42:08.875 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5009999999999998e-06 2024-09-13T06:42:08.875 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.876 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.876 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:08.876 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533412+0000", 2024-09-13T06:42:08.876 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089871873000000005 2024-09-13T06:42:08.876 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.876 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.876 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:08.876 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533419+0000", 2024-09-13T06:42:08.876 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.883e-06 2024-09-13T06:42:08.876 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:08.876 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:08.877 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:08.877 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.877 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.877 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25749 3.8 3.63996268 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:42:08.877 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443545+0000", 2024-09-13T06:42:08.877 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 132.357995313, 2024-09-13T06:42:08.877 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089897988999999998, 2024-09-13T06:42:08.877 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:08.877 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:42:08.877 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:08.877 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:08.877 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:08.878 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25749 2024-09-13T06:42:08.878 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.878 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:08.878 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.878 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:08.878 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443545+0000", 2024-09-13T06:42:08.878 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:08.878 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.878 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.878 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:08.878 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443545+0000", 2024-09-13T06:42:08.878 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:08.879 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.879 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.879 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:08.879 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443544+0000", 2024-09-13T06:42:08.879 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:08.879 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.879 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.879 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:08.879 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443553+0000", 2024-09-13T06:42:08.879 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.4770000000000003e-06 2024-09-13T06:42:08.879 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.879 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.880 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:08.880 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443564+0000", 2024-09-13T06:42:08.880 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0986e-05 2024-09-13T06:42:08.880 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.880 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.880 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:08.880 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443569+0000", 2024-09-13T06:42:08.880 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2530000000000004e-06 2024-09-13T06:42:08.880 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.880 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.880 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:08.880 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533438+0000", 2024-09-13T06:42:08.881 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089868641999999999 2024-09-13T06:42:08.881 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.881 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.881 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:08.881 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533442+0000", 2024-09-13T06:42:08.881 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.989e-06 2024-09-13T06:42:08.881 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:08.881 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:08.881 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:08.881 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.881 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.881 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25750 3.8 3.63996268 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:42:08.882 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443574+0000", 2024-09-13T06:42:08.882 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 132.35796582699999, 2024-09-13T06:42:08.882 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089895143999999996, 2024-09-13T06:42:08.882 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:08.882 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:42:08.882 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:08.882 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:08.882 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:08.882 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25750 2024-09-13T06:42:08.882 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.882 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:08.883 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.883 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:08.883 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443574+0000", 2024-09-13T06:42:08.883 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:08.883 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.883 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.883 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:08.883 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443574+0000", 2024-09-13T06:42:08.883 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:08.883 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.883 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.883 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:08.884 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443574+0000", 2024-09-13T06:42:08.884 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:08.884 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.884 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.884 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:08.884 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443576+0000", 2024-09-13T06:42:08.884 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6910000000000002e-06 2024-09-13T06:42:08.884 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.884 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.884 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:08.884 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443583+0000", 2024-09-13T06:42:08.884 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.331e-06 2024-09-13T06:42:08.885 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.885 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.885 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:08.885 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443587+0000", 2024-09-13T06:42:08.885 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6129999999999997e-06 2024-09-13T06:42:08.885 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.885 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.885 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:08.885 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533464+0000", 2024-09-13T06:42:08.885 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089876605999999998 2024-09-13T06:42:08.885 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.885 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.886 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:08.886 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533469+0000", 2024-09-13T06:42:08.886 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3909999999999997e-06 2024-09-13T06:42:08.886 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:08.886 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:08.886 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:08.886 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.886 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.886 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25751 3.8 3.63996268 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:42:08.886 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443592+0000", 2024-09-13T06:42:08.886 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 132.35794813000001, 2024-09-13T06:42:08.887 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089913650999999997, 2024-09-13T06:42:08.887 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:08.887 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:42:08.887 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:08.887 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:08.887 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:08.887 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25751 2024-09-13T06:42:08.887 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.887 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:08.887 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.887 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:08.887 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443592+0000", 2024-09-13T06:42:08.888 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:08.888 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.888 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.888 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:08.888 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443592+0000", 2024-09-13T06:42:08.888 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:08.888 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.888 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.888 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:08.888 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443591+0000", 2024-09-13T06:42:08.888 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:08.889 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.889 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.889 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:08.889 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443594+0000", 2024-09-13T06:42:08.889 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3649999999999998e-06 2024-09-13T06:42:08.889 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.889 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.889 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:08.889 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443599+0000", 2024-09-13T06:42:08.889 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.699e-06 2024-09-13T06:42:08.889 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.890 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.890 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:08.890 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443611+0000", 2024-09-13T06:42:08.890 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1503e-05 2024-09-13T06:42:08.890 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.890 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.890 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:08.890 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533497+0000", 2024-09-13T06:42:08.890 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089886453000000005 2024-09-13T06:42:08.890 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.890 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.891 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:08.891 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533505+0000", 2024-09-13T06:42:08.891 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.9910000000000002e-06 2024-09-13T06:42:08.891 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:08.891 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:08.891 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:08.891 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.891 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.891 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25752 3.8 3.63996268 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:42:08.891 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443615+0000", 2024-09-13T06:42:08.891 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 132.357924349, 2024-09-13T06:42:08.892 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089905868999999999, 2024-09-13T06:42:08.892 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:08.892 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:42:08.892 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:08.892 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:08.892 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:08.892 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25752 2024-09-13T06:42:08.892 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.892 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:08.892 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.892 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:08.892 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443615+0000", 2024-09-13T06:42:08.893 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:08.893 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.893 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.893 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:08.893 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443615+0000", 2024-09-13T06:42:08.893 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:08.893 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.893 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.893 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:08.893 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443615+0000", 2024-09-13T06:42:08.893 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:08.894 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.894 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.894 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:08.894 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443617+0000", 2024-09-13T06:42:08.894 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3539999999999998e-06 2024-09-13T06:42:08.894 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.894 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.894 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:08.894 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443624+0000", 2024-09-13T06:42:08.894 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3600000000000001e-06 2024-09-13T06:42:08.894 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.895 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.895 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:08.895 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443628+0000", 2024-09-13T06:42:08.895 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.2350000000000001e-06 2024-09-13T06:42:08.895 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.895 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.895 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:08.895 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533517+0000", 2024-09-13T06:42:08.895 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089889029999999995 2024-09-13T06:42:08.895 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.895 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.895 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:08.896 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533521+0000", 2024-09-13T06:42:08.896 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.2529999999999998e-06 2024-09-13T06:42:08.896 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:08.896 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:08.896 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:08.896 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.896 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.897 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25755 3.8 3.63996268 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:42:08.897 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.444692+0000", 2024-09-13T06:42:08.897 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 132.35684764300001, 2024-09-13T06:42:08.897 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.088904186999999996, 2024-09-13T06:42:08.897 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:08.897 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:42:08.897 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:08.897 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:08.897 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:08.897 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25755 2024-09-13T06:42:08.898 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.898 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:08.898 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.898 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:08.898 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.444692+0000", 2024-09-13T06:42:08.898 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:08.898 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.898 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.898 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:08.898 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.444692+0000", 2024-09-13T06:42:08.898 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:08.898 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.899 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.899 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:08.899 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.444692+0000", 2024-09-13T06:42:08.899 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:08.899 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.899 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.899 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:08.899 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.444694+0000", 2024-09-13T06:42:08.899 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.058e-06 2024-09-13T06:42:08.899 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.899 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.899 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:08.899 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.444700+0000", 2024-09-13T06:42:08.900 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7769999999999999e-06 2024-09-13T06:42:08.900 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.900 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.900 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:08.900 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.444704+0000", 2024-09-13T06:42:08.900 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6229999999999996e-06 2024-09-13T06:42:08.900 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.900 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.900 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:08.900 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533587+0000", 2024-09-13T06:42:08.900 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.088882744999999999 2024-09-13T06:42:08.901 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.901 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.901 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:08.901 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533596+0000", 2024-09-13T06:42:08.901 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.3270000000000007e-06 2024-09-13T06:42:08.901 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:08.901 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:08.901 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:08.901 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.901 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.901 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:64356 3.c 3:32785be9:::rbd_header.11218ba71f0d:head [watch reconnect cookie 140361410387072 gen 2] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e95)", 2024-09-13T06:42:08.902 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:48.473318+0000", 2024-09-13T06:42:08.902 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 80.328221955999993, 2024-09-13T06:42:08.902 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1458904379999999, 2024-09-13T06:42:08.902 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:08.902 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:08.902 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:08.902 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:08.902 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:08.902 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 64356 2024-09-13T06:42:08.902 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.902 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:08.902 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.903 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:08.903 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:48.473318+0000", 2024-09-13T06:42:08.903 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:08.903 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.903 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.903 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:08.903 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:48.473318+0000", 2024-09-13T06:42:08.903 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:08.903 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.903 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.903 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:08.903 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:48.473315+0000", 2024-09-13T06:42:08.904 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999971 2024-09-13T06:42:08.904 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.904 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.904 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:08.904 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:48.473329+0000", 2024-09-13T06:42:08.904 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.433e-05 2024-09-13T06:42:08.904 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.904 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.904 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:08.904 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:48.473363+0000", 2024-09-13T06:42:08.904 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.3592e-05 2024-09-13T06:42:08.904 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.905 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.905 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:08.905 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:48.473386+0000", 2024-09-13T06:42:08.905 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2708999999999999e-05 2024-09-13T06:42:08.905 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.905 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.905 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:08.905 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:48.473804+0000", 2024-09-13T06:42:08.905 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00041789399999999998 2024-09-13T06:42:08.905 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.905 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.905 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:42:08.906 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:48.473830+0000", 2024-09-13T06:42:08.906 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6869e-05 2024-09-13T06:42:08.906 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.906 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.906 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:08.906 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:49.614332+0000", 2024-09-13T06:42:08.906 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.140501107 2024-09-13T06:42:08.906 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.906 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.906 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for rw locks", 2024-09-13T06:42:08.906 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:49.614496+0000", 2024-09-13T06:42:08.906 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00016451200000000001 2024-09-13T06:42:08.907 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.907 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.907 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:08.907 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:49.617131+0000", 2024-09-13T06:42:08.907 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.002634843 2024-09-13T06:42:08.907 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.907 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.907 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:08.907 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:49.617204+0000", 2024-09-13T06:42:08.907 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.2991000000000006e-05 2024-09-13T06:42:08.907 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:08.907 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:08.908 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:08.908 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:49.619208+0000", 2024-09-13T06:42:08.908 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.002004381 2024-09-13T06:42:08.908 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:08.908 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:08.908 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:08.908 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:08.908 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:08.908 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:42:08.910 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-13T06:42:08.911 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:42:08.905+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:42:09.011 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:42:09.009+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:42:09.055 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:42:09.055 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [], 2024-09-13T06:42:09.056 INFO:teuthology.orchestra.run.smithi139.stdout: "num_ops": 0 2024-09-13T06:42:09.056 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:42:09.069 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-13T06:42:09.117 INFO:tasks.ceph.osd.6.smithi139.stderr:2024-09-13T06:42:09.113+0000 7fcd02c5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26385) UID: 0 2024-09-13T06:42:09.185 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:42:09.186 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [], 2024-09-13T06:42:09.186 INFO:teuthology.orchestra.run.smithi139.stdout: "complaint_time": 30, 2024-09-13T06:42:09.186 INFO:teuthology.orchestra.run.smithi139.stdout: "num_blocked_ops": 0 2024-09-13T06:42:09.186 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:42:09.199 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-13T06:42:09.212 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:42:09.209+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:42:09.313 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:42:09.309+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:42:09.367 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:42:09.368 INFO:teuthology.orchestra.run.smithi139.stdout: "size": 20, 2024-09-13T06:42:09.368 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 600, 2024-09-13T06:42:09.368 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [ 2024-09-13T06:42:09.368 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:09.368 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18706 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 3346432~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:42:09.368 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.846138+0000", 2024-09-13T06:42:09.368 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 137.51900862700001, 2024-09-13T06:42:09.368 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.102018712, 2024-09-13T06:42:09.369 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:09.369 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:09.369 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:09.369 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:09.369 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:09.369 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18706 2024-09-13T06:42:09.369 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:09.369 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:09.369 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:09.369 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:09.370 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846138+0000", 2024-09-13T06:42:09.370 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:09.370 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:09.370 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:09.370 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:09.370 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846138+0000", 2024-09-13T06:42:09.370 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:09.370 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:09.370 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:09.370 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:09.370 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846138+0000", 2024-09-13T06:42:09.371 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:09.371 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:09.371 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:09.371 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:09.371 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846141+0000", 2024-09-13T06:42:09.371 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.6969999999999999e-06 2024-09-13T06:42:09.371 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:09.371 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:09.371 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:09.371 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846150+0000", 2024-09-13T06:42:09.371 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6400000000000003e-06 2024-09-13T06:42:09.371 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:09.371 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:09.372 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:09.372 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846160+0000", 2024-09-13T06:42:09.372 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.3999999999999998e-06 2024-09-13T06:42:09.372 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:09.372 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:09.372 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:09.372 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.947764+0000", 2024-09-13T06:42:09.372 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101604085 2024-09-13T06:42:09.372 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:09.372 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:09.372 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:09.372 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.947888+0000", 2024-09-13T06:42:09.372 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000124113 2024-09-13T06:42:09.373 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:09.373 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:09.373 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:09.373 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.948157+0000", 2024-09-13T06:42:09.373 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00026943399999999998 2024-09-13T06:42:09.373 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:09.373 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:09.373 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:09.373 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:09.373 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:09.373 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18707 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 3375104~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:42:09.373 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.846207+0000", 2024-09-13T06:42:09.373 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 137.51893986100001, 2024-09-13T06:42:09.374 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10238114099999999, 2024-09-13T06:42:09.374 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:09.374 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:09.374 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:09.374 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:09.374 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:09.374 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18707 2024-09-13T06:42:09.374 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:09.374 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:09.374 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:09.374 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:09.375 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846207+0000", 2024-09-13T06:42:09.375 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:09.375 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:09.375 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:09.375 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:09.375 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846207+0000", 2024-09-13T06:42:09.375 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:09.375 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:09.375 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:09.375 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:09.375 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846206+0000", 2024-09-13T06:42:09.375 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:42:09.375 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:09.375 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:09.376 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:09.376 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846211+0000", 2024-09-13T06:42:09.376 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.3000000000000003e-06 2024-09-13T06:42:09.376 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:09.376 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:09.376 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:09.376 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846220+0000", 2024-09-13T06:42:09.376 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6199999999999994e-06 2024-09-13T06:42:09.376 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:09.376 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:09.376 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:09.376 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846228+0000", 2024-09-13T06:42:09.376 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.7500000000000003e-06 2024-09-13T06:42:09.376 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:09.377 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:09.377 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:09.377 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.948267+0000", 2024-09-13T06:42:09.377 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10203878700000001 2024-09-13T06:42:09.377 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:09.380 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:09.380 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:09.380 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.948435+0000", 2024-09-13T06:42:09.380 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00016796500000000001 2024-09-13T06:42:09.380 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:09.380 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:09.380 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:09.380 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.948588+0000", 2024-09-13T06:42:09.380 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00015373599999999999 2024-09-13T06:42:09.380 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:09.381 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:09.381 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:09.381 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:09.381 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:09.381 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18718 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 3690496~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:42:09.381 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.850174+0000", 2024-09-13T06:42:09.381 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 137.51497270799999, 2024-09-13T06:42:09.381 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101854154, 2024-09-13T06:42:09.381 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:09.381 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:09.381 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:09.381 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:09.382 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:09.382 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18718 2024-09-13T06:42:09.382 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:09.382 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:09.382 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:09.382 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:09.382 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850174+0000", 2024-09-13T06:42:09.382 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:09.382 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:09.382 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:09.382 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:09.382 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850174+0000", 2024-09-13T06:42:09.382 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:09.383 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:09.383 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:09.383 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:09.383 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850173+0000", 2024-09-13T06:42:09.383 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:42:09.383 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:09.383 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:09.383 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:09.383 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850178+0000", 2024-09-13T06:42:09.383 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.4129999999999999e-06 2024-09-13T06:42:09.383 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:09.383 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:09.383 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:09.384 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850188+0000", 2024-09-13T06:42:09.384 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.8600000000000005e-06 2024-09-13T06:42:09.384 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:09.384 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:09.384 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:09.384 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850195+0000", 2024-09-13T06:42:09.384 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.8730000000000007e-06 2024-09-13T06:42:09.384 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:09.384 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:09.384 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:09.384 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.951766+0000", 2024-09-13T06:42:09.384 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.1015703 2024-09-13T06:42:09.384 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:09.385 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:09.385 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:09.385 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.951879+0000", 2024-09-13T06:42:09.385 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000112932 2024-09-13T06:42:09.385 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:09.385 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:09.385 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:09.385 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.952029+0000", 2024-09-13T06:42:09.385 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000149846 2024-09-13T06:42:09.385 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:09.385 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:09.385 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:09.385 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:09.385 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:09.386 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18719 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 3719168~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:42:09.386 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.850202+0000", 2024-09-13T06:42:09.386 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 137.514944665, 2024-09-13T06:42:09.386 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.102191676, 2024-09-13T06:42:09.386 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:09.386 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:09.386 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:09.386 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:09.386 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:09.386 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18719 2024-09-13T06:42:09.386 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:09.386 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:09.386 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:09.387 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:09.387 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850202+0000", 2024-09-13T06:42:09.387 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:09.387 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:09.387 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:09.387 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:09.387 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850202+0000", 2024-09-13T06:42:09.387 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:09.387 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:09.387 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:09.387 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:09.387 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850202+0000", 2024-09-13T06:42:09.387 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:42:09.388 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:09.388 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:09.388 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:09.388 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850205+0000", 2024-09-13T06:42:09.388 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.89e-06 2024-09-13T06:42:09.388 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:09.388 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:09.388 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:09.388 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850216+0000", 2024-09-13T06:42:09.388 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0233e-05 2024-09-13T06:42:09.388 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:09.388 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:09.389 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:09.389 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850223+0000", 2024-09-13T06:42:09.389 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5299999999999999e-06 2024-09-13T06:42:09.389 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:09.389 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:09.389 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:09.389 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.952106+0000", 2024-09-13T06:42:09.389 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10188309299999999 2024-09-13T06:42:09.389 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:09.389 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:09.389 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:09.389 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.952233+0000", 2024-09-13T06:42:09.389 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000126993 2024-09-13T06:42:09.389 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:09.390 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:09.390 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:09.390 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.952394+0000", 2024-09-13T06:42:09.390 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000160791 2024-09-13T06:42:09.390 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:09.390 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:09.390 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:09.390 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:09.390 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:09.390 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18720 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 3747840~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:42:09.390 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.850726+0000", 2024-09-13T06:42:09.390 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 137.514420836, 2024-09-13T06:42:09.390 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10199504299999999, 2024-09-13T06:42:09.391 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:09.391 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:09.391 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:09.391 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:09.391 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:09.391 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18720 2024-09-13T06:42:09.391 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:09.391 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:09.391 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:09.391 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:09.391 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850726+0000", 2024-09-13T06:42:09.391 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:09.391 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:09.391 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:09.392 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:09.392 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850726+0000", 2024-09-13T06:42:09.392 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:09.392 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:09.392 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:09.392 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:09.392 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850229+0000", 2024-09-13T06:42:09.392 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9995027 2024-09-13T06:42:09.392 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:09.392 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:09.392 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:09.392 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850731+0000", 2024-09-13T06:42:09.392 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00050221599999999999 2024-09-13T06:42:09.393 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:09.393 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:09.393 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:09.393 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850751+0000", 2024-09-13T06:42:09.393 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.9703000000000001e-05 2024-09-13T06:42:09.393 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:09.393 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:09.393 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:09.393 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850764+0000", 2024-09-13T06:42:09.393 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3207000000000001e-05 2024-09-13T06:42:09.393 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:09.393 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:09.393 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:09.394 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.952454+0000", 2024-09-13T06:42:09.394 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101690102 2024-09-13T06:42:09.394 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:09.394 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:09.394 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:09.394 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.952571+0000", 2024-09-13T06:42:09.394 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000116556 2024-09-13T06:42:09.394 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:09.394 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:09.394 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:09.394 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.952721+0000", 2024-09-13T06:42:09.394 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000150419 2024-09-13T06:42:09.394 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:09.394 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:09.395 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:09.395 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:09.395 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:09.395 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18730 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 4034560~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:42:09.395 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.854013+0000", 2024-09-13T06:42:09.395 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 137.511133895, 2024-09-13T06:42:09.395 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10186914399999999, 2024-09-13T06:42:09.395 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:09.395 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:09.395 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:09.395 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:09.395 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:09.395 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18730 2024-09-13T06:42:09.395 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:09.396 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:09.396 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:09.396 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:09.396 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.854013+0000", 2024-09-13T06:42:09.396 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:09.396 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:09.396 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:09.396 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:09.396 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.854013+0000", 2024-09-13T06:42:09.396 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:09.396 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:09.396 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:09.396 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:09.396 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.854013+0000", 2024-09-13T06:42:09.397 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:09.397 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:09.397 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:09.397 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:09.397 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.854016+0000", 2024-09-13T06:42:09.397 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.1839999999999999e-06 2024-09-13T06:42:09.397 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:09.397 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:09.397 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:09.397 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.854025+0000", 2024-09-13T06:42:09.397 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.8030000000000003e-06 2024-09-13T06:42:09.397 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:09.397 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:09.398 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:09.398 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.854033+0000", 2024-09-13T06:42:09.398 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6500000000000002e-06 2024-09-13T06:42:09.398 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:09.398 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:09.398 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:09.398 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.955546+0000", 2024-09-13T06:42:09.398 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10151296 2024-09-13T06:42:09.398 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:09.398 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:09.398 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:09.398 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.955694+0000", 2024-09-13T06:42:09.398 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000147773 2024-09-13T06:42:09.398 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:09.399 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:09.399 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:09.399 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.955882+0000", 2024-09-13T06:42:09.399 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000188371 2024-09-13T06:42:09.399 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:09.399 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:09.399 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:09.399 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:09.399 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:09.399 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18742 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 4378624~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:42:09.399 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.857984+0000", 2024-09-13T06:42:09.399 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 137.50716277199999, 2024-09-13T06:42:09.399 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10179961799999999, 2024-09-13T06:42:09.400 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:09.400 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:09.400 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:09.400 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:09.400 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:09.400 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18742 2024-09-13T06:42:09.400 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:09.400 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:09.400 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:09.400 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:09.400 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.857984+0000", 2024-09-13T06:42:09.400 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:09.401 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:09.401 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:09.401 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:09.401 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.857984+0000", 2024-09-13T06:42:09.401 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:09.401 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:09.401 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:09.401 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:09.401 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.857983+0000", 2024-09-13T06:42:09.401 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:42:09.401 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:09.401 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:09.401 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:09.402 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.857987+0000", 2024-09-13T06:42:09.402 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0670000000000002e-06 2024-09-13T06:42:09.402 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:09.402 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:09.402 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:09.402 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.857997+0000", 2024-09-13T06:42:09.402 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6830000000000003e-06 2024-09-13T06:42:09.402 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:09.402 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:09.402 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:09.402 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.858006+0000", 2024-09-13T06:42:09.402 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.5739999999999996e-06 2024-09-13T06:42:09.403 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:09.403 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:09.403 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:09.403 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.959453+0000", 2024-09-13T06:42:09.403 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101447339 2024-09-13T06:42:09.403 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:09.403 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:09.403 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:09.403 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.959603+0000", 2024-09-13T06:42:09.403 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000150316 2024-09-13T06:42:09.403 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:09.403 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:09.404 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:09.404 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.959784+0000", 2024-09-13T06:42:09.404 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00018065900000000001 2024-09-13T06:42:09.404 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:09.404 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:09.404 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:09.404 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:09.404 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:09.404 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18743 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 4407296~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:42:09.404 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.858012+0000", 2024-09-13T06:42:09.404 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 137.50713477900001, 2024-09-13T06:42:09.404 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10210024500000001, 2024-09-13T06:42:09.405 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:09.405 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:09.405 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:09.405 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:09.405 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:09.405 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18743 2024-09-13T06:42:09.405 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:09.405 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:09.405 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:09.405 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:09.405 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.858012+0000", 2024-09-13T06:42:09.405 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:09.405 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:09.406 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:09.406 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:09.406 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.858012+0000", 2024-09-13T06:42:09.406 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:09.406 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:09.406 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:09.406 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:09.406 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.858011+0000", 2024-09-13T06:42:09.406 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:42:09.406 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:09.406 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:09.406 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:09.406 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.858016+0000", 2024-09-13T06:42:09.406 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0659999999999997e-06 2024-09-13T06:42:09.407 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:09.407 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:09.407 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:09.407 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.858024+0000", 2024-09-13T06:42:09.407 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.7700000000000007e-06 2024-09-13T06:42:09.407 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:09.407 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:09.407 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:09.407 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.858032+0000", 2024-09-13T06:42:09.407 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.7700000000000001e-06 2024-09-13T06:42:09.407 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:09.407 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:09.407 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:09.407 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.959850+0000", 2024-09-13T06:42:09.407 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.1018182 2024-09-13T06:42:09.408 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:09.408 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:09.408 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:09.408 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.959964+0000", 2024-09-13T06:42:09.408 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00011413600000000001 2024-09-13T06:42:09.408 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:09.408 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:09.408 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:09.408 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.960113+0000", 2024-09-13T06:42:09.408 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00014813900000000001 2024-09-13T06:42:09.408 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:09.408 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:09.409 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:09.409 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:09.409 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:09.409 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18755 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 4751360~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:42:09.409 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.862061+0000", 2024-09-13T06:42:09.409 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 137.50308652699999, 2024-09-13T06:42:09.409 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101907023, 2024-09-13T06:42:09.409 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:09.409 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:09.409 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:09.409 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:09.409 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:09.409 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18755 2024-09-13T06:42:09.410 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:09.410 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:09.410 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:09.410 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:09.410 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862061+0000", 2024-09-13T06:42:09.410 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:09.410 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:09.410 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:09.410 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:09.410 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862061+0000", 2024-09-13T06:42:09.410 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:09.410 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:09.410 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:09.410 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:09.410 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862060+0000", 2024-09-13T06:42:09.410 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:42:09.411 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:09.411 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:09.411 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:09.411 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862064+0000", 2024-09-13T06:42:09.411 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.3229999999999999e-06 2024-09-13T06:42:09.411 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:09.411 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:09.411 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:09.411 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862078+0000", 2024-09-13T06:42:09.411 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.433e-05 2024-09-13T06:42:09.411 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:09.411 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:09.411 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:09.411 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862086+0000", 2024-09-13T06:42:09.412 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.3869999999999997e-06 2024-09-13T06:42:09.412 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:09.412 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:09.412 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:09.412 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.963635+0000", 2024-09-13T06:42:09.412 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101549606 2024-09-13T06:42:09.412 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:09.412 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:09.412 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:09.412 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.963783+0000", 2024-09-13T06:42:09.412 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000147312 2024-09-13T06:42:09.412 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:09.412 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:09.413 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:09.413 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.963968+0000", 2024-09-13T06:42:09.413 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000185028 2024-09-13T06:42:09.413 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:09.413 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:09.413 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:09.413 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:09.413 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:09.413 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18756 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 4780032~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:42:09.413 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.862132+0000", 2024-09-13T06:42:09.413 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 137.50301468399999, 2024-09-13T06:42:09.413 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.102159295, 2024-09-13T06:42:09.413 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:09.414 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:09.414 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:09.414 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:09.414 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:09.414 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18756 2024-09-13T06:42:09.414 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:09.414 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:09.414 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:09.414 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:09.414 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862132+0000", 2024-09-13T06:42:09.414 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:09.414 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:09.415 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:09.415 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:09.415 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862132+0000", 2024-09-13T06:42:09.415 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:09.415 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:09.415 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:09.415 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:09.415 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862132+0000", 2024-09-13T06:42:09.415 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:42:09.415 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:09.415 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:09.415 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:09.415 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862136+0000", 2024-09-13T06:42:09.415 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.9559999999999999e-06 2024-09-13T06:42:09.416 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:09.416 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:09.416 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:09.416 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862145+0000", 2024-09-13T06:42:09.416 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6169999999999996e-06 2024-09-13T06:42:09.416 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:09.416 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:09.416 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:09.416 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862153+0000", 2024-09-13T06:42:09.416 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.8359999999999992e-06 2024-09-13T06:42:09.416 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:09.416 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:09.416 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:09.416 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.964018+0000", 2024-09-13T06:42:09.417 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101865421 2024-09-13T06:42:09.417 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:09.417 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:09.417 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:09.417 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.964140+0000", 2024-09-13T06:42:09.417 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000121172 2024-09-13T06:42:09.417 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:09.417 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:09.417 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:09.417 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.964292+0000", 2024-09-13T06:42:09.417 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00015202600000000001 2024-09-13T06:42:09.417 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:09.417 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:09.418 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:09.418 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:09.418 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:09.418 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18768 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 5124096~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:42:09.418 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.866345+0000", 2024-09-13T06:42:09.418 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 137.498802377, 2024-09-13T06:42:09.418 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101779361, 2024-09-13T06:42:09.418 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:09.418 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:09.418 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:09.418 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:09.418 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:09.418 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18768 2024-09-13T06:42:09.419 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:09.419 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:09.419 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:09.419 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:09.419 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.866345+0000", 2024-09-13T06:42:09.419 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:09.419 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:09.419 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:09.419 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:09.419 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.866345+0000", 2024-09-13T06:42:09.419 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:09.419 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:09.420 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:09.420 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:09.420 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.866344+0000", 2024-09-13T06:42:09.420 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:09.420 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:09.420 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:09.420 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:09.420 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.866348+0000", 2024-09-13T06:42:09.420 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.4300000000000002e-06 2024-09-13T06:42:09.420 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:09.420 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:09.420 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:09.420 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.866356+0000", 2024-09-13T06:42:09.420 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.5930000000000006e-06 2024-09-13T06:42:09.421 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:09.421 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:09.421 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:09.421 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.866364+0000", 2024-09-13T06:42:09.421 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5599999999999996e-06 2024-09-13T06:42:09.421 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:09.421 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:09.421 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:09.421 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.967865+0000", 2024-09-13T06:42:09.421 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101501683 2024-09-13T06:42:09.421 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:09.421 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:09.421 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:09.422 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.967981+0000", 2024-09-13T06:42:09.422 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000115643 2024-09-13T06:42:09.422 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:09.422 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:09.422 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:09.422 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.968124+0000", 2024-09-13T06:42:09.422 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00014305500000000001 2024-09-13T06:42:09.422 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:09.422 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:09.422 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:09.422 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:09.422 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:09.422 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18779 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 5439488~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:42:09.423 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.869996+0000", 2024-09-13T06:42:09.423 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 137.49515149199999, 2024-09-13T06:42:09.423 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10189577399999999, 2024-09-13T06:42:09.423 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:09.423 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:09.423 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:09.423 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:09.423 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:09.423 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18779 2024-09-13T06:42:09.423 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:09.423 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:09.423 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:09.423 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:09.423 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.869996+0000", 2024-09-13T06:42:09.424 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:09.424 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:09.424 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:09.424 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:09.424 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.869996+0000", 2024-09-13T06:42:09.424 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:09.424 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:09.424 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:09.424 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:09.424 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.869995+0000", 2024-09-13T06:42:09.424 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:09.424 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:09.424 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:09.425 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:09.425 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.869998+0000", 2024-09-13T06:42:09.425 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.2729999999999998e-06 2024-09-13T06:42:09.425 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:09.425 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:09.425 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:09.425 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.870007+0000", 2024-09-13T06:42:09.425 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.5760000000000006e-06 2024-09-13T06:42:09.425 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:09.425 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:09.425 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:09.425 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.870014+0000", 2024-09-13T06:42:09.426 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.1400000000000002e-06 2024-09-13T06:42:09.426 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:09.426 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:09.426 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:09.426 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.971631+0000", 2024-09-13T06:42:09.426 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101617503 2024-09-13T06:42:09.426 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:09.426 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:09.426 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:09.426 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.971747+0000", 2024-09-13T06:42:09.426 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00011599600000000001 2024-09-13T06:42:09.426 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:09.426 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:09.426 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:09.427 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.971891+0000", 2024-09-13T06:42:09.427 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000143912 2024-09-13T06:42:09.427 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:09.427 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:09.427 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:09.427 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:09.427 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:09.427 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18792 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 5812224~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:42:09.427 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.874371+0000", 2024-09-13T06:42:09.427 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 137.49077636199999, 2024-09-13T06:42:09.427 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101736005, 2024-09-13T06:42:09.427 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:09.428 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:09.428 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:09.428 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:09.428 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:09.428 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18792 2024-09-13T06:42:09.428 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:09.428 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:09.428 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:09.428 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:09.428 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874371+0000", 2024-09-13T06:42:09.428 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:09.428 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:09.428 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:09.428 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:09.429 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874371+0000", 2024-09-13T06:42:09.429 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:09.429 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:09.429 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:09.429 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:09.429 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874370+0000", 2024-09-13T06:42:09.429 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:09.429 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:09.429 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:09.429 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:09.429 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874374+0000", 2024-09-13T06:42:09.429 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.7239999999999998e-06 2024-09-13T06:42:09.429 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:09.430 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:09.430 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:09.430 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874385+0000", 2024-09-13T06:42:09.430 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1293e-05 2024-09-13T06:42:09.430 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:09.430 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:09.430 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:09.430 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874394+0000", 2024-09-13T06:42:09.430 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.0729999999999994e-06 2024-09-13T06:42:09.430 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:09.430 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:09.430 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:09.430 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.975850+0000", 2024-09-13T06:42:09.431 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10145599700000001 2024-09-13T06:42:09.431 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:09.431 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:09.431 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:09.431 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.975963+0000", 2024-09-13T06:42:09.431 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000112689 2024-09-13T06:42:09.431 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:09.431 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:09.431 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:09.431 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.976107+0000", 2024-09-13T06:42:09.431 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000143836 2024-09-13T06:42:09.431 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:09.431 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:09.431 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:09.432 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:09.432 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:09.432 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18793 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 5840896~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:42:09.432 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.874401+0000", 2024-09-13T06:42:09.432 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 137.49074632899999, 2024-09-13T06:42:09.432 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.102005516, 2024-09-13T06:42:09.432 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:09.432 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:09.432 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:09.432 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:09.432 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:09.432 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18793 2024-09-13T06:42:09.432 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:09.432 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:09.433 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:09.433 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:09.433 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874401+0000", 2024-09-13T06:42:09.433 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:09.433 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:09.433 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:09.433 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:09.433 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874401+0000", 2024-09-13T06:42:09.433 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:09.433 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:09.433 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:09.433 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:09.434 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874400+0000", 2024-09-13T06:42:09.434 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:42:09.434 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:09.434 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:09.434 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:09.434 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874404+0000", 2024-09-13T06:42:09.434 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0069999999999999e-06 2024-09-13T06:42:09.434 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:09.434 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:09.434 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:09.434 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874412+0000", 2024-09-13T06:42:09.434 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.5399999999999996e-06 2024-09-13T06:42:09.434 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:09.434 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:09.435 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:09.435 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874420+0000", 2024-09-13T06:42:09.435 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.6199999999999999e-06 2024-09-13T06:42:09.435 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:09.435 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:09.435 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:09.435 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.976150+0000", 2024-09-13T06:42:09.435 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101729874 2024-09-13T06:42:09.435 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:09.435 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:09.435 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:09.435 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.976261+0000", 2024-09-13T06:42:09.435 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000110819 2024-09-13T06:42:09.436 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:09.436 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:09.436 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:09.436 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.976406+0000", 2024-09-13T06:42:09.436 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000145489 2024-09-13T06:42:09.436 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:09.436 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:09.436 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:09.436 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:09.436 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:09.436 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18803 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 6127616~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:42:09.436 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.877851+0000", 2024-09-13T06:42:09.436 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 137.48729583599999, 2024-09-13T06:42:09.436 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101951584, 2024-09-13T06:42:09.437 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:09.437 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:09.437 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:09.437 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:09.437 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:09.437 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18803 2024-09-13T06:42:09.437 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:09.437 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:09.437 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:09.437 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:09.437 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.877851+0000", 2024-09-13T06:42:09.437 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:09.437 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:09.437 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:09.438 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:09.438 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.877851+0000", 2024-09-13T06:42:09.438 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:09.438 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:09.438 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:09.438 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:09.438 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.877851+0000", 2024-09-13T06:42:09.438 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:09.438 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:09.438 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:09.438 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:09.438 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.877854+0000", 2024-09-13T06:42:09.438 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.7929999999999999e-06 2024-09-13T06:42:09.439 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:09.439 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:09.439 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:09.439 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.877864+0000", 2024-09-13T06:42:09.439 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.2029999999999998e-06 2024-09-13T06:42:09.439 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:09.439 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:09.439 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:09.439 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.877873+0000", 2024-09-13T06:42:09.439 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.0440000000000001e-06 2024-09-13T06:42:09.439 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:09.439 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:09.440 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:09.440 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.979544+0000", 2024-09-13T06:42:09.440 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101671198 2024-09-13T06:42:09.440 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:09.440 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:09.440 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:09.440 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.979658+0000", 2024-09-13T06:42:09.440 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000114456 2024-09-13T06:42:09.440 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:09.440 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:09.440 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:09.440 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.979803+0000", 2024-09-13T06:42:09.440 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000144506 2024-09-13T06:42:09.440 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:09.441 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:09.441 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:09.441 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:09.441 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:09.441 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18807 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 6242304~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:42:09.441 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.879235+0000", 2024-09-13T06:42:09.441 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 137.48591180599999, 2024-09-13T06:42:09.441 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101781258, 2024-09-13T06:42:09.441 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:09.441 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:09.441 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:09.441 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:09.442 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:09.442 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18807 2024-09-13T06:42:09.442 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:09.442 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:09.442 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:09.442 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:09.442 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879235+0000", 2024-09-13T06:42:09.442 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:09.442 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:09.442 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:09.442 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:09.442 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879235+0000", 2024-09-13T06:42:09.442 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:09.442 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:09.443 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:09.443 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:09.443 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879235+0000", 2024-09-13T06:42:09.443 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:09.443 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:09.443 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:09.443 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:09.443 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879239+0000", 2024-09-13T06:42:09.443 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.963e-06 2024-09-13T06:42:09.443 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:09.443 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:09.443 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:09.443 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879247+0000", 2024-09-13T06:42:09.444 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6470000000000004e-06 2024-09-13T06:42:09.444 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:09.444 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:09.444 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:09.444 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879255+0000", 2024-09-13T06:42:09.444 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5429999999999996e-06 2024-09-13T06:42:09.444 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:09.444 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:09.444 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:09.444 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.980756+0000", 2024-09-13T06:42:09.444 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10150165999999999 2024-09-13T06:42:09.444 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:09.444 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:09.445 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:09.445 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.980868+0000", 2024-09-13T06:42:09.445 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000111196 2024-09-13T06:42:09.445 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:09.445 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:09.445 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:09.445 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.981017+0000", 2024-09-13T06:42:09.445 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000148846 2024-09-13T06:42:09.445 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:09.445 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:09.445 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:09.446 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:09.446 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:09.446 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18808 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 6270976~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:42:09.446 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.879261+0000", 2024-09-13T06:42:09.446 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 137.48588566699999, 2024-09-13T06:42:09.446 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.102057547, 2024-09-13T06:42:09.446 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:09.446 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:09.446 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:09.446 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:09.446 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:09.446 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18808 2024-09-13T06:42:09.446 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:09.447 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:09.447 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:09.447 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:09.447 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879261+0000", 2024-09-13T06:42:09.447 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:09.447 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:09.447 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:09.447 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:09.447 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879261+0000", 2024-09-13T06:42:09.447 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:09.447 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:09.447 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:09.447 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:09.447 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879261+0000", 2024-09-13T06:42:09.448 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:09.448 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:09.448 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:09.448 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:09.448 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879264+0000", 2024-09-13T06:42:09.448 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.523e-06 2024-09-13T06:42:09.448 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:09.448 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:09.448 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:09.448 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879273+0000", 2024-09-13T06:42:09.448 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6070000000000008e-06 2024-09-13T06:42:09.448 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:09.448 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:09.449 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:09.449 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879280+0000", 2024-09-13T06:42:09.449 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.4699999999999996e-06 2024-09-13T06:42:09.449 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:09.449 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:09.449 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:09.449 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.981060+0000", 2024-09-13T06:42:09.449 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10177934800000001 2024-09-13T06:42:09.449 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:09.449 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:09.449 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:09.449 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.981174+0000", 2024-09-13T06:42:09.449 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000114456 2024-09-13T06:42:09.450 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:09.450 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:09.450 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:09.450 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.981319+0000", 2024-09-13T06:42:09.450 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00014473900000000001 2024-09-13T06:42:09.450 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:09.450 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:09.450 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:09.450 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:09.450 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:09.450 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18810 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 2662400~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:42:09.450 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.880386+0000", 2024-09-13T06:42:09.450 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 137.48476150499999, 2024-09-13T06:42:09.450 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101728022, 2024-09-13T06:42:09.451 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:09.451 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:09.451 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:09.451 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:09.451 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:09.451 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18810 2024-09-13T06:42:09.451 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:09.451 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:09.451 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:09.451 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:09.451 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880386+0000", 2024-09-13T06:42:09.451 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:09.451 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:09.451 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:09.452 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:09.452 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880386+0000", 2024-09-13T06:42:09.452 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:09.452 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:09.452 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:09.452 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:09.452 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880385+0000", 2024-09-13T06:42:09.452 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:42:09.452 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:09.452 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:09.452 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:09.452 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880389+0000", 2024-09-13T06:42:09.452 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.8539999999999999e-06 2024-09-13T06:42:09.453 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:09.453 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:09.453 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:09.453 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880398+0000", 2024-09-13T06:42:09.453 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.1689999999999998e-06 2024-09-13T06:42:09.453 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:09.453 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:09.453 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:09.453 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880405+0000", 2024-09-13T06:42:09.453 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5700000000000004e-06 2024-09-13T06:42:09.453 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:09.453 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:09.453 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:09.453 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.981833+0000", 2024-09-13T06:42:09.454 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10142791800000001 2024-09-13T06:42:09.454 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:09.454 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:09.454 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:09.454 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.981973+0000", 2024-09-13T06:42:09.454 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00014002900000000001 2024-09-13T06:42:09.454 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:09.454 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:09.454 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:09.454 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.982114+0000", 2024-09-13T06:42:09.454 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000140276 2024-09-13T06:42:09.454 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:09.454 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:09.454 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:09.454 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:09.455 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:09.455 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18811 3.9 3.140f5209 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:42:09.455 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.880449+0000", 2024-09-13T06:42:09.455 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 137.48469812900001, 2024-09-13T06:42:09.455 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101739355, 2024-09-13T06:42:09.455 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:09.455 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:42:09.455 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:09.455 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:09.455 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:09.455 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18811 2024-09-13T06:42:09.455 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:09.455 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:09.455 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:09.456 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:09.456 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880449+0000", 2024-09-13T06:42:09.456 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:09.456 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:09.456 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:09.456 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:09.456 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880449+0000", 2024-09-13T06:42:09.456 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:09.456 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:09.456 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:09.456 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:09.456 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880448+0000", 2024-09-13T06:42:09.456 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:42:09.456 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:09.457 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:09.457 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:09.457 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880452+0000", 2024-09-13T06:42:09.457 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0470000000000004e-06 2024-09-13T06:42:09.457 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:09.457 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:09.457 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:09.457 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880462+0000", 2024-09-13T06:42:09.457 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6530000000000006e-06 2024-09-13T06:42:09.457 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:09.457 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:09.457 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:09.457 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880472+0000", 2024-09-13T06:42:09.457 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0027000000000001e-05 2024-09-13T06:42:09.458 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:09.458 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:09.458 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:09.458 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.982172+0000", 2024-09-13T06:42:09.458 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10170043500000001 2024-09-13T06:42:09.458 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:09.458 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:09.458 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:09.458 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.982188+0000", 2024-09-13T06:42:09.458 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6172999999999999e-05 2024-09-13T06:42:09.458 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:09.458 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:09.458 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:09.458 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:09.459 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:09.459 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18812 3.9 3.140f5209 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:42:09.459 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.880478+0000", 2024-09-13T06:42:09.459 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 137.484668892, 2024-09-13T06:42:09.459 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10177795100000001, 2024-09-13T06:42:09.459 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:09.459 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:42:09.459 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:09.459 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:09.459 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:09.459 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18812 2024-09-13T06:42:09.459 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:09.459 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:09.459 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:09.460 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:09.460 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880478+0000", 2024-09-13T06:42:09.460 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:09.460 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:09.460 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:09.460 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:09.460 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880478+0000", 2024-09-13T06:42:09.460 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:09.460 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:09.460 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:09.460 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:09.460 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880477+0000", 2024-09-13T06:42:09.460 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:42:09.460 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:09.461 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:09.461 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:09.461 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880481+0000", 2024-09-13T06:42:09.461 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.827e-06 2024-09-13T06:42:09.461 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:09.461 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:09.461 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:09.461 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880490+0000", 2024-09-13T06:42:09.461 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6100000000000006e-06 2024-09-13T06:42:09.461 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:09.461 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:09.461 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:09.461 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880497+0000", 2024-09-13T06:42:09.461 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.7030000000000006e-06 2024-09-13T06:42:09.462 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:09.462 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:09.462 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:09.462 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.982241+0000", 2024-09-13T06:42:09.462 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10174351199999999 2024-09-13T06:42:09.462 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:09.462 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:09.462 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:09.462 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.982256+0000", 2024-09-13T06:42:09.462 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5143000000000001e-05 2024-09-13T06:42:09.462 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:09.462 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:09.462 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:09.462 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:09.462 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:09.463 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:42:09.463 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-13T06:42:09.464 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-13T06:42:09.465 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:42:09.457+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:42:09.564 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:42:09.561+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:42:09.618 INFO:teuthology.orchestra.run.smithi081.stdout:osd.0: {} 2024-09-13T06:42:09.618 INFO:teuthology.orchestra.run.smithi081.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-13T06:42:09.634 INFO:teuthology.orchestra.run.smithi081.stdout:osd.1: {} 2024-09-13T06:42:09.634 INFO:teuthology.orchestra.run.smithi081.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-13T06:42:09.635 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:42:09.635 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [], 2024-09-13T06:42:09.635 INFO:teuthology.orchestra.run.smithi139.stdout: "num_ops": 0 2024-09-13T06:42:09.635 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:42:09.649 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-13T06:42:09.650 INFO:teuthology.orchestra.run.smithi081.stdout:osd.2: {} 2024-09-13T06:42:09.650 INFO:teuthology.orchestra.run.smithi081.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-13T06:42:09.665 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:42:09.661+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:42:09.665 INFO:teuthology.orchestra.run.smithi081.stdout:osd.3: {} 2024-09-13T06:42:09.666 INFO:teuthology.orchestra.run.smithi081.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-13T06:42:09.683 INFO:teuthology.orchestra.run.smithi081.stdout:osd.4: {} 2024-09-13T06:42:09.683 INFO:teuthology.orchestra.run.smithi081.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-13T06:42:09.700 INFO:teuthology.orchestra.run.smithi081.stdout:osd.5: {} 2024-09-13T06:42:09.700 INFO:teuthology.orchestra.run.smithi081.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-13T06:42:09.717 INFO:teuthology.orchestra.run.smithi081.stdout:osd.6: {} 2024-09-13T06:42:09.717 INFO:teuthology.orchestra.run.smithi081.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-13T06:42:09.717 INFO:teuthology.orchestra.run.smithi081.stderr:Error ENXIO: problem getting command descriptions from osd.7 2024-09-13T06:42:09.721 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-13T06:42:09.722 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-13T06:42:09.766 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:42:09.761+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:42:09.772 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:42:09.773 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:42:09.787 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-13T06:42:09.789 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 6, 7, 5, 3] out_osds: [4] dead_osds: [7] live_osds: [0, 1, 2, 3, 4, 5, 6] 2024-09-13T06:42:09.789 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-13T06:42:09.789 INFO:tasks.thrashosds.thrasher:Adding osd 4 2024-09-13T06:42:09.789 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd in 4 2024-09-13T06:42:09.873 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:42:09.869+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:42:09.956 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:42:09.957 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:42:09.968 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:42:09.965+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:42:09.970 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-13T06:42:10.069 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:42:10.065+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:42:10.119 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-13T06:42:10.117+0000 7fcdeb9fe640 -1 mon.a@0(leader).osd e169 definitely_dead 0 2024-09-13T06:42:10.126 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:42:10.126 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:42:10.140 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-13T06:42:10.170 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:42:10.169+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:42:10.271 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:42:10.273+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:42:10.308 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:42:10.309 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:42:10.323 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-13T06:42:10.372 INFO:tasks.ceph.osd.6.smithi139.stderr:2024-09-13T06:42:10.369+0000 7fcd02c5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26385) UID: 0 2024-09-13T06:42:10.447 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:42:10.447 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:42:10.461 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-13T06:42:10.506 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:42:10.505+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:42:10.574 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:42:10.573+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:42:10.592 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:42:10.592 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:42:10.607 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-13T06:42:10.675 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:42:10.669+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:42:10.766 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:42:10.766 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:42:10.776 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:42:10.773+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:42:10.780 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-13T06:42:10.822 INFO:teuthology.orchestra.run.smithi081.stderr:marked in osd.4. 2024-09-13T06:42:10.845 INFO:tasks.thrashosds.thrasher:Added osd 4 2024-09-13T06:42:10.877 INFO:tasks.ceph.osd.6.smithi139.stderr:2024-09-13T06:42:10.873+0000 7fcd02c5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26385) UID: 0 2024-09-13T06:42:10.906 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:42:10.906 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:42:10.912 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-13T06:42:10.920 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-13T06:42:10.978 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:42:10.973+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:42:11.078 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:42:11.077+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:42:11.082 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:42:11.082 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:42:11.096 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-13T06:42:11.182 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:42:11.181+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:42:11.253 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:42:11.253 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:42:11.267 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-13T06:42:11.310 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:42:11.309+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:42:11.380 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:42:11.377+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:42:11.391 INFO:teuthology.orchestra.run.smithi081.stderr:nodeep-scrub is unset 2024-09-13T06:42:11.435 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:42:11.435 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:42:11.449 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-13T06:42:11.482 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:42:11.481+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:42:11.583 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:42:11.581+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:42:11.614 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:42:11.615 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:42:11.629 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-13T06:42:11.684 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:42:11.677+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:42:11.722 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-13T06:42:11.785 INFO:tasks.ceph.osd.6.smithi139.stderr:2024-09-13T06:42:11.781+0000 7fcd02c5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26385) UID: 0 2024-09-13T06:42:11.787 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:42:11.787 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:42:11.802 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-13T06:42:11.881 INFO:teuthology.orchestra.run.smithi081.stdout:osd.0: {} 2024-09-13T06:42:11.882 INFO:teuthology.orchestra.run.smithi081.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-13T06:42:11.885 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:42:11.881+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:42:11.914 INFO:teuthology.orchestra.run.smithi081.stdout:osd.1: {} 2024-09-13T06:42:11.915 INFO:teuthology.orchestra.run.smithi081.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-13T06:42:11.932 INFO:teuthology.orchestra.run.smithi081.stdout:osd.2: {} 2024-09-13T06:42:11.932 INFO:teuthology.orchestra.run.smithi081.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-13T06:42:11.944 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:42:11.945 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 20, 2024-09-13T06:42:11.945 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 600, 2024-09-13T06:42:11.945 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [ 2024-09-13T06:42:11.945 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:11.945 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:36160 3.f 3:f62782c2:::rbd_object_map.11219660270d.0000000000000016:head [call] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-13T06:42:11.945 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:01.607291+0000", 2024-09-13T06:42:11.945 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 130.33796239, 2024-09-13T06:42:11.945 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.99619456699999998, 2024-09-13T06:42:11.945 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:11.945 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:11.945 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:11.945 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:11.946 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:11.946 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 36160 2024-09-13T06:42:11.946 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:11.946 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:11.946 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:11.946 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:11.946 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:01.607291+0000", 2024-09-13T06:42:11.946 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:11.946 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:11.946 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:11.946 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:11.946 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:01.607291+0000", 2024-09-13T06:42:11.946 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:11.946 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:11.947 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:11.947 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:11.947 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:01.607289+0000", 2024-09-13T06:42:11.947 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999976 2024-09-13T06:42:11.947 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:11.947 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:11.947 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:11.947 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:01.607302+0000", 2024-09-13T06:42:11.947 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3018e-05 2024-09-13T06:42:11.947 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:11.947 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:11.947 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:11.948 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:01.607323+0000", 2024-09-13T06:42:11.948 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1030999999999999e-05 2024-09-13T06:42:11.948 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:11.948 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:11.948 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:11.948 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:01.607342+0000", 2024-09-13T06:42:11.948 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8961e-05 2024-09-13T06:42:11.948 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:11.948 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:11.948 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:11.949 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:01.607425+0000", 2024-09-13T06:42:11.949 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.3171999999999996e-05 2024-09-13T06:42:11.949 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:11.949 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:11.949 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:42:11.949 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:01.607441+0000", 2024-09-13T06:42:11.949 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5996999999999999e-05 2024-09-13T06:42:11.949 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:11.949 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:11.949 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:11.949 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:02.596186+0000", 2024-09-13T06:42:11.949 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.98874432000000001 2024-09-13T06:42:11.950 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:11.950 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:11.950 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for missing object", 2024-09-13T06:42:11.950 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:02.596618+0000", 2024-09-13T06:42:11.950 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000432032 2024-09-13T06:42:11.950 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:11.950 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:11.950 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:11.950 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:02.600845+0000", 2024-09-13T06:42:11.950 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0042277410000000001 2024-09-13T06:42:11.950 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:11.950 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:11.950 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:11.951 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:02.601003+0000", 2024-09-13T06:42:11.951 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00015731999999999999 2024-09-13T06:42:11.951 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:11.951 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:11.951 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:11.951 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:02.603486+0000", 2024-09-13T06:42:11.951 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0024832510000000001 2024-09-13T06:42:11.951 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:11.951 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:11.951 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:11.951 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:11.951 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:11.951 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:37806 3.9 3:951cb95b:::rbd_data.1121d8143c6e.0000000000000002:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e56)", 2024-09-13T06:42:11.952 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:06.373482+0000", 2024-09-13T06:42:11.952 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 125.57177135400001, 2024-09-13T06:42:11.952 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.002476213, 2024-09-13T06:42:11.952 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:11.952 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:11.952 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:11.952 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:11.952 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:11.952 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 37806 2024-09-13T06:42:11.952 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:11.952 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:11.952 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:11.952 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:11.953 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.373482+0000", 2024-09-13T06:42:11.953 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:11.953 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:11.953 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:11.953 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:11.953 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.373482+0000", 2024-09-13T06:42:11.953 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:11.953 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:11.953 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:11.953 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:11.953 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.373479+0000", 2024-09-13T06:42:11.953 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999962 2024-09-13T06:42:11.953 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:11.954 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:11.954 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:11.954 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.373495+0000", 2024-09-13T06:42:11.954 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6640999999999999e-05 2024-09-13T06:42:11.954 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:11.954 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:11.954 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:11.954 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.373542+0000", 2024-09-13T06:42:11.954 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6229000000000001e-05 2024-09-13T06:42:11.954 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:11.954 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:11.954 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:11.954 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.373564+0000", 2024-09-13T06:42:11.954 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2684000000000002e-05 2024-09-13T06:42:11.955 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:11.955 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:11.955 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:11.955 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374268+0000", 2024-09-13T06:42:11.955 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00070363700000000001 2024-09-13T06:42:11.955 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:11.955 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:11.955 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:42:11.955 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374305+0000", 2024-09-13T06:42:11.955 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.6936e-05 2024-09-13T06:42:11.956 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:11.956 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:11.956 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:11.956 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.375175+0000", 2024-09-13T06:42:11.956 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.000870454 2024-09-13T06:42:11.956 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:11.956 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:11.956 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:11.956 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.375678+0000", 2024-09-13T06:42:11.956 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00050292499999999999 2024-09-13T06:42:11.956 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:11.956 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:11.956 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:11.957 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.375959+0000", 2024-09-13T06:42:11.957 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00028050599999999997 2024-09-13T06:42:11.957 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:11.957 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:11.957 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:11.957 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:11.957 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:11.957 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:37821 3.9 3:951cb95b:::rbd_data.1121d8143c6e.0000000000000002:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e56)", 2024-09-13T06:42:11.957 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:06.374454+0000", 2024-09-13T06:42:11.957 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 125.570800237, 2024-09-13T06:42:11.957 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.002545072, 2024-09-13T06:42:11.957 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:11.958 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:11.958 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:11.958 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:11.958 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:11.958 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 37821 2024-09-13T06:42:11.958 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:11.958 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:11.958 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:11.958 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:11.958 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374454+0000", 2024-09-13T06:42:11.958 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:11.958 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:11.958 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:11.958 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:11.958 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374454+0000", 2024-09-13T06:42:11.959 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:11.959 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:11.959 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:11.959 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:11.959 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374452+0000", 2024-09-13T06:42:11.959 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999981 2024-09-13T06:42:11.959 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:11.959 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:11.959 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:11.959 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374463+0000", 2024-09-13T06:42:11.959 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0756e-05 2024-09-13T06:42:11.959 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:11.959 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:11.960 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:11.960 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374487+0000", 2024-09-13T06:42:11.960 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4887000000000001e-05 2024-09-13T06:42:11.960 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:11.960 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:11.960 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:11.960 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374504+0000", 2024-09-13T06:42:11.960 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6852000000000001e-05 2024-09-13T06:42:11.960 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:11.960 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:11.960 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:11.960 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374829+0000", 2024-09-13T06:42:11.961 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000324684 2024-09-13T06:42:11.961 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:11.961 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:11.961 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:42:11.961 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374880+0000", 2024-09-13T06:42:11.961 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.1378000000000002e-05 2024-09-13T06:42:11.961 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:11.961 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:11.961 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:11.961 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.376423+0000", 2024-09-13T06:42:11.961 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.001542734 2024-09-13T06:42:11.961 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:11.961 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:11.962 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:11.962 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.376607+0000", 2024-09-13T06:42:11.962 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000183656 2024-09-13T06:42:11.962 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:11.962 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:11.962 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:11.962 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.376999+0000", 2024-09-13T06:42:11.962 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00039191200000000001 2024-09-13T06:42:11.962 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:11.962 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:11.962 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:11.962 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:11.962 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:11.963 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:37836 3.9 3:951cb95b:::rbd_data.1121d8143c6e.0000000000000002:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e56)", 2024-09-13T06:42:11.963 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:06.374929+0000", 2024-09-13T06:42:11.963 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 125.57032458499999, 2024-09-13T06:42:11.963 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.002778825, 2024-09-13T06:42:11.963 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:11.963 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:11.963 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:11.963 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:11.963 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:11.963 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 37836 2024-09-13T06:42:11.963 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:11.963 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:11.963 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:11.964 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:11.964 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374929+0000", 2024-09-13T06:42:11.964 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:11.964 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:11.964 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:11.964 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:11.964 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374929+0000", 2024-09-13T06:42:11.964 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:11.964 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:11.964 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:11.964 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:11.964 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374927+0000", 2024-09-13T06:42:11.964 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999981 2024-09-13T06:42:11.965 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:11.965 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:11.965 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:11.965 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374939+0000", 2024-09-13T06:42:11.965 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1846e-05 2024-09-13T06:42:11.965 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:11.965 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:11.965 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:11.965 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374962+0000", 2024-09-13T06:42:11.965 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3054e-05 2024-09-13T06:42:11.965 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:11.965 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:11.965 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:11.966 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374978+0000", 2024-09-13T06:42:11.966 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5899000000000001e-05 2024-09-13T06:42:11.966 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:11.966 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:11.966 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:11.966 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.375106+0000", 2024-09-13T06:42:11.966 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00012789 2024-09-13T06:42:11.966 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:11.966 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:11.966 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:42:11.966 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.375134+0000", 2024-09-13T06:42:11.966 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.8254000000000001e-05 2024-09-13T06:42:11.967 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:11.967 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:11.967 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:11.967 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.377082+0000", 2024-09-13T06:42:11.967 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0019471520000001 2024-09-13T06:42:11.967 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:11.967 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:11.967 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:11.967 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.377330+0000", 2024-09-13T06:42:11.967 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00024834199999999997 2024-09-13T06:42:11.967 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:11.967 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:11.967 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:11.967 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.377708+0000", 2024-09-13T06:42:11.968 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00037817100000000001 2024-09-13T06:42:11.968 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:11.968 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:11.968 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:11.968 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:11.968 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:11.968 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:37851 3.9 3:951cb95b:::rbd_data.1121d8143c6e.0000000000000002:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e56)", 2024-09-13T06:42:11.968 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:06.382636+0000", 2024-09-13T06:42:11.968 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 125.5626177, 2024-09-13T06:42:11.968 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.99582539400000003, 2024-09-13T06:42:11.968 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:11.968 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:11.969 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:11.969 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:11.969 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:11.969 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 37851 2024-09-13T06:42:11.969 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:11.969 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:11.969 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:11.969 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:11.969 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.382636+0000", 2024-09-13T06:42:11.969 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:11.969 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:11.969 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:11.970 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:11.970 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.382636+0000", 2024-09-13T06:42:11.970 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:11.970 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:11.970 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:11.970 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:11.970 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.382633+0000", 2024-09-13T06:42:11.970 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999971 2024-09-13T06:42:11.970 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:11.970 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:11.970 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:11.970 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.382652+0000", 2024-09-13T06:42:11.970 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8834999999999998e-05 2024-09-13T06:42:11.971 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:11.971 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:11.971 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:11.971 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.382695+0000", 2024-09-13T06:42:11.971 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.3136000000000002e-05 2024-09-13T06:42:11.971 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:11.971 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:11.971 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:11.971 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.382716+0000", 2024-09-13T06:42:11.971 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1421e-05 2024-09-13T06:42:11.971 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:11.971 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:11.972 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:11.972 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.382860+0000", 2024-09-13T06:42:11.972 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00014389200000000001 2024-09-13T06:42:11.972 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:11.972 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:11.972 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:42:11.972 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.382890+0000", 2024-09-13T06:42:11.972 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9827000000000001e-05 2024-09-13T06:42:11.972 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:11.972 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:11.972 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:11.972 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.377779+0000", 2024-09-13T06:42:11.973 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.99488842899999996 2024-09-13T06:42:11.973 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:11.973 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:11.973 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:11.973 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.378007+0000", 2024-09-13T06:42:11.973 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00022838099999999999 2024-09-13T06:42:11.973 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:11.973 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:11.973 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:11.973 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.378462+0000", 2024-09-13T06:42:11.973 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00045452300000000003 2024-09-13T06:42:11.973 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:11.973 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:11.974 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:11.974 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:11.974 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:11.974 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:37866 3.9 3:951cb95b:::rbd_data.1121d8143c6e.0000000000000002:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e56)", 2024-09-13T06:42:11.974 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:06.383951+0000", 2024-09-13T06:42:11.974 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 125.561303014, 2024-09-13T06:42:11.974 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.99517962299999996, 2024-09-13T06:42:11.974 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:11.974 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:11.974 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:11.974 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:11.974 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:11.974 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 37866 2024-09-13T06:42:11.974 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:11.975 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:11.975 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:11.975 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:11.975 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.383951+0000", 2024-09-13T06:42:11.975 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:11.975 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:11.975 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:11.975 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:11.975 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.383951+0000", 2024-09-13T06:42:11.975 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:11.975 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:11.975 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:11.975 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:11.976 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.383949+0000", 2024-09-13T06:42:11.976 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999981 2024-09-13T06:42:11.976 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:11.976 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:11.976 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:11.976 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.383961+0000", 2024-09-13T06:42:11.976 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1999e-05 2024-09-13T06:42:11.976 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:11.976 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:11.976 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:11.976 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384019+0000", 2024-09-13T06:42:11.976 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7621000000000003e-05 2024-09-13T06:42:11.976 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:11.977 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:11.977 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:11.977 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384040+0000", 2024-09-13T06:42:11.977 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1528000000000001e-05 2024-09-13T06:42:11.977 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:11.977 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:11.977 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:11.977 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384186+0000", 2024-09-13T06:42:11.977 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00014573799999999999 2024-09-13T06:42:11.977 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:11.977 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:11.977 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:42:11.977 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384204+0000", 2024-09-13T06:42:11.978 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7992e-05 2024-09-13T06:42:11.978 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:11.978 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:11.978 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:11.978 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.378536+0000", 2024-09-13T06:42:11.978 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.99433268600000002 2024-09-13T06:42:11.978 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:11.978 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:11.978 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:11.978 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.378771+0000", 2024-09-13T06:42:11.978 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00023445399999999999 2024-09-13T06:42:11.978 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:11.978 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:11.979 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:11.979 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.379130+0000", 2024-09-13T06:42:11.979 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00035954200000000002 2024-09-13T06:42:11.979 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:11.979 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:11.979 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:11.979 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:11.979 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:11.979 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:37881 3.9 3:951cb95b:::rbd_data.1121d8143c6e.0000000000000002:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e56)", 2024-09-13T06:42:11.979 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:06.384239+0000", 2024-09-13T06:42:11.979 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 125.56101459999999, 2024-09-13T06:42:11.979 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.99541483500000005, 2024-09-13T06:42:11.979 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:11.979 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:11.980 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:11.980 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:11.980 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:11.980 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 37881 2024-09-13T06:42:11.980 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:11.980 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:11.980 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:11.980 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:11.980 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384239+0000", 2024-09-13T06:42:11.980 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:11.980 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:11.980 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:11.981 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:11.981 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384239+0000", 2024-09-13T06:42:11.981 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:11.981 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:11.981 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:11.981 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:11.981 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384238+0000", 2024-09-13T06:42:11.981 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999986 2024-09-13T06:42:11.981 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:11.981 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:11.981 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:11.981 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384246+0000", 2024-09-13T06:42:11.981 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.2449999999999998e-06 2024-09-13T06:42:11.982 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:11.982 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:11.982 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:11.982 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384268+0000", 2024-09-13T06:42:11.982 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1518e-05 2024-09-13T06:42:11.982 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:11.982 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:11.982 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:11.982 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384282+0000", 2024-09-13T06:42:11.982 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4501999999999999e-05 2024-09-13T06:42:11.982 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:11.982 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:11.982 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:11.982 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384356+0000", 2024-09-13T06:42:11.983 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4265999999999997e-05 2024-09-13T06:42:11.983 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:11.983 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:11.983 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:42:11.983 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384370+0000", 2024-09-13T06:42:11.983 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3942e-05 2024-09-13T06:42:11.983 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:11.983 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:11.983 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:11.983 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.379199+0000", 2024-09-13T06:42:11.983 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.99482866599999997 2024-09-13T06:42:11.983 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:11.983 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:11.983 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:11.984 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.379347+0000", 2024-09-13T06:42:11.984 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00014749199999999999 2024-09-13T06:42:11.984 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:11.984 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:11.984 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:11.984 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.379654+0000", 2024-09-13T06:42:11.984 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00030752999999999998 2024-09-13T06:42:11.984 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:11.984 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:11.984 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:11.984 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:11.984 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:11.985 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:37896 3.9 3:951cb95b:::rbd_data.1121d8143c6e.0000000000000002:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e56)", 2024-09-13T06:42:11.985 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:06.384412+0000", 2024-09-13T06:42:11.985 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 125.560842167, 2024-09-13T06:42:11.985 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.99777835999999998, 2024-09-13T06:42:11.985 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:11.985 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:11.985 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:11.985 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:11.985 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:11.985 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 37896 2024-09-13T06:42:11.985 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:11.985 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:11.985 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:11.985 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:11.986 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384412+0000", 2024-09-13T06:42:11.986 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:11.986 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:11.986 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:11.986 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:11.986 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384412+0000", 2024-09-13T06:42:11.986 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:11.986 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:11.986 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:11.986 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:11.986 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384410+0000", 2024-09-13T06:42:11.986 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.999999 2024-09-13T06:42:11.986 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:11.986 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:11.987 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:11.987 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384418+0000", 2024-09-13T06:42:11.987 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.486e-06 2024-09-13T06:42:11.987 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:11.987 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:11.987 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:11.987 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384436+0000", 2024-09-13T06:42:11.987 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7668000000000001e-05 2024-09-13T06:42:11.987 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:11.987 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:11.987 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:11.987 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384449+0000", 2024-09-13T06:42:11.987 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3395e-05 2024-09-13T06:42:11.988 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:11.988 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:11.988 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:11.988 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384605+0000", 2024-09-13T06:42:11.988 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00015563099999999999 2024-09-13T06:42:11.988 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:11.988 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:11.988 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:42:11.988 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384635+0000", 2024-09-13T06:42:11.988 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.0383999999999999e-05 2024-09-13T06:42:11.988 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:11.988 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:11.988 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:11.988 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.379730+0000", 2024-09-13T06:42:11.989 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.99509493999999998 2024-09-13T06:42:11.989 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:11.989 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:11.989 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:11.989 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.379964+0000", 2024-09-13T06:42:11.989 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00023353499999999999 2024-09-13T06:42:11.989 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:11.989 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:11.989 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:11.989 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.382190+0000", 2024-09-13T06:42:11.989 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0022265039999999998 2024-09-13T06:42:11.989 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:11.989 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:11.990 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:11.990 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:11.990 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:11.990 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43222 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 389120~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:42:11.990 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558181+0000", 2024-09-13T06:42:11.990 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 110.387072913, 2024-09-13T06:42:11.990 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.06252038, 2024-09-13T06:42:11.990 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:11.990 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:11.990 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:11.990 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:11.990 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:11.990 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43222 2024-09-13T06:42:11.990 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:11.991 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:11.991 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:11.991 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:11.991 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558181+0000", 2024-09-13T06:42:11.991 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:11.991 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:11.991 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:11.991 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:11.991 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558181+0000", 2024-09-13T06:42:11.991 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:11.991 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:11.991 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:11.991 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:11.992 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558181+0000", 2024-09-13T06:42:11.992 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:11.992 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:11.992 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:11.992 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:11.992 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558183+0000", 2024-09-13T06:42:11.992 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.857e-06 2024-09-13T06:42:11.992 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:11.992 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:11.992 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:11.992 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558188+0000", 2024-09-13T06:42:11.992 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3759999999999999e-06 2024-09-13T06:42:11.992 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:11.993 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:11.993 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:11.993 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558261+0000", 2024-09-13T06:42:11.993 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3097999999999997e-05 2024-09-13T06:42:11.993 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:11.993 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:11.993 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:11.993 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.620354+0000", 2024-09-13T06:42:11.993 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.062092587999999997 2024-09-13T06:42:11.993 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:11.993 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:11.993 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:11.993 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.620428+0000", 2024-09-13T06:42:11.993 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3954000000000004e-05 2024-09-13T06:42:11.994 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:11.994 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:11.994 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:11.994 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.620701+0000", 2024-09-13T06:42:11.994 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000273773 2024-09-13T06:42:11.994 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:11.994 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:11.994 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:11.994 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:11.994 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:11.994 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43223 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 393216~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:42:11.994 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558267+0000", 2024-09-13T06:42:11.994 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 110.38698685599999, 2024-09-13T06:42:11.995 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.062813151999999997, 2024-09-13T06:42:11.995 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:11.995 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:11.995 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:11.995 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:11.995 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:11.995 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43223 2024-09-13T06:42:11.995 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:11.995 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:11.995 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:11.995 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:11.995 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558267+0000", 2024-09-13T06:42:11.996 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:11.996 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:11.996 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:11.996 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:11.996 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558267+0000", 2024-09-13T06:42:11.996 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:11.996 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:11.996 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:11.996 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:11.996 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558266+0000", 2024-09-13T06:42:11.996 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:11.996 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:11.996 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:11.997 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:11.997 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558270+0000", 2024-09-13T06:42:11.997 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.2389999999999998e-06 2024-09-13T06:42:11.997 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:11.997 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:11.997 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:11.997 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558277+0000", 2024-09-13T06:42:11.997 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5680000000000002e-06 2024-09-13T06:42:11.997 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:11.998 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:11.998 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:11.998 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558282+0000", 2024-09-13T06:42:11.998 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7060000000000003e-06 2024-09-13T06:42:11.998 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:11.998 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:11.998 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:11.998 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.620731+0000", 2024-09-13T06:42:11.998 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.062448661000000003 2024-09-13T06:42:11.998 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:11.998 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:11.998 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:11.998 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.620806+0000", 2024-09-13T06:42:11.998 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5862e-05 2024-09-13T06:42:11.999 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:11.999 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:11.999 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:11.999 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.621080+0000", 2024-09-13T06:42:11.999 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00027368599999999998 2024-09-13T06:42:11.999 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:11.999 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:11.999 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:11.999 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:11.999 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:11.999 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43224 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 407552~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:42:11.999 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558286+0000", 2024-09-13T06:42:11.999 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 110.386967492, 2024-09-13T06:42:12.000 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.063179052999999999, 2024-09-13T06:42:12.000 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:12.000 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:12.000 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:12.000 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:12.000 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:12.000 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43224 2024-09-13T06:42:12.000 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.000 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:12.000 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.000 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:12.000 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558286+0000", 2024-09-13T06:42:12.001 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:12.001 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.001 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.001 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:12.001 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558286+0000", 2024-09-13T06:42:12.001 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:12.001 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.001 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.001 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:12.001 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558286+0000", 2024-09-13T06:42:12.001 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:12.001 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.002 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.002 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:12.002 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558288+0000", 2024-09-13T06:42:12.002 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.227e-06 2024-09-13T06:42:12.002 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.002 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.002 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:12.002 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558292+0000", 2024-09-13T06:42:12.002 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.6289999999999999e-06 2024-09-13T06:42:12.002 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.002 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.002 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:12.002 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558294+0000", 2024-09-13T06:42:12.002 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5409999999999999e-06 2024-09-13T06:42:12.003 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.003 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.003 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:12.003 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.621110+0000", 2024-09-13T06:42:12.003 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.062815776000000004 2024-09-13T06:42:12.003 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.003 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.003 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:12.003 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.621186+0000", 2024-09-13T06:42:12.003 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5570999999999999e-05 2024-09-13T06:42:12.003 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.003 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.004 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:12.004 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.621465+0000", 2024-09-13T06:42:12.004 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00027988200000000001 2024-09-13T06:42:12.004 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:12.004 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:12.004 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:12.004 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.004 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.004 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43225 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 421888~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:42:12.004 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558296+0000", 2024-09-13T06:42:12.004 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 110.386957525, 2024-09-13T06:42:12.004 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.063551110999999993, 2024-09-13T06:42:12.004 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:12.005 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:12.005 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:12.005 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:12.005 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:12.005 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43225 2024-09-13T06:42:12.005 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.005 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:12.005 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.005 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:12.005 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558296+0000", 2024-09-13T06:42:12.005 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:12.005 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.006 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.006 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:12.006 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558296+0000", 2024-09-13T06:42:12.006 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:12.006 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.006 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.006 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:12.006 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558296+0000", 2024-09-13T06:42:12.006 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:42:12.006 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.006 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.006 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:12.006 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558305+0000", 2024-09-13T06:42:12.007 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.5290000000000008e-06 2024-09-13T06:42:12.007 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.007 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.007 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:12.007 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558308+0000", 2024-09-13T06:42:12.007 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.5619999999999999e-06 2024-09-13T06:42:12.007 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.007 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.007 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:12.007 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558311+0000", 2024-09-13T06:42:12.007 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.43e-06 2024-09-13T06:42:12.007 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.007 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.007 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:12.008 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.621495+0000", 2024-09-13T06:42:12.008 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.063184289000000005 2024-09-13T06:42:12.008 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.008 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.008 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:12.008 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.621569+0000", 2024-09-13T06:42:12.008 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4250000000000002e-05 2024-09-13T06:42:12.008 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.008 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.008 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:12.008 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.621847+0000", 2024-09-13T06:42:12.008 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00027826400000000002 2024-09-13T06:42:12.009 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:12.009 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:12.009 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:12.009 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.009 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.009 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43226 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 436224~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:42:12.009 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558313+0000", 2024-09-13T06:42:12.009 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 110.386940889, 2024-09-13T06:42:12.009 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.063914420999999999, 2024-09-13T06:42:12.009 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:12.009 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:12.009 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:12.009 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:12.010 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:12.010 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43226 2024-09-13T06:42:12.010 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.010 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:12.010 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.010 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:12.010 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558313+0000", 2024-09-13T06:42:12.010 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:12.010 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.010 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.010 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:12.010 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558313+0000", 2024-09-13T06:42:12.010 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:12.011 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.011 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.011 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:12.011 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558313+0000", 2024-09-13T06:42:12.011 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:12.011 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.011 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.011 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:12.011 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558314+0000", 2024-09-13T06:42:12.011 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3740000000000001e-06 2024-09-13T06:42:12.011 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.011 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.011 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:12.012 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558317+0000", 2024-09-13T06:42:12.012 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9730000000000002e-06 2024-09-13T06:42:12.012 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.012 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.012 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:12.012 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558319+0000", 2024-09-13T06:42:12.012 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4059999999999999e-06 2024-09-13T06:42:12.012 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.012 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.012 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:12.012 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.621877+0000", 2024-09-13T06:42:12.012 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.063557408999999995 2024-09-13T06:42:12.012 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.013 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.013 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:12.013 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.621951+0000", 2024-09-13T06:42:12.013 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4487999999999996e-05 2024-09-13T06:42:12.013 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.013 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.013 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:12.013 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.622227+0000", 2024-09-13T06:42:12.013 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000276011 2024-09-13T06:42:12.013 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:12.013 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:12.013 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:12.013 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.014 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.014 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43227 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 450560~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:42:12.014 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558322+0000", 2024-09-13T06:42:12.014 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 110.386932308, 2024-09-13T06:42:12.014 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.064285348000000006, 2024-09-13T06:42:12.014 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:12.014 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:12.014 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:12.014 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:12.014 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:12.014 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43227 2024-09-13T06:42:12.014 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.014 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:12.015 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.015 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:12.015 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558322+0000", 2024-09-13T06:42:12.015 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:12.015 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.015 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.015 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:12.015 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558322+0000", 2024-09-13T06:42:12.015 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:12.015 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.015 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.015 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:12.015 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558321+0000", 2024-09-13T06:42:12.016 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:42:12.016 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.016 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.016 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:12.016 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558323+0000", 2024-09-13T06:42:12.016 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.576e-06 2024-09-13T06:42:12.016 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.016 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.016 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:12.016 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558328+0000", 2024-09-13T06:42:12.016 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0719999999999999e-06 2024-09-13T06:42:12.016 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.016 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.017 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:12.017 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558332+0000", 2024-09-13T06:42:12.017 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.8130000000000002e-06 2024-09-13T06:42:12.017 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.017 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.017 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:12.017 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.622255+0000", 2024-09-13T06:42:12.017 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.063923195000000002 2024-09-13T06:42:12.017 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.017 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.017 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:12.017 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.622330+0000", 2024-09-13T06:42:12.017 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5383000000000007e-05 2024-09-13T06:42:12.017 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.018 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.018 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:12.018 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.622607+0000", 2024-09-13T06:42:12.018 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00027651999999999999 2024-09-13T06:42:12.018 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:12.018 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:12.018 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:12.018 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.018 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.018 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43228 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 464896~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:42:12.018 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558335+0000", 2024-09-13T06:42:12.018 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 110.386918399, 2024-09-13T06:42:12.018 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.064652253000000007, 2024-09-13T06:42:12.018 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:12.019 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:12.019 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:12.019 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:12.019 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:12.019 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43228 2024-09-13T06:42:12.019 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.019 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:12.019 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.019 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:12.019 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558335+0000", 2024-09-13T06:42:12.019 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:12.019 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.019 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.020 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:12.020 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558335+0000", 2024-09-13T06:42:12.020 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:12.020 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.020 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.020 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:12.020 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558335+0000", 2024-09-13T06:42:12.020 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:12.020 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.020 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.020 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:12.020 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558337+0000", 2024-09-13T06:42:12.021 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1380000000000001e-06 2024-09-13T06:42:12.021 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.021 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.021 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:12.021 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558343+0000", 2024-09-13T06:42:12.021 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.5140000000000001e-06 2024-09-13T06:42:12.021 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.021 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.021 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:12.021 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558348+0000", 2024-09-13T06:42:12.021 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9640000000000002e-06 2024-09-13T06:42:12.021 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.021 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.022 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:12.022 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.622636+0000", 2024-09-13T06:42:12.022 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.064288260999999999 2024-09-13T06:42:12.022 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.022 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.022 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:12.022 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.622715+0000", 2024-09-13T06:42:12.022 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.9351000000000006e-05 2024-09-13T06:42:12.022 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.022 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.022 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:12.022 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.622988+0000", 2024-09-13T06:42:12.022 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00027242599999999998 2024-09-13T06:42:12.022 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:12.023 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:12.023 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:12.023 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.023 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.023 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43229 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 479232~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:42:12.023 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558352+0000", 2024-09-13T06:42:12.023 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 110.386901984, 2024-09-13T06:42:12.023 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.065018024999999993, 2024-09-13T06:42:12.023 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:12.023 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:12.023 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:12.023 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:12.024 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:12.024 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43229 2024-09-13T06:42:12.024 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.024 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:12.024 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.024 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:12.024 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558352+0000", 2024-09-13T06:42:12.024 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:12.024 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.024 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.024 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:12.024 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558352+0000", 2024-09-13T06:42:12.024 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:12.025 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.025 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.025 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:12.025 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558352+0000", 2024-09-13T06:42:12.025 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:12.025 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.025 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.025 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:12.025 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558354+0000", 2024-09-13T06:42:12.026 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4930000000000001e-06 2024-09-13T06:42:12.026 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.026 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.026 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:12.026 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558360+0000", 2024-09-13T06:42:12.026 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.263e-06 2024-09-13T06:42:12.026 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.026 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.026 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:12.026 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558369+0000", 2024-09-13T06:42:12.026 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.0829999999999993e-06 2024-09-13T06:42:12.026 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.026 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.027 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:12.027 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.623017+0000", 2024-09-13T06:42:12.027 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.064647799000000006 2024-09-13T06:42:12.027 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.027 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.027 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:12.027 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.623090+0000", 2024-09-13T06:42:12.027 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3071000000000006e-05 2024-09-13T06:42:12.027 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.027 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.027 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:12.027 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.623370+0000", 2024-09-13T06:42:12.027 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000279661 2024-09-13T06:42:12.027 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:12.028 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:12.028 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:12.028 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.028 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.028 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43230 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 493568~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:42:12.028 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558374+0000", 2024-09-13T06:42:12.028 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 110.386879691, 2024-09-13T06:42:12.028 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.065410435000000003, 2024-09-13T06:42:12.028 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:12.028 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:12.028 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:12.028 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:12.029 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:12.029 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43230 2024-09-13T06:42:12.029 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.029 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:12.029 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.029 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:12.029 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558374+0000", 2024-09-13T06:42:12.029 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:12.029 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.029 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.029 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:12.029 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558374+0000", 2024-09-13T06:42:12.029 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:12.030 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.030 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.030 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:12.030 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558374+0000", 2024-09-13T06:42:12.030 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:12.030 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.030 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.030 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:12.030 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558376+0000", 2024-09-13T06:42:12.030 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4430000000000002e-06 2024-09-13T06:42:12.030 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.030 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.030 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:12.030 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558382+0000", 2024-09-13T06:42:12.031 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3029999999999996e-06 2024-09-13T06:42:12.031 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.031 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.031 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:12.031 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558387+0000", 2024-09-13T06:42:12.031 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.1699999999999999e-06 2024-09-13T06:42:12.031 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.031 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.031 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:12.031 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.623400+0000", 2024-09-13T06:42:12.031 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.065013244999999997 2024-09-13T06:42:12.031 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.031 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.032 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:12.032 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.623474+0000", 2024-09-13T06:42:12.032 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3889999999999999e-05 2024-09-13T06:42:12.032 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.032 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.032 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:12.032 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.623785+0000", 2024-09-13T06:42:12.032 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00031080099999999998 2024-09-13T06:42:12.032 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:12.032 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:12.032 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:12.032 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.032 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.032 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43231 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 507904~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:42:12.033 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558391+0000", 2024-09-13T06:42:12.033 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 110.386863006, 2024-09-13T06:42:12.033 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.065788597000000004, 2024-09-13T06:42:12.033 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:12.033 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:12.033 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:12.033 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:12.033 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:12.033 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43231 2024-09-13T06:42:12.033 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.033 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:12.033 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.033 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:12.034 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558391+0000", 2024-09-13T06:42:12.034 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:12.034 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.034 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.034 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:12.034 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558391+0000", 2024-09-13T06:42:12.034 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:12.034 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.034 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.034 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:12.034 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558390+0000", 2024-09-13T06:42:12.034 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:12.034 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.034 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.035 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:12.035 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558393+0000", 2024-09-13T06:42:12.035 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2570000000000002e-06 2024-09-13T06:42:12.035 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.035 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.035 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:12.035 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558399+0000", 2024-09-13T06:42:12.035 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0419999999999999e-06 2024-09-13T06:42:12.035 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.035 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.035 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:12.035 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558403+0000", 2024-09-13T06:42:12.035 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6249999999999998e-06 2024-09-13T06:42:12.036 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.036 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.036 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:12.036 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.623811+0000", 2024-09-13T06:42:12.036 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.065407549999999995 2024-09-13T06:42:12.036 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.036 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.036 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:12.036 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.623877+0000", 2024-09-13T06:42:12.036 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.5902999999999996e-05 2024-09-13T06:42:12.036 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.036 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.036 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:12.037 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.624179+0000", 2024-09-13T06:42:12.037 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00030259999999999998 2024-09-13T06:42:12.037 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:12.037 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:12.037 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:12.037 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.037 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.037 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43232 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 522240~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:42:12.037 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558422+0000", 2024-09-13T06:42:12.037 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 110.38683222900001, 2024-09-13T06:42:12.037 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.066176061999999994, 2024-09-13T06:42:12.037 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:12.037 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:12.038 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:12.038 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:12.038 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:12.038 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43232 2024-09-13T06:42:12.038 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.038 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:12.038 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.038 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:12.038 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558422+0000", 2024-09-13T06:42:12.038 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:12.038 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.038 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.038 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:12.038 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558422+0000", 2024-09-13T06:42:12.039 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:12.039 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.039 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.039 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:12.039 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558421+0000", 2024-09-13T06:42:12.039 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:12.039 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.039 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.039 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:12.039 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558428+0000", 2024-09-13T06:42:12.039 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.1690000000000003e-06 2024-09-13T06:42:12.039 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.039 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.039 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:12.040 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558434+0000", 2024-09-13T06:42:12.040 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9309999999999996e-06 2024-09-13T06:42:12.040 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.040 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.040 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:12.040 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558447+0000", 2024-09-13T06:42:12.040 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.271e-05 2024-09-13T06:42:12.040 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.040 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.040 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:12.040 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.624209+0000", 2024-09-13T06:42:12.040 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.065762102000000003 2024-09-13T06:42:12.040 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.040 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.040 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:12.041 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.624282+0000", 2024-09-13T06:42:12.041 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.2889e-05 2024-09-13T06:42:12.041 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.041 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.041 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:12.041 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.624598+0000", 2024-09-13T06:42:12.041 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00031591399999999998 2024-09-13T06:42:12.041 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:12.041 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:12.041 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:12.041 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.041 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.041 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43486 3.f 3:f7da9c8f:::rbd_data.1121f5f2e1c0.000000000000000b:1f [read 260096~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:42:12.042 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.569088+0000", 2024-09-13T06:42:12.042 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 110.37616550600001, 2024-09-13T06:42:12.042 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.062579223000000003, 2024-09-13T06:42:12.042 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:12.042 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:12.042 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:12.042 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:12.042 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:12.042 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43486 2024-09-13T06:42:12.042 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.042 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:12.042 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.042 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:12.043 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.569088+0000", 2024-09-13T06:42:12.043 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:12.043 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.043 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.043 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:12.043 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.569088+0000", 2024-09-13T06:42:12.043 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:12.043 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.043 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.043 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:12.043 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.569088+0000", 2024-09-13T06:42:12.043 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:12.043 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.044 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.044 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:12.044 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.569091+0000", 2024-09-13T06:42:12.044 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9629999999999998e-06 2024-09-13T06:42:12.044 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.044 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.044 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:12.044 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.569097+0000", 2024-09-13T06:42:12.044 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.4160000000000001e-06 2024-09-13T06:42:12.044 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.044 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.044 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:12.045 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.569102+0000", 2024-09-13T06:42:12.045 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6659999999999999e-06 2024-09-13T06:42:12.045 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.045 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.045 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:12.045 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.631346+0000", 2024-09-13T06:42:12.045 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.062243896 2024-09-13T06:42:12.045 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.045 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.045 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:12.045 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.631413+0000", 2024-09-13T06:42:12.045 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.7638000000000005e-05 2024-09-13T06:42:12.045 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.045 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.046 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:12.046 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.631668+0000", 2024-09-13T06:42:12.046 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0002541 2024-09-13T06:42:12.046 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:12.046 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:12.046 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:12.046 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:12.046 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:12.046 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:42:12.048 INFO:teuthology.orchestra.run.smithi081.stdout:osd.3: {} 2024-09-13T06:42:12.048 INFO:teuthology.orchestra.run.smithi081.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-13T06:42:12.049 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-13T06:42:12.050 INFO:teuthology.orchestra.run.smithi081.stdout:osd.4: {} 2024-09-13T06:42:12.050 INFO:teuthology.orchestra.run.smithi081.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-13T06:42:12.050 INFO:teuthology.orchestra.run.smithi081.stdout:osd.5: {} 2024-09-13T06:42:12.050 INFO:teuthology.orchestra.run.smithi081.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-13T06:42:12.051 INFO:teuthology.orchestra.run.smithi081.stdout:osd.6: {} 2024-09-13T06:42:12.051 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-13T06:42:12.052 INFO:teuthology.orchestra.run.smithi081.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-13T06:42:12.052 INFO:teuthology.orchestra.run.smithi081.stderr:Error ENXIO: problem getting command descriptions from osd.7 2024-09-13T06:42:12.052 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-13T06:42:12.052 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:42:12.045+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:42:12.148 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:42:12.145+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:42:12.215 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:42:12.215 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-13T06:42:12.215 INFO:teuthology.orchestra.run.smithi081.stdout: "num_ops": 0 2024-09-13T06:42:12.215 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:42:12.229 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-13T06:42:12.270 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:42:12.269+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:42:12.350 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:42:12.345+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:42:12.403 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:42:12.404 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-13T06:42:12.404 INFO:teuthology.orchestra.run.smithi081.stdout: "complaint_time": 30, 2024-09-13T06:42:12.404 INFO:teuthology.orchestra.run.smithi081.stdout: "num_blocked_ops": 0 2024-09-13T06:42:12.404 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:42:12.420 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-13T06:42:12.470 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:42:12.469+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:42:12.552 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:42:12.549+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:42:12.562 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:42:12.562 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 20, 2024-09-13T06:42:12.562 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 600, 2024-09-13T06:42:12.562 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [ 2024-09-13T06:42:12.562 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.562 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:2226 3.15 3:af026987:::rbd_data.112173e2f1b7.0000000000000017:head [sparse-read 0~4194304] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-13T06:42:12.562 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:37.606562+0000", 2024-09-13T06:42:12.562 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 154.95609942999999, 2024-09-13T06:42:12.562 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.83322091700000001, 2024-09-13T06:42:12.562 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:12.563 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:42:12.563 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:12.563 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:12.563 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:12.563 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 2226 2024-09-13T06:42:12.563 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.563 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:12.563 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.563 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:12.563 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606562+0000", 2024-09-13T06:42:12.563 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:12.563 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.563 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.564 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:12.564 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606562+0000", 2024-09-13T06:42:12.564 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:12.564 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.564 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.564 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:12.564 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606561+0000", 2024-09-13T06:42:12.564 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:12.564 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.564 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.564 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:12.564 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606565+0000", 2024-09-13T06:42:12.564 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.4379999999999999e-06 2024-09-13T06:42:12.565 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.565 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.565 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:12.565 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606569+0000", 2024-09-13T06:42:12.565 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.425e-06 2024-09-13T06:42:12.565 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.565 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.565 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:12.565 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606572+0000", 2024-09-13T06:42:12.565 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.05e-06 2024-09-13T06:42:12.565 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.565 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.566 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:12.566 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606621+0000", 2024-09-13T06:42:12.566 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.8723000000000001e-05 2024-09-13T06:42:12.566 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.566 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.566 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:42:12.566 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606630+0000", 2024-09-13T06:42:12.566 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.8040000000000007e-06 2024-09-13T06:42:12.566 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.566 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.566 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:12.566 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.439648+0000", 2024-09-13T06:42:12.566 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.83301824800000002 2024-09-13T06:42:12.567 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.567 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.567 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:12.567 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.439782+0000", 2024-09-13T06:42:12.567 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00013466699999999999 2024-09-13T06:42:12.567 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:12.567 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:12.567 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:12.567 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.567 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.568 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25661 3.8 3:1180686c:::rbd_data.1121f2c5ee81.0000000000000009:13 [read 397312~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:42:12.568 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.436956+0000", 2024-09-13T06:42:12.568 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 136.125704896, 2024-09-13T06:42:12.568 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089036758999999993, 2024-09-13T06:42:12.568 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:12.568 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:12.568 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:12.568 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:12.568 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:12.568 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25661 2024-09-13T06:42:12.568 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.568 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:12.569 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.569 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:12.569 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436956+0000", 2024-09-13T06:42:12.569 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:12.569 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.569 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.569 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:12.569 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436956+0000", 2024-09-13T06:42:12.569 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:12.569 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.569 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.569 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:12.569 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436956+0000", 2024-09-13T06:42:12.570 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:12.570 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.570 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.570 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:12.570 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436958+0000", 2024-09-13T06:42:12.570 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1770000000000001e-06 2024-09-13T06:42:12.570 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.570 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.570 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:12.570 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436963+0000", 2024-09-13T06:42:12.570 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.6489999999999996e-06 2024-09-13T06:42:12.570 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.570 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.570 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:12.571 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436975+0000", 2024-09-13T06:42:12.571 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1783999999999999e-05 2024-09-13T06:42:12.571 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.571 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.571 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:12.571 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.525671+0000", 2024-09-13T06:42:12.571 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.088696292999999995 2024-09-13T06:42:12.571 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.571 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.571 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:12.571 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.525749+0000", 2024-09-13T06:42:12.571 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.7589000000000005e-05 2024-09-13T06:42:12.571 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.572 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.572 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:12.572 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.525993+0000", 2024-09-13T06:42:12.572 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00024381000000000001 2024-09-13T06:42:12.572 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:12.572 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:12.572 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:12.572 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.572 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.572 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25662 3.8 3:1180686c:::rbd_data.1121f2c5ee81.0000000000000009:13 [read 421888~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:42:12.572 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.436980+0000", 2024-09-13T06:42:12.572 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 136.12568058400001, 2024-09-13T06:42:12.573 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089367577000000004, 2024-09-13T06:42:12.573 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:12.573 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:12.573 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:12.573 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:12.573 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:12.573 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25662 2024-09-13T06:42:12.573 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.573 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:12.573 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.573 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:12.573 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436980+0000", 2024-09-13T06:42:12.573 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:12.573 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.574 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.574 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:12.574 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436980+0000", 2024-09-13T06:42:12.574 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:12.574 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.574 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.574 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:12.574 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436980+0000", 2024-09-13T06:42:12.574 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:12.574 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.574 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.574 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:12.574 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436982+0000", 2024-09-13T06:42:12.575 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3989999999999998e-06 2024-09-13T06:42:12.575 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.575 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.575 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:12.575 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436988+0000", 2024-09-13T06:42:12.575 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0039999999999996e-06 2024-09-13T06:42:12.575 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.575 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.575 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:12.575 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436993+0000", 2024-09-13T06:42:12.575 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6090000000000003e-06 2024-09-13T06:42:12.575 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.576 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.576 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:12.576 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.526035+0000", 2024-09-13T06:42:12.576 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089042248000000004 2024-09-13T06:42:12.576 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.576 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.576 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:12.576 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.526111+0000", 2024-09-13T06:42:12.576 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5643999999999996e-05 2024-09-13T06:42:12.576 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.576 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.576 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:12.576 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.526348+0000", 2024-09-13T06:42:12.577 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00023705800000000001 2024-09-13T06:42:12.577 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:12.577 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:12.577 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:12.577 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.577 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.577 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25663 3.8 3:1180686c:::rbd_data.1121f2c5ee81.0000000000000009:13 [read 466944~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:42:12.577 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.436998+0000", 2024-09-13T06:42:12.577 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 136.12566293699999, 2024-09-13T06:42:12.577 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089730867000000006, 2024-09-13T06:42:12.577 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:12.577 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:12.577 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:12.578 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:12.578 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:12.578 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25663 2024-09-13T06:42:12.578 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.578 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:12.578 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.578 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:12.578 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436998+0000", 2024-09-13T06:42:12.578 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:12.578 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.578 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.578 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:12.578 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436998+0000", 2024-09-13T06:42:12.578 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:12.579 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.579 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.579 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:12.579 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436998+0000", 2024-09-13T06:42:12.579 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:12.579 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.579 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.579 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:12.579 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437000+0000", 2024-09-13T06:42:12.579 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0940000000000002e-06 2024-09-13T06:42:12.579 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.579 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.579 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:12.580 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437005+0000", 2024-09-13T06:42:12.580 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.604e-06 2024-09-13T06:42:12.580 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.580 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.580 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:12.580 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437032+0000", 2024-09-13T06:42:12.580 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6407e-05 2024-09-13T06:42:12.580 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.580 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.580 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:12.580 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.526363+0000", 2024-09-13T06:42:12.580 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089331456000000004 2024-09-13T06:42:12.580 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.581 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.581 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:12.581 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.526404+0000", 2024-09-13T06:42:12.581 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.0887999999999999e-05 2024-09-13T06:42:12.581 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.581 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.581 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:12.581 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.526729+0000", 2024-09-13T06:42:12.581 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00032486 2024-09-13T06:42:12.581 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:12.581 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:12.581 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:12.581 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.582 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.582 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25664 3.8 3:1180686c:::rbd_data.1121f2c5ee81.0000000000000009:13 [read 491520~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:42:12.582 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.437040+0000", 2024-09-13T06:42:12.582 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 136.12562102199999, 2024-09-13T06:42:12.582 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.090016650000000004, 2024-09-13T06:42:12.582 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:12.582 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:12.582 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:12.582 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:12.582 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:12.582 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25664 2024-09-13T06:42:12.582 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.583 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:12.583 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.583 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:12.583 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437040+0000", 2024-09-13T06:42:12.583 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:12.583 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.583 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.583 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:12.583 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437040+0000", 2024-09-13T06:42:12.583 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:12.583 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.584 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.584 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:12.584 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437039+0000", 2024-09-13T06:42:12.584 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:12.584 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.584 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.584 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:12.584 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437047+0000", 2024-09-13T06:42:12.584 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4839999999999998e-06 2024-09-13T06:42:12.584 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.584 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.584 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:12.584 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437054+0000", 2024-09-13T06:42:12.585 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.8299999999999998e-06 2024-09-13T06:42:12.585 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.585 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.585 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:12.585 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437060+0000", 2024-09-13T06:42:12.585 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.1510000000000001e-06 2024-09-13T06:42:12.585 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.585 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.585 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:12.585 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.526772+0000", 2024-09-13T06:42:12.585 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089711737999999999 2024-09-13T06:42:12.585 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.586 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.586 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:12.586 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.526848+0000", 2024-09-13T06:42:12.586 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5870000000000004e-05 2024-09-13T06:42:12.586 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.586 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.586 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:12.586 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.527057+0000", 2024-09-13T06:42:12.586 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000209106 2024-09-13T06:42:12.586 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:12.586 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:12.586 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:12.586 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.587 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.587 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25740 3.18 3:1c662b96:::rbd_data.1121f2c5ee81.0000000000000010:13 [read 200704~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:42:12.587 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443352+0000", 2024-09-13T06:42:12.587 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 136.11930934700001, 2024-09-13T06:42:12.587 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089068222000000002, 2024-09-13T06:42:12.587 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:12.587 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:12.587 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:12.587 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:12.587 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:12.587 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25740 2024-09-13T06:42:12.587 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.587 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:12.587 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.588 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:12.588 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443352+0000", 2024-09-13T06:42:12.588 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:12.588 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.588 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.588 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:12.588 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443352+0000", 2024-09-13T06:42:12.588 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:12.588 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.588 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.588 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:12.588 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443351+0000", 2024-09-13T06:42:12.588 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:12.588 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.589 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.589 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:12.589 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443354+0000", 2024-09-13T06:42:12.589 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.841e-06 2024-09-13T06:42:12.589 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.589 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.589 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:12.589 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443361+0000", 2024-09-13T06:42:12.589 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.0010000000000004e-06 2024-09-13T06:42:12.589 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.589 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.589 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:12.590 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443366+0000", 2024-09-13T06:42:12.590 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7119999999999999e-06 2024-09-13T06:42:12.590 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.590 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.590 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:12.590 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532117+0000", 2024-09-13T06:42:12.590 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.088751327000000005 2024-09-13T06:42:12.590 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.590 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.590 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:12.590 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532193+0000", 2024-09-13T06:42:12.590 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5839000000000004e-05 2024-09-13T06:42:12.590 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.590 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.591 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:12.591 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532420+0000", 2024-09-13T06:42:12.591 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00022691000000000001 2024-09-13T06:42:12.591 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:12.591 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:12.591 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:12.591 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.591 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.591 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25741 3.18 3:1c662b96:::rbd_data.1121f2c5ee81.0000000000000010:13 [read 225280~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:42:12.591 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443378+0000", 2024-09-13T06:42:12.591 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 136.11928258, 2024-09-13T06:42:12.591 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089324107, 2024-09-13T06:42:12.591 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:12.591 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:12.592 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:12.592 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:12.592 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:12.592 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25741 2024-09-13T06:42:12.592 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.592 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:12.592 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.592 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:12.592 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443378+0000", 2024-09-13T06:42:12.592 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:12.592 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.592 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.593 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:12.593 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443378+0000", 2024-09-13T06:42:12.593 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:12.593 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.593 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.593 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:12.593 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443378+0000", 2024-09-13T06:42:12.593 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:12.593 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.593 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.593 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:12.593 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443380+0000", 2024-09-13T06:42:12.593 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3549999999999999e-06 2024-09-13T06:42:12.594 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.594 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.594 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:12.594 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443388+0000", 2024-09-13T06:42:12.594 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.7449999999999995e-06 2024-09-13T06:42:12.594 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.594 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.594 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:12.594 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443393+0000", 2024-09-13T06:42:12.594 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.4e-06 2024-09-13T06:42:12.594 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.594 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.594 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:12.595 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532454+0000", 2024-09-13T06:42:12.595 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089060941000000005 2024-09-13T06:42:12.595 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.595 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.595 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:12.595 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532512+0000", 2024-09-13T06:42:12.595 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7763000000000002e-05 2024-09-13T06:42:12.595 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.595 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.595 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:12.595 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532703+0000", 2024-09-13T06:42:12.595 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000190328 2024-09-13T06:42:12.595 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:12.596 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:12.596 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:12.596 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.596 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.596 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25742 3.18 3:1c662b96:::rbd_data.1121f2c5ee81.0000000000000010:13 [read 270336~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:42:12.596 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443398+0000", 2024-09-13T06:42:12.596 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 136.11926286799999, 2024-09-13T06:42:12.596 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089621836999999996, 2024-09-13T06:42:12.596 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:12.596 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:12.596 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:12.596 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:12.596 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:12.597 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25742 2024-09-13T06:42:12.597 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.597 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:12.597 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.597 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:12.597 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443398+0000", 2024-09-13T06:42:12.597 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:12.597 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.597 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.597 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:12.597 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443398+0000", 2024-09-13T06:42:12.597 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:12.598 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.598 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.598 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:12.598 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443398+0000", 2024-09-13T06:42:12.598 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:12.598 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.598 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.598 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:12.598 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443400+0000", 2024-09-13T06:42:12.598 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1849999999999998e-06 2024-09-13T06:42:12.598 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.598 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.598 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:12.599 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443407+0000", 2024-09-13T06:42:12.599 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3669999999999999e-06 2024-09-13T06:42:12.599 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.599 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.599 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:12.599 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443420+0000", 2024-09-13T06:42:12.599 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2645e-05 2024-09-13T06:42:12.599 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.599 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.599 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:12.599 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532742+0000", 2024-09-13T06:42:12.599 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089322200000000004 2024-09-13T06:42:12.599 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.600 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.600 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:12.600 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532818+0000", 2024-09-13T06:42:12.600 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.6019000000000005e-05 2024-09-13T06:42:12.600 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.600 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.600 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:12.600 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533020+0000", 2024-09-13T06:42:12.600 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000201721 2024-09-13T06:42:12.601 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:12.601 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:12.601 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:12.601 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.601 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.601 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25743 3.18 3:1c662b96:::rbd_data.1121f2c5ee81.0000000000000010:13 [read 294912~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:42:12.601 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443425+0000", 2024-09-13T06:42:12.601 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 136.11923586, 2024-09-13T06:42:12.601 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089864075000000002, 2024-09-13T06:42:12.601 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:12.601 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:12.601 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:12.601 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:12.602 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:12.602 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25743 2024-09-13T06:42:12.602 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.602 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:12.602 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.602 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:12.602 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443425+0000", 2024-09-13T06:42:12.602 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:12.602 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.602 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.602 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:12.602 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443425+0000", 2024-09-13T06:42:12.602 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:12.602 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.603 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.603 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:12.603 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443425+0000", 2024-09-13T06:42:12.603 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:12.603 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.603 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.603 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:12.603 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443432+0000", 2024-09-13T06:42:12.603 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3420000000000002e-06 2024-09-13T06:42:12.603 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.603 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.603 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:12.604 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443440+0000", 2024-09-13T06:42:12.604 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5689999999999999e-06 2024-09-13T06:42:12.604 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.604 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.604 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:12.604 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443445+0000", 2024-09-13T06:42:12.604 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9590000000000003e-06 2024-09-13T06:42:12.604 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.604 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.604 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:12.604 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533063+0000", 2024-09-13T06:42:12.604 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089617988999999995 2024-09-13T06:42:12.604 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.605 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.605 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:12.605 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533122+0000", 2024-09-13T06:42:12.605 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9052999999999999e-05 2024-09-13T06:42:12.605 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.605 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.605 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:12.605 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533289+0000", 2024-09-13T06:42:12.605 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00016752800000000001 2024-09-13T06:42:12.605 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:12.605 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:12.605 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:12.605 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.605 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.606 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25744 3.18 3.69d46638 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:42:12.606 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443449+0000", 2024-09-13T06:42:12.606 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 136.119211713, 2024-09-13T06:42:12.606 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089869148999999995, 2024-09-13T06:42:12.606 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:12.606 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:42:12.606 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:12.606 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:12.606 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:12.606 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25744 2024-09-13T06:42:12.606 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.606 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:12.606 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.607 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:12.607 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443449+0000", 2024-09-13T06:42:12.607 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:12.607 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.607 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.607 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:12.607 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443449+0000", 2024-09-13T06:42:12.607 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:12.607 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.607 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.607 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:12.607 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443449+0000", 2024-09-13T06:42:12.607 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:12.608 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.608 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.608 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:12.608 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443451+0000", 2024-09-13T06:42:12.608 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.244e-06 2024-09-13T06:42:12.608 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.608 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.608 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:12.608 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443457+0000", 2024-09-13T06:42:12.608 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.66e-06 2024-09-13T06:42:12.608 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.608 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.608 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:12.609 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443461+0000", 2024-09-13T06:42:12.609 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5449999999999997e-06 2024-09-13T06:42:12.609 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.609 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.609 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:12.609 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533311+0000", 2024-09-13T06:42:12.609 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089849729000000003 2024-09-13T06:42:12.609 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.609 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.609 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:12.609 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533318+0000", 2024-09-13T06:42:12.609 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.328e-06 2024-09-13T06:42:12.609 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:12.609 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:12.610 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:12.610 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.610 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.610 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25745 3.18 3.69d46638 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:42:12.610 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443466+0000", 2024-09-13T06:42:12.610 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 136.119194655, 2024-09-13T06:42:12.610 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089886743000000005, 2024-09-13T06:42:12.610 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:12.610 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:42:12.610 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:12.610 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:12.610 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:12.610 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25745 2024-09-13T06:42:12.611 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.611 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:12.611 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.611 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:12.611 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443466+0000", 2024-09-13T06:42:12.611 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:12.611 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.611 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.611 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:12.611 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443466+0000", 2024-09-13T06:42:12.611 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:12.611 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.611 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.611 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:12.612 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443466+0000", 2024-09-13T06:42:12.612 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:12.612 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.612 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.612 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:12.612 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443474+0000", 2024-09-13T06:42:12.612 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.1289999999999996e-06 2024-09-13T06:42:12.612 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.612 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.612 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:12.612 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443484+0000", 2024-09-13T06:42:12.612 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0654e-05 2024-09-13T06:42:12.612 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.613 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.613 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:12.613 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443490+0000", 2024-09-13T06:42:12.613 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8030000000000002e-06 2024-09-13T06:42:12.613 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.613 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.613 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:12.613 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533348+0000", 2024-09-13T06:42:12.613 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089857267000000005 2024-09-13T06:42:12.613 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.613 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.613 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:12.613 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533353+0000", 2024-09-13T06:42:12.614 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.5520000000000004e-06 2024-09-13T06:42:12.614 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:12.614 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:12.614 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:12.614 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.614 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.614 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25746 3.18 3.69d46638 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:42:12.614 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443495+0000", 2024-09-13T06:42:12.614 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 136.11916554199999, 2024-09-13T06:42:12.614 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089903725000000004, 2024-09-13T06:42:12.614 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:12.614 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:42:12.614 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:12.614 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:12.615 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:12.615 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25746 2024-09-13T06:42:12.615 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.615 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:12.615 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.615 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:12.615 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443495+0000", 2024-09-13T06:42:12.615 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:12.615 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.615 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.615 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:12.615 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443495+0000", 2024-09-13T06:42:12.615 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:12.615 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.616 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.616 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:12.616 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443495+0000", 2024-09-13T06:42:12.616 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:12.616 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.616 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.616 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:12.616 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443498+0000", 2024-09-13T06:42:12.616 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.7690000000000001e-06 2024-09-13T06:42:12.616 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.616 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.616 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:12.616 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443504+0000", 2024-09-13T06:42:12.617 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9710000000000001e-06 2024-09-13T06:42:12.617 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.617 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.617 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:12.617 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443508+0000", 2024-09-13T06:42:12.617 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4159999999999997e-06 2024-09-13T06:42:12.617 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.617 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.617 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:12.617 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533391+0000", 2024-09-13T06:42:12.617 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089882607000000003 2024-09-13T06:42:12.617 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.617 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.617 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:12.618 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533399+0000", 2024-09-13T06:42:12.618 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.4349999999999997e-06 2024-09-13T06:42:12.618 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:12.618 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:12.618 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:12.618 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.618 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.618 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25747 3.8 3.63996268 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:42:12.618 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443512+0000", 2024-09-13T06:42:12.618 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 136.119148811, 2024-09-13T06:42:12.618 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089880075000000004, 2024-09-13T06:42:12.618 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:12.618 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:42:12.619 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:12.619 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:12.619 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:12.619 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25747 2024-09-13T06:42:12.619 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.619 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:12.619 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.619 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:12.619 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443512+0000", 2024-09-13T06:42:12.619 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:12.619 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.619 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.619 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:12.619 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443512+0000", 2024-09-13T06:42:12.620 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:12.620 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.620 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.620 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:12.620 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443512+0000", 2024-09-13T06:42:12.620 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:12.620 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.620 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.620 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:12.620 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443514+0000", 2024-09-13T06:42:12.620 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0980000000000001e-06 2024-09-13T06:42:12.620 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.620 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.621 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:12.621 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443520+0000", 2024-09-13T06:42:12.621 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7069999999999997e-06 2024-09-13T06:42:12.621 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.621 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.621 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:12.621 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443524+0000", 2024-09-13T06:42:12.621 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5390000000000001e-06 2024-09-13T06:42:12.621 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.621 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.621 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:12.621 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533384+0000", 2024-09-13T06:42:12.621 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089859684999999995 2024-09-13T06:42:12.622 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.622 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.622 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:12.622 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533392+0000", 2024-09-13T06:42:12.622 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.3440000000000001e-06 2024-09-13T06:42:12.622 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:12.622 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:12.622 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:12.622 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.622 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.622 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25748 3.8 3.63996268 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:42:12.622 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443528+0000", 2024-09-13T06:42:12.622 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 136.11913268399999, 2024-09-13T06:42:12.623 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089890715999999996, 2024-09-13T06:42:12.623 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:12.623 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:42:12.623 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:12.623 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:12.623 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:12.623 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25748 2024-09-13T06:42:12.623 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.623 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:12.623 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.623 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:12.623 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443528+0000", 2024-09-13T06:42:12.623 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:12.623 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.624 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.624 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:12.624 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443528+0000", 2024-09-13T06:42:12.624 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:12.624 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.624 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.624 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:12.624 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443528+0000", 2024-09-13T06:42:12.624 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:12.624 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.624 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.624 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:12.624 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443530+0000", 2024-09-13T06:42:12.625 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0650000000000001e-06 2024-09-13T06:42:12.625 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.625 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.625 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:12.625 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443536+0000", 2024-09-13T06:42:12.625 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7259999999999999e-06 2024-09-13T06:42:12.625 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.625 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.625 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:12.625 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443540+0000", 2024-09-13T06:42:12.625 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5009999999999998e-06 2024-09-13T06:42:12.625 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.625 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.626 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:12.626 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533412+0000", 2024-09-13T06:42:12.626 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089871873000000005 2024-09-13T06:42:12.626 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.626 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.626 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:12.626 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533419+0000", 2024-09-13T06:42:12.626 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.883e-06 2024-09-13T06:42:12.626 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:12.626 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:12.626 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:12.626 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.626 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.627 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25749 3.8 3.63996268 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:42:12.627 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443545+0000", 2024-09-13T06:42:12.627 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 136.119116488, 2024-09-13T06:42:12.627 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089897988999999998, 2024-09-13T06:42:12.627 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:12.627 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:42:12.627 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:12.627 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:12.627 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:12.627 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25749 2024-09-13T06:42:12.627 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.627 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:12.627 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.628 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:12.628 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443545+0000", 2024-09-13T06:42:12.628 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:12.628 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.628 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.628 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:12.628 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443545+0000", 2024-09-13T06:42:12.628 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:12.628 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.628 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.628 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:12.628 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443544+0000", 2024-09-13T06:42:12.628 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:12.629 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.629 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.629 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:12.629 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443553+0000", 2024-09-13T06:42:12.629 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.4770000000000003e-06 2024-09-13T06:42:12.629 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.629 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.629 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:12.629 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443564+0000", 2024-09-13T06:42:12.629 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0986e-05 2024-09-13T06:42:12.629 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.629 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.629 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:12.630 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443569+0000", 2024-09-13T06:42:12.630 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2530000000000004e-06 2024-09-13T06:42:12.630 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.630 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.630 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:12.630 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533438+0000", 2024-09-13T06:42:12.630 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089868641999999999 2024-09-13T06:42:12.630 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.630 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.630 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:12.630 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533442+0000", 2024-09-13T06:42:12.630 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.989e-06 2024-09-13T06:42:12.630 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:12.630 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:12.631 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:12.631 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.631 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.631 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25750 3.8 3.63996268 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:42:12.631 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443574+0000", 2024-09-13T06:42:12.631 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 136.11908700199999, 2024-09-13T06:42:12.631 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089895143999999996, 2024-09-13T06:42:12.631 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:12.631 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:42:12.631 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:12.631 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:12.631 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:12.631 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25750 2024-09-13T06:42:12.632 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.632 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:12.632 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.632 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:12.632 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443574+0000", 2024-09-13T06:42:12.632 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:12.632 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.632 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.632 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:12.632 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443574+0000", 2024-09-13T06:42:12.632 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:12.632 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.632 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.633 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:12.633 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443574+0000", 2024-09-13T06:42:12.633 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:12.633 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.633 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.633 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:12.633 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443576+0000", 2024-09-13T06:42:12.633 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6910000000000002e-06 2024-09-13T06:42:12.633 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.633 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.633 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:12.633 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443583+0000", 2024-09-13T06:42:12.633 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.331e-06 2024-09-13T06:42:12.633 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.634 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.634 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:12.634 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443587+0000", 2024-09-13T06:42:12.634 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6129999999999997e-06 2024-09-13T06:42:12.634 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.634 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.634 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:12.634 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533464+0000", 2024-09-13T06:42:12.634 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089876605999999998 2024-09-13T06:42:12.634 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.634 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.634 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:12.634 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533469+0000", 2024-09-13T06:42:12.635 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3909999999999997e-06 2024-09-13T06:42:12.635 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:12.635 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:12.635 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:12.635 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.635 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.635 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25751 3.8 3.63996268 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:42:12.635 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443592+0000", 2024-09-13T06:42:12.635 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 136.11906930500001, 2024-09-13T06:42:12.635 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089913650999999997, 2024-09-13T06:42:12.635 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:12.635 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:42:12.635 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:12.635 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:12.636 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:12.636 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25751 2024-09-13T06:42:12.636 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.636 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:12.636 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.636 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:12.636 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443592+0000", 2024-09-13T06:42:12.636 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:12.636 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.636 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.636 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:12.636 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443592+0000", 2024-09-13T06:42:12.636 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:12.637 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.637 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.637 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:12.637 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443591+0000", 2024-09-13T06:42:12.637 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:12.637 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.637 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.637 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:12.637 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443594+0000", 2024-09-13T06:42:12.637 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3649999999999998e-06 2024-09-13T06:42:12.637 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.637 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.638 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:12.638 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443599+0000", 2024-09-13T06:42:12.638 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.699e-06 2024-09-13T06:42:12.638 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.638 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.638 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:12.638 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443611+0000", 2024-09-13T06:42:12.638 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1503e-05 2024-09-13T06:42:12.638 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.638 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.638 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:12.638 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533497+0000", 2024-09-13T06:42:12.638 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089886453000000005 2024-09-13T06:42:12.639 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.639 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.639 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:12.639 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533505+0000", 2024-09-13T06:42:12.639 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.9910000000000002e-06 2024-09-13T06:42:12.639 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:12.639 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:12.639 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:12.639 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.639 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.639 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25752 3.8 3.63996268 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:42:12.639 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443615+0000", 2024-09-13T06:42:12.639 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 136.119045524, 2024-09-13T06:42:12.639 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089905868999999999, 2024-09-13T06:42:12.640 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:12.640 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:42:12.640 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:12.640 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:12.640 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:12.640 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25752 2024-09-13T06:42:12.640 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.640 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:12.640 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.640 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:12.640 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443615+0000", 2024-09-13T06:42:12.640 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:12.640 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.641 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.641 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:12.641 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443615+0000", 2024-09-13T06:42:12.641 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:12.641 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.641 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.641 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:12.641 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443615+0000", 2024-09-13T06:42:12.641 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:12.641 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.641 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.641 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:12.641 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443617+0000", 2024-09-13T06:42:12.642 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3539999999999998e-06 2024-09-13T06:42:12.642 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.642 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.642 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:12.642 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443624+0000", 2024-09-13T06:42:12.642 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3600000000000001e-06 2024-09-13T06:42:12.642 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.642 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.642 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:12.642 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443628+0000", 2024-09-13T06:42:12.642 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.2350000000000001e-06 2024-09-13T06:42:12.642 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.642 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.643 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:12.643 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533517+0000", 2024-09-13T06:42:12.643 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089889029999999995 2024-09-13T06:42:12.643 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.643 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.643 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:12.643 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533521+0000", 2024-09-13T06:42:12.643 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.2529999999999998e-06 2024-09-13T06:42:12.643 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:12.643 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:12.643 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:12.643 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.643 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.644 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25755 3.8 3.63996268 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:42:12.644 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.444692+0000", 2024-09-13T06:42:12.644 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 136.11796881800001, 2024-09-13T06:42:12.644 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.088904186999999996, 2024-09-13T06:42:12.644 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:12.644 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:42:12.644 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:12.644 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:12.644 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:12.644 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25755 2024-09-13T06:42:12.644 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.644 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:12.644 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.645 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:12.645 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.444692+0000", 2024-09-13T06:42:12.645 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:12.645 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.645 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.645 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:12.645 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.444692+0000", 2024-09-13T06:42:12.645 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:12.645 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.645 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.645 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:12.645 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.444692+0000", 2024-09-13T06:42:12.645 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:12.645 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.646 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.646 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:12.646 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.444694+0000", 2024-09-13T06:42:12.646 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.058e-06 2024-09-13T06:42:12.646 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.646 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.646 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:12.646 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.444700+0000", 2024-09-13T06:42:12.646 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7769999999999999e-06 2024-09-13T06:42:12.646 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.646 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.646 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:12.646 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.444704+0000", 2024-09-13T06:42:12.647 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6229999999999996e-06 2024-09-13T06:42:12.647 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.647 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.647 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:12.647 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533587+0000", 2024-09-13T06:42:12.647 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.088882744999999999 2024-09-13T06:42:12.647 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.647 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.647 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:12.647 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533596+0000", 2024-09-13T06:42:12.647 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.3270000000000007e-06 2024-09-13T06:42:12.647 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:12.647 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:12.647 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:12.648 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.648 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.648 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:64356 3.c 3:32785be9:::rbd_header.11218ba71f0d:head [watch reconnect cookie 140361410387072 gen 2] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e95)", 2024-09-13T06:42:12.648 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:48.473318+0000", 2024-09-13T06:42:12.648 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 84.089343131000007, 2024-09-13T06:42:12.648 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1458904379999999, 2024-09-13T06:42:12.648 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:12.648 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:12.648 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:12.648 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:12.648 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:12.648 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 64356 2024-09-13T06:42:12.648 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.649 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:12.649 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.649 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:12.649 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:48.473318+0000", 2024-09-13T06:42:12.649 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:12.649 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.649 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.649 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:12.649 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:48.473318+0000", 2024-09-13T06:42:12.649 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:12.649 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.649 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.649 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:12.650 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:48.473315+0000", 2024-09-13T06:42:12.650 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999971 2024-09-13T06:42:12.650 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.650 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.650 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:12.650 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:48.473329+0000", 2024-09-13T06:42:12.650 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.433e-05 2024-09-13T06:42:12.650 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.650 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.650 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:12.650 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:48.473363+0000", 2024-09-13T06:42:12.650 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.3592e-05 2024-09-13T06:42:12.650 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.650 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.651 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:12.651 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:48.473386+0000", 2024-09-13T06:42:12.651 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2708999999999999e-05 2024-09-13T06:42:12.651 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.651 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.651 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:12.651 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:48.473804+0000", 2024-09-13T06:42:12.651 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00041789399999999998 2024-09-13T06:42:12.651 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.651 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.651 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:42:12.651 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:48.473830+0000", 2024-09-13T06:42:12.651 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6869e-05 2024-09-13T06:42:12.652 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.652 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.652 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:12.652 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:49.614332+0000", 2024-09-13T06:42:12.652 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.140501107 2024-09-13T06:42:12.652 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.652 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.652 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for rw locks", 2024-09-13T06:42:12.652 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:49.614496+0000", 2024-09-13T06:42:12.652 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00016451200000000001 2024-09-13T06:42:12.652 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.652 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.652 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:12.653 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:49.617131+0000", 2024-09-13T06:42:12.653 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.002634843 2024-09-13T06:42:12.653 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.653 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.653 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:12.653 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:49.617204+0000", 2024-09-13T06:42:12.653 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.2991000000000006e-05 2024-09-13T06:42:12.653 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:12.653 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:12.653 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:12.653 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:49.619208+0000", 2024-09-13T06:42:12.653 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.002004381 2024-09-13T06:42:12.653 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:12.653 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:12.654 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:12.654 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:12.654 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:12.654 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:42:12.655 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-13T06:42:12.656 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:42:12.653+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:42:12.756 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:42:12.753+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:42:12.793 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:42:12.793 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [], 2024-09-13T06:42:12.793 INFO:teuthology.orchestra.run.smithi139.stdout: "num_ops": 0 2024-09-13T06:42:12.794 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:42:12.809 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-13T06:42:12.858 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:42:12.853+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:42:12.932 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:42:12.932 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [], 2024-09-13T06:42:12.933 INFO:teuthology.orchestra.run.smithi139.stdout: "complaint_time": 30, 2024-09-13T06:42:12.933 INFO:teuthology.orchestra.run.smithi139.stdout: "num_blocked_ops": 0 2024-09-13T06:42:12.933 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:42:12.948 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-13T06:42:12.959 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:42:12.957+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:42:13.060 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:42:13.057+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:42:13.086 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:42:13.087 INFO:teuthology.orchestra.run.smithi139.stdout: "size": 20, 2024-09-13T06:42:13.087 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 600, 2024-09-13T06:42:13.087 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [ 2024-09-13T06:42:13.087 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.087 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18706 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 3346432~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:42:13.087 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.846138+0000", 2024-09-13T06:42:13.087 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 141.239244904, 2024-09-13T06:42:13.088 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.102018712, 2024-09-13T06:42:13.088 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:13.088 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:13.088 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:13.088 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:13.088 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:13.088 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18706 2024-09-13T06:42:13.088 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.088 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:13.089 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.089 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:13.089 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846138+0000", 2024-09-13T06:42:13.089 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:13.089 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.089 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.089 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:13.089 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846138+0000", 2024-09-13T06:42:13.089 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:13.089 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.089 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.089 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:13.090 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846138+0000", 2024-09-13T06:42:13.090 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:13.090 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.090 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.090 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:13.090 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846141+0000", 2024-09-13T06:42:13.090 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.6969999999999999e-06 2024-09-13T06:42:13.090 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.090 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.090 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:13.090 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846150+0000", 2024-09-13T06:42:13.090 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6400000000000003e-06 2024-09-13T06:42:13.090 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.090 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.090 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:13.091 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846160+0000", 2024-09-13T06:42:13.091 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.3999999999999998e-06 2024-09-13T06:42:13.091 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.091 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.091 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:13.091 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.947764+0000", 2024-09-13T06:42:13.091 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101604085 2024-09-13T06:42:13.091 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.091 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.091 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:13.091 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.947888+0000", 2024-09-13T06:42:13.091 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000124113 2024-09-13T06:42:13.091 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.092 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.092 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:13.092 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.948157+0000", 2024-09-13T06:42:13.092 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00026943399999999998 2024-09-13T06:42:13.092 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:13.092 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:13.092 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:13.092 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.092 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.092 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18707 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 3375104~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:42:13.092 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.846207+0000", 2024-09-13T06:42:13.092 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 141.239176138, 2024-09-13T06:42:13.092 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10238114099999999, 2024-09-13T06:42:13.093 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:13.093 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:13.093 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:13.093 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:13.093 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:13.093 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18707 2024-09-13T06:42:13.093 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.093 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:13.093 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.093 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:13.093 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846207+0000", 2024-09-13T06:42:13.093 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:13.094 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.094 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.094 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:13.094 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846207+0000", 2024-09-13T06:42:13.094 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:13.094 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.094 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.094 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:13.094 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846206+0000", 2024-09-13T06:42:13.094 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:42:13.094 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.094 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.094 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:13.095 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846211+0000", 2024-09-13T06:42:13.095 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.3000000000000003e-06 2024-09-13T06:42:13.095 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.095 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.095 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:13.095 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846220+0000", 2024-09-13T06:42:13.095 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6199999999999994e-06 2024-09-13T06:42:13.095 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.095 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.095 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:13.095 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846228+0000", 2024-09-13T06:42:13.095 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.7500000000000003e-06 2024-09-13T06:42:13.095 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.095 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.095 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:13.096 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.948267+0000", 2024-09-13T06:42:13.096 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10203878700000001 2024-09-13T06:42:13.096 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.096 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.096 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:13.096 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.948435+0000", 2024-09-13T06:42:13.096 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00016796500000000001 2024-09-13T06:42:13.096 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.096 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.096 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:13.096 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.948588+0000", 2024-09-13T06:42:13.096 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00015373599999999999 2024-09-13T06:42:13.096 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:13.096 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:13.097 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:13.097 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.097 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.097 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18718 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 3690496~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:42:13.097 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.850174+0000", 2024-09-13T06:42:13.097 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 141.23520898500001, 2024-09-13T06:42:13.097 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101854154, 2024-09-13T06:42:13.097 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:13.097 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:13.097 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:13.097 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:13.097 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:13.097 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18718 2024-09-13T06:42:13.098 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.098 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:13.098 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.098 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:13.098 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850174+0000", 2024-09-13T06:42:13.098 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:13.098 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.098 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.098 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:13.098 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850174+0000", 2024-09-13T06:42:13.098 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:13.098 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.098 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.099 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:13.099 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850173+0000", 2024-09-13T06:42:13.099 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:42:13.099 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.099 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.099 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:13.099 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850178+0000", 2024-09-13T06:42:13.099 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.4129999999999999e-06 2024-09-13T06:42:13.099 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.099 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.099 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:13.099 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850188+0000", 2024-09-13T06:42:13.099 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.8600000000000005e-06 2024-09-13T06:42:13.099 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.100 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.100 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:13.100 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850195+0000", 2024-09-13T06:42:13.100 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.8730000000000007e-06 2024-09-13T06:42:13.100 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.100 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.100 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:13.100 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.951766+0000", 2024-09-13T06:42:13.100 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.1015703 2024-09-13T06:42:13.100 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.100 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.100 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:13.101 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.951879+0000", 2024-09-13T06:42:13.101 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000112932 2024-09-13T06:42:13.101 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.101 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.101 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:13.101 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.952029+0000", 2024-09-13T06:42:13.101 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000149846 2024-09-13T06:42:13.101 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:13.101 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:13.101 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:13.101 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.101 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.101 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18719 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 3719168~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:42:13.102 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.850202+0000", 2024-09-13T06:42:13.102 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 141.235180942, 2024-09-13T06:42:13.102 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.102191676, 2024-09-13T06:42:13.102 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:13.102 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:13.102 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:13.102 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:13.102 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:13.102 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18719 2024-09-13T06:42:13.102 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.102 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:13.102 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.102 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:13.102 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850202+0000", 2024-09-13T06:42:13.103 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:13.103 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.103 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.103 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:13.103 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850202+0000", 2024-09-13T06:42:13.103 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:13.103 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.103 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.103 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:13.104 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850202+0000", 2024-09-13T06:42:13.104 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:42:13.104 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.104 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.104 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:13.104 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850205+0000", 2024-09-13T06:42:13.104 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.89e-06 2024-09-13T06:42:13.104 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.104 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.104 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:13.104 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850216+0000", 2024-09-13T06:42:13.104 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0233e-05 2024-09-13T06:42:13.104 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.104 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.104 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:13.105 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850223+0000", 2024-09-13T06:42:13.105 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5299999999999999e-06 2024-09-13T06:42:13.105 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.105 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.105 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:13.105 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.952106+0000", 2024-09-13T06:42:13.105 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10188309299999999 2024-09-13T06:42:13.105 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.105 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.105 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:13.105 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.952233+0000", 2024-09-13T06:42:13.105 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000126993 2024-09-13T06:42:13.105 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.105 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.106 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:13.106 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.952394+0000", 2024-09-13T06:42:13.106 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000160791 2024-09-13T06:42:13.106 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:13.106 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:13.106 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:13.106 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.106 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.106 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18720 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 3747840~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:42:13.106 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.850726+0000", 2024-09-13T06:42:13.106 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 141.234657113, 2024-09-13T06:42:13.106 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10199504299999999, 2024-09-13T06:42:13.106 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:13.106 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:13.107 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:13.107 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:13.107 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:13.107 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18720 2024-09-13T06:42:13.107 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.107 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:13.107 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.107 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:13.107 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850726+0000", 2024-09-13T06:42:13.107 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:13.107 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.107 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.107 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:13.107 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850726+0000", 2024-09-13T06:42:13.107 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:13.108 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.108 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.108 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:13.108 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850229+0000", 2024-09-13T06:42:13.108 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9995027 2024-09-13T06:42:13.108 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.108 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.108 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:13.108 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850731+0000", 2024-09-13T06:42:13.108 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00050221599999999999 2024-09-13T06:42:13.108 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.109 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.109 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:13.109 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850751+0000", 2024-09-13T06:42:13.109 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.9703000000000001e-05 2024-09-13T06:42:13.109 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.109 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.109 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:13.109 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850764+0000", 2024-09-13T06:42:13.109 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3207000000000001e-05 2024-09-13T06:42:13.109 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.110 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.110 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:13.110 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.952454+0000", 2024-09-13T06:42:13.110 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101690102 2024-09-13T06:42:13.110 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.110 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.110 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:13.110 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.952571+0000", 2024-09-13T06:42:13.110 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000116556 2024-09-13T06:42:13.110 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.110 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.110 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:13.110 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.952721+0000", 2024-09-13T06:42:13.111 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000150419 2024-09-13T06:42:13.111 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:13.111 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:13.111 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:13.111 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.111 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.111 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18730 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 4034560~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:42:13.111 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.854013+0000", 2024-09-13T06:42:13.111 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 141.231370172, 2024-09-13T06:42:13.112 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10186914399999999, 2024-09-13T06:42:13.112 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:13.112 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:13.112 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:13.112 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:13.112 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:13.112 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18730 2024-09-13T06:42:13.112 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.112 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:13.112 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.112 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:13.113 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.854013+0000", 2024-09-13T06:42:13.113 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:13.113 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.113 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.113 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:13.113 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.854013+0000", 2024-09-13T06:42:13.113 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:13.113 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.113 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.113 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:13.114 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.854013+0000", 2024-09-13T06:42:13.114 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:13.114 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.114 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.114 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:13.114 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.854016+0000", 2024-09-13T06:42:13.114 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.1839999999999999e-06 2024-09-13T06:42:13.114 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.114 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.114 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:13.114 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.854025+0000", 2024-09-13T06:42:13.115 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.8030000000000003e-06 2024-09-13T06:42:13.115 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.115 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.115 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:13.115 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.854033+0000", 2024-09-13T06:42:13.115 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6500000000000002e-06 2024-09-13T06:42:13.115 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.115 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.115 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:13.116 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.955546+0000", 2024-09-13T06:42:13.116 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10151296 2024-09-13T06:42:13.116 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.116 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.116 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:13.116 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.955694+0000", 2024-09-13T06:42:13.116 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000147773 2024-09-13T06:42:13.116 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.116 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.116 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:13.116 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.955882+0000", 2024-09-13T06:42:13.117 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000188371 2024-09-13T06:42:13.117 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:13.117 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:13.117 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:13.117 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.117 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.117 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18742 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 4378624~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:42:13.117 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.857984+0000", 2024-09-13T06:42:13.117 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 141.22739904900001, 2024-09-13T06:42:13.117 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10179961799999999, 2024-09-13T06:42:13.117 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:13.118 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:13.118 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:13.118 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:13.118 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:13.118 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18742 2024-09-13T06:42:13.118 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.118 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:13.118 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.118 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:13.118 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.857984+0000", 2024-09-13T06:42:13.119 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:13.119 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.119 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.119 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:13.119 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.857984+0000", 2024-09-13T06:42:13.119 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:13.119 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.119 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.119 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:13.119 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.857983+0000", 2024-09-13T06:42:13.120 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:42:13.120 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.120 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.120 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:13.120 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.857987+0000", 2024-09-13T06:42:13.120 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0670000000000002e-06 2024-09-13T06:42:13.120 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.120 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.120 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:13.120 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.857997+0000", 2024-09-13T06:42:13.121 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6830000000000003e-06 2024-09-13T06:42:13.121 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.121 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.121 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:13.121 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.858006+0000", 2024-09-13T06:42:13.121 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.5739999999999996e-06 2024-09-13T06:42:13.121 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.121 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.122 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:13.122 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.959453+0000", 2024-09-13T06:42:13.122 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101447339 2024-09-13T06:42:13.122 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.122 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.122 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:13.122 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.959603+0000", 2024-09-13T06:42:13.122 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000150316 2024-09-13T06:42:13.122 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.122 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.122 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:13.122 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.959784+0000", 2024-09-13T06:42:13.123 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00018065900000000001 2024-09-13T06:42:13.123 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:13.123 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:13.123 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:13.123 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.123 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.123 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18743 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 4407296~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:42:13.123 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.858012+0000", 2024-09-13T06:42:13.123 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 141.22737105600001, 2024-09-13T06:42:13.123 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10210024500000001, 2024-09-13T06:42:13.123 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:13.123 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:13.124 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:13.124 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:13.124 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:13.124 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18743 2024-09-13T06:42:13.124 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.124 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:13.124 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.124 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:13.124 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.858012+0000", 2024-09-13T06:42:13.124 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:13.124 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.124 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.124 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:13.125 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.858012+0000", 2024-09-13T06:42:13.125 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:13.125 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.125 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.125 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:13.125 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.858011+0000", 2024-09-13T06:42:13.125 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:42:13.125 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.125 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.125 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:13.125 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.858016+0000", 2024-09-13T06:42:13.125 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0659999999999997e-06 2024-09-13T06:42:13.125 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.125 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.126 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:13.126 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.858024+0000", 2024-09-13T06:42:13.126 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.7700000000000007e-06 2024-09-13T06:42:13.126 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.126 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.126 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:13.126 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.858032+0000", 2024-09-13T06:42:13.126 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.7700000000000001e-06 2024-09-13T06:42:13.126 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.126 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.126 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:13.126 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.959850+0000", 2024-09-13T06:42:13.126 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.1018182 2024-09-13T06:42:13.127 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.127 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.127 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:13.127 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.959964+0000", 2024-09-13T06:42:13.127 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00011413600000000001 2024-09-13T06:42:13.127 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.127 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.127 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:13.127 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.960113+0000", 2024-09-13T06:42:13.127 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00014813900000000001 2024-09-13T06:42:13.127 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:13.127 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:13.127 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:13.127 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.127 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.128 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18755 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 4751360~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:42:13.128 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.862061+0000", 2024-09-13T06:42:13.128 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 141.22332280399999, 2024-09-13T06:42:13.128 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101907023, 2024-09-13T06:42:13.128 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:13.128 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:13.128 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:13.128 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:13.128 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:13.128 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18755 2024-09-13T06:42:13.128 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.128 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:13.128 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.128 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:13.128 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862061+0000", 2024-09-13T06:42:13.129 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:13.129 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.129 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.129 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:13.129 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862061+0000", 2024-09-13T06:42:13.129 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:13.129 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.129 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.129 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:13.129 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862060+0000", 2024-09-13T06:42:13.129 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:42:13.129 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.129 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.129 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:13.129 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862064+0000", 2024-09-13T06:42:13.130 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.3229999999999999e-06 2024-09-13T06:42:13.130 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.130 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.130 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:13.130 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862078+0000", 2024-09-13T06:42:13.130 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.433e-05 2024-09-13T06:42:13.130 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.130 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.130 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:13.130 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862086+0000", 2024-09-13T06:42:13.130 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.3869999999999997e-06 2024-09-13T06:42:13.130 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.130 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.130 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:13.130 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.963635+0000", 2024-09-13T06:42:13.131 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101549606 2024-09-13T06:42:13.131 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.131 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.131 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:13.131 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.963783+0000", 2024-09-13T06:42:13.131 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000147312 2024-09-13T06:42:13.131 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.131 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.131 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:13.131 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.963968+0000", 2024-09-13T06:42:13.131 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000185028 2024-09-13T06:42:13.132 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:13.132 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:13.132 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:13.132 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.132 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.132 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18756 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 4780032~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:42:13.132 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.862132+0000", 2024-09-13T06:42:13.132 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 141.22325096099999, 2024-09-13T06:42:13.132 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.102159295, 2024-09-13T06:42:13.132 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:13.132 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:13.132 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:13.132 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:13.133 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:13.133 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18756 2024-09-13T06:42:13.133 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.133 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:13.133 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.133 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:13.133 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862132+0000", 2024-09-13T06:42:13.133 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:13.133 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.133 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.133 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:13.133 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862132+0000", 2024-09-13T06:42:13.133 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:13.133 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.134 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.134 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:13.134 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862132+0000", 2024-09-13T06:42:13.134 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:42:13.134 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.134 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.134 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:13.134 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862136+0000", 2024-09-13T06:42:13.134 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.9559999999999999e-06 2024-09-13T06:42:13.134 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.134 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.134 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:13.134 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862145+0000", 2024-09-13T06:42:13.135 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6169999999999996e-06 2024-09-13T06:42:13.135 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.135 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.135 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:13.135 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862153+0000", 2024-09-13T06:42:13.135 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.8359999999999992e-06 2024-09-13T06:42:13.135 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.135 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.135 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:13.135 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.964018+0000", 2024-09-13T06:42:13.135 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101865421 2024-09-13T06:42:13.135 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.135 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.135 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:13.135 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.964140+0000", 2024-09-13T06:42:13.136 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000121172 2024-09-13T06:42:13.136 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.136 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.136 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:13.136 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.964292+0000", 2024-09-13T06:42:13.136 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00015202600000000001 2024-09-13T06:42:13.136 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:13.136 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:13.136 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:13.136 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.136 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.136 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18768 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 5124096~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:42:13.136 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.866345+0000", 2024-09-13T06:42:13.136 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 141.219038654, 2024-09-13T06:42:13.136 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101779361, 2024-09-13T06:42:13.137 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:13.137 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:13.137 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:13.137 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:13.137 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:13.137 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18768 2024-09-13T06:42:13.137 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.137 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:13.137 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.137 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:13.137 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.866345+0000", 2024-09-13T06:42:13.137 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:13.138 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.138 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.138 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:13.138 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.866345+0000", 2024-09-13T06:42:13.138 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:13.138 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.138 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.138 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:13.138 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.866344+0000", 2024-09-13T06:42:13.138 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:13.138 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.138 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.138 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:13.138 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.866348+0000", 2024-09-13T06:42:13.139 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.4300000000000002e-06 2024-09-13T06:42:13.139 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.139 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.139 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:13.139 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.866356+0000", 2024-09-13T06:42:13.139 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.5930000000000006e-06 2024-09-13T06:42:13.139 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.139 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.139 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:13.139 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.866364+0000", 2024-09-13T06:42:13.139 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5599999999999996e-06 2024-09-13T06:42:13.139 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.139 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.139 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:13.140 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.967865+0000", 2024-09-13T06:42:13.140 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101501683 2024-09-13T06:42:13.140 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.140 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.140 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:13.140 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.967981+0000", 2024-09-13T06:42:13.140 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000115643 2024-09-13T06:42:13.140 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.140 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.140 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:13.140 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.968124+0000", 2024-09-13T06:42:13.140 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00014305500000000001 2024-09-13T06:42:13.140 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:13.140 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:13.141 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:13.141 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.141 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.141 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18779 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 5439488~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:42:13.141 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.869996+0000", 2024-09-13T06:42:13.141 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 141.21538776899999, 2024-09-13T06:42:13.141 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10189577399999999, 2024-09-13T06:42:13.141 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:13.141 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:13.141 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:13.142 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:13.142 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:13.142 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18779 2024-09-13T06:42:13.142 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.142 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:13.142 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.142 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:13.142 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.869996+0000", 2024-09-13T06:42:13.142 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:13.142 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.142 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.142 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:13.143 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.869996+0000", 2024-09-13T06:42:13.143 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:13.143 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.143 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.143 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:13.143 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.869995+0000", 2024-09-13T06:42:13.143 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:13.143 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.143 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.143 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:13.143 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.869998+0000", 2024-09-13T06:42:13.143 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.2729999999999998e-06 2024-09-13T06:42:13.143 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.143 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.144 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:13.144 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.870007+0000", 2024-09-13T06:42:13.144 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.5760000000000006e-06 2024-09-13T06:42:13.144 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.144 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.144 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:13.144 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.870014+0000", 2024-09-13T06:42:13.144 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.1400000000000002e-06 2024-09-13T06:42:13.144 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.144 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.144 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:13.144 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.971631+0000", 2024-09-13T06:42:13.144 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101617503 2024-09-13T06:42:13.145 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.145 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.145 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:13.145 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.971747+0000", 2024-09-13T06:42:13.145 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00011599600000000001 2024-09-13T06:42:13.145 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.145 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.145 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:13.145 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.971891+0000", 2024-09-13T06:42:13.145 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000143912 2024-09-13T06:42:13.145 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:13.145 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:13.145 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:13.145 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.146 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.146 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18792 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 5812224~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:42:13.146 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.874371+0000", 2024-09-13T06:42:13.146 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 141.21101263899999, 2024-09-13T06:42:13.146 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101736005, 2024-09-13T06:42:13.146 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:13.146 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:13.146 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:13.146 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:13.146 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:13.146 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18792 2024-09-13T06:42:13.147 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.147 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:13.147 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.147 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:13.147 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874371+0000", 2024-09-13T06:42:13.147 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:13.147 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.147 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.147 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:13.148 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874371+0000", 2024-09-13T06:42:13.148 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:13.148 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.148 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.148 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:13.148 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874370+0000", 2024-09-13T06:42:13.148 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:13.148 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.148 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.148 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:13.148 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874374+0000", 2024-09-13T06:42:13.148 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.7239999999999998e-06 2024-09-13T06:42:13.149 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.149 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.149 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:13.149 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874385+0000", 2024-09-13T06:42:13.149 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1293e-05 2024-09-13T06:42:13.149 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.149 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.149 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:13.149 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874394+0000", 2024-09-13T06:42:13.149 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.0729999999999994e-06 2024-09-13T06:42:13.150 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.150 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.150 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:13.150 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.975850+0000", 2024-09-13T06:42:13.150 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10145599700000001 2024-09-13T06:42:13.150 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.150 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.150 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:13.150 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.975963+0000", 2024-09-13T06:42:13.150 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000112689 2024-09-13T06:42:13.150 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.151 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.151 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:13.151 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.976107+0000", 2024-09-13T06:42:13.151 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000143836 2024-09-13T06:42:13.151 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:13.151 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:13.151 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:13.151 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.151 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.151 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18793 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 5840896~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:42:13.151 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.874401+0000", 2024-09-13T06:42:13.152 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 141.21098260599999, 2024-09-13T06:42:13.152 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.102005516, 2024-09-13T06:42:13.152 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:13.152 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:13.152 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:13.152 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:13.152 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:13.152 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18793 2024-09-13T06:42:13.152 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.152 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:13.153 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.153 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:13.153 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874401+0000", 2024-09-13T06:42:13.153 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:13.153 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.153 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.153 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:13.153 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874401+0000", 2024-09-13T06:42:13.154 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:13.154 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.154 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.154 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:13.154 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874400+0000", 2024-09-13T06:42:13.154 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:42:13.154 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.154 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.154 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:13.155 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874404+0000", 2024-09-13T06:42:13.155 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0069999999999999e-06 2024-09-13T06:42:13.155 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.155 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.155 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:13.155 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874412+0000", 2024-09-13T06:42:13.155 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.5399999999999996e-06 2024-09-13T06:42:13.155 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.155 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.155 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:13.156 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874420+0000", 2024-09-13T06:42:13.156 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.6199999999999999e-06 2024-09-13T06:42:13.156 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.156 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.156 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:13.156 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.976150+0000", 2024-09-13T06:42:13.156 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101729874 2024-09-13T06:42:13.156 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.156 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.157 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:13.157 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.976261+0000", 2024-09-13T06:42:13.157 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000110819 2024-09-13T06:42:13.157 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.157 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.157 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:13.157 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.976406+0000", 2024-09-13T06:42:13.157 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000145489 2024-09-13T06:42:13.157 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:13.157 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:13.158 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:13.158 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.158 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.158 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18803 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 6127616~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:42:13.158 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.877851+0000", 2024-09-13T06:42:13.158 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 141.20753211300001, 2024-09-13T06:42:13.158 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101951584, 2024-09-13T06:42:13.158 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:13.158 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:13.158 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:13.159 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:13.159 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:13.159 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18803 2024-09-13T06:42:13.159 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.159 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:13.159 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.159 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:13.159 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.877851+0000", 2024-09-13T06:42:13.159 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:13.159 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.159 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.159 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:13.159 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.877851+0000", 2024-09-13T06:42:13.160 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:13.160 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.160 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.160 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:13.160 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.877851+0000", 2024-09-13T06:42:13.160 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:13.160 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.160 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.160 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:13.160 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.877854+0000", 2024-09-13T06:42:13.160 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.7929999999999999e-06 2024-09-13T06:42:13.160 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.160 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.161 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:13.161 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.877864+0000", 2024-09-13T06:42:13.161 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.2029999999999998e-06 2024-09-13T06:42:13.161 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.161 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.161 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:13.161 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.877873+0000", 2024-09-13T06:42:13.161 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.0440000000000001e-06 2024-09-13T06:42:13.161 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.161 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.161 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:13.161 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.979544+0000", 2024-09-13T06:42:13.161 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101671198 2024-09-13T06:42:13.162 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.162 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.162 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:13.162 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.979658+0000", 2024-09-13T06:42:13.162 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000114456 2024-09-13T06:42:13.162 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.162 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.162 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:13.162 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.979803+0000", 2024-09-13T06:42:13.162 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000144506 2024-09-13T06:42:13.162 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:13.162 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:13.162 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:13.163 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.163 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.163 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18807 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 6242304~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:42:13.163 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.879235+0000", 2024-09-13T06:42:13.163 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 141.20614808299999, 2024-09-13T06:42:13.163 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101781258, 2024-09-13T06:42:13.163 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:13.163 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:13.163 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:13.163 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:13.163 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:13.163 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18807 2024-09-13T06:42:13.163 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.163 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:13.164 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.164 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:13.164 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879235+0000", 2024-09-13T06:42:13.164 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:13.164 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.164 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.164 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:13.164 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879235+0000", 2024-09-13T06:42:13.164 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:13.164 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.164 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.164 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:13.164 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879235+0000", 2024-09-13T06:42:13.164 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:13.165 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.165 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.165 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:13.165 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879239+0000", 2024-09-13T06:42:13.165 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.963e-06 2024-09-13T06:42:13.165 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.165 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.165 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:13.165 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879247+0000", 2024-09-13T06:42:13.165 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6470000000000004e-06 2024-09-13T06:42:13.165 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.165 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.165 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:13.166 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879255+0000", 2024-09-13T06:42:13.166 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5429999999999996e-06 2024-09-13T06:42:13.166 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.166 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.166 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:13.166 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.980756+0000", 2024-09-13T06:42:13.166 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10150165999999999 2024-09-13T06:42:13.166 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.166 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.166 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:13.166 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.980868+0000", 2024-09-13T06:42:13.166 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000111196 2024-09-13T06:42:13.166 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.166 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.167 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:13.167 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.981017+0000", 2024-09-13T06:42:13.167 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000148846 2024-09-13T06:42:13.167 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:13.167 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:13.167 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:13.167 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.167 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.167 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18808 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 6270976~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:42:13.167 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.879261+0000", 2024-09-13T06:42:13.167 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 141.20612194399999, 2024-09-13T06:42:13.167 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.102057547, 2024-09-13T06:42:13.167 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:13.167 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:13.168 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:13.168 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:13.168 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:13.168 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18808 2024-09-13T06:42:13.168 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.168 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:13.168 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.168 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:13.168 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879261+0000", 2024-09-13T06:42:13.168 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:13.168 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.168 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.168 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:13.168 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879261+0000", 2024-09-13T06:42:13.169 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:13.169 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.169 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.169 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:13.169 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879261+0000", 2024-09-13T06:42:13.169 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:13.169 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.169 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.169 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:13.169 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879264+0000", 2024-09-13T06:42:13.169 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.523e-06 2024-09-13T06:42:13.169 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.169 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.169 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:13.170 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879273+0000", 2024-09-13T06:42:13.170 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6070000000000008e-06 2024-09-13T06:42:13.170 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.170 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.170 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:13.170 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879280+0000", 2024-09-13T06:42:13.170 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.4699999999999996e-06 2024-09-13T06:42:13.170 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.170 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.170 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:13.170 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.981060+0000", 2024-09-13T06:42:13.170 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10177934800000001 2024-09-13T06:42:13.170 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.170 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.171 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:13.171 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.981174+0000", 2024-09-13T06:42:13.171 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000114456 2024-09-13T06:42:13.171 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.171 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.171 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:13.171 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.981319+0000", 2024-09-13T06:42:13.171 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00014473900000000001 2024-09-13T06:42:13.171 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:13.171 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:13.171 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:13.171 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.171 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.172 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18810 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 2662400~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:42:13.172 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.880386+0000", 2024-09-13T06:42:13.172 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 141.20499778199999, 2024-09-13T06:42:13.172 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101728022, 2024-09-13T06:42:13.172 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:13.172 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:13.172 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:13.172 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:13.172 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:13.172 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18810 2024-09-13T06:42:13.172 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.172 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:13.172 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.172 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:13.173 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880386+0000", 2024-09-13T06:42:13.173 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:13.173 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.173 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.173 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:13.173 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880386+0000", 2024-09-13T06:42:13.173 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:13.173 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.173 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.173 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:13.173 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880385+0000", 2024-09-13T06:42:13.173 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:42:13.174 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.174 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.174 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:13.174 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880389+0000", 2024-09-13T06:42:13.174 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.8539999999999999e-06 2024-09-13T06:42:13.174 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.174 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.174 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:13.174 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880398+0000", 2024-09-13T06:42:13.174 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.1689999999999998e-06 2024-09-13T06:42:13.174 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.174 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.174 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:13.174 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880405+0000", 2024-09-13T06:42:13.175 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5700000000000004e-06 2024-09-13T06:42:13.175 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.175 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.175 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:13.175 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.981833+0000", 2024-09-13T06:42:13.175 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10142791800000001 2024-09-13T06:42:13.175 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.175 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.175 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:13.175 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.981973+0000", 2024-09-13T06:42:13.175 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00014002900000000001 2024-09-13T06:42:13.175 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.175 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.175 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:13.176 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.982114+0000", 2024-09-13T06:42:13.176 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000140276 2024-09-13T06:42:13.176 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:13.176 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:13.176 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:13.176 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.176 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.176 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18811 3.9 3.140f5209 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:42:13.176 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.880449+0000", 2024-09-13T06:42:13.176 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 141.20493440600001, 2024-09-13T06:42:13.176 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101739355, 2024-09-13T06:42:13.176 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:13.176 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:42:13.177 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:13.177 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:13.177 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:13.177 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18811 2024-09-13T06:42:13.177 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.177 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:13.177 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.177 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:13.177 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880449+0000", 2024-09-13T06:42:13.177 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:13.178 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.178 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.178 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:13.178 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880449+0000", 2024-09-13T06:42:13.178 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:13.178 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.178 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.178 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:13.178 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880448+0000", 2024-09-13T06:42:13.178 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:42:13.179 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.179 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.179 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:13.179 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880452+0000", 2024-09-13T06:42:13.179 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0470000000000004e-06 2024-09-13T06:42:13.179 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.179 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.179 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:13.179 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880462+0000", 2024-09-13T06:42:13.179 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6530000000000006e-06 2024-09-13T06:42:13.179 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.179 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.180 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:13.180 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880472+0000", 2024-09-13T06:42:13.180 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0027000000000001e-05 2024-09-13T06:42:13.180 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.180 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.180 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:13.180 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.982172+0000", 2024-09-13T06:42:13.180 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10170043500000001 2024-09-13T06:42:13.180 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.180 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.181 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:13.181 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.982188+0000", 2024-09-13T06:42:13.181 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6172999999999999e-05 2024-09-13T06:42:13.181 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:13.181 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:13.181 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:13.181 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.181 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.181 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18812 3.9 3.140f5209 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:42:13.182 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.880478+0000", 2024-09-13T06:42:13.182 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 141.204905169, 2024-09-13T06:42:13.182 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10177795100000001, 2024-09-13T06:42:13.182 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:13.182 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:42:13.182 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:13.182 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:13.182 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:13.182 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18812 2024-09-13T06:42:13.183 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.183 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:13.183 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.183 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:13.183 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880478+0000", 2024-09-13T06:42:13.183 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:13.183 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.183 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.183 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:13.184 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880478+0000", 2024-09-13T06:42:13.184 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:13.184 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.184 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.184 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:13.184 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880477+0000", 2024-09-13T06:42:13.184 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:42:13.184 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.184 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.185 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:13.185 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880481+0000", 2024-09-13T06:42:13.185 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.827e-06 2024-09-13T06:42:13.185 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.185 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.185 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:13.185 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880490+0000", 2024-09-13T06:42:13.185 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6100000000000006e-06 2024-09-13T06:42:13.185 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.185 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.186 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:13.186 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880497+0000", 2024-09-13T06:42:13.186 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.7030000000000006e-06 2024-09-13T06:42:13.186 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.186 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.186 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:13.186 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.982241+0000", 2024-09-13T06:42:13.186 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10174351199999999 2024-09-13T06:42:13.186 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.186 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.187 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:13.187 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.982256+0000", 2024-09-13T06:42:13.187 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5143000000000001e-05 2024-09-13T06:42:13.187 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:13.187 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:13.187 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:13.187 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:13.187 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:13.187 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:42:13.189 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-13T06:42:13.190 INFO:tasks.ceph.osd.6.smithi139.stderr:2024-09-13T06:42:13.185+0000 7fcd02c5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26385) UID: 0 2024-09-13T06:42:13.290 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:42:13.285+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:42:13.370 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:42:13.370 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [], 2024-09-13T06:42:13.370 INFO:teuthology.orchestra.run.smithi139.stdout: "num_ops": 0 2024-09-13T06:42:13.370 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:42:13.385 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-13T06:42:13.391 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:42:13.389+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:42:13.417 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-13T06:42:13.491 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:42:13.489+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:42:13.510 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:42:13.510 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [], 2024-09-13T06:42:13.510 INFO:teuthology.orchestra.run.smithi139.stdout: "complaint_time": 30, 2024-09-13T06:42:13.510 INFO:teuthology.orchestra.run.smithi139.stdout: "num_blocked_ops": 0 2024-09-13T06:42:13.511 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:42:13.526 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-13T06:42:13.592 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:42:13.589+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:42:13.653 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:42:13.653 INFO:teuthology.orchestra.run.smithi139.stdout: "size": 20, 2024-09-13T06:42:13.653 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 600, 2024-09-13T06:42:13.653 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [ 2024-09-13T06:42:13.653 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.653 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43282 3.1d 3:bd80bfb3:::rbd_object_map.11212f44bfb1.0000000000000020:head [call rbd.object_map_update in=20b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:42:13.653 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589032+0000", 2024-09-13T06:42:13.653 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 112.063551949, 2024-09-13T06:42:13.654 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.076225263000000001, 2024-09-13T06:42:13.654 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:13.654 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:42:13.654 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:13.654 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:13.654 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:13.654 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43282 2024-09-13T06:42:13.654 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.654 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:13.654 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.654 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:13.654 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589032+0000", 2024-09-13T06:42:13.654 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:13.654 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.655 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.655 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:13.655 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589032+0000", 2024-09-13T06:42:13.655 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:13.655 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.655 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.655 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:13.655 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589031+0000", 2024-09-13T06:42:13.655 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:42:13.655 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.655 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.655 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:13.655 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589036+0000", 2024-09-13T06:42:13.656 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.2619999999999998e-06 2024-09-13T06:42:13.656 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.656 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.656 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:13.656 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589046+0000", 2024-09-13T06:42:13.656 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.8099999999999992e-06 2024-09-13T06:42:13.656 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.656 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.656 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:13.656 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589054+0000", 2024-09-13T06:42:13.656 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.2230000000000007e-06 2024-09-13T06:42:13.656 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.657 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.657 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:13.657 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.660691+0000", 2024-09-13T06:42:13.657 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.07163659 2024-09-13T06:42:13.657 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.657 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.657 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:13.657 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.660850+0000", 2024-09-13T06:42:13.657 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00015864300000000001 2024-09-13T06:42:13.657 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.657 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.657 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 4", 2024-09-13T06:42:13.657 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.661729+0000", 2024-09-13T06:42:13.658 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00087956099999999995 2024-09-13T06:42:13.658 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.658 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.658 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:42:13.658 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.664409+0000", 2024-09-13T06:42:13.658 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0026803479999999999 2024-09-13T06:42:13.658 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.658 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.658 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-13T06:42:13.658 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.665088+0000", 2024-09-13T06:42:13.658 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00067901400000000003 2024-09-13T06:42:13.658 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.658 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.659 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-13T06:42:13.659 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.665181+0000", 2024-09-13T06:42:13.659 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.2050000000000001e-05 2024-09-13T06:42:13.659 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.659 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.659 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:13.659 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.665257+0000", 2024-09-13T06:42:13.659 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.6698000000000003e-05 2024-09-13T06:42:13.659 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:13.659 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:13.659 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:13.659 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.659 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.660 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43290 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 299008~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:42:13.660 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589500+0000", 2024-09-13T06:42:13.660 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 112.063083787, 2024-09-13T06:42:13.660 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.075898564000000002, 2024-09-13T06:42:13.660 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:13.660 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:13.660 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:13.660 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:13.660 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:13.660 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43290 2024-09-13T06:42:13.660 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.660 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:13.660 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.661 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:13.661 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589500+0000", 2024-09-13T06:42:13.661 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:13.661 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.661 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.661 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:13.661 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589500+0000", 2024-09-13T06:42:13.661 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:13.661 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.661 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.661 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:13.661 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589499+0000", 2024-09-13T06:42:13.661 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:42:13.661 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.662 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.662 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:13.662 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589503+0000", 2024-09-13T06:42:13.662 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.8330000000000004e-06 2024-09-13T06:42:13.662 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.662 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.662 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:13.662 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589511+0000", 2024-09-13T06:42:13.662 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.3359999999999995e-06 2024-09-13T06:42:13.662 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.662 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.662 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:13.662 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589519+0000", 2024-09-13T06:42:13.662 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.4760000000000001e-06 2024-09-13T06:42:13.663 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.663 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.663 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:13.663 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.665097+0000", 2024-09-13T06:42:13.663 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.075577828999999999 2024-09-13T06:42:13.663 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.663 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.663 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:13.663 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.665170+0000", 2024-09-13T06:42:13.663 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.3745000000000006e-05 2024-09-13T06:42:13.663 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.663 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.663 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:13.664 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.665399+0000", 2024-09-13T06:42:13.664 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00022826199999999999 2024-09-13T06:42:13.664 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:13.664 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:13.664 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:13.664 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.664 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.664 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43291 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 313344~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:42:13.664 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589560+0000", 2024-09-13T06:42:13.664 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 112.063023566, 2024-09-13T06:42:13.664 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.076145594999999996, 2024-09-13T06:42:13.664 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:13.664 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:13.665 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:13.665 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:13.665 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:13.665 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43291 2024-09-13T06:42:13.665 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.665 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:13.665 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.665 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:13.665 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589560+0000", 2024-09-13T06:42:13.665 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:13.665 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.665 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.665 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:13.666 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589560+0000", 2024-09-13T06:42:13.666 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:13.666 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.666 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.666 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:13.666 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589559+0000", 2024-09-13T06:42:13.666 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:42:13.666 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.666 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.666 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:13.666 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589564+0000", 2024-09-13T06:42:13.666 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.3989999999999997e-06 2024-09-13T06:42:13.666 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.667 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.667 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:13.667 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589574+0000", 2024-09-13T06:42:13.667 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0502999999999999e-05 2024-09-13T06:42:13.667 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.667 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.667 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:13.667 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589582+0000", 2024-09-13T06:42:13.667 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.1859999999999992e-06 2024-09-13T06:42:13.667 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.667 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.667 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:13.667 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.665423+0000", 2024-09-13T06:42:13.668 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.075840290000000005 2024-09-13T06:42:13.668 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.668 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.668 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:13.668 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.665496+0000", 2024-09-13T06:42:13.668 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.2791000000000002e-05 2024-09-13T06:42:13.668 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.668 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.668 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:13.668 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.665706+0000", 2024-09-13T06:42:13.668 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00021038200000000001 2024-09-13T06:42:13.668 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:13.668 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:13.668 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:13.669 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.669 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.669 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43292 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 327680~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:42:13.669 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589589+0000", 2024-09-13T06:42:13.669 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 112.06299502500001, 2024-09-13T06:42:13.669 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.076769537999999998, 2024-09-13T06:42:13.669 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:13.669 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:13.669 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:13.669 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:13.669 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:13.669 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43292 2024-09-13T06:42:13.669 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.669 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:13.670 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.670 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:13.670 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589589+0000", 2024-09-13T06:42:13.670 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:13.670 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.670 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.670 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:13.670 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589589+0000", 2024-09-13T06:42:13.670 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:13.670 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.670 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.670 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:13.670 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589588+0000", 2024-09-13T06:42:13.671 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:13.671 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.671 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.671 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:13.671 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589592+0000", 2024-09-13T06:42:13.671 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.6389999999999998e-06 2024-09-13T06:42:13.671 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.671 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.671 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:13.671 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589600+0000", 2024-09-13T06:42:13.671 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.4630000000000001e-06 2024-09-13T06:42:13.671 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.671 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.672 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:13.672 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589608+0000", 2024-09-13T06:42:13.672 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.2359999999999998e-06 2024-09-13T06:42:13.672 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.672 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.672 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:13.672 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.665779+0000", 2024-09-13T06:42:13.672 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.076170924000000001 2024-09-13T06:42:13.672 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.672 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.672 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:13.672 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.665977+0000", 2024-09-13T06:42:13.672 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00019891900000000001 2024-09-13T06:42:13.673 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.673 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.673 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:13.673 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.666358+0000", 2024-09-13T06:42:13.673 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000380963 2024-09-13T06:42:13.673 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:13.673 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:13.673 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:13.673 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.673 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.673 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43293 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 342016~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:42:13.673 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589616+0000", 2024-09-13T06:42:13.674 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 112.06296813100001, 2024-09-13T06:42:13.674 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.077030083999999999, 2024-09-13T06:42:13.674 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:13.674 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:13.674 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:13.674 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:13.674 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:13.674 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43293 2024-09-13T06:42:13.674 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.674 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:13.674 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.674 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:13.674 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589616+0000", 2024-09-13T06:42:13.674 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:13.675 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.675 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.675 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:13.675 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589616+0000", 2024-09-13T06:42:13.675 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:13.675 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.675 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.675 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:13.675 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589615+0000", 2024-09-13T06:42:13.675 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:42:13.675 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.675 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.675 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:13.676 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589619+0000", 2024-09-13T06:42:13.676 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.9559999999999999e-06 2024-09-13T06:42:13.676 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.676 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.676 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:13.676 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589627+0000", 2024-09-13T06:42:13.676 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.2490000000000001e-06 2024-09-13T06:42:13.676 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.676 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.676 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:13.676 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589635+0000", 2024-09-13T06:42:13.676 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.96e-06 2024-09-13T06:42:13.677 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.677 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.677 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:13.677 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.666379+0000", 2024-09-13T06:42:13.677 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.076744484000000002 2024-09-13T06:42:13.677 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.677 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.677 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:13.677 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.666454+0000", 2024-09-13T06:42:13.677 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.4623999999999996e-05 2024-09-13T06:42:13.677 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.677 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.677 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:13.678 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.666646+0000", 2024-09-13T06:42:13.678 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00019176999999999999 2024-09-13T06:42:13.678 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:13.678 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:13.678 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:13.678 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.678 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.678 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43294 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 356352~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:42:13.678 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589681+0000", 2024-09-13T06:42:13.678 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 112.062902816, 2024-09-13T06:42:13.678 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.077594648000000002, 2024-09-13T06:42:13.678 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:13.678 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:13.679 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:13.679 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:13.679 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:13.679 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43294 2024-09-13T06:42:13.679 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.679 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:13.679 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.679 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:13.679 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589681+0000", 2024-09-13T06:42:13.679 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:13.679 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.679 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.679 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:13.680 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589681+0000", 2024-09-13T06:42:13.680 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:13.680 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.680 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.680 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:13.680 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589680+0000", 2024-09-13T06:42:13.680 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:42:13.680 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.680 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.680 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:13.680 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589684+0000", 2024-09-13T06:42:13.680 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.8369999999999999e-06 2024-09-13T06:42:13.680 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.681 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.681 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:13.681 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589693+0000", 2024-09-13T06:42:13.681 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.1020000000000003e-06 2024-09-13T06:42:13.681 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.681 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.681 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:13.681 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589701+0000", 2024-09-13T06:42:13.681 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.8059999999999995e-06 2024-09-13T06:42:13.681 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.681 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.681 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:13.681 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.666714+0000", 2024-09-13T06:42:13.682 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.077013463000000004 2024-09-13T06:42:13.682 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.682 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.682 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:13.682 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.666897+0000", 2024-09-13T06:42:13.682 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000182268 2024-09-13T06:42:13.682 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.682 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.682 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:13.682 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.667276+0000", 2024-09-13T06:42:13.682 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00037907499999999998 2024-09-13T06:42:13.682 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:13.683 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:13.683 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:13.683 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.683 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.683 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43295 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 370688~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:42:13.683 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589744+0000", 2024-09-13T06:42:13.683 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 112.06283964399999, 2024-09-13T06:42:13.683 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.077854343000000006, 2024-09-13T06:42:13.683 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:13.683 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:13.683 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:13.683 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:13.683 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:13.684 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43295 2024-09-13T06:42:13.684 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.684 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:13.684 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.684 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:13.684 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589744+0000", 2024-09-13T06:42:13.684 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:13.684 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.684 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.684 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:13.684 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589744+0000", 2024-09-13T06:42:13.684 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:13.684 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.685 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.685 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:13.685 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589743+0000", 2024-09-13T06:42:13.685 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:42:13.685 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.685 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.685 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:13.685 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589747+0000", 2024-09-13T06:42:13.685 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0130000000000004e-06 2024-09-13T06:42:13.685 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.686 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.686 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:13.686 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589756+0000", 2024-09-13T06:42:13.686 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.003e-06 2024-09-13T06:42:13.686 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.686 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.686 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:13.686 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589766+0000", 2024-09-13T06:42:13.688 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.2820000000000002e-06 2024-09-13T06:42:13.688 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.688 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.688 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:13.688 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.667300+0000", 2024-09-13T06:42:13.688 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.077534299000000001 2024-09-13T06:42:13.688 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.688 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.689 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:13.689 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.667372+0000", 2024-09-13T06:42:13.689 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.2393999999999998e-05 2024-09-13T06:42:13.689 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.689 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.689 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:13.689 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.667599+0000", 2024-09-13T06:42:13.689 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000226269 2024-09-13T06:42:13.689 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:13.689 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:13.689 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:13.689 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.689 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.690 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43296 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 385024~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:42:13.690 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589772+0000", 2024-09-13T06:42:13.690 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 112.06281162000001, 2024-09-13T06:42:13.690 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.078469647000000003, 2024-09-13T06:42:13.690 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:13.690 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:13.690 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:13.690 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:13.690 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:13.690 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43296 2024-09-13T06:42:13.690 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.690 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:13.690 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.691 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:13.691 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589772+0000", 2024-09-13T06:42:13.691 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:13.691 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.691 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.691 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:13.691 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589772+0000", 2024-09-13T06:42:13.691 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:13.691 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.691 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.691 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:13.691 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589771+0000", 2024-09-13T06:42:13.691 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:42:13.692 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.692 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.692 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:13.692 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589775+0000", 2024-09-13T06:42:13.692 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.8530000000000002e-06 2024-09-13T06:42:13.692 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.692 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.692 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:13.692 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589784+0000", 2024-09-13T06:42:13.692 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.4300000000000006e-06 2024-09-13T06:42:13.692 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.692 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.693 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:13.693 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589791+0000", 2024-09-13T06:42:13.693 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.4660000000000002e-06 2024-09-13T06:42:13.693 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.693 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.693 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:13.693 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.667667+0000", 2024-09-13T06:42:13.693 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.077875697999999993 2024-09-13T06:42:13.693 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.693 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.693 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:13.693 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.667854+0000", 2024-09-13T06:42:13.693 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00018760099999999999 2024-09-13T06:42:13.694 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.694 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.694 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:13.694 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.668242+0000", 2024-09-13T06:42:13.694 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00038750600000000003 2024-09-13T06:42:13.694 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:13.694 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:13.694 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:13.694 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.694 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.694 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43297 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 403456~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:42:13.694 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589797+0000", 2024-09-13T06:42:13.694 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 112.06278691599999, 2024-09-13T06:42:13.694 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.078756672999999999, 2024-09-13T06:42:13.695 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:13.695 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:13.695 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:13.695 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:13.695 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:13.695 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43297 2024-09-13T06:42:13.695 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.695 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:13.695 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.695 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:13.695 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589797+0000", 2024-09-13T06:42:13.695 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:13.695 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.696 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.696 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:13.696 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589797+0000", 2024-09-13T06:42:13.696 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:13.696 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.696 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.696 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:13.696 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589796+0000", 2024-09-13T06:42:13.696 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:13.696 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.696 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.696 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:13.697 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589800+0000", 2024-09-13T06:42:13.697 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.3230000000000002e-06 2024-09-13T06:42:13.697 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.697 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.697 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:13.697 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589808+0000", 2024-09-13T06:42:13.697 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.2390000000000002e-06 2024-09-13T06:42:13.697 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.697 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.697 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:13.697 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589815+0000", 2024-09-13T06:42:13.697 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.413e-06 2024-09-13T06:42:13.697 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.698 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.698 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:13.698 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.668265+0000", 2024-09-13T06:42:13.698 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.078449873000000003 2024-09-13T06:42:13.698 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.698 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.698 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:13.698 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.668332+0000", 2024-09-13T06:42:13.698 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.7178e-05 2024-09-13T06:42:13.698 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.698 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.698 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:13.698 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.668554+0000", 2024-09-13T06:42:13.698 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00022128600000000001 2024-09-13T06:42:13.699 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:13.699 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:13.699 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:13.699 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.699 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.699 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43298 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 417792~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:42:13.699 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589821+0000", 2024-09-13T06:42:13.699 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 112.06276279399999, 2024-09-13T06:42:13.699 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.079368660999999993, 2024-09-13T06:42:13.699 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:13.699 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:13.699 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:13.699 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:13.700 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:13.700 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43298 2024-09-13T06:42:13.700 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.700 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:13.700 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.700 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:13.700 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589821+0000", 2024-09-13T06:42:13.700 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:13.700 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.700 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.700 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:13.700 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589821+0000", 2024-09-13T06:42:13.700 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:13.700 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.701 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.701 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:13.701 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589821+0000", 2024-09-13T06:42:13.701 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:13.701 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.701 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.701 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:13.701 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589830+0000", 2024-09-13T06:42:13.701 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.4860000000000003e-06 2024-09-13T06:42:13.701 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.701 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.701 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:13.701 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589839+0000", 2024-09-13T06:42:13.701 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.0159999999999997e-06 2024-09-13T06:42:13.702 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.702 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.702 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:13.702 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589847+0000", 2024-09-13T06:42:13.702 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.6059999999999997e-06 2024-09-13T06:42:13.702 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.702 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.702 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:13.702 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.668620+0000", 2024-09-13T06:42:13.702 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.078773485000000004 2024-09-13T06:42:13.702 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.702 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.702 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:13.703 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.668798+0000", 2024-09-13T06:42:13.703 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000178233 2024-09-13T06:42:13.703 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.703 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.703 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:13.703 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.669190+0000", 2024-09-13T06:42:13.703 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00039143499999999998 2024-09-13T06:42:13.703 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:13.703 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:13.703 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:13.703 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.703 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.703 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43299 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 432128~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:42:13.704 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589881+0000", 2024-09-13T06:42:13.704 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 112.062702946, 2024-09-13T06:42:13.704 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.079693849999999997, 2024-09-13T06:42:13.704 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:13.704 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:13.704 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:13.704 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:13.704 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:13.704 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43299 2024-09-13T06:42:13.704 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.704 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:13.704 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.704 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:13.705 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589881+0000", 2024-09-13T06:42:13.705 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:13.705 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.705 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.705 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:13.705 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589881+0000", 2024-09-13T06:42:13.705 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:13.705 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.705 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.705 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:13.705 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589880+0000", 2024-09-13T06:42:13.705 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:42:13.705 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.706 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.706 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:13.706 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589884+0000", 2024-09-13T06:42:13.706 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.053e-06 2024-09-13T06:42:13.706 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.706 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.706 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:13.706 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589893+0000", 2024-09-13T06:42:13.706 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.2129999999999997e-06 2024-09-13T06:42:13.706 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.706 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.706 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:13.706 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589901+0000", 2024-09-13T06:42:13.707 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.6399999999999997e-06 2024-09-13T06:42:13.707 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.707 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.707 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:13.707 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.669213+0000", 2024-09-13T06:42:13.707 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.079312074999999996 2024-09-13T06:42:13.707 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.707 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.707 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:13.707 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.669281+0000", 2024-09-13T06:42:13.708 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.8322000000000001e-05 2024-09-13T06:42:13.708 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.708 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.708 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:13.708 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.669575+0000", 2024-09-13T06:42:13.708 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00029349699999999999 2024-09-13T06:42:13.708 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:13.708 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:13.708 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:13.708 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.708 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.708 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43300 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 446464~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:42:13.709 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589909+0000", 2024-09-13T06:42:13.709 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 112.062675051, 2024-09-13T06:42:13.709 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.080339496999999996, 2024-09-13T06:42:13.709 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:13.709 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:13.709 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:13.709 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:13.709 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:13.709 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43300 2024-09-13T06:42:13.709 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.709 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:13.709 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.709 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:13.710 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589909+0000", 2024-09-13T06:42:13.710 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:13.710 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.710 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.710 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:13.710 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589909+0000", 2024-09-13T06:42:13.710 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:13.710 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.710 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.710 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:13.710 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589908+0000", 2024-09-13T06:42:13.710 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:42:13.711 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.711 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.711 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:13.711 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589912+0000", 2024-09-13T06:42:13.711 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.9430000000000002e-06 2024-09-13T06:42:13.711 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.711 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.711 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:13.711 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589920+0000", 2024-09-13T06:42:13.711 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.3860000000000007e-06 2024-09-13T06:42:13.711 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.711 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.711 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:13.711 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589928+0000", 2024-09-13T06:42:13.712 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.3329999999999999e-06 2024-09-13T06:42:13.712 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.712 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.712 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:13.712 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.669651+0000", 2024-09-13T06:42:13.712 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.079723204000000006 2024-09-13T06:42:13.712 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.712 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.712 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:13.712 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.669840+0000", 2024-09-13T06:42:13.712 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000189397 2024-09-13T06:42:13.712 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.713 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.713 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:13.713 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.670248+0000", 2024-09-13T06:42:13.713 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00040811100000000001 2024-09-13T06:42:13.713 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:13.713 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:13.713 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:13.713 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.713 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.713 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43301 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 460800~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:42:13.713 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589934+0000", 2024-09-13T06:42:13.713 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 112.062650377, 2024-09-13T06:42:13.713 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.080747474999999999, 2024-09-13T06:42:13.714 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:13.714 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:13.714 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:13.714 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:13.714 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:13.714 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43301 2024-09-13T06:42:13.714 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.714 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:13.714 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.714 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:13.714 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589934+0000", 2024-09-13T06:42:13.714 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:13.715 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.715 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.715 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:13.715 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589934+0000", 2024-09-13T06:42:13.715 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:13.715 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.715 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.715 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:13.715 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589933+0000", 2024-09-13T06:42:13.715 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:13.716 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.716 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.716 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:13.716 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589936+0000", 2024-09-13T06:42:13.716 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.4599999999999999e-06 2024-09-13T06:42:13.716 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.716 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.716 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:13.716 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589945+0000", 2024-09-13T06:42:13.716 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.2430000000000005e-06 2024-09-13T06:42:13.716 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.717 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.717 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:13.717 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589952+0000", 2024-09-13T06:42:13.717 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.3289999999999996e-06 2024-09-13T06:42:13.717 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.717 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.717 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:13.717 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.670280+0000", 2024-09-13T06:42:13.717 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.080328514000000004 2024-09-13T06:42:13.717 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.717 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.717 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:13.717 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.670376+0000", 2024-09-13T06:42:13.718 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.5752000000000001e-05 2024-09-13T06:42:13.718 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.718 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.718 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:13.718 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.670681+0000", 2024-09-13T06:42:13.718 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00030479699999999999 2024-09-13T06:42:13.718 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:13.718 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:13.718 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:13.718 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.718 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.718 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43302 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 475136~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:42:13.718 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589958+0000", 2024-09-13T06:42:13.719 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 112.062626315, 2024-09-13T06:42:13.719 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.081402394000000003, 2024-09-13T06:42:13.719 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:13.719 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:13.719 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:13.719 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:13.719 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:13.719 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43302 2024-09-13T06:42:13.719 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.719 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:13.719 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.719 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:13.719 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589958+0000", 2024-09-13T06:42:13.719 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:13.720 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.720 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.720 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:13.720 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589958+0000", 2024-09-13T06:42:13.720 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:13.720 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.720 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.720 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:13.720 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589957+0000", 2024-09-13T06:42:13.720 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:13.720 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.720 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.721 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:13.721 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589960+0000", 2024-09-13T06:42:13.721 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.4939999999999999e-06 2024-09-13T06:42:13.721 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.721 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.721 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:13.721 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589969+0000", 2024-09-13T06:42:13.721 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.3520000000000007e-06 2024-09-13T06:42:13.721 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.721 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.721 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:13.721 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589976+0000", 2024-09-13T06:42:13.722 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.3030000000000002e-06 2024-09-13T06:42:13.722 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.722 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.722 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:13.722 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.670765+0000", 2024-09-13T06:42:13.722 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.080789154000000002 2024-09-13T06:42:13.722 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.722 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.722 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:13.722 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.670960+0000", 2024-09-13T06:42:13.722 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00019464300000000001 2024-09-13T06:42:13.722 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.722 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.722 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:13.723 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.671360+0000", 2024-09-13T06:42:13.723 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00040005200000000002 2024-09-13T06:42:13.723 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:13.723 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:13.723 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:13.723 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.723 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.723 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43303 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 489472~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:42:13.723 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589985+0000", 2024-09-13T06:42:13.723 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 112.062599367, 2024-09-13T06:42:13.723 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.082024333000000005, 2024-09-13T06:42:13.723 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:13.723 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:13.723 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:13.724 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:13.724 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:13.724 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43303 2024-09-13T06:42:13.724 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.724 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:13.724 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.724 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:13.724 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589985+0000", 2024-09-13T06:42:13.724 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:13.724 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.724 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.724 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:13.724 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589985+0000", 2024-09-13T06:42:13.725 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:13.725 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.725 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.725 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:13.725 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589984+0000", 2024-09-13T06:42:13.725 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:42:13.725 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.725 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.725 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:13.725 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589987+0000", 2024-09-13T06:42:13.725 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.726e-06 2024-09-13T06:42:13.725 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.725 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.725 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:13.726 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589996+0000", 2024-09-13T06:42:13.726 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.5459999999999992e-06 2024-09-13T06:42:13.726 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.726 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.726 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:13.726 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590003+0000", 2024-09-13T06:42:13.726 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.4229999999999999e-06 2024-09-13T06:42:13.726 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.726 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.726 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:13.726 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.671426+0000", 2024-09-13T06:42:13.726 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.081422704999999998 2024-09-13T06:42:13.726 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.726 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.727 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:13.727 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.671615+0000", 2024-09-13T06:42:13.727 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000188875 2024-09-13T06:42:13.727 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.727 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.727 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:13.727 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.672009+0000", 2024-09-13T06:42:13.727 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000394015 2024-09-13T06:42:13.727 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:13.727 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:13.727 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:13.727 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.727 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.727 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43304 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 503808~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:42:13.728 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.590039+0000", 2024-09-13T06:42:13.728 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 112.06254482200001, 2024-09-13T06:42:13.728 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.082573880000000002, 2024-09-13T06:42:13.728 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:13.728 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:13.728 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:13.728 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:13.728 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:13.728 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43304 2024-09-13T06:42:13.728 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.728 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:13.728 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.729 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:13.729 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590039+0000", 2024-09-13T06:42:13.729 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:13.729 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.729 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.729 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:13.729 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590039+0000", 2024-09-13T06:42:13.729 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:13.729 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.729 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.729 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:13.729 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590038+0000", 2024-09-13T06:42:13.729 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:42:13.729 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.730 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.730 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:13.730 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590042+0000", 2024-09-13T06:42:13.730 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.9500000000000003e-06 2024-09-13T06:42:13.730 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.730 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.730 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:13.730 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590052+0000", 2024-09-13T06:42:13.730 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.3919999999999992e-06 2024-09-13T06:42:13.730 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.730 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.730 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:13.730 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590059+0000", 2024-09-13T06:42:13.731 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.7970000000000001e-06 2024-09-13T06:42:13.731 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.731 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.731 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:13.731 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.672078+0000", 2024-09-13T06:42:13.731 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.082018778000000001 2024-09-13T06:42:13.731 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.731 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.731 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:13.731 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.672266+0000", 2024-09-13T06:42:13.731 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00018807399999999999 2024-09-13T06:42:13.731 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.731 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.731 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:13.732 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.672613+0000", 2024-09-13T06:42:13.732 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00034677599999999997 2024-09-13T06:42:13.732 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:13.732 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:13.732 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:13.732 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.732 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.732 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43305 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 518144~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:42:13.732 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.590136+0000", 2024-09-13T06:42:13.732 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 112.06244763399999, 2024-09-13T06:42:13.732 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.082988206999999994, 2024-09-13T06:42:13.732 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:13.732 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:13.733 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:13.733 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:13.733 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:13.733 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43305 2024-09-13T06:42:13.733 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.733 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:13.733 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.733 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:13.733 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590136+0000", 2024-09-13T06:42:13.733 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:13.733 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.733 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.734 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:13.734 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590136+0000", 2024-09-13T06:42:13.734 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:13.734 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.734 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.734 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:13.734 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590135+0000", 2024-09-13T06:42:13.734 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:42:13.734 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.734 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.734 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:13.734 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590139+0000", 2024-09-13T06:42:13.734 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.9489999999999998e-06 2024-09-13T06:42:13.735 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.735 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.735 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:13.735 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590148+0000", 2024-09-13T06:42:13.735 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.9830000000000002e-06 2024-09-13T06:42:13.735 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.735 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.735 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:13.735 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590156+0000", 2024-09-13T06:42:13.735 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5229999999999998e-06 2024-09-13T06:42:13.735 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.735 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.736 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:13.736 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.672709+0000", 2024-09-13T06:42:13.736 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.082552886000000006 2024-09-13T06:42:13.736 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.736 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.736 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:13.736 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.672816+0000", 2024-09-13T06:42:13.736 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000107736 2024-09-13T06:42:13.736 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.736 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.737 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:13.737 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.673124+0000", 2024-09-13T06:42:13.737 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00030804900000000002 2024-09-13T06:42:13.737 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:13.737 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:13.737 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:13.737 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.737 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.737 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:66818 3.17 3.50afe697 (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e100)", 2024-09-13T06:42:13.737 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:53.498942+0000", 2024-09-13T06:42:13.737 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 80.153641449000006, 2024-09-13T06:42:13.737 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.011231284, 2024-09-13T06:42:13.738 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:13.738 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:42:13.738 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:13.738 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:13.738 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:13.738 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 66818 2024-09-13T06:42:13.738 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.738 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:13.738 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.738 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:13.738 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:53.498942+0000", 2024-09-13T06:42:13.738 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:13.738 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.738 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.738 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:13.739 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:53.498942+0000", 2024-09-13T06:42:13.739 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:13.739 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.739 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.739 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:13.739 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:53.498939+0000", 2024-09-13T06:42:13.739 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999967 2024-09-13T06:42:13.739 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.739 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.739 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:13.739 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:53.498954+0000", 2024-09-13T06:42:13.739 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5028000000000001e-05 2024-09-13T06:42:13.739 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.740 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.740 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:13.740 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:53.498986+0000", 2024-09-13T06:42:13.740 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.1993999999999999e-05 2024-09-13T06:42:13.740 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.740 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.740 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:13.740 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:53.499001+0000", 2024-09-13T06:42:13.740 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5166e-05 2024-09-13T06:42:13.740 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.740 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.740 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:13.740 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:53.505097+0000", 2024-09-13T06:42:13.740 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0060955610000000002 2024-09-13T06:42:13.741 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.741 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.741 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:42:13.741 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:53.505108+0000", 2024-09-13T06:42:13.741 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.084e-05 2024-09-13T06:42:13.741 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.741 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.741 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:13.741 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:54.510158+0000", 2024-09-13T06:42:13.741 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0050497549999999 2024-09-13T06:42:13.741 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.741 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.741 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:13.741 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:54.510174+0000", 2024-09-13T06:42:13.742 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6164e-05 2024-09-13T06:42:13.742 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:13.742 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:13.742 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:13.742 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.742 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.742 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:69764 3.2 3:47f10058:::rbd_data.11214956a993.0000000000000004:head [write-same] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e117)", 2024-09-13T06:42:13.742 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:41:11.371147+0000", 2024-09-13T06:42:13.742 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 62.281437138999998, 2024-09-13T06:42:13.742 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.03470167, 2024-09-13T06:42:13.742 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:13.742 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:42:13.742 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:13.743 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:13.743 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:13.743 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 69764 2024-09-13T06:42:13.743 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.743 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:13.743 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.743 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:13.743 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:11.371147+0000", 2024-09-13T06:42:13.743 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:13.743 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.743 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.743 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:13.743 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:11.371147+0000", 2024-09-13T06:42:13.744 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:13.744 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.744 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.744 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:13.744 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:11.371144+0000", 2024-09-13T06:42:13.744 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999967 2024-09-13T06:42:13.744 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.744 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.744 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:13.744 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:11.371161+0000", 2024-09-13T06:42:13.744 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7669e-05 2024-09-13T06:42:13.744 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.744 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.745 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:13.745 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:11.371198+0000", 2024-09-13T06:42:13.745 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.7014000000000002e-05 2024-09-13T06:42:13.745 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.745 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.745 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:13.745 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:11.371216+0000", 2024-09-13T06:42:13.745 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7425e-05 2024-09-13T06:42:13.745 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.745 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.745 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:13.745 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:11.371365+0000", 2024-09-13T06:42:13.745 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000149245 2024-09-13T06:42:13.746 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.746 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.746 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op must wait for map", 2024-09-13T06:42:13.746 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:11.371385+0000", 2024-09-13T06:42:13.746 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.0018999999999999e-05 2024-09-13T06:42:13.746 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.746 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.746 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:13.746 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:11.378406+0000", 2024-09-13T06:42:13.746 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0070207179999999996 2024-09-13T06:42:13.746 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.746 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.746 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:42:13.747 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:11.378429+0000", 2024-09-13T06:42:13.747 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.3453999999999999e-05 2024-09-13T06:42:13.747 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.747 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.747 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:13.747 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:12.405667+0000", 2024-09-13T06:42:13.747 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0272381690000001 2024-09-13T06:42:13.747 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.747 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.747 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:13.747 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:12.405848+0000", 2024-09-13T06:42:13.747 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00018112 2024-09-13T06:42:13.747 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:13.747 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:13.748 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:13.748 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.748 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.748 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:70346 3.16 3:69d35907:::rbd_object_map.11214956a993:head [read 0~36] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e122)", 2024-09-13T06:42:13.748 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:41:16.390917+0000", 2024-09-13T06:42:13.748 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 57.261667086999999, 2024-09-13T06:42:13.748 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.99327479799999996, 2024-09-13T06:42:13.748 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:13.748 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:13.748 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:13.748 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:13.748 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:13.748 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 70346 2024-09-13T06:42:13.749 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.749 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:13.749 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.749 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:13.749 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:16.390917+0000", 2024-09-13T06:42:13.749 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:13.749 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.749 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.749 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:13.749 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:16.390917+0000", 2024-09-13T06:42:13.749 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:13.749 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.749 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.750 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:13.750 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:16.390916+0000", 2024-09-13T06:42:13.750 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999986 2024-09-13T06:42:13.750 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.750 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.750 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:13.750 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:16.390922+0000", 2024-09-13T06:42:13.750 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.0480000000000004e-06 2024-09-13T06:42:13.750 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.750 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.750 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:13.750 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:16.390933+0000", 2024-09-13T06:42:13.750 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1387e-05 2024-09-13T06:42:13.751 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.751 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.751 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:13.751 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:16.390939+0000", 2024-09-13T06:42:13.751 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.8039999999999998e-06 2024-09-13T06:42:13.751 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.751 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.751 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:13.751 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:16.390983+0000", 2024-09-13T06:42:13.751 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.4663000000000003e-05 2024-09-13T06:42:13.751 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.751 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.751 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:42:13.751 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:16.390991+0000", 2024-09-13T06:42:13.752 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.8059999999999995e-06 2024-09-13T06:42:13.752 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.752 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.752 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:13.752 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:17.383624+0000", 2024-09-13T06:42:13.752 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.99263277299999997 2024-09-13T06:42:13.752 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.752 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.752 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:13.752 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:17.383891+0000", 2024-09-13T06:42:13.752 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00026717599999999999 2024-09-13T06:42:13.752 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:13.752 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:13.753 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:13.753 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:17.384192+0000", 2024-09-13T06:42:13.753 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00030047400000000001 2024-09-13T06:42:13.753 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:13.753 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:13.753 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:13.753 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:13.753 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:13.753 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:42:13.755 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-13T06:42:13.755 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:42:13.753+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:42:13.856 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:42:13.853+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:42:13.934 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:42:13.934 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [], 2024-09-13T06:42:13.934 INFO:teuthology.orchestra.run.smithi139.stdout: "num_ops": 0 2024-09-13T06:42:13.934 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:42:13.948 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-13T06:42:13.992 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:42:13.989+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:42:14.053 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-13T06:42:14.069 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:42:14.069 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [], 2024-09-13T06:42:14.069 INFO:teuthology.orchestra.run.smithi139.stdout: "complaint_time": 30, 2024-09-13T06:42:14.070 INFO:teuthology.orchestra.run.smithi139.stdout: "num_blocked_ops": 0 2024-09-13T06:42:14.070 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:42:14.085 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-13T06:42:14.098 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:42:14.097+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:42:14.173 INFO:tasks.ceph.osd.6.smithi139.stderr:2024-09-13T06:42:14.169+0000 7fcd02c5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26385) UID: 0 2024-09-13T06:42:14.209 INFO:teuthology.orchestra.run.smithi081.stdout:osd.0: {} 2024-09-13T06:42:14.210 INFO:teuthology.orchestra.run.smithi081.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-13T06:42:14.225 INFO:teuthology.orchestra.run.smithi081.stdout:osd.1: {} 2024-09-13T06:42:14.226 INFO:teuthology.orchestra.run.smithi081.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-13T06:42:14.242 INFO:teuthology.orchestra.run.smithi081.stdout:osd.2: {} 2024-09-13T06:42:14.242 INFO:teuthology.orchestra.run.smithi081.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-13T06:42:14.254 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:42:14.254 INFO:teuthology.orchestra.run.smithi139.stdout: "size": 20, 2024-09-13T06:42:14.254 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 600, 2024-09-13T06:42:14.255 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [ 2024-09-13T06:42:14.255 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:14.255 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27854 3.a 3:537b3559:::rbd_data.1121f2c5ee81.0000000000000016:13 [read 335872~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:42:14.255 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.658750+0000", 2024-09-13T06:42:14.255 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 137.59350298699999, 2024-09-13T06:42:14.255 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.037969532, 2024-09-13T06:42:14.255 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:14.255 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:14.255 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:14.255 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:14.255 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:14.255 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27854 2024-09-13T06:42:14.255 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:14.256 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:14.256 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:14.256 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:14.256 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658750+0000", 2024-09-13T06:42:14.256 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:14.256 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:14.256 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:14.256 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:14.256 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658750+0000", 2024-09-13T06:42:14.256 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:14.256 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:14.256 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:14.256 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:14.257 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658749+0000", 2024-09-13T06:42:14.257 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:14.257 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:14.257 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:14.257 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:14.257 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658757+0000", 2024-09-13T06:42:14.257 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.7389999999999999e-06 2024-09-13T06:42:14.257 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:14.257 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:14.257 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:14.257 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658763+0000", 2024-09-13T06:42:14.257 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.7769999999999999e-06 2024-09-13T06:42:14.257 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:14.258 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:14.258 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:14.258 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658767+0000", 2024-09-13T06:42:14.258 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.1749999999999998e-06 2024-09-13T06:42:14.258 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:14.258 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:14.258 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:14.258 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.696322+0000", 2024-09-13T06:42:14.258 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.037554772 2024-09-13T06:42:14.258 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:14.258 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:14.258 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:14.258 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.696418+0000", 2024-09-13T06:42:14.258 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6050000000000004e-05 2024-09-13T06:42:14.259 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:14.259 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:14.259 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:14.259 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.696719+0000", 2024-09-13T06:42:14.259 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00030138499999999999 2024-09-13T06:42:14.259 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:14.259 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:14.259 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:14.259 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:14.259 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:14.259 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27855 3.a 3:537b3559:::rbd_data.1121f2c5ee81.0000000000000016:13 [read 380928~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:42:14.259 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.658771+0000", 2024-09-13T06:42:14.259 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 137.59348174300001, 2024-09-13T06:42:14.260 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.038326354, 2024-09-13T06:42:14.260 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:14.260 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:14.260 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:14.260 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:14.260 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:14.260 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27855 2024-09-13T06:42:14.260 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:14.260 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:14.260 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:14.260 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:14.260 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658771+0000", 2024-09-13T06:42:14.260 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:14.261 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:14.261 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:14.261 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:14.261 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658771+0000", 2024-09-13T06:42:14.261 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:14.261 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:14.261 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:14.261 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:14.261 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658770+0000", 2024-09-13T06:42:14.261 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:14.261 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:14.261 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:14.261 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:14.261 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658772+0000", 2024-09-13T06:42:14.262 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.0930000000000001e-06 2024-09-13T06:42:14.262 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:14.262 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:14.262 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:14.262 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658778+0000", 2024-09-13T06:42:14.262 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.2730000000000002e-06 2024-09-13T06:42:14.262 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:14.262 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:14.262 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:14.262 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658782+0000", 2024-09-13T06:42:14.262 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0879999999999997e-06 2024-09-13T06:42:14.262 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:14.262 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:14.262 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:14.263 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.696770+0000", 2024-09-13T06:42:14.263 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.037988145000000001 2024-09-13T06:42:14.263 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:14.263 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:14.263 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:14.263 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.696852+0000", 2024-09-13T06:42:14.263 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.2039999999999994e-05 2024-09-13T06:42:14.263 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:14.263 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:14.263 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:14.263 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.697097+0000", 2024-09-13T06:42:14.263 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00024508800000000002 2024-09-13T06:42:14.263 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:14.264 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:14.264 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:14.264 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:14.264 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:14.264 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27856 3.a 3:537b3559:::rbd_data.1121f2c5ee81.0000000000000016:13 [read 405504~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:42:14.264 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.658786+0000", 2024-09-13T06:42:14.264 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 137.593466627, 2024-09-13T06:42:14.264 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.038736029999999998, 2024-09-13T06:42:14.264 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:14.264 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:14.264 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:14.264 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:14.264 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:14.264 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27856 2024-09-13T06:42:14.265 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:14.265 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:14.265 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:14.265 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:14.265 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658786+0000", 2024-09-13T06:42:14.265 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:14.265 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:14.265 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:14.265 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:14.265 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658786+0000", 2024-09-13T06:42:14.265 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:14.265 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:14.265 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:14.266 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:14.266 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658785+0000", 2024-09-13T06:42:14.266 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:14.266 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:14.266 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:14.266 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:14.266 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658787+0000", 2024-09-13T06:42:14.266 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.0040000000000002e-06 2024-09-13T06:42:14.266 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:14.266 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:14.266 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:14.266 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658793+0000", 2024-09-13T06:42:14.266 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.2410000000000003e-06 2024-09-13T06:42:14.266 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:14.267 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:14.267 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:14.267 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658797+0000", 2024-09-13T06:42:14.267 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.1330000000000001e-06 2024-09-13T06:42:14.267 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:14.267 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:14.267 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:14.267 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.697176+0000", 2024-09-13T06:42:14.267 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.038379074999999999 2024-09-13T06:42:14.267 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:14.267 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:14.267 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:14.267 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.697275+0000", 2024-09-13T06:42:14.268 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.8819000000000004e-05 2024-09-13T06:42:14.268 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:14.268 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:14.268 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:14.268 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.697522+0000", 2024-09-13T06:42:14.268 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00024719999999999999 2024-09-13T06:42:14.268 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:14.268 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:14.268 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:14.268 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:14.268 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:14.268 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27857 3.a 3:537b3559:::rbd_data.1121f2c5ee81.0000000000000016:13 [read 475136~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:42:14.268 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.658845+0000", 2024-09-13T06:42:14.269 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 137.59340762400001, 2024-09-13T06:42:14.269 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039112570999999999, 2024-09-13T06:42:14.269 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:14.269 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:14.269 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:14.269 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:14.269 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:14.269 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27857 2024-09-13T06:42:14.269 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:14.269 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:14.269 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:14.269 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:14.269 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658845+0000", 2024-09-13T06:42:14.270 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:14.270 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:14.270 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:14.270 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:14.270 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658845+0000", 2024-09-13T06:42:14.270 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:14.270 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:14.270 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:14.270 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:14.270 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658844+0000", 2024-09-13T06:42:14.271 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999986 2024-09-13T06:42:14.271 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:14.271 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:14.271 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:14.271 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658868+0000", 2024-09-13T06:42:14.271 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.4615000000000001e-05 2024-09-13T06:42:14.271 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:14.271 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:14.271 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:14.271 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658884+0000", 2024-09-13T06:42:14.271 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5401999999999999e-05 2024-09-13T06:42:14.271 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:14.271 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:14.271 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:14.272 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658896+0000", 2024-09-13T06:42:14.272 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2509e-05 2024-09-13T06:42:14.272 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:14.272 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:14.272 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:14.272 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.697571+0000", 2024-09-13T06:42:14.272 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.038675107 2024-09-13T06:42:14.272 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:14.272 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:14.272 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:14.272 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.697658+0000", 2024-09-13T06:42:14.272 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6349999999999998e-05 2024-09-13T06:42:14.272 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:14.272 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:14.273 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:14.273 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.697957+0000", 2024-09-13T06:42:14.273 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00029986100000000001 2024-09-13T06:42:14.273 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:14.273 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:14.273 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:14.273 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:14.273 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:14.273 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27858 3.a 3:537b3559:::rbd_data.1121f2c5ee81.0000000000000016:13 [read 499712~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:42:14.273 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.658905+0000", 2024-09-13T06:42:14.273 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 137.59334707400001, 2024-09-13T06:42:14.273 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039475392999999998, 2024-09-13T06:42:14.274 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:14.274 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:14.274 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:14.274 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:14.274 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:14.274 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27858 2024-09-13T06:42:14.274 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:14.274 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:14.274 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:14.274 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:14.274 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658905+0000", 2024-09-13T06:42:14.274 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:14.274 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:14.275 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:14.275 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:14.275 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658905+0000", 2024-09-13T06:42:14.275 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:14.275 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:14.275 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:14.275 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:14.275 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658905+0000", 2024-09-13T06:42:14.275 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:42:14.275 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:14.275 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:14.275 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:14.275 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658909+0000", 2024-09-13T06:42:14.276 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.831e-06 2024-09-13T06:42:14.276 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:14.276 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:14.276 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:14.276 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658920+0000", 2024-09-13T06:42:14.276 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0936e-05 2024-09-13T06:42:14.276 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:14.276 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:14.276 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:14.276 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658929+0000", 2024-09-13T06:42:14.276 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.2749999999999995e-06 2024-09-13T06:42:14.276 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:14.276 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:14.277 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:14.277 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.697990+0000", 2024-09-13T06:42:14.277 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039061625000000003 2024-09-13T06:42:14.277 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:14.277 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:14.277 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:14.277 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.698077+0000", 2024-09-13T06:42:14.277 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6922000000000006e-05 2024-09-13T06:42:14.277 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:14.277 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:14.277 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:14.277 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.698381+0000", 2024-09-13T06:42:14.277 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00030360599999999999 2024-09-13T06:42:14.278 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:14.278 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:14.278 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:14.278 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:14.278 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:14.278 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27929 3.a 3:537b3559:::rbd_data.1121f2c5ee81.0000000000000016:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:42:14.278 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.659338+0000", 2024-09-13T06:42:14.278 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 137.592914243, 2024-09-13T06:42:14.278 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039351214000000002, 2024-09-13T06:42:14.278 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:14.278 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:14.278 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:14.278 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:14.278 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:14.279 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27929 2024-09-13T06:42:14.279 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:14.279 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:14.279 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:14.279 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:14.279 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.659338+0000", 2024-09-13T06:42:14.279 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:14.279 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:14.279 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:14.279 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:14.279 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.659338+0000", 2024-09-13T06:42:14.279 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:14.279 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:14.279 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:14.280 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:14.280 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.659337+0000", 2024-09-13T06:42:14.280 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:42:14.280 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:14.280 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:14.280 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:14.280 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.659342+0000", 2024-09-13T06:42:14.280 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0799999999999999e-06 2024-09-13T06:42:14.280 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:14.280 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:14.280 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:14.280 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.659353+0000", 2024-09-13T06:42:14.280 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1798e-05 2024-09-13T06:42:14.280 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:14.281 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:14.281 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:14.281 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.659361+0000", 2024-09-13T06:42:14.281 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.8040000000000002e-06 2024-09-13T06:42:14.281 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:14.281 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:14.281 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:14.281 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.698449+0000", 2024-09-13T06:42:14.281 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039087519000000001 2024-09-13T06:42:14.281 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:14.281 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:14.281 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:14.281 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.698567+0000", 2024-09-13T06:42:14.282 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00011857 2024-09-13T06:42:14.282 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:14.282 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:14.282 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:14.282 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.698689+0000", 2024-09-13T06:42:14.282 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00012226699999999999 2024-09-13T06:42:14.282 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:14.282 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:14.282 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:14.282 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:14.282 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:14.282 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27974 3.a 3:537b3559:::rbd_data.1121f2c5ee81.0000000000000016:13 [read 32768~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:42:14.282 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.660102+0000", 2024-09-13T06:42:14.282 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 137.59215047500001, 2024-09-13T06:42:14.283 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.038972346999999997, 2024-09-13T06:42:14.283 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:14.283 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:14.283 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:14.283 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:14.283 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:14.283 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27974 2024-09-13T06:42:14.283 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:14.283 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:14.283 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:14.283 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:14.283 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660102+0000", 2024-09-13T06:42:14.283 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:14.284 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:14.284 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:14.284 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:14.284 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660102+0000", 2024-09-13T06:42:14.284 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:14.284 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:14.284 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:14.284 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:14.284 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660100+0000", 2024-09-13T06:42:14.284 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999976 2024-09-13T06:42:14.284 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:14.284 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:14.284 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:14.284 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660114+0000", 2024-09-13T06:42:14.285 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.4466e-05 2024-09-13T06:42:14.285 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:14.285 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:14.285 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:14.285 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660148+0000", 2024-09-13T06:42:14.285 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.3742999999999999e-05 2024-09-13T06:42:14.285 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:14.285 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:14.285 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:14.285 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660170+0000", 2024-09-13T06:42:14.285 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.2518e-05 2024-09-13T06:42:14.285 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:14.285 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:14.285 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:14.286 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.698719+0000", 2024-09-13T06:42:14.286 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.038548529999999998 2024-09-13T06:42:14.286 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:14.286 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:14.286 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:14.286 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.698806+0000", 2024-09-13T06:42:14.286 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.7179e-05 2024-09-13T06:42:14.286 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:14.286 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:14.286 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:14.286 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.699074+0000", 2024-09-13T06:42:14.286 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00026834800000000001 2024-09-13T06:42:14.286 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:14.286 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:14.287 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:14.287 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:14.287 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:14.287 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27975 3.a 3:537b3559:::rbd_data.1121f2c5ee81.0000000000000016:13 [read 57344~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:42:14.287 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.660189+0000", 2024-09-13T06:42:14.287 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 137.592063631, 2024-09-13T06:42:14.287 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039288678, 2024-09-13T06:42:14.287 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:14.287 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:14.287 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:14.287 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:14.287 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:14.287 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27975 2024-09-13T06:42:14.288 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:14.288 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:14.288 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:14.288 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:14.288 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660189+0000", 2024-09-13T06:42:14.288 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:14.288 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:14.288 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:14.288 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:14.288 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660189+0000", 2024-09-13T06:42:14.288 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:14.288 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:14.288 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:14.288 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:14.289 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660187+0000", 2024-09-13T06:42:14.289 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999981 2024-09-13T06:42:14.289 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:14.289 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:14.289 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:14.289 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660195+0000", 2024-09-13T06:42:14.289 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5610000000000001e-06 2024-09-13T06:42:14.289 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:14.289 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:14.289 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:14.289 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660212+0000", 2024-09-13T06:42:14.289 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7725999999999999e-05 2024-09-13T06:42:14.289 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:14.289 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:14.290 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:14.290 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660227+0000", 2024-09-13T06:42:14.290 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.43e-05 2024-09-13T06:42:14.290 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:14.290 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:14.290 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:14.290 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.699135+0000", 2024-09-13T06:42:14.290 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.038908336000000002 2024-09-13T06:42:14.290 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:14.290 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:14.290 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:14.290 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.699208+0000", 2024-09-13T06:42:14.290 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.3065000000000006e-05 2024-09-13T06:42:14.290 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:14.291 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:14.291 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:14.291 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.699478+0000", 2024-09-13T06:42:14.291 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00026946899999999999 2024-09-13T06:42:14.291 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:14.291 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:14.291 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:14.291 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:14.291 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:14.291 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27976 3.a 3:537b3559:::rbd_data.1121f2c5ee81.0000000000000016:13 [read 102400~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:42:14.291 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.660238+0000", 2024-09-13T06:42:14.291 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 137.592014468, 2024-09-13T06:42:14.291 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039636515999999997, 2024-09-13T06:42:14.291 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:14.292 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:14.292 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:14.292 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:14.292 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:14.292 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27976 2024-09-13T06:42:14.292 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:14.292 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:14.292 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:14.292 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:14.292 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660238+0000", 2024-09-13T06:42:14.292 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:14.292 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:14.292 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:14.292 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:14.293 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660238+0000", 2024-09-13T06:42:14.293 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:14.293 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:14.293 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:14.293 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:14.293 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660237+0000", 2024-09-13T06:42:14.293 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:42:14.293 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:14.293 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:14.293 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:14.293 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660243+0000", 2024-09-13T06:42:14.293 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.9909999999999999e-06 2024-09-13T06:42:14.293 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:14.293 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:14.293 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:14.294 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660259+0000", 2024-09-13T06:42:14.294 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6294e-05 2024-09-13T06:42:14.294 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:14.294 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:14.294 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:14.294 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660272+0000", 2024-09-13T06:42:14.294 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2714999999999999e-05 2024-09-13T06:42:14.294 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:14.294 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:14.294 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:14.294 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.699513+0000", 2024-09-13T06:42:14.294 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039240932999999999 2024-09-13T06:42:14.294 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:14.294 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:14.294 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:14.295 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.699604+0000", 2024-09-13T06:42:14.295 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.1367999999999997e-05 2024-09-13T06:42:14.295 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:14.295 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:14.295 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:14.295 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.699875+0000", 2024-09-13T06:42:14.295 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00027029499999999999 2024-09-13T06:42:14.295 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:14.295 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:14.295 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:14.295 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:14.295 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:14.295 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27977 3.a 3:537b3559:::rbd_data.1121f2c5ee81.0000000000000016:13 [read 126976~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:42:14.296 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.660284+0000", 2024-09-13T06:42:14.296 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 137.591968896, 2024-09-13T06:42:14.296 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039969945, 2024-09-13T06:42:14.296 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:14.296 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:14.296 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:14.296 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:14.296 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:14.296 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27977 2024-09-13T06:42:14.296 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:14.296 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:14.296 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:14.296 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:14.297 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660284+0000", 2024-09-13T06:42:14.297 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:14.297 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:14.297 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:14.297 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:14.297 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660284+0000", 2024-09-13T06:42:14.297 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:14.297 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:14.297 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:14.297 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:14.297 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660282+0000", 2024-09-13T06:42:14.300 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999986 2024-09-13T06:42:14.300 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:14.300 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:14.300 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:14.300 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660288+0000", 2024-09-13T06:42:14.300 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.2650000000000002e-06 2024-09-13T06:42:14.300 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:14.300 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:14.300 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:14.300 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660304+0000", 2024-09-13T06:42:14.300 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5430999999999998e-05 2024-09-13T06:42:14.300 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:14.301 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:14.301 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:14.301 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660316+0000", 2024-09-13T06:42:14.301 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.237e-05 2024-09-13T06:42:14.301 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:14.301 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:14.301 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:14.301 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.699907+0000", 2024-09-13T06:42:14.301 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039590735000000002 2024-09-13T06:42:14.301 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:14.301 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:14.301 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:14.301 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.699994+0000", 2024-09-13T06:42:14.302 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6996999999999994e-05 2024-09-13T06:42:14.302 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:14.302 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:14.302 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:14.302 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700254+0000", 2024-09-13T06:42:14.302 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000259564 2024-09-13T06:42:14.302 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:14.302 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:14.302 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:14.302 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:14.302 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:14.302 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27978 3.a 3.9aacdeca (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:42:14.302 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.660327+0000", 2024-09-13T06:42:14.302 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 137.59192529800001, 2024-09-13T06:42:14.303 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039984858999999998, 2024-09-13T06:42:14.303 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:14.303 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:42:14.303 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:14.303 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:14.303 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:14.303 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27978 2024-09-13T06:42:14.303 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:14.303 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:14.303 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:14.303 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:14.303 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660327+0000", 2024-09-13T06:42:14.303 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:14.303 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:14.303 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:14.304 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:14.304 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660327+0000", 2024-09-13T06:42:14.304 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:14.304 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:14.304 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:14.304 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:14.304 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660326+0000", 2024-09-13T06:42:14.304 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:42:14.304 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:14.304 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:14.304 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:14.304 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660366+0000", 2024-09-13T06:42:14.304 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.9691000000000003e-05 2024-09-13T06:42:14.305 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:14.305 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:14.305 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:14.305 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660399+0000", 2024-09-13T06:42:14.305 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.3262000000000001e-05 2024-09-13T06:42:14.305 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:14.305 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:14.305 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:14.305 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660414+0000", 2024-09-13T06:42:14.305 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.4775e-05 2024-09-13T06:42:14.305 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:14.305 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:14.305 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:14.306 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700298+0000", 2024-09-13T06:42:14.306 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039883759999999997 2024-09-13T06:42:14.306 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:14.306 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:14.306 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:14.306 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700312+0000", 2024-09-13T06:42:14.306 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.4374e-05 2024-09-13T06:42:14.306 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:14.306 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:14.306 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:14.306 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:14.306 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:14.306 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27979 3.a 3.9aacdeca (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:42:14.307 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.660429+0000", 2024-09-13T06:42:14.307 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 137.59182343000001, 2024-09-13T06:42:14.307 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039921361000000002, 2024-09-13T06:42:14.307 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:14.307 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:42:14.307 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:14.307 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:14.307 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:14.307 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27979 2024-09-13T06:42:14.307 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:14.307 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:14.307 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:14.307 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:14.308 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660429+0000", 2024-09-13T06:42:14.308 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:14.308 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:14.308 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:14.308 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:14.308 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660429+0000", 2024-09-13T06:42:14.308 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:14.308 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:14.308 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:14.308 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:14.308 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660428+0000", 2024-09-13T06:42:14.308 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999986 2024-09-13T06:42:14.308 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:14.308 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:14.309 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:14.309 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660434+0000", 2024-09-13T06:42:14.309 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.8190000000000003e-06 2024-09-13T06:42:14.309 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:14.309 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:14.309 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:14.309 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660451+0000", 2024-09-13T06:42:14.309 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6963e-05 2024-09-13T06:42:14.309 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:14.309 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:14.309 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:14.309 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660485+0000", 2024-09-13T06:42:14.309 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.3414000000000002e-05 2024-09-13T06:42:14.310 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:14.310 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:14.310 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:14.310 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700342+0000", 2024-09-13T06:42:14.310 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039857278000000003 2024-09-13T06:42:14.310 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:14.310 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:14.310 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:14.310 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700350+0000", 2024-09-13T06:42:14.310 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.2930000000000001e-06 2024-09-13T06:42:14.310 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:14.310 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:14.310 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:14.310 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:14.310 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:14.311 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27980 3.a 3.9aacdeca (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:42:14.311 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.660497+0000", 2024-09-13T06:42:14.311 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 137.59175521899999, 2024-09-13T06:42:14.311 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039888034000000003, 2024-09-13T06:42:14.311 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:14.311 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:42:14.311 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:14.311 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:14.311 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:14.311 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27980 2024-09-13T06:42:14.311 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:14.311 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:14.311 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:14.311 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:14.311 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660497+0000", 2024-09-13T06:42:14.312 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:14.312 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:14.312 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:14.312 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:14.312 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660497+0000", 2024-09-13T06:42:14.312 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:14.312 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:14.312 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:14.312 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:14.312 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660496+0000", 2024-09-13T06:42:14.312 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:42:14.312 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:14.312 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:14.312 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:14.313 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660503+0000", 2024-09-13T06:42:14.313 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.4110000000000001e-06 2024-09-13T06:42:14.313 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:14.313 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:14.313 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:14.313 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660519+0000", 2024-09-13T06:42:14.313 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6180000000000001e-05 2024-09-13T06:42:14.313 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:14.313 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:14.313 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:14.313 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660544+0000", 2024-09-13T06:42:14.313 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.5177999999999998e-05 2024-09-13T06:42:14.313 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:14.313 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:14.314 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:14.314 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700377+0000", 2024-09-13T06:42:14.314 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039833434000000001 2024-09-13T06:42:14.314 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:14.314 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:14.314 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:14.314 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700385+0000", 2024-09-13T06:42:14.314 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.8800000000000008e-06 2024-09-13T06:42:14.314 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:14.314 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:14.314 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:14.314 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:14.314 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:14.314 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27981 3.a 3.9aacdeca (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:42:14.315 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.660556+0000", 2024-09-13T06:42:14.315 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 137.59169687299999, 2024-09-13T06:42:14.315 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039869989000000002, 2024-09-13T06:42:14.315 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:14.315 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:42:14.315 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:14.315 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:14.315 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:14.315 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27981 2024-09-13T06:42:14.315 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:14.315 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:14.315 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:14.315 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:14.315 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660556+0000", 2024-09-13T06:42:14.316 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:14.316 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:14.316 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:14.316 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:14.316 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660556+0000", 2024-09-13T06:42:14.316 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:14.316 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:14.316 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:14.316 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:14.316 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660555+0000", 2024-09-13T06:42:14.316 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:42:14.316 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:14.316 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:14.317 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:14.317 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660561+0000", 2024-09-13T06:42:14.317 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.088e-06 2024-09-13T06:42:14.317 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:14.317 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:14.317 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:14.317 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660577+0000", 2024-09-13T06:42:14.317 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6147999999999999e-05 2024-09-13T06:42:14.317 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:14.317 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:14.317 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:14.317 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660589+0000", 2024-09-13T06:42:14.318 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2551999999999999e-05 2024-09-13T06:42:14.318 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:14.318 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:14.318 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:14.318 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700414+0000", 2024-09-13T06:42:14.318 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039825007000000003 2024-09-13T06:42:14.318 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:14.318 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:14.318 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:14.318 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700426+0000", 2024-09-13T06:42:14.318 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1265e-05 2024-09-13T06:42:14.318 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:14.318 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:14.319 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:14.319 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:14.319 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:14.319 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27982 3.a 3.9aacdeca (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:42:14.319 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.660603+0000", 2024-09-13T06:42:14.319 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 137.59164927800001, 2024-09-13T06:42:14.319 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039874779999999999, 2024-09-13T06:42:14.319 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:14.319 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:42:14.319 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:14.319 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:14.319 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:14.319 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27982 2024-09-13T06:42:14.320 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:14.320 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:14.320 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:14.320 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:14.320 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660603+0000", 2024-09-13T06:42:14.320 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:14.320 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:14.320 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:14.320 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:14.320 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660603+0000", 2024-09-13T06:42:14.320 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:14.320 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:14.320 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:14.321 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:14.321 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660602+0000", 2024-09-13T06:42:14.321 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:42:14.321 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:14.321 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:14.321 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:14.321 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660653+0000", 2024-09-13T06:42:14.321 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.0862000000000002e-05 2024-09-13T06:42:14.321 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:14.321 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:14.321 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:14.321 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660697+0000", 2024-09-13T06:42:14.321 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.3773000000000003e-05 2024-09-13T06:42:14.321 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:14.322 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:14.322 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:14.322 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660712+0000", 2024-09-13T06:42:14.322 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5464999999999998e-05 2024-09-13T06:42:14.322 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:14.322 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:14.322 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:14.322 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700469+0000", 2024-09-13T06:42:14.322 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039756503999999998 2024-09-13T06:42:14.322 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:14.322 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:14.322 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:14.322 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700478+0000", 2024-09-13T06:42:14.322 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.1730000000000001e-06 2024-09-13T06:42:14.322 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:14.323 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:14.323 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:14.323 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:14.323 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:14.323 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27983 3.a 3.9aacdeca (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:42:14.323 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.660726+0000", 2024-09-13T06:42:14.323 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 137.59152600300001, 2024-09-13T06:42:14.323 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039804357999999998, 2024-09-13T06:42:14.323 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:14.323 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:42:14.323 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:14.323 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:14.323 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:14.323 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27983 2024-09-13T06:42:14.323 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:14.324 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:14.324 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:14.324 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:14.324 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660726+0000", 2024-09-13T06:42:14.324 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:14.324 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:14.324 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:14.324 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:14.324 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660726+0000", 2024-09-13T06:42:14.324 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:14.324 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:14.324 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:14.324 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:14.324 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660725+0000", 2024-09-13T06:42:14.325 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999986 2024-09-13T06:42:14.325 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:14.325 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:14.325 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:14.325 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660733+0000", 2024-09-13T06:42:14.325 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.9359999999999999e-06 2024-09-13T06:42:14.325 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:14.325 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:14.325 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:14.325 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660751+0000", 2024-09-13T06:42:14.325 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7679000000000001e-05 2024-09-13T06:42:14.325 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:14.325 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:14.325 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:14.325 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660764+0000", 2024-09-13T06:42:14.326 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3112000000000001e-05 2024-09-13T06:42:14.326 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:14.326 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:14.326 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:14.326 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700516+0000", 2024-09-13T06:42:14.326 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039752183000000003 2024-09-13T06:42:14.326 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:14.326 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:14.326 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:14.326 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700531+0000", 2024-09-13T06:42:14.326 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.4732999999999999e-05 2024-09-13T06:42:14.326 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:14.326 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:14.326 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:14.327 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:14.327 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:14.327 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27984 3.a 3.9aacdeca (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:42:14.327 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.660776+0000", 2024-09-13T06:42:14.327 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 137.5914769, 2024-09-13T06:42:14.327 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039795697999999997, 2024-09-13T06:42:14.327 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:14.327 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:42:14.327 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:14.327 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:14.327 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:14.327 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27984 2024-09-13T06:42:14.327 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:14.328 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:14.328 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:14.328 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:14.328 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660776+0000", 2024-09-13T06:42:14.328 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:14.328 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:14.328 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:14.328 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:14.328 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660776+0000", 2024-09-13T06:42:14.328 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:14.328 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:14.328 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:14.328 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:14.328 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660775+0000", 2024-09-13T06:42:14.329 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:42:14.329 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:14.329 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:14.329 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:14.329 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660780+0000", 2024-09-13T06:42:14.329 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.7849999999999997e-06 2024-09-13T06:42:14.329 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:14.329 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:14.329 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:14.329 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660799+0000", 2024-09-13T06:42:14.329 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.8794e-05 2024-09-13T06:42:14.329 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:14.330 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:14.330 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:14.330 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660812+0000", 2024-09-13T06:42:14.330 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3029e-05 2024-09-13T06:42:14.330 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:14.330 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:14.330 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:14.330 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700562+0000", 2024-09-13T06:42:14.330 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039749984000000002 2024-09-13T06:42:14.330 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:14.330 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:14.330 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:14.330 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700571+0000", 2024-09-13T06:42:14.331 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.1260000000000004e-06 2024-09-13T06:42:14.331 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:14.331 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:14.331 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:14.331 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:14.331 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:14.331 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27985 3.a 3.9aacdeca (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:42:14.331 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.660824+0000", 2024-09-13T06:42:14.331 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 137.59142884799999, 2024-09-13T06:42:14.331 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039784462, 2024-09-13T06:42:14.331 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:14.331 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:42:14.331 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:14.331 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:14.331 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:14.332 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27985 2024-09-13T06:42:14.332 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:14.332 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:14.332 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:14.332 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:14.332 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660824+0000", 2024-09-13T06:42:14.332 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:14.332 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:14.332 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:14.332 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:14.332 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660824+0000", 2024-09-13T06:42:14.332 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:14.333 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:14.333 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:14.333 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:14.333 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660823+0000", 2024-09-13T06:42:14.333 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:42:14.333 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:14.333 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:14.333 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:14.333 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660829+0000", 2024-09-13T06:42:14.333 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.9440000000000002e-06 2024-09-13T06:42:14.333 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:14.333 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:14.333 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:14.334 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660922+0000", 2024-09-13T06:42:14.334 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.2958e-05 2024-09-13T06:42:14.334 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:14.334 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:14.334 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:14.334 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660964+0000", 2024-09-13T06:42:14.334 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.2407000000000002e-05 2024-09-13T06:42:14.334 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:14.334 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:14.334 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:14.334 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700600+0000", 2024-09-13T06:42:14.334 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039635581000000003 2024-09-13T06:42:14.334 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:14.335 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:14.335 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:14.335 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700608+0000", 2024-09-13T06:42:14.335 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.5890000000000003e-06 2024-09-13T06:42:14.335 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:14.335 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:14.335 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:14.335 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:14.335 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:14.335 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:28023 3.10 3:0dedc28a:::rbd_data.1121f2c5ee81.0000000000000019:13 [read 475136~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:42:14.335 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.662072+0000", 2024-09-13T06:42:14.335 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 137.590180863, 2024-09-13T06:42:14.335 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.038086508999999998, 2024-09-13T06:42:14.336 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:14.336 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:14.336 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:14.336 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:14.336 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:14.336 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 28023 2024-09-13T06:42:14.336 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:14.336 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:14.336 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:14.336 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:14.336 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.662072+0000", 2024-09-13T06:42:14.336 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:14.336 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:14.336 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:14.337 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:14.337 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.662072+0000", 2024-09-13T06:42:14.337 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:14.337 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:14.337 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:14.337 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:14.337 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.662070+0000", 2024-09-13T06:42:14.337 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999986 2024-09-13T06:42:14.337 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:14.337 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:14.337 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:14.337 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.662076+0000", 2024-09-13T06:42:14.337 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.139e-06 2024-09-13T06:42:14.338 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:14.338 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:14.338 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:14.338 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.662094+0000", 2024-09-13T06:42:14.338 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7136999999999999e-05 2024-09-13T06:42:14.338 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:14.338 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:14.338 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:14.338 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.662124+0000", 2024-09-13T06:42:14.338 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.0528999999999999e-05 2024-09-13T06:42:14.338 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:14.338 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:14.338 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:14.338 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.699843+0000", 2024-09-13T06:42:14.338 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.037718415999999998 2024-09-13T06:42:14.339 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:14.339 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:14.339 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:14.339 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.699931+0000", 2024-09-13T06:42:14.339 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.8345999999999997e-05 2024-09-13T06:42:14.339 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:14.339 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:14.339 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:14.339 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700158+0000", 2024-09-13T06:42:14.339 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00022723099999999999 2024-09-13T06:42:14.339 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:14.339 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:14.339 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:14.339 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:14.340 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:14.340 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:28024 3.10 3.5143b7b0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:42:14.340 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.662137+0000", 2024-09-13T06:42:14.340 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 137.590115341, 2024-09-13T06:42:14.340 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.038056092999999999, 2024-09-13T06:42:14.340 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:14.340 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:42:14.340 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:14.340 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:14.340 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:14.340 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 28024 2024-09-13T06:42:14.340 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:14.340 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:14.340 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:14.341 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:14.341 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.662137+0000", 2024-09-13T06:42:14.341 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:14.341 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:14.341 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:14.341 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:14.341 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.662137+0000", 2024-09-13T06:42:14.341 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:14.341 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:14.341 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:14.341 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:14.341 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.662136+0000", 2024-09-13T06:42:14.341 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999986 2024-09-13T06:42:14.342 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:14.342 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:14.342 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:14.342 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.662142+0000", 2024-09-13T06:42:14.342 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.6930000000000001e-06 2024-09-13T06:42:14.342 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:14.342 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:14.342 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:14.342 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.662160+0000", 2024-09-13T06:42:14.342 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7863000000000002e-05 2024-09-13T06:42:14.342 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:14.342 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:14.342 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:14.342 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.662189+0000", 2024-09-13T06:42:14.342 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.8486000000000001e-05 2024-09-13T06:42:14.343 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:14.343 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:14.343 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:14.343 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700187+0000", 2024-09-13T06:42:14.343 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.037998331000000003 2024-09-13T06:42:14.343 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:14.343 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:14.343 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:14.343 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700193+0000", 2024-09-13T06:42:14.343 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.0909999999999998e-06 2024-09-13T06:42:14.343 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:14.343 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:14.343 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:14.343 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:14.344 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:14.344 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:42:14.344 INFO:teuthology.orchestra.run.smithi081.stdout:osd.3: {} 2024-09-13T06:42:14.345 INFO:teuthology.orchestra.run.smithi081.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-13T06:42:14.345 INFO:teuthology.orchestra.run.smithi081.stdout:osd.4: {} 2024-09-13T06:42:14.346 INFO:teuthology.orchestra.run.smithi081.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-13T06:42:14.346 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:42:14.341+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:42:14.346 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-13T06:42:14.347 INFO:teuthology.orchestra.run.smithi081.stdout:osd.5: {} 2024-09-13T06:42:14.347 INFO:teuthology.orchestra.run.smithi081.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-13T06:42:14.347 INFO:teuthology.orchestra.run.smithi081.stdout:osd.6: {} 2024-09-13T06:42:14.348 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-13T06:42:14.348 INFO:teuthology.orchestra.run.smithi081.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-13T06:42:14.348 INFO:teuthology.orchestra.run.smithi081.stderr:Error ENXIO: problem getting command descriptions from osd.7 2024-09-13T06:42:14.349 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-13T06:42:14.418 INFO:teuthology.orchestra.run.smithi081.stderr:noscrub is set 2024-09-13T06:42:14.486 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:42:14.485+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:42:14.514 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:42:14.514 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:42:14.529 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-13T06:42:14.570 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:42:14.569+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:42:14.647 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:42:14.645+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:42:14.696 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:42:14.696 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:42:14.710 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-13T06:42:14.754 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:42:14.753+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:42:14.848 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:42:14.845+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:42:14.877 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:42:14.877 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:42:14.891 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-13T06:42:14.949 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:42:14.945+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:42:15.012 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:42:15.012 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:42:15.026 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-13T06:42:15.050 INFO:tasks.ceph.osd.6.smithi139.stderr:2024-09-13T06:42:15.045+0000 7fcd02c5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26385) UID: 0 2024-09-13T06:42:15.150 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:42:15.149+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:42:15.194 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:42:15.194 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:42:15.208 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-13T06:42:15.254 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:42:15.253+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:42:15.330 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:42:15.330 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:42:15.345 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-13T06:42:15.386 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:42:15.385+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:42:15.453 INFO:tasks.ceph.osd.6.smithi139.stderr:2024-09-13T06:42:15.449+0000 7fcd02c5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26385) UID: 0 2024-09-13T06:42:15.518 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:42:15.518 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:42:15.535 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-13T06:42:15.582 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:42:15.581+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:42:15.618 INFO:teuthology.orchestra.run.smithi081.stdout:checking clone #30, image image_client.0-clone30 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent31 2024-09-13T06:42:15.655 INFO:tasks.ceph.osd.6.smithi139.stderr:2024-09-13T06:42:15.649+0000 7fcd02c5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26385) UID: 0 2024-09-13T06:42:15.663 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:42:15.663 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:42:15.681 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-13T06:42:15.756 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:42:15.749+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:42:15.846 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 6, 7, 5, 3, 4] out_osds: [] dead_osds: [7] live_osds: [0, 1, 2, 3, 4, 5, 6] 2024-09-13T06:42:15.847 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-13T06:42:15.847 INFO:tasks.thrashosds.thrasher:Removing osd 6, in_osds are: [0, 1, 2, 6, 7, 5, 3, 4] 2024-09-13T06:42:15.847 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd out 6 2024-09-13T06:42:15.848 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:42:15.848 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:42:15.867 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-13T06:42:15.867 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:42:15.865+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:42:15.958 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:42:15.953+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:42:15.989 INFO:teuthology.orchestra.run.smithi081.stdout:4469 writesame 0xea13eff thru 0xea1c687 data_size 0x11(0x8789 bytes) 2024-09-13T06:42:15.990 INFO:teuthology.orchestra.run.smithi081.stdout:4470 write 0x510cbca thru 0x510e04c (0x1483 bytes) 2024-09-13T06:42:15.997 INFO:teuthology.orchestra.run.smithi081.stdout:4471 write 0x74c8760 thru 0x74cf72a (0x6fcb bytes) 2024-09-13T06:42:16.006 INFO:teuthology.orchestra.run.smithi081.stdout:4472 read 0x5c88093 thru 0x5c92e32 (0xada0 bytes) 2024-09-13T06:42:16.006 INFO:teuthology.orchestra.run.smithi081.stdout:4473 write 0x86ff452 thru 0x8704a36 (0x55e5 bytes) 2024-09-13T06:42:16.013 INFO:teuthology.orchestra.run.smithi081.stdout:4474 write 0xcccea6d thru 0xccd54dd (0x6a71 bytes) 2024-09-13T06:42:16.018 INFO:teuthology.orchestra.run.smithi081.stdout:4476 write 0x276591c thru 0x27718ed (0xbfd2 bytes) 2024-09-13T06:42:16.023 INFO:teuthology.orchestra.run.smithi081.stdout:4477 writesame 0xe20fda4 thru 0xe210f83 data_size 0x2c(0x11e0 bytes) 2024-09-13T06:42:16.029 INFO:teuthology.orchestra.run.smithi081.stdout:4479 writesame 0x6df6919 thru 0x6e067ba data_size 0xb(0xfea2 bytes) 2024-09-13T06:42:16.029 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:42:16.029 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:42:16.044 INFO:teuthology.orchestra.run.smithi081.stdout:4480 trunc from 0xea1c688 to 0xaac594a 2024-09-13T06:42:16.047 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-13T06:42:16.082 INFO:teuthology.orchestra.run.smithi081.stdout:4481 writesame 0xad58aec thru 0xad63bcf data_size 0x2(0xb0e4 bytes) 2024-09-13T06:42:16.082 INFO:teuthology.orchestra.run.smithi081.stdout:4482 writesame 0x8564f24 thru 0x8565f47 data_size 0x1(0x1024 bytes) 2024-09-13T06:42:16.083 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:42:16.081+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:42:16.085 INFO:teuthology.orchestra.run.smithi081.stdout:4483 writesame 0x6c7702c thru 0x6c83d25 data_size 0x1(0xccfa bytes) 2024-09-13T06:42:16.114 INFO:teuthology.orchestra.run.smithi081.stdout:4485 write 0x6b15fcc thru 0x6b1a98a (0x49bf bytes) 2024-09-13T06:42:16.121 INFO:teuthology.orchestra.run.smithi081.stdout:4486 read 0xa25f6d9 thru 0xa25fbf1 (0x519 bytes) 2024-09-13T06:42:16.121 INFO:teuthology.orchestra.run.smithi081.stdout:4487 read 0x6981440 thru 0x6988890 (0x7451 bytes) 2024-09-13T06:42:16.121 INFO:teuthology.orchestra.run.smithi081.stdout:4488 writesame 0x718f5cf thru 0x7190b7c data_size 0x19(0x15ae bytes) 2024-09-13T06:42:16.128 INFO:teuthology.orchestra.run.smithi081.stdout:4489 writesame 0x890913d thru 0x890ed15 data_size 0x1(0x5bd9 bytes) 2024-09-13T06:42:16.159 INFO:teuthology.orchestra.run.smithi081.stdout:4491 writesame 0x6e12cf6 thru 0x6e17afa data_size 0x1(0x4e05 bytes) 2024-09-13T06:42:16.159 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-13T06:42:16.157+0000 7fcdeb9fe640 -1 mon.a@0(leader).osd e175 definitely_dead 0 2024-09-13T06:42:16.159 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:42:16.157+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:42:16.166 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:42:16.166 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:42:16.176 INFO:teuthology.orchestra.run.smithi081.stdout:4492 writesame 0x971a294 thru 0x9725b91 data_size 0x1b(0xb8fe bytes) 2024-09-13T06:42:16.182 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-13T06:42:16.182 INFO:teuthology.orchestra.run.smithi081.stdout:4493 write 0x949b1e3 thru 0x94a87c5 (0xd5e3 bytes) 2024-09-13T06:42:16.188 INFO:teuthology.orchestra.run.smithi081.stdout:4494 punch from 0x39107f8 to 0x391ce8d, (0xc695 bytes) 2024-09-13T06:42:16.188 INFO:teuthology.orchestra.run.smithi081.stdout:4495 punch from 0x20c7705 to 0x20c8d07, (0x1602 bytes) 2024-09-13T06:42:16.188 INFO:teuthology.orchestra.run.smithi081.stdout:4496 read 0xa3053dd thru 0xa3061d5 (0xdf9 bytes) 2024-09-13T06:42:16.188 INFO:teuthology.orchestra.run.smithi081.stdout:4497 read 0x4ae9f9c thru 0x4af7154 (0xd1b9 bytes) 2024-09-13T06:42:16.188 INFO:teuthology.orchestra.run.smithi081.stdout:4498 clone 33 order 20 su 65536 sc 12 2024-09-13T06:42:16.260 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:42:16.257+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:42:16.294 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:42:16.294 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:42:16.307 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-13T06:42:16.350 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-13T06:42:16.394 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:42:16.393+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:42:16.435 INFO:teuthology.orchestra.run.smithi081.stderr:marked out osd.6. 2024-09-13T06:42:16.442 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-13T06:42:16.446 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:42:16.446 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:42:16.460 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-13T06:42:16.462 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:42:16.457+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:42:16.493 INFO:teuthology.orchestra.run.smithi081.stdout:osd.0: {} 2024-09-13T06:42:16.493 INFO:teuthology.orchestra.run.smithi081.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-13T06:42:16.509 INFO:teuthology.orchestra.run.smithi081.stdout:osd.1: {} 2024-09-13T06:42:16.509 INFO:teuthology.orchestra.run.smithi081.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-13T06:42:16.524 INFO:teuthology.orchestra.run.smithi081.stdout:osd.2: {} 2024-09-13T06:42:16.524 INFO:teuthology.orchestra.run.smithi081.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-13T06:42:16.539 INFO:teuthology.orchestra.run.smithi081.stdout:osd.3: {} 2024-09-13T06:42:16.540 INFO:teuthology.orchestra.run.smithi081.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-13T06:42:16.558 INFO:teuthology.orchestra.run.smithi081.stdout:osd.4: {} 2024-09-13T06:42:16.558 INFO:teuthology.orchestra.run.smithi081.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-13T06:42:16.563 INFO:tasks.ceph.osd.6.smithi139.stderr:2024-09-13T06:42:16.557+0000 7fcd02c5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26385) UID: 0 2024-09-13T06:42:16.576 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:42:16.576 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [], 2024-09-13T06:42:16.577 INFO:teuthology.orchestra.run.smithi139.stdout: "complaint_time": 30, 2024-09-13T06:42:16.577 INFO:teuthology.orchestra.run.smithi139.stdout: "num_blocked_ops": 0 2024-09-13T06:42:16.577 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:42:16.578 INFO:teuthology.orchestra.run.smithi081.stdout:osd.5: {} 2024-09-13T06:42:16.578 INFO:teuthology.orchestra.run.smithi081.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-13T06:42:16.591 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-13T06:42:16.595 INFO:teuthology.orchestra.run.smithi081.stdout:osd.6: {} 2024-09-13T06:42:16.595 INFO:teuthology.orchestra.run.smithi081.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-13T06:42:16.596 INFO:teuthology.orchestra.run.smithi081.stderr:Error ENXIO: problem getting command descriptions from osd.7 2024-09-13T06:42:16.599 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-13T06:42:16.600 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-13T06:42:16.664 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:42:16.661+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:42:16.758 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:42:16.758 INFO:teuthology.orchestra.run.smithi139.stdout: "size": 20, 2024-09-13T06:42:16.758 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 600, 2024-09-13T06:42:16.758 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [ 2024-09-13T06:42:16.758 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:16.758 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18706 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 3346432~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:42:16.759 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.846138+0000", 2024-09-13T06:42:16.759 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 144.90966483400001, 2024-09-13T06:42:16.759 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.102018712, 2024-09-13T06:42:16.759 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:16.759 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:16.759 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:16.759 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:16.759 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:16.759 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18706 2024-09-13T06:42:16.759 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:16.759 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:16.759 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:16.759 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:16.760 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846138+0000", 2024-09-13T06:42:16.760 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:16.760 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:16.760 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:16.760 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:16.760 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846138+0000", 2024-09-13T06:42:16.760 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:16.760 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:16.760 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:16.760 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:16.760 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846138+0000", 2024-09-13T06:42:16.761 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:16.761 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:16.761 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:16.761 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:16.761 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846141+0000", 2024-09-13T06:42:16.761 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.6969999999999999e-06 2024-09-13T06:42:16.761 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:16.761 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:16.761 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:16.761 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846150+0000", 2024-09-13T06:42:16.761 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6400000000000003e-06 2024-09-13T06:42:16.761 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:16.762 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:16.762 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:16.762 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846160+0000", 2024-09-13T06:42:16.762 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.3999999999999998e-06 2024-09-13T06:42:16.762 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:16.762 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:16.762 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:16.762 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.947764+0000", 2024-09-13T06:42:16.762 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101604085 2024-09-13T06:42:16.762 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:16.762 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:16.762 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:16.763 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.947888+0000", 2024-09-13T06:42:16.763 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000124113 2024-09-13T06:42:16.763 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:16.763 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:16.763 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:16.763 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.948157+0000", 2024-09-13T06:42:16.763 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00026943399999999998 2024-09-13T06:42:16.763 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:16.763 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:16.763 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:16.763 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:16.763 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:16.763 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18707 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 3375104~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:42:16.764 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.846207+0000", 2024-09-13T06:42:16.764 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 144.90959606800001, 2024-09-13T06:42:16.764 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10238114099999999, 2024-09-13T06:42:16.764 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:16.764 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:16.764 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:16.764 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:16.764 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:16.764 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18707 2024-09-13T06:42:16.764 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:16.764 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:16.764 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:16.764 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:16.764 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846207+0000", 2024-09-13T06:42:16.765 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:16.765 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:16.765 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:16.765 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:16.765 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846207+0000", 2024-09-13T06:42:16.765 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:16.765 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:16.765 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:16.765 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:16.765 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846206+0000", 2024-09-13T06:42:16.765 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:42:16.765 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:16.765 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:16.765 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:16.766 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846211+0000", 2024-09-13T06:42:16.766 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.3000000000000003e-06 2024-09-13T06:42:16.766 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:16.766 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:16.766 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:16.766 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846220+0000", 2024-09-13T06:42:16.766 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6199999999999994e-06 2024-09-13T06:42:16.766 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:16.766 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:16.766 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:16.766 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846228+0000", 2024-09-13T06:42:16.766 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.7500000000000003e-06 2024-09-13T06:42:16.766 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:16.766 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:16.767 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:16.767 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.948267+0000", 2024-09-13T06:42:16.767 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10203878700000001 2024-09-13T06:42:16.767 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:16.767 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:16.767 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:16.767 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.948435+0000", 2024-09-13T06:42:16.767 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00016796500000000001 2024-09-13T06:42:16.767 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:16.767 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:16.767 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:16.767 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.948588+0000", 2024-09-13T06:42:16.767 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00015373599999999999 2024-09-13T06:42:16.767 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:16.768 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:16.768 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:16.768 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:16.768 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:16.768 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18718 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 3690496~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:42:16.768 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.850174+0000", 2024-09-13T06:42:16.768 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 144.90562891499999, 2024-09-13T06:42:16.768 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101854154, 2024-09-13T06:42:16.769 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:16.769 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:16.769 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:16.769 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:16.769 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:16.769 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18718 2024-09-13T06:42:16.769 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:16.769 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:16.769 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:16.769 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:16.769 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850174+0000", 2024-09-13T06:42:16.769 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:16.769 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:16.769 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:16.770 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:16.770 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850174+0000", 2024-09-13T06:42:16.770 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:16.770 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:16.770 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:16.770 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:16.770 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850173+0000", 2024-09-13T06:42:16.770 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:42:16.770 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:16.770 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:16.770 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:16.770 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850178+0000", 2024-09-13T06:42:16.771 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.4129999999999999e-06 2024-09-13T06:42:16.771 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:16.771 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:16.771 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:16.771 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850188+0000", 2024-09-13T06:42:16.771 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.8600000000000005e-06 2024-09-13T06:42:16.771 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:16.771 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:16.771 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:16.771 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850195+0000", 2024-09-13T06:42:16.771 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.8730000000000007e-06 2024-09-13T06:42:16.771 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:16.771 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:16.772 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:16.772 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.951766+0000", 2024-09-13T06:42:16.772 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.1015703 2024-09-13T06:42:16.772 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:16.772 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:16.772 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:16.772 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.951879+0000", 2024-09-13T06:42:16.772 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000112932 2024-09-13T06:42:16.772 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:16.772 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:16.772 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:16.772 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.952029+0000", 2024-09-13T06:42:16.772 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000149846 2024-09-13T06:42:16.773 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:16.773 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:16.773 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:16.773 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:16.773 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:16.773 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18719 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 3719168~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:42:16.773 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.850202+0000", 2024-09-13T06:42:16.773 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 144.90560087200001, 2024-09-13T06:42:16.773 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.102191676, 2024-09-13T06:42:16.773 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:16.773 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:16.773 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:16.774 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:16.774 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:16.774 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18719 2024-09-13T06:42:16.774 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:16.774 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:16.774 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:16.774 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:16.774 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850202+0000", 2024-09-13T06:42:16.774 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:16.774 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:16.774 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:16.774 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:16.774 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850202+0000", 2024-09-13T06:42:16.775 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:16.775 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:16.775 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:16.775 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:16.775 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850202+0000", 2024-09-13T06:42:16.775 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:42:16.775 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:16.775 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:16.775 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:16.775 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850205+0000", 2024-09-13T06:42:16.775 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.89e-06 2024-09-13T06:42:16.775 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:16.775 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:16.776 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:16.776 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850216+0000", 2024-09-13T06:42:16.776 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0233e-05 2024-09-13T06:42:16.776 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:16.776 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:16.776 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:16.776 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850223+0000", 2024-09-13T06:42:16.776 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5299999999999999e-06 2024-09-13T06:42:16.776 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:16.776 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:16.776 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:16.776 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.952106+0000", 2024-09-13T06:42:16.776 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10188309299999999 2024-09-13T06:42:16.777 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:16.777 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:16.777 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:16.777 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.952233+0000", 2024-09-13T06:42:16.777 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000126993 2024-09-13T06:42:16.777 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:16.777 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:16.777 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:16.777 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.952394+0000", 2024-09-13T06:42:16.777 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000160791 2024-09-13T06:42:16.777 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:16.777 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:16.777 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:16.778 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:16.778 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:16.778 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18720 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 3747840~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:42:16.778 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.850726+0000", 2024-09-13T06:42:16.778 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 144.90507704300001, 2024-09-13T06:42:16.778 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10199504299999999, 2024-09-13T06:42:16.778 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:16.778 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:16.778 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:16.778 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:16.778 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:16.778 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18720 2024-09-13T06:42:16.778 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:16.778 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:16.779 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:16.779 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:16.779 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850726+0000", 2024-09-13T06:42:16.779 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:16.779 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:16.779 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:16.779 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:16.779 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850726+0000", 2024-09-13T06:42:16.779 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:16.779 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:16.779 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:16.779 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:16.779 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850229+0000", 2024-09-13T06:42:16.779 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9995027 2024-09-13T06:42:16.779 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:16.780 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:16.780 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:16.780 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850731+0000", 2024-09-13T06:42:16.780 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00050221599999999999 2024-09-13T06:42:16.780 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:16.780 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:16.780 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:16.780 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850751+0000", 2024-09-13T06:42:16.780 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.9703000000000001e-05 2024-09-13T06:42:16.780 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:16.780 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:16.780 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:16.780 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850764+0000", 2024-09-13T06:42:16.781 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3207000000000001e-05 2024-09-13T06:42:16.781 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:16.781 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:16.781 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:16.781 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.952454+0000", 2024-09-13T06:42:16.781 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101690102 2024-09-13T06:42:16.781 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:16.781 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:16.781 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:16.781 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.952571+0000", 2024-09-13T06:42:16.781 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000116556 2024-09-13T06:42:16.781 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:16.782 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:16.782 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:16.782 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.952721+0000", 2024-09-13T06:42:16.782 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000150419 2024-09-13T06:42:16.782 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:16.782 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:16.782 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:16.782 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:16.782 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:16.782 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18730 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 4034560~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:42:16.782 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.854013+0000", 2024-09-13T06:42:16.782 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 144.90179010200001, 2024-09-13T06:42:16.782 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10186914399999999, 2024-09-13T06:42:16.782 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:16.783 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:16.783 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:16.783 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:16.783 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:16.783 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18730 2024-09-13T06:42:16.783 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:16.783 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:16.783 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:16.783 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:16.783 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.854013+0000", 2024-09-13T06:42:16.783 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:16.783 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:16.783 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:16.784 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:16.784 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.854013+0000", 2024-09-13T06:42:16.784 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:16.784 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:16.784 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:16.784 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:16.784 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.854013+0000", 2024-09-13T06:42:16.784 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:16.784 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:16.784 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:16.784 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:16.784 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.854016+0000", 2024-09-13T06:42:16.784 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.1839999999999999e-06 2024-09-13T06:42:16.785 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:16.785 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:16.785 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:16.785 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.854025+0000", 2024-09-13T06:42:16.785 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.8030000000000003e-06 2024-09-13T06:42:16.785 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:16.785 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:16.785 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:16.785 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.854033+0000", 2024-09-13T06:42:16.785 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6500000000000002e-06 2024-09-13T06:42:16.785 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:16.786 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:16.786 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:16.786 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.955546+0000", 2024-09-13T06:42:16.786 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10151296 2024-09-13T06:42:16.786 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:16.786 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:16.786 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:16.786 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.955694+0000", 2024-09-13T06:42:16.786 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000147773 2024-09-13T06:42:16.786 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:16.786 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:16.786 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:16.786 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.955882+0000", 2024-09-13T06:42:16.787 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000188371 2024-09-13T06:42:16.787 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:16.787 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:16.787 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:16.787 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:16.787 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:16.787 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18742 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 4378624~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:42:16.787 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.857984+0000", 2024-09-13T06:42:16.787 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 144.89781897899999, 2024-09-13T06:42:16.787 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10179961799999999, 2024-09-13T06:42:16.787 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:16.787 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:16.787 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:16.787 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:16.788 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:16.788 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18742 2024-09-13T06:42:16.788 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:16.788 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:16.788 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:16.788 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:16.788 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.857984+0000", 2024-09-13T06:42:16.788 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:16.788 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:16.788 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:16.788 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:16.788 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.857984+0000", 2024-09-13T06:42:16.788 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:16.788 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:16.789 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:16.789 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:16.789 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.857983+0000", 2024-09-13T06:42:16.789 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:42:16.789 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:16.789 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:16.789 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:16.789 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.857987+0000", 2024-09-13T06:42:16.789 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0670000000000002e-06 2024-09-13T06:42:16.789 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:16.789 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:16.789 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:16.789 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.857997+0000", 2024-09-13T06:42:16.790 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6830000000000003e-06 2024-09-13T06:42:16.790 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:16.790 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:16.790 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:16.790 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.858006+0000", 2024-09-13T06:42:16.790 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.5739999999999996e-06 2024-09-13T06:42:16.790 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:16.790 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:16.790 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:16.790 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.959453+0000", 2024-09-13T06:42:16.790 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101447339 2024-09-13T06:42:16.790 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:16.790 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:16.791 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:16.791 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.959603+0000", 2024-09-13T06:42:16.791 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000150316 2024-09-13T06:42:16.791 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:16.791 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:16.791 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:16.791 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.959784+0000", 2024-09-13T06:42:16.791 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00018065900000000001 2024-09-13T06:42:16.791 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:16.791 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:16.791 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:16.791 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:16.791 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:16.791 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18743 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 4407296~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:42:16.791 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.858012+0000", 2024-09-13T06:42:16.792 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 144.89779098599999, 2024-09-13T06:42:16.792 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10210024500000001, 2024-09-13T06:42:16.792 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:16.792 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:16.792 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:16.792 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:16.792 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:16.792 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18743 2024-09-13T06:42:16.792 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:16.792 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:16.792 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:16.792 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:16.792 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.858012+0000", 2024-09-13T06:42:16.793 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:16.793 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:16.793 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:16.793 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:16.793 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.858012+0000", 2024-09-13T06:42:16.793 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:16.793 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:16.793 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:16.793 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:16.793 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.858011+0000", 2024-09-13T06:42:16.793 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:42:16.793 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:16.793 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:16.794 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:16.794 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.858016+0000", 2024-09-13T06:42:16.794 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0659999999999997e-06 2024-09-13T06:42:16.794 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:16.794 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:16.794 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:16.794 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.858024+0000", 2024-09-13T06:42:16.794 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.7700000000000007e-06 2024-09-13T06:42:16.794 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:16.794 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:16.794 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:16.794 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.858032+0000", 2024-09-13T06:42:16.794 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.7700000000000001e-06 2024-09-13T06:42:16.795 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:16.795 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:16.795 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:16.795 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.959850+0000", 2024-09-13T06:42:16.795 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.1018182 2024-09-13T06:42:16.795 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:16.795 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:16.795 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:16.795 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.959964+0000", 2024-09-13T06:42:16.795 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00011413600000000001 2024-09-13T06:42:16.795 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:16.795 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:16.795 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:16.795 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.960113+0000", 2024-09-13T06:42:16.795 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00014813900000000001 2024-09-13T06:42:16.796 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:16.796 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:16.796 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:16.796 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:16.796 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:16.796 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18755 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 4751360~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:42:16.796 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.862061+0000", 2024-09-13T06:42:16.796 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 144.893742734, 2024-09-13T06:42:16.796 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101907023, 2024-09-13T06:42:16.796 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:16.796 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:16.796 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:16.796 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:16.797 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:16.797 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18755 2024-09-13T06:42:16.797 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:16.797 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:16.797 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:16.797 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:16.797 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862061+0000", 2024-09-13T06:42:16.797 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:16.797 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:16.797 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:16.797 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:16.797 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862061+0000", 2024-09-13T06:42:16.797 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:16.798 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:16.798 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:16.798 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:16.798 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862060+0000", 2024-09-13T06:42:16.798 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:42:16.798 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:16.798 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:16.798 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:16.798 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862064+0000", 2024-09-13T06:42:16.798 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.3229999999999999e-06 2024-09-13T06:42:16.798 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:16.798 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:16.799 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:16.799 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862078+0000", 2024-09-13T06:42:16.799 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.433e-05 2024-09-13T06:42:16.799 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:16.799 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:16.799 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:16.799 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862086+0000", 2024-09-13T06:42:16.799 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.3869999999999997e-06 2024-09-13T06:42:16.799 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:16.799 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:16.799 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:16.799 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.963635+0000", 2024-09-13T06:42:16.799 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101549606 2024-09-13T06:42:16.800 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:16.800 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:16.800 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:16.800 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.963783+0000", 2024-09-13T06:42:16.800 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000147312 2024-09-13T06:42:16.800 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:16.800 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:16.800 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:16.800 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.963968+0000", 2024-09-13T06:42:16.800 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000185028 2024-09-13T06:42:16.800 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:16.800 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:16.800 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:16.801 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:16.801 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:16.801 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18756 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 4780032~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:42:16.801 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.862132+0000", 2024-09-13T06:42:16.801 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 144.893670891, 2024-09-13T06:42:16.801 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.102159295, 2024-09-13T06:42:16.801 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:16.801 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:16.801 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:16.801 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:16.801 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:16.801 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18756 2024-09-13T06:42:16.801 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:16.801 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:16.802 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:16.802 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:16.802 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862132+0000", 2024-09-13T06:42:16.802 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:16.802 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:16.802 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:16.802 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:16.802 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862132+0000", 2024-09-13T06:42:16.802 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:16.802 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:16.802 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:16.802 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:16.802 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862132+0000", 2024-09-13T06:42:16.802 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:42:16.803 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:16.803 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:16.803 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:16.803 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862136+0000", 2024-09-13T06:42:16.803 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.9559999999999999e-06 2024-09-13T06:42:16.803 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:16.803 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:16.803 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:16.803 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862145+0000", 2024-09-13T06:42:16.803 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6169999999999996e-06 2024-09-13T06:42:16.803 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:16.803 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:16.803 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:16.804 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862153+0000", 2024-09-13T06:42:16.804 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.8359999999999992e-06 2024-09-13T06:42:16.804 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:16.804 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:16.804 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:16.804 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.964018+0000", 2024-09-13T06:42:16.804 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101865421 2024-09-13T06:42:16.804 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:16.804 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:16.804 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:16.804 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.964140+0000", 2024-09-13T06:42:16.804 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000121172 2024-09-13T06:42:16.805 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:16.805 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:16.805 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:16.805 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.964292+0000", 2024-09-13T06:42:16.805 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00015202600000000001 2024-09-13T06:42:16.805 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:16.805 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:16.805 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:16.805 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:16.805 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:16.805 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18768 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 5124096~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:42:16.805 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.866345+0000", 2024-09-13T06:42:16.805 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 144.88945858400001, 2024-09-13T06:42:16.805 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101779361, 2024-09-13T06:42:16.805 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:16.806 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:16.806 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:16.806 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:16.806 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:16.806 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18768 2024-09-13T06:42:16.806 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:16.806 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:16.806 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:16.806 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:16.806 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.866345+0000", 2024-09-13T06:42:16.806 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:16.806 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:16.806 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:16.806 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:16.807 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.866345+0000", 2024-09-13T06:42:16.807 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:16.807 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:16.807 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:16.807 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:16.807 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.866344+0000", 2024-09-13T06:42:16.807 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:16.807 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:16.807 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:16.807 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:16.807 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.866348+0000", 2024-09-13T06:42:16.807 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.4300000000000002e-06 2024-09-13T06:42:16.807 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:16.808 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:16.808 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:16.808 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.866356+0000", 2024-09-13T06:42:16.808 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.5930000000000006e-06 2024-09-13T06:42:16.808 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:16.808 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:16.808 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:16.808 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.866364+0000", 2024-09-13T06:42:16.808 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5599999999999996e-06 2024-09-13T06:42:16.808 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:16.808 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:16.808 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:16.809 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.967865+0000", 2024-09-13T06:42:16.809 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101501683 2024-09-13T06:42:16.809 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:16.809 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:16.809 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:16.809 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.967981+0000", 2024-09-13T06:42:16.809 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000115643 2024-09-13T06:42:16.809 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:16.809 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:16.809 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:16.809 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.968124+0000", 2024-09-13T06:42:16.809 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00014305500000000001 2024-09-13T06:42:16.809 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:16.809 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:16.810 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:16.810 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:16.810 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:16.810 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18779 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 5439488~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:42:16.810 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.869996+0000", 2024-09-13T06:42:16.810 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 144.885807699, 2024-09-13T06:42:16.810 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10189577399999999, 2024-09-13T06:42:16.810 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:16.810 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:16.810 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:16.810 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:16.810 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:16.810 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18779 2024-09-13T06:42:16.811 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:16.811 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:16.811 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:16.811 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:16.811 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.869996+0000", 2024-09-13T06:42:16.811 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:16.811 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:16.811 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:16.811 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:16.811 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.869996+0000", 2024-09-13T06:42:16.811 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:16.811 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:16.811 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:16.812 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:16.812 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.869995+0000", 2024-09-13T06:42:16.812 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:16.812 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:16.812 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:16.812 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:16.812 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.869998+0000", 2024-09-13T06:42:16.812 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.2729999999999998e-06 2024-09-13T06:42:16.812 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:16.812 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:16.812 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:16.812 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.870007+0000", 2024-09-13T06:42:16.812 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.5760000000000006e-06 2024-09-13T06:42:16.812 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:16.813 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:16.813 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:16.813 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.870014+0000", 2024-09-13T06:42:16.813 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.1400000000000002e-06 2024-09-13T06:42:16.813 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:16.813 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:16.813 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:16.813 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.971631+0000", 2024-09-13T06:42:16.813 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101617503 2024-09-13T06:42:16.813 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:16.813 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:16.813 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:16.813 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.971747+0000", 2024-09-13T06:42:16.814 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00011599600000000001 2024-09-13T06:42:16.814 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:16.814 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:16.814 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:16.814 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.971891+0000", 2024-09-13T06:42:16.814 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000143912 2024-09-13T06:42:16.814 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:16.814 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:16.814 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:16.814 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:16.814 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:16.814 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18792 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 5812224~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:42:16.815 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.874371+0000", 2024-09-13T06:42:16.815 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 144.881432569, 2024-09-13T06:42:16.815 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101736005, 2024-09-13T06:42:16.815 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:16.815 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:16.815 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:16.815 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:16.815 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:16.815 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18792 2024-09-13T06:42:16.815 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:16.815 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:16.815 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:16.815 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:16.815 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874371+0000", 2024-09-13T06:42:16.816 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:16.816 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:16.816 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:16.816 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:16.816 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874371+0000", 2024-09-13T06:42:16.816 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:16.816 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:16.816 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:16.816 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:16.816 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874370+0000", 2024-09-13T06:42:16.816 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:16.816 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:16.816 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:16.816 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:16.816 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874374+0000", 2024-09-13T06:42:16.817 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.7239999999999998e-06 2024-09-13T06:42:16.817 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:16.817 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:16.817 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:16.817 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874385+0000", 2024-09-13T06:42:16.817 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1293e-05 2024-09-13T06:42:16.817 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:16.817 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:16.817 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:16.817 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874394+0000", 2024-09-13T06:42:16.817 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.0729999999999994e-06 2024-09-13T06:42:16.817 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:16.817 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:16.817 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:16.818 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.975850+0000", 2024-09-13T06:42:16.818 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10145599700000001 2024-09-13T06:42:16.818 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:16.818 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:16.818 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:16.818 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.975963+0000", 2024-09-13T06:42:16.818 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000112689 2024-09-13T06:42:16.818 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:16.818 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:16.818 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:16.818 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.976107+0000", 2024-09-13T06:42:16.818 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000143836 2024-09-13T06:42:16.818 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:16.818 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:16.818 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:16.818 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:16.819 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:16.819 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18793 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 5840896~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:42:16.819 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.874401+0000", 2024-09-13T06:42:16.819 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 144.881402536, 2024-09-13T06:42:16.819 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.102005516, 2024-09-13T06:42:16.819 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:16.819 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:16.819 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:16.819 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:16.819 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:16.819 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18793 2024-09-13T06:42:16.819 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:16.819 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:16.819 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:16.819 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:16.820 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874401+0000", 2024-09-13T06:42:16.820 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:16.820 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:16.820 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:16.820 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:16.820 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874401+0000", 2024-09-13T06:42:16.820 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:16.820 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:16.820 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:16.820 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:16.820 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874400+0000", 2024-09-13T06:42:16.820 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:42:16.820 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:16.821 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:16.821 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:16.821 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874404+0000", 2024-09-13T06:42:16.821 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0069999999999999e-06 2024-09-13T06:42:16.821 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:16.821 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:16.821 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:16.821 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874412+0000", 2024-09-13T06:42:16.821 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.5399999999999996e-06 2024-09-13T06:42:16.821 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:16.821 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:16.821 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:16.821 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874420+0000", 2024-09-13T06:42:16.821 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.6199999999999999e-06 2024-09-13T06:42:16.822 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:16.822 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:16.822 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:16.822 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.976150+0000", 2024-09-13T06:42:16.822 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101729874 2024-09-13T06:42:16.822 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:16.822 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:16.822 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:16.822 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.976261+0000", 2024-09-13T06:42:16.822 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000110819 2024-09-13T06:42:16.822 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:16.822 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:16.822 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:16.823 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.976406+0000", 2024-09-13T06:42:16.823 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000145489 2024-09-13T06:42:16.823 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:16.823 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:16.823 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:16.823 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:16.823 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:16.823 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18803 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 6127616~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:42:16.823 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.877851+0000", 2024-09-13T06:42:16.823 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 144.87795204299999, 2024-09-13T06:42:16.823 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101951584, 2024-09-13T06:42:16.823 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:16.824 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:16.824 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:16.824 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:16.824 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:16.824 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18803 2024-09-13T06:42:16.824 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:16.824 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:16.824 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:16.824 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:16.824 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.877851+0000", 2024-09-13T06:42:16.824 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:16.824 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:16.825 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:16.825 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:16.825 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.877851+0000", 2024-09-13T06:42:16.825 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:16.825 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:16.825 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:16.825 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:16.825 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.877851+0000", 2024-09-13T06:42:16.825 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:16.825 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:16.825 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:16.825 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:16.825 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.877854+0000", 2024-09-13T06:42:16.825 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.7929999999999999e-06 2024-09-13T06:42:16.825 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:16.826 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:16.826 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:16.826 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.877864+0000", 2024-09-13T06:42:16.826 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.2029999999999998e-06 2024-09-13T06:42:16.826 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:16.826 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:16.826 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:16.826 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.877873+0000", 2024-09-13T06:42:16.826 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.0440000000000001e-06 2024-09-13T06:42:16.826 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:16.826 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:16.826 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:16.826 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.979544+0000", 2024-09-13T06:42:16.827 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101671198 2024-09-13T06:42:16.827 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:16.827 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:16.827 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:16.827 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.979658+0000", 2024-09-13T06:42:16.827 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000114456 2024-09-13T06:42:16.827 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:16.827 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:16.827 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:16.827 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.979803+0000", 2024-09-13T06:42:16.827 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000144506 2024-09-13T06:42:16.827 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:16.827 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:16.827 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:16.827 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:16.827 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:16.828 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18807 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 6242304~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:42:16.828 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.879235+0000", 2024-09-13T06:42:16.828 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 144.876568013, 2024-09-13T06:42:16.828 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101781258, 2024-09-13T06:42:16.828 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:16.828 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:16.828 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:16.828 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:16.828 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:16.828 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18807 2024-09-13T06:42:16.828 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:16.828 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:16.828 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:16.828 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:16.828 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879235+0000", 2024-09-13T06:42:16.829 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:16.829 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:16.829 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:16.829 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:16.829 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879235+0000", 2024-09-13T06:42:16.829 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:16.829 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:16.829 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:16.829 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:16.829 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879235+0000", 2024-09-13T06:42:16.829 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:16.829 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:16.829 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:16.829 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:16.830 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879239+0000", 2024-09-13T06:42:16.830 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.963e-06 2024-09-13T06:42:16.830 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:16.830 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:16.830 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:16.830 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879247+0000", 2024-09-13T06:42:16.830 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6470000000000004e-06 2024-09-13T06:42:16.830 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:16.830 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:16.830 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:16.830 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879255+0000", 2024-09-13T06:42:16.830 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5429999999999996e-06 2024-09-13T06:42:16.830 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:16.830 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:16.831 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:16.831 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.980756+0000", 2024-09-13T06:42:16.831 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10150165999999999 2024-09-13T06:42:16.831 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:16.831 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:16.831 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:16.831 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.980868+0000", 2024-09-13T06:42:16.831 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000111196 2024-09-13T06:42:16.831 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:16.831 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:16.831 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:16.831 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.981017+0000", 2024-09-13T06:42:16.831 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000148846 2024-09-13T06:42:16.831 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:16.831 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:16.832 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:16.832 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:16.832 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:16.832 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18808 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 6270976~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:42:16.832 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.879261+0000", 2024-09-13T06:42:16.832 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 144.876541874, 2024-09-13T06:42:16.832 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.102057547, 2024-09-13T06:42:16.832 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:16.832 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:16.832 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:16.832 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:16.832 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:16.832 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18808 2024-09-13T06:42:16.832 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:16.833 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:16.833 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:16.833 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:16.833 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879261+0000", 2024-09-13T06:42:16.833 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:16.833 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:16.833 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:16.833 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:16.833 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879261+0000", 2024-09-13T06:42:16.833 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:16.833 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:16.833 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:16.833 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:16.833 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879261+0000", 2024-09-13T06:42:16.834 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:16.834 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:16.834 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:16.834 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:16.834 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879264+0000", 2024-09-13T06:42:16.834 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.523e-06 2024-09-13T06:42:16.834 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:16.834 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:16.834 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:16.834 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879273+0000", 2024-09-13T06:42:16.834 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6070000000000008e-06 2024-09-13T06:42:16.834 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:16.834 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:16.834 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:16.834 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879280+0000", 2024-09-13T06:42:16.835 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.4699999999999996e-06 2024-09-13T06:42:16.835 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:16.835 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:16.835 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:16.835 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.981060+0000", 2024-09-13T06:42:16.835 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10177934800000001 2024-09-13T06:42:16.835 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:16.835 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:16.835 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:16.835 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.981174+0000", 2024-09-13T06:42:16.835 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000114456 2024-09-13T06:42:16.835 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:16.835 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:16.835 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:16.835 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.981319+0000", 2024-09-13T06:42:16.836 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00014473900000000001 2024-09-13T06:42:16.836 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:16.836 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:16.836 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:16.836 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:16.836 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:16.836 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18810 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 2662400~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:42:16.836 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.880386+0000", 2024-09-13T06:42:16.836 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 144.875417712, 2024-09-13T06:42:16.836 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101728022, 2024-09-13T06:42:16.836 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:16.836 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:16.836 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:16.836 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:16.837 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:16.837 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18810 2024-09-13T06:42:16.837 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:16.837 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:16.837 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:16.837 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:16.837 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880386+0000", 2024-09-13T06:42:16.837 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:16.837 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:16.837 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:16.837 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:16.837 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880386+0000", 2024-09-13T06:42:16.837 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:16.837 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:16.838 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:16.838 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:16.838 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880385+0000", 2024-09-13T06:42:16.838 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:42:16.838 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:16.838 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:16.838 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:16.838 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880389+0000", 2024-09-13T06:42:16.838 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.8539999999999999e-06 2024-09-13T06:42:16.838 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:16.838 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:16.838 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:16.838 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880398+0000", 2024-09-13T06:42:16.838 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.1689999999999998e-06 2024-09-13T06:42:16.838 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:16.839 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:16.839 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:16.839 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880405+0000", 2024-09-13T06:42:16.839 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5700000000000004e-06 2024-09-13T06:42:16.839 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:16.839 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:16.839 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:16.839 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.981833+0000", 2024-09-13T06:42:16.839 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10142791800000001 2024-09-13T06:42:16.839 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:16.839 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:16.839 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:16.839 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.981973+0000", 2024-09-13T06:42:16.839 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00014002900000000001 2024-09-13T06:42:16.840 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:16.840 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:16.840 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:16.840 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.982114+0000", 2024-09-13T06:42:16.840 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000140276 2024-09-13T06:42:16.840 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:16.840 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:16.840 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:16.840 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:16.840 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:16.840 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18811 3.9 3.140f5209 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:42:16.840 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.880449+0000", 2024-09-13T06:42:16.840 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 144.87535433599999, 2024-09-13T06:42:16.840 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101739355, 2024-09-13T06:42:16.840 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:16.841 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:42:16.841 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:16.841 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:16.841 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:16.841 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18811 2024-09-13T06:42:16.841 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:16.841 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:16.841 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:16.841 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:16.841 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880449+0000", 2024-09-13T06:42:16.841 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:16.841 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:16.841 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:16.841 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:16.842 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880449+0000", 2024-09-13T06:42:16.842 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:16.842 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:16.842 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:16.842 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:16.842 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880448+0000", 2024-09-13T06:42:16.842 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:42:16.842 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:16.842 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:16.842 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:16.842 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880452+0000", 2024-09-13T06:42:16.842 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0470000000000004e-06 2024-09-13T06:42:16.842 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:16.842 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:16.843 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:16.843 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880462+0000", 2024-09-13T06:42:16.843 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6530000000000006e-06 2024-09-13T06:42:16.843 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:16.843 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:16.843 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:16.843 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880472+0000", 2024-09-13T06:42:16.843 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0027000000000001e-05 2024-09-13T06:42:16.843 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:16.843 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:16.843 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:16.843 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.982172+0000", 2024-09-13T06:42:16.843 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10170043500000001 2024-09-13T06:42:16.844 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:16.844 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:16.844 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:16.844 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.982188+0000", 2024-09-13T06:42:16.844 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6172999999999999e-05 2024-09-13T06:42:16.844 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:16.844 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:16.844 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:16.844 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:16.844 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:16.844 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18812 3.9 3.140f5209 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:42:16.844 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.880478+0000", 2024-09-13T06:42:16.844 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 144.87532509900001, 2024-09-13T06:42:16.845 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10177795100000001, 2024-09-13T06:42:16.845 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:16.845 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:42:16.845 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:16.845 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:16.845 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:16.845 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18812 2024-09-13T06:42:16.845 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:16.845 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:16.845 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:16.845 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:16.845 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880478+0000", 2024-09-13T06:42:16.845 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:16.846 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:16.846 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:16.846 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:16.846 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880478+0000", 2024-09-13T06:42:16.846 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:16.846 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:16.846 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:16.846 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:16.846 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880477+0000", 2024-09-13T06:42:16.846 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:42:16.846 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:16.846 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:16.846 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:16.846 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880481+0000", 2024-09-13T06:42:16.847 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.827e-06 2024-09-13T06:42:16.847 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:16.847 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:16.847 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:16.847 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880490+0000", 2024-09-13T06:42:16.847 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6100000000000006e-06 2024-09-13T06:42:16.847 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:16.847 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:16.847 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:16.847 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880497+0000", 2024-09-13T06:42:16.847 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.7030000000000006e-06 2024-09-13T06:42:16.847 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:16.847 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:16.848 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:16.848 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.982241+0000", 2024-09-13T06:42:16.848 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10174351199999999 2024-09-13T06:42:16.848 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:16.848 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:16.848 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:16.848 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.982256+0000", 2024-09-13T06:42:16.848 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5143000000000001e-05 2024-09-13T06:42:16.848 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:16.848 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:16.848 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:16.848 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:16.848 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:16.848 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:42:16.850 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-13T06:42:16.851 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:42:16.849+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:42:16.951 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:42:16.945+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:42:16.975 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:42:16.976 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [], 2024-09-13T06:42:16.976 INFO:teuthology.orchestra.run.smithi139.stdout: "num_ops": 0 2024-09-13T06:42:16.976 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:42:16.990 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-13T06:42:17.076 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:42:17.073+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:42:17.152 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:42:17.153+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:42:17.158 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:42:17.158 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [], 2024-09-13T06:42:17.158 INFO:teuthology.orchestra.run.smithi139.stdout: "complaint_time": 30, 2024-09-13T06:42:17.158 INFO:teuthology.orchestra.run.smithi139.stdout: "num_blocked_ops": 0 2024-09-13T06:42:17.158 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:42:17.172 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-13T06:42:17.253 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:42:17.249+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:42:17.342 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:42:17.342 INFO:teuthology.orchestra.run.smithi139.stdout: "size": 20, 2024-09-13T06:42:17.342 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 600, 2024-09-13T06:42:17.343 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [ 2024-09-13T06:42:17.343 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.343 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43282 3.1d 3:bd80bfb3:::rbd_object_map.11212f44bfb1.0000000000000020:head [call rbd.object_map_update in=20b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:42:17.343 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589032+0000", 2024-09-13T06:42:17.343 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 115.751123015, 2024-09-13T06:42:17.343 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.076225263000000001, 2024-09-13T06:42:17.343 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:17.343 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:42:17.343 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:17.343 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:17.343 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:17.343 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43282 2024-09-13T06:42:17.344 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.344 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:17.344 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.344 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:17.344 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589032+0000", 2024-09-13T06:42:17.344 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:17.344 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.344 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.344 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:17.344 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589032+0000", 2024-09-13T06:42:17.344 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:17.344 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.345 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.345 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:17.345 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589031+0000", 2024-09-13T06:42:17.345 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:42:17.345 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.345 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.345 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:17.345 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589036+0000", 2024-09-13T06:42:17.345 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.2619999999999998e-06 2024-09-13T06:42:17.345 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.345 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.345 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:17.345 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589046+0000", 2024-09-13T06:42:17.345 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.8099999999999992e-06 2024-09-13T06:42:17.346 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.346 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.346 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:17.346 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589054+0000", 2024-09-13T06:42:17.346 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.2230000000000007e-06 2024-09-13T06:42:17.346 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.346 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.346 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:17.346 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.660691+0000", 2024-09-13T06:42:17.346 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.07163659 2024-09-13T06:42:17.346 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.346 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.346 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:17.347 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.660850+0000", 2024-09-13T06:42:17.347 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00015864300000000001 2024-09-13T06:42:17.347 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.347 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.347 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 4", 2024-09-13T06:42:17.347 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.661729+0000", 2024-09-13T06:42:17.347 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00087956099999999995 2024-09-13T06:42:17.347 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.347 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.347 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:42:17.347 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.664409+0000", 2024-09-13T06:42:17.347 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0026803479999999999 2024-09-13T06:42:17.347 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.347 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.348 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-13T06:42:17.348 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.665088+0000", 2024-09-13T06:42:17.348 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00067901400000000003 2024-09-13T06:42:17.348 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.348 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.348 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-13T06:42:17.348 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.665181+0000", 2024-09-13T06:42:17.348 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.2050000000000001e-05 2024-09-13T06:42:17.348 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.348 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.348 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:17.348 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.665257+0000", 2024-09-13T06:42:17.348 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.6698000000000003e-05 2024-09-13T06:42:17.349 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:17.349 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:17.349 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:17.349 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.349 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.349 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43290 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 299008~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:42:17.349 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589500+0000", 2024-09-13T06:42:17.349 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 115.750654853, 2024-09-13T06:42:17.349 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.075898564000000002, 2024-09-13T06:42:17.349 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:17.349 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:17.349 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:17.349 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:17.350 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:17.350 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43290 2024-09-13T06:42:17.350 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.350 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:17.350 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.350 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:17.350 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589500+0000", 2024-09-13T06:42:17.350 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:17.350 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.350 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.350 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:17.350 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589500+0000", 2024-09-13T06:42:17.350 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:17.350 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.351 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.351 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:17.351 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589499+0000", 2024-09-13T06:42:17.351 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:42:17.351 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.351 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.351 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:17.351 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589503+0000", 2024-09-13T06:42:17.351 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.8330000000000004e-06 2024-09-13T06:42:17.351 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.351 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.351 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:17.351 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589511+0000", 2024-09-13T06:42:17.351 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.3359999999999995e-06 2024-09-13T06:42:17.352 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.352 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.352 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:17.352 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589519+0000", 2024-09-13T06:42:17.352 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.4760000000000001e-06 2024-09-13T06:42:17.352 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.352 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.352 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:17.352 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.665097+0000", 2024-09-13T06:42:17.352 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.075577828999999999 2024-09-13T06:42:17.352 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.352 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.352 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:17.352 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.665170+0000", 2024-09-13T06:42:17.353 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.3745000000000006e-05 2024-09-13T06:42:17.353 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.353 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.353 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:17.353 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.665399+0000", 2024-09-13T06:42:17.353 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00022826199999999999 2024-09-13T06:42:17.353 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:17.353 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:17.353 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:17.353 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.353 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.353 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43291 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 313344~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:42:17.353 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589560+0000", 2024-09-13T06:42:17.353 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 115.750594632, 2024-09-13T06:42:17.354 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.076145594999999996, 2024-09-13T06:42:17.354 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:17.354 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:17.354 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:17.354 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:17.354 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:17.354 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43291 2024-09-13T06:42:17.354 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.354 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:17.354 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.354 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:17.354 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589560+0000", 2024-09-13T06:42:17.354 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:17.354 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.354 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.355 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:17.355 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589560+0000", 2024-09-13T06:42:17.355 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:17.355 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.355 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.355 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:17.355 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589559+0000", 2024-09-13T06:42:17.355 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:42:17.355 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.355 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.355 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:17.355 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589564+0000", 2024-09-13T06:42:17.355 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.3989999999999997e-06 2024-09-13T06:42:17.355 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.356 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.356 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:17.356 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589574+0000", 2024-09-13T06:42:17.356 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0502999999999999e-05 2024-09-13T06:42:17.356 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.356 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.356 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:17.356 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589582+0000", 2024-09-13T06:42:17.356 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.1859999999999992e-06 2024-09-13T06:42:17.356 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.356 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.356 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:17.356 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.665423+0000", 2024-09-13T06:42:17.356 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.075840290000000005 2024-09-13T06:42:17.357 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.357 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.357 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:17.357 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.665496+0000", 2024-09-13T06:42:17.357 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.2791000000000002e-05 2024-09-13T06:42:17.357 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.357 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.357 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:17.357 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.665706+0000", 2024-09-13T06:42:17.357 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00021038200000000001 2024-09-13T06:42:17.357 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:17.357 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:17.357 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:17.357 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.358 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.358 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43292 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 327680~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:42:17.358 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589589+0000", 2024-09-13T06:42:17.358 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 115.750566091, 2024-09-13T06:42:17.358 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.076769537999999998, 2024-09-13T06:42:17.358 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:17.358 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:17.358 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:17.358 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:17.358 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:17.358 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43292 2024-09-13T06:42:17.358 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.358 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:17.359 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.359 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:17.359 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589589+0000", 2024-09-13T06:42:17.359 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:17.359 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.359 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.359 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:17.359 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589589+0000", 2024-09-13T06:42:17.359 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:17.359 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.359 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.359 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:17.359 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589588+0000", 2024-09-13T06:42:17.360 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:17.360 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.360 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.360 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:17.360 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589592+0000", 2024-09-13T06:42:17.360 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.6389999999999998e-06 2024-09-13T06:42:17.360 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.360 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.360 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:17.360 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589600+0000", 2024-09-13T06:42:17.360 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.4630000000000001e-06 2024-09-13T06:42:17.360 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.360 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.361 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:17.361 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589608+0000", 2024-09-13T06:42:17.361 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.2359999999999998e-06 2024-09-13T06:42:17.361 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.361 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.361 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:17.361 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.665779+0000", 2024-09-13T06:42:17.361 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.076170924000000001 2024-09-13T06:42:17.361 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.361 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.361 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:17.361 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.665977+0000", 2024-09-13T06:42:17.362 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00019891900000000001 2024-09-13T06:42:17.362 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.362 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.362 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:17.362 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.666358+0000", 2024-09-13T06:42:17.362 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000380963 2024-09-13T06:42:17.362 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:17.362 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:17.362 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:17.362 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.362 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.362 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43293 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 342016~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:42:17.362 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589616+0000", 2024-09-13T06:42:17.363 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 115.75053919699999, 2024-09-13T06:42:17.363 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.077030083999999999, 2024-09-13T06:42:17.363 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:17.363 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:17.363 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:17.363 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:17.363 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:17.363 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43293 2024-09-13T06:42:17.363 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.363 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:17.363 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.363 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:17.363 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589616+0000", 2024-09-13T06:42:17.363 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:17.364 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.364 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.364 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:17.364 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589616+0000", 2024-09-13T06:42:17.364 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:17.364 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.364 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.364 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:17.364 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589615+0000", 2024-09-13T06:42:17.364 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:42:17.364 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.364 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.364 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:17.365 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589619+0000", 2024-09-13T06:42:17.365 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.9559999999999999e-06 2024-09-13T06:42:17.365 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.365 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.365 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:17.365 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589627+0000", 2024-09-13T06:42:17.365 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.2490000000000001e-06 2024-09-13T06:42:17.365 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.365 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.365 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:17.365 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589635+0000", 2024-09-13T06:42:17.365 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.96e-06 2024-09-13T06:42:17.365 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.366 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.366 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:17.366 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.666379+0000", 2024-09-13T06:42:17.366 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.076744484000000002 2024-09-13T06:42:17.366 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.366 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.366 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:17.366 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.666454+0000", 2024-09-13T06:42:17.366 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.4623999999999996e-05 2024-09-13T06:42:17.366 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.366 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.366 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:17.366 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.666646+0000", 2024-09-13T06:42:17.366 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00019176999999999999 2024-09-13T06:42:17.367 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:17.367 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:17.367 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:17.367 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.367 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.367 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43294 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 356352~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:42:17.367 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589681+0000", 2024-09-13T06:42:17.367 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 115.75047388199999, 2024-09-13T06:42:17.367 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.077594648000000002, 2024-09-13T06:42:17.367 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:17.367 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:17.367 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:17.367 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:17.368 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:17.368 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43294 2024-09-13T06:42:17.368 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.368 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:17.368 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.368 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:17.368 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589681+0000", 2024-09-13T06:42:17.368 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:17.368 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.368 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.368 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:17.368 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589681+0000", 2024-09-13T06:42:17.368 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:17.368 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.369 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.369 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:17.369 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589680+0000", 2024-09-13T06:42:17.369 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:42:17.369 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.369 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.369 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:17.369 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589684+0000", 2024-09-13T06:42:17.369 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.8369999999999999e-06 2024-09-13T06:42:17.369 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.369 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.369 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:17.370 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589693+0000", 2024-09-13T06:42:17.370 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.1020000000000003e-06 2024-09-13T06:42:17.370 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.370 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.370 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:17.370 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589701+0000", 2024-09-13T06:42:17.370 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.8059999999999995e-06 2024-09-13T06:42:17.370 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.370 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.370 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:17.370 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.666714+0000", 2024-09-13T06:42:17.370 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.077013463000000004 2024-09-13T06:42:17.370 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.370 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.371 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:17.371 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.666897+0000", 2024-09-13T06:42:17.371 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000182268 2024-09-13T06:42:17.371 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.371 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.371 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:17.371 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.667276+0000", 2024-09-13T06:42:17.371 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00037907499999999998 2024-09-13T06:42:17.371 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:17.371 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:17.371 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:17.371 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.371 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.372 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43295 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 370688~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:42:17.372 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589744+0000", 2024-09-13T06:42:17.372 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 115.75041071, 2024-09-13T06:42:17.372 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.077854343000000006, 2024-09-13T06:42:17.372 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:17.372 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:17.372 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:17.372 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:17.372 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:17.372 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43295 2024-09-13T06:42:17.372 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.372 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:17.372 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.373 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:17.373 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589744+0000", 2024-09-13T06:42:17.373 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:17.373 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.373 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.373 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:17.373 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589744+0000", 2024-09-13T06:42:17.373 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:17.373 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.373 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.373 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:17.373 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589743+0000", 2024-09-13T06:42:17.373 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:42:17.374 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.374 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.374 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:17.374 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589747+0000", 2024-09-13T06:42:17.374 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0130000000000004e-06 2024-09-13T06:42:17.374 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.374 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.374 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:17.374 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589756+0000", 2024-09-13T06:42:17.374 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.003e-06 2024-09-13T06:42:17.374 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.374 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.374 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:17.374 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589766+0000", 2024-09-13T06:42:17.375 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.2820000000000002e-06 2024-09-13T06:42:17.375 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.375 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.375 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:17.375 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.667300+0000", 2024-09-13T06:42:17.375 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.077534299000000001 2024-09-13T06:42:17.375 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.375 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.375 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:17.375 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.667372+0000", 2024-09-13T06:42:17.375 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.2393999999999998e-05 2024-09-13T06:42:17.375 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.375 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.376 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:17.376 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.667599+0000", 2024-09-13T06:42:17.376 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000226269 2024-09-13T06:42:17.376 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:17.376 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:17.376 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:17.376 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.376 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.376 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43296 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 385024~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:42:17.376 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589772+0000", 2024-09-13T06:42:17.376 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 115.75038268599999, 2024-09-13T06:42:17.376 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.078469647000000003, 2024-09-13T06:42:17.376 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:17.376 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:17.376 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:17.377 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:17.377 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:17.377 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43296 2024-09-13T06:42:17.377 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.377 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:17.377 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.377 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:17.377 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589772+0000", 2024-09-13T06:42:17.377 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:17.377 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.377 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.377 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:17.377 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589772+0000", 2024-09-13T06:42:17.377 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:17.377 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.378 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.378 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:17.378 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589771+0000", 2024-09-13T06:42:17.378 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:42:17.378 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.378 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.378 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:17.378 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589775+0000", 2024-09-13T06:42:17.378 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.8530000000000002e-06 2024-09-13T06:42:17.378 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.378 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.378 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:17.378 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589784+0000", 2024-09-13T06:42:17.378 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.4300000000000006e-06 2024-09-13T06:42:17.378 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.378 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.379 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:17.379 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589791+0000", 2024-09-13T06:42:17.379 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.4660000000000002e-06 2024-09-13T06:42:17.379 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.379 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.379 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:17.379 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.667667+0000", 2024-09-13T06:42:17.379 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.077875697999999993 2024-09-13T06:42:17.379 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.379 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.379 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:17.379 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.667854+0000", 2024-09-13T06:42:17.379 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00018760099999999999 2024-09-13T06:42:17.379 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.379 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.380 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:17.380 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.668242+0000", 2024-09-13T06:42:17.380 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00038750600000000003 2024-09-13T06:42:17.380 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:17.380 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:17.380 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:17.380 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.380 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.380 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43297 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 403456~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:42:17.380 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589797+0000", 2024-09-13T06:42:17.380 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 115.750357982, 2024-09-13T06:42:17.380 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.078756672999999999, 2024-09-13T06:42:17.380 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:17.380 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:17.381 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:17.381 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:17.381 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:17.381 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43297 2024-09-13T06:42:17.381 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.381 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:17.381 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.381 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:17.381 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589797+0000", 2024-09-13T06:42:17.381 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:17.381 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.381 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.381 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:17.381 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589797+0000", 2024-09-13T06:42:17.382 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:17.382 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.382 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.382 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:17.382 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589796+0000", 2024-09-13T06:42:17.382 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:17.382 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.382 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.382 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:17.382 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589800+0000", 2024-09-13T06:42:17.382 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.3230000000000002e-06 2024-09-13T06:42:17.382 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.382 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.382 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:17.382 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589808+0000", 2024-09-13T06:42:17.383 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.2390000000000002e-06 2024-09-13T06:42:17.383 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.383 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.383 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:17.383 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589815+0000", 2024-09-13T06:42:17.383 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.413e-06 2024-09-13T06:42:17.383 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.383 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.383 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:17.383 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.668265+0000", 2024-09-13T06:42:17.383 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.078449873000000003 2024-09-13T06:42:17.383 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.383 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.384 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:17.384 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.668332+0000", 2024-09-13T06:42:17.384 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.7178e-05 2024-09-13T06:42:17.384 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.384 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.384 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:17.384 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.668554+0000", 2024-09-13T06:42:17.384 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00022128600000000001 2024-09-13T06:42:17.384 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:17.384 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:17.384 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:17.384 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.384 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.384 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43298 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 417792~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:42:17.385 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589821+0000", 2024-09-13T06:42:17.385 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 115.75033386, 2024-09-13T06:42:17.385 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.079368660999999993, 2024-09-13T06:42:17.385 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:17.385 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:17.385 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:17.385 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:17.385 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:17.385 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43298 2024-09-13T06:42:17.385 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.385 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:17.385 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.385 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:17.385 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589821+0000", 2024-09-13T06:42:17.386 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:17.386 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.386 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.386 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:17.386 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589821+0000", 2024-09-13T06:42:17.386 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:17.386 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.386 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.386 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:17.386 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589821+0000", 2024-09-13T06:42:17.386 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:17.386 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.386 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.386 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:17.386 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589830+0000", 2024-09-13T06:42:17.387 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.4860000000000003e-06 2024-09-13T06:42:17.387 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.387 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.387 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:17.387 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589839+0000", 2024-09-13T06:42:17.387 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.0159999999999997e-06 2024-09-13T06:42:17.387 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.387 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.387 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:17.387 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589847+0000", 2024-09-13T06:42:17.387 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.6059999999999997e-06 2024-09-13T06:42:17.387 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.388 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.388 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:17.388 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.668620+0000", 2024-09-13T06:42:17.388 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.078773485000000004 2024-09-13T06:42:17.388 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.388 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.388 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:17.388 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.668798+0000", 2024-09-13T06:42:17.388 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000178233 2024-09-13T06:42:17.388 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.388 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.388 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:17.388 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.669190+0000", 2024-09-13T06:42:17.389 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00039143499999999998 2024-09-13T06:42:17.389 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:17.389 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:17.389 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:17.389 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.389 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.389 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43299 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 432128~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:42:17.389 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589881+0000", 2024-09-13T06:42:17.389 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 115.75027401200001, 2024-09-13T06:42:17.389 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.079693849999999997, 2024-09-13T06:42:17.390 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:17.390 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:17.390 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:17.390 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:17.390 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:17.390 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43299 2024-09-13T06:42:17.390 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.390 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:17.390 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.390 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:17.390 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589881+0000", 2024-09-13T06:42:17.390 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:17.391 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.391 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.391 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:17.391 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589881+0000", 2024-09-13T06:42:17.391 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:17.391 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.391 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.391 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:17.391 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589880+0000", 2024-09-13T06:42:17.391 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:42:17.391 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.391 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.391 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:17.391 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589884+0000", 2024-09-13T06:42:17.392 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.053e-06 2024-09-13T06:42:17.392 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.392 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.392 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:17.392 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589893+0000", 2024-09-13T06:42:17.392 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.2129999999999997e-06 2024-09-13T06:42:17.392 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.392 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.392 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:17.392 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589901+0000", 2024-09-13T06:42:17.392 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.6399999999999997e-06 2024-09-13T06:42:17.392 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.393 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.393 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:17.393 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.669213+0000", 2024-09-13T06:42:17.393 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.079312074999999996 2024-09-13T06:42:17.393 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.393 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.393 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:17.393 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.669281+0000", 2024-09-13T06:42:17.393 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.8322000000000001e-05 2024-09-13T06:42:17.393 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.393 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.393 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:17.394 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.669575+0000", 2024-09-13T06:42:17.394 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00029349699999999999 2024-09-13T06:42:17.394 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:17.394 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:17.394 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:17.394 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.394 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.394 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43300 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 446464~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:42:17.394 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589909+0000", 2024-09-13T06:42:17.394 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 115.750246117, 2024-09-13T06:42:17.394 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.080339496999999996, 2024-09-13T06:42:17.394 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:17.394 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:17.395 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:17.395 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:17.395 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:17.395 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43300 2024-09-13T06:42:17.395 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.395 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:17.395 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.395 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:17.395 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589909+0000", 2024-09-13T06:42:17.395 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:17.395 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.395 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.395 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:17.395 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589909+0000", 2024-09-13T06:42:17.395 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:17.396 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.396 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.396 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:17.396 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589908+0000", 2024-09-13T06:42:17.396 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:42:17.396 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.396 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.396 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:17.396 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589912+0000", 2024-09-13T06:42:17.396 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.9430000000000002e-06 2024-09-13T06:42:17.396 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.396 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.396 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:17.396 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589920+0000", 2024-09-13T06:42:17.396 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.3860000000000007e-06 2024-09-13T06:42:17.397 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.397 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.397 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:17.397 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589928+0000", 2024-09-13T06:42:17.397 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.3329999999999999e-06 2024-09-13T06:42:17.397 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.397 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.397 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:17.397 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.669651+0000", 2024-09-13T06:42:17.397 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.079723204000000006 2024-09-13T06:42:17.397 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.398 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.398 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:17.398 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.669840+0000", 2024-09-13T06:42:17.398 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000189397 2024-09-13T06:42:17.398 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.398 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.398 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:17.398 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.670248+0000", 2024-09-13T06:42:17.398 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00040811100000000001 2024-09-13T06:42:17.398 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:17.398 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:17.398 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:17.398 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.398 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.399 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43301 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 460800~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:42:17.399 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589934+0000", 2024-09-13T06:42:17.399 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 115.750221443, 2024-09-13T06:42:17.399 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.080747474999999999, 2024-09-13T06:42:17.399 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:17.399 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:17.399 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:17.399 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:17.399 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:17.399 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43301 2024-09-13T06:42:17.399 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.399 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:17.399 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.399 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:17.400 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589934+0000", 2024-09-13T06:42:17.400 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:17.400 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.400 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.400 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:17.400 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589934+0000", 2024-09-13T06:42:17.400 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:17.400 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.400 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.400 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:17.400 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589933+0000", 2024-09-13T06:42:17.400 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:17.400 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.401 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.401 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:17.401 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589936+0000", 2024-09-13T06:42:17.401 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.4599999999999999e-06 2024-09-13T06:42:17.401 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.401 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.401 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:17.401 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589945+0000", 2024-09-13T06:42:17.401 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.2430000000000005e-06 2024-09-13T06:42:17.401 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.401 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.402 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:17.402 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589952+0000", 2024-09-13T06:42:17.402 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.3289999999999996e-06 2024-09-13T06:42:17.402 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.402 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.402 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:17.402 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.670280+0000", 2024-09-13T06:42:17.402 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.080328514000000004 2024-09-13T06:42:17.402 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.403 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.403 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:17.403 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.670376+0000", 2024-09-13T06:42:17.403 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.5752000000000001e-05 2024-09-13T06:42:17.403 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.403 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.403 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:17.403 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.670681+0000", 2024-09-13T06:42:17.403 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00030479699999999999 2024-09-13T06:42:17.403 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:17.403 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:17.403 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:17.403 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.403 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.404 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43302 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 475136~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:42:17.404 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589958+0000", 2024-09-13T06:42:17.404 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 115.75019738100001, 2024-09-13T06:42:17.404 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.081402394000000003, 2024-09-13T06:42:17.404 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:17.404 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:17.404 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:17.404 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:17.404 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:17.404 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43302 2024-09-13T06:42:17.405 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.405 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:17.405 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.405 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:17.405 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589958+0000", 2024-09-13T06:42:17.405 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:17.405 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.405 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.405 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:17.405 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589958+0000", 2024-09-13T06:42:17.405 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:17.405 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.405 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.406 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:17.406 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589957+0000", 2024-09-13T06:42:17.406 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:17.406 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.406 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.406 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:17.406 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589960+0000", 2024-09-13T06:42:17.406 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.4939999999999999e-06 2024-09-13T06:42:17.406 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.406 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.406 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:17.406 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589969+0000", 2024-09-13T06:42:17.406 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.3520000000000007e-06 2024-09-13T06:42:17.407 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.407 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.407 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:17.407 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589976+0000", 2024-09-13T06:42:17.407 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.3030000000000002e-06 2024-09-13T06:42:17.407 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.407 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.407 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:17.407 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.670765+0000", 2024-09-13T06:42:17.407 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.080789154000000002 2024-09-13T06:42:17.407 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.407 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.407 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:17.408 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.670960+0000", 2024-09-13T06:42:17.408 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00019464300000000001 2024-09-13T06:42:17.408 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.408 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.408 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:17.408 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.671360+0000", 2024-09-13T06:42:17.408 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00040005200000000002 2024-09-13T06:42:17.408 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:17.408 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:17.408 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:17.409 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.409 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.409 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43303 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 489472~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:42:17.409 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589985+0000", 2024-09-13T06:42:17.409 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 115.75017043299999, 2024-09-13T06:42:17.409 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.082024333000000005, 2024-09-13T06:42:17.409 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:17.409 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:17.409 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:17.409 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:17.409 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:17.409 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43303 2024-09-13T06:42:17.409 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.410 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:17.410 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.410 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:17.410 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589985+0000", 2024-09-13T06:42:17.410 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:17.410 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.410 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.410 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:17.410 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589985+0000", 2024-09-13T06:42:17.410 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:17.410 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.410 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.410 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:17.411 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589984+0000", 2024-09-13T06:42:17.411 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:42:17.411 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.411 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.411 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:17.411 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589987+0000", 2024-09-13T06:42:17.411 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.726e-06 2024-09-13T06:42:17.411 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.411 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.411 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:17.411 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589996+0000", 2024-09-13T06:42:17.411 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.5459999999999992e-06 2024-09-13T06:42:17.411 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.411 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.412 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:17.412 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590003+0000", 2024-09-13T06:42:17.412 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.4229999999999999e-06 2024-09-13T06:42:17.412 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.412 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.412 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:17.412 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.671426+0000", 2024-09-13T06:42:17.412 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.081422704999999998 2024-09-13T06:42:17.412 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.412 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.412 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:17.412 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.671615+0000", 2024-09-13T06:42:17.412 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000188875 2024-09-13T06:42:17.413 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.413 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.413 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:17.413 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.672009+0000", 2024-09-13T06:42:17.413 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000394015 2024-09-13T06:42:17.413 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:17.413 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:17.413 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:17.413 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.413 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.413 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43304 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 503808~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:42:17.413 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.590039+0000", 2024-09-13T06:42:17.413 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 115.750115888, 2024-09-13T06:42:17.413 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.082573880000000002, 2024-09-13T06:42:17.414 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:17.414 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:17.414 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:17.414 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:17.414 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:17.414 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43304 2024-09-13T06:42:17.414 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.414 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:17.414 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.414 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:17.414 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590039+0000", 2024-09-13T06:42:17.414 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:17.414 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.415 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.415 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:17.415 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590039+0000", 2024-09-13T06:42:17.415 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:17.415 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.415 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.415 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:17.415 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590038+0000", 2024-09-13T06:42:17.415 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:42:17.415 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.415 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.415 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:17.415 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590042+0000", 2024-09-13T06:42:17.416 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.9500000000000003e-06 2024-09-13T06:42:17.416 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.416 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.416 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:17.416 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590052+0000", 2024-09-13T06:42:17.416 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.3919999999999992e-06 2024-09-13T06:42:17.416 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.416 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.416 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:17.416 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590059+0000", 2024-09-13T06:42:17.416 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.7970000000000001e-06 2024-09-13T06:42:17.416 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.417 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.417 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:17.417 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.672078+0000", 2024-09-13T06:42:17.417 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.082018778000000001 2024-09-13T06:42:17.417 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.417 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.417 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:17.417 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.672266+0000", 2024-09-13T06:42:17.417 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00018807399999999999 2024-09-13T06:42:17.417 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.417 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.417 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:17.417 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.672613+0000", 2024-09-13T06:42:17.418 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00034677599999999997 2024-09-13T06:42:17.418 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:17.418 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:17.418 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:17.418 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.418 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.418 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43305 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 518144~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:42:17.418 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.590136+0000", 2024-09-13T06:42:17.418 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 115.7500187, 2024-09-13T06:42:17.418 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.082988206999999994, 2024-09-13T06:42:17.418 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:17.418 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:17.418 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:17.419 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:17.419 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:17.419 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43305 2024-09-13T06:42:17.419 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.419 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:17.419 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.419 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:17.419 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590136+0000", 2024-09-13T06:42:17.419 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:17.419 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.419 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.419 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:17.419 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590136+0000", 2024-09-13T06:42:17.419 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:17.420 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.420 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.420 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:17.420 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590135+0000", 2024-09-13T06:42:17.420 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:42:17.420 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.420 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.420 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:17.420 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590139+0000", 2024-09-13T06:42:17.420 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.9489999999999998e-06 2024-09-13T06:42:17.420 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.420 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.421 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:17.421 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590148+0000", 2024-09-13T06:42:17.421 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.9830000000000002e-06 2024-09-13T06:42:17.421 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.421 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.421 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:17.421 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590156+0000", 2024-09-13T06:42:17.421 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5229999999999998e-06 2024-09-13T06:42:17.421 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.421 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.421 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:17.421 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.672709+0000", 2024-09-13T06:42:17.421 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.082552886000000006 2024-09-13T06:42:17.422 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.422 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.422 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:17.422 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.672816+0000", 2024-09-13T06:42:17.422 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000107736 2024-09-13T06:42:17.422 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.422 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.422 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:17.422 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.673124+0000", 2024-09-13T06:42:17.422 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00030804900000000002 2024-09-13T06:42:17.422 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:17.422 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:17.423 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:17.423 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.423 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.423 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:66818 3.17 3.50afe697 (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e100)", 2024-09-13T06:42:17.423 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:53.498942+0000", 2024-09-13T06:42:17.423 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 83.841212514999995, 2024-09-13T06:42:17.423 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.011231284, 2024-09-13T06:42:17.423 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:17.423 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:42:17.423 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:17.423 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:17.423 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:17.423 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 66818 2024-09-13T06:42:17.424 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.424 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:17.424 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.424 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:17.424 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:53.498942+0000", 2024-09-13T06:42:17.424 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:17.424 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.424 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.424 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:17.424 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:53.498942+0000", 2024-09-13T06:42:17.424 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:17.424 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.424 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.425 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:17.425 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:53.498939+0000", 2024-09-13T06:42:17.425 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999967 2024-09-13T06:42:17.425 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.425 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.425 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:17.425 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:53.498954+0000", 2024-09-13T06:42:17.425 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5028000000000001e-05 2024-09-13T06:42:17.425 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.425 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.425 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:17.425 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:53.498986+0000", 2024-09-13T06:42:17.425 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.1993999999999999e-05 2024-09-13T06:42:17.425 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.426 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.426 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:17.426 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:53.499001+0000", 2024-09-13T06:42:17.426 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5166e-05 2024-09-13T06:42:17.426 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.426 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.426 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:17.426 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:53.505097+0000", 2024-09-13T06:42:17.426 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0060955610000000002 2024-09-13T06:42:17.426 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.426 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.426 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:42:17.426 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:53.505108+0000", 2024-09-13T06:42:17.426 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.084e-05 2024-09-13T06:42:17.427 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.427 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.427 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:17.427 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:54.510158+0000", 2024-09-13T06:42:17.427 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0050497549999999 2024-09-13T06:42:17.427 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.427 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.427 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:17.427 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:54.510174+0000", 2024-09-13T06:42:17.427 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6164e-05 2024-09-13T06:42:17.427 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:17.427 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:17.427 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:17.427 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.427 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.428 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:69764 3.2 3:47f10058:::rbd_data.11214956a993.0000000000000004:head [write-same] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e117)", 2024-09-13T06:42:17.428 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:41:11.371147+0000", 2024-09-13T06:42:17.428 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 65.969008204999994, 2024-09-13T06:42:17.428 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.03470167, 2024-09-13T06:42:17.428 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:17.428 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:42:17.428 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:17.428 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:17.428 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:17.428 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 69764 2024-09-13T06:42:17.428 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.428 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:17.428 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.428 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:17.429 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:11.371147+0000", 2024-09-13T06:42:17.429 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:17.429 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.429 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.429 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:17.429 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:11.371147+0000", 2024-09-13T06:42:17.429 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:17.429 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.429 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.429 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:17.429 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:11.371144+0000", 2024-09-13T06:42:17.429 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999967 2024-09-13T06:42:17.429 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.430 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.430 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:17.430 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:11.371161+0000", 2024-09-13T06:42:17.430 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7669e-05 2024-09-13T06:42:17.430 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.430 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.430 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:17.430 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:11.371198+0000", 2024-09-13T06:42:17.430 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.7014000000000002e-05 2024-09-13T06:42:17.430 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.430 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.430 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:17.430 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:11.371216+0000", 2024-09-13T06:42:17.430 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7425e-05 2024-09-13T06:42:17.430 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.431 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.431 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:17.431 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:11.371365+0000", 2024-09-13T06:42:17.431 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000149245 2024-09-13T06:42:17.431 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.431 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.431 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op must wait for map", 2024-09-13T06:42:17.431 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:11.371385+0000", 2024-09-13T06:42:17.431 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.0018999999999999e-05 2024-09-13T06:42:17.431 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.431 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.431 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:17.431 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:11.378406+0000", 2024-09-13T06:42:17.431 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0070207179999999996 2024-09-13T06:42:17.432 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.432 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.432 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:42:17.432 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:11.378429+0000", 2024-09-13T06:42:17.432 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.3453999999999999e-05 2024-09-13T06:42:17.432 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.432 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.432 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:17.432 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:12.405667+0000", 2024-09-13T06:42:17.432 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0272381690000001 2024-09-13T06:42:17.432 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.432 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.432 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:17.433 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:12.405848+0000", 2024-09-13T06:42:17.433 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00018112 2024-09-13T06:42:17.433 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:17.433 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:17.433 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:17.433 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.433 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.433 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:70346 3.16 3:69d35907:::rbd_object_map.11214956a993:head [read 0~36] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e122)", 2024-09-13T06:42:17.433 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:41:16.390917+0000", 2024-09-13T06:42:17.433 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 60.949238153000003, 2024-09-13T06:42:17.433 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.99327479799999996, 2024-09-13T06:42:17.433 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:17.433 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:17.433 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:17.433 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:17.434 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:17.434 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 70346 2024-09-13T06:42:17.434 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.434 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:17.434 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.434 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:17.434 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:16.390917+0000", 2024-09-13T06:42:17.434 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:17.434 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.434 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.434 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:17.434 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:16.390917+0000", 2024-09-13T06:42:17.434 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:17.434 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.435 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.435 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:17.435 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:16.390916+0000", 2024-09-13T06:42:17.435 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999986 2024-09-13T06:42:17.435 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.435 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.435 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:17.435 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:16.390922+0000", 2024-09-13T06:42:17.435 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.0480000000000004e-06 2024-09-13T06:42:17.435 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.435 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.435 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:17.435 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:16.390933+0000", 2024-09-13T06:42:17.436 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1387e-05 2024-09-13T06:42:17.436 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.436 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.436 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:17.436 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:16.390939+0000", 2024-09-13T06:42:17.436 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.8039999999999998e-06 2024-09-13T06:42:17.436 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.436 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.436 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:17.436 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:16.390983+0000", 2024-09-13T06:42:17.436 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.4663000000000003e-05 2024-09-13T06:42:17.436 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.436 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.436 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:42:17.437 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:16.390991+0000", 2024-09-13T06:42:17.437 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.8059999999999995e-06 2024-09-13T06:42:17.437 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.437 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.437 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:17.437 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:17.383624+0000", 2024-09-13T06:42:17.437 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.99263277299999997 2024-09-13T06:42:17.437 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.437 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.437 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:17.437 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:17.383891+0000", 2024-09-13T06:42:17.437 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00026717599999999999 2024-09-13T06:42:17.437 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.437 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.438 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:17.438 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:17.384192+0000", 2024-09-13T06:42:17.438 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00030047400000000001 2024-09-13T06:42:17.438 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:17.438 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:17.438 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:17.438 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:17.438 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:17.438 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:42:17.440 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-13T06:42:17.440 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:42:17.433+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:42:17.442 INFO:teuthology.orchestra.run.smithi081.stderr:nodeep-scrub is set 2024-09-13T06:42:17.540 INFO:tasks.ceph.osd.6.smithi139.stderr:2024-09-13T06:42:17.537+0000 7fcd02c5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26385) UID: 0 2024-09-13T06:42:17.607 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:42:17.608 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [], 2024-09-13T06:42:17.608 INFO:teuthology.orchestra.run.smithi139.stdout: "num_ops": 0 2024-09-13T06:42:17.608 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:42:17.623 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-13T06:42:17.665 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:42:17.661+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:42:17.742 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:42:17.737+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:42:17.788 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:42:17.789 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [], 2024-09-13T06:42:17.789 INFO:teuthology.orchestra.run.smithi139.stdout: "complaint_time": 30, 2024-09-13T06:42:17.789 INFO:teuthology.orchestra.run.smithi139.stdout: "num_blocked_ops": 0 2024-09-13T06:42:17.789 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:42:17.803 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-13T06:42:17.842 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:42:17.841+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:42:17.922 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:42:17.922 INFO:teuthology.orchestra.run.smithi139.stdout: "size": 20, 2024-09-13T06:42:17.922 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 600, 2024-09-13T06:42:17.922 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [ 2024-09-13T06:42:17.922 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.922 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27854 3.a 3:537b3559:::rbd_data.1121f2c5ee81.0000000000000016:13 [read 335872~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:42:17.922 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.658750+0000", 2024-09-13T06:42:17.922 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 141.261301635, 2024-09-13T06:42:17.923 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.037969532, 2024-09-13T06:42:17.923 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:17.923 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:17.923 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:17.923 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:17.923 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:17.923 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27854 2024-09-13T06:42:17.923 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.923 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:17.923 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.923 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:17.923 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658750+0000", 2024-09-13T06:42:17.923 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:17.924 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.924 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.924 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:17.924 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658750+0000", 2024-09-13T06:42:17.924 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:17.924 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.924 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.924 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:17.924 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658749+0000", 2024-09-13T06:42:17.924 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:17.924 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.924 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.924 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:17.924 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658757+0000", 2024-09-13T06:42:17.925 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.7389999999999999e-06 2024-09-13T06:42:17.925 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.925 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.925 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:17.925 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658763+0000", 2024-09-13T06:42:17.925 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.7769999999999999e-06 2024-09-13T06:42:17.925 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.925 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.925 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:17.925 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658767+0000", 2024-09-13T06:42:17.925 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.1749999999999998e-06 2024-09-13T06:42:17.925 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.925 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.926 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:17.926 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.696322+0000", 2024-09-13T06:42:17.926 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.037554772 2024-09-13T06:42:17.926 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.926 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.926 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:17.926 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.696418+0000", 2024-09-13T06:42:17.926 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6050000000000004e-05 2024-09-13T06:42:17.926 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.926 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.926 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:17.926 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.696719+0000", 2024-09-13T06:42:17.926 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00030138499999999999 2024-09-13T06:42:17.926 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:17.927 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:17.927 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:17.927 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.927 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.927 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27855 3.a 3:537b3559:::rbd_data.1121f2c5ee81.0000000000000016:13 [read 380928~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:42:17.927 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.658771+0000", 2024-09-13T06:42:17.927 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 141.26128039100001, 2024-09-13T06:42:17.927 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.038326354, 2024-09-13T06:42:17.927 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:17.927 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:17.927 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:17.927 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:17.927 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:17.927 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27855 2024-09-13T06:42:17.928 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.928 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:17.928 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.928 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:17.928 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658771+0000", 2024-09-13T06:42:17.928 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:17.928 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.928 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.928 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:17.928 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658771+0000", 2024-09-13T06:42:17.928 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:17.928 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.928 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.929 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:17.929 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658770+0000", 2024-09-13T06:42:17.929 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:17.929 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.929 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.929 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:17.929 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658772+0000", 2024-09-13T06:42:17.929 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.0930000000000001e-06 2024-09-13T06:42:17.929 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.929 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.929 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:17.929 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658778+0000", 2024-09-13T06:42:17.929 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.2730000000000002e-06 2024-09-13T06:42:17.930 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.930 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.930 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:17.930 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658782+0000", 2024-09-13T06:42:17.930 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0879999999999997e-06 2024-09-13T06:42:17.930 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.930 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.930 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:17.930 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.696770+0000", 2024-09-13T06:42:17.930 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.037988145000000001 2024-09-13T06:42:17.930 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.930 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.930 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:17.931 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.696852+0000", 2024-09-13T06:42:17.931 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.2039999999999994e-05 2024-09-13T06:42:17.931 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.931 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.931 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:17.931 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.697097+0000", 2024-09-13T06:42:17.931 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00024508800000000002 2024-09-13T06:42:17.931 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:17.931 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:17.931 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:17.931 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.931 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.931 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27856 3.a 3:537b3559:::rbd_data.1121f2c5ee81.0000000000000016:13 [read 405504~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:42:17.931 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.658786+0000", 2024-09-13T06:42:17.932 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 141.261265275, 2024-09-13T06:42:17.932 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.038736029999999998, 2024-09-13T06:42:17.932 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:17.932 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:17.932 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:17.932 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:17.932 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:17.932 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27856 2024-09-13T06:42:17.932 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.932 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:17.932 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.932 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:17.932 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658786+0000", 2024-09-13T06:42:17.932 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:17.933 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.933 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.933 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:17.933 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658786+0000", 2024-09-13T06:42:17.933 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:17.933 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.933 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.933 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:17.933 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658785+0000", 2024-09-13T06:42:17.933 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:17.933 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.933 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.933 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:17.934 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658787+0000", 2024-09-13T06:42:17.934 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.0040000000000002e-06 2024-09-13T06:42:17.934 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.934 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.934 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:17.934 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658793+0000", 2024-09-13T06:42:17.934 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.2410000000000003e-06 2024-09-13T06:42:17.934 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.934 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.934 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:17.934 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658797+0000", 2024-09-13T06:42:17.934 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.1330000000000001e-06 2024-09-13T06:42:17.934 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.934 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.934 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:17.934 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.697176+0000", 2024-09-13T06:42:17.935 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.038379074999999999 2024-09-13T06:42:17.935 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.935 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.935 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:17.935 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.697275+0000", 2024-09-13T06:42:17.935 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.8819000000000004e-05 2024-09-13T06:42:17.935 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.935 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.935 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:17.935 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.697522+0000", 2024-09-13T06:42:17.935 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00024719999999999999 2024-09-13T06:42:17.935 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:17.935 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:17.935 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:17.936 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.936 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.936 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27857 3.a 3:537b3559:::rbd_data.1121f2c5ee81.0000000000000016:13 [read 475136~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:42:17.936 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.658845+0000", 2024-09-13T06:42:17.936 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 141.26120627200001, 2024-09-13T06:42:17.936 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039112570999999999, 2024-09-13T06:42:17.936 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:17.936 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:17.936 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:17.936 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:17.936 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:17.936 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27857 2024-09-13T06:42:17.936 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.936 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:17.937 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.937 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:17.937 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658845+0000", 2024-09-13T06:42:17.937 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:17.937 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.937 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.937 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:17.937 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658845+0000", 2024-09-13T06:42:17.937 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:17.937 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.937 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.937 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:17.937 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658844+0000", 2024-09-13T06:42:17.937 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999986 2024-09-13T06:42:17.938 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.938 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.938 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:17.938 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658868+0000", 2024-09-13T06:42:17.938 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.4615000000000001e-05 2024-09-13T06:42:17.938 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.938 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.938 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:17.938 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658884+0000", 2024-09-13T06:42:17.938 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5401999999999999e-05 2024-09-13T06:42:17.938 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.938 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.938 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:17.938 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658896+0000", 2024-09-13T06:42:17.938 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2509e-05 2024-09-13T06:42:17.939 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.939 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.939 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:17.939 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.697571+0000", 2024-09-13T06:42:17.939 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.038675107 2024-09-13T06:42:17.939 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.939 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.939 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:17.939 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.697658+0000", 2024-09-13T06:42:17.939 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6349999999999998e-05 2024-09-13T06:42:17.939 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.939 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.939 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:17.939 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.697957+0000", 2024-09-13T06:42:17.939 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00029986100000000001 2024-09-13T06:42:17.940 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:17.940 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:17.940 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:17.940 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.940 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.940 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27858 3.a 3:537b3559:::rbd_data.1121f2c5ee81.0000000000000016:13 [read 499712~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:42:17.940 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.658905+0000", 2024-09-13T06:42:17.940 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 141.26114572200001, 2024-09-13T06:42:17.940 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039475392999999998, 2024-09-13T06:42:17.940 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:17.940 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:17.940 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:17.941 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:17.941 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:17.941 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27858 2024-09-13T06:42:17.941 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.941 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:17.941 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.941 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:17.941 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658905+0000", 2024-09-13T06:42:17.941 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:17.941 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.941 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.941 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:17.941 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658905+0000", 2024-09-13T06:42:17.941 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:17.941 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.942 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.942 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:17.942 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658905+0000", 2024-09-13T06:42:17.942 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:42:17.942 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.942 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.942 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:17.942 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658909+0000", 2024-09-13T06:42:17.942 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.831e-06 2024-09-13T06:42:17.942 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.942 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.942 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:17.942 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658920+0000", 2024-09-13T06:42:17.943 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0936e-05 2024-09-13T06:42:17.943 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.943 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.943 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:17.943 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658929+0000", 2024-09-13T06:42:17.943 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.2749999999999995e-06 2024-09-13T06:42:17.943 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.943 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.943 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:17.943 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.697990+0000", 2024-09-13T06:42:17.943 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039061625000000003 2024-09-13T06:42:17.943 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.943 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.944 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:17.944 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.698077+0000", 2024-09-13T06:42:17.944 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6922000000000006e-05 2024-09-13T06:42:17.944 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.944 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.944 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:17.944 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.698381+0000", 2024-09-13T06:42:17.944 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00030360599999999999 2024-09-13T06:42:17.944 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:17.944 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:17.944 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:17.944 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.944 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.944 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27929 3.a 3:537b3559:::rbd_data.1121f2c5ee81.0000000000000016:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:42:17.945 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.659338+0000", 2024-09-13T06:42:17.945 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 141.260712891, 2024-09-13T06:42:17.945 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039351214000000002, 2024-09-13T06:42:17.945 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:17.945 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:17.945 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:17.945 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:17.945 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:17.945 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27929 2024-09-13T06:42:17.945 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.945 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:17.945 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.945 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:17.945 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.659338+0000", 2024-09-13T06:42:17.946 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:17.946 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.946 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.946 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:17.946 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.659338+0000", 2024-09-13T06:42:17.946 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:17.946 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.946 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.946 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:17.946 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.659337+0000", 2024-09-13T06:42:17.946 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:42:17.946 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.946 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.946 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:17.947 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.659342+0000", 2024-09-13T06:42:17.947 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0799999999999999e-06 2024-09-13T06:42:17.947 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.947 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.947 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:17.947 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.659353+0000", 2024-09-13T06:42:17.947 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1798e-05 2024-09-13T06:42:17.947 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.947 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.947 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:17.947 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.659361+0000", 2024-09-13T06:42:17.947 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.8040000000000002e-06 2024-09-13T06:42:17.947 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.948 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.948 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:17.948 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.698449+0000", 2024-09-13T06:42:17.948 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039087519000000001 2024-09-13T06:42:17.948 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.948 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.948 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:17.948 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.698567+0000", 2024-09-13T06:42:17.948 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00011857 2024-09-13T06:42:17.948 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.948 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.948 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:17.948 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.698689+0000", 2024-09-13T06:42:17.948 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00012226699999999999 2024-09-13T06:42:17.948 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:17.949 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:17.949 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:17.949 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.949 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.949 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27974 3.a 3:537b3559:::rbd_data.1121f2c5ee81.0000000000000016:13 [read 32768~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:42:17.949 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.660102+0000", 2024-09-13T06:42:17.949 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 141.25994912300001, 2024-09-13T06:42:17.949 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.038972346999999997, 2024-09-13T06:42:17.949 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:17.949 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:17.949 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:17.949 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:17.949 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:17.949 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27974 2024-09-13T06:42:17.950 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.950 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:17.950 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.950 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:17.950 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660102+0000", 2024-09-13T06:42:17.950 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:17.950 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.950 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.950 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:17.950 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660102+0000", 2024-09-13T06:42:17.950 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:17.950 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.950 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.951 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:17.951 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660100+0000", 2024-09-13T06:42:17.951 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999976 2024-09-13T06:42:17.951 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.951 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.951 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:17.951 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660114+0000", 2024-09-13T06:42:17.951 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.4466e-05 2024-09-13T06:42:17.951 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.951 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.951 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:17.951 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660148+0000", 2024-09-13T06:42:17.951 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.3742999999999999e-05 2024-09-13T06:42:17.952 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.952 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.952 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:17.952 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660170+0000", 2024-09-13T06:42:17.952 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.2518e-05 2024-09-13T06:42:17.952 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.952 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.952 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:17.952 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.698719+0000", 2024-09-13T06:42:17.952 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.038548529999999998 2024-09-13T06:42:17.952 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.952 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.952 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:17.953 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.698806+0000", 2024-09-13T06:42:17.953 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.7179e-05 2024-09-13T06:42:17.953 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.953 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.953 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:17.953 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.699074+0000", 2024-09-13T06:42:17.953 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00026834800000000001 2024-09-13T06:42:17.953 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:17.953 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:17.953 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:17.953 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.953 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.953 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27975 3.a 3:537b3559:::rbd_data.1121f2c5ee81.0000000000000016:13 [read 57344~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:42:17.954 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.660189+0000", 2024-09-13T06:42:17.954 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 141.259862279, 2024-09-13T06:42:17.954 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039288678, 2024-09-13T06:42:17.954 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:17.954 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:17.954 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:17.954 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:17.954 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:17.954 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27975 2024-09-13T06:42:17.954 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.954 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:17.954 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.954 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:17.954 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660189+0000", 2024-09-13T06:42:17.955 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:17.955 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.955 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.955 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:17.955 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660189+0000", 2024-09-13T06:42:17.955 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:17.955 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.955 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.955 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:17.955 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660187+0000", 2024-09-13T06:42:17.955 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999981 2024-09-13T06:42:17.955 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.955 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.955 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:17.955 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660195+0000", 2024-09-13T06:42:17.955 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5610000000000001e-06 2024-09-13T06:42:17.956 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.956 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.956 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:17.956 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660212+0000", 2024-09-13T06:42:17.956 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7725999999999999e-05 2024-09-13T06:42:17.956 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.956 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.956 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:17.956 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660227+0000", 2024-09-13T06:42:17.956 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.43e-05 2024-09-13T06:42:17.956 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.956 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.956 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:17.957 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.699135+0000", 2024-09-13T06:42:17.957 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.038908336000000002 2024-09-13T06:42:17.957 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.957 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.957 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:17.957 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.699208+0000", 2024-09-13T06:42:17.957 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.3065000000000006e-05 2024-09-13T06:42:17.957 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.957 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.957 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:17.957 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.699478+0000", 2024-09-13T06:42:17.957 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00026946899999999999 2024-09-13T06:42:17.957 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:17.958 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:17.958 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:17.958 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.958 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.958 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27976 3.a 3:537b3559:::rbd_data.1121f2c5ee81.0000000000000016:13 [read 102400~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:42:17.958 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.660238+0000", 2024-09-13T06:42:17.958 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 141.259813116, 2024-09-13T06:42:17.958 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039636515999999997, 2024-09-13T06:42:17.958 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:17.958 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:17.958 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:17.958 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:17.958 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:17.958 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27976 2024-09-13T06:42:17.959 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.959 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:17.959 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.959 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:17.959 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660238+0000", 2024-09-13T06:42:17.959 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:17.959 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.959 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.959 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:17.959 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660238+0000", 2024-09-13T06:42:17.959 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:17.959 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.959 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.959 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:17.959 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660237+0000", 2024-09-13T06:42:17.960 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:42:17.960 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.960 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.960 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:17.960 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660243+0000", 2024-09-13T06:42:17.960 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.9909999999999999e-06 2024-09-13T06:42:17.960 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.960 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.960 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:17.960 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660259+0000", 2024-09-13T06:42:17.960 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6294e-05 2024-09-13T06:42:17.960 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.960 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.960 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:17.961 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660272+0000", 2024-09-13T06:42:17.961 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2714999999999999e-05 2024-09-13T06:42:17.961 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.961 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.961 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:17.961 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.699513+0000", 2024-09-13T06:42:17.961 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039240932999999999 2024-09-13T06:42:17.961 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.961 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.961 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:17.961 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.699604+0000", 2024-09-13T06:42:17.961 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.1367999999999997e-05 2024-09-13T06:42:17.961 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.961 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.961 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:17.962 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.699875+0000", 2024-09-13T06:42:17.962 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00027029499999999999 2024-09-13T06:42:17.962 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:17.962 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:17.962 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:17.962 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.962 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.962 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27977 3.a 3:537b3559:::rbd_data.1121f2c5ee81.0000000000000016:13 [read 126976~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:42:17.962 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.660284+0000", 2024-09-13T06:42:17.962 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 141.259767544, 2024-09-13T06:42:17.962 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039969945, 2024-09-13T06:42:17.962 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:17.962 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:17.962 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:17.963 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:17.963 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:17.963 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27977 2024-09-13T06:42:17.963 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.963 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:17.963 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.963 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:17.963 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660284+0000", 2024-09-13T06:42:17.963 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:17.963 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.963 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.963 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:17.963 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660284+0000", 2024-09-13T06:42:17.963 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:17.964 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.964 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.964 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:17.964 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660282+0000", 2024-09-13T06:42:17.964 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999986 2024-09-13T06:42:17.964 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.964 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.964 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:17.964 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660288+0000", 2024-09-13T06:42:17.964 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.2650000000000002e-06 2024-09-13T06:42:17.964 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.964 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.965 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:17.965 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660304+0000", 2024-09-13T06:42:17.965 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5430999999999998e-05 2024-09-13T06:42:17.965 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.965 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.965 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:17.965 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660316+0000", 2024-09-13T06:42:17.965 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.237e-05 2024-09-13T06:42:17.965 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.965 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.965 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:17.965 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.699907+0000", 2024-09-13T06:42:17.965 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039590735000000002 2024-09-13T06:42:17.966 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.966 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.966 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:17.966 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.699994+0000", 2024-09-13T06:42:17.966 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6996999999999994e-05 2024-09-13T06:42:17.966 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.966 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.966 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:17.966 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700254+0000", 2024-09-13T06:42:17.966 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000259564 2024-09-13T06:42:17.966 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:17.966 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:17.966 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:17.966 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.967 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.967 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27978 3.a 3.9aacdeca (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:42:17.967 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.660327+0000", 2024-09-13T06:42:17.967 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 141.25972394600001, 2024-09-13T06:42:17.967 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039984858999999998, 2024-09-13T06:42:17.967 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:17.967 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:42:17.967 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:17.967 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:17.967 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:17.967 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27978 2024-09-13T06:42:17.967 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.967 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:17.967 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.967 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:17.968 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660327+0000", 2024-09-13T06:42:17.968 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:17.968 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.968 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.968 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:17.968 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660327+0000", 2024-09-13T06:42:17.968 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:17.968 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.968 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.968 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:17.968 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660326+0000", 2024-09-13T06:42:17.968 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:42:17.968 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.969 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.969 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:17.969 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660366+0000", 2024-09-13T06:42:17.969 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.9691000000000003e-05 2024-09-13T06:42:17.969 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.969 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.969 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:17.969 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660399+0000", 2024-09-13T06:42:17.969 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.3262000000000001e-05 2024-09-13T06:42:17.969 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.969 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.969 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:17.969 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660414+0000", 2024-09-13T06:42:17.970 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.4775e-05 2024-09-13T06:42:17.970 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.970 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.970 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:17.970 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700298+0000", 2024-09-13T06:42:17.970 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039883759999999997 2024-09-13T06:42:17.970 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.970 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.970 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:17.970 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700312+0000", 2024-09-13T06:42:17.970 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.4374e-05 2024-09-13T06:42:17.970 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:17.970 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:17.970 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:17.970 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.971 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.971 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27979 3.a 3.9aacdeca (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:42:17.971 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.660429+0000", 2024-09-13T06:42:17.971 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 141.25962207800001, 2024-09-13T06:42:17.971 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039921361000000002, 2024-09-13T06:42:17.971 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:17.971 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:42:17.971 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:17.971 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:17.971 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:17.971 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27979 2024-09-13T06:42:17.971 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.971 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:17.971 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.971 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:17.972 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660429+0000", 2024-09-13T06:42:17.972 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:17.972 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.972 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.972 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:17.972 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660429+0000", 2024-09-13T06:42:17.972 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:17.972 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.972 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.972 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:17.972 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660428+0000", 2024-09-13T06:42:17.972 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999986 2024-09-13T06:42:17.972 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.972 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.973 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:17.973 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660434+0000", 2024-09-13T06:42:17.973 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.8190000000000003e-06 2024-09-13T06:42:17.973 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.973 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.973 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:17.973 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660451+0000", 2024-09-13T06:42:17.973 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6963e-05 2024-09-13T06:42:17.973 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.973 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.973 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:17.973 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660485+0000", 2024-09-13T06:42:17.973 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.3414000000000002e-05 2024-09-13T06:42:17.973 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.974 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.974 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:17.974 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700342+0000", 2024-09-13T06:42:17.974 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039857278000000003 2024-09-13T06:42:17.974 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.974 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.974 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:17.974 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700350+0000", 2024-09-13T06:42:17.974 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.2930000000000001e-06 2024-09-13T06:42:17.974 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:17.974 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:17.974 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:17.974 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.974 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.975 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27980 3.a 3.9aacdeca (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:42:17.975 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.660497+0000", 2024-09-13T06:42:17.975 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 141.25955386699999, 2024-09-13T06:42:17.975 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039888034000000003, 2024-09-13T06:42:17.975 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:17.975 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:42:17.975 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:17.975 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:17.975 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:17.975 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27980 2024-09-13T06:42:17.975 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.975 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:17.975 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.975 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:17.976 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660497+0000", 2024-09-13T06:42:17.976 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:17.976 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.976 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.976 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:17.976 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660497+0000", 2024-09-13T06:42:17.976 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:17.976 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.976 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.976 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:17.976 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660496+0000", 2024-09-13T06:42:17.976 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:42:17.977 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.977 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.977 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:17.977 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660503+0000", 2024-09-13T06:42:17.977 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.4110000000000001e-06 2024-09-13T06:42:17.977 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.977 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.977 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:17.977 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660519+0000", 2024-09-13T06:42:17.977 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6180000000000001e-05 2024-09-13T06:42:17.977 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.977 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.977 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:17.978 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660544+0000", 2024-09-13T06:42:17.978 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.5177999999999998e-05 2024-09-13T06:42:17.978 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.978 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.978 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:17.978 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700377+0000", 2024-09-13T06:42:17.978 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039833434000000001 2024-09-13T06:42:17.978 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.978 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.978 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:17.978 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700385+0000", 2024-09-13T06:42:17.978 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.8800000000000008e-06 2024-09-13T06:42:17.978 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:17.978 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:17.979 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:17.979 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.979 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.979 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27981 3.a 3.9aacdeca (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:42:17.979 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.660556+0000", 2024-09-13T06:42:17.979 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 141.25949552099999, 2024-09-13T06:42:17.979 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039869989000000002, 2024-09-13T06:42:17.979 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:17.979 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:42:17.979 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:17.979 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:17.979 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:17.979 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27981 2024-09-13T06:42:17.979 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.979 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:17.980 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.980 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:17.980 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660556+0000", 2024-09-13T06:42:17.980 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:17.980 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.980 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.980 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:17.980 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660556+0000", 2024-09-13T06:42:17.980 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:17.980 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.980 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.980 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:17.980 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660555+0000", 2024-09-13T06:42:17.980 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:42:17.981 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.981 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.981 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:17.981 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660561+0000", 2024-09-13T06:42:17.981 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.088e-06 2024-09-13T06:42:17.981 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.981 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.981 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:17.981 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660577+0000", 2024-09-13T06:42:17.981 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6147999999999999e-05 2024-09-13T06:42:17.981 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.981 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.981 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:17.981 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660589+0000", 2024-09-13T06:42:17.982 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2551999999999999e-05 2024-09-13T06:42:17.982 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.982 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.982 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:17.982 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700414+0000", 2024-09-13T06:42:17.982 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039825007000000003 2024-09-13T06:42:17.982 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.982 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.982 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:17.982 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700426+0000", 2024-09-13T06:42:17.982 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1265e-05 2024-09-13T06:42:17.982 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:17.983 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:17.983 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:17.983 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.983 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.983 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27982 3.a 3.9aacdeca (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:42:17.983 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.660603+0000", 2024-09-13T06:42:17.983 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 141.25944792600001, 2024-09-13T06:42:17.983 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039874779999999999, 2024-09-13T06:42:17.983 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:17.983 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:42:17.983 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:17.983 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:17.983 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:17.984 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27982 2024-09-13T06:42:17.984 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.984 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:17.984 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.984 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:17.984 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660603+0000", 2024-09-13T06:42:17.984 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:17.984 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.984 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.984 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:17.984 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660603+0000", 2024-09-13T06:42:17.985 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:17.985 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.985 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.985 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:17.985 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660602+0000", 2024-09-13T06:42:17.985 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:42:17.985 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.985 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.985 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:17.985 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660653+0000", 2024-09-13T06:42:17.985 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.0862000000000002e-05 2024-09-13T06:42:17.985 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.986 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.986 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:17.986 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660697+0000", 2024-09-13T06:42:17.986 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.3773000000000003e-05 2024-09-13T06:42:17.986 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.986 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.986 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:17.986 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660712+0000", 2024-09-13T06:42:17.986 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5464999999999998e-05 2024-09-13T06:42:17.986 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.986 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.986 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:17.987 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700469+0000", 2024-09-13T06:42:17.987 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039756503999999998 2024-09-13T06:42:17.987 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.987 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.987 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:17.987 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700478+0000", 2024-09-13T06:42:17.987 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.1730000000000001e-06 2024-09-13T06:42:17.987 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:17.987 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:17.987 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:17.987 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.987 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.987 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27983 3.a 3.9aacdeca (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:42:17.987 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.660726+0000", 2024-09-13T06:42:17.988 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 141.25932465099999, 2024-09-13T06:42:17.988 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039804357999999998, 2024-09-13T06:42:17.988 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:17.988 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:42:17.988 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:17.988 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:17.988 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:17.988 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27983 2024-09-13T06:42:17.988 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.988 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:17.988 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.988 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:17.989 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660726+0000", 2024-09-13T06:42:17.989 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:17.989 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.989 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.989 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:17.989 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660726+0000", 2024-09-13T06:42:17.989 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:17.989 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.989 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.989 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:17.989 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660725+0000", 2024-09-13T06:42:17.989 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999986 2024-09-13T06:42:17.989 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.990 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.990 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:17.990 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660733+0000", 2024-09-13T06:42:17.990 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.9359999999999999e-06 2024-09-13T06:42:17.990 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.990 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.990 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:17.990 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660751+0000", 2024-09-13T06:42:17.990 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7679000000000001e-05 2024-09-13T06:42:17.990 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.990 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.990 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:17.990 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660764+0000", 2024-09-13T06:42:17.990 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3112000000000001e-05 2024-09-13T06:42:17.991 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.991 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.991 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:17.991 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700516+0000", 2024-09-13T06:42:17.991 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039752183000000003 2024-09-13T06:42:17.991 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.991 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.991 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:17.991 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700531+0000", 2024-09-13T06:42:17.991 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.4732999999999999e-05 2024-09-13T06:42:17.991 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:17.991 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:17.991 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:17.991 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.991 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.992 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27984 3.a 3.9aacdeca (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:42:17.992 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.660776+0000", 2024-09-13T06:42:17.992 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 141.25927554800001, 2024-09-13T06:42:17.992 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039795697999999997, 2024-09-13T06:42:17.992 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:17.992 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:42:17.992 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:17.992 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:17.992 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:17.992 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27984 2024-09-13T06:42:17.992 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.992 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:17.992 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.992 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:17.993 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660776+0000", 2024-09-13T06:42:17.993 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:17.993 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.993 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.993 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:17.993 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660776+0000", 2024-09-13T06:42:17.993 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:17.993 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.993 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.993 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:17.993 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660775+0000", 2024-09-13T06:42:17.993 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:42:17.994 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.994 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.994 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:17.994 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660780+0000", 2024-09-13T06:42:17.994 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.7849999999999997e-06 2024-09-13T06:42:17.994 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.994 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.994 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:17.994 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660799+0000", 2024-09-13T06:42:17.994 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.8794e-05 2024-09-13T06:42:17.994 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.994 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.994 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:17.994 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660812+0000", 2024-09-13T06:42:17.994 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3029e-05 2024-09-13T06:42:17.995 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.995 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.995 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:17.995 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700562+0000", 2024-09-13T06:42:17.995 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039749984000000002 2024-09-13T06:42:17.995 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.995 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.995 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:17.995 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700571+0000", 2024-09-13T06:42:17.995 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.1260000000000004e-06 2024-09-13T06:42:17.995 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:17.995 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:17.995 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:17.995 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.996 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.996 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27985 3.a 3.9aacdeca (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:42:17.996 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.660824+0000", 2024-09-13T06:42:17.996 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 141.25922749599999, 2024-09-13T06:42:17.996 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039784462, 2024-09-13T06:42:17.996 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:17.996 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:42:17.996 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:17.996 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:17.996 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:17.996 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27985 2024-09-13T06:42:17.996 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.996 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:17.996 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.997 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:17.997 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660824+0000", 2024-09-13T06:42:17.997 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:17.997 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.997 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.997 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:17.997 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660824+0000", 2024-09-13T06:42:17.997 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:17.997 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.997 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.997 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:17.997 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660823+0000", 2024-09-13T06:42:17.997 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:42:17.997 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.998 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.998 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:17.998 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660829+0000", 2024-09-13T06:42:17.998 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.9440000000000002e-06 2024-09-13T06:42:17.998 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.998 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.998 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:17.998 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660922+0000", 2024-09-13T06:42:17.998 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.2958e-05 2024-09-13T06:42:17.998 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.998 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.998 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:17.998 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660964+0000", 2024-09-13T06:42:17.998 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.2407000000000002e-05 2024-09-13T06:42:17.998 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.999 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.999 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:17.999 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700600+0000", 2024-09-13T06:42:17.999 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039635581000000003 2024-09-13T06:42:17.999 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.999 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.999 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:17.999 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700608+0000", 2024-09-13T06:42:17.999 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.5890000000000003e-06 2024-09-13T06:42:17.999 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:17.999 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:17.999 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:17.999 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:17.999 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:17.999 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:28023 3.10 3:0dedc28a:::rbd_data.1121f2c5ee81.0000000000000019:13 [read 475136~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:42:18.000 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.662072+0000", 2024-09-13T06:42:18.000 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 141.257979511, 2024-09-13T06:42:18.000 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.038086508999999998, 2024-09-13T06:42:18.000 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:18.000 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:18.000 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:18.000 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:18.000 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:18.000 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 28023 2024-09-13T06:42:18.000 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:18.000 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:18.000 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:18.000 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:18.000 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.662072+0000", 2024-09-13T06:42:18.000 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:18.001 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:18.001 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:18.001 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:18.001 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.662072+0000", 2024-09-13T06:42:18.001 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:18.001 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:18.001 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:18.001 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:18.001 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.662070+0000", 2024-09-13T06:42:18.001 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999986 2024-09-13T06:42:18.001 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:18.001 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:18.001 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:18.001 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.662076+0000", 2024-09-13T06:42:18.001 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.139e-06 2024-09-13T06:42:18.002 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:18.002 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:18.002 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:18.002 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.662094+0000", 2024-09-13T06:42:18.002 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7136999999999999e-05 2024-09-13T06:42:18.002 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:18.002 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:18.002 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:18.002 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.662124+0000", 2024-09-13T06:42:18.002 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.0528999999999999e-05 2024-09-13T06:42:18.002 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:18.002 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:18.002 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:18.002 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.699843+0000", 2024-09-13T06:42:18.002 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.037718415999999998 2024-09-13T06:42:18.003 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:18.003 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:18.003 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:18.003 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.699931+0000", 2024-09-13T06:42:18.003 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.8345999999999997e-05 2024-09-13T06:42:18.003 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:18.003 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:18.003 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:18.003 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700158+0000", 2024-09-13T06:42:18.003 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00022723099999999999 2024-09-13T06:42:18.003 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:18.003 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:18.003 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:18.003 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:18.004 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:18.004 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:28024 3.10 3.5143b7b0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:42:18.004 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.662137+0000", 2024-09-13T06:42:18.004 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 141.257913989, 2024-09-13T06:42:18.004 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.038056092999999999, 2024-09-13T06:42:18.004 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:18.004 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:42:18.004 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:18.004 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:18.004 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:18.004 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 28024 2024-09-13T06:42:18.004 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:18.004 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:18.004 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:18.005 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:18.005 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.662137+0000", 2024-09-13T06:42:18.005 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:18.005 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:18.005 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:18.005 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:18.005 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.662137+0000", 2024-09-13T06:42:18.005 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:18.005 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:18.005 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:18.005 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:18.005 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.662136+0000", 2024-09-13T06:42:18.005 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999986 2024-09-13T06:42:18.005 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:18.005 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:18.006 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:18.006 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.662142+0000", 2024-09-13T06:42:18.006 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.6930000000000001e-06 2024-09-13T06:42:18.006 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:18.006 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:18.006 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:18.006 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.662160+0000", 2024-09-13T06:42:18.006 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7863000000000002e-05 2024-09-13T06:42:18.006 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:18.006 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:18.006 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:18.006 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.662189+0000", 2024-09-13T06:42:18.006 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.8486000000000001e-05 2024-09-13T06:42:18.006 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:18.006 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:18.007 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:18.007 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700187+0000", 2024-09-13T06:42:18.007 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.037998331000000003 2024-09-13T06:42:18.007 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:18.007 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:18.007 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:18.007 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700193+0000", 2024-09-13T06:42:18.007 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.0909999999999998e-06 2024-09-13T06:42:18.007 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:18.007 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:18.007 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:18.007 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:18.007 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:18.007 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:42:18.009 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-13T06:42:18.009 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:42:18.005+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:42:18.110 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:42:18.105+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:42:18.142 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:42:18.142 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-13T06:42:18.142 INFO:teuthology.orchestra.run.smithi081.stdout: "num_ops": 0 2024-09-13T06:42:18.142 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:42:18.156 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-13T06:42:18.211 INFO:tasks.ceph.osd.6.smithi139.stderr:2024-09-13T06:42:18.205+0000 7fcd02c5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26385) UID: 0 2024-09-13T06:42:18.312 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:42:18.309+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:42:18.322 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:42:18.322 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-13T06:42:18.322 INFO:teuthology.orchestra.run.smithi081.stdout: "complaint_time": 30, 2024-09-13T06:42:18.323 INFO:teuthology.orchestra.run.smithi081.stdout: "num_blocked_ops": 0 2024-09-13T06:42:18.323 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:42:18.337 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-13T06:42:18.413 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:42:18.409+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:42:18.472 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:42:18.472 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 20, 2024-09-13T06:42:18.472 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 600, 2024-09-13T06:42:18.472 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [ 2024-09-13T06:42:18.472 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:18.472 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:37801 3.1 3:82e31015:::rbd_object_map.1121d8143c6e.0000000000000019:head [call] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e55)", 2024-09-13T06:42:18.472 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:05.646191+0000", 2024-09-13T06:42:18.472 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 132.82430449700001, 2024-09-13T06:42:18.472 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.72659507800000001, 2024-09-13T06:42:18.472 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:18.473 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:18.473 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:18.473 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:18.473 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:18.473 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 37801 2024-09-13T06:42:18.473 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:18.473 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:18.473 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:18.473 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:18.473 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:05.646191+0000", 2024-09-13T06:42:18.473 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:18.473 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:18.473 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:18.474 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:18.474 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:05.646191+0000", 2024-09-13T06:42:18.474 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:18.474 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:18.474 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:18.474 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:18.474 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:05.646188+0000", 2024-09-13T06:42:18.474 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999971 2024-09-13T06:42:18.474 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:18.474 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:18.474 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:18.474 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:05.646206+0000", 2024-09-13T06:42:18.474 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8182999999999999e-05 2024-09-13T06:42:18.475 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:18.475 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:18.475 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:18.475 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:05.646237+0000", 2024-09-13T06:42:18.475 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.1071000000000001e-05 2024-09-13T06:42:18.475 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:18.475 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:18.475 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:18.475 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:05.646251+0000", 2024-09-13T06:42:18.475 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3679000000000001e-05 2024-09-13T06:42:18.475 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:18.475 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:18.475 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:18.476 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:05.646321+0000", 2024-09-13T06:42:18.476 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.9831000000000003e-05 2024-09-13T06:42:18.476 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:18.476 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:18.476 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:42:18.476 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:05.646331+0000", 2024-09-13T06:42:18.476 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0242e-05 2024-09-13T06:42:18.476 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:18.476 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:18.476 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:18.476 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.371959+0000", 2024-09-13T06:42:18.476 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.72562817199999996 2024-09-13T06:42:18.477 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:18.477 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:18.477 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:18.477 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.372389+0000", 2024-09-13T06:42:18.477 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00042977400000000001 2024-09-13T06:42:18.477 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:18.477 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:18.477 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:18.477 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.372786+0000", 2024-09-13T06:42:18.477 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00039706099999999999 2024-09-13T06:42:18.477 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:18.478 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:18.478 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:18.478 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:18.478 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:18.478 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43009 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 489472~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:42:18.478 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.644660+0000", 2024-09-13T06:42:18.478 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 116.825835535, 2024-09-13T06:42:18.478 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123376071, 2024-09-13T06:42:18.478 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:18.478 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:18.478 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:18.478 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:18.478 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:18.478 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43009 2024-09-13T06:42:18.479 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:18.479 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:18.479 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:18.479 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:18.479 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.644660+0000", 2024-09-13T06:42:18.479 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:18.479 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:18.479 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:18.479 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:18.479 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.644660+0000", 2024-09-13T06:42:18.480 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:18.480 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:18.480 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:18.480 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:18.480 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.644659+0000", 2024-09-13T06:42:18.480 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:18.480 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:18.480 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:18.480 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:18.480 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.644662+0000", 2024-09-13T06:42:18.480 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4949999999999998e-06 2024-09-13T06:42:18.480 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:18.480 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:18.481 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:18.481 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.644669+0000", 2024-09-13T06:42:18.481 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.289e-06 2024-09-13T06:42:18.481 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:18.481 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:18.481 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:18.481 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.644674+0000", 2024-09-13T06:42:18.481 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.8840000000000002e-06 2024-09-13T06:42:18.481 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:18.481 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:18.481 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:18.481 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.767602+0000", 2024-09-13T06:42:18.481 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.122928158 2024-09-13T06:42:18.482 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:18.482 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:18.482 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:18.482 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.767676+0000", 2024-09-13T06:42:18.482 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3992999999999994e-05 2024-09-13T06:42:18.482 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:18.482 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:18.482 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:18.482 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.768036+0000", 2024-09-13T06:42:18.482 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00035966200000000001 2024-09-13T06:42:18.482 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:18.482 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:18.483 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:18.483 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:18.483 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:18.483 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43010 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 503808~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:42:18.483 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.644678+0000", 2024-09-13T06:42:18.483 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 116.82581720899999, 2024-09-13T06:42:18.483 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123728798, 2024-09-13T06:42:18.483 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:18.483 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:18.483 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:18.483 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:18.483 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:18.483 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43010 2024-09-13T06:42:18.484 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:18.484 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:18.484 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:18.484 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:18.484 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.644678+0000", 2024-09-13T06:42:18.484 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:18.484 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:18.484 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:18.484 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:18.484 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.644678+0000", 2024-09-13T06:42:18.485 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:18.485 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:18.485 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:18.485 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:18.485 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.644678+0000", 2024-09-13T06:42:18.485 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:18.485 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:18.485 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:18.485 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:18.485 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.644680+0000", 2024-09-13T06:42:18.485 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2050000000000001e-06 2024-09-13T06:42:18.486 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:18.486 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:18.486 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:18.486 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.644686+0000", 2024-09-13T06:42:18.486 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8440000000000003e-06 2024-09-13T06:42:18.486 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:18.486 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:18.486 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:18.486 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.644691+0000", 2024-09-13T06:42:18.486 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.118e-06 2024-09-13T06:42:18.487 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:18.487 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:18.487 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:18.487 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.768065+0000", 2024-09-13T06:42:18.487 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123374698 2024-09-13T06:42:18.487 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:18.487 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:18.487 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:18.487 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.768139+0000", 2024-09-13T06:42:18.487 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3934000000000001e-05 2024-09-13T06:42:18.487 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:18.488 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:18.488 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:18.488 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.768407+0000", 2024-09-13T06:42:18.488 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00026738800000000002 2024-09-13T06:42:18.488 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:18.488 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:18.488 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:18.488 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:18.488 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:18.488 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43181 3.17 3:ec5ebce4:::rbd_data.1121f5f2e1c0.0000000000000001:1f [read 319488~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:42:18.488 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.652968+0000", 2024-09-13T06:42:18.488 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 116.817526693, 2024-09-13T06:42:18.489 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.12363807, 2024-09-13T06:42:18.489 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:18.489 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:18.489 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:18.489 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:18.489 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:18.489 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43181 2024-09-13T06:42:18.489 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:18.489 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:18.489 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:18.489 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:18.490 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.652968+0000", 2024-09-13T06:42:18.490 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:18.490 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:18.490 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:18.490 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:18.490 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.652968+0000", 2024-09-13T06:42:18.490 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:18.490 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:18.490 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:18.490 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:18.490 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.652968+0000", 2024-09-13T06:42:18.490 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:18.491 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:18.491 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:18.491 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:18.491 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.652970+0000", 2024-09-13T06:42:18.491 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2409999999999998e-06 2024-09-13T06:42:18.491 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:18.491 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:18.491 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:18.491 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.652976+0000", 2024-09-13T06:42:18.491 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0079999999999999e-06 2024-09-13T06:42:18.491 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:18.491 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:18.492 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:18.492 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.652981+0000", 2024-09-13T06:42:18.492 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4390000000000002e-06 2024-09-13T06:42:18.492 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:18.492 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:18.492 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:18.492 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.776275+0000", 2024-09-13T06:42:18.492 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.12329396099999999 2024-09-13T06:42:18.492 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:18.492 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:18.492 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:18.492 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.776316+0000", 2024-09-13T06:42:18.492 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.1244e-05 2024-09-13T06:42:18.493 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:18.493 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:18.493 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:18.493 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.776607+0000", 2024-09-13T06:42:18.493 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00029051199999999999 2024-09-13T06:42:18.493 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:18.493 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:18.493 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:18.493 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:18.494 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:18.494 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43182 3.17 3:ec5ebce4:::rbd_data.1121f5f2e1c0.0000000000000001:1f [read 333824~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:42:18.494 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.652985+0000", 2024-09-13T06:42:18.494 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 116.817509884, 2024-09-13T06:42:18.494 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123926616, 2024-09-13T06:42:18.494 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:18.494 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:18.494 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:18.494 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:18.494 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:18.494 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43182 2024-09-13T06:42:18.494 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:18.494 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:18.494 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:18.495 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:18.495 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.652985+0000", 2024-09-13T06:42:18.495 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:18.495 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:18.495 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:18.495 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:18.495 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.652985+0000", 2024-09-13T06:42:18.495 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:18.495 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:18.495 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:18.495 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:18.495 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.652985+0000", 2024-09-13T06:42:18.496 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:18.496 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:18.496 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:18.496 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:18.496 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.652987+0000", 2024-09-13T06:42:18.496 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0899999999999999e-06 2024-09-13T06:42:18.496 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:18.496 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:18.496 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:18.496 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.652994+0000", 2024-09-13T06:42:18.496 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3100000000000003e-06 2024-09-13T06:42:18.496 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:18.496 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:18.496 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:18.496 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.653000+0000", 2024-09-13T06:42:18.497 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2020000000000003e-06 2024-09-13T06:42:18.497 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:18.497 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:18.497 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:18.497 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.776635+0000", 2024-09-13T06:42:18.497 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.12363529400000001 2024-09-13T06:42:18.497 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:18.497 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:18.497 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:18.497 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.776676+0000", 2024-09-13T06:42:18.497 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.0745999999999999e-05 2024-09-13T06:42:18.497 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:18.497 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:18.497 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:18.498 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.776912+0000", 2024-09-13T06:42:18.498 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00023631300000000001 2024-09-13T06:42:18.498 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:18.498 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:18.498 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:18.498 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:18.498 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:18.498 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43192 3.17 3:ec5ebce4:::rbd_data.1121f5f2e1c0.0000000000000001:1f [read 466944~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:42:18.498 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.656622+0000", 2024-09-13T06:42:18.498 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 116.813872828, 2024-09-13T06:42:18.498 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123503136, 2024-09-13T06:42:18.498 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:18.498 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:18.498 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:18.498 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:18.499 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:18.499 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43192 2024-09-13T06:42:18.499 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:18.499 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:18.499 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:18.499 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:18.499 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656622+0000", 2024-09-13T06:42:18.499 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:18.499 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:18.499 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:18.499 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:18.499 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656622+0000", 2024-09-13T06:42:18.499 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:18.499 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:18.499 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:18.500 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:18.500 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656622+0000", 2024-09-13T06:42:18.500 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:42:18.500 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:18.500 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:18.500 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:18.500 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656623+0000", 2024-09-13T06:42:18.500 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2079999999999999e-06 2024-09-13T06:42:18.500 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:18.500 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:18.500 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:18.500 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656627+0000", 2024-09-13T06:42:18.501 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.4819999999999999e-06 2024-09-13T06:42:18.501 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:18.501 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:18.501 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:18.501 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656629+0000", 2024-09-13T06:42:18.501 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.582e-06 2024-09-13T06:42:18.501 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:18.501 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:18.501 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:18.501 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.779866+0000", 2024-09-13T06:42:18.501 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.12323638100000001 2024-09-13T06:42:18.501 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:18.501 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:18.502 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:18.502 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.779905+0000", 2024-09-13T06:42:18.502 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.9529e-05 2024-09-13T06:42:18.502 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:18.502 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:18.502 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:18.502 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.780125+0000", 2024-09-13T06:42:18.502 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000220168 2024-09-13T06:42:18.502 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:18.502 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:18.502 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:18.502 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:18.502 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:18.503 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43193 3.17 3:ec5ebce4:::rbd_data.1121f5f2e1c0.0000000000000001:1f [read 481280~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:42:18.503 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.656635+0000", 2024-09-13T06:42:18.503 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 116.81386034400001, 2024-09-13T06:42:18.503 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.12374478999999999, 2024-09-13T06:42:18.503 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:18.503 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:18.503 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:18.503 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:18.503 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:18.503 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43193 2024-09-13T06:42:18.503 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:18.503 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:18.503 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:18.503 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:18.504 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656635+0000", 2024-09-13T06:42:18.504 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:18.504 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:18.504 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:18.504 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:18.504 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656635+0000", 2024-09-13T06:42:18.504 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:18.504 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:18.504 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:18.504 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:18.504 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656635+0000", 2024-09-13T06:42:18.504 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:42:18.504 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:18.504 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:18.505 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:18.505 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656636+0000", 2024-09-13T06:42:18.505 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.544e-06 2024-09-13T06:42:18.505 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:18.505 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:18.505 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:18.505 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656639+0000", 2024-09-13T06:42:18.505 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.0879999999999999e-06 2024-09-13T06:42:18.505 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:18.505 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:18.505 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:18.505 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656642+0000", 2024-09-13T06:42:18.505 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5799999999999999e-06 2024-09-13T06:42:18.506 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:18.506 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:18.506 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:18.506 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.780151+0000", 2024-09-13T06:42:18.506 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123509035 2024-09-13T06:42:18.506 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:18.506 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:18.506 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:18.506 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.780191+0000", 2024-09-13T06:42:18.506 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.9758000000000001e-05 2024-09-13T06:42:18.506 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:18.506 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:18.506 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:18.506 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.780380+0000", 2024-09-13T06:42:18.507 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000189023 2024-09-13T06:42:18.507 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:18.507 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:18.507 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:18.507 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:18.507 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:18.507 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43194 3.17 3:ec5ebce4:::rbd_data.1121f5f2e1c0.0000000000000001:1f [read 495616~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:42:18.507 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.656645+0000", 2024-09-13T06:42:18.507 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 116.813849691, 2024-09-13T06:42:18.507 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.124088483, 2024-09-13T06:42:18.507 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:18.507 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:18.507 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:18.507 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:18.508 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:18.508 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43194 2024-09-13T06:42:18.508 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:18.508 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:18.508 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:18.508 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:18.508 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656645+0000", 2024-09-13T06:42:18.508 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:18.508 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:18.508 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:18.508 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:18.509 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656645+0000", 2024-09-13T06:42:18.509 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:18.509 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:18.509 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:18.509 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:18.509 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656645+0000", 2024-09-13T06:42:18.509 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:18.509 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:18.509 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:18.509 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:18.509 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656647+0000", 2024-09-13T06:42:18.509 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9180000000000001e-06 2024-09-13T06:42:18.509 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:18.509 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:18.510 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:18.510 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656653+0000", 2024-09-13T06:42:18.510 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7860000000000002e-06 2024-09-13T06:42:18.510 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:18.510 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:18.510 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:18.510 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656658+0000", 2024-09-13T06:42:18.510 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6949999999999999e-06 2024-09-13T06:42:18.510 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:18.510 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:18.510 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:18.510 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.780406+0000", 2024-09-13T06:42:18.510 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123748657 2024-09-13T06:42:18.510 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:18.511 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:18.511 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:18.511 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.780446+0000", 2024-09-13T06:42:18.511 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.9360999999999998e-05 2024-09-13T06:42:18.511 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:18.511 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:18.511 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:18.511 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.780734+0000", 2024-09-13T06:42:18.511 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00028838399999999998 2024-09-13T06:42:18.511 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:18.511 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:18.511 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:18.511 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:18.511 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:18.512 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43240 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 106496~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:42:18.512 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.660672+0000", 2024-09-13T06:42:18.512 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 116.80982332799999, 2024-09-13T06:42:18.512 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123612707, 2024-09-13T06:42:18.512 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:18.512 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:18.512 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:18.512 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:18.512 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:18.512 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43240 2024-09-13T06:42:18.512 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:18.513 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:18.513 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:18.513 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:18.513 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660672+0000", 2024-09-13T06:42:18.513 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:18.513 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:18.513 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:18.513 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:18.513 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660672+0000", 2024-09-13T06:42:18.513 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:18.513 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:18.513 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:18.513 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:18.513 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660671+0000", 2024-09-13T06:42:18.514 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:18.514 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:18.514 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:18.514 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:18.514 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660673+0000", 2024-09-13T06:42:18.514 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.652e-06 2024-09-13T06:42:18.514 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:18.514 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:18.514 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:18.514 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660677+0000", 2024-09-13T06:42:18.514 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.2509999999999996e-06 2024-09-13T06:42:18.514 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:18.514 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:18.514 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:18.514 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660680+0000", 2024-09-13T06:42:18.515 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.8150000000000002e-06 2024-09-13T06:42:18.515 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:18.515 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:18.515 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:18.515 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.783596+0000", 2024-09-13T06:42:18.515 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.122915841 2024-09-13T06:42:18.515 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:18.515 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:18.515 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:18.515 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.783682+0000", 2024-09-13T06:42:18.515 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.5822999999999995e-05 2024-09-13T06:42:18.515 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:18.515 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:18.515 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:18.516 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.784285+0000", 2024-09-13T06:42:18.516 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00060276500000000001 2024-09-13T06:42:18.516 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:18.516 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:18.516 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:18.516 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:18.516 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:18.516 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43241 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 120832~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:42:18.516 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.660682+0000", 2024-09-13T06:42:18.516 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 116.809812753, 2024-09-13T06:42:18.516 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123958204, 2024-09-13T06:42:18.516 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:18.516 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:18.516 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:18.516 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:18.517 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:18.517 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43241 2024-09-13T06:42:18.517 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:18.517 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:18.517 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:18.517 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:18.517 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660682+0000", 2024-09-13T06:42:18.517 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:18.517 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:18.517 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:18.517 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:18.517 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660682+0000", 2024-09-13T06:42:18.517 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:18.518 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:18.518 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:18.518 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:18.518 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660682+0000", 2024-09-13T06:42:18.518 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:18.518 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:18.518 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:18.518 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:18.519 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660683+0000", 2024-09-13T06:42:18.519 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.308e-06 2024-09-13T06:42:18.519 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:18.519 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:18.519 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:18.519 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660686+0000", 2024-09-13T06:42:18.519 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.977e-06 2024-09-13T06:42:18.519 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:18.519 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:18.519 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:18.519 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660689+0000", 2024-09-13T06:42:18.519 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5830000000000001e-06 2024-09-13T06:42:18.519 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:18.520 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:18.520 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:18.520 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.784366+0000", 2024-09-13T06:42:18.520 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.12367713599999999 2024-09-13T06:42:18.520 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:18.520 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:18.520 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:18.520 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.784451+0000", 2024-09-13T06:42:18.520 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.4629999999999994e-05 2024-09-13T06:42:18.520 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:18.520 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:18.520 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:18.520 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.784641+0000", 2024-09-13T06:42:18.520 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00018984899999999999 2024-09-13T06:42:18.521 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:18.521 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:18.521 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:18.521 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:18.521 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:18.521 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43242 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 139264~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:42:18.521 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.660691+0000", 2024-09-13T06:42:18.521 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 116.80980377500001, 2024-09-13T06:42:18.521 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.124536443, 2024-09-13T06:42:18.521 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:18.521 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:18.521 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:18.521 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:18.521 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:18.521 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43242 2024-09-13T06:42:18.522 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:18.522 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:18.522 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:18.522 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:18.522 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660691+0000", 2024-09-13T06:42:18.522 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:18.522 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:18.522 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:18.522 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:18.522 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660691+0000", 2024-09-13T06:42:18.522 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:18.522 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:18.522 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:18.523 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:18.523 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660691+0000", 2024-09-13T06:42:18.523 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:42:18.523 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:18.523 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:18.523 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:18.523 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660696+0000", 2024-09-13T06:42:18.523 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0560000000000004e-06 2024-09-13T06:42:18.523 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:18.523 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:18.523 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:18.523 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660699+0000", 2024-09-13T06:42:18.523 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.2009999999999999e-06 2024-09-13T06:42:18.523 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:18.524 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:18.524 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:18.524 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660702+0000", 2024-09-13T06:42:18.524 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.633e-06 2024-09-13T06:42:18.524 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:18.524 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:18.524 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:18.524 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.784912+0000", 2024-09-13T06:42:18.524 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.124209497 2024-09-13T06:42:18.524 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:18.524 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:18.524 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:18.524 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.784995+0000", 2024-09-13T06:42:18.524 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.3891e-05 2024-09-13T06:42:18.524 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:18.525 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:18.525 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:18.525 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.785228+0000", 2024-09-13T06:42:18.525 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00023237400000000001 2024-09-13T06:42:18.525 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:18.525 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:18.525 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:18.525 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:18.525 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:18.525 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43243 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 153600~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:42:18.525 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.660705+0000", 2024-09-13T06:42:18.525 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 116.80979044199999, 2024-09-13T06:42:18.525 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.124825835, 2024-09-13T06:42:18.526 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:18.526 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:18.526 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:18.526 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:18.526 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:18.526 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43243 2024-09-13T06:42:18.526 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:18.526 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:18.526 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:18.526 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:18.526 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660705+0000", 2024-09-13T06:42:18.526 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:18.526 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:18.526 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:18.526 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:18.527 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660705+0000", 2024-09-13T06:42:18.527 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:18.527 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:18.527 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:18.527 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:18.527 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660705+0000", 2024-09-13T06:42:18.527 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:42:18.527 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:18.527 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:18.527 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:18.527 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660706+0000", 2024-09-13T06:42:18.527 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4339999999999999e-06 2024-09-13T06:42:18.527 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:18.527 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:18.528 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:18.528 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660709+0000", 2024-09-13T06:42:18.528 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9000000000000002e-06 2024-09-13T06:42:18.528 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:18.528 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:18.528 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:18.528 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660712+0000", 2024-09-13T06:42:18.528 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.0589999999999998e-06 2024-09-13T06:42:18.528 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:18.528 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:18.528 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:18.528 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.785318+0000", 2024-09-13T06:42:18.528 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.124606299 2024-09-13T06:42:18.528 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:18.529 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:18.529 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:18.529 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.785361+0000", 2024-09-13T06:42:18.529 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.3214999999999999e-05 2024-09-13T06:42:18.529 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:18.529 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:18.529 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:18.529 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.785531+0000", 2024-09-13T06:42:18.529 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00016914400000000001 2024-09-13T06:42:18.529 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:18.529 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:18.529 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:18.530 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:18.530 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:18.530 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43244 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 167936~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:42:18.530 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.660714+0000", 2024-09-13T06:42:18.530 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 116.80978102900001, 2024-09-13T06:42:18.530 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.125073248, 2024-09-13T06:42:18.530 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:18.530 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:18.530 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:18.530 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:18.530 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:18.530 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43244 2024-09-13T06:42:18.531 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:18.531 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:18.531 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:18.531 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:18.531 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660714+0000", 2024-09-13T06:42:18.531 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:18.531 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:18.531 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:18.531 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:18.531 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660714+0000", 2024-09-13T06:42:18.531 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:18.531 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:18.531 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:18.532 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:18.532 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660714+0000", 2024-09-13T06:42:18.532 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:42:18.532 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:18.532 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:18.532 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:18.532 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660715+0000", 2024-09-13T06:42:18.532 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2330000000000001e-06 2024-09-13T06:42:18.532 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:18.532 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:18.532 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:18.532 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660718+0000", 2024-09-13T06:42:18.533 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9569999999999998e-06 2024-09-13T06:42:18.533 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:18.533 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:18.533 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:18.533 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660721+0000", 2024-09-13T06:42:18.533 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.678e-06 2024-09-13T06:42:18.533 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:18.533 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:18.533 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:18.533 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.785557+0000", 2024-09-13T06:42:18.533 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.12483633199999999 2024-09-13T06:42:18.533 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:18.533 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:18.533 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:18.534 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.785618+0000", 2024-09-13T06:42:18.534 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0686000000000001e-05 2024-09-13T06:42:18.534 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:18.534 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:18.534 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:18.534 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.785787+0000", 2024-09-13T06:42:18.534 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00016957699999999999 2024-09-13T06:42:18.534 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:18.534 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:18.534 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:18.534 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:18.534 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:18.534 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43254 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 315392~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:42:18.535 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.664717+0000", 2024-09-13T06:42:18.535 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 116.805778461, 2024-09-13T06:42:18.535 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.12357108, 2024-09-13T06:42:18.535 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:18.535 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:18.535 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:18.535 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:18.535 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:18.535 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43254 2024-09-13T06:42:18.536 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:18.536 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:18.536 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:18.536 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:18.536 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664717+0000", 2024-09-13T06:42:18.536 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:18.536 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:18.536 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:18.536 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:18.536 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664717+0000", 2024-09-13T06:42:18.536 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:18.536 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:18.536 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:18.537 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:18.537 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664716+0000", 2024-09-13T06:42:18.537 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:18.537 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:18.537 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:18.537 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:18.537 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664724+0000", 2024-09-13T06:42:18.537 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.7109999999999995e-06 2024-09-13T06:42:18.537 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:18.537 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:18.537 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:18.537 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664732+0000", 2024-09-13T06:42:18.537 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.8399999999999995e-06 2024-09-13T06:42:18.537 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:18.538 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:18.538 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:18.538 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664738+0000", 2024-09-13T06:42:18.538 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.879e-06 2024-09-13T06:42:18.538 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:18.538 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:18.538 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:18.538 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.788018+0000", 2024-09-13T06:42:18.538 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123280719 2024-09-13T06:42:18.538 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:18.538 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:18.538 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:18.538 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.788119+0000", 2024-09-13T06:42:18.538 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000100558 2024-09-13T06:42:18.539 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:18.539 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:18.539 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:18.539 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.788288+0000", 2024-09-13T06:42:18.539 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000168751 2024-09-13T06:42:18.539 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:18.539 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:18.539 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:18.539 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:18.539 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:18.539 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43255 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 329728~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:42:18.539 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.664743+0000", 2024-09-13T06:42:18.539 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 116.805752465, 2024-09-13T06:42:18.539 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.12381711500000001, 2024-09-13T06:42:18.539 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:18.540 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:18.540 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:18.540 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:18.540 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:18.540 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43255 2024-09-13T06:42:18.540 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:18.540 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:18.540 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:18.540 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:18.540 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664743+0000", 2024-09-13T06:42:18.540 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:18.540 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:18.540 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:18.540 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:18.541 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664743+0000", 2024-09-13T06:42:18.541 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:18.541 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:18.541 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:18.541 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:18.541 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664742+0000", 2024-09-13T06:42:18.541 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:18.541 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:18.541 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:18.541 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:18.541 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664745+0000", 2024-09-13T06:42:18.541 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.7269999999999999e-06 2024-09-13T06:42:18.541 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:18.542 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:18.542 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:18.542 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664753+0000", 2024-09-13T06:42:18.542 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.8709999999999997e-06 2024-09-13T06:42:18.542 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:18.542 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:18.542 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:18.542 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664758+0000", 2024-09-13T06:42:18.542 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2220000000000001e-06 2024-09-13T06:42:18.542 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:18.542 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:18.542 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:18.542 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.788314+0000", 2024-09-13T06:42:18.543 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123555545 2024-09-13T06:42:18.543 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:18.543 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:18.543 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:18.543 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.788368+0000", 2024-09-13T06:42:18.543 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3928999999999998e-05 2024-09-13T06:42:18.543 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:18.543 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:18.543 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:18.543 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.788560+0000", 2024-09-13T06:42:18.543 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000192237 2024-09-13T06:42:18.543 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:18.543 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:18.543 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:18.544 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:18.544 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:18.544 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43256 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 344064~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:42:18.544 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.664763+0000", 2024-09-13T06:42:18.544 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 116.805732519, 2024-09-13T06:42:18.544 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.12418359399999999, 2024-09-13T06:42:18.544 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:18.544 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:18.544 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:18.544 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:18.544 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:18.544 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43256 2024-09-13T06:42:18.545 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:18.545 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:18.545 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:18.545 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:18.545 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664763+0000", 2024-09-13T06:42:18.545 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:18.545 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:18.545 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:18.545 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:18.545 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664763+0000", 2024-09-13T06:42:18.545 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:18.546 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:18.546 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:18.546 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:18.546 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664762+0000", 2024-09-13T06:42:18.546 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:18.546 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:18.546 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:18.546 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:18.546 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664765+0000", 2024-09-13T06:42:18.546 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3290000000000001e-06 2024-09-13T06:42:18.546 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:18.546 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:18.546 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:18.546 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664771+0000", 2024-09-13T06:42:18.547 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.1319999999999999e-06 2024-09-13T06:42:18.547 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:18.547 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:18.547 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:18.547 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664776+0000", 2024-09-13T06:42:18.547 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.8840000000000002e-06 2024-09-13T06:42:18.547 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:18.547 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:18.547 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:18.547 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.788598+0000", 2024-09-13T06:42:18.547 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123821979 2024-09-13T06:42:18.547 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:18.547 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:18.548 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:18.548 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.788680+0000", 2024-09-13T06:42:18.548 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.2367999999999995e-05 2024-09-13T06:42:18.548 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:18.548 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:18.548 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:18.548 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.788946+0000", 2024-09-13T06:42:18.548 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00026629799999999999 2024-09-13T06:42:18.548 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:18.548 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:18.548 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:18.549 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:18.549 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:18.549 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43265 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 477184~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:42:18.549 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.669414+0000", 2024-09-13T06:42:18.549 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 116.801080883, 2024-09-13T06:42:18.549 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123446973, 2024-09-13T06:42:18.549 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:18.549 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:18.549 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:18.549 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:18.549 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:18.549 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43265 2024-09-13T06:42:18.550 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:18.550 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:18.550 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:18.550 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:18.550 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669414+0000", 2024-09-13T06:42:18.550 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:18.550 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:18.550 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:18.550 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:18.550 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669414+0000", 2024-09-13T06:42:18.550 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:18.550 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:18.550 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:18.550 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:18.551 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669414+0000", 2024-09-13T06:42:18.551 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:18.551 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:18.551 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:18.551 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:18.551 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669416+0000", 2024-09-13T06:42:18.551 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.317e-06 2024-09-13T06:42:18.551 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:18.551 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:18.551 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:18.551 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669425+0000", 2024-09-13T06:42:18.551 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.0650000000000005e-06 2024-09-13T06:42:18.551 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:18.551 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:18.551 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:18.552 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669430+0000", 2024-09-13T06:42:18.552 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5079999999999999e-06 2024-09-13T06:42:18.552 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:18.552 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:18.552 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:18.552 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.792649+0000", 2024-09-13T06:42:18.552 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123219328 2024-09-13T06:42:18.552 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:18.552 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:18.552 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:18.552 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.792695+0000", 2024-09-13T06:42:18.552 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5476999999999998e-05 2024-09-13T06:42:18.552 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:18.553 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:18.553 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:18.553 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.792861+0000", 2024-09-13T06:42:18.553 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00016658999999999999 2024-09-13T06:42:18.553 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:18.553 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:18.553 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:18.553 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:18.553 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:18.553 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43266 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 491520~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:42:18.553 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.669434+0000", 2024-09-13T06:42:18.553 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 116.801060761, 2024-09-13T06:42:18.554 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123685267, 2024-09-13T06:42:18.554 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:18.554 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:18.554 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:18.554 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:18.554 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:18.554 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43266 2024-09-13T06:42:18.554 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:18.554 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:18.554 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:18.554 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:18.555 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669434+0000", 2024-09-13T06:42:18.555 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:18.555 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:18.555 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:18.555 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:18.555 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669434+0000", 2024-09-13T06:42:18.555 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:18.555 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:18.555 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:18.555 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:18.555 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669434+0000", 2024-09-13T06:42:18.555 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:18.555 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:18.556 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:18.556 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:18.556 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669441+0000", 2024-09-13T06:42:18.556 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3019999999999997e-06 2024-09-13T06:42:18.556 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:18.556 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:18.556 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:18.556 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669451+0000", 2024-09-13T06:42:18.556 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.6379999999999999e-06 2024-09-13T06:42:18.556 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:18.556 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:18.556 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:18.556 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669456+0000", 2024-09-13T06:42:18.557 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.361e-06 2024-09-13T06:42:18.557 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:18.557 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:18.557 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:18.557 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.792879+0000", 2024-09-13T06:42:18.557 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123422686 2024-09-13T06:42:18.557 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:18.557 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:18.557 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:18.557 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.792923+0000", 2024-09-13T06:42:18.557 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4035000000000001e-05 2024-09-13T06:42:18.557 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:18.557 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:18.558 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:18.558 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.793120+0000", 2024-09-13T06:42:18.558 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00019660899999999999 2024-09-13T06:42:18.558 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:18.558 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:18.558 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:18.558 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:18.558 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:18.558 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43267 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 505856~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:42:18.558 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.669461+0000", 2024-09-13T06:42:18.558 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 116.801033965, 2024-09-13T06:42:18.559 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123933711, 2024-09-13T06:42:18.559 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:18.559 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:18.559 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:18.559 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:18.559 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:18.559 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43267 2024-09-13T06:42:18.559 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:18.559 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:18.559 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:18.559 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:18.559 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669461+0000", 2024-09-13T06:42:18.559 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:18.560 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:18.560 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:18.560 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:18.560 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669461+0000", 2024-09-13T06:42:18.560 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:18.560 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:18.560 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:18.560 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:18.560 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669461+0000", 2024-09-13T06:42:18.560 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:18.560 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:18.560 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:18.560 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:18.560 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669463+0000", 2024-09-13T06:42:18.561 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5629999999999999e-06 2024-09-13T06:42:18.561 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:18.561 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:18.561 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:18.561 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669473+0000", 2024-09-13T06:42:18.561 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.9520000000000006e-06 2024-09-13T06:42:18.561 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:18.561 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:18.561 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:18.561 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669479+0000", 2024-09-13T06:42:18.561 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8540000000000002e-06 2024-09-13T06:42:18.561 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:18.561 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:18.562 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:18.562 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.793137+0000", 2024-09-13T06:42:18.562 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.12365825699999999 2024-09-13T06:42:18.562 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:18.562 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:18.562 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:18.562 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.793181+0000", 2024-09-13T06:42:18.562 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.3773999999999998e-05 2024-09-13T06:42:18.562 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:18.562 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:18.562 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:18.562 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.793395+0000", 2024-09-13T06:42:18.562 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00021372399999999999 2024-09-13T06:42:18.562 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:18.563 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:18.563 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:18.563 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:18.563 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:18.563 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43268 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 520192~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:42:18.563 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.669484+0000", 2024-09-13T06:42:18.563 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 116.80101118, 2024-09-13T06:42:18.563 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.12441057899999999, 2024-09-13T06:42:18.563 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:18.563 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:18.563 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:18.563 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:18.563 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:18.563 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43268 2024-09-13T06:42:18.563 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:18.564 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:18.564 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:18.564 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:18.564 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669484+0000", 2024-09-13T06:42:18.564 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:18.564 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:18.564 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:18.564 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:18.564 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669484+0000", 2024-09-13T06:42:18.564 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:18.564 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:18.564 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:18.564 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:18.565 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669484+0000", 2024-09-13T06:42:18.565 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:18.565 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:18.565 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:18.565 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:18.565 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669486+0000", 2024-09-13T06:42:18.565 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6120000000000001e-06 2024-09-13T06:42:18.565 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:18.565 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:18.565 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:18.566 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669494+0000", 2024-09-13T06:42:18.566 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4819999999999997e-06 2024-09-13T06:42:18.566 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:18.566 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:18.566 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:18.566 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669497+0000", 2024-09-13T06:42:18.566 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9790000000000002e-06 2024-09-13T06:42:18.566 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:18.567 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:18.567 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:18.567 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.793559+0000", 2024-09-13T06:42:18.567 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.124062436 2024-09-13T06:42:18.567 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:18.567 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:18.567 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:18.567 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.793603+0000", 2024-09-13T06:42:18.567 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.3764999999999999e-05 2024-09-13T06:42:18.567 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:18.567 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:18.567 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:18.567 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.793895+0000", 2024-09-13T06:42:18.567 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00029168299999999999 2024-09-13T06:42:18.567 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:18.568 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:18.568 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:18.568 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:18.568 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:18.568 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:42:18.569 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-13T06:42:18.570 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:42:18.565+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:42:18.600 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-13T06:42:18.670 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:42:18.665+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:42:18.771 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:42:18.769+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:42:18.778 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:42:18.778 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-13T06:42:18.778 INFO:teuthology.orchestra.run.smithi081.stdout: "num_ops": 0 2024-09-13T06:42:18.778 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:42:18.799 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-13T06:42:18.800 INFO:teuthology.orchestra.run.smithi081.stdout:osd.0: {} 2024-09-13T06:42:18.800 INFO:teuthology.orchestra.run.smithi081.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-13T06:42:18.819 INFO:teuthology.orchestra.run.smithi081.stdout:osd.1: {} 2024-09-13T06:42:18.819 INFO:teuthology.orchestra.run.smithi081.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-13T06:42:18.840 INFO:teuthology.orchestra.run.smithi081.stdout:osd.2: {} 2024-09-13T06:42:18.840 INFO:teuthology.orchestra.run.smithi081.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-13T06:42:18.859 INFO:teuthology.orchestra.run.smithi081.stdout:osd.3: {} 2024-09-13T06:42:18.859 INFO:teuthology.orchestra.run.smithi081.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-13T06:42:18.871 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:42:18.869+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:42:18.883 INFO:teuthology.orchestra.run.smithi081.stdout:osd.4: {} 2024-09-13T06:42:18.884 INFO:teuthology.orchestra.run.smithi081.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-13T06:42:18.908 INFO:teuthology.orchestra.run.smithi081.stdout:osd.5: {} 2024-09-13T06:42:18.908 INFO:teuthology.orchestra.run.smithi081.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-13T06:42:18.932 INFO:teuthology.orchestra.run.smithi081.stdout:osd.6: {} 2024-09-13T06:42:18.932 INFO:teuthology.orchestra.run.smithi081.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-13T06:42:18.933 INFO:teuthology.orchestra.run.smithi081.stderr:Error ENXIO: problem getting command descriptions from osd.7 2024-09-13T06:42:18.937 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-13T06:42:18.937 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-13T06:42:18.954 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:42:18.954 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:42:18.969 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-13T06:42:18.973 INFO:tasks.ceph.osd.6.smithi139.stderr:2024-09-13T06:42:18.969+0000 7fcd02c5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26385) UID: 0 2024-09-13T06:42:19.074 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:42:19.069+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:42:19.135 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:42:19.135 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:42:19.151 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-13T06:42:19.194 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:42:19.193+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:42:19.276 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:42:19.273+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:42:19.277 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:42:19.277 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:42:19.293 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-13T06:42:19.382 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:42:19.381+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:42:19.466 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:42:19.466 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:42:19.466 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-13T06:42:19.487 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-13T06:42:19.487 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:42:19.485+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:42:19.578 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:42:19.577+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:42:19.650 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:42:19.650 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:42:19.664 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-13T06:42:19.706 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:42:19.704+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:42:19.781 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:42:19.781+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:42:19.820 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:42:19.821 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:42:19.834 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-13T06:42:19.882 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:42:19.876+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:42:19.959 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:42:19.959 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:42:19.973 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-13T06:42:20.015 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:42:20.012+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:42:20.083 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:42:20.080+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:42:20.136 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:42:20.137 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:42:20.150 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-13T06:42:20.196 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:42:20.193+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:42:20.282 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:42:20.282 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:42:20.285 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:42:20.280+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:42:20.298 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-13T06:42:20.385 INFO:tasks.ceph.osd.6.smithi139.stderr:2024-09-13T06:42:20.381+0000 7fcd02c5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26385) UID: 0 2024-09-13T06:42:20.461 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:42:20.461 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:42:20.475 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-13T06:42:20.491 INFO:teuthology.orchestra.run.smithi081.stderr:noscrub is unset 2024-09-13T06:42:20.516 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:42:20.513+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:42:20.586 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:42:20.584+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:42:20.657 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:42:20.657 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:42:20.672 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-13T06:42:20.716 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:42:20.713+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:42:20.788 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:42:20.784+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:42:20.790 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:42:20.790 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:42:20.803 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-13T06:42:20.889 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:42:20.884+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:42:20.938 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-13T06:42:20.961 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:42:20.961 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:42:20.975 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-13T06:42:20.990 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:42:20.988+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:42:21.090 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:42:21.088+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:42:21.093 INFO:teuthology.orchestra.run.smithi081.stdout:osd.0: {} 2024-09-13T06:42:21.093 INFO:teuthology.orchestra.run.smithi081.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-13T06:42:21.099 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:42:21.099 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:42:21.110 INFO:teuthology.orchestra.run.smithi081.stdout:osd.1: {} 2024-09-13T06:42:21.110 INFO:teuthology.orchestra.run.smithi081.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-13T06:42:21.113 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-13T06:42:21.125 INFO:teuthology.orchestra.run.smithi081.stdout:osd.2: {} 2024-09-13T06:42:21.126 INFO:teuthology.orchestra.run.smithi081.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-13T06:42:21.141 INFO:teuthology.orchestra.run.smithi081.stdout:osd.3: {} 2024-09-13T06:42:21.141 INFO:teuthology.orchestra.run.smithi081.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-13T06:42:21.159 INFO:teuthology.orchestra.run.smithi081.stdout:osd.4: {} 2024-09-13T06:42:21.160 INFO:teuthology.orchestra.run.smithi081.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-13T06:42:21.177 INFO:teuthology.orchestra.run.smithi081.stdout:osd.5: {} 2024-09-13T06:42:21.177 INFO:teuthology.orchestra.run.smithi081.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-13T06:42:21.192 INFO:tasks.ceph.osd.6.smithi139.stderr:2024-09-13T06:42:21.185+0000 7fcd02c5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26385) UID: 0 2024-09-13T06:42:21.196 INFO:teuthology.orchestra.run.smithi081.stdout:osd.6: {} 2024-09-13T06:42:21.196 INFO:teuthology.orchestra.run.smithi081.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-13T06:42:21.197 INFO:teuthology.orchestra.run.smithi081.stderr:Error ENXIO: problem getting command descriptions from osd.7 2024-09-13T06:42:21.201 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-13T06:42:21.201 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-13T06:42:21.236 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:42:21.236 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [], 2024-09-13T06:42:21.236 INFO:teuthology.orchestra.run.smithi139.stdout: "num_ops": 0 2024-09-13T06:42:21.236 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:42:21.250 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-13T06:42:21.292 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:42:21.288+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:42:21.393 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:42:21.389+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:42:21.416 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:42:21.417 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [], 2024-09-13T06:42:21.417 INFO:teuthology.orchestra.run.smithi139.stdout: "complaint_time": 30, 2024-09-13T06:42:21.417 INFO:teuthology.orchestra.run.smithi139.stdout: "num_blocked_ops": 0 2024-09-13T06:42:21.417 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:42:21.431 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-13T06:42:21.464 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 7, 5, 3, 4] out_osds: [6] dead_osds: [7] live_osds: [0, 1, 2, 3, 4, 5, 6] 2024-09-13T06:42:21.464 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-13T06:42:21.464 INFO:tasks.thrashosds.thrasher:Reviving osd 7 2024-09-13T06:42:21.464 INFO:tasks.ceph.osd.7:Restarting daemon 2024-09-13T06:42:21.465 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-09-13T06:42:21.475 INFO:tasks.ceph.osd.7:Started 2024-09-13T06:42:21.475 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-13T06:42:21.494 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:42:21.492+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:42:21.594 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:42:21.592+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:42:21.600 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:42:21.600 INFO:teuthology.orchestra.run.smithi139.stdout: "size": 20, 2024-09-13T06:42:21.600 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 600, 2024-09-13T06:42:21.600 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [ 2024-09-13T06:42:21.600 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:21.600 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27854 3.a 3:537b3559:::rbd_data.1121f2c5ee81.0000000000000016:13 [read 335872~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:42:21.601 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.658750+0000", 2024-09-13T06:42:21.601 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 144.94075838699999, 2024-09-13T06:42:21.601 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.037969532, 2024-09-13T06:42:21.601 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:21.601 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:21.601 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:21.601 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:21.601 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:21.601 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27854 2024-09-13T06:42:21.601 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:21.601 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:21.601 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:21.602 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:21.602 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658750+0000", 2024-09-13T06:42:21.602 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:21.602 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:21.602 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:21.602 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:21.602 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658750+0000", 2024-09-13T06:42:21.602 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:21.602 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:21.602 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:21.602 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:21.602 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658749+0000", 2024-09-13T06:42:21.602 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:21.603 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:21.603 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:21.603 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:21.603 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658757+0000", 2024-09-13T06:42:21.603 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.7389999999999999e-06 2024-09-13T06:42:21.603 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:21.603 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:21.603 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:21.603 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658763+0000", 2024-09-13T06:42:21.603 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.7769999999999999e-06 2024-09-13T06:42:21.603 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:21.603 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:21.603 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:21.604 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658767+0000", 2024-09-13T06:42:21.604 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.1749999999999998e-06 2024-09-13T06:42:21.604 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:21.604 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:21.604 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:21.604 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.696322+0000", 2024-09-13T06:42:21.604 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.037554772 2024-09-13T06:42:21.604 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:21.604 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:21.604 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:21.604 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.696418+0000", 2024-09-13T06:42:21.604 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6050000000000004e-05 2024-09-13T06:42:21.604 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:21.604 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:21.605 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:21.605 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.696719+0000", 2024-09-13T06:42:21.605 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00030138499999999999 2024-09-13T06:42:21.605 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:21.605 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:21.605 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:21.605 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:21.605 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:21.605 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27855 3.a 3:537b3559:::rbd_data.1121f2c5ee81.0000000000000016:13 [read 380928~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:42:21.605 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.658771+0000", 2024-09-13T06:42:21.605 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 144.94073714300001, 2024-09-13T06:42:21.605 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.038326354, 2024-09-13T06:42:21.605 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:21.606 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:21.606 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:21.606 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:21.606 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:21.606 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27855 2024-09-13T06:42:21.606 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:21.606 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:21.606 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:21.606 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:21.606 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658771+0000", 2024-09-13T06:42:21.606 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:21.606 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:21.606 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:21.607 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:21.607 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658771+0000", 2024-09-13T06:42:21.607 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:21.607 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:21.607 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:21.607 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:21.607 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658770+0000", 2024-09-13T06:42:21.607 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:21.607 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:21.607 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:21.607 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:21.607 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658772+0000", 2024-09-13T06:42:21.607 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.0930000000000001e-06 2024-09-13T06:42:21.608 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:21.608 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:21.608 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:21.608 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658778+0000", 2024-09-13T06:42:21.608 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.2730000000000002e-06 2024-09-13T06:42:21.608 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:21.608 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:21.608 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:21.608 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658782+0000", 2024-09-13T06:42:21.608 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0879999999999997e-06 2024-09-13T06:42:21.608 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:21.608 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:21.608 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:21.609 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.696770+0000", 2024-09-13T06:42:21.609 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.037988145000000001 2024-09-13T06:42:21.609 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:21.609 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:21.609 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:21.609 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.696852+0000", 2024-09-13T06:42:21.609 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.2039999999999994e-05 2024-09-13T06:42:21.609 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:21.609 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:21.609 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:21.609 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.697097+0000", 2024-09-13T06:42:21.609 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00024508800000000002 2024-09-13T06:42:21.609 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:21.609 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:21.610 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:21.610 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:21.610 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:21.610 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27856 3.a 3:537b3559:::rbd_data.1121f2c5ee81.0000000000000016:13 [read 405504~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:42:21.610 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.658786+0000", 2024-09-13T06:42:21.610 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 144.94072202699999, 2024-09-13T06:42:21.610 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.038736029999999998, 2024-09-13T06:42:21.610 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:21.610 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:21.610 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:21.610 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:21.610 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:21.610 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27856 2024-09-13T06:42:21.611 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:21.611 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:21.611 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:21.611 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:21.611 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658786+0000", 2024-09-13T06:42:21.611 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:21.611 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:21.611 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:21.611 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:21.611 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658786+0000", 2024-09-13T06:42:21.611 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:21.611 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:21.611 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:21.611 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:21.612 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658785+0000", 2024-09-13T06:42:21.612 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:21.612 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:21.612 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:21.612 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:21.612 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658787+0000", 2024-09-13T06:42:21.612 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.0040000000000002e-06 2024-09-13T06:42:21.612 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:21.612 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:21.612 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:21.612 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658793+0000", 2024-09-13T06:42:21.612 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.2410000000000003e-06 2024-09-13T06:42:21.612 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:21.613 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:21.613 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:21.613 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658797+0000", 2024-09-13T06:42:21.613 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.1330000000000001e-06 2024-09-13T06:42:21.613 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:21.613 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:21.613 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:21.613 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.697176+0000", 2024-09-13T06:42:21.613 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.038379074999999999 2024-09-13T06:42:21.613 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:21.613 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:21.613 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:21.613 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.697275+0000", 2024-09-13T06:42:21.613 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.8819000000000004e-05 2024-09-13T06:42:21.614 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:21.614 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:21.614 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:21.614 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.697522+0000", 2024-09-13T06:42:21.614 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00024719999999999999 2024-09-13T06:42:21.614 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:21.614 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:21.614 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:21.614 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:21.614 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:21.614 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27857 3.a 3:537b3559:::rbd_data.1121f2c5ee81.0000000000000016:13 [read 475136~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:42:21.614 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.658845+0000", 2024-09-13T06:42:21.614 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 144.940663024, 2024-09-13T06:42:21.615 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039112570999999999, 2024-09-13T06:42:21.615 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:21.615 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:21.615 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:21.615 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:21.615 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:21.615 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27857 2024-09-13T06:42:21.615 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:21.615 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:21.615 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:21.615 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:21.615 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658845+0000", 2024-09-13T06:42:21.616 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:21.616 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:21.616 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:21.616 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:21.616 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658845+0000", 2024-09-13T06:42:21.616 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:21.616 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:21.616 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:21.616 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:21.616 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658844+0000", 2024-09-13T06:42:21.616 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999986 2024-09-13T06:42:21.616 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:21.616 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:21.616 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:21.617 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658868+0000", 2024-09-13T06:42:21.617 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.4615000000000001e-05 2024-09-13T06:42:21.617 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:21.617 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:21.617 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:21.617 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658884+0000", 2024-09-13T06:42:21.617 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5401999999999999e-05 2024-09-13T06:42:21.617 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:21.617 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:21.617 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:21.617 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658896+0000", 2024-09-13T06:42:21.617 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2509e-05 2024-09-13T06:42:21.618 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:21.618 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:21.618 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:21.618 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.697571+0000", 2024-09-13T06:42:21.618 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.038675107 2024-09-13T06:42:21.618 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:21.618 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:21.618 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:21.618 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.697658+0000", 2024-09-13T06:42:21.618 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6349999999999998e-05 2024-09-13T06:42:21.618 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:21.618 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:21.618 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:21.618 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.697957+0000", 2024-09-13T06:42:21.619 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00029986100000000001 2024-09-13T06:42:21.619 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:21.619 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:21.619 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:21.619 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:21.619 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:21.619 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27858 3.a 3:537b3559:::rbd_data.1121f2c5ee81.0000000000000016:13 [read 499712~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:42:21.619 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.658905+0000", 2024-09-13T06:42:21.619 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 144.940602474, 2024-09-13T06:42:21.619 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039475392999999998, 2024-09-13T06:42:21.619 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:21.619 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:21.619 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:21.620 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:21.620 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:21.620 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27858 2024-09-13T06:42:21.620 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:21.620 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:21.620 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:21.620 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:21.620 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658905+0000", 2024-09-13T06:42:21.620 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:21.620 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:21.620 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:21.620 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:21.620 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658905+0000", 2024-09-13T06:42:21.620 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:21.621 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:21.621 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:21.621 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:21.621 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658905+0000", 2024-09-13T06:42:21.621 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:42:21.621 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:21.621 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:21.621 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:21.621 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658909+0000", 2024-09-13T06:42:21.621 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.831e-06 2024-09-13T06:42:21.621 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:21.621 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:21.621 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:21.622 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658920+0000", 2024-09-13T06:42:21.622 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0936e-05 2024-09-13T06:42:21.622 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:21.622 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:21.622 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:21.622 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658929+0000", 2024-09-13T06:42:21.622 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.2749999999999995e-06 2024-09-13T06:42:21.622 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:21.622 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:21.622 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:21.622 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.697990+0000", 2024-09-13T06:42:21.622 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039061625000000003 2024-09-13T06:42:21.622 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:21.622 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:21.623 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:21.623 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.698077+0000", 2024-09-13T06:42:21.623 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6922000000000006e-05 2024-09-13T06:42:21.623 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:21.623 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:21.623 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:21.623 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.698381+0000", 2024-09-13T06:42:21.623 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00030360599999999999 2024-09-13T06:42:21.623 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:21.623 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:21.623 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:21.623 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:21.623 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:21.623 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27929 3.a 3:537b3559:::rbd_data.1121f2c5ee81.0000000000000016:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:42:21.624 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.659338+0000", 2024-09-13T06:42:21.624 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 144.94016964299999, 2024-09-13T06:42:21.624 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039351214000000002, 2024-09-13T06:42:21.624 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:21.624 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:21.624 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:21.624 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:21.624 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:21.624 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27929 2024-09-13T06:42:21.624 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:21.624 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:21.624 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:21.624 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:21.624 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.659338+0000", 2024-09-13T06:42:21.625 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:21.625 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:21.625 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:21.625 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:21.625 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.659338+0000", 2024-09-13T06:42:21.625 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:21.625 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:21.625 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:21.625 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:21.625 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.659337+0000", 2024-09-13T06:42:21.625 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:42:21.625 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:21.625 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:21.625 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:21.626 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.659342+0000", 2024-09-13T06:42:21.626 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0799999999999999e-06 2024-09-13T06:42:21.626 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:21.626 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:21.626 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:21.626 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.659353+0000", 2024-09-13T06:42:21.626 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1798e-05 2024-09-13T06:42:21.626 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:21.626 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:21.626 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:21.626 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.659361+0000", 2024-09-13T06:42:21.626 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.8040000000000002e-06 2024-09-13T06:42:21.626 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:21.627 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:21.627 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:21.627 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.698449+0000", 2024-09-13T06:42:21.627 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039087519000000001 2024-09-13T06:42:21.627 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:21.627 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:21.627 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:21.627 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.698567+0000", 2024-09-13T06:42:21.627 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00011857 2024-09-13T06:42:21.627 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:21.627 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:21.627 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:21.627 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.698689+0000", 2024-09-13T06:42:21.628 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00012226699999999999 2024-09-13T06:42:21.628 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:21.628 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:21.628 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:21.628 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:21.628 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:21.628 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27974 3.a 3:537b3559:::rbd_data.1121f2c5ee81.0000000000000016:13 [read 32768~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:42:21.628 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.660102+0000", 2024-09-13T06:42:21.628 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 144.93940587500001, 2024-09-13T06:42:21.628 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.038972346999999997, 2024-09-13T06:42:21.628 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:21.628 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:21.629 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:21.629 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:21.629 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:21.629 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27974 2024-09-13T06:42:21.629 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:21.629 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:21.629 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:21.629 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:21.629 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660102+0000", 2024-09-13T06:42:21.629 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:21.629 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:21.629 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:21.629 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:21.630 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660102+0000", 2024-09-13T06:42:21.630 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:21.630 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:21.630 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:21.630 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:21.630 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660100+0000", 2024-09-13T06:42:21.630 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999976 2024-09-13T06:42:21.630 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:21.630 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:21.630 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:21.630 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660114+0000", 2024-09-13T06:42:21.630 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.4466e-05 2024-09-13T06:42:21.630 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:21.631 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:21.631 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:21.631 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660148+0000", 2024-09-13T06:42:21.631 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.3742999999999999e-05 2024-09-13T06:42:21.631 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:21.631 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:21.631 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:21.631 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660170+0000", 2024-09-13T06:42:21.631 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.2518e-05 2024-09-13T06:42:21.631 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:21.631 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:21.631 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:21.631 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.698719+0000", 2024-09-13T06:42:21.632 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.038548529999999998 2024-09-13T06:42:21.632 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:21.632 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:21.632 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:21.632 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.698806+0000", 2024-09-13T06:42:21.632 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.7179e-05 2024-09-13T06:42:21.632 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:21.632 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:21.632 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:21.632 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.699074+0000", 2024-09-13T06:42:21.632 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00026834800000000001 2024-09-13T06:42:21.632 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:21.633 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:21.633 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:21.633 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:21.633 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:21.633 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27975 3.a 3:537b3559:::rbd_data.1121f2c5ee81.0000000000000016:13 [read 57344~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:42:21.633 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.660189+0000", 2024-09-13T06:42:21.633 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 144.939319031, 2024-09-13T06:42:21.633 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039288678, 2024-09-13T06:42:21.633 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:21.633 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:21.633 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:21.633 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:21.633 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:21.634 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27975 2024-09-13T06:42:21.634 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:21.634 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:21.634 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:21.634 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:21.634 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660189+0000", 2024-09-13T06:42:21.634 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:21.634 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:21.634 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:21.634 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:21.634 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660189+0000", 2024-09-13T06:42:21.634 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:21.634 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:21.634 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:21.634 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:21.635 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660187+0000", 2024-09-13T06:42:21.635 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999981 2024-09-13T06:42:21.635 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:21.635 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:21.635 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:21.635 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660195+0000", 2024-09-13T06:42:21.635 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5610000000000001e-06 2024-09-13T06:42:21.635 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:21.635 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:21.635 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:21.635 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660212+0000", 2024-09-13T06:42:21.635 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7725999999999999e-05 2024-09-13T06:42:21.635 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:21.635 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:21.636 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:21.636 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660227+0000", 2024-09-13T06:42:21.636 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.43e-05 2024-09-13T06:42:21.636 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:21.636 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:21.636 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:21.636 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.699135+0000", 2024-09-13T06:42:21.636 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.038908336000000002 2024-09-13T06:42:21.636 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:21.636 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:21.636 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:21.636 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.699208+0000", 2024-09-13T06:42:21.636 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.3065000000000006e-05 2024-09-13T06:42:21.637 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:21.637 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:21.637 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:21.637 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.699478+0000", 2024-09-13T06:42:21.637 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00026946899999999999 2024-09-13T06:42:21.637 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:21.637 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:21.637 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:21.637 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:21.637 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:21.637 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27976 3.a 3:537b3559:::rbd_data.1121f2c5ee81.0000000000000016:13 [read 102400~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:42:21.637 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.660238+0000", 2024-09-13T06:42:21.637 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 144.939269868, 2024-09-13T06:42:21.638 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039636515999999997, 2024-09-13T06:42:21.638 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:21.638 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:21.638 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:21.638 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:21.638 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:21.638 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27976 2024-09-13T06:42:21.638 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:21.638 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:21.638 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:21.638 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:21.638 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660238+0000", 2024-09-13T06:42:21.638 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:21.638 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:21.639 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:21.639 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:21.639 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660238+0000", 2024-09-13T06:42:21.639 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:21.639 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:21.639 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:21.639 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:21.639 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660237+0000", 2024-09-13T06:42:21.639 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:42:21.639 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:21.639 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:21.639 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:21.639 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660243+0000", 2024-09-13T06:42:21.640 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.9909999999999999e-06 2024-09-13T06:42:21.640 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:21.640 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:21.640 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:21.640 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660259+0000", 2024-09-13T06:42:21.640 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6294e-05 2024-09-13T06:42:21.640 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:21.640 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:21.640 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:21.640 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660272+0000", 2024-09-13T06:42:21.640 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2714999999999999e-05 2024-09-13T06:42:21.640 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:21.641 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:21.641 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:21.641 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.699513+0000", 2024-09-13T06:42:21.641 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039240932999999999 2024-09-13T06:42:21.641 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:21.641 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:21.641 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:21.641 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.699604+0000", 2024-09-13T06:42:21.641 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.1367999999999997e-05 2024-09-13T06:42:21.641 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:21.641 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:21.641 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:21.641 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.699875+0000", 2024-09-13T06:42:21.642 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00027029499999999999 2024-09-13T06:42:21.642 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:21.642 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:21.642 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:21.642 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:21.642 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:21.642 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27977 3.a 3:537b3559:::rbd_data.1121f2c5ee81.0000000000000016:13 [read 126976~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:42:21.642 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.660284+0000", 2024-09-13T06:42:21.642 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 144.93922429599999, 2024-09-13T06:42:21.642 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039969945, 2024-09-13T06:42:21.642 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:21.642 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:21.642 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:21.643 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:21.643 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:21.643 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27977 2024-09-13T06:42:21.643 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:21.643 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:21.643 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:21.643 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:21.643 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660284+0000", 2024-09-13T06:42:21.643 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:21.643 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:21.643 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:21.643 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:21.643 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660284+0000", 2024-09-13T06:42:21.644 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:21.644 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:21.644 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:21.644 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:21.644 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660282+0000", 2024-09-13T06:42:21.644 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999986 2024-09-13T06:42:21.644 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:21.644 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:21.644 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:21.644 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660288+0000", 2024-09-13T06:42:21.644 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.2650000000000002e-06 2024-09-13T06:42:21.644 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:21.645 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:21.645 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:21.645 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660304+0000", 2024-09-13T06:42:21.645 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5430999999999998e-05 2024-09-13T06:42:21.645 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:21.645 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:21.645 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:21.645 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660316+0000", 2024-09-13T06:42:21.645 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.237e-05 2024-09-13T06:42:21.645 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:21.645 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:21.645 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:21.645 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.699907+0000", 2024-09-13T06:42:21.646 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039590735000000002 2024-09-13T06:42:21.646 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:21.646 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:21.646 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:21.646 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.699994+0000", 2024-09-13T06:42:21.646 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6996999999999994e-05 2024-09-13T06:42:21.646 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:21.646 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:21.646 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:21.646 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700254+0000", 2024-09-13T06:42:21.646 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000259564 2024-09-13T06:42:21.646 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:21.646 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:21.647 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:21.647 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:21.647 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:21.647 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27978 3.a 3.9aacdeca (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:42:21.647 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.660327+0000", 2024-09-13T06:42:21.647 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 144.939180698, 2024-09-13T06:42:21.647 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039984858999999998, 2024-09-13T06:42:21.647 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:21.647 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:42:21.647 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:21.647 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:21.647 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:21.647 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27978 2024-09-13T06:42:21.648 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:21.648 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:21.648 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:21.648 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:21.648 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660327+0000", 2024-09-13T06:42:21.648 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:21.648 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:21.648 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:21.648 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:21.648 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660327+0000", 2024-09-13T06:42:21.648 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:21.648 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:21.648 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:21.649 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:21.649 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660326+0000", 2024-09-13T06:42:21.649 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:42:21.649 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:21.649 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:21.649 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:21.649 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660366+0000", 2024-09-13T06:42:21.649 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.9691000000000003e-05 2024-09-13T06:42:21.649 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:21.649 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:21.649 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:21.649 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660399+0000", 2024-09-13T06:42:21.649 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.3262000000000001e-05 2024-09-13T06:42:21.650 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:21.650 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:21.650 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:21.650 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660414+0000", 2024-09-13T06:42:21.650 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.4775e-05 2024-09-13T06:42:21.650 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:21.650 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:21.650 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:21.650 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700298+0000", 2024-09-13T06:42:21.650 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039883759999999997 2024-09-13T06:42:21.650 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:21.650 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:21.651 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:21.651 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700312+0000", 2024-09-13T06:42:21.651 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.4374e-05 2024-09-13T06:42:21.651 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:21.651 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:21.651 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:21.651 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:21.651 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:21.651 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27979 3.a 3.9aacdeca (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:42:21.651 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.660429+0000", 2024-09-13T06:42:21.651 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 144.93907883, 2024-09-13T06:42:21.651 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039921361000000002, 2024-09-13T06:42:21.651 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:21.652 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:42:21.652 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:21.652 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:21.652 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:21.652 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27979 2024-09-13T06:42:21.652 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:21.652 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:21.652 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:21.652 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:21.652 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660429+0000", 2024-09-13T06:42:21.652 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:21.652 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:21.652 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:21.653 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:21.653 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660429+0000", 2024-09-13T06:42:21.653 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:21.653 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:21.653 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:21.653 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:21.653 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660428+0000", 2024-09-13T06:42:21.653 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999986 2024-09-13T06:42:21.653 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:21.653 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:21.653 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:21.653 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660434+0000", 2024-09-13T06:42:21.653 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.8190000000000003e-06 2024-09-13T06:42:21.654 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:21.654 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:21.654 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:21.654 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660451+0000", 2024-09-13T06:42:21.654 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6963e-05 2024-09-13T06:42:21.654 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:21.654 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:21.654 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:21.654 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660485+0000", 2024-09-13T06:42:21.654 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.3414000000000002e-05 2024-09-13T06:42:21.654 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:21.654 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:21.654 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:21.655 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700342+0000", 2024-09-13T06:42:21.655 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039857278000000003 2024-09-13T06:42:21.655 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:21.655 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:21.655 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:21.655 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700350+0000", 2024-09-13T06:42:21.655 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.2930000000000001e-06 2024-09-13T06:42:21.655 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:21.655 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:21.655 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:21.655 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:21.655 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:21.656 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27980 3.a 3.9aacdeca (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:42:21.656 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.660497+0000", 2024-09-13T06:42:21.656 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 144.93901061899999, 2024-09-13T06:42:21.656 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039888034000000003, 2024-09-13T06:42:21.656 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:21.656 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:42:21.656 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:21.656 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:21.656 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:21.656 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27980 2024-09-13T06:42:21.656 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:21.656 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:21.656 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:21.657 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:21.657 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660497+0000", 2024-09-13T06:42:21.657 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:21.657 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:21.657 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:21.657 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:21.657 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660497+0000", 2024-09-13T06:42:21.657 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:21.657 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:21.657 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:21.657 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:21.657 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660496+0000", 2024-09-13T06:42:21.658 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:42:21.658 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:21.658 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:21.658 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:21.658 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660503+0000", 2024-09-13T06:42:21.658 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.4110000000000001e-06 2024-09-13T06:42:21.658 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:21.658 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:21.658 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:21.658 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660519+0000", 2024-09-13T06:42:21.658 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6180000000000001e-05 2024-09-13T06:42:21.658 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:21.658 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:21.659 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:21.659 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660544+0000", 2024-09-13T06:42:21.659 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.5177999999999998e-05 2024-09-13T06:42:21.659 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:21.659 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:21.659 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:21.659 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700377+0000", 2024-09-13T06:42:21.659 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039833434000000001 2024-09-13T06:42:21.659 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:21.659 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:21.659 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:21.659 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700385+0000", 2024-09-13T06:42:21.660 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.8800000000000008e-06 2024-09-13T06:42:21.660 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:21.660 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:21.660 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:21.660 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:21.660 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:21.660 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27981 3.a 3.9aacdeca (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:42:21.660 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.660556+0000", 2024-09-13T06:42:21.660 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 144.93895227300001, 2024-09-13T06:42:21.660 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039869989000000002, 2024-09-13T06:42:21.660 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:21.660 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:42:21.660 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:21.661 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:21.661 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:21.661 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27981 2024-09-13T06:42:21.661 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:21.661 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:21.661 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:21.661 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:21.661 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660556+0000", 2024-09-13T06:42:21.661 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:21.661 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:21.661 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:21.662 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:21.662 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660556+0000", 2024-09-13T06:42:21.662 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:21.662 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:21.662 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:21.662 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:21.662 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660555+0000", 2024-09-13T06:42:21.662 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:42:21.662 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:21.662 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:21.662 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:21.662 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660561+0000", 2024-09-13T06:42:21.663 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.088e-06 2024-09-13T06:42:21.663 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:21.663 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:21.663 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:21.663 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660577+0000", 2024-09-13T06:42:21.663 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6147999999999999e-05 2024-09-13T06:42:21.663 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:21.663 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:21.663 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:21.663 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660589+0000", 2024-09-13T06:42:21.663 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2551999999999999e-05 2024-09-13T06:42:21.663 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:21.663 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:21.664 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:21.664 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700414+0000", 2024-09-13T06:42:21.664 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039825007000000003 2024-09-13T06:42:21.664 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:21.664 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:21.664 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:21.664 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700426+0000", 2024-09-13T06:42:21.664 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1265e-05 2024-09-13T06:42:21.664 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:21.664 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:21.664 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:21.664 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:21.664 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:21.665 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27982 3.a 3.9aacdeca (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:42:21.665 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.660603+0000", 2024-09-13T06:42:21.665 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 144.938904678, 2024-09-13T06:42:21.665 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039874779999999999, 2024-09-13T06:42:21.665 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:21.665 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:42:21.665 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:21.665 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:21.665 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:21.665 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27982 2024-09-13T06:42:21.665 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:21.665 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:21.666 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:21.666 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:21.666 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660603+0000", 2024-09-13T06:42:21.666 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:21.666 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:21.666 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:21.666 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:21.666 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660603+0000", 2024-09-13T06:42:21.666 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:21.666 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:21.666 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:21.666 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:21.666 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660602+0000", 2024-09-13T06:42:21.666 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:42:21.667 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:21.667 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:21.667 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:21.667 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660653+0000", 2024-09-13T06:42:21.667 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.0862000000000002e-05 2024-09-13T06:42:21.667 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:21.667 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:21.667 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:21.667 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660697+0000", 2024-09-13T06:42:21.667 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.3773000000000003e-05 2024-09-13T06:42:21.667 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:21.667 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:21.667 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:21.668 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660712+0000", 2024-09-13T06:42:21.668 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5464999999999998e-05 2024-09-13T06:42:21.668 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:21.668 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:21.668 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:21.668 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700469+0000", 2024-09-13T06:42:21.668 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039756503999999998 2024-09-13T06:42:21.668 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:21.668 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:21.668 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:21.669 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700478+0000", 2024-09-13T06:42:21.669 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.1730000000000001e-06 2024-09-13T06:42:21.669 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:21.669 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:21.669 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:21.669 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:21.669 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:21.669 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27983 3.a 3.9aacdeca (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:42:21.669 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.660726+0000", 2024-09-13T06:42:21.669 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 144.93878140300001, 2024-09-13T06:42:21.669 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039804357999999998, 2024-09-13T06:42:21.669 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:21.669 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:42:21.670 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:21.670 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:21.670 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:21.670 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27983 2024-09-13T06:42:21.670 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:21.670 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:21.670 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:21.670 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:21.670 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660726+0000", 2024-09-13T06:42:21.670 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:21.670 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:21.670 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:21.671 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:21.671 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660726+0000", 2024-09-13T06:42:21.671 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:21.671 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:21.671 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:21.671 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:21.671 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660725+0000", 2024-09-13T06:42:21.671 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999986 2024-09-13T06:42:21.671 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:21.671 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:21.671 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:21.671 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660733+0000", 2024-09-13T06:42:21.671 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.9359999999999999e-06 2024-09-13T06:42:21.672 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:21.672 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:21.672 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:21.672 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660751+0000", 2024-09-13T06:42:21.672 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7679000000000001e-05 2024-09-13T06:42:21.672 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:21.672 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:21.672 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:21.672 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660764+0000", 2024-09-13T06:42:21.672 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3112000000000001e-05 2024-09-13T06:42:21.672 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:21.672 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:21.672 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:21.673 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700516+0000", 2024-09-13T06:42:21.673 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039752183000000003 2024-09-13T06:42:21.673 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:21.673 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:21.673 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:21.673 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700531+0000", 2024-09-13T06:42:21.673 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.4732999999999999e-05 2024-09-13T06:42:21.673 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:21.673 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:21.673 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:21.673 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:21.673 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:21.674 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27984 3.a 3.9aacdeca (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:42:21.674 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.660776+0000", 2024-09-13T06:42:21.674 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 144.9387323, 2024-09-13T06:42:21.674 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039795697999999997, 2024-09-13T06:42:21.674 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:21.674 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:42:21.674 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:21.674 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:21.674 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:21.674 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27984 2024-09-13T06:42:21.674 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:21.674 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:21.674 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:21.674 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:21.675 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660776+0000", 2024-09-13T06:42:21.675 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:21.675 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:21.675 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:21.675 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:21.675 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660776+0000", 2024-09-13T06:42:21.675 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:21.675 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:21.675 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:21.675 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:21.675 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660775+0000", 2024-09-13T06:42:21.675 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:42:21.675 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:21.676 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:21.676 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:21.676 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660780+0000", 2024-09-13T06:42:21.676 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.7849999999999997e-06 2024-09-13T06:42:21.676 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:21.676 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:21.676 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:21.676 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660799+0000", 2024-09-13T06:42:21.676 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.8794e-05 2024-09-13T06:42:21.676 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:21.676 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:21.676 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:21.677 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660812+0000", 2024-09-13T06:42:21.677 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3029e-05 2024-09-13T06:42:21.677 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:21.677 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:21.677 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:21.677 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700562+0000", 2024-09-13T06:42:21.677 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039749984000000002 2024-09-13T06:42:21.677 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:21.677 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:21.677 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:21.677 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700571+0000", 2024-09-13T06:42:21.677 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.1260000000000004e-06 2024-09-13T06:42:21.677 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:21.678 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:21.678 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:21.678 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:21.678 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:21.678 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27985 3.a 3.9aacdeca (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:42:21.678 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.660824+0000", 2024-09-13T06:42:21.678 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 144.93868424799999, 2024-09-13T06:42:21.678 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039784462, 2024-09-13T06:42:21.678 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:21.678 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:42:21.678 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:21.678 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:21.678 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:21.678 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27985 2024-09-13T06:42:21.679 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:21.679 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:21.679 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:21.679 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:21.679 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660824+0000", 2024-09-13T06:42:21.679 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:21.679 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:21.679 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:21.679 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:21.679 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660824+0000", 2024-09-13T06:42:21.679 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:21.679 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:21.679 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:21.679 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:21.679 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660823+0000", 2024-09-13T06:42:21.680 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:42:21.680 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:21.680 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:21.680 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:21.680 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660829+0000", 2024-09-13T06:42:21.680 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.9440000000000002e-06 2024-09-13T06:42:21.680 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:21.680 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:21.680 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:21.680 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660922+0000", 2024-09-13T06:42:21.680 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.2958e-05 2024-09-13T06:42:21.680 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:21.680 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:21.681 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:21.681 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660964+0000", 2024-09-13T06:42:21.681 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.2407000000000002e-05 2024-09-13T06:42:21.681 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:21.681 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:21.681 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:21.681 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700600+0000", 2024-09-13T06:42:21.681 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039635581000000003 2024-09-13T06:42:21.681 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:21.681 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:21.681 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:21.681 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700608+0000", 2024-09-13T06:42:21.681 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.5890000000000003e-06 2024-09-13T06:42:21.682 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:21.682 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:21.682 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:21.682 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:21.682 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:21.682 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:28023 3.10 3:0dedc28a:::rbd_data.1121f2c5ee81.0000000000000019:13 [read 475136~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:42:21.682 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.662072+0000", 2024-09-13T06:42:21.682 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 144.937436263, 2024-09-13T06:42:21.682 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.038086508999999998, 2024-09-13T06:42:21.682 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:21.682 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:21.682 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:21.682 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:21.683 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:21.683 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 28023 2024-09-13T06:42:21.683 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:21.683 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:21.683 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:21.683 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:21.683 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.662072+0000", 2024-09-13T06:42:21.683 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:21.683 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:21.683 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:21.683 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:21.683 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.662072+0000", 2024-09-13T06:42:21.683 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:21.683 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:21.684 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:21.684 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:21.684 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.662070+0000", 2024-09-13T06:42:21.684 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999986 2024-09-13T06:42:21.684 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:21.684 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:21.684 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:21.684 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.662076+0000", 2024-09-13T06:42:21.684 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.139e-06 2024-09-13T06:42:21.684 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:21.684 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:21.684 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:21.684 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.662094+0000", 2024-09-13T06:42:21.685 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7136999999999999e-05 2024-09-13T06:42:21.685 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:21.685 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:21.685 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:21.685 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.662124+0000", 2024-09-13T06:42:21.685 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.0528999999999999e-05 2024-09-13T06:42:21.685 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:21.685 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:21.685 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:21.685 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.699843+0000", 2024-09-13T06:42:21.685 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.037718415999999998 2024-09-13T06:42:21.685 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:21.685 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:21.685 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:21.686 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.699931+0000", 2024-09-13T06:42:21.686 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.8345999999999997e-05 2024-09-13T06:42:21.686 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:21.686 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:21.686 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:21.686 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700158+0000", 2024-09-13T06:42:21.686 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00022723099999999999 2024-09-13T06:42:21.686 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:21.686 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:21.686 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:21.686 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:21.686 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:21.686 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:28024 3.10 3.5143b7b0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:42:21.687 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.662137+0000", 2024-09-13T06:42:21.687 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 144.937370741, 2024-09-13T06:42:21.687 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.038056092999999999, 2024-09-13T06:42:21.687 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:21.687 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:42:21.687 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:21.687 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:21.687 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:21.687 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 28024 2024-09-13T06:42:21.687 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:21.687 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:21.687 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:21.687 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:21.688 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.662137+0000", 2024-09-13T06:42:21.688 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:21.688 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:21.688 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:21.688 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:21.688 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.662137+0000", 2024-09-13T06:42:21.688 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:21.688 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:21.688 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:21.688 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:21.688 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.662136+0000", 2024-09-13T06:42:21.688 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999986 2024-09-13T06:42:21.688 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:21.689 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:21.689 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:21.689 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.662142+0000", 2024-09-13T06:42:21.689 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.6930000000000001e-06 2024-09-13T06:42:21.689 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:21.689 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:21.689 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:21.689 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.662160+0000", 2024-09-13T06:42:21.689 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7863000000000002e-05 2024-09-13T06:42:21.689 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:21.689 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:21.689 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:21.689 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.662189+0000", 2024-09-13T06:42:21.690 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.8486000000000001e-05 2024-09-13T06:42:21.690 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:21.690 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:21.690 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:21.690 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700187+0000", 2024-09-13T06:42:21.690 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.037998331000000003 2024-09-13T06:42:21.690 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:21.690 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:21.690 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:21.690 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700193+0000", 2024-09-13T06:42:21.690 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.0909999999999998e-06 2024-09-13T06:42:21.690 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:21.690 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:21.691 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:21.691 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:21.691 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:21.691 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:42:21.691 INFO:teuthology.orchestra.run.smithi081.stdout:checking clone #31, image image_client.0-clone31 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent32 2024-09-13T06:42:21.693 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-13T06:42:21.693 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-13T06:42:21.693 INFO:teuthology.orchestra.run.smithi139.stderr:no valid command found; 10 closest matches: 2024-09-13T06:42:21.694 INFO:teuthology.orchestra.run.smithi139.stderr:0 2024-09-13T06:42:21.694 INFO:teuthology.orchestra.run.smithi139.stderr:1 2024-09-13T06:42:21.694 INFO:teuthology.orchestra.run.smithi139.stderr:2 2024-09-13T06:42:21.694 INFO:teuthology.orchestra.run.smithi139.stderr:abort 2024-09-13T06:42:21.694 INFO:teuthology.orchestra.run.smithi139.stderr:assert 2024-09-13T06:42:21.694 INFO:teuthology.orchestra.run.smithi139.stderr:config diff 2024-09-13T06:42:21.694 INFO:teuthology.orchestra.run.smithi139.stderr:config diff get 2024-09-13T06:42:21.694 INFO:teuthology.orchestra.run.smithi139.stderr:config get 2024-09-13T06:42:21.694 INFO:teuthology.orchestra.run.smithi139.stderr:config help [] 2024-09-13T06:42:21.694 INFO:teuthology.orchestra.run.smithi139.stderr:config set ... 2024-09-13T06:42:21.694 INFO:teuthology.orchestra.run.smithi139.stderr:admin_socket: invalid command 2024-09-13T06:42:21.695 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-7, ['dump_ops_in_flight'] 2024-09-13T06:42:21.696 INFO:tasks.ceph.osd.6.smithi139.stderr:2024-09-13T06:42:21.689+0000 7fcd02c5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26385) UID: 0 2024-09-13T06:42:21.797 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:42:21.792+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:42:21.845 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:42:21.845 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-13T06:42:21.846 INFO:teuthology.orchestra.run.smithi081.stdout: "num_ops": 0 2024-09-13T06:42:21.846 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:42:21.862 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-13T06:42:21.906 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:42:21.904+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:42:21.999 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:42:21.996+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:42:22.030 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:42:22.031 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-13T06:42:22.031 INFO:teuthology.orchestra.run.smithi081.stdout: "complaint_time": 30, 2024-09-13T06:42:22.031 INFO:teuthology.orchestra.run.smithi081.stdout: "num_blocked_ops": 0 2024-09-13T06:42:22.031 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:42:22.045 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-13T06:42:22.072 INFO:teuthology.orchestra.run.smithi081.stdout:4500 punch from 0x4896081 to 0x48a2201, (0xc180 bytes) 2024-09-13T06:42:22.078 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-13T06:42:22.073+0000 7fa8be9d27c0 -1 Falling back to public interface 2024-09-13T06:42:22.081 INFO:teuthology.orchestra.run.smithi081.stdout:4502 writesame 0x8ce8412 thru 0x8ce9737 data_size 0x13(0x1326 bytes) 2024-09-13T06:42:22.097 INFO:teuthology.orchestra.run.smithi081.stdout:4503 trunc from 0xad63bd0 to 0x1eb2c19 2024-09-13T06:42:22.099 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:42:22.096+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:42:22.127 INFO:teuthology.orchestra.run.smithi081.stdout:4504 read 0x1e4ea13 thru 0x1e52266 (0x3854 bytes) 2024-09-13T06:42:22.127 INFO:teuthology.orchestra.run.smithi081.stdout:4506 read 0x3c879b thru 0x3d5c8b (0xd4f1 bytes) 2024-09-13T06:42:22.150 INFO:teuthology.orchestra.run.smithi081.stdout:4507 write 0x8c369c8 thru 0x8c3d410 (0x6a49 bytes) 2024-09-13T06:42:22.178 INFO:teuthology.orchestra.run.smithi081.stdout:4508 write 0xe019cc3 thru 0xe022cb4 (0x8ff2 bytes) 2024-09-13T06:42:22.187 INFO:teuthology.orchestra.run.smithi081.stdout:4509 read 0x75631be thru 0x7567865 (0x46a8 bytes) 2024-09-13T06:42:22.187 INFO:teuthology.orchestra.run.smithi081.stdout:4512 write 0x70dc8a9 thru 0x70de3e0 (0x1b38 bytes) 2024-09-13T06:42:22.193 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:42:22.194 INFO:teuthology.orchestra.run.smithi081.stdout:4514 writesame 0x79f4a3 thru 0x7a59a3 data_size 0x33(0x6501 bytes) 2024-09-13T06:42:22.198 INFO:teuthology.orchestra.run.smithi081.stdout:4515 read 0x91f5e2c thru 0x91f6079 (0x24e bytes) 2024-09-13T06:42:22.198 INFO:teuthology.orchestra.run.smithi081.stdout:4517 read 0xb3c8964 thru 0xb3d42dc (0xb979 bytes) 2024-09-13T06:42:22.198 INFO:teuthology.orchestra.run.smithi081.stdout:4518 punch from 0xde63429 to 0xde65212, (0x1de9 bytes) 2024-09-13T06:42:22.198 INFO:teuthology.orchestra.run.smithi081.stdout:4520 write 0xd2228d4 thru 0xd22b5cb (0x8cf8 bytes) 2024-09-13T06:42:22.199 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:42:22.196+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:42:22.204 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:42:22.204 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:42:22.204 INFO:teuthology.orchestra.run.smithi081.stdout:4523 read 0xa5f01fa thru 0xa5fd77e (0xd585 bytes) 2024-09-13T06:42:22.211 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:42:22.211 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 20, 2024-09-13T06:42:22.211 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 600, 2024-09-13T06:42:22.211 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [ 2024-09-13T06:42:22.211 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.211 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:37801 3.1 3:82e31015:::rbd_object_map.1121d8143c6e.0000000000000019:head [call] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e55)", 2024-09-13T06:42:22.211 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:05.646191+0000", 2024-09-13T06:42:22.211 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 136.564644225, 2024-09-13T06:42:22.211 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.72659507800000001, 2024-09-13T06:42:22.211 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:22.212 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:22.212 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:22.212 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:22.212 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:22.212 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 37801 2024-09-13T06:42:22.212 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.212 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:22.212 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.212 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:22.212 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:05.646191+0000", 2024-09-13T06:42:22.212 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:22.212 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.212 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.212 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:22.213 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:05.646191+0000", 2024-09-13T06:42:22.213 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:22.213 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.213 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.213 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:22.213 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:05.646188+0000", 2024-09-13T06:42:22.213 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999971 2024-09-13T06:42:22.213 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.213 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.213 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:22.213 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:05.646206+0000", 2024-09-13T06:42:22.213 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8182999999999999e-05 2024-09-13T06:42:22.213 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.213 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.214 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:22.214 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:05.646237+0000", 2024-09-13T06:42:22.214 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.1071000000000001e-05 2024-09-13T06:42:22.214 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.214 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.214 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:22.214 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:05.646251+0000", 2024-09-13T06:42:22.214 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3679000000000001e-05 2024-09-13T06:42:22.214 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.214 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.214 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:22.214 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:05.646321+0000", 2024-09-13T06:42:22.214 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.9831000000000003e-05 2024-09-13T06:42:22.214 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.215 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.215 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:42:22.215 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:05.646331+0000", 2024-09-13T06:42:22.215 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0242e-05 2024-09-13T06:42:22.215 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.215 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.215 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:22.215 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.371959+0000", 2024-09-13T06:42:22.215 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.72562817199999996 2024-09-13T06:42:22.215 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.215 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.215 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:22.215 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.372389+0000", 2024-09-13T06:42:22.216 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00042977400000000001 2024-09-13T06:42:22.216 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.216 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.216 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:22.216 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.372786+0000", 2024-09-13T06:42:22.216 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00039706099999999999 2024-09-13T06:42:22.216 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:22.216 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:22.216 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:22.216 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.216 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.216 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43009 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 489472~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:42:22.216 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.644660+0000", 2024-09-13T06:42:22.216 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 120.56617526300001, 2024-09-13T06:42:22.217 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123376071, 2024-09-13T06:42:22.217 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:22.217 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:22.217 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:22.217 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:22.217 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:22.217 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43009 2024-09-13T06:42:22.217 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.217 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:22.217 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.217 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:22.217 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.644660+0000", 2024-09-13T06:42:22.218 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:22.218 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.218 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.218 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:22.218 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.644660+0000", 2024-09-13T06:42:22.218 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:22.218 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.218 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.218 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:22.218 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.644659+0000", 2024-09-13T06:42:22.218 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:22.218 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.219 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.219 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:22.219 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.644662+0000", 2024-09-13T06:42:22.219 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4949999999999998e-06 2024-09-13T06:42:22.219 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.219 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.219 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:22.219 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.644669+0000", 2024-09-13T06:42:22.219 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.289e-06 2024-09-13T06:42:22.219 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.219 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.219 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:22.219 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.644674+0000", 2024-09-13T06:42:22.220 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.8840000000000002e-06 2024-09-13T06:42:22.220 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.220 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.220 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:22.220 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.767602+0000", 2024-09-13T06:42:22.220 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.122928158 2024-09-13T06:42:22.220 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.220 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.220 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:22.221 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.767676+0000", 2024-09-13T06:42:22.221 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3992999999999994e-05 2024-09-13T06:42:22.221 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.221 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.221 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:22.221 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.768036+0000", 2024-09-13T06:42:22.221 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00035966200000000001 2024-09-13T06:42:22.221 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:22.221 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:22.222 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:22.222 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.222 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.222 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43010 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 503808~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:42:22.222 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.644678+0000", 2024-09-13T06:42:22.222 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 120.566156937, 2024-09-13T06:42:22.222 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123728798, 2024-09-13T06:42:22.222 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:22.222 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:22.222 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:22.222 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:22.222 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:22.222 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43010 2024-09-13T06:42:22.222 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.223 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:22.223 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.223 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:22.223 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.644678+0000", 2024-09-13T06:42:22.223 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:22.223 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.223 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.223 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:22.223 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.644678+0000", 2024-09-13T06:42:22.223 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:22.223 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.223 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.223 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:22.224 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.644678+0000", 2024-09-13T06:42:22.224 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:22.224 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.224 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.224 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:22.224 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.644680+0000", 2024-09-13T06:42:22.224 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2050000000000001e-06 2024-09-13T06:42:22.224 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.224 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.224 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:22.224 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.644686+0000", 2024-09-13T06:42:22.224 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8440000000000003e-06 2024-09-13T06:42:22.224 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.224 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.225 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:22.225 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.644691+0000", 2024-09-13T06:42:22.225 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.118e-06 2024-09-13T06:42:22.225 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.225 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.225 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:22.225 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.768065+0000", 2024-09-13T06:42:22.225 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123374698 2024-09-13T06:42:22.225 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.225 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.225 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:22.225 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.768139+0000", 2024-09-13T06:42:22.225 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3934000000000001e-05 2024-09-13T06:42:22.225 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.226 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.226 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:22.226 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.768407+0000", 2024-09-13T06:42:22.226 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00026738800000000002 2024-09-13T06:42:22.226 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:22.226 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:22.226 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:22.226 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.226 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.226 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43181 3.17 3:ec5ebce4:::rbd_data.1121f5f2e1c0.0000000000000001:1f [read 319488~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:42:22.226 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.652968+0000", 2024-09-13T06:42:22.226 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 120.557866421, 2024-09-13T06:42:22.226 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.12363807, 2024-09-13T06:42:22.227 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:22.227 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:22.227 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:22.227 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:22.227 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:22.227 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43181 2024-09-13T06:42:22.227 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.227 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:22.227 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.227 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:22.227 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.652968+0000", 2024-09-13T06:42:22.227 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:22.227 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.227 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.227 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:22.228 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.652968+0000", 2024-09-13T06:42:22.228 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:22.228 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.228 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.228 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:22.228 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.652968+0000", 2024-09-13T06:42:22.228 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:22.228 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.228 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.228 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:22.228 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.652970+0000", 2024-09-13T06:42:22.228 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2409999999999998e-06 2024-09-13T06:42:22.228 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.228 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.229 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:22.229 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.652976+0000", 2024-09-13T06:42:22.229 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0079999999999999e-06 2024-09-13T06:42:22.229 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.229 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.229 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:22.229 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.652981+0000", 2024-09-13T06:42:22.229 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4390000000000002e-06 2024-09-13T06:42:22.229 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.229 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.229 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:22.229 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.776275+0000", 2024-09-13T06:42:22.229 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.12329396099999999 2024-09-13T06:42:22.229 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.230 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.230 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:22.230 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.776316+0000", 2024-09-13T06:42:22.230 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.1244e-05 2024-09-13T06:42:22.230 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.230 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.230 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:22.230 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.776607+0000", 2024-09-13T06:42:22.230 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00029051199999999999 2024-09-13T06:42:22.230 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:22.230 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:22.230 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:22.230 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.230 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.231 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43182 3.17 3:ec5ebce4:::rbd_data.1121f5f2e1c0.0000000000000001:1f [read 333824~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:42:22.231 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.652985+0000", 2024-09-13T06:42:22.231 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 120.557849612, 2024-09-13T06:42:22.231 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123926616, 2024-09-13T06:42:22.231 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:22.231 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:22.231 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:22.231 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:22.231 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:22.231 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43182 2024-09-13T06:42:22.231 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.231 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:22.231 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.231 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:22.232 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.652985+0000", 2024-09-13T06:42:22.232 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:22.232 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.232 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.232 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:22.232 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.652985+0000", 2024-09-13T06:42:22.232 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:22.232 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.232 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.232 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:22.232 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.652985+0000", 2024-09-13T06:42:22.232 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:22.233 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.233 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.233 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:22.233 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.652987+0000", 2024-09-13T06:42:22.233 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0899999999999999e-06 2024-09-13T06:42:22.233 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.233 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.233 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:22.233 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.652994+0000", 2024-09-13T06:42:22.233 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3100000000000003e-06 2024-09-13T06:42:22.233 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.233 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.233 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:22.233 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.653000+0000", 2024-09-13T06:42:22.234 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2020000000000003e-06 2024-09-13T06:42:22.234 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.234 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.234 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:22.234 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.776635+0000", 2024-09-13T06:42:22.234 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.12363529400000001 2024-09-13T06:42:22.234 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.234 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.234 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:22.234 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.776676+0000", 2024-09-13T06:42:22.234 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.0745999999999999e-05 2024-09-13T06:42:22.234 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.234 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.234 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:22.235 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.776912+0000", 2024-09-13T06:42:22.235 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00023631300000000001 2024-09-13T06:42:22.235 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:22.235 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:22.235 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:22.235 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.235 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.235 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43192 3.17 3:ec5ebce4:::rbd_data.1121f5f2e1c0.0000000000000001:1f [read 466944~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:42:22.235 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.656622+0000", 2024-09-13T06:42:22.235 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 120.554212556, 2024-09-13T06:42:22.235 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123503136, 2024-09-13T06:42:22.235 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:22.235 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:22.235 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:22.235 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:22.236 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:22.236 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43192 2024-09-13T06:42:22.236 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.236 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:22.236 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.236 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:22.236 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656622+0000", 2024-09-13T06:42:22.236 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:22.236 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.236 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.236 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:22.236 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656622+0000", 2024-09-13T06:42:22.236 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:22.236 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.237 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.237 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:22.237 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656622+0000", 2024-09-13T06:42:22.237 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:42:22.237 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.237 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.237 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:22.237 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656623+0000", 2024-09-13T06:42:22.237 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2079999999999999e-06 2024-09-13T06:42:22.237 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.237 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.237 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:22.237 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656627+0000", 2024-09-13T06:42:22.238 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.4819999999999999e-06 2024-09-13T06:42:22.238 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.238 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.238 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:22.238 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656629+0000", 2024-09-13T06:42:22.238 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.582e-06 2024-09-13T06:42:22.238 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.238 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.238 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:22.238 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.779866+0000", 2024-09-13T06:42:22.238 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.12323638100000001 2024-09-13T06:42:22.238 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.238 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.238 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:22.238 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.779905+0000", 2024-09-13T06:42:22.239 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.9529e-05 2024-09-13T06:42:22.239 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.239 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.239 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:22.239 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.780125+0000", 2024-09-13T06:42:22.239 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000220168 2024-09-13T06:42:22.239 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:22.239 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:22.239 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:22.239 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.239 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.239 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43193 3.17 3:ec5ebce4:::rbd_data.1121f5f2e1c0.0000000000000001:1f [read 481280~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:42:22.239 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.656635+0000", 2024-09-13T06:42:22.239 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 120.554200072, 2024-09-13T06:42:22.239 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.12374478999999999, 2024-09-13T06:42:22.240 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:22.240 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:22.240 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:22.240 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:22.240 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:22.240 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43193 2024-09-13T06:42:22.240 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.240 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:22.240 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.240 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:22.240 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656635+0000", 2024-09-13T06:42:22.240 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:22.240 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.241 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.241 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:22.241 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656635+0000", 2024-09-13T06:42:22.241 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:22.241 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.241 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.241 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:22.241 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656635+0000", 2024-09-13T06:42:22.241 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:42:22.241 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.241 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.241 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:22.241 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656636+0000", 2024-09-13T06:42:22.242 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.544e-06 2024-09-13T06:42:22.242 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.242 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.242 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:22.242 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656639+0000", 2024-09-13T06:42:22.242 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.0879999999999999e-06 2024-09-13T06:42:22.242 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.242 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.242 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:22.242 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656642+0000", 2024-09-13T06:42:22.242 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5799999999999999e-06 2024-09-13T06:42:22.242 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.242 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.242 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:22.243 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.780151+0000", 2024-09-13T06:42:22.243 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123509035 2024-09-13T06:42:22.243 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.243 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.243 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:22.243 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.780191+0000", 2024-09-13T06:42:22.243 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.9758000000000001e-05 2024-09-13T06:42:22.243 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.243 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.243 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:22.243 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.780380+0000", 2024-09-13T06:42:22.244 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000189023 2024-09-13T06:42:22.244 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:22.244 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:22.244 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:22.244 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.244 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.244 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43194 3.17 3:ec5ebce4:::rbd_data.1121f5f2e1c0.0000000000000001:1f [read 495616~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:42:22.244 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.656645+0000", 2024-09-13T06:42:22.244 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 120.554189419, 2024-09-13T06:42:22.244 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.124088483, 2024-09-13T06:42:22.244 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:22.244 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:22.245 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:22.245 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:22.245 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:22.245 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43194 2024-09-13T06:42:22.245 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.245 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:22.245 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.245 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:22.245 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656645+0000", 2024-09-13T06:42:22.245 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:22.245 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.245 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.246 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:22.246 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656645+0000", 2024-09-13T06:42:22.246 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:22.246 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.246 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.246 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:22.246 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656645+0000", 2024-09-13T06:42:22.246 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:22.246 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.246 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.246 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:22.246 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656647+0000", 2024-09-13T06:42:22.246 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9180000000000001e-06 2024-09-13T06:42:22.246 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.247 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.247 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:22.247 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656653+0000", 2024-09-13T06:42:22.247 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7860000000000002e-06 2024-09-13T06:42:22.247 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.247 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.247 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:22.247 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656658+0000", 2024-09-13T06:42:22.247 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6949999999999999e-06 2024-09-13T06:42:22.247 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.248 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.248 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:22.248 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.780406+0000", 2024-09-13T06:42:22.248 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123748657 2024-09-13T06:42:22.248 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.248 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.248 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:22.248 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.780446+0000", 2024-09-13T06:42:22.248 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.9360999999999998e-05 2024-09-13T06:42:22.248 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.248 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.248 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:22.248 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.780734+0000", 2024-09-13T06:42:22.249 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00028838399999999998 2024-09-13T06:42:22.249 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:22.249 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:22.249 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:22.249 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.249 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.249 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43240 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 106496~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:42:22.249 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.660672+0000", 2024-09-13T06:42:22.249 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 120.550163056, 2024-09-13T06:42:22.249 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123612707, 2024-09-13T06:42:22.249 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:22.249 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:22.249 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:22.249 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:22.250 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:22.250 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43240 2024-09-13T06:42:22.250 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.250 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:22.250 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.250 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:22.250 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660672+0000", 2024-09-13T06:42:22.250 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:22.250 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.250 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.250 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:22.250 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660672+0000", 2024-09-13T06:42:22.250 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:22.250 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.251 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.251 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:22.251 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660671+0000", 2024-09-13T06:42:22.251 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:22.251 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.251 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.251 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:22.251 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660673+0000", 2024-09-13T06:42:22.251 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.652e-06 2024-09-13T06:42:22.251 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.251 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.251 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:22.251 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660677+0000", 2024-09-13T06:42:22.252 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.2509999999999996e-06 2024-09-13T06:42:22.252 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.252 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.252 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:22.252 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660680+0000", 2024-09-13T06:42:22.252 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.8150000000000002e-06 2024-09-13T06:42:22.252 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.252 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.252 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:22.253 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.783596+0000", 2024-09-13T06:42:22.253 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.122915841 2024-09-13T06:42:22.253 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.253 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.253 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:22.253 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.783682+0000", 2024-09-13T06:42:22.253 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.5822999999999995e-05 2024-09-13T06:42:22.253 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.253 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.253 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:22.254 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.784285+0000", 2024-09-13T06:42:22.254 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00060276500000000001 2024-09-13T06:42:22.254 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:22.254 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:22.254 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:22.254 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.254 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.254 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43241 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 120832~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:42:22.254 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.660682+0000", 2024-09-13T06:42:22.254 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 120.550152481, 2024-09-13T06:42:22.254 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123958204, 2024-09-13T06:42:22.254 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:22.254 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:22.255 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:22.255 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:22.255 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:22.255 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43241 2024-09-13T06:42:22.255 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.255 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:22.255 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.255 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:22.255 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660682+0000", 2024-09-13T06:42:22.255 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:22.255 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.255 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.255 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:22.255 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660682+0000", 2024-09-13T06:42:22.256 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:22.256 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.256 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.256 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:22.256 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660682+0000", 2024-09-13T06:42:22.256 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:22.256 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.256 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.256 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:22.256 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660683+0000", 2024-09-13T06:42:22.256 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.308e-06 2024-09-13T06:42:22.256 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.256 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.257 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:22.257 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660686+0000", 2024-09-13T06:42:22.257 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.977e-06 2024-09-13T06:42:22.257 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.257 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.257 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:22.257 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660689+0000", 2024-09-13T06:42:22.257 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5830000000000001e-06 2024-09-13T06:42:22.257 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.257 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.257 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:22.257 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.784366+0000", 2024-09-13T06:42:22.257 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.12367713599999999 2024-09-13T06:42:22.257 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.258 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.258 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:22.258 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.784451+0000", 2024-09-13T06:42:22.258 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.4629999999999994e-05 2024-09-13T06:42:22.258 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.258 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.258 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:22.258 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.784641+0000", 2024-09-13T06:42:22.258 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00018984899999999999 2024-09-13T06:42:22.258 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:22.258 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:22.258 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:22.258 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.259 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.259 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43242 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 139264~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:42:22.259 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.660691+0000", 2024-09-13T06:42:22.259 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 120.550143503, 2024-09-13T06:42:22.259 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.124536443, 2024-09-13T06:42:22.259 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:22.259 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:22.259 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:22.259 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:22.259 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:22.259 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43242 2024-09-13T06:42:22.259 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.259 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:22.260 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.260 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:22.260 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660691+0000", 2024-09-13T06:42:22.260 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:22.260 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.260 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.260 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:22.260 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660691+0000", 2024-09-13T06:42:22.260 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:22.260 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.260 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.260 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:22.260 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660691+0000", 2024-09-13T06:42:22.261 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:42:22.261 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.261 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.261 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:22.261 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660696+0000", 2024-09-13T06:42:22.261 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0560000000000004e-06 2024-09-13T06:42:22.261 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.261 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.261 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:22.261 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660699+0000", 2024-09-13T06:42:22.261 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.2009999999999999e-06 2024-09-13T06:42:22.261 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.261 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.262 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:22.262 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660702+0000", 2024-09-13T06:42:22.262 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.633e-06 2024-09-13T06:42:22.262 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.262 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.262 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:22.262 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.784912+0000", 2024-09-13T06:42:22.262 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.124209497 2024-09-13T06:42:22.262 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.262 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.262 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:22.262 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.784995+0000", 2024-09-13T06:42:22.262 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.3891e-05 2024-09-13T06:42:22.262 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.263 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.263 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:22.263 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.785228+0000", 2024-09-13T06:42:22.263 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00023237400000000001 2024-09-13T06:42:22.263 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:22.263 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:22.263 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:22.263 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.263 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.263 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43243 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 153600~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:42:22.263 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.660705+0000", 2024-09-13T06:42:22.263 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 120.55013017, 2024-09-13T06:42:22.263 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.124825835, 2024-09-13T06:42:22.263 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:22.264 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:22.264 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:22.264 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:22.264 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:22.264 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43243 2024-09-13T06:42:22.264 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.264 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:22.264 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.264 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:22.264 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660705+0000", 2024-09-13T06:42:22.264 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:22.264 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.264 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.265 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:22.265 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660705+0000", 2024-09-13T06:42:22.265 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:22.265 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.265 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.265 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:22.265 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660705+0000", 2024-09-13T06:42:22.265 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:42:22.265 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.265 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.265 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:22.265 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660706+0000", 2024-09-13T06:42:22.265 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4339999999999999e-06 2024-09-13T06:42:22.265 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.266 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.266 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:22.266 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660709+0000", 2024-09-13T06:42:22.266 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9000000000000002e-06 2024-09-13T06:42:22.266 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.266 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.266 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:22.266 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660712+0000", 2024-09-13T06:42:22.266 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.0589999999999998e-06 2024-09-13T06:42:22.266 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.266 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.266 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:22.266 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.785318+0000", 2024-09-13T06:42:22.266 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.124606299 2024-09-13T06:42:22.267 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.267 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.267 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:22.267 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.785361+0000", 2024-09-13T06:42:22.267 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.3214999999999999e-05 2024-09-13T06:42:22.267 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.267 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.267 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:22.267 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.785531+0000", 2024-09-13T06:42:22.267 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00016914400000000001 2024-09-13T06:42:22.267 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:22.267 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:22.267 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:22.267 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.267 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.268 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43244 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 167936~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:42:22.268 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.660714+0000", 2024-09-13T06:42:22.268 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 120.550120757, 2024-09-13T06:42:22.268 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.125073248, 2024-09-13T06:42:22.268 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:22.268 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:22.268 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:22.268 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:22.268 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:22.268 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43244 2024-09-13T06:42:22.268 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.268 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:22.268 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.268 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:22.269 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660714+0000", 2024-09-13T06:42:22.269 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:22.269 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.269 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.269 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:22.269 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660714+0000", 2024-09-13T06:42:22.269 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:22.269 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.269 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.269 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:22.269 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660714+0000", 2024-09-13T06:42:22.270 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:42:22.270 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.270 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.270 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:22.270 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660715+0000", 2024-09-13T06:42:22.270 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2330000000000001e-06 2024-09-13T06:42:22.270 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.270 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.270 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:22.270 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660718+0000", 2024-09-13T06:42:22.270 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9569999999999998e-06 2024-09-13T06:42:22.270 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.270 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.271 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:22.271 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660721+0000", 2024-09-13T06:42:22.271 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.678e-06 2024-09-13T06:42:22.271 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.271 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.271 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:22.271 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.785557+0000", 2024-09-13T06:42:22.271 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.12483633199999999 2024-09-13T06:42:22.271 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.271 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.271 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:22.271 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.785618+0000", 2024-09-13T06:42:22.271 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0686000000000001e-05 2024-09-13T06:42:22.271 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.272 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.272 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:22.272 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.785787+0000", 2024-09-13T06:42:22.272 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00016957699999999999 2024-09-13T06:42:22.272 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:22.272 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:22.272 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:22.272 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.272 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.272 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43254 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 315392~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:42:22.272 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.664717+0000", 2024-09-13T06:42:22.272 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 120.546118189, 2024-09-13T06:42:22.272 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.12357108, 2024-09-13T06:42:22.273 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:22.273 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:22.273 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:22.273 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:22.273 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:22.273 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43254 2024-09-13T06:42:22.273 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.273 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:22.273 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.273 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:22.273 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664717+0000", 2024-09-13T06:42:22.273 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:22.273 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.274 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.274 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:22.274 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664717+0000", 2024-09-13T06:42:22.274 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:22.274 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.274 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.274 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:22.274 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664716+0000", 2024-09-13T06:42:22.274 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:22.274 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.274 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.274 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:22.274 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664724+0000", 2024-09-13T06:42:22.275 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.7109999999999995e-06 2024-09-13T06:42:22.275 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.275 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.275 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:22.275 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664732+0000", 2024-09-13T06:42:22.275 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.8399999999999995e-06 2024-09-13T06:42:22.275 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.275 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.275 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:22.275 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664738+0000", 2024-09-13T06:42:22.275 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.879e-06 2024-09-13T06:42:22.275 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.275 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.275 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:22.276 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.788018+0000", 2024-09-13T06:42:22.276 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123280719 2024-09-13T06:42:22.276 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.276 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.276 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:22.276 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.788119+0000", 2024-09-13T06:42:22.276 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000100558 2024-09-13T06:42:22.276 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.276 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.276 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:22.276 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.788288+0000", 2024-09-13T06:42:22.276 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000168751 2024-09-13T06:42:22.276 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:22.276 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:22.277 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:22.277 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.277 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.277 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43255 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 329728~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:42:22.277 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.664743+0000", 2024-09-13T06:42:22.277 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 120.54609219300001, 2024-09-13T06:42:22.277 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.12381711500000001, 2024-09-13T06:42:22.277 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:22.277 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:22.277 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:22.277 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:22.277 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:22.277 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43255 2024-09-13T06:42:22.278 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.278 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:22.278 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.278 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:22.278 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664743+0000", 2024-09-13T06:42:22.278 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:22.278 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.278 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.278 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:22.278 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664743+0000", 2024-09-13T06:42:22.278 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:22.278 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.278 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.278 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:22.279 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664742+0000", 2024-09-13T06:42:22.279 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:22.279 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.279 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.279 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:22.279 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664745+0000", 2024-09-13T06:42:22.279 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.7269999999999999e-06 2024-09-13T06:42:22.279 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.279 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.279 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:22.279 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664753+0000", 2024-09-13T06:42:22.279 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.8709999999999997e-06 2024-09-13T06:42:22.279 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.279 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.280 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:22.280 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664758+0000", 2024-09-13T06:42:22.280 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2220000000000001e-06 2024-09-13T06:42:22.280 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.280 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.280 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:22.280 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.788314+0000", 2024-09-13T06:42:22.280 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123555545 2024-09-13T06:42:22.280 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.280 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.280 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:22.280 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.788368+0000", 2024-09-13T06:42:22.280 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3928999999999998e-05 2024-09-13T06:42:22.280 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.281 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.281 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:22.281 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.788560+0000", 2024-09-13T06:42:22.281 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000192237 2024-09-13T06:42:22.281 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:22.281 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:22.281 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:22.281 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.281 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.281 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43256 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 344064~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:42:22.281 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.664763+0000", 2024-09-13T06:42:22.281 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 120.546072247, 2024-09-13T06:42:22.281 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.12418359399999999, 2024-09-13T06:42:22.282 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:22.282 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:22.282 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:22.282 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:22.282 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:22.282 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43256 2024-09-13T06:42:22.282 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.282 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:22.282 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.282 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:22.282 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664763+0000", 2024-09-13T06:42:22.282 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:22.282 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.283 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.283 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:22.283 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664763+0000", 2024-09-13T06:42:22.283 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:22.283 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.283 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.283 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:22.283 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664762+0000", 2024-09-13T06:42:22.283 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:22.283 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.283 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.283 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:22.284 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664765+0000", 2024-09-13T06:42:22.284 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3290000000000001e-06 2024-09-13T06:42:22.284 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.284 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.284 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:22.284 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664771+0000", 2024-09-13T06:42:22.284 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.1319999999999999e-06 2024-09-13T06:42:22.284 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.284 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.284 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:22.284 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664776+0000", 2024-09-13T06:42:22.284 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.8840000000000002e-06 2024-09-13T06:42:22.285 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.285 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.285 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:22.285 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.788598+0000", 2024-09-13T06:42:22.285 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123821979 2024-09-13T06:42:22.285 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.285 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.285 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:22.285 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.788680+0000", 2024-09-13T06:42:22.285 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.2367999999999995e-05 2024-09-13T06:42:22.285 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.285 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.285 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:22.285 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.788946+0000", 2024-09-13T06:42:22.286 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00026629799999999999 2024-09-13T06:42:22.286 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:22.286 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:22.286 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:22.286 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.286 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.286 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43265 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 477184~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:42:22.286 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.669414+0000", 2024-09-13T06:42:22.286 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 120.54142061100001, 2024-09-13T06:42:22.286 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123446973, 2024-09-13T06:42:22.286 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:22.286 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:22.286 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:22.286 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:22.287 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:22.287 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43265 2024-09-13T06:42:22.287 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.287 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:22.287 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.287 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:22.287 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669414+0000", 2024-09-13T06:42:22.287 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:22.287 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.288 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.288 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:22.288 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669414+0000", 2024-09-13T06:42:22.288 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:22.288 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.288 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.288 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:22.288 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669414+0000", 2024-09-13T06:42:22.288 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:22.288 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.288 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.288 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:22.288 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669416+0000", 2024-09-13T06:42:22.289 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.317e-06 2024-09-13T06:42:22.289 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.289 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.289 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:22.289 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669425+0000", 2024-09-13T06:42:22.289 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.0650000000000005e-06 2024-09-13T06:42:22.289 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.289 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.289 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:22.289 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669430+0000", 2024-09-13T06:42:22.289 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5079999999999999e-06 2024-09-13T06:42:22.289 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.289 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.289 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:22.290 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.792649+0000", 2024-09-13T06:42:22.290 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123219328 2024-09-13T06:42:22.290 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.290 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.290 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:22.290 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.792695+0000", 2024-09-13T06:42:22.290 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5476999999999998e-05 2024-09-13T06:42:22.290 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.290 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.290 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:22.290 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.792861+0000", 2024-09-13T06:42:22.290 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00016658999999999999 2024-09-13T06:42:22.290 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:22.291 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:22.291 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:22.291 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.291 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.291 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43266 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 491520~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:42:22.291 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.669434+0000", 2024-09-13T06:42:22.291 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 120.541400489, 2024-09-13T06:42:22.291 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123685267, 2024-09-13T06:42:22.291 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:22.291 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:22.291 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:22.291 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:22.291 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:22.292 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43266 2024-09-13T06:42:22.292 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.292 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:22.292 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.292 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:22.292 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669434+0000", 2024-09-13T06:42:22.292 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:22.292 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.292 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.292 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:22.292 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669434+0000", 2024-09-13T06:42:22.293 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:22.293 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.293 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.293 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:22.293 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669434+0000", 2024-09-13T06:42:22.293 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:22.293 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.293 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.293 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:22.293 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669441+0000", 2024-09-13T06:42:22.293 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3019999999999997e-06 2024-09-13T06:42:22.293 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.293 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.294 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:22.294 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669451+0000", 2024-09-13T06:42:22.294 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.6379999999999999e-06 2024-09-13T06:42:22.294 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.294 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.294 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:22.294 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669456+0000", 2024-09-13T06:42:22.294 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.361e-06 2024-09-13T06:42:22.294 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.294 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.294 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:22.294 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.792879+0000", 2024-09-13T06:42:22.294 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123422686 2024-09-13T06:42:22.295 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.295 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.295 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:22.295 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.792923+0000", 2024-09-13T06:42:22.295 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4035000000000001e-05 2024-09-13T06:42:22.295 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.295 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.295 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:22.295 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.793120+0000", 2024-09-13T06:42:22.295 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00019660899999999999 2024-09-13T06:42:22.295 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:22.295 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:22.295 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:22.296 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.296 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.296 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43267 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 505856~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:42:22.296 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.669461+0000", 2024-09-13T06:42:22.296 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 120.541373693, 2024-09-13T06:42:22.296 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123933711, 2024-09-13T06:42:22.296 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:22.296 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:22.296 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:22.296 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:22.296 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:22.296 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43267 2024-09-13T06:42:22.297 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.297 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:22.297 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.297 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:22.297 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669461+0000", 2024-09-13T06:42:22.297 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:22.297 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.297 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.297 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:22.297 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669461+0000", 2024-09-13T06:42:22.297 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:22.297 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.298 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.298 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:22.298 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669461+0000", 2024-09-13T06:42:22.298 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:22.298 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.298 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.298 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:22.298 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669463+0000", 2024-09-13T06:42:22.298 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5629999999999999e-06 2024-09-13T06:42:22.298 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.298 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.298 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:22.298 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669473+0000", 2024-09-13T06:42:22.298 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.9520000000000006e-06 2024-09-13T06:42:22.298 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.299 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.299 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:22.299 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669479+0000", 2024-09-13T06:42:22.299 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8540000000000002e-06 2024-09-13T06:42:22.299 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.299 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.299 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:22.299 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.793137+0000", 2024-09-13T06:42:22.299 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.12365825699999999 2024-09-13T06:42:22.299 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.299 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.300 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:22.300 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.793181+0000", 2024-09-13T06:42:22.300 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.3773999999999998e-05 2024-09-13T06:42:22.300 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.300 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.300 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:22.300 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.793395+0000", 2024-09-13T06:42:22.300 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00021372399999999999 2024-09-13T06:42:22.300 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:22.300 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:22.300 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:22.300 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.301 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.301 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43268 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 520192~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:42:22.301 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.669484+0000", 2024-09-13T06:42:22.301 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 120.541350908, 2024-09-13T06:42:22.301 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.12441057899999999, 2024-09-13T06:42:22.301 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:22.301 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:22.301 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:22.301 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:22.301 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:22.301 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43268 2024-09-13T06:42:22.301 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.301 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:22.301 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.302 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:22.302 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669484+0000", 2024-09-13T06:42:22.302 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:22.302 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.302 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.302 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:22.302 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669484+0000", 2024-09-13T06:42:22.302 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:22.302 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.302 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.302 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:22.303 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669484+0000", 2024-09-13T06:42:22.303 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:22.303 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.303 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.303 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:22.303 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669486+0000", 2024-09-13T06:42:22.303 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6120000000000001e-06 2024-09-13T06:42:22.303 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.303 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.303 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:22.303 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669494+0000", 2024-09-13T06:42:22.303 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4819999999999997e-06 2024-09-13T06:42:22.304 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.304 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.304 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:22.304 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669497+0000", 2024-09-13T06:42:22.304 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9790000000000002e-06 2024-09-13T06:42:22.304 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.304 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.304 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:22.304 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.793559+0000", 2024-09-13T06:42:22.304 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.124062436 2024-09-13T06:42:22.304 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.304 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.304 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:22.305 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.793603+0000", 2024-09-13T06:42:22.305 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.3764999999999999e-05 2024-09-13T06:42:22.305 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.305 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.305 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:22.305 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.793895+0000", 2024-09-13T06:42:22.305 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00029168299999999999 2024-09-13T06:42:22.305 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:22.305 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:22.305 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:22.305 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:22.305 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:22.305 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:42:22.306 INFO:teuthology.orchestra.run.smithi081.stdout:4527 write 0xe625813 thru 0xe62b5a9 (0x5d97 bytes) 2024-09-13T06:42:22.306 INFO:teuthology.orchestra.run.smithi081.stdout:4528 write 0x775f30d thru 0x77654b3 (0x61a7 bytes) 2024-09-13T06:42:22.307 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-13T06:42:22.308 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:42:22.308 INFO:teuthology.orchestra.run.smithi081.stdout:4530 trunc from 0xe62b5aa to 0x465526c 2024-09-13T06:42:22.309 INFO:teuthology.orchestra.run.smithi081.stdout:4531 read 0x15343b thru 0x15846e (0x5034 bytes) 2024-09-13T06:42:22.309 INFO:teuthology.orchestra.run.smithi081.stdout:4532 read 0x2508f46 thru 0x2516770 (0xd82b bytes) 2024-09-13T06:42:22.309 INFO:teuthology.orchestra.run.smithi081.stdout:4533 punch from 0x2c99aa0 to 0x2ca445c, (0xa9bc bytes) 2024-09-13T06:42:22.309 INFO:teuthology.orchestra.run.smithi081.stdout:4534 trunc from 0x465526c to 0xd2a85b9 2024-09-13T06:42:22.309 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:42:22.304+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:42:22.334 INFO:teuthology.orchestra.run.smithi081.stdout:4535 trunc from 0xd2a85b9 to 0x76bb289 2024-09-13T06:42:22.350 INFO:teuthology.orchestra.run.smithi081.stdout:4536 read 0x3a6f2ca thru 0x3a72268 (0x2f9f bytes) 2024-09-13T06:42:22.350 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:42:22.350 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:42:22.359 INFO:teuthology.orchestra.run.smithi081.stdout:4539 trunc from 0x76bb289 to 0x324d440 2024-09-13T06:42:22.372 INFO:teuthology.orchestra.run.smithi081.stdout:4540 read 0x1249865 thru 0x125247f (0x8c1b bytes) 2024-09-13T06:42:22.372 INFO:teuthology.orchestra.run.smithi081.stdout:4542 read 0x56580a thru 0x56c4f4 (0x6ceb bytes) 2024-09-13T06:42:22.393 INFO:teuthology.orchestra.run.smithi081.stdout:4543 trunc from 0x324d440 to 0xe1e157a 2024-09-13T06:42:22.403 INFO:teuthology.orchestra.run.smithi081.stdout:4545 read 0x3a14e26 thru 0x3a1a627 (0x5802 bytes) 2024-09-13T06:42:22.404 INFO:teuthology.orchestra.run.smithi081.stdout:4546 read 0x58bbfdb thru 0x58c64b3 (0xa4d9 bytes) 2024-09-13T06:42:22.404 INFO:teuthology.orchestra.run.smithi081.stdout:4547 write 0x746362f thru 0x7466ee8 (0x38ba bytes) 2024-09-13T06:42:22.408 INFO:tasks.ceph.osd.6.smithi139.stderr:2024-09-13T06:42:22.401+0000 7fcd02c5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26385) UID: 0 2024-09-13T06:42:22.408 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:42:22.408 INFO:teuthology.orchestra.run.smithi081.stdout:4551 write 0xbcfd146 thru 0xbd0098a (0x3845 bytes) 2024-09-13T06:42:22.413 INFO:teuthology.orchestra.run.smithi081.stdout:4552 write 0x6af2a12 thru 0x6af5578 (0x2b67 bytes) 2024-09-13T06:42:22.417 INFO:teuthology.orchestra.run.smithi081.stdout:4553 writesame 0xb501cca thru 0xb50338f data_size 0x16(0x16c6 bytes) 2024-09-13T06:42:22.432 INFO:teuthology.orchestra.run.smithi081.stdout:4554 trunc from 0xe1e157a to 0x6a9b0cf 2024-09-13T06:42:22.458 INFO:teuthology.orchestra.run.smithi081.stdout:4555 write 0x381b5bd thru 0x3824d9c (0x97e0 bytes) 2024-09-13T06:42:22.479 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:42:22.479 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-13T06:42:22.479 INFO:teuthology.orchestra.run.smithi081.stdout: "num_ops": 0 2024-09-13T06:42:22.479 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:42:22.482 INFO:teuthology.orchestra.run.smithi081.stdout:4559 write 0x86fbba7 thru 0x86fe2a7 (0x2701 bytes) 2024-09-13T06:42:22.489 INFO:teuthology.orchestra.run.smithi081.stdout:4560 punch from 0xb1c17 to 0xb9e55, (0x823e bytes) 2024-09-13T06:42:22.489 INFO:teuthology.orchestra.run.smithi081.stdout:4561 clone 34 order 19 su 2048 sc 3 2024-09-13T06:42:22.493 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-13T06:42:22.509 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:42:22.505+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:42:22.526 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-13T06:42:22.610 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:42:22.608+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:42:22.655 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:42:22.655 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-13T06:42:22.655 INFO:teuthology.orchestra.run.smithi081.stdout: "complaint_time": 30, 2024-09-13T06:42:22.655 INFO:teuthology.orchestra.run.smithi081.stdout: "num_blocked_ops": 0 2024-09-13T06:42:22.655 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:42:22.671 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-13T06:42:22.711 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:42:22.705+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:42:22.812 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:42:22.808+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:42:22.836 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:42:22.837 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 20, 2024-09-13T06:42:22.837 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 600, 2024-09-13T06:42:22.837 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [ 2024-09-13T06:42:22.837 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.837 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:21979 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 14217216~4096 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:42:22.837 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.888811+0000", 2024-09-13T06:42:22.837 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 149.946555964, 2024-09-13T06:42:22.837 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049092969, 2024-09-13T06:42:22.837 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:22.837 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:22.838 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:22.838 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:22.838 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:22.838 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 21979 2024-09-13T06:42:22.838 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.838 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:22.838 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.838 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:22.838 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888811+0000", 2024-09-13T06:42:22.838 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:22.838 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.838 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.838 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:22.838 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888811+0000", 2024-09-13T06:42:22.839 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:22.839 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.839 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.839 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:22.839 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888811+0000", 2024-09-13T06:42:22.839 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:42:22.839 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.839 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.839 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:22.839 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888812+0000", 2024-09-13T06:42:22.839 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.204e-06 2024-09-13T06:42:22.839 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.839 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.839 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:22.840 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888815+0000", 2024-09-13T06:42:22.840 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9359999999999999e-06 2024-09-13T06:42:22.840 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.840 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.840 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:22.840 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888818+0000", 2024-09-13T06:42:22.840 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.7369999999999998e-06 2024-09-13T06:42:22.840 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.840 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.840 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:22.840 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.937663+0000", 2024-09-13T06:42:22.840 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.048844540999999998 2024-09-13T06:42:22.840 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.840 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.841 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:22.841 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.937709+0000", 2024-09-13T06:42:22.841 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6492999999999997e-05 2024-09-13T06:42:22.841 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.841 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.841 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:22.841 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.937904+0000", 2024-09-13T06:42:22.841 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00019526499999999999 2024-09-13T06:42:22.841 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:22.841 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:22.841 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:22.841 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.841 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.841 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:21980 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 14245888~4096 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:42:22.842 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.888820+0000", 2024-09-13T06:42:22.842 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 149.94654728699999, 2024-09-13T06:42:22.842 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049357080999999997, 2024-09-13T06:42:22.842 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:22.842 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:22.842 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:22.842 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:22.842 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:22.842 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 21980 2024-09-13T06:42:22.842 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.842 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:22.842 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.842 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:22.842 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888820+0000", 2024-09-13T06:42:22.843 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:22.843 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.843 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.843 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:22.843 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888820+0000", 2024-09-13T06:42:22.843 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:22.843 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.843 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.843 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:22.843 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888820+0000", 2024-09-13T06:42:22.843 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:42:22.843 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.843 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.843 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:22.843 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888821+0000", 2024-09-13T06:42:22.844 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.122e-06 2024-09-13T06:42:22.844 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.844 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.844 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:22.844 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888824+0000", 2024-09-13T06:42:22.844 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.0580000000000002e-06 2024-09-13T06:42:22.844 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.844 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.844 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:22.844 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888827+0000", 2024-09-13T06:42:22.844 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.666e-06 2024-09-13T06:42:22.844 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.844 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.845 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:22.845 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.937935+0000", 2024-09-13T06:42:22.845 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049108329999999999 2024-09-13T06:42:22.845 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.845 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.845 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:22.845 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.937985+0000", 2024-09-13T06:42:22.845 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9694000000000002e-05 2024-09-13T06:42:22.845 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.845 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.845 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:22.845 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.938177+0000", 2024-09-13T06:42:22.845 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00019241899999999999 2024-09-13T06:42:22.845 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:22.846 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:22.846 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:22.846 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.846 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.846 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:21984 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:snapdir [list-snaps] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:42:22.846 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.888829+0000", 2024-09-13T06:42:22.846 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 149.94653850899999, 2024-09-13T06:42:22.846 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049524545000000003, 2024-09-13T06:42:22.846 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:22.846 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:22.846 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:22.846 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:22.846 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:22.846 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 21984 2024-09-13T06:42:22.847 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.847 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:22.847 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.847 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:22.847 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888829+0000", 2024-09-13T06:42:22.847 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:22.847 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.847 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.847 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:22.847 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888829+0000", 2024-09-13T06:42:22.847 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:22.847 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.847 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.847 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:22.848 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888829+0000", 2024-09-13T06:42:22.848 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:42:22.848 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.848 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.848 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:22.848 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888830+0000", 2024-09-13T06:42:22.848 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2529999999999999e-06 2024-09-13T06:42:22.848 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.848 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.848 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:22.848 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888835+0000", 2024-09-13T06:42:22.848 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.4729999999999999e-06 2024-09-13T06:42:22.848 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.849 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.849 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:22.849 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888840+0000", 2024-09-13T06:42:22.849 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0159999999999999e-06 2024-09-13T06:42:22.849 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.849 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.849 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:22.849 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.938199+0000", 2024-09-13T06:42:22.849 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049358974999999999 2024-09-13T06:42:22.849 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.849 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.849 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:22.849 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.938268+0000", 2024-09-13T06:42:22.850 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.8876999999999998e-05 2024-09-13T06:42:22.850 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.850 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.850 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:22.850 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.938353+0000", 2024-09-13T06:42:22.850 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.5155999999999996e-05 2024-09-13T06:42:22.850 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:22.850 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:22.850 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:22.850 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.850 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.851 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:21985 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 12587008~4096 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:42:22.851 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.888858+0000", 2024-09-13T06:42:22.851 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 149.946509359, 2024-09-13T06:42:22.851 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049674347000000001, 2024-09-13T06:42:22.851 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:22.851 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:22.851 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:22.851 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:22.851 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:22.851 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 21985 2024-09-13T06:42:22.851 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.851 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:22.851 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.851 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:22.852 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888858+0000", 2024-09-13T06:42:22.852 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:22.852 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.852 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.852 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:22.852 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888858+0000", 2024-09-13T06:42:22.852 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:22.852 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.852 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.852 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:22.852 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888857+0000", 2024-09-13T06:42:22.852 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:22.852 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.852 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.852 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:22.853 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888860+0000", 2024-09-13T06:42:22.853 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4739999999999999e-06 2024-09-13T06:42:22.853 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.853 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.853 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:22.853 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888867+0000", 2024-09-13T06:42:22.853 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.7170000000000002e-06 2024-09-13T06:42:22.853 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.853 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.853 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:22.853 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888871+0000", 2024-09-13T06:42:22.853 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5120000000000002e-06 2024-09-13T06:42:22.853 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.853 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.854 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:22.854 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.938389+0000", 2024-09-13T06:42:22.854 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049517717000000003 2024-09-13T06:42:22.854 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.854 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.854 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:22.854 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.938449+0000", 2024-09-13T06:42:22.854 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0513999999999997e-05 2024-09-13T06:42:22.854 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.854 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.854 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:22.854 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.938532+0000", 2024-09-13T06:42:22.854 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.2936999999999996e-05 2024-09-13T06:42:22.854 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:22.854 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:22.855 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:22.855 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.855 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.855 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:21986 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 12615680~4096 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:42:22.855 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.888875+0000", 2024-09-13T06:42:22.855 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 149.94649184599999, 2024-09-13T06:42:22.855 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049881781, 2024-09-13T06:42:22.855 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:22.855 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:22.855 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:22.855 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:22.855 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:22.855 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 21986 2024-09-13T06:42:22.855 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.855 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:22.856 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.856 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:22.856 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888875+0000", 2024-09-13T06:42:22.856 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:22.856 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.856 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.856 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:22.856 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888875+0000", 2024-09-13T06:42:22.856 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:22.856 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.856 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.856 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:22.856 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888875+0000", 2024-09-13T06:42:22.857 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:22.857 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.857 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.857 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:22.857 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888880+0000", 2024-09-13T06:42:22.857 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7600000000000002e-06 2024-09-13T06:42:22.857 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.857 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.857 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:22.857 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888887+0000", 2024-09-13T06:42:22.857 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3950000000000003e-06 2024-09-13T06:42:22.857 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.857 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.857 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:22.858 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888892+0000", 2024-09-13T06:42:22.858 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0409999999999997e-06 2024-09-13T06:42:22.858 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.858 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.858 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:22.858 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.938568+0000", 2024-09-13T06:42:22.858 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049675267000000002 2024-09-13T06:42:22.858 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.858 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.858 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:22.858 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.938653+0000", 2024-09-13T06:42:22.858 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.5792999999999997e-05 2024-09-13T06:42:22.858 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.858 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.858 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:22.859 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.938757+0000", 2024-09-13T06:42:22.859 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00010387699999999999 2024-09-13T06:42:22.859 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:22.859 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:22.859 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:22.859 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.859 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.859 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:21987 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 12644352~4096 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:42:22.859 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.888899+0000", 2024-09-13T06:42:22.859 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 149.94646850000001, 2024-09-13T06:42:22.859 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.050094056999999997, 2024-09-13T06:42:22.859 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:22.859 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:22.860 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:22.860 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:22.860 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:22.860 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 21987 2024-09-13T06:42:22.860 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.860 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:22.860 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.860 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:22.860 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888899+0000", 2024-09-13T06:42:22.860 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:22.860 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.860 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.860 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:22.860 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888899+0000", 2024-09-13T06:42:22.860 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:22.861 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.861 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.861 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:22.861 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888899+0000", 2024-09-13T06:42:22.861 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:22.861 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.861 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.861 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:22.861 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888901+0000", 2024-09-13T06:42:22.861 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2539999999999999e-06 2024-09-13T06:42:22.861 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.861 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.861 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:22.862 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888907+0000", 2024-09-13T06:42:22.862 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9009999999999999e-06 2024-09-13T06:42:22.862 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.862 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.862 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:22.862 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888912+0000", 2024-09-13T06:42:22.862 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9840000000000001e-06 2024-09-13T06:42:22.862 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.862 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.862 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:22.862 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.938810+0000", 2024-09-13T06:42:22.862 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049898835000000002 2024-09-13T06:42:22.862 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.862 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.862 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:22.863 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.938890+0000", 2024-09-13T06:42:22.863 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.9215000000000006e-05 2024-09-13T06:42:22.863 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.863 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.863 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:22.863 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.938993+0000", 2024-09-13T06:42:22.863 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000103194 2024-09-13T06:42:22.863 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:22.863 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:22.863 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:22.863 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.863 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.863 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:21988 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 12673024~4096 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:42:22.863 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.888916+0000", 2024-09-13T06:42:22.864 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 149.94645148399999, 2024-09-13T06:42:22.864 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.050203036999999999, 2024-09-13T06:42:22.864 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:22.864 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:22.864 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:22.864 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:22.864 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:22.864 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 21988 2024-09-13T06:42:22.864 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.864 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:22.864 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.864 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:22.864 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888916+0000", 2024-09-13T06:42:22.864 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:22.865 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.865 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.865 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:22.865 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888916+0000", 2024-09-13T06:42:22.865 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:22.865 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.865 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.865 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:22.865 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888915+0000", 2024-09-13T06:42:22.865 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:22.865 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.865 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.865 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:22.865 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888918+0000", 2024-09-13T06:42:22.866 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1500000000000002e-06 2024-09-13T06:42:22.866 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.866 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.866 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:22.866 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888925+0000", 2024-09-13T06:42:22.866 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.9380000000000003e-06 2024-09-13T06:42:22.866 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.866 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.866 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:22.866 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888933+0000", 2024-09-13T06:42:22.866 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.0560000000000005e-06 2024-09-13T06:42:22.866 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.867 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.867 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:22.867 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.939026+0000", 2024-09-13T06:42:22.867 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.050093499999999999 2024-09-13T06:42:22.867 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.867 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.867 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:22.867 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.939068+0000", 2024-09-13T06:42:22.867 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.1705999999999997e-05 2024-09-13T06:42:22.867 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.867 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.867 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:22.867 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.939119+0000", 2024-09-13T06:42:22.867 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.1048999999999999e-05 2024-09-13T06:42:22.868 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:22.868 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:22.868 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:22.868 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.868 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.868 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:21989 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 12701696~4096 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:42:22.868 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.888938+0000", 2024-09-13T06:42:22.868 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 149.94642915700001, 2024-09-13T06:42:22.868 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.050294393999999999, 2024-09-13T06:42:22.868 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:22.868 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:22.868 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:22.868 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:22.868 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:22.869 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 21989 2024-09-13T06:42:22.869 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.869 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:22.869 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.869 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:22.869 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888938+0000", 2024-09-13T06:42:22.869 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:22.869 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.869 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.869 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:22.870 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888938+0000", 2024-09-13T06:42:22.870 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:22.870 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.870 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.870 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:22.870 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888938+0000", 2024-09-13T06:42:22.870 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:22.870 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.870 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.870 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:22.870 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888940+0000", 2024-09-13T06:42:22.870 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5330000000000001e-06 2024-09-13T06:42:22.870 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.871 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.871 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:22.871 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888947+0000", 2024-09-13T06:42:22.871 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.2389999999999999e-06 2024-09-13T06:42:22.871 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.871 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.871 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:22.871 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888952+0000", 2024-09-13T06:42:22.871 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.5720000000000002e-06 2024-09-13T06:42:22.871 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.871 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.871 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:22.871 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.939141+0000", 2024-09-13T06:42:22.871 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.050188903999999999 2024-09-13T06:42:22.872 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.872 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.872 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:22.872 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.939182+0000", 2024-09-13T06:42:22.872 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.0926000000000001e-05 2024-09-13T06:42:22.872 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.872 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.872 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:22.872 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.939233+0000", 2024-09-13T06:42:22.872 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0532999999999999e-05 2024-09-13T06:42:22.872 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:22.872 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:22.872 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:22.873 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.873 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.873 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:22007 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 13217792~4096 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:42:22.873 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.892771+0000", 2024-09-13T06:42:22.873 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 149.94259605100001, 2024-09-13T06:42:22.873 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049090024000000003, 2024-09-13T06:42:22.873 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:22.873 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:22.873 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:22.873 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:22.873 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:22.873 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 22007 2024-09-13T06:42:22.873 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.873 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:22.874 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.874 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:22.874 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892771+0000", 2024-09-13T06:42:22.874 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:22.874 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.874 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.874 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:22.874 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892771+0000", 2024-09-13T06:42:22.874 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:22.874 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.874 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.874 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:22.874 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892771+0000", 2024-09-13T06:42:22.874 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:42:22.874 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.875 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.875 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:22.875 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892772+0000", 2024-09-13T06:42:22.875 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.184e-06 2024-09-13T06:42:22.875 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.875 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.875 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:22.875 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892775+0000", 2024-09-13T06:42:22.875 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9179999999999998e-06 2024-09-13T06:42:22.875 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.875 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.875 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:22.875 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892778+0000", 2024-09-13T06:42:22.876 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4990000000000001e-06 2024-09-13T06:42:22.876 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.876 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.876 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:22.876 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.941760+0000", 2024-09-13T06:42:22.876 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.048982070000000003 2024-09-13T06:42:22.876 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.876 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.876 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:22.876 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.941808+0000", 2024-09-13T06:42:22.876 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.8278000000000001e-05 2024-09-13T06:42:22.876 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.877 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.877 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:22.877 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.941861+0000", 2024-09-13T06:42:22.877 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3284e-05 2024-09-13T06:42:22.877 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:22.877 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:22.877 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:22.877 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.877 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.877 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:22008 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 13246464~4096 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:42:22.877 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.892780+0000", 2024-09-13T06:42:22.877 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 149.94258739399999, 2024-09-13T06:42:22.877 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049200477999999999, 2024-09-13T06:42:22.878 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:22.878 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:22.878 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:22.878 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:22.878 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:22.878 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 22008 2024-09-13T06:42:22.878 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.878 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:22.878 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.878 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:22.878 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892780+0000", 2024-09-13T06:42:22.878 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:22.878 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.878 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.879 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:22.879 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892780+0000", 2024-09-13T06:42:22.879 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:22.879 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.879 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.879 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:22.879 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892780+0000", 2024-09-13T06:42:22.879 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:42:22.879 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.879 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.879 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:22.879 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892781+0000", 2024-09-13T06:42:22.879 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.083e-06 2024-09-13T06:42:22.880 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.880 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.880 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:22.880 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892784+0000", 2024-09-13T06:42:22.880 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.926e-06 2024-09-13T06:42:22.880 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.880 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.880 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:22.880 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892786+0000", 2024-09-13T06:42:22.880 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4490000000000002e-06 2024-09-13T06:42:22.880 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.880 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.881 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:22.881 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.941888+0000", 2024-09-13T06:42:22.881 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049102290999999999 2024-09-13T06:42:22.881 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.881 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.881 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:22.881 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.941929+0000", 2024-09-13T06:42:22.881 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.0541999999999999e-05 2024-09-13T06:42:22.881 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.881 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.881 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:22.881 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.941980+0000", 2024-09-13T06:42:22.881 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.1391999999999999e-05 2024-09-13T06:42:22.882 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:22.882 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:22.882 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:22.882 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.882 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.882 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:22009 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 13275136~4096 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:42:22.882 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.892788+0000", 2024-09-13T06:42:22.882 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 149.94257891000001, 2024-09-13T06:42:22.882 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049311926999999998, 2024-09-13T06:42:22.882 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:22.882 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:22.882 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:22.882 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:22.882 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:22.882 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 22009 2024-09-13T06:42:22.883 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.883 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:22.883 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.883 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:22.883 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892788+0000", 2024-09-13T06:42:22.883 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:22.883 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.883 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.883 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:22.883 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892788+0000", 2024-09-13T06:42:22.883 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:22.883 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.883 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.883 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:22.883 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892788+0000", 2024-09-13T06:42:22.883 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:42:22.884 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.884 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.884 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:22.884 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892789+0000", 2024-09-13T06:42:22.884 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1850000000000001e-06 2024-09-13T06:42:22.884 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.884 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.884 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:22.884 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892793+0000", 2024-09-13T06:42:22.884 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.9099999999999998e-06 2024-09-13T06:42:22.884 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.884 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.884 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:22.885 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892798+0000", 2024-09-13T06:42:22.885 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5070000000000002e-06 2024-09-13T06:42:22.885 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.885 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.885 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:22.885 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.942007+0000", 2024-09-13T06:42:22.885 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049208904999999997 2024-09-13T06:42:22.885 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.885 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.885 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:22.885 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.942049+0000", 2024-09-13T06:42:22.885 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.1922000000000003e-05 2024-09-13T06:42:22.885 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.885 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.886 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:22.886 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.942100+0000", 2024-09-13T06:42:22.886 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.1736000000000001e-05 2024-09-13T06:42:22.886 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:22.886 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:22.886 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:22.886 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.886 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.886 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:22010 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 13303808~4096 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:42:22.886 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.892817+0000", 2024-09-13T06:42:22.886 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 149.94255071399999, 2024-09-13T06:42:22.886 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049466149000000001, 2024-09-13T06:42:22.886 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:22.886 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:22.886 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:22.887 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:22.887 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:22.887 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 22010 2024-09-13T06:42:22.887 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.887 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:22.887 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.887 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:22.887 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892817+0000", 2024-09-13T06:42:22.887 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:22.887 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.887 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.887 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:22.887 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892817+0000", 2024-09-13T06:42:22.887 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:22.888 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.888 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.888 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:22.888 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892816+0000", 2024-09-13T06:42:22.888 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:22.888 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.888 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.888 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:22.888 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892821+0000", 2024-09-13T06:42:22.888 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9459999999999997e-06 2024-09-13T06:42:22.888 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.888 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.888 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:22.889 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892828+0000", 2024-09-13T06:42:22.889 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.6780000000000003e-06 2024-09-13T06:42:22.889 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.889 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.889 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:22.889 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892833+0000", 2024-09-13T06:42:22.889 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.8389999999999997e-06 2024-09-13T06:42:22.889 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.889 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.889 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:22.889 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.942127+0000", 2024-09-13T06:42:22.889 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049294163000000002 2024-09-13T06:42:22.889 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.890 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.890 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:22.890 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.942186+0000", 2024-09-13T06:42:22.890 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9335e-05 2024-09-13T06:42:22.890 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.890 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.890 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:22.890 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.942283+0000", 2024-09-13T06:42:22.890 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.6699000000000004e-05 2024-09-13T06:42:22.890 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:22.890 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:22.890 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:22.890 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.890 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.891 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:22011 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 13332480~4096 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:42:22.891 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.892838+0000", 2024-09-13T06:42:22.891 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 149.94252902700001, 2024-09-13T06:42:22.891 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049589214, 2024-09-13T06:42:22.891 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:22.891 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:22.891 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:22.891 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:22.891 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:22.891 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 22011 2024-09-13T06:42:22.891 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.891 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:22.891 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.892 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:22.892 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892838+0000", 2024-09-13T06:42:22.892 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:22.892 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.892 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.892 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:22.892 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892838+0000", 2024-09-13T06:42:22.892 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:22.892 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.892 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.892 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:22.892 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892838+0000", 2024-09-13T06:42:22.892 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:22.892 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.893 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.893 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:22.893 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892840+0000", 2024-09-13T06:42:22.893 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.136e-06 2024-09-13T06:42:22.893 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.893 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.893 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:22.893 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892852+0000", 2024-09-13T06:42:22.893 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2122e-05 2024-09-13T06:42:22.893 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.893 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.893 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:22.893 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892862+0000", 2024-09-13T06:42:22.893 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.7049999999999994e-06 2024-09-13T06:42:22.894 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.894 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.894 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:22.894 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.942319+0000", 2024-09-13T06:42:22.894 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049456623999999998 2024-09-13T06:42:22.894 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.894 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.894 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:22.894 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.942363+0000", 2024-09-13T06:42:22.894 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4759000000000003e-05 2024-09-13T06:42:22.894 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.894 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.894 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:22.895 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.942428+0000", 2024-09-13T06:42:22.895 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.4221999999999996e-05 2024-09-13T06:42:22.895 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:22.895 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:22.895 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:22.895 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.895 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.895 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:22338 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 13611008~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:42:22.895 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.951070+0000", 2024-09-13T06:42:22.895 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 149.884297506, 2024-09-13T06:42:22.895 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049135817999999998, 2024-09-13T06:42:22.895 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:22.895 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:22.895 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:22.895 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:22.895 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:22.896 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 22338 2024-09-13T06:42:22.896 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.896 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:22.896 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.896 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:22.896 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951070+0000", 2024-09-13T06:42:22.896 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:22.896 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.896 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.896 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:22.896 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951070+0000", 2024-09-13T06:42:22.896 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:22.896 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.897 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.897 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:22.897 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951069+0000", 2024-09-13T06:42:22.897 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:22.897 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.897 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.897 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:22.897 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951072+0000", 2024-09-13T06:42:22.897 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5909999999999998e-06 2024-09-13T06:42:22.897 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.897 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.897 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:22.897 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951078+0000", 2024-09-13T06:42:22.897 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.4450000000000001e-06 2024-09-13T06:42:22.898 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.898 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.898 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:22.898 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951083+0000", 2024-09-13T06:42:22.898 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7790000000000003e-06 2024-09-13T06:42:22.898 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.898 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.898 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:22.898 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:53.000020+0000", 2024-09-13T06:42:22.898 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.048936999000000002 2024-09-13T06:42:22.898 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.898 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.898 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:22.898 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:53.000106+0000", 2024-09-13T06:42:22.899 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.5532999999999996e-05 2024-09-13T06:42:22.899 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.899 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.899 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:22.899 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:53.000206+0000", 2024-09-13T06:42:22.899 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.9852999999999994e-05 2024-09-13T06:42:22.899 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:22.899 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:22.899 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:22.899 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.899 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.899 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:22339 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 13639680~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:42:22.899 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.951088+0000", 2024-09-13T06:42:22.899 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 149.884279808, 2024-09-13T06:42:22.900 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049238202000000002, 2024-09-13T06:42:22.900 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:22.900 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:22.900 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:22.900 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:22.900 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:22.900 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 22339 2024-09-13T06:42:22.900 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.900 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:22.900 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.900 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:22.900 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951088+0000", 2024-09-13T06:42:22.900 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:22.900 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.901 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.901 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:22.901 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951088+0000", 2024-09-13T06:42:22.901 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:22.901 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.901 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.901 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:22.901 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951087+0000", 2024-09-13T06:42:22.901 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:22.901 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.901 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.901 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:22.901 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951089+0000", 2024-09-13T06:42:22.901 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.153e-06 2024-09-13T06:42:22.902 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.902 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.902 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:22.902 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951093+0000", 2024-09-13T06:42:22.902 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.7120000000000002e-06 2024-09-13T06:42:22.902 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.902 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.902 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:22.902 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951096+0000", 2024-09-13T06:42:22.902 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.0570000000000001e-06 2024-09-13T06:42:22.902 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.902 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.902 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:22.903 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:53.000220+0000", 2024-09-13T06:42:22.903 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049123989 2024-09-13T06:42:22.903 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.903 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.903 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:22.903 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:53.000271+0000", 2024-09-13T06:42:22.903 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.062e-05 2024-09-13T06:42:22.903 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.903 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.903 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:22.903 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:53.000326+0000", 2024-09-13T06:42:22.903 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.5121000000000003e-05 2024-09-13T06:42:22.903 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:22.903 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:22.903 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:22.904 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.904 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.904 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:22340 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 13668352~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:42:22.904 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.951200+0000", 2024-09-13T06:42:22.904 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 149.88416691899999, 2024-09-13T06:42:22.904 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049352350000000003, 2024-09-13T06:42:22.904 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:22.904 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:22.904 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:22.904 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:22.904 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:22.904 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 22340 2024-09-13T06:42:22.904 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.904 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:22.905 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.905 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:22.905 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951200+0000", 2024-09-13T06:42:22.905 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:22.905 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.905 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.905 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:22.905 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951200+0000", 2024-09-13T06:42:22.905 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:22.905 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.905 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.905 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:22.905 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951098+0000", 2024-09-13T06:42:22.906 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.999898 2024-09-13T06:42:22.906 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.906 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.906 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:22.906 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951204+0000", 2024-09-13T06:42:22.906 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000105398 2024-09-13T06:42:22.906 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.906 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.906 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:22.906 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951211+0000", 2024-09-13T06:42:22.906 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.43e-06 2024-09-13T06:42:22.906 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.906 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.906 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:22.907 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951216+0000", 2024-09-13T06:42:22.907 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2800000000000003e-06 2024-09-13T06:42:22.907 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.907 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.907 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:22.907 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:53.000358+0000", 2024-09-13T06:42:22.907 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049142036 2024-09-13T06:42:22.907 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.907 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.907 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:22.907 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:53.000443+0000", 2024-09-13T06:42:22.907 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.4710999999999996e-05 2024-09-13T06:42:22.907 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.907 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.908 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:22.908 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:53.000553+0000", 2024-09-13T06:42:22.908 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000109622 2024-09-13T06:42:22.908 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:22.908 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:22.908 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:22.908 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.908 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.908 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:22348 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 13897728~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:42:22.908 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.952783+0000", 2024-09-13T06:42:22.908 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 149.88258413099999, 2024-09-13T06:42:22.908 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049120832000000003, 2024-09-13T06:42:22.908 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:22.908 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:22.908 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:22.909 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:22.909 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:22.909 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 22348 2024-09-13T06:42:22.909 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.909 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:22.909 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.909 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:22.909 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.952783+0000", 2024-09-13T06:42:22.909 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:22.909 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.909 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.909 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:22.909 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.952783+0000", 2024-09-13T06:42:22.910 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:22.910 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.910 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.910 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:22.910 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.952783+0000", 2024-09-13T06:42:22.910 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:22.910 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.910 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.910 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:22.910 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.952785+0000", 2024-09-13T06:42:22.910 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4980000000000001e-06 2024-09-13T06:42:22.910 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.910 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.910 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:22.911 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.952799+0000", 2024-09-13T06:42:22.911 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3825000000000001e-05 2024-09-13T06:42:22.911 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.911 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.911 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:22.911 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.952809+0000", 2024-09-13T06:42:22.911 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0043e-05 2024-09-13T06:42:22.911 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.911 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.911 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:22.911 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:53.001723+0000", 2024-09-13T06:42:22.911 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.048914065 2024-09-13T06:42:22.911 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.911 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.911 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:22.912 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:53.001807+0000", 2024-09-13T06:42:22.912 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.3776000000000006e-05 2024-09-13T06:42:22.912 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.912 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.912 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:22.912 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:53.001904+0000", 2024-09-13T06:42:22.912 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.7004999999999997e-05 2024-09-13T06:42:22.912 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:22.912 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:22.912 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:22.912 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.912 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.912 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:69045 3.0 3:05ea3821:::rbd_data.1121867cc19b.0000000000000000:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109)", 2024-09-13T06:42:22.912 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:41:03.637760+0000", 2024-09-13T06:42:22.912 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 79.197607372999997, 2024-09-13T06:42:22.913 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.052276712000000003, 2024-09-13T06:42:22.913 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:22.913 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:42:22.913 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:22.913 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:22.913 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:22.913 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 69045 2024-09-13T06:42:22.913 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.913 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:22.913 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.913 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:22.913 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:03.637760+0000", 2024-09-13T06:42:22.913 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:22.913 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.914 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.914 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:22.914 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:03.637760+0000", 2024-09-13T06:42:22.914 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:22.914 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.914 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.914 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:22.914 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:03.637758+0000", 2024-09-13T06:42:22.914 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999981 2024-09-13T06:42:22.914 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.914 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.914 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:22.914 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:03.637770+0000", 2024-09-13T06:42:22.914 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1533e-05 2024-09-13T06:42:22.914 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.915 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.915 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:22.915 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:03.637794+0000", 2024-09-13T06:42:22.915 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4243000000000002e-05 2024-09-13T06:42:22.915 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.915 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.915 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:22.915 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:03.637806+0000", 2024-09-13T06:42:22.915 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2033e-05 2024-09-13T06:42:22.915 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.915 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.915 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:22.915 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:03.637891+0000", 2024-09-13T06:42:22.915 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.5358000000000005e-05 2024-09-13T06:42:22.915 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.915 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.916 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:22.916 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:03.638042+0000", 2024-09-13T06:42:22.916 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000151073 2024-09-13T06:42:22.916 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.916 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.916 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 2", 2024-09-13T06:42:22.916 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:03.647124+0000", 2024-09-13T06:42:22.916 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0090821670000000004 2024-09-13T06:42:22.916 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.916 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.916 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:42:22.916 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:03.689849+0000", 2024-09-13T06:42:22.916 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.042724445999999999 2024-09-13T06:42:22.916 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.916 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.917 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-09-13T06:42:22.917 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:03.689871+0000", 2024-09-13T06:42:22.917 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1778999999999999e-05 2024-09-13T06:42:22.917 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.917 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.917 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:42:22.917 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:03.689965+0000", 2024-09-13T06:42:22.917 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.4312000000000001e-05 2024-09-13T06:42:22.917 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.917 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.917 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:22.917 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:03.690037+0000", 2024-09-13T06:42:22.917 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.1687999999999995e-05 2024-09-13T06:42:22.918 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:22.918 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:22.918 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:22.918 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.918 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.918 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:90987 3.6 3:6263dd97:::rbd_object_map.11212443ae03.0000000000000049:head [call] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-13T06:42:22.918 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:41:35.460333+0000", 2024-09-13T06:42:22.918 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 47.375033985999998, 2024-09-13T06:42:22.918 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0001633640000001, 2024-09-13T06:42:22.918 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:22.918 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:22.918 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:22.918 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:22.918 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:22.918 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 90987 2024-09-13T06:42:22.918 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.919 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:22.919 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.919 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:22.919 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:35.460333+0000", 2024-09-13T06:42:22.919 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:22.919 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.919 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.919 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:22.919 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:35.460333+0000", 2024-09-13T06:42:22.919 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:22.919 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.919 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.919 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:22.919 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:35.460330+0000", 2024-09-13T06:42:22.919 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999971 2024-09-13T06:42:22.920 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.920 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.920 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:22.920 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:35.460343+0000", 2024-09-13T06:42:22.920 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2695e-05 2024-09-13T06:42:22.920 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.920 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.920 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:22.920 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:35.460365+0000", 2024-09-13T06:42:22.920 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2473999999999999e-05 2024-09-13T06:42:22.920 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.920 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.920 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:22.921 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:35.460376+0000", 2024-09-13T06:42:22.921 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0383999999999999e-05 2024-09-13T06:42:22.921 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.921 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.921 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:22.921 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:35.460435+0000", 2024-09-13T06:42:22.921 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8650000000000003e-05 2024-09-13T06:42:22.921 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.921 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.921 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:42:22.921 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:35.460444+0000", 2024-09-13T06:42:22.921 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.0380000000000005e-06 2024-09-13T06:42:22.921 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.921 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.922 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:22.922 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:36.459433+0000", 2024-09-13T06:42:22.922 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.99898895799999998 2024-09-13T06:42:22.922 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.922 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.922 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:22.922 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:36.459622+0000", 2024-09-13T06:42:22.922 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00018940299999999999 2024-09-13T06:42:22.922 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.922 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.922 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:22.922 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:36.460497+0000", 2024-09-13T06:42:22.922 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00087481199999999999 2024-09-13T06:42:22.922 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:22.923 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:22.923 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:22.923 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.923 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.923 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:159632 3.a 3:57f62123:::rbd_header.112138ed422:head [create,call rbd.create in=9b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e167)", 2024-09-13T06:42:22.923 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:42:07.853351+0000", 2024-09-13T06:42:22.923 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 14.982016184000001, 2024-09-13T06:42:22.923 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.95572760999999995, 2024-09-13T06:42:22.923 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:22.923 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:42:22.923 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:22.923 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:22.923 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:22.923 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 159632 2024-09-13T06:42:22.923 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.924 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:22.924 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.924 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:22.924 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:07.853351+0000", 2024-09-13T06:42:22.924 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:22.924 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.924 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.924 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:22.924 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:07.853351+0000", 2024-09-13T06:42:22.924 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:22.924 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.924 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.924 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:22.924 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:07.853350+0000", 2024-09-13T06:42:22.924 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.999999 2024-09-13T06:42:22.925 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.925 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.925 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:22.925 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:07.853356+0000", 2024-09-13T06:42:22.925 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.1560000000000003e-06 2024-09-13T06:42:22.925 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.925 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.925 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:22.925 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:07.853365+0000", 2024-09-13T06:42:22.925 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.8079999999999999e-06 2024-09-13T06:42:22.925 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.925 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.925 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:22.926 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:07.853372+0000", 2024-09-13T06:42:22.926 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.5540000000000003e-06 2024-09-13T06:42:22.926 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.926 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.926 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:22.926 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:07.853430+0000", 2024-09-13T06:42:22.926 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8038000000000002e-05 2024-09-13T06:42:22.926 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.926 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.926 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:42:22.926 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:07.853444+0000", 2024-09-13T06:42:22.926 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3719e-05 2024-09-13T06:42:22.926 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.926 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.926 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:22.927 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:08.804052+0000", 2024-09-13T06:42:22.927 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.95060817799999997 2024-09-13T06:42:22.927 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.927 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.927 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:22.927 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:08.804234+0000", 2024-09-13T06:42:22.927 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00018192999999999999 2024-09-13T06:42:22.927 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.927 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.927 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 6", 2024-09-13T06:42:22.927 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:08.804797+0000", 2024-09-13T06:42:22.927 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00056282399999999996 2024-09-13T06:42:22.927 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.927 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.927 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-09-13T06:42:22.927 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:08.805704+0000", 2024-09-13T06:42:22.928 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00090781 2024-09-13T06:42:22.928 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.928 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.928 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:42:22.928 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:08.808907+0000", 2024-09-13T06:42:22.928 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0032031239999999999 2024-09-13T06:42:22.928 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.928 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.928 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:42:22.928 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:08.808998+0000", 2024-09-13T06:42:22.928 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.0191000000000004e-05 2024-09-13T06:42:22.928 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:22.928 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:22.928 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:22.929 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:08.809079+0000", 2024-09-13T06:42:22.929 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.1076999999999996e-05 2024-09-13T06:42:22.929 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:22.929 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:22.929 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:22.929 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:22.929 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:22.929 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:42:22.930 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-13T06:42:22.931 INFO:tasks.ceph.osd.6.smithi139.stderr:2024-09-13T06:42:22.925+0000 7fcd02c5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26385) UID: 0 2024-09-13T06:42:23.031 INFO:tasks.ceph.osd.6.smithi139.stderr:2024-09-13T06:42:23.025+0000 7fcd02c5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26385) UID: 0 2024-09-13T06:42:23.098 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:42:23.098 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-13T06:42:23.098 INFO:teuthology.orchestra.run.smithi081.stdout: "num_ops": 0 2024-09-13T06:42:23.098 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:42:23.112 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-13T06:42:23.131 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:42:23.129+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:42:23.202 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-13T06:42:23.233 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:42:23.233+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:42:23.236 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:42:23.236 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-13T06:42:23.236 INFO:teuthology.orchestra.run.smithi081.stdout: "complaint_time": 30, 2024-09-13T06:42:23.236 INFO:teuthology.orchestra.run.smithi081.stdout: "num_blocked_ops": 0 2024-09-13T06:42:23.236 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:42:23.251 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-13T06:42:23.341 INFO:teuthology.orchestra.run.smithi081.stdout:osd.0: {} 2024-09-13T06:42:23.341 INFO:teuthology.orchestra.run.smithi081.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-13T06:42:23.342 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:42:23.336+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:42:23.358 INFO:teuthology.orchestra.run.smithi081.stdout:osd.1: {} 2024-09-13T06:42:23.358 INFO:teuthology.orchestra.run.smithi081.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-13T06:42:23.374 INFO:teuthology.orchestra.run.smithi081.stdout:osd.2: {} 2024-09-13T06:42:23.374 INFO:teuthology.orchestra.run.smithi081.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-13T06:42:23.391 INFO:teuthology.orchestra.run.smithi081.stdout:osd.3: {} 2024-09-13T06:42:23.391 INFO:teuthology.orchestra.run.smithi081.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-13T06:42:23.411 INFO:teuthology.orchestra.run.smithi081.stdout:osd.4: {} 2024-09-13T06:42:23.411 INFO:teuthology.orchestra.run.smithi081.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-13T06:42:23.413 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:42:23.413 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:42:23.427 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-13T06:42:23.431 INFO:teuthology.orchestra.run.smithi081.stdout:osd.5: {} 2024-09-13T06:42:23.431 INFO:teuthology.orchestra.run.smithi081.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-13T06:42:23.434 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:42:23.429+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:42:23.451 INFO:teuthology.orchestra.run.smithi081.stdout:osd.6: {} 2024-09-13T06:42:23.452 INFO:teuthology.orchestra.run.smithi081.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-13T06:42:23.452 INFO:teuthology.orchestra.run.smithi081.stderr:Error ENXIO: problem getting command descriptions from osd.7 2024-09-13T06:42:23.455 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-13T06:42:23.456 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-13T06:42:23.510 INFO:teuthology.orchestra.run.smithi081.stderr:nodeep-scrub is unset 2024-09-13T06:42:23.535 INFO:tasks.ceph.osd.6.smithi139.stderr:2024-09-13T06:42:23.529+0000 7fcd02c5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26385) UID: 0 2024-09-13T06:42:23.570 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:42:23.570 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:42:23.594 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-13T06:42:23.635 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:42:23.629+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:42:23.736 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:42:23.732+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:42:23.806 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:42:23.807 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:42:23.827 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-13T06:42:23.836 INFO:tasks.ceph.osd.6.smithi139.stderr:2024-09-13T06:42:23.833+0000 7fcd02c5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26385) UID: 0 2024-09-13T06:42:23.937 INFO:tasks.ceph.osd.6.smithi139.stderr:2024-09-13T06:42:23.933+0000 7fcd02c5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26385) UID: 0 2024-09-13T06:42:23.990 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:42:23.990 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:42:24.005 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-13T06:42:24.048 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:42:24.045+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:42:24.130 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:42:24.130 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:42:24.139 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:42:24.136+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:42:24.143 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-13T06:42:24.240 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:42:24.236+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:42:24.304 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:42:24.305 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:42:24.318 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-13T06:42:24.364 INFO:tasks.ceph.osd.6.smithi139.stderr:2024-09-13T06:42:24.361+0000 7fcd02c5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26385) UID: 0 2024-09-13T06:42:24.440 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:42:24.441 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:42:24.441 INFO:tasks.ceph.osd.6.smithi139.stderr:2024-09-13T06:42:24.437+0000 7fcd02c5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26385) UID: 0 2024-09-13T06:42:24.454 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-13T06:42:24.542 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:42:24.540+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:42:24.615 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:42:24.615 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:42:24.629 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-13T06:42:24.672 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:42:24.669+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:42:24.706 INFO:teuthology.orchestra.run.smithi081.stdout:checking clone #32, image image_client.0-clone32 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent33 2024-09-13T06:42:24.743 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:42:24.737+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:42:24.754 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:42:24.754 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:42:24.768 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-13T06:42:24.856 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:42:24.853+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:42:24.931 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:42:24.931 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:42:24.944 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-13T06:42:24.945 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:42:24.940+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:42:25.034 INFO:teuthology.orchestra.run.smithi081.stdout:4563 read 0x12f44d3 thru 0x12feb76 (0xa6a4 bytes) 2024-09-13T06:42:25.041 INFO:teuthology.orchestra.run.smithi081.stdout:4564 trunc from 0x86fe2a8 to 0x4089fc4 2024-09-13T06:42:25.045 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:42:25.040+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:42:25.071 INFO:teuthology.orchestra.run.smithi081.stdout:4565 read 0x3bf4583 thru 0x3bf83a9 (0x3e27 bytes) 2024-09-13T06:42:25.074 INFO:teuthology.orchestra.run.smithi081.stdout:4566 trunc from 0x4089fc4 to 0x652dc88 2024-09-13T06:42:25.086 INFO:teuthology.orchestra.run.smithi081.stdout:4568 read 0x57abd15 thru 0x57b609b (0xa387 bytes) 2024-09-13T06:42:25.112 INFO:teuthology.orchestra.run.smithi081.stdout:4569 write 0xeab23ac thru 0xeab4155 (0x1daa bytes) 2024-09-13T06:42:25.114 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:42:25.114 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:42:25.126 INFO:teuthology.orchestra.run.smithi081.stdout:4571 trunc from 0xeab4156 to 0xe4db95d 2024-09-13T06:42:25.130 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-13T06:42:25.141 INFO:teuthology.orchestra.run.smithi081.stdout:4572 read 0xbaf979d thru 0xbb0633e (0xcba2 bytes) 2024-09-13T06:42:25.141 INFO:teuthology.orchestra.run.smithi081.stdout:4573 punch from 0x7c3336a to 0x7c41ace, (0xe764 bytes) 2024-09-13T06:42:25.141 INFO:teuthology.orchestra.run.smithi081.stdout:4575 read 0xd03c374 thru 0xd047cdc (0xb969 bytes) 2024-09-13T06:42:25.141 INFO:teuthology.orchestra.run.smithi081.stdout:4576 read 0x1f3faf thru 0x203232 (0xf284 bytes) 2024-09-13T06:42:25.142 INFO:teuthology.orchestra.run.smithi081.stdout:4579 read 0x290f5d9 thru 0x291161b (0x2043 bytes) 2024-09-13T06:42:25.151 INFO:teuthology.orchestra.run.smithi081.stdout:4580 writesame 0xe652702 thru 0xe658ffd data_size 0x2(0x68fc bytes) 2024-09-13T06:42:25.151 INFO:teuthology.orchestra.run.smithi081.stdout:4582 read 0x4564b7f thru 0x456f5e8 (0xaa6a bytes) 2024-09-13T06:42:25.151 INFO:teuthology.orchestra.run.smithi081.stdout:4586 punch from 0x98e87e3 to 0x98f5c7e, (0xd49b bytes) 2024-09-13T06:42:25.151 INFO:teuthology.orchestra.run.smithi081.stdout:4587 writesame 0xb8bcabd thru 0xb8c01f6 data_size 0x1(0x373a bytes) 2024-09-13T06:42:25.162 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:42:25.162 INFO:teuthology.orchestra.run.smithi081.stdout:4589 read 0x487bb1 thru 0x493437 (0xb887 bytes) 2024-09-13T06:42:25.164 INFO:teuthology.orchestra.run.smithi081.stdout:4591 write 0xd535eea thru 0xd53989b (0x39b2 bytes) 2024-09-13T06:42:25.176 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:42:25.173+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:42:25.199 INFO:teuthology.orchestra.run.smithi081.stdout:4592 trunc from 0xe658ffe to 0x34db9f4 2024-09-13T06:42:25.241 INFO:teuthology.orchestra.run.smithi081.stdout:4595 trunc from 0x34db9f4 to 0xaf41f08 2024-09-13T06:42:25.247 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:42:25.244+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:42:25.257 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:42:25.258 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:42:25.260 INFO:teuthology.orchestra.run.smithi081.stdout:4596 trunc from 0xaf41f08 to 0xc3cb7d0 2024-09-13T06:42:25.272 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-13T06:42:25.277 INFO:teuthology.orchestra.run.smithi081.stdout:4597 punch from 0x94a4574 to 0x94ad844, (0x92d0 bytes) 2024-09-13T06:42:25.277 INFO:teuthology.orchestra.run.smithi081.stdout:4598 writesame 0x40d6970 thru 0x40e58b2 data_size 0x11(0xef43 bytes) 2024-09-13T06:42:25.290 INFO:teuthology.orchestra.run.smithi081.stdout:4599 read 0x8284841 thru 0x828c36f (0x7b2f bytes) 2024-09-13T06:42:25.291 INFO:teuthology.orchestra.run.smithi081.stdout:4600 writesame 0x8d9142b thru 0x8d9b5b9 data_size 0x1(0xa18f bytes) 2024-09-13T06:42:25.320 INFO:teuthology.orchestra.run.smithi081.stdout:4602 trunc from 0xc3cb7d0 to 0xc3fc211 2024-09-13T06:42:25.330 INFO:teuthology.orchestra.run.smithi081.stdout:4603 read 0x4e0d8c thru 0x4e94f1 (0x8766 bytes) 2024-09-13T06:42:25.331 INFO:teuthology.orchestra.run.smithi081.stdout:4604 read 0xbbba063 thru 0xbbc3ab4 (0x9a52 bytes) 2024-09-13T06:42:25.348 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:42:25.344+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:42:25.349 INFO:teuthology.orchestra.run.smithi081.stdout:4605 write 0xe26d258 thru 0xe278a70 (0xb819 bytes) 2024-09-13T06:42:25.358 INFO:teuthology.orchestra.run.smithi081.stdout:4607 writesame 0xc3d013a thru 0xc3d1d1e data_size 0x1(0x1be5 bytes) 2024-09-13T06:42:25.395 INFO:teuthology.orchestra.run.smithi081.stdout:4608 trunc from 0xe278a71 to 0x41c0ef3 2024-09-13T06:42:25.418 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:42:25.418 INFO:teuthology.orchestra.run.smithi081.stdout:4613 clone 35 order 25 su 4194304 sc 9 2024-09-13T06:42:25.439 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:42:25.440 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:42:25.449 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:42:25.444+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:42:25.454 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-13T06:42:25.457 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-13T06:42:25.536 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-13T06:42:25.549 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:42:25.545+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:42:25.590 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:42:25.590 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:42:25.609 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-13T06:42:25.648 INFO:teuthology.orchestra.run.smithi081.stdout:osd.0: {} 2024-09-13T06:42:25.648 INFO:teuthology.orchestra.run.smithi081.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-13T06:42:25.650 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:42:25.648+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:42:25.665 INFO:teuthology.orchestra.run.smithi081.stdout:osd.1: {} 2024-09-13T06:42:25.665 INFO:teuthology.orchestra.run.smithi081.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-13T06:42:25.686 INFO:teuthology.orchestra.run.smithi081.stdout:osd.2: {} 2024-09-13T06:42:25.686 INFO:teuthology.orchestra.run.smithi081.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-13T06:42:25.716 INFO:teuthology.orchestra.run.smithi081.stdout:osd.3: {} 2024-09-13T06:42:25.716 INFO:teuthology.orchestra.run.smithi081.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-13T06:42:25.728 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:42:25.729 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-13T06:42:25.729 INFO:teuthology.orchestra.run.smithi081.stdout: "complaint_time": 30, 2024-09-13T06:42:25.729 INFO:teuthology.orchestra.run.smithi081.stdout: "num_blocked_ops": 0 2024-09-13T06:42:25.729 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:42:25.743 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-13T06:42:25.750 INFO:teuthology.orchestra.run.smithi081.stdout:osd.4: {} 2024-09-13T06:42:25.750 INFO:teuthology.orchestra.run.smithi081.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-13T06:42:25.751 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:42:25.745+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:42:25.784 INFO:teuthology.orchestra.run.smithi081.stdout:osd.5: {} 2024-09-13T06:42:25.784 INFO:teuthology.orchestra.run.smithi081.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-13T06:42:25.819 INFO:teuthology.orchestra.run.smithi081.stdout:osd.6: {} 2024-09-13T06:42:25.819 INFO:teuthology.orchestra.run.smithi081.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-13T06:42:25.819 INFO:teuthology.orchestra.run.smithi081.stderr:Error ENXIO: problem getting command descriptions from osd.7 2024-09-13T06:42:25.823 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-13T06:42:25.824 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-13T06:42:25.866 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:42:25.866 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 20, 2024-09-13T06:42:25.866 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 600, 2024-09-13T06:42:25.866 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [ 2024-09-13T06:42:25.866 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:25.866 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:37801 3.1 3:82e31015:::rbd_object_map.1121d8143c6e.0000000000000019:head [call] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e55)", 2024-09-13T06:42:25.867 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:05.646191+0000", 2024-09-13T06:42:25.867 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 140.22039071, 2024-09-13T06:42:25.867 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.72659507800000001, 2024-09-13T06:42:25.867 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:25.867 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:25.867 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:25.867 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:25.867 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:25.867 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 37801 2024-09-13T06:42:25.867 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:25.867 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:25.867 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:25.867 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:25.867 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:05.646191+0000", 2024-09-13T06:42:25.867 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:25.868 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:25.868 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:25.868 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:25.868 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:05.646191+0000", 2024-09-13T06:42:25.868 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:25.868 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:25.868 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:25.868 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:25.868 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:05.646188+0000", 2024-09-13T06:42:25.868 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999971 2024-09-13T06:42:25.868 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:25.868 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:25.868 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:25.868 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:05.646206+0000", 2024-09-13T06:42:25.869 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8182999999999999e-05 2024-09-13T06:42:25.869 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:25.869 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:25.869 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:25.869 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:05.646237+0000", 2024-09-13T06:42:25.869 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.1071000000000001e-05 2024-09-13T06:42:25.869 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:25.869 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:25.869 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:25.869 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:05.646251+0000", 2024-09-13T06:42:25.869 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3679000000000001e-05 2024-09-13T06:42:25.869 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:25.869 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:25.869 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:25.870 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:05.646321+0000", 2024-09-13T06:42:25.870 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.9831000000000003e-05 2024-09-13T06:42:25.870 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:25.870 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:25.870 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:42:25.870 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:05.646331+0000", 2024-09-13T06:42:25.870 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0242e-05 2024-09-13T06:42:25.870 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:25.870 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:25.870 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:25.870 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.371959+0000", 2024-09-13T06:42:25.870 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.72562817199999996 2024-09-13T06:42:25.870 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:25.870 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:25.870 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:25.871 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.372389+0000", 2024-09-13T06:42:25.871 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00042977400000000001 2024-09-13T06:42:25.871 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:25.871 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:25.871 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:25.871 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.372786+0000", 2024-09-13T06:42:25.871 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00039706099999999999 2024-09-13T06:42:25.871 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:25.871 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:25.871 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:25.871 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:25.871 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:25.871 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43009 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 489472~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:42:25.871 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.644660+0000", 2024-09-13T06:42:25.871 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 124.221921748, 2024-09-13T06:42:25.872 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123376071, 2024-09-13T06:42:25.872 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:25.872 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:25.872 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:25.872 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:25.872 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:25.872 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43009 2024-09-13T06:42:25.872 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:25.872 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:25.872 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:25.872 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:25.872 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.644660+0000", 2024-09-13T06:42:25.872 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:25.872 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:25.873 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:25.873 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:25.873 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.644660+0000", 2024-09-13T06:42:25.873 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:25.873 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:25.873 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:25.873 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:25.873 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.644659+0000", 2024-09-13T06:42:25.873 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:25.873 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:25.873 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:25.873 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:25.873 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.644662+0000", 2024-09-13T06:42:25.874 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4949999999999998e-06 2024-09-13T06:42:25.874 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:25.874 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:25.874 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:25.874 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.644669+0000", 2024-09-13T06:42:25.874 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.289e-06 2024-09-13T06:42:25.874 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:25.874 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:25.874 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:25.874 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.644674+0000", 2024-09-13T06:42:25.874 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.8840000000000002e-06 2024-09-13T06:42:25.874 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:25.874 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:25.874 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:25.874 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.767602+0000", 2024-09-13T06:42:25.875 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.122928158 2024-09-13T06:42:25.875 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:25.875 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:25.875 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:25.875 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.767676+0000", 2024-09-13T06:42:25.875 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3992999999999994e-05 2024-09-13T06:42:25.875 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:25.875 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:25.875 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:25.875 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.768036+0000", 2024-09-13T06:42:25.875 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00035966200000000001 2024-09-13T06:42:25.875 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:25.875 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:25.875 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:25.875 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:25.876 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:25.876 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43010 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 503808~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:42:25.876 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.644678+0000", 2024-09-13T06:42:25.876 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 124.221903422, 2024-09-13T06:42:25.876 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123728798, 2024-09-13T06:42:25.876 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:25.876 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:25.876 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:25.876 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:25.876 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:25.876 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43010 2024-09-13T06:42:25.876 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:25.876 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:25.876 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:25.876 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:25.877 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.644678+0000", 2024-09-13T06:42:25.877 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:25.877 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:25.877 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:25.877 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:25.877 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.644678+0000", 2024-09-13T06:42:25.877 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:25.877 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:25.877 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:25.877 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:25.877 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.644678+0000", 2024-09-13T06:42:25.877 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:25.877 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:25.877 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:25.878 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:25.878 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.644680+0000", 2024-09-13T06:42:25.878 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2050000000000001e-06 2024-09-13T06:42:25.878 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:25.878 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:25.878 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:25.878 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.644686+0000", 2024-09-13T06:42:25.878 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8440000000000003e-06 2024-09-13T06:42:25.878 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:25.878 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:25.879 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:25.879 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.644691+0000", 2024-09-13T06:42:25.879 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.118e-06 2024-09-13T06:42:25.879 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:25.879 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:25.879 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:25.879 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.768065+0000", 2024-09-13T06:42:25.879 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123374698 2024-09-13T06:42:25.879 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:25.879 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:25.879 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:25.879 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.768139+0000", 2024-09-13T06:42:25.879 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3934000000000001e-05 2024-09-13T06:42:25.879 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:25.879 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:25.880 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:25.880 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.768407+0000", 2024-09-13T06:42:25.880 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00026738800000000002 2024-09-13T06:42:25.880 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:25.880 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:25.880 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:25.880 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:25.880 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:25.880 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43181 3.17 3:ec5ebce4:::rbd_data.1121f5f2e1c0.0000000000000001:1f [read 319488~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:42:25.880 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.652968+0000", 2024-09-13T06:42:25.880 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 124.21361290599999, 2024-09-13T06:42:25.880 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.12363807, 2024-09-13T06:42:25.880 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:25.880 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:25.881 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:25.881 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:25.881 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:25.881 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43181 2024-09-13T06:42:25.881 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:25.881 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:25.881 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:25.881 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:25.881 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.652968+0000", 2024-09-13T06:42:25.881 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:25.881 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:25.881 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:25.881 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:25.881 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.652968+0000", 2024-09-13T06:42:25.882 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:25.882 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:25.882 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:25.882 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:25.882 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.652968+0000", 2024-09-13T06:42:25.882 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:25.882 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:25.882 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:25.882 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:25.882 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.652970+0000", 2024-09-13T06:42:25.882 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2409999999999998e-06 2024-09-13T06:42:25.882 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:25.882 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:25.882 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:25.882 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.652976+0000", 2024-09-13T06:42:25.883 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0079999999999999e-06 2024-09-13T06:42:25.883 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:25.883 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:25.883 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:25.883 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.652981+0000", 2024-09-13T06:42:25.883 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4390000000000002e-06 2024-09-13T06:42:25.883 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:25.883 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:25.883 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:25.883 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.776275+0000", 2024-09-13T06:42:25.883 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.12329396099999999 2024-09-13T06:42:25.883 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:25.883 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:25.884 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:25.884 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.776316+0000", 2024-09-13T06:42:25.884 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.1244e-05 2024-09-13T06:42:25.884 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:25.884 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:25.884 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:25.884 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.776607+0000", 2024-09-13T06:42:25.884 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00029051199999999999 2024-09-13T06:42:25.884 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:25.884 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:25.884 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:25.884 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:25.884 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:25.884 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43182 3.17 3:ec5ebce4:::rbd_data.1121f5f2e1c0.0000000000000001:1f [read 333824~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:42:25.885 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.652985+0000", 2024-09-13T06:42:25.885 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 124.21359609700001, 2024-09-13T06:42:25.885 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123926616, 2024-09-13T06:42:25.885 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:25.885 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:25.885 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:25.885 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:25.885 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:25.885 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43182 2024-09-13T06:42:25.885 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:25.885 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:25.885 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:25.885 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:25.885 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.652985+0000", 2024-09-13T06:42:25.886 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:25.886 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:25.886 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:25.886 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:25.886 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.652985+0000", 2024-09-13T06:42:25.886 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:25.886 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:25.886 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:25.886 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:25.886 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.652985+0000", 2024-09-13T06:42:25.886 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:25.886 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:25.886 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:25.886 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:25.886 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.652987+0000", 2024-09-13T06:42:25.887 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0899999999999999e-06 2024-09-13T06:42:25.887 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:25.887 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:25.887 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:25.887 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.652994+0000", 2024-09-13T06:42:25.887 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3100000000000003e-06 2024-09-13T06:42:25.887 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:25.887 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:25.887 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:25.887 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.653000+0000", 2024-09-13T06:42:25.887 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2020000000000003e-06 2024-09-13T06:42:25.887 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:25.887 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:25.887 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:25.887 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.776635+0000", 2024-09-13T06:42:25.888 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.12363529400000001 2024-09-13T06:42:25.888 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:25.888 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:25.888 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:25.888 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.776676+0000", 2024-09-13T06:42:25.888 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.0745999999999999e-05 2024-09-13T06:42:25.888 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:25.888 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:25.888 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:25.888 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.776912+0000", 2024-09-13T06:42:25.888 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00023631300000000001 2024-09-13T06:42:25.888 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:25.888 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:25.888 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:25.888 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:25.889 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:25.889 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43192 3.17 3:ec5ebce4:::rbd_data.1121f5f2e1c0.0000000000000001:1f [read 466944~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:42:25.889 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.656622+0000", 2024-09-13T06:42:25.889 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 124.209959041, 2024-09-13T06:42:25.889 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123503136, 2024-09-13T06:42:25.889 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:25.889 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:25.889 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:25.889 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:25.889 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:25.889 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43192 2024-09-13T06:42:25.889 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:25.889 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:25.889 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:25.890 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:25.890 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656622+0000", 2024-09-13T06:42:25.890 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:25.890 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:25.890 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:25.890 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:25.890 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656622+0000", 2024-09-13T06:42:25.890 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:25.890 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:25.890 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:25.890 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:25.890 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656622+0000", 2024-09-13T06:42:25.890 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:42:25.890 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:25.890 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:25.891 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:25.891 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656623+0000", 2024-09-13T06:42:25.891 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2079999999999999e-06 2024-09-13T06:42:25.891 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:25.891 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:25.891 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:25.891 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656627+0000", 2024-09-13T06:42:25.891 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.4819999999999999e-06 2024-09-13T06:42:25.891 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:25.891 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:25.891 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:25.891 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656629+0000", 2024-09-13T06:42:25.891 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.582e-06 2024-09-13T06:42:25.891 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:25.891 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:25.892 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:25.892 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.779866+0000", 2024-09-13T06:42:25.892 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.12323638100000001 2024-09-13T06:42:25.892 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:25.892 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:25.892 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:25.892 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.779905+0000", 2024-09-13T06:42:25.892 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.9529e-05 2024-09-13T06:42:25.892 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:25.892 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:25.892 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:25.892 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.780125+0000", 2024-09-13T06:42:25.892 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000220168 2024-09-13T06:42:25.892 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:25.893 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:25.893 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:25.893 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:25.893 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:25.893 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43193 3.17 3:ec5ebce4:::rbd_data.1121f5f2e1c0.0000000000000001:1f [read 481280~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:42:25.893 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.656635+0000", 2024-09-13T06:42:25.893 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 124.20994655699999, 2024-09-13T06:42:25.893 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.12374478999999999, 2024-09-13T06:42:25.893 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:25.893 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:25.893 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:25.893 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:25.894 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:25.894 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43193 2024-09-13T06:42:25.894 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:25.894 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:25.894 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:25.894 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:25.894 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656635+0000", 2024-09-13T06:42:25.894 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:25.894 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:25.894 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:25.894 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:25.894 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656635+0000", 2024-09-13T06:42:25.894 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:25.894 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:25.895 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:25.895 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:25.895 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656635+0000", 2024-09-13T06:42:25.895 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:42:25.895 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:25.895 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:25.895 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:25.895 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656636+0000", 2024-09-13T06:42:25.895 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.544e-06 2024-09-13T06:42:25.895 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:25.895 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:25.895 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:25.895 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656639+0000", 2024-09-13T06:42:25.896 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.0879999999999999e-06 2024-09-13T06:42:25.896 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:25.896 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:25.896 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:25.896 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656642+0000", 2024-09-13T06:42:25.896 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5799999999999999e-06 2024-09-13T06:42:25.896 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:25.896 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:25.896 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:25.896 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.780151+0000", 2024-09-13T06:42:25.896 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123509035 2024-09-13T06:42:25.896 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:25.896 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:25.896 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:25.897 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.780191+0000", 2024-09-13T06:42:25.897 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.9758000000000001e-05 2024-09-13T06:42:25.897 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:25.897 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:25.897 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:25.897 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.780380+0000", 2024-09-13T06:42:25.897 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000189023 2024-09-13T06:42:25.897 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:25.897 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:25.897 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:25.897 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:25.897 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:25.897 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43194 3.17 3:ec5ebce4:::rbd_data.1121f5f2e1c0.0000000000000001:1f [read 495616~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:42:25.898 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.656645+0000", 2024-09-13T06:42:25.898 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 124.20993590400001, 2024-09-13T06:42:25.898 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.124088483, 2024-09-13T06:42:25.898 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:25.898 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:25.898 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:25.898 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:25.898 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:25.898 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43194 2024-09-13T06:42:25.898 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:25.898 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:25.898 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:25.898 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:25.898 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656645+0000", 2024-09-13T06:42:25.899 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:25.899 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:25.899 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:25.899 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:25.899 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656645+0000", 2024-09-13T06:42:25.899 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:25.899 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:25.899 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:25.899 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:25.899 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656645+0000", 2024-09-13T06:42:25.899 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:25.899 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:25.899 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:25.899 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:25.899 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656647+0000", 2024-09-13T06:42:25.899 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9180000000000001e-06 2024-09-13T06:42:25.900 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:25.900 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:25.900 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:25.900 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656653+0000", 2024-09-13T06:42:25.900 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7860000000000002e-06 2024-09-13T06:42:25.900 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:25.900 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:25.900 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:25.900 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656658+0000", 2024-09-13T06:42:25.900 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6949999999999999e-06 2024-09-13T06:42:25.900 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:25.900 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:25.900 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:25.900 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.780406+0000", 2024-09-13T06:42:25.901 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123748657 2024-09-13T06:42:25.901 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:25.901 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:25.901 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:25.901 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.780446+0000", 2024-09-13T06:42:25.901 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.9360999999999998e-05 2024-09-13T06:42:25.901 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:25.901 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:25.901 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:25.901 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.780734+0000", 2024-09-13T06:42:25.901 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00028838399999999998 2024-09-13T06:42:25.901 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:25.901 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:25.901 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:25.902 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:25.902 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:25.902 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43240 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 106496~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:42:25.902 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.660672+0000", 2024-09-13T06:42:25.902 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 124.205909541, 2024-09-13T06:42:25.902 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123612707, 2024-09-13T06:42:25.902 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:25.902 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:25.902 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:25.902 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:25.902 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:25.902 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43240 2024-09-13T06:42:25.902 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:25.902 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:25.902 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:25.903 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:25.903 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660672+0000", 2024-09-13T06:42:25.903 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:25.903 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:25.903 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:25.903 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:25.903 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660672+0000", 2024-09-13T06:42:25.903 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:25.903 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:25.903 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:25.903 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:25.903 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660671+0000", 2024-09-13T06:42:25.903 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:25.904 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:25.904 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:25.904 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:25.904 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660673+0000", 2024-09-13T06:42:25.904 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.652e-06 2024-09-13T06:42:25.904 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:25.904 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:25.904 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:25.904 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660677+0000", 2024-09-13T06:42:25.904 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.2509999999999996e-06 2024-09-13T06:42:25.904 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:25.904 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:25.904 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:25.905 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660680+0000", 2024-09-13T06:42:25.905 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.8150000000000002e-06 2024-09-13T06:42:25.905 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:25.905 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:25.905 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:25.905 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.783596+0000", 2024-09-13T06:42:25.905 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.122915841 2024-09-13T06:42:25.905 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:25.905 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:25.905 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:25.905 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.783682+0000", 2024-09-13T06:42:25.905 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.5822999999999995e-05 2024-09-13T06:42:25.905 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:25.905 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:25.906 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:25.906 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.784285+0000", 2024-09-13T06:42:25.906 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00060276500000000001 2024-09-13T06:42:25.906 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:25.906 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:25.906 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:25.906 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:25.906 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:25.906 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43241 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 120832~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:42:25.906 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.660682+0000", 2024-09-13T06:42:25.906 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 124.20589896600001, 2024-09-13T06:42:25.906 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123958204, 2024-09-13T06:42:25.906 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:25.906 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:25.907 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:25.907 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:25.907 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:25.907 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43241 2024-09-13T06:42:25.907 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:25.907 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:25.907 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:25.907 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:25.907 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660682+0000", 2024-09-13T06:42:25.907 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:25.907 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:25.907 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:25.907 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:25.907 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660682+0000", 2024-09-13T06:42:25.907 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:25.908 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:25.908 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:25.908 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:25.908 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660682+0000", 2024-09-13T06:42:25.908 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:25.908 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:25.908 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:25.908 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:25.908 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660683+0000", 2024-09-13T06:42:25.908 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.308e-06 2024-09-13T06:42:25.908 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:25.908 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:25.908 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:25.909 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660686+0000", 2024-09-13T06:42:25.909 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.977e-06 2024-09-13T06:42:25.909 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:25.909 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:25.909 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:25.909 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660689+0000", 2024-09-13T06:42:25.909 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5830000000000001e-06 2024-09-13T06:42:25.909 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:25.909 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:25.909 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:25.909 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.784366+0000", 2024-09-13T06:42:25.909 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.12367713599999999 2024-09-13T06:42:25.909 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:25.910 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:25.910 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:25.910 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.784451+0000", 2024-09-13T06:42:25.910 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.4629999999999994e-05 2024-09-13T06:42:25.910 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:25.910 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:25.910 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:25.910 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.784641+0000", 2024-09-13T06:42:25.910 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00018984899999999999 2024-09-13T06:42:25.910 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:25.910 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:25.910 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:25.910 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:25.910 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:25.911 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43242 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 139264~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:42:25.911 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.660691+0000", 2024-09-13T06:42:25.911 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 124.205889988, 2024-09-13T06:42:25.911 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.124536443, 2024-09-13T06:42:25.911 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:25.911 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:25.911 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:25.911 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:25.911 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:25.911 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43242 2024-09-13T06:42:25.911 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:25.911 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:25.911 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:25.912 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:25.912 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660691+0000", 2024-09-13T06:42:25.912 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:25.912 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:25.912 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:25.912 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:25.912 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660691+0000", 2024-09-13T06:42:25.912 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:25.912 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:25.912 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:25.912 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:25.912 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660691+0000", 2024-09-13T06:42:25.913 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:42:25.913 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:25.913 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:25.913 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:25.913 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660696+0000", 2024-09-13T06:42:25.913 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0560000000000004e-06 2024-09-13T06:42:25.913 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:25.913 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:25.913 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:25.913 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660699+0000", 2024-09-13T06:42:25.913 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.2009999999999999e-06 2024-09-13T06:42:25.913 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:25.913 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:25.914 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:25.914 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660702+0000", 2024-09-13T06:42:25.914 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.633e-06 2024-09-13T06:42:25.914 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:25.914 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:25.914 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:25.914 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.784912+0000", 2024-09-13T06:42:25.914 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.124209497 2024-09-13T06:42:25.914 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:25.914 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:25.914 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:25.914 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.784995+0000", 2024-09-13T06:42:25.914 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.3891e-05 2024-09-13T06:42:25.915 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:25.915 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:25.915 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:25.915 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.785228+0000", 2024-09-13T06:42:25.915 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00023237400000000001 2024-09-13T06:42:25.915 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:25.915 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:25.915 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:25.915 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:25.915 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:25.915 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43243 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 153600~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:42:25.915 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.660705+0000", 2024-09-13T06:42:25.915 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 124.205876655, 2024-09-13T06:42:25.915 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.124825835, 2024-09-13T06:42:25.916 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:25.916 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:25.916 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:25.916 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:25.916 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:25.916 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43243 2024-09-13T06:42:25.916 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:25.916 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:25.916 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:25.916 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:25.916 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660705+0000", 2024-09-13T06:42:25.916 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:25.916 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:25.917 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:25.917 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:25.917 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660705+0000", 2024-09-13T06:42:25.917 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:25.917 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:25.917 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:25.917 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:25.917 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660705+0000", 2024-09-13T06:42:25.917 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:42:25.917 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:25.917 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:25.917 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:25.917 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660706+0000", 2024-09-13T06:42:25.918 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4339999999999999e-06 2024-09-13T06:42:25.918 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:25.918 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:25.918 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:25.918 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660709+0000", 2024-09-13T06:42:25.918 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9000000000000002e-06 2024-09-13T06:42:25.918 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:25.918 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:25.918 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:25.918 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660712+0000", 2024-09-13T06:42:25.918 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.0589999999999998e-06 2024-09-13T06:42:25.918 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:25.918 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:25.918 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:25.919 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.785318+0000", 2024-09-13T06:42:25.919 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.124606299 2024-09-13T06:42:25.919 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:25.919 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:25.919 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:25.919 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.785361+0000", 2024-09-13T06:42:25.919 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.3214999999999999e-05 2024-09-13T06:42:25.919 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:25.919 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:25.919 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:25.919 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.785531+0000", 2024-09-13T06:42:25.919 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00016914400000000001 2024-09-13T06:42:25.919 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:25.919 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:25.919 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:25.920 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:25.920 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:25.920 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43244 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 167936~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:42:25.920 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.660714+0000", 2024-09-13T06:42:25.920 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 124.205867242, 2024-09-13T06:42:25.920 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.125073248, 2024-09-13T06:42:25.920 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:25.920 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:25.920 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:25.920 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:25.920 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:25.920 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43244 2024-09-13T06:42:25.920 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:25.921 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:25.921 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:25.921 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:25.921 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660714+0000", 2024-09-13T06:42:25.921 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:25.921 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:25.921 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:25.921 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:25.921 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660714+0000", 2024-09-13T06:42:25.921 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:25.921 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:25.921 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:25.921 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:25.921 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660714+0000", 2024-09-13T06:42:25.922 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:42:25.922 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:25.922 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:25.922 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:25.922 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660715+0000", 2024-09-13T06:42:25.922 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2330000000000001e-06 2024-09-13T06:42:25.922 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:25.922 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:25.922 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:25.922 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660718+0000", 2024-09-13T06:42:25.922 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9569999999999998e-06 2024-09-13T06:42:25.922 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:25.922 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:25.923 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:25.923 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660721+0000", 2024-09-13T06:42:25.923 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.678e-06 2024-09-13T06:42:25.923 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:25.923 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:25.923 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:25.923 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.785557+0000", 2024-09-13T06:42:25.923 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.12483633199999999 2024-09-13T06:42:25.923 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:25.923 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:25.923 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:25.923 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.785618+0000", 2024-09-13T06:42:25.923 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0686000000000001e-05 2024-09-13T06:42:25.923 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:25.924 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:25.924 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:25.924 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.785787+0000", 2024-09-13T06:42:25.924 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00016957699999999999 2024-09-13T06:42:25.924 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:25.924 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:25.924 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:25.924 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:25.924 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:25.924 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43254 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 315392~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:42:25.924 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.664717+0000", 2024-09-13T06:42:25.924 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 124.20186467400001, 2024-09-13T06:42:25.924 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.12357108, 2024-09-13T06:42:25.924 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:25.925 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:25.925 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:25.925 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:25.925 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:25.925 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43254 2024-09-13T06:42:25.925 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:25.925 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:25.925 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:25.925 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:25.925 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664717+0000", 2024-09-13T06:42:25.925 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:25.925 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:25.925 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:25.925 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:25.925 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664717+0000", 2024-09-13T06:42:25.926 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:25.926 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:25.926 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:25.926 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:25.926 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664716+0000", 2024-09-13T06:42:25.926 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:25.926 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:25.926 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:25.926 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:25.926 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664724+0000", 2024-09-13T06:42:25.926 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.7109999999999995e-06 2024-09-13T06:42:25.926 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:25.926 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:25.926 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:25.927 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664732+0000", 2024-09-13T06:42:25.927 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.8399999999999995e-06 2024-09-13T06:42:25.927 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:25.927 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:25.927 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:25.927 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664738+0000", 2024-09-13T06:42:25.927 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.879e-06 2024-09-13T06:42:25.927 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:25.927 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:25.927 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:25.927 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.788018+0000", 2024-09-13T06:42:25.927 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123280719 2024-09-13T06:42:25.927 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:25.927 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:25.928 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:25.928 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.788119+0000", 2024-09-13T06:42:25.928 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000100558 2024-09-13T06:42:25.928 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:25.928 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:25.928 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:25.928 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.788288+0000", 2024-09-13T06:42:25.928 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000168751 2024-09-13T06:42:25.928 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:25.928 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:25.928 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:25.928 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:25.928 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:25.928 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43255 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 329728~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:42:25.928 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.664743+0000", 2024-09-13T06:42:25.929 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 124.201838678, 2024-09-13T06:42:25.929 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.12381711500000001, 2024-09-13T06:42:25.929 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:25.929 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:25.929 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:25.929 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:25.929 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:25.929 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43255 2024-09-13T06:42:25.929 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:25.929 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:25.929 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:25.929 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:25.929 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664743+0000", 2024-09-13T06:42:25.929 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:25.930 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:25.930 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:25.930 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:25.930 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664743+0000", 2024-09-13T06:42:25.930 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:25.930 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:25.930 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:25.930 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:25.930 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664742+0000", 2024-09-13T06:42:25.930 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:25.930 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:25.930 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:25.930 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:25.930 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664745+0000", 2024-09-13T06:42:25.930 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.7269999999999999e-06 2024-09-13T06:42:25.931 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:25.931 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:25.931 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:25.931 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664753+0000", 2024-09-13T06:42:25.931 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.8709999999999997e-06 2024-09-13T06:42:25.931 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:25.931 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:25.931 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:25.931 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664758+0000", 2024-09-13T06:42:25.931 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2220000000000001e-06 2024-09-13T06:42:25.931 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:25.931 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:25.931 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:25.931 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.788314+0000", 2024-09-13T06:42:25.931 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123555545 2024-09-13T06:42:25.932 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:25.932 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:25.932 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:25.932 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.788368+0000", 2024-09-13T06:42:25.932 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3928999999999998e-05 2024-09-13T06:42:25.932 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:25.932 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:25.932 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:25.932 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.788560+0000", 2024-09-13T06:42:25.932 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000192237 2024-09-13T06:42:25.932 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:25.932 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:25.932 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:25.932 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:25.933 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:25.933 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43256 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 344064~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:42:25.933 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.664763+0000", 2024-09-13T06:42:25.933 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 124.20181873200001, 2024-09-13T06:42:25.933 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.12418359399999999, 2024-09-13T06:42:25.933 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:25.933 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:25.933 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:25.933 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:25.933 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:25.933 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43256 2024-09-13T06:42:25.933 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:25.933 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:25.933 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:25.934 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:25.934 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664763+0000", 2024-09-13T06:42:25.934 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:25.934 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:25.935 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:25.936 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:25.936 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664763+0000", 2024-09-13T06:42:25.936 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:25.936 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:25.936 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:25.936 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:25.936 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664762+0000", 2024-09-13T06:42:25.936 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:25.936 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:25.936 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:25.936 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:25.936 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664765+0000", 2024-09-13T06:42:25.936 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3290000000000001e-06 2024-09-13T06:42:25.937 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:25.937 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:25.937 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:25.937 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664771+0000", 2024-09-13T06:42:25.937 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.1319999999999999e-06 2024-09-13T06:42:25.937 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:25.937 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:25.937 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:25.937 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664776+0000", 2024-09-13T06:42:25.937 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.8840000000000002e-06 2024-09-13T06:42:25.937 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:25.937 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:25.937 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:25.937 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.788598+0000", 2024-09-13T06:42:25.938 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123821979 2024-09-13T06:42:25.938 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:25.938 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:25.938 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:25.938 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.788680+0000", 2024-09-13T06:42:25.938 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.2367999999999995e-05 2024-09-13T06:42:25.938 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:25.938 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:25.938 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:25.938 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.788946+0000", 2024-09-13T06:42:25.938 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00026629799999999999 2024-09-13T06:42:25.938 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:25.938 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:25.938 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:25.938 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:25.939 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:25.939 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43265 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 477184~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:42:25.939 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.669414+0000", 2024-09-13T06:42:25.939 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 124.197167096, 2024-09-13T06:42:25.939 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123446973, 2024-09-13T06:42:25.939 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:25.939 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:25.939 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:25.939 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:25.939 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:25.939 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43265 2024-09-13T06:42:25.939 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:25.939 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:25.939 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:25.939 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:25.940 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669414+0000", 2024-09-13T06:42:25.940 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:25.940 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:25.940 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:25.940 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:25.940 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669414+0000", 2024-09-13T06:42:25.940 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:25.940 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:25.940 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:25.940 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:25.940 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669414+0000", 2024-09-13T06:42:25.940 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:25.940 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:25.940 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:25.941 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:25.941 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669416+0000", 2024-09-13T06:42:25.941 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.317e-06 2024-09-13T06:42:25.941 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:25.941 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:25.941 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:25.941 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669425+0000", 2024-09-13T06:42:25.941 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.0650000000000005e-06 2024-09-13T06:42:25.941 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:25.941 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:25.941 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:25.941 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669430+0000", 2024-09-13T06:42:25.941 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5079999999999999e-06 2024-09-13T06:42:25.941 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:25.941 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:25.942 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:25.942 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.792649+0000", 2024-09-13T06:42:25.942 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123219328 2024-09-13T06:42:25.942 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:25.942 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:25.942 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:25.942 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.792695+0000", 2024-09-13T06:42:25.942 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5476999999999998e-05 2024-09-13T06:42:25.942 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:25.942 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:25.942 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:25.942 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.792861+0000", 2024-09-13T06:42:25.942 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00016658999999999999 2024-09-13T06:42:25.942 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:25.942 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:25.942 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:25.943 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:25.943 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:25.943 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43266 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 491520~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:42:25.943 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.669434+0000", 2024-09-13T06:42:25.943 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 124.19714697400001, 2024-09-13T06:42:25.943 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123685267, 2024-09-13T06:42:25.943 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:25.943 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:25.943 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:25.943 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:25.943 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:25.943 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43266 2024-09-13T06:42:25.943 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:25.943 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:25.944 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:25.944 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:25.944 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669434+0000", 2024-09-13T06:42:25.944 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:25.944 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:25.944 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:25.944 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:25.944 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669434+0000", 2024-09-13T06:42:25.944 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:25.944 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:25.944 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:25.944 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:25.944 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669434+0000", 2024-09-13T06:42:25.944 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:25.945 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:25.945 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:25.945 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:25.945 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669441+0000", 2024-09-13T06:42:25.945 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3019999999999997e-06 2024-09-13T06:42:25.945 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:25.945 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:25.945 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:25.945 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669451+0000", 2024-09-13T06:42:25.945 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.6379999999999999e-06 2024-09-13T06:42:25.945 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:25.945 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:25.945 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:25.945 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669456+0000", 2024-09-13T06:42:25.945 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.361e-06 2024-09-13T06:42:25.946 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:25.946 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:25.946 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:25.946 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.792879+0000", 2024-09-13T06:42:25.946 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123422686 2024-09-13T06:42:25.946 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:25.946 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:25.946 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:25.946 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.792923+0000", 2024-09-13T06:42:25.946 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4035000000000001e-05 2024-09-13T06:42:25.946 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:25.946 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:25.946 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:25.946 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.793120+0000", 2024-09-13T06:42:25.946 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00019660899999999999 2024-09-13T06:42:25.946 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:25.947 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:25.947 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:25.947 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:25.947 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:25.947 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43267 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 505856~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:42:25.947 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.669461+0000", 2024-09-13T06:42:25.947 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 124.19712017800001, 2024-09-13T06:42:25.947 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123933711, 2024-09-13T06:42:25.947 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:25.947 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:25.947 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:25.947 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:25.947 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:25.947 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43267 2024-09-13T06:42:25.947 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:25.948 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:25.948 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:25.948 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:25.948 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669461+0000", 2024-09-13T06:42:25.948 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:25.948 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:25.948 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:25.948 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:25.948 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669461+0000", 2024-09-13T06:42:25.948 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:25.948 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:25.948 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:25.948 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:25.948 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669461+0000", 2024-09-13T06:42:25.948 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:25.949 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:25.949 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:25.949 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:25.949 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669463+0000", 2024-09-13T06:42:25.949 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5629999999999999e-06 2024-09-13T06:42:25.949 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:25.949 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:25.949 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:25.949 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669473+0000", 2024-09-13T06:42:25.949 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.9520000000000006e-06 2024-09-13T06:42:25.949 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:25.949 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:25.949 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:25.949 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669479+0000", 2024-09-13T06:42:25.949 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8540000000000002e-06 2024-09-13T06:42:25.950 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:25.950 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:25.950 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:25.950 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.793137+0000", 2024-09-13T06:42:25.950 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.12365825699999999 2024-09-13T06:42:25.950 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:25.950 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:25.950 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:25.950 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.793181+0000", 2024-09-13T06:42:25.950 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.3773999999999998e-05 2024-09-13T06:42:25.950 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:25.950 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:25.950 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:25.950 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.793395+0000", 2024-09-13T06:42:25.951 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00021372399999999999 2024-09-13T06:42:25.951 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:25.951 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:25.951 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:25.951 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:25.951 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:25.951 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43268 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 520192~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:42:25.951 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.669484+0000", 2024-09-13T06:42:25.951 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 124.19709739300001, 2024-09-13T06:42:25.951 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.12441057899999999, 2024-09-13T06:42:25.951 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:25.951 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:25.951 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:25.951 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:25.952 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:25.952 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43268 2024-09-13T06:42:25.952 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:25.952 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:25.952 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:25.952 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:25.952 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669484+0000", 2024-09-13T06:42:25.952 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:25.952 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:25.952 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:25.952 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:25.952 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669484+0000", 2024-09-13T06:42:25.952 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:25.952 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:25.953 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:25.953 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:25.953 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669484+0000", 2024-09-13T06:42:25.953 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:25.953 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:25.953 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:25.953 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:25.953 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669486+0000", 2024-09-13T06:42:25.953 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6120000000000001e-06 2024-09-13T06:42:25.953 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:25.953 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:25.953 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:25.953 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669494+0000", 2024-09-13T06:42:25.953 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4819999999999997e-06 2024-09-13T06:42:25.954 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:25.954 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:25.954 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:25.954 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669497+0000", 2024-09-13T06:42:25.954 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9790000000000002e-06 2024-09-13T06:42:25.954 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:25.954 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:25.954 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:25.954 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.793559+0000", 2024-09-13T06:42:25.954 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.124062436 2024-09-13T06:42:25.954 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:25.954 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:25.954 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:25.954 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.793603+0000", 2024-09-13T06:42:25.954 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.3764999999999999e-05 2024-09-13T06:42:25.954 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:25.955 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:25.955 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:25.955 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.793895+0000", 2024-09-13T06:42:25.955 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00029168299999999999 2024-09-13T06:42:25.955 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:25.955 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:25.955 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:25.955 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:25.955 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:25.955 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:42:25.955 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:42:25.864+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:42:25.956 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-13T06:42:25.958 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:42:25.953+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:42:25.965 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-13T06:42:25.961+0000 7fa8be9d27c0 -1 osd.7 121 log_to_monitors true 2024-09-13T06:42:26.058 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:42:26.056+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:42:26.125 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:42:26.125 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-13T06:42:26.125 INFO:teuthology.orchestra.run.smithi081.stdout: "num_ops": 0 2024-09-13T06:42:26.125 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:42:26.139 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-13T06:42:26.186 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:42:26.184+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:42:26.260 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:42:26.256+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:42:26.308 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:42:26.308 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-13T06:42:26.308 INFO:teuthology.orchestra.run.smithi081.stdout: "complaint_time": 30, 2024-09-13T06:42:26.308 INFO:teuthology.orchestra.run.smithi081.stdout: "num_blocked_ops": 0 2024-09-13T06:42:26.308 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:42:26.322 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-13T06:42:26.370 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:42:26.368+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:42:26.461 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:42:26.456+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:42:26.493 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:42:26.493 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 20, 2024-09-13T06:42:26.493 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 600, 2024-09-13T06:42:26.494 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [ 2024-09-13T06:42:26.494 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:26.494 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:21979 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 14217216~4096 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:42:26.494 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.888811+0000", 2024-09-13T06:42:26.494 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 153.60503031100001, 2024-09-13T06:42:26.494 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049092969, 2024-09-13T06:42:26.494 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:26.494 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:26.494 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:26.494 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:26.494 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:26.494 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 21979 2024-09-13T06:42:26.494 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:26.495 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:26.495 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:26.495 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:26.495 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888811+0000", 2024-09-13T06:42:26.495 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:26.495 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:26.495 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:26.495 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:26.495 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888811+0000", 2024-09-13T06:42:26.495 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:26.495 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:26.495 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:26.495 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:26.495 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888811+0000", 2024-09-13T06:42:26.496 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:42:26.496 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:26.496 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:26.496 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:26.496 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888812+0000", 2024-09-13T06:42:26.496 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.204e-06 2024-09-13T06:42:26.496 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:26.496 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:26.496 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:26.496 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888815+0000", 2024-09-13T06:42:26.496 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9359999999999999e-06 2024-09-13T06:42:26.496 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:26.496 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:26.497 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:26.497 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888818+0000", 2024-09-13T06:42:26.497 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.7369999999999998e-06 2024-09-13T06:42:26.497 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:26.497 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:26.497 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:26.497 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.937663+0000", 2024-09-13T06:42:26.497 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.048844540999999998 2024-09-13T06:42:26.497 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:26.497 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:26.497 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:26.497 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.937709+0000", 2024-09-13T06:42:26.497 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6492999999999997e-05 2024-09-13T06:42:26.498 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:26.498 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:26.498 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:26.498 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.937904+0000", 2024-09-13T06:42:26.498 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00019526499999999999 2024-09-13T06:42:26.498 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:26.498 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:26.498 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:26.498 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:26.498 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:26.498 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:21980 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 14245888~4096 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:42:26.498 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.888820+0000", 2024-09-13T06:42:26.498 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 153.605021634, 2024-09-13T06:42:26.499 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049357080999999997, 2024-09-13T06:42:26.499 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:26.499 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:26.499 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:26.499 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:26.499 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:26.499 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 21980 2024-09-13T06:42:26.499 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:26.499 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:26.499 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:26.499 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:26.499 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888820+0000", 2024-09-13T06:42:26.499 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:26.499 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:26.500 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:26.500 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:26.500 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888820+0000", 2024-09-13T06:42:26.500 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:26.500 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:26.500 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:26.500 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:26.500 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888820+0000", 2024-09-13T06:42:26.500 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:42:26.500 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:26.500 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:26.500 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:26.500 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888821+0000", 2024-09-13T06:42:26.500 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.122e-06 2024-09-13T06:42:26.500 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:26.501 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:26.501 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:26.501 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888824+0000", 2024-09-13T06:42:26.501 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.0580000000000002e-06 2024-09-13T06:42:26.501 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:26.501 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:26.501 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:26.501 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888827+0000", 2024-09-13T06:42:26.501 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.666e-06 2024-09-13T06:42:26.501 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:26.501 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:26.501 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:26.501 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.937935+0000", 2024-09-13T06:42:26.501 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049108329999999999 2024-09-13T06:42:26.501 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:26.502 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:26.502 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:26.502 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.937985+0000", 2024-09-13T06:42:26.502 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9694000000000002e-05 2024-09-13T06:42:26.502 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:26.502 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:26.502 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:26.502 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.938177+0000", 2024-09-13T06:42:26.502 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00019241899999999999 2024-09-13T06:42:26.502 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:26.502 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:26.502 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:26.502 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:26.503 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:26.503 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:21984 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:snapdir [list-snaps] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:42:26.503 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.888829+0000", 2024-09-13T06:42:26.503 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 153.605012856, 2024-09-13T06:42:26.503 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049524545000000003, 2024-09-13T06:42:26.503 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:26.503 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:26.503 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:26.503 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:26.503 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:26.503 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 21984 2024-09-13T06:42:26.503 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:26.503 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:26.503 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:26.504 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:26.504 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888829+0000", 2024-09-13T06:42:26.504 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:26.504 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:26.504 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:26.504 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:26.504 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888829+0000", 2024-09-13T06:42:26.504 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:26.504 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:26.504 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:26.504 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:26.504 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888829+0000", 2024-09-13T06:42:26.504 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:42:26.504 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:26.505 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:26.505 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:26.505 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888830+0000", 2024-09-13T06:42:26.505 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2529999999999999e-06 2024-09-13T06:42:26.505 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:26.505 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:26.505 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:26.505 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888835+0000", 2024-09-13T06:42:26.505 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.4729999999999999e-06 2024-09-13T06:42:26.505 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:26.505 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:26.505 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:26.505 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888840+0000", 2024-09-13T06:42:26.506 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0159999999999999e-06 2024-09-13T06:42:26.506 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:26.506 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:26.506 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:26.506 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.938199+0000", 2024-09-13T06:42:26.506 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049358974999999999 2024-09-13T06:42:26.506 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:26.506 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:26.506 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:26.506 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.938268+0000", 2024-09-13T06:42:26.506 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.8876999999999998e-05 2024-09-13T06:42:26.506 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:26.506 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:26.507 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:26.507 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.938353+0000", 2024-09-13T06:42:26.507 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.5155999999999996e-05 2024-09-13T06:42:26.507 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:26.507 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:26.507 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:26.507 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:26.507 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:26.507 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:21985 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 12587008~4096 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:42:26.507 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.888858+0000", 2024-09-13T06:42:26.507 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 153.60498370600001, 2024-09-13T06:42:26.507 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049674347000000001, 2024-09-13T06:42:26.507 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:26.508 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:26.508 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:26.508 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:26.508 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:26.508 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 21985 2024-09-13T06:42:26.508 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:26.508 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:26.508 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:26.508 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:26.508 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888858+0000", 2024-09-13T06:42:26.508 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:26.508 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:26.508 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:26.509 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:26.509 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888858+0000", 2024-09-13T06:42:26.509 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:26.509 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:26.509 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:26.509 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:26.509 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888857+0000", 2024-09-13T06:42:26.509 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:26.509 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:26.509 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:26.509 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:26.509 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888860+0000", 2024-09-13T06:42:26.509 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4739999999999999e-06 2024-09-13T06:42:26.509 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:26.510 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:26.510 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:26.510 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888867+0000", 2024-09-13T06:42:26.510 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.7170000000000002e-06 2024-09-13T06:42:26.510 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:26.510 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:26.510 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:26.510 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888871+0000", 2024-09-13T06:42:26.510 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5120000000000002e-06 2024-09-13T06:42:26.510 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:26.510 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:26.510 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:26.510 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.938389+0000", 2024-09-13T06:42:26.510 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049517717000000003 2024-09-13T06:42:26.511 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:26.511 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:26.511 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:26.511 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.938449+0000", 2024-09-13T06:42:26.511 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0513999999999997e-05 2024-09-13T06:42:26.511 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:26.511 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:26.511 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:26.511 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.938532+0000", 2024-09-13T06:42:26.511 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.2936999999999996e-05 2024-09-13T06:42:26.511 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:26.511 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:26.511 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:26.512 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:26.512 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:26.512 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:21986 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 12615680~4096 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:42:26.512 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.888875+0000", 2024-09-13T06:42:26.512 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 153.604966193, 2024-09-13T06:42:26.512 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049881781, 2024-09-13T06:42:26.512 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:26.512 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:26.512 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:26.512 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:26.512 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:26.512 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 21986 2024-09-13T06:42:26.512 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:26.513 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:26.513 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:26.513 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:26.513 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888875+0000", 2024-09-13T06:42:26.513 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:26.513 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:26.513 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:26.513 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:26.513 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888875+0000", 2024-09-13T06:42:26.513 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:26.513 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:26.513 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:26.513 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:26.514 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888875+0000", 2024-09-13T06:42:26.514 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:26.514 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:26.514 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:26.514 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:26.514 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888880+0000", 2024-09-13T06:42:26.514 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7600000000000002e-06 2024-09-13T06:42:26.514 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:26.514 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:26.514 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:26.514 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888887+0000", 2024-09-13T06:42:26.514 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3950000000000003e-06 2024-09-13T06:42:26.514 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:26.514 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:26.515 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:26.515 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888892+0000", 2024-09-13T06:42:26.515 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0409999999999997e-06 2024-09-13T06:42:26.515 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:26.515 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:26.515 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:26.515 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.938568+0000", 2024-09-13T06:42:26.515 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049675267000000002 2024-09-13T06:42:26.515 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:26.515 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:26.515 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:26.515 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.938653+0000", 2024-09-13T06:42:26.515 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.5792999999999997e-05 2024-09-13T06:42:26.515 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:26.516 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:26.516 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:26.516 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.938757+0000", 2024-09-13T06:42:26.516 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00010387699999999999 2024-09-13T06:42:26.516 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:26.516 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:26.516 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:26.516 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:26.516 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:26.516 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:21987 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 12644352~4096 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:42:26.516 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.888899+0000", 2024-09-13T06:42:26.516 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 153.60494284699999, 2024-09-13T06:42:26.516 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.050094056999999997, 2024-09-13T06:42:26.516 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:26.517 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:26.517 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:26.517 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:26.517 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:26.517 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 21987 2024-09-13T06:42:26.517 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:26.517 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:26.517 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:26.517 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:26.517 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888899+0000", 2024-09-13T06:42:26.517 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:26.517 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:26.517 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:26.518 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:26.518 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888899+0000", 2024-09-13T06:42:26.518 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:26.518 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:26.518 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:26.518 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:26.518 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888899+0000", 2024-09-13T06:42:26.518 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:26.518 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:26.518 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:26.518 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:26.518 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888901+0000", 2024-09-13T06:42:26.518 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2539999999999999e-06 2024-09-13T06:42:26.518 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:26.518 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:26.519 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:26.519 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888907+0000", 2024-09-13T06:42:26.519 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9009999999999999e-06 2024-09-13T06:42:26.519 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:26.519 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:26.519 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:26.519 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888912+0000", 2024-09-13T06:42:26.519 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9840000000000001e-06 2024-09-13T06:42:26.519 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:26.519 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:26.519 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:26.519 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.938810+0000", 2024-09-13T06:42:26.519 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049898835000000002 2024-09-13T06:42:26.519 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:26.519 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:26.520 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:26.520 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.938890+0000", 2024-09-13T06:42:26.520 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.9215000000000006e-05 2024-09-13T06:42:26.520 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:26.520 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:26.520 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:26.520 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.938993+0000", 2024-09-13T06:42:26.520 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000103194 2024-09-13T06:42:26.520 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:26.520 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:26.520 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:26.520 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:26.520 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:26.520 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:21988 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 12673024~4096 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:42:26.521 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.888916+0000", 2024-09-13T06:42:26.521 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 153.604925831, 2024-09-13T06:42:26.521 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.050203036999999999, 2024-09-13T06:42:26.521 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:26.521 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:26.521 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:26.521 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:26.521 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:26.521 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 21988 2024-09-13T06:42:26.521 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:26.521 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:26.521 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:26.521 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:26.521 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888916+0000", 2024-09-13T06:42:26.522 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:26.522 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:26.522 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:26.522 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:26.522 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888916+0000", 2024-09-13T06:42:26.522 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:26.522 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:26.522 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:26.522 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:26.522 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888915+0000", 2024-09-13T06:42:26.522 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:26.522 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:26.522 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:26.523 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:26.523 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888918+0000", 2024-09-13T06:42:26.523 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1500000000000002e-06 2024-09-13T06:42:26.523 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:26.523 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:26.523 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:26.523 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888925+0000", 2024-09-13T06:42:26.523 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.9380000000000003e-06 2024-09-13T06:42:26.523 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:26.523 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:26.523 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:26.523 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888933+0000", 2024-09-13T06:42:26.523 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.0560000000000005e-06 2024-09-13T06:42:26.523 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:26.524 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:26.524 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:26.524 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.939026+0000", 2024-09-13T06:42:26.524 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.050093499999999999 2024-09-13T06:42:26.524 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:26.524 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:26.524 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:26.524 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.939068+0000", 2024-09-13T06:42:26.524 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.1705999999999997e-05 2024-09-13T06:42:26.524 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:26.524 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:26.524 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:26.524 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.939119+0000", 2024-09-13T06:42:26.524 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.1048999999999999e-05 2024-09-13T06:42:26.524 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:26.525 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:26.525 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:26.525 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:26.525 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:26.525 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:21989 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 12701696~4096 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:42:26.525 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.888938+0000", 2024-09-13T06:42:26.525 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 153.60490350399999, 2024-09-13T06:42:26.525 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.050294393999999999, 2024-09-13T06:42:26.525 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:26.525 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:26.525 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:26.525 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:26.525 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:26.525 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 21989 2024-09-13T06:42:26.526 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:26.526 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:26.526 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:26.526 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:26.526 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888938+0000", 2024-09-13T06:42:26.526 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:26.526 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:26.526 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:26.526 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:26.526 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888938+0000", 2024-09-13T06:42:26.526 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:26.526 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:26.526 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:26.527 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:26.527 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888938+0000", 2024-09-13T06:42:26.527 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:26.527 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:26.527 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:26.527 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:26.527 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888940+0000", 2024-09-13T06:42:26.527 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5330000000000001e-06 2024-09-13T06:42:26.527 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:26.527 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:26.527 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:26.527 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888947+0000", 2024-09-13T06:42:26.527 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.2389999999999999e-06 2024-09-13T06:42:26.527 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:26.528 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:26.528 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:26.528 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888952+0000", 2024-09-13T06:42:26.528 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.5720000000000002e-06 2024-09-13T06:42:26.528 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:26.528 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:26.528 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:26.528 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.939141+0000", 2024-09-13T06:42:26.528 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.050188903999999999 2024-09-13T06:42:26.528 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:26.528 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:26.528 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:26.529 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.939182+0000", 2024-09-13T06:42:26.529 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.0926000000000001e-05 2024-09-13T06:42:26.529 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:26.529 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:26.529 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:26.529 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.939233+0000", 2024-09-13T06:42:26.529 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0532999999999999e-05 2024-09-13T06:42:26.529 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:26.529 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:26.529 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:26.529 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:26.529 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:26.529 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:22007 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 13217792~4096 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:42:26.529 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.892771+0000", 2024-09-13T06:42:26.529 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 153.60107039799999, 2024-09-13T06:42:26.530 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049090024000000003, 2024-09-13T06:42:26.530 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:26.530 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:26.530 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:26.530 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:26.530 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:26.530 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 22007 2024-09-13T06:42:26.530 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:26.530 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:26.530 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:26.530 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:26.530 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892771+0000", 2024-09-13T06:42:26.530 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:26.530 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:26.530 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:26.531 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:26.531 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892771+0000", 2024-09-13T06:42:26.531 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:26.531 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:26.531 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:26.531 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:26.531 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892771+0000", 2024-09-13T06:42:26.531 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:42:26.531 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:26.531 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:26.531 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:26.531 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892772+0000", 2024-09-13T06:42:26.531 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.184e-06 2024-09-13T06:42:26.532 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:26.532 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:26.532 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:26.532 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892775+0000", 2024-09-13T06:42:26.532 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9179999999999998e-06 2024-09-13T06:42:26.532 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:26.532 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:26.532 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:26.532 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892778+0000", 2024-09-13T06:42:26.532 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4990000000000001e-06 2024-09-13T06:42:26.532 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:26.532 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:26.532 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:26.532 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.941760+0000", 2024-09-13T06:42:26.533 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.048982070000000003 2024-09-13T06:42:26.533 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:26.533 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:26.533 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:26.533 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.941808+0000", 2024-09-13T06:42:26.533 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.8278000000000001e-05 2024-09-13T06:42:26.533 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:26.533 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:26.533 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:26.533 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.941861+0000", 2024-09-13T06:42:26.533 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3284e-05 2024-09-13T06:42:26.533 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:26.533 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:26.533 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:26.534 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:26.534 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:26.534 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:22008 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 13246464~4096 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:42:26.534 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.892780+0000", 2024-09-13T06:42:26.534 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 153.601061741, 2024-09-13T06:42:26.534 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049200477999999999, 2024-09-13T06:42:26.534 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:26.534 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:26.534 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:26.534 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:26.534 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:26.534 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 22008 2024-09-13T06:42:26.534 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:26.534 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:26.534 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:26.535 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:26.535 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892780+0000", 2024-09-13T06:42:26.535 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:26.535 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:26.535 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:26.535 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:26.535 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892780+0000", 2024-09-13T06:42:26.535 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:26.535 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:26.535 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:26.535 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:26.535 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892780+0000", 2024-09-13T06:42:26.535 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:42:26.535 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:26.535 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:26.536 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:26.536 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892781+0000", 2024-09-13T06:42:26.536 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.083e-06 2024-09-13T06:42:26.536 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:26.536 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:26.536 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:26.536 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892784+0000", 2024-09-13T06:42:26.536 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.926e-06 2024-09-13T06:42:26.536 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:26.536 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:26.536 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:26.536 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892786+0000", 2024-09-13T06:42:26.536 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4490000000000002e-06 2024-09-13T06:42:26.536 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:26.536 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:26.537 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:26.537 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.941888+0000", 2024-09-13T06:42:26.537 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049102290999999999 2024-09-13T06:42:26.537 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:26.537 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:26.537 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:26.537 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.941929+0000", 2024-09-13T06:42:26.537 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.0541999999999999e-05 2024-09-13T06:42:26.537 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:26.537 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:26.537 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:26.537 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.941980+0000", 2024-09-13T06:42:26.537 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.1391999999999999e-05 2024-09-13T06:42:26.537 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:26.537 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:26.538 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:26.538 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:26.538 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:26.538 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:22009 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 13275136~4096 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:42:26.538 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.892788+0000", 2024-09-13T06:42:26.538 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 153.60105325699999, 2024-09-13T06:42:26.538 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049311926999999998, 2024-09-13T06:42:26.538 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:26.538 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:26.538 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:26.538 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:26.538 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:26.538 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 22009 2024-09-13T06:42:26.539 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:26.539 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:26.539 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:26.539 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:26.539 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892788+0000", 2024-09-13T06:42:26.539 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:26.539 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:26.539 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:26.539 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:26.539 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892788+0000", 2024-09-13T06:42:26.539 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:26.539 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:26.539 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:26.539 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:26.539 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892788+0000", 2024-09-13T06:42:26.540 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:42:26.540 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:26.540 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:26.540 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:26.540 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892789+0000", 2024-09-13T06:42:26.540 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1850000000000001e-06 2024-09-13T06:42:26.540 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:26.540 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:26.540 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:26.540 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892793+0000", 2024-09-13T06:42:26.540 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.9099999999999998e-06 2024-09-13T06:42:26.540 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:26.540 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:26.540 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:26.540 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892798+0000", 2024-09-13T06:42:26.541 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5070000000000002e-06 2024-09-13T06:42:26.541 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:26.541 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:26.541 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:26.541 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.942007+0000", 2024-09-13T06:42:26.541 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049208904999999997 2024-09-13T06:42:26.541 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:26.541 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:26.541 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:26.541 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.942049+0000", 2024-09-13T06:42:26.541 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.1922000000000003e-05 2024-09-13T06:42:26.541 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:26.541 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:26.542 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:26.542 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.942100+0000", 2024-09-13T06:42:26.542 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.1736000000000001e-05 2024-09-13T06:42:26.542 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:26.542 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:26.542 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:26.542 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:26.542 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:26.542 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:22010 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 13303808~4096 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:42:26.542 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.892817+0000", 2024-09-13T06:42:26.542 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 153.601025061, 2024-09-13T06:42:26.542 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049466149000000001, 2024-09-13T06:42:26.542 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:26.542 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:26.543 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:26.543 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:26.543 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:26.543 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 22010 2024-09-13T06:42:26.543 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:26.543 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:26.543 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:26.543 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:26.543 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892817+0000", 2024-09-13T06:42:26.543 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:26.543 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:26.543 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:26.543 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:26.543 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892817+0000", 2024-09-13T06:42:26.544 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:26.544 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:26.544 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:26.544 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:26.544 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892816+0000", 2024-09-13T06:42:26.544 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:26.544 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:26.544 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:26.544 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:26.544 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892821+0000", 2024-09-13T06:42:26.544 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9459999999999997e-06 2024-09-13T06:42:26.544 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:26.544 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:26.544 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:26.545 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892828+0000", 2024-09-13T06:42:26.545 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.6780000000000003e-06 2024-09-13T06:42:26.545 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:26.545 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:26.545 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:26.545 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892833+0000", 2024-09-13T06:42:26.545 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.8389999999999997e-06 2024-09-13T06:42:26.545 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:26.545 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:26.545 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:26.545 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.942127+0000", 2024-09-13T06:42:26.545 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049294163000000002 2024-09-13T06:42:26.545 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:26.546 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:26.546 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:26.546 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.942186+0000", 2024-09-13T06:42:26.546 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9335e-05 2024-09-13T06:42:26.546 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:26.546 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:26.546 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:26.546 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.942283+0000", 2024-09-13T06:42:26.546 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.6699000000000004e-05 2024-09-13T06:42:26.546 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:26.546 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:26.546 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:26.546 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:26.546 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:26.547 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:22011 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 13332480~4096 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:42:26.547 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.892838+0000", 2024-09-13T06:42:26.547 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 153.60100337399999, 2024-09-13T06:42:26.547 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049589214, 2024-09-13T06:42:26.547 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:26.547 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:26.547 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:26.547 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:26.547 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:26.547 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 22011 2024-09-13T06:42:26.547 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:26.547 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:26.547 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:26.547 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:26.548 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892838+0000", 2024-09-13T06:42:26.548 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:26.548 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:26.548 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:26.548 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:26.548 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892838+0000", 2024-09-13T06:42:26.548 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:26.548 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:26.548 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:26.548 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:26.548 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892838+0000", 2024-09-13T06:42:26.548 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:26.548 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:26.548 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:26.549 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:26.549 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892840+0000", 2024-09-13T06:42:26.549 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.136e-06 2024-09-13T06:42:26.549 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:26.549 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:26.549 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:26.549 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892852+0000", 2024-09-13T06:42:26.549 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2122e-05 2024-09-13T06:42:26.549 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:26.549 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:26.549 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:26.549 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892862+0000", 2024-09-13T06:42:26.549 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.7049999999999994e-06 2024-09-13T06:42:26.549 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:26.549 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:26.550 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:26.550 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.942319+0000", 2024-09-13T06:42:26.550 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049456623999999998 2024-09-13T06:42:26.550 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:26.550 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:26.550 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:26.550 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.942363+0000", 2024-09-13T06:42:26.550 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4759000000000003e-05 2024-09-13T06:42:26.550 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:26.550 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:26.550 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:26.550 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.942428+0000", 2024-09-13T06:42:26.550 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.4221999999999996e-05 2024-09-13T06:42:26.550 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:26.551 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:26.551 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:26.551 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:26.551 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:26.551 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:22338 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 13611008~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:42:26.551 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.951070+0000", 2024-09-13T06:42:26.551 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 153.542771853, 2024-09-13T06:42:26.551 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049135817999999998, 2024-09-13T06:42:26.551 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:26.551 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:26.551 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:26.551 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:26.551 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:26.551 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 22338 2024-09-13T06:42:26.551 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:26.552 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:26.552 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:26.552 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:26.552 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951070+0000", 2024-09-13T06:42:26.552 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:26.552 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:26.552 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:26.552 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:26.552 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951070+0000", 2024-09-13T06:42:26.552 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:26.552 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:26.552 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:26.552 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:26.552 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951069+0000", 2024-09-13T06:42:26.553 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:26.553 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:26.553 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:26.553 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:26.553 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951072+0000", 2024-09-13T06:42:26.553 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5909999999999998e-06 2024-09-13T06:42:26.553 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:26.553 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:26.553 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:26.553 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951078+0000", 2024-09-13T06:42:26.553 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.4450000000000001e-06 2024-09-13T06:42:26.553 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:26.553 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:26.553 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:26.554 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951083+0000", 2024-09-13T06:42:26.554 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7790000000000003e-06 2024-09-13T06:42:26.554 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:26.554 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:26.554 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:26.554 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:53.000020+0000", 2024-09-13T06:42:26.554 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.048936999000000002 2024-09-13T06:42:26.554 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:26.554 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:26.554 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:26.554 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:53.000106+0000", 2024-09-13T06:42:26.554 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.5532999999999996e-05 2024-09-13T06:42:26.554 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:26.554 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:26.555 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:26.555 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:53.000206+0000", 2024-09-13T06:42:26.555 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.9852999999999994e-05 2024-09-13T06:42:26.555 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:26.555 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:26.555 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:26.555 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:26.555 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:26.555 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:22339 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 13639680~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:42:26.555 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.951088+0000", 2024-09-13T06:42:26.555 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 153.54275415500001, 2024-09-13T06:42:26.555 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049238202000000002, 2024-09-13T06:42:26.555 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:26.556 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:26.556 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:26.556 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:26.556 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:26.556 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 22339 2024-09-13T06:42:26.556 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:26.556 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:26.556 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:26.556 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:26.556 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951088+0000", 2024-09-13T06:42:26.556 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:26.556 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:26.556 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:26.556 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:26.556 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951088+0000", 2024-09-13T06:42:26.557 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:26.557 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:26.557 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:26.557 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:26.557 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951087+0000", 2024-09-13T06:42:26.557 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:26.557 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:26.557 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:26.557 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:26.557 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951089+0000", 2024-09-13T06:42:26.557 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.153e-06 2024-09-13T06:42:26.557 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:26.557 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:26.557 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:26.558 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951093+0000", 2024-09-13T06:42:26.558 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.7120000000000002e-06 2024-09-13T06:42:26.558 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:26.558 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:26.558 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:26.558 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951096+0000", 2024-09-13T06:42:26.558 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.0570000000000001e-06 2024-09-13T06:42:26.558 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:26.558 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:26.558 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:26.558 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:53.000220+0000", 2024-09-13T06:42:26.558 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049123989 2024-09-13T06:42:26.558 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:26.558 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:26.559 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:26.559 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:53.000271+0000", 2024-09-13T06:42:26.559 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.062e-05 2024-09-13T06:42:26.559 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:26.559 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:26.559 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:26.559 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:53.000326+0000", 2024-09-13T06:42:26.559 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.5121000000000003e-05 2024-09-13T06:42:26.559 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:26.559 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:26.559 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:26.559 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:26.559 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:26.559 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:22340 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 13668352~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:42:26.560 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.951200+0000", 2024-09-13T06:42:26.560 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 153.542641266, 2024-09-13T06:42:26.560 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049352350000000003, 2024-09-13T06:42:26.560 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:26.560 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:26.560 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:26.560 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:26.560 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:26.560 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 22340 2024-09-13T06:42:26.560 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:26.560 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:26.560 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:26.560 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:26.560 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951200+0000", 2024-09-13T06:42:26.561 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:26.561 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:26.561 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:26.561 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:26.561 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951200+0000", 2024-09-13T06:42:26.561 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:26.561 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:26.561 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:26.561 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:26.561 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951098+0000", 2024-09-13T06:42:26.561 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.999898 2024-09-13T06:42:26.561 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:26.561 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:26.561 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:26.561 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951204+0000", 2024-09-13T06:42:26.562 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000105398 2024-09-13T06:42:26.562 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:26.562 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:26.562 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:26.562 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951211+0000", 2024-09-13T06:42:26.562 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.43e-06 2024-09-13T06:42:26.562 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:26.562 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:26.562 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:26.562 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951216+0000", 2024-09-13T06:42:26.562 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2800000000000003e-06 2024-09-13T06:42:26.562 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:26.562 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:26.562 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:26.563 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:53.000358+0000", 2024-09-13T06:42:26.563 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049142036 2024-09-13T06:42:26.563 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:26.563 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:26.563 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:26.563 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:53.000443+0000", 2024-09-13T06:42:26.563 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.4710999999999996e-05 2024-09-13T06:42:26.563 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:26.563 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:26.563 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:26.563 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:53.000553+0000", 2024-09-13T06:42:26.563 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000109622 2024-09-13T06:42:26.563 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:26.563 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:26.563 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:26.564 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:26.564 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:26.564 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:22348 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 13897728~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:42:26.564 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.952783+0000", 2024-09-13T06:42:26.564 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 153.541058478, 2024-09-13T06:42:26.564 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049120832000000003, 2024-09-13T06:42:26.564 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:26.564 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:26.564 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:26.564 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:26.564 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:26.564 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 22348 2024-09-13T06:42:26.564 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:26.565 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:26.565 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:26.565 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:26.565 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.952783+0000", 2024-09-13T06:42:26.565 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:26.565 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:26.565 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:26.565 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:26.565 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.952783+0000", 2024-09-13T06:42:26.565 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:26.565 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:26.565 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:26.565 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:26.565 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.952783+0000", 2024-09-13T06:42:26.566 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:26.566 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:26.566 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:26.566 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:26.566 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.952785+0000", 2024-09-13T06:42:26.566 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4980000000000001e-06 2024-09-13T06:42:26.566 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:26.566 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:26.566 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:26.566 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.952799+0000", 2024-09-13T06:42:26.566 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3825000000000001e-05 2024-09-13T06:42:26.566 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:26.566 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:26.566 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:26.566 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.952809+0000", 2024-09-13T06:42:26.567 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0043e-05 2024-09-13T06:42:26.567 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:26.567 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:26.567 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:26.567 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:53.001723+0000", 2024-09-13T06:42:26.567 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.048914065 2024-09-13T06:42:26.567 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:26.567 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:26.567 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:26.567 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:53.001807+0000", 2024-09-13T06:42:26.567 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.3776000000000006e-05 2024-09-13T06:42:26.567 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:26.567 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:26.567 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:26.567 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:53.001904+0000", 2024-09-13T06:42:26.568 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.7004999999999997e-05 2024-09-13T06:42:26.568 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:26.568 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:26.568 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:26.568 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:26.568 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:26.568 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:69045 3.0 3:05ea3821:::rbd_data.1121867cc19b.0000000000000000:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109)", 2024-09-13T06:42:26.568 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:41:03.637760+0000", 2024-09-13T06:42:26.568 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 82.856081720000006, 2024-09-13T06:42:26.568 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.052276712000000003, 2024-09-13T06:42:26.568 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:26.568 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:42:26.568 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:26.568 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:26.569 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:26.569 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 69045 2024-09-13T06:42:26.569 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:26.569 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:26.569 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:26.569 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:26.569 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:03.637760+0000", 2024-09-13T06:42:26.569 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:26.569 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:26.569 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:26.569 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:26.569 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:03.637760+0000", 2024-09-13T06:42:26.569 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:26.569 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:26.570 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:26.570 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:26.570 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:03.637758+0000", 2024-09-13T06:42:26.570 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999981 2024-09-13T06:42:26.570 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:26.570 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:26.570 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:26.570 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:03.637770+0000", 2024-09-13T06:42:26.570 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1533e-05 2024-09-13T06:42:26.570 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:26.570 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:26.570 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:26.570 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:03.637794+0000", 2024-09-13T06:42:26.570 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4243000000000002e-05 2024-09-13T06:42:26.571 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:26.571 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:26.571 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:26.571 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:03.637806+0000", 2024-09-13T06:42:26.571 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2033e-05 2024-09-13T06:42:26.571 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:26.571 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:26.571 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:26.571 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:03.637891+0000", 2024-09-13T06:42:26.571 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.5358000000000005e-05 2024-09-13T06:42:26.571 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:26.571 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:26.571 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:26.571 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:03.638042+0000", 2024-09-13T06:42:26.572 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000151073 2024-09-13T06:42:26.572 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:26.572 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:26.572 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 2", 2024-09-13T06:42:26.572 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:03.647124+0000", 2024-09-13T06:42:26.572 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0090821670000000004 2024-09-13T06:42:26.572 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:26.572 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:26.572 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:42:26.572 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:03.689849+0000", 2024-09-13T06:42:26.572 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.042724445999999999 2024-09-13T06:42:26.572 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:26.572 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:26.573 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-09-13T06:42:26.573 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:03.689871+0000", 2024-09-13T06:42:26.573 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1778999999999999e-05 2024-09-13T06:42:26.573 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:26.573 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:26.573 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:42:26.573 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:03.689965+0000", 2024-09-13T06:42:26.573 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.4312000000000001e-05 2024-09-13T06:42:26.573 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:26.573 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:26.573 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:26.573 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:03.690037+0000", 2024-09-13T06:42:26.574 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.1687999999999995e-05 2024-09-13T06:42:26.574 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:26.574 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:26.574 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:26.574 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:26.574 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:26.574 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:90987 3.6 3:6263dd97:::rbd_object_map.11212443ae03.0000000000000049:head [call] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-13T06:42:26.574 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:41:35.460333+0000", 2024-09-13T06:42:26.574 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 51.033508333, 2024-09-13T06:42:26.574 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0001633640000001, 2024-09-13T06:42:26.574 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:26.574 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:26.574 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:26.575 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:26.575 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:26.575 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 90987 2024-09-13T06:42:26.575 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:26.575 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:26.575 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:26.575 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:26.575 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:35.460333+0000", 2024-09-13T06:42:26.575 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:26.575 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:26.575 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:26.575 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:26.575 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:35.460333+0000", 2024-09-13T06:42:26.575 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:26.576 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:26.576 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:26.576 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:26.576 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:35.460330+0000", 2024-09-13T06:42:26.576 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999971 2024-09-13T06:42:26.576 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:26.576 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:26.576 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:26.576 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:35.460343+0000", 2024-09-13T06:42:26.576 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2695e-05 2024-09-13T06:42:26.576 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:26.576 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:26.576 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:26.577 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:35.460365+0000", 2024-09-13T06:42:26.577 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2473999999999999e-05 2024-09-13T06:42:26.577 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:26.577 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:26.577 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:26.577 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:35.460376+0000", 2024-09-13T06:42:26.577 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0383999999999999e-05 2024-09-13T06:42:26.577 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:26.577 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:26.577 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:26.577 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:35.460435+0000", 2024-09-13T06:42:26.577 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8650000000000003e-05 2024-09-13T06:42:26.577 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:26.578 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:26.578 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:42:26.578 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:35.460444+0000", 2024-09-13T06:42:26.578 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.0380000000000005e-06 2024-09-13T06:42:26.578 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:26.578 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:26.578 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:26.578 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:36.459433+0000", 2024-09-13T06:42:26.578 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.99898895799999998 2024-09-13T06:42:26.578 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:26.578 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:26.578 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:26.578 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:36.459622+0000", 2024-09-13T06:42:26.578 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00018940299999999999 2024-09-13T06:42:26.579 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:26.579 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:26.579 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:26.579 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:36.460497+0000", 2024-09-13T06:42:26.579 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00087481199999999999 2024-09-13T06:42:26.579 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:26.579 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:26.579 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:26.579 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:26.579 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:26.579 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:159632 3.a 3:57f62123:::rbd_header.112138ed422:head [create,call rbd.create in=9b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e167)", 2024-09-13T06:42:26.579 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:42:07.853351+0000", 2024-09-13T06:42:26.579 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 18.640490531000001, 2024-09-13T06:42:26.580 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.95572760999999995, 2024-09-13T06:42:26.580 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:26.580 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:42:26.580 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:26.580 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:26.580 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:26.580 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 159632 2024-09-13T06:42:26.580 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:26.580 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:26.580 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:26.580 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:26.580 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:07.853351+0000", 2024-09-13T06:42:26.580 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:26.580 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:26.581 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:26.581 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:26.581 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:07.853351+0000", 2024-09-13T06:42:26.581 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:26.581 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:26.581 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:26.581 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:26.581 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:07.853350+0000", 2024-09-13T06:42:26.581 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.999999 2024-09-13T06:42:26.581 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:26.581 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:26.581 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:26.581 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:07.853356+0000", 2024-09-13T06:42:26.581 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.1560000000000003e-06 2024-09-13T06:42:26.582 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:26.582 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:26.582 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:26.582 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:07.853365+0000", 2024-09-13T06:42:26.582 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.8079999999999999e-06 2024-09-13T06:42:26.582 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:26.582 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:26.582 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:26.582 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:07.853372+0000", 2024-09-13T06:42:26.582 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.5540000000000003e-06 2024-09-13T06:42:26.582 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:26.582 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:26.582 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:26.582 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:07.853430+0000", 2024-09-13T06:42:26.583 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8038000000000002e-05 2024-09-13T06:42:26.583 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:26.583 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:26.583 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:42:26.583 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:07.853444+0000", 2024-09-13T06:42:26.583 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3719e-05 2024-09-13T06:42:26.583 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:26.583 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:26.583 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:26.583 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:08.804052+0000", 2024-09-13T06:42:26.583 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.95060817799999997 2024-09-13T06:42:26.583 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:26.583 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:26.584 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:26.584 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:08.804234+0000", 2024-09-13T06:42:26.584 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00018192999999999999 2024-09-13T06:42:26.584 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:26.584 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:26.584 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 6", 2024-09-13T06:42:26.584 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:08.804797+0000", 2024-09-13T06:42:26.584 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00056282399999999996 2024-09-13T06:42:26.584 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:26.584 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:26.584 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-09-13T06:42:26.584 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:08.805704+0000", 2024-09-13T06:42:26.584 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00090781 2024-09-13T06:42:26.584 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:26.584 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:26.585 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:42:26.585 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:08.808907+0000", 2024-09-13T06:42:26.585 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0032031239999999999 2024-09-13T06:42:26.585 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:26.585 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:26.585 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:42:26.585 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:08.808998+0000", 2024-09-13T06:42:26.585 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.0191000000000004e-05 2024-09-13T06:42:26.585 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:26.585 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:26.585 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:26.585 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:08.809079+0000", 2024-09-13T06:42:26.585 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.1076999999999996e-05 2024-09-13T06:42:26.585 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:26.585 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:26.586 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:26.586 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:26.586 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:26.586 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:42:26.587 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-13T06:42:26.588 INFO:teuthology.orchestra.run.smithi081.stderr:noscrub is set 2024-09-13T06:42:26.588 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:42:26.584+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:42:26.615 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-13T06:42:26.609+0000 7fa8b2799640 -1 osd.7 186 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T06:42:26.687 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:42:26.684+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:42:26.696 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-13T06:42:26.761 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:42:26.761 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-13T06:42:26.761 INFO:teuthology.orchestra.run.smithi081.stdout: "num_ops": 0 2024-09-13T06:42:26.761 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:42:26.775 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-13T06:42:26.818 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:42:26.816+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:42:26.825 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:42:26.825 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [], 2024-09-13T06:42:26.825 INFO:teuthology.orchestra.run.smithi139.stdout: "num_ops": 0 2024-09-13T06:42:26.825 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:42:26.890 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:42:26.884+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:42:26.939 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:42:26.939 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-13T06:42:26.939 INFO:teuthology.orchestra.run.smithi081.stdout: "complaint_time": 30, 2024-09-13T06:42:26.939 INFO:teuthology.orchestra.run.smithi081.stdout: "num_blocked_ops": 0 2024-09-13T06:42:26.939 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:42:26.953 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-13T06:42:26.994 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:42:26.992+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:42:27.091 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:42:27.085+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:42:27.119 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:42:27.119 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 20, 2024-09-13T06:42:27.119 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 600, 2024-09-13T06:42:27.119 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [ 2024-09-13T06:42:27.119 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.119 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:36160 3.f 3:f62782c2:::rbd_object_map.11219660270d.0000000000000016:head [call] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-13T06:42:27.119 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:01.607291+0000", 2024-09-13T06:42:27.119 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 145.51058146, 2024-09-13T06:42:27.119 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.99619456699999998, 2024-09-13T06:42:27.120 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:27.120 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:27.120 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:27.120 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:27.120 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:27.120 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 36160 2024-09-13T06:42:27.120 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.120 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:27.120 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.120 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:27.120 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:01.607291+0000", 2024-09-13T06:42:27.120 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:27.120 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.120 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.120 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:27.121 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:01.607291+0000", 2024-09-13T06:42:27.121 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:27.121 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.121 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.121 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:27.121 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:01.607289+0000", 2024-09-13T06:42:27.121 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999976 2024-09-13T06:42:27.121 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.121 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.121 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:27.121 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:01.607302+0000", 2024-09-13T06:42:27.121 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3018e-05 2024-09-13T06:42:27.121 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.121 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.121 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:27.122 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:01.607323+0000", 2024-09-13T06:42:27.122 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1030999999999999e-05 2024-09-13T06:42:27.122 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.122 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.122 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:27.122 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:01.607342+0000", 2024-09-13T06:42:27.122 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8961e-05 2024-09-13T06:42:27.122 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.122 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.122 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:27.122 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:01.607425+0000", 2024-09-13T06:42:27.122 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.3171999999999996e-05 2024-09-13T06:42:27.122 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.122 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.122 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:42:27.122 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:01.607441+0000", 2024-09-13T06:42:27.123 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5996999999999999e-05 2024-09-13T06:42:27.123 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.123 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.123 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:27.123 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:02.596186+0000", 2024-09-13T06:42:27.123 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.98874432000000001 2024-09-13T06:42:27.123 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.123 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.123 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for missing object", 2024-09-13T06:42:27.123 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:02.596618+0000", 2024-09-13T06:42:27.123 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000432032 2024-09-13T06:42:27.123 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.123 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.123 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:27.124 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:02.600845+0000", 2024-09-13T06:42:27.124 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0042277410000000001 2024-09-13T06:42:27.124 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.124 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.124 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:27.124 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:02.601003+0000", 2024-09-13T06:42:27.124 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00015731999999999999 2024-09-13T06:42:27.124 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.124 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.124 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:27.124 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:02.603486+0000", 2024-09-13T06:42:27.124 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0024832510000000001 2024-09-13T06:42:27.124 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:27.124 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:27.125 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:27.125 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.125 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.125 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:37806 3.9 3:951cb95b:::rbd_data.1121d8143c6e.0000000000000002:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e56)", 2024-09-13T06:42:27.125 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:06.373482+0000", 2024-09-13T06:42:27.125 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 140.74439042399999, 2024-09-13T06:42:27.125 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.002476213, 2024-09-13T06:42:27.125 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:27.125 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:27.125 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:27.125 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:27.125 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:27.125 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 37806 2024-09-13T06:42:27.126 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.126 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:27.126 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.126 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:27.126 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.373482+0000", 2024-09-13T06:42:27.126 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:27.126 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.126 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.126 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:27.126 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.373482+0000", 2024-09-13T06:42:27.126 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:27.126 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.126 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.126 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:27.126 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.373479+0000", 2024-09-13T06:42:27.126 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999962 2024-09-13T06:42:27.127 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.127 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.127 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:27.127 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.373495+0000", 2024-09-13T06:42:27.127 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6640999999999999e-05 2024-09-13T06:42:27.127 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.127 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.127 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:27.127 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.373542+0000", 2024-09-13T06:42:27.127 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6229000000000001e-05 2024-09-13T06:42:27.127 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.127 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.127 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:27.128 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.373564+0000", 2024-09-13T06:42:27.128 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2684000000000002e-05 2024-09-13T06:42:27.128 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.128 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.128 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:27.128 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374268+0000", 2024-09-13T06:42:27.128 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00070363700000000001 2024-09-13T06:42:27.128 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.128 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.128 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:42:27.128 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374305+0000", 2024-09-13T06:42:27.128 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.6936e-05 2024-09-13T06:42:27.128 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.128 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.128 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:27.129 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.375175+0000", 2024-09-13T06:42:27.129 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.000870454 2024-09-13T06:42:27.129 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.129 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.129 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:27.129 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.375678+0000", 2024-09-13T06:42:27.129 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00050292499999999999 2024-09-13T06:42:27.129 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.129 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.129 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:27.129 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.375959+0000", 2024-09-13T06:42:27.129 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00028050599999999997 2024-09-13T06:42:27.129 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:27.129 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:27.130 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:27.130 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.130 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.130 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:37821 3.9 3:951cb95b:::rbd_data.1121d8143c6e.0000000000000002:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e56)", 2024-09-13T06:42:27.130 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:06.374454+0000", 2024-09-13T06:42:27.130 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 140.74341930700001, 2024-09-13T06:42:27.130 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.002545072, 2024-09-13T06:42:27.130 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:27.130 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:27.130 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:27.130 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:27.130 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:27.130 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 37821 2024-09-13T06:42:27.130 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.130 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:27.131 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.131 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:27.131 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374454+0000", 2024-09-13T06:42:27.131 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:27.131 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.131 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.131 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:27.131 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374454+0000", 2024-09-13T06:42:27.131 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:27.131 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.131 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.131 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:27.131 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374452+0000", 2024-09-13T06:42:27.131 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999981 2024-09-13T06:42:27.132 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.132 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.132 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:27.132 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374463+0000", 2024-09-13T06:42:27.132 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0756e-05 2024-09-13T06:42:27.132 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.132 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.132 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:27.132 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374487+0000", 2024-09-13T06:42:27.132 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4887000000000001e-05 2024-09-13T06:42:27.132 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.132 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.132 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:27.133 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374504+0000", 2024-09-13T06:42:27.133 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6852000000000001e-05 2024-09-13T06:42:27.133 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.133 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.133 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:27.133 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374829+0000", 2024-09-13T06:42:27.133 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000324684 2024-09-13T06:42:27.133 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.133 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.133 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:42:27.133 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374880+0000", 2024-09-13T06:42:27.133 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.1378000000000002e-05 2024-09-13T06:42:27.134 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.134 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.134 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:27.134 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.376423+0000", 2024-09-13T06:42:27.134 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.001542734 2024-09-13T06:42:27.134 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.134 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.134 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:27.134 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.376607+0000", 2024-09-13T06:42:27.134 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000183656 2024-09-13T06:42:27.134 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.134 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.134 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:27.134 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.376999+0000", 2024-09-13T06:42:27.135 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00039191200000000001 2024-09-13T06:42:27.135 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:27.135 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:27.135 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:27.135 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.135 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.135 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:37836 3.9 3:951cb95b:::rbd_data.1121d8143c6e.0000000000000002:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e56)", 2024-09-13T06:42:27.135 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:06.374929+0000", 2024-09-13T06:42:27.135 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 140.742943655, 2024-09-13T06:42:27.135 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.002778825, 2024-09-13T06:42:27.135 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:27.135 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:27.135 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:27.135 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:27.136 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:27.136 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 37836 2024-09-13T06:42:27.136 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.136 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:27.136 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.136 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:27.136 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374929+0000", 2024-09-13T06:42:27.136 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:27.136 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.136 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.136 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:27.136 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374929+0000", 2024-09-13T06:42:27.136 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:27.136 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.137 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.137 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:27.137 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374927+0000", 2024-09-13T06:42:27.137 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999981 2024-09-13T06:42:27.137 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.137 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.137 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:27.137 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374939+0000", 2024-09-13T06:42:27.137 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1846e-05 2024-09-13T06:42:27.137 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.137 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.137 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:27.137 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374962+0000", 2024-09-13T06:42:27.138 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3054e-05 2024-09-13T06:42:27.138 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.138 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.138 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:27.138 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374978+0000", 2024-09-13T06:42:27.138 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5899000000000001e-05 2024-09-13T06:42:27.138 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.138 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.138 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:27.138 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.375106+0000", 2024-09-13T06:42:27.138 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00012789 2024-09-13T06:42:27.138 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.138 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.138 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:42:27.139 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.375134+0000", 2024-09-13T06:42:27.139 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.8254000000000001e-05 2024-09-13T06:42:27.139 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.139 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.139 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:27.139 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.377082+0000", 2024-09-13T06:42:27.139 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0019471520000001 2024-09-13T06:42:27.139 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.139 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.139 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:27.139 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.377330+0000", 2024-09-13T06:42:27.139 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00024834199999999997 2024-09-13T06:42:27.139 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.139 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.139 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:27.140 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.377708+0000", 2024-09-13T06:42:27.140 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00037817100000000001 2024-09-13T06:42:27.140 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:27.140 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:27.140 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:27.140 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.140 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.140 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:37851 3.9 3:951cb95b:::rbd_data.1121d8143c6e.0000000000000002:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e56)", 2024-09-13T06:42:27.140 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:06.382636+0000", 2024-09-13T06:42:27.140 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 140.73523677, 2024-09-13T06:42:27.140 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.99582539400000003, 2024-09-13T06:42:27.140 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:27.140 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:27.140 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:27.140 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:27.141 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:27.141 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 37851 2024-09-13T06:42:27.141 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.141 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:27.141 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.141 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:27.141 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.382636+0000", 2024-09-13T06:42:27.141 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:27.141 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.141 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.141 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:27.141 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.382636+0000", 2024-09-13T06:42:27.141 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:27.141 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.141 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.142 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:27.142 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.382633+0000", 2024-09-13T06:42:27.142 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999971 2024-09-13T06:42:27.142 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.142 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.142 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:27.142 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.382652+0000", 2024-09-13T06:42:27.142 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8834999999999998e-05 2024-09-13T06:42:27.142 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.142 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.142 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:27.142 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.382695+0000", 2024-09-13T06:42:27.142 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.3136000000000002e-05 2024-09-13T06:42:27.142 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.142 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.142 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:27.143 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.382716+0000", 2024-09-13T06:42:27.143 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1421e-05 2024-09-13T06:42:27.143 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.143 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.143 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:27.143 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.382860+0000", 2024-09-13T06:42:27.143 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00014389200000000001 2024-09-13T06:42:27.143 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.143 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.143 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:42:27.143 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.382890+0000", 2024-09-13T06:42:27.143 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9827000000000001e-05 2024-09-13T06:42:27.143 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.143 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.144 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:27.144 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.377779+0000", 2024-09-13T06:42:27.144 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.99488842899999996 2024-09-13T06:42:27.144 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.144 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.144 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:27.144 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.378007+0000", 2024-09-13T06:42:27.144 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00022838099999999999 2024-09-13T06:42:27.144 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.144 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.144 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:27.144 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.378462+0000", 2024-09-13T06:42:27.144 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00045452300000000003 2024-09-13T06:42:27.144 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:27.144 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:27.144 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:27.145 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.145 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.145 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:37866 3.9 3:951cb95b:::rbd_data.1121d8143c6e.0000000000000002:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e56)", 2024-09-13T06:42:27.145 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:06.383951+0000", 2024-09-13T06:42:27.145 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 140.733922084, 2024-09-13T06:42:27.145 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.99517962299999996, 2024-09-13T06:42:27.145 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:27.145 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:27.145 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:27.145 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:27.145 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:27.145 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 37866 2024-09-13T06:42:27.145 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.145 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:27.145 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.146 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:27.146 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.383951+0000", 2024-09-13T06:42:27.146 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:27.146 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.146 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.146 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:27.146 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.383951+0000", 2024-09-13T06:42:27.146 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:27.146 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.146 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.146 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:27.146 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.383949+0000", 2024-09-13T06:42:27.146 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999981 2024-09-13T06:42:27.146 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.146 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.147 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:27.147 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.383961+0000", 2024-09-13T06:42:27.147 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1999e-05 2024-09-13T06:42:27.147 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.147 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.147 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:27.147 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384019+0000", 2024-09-13T06:42:27.147 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7621000000000003e-05 2024-09-13T06:42:27.147 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.147 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.147 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:27.147 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384040+0000", 2024-09-13T06:42:27.147 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1528000000000001e-05 2024-09-13T06:42:27.147 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.147 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.147 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:27.148 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384186+0000", 2024-09-13T06:42:27.148 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00014573799999999999 2024-09-13T06:42:27.148 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.148 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.148 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:42:27.148 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384204+0000", 2024-09-13T06:42:27.148 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7992e-05 2024-09-13T06:42:27.148 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.148 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.148 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:27.148 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.378536+0000", 2024-09-13T06:42:27.148 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.99433268600000002 2024-09-13T06:42:27.148 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.148 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.148 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:27.149 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.378771+0000", 2024-09-13T06:42:27.149 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00023445399999999999 2024-09-13T06:42:27.149 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.149 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.149 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:27.149 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.379130+0000", 2024-09-13T06:42:27.149 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00035954200000000002 2024-09-13T06:42:27.149 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:27.149 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:27.149 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:27.149 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.149 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.149 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:37881 3.9 3:951cb95b:::rbd_data.1121d8143c6e.0000000000000002:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e56)", 2024-09-13T06:42:27.149 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:06.384239+0000", 2024-09-13T06:42:27.149 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 140.73363366999999, 2024-09-13T06:42:27.150 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.99541483500000005, 2024-09-13T06:42:27.150 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:27.150 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:27.150 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:27.150 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:27.150 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:27.150 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 37881 2024-09-13T06:42:27.150 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.150 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:27.150 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.150 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:27.150 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384239+0000", 2024-09-13T06:42:27.150 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:27.150 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.151 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.151 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:27.151 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384239+0000", 2024-09-13T06:42:27.151 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:27.151 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.151 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.151 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:27.151 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384238+0000", 2024-09-13T06:42:27.151 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999986 2024-09-13T06:42:27.151 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.151 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.151 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:27.151 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384246+0000", 2024-09-13T06:42:27.151 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.2449999999999998e-06 2024-09-13T06:42:27.152 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.152 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.152 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:27.152 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384268+0000", 2024-09-13T06:42:27.152 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1518e-05 2024-09-13T06:42:27.152 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.152 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.152 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:27.152 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384282+0000", 2024-09-13T06:42:27.152 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4501999999999999e-05 2024-09-13T06:42:27.152 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.152 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.152 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:27.152 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384356+0000", 2024-09-13T06:42:27.152 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4265999999999997e-05 2024-09-13T06:42:27.153 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.153 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.153 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:42:27.153 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384370+0000", 2024-09-13T06:42:27.153 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3942e-05 2024-09-13T06:42:27.153 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.153 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.153 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:27.153 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.379199+0000", 2024-09-13T06:42:27.153 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.99482866599999997 2024-09-13T06:42:27.153 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.153 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.153 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:27.153 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.379347+0000", 2024-09-13T06:42:27.153 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00014749199999999999 2024-09-13T06:42:27.154 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.154 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.154 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:27.154 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.379654+0000", 2024-09-13T06:42:27.154 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00030752999999999998 2024-09-13T06:42:27.154 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:27.154 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:27.154 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:27.154 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.154 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.154 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:37896 3.9 3:951cb95b:::rbd_data.1121d8143c6e.0000000000000002:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e56)", 2024-09-13T06:42:27.154 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:06.384412+0000", 2024-09-13T06:42:27.154 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 140.733461237, 2024-09-13T06:42:27.154 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.99777835999999998, 2024-09-13T06:42:27.154 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:27.155 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:27.155 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:27.155 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:27.155 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:27.155 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 37896 2024-09-13T06:42:27.155 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.155 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:27.155 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.155 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:27.155 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384412+0000", 2024-09-13T06:42:27.155 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:27.155 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.155 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.155 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:27.155 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384412+0000", 2024-09-13T06:42:27.156 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:27.156 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.156 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.156 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:27.156 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384410+0000", 2024-09-13T06:42:27.156 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.999999 2024-09-13T06:42:27.156 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.156 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.156 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:27.156 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384418+0000", 2024-09-13T06:42:27.156 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.486e-06 2024-09-13T06:42:27.156 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.156 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.156 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:27.156 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384436+0000", 2024-09-13T06:42:27.157 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7668000000000001e-05 2024-09-13T06:42:27.157 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.157 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.157 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:27.157 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384449+0000", 2024-09-13T06:42:27.157 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3395e-05 2024-09-13T06:42:27.157 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.157 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.157 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:27.157 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384605+0000", 2024-09-13T06:42:27.157 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00015563099999999999 2024-09-13T06:42:27.157 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.157 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.158 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:42:27.158 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384635+0000", 2024-09-13T06:42:27.158 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.0383999999999999e-05 2024-09-13T06:42:27.158 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.158 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.158 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:27.158 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.379730+0000", 2024-09-13T06:42:27.158 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.99509493999999998 2024-09-13T06:42:27.158 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.158 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.158 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:27.158 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.379964+0000", 2024-09-13T06:42:27.158 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00023353499999999999 2024-09-13T06:42:27.158 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.158 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.159 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:27.159 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.382190+0000", 2024-09-13T06:42:27.159 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0022265039999999998 2024-09-13T06:42:27.159 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:27.159 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:27.159 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:27.159 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.159 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.159 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43222 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 389120~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:42:27.159 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558181+0000", 2024-09-13T06:42:27.159 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 125.55969198299999, 2024-09-13T06:42:27.159 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.06252038, 2024-09-13T06:42:27.159 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:27.159 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:27.159 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:27.160 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:27.160 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:27.160 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43222 2024-09-13T06:42:27.160 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.160 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:27.160 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.160 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:27.160 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558181+0000", 2024-09-13T06:42:27.160 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:27.160 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.160 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.160 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:27.160 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558181+0000", 2024-09-13T06:42:27.161 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:27.161 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.161 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.161 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:27.161 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558181+0000", 2024-09-13T06:42:27.161 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:27.161 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.161 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.161 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:27.161 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558183+0000", 2024-09-13T06:42:27.161 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.857e-06 2024-09-13T06:42:27.161 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.161 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.161 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:27.161 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558188+0000", 2024-09-13T06:42:27.162 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3759999999999999e-06 2024-09-13T06:42:27.162 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.162 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.162 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:27.162 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558261+0000", 2024-09-13T06:42:27.162 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3097999999999997e-05 2024-09-13T06:42:27.162 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.162 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.162 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:27.162 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.620354+0000", 2024-09-13T06:42:27.162 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.062092587999999997 2024-09-13T06:42:27.162 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.162 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.162 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:27.163 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.620428+0000", 2024-09-13T06:42:27.163 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3954000000000004e-05 2024-09-13T06:42:27.163 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.163 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.163 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:27.163 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.620701+0000", 2024-09-13T06:42:27.163 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000273773 2024-09-13T06:42:27.163 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:27.163 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:27.163 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:27.163 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.163 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.163 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43223 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 393216~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:42:27.163 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558267+0000", 2024-09-13T06:42:27.164 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 125.559605926, 2024-09-13T06:42:27.164 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.062813151999999997, 2024-09-13T06:42:27.164 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:27.164 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:27.164 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:27.164 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:27.164 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:27.164 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43223 2024-09-13T06:42:27.164 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.164 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:27.164 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.164 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:27.164 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558267+0000", 2024-09-13T06:42:27.164 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:27.165 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.165 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.165 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:27.165 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558267+0000", 2024-09-13T06:42:27.165 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:27.165 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.165 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.165 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:27.165 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558266+0000", 2024-09-13T06:42:27.165 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:27.165 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.165 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.165 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:27.165 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558270+0000", 2024-09-13T06:42:27.165 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.2389999999999998e-06 2024-09-13T06:42:27.166 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.166 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.166 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:27.166 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558277+0000", 2024-09-13T06:42:27.166 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5680000000000002e-06 2024-09-13T06:42:27.166 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.166 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.166 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:27.166 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558282+0000", 2024-09-13T06:42:27.166 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7060000000000003e-06 2024-09-13T06:42:27.166 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.166 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.166 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:27.166 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.620731+0000", 2024-09-13T06:42:27.166 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.062448661000000003 2024-09-13T06:42:27.167 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.167 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.167 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:27.167 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.620806+0000", 2024-09-13T06:42:27.167 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5862e-05 2024-09-13T06:42:27.167 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.167 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.167 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:27.167 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.621080+0000", 2024-09-13T06:42:27.167 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00027368599999999998 2024-09-13T06:42:27.167 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:27.167 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:27.167 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:27.167 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.167 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.168 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43224 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 407552~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:42:27.168 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558286+0000", 2024-09-13T06:42:27.168 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 125.55958656200001, 2024-09-13T06:42:27.168 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.063179052999999999, 2024-09-13T06:42:27.168 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:27.168 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:27.168 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:27.168 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:27.168 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:27.168 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43224 2024-09-13T06:42:27.168 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.168 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:27.168 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.168 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:27.168 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558286+0000", 2024-09-13T06:42:27.169 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:27.169 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.169 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.169 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:27.169 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558286+0000", 2024-09-13T06:42:27.169 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:27.169 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.169 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.169 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:27.169 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558286+0000", 2024-09-13T06:42:27.169 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:27.169 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.169 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.169 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:27.169 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558288+0000", 2024-09-13T06:42:27.169 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.227e-06 2024-09-13T06:42:27.170 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.170 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.170 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:27.170 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558292+0000", 2024-09-13T06:42:27.170 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.6289999999999999e-06 2024-09-13T06:42:27.170 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.170 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.170 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:27.170 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558294+0000", 2024-09-13T06:42:27.170 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5409999999999999e-06 2024-09-13T06:42:27.170 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.170 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.170 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:27.170 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.621110+0000", 2024-09-13T06:42:27.171 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.062815776000000004 2024-09-13T06:42:27.171 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.171 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.171 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:27.171 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.621186+0000", 2024-09-13T06:42:27.171 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5570999999999999e-05 2024-09-13T06:42:27.171 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.171 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.171 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:27.171 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.621465+0000", 2024-09-13T06:42:27.171 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00027988200000000001 2024-09-13T06:42:27.171 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:27.171 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:27.172 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:27.172 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.172 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.172 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43225 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 421888~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:42:27.172 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558296+0000", 2024-09-13T06:42:27.172 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 125.559576595, 2024-09-13T06:42:27.172 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.063551110999999993, 2024-09-13T06:42:27.172 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:27.172 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:27.172 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:27.172 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:27.172 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:27.172 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43225 2024-09-13T06:42:27.173 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.173 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:27.173 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.173 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:27.173 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558296+0000", 2024-09-13T06:42:27.173 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:27.173 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.173 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.173 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:27.173 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558296+0000", 2024-09-13T06:42:27.173 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:27.174 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.174 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.174 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:27.174 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558296+0000", 2024-09-13T06:42:27.174 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:42:27.174 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.174 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.174 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:27.174 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558305+0000", 2024-09-13T06:42:27.174 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.5290000000000008e-06 2024-09-13T06:42:27.174 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.174 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.174 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:27.175 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558308+0000", 2024-09-13T06:42:27.175 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.5619999999999999e-06 2024-09-13T06:42:27.175 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.175 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.175 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:27.175 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558311+0000", 2024-09-13T06:42:27.175 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.43e-06 2024-09-13T06:42:27.175 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.175 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.175 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:27.175 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.621495+0000", 2024-09-13T06:42:27.175 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.063184289000000005 2024-09-13T06:42:27.175 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.176 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.176 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:27.176 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.621569+0000", 2024-09-13T06:42:27.176 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4250000000000002e-05 2024-09-13T06:42:27.176 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.176 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.176 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:27.176 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.621847+0000", 2024-09-13T06:42:27.176 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00027826400000000002 2024-09-13T06:42:27.176 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:27.176 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:27.176 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:27.177 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.177 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.177 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43226 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 436224~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:42:27.177 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558313+0000", 2024-09-13T06:42:27.177 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 125.559559959, 2024-09-13T06:42:27.177 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.063914420999999999, 2024-09-13T06:42:27.177 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:27.177 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:27.177 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:27.177 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:27.177 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:27.177 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43226 2024-09-13T06:42:27.178 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.178 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:27.178 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.178 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:27.178 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558313+0000", 2024-09-13T06:42:27.178 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:27.178 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.178 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.178 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:27.178 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558313+0000", 2024-09-13T06:42:27.178 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:27.178 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.178 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.178 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:27.179 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558313+0000", 2024-09-13T06:42:27.179 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:27.179 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.179 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.179 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:27.179 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558314+0000", 2024-09-13T06:42:27.179 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3740000000000001e-06 2024-09-13T06:42:27.179 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.179 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.179 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:27.179 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558317+0000", 2024-09-13T06:42:27.179 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9730000000000002e-06 2024-09-13T06:42:27.180 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.180 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.180 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:27.180 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558319+0000", 2024-09-13T06:42:27.180 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4059999999999999e-06 2024-09-13T06:42:27.180 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.180 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.180 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:27.180 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.621877+0000", 2024-09-13T06:42:27.180 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.063557408999999995 2024-09-13T06:42:27.180 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.180 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.180 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:27.180 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.621951+0000", 2024-09-13T06:42:27.181 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4487999999999996e-05 2024-09-13T06:42:27.181 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.181 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.181 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:27.181 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.622227+0000", 2024-09-13T06:42:27.181 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000276011 2024-09-13T06:42:27.181 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:27.181 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:27.181 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:27.181 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.181 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.181 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43227 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 450560~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:42:27.181 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558322+0000", 2024-09-13T06:42:27.182 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 125.55955137799999, 2024-09-13T06:42:27.182 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.064285348000000006, 2024-09-13T06:42:27.182 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:27.182 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:27.182 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:27.182 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:27.182 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:27.182 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43227 2024-09-13T06:42:27.182 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.182 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:27.182 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.182 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:27.182 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558322+0000", 2024-09-13T06:42:27.182 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:27.183 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.183 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.183 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:27.183 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558322+0000", 2024-09-13T06:42:27.183 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:27.183 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.183 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.183 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:27.183 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558321+0000", 2024-09-13T06:42:27.183 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:42:27.183 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.183 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.183 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:27.183 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558323+0000", 2024-09-13T06:42:27.184 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.576e-06 2024-09-13T06:42:27.184 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.184 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.184 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:27.184 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558328+0000", 2024-09-13T06:42:27.184 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0719999999999999e-06 2024-09-13T06:42:27.184 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.184 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.184 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:27.184 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558332+0000", 2024-09-13T06:42:27.184 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.8130000000000002e-06 2024-09-13T06:42:27.184 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.184 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.184 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:27.184 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.622255+0000", 2024-09-13T06:42:27.185 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.063923195000000002 2024-09-13T06:42:27.185 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.185 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.185 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:27.185 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.622330+0000", 2024-09-13T06:42:27.185 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5383000000000007e-05 2024-09-13T06:42:27.185 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.185 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.185 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:27.185 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.622607+0000", 2024-09-13T06:42:27.185 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00027651999999999999 2024-09-13T06:42:27.185 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:27.185 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:27.185 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:27.185 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.186 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.186 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43228 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 464896~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:42:27.186 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558335+0000", 2024-09-13T06:42:27.186 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 125.55953746900001, 2024-09-13T06:42:27.186 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.064652253000000007, 2024-09-13T06:42:27.186 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:27.186 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:27.186 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:27.186 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:27.186 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:27.186 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43228 2024-09-13T06:42:27.186 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.186 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:27.186 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.186 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:27.187 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558335+0000", 2024-09-13T06:42:27.187 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:27.187 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.187 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.187 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:27.187 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558335+0000", 2024-09-13T06:42:27.187 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:27.187 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.187 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.187 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:27.187 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558335+0000", 2024-09-13T06:42:27.187 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:27.187 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.187 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.187 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:27.188 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558337+0000", 2024-09-13T06:42:27.188 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1380000000000001e-06 2024-09-13T06:42:27.188 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.188 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.188 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:27.188 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558343+0000", 2024-09-13T06:42:27.188 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.5140000000000001e-06 2024-09-13T06:42:27.188 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.188 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.188 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:27.188 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558348+0000", 2024-09-13T06:42:27.188 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9640000000000002e-06 2024-09-13T06:42:27.188 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.188 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.188 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:27.189 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.622636+0000", 2024-09-13T06:42:27.189 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.064288260999999999 2024-09-13T06:42:27.189 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.189 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.189 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:27.189 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.622715+0000", 2024-09-13T06:42:27.189 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.9351000000000006e-05 2024-09-13T06:42:27.189 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.189 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.189 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:27.189 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.622988+0000", 2024-09-13T06:42:27.189 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00027242599999999998 2024-09-13T06:42:27.189 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:27.189 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:27.189 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:27.190 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.190 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.190 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43229 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 479232~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:42:27.190 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558352+0000", 2024-09-13T06:42:27.190 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 125.559521054, 2024-09-13T06:42:27.190 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.065018024999999993, 2024-09-13T06:42:27.190 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:27.190 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:27.190 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:27.190 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:27.190 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:27.190 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43229 2024-09-13T06:42:27.190 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.190 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:27.190 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.191 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:27.191 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558352+0000", 2024-09-13T06:42:27.191 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:27.191 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.191 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.191 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:27.191 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558352+0000", 2024-09-13T06:42:27.191 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:27.191 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.191 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.191 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:27.191 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558352+0000", 2024-09-13T06:42:27.191 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:27.191 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.191 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.192 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:27.192 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558354+0000", 2024-09-13T06:42:27.192 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4930000000000001e-06 2024-09-13T06:42:27.192 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.192 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.192 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:27.192 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558360+0000", 2024-09-13T06:42:27.192 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.263e-06 2024-09-13T06:42:27.192 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.192 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.192 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:27.192 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558369+0000", 2024-09-13T06:42:27.192 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.0829999999999993e-06 2024-09-13T06:42:27.192 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.192 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.193 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:27.193 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.623017+0000", 2024-09-13T06:42:27.193 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.064647799000000006 2024-09-13T06:42:27.193 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.193 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.193 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:27.193 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.623090+0000", 2024-09-13T06:42:27.193 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3071000000000006e-05 2024-09-13T06:42:27.193 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.193 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.193 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:27.193 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.623370+0000", 2024-09-13T06:42:27.193 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000279661 2024-09-13T06:42:27.193 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:27.193 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:27.194 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:27.194 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.194 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.194 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43230 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 493568~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:42:27.194 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558374+0000", 2024-09-13T06:42:27.194 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 125.559498761, 2024-09-13T06:42:27.194 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.065410435000000003, 2024-09-13T06:42:27.194 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:27.194 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:27.194 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:27.194 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:27.194 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:27.194 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43230 2024-09-13T06:42:27.194 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.194 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:27.195 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.195 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:27.195 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558374+0000", 2024-09-13T06:42:27.195 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:27.195 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.195 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.195 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:27.195 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558374+0000", 2024-09-13T06:42:27.195 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:27.195 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.195 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.195 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:27.195 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558374+0000", 2024-09-13T06:42:27.195 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:27.195 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.196 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.196 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:27.196 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558376+0000", 2024-09-13T06:42:27.196 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4430000000000002e-06 2024-09-13T06:42:27.196 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.196 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.196 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:27.196 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558382+0000", 2024-09-13T06:42:27.196 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3029999999999996e-06 2024-09-13T06:42:27.196 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.196 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.196 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:27.196 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558387+0000", 2024-09-13T06:42:27.196 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.1699999999999999e-06 2024-09-13T06:42:27.197 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.197 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.197 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:27.197 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.623400+0000", 2024-09-13T06:42:27.197 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.065013244999999997 2024-09-13T06:42:27.197 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.197 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.197 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:27.197 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.623474+0000", 2024-09-13T06:42:27.197 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3889999999999999e-05 2024-09-13T06:42:27.197 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.197 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.197 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:27.197 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.623785+0000", 2024-09-13T06:42:27.197 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00031080099999999998 2024-09-13T06:42:27.197 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:27.198 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:27.198 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:27.198 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.198 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.198 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43231 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 507904~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:42:27.198 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558391+0000", 2024-09-13T06:42:27.198 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 125.55948207599999, 2024-09-13T06:42:27.198 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.065788597000000004, 2024-09-13T06:42:27.198 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:27.198 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:27.198 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:27.198 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:27.198 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:27.198 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43231 2024-09-13T06:42:27.199 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.199 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:27.199 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.199 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:27.199 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558391+0000", 2024-09-13T06:42:27.199 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:27.199 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.199 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.199 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:27.199 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558391+0000", 2024-09-13T06:42:27.199 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:27.199 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.199 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.199 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:27.200 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558390+0000", 2024-09-13T06:42:27.200 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:27.200 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.200 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.200 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:27.200 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558393+0000", 2024-09-13T06:42:27.200 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2570000000000002e-06 2024-09-13T06:42:27.200 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.200 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.200 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:27.200 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558399+0000", 2024-09-13T06:42:27.200 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0419999999999999e-06 2024-09-13T06:42:27.200 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.200 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.201 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:27.201 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558403+0000", 2024-09-13T06:42:27.201 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6249999999999998e-06 2024-09-13T06:42:27.201 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.201 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.201 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:27.201 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.623811+0000", 2024-09-13T06:42:27.201 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.065407549999999995 2024-09-13T06:42:27.201 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.201 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.201 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:27.201 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.623877+0000", 2024-09-13T06:42:27.201 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.5902999999999996e-05 2024-09-13T06:42:27.201 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.202 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.202 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:27.202 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.624179+0000", 2024-09-13T06:42:27.202 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00030259999999999998 2024-09-13T06:42:27.202 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:27.202 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:27.202 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:27.202 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.202 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.202 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43232 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 522240~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:42:27.202 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558422+0000", 2024-09-13T06:42:27.202 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 125.559451299, 2024-09-13T06:42:27.203 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.066176061999999994, 2024-09-13T06:42:27.203 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:27.203 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:27.203 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:27.203 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:27.203 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:27.203 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43232 2024-09-13T06:42:27.203 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.203 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:27.203 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.203 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:27.203 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558422+0000", 2024-09-13T06:42:27.203 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:27.204 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.204 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.204 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:27.204 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558422+0000", 2024-09-13T06:42:27.204 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:27.204 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.204 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.204 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:27.204 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558421+0000", 2024-09-13T06:42:27.204 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:27.204 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.204 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.204 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:27.204 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558428+0000", 2024-09-13T06:42:27.205 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.1690000000000003e-06 2024-09-13T06:42:27.205 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.205 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.205 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:27.205 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558434+0000", 2024-09-13T06:42:27.205 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9309999999999996e-06 2024-09-13T06:42:27.205 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.205 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.205 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:27.205 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558447+0000", 2024-09-13T06:42:27.205 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.271e-05 2024-09-13T06:42:27.205 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.205 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.205 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:27.206 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.624209+0000", 2024-09-13T06:42:27.206 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.065762102000000003 2024-09-13T06:42:27.206 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.206 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.206 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:27.206 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.624282+0000", 2024-09-13T06:42:27.206 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.2889e-05 2024-09-13T06:42:27.206 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.206 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.206 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:27.206 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.624598+0000", 2024-09-13T06:42:27.206 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00031591399999999998 2024-09-13T06:42:27.206 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:27.206 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:27.207 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:27.207 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.207 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.207 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43486 3.f 3:f7da9c8f:::rbd_data.1121f5f2e1c0.000000000000000b:1f [read 260096~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:42:27.207 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.569088+0000", 2024-09-13T06:42:27.207 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 125.548784576, 2024-09-13T06:42:27.207 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.062579223000000003, 2024-09-13T06:42:27.207 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:27.207 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:27.207 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:27.207 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:27.207 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:27.207 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43486 2024-09-13T06:42:27.207 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.208 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:27.208 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.208 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:27.208 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.569088+0000", 2024-09-13T06:42:27.208 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:27.208 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.208 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.208 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:27.208 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.569088+0000", 2024-09-13T06:42:27.208 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:27.208 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.208 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.208 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:27.208 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.569088+0000", 2024-09-13T06:42:27.209 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:27.209 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.209 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.209 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:27.209 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.569091+0000", 2024-09-13T06:42:27.209 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9629999999999998e-06 2024-09-13T06:42:27.209 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.209 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.209 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:27.209 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.569097+0000", 2024-09-13T06:42:27.209 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.4160000000000001e-06 2024-09-13T06:42:27.209 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.209 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.210 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:27.210 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.569102+0000", 2024-09-13T06:42:27.210 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6659999999999999e-06 2024-09-13T06:42:27.210 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.210 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.210 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:27.210 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.631346+0000", 2024-09-13T06:42:27.210 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.062243896 2024-09-13T06:42:27.210 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.210 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.210 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:27.210 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.631413+0000", 2024-09-13T06:42:27.210 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.7638000000000005e-05 2024-09-13T06:42:27.210 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.210 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.211 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:27.211 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.631668+0000", 2024-09-13T06:42:27.211 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0002541 2024-09-13T06:42:27.211 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:27.211 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:27.211 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:27.211 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:27.211 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:27.211 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:42:27.212 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-13T06:42:27.213 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-13T06:42:27.209+0000 7fa8bb18e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 36790) UID: 0 2024-09-13T06:42:27.314 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:42:27.313+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:42:27.340 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:42:27.340 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-13T06:42:27.340 INFO:teuthology.orchestra.run.smithi081.stdout: "num_ops": 0 2024-09-13T06:42:27.340 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:42:27.355 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-13T06:42:27.415 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:42:27.409+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:42:27.471 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:42:27.471 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-13T06:42:27.471 INFO:teuthology.orchestra.run.smithi081.stdout: "complaint_time": 30, 2024-09-13T06:42:27.471 INFO:teuthology.orchestra.run.smithi081.stdout: "num_blocked_ops": 0 2024-09-13T06:42:27.471 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:42:27.485 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-13T06:42:27.530 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:42:27.528+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:42:27.617 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:42:27.612+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:42:27.625 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:42:27.625 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 20, 2024-09-13T06:42:27.625 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 600, 2024-09-13T06:42:27.625 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [ 2024-09-13T06:42:27.625 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.625 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:2226 3.15 3:af026987:::rbd_data.112173e2f1b7.0000000000000017:head [sparse-read 0~4194304] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-13T06:42:27.625 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:37.606562+0000", 2024-09-13T06:42:27.625 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 170.01724089199999, 2024-09-13T06:42:27.626 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.83322091700000001, 2024-09-13T06:42:27.626 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:27.626 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:42:27.626 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:27.626 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:27.626 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:27.626 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 2226 2024-09-13T06:42:27.626 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.626 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:27.626 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.626 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:27.626 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606562+0000", 2024-09-13T06:42:27.626 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:27.627 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.627 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.627 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:27.627 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606562+0000", 2024-09-13T06:42:27.627 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:27.627 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.627 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.627 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:27.627 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606561+0000", 2024-09-13T06:42:27.627 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:27.627 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.627 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.627 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:27.628 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606565+0000", 2024-09-13T06:42:27.628 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.4379999999999999e-06 2024-09-13T06:42:27.628 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.628 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.628 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:27.628 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606569+0000", 2024-09-13T06:42:27.628 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.425e-06 2024-09-13T06:42:27.628 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.628 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.628 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:27.628 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606572+0000", 2024-09-13T06:42:27.628 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.05e-06 2024-09-13T06:42:27.628 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.628 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.629 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:27.629 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606621+0000", 2024-09-13T06:42:27.629 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.8723000000000001e-05 2024-09-13T06:42:27.629 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.629 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.629 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:42:27.629 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606630+0000", 2024-09-13T06:42:27.629 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.8040000000000007e-06 2024-09-13T06:42:27.629 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.629 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.629 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:27.629 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.439648+0000", 2024-09-13T06:42:27.629 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.83301824800000002 2024-09-13T06:42:27.629 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.630 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.630 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:27.630 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.439782+0000", 2024-09-13T06:42:27.630 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00013466699999999999 2024-09-13T06:42:27.630 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:27.630 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:27.630 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:27.630 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.630 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.630 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25661 3.8 3:1180686c:::rbd_data.1121f2c5ee81.0000000000000009:13 [read 397312~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:42:27.630 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.436956+0000", 2024-09-13T06:42:27.630 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 151.186846358, 2024-09-13T06:42:27.630 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089036758999999993, 2024-09-13T06:42:27.630 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:27.631 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:27.631 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:27.631 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:27.631 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:27.631 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25661 2024-09-13T06:42:27.631 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.631 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:27.631 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.631 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:27.631 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436956+0000", 2024-09-13T06:42:27.631 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:27.631 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.631 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.631 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:27.631 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436956+0000", 2024-09-13T06:42:27.632 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:27.632 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.632 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.632 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:27.632 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436956+0000", 2024-09-13T06:42:27.632 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:27.632 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.632 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.632 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:27.632 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436958+0000", 2024-09-13T06:42:27.632 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1770000000000001e-06 2024-09-13T06:42:27.632 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.632 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.632 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:27.633 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436963+0000", 2024-09-13T06:42:27.633 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.6489999999999996e-06 2024-09-13T06:42:27.633 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.633 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.633 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:27.633 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436975+0000", 2024-09-13T06:42:27.633 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1783999999999999e-05 2024-09-13T06:42:27.633 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.633 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.633 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:27.633 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.525671+0000", 2024-09-13T06:42:27.633 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.088696292999999995 2024-09-13T06:42:27.633 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.633 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.634 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:27.634 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.525749+0000", 2024-09-13T06:42:27.634 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.7589000000000005e-05 2024-09-13T06:42:27.634 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.634 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.634 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:27.634 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.525993+0000", 2024-09-13T06:42:27.634 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00024381000000000001 2024-09-13T06:42:27.634 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:27.634 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:27.634 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:27.634 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.634 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.634 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25662 3.8 3:1180686c:::rbd_data.1121f2c5ee81.0000000000000009:13 [read 421888~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:42:27.635 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.436980+0000", 2024-09-13T06:42:27.635 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 151.186822046, 2024-09-13T06:42:27.635 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089367577000000004, 2024-09-13T06:42:27.635 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:27.635 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:27.635 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:27.635 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:27.635 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:27.635 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25662 2024-09-13T06:42:27.635 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.635 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:27.635 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.635 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:27.635 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436980+0000", 2024-09-13T06:42:27.635 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:27.636 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.636 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.636 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:27.636 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436980+0000", 2024-09-13T06:42:27.636 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:27.636 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.636 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.636 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:27.636 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436980+0000", 2024-09-13T06:42:27.636 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:27.636 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.636 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.636 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:27.636 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436982+0000", 2024-09-13T06:42:27.637 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3989999999999998e-06 2024-09-13T06:42:27.637 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.637 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.637 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:27.637 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436988+0000", 2024-09-13T06:42:27.637 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0039999999999996e-06 2024-09-13T06:42:27.637 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.637 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.637 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:27.637 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436993+0000", 2024-09-13T06:42:27.637 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6090000000000003e-06 2024-09-13T06:42:27.637 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.637 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.637 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:27.637 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.526035+0000", 2024-09-13T06:42:27.638 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089042248000000004 2024-09-13T06:42:27.638 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.638 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.638 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:27.638 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.526111+0000", 2024-09-13T06:42:27.638 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5643999999999996e-05 2024-09-13T06:42:27.638 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.638 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.638 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:27.638 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.526348+0000", 2024-09-13T06:42:27.638 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00023705800000000001 2024-09-13T06:42:27.638 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:27.638 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:27.638 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:27.639 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.639 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.639 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25663 3.8 3:1180686c:::rbd_data.1121f2c5ee81.0000000000000009:13 [read 466944~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:42:27.639 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.436998+0000", 2024-09-13T06:42:27.639 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 151.18680439900001, 2024-09-13T06:42:27.639 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089730867000000006, 2024-09-13T06:42:27.639 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:27.639 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:27.639 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:27.639 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:27.639 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:27.639 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25663 2024-09-13T06:42:27.639 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.640 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:27.640 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.640 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:27.640 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436998+0000", 2024-09-13T06:42:27.640 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:27.640 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.640 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.640 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:27.640 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436998+0000", 2024-09-13T06:42:27.640 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:27.640 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.640 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.640 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:27.641 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436998+0000", 2024-09-13T06:42:27.641 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:27.641 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.641 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.641 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:27.641 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437000+0000", 2024-09-13T06:42:27.641 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0940000000000002e-06 2024-09-13T06:42:27.641 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.641 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.641 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:27.641 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437005+0000", 2024-09-13T06:42:27.641 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.604e-06 2024-09-13T06:42:27.641 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.641 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.642 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:27.642 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437032+0000", 2024-09-13T06:42:27.642 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6407e-05 2024-09-13T06:42:27.642 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.642 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.642 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:27.642 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.526363+0000", 2024-09-13T06:42:27.642 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089331456000000004 2024-09-13T06:42:27.642 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.642 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.642 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:27.642 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.526404+0000", 2024-09-13T06:42:27.642 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.0887999999999999e-05 2024-09-13T06:42:27.642 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.643 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.643 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:27.643 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.526729+0000", 2024-09-13T06:42:27.643 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00032486 2024-09-13T06:42:27.643 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:27.643 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:27.643 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:27.643 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.643 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.643 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25664 3.8 3:1180686c:::rbd_data.1121f2c5ee81.0000000000000009:13 [read 491520~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:42:27.643 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.437040+0000", 2024-09-13T06:42:27.643 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 151.18676248400001, 2024-09-13T06:42:27.643 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.090016650000000004, 2024-09-13T06:42:27.643 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:27.644 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:27.644 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:27.644 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:27.644 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:27.644 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25664 2024-09-13T06:42:27.644 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.644 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:27.644 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.644 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:27.644 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437040+0000", 2024-09-13T06:42:27.644 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:27.644 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.644 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.645 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:27.645 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437040+0000", 2024-09-13T06:42:27.645 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:27.645 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.645 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.645 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:27.645 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437039+0000", 2024-09-13T06:42:27.645 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:27.645 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.645 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.645 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:27.645 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437047+0000", 2024-09-13T06:42:27.645 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4839999999999998e-06 2024-09-13T06:42:27.646 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.646 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.646 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:27.646 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437054+0000", 2024-09-13T06:42:27.646 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.8299999999999998e-06 2024-09-13T06:42:27.646 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.646 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.646 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:27.646 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437060+0000", 2024-09-13T06:42:27.646 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.1510000000000001e-06 2024-09-13T06:42:27.646 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.646 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.646 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:27.646 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.526772+0000", 2024-09-13T06:42:27.646 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089711737999999999 2024-09-13T06:42:27.647 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.647 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.647 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:27.647 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.526848+0000", 2024-09-13T06:42:27.647 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5870000000000004e-05 2024-09-13T06:42:27.647 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.647 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.647 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:27.647 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.527057+0000", 2024-09-13T06:42:27.647 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000209106 2024-09-13T06:42:27.647 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:27.647 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:27.647 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:27.647 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.648 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.648 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25740 3.18 3:1c662b96:::rbd_data.1121f2c5ee81.0000000000000010:13 [read 200704~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:42:27.648 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443352+0000", 2024-09-13T06:42:27.648 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 151.18045080900001, 2024-09-13T06:42:27.648 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089068222000000002, 2024-09-13T06:42:27.648 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:27.648 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:27.648 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:27.648 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:27.648 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:27.648 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25740 2024-09-13T06:42:27.648 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.648 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:27.648 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.649 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:27.649 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443352+0000", 2024-09-13T06:42:27.649 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:27.649 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.649 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.649 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:27.649 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443352+0000", 2024-09-13T06:42:27.649 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:27.649 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.649 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.649 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:27.649 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443351+0000", 2024-09-13T06:42:27.649 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:27.649 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.650 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.650 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:27.650 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443354+0000", 2024-09-13T06:42:27.650 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.841e-06 2024-09-13T06:42:27.650 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.650 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.650 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:27.650 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443361+0000", 2024-09-13T06:42:27.650 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.0010000000000004e-06 2024-09-13T06:42:27.650 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.650 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.650 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:27.650 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443366+0000", 2024-09-13T06:42:27.650 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7119999999999999e-06 2024-09-13T06:42:27.650 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.651 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.651 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:27.651 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532117+0000", 2024-09-13T06:42:27.651 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.088751327000000005 2024-09-13T06:42:27.651 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.651 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.651 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:27.651 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532193+0000", 2024-09-13T06:42:27.651 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5839000000000004e-05 2024-09-13T06:42:27.651 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.651 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.651 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:27.651 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532420+0000", 2024-09-13T06:42:27.651 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00022691000000000001 2024-09-13T06:42:27.651 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:27.652 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:27.652 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:27.652 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.652 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.652 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25741 3.18 3:1c662b96:::rbd_data.1121f2c5ee81.0000000000000010:13 [read 225280~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:42:27.652 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443378+0000", 2024-09-13T06:42:27.652 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 151.180424042, 2024-09-13T06:42:27.652 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089324107, 2024-09-13T06:42:27.652 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:27.652 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:27.652 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:27.652 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:27.652 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:27.653 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25741 2024-09-13T06:42:27.653 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.653 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:27.653 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.653 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:27.653 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443378+0000", 2024-09-13T06:42:27.653 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:27.653 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.653 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.653 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:27.653 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443378+0000", 2024-09-13T06:42:27.653 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:27.653 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.654 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.654 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:27.654 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443378+0000", 2024-09-13T06:42:27.654 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:27.654 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.654 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.654 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:27.654 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443380+0000", 2024-09-13T06:42:27.654 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3549999999999999e-06 2024-09-13T06:42:27.654 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.654 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.654 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:27.654 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443388+0000", 2024-09-13T06:42:27.654 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.7449999999999995e-06 2024-09-13T06:42:27.655 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.655 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.655 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:27.655 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443393+0000", 2024-09-13T06:42:27.655 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.4e-06 2024-09-13T06:42:27.655 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.655 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.655 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:27.655 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532454+0000", 2024-09-13T06:42:27.655 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089060941000000005 2024-09-13T06:42:27.655 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.655 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.655 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:27.655 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532512+0000", 2024-09-13T06:42:27.656 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7763000000000002e-05 2024-09-13T06:42:27.656 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.656 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.656 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:27.656 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532703+0000", 2024-09-13T06:42:27.656 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000190328 2024-09-13T06:42:27.656 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:27.656 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:27.656 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:27.656 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.656 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.656 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25742 3.18 3:1c662b96:::rbd_data.1121f2c5ee81.0000000000000010:13 [read 270336~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:42:27.656 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443398+0000", 2024-09-13T06:42:27.656 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 151.18040432999999, 2024-09-13T06:42:27.656 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089621836999999996, 2024-09-13T06:42:27.657 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:27.657 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:27.657 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:27.657 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:27.657 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:27.657 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25742 2024-09-13T06:42:27.657 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.657 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:27.657 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.657 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:27.657 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443398+0000", 2024-09-13T06:42:27.657 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:27.657 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.657 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.657 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:27.657 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443398+0000", 2024-09-13T06:42:27.658 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:27.658 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.658 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.658 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:27.658 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443398+0000", 2024-09-13T06:42:27.658 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:27.658 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.658 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.658 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:27.658 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443400+0000", 2024-09-13T06:42:27.658 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1849999999999998e-06 2024-09-13T06:42:27.658 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.658 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.658 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:27.658 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443407+0000", 2024-09-13T06:42:27.659 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3669999999999999e-06 2024-09-13T06:42:27.659 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.659 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.659 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:27.659 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443420+0000", 2024-09-13T06:42:27.659 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2645e-05 2024-09-13T06:42:27.659 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.659 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.659 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:27.659 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532742+0000", 2024-09-13T06:42:27.659 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089322200000000004 2024-09-13T06:42:27.659 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.659 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.659 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:27.659 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532818+0000", 2024-09-13T06:42:27.660 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.6019000000000005e-05 2024-09-13T06:42:27.660 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.660 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.660 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:27.660 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533020+0000", 2024-09-13T06:42:27.660 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000201721 2024-09-13T06:42:27.660 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:27.660 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:27.660 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:27.660 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.660 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.660 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25743 3.18 3:1c662b96:::rbd_data.1121f2c5ee81.0000000000000010:13 [read 294912~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:42:27.660 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443425+0000", 2024-09-13T06:42:27.660 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 151.180377322, 2024-09-13T06:42:27.660 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089864075000000002, 2024-09-13T06:42:27.661 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:27.661 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:27.661 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:27.661 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:27.661 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:27.661 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25743 2024-09-13T06:42:27.661 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.661 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:27.661 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.661 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:27.661 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443425+0000", 2024-09-13T06:42:27.661 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:27.661 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.661 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.661 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:27.662 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443425+0000", 2024-09-13T06:42:27.662 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:27.662 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.662 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.662 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:27.662 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443425+0000", 2024-09-13T06:42:27.662 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:27.662 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.662 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.662 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:27.662 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443432+0000", 2024-09-13T06:42:27.662 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3420000000000002e-06 2024-09-13T06:42:27.662 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.662 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.662 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:27.663 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443440+0000", 2024-09-13T06:42:27.663 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5689999999999999e-06 2024-09-13T06:42:27.663 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.663 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.663 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:27.663 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443445+0000", 2024-09-13T06:42:27.663 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9590000000000003e-06 2024-09-13T06:42:27.663 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.663 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.663 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:27.663 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533063+0000", 2024-09-13T06:42:27.663 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089617988999999995 2024-09-13T06:42:27.663 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.663 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.664 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:27.664 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533122+0000", 2024-09-13T06:42:27.664 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9052999999999999e-05 2024-09-13T06:42:27.664 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.664 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.664 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:27.664 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533289+0000", 2024-09-13T06:42:27.664 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00016752800000000001 2024-09-13T06:42:27.664 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:27.664 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:27.664 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:27.664 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.664 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.664 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25744 3.18 3.69d46638 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:42:27.664 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443449+0000", 2024-09-13T06:42:27.665 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 151.18035317499999, 2024-09-13T06:42:27.665 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089869148999999995, 2024-09-13T06:42:27.665 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:27.665 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:42:27.665 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:27.665 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:27.665 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:27.665 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25744 2024-09-13T06:42:27.665 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.665 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:27.665 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.665 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:27.665 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443449+0000", 2024-09-13T06:42:27.665 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:27.665 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.665 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.666 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:27.666 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443449+0000", 2024-09-13T06:42:27.666 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:27.666 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.666 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.666 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:27.666 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443449+0000", 2024-09-13T06:42:27.666 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:27.666 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.666 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.666 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:27.666 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443451+0000", 2024-09-13T06:42:27.666 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.244e-06 2024-09-13T06:42:27.666 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.666 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.667 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:27.667 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443457+0000", 2024-09-13T06:42:27.667 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.66e-06 2024-09-13T06:42:27.667 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.667 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.667 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:27.667 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443461+0000", 2024-09-13T06:42:27.667 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5449999999999997e-06 2024-09-13T06:42:27.667 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.667 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.667 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:27.667 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533311+0000", 2024-09-13T06:42:27.667 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089849729000000003 2024-09-13T06:42:27.667 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.667 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.668 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:27.668 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533318+0000", 2024-09-13T06:42:27.668 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.328e-06 2024-09-13T06:42:27.668 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:27.668 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:27.668 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:27.668 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.668 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.668 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25745 3.18 3.69d46638 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:42:27.668 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443466+0000", 2024-09-13T06:42:27.668 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 151.180336117, 2024-09-13T06:42:27.668 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089886743000000005, 2024-09-13T06:42:27.668 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:27.668 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:42:27.668 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:27.669 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:27.669 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:27.669 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25745 2024-09-13T06:42:27.669 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.669 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:27.669 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.669 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:27.669 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443466+0000", 2024-09-13T06:42:27.669 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:27.669 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.669 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.669 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:27.669 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443466+0000", 2024-09-13T06:42:27.669 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:27.670 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.670 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.670 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:27.670 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443466+0000", 2024-09-13T06:42:27.670 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:27.670 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.670 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.670 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:27.670 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443474+0000", 2024-09-13T06:42:27.670 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.1289999999999996e-06 2024-09-13T06:42:27.670 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.670 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.670 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:27.670 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443484+0000", 2024-09-13T06:42:27.670 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0654e-05 2024-09-13T06:42:27.671 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.671 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.671 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:27.671 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443490+0000", 2024-09-13T06:42:27.671 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8030000000000002e-06 2024-09-13T06:42:27.671 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.671 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.671 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:27.671 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533348+0000", 2024-09-13T06:42:27.671 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089857267000000005 2024-09-13T06:42:27.671 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.671 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.671 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:27.671 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533353+0000", 2024-09-13T06:42:27.671 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.5520000000000004e-06 2024-09-13T06:42:27.671 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:27.672 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:27.672 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:27.672 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.672 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.672 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25746 3.18 3.69d46638 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:42:27.672 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443495+0000", 2024-09-13T06:42:27.672 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 151.18030700400001, 2024-09-13T06:42:27.672 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089903725000000004, 2024-09-13T06:42:27.672 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:27.672 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:42:27.672 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:27.672 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:27.672 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:27.672 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25746 2024-09-13T06:42:27.673 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.673 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:27.673 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.673 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:27.673 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443495+0000", 2024-09-13T06:42:27.673 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:27.673 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.673 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.673 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:27.673 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443495+0000", 2024-09-13T06:42:27.673 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:27.673 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.673 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.674 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:27.674 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443495+0000", 2024-09-13T06:42:27.674 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:27.674 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.674 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.674 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:27.674 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443498+0000", 2024-09-13T06:42:27.674 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.7690000000000001e-06 2024-09-13T06:42:27.674 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.674 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.674 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:27.674 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443504+0000", 2024-09-13T06:42:27.674 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9710000000000001e-06 2024-09-13T06:42:27.674 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.675 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.675 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:27.675 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443508+0000", 2024-09-13T06:42:27.675 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4159999999999997e-06 2024-09-13T06:42:27.675 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.675 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.675 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:27.675 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533391+0000", 2024-09-13T06:42:27.675 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089882607000000003 2024-09-13T06:42:27.675 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.675 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.675 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:27.675 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533399+0000", 2024-09-13T06:42:27.675 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.4349999999999997e-06 2024-09-13T06:42:27.675 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:27.675 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:27.676 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:27.676 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.676 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.676 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25747 3.8 3.63996268 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:42:27.676 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443512+0000", 2024-09-13T06:42:27.676 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 151.180290273, 2024-09-13T06:42:27.676 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089880075000000004, 2024-09-13T06:42:27.676 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:27.676 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:42:27.676 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:27.676 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:27.676 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:27.676 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25747 2024-09-13T06:42:27.677 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.677 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:27.677 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.677 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:27.677 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443512+0000", 2024-09-13T06:42:27.677 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:27.677 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.677 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.677 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:27.677 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443512+0000", 2024-09-13T06:42:27.677 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:27.677 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.677 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.677 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:27.677 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443512+0000", 2024-09-13T06:42:27.678 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:27.678 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.678 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.678 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:27.678 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443514+0000", 2024-09-13T06:42:27.678 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0980000000000001e-06 2024-09-13T06:42:27.678 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.678 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.678 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:27.678 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443520+0000", 2024-09-13T06:42:27.678 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7069999999999997e-06 2024-09-13T06:42:27.678 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.678 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.678 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:27.678 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443524+0000", 2024-09-13T06:42:27.679 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5390000000000001e-06 2024-09-13T06:42:27.679 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.679 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.679 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:27.679 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533384+0000", 2024-09-13T06:42:27.679 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089859684999999995 2024-09-13T06:42:27.679 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.679 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.679 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:27.679 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533392+0000", 2024-09-13T06:42:27.679 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.3440000000000001e-06 2024-09-13T06:42:27.679 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:27.679 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:27.679 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:27.679 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.680 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.680 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25748 3.8 3.63996268 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:42:27.680 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443528+0000", 2024-09-13T06:42:27.680 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 151.18027414599999, 2024-09-13T06:42:27.680 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089890715999999996, 2024-09-13T06:42:27.680 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:27.680 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:42:27.680 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:27.680 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:27.680 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:27.680 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25748 2024-09-13T06:42:27.680 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.680 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:27.680 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.680 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:27.681 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443528+0000", 2024-09-13T06:42:27.681 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:27.681 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.681 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.681 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:27.681 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443528+0000", 2024-09-13T06:42:27.681 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:27.681 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.681 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.681 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:27.681 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443528+0000", 2024-09-13T06:42:27.681 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:27.681 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.681 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.682 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:27.682 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443530+0000", 2024-09-13T06:42:27.682 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0650000000000001e-06 2024-09-13T06:42:27.682 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.682 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.682 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:27.682 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443536+0000", 2024-09-13T06:42:27.682 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7259999999999999e-06 2024-09-13T06:42:27.682 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.682 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.682 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:27.682 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443540+0000", 2024-09-13T06:42:27.682 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5009999999999998e-06 2024-09-13T06:42:27.682 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.683 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.683 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:27.683 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533412+0000", 2024-09-13T06:42:27.683 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089871873000000005 2024-09-13T06:42:27.683 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.683 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.683 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:27.683 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533419+0000", 2024-09-13T06:42:27.683 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.883e-06 2024-09-13T06:42:27.683 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:27.683 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:27.683 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:27.683 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.683 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.684 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25749 3.8 3.63996268 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:42:27.684 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443545+0000", 2024-09-13T06:42:27.684 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 151.18025795, 2024-09-13T06:42:27.684 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089897988999999998, 2024-09-13T06:42:27.684 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:27.684 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:42:27.684 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:27.684 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:27.684 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:27.684 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25749 2024-09-13T06:42:27.684 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.684 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:27.684 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.685 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:27.685 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443545+0000", 2024-09-13T06:42:27.685 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:27.685 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.685 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.685 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:27.685 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443545+0000", 2024-09-13T06:42:27.685 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:27.685 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.685 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.685 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:27.685 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443544+0000", 2024-09-13T06:42:27.685 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:27.685 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.686 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.686 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:27.686 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443553+0000", 2024-09-13T06:42:27.686 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.4770000000000003e-06 2024-09-13T06:42:27.686 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.686 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.686 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:27.686 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443564+0000", 2024-09-13T06:42:27.686 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0986e-05 2024-09-13T06:42:27.686 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.686 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.686 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:27.686 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443569+0000", 2024-09-13T06:42:27.686 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2530000000000004e-06 2024-09-13T06:42:27.686 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.687 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.687 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:27.687 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533438+0000", 2024-09-13T06:42:27.687 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089868641999999999 2024-09-13T06:42:27.687 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.687 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.687 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:27.687 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533442+0000", 2024-09-13T06:42:27.687 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.989e-06 2024-09-13T06:42:27.687 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:27.687 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:27.687 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:27.687 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.688 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.688 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25750 3.8 3.63996268 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:42:27.688 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443574+0000", 2024-09-13T06:42:27.688 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 151.18022846400001, 2024-09-13T06:42:27.688 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089895143999999996, 2024-09-13T06:42:27.688 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:27.688 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:42:27.688 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:27.688 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:27.688 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:27.688 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25750 2024-09-13T06:42:27.688 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.688 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:27.688 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.689 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:27.689 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443574+0000", 2024-09-13T06:42:27.689 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:27.689 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.689 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.689 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:27.689 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443574+0000", 2024-09-13T06:42:27.689 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:27.689 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.689 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.689 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:27.689 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443574+0000", 2024-09-13T06:42:27.689 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:27.689 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.689 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.690 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:27.690 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443576+0000", 2024-09-13T06:42:27.690 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6910000000000002e-06 2024-09-13T06:42:27.690 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.690 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.690 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:27.690 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443583+0000", 2024-09-13T06:42:27.690 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.331e-06 2024-09-13T06:42:27.690 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.690 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.690 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:27.690 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443587+0000", 2024-09-13T06:42:27.690 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6129999999999997e-06 2024-09-13T06:42:27.690 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.691 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.691 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:27.691 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533464+0000", 2024-09-13T06:42:27.691 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089876605999999998 2024-09-13T06:42:27.691 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.691 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.691 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:27.691 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533469+0000", 2024-09-13T06:42:27.691 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3909999999999997e-06 2024-09-13T06:42:27.691 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:27.691 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:27.691 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:27.691 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.692 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.692 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25751 3.8 3.63996268 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:42:27.692 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443592+0000", 2024-09-13T06:42:27.692 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 151.18021076700001, 2024-09-13T06:42:27.692 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089913650999999997, 2024-09-13T06:42:27.692 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:27.692 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:42:27.692 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:27.692 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:27.692 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:27.692 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25751 2024-09-13T06:42:27.692 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.692 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:27.692 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.693 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:27.693 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443592+0000", 2024-09-13T06:42:27.693 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:27.693 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.693 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.693 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:27.693 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443592+0000", 2024-09-13T06:42:27.693 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:27.693 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.693 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.693 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:27.693 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443591+0000", 2024-09-13T06:42:27.693 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:27.694 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.694 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.694 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:27.694 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443594+0000", 2024-09-13T06:42:27.694 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3649999999999998e-06 2024-09-13T06:42:27.694 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.694 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.694 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:27.694 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443599+0000", 2024-09-13T06:42:27.694 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.699e-06 2024-09-13T06:42:27.694 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.694 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.694 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:27.694 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443611+0000", 2024-09-13T06:42:27.695 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1503e-05 2024-09-13T06:42:27.695 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.695 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.695 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:27.695 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533497+0000", 2024-09-13T06:42:27.695 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089886453000000005 2024-09-13T06:42:27.695 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.695 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.695 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:27.695 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533505+0000", 2024-09-13T06:42:27.695 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.9910000000000002e-06 2024-09-13T06:42:27.696 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:27.696 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:27.696 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:27.696 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.696 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.696 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25752 3.8 3.63996268 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:42:27.696 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443615+0000", 2024-09-13T06:42:27.696 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 151.180186986, 2024-09-13T06:42:27.696 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089905868999999999, 2024-09-13T06:42:27.696 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:27.696 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:42:27.696 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:27.696 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:27.696 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:27.697 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25752 2024-09-13T06:42:27.697 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.697 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:27.697 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.697 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:27.697 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443615+0000", 2024-09-13T06:42:27.697 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:27.697 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.697 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.697 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:27.697 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443615+0000", 2024-09-13T06:42:27.697 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:27.697 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.697 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.697 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:27.698 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443615+0000", 2024-09-13T06:42:27.698 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:27.698 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.698 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.698 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:27.698 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443617+0000", 2024-09-13T06:42:27.698 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3539999999999998e-06 2024-09-13T06:42:27.698 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.698 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.698 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:27.698 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443624+0000", 2024-09-13T06:42:27.698 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3600000000000001e-06 2024-09-13T06:42:27.698 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.699 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.699 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:27.699 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443628+0000", 2024-09-13T06:42:27.699 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.2350000000000001e-06 2024-09-13T06:42:27.699 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.699 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.699 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:27.699 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533517+0000", 2024-09-13T06:42:27.699 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089889029999999995 2024-09-13T06:42:27.699 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.699 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.699 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:27.699 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533521+0000", 2024-09-13T06:42:27.699 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.2529999999999998e-06 2024-09-13T06:42:27.699 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:27.699 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:27.700 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:27.700 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.700 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.700 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25755 3.8 3.63996268 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:42:27.700 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.444692+0000", 2024-09-13T06:42:27.700 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 151.17911028, 2024-09-13T06:42:27.700 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.088904186999999996, 2024-09-13T06:42:27.700 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:27.700 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:42:27.700 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:27.700 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:27.700 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:27.700 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25755 2024-09-13T06:42:27.700 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.700 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:27.701 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.701 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:27.701 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.444692+0000", 2024-09-13T06:42:27.701 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:27.701 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.701 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.701 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:27.701 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.444692+0000", 2024-09-13T06:42:27.701 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:27.701 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.701 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.701 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:27.701 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.444692+0000", 2024-09-13T06:42:27.701 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:27.701 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.702 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.702 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:27.702 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.444694+0000", 2024-09-13T06:42:27.702 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.058e-06 2024-09-13T06:42:27.702 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.702 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.702 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:27.702 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.444700+0000", 2024-09-13T06:42:27.702 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7769999999999999e-06 2024-09-13T06:42:27.702 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.702 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.702 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:27.702 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.444704+0000", 2024-09-13T06:42:27.703 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6229999999999996e-06 2024-09-13T06:42:27.703 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.703 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.703 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:27.703 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533587+0000", 2024-09-13T06:42:27.703 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.088882744999999999 2024-09-13T06:42:27.703 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.703 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.703 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:27.703 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533596+0000", 2024-09-13T06:42:27.703 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.3270000000000007e-06 2024-09-13T06:42:27.703 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:27.703 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:27.704 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:27.704 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.704 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.704 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:64356 3.c 3:32785be9:::rbd_header.11218ba71f0d:head [watch reconnect cookie 140361410387072 gen 2] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e95)", 2024-09-13T06:42:27.704 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:48.473318+0000", 2024-09-13T06:42:27.704 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 99.150484593000002, 2024-09-13T06:42:27.704 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1458904379999999, 2024-09-13T06:42:27.704 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:27.704 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:27.704 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:27.704 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:27.704 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:27.704 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 64356 2024-09-13T06:42:27.704 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.705 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:27.705 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.705 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:27.705 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:48.473318+0000", 2024-09-13T06:42:27.705 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:27.705 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.705 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.705 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:27.705 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:48.473318+0000", 2024-09-13T06:42:27.705 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:27.705 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.705 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.705 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:27.705 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:48.473315+0000", 2024-09-13T06:42:27.705 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999971 2024-09-13T06:42:27.706 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.706 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.706 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:27.706 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:48.473329+0000", 2024-09-13T06:42:27.706 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.433e-05 2024-09-13T06:42:27.706 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.706 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.706 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:27.706 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:48.473363+0000", 2024-09-13T06:42:27.706 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.3592e-05 2024-09-13T06:42:27.706 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.706 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.706 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:27.706 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:48.473386+0000", 2024-09-13T06:42:27.706 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2708999999999999e-05 2024-09-13T06:42:27.707 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.707 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.707 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:27.707 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:48.473804+0000", 2024-09-13T06:42:27.707 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00041789399999999998 2024-09-13T06:42:27.707 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.707 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.707 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:42:27.707 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:48.473830+0000", 2024-09-13T06:42:27.707 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6869e-05 2024-09-13T06:42:27.707 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.707 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.707 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:27.707 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:49.614332+0000", 2024-09-13T06:42:27.707 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.140501107 2024-09-13T06:42:27.707 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.708 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.708 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for rw locks", 2024-09-13T06:42:27.708 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:49.614496+0000", 2024-09-13T06:42:27.708 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00016451200000000001 2024-09-13T06:42:27.708 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.708 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.708 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:27.708 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:49.617131+0000", 2024-09-13T06:42:27.708 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.002634843 2024-09-13T06:42:27.708 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.708 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.708 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:27.708 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:49.617204+0000", 2024-09-13T06:42:27.708 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.2991000000000006e-05 2024-09-13T06:42:27.708 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:27.709 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:27.709 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:27.709 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:49.619208+0000", 2024-09-13T06:42:27.709 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.002004381 2024-09-13T06:42:27.709 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:27.709 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:27.709 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:27.709 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:27.709 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:27.709 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:42:27.710 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-13T06:42:27.754 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:42:27.752+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:42:27.818 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:42:27.813+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:42:27.824 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-13T06:42:27.842 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:42:27.842 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [], 2024-09-13T06:42:27.842 INFO:teuthology.orchestra.run.smithi139.stdout: "num_ops": 0 2024-09-13T06:42:27.842 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:42:27.856 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-13T06:42:27.919 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:42:27.916+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:42:27.976 INFO:teuthology.orchestra.run.smithi081.stdout:osd.0: {} 2024-09-13T06:42:27.976 INFO:teuthology.orchestra.run.smithi081.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-13T06:42:27.993 INFO:teuthology.orchestra.run.smithi081.stdout:osd.1: {} 2024-09-13T06:42:27.993 INFO:teuthology.orchestra.run.smithi081.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-13T06:42:28.010 INFO:teuthology.orchestra.run.smithi081.stdout:osd.2: {} 2024-09-13T06:42:28.010 INFO:teuthology.orchestra.run.smithi081.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-13T06:42:28.019 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:42:28.016+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:42:28.022 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:42:28.022 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [], 2024-09-13T06:42:28.022 INFO:teuthology.orchestra.run.smithi139.stdout: "complaint_time": 30, 2024-09-13T06:42:28.022 INFO:teuthology.orchestra.run.smithi139.stdout: "num_blocked_ops": 0 2024-09-13T06:42:28.022 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:42:28.026 INFO:teuthology.orchestra.run.smithi081.stdout:osd.3: {} 2024-09-13T06:42:28.026 INFO:teuthology.orchestra.run.smithi081.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-13T06:42:28.036 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-13T06:42:28.044 INFO:teuthology.orchestra.run.smithi081.stdout:osd.4: {} 2024-09-13T06:42:28.045 INFO:teuthology.orchestra.run.smithi081.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-13T06:42:28.061 INFO:teuthology.orchestra.run.smithi081.stdout:osd.5: {} 2024-09-13T06:42:28.061 INFO:teuthology.orchestra.run.smithi081.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-13T06:42:28.079 INFO:teuthology.orchestra.run.smithi081.stdout:osd.6: {} 2024-09-13T06:42:28.080 INFO:teuthology.orchestra.run.smithi081.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-13T06:42:28.097 INFO:teuthology.orchestra.run.smithi081.stdout:osd.7: {} 2024-09-13T06:42:28.097 INFO:teuthology.orchestra.run.smithi081.stderr:osd.7: osd_delete_sleep = '' osd_delete_sleep_hdd = '' osd_delete_sleep_hybrid = '' osd_delete_sleep_ssd = '' osd_enable_op_tracker = '' osd_max_backfills = '' osd_pg_delete_cost = '' (not observed, change may require restart) osd_recovery_max_active = '' osd_recovery_max_active_hdd = '' osd_recovery_max_active_ssd = '' osd_recovery_sleep = '' osd_recovery_sleep_hdd = '' osd_recovery_sleep_hybrid = '' osd_recovery_sleep_ssd = '' osd_scrub_sleep = '' osd_snap_trim_sleep = '' osd_snap_trim_sleep_hdd = '' osd_snap_trim_sleep_hybrid = '' osd_snap_trim_sleep_ssd = '' 2024-09-13T06:42:28.159 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:42:28.159 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:42:28.162 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:42:28.160+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:42:28.173 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-13T06:42:28.221 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-13T06:42:28.217+0000 7fa8bb18e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 36790) UID: 0 2024-09-13T06:42:28.295 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:42:28.295 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:42:28.309 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-13T06:42:28.352 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:42:28.349+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:42:28.424 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:42:28.420+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:42:28.472 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:42:28.472 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:42:28.486 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-13T06:42:28.525 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:42:28.520+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:42:28.589 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-13T06:42:28.610 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:42:28.610 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:42:28.624 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-13T06:42:28.625 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:42:28.621+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:42:28.727 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:42:28.721+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:42:28.741 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:42:28.741 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:42:28.755 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-13T06:42:28.828 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:42:28.824+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:42:28.922 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:42:28.922 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:42:28.929 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:42:28.925+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:42:28.936 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-13T06:42:29.030 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:42:29.028+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:42:29.105 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:42:29.105 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:42:29.119 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-13T06:42:29.130 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:42:29.128+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:42:29.231 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:42:29.228+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:42:29.241 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:42:29.241 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:42:29.255 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-13T06:42:29.332 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:42:29.329+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:42:29.374 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:42:29.374 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:42:29.388 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-13T06:42:29.433 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:42:29.428+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:42:29.533 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-13T06:42:29.529+0000 7fa8bb18e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 36790) UID: 0 2024-09-13T06:42:29.555 INFO:teuthology.orchestra.run.smithi081.stderr:nodeep-scrub is set 2024-09-13T06:42:29.559 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:42:29.559 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:42:29.584 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-13T06:42:29.620 INFO:teuthology.orchestra.run.smithi081.stdout:checking clone #33, image image_client.0-clone33 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent34 2024-09-13T06:42:29.634 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-13T06:42:29.629+0000 7fa8bb18e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 36790) UID: 0 2024-09-13T06:42:29.735 INFO:tasks.ceph.osd.6.smithi139.stderr:2024-09-13T06:42:29.729+0000 7fcd02c5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26385) UID: 0 2024-09-13T06:42:29.750 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:42:29.750 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:42:29.766 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-13T06:42:29.835 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:42:29.832+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:42:29.883 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:42:29.883 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:42:29.898 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-13T06:42:29.908 INFO:teuthology.orchestra.run.smithi081.stdout:4614 trunc from 0x41c0ef3 to 0xcc5baa6 2024-09-13T06:42:29.926 INFO:teuthology.orchestra.run.smithi081.stdout:4617 writesame 0xcbf948b thru 0xcc05c68 data_size 0x1(0xc7de bytes) 2024-09-13T06:42:29.936 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:42:29.932+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:42:29.979 INFO:teuthology.orchestra.run.smithi081.stdout:4618 trunc from 0xcc5baa6 to 0xa2b4903 2024-09-13T06:42:29.994 INFO:teuthology.orchestra.run.smithi081.stdout:4620 writesame 0x90a47f5 thru 0x90a9bdb data_size 0x1(0x53e7 bytes) 2024-09-13T06:42:30.007 INFO:teuthology.orchestra.run.smithi081.stdout:4622 read 0x9e329d6 thru 0x9e35148 (0x2773 bytes) 2024-09-13T06:42:30.008 INFO:teuthology.orchestra.run.smithi081.stdout:4623 read 0x6122526 thru 0x612e11a (0xbbf5 bytes) 2024-09-13T06:42:30.008 INFO:teuthology.orchestra.run.smithi081.stdout:4626 read 0x24b50f1 thru 0x24b71d1 (0x20e1 bytes) 2024-09-13T06:42:30.009 INFO:teuthology.orchestra.run.smithi081.stdout:4627 read 0x5cac36 thru 0x5cbd9e (0x1169 bytes) 2024-09-13T06:42:30.009 INFO:teuthology.orchestra.run.smithi081.stdout:4629 punch from 0x1df80bd to 0x1dfe486, (0x63c9 bytes) 2024-09-13T06:42:30.011 INFO:teuthology.orchestra.run.smithi081.stdout:4632 trunc from 0xa2b4903 to 0xad33bd7 2024-09-13T06:42:30.020 INFO:teuthology.orchestra.run.smithi081.stdout:4633 writesame 0x6a1bf04 thru 0x6a1bf06 data_size 0x1(0x3 bytes) 2024-09-13T06:42:30.025 INFO:teuthology.orchestra.run.smithi081.stdout:4635 write 0x2d5487b thru 0x2d57392 (0x2b18 bytes) 2024-09-13T06:42:30.028 INFO:teuthology.orchestra.run.smithi081.stdout:4636 writesame 0x365fdfe thru 0x36645da data_size 0x1(0x47dd bytes) 2024-09-13T06:42:30.037 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:42:30.032+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:42:30.042 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:42:30.042 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:42:30.052 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:42:30.052 INFO:teuthology.orchestra.run.smithi081.stdout:4638 writesame 0x6902176 thru 0x690ab47 data_size 0x2e(0x89d2 bytes) 2024-09-13T06:42:30.054 INFO:teuthology.orchestra.run.smithi081.stdout:4639 read 0x5dbd001 thru 0x5dc8068 (0xb068 bytes) 2024-09-13T06:42:30.055 INFO:teuthology.orchestra.run.smithi081.stdout:4640 read 0x5649ef6 thru 0x5659a75 (0xfb80 bytes) 2024-09-13T06:42:30.056 INFO:teuthology.orchestra.run.smithi081.stdout:4641 writesame 0x9bd2d7b thru 0x9bda7d3 data_size 0x1(0x7a59 bytes) 2024-09-13T06:42:30.057 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-13T06:42:30.090 INFO:teuthology.orchestra.run.smithi081.stdout:4642 write 0x3834ab thru 0x38db2e (0xa684 bytes) 2024-09-13T06:42:30.093 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:42:30.093 INFO:teuthology.orchestra.run.smithi081.stdout:4644 write 0x4c6495f thru 0x4c68a24 (0x40c6 bytes) 2024-09-13T06:42:30.095 INFO:teuthology.orchestra.run.smithi081.stdout:4645 write 0x6e5bf01 thru 0x6e5e1f3 (0x22f3 bytes) 2024-09-13T06:42:30.097 INFO:teuthology.orchestra.run.smithi081.stdout:4646 write 0x2365dac thru 0x236b8f8 (0x5b4d bytes) 2024-09-13T06:42:30.100 INFO:teuthology.orchestra.run.smithi081.stdout:4647 read 0x5a8b521 thru 0x5a9a136 (0xec16 bytes) 2024-09-13T06:42:30.101 INFO:teuthology.orchestra.run.smithi081.stdout:4649 read 0x943b954 thru 0x9441f62 (0x660f bytes) 2024-09-13T06:42:30.102 INFO:teuthology.orchestra.run.smithi081.stdout:4650 read 0x4ab447f thru 0x4ab559c (0x111e bytes) 2024-09-13T06:42:30.102 INFO:teuthology.orchestra.run.smithi081.stdout:4651 read 0x34c1ca7 thru 0x34c6f58 (0x52b2 bytes) 2024-09-13T06:42:30.104 INFO:teuthology.orchestra.run.smithi081.stdout:4652 read 0x92da67f thru 0x92dd64e (0x2fd0 bytes) 2024-09-13T06:42:30.104 INFO:teuthology.orchestra.run.smithi081.stdout:4653 read 0x273f2c6 thru 0x273f6ab (0x3e6 bytes) 2024-09-13T06:42:30.104 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:42:30.115 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-13T06:42:30.122 INFO:teuthology.orchestra.run.smithi081.stdout:4658 write 0xe482aef thru 0xe48a0b1 (0x75c3 bytes) 2024-09-13T06:42:30.134 INFO:teuthology.orchestra.run.smithi081.stdout:4663 write 0xeb843ab thru 0xeb8a78c (0x63e2 bytes) 2024-09-13T06:42:30.137 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:42:30.132+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:42:30.138 INFO:teuthology.orchestra.run.smithi081.stdout:4664 write 0x37dfb19 thru 0x37e9b04 (0x9fec bytes) 2024-09-13T06:42:30.141 INFO:teuthology.orchestra.run.smithi081.stdout:4665 write 0x44a37aa thru 0x44af41e (0xbc75 bytes) 2024-09-13T06:42:30.143 INFO:teuthology.orchestra.run.smithi081.stdout:4666 write 0xcb3537f thru 0xcb3f1e4 (0x9e66 bytes) 2024-09-13T06:42:30.161 INFO:teuthology.orchestra.run.smithi081.stdout:4668 trunc from 0xeb8a78d to 0x46e6fdd 2024-09-13T06:42:30.194 INFO:teuthology.orchestra.run.smithi081.stdout:4669 write 0xa2c6877 thru 0xa2cd492 (0x6c1c bytes) 2024-09-13T06:42:30.198 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:42:30.198 INFO:teuthology.orchestra.run.smithi081.stdout:4672 read 0x765a63a thru 0x7662079 (0x7a40 bytes) 2024-09-13T06:42:30.198 INFO:teuthology.orchestra.run.smithi081.stdout:4673 punch from 0x630a429 to 0x63122d4, (0x7eab bytes) 2024-09-13T06:42:30.199 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:42:30.208 INFO:teuthology.orchestra.run.smithi081.stdout:4676 write 0xab23943 thru 0xab30457 (0xcb15 bytes) 2024-09-13T06:42:30.225 INFO:teuthology.orchestra.run.smithi081.stdout:4677 writesame 0xe555ca1 thru 0xe564322 data_size 0x46(0xe682 bytes) 2024-09-13T06:42:30.225 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:42:30.226 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:42:30.228 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:42:30.228 INFO:teuthology.orchestra.run.smithi081.stdout:4679 read 0x75625e4 thru 0x75697ea (0x7207 bytes) 2024-09-13T06:42:30.238 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:42:30.236+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:42:30.243 INFO:teuthology.orchestra.run.smithi081.stdout:4680 trunc from 0xe564323 to 0x473d5d5 2024-09-13T06:42:30.249 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-13T06:42:30.257 INFO:teuthology.orchestra.run.smithi081.stdout:4681 write 0xeab5b1 thru 0xeacd12 (0x1762 bytes) 2024-09-13T06:42:30.258 INFO:teuthology.orchestra.run.smithi081.stdout:4682 read 0x35a5036 thru 0x35a9fea (0x4fb5 bytes) 2024-09-13T06:42:30.273 INFO:teuthology.orchestra.run.smithi081.stdout:4683 writesame 0x6cd9b9b thru 0x6ce982d data_size 0x7(0xfc93 bytes) 2024-09-13T06:42:30.274 INFO:teuthology.orchestra.run.smithi081.stdout:4685 read 0x4e1762b thru 0x4e1d6a6 (0x607c bytes) 2024-09-13T06:42:30.275 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:42:30.275 INFO:teuthology.orchestra.run.smithi081.stdout:4688 write 0x310f307 thru 0x311c986 (0xd680 bytes) 2024-09-13T06:42:30.282 INFO:teuthology.orchestra.run.smithi081.stdout:osd.0: {} 2024-09-13T06:42:30.282 INFO:teuthology.orchestra.run.smithi081.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-13T06:42:30.294 INFO:teuthology.orchestra.run.smithi081.stdout:4689 write 0xc3eb17f thru 0xc3ef268 (0x40ea bytes) 2024-09-13T06:42:30.297 INFO:teuthology.orchestra.run.smithi081.stdout:4690 write 0xae0f4ed thru 0xae1a36f (0xae83 bytes) 2024-09-13T06:42:30.301 INFO:teuthology.orchestra.run.smithi081.stdout:4691 write 0x86d4b99 thru 0x86d8880 (0x3ce8 bytes) 2024-09-13T06:42:30.303 INFO:teuthology.orchestra.run.smithi081.stdout:osd.1: {} 2024-09-13T06:42:30.303 INFO:teuthology.orchestra.run.smithi081.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-13T06:42:30.303 INFO:teuthology.orchestra.run.smithi081.stdout:4692 read 0x80e2f0c thru 0x80ef10d (0xc202 bytes) 2024-09-13T06:42:30.304 INFO:teuthology.orchestra.run.smithi081.stdout:4693 read 0x8423baa thru 0x842ec95 (0xb0ec bytes) 2024-09-13T06:42:30.305 INFO:teuthology.orchestra.run.smithi081.stdout:4694 write 0x30666e9 thru 0x306df30 (0x7848 bytes) 2024-09-13T06:42:30.307 INFO:teuthology.orchestra.run.smithi081.stdout:4696 clone 36 order 20 su 32768 sc 11 2024-09-13T06:42:30.320 INFO:teuthology.orchestra.run.smithi081.stdout:osd.2: {} 2024-09-13T06:42:30.320 INFO:teuthology.orchestra.run.smithi081.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-13T06:42:30.336 INFO:teuthology.orchestra.run.smithi081.stdout:osd.3: {} 2024-09-13T06:42:30.336 INFO:teuthology.orchestra.run.smithi081.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-13T06:42:30.338 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:42:30.336+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:42:30.358 INFO:teuthology.orchestra.run.smithi081.stdout:osd.4: {} 2024-09-13T06:42:30.358 INFO:teuthology.orchestra.run.smithi081.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-13T06:42:30.374 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:42:30.374 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-13T06:42:30.374 INFO:teuthology.orchestra.run.smithi081.stdout: "complaint_time": 30, 2024-09-13T06:42:30.374 INFO:teuthology.orchestra.run.smithi081.stdout: "num_blocked_ops": 0 2024-09-13T06:42:30.374 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:42:30.379 INFO:teuthology.orchestra.run.smithi081.stdout:osd.5: {} 2024-09-13T06:42:30.380 INFO:teuthology.orchestra.run.smithi081.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-13T06:42:30.388 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-13T06:42:30.401 INFO:teuthology.orchestra.run.smithi081.stdout:osd.6: {} 2024-09-13T06:42:30.402 INFO:teuthology.orchestra.run.smithi081.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-13T06:42:30.423 INFO:teuthology.orchestra.run.smithi081.stdout:osd.7: {} 2024-09-13T06:42:30.423 INFO:teuthology.orchestra.run.smithi081.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-13T06:42:30.439 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:42:30.436+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:42:30.527 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:42:30.528 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 20, 2024-09-13T06:42:30.528 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 600, 2024-09-13T06:42:30.528 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [ 2024-09-13T06:42:30.528 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:30.528 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:21979 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 14217216~4096 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:42:30.528 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.888811+0000", 2024-09-13T06:42:30.528 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 157.63929558199999, 2024-09-13T06:42:30.528 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049092969, 2024-09-13T06:42:30.528 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:30.528 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:30.529 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:30.529 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:30.529 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:30.529 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 21979 2024-09-13T06:42:30.529 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:30.529 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:30.529 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:30.529 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:30.529 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888811+0000", 2024-09-13T06:42:30.529 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:30.529 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:30.529 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:30.530 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:30.530 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888811+0000", 2024-09-13T06:42:30.530 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:30.530 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:30.530 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:30.530 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:30.530 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888811+0000", 2024-09-13T06:42:30.530 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:42:30.530 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:30.530 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:30.530 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:30.530 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888812+0000", 2024-09-13T06:42:30.531 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.204e-06 2024-09-13T06:42:30.531 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:30.531 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:30.531 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:30.531 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888815+0000", 2024-09-13T06:42:30.531 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9359999999999999e-06 2024-09-13T06:42:30.531 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:30.531 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:30.531 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:30.531 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888818+0000", 2024-09-13T06:42:30.531 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.7369999999999998e-06 2024-09-13T06:42:30.531 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:30.532 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:30.532 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:30.532 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.937663+0000", 2024-09-13T06:42:30.532 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.048844540999999998 2024-09-13T06:42:30.532 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:30.532 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:30.532 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:30.532 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.937709+0000", 2024-09-13T06:42:30.532 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6492999999999997e-05 2024-09-13T06:42:30.532 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:30.533 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:30.533 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:30.533 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.937904+0000", 2024-09-13T06:42:30.533 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00019526499999999999 2024-09-13T06:42:30.533 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:30.533 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:30.533 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:30.533 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:30.533 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:30.533 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:21980 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 14245888~4096 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:42:30.533 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.888820+0000", 2024-09-13T06:42:30.534 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 157.63928690500001, 2024-09-13T06:42:30.534 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049357080999999997, 2024-09-13T06:42:30.534 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:30.534 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:30.534 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:30.534 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:30.534 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:30.534 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 21980 2024-09-13T06:42:30.534 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:30.534 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:30.534 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:30.535 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:30.535 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888820+0000", 2024-09-13T06:42:30.535 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:30.535 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:30.535 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:30.535 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:30.535 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888820+0000", 2024-09-13T06:42:30.535 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:30.535 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:30.535 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:30.535 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:30.535 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888820+0000", 2024-09-13T06:42:30.536 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:42:30.536 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:30.536 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:30.536 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:30.536 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888821+0000", 2024-09-13T06:42:30.536 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.122e-06 2024-09-13T06:42:30.536 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:30.536 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:30.536 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:30.536 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888824+0000", 2024-09-13T06:42:30.537 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.0580000000000002e-06 2024-09-13T06:42:30.537 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:30.537 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:30.537 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:30.537 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888827+0000", 2024-09-13T06:42:30.537 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.666e-06 2024-09-13T06:42:30.537 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:30.537 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:30.537 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:30.537 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.937935+0000", 2024-09-13T06:42:30.537 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049108329999999999 2024-09-13T06:42:30.537 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:30.538 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:30.538 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:30.538 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.937985+0000", 2024-09-13T06:42:30.538 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9694000000000002e-05 2024-09-13T06:42:30.538 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:30.538 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:30.538 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:30.538 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.938177+0000", 2024-09-13T06:42:30.538 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00019241899999999999 2024-09-13T06:42:30.538 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:30.538 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:30.538 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:30.539 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:30.539 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:30.539 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:21984 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:snapdir [list-snaps] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:42:30.539 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.888829+0000", 2024-09-13T06:42:30.539 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 157.63927812700001, 2024-09-13T06:42:30.539 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049524545000000003, 2024-09-13T06:42:30.539 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:30.539 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:30.539 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:30.539 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:30.539 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:30.539 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 21984 2024-09-13T06:42:30.540 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:30.540 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:30.540 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:30.540 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:30.540 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888829+0000", 2024-09-13T06:42:30.540 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:30.540 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:30.540 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:30.540 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:30.540 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888829+0000", 2024-09-13T06:42:30.540 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:30.540 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:30.541 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:30.541 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:30.541 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888829+0000", 2024-09-13T06:42:30.541 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:42:30.541 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:30.541 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:30.541 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:30.541 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888830+0000", 2024-09-13T06:42:30.541 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2529999999999999e-06 2024-09-13T06:42:30.541 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:30.541 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:30.541 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:30.541 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888835+0000", 2024-09-13T06:42:30.542 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.4729999999999999e-06 2024-09-13T06:42:30.542 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:30.542 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:30.542 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:30.542 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888840+0000", 2024-09-13T06:42:30.542 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0159999999999999e-06 2024-09-13T06:42:30.542 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:30.542 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:30.542 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:30.542 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.938199+0000", 2024-09-13T06:42:30.542 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049358974999999999 2024-09-13T06:42:30.543 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:30.543 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:30.543 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:30.543 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.938268+0000", 2024-09-13T06:42:30.543 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.8876999999999998e-05 2024-09-13T06:42:30.543 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:30.543 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:30.543 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:30.543 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.938353+0000", 2024-09-13T06:42:30.543 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.5155999999999996e-05 2024-09-13T06:42:30.543 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:30.544 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:30.544 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:30.544 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:30.544 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:30.544 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:21985 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 12587008~4096 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:42:30.544 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.888858+0000", 2024-09-13T06:42:30.544 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 157.63924897699999, 2024-09-13T06:42:30.544 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049674347000000001, 2024-09-13T06:42:30.544 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:30.544 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:30.544 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:30.544 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:30.544 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:30.545 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 21985 2024-09-13T06:42:30.545 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:30.545 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:30.545 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:30.545 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:30.545 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888858+0000", 2024-09-13T06:42:30.545 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:30.545 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:30.545 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:30.545 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:30.545 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888858+0000", 2024-09-13T06:42:30.546 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:30.546 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:30.546 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:30.546 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:30.546 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888857+0000", 2024-09-13T06:42:30.546 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:30.546 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:30.546 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:30.546 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:30.546 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888860+0000", 2024-09-13T06:42:30.546 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4739999999999999e-06 2024-09-13T06:42:30.547 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:30.547 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:30.547 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:30.547 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888867+0000", 2024-09-13T06:42:30.547 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.7170000000000002e-06 2024-09-13T06:42:30.547 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:30.547 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:30.547 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:30.547 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888871+0000", 2024-09-13T06:42:30.547 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5120000000000002e-06 2024-09-13T06:42:30.547 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:30.548 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:30.548 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:30.548 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.938389+0000", 2024-09-13T06:42:30.548 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049517717000000003 2024-09-13T06:42:30.548 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:30.548 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:30.548 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:30.548 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.938449+0000", 2024-09-13T06:42:30.548 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0513999999999997e-05 2024-09-13T06:42:30.548 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:30.549 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:30.549 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:30.549 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.938532+0000", 2024-09-13T06:42:30.549 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.2936999999999996e-05 2024-09-13T06:42:30.549 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:30.549 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:30.549 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:30.549 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:30.549 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:30.549 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:21986 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 12615680~4096 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:42:30.549 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.888875+0000", 2024-09-13T06:42:30.549 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 157.63923146400001, 2024-09-13T06:42:30.550 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049881781, 2024-09-13T06:42:30.550 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:30.550 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:30.550 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:30.550 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:30.550 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:30.550 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 21986 2024-09-13T06:42:30.550 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:30.550 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:30.550 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:30.550 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:30.551 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888875+0000", 2024-09-13T06:42:30.551 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:30.551 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:30.551 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:30.551 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:30.551 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888875+0000", 2024-09-13T06:42:30.551 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:30.551 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:30.551 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:30.551 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:30.552 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888875+0000", 2024-09-13T06:42:30.552 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:30.552 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:30.552 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:30.552 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:30.552 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888880+0000", 2024-09-13T06:42:30.552 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7600000000000002e-06 2024-09-13T06:42:30.552 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:30.552 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:30.552 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:30.553 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888887+0000", 2024-09-13T06:42:30.553 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3950000000000003e-06 2024-09-13T06:42:30.553 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:30.553 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:30.553 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:30.553 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888892+0000", 2024-09-13T06:42:30.553 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0409999999999997e-06 2024-09-13T06:42:30.553 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:30.553 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:30.553 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:30.553 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.938568+0000", 2024-09-13T06:42:30.554 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049675267000000002 2024-09-13T06:42:30.554 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:30.554 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:30.554 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:30.554 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.938653+0000", 2024-09-13T06:42:30.554 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.5792999999999997e-05 2024-09-13T06:42:30.554 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:30.554 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:30.554 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:30.554 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.938757+0000", 2024-09-13T06:42:30.554 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00010387699999999999 2024-09-13T06:42:30.555 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:30.555 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:30.555 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:30.555 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:30.555 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:30.555 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:21987 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 12644352~4096 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:42:30.555 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.888899+0000", 2024-09-13T06:42:30.555 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 157.639208118, 2024-09-13T06:42:30.555 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.050094056999999997, 2024-09-13T06:42:30.555 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:30.555 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:30.556 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:30.556 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:30.556 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:30.556 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 21987 2024-09-13T06:42:30.556 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:30.556 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:30.556 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:30.556 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:30.556 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888899+0000", 2024-09-13T06:42:30.556 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:30.556 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:30.557 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:30.557 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:30.557 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888899+0000", 2024-09-13T06:42:30.557 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:30.557 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:30.557 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:30.557 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:30.557 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888899+0000", 2024-09-13T06:42:30.557 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:30.557 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:30.557 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:30.558 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:30.558 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888901+0000", 2024-09-13T06:42:30.558 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2539999999999999e-06 2024-09-13T06:42:30.558 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:30.558 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:30.558 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:30.558 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888907+0000", 2024-09-13T06:42:30.558 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9009999999999999e-06 2024-09-13T06:42:30.558 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:30.558 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:30.558 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:30.558 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888912+0000", 2024-09-13T06:42:30.559 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9840000000000001e-06 2024-09-13T06:42:30.559 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:30.559 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:30.559 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:30.559 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.938810+0000", 2024-09-13T06:42:30.559 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049898835000000002 2024-09-13T06:42:30.559 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:30.559 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:30.559 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:30.559 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.938890+0000", 2024-09-13T06:42:30.559 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.9215000000000006e-05 2024-09-13T06:42:30.559 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:30.560 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:30.560 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:30.560 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.938993+0000", 2024-09-13T06:42:30.560 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000103194 2024-09-13T06:42:30.560 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:30.560 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:30.560 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:30.560 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:30.560 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:30.560 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:21988 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 12673024~4096 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:42:30.560 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.888916+0000", 2024-09-13T06:42:30.560 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 157.63919110200001, 2024-09-13T06:42:30.560 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.050203036999999999, 2024-09-13T06:42:30.561 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:30.561 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:30.561 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:30.561 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:30.561 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:30.561 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 21988 2024-09-13T06:42:30.561 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:30.561 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:30.561 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:30.561 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:30.561 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888916+0000", 2024-09-13T06:42:30.561 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:30.562 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:30.562 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:30.562 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:30.562 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888916+0000", 2024-09-13T06:42:30.562 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:30.562 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:30.562 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:30.562 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:30.562 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888915+0000", 2024-09-13T06:42:30.562 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:30.562 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:30.562 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:30.563 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:30.563 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888918+0000", 2024-09-13T06:42:30.563 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1500000000000002e-06 2024-09-13T06:42:30.563 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:30.563 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:30.563 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:30.563 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888925+0000", 2024-09-13T06:42:30.563 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.9380000000000003e-06 2024-09-13T06:42:30.563 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:30.563 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:30.563 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:30.564 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888933+0000", 2024-09-13T06:42:30.564 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.0560000000000005e-06 2024-09-13T06:42:30.564 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:30.564 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:30.564 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:30.564 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.939026+0000", 2024-09-13T06:42:30.564 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.050093499999999999 2024-09-13T06:42:30.564 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:30.564 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:30.564 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:30.564 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.939068+0000", 2024-09-13T06:42:30.565 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.1705999999999997e-05 2024-09-13T06:42:30.565 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:30.565 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:30.565 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:30.565 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.939119+0000", 2024-09-13T06:42:30.565 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.1048999999999999e-05 2024-09-13T06:42:30.565 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:30.565 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:30.565 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:30.565 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:30.565 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:30.566 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:21989 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 12701696~4096 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:42:30.566 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.888938+0000", 2024-09-13T06:42:30.566 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 157.639168775, 2024-09-13T06:42:30.566 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.050294393999999999, 2024-09-13T06:42:30.566 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:30.566 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:30.566 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:30.566 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:30.566 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:30.566 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 21989 2024-09-13T06:42:30.566 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:30.567 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:30.567 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:30.567 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:30.567 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888938+0000", 2024-09-13T06:42:30.567 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:30.567 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:30.567 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:30.567 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:30.567 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888938+0000", 2024-09-13T06:42:30.567 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:30.567 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:30.568 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:30.568 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:30.568 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888938+0000", 2024-09-13T06:42:30.568 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:30.568 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:30.568 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:30.568 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:30.568 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888940+0000", 2024-09-13T06:42:30.568 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5330000000000001e-06 2024-09-13T06:42:30.568 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:30.568 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:30.569 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:30.569 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888947+0000", 2024-09-13T06:42:30.569 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.2389999999999999e-06 2024-09-13T06:42:30.569 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:30.569 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:30.569 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:30.569 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888952+0000", 2024-09-13T06:42:30.569 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.5720000000000002e-06 2024-09-13T06:42:30.569 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:30.569 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:30.569 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:30.569 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.939141+0000", 2024-09-13T06:42:30.570 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.050188903999999999 2024-09-13T06:42:30.570 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:30.570 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:30.570 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:30.570 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.939182+0000", 2024-09-13T06:42:30.570 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.0926000000000001e-05 2024-09-13T06:42:30.570 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:30.570 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:30.570 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:30.570 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.939233+0000", 2024-09-13T06:42:30.570 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0532999999999999e-05 2024-09-13T06:42:30.571 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:30.571 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:30.571 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:30.571 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:30.571 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:30.571 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:22007 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 13217792~4096 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:42:30.571 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.892771+0000", 2024-09-13T06:42:30.571 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 157.635335669, 2024-09-13T06:42:30.571 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049090024000000003, 2024-09-13T06:42:30.571 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:30.571 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:30.572 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:30.572 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:30.572 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:30.572 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 22007 2024-09-13T06:42:30.572 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:30.572 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:30.572 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:30.572 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:30.572 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892771+0000", 2024-09-13T06:42:30.572 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:30.572 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:30.573 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:30.573 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:30.573 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892771+0000", 2024-09-13T06:42:30.573 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:30.573 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:30.573 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:30.573 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:30.573 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892771+0000", 2024-09-13T06:42:30.573 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:42:30.573 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:30.573 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:30.574 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:30.574 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892772+0000", 2024-09-13T06:42:30.574 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.184e-06 2024-09-13T06:42:30.574 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:30.574 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:30.574 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:30.574 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892775+0000", 2024-09-13T06:42:30.574 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9179999999999998e-06 2024-09-13T06:42:30.574 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:30.574 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:30.575 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:30.575 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892778+0000", 2024-09-13T06:42:30.575 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4990000000000001e-06 2024-09-13T06:42:30.575 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:30.575 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:30.575 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:30.575 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.941760+0000", 2024-09-13T06:42:30.575 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.048982070000000003 2024-09-13T06:42:30.575 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:30.575 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:30.575 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:30.575 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.941808+0000", 2024-09-13T06:42:30.576 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.8278000000000001e-05 2024-09-13T06:42:30.576 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:30.576 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:30.576 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:30.576 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.941861+0000", 2024-09-13T06:42:30.576 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3284e-05 2024-09-13T06:42:30.576 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:30.576 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:30.576 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:30.576 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:30.576 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:30.576 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:22008 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 13246464~4096 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:42:30.577 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.892780+0000", 2024-09-13T06:42:30.577 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 157.635327012, 2024-09-13T06:42:30.577 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049200477999999999, 2024-09-13T06:42:30.577 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:30.577 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:30.577 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:30.577 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:30.577 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:30.577 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 22008 2024-09-13T06:42:30.577 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:30.577 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:30.577 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:30.577 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:30.578 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892780+0000", 2024-09-13T06:42:30.578 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:30.578 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:30.578 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:30.578 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:30.578 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892780+0000", 2024-09-13T06:42:30.578 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:30.578 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:30.578 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:30.578 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:30.578 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892780+0000", 2024-09-13T06:42:30.578 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:42:30.579 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:30.579 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:30.579 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:30.579 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892781+0000", 2024-09-13T06:42:30.579 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.083e-06 2024-09-13T06:42:30.579 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:30.579 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:30.579 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:30.579 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892784+0000", 2024-09-13T06:42:30.579 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.926e-06 2024-09-13T06:42:30.579 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:30.579 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:30.579 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:30.580 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892786+0000", 2024-09-13T06:42:30.580 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4490000000000002e-06 2024-09-13T06:42:30.580 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:30.580 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:30.580 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:30.580 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.941888+0000", 2024-09-13T06:42:30.580 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049102290999999999 2024-09-13T06:42:30.580 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:30.580 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:30.580 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:30.580 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.941929+0000", 2024-09-13T06:42:30.580 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.0541999999999999e-05 2024-09-13T06:42:30.580 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:30.581 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:30.581 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:30.581 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.941980+0000", 2024-09-13T06:42:30.581 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.1391999999999999e-05 2024-09-13T06:42:30.581 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:30.581 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:30.581 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:30.581 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:30.581 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:30.581 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:22009 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 13275136~4096 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:42:30.581 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.892788+0000", 2024-09-13T06:42:30.582 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 157.635318528, 2024-09-13T06:42:30.582 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049311926999999998, 2024-09-13T06:42:30.582 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:30.582 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:30.582 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:30.582 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:30.582 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:30.582 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 22009 2024-09-13T06:42:30.582 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:30.582 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:30.582 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:30.582 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:30.583 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892788+0000", 2024-09-13T06:42:30.583 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:30.583 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:30.583 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:30.583 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:30.583 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892788+0000", 2024-09-13T06:42:30.583 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:30.583 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:30.583 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:30.583 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:30.583 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892788+0000", 2024-09-13T06:42:30.583 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:42:30.583 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:30.584 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:30.584 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:30.584 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892789+0000", 2024-09-13T06:42:30.584 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1850000000000001e-06 2024-09-13T06:42:30.584 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:30.584 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:30.584 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:30.584 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892793+0000", 2024-09-13T06:42:30.584 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.9099999999999998e-06 2024-09-13T06:42:30.584 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:30.584 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:30.584 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:30.584 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892798+0000", 2024-09-13T06:42:30.585 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5070000000000002e-06 2024-09-13T06:42:30.585 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:30.585 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:30.585 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:30.585 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.942007+0000", 2024-09-13T06:42:30.585 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049208904999999997 2024-09-13T06:42:30.585 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:30.585 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:30.585 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:30.585 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.942049+0000", 2024-09-13T06:42:30.585 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.1922000000000003e-05 2024-09-13T06:42:30.585 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:30.586 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:30.586 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:30.586 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.942100+0000", 2024-09-13T06:42:30.586 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.1736000000000001e-05 2024-09-13T06:42:30.586 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:30.586 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:30.586 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:30.586 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:30.586 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:30.586 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:22010 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 13303808~4096 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:42:30.586 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.892817+0000", 2024-09-13T06:42:30.586 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 157.63529033200001, 2024-09-13T06:42:30.586 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049466149000000001, 2024-09-13T06:42:30.587 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:30.587 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:30.587 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:30.587 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:30.587 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:30.587 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 22010 2024-09-13T06:42:30.587 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:30.587 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:30.587 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:30.587 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:30.587 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892817+0000", 2024-09-13T06:42:30.587 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:30.588 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:30.588 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:30.588 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:30.588 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892817+0000", 2024-09-13T06:42:30.588 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:30.588 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:30.588 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:30.588 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:30.588 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892816+0000", 2024-09-13T06:42:30.588 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:30.588 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:30.588 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:30.589 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:30.589 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892821+0000", 2024-09-13T06:42:30.589 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9459999999999997e-06 2024-09-13T06:42:30.589 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:30.589 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:30.589 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:30.589 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892828+0000", 2024-09-13T06:42:30.589 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.6780000000000003e-06 2024-09-13T06:42:30.589 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:30.589 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:30.589 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:30.589 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892833+0000", 2024-09-13T06:42:30.589 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.8389999999999997e-06 2024-09-13T06:42:30.590 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:30.590 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:30.590 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:30.590 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.942127+0000", 2024-09-13T06:42:30.590 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049294163000000002 2024-09-13T06:42:30.590 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:30.590 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:30.590 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:30.590 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.942186+0000", 2024-09-13T06:42:30.590 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9335e-05 2024-09-13T06:42:30.590 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:30.590 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:30.591 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:30.591 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.942283+0000", 2024-09-13T06:42:30.591 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.6699000000000004e-05 2024-09-13T06:42:30.591 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:30.591 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:30.591 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:30.591 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:30.591 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:30.591 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:22011 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 13332480~4096 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:42:30.591 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.892838+0000", 2024-09-13T06:42:30.591 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 157.635268645, 2024-09-13T06:42:30.592 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049589214, 2024-09-13T06:42:30.592 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:30.592 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:30.592 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:30.592 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:30.592 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:30.592 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 22011 2024-09-13T06:42:30.592 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:30.592 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:30.592 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:30.593 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:30.593 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892838+0000", 2024-09-13T06:42:30.593 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:30.593 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:30.593 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:30.593 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:30.593 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892838+0000", 2024-09-13T06:42:30.593 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:30.593 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:30.593 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:30.593 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:30.594 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892838+0000", 2024-09-13T06:42:30.594 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:30.594 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:30.594 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:30.594 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:30.594 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892840+0000", 2024-09-13T06:42:30.594 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.136e-06 2024-09-13T06:42:30.594 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:30.594 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:30.594 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:30.594 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892852+0000", 2024-09-13T06:42:30.594 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2122e-05 2024-09-13T06:42:30.595 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:30.595 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:30.595 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:30.595 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892862+0000", 2024-09-13T06:42:30.595 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.7049999999999994e-06 2024-09-13T06:42:30.595 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:30.595 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:30.595 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:30.595 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.942319+0000", 2024-09-13T06:42:30.595 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049456623999999998 2024-09-13T06:42:30.595 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:30.595 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:30.595 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:30.596 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.942363+0000", 2024-09-13T06:42:30.596 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4759000000000003e-05 2024-09-13T06:42:30.596 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:30.596 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:30.596 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:30.596 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.942428+0000", 2024-09-13T06:42:30.596 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.4221999999999996e-05 2024-09-13T06:42:30.596 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:30.596 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:30.596 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:30.596 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:30.597 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:30.597 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:22338 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 13611008~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:42:30.597 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.951070+0000", 2024-09-13T06:42:30.597 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 157.57703712399999, 2024-09-13T06:42:30.597 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049135817999999998, 2024-09-13T06:42:30.597 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:30.597 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:30.597 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:30.597 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:30.597 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:30.597 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 22338 2024-09-13T06:42:30.597 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:30.598 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:30.598 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:30.598 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:30.598 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951070+0000", 2024-09-13T06:42:30.598 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:30.598 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:30.598 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:30.598 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:30.598 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951070+0000", 2024-09-13T06:42:30.598 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:30.598 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:30.598 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:30.599 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:30.599 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951069+0000", 2024-09-13T06:42:30.599 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:30.599 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:30.599 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:30.599 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:30.599 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951072+0000", 2024-09-13T06:42:30.599 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5909999999999998e-06 2024-09-13T06:42:30.599 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:30.599 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:30.599 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:30.600 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951078+0000", 2024-09-13T06:42:30.600 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.4450000000000001e-06 2024-09-13T06:42:30.600 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:30.600 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:30.600 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:30.600 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951083+0000", 2024-09-13T06:42:30.600 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7790000000000003e-06 2024-09-13T06:42:30.600 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:30.600 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:30.600 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:30.600 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:53.000020+0000", 2024-09-13T06:42:30.600 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.048936999000000002 2024-09-13T06:42:30.601 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:30.601 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:30.601 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:30.601 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:53.000106+0000", 2024-09-13T06:42:30.601 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.5532999999999996e-05 2024-09-13T06:42:30.601 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:30.601 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:30.601 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:30.601 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:53.000206+0000", 2024-09-13T06:42:30.601 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.9852999999999994e-05 2024-09-13T06:42:30.601 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:30.602 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:30.602 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:30.602 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:30.602 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:30.602 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:22339 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 13639680~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:42:30.602 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.951088+0000", 2024-09-13T06:42:30.602 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 157.57701942599999, 2024-09-13T06:42:30.602 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049238202000000002, 2024-09-13T06:42:30.602 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:30.602 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:30.602 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:30.603 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:30.603 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:30.603 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 22339 2024-09-13T06:42:30.603 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:30.603 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:30.603 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:30.603 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:30.603 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951088+0000", 2024-09-13T06:42:30.603 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:30.603 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:30.603 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:30.604 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:30.604 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951088+0000", 2024-09-13T06:42:30.604 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:30.604 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:30.604 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:30.604 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:30.604 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951087+0000", 2024-09-13T06:42:30.604 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:30.604 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:30.604 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:30.604 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:30.605 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951089+0000", 2024-09-13T06:42:30.605 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.153e-06 2024-09-13T06:42:30.605 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:30.605 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:30.605 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:30.605 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951093+0000", 2024-09-13T06:42:30.605 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.7120000000000002e-06 2024-09-13T06:42:30.605 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:30.605 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:30.605 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:30.605 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951096+0000", 2024-09-13T06:42:30.605 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.0570000000000001e-06 2024-09-13T06:42:30.605 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:30.606 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:30.606 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:30.606 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:53.000220+0000", 2024-09-13T06:42:30.606 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049123989 2024-09-13T06:42:30.606 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:30.606 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:30.606 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:30.606 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:53.000271+0000", 2024-09-13T06:42:30.606 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.062e-05 2024-09-13T06:42:30.606 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:30.606 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:30.606 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:30.607 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:53.000326+0000", 2024-09-13T06:42:30.607 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.5121000000000003e-05 2024-09-13T06:42:30.607 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:30.607 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:30.607 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:30.607 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:30.607 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:30.607 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:22340 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 13668352~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:42:30.607 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.951200+0000", 2024-09-13T06:42:30.607 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 157.57690653700001, 2024-09-13T06:42:30.607 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049352350000000003, 2024-09-13T06:42:30.608 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:30.608 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:30.608 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:30.608 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:30.608 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:30.608 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 22340 2024-09-13T06:42:30.608 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:30.608 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:30.608 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:30.608 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:30.608 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951200+0000", 2024-09-13T06:42:30.609 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:30.609 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:30.609 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:30.609 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:30.609 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951200+0000", 2024-09-13T06:42:30.609 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:30.609 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:30.609 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:30.609 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:30.609 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951098+0000", 2024-09-13T06:42:30.609 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.999898 2024-09-13T06:42:30.610 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:30.610 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:30.610 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:30.610 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951204+0000", 2024-09-13T06:42:30.610 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000105398 2024-09-13T06:42:30.610 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:30.610 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:30.610 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:30.610 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951211+0000", 2024-09-13T06:42:30.610 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.43e-06 2024-09-13T06:42:30.610 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:30.610 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:30.611 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:30.611 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951216+0000", 2024-09-13T06:42:30.611 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2800000000000003e-06 2024-09-13T06:42:30.611 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:30.611 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:30.611 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:30.611 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:53.000358+0000", 2024-09-13T06:42:30.611 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049142036 2024-09-13T06:42:30.611 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:30.611 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:30.612 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:30.612 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:53.000443+0000", 2024-09-13T06:42:30.612 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.4710999999999996e-05 2024-09-13T06:42:30.612 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:30.612 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:30.612 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:30.612 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:53.000553+0000", 2024-09-13T06:42:30.612 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000109622 2024-09-13T06:42:30.612 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:30.612 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:30.612 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:30.613 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:30.613 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:30.613 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:22348 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 13897728~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:42:30.613 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.952783+0000", 2024-09-13T06:42:30.613 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 157.57532374900001, 2024-09-13T06:42:30.613 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049120832000000003, 2024-09-13T06:42:30.613 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:30.613 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:30.613 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:30.613 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:30.613 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:30.614 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 22348 2024-09-13T06:42:30.614 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:30.614 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:30.614 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:30.614 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:30.614 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.952783+0000", 2024-09-13T06:42:30.614 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:30.614 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:30.614 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:30.614 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:30.614 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.952783+0000", 2024-09-13T06:42:30.615 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:30.615 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:30.615 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:30.615 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:30.615 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.952783+0000", 2024-09-13T06:42:30.615 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:30.615 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:30.615 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:30.615 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:30.615 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.952785+0000", 2024-09-13T06:42:30.615 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4980000000000001e-06 2024-09-13T06:42:30.615 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:30.616 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:30.616 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:30.616 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.952799+0000", 2024-09-13T06:42:30.616 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3825000000000001e-05 2024-09-13T06:42:30.616 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:30.616 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:30.616 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:30.616 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.952809+0000", 2024-09-13T06:42:30.616 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0043e-05 2024-09-13T06:42:30.616 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:30.616 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:30.617 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:30.617 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:53.001723+0000", 2024-09-13T06:42:30.617 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.048914065 2024-09-13T06:42:30.617 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:30.617 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:30.617 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:30.617 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:53.001807+0000", 2024-09-13T06:42:30.617 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.3776000000000006e-05 2024-09-13T06:42:30.617 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:30.617 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:30.617 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:30.618 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:53.001904+0000", 2024-09-13T06:42:30.618 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.7004999999999997e-05 2024-09-13T06:42:30.618 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:30.618 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:30.618 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:30.618 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:30.618 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:30.618 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:69045 3.0 3:05ea3821:::rbd_data.1121867cc19b.0000000000000000:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109)", 2024-09-13T06:42:30.618 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:41:03.637760+0000", 2024-09-13T06:42:30.618 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 86.890346991000001, 2024-09-13T06:42:30.618 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.052276712000000003, 2024-09-13T06:42:30.618 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:30.619 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:42:30.619 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:30.619 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:30.619 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:30.619 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 69045 2024-09-13T06:42:30.619 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:30.619 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:30.619 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:30.619 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:30.619 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:03.637760+0000", 2024-09-13T06:42:30.619 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:30.620 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:30.620 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:30.620 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:30.620 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:03.637760+0000", 2024-09-13T06:42:30.620 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:30.620 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:30.620 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:30.620 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:30.620 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:03.637758+0000", 2024-09-13T06:42:30.620 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999981 2024-09-13T06:42:30.620 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:30.621 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:30.621 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:30.621 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:03.637770+0000", 2024-09-13T06:42:30.621 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1533e-05 2024-09-13T06:42:30.621 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:30.621 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:30.621 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:30.621 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:03.637794+0000", 2024-09-13T06:42:30.621 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4243000000000002e-05 2024-09-13T06:42:30.621 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:30.622 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:30.622 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:30.622 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:03.637806+0000", 2024-09-13T06:42:30.622 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2033e-05 2024-09-13T06:42:30.622 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:30.622 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:30.622 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:30.622 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:03.637891+0000", 2024-09-13T06:42:30.622 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.5358000000000005e-05 2024-09-13T06:42:30.622 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:30.622 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:30.622 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:30.622 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:03.638042+0000", 2024-09-13T06:42:30.623 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000151073 2024-09-13T06:42:30.623 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:30.623 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:30.623 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 2", 2024-09-13T06:42:30.623 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:03.647124+0000", 2024-09-13T06:42:30.623 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0090821670000000004 2024-09-13T06:42:30.623 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:30.623 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:30.623 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:42:30.623 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:03.689849+0000", 2024-09-13T06:42:30.623 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.042724445999999999 2024-09-13T06:42:30.624 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:30.624 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:30.624 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-09-13T06:42:30.624 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:03.689871+0000", 2024-09-13T06:42:30.624 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1778999999999999e-05 2024-09-13T06:42:30.624 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:30.624 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:30.624 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:42:30.624 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:03.689965+0000", 2024-09-13T06:42:30.624 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.4312000000000001e-05 2024-09-13T06:42:30.624 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:30.624 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:30.625 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:30.625 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:03.690037+0000", 2024-09-13T06:42:30.625 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.1687999999999995e-05 2024-09-13T06:42:30.625 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:30.625 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:30.625 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:30.625 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:30.625 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:30.625 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:90987 3.6 3:6263dd97:::rbd_object_map.11212443ae03.0000000000000049:head [call] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-13T06:42:30.625 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:41:35.460333+0000", 2024-09-13T06:42:30.625 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 55.067773604000003, 2024-09-13T06:42:30.625 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0001633640000001, 2024-09-13T06:42:30.626 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:30.626 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:30.626 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:30.626 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:30.628 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:30.628 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 90987 2024-09-13T06:42:30.628 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:30.628 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:30.628 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:30.628 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:30.628 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:35.460333+0000", 2024-09-13T06:42:30.628 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:30.628 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:30.628 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:30.628 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:30.628 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:35.460333+0000", 2024-09-13T06:42:30.629 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:30.629 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:30.629 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:30.629 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:30.629 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:35.460330+0000", 2024-09-13T06:42:30.629 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999971 2024-09-13T06:42:30.629 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:30.629 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:30.629 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:30.629 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:35.460343+0000", 2024-09-13T06:42:30.629 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2695e-05 2024-09-13T06:42:30.629 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:30.630 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:30.630 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:30.630 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:35.460365+0000", 2024-09-13T06:42:30.630 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2473999999999999e-05 2024-09-13T06:42:30.630 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:30.630 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:30.630 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:30.630 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:35.460376+0000", 2024-09-13T06:42:30.630 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0383999999999999e-05 2024-09-13T06:42:30.630 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:30.630 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:30.630 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:30.630 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:35.460435+0000", 2024-09-13T06:42:30.631 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8650000000000003e-05 2024-09-13T06:42:30.631 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:30.631 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:30.631 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:42:30.631 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:35.460444+0000", 2024-09-13T06:42:30.631 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.0380000000000005e-06 2024-09-13T06:42:30.631 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:30.631 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:30.631 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:30.631 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:36.459433+0000", 2024-09-13T06:42:30.631 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.99898895799999998 2024-09-13T06:42:30.631 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:30.631 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:30.632 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:30.632 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:36.459622+0000", 2024-09-13T06:42:30.632 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00018940299999999999 2024-09-13T06:42:30.632 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:30.632 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:30.632 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:30.632 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:36.460497+0000", 2024-09-13T06:42:30.632 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00087481199999999999 2024-09-13T06:42:30.632 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:30.632 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:30.633 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:30.633 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:30.633 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:30.633 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:159632 3.a 3:57f62123:::rbd_header.112138ed422:head [create,call rbd.create in=9b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e167)", 2024-09-13T06:42:30.633 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:42:07.853351+0000", 2024-09-13T06:42:30.633 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 22.674755802, 2024-09-13T06:42:30.633 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.95572760999999995, 2024-09-13T06:42:30.633 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:30.633 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:42:30.633 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:30.633 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:30.634 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:30.634 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 159632 2024-09-13T06:42:30.634 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:30.634 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:30.634 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:30.634 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:30.634 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:07.853351+0000", 2024-09-13T06:42:30.634 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:30.634 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:30.634 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:30.634 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:30.634 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:07.853351+0000", 2024-09-13T06:42:30.634 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:30.635 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:30.635 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:30.635 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:30.635 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:07.853350+0000", 2024-09-13T06:42:30.635 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.999999 2024-09-13T06:42:30.635 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:30.635 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:30.635 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:30.635 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:07.853356+0000", 2024-09-13T06:42:30.635 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.1560000000000003e-06 2024-09-13T06:42:30.635 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:30.635 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:30.635 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:30.636 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:07.853365+0000", 2024-09-13T06:42:30.636 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.8079999999999999e-06 2024-09-13T06:42:30.636 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:30.636 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:30.636 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:30.636 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:07.853372+0000", 2024-09-13T06:42:30.636 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.5540000000000003e-06 2024-09-13T06:42:30.636 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:30.636 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:30.636 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:30.636 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:07.853430+0000", 2024-09-13T06:42:30.637 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8038000000000002e-05 2024-09-13T06:42:30.637 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:30.637 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:30.637 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:42:30.637 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:07.853444+0000", 2024-09-13T06:42:30.637 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3719e-05 2024-09-13T06:42:30.637 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:30.637 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:30.637 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:30.637 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:08.804052+0000", 2024-09-13T06:42:30.637 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.95060817799999997 2024-09-13T06:42:30.637 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:30.638 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:30.638 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:30.638 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:08.804234+0000", 2024-09-13T06:42:30.638 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00018192999999999999 2024-09-13T06:42:30.638 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:30.638 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:30.638 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 6", 2024-09-13T06:42:30.638 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:08.804797+0000", 2024-09-13T06:42:30.638 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00056282399999999996 2024-09-13T06:42:30.638 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:30.638 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:30.638 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-09-13T06:42:30.638 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:08.805704+0000", 2024-09-13T06:42:30.638 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00090781 2024-09-13T06:42:30.639 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:30.639 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:30.639 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:42:30.639 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:08.808907+0000", 2024-09-13T06:42:30.639 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0032031239999999999 2024-09-13T06:42:30.639 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:30.639 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:30.639 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:42:30.639 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:08.808998+0000", 2024-09-13T06:42:30.639 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.0191000000000004e-05 2024-09-13T06:42:30.639 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:30.639 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:30.640 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:30.640 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:08.809079+0000", 2024-09-13T06:42:30.640 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.1076999999999996e-05 2024-09-13T06:42:30.640 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:30.640 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:30.640 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:30.640 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:30.640 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:30.640 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:42:30.642 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-13T06:42:30.642 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:42:30.637+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:42:30.742 INFO:tasks.ceph.osd.6.smithi139.stderr:2024-09-13T06:42:30.737+0000 7fcd02c5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26385) UID: 0 2024-09-13T06:42:30.769 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:42:30.769 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [ 2024-09-13T06:42:30.769 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:30.769 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:170125 3.9 3.b1fd2729 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e190)", 2024-09-13T06:42:30.770 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:42:30.601501+0000", 2024-09-13T06:42:30.770 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.169440172, 2024-09-13T06:42:30.770 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.16950099399999999, 2024-09-13T06:42:30.770 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:30.770 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "waiting for peered", 2024-09-13T06:42:30.770 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:30.770 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:30.770 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:30.770 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 170125 2024-09-13T06:42:30.770 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:30.770 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:30.771 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:30.771 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:30.771 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:30.601501+0000", 2024-09-13T06:42:30.771 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:30.771 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:30.771 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:30.771 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:30.771 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:30.601501+0000", 2024-09-13T06:42:30.771 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:30.771 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:30.771 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:30.772 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:30.772 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:30.601499+0000", 2024-09-13T06:42:30.772 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999986 2024-09-13T06:42:30.772 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:30.772 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:30.772 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:30.772 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:30.601506+0000", 2024-09-13T06:42:30.772 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.9940000000000003e-06 2024-09-13T06:42:30.772 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:30.772 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:30.772 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:30.773 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:30.601519+0000", 2024-09-13T06:42:30.773 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2875e-05 2024-09-13T06:42:30.773 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:30.773 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:30.773 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:30.773 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:30.601525+0000", 2024-09-13T06:42:30.773 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8549999999999998e-06 2024-09-13T06:42:30.773 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:30.773 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:30.773 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:30.773 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:30.601560+0000", 2024-09-13T06:42:30.774 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.5271000000000002e-05 2024-09-13T06:42:30.774 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:30.774 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:30.774 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:42:30.774 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:30.601566+0000", 2024-09-13T06:42:30.774 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3090000000000001e-06 2024-09-13T06:42:30.774 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:30.774 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:30.774 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:30.774 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:30.774 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-13T06:42:30.774 INFO:teuthology.orchestra.run.smithi081.stdout: "num_ops": 1 2024-09-13T06:42:30.775 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:42:30.784 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-13T06:42:30.843 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:42:30.837+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:42:30.900 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:42:30.901 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-13T06:42:30.901 INFO:teuthology.orchestra.run.smithi081.stdout: "complaint_time": 30, 2024-09-13T06:42:30.901 INFO:teuthology.orchestra.run.smithi081.stdout: "num_blocked_ops": 0 2024-09-13T06:42:30.901 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:42:30.915 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-13T06:42:30.944 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:42:30.937+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:42:31.041 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:42:31.041 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 20, 2024-09-13T06:42:31.041 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 600, 2024-09-13T06:42:31.041 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [ 2024-09-13T06:42:31.041 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.041 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:36160 3.f 3:f62782c2:::rbd_object_map.11219660270d.0000000000000016:head [call] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-13T06:42:31.041 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:01.607291+0000", 2024-09-13T06:42:31.041 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 149.43091395900001, 2024-09-13T06:42:31.041 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.99619456699999998, 2024-09-13T06:42:31.041 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:31.041 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:31.041 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:31.041 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:31.042 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:31.042 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 36160 2024-09-13T06:42:31.042 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.042 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:31.042 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.042 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:31.042 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:01.607291+0000", 2024-09-13T06:42:31.042 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:31.042 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.042 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.042 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:31.042 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:01.607291+0000", 2024-09-13T06:42:31.043 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:31.043 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.043 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.043 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:31.043 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:01.607289+0000", 2024-09-13T06:42:31.043 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999976 2024-09-13T06:42:31.043 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.043 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.043 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:31.043 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:01.607302+0000", 2024-09-13T06:42:31.043 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3018e-05 2024-09-13T06:42:31.043 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.043 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.044 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:31.044 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:01.607323+0000", 2024-09-13T06:42:31.044 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1030999999999999e-05 2024-09-13T06:42:31.044 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.044 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.044 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:31.044 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:01.607342+0000", 2024-09-13T06:42:31.044 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8961e-05 2024-09-13T06:42:31.044 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.044 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.044 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:31.044 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:01.607425+0000", 2024-09-13T06:42:31.044 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.3171999999999996e-05 2024-09-13T06:42:31.044 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.045 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.045 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:42:31.045 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:01.607441+0000", 2024-09-13T06:42:31.045 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5996999999999999e-05 2024-09-13T06:42:31.045 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.045 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.045 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:31.045 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:02.596186+0000", 2024-09-13T06:42:31.045 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.98874432000000001 2024-09-13T06:42:31.045 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.045 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.045 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for missing object", 2024-09-13T06:42:31.045 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:02.596618+0000", 2024-09-13T06:42:31.046 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000432032 2024-09-13T06:42:31.046 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.046 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.046 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:31.046 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:02.600845+0000", 2024-09-13T06:42:31.046 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0042277410000000001 2024-09-13T06:42:31.046 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.046 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.046 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:31.046 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:02.601003+0000", 2024-09-13T06:42:31.046 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00015731999999999999 2024-09-13T06:42:31.046 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.046 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.046 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:31.047 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:02.603486+0000", 2024-09-13T06:42:31.047 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0024832510000000001 2024-09-13T06:42:31.047 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:31.047 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:31.047 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:31.047 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.047 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.047 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:37806 3.9 3:951cb95b:::rbd_data.1121d8143c6e.0000000000000002:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e56)", 2024-09-13T06:42:31.047 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:06.373482+0000", 2024-09-13T06:42:31.047 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 144.664722923, 2024-09-13T06:42:31.047 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.002476213, 2024-09-13T06:42:31.047 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:31.047 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:31.047 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:31.048 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:31.048 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:31.048 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 37806 2024-09-13T06:42:31.048 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.048 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:31.048 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.048 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:31.048 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.373482+0000", 2024-09-13T06:42:31.048 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:31.048 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.048 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.048 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:31.048 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.373482+0000", 2024-09-13T06:42:31.048 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:31.048 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.049 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.049 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:31.049 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.373479+0000", 2024-09-13T06:42:31.049 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999962 2024-09-13T06:42:31.049 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.049 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.049 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:31.049 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.373495+0000", 2024-09-13T06:42:31.049 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6640999999999999e-05 2024-09-13T06:42:31.049 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.049 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.049 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:31.049 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.373542+0000", 2024-09-13T06:42:31.049 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6229000000000001e-05 2024-09-13T06:42:31.050 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.050 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.050 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:31.050 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.373564+0000", 2024-09-13T06:42:31.050 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2684000000000002e-05 2024-09-13T06:42:31.050 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.050 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.050 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:31.050 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374268+0000", 2024-09-13T06:42:31.050 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00070363700000000001 2024-09-13T06:42:31.050 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.050 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.051 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:42:31.051 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374305+0000", 2024-09-13T06:42:31.051 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.6936e-05 2024-09-13T06:42:31.051 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.051 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.051 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:31.051 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.375175+0000", 2024-09-13T06:42:31.051 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.000870454 2024-09-13T06:42:31.051 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.051 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.051 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:31.051 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.375678+0000", 2024-09-13T06:42:31.051 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00050292499999999999 2024-09-13T06:42:31.052 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.052 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.052 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:31.052 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.375959+0000", 2024-09-13T06:42:31.052 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00028050599999999997 2024-09-13T06:42:31.052 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:31.052 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:31.052 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:31.052 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.052 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.052 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:37821 3.9 3:951cb95b:::rbd_data.1121d8143c6e.0000000000000002:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e56)", 2024-09-13T06:42:31.053 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:06.374454+0000", 2024-09-13T06:42:31.053 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 144.66375180599999, 2024-09-13T06:42:31.053 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.002545072, 2024-09-13T06:42:31.053 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:31.053 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:31.053 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:31.053 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:31.053 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:31.053 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 37821 2024-09-13T06:42:31.053 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.053 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:31.053 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.053 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:31.054 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374454+0000", 2024-09-13T06:42:31.054 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:31.054 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.054 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.054 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:31.054 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374454+0000", 2024-09-13T06:42:31.054 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:31.054 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.054 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.054 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:31.054 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374452+0000", 2024-09-13T06:42:31.054 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999981 2024-09-13T06:42:31.054 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.054 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.055 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:31.055 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374463+0000", 2024-09-13T06:42:31.055 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0756e-05 2024-09-13T06:42:31.055 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.055 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.055 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:31.055 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374487+0000", 2024-09-13T06:42:31.055 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4887000000000001e-05 2024-09-13T06:42:31.055 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.055 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.055 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:31.055 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374504+0000", 2024-09-13T06:42:31.056 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6852000000000001e-05 2024-09-13T06:42:31.056 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.056 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.056 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:31.056 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374829+0000", 2024-09-13T06:42:31.056 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000324684 2024-09-13T06:42:31.056 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.056 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.056 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:42:31.056 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374880+0000", 2024-09-13T06:42:31.056 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.1378000000000002e-05 2024-09-13T06:42:31.056 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.056 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.057 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:31.057 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.376423+0000", 2024-09-13T06:42:31.057 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.001542734 2024-09-13T06:42:31.057 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.057 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.057 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:31.057 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.376607+0000", 2024-09-13T06:42:31.057 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000183656 2024-09-13T06:42:31.057 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.057 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.057 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:31.057 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.376999+0000", 2024-09-13T06:42:31.057 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00039191200000000001 2024-09-13T06:42:31.058 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:31.058 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:31.058 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:31.058 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.058 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.058 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:37836 3.9 3:951cb95b:::rbd_data.1121d8143c6e.0000000000000002:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e56)", 2024-09-13T06:42:31.058 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:06.374929+0000", 2024-09-13T06:42:31.058 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 144.66327615399999, 2024-09-13T06:42:31.058 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.002778825, 2024-09-13T06:42:31.058 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:31.058 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:31.058 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:31.058 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:31.058 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:31.059 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 37836 2024-09-13T06:42:31.059 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.059 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:31.059 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.059 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:31.059 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374929+0000", 2024-09-13T06:42:31.059 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:31.059 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.059 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.059 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:31.059 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374929+0000", 2024-09-13T06:42:31.059 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:31.059 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.060 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.060 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:31.060 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374927+0000", 2024-09-13T06:42:31.060 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999981 2024-09-13T06:42:31.060 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.060 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.060 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:31.060 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374939+0000", 2024-09-13T06:42:31.060 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1846e-05 2024-09-13T06:42:31.060 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.060 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.060 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:31.060 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374962+0000", 2024-09-13T06:42:31.061 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3054e-05 2024-09-13T06:42:31.061 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.061 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.061 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:31.061 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374978+0000", 2024-09-13T06:42:31.061 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5899000000000001e-05 2024-09-13T06:42:31.061 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.061 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.061 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:31.061 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.375106+0000", 2024-09-13T06:42:31.061 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00012789 2024-09-13T06:42:31.061 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.061 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.062 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:42:31.062 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.375134+0000", 2024-09-13T06:42:31.062 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.8254000000000001e-05 2024-09-13T06:42:31.062 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.062 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.062 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:31.062 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.377082+0000", 2024-09-13T06:42:31.062 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0019471520000001 2024-09-13T06:42:31.062 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.062 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.062 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:31.062 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.377330+0000", 2024-09-13T06:42:31.062 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00024834199999999997 2024-09-13T06:42:31.062 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.063 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.063 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:31.063 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.377708+0000", 2024-09-13T06:42:31.063 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00037817100000000001 2024-09-13T06:42:31.063 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:31.063 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:31.063 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:31.063 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.063 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.063 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:37851 3.9 3:951cb95b:::rbd_data.1121d8143c6e.0000000000000002:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e56)", 2024-09-13T06:42:31.063 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:06.382636+0000", 2024-09-13T06:42:31.063 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 144.65556926900001, 2024-09-13T06:42:31.063 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.99582539400000003, 2024-09-13T06:42:31.063 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:31.064 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:31.064 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:31.064 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:31.064 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:31.064 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 37851 2024-09-13T06:42:31.064 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.064 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:31.064 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.064 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:31.064 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.382636+0000", 2024-09-13T06:42:31.064 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:31.064 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.064 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.065 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:31.065 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.382636+0000", 2024-09-13T06:42:31.065 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:31.065 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.065 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.065 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:31.065 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.382633+0000", 2024-09-13T06:42:31.065 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999971 2024-09-13T06:42:31.065 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.065 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.065 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:31.065 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.382652+0000", 2024-09-13T06:42:31.065 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8834999999999998e-05 2024-09-13T06:42:31.065 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.066 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.066 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:31.066 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.382695+0000", 2024-09-13T06:42:31.066 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.3136000000000002e-05 2024-09-13T06:42:31.066 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.066 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.066 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:31.066 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.382716+0000", 2024-09-13T06:42:31.066 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1421e-05 2024-09-13T06:42:31.066 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.066 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.066 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:31.066 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.382860+0000", 2024-09-13T06:42:31.066 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00014389200000000001 2024-09-13T06:42:31.067 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.067 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.067 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:42:31.067 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.382890+0000", 2024-09-13T06:42:31.067 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9827000000000001e-05 2024-09-13T06:42:31.067 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.067 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.067 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:31.067 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.377779+0000", 2024-09-13T06:42:31.067 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.99488842899999996 2024-09-13T06:42:31.067 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.067 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.068 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:31.068 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.378007+0000", 2024-09-13T06:42:31.068 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00022838099999999999 2024-09-13T06:42:31.068 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.068 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.068 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:31.068 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.378462+0000", 2024-09-13T06:42:31.068 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00045452300000000003 2024-09-13T06:42:31.068 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:31.068 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:31.068 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:31.068 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.068 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.069 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:37866 3.9 3:951cb95b:::rbd_data.1121d8143c6e.0000000000000002:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e56)", 2024-09-13T06:42:31.069 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:06.383951+0000", 2024-09-13T06:42:31.069 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 144.65425458300001, 2024-09-13T06:42:31.069 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.99517962299999996, 2024-09-13T06:42:31.069 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:31.069 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:31.069 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:31.069 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:31.069 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:31.069 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 37866 2024-09-13T06:42:31.069 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.069 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:31.069 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.069 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:31.070 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.383951+0000", 2024-09-13T06:42:31.070 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:31.070 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.070 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.070 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:31.070 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.383951+0000", 2024-09-13T06:42:31.070 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:31.070 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.070 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.070 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:31.070 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.383949+0000", 2024-09-13T06:42:31.070 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999981 2024-09-13T06:42:31.070 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.070 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.071 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:31.071 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.383961+0000", 2024-09-13T06:42:31.071 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1999e-05 2024-09-13T06:42:31.071 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.071 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.071 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:31.071 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384019+0000", 2024-09-13T06:42:31.071 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7621000000000003e-05 2024-09-13T06:42:31.071 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.071 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.071 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:31.071 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384040+0000", 2024-09-13T06:42:31.071 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1528000000000001e-05 2024-09-13T06:42:31.072 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.072 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.072 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:31.072 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384186+0000", 2024-09-13T06:42:31.072 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00014573799999999999 2024-09-13T06:42:31.072 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.072 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.072 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:42:31.072 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384204+0000", 2024-09-13T06:42:31.072 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7992e-05 2024-09-13T06:42:31.072 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.072 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.072 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:31.072 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.378536+0000", 2024-09-13T06:42:31.073 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.99433268600000002 2024-09-13T06:42:31.073 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.073 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.073 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:31.073 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.378771+0000", 2024-09-13T06:42:31.073 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00023445399999999999 2024-09-13T06:42:31.073 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.073 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.073 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:31.073 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.379130+0000", 2024-09-13T06:42:31.073 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00035954200000000002 2024-09-13T06:42:31.073 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:31.073 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:31.074 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:31.074 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.074 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.074 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:37881 3.9 3:951cb95b:::rbd_data.1121d8143c6e.0000000000000002:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e56)", 2024-09-13T06:42:31.074 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:06.384239+0000", 2024-09-13T06:42:31.074 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 144.653966169, 2024-09-13T06:42:31.074 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.99541483500000005, 2024-09-13T06:42:31.074 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:31.074 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:31.074 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:31.074 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:31.074 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:31.074 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 37881 2024-09-13T06:42:31.074 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.074 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:31.075 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.075 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:31.075 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384239+0000", 2024-09-13T06:42:31.075 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:31.075 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.075 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.075 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:31.075 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384239+0000", 2024-09-13T06:42:31.075 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:31.075 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.075 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.075 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:31.075 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384238+0000", 2024-09-13T06:42:31.076 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999986 2024-09-13T06:42:31.076 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.076 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.076 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:31.076 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384246+0000", 2024-09-13T06:42:31.076 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.2449999999999998e-06 2024-09-13T06:42:31.076 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.076 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.076 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:31.076 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384268+0000", 2024-09-13T06:42:31.076 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1518e-05 2024-09-13T06:42:31.076 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.076 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.076 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:31.077 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384282+0000", 2024-09-13T06:42:31.077 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4501999999999999e-05 2024-09-13T06:42:31.077 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.077 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.077 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:31.077 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384356+0000", 2024-09-13T06:42:31.077 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4265999999999997e-05 2024-09-13T06:42:31.077 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.077 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.077 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:42:31.077 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384370+0000", 2024-09-13T06:42:31.077 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3942e-05 2024-09-13T06:42:31.077 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.078 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.078 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:31.078 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.379199+0000", 2024-09-13T06:42:31.078 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.99482866599999997 2024-09-13T06:42:31.078 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.078 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.078 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:31.078 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.379347+0000", 2024-09-13T06:42:31.078 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00014749199999999999 2024-09-13T06:42:31.078 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.078 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.078 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:31.078 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.379654+0000", 2024-09-13T06:42:31.078 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00030752999999999998 2024-09-13T06:42:31.078 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:31.079 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:31.079 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:31.079 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.079 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.079 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:37896 3.9 3:951cb95b:::rbd_data.1121d8143c6e.0000000000000002:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e56)", 2024-09-13T06:42:31.079 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:06.384412+0000", 2024-09-13T06:42:31.079 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 144.65379373600001, 2024-09-13T06:42:31.079 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.99777835999999998, 2024-09-13T06:42:31.079 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:31.079 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:31.079 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:31.079 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:31.079 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:31.080 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 37896 2024-09-13T06:42:31.080 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.080 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:31.080 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.080 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:31.080 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384412+0000", 2024-09-13T06:42:31.080 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:31.080 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.080 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.080 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:31.080 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384412+0000", 2024-09-13T06:42:31.080 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:31.081 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.081 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.081 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:31.081 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384410+0000", 2024-09-13T06:42:31.081 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.999999 2024-09-13T06:42:31.081 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.081 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.081 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:31.081 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384418+0000", 2024-09-13T06:42:31.081 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.486e-06 2024-09-13T06:42:31.081 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.081 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.081 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:31.081 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384436+0000", 2024-09-13T06:42:31.082 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7668000000000001e-05 2024-09-13T06:42:31.082 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.082 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.082 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:31.082 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384449+0000", 2024-09-13T06:42:31.082 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3395e-05 2024-09-13T06:42:31.082 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.082 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.082 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:31.082 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384605+0000", 2024-09-13T06:42:31.082 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00015563099999999999 2024-09-13T06:42:31.082 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.082 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.083 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:42:31.083 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384635+0000", 2024-09-13T06:42:31.083 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.0383999999999999e-05 2024-09-13T06:42:31.083 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.083 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.083 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:31.083 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.379730+0000", 2024-09-13T06:42:31.083 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.99509493999999998 2024-09-13T06:42:31.083 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.083 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.083 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:31.083 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.379964+0000", 2024-09-13T06:42:31.083 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00023353499999999999 2024-09-13T06:42:31.084 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.084 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.084 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:31.084 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.382190+0000", 2024-09-13T06:42:31.084 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0022265039999999998 2024-09-13T06:42:31.084 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:31.084 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:31.084 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:31.084 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.084 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.084 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43222 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 389120~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:42:31.084 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558181+0000", 2024-09-13T06:42:31.085 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 129.480024482, 2024-09-13T06:42:31.085 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.06252038, 2024-09-13T06:42:31.085 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:31.085 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:31.085 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:31.085 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:31.085 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:31.085 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43222 2024-09-13T06:42:31.085 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.085 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:31.085 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.085 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:31.085 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558181+0000", 2024-09-13T06:42:31.086 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:31.086 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.086 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.086 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:31.086 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558181+0000", 2024-09-13T06:42:31.086 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:31.086 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.086 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.086 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:31.086 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558181+0000", 2024-09-13T06:42:31.086 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:31.086 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.086 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.087 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:31.087 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558183+0000", 2024-09-13T06:42:31.087 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.857e-06 2024-09-13T06:42:31.087 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.087 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.087 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:31.087 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558188+0000", 2024-09-13T06:42:31.087 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3759999999999999e-06 2024-09-13T06:42:31.087 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.087 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.087 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:31.087 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558261+0000", 2024-09-13T06:42:31.087 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3097999999999997e-05 2024-09-13T06:42:31.087 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.087 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.088 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:31.088 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.620354+0000", 2024-09-13T06:42:31.088 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.062092587999999997 2024-09-13T06:42:31.088 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.088 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.088 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:31.088 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.620428+0000", 2024-09-13T06:42:31.088 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3954000000000004e-05 2024-09-13T06:42:31.088 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.088 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.088 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:31.088 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.620701+0000", 2024-09-13T06:42:31.089 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000273773 2024-09-13T06:42:31.089 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:31.089 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:31.089 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:31.089 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.089 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.089 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43223 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 393216~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:42:31.089 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558267+0000", 2024-09-13T06:42:31.089 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 129.479938425, 2024-09-13T06:42:31.089 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.062813151999999997, 2024-09-13T06:42:31.089 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:31.089 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:31.089 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:31.089 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:31.090 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:31.090 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43223 2024-09-13T06:42:31.090 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.090 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:31.090 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.090 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:31.090 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558267+0000", 2024-09-13T06:42:31.090 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:31.090 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.090 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.090 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:31.090 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558267+0000", 2024-09-13T06:42:31.090 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:31.090 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.090 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.091 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:31.091 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558266+0000", 2024-09-13T06:42:31.091 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:31.091 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.091 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.091 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:31.091 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558270+0000", 2024-09-13T06:42:31.091 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.2389999999999998e-06 2024-09-13T06:42:31.091 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.091 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.091 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:31.091 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558277+0000", 2024-09-13T06:42:31.091 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5680000000000002e-06 2024-09-13T06:42:31.091 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.092 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.092 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:31.092 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558282+0000", 2024-09-13T06:42:31.092 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7060000000000003e-06 2024-09-13T06:42:31.092 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.092 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.092 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:31.092 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.620731+0000", 2024-09-13T06:42:31.092 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.062448661000000003 2024-09-13T06:42:31.092 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.092 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.092 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:31.092 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.620806+0000", 2024-09-13T06:42:31.093 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5862e-05 2024-09-13T06:42:31.093 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.093 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.093 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:31.093 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.621080+0000", 2024-09-13T06:42:31.093 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00027368599999999998 2024-09-13T06:42:31.093 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:31.093 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:31.093 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:31.093 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.093 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.093 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43224 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 407552~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:42:31.094 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558286+0000", 2024-09-13T06:42:31.094 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 129.479919061, 2024-09-13T06:42:31.094 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.063179052999999999, 2024-09-13T06:42:31.094 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:31.094 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:31.094 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:31.094 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:31.094 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:31.094 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43224 2024-09-13T06:42:31.094 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.094 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:31.094 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.094 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:31.094 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558286+0000", 2024-09-13T06:42:31.094 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:31.095 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.095 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.095 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:31.095 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558286+0000", 2024-09-13T06:42:31.095 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:31.095 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.095 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.095 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:31.095 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558286+0000", 2024-09-13T06:42:31.095 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:31.095 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.095 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.095 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:31.095 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558288+0000", 2024-09-13T06:42:31.095 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.227e-06 2024-09-13T06:42:31.096 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.096 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.096 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:31.096 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558292+0000", 2024-09-13T06:42:31.096 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.6289999999999999e-06 2024-09-13T06:42:31.096 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.096 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.096 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:31.096 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558294+0000", 2024-09-13T06:42:31.096 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5409999999999999e-06 2024-09-13T06:42:31.096 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.096 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.096 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:31.096 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.621110+0000", 2024-09-13T06:42:31.096 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.062815776000000004 2024-09-13T06:42:31.097 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.097 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.097 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:31.097 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.621186+0000", 2024-09-13T06:42:31.097 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5570999999999999e-05 2024-09-13T06:42:31.097 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.097 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.097 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:31.097 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.621465+0000", 2024-09-13T06:42:31.097 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00027988200000000001 2024-09-13T06:42:31.097 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:31.097 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:31.098 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:31.098 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.098 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.098 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43225 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 421888~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:42:31.098 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558296+0000", 2024-09-13T06:42:31.098 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 129.47990909399999, 2024-09-13T06:42:31.098 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.063551110999999993, 2024-09-13T06:42:31.098 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:31.098 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:31.098 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:31.098 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:31.098 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:31.098 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43225 2024-09-13T06:42:31.098 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.098 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:31.099 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.099 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:31.099 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558296+0000", 2024-09-13T06:42:31.099 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:31.099 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.099 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.099 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:31.099 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558296+0000", 2024-09-13T06:42:31.099 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:31.099 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.099 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.099 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:31.099 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558296+0000", 2024-09-13T06:42:31.099 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:42:31.100 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.100 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.100 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:31.100 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558305+0000", 2024-09-13T06:42:31.100 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.5290000000000008e-06 2024-09-13T06:42:31.100 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.100 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.100 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:31.100 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558308+0000", 2024-09-13T06:42:31.100 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.5619999999999999e-06 2024-09-13T06:42:31.100 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.100 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.101 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:31.101 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558311+0000", 2024-09-13T06:42:31.101 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.43e-06 2024-09-13T06:42:31.101 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.101 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.101 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:31.101 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.621495+0000", 2024-09-13T06:42:31.101 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.063184289000000005 2024-09-13T06:42:31.101 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.101 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.101 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:31.102 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.621569+0000", 2024-09-13T06:42:31.102 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4250000000000002e-05 2024-09-13T06:42:31.102 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.102 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.102 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:31.102 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.621847+0000", 2024-09-13T06:42:31.102 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00027826400000000002 2024-09-13T06:42:31.102 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:31.102 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:31.102 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:31.102 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.102 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.103 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43226 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 436224~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:42:31.103 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558313+0000", 2024-09-13T06:42:31.103 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 129.47989245799999, 2024-09-13T06:42:31.103 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.063914420999999999, 2024-09-13T06:42:31.103 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:31.103 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:31.103 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:31.103 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:31.103 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:31.103 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43226 2024-09-13T06:42:31.103 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.103 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:31.103 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.104 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:31.104 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558313+0000", 2024-09-13T06:42:31.104 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:31.104 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.104 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.104 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:31.104 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558313+0000", 2024-09-13T06:42:31.104 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:31.104 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.104 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.104 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:31.104 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558313+0000", 2024-09-13T06:42:31.104 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:31.104 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.105 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.105 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:31.105 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558314+0000", 2024-09-13T06:42:31.105 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3740000000000001e-06 2024-09-13T06:42:31.105 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.105 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.105 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:31.105 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558317+0000", 2024-09-13T06:42:31.105 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9730000000000002e-06 2024-09-13T06:42:31.105 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.105 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.105 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:31.105 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558319+0000", 2024-09-13T06:42:31.105 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4059999999999999e-06 2024-09-13T06:42:31.105 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.106 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.106 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:31.106 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.621877+0000", 2024-09-13T06:42:31.106 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.063557408999999995 2024-09-13T06:42:31.106 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.106 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.106 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:31.106 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.621951+0000", 2024-09-13T06:42:31.106 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4487999999999996e-05 2024-09-13T06:42:31.106 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.106 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.106 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:31.106 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.622227+0000", 2024-09-13T06:42:31.106 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000276011 2024-09-13T06:42:31.106 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:31.107 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:31.107 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:31.107 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.107 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.107 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43227 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 450560~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:42:31.107 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558322+0000", 2024-09-13T06:42:31.107 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 129.47988387699999, 2024-09-13T06:42:31.107 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.064285348000000006, 2024-09-13T06:42:31.107 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:31.107 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:31.107 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:31.107 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:31.107 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:31.107 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43227 2024-09-13T06:42:31.107 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.107 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:31.108 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.108 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:31.108 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558322+0000", 2024-09-13T06:42:31.108 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:31.108 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.108 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.108 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:31.108 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558322+0000", 2024-09-13T06:42:31.108 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:31.108 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.108 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.108 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:31.108 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558321+0000", 2024-09-13T06:42:31.108 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:42:31.109 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.109 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.109 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:31.109 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558323+0000", 2024-09-13T06:42:31.109 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.576e-06 2024-09-13T06:42:31.109 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.109 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.109 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:31.109 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558328+0000", 2024-09-13T06:42:31.109 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0719999999999999e-06 2024-09-13T06:42:31.109 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.109 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.109 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:31.109 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558332+0000", 2024-09-13T06:42:31.109 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.8130000000000002e-06 2024-09-13T06:42:31.110 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.110 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.110 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:31.110 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.622255+0000", 2024-09-13T06:42:31.110 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.063923195000000002 2024-09-13T06:42:31.110 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.110 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.110 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:31.110 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.622330+0000", 2024-09-13T06:42:31.110 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5383000000000007e-05 2024-09-13T06:42:31.110 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.110 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.110 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:31.110 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.622607+0000", 2024-09-13T06:42:31.110 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00027651999999999999 2024-09-13T06:42:31.111 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:31.111 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:31.111 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:31.111 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.111 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.111 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43228 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 464896~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:42:31.111 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558335+0000", 2024-09-13T06:42:31.111 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 129.479869968, 2024-09-13T06:42:31.111 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.064652253000000007, 2024-09-13T06:42:31.111 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:31.111 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:31.111 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:31.111 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:31.111 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:31.112 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43228 2024-09-13T06:42:31.112 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.112 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:31.112 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.112 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:31.112 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558335+0000", 2024-09-13T06:42:31.112 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:31.112 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.112 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.112 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:31.112 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558335+0000", 2024-09-13T06:42:31.112 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:31.112 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.113 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.113 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:31.113 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558335+0000", 2024-09-13T06:42:31.113 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:31.113 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.113 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.113 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:31.113 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558337+0000", 2024-09-13T06:42:31.113 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1380000000000001e-06 2024-09-13T06:42:31.113 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.113 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.113 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:31.113 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558343+0000", 2024-09-13T06:42:31.113 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.5140000000000001e-06 2024-09-13T06:42:31.114 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.114 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.114 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:31.114 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558348+0000", 2024-09-13T06:42:31.114 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9640000000000002e-06 2024-09-13T06:42:31.114 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.114 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.114 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:31.114 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.622636+0000", 2024-09-13T06:42:31.114 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.064288260999999999 2024-09-13T06:42:31.114 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.114 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.114 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:31.114 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.622715+0000", 2024-09-13T06:42:31.114 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.9351000000000006e-05 2024-09-13T06:42:31.114 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.115 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.115 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:31.115 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.622988+0000", 2024-09-13T06:42:31.115 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00027242599999999998 2024-09-13T06:42:31.115 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:31.115 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:31.115 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:31.115 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.115 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.115 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43229 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 479232~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:42:31.115 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558352+0000", 2024-09-13T06:42:31.115 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 129.479853553, 2024-09-13T06:42:31.116 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.065018024999999993, 2024-09-13T06:42:31.116 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:31.116 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:31.116 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:31.116 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:31.116 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:31.116 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43229 2024-09-13T06:42:31.116 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.116 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:31.116 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.116 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:31.116 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558352+0000", 2024-09-13T06:42:31.116 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:31.117 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.117 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.117 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:31.117 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558352+0000", 2024-09-13T06:42:31.117 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:31.117 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.117 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.117 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:31.117 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558352+0000", 2024-09-13T06:42:31.117 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:31.117 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.117 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.117 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:31.117 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558354+0000", 2024-09-13T06:42:31.118 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4930000000000001e-06 2024-09-13T06:42:31.118 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.118 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.118 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:31.118 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558360+0000", 2024-09-13T06:42:31.118 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.263e-06 2024-09-13T06:42:31.118 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.118 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.118 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:31.118 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558369+0000", 2024-09-13T06:42:31.118 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.0829999999999993e-06 2024-09-13T06:42:31.118 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.118 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.118 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:31.118 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.623017+0000", 2024-09-13T06:42:31.118 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.064647799000000006 2024-09-13T06:42:31.119 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.119 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.119 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:31.119 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.623090+0000", 2024-09-13T06:42:31.119 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3071000000000006e-05 2024-09-13T06:42:31.119 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.119 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.119 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:31.119 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.623370+0000", 2024-09-13T06:42:31.119 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000279661 2024-09-13T06:42:31.119 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:31.119 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:31.119 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:31.119 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.119 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.120 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43230 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 493568~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:42:31.120 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558374+0000", 2024-09-13T06:42:31.120 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 129.47983126, 2024-09-13T06:42:31.120 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.065410435000000003, 2024-09-13T06:42:31.120 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:31.120 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:31.120 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:31.120 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:31.120 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:31.120 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43230 2024-09-13T06:42:31.120 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.120 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:31.120 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.120 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:31.120 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558374+0000", 2024-09-13T06:42:31.121 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:31.121 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.121 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.121 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:31.121 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558374+0000", 2024-09-13T06:42:31.121 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:31.121 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.121 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.121 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:31.121 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558374+0000", 2024-09-13T06:42:31.121 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:31.121 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.121 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.122 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:31.122 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558376+0000", 2024-09-13T06:42:31.122 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4430000000000002e-06 2024-09-13T06:42:31.122 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.122 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.122 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:31.122 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558382+0000", 2024-09-13T06:42:31.122 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3029999999999996e-06 2024-09-13T06:42:31.122 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.122 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.122 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:31.122 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558387+0000", 2024-09-13T06:42:31.122 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.1699999999999999e-06 2024-09-13T06:42:31.123 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.123 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.123 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:31.123 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.623400+0000", 2024-09-13T06:42:31.123 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.065013244999999997 2024-09-13T06:42:31.123 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.123 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.123 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:31.123 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.623474+0000", 2024-09-13T06:42:31.123 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3889999999999999e-05 2024-09-13T06:42:31.123 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.123 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.123 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:31.124 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.623785+0000", 2024-09-13T06:42:31.124 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00031080099999999998 2024-09-13T06:42:31.124 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:31.124 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:31.124 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:31.124 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.124 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.124 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43231 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 507904~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:42:31.124 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558391+0000", 2024-09-13T06:42:31.124 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 129.47981457500001, 2024-09-13T06:42:31.124 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.065788597000000004, 2024-09-13T06:42:31.124 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:31.124 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:31.124 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:31.125 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:31.125 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:31.125 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43231 2024-09-13T06:42:31.125 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.125 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:31.125 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.125 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:31.125 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558391+0000", 2024-09-13T06:42:31.125 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:31.125 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.125 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.125 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:31.125 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558391+0000", 2024-09-13T06:42:31.125 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:31.125 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.126 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.126 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:31.126 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558390+0000", 2024-09-13T06:42:31.126 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:31.126 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.126 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.126 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:31.126 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558393+0000", 2024-09-13T06:42:31.126 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2570000000000002e-06 2024-09-13T06:42:31.126 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.126 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.126 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:31.126 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558399+0000", 2024-09-13T06:42:31.127 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0419999999999999e-06 2024-09-13T06:42:31.127 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.127 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.127 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:31.127 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558403+0000", 2024-09-13T06:42:31.127 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6249999999999998e-06 2024-09-13T06:42:31.127 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.127 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.127 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:31.127 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.623811+0000", 2024-09-13T06:42:31.127 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.065407549999999995 2024-09-13T06:42:31.127 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.127 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.127 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:31.127 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.623877+0000", 2024-09-13T06:42:31.128 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.5902999999999996e-05 2024-09-13T06:42:31.128 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.128 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.128 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:31.128 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.624179+0000", 2024-09-13T06:42:31.128 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00030259999999999998 2024-09-13T06:42:31.128 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:31.128 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:31.128 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:31.128 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.128 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.128 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43232 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 522240~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:42:31.128 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558422+0000", 2024-09-13T06:42:31.128 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 129.479783798, 2024-09-13T06:42:31.128 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.066176061999999994, 2024-09-13T06:42:31.129 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:31.129 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:31.129 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:31.129 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:31.129 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:31.129 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43232 2024-09-13T06:42:31.129 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.129 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:31.129 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.129 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:31.129 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558422+0000", 2024-09-13T06:42:31.129 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:31.129 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.130 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.130 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:31.130 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558422+0000", 2024-09-13T06:42:31.130 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:31.130 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.130 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.130 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:31.130 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558421+0000", 2024-09-13T06:42:31.130 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:31.130 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.130 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.130 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:31.130 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558428+0000", 2024-09-13T06:42:31.130 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.1690000000000003e-06 2024-09-13T06:42:31.130 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.131 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.131 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:31.131 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558434+0000", 2024-09-13T06:42:31.131 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9309999999999996e-06 2024-09-13T06:42:31.131 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.131 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.131 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:31.131 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558447+0000", 2024-09-13T06:42:31.131 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.271e-05 2024-09-13T06:42:31.131 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.131 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.131 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:31.131 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.624209+0000", 2024-09-13T06:42:31.132 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.065762102000000003 2024-09-13T06:42:31.132 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.132 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.132 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:31.132 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.624282+0000", 2024-09-13T06:42:31.132 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.2889e-05 2024-09-13T06:42:31.132 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.132 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.132 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:31.132 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.624598+0000", 2024-09-13T06:42:31.132 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00031591399999999998 2024-09-13T06:42:31.132 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:31.132 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:31.132 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:31.133 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.133 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.133 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43486 3.f 3:f7da9c8f:::rbd_data.1121f5f2e1c0.000000000000000b:1f [read 260096~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:42:31.133 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.569088+0000", 2024-09-13T06:42:31.133 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 129.46911707500001, 2024-09-13T06:42:31.133 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.062579223000000003, 2024-09-13T06:42:31.133 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:31.133 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:31.133 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:31.133 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:31.133 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:31.133 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43486 2024-09-13T06:42:31.133 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.134 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:31.134 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.134 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:31.134 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.569088+0000", 2024-09-13T06:42:31.134 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:31.134 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.134 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.134 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:31.134 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.569088+0000", 2024-09-13T06:42:31.134 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:31.134 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.134 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.135 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:31.135 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.569088+0000", 2024-09-13T06:42:31.135 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:31.135 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.135 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.135 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:31.135 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.569091+0000", 2024-09-13T06:42:31.135 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9629999999999998e-06 2024-09-13T06:42:31.135 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.135 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.135 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:31.135 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.569097+0000", 2024-09-13T06:42:31.135 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.4160000000000001e-06 2024-09-13T06:42:31.135 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.136 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.136 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:31.136 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.569102+0000", 2024-09-13T06:42:31.136 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6659999999999999e-06 2024-09-13T06:42:31.136 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.136 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.136 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:31.136 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.631346+0000", 2024-09-13T06:42:31.136 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.062243896 2024-09-13T06:42:31.136 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.136 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.136 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:31.136 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.631413+0000", 2024-09-13T06:42:31.137 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.7638000000000005e-05 2024-09-13T06:42:31.137 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.137 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.137 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:31.137 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.631668+0000", 2024-09-13T06:42:31.137 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0002541 2024-09-13T06:42:31.137 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:31.137 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:31.137 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:31.137 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:31.137 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:31.137 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:42:31.139 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-13T06:42:31.139 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:42:31.136+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:42:31.239 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:42:31.236+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:42:31.309 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:42:31.309 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-13T06:42:31.309 INFO:teuthology.orchestra.run.smithi081.stdout: "num_ops": 0 2024-09-13T06:42:31.309 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:42:31.323 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-13T06:42:31.340 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:42:31.333+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:42:31.440 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:42:31.436+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:42:31.500 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:42:31.500 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-13T06:42:31.500 INFO:teuthology.orchestra.run.smithi081.stdout: "complaint_time": 30, 2024-09-13T06:42:31.500 INFO:teuthology.orchestra.run.smithi081.stdout: "num_blocked_ops": 0 2024-09-13T06:42:31.501 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:42:31.514 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-13T06:42:31.558 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:42:31.556+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:42:31.580 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-13T06:42:31.650 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:42:31.648+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:42:31.676 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:42:31.677 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 20, 2024-09-13T06:42:31.677 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 600, 2024-09-13T06:42:31.677 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [ 2024-09-13T06:42:31.677 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.677 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:2226 3.15 3:af026987:::rbd_data.112173e2f1b7.0000000000000017:head [sparse-read 0~4194304] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-13T06:42:31.677 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:37.606562+0000", 2024-09-13T06:42:31.677 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 174.07047427699999, 2024-09-13T06:42:31.677 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.83322091700000001, 2024-09-13T06:42:31.677 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:31.677 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:42:31.677 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:31.677 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:31.677 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:31.677 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 2226 2024-09-13T06:42:31.678 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.678 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:31.678 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.678 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:31.678 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606562+0000", 2024-09-13T06:42:31.678 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:31.678 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.678 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.678 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:31.678 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606562+0000", 2024-09-13T06:42:31.678 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:31.678 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.679 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.679 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:31.679 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606561+0000", 2024-09-13T06:42:31.679 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:31.679 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.679 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.679 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:31.679 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606565+0000", 2024-09-13T06:42:31.679 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.4379999999999999e-06 2024-09-13T06:42:31.679 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.679 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.679 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:31.679 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606569+0000", 2024-09-13T06:42:31.679 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.425e-06 2024-09-13T06:42:31.679 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.680 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.680 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:31.680 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606572+0000", 2024-09-13T06:42:31.680 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.05e-06 2024-09-13T06:42:31.680 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.680 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.680 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:31.680 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606621+0000", 2024-09-13T06:42:31.680 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.8723000000000001e-05 2024-09-13T06:42:31.680 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.680 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.680 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:42:31.680 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606630+0000", 2024-09-13T06:42:31.680 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.8040000000000007e-06 2024-09-13T06:42:31.681 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.681 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.681 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:31.681 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.439648+0000", 2024-09-13T06:42:31.681 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.83301824800000002 2024-09-13T06:42:31.681 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.681 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.681 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:31.681 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.439782+0000", 2024-09-13T06:42:31.681 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00013466699999999999 2024-09-13T06:42:31.681 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:31.681 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:31.681 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:31.681 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.681 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.682 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25661 3.8 3:1180686c:::rbd_data.1121f2c5ee81.0000000000000009:13 [read 397312~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:42:31.682 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.436956+0000", 2024-09-13T06:42:31.682 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 155.240079743, 2024-09-13T06:42:31.682 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089036758999999993, 2024-09-13T06:42:31.682 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:31.682 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:31.682 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:31.682 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:31.682 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:31.682 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25661 2024-09-13T06:42:31.682 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.682 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:31.682 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.682 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:31.683 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436956+0000", 2024-09-13T06:42:31.683 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:31.683 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.683 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.683 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:31.683 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436956+0000", 2024-09-13T06:42:31.683 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:31.683 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.683 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.683 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:31.683 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436956+0000", 2024-09-13T06:42:31.683 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:31.683 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.683 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.683 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:31.684 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436958+0000", 2024-09-13T06:42:31.684 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1770000000000001e-06 2024-09-13T06:42:31.684 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.684 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.684 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:31.684 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436963+0000", 2024-09-13T06:42:31.684 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.6489999999999996e-06 2024-09-13T06:42:31.684 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.684 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.684 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:31.684 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436975+0000", 2024-09-13T06:42:31.684 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1783999999999999e-05 2024-09-13T06:42:31.684 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.684 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.685 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:31.685 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.525671+0000", 2024-09-13T06:42:31.685 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.088696292999999995 2024-09-13T06:42:31.685 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.685 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.685 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:31.685 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.525749+0000", 2024-09-13T06:42:31.685 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.7589000000000005e-05 2024-09-13T06:42:31.685 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.685 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.685 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:31.685 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.525993+0000", 2024-09-13T06:42:31.685 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00024381000000000001 2024-09-13T06:42:31.685 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:31.685 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:31.686 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:31.686 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.686 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.686 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25662 3.8 3:1180686c:::rbd_data.1121f2c5ee81.0000000000000009:13 [read 421888~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:42:31.686 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.436980+0000", 2024-09-13T06:42:31.686 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 155.240055431, 2024-09-13T06:42:31.686 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089367577000000004, 2024-09-13T06:42:31.686 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:31.686 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:31.686 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:31.686 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:31.686 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:31.686 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25662 2024-09-13T06:42:31.686 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.687 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:31.687 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.687 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:31.687 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436980+0000", 2024-09-13T06:42:31.687 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:31.687 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.687 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.687 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:31.687 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436980+0000", 2024-09-13T06:42:31.687 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:31.687 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.687 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.687 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:31.687 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436980+0000", 2024-09-13T06:42:31.687 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:31.688 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.688 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.688 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:31.688 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436982+0000", 2024-09-13T06:42:31.688 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3989999999999998e-06 2024-09-13T06:42:31.688 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.688 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.688 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:31.688 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436988+0000", 2024-09-13T06:42:31.688 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0039999999999996e-06 2024-09-13T06:42:31.688 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.688 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.688 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:31.689 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436993+0000", 2024-09-13T06:42:31.689 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6090000000000003e-06 2024-09-13T06:42:31.689 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.689 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.689 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:31.689 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.526035+0000", 2024-09-13T06:42:31.689 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089042248000000004 2024-09-13T06:42:31.689 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.689 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.689 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:31.689 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.526111+0000", 2024-09-13T06:42:31.689 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5643999999999996e-05 2024-09-13T06:42:31.689 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.689 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.690 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:31.690 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.526348+0000", 2024-09-13T06:42:31.690 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00023705800000000001 2024-09-13T06:42:31.690 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:31.690 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:31.690 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:31.690 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.690 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.690 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25663 3.8 3:1180686c:::rbd_data.1121f2c5ee81.0000000000000009:13 [read 466944~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:42:31.690 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.436998+0000", 2024-09-13T06:42:31.690 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 155.24003778400001, 2024-09-13T06:42:31.690 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089730867000000006, 2024-09-13T06:42:31.690 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:31.691 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:31.691 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:31.691 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:31.691 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:31.691 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25663 2024-09-13T06:42:31.691 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.691 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:31.691 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.691 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:31.691 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436998+0000", 2024-09-13T06:42:31.691 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:31.691 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.692 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.692 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:31.692 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436998+0000", 2024-09-13T06:42:31.692 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:31.692 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.692 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.692 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:31.692 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436998+0000", 2024-09-13T06:42:31.692 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:31.692 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.692 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.692 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:31.692 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437000+0000", 2024-09-13T06:42:31.693 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0940000000000002e-06 2024-09-13T06:42:31.693 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.693 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.693 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:31.693 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437005+0000", 2024-09-13T06:42:31.693 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.604e-06 2024-09-13T06:42:31.693 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.693 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.693 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:31.693 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437032+0000", 2024-09-13T06:42:31.693 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6407e-05 2024-09-13T06:42:31.693 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.693 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.694 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:31.694 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.526363+0000", 2024-09-13T06:42:31.694 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089331456000000004 2024-09-13T06:42:31.694 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.694 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.694 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:31.694 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.526404+0000", 2024-09-13T06:42:31.694 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.0887999999999999e-05 2024-09-13T06:42:31.694 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.694 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.694 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:31.694 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.526729+0000", 2024-09-13T06:42:31.694 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00032486 2024-09-13T06:42:31.695 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:31.695 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:31.695 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:31.695 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.695 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.695 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25664 3.8 3:1180686c:::rbd_data.1121f2c5ee81.0000000000000009:13 [read 491520~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:42:31.695 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.437040+0000", 2024-09-13T06:42:31.695 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 155.23999586900001, 2024-09-13T06:42:31.695 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.090016650000000004, 2024-09-13T06:42:31.695 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:31.695 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:31.695 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:31.695 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:31.695 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:31.696 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25664 2024-09-13T06:42:31.696 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.696 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:31.696 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.696 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:31.696 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437040+0000", 2024-09-13T06:42:31.696 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:31.696 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.696 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.696 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:31.696 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437040+0000", 2024-09-13T06:42:31.696 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:31.696 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.696 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.697 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:31.697 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437039+0000", 2024-09-13T06:42:31.697 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:31.697 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.697 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.697 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:31.697 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437047+0000", 2024-09-13T06:42:31.697 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4839999999999998e-06 2024-09-13T06:42:31.697 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.697 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.697 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:31.697 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437054+0000", 2024-09-13T06:42:31.697 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.8299999999999998e-06 2024-09-13T06:42:31.697 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.698 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.698 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:31.698 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437060+0000", 2024-09-13T06:42:31.698 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.1510000000000001e-06 2024-09-13T06:42:31.698 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.698 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.698 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:31.698 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.526772+0000", 2024-09-13T06:42:31.698 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089711737999999999 2024-09-13T06:42:31.698 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.698 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.698 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:31.698 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.526848+0000", 2024-09-13T06:42:31.698 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5870000000000004e-05 2024-09-13T06:42:31.698 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.699 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.699 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:31.699 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.527057+0000", 2024-09-13T06:42:31.699 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000209106 2024-09-13T06:42:31.699 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:31.699 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:31.699 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:31.699 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.699 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.699 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25740 3.18 3:1c662b96:::rbd_data.1121f2c5ee81.0000000000000010:13 [read 200704~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:42:31.699 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443352+0000", 2024-09-13T06:42:31.699 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 155.23368419400001, 2024-09-13T06:42:31.699 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089068222000000002, 2024-09-13T06:42:31.699 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:31.699 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:31.700 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:31.700 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:31.700 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:31.700 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25740 2024-09-13T06:42:31.700 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.700 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:31.700 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.700 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:31.700 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443352+0000", 2024-09-13T06:42:31.700 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:31.700 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.700 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.700 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:31.700 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443352+0000", 2024-09-13T06:42:31.701 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:31.701 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.701 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.701 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:31.701 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443351+0000", 2024-09-13T06:42:31.701 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:31.701 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.701 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.701 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:31.701 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443354+0000", 2024-09-13T06:42:31.701 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.841e-06 2024-09-13T06:42:31.701 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.701 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.701 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:31.702 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443361+0000", 2024-09-13T06:42:31.702 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.0010000000000004e-06 2024-09-13T06:42:31.702 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.702 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.702 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:31.702 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443366+0000", 2024-09-13T06:42:31.702 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7119999999999999e-06 2024-09-13T06:42:31.702 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.702 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.702 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:31.702 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532117+0000", 2024-09-13T06:42:31.702 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.088751327000000005 2024-09-13T06:42:31.703 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.703 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.703 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:31.703 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532193+0000", 2024-09-13T06:42:31.703 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5839000000000004e-05 2024-09-13T06:42:31.703 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.703 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.703 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:31.703 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532420+0000", 2024-09-13T06:42:31.703 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00022691000000000001 2024-09-13T06:42:31.703 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:31.703 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:31.703 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:31.703 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.704 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.704 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25741 3.18 3:1c662b96:::rbd_data.1121f2c5ee81.0000000000000010:13 [read 225280~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:42:31.704 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443378+0000", 2024-09-13T06:42:31.704 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 155.233657427, 2024-09-13T06:42:31.704 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089324107, 2024-09-13T06:42:31.704 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:31.704 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:31.704 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:31.704 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:31.704 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:31.704 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25741 2024-09-13T06:42:31.704 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.704 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:31.705 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.705 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:31.705 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443378+0000", 2024-09-13T06:42:31.705 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:31.705 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.705 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.705 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:31.705 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443378+0000", 2024-09-13T06:42:31.705 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:31.705 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.705 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.705 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:31.705 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443378+0000", 2024-09-13T06:42:31.706 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:31.706 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.706 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.706 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:31.706 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443380+0000", 2024-09-13T06:42:31.706 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3549999999999999e-06 2024-09-13T06:42:31.706 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.706 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.706 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:31.706 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443388+0000", 2024-09-13T06:42:31.706 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.7449999999999995e-06 2024-09-13T06:42:31.706 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.706 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.707 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:31.707 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443393+0000", 2024-09-13T06:42:31.707 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.4e-06 2024-09-13T06:42:31.707 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.707 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.707 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:31.707 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532454+0000", 2024-09-13T06:42:31.707 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089060941000000005 2024-09-13T06:42:31.707 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.707 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.707 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:31.707 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532512+0000", 2024-09-13T06:42:31.707 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7763000000000002e-05 2024-09-13T06:42:31.707 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.708 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.708 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:31.708 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532703+0000", 2024-09-13T06:42:31.708 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000190328 2024-09-13T06:42:31.708 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:31.708 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:31.708 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:31.708 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.708 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.708 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25742 3.18 3:1c662b96:::rbd_data.1121f2c5ee81.0000000000000010:13 [read 270336~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:42:31.708 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443398+0000", 2024-09-13T06:42:31.708 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 155.23363771499999, 2024-09-13T06:42:31.708 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089621836999999996, 2024-09-13T06:42:31.708 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:31.708 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:31.709 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:31.709 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:31.709 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:31.709 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25742 2024-09-13T06:42:31.709 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.709 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:31.709 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.709 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:31.709 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443398+0000", 2024-09-13T06:42:31.709 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:31.709 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.709 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.709 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:31.709 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443398+0000", 2024-09-13T06:42:31.710 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:31.710 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.710 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.710 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:31.710 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443398+0000", 2024-09-13T06:42:31.710 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:31.710 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.710 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.710 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:31.710 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443400+0000", 2024-09-13T06:42:31.710 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1849999999999998e-06 2024-09-13T06:42:31.710 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.710 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.710 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:31.711 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443407+0000", 2024-09-13T06:42:31.711 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3669999999999999e-06 2024-09-13T06:42:31.711 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.711 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.711 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:31.711 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443420+0000", 2024-09-13T06:42:31.711 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2645e-05 2024-09-13T06:42:31.711 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.711 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.711 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:31.711 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532742+0000", 2024-09-13T06:42:31.711 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089322200000000004 2024-09-13T06:42:31.711 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.711 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.711 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:31.712 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532818+0000", 2024-09-13T06:42:31.712 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.6019000000000005e-05 2024-09-13T06:42:31.712 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.712 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.712 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:31.712 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533020+0000", 2024-09-13T06:42:31.712 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000201721 2024-09-13T06:42:31.712 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:31.712 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:31.712 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:31.712 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.712 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.712 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25743 3.18 3:1c662b96:::rbd_data.1121f2c5ee81.0000000000000010:13 [read 294912~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:42:31.712 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443425+0000", 2024-09-13T06:42:31.713 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 155.233610707, 2024-09-13T06:42:31.713 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089864075000000002, 2024-09-13T06:42:31.713 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:31.713 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:31.713 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:31.713 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:31.713 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:31.713 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25743 2024-09-13T06:42:31.713 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.713 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:31.713 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.713 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:31.713 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443425+0000", 2024-09-13T06:42:31.714 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:31.714 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.714 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.714 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:31.714 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443425+0000", 2024-09-13T06:42:31.714 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:31.714 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.714 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.714 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:31.714 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443425+0000", 2024-09-13T06:42:31.714 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:31.714 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.715 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.715 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:31.715 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443432+0000", 2024-09-13T06:42:31.715 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3420000000000002e-06 2024-09-13T06:42:31.715 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.715 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.715 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:31.715 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443440+0000", 2024-09-13T06:42:31.715 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5689999999999999e-06 2024-09-13T06:42:31.715 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.715 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.715 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:31.715 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443445+0000", 2024-09-13T06:42:31.716 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9590000000000003e-06 2024-09-13T06:42:31.716 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.716 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.716 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:31.716 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533063+0000", 2024-09-13T06:42:31.716 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089617988999999995 2024-09-13T06:42:31.716 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.716 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.716 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:31.716 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533122+0000", 2024-09-13T06:42:31.716 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9052999999999999e-05 2024-09-13T06:42:31.716 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.716 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.717 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:31.717 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533289+0000", 2024-09-13T06:42:31.717 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00016752800000000001 2024-09-13T06:42:31.717 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:31.717 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:31.717 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:31.717 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.717 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.717 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25744 3.18 3.69d46638 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:42:31.717 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443449+0000", 2024-09-13T06:42:31.717 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 155.23358655999999, 2024-09-13T06:42:31.717 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089869148999999995, 2024-09-13T06:42:31.718 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:31.718 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:42:31.718 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:31.718 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:31.718 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:31.718 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25744 2024-09-13T06:42:31.718 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.718 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:31.718 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.718 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:31.718 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443449+0000", 2024-09-13T06:42:31.718 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:31.718 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.719 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.719 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:31.719 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443449+0000", 2024-09-13T06:42:31.719 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:31.719 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.719 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.719 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:31.719 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443449+0000", 2024-09-13T06:42:31.719 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:31.719 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.719 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.719 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:31.719 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443451+0000", 2024-09-13T06:42:31.720 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.244e-06 2024-09-13T06:42:31.720 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.720 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.720 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:31.720 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443457+0000", 2024-09-13T06:42:31.720 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.66e-06 2024-09-13T06:42:31.720 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.720 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.720 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:31.720 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443461+0000", 2024-09-13T06:42:31.720 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5449999999999997e-06 2024-09-13T06:42:31.720 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.720 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.721 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:31.721 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533311+0000", 2024-09-13T06:42:31.721 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089849729000000003 2024-09-13T06:42:31.721 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.721 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.721 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:31.721 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533318+0000", 2024-09-13T06:42:31.721 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.328e-06 2024-09-13T06:42:31.721 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:31.721 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:31.721 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:31.721 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.721 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.721 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25745 3.18 3.69d46638 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:42:31.722 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443466+0000", 2024-09-13T06:42:31.722 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 155.23356950199999, 2024-09-13T06:42:31.722 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089886743000000005, 2024-09-13T06:42:31.722 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:31.722 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:42:31.722 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:31.722 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:31.722 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:31.722 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25745 2024-09-13T06:42:31.722 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.722 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:31.722 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.722 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:31.722 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443466+0000", 2024-09-13T06:42:31.723 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:31.723 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.723 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.723 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:31.723 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443466+0000", 2024-09-13T06:42:31.723 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:31.723 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.723 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.723 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:31.723 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443466+0000", 2024-09-13T06:42:31.723 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:31.723 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.723 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.724 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:31.724 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443474+0000", 2024-09-13T06:42:31.724 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.1289999999999996e-06 2024-09-13T06:42:31.724 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.724 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.724 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:31.724 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443484+0000", 2024-09-13T06:42:31.724 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0654e-05 2024-09-13T06:42:31.724 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.724 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.724 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:31.724 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443490+0000", 2024-09-13T06:42:31.724 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8030000000000002e-06 2024-09-13T06:42:31.725 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.725 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.725 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:31.725 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533348+0000", 2024-09-13T06:42:31.725 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089857267000000005 2024-09-13T06:42:31.725 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.725 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.725 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:31.725 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533353+0000", 2024-09-13T06:42:31.725 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.5520000000000004e-06 2024-09-13T06:42:31.725 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:31.725 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:31.726 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:31.726 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.726 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.726 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25746 3.18 3.69d46638 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:42:31.726 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443495+0000", 2024-09-13T06:42:31.726 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 155.23354038900001, 2024-09-13T06:42:31.726 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089903725000000004, 2024-09-13T06:42:31.726 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:31.726 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:42:31.726 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:31.726 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:31.726 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:31.726 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25746 2024-09-13T06:42:31.727 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.727 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:31.727 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.727 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:31.727 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443495+0000", 2024-09-13T06:42:31.727 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:31.727 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.727 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.727 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:31.727 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443495+0000", 2024-09-13T06:42:31.727 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:31.727 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.727 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.727 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:31.728 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443495+0000", 2024-09-13T06:42:31.728 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:31.728 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.728 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.728 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:31.728 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443498+0000", 2024-09-13T06:42:31.728 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.7690000000000001e-06 2024-09-13T06:42:31.728 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.728 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.728 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:31.728 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443504+0000", 2024-09-13T06:42:31.728 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9710000000000001e-06 2024-09-13T06:42:31.728 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.728 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.729 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:31.729 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443508+0000", 2024-09-13T06:42:31.729 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4159999999999997e-06 2024-09-13T06:42:31.729 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.729 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.729 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:31.729 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533391+0000", 2024-09-13T06:42:31.729 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089882607000000003 2024-09-13T06:42:31.729 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.729 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.729 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:31.729 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533399+0000", 2024-09-13T06:42:31.729 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.4349999999999997e-06 2024-09-13T06:42:31.729 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:31.729 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:31.730 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:31.730 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.730 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.730 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25747 3.8 3.63996268 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:42:31.730 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443512+0000", 2024-09-13T06:42:31.730 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 155.233523658, 2024-09-13T06:42:31.730 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089880075000000004, 2024-09-13T06:42:31.730 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:31.730 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:42:31.730 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:31.730 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:31.730 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:31.730 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25747 2024-09-13T06:42:31.730 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.731 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:31.731 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.731 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:31.731 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443512+0000", 2024-09-13T06:42:31.731 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:31.731 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.731 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.731 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:31.731 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443512+0000", 2024-09-13T06:42:31.731 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:31.731 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.731 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.731 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:31.732 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443512+0000", 2024-09-13T06:42:31.732 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:31.732 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.732 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.732 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:31.732 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443514+0000", 2024-09-13T06:42:31.732 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0980000000000001e-06 2024-09-13T06:42:31.732 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.732 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.732 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:31.732 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443520+0000", 2024-09-13T06:42:31.732 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7069999999999997e-06 2024-09-13T06:42:31.732 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.733 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.733 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:31.733 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443524+0000", 2024-09-13T06:42:31.733 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5390000000000001e-06 2024-09-13T06:42:31.733 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.733 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.733 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:31.733 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533384+0000", 2024-09-13T06:42:31.733 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089859684999999995 2024-09-13T06:42:31.733 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.733 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.733 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:31.733 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533392+0000", 2024-09-13T06:42:31.734 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.3440000000000001e-06 2024-09-13T06:42:31.734 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:31.734 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:31.734 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:31.734 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.734 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.734 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25748 3.8 3.63996268 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:42:31.734 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443528+0000", 2024-09-13T06:42:31.734 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 155.23350753099999, 2024-09-13T06:42:31.734 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089890715999999996, 2024-09-13T06:42:31.734 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:31.734 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:42:31.734 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:31.734 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:31.735 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:31.735 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25748 2024-09-13T06:42:31.735 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.735 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:31.735 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.735 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:31.735 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443528+0000", 2024-09-13T06:42:31.735 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:31.735 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.735 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.735 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:31.735 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443528+0000", 2024-09-13T06:42:31.735 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:31.736 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.736 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.736 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:31.736 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443528+0000", 2024-09-13T06:42:31.736 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:31.736 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.736 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.736 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:31.736 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443530+0000", 2024-09-13T06:42:31.736 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0650000000000001e-06 2024-09-13T06:42:31.736 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.736 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.736 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:31.737 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443536+0000", 2024-09-13T06:42:31.737 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7259999999999999e-06 2024-09-13T06:42:31.737 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.737 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.737 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:31.737 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443540+0000", 2024-09-13T06:42:31.737 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5009999999999998e-06 2024-09-13T06:42:31.737 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.737 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.737 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:31.737 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533412+0000", 2024-09-13T06:42:31.737 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089871873000000005 2024-09-13T06:42:31.737 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.738 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.738 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:31.738 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533419+0000", 2024-09-13T06:42:31.738 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.883e-06 2024-09-13T06:42:31.738 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:31.738 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:31.738 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:31.738 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.738 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.738 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25749 3.8 3.63996268 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:42:31.738 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443545+0000", 2024-09-13T06:42:31.738 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 155.233491335, 2024-09-13T06:42:31.738 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089897988999999998, 2024-09-13T06:42:31.738 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:31.738 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:42:31.738 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:31.739 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:31.739 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:31.739 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25749 2024-09-13T06:42:31.739 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.739 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:31.739 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.739 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:31.739 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443545+0000", 2024-09-13T06:42:31.739 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:31.739 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.739 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.739 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:31.739 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443545+0000", 2024-09-13T06:42:31.739 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:31.740 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.740 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.740 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:31.740 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443544+0000", 2024-09-13T06:42:31.740 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:31.740 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.740 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.740 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:31.740 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443553+0000", 2024-09-13T06:42:31.740 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.4770000000000003e-06 2024-09-13T06:42:31.740 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.740 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.740 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:31.740 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443564+0000", 2024-09-13T06:42:31.741 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0986e-05 2024-09-13T06:42:31.741 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.741 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.741 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:31.741 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443569+0000", 2024-09-13T06:42:31.741 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2530000000000004e-06 2024-09-13T06:42:31.741 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.741 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.741 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:31.741 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533438+0000", 2024-09-13T06:42:31.741 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089868641999999999 2024-09-13T06:42:31.741 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.741 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.741 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:31.741 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533442+0000", 2024-09-13T06:42:31.742 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.989e-06 2024-09-13T06:42:31.742 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:31.742 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:31.742 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:31.742 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.742 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.742 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25750 3.8 3.63996268 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:42:31.742 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443574+0000", 2024-09-13T06:42:31.742 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 155.23346184900001, 2024-09-13T06:42:31.742 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089895143999999996, 2024-09-13T06:42:31.742 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:31.742 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:42:31.742 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:31.743 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:31.743 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:31.743 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25750 2024-09-13T06:42:31.743 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.743 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:31.743 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.743 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:31.743 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443574+0000", 2024-09-13T06:42:31.743 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:31.743 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.743 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.743 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:31.743 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443574+0000", 2024-09-13T06:42:31.743 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:31.744 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.744 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.744 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:31.744 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443574+0000", 2024-09-13T06:42:31.744 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:31.744 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.744 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.744 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:31.744 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443576+0000", 2024-09-13T06:42:31.744 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6910000000000002e-06 2024-09-13T06:42:31.744 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.744 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.744 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:31.745 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443583+0000", 2024-09-13T06:42:31.745 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.331e-06 2024-09-13T06:42:31.745 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.745 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.745 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:31.745 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443587+0000", 2024-09-13T06:42:31.745 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6129999999999997e-06 2024-09-13T06:42:31.745 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.745 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.745 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:31.745 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533464+0000", 2024-09-13T06:42:31.745 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089876605999999998 2024-09-13T06:42:31.745 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.746 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.746 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:31.746 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533469+0000", 2024-09-13T06:42:31.746 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3909999999999997e-06 2024-09-13T06:42:31.746 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:31.746 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:31.746 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:31.746 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.746 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.746 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25751 3.8 3.63996268 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:42:31.746 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443592+0000", 2024-09-13T06:42:31.746 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 155.233444152, 2024-09-13T06:42:31.746 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089913650999999997, 2024-09-13T06:42:31.746 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:31.747 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:42:31.747 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:31.747 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:31.747 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:31.747 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25751 2024-09-13T06:42:31.747 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.747 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:31.747 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.747 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:31.747 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443592+0000", 2024-09-13T06:42:31.747 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:31.747 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.747 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.748 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:31.748 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443592+0000", 2024-09-13T06:42:31.748 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:31.748 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.748 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.748 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:31.748 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443591+0000", 2024-09-13T06:42:31.748 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:31.748 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.748 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.748 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:31.748 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443594+0000", 2024-09-13T06:42:31.748 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3649999999999998e-06 2024-09-13T06:42:31.748 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.749 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.749 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:31.749 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443599+0000", 2024-09-13T06:42:31.749 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.699e-06 2024-09-13T06:42:31.749 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.749 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.749 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:31.749 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443611+0000", 2024-09-13T06:42:31.749 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1503e-05 2024-09-13T06:42:31.749 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.749 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.749 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:31.749 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533497+0000", 2024-09-13T06:42:31.750 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089886453000000005 2024-09-13T06:42:31.750 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.750 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.750 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:31.750 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533505+0000", 2024-09-13T06:42:31.750 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.9910000000000002e-06 2024-09-13T06:42:31.750 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:31.750 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:31.750 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:31.750 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.750 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.750 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25752 3.8 3.63996268 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:42:31.750 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443615+0000", 2024-09-13T06:42:31.750 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 155.23342037099999, 2024-09-13T06:42:31.751 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089905868999999999, 2024-09-13T06:42:31.751 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:31.751 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:42:31.751 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:31.751 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:31.751 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:31.751 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25752 2024-09-13T06:42:31.751 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.751 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:31.751 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.751 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:31.751 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443615+0000", 2024-09-13T06:42:31.751 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:31.752 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.752 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.752 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:31.752 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443615+0000", 2024-09-13T06:42:31.752 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:31.752 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.752 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.752 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:31.752 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443615+0000", 2024-09-13T06:42:31.752 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:31.752 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.752 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.752 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:31.752 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443617+0000", 2024-09-13T06:42:31.753 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3539999999999998e-06 2024-09-13T06:42:31.753 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.753 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.753 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:31.753 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443624+0000", 2024-09-13T06:42:31.753 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3600000000000001e-06 2024-09-13T06:42:31.753 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.753 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.753 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:31.753 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443628+0000", 2024-09-13T06:42:31.753 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.2350000000000001e-06 2024-09-13T06:42:31.753 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.753 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.754 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:31.754 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533517+0000", 2024-09-13T06:42:31.754 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089889029999999995 2024-09-13T06:42:31.754 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.754 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.754 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:31.754 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533521+0000", 2024-09-13T06:42:31.754 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.2529999999999998e-06 2024-09-13T06:42:31.754 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:31.754 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:31.754 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:31.754 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.754 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.754 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25755 3.8 3.63996268 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:42:31.754 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.444692+0000", 2024-09-13T06:42:31.755 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 155.232343665, 2024-09-13T06:42:31.755 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.088904186999999996, 2024-09-13T06:42:31.755 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:31.755 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:42:31.755 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:31.755 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:31.755 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:31.755 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25755 2024-09-13T06:42:31.755 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.755 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:31.755 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.755 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:31.755 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.444692+0000", 2024-09-13T06:42:31.755 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:31.756 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.756 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.756 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:31.756 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.444692+0000", 2024-09-13T06:42:31.756 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:31.756 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.756 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.756 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:31.756 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.444692+0000", 2024-09-13T06:42:31.756 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:31.756 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.756 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.756 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:31.756 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.444694+0000", 2024-09-13T06:42:31.757 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.058e-06 2024-09-13T06:42:31.757 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.757 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.757 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:31.757 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.444700+0000", 2024-09-13T06:42:31.757 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7769999999999999e-06 2024-09-13T06:42:31.757 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.757 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.757 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:31.757 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.444704+0000", 2024-09-13T06:42:31.757 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6229999999999996e-06 2024-09-13T06:42:31.757 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.757 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.758 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:31.758 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533587+0000", 2024-09-13T06:42:31.758 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.088882744999999999 2024-09-13T06:42:31.758 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.758 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.758 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:31.758 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533596+0000", 2024-09-13T06:42:31.758 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.3270000000000007e-06 2024-09-13T06:42:31.758 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:31.758 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:31.758 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:31.758 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.758 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.759 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:64356 3.c 3:32785be9:::rbd_header.11218ba71f0d:head [watch reconnect cookie 140361410387072 gen 2] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e95)", 2024-09-13T06:42:31.759 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:48.473318+0000", 2024-09-13T06:42:31.759 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 103.203717978, 2024-09-13T06:42:31.759 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1458904379999999, 2024-09-13T06:42:31.759 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:31.759 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:31.759 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:31.759 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:31.759 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:31.759 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 64356 2024-09-13T06:42:31.759 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.759 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:31.759 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.760 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:31.760 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:48.473318+0000", 2024-09-13T06:42:31.760 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:31.760 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.760 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.760 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:31.760 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:48.473318+0000", 2024-09-13T06:42:31.760 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:31.760 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.760 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.760 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:31.760 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:48.473315+0000", 2024-09-13T06:42:31.760 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999971 2024-09-13T06:42:31.760 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.761 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.761 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:31.761 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:48.473329+0000", 2024-09-13T06:42:31.761 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.433e-05 2024-09-13T06:42:31.761 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.761 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.761 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:31.761 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:48.473363+0000", 2024-09-13T06:42:31.761 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.3592e-05 2024-09-13T06:42:31.761 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.761 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.761 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:31.761 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:48.473386+0000", 2024-09-13T06:42:31.761 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2708999999999999e-05 2024-09-13T06:42:31.761 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.762 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.762 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:31.762 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:48.473804+0000", 2024-09-13T06:42:31.762 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00041789399999999998 2024-09-13T06:42:31.762 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.762 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.762 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:42:31.762 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:48.473830+0000", 2024-09-13T06:42:31.762 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6869e-05 2024-09-13T06:42:31.762 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.762 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.762 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:31.762 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:49.614332+0000", 2024-09-13T06:42:31.762 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.140501107 2024-09-13T06:42:31.762 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.763 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.763 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for rw locks", 2024-09-13T06:42:31.763 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:49.614496+0000", 2024-09-13T06:42:31.763 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00016451200000000001 2024-09-13T06:42:31.763 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.763 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.763 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:31.763 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:49.617131+0000", 2024-09-13T06:42:31.763 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.002634843 2024-09-13T06:42:31.763 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.763 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.763 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:31.764 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:49.617204+0000", 2024-09-13T06:42:31.764 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.2991000000000006e-05 2024-09-13T06:42:31.764 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:31.764 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:31.764 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:31.764 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:49.619208+0000", 2024-09-13T06:42:31.764 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.002004381 2024-09-13T06:42:31.764 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:31.764 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:31.764 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:31.764 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:31.764 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:31.764 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:42:31.766 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-13T06:42:31.766 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:42:31.760+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:42:31.839 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 7, 5, 3, 4] out_osds: [6] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-13T06:42:31.839 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-13T06:42:31.839 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap_items 2024-09-13T06:42:31.839 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-09-13T06:42:31.886 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:42:31.884+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:42:31.902 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:42:31.902 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [], 2024-09-13T06:42:31.902 INFO:teuthology.orchestra.run.smithi139.stdout: "num_ops": 0 2024-09-13T06:42:31.902 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:42:31.917 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-13T06:42:31.967 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:42:31.961+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:42:32.037 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:42:32.037 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [], 2024-09-13T06:42:32.037 INFO:teuthology.orchestra.run.smithi139.stdout: "complaint_time": 30, 2024-09-13T06:42:32.037 INFO:teuthology.orchestra.run.smithi139.stdout: "num_blocked_ops": 0 2024-09-13T06:42:32.038 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:42:32.052 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-13T06:42:32.096 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-13T06:42:32.093+0000 7fa8bb18e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 36790) UID: 0 2024-09-13T06:42:32.135 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T06:42:32.135 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:42:32.135 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 191, 2024-09-13T06:42:32.135 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "e5612297-d004-4957-927e-afa37f30d6cf", 2024-09-13T06:42:32.135 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-09-13T06:38:56.670231+0000", 2024-09-13T06:42:32.136 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-09-13T06:42:31.384785+0000", 2024-09-13T06:42:32.136 INFO:teuthology.orchestra.run.smithi081.stdout: "last_up_change": "2024-09-13T06:42:27.540181+0000", 2024-09-13T06:42:32.136 INFO:teuthology.orchestra.run.smithi081.stdout: "last_in_change": "2024-09-13T06:42:16.419321+0000", 2024-09-13T06:42:32.136 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": "noscrub,nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-13T06:42:32.136 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_num": 5806080, 2024-09-13T06:42:32.136 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_set": [ 2024-09-13T06:42:32.136 INFO:teuthology.orchestra.run.smithi081.stdout: "nodeep-scrub", 2024-09-13T06:42:32.136 INFO:teuthology.orchestra.run.smithi081.stdout: "noscrub", 2024-09-13T06:42:32.136 INFO:teuthology.orchestra.run.smithi081.stdout: "pglog_hardlimit", 2024-09-13T06:42:32.136 INFO:teuthology.orchestra.run.smithi081.stdout: "purged_snapdirs", 2024-09-13T06:42:32.136 INFO:teuthology.orchestra.run.smithi081.stdout: "recovery_deletes", 2024-09-13T06:42:32.136 INFO:teuthology.orchestra.run.smithi081.stdout: "sortbitwise" 2024-09-13T06:42:32.136 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-13T06:42:32.136 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_version": 5, 2024-09-13T06:42:32.137 INFO:teuthology.orchestra.run.smithi081.stdout: "full_ratio": 0.94999998807907104, 2024-09-13T06:42:32.137 INFO:teuthology.orchestra.run.smithi081.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-09-13T06:42:32.137 INFO:teuthology.orchestra.run.smithi081.stdout: "nearfull_ratio": 0.85000002384185791, 2024-09-13T06:42:32.137 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_snapshot": "", 2024-09-13T06:42:32.137 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_max": 3, 2024-09-13T06:42:32.137 INFO:teuthology.orchestra.run.smithi081.stdout: "max_osd": 8, 2024-09-13T06:42:32.137 INFO:teuthology.orchestra.run.smithi081.stdout: "require_min_compat_client": "luminous", 2024-09-13T06:42:32.137 INFO:teuthology.orchestra.run.smithi081.stdout: "min_compat_client": "luminous", 2024-09-13T06:42:32.137 INFO:teuthology.orchestra.run.smithi081.stdout: "require_osd_release": "reef", 2024-09-13T06:42:32.137 INFO:teuthology.orchestra.run.smithi081.stdout: "allow_crimson": false, 2024-09-13T06:42:32.137 INFO:teuthology.orchestra.run.smithi081.stdout: "pools": [ 2024-09-13T06:42:32.137 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:32.137 INFO:teuthology.orchestra.run.smithi081.stdout: "pool": 1, 2024-09-13T06:42:32.138 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_name": ".mgr", 2024-09-13T06:42:32.138 INFO:teuthology.orchestra.run.smithi081.stdout: "create_time": "2024-09-13T06:39:09.600726+0000", 2024-09-13T06:42:32.138 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-13T06:42:32.138 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_names": "hashpspool", 2024-09-13T06:42:32.138 INFO:teuthology.orchestra.run.smithi081.stdout: "type": 1, 2024-09-13T06:42:32.138 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 2, 2024-09-13T06:42:32.138 INFO:teuthology.orchestra.run.smithi081.stdout: "min_size": 1, 2024-09-13T06:42:32.138 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_rule": 0, 2024-09-13T06:42:32.138 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_count": 0, 2024-09-13T06:42:32.138 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_target": 0, 2024-09-13T06:42:32.138 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_barrier": 0, 2024-09-13T06:42:32.138 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-13T06:42:32.138 INFO:teuthology.orchestra.run.smithi081.stdout: "object_hash": 2, 2024-09-13T06:42:32.139 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_mode": "off", 2024-09-13T06:42:32.139 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num": 1, 2024-09-13T06:42:32.139 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num": 1, 2024-09-13T06:42:32.139 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num_target": 1, 2024-09-13T06:42:32.139 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_target": 1, 2024-09-13T06:42:32.139 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_pending": 1, 2024-09-13T06:42:32.139 INFO:teuthology.orchestra.run.smithi081.stdout: "last_pg_merge_meta": { 2024-09-13T06:42:32.139 INFO:teuthology.orchestra.run.smithi081.stdout: "source_pgid": "0.0", 2024-09-13T06:42:32.139 INFO:teuthology.orchestra.run.smithi081.stdout: "ready_epoch": 0, 2024-09-13T06:42:32.139 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_started": 0, 2024-09-13T06:42:32.139 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_clean": 0, 2024-09-13T06:42:32.139 INFO:teuthology.orchestra.run.smithi081.stdout: "source_version": "0'0", 2024-09-13T06:42:32.139 INFO:teuthology.orchestra.run.smithi081.stdout: "target_version": "0'0" 2024-09-13T06:42:32.139 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:32.139 INFO:teuthology.orchestra.run.smithi081.stdout: "last_change": "16", 2024-09-13T06:42:32.140 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend": "0", 2024-09-13T06:42:32.140 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-13T06:42:32.140 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_preluminous": "0", 2024-09-13T06:42:32.140 INFO:teuthology.orchestra.run.smithi081.stdout: "auid": 0, 2024-09-13T06:42:32.140 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_mode": "selfmanaged", 2024-09-13T06:42:32.140 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_seq": 0, 2024-09-13T06:42:32.140 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_epoch": 0, 2024-09-13T06:42:32.140 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_snaps": [], 2024-09-13T06:42:32.140 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps": "[]", 2024-09-13T06:42:32.140 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_bytes": 0, 2024-09-13T06:42:32.140 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_objects": 0, 2024-09-13T06:42:32.140 INFO:teuthology.orchestra.run.smithi081.stdout: "tiers": [], 2024-09-13T06:42:32.140 INFO:teuthology.orchestra.run.smithi081.stdout: "tier_of": -1, 2024-09-13T06:42:32.140 INFO:teuthology.orchestra.run.smithi081.stdout: "read_tier": -1, 2024-09-13T06:42:32.141 INFO:teuthology.orchestra.run.smithi081.stdout: "write_tier": -1, 2024-09-13T06:42:32.141 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_mode": "none", 2024-09-13T06:42:32.141 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_bytes": 0, 2024-09-13T06:42:32.141 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_objects": 0, 2024-09-13T06:42:32.141 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-13T06:42:32.141 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-13T06:42:32.141 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-13T06:42:32.141 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_flush_age": 0, 2024-09-13T06:42:32.141 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_evict_age": 0, 2024-09-13T06:42:32.141 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profile": "", 2024-09-13T06:42:32.141 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_params": { 2024-09-13T06:42:32.141 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "none" 2024-09-13T06:42:32.141 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:32.142 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_period": 0, 2024-09-13T06:42:32.142 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_count": 0, 2024-09-13T06:42:32.142 INFO:teuthology.orchestra.run.smithi081.stdout: "use_gmt_hitset": true, 2024-09-13T06:42:32.142 INFO:teuthology.orchestra.run.smithi081.stdout: "min_read_recency_for_promote": 0, 2024-09-13T06:42:32.142 INFO:teuthology.orchestra.run.smithi081.stdout: "min_write_recency_for_promote": 0, 2024-09-13T06:42:32.142 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_grade_decay_rate": 0, 2024-09-13T06:42:32.142 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_search_last_n": 0, 2024-09-13T06:42:32.142 INFO:teuthology.orchestra.run.smithi081.stdout: "grade_table": [], 2024-09-13T06:42:32.142 INFO:teuthology.orchestra.run.smithi081.stdout: "stripe_width": 0, 2024-09-13T06:42:32.142 INFO:teuthology.orchestra.run.smithi081.stdout: "expected_num_objects": 0, 2024-09-13T06:42:32.142 INFO:teuthology.orchestra.run.smithi081.stdout: "fast_read": false, 2024-09-13T06:42:32.142 INFO:teuthology.orchestra.run.smithi081.stdout: "options": { 2024-09-13T06:42:32.142 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_max": 32, 2024-09-13T06:42:32.142 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_min": 1 2024-09-13T06:42:32.143 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:32.143 INFO:teuthology.orchestra.run.smithi081.stdout: "application_metadata": { 2024-09-13T06:42:32.143 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": {} 2024-09-13T06:42:32.143 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:32.143 INFO:teuthology.orchestra.run.smithi081.stdout: "read_balance": { 2024-09-13T06:42:32.143 INFO:teuthology.orchestra.run.smithi081.stdout: "score_acting": 6.9000000953674316, 2024-09-13T06:42:32.143 INFO:teuthology.orchestra.run.smithi081.stdout: "score_stable": 6.9000000953674316, 2024-09-13T06:42:32.143 INFO:teuthology.orchestra.run.smithi081.stdout: "optimal_score": 0.28999999165534973, 2024-09-13T06:42:32.143 INFO:teuthology.orchestra.run.smithi081.stdout: "raw_score_acting": 2, 2024-09-13T06:42:32.143 INFO:teuthology.orchestra.run.smithi081.stdout: "raw_score_stable": 2, 2024-09-13T06:42:32.143 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity_weighted": 0.70774269104003906, 2024-09-13T06:42:32.143 INFO:teuthology.orchestra.run.smithi081.stdout: "average_primary_affinity": 0.81000000238418579, 2024-09-13T06:42:32.143 INFO:teuthology.orchestra.run.smithi081.stdout: "average_primary_affinity_weighted": 0.70999997854232788 2024-09-13T06:42:32.143 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:32.144 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:32.144 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:32.144 INFO:teuthology.orchestra.run.smithi081.stdout: "pool": 2, 2024-09-13T06:42:32.144 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_name": "rbd", 2024-09-13T06:42:32.144 INFO:teuthology.orchestra.run.smithi081.stdout: "create_time": "2024-09-13T06:39:15.802118+0000", 2024-09-13T06:42:32.144 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 8193, 2024-09-13T06:42:32.144 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-13T06:42:32.144 INFO:teuthology.orchestra.run.smithi081.stdout: "type": 1, 2024-09-13T06:42:32.144 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 2, 2024-09-13T06:42:32.144 INFO:teuthology.orchestra.run.smithi081.stdout: "min_size": 1, 2024-09-13T06:42:32.144 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_rule": 0, 2024-09-13T06:42:32.144 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_count": 0, 2024-09-13T06:42:32.144 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_target": 0, 2024-09-13T06:42:32.144 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_barrier": 0, 2024-09-13T06:42:32.145 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-13T06:42:32.145 INFO:teuthology.orchestra.run.smithi081.stdout: "object_hash": 2, 2024-09-13T06:42:32.145 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_mode": "off", 2024-09-13T06:42:32.145 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num": 8, 2024-09-13T06:42:32.145 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num": 8, 2024-09-13T06:42:32.145 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num_target": 8, 2024-09-13T06:42:32.145 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_target": 8, 2024-09-13T06:42:32.145 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_pending": 8, 2024-09-13T06:42:32.145 INFO:teuthology.orchestra.run.smithi081.stdout: "last_pg_merge_meta": { 2024-09-13T06:42:32.145 INFO:teuthology.orchestra.run.smithi081.stdout: "source_pgid": "0.0", 2024-09-13T06:42:32.145 INFO:teuthology.orchestra.run.smithi081.stdout: "ready_epoch": 0, 2024-09-13T06:42:32.145 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_started": 0, 2024-09-13T06:42:32.145 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_clean": 0, 2024-09-13T06:42:32.145 INFO:teuthology.orchestra.run.smithi081.stdout: "source_version": "0'0", 2024-09-13T06:42:32.145 INFO:teuthology.orchestra.run.smithi081.stdout: "target_version": "0'0" 2024-09-13T06:42:32.146 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:32.146 INFO:teuthology.orchestra.run.smithi081.stdout: "last_change": "20", 2024-09-13T06:42:32.146 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend": "0", 2024-09-13T06:42:32.146 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-13T06:42:32.146 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_preluminous": "0", 2024-09-13T06:42:32.146 INFO:teuthology.orchestra.run.smithi081.stdout: "auid": 0, 2024-09-13T06:42:32.146 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_mode": "selfmanaged", 2024-09-13T06:42:32.146 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_seq": 3, 2024-09-13T06:42:32.146 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_epoch": 20, 2024-09-13T06:42:32.146 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_snaps": [], 2024-09-13T06:42:32.146 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps": "[]", 2024-09-13T06:42:32.146 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_bytes": 0, 2024-09-13T06:42:32.146 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_objects": 0, 2024-09-13T06:42:32.146 INFO:teuthology.orchestra.run.smithi081.stdout: "tiers": [], 2024-09-13T06:42:32.147 INFO:teuthology.orchestra.run.smithi081.stdout: "tier_of": -1, 2024-09-13T06:42:32.147 INFO:teuthology.orchestra.run.smithi081.stdout: "read_tier": -1, 2024-09-13T06:42:32.147 INFO:teuthology.orchestra.run.smithi081.stdout: "write_tier": -1, 2024-09-13T06:42:32.147 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_mode": "none", 2024-09-13T06:42:32.147 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_bytes": 0, 2024-09-13T06:42:32.147 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_objects": 0, 2024-09-13T06:42:32.147 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-13T06:42:32.147 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-13T06:42:32.147 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-13T06:42:32.147 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_flush_age": 0, 2024-09-13T06:42:32.147 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_evict_age": 0, 2024-09-13T06:42:32.147 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profile": "", 2024-09-13T06:42:32.147 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_params": { 2024-09-13T06:42:32.147 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "none" 2024-09-13T06:42:32.147 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:32.147 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_period": 0, 2024-09-13T06:42:32.148 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_count": 0, 2024-09-13T06:42:32.148 INFO:teuthology.orchestra.run.smithi081.stdout: "use_gmt_hitset": true, 2024-09-13T06:42:32.148 INFO:teuthology.orchestra.run.smithi081.stdout: "min_read_recency_for_promote": 0, 2024-09-13T06:42:32.148 INFO:teuthology.orchestra.run.smithi081.stdout: "min_write_recency_for_promote": 0, 2024-09-13T06:42:32.148 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_grade_decay_rate": 0, 2024-09-13T06:42:32.148 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_search_last_n": 0, 2024-09-13T06:42:32.148 INFO:teuthology.orchestra.run.smithi081.stdout: "grade_table": [], 2024-09-13T06:42:32.148 INFO:teuthology.orchestra.run.smithi081.stdout: "stripe_width": 0, 2024-09-13T06:42:32.148 INFO:teuthology.orchestra.run.smithi081.stdout: "expected_num_objects": 0, 2024-09-13T06:42:32.148 INFO:teuthology.orchestra.run.smithi081.stdout: "fast_read": false, 2024-09-13T06:42:32.148 INFO:teuthology.orchestra.run.smithi081.stdout: "options": {}, 2024-09-13T06:42:32.148 INFO:teuthology.orchestra.run.smithi081.stdout: "application_metadata": { 2024-09-13T06:42:32.148 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd": {} 2024-09-13T06:42:32.148 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:32.148 INFO:teuthology.orchestra.run.smithi081.stdout: "read_balance": { 2024-09-13T06:42:32.149 INFO:teuthology.orchestra.run.smithi081.stdout: "score_acting": 2.630000114440918, 2024-09-13T06:42:32.149 INFO:teuthology.orchestra.run.smithi081.stdout: "score_stable": 2.630000114440918, 2024-09-13T06:42:32.149 INFO:teuthology.orchestra.run.smithi081.stdout: "optimal_score": 1, 2024-09-13T06:42:32.149 INFO:teuthology.orchestra.run.smithi081.stdout: "raw_score_acting": 2.630000114440918, 2024-09-13T06:42:32.149 INFO:teuthology.orchestra.run.smithi081.stdout: "raw_score_stable": 2.630000114440918, 2024-09-13T06:42:32.149 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity_weighted": 0.70774269104003906, 2024-09-13T06:42:32.149 INFO:teuthology.orchestra.run.smithi081.stdout: "average_primary_affinity": 0.81000000238418579, 2024-09-13T06:42:32.149 INFO:teuthology.orchestra.run.smithi081.stdout: "average_primary_affinity_weighted": 0.70999997854232788 2024-09-13T06:42:32.149 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:32.149 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:32.149 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:32.149 INFO:teuthology.orchestra.run.smithi081.stdout: "pool": 3, 2024-09-13T06:42:32.149 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_name": "pool_client.0", 2024-09-13T06:42:32.149 INFO:teuthology.orchestra.run.smithi081.stdout: "create_time": "2024-09-13T06:39:25.648942+0000", 2024-09-13T06:42:32.149 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 8193, 2024-09-13T06:42:32.149 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-13T06:42:32.150 INFO:teuthology.orchestra.run.smithi081.stdout: "type": 1, 2024-09-13T06:42:32.150 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 2, 2024-09-13T06:42:32.150 INFO:teuthology.orchestra.run.smithi081.stdout: "min_size": 1, 2024-09-13T06:42:32.150 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_rule": 0, 2024-09-13T06:42:32.150 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_count": 0, 2024-09-13T06:42:32.150 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_target": 0, 2024-09-13T06:42:32.150 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_barrier": 0, 2024-09-13T06:42:32.150 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-13T06:42:32.150 INFO:teuthology.orchestra.run.smithi081.stdout: "object_hash": 2, 2024-09-13T06:42:32.150 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_mode": "off", 2024-09-13T06:42:32.150 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num": 32, 2024-09-13T06:42:32.150 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num": 32, 2024-09-13T06:42:32.150 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num_target": 32, 2024-09-13T06:42:32.150 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_target": 32, 2024-09-13T06:42:32.151 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_pending": 32, 2024-09-13T06:42:32.151 INFO:teuthology.orchestra.run.smithi081.stdout: "last_pg_merge_meta": { 2024-09-13T06:42:32.151 INFO:teuthology.orchestra.run.smithi081.stdout: "source_pgid": "0.0", 2024-09-13T06:42:32.151 INFO:teuthology.orchestra.run.smithi081.stdout: "ready_epoch": 0, 2024-09-13T06:42:32.151 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_started": 0, 2024-09-13T06:42:32.151 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_clean": 0, 2024-09-13T06:42:32.151 INFO:teuthology.orchestra.run.smithi081.stdout: "source_version": "0'0", 2024-09-13T06:42:32.151 INFO:teuthology.orchestra.run.smithi081.stdout: "target_version": "0'0" 2024-09-13T06:42:32.151 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:32.151 INFO:teuthology.orchestra.run.smithi081.stdout: "last_change": "190", 2024-09-13T06:42:32.151 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend": "0", 2024-09-13T06:42:32.151 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-13T06:42:32.151 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_preluminous": "0", 2024-09-13T06:42:32.151 INFO:teuthology.orchestra.run.smithi081.stdout: "auid": 0, 2024-09-13T06:42:32.151 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_mode": "selfmanaged", 2024-09-13T06:42:32.152 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_seq": 109, 2024-09-13T06:42:32.152 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_epoch": 190, 2024-09-13T06:42:32.152 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_snaps": [], 2024-09-13T06:42:32.152 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps": "[]", 2024-09-13T06:42:32.152 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_bytes": 0, 2024-09-13T06:42:32.152 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_objects": 0, 2024-09-13T06:42:32.152 INFO:teuthology.orchestra.run.smithi081.stdout: "tiers": [], 2024-09-13T06:42:32.152 INFO:teuthology.orchestra.run.smithi081.stdout: "tier_of": -1, 2024-09-13T06:42:32.152 INFO:teuthology.orchestra.run.smithi081.stdout: "read_tier": -1, 2024-09-13T06:42:32.152 INFO:teuthology.orchestra.run.smithi081.stdout: "write_tier": -1, 2024-09-13T06:42:32.152 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_mode": "none", 2024-09-13T06:42:32.152 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_bytes": 0, 2024-09-13T06:42:32.152 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_objects": 0, 2024-09-13T06:42:32.152 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-13T06:42:32.152 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-13T06:42:32.153 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-13T06:42:32.153 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_flush_age": 0, 2024-09-13T06:42:32.153 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_evict_age": 0, 2024-09-13T06:42:32.153 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profile": "", 2024-09-13T06:42:32.153 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_params": { 2024-09-13T06:42:32.153 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "none" 2024-09-13T06:42:32.153 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:32.153 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_period": 0, 2024-09-13T06:42:32.153 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_count": 0, 2024-09-13T06:42:32.153 INFO:teuthology.orchestra.run.smithi081.stdout: "use_gmt_hitset": true, 2024-09-13T06:42:32.153 INFO:teuthology.orchestra.run.smithi081.stdout: "min_read_recency_for_promote": 0, 2024-09-13T06:42:32.153 INFO:teuthology.orchestra.run.smithi081.stdout: "min_write_recency_for_promote": 0, 2024-09-13T06:42:32.154 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_grade_decay_rate": 0, 2024-09-13T06:42:32.154 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_search_last_n": 0, 2024-09-13T06:42:32.154 INFO:teuthology.orchestra.run.smithi081.stdout: "grade_table": [], 2024-09-13T06:42:32.154 INFO:teuthology.orchestra.run.smithi081.stdout: "stripe_width": 0, 2024-09-13T06:42:32.154 INFO:teuthology.orchestra.run.smithi081.stdout: "expected_num_objects": 0, 2024-09-13T06:42:32.154 INFO:teuthology.orchestra.run.smithi081.stdout: "fast_read": false, 2024-09-13T06:42:32.154 INFO:teuthology.orchestra.run.smithi081.stdout: "options": {}, 2024-09-13T06:42:32.154 INFO:teuthology.orchestra.run.smithi081.stdout: "application_metadata": { 2024-09-13T06:42:32.154 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd": {} 2024-09-13T06:42:32.154 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:32.154 INFO:teuthology.orchestra.run.smithi081.stdout: "read_balance": { 2024-09-13T06:42:32.154 INFO:teuthology.orchestra.run.smithi081.stdout: "score_acting": 8.0900001525878906, 2024-09-13T06:42:32.154 INFO:teuthology.orchestra.run.smithi081.stdout: "score_stable": 1.9700000286102295, 2024-09-13T06:42:32.155 INFO:teuthology.orchestra.run.smithi081.stdout: "optimal_score": 1, 2024-09-13T06:42:32.155 INFO:teuthology.orchestra.run.smithi081.stdout: "raw_score_acting": 8.0900001525878906, 2024-09-13T06:42:32.155 INFO:teuthology.orchestra.run.smithi081.stdout: "raw_score_stable": 1.9700000286102295, 2024-09-13T06:42:32.155 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity_weighted": 0.70774269104003906, 2024-09-13T06:42:32.155 INFO:teuthology.orchestra.run.smithi081.stdout: "average_primary_affinity": 0.81000000238418579, 2024-09-13T06:42:32.155 INFO:teuthology.orchestra.run.smithi081.stdout: "average_primary_affinity_weighted": 0.70999997854232788, 2024-09-13T06:42:32.155 INFO:teuthology.orchestra.run.smithi081.stdout: "error_message": "pool 3 has acting primaries on OSD(s) with primary affinity 0, read balance score is not accurate" 2024-09-13T06:42:32.155 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:32.155 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:32.155 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-13T06:42:32.155 INFO:teuthology.orchestra.run.smithi081.stdout: "osds": [ 2024-09-13T06:42:32.155 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:32.155 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 0, 2024-09-13T06:42:32.155 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "54b0a3e4-58ad-4f95-86dc-29a11c9a1964", 2024-09-13T06:42:32.156 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2024-09-13T06:42:32.156 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2024-09-13T06:42:32.156 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2024-09-13T06:42:32.156 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 0, 2024-09-13T06:42:32.156 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2024-09-13T06:42:32.156 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2024-09-13T06:42:32.156 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2024-09-13T06:42:32.156 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 189, 2024-09-13T06:42:32.156 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2024-09-13T06:42:32.156 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2024-09-13T06:42:32.156 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-13T06:42:32.156 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:42:32.156 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:32.156 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:42:32.157 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6808", 2024-09-13T06:42:32.157 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 1904727940 2024-09-13T06:42:32.157 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:32.157 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:32.157 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:42:32.157 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6809", 2024-09-13T06:42:32.157 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 1904727940 2024-09-13T06:42:32.157 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:32.157 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:32.157 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:32.157 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2024-09-13T06:42:32.157 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:42:32.157 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:32.157 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:42:32.157 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6810", 2024-09-13T06:42:32.158 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 1904727940 2024-09-13T06:42:32.158 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:32.158 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:32.158 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:42:32.158 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6811", 2024-09-13T06:42:32.158 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 1904727940 2024-09-13T06:42:32.158 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:32.158 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:32.158 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:32.158 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2024-09-13T06:42:32.158 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:42:32.158 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:32.158 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:42:32.158 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6814", 2024-09-13T06:42:32.158 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 1904727940 2024-09-13T06:42:32.159 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:32.159 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:32.159 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:42:32.159 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6815", 2024-09-13T06:42:32.159 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 1904727940 2024-09-13T06:42:32.159 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:32.159 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:32.159 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:32.159 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2024-09-13T06:42:32.159 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:42:32.159 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:32.159 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:42:32.159 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6812", 2024-09-13T06:42:32.159 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 1904727940 2024-09-13T06:42:32.159 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:32.160 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:32.160 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:42:32.160 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6813", 2024-09-13T06:42:32.160 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 1904727940 2024-09-13T06:42:32.160 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:32.160 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:32.160 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:32.160 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6809/1904727940", 2024-09-13T06:42:32.160 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.81:6811/1904727940", 2024-09-13T06:42:32.160 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.81:6815/1904727940", 2024-09-13T06:42:32.160 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.81:6813/1904727940", 2024-09-13T06:42:32.160 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2024-09-13T06:42:32.160 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2024-09-13T06:42:32.160 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2024-09-13T06:42:32.160 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:32.161 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:32.161 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:32.161 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 1, 2024-09-13T06:42:32.161 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "a6dba5b9-c833-465e-a8a5-1741528b24c0", 2024-09-13T06:42:32.161 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2024-09-13T06:42:32.161 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2024-09-13T06:42:32.161 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2024-09-13T06:42:32.161 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2024-09-13T06:42:32.161 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2024-09-13T06:42:32.161 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2024-09-13T06:42:32.161 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2024-09-13T06:42:32.161 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 189, 2024-09-13T06:42:32.161 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2024-09-13T06:42:32.162 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2024-09-13T06:42:32.162 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-13T06:42:32.162 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:42:32.162 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:32.162 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:42:32.162 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6817", 2024-09-13T06:42:32.162 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 738205570 2024-09-13T06:42:32.162 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:32.162 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:32.162 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:42:32.162 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6819", 2024-09-13T06:42:32.162 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 738205570 2024-09-13T06:42:32.162 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:32.163 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:32.163 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:32.163 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2024-09-13T06:42:32.163 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:42:32.163 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:32.163 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:42:32.163 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6822", 2024-09-13T06:42:32.163 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 738205570 2024-09-13T06:42:32.163 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:32.163 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:32.163 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:42:32.163 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6824", 2024-09-13T06:42:32.163 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 738205570 2024-09-13T06:42:32.164 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:32.164 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:32.164 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:32.164 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2024-09-13T06:42:32.164 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:42:32.164 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:32.164 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:42:32.164 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6830", 2024-09-13T06:42:32.164 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 738205570 2024-09-13T06:42:32.164 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:32.164 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:32.164 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:42:32.164 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6831", 2024-09-13T06:42:32.164 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 738205570 2024-09-13T06:42:32.164 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:32.165 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:32.165 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:32.165 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2024-09-13T06:42:32.165 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:42:32.165 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:32.165 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:42:32.165 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6826", 2024-09-13T06:42:32.165 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 738205570 2024-09-13T06:42:32.165 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:32.165 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:32.165 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:42:32.165 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6829", 2024-09-13T06:42:32.165 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 738205570 2024-09-13T06:42:32.166 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:32.166 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:32.166 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:32.166 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6819/738205570", 2024-09-13T06:42:32.166 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.81:6824/738205570", 2024-09-13T06:42:32.166 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.81:6831/738205570", 2024-09-13T06:42:32.166 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.81:6829/738205570", 2024-09-13T06:42:32.166 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2024-09-13T06:42:32.166 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2024-09-13T06:42:32.166 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2024-09-13T06:42:32.166 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:32.166 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:32.166 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:32.166 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 2, 2024-09-13T06:42:32.167 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "6c45097e-44a2-454f-80a4-0fe879ccd52f", 2024-09-13T06:42:32.167 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2024-09-13T06:42:32.167 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2024-09-13T06:42:32.167 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2024-09-13T06:42:32.167 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2024-09-13T06:42:32.167 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2024-09-13T06:42:32.167 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2024-09-13T06:42:32.167 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2024-09-13T06:42:32.167 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 190, 2024-09-13T06:42:32.167 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2024-09-13T06:42:32.167 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2024-09-13T06:42:32.167 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-13T06:42:32.167 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:42:32.167 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:32.167 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:42:32.168 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6816", 2024-09-13T06:42:32.168 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 3558674335 2024-09-13T06:42:32.168 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:32.168 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:32.168 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:42:32.168 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6818", 2024-09-13T06:42:32.168 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 3558674335 2024-09-13T06:42:32.168 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:32.168 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:32.168 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:32.168 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2024-09-13T06:42:32.168 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:42:32.168 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:32.168 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:42:32.168 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6820", 2024-09-13T06:42:32.169 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 3558674335 2024-09-13T06:42:32.169 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:32.169 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:32.169 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:42:32.169 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6821", 2024-09-13T06:42:32.169 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 3558674335 2024-09-13T06:42:32.169 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:32.169 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:32.169 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:32.169 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2024-09-13T06:42:32.169 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:42:32.169 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:32.169 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:42:32.169 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6827", 2024-09-13T06:42:32.169 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 3558674335 2024-09-13T06:42:32.170 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:32.170 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:32.170 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:42:32.170 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6828", 2024-09-13T06:42:32.170 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 3558674335 2024-09-13T06:42:32.170 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:32.170 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:32.170 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:32.170 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2024-09-13T06:42:32.170 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:42:32.170 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:32.170 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:42:32.170 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6823", 2024-09-13T06:42:32.170 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 3558674335 2024-09-13T06:42:32.170 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:32.170 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:32.171 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:42:32.171 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6825", 2024-09-13T06:42:32.171 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 3558674335 2024-09-13T06:42:32.171 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:32.171 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:32.171 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:32.171 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6818/3558674335", 2024-09-13T06:42:32.171 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.81:6821/3558674335", 2024-09-13T06:42:32.171 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.81:6828/3558674335", 2024-09-13T06:42:32.171 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.81:6825/3558674335", 2024-09-13T06:42:32.171 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2024-09-13T06:42:32.171 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2024-09-13T06:42:32.171 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2024-09-13T06:42:32.171 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:32.171 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:32.172 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:32.172 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 3, 2024-09-13T06:42:32.172 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "31952760-06f3-4618-a5c4-f5c4fed3aadb", 2024-09-13T06:42:32.172 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2024-09-13T06:42:32.172 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2024-09-13T06:42:32.172 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2024-09-13T06:42:32.172 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2024-09-13T06:42:32.172 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2024-09-13T06:42:32.172 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2024-09-13T06:42:32.172 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2024-09-13T06:42:32.172 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 190, 2024-09-13T06:42:32.172 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2024-09-13T06:42:32.172 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2024-09-13T06:42:32.173 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-13T06:42:32.173 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:42:32.173 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:32.173 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:42:32.173 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6800", 2024-09-13T06:42:32.173 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 1886327229 2024-09-13T06:42:32.173 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:32.173 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:32.173 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:42:32.173 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6801", 2024-09-13T06:42:32.173 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 1886327229 2024-09-13T06:42:32.173 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:32.173 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:32.173 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:32.174 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2024-09-13T06:42:32.174 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:42:32.174 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:32.174 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:42:32.174 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6802", 2024-09-13T06:42:32.174 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 1886327229 2024-09-13T06:42:32.174 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:32.174 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:32.174 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:42:32.174 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6803", 2024-09-13T06:42:32.174 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 1886327229 2024-09-13T06:42:32.174 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:32.174 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:32.174 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:32.174 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2024-09-13T06:42:32.174 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:42:32.175 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:32.175 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:42:32.175 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6806", 2024-09-13T06:42:32.175 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 1886327229 2024-09-13T06:42:32.175 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:32.175 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:32.175 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:42:32.175 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6807", 2024-09-13T06:42:32.175 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 1886327229 2024-09-13T06:42:32.175 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:32.175 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:32.175 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:32.175 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2024-09-13T06:42:32.175 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:42:32.176 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:32.176 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:42:32.176 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6804", 2024-09-13T06:42:32.176 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 1886327229 2024-09-13T06:42:32.176 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:32.176 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:32.176 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:42:32.176 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6805", 2024-09-13T06:42:32.176 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 1886327229 2024-09-13T06:42:32.176 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:32.176 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:32.176 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:32.176 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6801/1886327229", 2024-09-13T06:42:32.176 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.81:6803/1886327229", 2024-09-13T06:42:32.176 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.81:6807/1886327229", 2024-09-13T06:42:32.177 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.81:6805/1886327229", 2024-09-13T06:42:32.177 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2024-09-13T06:42:32.177 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2024-09-13T06:42:32.177 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2024-09-13T06:42:32.177 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:32.177 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:32.177 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:32.177 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 4, 2024-09-13T06:42:32.177 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "c9bd2751-c836-43dc-b844-e13678cb2fd9", 2024-09-13T06:42:32.177 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2024-09-13T06:42:32.177 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2024-09-13T06:42:32.177 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0.58685302734375, 2024-09-13T06:42:32.177 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2024-09-13T06:42:32.177 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2024-09-13T06:42:32.177 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2024-09-13T06:42:32.178 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2024-09-13T06:42:32.178 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 190, 2024-09-13T06:42:32.178 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2024-09-13T06:42:32.178 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2024-09-13T06:42:32.178 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-13T06:42:32.178 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:42:32.178 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:32.178 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:42:32.178 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6817", 2024-09-13T06:42:32.178 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2184515621 2024-09-13T06:42:32.178 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:32.178 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:32.178 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:42:32.179 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6819", 2024-09-13T06:42:32.179 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2184515621 2024-09-13T06:42:32.179 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:32.179 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:32.179 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:32.179 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2024-09-13T06:42:32.179 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:42:32.179 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:32.179 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:42:32.179 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6820", 2024-09-13T06:42:32.179 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2184515621 2024-09-13T06:42:32.179 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:32.179 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:32.179 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:42:32.179 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6822", 2024-09-13T06:42:32.179 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2184515621 2024-09-13T06:42:32.180 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:32.180 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:32.180 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:32.180 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2024-09-13T06:42:32.180 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:42:32.180 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:32.180 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:42:32.180 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6827", 2024-09-13T06:42:32.180 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2184515621 2024-09-13T06:42:32.180 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:32.180 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:32.180 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:42:32.180 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6829", 2024-09-13T06:42:32.180 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2184515621 2024-09-13T06:42:32.181 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:32.181 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:32.181 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:32.181 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2024-09-13T06:42:32.181 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:42:32.181 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:32.181 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:42:32.181 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6824", 2024-09-13T06:42:32.181 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2184515621 2024-09-13T06:42:32.181 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:32.181 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:32.181 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:42:32.181 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6826", 2024-09-13T06:42:32.181 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2184515621 2024-09-13T06:42:32.181 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:32.181 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:32.182 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:32.182 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.139:6819/2184515621", 2024-09-13T06:42:32.182 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.139:6822/2184515621", 2024-09-13T06:42:32.182 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.139:6829/2184515621", 2024-09-13T06:42:32.182 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.139:6826/2184515621", 2024-09-13T06:42:32.182 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2024-09-13T06:42:32.182 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2024-09-13T06:42:32.182 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2024-09-13T06:42:32.182 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:32.182 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:32.182 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:32.182 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 5, 2024-09-13T06:42:32.182 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "2971b93a-6c9f-4b77-b526-4eac788fabf9", 2024-09-13T06:42:32.182 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2024-09-13T06:42:32.182 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2024-09-13T06:42:32.183 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2024-09-13T06:42:32.183 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 0.115264892578125, 2024-09-13T06:42:32.183 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2024-09-13T06:42:32.183 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2024-09-13T06:42:32.183 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2024-09-13T06:42:32.183 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 190, 2024-09-13T06:42:32.183 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2024-09-13T06:42:32.183 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2024-09-13T06:42:32.183 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-13T06:42:32.183 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:42:32.183 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:32.183 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:42:32.183 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6816", 2024-09-13T06:42:32.183 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 3982901834 2024-09-13T06:42:32.184 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:32.184 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:32.184 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:42:32.184 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6818", 2024-09-13T06:42:32.184 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 3982901834 2024-09-13T06:42:32.184 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:32.184 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:32.184 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:32.184 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2024-09-13T06:42:32.184 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:42:32.184 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:32.184 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:42:32.184 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6821", 2024-09-13T06:42:32.184 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 3982901834 2024-09-13T06:42:32.184 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:32.185 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:32.185 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:42:32.185 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6823", 2024-09-13T06:42:32.185 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 3982901834 2024-09-13T06:42:32.185 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:32.185 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:32.185 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:32.185 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2024-09-13T06:42:32.185 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:42:32.185 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:32.185 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:42:32.185 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6830", 2024-09-13T06:42:32.185 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 3982901834 2024-09-13T06:42:32.186 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:32.186 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:32.186 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:42:32.186 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6831", 2024-09-13T06:42:32.186 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 3982901834 2024-09-13T06:42:32.186 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:32.186 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:32.186 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:32.186 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2024-09-13T06:42:32.186 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:42:32.186 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:32.186 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:42:32.186 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6825", 2024-09-13T06:42:32.186 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 3982901834 2024-09-13T06:42:32.186 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:32.186 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:32.187 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:42:32.187 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6828", 2024-09-13T06:42:32.187 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 3982901834 2024-09-13T06:42:32.187 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:32.187 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:32.187 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:32.187 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.139:6818/3982901834", 2024-09-13T06:42:32.187 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.139:6823/3982901834", 2024-09-13T06:42:32.187 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.139:6831/3982901834", 2024-09-13T06:42:32.187 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.139:6828/3982901834", 2024-09-13T06:42:32.187 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2024-09-13T06:42:32.187 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2024-09-13T06:42:32.187 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2024-09-13T06:42:32.187 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:32.187 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:32.188 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:32.188 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 6, 2024-09-13T06:42:32.188 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "e1f786ce-579e-48cc-b212-83f881b94184", 2024-09-13T06:42:32.188 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2024-09-13T06:42:32.188 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 0, 2024-09-13T06:42:32.188 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-13T06:42:32.188 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 0.5466766357421875, 2024-09-13T06:42:32.188 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2024-09-13T06:42:32.188 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2024-09-13T06:42:32.188 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2024-09-13T06:42:32.188 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 170, 2024-09-13T06:42:32.188 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2024-09-13T06:42:32.189 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2024-09-13T06:42:32.189 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-13T06:42:32.189 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:42:32.189 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:32.189 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:42:32.189 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6800", 2024-09-13T06:42:32.189 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2283932666 2024-09-13T06:42:32.189 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:32.189 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:32.189 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:42:32.189 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6801", 2024-09-13T06:42:32.189 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2283932666 2024-09-13T06:42:32.189 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:32.189 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:32.190 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:32.190 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2024-09-13T06:42:32.190 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:42:32.190 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:32.190 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:42:32.190 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6802", 2024-09-13T06:42:32.190 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2283932666 2024-09-13T06:42:32.190 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:32.190 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:32.190 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:42:32.190 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6803", 2024-09-13T06:42:32.190 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2283932666 2024-09-13T06:42:32.191 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:32.191 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:32.191 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:32.191 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2024-09-13T06:42:32.191 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:42:32.191 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:32.191 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:42:32.191 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6806", 2024-09-13T06:42:32.191 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2283932666 2024-09-13T06:42:32.191 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:32.191 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:32.191 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:42:32.191 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6807", 2024-09-13T06:42:32.191 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2283932666 2024-09-13T06:42:32.192 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:32.192 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:32.192 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:32.192 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2024-09-13T06:42:32.192 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:42:32.192 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:32.192 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:42:32.192 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6804", 2024-09-13T06:42:32.192 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2283932666 2024-09-13T06:42:32.192 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:32.192 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:32.192 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:42:32.192 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6805", 2024-09-13T06:42:32.192 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2283932666 2024-09-13T06:42:32.193 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:32.193 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:32.193 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:32.193 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.139:6801/2283932666", 2024-09-13T06:42:32.193 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.139:6803/2283932666", 2024-09-13T06:42:32.193 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.139:6807/2283932666", 2024-09-13T06:42:32.193 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.139:6805/2283932666", 2024-09-13T06:42:32.193 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2024-09-13T06:42:32.193 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2024-09-13T06:42:32.193 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2024-09-13T06:42:32.193 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:32.193 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:32.193 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:32.194 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 7, 2024-09-13T06:42:32.194 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "a287ddf6-84eb-4225-b267-25eee1657625", 2024-09-13T06:42:32.194 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2024-09-13T06:42:32.194 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2024-09-13T06:42:32.194 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2024-09-13T06:42:32.194 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2024-09-13T06:42:32.194 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 13, 2024-09-13T06:42:32.194 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 121, 2024-09-13T06:42:32.194 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 187, 2024-09-13T06:42:32.194 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 190, 2024-09-13T06:42:32.194 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 122, 2024-09-13T06:42:32.194 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2024-09-13T06:42:32.194 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-13T06:42:32.195 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:42:32.195 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:32.195 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:42:32.195 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6808", 2024-09-13T06:42:32.195 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 105054579 2024-09-13T06:42:32.195 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:32.195 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:32.195 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:42:32.195 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6809", 2024-09-13T06:42:32.195 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 105054579 2024-09-13T06:42:32.195 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:32.195 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:32.195 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:32.195 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2024-09-13T06:42:32.196 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:42:32.196 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:32.196 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:42:32.196 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6810", 2024-09-13T06:42:32.196 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 105054579 2024-09-13T06:42:32.196 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:32.196 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:32.196 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:42:32.196 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6811", 2024-09-13T06:42:32.196 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 105054579 2024-09-13T06:42:32.196 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:32.196 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:32.196 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:32.197 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2024-09-13T06:42:32.197 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:42:32.197 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:32.197 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:42:32.197 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6814", 2024-09-13T06:42:32.197 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 105054579 2024-09-13T06:42:32.197 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:32.197 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:32.197 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:42:32.197 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6815", 2024-09-13T06:42:32.197 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 105054579 2024-09-13T06:42:32.197 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:32.197 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:32.198 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:32.198 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2024-09-13T06:42:32.198 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:42:32.198 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:32.198 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:42:32.198 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6812", 2024-09-13T06:42:32.198 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 105054579 2024-09-13T06:42:32.198 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:32.198 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:32.198 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:42:32.198 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6813", 2024-09-13T06:42:32.198 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 105054579 2024-09-13T06:42:32.198 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:32.198 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:32.198 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:32.199 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.139:6809/105054579", 2024-09-13T06:42:32.199 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.139:6811/105054579", 2024-09-13T06:42:32.199 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.139:6815/105054579", 2024-09-13T06:42:32.199 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.139:6813/105054579", 2024-09-13T06:42:32.199 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2024-09-13T06:42:32.199 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2024-09-13T06:42:32.199 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2024-09-13T06:42:32.199 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:32.199 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:32.199 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-13T06:42:32.199 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_xinfo": [ 2024-09-13T06:42:32.199 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:32.199 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 0, 2024-09-13T06:42:32.199 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2024-09-13T06:42:32.200 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2024-09-13T06:42:32.200 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2024-09-13T06:42:32.200 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138322906710015, 2024-09-13T06:42:32.200 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2024-09-13T06:42:32.200 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2024-09-13T06:39:05.476871+0000", 2024-09-13T06:42:32.200 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2024-09-13T06:42:32.200 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:32.200 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:32.200 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 1, 2024-09-13T06:42:32.200 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2024-09-13T06:42:32.200 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2024-09-13T06:42:32.200 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2024-09-13T06:42:32.200 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138322906710015, 2024-09-13T06:42:32.200 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2024-09-13T06:42:32.200 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2024-09-13T06:39:05.455183+0000", 2024-09-13T06:42:32.201 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2024-09-13T06:42:32.201 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:32.201 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:32.201 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 2, 2024-09-13T06:42:32.201 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2024-09-13T06:42:32.201 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2024-09-13T06:42:32.201 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2024-09-13T06:42:32.201 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138322906710015, 2024-09-13T06:42:32.201 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2024-09-13T06:42:32.201 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2024-09-13T06:39:05.504853+0000", 2024-09-13T06:42:32.201 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2024-09-13T06:42:32.201 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:32.201 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:32.201 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 3, 2024-09-13T06:42:32.201 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2024-09-13T06:42:32.202 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2024-09-13T06:42:32.202 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2024-09-13T06:42:32.202 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138322906710015, 2024-09-13T06:42:32.202 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2024-09-13T06:42:32.202 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2024-09-13T06:39:05.372429+0000", 2024-09-13T06:42:32.202 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2024-09-13T06:42:32.202 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:32.202 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:32.202 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 4, 2024-09-13T06:42:32.202 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2024-09-13T06:42:32.202 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2024-09-13T06:42:32.202 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2024-09-13T06:42:32.202 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138322906710015, 2024-09-13T06:42:32.202 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2024-09-13T06:42:32.202 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2024-09-13T06:39:05.421023+0000", 2024-09-13T06:42:32.203 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2024-09-13T06:42:32.203 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:32.203 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:32.203 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 5, 2024-09-13T06:42:32.203 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2024-09-13T06:42:32.203 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2024-09-13T06:42:32.203 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2024-09-13T06:42:32.203 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138322906710015, 2024-09-13T06:42:32.203 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2024-09-13T06:42:32.203 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2024-09-13T06:39:05.477489+0000", 2024-09-13T06:42:32.203 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2024-09-13T06:42:32.203 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:32.203 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:32.204 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 6, 2024-09-13T06:42:32.204 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2024-09-13T06:42:32.204 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2024-09-13T06:42:32.204 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2024-09-13T06:42:32.204 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138322906710015, 2024-09-13T06:42:32.204 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 65536, 2024-09-13T06:42:32.204 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2024-09-13T06:39:05.314700+0000", 2024-09-13T06:42:32.204 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2024-09-13T06:42:32.204 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:32.204 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:32.204 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 7, 2024-09-13T06:42:32.204 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2024-09-13T06:42:32.204 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2024-09-13T06:42:32.204 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2024-09-13T06:42:32.204 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138322906710015, 2024-09-13T06:42:32.205 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2024-09-13T06:42:32.205 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2024-09-13T06:39:05.462229+0000", 2024-09-13T06:42:32.205 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 122 2024-09-13T06:42:32.205 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:32.205 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-13T06:42:32.205 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_upmap": [ 2024-09-13T06:42:32.205 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:32.205 INFO:teuthology.orchestra.run.smithi081.stdout: "pgid": "3.1a", 2024-09-13T06:42:32.205 INFO:teuthology.orchestra.run.smithi081.stdout: "osds": [ 2024-09-13T06:42:32.205 INFO:teuthology.orchestra.run.smithi081.stdout: 2, 2024-09-13T06:42:32.205 INFO:teuthology.orchestra.run.smithi081.stdout: 6 2024-09-13T06:42:32.205 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:32.205 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:32.205 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-13T06:42:32.205 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_upmap_items": [], 2024-09-13T06:42:32.205 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_upmap_primaries": [], 2024-09-13T06:42:32.206 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_temp": [ 2024-09-13T06:42:32.206 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:32.206 INFO:teuthology.orchestra.run.smithi081.stdout: "pgid": "3.f", 2024-09-13T06:42:32.206 INFO:teuthology.orchestra.run.smithi081.stdout: "osds": [ 2024-09-13T06:42:32.206 INFO:teuthology.orchestra.run.smithi081.stdout: 4 2024-09-13T06:42:32.206 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:32.206 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:32.206 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:32.206 INFO:teuthology.orchestra.run.smithi081.stdout: "pgid": "3.11", 2024-09-13T06:42:32.206 INFO:teuthology.orchestra.run.smithi081.stdout: "osds": [ 2024-09-13T06:42:32.206 INFO:teuthology.orchestra.run.smithi081.stdout: 4 2024-09-13T06:42:32.206 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:32.206 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:32.206 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:32.206 INFO:teuthology.orchestra.run.smithi081.stdout: "pgid": "3.15", 2024-09-13T06:42:32.207 INFO:teuthology.orchestra.run.smithi081.stdout: "osds": [ 2024-09-13T06:42:32.207 INFO:teuthology.orchestra.run.smithi081.stdout: 3 2024-09-13T06:42:32.207 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:32.207 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:32.207 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-13T06:42:32.207 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_temp": [], 2024-09-13T06:42:32.207 INFO:teuthology.orchestra.run.smithi081.stdout: "blocklist": {}, 2024-09-13T06:42:32.207 INFO:teuthology.orchestra.run.smithi081.stdout: "range_blocklist": {}, 2024-09-13T06:42:32.207 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profiles": { 2024-09-13T06:42:32.207 INFO:teuthology.orchestra.run.smithi081.stdout: "default": { 2024-09-13T06:42:32.207 INFO:teuthology.orchestra.run.smithi081.stdout: "crush-failure-domain": "osd", 2024-09-13T06:42:32.207 INFO:teuthology.orchestra.run.smithi081.stdout: "k": "2", 2024-09-13T06:42:32.207 INFO:teuthology.orchestra.run.smithi081.stdout: "m": "1", 2024-09-13T06:42:32.207 INFO:teuthology.orchestra.run.smithi081.stdout: "plugin": "jerasure", 2024-09-13T06:42:32.208 INFO:teuthology.orchestra.run.smithi081.stdout: "technique": "reed_sol_van" 2024-09-13T06:42:32.208 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:32.208 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:32.208 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps_queue": [ 2024-09-13T06:42:32.208 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:32.208 INFO:teuthology.orchestra.run.smithi081.stdout: "pool": 3, 2024-09-13T06:42:32.208 INFO:teuthology.orchestra.run.smithi081.stdout: "snaps": [ 2024-09-13T06:42:32.208 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:32.208 INFO:teuthology.orchestra.run.smithi081.stdout: "begin": 62, 2024-09-13T06:42:32.208 INFO:teuthology.orchestra.run.smithi081.stdout: "length": 1 2024-09-13T06:42:32.208 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:32.208 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:32.208 INFO:teuthology.orchestra.run.smithi081.stdout: "begin": 65, 2024-09-13T06:42:32.208 INFO:teuthology.orchestra.run.smithi081.stdout: "length": 1 2024-09-13T06:42:32.209 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:32.209 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:32.209 INFO:teuthology.orchestra.run.smithi081.stdout: "begin": 68, 2024-09-13T06:42:32.209 INFO:teuthology.orchestra.run.smithi081.stdout: "length": 1 2024-09-13T06:42:32.209 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:32.209 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:32.209 INFO:teuthology.orchestra.run.smithi081.stdout: "begin": 71, 2024-09-13T06:42:32.209 INFO:teuthology.orchestra.run.smithi081.stdout: "length": 1 2024-09-13T06:42:32.209 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:32.209 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:32.209 INFO:teuthology.orchestra.run.smithi081.stdout: "begin": 74, 2024-09-13T06:42:32.209 INFO:teuthology.orchestra.run.smithi081.stdout: "length": 1 2024-09-13T06:42:32.209 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:32.209 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:32.209 INFO:teuthology.orchestra.run.smithi081.stdout: "begin": 77, 2024-09-13T06:42:32.210 INFO:teuthology.orchestra.run.smithi081.stdout: "length": 1 2024-09-13T06:42:32.210 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:32.210 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:32.210 INFO:teuthology.orchestra.run.smithi081.stdout: "begin": 80, 2024-09-13T06:42:32.210 INFO:teuthology.orchestra.run.smithi081.stdout: "length": 1 2024-09-13T06:42:32.210 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:32.210 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:32.210 INFO:teuthology.orchestra.run.smithi081.stdout: "begin": 83, 2024-09-13T06:42:32.210 INFO:teuthology.orchestra.run.smithi081.stdout: "length": 1 2024-09-13T06:42:32.210 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:32.210 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:32.210 INFO:teuthology.orchestra.run.smithi081.stdout: "begin": 86, 2024-09-13T06:42:32.210 INFO:teuthology.orchestra.run.smithi081.stdout: "length": 1 2024-09-13T06:42:32.210 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:32.211 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:32.211 INFO:teuthology.orchestra.run.smithi081.stdout: "begin": 89, 2024-09-13T06:42:32.211 INFO:teuthology.orchestra.run.smithi081.stdout: "length": 1 2024-09-13T06:42:32.211 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:32.211 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:32.211 INFO:teuthology.orchestra.run.smithi081.stdout: "begin": 92, 2024-09-13T06:42:32.211 INFO:teuthology.orchestra.run.smithi081.stdout: "length": 1 2024-09-13T06:42:32.211 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:32.211 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:32.211 INFO:teuthology.orchestra.run.smithi081.stdout: "begin": 95, 2024-09-13T06:42:32.211 INFO:teuthology.orchestra.run.smithi081.stdout: "length": 1 2024-09-13T06:42:32.211 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:32.211 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:32.212 INFO:teuthology.orchestra.run.smithi081.stdout: "begin": 98, 2024-09-13T06:42:32.212 INFO:teuthology.orchestra.run.smithi081.stdout: "length": 1 2024-09-13T06:42:32.212 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:32.212 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:32.212 INFO:teuthology.orchestra.run.smithi081.stdout: "begin": 101, 2024-09-13T06:42:32.212 INFO:teuthology.orchestra.run.smithi081.stdout: "length": 1 2024-09-13T06:42:32.212 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:32.212 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:32.212 INFO:teuthology.orchestra.run.smithi081.stdout: "begin": 104, 2024-09-13T06:42:32.212 INFO:teuthology.orchestra.run.smithi081.stdout: "length": 1 2024-09-13T06:42:32.212 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:32.212 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:32.212 INFO:teuthology.orchestra.run.smithi081.stdout: "begin": 107, 2024-09-13T06:42:32.212 INFO:teuthology.orchestra.run.smithi081.stdout: "length": 1 2024-09-13T06:42:32.213 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:32.213 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:32.213 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:32.213 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-13T06:42:32.213 INFO:teuthology.orchestra.run.smithi081.stdout: "new_removed_snaps": [], 2024-09-13T06:42:32.213 INFO:teuthology.orchestra.run.smithi081.stdout: "new_purged_snaps": [], 2024-09-13T06:42:32.213 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_node_flags": {}, 2024-09-13T06:42:32.213 INFO:teuthology.orchestra.run.smithi081.stdout: "device_class_flags": {}, 2024-09-13T06:42:32.213 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": { 2024-09-13T06:42:32.213 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode_enabled": false, 2024-09-13T06:42:32.213 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_bucket_count": 0, 2024-09-13T06:42:32.213 INFO:teuthology.orchestra.run.smithi081.stdout: "degraded_stretch_mode": 0, 2024-09-13T06:42:32.214 INFO:teuthology.orchestra.run.smithi081.stdout: "recovering_stretch_mode": 0, 2024-09-13T06:42:32.214 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode_bucket": 0 2024-09-13T06:42:32.214 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:32.214 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:42:32.216 INFO:tasks.thrashosds.thrasher:j is {'epoch': 191, 'fsid': 'e5612297-d004-4957-927e-afa37f30d6cf', 'created': '2024-09-13T06:38:56.670231+0000', 'modified': '2024-09-13T06:42:31.384785+0000', 'last_up_change': '2024-09-13T06:42:27.540181+0000', 'last_in_change': '2024-09-13T06:42:16.419321+0000', 'flags': 'noscrub,nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5806080, 'flags_set': ['nodeep-scrub', 'noscrub', 'pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 5, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 3, 'max_osd': 8, 'require_min_compat_client': 'luminous', 'min_compat_client': 'luminous', 'require_osd_release': 'reef', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T06:39:09.600726+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 6.900000095367432, 'score_stable': 6.900000095367432, 'optimal_score': 0.28999999165534973, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 0.7077426910400391, 'average_primary_affinity': 0.8100000023841858, 'average_primary_affinity_weighted': 0.7099999785423279}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-09-13T06:39:15.802118+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 3, 'snap_epoch': 20, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2.630000114440918, 'score_stable': 2.630000114440918, 'optimal_score': 1, 'raw_score_acting': 2.630000114440918, 'raw_score_stable': 2.630000114440918, 'primary_affinity_weighted': 0.7077426910400391, 'average_primary_affinity': 0.8100000023841858, 'average_primary_affinity_weighted': 0.7099999785423279}}, {'pool': 3, 'pool_name': 'pool_client.0', 'create_time': '2024-09-13T06:39:25.648942+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '190', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 109, 'snap_epoch': 190, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 8.09000015258789, 'score_stable': 1.9700000286102295, 'optimal_score': 1, 'raw_score_acting': 8.09000015258789, 'raw_score_stable': 1.9700000286102295, 'primary_affinity_weighted': 0.7077426910400391, 'average_primary_affinity': 0.8100000023841858, 'average_primary_affinity_weighted': 0.7099999785423279, 'error_message': 'pool 3 has acting primaries on OSD(s) with primary affinity 0, read balance score is not accurate'}}], 'osds': [{'osd': 0, 'uuid': '54b0a3e4-58ad-4f95-86dc-29a11c9a1964', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 0, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 189, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6808', 'nonce': 1904727940}, {'type': 'v1', 'addr': '172.21.15.81:6809', 'nonce': 1904727940}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6810', 'nonce': 1904727940}, {'type': 'v1', 'addr': '172.21.15.81:6811', 'nonce': 1904727940}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6814', 'nonce': 1904727940}, {'type': 'v1', 'addr': '172.21.15.81:6815', 'nonce': 1904727940}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6812', 'nonce': 1904727940}, {'type': 'v1', 'addr': '172.21.15.81:6813', 'nonce': 1904727940}]}, 'public_addr': '172.21.15.81:6809/1904727940', 'cluster_addr': '172.21.15.81:6811/1904727940', 'heartbeat_back_addr': '172.21.15.81:6815/1904727940', 'heartbeat_front_addr': '172.21.15.81:6813/1904727940', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': 'a6dba5b9-c833-465e-a8a5-1741528b24c0', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 189, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6817', 'nonce': 738205570}, {'type': 'v1', 'addr': '172.21.15.81:6819', 'nonce': 738205570}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6822', 'nonce': 738205570}, {'type': 'v1', 'addr': '172.21.15.81:6824', 'nonce': 738205570}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6830', 'nonce': 738205570}, {'type': 'v1', 'addr': '172.21.15.81:6831', 'nonce': 738205570}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6826', 'nonce': 738205570}, {'type': 'v1', 'addr': '172.21.15.81:6829', 'nonce': 738205570}]}, 'public_addr': '172.21.15.81:6819/738205570', 'cluster_addr': '172.21.15.81:6824/738205570', 'heartbeat_back_addr': '172.21.15.81:6831/738205570', 'heartbeat_front_addr': '172.21.15.81:6829/738205570', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': '6c45097e-44a2-454f-80a4-0fe879ccd52f', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 190, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6816', 'nonce': 3558674335}, {'type': 'v1', 'addr': '172.21.15.81:6818', 'nonce': 3558674335}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6820', 'nonce': 3558674335}, {'type': 'v1', 'addr': '172.21.15.81:6821', 'nonce': 3558674335}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6827', 'nonce': 3558674335}, {'type': 'v1', 'addr': '172.21.15.81:6828', 'nonce': 3558674335}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6823', 'nonce': 3558674335}, {'type': 'v1', 'addr': '172.21.15.81:6825', 'nonce': 3558674335}]}, 'public_addr': '172.21.15.81:6818/3558674335', 'cluster_addr': '172.21.15.81:6821/3558674335', 'heartbeat_back_addr': '172.21.15.81:6828/3558674335', 'heartbeat_front_addr': '172.21.15.81:6825/3558674335', 'state': ['exists', 'up']}, {'osd': 3, 'uuid': '31952760-06f3-4618-a5c4-f5c4fed3aadb', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 190, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6800', 'nonce': 1886327229}, {'type': 'v1', 'addr': '172.21.15.81:6801', 'nonce': 1886327229}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6802', 'nonce': 1886327229}, {'type': 'v1', 'addr': '172.21.15.81:6803', 'nonce': 1886327229}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6806', 'nonce': 1886327229}, {'type': 'v1', 'addr': '172.21.15.81:6807', 'nonce': 1886327229}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6804', 'nonce': 1886327229}, {'type': 'v1', 'addr': '172.21.15.81:6805', 'nonce': 1886327229}]}, 'public_addr': '172.21.15.81:6801/1886327229', 'cluster_addr': '172.21.15.81:6803/1886327229', 'heartbeat_back_addr': '172.21.15.81:6807/1886327229', 'heartbeat_front_addr': '172.21.15.81:6805/1886327229', 'state': ['exists', 'up']}, {'osd': 4, 'uuid': 'c9bd2751-c836-43dc-b844-e13678cb2fd9', 'up': 1, 'in': 1, 'weight': 0.58685302734375, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 190, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.139:6817', 'nonce': 2184515621}, {'type': 'v1', 'addr': '172.21.15.139:6819', 'nonce': 2184515621}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.139:6820', 'nonce': 2184515621}, {'type': 'v1', 'addr': '172.21.15.139:6822', 'nonce': 2184515621}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.139:6827', 'nonce': 2184515621}, {'type': 'v1', 'addr': '172.21.15.139:6829', 'nonce': 2184515621}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.139:6824', 'nonce': 2184515621}, {'type': 'v1', 'addr': '172.21.15.139:6826', 'nonce': 2184515621}]}, 'public_addr': '172.21.15.139:6819/2184515621', 'cluster_addr': '172.21.15.139:6822/2184515621', 'heartbeat_back_addr': '172.21.15.139:6829/2184515621', 'heartbeat_front_addr': '172.21.15.139:6826/2184515621', 'state': ['exists', 'up']}, {'osd': 5, 'uuid': '2971b93a-6c9f-4b77-b526-4eac788fabf9', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 0.115264892578125, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 190, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.139:6816', 'nonce': 3982901834}, {'type': 'v1', 'addr': '172.21.15.139:6818', 'nonce': 3982901834}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.139:6821', 'nonce': 3982901834}, {'type': 'v1', 'addr': '172.21.15.139:6823', 'nonce': 3982901834}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.139:6830', 'nonce': 3982901834}, {'type': 'v1', 'addr': '172.21.15.139:6831', 'nonce': 3982901834}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.139:6825', 'nonce': 3982901834}, {'type': 'v1', 'addr': '172.21.15.139:6828', 'nonce': 3982901834}]}, 'public_addr': '172.21.15.139:6818/3982901834', 'cluster_addr': '172.21.15.139:6823/3982901834', 'heartbeat_back_addr': '172.21.15.139:6831/3982901834', 'heartbeat_front_addr': '172.21.15.139:6828/3982901834', 'state': ['exists', 'up']}, {'osd': 6, 'uuid': 'e1f786ce-579e-48cc-b212-83f881b94184', 'up': 1, 'in': 0, 'weight': 0, 'primary_affinity': 0.5466766357421875, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 170, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.139:6800', 'nonce': 2283932666}, {'type': 'v1', 'addr': '172.21.15.139:6801', 'nonce': 2283932666}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.139:6802', 'nonce': 2283932666}, {'type': 'v1', 'addr': '172.21.15.139:6803', 'nonce': 2283932666}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.139:6806', 'nonce': 2283932666}, {'type': 'v1', 'addr': '172.21.15.139:6807', 'nonce': 2283932666}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.139:6804', 'nonce': 2283932666}, {'type': 'v1', 'addr': '172.21.15.139:6805', 'nonce': 2283932666}]}, 'public_addr': '172.21.15.139:6801/2283932666', 'cluster_addr': '172.21.15.139:6803/2283932666', 'heartbeat_back_addr': '172.21.15.139:6807/2283932666', 'heartbeat_front_addr': '172.21.15.139:6805/2283932666', 'state': ['exists', 'up']}, {'osd': 7, 'uuid': 'a287ddf6-84eb-4225-b267-25eee1657625', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 13, 'last_clean_end': 121, 'up_from': 187, 'up_thru': 190, 'down_at': 122, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.139:6808', 'nonce': 105054579}, {'type': 'v1', 'addr': '172.21.15.139:6809', 'nonce': 105054579}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.139:6810', 'nonce': 105054579}, {'type': 'v1', 'addr': '172.21.15.139:6811', 'nonce': 105054579}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.139:6814', 'nonce': 105054579}, {'type': 'v1', 'addr': '172.21.15.139:6815', 'nonce': 105054579}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.139:6812', 'nonce': 105054579}, {'type': 'v1', 'addr': '172.21.15.139:6813', 'nonce': 105054579}]}, 'public_addr': '172.21.15.139:6809/105054579', 'cluster_addr': '172.21.15.139:6811/105054579', 'heartbeat_back_addr': '172.21.15.139:6815/105054579', 'heartbeat_front_addr': '172.21.15.139:6813/105054579', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-13T06:39:05.476871+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-13T06:39:05.455183+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-13T06:39:05.504853+0000', 'dead_epoch': 0}, {'osd': 3, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-13T06:39:05.372429+0000', 'dead_epoch': 0}, {'osd': 4, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-13T06:39:05.421023+0000', 'dead_epoch': 0}, {'osd': 5, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-13T06:39:05.477489+0000', 'dead_epoch': 0}, {'osd': 6, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 65536, 'last_purged_snaps_scrub': '2024-09-13T06:39:05.314700+0000', 'dead_epoch': 0}, {'osd': 7, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-13T06:39:05.462229+0000', 'dead_epoch': 122}], 'pg_upmap': [{'pgid': '3.1a', 'osds': [2, 6]}], 'pg_upmap_items': [], 'pg_upmap_primaries': [], 'pg_temp': [{'pgid': '3.f', 'osds': [4]}, {'pgid': '3.11', 'osds': [4]}, {'pgid': '3.15', 'osds': [3]}], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [{'pool': 3, 'snaps': [{'begin': 62, 'length': 1}, {'begin': 65, 'length': 1}, {'begin': 68, 'length': 1}, {'begin': 71, 'length': 1}, {'begin': 74, 'length': 1}, {'begin': 77, 'length': 1}, {'begin': 80, 'length': 1}, {'begin': 83, 'length': 1}, {'begin': 86, 'length': 1}, {'begin': 89, 'length': 1}, {'begin': 92, 'length': 1}, {'begin': 95, 'length': 1}, {'begin': 98, 'length': 1}, {'begin': 101, 'length': 1}, {'begin': 104, 'length': 1}, {'begin': 107, 'length': 1}]}], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-09-13T06:42:32.216 INFO:tasks.thrashosds.thrasher:No pg_upmap entries; doing nothing 2024-09-13T06:42:32.216 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:42:32.212+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:42:32.219 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:42:32.219 INFO:teuthology.orchestra.run.smithi139.stdout: "size": 20, 2024-09-13T06:42:32.219 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 600, 2024-09-13T06:42:32.219 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [ 2024-09-13T06:42:32.219 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:32.220 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18706 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 3346432~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:42:32.220 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.846138+0000", 2024-09-13T06:42:32.220 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 160.37091405000001, 2024-09-13T06:42:32.220 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.102018712, 2024-09-13T06:42:32.220 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:32.220 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:32.220 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:32.220 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:32.220 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:32.220 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18706 2024-09-13T06:42:32.220 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:32.220 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:32.220 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:32.221 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:32.221 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846138+0000", 2024-09-13T06:42:32.221 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:32.221 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:32.221 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:32.221 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:32.221 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846138+0000", 2024-09-13T06:42:32.221 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:32.221 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:32.221 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:32.221 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:32.221 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846138+0000", 2024-09-13T06:42:32.221 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:32.221 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:32.221 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:32.222 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:32.222 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846141+0000", 2024-09-13T06:42:32.222 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.6969999999999999e-06 2024-09-13T06:42:32.222 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:32.222 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:32.222 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:32.222 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846150+0000", 2024-09-13T06:42:32.222 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6400000000000003e-06 2024-09-13T06:42:32.222 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:32.222 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:32.222 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:32.222 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846160+0000", 2024-09-13T06:42:32.222 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.3999999999999998e-06 2024-09-13T06:42:32.223 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:32.223 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:32.223 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:32.223 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.947764+0000", 2024-09-13T06:42:32.223 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101604085 2024-09-13T06:42:32.223 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:32.223 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:32.223 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:32.223 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.947888+0000", 2024-09-13T06:42:32.223 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000124113 2024-09-13T06:42:32.223 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:32.223 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:32.223 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:32.224 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.948157+0000", 2024-09-13T06:42:32.224 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00026943399999999998 2024-09-13T06:42:32.224 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:32.224 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:32.224 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:32.224 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:32.224 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:32.224 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18707 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 3375104~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:42:32.224 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.846207+0000", 2024-09-13T06:42:32.224 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 160.37084528400001, 2024-09-13T06:42:32.224 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10238114099999999, 2024-09-13T06:42:32.224 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:32.224 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:32.224 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:32.225 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:32.225 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:32.225 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18707 2024-09-13T06:42:32.225 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:32.225 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:32.225 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:32.225 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:32.225 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846207+0000", 2024-09-13T06:42:32.225 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:32.225 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:32.225 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:32.226 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:32.226 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846207+0000", 2024-09-13T06:42:32.226 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:32.226 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:32.226 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:32.226 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:32.226 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846206+0000", 2024-09-13T06:42:32.226 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:42:32.226 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:32.226 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:32.226 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:32.226 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846211+0000", 2024-09-13T06:42:32.226 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.3000000000000003e-06 2024-09-13T06:42:32.227 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:32.227 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:32.227 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:32.227 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846220+0000", 2024-09-13T06:42:32.227 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6199999999999994e-06 2024-09-13T06:42:32.227 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:32.227 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:32.227 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:32.227 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846228+0000", 2024-09-13T06:42:32.227 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.7500000000000003e-06 2024-09-13T06:42:32.227 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:32.227 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:32.228 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:32.228 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.948267+0000", 2024-09-13T06:42:32.228 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10203878700000001 2024-09-13T06:42:32.228 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:32.228 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:32.228 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:32.228 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.948435+0000", 2024-09-13T06:42:32.228 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00016796500000000001 2024-09-13T06:42:32.228 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:32.228 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:32.228 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:32.228 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.948588+0000", 2024-09-13T06:42:32.228 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00015373599999999999 2024-09-13T06:42:32.228 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:32.229 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:32.229 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:32.229 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:32.229 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:32.229 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18718 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 3690496~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:42:32.229 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.850174+0000", 2024-09-13T06:42:32.229 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 160.36687813099999, 2024-09-13T06:42:32.229 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101854154, 2024-09-13T06:42:32.229 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:32.229 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:32.229 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:32.229 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:32.229 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:32.230 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18718 2024-09-13T06:42:32.230 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:32.230 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:32.230 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:32.230 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:32.230 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850174+0000", 2024-09-13T06:42:32.230 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:32.230 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:32.230 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:32.230 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:32.230 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850174+0000", 2024-09-13T06:42:32.230 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:32.230 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:32.230 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:32.231 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:32.231 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850173+0000", 2024-09-13T06:42:32.231 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:42:32.231 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:32.231 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:32.231 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:32.231 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850178+0000", 2024-09-13T06:42:32.231 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.4129999999999999e-06 2024-09-13T06:42:32.231 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:32.231 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:32.231 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:32.231 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850188+0000", 2024-09-13T06:42:32.231 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.8600000000000005e-06 2024-09-13T06:42:32.231 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:32.231 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:32.232 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:32.232 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850195+0000", 2024-09-13T06:42:32.232 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.8730000000000007e-06 2024-09-13T06:42:32.232 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:32.232 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:32.232 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:32.232 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.951766+0000", 2024-09-13T06:42:32.232 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.1015703 2024-09-13T06:42:32.232 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:32.232 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:32.232 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:32.232 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.951879+0000", 2024-09-13T06:42:32.232 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000112932 2024-09-13T06:42:32.232 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:32.233 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:32.233 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:32.233 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.952029+0000", 2024-09-13T06:42:32.233 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000149846 2024-09-13T06:42:32.233 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:32.233 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:32.233 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:32.233 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:32.233 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:32.233 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18719 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 3719168~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:42:32.233 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.850202+0000", 2024-09-13T06:42:32.233 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 160.36685008800001, 2024-09-13T06:42:32.233 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.102191676, 2024-09-13T06:42:32.233 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:32.234 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:32.234 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:32.234 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:32.234 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:32.234 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18719 2024-09-13T06:42:32.234 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:32.234 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:32.234 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:32.234 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:32.234 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850202+0000", 2024-09-13T06:42:32.234 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:32.234 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:32.234 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:32.234 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:32.234 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850202+0000", 2024-09-13T06:42:32.235 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:32.235 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:32.235 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:32.235 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:32.235 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850202+0000", 2024-09-13T06:42:32.235 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:42:32.235 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:32.235 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:32.235 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:32.235 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850205+0000", 2024-09-13T06:42:32.235 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.89e-06 2024-09-13T06:42:32.235 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:32.235 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:32.235 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:32.235 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850216+0000", 2024-09-13T06:42:32.236 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0233e-05 2024-09-13T06:42:32.236 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:32.236 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:32.236 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:32.236 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850223+0000", 2024-09-13T06:42:32.236 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5299999999999999e-06 2024-09-13T06:42:32.236 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:32.236 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:32.236 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:32.236 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.952106+0000", 2024-09-13T06:42:32.236 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10188309299999999 2024-09-13T06:42:32.236 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:32.236 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:32.236 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:32.237 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.952233+0000", 2024-09-13T06:42:32.237 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000126993 2024-09-13T06:42:32.237 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:32.237 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:32.237 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:32.237 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.952394+0000", 2024-09-13T06:42:32.237 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000160791 2024-09-13T06:42:32.237 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:32.237 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:32.237 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:32.237 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:32.237 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:32.237 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18720 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 3747840~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:42:32.237 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.850726+0000", 2024-09-13T06:42:32.238 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 160.366326259, 2024-09-13T06:42:32.238 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10199504299999999, 2024-09-13T06:42:32.238 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:32.238 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:32.238 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:32.238 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:32.238 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:32.238 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18720 2024-09-13T06:42:32.238 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:32.238 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:32.238 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:32.238 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:32.238 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850726+0000", 2024-09-13T06:42:32.239 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:32.239 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:32.239 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:32.239 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:32.239 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850726+0000", 2024-09-13T06:42:32.239 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:32.239 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:32.239 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:32.239 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:32.239 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850229+0000", 2024-09-13T06:42:32.239 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9995027 2024-09-13T06:42:32.239 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:32.239 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:32.239 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:32.239 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850731+0000", 2024-09-13T06:42:32.239 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00050221599999999999 2024-09-13T06:42:32.240 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:32.240 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:32.240 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:32.240 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850751+0000", 2024-09-13T06:42:32.240 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.9703000000000001e-05 2024-09-13T06:42:32.240 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:32.240 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:32.240 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:32.240 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850764+0000", 2024-09-13T06:42:32.240 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3207000000000001e-05 2024-09-13T06:42:32.240 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:32.240 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:32.240 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:32.241 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.952454+0000", 2024-09-13T06:42:32.241 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101690102 2024-09-13T06:42:32.241 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:32.241 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:32.241 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:32.241 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.952571+0000", 2024-09-13T06:42:32.241 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000116556 2024-09-13T06:42:32.241 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:32.241 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:32.241 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:32.241 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.952721+0000", 2024-09-13T06:42:32.241 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000150419 2024-09-13T06:42:32.241 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:32.241 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:32.241 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:32.242 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:32.242 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:32.242 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18730 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 4034560~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:42:32.242 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.854013+0000", 2024-09-13T06:42:32.242 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 160.36303931800001, 2024-09-13T06:42:32.242 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10186914399999999, 2024-09-13T06:42:32.242 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:32.242 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:32.242 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:32.242 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:32.242 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:32.242 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18730 2024-09-13T06:42:32.242 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:32.242 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:32.242 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:32.243 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:32.243 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.854013+0000", 2024-09-13T06:42:32.243 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:32.243 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:32.243 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:32.243 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:32.243 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.854013+0000", 2024-09-13T06:42:32.243 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:32.243 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:32.243 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:32.243 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:32.243 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.854013+0000", 2024-09-13T06:42:32.243 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:32.243 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:32.244 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:32.244 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:32.244 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.854016+0000", 2024-09-13T06:42:32.244 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.1839999999999999e-06 2024-09-13T06:42:32.244 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:32.244 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:32.244 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:32.244 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.854025+0000", 2024-09-13T06:42:32.244 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.8030000000000003e-06 2024-09-13T06:42:32.244 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:32.244 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:32.244 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:32.244 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.854033+0000", 2024-09-13T06:42:32.244 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6500000000000002e-06 2024-09-13T06:42:32.245 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:32.245 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:32.245 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:32.245 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.955546+0000", 2024-09-13T06:42:32.245 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10151296 2024-09-13T06:42:32.245 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:32.245 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:32.245 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:32.245 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.955694+0000", 2024-09-13T06:42:32.245 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000147773 2024-09-13T06:42:32.245 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:32.245 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:32.245 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:32.245 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.955882+0000", 2024-09-13T06:42:32.245 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000188371 2024-09-13T06:42:32.246 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:32.246 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:32.246 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:32.246 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:32.246 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:32.246 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18742 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 4378624~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:42:32.246 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.857984+0000", 2024-09-13T06:42:32.246 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 160.35906819499999, 2024-09-13T06:42:32.246 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10179961799999999, 2024-09-13T06:42:32.246 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:32.246 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:32.246 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:32.246 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:32.247 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:32.247 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18742 2024-09-13T06:42:32.247 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:32.247 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:32.247 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:32.247 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:32.247 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.857984+0000", 2024-09-13T06:42:32.247 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:32.247 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:32.247 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:32.247 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:32.247 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.857984+0000", 2024-09-13T06:42:32.247 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:32.247 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:32.247 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:32.248 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:32.248 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.857983+0000", 2024-09-13T06:42:32.248 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:42:32.248 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:32.248 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:32.248 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:32.248 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.857987+0000", 2024-09-13T06:42:32.248 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0670000000000002e-06 2024-09-13T06:42:32.248 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:32.248 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:32.248 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:32.248 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.857997+0000", 2024-09-13T06:42:32.248 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6830000000000003e-06 2024-09-13T06:42:32.249 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:32.249 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:32.249 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:32.249 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.858006+0000", 2024-09-13T06:42:32.249 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.5739999999999996e-06 2024-09-13T06:42:32.249 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:32.249 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:32.249 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:32.249 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.959453+0000", 2024-09-13T06:42:32.249 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101447339 2024-09-13T06:42:32.249 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:32.249 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:32.249 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:32.250 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.959603+0000", 2024-09-13T06:42:32.250 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000150316 2024-09-13T06:42:32.250 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:32.250 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:32.250 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:32.250 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.959784+0000", 2024-09-13T06:42:32.250 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00018065900000000001 2024-09-13T06:42:32.250 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:32.250 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:32.250 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:32.250 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:32.250 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:32.250 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18743 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 4407296~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:42:32.251 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.858012+0000", 2024-09-13T06:42:32.251 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 160.35904020199999, 2024-09-13T06:42:32.251 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10210024500000001, 2024-09-13T06:42:32.251 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:32.251 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:32.251 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:32.251 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:32.251 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:32.251 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18743 2024-09-13T06:42:32.251 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:32.251 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:32.251 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:32.251 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:32.251 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.858012+0000", 2024-09-13T06:42:32.252 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:32.252 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:32.252 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:32.252 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:32.252 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.858012+0000", 2024-09-13T06:42:32.252 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:32.252 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:32.252 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:32.252 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:32.252 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.858011+0000", 2024-09-13T06:42:32.252 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:42:32.252 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:32.252 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:32.252 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:32.253 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.858016+0000", 2024-09-13T06:42:32.253 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0659999999999997e-06 2024-09-13T06:42:32.253 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:32.253 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:32.253 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:32.253 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.858024+0000", 2024-09-13T06:42:32.253 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.7700000000000007e-06 2024-09-13T06:42:32.253 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:32.253 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:32.253 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:32.253 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.858032+0000", 2024-09-13T06:42:32.253 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.7700000000000001e-06 2024-09-13T06:42:32.254 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:32.254 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:32.254 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:32.254 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.959850+0000", 2024-09-13T06:42:32.254 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.1018182 2024-09-13T06:42:32.254 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:32.254 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:32.254 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:32.254 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.959964+0000", 2024-09-13T06:42:32.254 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00011413600000000001 2024-09-13T06:42:32.254 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:32.254 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:32.254 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:32.254 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.960113+0000", 2024-09-13T06:42:32.255 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00014813900000000001 2024-09-13T06:42:32.255 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:32.255 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:32.255 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:32.255 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:32.255 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:32.255 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18755 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 4751360~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:42:32.255 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.862061+0000", 2024-09-13T06:42:32.255 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 160.35499195, 2024-09-13T06:42:32.255 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101907023, 2024-09-13T06:42:32.255 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:32.255 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:32.255 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:32.256 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:32.256 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:32.256 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18755 2024-09-13T06:42:32.256 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:32.256 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:32.256 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:32.256 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:32.256 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862061+0000", 2024-09-13T06:42:32.256 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:32.256 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:32.256 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:32.256 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:32.256 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862061+0000", 2024-09-13T06:42:32.256 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:32.257 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:32.257 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:32.257 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:32.257 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862060+0000", 2024-09-13T06:42:32.257 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:42:32.257 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:32.257 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:32.257 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:32.257 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862064+0000", 2024-09-13T06:42:32.257 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.3229999999999999e-06 2024-09-13T06:42:32.257 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:32.257 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:32.257 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:32.257 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862078+0000", 2024-09-13T06:42:32.258 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.433e-05 2024-09-13T06:42:32.258 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:32.258 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:32.258 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:32.258 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862086+0000", 2024-09-13T06:42:32.258 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.3869999999999997e-06 2024-09-13T06:42:32.258 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:32.258 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:32.258 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:32.258 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.963635+0000", 2024-09-13T06:42:32.258 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101549606 2024-09-13T06:42:32.258 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:32.258 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:32.258 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:32.259 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.963783+0000", 2024-09-13T06:42:32.259 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000147312 2024-09-13T06:42:32.259 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:32.259 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:32.259 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:32.259 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.963968+0000", 2024-09-13T06:42:32.259 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000185028 2024-09-13T06:42:32.259 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:32.259 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:32.259 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:32.259 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:32.259 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:32.259 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18756 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 4780032~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:42:32.259 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.862132+0000", 2024-09-13T06:42:32.260 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 160.354920107, 2024-09-13T06:42:32.260 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.102159295, 2024-09-13T06:42:32.260 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:32.260 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:32.260 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:32.260 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:32.260 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:32.260 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18756 2024-09-13T06:42:32.260 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:32.260 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:32.260 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:32.260 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:32.260 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862132+0000", 2024-09-13T06:42:32.260 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:32.261 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:32.261 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:32.261 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:32.261 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862132+0000", 2024-09-13T06:42:32.261 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:32.261 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:32.261 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:32.261 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:32.261 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862132+0000", 2024-09-13T06:42:32.261 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:42:32.261 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:32.261 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:32.261 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:32.261 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862136+0000", 2024-09-13T06:42:32.262 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.9559999999999999e-06 2024-09-13T06:42:32.262 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:32.262 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:32.262 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:32.262 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862145+0000", 2024-09-13T06:42:32.262 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6169999999999996e-06 2024-09-13T06:42:32.262 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:32.262 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:32.262 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:32.262 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862153+0000", 2024-09-13T06:42:32.262 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.8359999999999992e-06 2024-09-13T06:42:32.262 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:32.262 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:32.262 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:32.263 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.964018+0000", 2024-09-13T06:42:32.263 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101865421 2024-09-13T06:42:32.263 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:32.263 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:32.263 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:32.263 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.964140+0000", 2024-09-13T06:42:32.263 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000121172 2024-09-13T06:42:32.263 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:32.263 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:32.263 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:32.263 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.964292+0000", 2024-09-13T06:42:32.263 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00015202600000000001 2024-09-13T06:42:32.263 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:32.264 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:32.264 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:32.264 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:32.264 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:32.264 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18768 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 5124096~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:42:32.264 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.866345+0000", 2024-09-13T06:42:32.264 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 160.35070780000001, 2024-09-13T06:42:32.264 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101779361, 2024-09-13T06:42:32.264 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:32.264 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:32.264 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:32.264 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:32.264 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:32.264 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18768 2024-09-13T06:42:32.265 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:32.265 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:32.265 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:32.265 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:32.265 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.866345+0000", 2024-09-13T06:42:32.265 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:32.265 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:32.265 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:32.265 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:32.265 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.866345+0000", 2024-09-13T06:42:32.265 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:32.265 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:32.265 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:32.265 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:32.265 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.866344+0000", 2024-09-13T06:42:32.266 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:32.266 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:32.266 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:32.266 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:32.266 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.866348+0000", 2024-09-13T06:42:32.266 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.4300000000000002e-06 2024-09-13T06:42:32.266 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:32.266 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:32.266 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:32.266 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.866356+0000", 2024-09-13T06:42:32.266 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.5930000000000006e-06 2024-09-13T06:42:32.266 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:32.266 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:32.266 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:32.267 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.866364+0000", 2024-09-13T06:42:32.267 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5599999999999996e-06 2024-09-13T06:42:32.267 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:32.267 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:32.269 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:32.269 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.967865+0000", 2024-09-13T06:42:32.269 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101501683 2024-09-13T06:42:32.269 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:32.269 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:32.269 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:32.269 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.967981+0000", 2024-09-13T06:42:32.269 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000115643 2024-09-13T06:42:32.269 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:32.269 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:32.269 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:32.269 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.968124+0000", 2024-09-13T06:42:32.270 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00014305500000000001 2024-09-13T06:42:32.270 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:32.270 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:32.270 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:32.270 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:32.270 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:32.270 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18779 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 5439488~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:42:32.270 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.869996+0000", 2024-09-13T06:42:32.270 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 160.347056915, 2024-09-13T06:42:32.270 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10189577399999999, 2024-09-13T06:42:32.270 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:32.270 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:32.271 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:32.271 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:32.271 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:32.271 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18779 2024-09-13T06:42:32.271 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:32.271 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:32.271 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:32.271 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:32.271 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.869996+0000", 2024-09-13T06:42:32.271 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:32.271 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:32.271 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:32.271 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:32.271 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.869996+0000", 2024-09-13T06:42:32.271 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:32.272 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:32.272 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:32.272 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:32.272 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.869995+0000", 2024-09-13T06:42:32.272 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:32.272 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:32.272 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:32.272 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:32.272 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.869998+0000", 2024-09-13T06:42:32.272 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.2729999999999998e-06 2024-09-13T06:42:32.272 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:32.272 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:32.272 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:32.272 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.870007+0000", 2024-09-13T06:42:32.272 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.5760000000000006e-06 2024-09-13T06:42:32.273 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:32.273 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:32.273 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:32.273 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.870014+0000", 2024-09-13T06:42:32.273 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.1400000000000002e-06 2024-09-13T06:42:32.273 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:32.273 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:32.273 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:32.273 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.971631+0000", 2024-09-13T06:42:32.273 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101617503 2024-09-13T06:42:32.273 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:32.273 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:32.273 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:32.273 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.971747+0000", 2024-09-13T06:42:32.274 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00011599600000000001 2024-09-13T06:42:32.274 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:32.274 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:32.274 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:32.274 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.971891+0000", 2024-09-13T06:42:32.274 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000143912 2024-09-13T06:42:32.274 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:32.274 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:32.274 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:32.274 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:32.274 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:32.274 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18792 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 5812224~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:42:32.274 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.874371+0000", 2024-09-13T06:42:32.275 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 160.342681785, 2024-09-13T06:42:32.275 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101736005, 2024-09-13T06:42:32.275 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:32.275 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:32.275 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:32.275 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:32.275 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:32.275 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18792 2024-09-13T06:42:32.275 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:32.275 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:32.275 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:32.275 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:32.276 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874371+0000", 2024-09-13T06:42:32.276 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:32.276 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:32.276 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:32.276 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:32.276 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874371+0000", 2024-09-13T06:42:32.276 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:32.276 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:32.276 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:32.276 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:32.276 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874370+0000", 2024-09-13T06:42:32.276 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:32.277 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:32.277 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:32.277 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:32.277 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874374+0000", 2024-09-13T06:42:32.277 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.7239999999999998e-06 2024-09-13T06:42:32.277 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:32.277 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:32.277 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:32.277 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874385+0000", 2024-09-13T06:42:32.277 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1293e-05 2024-09-13T06:42:32.277 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:32.278 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:32.278 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:32.278 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874394+0000", 2024-09-13T06:42:32.278 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.0729999999999994e-06 2024-09-13T06:42:32.278 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:32.278 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:32.278 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:32.278 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.975850+0000", 2024-09-13T06:42:32.278 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10145599700000001 2024-09-13T06:42:32.278 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:32.278 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:32.278 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:32.278 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.975963+0000", 2024-09-13T06:42:32.279 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000112689 2024-09-13T06:42:32.279 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:32.279 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:32.279 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:32.279 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.976107+0000", 2024-09-13T06:42:32.279 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000143836 2024-09-13T06:42:32.279 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:32.279 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:32.279 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:32.279 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:32.279 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:32.279 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18793 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 5840896~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:42:32.279 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.874401+0000", 2024-09-13T06:42:32.279 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 160.34265175199999, 2024-09-13T06:42:32.279 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.102005516, 2024-09-13T06:42:32.280 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:32.280 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:32.280 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:32.280 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:32.280 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:32.280 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18793 2024-09-13T06:42:32.280 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:32.280 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:32.280 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:32.280 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:32.280 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874401+0000", 2024-09-13T06:42:32.280 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:32.280 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:32.280 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:32.280 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:32.281 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874401+0000", 2024-09-13T06:42:32.281 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:32.281 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:32.281 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:32.281 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:32.281 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874400+0000", 2024-09-13T06:42:32.281 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:42:32.281 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:32.281 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:32.281 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:32.281 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874404+0000", 2024-09-13T06:42:32.281 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0069999999999999e-06 2024-09-13T06:42:32.282 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:32.282 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:32.282 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:32.282 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874412+0000", 2024-09-13T06:42:32.282 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.5399999999999996e-06 2024-09-13T06:42:32.282 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:32.282 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:32.282 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:32.282 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874420+0000", 2024-09-13T06:42:32.282 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.6199999999999999e-06 2024-09-13T06:42:32.282 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:32.282 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:32.282 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:32.282 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.976150+0000", 2024-09-13T06:42:32.282 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101729874 2024-09-13T06:42:32.283 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:32.283 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:32.283 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:32.283 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.976261+0000", 2024-09-13T06:42:32.283 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000110819 2024-09-13T06:42:32.283 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:32.283 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:32.283 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:32.283 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.976406+0000", 2024-09-13T06:42:32.283 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000145489 2024-09-13T06:42:32.283 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:32.283 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:32.283 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:32.283 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:32.284 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:32.284 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18803 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 6127616~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:42:32.284 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.877851+0000", 2024-09-13T06:42:32.284 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 160.33920125899999, 2024-09-13T06:42:32.284 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101951584, 2024-09-13T06:42:32.284 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:32.284 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:32.284 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:32.284 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:32.284 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:32.284 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18803 2024-09-13T06:42:32.284 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:32.284 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:32.285 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:32.285 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:32.285 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.877851+0000", 2024-09-13T06:42:32.285 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:32.285 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:32.285 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:32.285 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:32.285 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.877851+0000", 2024-09-13T06:42:32.285 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:32.285 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:32.285 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:32.285 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:32.285 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.877851+0000", 2024-09-13T06:42:32.285 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:32.286 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:32.286 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:32.286 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:32.286 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.877854+0000", 2024-09-13T06:42:32.286 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.7929999999999999e-06 2024-09-13T06:42:32.286 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:32.286 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:32.286 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:32.286 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.877864+0000", 2024-09-13T06:42:32.286 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.2029999999999998e-06 2024-09-13T06:42:32.286 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:32.286 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:32.286 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:32.286 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.877873+0000", 2024-09-13T06:42:32.286 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.0440000000000001e-06 2024-09-13T06:42:32.287 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:32.287 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:32.287 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:32.287 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.979544+0000", 2024-09-13T06:42:32.287 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101671198 2024-09-13T06:42:32.287 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:32.287 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:32.287 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:32.287 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.979658+0000", 2024-09-13T06:42:32.287 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000114456 2024-09-13T06:42:32.287 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:32.287 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:32.287 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:32.287 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.979803+0000", 2024-09-13T06:42:32.287 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000144506 2024-09-13T06:42:32.287 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:32.288 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:32.288 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:32.288 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:32.288 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:32.288 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18807 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 6242304~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:42:32.288 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.879235+0000", 2024-09-13T06:42:32.288 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 160.337817229, 2024-09-13T06:42:32.288 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101781258, 2024-09-13T06:42:32.288 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:32.288 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:32.288 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:32.288 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:32.288 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:32.288 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18807 2024-09-13T06:42:32.289 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:32.289 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:32.289 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:32.289 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:32.289 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879235+0000", 2024-09-13T06:42:32.289 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:32.289 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:32.289 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:32.289 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:32.289 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879235+0000", 2024-09-13T06:42:32.289 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:32.290 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:32.290 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:32.290 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:32.290 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879235+0000", 2024-09-13T06:42:32.290 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:32.290 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:32.290 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:32.290 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:32.290 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879239+0000", 2024-09-13T06:42:32.290 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.963e-06 2024-09-13T06:42:32.290 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:32.290 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:32.290 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:32.291 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879247+0000", 2024-09-13T06:42:32.291 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6470000000000004e-06 2024-09-13T06:42:32.291 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:32.291 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:32.291 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:32.291 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879255+0000", 2024-09-13T06:42:32.291 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5429999999999996e-06 2024-09-13T06:42:32.291 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:32.291 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:32.291 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:32.291 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.980756+0000", 2024-09-13T06:42:32.292 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10150165999999999 2024-09-13T06:42:32.292 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:32.292 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:32.292 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:32.292 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.980868+0000", 2024-09-13T06:42:32.292 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000111196 2024-09-13T06:42:32.292 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:32.292 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:32.292 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:32.293 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.981017+0000", 2024-09-13T06:42:32.293 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000148846 2024-09-13T06:42:32.293 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:32.293 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:32.293 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:32.293 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:32.293 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:32.293 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18808 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 6270976~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:42:32.293 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.879261+0000", 2024-09-13T06:42:32.293 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 160.33779109, 2024-09-13T06:42:32.293 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.102057547, 2024-09-13T06:42:32.293 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:32.293 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:32.293 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:32.294 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:32.294 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:32.294 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18808 2024-09-13T06:42:32.294 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:32.294 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:32.294 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:32.294 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:32.294 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879261+0000", 2024-09-13T06:42:32.294 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:32.294 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:32.295 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:32.295 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:32.295 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879261+0000", 2024-09-13T06:42:32.295 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:32.295 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:32.295 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:32.295 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:32.295 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879261+0000", 2024-09-13T06:42:32.295 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:32.295 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:32.295 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:32.295 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:32.295 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879264+0000", 2024-09-13T06:42:32.295 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.523e-06 2024-09-13T06:42:32.295 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:32.296 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:32.296 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:32.296 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879273+0000", 2024-09-13T06:42:32.296 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6070000000000008e-06 2024-09-13T06:42:32.296 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:32.296 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:32.296 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:32.296 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879280+0000", 2024-09-13T06:42:32.296 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.4699999999999996e-06 2024-09-13T06:42:32.297 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:32.297 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:32.297 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:32.297 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.981060+0000", 2024-09-13T06:42:32.297 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10177934800000001 2024-09-13T06:42:32.297 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:32.297 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:32.298 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:32.298 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.981174+0000", 2024-09-13T06:42:32.298 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000114456 2024-09-13T06:42:32.298 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:32.298 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:32.298 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:32.298 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.981319+0000", 2024-09-13T06:42:32.298 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00014473900000000001 2024-09-13T06:42:32.298 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:32.298 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:32.298 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:32.298 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:32.298 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:32.298 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18811 3.9 3.140f5209 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:42:32.299 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.880449+0000", 2024-09-13T06:42:32.299 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 160.33660355200001, 2024-09-13T06:42:32.299 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101739355, 2024-09-13T06:42:32.299 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:32.299 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:42:32.299 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:32.299 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:32.299 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:32.299 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18811 2024-09-13T06:42:32.299 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:32.299 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:32.299 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:32.299 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:32.299 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880449+0000", 2024-09-13T06:42:32.299 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:32.299 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:32.300 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:32.300 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:32.300 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880449+0000", 2024-09-13T06:42:32.300 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:32.300 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:32.300 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:32.300 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:32.300 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880448+0000", 2024-09-13T06:42:32.300 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:42:32.300 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:32.300 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:32.300 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:32.301 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880452+0000", 2024-09-13T06:42:32.301 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0470000000000004e-06 2024-09-13T06:42:32.301 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:32.301 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:32.301 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:32.301 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880462+0000", 2024-09-13T06:42:32.301 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6530000000000006e-06 2024-09-13T06:42:32.301 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:32.301 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:32.301 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:32.301 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880472+0000", 2024-09-13T06:42:32.301 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0027000000000001e-05 2024-09-13T06:42:32.301 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:32.301 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:32.301 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:32.302 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.982172+0000", 2024-09-13T06:42:32.302 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10170043500000001 2024-09-13T06:42:32.302 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:32.302 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:32.302 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:32.302 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.982188+0000", 2024-09-13T06:42:32.302 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6172999999999999e-05 2024-09-13T06:42:32.302 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:32.302 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:32.302 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:32.302 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:32.302 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:32.302 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18812 3.9 3.140f5209 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:42:32.302 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.880478+0000", 2024-09-13T06:42:32.302 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 160.33657431500001, 2024-09-13T06:42:32.303 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10177795100000001, 2024-09-13T06:42:32.303 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:32.303 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:42:32.303 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:32.303 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:32.303 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:32.303 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18812 2024-09-13T06:42:32.303 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:32.303 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:32.303 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:32.303 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:32.303 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880478+0000", 2024-09-13T06:42:32.303 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:32.303 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:32.303 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:32.304 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:32.304 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880478+0000", 2024-09-13T06:42:32.304 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:32.304 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:32.304 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:32.304 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:32.304 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880477+0000", 2024-09-13T06:42:32.304 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:42:32.304 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:32.304 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:32.304 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:32.304 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880481+0000", 2024-09-13T06:42:32.304 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.827e-06 2024-09-13T06:42:32.304 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:32.305 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:32.305 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:32.305 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880490+0000", 2024-09-13T06:42:32.305 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6100000000000006e-06 2024-09-13T06:42:32.305 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:32.305 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:32.305 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:32.305 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880497+0000", 2024-09-13T06:42:32.305 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.7030000000000006e-06 2024-09-13T06:42:32.305 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:32.305 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:32.305 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:32.305 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.982241+0000", 2024-09-13T06:42:32.305 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10174351199999999 2024-09-13T06:42:32.306 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:32.306 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:32.306 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:32.306 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.982256+0000", 2024-09-13T06:42:32.306 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5143000000000001e-05 2024-09-13T06:42:32.306 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:32.306 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:32.306 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:32.306 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:32.306 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:32.306 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:160483 3.a 3:57f62123:::rbd_header.112138ed422:head [watch reconnect cookie 140361344088384 gen 3] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e177)", 2024-09-13T06:42:32.306 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:42:17.439011+0000", 2024-09-13T06:42:32.306 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 14.778041124, 2024-09-13T06:42:32.306 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.155518861, 2024-09-13T06:42:32.306 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:32.307 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:32.307 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:32.307 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:32.307 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:32.307 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 160483 2024-09-13T06:42:32.307 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:32.307 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:32.307 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:32.307 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:32.307 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:17.439011+0000", 2024-09-13T06:42:32.307 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:32.307 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:32.307 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:32.307 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:32.307 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:17.439011+0000", 2024-09-13T06:42:32.307 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:32.308 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:32.308 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:32.308 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:32.308 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:17.439009+0000", 2024-09-13T06:42:32.308 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999976 2024-09-13T06:42:32.308 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:32.308 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:32.308 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:32.308 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:17.439024+0000", 2024-09-13T06:42:32.308 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.464e-05 2024-09-13T06:42:32.308 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:32.308 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:32.308 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:32.308 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:17.439058+0000", 2024-09-13T06:42:32.308 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.4712999999999998e-05 2024-09-13T06:42:32.309 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:32.309 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:32.309 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:32.309 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:17.439085+0000", 2024-09-13T06:42:32.309 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.6216000000000001e-05 2024-09-13T06:42:32.309 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:32.309 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:32.309 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:32.309 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:17.439182+0000", 2024-09-13T06:42:32.309 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.7020000000000003e-05 2024-09-13T06:42:32.309 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:32.309 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:32.309 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:42:32.309 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:17.439204+0000", 2024-09-13T06:42:32.310 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.2276000000000002e-05 2024-09-13T06:42:32.310 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:32.310 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:32.310 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:32.310 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:18.588627+0000", 2024-09-13T06:42:32.310 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1494235829999999 2024-09-13T06:42:32.310 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:32.310 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:32.310 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for rw locks", 2024-09-13T06:42:32.310 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:18.589031+0000", 2024-09-13T06:42:32.310 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0004035 2024-09-13T06:42:32.310 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:32.311 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:32.311 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:32.311 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:18.590604+0000", 2024-09-13T06:42:32.311 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.001573234 2024-09-13T06:42:32.311 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:32.311 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:32.311 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:32.311 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:18.590791+0000", 2024-09-13T06:42:32.311 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000186701 2024-09-13T06:42:32.311 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:32.311 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:32.312 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:32.312 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:18.594530+0000", 2024-09-13T06:42:32.312 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0037394250000000002 2024-09-13T06:42:32.312 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:32.312 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:32.312 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:32.313 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:32.313 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:32.313 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:42:32.314 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-13T06:42:32.315 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:42:32.316+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:42:32.402 INFO:teuthology.orchestra.run.smithi081.stderr:noscrub is unset 2024-09-13T06:42:32.422 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-13T06:42:32.413+0000 7fa8bb18e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 36790) UID: 0 2024-09-13T06:42:32.442 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-13T06:42:32.456 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:42:32.457 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [], 2024-09-13T06:42:32.457 INFO:teuthology.orchestra.run.smithi139.stdout: "num_ops": 0 2024-09-13T06:42:32.457 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:42:32.472 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-13T06:42:32.518 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:42:32.516+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:42:32.618 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:42:32.612+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:42:32.618 INFO:teuthology.orchestra.run.smithi081.stdout:osd.0: {} 2024-09-13T06:42:32.618 INFO:teuthology.orchestra.run.smithi081.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-13T06:42:32.634 INFO:teuthology.orchestra.run.smithi081.stdout:osd.1: {} 2024-09-13T06:42:32.634 INFO:teuthology.orchestra.run.smithi081.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-13T06:42:32.637 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:42:32.637 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [], 2024-09-13T06:42:32.637 INFO:teuthology.orchestra.run.smithi139.stdout: "complaint_time": 30, 2024-09-13T06:42:32.637 INFO:teuthology.orchestra.run.smithi139.stdout: "num_blocked_ops": 0 2024-09-13T06:42:32.637 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:42:32.650 INFO:teuthology.orchestra.run.smithi081.stdout:osd.2: {} 2024-09-13T06:42:32.755 INFO:teuthology.orchestra.run.smithi081.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-13T06:42:32.756 INFO:teuthology.orchestra.run.smithi081.stdout:osd.3: {} 2024-09-13T06:42:32.756 INFO:teuthology.orchestra.run.smithi081.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-13T06:42:32.756 INFO:teuthology.orchestra.run.smithi081.stdout:osd.4: {} 2024-09-13T06:42:32.756 INFO:teuthology.orchestra.run.smithi081.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-13T06:42:32.757 INFO:teuthology.orchestra.run.smithi081.stdout:osd.5: {} 2024-09-13T06:42:32.757 INFO:teuthology.orchestra.run.smithi081.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-13T06:42:32.757 INFO:teuthology.orchestra.run.smithi081.stdout:osd.6: {} 2024-09-13T06:42:32.757 INFO:teuthology.orchestra.run.smithi081.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-13T06:42:32.758 INFO:teuthology.orchestra.run.smithi081.stdout:osd.7: {} 2024-09-13T06:42:32.758 INFO:teuthology.orchestra.run.smithi081.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-13T06:42:32.759 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-13T06:42:32.760 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:42:32.756+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:42:32.860 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:42:32.853+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:42:32.890 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:42:32.890 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:42:32.904 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-13T06:42:32.992 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:42:32.989+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:42:33.062 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-13T06:42:33.057+0000 7fa8bb18e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 36790) UID: 0 2024-09-13T06:42:33.072 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:42:33.073 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:42:33.088 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-13T06:42:33.172 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-13T06:42:33.169+0000 7fa8bb18e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 36790) UID: 0 2024-09-13T06:42:33.247 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:42:33.247 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:42:33.261 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-13T06:42:33.264 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:42:33.260+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:42:33.365 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:42:33.364+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:42:33.437 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:42:33.437 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:42:33.453 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-13T06:42:33.466 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:42:33.464+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:42:33.568 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:42:33.564+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:42:33.632 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:42:33.632 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:42:33.654 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-13T06:42:33.668 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:42:33.664+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:42:33.768 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:42:33.764+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:42:33.832 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:42:33.833 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:42:33.854 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-13T06:42:33.869 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:42:33.864+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:42:33.970 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:42:33.964+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:42:34.005 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:42:34.005 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:42:34.020 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-13T06:42:34.071 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-13T06:42:34.065+0000 7fa8bb18e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 36790) UID: 0 2024-09-13T06:42:34.147 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:42:34.147 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:42:34.161 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-13T06:42:34.206 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:42:34.204+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:42:34.273 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:42:34.268+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:42:34.277 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:42:34.277 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:42:34.291 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-13T06:42:34.382 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:42:34.380+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:42:34.429 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-13T06:42:34.457 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:42:34.457 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:42:34.473 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-13T06:42:34.474 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:42:34.469+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:42:34.575 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:42:34.572+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:42:34.638 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:42:34.639 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:42:34.656 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-13T06:42:34.675 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-13T06:42:34.669+0000 7fa8bb18e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 36790) UID: 0 2024-09-13T06:42:34.763 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-13T06:42:34.792 INFO:teuthology.orchestra.run.smithi081.stdout:checking clone #34, image image_client.0-clone34 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent35 2024-09-13T06:42:34.793 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:42:34.788+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:42:34.833 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:42:34.833 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:42:34.851 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-13T06:42:34.880 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:42:34.873+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:42:34.927 INFO:teuthology.orchestra.run.smithi081.stdout:osd.0: {} 2024-09-13T06:42:34.927 INFO:teuthology.orchestra.run.smithi081.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-13T06:42:34.937 INFO:teuthology.orchestra.run.smithi081.stdout:4698 read 0x25d8d19 thru 0x25e6db0 (0xe098 bytes) 2024-09-13T06:42:34.939 INFO:teuthology.orchestra.run.smithi081.stdout:4699 writesame 0x45d2b36 thru 0x45de386 data_size 0x1(0xb851 bytes) 2024-09-13T06:42:34.943 INFO:teuthology.orchestra.run.smithi081.stdout:osd.1: {} 2024-09-13T06:42:34.944 INFO:teuthology.orchestra.run.smithi081.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-13T06:42:34.962 INFO:teuthology.orchestra.run.smithi081.stdout:osd.2: {} 2024-09-13T06:42:34.962 INFO:teuthology.orchestra.run.smithi081.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-13T06:42:34.972 INFO:teuthology.orchestra.run.smithi081.stdout:4700 read 0x4732510 thru 0x4736244 (0x3d35 bytes) 2024-09-13T06:42:34.973 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:42:34.974 INFO:teuthology.orchestra.run.smithi081.stdout:4702 punch from 0x6a7325e to 0x6a7ee12, (0xbbb4 bytes) 2024-09-13T06:42:34.974 INFO:teuthology.orchestra.run.smithi081.stdout:4704 punch from 0x1534694 to 0x1542683, (0xdfef bytes) 2024-09-13T06:42:34.974 INFO:teuthology.orchestra.run.smithi081.stdout:4705 read 0x12ad5d0 thru 0x12bb97c (0xe3ad bytes) 2024-09-13T06:42:34.975 INFO:teuthology.orchestra.run.smithi081.stdout:4707 read 0xed8377 thru 0xee48c2 (0xc54c bytes) 2024-09-13T06:42:34.976 INFO:teuthology.orchestra.run.smithi081.stdout:4708 read 0x789bc27 thru 0x78a1f2b (0x6305 bytes) 2024-09-13T06:42:34.977 INFO:teuthology.orchestra.run.smithi081.stdout:4709 punch from 0xa6b9510 to 0xa6c5573, (0xc063 bytes) 2024-09-13T06:42:34.977 INFO:teuthology.orchestra.run.smithi081.stdout:4711 read 0x14fbb26 thru 0x1506a38 (0xaf13 bytes) 2024-09-13T06:42:34.978 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:42:34.976+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:42:34.978 INFO:teuthology.orchestra.run.smithi081.stdout:osd.3: {} 2024-09-13T06:42:34.979 INFO:teuthology.orchestra.run.smithi081.stdout:4712 write 0xa8a8dd thru 0xa94ee5 (0xa609 bytes) 2024-09-13T06:42:34.979 INFO:teuthology.orchestra.run.smithi081.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-13T06:42:34.982 INFO:teuthology.orchestra.run.smithi081.stdout:4713 read 0x76d9006 thru 0x76dd5a2 (0x459d bytes) 2024-09-13T06:42:34.985 INFO:teuthology.orchestra.run.smithi081.stdout:4715 trunc from 0xc3ef269 to 0xaae3451 2024-09-13T06:42:35.004 INFO:teuthology.orchestra.run.smithi081.stdout:osd.4: {} 2024-09-13T06:42:35.004 INFO:teuthology.orchestra.run.smithi081.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-13T06:42:35.017 INFO:teuthology.orchestra.run.smithi081.stdout:4717 read 0x98af05f thru 0x98b2980 (0x3922 bytes) 2024-09-13T06:42:35.017 INFO:teuthology.orchestra.run.smithi081.stdout:4718 punch from 0xa608918 to 0xa6158fc, (0xcfe4 bytes) 2024-09-13T06:42:35.017 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:42:35.017 INFO:teuthology.orchestra.run.smithi081.stdout:4720 punch from 0x4da23a4 to 0x4da7e04, (0x5a60 bytes) 2024-09-13T06:42:35.017 INFO:teuthology.orchestra.run.smithi081.stdout:4721 read 0x3dab6e0 thru 0x3daec8c (0x35ad bytes) 2024-09-13T06:42:35.024 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:42:35.024 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 20, 2024-09-13T06:42:35.024 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 600, 2024-09-13T06:42:35.024 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [ 2024-09-13T06:42:35.024 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.024 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:21979 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 14217216~4096 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:42:35.024 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.888811+0000", 2024-09-13T06:42:35.025 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 162.134495851, 2024-09-13T06:42:35.025 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049092969, 2024-09-13T06:42:35.025 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:35.025 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:35.025 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:35.025 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:35.025 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:35.025 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 21979 2024-09-13T06:42:35.025 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.025 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:35.025 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.025 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:35.025 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888811+0000", 2024-09-13T06:42:35.026 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:35.026 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.026 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.026 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:35.026 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888811+0000", 2024-09-13T06:42:35.026 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:35.026 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.026 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.026 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:35.026 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888811+0000", 2024-09-13T06:42:35.026 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:42:35.027 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.027 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.027 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:35.027 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888812+0000", 2024-09-13T06:42:35.027 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.204e-06 2024-09-13T06:42:35.027 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.027 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.027 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:35.027 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888815+0000", 2024-09-13T06:42:35.027 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9359999999999999e-06 2024-09-13T06:42:35.027 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.027 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.027 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:35.027 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888818+0000", 2024-09-13T06:42:35.028 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.7369999999999998e-06 2024-09-13T06:42:35.028 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.028 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.028 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:35.028 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.937663+0000", 2024-09-13T06:42:35.028 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.048844540999999998 2024-09-13T06:42:35.028 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.028 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.028 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:35.028 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.937709+0000", 2024-09-13T06:42:35.028 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6492999999999997e-05 2024-09-13T06:42:35.029 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.029 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.029 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:35.029 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.937904+0000", 2024-09-13T06:42:35.029 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00019526499999999999 2024-09-13T06:42:35.029 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:35.029 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:35.029 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:35.029 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.029 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.029 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:21980 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 14245888~4096 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:42:35.029 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.888820+0000", 2024-09-13T06:42:35.030 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 162.13448717399999, 2024-09-13T06:42:35.030 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049357080999999997, 2024-09-13T06:42:35.030 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:35.030 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:35.030 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:35.030 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:35.030 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:35.030 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 21980 2024-09-13T06:42:35.030 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.030 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:35.030 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.030 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:35.031 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888820+0000", 2024-09-13T06:42:35.031 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:35.031 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.031 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.031 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:35.031 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888820+0000", 2024-09-13T06:42:35.031 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:35.031 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.031 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.031 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:35.031 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888820+0000", 2024-09-13T06:42:35.031 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:42:35.031 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.032 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.032 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:35.032 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888821+0000", 2024-09-13T06:42:35.032 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.122e-06 2024-09-13T06:42:35.032 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.032 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.032 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:35.032 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888824+0000", 2024-09-13T06:42:35.032 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.0580000000000002e-06 2024-09-13T06:42:35.032 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.032 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.032 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:35.033 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888827+0000", 2024-09-13T06:42:35.033 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.666e-06 2024-09-13T06:42:35.033 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.033 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.033 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:35.033 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.937935+0000", 2024-09-13T06:42:35.033 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049108329999999999 2024-09-13T06:42:35.033 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.033 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.033 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:35.033 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.937985+0000", 2024-09-13T06:42:35.033 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9694000000000002e-05 2024-09-13T06:42:35.033 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.033 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.034 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:35.034 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.938177+0000", 2024-09-13T06:42:35.034 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00019241899999999999 2024-09-13T06:42:35.034 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:35.034 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:35.034 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:35.034 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.034 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.034 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:21984 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:snapdir [list-snaps] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:42:35.034 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.888829+0000", 2024-09-13T06:42:35.034 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 162.13447839599999, 2024-09-13T06:42:35.034 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049524545000000003, 2024-09-13T06:42:35.034 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:35.034 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:35.035 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:35.035 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:35.035 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:35.035 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 21984 2024-09-13T06:42:35.035 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.035 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:35.035 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.035 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:35.035 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888829+0000", 2024-09-13T06:42:35.035 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:35.035 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.035 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.035 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:35.036 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888829+0000", 2024-09-13T06:42:35.036 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:35.036 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.036 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.036 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:35.036 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888829+0000", 2024-09-13T06:42:35.036 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:42:35.036 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.036 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.036 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:35.036 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888830+0000", 2024-09-13T06:42:35.036 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2529999999999999e-06 2024-09-13T06:42:35.036 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.037 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.037 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:35.037 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888835+0000", 2024-09-13T06:42:35.037 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.4729999999999999e-06 2024-09-13T06:42:35.037 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.037 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.037 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:35.037 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888840+0000", 2024-09-13T06:42:35.037 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0159999999999999e-06 2024-09-13T06:42:35.037 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.037 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.037 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:35.037 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.938199+0000", 2024-09-13T06:42:35.037 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049358974999999999 2024-09-13T06:42:35.038 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.038 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.038 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:35.038 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.938268+0000", 2024-09-13T06:42:35.038 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.8876999999999998e-05 2024-09-13T06:42:35.038 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.038 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.038 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:35.038 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.938353+0000", 2024-09-13T06:42:35.038 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.5155999999999996e-05 2024-09-13T06:42:35.038 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:35.038 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:35.038 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:35.039 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.039 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.039 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:21985 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 12587008~4096 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:42:35.039 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.888858+0000", 2024-09-13T06:42:35.039 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 162.134449246, 2024-09-13T06:42:35.039 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049674347000000001, 2024-09-13T06:42:35.039 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:35.039 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:35.039 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:35.039 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:35.039 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:35.039 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 21985 2024-09-13T06:42:35.039 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.039 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:35.040 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.040 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:35.040 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888858+0000", 2024-09-13T06:42:35.040 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:35.040 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.040 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.040 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:35.040 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888858+0000", 2024-09-13T06:42:35.040 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:35.040 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.040 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.040 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:35.040 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888857+0000", 2024-09-13T06:42:35.041 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:35.041 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.041 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.041 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:35.041 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888860+0000", 2024-09-13T06:42:35.041 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4739999999999999e-06 2024-09-13T06:42:35.041 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.041 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.041 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:35.041 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888867+0000", 2024-09-13T06:42:35.041 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.7170000000000002e-06 2024-09-13T06:42:35.041 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.041 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.041 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:35.042 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888871+0000", 2024-09-13T06:42:35.042 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5120000000000002e-06 2024-09-13T06:42:35.042 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.042 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.042 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:35.042 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.938389+0000", 2024-09-13T06:42:35.042 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049517717000000003 2024-09-13T06:42:35.042 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.042 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.042 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:35.042 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.938449+0000", 2024-09-13T06:42:35.042 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0513999999999997e-05 2024-09-13T06:42:35.042 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.043 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.043 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:35.043 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.938532+0000", 2024-09-13T06:42:35.043 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.2936999999999996e-05 2024-09-13T06:42:35.043 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:35.043 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:35.043 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:35.043 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.043 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.043 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:21986 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 12615680~4096 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:42:35.043 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.888875+0000", 2024-09-13T06:42:35.043 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 162.13443173300001, 2024-09-13T06:42:35.043 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049881781, 2024-09-13T06:42:35.043 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:35.044 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:35.044 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:35.044 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:35.044 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:35.044 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 21986 2024-09-13T06:42:35.044 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.044 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:35.044 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.044 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:35.044 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888875+0000", 2024-09-13T06:42:35.044 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:35.044 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.044 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.044 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:35.045 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888875+0000", 2024-09-13T06:42:35.045 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:35.045 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.045 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.045 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:35.045 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888875+0000", 2024-09-13T06:42:35.045 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:35.045 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.045 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.045 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:35.045 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888880+0000", 2024-09-13T06:42:35.045 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7600000000000002e-06 2024-09-13T06:42:35.046 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.046 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.046 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:35.046 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888887+0000", 2024-09-13T06:42:35.046 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3950000000000003e-06 2024-09-13T06:42:35.046 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.046 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.046 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:35.046 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888892+0000", 2024-09-13T06:42:35.046 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0409999999999997e-06 2024-09-13T06:42:35.046 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.046 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.046 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:35.046 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.938568+0000", 2024-09-13T06:42:35.046 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049675267000000002 2024-09-13T06:42:35.047 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.047 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.047 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:35.047 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.938653+0000", 2024-09-13T06:42:35.047 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.5792999999999997e-05 2024-09-13T06:42:35.047 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.047 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.047 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:35.047 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.938757+0000", 2024-09-13T06:42:35.047 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00010387699999999999 2024-09-13T06:42:35.047 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:35.047 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:35.047 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:35.047 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.048 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.048 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:21987 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 12644352~4096 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:42:35.048 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.888899+0000", 2024-09-13T06:42:35.048 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 162.13440838700001, 2024-09-13T06:42:35.048 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.050094056999999997, 2024-09-13T06:42:35.048 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:35.048 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:35.048 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:35.048 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:35.048 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:35.048 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 21987 2024-09-13T06:42:35.048 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.048 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:35.048 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.049 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:35.049 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888899+0000", 2024-09-13T06:42:35.049 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:35.049 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.049 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.049 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:35.049 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888899+0000", 2024-09-13T06:42:35.049 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:35.049 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.049 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.049 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:35.049 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888899+0000", 2024-09-13T06:42:35.049 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:35.049 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.050 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.050 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:35.050 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888901+0000", 2024-09-13T06:42:35.050 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2539999999999999e-06 2024-09-13T06:42:35.050 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.050 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.050 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:35.050 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888907+0000", 2024-09-13T06:42:35.050 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9009999999999999e-06 2024-09-13T06:42:35.050 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.050 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.050 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:35.050 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888912+0000", 2024-09-13T06:42:35.050 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9840000000000001e-06 2024-09-13T06:42:35.050 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.051 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.051 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:35.051 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.938810+0000", 2024-09-13T06:42:35.051 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049898835000000002 2024-09-13T06:42:35.051 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.051 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.051 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:35.051 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.938890+0000", 2024-09-13T06:42:35.051 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.9215000000000006e-05 2024-09-13T06:42:35.051 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.051 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.051 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:35.051 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.938993+0000", 2024-09-13T06:42:35.051 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000103194 2024-09-13T06:42:35.052 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:35.052 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:35.052 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:35.052 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.052 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.052 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:21988 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 12673024~4096 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:42:35.052 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.888916+0000", 2024-09-13T06:42:35.052 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 162.13439137099999, 2024-09-13T06:42:35.052 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.050203036999999999, 2024-09-13T06:42:35.052 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:35.052 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:35.052 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:35.052 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:35.053 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:35.053 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 21988 2024-09-13T06:42:35.053 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.053 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:35.053 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.053 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:35.053 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888916+0000", 2024-09-13T06:42:35.053 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:35.053 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.053 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.053 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:35.054 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888916+0000", 2024-09-13T06:42:35.054 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:35.054 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.054 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.054 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:35.054 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888915+0000", 2024-09-13T06:42:35.054 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:35.054 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.054 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.054 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:35.054 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888918+0000", 2024-09-13T06:42:35.054 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1500000000000002e-06 2024-09-13T06:42:35.054 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.054 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.055 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:35.055 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888925+0000", 2024-09-13T06:42:35.055 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.9380000000000003e-06 2024-09-13T06:42:35.055 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.055 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.055 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:35.055 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888933+0000", 2024-09-13T06:42:35.055 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.0560000000000005e-06 2024-09-13T06:42:35.055 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.055 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.055 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:35.055 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.939026+0000", 2024-09-13T06:42:35.055 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.050093499999999999 2024-09-13T06:42:35.056 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.056 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.056 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:35.056 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.939068+0000", 2024-09-13T06:42:35.056 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.1705999999999997e-05 2024-09-13T06:42:35.056 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.056 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.056 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:35.056 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.939119+0000", 2024-09-13T06:42:35.056 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.1048999999999999e-05 2024-09-13T06:42:35.056 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:35.056 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:35.056 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:35.056 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.057 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.057 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:21989 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 12701696~4096 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:42:35.057 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.888938+0000", 2024-09-13T06:42:35.057 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 162.13436904400001, 2024-09-13T06:42:35.057 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.050294393999999999, 2024-09-13T06:42:35.057 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:35.057 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:35.057 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:35.057 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:35.057 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:35.057 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 21989 2024-09-13T06:42:35.057 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.057 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:35.057 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.058 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:35.058 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888938+0000", 2024-09-13T06:42:35.058 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:35.058 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.058 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.058 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:35.058 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888938+0000", 2024-09-13T06:42:35.058 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:35.058 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.058 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.058 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:35.058 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888938+0000", 2024-09-13T06:42:35.058 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:35.058 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.059 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.059 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:35.059 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888940+0000", 2024-09-13T06:42:35.059 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5330000000000001e-06 2024-09-13T06:42:35.059 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.059 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.059 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:35.059 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888947+0000", 2024-09-13T06:42:35.059 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.2389999999999999e-06 2024-09-13T06:42:35.059 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.059 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.059 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:35.059 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888952+0000", 2024-09-13T06:42:35.059 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.5720000000000002e-06 2024-09-13T06:42:35.059 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.060 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.060 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:35.060 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.939141+0000", 2024-09-13T06:42:35.060 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.050188903999999999 2024-09-13T06:42:35.060 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.060 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.060 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:35.060 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.939182+0000", 2024-09-13T06:42:35.060 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.0926000000000001e-05 2024-09-13T06:42:35.060 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.060 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.060 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:35.060 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.939233+0000", 2024-09-13T06:42:35.060 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0532999999999999e-05 2024-09-13T06:42:35.061 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:35.061 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:35.061 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:35.061 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.061 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.061 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:22007 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 13217792~4096 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:42:35.061 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.892771+0000", 2024-09-13T06:42:35.061 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 162.13053593800001, 2024-09-13T06:42:35.061 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049090024000000003, 2024-09-13T06:42:35.061 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:35.061 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:35.061 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:35.061 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:35.061 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:35.062 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 22007 2024-09-13T06:42:35.062 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.062 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:35.062 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.062 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:35.062 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892771+0000", 2024-09-13T06:42:35.062 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:35.062 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.062 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.062 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:35.062 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892771+0000", 2024-09-13T06:42:35.062 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:35.062 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.062 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.063 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:35.063 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892771+0000", 2024-09-13T06:42:35.063 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:42:35.063 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.063 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.063 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:35.063 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892772+0000", 2024-09-13T06:42:35.063 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.184e-06 2024-09-13T06:42:35.063 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.063 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.063 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:35.063 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892775+0000", 2024-09-13T06:42:35.063 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9179999999999998e-06 2024-09-13T06:42:35.063 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.064 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.064 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:35.064 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892778+0000", 2024-09-13T06:42:35.064 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4990000000000001e-06 2024-09-13T06:42:35.064 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.064 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.064 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:35.064 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.941760+0000", 2024-09-13T06:42:35.064 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.048982070000000003 2024-09-13T06:42:35.064 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.064 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.064 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:35.064 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.941808+0000", 2024-09-13T06:42:35.065 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.8278000000000001e-05 2024-09-13T06:42:35.065 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.065 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.065 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:35.065 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.941861+0000", 2024-09-13T06:42:35.065 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3284e-05 2024-09-13T06:42:35.065 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:35.065 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:35.065 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:35.065 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.065 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.065 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:22008 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 13246464~4096 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:42:35.065 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.892780+0000", 2024-09-13T06:42:35.066 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 162.13052728100001, 2024-09-13T06:42:35.066 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049200477999999999, 2024-09-13T06:42:35.066 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:35.066 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:35.066 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:35.066 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:35.066 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:35.066 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 22008 2024-09-13T06:42:35.066 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.066 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:35.066 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.066 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:35.066 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892780+0000", 2024-09-13T06:42:35.066 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:35.066 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.067 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.067 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:35.067 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892780+0000", 2024-09-13T06:42:35.067 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:35.067 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.067 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.067 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:35.067 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892780+0000", 2024-09-13T06:42:35.067 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:42:35.067 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.067 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.067 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:35.067 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892781+0000", 2024-09-13T06:42:35.068 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.083e-06 2024-09-13T06:42:35.068 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.068 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.068 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:35.068 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892784+0000", 2024-09-13T06:42:35.068 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.926e-06 2024-09-13T06:42:35.068 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.068 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.068 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:35.068 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892786+0000", 2024-09-13T06:42:35.068 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4490000000000002e-06 2024-09-13T06:42:35.068 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.068 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.068 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:35.069 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.941888+0000", 2024-09-13T06:42:35.069 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049102290999999999 2024-09-13T06:42:35.069 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.069 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.069 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:35.069 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.941929+0000", 2024-09-13T06:42:35.069 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.0541999999999999e-05 2024-09-13T06:42:35.069 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.069 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.069 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:35.069 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.941980+0000", 2024-09-13T06:42:35.069 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.1391999999999999e-05 2024-09-13T06:42:35.069 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:35.070 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:35.070 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:35.070 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.070 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.070 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:22009 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 13275136~4096 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:42:35.070 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.892788+0000", 2024-09-13T06:42:35.070 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 162.13051879700001, 2024-09-13T06:42:35.070 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049311926999999998, 2024-09-13T06:42:35.070 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:35.070 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:35.070 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:35.070 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:35.070 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:35.070 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 22009 2024-09-13T06:42:35.070 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.071 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:35.071 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.071 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:35.071 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892788+0000", 2024-09-13T06:42:35.071 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:35.071 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.071 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.071 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:35.071 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892788+0000", 2024-09-13T06:42:35.071 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:35.071 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.071 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.071 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:35.071 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892788+0000", 2024-09-13T06:42:35.072 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:42:35.072 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.072 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.072 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:35.072 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892789+0000", 2024-09-13T06:42:35.072 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1850000000000001e-06 2024-09-13T06:42:35.072 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.072 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.072 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:35.072 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892793+0000", 2024-09-13T06:42:35.072 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.9099999999999998e-06 2024-09-13T06:42:35.072 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.072 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.072 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:35.073 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892798+0000", 2024-09-13T06:42:35.073 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5070000000000002e-06 2024-09-13T06:42:35.073 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.073 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.073 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:35.073 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.942007+0000", 2024-09-13T06:42:35.073 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049208904999999997 2024-09-13T06:42:35.073 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.073 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.073 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:35.073 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.942049+0000", 2024-09-13T06:42:35.073 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.1922000000000003e-05 2024-09-13T06:42:35.073 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.074 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.074 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:35.074 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.942100+0000", 2024-09-13T06:42:35.074 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.1736000000000001e-05 2024-09-13T06:42:35.074 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:35.074 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:35.074 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:35.074 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.074 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.074 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:22010 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 13303808~4096 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:42:35.074 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.892817+0000", 2024-09-13T06:42:35.074 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 162.13049060099999, 2024-09-13T06:42:35.074 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049466149000000001, 2024-09-13T06:42:35.074 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:35.074 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:35.075 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:35.075 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:35.075 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:35.075 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 22010 2024-09-13T06:42:35.075 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.075 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:35.075 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.075 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:35.075 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892817+0000", 2024-09-13T06:42:35.075 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:35.075 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.075 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.075 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:35.075 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892817+0000", 2024-09-13T06:42:35.076 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:35.076 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.076 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.076 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:35.076 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892816+0000", 2024-09-13T06:42:35.076 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:35.076 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.076 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.076 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:35.076 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892821+0000", 2024-09-13T06:42:35.076 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9459999999999997e-06 2024-09-13T06:42:35.076 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.076 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.076 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:35.077 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892828+0000", 2024-09-13T06:42:35.077 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.6780000000000003e-06 2024-09-13T06:42:35.077 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.077 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.077 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:35.077 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892833+0000", 2024-09-13T06:42:35.077 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.8389999999999997e-06 2024-09-13T06:42:35.077 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.077 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.077 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:35.077 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.942127+0000", 2024-09-13T06:42:35.077 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049294163000000002 2024-09-13T06:42:35.077 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.077 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.077 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:35.078 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.942186+0000", 2024-09-13T06:42:35.078 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9335e-05 2024-09-13T06:42:35.078 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.078 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.078 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:35.078 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.942283+0000", 2024-09-13T06:42:35.078 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.6699000000000004e-05 2024-09-13T06:42:35.078 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:35.078 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:35.078 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:35.078 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.078 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.078 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:22011 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 13332480~4096 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:42:35.078 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.892838+0000", 2024-09-13T06:42:35.079 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 162.13046891400001, 2024-09-13T06:42:35.079 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049589214, 2024-09-13T06:42:35.079 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:35.079 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:35.079 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:35.079 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:35.079 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:35.079 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 22011 2024-09-13T06:42:35.079 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.079 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:35.079 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.079 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:35.079 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892838+0000", 2024-09-13T06:42:35.079 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:35.079 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.080 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.080 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:35.080 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892838+0000", 2024-09-13T06:42:35.080 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:35.080 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.080 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.080 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:35.080 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892838+0000", 2024-09-13T06:42:35.080 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:35.080 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.080 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.080 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:35.080 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892840+0000", 2024-09-13T06:42:35.081 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.136e-06 2024-09-13T06:42:35.081 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.081 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.081 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:35.081 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892852+0000", 2024-09-13T06:42:35.081 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2122e-05 2024-09-13T06:42:35.081 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.081 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.081 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:35.081 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892862+0000", 2024-09-13T06:42:35.081 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.7049999999999994e-06 2024-09-13T06:42:35.081 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.081 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.081 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:35.082 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.942319+0000", 2024-09-13T06:42:35.082 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049456623999999998 2024-09-13T06:42:35.082 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.082 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.082 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:35.082 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.942363+0000", 2024-09-13T06:42:35.082 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4759000000000003e-05 2024-09-13T06:42:35.082 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.082 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.082 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:35.082 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.942428+0000", 2024-09-13T06:42:35.082 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.4221999999999996e-05 2024-09-13T06:42:35.082 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:35.082 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:35.082 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:35.083 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.083 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.083 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:22338 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 13611008~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:42:35.083 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.951070+0000", 2024-09-13T06:42:35.083 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 162.07223739299999, 2024-09-13T06:42:35.083 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049135817999999998, 2024-09-13T06:42:35.083 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:35.083 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:35.083 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:35.083 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:35.083 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:35.083 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 22338 2024-09-13T06:42:35.083 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.083 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:35.084 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.084 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:35.084 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951070+0000", 2024-09-13T06:42:35.084 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:35.084 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.084 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.084 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:35.084 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951070+0000", 2024-09-13T06:42:35.084 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:35.084 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.084 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.084 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:35.084 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951069+0000", 2024-09-13T06:42:35.084 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:35.084 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.085 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.085 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:35.085 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951072+0000", 2024-09-13T06:42:35.085 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5909999999999998e-06 2024-09-13T06:42:35.085 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.085 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.085 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:35.085 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951078+0000", 2024-09-13T06:42:35.085 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.4450000000000001e-06 2024-09-13T06:42:35.085 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.085 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.085 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:35.085 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951083+0000", 2024-09-13T06:42:35.085 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7790000000000003e-06 2024-09-13T06:42:35.085 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.086 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.086 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:35.086 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:53.000020+0000", 2024-09-13T06:42:35.086 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.048936999000000002 2024-09-13T06:42:35.086 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.086 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.086 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:35.086 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:53.000106+0000", 2024-09-13T06:42:35.086 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.5532999999999996e-05 2024-09-13T06:42:35.086 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.086 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.086 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:35.086 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:53.000206+0000", 2024-09-13T06:42:35.086 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.9852999999999994e-05 2024-09-13T06:42:35.086 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:35.087 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:35.087 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:35.087 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.087 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.087 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:22339 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 13639680~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:42:35.087 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.951088+0000", 2024-09-13T06:42:35.087 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 162.072219695, 2024-09-13T06:42:35.087 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049238202000000002, 2024-09-13T06:42:35.087 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:35.087 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:35.087 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:35.087 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:35.087 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:35.087 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 22339 2024-09-13T06:42:35.087 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.087 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:35.088 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.088 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:35.088 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951088+0000", 2024-09-13T06:42:35.088 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:35.088 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.088 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.088 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:35.088 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951088+0000", 2024-09-13T06:42:35.088 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:35.088 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.088 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.088 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:35.088 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951087+0000", 2024-09-13T06:42:35.088 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:35.088 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.088 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.089 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:35.089 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951089+0000", 2024-09-13T06:42:35.089 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.153e-06 2024-09-13T06:42:35.089 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.089 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.089 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:35.089 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951093+0000", 2024-09-13T06:42:35.089 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.7120000000000002e-06 2024-09-13T06:42:35.089 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.089 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.089 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:35.089 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951096+0000", 2024-09-13T06:42:35.089 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.0570000000000001e-06 2024-09-13T06:42:35.089 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.089 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.090 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:35.090 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:53.000220+0000", 2024-09-13T06:42:35.090 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049123989 2024-09-13T06:42:35.090 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.090 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.090 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:35.090 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:53.000271+0000", 2024-09-13T06:42:35.090 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.062e-05 2024-09-13T06:42:35.090 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.090 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.090 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:35.090 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:53.000326+0000", 2024-09-13T06:42:35.090 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.5121000000000003e-05 2024-09-13T06:42:35.090 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:35.090 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:35.091 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:35.091 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.091 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.091 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:22340 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 13668352~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:42:35.091 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.951200+0000", 2024-09-13T06:42:35.091 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 162.07210680599999, 2024-09-13T06:42:35.091 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049352350000000003, 2024-09-13T06:42:35.091 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:35.091 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:35.091 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:35.091 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:35.091 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:35.091 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 22340 2024-09-13T06:42:35.091 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.092 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:35.092 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.092 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:35.092 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951200+0000", 2024-09-13T06:42:35.092 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:35.092 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.092 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.092 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:35.092 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951200+0000", 2024-09-13T06:42:35.092 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:35.092 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.092 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.092 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:35.092 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951098+0000", 2024-09-13T06:42:35.092 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.999898 2024-09-13T06:42:35.093 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.093 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.093 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:35.093 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951204+0000", 2024-09-13T06:42:35.093 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000105398 2024-09-13T06:42:35.093 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.093 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.093 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:35.093 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951211+0000", 2024-09-13T06:42:35.093 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.43e-06 2024-09-13T06:42:35.093 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.093 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.093 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:35.094 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951216+0000", 2024-09-13T06:42:35.094 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2800000000000003e-06 2024-09-13T06:42:35.094 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.094 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.094 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:35.094 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:53.000358+0000", 2024-09-13T06:42:35.094 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049142036 2024-09-13T06:42:35.094 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.094 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.094 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:35.094 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:53.000443+0000", 2024-09-13T06:42:35.094 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.4710999999999996e-05 2024-09-13T06:42:35.094 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.094 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.095 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:35.095 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:53.000553+0000", 2024-09-13T06:42:35.095 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000109622 2024-09-13T06:42:35.095 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:35.095 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:35.095 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:35.095 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.095 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.095 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:22348 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 13897728~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:42:35.095 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.952783+0000", 2024-09-13T06:42:35.095 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 162.07052401799999, 2024-09-13T06:42:35.095 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049120832000000003, 2024-09-13T06:42:35.095 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:35.095 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:35.096 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:35.096 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:35.096 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:35.096 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 22348 2024-09-13T06:42:35.096 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.096 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:35.096 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.096 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:35.096 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.952783+0000", 2024-09-13T06:42:35.096 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:35.096 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.096 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.096 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:35.096 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.952783+0000", 2024-09-13T06:42:35.097 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:35.097 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.097 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.097 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:35.097 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.952783+0000", 2024-09-13T06:42:35.097 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:35.097 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.097 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.097 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:35.097 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.952785+0000", 2024-09-13T06:42:35.097 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4980000000000001e-06 2024-09-13T06:42:35.097 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.097 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.097 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:35.097 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.952799+0000", 2024-09-13T06:42:35.098 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3825000000000001e-05 2024-09-13T06:42:35.098 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.098 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.098 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:35.098 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.952809+0000", 2024-09-13T06:42:35.098 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0043e-05 2024-09-13T06:42:35.098 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.098 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.098 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:35.098 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:53.001723+0000", 2024-09-13T06:42:35.098 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.048914065 2024-09-13T06:42:35.098 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.098 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.098 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:35.098 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:53.001807+0000", 2024-09-13T06:42:35.099 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.3776000000000006e-05 2024-09-13T06:42:35.099 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.099 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.099 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:35.099 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:53.001904+0000", 2024-09-13T06:42:35.099 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.7004999999999997e-05 2024-09-13T06:42:35.099 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:35.099 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:35.099 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:35.099 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.099 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.099 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:69045 3.0 3:05ea3821:::rbd_data.1121867cc19b.0000000000000000:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109)", 2024-09-13T06:42:35.099 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:41:03.637760+0000", 2024-09-13T06:42:35.100 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 91.385547259999996, 2024-09-13T06:42:35.100 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.052276712000000003, 2024-09-13T06:42:35.100 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:35.100 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:42:35.100 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:35.100 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:35.100 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:35.100 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 69045 2024-09-13T06:42:35.100 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.100 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:35.100 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.100 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:35.101 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:03.637760+0000", 2024-09-13T06:42:35.101 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:35.101 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.101 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.101 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:35.101 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:03.637760+0000", 2024-09-13T06:42:35.101 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:35.101 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.101 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.101 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:35.101 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:03.637758+0000", 2024-09-13T06:42:35.101 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999981 2024-09-13T06:42:35.101 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.101 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.101 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:35.101 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:03.637770+0000", 2024-09-13T06:42:35.102 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1533e-05 2024-09-13T06:42:35.102 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.102 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.102 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:35.102 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:03.637794+0000", 2024-09-13T06:42:35.102 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4243000000000002e-05 2024-09-13T06:42:35.102 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.102 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.102 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:35.102 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:03.637806+0000", 2024-09-13T06:42:35.102 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2033e-05 2024-09-13T06:42:35.102 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.102 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.103 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:35.103 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:03.637891+0000", 2024-09-13T06:42:35.103 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.5358000000000005e-05 2024-09-13T06:42:35.103 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.103 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.103 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:35.103 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:03.638042+0000", 2024-09-13T06:42:35.103 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000151073 2024-09-13T06:42:35.103 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.103 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.103 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 2", 2024-09-13T06:42:35.103 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:03.647124+0000", 2024-09-13T06:42:35.103 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0090821670000000004 2024-09-13T06:42:35.103 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.104 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.104 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:42:35.104 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:03.689849+0000", 2024-09-13T06:42:35.104 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.042724445999999999 2024-09-13T06:42:35.104 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.104 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.104 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-09-13T06:42:35.104 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:03.689871+0000", 2024-09-13T06:42:35.104 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1778999999999999e-05 2024-09-13T06:42:35.104 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.104 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.104 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:42:35.104 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:03.689965+0000", 2024-09-13T06:42:35.104 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.4312000000000001e-05 2024-09-13T06:42:35.104 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.105 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.105 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:35.105 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:03.690037+0000", 2024-09-13T06:42:35.105 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.1687999999999995e-05 2024-09-13T06:42:35.105 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:35.105 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:35.105 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:35.105 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.105 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.105 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:90987 3.6 3:6263dd97:::rbd_object_map.11212443ae03.0000000000000049:head [call] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-13T06:42:35.105 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:41:35.460333+0000", 2024-09-13T06:42:35.105 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 59.562973872999997, 2024-09-13T06:42:35.105 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0001633640000001, 2024-09-13T06:42:35.105 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:35.105 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:35.105 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:35.106 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:35.106 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:35.106 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 90987 2024-09-13T06:42:35.106 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.106 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:35.106 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.106 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:35.106 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:35.460333+0000", 2024-09-13T06:42:35.106 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:35.106 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.106 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.106 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:35.106 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:35.460333+0000", 2024-09-13T06:42:35.106 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:35.106 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.106 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.107 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:35.107 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:35.460330+0000", 2024-09-13T06:42:35.107 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999971 2024-09-13T06:42:35.107 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.107 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.107 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:35.107 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:35.460343+0000", 2024-09-13T06:42:35.107 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2695e-05 2024-09-13T06:42:35.107 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.107 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.107 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:35.107 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:35.460365+0000", 2024-09-13T06:42:35.107 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2473999999999999e-05 2024-09-13T06:42:35.107 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.107 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.108 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:35.108 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:35.460376+0000", 2024-09-13T06:42:35.108 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0383999999999999e-05 2024-09-13T06:42:35.108 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.108 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.108 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:35.108 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:35.460435+0000", 2024-09-13T06:42:35.108 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8650000000000003e-05 2024-09-13T06:42:35.108 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.108 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.108 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:42:35.108 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:35.460444+0000", 2024-09-13T06:42:35.108 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.0380000000000005e-06 2024-09-13T06:42:35.108 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.109 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.109 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:35.109 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:36.459433+0000", 2024-09-13T06:42:35.109 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.99898895799999998 2024-09-13T06:42:35.109 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.109 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.109 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:35.109 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:36.459622+0000", 2024-09-13T06:42:35.109 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00018940299999999999 2024-09-13T06:42:35.109 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.109 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.109 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:35.109 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:36.460497+0000", 2024-09-13T06:42:35.109 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00087481199999999999 2024-09-13T06:42:35.110 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:35.110 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:35.110 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:35.110 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.110 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.110 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:159632 3.a 3:57f62123:::rbd_header.112138ed422:head [create,call rbd.create in=9b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e167)", 2024-09-13T06:42:35.110 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:42:07.853351+0000", 2024-09-13T06:42:35.110 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 27.169956071000001, 2024-09-13T06:42:35.110 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.95572760999999995, 2024-09-13T06:42:35.110 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:35.110 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:42:35.110 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:35.110 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:35.110 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:35.111 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 159632 2024-09-13T06:42:35.111 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.111 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:35.111 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.111 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:35.111 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:07.853351+0000", 2024-09-13T06:42:35.111 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:35.111 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.111 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.111 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:35.111 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:07.853351+0000", 2024-09-13T06:42:35.111 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:35.111 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.111 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.111 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:35.112 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:07.853350+0000", 2024-09-13T06:42:35.112 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.999999 2024-09-13T06:42:35.112 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.112 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.112 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:35.112 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:07.853356+0000", 2024-09-13T06:42:35.112 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.1560000000000003e-06 2024-09-13T06:42:35.112 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.112 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.112 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:35.112 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:07.853365+0000", 2024-09-13T06:42:35.112 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.8079999999999999e-06 2024-09-13T06:42:35.112 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.112 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.113 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:35.113 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:07.853372+0000", 2024-09-13T06:42:35.113 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.5540000000000003e-06 2024-09-13T06:42:35.113 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.113 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.113 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:35.113 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:07.853430+0000", 2024-09-13T06:42:35.113 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8038000000000002e-05 2024-09-13T06:42:35.113 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.113 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.113 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:42:35.113 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:07.853444+0000", 2024-09-13T06:42:35.113 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3719e-05 2024-09-13T06:42:35.113 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.114 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.114 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:35.114 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:08.804052+0000", 2024-09-13T06:42:35.114 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.95060817799999997 2024-09-13T06:42:35.114 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.114 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.114 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:35.114 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:08.804234+0000", 2024-09-13T06:42:35.114 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00018192999999999999 2024-09-13T06:42:35.114 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.114 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.114 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 6", 2024-09-13T06:42:35.114 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:08.804797+0000", 2024-09-13T06:42:35.114 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00056282399999999996 2024-09-13T06:42:35.114 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.115 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.115 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-09-13T06:42:35.115 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:08.805704+0000", 2024-09-13T06:42:35.115 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00090781 2024-09-13T06:42:35.115 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.115 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.115 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:42:35.115 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:08.808907+0000", 2024-09-13T06:42:35.115 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0032031239999999999 2024-09-13T06:42:35.115 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.115 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.115 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:42:35.115 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:08.808998+0000", 2024-09-13T06:42:35.115 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.0191000000000004e-05 2024-09-13T06:42:35.115 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.115 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.116 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:35.116 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:08.809079+0000", 2024-09-13T06:42:35.116 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.1076999999999996e-05 2024-09-13T06:42:35.116 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:35.116 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:35.116 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:35.116 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:35.116 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:35.116 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:42:35.117 INFO:teuthology.orchestra.run.smithi081.stdout:osd.5: {} 2024-09-13T06:42:35.117 INFO:teuthology.orchestra.run.smithi081.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-13T06:42:35.117 INFO:teuthology.orchestra.run.smithi081.stdout:4722 trunc from 0xaae3451 to 0x2b7bf0d 2024-09-13T06:42:35.118 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-13T06:42:35.119 INFO:teuthology.orchestra.run.smithi081.stdout:osd.6: {} 2024-09-13T06:42:35.119 INFO:teuthology.orchestra.run.smithi081.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-13T06:42:35.119 INFO:teuthology.orchestra.run.smithi081.stdout:osd.7: {} 2024-09-13T06:42:35.120 INFO:teuthology.orchestra.run.smithi081.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-13T06:42:35.120 INFO:teuthology.orchestra.run.smithi081.stdout:4723 punch from 0x49882d to 0x49ef6c, (0x673f bytes) 2024-09-13T06:42:35.120 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:42:35.113+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:42:35.131 INFO:teuthology.orchestra.run.smithi081.stdout:4724 write 0xb0714c6 thru 0xb07e843 (0xd37e bytes) 2024-09-13T06:42:35.138 INFO:teuthology.orchestra.run.smithi081.stdout:4725 write 0x42dcf6a thru 0x42ea042 (0xd0d9 bytes) 2024-09-13T06:42:35.145 INFO:teuthology.orchestra.run.smithi081.stdout:4726 write 0x4322264 thru 0x432ed44 (0xcae1 bytes) 2024-09-13T06:42:35.152 INFO:teuthology.orchestra.run.smithi081.stdout:4727 punch from 0x2ee8dcc to 0x2ef6b39, (0xdd6d bytes) 2024-09-13T06:42:35.154 INFO:teuthology.orchestra.run.smithi081.stdout:4728 trunc from 0xb07e844 to 0x9af6ba3 2024-09-13T06:42:35.171 INFO:teuthology.orchestra.run.smithi081.stdout:4729 punch from 0x469fd67 to 0x46a5dd6, (0x606f bytes) 2024-09-13T06:42:35.171 INFO:teuthology.orchestra.run.smithi081.stdout:4730 write 0x99bc6bc thru 0x99be60a (0x1f4f bytes) 2024-09-13T06:42:35.177 INFO:teuthology.orchestra.run.smithi081.stdout:4731 punch from 0x54a9a59 to 0x54b2df1, (0x9398 bytes) 2024-09-13T06:42:35.177 INFO:teuthology.orchestra.run.smithi081.stdout:4733 write 0x22f43e8 thru 0x22f9a0e (0x5627 bytes) 2024-09-13T06:42:35.180 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:42:35.194 INFO:teuthology.orchestra.run.smithi081.stdout:4736 writesame 0xbb2765e thru 0xbb3557e data_size 0x1(0xdf21 bytes) 2024-09-13T06:42:35.194 INFO:teuthology.orchestra.run.smithi081.stdout:4737 punch from 0x6e21ba6 to 0x6e26a90, (0x4eea bytes) 2024-09-13T06:42:35.208 INFO:teuthology.orchestra.run.smithi081.stdout:4738 write 0xdd5fdcb thru 0xdd68632 (0x8868 bytes) 2024-09-13T06:42:35.216 INFO:teuthology.orchestra.run.smithi081.stdout:4739 read 0x47181aa thru 0x47191b5 (0x100c bytes) 2024-09-13T06:42:35.216 INFO:teuthology.orchestra.run.smithi081.stdout:4741 write 0x933de30 thru 0x9348e26 (0xaff7 bytes) 2024-09-13T06:42:35.217 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:42:35.212+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:42:35.226 INFO:teuthology.orchestra.run.smithi081.stdout:4742 punch from 0x4a6b013 to 0x4a78bec, (0xdbd9 bytes) 2024-09-13T06:42:35.227 INFO:teuthology.orchestra.run.smithi081.stdout:4744 writesame 0x6660e89 thru 0x6662821 data_size 0x1(0x1999 bytes) 2024-09-13T06:42:35.238 INFO:teuthology.orchestra.run.smithi081.stdout:4745 punch from 0x617b3ef to 0x61882f4, (0xcf05 bytes) 2024-09-13T06:42:35.238 INFO:teuthology.orchestra.run.smithi081.stdout:4746 read 0xcad4b41 thru 0xcae1f5d (0xd41d bytes) 2024-09-13T06:42:35.238 INFO:teuthology.orchestra.run.smithi081.stdout:4747 read 0xb1e4175 thru 0xb1e8faf (0x4e3b bytes) 2024-09-13T06:42:35.238 INFO:teuthology.orchestra.run.smithi081.stdout:4748 write 0xb21c2e1 thru 0xb21cf02 (0xc22 bytes) 2024-09-13T06:42:35.243 INFO:teuthology.orchestra.run.smithi081.stdout:4749 writesame 0xba2179b thru 0xba240a1 data_size 0x9(0x2907 bytes) 2024-09-13T06:42:35.250 INFO:teuthology.orchestra.run.smithi081.stdout:4750 write 0xb0d4f8b thru 0xb0dfd94 (0xae0a bytes) 2024-09-13T06:42:35.257 INFO:teuthology.orchestra.run.smithi081.stdout:4751 punch from 0xa1ca86d to 0xa1d4dba, (0xa54d bytes) 2024-09-13T06:42:35.257 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:42:35.257 INFO:teuthology.orchestra.run.smithi081.stdout:4755 writesame 0x24ea5fc thru 0x24ec78d data_size 0x1(0x2192 bytes) 2024-09-13T06:42:35.258 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:42:35.258 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-13T06:42:35.258 INFO:teuthology.orchestra.run.smithi081.stdout: "num_ops": 0 2024-09-13T06:42:35.259 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:42:35.268 INFO:teuthology.orchestra.run.smithi081.stdout:4756 read 0x4dca997 thru 0x4dd6190 (0xb7fa bytes) 2024-09-13T06:42:35.268 INFO:teuthology.orchestra.run.smithi081.stdout:4757 read 0xafa2f6b thru 0xafa4c5d (0x1cf3 bytes) 2024-09-13T06:42:35.268 INFO:teuthology.orchestra.run.smithi081.stdout:4758 write 0x1be4a0d thru 0x1bf1d25 (0xd319 bytes) 2024-09-13T06:42:35.274 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-13T06:42:35.284 INFO:teuthology.orchestra.run.smithi081.stdout:4759 trunc from 0xdd68633 to 0x66c1f1c 2024-09-13T06:42:35.312 INFO:teuthology.orchestra.run.smithi081.stdout:4762 punch from 0x1b9a3e6 to 0x1ba783a, (0xd454 bytes) 2024-09-13T06:42:35.312 INFO:teuthology.orchestra.run.smithi081.stdout:4765 read 0x4014f37 thru 0x40210e8 (0xc1b2 bytes) 2024-09-13T06:42:35.313 INFO:teuthology.orchestra.run.smithi081.stdout:4766 read 0x557c599 thru 0x558b407 (0xee6f bytes) 2024-09-13T06:42:35.313 INFO:teuthology.orchestra.run.smithi081.stdout:4767 writesame 0x3ca80d3 thru 0x3cacc03 data_size 0x1(0x4b31 bytes) 2024-09-13T06:42:35.318 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:42:35.313+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:42:35.340 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:42:35.349 INFO:teuthology.orchestra.run.smithi081.stdout:4769 trunc from 0x66c1f1c to 0xc49d318 2024-09-13T06:42:35.362 INFO:teuthology.orchestra.run.smithi081.stdout:4771 trunc from 0xc49d318 to 0xc0448e8 2024-09-13T06:42:35.375 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:42:35.375 INFO:teuthology.orchestra.run.smithi081.stdout:4773 write 0x45c3cd7 thru 0x45ce262 (0xa58c bytes) 2024-09-13T06:42:35.383 INFO:teuthology.orchestra.run.smithi081.stdout:4774 write 0x6dcb0f9 thru 0x6dd07ee (0x56f6 bytes) 2024-09-13T06:42:35.392 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:42:35.392 INFO:teuthology.orchestra.run.smithi081.stdout:4776 writesame 0x78bbc71 thru 0x78c013d data_size 0x1(0x44cd bytes) 2024-09-13T06:42:35.408 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:42:35.409 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-13T06:42:35.409 INFO:teuthology.orchestra.run.smithi081.stdout: "complaint_time": 30, 2024-09-13T06:42:35.409 INFO:teuthology.orchestra.run.smithi081.stdout: "num_blocked_ops": 0 2024-09-13T06:42:35.409 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:42:35.418 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:42:35.413+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:42:35.423 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-13T06:42:35.425 INFO:teuthology.orchestra.run.smithi081.stdout:4778 writesame 0x9edd788 thru 0x9ee43a0 data_size 0x1(0x6c19 bytes) 2024-09-13T06:42:35.446 INFO:teuthology.orchestra.run.smithi081.stdout:4779 write 0x4b3811f thru 0x4b41b7e (0x9a60 bytes) 2024-09-13T06:42:35.454 INFO:teuthology.orchestra.run.smithi081.stdout:4782 writesame 0x1ec99a thru 0x1f010e data_size 0x1(0x3775 bytes) 2024-09-13T06:42:35.464 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:42:35.464 INFO:teuthology.orchestra.run.smithi081.stdout:4784 write 0x75a1afd thru 0x75a5f24 (0x4428 bytes) 2024-09-13T06:42:35.474 INFO:teuthology.orchestra.run.smithi081.stdout:4785 trunc from 0xc0448e8 to 0x79a75f3 2024-09-13T06:42:35.519 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:42:35.516+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:42:35.520 INFO:teuthology.orchestra.run.smithi081.stdout:4786 writesame 0xb9af793 thru 0xb9bddd8 data_size 0x6(0xe646 bytes) 2024-09-13T06:42:35.520 INFO:teuthology.orchestra.run.smithi081.stdout:4787 clone 37 order 22 su 1048576 sc 12 2024-09-13T06:42:35.547 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:42:35.547 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 20, 2024-09-13T06:42:35.548 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 600, 2024-09-13T06:42:35.548 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [ 2024-09-13T06:42:35.548 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.548 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:36160 3.f 3:f62782c2:::rbd_object_map.11219660270d.0000000000000016:head [call] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-13T06:42:35.548 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:01.607291+0000", 2024-09-13T06:42:35.548 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 153.94040774999999, 2024-09-13T06:42:35.548 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.99619456699999998, 2024-09-13T06:42:35.548 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:35.548 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:35.548 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:35.548 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:35.548 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:35.549 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 36160 2024-09-13T06:42:35.549 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.549 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:35.549 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.549 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:35.549 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:01.607291+0000", 2024-09-13T06:42:35.549 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:35.549 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.549 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.549 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:35.549 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:01.607291+0000", 2024-09-13T06:42:35.549 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:35.549 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.549 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.550 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:35.550 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:01.607289+0000", 2024-09-13T06:42:35.550 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999976 2024-09-13T06:42:35.550 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.550 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.550 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:35.550 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:01.607302+0000", 2024-09-13T06:42:35.550 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3018e-05 2024-09-13T06:42:35.550 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.550 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.550 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:35.550 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:01.607323+0000", 2024-09-13T06:42:35.550 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1030999999999999e-05 2024-09-13T06:42:35.550 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.551 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.551 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:35.551 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:01.607342+0000", 2024-09-13T06:42:35.551 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8961e-05 2024-09-13T06:42:35.551 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.551 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.551 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:35.551 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:01.607425+0000", 2024-09-13T06:42:35.551 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.3171999999999996e-05 2024-09-13T06:42:35.551 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.551 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.551 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:42:35.551 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:01.607441+0000", 2024-09-13T06:42:35.552 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5996999999999999e-05 2024-09-13T06:42:35.552 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.552 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.552 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:35.552 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:02.596186+0000", 2024-09-13T06:42:35.552 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.98874432000000001 2024-09-13T06:42:35.552 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.552 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.552 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for missing object", 2024-09-13T06:42:35.552 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:02.596618+0000", 2024-09-13T06:42:35.553 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000432032 2024-09-13T06:42:35.553 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.553 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.553 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:35.553 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:02.600845+0000", 2024-09-13T06:42:35.553 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0042277410000000001 2024-09-13T06:42:35.553 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.553 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.553 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:35.553 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:02.601003+0000", 2024-09-13T06:42:35.553 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00015731999999999999 2024-09-13T06:42:35.553 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.553 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.553 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:35.554 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:02.603486+0000", 2024-09-13T06:42:35.554 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0024832510000000001 2024-09-13T06:42:35.554 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:35.554 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:35.554 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:35.554 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.554 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.554 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:37806 3.9 3:951cb95b:::rbd_data.1121d8143c6e.0000000000000002:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e56)", 2024-09-13T06:42:35.554 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:06.373482+0000", 2024-09-13T06:42:35.554 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 149.17421671400001, 2024-09-13T06:42:35.554 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.002476213, 2024-09-13T06:42:35.555 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:35.555 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:35.555 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:35.555 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:35.555 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:35.555 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 37806 2024-09-13T06:42:35.555 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.555 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:35.555 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.555 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:35.555 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.373482+0000", 2024-09-13T06:42:35.555 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:35.556 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.556 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.556 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:35.556 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.373482+0000", 2024-09-13T06:42:35.556 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:35.556 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.556 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.556 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:35.556 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.373479+0000", 2024-09-13T06:42:35.556 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999962 2024-09-13T06:42:35.556 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.556 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.556 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:35.556 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.373495+0000", 2024-09-13T06:42:35.557 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6640999999999999e-05 2024-09-13T06:42:35.557 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.557 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.557 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:35.557 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.373542+0000", 2024-09-13T06:42:35.557 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6229000000000001e-05 2024-09-13T06:42:35.557 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.557 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.557 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:35.557 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.373564+0000", 2024-09-13T06:42:35.557 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2684000000000002e-05 2024-09-13T06:42:35.558 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.558 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.558 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:35.558 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374268+0000", 2024-09-13T06:42:35.558 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00070363700000000001 2024-09-13T06:42:35.558 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.558 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.558 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:42:35.558 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374305+0000", 2024-09-13T06:42:35.558 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.6936e-05 2024-09-13T06:42:35.558 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.559 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.559 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:35.559 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.375175+0000", 2024-09-13T06:42:35.559 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.000870454 2024-09-13T06:42:35.559 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.559 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.559 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:35.559 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.375678+0000", 2024-09-13T06:42:35.559 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00050292499999999999 2024-09-13T06:42:35.559 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.559 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.559 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:35.559 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.375959+0000", 2024-09-13T06:42:35.559 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00028050599999999997 2024-09-13T06:42:35.560 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:35.560 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:35.560 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:35.560 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.560 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.560 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:37821 3.9 3:951cb95b:::rbd_data.1121d8143c6e.0000000000000002:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e56)", 2024-09-13T06:42:35.560 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:06.374454+0000", 2024-09-13T06:42:35.560 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 149.173245597, 2024-09-13T06:42:35.560 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.002545072, 2024-09-13T06:42:35.560 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:35.560 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:35.560 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:35.560 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:35.560 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:35.560 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 37821 2024-09-13T06:42:35.561 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.561 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:35.561 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.561 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:35.561 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374454+0000", 2024-09-13T06:42:35.561 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:35.561 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.561 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.561 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:35.561 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374454+0000", 2024-09-13T06:42:35.561 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:35.561 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.561 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.561 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:35.562 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374452+0000", 2024-09-13T06:42:35.562 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999981 2024-09-13T06:42:35.562 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.562 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.562 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:35.562 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374463+0000", 2024-09-13T06:42:35.562 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0756e-05 2024-09-13T06:42:35.562 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.562 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.562 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:35.562 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374487+0000", 2024-09-13T06:42:35.562 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4887000000000001e-05 2024-09-13T06:42:35.562 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.563 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.563 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:35.563 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374504+0000", 2024-09-13T06:42:35.563 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6852000000000001e-05 2024-09-13T06:42:35.563 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.563 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.563 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:35.563 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374829+0000", 2024-09-13T06:42:35.563 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000324684 2024-09-13T06:42:35.563 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.563 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.563 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:42:35.564 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374880+0000", 2024-09-13T06:42:35.564 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.1378000000000002e-05 2024-09-13T06:42:35.564 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.564 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.564 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:35.564 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.376423+0000", 2024-09-13T06:42:35.564 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.001542734 2024-09-13T06:42:35.564 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.564 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.564 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:35.564 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.376607+0000", 2024-09-13T06:42:35.564 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000183656 2024-09-13T06:42:35.564 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.564 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.564 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:35.565 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.376999+0000", 2024-09-13T06:42:35.565 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00039191200000000001 2024-09-13T06:42:35.565 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:35.565 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:35.565 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:35.565 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.565 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.565 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:37836 3.9 3:951cb95b:::rbd_data.1121d8143c6e.0000000000000002:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e56)", 2024-09-13T06:42:35.565 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:06.374929+0000", 2024-09-13T06:42:35.566 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 149.172769945, 2024-09-13T06:42:35.566 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.002778825, 2024-09-13T06:42:35.566 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:35.566 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:35.566 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:35.566 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:35.566 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:35.566 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 37836 2024-09-13T06:42:35.566 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.566 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:35.566 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.566 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:35.566 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374929+0000", 2024-09-13T06:42:35.566 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:35.567 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.567 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.567 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:35.567 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374929+0000", 2024-09-13T06:42:35.567 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:35.567 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.567 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.567 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:35.567 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374927+0000", 2024-09-13T06:42:35.567 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999981 2024-09-13T06:42:35.567 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.567 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.567 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:35.568 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374939+0000", 2024-09-13T06:42:35.568 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1846e-05 2024-09-13T06:42:35.568 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.568 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.568 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:35.568 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374962+0000", 2024-09-13T06:42:35.568 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3054e-05 2024-09-13T06:42:35.568 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.568 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.568 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:35.568 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374978+0000", 2024-09-13T06:42:35.568 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5899000000000001e-05 2024-09-13T06:42:35.568 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.569 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.569 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:35.569 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.375106+0000", 2024-09-13T06:42:35.569 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00012789 2024-09-13T06:42:35.569 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.569 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.569 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:42:35.569 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.375134+0000", 2024-09-13T06:42:35.569 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.8254000000000001e-05 2024-09-13T06:42:35.569 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.569 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.569 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:35.569 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.377082+0000", 2024-09-13T06:42:35.570 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0019471520000001 2024-09-13T06:42:35.570 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.570 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.570 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:35.570 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.377330+0000", 2024-09-13T06:42:35.570 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00024834199999999997 2024-09-13T06:42:35.570 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.570 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.570 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:35.570 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.377708+0000", 2024-09-13T06:42:35.570 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00037817100000000001 2024-09-13T06:42:35.570 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:35.570 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:35.571 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:35.571 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.571 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.571 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:37851 3.9 3:951cb95b:::rbd_data.1121d8143c6e.0000000000000002:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e56)", 2024-09-13T06:42:35.571 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:06.382636+0000", 2024-09-13T06:42:35.571 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 149.16506305999999, 2024-09-13T06:42:35.571 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.99582539400000003, 2024-09-13T06:42:35.571 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:35.571 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:35.571 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:35.571 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:35.571 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:35.571 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 37851 2024-09-13T06:42:35.572 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.572 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:35.572 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.572 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:35.572 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.382636+0000", 2024-09-13T06:42:35.572 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:35.572 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.572 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.572 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:35.573 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.382636+0000", 2024-09-13T06:42:35.573 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:35.573 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.573 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.573 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:35.573 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.382633+0000", 2024-09-13T06:42:35.573 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999971 2024-09-13T06:42:35.573 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.573 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.573 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:35.573 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.382652+0000", 2024-09-13T06:42:35.573 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8834999999999998e-05 2024-09-13T06:42:35.573 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.574 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.574 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:35.574 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.382695+0000", 2024-09-13T06:42:35.574 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.3136000000000002e-05 2024-09-13T06:42:35.574 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.574 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.574 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:35.574 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.382716+0000", 2024-09-13T06:42:35.574 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1421e-05 2024-09-13T06:42:35.574 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.574 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.574 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:35.574 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.382860+0000", 2024-09-13T06:42:35.574 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00014389200000000001 2024-09-13T06:42:35.574 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.575 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.575 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:42:35.575 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.382890+0000", 2024-09-13T06:42:35.575 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9827000000000001e-05 2024-09-13T06:42:35.575 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.575 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.575 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:35.575 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.377779+0000", 2024-09-13T06:42:35.575 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.99488842899999996 2024-09-13T06:42:35.575 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.575 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.575 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:35.576 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.378007+0000", 2024-09-13T06:42:35.576 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00022838099999999999 2024-09-13T06:42:35.576 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.576 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.576 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:35.576 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.378462+0000", 2024-09-13T06:42:35.576 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00045452300000000003 2024-09-13T06:42:35.576 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:35.576 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:35.576 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:35.576 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.576 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.577 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:37866 3.9 3:951cb95b:::rbd_data.1121d8143c6e.0000000000000002:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e56)", 2024-09-13T06:42:35.577 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:06.383951+0000", 2024-09-13T06:42:35.577 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 149.16374837399999, 2024-09-13T06:42:35.577 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.99517962299999996, 2024-09-13T06:42:35.577 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:35.577 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:35.577 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:35.577 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:35.577 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:35.577 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 37866 2024-09-13T06:42:35.577 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.577 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:35.577 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.577 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:35.578 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.383951+0000", 2024-09-13T06:42:35.578 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:35.578 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.578 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.578 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:35.578 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.383951+0000", 2024-09-13T06:42:35.578 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:35.578 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.578 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.578 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:35.578 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.383949+0000", 2024-09-13T06:42:35.578 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999981 2024-09-13T06:42:35.578 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.579 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.579 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:35.579 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.383961+0000", 2024-09-13T06:42:35.579 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1999e-05 2024-09-13T06:42:35.579 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.579 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.579 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:35.579 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384019+0000", 2024-09-13T06:42:35.579 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7621000000000003e-05 2024-09-13T06:42:35.579 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.579 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.579 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:35.579 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384040+0000", 2024-09-13T06:42:35.579 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1528000000000001e-05 2024-09-13T06:42:35.579 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.580 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.580 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:35.580 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384186+0000", 2024-09-13T06:42:35.580 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00014573799999999999 2024-09-13T06:42:35.580 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.580 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.580 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:42:35.580 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384204+0000", 2024-09-13T06:42:35.580 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7992e-05 2024-09-13T06:42:35.580 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.580 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.580 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:35.580 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.378536+0000", 2024-09-13T06:42:35.581 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.99433268600000002 2024-09-13T06:42:35.581 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.581 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.581 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:35.581 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.378771+0000", 2024-09-13T06:42:35.581 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00023445399999999999 2024-09-13T06:42:35.581 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.581 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.581 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:35.581 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.379130+0000", 2024-09-13T06:42:35.581 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00035954200000000002 2024-09-13T06:42:35.581 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:35.582 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:35.582 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:35.582 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.582 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.582 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:37881 3.9 3:951cb95b:::rbd_data.1121d8143c6e.0000000000000002:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e56)", 2024-09-13T06:42:35.582 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:06.384239+0000", 2024-09-13T06:42:35.582 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 149.16345996000001, 2024-09-13T06:42:35.582 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.99541483500000005, 2024-09-13T06:42:35.582 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:35.582 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:35.582 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:35.582 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:35.582 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:35.583 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 37881 2024-09-13T06:42:35.583 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.583 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:35.583 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.583 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:35.583 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384239+0000", 2024-09-13T06:42:35.583 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:35.583 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.583 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.583 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:35.584 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384239+0000", 2024-09-13T06:42:35.584 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:35.584 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.584 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.584 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:35.584 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384238+0000", 2024-09-13T06:42:35.584 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999986 2024-09-13T06:42:35.584 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.584 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.584 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:35.584 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384246+0000", 2024-09-13T06:42:35.584 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.2449999999999998e-06 2024-09-13T06:42:35.584 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.584 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.584 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:35.585 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384268+0000", 2024-09-13T06:42:35.585 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1518e-05 2024-09-13T06:42:35.585 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.585 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.585 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:35.585 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384282+0000", 2024-09-13T06:42:35.585 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4501999999999999e-05 2024-09-13T06:42:35.585 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.585 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.585 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:35.585 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384356+0000", 2024-09-13T06:42:35.585 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4265999999999997e-05 2024-09-13T06:42:35.585 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.586 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.586 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:42:35.586 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384370+0000", 2024-09-13T06:42:35.586 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3942e-05 2024-09-13T06:42:35.586 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.586 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.586 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:35.586 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.379199+0000", 2024-09-13T06:42:35.586 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.99482866599999997 2024-09-13T06:42:35.586 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.587 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.587 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:35.587 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.379347+0000", 2024-09-13T06:42:35.587 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00014749199999999999 2024-09-13T06:42:35.587 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.587 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.587 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:35.587 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.379654+0000", 2024-09-13T06:42:35.587 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00030752999999999998 2024-09-13T06:42:35.587 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:35.587 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:35.587 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:35.587 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.587 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.588 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:37896 3.9 3:951cb95b:::rbd_data.1121d8143c6e.0000000000000002:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e56)", 2024-09-13T06:42:35.588 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:06.384412+0000", 2024-09-13T06:42:35.588 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 149.16328752699999, 2024-09-13T06:42:35.588 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.99777835999999998, 2024-09-13T06:42:35.588 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:35.588 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:35.588 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:35.588 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:35.588 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:35.588 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 37896 2024-09-13T06:42:35.588 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.588 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:35.589 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.589 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:35.589 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384412+0000", 2024-09-13T06:42:35.589 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:35.589 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.589 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.589 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:35.589 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384412+0000", 2024-09-13T06:42:35.589 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:35.589 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.589 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.589 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:35.589 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384410+0000", 2024-09-13T06:42:35.590 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.999999 2024-09-13T06:42:35.590 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.590 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.590 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:35.590 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384418+0000", 2024-09-13T06:42:35.590 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.486e-06 2024-09-13T06:42:35.590 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.590 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.590 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:35.590 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384436+0000", 2024-09-13T06:42:35.590 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7668000000000001e-05 2024-09-13T06:42:35.590 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.590 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.590 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:35.590 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384449+0000", 2024-09-13T06:42:35.591 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3395e-05 2024-09-13T06:42:35.591 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.591 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.591 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:35.591 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384605+0000", 2024-09-13T06:42:35.591 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00015563099999999999 2024-09-13T06:42:35.591 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.591 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.591 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:42:35.591 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384635+0000", 2024-09-13T06:42:35.591 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.0383999999999999e-05 2024-09-13T06:42:35.591 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.591 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.591 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:35.591 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.379730+0000", 2024-09-13T06:42:35.592 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.99509493999999998 2024-09-13T06:42:35.592 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.592 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.592 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:35.592 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.379964+0000", 2024-09-13T06:42:35.592 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00023353499999999999 2024-09-13T06:42:35.592 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.592 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.592 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:35.592 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.382190+0000", 2024-09-13T06:42:35.592 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0022265039999999998 2024-09-13T06:42:35.592 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:35.593 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:35.593 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:35.593 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.593 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.593 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43223 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 393216~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:42:35.593 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558267+0000", 2024-09-13T06:42:35.593 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 133.98943221600001, 2024-09-13T06:42:35.593 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.062813151999999997, 2024-09-13T06:42:35.593 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:35.593 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:35.593 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:35.593 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:35.593 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:35.594 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43223 2024-09-13T06:42:35.594 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.594 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:35.594 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.594 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:35.594 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558267+0000", 2024-09-13T06:42:35.594 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:35.594 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.594 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.594 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:35.594 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558267+0000", 2024-09-13T06:42:35.594 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:35.594 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.595 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.595 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:35.595 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558266+0000", 2024-09-13T06:42:35.595 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:35.595 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.595 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.595 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:35.595 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558270+0000", 2024-09-13T06:42:35.595 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.2389999999999998e-06 2024-09-13T06:42:35.595 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.595 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.595 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:35.595 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558277+0000", 2024-09-13T06:42:35.595 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5680000000000002e-06 2024-09-13T06:42:35.596 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.596 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.596 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:35.596 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558282+0000", 2024-09-13T06:42:35.596 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7060000000000003e-06 2024-09-13T06:42:35.596 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.596 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.596 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:35.596 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.620731+0000", 2024-09-13T06:42:35.596 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.062448661000000003 2024-09-13T06:42:35.597 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.597 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.597 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:35.597 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.620806+0000", 2024-09-13T06:42:35.597 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5862e-05 2024-09-13T06:42:35.597 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.597 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.597 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:35.597 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.621080+0000", 2024-09-13T06:42:35.597 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00027368599999999998 2024-09-13T06:42:35.597 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:35.597 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:35.598 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:35.598 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.598 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.598 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43224 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 407552~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:42:35.598 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558286+0000", 2024-09-13T06:42:35.598 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 133.98941285199999, 2024-09-13T06:42:35.598 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.063179052999999999, 2024-09-13T06:42:35.598 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:35.598 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:35.598 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:35.598 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:35.598 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:35.598 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43224 2024-09-13T06:42:35.599 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.599 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:35.599 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.599 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:35.599 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558286+0000", 2024-09-13T06:42:35.599 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:35.599 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.599 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.599 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:35.599 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558286+0000", 2024-09-13T06:42:35.599 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:35.599 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.599 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.599 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:35.599 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558286+0000", 2024-09-13T06:42:35.599 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:35.600 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.600 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.600 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:35.600 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558288+0000", 2024-09-13T06:42:35.600 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.227e-06 2024-09-13T06:42:35.600 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.600 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.600 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:35.600 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558292+0000", 2024-09-13T06:42:35.600 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.6289999999999999e-06 2024-09-13T06:42:35.600 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.600 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.600 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:35.600 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558294+0000", 2024-09-13T06:42:35.601 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5409999999999999e-06 2024-09-13T06:42:35.601 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.601 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.601 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:35.601 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.621110+0000", 2024-09-13T06:42:35.601 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.062815776000000004 2024-09-13T06:42:35.601 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.601 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.601 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:35.601 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.621186+0000", 2024-09-13T06:42:35.602 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5570999999999999e-05 2024-09-13T06:42:35.602 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.602 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.602 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:35.602 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.621465+0000", 2024-09-13T06:42:35.602 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00027988200000000001 2024-09-13T06:42:35.602 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:35.602 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:35.602 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:35.602 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.602 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.602 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43225 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 421888~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:42:35.602 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558296+0000", 2024-09-13T06:42:35.603 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 133.989402885, 2024-09-13T06:42:35.603 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.063551110999999993, 2024-09-13T06:42:35.603 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:35.603 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:35.603 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:35.603 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:35.603 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:35.603 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43225 2024-09-13T06:42:35.603 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.603 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:35.603 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.603 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:35.603 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558296+0000", 2024-09-13T06:42:35.603 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:35.604 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.604 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.604 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:35.604 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558296+0000", 2024-09-13T06:42:35.604 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:35.604 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.604 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.604 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:35.604 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558296+0000", 2024-09-13T06:42:35.604 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:42:35.604 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.604 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.604 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:35.605 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558305+0000", 2024-09-13T06:42:35.605 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.5290000000000008e-06 2024-09-13T06:42:35.605 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.605 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.605 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:35.605 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558308+0000", 2024-09-13T06:42:35.605 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.5619999999999999e-06 2024-09-13T06:42:35.605 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.605 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.605 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:35.605 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558311+0000", 2024-09-13T06:42:35.605 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.43e-06 2024-09-13T06:42:35.605 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.606 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.606 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:35.606 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.621495+0000", 2024-09-13T06:42:35.606 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.063184289000000005 2024-09-13T06:42:35.606 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.606 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.606 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:35.606 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.621569+0000", 2024-09-13T06:42:35.606 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4250000000000002e-05 2024-09-13T06:42:35.606 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.606 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.607 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:35.607 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.621847+0000", 2024-09-13T06:42:35.607 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00027826400000000002 2024-09-13T06:42:35.607 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:35.607 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:35.607 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:35.607 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.607 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.607 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43226 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 436224~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:42:35.607 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558313+0000", 2024-09-13T06:42:35.607 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 133.98938624900001, 2024-09-13T06:42:35.607 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.063914420999999999, 2024-09-13T06:42:35.608 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:35.608 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:35.608 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:35.608 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:35.608 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:35.608 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43226 2024-09-13T06:42:35.608 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.608 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:35.608 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.608 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:35.608 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558313+0000", 2024-09-13T06:42:35.608 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:35.608 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.608 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.609 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:35.609 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558313+0000", 2024-09-13T06:42:35.609 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:35.609 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.609 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.609 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:35.609 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558313+0000", 2024-09-13T06:42:35.609 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:35.609 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.609 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.609 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:35.609 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558314+0000", 2024-09-13T06:42:35.609 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3740000000000001e-06 2024-09-13T06:42:35.609 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.609 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.610 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:35.610 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558317+0000", 2024-09-13T06:42:35.610 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9730000000000002e-06 2024-09-13T06:42:35.610 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.610 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.610 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:35.610 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558319+0000", 2024-09-13T06:42:35.610 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4059999999999999e-06 2024-09-13T06:42:35.610 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.610 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.610 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:35.610 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.621877+0000", 2024-09-13T06:42:35.610 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.063557408999999995 2024-09-13T06:42:35.610 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.610 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.611 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:35.611 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.621951+0000", 2024-09-13T06:42:35.611 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4487999999999996e-05 2024-09-13T06:42:35.611 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.611 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.611 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:35.611 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.622227+0000", 2024-09-13T06:42:35.611 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000276011 2024-09-13T06:42:35.611 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:35.611 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:35.611 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:35.611 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.611 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.611 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43227 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 450560~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:42:35.611 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558322+0000", 2024-09-13T06:42:35.612 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 133.989377668, 2024-09-13T06:42:35.612 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.064285348000000006, 2024-09-13T06:42:35.612 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:35.612 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:35.612 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:35.612 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:35.612 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:35.612 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43227 2024-09-13T06:42:35.612 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.612 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:35.612 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.612 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:35.612 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558322+0000", 2024-09-13T06:42:35.612 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:35.613 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.613 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.613 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:35.613 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558322+0000", 2024-09-13T06:42:35.613 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:35.613 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.613 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.613 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:35.613 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558321+0000", 2024-09-13T06:42:35.613 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:42:35.613 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.613 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.613 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:35.614 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558323+0000", 2024-09-13T06:42:35.614 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.576e-06 2024-09-13T06:42:35.614 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.614 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.614 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:35.614 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558328+0000", 2024-09-13T06:42:35.614 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0719999999999999e-06 2024-09-13T06:42:35.614 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.614 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.614 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:35.614 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558332+0000", 2024-09-13T06:42:35.614 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.8130000000000002e-06 2024-09-13T06:42:35.614 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.614 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.614 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:35.614 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.622255+0000", 2024-09-13T06:42:35.615 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.063923195000000002 2024-09-13T06:42:35.615 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.615 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.615 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:35.615 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.622330+0000", 2024-09-13T06:42:35.615 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5383000000000007e-05 2024-09-13T06:42:35.615 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.615 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.615 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:35.615 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.622607+0000", 2024-09-13T06:42:35.615 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00027651999999999999 2024-09-13T06:42:35.615 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:35.615 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:35.616 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:35.616 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.616 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.616 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43228 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 464896~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:42:35.616 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558335+0000", 2024-09-13T06:42:35.616 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 133.98936375900001, 2024-09-13T06:42:35.616 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.064652253000000007, 2024-09-13T06:42:35.616 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:35.616 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:35.616 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:35.616 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:35.616 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:35.616 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43228 2024-09-13T06:42:35.616 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.616 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:35.617 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.617 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:35.617 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558335+0000", 2024-09-13T06:42:35.617 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:35.617 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.617 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.617 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:35.617 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558335+0000", 2024-09-13T06:42:35.617 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:35.617 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.618 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.618 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:35.618 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558335+0000", 2024-09-13T06:42:35.618 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:35.618 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.618 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.618 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:35.618 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558337+0000", 2024-09-13T06:42:35.618 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1380000000000001e-06 2024-09-13T06:42:35.618 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.618 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.618 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:35.618 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558343+0000", 2024-09-13T06:42:35.618 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.5140000000000001e-06 2024-09-13T06:42:35.619 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.619 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.619 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:35.619 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558348+0000", 2024-09-13T06:42:35.619 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9640000000000002e-06 2024-09-13T06:42:35.619 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.619 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.619 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:35.619 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.622636+0000", 2024-09-13T06:42:35.619 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.064288260999999999 2024-09-13T06:42:35.619 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.619 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.619 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:35.619 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.622715+0000", 2024-09-13T06:42:35.620 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.9351000000000006e-05 2024-09-13T06:42:35.620 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.620 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.620 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:35.620 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.622988+0000", 2024-09-13T06:42:35.620 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00027242599999999998 2024-09-13T06:42:35.620 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:35.620 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:35.620 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:35.620 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.620 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.620 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43229 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 479232~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:42:35.620 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558352+0000", 2024-09-13T06:42:35.620 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 133.98934734400001, 2024-09-13T06:42:35.621 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.065018024999999993, 2024-09-13T06:42:35.621 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:35.621 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:35.621 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:35.621 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:35.621 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:35.621 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43229 2024-09-13T06:42:35.621 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.621 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:35.621 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.621 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:35.621 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558352+0000", 2024-09-13T06:42:35.621 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:35.621 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.622 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.622 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:35.622 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558352+0000", 2024-09-13T06:42:35.622 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:35.622 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.622 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.622 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:35.622 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558352+0000", 2024-09-13T06:42:35.622 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:35.622 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.622 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.622 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:35.622 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558354+0000", 2024-09-13T06:42:35.622 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4930000000000001e-06 2024-09-13T06:42:35.623 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.623 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.623 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:35.623 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558360+0000", 2024-09-13T06:42:35.623 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.263e-06 2024-09-13T06:42:35.623 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.623 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.623 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:35.623 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558369+0000", 2024-09-13T06:42:35.623 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.0829999999999993e-06 2024-09-13T06:42:35.623 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.623 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.623 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:35.623 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.623017+0000", 2024-09-13T06:42:35.624 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.064647799000000006 2024-09-13T06:42:35.624 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.624 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.624 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:35.624 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.623090+0000", 2024-09-13T06:42:35.624 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3071000000000006e-05 2024-09-13T06:42:35.624 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.624 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.624 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:35.624 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.623370+0000", 2024-09-13T06:42:35.624 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000279661 2024-09-13T06:42:35.624 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:35.624 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:35.625 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:35.625 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.625 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.625 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43230 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 493568~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:42:35.625 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558374+0000", 2024-09-13T06:42:35.625 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 133.98932505100001, 2024-09-13T06:42:35.625 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.065410435000000003, 2024-09-13T06:42:35.625 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:35.625 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:35.625 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:35.625 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:35.625 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:35.625 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43230 2024-09-13T06:42:35.625 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.626 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:35.626 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.626 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:35.626 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558374+0000", 2024-09-13T06:42:35.626 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:35.626 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.626 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.626 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:35.626 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558374+0000", 2024-09-13T06:42:35.626 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:35.626 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.626 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.627 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:35.627 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558374+0000", 2024-09-13T06:42:35.627 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:35.627 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.627 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.627 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:35.627 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558376+0000", 2024-09-13T06:42:35.627 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4430000000000002e-06 2024-09-13T06:42:35.627 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.627 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.627 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:35.628 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558382+0000", 2024-09-13T06:42:35.628 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3029999999999996e-06 2024-09-13T06:42:35.628 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.628 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.628 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:35.628 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558387+0000", 2024-09-13T06:42:35.628 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.1699999999999999e-06 2024-09-13T06:42:35.628 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.628 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.628 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:35.629 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.623400+0000", 2024-09-13T06:42:35.629 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.065013244999999997 2024-09-13T06:42:35.629 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.629 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.629 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:35.629 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.623474+0000", 2024-09-13T06:42:35.629 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3889999999999999e-05 2024-09-13T06:42:35.629 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.629 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.629 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:35.629 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.623785+0000", 2024-09-13T06:42:35.629 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00031080099999999998 2024-09-13T06:42:35.629 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:35.629 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:35.630 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:35.630 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.630 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.630 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43231 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 507904~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:42:35.630 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558391+0000", 2024-09-13T06:42:35.630 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 133.98930836599999, 2024-09-13T06:42:35.630 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.065788597000000004, 2024-09-13T06:42:35.630 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:35.630 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:35.630 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:35.630 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:35.630 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:35.631 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43231 2024-09-13T06:42:35.631 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.631 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:35.631 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.631 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:35.631 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558391+0000", 2024-09-13T06:42:35.631 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:35.631 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.631 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.631 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:35.631 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558391+0000", 2024-09-13T06:42:35.632 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:35.632 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.632 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.632 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:35.632 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558390+0000", 2024-09-13T06:42:35.632 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:35.632 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.632 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.632 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:35.633 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558393+0000", 2024-09-13T06:42:35.633 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2570000000000002e-06 2024-09-13T06:42:35.633 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.633 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.633 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:35.633 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558399+0000", 2024-09-13T06:42:35.633 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0419999999999999e-06 2024-09-13T06:42:35.633 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.633 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.633 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:35.634 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558403+0000", 2024-09-13T06:42:35.634 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6249999999999998e-06 2024-09-13T06:42:35.634 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.634 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.634 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:35.634 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.623811+0000", 2024-09-13T06:42:35.634 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.065407549999999995 2024-09-13T06:42:35.634 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.634 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.634 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:35.634 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.623877+0000", 2024-09-13T06:42:35.635 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.5902999999999996e-05 2024-09-13T06:42:35.635 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.635 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.635 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:35.635 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.624179+0000", 2024-09-13T06:42:35.635 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00030259999999999998 2024-09-13T06:42:35.635 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:35.635 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:35.635 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:35.635 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.635 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.635 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43232 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 522240~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:42:35.635 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558422+0000", 2024-09-13T06:42:35.636 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 133.98927758900001, 2024-09-13T06:42:35.636 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.066176061999999994, 2024-09-13T06:42:35.636 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:35.636 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:35.636 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:35.636 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:35.636 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:35.636 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43232 2024-09-13T06:42:35.636 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.636 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:35.636 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.636 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:35.636 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558422+0000", 2024-09-13T06:42:35.636 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:35.637 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.637 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.637 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:35.637 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558422+0000", 2024-09-13T06:42:35.637 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:35.637 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.637 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.637 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:35.637 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558421+0000", 2024-09-13T06:42:35.637 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:35.637 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.637 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.637 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:35.637 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558428+0000", 2024-09-13T06:42:35.638 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.1690000000000003e-06 2024-09-13T06:42:35.638 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.638 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.638 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:35.638 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558434+0000", 2024-09-13T06:42:35.638 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9309999999999996e-06 2024-09-13T06:42:35.638 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.639 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.639 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:35.639 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558447+0000", 2024-09-13T06:42:35.639 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.271e-05 2024-09-13T06:42:35.639 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.639 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.639 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:35.639 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.624209+0000", 2024-09-13T06:42:35.639 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.065762102000000003 2024-09-13T06:42:35.639 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.639 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.639 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:35.639 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.624282+0000", 2024-09-13T06:42:35.639 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.2889e-05 2024-09-13T06:42:35.640 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.640 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.640 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:35.640 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.624598+0000", 2024-09-13T06:42:35.640 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00031591399999999998 2024-09-13T06:42:35.640 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:35.640 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:35.640 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:35.640 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.640 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.640 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43486 3.f 3:f7da9c8f:::rbd_data.1121f5f2e1c0.000000000000000b:1f [read 260096~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:42:35.640 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.569088+0000", 2024-09-13T06:42:35.640 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 133.978610866, 2024-09-13T06:42:35.641 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.062579223000000003, 2024-09-13T06:42:35.641 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:35.641 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:35.641 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:35.641 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:35.641 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:35.641 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43486 2024-09-13T06:42:35.641 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.641 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:35.641 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.641 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:35.641 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.569088+0000", 2024-09-13T06:42:35.641 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:35.642 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.642 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.642 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:35.642 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.569088+0000", 2024-09-13T06:42:35.642 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:35.642 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.642 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.642 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:35.642 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.569088+0000", 2024-09-13T06:42:35.642 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:35.642 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.642 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.642 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:35.643 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.569091+0000", 2024-09-13T06:42:35.643 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9629999999999998e-06 2024-09-13T06:42:35.643 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.643 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.643 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:35.643 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.569097+0000", 2024-09-13T06:42:35.643 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.4160000000000001e-06 2024-09-13T06:42:35.643 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.643 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.643 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:35.643 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.569102+0000", 2024-09-13T06:42:35.643 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6659999999999999e-06 2024-09-13T06:42:35.643 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.644 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.644 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:35.644 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.631346+0000", 2024-09-13T06:42:35.644 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.062243896 2024-09-13T06:42:35.644 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.644 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.644 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:35.644 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.631413+0000", 2024-09-13T06:42:35.644 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.7638000000000005e-05 2024-09-13T06:42:35.644 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.644 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.644 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:35.645 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.631668+0000", 2024-09-13T06:42:35.645 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0002541 2024-09-13T06:42:35.645 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:35.645 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:35.645 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:35.645 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.645 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.645 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:170125 3.9 3:94e4bf8d:::rbd_object_map.1121fa0cc8a3.000000000000006d:head [writefull 0~37] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e190)", 2024-09-13T06:42:35.645 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:42:30.601501+0000", 2024-09-13T06:42:35.645 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 4.9461986549999999, 2024-09-13T06:42:35.645 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.80498820000000004, 2024-09-13T06:42:35.645 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:35.645 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:42:35.646 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:35.646 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:35.646 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:35.646 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 170125 2024-09-13T06:42:35.646 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.646 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:35.646 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.646 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:35.646 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:30.601501+0000", 2024-09-13T06:42:35.646 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:35.646 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.646 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.646 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:35.647 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:30.601501+0000", 2024-09-13T06:42:35.647 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:35.647 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.647 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.647 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:35.647 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:30.601499+0000", 2024-09-13T06:42:35.647 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999986 2024-09-13T06:42:35.647 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.647 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.647 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:35.647 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:30.601506+0000", 2024-09-13T06:42:35.647 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.9940000000000003e-06 2024-09-13T06:42:35.647 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.647 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.648 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:35.648 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:30.601519+0000", 2024-09-13T06:42:35.648 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2875e-05 2024-09-13T06:42:35.648 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.648 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.648 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:35.648 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:30.601525+0000", 2024-09-13T06:42:35.648 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8549999999999998e-06 2024-09-13T06:42:35.648 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.648 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.648 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:35.648 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:30.601560+0000", 2024-09-13T06:42:35.648 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.5271000000000002e-05 2024-09-13T06:42:35.648 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.649 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.649 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:42:35.649 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:30.601566+0000", 2024-09-13T06:42:35.649 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3090000000000001e-06 2024-09-13T06:42:35.649 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.649 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.649 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:35.649 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:31.403017+0000", 2024-09-13T06:42:35.649 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.80145064200000005 2024-09-13T06:42:35.649 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.649 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.649 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:35.649 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:31.403252+0000", 2024-09-13T06:42:35.650 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000234718 2024-09-13T06:42:35.650 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.650 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.650 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 7", 2024-09-13T06:42:35.650 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:31.403521+0000", 2024-09-13T06:42:35.650 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00026917 2024-09-13T06:42:35.650 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.650 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.650 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-09-13T06:42:35.650 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:31.404918+0000", 2024-09-13T06:42:35.650 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.001397017 2024-09-13T06:42:35.650 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.650 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.651 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:42:35.651 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:31.406176+0000", 2024-09-13T06:42:35.651 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.001257998 2024-09-13T06:42:35.651 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.651 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.651 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:42:35.651 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:31.406334+0000", 2024-09-13T06:42:35.651 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00015819099999999999 2024-09-13T06:42:35.651 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:35.651 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:35.651 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:35.651 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:31.406489+0000", 2024-09-13T06:42:35.651 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00015476699999999999 2024-09-13T06:42:35.651 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:35.652 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:35.652 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:35.652 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:35.652 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:35.652 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:42:35.653 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-13T06:42:35.654 INFO:teuthology.orchestra.run.smithi081.stderr:nodeep-scrub is unset 2024-09-13T06:42:35.655 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:42:35.648+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:42:35.754 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:42:35.749+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:42:35.817 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:42:35.817 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-13T06:42:35.817 INFO:teuthology.orchestra.run.smithi081.stdout: "num_ops": 0 2024-09-13T06:42:35.817 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:42:35.831 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-13T06:42:35.878 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:42:35.876+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:42:35.954 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:42:35.954 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-13T06:42:35.954 INFO:teuthology.orchestra.run.smithi081.stdout: "complaint_time": 30, 2024-09-13T06:42:35.954 INFO:teuthology.orchestra.run.smithi081.stdout: "num_blocked_ops": 0 2024-09-13T06:42:35.954 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:42:35.955 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:42:35.953+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:42:35.968 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-13T06:42:36.055 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:42:36.052+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:42:36.130 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:42:36.130 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 20, 2024-09-13T06:42:36.130 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 600, 2024-09-13T06:42:36.130 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [ 2024-09-13T06:42:36.131 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:36.131 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:2226 3.15 3:af026987:::rbd_data.112173e2f1b7.0000000000000017:head [sparse-read 0~4194304] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-13T06:42:36.131 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:37.606562+0000", 2024-09-13T06:42:36.131 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 178.523063253, 2024-09-13T06:42:36.131 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.83322091700000001, 2024-09-13T06:42:36.131 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:36.131 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:42:36.131 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:36.131 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:36.131 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:36.131 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 2226 2024-09-13T06:42:36.131 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:36.131 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:36.131 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:36.132 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:36.132 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606562+0000", 2024-09-13T06:42:36.132 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:36.132 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:36.132 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:36.132 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:36.132 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606562+0000", 2024-09-13T06:42:36.132 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:36.132 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:36.132 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:36.132 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:36.132 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606561+0000", 2024-09-13T06:42:36.133 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:36.133 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:36.133 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:36.133 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:36.133 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606565+0000", 2024-09-13T06:42:36.133 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.4379999999999999e-06 2024-09-13T06:42:36.133 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:36.133 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:36.133 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:36.133 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606569+0000", 2024-09-13T06:42:36.133 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.425e-06 2024-09-13T06:42:36.133 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:36.134 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:36.134 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:36.134 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606572+0000", 2024-09-13T06:42:36.134 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.05e-06 2024-09-13T06:42:36.134 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:36.134 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:36.134 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:36.134 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606621+0000", 2024-09-13T06:42:36.134 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.8723000000000001e-05 2024-09-13T06:42:36.134 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:36.134 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:36.135 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:42:36.135 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606630+0000", 2024-09-13T06:42:36.135 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.8040000000000007e-06 2024-09-13T06:42:36.135 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:36.135 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:36.135 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:36.135 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.439648+0000", 2024-09-13T06:42:36.135 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.83301824800000002 2024-09-13T06:42:36.135 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:36.135 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:36.135 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:36.135 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.439782+0000", 2024-09-13T06:42:36.135 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00013466699999999999 2024-09-13T06:42:36.135 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:36.136 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:36.136 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:36.136 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:36.136 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:36.136 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25661 3.8 3:1180686c:::rbd_data.1121f2c5ee81.0000000000000009:13 [read 397312~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:42:36.136 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.436956+0000", 2024-09-13T06:42:36.136 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 159.69266871900001, 2024-09-13T06:42:36.136 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089036758999999993, 2024-09-13T06:42:36.136 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:36.136 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:36.136 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:36.136 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:36.136 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:36.136 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25661 2024-09-13T06:42:36.137 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:36.137 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:36.137 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:36.137 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:36.137 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436956+0000", 2024-09-13T06:42:36.137 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:36.137 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:36.137 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:36.137 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:36.137 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436956+0000", 2024-09-13T06:42:36.137 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:36.137 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:36.137 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:36.138 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:36.138 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436956+0000", 2024-09-13T06:42:36.138 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:36.138 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:36.138 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:36.138 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:36.138 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436958+0000", 2024-09-13T06:42:36.138 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1770000000000001e-06 2024-09-13T06:42:36.138 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:36.138 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:36.138 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:36.138 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436963+0000", 2024-09-13T06:42:36.139 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.6489999999999996e-06 2024-09-13T06:42:36.139 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:36.139 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:36.139 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:36.139 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436975+0000", 2024-09-13T06:42:36.139 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1783999999999999e-05 2024-09-13T06:42:36.139 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:36.139 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:36.139 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:36.139 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.525671+0000", 2024-09-13T06:42:36.139 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.088696292999999995 2024-09-13T06:42:36.139 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:36.139 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:36.139 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:36.140 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.525749+0000", 2024-09-13T06:42:36.140 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.7589000000000005e-05 2024-09-13T06:42:36.140 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:36.140 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:36.140 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:36.140 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.525993+0000", 2024-09-13T06:42:36.140 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00024381000000000001 2024-09-13T06:42:36.140 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:36.140 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:36.140 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:36.140 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:36.140 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:36.140 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25662 3.8 3:1180686c:::rbd_data.1121f2c5ee81.0000000000000009:13 [read 421888~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:42:36.141 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.436980+0000", 2024-09-13T06:42:36.141 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 159.69264440699999, 2024-09-13T06:42:36.141 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089367577000000004, 2024-09-13T06:42:36.141 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:36.141 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:36.141 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:36.141 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:36.141 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:36.141 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25662 2024-09-13T06:42:36.141 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:36.141 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:36.141 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:36.141 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:36.141 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436980+0000", 2024-09-13T06:42:36.142 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:36.142 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:36.142 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:36.142 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:36.142 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436980+0000", 2024-09-13T06:42:36.142 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:36.142 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:36.142 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:36.142 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:36.142 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436980+0000", 2024-09-13T06:42:36.142 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:36.142 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:36.142 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:36.142 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:36.143 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436982+0000", 2024-09-13T06:42:36.143 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3989999999999998e-06 2024-09-13T06:42:36.143 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:36.143 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:36.143 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:36.143 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436988+0000", 2024-09-13T06:42:36.143 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0039999999999996e-06 2024-09-13T06:42:36.143 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:36.143 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:36.143 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:36.143 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436993+0000", 2024-09-13T06:42:36.143 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6090000000000003e-06 2024-09-13T06:42:36.144 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:36.144 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:36.144 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:36.144 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.526035+0000", 2024-09-13T06:42:36.144 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089042248000000004 2024-09-13T06:42:36.144 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:36.144 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:36.144 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:36.144 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.526111+0000", 2024-09-13T06:42:36.144 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5643999999999996e-05 2024-09-13T06:42:36.144 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:36.144 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:36.145 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:36.145 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.526348+0000", 2024-09-13T06:42:36.145 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00023705800000000001 2024-09-13T06:42:36.145 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:36.145 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:36.145 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:36.145 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:36.145 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:36.145 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25663 3.8 3:1180686c:::rbd_data.1121f2c5ee81.0000000000000009:13 [read 466944~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:42:36.145 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.436998+0000", 2024-09-13T06:42:36.145 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 159.69262676, 2024-09-13T06:42:36.145 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089730867000000006, 2024-09-13T06:42:36.145 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:36.145 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:36.146 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:36.146 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:36.146 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:36.146 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25663 2024-09-13T06:42:36.146 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:36.146 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:36.146 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:36.146 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:36.146 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436998+0000", 2024-09-13T06:42:36.146 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:36.146 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:36.146 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:36.146 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:36.146 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436998+0000", 2024-09-13T06:42:36.146 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:36.147 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:36.147 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:36.147 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:36.147 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436998+0000", 2024-09-13T06:42:36.147 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:36.147 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:36.147 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:36.147 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:36.147 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437000+0000", 2024-09-13T06:42:36.147 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0940000000000002e-06 2024-09-13T06:42:36.147 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:36.147 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:36.147 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:36.147 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437005+0000", 2024-09-13T06:42:36.148 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.604e-06 2024-09-13T06:42:36.148 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:36.148 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:36.148 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:36.148 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437032+0000", 2024-09-13T06:42:36.148 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6407e-05 2024-09-13T06:42:36.148 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:36.148 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:36.148 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:36.148 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.526363+0000", 2024-09-13T06:42:36.148 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089331456000000004 2024-09-13T06:42:36.148 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:36.148 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:36.148 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:36.149 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.526404+0000", 2024-09-13T06:42:36.149 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.0887999999999999e-05 2024-09-13T06:42:36.149 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:36.149 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:36.149 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:36.149 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.526729+0000", 2024-09-13T06:42:36.149 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00032486 2024-09-13T06:42:36.149 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:36.149 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:36.149 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:36.149 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:36.149 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:36.149 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25664 3.8 3:1180686c:::rbd_data.1121f2c5ee81.0000000000000009:13 [read 491520~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:42:36.150 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.437040+0000", 2024-09-13T06:42:36.150 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 159.692584845, 2024-09-13T06:42:36.150 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.090016650000000004, 2024-09-13T06:42:36.150 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:36.150 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:36.150 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:36.150 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:36.150 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:36.150 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25664 2024-09-13T06:42:36.150 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:36.150 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:36.150 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:36.150 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:36.151 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437040+0000", 2024-09-13T06:42:36.151 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:36.151 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:36.151 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:36.151 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:36.151 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437040+0000", 2024-09-13T06:42:36.151 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:36.151 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:36.151 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:36.151 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:36.151 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437039+0000", 2024-09-13T06:42:36.151 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:36.151 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:36.152 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:36.152 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:36.152 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437047+0000", 2024-09-13T06:42:36.152 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4839999999999998e-06 2024-09-13T06:42:36.152 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:36.152 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:36.152 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:36.152 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437054+0000", 2024-09-13T06:42:36.152 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.8299999999999998e-06 2024-09-13T06:42:36.152 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:36.152 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:36.152 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:36.152 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437060+0000", 2024-09-13T06:42:36.153 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.1510000000000001e-06 2024-09-13T06:42:36.153 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:36.153 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:36.153 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:36.153 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.526772+0000", 2024-09-13T06:42:36.153 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089711737999999999 2024-09-13T06:42:36.153 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:36.153 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:36.153 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:36.153 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.526848+0000", 2024-09-13T06:42:36.153 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5870000000000004e-05 2024-09-13T06:42:36.153 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:36.153 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:36.154 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:36.154 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.527057+0000", 2024-09-13T06:42:36.154 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000209106 2024-09-13T06:42:36.154 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:36.154 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:36.154 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:36.154 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:36.154 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:36.154 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25740 3.18 3:1c662b96:::rbd_data.1121f2c5ee81.0000000000000010:13 [read 200704~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:42:36.154 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443352+0000", 2024-09-13T06:42:36.154 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 159.68627316999999, 2024-09-13T06:42:36.154 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089068222000000002, 2024-09-13T06:42:36.154 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:36.155 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:36.155 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:36.155 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:36.155 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:36.155 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25740 2024-09-13T06:42:36.155 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:36.155 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:36.155 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:36.155 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:36.155 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443352+0000", 2024-09-13T06:42:36.155 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:36.155 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:36.155 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:36.155 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:36.155 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443352+0000", 2024-09-13T06:42:36.156 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:36.156 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:36.156 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:36.156 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:36.156 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443351+0000", 2024-09-13T06:42:36.156 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:36.156 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:36.156 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:36.156 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:36.156 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443354+0000", 2024-09-13T06:42:36.156 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.841e-06 2024-09-13T06:42:36.156 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:36.156 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:36.157 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:36.157 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443361+0000", 2024-09-13T06:42:36.157 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.0010000000000004e-06 2024-09-13T06:42:36.157 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:36.157 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:36.157 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:36.157 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443366+0000", 2024-09-13T06:42:36.157 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7119999999999999e-06 2024-09-13T06:42:36.157 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:36.157 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:36.157 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:36.157 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532117+0000", 2024-09-13T06:42:36.157 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.088751327000000005 2024-09-13T06:42:36.158 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:36.158 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:36.158 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:36.158 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532193+0000", 2024-09-13T06:42:36.158 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5839000000000004e-05 2024-09-13T06:42:36.158 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:36.158 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:36.158 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:36.158 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532420+0000", 2024-09-13T06:42:36.158 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00022691000000000001 2024-09-13T06:42:36.158 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:36.158 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:36.158 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:36.159 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:36.159 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:36.159 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25741 3.18 3:1c662b96:::rbd_data.1121f2c5ee81.0000000000000010:13 [read 225280~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:42:36.159 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443378+0000", 2024-09-13T06:42:36.159 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 159.68624640300001, 2024-09-13T06:42:36.159 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089324107, 2024-09-13T06:42:36.159 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:36.159 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:36.159 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:36.159 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:36.159 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:36.159 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25741 2024-09-13T06:42:36.159 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:36.160 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:36.160 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:36.160 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:36.160 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443378+0000", 2024-09-13T06:42:36.160 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:36.160 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:36.160 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:36.160 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:36.160 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443378+0000", 2024-09-13T06:42:36.160 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:36.160 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:36.160 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:36.161 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:36.161 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443378+0000", 2024-09-13T06:42:36.161 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:36.161 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:36.161 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:36.161 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:36.161 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443380+0000", 2024-09-13T06:42:36.161 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3549999999999999e-06 2024-09-13T06:42:36.161 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:36.161 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:36.161 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:36.161 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443388+0000", 2024-09-13T06:42:36.161 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.7449999999999995e-06 2024-09-13T06:42:36.162 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:36.162 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:36.162 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:36.162 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443393+0000", 2024-09-13T06:42:36.162 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.4e-06 2024-09-13T06:42:36.162 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:36.162 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:36.162 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:36.162 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532454+0000", 2024-09-13T06:42:36.162 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089060941000000005 2024-09-13T06:42:36.162 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:36.162 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:36.163 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:36.163 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532512+0000", 2024-09-13T06:42:36.163 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7763000000000002e-05 2024-09-13T06:42:36.163 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:36.163 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:36.163 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:36.163 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532703+0000", 2024-09-13T06:42:36.163 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000190328 2024-09-13T06:42:36.163 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:36.163 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:36.163 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:36.163 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:36.163 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:36.164 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25742 3.18 3:1c662b96:::rbd_data.1121f2c5ee81.0000000000000010:13 [read 270336~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:42:36.164 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443398+0000", 2024-09-13T06:42:36.164 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 159.686226691, 2024-09-13T06:42:36.164 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089621836999999996, 2024-09-13T06:42:36.164 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:36.164 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:36.164 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:36.164 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:36.164 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:36.164 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25742 2024-09-13T06:42:36.164 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:36.164 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:36.164 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:36.165 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:36.165 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443398+0000", 2024-09-13T06:42:36.165 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:36.165 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:36.165 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:36.165 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:36.165 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443398+0000", 2024-09-13T06:42:36.165 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:36.165 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:36.165 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:36.165 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:36.165 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443398+0000", 2024-09-13T06:42:36.166 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:36.166 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:36.166 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:36.166 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:36.166 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443400+0000", 2024-09-13T06:42:36.166 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1849999999999998e-06 2024-09-13T06:42:36.166 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:36.166 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:36.166 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:36.166 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443407+0000", 2024-09-13T06:42:36.166 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3669999999999999e-06 2024-09-13T06:42:36.166 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:36.166 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:36.167 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:36.167 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443420+0000", 2024-09-13T06:42:36.167 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2645e-05 2024-09-13T06:42:36.167 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:36.167 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:36.167 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:36.167 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532742+0000", 2024-09-13T06:42:36.167 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089322200000000004 2024-09-13T06:42:36.167 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:36.167 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:36.167 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:36.167 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532818+0000", 2024-09-13T06:42:36.167 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.6019000000000005e-05 2024-09-13T06:42:36.168 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:36.168 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:36.168 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:36.168 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533020+0000", 2024-09-13T06:42:36.168 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000201721 2024-09-13T06:42:36.168 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:36.168 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:36.168 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:36.168 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:36.168 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:36.168 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25743 3.18 3:1c662b96:::rbd_data.1121f2c5ee81.0000000000000010:13 [read 294912~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:42:36.168 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443425+0000", 2024-09-13T06:42:36.168 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 159.68619968300001, 2024-09-13T06:42:36.169 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089864075000000002, 2024-09-13T06:42:36.169 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:36.169 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:36.169 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:36.169 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:36.169 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:36.169 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25743 2024-09-13T06:42:36.169 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:36.169 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:36.169 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:36.169 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:36.169 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443425+0000", 2024-09-13T06:42:36.169 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:36.170 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:36.170 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:36.170 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:36.170 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443425+0000", 2024-09-13T06:42:36.170 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:36.170 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:36.170 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:36.170 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:36.170 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443425+0000", 2024-09-13T06:42:36.170 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:36.170 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:36.170 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:36.170 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:36.171 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443432+0000", 2024-09-13T06:42:36.171 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3420000000000002e-06 2024-09-13T06:42:36.171 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:36.171 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:36.171 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:36.171 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443440+0000", 2024-09-13T06:42:36.171 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5689999999999999e-06 2024-09-13T06:42:36.171 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:36.171 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:36.171 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:36.171 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443445+0000", 2024-09-13T06:42:36.171 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9590000000000003e-06 2024-09-13T06:42:36.172 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:36.172 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:36.172 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:36.172 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533063+0000", 2024-09-13T06:42:36.172 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089617988999999995 2024-09-13T06:42:36.172 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:36.172 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:36.172 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:36.172 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533122+0000", 2024-09-13T06:42:36.172 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9052999999999999e-05 2024-09-13T06:42:36.172 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:36.173 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:36.173 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:36.173 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533289+0000", 2024-09-13T06:42:36.173 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00016752800000000001 2024-09-13T06:42:36.173 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:36.173 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:36.173 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:36.173 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:36.173 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:36.173 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25744 3.18 3.69d46638 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:42:36.173 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443449+0000", 2024-09-13T06:42:36.173 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 159.68617553600001, 2024-09-13T06:42:36.174 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089869148999999995, 2024-09-13T06:42:36.174 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:36.174 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:42:36.174 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:36.174 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:36.174 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:36.174 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25744 2024-09-13T06:42:36.174 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:36.174 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:36.174 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:36.174 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:36.174 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443449+0000", 2024-09-13T06:42:36.175 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:36.175 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:36.175 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:36.175 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:36.175 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443449+0000", 2024-09-13T06:42:36.175 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:36.175 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:36.175 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:36.175 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:36.175 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443449+0000", 2024-09-13T06:42:36.175 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:36.175 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:36.175 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:36.176 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:36.176 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443451+0000", 2024-09-13T06:42:36.176 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.244e-06 2024-09-13T06:42:36.176 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:36.176 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:36.176 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:36.176 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443457+0000", 2024-09-13T06:42:36.176 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.66e-06 2024-09-13T06:42:36.176 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:36.176 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:36.176 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:36.176 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443461+0000", 2024-09-13T06:42:36.177 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5449999999999997e-06 2024-09-13T06:42:36.177 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:36.177 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:36.177 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:36.177 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533311+0000", 2024-09-13T06:42:36.177 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089849729000000003 2024-09-13T06:42:36.177 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:36.177 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:36.177 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:36.177 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533318+0000", 2024-09-13T06:42:36.177 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.328e-06 2024-09-13T06:42:36.177 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:36.178 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:36.178 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:36.178 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:36.178 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:36.178 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25745 3.18 3.69d46638 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:42:36.178 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443466+0000", 2024-09-13T06:42:36.178 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 159.68615847800001, 2024-09-13T06:42:36.178 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089886743000000005, 2024-09-13T06:42:36.178 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:36.178 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:42:36.178 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:36.178 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:36.178 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:36.178 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25745 2024-09-13T06:42:36.179 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:36.179 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:36.179 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:36.179 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:36.179 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443466+0000", 2024-09-13T06:42:36.179 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:36.179 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:36.179 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:36.179 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:36.179 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443466+0000", 2024-09-13T06:42:36.179 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:36.179 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:36.179 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:36.180 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:36.180 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443466+0000", 2024-09-13T06:42:36.180 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:36.180 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:36.180 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:36.180 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:36.180 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443474+0000", 2024-09-13T06:42:36.180 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.1289999999999996e-06 2024-09-13T06:42:36.180 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:36.180 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:36.180 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:36.180 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443484+0000", 2024-09-13T06:42:36.180 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0654e-05 2024-09-13T06:42:36.181 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:36.181 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:36.181 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:36.181 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443490+0000", 2024-09-13T06:42:36.181 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8030000000000002e-06 2024-09-13T06:42:36.181 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:36.181 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:36.181 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:36.181 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533348+0000", 2024-09-13T06:42:36.181 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089857267000000005 2024-09-13T06:42:36.181 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:36.181 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:36.181 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:36.181 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533353+0000", 2024-09-13T06:42:36.182 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.5520000000000004e-06 2024-09-13T06:42:36.182 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:36.182 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:36.182 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:36.182 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:36.182 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:36.182 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25746 3.18 3.69d46638 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:42:36.182 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443495+0000", 2024-09-13T06:42:36.182 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 159.686129365, 2024-09-13T06:42:36.182 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089903725000000004, 2024-09-13T06:42:36.182 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:36.182 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:42:36.182 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:36.183 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:36.183 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:36.183 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25746 2024-09-13T06:42:36.183 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:36.183 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:36.183 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:36.183 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:36.183 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443495+0000", 2024-09-13T06:42:36.183 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:36.183 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:36.183 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:36.183 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:36.183 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443495+0000", 2024-09-13T06:42:36.184 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:36.184 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:36.184 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:36.184 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:36.184 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443495+0000", 2024-09-13T06:42:36.184 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:36.184 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:36.184 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:36.184 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:36.184 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443498+0000", 2024-09-13T06:42:36.184 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.7690000000000001e-06 2024-09-13T06:42:36.184 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:36.185 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:36.185 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:36.185 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443504+0000", 2024-09-13T06:42:36.185 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9710000000000001e-06 2024-09-13T06:42:36.185 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:36.185 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:36.185 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:36.185 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443508+0000", 2024-09-13T06:42:36.185 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4159999999999997e-06 2024-09-13T06:42:36.185 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:36.185 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:36.185 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:36.185 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533391+0000", 2024-09-13T06:42:36.185 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089882607000000003 2024-09-13T06:42:36.186 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:36.186 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:36.186 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:36.186 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533399+0000", 2024-09-13T06:42:36.186 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.4349999999999997e-06 2024-09-13T06:42:36.186 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:36.186 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:36.186 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:36.186 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:36.186 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:36.186 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25747 3.8 3.63996268 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:42:36.186 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443512+0000", 2024-09-13T06:42:36.186 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 159.68611263400001, 2024-09-13T06:42:36.186 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089880075000000004, 2024-09-13T06:42:36.187 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:36.187 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:42:36.187 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:36.187 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:36.187 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:36.187 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25747 2024-09-13T06:42:36.187 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:36.187 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:36.187 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:36.187 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:36.187 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443512+0000", 2024-09-13T06:42:36.187 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:36.187 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:36.187 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:36.188 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:36.188 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443512+0000", 2024-09-13T06:42:36.188 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:36.188 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:36.188 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:36.188 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:36.188 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443512+0000", 2024-09-13T06:42:36.188 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:36.188 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:36.188 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:36.188 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:36.188 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443514+0000", 2024-09-13T06:42:36.189 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0980000000000001e-06 2024-09-13T06:42:36.189 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:36.189 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:36.189 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:36.189 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443520+0000", 2024-09-13T06:42:36.189 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7069999999999997e-06 2024-09-13T06:42:36.189 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:36.189 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:36.189 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:36.189 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443524+0000", 2024-09-13T06:42:36.189 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5390000000000001e-06 2024-09-13T06:42:36.189 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:36.189 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:36.190 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:36.190 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533384+0000", 2024-09-13T06:42:36.190 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089859684999999995 2024-09-13T06:42:36.190 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:36.190 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:36.190 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:36.190 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533392+0000", 2024-09-13T06:42:36.190 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.3440000000000001e-06 2024-09-13T06:42:36.190 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:36.190 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:36.190 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:36.190 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:36.190 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:36.191 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25748 3.8 3.63996268 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:42:36.191 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443528+0000", 2024-09-13T06:42:36.191 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 159.686096507, 2024-09-13T06:42:36.191 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089890715999999996, 2024-09-13T06:42:36.191 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:36.191 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:42:36.191 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:36.191 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:36.191 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:36.191 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25748 2024-09-13T06:42:36.191 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:36.191 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:36.191 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:36.192 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:36.192 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443528+0000", 2024-09-13T06:42:36.192 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:36.192 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:36.192 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:36.192 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:36.192 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443528+0000", 2024-09-13T06:42:36.192 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:36.192 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:36.192 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:36.192 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:36.192 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443528+0000", 2024-09-13T06:42:36.192 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:36.193 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:36.193 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:36.193 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:36.193 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443530+0000", 2024-09-13T06:42:36.193 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0650000000000001e-06 2024-09-13T06:42:36.193 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:36.193 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:36.193 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:36.193 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443536+0000", 2024-09-13T06:42:36.193 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7259999999999999e-06 2024-09-13T06:42:36.193 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:36.193 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:36.193 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:36.194 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443540+0000", 2024-09-13T06:42:36.194 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5009999999999998e-06 2024-09-13T06:42:36.194 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:36.194 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:36.194 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:36.194 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533412+0000", 2024-09-13T06:42:36.194 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089871873000000005 2024-09-13T06:42:36.194 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:36.194 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:36.194 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:36.194 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533419+0000", 2024-09-13T06:42:36.194 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.883e-06 2024-09-13T06:42:36.194 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:36.195 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:36.195 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:36.195 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:36.195 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:36.195 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25749 3.8 3.63996268 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:42:36.195 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443545+0000", 2024-09-13T06:42:36.195 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 159.68608031100001, 2024-09-13T06:42:36.195 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089897988999999998, 2024-09-13T06:42:36.195 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:36.195 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:42:36.195 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:36.195 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:36.195 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:36.196 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25749 2024-09-13T06:42:36.196 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:36.196 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:36.196 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:36.196 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:36.196 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443545+0000", 2024-09-13T06:42:36.196 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:36.196 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:36.196 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:36.196 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:36.196 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443545+0000", 2024-09-13T06:42:36.196 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:36.196 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:36.197 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:36.197 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:36.197 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443544+0000", 2024-09-13T06:42:36.197 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:36.197 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:36.197 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:36.197 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:36.197 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443553+0000", 2024-09-13T06:42:36.197 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.4770000000000003e-06 2024-09-13T06:42:36.197 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:36.197 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:36.197 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:36.197 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443564+0000", 2024-09-13T06:42:36.198 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0986e-05 2024-09-13T06:42:36.198 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:36.198 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:36.198 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:36.198 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443569+0000", 2024-09-13T06:42:36.198 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2530000000000004e-06 2024-09-13T06:42:36.198 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:36.198 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:36.198 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:36.198 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533438+0000", 2024-09-13T06:42:36.198 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089868641999999999 2024-09-13T06:42:36.198 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:36.198 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:36.199 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:36.199 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533442+0000", 2024-09-13T06:42:36.199 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.989e-06 2024-09-13T06:42:36.199 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:36.199 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:36.199 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:36.199 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:36.199 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:36.199 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25750 3.8 3.63996268 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:42:36.199 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443574+0000", 2024-09-13T06:42:36.199 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 159.686050825, 2024-09-13T06:42:36.199 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089895143999999996, 2024-09-13T06:42:36.199 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:36.199 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:42:36.200 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:36.200 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:36.200 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:36.200 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25750 2024-09-13T06:42:36.200 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:36.200 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:36.200 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:36.200 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:36.200 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443574+0000", 2024-09-13T06:42:36.200 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:36.200 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:36.200 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:36.200 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:36.201 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443574+0000", 2024-09-13T06:42:36.201 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:36.201 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:36.201 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:36.201 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:36.201 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443574+0000", 2024-09-13T06:42:36.201 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:36.201 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:36.201 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:36.201 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:36.201 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443576+0000", 2024-09-13T06:42:36.201 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6910000000000002e-06 2024-09-13T06:42:36.201 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:36.201 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:36.202 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:36.202 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443583+0000", 2024-09-13T06:42:36.202 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.331e-06 2024-09-13T06:42:36.202 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:36.202 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:36.202 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:36.202 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443587+0000", 2024-09-13T06:42:36.202 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6129999999999997e-06 2024-09-13T06:42:36.202 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:36.202 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:36.202 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:36.202 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533464+0000", 2024-09-13T06:42:36.202 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089876605999999998 2024-09-13T06:42:36.203 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:36.203 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:36.203 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:36.203 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533469+0000", 2024-09-13T06:42:36.203 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3909999999999997e-06 2024-09-13T06:42:36.203 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:36.203 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:36.203 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:36.203 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:36.203 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:36.203 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25751 3.8 3.63996268 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:42:36.203 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443592+0000", 2024-09-13T06:42:36.203 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 159.68603312799999, 2024-09-13T06:42:36.204 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089913650999999997, 2024-09-13T06:42:36.204 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:36.204 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:42:36.204 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:36.204 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:36.204 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:36.204 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25751 2024-09-13T06:42:36.204 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:36.204 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:36.204 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:36.204 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:36.204 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443592+0000", 2024-09-13T06:42:36.204 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:36.205 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:36.205 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:36.205 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:36.205 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443592+0000", 2024-09-13T06:42:36.205 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:36.205 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:36.205 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:36.205 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:36.205 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443591+0000", 2024-09-13T06:42:36.205 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:36.205 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:36.205 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:36.206 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:36.206 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443594+0000", 2024-09-13T06:42:36.206 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3649999999999998e-06 2024-09-13T06:42:36.206 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:36.206 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:36.206 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:36.206 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443599+0000", 2024-09-13T06:42:36.206 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.699e-06 2024-09-13T06:42:36.206 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:36.206 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:36.206 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:36.206 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443611+0000", 2024-09-13T06:42:36.206 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1503e-05 2024-09-13T06:42:36.206 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:36.207 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:36.207 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:36.207 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533497+0000", 2024-09-13T06:42:36.207 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089886453000000005 2024-09-13T06:42:36.207 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:36.207 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:36.207 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:36.207 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533505+0000", 2024-09-13T06:42:36.207 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.9910000000000002e-06 2024-09-13T06:42:36.207 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:36.207 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:36.207 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:36.207 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:36.208 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:36.208 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25752 3.8 3.63996268 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:42:36.208 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443615+0000", 2024-09-13T06:42:36.208 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 159.68600934700001, 2024-09-13T06:42:36.208 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089905868999999999, 2024-09-13T06:42:36.208 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:36.208 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:42:36.208 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:36.208 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:36.208 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:36.208 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25752 2024-09-13T06:42:36.208 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:36.208 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:36.209 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:36.209 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:36.209 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443615+0000", 2024-09-13T06:42:36.209 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:36.209 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:36.209 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:36.209 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:36.209 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443615+0000", 2024-09-13T06:42:36.209 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:36.209 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:36.209 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:36.209 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:36.210 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443615+0000", 2024-09-13T06:42:36.210 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:36.210 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:36.210 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:36.210 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:36.210 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443617+0000", 2024-09-13T06:42:36.210 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3539999999999998e-06 2024-09-13T06:42:36.210 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:36.210 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:36.210 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:36.210 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443624+0000", 2024-09-13T06:42:36.210 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3600000000000001e-06 2024-09-13T06:42:36.210 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:36.210 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:36.211 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:36.211 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443628+0000", 2024-09-13T06:42:36.211 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.2350000000000001e-06 2024-09-13T06:42:36.211 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:36.211 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:36.211 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:36.211 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533517+0000", 2024-09-13T06:42:36.211 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089889029999999995 2024-09-13T06:42:36.211 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:36.211 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:36.211 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:36.211 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533521+0000", 2024-09-13T06:42:36.211 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.2529999999999998e-06 2024-09-13T06:42:36.211 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:36.212 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:36.212 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:36.212 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:36.212 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:36.212 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:64356 3.c 3:32785be9:::rbd_header.11218ba71f0d:head [watch reconnect cookie 140361410387072 gen 2] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e95)", 2024-09-13T06:42:36.212 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:48.473318+0000", 2024-09-13T06:42:36.212 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 107.656306954, 2024-09-13T06:42:36.212 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1458904379999999, 2024-09-13T06:42:36.212 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:36.212 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:36.212 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:36.212 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:36.212 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:36.212 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 64356 2024-09-13T06:42:36.213 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:36.213 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:36.213 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:36.213 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:36.213 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:48.473318+0000", 2024-09-13T06:42:36.213 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:36.213 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:36.213 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:36.213 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:36.213 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:48.473318+0000", 2024-09-13T06:42:36.213 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:36.213 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:36.214 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:36.214 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:36.214 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:48.473315+0000", 2024-09-13T06:42:36.214 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999971 2024-09-13T06:42:36.214 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:36.214 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:36.214 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:36.214 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:48.473329+0000", 2024-09-13T06:42:36.214 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.433e-05 2024-09-13T06:42:36.214 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:36.214 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:36.214 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:36.214 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:48.473363+0000", 2024-09-13T06:42:36.215 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.3592e-05 2024-09-13T06:42:36.215 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:36.215 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:36.215 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:36.215 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:48.473386+0000", 2024-09-13T06:42:36.215 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2708999999999999e-05 2024-09-13T06:42:36.215 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:36.215 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:36.215 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:36.215 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:48.473804+0000", 2024-09-13T06:42:36.215 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00041789399999999998 2024-09-13T06:42:36.215 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:36.215 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:36.215 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:42:36.216 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:48.473830+0000", 2024-09-13T06:42:36.216 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6869e-05 2024-09-13T06:42:36.216 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:36.216 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:36.216 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:36.216 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:49.614332+0000", 2024-09-13T06:42:36.216 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.140501107 2024-09-13T06:42:36.216 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:36.216 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:36.216 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for rw locks", 2024-09-13T06:42:36.216 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:49.614496+0000", 2024-09-13T06:42:36.216 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00016451200000000001 2024-09-13T06:42:36.216 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:36.216 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:36.217 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:36.217 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:49.617131+0000", 2024-09-13T06:42:36.217 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.002634843 2024-09-13T06:42:36.217 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:36.217 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:36.217 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:36.217 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:49.617204+0000", 2024-09-13T06:42:36.217 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.2991000000000006e-05 2024-09-13T06:42:36.217 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:36.217 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:36.217 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:36.217 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:49.619208+0000", 2024-09-13T06:42:36.218 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.002004381 2024-09-13T06:42:36.218 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:36.218 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:36.218 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:36.218 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:36.218 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:36.218 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:170155 3.7 3:e17728eb:::image_client.0-clone36.rbd:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e191)", 2024-09-13T06:42:36.218 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:42:31.436412+0000", 2024-09-13T06:42:36.218 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 4.6932131310000003, 2024-09-13T06:42:36.218 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.97843703800000004, 2024-09-13T06:42:36.218 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:36.218 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:42:36.218 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:36.219 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:36.219 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:36.219 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 170155 2024-09-13T06:42:36.219 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:36.219 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:36.219 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:36.219 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:36.219 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:31.436412+0000", 2024-09-13T06:42:36.219 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:36.219 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:36.219 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:36.220 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:36.220 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:31.436412+0000", 2024-09-13T06:42:36.220 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:36.220 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:36.220 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:36.220 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:36.220 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:31.436410+0000", 2024-09-13T06:42:36.220 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999986 2024-09-13T06:42:36.220 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:36.220 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:36.220 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:36.220 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:31.436417+0000", 2024-09-13T06:42:36.220 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.6939999999999998e-06 2024-09-13T06:42:36.220 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:36.221 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:36.221 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:36.221 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:31.436430+0000", 2024-09-13T06:42:36.221 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3016999999999999e-05 2024-09-13T06:42:36.221 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:36.221 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:36.221 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:36.221 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:31.436437+0000", 2024-09-13T06:42:36.221 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.1069999999999999e-06 2024-09-13T06:42:36.221 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:36.221 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:36.221 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:36.222 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:31.436515+0000", 2024-09-13T06:42:36.222 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.7756000000000006e-05 2024-09-13T06:42:36.222 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:36.222 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:36.222 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:42:36.222 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:31.436523+0000", 2024-09-13T06:42:36.222 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.4970000000000001e-06 2024-09-13T06:42:36.222 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:36.222 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:36.222 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:36.222 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:32.414565+0000", 2024-09-13T06:42:36.222 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.97804144199999998 2024-09-13T06:42:36.222 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:36.223 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:36.223 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:36.223 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:32.414849+0000", 2024-09-13T06:42:36.223 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00028388600000000001 2024-09-13T06:42:36.223 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:36.223 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:36.223 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:36.223 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:36.223 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:36.223 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:42:36.225 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-13T06:42:36.225 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:42:36.220+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:42:36.326 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:42:36.321+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:42:36.354 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:42:36.354 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [], 2024-09-13T06:42:36.355 INFO:teuthology.orchestra.run.smithi139.stdout: "num_ops": 0 2024-09-13T06:42:36.355 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:42:36.368 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-13T06:42:36.456 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:42:36.453+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:42:36.528 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:42:36.524+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:42:36.536 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:42:36.536 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [], 2024-09-13T06:42:36.536 INFO:teuthology.orchestra.run.smithi139.stdout: "complaint_time": 30, 2024-09-13T06:42:36.536 INFO:teuthology.orchestra.run.smithi139.stdout: "num_blocked_ops": 0 2024-09-13T06:42:36.536 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:42:36.550 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-13T06:42:36.641 INFO:tasks.ceph.osd.6.smithi139.stderr:2024-09-13T06:42:36.637+0000 7fcd02c5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26385) UID: 0 2024-09-13T06:42:36.730 INFO:tasks.ceph.osd.6.smithi139.stderr:2024-09-13T06:42:36.725+0000 7fcd02c5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26385) UID: 0 2024-09-13T06:42:36.757 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:42:36.757 INFO:teuthology.orchestra.run.smithi139.stdout: "size": 20, 2024-09-13T06:42:36.757 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 600, 2024-09-13T06:42:36.757 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [ 2024-09-13T06:42:36.757 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:36.758 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18706 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 3346432~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:42:36.758 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.846138+0000", 2024-09-13T06:42:36.758 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 164.909584569, 2024-09-13T06:42:36.758 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.102018712, 2024-09-13T06:42:36.758 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:36.758 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:36.758 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:36.758 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:36.758 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:36.758 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18706 2024-09-13T06:42:36.758 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:36.759 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:36.759 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:36.759 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:36.759 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846138+0000", 2024-09-13T06:42:36.759 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:36.759 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:36.759 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:36.759 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:36.759 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846138+0000", 2024-09-13T06:42:36.759 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:36.759 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:36.759 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:36.759 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:36.759 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846138+0000", 2024-09-13T06:42:36.760 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:36.760 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:36.760 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:36.760 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:36.760 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846141+0000", 2024-09-13T06:42:36.760 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.6969999999999999e-06 2024-09-13T06:42:36.760 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:36.760 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:36.760 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:36.760 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846150+0000", 2024-09-13T06:42:36.760 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6400000000000003e-06 2024-09-13T06:42:36.760 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:36.760 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:36.760 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:36.761 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846160+0000", 2024-09-13T06:42:36.761 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.3999999999999998e-06 2024-09-13T06:42:36.761 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:36.761 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:36.761 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:36.761 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.947764+0000", 2024-09-13T06:42:36.761 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101604085 2024-09-13T06:42:36.761 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:36.761 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:36.761 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:36.761 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.947888+0000", 2024-09-13T06:42:36.761 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000124113 2024-09-13T06:42:36.762 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:36.762 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:36.762 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:36.762 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.948157+0000", 2024-09-13T06:42:36.762 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00026943399999999998 2024-09-13T06:42:36.762 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:36.762 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:36.762 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:36.762 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:36.762 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:36.762 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18707 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 3375104~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:42:36.762 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.846207+0000", 2024-09-13T06:42:36.762 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 164.90951580300001, 2024-09-13T06:42:36.763 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10238114099999999, 2024-09-13T06:42:36.763 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:36.763 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:36.763 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:36.763 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:36.763 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:36.763 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18707 2024-09-13T06:42:36.763 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:36.763 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:36.763 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:36.763 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:36.763 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846207+0000", 2024-09-13T06:42:36.763 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:36.764 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:36.764 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:36.764 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:36.764 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846207+0000", 2024-09-13T06:42:36.764 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:36.764 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:36.764 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:36.764 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:36.764 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846206+0000", 2024-09-13T06:42:36.764 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:42:36.764 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:36.764 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:36.764 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:36.764 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846211+0000", 2024-09-13T06:42:36.765 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.3000000000000003e-06 2024-09-13T06:42:36.765 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:36.765 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:36.765 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:36.765 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846220+0000", 2024-09-13T06:42:36.765 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6199999999999994e-06 2024-09-13T06:42:36.765 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:36.765 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:36.765 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:36.765 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846228+0000", 2024-09-13T06:42:36.765 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.7500000000000003e-06 2024-09-13T06:42:36.765 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:36.765 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:36.765 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:36.766 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.948267+0000", 2024-09-13T06:42:36.766 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10203878700000001 2024-09-13T06:42:36.766 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:36.766 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:36.766 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:36.766 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.948435+0000", 2024-09-13T06:42:36.766 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00016796500000000001 2024-09-13T06:42:36.766 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:36.766 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:36.766 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:36.766 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.948588+0000", 2024-09-13T06:42:36.766 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00015373599999999999 2024-09-13T06:42:36.767 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:36.767 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:36.767 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:36.767 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:36.767 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:36.767 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18718 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 3690496~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:42:36.767 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.850174+0000", 2024-09-13T06:42:36.767 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 164.90554864999999, 2024-09-13T06:42:36.767 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101854154, 2024-09-13T06:42:36.767 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:36.767 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:36.767 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:36.767 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:36.768 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:36.768 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18718 2024-09-13T06:42:36.768 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:36.768 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:36.768 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:36.768 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:36.768 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850174+0000", 2024-09-13T06:42:36.768 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:36.768 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:36.768 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:36.768 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:36.768 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850174+0000", 2024-09-13T06:42:36.768 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:36.768 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:36.769 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:36.769 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:36.769 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850173+0000", 2024-09-13T06:42:36.769 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:42:36.769 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:36.769 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:36.769 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:36.769 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850178+0000", 2024-09-13T06:42:36.769 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.4129999999999999e-06 2024-09-13T06:42:36.769 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:36.769 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:36.769 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:36.769 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850188+0000", 2024-09-13T06:42:36.769 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.8600000000000005e-06 2024-09-13T06:42:36.770 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:36.770 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:36.770 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:36.770 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850195+0000", 2024-09-13T06:42:36.770 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.8730000000000007e-06 2024-09-13T06:42:36.770 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:36.770 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:36.770 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:36.770 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.951766+0000", 2024-09-13T06:42:36.770 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.1015703 2024-09-13T06:42:36.770 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:36.770 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:36.770 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:36.771 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.951879+0000", 2024-09-13T06:42:36.771 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000112932 2024-09-13T06:42:36.771 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:36.771 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:36.771 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:36.771 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.952029+0000", 2024-09-13T06:42:36.771 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000149846 2024-09-13T06:42:36.771 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:36.771 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:36.771 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:36.771 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:36.771 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:36.771 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18719 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 3719168~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:42:36.771 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.850202+0000", 2024-09-13T06:42:36.771 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 164.905520607, 2024-09-13T06:42:36.772 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.102191676, 2024-09-13T06:42:36.772 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:36.772 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:36.772 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:36.772 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:36.772 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:36.772 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18719 2024-09-13T06:42:36.772 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:36.772 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:36.772 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:36.772 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:36.772 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850202+0000", 2024-09-13T06:42:36.772 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:36.772 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:36.773 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:36.773 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:36.773 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850202+0000", 2024-09-13T06:42:36.773 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:36.773 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:36.773 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:36.773 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:36.773 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850202+0000", 2024-09-13T06:42:36.773 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:42:36.773 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:36.773 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:36.773 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:36.773 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850205+0000", 2024-09-13T06:42:36.774 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.89e-06 2024-09-13T06:42:36.774 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:36.774 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:36.774 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:36.774 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850216+0000", 2024-09-13T06:42:36.774 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0233e-05 2024-09-13T06:42:36.774 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:36.774 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:36.774 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:36.774 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850223+0000", 2024-09-13T06:42:36.774 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5299999999999999e-06 2024-09-13T06:42:36.774 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:36.774 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:36.774 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:36.775 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.952106+0000", 2024-09-13T06:42:36.775 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10188309299999999 2024-09-13T06:42:36.775 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:36.775 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:36.775 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:36.775 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.952233+0000", 2024-09-13T06:42:36.775 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000126993 2024-09-13T06:42:36.775 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:36.775 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:36.775 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:36.775 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.952394+0000", 2024-09-13T06:42:36.775 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000160791 2024-09-13T06:42:36.775 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:36.775 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:36.775 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:36.776 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:36.776 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:36.776 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18720 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 3747840~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:42:36.776 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.850726+0000", 2024-09-13T06:42:36.776 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 164.904996778, 2024-09-13T06:42:36.776 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10199504299999999, 2024-09-13T06:42:36.776 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:36.776 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:36.776 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:36.776 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:36.776 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:36.776 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18720 2024-09-13T06:42:36.776 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:36.776 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:36.777 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:36.777 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:36.777 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850726+0000", 2024-09-13T06:42:36.777 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:36.777 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:36.777 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:36.777 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:36.777 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850726+0000", 2024-09-13T06:42:36.777 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:36.777 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:36.777 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:36.777 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:36.777 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850229+0000", 2024-09-13T06:42:36.777 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9995027 2024-09-13T06:42:36.778 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:36.778 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:36.778 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:36.778 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850731+0000", 2024-09-13T06:42:36.778 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00050221599999999999 2024-09-13T06:42:36.778 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:36.778 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:36.778 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:36.778 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850751+0000", 2024-09-13T06:42:36.778 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.9703000000000001e-05 2024-09-13T06:42:36.778 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:36.778 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:36.778 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:36.778 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850764+0000", 2024-09-13T06:42:36.778 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3207000000000001e-05 2024-09-13T06:42:36.779 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:36.779 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:36.779 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:36.779 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.952454+0000", 2024-09-13T06:42:36.779 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101690102 2024-09-13T06:42:36.779 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:36.779 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:36.779 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:36.779 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.952571+0000", 2024-09-13T06:42:36.779 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000116556 2024-09-13T06:42:36.779 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:36.779 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:36.779 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:36.779 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.952721+0000", 2024-09-13T06:42:36.779 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000150419 2024-09-13T06:42:36.780 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:36.780 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:36.780 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:36.780 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:36.780 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:36.780 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18730 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 4034560~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:42:36.780 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.854013+0000", 2024-09-13T06:42:36.780 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 164.901709837, 2024-09-13T06:42:36.780 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10186914399999999, 2024-09-13T06:42:36.780 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:36.780 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:36.780 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:36.780 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:36.780 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:36.781 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18730 2024-09-13T06:42:36.781 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:36.781 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:36.781 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:36.781 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:36.781 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.854013+0000", 2024-09-13T06:42:36.781 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:36.781 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:36.781 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:36.781 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:36.781 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.854013+0000", 2024-09-13T06:42:36.781 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:36.781 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:36.782 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:36.782 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:36.782 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.854013+0000", 2024-09-13T06:42:36.782 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:36.782 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:36.782 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:36.782 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:36.782 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.854016+0000", 2024-09-13T06:42:36.782 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.1839999999999999e-06 2024-09-13T06:42:36.782 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:36.782 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:36.782 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:36.783 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.854025+0000", 2024-09-13T06:42:36.783 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.8030000000000003e-06 2024-09-13T06:42:36.783 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:36.783 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:36.783 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:36.783 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.854033+0000", 2024-09-13T06:42:36.783 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6500000000000002e-06 2024-09-13T06:42:36.783 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:36.783 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:36.783 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:36.783 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.955546+0000", 2024-09-13T06:42:36.783 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10151296 2024-09-13T06:42:36.783 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:36.784 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:36.784 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:36.784 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.955694+0000", 2024-09-13T06:42:36.784 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000147773 2024-09-13T06:42:36.784 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:36.784 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:36.784 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:36.784 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.955882+0000", 2024-09-13T06:42:36.784 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000188371 2024-09-13T06:42:36.784 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:36.784 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:36.784 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:36.784 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:36.784 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:36.785 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18742 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 4378624~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:42:36.785 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.857984+0000", 2024-09-13T06:42:36.785 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 164.89773871400001, 2024-09-13T06:42:36.785 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10179961799999999, 2024-09-13T06:42:36.785 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:36.785 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:36.785 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:36.785 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:36.785 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:36.785 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18742 2024-09-13T06:42:36.785 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:36.785 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:36.785 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:36.786 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:36.786 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.857984+0000", 2024-09-13T06:42:36.786 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:36.786 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:36.786 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:36.786 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:36.786 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.857984+0000", 2024-09-13T06:42:36.786 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:36.786 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:36.786 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:36.786 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:36.786 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.857983+0000", 2024-09-13T06:42:36.786 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:42:36.787 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:36.787 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:36.787 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:36.787 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.857987+0000", 2024-09-13T06:42:36.787 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0670000000000002e-06 2024-09-13T06:42:36.787 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:36.787 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:36.787 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:36.787 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.857997+0000", 2024-09-13T06:42:36.787 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6830000000000003e-06 2024-09-13T06:42:36.787 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:36.787 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:36.787 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:36.787 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.858006+0000", 2024-09-13T06:42:36.787 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.5739999999999996e-06 2024-09-13T06:42:36.788 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:36.788 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:36.788 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:36.788 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.959453+0000", 2024-09-13T06:42:36.788 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101447339 2024-09-13T06:42:36.788 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:36.788 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:36.788 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:36.788 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.959603+0000", 2024-09-13T06:42:36.788 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000150316 2024-09-13T06:42:36.788 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:36.788 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:36.788 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:36.788 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.959784+0000", 2024-09-13T06:42:36.789 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00018065900000000001 2024-09-13T06:42:36.789 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:36.789 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:36.789 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:36.789 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:36.789 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:36.789 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18743 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 4407296~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:42:36.789 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.858012+0000", 2024-09-13T06:42:36.789 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 164.89771072100001, 2024-09-13T06:42:36.789 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10210024500000001, 2024-09-13T06:42:36.789 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:36.789 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:36.790 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:36.790 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:36.790 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:36.790 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18743 2024-09-13T06:42:36.790 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:36.790 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:36.790 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:36.790 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:36.790 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.858012+0000", 2024-09-13T06:42:36.790 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:36.790 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:36.790 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:36.790 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:36.790 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.858012+0000", 2024-09-13T06:42:36.791 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:36.791 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:36.791 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:36.791 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:36.791 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.858011+0000", 2024-09-13T06:42:36.791 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:42:36.791 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:36.791 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:36.791 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:36.791 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.858016+0000", 2024-09-13T06:42:36.791 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0659999999999997e-06 2024-09-13T06:42:36.791 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:36.791 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:36.791 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:36.792 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.858024+0000", 2024-09-13T06:42:36.792 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.7700000000000007e-06 2024-09-13T06:42:36.792 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:36.792 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:36.792 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:36.792 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.858032+0000", 2024-09-13T06:42:36.792 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.7700000000000001e-06 2024-09-13T06:42:36.792 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:36.792 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:36.792 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:36.792 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.959850+0000", 2024-09-13T06:42:36.792 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.1018182 2024-09-13T06:42:36.792 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:36.793 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:36.793 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:36.793 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.959964+0000", 2024-09-13T06:42:36.793 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00011413600000000001 2024-09-13T06:42:36.793 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:36.793 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:36.793 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:36.793 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.960113+0000", 2024-09-13T06:42:36.793 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00014813900000000001 2024-09-13T06:42:36.793 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:36.793 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:36.793 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:36.794 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:36.794 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:36.794 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18755 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 4751360~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:42:36.794 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.862061+0000", 2024-09-13T06:42:36.794 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 164.89366246899999, 2024-09-13T06:42:36.794 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101907023, 2024-09-13T06:42:36.794 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:36.794 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:36.794 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:36.794 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:36.794 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:36.794 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18755 2024-09-13T06:42:36.794 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:36.795 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:36.795 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:36.795 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:36.795 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862061+0000", 2024-09-13T06:42:36.795 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:36.795 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:36.795 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:36.795 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:36.795 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862061+0000", 2024-09-13T06:42:36.795 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:36.795 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:36.795 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:36.795 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:36.795 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862060+0000", 2024-09-13T06:42:36.795 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:42:36.796 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:36.796 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:36.796 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:36.796 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862064+0000", 2024-09-13T06:42:36.796 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.3229999999999999e-06 2024-09-13T06:42:36.796 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:36.796 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:36.796 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:36.796 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862078+0000", 2024-09-13T06:42:36.796 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.433e-05 2024-09-13T06:42:36.796 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:36.796 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:36.797 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:36.797 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862086+0000", 2024-09-13T06:42:36.797 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.3869999999999997e-06 2024-09-13T06:42:36.797 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:36.797 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:36.797 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:36.797 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.963635+0000", 2024-09-13T06:42:36.797 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101549606 2024-09-13T06:42:36.797 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:36.797 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:36.797 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:36.797 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.963783+0000", 2024-09-13T06:42:36.798 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000147312 2024-09-13T06:42:36.798 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:36.798 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:36.798 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:36.798 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.963968+0000", 2024-09-13T06:42:36.798 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000185028 2024-09-13T06:42:36.798 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:36.798 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:36.798 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:36.798 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:36.798 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:36.798 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18756 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 4780032~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:42:36.799 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.862132+0000", 2024-09-13T06:42:36.799 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 164.89359062599999, 2024-09-13T06:42:36.799 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.102159295, 2024-09-13T06:42:36.799 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:36.799 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:36.799 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:36.799 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:36.799 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:36.799 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18756 2024-09-13T06:42:36.799 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:36.799 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:36.799 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:36.799 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:36.800 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862132+0000", 2024-09-13T06:42:36.800 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:36.800 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:36.800 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:36.800 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:36.800 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862132+0000", 2024-09-13T06:42:36.800 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:36.800 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:36.800 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:36.800 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:36.800 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862132+0000", 2024-09-13T06:42:36.800 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:42:36.800 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:36.800 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:36.801 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:36.801 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862136+0000", 2024-09-13T06:42:36.801 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.9559999999999999e-06 2024-09-13T06:42:36.801 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:36.801 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:36.801 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:36.801 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862145+0000", 2024-09-13T06:42:36.801 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6169999999999996e-06 2024-09-13T06:42:36.801 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:36.801 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:36.801 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:36.801 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862153+0000", 2024-09-13T06:42:36.801 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.8359999999999992e-06 2024-09-13T06:42:36.802 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:36.802 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:36.802 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:36.802 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.964018+0000", 2024-09-13T06:42:36.802 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101865421 2024-09-13T06:42:36.802 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:36.802 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:36.802 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:36.802 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.964140+0000", 2024-09-13T06:42:36.802 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000121172 2024-09-13T06:42:36.802 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:36.802 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:36.803 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:36.803 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.964292+0000", 2024-09-13T06:42:36.803 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00015202600000000001 2024-09-13T06:42:36.803 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:36.803 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:36.803 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:36.803 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:36.803 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:36.803 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18768 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 5124096~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:42:36.803 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.866345+0000", 2024-09-13T06:42:36.803 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 164.889378319, 2024-09-13T06:42:36.803 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101779361, 2024-09-13T06:42:36.803 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:36.803 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:36.804 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:36.804 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:36.804 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:36.804 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18768 2024-09-13T06:42:36.804 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:36.804 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:36.804 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:36.804 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:36.804 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.866345+0000", 2024-09-13T06:42:36.804 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:36.804 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:36.804 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:36.804 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:36.805 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.866345+0000", 2024-09-13T06:42:36.805 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:36.805 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:36.805 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:36.805 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:36.805 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.866344+0000", 2024-09-13T06:42:36.805 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:36.805 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:36.805 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:36.805 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:36.805 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.866348+0000", 2024-09-13T06:42:36.805 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.4300000000000002e-06 2024-09-13T06:42:36.805 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:36.805 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:36.806 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:36.806 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.866356+0000", 2024-09-13T06:42:36.806 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.5930000000000006e-06 2024-09-13T06:42:36.806 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:36.806 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:36.806 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:36.806 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.866364+0000", 2024-09-13T06:42:36.806 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5599999999999996e-06 2024-09-13T06:42:36.806 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:36.806 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:36.806 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:36.806 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.967865+0000", 2024-09-13T06:42:36.806 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101501683 2024-09-13T06:42:36.806 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:36.807 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:36.807 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:36.807 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.967981+0000", 2024-09-13T06:42:36.807 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000115643 2024-09-13T06:42:36.807 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:36.807 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:36.807 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:36.807 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.968124+0000", 2024-09-13T06:42:36.807 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00014305500000000001 2024-09-13T06:42:36.807 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:36.807 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:36.807 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:36.807 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:36.807 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:36.807 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18779 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 5439488~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:42:36.808 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.869996+0000", 2024-09-13T06:42:36.808 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 164.88572743399999, 2024-09-13T06:42:36.808 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10189577399999999, 2024-09-13T06:42:36.808 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:36.808 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:36.808 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:36.808 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:36.808 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:36.808 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18779 2024-09-13T06:42:36.808 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:36.808 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:36.808 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:36.808 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:36.808 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.869996+0000", 2024-09-13T06:42:36.809 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:36.809 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:36.809 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:36.809 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:36.809 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.869996+0000", 2024-09-13T06:42:36.809 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:36.809 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:36.809 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:36.809 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:36.809 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.869995+0000", 2024-09-13T06:42:36.809 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:36.809 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:36.809 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:36.809 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:36.810 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.869998+0000", 2024-09-13T06:42:36.810 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.2729999999999998e-06 2024-09-13T06:42:36.810 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:36.810 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:36.810 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:36.810 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.870007+0000", 2024-09-13T06:42:36.810 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.5760000000000006e-06 2024-09-13T06:42:36.810 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:36.810 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:36.810 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:36.810 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.870014+0000", 2024-09-13T06:42:36.810 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.1400000000000002e-06 2024-09-13T06:42:36.811 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:36.811 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:36.811 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:36.811 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.971631+0000", 2024-09-13T06:42:36.811 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101617503 2024-09-13T06:42:36.811 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:36.811 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:36.811 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:36.811 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.971747+0000", 2024-09-13T06:42:36.811 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00011599600000000001 2024-09-13T06:42:36.811 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:36.811 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:36.811 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:36.811 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.971891+0000", 2024-09-13T06:42:36.812 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000143912 2024-09-13T06:42:36.812 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:36.812 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:36.812 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:36.812 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:36.812 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:36.812 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18792 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 5812224~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:42:36.812 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.874371+0000", 2024-09-13T06:42:36.812 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 164.88135230399999, 2024-09-13T06:42:36.812 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101736005, 2024-09-13T06:42:36.812 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:36.812 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:36.812 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:36.813 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:36.813 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:36.813 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18792 2024-09-13T06:42:36.813 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:36.813 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:36.813 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:36.813 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:36.813 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874371+0000", 2024-09-13T06:42:36.813 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:36.813 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:36.813 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:36.813 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:36.813 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874371+0000", 2024-09-13T06:42:36.814 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:36.814 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:36.814 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:36.814 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:36.814 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874370+0000", 2024-09-13T06:42:36.814 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:36.814 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:36.814 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:36.814 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:36.814 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874374+0000", 2024-09-13T06:42:36.814 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.7239999999999998e-06 2024-09-13T06:42:36.814 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:36.814 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:36.814 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:36.814 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874385+0000", 2024-09-13T06:42:36.815 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1293e-05 2024-09-13T06:42:36.815 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:36.815 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:36.815 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:36.815 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874394+0000", 2024-09-13T06:42:36.815 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.0729999999999994e-06 2024-09-13T06:42:36.815 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:36.815 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:36.815 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:36.815 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.975850+0000", 2024-09-13T06:42:36.815 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10145599700000001 2024-09-13T06:42:36.815 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:36.815 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:36.816 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:36.816 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.975963+0000", 2024-09-13T06:42:36.816 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000112689 2024-09-13T06:42:36.816 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:36.816 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:36.816 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:36.816 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.976107+0000", 2024-09-13T06:42:36.816 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000143836 2024-09-13T06:42:36.816 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:36.816 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:36.816 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:36.816 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:36.816 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:36.816 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18793 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 5840896~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:42:36.817 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.874401+0000", 2024-09-13T06:42:36.817 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 164.88132227099999, 2024-09-13T06:42:36.817 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.102005516, 2024-09-13T06:42:36.817 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:36.817 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:36.817 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:36.817 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:36.817 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:36.817 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18793 2024-09-13T06:42:36.817 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:36.817 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:36.817 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:36.817 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:36.818 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874401+0000", 2024-09-13T06:42:36.818 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:36.818 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:36.818 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:36.818 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:36.818 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874401+0000", 2024-09-13T06:42:36.818 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:36.818 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:36.818 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:36.818 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:36.818 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874400+0000", 2024-09-13T06:42:36.818 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:42:36.818 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:36.819 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:36.819 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:36.819 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874404+0000", 2024-09-13T06:42:36.819 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0069999999999999e-06 2024-09-13T06:42:36.819 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:36.819 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:36.819 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:36.819 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874412+0000", 2024-09-13T06:42:36.819 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.5399999999999996e-06 2024-09-13T06:42:36.819 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:36.819 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:36.819 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:36.819 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874420+0000", 2024-09-13T06:42:36.820 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.6199999999999999e-06 2024-09-13T06:42:36.820 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:36.820 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:36.820 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:36.820 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.976150+0000", 2024-09-13T06:42:36.820 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101729874 2024-09-13T06:42:36.820 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:36.820 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:36.820 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:36.820 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.976261+0000", 2024-09-13T06:42:36.820 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000110819 2024-09-13T06:42:36.820 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:36.821 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:36.821 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:36.821 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.976406+0000", 2024-09-13T06:42:36.821 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000145489 2024-09-13T06:42:36.821 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:36.821 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:36.821 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:36.821 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:36.821 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:36.821 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18803 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 6127616~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:42:36.821 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.877851+0000", 2024-09-13T06:42:36.821 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 164.87787177800001, 2024-09-13T06:42:36.821 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101951584, 2024-09-13T06:42:36.821 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:36.822 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:36.822 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:36.822 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:36.822 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:36.822 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18803 2024-09-13T06:42:36.822 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:36.822 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:36.822 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:36.822 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:36.822 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.877851+0000", 2024-09-13T06:42:36.822 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:36.822 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:36.822 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:36.822 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:36.822 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.877851+0000", 2024-09-13T06:42:36.822 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:36.823 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:36.823 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:36.823 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:36.823 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.877851+0000", 2024-09-13T06:42:36.823 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:36.823 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:36.823 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:36.823 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:36.823 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.877854+0000", 2024-09-13T06:42:36.823 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.7929999999999999e-06 2024-09-13T06:42:36.823 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:36.823 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:36.823 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:36.823 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.877864+0000", 2024-09-13T06:42:36.824 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.2029999999999998e-06 2024-09-13T06:42:36.824 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:36.824 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:36.824 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:36.824 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.877873+0000", 2024-09-13T06:42:36.824 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.0440000000000001e-06 2024-09-13T06:42:36.824 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:36.824 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:36.824 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:36.824 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.979544+0000", 2024-09-13T06:42:36.824 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101671198 2024-09-13T06:42:36.824 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:36.824 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:36.824 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:36.824 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.979658+0000", 2024-09-13T06:42:36.825 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000114456 2024-09-13T06:42:36.825 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:36.825 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:36.825 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:36.825 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.979803+0000", 2024-09-13T06:42:36.825 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000144506 2024-09-13T06:42:36.825 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:36.825 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:36.825 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:36.825 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:36.825 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:36.825 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18807 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 6242304~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:42:36.825 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.879235+0000", 2024-09-13T06:42:36.825 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 164.87648774799999, 2024-09-13T06:42:36.825 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101781258, 2024-09-13T06:42:36.826 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:36.826 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:36.826 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:36.826 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:36.826 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:36.826 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18807 2024-09-13T06:42:36.826 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:36.826 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:36.826 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:36.826 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:36.826 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879235+0000", 2024-09-13T06:42:36.826 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:36.826 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:36.826 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:36.827 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:36.827 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879235+0000", 2024-09-13T06:42:36.827 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:36.827 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:36.827 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:36.827 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:36.827 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879235+0000", 2024-09-13T06:42:36.827 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:36.827 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:36.827 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:36.827 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:36.827 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879239+0000", 2024-09-13T06:42:36.827 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.963e-06 2024-09-13T06:42:36.827 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:36.827 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:36.827 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:36.828 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879247+0000", 2024-09-13T06:42:36.828 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6470000000000004e-06 2024-09-13T06:42:36.828 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:36.828 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:36.828 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:36.828 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879255+0000", 2024-09-13T06:42:36.828 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5429999999999996e-06 2024-09-13T06:42:36.828 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:36.828 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:36.828 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:36.828 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.980756+0000", 2024-09-13T06:42:36.828 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10150165999999999 2024-09-13T06:42:36.828 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:36.828 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:36.828 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:36.829 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.980868+0000", 2024-09-13T06:42:36.829 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000111196 2024-09-13T06:42:36.829 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:36.829 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:36.829 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:36.829 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.981017+0000", 2024-09-13T06:42:36.829 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000148846 2024-09-13T06:42:36.829 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:36.829 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:36.829 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:36.829 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:36.829 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:36.829 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18808 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 6270976~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:42:36.830 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.879261+0000", 2024-09-13T06:42:36.830 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 164.87646160899999, 2024-09-13T06:42:36.830 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.102057547, 2024-09-13T06:42:36.830 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:36.830 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:36.830 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:36.830 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:36.830 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:36.830 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18808 2024-09-13T06:42:36.830 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:36.830 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:36.830 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:36.830 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:36.830 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879261+0000", 2024-09-13T06:42:36.830 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:36.831 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:36.831 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:36.831 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:36.831 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879261+0000", 2024-09-13T06:42:36.831 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:36.831 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:36.831 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:36.831 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:36.831 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879261+0000", 2024-09-13T06:42:36.831 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:36.831 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:36.831 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:36.831 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:36.832 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879264+0000", 2024-09-13T06:42:36.832 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.523e-06 2024-09-13T06:42:36.832 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:36.832 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:36.832 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:36.832 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879273+0000", 2024-09-13T06:42:36.832 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6070000000000008e-06 2024-09-13T06:42:36.832 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:36.832 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:36.832 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:36.832 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879280+0000", 2024-09-13T06:42:36.832 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.4699999999999996e-06 2024-09-13T06:42:36.832 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:36.832 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:36.832 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:36.833 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.981060+0000", 2024-09-13T06:42:36.833 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10177934800000001 2024-09-13T06:42:36.833 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:36.833 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:36.833 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:36.833 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.981174+0000", 2024-09-13T06:42:36.833 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000114456 2024-09-13T06:42:36.833 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:36.833 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:36.833 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:36.833 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.981319+0000", 2024-09-13T06:42:36.833 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00014473900000000001 2024-09-13T06:42:36.833 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:36.833 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:36.834 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:36.834 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:36.834 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:36.834 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18811 3.9 3.140f5209 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:42:36.834 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.880449+0000", 2024-09-13T06:42:36.834 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 164.87527407100001, 2024-09-13T06:42:36.834 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101739355, 2024-09-13T06:42:36.834 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:36.834 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:42:36.834 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:36.834 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:36.834 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:36.834 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18811 2024-09-13T06:42:36.834 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:36.834 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:36.835 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:36.835 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:36.835 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880449+0000", 2024-09-13T06:42:36.835 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:36.835 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:36.835 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:36.835 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:36.835 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880449+0000", 2024-09-13T06:42:36.835 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:36.835 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:36.835 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:36.835 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:36.835 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880448+0000", 2024-09-13T06:42:36.835 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:42:36.836 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:36.836 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:36.836 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:36.836 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880452+0000", 2024-09-13T06:42:36.836 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0470000000000004e-06 2024-09-13T06:42:36.836 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:36.836 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:36.836 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:36.836 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880462+0000", 2024-09-13T06:42:36.836 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6530000000000006e-06 2024-09-13T06:42:36.836 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:36.836 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:36.836 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:36.836 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880472+0000", 2024-09-13T06:42:36.837 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0027000000000001e-05 2024-09-13T06:42:36.837 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:36.837 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:36.837 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:36.837 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.982172+0000", 2024-09-13T06:42:36.837 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10170043500000001 2024-09-13T06:42:36.837 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:36.837 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:36.837 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:36.837 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.982188+0000", 2024-09-13T06:42:36.837 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6172999999999999e-05 2024-09-13T06:42:36.837 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:36.837 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:36.838 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:36.838 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:36.838 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:36.838 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18812 3.9 3.140f5209 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:42:36.838 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.880478+0000", 2024-09-13T06:42:36.838 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 164.875244834, 2024-09-13T06:42:36.838 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10177795100000001, 2024-09-13T06:42:36.838 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:36.838 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:42:36.838 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:36.838 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:36.838 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:36.838 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18812 2024-09-13T06:42:36.838 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:36.838 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:36.839 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:36.839 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:36.839 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880478+0000", 2024-09-13T06:42:36.839 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:36.839 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:36.839 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:36.839 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:36.839 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880478+0000", 2024-09-13T06:42:36.839 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:36.839 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:36.839 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:36.839 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:36.839 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880477+0000", 2024-09-13T06:42:36.839 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:42:36.840 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:36.840 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:36.840 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:36.840 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880481+0000", 2024-09-13T06:42:36.840 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.827e-06 2024-09-13T06:42:36.840 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:36.840 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:36.840 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:36.840 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880490+0000", 2024-09-13T06:42:36.840 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6100000000000006e-06 2024-09-13T06:42:36.840 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:36.840 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:36.840 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:36.840 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880497+0000", 2024-09-13T06:42:36.840 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.7030000000000006e-06 2024-09-13T06:42:36.841 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:36.841 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:36.841 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:36.841 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.982241+0000", 2024-09-13T06:42:36.841 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10174351199999999 2024-09-13T06:42:36.841 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:36.841 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:36.841 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:36.841 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.982256+0000", 2024-09-13T06:42:36.841 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5143000000000001e-05 2024-09-13T06:42:36.841 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:36.841 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:36.842 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:36.842 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:36.842 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:36.842 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:160483 3.a 3:57f62123:::rbd_header.112138ed422:head [watch reconnect cookie 140361344088384 gen 3] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e177)", 2024-09-13T06:42:36.842 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:42:17.439011+0000", 2024-09-13T06:42:36.842 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 19.316711643000001, 2024-09-13T06:42:36.842 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.155518861, 2024-09-13T06:42:36.842 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:36.842 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:36.842 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:36.842 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:36.842 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:36.843 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 160483 2024-09-13T06:42:36.843 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:36.843 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:36.843 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:36.843 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:36.843 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:17.439011+0000", 2024-09-13T06:42:36.843 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:36.843 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:36.843 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:36.843 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:36.843 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:17.439011+0000", 2024-09-13T06:42:36.843 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:36.844 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:36.844 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:36.844 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:36.844 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:17.439009+0000", 2024-09-13T06:42:36.844 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999976 2024-09-13T06:42:36.844 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:36.844 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:36.844 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:36.844 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:17.439024+0000", 2024-09-13T06:42:36.844 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.464e-05 2024-09-13T06:42:36.844 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:36.844 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:36.844 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:36.845 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:17.439058+0000", 2024-09-13T06:42:36.845 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.4712999999999998e-05 2024-09-13T06:42:36.845 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:36.845 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:36.845 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:36.845 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:17.439085+0000", 2024-09-13T06:42:36.845 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.6216000000000001e-05 2024-09-13T06:42:36.845 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:36.845 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:36.845 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:36.845 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:17.439182+0000", 2024-09-13T06:42:36.845 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.7020000000000003e-05 2024-09-13T06:42:36.845 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:36.846 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:36.846 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:42:36.846 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:17.439204+0000", 2024-09-13T06:42:36.846 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.2276000000000002e-05 2024-09-13T06:42:36.846 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:36.846 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:36.846 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:36.846 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:18.588627+0000", 2024-09-13T06:42:36.846 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1494235829999999 2024-09-13T06:42:36.846 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:36.846 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:36.846 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for rw locks", 2024-09-13T06:42:36.846 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:18.589031+0000", 2024-09-13T06:42:36.847 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0004035 2024-09-13T06:42:36.847 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:36.847 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:36.847 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:36.847 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:18.590604+0000", 2024-09-13T06:42:36.847 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.001573234 2024-09-13T06:42:36.847 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:36.847 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:36.847 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:36.847 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:18.590791+0000", 2024-09-13T06:42:36.847 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000186701 2024-09-13T06:42:36.847 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:36.847 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:36.847 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:36.848 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:18.594530+0000", 2024-09-13T06:42:36.848 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0037394250000000002 2024-09-13T06:42:36.848 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:36.848 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:36.848 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:36.848 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:36.848 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:36.848 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:42:36.849 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-13T06:42:36.850 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:42:36.844+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:42:36.950 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-13T06:42:36.945+0000 7fa8bb18e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 36790) UID: 0 2024-09-13T06:42:37.019 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:42:37.019 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [], 2024-09-13T06:42:37.019 INFO:teuthology.orchestra.run.smithi139.stdout: "num_ops": 0 2024-09-13T06:42:37.019 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:42:37.033 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-13T06:42:37.051 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:42:37.048+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:42:37.121 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-13T06:42:37.153 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-13T06:42:37.149+0000 7fa8bb18e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 36790) UID: 0 2024-09-13T06:42:37.200 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:42:37.200 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [], 2024-09-13T06:42:37.200 INFO:teuthology.orchestra.run.smithi139.stdout: "complaint_time": 30, 2024-09-13T06:42:37.200 INFO:teuthology.orchestra.run.smithi139.stdout: "num_blocked_ops": 0 2024-09-13T06:42:37.200 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:42:37.215 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-13T06:42:37.217 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 7, 5, 3, 4] out_osds: [6] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-13T06:42:37.217 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-13T06:42:37.217 INFO:tasks.thrashosds.thrasher:Setting full ratio to .001 2024-09-13T06:42:37.217 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set-full-ratio .001 2024-09-13T06:42:37.256 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:42:37.253+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:42:37.272 INFO:teuthology.orchestra.run.smithi081.stdout:osd.0: {} 2024-09-13T06:42:37.272 INFO:teuthology.orchestra.run.smithi081.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-13T06:42:37.289 INFO:teuthology.orchestra.run.smithi081.stdout:osd.1: {} 2024-09-13T06:42:37.289 INFO:teuthology.orchestra.run.smithi081.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-13T06:42:37.306 INFO:teuthology.orchestra.run.smithi081.stdout:osd.2: {} 2024-09-13T06:42:37.307 INFO:teuthology.orchestra.run.smithi081.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-13T06:42:37.323 INFO:teuthology.orchestra.run.smithi081.stdout:osd.3: {} 2024-09-13T06:42:37.323 INFO:teuthology.orchestra.run.smithi081.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-13T06:42:37.341 INFO:teuthology.orchestra.run.smithi081.stdout:osd.4: {} 2024-09-13T06:42:37.341 INFO:teuthology.orchestra.run.smithi081.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-13T06:42:37.354 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:42:37.349+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:42:37.360 INFO:teuthology.orchestra.run.smithi081.stdout:osd.5: {} 2024-09-13T06:42:37.361 INFO:teuthology.orchestra.run.smithi081.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-13T06:42:37.380 INFO:teuthology.orchestra.run.smithi081.stdout:osd.6: {} 2024-09-13T06:42:37.381 INFO:teuthology.orchestra.run.smithi081.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-13T06:42:37.383 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:42:37.383 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:42:37.398 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-13T06:42:37.399 INFO:teuthology.orchestra.run.smithi081.stdout:osd.7: {} 2024-09-13T06:42:37.399 INFO:teuthology.orchestra.run.smithi081.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-13T06:42:37.455 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:42:37.452+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:42:37.555 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:42:37.549+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:42:37.570 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:42:37.570 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:42:37.585 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-13T06:42:37.614 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-13T06:42:37.612+0000 7fcdee203640 -1 log_channel(cluster) log [ERR] : Health check failed: full ratio(s) out of order (OSD_OUT_OF_ORDER_FULL) 2024-09-13T06:42:37.622 INFO:teuthology.orchestra.run.smithi081.stderr:osd set-full-ratio 0.001 2024-09-13T06:42:37.656 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-13T06:42:37.672 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:42:37.669+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:42:37.751 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:42:37.751 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:42:37.757 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-13T06:42:37.753+0000 7fa8bb18e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 36790) UID: 0 2024-09-13T06:42:37.765 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-13T06:42:37.796 INFO:teuthology.orchestra.run.smithi081.stdout:checking clone #35, image image_client.0-clone35 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent36 2024-09-13T06:42:37.862 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-13T06:42:37.857+0000 7fa8bb18e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 36790) UID: 0 2024-09-13T06:42:37.943 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:42:37.944 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:42:37.957 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-13T06:42:37.959 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:42:37.956+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:42:38.060 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-13T06:42:38.053+0000 7fa8bb18e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 36790) UID: 0 2024-09-13T06:42:38.126 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:42:38.126 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:42:38.134 INFO:teuthology.orchestra.run.smithi081.stdout:4790 punch from 0x66f1ddc to 0x6701d30, (0xff54 bytes) 2024-09-13T06:42:38.140 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-13T06:42:38.141 INFO:teuthology.orchestra.run.smithi081.stdout:4791 writesame 0x4a873eb thru 0x4a88a95 data_size 0x1(0x16ab bytes) 2024-09-13T06:42:38.148 INFO:teuthology.orchestra.run.smithi081.stdout:4792 read 0x8f8b416 thru 0x8f8ff0d (0x4af8 bytes) 2024-09-13T06:42:38.148 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:42:38.148 INFO:teuthology.orchestra.run.smithi081.stdout:4794 read 0x8513110 thru 0x8515fc1 (0x2eb2 bytes) 2024-09-13T06:42:38.149 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:42:38.149 INFO:teuthology.orchestra.run.smithi081.stdout:4796 read 0x4b8e1 thru 0x4f142 (0x3862 bytes) 2024-09-13T06:42:38.150 INFO:teuthology.orchestra.run.smithi081.stdout:4797 writesame 0xb338a9c thru 0xb345332 data_size 0x1(0xc897 bytes) 2024-09-13T06:42:38.185 INFO:tasks.ceph.osd.6.smithi139.stderr:2024-09-13T06:42:38.181+0000 7fcd02c5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26385) UID: 0 2024-09-13T06:42:38.196 INFO:teuthology.orchestra.run.smithi081.stdout:4798 write 0x903afe6 thru 0x903cd17 (0x1d32 bytes) 2024-09-13T06:42:38.201 INFO:teuthology.orchestra.run.smithi081.stdout:4799 read 0x1a48d2a thru 0x1a4cf98 (0x426f bytes) 2024-09-13T06:42:38.202 INFO:teuthology.orchestra.run.smithi081.stdout:4805 write 0xa6b7a02 thru 0xa6bbf8a (0x4589 bytes) 2024-09-13T06:42:38.209 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:42:38.209 INFO:teuthology.orchestra.run.smithi081.stdout:4807 write 0x5a54dfd thru 0x5a5fa3c (0xac40 bytes) 2024-09-13T06:42:38.213 INFO:teuthology.orchestra.run.smithi081.stdout:4808 trunc from 0xb9bddd9 to 0xb2e822d 2024-09-13T06:42:38.224 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:42:38.225 INFO:teuthology.orchestra.run.smithi081.stdout:4811 read 0x52e7341 thru 0x52e7e9a (0xb5a bytes) 2024-09-13T06:42:38.225 INFO:teuthology.orchestra.run.smithi081.stdout:4812 write 0x4c3be7b thru 0x4c4adbf (0xef45 bytes) 2024-09-13T06:42:38.232 INFO:teuthology.orchestra.run.smithi081.stdout:4813 read 0x164433a thru 0x164fe96 (0xbb5d bytes) 2024-09-13T06:42:38.233 INFO:teuthology.orchestra.run.smithi081.stdout:4814 read 0xa4f277 thru 0xa4f514 (0x29e bytes) 2024-09-13T06:42:38.234 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:42:38.234 INFO:teuthology.orchestra.run.smithi081.stdout:4816 writesame 0x41696cd thru 0x4170b65 data_size 0x1(0x7499 bytes) 2024-09-13T06:42:38.258 INFO:teuthology.orchestra.run.smithi081.stdout:4817 read 0x76a139f thru 0x76aec36 (0xd898 bytes) 2024-09-13T06:42:38.259 INFO:teuthology.orchestra.run.smithi081.stdout:4820 punch from 0x807341b to 0x8074326, (0xf0b bytes) 2024-09-13T06:42:38.259 INFO:teuthology.orchestra.run.smithi081.stdout:4821 punch from 0x17cc06c to 0x17cfd84, (0x3d18 bytes) 2024-09-13T06:42:38.259 INFO:teuthology.orchestra.run.smithi081.stdout:4822 write 0x65f4222 thru 0x65f8154 (0x3f33 bytes) 2024-09-13T06:42:38.262 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:42:38.257+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:42:38.264 INFO:teuthology.orchestra.run.smithi081.stdout:4824 punch from 0xd6b355 to 0xd7a8e1, (0xf58c bytes) 2024-09-13T06:42:38.264 INFO:teuthology.orchestra.run.smithi081.stdout:4825 read 0x948d7aa thru 0x9496457 (0x8cae bytes) 2024-09-13T06:42:38.283 INFO:teuthology.orchestra.run.smithi081.stdout:4826 write 0xca45f56 thru 0xca5302b (0xd0d6 bytes) 2024-09-13T06:42:38.291 INFO:teuthology.orchestra.run.smithi081.stdout:4827 punch from 0x39e53cd to 0x39f1970, (0xc5a3 bytes) 2024-09-13T06:42:38.316 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:42:38.316 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:42:38.316 INFO:teuthology.orchestra.run.smithi081.stdout:4831 trunc from 0xca5302c to 0x2c91074 2024-09-13T06:42:38.335 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-13T06:42:38.355 INFO:teuthology.orchestra.run.smithi081.stdout:4832 punch from 0x1a4bd2d to 0x1a4c54e, (0x821 bytes) 2024-09-13T06:42:38.355 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:42:38.355 INFO:teuthology.orchestra.run.smithi081.stdout:4836 read 0x223e2f3 thru 0x22440d3 (0x5de1 bytes) 2024-09-13T06:42:38.356 INFO:teuthology.orchestra.run.smithi081.stdout:4837 read 0x12cc2a2 thru 0x12d19a5 (0x5704 bytes) 2024-09-13T06:42:38.357 INFO:teuthology.orchestra.run.smithi081.stdout:4838 read 0x10d811e thru 0x10e1d5a (0x9c3d bytes) 2024-09-13T06:42:38.359 INFO:teuthology.orchestra.run.smithi081.stdout:4839 punch from 0x2bd96a1 to 0x2bdf110, (0x5a6f bytes) 2024-09-13T06:42:38.373 INFO:teuthology.orchestra.run.smithi081.stdout:4840 trunc from 0x2c91074 to 0x816011b 2024-09-13T06:42:38.376 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:42:38.373+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:42:38.385 INFO:teuthology.orchestra.run.smithi081.stdout:4841 read 0x3b39195 thru 0x3b3a39c (0x1208 bytes) 2024-09-13T06:42:38.385 INFO:teuthology.orchestra.run.smithi081.stdout:4843 read 0x27d72ff thru 0x27df497 (0x8199 bytes) 2024-09-13T06:42:38.387 INFO:teuthology.orchestra.run.smithi081.stdout:4844 trunc from 0x816011b to 0x7bc385b 2024-09-13T06:42:38.398 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:42:38.398 INFO:teuthology.orchestra.run.smithi081.stdout:4846 punch from 0x5f27d87 to 0x5f2b50e, (0x3787 bytes) 2024-09-13T06:42:38.398 INFO:teuthology.orchestra.run.smithi081.stdout:4847 writesame 0xc76146 thru 0xc76399 data_size 0x2(0x254 bytes) 2024-09-13T06:42:38.413 INFO:teuthology.orchestra.run.smithi081.stdout:4848 trunc from 0x7bc385b to 0xc46b827 2024-09-13T06:42:38.443 INFO:teuthology.orchestra.run.smithi081.stdout:4849 writesame 0xe553f1a thru 0xe55c7df data_size 0x7(0x88c6 bytes) 2024-09-13T06:42:38.443 INFO:teuthology.orchestra.run.smithi081.stdout:4850 write 0x31641c5 thru 0x316dcb6 (0x9af2 bytes) 2024-09-13T06:42:38.449 INFO:teuthology.orchestra.run.smithi081.stdout:4851 punch from 0xb387415 to 0xb39038a, (0x8f75 bytes) 2024-09-13T06:42:38.449 INFO:teuthology.orchestra.run.smithi081.stdout:4852 punch from 0x4f53c77 to 0x4f5d886, (0x9c0f bytes) 2024-09-13T06:42:38.449 INFO:teuthology.orchestra.run.smithi081.stdout:4853 write 0x8987e01 thru 0x8994abb (0xccbb bytes) 2024-09-13T06:42:38.455 INFO:teuthology.orchestra.run.smithi081.stdout:4854 punch from 0x5b40ec4 to 0x5b4c486, (0xb5c2 bytes) 2024-09-13T06:42:38.455 INFO:teuthology.orchestra.run.smithi081.stdout:4855 read 0x8e045b3 thru 0x8e0a0c0 (0x5b0e bytes) 2024-09-13T06:42:38.455 INFO:teuthology.orchestra.run.smithi081.stdout:4856 punch from 0x60526dd to 0x6057418, (0x4d3b bytes) 2024-09-13T06:42:38.455 INFO:teuthology.orchestra.run.smithi081.stdout:4859 write 0xde88ad2 thru 0xde8ce7a (0x43a9 bytes) 2024-09-13T06:42:38.459 INFO:teuthology.orchestra.run.smithi081.stdout:4860 read 0x25c3c4f thru 0x25c4c68 (0x101a bytes) 2024-09-13T06:42:38.461 INFO:teuthology.orchestra.run.smithi081.stdout:4862 punch from 0xe2c0d79 to 0xe2c15d4, (0x85b bytes) 2024-09-13T06:42:38.461 INFO:teuthology.orchestra.run.smithi081.stdout:4863 write 0x5e84546 thru 0x5e868b1 (0x236c bytes) 2024-09-13T06:42:38.464 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:42:38.461+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:42:38.465 INFO:teuthology.orchestra.run.smithi081.stdout:4865 write 0xd0b64d0 thru 0xd0be7ae (0x82df bytes) 2024-09-13T06:42:38.499 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:42:38.499 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:42:38.499 INFO:teuthology.orchestra.run.smithi081.stdout:4866 trunc from 0xe55c7e0 to 0x3d022b9 2024-09-13T06:42:38.515 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-13T06:42:38.524 INFO:teuthology.orchestra.run.smithi081.stdout:4867 write 0x2d84792 thru 0x2d88e26 (0x4695 bytes) 2024-09-13T06:42:38.541 INFO:teuthology.orchestra.run.smithi081.stdout:4868 trunc from 0x3d022b9 to 0x93fcdd0 2024-09-13T06:42:38.550 INFO:teuthology.orchestra.run.smithi081.stdout:4869 read 0x72651d2 thru 0x72681be (0x2fed bytes) 2024-09-13T06:42:38.550 INFO:teuthology.orchestra.run.smithi081.stdout:4870 punch from 0x4518e73 to 0x45269ac, (0xdb39 bytes) 2024-09-13T06:42:38.564 INFO:tasks.ceph.osd.6.smithi139.stderr:2024-09-13T06:42:38.561+0000 7fcd02c5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26385) UID: 0 2024-09-13T06:42:38.568 INFO:teuthology.orchestra.run.smithi081.stdout:4871 write 0xe3dea17 thru 0xe3e31b4 (0x479e bytes) 2024-09-13T06:42:38.574 INFO:teuthology.orchestra.run.smithi081.stdout:4872 read 0x2db255f thru 0x2dbccd6 (0xa778 bytes) 2024-09-13T06:42:38.575 INFO:teuthology.orchestra.run.smithi081.stdout:4873 read 0x86a7fa9 thru 0x86b1bbc (0x9c14 bytes) 2024-09-13T06:42:38.575 INFO:teuthology.orchestra.run.smithi081.stdout:4874 punch from 0x721547a to 0x7223c43, (0xe7c9 bytes) 2024-09-13T06:42:38.575 INFO:teuthology.orchestra.run.smithi081.stdout:4875 read 0x697577e thru 0x697ff32 (0xa7b5 bytes) 2024-09-13T06:42:38.575 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:42:38.575 INFO:teuthology.orchestra.run.smithi081.stdout:4878 write 0xab0ed8 thru 0xabb85d (0xa986 bytes) 2024-09-13T06:42:38.579 INFO:teuthology.orchestra.run.smithi081.stdout:4879 read 0x6ea27a3 thru 0x6eaaa87 (0x82e5 bytes) 2024-09-13T06:42:38.579 INFO:teuthology.orchestra.run.smithi081.stdout:4880 writesame 0x41c658 thru 0x41f5a6 data_size 0xb(0x2f4f bytes) 2024-09-13T06:42:38.598 INFO:teuthology.orchestra.run.smithi081.stdout:4881 trunc from 0xe3e31b5 to 0x6525971 2024-09-13T06:42:38.619 INFO:teuthology.orchestra.run.smithi081.stdout:4883 punch from 0x361f181 to 0x3625430, (0x62af bytes) 2024-09-13T06:42:38.622 INFO:teuthology.orchestra.run.smithi081.stdout:4884 trunc from 0x6525971 to 0x46a1918 2024-09-13T06:42:38.637 INFO:teuthology.orchestra.run.smithi081.stdout:4885 write 0x25bb119 thru 0x25c9803 (0xe6eb bytes) 2024-09-13T06:42:38.643 INFO:teuthology.orchestra.run.smithi081.stdout:4886 write 0x2b614d6 thru 0x2b6834a (0x6e75 bytes) 2024-09-13T06:42:38.645 INFO:teuthology.orchestra.run.smithi081.stderr:noscrub is set 2024-09-13T06:42:38.651 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:42:38.651 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:42:38.653 INFO:tasks.thrashosds.thrasher:Setting full ratio back to .95 2024-09-13T06:42:38.653 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set-full-ratio .95 2024-09-13T06:42:38.662 INFO:teuthology.orchestra.run.smithi081.stdout:4887 writesame 0x64b4def thru 0x64ba4ae data_size 0x20(0x56c0 bytes) 2024-09-13T06:42:38.662 INFO:teuthology.orchestra.run.smithi081.stdout:4888 read 0x49415b9 thru 0x494a322 (0x8d6a bytes) 2024-09-13T06:42:38.663 INFO:teuthology.orchestra.run.smithi081.stdout:4890 read 0x513a469 thru 0x514288f (0x8427 bytes) 2024-09-13T06:42:38.663 INFO:teuthology.orchestra.run.smithi081.stdout:4891 write 0x3b3fdf thru 0x3be4fb (0xa51d bytes) 2024-09-13T06:42:38.665 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:42:38.661+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:42:38.666 INFO:teuthology.orchestra.run.smithi081.stdout:4892 read 0xd074f5 thru 0xd15dbc (0xe8c8 bytes) 2024-09-13T06:42:38.670 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-13T06:42:38.684 INFO:teuthology.orchestra.run.smithi081.stdout:4893 write 0xca3f346 thru 0xca48061 (0x8d1c bytes) 2024-09-13T06:42:38.698 INFO:teuthology.orchestra.run.smithi081.stdout:4894 trunc from 0xca48062 to 0x7bd598b 2024-09-13T06:42:38.717 INFO:teuthology.orchestra.run.smithi081.stdout:4895 read 0x6e5e2d4 thru 0x6e6cebe (0xebeb bytes) 2024-09-13T06:42:38.719 INFO:teuthology.orchestra.run.smithi081.stdout:4896 trunc from 0x7bd598b to 0x90877b7 2024-09-13T06:42:38.739 INFO:teuthology.orchestra.run.smithi081.stdout:4897 trunc from 0x90877b7 to 0x30ed6e 2024-09-13T06:42:38.766 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-13T06:42:38.761+0000 7fa8bb18e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 36790) UID: 0 2024-09-13T06:42:38.807 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:42:38.807 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:42:38.812 INFO:teuthology.orchestra.run.smithi081.stdout:4900 punch from 0x1efd03 to 0x1f52dd, (0x55da bytes) 2024-09-13T06:42:38.812 INFO:teuthology.orchestra.run.smithi081.stdout:4901 punch from 0x132c10 to 0x141b33, (0xef23 bytes) 2024-09-13T06:42:38.829 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-13T06:42:38.834 INFO:teuthology.orchestra.run.smithi081.stdout:4903 write 0xb06bbe8 thru 0xb072797 (0x6bb0 bytes) 2024-09-13T06:42:38.841 INFO:teuthology.orchestra.run.smithi081.stdout:4904 read 0x48051e thru 0x48a8b2 (0xa395 bytes) 2024-09-13T06:42:38.841 INFO:teuthology.orchestra.run.smithi081.stdout:4906 read 0x61026ab thru 0x6103386 (0xcdc bytes) 2024-09-13T06:42:38.846 INFO:teuthology.orchestra.run.smithi081.stdout:4907 trunc from 0xb072798 to 0x7953951 2024-09-13T06:42:38.865 INFO:teuthology.orchestra.run.smithi081.stdout:4908 write 0x73355ba thru 0x73428c8 (0xd30f bytes) 2024-09-13T06:42:38.866 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:42:38.864+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:42:38.890 INFO:teuthology.orchestra.run.smithi081.stdout:4909 writesame 0xd9864cc thru 0xd988e0f data_size 0x26(0x2944 bytes) 2024-09-13T06:42:38.890 INFO:teuthology.orchestra.run.smithi081.stdout:4910 read 0x41f59d5 thru 0x41f750c (0x1b38 bytes) 2024-09-13T06:42:38.890 INFO:teuthology.orchestra.run.smithi081.stdout:4912 read 0x40eb79f thru 0x40f4afc (0x935e bytes) 2024-09-13T06:42:38.890 INFO:teuthology.orchestra.run.smithi081.stdout:4913 read 0x2f2d6eb thru 0x2f33da6 (0x66bc bytes) 2024-09-13T06:42:38.890 INFO:teuthology.orchestra.run.smithi081.stdout:4916 write 0xc97bf2c thru 0xc97d20c (0x12e1 bytes) 2024-09-13T06:42:38.897 INFO:teuthology.orchestra.run.smithi081.stdout:4917 read 0xcc27e55 thru 0xcc2ba69 (0x3c15 bytes) 2024-09-13T06:42:38.897 INFO:teuthology.orchestra.run.smithi081.stdout:4918 write 0x3604924 thru 0x36089b8 (0x4095 bytes) 2024-09-13T06:42:38.903 INFO:teuthology.orchestra.run.smithi081.stdout:4919 write 0x92c5a1e thru 0x92d09dc (0xafbf bytes) 2024-09-13T06:42:38.912 INFO:teuthology.orchestra.run.smithi081.stdout:4920 punch from 0x4bc5c3 to 0x4c44c1, (0x7efe bytes) 2024-09-13T06:42:38.924 INFO:teuthology.orchestra.run.smithi081.stdout:4922 trunc from 0xd988e10 to 0x5d9630b 2024-09-13T06:42:38.951 INFO:teuthology.orchestra.run.smithi081.stdout:4923 write 0x61dd95f thru 0x61e2fe2 (0x5684 bytes) 2024-09-13T06:42:38.957 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:42:38.957 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:42:38.958 INFO:teuthology.orchestra.run.smithi081.stdout:4924 read 0x408360 thru 0x4162f6 (0xdf97 bytes) 2024-09-13T06:42:38.958 INFO:teuthology.orchestra.run.smithi081.stdout:4925 read 0x2daacc4 thru 0x2db725a (0xc597 bytes) 2024-09-13T06:42:38.967 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:42:38.961+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:42:38.979 INFO:teuthology.orchestra.run.smithi081.stdout:4926 write 0xeae2178 thru 0xeae7910 (0x5799 bytes) 2024-09-13T06:42:38.980 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-13T06:42:38.986 INFO:teuthology.orchestra.run.smithi081.stdout:4927 punch from 0x84c3d5 to 0x858415, (0xc040 bytes) 2024-09-13T06:42:38.986 INFO:teuthology.orchestra.run.smithi081.stdout:4929 read 0x42ba239 thru 0x42be2fa (0x40c2 bytes) 2024-09-13T06:42:38.987 INFO:teuthology.orchestra.run.smithi081.stdout:4930 read 0x4481d6b thru 0x448cfe2 (0xb278 bytes) 2024-09-13T06:42:38.987 INFO:teuthology.orchestra.run.smithi081.stdout:4932 writesame 0xa601aa0 thru 0xa6031ba data_size 0x23(0x171b bytes) 2024-09-13T06:42:38.992 INFO:teuthology.orchestra.run.smithi081.stdout:4933 clone 38 order 25 su 262144 sc 15 2024-09-13T06:42:39.068 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:42:39.064+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:42:39.101 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:42:39.101 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:42:39.115 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-13T06:42:39.206 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:42:39.204+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:42:39.269 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:42:39.264+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:42:39.284 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:42:39.285 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:42:39.299 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-13T06:42:39.370 INFO:tasks.ceph.osd.6.smithi139.stderr:2024-09-13T06:42:39.365+0000 7fcd02c5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26385) UID: 0 2024-09-13T06:42:39.416 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-13T06:42:39.471 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:42:39.468+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:42:39.471 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:42:39.471 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:42:39.487 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-13T06:42:39.552 INFO:teuthology.orchestra.run.smithi081.stdout:osd.0: {} 2024-09-13T06:42:39.553 INFO:teuthology.orchestra.run.smithi081.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-13T06:42:39.570 INFO:teuthology.orchestra.run.smithi081.stdout:osd.1: {} 2024-09-13T06:42:39.570 INFO:teuthology.orchestra.run.smithi081.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-13T06:42:39.571 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:42:39.568+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:42:39.587 INFO:teuthology.orchestra.run.smithi081.stdout:osd.2: {} 2024-09-13T06:42:39.587 INFO:teuthology.orchestra.run.smithi081.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-13T06:42:39.603 INFO:teuthology.orchestra.run.smithi081.stdout:osd.3: {} 2024-09-13T06:42:39.603 INFO:teuthology.orchestra.run.smithi081.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-13T06:42:39.623 INFO:teuthology.orchestra.run.smithi081.stdout:osd.4: {} 2024-09-13T06:42:39.623 INFO:teuthology.orchestra.run.smithi081.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-13T06:42:39.646 INFO:teuthology.orchestra.run.smithi081.stdout:osd.5: {} 2024-09-13T06:42:39.646 INFO:teuthology.orchestra.run.smithi081.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-13T06:42:39.646 INFO:teuthology.orchestra.run.smithi081.stderr:osd set-full-ratio 0.95 2024-09-13T06:42:39.647 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:42:39.647 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-13T06:42:39.648 INFO:teuthology.orchestra.run.smithi081.stdout: "num_ops": 0 2024-09-13T06:42:39.648 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:42:39.666 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-13T06:42:39.675 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:42:39.672+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:42:39.677 INFO:teuthology.orchestra.run.smithi081.stdout:osd.6: {} 2024-09-13T06:42:39.678 INFO:teuthology.orchestra.run.smithi081.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-13T06:42:39.702 INFO:teuthology.orchestra.run.smithi081.stdout:osd.7: {} 2024-09-13T06:42:39.702 INFO:teuthology.orchestra.run.smithi081.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-13T06:42:39.774 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:42:39.772+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:42:39.802 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:42:39.802 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-13T06:42:39.802 INFO:teuthology.orchestra.run.smithi081.stdout: "complaint_time": 30, 2024-09-13T06:42:39.802 INFO:teuthology.orchestra.run.smithi081.stdout: "num_blocked_ops": 0 2024-09-13T06:42:39.803 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:42:39.815 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-13T06:42:39.875 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:42:39.873+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:42:39.976 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:42:39.973+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:42:39.982 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:42:39.982 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 20, 2024-09-13T06:42:39.982 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 600, 2024-09-13T06:42:39.982 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [ 2024-09-13T06:42:39.982 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:39.982 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:36160 3.f 3:f62782c2:::rbd_object_map.11219660270d.0000000000000016:head [call] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-13T06:42:39.982 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:01.607291+0000", 2024-09-13T06:42:39.982 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 158.373543923, 2024-09-13T06:42:39.982 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.99619456699999998, 2024-09-13T06:42:39.982 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:39.983 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:39.983 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:39.983 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:39.983 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:39.983 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 36160 2024-09-13T06:42:39.983 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:39.983 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:39.983 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:39.983 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:39.983 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:01.607291+0000", 2024-09-13T06:42:39.983 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:39.983 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:39.983 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:39.983 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:39.984 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:01.607291+0000", 2024-09-13T06:42:39.984 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:39.984 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:39.984 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:39.984 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:39.984 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:01.607289+0000", 2024-09-13T06:42:39.984 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999976 2024-09-13T06:42:39.984 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:39.984 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:39.984 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:39.984 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:01.607302+0000", 2024-09-13T06:42:39.984 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3018e-05 2024-09-13T06:42:39.984 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:39.985 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:39.985 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:39.985 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:01.607323+0000", 2024-09-13T06:42:39.985 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1030999999999999e-05 2024-09-13T06:42:39.985 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:39.985 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:39.985 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:39.985 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:01.607342+0000", 2024-09-13T06:42:39.985 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8961e-05 2024-09-13T06:42:39.985 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:39.985 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:39.985 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:39.986 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:01.607425+0000", 2024-09-13T06:42:39.986 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.3171999999999996e-05 2024-09-13T06:42:39.986 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:39.986 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:39.986 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:42:39.986 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:01.607441+0000", 2024-09-13T06:42:39.986 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5996999999999999e-05 2024-09-13T06:42:39.986 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:39.986 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:39.987 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:39.987 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:02.596186+0000", 2024-09-13T06:42:39.987 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.98874432000000001 2024-09-13T06:42:39.987 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:39.987 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:39.987 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for missing object", 2024-09-13T06:42:39.987 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:02.596618+0000", 2024-09-13T06:42:39.987 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000432032 2024-09-13T06:42:39.987 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:39.987 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:39.987 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:39.987 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:02.600845+0000", 2024-09-13T06:42:39.987 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0042277410000000001 2024-09-13T06:42:39.988 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:39.988 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:39.988 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:39.988 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:02.601003+0000", 2024-09-13T06:42:39.988 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00015731999999999999 2024-09-13T06:42:39.988 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:39.988 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:39.988 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:39.988 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:02.603486+0000", 2024-09-13T06:42:39.988 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0024832510000000001 2024-09-13T06:42:39.988 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:39.988 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:39.988 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:39.988 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:39.989 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:39.989 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:37806 3.9 3:951cb95b:::rbd_data.1121d8143c6e.0000000000000002:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e56)", 2024-09-13T06:42:39.989 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:06.373482+0000", 2024-09-13T06:42:39.989 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 153.60735288699999, 2024-09-13T06:42:39.989 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.002476213, 2024-09-13T06:42:39.989 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:39.989 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:39.989 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:39.990 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:39.990 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:39.990 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 37806 2024-09-13T06:42:39.990 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:39.990 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:39.990 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:39.990 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:39.990 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.373482+0000", 2024-09-13T06:42:39.990 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:39.990 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:39.990 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:39.990 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:39.990 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.373482+0000", 2024-09-13T06:42:39.990 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:39.991 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:39.991 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:39.991 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:39.991 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.373479+0000", 2024-09-13T06:42:39.991 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999962 2024-09-13T06:42:39.991 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:39.991 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:39.991 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:39.991 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.373495+0000", 2024-09-13T06:42:39.991 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6640999999999999e-05 2024-09-13T06:42:39.991 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:39.991 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:39.991 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:39.991 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.373542+0000", 2024-09-13T06:42:39.991 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6229000000000001e-05 2024-09-13T06:42:39.992 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:39.992 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:39.992 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:39.992 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.373564+0000", 2024-09-13T06:42:39.992 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2684000000000002e-05 2024-09-13T06:42:39.992 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:39.992 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:39.992 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:39.992 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374268+0000", 2024-09-13T06:42:39.992 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00070363700000000001 2024-09-13T06:42:39.992 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:39.992 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:39.992 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:42:39.993 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374305+0000", 2024-09-13T06:42:39.993 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.6936e-05 2024-09-13T06:42:39.993 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:39.993 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:39.993 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:39.993 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.375175+0000", 2024-09-13T06:42:39.993 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.000870454 2024-09-13T06:42:39.993 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:39.993 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:39.993 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:39.993 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.375678+0000", 2024-09-13T06:42:39.993 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00050292499999999999 2024-09-13T06:42:39.994 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:39.994 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:39.994 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:39.994 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.375959+0000", 2024-09-13T06:42:39.994 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00028050599999999997 2024-09-13T06:42:39.994 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:39.994 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:39.994 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:39.994 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:39.994 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:39.994 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:37821 3.9 3:951cb95b:::rbd_data.1121d8143c6e.0000000000000002:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e56)", 2024-09-13T06:42:39.994 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:06.374454+0000", 2024-09-13T06:42:39.994 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 153.60638177000001, 2024-09-13T06:42:39.994 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.002545072, 2024-09-13T06:42:39.994 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:39.995 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:39.995 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:39.995 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:39.995 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:39.995 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 37821 2024-09-13T06:42:39.995 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:39.995 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:39.995 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:39.995 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:39.995 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374454+0000", 2024-09-13T06:42:39.995 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:39.995 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:39.995 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:39.995 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:39.996 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374454+0000", 2024-09-13T06:42:39.996 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:39.996 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:39.996 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:39.996 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:39.996 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374452+0000", 2024-09-13T06:42:39.996 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999981 2024-09-13T06:42:39.996 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:39.996 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:39.996 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:39.996 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374463+0000", 2024-09-13T06:42:39.996 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0756e-05 2024-09-13T06:42:39.996 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:39.997 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:39.997 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:39.997 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374487+0000", 2024-09-13T06:42:39.997 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4887000000000001e-05 2024-09-13T06:42:39.997 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:39.997 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:39.997 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:39.997 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374504+0000", 2024-09-13T06:42:39.997 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6852000000000001e-05 2024-09-13T06:42:39.997 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:39.997 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:39.997 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:39.998 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374829+0000", 2024-09-13T06:42:39.998 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000324684 2024-09-13T06:42:39.998 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:39.998 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:39.998 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:42:39.998 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374880+0000", 2024-09-13T06:42:39.998 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.1378000000000002e-05 2024-09-13T06:42:39.998 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:39.998 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:39.998 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:39.998 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.376423+0000", 2024-09-13T06:42:39.998 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.001542734 2024-09-13T06:42:39.998 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:39.998 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:39.999 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:39.999 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.376607+0000", 2024-09-13T06:42:39.999 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000183656 2024-09-13T06:42:39.999 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:39.999 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:39.999 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:39.999 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.376999+0000", 2024-09-13T06:42:39.999 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00039191200000000001 2024-09-13T06:42:39.999 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:39.999 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:39.999 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:39.999 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.000 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.000 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:37836 3.9 3:951cb95b:::rbd_data.1121d8143c6e.0000000000000002:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e56)", 2024-09-13T06:42:40.000 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:06.374929+0000", 2024-09-13T06:42:40.000 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 153.60590611800001, 2024-09-13T06:42:40.000 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.002778825, 2024-09-13T06:42:40.000 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:40.000 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:40.000 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:40.000 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:40.000 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:40.000 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 37836 2024-09-13T06:42:40.000 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.000 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:40.000 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.001 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:40.001 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374929+0000", 2024-09-13T06:42:40.001 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:40.001 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.001 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.001 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:40.001 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374929+0000", 2024-09-13T06:42:40.001 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:40.001 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.001 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.001 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:40.001 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374927+0000", 2024-09-13T06:42:40.001 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999981 2024-09-13T06:42:40.002 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.002 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.002 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:40.002 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374939+0000", 2024-09-13T06:42:40.002 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1846e-05 2024-09-13T06:42:40.002 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.002 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.002 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:40.002 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374962+0000", 2024-09-13T06:42:40.002 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3054e-05 2024-09-13T06:42:40.002 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.002 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.002 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:40.002 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374978+0000", 2024-09-13T06:42:40.003 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5899000000000001e-05 2024-09-13T06:42:40.003 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.003 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.003 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:40.003 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.375106+0000", 2024-09-13T06:42:40.003 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00012789 2024-09-13T06:42:40.003 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.003 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.003 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:42:40.003 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.375134+0000", 2024-09-13T06:42:40.003 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.8254000000000001e-05 2024-09-13T06:42:40.003 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.003 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.004 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:40.004 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.377082+0000", 2024-09-13T06:42:40.004 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0019471520000001 2024-09-13T06:42:40.004 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.004 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.004 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:40.004 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.377330+0000", 2024-09-13T06:42:40.004 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00024834199999999997 2024-09-13T06:42:40.004 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.004 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.004 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:40.004 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.377708+0000", 2024-09-13T06:42:40.004 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00037817100000000001 2024-09-13T06:42:40.005 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:40.005 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:40.005 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:40.005 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.005 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.005 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:37851 3.9 3:951cb95b:::rbd_data.1121d8143c6e.0000000000000002:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e56)", 2024-09-13T06:42:40.005 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:06.382636+0000", 2024-09-13T06:42:40.005 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 153.598199233, 2024-09-13T06:42:40.005 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.99582539400000003, 2024-09-13T06:42:40.005 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:40.005 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:40.005 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:40.005 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:40.006 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:40.006 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 37851 2024-09-13T06:42:40.006 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.006 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:40.006 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.006 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:40.006 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.382636+0000", 2024-09-13T06:42:40.006 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:40.006 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.006 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.006 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:40.006 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.382636+0000", 2024-09-13T06:42:40.006 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:40.006 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.007 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.007 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:40.007 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.382633+0000", 2024-09-13T06:42:40.007 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999971 2024-09-13T06:42:40.007 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.007 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.007 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:40.007 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.382652+0000", 2024-09-13T06:42:40.007 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8834999999999998e-05 2024-09-13T06:42:40.007 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.007 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.007 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:40.007 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.382695+0000", 2024-09-13T06:42:40.007 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.3136000000000002e-05 2024-09-13T06:42:40.008 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.008 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.008 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:40.008 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.382716+0000", 2024-09-13T06:42:40.008 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1421e-05 2024-09-13T06:42:40.008 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.008 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.008 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:40.008 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.382860+0000", 2024-09-13T06:42:40.008 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00014389200000000001 2024-09-13T06:42:40.008 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.008 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.008 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:42:40.008 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.382890+0000", 2024-09-13T06:42:40.009 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9827000000000001e-05 2024-09-13T06:42:40.009 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.009 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.009 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:40.009 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.377779+0000", 2024-09-13T06:42:40.009 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.99488842899999996 2024-09-13T06:42:40.009 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.009 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.009 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:40.009 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.378007+0000", 2024-09-13T06:42:40.009 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00022838099999999999 2024-09-13T06:42:40.009 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.009 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.010 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:40.010 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.378462+0000", 2024-09-13T06:42:40.010 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00045452300000000003 2024-09-13T06:42:40.010 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:40.010 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:40.010 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:40.010 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.010 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.010 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:37866 3.9 3:951cb95b:::rbd_data.1121d8143c6e.0000000000000002:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e56)", 2024-09-13T06:42:40.010 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:06.383951+0000", 2024-09-13T06:42:40.010 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 153.596884547, 2024-09-13T06:42:40.010 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.99517962299999996, 2024-09-13T06:42:40.011 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:40.011 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:40.011 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:40.011 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:40.011 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:40.011 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 37866 2024-09-13T06:42:40.011 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.011 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:40.011 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.011 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:40.011 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.383951+0000", 2024-09-13T06:42:40.011 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:40.011 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.012 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.012 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:40.012 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.383951+0000", 2024-09-13T06:42:40.012 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:40.012 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.012 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.012 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:40.012 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.383949+0000", 2024-09-13T06:42:40.012 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999981 2024-09-13T06:42:40.012 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.012 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.012 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:40.012 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.383961+0000", 2024-09-13T06:42:40.013 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1999e-05 2024-09-13T06:42:40.013 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.013 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.013 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:40.013 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384019+0000", 2024-09-13T06:42:40.013 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7621000000000003e-05 2024-09-13T06:42:40.013 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.013 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.013 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:40.013 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384040+0000", 2024-09-13T06:42:40.013 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1528000000000001e-05 2024-09-13T06:42:40.013 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.013 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.014 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:40.014 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384186+0000", 2024-09-13T06:42:40.014 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00014573799999999999 2024-09-13T06:42:40.014 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.014 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.014 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:42:40.014 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384204+0000", 2024-09-13T06:42:40.014 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7992e-05 2024-09-13T06:42:40.014 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.014 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.014 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:40.014 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.378536+0000", 2024-09-13T06:42:40.014 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.99433268600000002 2024-09-13T06:42:40.014 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.015 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.015 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:40.015 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.378771+0000", 2024-09-13T06:42:40.015 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00023445399999999999 2024-09-13T06:42:40.015 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.015 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.015 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:40.015 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.379130+0000", 2024-09-13T06:42:40.015 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00035954200000000002 2024-09-13T06:42:40.015 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:40.015 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:40.015 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:40.015 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.016 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.016 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:37881 3.9 3:951cb95b:::rbd_data.1121d8143c6e.0000000000000002:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e56)", 2024-09-13T06:42:40.016 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:06.384239+0000", 2024-09-13T06:42:40.016 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 153.59659613299999, 2024-09-13T06:42:40.016 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.99541483500000005, 2024-09-13T06:42:40.016 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:40.016 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:40.016 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:40.016 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:40.016 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:40.016 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 37881 2024-09-13T06:42:40.016 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.016 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:40.017 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.017 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:40.017 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384239+0000", 2024-09-13T06:42:40.017 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:40.017 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.017 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.017 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:40.017 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384239+0000", 2024-09-13T06:42:40.017 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:40.017 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.017 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.017 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:40.017 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384238+0000", 2024-09-13T06:42:40.018 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999986 2024-09-13T06:42:40.018 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.018 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.018 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:40.018 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384246+0000", 2024-09-13T06:42:40.018 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.2449999999999998e-06 2024-09-13T06:42:40.018 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.018 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.018 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:40.018 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384268+0000", 2024-09-13T06:42:40.018 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1518e-05 2024-09-13T06:42:40.018 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.018 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.018 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:40.018 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384282+0000", 2024-09-13T06:42:40.019 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4501999999999999e-05 2024-09-13T06:42:40.019 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.019 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.019 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:40.019 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384356+0000", 2024-09-13T06:42:40.019 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4265999999999997e-05 2024-09-13T06:42:40.019 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.019 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.019 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:42:40.019 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384370+0000", 2024-09-13T06:42:40.019 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3942e-05 2024-09-13T06:42:40.019 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.019 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.019 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:40.020 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.379199+0000", 2024-09-13T06:42:40.020 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.99482866599999997 2024-09-13T06:42:40.020 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.020 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.020 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:40.020 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.379347+0000", 2024-09-13T06:42:40.020 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00014749199999999999 2024-09-13T06:42:40.020 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.020 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.020 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:40.020 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.379654+0000", 2024-09-13T06:42:40.020 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00030752999999999998 2024-09-13T06:42:40.021 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:40.021 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:40.021 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:40.021 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.021 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.021 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:37896 3.9 3:951cb95b:::rbd_data.1121d8143c6e.0000000000000002:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e56)", 2024-09-13T06:42:40.021 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:06.384412+0000", 2024-09-13T06:42:40.021 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 153.5964237, 2024-09-13T06:42:40.021 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.99777835999999998, 2024-09-13T06:42:40.021 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:40.021 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:40.021 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:40.021 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:40.021 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:40.022 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 37896 2024-09-13T06:42:40.022 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.022 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:40.022 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.022 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:40.022 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384412+0000", 2024-09-13T06:42:40.022 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:40.022 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.022 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.022 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:40.022 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384412+0000", 2024-09-13T06:42:40.022 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:40.022 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.023 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.023 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:40.023 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384410+0000", 2024-09-13T06:42:40.023 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.999999 2024-09-13T06:42:40.023 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.023 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.023 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:40.023 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384418+0000", 2024-09-13T06:42:40.023 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.486e-06 2024-09-13T06:42:40.023 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.023 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.023 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:40.023 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384436+0000", 2024-09-13T06:42:40.023 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7668000000000001e-05 2024-09-13T06:42:40.024 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.024 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.024 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:40.024 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384449+0000", 2024-09-13T06:42:40.024 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3395e-05 2024-09-13T06:42:40.024 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.024 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.024 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:40.024 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384605+0000", 2024-09-13T06:42:40.024 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00015563099999999999 2024-09-13T06:42:40.024 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.024 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.024 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:42:40.024 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384635+0000", 2024-09-13T06:42:40.025 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.0383999999999999e-05 2024-09-13T06:42:40.025 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.025 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.025 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:40.025 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.379730+0000", 2024-09-13T06:42:40.025 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.99509493999999998 2024-09-13T06:42:40.025 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.025 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.025 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:40.025 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.379964+0000", 2024-09-13T06:42:40.025 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00023353499999999999 2024-09-13T06:42:40.025 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.025 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.026 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:40.026 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.382190+0000", 2024-09-13T06:42:40.026 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0022265039999999998 2024-09-13T06:42:40.026 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:40.026 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:40.026 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:40.026 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.026 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.026 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43223 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 393216~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:42:40.026 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558267+0000", 2024-09-13T06:42:40.026 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 138.42256838899999, 2024-09-13T06:42:40.026 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.062813151999999997, 2024-09-13T06:42:40.026 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:40.026 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:40.027 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:40.027 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:40.027 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:40.027 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43223 2024-09-13T06:42:40.027 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.027 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:40.027 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.027 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:40.027 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558267+0000", 2024-09-13T06:42:40.027 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:40.027 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.027 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.027 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:40.028 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558267+0000", 2024-09-13T06:42:40.028 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:40.028 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.028 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.028 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:40.028 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558266+0000", 2024-09-13T06:42:40.028 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:40.028 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.028 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.028 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:40.028 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558270+0000", 2024-09-13T06:42:40.028 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.2389999999999998e-06 2024-09-13T06:42:40.028 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.028 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.029 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:40.029 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558277+0000", 2024-09-13T06:42:40.029 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5680000000000002e-06 2024-09-13T06:42:40.029 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.029 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.029 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:40.029 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558282+0000", 2024-09-13T06:42:40.029 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7060000000000003e-06 2024-09-13T06:42:40.029 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.029 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.029 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:40.029 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.620731+0000", 2024-09-13T06:42:40.029 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.062448661000000003 2024-09-13T06:42:40.030 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.030 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.030 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:40.030 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.620806+0000", 2024-09-13T06:42:40.030 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5862e-05 2024-09-13T06:42:40.030 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.030 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.030 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:40.030 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.621080+0000", 2024-09-13T06:42:40.030 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00027368599999999998 2024-09-13T06:42:40.030 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:40.030 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:40.030 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:40.031 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.031 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.031 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43224 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 407552~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:42:40.031 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558286+0000", 2024-09-13T06:42:40.031 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 138.422549025, 2024-09-13T06:42:40.031 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.063179052999999999, 2024-09-13T06:42:40.031 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:40.031 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:40.031 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:40.031 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:40.031 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:40.031 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43224 2024-09-13T06:42:40.031 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.031 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:40.032 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.032 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:40.032 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558286+0000", 2024-09-13T06:42:40.032 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:40.032 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.032 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.032 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:40.032 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558286+0000", 2024-09-13T06:42:40.032 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:40.032 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.032 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.032 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:40.032 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558286+0000", 2024-09-13T06:42:40.032 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:40.033 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.033 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.033 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:40.033 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558288+0000", 2024-09-13T06:42:40.033 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.227e-06 2024-09-13T06:42:40.033 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.033 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.033 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:40.033 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558292+0000", 2024-09-13T06:42:40.033 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.6289999999999999e-06 2024-09-13T06:42:40.033 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.033 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.033 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:40.034 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558294+0000", 2024-09-13T06:42:40.034 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5409999999999999e-06 2024-09-13T06:42:40.034 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.034 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.034 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:40.034 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.621110+0000", 2024-09-13T06:42:40.034 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.062815776000000004 2024-09-13T06:42:40.034 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.034 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.034 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:40.034 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.621186+0000", 2024-09-13T06:42:40.034 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5570999999999999e-05 2024-09-13T06:42:40.034 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.034 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.035 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:40.035 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.621465+0000", 2024-09-13T06:42:40.035 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00027988200000000001 2024-09-13T06:42:40.035 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:40.035 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:40.035 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:40.035 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.035 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.035 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43225 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 421888~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:42:40.035 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558296+0000", 2024-09-13T06:42:40.035 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 138.42253905800001, 2024-09-13T06:42:40.035 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.063551110999999993, 2024-09-13T06:42:40.035 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:40.036 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:40.036 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:40.036 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:40.036 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:40.036 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43225 2024-09-13T06:42:40.036 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.036 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:40.036 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.036 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:40.036 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558296+0000", 2024-09-13T06:42:40.036 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:40.036 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.036 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.036 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:40.037 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558296+0000", 2024-09-13T06:42:40.037 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:40.037 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.037 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.037 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:40.037 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558296+0000", 2024-09-13T06:42:40.037 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:42:40.037 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.037 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.037 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:40.037 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558305+0000", 2024-09-13T06:42:40.038 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.5290000000000008e-06 2024-09-13T06:42:40.038 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.038 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.038 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:40.038 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558308+0000", 2024-09-13T06:42:40.038 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.5619999999999999e-06 2024-09-13T06:42:40.038 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.038 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.038 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:40.038 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558311+0000", 2024-09-13T06:42:40.038 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.43e-06 2024-09-13T06:42:40.038 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.038 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.039 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:40.039 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.621495+0000", 2024-09-13T06:42:40.039 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.063184289000000005 2024-09-13T06:42:40.039 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.039 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.039 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:40.039 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.621569+0000", 2024-09-13T06:42:40.039 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4250000000000002e-05 2024-09-13T06:42:40.039 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.039 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.039 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:40.039 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.621847+0000", 2024-09-13T06:42:40.039 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00027826400000000002 2024-09-13T06:42:40.039 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:40.040 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:40.040 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:40.040 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.040 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.040 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43226 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 436224~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:42:40.040 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558313+0000", 2024-09-13T06:42:40.040 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 138.42252242199999, 2024-09-13T06:42:40.040 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.063914420999999999, 2024-09-13T06:42:40.040 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:40.040 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:40.040 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:40.040 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:40.040 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:40.041 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43226 2024-09-13T06:42:40.041 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.041 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:40.044 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.044 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:40.044 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558313+0000", 2024-09-13T06:42:40.044 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:40.044 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.044 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.044 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:40.044 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558313+0000", 2024-09-13T06:42:40.045 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:40.045 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.045 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.045 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:40.045 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558313+0000", 2024-09-13T06:42:40.045 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:40.045 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.045 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.045 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:40.045 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558314+0000", 2024-09-13T06:42:40.045 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3740000000000001e-06 2024-09-13T06:42:40.045 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.045 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.046 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:40.046 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558317+0000", 2024-09-13T06:42:40.046 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9730000000000002e-06 2024-09-13T06:42:40.046 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.046 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.046 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:40.046 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558319+0000", 2024-09-13T06:42:40.046 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4059999999999999e-06 2024-09-13T06:42:40.046 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.046 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.046 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:40.046 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.621877+0000", 2024-09-13T06:42:40.046 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.063557408999999995 2024-09-13T06:42:40.047 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.047 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.047 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:40.047 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.621951+0000", 2024-09-13T06:42:40.047 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4487999999999996e-05 2024-09-13T06:42:40.047 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.047 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.047 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:40.047 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.622227+0000", 2024-09-13T06:42:40.047 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000276011 2024-09-13T06:42:40.047 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:40.047 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:40.048 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:40.048 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.048 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.048 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43227 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 450560~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:42:40.048 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558322+0000", 2024-09-13T06:42:40.048 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 138.42251384100001, 2024-09-13T06:42:40.048 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.064285348000000006, 2024-09-13T06:42:40.048 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:40.048 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:40.048 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:40.048 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:40.048 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:40.048 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43227 2024-09-13T06:42:40.049 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.049 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:40.049 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.049 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:40.049 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558322+0000", 2024-09-13T06:42:40.049 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:40.049 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.049 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.049 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:40.049 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558322+0000", 2024-09-13T06:42:40.049 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:40.049 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.049 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.050 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:40.050 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558321+0000", 2024-09-13T06:42:40.050 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:42:40.050 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.050 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.050 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:40.050 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558323+0000", 2024-09-13T06:42:40.050 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.576e-06 2024-09-13T06:42:40.050 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.050 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.050 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:40.050 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558328+0000", 2024-09-13T06:42:40.050 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0719999999999999e-06 2024-09-13T06:42:40.051 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.051 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.051 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:40.051 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558332+0000", 2024-09-13T06:42:40.051 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.8130000000000002e-06 2024-09-13T06:42:40.051 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.051 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.051 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:40.051 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.622255+0000", 2024-09-13T06:42:40.051 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.063923195000000002 2024-09-13T06:42:40.051 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.051 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.051 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:40.052 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.622330+0000", 2024-09-13T06:42:40.052 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5383000000000007e-05 2024-09-13T06:42:40.052 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.052 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.052 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:40.052 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.622607+0000", 2024-09-13T06:42:40.052 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00027651999999999999 2024-09-13T06:42:40.052 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:40.052 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:40.052 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:40.052 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.052 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.052 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43228 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 464896~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:42:40.053 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558335+0000", 2024-09-13T06:42:40.053 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 138.42249993199999, 2024-09-13T06:42:40.053 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.064652253000000007, 2024-09-13T06:42:40.053 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:40.053 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:40.053 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:40.053 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:40.053 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:40.053 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43228 2024-09-13T06:42:40.053 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.053 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:40.053 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.053 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:40.054 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558335+0000", 2024-09-13T06:42:40.054 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:40.054 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.054 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.054 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:40.054 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558335+0000", 2024-09-13T06:42:40.054 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:40.054 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.054 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.054 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:40.054 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558335+0000", 2024-09-13T06:42:40.054 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:40.054 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.054 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.054 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:40.055 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558337+0000", 2024-09-13T06:42:40.055 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1380000000000001e-06 2024-09-13T06:42:40.055 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.055 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.055 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:40.055 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558343+0000", 2024-09-13T06:42:40.055 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.5140000000000001e-06 2024-09-13T06:42:40.055 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.055 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.055 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:40.055 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558348+0000", 2024-09-13T06:42:40.055 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9640000000000002e-06 2024-09-13T06:42:40.055 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.056 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.056 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:40.056 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.622636+0000", 2024-09-13T06:42:40.056 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.064288260999999999 2024-09-13T06:42:40.056 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.056 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.056 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:40.056 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.622715+0000", 2024-09-13T06:42:40.056 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.9351000000000006e-05 2024-09-13T06:42:40.056 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.056 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.056 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:40.056 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.622988+0000", 2024-09-13T06:42:40.057 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00027242599999999998 2024-09-13T06:42:40.057 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:40.057 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:40.057 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:40.057 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.057 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.057 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43229 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 479232~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:42:40.057 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558352+0000", 2024-09-13T06:42:40.057 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 138.42248351699999, 2024-09-13T06:42:40.057 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.065018024999999993, 2024-09-13T06:42:40.057 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:40.057 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:40.057 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:40.057 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:40.058 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:40.058 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43229 2024-09-13T06:42:40.058 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.058 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:40.058 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.058 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:40.058 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558352+0000", 2024-09-13T06:42:40.058 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:40.058 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.058 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.058 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:40.058 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558352+0000", 2024-09-13T06:42:40.058 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:40.059 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.059 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.059 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:40.059 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558352+0000", 2024-09-13T06:42:40.059 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:40.059 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.059 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.059 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:40.059 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558354+0000", 2024-09-13T06:42:40.059 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4930000000000001e-06 2024-09-13T06:42:40.059 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.059 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.059 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:40.059 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558360+0000", 2024-09-13T06:42:40.060 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.263e-06 2024-09-13T06:42:40.060 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.060 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.060 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:40.060 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558369+0000", 2024-09-13T06:42:40.060 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.0829999999999993e-06 2024-09-13T06:42:40.060 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.060 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.060 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:40.060 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.623017+0000", 2024-09-13T06:42:40.060 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.064647799000000006 2024-09-13T06:42:40.060 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.060 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.061 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:40.061 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.623090+0000", 2024-09-13T06:42:40.061 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3071000000000006e-05 2024-09-13T06:42:40.061 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.061 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.061 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:40.061 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.623370+0000", 2024-09-13T06:42:40.061 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000279661 2024-09-13T06:42:40.061 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:40.061 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:40.061 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:40.061 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.062 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.062 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43230 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 493568~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:42:40.062 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558374+0000", 2024-09-13T06:42:40.062 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 138.42246122399999, 2024-09-13T06:42:40.062 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.065410435000000003, 2024-09-13T06:42:40.062 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:40.062 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:40.062 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:40.062 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:40.062 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:40.062 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43230 2024-09-13T06:42:40.062 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.062 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:40.063 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.063 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:40.063 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558374+0000", 2024-09-13T06:42:40.063 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:40.063 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.063 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.063 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:40.063 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558374+0000", 2024-09-13T06:42:40.063 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:40.063 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.063 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.063 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:40.063 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558374+0000", 2024-09-13T06:42:40.063 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:40.064 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.064 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.064 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:40.064 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558376+0000", 2024-09-13T06:42:40.064 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4430000000000002e-06 2024-09-13T06:42:40.064 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.064 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.064 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:40.064 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558382+0000", 2024-09-13T06:42:40.065 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3029999999999996e-06 2024-09-13T06:42:40.065 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.065 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.065 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:40.065 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558387+0000", 2024-09-13T06:42:40.065 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.1699999999999999e-06 2024-09-13T06:42:40.065 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.065 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.065 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:40.065 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.623400+0000", 2024-09-13T06:42:40.065 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.065013244999999997 2024-09-13T06:42:40.065 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.066 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.066 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:40.066 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.623474+0000", 2024-09-13T06:42:40.066 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3889999999999999e-05 2024-09-13T06:42:40.066 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.066 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.066 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:40.066 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.623785+0000", 2024-09-13T06:42:40.066 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00031080099999999998 2024-09-13T06:42:40.066 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:40.066 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:40.066 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:40.066 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.066 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.067 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43231 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 507904~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:42:40.067 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558391+0000", 2024-09-13T06:42:40.067 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 138.422444539, 2024-09-13T06:42:40.067 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.065788597000000004, 2024-09-13T06:42:40.067 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:40.067 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:40.067 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:40.067 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:40.067 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:40.067 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43231 2024-09-13T06:42:40.067 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.067 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:40.067 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.067 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:40.067 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558391+0000", 2024-09-13T06:42:40.068 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:40.068 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.068 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.068 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:40.068 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558391+0000", 2024-09-13T06:42:40.068 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:40.068 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.068 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.068 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:40.068 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558390+0000", 2024-09-13T06:42:40.068 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:40.068 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.068 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.069 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:40.069 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558393+0000", 2024-09-13T06:42:40.069 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2570000000000002e-06 2024-09-13T06:42:40.069 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.069 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.069 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:40.069 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558399+0000", 2024-09-13T06:42:40.069 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0419999999999999e-06 2024-09-13T06:42:40.069 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.069 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.069 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:40.069 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558403+0000", 2024-09-13T06:42:40.069 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6249999999999998e-06 2024-09-13T06:42:40.069 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.070 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.070 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:40.070 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.623811+0000", 2024-09-13T06:42:40.070 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.065407549999999995 2024-09-13T06:42:40.070 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.070 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.070 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:40.070 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.623877+0000", 2024-09-13T06:42:40.070 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.5902999999999996e-05 2024-09-13T06:42:40.070 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.070 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.070 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:40.070 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.624179+0000", 2024-09-13T06:42:40.070 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00030259999999999998 2024-09-13T06:42:40.071 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:40.071 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:40.071 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:40.071 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.071 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.071 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43232 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 522240~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:42:40.071 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558422+0000", 2024-09-13T06:42:40.071 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 138.42241376199999, 2024-09-13T06:42:40.071 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.066176061999999994, 2024-09-13T06:42:40.071 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:40.071 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:40.071 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:40.071 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:40.071 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:40.072 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43232 2024-09-13T06:42:40.072 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.072 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:40.072 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.072 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:40.072 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558422+0000", 2024-09-13T06:42:40.072 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:40.072 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.072 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.072 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:40.072 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558422+0000", 2024-09-13T06:42:40.072 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:40.072 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.072 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.073 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:40.073 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558421+0000", 2024-09-13T06:42:40.073 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:40.073 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.073 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.073 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:40.073 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558428+0000", 2024-09-13T06:42:40.073 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.1690000000000003e-06 2024-09-13T06:42:40.073 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.073 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.073 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:40.073 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558434+0000", 2024-09-13T06:42:40.073 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9309999999999996e-06 2024-09-13T06:42:40.074 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.074 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.074 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:40.074 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558447+0000", 2024-09-13T06:42:40.074 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.271e-05 2024-09-13T06:42:40.074 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.074 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.074 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:40.074 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.624209+0000", 2024-09-13T06:42:40.074 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.065762102000000003 2024-09-13T06:42:40.074 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.074 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.074 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:40.075 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.624282+0000", 2024-09-13T06:42:40.075 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.2889e-05 2024-09-13T06:42:40.075 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.075 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.075 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:40.075 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.624598+0000", 2024-09-13T06:42:40.075 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00031591399999999998 2024-09-13T06:42:40.075 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:40.075 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:40.075 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:40.075 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.075 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.075 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43486 3.f 3:f7da9c8f:::rbd_data.1121f5f2e1c0.000000000000000b:1f [read 260096~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:42:40.075 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.569088+0000", 2024-09-13T06:42:40.076 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 138.41174703900001, 2024-09-13T06:42:40.076 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.062579223000000003, 2024-09-13T06:42:40.076 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:40.076 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:40.076 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:40.076 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:40.076 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:40.076 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43486 2024-09-13T06:42:40.076 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.076 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:40.076 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.076 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:40.076 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.569088+0000", 2024-09-13T06:42:40.077 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:40.077 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.077 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.077 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:40.077 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.569088+0000", 2024-09-13T06:42:40.077 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:40.077 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.077 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.077 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:40.077 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.569088+0000", 2024-09-13T06:42:40.077 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:40.077 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.077 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.078 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:40.078 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.569091+0000", 2024-09-13T06:42:40.078 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9629999999999998e-06 2024-09-13T06:42:40.078 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.078 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.078 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:40.078 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.569097+0000", 2024-09-13T06:42:40.078 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.4160000000000001e-06 2024-09-13T06:42:40.078 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.078 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.078 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:40.078 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.569102+0000", 2024-09-13T06:42:40.078 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6659999999999999e-06 2024-09-13T06:42:40.079 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.079 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.079 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:40.079 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.631346+0000", 2024-09-13T06:42:40.079 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.062243896 2024-09-13T06:42:40.079 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.079 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.079 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:40.079 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.631413+0000", 2024-09-13T06:42:40.079 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.7638000000000005e-05 2024-09-13T06:42:40.079 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.079 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.079 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:40.079 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.631668+0000", 2024-09-13T06:42:40.079 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0002541 2024-09-13T06:42:40.080 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:40.080 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:40.080 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:40.080 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.080 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.080 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:170125 3.9 3:94e4bf8d:::rbd_object_map.1121fa0cc8a3.000000000000006d:head [writefull 0~37] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e190)", 2024-09-13T06:42:40.080 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:42:30.601501+0000", 2024-09-13T06:42:40.080 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 9.3793348279999993, 2024-09-13T06:42:40.080 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.80498820000000004, 2024-09-13T06:42:40.080 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:40.080 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:42:40.080 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:40.080 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:40.080 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:40.081 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 170125 2024-09-13T06:42:40.081 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.081 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:40.081 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.081 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:40.081 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:30.601501+0000", 2024-09-13T06:42:40.081 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:40.081 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.081 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.081 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:40.081 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:30.601501+0000", 2024-09-13T06:42:40.081 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:40.081 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.081 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.082 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:40.082 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:30.601499+0000", 2024-09-13T06:42:40.082 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999986 2024-09-13T06:42:40.082 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.082 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.082 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:40.082 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:30.601506+0000", 2024-09-13T06:42:40.082 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.9940000000000003e-06 2024-09-13T06:42:40.082 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.082 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.082 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:40.082 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:30.601519+0000", 2024-09-13T06:42:40.082 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2875e-05 2024-09-13T06:42:40.083 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.083 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.083 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:40.083 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:30.601525+0000", 2024-09-13T06:42:40.083 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8549999999999998e-06 2024-09-13T06:42:40.083 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.083 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.083 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:40.083 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:30.601560+0000", 2024-09-13T06:42:40.083 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.5271000000000002e-05 2024-09-13T06:42:40.083 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.083 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.083 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:42:40.083 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:30.601566+0000", 2024-09-13T06:42:40.084 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3090000000000001e-06 2024-09-13T06:42:40.084 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.084 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.084 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:40.084 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:31.403017+0000", 2024-09-13T06:42:40.084 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.80145064200000005 2024-09-13T06:42:40.084 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.084 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.084 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:40.084 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:31.403252+0000", 2024-09-13T06:42:40.084 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000234718 2024-09-13T06:42:40.084 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.084 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.084 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 7", 2024-09-13T06:42:40.085 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:31.403521+0000", 2024-09-13T06:42:40.085 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00026917 2024-09-13T06:42:40.085 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.085 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.085 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-09-13T06:42:40.085 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:31.404918+0000", 2024-09-13T06:42:40.085 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.001397017 2024-09-13T06:42:40.085 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.085 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.085 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:42:40.085 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:31.406176+0000", 2024-09-13T06:42:40.085 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.001257998 2024-09-13T06:42:40.085 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.086 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.086 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:42:40.086 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:31.406334+0000", 2024-09-13T06:42:40.086 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00015819099999999999 2024-09-13T06:42:40.086 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.086 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.086 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:40.086 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:31.406489+0000", 2024-09-13T06:42:40.086 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00015476699999999999 2024-09-13T06:42:40.086 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:40.086 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:40.086 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:40.086 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:40.086 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:40.087 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:42:40.088 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-13T06:42:40.089 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:42:40.084+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:42:40.189 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:42:40.184+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:42:40.256 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:42:40.256 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-13T06:42:40.256 INFO:teuthology.orchestra.run.smithi081.stdout: "num_ops": 0 2024-09-13T06:42:40.256 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:42:40.270 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-13T06:42:40.314 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:42:40.312+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:42:40.391 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:42:40.388+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:42:40.435 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:42:40.435 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-13T06:42:40.435 INFO:teuthology.orchestra.run.smithi081.stdout: "complaint_time": 30, 2024-09-13T06:42:40.436 INFO:teuthology.orchestra.run.smithi081.stdout: "num_blocked_ops": 0 2024-09-13T06:42:40.436 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:42:40.449 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-13T06:42:40.493 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:42:40.493+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:42:40.593 INFO:tasks.ceph.osd.6.smithi139.stderr:2024-09-13T06:42:40.589+0000 7fcd02c5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26385) UID: 0 2024-09-13T06:42:40.613 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:42:40.613 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 20, 2024-09-13T06:42:40.613 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 600, 2024-09-13T06:42:40.613 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [ 2024-09-13T06:42:40.614 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.614 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:2226 3.15 3:af026987:::rbd_data.112173e2f1b7.0000000000000017:head [sparse-read 0~4194304] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-13T06:42:40.614 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:37.606562+0000", 2024-09-13T06:42:40.614 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 183.00611097500001, 2024-09-13T06:42:40.614 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.83322091700000001, 2024-09-13T06:42:40.614 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:40.614 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:42:40.614 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:40.614 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:40.614 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:40.614 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 2226 2024-09-13T06:42:40.614 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.614 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:40.614 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.615 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:40.615 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606562+0000", 2024-09-13T06:42:40.615 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:40.615 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.615 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.615 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:40.615 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606562+0000", 2024-09-13T06:42:40.615 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:40.615 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.615 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.615 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:40.615 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606561+0000", 2024-09-13T06:42:40.615 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:40.615 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.616 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.616 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:40.616 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606565+0000", 2024-09-13T06:42:40.616 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.4379999999999999e-06 2024-09-13T06:42:40.616 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.616 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.616 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:40.616 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606569+0000", 2024-09-13T06:42:40.616 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.425e-06 2024-09-13T06:42:40.616 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.616 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.616 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:40.616 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606572+0000", 2024-09-13T06:42:40.616 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.05e-06 2024-09-13T06:42:40.617 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.617 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.617 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:40.617 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606621+0000", 2024-09-13T06:42:40.617 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.8723000000000001e-05 2024-09-13T06:42:40.617 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.617 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.617 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:42:40.617 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606630+0000", 2024-09-13T06:42:40.617 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.8040000000000007e-06 2024-09-13T06:42:40.617 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.617 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.617 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:40.617 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.439648+0000", 2024-09-13T06:42:40.617 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.83301824800000002 2024-09-13T06:42:40.618 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.618 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.618 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:40.618 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.439782+0000", 2024-09-13T06:42:40.618 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00013466699999999999 2024-09-13T06:42:40.618 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:40.618 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:40.618 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:40.618 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.618 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.618 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25661 3.8 3:1180686c:::rbd_data.1121f2c5ee81.0000000000000009:13 [read 397312~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:42:40.618 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.436956+0000", 2024-09-13T06:42:40.618 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 164.17571644099999, 2024-09-13T06:42:40.618 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089036758999999993, 2024-09-13T06:42:40.618 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:40.619 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:40.619 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:40.619 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:40.619 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:40.619 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25661 2024-09-13T06:42:40.619 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.619 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:40.619 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.619 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:40.619 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436956+0000", 2024-09-13T06:42:40.619 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:40.619 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.619 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.619 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:40.619 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436956+0000", 2024-09-13T06:42:40.619 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:40.620 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.620 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.620 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:40.620 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436956+0000", 2024-09-13T06:42:40.620 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:40.620 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.620 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.620 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:40.620 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436958+0000", 2024-09-13T06:42:40.620 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1770000000000001e-06 2024-09-13T06:42:40.620 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.620 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.620 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:40.620 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436963+0000", 2024-09-13T06:42:40.621 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.6489999999999996e-06 2024-09-13T06:42:40.621 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.621 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.621 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:40.621 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436975+0000", 2024-09-13T06:42:40.621 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1783999999999999e-05 2024-09-13T06:42:40.621 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.621 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.621 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:40.621 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.525671+0000", 2024-09-13T06:42:40.621 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.088696292999999995 2024-09-13T06:42:40.621 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.621 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.621 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:40.622 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.525749+0000", 2024-09-13T06:42:40.622 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.7589000000000005e-05 2024-09-13T06:42:40.622 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.622 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.622 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:40.622 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.525993+0000", 2024-09-13T06:42:40.622 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00024381000000000001 2024-09-13T06:42:40.622 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:40.622 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:40.622 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:40.622 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.622 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.622 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25662 3.8 3:1180686c:::rbd_data.1121f2c5ee81.0000000000000009:13 [read 421888~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:42:40.622 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.436980+0000", 2024-09-13T06:42:40.622 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 164.175692129, 2024-09-13T06:42:40.623 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089367577000000004, 2024-09-13T06:42:40.623 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:40.623 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:40.623 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:40.623 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:40.623 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:40.623 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25662 2024-09-13T06:42:40.623 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.623 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:40.623 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.623 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:40.623 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436980+0000", 2024-09-13T06:42:40.624 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:40.624 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.624 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.624 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:40.624 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436980+0000", 2024-09-13T06:42:40.624 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:40.624 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.624 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.624 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:40.624 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436980+0000", 2024-09-13T06:42:40.624 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:40.624 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.624 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.624 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:40.625 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436982+0000", 2024-09-13T06:42:40.625 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3989999999999998e-06 2024-09-13T06:42:40.625 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.625 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.625 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:40.625 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436988+0000", 2024-09-13T06:42:40.625 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0039999999999996e-06 2024-09-13T06:42:40.625 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.625 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.625 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:40.625 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436993+0000", 2024-09-13T06:42:40.625 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6090000000000003e-06 2024-09-13T06:42:40.626 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.626 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.626 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:40.626 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.526035+0000", 2024-09-13T06:42:40.626 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089042248000000004 2024-09-13T06:42:40.626 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.626 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.626 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:40.626 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.526111+0000", 2024-09-13T06:42:40.626 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5643999999999996e-05 2024-09-13T06:42:40.626 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.626 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.626 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:40.626 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.526348+0000", 2024-09-13T06:42:40.627 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00023705800000000001 2024-09-13T06:42:40.627 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:40.627 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:40.627 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:40.627 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.627 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.627 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25663 3.8 3:1180686c:::rbd_data.1121f2c5ee81.0000000000000009:13 [read 466944~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:42:40.627 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.436998+0000", 2024-09-13T06:42:40.627 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 164.17567448200001, 2024-09-13T06:42:40.627 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089730867000000006, 2024-09-13T06:42:40.627 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:40.627 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:40.627 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:40.627 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:40.627 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:40.628 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25663 2024-09-13T06:42:40.628 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.628 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:40.628 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.628 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:40.628 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436998+0000", 2024-09-13T06:42:40.628 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:40.628 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.628 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.628 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:40.628 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436998+0000", 2024-09-13T06:42:40.628 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:40.628 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.628 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.629 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:40.629 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436998+0000", 2024-09-13T06:42:40.629 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:40.629 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.629 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.629 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:40.629 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437000+0000", 2024-09-13T06:42:40.629 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0940000000000002e-06 2024-09-13T06:42:40.629 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.629 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.629 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:40.629 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437005+0000", 2024-09-13T06:42:40.629 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.604e-06 2024-09-13T06:42:40.629 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.629 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.630 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:40.630 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437032+0000", 2024-09-13T06:42:40.630 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6407e-05 2024-09-13T06:42:40.630 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.630 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.630 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:40.630 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.526363+0000", 2024-09-13T06:42:40.630 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089331456000000004 2024-09-13T06:42:40.630 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.630 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.630 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:40.630 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.526404+0000", 2024-09-13T06:42:40.630 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.0887999999999999e-05 2024-09-13T06:42:40.630 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.630 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.631 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:40.631 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.526729+0000", 2024-09-13T06:42:40.631 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00032486 2024-09-13T06:42:40.631 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:40.631 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:40.631 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:40.631 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.631 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.631 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25664 3.8 3:1180686c:::rbd_data.1121f2c5ee81.0000000000000009:13 [read 491520~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:42:40.631 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.437040+0000", 2024-09-13T06:42:40.631 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 164.17563256700001, 2024-09-13T06:42:40.631 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.090016650000000004, 2024-09-13T06:42:40.631 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:40.631 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:40.631 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:40.631 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:40.632 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:40.632 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25664 2024-09-13T06:42:40.632 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.632 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:40.632 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.632 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:40.632 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437040+0000", 2024-09-13T06:42:40.632 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:40.632 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.632 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.632 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:40.632 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437040+0000", 2024-09-13T06:42:40.632 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:40.632 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.633 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.633 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:40.633 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437039+0000", 2024-09-13T06:42:40.633 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:40.633 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.633 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.633 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:40.633 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437047+0000", 2024-09-13T06:42:40.633 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4839999999999998e-06 2024-09-13T06:42:40.633 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.633 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.633 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:40.634 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437054+0000", 2024-09-13T06:42:40.634 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.8299999999999998e-06 2024-09-13T06:42:40.634 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.634 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.634 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:40.634 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437060+0000", 2024-09-13T06:42:40.634 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.1510000000000001e-06 2024-09-13T06:42:40.634 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.634 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.634 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:40.634 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.526772+0000", 2024-09-13T06:42:40.634 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089711737999999999 2024-09-13T06:42:40.634 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.634 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.634 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:40.635 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.526848+0000", 2024-09-13T06:42:40.635 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5870000000000004e-05 2024-09-13T06:42:40.635 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.635 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.635 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:40.635 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.527057+0000", 2024-09-13T06:42:40.635 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000209106 2024-09-13T06:42:40.635 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:40.635 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:40.635 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:40.635 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.635 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.635 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25740 3.18 3:1c662b96:::rbd_data.1121f2c5ee81.0000000000000010:13 [read 200704~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:42:40.635 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443352+0000", 2024-09-13T06:42:40.636 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 164.169320892, 2024-09-13T06:42:40.636 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089068222000000002, 2024-09-13T06:42:40.636 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:40.636 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:40.636 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:40.636 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:40.636 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:40.636 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25740 2024-09-13T06:42:40.636 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.636 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:40.636 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.636 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:40.636 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443352+0000", 2024-09-13T06:42:40.637 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:40.637 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.637 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.637 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:40.637 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443352+0000", 2024-09-13T06:42:40.637 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:40.637 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.637 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.637 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:40.637 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443351+0000", 2024-09-13T06:42:40.637 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:40.637 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.637 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.637 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:40.638 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443354+0000", 2024-09-13T06:42:40.638 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.841e-06 2024-09-13T06:42:40.638 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.638 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.638 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:40.638 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443361+0000", 2024-09-13T06:42:40.638 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.0010000000000004e-06 2024-09-13T06:42:40.638 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.638 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.638 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:40.638 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443366+0000", 2024-09-13T06:42:40.638 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7119999999999999e-06 2024-09-13T06:42:40.638 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.638 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.639 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:40.639 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532117+0000", 2024-09-13T06:42:40.639 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.088751327000000005 2024-09-13T06:42:40.639 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.639 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.639 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:40.639 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532193+0000", 2024-09-13T06:42:40.639 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5839000000000004e-05 2024-09-13T06:42:40.639 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.639 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.639 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:40.639 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532420+0000", 2024-09-13T06:42:40.639 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00022691000000000001 2024-09-13T06:42:40.639 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:40.639 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:40.640 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:40.640 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.640 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.640 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25741 3.18 3:1c662b96:::rbd_data.1121f2c5ee81.0000000000000010:13 [read 225280~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:42:40.640 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443378+0000", 2024-09-13T06:42:40.640 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 164.16929412499999, 2024-09-13T06:42:40.640 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089324107, 2024-09-13T06:42:40.640 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:40.640 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:40.640 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:40.640 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:40.640 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:40.640 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25741 2024-09-13T06:42:40.640 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.641 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:40.641 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.641 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:40.641 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443378+0000", 2024-09-13T06:42:40.641 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:40.641 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.641 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.641 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:40.641 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443378+0000", 2024-09-13T06:42:40.641 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:40.641 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.641 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.641 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:40.641 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443378+0000", 2024-09-13T06:42:40.642 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:40.642 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.642 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.642 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:40.642 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443380+0000", 2024-09-13T06:42:40.642 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3549999999999999e-06 2024-09-13T06:42:40.642 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.642 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.642 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:40.642 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443388+0000", 2024-09-13T06:42:40.642 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.7449999999999995e-06 2024-09-13T06:42:40.642 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.642 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.642 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:40.643 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443393+0000", 2024-09-13T06:42:40.643 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.4e-06 2024-09-13T06:42:40.643 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.643 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.643 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:40.643 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532454+0000", 2024-09-13T06:42:40.643 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089060941000000005 2024-09-13T06:42:40.643 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.643 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.643 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:40.643 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532512+0000", 2024-09-13T06:42:40.643 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7763000000000002e-05 2024-09-13T06:42:40.643 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.643 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.644 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:40.644 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532703+0000", 2024-09-13T06:42:40.644 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000190328 2024-09-13T06:42:40.644 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:40.644 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:40.644 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:40.644 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.644 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.644 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25742 3.18 3:1c662b96:::rbd_data.1121f2c5ee81.0000000000000010:13 [read 270336~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:42:40.644 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443398+0000", 2024-09-13T06:42:40.644 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 164.16927441300001, 2024-09-13T06:42:40.644 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089621836999999996, 2024-09-13T06:42:40.644 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:40.645 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:40.645 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:40.645 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:40.645 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:40.645 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25742 2024-09-13T06:42:40.645 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.645 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:40.645 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.645 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:40.645 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443398+0000", 2024-09-13T06:42:40.645 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:40.645 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.645 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.646 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:40.646 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443398+0000", 2024-09-13T06:42:40.646 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:40.646 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.646 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.646 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:40.646 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443398+0000", 2024-09-13T06:42:40.646 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:40.646 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.646 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.646 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:40.646 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443400+0000", 2024-09-13T06:42:40.646 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1849999999999998e-06 2024-09-13T06:42:40.647 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.647 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.647 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:40.647 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443407+0000", 2024-09-13T06:42:40.647 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3669999999999999e-06 2024-09-13T06:42:40.647 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.647 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.647 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:40.647 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443420+0000", 2024-09-13T06:42:40.647 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2645e-05 2024-09-13T06:42:40.647 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.647 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.647 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:40.647 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532742+0000", 2024-09-13T06:42:40.647 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089322200000000004 2024-09-13T06:42:40.648 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.648 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.648 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:40.648 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532818+0000", 2024-09-13T06:42:40.648 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.6019000000000005e-05 2024-09-13T06:42:40.648 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.648 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.648 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:40.648 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533020+0000", 2024-09-13T06:42:40.648 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000201721 2024-09-13T06:42:40.648 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:40.648 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:40.649 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:40.649 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.649 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.649 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25743 3.18 3:1c662b96:::rbd_data.1121f2c5ee81.0000000000000010:13 [read 294912~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:42:40.649 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443425+0000", 2024-09-13T06:42:40.649 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 164.16924740499999, 2024-09-13T06:42:40.649 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089864075000000002, 2024-09-13T06:42:40.649 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:40.649 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:40.649 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:40.649 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:40.649 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:40.649 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25743 2024-09-13T06:42:40.649 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.650 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:40.650 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.650 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:40.650 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443425+0000", 2024-09-13T06:42:40.650 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:40.650 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.650 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.650 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:40.650 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443425+0000", 2024-09-13T06:42:40.650 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:40.650 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.650 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.650 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:40.650 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443425+0000", 2024-09-13T06:42:40.651 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:40.651 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.651 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.651 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:40.651 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443432+0000", 2024-09-13T06:42:40.651 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3420000000000002e-06 2024-09-13T06:42:40.651 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.651 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.651 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:40.651 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443440+0000", 2024-09-13T06:42:40.651 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5689999999999999e-06 2024-09-13T06:42:40.651 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.651 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.652 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:40.652 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443445+0000", 2024-09-13T06:42:40.652 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9590000000000003e-06 2024-09-13T06:42:40.652 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.652 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.652 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:40.652 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533063+0000", 2024-09-13T06:42:40.652 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089617988999999995 2024-09-13T06:42:40.652 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.652 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.652 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:40.652 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533122+0000", 2024-09-13T06:42:40.652 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9052999999999999e-05 2024-09-13T06:42:40.653 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.653 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.653 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:40.653 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533289+0000", 2024-09-13T06:42:40.653 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00016752800000000001 2024-09-13T06:42:40.653 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:40.653 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:40.653 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:40.653 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.653 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.653 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25744 3.18 3.69d46638 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:42:40.653 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443449+0000", 2024-09-13T06:42:40.653 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 164.16922325799999, 2024-09-13T06:42:40.653 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089869148999999995, 2024-09-13T06:42:40.654 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:40.654 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:42:40.654 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:40.654 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:40.654 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:40.654 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25744 2024-09-13T06:42:40.654 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.654 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:40.654 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.654 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:40.654 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443449+0000", 2024-09-13T06:42:40.654 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:40.654 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.655 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.655 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:40.655 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443449+0000", 2024-09-13T06:42:40.655 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:40.655 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.655 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.655 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:40.655 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443449+0000", 2024-09-13T06:42:40.655 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:40.655 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.655 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.655 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:40.655 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443451+0000", 2024-09-13T06:42:40.655 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.244e-06 2024-09-13T06:42:40.656 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.656 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.656 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:40.656 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443457+0000", 2024-09-13T06:42:40.656 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.66e-06 2024-09-13T06:42:40.656 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.656 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.656 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:40.656 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443461+0000", 2024-09-13T06:42:40.656 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5449999999999997e-06 2024-09-13T06:42:40.656 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.656 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.656 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:40.656 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533311+0000", 2024-09-13T06:42:40.657 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089849729000000003 2024-09-13T06:42:40.657 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.657 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.657 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:40.657 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533318+0000", 2024-09-13T06:42:40.657 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.328e-06 2024-09-13T06:42:40.657 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:40.657 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:40.657 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:40.657 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.657 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.657 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25745 3.18 3.69d46638 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:42:40.657 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443466+0000", 2024-09-13T06:42:40.658 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 164.16920619999999, 2024-09-13T06:42:40.658 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089886743000000005, 2024-09-13T06:42:40.658 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:40.658 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:42:40.658 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:40.658 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:40.658 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:40.658 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25745 2024-09-13T06:42:40.658 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.658 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:40.658 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.658 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:40.658 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443466+0000", 2024-09-13T06:42:40.658 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:40.659 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.659 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.659 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:40.659 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443466+0000", 2024-09-13T06:42:40.659 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:40.659 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.659 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.659 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:40.659 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443466+0000", 2024-09-13T06:42:40.659 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:40.659 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.659 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.659 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:40.659 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443474+0000", 2024-09-13T06:42:40.660 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.1289999999999996e-06 2024-09-13T06:42:40.660 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.660 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.660 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:40.660 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443484+0000", 2024-09-13T06:42:40.660 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0654e-05 2024-09-13T06:42:40.660 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.660 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.660 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:40.660 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443490+0000", 2024-09-13T06:42:40.660 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8030000000000002e-06 2024-09-13T06:42:40.660 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.660 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.660 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:40.661 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533348+0000", 2024-09-13T06:42:40.661 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089857267000000005 2024-09-13T06:42:40.661 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.661 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.661 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:40.661 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533353+0000", 2024-09-13T06:42:40.661 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.5520000000000004e-06 2024-09-13T06:42:40.661 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:40.661 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:40.661 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:40.661 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.661 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.661 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25746 3.18 3.69d46638 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:42:40.661 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443495+0000", 2024-09-13T06:42:40.662 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 164.16917708700001, 2024-09-13T06:42:40.662 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089903725000000004, 2024-09-13T06:42:40.662 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:40.662 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:42:40.662 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:40.662 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:40.662 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:40.662 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25746 2024-09-13T06:42:40.662 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.662 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:40.662 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.663 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:40.663 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443495+0000", 2024-09-13T06:42:40.663 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:40.664 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.664 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.664 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:40.664 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443495+0000", 2024-09-13T06:42:40.664 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:40.664 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.664 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.664 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:40.664 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443495+0000", 2024-09-13T06:42:40.664 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:40.664 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.664 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.664 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:40.664 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443498+0000", 2024-09-13T06:42:40.665 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.7690000000000001e-06 2024-09-13T06:42:40.665 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.665 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.665 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:40.665 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443504+0000", 2024-09-13T06:42:40.665 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9710000000000001e-06 2024-09-13T06:42:40.665 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.665 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.665 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:40.665 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443508+0000", 2024-09-13T06:42:40.665 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4159999999999997e-06 2024-09-13T06:42:40.665 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.665 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.666 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:40.666 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533391+0000", 2024-09-13T06:42:40.666 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089882607000000003 2024-09-13T06:42:40.666 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.666 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.666 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:40.666 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533399+0000", 2024-09-13T06:42:40.666 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.4349999999999997e-06 2024-09-13T06:42:40.666 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:40.666 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:40.666 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:40.666 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.666 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.666 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25747 3.8 3.63996268 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:42:40.667 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443512+0000", 2024-09-13T06:42:40.667 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 164.16916035599999, 2024-09-13T06:42:40.667 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089880075000000004, 2024-09-13T06:42:40.667 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:40.667 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:42:40.667 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:40.667 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:40.667 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:40.667 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25747 2024-09-13T06:42:40.667 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.667 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:40.667 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.667 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:40.667 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443512+0000", 2024-09-13T06:42:40.667 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:40.668 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.668 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.668 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:40.668 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443512+0000", 2024-09-13T06:42:40.668 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:40.668 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.668 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.668 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:40.668 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443512+0000", 2024-09-13T06:42:40.668 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:40.668 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.668 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.668 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:40.668 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443514+0000", 2024-09-13T06:42:40.669 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0980000000000001e-06 2024-09-13T06:42:40.669 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.669 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.669 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:40.669 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443520+0000", 2024-09-13T06:42:40.669 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7069999999999997e-06 2024-09-13T06:42:40.669 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.669 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.669 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:40.669 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443524+0000", 2024-09-13T06:42:40.669 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5390000000000001e-06 2024-09-13T06:42:40.669 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.669 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.670 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:40.670 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533384+0000", 2024-09-13T06:42:40.670 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089859684999999995 2024-09-13T06:42:40.670 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.670 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.670 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:40.670 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533392+0000", 2024-09-13T06:42:40.670 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.3440000000000001e-06 2024-09-13T06:42:40.670 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:40.670 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:40.670 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:40.670 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.670 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.670 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25748 3.8 3.63996268 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:42:40.671 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443528+0000", 2024-09-13T06:42:40.671 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 164.16914422900001, 2024-09-13T06:42:40.671 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089890715999999996, 2024-09-13T06:42:40.671 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:40.671 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:42:40.671 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:40.671 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:40.671 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:40.671 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25748 2024-09-13T06:42:40.671 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.671 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:40.671 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.671 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:40.671 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443528+0000", 2024-09-13T06:42:40.671 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:40.672 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.672 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.672 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:40.672 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443528+0000", 2024-09-13T06:42:40.672 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:40.672 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.672 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.672 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:40.672 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443528+0000", 2024-09-13T06:42:40.672 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:40.672 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.672 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.672 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:40.672 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443530+0000", 2024-09-13T06:42:40.673 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0650000000000001e-06 2024-09-13T06:42:40.673 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.673 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.673 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:40.673 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443536+0000", 2024-09-13T06:42:40.673 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7259999999999999e-06 2024-09-13T06:42:40.673 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.673 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.673 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:40.673 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443540+0000", 2024-09-13T06:42:40.673 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5009999999999998e-06 2024-09-13T06:42:40.673 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.673 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.674 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:40.674 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533412+0000", 2024-09-13T06:42:40.674 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089871873000000005 2024-09-13T06:42:40.674 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.674 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.674 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:40.674 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533419+0000", 2024-09-13T06:42:40.674 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.883e-06 2024-09-13T06:42:40.674 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:40.674 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:40.674 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:40.674 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.674 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.674 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25749 3.8 3.63996268 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:42:40.674 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443545+0000", 2024-09-13T06:42:40.675 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 164.16912803299999, 2024-09-13T06:42:40.675 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089897988999999998, 2024-09-13T06:42:40.675 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:40.675 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:42:40.675 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:40.675 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:40.675 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:40.675 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25749 2024-09-13T06:42:40.675 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.675 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:40.675 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.675 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:40.675 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443545+0000", 2024-09-13T06:42:40.675 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:40.676 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.676 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.676 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:40.676 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443545+0000", 2024-09-13T06:42:40.676 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:40.676 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.676 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.676 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:40.676 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443544+0000", 2024-09-13T06:42:40.676 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:40.676 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.676 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.676 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:40.677 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443553+0000", 2024-09-13T06:42:40.677 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.4770000000000003e-06 2024-09-13T06:42:40.677 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.677 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.677 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:40.677 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443564+0000", 2024-09-13T06:42:40.677 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0986e-05 2024-09-13T06:42:40.677 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.677 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.677 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:40.677 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443569+0000", 2024-09-13T06:42:40.677 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2530000000000004e-06 2024-09-13T06:42:40.677 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.677 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.678 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:40.678 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533438+0000", 2024-09-13T06:42:40.678 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089868641999999999 2024-09-13T06:42:40.678 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.678 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.678 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:40.678 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533442+0000", 2024-09-13T06:42:40.678 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.989e-06 2024-09-13T06:42:40.678 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:40.678 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:40.678 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:40.678 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.678 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.678 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25750 3.8 3.63996268 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:42:40.678 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443574+0000", 2024-09-13T06:42:40.678 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 164.169098547, 2024-09-13T06:42:40.679 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089895143999999996, 2024-09-13T06:42:40.679 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:40.679 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:42:40.679 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:40.679 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:40.679 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:40.679 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25750 2024-09-13T06:42:40.679 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.679 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:40.679 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.679 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:40.679 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443574+0000", 2024-09-13T06:42:40.679 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:40.679 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.679 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.680 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:40.680 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443574+0000", 2024-09-13T06:42:40.680 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:40.680 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.680 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.680 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:40.680 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443574+0000", 2024-09-13T06:42:40.680 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:40.680 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.680 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.680 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:40.680 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443576+0000", 2024-09-13T06:42:40.680 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6910000000000002e-06 2024-09-13T06:42:40.680 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.680 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.681 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:40.681 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443583+0000", 2024-09-13T06:42:40.681 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.331e-06 2024-09-13T06:42:40.681 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.681 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.681 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:40.681 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443587+0000", 2024-09-13T06:42:40.681 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6129999999999997e-06 2024-09-13T06:42:40.681 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.681 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.681 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:40.681 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533464+0000", 2024-09-13T06:42:40.681 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089876605999999998 2024-09-13T06:42:40.681 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.681 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.682 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:40.682 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533469+0000", 2024-09-13T06:42:40.682 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3909999999999997e-06 2024-09-13T06:42:40.682 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:40.682 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:40.682 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:40.682 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.682 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.682 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25751 3.8 3.63996268 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:42:40.682 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443592+0000", 2024-09-13T06:42:40.682 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 164.16908085, 2024-09-13T06:42:40.682 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089913650999999997, 2024-09-13T06:42:40.682 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:40.682 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:42:40.682 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:40.682 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:40.683 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:40.683 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25751 2024-09-13T06:42:40.683 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.683 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:40.683 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.683 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:40.683 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443592+0000", 2024-09-13T06:42:40.683 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:40.683 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.683 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.683 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:40.683 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443592+0000", 2024-09-13T06:42:40.683 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:40.683 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.684 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.684 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:40.684 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443591+0000", 2024-09-13T06:42:40.684 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:40.684 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.684 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.684 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:40.684 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443594+0000", 2024-09-13T06:42:40.684 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3649999999999998e-06 2024-09-13T06:42:40.684 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.684 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.684 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:40.684 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443599+0000", 2024-09-13T06:42:40.684 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.699e-06 2024-09-13T06:42:40.685 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.685 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.685 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:40.685 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443611+0000", 2024-09-13T06:42:40.685 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1503e-05 2024-09-13T06:42:40.685 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.685 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.685 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:40.685 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533497+0000", 2024-09-13T06:42:40.685 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089886453000000005 2024-09-13T06:42:40.685 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.685 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.685 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:40.686 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533505+0000", 2024-09-13T06:42:40.686 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.9910000000000002e-06 2024-09-13T06:42:40.686 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:40.686 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:40.686 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:40.686 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.686 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.686 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25752 3.8 3.63996268 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:42:40.686 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443615+0000", 2024-09-13T06:42:40.686 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 164.16905706899999, 2024-09-13T06:42:40.686 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089905868999999999, 2024-09-13T06:42:40.686 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:40.686 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:42:40.686 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:40.686 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:40.687 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:40.687 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25752 2024-09-13T06:42:40.687 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.687 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:40.687 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.687 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:40.687 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443615+0000", 2024-09-13T06:42:40.687 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:40.687 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.687 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.687 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:40.687 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443615+0000", 2024-09-13T06:42:40.687 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:40.687 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.687 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.687 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:40.688 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443615+0000", 2024-09-13T06:42:40.688 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:40.688 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.688 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.688 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:40.688 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443617+0000", 2024-09-13T06:42:40.688 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3539999999999998e-06 2024-09-13T06:42:40.688 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.688 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.688 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:40.688 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443624+0000", 2024-09-13T06:42:40.688 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3600000000000001e-06 2024-09-13T06:42:40.688 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.688 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.689 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:40.689 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443628+0000", 2024-09-13T06:42:40.689 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.2350000000000001e-06 2024-09-13T06:42:40.689 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.689 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.689 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:40.689 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533517+0000", 2024-09-13T06:42:40.689 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089889029999999995 2024-09-13T06:42:40.689 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.689 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.689 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:40.689 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533521+0000", 2024-09-13T06:42:40.689 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.2529999999999998e-06 2024-09-13T06:42:40.689 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:40.689 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:40.690 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:40.690 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.690 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.690 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:64356 3.c 3:32785be9:::rbd_header.11218ba71f0d:head [watch reconnect cookie 140361410387072 gen 2] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e95)", 2024-09-13T06:42:40.690 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:48.473318+0000", 2024-09-13T06:42:40.690 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 112.139354676, 2024-09-13T06:42:40.690 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1458904379999999, 2024-09-13T06:42:40.690 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:40.690 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:40.690 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:40.690 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:40.690 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:40.690 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 64356 2024-09-13T06:42:40.690 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.690 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:40.691 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.691 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:40.691 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:48.473318+0000", 2024-09-13T06:42:40.691 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:40.691 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.691 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.691 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:40.691 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:48.473318+0000", 2024-09-13T06:42:40.691 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:40.691 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.691 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.691 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:40.691 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:48.473315+0000", 2024-09-13T06:42:40.691 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999971 2024-09-13T06:42:40.691 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.691 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.692 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:40.692 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:48.473329+0000", 2024-09-13T06:42:40.692 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.433e-05 2024-09-13T06:42:40.692 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.692 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.692 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:40.692 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:48.473363+0000", 2024-09-13T06:42:40.692 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.3592e-05 2024-09-13T06:42:40.692 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.692 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.692 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:40.692 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:48.473386+0000", 2024-09-13T06:42:40.692 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2708999999999999e-05 2024-09-13T06:42:40.692 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.692 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.693 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:40.693 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:48.473804+0000", 2024-09-13T06:42:40.693 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00041789399999999998 2024-09-13T06:42:40.693 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.693 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.693 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:42:40.693 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:48.473830+0000", 2024-09-13T06:42:40.693 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6869e-05 2024-09-13T06:42:40.693 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.693 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.693 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:40.693 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:49.614332+0000", 2024-09-13T06:42:40.693 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.140501107 2024-09-13T06:42:40.694 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.694 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.694 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for rw locks", 2024-09-13T06:42:40.694 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:49.614496+0000", 2024-09-13T06:42:40.694 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00016451200000000001 2024-09-13T06:42:40.694 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.694 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.694 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:40.694 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:49.617131+0000", 2024-09-13T06:42:40.694 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.002634843 2024-09-13T06:42:40.694 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.694 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.694 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:40.694 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:49.617204+0000", 2024-09-13T06:42:40.694 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.2991000000000006e-05 2024-09-13T06:42:40.695 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.695 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.695 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:40.695 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:49.619208+0000", 2024-09-13T06:42:40.695 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.002004381 2024-09-13T06:42:40.695 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:40.695 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:40.695 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:40.695 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.695 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.695 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:170155 3.7 3:e17728eb:::image_client.0-clone36.rbd:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e191)", 2024-09-13T06:42:40.695 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:42:31.436412+0000", 2024-09-13T06:42:40.695 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 9.1762608530000005, 2024-09-13T06:42:40.695 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.97843703800000004, 2024-09-13T06:42:40.695 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:40.696 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:42:40.696 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:40.696 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:40.696 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:40.696 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 170155 2024-09-13T06:42:40.696 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.696 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:40.696 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.696 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:40.696 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:31.436412+0000", 2024-09-13T06:42:40.696 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:40.696 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.696 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.696 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:40.696 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:31.436412+0000", 2024-09-13T06:42:40.697 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:40.697 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.697 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.697 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:40.697 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:31.436410+0000", 2024-09-13T06:42:40.697 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999986 2024-09-13T06:42:40.697 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.697 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.697 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:40.697 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:31.436417+0000", 2024-09-13T06:42:40.697 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.6939999999999998e-06 2024-09-13T06:42:40.697 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.697 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.698 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:40.698 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:31.436430+0000", 2024-09-13T06:42:40.698 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3016999999999999e-05 2024-09-13T06:42:40.698 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.698 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.698 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:40.698 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:31.436437+0000", 2024-09-13T06:42:40.698 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.1069999999999999e-06 2024-09-13T06:42:40.698 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.698 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.698 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:40.698 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:31.436515+0000", 2024-09-13T06:42:40.698 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.7756000000000006e-05 2024-09-13T06:42:40.698 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.699 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.699 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:42:40.699 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:31.436523+0000", 2024-09-13T06:42:40.699 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.4970000000000001e-06 2024-09-13T06:42:40.699 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.699 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.699 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:40.699 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:32.414565+0000", 2024-09-13T06:42:40.699 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.97804144199999998 2024-09-13T06:42:40.699 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:40.699 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:40.699 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:40.699 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:32.414849+0000", 2024-09-13T06:42:40.699 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00028388600000000001 2024-09-13T06:42:40.699 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:40.699 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:40.700 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:40.700 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:40.700 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:40.700 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:42:40.700 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-13T06:42:40.702 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-13T06:42:40.702 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:42:40.696+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:42:40.802 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:42:40.800+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:42:40.837 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:42:40.837 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [], 2024-09-13T06:42:40.837 INFO:teuthology.orchestra.run.smithi139.stdout: "num_ops": 0 2024-09-13T06:42:40.837 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:42:40.851 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-13T06:42:40.903 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-13T06:42:40.897+0000 7fa8bb18e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 36790) UID: 0 2024-09-13T06:42:40.973 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:42:40.973 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [], 2024-09-13T06:42:40.973 INFO:teuthology.orchestra.run.smithi139.stdout: "complaint_time": 30, 2024-09-13T06:42:40.973 INFO:teuthology.orchestra.run.smithi139.stdout: "num_blocked_ops": 0 2024-09-13T06:42:40.973 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:42:40.986 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-13T06:42:41.028 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-13T06:42:41.025+0000 7fa8bb18e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 36790) UID: 0 2024-09-13T06:42:41.104 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:42:41.101+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:42:41.151 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:42:41.151 INFO:teuthology.orchestra.run.smithi139.stdout: "size": 20, 2024-09-13T06:42:41.151 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 600, 2024-09-13T06:42:41.152 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [ 2024-09-13T06:42:41.152 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.152 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18706 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 3346432~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:42:41.152 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.846138+0000", 2024-09-13T06:42:41.152 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 169.30491561400001, 2024-09-13T06:42:41.152 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.102018712, 2024-09-13T06:42:41.152 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:41.152 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:41.152 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:41.152 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:41.152 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:41.152 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18706 2024-09-13T06:42:41.152 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.153 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:41.153 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.153 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:41.153 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846138+0000", 2024-09-13T06:42:41.153 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:41.153 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.153 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.153 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:41.153 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846138+0000", 2024-09-13T06:42:41.153 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:41.153 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.153 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.154 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:41.154 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846138+0000", 2024-09-13T06:42:41.154 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:41.154 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.154 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.154 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:41.154 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846141+0000", 2024-09-13T06:42:41.154 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.6969999999999999e-06 2024-09-13T06:42:41.154 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.154 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.154 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:41.154 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846150+0000", 2024-09-13T06:42:41.154 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6400000000000003e-06 2024-09-13T06:42:41.155 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.155 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.155 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:41.155 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846160+0000", 2024-09-13T06:42:41.155 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.3999999999999998e-06 2024-09-13T06:42:41.155 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.155 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.155 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:41.155 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.947764+0000", 2024-09-13T06:42:41.155 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101604085 2024-09-13T06:42:41.155 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.155 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.155 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:41.155 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.947888+0000", 2024-09-13T06:42:41.155 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000124113 2024-09-13T06:42:41.156 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.156 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.156 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:41.156 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.948157+0000", 2024-09-13T06:42:41.156 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00026943399999999998 2024-09-13T06:42:41.156 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:41.156 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:41.156 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:41.156 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.156 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.156 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18707 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 3375104~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:42:41.156 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.846207+0000", 2024-09-13T06:42:41.156 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 169.30484684800001, 2024-09-13T06:42:41.157 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10238114099999999, 2024-09-13T06:42:41.157 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:41.157 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:41.157 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:41.157 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:41.157 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:41.157 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18707 2024-09-13T06:42:41.157 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.157 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:41.157 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.157 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:41.157 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846207+0000", 2024-09-13T06:42:41.157 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:41.158 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.158 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.158 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:41.158 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846207+0000", 2024-09-13T06:42:41.158 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:41.158 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.158 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.158 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:41.158 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846206+0000", 2024-09-13T06:42:41.158 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:42:41.158 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.158 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.158 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:41.158 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846211+0000", 2024-09-13T06:42:41.158 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.3000000000000003e-06 2024-09-13T06:42:41.159 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.159 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.159 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:41.159 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846220+0000", 2024-09-13T06:42:41.159 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6199999999999994e-06 2024-09-13T06:42:41.159 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.159 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.159 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:41.159 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846228+0000", 2024-09-13T06:42:41.159 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.7500000000000003e-06 2024-09-13T06:42:41.159 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.159 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.159 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:41.160 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.948267+0000", 2024-09-13T06:42:41.160 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10203878700000001 2024-09-13T06:42:41.160 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.160 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.160 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:41.160 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.948435+0000", 2024-09-13T06:42:41.160 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00016796500000000001 2024-09-13T06:42:41.160 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.160 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.160 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:41.160 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.948588+0000", 2024-09-13T06:42:41.160 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00015373599999999999 2024-09-13T06:42:41.160 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:41.160 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:41.161 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:41.161 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.161 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.161 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18718 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 3690496~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:42:41.161 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.850174+0000", 2024-09-13T06:42:41.161 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 169.30087969499999, 2024-09-13T06:42:41.161 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101854154, 2024-09-13T06:42:41.161 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:41.161 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:41.161 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:41.161 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:41.161 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:41.161 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18718 2024-09-13T06:42:41.161 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.161 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:41.162 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.162 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:41.162 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850174+0000", 2024-09-13T06:42:41.162 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:41.162 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.162 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.162 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:41.162 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850174+0000", 2024-09-13T06:42:41.162 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:41.162 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.162 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.162 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:41.162 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850173+0000", 2024-09-13T06:42:41.162 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:42:41.162 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.163 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.163 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:41.163 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850178+0000", 2024-09-13T06:42:41.163 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.4129999999999999e-06 2024-09-13T06:42:41.163 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.163 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.163 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:41.163 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850188+0000", 2024-09-13T06:42:41.163 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.8600000000000005e-06 2024-09-13T06:42:41.163 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.163 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.163 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:41.163 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850195+0000", 2024-09-13T06:42:41.163 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.8730000000000007e-06 2024-09-13T06:42:41.164 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.164 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.164 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:41.164 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.951766+0000", 2024-09-13T06:42:41.164 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.1015703 2024-09-13T06:42:41.164 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.164 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.164 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:41.164 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.951879+0000", 2024-09-13T06:42:41.164 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000112932 2024-09-13T06:42:41.164 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.164 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.165 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:41.165 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.952029+0000", 2024-09-13T06:42:41.165 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000149846 2024-09-13T06:42:41.165 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:41.165 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:41.165 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:41.165 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.165 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.165 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18719 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 3719168~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:42:41.165 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.850202+0000", 2024-09-13T06:42:41.165 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 169.30085165200001, 2024-09-13T06:42:41.165 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.102191676, 2024-09-13T06:42:41.165 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:41.165 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:41.166 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:41.166 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:41.166 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:41.166 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18719 2024-09-13T06:42:41.166 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.166 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:41.166 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.166 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:41.166 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850202+0000", 2024-09-13T06:42:41.166 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:41.166 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.166 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.166 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:41.166 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850202+0000", 2024-09-13T06:42:41.166 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:41.166 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.167 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.167 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:41.167 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850202+0000", 2024-09-13T06:42:41.167 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:42:41.167 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.167 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.167 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:41.167 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850205+0000", 2024-09-13T06:42:41.167 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.89e-06 2024-09-13T06:42:41.167 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.167 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.167 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:41.167 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850216+0000", 2024-09-13T06:42:41.167 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0233e-05 2024-09-13T06:42:41.167 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.168 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.168 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:41.168 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850223+0000", 2024-09-13T06:42:41.168 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5299999999999999e-06 2024-09-13T06:42:41.168 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.168 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.168 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:41.168 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.952106+0000", 2024-09-13T06:42:41.168 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10188309299999999 2024-09-13T06:42:41.169 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.169 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.169 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:41.169 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.952233+0000", 2024-09-13T06:42:41.169 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000126993 2024-09-13T06:42:41.169 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.169 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.169 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:41.169 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.952394+0000", 2024-09-13T06:42:41.169 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000160791 2024-09-13T06:42:41.169 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:41.169 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:41.169 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:41.170 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.170 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.170 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18720 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 3747840~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:42:41.170 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.850726+0000", 2024-09-13T06:42:41.170 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 169.300327823, 2024-09-13T06:42:41.170 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10199504299999999, 2024-09-13T06:42:41.170 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:41.170 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:41.170 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:41.170 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:41.170 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:41.170 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18720 2024-09-13T06:42:41.170 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.170 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:41.170 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.171 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:41.171 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850726+0000", 2024-09-13T06:42:41.171 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:41.171 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.171 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.171 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:41.171 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850726+0000", 2024-09-13T06:42:41.171 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:41.171 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.171 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.171 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:41.171 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850229+0000", 2024-09-13T06:42:41.171 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9995027 2024-09-13T06:42:41.172 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.172 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.172 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:41.172 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850731+0000", 2024-09-13T06:42:41.172 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00050221599999999999 2024-09-13T06:42:41.172 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.172 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.172 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:41.172 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850751+0000", 2024-09-13T06:42:41.172 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.9703000000000001e-05 2024-09-13T06:42:41.172 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.172 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.172 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:41.172 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850764+0000", 2024-09-13T06:42:41.173 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3207000000000001e-05 2024-09-13T06:42:41.173 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.173 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.173 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:41.173 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.952454+0000", 2024-09-13T06:42:41.173 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101690102 2024-09-13T06:42:41.173 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.173 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.173 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:41.173 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.952571+0000", 2024-09-13T06:42:41.173 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000116556 2024-09-13T06:42:41.173 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.173 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.174 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:41.174 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.952721+0000", 2024-09-13T06:42:41.174 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000150419 2024-09-13T06:42:41.174 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:41.174 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:41.174 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:41.174 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.174 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.174 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18730 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 4034560~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:42:41.174 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.854013+0000", 2024-09-13T06:42:41.174 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 169.297040882, 2024-09-13T06:42:41.174 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10186914399999999, 2024-09-13T06:42:41.174 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:41.174 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:41.175 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:41.175 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:41.175 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:41.175 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18730 2024-09-13T06:42:41.175 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.175 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:41.175 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.175 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:41.175 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.854013+0000", 2024-09-13T06:42:41.175 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:41.175 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.175 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.175 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:41.175 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.854013+0000", 2024-09-13T06:42:41.176 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:41.176 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.176 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.176 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:41.176 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.854013+0000", 2024-09-13T06:42:41.176 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:41.176 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.176 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.176 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:41.176 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.854016+0000", 2024-09-13T06:42:41.176 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.1839999999999999e-06 2024-09-13T06:42:41.176 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.177 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.177 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:41.177 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.854025+0000", 2024-09-13T06:42:41.177 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.8030000000000003e-06 2024-09-13T06:42:41.177 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.177 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.177 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:41.177 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.854033+0000", 2024-09-13T06:42:41.177 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6500000000000002e-06 2024-09-13T06:42:41.177 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.177 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.177 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:41.178 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.955546+0000", 2024-09-13T06:42:41.178 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10151296 2024-09-13T06:42:41.178 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.178 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.178 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:41.178 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.955694+0000", 2024-09-13T06:42:41.178 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000147773 2024-09-13T06:42:41.178 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.178 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.178 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:41.178 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.955882+0000", 2024-09-13T06:42:41.178 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000188371 2024-09-13T06:42:41.178 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:41.178 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:41.179 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:41.179 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.179 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.179 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18742 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 4378624~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:42:41.179 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.857984+0000", 2024-09-13T06:42:41.179 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 169.29306975899999, 2024-09-13T06:42:41.179 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10179961799999999, 2024-09-13T06:42:41.179 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:41.179 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:41.179 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:41.179 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:41.179 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:41.179 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18742 2024-09-13T06:42:41.179 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.179 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:41.180 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.180 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:41.180 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.857984+0000", 2024-09-13T06:42:41.180 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:41.180 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.180 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.180 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:41.180 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.857984+0000", 2024-09-13T06:42:41.180 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:41.180 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.180 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.180 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:41.180 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.857983+0000", 2024-09-13T06:42:41.180 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:42:41.180 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.181 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.181 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:41.181 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.857987+0000", 2024-09-13T06:42:41.181 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0670000000000002e-06 2024-09-13T06:42:41.181 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.181 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.181 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:41.181 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.857997+0000", 2024-09-13T06:42:41.181 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6830000000000003e-06 2024-09-13T06:42:41.181 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.181 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.181 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:41.181 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.858006+0000", 2024-09-13T06:42:41.181 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.5739999999999996e-06 2024-09-13T06:42:41.181 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.182 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.182 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:41.182 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.959453+0000", 2024-09-13T06:42:41.182 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101447339 2024-09-13T06:42:41.182 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.182 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.182 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:41.182 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.959603+0000", 2024-09-13T06:42:41.182 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000150316 2024-09-13T06:42:41.182 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.182 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.183 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:41.183 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.959784+0000", 2024-09-13T06:42:41.183 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00018065900000000001 2024-09-13T06:42:41.183 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:41.183 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:41.183 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:41.183 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.183 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.183 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18743 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 4407296~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:42:41.183 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.858012+0000", 2024-09-13T06:42:41.183 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 169.29304176599999, 2024-09-13T06:42:41.183 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10210024500000001, 2024-09-13T06:42:41.184 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:41.184 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:41.184 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:41.184 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:41.184 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:41.184 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18743 2024-09-13T06:42:41.184 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.184 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:41.184 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.184 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:41.184 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.858012+0000", 2024-09-13T06:42:41.184 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:41.184 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.184 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.185 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:41.185 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.858012+0000", 2024-09-13T06:42:41.185 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:41.185 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.185 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.185 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:41.185 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.858011+0000", 2024-09-13T06:42:41.185 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:42:41.185 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.185 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.185 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:41.185 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.858016+0000", 2024-09-13T06:42:41.185 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0659999999999997e-06 2024-09-13T06:42:41.185 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.186 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.186 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:41.186 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.858024+0000", 2024-09-13T06:42:41.186 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.7700000000000007e-06 2024-09-13T06:42:41.186 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.186 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.186 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:41.186 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.858032+0000", 2024-09-13T06:42:41.186 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.7700000000000001e-06 2024-09-13T06:42:41.186 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.186 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.186 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:41.186 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.959850+0000", 2024-09-13T06:42:41.186 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.1018182 2024-09-13T06:42:41.187 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.187 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.187 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:41.187 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.959964+0000", 2024-09-13T06:42:41.187 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00011413600000000001 2024-09-13T06:42:41.187 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.187 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.187 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:41.187 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.960113+0000", 2024-09-13T06:42:41.187 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00014813900000000001 2024-09-13T06:42:41.187 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:41.187 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:41.187 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:41.187 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.188 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.188 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18755 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 4751360~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:42:41.188 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.862061+0000", 2024-09-13T06:42:41.188 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 169.288993514, 2024-09-13T06:42:41.188 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101907023, 2024-09-13T06:42:41.188 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:41.188 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:41.188 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:41.188 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:41.188 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:41.188 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18755 2024-09-13T06:42:41.188 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.188 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:41.188 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.189 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:41.189 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862061+0000", 2024-09-13T06:42:41.189 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:41.189 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.189 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.189 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:41.189 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862061+0000", 2024-09-13T06:42:41.189 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:41.189 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.189 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.189 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:41.190 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862060+0000", 2024-09-13T06:42:41.190 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:42:41.190 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.190 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.190 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:41.190 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862064+0000", 2024-09-13T06:42:41.190 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.3229999999999999e-06 2024-09-13T06:42:41.190 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.190 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.190 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:41.190 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862078+0000", 2024-09-13T06:42:41.190 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.433e-05 2024-09-13T06:42:41.190 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.190 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.191 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:41.191 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862086+0000", 2024-09-13T06:42:41.191 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.3869999999999997e-06 2024-09-13T06:42:41.191 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.191 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.191 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:41.191 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.963635+0000", 2024-09-13T06:42:41.191 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101549606 2024-09-13T06:42:41.191 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.191 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.191 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:41.191 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.963783+0000", 2024-09-13T06:42:41.191 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000147312 2024-09-13T06:42:41.191 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.191 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.192 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:41.192 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.963968+0000", 2024-09-13T06:42:41.192 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000185028 2024-09-13T06:42:41.192 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:41.192 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:41.192 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:41.192 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.192 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.192 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18756 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 4780032~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:42:41.192 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.862132+0000", 2024-09-13T06:42:41.192 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 169.288921671, 2024-09-13T06:42:41.192 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.102159295, 2024-09-13T06:42:41.192 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:41.193 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:41.193 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:41.193 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:41.193 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:41.193 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18756 2024-09-13T06:42:41.193 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.193 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:41.193 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.193 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:41.193 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862132+0000", 2024-09-13T06:42:41.193 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:41.193 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.193 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.193 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:41.194 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862132+0000", 2024-09-13T06:42:41.194 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:41.194 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.194 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.194 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:41.194 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862132+0000", 2024-09-13T06:42:41.194 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:42:41.194 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.194 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.194 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:41.194 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862136+0000", 2024-09-13T06:42:41.194 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.9559999999999999e-06 2024-09-13T06:42:41.194 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.194 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.195 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:41.195 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862145+0000", 2024-09-13T06:42:41.195 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6169999999999996e-06 2024-09-13T06:42:41.195 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.195 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.195 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:41.195 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862153+0000", 2024-09-13T06:42:41.195 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.8359999999999992e-06 2024-09-13T06:42:41.195 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.195 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.195 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:41.195 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.964018+0000", 2024-09-13T06:42:41.195 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101865421 2024-09-13T06:42:41.195 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.196 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.196 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:41.196 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.964140+0000", 2024-09-13T06:42:41.196 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000121172 2024-09-13T06:42:41.196 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.196 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.196 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:41.196 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.964292+0000", 2024-09-13T06:42:41.196 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00015202600000000001 2024-09-13T06:42:41.196 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:41.196 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:41.196 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:41.197 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.197 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.197 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18768 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 5124096~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:42:41.197 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.866345+0000", 2024-09-13T06:42:41.197 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 169.28470936400001, 2024-09-13T06:42:41.197 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101779361, 2024-09-13T06:42:41.197 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:41.197 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:41.197 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:41.197 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:41.197 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:41.197 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18768 2024-09-13T06:42:41.197 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.197 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:41.198 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.198 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:41.198 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.866345+0000", 2024-09-13T06:42:41.198 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:41.198 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.198 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.198 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:41.198 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.866345+0000", 2024-09-13T06:42:41.198 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:41.198 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.198 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.198 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:41.198 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.866344+0000", 2024-09-13T06:42:41.199 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:41.199 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.199 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.199 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:41.199 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.866348+0000", 2024-09-13T06:42:41.199 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.4300000000000002e-06 2024-09-13T06:42:41.199 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.199 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.199 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:41.199 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.866356+0000", 2024-09-13T06:42:41.199 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.5930000000000006e-06 2024-09-13T06:42:41.199 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.199 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.199 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:41.199 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.866364+0000", 2024-09-13T06:42:41.200 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5599999999999996e-06 2024-09-13T06:42:41.200 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.200 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.200 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:41.200 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.967865+0000", 2024-09-13T06:42:41.200 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101501683 2024-09-13T06:42:41.200 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.200 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.200 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:41.200 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.967981+0000", 2024-09-13T06:42:41.200 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000115643 2024-09-13T06:42:41.200 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.200 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.201 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:41.201 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.968124+0000", 2024-09-13T06:42:41.201 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00014305500000000001 2024-09-13T06:42:41.201 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:41.201 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:41.201 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:41.201 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.201 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.201 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18779 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 5439488~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:42:41.201 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.869996+0000", 2024-09-13T06:42:41.201 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 169.281058479, 2024-09-13T06:42:41.201 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10189577399999999, 2024-09-13T06:42:41.201 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:41.201 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:41.201 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:41.202 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:41.202 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:41.202 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18779 2024-09-13T06:42:41.202 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.202 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:41.202 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.202 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:41.202 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.869996+0000", 2024-09-13T06:42:41.202 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:41.202 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.202 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.202 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:41.203 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.869996+0000", 2024-09-13T06:42:41.203 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:41.203 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.203 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.203 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:41.203 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.869995+0000", 2024-09-13T06:42:41.203 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:41.203 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.203 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.203 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:41.204 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.869998+0000", 2024-09-13T06:42:41.204 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.2729999999999998e-06 2024-09-13T06:42:41.204 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.204 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.204 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:41.204 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.870007+0000", 2024-09-13T06:42:41.204 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.5760000000000006e-06 2024-09-13T06:42:41.204 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.204 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.204 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:41.204 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.870014+0000", 2024-09-13T06:42:41.205 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.1400000000000002e-06 2024-09-13T06:42:41.205 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.205 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.205 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:41.205 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.971631+0000", 2024-09-13T06:42:41.205 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101617503 2024-09-13T06:42:41.205 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.205 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.205 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:41.205 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.971747+0000", 2024-09-13T06:42:41.205 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00011599600000000001 2024-09-13T06:42:41.205 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.205 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.205 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:41.206 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.971891+0000", 2024-09-13T06:42:41.206 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000143912 2024-09-13T06:42:41.206 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:41.206 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:41.206 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:41.206 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.206 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.206 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18792 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 5812224~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:42:41.206 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.874371+0000", 2024-09-13T06:42:41.206 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 169.276683349, 2024-09-13T06:42:41.206 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101736005, 2024-09-13T06:42:41.206 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:41.206 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:41.206 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:41.207 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:41.207 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:41.207 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18792 2024-09-13T06:42:41.207 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.207 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:41.207 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.207 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:41.207 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874371+0000", 2024-09-13T06:42:41.207 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:41.207 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.207 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.207 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:41.207 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874371+0000", 2024-09-13T06:42:41.207 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:41.208 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.208 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.208 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:41.208 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874370+0000", 2024-09-13T06:42:41.208 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:41.208 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.208 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.208 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:41.208 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874374+0000", 2024-09-13T06:42:41.208 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.7239999999999998e-06 2024-09-13T06:42:41.208 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.208 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.208 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:41.209 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874385+0000", 2024-09-13T06:42:41.209 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1293e-05 2024-09-13T06:42:41.209 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.209 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.209 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:41.209 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874394+0000", 2024-09-13T06:42:41.209 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.0729999999999994e-06 2024-09-13T06:42:41.209 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.209 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.209 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:41.209 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.975850+0000", 2024-09-13T06:42:41.209 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10145599700000001 2024-09-13T06:42:41.209 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.209 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.210 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:41.210 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.975963+0000", 2024-09-13T06:42:41.210 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000112689 2024-09-13T06:42:41.210 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.210 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.210 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:41.210 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.976107+0000", 2024-09-13T06:42:41.210 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000143836 2024-09-13T06:42:41.210 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:41.210 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:41.210 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:41.210 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.210 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.210 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18793 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 5840896~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:42:41.210 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.874401+0000", 2024-09-13T06:42:41.211 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 169.27665331599999, 2024-09-13T06:42:41.211 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.102005516, 2024-09-13T06:42:41.211 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:41.211 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:41.211 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:41.211 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:41.211 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:41.211 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18793 2024-09-13T06:42:41.211 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.211 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:41.211 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.211 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:41.211 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874401+0000", 2024-09-13T06:42:41.211 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:41.212 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.212 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.212 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:41.212 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874401+0000", 2024-09-13T06:42:41.212 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:41.212 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.212 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.212 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:41.212 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874400+0000", 2024-09-13T06:42:41.212 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:42:41.212 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.212 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.212 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:41.212 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874404+0000", 2024-09-13T06:42:41.213 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0069999999999999e-06 2024-09-13T06:42:41.213 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.213 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.213 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:41.213 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874412+0000", 2024-09-13T06:42:41.213 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.5399999999999996e-06 2024-09-13T06:42:41.213 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.213 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.213 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:41.213 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874420+0000", 2024-09-13T06:42:41.213 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.6199999999999999e-06 2024-09-13T06:42:41.213 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.213 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.214 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:41.214 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.976150+0000", 2024-09-13T06:42:41.214 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101729874 2024-09-13T06:42:41.214 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.214 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.214 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:41.214 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.976261+0000", 2024-09-13T06:42:41.214 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000110819 2024-09-13T06:42:41.214 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.214 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.214 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:41.214 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.976406+0000", 2024-09-13T06:42:41.215 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000145489 2024-09-13T06:42:41.215 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:41.215 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:41.215 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:41.215 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.215 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.215 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18803 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 6127616~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:42:41.215 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.877851+0000", 2024-09-13T06:42:41.215 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 169.27320282299999, 2024-09-13T06:42:41.215 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101951584, 2024-09-13T06:42:41.216 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:41.216 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:41.216 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:41.216 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:41.216 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:41.216 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18803 2024-09-13T06:42:41.216 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.216 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:41.216 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.216 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:41.216 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.877851+0000", 2024-09-13T06:42:41.216 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:41.216 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.217 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.217 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:41.217 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.877851+0000", 2024-09-13T06:42:41.217 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:41.217 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.217 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.217 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:41.217 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.877851+0000", 2024-09-13T06:42:41.217 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:41.217 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.217 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.217 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:41.217 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.877854+0000", 2024-09-13T06:42:41.217 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.7929999999999999e-06 2024-09-13T06:42:41.218 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.218 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.218 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:41.218 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.877864+0000", 2024-09-13T06:42:41.218 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.2029999999999998e-06 2024-09-13T06:42:41.218 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.218 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.218 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:41.218 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.877873+0000", 2024-09-13T06:42:41.218 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.0440000000000001e-06 2024-09-13T06:42:41.218 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.218 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.219 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:41.219 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.979544+0000", 2024-09-13T06:42:41.219 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101671198 2024-09-13T06:42:41.219 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.219 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.219 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:41.219 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.979658+0000", 2024-09-13T06:42:41.219 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000114456 2024-09-13T06:42:41.219 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.219 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.219 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:41.219 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.979803+0000", 2024-09-13T06:42:41.219 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000144506 2024-09-13T06:42:41.219 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:41.220 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:41.220 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:41.220 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.220 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.220 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18807 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 6242304~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:42:41.220 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.879235+0000", 2024-09-13T06:42:41.220 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 169.27181879299999, 2024-09-13T06:42:41.220 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101781258, 2024-09-13T06:42:41.220 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:41.220 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:41.220 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:41.220 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:41.220 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:41.221 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18807 2024-09-13T06:42:41.221 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.221 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:41.221 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.221 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:41.221 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879235+0000", 2024-09-13T06:42:41.221 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:41.221 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.221 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.221 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:41.221 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879235+0000", 2024-09-13T06:42:41.221 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:41.221 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.221 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.222 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:41.222 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879235+0000", 2024-09-13T06:42:41.222 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:41.222 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.222 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.222 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:41.222 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879239+0000", 2024-09-13T06:42:41.222 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.963e-06 2024-09-13T06:42:41.222 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.222 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.222 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:41.222 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879247+0000", 2024-09-13T06:42:41.222 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6470000000000004e-06 2024-09-13T06:42:41.222 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.222 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.223 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:41.223 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879255+0000", 2024-09-13T06:42:41.223 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5429999999999996e-06 2024-09-13T06:42:41.223 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.223 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.223 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:41.223 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.980756+0000", 2024-09-13T06:42:41.223 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10150165999999999 2024-09-13T06:42:41.223 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.223 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.223 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:41.223 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.980868+0000", 2024-09-13T06:42:41.224 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000111196 2024-09-13T06:42:41.224 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.224 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.224 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:41.224 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.981017+0000", 2024-09-13T06:42:41.224 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000148846 2024-09-13T06:42:41.224 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:41.224 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:41.224 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:41.224 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.224 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.224 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18808 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 6270976~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:42:41.224 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.879261+0000", 2024-09-13T06:42:41.225 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 169.271792654, 2024-09-13T06:42:41.225 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.102057547, 2024-09-13T06:42:41.225 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:41.225 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:41.225 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:41.225 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:41.225 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:41.225 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18808 2024-09-13T06:42:41.225 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.225 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:41.225 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.225 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:41.225 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879261+0000", 2024-09-13T06:42:41.225 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:41.225 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.226 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.226 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:41.226 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879261+0000", 2024-09-13T06:42:41.226 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:41.226 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.226 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.226 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:41.226 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879261+0000", 2024-09-13T06:42:41.226 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:41.226 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.226 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.226 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:41.226 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879264+0000", 2024-09-13T06:42:41.227 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.523e-06 2024-09-13T06:42:41.227 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.227 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.227 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:41.227 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879273+0000", 2024-09-13T06:42:41.227 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6070000000000008e-06 2024-09-13T06:42:41.227 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.227 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.227 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:41.227 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879280+0000", 2024-09-13T06:42:41.227 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.4699999999999996e-06 2024-09-13T06:42:41.227 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.227 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.227 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:41.228 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.981060+0000", 2024-09-13T06:42:41.228 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10177934800000001 2024-09-13T06:42:41.228 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.228 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.228 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:41.228 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.981174+0000", 2024-09-13T06:42:41.228 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000114456 2024-09-13T06:42:41.228 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.228 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.228 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:41.228 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.981319+0000", 2024-09-13T06:42:41.228 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00014473900000000001 2024-09-13T06:42:41.228 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:41.228 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:41.229 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:41.229 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.229 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.229 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18811 3.9 3.140f5209 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:42:41.229 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.880449+0000", 2024-09-13T06:42:41.229 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 169.27060511600001, 2024-09-13T06:42:41.229 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101739355, 2024-09-13T06:42:41.229 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:41.229 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:42:41.229 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:41.229 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:41.229 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:41.229 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18811 2024-09-13T06:42:41.230 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.230 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:41.230 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.230 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:41.230 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880449+0000", 2024-09-13T06:42:41.230 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:41.230 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.230 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.230 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:41.230 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880449+0000", 2024-09-13T06:42:41.230 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:41.230 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.230 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.230 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:41.231 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880448+0000", 2024-09-13T06:42:41.231 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:42:41.231 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.231 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.231 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:41.231 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880452+0000", 2024-09-13T06:42:41.231 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0470000000000004e-06 2024-09-13T06:42:41.231 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.231 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.231 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:41.231 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880462+0000", 2024-09-13T06:42:41.231 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6530000000000006e-06 2024-09-13T06:42:41.231 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.231 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.231 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:41.232 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880472+0000", 2024-09-13T06:42:41.232 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0027000000000001e-05 2024-09-13T06:42:41.232 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.232 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.232 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:41.232 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.982172+0000", 2024-09-13T06:42:41.232 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10170043500000001 2024-09-13T06:42:41.232 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.232 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.232 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:41.232 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.982188+0000", 2024-09-13T06:42:41.232 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6172999999999999e-05 2024-09-13T06:42:41.232 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:41.232 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:41.233 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:41.233 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.233 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.233 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18812 3.9 3.140f5209 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:42:41.233 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.880478+0000", 2024-09-13T06:42:41.233 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 169.27057587900001, 2024-09-13T06:42:41.233 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10177795100000001, 2024-09-13T06:42:41.233 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:41.233 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:42:41.233 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:41.233 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:41.233 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:41.233 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18812 2024-09-13T06:42:41.234 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.234 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:41.234 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.234 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:41.234 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880478+0000", 2024-09-13T06:42:41.234 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:41.234 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.234 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.234 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:41.234 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880478+0000", 2024-09-13T06:42:41.234 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:41.234 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.234 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.234 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:41.234 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880477+0000", 2024-09-13T06:42:41.234 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:42:41.235 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.235 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.235 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:41.235 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880481+0000", 2024-09-13T06:42:41.235 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.827e-06 2024-09-13T06:42:41.235 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.235 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.235 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:41.235 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880490+0000", 2024-09-13T06:42:41.235 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6100000000000006e-06 2024-09-13T06:42:41.235 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.235 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.235 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:41.235 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880497+0000", 2024-09-13T06:42:41.235 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.7030000000000006e-06 2024-09-13T06:42:41.236 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.236 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.236 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:41.236 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.982241+0000", 2024-09-13T06:42:41.236 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10174351199999999 2024-09-13T06:42:41.236 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.236 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.236 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:41.236 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.982256+0000", 2024-09-13T06:42:41.236 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5143000000000001e-05 2024-09-13T06:42:41.236 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:41.236 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:41.236 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:41.236 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.237 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.237 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:160483 3.a 3:57f62123:::rbd_header.112138ed422:head [watch reconnect cookie 140361344088384 gen 3] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e177)", 2024-09-13T06:42:41.237 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:42:17.439011+0000", 2024-09-13T06:42:41.237 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 23.712042688, 2024-09-13T06:42:41.237 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.155518861, 2024-09-13T06:42:41.237 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:41.237 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:41.237 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:41.237 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:41.237 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:41.237 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 160483 2024-09-13T06:42:41.237 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.237 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:41.237 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.238 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:41.238 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:17.439011+0000", 2024-09-13T06:42:41.238 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:41.238 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.238 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.238 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:41.238 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:17.439011+0000", 2024-09-13T06:42:41.238 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:41.238 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.238 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.238 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:41.238 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:17.439009+0000", 2024-09-13T06:42:41.238 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999976 2024-09-13T06:42:41.239 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.239 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.239 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:41.239 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:17.439024+0000", 2024-09-13T06:42:41.239 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.464e-05 2024-09-13T06:42:41.239 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.239 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.239 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:41.239 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:17.439058+0000", 2024-09-13T06:42:41.239 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.4712999999999998e-05 2024-09-13T06:42:41.239 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.239 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.239 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:41.239 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:17.439085+0000", 2024-09-13T06:42:41.240 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.6216000000000001e-05 2024-09-13T06:42:41.240 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.240 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.240 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:41.240 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:17.439182+0000", 2024-09-13T06:42:41.240 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.7020000000000003e-05 2024-09-13T06:42:41.240 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.240 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.240 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:42:41.240 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:17.439204+0000", 2024-09-13T06:42:41.240 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.2276000000000002e-05 2024-09-13T06:42:41.240 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.241 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.241 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:41.241 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:18.588627+0000", 2024-09-13T06:42:41.241 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1494235829999999 2024-09-13T06:42:41.241 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.241 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.241 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for rw locks", 2024-09-13T06:42:41.241 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:18.589031+0000", 2024-09-13T06:42:41.241 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0004035 2024-09-13T06:42:41.241 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.241 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.241 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:41.241 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:18.590604+0000", 2024-09-13T06:42:41.242 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.001573234 2024-09-13T06:42:41.242 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.242 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.242 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:41.242 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:18.590791+0000", 2024-09-13T06:42:41.242 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000186701 2024-09-13T06:42:41.242 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.242 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.242 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:41.242 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:18.594530+0000", 2024-09-13T06:42:41.242 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0037394250000000002 2024-09-13T06:42:41.242 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:41.242 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:41.242 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:41.243 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:41.243 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:41.243 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:42:41.244 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-13T06:42:41.245 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:42:41.244+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:42:41.345 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:42:41.340+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:42:41.398 INFO:teuthology.orchestra.run.smithi081.stderr:nodeep-scrub is set 2024-09-13T06:42:41.419 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:42:41.419 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [], 2024-09-13T06:42:41.419 INFO:teuthology.orchestra.run.smithi139.stdout: "num_ops": 0 2024-09-13T06:42:41.419 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:42:41.433 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-13T06:42:41.470 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:42:41.468+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:42:41.546 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:42:41.544+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:42:41.550 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:42:41.551 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [], 2024-09-13T06:42:41.551 INFO:teuthology.orchestra.run.smithi139.stdout: "complaint_time": 30, 2024-09-13T06:42:41.551 INFO:teuthology.orchestra.run.smithi139.stdout: "num_blocked_ops": 0 2024-09-13T06:42:41.551 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:42:41.564 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-13T06:42:41.612 INFO:teuthology.orchestra.run.smithi081.stdout:checking clone #36, image image_client.0-clone36 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent37 2024-09-13T06:42:41.647 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:42:41.644+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:42:41.693 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:42:41.693 INFO:teuthology.orchestra.run.smithi139.stdout: "size": 20, 2024-09-13T06:42:41.693 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 600, 2024-09-13T06:42:41.693 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [ 2024-09-13T06:42:41.693 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.693 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43282 3.1d 3:bd80bfb3:::rbd_object_map.11212f44bfb1.0000000000000020:head [call rbd.object_map_update in=20b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:42:41.693 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589032+0000", 2024-09-13T06:42:41.693 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 140.10149249700001, 2024-09-13T06:42:41.693 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.076225263000000001, 2024-09-13T06:42:41.693 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:41.694 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:42:41.694 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:41.694 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:41.694 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:41.694 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43282 2024-09-13T06:42:41.694 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.694 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:41.694 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.694 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:41.694 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589032+0000", 2024-09-13T06:42:41.694 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:41.694 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.695 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.695 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:41.695 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589032+0000", 2024-09-13T06:42:41.695 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:41.695 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.695 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.695 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:41.695 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589031+0000", 2024-09-13T06:42:41.695 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:42:41.695 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.695 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.695 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:41.695 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589036+0000", 2024-09-13T06:42:41.695 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.2619999999999998e-06 2024-09-13T06:42:41.696 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.696 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.696 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:41.696 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589046+0000", 2024-09-13T06:42:41.696 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.8099999999999992e-06 2024-09-13T06:42:41.696 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.696 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.696 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:41.696 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589054+0000", 2024-09-13T06:42:41.696 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.2230000000000007e-06 2024-09-13T06:42:41.696 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.696 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.697 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:41.697 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.660691+0000", 2024-09-13T06:42:41.697 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.07163659 2024-09-13T06:42:41.697 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.697 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.697 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:41.697 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.660850+0000", 2024-09-13T06:42:41.697 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00015864300000000001 2024-09-13T06:42:41.697 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.697 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.697 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 4", 2024-09-13T06:42:41.697 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.661729+0000", 2024-09-13T06:42:41.697 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00087956099999999995 2024-09-13T06:42:41.698 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.698 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.698 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:42:41.698 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.664409+0000", 2024-09-13T06:42:41.698 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0026803479999999999 2024-09-13T06:42:41.698 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.698 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.698 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-13T06:42:41.698 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.665088+0000", 2024-09-13T06:42:41.698 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00067901400000000003 2024-09-13T06:42:41.698 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.698 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.699 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-13T06:42:41.699 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.665181+0000", 2024-09-13T06:42:41.699 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.2050000000000001e-05 2024-09-13T06:42:41.699 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.699 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.699 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:41.699 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.665257+0000", 2024-09-13T06:42:41.699 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.6698000000000003e-05 2024-09-13T06:42:41.699 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:41.699 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:41.699 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:41.699 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.699 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.699 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43290 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 299008~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:42:41.700 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589500+0000", 2024-09-13T06:42:41.700 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 140.10102433500001, 2024-09-13T06:42:41.700 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.075898564000000002, 2024-09-13T06:42:41.700 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:41.700 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:41.700 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:41.700 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:41.700 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:41.700 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43290 2024-09-13T06:42:41.700 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.700 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:41.700 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.700 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:41.700 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589500+0000", 2024-09-13T06:42:41.701 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:41.701 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.701 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.701 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:41.701 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589500+0000", 2024-09-13T06:42:41.701 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:41.701 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.701 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.701 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:41.701 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589499+0000", 2024-09-13T06:42:41.701 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:42:41.701 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.702 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.702 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:41.702 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589503+0000", 2024-09-13T06:42:41.702 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.8330000000000004e-06 2024-09-13T06:42:41.702 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.702 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.702 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:41.702 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589511+0000", 2024-09-13T06:42:41.702 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.3359999999999995e-06 2024-09-13T06:42:41.702 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.702 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.702 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:41.703 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589519+0000", 2024-09-13T06:42:41.703 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.4760000000000001e-06 2024-09-13T06:42:41.703 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.703 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.703 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:41.703 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.665097+0000", 2024-09-13T06:42:41.703 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.075577828999999999 2024-09-13T06:42:41.703 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.703 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.703 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:41.703 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.665170+0000", 2024-09-13T06:42:41.703 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.3745000000000006e-05 2024-09-13T06:42:41.703 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.703 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.703 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:41.704 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.665399+0000", 2024-09-13T06:42:41.704 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00022826199999999999 2024-09-13T06:42:41.704 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:41.704 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:41.704 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:41.704 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.704 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.704 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43291 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 313344~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:42:41.704 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589560+0000", 2024-09-13T06:42:41.704 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 140.10096411399999, 2024-09-13T06:42:41.704 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.076145594999999996, 2024-09-13T06:42:41.704 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:41.704 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:41.704 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:41.705 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:41.705 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:41.705 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43291 2024-09-13T06:42:41.705 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.705 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:41.705 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.705 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:41.705 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589560+0000", 2024-09-13T06:42:41.705 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:41.705 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.705 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.705 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:41.705 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589560+0000", 2024-09-13T06:42:41.705 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:41.706 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.706 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.706 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:41.706 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589559+0000", 2024-09-13T06:42:41.706 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:42:41.706 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.706 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.706 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:41.706 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589564+0000", 2024-09-13T06:42:41.706 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.3989999999999997e-06 2024-09-13T06:42:41.706 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.706 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.706 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:41.706 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589574+0000", 2024-09-13T06:42:41.707 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0502999999999999e-05 2024-09-13T06:42:41.707 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.707 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.707 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:41.707 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589582+0000", 2024-09-13T06:42:41.707 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.1859999999999992e-06 2024-09-13T06:42:41.707 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.707 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.707 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:41.707 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.665423+0000", 2024-09-13T06:42:41.707 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.075840290000000005 2024-09-13T06:42:41.707 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.707 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.708 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:41.708 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.665496+0000", 2024-09-13T06:42:41.708 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.2791000000000002e-05 2024-09-13T06:42:41.708 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.708 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.708 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:41.708 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.665706+0000", 2024-09-13T06:42:41.708 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00021038200000000001 2024-09-13T06:42:41.708 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:41.708 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:41.708 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:41.708 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.708 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.708 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43292 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 327680~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:42:41.709 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589589+0000", 2024-09-13T06:42:41.709 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 140.10093557299999, 2024-09-13T06:42:41.709 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.076769537999999998, 2024-09-13T06:42:41.709 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:41.709 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:41.709 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:41.709 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:41.709 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:41.709 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43292 2024-09-13T06:42:41.709 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.709 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:41.709 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.709 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:41.709 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589589+0000", 2024-09-13T06:42:41.710 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:41.710 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.710 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.710 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:41.710 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589589+0000", 2024-09-13T06:42:41.710 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:41.710 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.710 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.710 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:41.710 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589588+0000", 2024-09-13T06:42:41.710 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:41.710 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.710 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.711 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:41.711 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589592+0000", 2024-09-13T06:42:41.711 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.6389999999999998e-06 2024-09-13T06:42:41.711 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.711 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.711 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:41.711 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589600+0000", 2024-09-13T06:42:41.711 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.4630000000000001e-06 2024-09-13T06:42:41.711 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.711 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.711 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:41.711 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589608+0000", 2024-09-13T06:42:41.711 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.2359999999999998e-06 2024-09-13T06:42:41.711 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.711 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.712 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:41.712 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.665779+0000", 2024-09-13T06:42:41.712 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.076170924000000001 2024-09-13T06:42:41.712 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.712 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.712 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:41.712 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.665977+0000", 2024-09-13T06:42:41.712 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00019891900000000001 2024-09-13T06:42:41.712 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.712 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.712 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:41.712 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.666358+0000", 2024-09-13T06:42:41.712 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000380963 2024-09-13T06:42:41.712 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:41.713 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:41.713 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:41.713 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.713 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.713 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43293 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 342016~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:42:41.713 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589616+0000", 2024-09-13T06:42:41.713 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 140.10090867900001, 2024-09-13T06:42:41.713 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.077030083999999999, 2024-09-13T06:42:41.713 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:41.713 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:41.713 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:41.713 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:41.713 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:41.713 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43293 2024-09-13T06:42:41.713 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.714 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:41.714 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.714 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:41.714 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589616+0000", 2024-09-13T06:42:41.714 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:41.714 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.714 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.714 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:41.714 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589616+0000", 2024-09-13T06:42:41.714 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:41.714 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.714 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.714 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:41.714 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589615+0000", 2024-09-13T06:42:41.714 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:42:41.715 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.715 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.715 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:41.715 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589619+0000", 2024-09-13T06:42:41.715 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.9559999999999999e-06 2024-09-13T06:42:41.715 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.715 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.715 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:41.715 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589627+0000", 2024-09-13T06:42:41.715 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.2490000000000001e-06 2024-09-13T06:42:41.715 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.715 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.715 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:41.716 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589635+0000", 2024-09-13T06:42:41.716 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.96e-06 2024-09-13T06:42:41.716 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.716 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.716 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:41.716 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.666379+0000", 2024-09-13T06:42:41.716 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.076744484000000002 2024-09-13T06:42:41.716 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.716 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.716 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:41.716 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.666454+0000", 2024-09-13T06:42:41.716 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.4623999999999996e-05 2024-09-13T06:42:41.716 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.716 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.717 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:41.717 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.666646+0000", 2024-09-13T06:42:41.717 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00019176999999999999 2024-09-13T06:42:41.717 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:41.717 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:41.717 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:41.717 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.717 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.717 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43294 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 356352~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:42:41.717 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589681+0000", 2024-09-13T06:42:41.717 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 140.10084336400001, 2024-09-13T06:42:41.717 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.077594648000000002, 2024-09-13T06:42:41.717 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:41.717 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:41.717 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:41.718 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:41.718 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:41.718 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43294 2024-09-13T06:42:41.718 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.718 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:41.718 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.718 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:41.718 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589681+0000", 2024-09-13T06:42:41.718 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:41.718 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.718 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.718 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:41.718 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589681+0000", 2024-09-13T06:42:41.718 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:41.719 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.719 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.719 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:41.719 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589680+0000", 2024-09-13T06:42:41.719 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:42:41.719 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.719 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.719 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:41.719 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589684+0000", 2024-09-13T06:42:41.719 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.8369999999999999e-06 2024-09-13T06:42:41.719 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.719 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.719 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:41.719 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589693+0000", 2024-09-13T06:42:41.719 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.1020000000000003e-06 2024-09-13T06:42:41.720 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.720 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.720 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:41.720 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589701+0000", 2024-09-13T06:42:41.720 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.8059999999999995e-06 2024-09-13T06:42:41.720 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.720 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.720 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:41.720 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.666714+0000", 2024-09-13T06:42:41.720 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.077013463000000004 2024-09-13T06:42:41.720 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.720 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.720 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:41.721 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.666897+0000", 2024-09-13T06:42:41.721 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000182268 2024-09-13T06:42:41.721 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.721 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.721 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:41.721 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.667276+0000", 2024-09-13T06:42:41.721 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00037907499999999998 2024-09-13T06:42:41.721 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:41.721 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:41.721 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:41.721 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.721 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.722 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43295 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 370688~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:42:41.722 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589744+0000", 2024-09-13T06:42:41.722 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 140.100780192, 2024-09-13T06:42:41.722 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.077854343000000006, 2024-09-13T06:42:41.722 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:41.722 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:41.722 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:41.722 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:41.722 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:41.722 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43295 2024-09-13T06:42:41.722 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.722 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:41.722 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.722 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:41.723 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589744+0000", 2024-09-13T06:42:41.723 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:41.723 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.723 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.723 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:41.723 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589744+0000", 2024-09-13T06:42:41.723 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:41.723 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.723 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.723 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:41.723 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589743+0000", 2024-09-13T06:42:41.724 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:42:41.724 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.724 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.724 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:41.724 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589747+0000", 2024-09-13T06:42:41.724 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0130000000000004e-06 2024-09-13T06:42:41.724 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.724 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.724 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:41.724 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589756+0000", 2024-09-13T06:42:41.724 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.003e-06 2024-09-13T06:42:41.724 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.724 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.724 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:41.725 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589766+0000", 2024-09-13T06:42:41.725 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.2820000000000002e-06 2024-09-13T06:42:41.725 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.725 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.725 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:41.725 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.667300+0000", 2024-09-13T06:42:41.725 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.077534299000000001 2024-09-13T06:42:41.725 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.725 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.725 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:41.725 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.667372+0000", 2024-09-13T06:42:41.725 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.2393999999999998e-05 2024-09-13T06:42:41.725 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.725 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.726 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:41.726 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.667599+0000", 2024-09-13T06:42:41.726 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000226269 2024-09-13T06:42:41.726 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:41.726 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:41.726 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:41.726 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.726 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.726 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43296 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 385024~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:42:41.726 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589772+0000", 2024-09-13T06:42:41.726 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 140.10075216800001, 2024-09-13T06:42:41.726 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.078469647000000003, 2024-09-13T06:42:41.726 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:41.726 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:41.726 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:41.727 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:41.727 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:41.727 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43296 2024-09-13T06:42:41.727 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.727 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:41.727 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.727 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:41.727 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589772+0000", 2024-09-13T06:42:41.727 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:41.727 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.727 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.727 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:41.727 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589772+0000", 2024-09-13T06:42:41.727 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:41.727 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.728 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.728 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:41.728 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589771+0000", 2024-09-13T06:42:41.728 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:42:41.728 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.728 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.728 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:41.728 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589775+0000", 2024-09-13T06:42:41.728 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.8530000000000002e-06 2024-09-13T06:42:41.728 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.728 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.728 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:41.728 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589784+0000", 2024-09-13T06:42:41.728 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.4300000000000006e-06 2024-09-13T06:42:41.729 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.729 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.729 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:41.729 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589791+0000", 2024-09-13T06:42:41.729 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.4660000000000002e-06 2024-09-13T06:42:41.729 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.729 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.729 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:41.729 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.667667+0000", 2024-09-13T06:42:41.729 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.077875697999999993 2024-09-13T06:42:41.729 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.729 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.729 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:41.729 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.667854+0000", 2024-09-13T06:42:41.730 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00018760099999999999 2024-09-13T06:42:41.730 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.730 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.730 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:41.730 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.668242+0000", 2024-09-13T06:42:41.730 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00038750600000000003 2024-09-13T06:42:41.730 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:41.730 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:41.730 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:41.730 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.730 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.730 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43297 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 403456~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:42:41.730 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589797+0000", 2024-09-13T06:42:41.730 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 140.10072746399999, 2024-09-13T06:42:41.730 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.078756672999999999, 2024-09-13T06:42:41.731 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:41.731 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:41.731 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:41.731 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:41.731 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:41.731 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43297 2024-09-13T06:42:41.731 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.731 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:41.731 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.731 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:41.731 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589797+0000", 2024-09-13T06:42:41.731 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:41.731 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.731 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.732 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:41.732 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589797+0000", 2024-09-13T06:42:41.732 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:41.732 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.732 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.732 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:41.732 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589796+0000", 2024-09-13T06:42:41.732 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:41.732 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.732 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.732 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:41.732 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589800+0000", 2024-09-13T06:42:41.732 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.3230000000000002e-06 2024-09-13T06:42:41.733 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.733 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.733 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:41.733 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589808+0000", 2024-09-13T06:42:41.733 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.2390000000000002e-06 2024-09-13T06:42:41.733 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.733 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.733 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:41.733 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589815+0000", 2024-09-13T06:42:41.733 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.413e-06 2024-09-13T06:42:41.733 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.733 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.733 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:41.734 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.668265+0000", 2024-09-13T06:42:41.734 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.078449873000000003 2024-09-13T06:42:41.734 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.734 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.734 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:41.734 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.668332+0000", 2024-09-13T06:42:41.734 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.7178e-05 2024-09-13T06:42:41.734 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.734 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.734 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:41.734 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.668554+0000", 2024-09-13T06:42:41.734 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00022128600000000001 2024-09-13T06:42:41.734 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:41.734 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:41.734 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:41.735 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.735 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.735 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43298 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 417792~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:42:41.735 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589821+0000", 2024-09-13T06:42:41.735 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 140.100703342, 2024-09-13T06:42:41.735 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.079368660999999993, 2024-09-13T06:42:41.735 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:41.735 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:41.735 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:41.735 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:41.735 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:41.735 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43298 2024-09-13T06:42:41.735 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.735 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:41.736 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.736 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:41.736 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589821+0000", 2024-09-13T06:42:41.736 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:41.736 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.736 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.736 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:41.736 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589821+0000", 2024-09-13T06:42:41.736 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:41.736 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.736 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.736 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:41.736 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589821+0000", 2024-09-13T06:42:41.737 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:41.737 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.737 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.737 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:41.737 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589830+0000", 2024-09-13T06:42:41.737 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.4860000000000003e-06 2024-09-13T06:42:41.737 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.737 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.737 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:41.737 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589839+0000", 2024-09-13T06:42:41.737 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.0159999999999997e-06 2024-09-13T06:42:41.737 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.737 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.737 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:41.738 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589847+0000", 2024-09-13T06:42:41.738 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.6059999999999997e-06 2024-09-13T06:42:41.738 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.738 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.738 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:41.738 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.668620+0000", 2024-09-13T06:42:41.738 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.078773485000000004 2024-09-13T06:42:41.738 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.738 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.738 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:41.738 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.668798+0000", 2024-09-13T06:42:41.738 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000178233 2024-09-13T06:42:41.738 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.739 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.739 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:41.739 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.669190+0000", 2024-09-13T06:42:41.739 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00039143499999999998 2024-09-13T06:42:41.739 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:41.739 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:41.739 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:41.739 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.739 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.739 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43299 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 432128~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:42:41.739 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589881+0000", 2024-09-13T06:42:41.739 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 140.100643494, 2024-09-13T06:42:41.739 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.079693849999999997, 2024-09-13T06:42:41.740 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:41.740 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:41.740 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:41.740 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:41.740 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:41.740 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43299 2024-09-13T06:42:41.740 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.740 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:41.740 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.740 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:41.740 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589881+0000", 2024-09-13T06:42:41.740 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:41.740 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.741 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.741 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:41.741 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589881+0000", 2024-09-13T06:42:41.741 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:41.741 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.741 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.741 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:41.741 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589880+0000", 2024-09-13T06:42:41.741 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:42:41.741 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.741 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.741 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:41.741 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589884+0000", 2024-09-13T06:42:41.742 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.053e-06 2024-09-13T06:42:41.742 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.742 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.742 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:41.742 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589893+0000", 2024-09-13T06:42:41.742 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.2129999999999997e-06 2024-09-13T06:42:41.742 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.742 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.742 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:41.742 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589901+0000", 2024-09-13T06:42:41.742 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.6399999999999997e-06 2024-09-13T06:42:41.742 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.742 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.743 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:41.743 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.669213+0000", 2024-09-13T06:42:41.743 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.079312074999999996 2024-09-13T06:42:41.743 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.743 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.743 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:41.743 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.669281+0000", 2024-09-13T06:42:41.743 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.8322000000000001e-05 2024-09-13T06:42:41.743 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.743 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.743 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:41.743 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.669575+0000", 2024-09-13T06:42:41.743 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00029349699999999999 2024-09-13T06:42:41.743 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:41.744 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:41.744 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:41.744 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.744 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.744 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43300 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 446464~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:42:41.744 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589909+0000", 2024-09-13T06:42:41.744 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 140.10061559900001, 2024-09-13T06:42:41.744 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.080339496999999996, 2024-09-13T06:42:41.744 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:41.744 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:41.744 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:41.744 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:41.744 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:41.745 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43300 2024-09-13T06:42:41.745 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.745 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:41.745 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.745 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:41.745 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589909+0000", 2024-09-13T06:42:41.745 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:41.745 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.745 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.745 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:41.745 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589909+0000", 2024-09-13T06:42:41.745 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:41.745 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.746 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.746 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:41.746 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589908+0000", 2024-09-13T06:42:41.746 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:42:41.746 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.746 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.746 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:41.746 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589912+0000", 2024-09-13T06:42:41.746 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.9430000000000002e-06 2024-09-13T06:42:41.746 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.746 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.746 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:41.746 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589920+0000", 2024-09-13T06:42:41.747 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.3860000000000007e-06 2024-09-13T06:42:41.747 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.747 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.747 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:41.747 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589928+0000", 2024-09-13T06:42:41.747 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.3329999999999999e-06 2024-09-13T06:42:41.747 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.747 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.747 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:41.747 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.669651+0000", 2024-09-13T06:42:41.747 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.079723204000000006 2024-09-13T06:42:41.747 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.747 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.748 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:41.748 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.669840+0000", 2024-09-13T06:42:41.748 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000189397 2024-09-13T06:42:41.748 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.748 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.748 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:41.748 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.670248+0000", 2024-09-13T06:42:41.748 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00040811100000000001 2024-09-13T06:42:41.748 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:41.748 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:41.748 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:41.748 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.748 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.748 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43301 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 460800~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:42:41.749 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589934+0000", 2024-09-13T06:42:41.749 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 140.10059092500001, 2024-09-13T06:42:41.749 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.080747474999999999, 2024-09-13T06:42:41.749 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:41.749 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:41.749 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:41.749 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:41.749 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:41.749 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43301 2024-09-13T06:42:41.749 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.749 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:41.749 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.749 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:41.749 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589934+0000", 2024-09-13T06:42:41.750 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:41.750 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.750 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.750 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:41.750 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589934+0000", 2024-09-13T06:42:41.750 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:41.750 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.750 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.750 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:41.750 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589933+0000", 2024-09-13T06:42:41.750 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:41.750 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.750 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.751 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:41.751 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589936+0000", 2024-09-13T06:42:41.751 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.4599999999999999e-06 2024-09-13T06:42:41.751 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.751 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.751 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:41.751 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589945+0000", 2024-09-13T06:42:41.751 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.2430000000000005e-06 2024-09-13T06:42:41.751 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.751 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.751 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:41.751 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589952+0000", 2024-09-13T06:42:41.751 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.3289999999999996e-06 2024-09-13T06:42:41.751 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.752 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.752 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:41.752 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.670280+0000", 2024-09-13T06:42:41.752 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.080328514000000004 2024-09-13T06:42:41.752 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.752 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.752 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:41.752 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.670376+0000", 2024-09-13T06:42:41.752 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.5752000000000001e-05 2024-09-13T06:42:41.752 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.752 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.752 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:41.752 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.670681+0000", 2024-09-13T06:42:41.752 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00030479699999999999 2024-09-13T06:42:41.753 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:41.753 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:41.753 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:41.753 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.753 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.753 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43302 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 475136~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:42:41.753 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589958+0000", 2024-09-13T06:42:41.753 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 140.10056686300001, 2024-09-13T06:42:41.753 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.081402394000000003, 2024-09-13T06:42:41.753 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:41.753 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:41.753 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:41.754 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:41.754 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:41.754 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43302 2024-09-13T06:42:41.754 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.754 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:41.754 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.754 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:41.754 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589958+0000", 2024-09-13T06:42:41.754 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:41.754 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.754 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.754 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:41.754 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589958+0000", 2024-09-13T06:42:41.754 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:41.754 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.755 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.755 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:41.755 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589957+0000", 2024-09-13T06:42:41.755 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:41.755 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.755 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.755 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:41.755 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589960+0000", 2024-09-13T06:42:41.755 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.4939999999999999e-06 2024-09-13T06:42:41.755 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.755 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.755 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:41.755 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589969+0000", 2024-09-13T06:42:41.755 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.3520000000000007e-06 2024-09-13T06:42:41.755 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.756 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.756 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:41.756 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589976+0000", 2024-09-13T06:42:41.756 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.3030000000000002e-06 2024-09-13T06:42:41.756 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.756 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.756 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:41.756 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.670765+0000", 2024-09-13T06:42:41.756 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.080789154000000002 2024-09-13T06:42:41.756 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.756 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.756 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:41.757 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.670960+0000", 2024-09-13T06:42:41.757 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00019464300000000001 2024-09-13T06:42:41.757 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.757 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.757 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:41.757 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.671360+0000", 2024-09-13T06:42:41.757 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00040005200000000002 2024-09-13T06:42:41.757 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:41.757 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:41.757 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:41.757 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.757 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.757 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43303 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 489472~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:42:41.758 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589985+0000", 2024-09-13T06:42:41.758 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 140.10053991500001, 2024-09-13T06:42:41.758 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.082024333000000005, 2024-09-13T06:42:41.758 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:41.758 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:41.758 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:41.758 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:41.758 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:41.758 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43303 2024-09-13T06:42:41.758 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.758 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:41.758 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.758 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:41.758 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589985+0000", 2024-09-13T06:42:41.759 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:41.759 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.759 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.759 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:41.759 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589985+0000", 2024-09-13T06:42:41.759 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:41.759 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.759 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.759 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:41.759 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589984+0000", 2024-09-13T06:42:41.759 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:42:41.759 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.759 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.760 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:41.760 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589987+0000", 2024-09-13T06:42:41.760 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.726e-06 2024-09-13T06:42:41.760 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.760 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.760 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:41.760 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589996+0000", 2024-09-13T06:42:41.760 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.5459999999999992e-06 2024-09-13T06:42:41.760 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.760 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.760 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:41.760 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590003+0000", 2024-09-13T06:42:41.761 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.4229999999999999e-06 2024-09-13T06:42:41.761 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.761 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.761 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:41.761 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.671426+0000", 2024-09-13T06:42:41.761 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.081422704999999998 2024-09-13T06:42:41.761 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.761 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.761 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:41.761 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.671615+0000", 2024-09-13T06:42:41.761 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000188875 2024-09-13T06:42:41.761 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.762 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.762 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:41.762 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.672009+0000", 2024-09-13T06:42:41.762 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000394015 2024-09-13T06:42:41.762 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:41.762 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:41.762 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:41.762 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.762 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.762 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43304 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 503808~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:42:41.762 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.590039+0000", 2024-09-13T06:42:41.762 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 140.10048537, 2024-09-13T06:42:41.762 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.082573880000000002, 2024-09-13T06:42:41.763 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:41.763 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:41.763 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:41.763 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:41.763 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:41.763 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43304 2024-09-13T06:42:41.763 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.763 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:41.763 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.763 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:41.763 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590039+0000", 2024-09-13T06:42:41.763 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:41.763 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.764 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.764 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:41.764 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590039+0000", 2024-09-13T06:42:41.764 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:41.764 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.764 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.764 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:41.764 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590038+0000", 2024-09-13T06:42:41.764 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:42:41.764 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.764 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.764 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:41.765 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590042+0000", 2024-09-13T06:42:41.765 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.9500000000000003e-06 2024-09-13T06:42:41.765 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.765 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.765 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:41.765 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590052+0000", 2024-09-13T06:42:41.765 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.3919999999999992e-06 2024-09-13T06:42:41.765 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.765 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.765 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:41.765 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590059+0000", 2024-09-13T06:42:41.765 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.7970000000000001e-06 2024-09-13T06:42:41.765 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.766 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.766 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:41.766 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.672078+0000", 2024-09-13T06:42:41.766 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.082018778000000001 2024-09-13T06:42:41.766 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.766 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.766 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:41.766 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.672266+0000", 2024-09-13T06:42:41.766 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00018807399999999999 2024-09-13T06:42:41.766 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.766 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.766 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:41.766 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.672613+0000", 2024-09-13T06:42:41.767 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00034677599999999997 2024-09-13T06:42:41.767 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:41.767 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:41.767 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:41.767 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.767 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.767 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43305 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 518144~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:42:41.767 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.590136+0000", 2024-09-13T06:42:41.767 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 140.10038818199999, 2024-09-13T06:42:41.767 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.082988206999999994, 2024-09-13T06:42:41.767 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:41.767 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:41.768 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:41.768 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:41.768 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:41.768 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43305 2024-09-13T06:42:41.768 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.768 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:41.768 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.768 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:41.768 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590136+0000", 2024-09-13T06:42:41.768 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:41.768 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.768 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.769 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:41.769 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590136+0000", 2024-09-13T06:42:41.769 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:41.769 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.769 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.769 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:41.769 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590135+0000", 2024-09-13T06:42:41.769 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:42:41.769 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.769 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.769 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:41.769 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590139+0000", 2024-09-13T06:42:41.769 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.9489999999999998e-06 2024-09-13T06:42:41.770 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.770 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.770 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:41.770 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590148+0000", 2024-09-13T06:42:41.770 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.9830000000000002e-06 2024-09-13T06:42:41.770 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.770 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.770 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:41.770 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590156+0000", 2024-09-13T06:42:41.770 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5229999999999998e-06 2024-09-13T06:42:41.770 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.770 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.770 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:41.770 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.672709+0000", 2024-09-13T06:42:41.771 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.082552886000000006 2024-09-13T06:42:41.771 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.771 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.771 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:41.771 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.672816+0000", 2024-09-13T06:42:41.771 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000107736 2024-09-13T06:42:41.771 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.771 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.771 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:41.771 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.673124+0000", 2024-09-13T06:42:41.771 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00030804900000000002 2024-09-13T06:42:41.771 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:41.772 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:41.772 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:41.772 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.772 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.772 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:66818 3.17 3.50afe697 (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e100)", 2024-09-13T06:42:41.772 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:53.498942+0000", 2024-09-13T06:42:41.772 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 108.191581997, 2024-09-13T06:42:41.772 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.011231284, 2024-09-13T06:42:41.772 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:41.772 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:42:41.772 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:41.772 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:41.773 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:41.773 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 66818 2024-09-13T06:42:41.773 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.773 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:41.773 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.773 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:41.773 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:53.498942+0000", 2024-09-13T06:42:41.773 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:41.773 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.773 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.773 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:41.773 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:53.498942+0000", 2024-09-13T06:42:41.773 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:41.774 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.774 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.774 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:41.774 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:53.498939+0000", 2024-09-13T06:42:41.774 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999967 2024-09-13T06:42:41.774 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.774 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.774 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:41.774 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:53.498954+0000", 2024-09-13T06:42:41.774 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5028000000000001e-05 2024-09-13T06:42:41.774 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.774 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.774 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:41.775 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:53.498986+0000", 2024-09-13T06:42:41.775 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.1993999999999999e-05 2024-09-13T06:42:41.775 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.775 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.775 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:41.775 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:53.499001+0000", 2024-09-13T06:42:41.775 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5166e-05 2024-09-13T06:42:41.775 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.775 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.775 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:41.775 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:53.505097+0000", 2024-09-13T06:42:41.775 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0060955610000000002 2024-09-13T06:42:41.775 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.776 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.776 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:42:41.776 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:53.505108+0000", 2024-09-13T06:42:41.776 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.084e-05 2024-09-13T06:42:41.776 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.776 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.776 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:41.776 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:54.510158+0000", 2024-09-13T06:42:41.776 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0050497549999999 2024-09-13T06:42:41.776 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.776 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.776 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:41.776 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:54.510174+0000", 2024-09-13T06:42:41.777 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6164e-05 2024-09-13T06:42:41.777 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:41.777 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:41.777 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:41.777 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.777 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.777 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:69764 3.2 3:47f10058:::rbd_data.11214956a993.0000000000000004:head [write-same] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e117)", 2024-09-13T06:42:41.777 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:41:11.371147+0000", 2024-09-13T06:42:41.777 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 90.319377686999999, 2024-09-13T06:42:41.777 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.03470167, 2024-09-13T06:42:41.777 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:41.777 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:42:41.777 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:41.778 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:41.778 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:41.778 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 69764 2024-09-13T06:42:41.778 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.778 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:41.778 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.778 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:41.778 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:11.371147+0000", 2024-09-13T06:42:41.778 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:41.778 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.778 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.778 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:41.778 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:11.371147+0000", 2024-09-13T06:42:41.779 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:41.779 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.779 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.779 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:41.779 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:11.371144+0000", 2024-09-13T06:42:41.779 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999967 2024-09-13T06:42:41.779 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.779 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.779 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:41.779 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:11.371161+0000", 2024-09-13T06:42:41.779 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7669e-05 2024-09-13T06:42:41.779 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.779 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.780 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:41.780 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:11.371198+0000", 2024-09-13T06:42:41.780 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.7014000000000002e-05 2024-09-13T06:42:41.780 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.780 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.780 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:41.780 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:11.371216+0000", 2024-09-13T06:42:41.780 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7425e-05 2024-09-13T06:42:41.780 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.780 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.780 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:41.780 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:11.371365+0000", 2024-09-13T06:42:41.780 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000149245 2024-09-13T06:42:41.780 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.781 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.781 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op must wait for map", 2024-09-13T06:42:41.781 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:11.371385+0000", 2024-09-13T06:42:41.781 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.0018999999999999e-05 2024-09-13T06:42:41.781 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.781 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.781 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:41.781 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:11.378406+0000", 2024-09-13T06:42:41.781 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0070207179999999996 2024-09-13T06:42:41.781 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.781 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.781 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:42:41.782 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:11.378429+0000", 2024-09-13T06:42:41.782 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.3453999999999999e-05 2024-09-13T06:42:41.782 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.782 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.782 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:41.782 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:12.405667+0000", 2024-09-13T06:42:41.782 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0272381690000001 2024-09-13T06:42:41.782 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.782 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.782 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:41.782 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:12.405848+0000", 2024-09-13T06:42:41.782 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00018112 2024-09-13T06:42:41.782 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:41.782 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:41.783 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:41.783 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.783 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.783 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:70346 3.16 3:69d35907:::rbd_object_map.11214956a993:head [read 0~36] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e122)", 2024-09-13T06:42:41.783 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:41:16.390917+0000", 2024-09-13T06:42:41.783 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 85.299607635000001, 2024-09-13T06:42:41.783 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.99327479799999996, 2024-09-13T06:42:41.783 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:41.783 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:41.783 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:41.783 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:41.783 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:41.783 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 70346 2024-09-13T06:42:41.783 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.783 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:41.784 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.784 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:41.784 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:16.390917+0000", 2024-09-13T06:42:41.784 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:41.784 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.784 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.784 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:41.784 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:16.390917+0000", 2024-09-13T06:42:41.784 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:41.784 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.784 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.784 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:41.784 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:16.390916+0000", 2024-09-13T06:42:41.785 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999986 2024-09-13T06:42:41.785 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.785 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.785 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:41.785 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:16.390922+0000", 2024-09-13T06:42:41.785 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.0480000000000004e-06 2024-09-13T06:42:41.785 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.785 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.785 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:41.785 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:16.390933+0000", 2024-09-13T06:42:41.785 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1387e-05 2024-09-13T06:42:41.785 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.785 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.786 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:41.786 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:16.390939+0000", 2024-09-13T06:42:41.786 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.8039999999999998e-06 2024-09-13T06:42:41.786 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.786 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.786 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:41.786 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:16.390983+0000", 2024-09-13T06:42:41.786 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.4663000000000003e-05 2024-09-13T06:42:41.786 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.786 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.786 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:42:41.786 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:16.390991+0000", 2024-09-13T06:42:41.786 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.8059999999999995e-06 2024-09-13T06:42:41.786 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.787 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.787 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:41.787 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:17.383624+0000", 2024-09-13T06:42:41.787 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.99263277299999997 2024-09-13T06:42:41.787 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.787 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.787 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:41.787 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:17.383891+0000", 2024-09-13T06:42:41.787 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00026717599999999999 2024-09-13T06:42:41.787 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:41.787 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:41.787 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:41.787 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:17.384192+0000", 2024-09-13T06:42:41.787 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00030047400000000001 2024-09-13T06:42:41.787 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:41.788 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:41.788 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:41.788 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:41.788 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:41.788 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:42:41.788 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-13T06:42:41.790 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-13T06:42:41.790 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:42:41.784+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:42:41.890 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:42:41.888+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:42:41.915 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:42:41.915 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [], 2024-09-13T06:42:41.915 INFO:teuthology.orchestra.run.smithi139.stdout: "num_ops": 0 2024-09-13T06:42:41.915 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:42:41.929 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-13T06:42:41.934 INFO:teuthology.orchestra.run.smithi081.stdout:osd.0: {} 2024-09-13T06:42:41.934 INFO:teuthology.orchestra.run.smithi081.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-13T06:42:41.950 INFO:teuthology.orchestra.run.smithi081.stdout:osd.1: {} 2024-09-13T06:42:41.951 INFO:teuthology.orchestra.run.smithi081.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-13T06:42:41.966 INFO:teuthology.orchestra.run.smithi081.stdout:osd.2: {} 2024-09-13T06:42:41.967 INFO:teuthology.orchestra.run.smithi081.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-13T06:42:41.977 INFO:teuthology.orchestra.run.smithi081.stdout:4934 read 0x4fbbccc thru 0x4fbe242 (0x2577 bytes) 2024-09-13T06:42:41.978 INFO:teuthology.orchestra.run.smithi081.stdout:4935 write 0x8de4de2 thru 0x8de7f5d (0x317c bytes) 2024-09-13T06:42:41.983 INFO:teuthology.orchestra.run.smithi081.stdout:osd.3: {} 2024-09-13T06:42:41.983 INFO:teuthology.orchestra.run.smithi081.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-13T06:42:41.984 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:42:41.984 INFO:teuthology.orchestra.run.smithi081.stdout:4937 write 0x826a50 thru 0x82f74c (0x8cfd bytes) 2024-09-13T06:42:41.986 INFO:teuthology.orchestra.run.smithi081.stdout:4938 punch from 0xd17ba06 to 0xd1891cf, (0xd7c9 bytes) 2024-09-13T06:42:41.986 INFO:teuthology.orchestra.run.smithi081.stdout:4939 writesame 0x6877c43 thru 0x6883831 data_size 0x57(0xbbef bytes) 2024-09-13T06:42:41.989 INFO:teuthology.orchestra.run.smithi081.stdout:4942 writesame 0x9d49442 thru 0x9d53218 data_size 0x1(0x9dd7 bytes) 2024-09-13T06:42:41.990 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:42:41.988+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:42:42.006 INFO:teuthology.orchestra.run.smithi081.stdout:osd.4: {} 2024-09-13T06:42:42.006 INFO:teuthology.orchestra.run.smithi081.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-13T06:42:42.027 INFO:teuthology.orchestra.run.smithi081.stdout:osd.5: {} 2024-09-13T06:42:42.027 INFO:teuthology.orchestra.run.smithi081.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-13T06:42:42.045 INFO:teuthology.orchestra.run.smithi081.stdout:osd.6: {} 2024-09-13T06:42:42.046 INFO:teuthology.orchestra.run.smithi081.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-13T06:42:42.047 INFO:teuthology.orchestra.run.smithi081.stdout:4943 trunc from 0xeae7911 to 0xdd1a7cd 2024-09-13T06:42:42.054 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:42:42.054 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:42:42.057 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:42:42.057 INFO:teuthology.orchestra.run.smithi081.stdout:4945 read 0x788e21 thru 0x794e46 (0xc026 bytes) 2024-09-13T06:42:42.058 INFO:teuthology.orchestra.run.smithi081.stdout:4946 write 0x58d2f20 thru 0x58dd200 (0xa2e1 bytes) 2024-09-13T06:42:42.060 INFO:teuthology.orchestra.run.smithi081.stdout:4948 read 0xcbf0bd8 thru 0xcbf3404 (0x282d bytes) 2024-09-13T06:42:42.060 INFO:teuthology.orchestra.run.smithi081.stdout:4949 read 0x4b1d3b1 thru 0x4b2580d (0x845d bytes) 2024-09-13T06:42:42.061 INFO:teuthology.orchestra.run.smithi081.stdout:4950 write 0x89bd88e thru 0x89c7277 (0x99ea bytes) 2024-09-13T06:42:42.063 INFO:teuthology.orchestra.run.smithi081.stdout:4951 writesame 0xba533c5 thru 0xba57ebf data_size 0x1(0x4afb bytes) 2024-09-13T06:42:42.068 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-13T06:42:42.070 INFO:teuthology.orchestra.run.smithi081.stdout:osd.7: {} 2024-09-13T06:42:42.070 INFO:teuthology.orchestra.run.smithi081.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-13T06:42:42.078 INFO:teuthology.orchestra.run.smithi081.stdout:4952 trunc from 0xdd1a7cd to 0xc2e332d 2024-09-13T06:42:42.088 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:42:42.088 INFO:teuthology.orchestra.run.smithi081.stdout:4954 write 0x2a95753 thru 0x2a9e49f (0x8d4d bytes) 2024-09-13T06:42:42.099 INFO:teuthology.orchestra.run.smithi081.stdout:4956 trunc from 0xc2e332d to 0x5a03cd2 2024-09-13T06:42:42.108 INFO:teuthology.orchestra.run.smithi081.stdout:4959 read 0x24fcdae thru 0x24fee15 (0x2068 bytes) 2024-09-13T06:42:42.112 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-13T06:42:42.109+0000 7fa8bb18e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 36790) UID: 0 2024-09-13T06:42:42.124 INFO:teuthology.orchestra.run.smithi081.stdout:4960 write 0xbedfcf4 thru 0xbee5446 (0x5753 bytes) 2024-09-13T06:42:42.126 INFO:teuthology.orchestra.run.smithi081.stdout:4961 read 0x18379bc thru 0x1845819 (0xde5e bytes) 2024-09-13T06:42:42.126 INFO:teuthology.orchestra.run.smithi081.stdout:4962 write 0x98b10d5 thru 0x98b62c3 (0x51ef bytes) 2024-09-13T06:42:42.128 INFO:teuthology.orchestra.run.smithi081.stdout:4963 write 0x267ef6 thru 0x274516 (0xc621 bytes) 2024-09-13T06:42:42.132 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:42:42.132 INFO:teuthology.orchestra.run.smithi081.stdout:4966 read 0x8e2608f thru 0x8e27caf (0x1c21 bytes) 2024-09-13T06:42:42.132 INFO:teuthology.orchestra.run.smithi081.stdout:4968 write 0x5dc1612 thru 0x5dd122e (0xfc1d bytes) 2024-09-13T06:42:42.135 INFO:teuthology.orchestra.run.smithi081.stdout:4969 read 0xa9a8cb0 thru 0xa9a9a63 (0xdb4 bytes) 2024-09-13T06:42:42.136 INFO:teuthology.orchestra.run.smithi081.stdout:4971 punch from 0x9b57d21 to 0x9b62752, (0xaa31 bytes) 2024-09-13T06:42:42.136 INFO:teuthology.orchestra.run.smithi081.stdout:4972 read 0xd8805b thru 0xd945b7 (0xc55d bytes) 2024-09-13T06:42:42.136 INFO:teuthology.orchestra.run.smithi081.stdout:4974 punch from 0x23b24b to 0x241c5c, (0x6a11 bytes) 2024-09-13T06:42:42.137 INFO:teuthology.orchestra.run.smithi081.stdout:4975 writesame 0x6224da thru 0x62d12e data_size 0x1(0xac55 bytes) 2024-09-13T06:42:42.179 INFO:teuthology.orchestra.run.smithi081.stdout:4976 write 0xc9f2ac1 thru 0xca01455 (0xe995 bytes) 2024-09-13T06:42:42.182 INFO:teuthology.orchestra.run.smithi081.stdout:4977 punch from 0xa014f87 to 0xa01eac0, (0x9b39 bytes) 2024-09-13T06:42:42.189 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:42:42.190 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:42:42.192 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:42:42.188+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:42:42.195 INFO:teuthology.orchestra.run.smithi081.stdout:4978 writesame 0xd4bc296 thru 0xd4c598d data_size 0x4(0x96f8 bytes) 2024-09-13T06:42:42.198 INFO:teuthology.orchestra.run.smithi081.stdout:4981 writesame 0xb9aca7c thru 0xb9aef51 data_size 0x2e(0x24d6 bytes) 2024-09-13T06:42:42.201 INFO:teuthology.orchestra.run.smithi081.stdout:4985 read 0x616acb8 thru 0x616e019 (0x3362 bytes) 2024-09-13T06:42:42.202 INFO:teuthology.orchestra.run.smithi081.stdout:4988 read 0x2f1a116 thru 0x2f20cab (0x6b96 bytes) 2024-09-13T06:42:42.203 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:42:42.203 INFO:teuthology.orchestra.run.smithi081.stdout:4990 write 0x80baf41 thru 0x80c1450 (0x6510 bytes) 2024-09-13T06:42:42.205 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-13T06:42:42.206 INFO:teuthology.orchestra.run.smithi081.stdout:4991 read 0xe8eed5 thru 0xe99de7 (0xaf13 bytes) 2024-09-13T06:42:42.208 INFO:teuthology.orchestra.run.smithi081.stdout:4992 punch from 0x4c0e340 to 0x4c184ac, (0xa16c bytes) 2024-09-13T06:42:42.208 INFO:teuthology.orchestra.run.smithi081.stdout:4995 writesame 0x76fde4b thru 0x77013bb data_size 0x1(0x3571 bytes) 2024-09-13T06:42:42.222 INFO:teuthology.orchestra.run.smithi081.stdout:4997 read 0xafbf131 thru 0xafc5469 (0x6339 bytes) 2024-09-13T06:42:42.223 INFO:teuthology.orchestra.run.smithi081.stdout:5000 punch from 0x4d79125 to 0x4d86ba6, (0xda81 bytes) 2024-09-13T06:42:42.223 INFO:teuthology.orchestra.run.smithi081.stdout:5002 writesame 0x7a888da thru 0x7a8ed3b data_size 0x3(0x6462 bytes) 2024-09-13T06:42:42.230 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:42:42.237 INFO:teuthology.orchestra.run.smithi081.stdout:5004 trunc from 0xd4c598e to 0xaabe8ed 2024-09-13T06:42:42.255 INFO:teuthology.orchestra.run.smithi081.stdout:5005 read 0x8bb5003 thru 0x8bbcdc4 (0x7dc2 bytes) 2024-09-13T06:42:42.256 INFO:teuthology.orchestra.run.smithi081.stdout:5006 writesame 0x53b54aa thru 0x53bcfb3 data_size 0x1(0x7b0a bytes) 2024-09-13T06:42:42.280 INFO:teuthology.orchestra.run.smithi081.stdout:5007 writesame 0x222846c thru 0x2229149 data_size 0x1b(0xcde bytes) 2024-09-13T06:42:42.284 INFO:teuthology.orchestra.run.smithi081.stdout:5009 punch from 0x8b9f12 to 0x8c0681, (0x676f bytes) 2024-09-13T06:42:42.284 INFO:teuthology.orchestra.run.smithi081.stdout:5010 punch from 0x2dd4334 to 0x2dd4a28, (0x6f4 bytes) 2024-09-13T06:42:42.284 INFO:teuthology.orchestra.run.smithi081.stdout:5011 punch from 0x297c375 to 0x2982f8e, (0x6c19 bytes) 2024-09-13T06:42:42.284 INFO:teuthology.orchestra.run.smithi081.stdout:5012 punch from 0x6a22d73 to 0x6a26c3f, (0x3ecc bytes) 2024-09-13T06:42:42.285 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:42:42.285 INFO:teuthology.orchestra.run.smithi081.stdout:5015 punch from 0x1457012 to 0x1461e5a, (0xae48 bytes) 2024-09-13T06:42:42.285 INFO:teuthology.orchestra.run.smithi081.stdout:5017 trunc from 0xaabe8ed to 0xaa62a2d 2024-09-13T06:42:42.296 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:42:42.289+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:42:42.297 INFO:teuthology.orchestra.run.smithi081.stdout:5018 read 0x2136081 thru 0x214221e (0xc19e bytes) 2024-09-13T06:42:42.297 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:42:42.322 INFO:teuthology.orchestra.run.smithi081.stdout:5020 trunc from 0xaa62a2d to 0x16ff54b 2024-09-13T06:42:42.360 INFO:teuthology.orchestra.run.smithi081.stdout:5021 trunc from 0x16ff54b to 0x7ed4c29 2024-09-13T06:42:42.374 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:42:42.374 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:42:42.388 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-13T06:42:42.388 INFO:teuthology.orchestra.run.smithi081.stdout:5022 trunc from 0x7ed4c29 to 0x250cf64 2024-09-13T06:42:42.394 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:42:42.392+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:42:42.410 INFO:teuthology.orchestra.run.smithi081.stdout:5023 punch from 0x11b61e9 to 0x11c1d86, (0xbb9d bytes) 2024-09-13T06:42:42.430 INFO:teuthology.orchestra.run.smithi081.stdout:5024 write 0x54cfbf3 thru 0x54def16 (0xf324 bytes) 2024-09-13T06:42:42.450 INFO:teuthology.orchestra.run.smithi081.stdout:5027 trunc from 0x54def17 to 0xb7bda54 2024-09-13T06:42:42.464 INFO:teuthology.orchestra.run.smithi081.stdout:5028 read 0x79f15cd thru 0x79f54cb (0x3eff bytes) 2024-09-13T06:42:42.465 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:42:42.465 INFO:teuthology.orchestra.run.smithi081.stdout:5030 writesame 0xaa107e0 thru 0xaa1d4ed data_size 0x1a(0xcd0e bytes) 2024-09-13T06:42:42.489 INFO:teuthology.orchestra.run.smithi081.stdout:5031 write 0xdadd103 thru 0xdadeb53 (0x1a51 bytes) 2024-09-13T06:42:42.492 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:42:42.492 INFO:teuthology.orchestra.run.smithi081.stdout:5033 write 0x76a18cb thru 0x76a1fd8 (0x70e bytes) 2024-09-13T06:42:42.495 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:42:42.492+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:42:42.495 INFO:teuthology.orchestra.run.smithi081.stdout:5035 read 0x9068299 thru 0x906f3e4 (0x714c bytes) 2024-09-13T06:42:42.496 INFO:teuthology.orchestra.run.smithi081.stdout:5036 punch from 0xc76107e to 0xc768a55, (0x79d7 bytes) 2024-09-13T06:42:42.496 INFO:teuthology.orchestra.run.smithi081.stdout:5039 writesame 0x504909a thru 0x50589c7 data_size 0x5(0xf92e bytes) 2024-09-13T06:42:42.516 INFO:teuthology.orchestra.run.smithi081.stdout:5040 read 0xcde4a6a thru 0xcde9c4e (0x51e5 bytes) 2024-09-13T06:42:42.517 INFO:teuthology.orchestra.run.smithi081.stdout:5041 punch from 0x5ba6c7d to 0x5bb503f, (0xe3c2 bytes) 2024-09-13T06:42:42.517 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:42:42.522 INFO:teuthology.orchestra.run.smithi081.stdout:5043 trunc from 0xdadeb54 to 0xbfc26cf 2024-09-13T06:42:42.542 INFO:teuthology.orchestra.run.smithi081.stdout:5044 read 0x3b1a8b8 thru 0x3b1ce3f (0x2588 bytes) 2024-09-13T06:42:42.549 INFO:teuthology.orchestra.run.smithi081.stdout:5045 trunc from 0xbfc26cf to 0x9ca0d14 2024-09-13T06:42:42.559 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:42:42.560 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:42:42.572 INFO:teuthology.orchestra.run.smithi081.stdout:5046 trunc from 0x9ca0d14 to 0x950c862 2024-09-13T06:42:42.574 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-13T06:42:42.592 INFO:teuthology.orchestra.run.smithi081.stdout:5047 read 0xfc4250 thru 0xfce0d5 (0x9e86 bytes) 2024-09-13T06:42:42.610 INFO:teuthology.orchestra.run.smithi081.stdout:5050 write 0xb197785 thru 0xb1a5964 (0xe1e0 bytes) 2024-09-13T06:42:42.614 INFO:teuthology.orchestra.run.smithi081.stdout:5051 read 0x1cf3df1 thru 0x1cfa1b0 (0x63c0 bytes) 2024-09-13T06:42:42.615 INFO:teuthology.orchestra.run.smithi081.stdout:5053 writesame 0x62ca86b thru 0x62d3b8b data_size 0x5d(0x9321 bytes) 2024-09-13T06:42:42.620 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-13T06:42:42.617+0000 7fa8bb18e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 36790) UID: 0 2024-09-13T06:42:42.632 INFO:teuthology.orchestra.run.smithi081.stdout:5054 write 0xbb2e6e7 thru 0xbb346fc (0x6016 bytes) 2024-09-13T06:42:42.636 INFO:teuthology.orchestra.run.smithi081.stdout:5056 writesame 0x494135 thru 0x49dded data_size 0x35(0x9cb9 bytes) 2024-09-13T06:42:42.648 INFO:teuthology.orchestra.run.smithi081.stdout:5057 trunc from 0xbb346fd to 0xedca171 2024-09-13T06:42:42.661 INFO:teuthology.orchestra.run.smithi081.stdout:5058 write 0x61a36de thru 0x61a7294 (0x3bb7 bytes) 2024-09-13T06:42:42.664 INFO:teuthology.orchestra.run.smithi081.stdout:5059 punch from 0x1c05758 to 0x1c0faee, (0xa396 bytes) 2024-09-13T06:42:42.693 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:42:42.693 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:42:42.697 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:42:42.693+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:42:42.704 INFO:teuthology.orchestra.run.smithi081.stdout:5061 trunc from 0xedca171 to 0xb34526 2024-09-13T06:42:42.709 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-13T06:42:42.721 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:42:42.745 INFO:teuthology.orchestra.run.smithi081.stdout:5063 write 0x749de7d thru 0x74a9880 (0xba04 bytes) 2024-09-13T06:42:42.747 INFO:teuthology.orchestra.run.smithi081.stdout:5064 write 0x2906601 thru 0x291523c (0xec3c bytes) 2024-09-13T06:42:42.756 INFO:teuthology.orchestra.run.smithi081.stdout:5065 trunc from 0x74a9881 to 0x9291be1 2024-09-13T06:42:42.784 INFO:teuthology.orchestra.run.smithi081.stdout:5066 write 0xd2af5a6 thru 0xd2b77e7 (0x8242 bytes) 2024-09-13T06:42:42.786 INFO:teuthology.orchestra.run.smithi081.stdout:5067 write 0x8f8fe02 thru 0x8f9d65f (0xd85e bytes) 2024-09-13T06:42:42.788 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:42:42.789 INFO:teuthology.orchestra.run.smithi081.stdout:5069 punch from 0x78016c8 to 0x780bc0d, (0xa545 bytes) 2024-09-13T06:42:42.795 INFO:teuthology.orchestra.run.smithi081.stdout:5070 trunc from 0xd2b77e8 to 0xa540699 2024-09-13T06:42:42.798 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:42:42.793+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:42:42.806 INFO:teuthology.orchestra.run.smithi081.stdout:5071 punch from 0x273365c to 0x2739da7, (0x674b bytes) 2024-09-13T06:42:42.806 INFO:teuthology.orchestra.run.smithi081.stdout:5072 read 0x6c8e4b7 thru 0x6c90142 (0x1c8c bytes) 2024-09-13T06:42:42.807 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:42:42.807 INFO:teuthology.orchestra.run.smithi081.stdout:5074 read 0x8bfd0ad thru 0x8c07ffe (0xaf52 bytes) 2024-09-13T06:42:42.808 INFO:teuthology.orchestra.run.smithi081.stdout:5075 punch from 0x788265c to 0x788ad00, (0x86a4 bytes) 2024-09-13T06:42:42.824 INFO:teuthology.orchestra.run.smithi081.stdout:5076 write 0xe49c3ee thru 0xe4a90c1 (0xccd4 bytes) 2024-09-13T06:42:42.827 INFO:teuthology.orchestra.run.smithi081.stdout:5077 write 0xb7ce1a7 thru 0xb7db4d9 (0xd333 bytes) 2024-09-13T06:42:42.831 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:42:42.831 INFO:teuthology.orchestra.run.smithi081.stdout:5079 read 0xb1eb586 thru 0xb1f71a6 (0xbc21 bytes) 2024-09-13T06:42:42.854 INFO:teuthology.orchestra.run.smithi081.stdout:5080 trunc from 0xe4a90c2 to 0x11b30a5 2024-09-13T06:42:42.872 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:42:42.873 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:42:42.876 INFO:teuthology.orchestra.run.smithi081.stdout:5081 trunc from 0x11b30a5 to 0x43c3dad 2024-09-13T06:42:42.886 INFO:teuthology.orchestra.run.smithi081.stdout:5082 punch from 0x4e3d24 to 0x4f0ed1, (0xd1ad bytes) 2024-09-13T06:42:42.895 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-13T06:42:42.899 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:42:42.893+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:42:42.900 INFO:teuthology.orchestra.run.smithi081.stdout:5083 write 0x846086b thru 0x8466e3b (0x65d1 bytes) 2024-09-13T06:42:42.917 INFO:teuthology.orchestra.run.smithi081.stdout:5084 writesame 0xdab8f10 thru 0xdac8e04 data_size 0x1(0xfef5 bytes) 2024-09-13T06:42:42.918 INFO:teuthology.orchestra.run.smithi081.stdout:5086 write 0x1965173 thru 0x197177e (0xc60c bytes) 2024-09-13T06:42:42.920 INFO:teuthology.orchestra.run.smithi081.stdout:5088 write 0x1735de3 thru 0x1737ea1 (0x20bf bytes) 2024-09-13T06:42:42.923 INFO:teuthology.orchestra.run.smithi081.stdout:5090 read 0x423b256 thru 0x424203c (0x6de7 bytes) 2024-09-13T06:42:42.924 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:42:42.924 INFO:teuthology.orchestra.run.smithi081.stdout:5093 write 0x56866e9 thru 0x5687817 (0x112f bytes) 2024-09-13T06:42:42.925 INFO:teuthology.orchestra.run.smithi081.stdout:5096 write 0x812cefa thru 0x812d8b3 (0x9ba bytes) 2024-09-13T06:42:42.934 INFO:teuthology.orchestra.run.smithi081.stdout:5097 trunc from 0xdac8e05 to 0x95a995f 2024-09-13T06:42:42.945 INFO:teuthology.orchestra.run.smithi081.stdout:5098 read 0x7bdd10 thru 0x7bf598 (0x1889 bytes) 2024-09-13T06:42:42.946 INFO:teuthology.orchestra.run.smithi081.stdout:5099 punch from 0x867164b to 0x867169a, (0x4f bytes) 2024-09-13T06:42:42.959 INFO:teuthology.orchestra.run.smithi081.stdout:5100 writesame 0xce9aef2 thru 0xcea6ca4 data_size 0x1(0xbdb3 bytes) 2024-09-13T06:42:42.961 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:42:42.961 INFO:teuthology.orchestra.run.smithi081.stdout:5104 writesame 0x5e26f4d thru 0x5e27ad8 data_size 0x2(0xb8c bytes) 2024-09-13T06:42:42.972 INFO:teuthology.orchestra.run.smithi081.stdout:5105 write 0xeac7dee thru 0xeacd70a (0x591d bytes) 2024-09-13T06:42:42.975 INFO:teuthology.orchestra.run.smithi081.stdout:5106 read 0x32339b3 thru 0x323c94d (0x8f9b bytes) 2024-09-13T06:42:42.976 INFO:teuthology.orchestra.run.smithi081.stdout:5107 write 0x41e7abc thru 0x41ebe8c (0x43d1 bytes) 2024-09-13T06:42:42.977 INFO:teuthology.orchestra.run.smithi081.stdout:5108 write 0x1539e48 thru 0x153d8cc (0x3a85 bytes) 2024-09-13T06:42:42.981 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:42:42.996 INFO:teuthology.orchestra.run.smithi081.stdout:5110 trunc from 0xeacd70b to 0x56fc1b5 2024-09-13T06:42:43.000 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-13T06:42:42.997+0000 7fa8bb18e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 36790) UID: 0 2024-09-13T06:42:43.009 INFO:teuthology.orchestra.run.smithi081.stdout:5111 write 0x273186c thru 0x273c97c (0xb111 bytes) 2024-09-13T06:42:43.012 INFO:teuthology.orchestra.run.smithi081.stdout:5113 writesame 0x430921f thru 0x430f7c4 data_size 0x3(0x65a6 bytes) 2024-09-13T06:42:43.036 INFO:teuthology.orchestra.run.smithi081.stdout:5114 write 0x6f30a43 thru 0x6f39245 (0x8803 bytes) 2024-09-13T06:42:43.039 INFO:teuthology.orchestra.run.smithi081.stdout:5116 write 0x57948d9 thru 0x579758f (0x2cb7 bytes) 2024-09-13T06:42:43.041 INFO:teuthology.orchestra.run.smithi081.stdout:5117 punch from 0x6dc7afb to 0x6dcba4d, (0x3f52 bytes) 2024-09-13T06:42:43.046 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:42:43.046 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:42:43.051 INFO:teuthology.orchestra.run.smithi081.stdout:5118 trunc from 0x6f39246 to 0xafbbbf 2024-09-13T06:42:43.068 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-13T06:42:43.082 INFO:teuthology.orchestra.run.smithi081.stdout:5119 trunc from 0xafbbbf to 0x9fa1b1f 2024-09-13T06:42:43.097 INFO:teuthology.orchestra.run.smithi081.stdout:5121 write 0xafc4355 thru 0xafc5ecc (0x1b78 bytes) 2024-09-13T06:42:43.100 INFO:teuthology.orchestra.run.smithi081.stdout:5122 read 0x2c68d95 thru 0x2c701b8 (0x7424 bytes) 2024-09-13T06:42:43.100 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:42:43.097+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:42:43.110 INFO:teuthology.orchestra.run.smithi081.stdout:5123 trunc from 0xafc5ecd to 0x4d0c2a4 2024-09-13T06:42:43.121 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:42:43.121 INFO:teuthology.orchestra.run.smithi081.stdout:5126 punch from 0x3fcf39d to 0x3fd4a0d, (0x5670 bytes) 2024-09-13T06:42:43.121 INFO:teuthology.orchestra.run.smithi081.stdout:5128 write 0x1e3bfcc thru 0x1e3fa55 (0x3a8a bytes) 2024-09-13T06:42:43.128 INFO:teuthology.orchestra.run.smithi081.stdout:5129 trunc from 0x4d0c2a4 to 0x29f80e8 2024-09-13T06:42:43.156 INFO:teuthology.orchestra.run.smithi081.stdout:5131 writesame 0xa44ef3f thru 0xa454ca4 data_size 0xf(0x5d66 bytes) 2024-09-13T06:42:43.171 INFO:teuthology.orchestra.run.smithi081.stdout:5132 writesame 0xdaecb2b thru 0xdaed0a5 data_size 0x1(0x57b bytes) 2024-09-13T06:42:43.173 INFO:teuthology.orchestra.run.smithi081.stdout:5134 trunc from 0xdaed0a6 to 0xdade9c5 2024-09-13T06:42:43.181 INFO:teuthology.orchestra.run.smithi081.stdout:5135 read 0x882165 thru 0x889bae (0x7a4a bytes) 2024-09-13T06:42:43.181 INFO:teuthology.orchestra.run.smithi081.stdout:5137 read 0xc9baf3c thru 0xc9c6692 (0xb757 bytes) 2024-09-13T06:42:43.181 INFO:teuthology.orchestra.run.smithi081.stdout:5139 write 0xa466086 thru 0xa470c28 (0xaba3 bytes) 2024-09-13T06:42:43.184 INFO:teuthology.orchestra.run.smithi081.stdout:5140 read 0xbcfcd3 thru 0xbd2c23 (0x2f51 bytes) 2024-09-13T06:42:43.195 INFO:teuthology.orchestra.run.smithi081.stdout:5142 trunc from 0xdade9c5 to 0x60fd996 2024-09-13T06:42:43.201 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:42:43.196+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:42:43.206 INFO:teuthology.orchestra.run.smithi081.stdout:5143 punch from 0x3bea1a8 to 0x3bea74b, (0x5a3 bytes) 2024-09-13T06:42:43.206 INFO:teuthology.orchestra.run.smithi081.stdout:5146 punch from 0x34730c0 to 0x3482843, (0xf783 bytes) 2024-09-13T06:42:43.206 INFO:teuthology.orchestra.run.smithi081.stdout:5147 punch from 0x84542 to 0x9441c, (0xfeda bytes) 2024-09-13T06:42:43.206 INFO:teuthology.orchestra.run.smithi081.stdout:5152 read 0x247ed6c thru 0x248e84f (0xfae4 bytes) 2024-09-13T06:42:43.206 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:42:43.207 INFO:teuthology.orchestra.run.smithi081.stdout:5154 punch from 0x60db963 to 0x60eb0aa, (0xf747 bytes) 2024-09-13T06:42:43.208 INFO:teuthology.orchestra.run.smithi081.stdout:5155 trunc from 0x60fd996 to 0x4d68f2e 2024-09-13T06:42:43.220 INFO:teuthology.orchestra.run.smithi081.stdout:5157 read 0xc6a7d3 thru 0xc73ad9 (0x9307 bytes) 2024-09-13T06:42:43.225 INFO:teuthology.orchestra.run.smithi081.stdout:5158 trunc from 0x4d68f2e to 0x2106f39 2024-09-13T06:42:43.231 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:42:43.231 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:42:43.238 INFO:teuthology.orchestra.run.smithi081.stdout:5159 read 0x176a10 thru 0x17f8ae (0x8e9f bytes) 2024-09-13T06:42:43.249 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-13T06:42:43.251 INFO:teuthology.orchestra.run.smithi081.stdout:5160 write 0x377f783 thru 0x3784361 (0x4bdf bytes) 2024-09-13T06:42:43.253 INFO:teuthology.orchestra.run.smithi081.stdout:5161 punch from 0xb3164d to 0xb3dc07, (0xc5ba bytes) 2024-09-13T06:42:43.276 INFO:teuthology.orchestra.run.smithi081.stdout:5163 writesame 0xc763407 thru 0xc769b56 data_size 0x2(0x6750 bytes) 2024-09-13T06:42:43.285 INFO:teuthology.orchestra.run.smithi081.stdout:5164 write 0xcb6e24b thru 0xcb76c3d (0x89f3 bytes) 2024-09-13T06:42:43.289 INFO:teuthology.orchestra.run.smithi081.stdout:5166 read 0x3715a3b thru 0x3715ad0 (0x96 bytes) 2024-09-13T06:42:43.289 INFO:teuthology.orchestra.run.smithi081.stdout:5167 read 0x4293b1d thru 0x42a1d85 (0xe269 bytes) 2024-09-13T06:42:43.290 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:42:43.290 INFO:teuthology.orchestra.run.smithi081.stdout:5169 trunc from 0xcb76c3e to 0xc2dbcae 2024-09-13T06:42:43.301 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:42:43.296+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:42:43.302 INFO:teuthology.orchestra.run.smithi081.stdout:5172 read 0x769e38f thru 0x76a3ce9 (0x595b bytes) 2024-09-13T06:42:43.303 INFO:teuthology.orchestra.run.smithi081.stdout:5173 write 0x5ce75d4 thru 0x5ceed07 (0x7734 bytes) 2024-09-13T06:42:43.305 INFO:teuthology.orchestra.run.smithi081.stdout:5177 writesame 0xbf8ad12 thru 0xbf97df0 data_size 0x1(0xd0df bytes) 2024-09-13T06:42:43.351 INFO:teuthology.orchestra.run.smithi081.stdout:5178 trunc from 0xc2dbcae to 0x5d96bfa 2024-09-13T06:42:43.363 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:42:43.363 INFO:teuthology.orchestra.run.smithi081.stdout:5181 read 0x223a9ea thru 0x22468d2 (0xbee9 bytes) 2024-09-13T06:42:43.386 INFO:teuthology.orchestra.run.smithi081.stdout:5182 writesame 0xd3520b4 thru 0xd360458 data_size 0x1(0xe3a5 bytes) 2024-09-13T06:42:43.387 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:42:43.387 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:42:43.389 INFO:teuthology.orchestra.run.smithi081.stdout:5183 punch from 0xc49ad43 to 0xc4a7f40, (0xd1fd bytes) 2024-09-13T06:42:43.389 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:42:43.389 INFO:teuthology.orchestra.run.smithi081.stdout:5185 read 0x9c94013 thru 0x9c9fe0b (0xbdf9 bytes) 2024-09-13T06:42:43.389 INFO:teuthology.orchestra.run.smithi081.stdout:5186 read 0x6433990 thru 0x643b94c (0x7fbd bytes) 2024-09-13T06:42:43.389 INFO:teuthology.orchestra.run.smithi081.stdout:5187 write 0x38e62a5 thru 0x38ee9ef (0x874b bytes) 2024-09-13T06:42:43.392 INFO:teuthology.orchestra.run.smithi081.stdout:5189 read 0x90edc47 thru 0x90f4e03 (0x71bd bytes) 2024-09-13T06:42:43.392 INFO:teuthology.orchestra.run.smithi081.stdout:5190 write 0x25214ff thru 0x253034d (0xee4f bytes) 2024-09-13T06:42:43.403 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:42:43.400+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:42:43.405 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-13T06:42:43.416 INFO:teuthology.orchestra.run.smithi081.stdout:5191 trunc from 0xd360459 to 0x2473be1 2024-09-13T06:42:43.426 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-13T06:42:43.429 INFO:teuthology.orchestra.run.smithi081.stdout:5192 punch from 0xce0103 to 0xcea892, (0xa78f bytes) 2024-09-13T06:42:43.429 INFO:teuthology.orchestra.run.smithi081.stdout:5193 read 0x9a8afc thru 0x9a98a9 (0xdae bytes) 2024-09-13T06:42:43.429 INFO:teuthology.orchestra.run.smithi081.stdout:5194 punch from 0xd91c20 to 0xda14ba, (0xf89a bytes) 2024-09-13T06:42:43.438 INFO:teuthology.orchestra.run.smithi081.stdout:5197 writesame 0x38968ba thru 0x38a6760 data_size 0x43(0xfea7 bytes) 2024-09-13T06:42:43.440 INFO:teuthology.orchestra.run.smithi081.stdout:5198 read 0x6411b6 thru 0x644f4b (0x3d96 bytes) 2024-09-13T06:42:43.452 INFO:teuthology.orchestra.run.smithi081.stdout:5199 writesame 0x607e61b thru 0x608332f data_size 0x1(0x4d15 bytes) 2024-09-13T06:42:43.465 INFO:teuthology.orchestra.run.smithi081.stdout:5200 write 0x7b956e4 thru 0x7b9b0bc (0x59d9 bytes) 2024-09-13T06:42:43.467 INFO:teuthology.orchestra.run.smithi081.stdout:5201 read 0x4ddf96f thru 0x4de6c1e (0x72b0 bytes) 2024-09-13T06:42:43.468 INFO:teuthology.orchestra.run.smithi081.stdout:5202 write 0x4dde731 thru 0x4de5b49 (0x7419 bytes) 2024-09-13T06:42:43.481 INFO:teuthology.orchestra.run.smithi081.stdout:5203 write 0x9eae13f thru 0x9ebb483 (0xd345 bytes) 2024-09-13T06:42:43.483 INFO:teuthology.orchestra.run.smithi081.stdout:5204 read 0xebb06e thru 0xeca0d8 (0xf06b bytes) 2024-09-13T06:42:43.484 INFO:teuthology.orchestra.run.smithi081.stdout:5205 read 0x29f3d81 thru 0x2a02245 (0xe4c5 bytes) 2024-09-13T06:42:43.485 INFO:teuthology.orchestra.run.smithi081.stdout:5206 write 0x72fd322 thru 0x7308832 (0xb511 bytes) 2024-09-13T06:42:43.488 INFO:teuthology.orchestra.run.smithi081.stdout:5208 read 0x42e44c3 thru 0x42e560c (0x114a bytes) 2024-09-13T06:42:43.489 INFO:teuthology.orchestra.run.smithi081.stdout:5209 read 0xd4401a thru 0xd459fb (0x19e2 bytes) 2024-09-13T06:42:43.489 INFO:teuthology.orchestra.run.smithi081.stdout:5210 read 0x4136729 thru 0x4144ade (0xe3b6 bytes) 2024-09-13T06:42:43.490 INFO:teuthology.orchestra.run.smithi081.stdout:5212 write 0x5acabec thru 0x5ada007 (0xf41c bytes) 2024-09-13T06:42:43.493 INFO:teuthology.orchestra.run.smithi081.stdout:5213 read 0x9b241bf thru 0x9b2f37e (0xb1c0 bytes) 2024-09-13T06:42:43.504 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:42:43.500+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:42:43.504 INFO:teuthology.orchestra.run.smithi081.stdout:5214 writesame 0xc46105f thru 0xc4688e5 data_size 0x79(0x7887 bytes) 2024-09-13T06:42:43.517 INFO:teuthology.orchestra.run.smithi081.stdout:5217 write 0xe7f2d14 thru 0xe7f3be3 (0xed0 bytes) 2024-09-13T06:42:43.519 INFO:teuthology.orchestra.run.smithi081.stdout:5219 read 0x4ae1a1d thru 0x4ae8d05 (0x72e9 bytes) 2024-09-13T06:42:43.520 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:42:43.523 INFO:teuthology.orchestra.run.smithi081.stdout:5222 trunc from 0xe7f3be4 to 0xc3673d8 2024-09-13T06:42:43.536 INFO:teuthology.orchestra.run.smithi081.stdout:5223 read 0x1a05f14 thru 0x1a0dc3e (0x7d2b bytes) 2024-09-13T06:42:43.537 INFO:teuthology.orchestra.run.smithi081.stdout:5224 punch from 0x5a52354 to 0x5a5706f, (0x4d1b bytes) 2024-09-13T06:42:43.555 INFO:teuthology.orchestra.run.smithi081.stdout:5225 trunc from 0xc3673d8 to 0x57d5d2 2024-09-13T06:42:43.558 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:42:43.558 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:42:43.568 INFO:teuthology.orchestra.run.smithi081.stdout:5227 punch from 0x1777c2 to 0x179ba0, (0x23de bytes) 2024-09-13T06:42:43.568 INFO:teuthology.orchestra.run.smithi081.stdout:5229 read 0x17c818 thru 0x188beb (0xc3d4 bytes) 2024-09-13T06:42:43.569 INFO:teuthology.orchestra.run.smithi081.stdout:5230 punch from 0x3584b3 to 0x36119c, (0x8ce9 bytes) 2024-09-13T06:42:43.580 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-13T06:42:43.593 INFO:teuthology.orchestra.run.smithi081.stdout:5232 write 0xc84e36a thru 0xc8518bc (0x3553 bytes) 2024-09-13T06:42:43.597 INFO:teuthology.orchestra.run.smithi081.stdout:5233 trunc from 0xc8518bd to 0xcebab33 2024-09-13T06:42:43.603 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:42:43.604 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:42:43.601+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:42:43.612 INFO:teuthology.orchestra.run.smithi081.stdout:5237 trunc from 0xcebab33 to 0x6985faa 2024-09-13T06:42:43.623 INFO:teuthology.orchestra.run.smithi081.stdout:5239 read 0x558c217 thru 0x558f374 (0x315e bytes) 2024-09-13T06:42:43.638 INFO:teuthology.orchestra.run.smithi081.stdout:5240 writesame 0xbd5fa2e thru 0xbd6e5e3 data_size 0xb2(0xebb6 bytes) 2024-09-13T06:42:43.640 INFO:teuthology.orchestra.run.smithi081.stdout:5241 write 0xbae22b8 thru 0xbaed3f1 (0xb13a bytes) 2024-09-13T06:42:43.642 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:42:43.651 INFO:teuthology.orchestra.run.smithi081.stdout:5243 writesame 0xd64422e thru 0xd652296 data_size 0x1d(0xe069 bytes) 2024-09-13T06:42:43.654 INFO:teuthology.orchestra.run.smithi081.stdout:5248 read 0x88ccc8e thru 0x88dacef (0xe062 bytes) 2024-09-13T06:42:43.654 INFO:teuthology.orchestra.run.smithi081.stdout:5249 read 0x5bc892c thru 0x5bcfe72 (0x7547 bytes) 2024-09-13T06:42:43.654 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:42:43.654 INFO:teuthology.orchestra.run.smithi081.stdout:5251 read 0x7693b0e thru 0x76a2714 (0xec07 bytes) 2024-09-13T06:42:43.655 INFO:teuthology.orchestra.run.smithi081.stdout:5252 write 0x5725e61 thru 0x572995f (0x3aff bytes) 2024-09-13T06:42:43.659 INFO:teuthology.orchestra.run.smithi081.stdout:5254 read 0x765ba0c thru 0x766aa94 (0xf089 bytes) 2024-09-13T06:42:43.659 INFO:teuthology.orchestra.run.smithi081.stdout:5256 writesame 0x43ad6f7 thru 0x43b61e6 data_size 0x1a(0x8af0 bytes) 2024-09-13T06:42:43.664 INFO:teuthology.orchestra.run.smithi081.stdout:5257 read 0xb1e6b2b thru 0xb1e7953 (0xe29 bytes) 2024-09-13T06:42:43.664 INFO:teuthology.orchestra.run.smithi081.stdout:5258 writesame 0x344f0ac thru 0x344f6dc data_size 0x1(0x631 bytes) 2024-09-13T06:42:43.668 INFO:teuthology.orchestra.run.smithi081.stdout:5259 write 0x4b01e3c thru 0x4b0f2e9 (0xd4ae bytes) 2024-09-13T06:42:43.690 INFO:teuthology.orchestra.run.smithi081.stdout:5260 trunc from 0xd652297 to 0xa7fdc2 2024-09-13T06:42:43.706 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:42:43.700+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:42:43.728 INFO:teuthology.orchestra.run.smithi081.stdout:5261 writesame 0xb1deac1 thru 0xb1e95f1 data_size 0x5(0xab31 bytes) 2024-09-13T06:42:43.728 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:42:43.729 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:42:43.733 INFO:teuthology.orchestra.run.smithi081.stdout:5262 trunc from 0xb1e95f2 to 0x8a9cd2f 2024-09-13T06:42:43.747 INFO:teuthology.orchestra.run.smithi081.stdout:5263 trunc from 0x8a9cd2f to 0x83f5803 2024-09-13T06:42:43.749 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-13T06:42:43.773 INFO:teuthology.orchestra.run.smithi081.stdout:5265 write 0xbebe70e thru 0xbecac91 (0xc584 bytes) 2024-09-13T06:42:43.776 INFO:teuthology.orchestra.run.smithi081.stdout:5266 read 0x1a73c8d thru 0x1a7e447 (0xa7bb bytes) 2024-09-13T06:42:43.776 INFO:teuthology.orchestra.run.smithi081.stdout:5267 punch from 0xb6c6c95 to 0xb6d1871, (0xabdc bytes) 2024-09-13T06:42:43.782 INFO:teuthology.orchestra.run.smithi081.stdout:5268 trunc from 0xbecac92 to 0x8279e0f 2024-09-13T06:42:43.798 INFO:teuthology.orchestra.run.smithi081.stdout:5269 trunc from 0x8279e0f to 0xb8be918 2024-09-13T06:42:43.804 INFO:teuthology.orchestra.run.smithi081.stdout:5270 write 0x45c0e8e thru 0x45c8172 (0x72e5 bytes) 2024-09-13T06:42:43.807 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:42:43.801+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:42:43.815 INFO:teuthology.orchestra.run.smithi081.stdout:5271 write 0xc603bb9 thru 0xc60a95c (0x6da4 bytes) 2024-09-13T06:42:43.826 INFO:teuthology.orchestra.run.smithi081.stdout:5272 trunc from 0xc60a95d to 0x5bfa473 2024-09-13T06:42:43.838 INFO:teuthology.orchestra.run.smithi081.stdout:5273 read 0x3cbabd3 thru 0x3cc9d13 (0xf141 bytes) 2024-09-13T06:42:43.838 INFO:teuthology.orchestra.run.smithi081.stdout:5274 punch from 0x28d19c7 to 0x28dab1b, (0x9154 bytes) 2024-09-13T06:42:43.838 INFO:teuthology.orchestra.run.smithi081.stdout:5275 read 0x3728cd4 thru 0x3733097 (0xa3c4 bytes) 2024-09-13T06:42:43.839 INFO:teuthology.orchestra.run.smithi081.stdout:5276 punch from 0x8bf3ed to 0x8cd286, (0xde99 bytes) 2024-09-13T06:42:43.845 INFO:teuthology.orchestra.run.smithi081.stdout:5277 writesame 0x5cb0011 thru 0x5cbab93 data_size 0x17(0xab83 bytes) 2024-09-13T06:42:43.846 INFO:teuthology.orchestra.run.smithi081.stdout:5278 write 0x531a8f2 thru 0x531e316 (0x3a25 bytes) 2024-09-13T06:42:43.860 INFO:teuthology.orchestra.run.smithi081.stdout:5279 write 0x8ec0451 thru 0x8ecf69e (0xf24e bytes) 2024-09-13T06:42:43.862 INFO:teuthology.orchestra.run.smithi081.stdout:5280 write 0x1c7e08b thru 0x1c8706b (0x8fe1 bytes) 2024-09-13T06:42:43.866 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:42:43.873 INFO:teuthology.orchestra.run.smithi081.stdout:5282 trunc from 0x8ecf69f to 0xdb6743a 2024-09-13T06:42:43.879 INFO:teuthology.orchestra.run.smithi081.stdout:5283 read 0x2f55e64 thru 0x2f5b088 (0x5225 bytes) 2024-09-13T06:42:43.880 INFO:teuthology.orchestra.run.smithi081.stdout:5284 write 0x66f9a8 thru 0x677758 (0x7db1 bytes) 2024-09-13T06:42:43.882 INFO:teuthology.orchestra.run.smithi081.stdout:5285 read 0xc974b60 thru 0xc9831af (0xe650 bytes) 2024-09-13T06:42:43.882 INFO:teuthology.orchestra.run.smithi081.stdout:5286 write 0x34c837b thru 0x34d39fe (0xb684 bytes) 2024-09-13T06:42:43.884 INFO:teuthology.orchestra.run.smithi081.stdout:5287 read 0x55d4e91 thru 0x55d5945 (0xab5 bytes) 2024-09-13T06:42:43.885 INFO:teuthology.orchestra.run.smithi081.stdout:5289 writesame 0xc37916b thru 0xc37d582 data_size 0x4(0x4418 bytes) 2024-09-13T06:42:43.888 INFO:teuthology.orchestra.run.smithi081.stdout:5292 write 0x7ce1a46 thru 0x7ceb08d (0x9648 bytes) 2024-09-13T06:42:43.890 INFO:teuthology.orchestra.run.smithi081.stdout:5294 write 0xb09e27 thru 0xb19a66 (0xfc40 bytes) 2024-09-13T06:42:43.894 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:42:43.894 INFO:teuthology.orchestra.run.smithi081.stdout:5296 punch from 0x98fe9c4 to 0x990b4dc, (0xcb18 bytes) 2024-09-13T06:42:43.894 INFO:teuthology.orchestra.run.smithi081.stdout:5297 read 0x14adcc4 thru 0x14b3311 (0x564e bytes) 2024-09-13T06:42:43.895 INFO:teuthology.orchestra.run.smithi081.stdout:5298 read 0x4832f5f thru 0x483ce2f (0x9ed1 bytes) 2024-09-13T06:42:43.895 INFO:teuthology.orchestra.run.smithi081.stdout:5300 read 0x157b8cd thru 0x158554f (0x9c83 bytes) 2024-09-13T06:42:43.895 INFO:teuthology.orchestra.run.smithi081.stdout:5302 writesame 0xcbf305e thru 0xcbf4b4b data_size 0x9(0x1aee bytes) 2024-09-13T06:42:43.897 INFO:teuthology.orchestra.run.smithi081.stdout:5303 writesame 0xa464429 thru 0xa46d860 data_size 0x66(0x9438 bytes) 2024-09-13T06:42:43.899 INFO:teuthology.orchestra.run.smithi081.stdout:5304 punch from 0xc60b057 to 0xc616f3d, (0xbee6 bytes) 2024-09-13T06:42:43.899 INFO:teuthology.orchestra.run.smithi081.stdout:5305 write 0x24860b6 thru 0x2490c8f (0xabda bytes) 2024-09-13T06:42:43.901 INFO:teuthology.orchestra.run.smithi081.stdout:5307 read 0x19444cf thru 0x194e143 (0x9c75 bytes) 2024-09-13T06:42:43.901 INFO:teuthology.orchestra.run.smithi081.stdout:5308 punch from 0xc6a1c22 to 0xc6abde5, (0xa1c3 bytes) 2024-09-13T06:42:43.901 INFO:teuthology.orchestra.run.smithi081.stdout:5309 read 0xaf22e6 thru 0xb0201e (0xfd39 bytes) 2024-09-13T06:42:43.902 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:42:43.902 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:42:43.902 INFO:teuthology.orchestra.run.smithi081.stdout:5312 read 0x28491d9 thru 0x284b1d9 (0x2001 bytes) 2024-09-13T06:42:43.903 INFO:teuthology.orchestra.run.smithi081.stdout:5313 writesame 0xeb4845 thru 0xebc1e2 data_size 0x3(0x799e bytes) 2024-09-13T06:42:43.907 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:42:43.901+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:42:43.908 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:42:43.909 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:42:43.919 INFO:teuthology.orchestra.run.smithi081.stdout:5314 writesame 0x4e94981 thru 0x4ea2e2c data_size 0xa(0xe4ac bytes) 2024-09-13T06:42:43.923 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-13T06:42:43.928 INFO:teuthology.orchestra.run.smithi081.stdout:5315 read 0xbed638b thru 0xbed8297 (0x1f0d bytes) 2024-09-13T06:42:43.943 INFO:teuthology.orchestra.run.smithi081.stdout:5317 trunc from 0xdb6743a to 0x6e9f336 2024-09-13T06:42:43.956 INFO:teuthology.orchestra.run.smithi081.stdout:5319 writesame 0x57a5718 thru 0x57ad090 data_size 0xb(0x7979 bytes) 2024-09-13T06:42:43.963 INFO:teuthology.orchestra.run.smithi081.stdout:5320 trunc from 0x6e9f336 to 0x9e34a97 2024-09-13T06:42:43.971 INFO:teuthology.orchestra.run.smithi081.stdout:5321 trunc from 0x9e34a97 to 0xa49782f 2024-09-13T06:42:43.979 INFO:teuthology.orchestra.run.smithi081.stdout:5323 writesame 0x9f47c2a thru 0x9f4878c data_size 0xb(0xb63 bytes) 2024-09-13T06:42:43.981 INFO:teuthology.orchestra.run.smithi081.stdout:5324 write 0x5b050a5 thru 0x5b141ef (0xf14b bytes) 2024-09-13T06:42:43.983 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:42:43.993 INFO:teuthology.orchestra.run.smithi081.stdout:5326 writesame 0xbbaf148 thru 0xbbbb2c2 data_size 0x1(0xc17b bytes) 2024-09-13T06:42:43.996 INFO:teuthology.orchestra.run.smithi081.stdout:5327 write 0x5d957dd thru 0x5d9f41b (0x9c3f bytes) 2024-09-13T06:42:43.999 INFO:teuthology.orchestra.run.smithi081.stdout:5328 punch from 0xa6fc3b4 to 0xa70a282, (0xdece bytes) 2024-09-13T06:42:43.999 INFO:teuthology.orchestra.run.smithi081.stdout:5330 punch from 0xa8f4847 to 0xa8fc033, (0x77ec bytes) 2024-09-13T06:42:43.999 INFO:teuthology.orchestra.run.smithi081.stdout:5331 read 0x38b1bde thru 0x38bf8ff (0xdd22 bytes) 2024-09-13T06:42:44.007 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:42:44.004+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:42:44.018 INFO:teuthology.orchestra.run.smithi081.stdout:5333 trunc from 0xbbbb2c3 to 0x17b6cbc 2024-09-13T06:42:44.030 INFO:teuthology.orchestra.run.smithi081.stdout:5335 punch from 0x280443 to 0x2876a7, (0x7264 bytes) 2024-09-13T06:42:44.030 INFO:teuthology.orchestra.run.smithi081.stdout:5336 clone 39 order 18 su 1024 sc 14 2024-09-13T06:42:44.063 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:42:44.063 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:42:44.077 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-13T06:42:44.092 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-13T06:42:44.109 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:42:44.105+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:42:44.210 INFO:tasks.ceph.osd.6.smithi139.stderr:2024-09-13T06:42:44.209+0000 7fcd02c5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26385) UID: 0 2024-09-13T06:42:44.235 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:42:44.235 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:42:44.251 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-13T06:42:44.262 INFO:teuthology.orchestra.run.smithi081.stdout:osd.0: {} 2024-09-13T06:42:44.262 INFO:teuthology.orchestra.run.smithi081.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-13T06:42:44.278 INFO:teuthology.orchestra.run.smithi081.stdout:osd.1: {} 2024-09-13T06:42:44.279 INFO:teuthology.orchestra.run.smithi081.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-13T06:42:44.295 INFO:teuthology.orchestra.run.smithi081.stdout:osd.2: {} 2024-09-13T06:42:44.295 INFO:teuthology.orchestra.run.smithi081.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-13T06:42:44.310 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:42:44.309+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:42:44.311 INFO:teuthology.orchestra.run.smithi081.stdout:osd.3: {} 2024-09-13T06:42:44.311 INFO:teuthology.orchestra.run.smithi081.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-13T06:42:44.331 INFO:teuthology.orchestra.run.smithi081.stdout:osd.4: {} 2024-09-13T06:42:44.331 INFO:teuthology.orchestra.run.smithi081.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-13T06:42:44.351 INFO:teuthology.orchestra.run.smithi081.stdout:osd.5: {} 2024-09-13T06:42:44.351 INFO:teuthology.orchestra.run.smithi081.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-13T06:42:44.365 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:42:44.365 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-13T06:42:44.365 INFO:teuthology.orchestra.run.smithi081.stdout: "num_ops": 0 2024-09-13T06:42:44.365 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:42:44.371 INFO:teuthology.orchestra.run.smithi081.stdout:osd.6: {} 2024-09-13T06:42:44.372 INFO:teuthology.orchestra.run.smithi081.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-13T06:42:44.379 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-13T06:42:44.393 INFO:teuthology.orchestra.run.smithi081.stdout:osd.7: {} 2024-09-13T06:42:44.393 INFO:teuthology.orchestra.run.smithi081.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-13T06:42:44.411 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:42:44.405+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:42:44.511 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:42:44.511 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-13T06:42:44.511 INFO:teuthology.orchestra.run.smithi081.stdout: "complaint_time": 30, 2024-09-13T06:42:44.511 INFO:teuthology.orchestra.run.smithi081.stdout: "num_blocked_ops": 0 2024-09-13T06:42:44.511 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:42:44.513 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:42:44.513+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:42:44.525 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-13T06:42:44.614 INFO:tasks.ceph.osd.6.smithi139.stderr:2024-09-13T06:42:44.609+0000 7fcd02c5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26385) UID: 0 2024-09-13T06:42:44.653 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:42:44.653 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 20, 2024-09-13T06:42:44.653 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 600, 2024-09-13T06:42:44.653 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [ 2024-09-13T06:42:44.654 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:44.654 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:2226 3.15 3:af026987:::rbd_data.112173e2f1b7.0000000000000017:head [sparse-read 0~4194304] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-13T06:42:44.654 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:37.606562+0000", 2024-09-13T06:42:44.654 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 187.04482791699999, 2024-09-13T06:42:44.654 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.83322091700000001, 2024-09-13T06:42:44.654 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:44.654 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:42:44.655 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:44.655 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:44.655 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:44.655 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 2226 2024-09-13T06:42:44.655 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:44.655 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:44.656 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:44.656 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:44.656 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606562+0000", 2024-09-13T06:42:44.656 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:44.656 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:44.656 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:44.657 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:44.657 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606562+0000", 2024-09-13T06:42:44.657 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:44.657 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:44.657 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:44.658 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:44.658 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606561+0000", 2024-09-13T06:42:44.658 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:44.658 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:44.658 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:44.658 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:44.658 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606565+0000", 2024-09-13T06:42:44.658 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.4379999999999999e-06 2024-09-13T06:42:44.658 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:44.659 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:44.659 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:44.659 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606569+0000", 2024-09-13T06:42:44.659 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.425e-06 2024-09-13T06:42:44.659 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:44.659 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:44.660 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:44.660 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606572+0000", 2024-09-13T06:42:44.660 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.05e-06 2024-09-13T06:42:44.660 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:44.660 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:44.661 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:44.661 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606621+0000", 2024-09-13T06:42:44.661 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.8723000000000001e-05 2024-09-13T06:42:44.661 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:44.661 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:44.661 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:42:44.661 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606630+0000", 2024-09-13T06:42:44.661 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.8040000000000007e-06 2024-09-13T06:42:44.662 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:44.662 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:44.662 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:44.662 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.439648+0000", 2024-09-13T06:42:44.662 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.83301824800000002 2024-09-13T06:42:44.662 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:44.662 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:44.662 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:44.663 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.439782+0000", 2024-09-13T06:42:44.663 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00013466699999999999 2024-09-13T06:42:44.663 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:44.663 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:44.663 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:44.663 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:44.664 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:44.664 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25661 3.8 3:1180686c:::rbd_data.1121f2c5ee81.0000000000000009:13 [read 397312~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:42:44.664 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.436956+0000", 2024-09-13T06:42:44.664 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 168.214433383, 2024-09-13T06:42:44.664 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089036758999999993, 2024-09-13T06:42:44.665 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:44.665 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:44.665 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:44.665 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:44.665 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:44.665 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25661 2024-09-13T06:42:44.666 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:44.666 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:44.666 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:44.666 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:44.666 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436956+0000", 2024-09-13T06:42:44.666 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:44.667 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:44.667 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:44.667 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:44.667 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436956+0000", 2024-09-13T06:42:44.667 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:44.668 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:44.668 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:44.668 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:44.668 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436956+0000", 2024-09-13T06:42:44.668 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:44.669 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:44.669 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:44.669 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:44.669 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436958+0000", 2024-09-13T06:42:44.669 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1770000000000001e-06 2024-09-13T06:42:44.670 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:44.670 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:44.670 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:44.670 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436963+0000", 2024-09-13T06:42:44.670 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.6489999999999996e-06 2024-09-13T06:42:44.670 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:44.671 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:44.671 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:44.671 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436975+0000", 2024-09-13T06:42:44.671 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1783999999999999e-05 2024-09-13T06:42:44.671 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:44.671 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:44.671 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:44.671 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.525671+0000", 2024-09-13T06:42:44.671 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.088696292999999995 2024-09-13T06:42:44.672 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:44.672 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:44.672 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:44.672 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.525749+0000", 2024-09-13T06:42:44.672 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.7589000000000005e-05 2024-09-13T06:42:44.672 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:44.672 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:44.672 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:44.672 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.525993+0000", 2024-09-13T06:42:44.672 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00024381000000000001 2024-09-13T06:42:44.672 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:44.672 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:44.672 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:44.673 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:44.673 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:44.673 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25662 3.8 3:1180686c:::rbd_data.1121f2c5ee81.0000000000000009:13 [read 421888~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:42:44.673 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.436980+0000", 2024-09-13T06:42:44.673 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 168.21440907100001, 2024-09-13T06:42:44.673 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089367577000000004, 2024-09-13T06:42:44.673 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:44.673 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:44.673 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:44.673 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:44.673 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:44.673 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25662 2024-09-13T06:42:44.674 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:44.674 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:44.674 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:44.674 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:44.674 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436980+0000", 2024-09-13T06:42:44.674 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:44.674 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:44.674 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:44.674 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:44.674 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436980+0000", 2024-09-13T06:42:44.674 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:44.674 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:44.674 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:44.675 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:44.675 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436980+0000", 2024-09-13T06:42:44.675 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:44.675 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:44.675 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:44.675 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:44.675 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436982+0000", 2024-09-13T06:42:44.675 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3989999999999998e-06 2024-09-13T06:42:44.675 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:44.675 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:44.675 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:44.675 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436988+0000", 2024-09-13T06:42:44.675 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0039999999999996e-06 2024-09-13T06:42:44.675 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:44.676 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:44.676 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:44.676 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436993+0000", 2024-09-13T06:42:44.676 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6090000000000003e-06 2024-09-13T06:42:44.676 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:44.676 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:44.676 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:44.676 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.526035+0000", 2024-09-13T06:42:44.676 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089042248000000004 2024-09-13T06:42:44.676 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:44.676 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:44.676 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:44.677 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.526111+0000", 2024-09-13T06:42:44.677 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5643999999999996e-05 2024-09-13T06:42:44.677 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:44.677 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:44.677 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:44.677 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.526348+0000", 2024-09-13T06:42:44.677 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00023705800000000001 2024-09-13T06:42:44.677 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:44.677 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:44.677 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:44.677 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:44.678 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:44.678 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25663 3.8 3:1180686c:::rbd_data.1121f2c5ee81.0000000000000009:13 [read 466944~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:42:44.678 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.436998+0000", 2024-09-13T06:42:44.678 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 168.21439142400001, 2024-09-13T06:42:44.678 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089730867000000006, 2024-09-13T06:42:44.678 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:44.678 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:44.678 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:44.678 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:44.678 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:44.679 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25663 2024-09-13T06:42:44.679 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:44.679 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:44.679 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:44.679 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:44.679 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436998+0000", 2024-09-13T06:42:44.679 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:44.679 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:44.679 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:44.679 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:44.679 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436998+0000", 2024-09-13T06:42:44.679 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:44.680 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:44.680 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:44.680 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:44.680 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436998+0000", 2024-09-13T06:42:44.680 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:44.680 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:44.680 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:44.680 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:44.680 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437000+0000", 2024-09-13T06:42:44.680 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0940000000000002e-06 2024-09-13T06:42:44.680 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:44.680 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:44.680 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:44.681 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437005+0000", 2024-09-13T06:42:44.681 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.604e-06 2024-09-13T06:42:44.681 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:44.681 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:44.681 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:44.681 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437032+0000", 2024-09-13T06:42:44.681 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6407e-05 2024-09-13T06:42:44.681 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:44.682 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:44.682 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:44.682 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.526363+0000", 2024-09-13T06:42:44.682 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089331456000000004 2024-09-13T06:42:44.683 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:44.683 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:44.683 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:44.683 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.526404+0000", 2024-09-13T06:42:44.683 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.0887999999999999e-05 2024-09-13T06:42:44.684 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:44.684 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:44.684 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:44.684 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.526729+0000", 2024-09-13T06:42:44.684 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00032486 2024-09-13T06:42:44.685 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:44.685 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:44.685 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:44.685 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:44.685 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:44.685 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25664 3.8 3:1180686c:::rbd_data.1121f2c5ee81.0000000000000009:13 [read 491520~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:42:44.686 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.437040+0000", 2024-09-13T06:42:44.686 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 168.21434950899999, 2024-09-13T06:42:44.686 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.090016650000000004, 2024-09-13T06:42:44.686 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:44.686 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:44.686 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:44.687 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:44.687 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:44.687 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25664 2024-09-13T06:42:44.687 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:44.687 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:44.687 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:44.687 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:44.688 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437040+0000", 2024-09-13T06:42:44.688 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:44.688 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:44.688 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:44.688 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:44.688 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437040+0000", 2024-09-13T06:42:44.689 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:44.689 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:44.689 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:44.689 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:44.689 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437039+0000", 2024-09-13T06:42:44.690 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:44.690 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:44.690 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:44.690 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:44.690 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437047+0000", 2024-09-13T06:42:44.690 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4839999999999998e-06 2024-09-13T06:42:44.691 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:44.691 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:44.691 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:44.691 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437054+0000", 2024-09-13T06:42:44.691 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.8299999999999998e-06 2024-09-13T06:42:44.691 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:44.692 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:44.692 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:44.692 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437060+0000", 2024-09-13T06:42:44.692 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.1510000000000001e-06 2024-09-13T06:42:44.692 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:44.692 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:44.693 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:44.693 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.526772+0000", 2024-09-13T06:42:44.693 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089711737999999999 2024-09-13T06:42:44.693 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:44.693 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:44.693 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:44.694 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.526848+0000", 2024-09-13T06:42:44.694 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5870000000000004e-05 2024-09-13T06:42:44.694 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:44.694 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:44.694 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:44.694 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.527057+0000", 2024-09-13T06:42:44.694 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000209106 2024-09-13T06:42:44.695 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:44.695 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:44.695 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:44.695 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:44.695 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:44.695 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25740 3.18 3:1c662b96:::rbd_data.1121f2c5ee81.0000000000000010:13 [read 200704~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:42:44.695 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443352+0000", 2024-09-13T06:42:44.696 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 168.20803783400001, 2024-09-13T06:42:44.696 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089068222000000002, 2024-09-13T06:42:44.696 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:44.696 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:44.696 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:44.696 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:44.696 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:44.697 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25740 2024-09-13T06:42:44.697 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:44.697 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:44.697 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:44.697 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:44.697 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443352+0000", 2024-09-13T06:42:44.698 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:44.698 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:44.698 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:44.698 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:44.698 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443352+0000", 2024-09-13T06:42:44.698 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:44.698 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:44.699 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:44.699 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:44.699 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443351+0000", 2024-09-13T06:42:44.699 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:44.699 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:44.699 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:44.699 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:44.699 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443354+0000", 2024-09-13T06:42:44.699 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.841e-06 2024-09-13T06:42:44.699 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:44.699 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:44.700 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:44.700 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443361+0000", 2024-09-13T06:42:44.700 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.0010000000000004e-06 2024-09-13T06:42:44.700 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:44.701 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:44.701 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:44.701 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443366+0000", 2024-09-13T06:42:44.701 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7119999999999999e-06 2024-09-13T06:42:44.701 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:44.701 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:44.701 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:44.701 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532117+0000", 2024-09-13T06:42:44.702 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.088751327000000005 2024-09-13T06:42:44.702 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:44.702 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:44.702 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:44.702 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532193+0000", 2024-09-13T06:42:44.703 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5839000000000004e-05 2024-09-13T06:42:44.703 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:44.703 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:44.703 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:44.703 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532420+0000", 2024-09-13T06:42:44.703 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00022691000000000001 2024-09-13T06:42:44.703 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:44.704 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:44.704 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:44.704 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:44.704 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:44.704 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25741 3.18 3:1c662b96:::rbd_data.1121f2c5ee81.0000000000000010:13 [read 225280~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:42:44.704 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443378+0000", 2024-09-13T06:42:44.704 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 168.208011067, 2024-09-13T06:42:44.705 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089324107, 2024-09-13T06:42:44.705 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:44.705 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:44.705 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:44.705 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:44.705 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:44.706 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25741 2024-09-13T06:42:44.706 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:44.706 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:44.706 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:44.706 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:44.706 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443378+0000", 2024-09-13T06:42:44.707 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:44.707 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:44.707 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:44.707 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:44.707 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443378+0000", 2024-09-13T06:42:44.707 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:44.708 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:44.708 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:44.708 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:44.708 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443378+0000", 2024-09-13T06:42:44.708 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:44.708 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:44.709 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:44.709 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:44.709 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443380+0000", 2024-09-13T06:42:44.709 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3549999999999999e-06 2024-09-13T06:42:44.709 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:44.710 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:44.710 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:44.710 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443388+0000", 2024-09-13T06:42:44.710 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.7449999999999995e-06 2024-09-13T06:42:44.710 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:44.711 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:44.711 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:44.711 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443393+0000", 2024-09-13T06:42:44.711 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.4e-06 2024-09-13T06:42:44.711 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:44.711 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:44.712 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:44.712 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532454+0000", 2024-09-13T06:42:44.712 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089060941000000005 2024-09-13T06:42:44.712 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:44.712 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:44.712 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:44.713 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532512+0000", 2024-09-13T06:42:44.713 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7763000000000002e-05 2024-09-13T06:42:44.713 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:44.713 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:44.713 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:44.714 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532703+0000", 2024-09-13T06:42:44.714 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000190328 2024-09-13T06:42:44.714 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:44.714 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:44.714 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:44.714 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:44.714 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:44.714 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25742 3.18 3:1c662b96:::rbd_data.1121f2c5ee81.0000000000000010:13 [read 270336~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:42:44.714 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443398+0000", 2024-09-13T06:42:44.714 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 168.20799135499999, 2024-09-13T06:42:44.714 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089621836999999996, 2024-09-13T06:42:44.715 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:44.715 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:44.715 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:44.715 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:44.715 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:44.715 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25742 2024-09-13T06:42:44.715 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:44.715 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:44.715 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:44.715 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:44.715 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443398+0000", 2024-09-13T06:42:44.715 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:44.715 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:44.715 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:44.716 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:44.716 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443398+0000", 2024-09-13T06:42:44.716 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:44.716 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:44.716 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:44.716 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:44.716 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443398+0000", 2024-09-13T06:42:44.716 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:44.716 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:44.716 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:44.716 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:44.716 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443400+0000", 2024-09-13T06:42:44.717 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1849999999999998e-06 2024-09-13T06:42:44.717 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:44.717 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:44.717 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:44.717 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443407+0000", 2024-09-13T06:42:44.717 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3669999999999999e-06 2024-09-13T06:42:44.717 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:44.717 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:44.717 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:44.717 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443420+0000", 2024-09-13T06:42:44.717 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2645e-05 2024-09-13T06:42:44.717 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:44.717 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:44.718 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:44.718 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532742+0000", 2024-09-13T06:42:44.718 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089322200000000004 2024-09-13T06:42:44.718 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:44.718 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:44.718 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:44.718 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532818+0000", 2024-09-13T06:42:44.718 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.6019000000000005e-05 2024-09-13T06:42:44.718 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:44.718 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:44.718 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:44.718 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533020+0000", 2024-09-13T06:42:44.718 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000201721 2024-09-13T06:42:44.718 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:44.719 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:44.719 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:44.719 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:44.719 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:44.719 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25743 3.18 3:1c662b96:::rbd_data.1121f2c5ee81.0000000000000010:13 [read 294912~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:42:44.719 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443425+0000", 2024-09-13T06:42:44.719 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 168.207964347, 2024-09-13T06:42:44.719 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089864075000000002, 2024-09-13T06:42:44.719 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:44.719 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:44.719 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:44.719 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:44.719 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:44.719 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25743 2024-09-13T06:42:44.720 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:44.720 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:44.720 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:44.720 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:44.720 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443425+0000", 2024-09-13T06:42:44.720 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:44.720 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:44.720 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:44.720 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:44.720 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443425+0000", 2024-09-13T06:42:44.720 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:44.720 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:44.720 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:44.721 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:44.721 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443425+0000", 2024-09-13T06:42:44.721 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:44.721 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:44.721 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:44.721 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:44.721 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443432+0000", 2024-09-13T06:42:44.721 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3420000000000002e-06 2024-09-13T06:42:44.721 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:44.721 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:44.721 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:44.721 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443440+0000", 2024-09-13T06:42:44.722 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5689999999999999e-06 2024-09-13T06:42:44.722 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:44.722 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:44.722 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:44.722 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443445+0000", 2024-09-13T06:42:44.722 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9590000000000003e-06 2024-09-13T06:42:44.722 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:44.722 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:44.722 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:44.722 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533063+0000", 2024-09-13T06:42:44.722 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089617988999999995 2024-09-13T06:42:44.722 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:44.722 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:44.723 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:44.723 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533122+0000", 2024-09-13T06:42:44.723 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9052999999999999e-05 2024-09-13T06:42:44.723 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:44.723 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:44.723 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:44.723 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533289+0000", 2024-09-13T06:42:44.723 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00016752800000000001 2024-09-13T06:42:44.723 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:44.723 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:44.723 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:44.723 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:44.723 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:44.723 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25744 3.18 3.69d46638 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:42:44.724 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443449+0000", 2024-09-13T06:42:44.724 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 168.2079402, 2024-09-13T06:42:44.724 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089869148999999995, 2024-09-13T06:42:44.724 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:44.724 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:42:44.724 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:44.724 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:44.724 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:44.725 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25744 2024-09-13T06:42:44.725 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:44.725 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:44.725 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:44.725 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:44.726 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443449+0000", 2024-09-13T06:42:44.726 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:44.726 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:44.726 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:44.726 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:44.726 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443449+0000", 2024-09-13T06:42:44.726 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:44.726 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:44.726 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:44.726 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:44.727 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443449+0000", 2024-09-13T06:42:44.727 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:44.727 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:44.727 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:44.727 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:44.727 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443451+0000", 2024-09-13T06:42:44.727 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.244e-06 2024-09-13T06:42:44.727 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:44.727 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:44.727 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:44.727 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443457+0000", 2024-09-13T06:42:44.727 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.66e-06 2024-09-13T06:42:44.727 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:44.728 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:44.728 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:44.728 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443461+0000", 2024-09-13T06:42:44.728 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5449999999999997e-06 2024-09-13T06:42:44.728 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:44.728 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:44.728 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:44.728 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533311+0000", 2024-09-13T06:42:44.728 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089849729000000003 2024-09-13T06:42:44.728 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:44.728 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:44.728 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:44.728 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533318+0000", 2024-09-13T06:42:44.729 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.328e-06 2024-09-13T06:42:44.729 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:44.729 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:44.729 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:44.729 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:44.729 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:44.729 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25745 3.18 3.69d46638 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:42:44.729 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443466+0000", 2024-09-13T06:42:44.729 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 168.207923142, 2024-09-13T06:42:44.729 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089886743000000005, 2024-09-13T06:42:44.729 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:44.729 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:42:44.729 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:44.730 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:44.730 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:44.730 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25745 2024-09-13T06:42:44.730 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:44.730 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:44.730 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:44.730 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:44.730 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443466+0000", 2024-09-13T06:42:44.730 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:44.730 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:44.730 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:44.730 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:44.730 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443466+0000", 2024-09-13T06:42:44.730 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:44.731 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:44.731 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:44.731 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:44.731 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443466+0000", 2024-09-13T06:42:44.731 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:44.731 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:44.731 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:44.731 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:44.731 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443474+0000", 2024-09-13T06:42:44.731 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.1289999999999996e-06 2024-09-13T06:42:44.731 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:44.731 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:44.731 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:44.732 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443484+0000", 2024-09-13T06:42:44.732 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0654e-05 2024-09-13T06:42:44.732 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:44.732 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:44.732 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:44.732 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443490+0000", 2024-09-13T06:42:44.732 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8030000000000002e-06 2024-09-13T06:42:44.732 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:44.732 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:44.732 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:44.732 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533348+0000", 2024-09-13T06:42:44.732 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089857267000000005 2024-09-13T06:42:44.732 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:44.733 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:44.733 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:44.733 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533353+0000", 2024-09-13T06:42:44.733 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.5520000000000004e-06 2024-09-13T06:42:44.733 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:44.733 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:44.733 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:44.733 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:44.733 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:44.733 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25746 3.18 3.69d46638 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:42:44.733 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443495+0000", 2024-09-13T06:42:44.733 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 168.20789402899999, 2024-09-13T06:42:44.733 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089903725000000004, 2024-09-13T06:42:44.734 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:44.734 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:42:44.734 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:44.734 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:44.734 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:44.734 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25746 2024-09-13T06:42:44.734 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:44.734 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:44.734 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:44.734 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:44.734 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443495+0000", 2024-09-13T06:42:44.734 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:44.734 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:44.734 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:44.735 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:44.735 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443495+0000", 2024-09-13T06:42:44.735 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:44.735 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:44.735 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:44.735 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:44.735 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443495+0000", 2024-09-13T06:42:44.735 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:44.735 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:44.735 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:44.735 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:44.735 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443498+0000", 2024-09-13T06:42:44.735 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.7690000000000001e-06 2024-09-13T06:42:44.735 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:44.736 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:44.736 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:44.736 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443504+0000", 2024-09-13T06:42:44.736 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9710000000000001e-06 2024-09-13T06:42:44.736 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:44.736 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:44.736 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:44.736 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443508+0000", 2024-09-13T06:42:44.736 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4159999999999997e-06 2024-09-13T06:42:44.736 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:44.736 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:44.736 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:44.736 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533391+0000", 2024-09-13T06:42:44.737 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089882607000000003 2024-09-13T06:42:44.737 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:44.737 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:44.737 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:44.737 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533399+0000", 2024-09-13T06:42:44.737 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.4349999999999997e-06 2024-09-13T06:42:44.737 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:44.737 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:44.737 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:44.737 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:44.737 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:44.737 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25747 3.8 3.63996268 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:42:44.737 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443512+0000", 2024-09-13T06:42:44.738 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 168.207877298, 2024-09-13T06:42:44.738 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089880075000000004, 2024-09-13T06:42:44.738 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:44.738 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:42:44.738 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:44.738 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:44.738 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:44.738 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25747 2024-09-13T06:42:44.738 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:44.738 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:44.738 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:44.738 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:44.738 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443512+0000", 2024-09-13T06:42:44.739 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:44.739 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:44.739 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:44.739 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:44.739 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443512+0000", 2024-09-13T06:42:44.739 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:44.739 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:44.739 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:44.739 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:44.739 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443512+0000", 2024-09-13T06:42:44.740 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:44.740 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:44.740 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:44.740 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:44.740 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443514+0000", 2024-09-13T06:42:44.740 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0980000000000001e-06 2024-09-13T06:42:44.740 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:44.740 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:44.740 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:44.740 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443520+0000", 2024-09-13T06:42:44.740 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7069999999999997e-06 2024-09-13T06:42:44.740 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:44.740 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:44.741 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:44.741 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443524+0000", 2024-09-13T06:42:44.741 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5390000000000001e-06 2024-09-13T06:42:44.741 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:44.741 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:44.741 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:44.741 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533384+0000", 2024-09-13T06:42:44.741 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089859684999999995 2024-09-13T06:42:44.741 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:44.741 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:44.741 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:44.741 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533392+0000", 2024-09-13T06:42:44.741 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.3440000000000001e-06 2024-09-13T06:42:44.742 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:44.742 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:44.742 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:44.742 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:44.742 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:44.742 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25748 3.8 3.63996268 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:42:44.742 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443528+0000", 2024-09-13T06:42:44.742 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 168.20786117099999, 2024-09-13T06:42:44.742 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089890715999999996, 2024-09-13T06:42:44.742 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:44.742 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:42:44.742 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:44.742 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:44.742 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:44.743 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25748 2024-09-13T06:42:44.743 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:44.743 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:44.743 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:44.743 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:44.743 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443528+0000", 2024-09-13T06:42:44.743 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:44.743 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:44.743 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:44.743 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:44.743 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443528+0000", 2024-09-13T06:42:44.743 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:44.743 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:44.743 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:44.744 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:44.744 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443528+0000", 2024-09-13T06:42:44.744 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:44.744 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:44.744 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:44.744 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:44.744 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443530+0000", 2024-09-13T06:42:44.744 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0650000000000001e-06 2024-09-13T06:42:44.744 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:44.744 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:44.744 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:44.744 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443536+0000", 2024-09-13T06:42:44.744 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7259999999999999e-06 2024-09-13T06:42:44.745 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:44.745 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:44.745 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:44.745 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443540+0000", 2024-09-13T06:42:44.745 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5009999999999998e-06 2024-09-13T06:42:44.745 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:44.745 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:44.745 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:44.745 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533412+0000", 2024-09-13T06:42:44.745 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089871873000000005 2024-09-13T06:42:44.745 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:44.745 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:44.745 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:44.746 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533419+0000", 2024-09-13T06:42:44.746 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.883e-06 2024-09-13T06:42:44.746 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:44.746 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:44.746 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:44.746 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:44.746 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:44.746 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25749 3.8 3.63996268 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:42:44.746 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443545+0000", 2024-09-13T06:42:44.746 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 168.207844975, 2024-09-13T06:42:44.746 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089897988999999998, 2024-09-13T06:42:44.746 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:44.746 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:42:44.747 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:44.747 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:44.747 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:44.747 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25749 2024-09-13T06:42:44.747 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:44.747 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:44.747 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:44.747 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:44.747 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443545+0000", 2024-09-13T06:42:44.747 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:44.747 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:44.747 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:44.747 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:44.748 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443545+0000", 2024-09-13T06:42:44.748 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:44.748 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:44.748 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:44.748 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:44.748 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443544+0000", 2024-09-13T06:42:44.748 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:44.748 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:44.748 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:44.748 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:44.748 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443553+0000", 2024-09-13T06:42:44.748 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.4770000000000003e-06 2024-09-13T06:42:44.748 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:44.749 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:44.749 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:44.749 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443564+0000", 2024-09-13T06:42:44.749 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0986e-05 2024-09-13T06:42:44.749 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:44.749 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:44.749 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:44.749 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443569+0000", 2024-09-13T06:42:44.749 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2530000000000004e-06 2024-09-13T06:42:44.749 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:44.749 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:44.749 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:44.749 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533438+0000", 2024-09-13T06:42:44.750 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089868641999999999 2024-09-13T06:42:44.750 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:44.750 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:44.750 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:44.750 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533442+0000", 2024-09-13T06:42:44.750 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.989e-06 2024-09-13T06:42:44.750 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:44.750 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:44.750 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:44.750 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:44.750 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:44.750 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25750 3.8 3.63996268 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:42:44.750 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443574+0000", 2024-09-13T06:42:44.750 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 168.20781548900001, 2024-09-13T06:42:44.751 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089895143999999996, 2024-09-13T06:42:44.751 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:44.751 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:42:44.751 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:44.751 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:44.751 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:44.751 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25750 2024-09-13T06:42:44.751 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:44.751 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:44.751 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:44.751 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:44.751 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443574+0000", 2024-09-13T06:42:44.751 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:44.751 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:44.752 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:44.752 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:44.752 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443574+0000", 2024-09-13T06:42:44.752 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:44.752 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:44.752 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:44.752 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:44.752 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443574+0000", 2024-09-13T06:42:44.752 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:44.752 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:44.752 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:44.752 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:44.752 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443576+0000", 2024-09-13T06:42:44.753 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6910000000000002e-06 2024-09-13T06:42:44.753 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:44.753 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:44.753 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:44.753 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443583+0000", 2024-09-13T06:42:44.753 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.331e-06 2024-09-13T06:42:44.753 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:44.753 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:44.753 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:44.753 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443587+0000", 2024-09-13T06:42:44.753 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6129999999999997e-06 2024-09-13T06:42:44.753 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:44.753 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:44.754 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:44.754 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533464+0000", 2024-09-13T06:42:44.754 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089876605999999998 2024-09-13T06:42:44.754 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:44.754 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:44.754 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:44.754 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533469+0000", 2024-09-13T06:42:44.754 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3909999999999997e-06 2024-09-13T06:42:44.754 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:44.754 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:44.754 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:44.754 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:44.754 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:44.754 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25751 3.8 3.63996268 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:42:44.755 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443592+0000", 2024-09-13T06:42:44.755 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 168.20779779200001, 2024-09-13T06:42:44.755 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089913650999999997, 2024-09-13T06:42:44.755 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:44.755 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:42:44.755 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:44.755 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:44.755 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:44.755 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25751 2024-09-13T06:42:44.755 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:44.755 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:44.755 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:44.755 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:44.755 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443592+0000", 2024-09-13T06:42:44.756 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:44.756 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:44.756 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:44.756 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:44.756 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443592+0000", 2024-09-13T06:42:44.756 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:44.756 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:44.756 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:44.756 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:44.756 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443591+0000", 2024-09-13T06:42:44.756 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:44.756 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:44.756 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:44.757 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:44.757 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443594+0000", 2024-09-13T06:42:44.757 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3649999999999998e-06 2024-09-13T06:42:44.757 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:44.757 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:44.757 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:44.757 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443599+0000", 2024-09-13T06:42:44.757 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.699e-06 2024-09-13T06:42:44.757 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:44.757 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:44.757 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:44.757 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443611+0000", 2024-09-13T06:42:44.758 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1503e-05 2024-09-13T06:42:44.758 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:44.758 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:44.758 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:44.758 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533497+0000", 2024-09-13T06:42:44.758 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089886453000000005 2024-09-13T06:42:44.758 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:44.758 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:44.758 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:44.758 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533505+0000", 2024-09-13T06:42:44.758 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.9910000000000002e-06 2024-09-13T06:42:44.758 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:44.758 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:44.758 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:44.759 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:44.759 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:44.759 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25752 3.8 3.63996268 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:42:44.759 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443615+0000", 2024-09-13T06:42:44.759 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 168.207774011, 2024-09-13T06:42:44.759 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089905868999999999, 2024-09-13T06:42:44.759 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:44.759 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:42:44.759 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:44.759 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:44.759 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:44.759 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25752 2024-09-13T06:42:44.759 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:44.759 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:44.759 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:44.760 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:44.760 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443615+0000", 2024-09-13T06:42:44.760 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:44.760 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:44.760 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:44.760 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:44.760 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443615+0000", 2024-09-13T06:42:44.760 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:44.760 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:44.760 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:44.760 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:44.760 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443615+0000", 2024-09-13T06:42:44.760 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:44.761 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:44.761 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:44.761 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:44.761 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443617+0000", 2024-09-13T06:42:44.761 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3539999999999998e-06 2024-09-13T06:42:44.761 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:44.761 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:44.761 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:44.761 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443624+0000", 2024-09-13T06:42:44.761 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3600000000000001e-06 2024-09-13T06:42:44.761 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:44.761 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:44.761 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:44.761 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443628+0000", 2024-09-13T06:42:44.762 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.2350000000000001e-06 2024-09-13T06:42:44.762 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:44.762 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:44.762 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:44.762 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533517+0000", 2024-09-13T06:42:44.762 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089889029999999995 2024-09-13T06:42:44.762 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:44.762 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:44.762 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:44.762 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533521+0000", 2024-09-13T06:42:44.762 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.2529999999999998e-06 2024-09-13T06:42:44.762 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:44.762 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:44.762 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:44.763 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:44.763 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:44.763 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:64356 3.c 3:32785be9:::rbd_header.11218ba71f0d:head [watch reconnect cookie 140361410387072 gen 2] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e95)", 2024-09-13T06:42:44.763 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:48.473318+0000", 2024-09-13T06:42:44.763 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 116.178071618, 2024-09-13T06:42:44.763 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1458904379999999, 2024-09-13T06:42:44.763 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:44.763 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:44.763 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:44.763 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:44.763 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:44.763 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 64356 2024-09-13T06:42:44.763 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:44.763 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:44.764 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:44.764 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:44.764 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:48.473318+0000", 2024-09-13T06:42:44.764 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:44.764 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:44.764 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:44.764 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:44.764 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:48.473318+0000", 2024-09-13T06:42:44.764 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:44.764 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:44.764 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:44.764 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:44.765 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:48.473315+0000", 2024-09-13T06:42:44.765 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999971 2024-09-13T06:42:44.765 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:44.765 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:44.765 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:44.765 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:48.473329+0000", 2024-09-13T06:42:44.765 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.433e-05 2024-09-13T06:42:44.765 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:44.765 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:44.765 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:44.765 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:48.473363+0000", 2024-09-13T06:42:44.765 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.3592e-05 2024-09-13T06:42:44.765 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:44.765 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:44.766 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:44.766 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:48.473386+0000", 2024-09-13T06:42:44.766 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2708999999999999e-05 2024-09-13T06:42:44.766 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:44.766 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:44.766 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:44.766 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:48.473804+0000", 2024-09-13T06:42:44.766 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00041789399999999998 2024-09-13T06:42:44.766 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:44.766 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:44.766 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:42:44.766 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:48.473830+0000", 2024-09-13T06:42:44.766 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6869e-05 2024-09-13T06:42:44.767 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:44.767 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:44.767 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:44.767 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:49.614332+0000", 2024-09-13T06:42:44.767 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.140501107 2024-09-13T06:42:44.767 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:44.767 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:44.767 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for rw locks", 2024-09-13T06:42:44.767 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:49.614496+0000", 2024-09-13T06:42:44.767 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00016451200000000001 2024-09-13T06:42:44.767 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:44.767 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:44.767 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:44.767 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:49.617131+0000", 2024-09-13T06:42:44.768 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.002634843 2024-09-13T06:42:44.768 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:44.768 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:44.768 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:44.768 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:49.617204+0000", 2024-09-13T06:42:44.768 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.2991000000000006e-05 2024-09-13T06:42:44.768 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:44.768 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:44.768 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:44.768 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:49.619208+0000", 2024-09-13T06:42:44.768 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.002004381 2024-09-13T06:42:44.768 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:44.768 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:44.769 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:44.769 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:44.769 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:44.769 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:170155 3.7 3:e17728eb:::image_client.0-clone36.rbd:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e191)", 2024-09-13T06:42:44.769 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:42:31.436412+0000", 2024-09-13T06:42:44.769 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 13.214977794999999, 2024-09-13T06:42:44.769 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.97843703800000004, 2024-09-13T06:42:44.769 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:44.769 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:42:44.769 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:44.769 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:44.769 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:44.769 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 170155 2024-09-13T06:42:44.770 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:44.770 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:44.770 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:44.770 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:44.770 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:31.436412+0000", 2024-09-13T06:42:44.770 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:44.770 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:44.770 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:44.770 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:44.770 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:31.436412+0000", 2024-09-13T06:42:44.770 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:44.770 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:44.770 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:44.770 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:44.771 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:31.436410+0000", 2024-09-13T06:42:44.771 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999986 2024-09-13T06:42:44.771 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:44.771 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:44.771 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:44.771 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:31.436417+0000", 2024-09-13T06:42:44.771 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.6939999999999998e-06 2024-09-13T06:42:44.771 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:44.771 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:44.771 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:44.771 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:31.436430+0000", 2024-09-13T06:42:44.771 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3016999999999999e-05 2024-09-13T06:42:44.771 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:44.771 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:44.772 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:44.772 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:31.436437+0000", 2024-09-13T06:42:44.772 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.1069999999999999e-06 2024-09-13T06:42:44.772 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:44.772 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:44.772 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:44.772 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:31.436515+0000", 2024-09-13T06:42:44.772 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.7756000000000006e-05 2024-09-13T06:42:44.772 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:44.772 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:44.772 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:42:44.772 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:31.436523+0000", 2024-09-13T06:42:44.772 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.4970000000000001e-06 2024-09-13T06:42:44.773 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:44.773 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:44.773 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:44.773 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:32.414565+0000", 2024-09-13T06:42:44.773 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.97804144199999998 2024-09-13T06:42:44.773 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:44.773 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:44.773 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:44.773 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:32.414849+0000", 2024-09-13T06:42:44.773 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00028388600000000001 2024-09-13T06:42:44.773 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:44.773 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:44.773 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:44.774 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:44.774 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:44.774 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:42:44.774 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 7, 5, 3, 4] out_osds: [6] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-13T06:42:44.774 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-13T06:42:44.774 INFO:tasks.thrashosds.thrasher:primary_affinity 2024-09-13T06:42:44.774 INFO:tasks.thrashosds.thrasher:Setting osd 4 primary_affinity to 0.649204 2024-09-13T06:42:44.774 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 4 0.6492043928133836 2024-09-13T06:42:44.775 INFO:teuthology.orchestra.run.smithi081.stderr:noscrub is unset 2024-09-13T06:42:44.776 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-13T06:42:44.778 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:42:44.773+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:42:44.877 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:42:44.872+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:42:44.909 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:42:44.909 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [], 2024-09-13T06:42:44.909 INFO:teuthology.orchestra.run.smithi139.stdout: "num_ops": 0 2024-09-13T06:42:44.910 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:42:44.924 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-13T06:42:44.977 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:42:44.972+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:42:45.044 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:42:45.045 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [], 2024-09-13T06:42:45.045 INFO:teuthology.orchestra.run.smithi139.stdout: "complaint_time": 30, 2024-09-13T06:42:45.045 INFO:teuthology.orchestra.run.smithi139.stdout: "num_blocked_ops": 0 2024-09-13T06:42:45.045 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:42:45.059 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-13T06:42:45.079 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:42:45.076+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:42:45.180 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:42:45.176+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:42:45.183 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:42:45.183 INFO:teuthology.orchestra.run.smithi139.stdout: "size": 20, 2024-09-13T06:42:45.183 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 600, 2024-09-13T06:42:45.183 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [ 2024-09-13T06:42:45.184 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.184 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18706 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 3346432~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:42:45.184 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.846138+0000", 2024-09-13T06:42:45.184 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 173.335469558, 2024-09-13T06:42:45.184 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.102018712, 2024-09-13T06:42:45.184 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:45.184 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:45.184 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:45.184 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:45.184 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:45.184 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18706 2024-09-13T06:42:45.184 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.185 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:45.185 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.185 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:45.185 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846138+0000", 2024-09-13T06:42:45.185 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:45.185 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.185 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.185 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:45.185 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846138+0000", 2024-09-13T06:42:45.185 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:45.185 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.185 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.185 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:45.186 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846138+0000", 2024-09-13T06:42:45.186 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:45.186 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.186 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.186 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:45.186 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846141+0000", 2024-09-13T06:42:45.186 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.6969999999999999e-06 2024-09-13T06:42:45.186 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.186 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.186 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:45.186 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846150+0000", 2024-09-13T06:42:45.186 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6400000000000003e-06 2024-09-13T06:42:45.186 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.187 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.187 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:45.187 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846160+0000", 2024-09-13T06:42:45.187 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.3999999999999998e-06 2024-09-13T06:42:45.187 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.187 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.187 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:45.187 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.947764+0000", 2024-09-13T06:42:45.187 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101604085 2024-09-13T06:42:45.187 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.187 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.187 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:45.187 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.947888+0000", 2024-09-13T06:42:45.188 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000124113 2024-09-13T06:42:45.188 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.188 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.188 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:45.188 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.948157+0000", 2024-09-13T06:42:45.188 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00026943399999999998 2024-09-13T06:42:45.188 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:45.188 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:45.188 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:45.188 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.188 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.188 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18707 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 3375104~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:42:45.188 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.846207+0000", 2024-09-13T06:42:45.188 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 173.335400792, 2024-09-13T06:42:45.189 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10238114099999999, 2024-09-13T06:42:45.189 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:45.189 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:45.189 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:45.189 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:45.189 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:45.189 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18707 2024-09-13T06:42:45.189 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.189 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:45.189 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.189 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:45.189 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846207+0000", 2024-09-13T06:42:45.189 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:45.190 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.190 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.190 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:45.190 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846207+0000", 2024-09-13T06:42:45.190 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:45.190 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.190 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.190 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:45.190 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846206+0000", 2024-09-13T06:42:45.190 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:42:45.190 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.190 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.190 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:45.190 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846211+0000", 2024-09-13T06:42:45.191 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.3000000000000003e-06 2024-09-13T06:42:45.191 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.191 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.191 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:45.191 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846220+0000", 2024-09-13T06:42:45.191 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6199999999999994e-06 2024-09-13T06:42:45.191 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.191 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.191 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:45.191 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846228+0000", 2024-09-13T06:42:45.191 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.7500000000000003e-06 2024-09-13T06:42:45.191 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.191 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.191 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:45.192 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.948267+0000", 2024-09-13T06:42:45.192 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10203878700000001 2024-09-13T06:42:45.192 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.192 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.192 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:45.192 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.948435+0000", 2024-09-13T06:42:45.192 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00016796500000000001 2024-09-13T06:42:45.192 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.192 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.192 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:45.192 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.948588+0000", 2024-09-13T06:42:45.192 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00015373599999999999 2024-09-13T06:42:45.192 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:45.193 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:45.193 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:45.193 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.193 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.193 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18718 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 3690496~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:42:45.193 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.850174+0000", 2024-09-13T06:42:45.193 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 173.33143363900001, 2024-09-13T06:42:45.193 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101854154, 2024-09-13T06:42:45.193 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:45.193 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:45.193 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:45.193 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:45.194 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:45.194 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18718 2024-09-13T06:42:45.194 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.194 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:45.194 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.194 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:45.194 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850174+0000", 2024-09-13T06:42:45.194 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:45.194 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.194 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.194 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:45.194 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850174+0000", 2024-09-13T06:42:45.194 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:45.195 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.195 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.195 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:45.195 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850173+0000", 2024-09-13T06:42:45.195 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:42:45.195 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.195 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.195 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:45.195 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850178+0000", 2024-09-13T06:42:45.195 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.4129999999999999e-06 2024-09-13T06:42:45.195 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.195 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.195 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:45.196 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850188+0000", 2024-09-13T06:42:45.196 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.8600000000000005e-06 2024-09-13T06:42:45.196 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.196 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.196 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:45.196 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850195+0000", 2024-09-13T06:42:45.196 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.8730000000000007e-06 2024-09-13T06:42:45.196 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.196 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.196 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:45.196 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.951766+0000", 2024-09-13T06:42:45.196 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.1015703 2024-09-13T06:42:45.196 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.197 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.197 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:45.197 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.951879+0000", 2024-09-13T06:42:45.197 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000112932 2024-09-13T06:42:45.197 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.197 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.197 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:45.197 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.952029+0000", 2024-09-13T06:42:45.197 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000149846 2024-09-13T06:42:45.197 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:45.197 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:45.197 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:45.197 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.198 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.198 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18719 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 3719168~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:42:45.198 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.850202+0000", 2024-09-13T06:42:45.198 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 173.331405596, 2024-09-13T06:42:45.198 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.102191676, 2024-09-13T06:42:45.198 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:45.198 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:45.198 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:45.198 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:45.198 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:45.198 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18719 2024-09-13T06:42:45.198 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.199 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:45.199 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.199 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:45.199 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850202+0000", 2024-09-13T06:42:45.199 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:45.199 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.199 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.199 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:45.199 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850202+0000", 2024-09-13T06:42:45.199 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:45.199 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.199 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.199 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:45.199 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850202+0000", 2024-09-13T06:42:45.200 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:42:45.200 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.200 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.200 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:45.200 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850205+0000", 2024-09-13T06:42:45.200 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.89e-06 2024-09-13T06:42:45.200 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.200 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.200 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:45.200 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850216+0000", 2024-09-13T06:42:45.200 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0233e-05 2024-09-13T06:42:45.200 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.201 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.201 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:45.201 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850223+0000", 2024-09-13T06:42:45.201 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5299999999999999e-06 2024-09-13T06:42:45.201 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.201 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.201 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:45.201 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.952106+0000", 2024-09-13T06:42:45.201 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10188309299999999 2024-09-13T06:42:45.201 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.201 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.201 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:45.201 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.952233+0000", 2024-09-13T06:42:45.202 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000126993 2024-09-13T06:42:45.202 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.202 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.202 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:45.202 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.952394+0000", 2024-09-13T06:42:45.202 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000160791 2024-09-13T06:42:45.202 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:45.202 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:45.202 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:45.202 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.202 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.202 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18720 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 3747840~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:42:45.203 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.850726+0000", 2024-09-13T06:42:45.203 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 173.33088176699999, 2024-09-13T06:42:45.203 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10199504299999999, 2024-09-13T06:42:45.203 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:45.203 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:45.203 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:45.203 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:45.203 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:45.203 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18720 2024-09-13T06:42:45.203 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.203 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:45.203 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.203 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:45.204 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850726+0000", 2024-09-13T06:42:45.204 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:45.204 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.204 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.204 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:45.204 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850726+0000", 2024-09-13T06:42:45.204 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:45.204 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.204 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.204 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:45.204 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850229+0000", 2024-09-13T06:42:45.204 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9995027 2024-09-13T06:42:45.204 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.205 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.205 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:45.205 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850731+0000", 2024-09-13T06:42:45.205 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00050221599999999999 2024-09-13T06:42:45.205 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.205 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.205 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:45.205 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850751+0000", 2024-09-13T06:42:45.205 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.9703000000000001e-05 2024-09-13T06:42:45.205 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.205 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.205 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:45.205 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850764+0000", 2024-09-13T06:42:45.205 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3207000000000001e-05 2024-09-13T06:42:45.206 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.206 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.206 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:45.206 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.952454+0000", 2024-09-13T06:42:45.206 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101690102 2024-09-13T06:42:45.206 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.206 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.206 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:45.206 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.952571+0000", 2024-09-13T06:42:45.206 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000116556 2024-09-13T06:42:45.206 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.206 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.207 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:45.207 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.952721+0000", 2024-09-13T06:42:45.207 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000150419 2024-09-13T06:42:45.207 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:45.207 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:45.207 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:45.207 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.207 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.207 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18730 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 4034560~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:42:45.207 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.854013+0000", 2024-09-13T06:42:45.207 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 173.327594826, 2024-09-13T06:42:45.207 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10186914399999999, 2024-09-13T06:42:45.207 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:45.208 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:45.208 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:45.208 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:45.208 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:45.208 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18730 2024-09-13T06:42:45.208 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.208 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:45.208 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.208 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:45.208 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.854013+0000", 2024-09-13T06:42:45.208 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:45.208 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.209 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.209 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:45.209 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.854013+0000", 2024-09-13T06:42:45.209 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:45.209 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.209 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.209 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:45.209 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.854013+0000", 2024-09-13T06:42:45.209 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:45.209 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.209 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.209 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:45.209 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.854016+0000", 2024-09-13T06:42:45.210 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.1839999999999999e-06 2024-09-13T06:42:45.210 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.210 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.210 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:45.210 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.854025+0000", 2024-09-13T06:42:45.210 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.8030000000000003e-06 2024-09-13T06:42:45.210 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.210 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.210 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:45.210 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.854033+0000", 2024-09-13T06:42:45.210 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6500000000000002e-06 2024-09-13T06:42:45.210 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.210 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.210 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:45.211 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.955546+0000", 2024-09-13T06:42:45.211 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10151296 2024-09-13T06:42:45.211 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.211 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.211 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:45.211 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.955694+0000", 2024-09-13T06:42:45.211 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000147773 2024-09-13T06:42:45.211 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.211 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.211 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:45.211 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.955882+0000", 2024-09-13T06:42:45.211 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000188371 2024-09-13T06:42:45.211 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:45.212 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:45.212 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:45.212 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.212 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.212 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18742 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 4378624~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:42:45.212 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.857984+0000", 2024-09-13T06:42:45.212 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 173.32362370300001, 2024-09-13T06:42:45.212 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10179961799999999, 2024-09-13T06:42:45.212 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:45.212 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:45.212 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:45.212 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:45.212 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:45.213 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18742 2024-09-13T06:42:45.213 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.213 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:45.213 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.213 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:45.213 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.857984+0000", 2024-09-13T06:42:45.213 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:45.213 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.213 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.213 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:45.213 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.857984+0000", 2024-09-13T06:42:45.213 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:45.213 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.214 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.214 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:45.214 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.857983+0000", 2024-09-13T06:42:45.214 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:42:45.214 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.214 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.214 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:45.214 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.857987+0000", 2024-09-13T06:42:45.214 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0670000000000002e-06 2024-09-13T06:42:45.214 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.214 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.214 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:45.214 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.857997+0000", 2024-09-13T06:42:45.214 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6830000000000003e-06 2024-09-13T06:42:45.214 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.215 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.215 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:45.215 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.858006+0000", 2024-09-13T06:42:45.215 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.5739999999999996e-06 2024-09-13T06:42:45.215 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.215 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.215 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:45.215 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.959453+0000", 2024-09-13T06:42:45.215 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101447339 2024-09-13T06:42:45.215 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.215 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.215 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:45.215 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.959603+0000", 2024-09-13T06:42:45.215 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000150316 2024-09-13T06:42:45.215 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.216 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.216 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:45.216 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.959784+0000", 2024-09-13T06:42:45.216 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00018065900000000001 2024-09-13T06:42:45.216 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:45.216 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:45.216 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:45.216 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.216 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.216 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18743 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 4407296~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:42:45.216 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.858012+0000", 2024-09-13T06:42:45.216 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 173.32359571000001, 2024-09-13T06:42:45.216 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10210024500000001, 2024-09-13T06:42:45.216 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:45.217 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:45.217 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:45.217 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:45.217 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:45.217 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18743 2024-09-13T06:42:45.217 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.217 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:45.217 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.217 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:45.217 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.858012+0000", 2024-09-13T06:42:45.217 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:45.217 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.217 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.217 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:45.218 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.858012+0000", 2024-09-13T06:42:45.218 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:45.218 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.218 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.218 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:45.218 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.858011+0000", 2024-09-13T06:42:45.218 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:42:45.218 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.218 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.218 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:45.218 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.858016+0000", 2024-09-13T06:42:45.218 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0659999999999997e-06 2024-09-13T06:42:45.218 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.219 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.219 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:45.219 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.858024+0000", 2024-09-13T06:42:45.219 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.7700000000000007e-06 2024-09-13T06:42:45.219 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.219 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.219 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:45.219 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.858032+0000", 2024-09-13T06:42:45.219 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.7700000000000001e-06 2024-09-13T06:42:45.219 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.219 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.219 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:45.219 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.959850+0000", 2024-09-13T06:42:45.219 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.1018182 2024-09-13T06:42:45.220 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.220 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.220 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:45.220 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.959964+0000", 2024-09-13T06:42:45.220 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00011413600000000001 2024-09-13T06:42:45.220 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.220 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.220 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:45.220 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.960113+0000", 2024-09-13T06:42:45.220 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00014813900000000001 2024-09-13T06:42:45.220 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:45.220 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:45.220 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:45.221 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.221 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.221 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18755 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 4751360~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:42:45.221 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.862061+0000", 2024-09-13T06:42:45.221 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 173.31954745799999, 2024-09-13T06:42:45.221 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101907023, 2024-09-13T06:42:45.221 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:45.221 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:45.221 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:45.221 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:45.221 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:45.221 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18755 2024-09-13T06:42:45.221 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.222 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:45.222 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.222 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:45.222 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862061+0000", 2024-09-13T06:42:45.222 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:45.222 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.222 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.222 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:45.222 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862061+0000", 2024-09-13T06:42:45.222 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:45.222 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.222 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.222 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:45.223 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862060+0000", 2024-09-13T06:42:45.223 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:42:45.223 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.223 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.223 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:45.223 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862064+0000", 2024-09-13T06:42:45.223 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.3229999999999999e-06 2024-09-13T06:42:45.223 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.223 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.223 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:45.223 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862078+0000", 2024-09-13T06:42:45.223 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.433e-05 2024-09-13T06:42:45.223 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.223 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.223 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:45.224 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862086+0000", 2024-09-13T06:42:45.224 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.3869999999999997e-06 2024-09-13T06:42:45.224 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.224 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.224 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:45.224 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.963635+0000", 2024-09-13T06:42:45.224 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101549606 2024-09-13T06:42:45.224 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.224 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.224 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:45.224 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.963783+0000", 2024-09-13T06:42:45.224 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000147312 2024-09-13T06:42:45.225 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.225 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.225 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:45.225 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.963968+0000", 2024-09-13T06:42:45.225 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000185028 2024-09-13T06:42:45.225 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:45.225 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:45.225 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:45.225 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.225 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.225 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18756 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 4780032~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:42:45.225 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.862132+0000", 2024-09-13T06:42:45.226 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 173.31947561499999, 2024-09-13T06:42:45.226 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.102159295, 2024-09-13T06:42:45.226 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:45.226 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:45.226 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:45.226 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:45.226 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:45.226 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18756 2024-09-13T06:42:45.226 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.226 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:45.226 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.226 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:45.226 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862132+0000", 2024-09-13T06:42:45.226 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:45.227 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.227 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.227 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:45.227 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862132+0000", 2024-09-13T06:42:45.227 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:45.227 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.227 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.227 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:45.227 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862132+0000", 2024-09-13T06:42:45.227 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:42:45.227 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.227 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.228 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:45.228 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862136+0000", 2024-09-13T06:42:45.228 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.9559999999999999e-06 2024-09-13T06:42:45.228 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.228 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.228 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:45.228 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862145+0000", 2024-09-13T06:42:45.228 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6169999999999996e-06 2024-09-13T06:42:45.228 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.228 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.228 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:45.228 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862153+0000", 2024-09-13T06:42:45.229 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.8359999999999992e-06 2024-09-13T06:42:45.229 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.229 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.229 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:45.229 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.964018+0000", 2024-09-13T06:42:45.229 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101865421 2024-09-13T06:42:45.229 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.229 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.229 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:45.229 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.964140+0000", 2024-09-13T06:42:45.229 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000121172 2024-09-13T06:42:45.229 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.229 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.230 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:45.230 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.964292+0000", 2024-09-13T06:42:45.230 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00015202600000000001 2024-09-13T06:42:45.230 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:45.230 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:45.230 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:45.230 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.230 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.230 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18768 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 5124096~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:42:45.230 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.866345+0000", 2024-09-13T06:42:45.230 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 173.315263308, 2024-09-13T06:42:45.230 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101779361, 2024-09-13T06:42:45.230 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:45.230 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:45.231 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:45.231 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:45.231 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:45.231 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18768 2024-09-13T06:42:45.231 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.231 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:45.231 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.231 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:45.231 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.866345+0000", 2024-09-13T06:42:45.231 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:45.231 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.231 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.231 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:45.231 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.866345+0000", 2024-09-13T06:42:45.232 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:45.232 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.232 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.232 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:45.232 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.866344+0000", 2024-09-13T06:42:45.232 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:45.232 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.232 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.232 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:45.232 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.866348+0000", 2024-09-13T06:42:45.232 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.4300000000000002e-06 2024-09-13T06:42:45.232 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.232 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.232 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:45.233 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.866356+0000", 2024-09-13T06:42:45.233 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.5930000000000006e-06 2024-09-13T06:42:45.233 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.233 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.233 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:45.233 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.866364+0000", 2024-09-13T06:42:45.233 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5599999999999996e-06 2024-09-13T06:42:45.233 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.233 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.233 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:45.233 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.967865+0000", 2024-09-13T06:42:45.233 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101501683 2024-09-13T06:42:45.233 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.233 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.234 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:45.234 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.967981+0000", 2024-09-13T06:42:45.234 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000115643 2024-09-13T06:42:45.234 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.234 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.234 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:45.234 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.968124+0000", 2024-09-13T06:42:45.234 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00014305500000000001 2024-09-13T06:42:45.234 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:45.234 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:45.234 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:45.234 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.234 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.234 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18779 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 5439488~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:42:45.235 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.869996+0000", 2024-09-13T06:42:45.235 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 173.31161242300001, 2024-09-13T06:42:45.235 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10189577399999999, 2024-09-13T06:42:45.235 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:45.235 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:45.235 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:45.235 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:45.235 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:45.235 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18779 2024-09-13T06:42:45.235 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.235 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:45.235 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.235 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:45.235 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.869996+0000", 2024-09-13T06:42:45.236 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:45.236 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.236 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.236 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:45.236 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.869996+0000", 2024-09-13T06:42:45.236 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:45.236 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.236 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.236 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:45.236 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.869995+0000", 2024-09-13T06:42:45.236 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:45.236 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.236 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.236 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:45.237 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.869998+0000", 2024-09-13T06:42:45.237 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.2729999999999998e-06 2024-09-13T06:42:45.237 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.237 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.237 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:45.237 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.870007+0000", 2024-09-13T06:42:45.237 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.5760000000000006e-06 2024-09-13T06:42:45.237 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.237 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.237 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:45.237 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.870014+0000", 2024-09-13T06:42:45.237 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.1400000000000002e-06 2024-09-13T06:42:45.237 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.238 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.238 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:45.238 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.971631+0000", 2024-09-13T06:42:45.238 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101617503 2024-09-13T06:42:45.238 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.238 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.238 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:45.238 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.971747+0000", 2024-09-13T06:42:45.238 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00011599600000000001 2024-09-13T06:42:45.238 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.238 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.238 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:45.238 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.971891+0000", 2024-09-13T06:42:45.239 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000143912 2024-09-13T06:42:45.239 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:45.239 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:45.239 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:45.239 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.239 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.239 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18792 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 5812224~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:42:45.239 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.874371+0000", 2024-09-13T06:42:45.239 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 173.30723729300001, 2024-09-13T06:42:45.239 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101736005, 2024-09-13T06:42:45.239 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:45.239 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:45.239 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:45.239 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:45.239 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:45.240 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18792 2024-09-13T06:42:45.240 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.240 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:45.240 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.240 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:45.240 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874371+0000", 2024-09-13T06:42:45.240 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:45.240 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.240 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.240 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:45.240 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874371+0000", 2024-09-13T06:42:45.240 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:45.240 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.240 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.241 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:45.241 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874370+0000", 2024-09-13T06:42:45.241 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:45.241 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.241 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.241 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:45.241 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874374+0000", 2024-09-13T06:42:45.241 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.7239999999999998e-06 2024-09-13T06:42:45.241 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.241 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.241 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:45.241 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874385+0000", 2024-09-13T06:42:45.241 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1293e-05 2024-09-13T06:42:45.242 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.242 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.242 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:45.242 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874394+0000", 2024-09-13T06:42:45.242 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.0729999999999994e-06 2024-09-13T06:42:45.242 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.242 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.242 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:45.242 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.975850+0000", 2024-09-13T06:42:45.242 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10145599700000001 2024-09-13T06:42:45.242 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.242 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.243 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:45.243 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.975963+0000", 2024-09-13T06:42:45.243 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000112689 2024-09-13T06:42:45.243 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.243 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.243 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:45.243 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.976107+0000", 2024-09-13T06:42:45.243 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000143836 2024-09-13T06:42:45.243 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:45.243 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:45.243 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:45.243 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.243 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.243 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18793 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 5840896~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:42:45.244 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.874401+0000", 2024-09-13T06:42:45.244 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 173.30720726000001, 2024-09-13T06:42:45.244 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.102005516, 2024-09-13T06:42:45.244 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:45.244 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:45.244 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:45.244 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:45.244 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:45.244 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18793 2024-09-13T06:42:45.244 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.244 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:45.244 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.244 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:45.245 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874401+0000", 2024-09-13T06:42:45.245 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:45.245 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.245 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.245 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:45.245 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874401+0000", 2024-09-13T06:42:45.245 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:45.245 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.245 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.245 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:45.245 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874400+0000", 2024-09-13T06:42:45.245 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:42:45.246 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.246 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.246 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:45.246 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874404+0000", 2024-09-13T06:42:45.246 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0069999999999999e-06 2024-09-13T06:42:45.246 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.246 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.246 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:45.246 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874412+0000", 2024-09-13T06:42:45.246 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.5399999999999996e-06 2024-09-13T06:42:45.246 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.246 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.246 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:45.246 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874420+0000", 2024-09-13T06:42:45.247 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.6199999999999999e-06 2024-09-13T06:42:45.247 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.247 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.247 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:45.247 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.976150+0000", 2024-09-13T06:42:45.247 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101729874 2024-09-13T06:42:45.247 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.247 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.247 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:45.247 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.976261+0000", 2024-09-13T06:42:45.247 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000110819 2024-09-13T06:42:45.247 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.248 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.248 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:45.248 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.976406+0000", 2024-09-13T06:42:45.248 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000145489 2024-09-13T06:42:45.248 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:45.248 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:45.248 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:45.248 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.248 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.248 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18803 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 6127616~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:42:45.248 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.877851+0000", 2024-09-13T06:42:45.248 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 173.30375676700001, 2024-09-13T06:42:45.248 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101951584, 2024-09-13T06:42:45.249 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:45.249 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:45.249 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:45.249 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:45.249 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:45.249 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18803 2024-09-13T06:42:45.249 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.249 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:45.249 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.249 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:45.249 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.877851+0000", 2024-09-13T06:42:45.249 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:45.250 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.250 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.250 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:45.250 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.877851+0000", 2024-09-13T06:42:45.250 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:45.250 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.250 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.250 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:45.250 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.877851+0000", 2024-09-13T06:42:45.250 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:45.250 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.250 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.250 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:45.250 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.877854+0000", 2024-09-13T06:42:45.251 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.7929999999999999e-06 2024-09-13T06:42:45.251 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.251 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.251 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:45.251 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.877864+0000", 2024-09-13T06:42:45.251 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.2029999999999998e-06 2024-09-13T06:42:45.251 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.251 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.251 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:45.251 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.877873+0000", 2024-09-13T06:42:45.251 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.0440000000000001e-06 2024-09-13T06:42:45.251 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.251 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.251 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:45.252 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.979544+0000", 2024-09-13T06:42:45.252 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101671198 2024-09-13T06:42:45.252 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.252 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.252 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:45.252 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.979658+0000", 2024-09-13T06:42:45.252 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000114456 2024-09-13T06:42:45.252 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.252 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.252 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:45.252 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.979803+0000", 2024-09-13T06:42:45.252 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000144506 2024-09-13T06:42:45.252 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:45.252 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:45.252 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:45.253 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.253 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.253 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18807 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 6242304~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:42:45.253 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.879235+0000", 2024-09-13T06:42:45.253 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 173.30237273700001, 2024-09-13T06:42:45.253 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101781258, 2024-09-13T06:42:45.253 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:45.253 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:45.253 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:45.253 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:45.253 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:45.253 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18807 2024-09-13T06:42:45.253 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.254 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:45.254 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.254 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:45.254 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879235+0000", 2024-09-13T06:42:45.254 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:45.254 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.254 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.254 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:45.254 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879235+0000", 2024-09-13T06:42:45.254 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:45.254 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.254 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.254 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:45.255 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879235+0000", 2024-09-13T06:42:45.255 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:45.255 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.255 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.255 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:45.255 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879239+0000", 2024-09-13T06:42:45.255 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.963e-06 2024-09-13T06:42:45.255 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.255 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.255 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:45.255 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879247+0000", 2024-09-13T06:42:45.255 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6470000000000004e-06 2024-09-13T06:42:45.255 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.255 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.255 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:45.256 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879255+0000", 2024-09-13T06:42:45.256 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5429999999999996e-06 2024-09-13T06:42:45.256 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.256 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.256 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:45.256 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.980756+0000", 2024-09-13T06:42:45.256 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10150165999999999 2024-09-13T06:42:45.256 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.256 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.256 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:45.256 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.980868+0000", 2024-09-13T06:42:45.256 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000111196 2024-09-13T06:42:45.256 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.257 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.257 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:45.257 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.981017+0000", 2024-09-13T06:42:45.257 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000148846 2024-09-13T06:42:45.257 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:45.257 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:45.257 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:45.257 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.257 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.257 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18808 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 6270976~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:42:45.257 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.879261+0000", 2024-09-13T06:42:45.257 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 173.30234659800001, 2024-09-13T06:42:45.257 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.102057547, 2024-09-13T06:42:45.258 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:45.258 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:45.258 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:45.258 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:45.258 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:45.258 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18808 2024-09-13T06:42:45.258 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.258 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:45.258 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.258 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:45.258 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879261+0000", 2024-09-13T06:42:45.258 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:45.258 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.258 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.258 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:45.259 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879261+0000", 2024-09-13T06:42:45.259 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:45.259 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.259 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.259 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:45.259 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879261+0000", 2024-09-13T06:42:45.259 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:45.259 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.259 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.259 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:45.259 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879264+0000", 2024-09-13T06:42:45.259 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.523e-06 2024-09-13T06:42:45.259 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.259 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.260 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:45.260 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879273+0000", 2024-09-13T06:42:45.260 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6070000000000008e-06 2024-09-13T06:42:45.260 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.260 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.260 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:45.260 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879280+0000", 2024-09-13T06:42:45.260 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.4699999999999996e-06 2024-09-13T06:42:45.260 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.260 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.260 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:45.260 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.981060+0000", 2024-09-13T06:42:45.260 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10177934800000001 2024-09-13T06:42:45.261 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.261 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.261 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:45.261 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.981174+0000", 2024-09-13T06:42:45.261 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000114456 2024-09-13T06:42:45.261 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.261 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.261 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:45.261 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.981319+0000", 2024-09-13T06:42:45.261 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00014473900000000001 2024-09-13T06:42:45.261 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:45.261 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:45.261 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:45.262 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.262 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.262 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18811 3.9 3.140f5209 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:42:45.262 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.880449+0000", 2024-09-13T06:42:45.262 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 173.30115906, 2024-09-13T06:42:45.262 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101739355, 2024-09-13T06:42:45.262 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:45.262 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:42:45.262 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:45.262 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:45.262 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:45.262 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18811 2024-09-13T06:42:45.262 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.263 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:45.263 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.263 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:45.263 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880449+0000", 2024-09-13T06:42:45.263 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:45.263 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.263 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.263 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:45.263 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880449+0000", 2024-09-13T06:42:45.263 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:45.263 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.263 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.263 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:45.264 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880448+0000", 2024-09-13T06:42:45.264 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:42:45.264 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.264 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.264 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:45.264 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880452+0000", 2024-09-13T06:42:45.264 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0470000000000004e-06 2024-09-13T06:42:45.264 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.264 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.264 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:45.264 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880462+0000", 2024-09-13T06:42:45.264 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6530000000000006e-06 2024-09-13T06:42:45.264 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.264 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.264 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:45.265 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880472+0000", 2024-09-13T06:42:45.265 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0027000000000001e-05 2024-09-13T06:42:45.265 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.265 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.265 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:45.265 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.982172+0000", 2024-09-13T06:42:45.265 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10170043500000001 2024-09-13T06:42:45.265 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.265 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.265 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:45.265 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.982188+0000", 2024-09-13T06:42:45.265 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6172999999999999e-05 2024-09-13T06:42:45.265 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:45.266 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:45.266 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:45.266 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.266 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.266 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18812 3.9 3.140f5209 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:42:45.266 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.880478+0000", 2024-09-13T06:42:45.266 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 173.301129823, 2024-09-13T06:42:45.266 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10177795100000001, 2024-09-13T06:42:45.266 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:45.266 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:42:45.266 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:45.266 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:45.266 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:45.266 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18812 2024-09-13T06:42:45.267 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.267 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:45.267 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.267 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:45.267 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880478+0000", 2024-09-13T06:42:45.267 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:45.267 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.267 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.267 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:45.267 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880478+0000", 2024-09-13T06:42:45.267 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:45.267 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.267 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.267 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:45.267 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880477+0000", 2024-09-13T06:42:45.268 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:42:45.268 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.268 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.268 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:45.268 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880481+0000", 2024-09-13T06:42:45.268 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.827e-06 2024-09-13T06:42:45.268 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.268 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.268 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:45.268 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880490+0000", 2024-09-13T06:42:45.268 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6100000000000006e-06 2024-09-13T06:42:45.268 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.269 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.269 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:45.269 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880497+0000", 2024-09-13T06:42:45.269 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.7030000000000006e-06 2024-09-13T06:42:45.269 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.269 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.269 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:45.269 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.982241+0000", 2024-09-13T06:42:45.269 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10174351199999999 2024-09-13T06:42:45.269 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.269 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.269 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:45.269 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.982256+0000", 2024-09-13T06:42:45.270 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5143000000000001e-05 2024-09-13T06:42:45.270 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:45.270 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:45.270 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:45.270 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.270 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.270 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:160483 3.a 3:57f62123:::rbd_header.112138ed422:head [watch reconnect cookie 140361344088384 gen 3] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e177)", 2024-09-13T06:42:45.270 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:42:17.439011+0000", 2024-09-13T06:42:45.270 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 27.742596632000001, 2024-09-13T06:42:45.270 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.155518861, 2024-09-13T06:42:45.270 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:45.270 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:45.270 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:45.270 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:45.271 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:45.271 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 160483 2024-09-13T06:42:45.271 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.271 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:45.271 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.271 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:45.271 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:17.439011+0000", 2024-09-13T06:42:45.271 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:45.271 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.271 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.271 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:45.271 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:17.439011+0000", 2024-09-13T06:42:45.271 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:45.271 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.271 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.272 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:45.272 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:17.439009+0000", 2024-09-13T06:42:45.272 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999976 2024-09-13T06:42:45.272 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.272 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.272 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:45.272 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:17.439024+0000", 2024-09-13T06:42:45.272 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.464e-05 2024-09-13T06:42:45.272 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.272 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.272 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:45.272 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:17.439058+0000", 2024-09-13T06:42:45.272 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.4712999999999998e-05 2024-09-13T06:42:45.272 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.273 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.273 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:45.273 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:17.439085+0000", 2024-09-13T06:42:45.273 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.6216000000000001e-05 2024-09-13T06:42:45.273 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.273 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.273 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:45.273 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:17.439182+0000", 2024-09-13T06:42:45.273 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.7020000000000003e-05 2024-09-13T06:42:45.273 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.273 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.273 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:42:45.273 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:17.439204+0000", 2024-09-13T06:42:45.274 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.2276000000000002e-05 2024-09-13T06:42:45.274 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.274 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.274 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:45.274 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:18.588627+0000", 2024-09-13T06:42:45.274 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1494235829999999 2024-09-13T06:42:45.274 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.274 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.274 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for rw locks", 2024-09-13T06:42:45.274 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:18.589031+0000", 2024-09-13T06:42:45.274 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0004035 2024-09-13T06:42:45.274 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.274 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.274 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:45.275 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:18.590604+0000", 2024-09-13T06:42:45.275 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.001573234 2024-09-13T06:42:45.275 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.275 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.275 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:45.275 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:18.590791+0000", 2024-09-13T06:42:45.275 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000186701 2024-09-13T06:42:45.275 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.275 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.275 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:45.275 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:18.594530+0000", 2024-09-13T06:42:45.275 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0037394250000000002 2024-09-13T06:42:45.275 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:45.276 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:45.276 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:45.276 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:45.276 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:45.276 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:42:45.277 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-13T06:42:45.280 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-13T06:42:45.277+0000 7fa8bb18e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 36790) UID: 0 2024-09-13T06:42:45.381 INFO:tasks.ceph.osd.6.smithi139.stderr:2024-09-13T06:42:45.377+0000 7fcd02c5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26385) UID: 0 2024-09-13T06:42:45.403 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:42:45.403 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [], 2024-09-13T06:42:45.403 INFO:teuthology.orchestra.run.smithi139.stdout: "num_ops": 0 2024-09-13T06:42:45.403 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:42:45.417 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-13T06:42:45.481 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:42:45.476+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:42:45.582 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:42:45.580+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:42:45.584 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:42:45.584 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [], 2024-09-13T06:42:45.584 INFO:teuthology.orchestra.run.smithi139.stdout: "complaint_time": 30, 2024-09-13T06:42:45.584 INFO:teuthology.orchestra.run.smithi139.stdout: "num_blocked_ops": 0 2024-09-13T06:42:45.584 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:42:45.600 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-13T06:42:45.683 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-13T06:42:45.677+0000 7fa8bb18e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 36790) UID: 0 2024-09-13T06:42:45.686 INFO:teuthology.orchestra.run.smithi081.stderr:set osd.4 primary-affinity to 0.649204 (8425462) 2024-09-13T06:42:45.725 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:42:45.726 INFO:teuthology.orchestra.run.smithi139.stdout: "size": 20, 2024-09-13T06:42:45.726 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 600, 2024-09-13T06:42:45.726 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [ 2024-09-13T06:42:45.726 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.726 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43282 3.1d 3:bd80bfb3:::rbd_object_map.11212f44bfb1.0000000000000020:head [call rbd.object_map_update in=20b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:42:45.726 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589032+0000", 2024-09-13T06:42:45.726 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 144.13483134200001, 2024-09-13T06:42:45.726 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.076225263000000001, 2024-09-13T06:42:45.726 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:45.726 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:42:45.726 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:45.726 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:45.727 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:45.727 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43282 2024-09-13T06:42:45.727 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.727 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:45.727 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.727 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:45.727 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589032+0000", 2024-09-13T06:42:45.727 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:45.727 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.728 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.728 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:45.728 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589032+0000", 2024-09-13T06:42:45.728 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:45.728 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.728 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.728 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:45.728 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589031+0000", 2024-09-13T06:42:45.728 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:42:45.728 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.728 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.728 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:45.729 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589036+0000", 2024-09-13T06:42:45.729 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.2619999999999998e-06 2024-09-13T06:42:45.729 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.729 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.729 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:45.729 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589046+0000", 2024-09-13T06:42:45.729 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.8099999999999992e-06 2024-09-13T06:42:45.729 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.730 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.730 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:45.730 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589054+0000", 2024-09-13T06:42:45.730 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.2230000000000007e-06 2024-09-13T06:42:45.730 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.730 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.730 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:45.730 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.660691+0000", 2024-09-13T06:42:45.730 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.07163659 2024-09-13T06:42:45.730 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.730 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.730 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:45.730 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.660850+0000", 2024-09-13T06:42:45.730 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00015864300000000001 2024-09-13T06:42:45.731 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.731 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.731 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 4", 2024-09-13T06:42:45.731 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.661729+0000", 2024-09-13T06:42:45.731 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00087956099999999995 2024-09-13T06:42:45.731 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.731 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.731 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:42:45.731 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.664409+0000", 2024-09-13T06:42:45.731 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0026803479999999999 2024-09-13T06:42:45.731 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.731 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.732 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-13T06:42:45.732 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.665088+0000", 2024-09-13T06:42:45.732 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00067901400000000003 2024-09-13T06:42:45.732 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.732 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.732 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-13T06:42:45.732 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.665181+0000", 2024-09-13T06:42:45.732 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.2050000000000001e-05 2024-09-13T06:42:45.732 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.732 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.732 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:45.732 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.665257+0000", 2024-09-13T06:42:45.732 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.6698000000000003e-05 2024-09-13T06:42:45.733 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:45.733 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:45.733 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:45.733 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.733 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.733 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43290 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 299008~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:42:45.733 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589500+0000", 2024-09-13T06:42:45.733 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 144.13436318000001, 2024-09-13T06:42:45.733 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.075898564000000002, 2024-09-13T06:42:45.733 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:45.733 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:45.734 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:45.734 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:45.734 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:45.734 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43290 2024-09-13T06:42:45.734 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.734 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:45.734 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.734 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:45.734 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589500+0000", 2024-09-13T06:42:45.734 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:45.735 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.735 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.735 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:45.735 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589500+0000", 2024-09-13T06:42:45.735 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:45.735 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.735 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.735 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:45.735 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589499+0000", 2024-09-13T06:42:45.736 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:42:45.736 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.736 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.736 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:45.736 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589503+0000", 2024-09-13T06:42:45.736 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.8330000000000004e-06 2024-09-13T06:42:45.736 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.736 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.736 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:45.736 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589511+0000", 2024-09-13T06:42:45.736 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.3359999999999995e-06 2024-09-13T06:42:45.736 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.736 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.736 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:45.737 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589519+0000", 2024-09-13T06:42:45.737 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.4760000000000001e-06 2024-09-13T06:42:45.737 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.737 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.737 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:45.737 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.665097+0000", 2024-09-13T06:42:45.737 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.075577828999999999 2024-09-13T06:42:45.737 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.737 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.737 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:45.737 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.665170+0000", 2024-09-13T06:42:45.737 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.3745000000000006e-05 2024-09-13T06:42:45.737 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.738 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.738 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:45.738 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.665399+0000", 2024-09-13T06:42:45.738 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00022826199999999999 2024-09-13T06:42:45.738 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:45.738 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:45.738 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:45.738 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.738 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.738 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43291 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 313344~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:42:45.738 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589560+0000", 2024-09-13T06:42:45.738 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 144.134302959, 2024-09-13T06:42:45.738 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.076145594999999996, 2024-09-13T06:42:45.739 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:45.739 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:45.739 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:45.739 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:45.739 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:45.739 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43291 2024-09-13T06:42:45.739 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.739 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:45.739 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.739 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:45.739 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589560+0000", 2024-09-13T06:42:45.739 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:45.739 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.740 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.740 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:45.740 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589560+0000", 2024-09-13T06:42:45.740 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:45.740 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.740 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.740 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:45.740 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589559+0000", 2024-09-13T06:42:45.740 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:42:45.740 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.740 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.740 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:45.740 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589564+0000", 2024-09-13T06:42:45.740 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.3989999999999997e-06 2024-09-13T06:42:45.741 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.741 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.741 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:45.741 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589574+0000", 2024-09-13T06:42:45.741 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0502999999999999e-05 2024-09-13T06:42:45.741 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.741 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.741 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:45.741 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589582+0000", 2024-09-13T06:42:45.741 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.1859999999999992e-06 2024-09-13T06:42:45.741 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.741 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.742 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:45.742 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.665423+0000", 2024-09-13T06:42:45.742 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.075840290000000005 2024-09-13T06:42:45.742 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.742 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.742 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:45.742 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.665496+0000", 2024-09-13T06:42:45.742 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.2791000000000002e-05 2024-09-13T06:42:45.742 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.742 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.743 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:45.743 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.665706+0000", 2024-09-13T06:42:45.743 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00021038200000000001 2024-09-13T06:42:45.743 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:45.743 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:45.743 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:45.743 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.743 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.743 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43292 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 327680~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:42:45.743 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589589+0000", 2024-09-13T06:42:45.743 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 144.13427441799999, 2024-09-13T06:42:45.743 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.076769537999999998, 2024-09-13T06:42:45.743 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:45.744 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:45.744 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:45.744 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:45.744 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:45.744 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43292 2024-09-13T06:42:45.744 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.744 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:45.744 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.744 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:45.744 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589589+0000", 2024-09-13T06:42:45.744 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:45.744 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.744 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.744 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:45.745 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589589+0000", 2024-09-13T06:42:45.745 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:45.745 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.745 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.745 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:45.745 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589588+0000", 2024-09-13T06:42:45.745 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:45.745 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.745 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.745 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:45.745 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589592+0000", 2024-09-13T06:42:45.746 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.6389999999999998e-06 2024-09-13T06:42:45.746 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.746 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.746 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:45.747 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589600+0000", 2024-09-13T06:42:45.747 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.4630000000000001e-06 2024-09-13T06:42:45.747 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.747 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.747 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:45.747 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589608+0000", 2024-09-13T06:42:45.747 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.2359999999999998e-06 2024-09-13T06:42:45.747 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.747 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.747 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:45.747 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.665779+0000", 2024-09-13T06:42:45.747 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.076170924000000001 2024-09-13T06:42:45.748 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.748 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.748 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:45.748 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.665977+0000", 2024-09-13T06:42:45.748 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00019891900000000001 2024-09-13T06:42:45.748 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.748 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.748 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:45.748 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.666358+0000", 2024-09-13T06:42:45.749 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000380963 2024-09-13T06:42:45.749 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:45.749 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:45.749 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:45.749 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.749 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.749 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43293 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 342016~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:42:45.749 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589616+0000", 2024-09-13T06:42:45.749 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 144.13424752399999, 2024-09-13T06:42:45.749 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.077030083999999999, 2024-09-13T06:42:45.749 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:45.750 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:45.750 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:45.750 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:45.750 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:45.750 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43293 2024-09-13T06:42:45.750 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.750 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:45.750 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.751 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:45.751 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589616+0000", 2024-09-13T06:42:45.751 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:45.751 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.751 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.751 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:45.751 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589616+0000", 2024-09-13T06:42:45.751 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:45.751 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.751 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.751 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:45.751 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589615+0000", 2024-09-13T06:42:45.751 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:42:45.752 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.752 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.752 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:45.752 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589619+0000", 2024-09-13T06:42:45.752 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.9559999999999999e-06 2024-09-13T06:42:45.752 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.752 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.752 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:45.752 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589627+0000", 2024-09-13T06:42:45.752 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.2490000000000001e-06 2024-09-13T06:42:45.752 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.752 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.753 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:45.753 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589635+0000", 2024-09-13T06:42:45.753 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.96e-06 2024-09-13T06:42:45.753 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.753 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.753 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:45.753 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.666379+0000", 2024-09-13T06:42:45.753 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.076744484000000002 2024-09-13T06:42:45.753 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.753 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.753 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:45.753 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.666454+0000", 2024-09-13T06:42:45.753 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.4623999999999996e-05 2024-09-13T06:42:45.754 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.754 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.754 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:45.754 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.666646+0000", 2024-09-13T06:42:45.754 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00019176999999999999 2024-09-13T06:42:45.754 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:45.754 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:45.754 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:45.754 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.754 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.754 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43294 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 356352~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:42:45.755 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589681+0000", 2024-09-13T06:42:45.755 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 144.13418220899999, 2024-09-13T06:42:45.755 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.077594648000000002, 2024-09-13T06:42:45.755 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:45.755 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:45.755 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:45.755 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:45.755 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:45.755 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43294 2024-09-13T06:42:45.755 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.755 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:45.755 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.756 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:45.756 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589681+0000", 2024-09-13T06:42:45.756 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:45.756 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.756 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.756 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:45.756 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589681+0000", 2024-09-13T06:42:45.756 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:45.756 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.756 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.756 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:45.756 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589680+0000", 2024-09-13T06:42:45.756 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:42:45.757 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.757 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.757 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:45.757 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589684+0000", 2024-09-13T06:42:45.757 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.8369999999999999e-06 2024-09-13T06:42:45.757 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.757 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.757 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:45.757 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589693+0000", 2024-09-13T06:42:45.757 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.1020000000000003e-06 2024-09-13T06:42:45.757 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.757 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.757 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:45.758 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589701+0000", 2024-09-13T06:42:45.758 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.8059999999999995e-06 2024-09-13T06:42:45.758 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.758 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.758 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:45.758 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.666714+0000", 2024-09-13T06:42:45.758 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.077013463000000004 2024-09-13T06:42:45.758 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.758 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.758 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:45.758 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.666897+0000", 2024-09-13T06:42:45.758 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000182268 2024-09-13T06:42:45.759 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.759 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.759 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:45.759 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.667276+0000", 2024-09-13T06:42:45.759 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00037907499999999998 2024-09-13T06:42:45.759 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:45.759 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:45.759 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:45.759 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.759 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.759 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43295 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 370688~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:42:45.759 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589744+0000", 2024-09-13T06:42:45.759 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 144.134119037, 2024-09-13T06:42:45.759 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.077854343000000006, 2024-09-13T06:42:45.760 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:45.760 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:45.760 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:45.760 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:45.760 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:45.760 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43295 2024-09-13T06:42:45.760 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.760 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:45.760 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.760 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:45.760 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589744+0000", 2024-09-13T06:42:45.761 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:45.761 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.761 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.761 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:45.761 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589744+0000", 2024-09-13T06:42:45.761 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:45.761 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.761 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.761 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:45.761 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589743+0000", 2024-09-13T06:42:45.762 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:42:45.762 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.762 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.762 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:45.762 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589747+0000", 2024-09-13T06:42:45.762 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0130000000000004e-06 2024-09-13T06:42:45.762 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.762 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.762 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:45.762 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589756+0000", 2024-09-13T06:42:45.762 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.003e-06 2024-09-13T06:42:45.762 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.762 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.762 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:45.762 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589766+0000", 2024-09-13T06:42:45.763 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.2820000000000002e-06 2024-09-13T06:42:45.763 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.763 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.763 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:45.763 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.667300+0000", 2024-09-13T06:42:45.763 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.077534299000000001 2024-09-13T06:42:45.763 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.763 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.763 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:45.763 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.667372+0000", 2024-09-13T06:42:45.763 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.2393999999999998e-05 2024-09-13T06:42:45.763 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.763 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.763 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:45.764 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.667599+0000", 2024-09-13T06:42:45.764 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000226269 2024-09-13T06:42:45.764 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:45.764 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:45.764 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:45.764 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.764 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.764 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43296 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 385024~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:42:45.764 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589772+0000", 2024-09-13T06:42:45.764 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 144.13409101299999, 2024-09-13T06:42:45.764 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.078469647000000003, 2024-09-13T06:42:45.765 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:45.765 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:45.765 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:45.765 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:45.765 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:45.765 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43296 2024-09-13T06:42:45.765 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.765 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:45.765 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.765 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:45.765 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589772+0000", 2024-09-13T06:42:45.765 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:45.765 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.766 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.766 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:45.766 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589772+0000", 2024-09-13T06:42:45.766 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:45.766 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.766 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.766 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:45.766 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589771+0000", 2024-09-13T06:42:45.766 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:42:45.766 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.766 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.766 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:45.766 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589775+0000", 2024-09-13T06:42:45.766 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.8530000000000002e-06 2024-09-13T06:42:45.767 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.767 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.767 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:45.767 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589784+0000", 2024-09-13T06:42:45.767 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.4300000000000006e-06 2024-09-13T06:42:45.767 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.767 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.767 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:45.767 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589791+0000", 2024-09-13T06:42:45.767 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.4660000000000002e-06 2024-09-13T06:42:45.767 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.767 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.767 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:45.768 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.667667+0000", 2024-09-13T06:42:45.768 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.077875697999999993 2024-09-13T06:42:45.768 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.768 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.768 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:45.768 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.667854+0000", 2024-09-13T06:42:45.768 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00018760099999999999 2024-09-13T06:42:45.768 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.768 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.768 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:45.768 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.668242+0000", 2024-09-13T06:42:45.768 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00038750600000000003 2024-09-13T06:42:45.768 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:45.768 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:45.769 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:45.769 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.769 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.769 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43297 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 403456~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:42:45.769 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589797+0000", 2024-09-13T06:42:45.769 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 144.13406630899999, 2024-09-13T06:42:45.769 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.078756672999999999, 2024-09-13T06:42:45.769 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:45.769 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:45.769 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:45.769 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:45.769 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:45.769 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43297 2024-09-13T06:42:45.770 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.770 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:45.770 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.770 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:45.770 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589797+0000", 2024-09-13T06:42:45.770 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:45.770 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.770 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.770 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:45.770 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589797+0000", 2024-09-13T06:42:45.770 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:45.770 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.770 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.771 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:45.771 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589796+0000", 2024-09-13T06:42:45.771 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:45.771 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.771 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.771 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:45.771 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589800+0000", 2024-09-13T06:42:45.771 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.3230000000000002e-06 2024-09-13T06:42:45.771 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.772 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.772 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:45.772 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589808+0000", 2024-09-13T06:42:45.772 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.2390000000000002e-06 2024-09-13T06:42:45.772 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.772 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.772 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:45.772 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589815+0000", 2024-09-13T06:42:45.772 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.413e-06 2024-09-13T06:42:45.772 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.772 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.772 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:45.773 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.668265+0000", 2024-09-13T06:42:45.773 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.078449873000000003 2024-09-13T06:42:45.773 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.773 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.773 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:45.773 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.668332+0000", 2024-09-13T06:42:45.773 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.7178e-05 2024-09-13T06:42:45.773 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.773 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.773 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:45.774 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.668554+0000", 2024-09-13T06:42:45.774 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00022128600000000001 2024-09-13T06:42:45.774 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:45.774 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:45.774 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:45.774 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.774 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.774 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43298 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 417792~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:42:45.774 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589821+0000", 2024-09-13T06:42:45.774 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 144.13404218700001, 2024-09-13T06:42:45.774 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.079368660999999993, 2024-09-13T06:42:45.774 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:45.775 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:45.775 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:45.775 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:45.775 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:45.775 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43298 2024-09-13T06:42:45.775 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.775 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:45.775 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.775 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:45.775 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589821+0000", 2024-09-13T06:42:45.775 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:45.775 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.775 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.775 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:45.776 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589821+0000", 2024-09-13T06:42:45.776 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:45.776 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.776 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.776 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:45.776 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589821+0000", 2024-09-13T06:42:45.776 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:45.776 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.776 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.776 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:45.777 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589830+0000", 2024-09-13T06:42:45.777 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.4860000000000003e-06 2024-09-13T06:42:45.777 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.777 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.777 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:45.777 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589839+0000", 2024-09-13T06:42:45.777 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.0159999999999997e-06 2024-09-13T06:42:45.777 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.777 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.777 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:45.777 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589847+0000", 2024-09-13T06:42:45.778 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.6059999999999997e-06 2024-09-13T06:42:45.778 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.778 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.778 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:45.778 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.668620+0000", 2024-09-13T06:42:45.778 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.078773485000000004 2024-09-13T06:42:45.778 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.778 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.778 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:45.778 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.668798+0000", 2024-09-13T06:42:45.778 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000178233 2024-09-13T06:42:45.778 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.778 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.779 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:45.779 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.669190+0000", 2024-09-13T06:42:45.779 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00039143499999999998 2024-09-13T06:42:45.779 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:45.779 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:45.779 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:45.779 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.779 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.779 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43299 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 432128~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:42:45.779 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589881+0000", 2024-09-13T06:42:45.779 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 144.133982339, 2024-09-13T06:42:45.779 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.079693849999999997, 2024-09-13T06:42:45.779 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:45.779 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:45.780 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:45.780 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:45.780 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:45.780 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43299 2024-09-13T06:42:45.780 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.780 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:45.780 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.780 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:45.780 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589881+0000", 2024-09-13T06:42:45.780 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:45.781 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.781 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.781 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:45.781 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589881+0000", 2024-09-13T06:42:45.781 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:45.781 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.781 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.781 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:45.781 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589880+0000", 2024-09-13T06:42:45.781 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:42:45.781 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.781 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.781 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:45.782 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589884+0000", 2024-09-13T06:42:45.782 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.053e-06 2024-09-13T06:42:45.782 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.782 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.782 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:45.782 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589893+0000", 2024-09-13T06:42:45.783 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.2129999999999997e-06 2024-09-13T06:42:45.783 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.783 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.783 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:45.783 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589901+0000", 2024-09-13T06:42:45.783 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.6399999999999997e-06 2024-09-13T06:42:45.783 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.783 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.783 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:45.783 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.669213+0000", 2024-09-13T06:42:45.783 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.079312074999999996 2024-09-13T06:42:45.783 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.783 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.784 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:45.784 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.669281+0000", 2024-09-13T06:42:45.784 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.8322000000000001e-05 2024-09-13T06:42:45.784 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.784 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.784 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:45.784 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.669575+0000", 2024-09-13T06:42:45.784 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00029349699999999999 2024-09-13T06:42:45.784 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:45.784 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:45.785 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:45.785 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.785 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.785 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43300 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 446464~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:42:45.785 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589909+0000", 2024-09-13T06:42:45.785 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 144.13395444400001, 2024-09-13T06:42:45.785 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.080339496999999996, 2024-09-13T06:42:45.785 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:45.786 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:45.786 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:45.786 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:45.786 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:45.786 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43300 2024-09-13T06:42:45.786 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.786 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:45.786 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.786 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:45.786 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589909+0000", 2024-09-13T06:42:45.786 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:45.786 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.786 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.787 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:45.787 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589909+0000", 2024-09-13T06:42:45.787 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:45.787 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.787 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.787 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:45.787 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589908+0000", 2024-09-13T06:42:45.787 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:42:45.787 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.787 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.787 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:45.787 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589912+0000", 2024-09-13T06:42:45.787 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.9430000000000002e-06 2024-09-13T06:42:45.788 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.788 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.788 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:45.788 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589920+0000", 2024-09-13T06:42:45.788 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.3860000000000007e-06 2024-09-13T06:42:45.788 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.788 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.788 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:45.788 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589928+0000", 2024-09-13T06:42:45.788 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.3329999999999999e-06 2024-09-13T06:42:45.788 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.788 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.788 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:45.788 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.669651+0000", 2024-09-13T06:42:45.789 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.079723204000000006 2024-09-13T06:42:45.789 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.789 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.789 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:45.789 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.669840+0000", 2024-09-13T06:42:45.789 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000189397 2024-09-13T06:42:45.789 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.789 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.789 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:45.789 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.670248+0000", 2024-09-13T06:42:45.789 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00040811100000000001 2024-09-13T06:42:45.789 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:45.789 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:45.789 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:45.790 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.790 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.790 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43301 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 460800~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:42:45.790 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589934+0000", 2024-09-13T06:42:45.790 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 144.13392977000001, 2024-09-13T06:42:45.790 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.080747474999999999, 2024-09-13T06:42:45.790 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:45.790 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:45.790 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:45.790 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:45.790 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:45.790 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43301 2024-09-13T06:42:45.790 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.791 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:45.791 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.791 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:45.791 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589934+0000", 2024-09-13T06:42:45.791 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:45.791 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.791 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.791 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:45.791 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589934+0000", 2024-09-13T06:42:45.791 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:45.791 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.791 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.792 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:45.792 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589933+0000", 2024-09-13T06:42:45.792 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:45.792 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.792 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.792 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:45.792 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589936+0000", 2024-09-13T06:42:45.792 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.4599999999999999e-06 2024-09-13T06:42:45.792 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.792 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.792 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:45.793 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589945+0000", 2024-09-13T06:42:45.793 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.2430000000000005e-06 2024-09-13T06:42:45.793 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.793 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.793 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:45.793 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589952+0000", 2024-09-13T06:42:45.793 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.3289999999999996e-06 2024-09-13T06:42:45.793 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.793 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.793 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:45.793 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.670280+0000", 2024-09-13T06:42:45.794 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.080328514000000004 2024-09-13T06:42:45.794 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.794 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.794 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:45.794 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.670376+0000", 2024-09-13T06:42:45.794 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.5752000000000001e-05 2024-09-13T06:42:45.794 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.794 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.794 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:45.794 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.670681+0000", 2024-09-13T06:42:45.794 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00030479699999999999 2024-09-13T06:42:45.794 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:45.794 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:45.795 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:45.795 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.795 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.795 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43302 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 475136~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:42:45.795 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589958+0000", 2024-09-13T06:42:45.795 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 144.13390570799999, 2024-09-13T06:42:45.795 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.081402394000000003, 2024-09-13T06:42:45.795 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:45.795 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:45.795 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:45.795 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:45.795 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:45.795 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43302 2024-09-13T06:42:45.796 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.796 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:45.796 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.796 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:45.796 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589958+0000", 2024-09-13T06:42:45.796 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:45.796 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.796 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.796 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:45.796 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589958+0000", 2024-09-13T06:42:45.796 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:45.796 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.796 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.797 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:45.797 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589957+0000", 2024-09-13T06:42:45.797 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:45.797 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.797 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.797 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:45.797 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589960+0000", 2024-09-13T06:42:45.797 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.4939999999999999e-06 2024-09-13T06:42:45.797 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.797 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.797 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:45.797 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589969+0000", 2024-09-13T06:42:45.798 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.3520000000000007e-06 2024-09-13T06:42:45.798 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.798 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.798 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:45.798 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589976+0000", 2024-09-13T06:42:45.798 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.3030000000000002e-06 2024-09-13T06:42:45.798 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.798 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.798 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:45.798 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.670765+0000", 2024-09-13T06:42:45.798 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.080789154000000002 2024-09-13T06:42:45.798 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.798 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.799 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:45.799 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.670960+0000", 2024-09-13T06:42:45.799 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00019464300000000001 2024-09-13T06:42:45.799 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.799 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.799 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:45.799 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.671360+0000", 2024-09-13T06:42:45.799 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00040005200000000002 2024-09-13T06:42:45.799 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:45.799 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:45.799 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:45.799 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.799 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.799 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43303 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 489472~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:42:45.800 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589985+0000", 2024-09-13T06:42:45.800 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 144.13387875999999, 2024-09-13T06:42:45.800 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.082024333000000005, 2024-09-13T06:42:45.800 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:45.800 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:45.800 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:45.800 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:45.800 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:45.800 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43303 2024-09-13T06:42:45.800 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.800 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:45.800 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.800 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:45.801 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589985+0000", 2024-09-13T06:42:45.801 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:45.801 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.801 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.801 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:45.801 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589985+0000", 2024-09-13T06:42:45.801 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:45.801 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.801 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.801 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:45.801 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589984+0000", 2024-09-13T06:42:45.801 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:42:45.801 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.802 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.802 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:45.802 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589987+0000", 2024-09-13T06:42:45.802 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.726e-06 2024-09-13T06:42:45.802 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.802 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.802 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:45.802 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589996+0000", 2024-09-13T06:42:45.802 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.5459999999999992e-06 2024-09-13T06:42:45.802 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.802 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.802 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:45.802 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590003+0000", 2024-09-13T06:42:45.802 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.4229999999999999e-06 2024-09-13T06:42:45.803 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.803 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.803 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:45.803 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.671426+0000", 2024-09-13T06:42:45.803 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.081422704999999998 2024-09-13T06:42:45.803 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.803 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.803 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:45.803 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.671615+0000", 2024-09-13T06:42:45.804 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000188875 2024-09-13T06:42:45.804 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.804 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.804 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:45.804 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.672009+0000", 2024-09-13T06:42:45.804 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000394015 2024-09-13T06:42:45.804 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:45.804 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:45.804 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:45.804 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.804 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.804 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43304 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 503808~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:42:45.805 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.590039+0000", 2024-09-13T06:42:45.805 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 144.133824215, 2024-09-13T06:42:45.805 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.082573880000000002, 2024-09-13T06:42:45.805 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:45.805 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:45.805 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:45.805 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:45.805 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:45.805 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43304 2024-09-13T06:42:45.805 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.805 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:45.805 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.805 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:45.806 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590039+0000", 2024-09-13T06:42:45.806 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:45.806 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.806 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.806 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:45.806 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590039+0000", 2024-09-13T06:42:45.806 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:45.806 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.806 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.806 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:45.807 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590038+0000", 2024-09-13T06:42:45.807 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:42:45.807 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.807 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.807 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:45.807 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590042+0000", 2024-09-13T06:42:45.807 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.9500000000000003e-06 2024-09-13T06:42:45.807 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.807 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.807 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:45.807 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590052+0000", 2024-09-13T06:42:45.807 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.3919999999999992e-06 2024-09-13T06:42:45.808 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.808 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.808 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:45.808 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590059+0000", 2024-09-13T06:42:45.808 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.7970000000000001e-06 2024-09-13T06:42:45.808 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.808 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.808 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:45.808 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.672078+0000", 2024-09-13T06:42:45.808 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.082018778000000001 2024-09-13T06:42:45.808 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.808 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.808 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:45.808 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.672266+0000", 2024-09-13T06:42:45.809 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00018807399999999999 2024-09-13T06:42:45.809 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.809 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.809 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:45.809 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.672613+0000", 2024-09-13T06:42:45.809 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00034677599999999997 2024-09-13T06:42:45.809 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:45.809 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:45.809 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:45.809 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.809 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.810 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43305 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 518144~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:42:45.810 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.590136+0000", 2024-09-13T06:42:45.810 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 144.13372702699999, 2024-09-13T06:42:45.810 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.082988206999999994, 2024-09-13T06:42:45.810 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:45.810 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:45.810 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:45.810 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:45.810 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:45.810 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43305 2024-09-13T06:42:45.810 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.810 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:45.810 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.811 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:45.811 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590136+0000", 2024-09-13T06:42:45.811 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:45.811 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.811 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.811 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:45.811 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590136+0000", 2024-09-13T06:42:45.811 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:45.811 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.811 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.811 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:45.811 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590135+0000", 2024-09-13T06:42:45.811 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:42:45.811 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.812 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.812 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:45.812 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590139+0000", 2024-09-13T06:42:45.812 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.9489999999999998e-06 2024-09-13T06:42:45.812 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.812 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.812 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:45.812 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590148+0000", 2024-09-13T06:42:45.812 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.9830000000000002e-06 2024-09-13T06:42:45.812 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.812 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.812 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:45.812 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590156+0000", 2024-09-13T06:42:45.813 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5229999999999998e-06 2024-09-13T06:42:45.813 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.813 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.813 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:45.813 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.672709+0000", 2024-09-13T06:42:45.813 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.082552886000000006 2024-09-13T06:42:45.813 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.813 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.813 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:45.813 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.672816+0000", 2024-09-13T06:42:45.813 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000107736 2024-09-13T06:42:45.813 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.813 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.814 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:45.814 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.673124+0000", 2024-09-13T06:42:45.814 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00030804900000000002 2024-09-13T06:42:45.814 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:45.814 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:45.814 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:45.814 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.814 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.814 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:66818 3.17 3.50afe697 (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e100)", 2024-09-13T06:42:45.815 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:53.498942+0000", 2024-09-13T06:42:45.815 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 112.224920842, 2024-09-13T06:42:45.815 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.011231284, 2024-09-13T06:42:45.815 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:45.815 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:42:45.815 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:45.815 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:45.815 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:45.815 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 66818 2024-09-13T06:42:45.815 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.815 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:45.815 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.815 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:45.815 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:53.498942+0000", 2024-09-13T06:42:45.816 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:45.816 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.816 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.816 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:45.816 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:53.498942+0000", 2024-09-13T06:42:45.816 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:45.816 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.816 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.816 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:45.816 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:53.498939+0000", 2024-09-13T06:42:45.816 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999967 2024-09-13T06:42:45.816 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.816 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.816 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:45.817 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:53.498954+0000", 2024-09-13T06:42:45.817 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5028000000000001e-05 2024-09-13T06:42:45.817 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.817 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.817 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:45.817 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:53.498986+0000", 2024-09-13T06:42:45.817 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.1993999999999999e-05 2024-09-13T06:42:45.817 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.817 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.817 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:45.817 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:53.499001+0000", 2024-09-13T06:42:45.817 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5166e-05 2024-09-13T06:42:45.817 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.818 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.818 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:45.818 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:53.505097+0000", 2024-09-13T06:42:45.818 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0060955610000000002 2024-09-13T06:42:45.818 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.818 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.818 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:42:45.818 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:53.505108+0000", 2024-09-13T06:42:45.818 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.084e-05 2024-09-13T06:42:45.818 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.818 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.818 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:45.818 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:54.510158+0000", 2024-09-13T06:42:45.818 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0050497549999999 2024-09-13T06:42:45.818 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.819 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.819 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:45.819 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:54.510174+0000", 2024-09-13T06:42:45.819 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6164e-05 2024-09-13T06:42:45.819 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:45.819 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:45.819 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:45.819 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.819 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.819 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:69764 3.2 3:47f10058:::rbd_data.11214956a993.0000000000000004:head [write-same] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e117)", 2024-09-13T06:42:45.819 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:41:11.371147+0000", 2024-09-13T06:42:45.819 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 94.352716532000002, 2024-09-13T06:42:45.819 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.03470167, 2024-09-13T06:42:45.819 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:45.820 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:42:45.820 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:45.820 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:45.820 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:45.820 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 69764 2024-09-13T06:42:45.820 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.820 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:45.820 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.820 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:45.820 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:11.371147+0000", 2024-09-13T06:42:45.820 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:45.820 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.820 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.820 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:45.821 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:11.371147+0000", 2024-09-13T06:42:45.821 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:45.821 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.821 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.821 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:45.821 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:11.371144+0000", 2024-09-13T06:42:45.821 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999967 2024-09-13T06:42:45.821 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.821 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.821 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:45.821 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:11.371161+0000", 2024-09-13T06:42:45.821 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7669e-05 2024-09-13T06:42:45.821 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.821 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.822 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:45.822 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:11.371198+0000", 2024-09-13T06:42:45.822 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.7014000000000002e-05 2024-09-13T06:42:45.822 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.822 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.822 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:45.822 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:11.371216+0000", 2024-09-13T06:42:45.822 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7425e-05 2024-09-13T06:42:45.822 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.822 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.822 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:45.822 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:11.371365+0000", 2024-09-13T06:42:45.822 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000149245 2024-09-13T06:42:45.823 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.823 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.823 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op must wait for map", 2024-09-13T06:42:45.823 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:11.371385+0000", 2024-09-13T06:42:45.823 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.0018999999999999e-05 2024-09-13T06:42:45.823 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.823 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.823 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:45.823 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:11.378406+0000", 2024-09-13T06:42:45.823 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0070207179999999996 2024-09-13T06:42:45.824 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.824 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.824 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:42:45.824 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:11.378429+0000", 2024-09-13T06:42:45.824 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.3453999999999999e-05 2024-09-13T06:42:45.824 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.824 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.824 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:45.824 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:12.405667+0000", 2024-09-13T06:42:45.825 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0272381690000001 2024-09-13T06:42:45.825 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.825 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.825 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:45.825 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:12.405848+0000", 2024-09-13T06:42:45.825 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00018112 2024-09-13T06:42:45.825 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:45.825 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:45.825 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:45.825 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.825 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.825 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:70346 3.16 3:69d35907:::rbd_object_map.11214956a993:head [read 0~36] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e122)", 2024-09-13T06:42:45.826 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:41:16.390917+0000", 2024-09-13T06:42:45.826 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 89.332946480000004, 2024-09-13T06:42:45.826 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.99327479799999996, 2024-09-13T06:42:45.826 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:45.826 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:45.826 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:45.826 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:45.826 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:45.826 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 70346 2024-09-13T06:42:45.826 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.826 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:45.826 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.827 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:45.827 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:16.390917+0000", 2024-09-13T06:42:45.827 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:45.827 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.827 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.827 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:45.827 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:16.390917+0000", 2024-09-13T06:42:45.827 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:45.827 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.827 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.827 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:45.828 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:16.390916+0000", 2024-09-13T06:42:45.828 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999986 2024-09-13T06:42:45.828 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.828 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.828 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:45.828 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:16.390922+0000", 2024-09-13T06:42:45.828 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.0480000000000004e-06 2024-09-13T06:42:45.828 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.828 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.828 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:45.828 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:16.390933+0000", 2024-09-13T06:42:45.828 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1387e-05 2024-09-13T06:42:45.829 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.829 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.829 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:45.829 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:16.390939+0000", 2024-09-13T06:42:45.829 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.8039999999999998e-06 2024-09-13T06:42:45.829 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.829 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.829 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:45.829 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:16.390983+0000", 2024-09-13T06:42:45.829 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.4663000000000003e-05 2024-09-13T06:42:45.829 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.829 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.829 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:42:45.829 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:16.390991+0000", 2024-09-13T06:42:45.830 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.8059999999999995e-06 2024-09-13T06:42:45.830 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.830 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.830 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:45.830 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:17.383624+0000", 2024-09-13T06:42:45.830 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.99263277299999997 2024-09-13T06:42:45.830 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.830 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.831 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:45.831 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:17.383891+0000", 2024-09-13T06:42:45.831 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00026717599999999999 2024-09-13T06:42:45.831 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:45.831 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:45.831 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:45.831 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:17.384192+0000", 2024-09-13T06:42:45.831 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00030047400000000001 2024-09-13T06:42:45.831 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:45.831 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:45.831 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:45.831 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:45.832 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:45.832 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:42:45.833 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-13T06:42:45.834 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:42:45.828+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:42:45.934 INFO:tasks.ceph.osd.6.smithi139.stderr:2024-09-13T06:42:45.929+0000 7fcd02c5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26385) UID: 0 2024-09-13T06:42:46.007 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:42:46.007 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [], 2024-09-13T06:42:46.007 INFO:teuthology.orchestra.run.smithi139.stdout: "num_ops": 0 2024-09-13T06:42:46.007 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:42:46.021 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-13T06:42:46.036 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:42:46.036+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:42:46.136 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:42:46.133+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:42:46.189 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:42:46.189 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [], 2024-09-13T06:42:46.189 INFO:teuthology.orchestra.run.smithi139.stdout: "complaint_time": 30, 2024-09-13T06:42:46.189 INFO:teuthology.orchestra.run.smithi139.stdout: "num_blocked_ops": 0 2024-09-13T06:42:46.189 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:42:46.204 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-13T06:42:46.237 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:42:46.236+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:42:46.338 INFO:tasks.ceph.osd.6.smithi139.stderr:2024-09-13T06:42:46.333+0000 7fcd02c5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26385) UID: 0 2024-09-13T06:42:46.374 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:42:46.374 INFO:teuthology.orchestra.run.smithi139.stdout: "size": 20, 2024-09-13T06:42:46.374 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 600, 2024-09-13T06:42:46.374 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [ 2024-09-13T06:42:46.374 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:46.374 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27854 3.a 3:537b3559:::rbd_data.1121f2c5ee81.0000000000000016:13 [read 335872~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:42:46.374 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.658750+0000", 2024-09-13T06:42:46.374 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 169.713918081, 2024-09-13T06:42:46.375 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.037969532, 2024-09-13T06:42:46.375 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:46.375 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:46.375 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:46.375 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:46.375 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:46.375 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27854 2024-09-13T06:42:46.375 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:46.375 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:46.375 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:46.375 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:46.375 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658750+0000", 2024-09-13T06:42:46.375 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:46.376 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:46.376 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:46.376 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:46.376 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658750+0000", 2024-09-13T06:42:46.376 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:46.376 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:46.376 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:46.376 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:46.376 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658749+0000", 2024-09-13T06:42:46.376 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:46.376 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:46.376 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:46.376 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:46.377 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658757+0000", 2024-09-13T06:42:46.377 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.7389999999999999e-06 2024-09-13T06:42:46.377 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:46.377 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:46.377 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:46.377 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658763+0000", 2024-09-13T06:42:46.377 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.7769999999999999e-06 2024-09-13T06:42:46.377 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:46.377 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:46.377 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:46.377 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658767+0000", 2024-09-13T06:42:46.377 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.1749999999999998e-06 2024-09-13T06:42:46.377 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:46.378 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:46.378 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:46.378 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.696322+0000", 2024-09-13T06:42:46.378 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.037554772 2024-09-13T06:42:46.378 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:46.378 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:46.378 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:46.378 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.696418+0000", 2024-09-13T06:42:46.378 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6050000000000004e-05 2024-09-13T06:42:46.378 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:46.378 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:46.378 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:46.378 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.696719+0000", 2024-09-13T06:42:46.378 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00030138499999999999 2024-09-13T06:42:46.378 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:46.379 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:46.379 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:46.379 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:46.379 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:46.379 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27855 3.a 3:537b3559:::rbd_data.1121f2c5ee81.0000000000000016:13 [read 380928~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:42:46.379 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.658771+0000", 2024-09-13T06:42:46.379 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 169.71389683699999, 2024-09-13T06:42:46.379 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.038326354, 2024-09-13T06:42:46.379 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:46.379 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:46.379 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:46.379 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:46.379 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:46.380 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27855 2024-09-13T06:42:46.380 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:46.380 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:46.380 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:46.380 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:46.380 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658771+0000", 2024-09-13T06:42:46.380 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:46.380 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:46.380 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:46.380 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:46.380 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658771+0000", 2024-09-13T06:42:46.380 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:46.380 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:46.380 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:46.381 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:46.381 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658770+0000", 2024-09-13T06:42:46.381 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:46.381 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:46.381 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:46.381 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:46.381 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658772+0000", 2024-09-13T06:42:46.381 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.0930000000000001e-06 2024-09-13T06:42:46.381 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:46.381 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:46.381 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:46.381 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658778+0000", 2024-09-13T06:42:46.381 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.2730000000000002e-06 2024-09-13T06:42:46.382 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:46.382 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:46.382 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:46.382 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658782+0000", 2024-09-13T06:42:46.382 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0879999999999997e-06 2024-09-13T06:42:46.382 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:46.382 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:46.382 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:46.382 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.696770+0000", 2024-09-13T06:42:46.382 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.037988145000000001 2024-09-13T06:42:46.382 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:46.382 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:46.382 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:46.382 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.696852+0000", 2024-09-13T06:42:46.382 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.2039999999999994e-05 2024-09-13T06:42:46.382 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:46.383 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:46.383 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:46.383 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.697097+0000", 2024-09-13T06:42:46.383 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00024508800000000002 2024-09-13T06:42:46.383 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:46.383 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:46.383 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:46.383 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:46.383 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:46.383 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27856 3.a 3:537b3559:::rbd_data.1121f2c5ee81.0000000000000016:13 [read 405504~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:42:46.383 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.658786+0000", 2024-09-13T06:42:46.383 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 169.71388172100001, 2024-09-13T06:42:46.383 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.038736029999999998, 2024-09-13T06:42:46.383 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:46.384 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:46.384 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:46.384 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:46.384 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:46.384 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27856 2024-09-13T06:42:46.384 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:46.384 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:46.384 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:46.384 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:46.384 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658786+0000", 2024-09-13T06:42:46.384 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:46.384 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:46.384 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:46.385 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:46.385 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658786+0000", 2024-09-13T06:42:46.385 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:46.385 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:46.385 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:46.385 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:46.385 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658785+0000", 2024-09-13T06:42:46.385 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:46.385 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:46.385 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:46.385 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:46.385 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658787+0000", 2024-09-13T06:42:46.385 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.0040000000000002e-06 2024-09-13T06:42:46.386 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:46.386 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:46.386 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:46.386 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658793+0000", 2024-09-13T06:42:46.386 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.2410000000000003e-06 2024-09-13T06:42:46.386 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:46.386 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:46.386 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:46.386 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658797+0000", 2024-09-13T06:42:46.386 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.1330000000000001e-06 2024-09-13T06:42:46.386 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:46.386 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:46.386 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:46.387 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.697176+0000", 2024-09-13T06:42:46.387 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.038379074999999999 2024-09-13T06:42:46.387 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:46.387 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:46.387 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:46.387 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.697275+0000", 2024-09-13T06:42:46.387 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.8819000000000004e-05 2024-09-13T06:42:46.387 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:46.387 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:46.387 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:46.387 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.697522+0000", 2024-09-13T06:42:46.387 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00024719999999999999 2024-09-13T06:42:46.387 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:46.387 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:46.388 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:46.388 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:46.388 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:46.388 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27857 3.a 3:537b3559:::rbd_data.1121f2c5ee81.0000000000000016:13 [read 475136~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:42:46.388 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.658845+0000", 2024-09-13T06:42:46.388 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 169.71382271799999, 2024-09-13T06:42:46.388 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039112570999999999, 2024-09-13T06:42:46.388 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:46.388 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:46.388 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:46.388 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:46.388 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:46.389 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27857 2024-09-13T06:42:46.389 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:46.389 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:46.389 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:46.389 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:46.389 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658845+0000", 2024-09-13T06:42:46.389 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:46.389 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:46.389 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:46.389 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:46.389 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658845+0000", 2024-09-13T06:42:46.389 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:46.389 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:46.390 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:46.390 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:46.390 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658844+0000", 2024-09-13T06:42:46.390 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999986 2024-09-13T06:42:46.390 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:46.390 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:46.390 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:46.390 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658868+0000", 2024-09-13T06:42:46.390 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.4615000000000001e-05 2024-09-13T06:42:46.390 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:46.390 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:46.390 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:46.390 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658884+0000", 2024-09-13T06:42:46.391 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5401999999999999e-05 2024-09-13T06:42:46.391 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:46.391 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:46.391 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:46.391 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658896+0000", 2024-09-13T06:42:46.391 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2509e-05 2024-09-13T06:42:46.391 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:46.391 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:46.391 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:46.391 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.697571+0000", 2024-09-13T06:42:46.391 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.038675107 2024-09-13T06:42:46.391 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:46.391 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:46.392 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:46.392 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.697658+0000", 2024-09-13T06:42:46.392 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6349999999999998e-05 2024-09-13T06:42:46.392 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:46.392 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:46.392 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:46.392 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.697957+0000", 2024-09-13T06:42:46.392 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00029986100000000001 2024-09-13T06:42:46.392 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:46.392 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:46.392 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:46.392 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:46.392 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:46.393 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27858 3.a 3:537b3559:::rbd_data.1121f2c5ee81.0000000000000016:13 [read 499712~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:42:46.393 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.658905+0000", 2024-09-13T06:42:46.393 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 169.71376216799999, 2024-09-13T06:42:46.393 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039475392999999998, 2024-09-13T06:42:46.393 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:46.393 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:46.393 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:46.393 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:46.393 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:46.393 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27858 2024-09-13T06:42:46.393 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:46.393 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:46.393 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:46.394 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:46.394 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658905+0000", 2024-09-13T06:42:46.394 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:46.394 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:46.394 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:46.394 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:46.394 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658905+0000", 2024-09-13T06:42:46.394 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:46.394 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:46.394 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:46.394 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:46.394 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658905+0000", 2024-09-13T06:42:46.394 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:42:46.394 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:46.394 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:46.395 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:46.395 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658909+0000", 2024-09-13T06:42:46.395 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.831e-06 2024-09-13T06:42:46.395 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:46.395 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:46.395 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:46.395 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658920+0000", 2024-09-13T06:42:46.395 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0936e-05 2024-09-13T06:42:46.395 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:46.395 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:46.395 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:46.395 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.658929+0000", 2024-09-13T06:42:46.395 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.2749999999999995e-06 2024-09-13T06:42:46.395 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:46.395 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:46.396 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:46.396 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.697990+0000", 2024-09-13T06:42:46.396 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039061625000000003 2024-09-13T06:42:46.396 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:46.396 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:46.396 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:46.396 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.698077+0000", 2024-09-13T06:42:46.396 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6922000000000006e-05 2024-09-13T06:42:46.396 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:46.396 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:46.396 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:46.396 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.698381+0000", 2024-09-13T06:42:46.396 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00030360599999999999 2024-09-13T06:42:46.396 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:46.397 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:46.397 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:46.397 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:46.397 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:46.397 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27929 3.a 3:537b3559:::rbd_data.1121f2c5ee81.0000000000000016:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:42:46.397 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.659338+0000", 2024-09-13T06:42:46.397 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 169.713329337, 2024-09-13T06:42:46.397 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039351214000000002, 2024-09-13T06:42:46.397 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:46.397 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:46.397 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:46.397 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:46.397 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:46.398 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27929 2024-09-13T06:42:46.398 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:46.398 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:46.398 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:46.398 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:46.398 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.659338+0000", 2024-09-13T06:42:46.398 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:46.398 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:46.398 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:46.398 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:46.398 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.659338+0000", 2024-09-13T06:42:46.398 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:46.398 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:46.398 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:46.398 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:46.399 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.659337+0000", 2024-09-13T06:42:46.399 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:42:46.399 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:46.399 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:46.399 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:46.399 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.659342+0000", 2024-09-13T06:42:46.399 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0799999999999999e-06 2024-09-13T06:42:46.399 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:46.399 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:46.399 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:46.399 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.659353+0000", 2024-09-13T06:42:46.399 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1798e-05 2024-09-13T06:42:46.399 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:46.399 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:46.399 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:46.400 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.659361+0000", 2024-09-13T06:42:46.400 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.8040000000000002e-06 2024-09-13T06:42:46.400 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:46.400 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:46.400 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:46.400 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.698449+0000", 2024-09-13T06:42:46.400 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039087519000000001 2024-09-13T06:42:46.400 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:46.400 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:46.400 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:46.400 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.698567+0000", 2024-09-13T06:42:46.400 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00011857 2024-09-13T06:42:46.401 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:46.401 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:46.401 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:46.401 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.698689+0000", 2024-09-13T06:42:46.401 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00012226699999999999 2024-09-13T06:42:46.401 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:46.401 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:46.401 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:46.401 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:46.401 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:46.402 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27974 3.a 3:537b3559:::rbd_data.1121f2c5ee81.0000000000000016:13 [read 32768~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:42:46.402 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.660102+0000", 2024-09-13T06:42:46.402 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 169.71256556899999, 2024-09-13T06:42:46.402 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.038972346999999997, 2024-09-13T06:42:46.402 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:46.402 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:46.402 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:46.402 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:46.402 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:46.402 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27974 2024-09-13T06:42:46.402 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:46.402 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:46.403 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:46.403 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:46.403 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660102+0000", 2024-09-13T06:42:46.403 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:46.403 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:46.403 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:46.403 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:46.403 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660102+0000", 2024-09-13T06:42:46.403 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:46.403 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:46.403 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:46.403 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:46.403 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660100+0000", 2024-09-13T06:42:46.404 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999976 2024-09-13T06:42:46.404 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:46.404 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:46.404 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:46.404 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660114+0000", 2024-09-13T06:42:46.404 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.4466e-05 2024-09-13T06:42:46.404 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:46.404 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:46.404 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:46.404 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660148+0000", 2024-09-13T06:42:46.404 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.3742999999999999e-05 2024-09-13T06:42:46.404 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:46.404 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:46.405 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:46.405 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660170+0000", 2024-09-13T06:42:46.405 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.2518e-05 2024-09-13T06:42:46.405 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:46.405 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:46.405 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:46.405 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.698719+0000", 2024-09-13T06:42:46.405 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.038548529999999998 2024-09-13T06:42:46.405 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:46.405 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:46.405 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:46.405 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.698806+0000", 2024-09-13T06:42:46.405 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.7179e-05 2024-09-13T06:42:46.405 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:46.406 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:46.406 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:46.406 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.699074+0000", 2024-09-13T06:42:46.406 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00026834800000000001 2024-09-13T06:42:46.406 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:46.406 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:46.406 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:46.406 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:46.406 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:46.406 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27975 3.a 3:537b3559:::rbd_data.1121f2c5ee81.0000000000000016:13 [read 57344~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:42:46.406 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.660189+0000", 2024-09-13T06:42:46.406 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 169.71247872500001, 2024-09-13T06:42:46.407 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039288678, 2024-09-13T06:42:46.407 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:46.407 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:46.407 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:46.407 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:46.407 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:46.407 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27975 2024-09-13T06:42:46.407 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:46.407 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:46.407 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:46.407 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:46.407 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660189+0000", 2024-09-13T06:42:46.407 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:46.407 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:46.408 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:46.408 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:46.408 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660189+0000", 2024-09-13T06:42:46.408 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:46.408 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:46.408 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:46.408 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:46.408 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660187+0000", 2024-09-13T06:42:46.408 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999981 2024-09-13T06:42:46.408 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:46.408 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:46.408 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:46.408 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660195+0000", 2024-09-13T06:42:46.409 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5610000000000001e-06 2024-09-13T06:42:46.409 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:46.409 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:46.409 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:46.409 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660212+0000", 2024-09-13T06:42:46.409 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7725999999999999e-05 2024-09-13T06:42:46.409 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:46.409 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:46.409 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:46.409 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660227+0000", 2024-09-13T06:42:46.410 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.43e-05 2024-09-13T06:42:46.410 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:46.410 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:46.410 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:46.410 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.699135+0000", 2024-09-13T06:42:46.410 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.038908336000000002 2024-09-13T06:42:46.410 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:46.410 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:46.410 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:46.410 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.699208+0000", 2024-09-13T06:42:46.410 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.3065000000000006e-05 2024-09-13T06:42:46.410 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:46.410 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:46.410 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:46.410 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.699478+0000", 2024-09-13T06:42:46.411 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00026946899999999999 2024-09-13T06:42:46.411 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:46.411 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:46.411 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:46.411 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:46.411 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:46.411 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27976 3.a 3:537b3559:::rbd_data.1121f2c5ee81.0000000000000016:13 [read 102400~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:42:46.411 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.660238+0000", 2024-09-13T06:42:46.411 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 169.71242956200001, 2024-09-13T06:42:46.411 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039636515999999997, 2024-09-13T06:42:46.411 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:46.411 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:46.412 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:46.412 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:46.412 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:46.412 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27976 2024-09-13T06:42:46.412 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:46.412 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:46.412 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:46.412 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:46.412 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660238+0000", 2024-09-13T06:42:46.412 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:46.412 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:46.412 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:46.412 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:46.413 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660238+0000", 2024-09-13T06:42:46.413 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:46.413 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:46.413 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:46.413 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:46.413 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660237+0000", 2024-09-13T06:42:46.413 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:42:46.413 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:46.413 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:46.413 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:46.413 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660243+0000", 2024-09-13T06:42:46.413 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.9909999999999999e-06 2024-09-13T06:42:46.413 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:46.414 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:46.414 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:46.414 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660259+0000", 2024-09-13T06:42:46.414 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6294e-05 2024-09-13T06:42:46.414 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:46.414 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:46.414 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:46.414 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660272+0000", 2024-09-13T06:42:46.414 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2714999999999999e-05 2024-09-13T06:42:46.414 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:46.414 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:46.414 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:46.414 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.699513+0000", 2024-09-13T06:42:46.414 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039240932999999999 2024-09-13T06:42:46.415 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:46.415 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:46.415 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:46.415 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.699604+0000", 2024-09-13T06:42:46.415 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.1367999999999997e-05 2024-09-13T06:42:46.415 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:46.415 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:46.415 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:46.415 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.699875+0000", 2024-09-13T06:42:46.415 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00027029499999999999 2024-09-13T06:42:46.415 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:46.415 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:46.415 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:46.415 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:46.416 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:46.416 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27977 3.a 3:537b3559:::rbd_data.1121f2c5ee81.0000000000000016:13 [read 126976~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:42:46.416 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.660284+0000", 2024-09-13T06:42:46.416 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 169.71238399000001, 2024-09-13T06:42:46.416 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039969945, 2024-09-13T06:42:46.416 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:46.416 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:46.416 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:46.416 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:46.416 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:46.416 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27977 2024-09-13T06:42:46.416 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:46.416 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:46.417 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:46.417 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:46.417 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660284+0000", 2024-09-13T06:42:46.417 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:46.417 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:46.417 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:46.417 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:46.417 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660284+0000", 2024-09-13T06:42:46.417 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:46.417 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:46.417 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:46.417 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:46.417 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660282+0000", 2024-09-13T06:42:46.417 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999986 2024-09-13T06:42:46.418 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:46.418 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:46.418 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:46.418 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660288+0000", 2024-09-13T06:42:46.418 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.2650000000000002e-06 2024-09-13T06:42:46.418 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:46.418 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:46.418 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:46.418 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660304+0000", 2024-09-13T06:42:46.418 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5430999999999998e-05 2024-09-13T06:42:46.418 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:46.418 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:46.418 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:46.419 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660316+0000", 2024-09-13T06:42:46.419 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.237e-05 2024-09-13T06:42:46.419 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:46.419 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:46.419 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:46.419 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.699907+0000", 2024-09-13T06:42:46.419 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039590735000000002 2024-09-13T06:42:46.419 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:46.419 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:46.419 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:46.419 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.699994+0000", 2024-09-13T06:42:46.419 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6996999999999994e-05 2024-09-13T06:42:46.419 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:46.419 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:46.419 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:46.420 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700254+0000", 2024-09-13T06:42:46.420 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000259564 2024-09-13T06:42:46.420 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:46.420 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:46.420 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:46.420 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:46.420 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:46.420 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27978 3.a 3.9aacdeca (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:42:46.420 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.660327+0000", 2024-09-13T06:42:46.420 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 169.71234039199999, 2024-09-13T06:42:46.420 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039984858999999998, 2024-09-13T06:42:46.420 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:46.420 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:42:46.421 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:46.421 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:46.421 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:46.421 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27978 2024-09-13T06:42:46.421 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:46.421 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:46.421 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:46.421 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:46.421 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660327+0000", 2024-09-13T06:42:46.421 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:46.421 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:46.421 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:46.422 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:46.422 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660327+0000", 2024-09-13T06:42:46.422 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:46.422 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:46.422 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:46.422 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:46.422 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660326+0000", 2024-09-13T06:42:46.422 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:42:46.422 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:46.422 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:46.422 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:46.422 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660366+0000", 2024-09-13T06:42:46.422 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.9691000000000003e-05 2024-09-13T06:42:46.422 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:46.422 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:46.423 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:46.423 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660399+0000", 2024-09-13T06:42:46.423 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.3262000000000001e-05 2024-09-13T06:42:46.423 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:46.423 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:46.423 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:46.423 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660414+0000", 2024-09-13T06:42:46.423 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.4775e-05 2024-09-13T06:42:46.423 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:46.423 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:46.423 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:46.423 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700298+0000", 2024-09-13T06:42:46.423 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039883759999999997 2024-09-13T06:42:46.423 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:46.423 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:46.424 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:46.424 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700312+0000", 2024-09-13T06:42:46.424 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.4374e-05 2024-09-13T06:42:46.424 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:46.424 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:46.424 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:46.424 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:46.424 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:46.424 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27979 3.a 3.9aacdeca (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:42:46.424 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.660429+0000", 2024-09-13T06:42:46.424 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 169.71223852399999, 2024-09-13T06:42:46.424 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039921361000000002, 2024-09-13T06:42:46.424 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:46.424 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:42:46.425 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:46.425 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:46.425 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:46.425 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27979 2024-09-13T06:42:46.425 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:46.425 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:46.425 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:46.425 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:46.425 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660429+0000", 2024-09-13T06:42:46.425 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:46.425 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:46.425 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:46.425 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:46.426 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660429+0000", 2024-09-13T06:42:46.426 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:46.426 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:46.426 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:46.426 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:46.426 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660428+0000", 2024-09-13T06:42:46.426 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999986 2024-09-13T06:42:46.426 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:46.426 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:46.426 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:46.426 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660434+0000", 2024-09-13T06:42:46.426 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.8190000000000003e-06 2024-09-13T06:42:46.426 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:46.427 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:46.427 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:46.427 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660451+0000", 2024-09-13T06:42:46.427 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6963e-05 2024-09-13T06:42:46.427 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:46.427 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:46.427 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:46.427 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660485+0000", 2024-09-13T06:42:46.427 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.3414000000000002e-05 2024-09-13T06:42:46.427 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:46.427 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:46.427 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:46.427 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700342+0000", 2024-09-13T06:42:46.427 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039857278000000003 2024-09-13T06:42:46.428 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:46.428 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:46.428 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:46.428 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700350+0000", 2024-09-13T06:42:46.428 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.2930000000000001e-06 2024-09-13T06:42:46.428 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:46.428 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:46.428 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:46.428 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:46.428 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:46.428 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27980 3.a 3.9aacdeca (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:42:46.428 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.660497+0000", 2024-09-13T06:42:46.428 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 169.712170313, 2024-09-13T06:42:46.429 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039888034000000003, 2024-09-13T06:42:46.429 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:46.429 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:42:46.429 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:46.429 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:46.429 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:46.429 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27980 2024-09-13T06:42:46.429 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:46.429 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:46.429 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:46.429 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:46.429 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660497+0000", 2024-09-13T06:42:46.429 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:46.430 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:46.430 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:46.430 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:46.430 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660497+0000", 2024-09-13T06:42:46.430 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:46.430 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:46.430 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:46.430 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:46.430 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660496+0000", 2024-09-13T06:42:46.430 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:42:46.430 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:46.430 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:46.430 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:46.431 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660503+0000", 2024-09-13T06:42:46.431 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.4110000000000001e-06 2024-09-13T06:42:46.431 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:46.431 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:46.431 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:46.431 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660519+0000", 2024-09-13T06:42:46.431 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6180000000000001e-05 2024-09-13T06:42:46.431 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:46.431 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:46.431 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:46.431 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660544+0000", 2024-09-13T06:42:46.431 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.5177999999999998e-05 2024-09-13T06:42:46.432 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:46.432 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:46.432 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:46.432 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700377+0000", 2024-09-13T06:42:46.432 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039833434000000001 2024-09-13T06:42:46.432 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:46.432 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:46.432 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:46.432 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700385+0000", 2024-09-13T06:42:46.432 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.8800000000000008e-06 2024-09-13T06:42:46.432 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:46.432 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:46.432 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:46.433 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:46.433 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:46.433 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27981 3.a 3.9aacdeca (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:42:46.433 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.660556+0000", 2024-09-13T06:42:46.433 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 169.712111967, 2024-09-13T06:42:46.433 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039869989000000002, 2024-09-13T06:42:46.433 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:46.433 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:42:46.433 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:46.433 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:46.433 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:46.433 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27981 2024-09-13T06:42:46.433 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:46.433 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:46.434 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:46.434 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:46.434 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660556+0000", 2024-09-13T06:42:46.434 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:46.434 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:46.434 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:46.434 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:46.434 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660556+0000", 2024-09-13T06:42:46.434 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:46.434 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:46.434 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:46.434 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:46.434 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660555+0000", 2024-09-13T06:42:46.435 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:42:46.435 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:46.435 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:46.435 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:46.435 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660561+0000", 2024-09-13T06:42:46.435 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.088e-06 2024-09-13T06:42:46.435 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:46.435 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:46.435 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:46.435 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660577+0000", 2024-09-13T06:42:46.435 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6147999999999999e-05 2024-09-13T06:42:46.435 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:46.435 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:46.435 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:46.436 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660589+0000", 2024-09-13T06:42:46.436 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2551999999999999e-05 2024-09-13T06:42:46.436 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:46.436 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:46.436 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:46.436 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700414+0000", 2024-09-13T06:42:46.436 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039825007000000003 2024-09-13T06:42:46.436 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:46.436 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:46.436 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:46.436 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700426+0000", 2024-09-13T06:42:46.436 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1265e-05 2024-09-13T06:42:46.436 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:46.436 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:46.437 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:46.437 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:46.437 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:46.437 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27982 3.a 3.9aacdeca (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:42:46.437 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.660603+0000", 2024-09-13T06:42:46.437 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 169.71206437199999, 2024-09-13T06:42:46.437 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039874779999999999, 2024-09-13T06:42:46.437 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:46.437 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:42:46.437 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:46.437 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:46.437 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:46.437 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27982 2024-09-13T06:42:46.438 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:46.438 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:46.438 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:46.438 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:46.438 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660603+0000", 2024-09-13T06:42:46.438 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:46.438 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:46.438 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:46.438 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:46.438 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660603+0000", 2024-09-13T06:42:46.438 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:46.438 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:46.438 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:46.438 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:46.438 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660602+0000", 2024-09-13T06:42:46.439 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:42:46.439 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:46.439 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:46.439 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:46.439 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660653+0000", 2024-09-13T06:42:46.439 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.0862000000000002e-05 2024-09-13T06:42:46.439 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:46.439 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:46.439 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:46.439 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660697+0000", 2024-09-13T06:42:46.439 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.3773000000000003e-05 2024-09-13T06:42:46.439 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:46.439 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:46.439 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:46.439 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660712+0000", 2024-09-13T06:42:46.440 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5464999999999998e-05 2024-09-13T06:42:46.440 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:46.440 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:46.440 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:46.440 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700469+0000", 2024-09-13T06:42:46.440 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039756503999999998 2024-09-13T06:42:46.440 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:46.440 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:46.440 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:46.440 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700478+0000", 2024-09-13T06:42:46.440 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.1730000000000001e-06 2024-09-13T06:42:46.440 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:46.440 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:46.441 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:46.441 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:46.441 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:46.441 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27983 3.a 3.9aacdeca (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:42:46.441 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.660726+0000", 2024-09-13T06:42:46.441 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 169.71194109699999, 2024-09-13T06:42:46.441 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039804357999999998, 2024-09-13T06:42:46.441 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:46.441 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:42:46.441 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:46.441 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:46.441 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:46.441 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27983 2024-09-13T06:42:46.442 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:46.442 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:46.442 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:46.442 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:46.442 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660726+0000", 2024-09-13T06:42:46.442 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:46.442 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:46.442 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:46.442 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:46.442 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660726+0000", 2024-09-13T06:42:46.442 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:46.442 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:46.442 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:46.442 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:46.442 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660725+0000", 2024-09-13T06:42:46.442 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999986 2024-09-13T06:42:46.443 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:46.443 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:46.443 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:46.443 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660733+0000", 2024-09-13T06:42:46.443 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.9359999999999999e-06 2024-09-13T06:42:46.443 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:46.443 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:46.443 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:46.443 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660751+0000", 2024-09-13T06:42:46.443 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7679000000000001e-05 2024-09-13T06:42:46.443 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:46.443 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:46.443 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:46.444 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660764+0000", 2024-09-13T06:42:46.444 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3112000000000001e-05 2024-09-13T06:42:46.444 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:46.444 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:46.444 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:46.444 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700516+0000", 2024-09-13T06:42:46.444 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039752183000000003 2024-09-13T06:42:46.444 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:46.444 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:46.444 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:46.444 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700531+0000", 2024-09-13T06:42:46.444 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.4732999999999999e-05 2024-09-13T06:42:46.444 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:46.444 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:46.444 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:46.445 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:46.445 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:46.445 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27984 3.a 3.9aacdeca (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:42:46.445 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.660776+0000", 2024-09-13T06:42:46.445 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 169.71189199400001, 2024-09-13T06:42:46.445 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039795697999999997, 2024-09-13T06:42:46.445 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:46.445 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:42:46.445 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:46.445 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:46.445 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:46.445 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27984 2024-09-13T06:42:46.445 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:46.446 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:46.446 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:46.446 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:46.446 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660776+0000", 2024-09-13T06:42:46.446 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:46.446 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:46.446 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:46.446 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:46.446 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660776+0000", 2024-09-13T06:42:46.446 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:46.446 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:46.446 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:46.446 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:46.446 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660775+0000", 2024-09-13T06:42:46.447 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:42:46.447 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:46.447 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:46.447 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:46.447 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660780+0000", 2024-09-13T06:42:46.447 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.7849999999999997e-06 2024-09-13T06:42:46.447 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:46.447 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:46.447 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:46.447 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660799+0000", 2024-09-13T06:42:46.447 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.8794e-05 2024-09-13T06:42:46.447 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:46.447 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:46.447 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:46.448 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660812+0000", 2024-09-13T06:42:46.448 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3029e-05 2024-09-13T06:42:46.448 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:46.448 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:46.448 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:46.448 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700562+0000", 2024-09-13T06:42:46.448 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039749984000000002 2024-09-13T06:42:46.448 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:46.448 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:46.448 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:46.448 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700571+0000", 2024-09-13T06:42:46.448 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.1260000000000004e-06 2024-09-13T06:42:46.448 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:46.449 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:46.449 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:46.449 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:46.449 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:46.449 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:27985 3.a 3.9aacdeca (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:42:46.449 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.660824+0000", 2024-09-13T06:42:46.449 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 169.711843942, 2024-09-13T06:42:46.449 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039784462, 2024-09-13T06:42:46.449 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:46.449 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:42:46.449 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:46.449 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:46.450 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:46.450 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 27985 2024-09-13T06:42:46.450 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:46.450 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:46.450 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:46.450 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:46.450 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660824+0000", 2024-09-13T06:42:46.450 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:46.450 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:46.450 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:46.450 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:46.450 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660824+0000", 2024-09-13T06:42:46.450 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:46.451 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:46.451 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:46.451 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:46.451 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660823+0000", 2024-09-13T06:42:46.451 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:42:46.451 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:46.451 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:46.451 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:46.451 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660829+0000", 2024-09-13T06:42:46.451 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.9440000000000002e-06 2024-09-13T06:42:46.451 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:46.451 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:46.451 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:46.452 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660922+0000", 2024-09-13T06:42:46.452 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.2958e-05 2024-09-13T06:42:46.452 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:46.452 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:46.452 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:46.452 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.660964+0000", 2024-09-13T06:42:46.452 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.2407000000000002e-05 2024-09-13T06:42:46.452 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:46.452 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:46.452 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:46.452 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700600+0000", 2024-09-13T06:42:46.452 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.039635581000000003 2024-09-13T06:42:46.452 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:46.453 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:46.453 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:46.453 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700608+0000", 2024-09-13T06:42:46.453 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.5890000000000003e-06 2024-09-13T06:42:46.453 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:46.453 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:46.453 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:46.453 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:46.453 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:46.453 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:28023 3.10 3:0dedc28a:::rbd_data.1121f2c5ee81.0000000000000019:13 [read 475136~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:42:46.453 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.662072+0000", 2024-09-13T06:42:46.453 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 169.71059595700001, 2024-09-13T06:42:46.453 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.038086508999999998, 2024-09-13T06:42:46.454 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:46.454 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:46.454 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:46.454 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:46.454 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:46.454 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 28023 2024-09-13T06:42:46.454 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:46.454 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:46.454 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:46.454 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:46.454 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.662072+0000", 2024-09-13T06:42:46.454 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:46.454 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:46.454 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:46.455 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:46.455 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.662072+0000", 2024-09-13T06:42:46.455 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:46.455 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:46.455 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:46.455 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:46.455 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.662070+0000", 2024-09-13T06:42:46.455 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999986 2024-09-13T06:42:46.455 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:46.455 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:46.455 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:46.455 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.662076+0000", 2024-09-13T06:42:46.455 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.139e-06 2024-09-13T06:42:46.456 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:46.456 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:46.456 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:46.456 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.662094+0000", 2024-09-13T06:42:46.456 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7136999999999999e-05 2024-09-13T06:42:46.456 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:46.456 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:46.456 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:46.456 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.662124+0000", 2024-09-13T06:42:46.457 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.0528999999999999e-05 2024-09-13T06:42:46.457 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:46.457 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:46.457 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:46.457 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.699843+0000", 2024-09-13T06:42:46.457 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.037718415999999998 2024-09-13T06:42:46.457 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:46.457 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:46.457 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:46.457 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.699931+0000", 2024-09-13T06:42:46.457 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.8345999999999997e-05 2024-09-13T06:42:46.457 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:46.457 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:46.458 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:46.458 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700158+0000", 2024-09-13T06:42:46.458 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00022723099999999999 2024-09-13T06:42:46.458 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:46.458 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:46.458 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:46.458 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:46.458 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:46.458 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:28024 3.10 3.5143b7b0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:42:46.458 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:56.662137+0000", 2024-09-13T06:42:46.458 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 169.71053043500001, 2024-09-13T06:42:46.458 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.038056092999999999, 2024-09-13T06:42:46.458 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:46.458 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:42:46.459 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:46.459 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:46.459 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:46.459 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 28024 2024-09-13T06:42:46.459 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:46.459 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:46.459 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:46.459 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:46.459 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.662137+0000", 2024-09-13T06:42:46.459 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:46.459 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:46.459 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:46.459 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:46.459 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.662137+0000", 2024-09-13T06:42:46.460 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:46.460 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:46.460 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:46.460 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:46.460 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.662136+0000", 2024-09-13T06:42:46.460 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999986 2024-09-13T06:42:46.460 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:46.460 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:46.460 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:46.460 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.662142+0000", 2024-09-13T06:42:46.460 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.6930000000000001e-06 2024-09-13T06:42:46.460 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:46.460 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:46.461 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:46.461 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.662160+0000", 2024-09-13T06:42:46.461 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7863000000000002e-05 2024-09-13T06:42:46.461 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:46.461 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:46.461 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:46.461 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.662189+0000", 2024-09-13T06:42:46.461 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.8486000000000001e-05 2024-09-13T06:42:46.461 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:46.461 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:46.461 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:46.461 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700187+0000", 2024-09-13T06:42:46.461 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.037998331000000003 2024-09-13T06:42:46.462 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:46.462 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:46.462 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:46.462 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:56.700193+0000", 2024-09-13T06:42:46.462 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.0909999999999998e-06 2024-09-13T06:42:46.462 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:46.462 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:46.462 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:46.462 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:46.462 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:46.462 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:42:46.462 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-13T06:42:46.464 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-13T06:42:46.465 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:42:46.461+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:42:46.565 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:42:46.561+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:42:46.650 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:42:46.650 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [], 2024-09-13T06:42:46.651 INFO:teuthology.orchestra.run.smithi139.stdout: "num_ops": 0 2024-09-13T06:42:46.651 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:42:46.658 INFO:teuthology.orchestra.run.smithi081.stdout:osd.0: {} 2024-09-13T06:42:46.658 INFO:teuthology.orchestra.run.smithi081.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-13T06:42:46.665 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-13T06:42:46.690 INFO:teuthology.orchestra.run.smithi081.stdout:osd.1: {} 2024-09-13T06:42:46.690 INFO:teuthology.orchestra.run.smithi081.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-13T06:42:46.708 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-13T06:42:46.705+0000 7fa8bb18e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 36790) UID: 0 2024-09-13T06:42:46.724 INFO:teuthology.orchestra.run.smithi081.stdout:osd.2: {} 2024-09-13T06:42:46.725 INFO:teuthology.orchestra.run.smithi081.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-13T06:42:46.749 INFO:teuthology.orchestra.run.smithi081.stdout:osd.3: {} 2024-09-13T06:42:46.750 INFO:teuthology.orchestra.run.smithi081.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-13T06:42:46.767 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:42:46.761+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:42:46.778 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-13T06:42:46.778 INFO:teuthology.orchestra.run.smithi081.stdout:osd.4: {} 2024-09-13T06:42:46.779 INFO:teuthology.orchestra.run.smithi081.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-13T06:42:46.810 INFO:teuthology.orchestra.run.smithi081.stdout:osd.5: {} 2024-09-13T06:42:46.810 INFO:teuthology.orchestra.run.smithi081.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-13T06:42:46.837 INFO:teuthology.orchestra.run.smithi081.stdout:osd.6: {} 2024-09-13T06:42:46.837 INFO:teuthology.orchestra.run.smithi081.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-13T06:42:46.842 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:42:46.842 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [], 2024-09-13T06:42:46.842 INFO:teuthology.orchestra.run.smithi139.stdout: "complaint_time": 30, 2024-09-13T06:42:46.842 INFO:teuthology.orchestra.run.smithi139.stdout: "num_blocked_ops": 0 2024-09-13T06:42:46.842 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:42:46.858 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-13T06:42:46.865 INFO:teuthology.orchestra.run.smithi081.stdout:osd.7: {} 2024-09-13T06:42:46.865 INFO:teuthology.orchestra.run.smithi081.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-13T06:42:46.900 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-13T06:42:46.901+0000 7fa8bb18e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 36790) UID: 0 2024-09-13T06:42:46.969 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-13T06:42:46.965+0000 7fa8bb18e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 36790) UID: 0 2024-09-13T06:42:47.042 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:42:47.043 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:42:47.056 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-13T06:42:47.102 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:42:47.100+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:42:47.171 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:42:47.165+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:42:47.230 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:42:47.230 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:42:47.248 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-13T06:42:47.272 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:42:47.269+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:42:47.373 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:42:47.369+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:42:47.460 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:42:47.460 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:42:47.473 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:42:47.469+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:42:47.477 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-13T06:42:47.574 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:42:47.572+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:42:47.625 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:42:47.625 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:42:47.639 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-13T06:42:47.676 INFO:tasks.ceph.osd.6.smithi139.stderr:2024-09-13T06:42:47.669+0000 7fcd02c5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26385) UID: 0 2024-09-13T06:42:47.698 INFO:teuthology.orchestra.run.smithi081.stderr:nodeep-scrub is unset 2024-09-13T06:42:47.776 INFO:tasks.ceph.osd.6.smithi139.stderr:2024-09-13T06:42:47.773+0000 7fcd02c5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26385) UID: 0 2024-09-13T06:42:47.877 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:42:47.872+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:42:47.878 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:42:47.878 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:42:47.900 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-13T06:42:47.978 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:42:47.977+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:42:48.045 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:42:48.046 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:42:48.058 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-13T06:42:48.111 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:42:48.108+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:42:48.178 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:42:48.179 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:42:48.179 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:42:48.177+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:42:48.191 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-13T06:42:48.280 INFO:tasks.ceph.osd.6.smithi139.stderr:2024-09-13T06:42:48.277+0000 7fcd02c5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26385) UID: 0 2024-09-13T06:42:48.349 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:42:48.349 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:42:48.362 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-13T06:42:48.406 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:42:48.408+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:42:48.475 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:42:48.475 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:42:48.481 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:42:48.476+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:42:48.488 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-13T06:42:48.581 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-13T06:42:48.581+0000 7fa8bb18e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 36790) UID: 0 2024-09-13T06:42:48.647 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:42:48.647 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:42:48.660 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-13T06:42:48.682 INFO:tasks.ceph.osd.6.smithi139.stderr:2024-09-13T06:42:48.681+0000 7fcd02c5c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26385) UID: 0 2024-09-13T06:42:48.760 INFO:teuthology.orchestra.run.smithi081.stdout:checking clone #37, image image_client.0-clone37 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent38 2024-09-13T06:42:48.778 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:42:48.778 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:42:48.783 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:42:48.780+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:42:48.794 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-13T06:42:48.886 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:42:48.884+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:42:48.893 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-13T06:42:48.957 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:42:48.958 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:42:48.973 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-13T06:42:49.018 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:42:49.016+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:42:49.025 INFO:teuthology.orchestra.run.smithi081.stdout:osd.0: {} 2024-09-13T06:42:49.025 INFO:teuthology.orchestra.run.smithi081.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-13T06:42:49.056 INFO:teuthology.orchestra.run.smithi081.stdout:osd.1: {} 2024-09-13T06:42:49.056 INFO:teuthology.orchestra.run.smithi081.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-13T06:42:49.073 INFO:teuthology.orchestra.run.smithi081.stdout:osd.2: {} 2024-09-13T06:42:49.073 INFO:teuthology.orchestra.run.smithi081.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-13T06:42:49.086 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:42:49.080+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:42:49.090 INFO:teuthology.orchestra.run.smithi081.stdout:osd.3: {} 2024-09-13T06:42:49.090 INFO:teuthology.orchestra.run.smithi081.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-13T06:42:49.109 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:42:49.109 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 20, 2024-09-13T06:42:49.109 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 600, 2024-09-13T06:42:49.109 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [ 2024-09-13T06:42:49.109 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:49.109 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:2226 3.15 3:af026987:::rbd_data.112173e2f1b7.0000000000000017:head [sparse-read 0~4194304] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-13T06:42:49.109 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:37.606562+0000", 2024-09-13T06:42:49.109 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 191.50293490300001, 2024-09-13T06:42:49.110 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.83322091700000001, 2024-09-13T06:42:49.110 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:49.110 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:42:49.110 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:49.110 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:49.110 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:49.110 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 2226 2024-09-13T06:42:49.110 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:49.110 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:49.110 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:49.110 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:49.110 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606562+0000", 2024-09-13T06:42:49.110 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:49.111 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:49.111 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:49.111 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:49.111 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606562+0000", 2024-09-13T06:42:49.111 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:49.111 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:49.111 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:49.111 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:49.111 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606561+0000", 2024-09-13T06:42:49.112 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:49.112 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:49.112 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:49.112 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:49.112 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606565+0000", 2024-09-13T06:42:49.112 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.4379999999999999e-06 2024-09-13T06:42:49.112 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:49.112 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:49.112 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:49.113 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606569+0000", 2024-09-13T06:42:49.113 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.425e-06 2024-09-13T06:42:49.113 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:49.113 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:49.113 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:49.113 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606572+0000", 2024-09-13T06:42:49.113 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.05e-06 2024-09-13T06:42:49.113 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:49.113 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:49.114 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:49.114 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606621+0000", 2024-09-13T06:42:49.114 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.8723000000000001e-05 2024-09-13T06:42:49.114 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:49.114 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:49.114 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:42:49.114 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606630+0000", 2024-09-13T06:42:49.114 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.8040000000000007e-06 2024-09-13T06:42:49.114 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:49.114 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:49.114 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:49.114 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.439648+0000", 2024-09-13T06:42:49.114 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.83301824800000002 2024-09-13T06:42:49.115 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:49.115 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:49.115 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:49.115 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.439782+0000", 2024-09-13T06:42:49.115 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00013466699999999999 2024-09-13T06:42:49.115 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:49.115 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:49.115 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:49.115 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:49.115 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:49.115 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25661 3.8 3:1180686c:::rbd_data.1121f2c5ee81.0000000000000009:13 [read 397312~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:42:49.115 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.436956+0000", 2024-09-13T06:42:49.115 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 172.67254036899999, 2024-09-13T06:42:49.116 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089036758999999993, 2024-09-13T06:42:49.116 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:49.116 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:49.116 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:49.116 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:49.116 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:49.116 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25661 2024-09-13T06:42:49.116 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:49.116 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:49.116 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:49.116 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:49.117 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436956+0000", 2024-09-13T06:42:49.117 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:49.117 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:49.117 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:49.117 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:49.117 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436956+0000", 2024-09-13T06:42:49.117 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:49.117 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:49.117 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:49.117 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:49.117 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436956+0000", 2024-09-13T06:42:49.117 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:49.118 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:49.118 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:49.118 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:49.118 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436958+0000", 2024-09-13T06:42:49.118 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1770000000000001e-06 2024-09-13T06:42:49.118 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:49.118 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:49.118 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:49.118 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436963+0000", 2024-09-13T06:42:49.119 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.6489999999999996e-06 2024-09-13T06:42:49.119 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:49.119 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:49.119 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:49.119 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436975+0000", 2024-09-13T06:42:49.119 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1783999999999999e-05 2024-09-13T06:42:49.119 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:49.119 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:49.119 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:49.119 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.525671+0000", 2024-09-13T06:42:49.119 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.088696292999999995 2024-09-13T06:42:49.120 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:49.120 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:49.120 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:49.120 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.525749+0000", 2024-09-13T06:42:49.120 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.7589000000000005e-05 2024-09-13T06:42:49.120 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:49.120 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:49.120 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:49.120 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.525993+0000", 2024-09-13T06:42:49.120 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00024381000000000001 2024-09-13T06:42:49.120 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:49.120 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:49.121 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:49.121 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:49.121 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:49.121 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25662 3.8 3:1180686c:::rbd_data.1121f2c5ee81.0000000000000009:13 [read 421888~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:42:49.121 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.436980+0000", 2024-09-13T06:42:49.121 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 172.672516057, 2024-09-13T06:42:49.121 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089367577000000004, 2024-09-13T06:42:49.121 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:49.121 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:49.121 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:49.121 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:49.121 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:49.121 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25662 2024-09-13T06:42:49.122 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:49.122 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:49.122 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:49.122 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:49.122 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436980+0000", 2024-09-13T06:42:49.122 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:49.122 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:49.122 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:49.122 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:49.122 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436980+0000", 2024-09-13T06:42:49.122 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:49.122 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:49.122 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:49.122 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:49.123 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436980+0000", 2024-09-13T06:42:49.123 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:49.123 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:49.123 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:49.123 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:49.123 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436982+0000", 2024-09-13T06:42:49.123 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3989999999999998e-06 2024-09-13T06:42:49.123 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:49.123 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:49.123 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:49.123 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436988+0000", 2024-09-13T06:42:49.123 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0039999999999996e-06 2024-09-13T06:42:49.123 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:49.124 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:49.124 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:49.124 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436993+0000", 2024-09-13T06:42:49.124 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6090000000000003e-06 2024-09-13T06:42:49.124 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:49.124 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:49.124 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:49.124 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.526035+0000", 2024-09-13T06:42:49.124 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089042248000000004 2024-09-13T06:42:49.124 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:49.124 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:49.124 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:49.124 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.526111+0000", 2024-09-13T06:42:49.124 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5643999999999996e-05 2024-09-13T06:42:49.125 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:49.125 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:49.125 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:49.125 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.526348+0000", 2024-09-13T06:42:49.125 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00023705800000000001 2024-09-13T06:42:49.125 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:49.125 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:49.125 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:49.125 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:49.125 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:49.125 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25663 3.8 3:1180686c:::rbd_data.1121f2c5ee81.0000000000000009:13 [read 466944~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:42:49.125 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.436998+0000", 2024-09-13T06:42:49.126 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 172.67249841, 2024-09-13T06:42:49.126 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089730867000000006, 2024-09-13T06:42:49.126 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:49.126 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:49.126 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:49.126 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:49.126 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:49.126 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25663 2024-09-13T06:42:49.126 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:49.126 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:49.126 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:49.126 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:49.126 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436998+0000", 2024-09-13T06:42:49.126 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:49.127 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:49.127 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:49.127 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:49.127 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436998+0000", 2024-09-13T06:42:49.127 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:49.127 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:49.127 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:49.127 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:49.127 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436998+0000", 2024-09-13T06:42:49.127 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:49.127 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:49.127 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:49.127 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:49.128 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437000+0000", 2024-09-13T06:42:49.128 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0940000000000002e-06 2024-09-13T06:42:49.128 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:49.128 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:49.128 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:49.128 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437005+0000", 2024-09-13T06:42:49.128 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.604e-06 2024-09-13T06:42:49.128 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:49.128 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:49.128 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:49.128 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437032+0000", 2024-09-13T06:42:49.128 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6407e-05 2024-09-13T06:42:49.128 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:49.129 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:49.129 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:49.129 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.526363+0000", 2024-09-13T06:42:49.129 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089331456000000004 2024-09-13T06:42:49.129 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:49.129 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:49.129 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:49.129 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.526404+0000", 2024-09-13T06:42:49.129 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.0887999999999999e-05 2024-09-13T06:42:49.129 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:49.130 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:49.130 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:49.130 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.526729+0000", 2024-09-13T06:42:49.130 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00032486 2024-09-13T06:42:49.130 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:49.130 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:49.130 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:49.130 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:49.130 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:49.130 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25664 3.8 3:1180686c:::rbd_data.1121f2c5ee81.0000000000000009:13 [read 491520~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:42:49.130 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.437040+0000", 2024-09-13T06:42:49.130 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 172.67245649500001, 2024-09-13T06:42:49.131 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.090016650000000004, 2024-09-13T06:42:49.131 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:49.131 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:49.131 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:49.131 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:49.131 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:49.131 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25664 2024-09-13T06:42:49.131 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:49.131 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:49.131 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:49.132 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:49.132 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437040+0000", 2024-09-13T06:42:49.132 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:49.132 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:49.132 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:49.132 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:49.132 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437040+0000", 2024-09-13T06:42:49.132 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:49.132 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:49.132 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:49.132 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:49.132 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437039+0000", 2024-09-13T06:42:49.133 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:49.133 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:49.133 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:49.133 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:49.133 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437047+0000", 2024-09-13T06:42:49.133 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4839999999999998e-06 2024-09-13T06:42:49.133 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:49.133 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:49.133 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:49.133 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437054+0000", 2024-09-13T06:42:49.133 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.8299999999999998e-06 2024-09-13T06:42:49.133 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:49.133 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:49.133 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:49.134 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437060+0000", 2024-09-13T06:42:49.134 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.1510000000000001e-06 2024-09-13T06:42:49.134 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:49.134 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:49.134 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:49.134 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.526772+0000", 2024-09-13T06:42:49.134 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089711737999999999 2024-09-13T06:42:49.134 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:49.134 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:49.134 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:49.134 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.526848+0000", 2024-09-13T06:42:49.134 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5870000000000004e-05 2024-09-13T06:42:49.134 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:49.134 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:49.134 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:49.135 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.527057+0000", 2024-09-13T06:42:49.135 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000209106 2024-09-13T06:42:49.135 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:49.135 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:49.135 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:49.135 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:49.135 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:49.135 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25740 3.18 3:1c662b96:::rbd_data.1121f2c5ee81.0000000000000010:13 [read 200704~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:42:49.135 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443352+0000", 2024-09-13T06:42:49.135 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 172.66614482, 2024-09-13T06:42:49.135 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089068222000000002, 2024-09-13T06:42:49.135 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:49.135 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:49.135 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:49.136 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:49.136 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:49.136 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25740 2024-09-13T06:42:49.136 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:49.136 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:49.136 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:49.136 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:49.136 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443352+0000", 2024-09-13T06:42:49.136 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:49.136 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:49.136 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:49.136 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:49.136 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443352+0000", 2024-09-13T06:42:49.136 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:49.137 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:49.137 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:49.137 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:49.137 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443351+0000", 2024-09-13T06:42:49.137 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:49.137 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:49.137 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:49.137 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:49.137 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443354+0000", 2024-09-13T06:42:49.137 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.841e-06 2024-09-13T06:42:49.137 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:49.137 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:49.137 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:49.137 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443361+0000", 2024-09-13T06:42:49.137 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.0010000000000004e-06 2024-09-13T06:42:49.138 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:49.138 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:49.138 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:49.138 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443366+0000", 2024-09-13T06:42:49.138 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7119999999999999e-06 2024-09-13T06:42:49.138 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:49.138 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:49.138 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:49.138 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532117+0000", 2024-09-13T06:42:49.138 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.088751327000000005 2024-09-13T06:42:49.138 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:49.138 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:49.138 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:49.138 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532193+0000", 2024-09-13T06:42:49.139 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5839000000000004e-05 2024-09-13T06:42:49.139 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:49.139 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:49.139 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:49.139 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532420+0000", 2024-09-13T06:42:49.139 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00022691000000000001 2024-09-13T06:42:49.139 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:49.139 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:49.139 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:49.139 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:49.139 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:49.139 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25741 3.18 3:1c662b96:::rbd_data.1121f2c5ee81.0000000000000010:13 [read 225280~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:42:49.139 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443378+0000", 2024-09-13T06:42:49.140 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 172.66611805299999, 2024-09-13T06:42:49.140 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089324107, 2024-09-13T06:42:49.140 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:49.140 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:49.140 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:49.140 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:49.140 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:49.140 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25741 2024-09-13T06:42:49.140 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:49.140 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:49.140 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:49.141 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:49.141 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443378+0000", 2024-09-13T06:42:49.141 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:49.141 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:49.141 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:49.141 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:49.141 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443378+0000", 2024-09-13T06:42:49.141 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:49.141 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:49.141 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:49.141 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:49.141 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443378+0000", 2024-09-13T06:42:49.141 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:49.142 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:49.142 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:49.142 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:49.142 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443380+0000", 2024-09-13T06:42:49.142 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3549999999999999e-06 2024-09-13T06:42:49.142 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:49.142 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:49.142 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:49.142 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443388+0000", 2024-09-13T06:42:49.142 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.7449999999999995e-06 2024-09-13T06:42:49.142 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:49.142 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:49.142 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:49.142 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443393+0000", 2024-09-13T06:42:49.143 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.4e-06 2024-09-13T06:42:49.143 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:49.143 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:49.143 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:49.143 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532454+0000", 2024-09-13T06:42:49.143 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089060941000000005 2024-09-13T06:42:49.143 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:49.143 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:49.143 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:49.143 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532512+0000", 2024-09-13T06:42:49.143 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7763000000000002e-05 2024-09-13T06:42:49.143 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:49.143 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:49.144 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:49.144 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532703+0000", 2024-09-13T06:42:49.144 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000190328 2024-09-13T06:42:49.144 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:49.144 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:49.144 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:49.144 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:49.144 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:49.144 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25742 3.18 3:1c662b96:::rbd_data.1121f2c5ee81.0000000000000010:13 [read 270336~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:42:49.144 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443398+0000", 2024-09-13T06:42:49.144 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 172.66609834100001, 2024-09-13T06:42:49.144 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089621836999999996, 2024-09-13T06:42:49.144 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:49.144 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:49.144 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:49.145 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:49.145 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:49.145 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25742 2024-09-13T06:42:49.145 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:49.145 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:49.145 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:49.145 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:49.145 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443398+0000", 2024-09-13T06:42:49.145 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:49.145 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:49.145 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:49.145 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:49.145 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443398+0000", 2024-09-13T06:42:49.145 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:49.146 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:49.146 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:49.146 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:49.146 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443398+0000", 2024-09-13T06:42:49.146 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:49.146 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:49.146 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:49.146 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:49.146 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443400+0000", 2024-09-13T06:42:49.146 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1849999999999998e-06 2024-09-13T06:42:49.146 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:49.147 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:49.147 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:49.147 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443407+0000", 2024-09-13T06:42:49.147 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3669999999999999e-06 2024-09-13T06:42:49.147 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:49.147 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:49.147 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:49.147 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443420+0000", 2024-09-13T06:42:49.147 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2645e-05 2024-09-13T06:42:49.147 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:49.147 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:49.147 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:49.147 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532742+0000", 2024-09-13T06:42:49.147 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089322200000000004 2024-09-13T06:42:49.148 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:49.148 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:49.148 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:49.148 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532818+0000", 2024-09-13T06:42:49.148 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.6019000000000005e-05 2024-09-13T06:42:49.148 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:49.148 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:49.148 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:49.148 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533020+0000", 2024-09-13T06:42:49.148 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000201721 2024-09-13T06:42:49.149 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:49.149 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:49.149 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:49.149 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:49.149 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:49.149 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25743 3.18 3:1c662b96:::rbd_data.1121f2c5ee81.0000000000000010:13 [read 294912~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:42:49.149 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443425+0000", 2024-09-13T06:42:49.149 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 172.66607133299999, 2024-09-13T06:42:49.149 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089864075000000002, 2024-09-13T06:42:49.149 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:49.149 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:49.149 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:49.149 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:49.150 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:49.150 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25743 2024-09-13T06:42:49.150 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:49.150 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:49.150 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:49.150 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:49.150 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443425+0000", 2024-09-13T06:42:49.150 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:49.150 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:49.150 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:49.150 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:49.150 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443425+0000", 2024-09-13T06:42:49.150 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:49.151 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:49.151 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:49.151 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:49.151 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443425+0000", 2024-09-13T06:42:49.151 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:49.151 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:49.151 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:49.151 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:49.151 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443432+0000", 2024-09-13T06:42:49.151 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3420000000000002e-06 2024-09-13T06:42:49.151 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:49.151 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:49.151 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:49.151 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443440+0000", 2024-09-13T06:42:49.152 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5689999999999999e-06 2024-09-13T06:42:49.152 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:49.152 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:49.152 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:49.152 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443445+0000", 2024-09-13T06:42:49.152 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9590000000000003e-06 2024-09-13T06:42:49.152 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:49.152 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:49.152 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:49.152 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533063+0000", 2024-09-13T06:42:49.152 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089617988999999995 2024-09-13T06:42:49.152 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:49.152 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:49.152 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:49.153 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533122+0000", 2024-09-13T06:42:49.153 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9052999999999999e-05 2024-09-13T06:42:49.153 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:49.153 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:49.153 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:49.153 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533289+0000", 2024-09-13T06:42:49.153 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00016752800000000001 2024-09-13T06:42:49.153 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:49.153 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:49.153 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:49.153 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:49.153 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:49.153 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25744 3.18 3.69d46638 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:42:49.154 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443449+0000", 2024-09-13T06:42:49.154 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 172.66604718599999, 2024-09-13T06:42:49.154 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089869148999999995, 2024-09-13T06:42:49.154 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:49.154 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:42:49.154 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:49.154 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:49.154 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:49.154 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25744 2024-09-13T06:42:49.154 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:49.154 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:49.154 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:49.154 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:49.154 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443449+0000", 2024-09-13T06:42:49.154 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:49.155 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:49.155 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:49.155 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:49.155 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443449+0000", 2024-09-13T06:42:49.155 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:49.155 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:49.155 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:49.155 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:49.155 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443449+0000", 2024-09-13T06:42:49.155 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:49.155 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:49.156 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:49.156 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:49.156 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443451+0000", 2024-09-13T06:42:49.156 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.244e-06 2024-09-13T06:42:49.156 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:49.156 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:49.156 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:49.156 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443457+0000", 2024-09-13T06:42:49.156 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.66e-06 2024-09-13T06:42:49.156 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:49.156 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:49.156 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:49.156 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443461+0000", 2024-09-13T06:42:49.157 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5449999999999997e-06 2024-09-13T06:42:49.157 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:49.157 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:49.157 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:49.157 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533311+0000", 2024-09-13T06:42:49.157 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089849729000000003 2024-09-13T06:42:49.157 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:49.157 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:49.157 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:49.157 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533318+0000", 2024-09-13T06:42:49.157 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.328e-06 2024-09-13T06:42:49.157 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:49.158 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:49.158 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:49.158 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:49.158 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:49.158 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25745 3.18 3.69d46638 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:42:49.158 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443466+0000", 2024-09-13T06:42:49.158 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 172.66603012799999, 2024-09-13T06:42:49.158 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089886743000000005, 2024-09-13T06:42:49.158 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:49.158 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:42:49.158 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:49.158 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:49.158 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:49.159 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25745 2024-09-13T06:42:49.159 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:49.159 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:49.159 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:49.159 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:49.159 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443466+0000", 2024-09-13T06:42:49.159 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:49.159 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:49.159 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:49.159 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:49.159 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443466+0000", 2024-09-13T06:42:49.159 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:49.159 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:49.160 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:49.160 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:49.160 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443466+0000", 2024-09-13T06:42:49.160 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:49.160 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:49.160 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:49.160 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:49.160 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443474+0000", 2024-09-13T06:42:49.160 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.1289999999999996e-06 2024-09-13T06:42:49.160 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:49.160 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:49.160 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:49.160 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443484+0000", 2024-09-13T06:42:49.161 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0654e-05 2024-09-13T06:42:49.161 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:49.161 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:49.161 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:49.161 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443490+0000", 2024-09-13T06:42:49.161 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8030000000000002e-06 2024-09-13T06:42:49.161 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:49.161 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:49.161 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:49.161 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533348+0000", 2024-09-13T06:42:49.161 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089857267000000005 2024-09-13T06:42:49.161 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:49.162 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:49.162 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:49.162 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533353+0000", 2024-09-13T06:42:49.162 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.5520000000000004e-06 2024-09-13T06:42:49.162 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:49.162 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:49.162 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:49.162 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:49.162 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:49.162 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25746 3.18 3.69d46638 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:42:49.162 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443495+0000", 2024-09-13T06:42:49.162 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 172.66600101500001, 2024-09-13T06:42:49.162 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089903725000000004, 2024-09-13T06:42:49.163 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:49.163 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:42:49.163 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:49.163 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:49.163 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:49.163 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25746 2024-09-13T06:42:49.163 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:49.163 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:49.163 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:49.163 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:49.163 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443495+0000", 2024-09-13T06:42:49.163 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:49.163 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:49.164 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:49.164 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:49.164 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443495+0000", 2024-09-13T06:42:49.164 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:49.164 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:49.164 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:49.164 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:49.164 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443495+0000", 2024-09-13T06:42:49.164 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:49.164 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:49.164 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:49.164 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:49.164 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443498+0000", 2024-09-13T06:42:49.165 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.7690000000000001e-06 2024-09-13T06:42:49.165 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:49.165 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:49.165 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:49.165 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443504+0000", 2024-09-13T06:42:49.165 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9710000000000001e-06 2024-09-13T06:42:49.165 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:49.165 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:49.165 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:49.165 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443508+0000", 2024-09-13T06:42:49.165 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4159999999999997e-06 2024-09-13T06:42:49.165 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:49.165 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:49.166 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:49.166 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533391+0000", 2024-09-13T06:42:49.166 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089882607000000003 2024-09-13T06:42:49.166 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:49.166 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:49.166 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:49.166 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533399+0000", 2024-09-13T06:42:49.166 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.4349999999999997e-06 2024-09-13T06:42:49.166 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:49.166 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:49.166 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:49.166 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:49.166 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:49.167 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25747 3.8 3.63996268 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:42:49.167 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443512+0000", 2024-09-13T06:42:49.167 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 172.66598428399999, 2024-09-13T06:42:49.167 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089880075000000004, 2024-09-13T06:42:49.167 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:49.167 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:42:49.167 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:49.167 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:49.167 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:49.167 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25747 2024-09-13T06:42:49.167 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:49.167 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:49.168 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:49.168 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:49.168 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443512+0000", 2024-09-13T06:42:49.168 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:49.168 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:49.168 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:49.168 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:49.168 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443512+0000", 2024-09-13T06:42:49.168 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:49.168 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:49.168 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:49.168 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:49.168 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443512+0000", 2024-09-13T06:42:49.168 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:49.169 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:49.169 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:49.169 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:49.169 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443514+0000", 2024-09-13T06:42:49.169 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0980000000000001e-06 2024-09-13T06:42:49.169 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:49.169 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:49.169 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:49.169 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443520+0000", 2024-09-13T06:42:49.169 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7069999999999997e-06 2024-09-13T06:42:49.169 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:49.169 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:49.169 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:49.170 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443524+0000", 2024-09-13T06:42:49.170 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5390000000000001e-06 2024-09-13T06:42:49.170 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:49.170 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:49.170 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:49.170 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533384+0000", 2024-09-13T06:42:49.170 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089859684999999995 2024-09-13T06:42:49.170 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:49.170 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:49.170 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:49.170 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533392+0000", 2024-09-13T06:42:49.170 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.3440000000000001e-06 2024-09-13T06:42:49.170 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:49.171 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:49.171 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:49.171 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:49.171 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:49.171 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25748 3.8 3.63996268 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:42:49.171 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443528+0000", 2024-09-13T06:42:49.171 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 172.66596815700001, 2024-09-13T06:42:49.171 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089890715999999996, 2024-09-13T06:42:49.171 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:49.171 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:42:49.171 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:49.171 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:49.171 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:49.171 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25748 2024-09-13T06:42:49.172 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:49.172 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:49.172 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:49.172 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:49.172 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443528+0000", 2024-09-13T06:42:49.172 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:49.172 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:49.172 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:49.172 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:49.172 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443528+0000", 2024-09-13T06:42:49.172 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:49.172 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:49.172 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:49.172 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:49.172 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443528+0000", 2024-09-13T06:42:49.173 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:49.173 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:49.173 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:49.173 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:49.173 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443530+0000", 2024-09-13T06:42:49.173 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0650000000000001e-06 2024-09-13T06:42:49.173 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:49.173 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:49.173 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:49.173 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443536+0000", 2024-09-13T06:42:49.174 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7259999999999999e-06 2024-09-13T06:42:49.174 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:49.174 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:49.174 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:49.174 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443540+0000", 2024-09-13T06:42:49.174 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5009999999999998e-06 2024-09-13T06:42:49.174 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:49.174 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:49.174 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:49.174 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533412+0000", 2024-09-13T06:42:49.174 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089871873000000005 2024-09-13T06:42:49.174 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:49.175 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:49.175 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:49.175 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533419+0000", 2024-09-13T06:42:49.175 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.883e-06 2024-09-13T06:42:49.175 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:49.175 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:49.175 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:49.175 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:49.175 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:49.175 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25749 3.8 3.63996268 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:42:49.175 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443545+0000", 2024-09-13T06:42:49.175 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 172.66595196099999, 2024-09-13T06:42:49.175 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089897988999999998, 2024-09-13T06:42:49.175 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:49.176 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:42:49.176 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:49.176 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:49.176 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:49.176 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25749 2024-09-13T06:42:49.176 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:49.176 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:49.176 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:49.176 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:49.176 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443545+0000", 2024-09-13T06:42:49.176 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:49.176 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:49.177 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:49.177 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:49.177 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443545+0000", 2024-09-13T06:42:49.177 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:49.177 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:49.177 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:49.177 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:49.177 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443544+0000", 2024-09-13T06:42:49.177 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:49.177 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:49.177 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:49.177 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:49.177 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443553+0000", 2024-09-13T06:42:49.177 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.4770000000000003e-06 2024-09-13T06:42:49.178 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:49.178 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:49.178 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:49.178 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443564+0000", 2024-09-13T06:42:49.178 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0986e-05 2024-09-13T06:42:49.178 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:49.178 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:49.178 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:49.178 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443569+0000", 2024-09-13T06:42:49.178 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2530000000000004e-06 2024-09-13T06:42:49.178 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:49.178 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:49.178 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:49.178 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533438+0000", 2024-09-13T06:42:49.179 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089868641999999999 2024-09-13T06:42:49.179 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:49.179 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:49.179 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:49.179 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533442+0000", 2024-09-13T06:42:49.179 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.989e-06 2024-09-13T06:42:49.179 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:49.179 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:49.179 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:49.179 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:49.179 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:49.179 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25750 3.8 3.63996268 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:42:49.180 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443574+0000", 2024-09-13T06:42:49.180 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 172.665922475, 2024-09-13T06:42:49.180 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089895143999999996, 2024-09-13T06:42:49.180 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:49.180 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:42:49.180 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:49.180 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:49.180 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:49.180 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25750 2024-09-13T06:42:49.180 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:49.180 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:49.181 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:49.181 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:49.181 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443574+0000", 2024-09-13T06:42:49.181 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:49.181 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:49.181 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:49.181 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:49.181 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443574+0000", 2024-09-13T06:42:49.181 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:49.181 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:49.181 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:49.181 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:49.181 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443574+0000", 2024-09-13T06:42:49.182 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:49.182 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:49.182 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:49.182 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:49.182 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443576+0000", 2024-09-13T06:42:49.182 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6910000000000002e-06 2024-09-13T06:42:49.182 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:49.182 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:49.182 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:49.182 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443583+0000", 2024-09-13T06:42:49.182 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.331e-06 2024-09-13T06:42:49.182 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:49.182 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:49.183 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:49.183 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443587+0000", 2024-09-13T06:42:49.183 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6129999999999997e-06 2024-09-13T06:42:49.183 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:49.183 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:49.183 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:49.183 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533464+0000", 2024-09-13T06:42:49.183 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089876605999999998 2024-09-13T06:42:49.183 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:49.183 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:49.183 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:49.183 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533469+0000", 2024-09-13T06:42:49.184 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3909999999999997e-06 2024-09-13T06:42:49.184 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:49.184 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:49.184 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:49.184 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:49.184 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:49.185 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25751 3.8 3.63996268 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:42:49.185 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443592+0000", 2024-09-13T06:42:49.185 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 172.665904778, 2024-09-13T06:42:49.185 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089913650999999997, 2024-09-13T06:42:49.185 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:49.185 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:42:49.185 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:49.185 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:49.185 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:49.185 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25751 2024-09-13T06:42:49.185 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:49.186 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:49.186 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:49.186 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:49.186 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443592+0000", 2024-09-13T06:42:49.186 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:49.186 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:49.186 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:49.186 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:49.186 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443592+0000", 2024-09-13T06:42:49.186 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:49.186 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:49.186 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:49.186 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:49.187 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443591+0000", 2024-09-13T06:42:49.187 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:49.187 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:49.187 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:49.187 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:49.187 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443594+0000", 2024-09-13T06:42:49.187 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3649999999999998e-06 2024-09-13T06:42:49.187 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:49.187 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:49.187 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:49.187 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443599+0000", 2024-09-13T06:42:49.187 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.699e-06 2024-09-13T06:42:49.187 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:49.188 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:49.188 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:49.188 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443611+0000", 2024-09-13T06:42:49.188 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1503e-05 2024-09-13T06:42:49.188 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:49.188 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:49.188 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:49.188 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533497+0000", 2024-09-13T06:42:49.188 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089886453000000005 2024-09-13T06:42:49.188 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:49.188 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:49.188 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:49.188 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533505+0000", 2024-09-13T06:42:49.189 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.9910000000000002e-06 2024-09-13T06:42:49.189 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:49.189 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:49.189 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:49.189 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:49.189 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:49.189 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25752 3.8 3.63996268 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:42:49.189 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443615+0000", 2024-09-13T06:42:49.189 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 172.66588099699999, 2024-09-13T06:42:49.189 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089905868999999999, 2024-09-13T06:42:49.189 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:49.189 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:42:49.189 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:49.190 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:49.190 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:49.190 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25752 2024-09-13T06:42:49.190 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:49.190 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:49.190 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:49.190 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:49.190 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443615+0000", 2024-09-13T06:42:49.190 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:49.190 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:49.190 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:49.190 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:49.190 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443615+0000", 2024-09-13T06:42:49.190 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:49.191 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:49.191 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:49.191 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:49.191 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443615+0000", 2024-09-13T06:42:49.191 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:49.191 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:49.191 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:49.191 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:49.191 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443617+0000", 2024-09-13T06:42:49.191 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3539999999999998e-06 2024-09-13T06:42:49.191 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:49.191 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:49.191 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:49.192 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443624+0000", 2024-09-13T06:42:49.192 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3600000000000001e-06 2024-09-13T06:42:49.192 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:49.192 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:49.192 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:49.192 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443628+0000", 2024-09-13T06:42:49.192 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.2350000000000001e-06 2024-09-13T06:42:49.192 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:49.192 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:49.192 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:49.192 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533517+0000", 2024-09-13T06:42:49.192 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089889029999999995 2024-09-13T06:42:49.192 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:49.193 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:49.193 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:49.193 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533521+0000", 2024-09-13T06:42:49.193 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.2529999999999998e-06 2024-09-13T06:42:49.193 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:49.193 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:49.193 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:49.193 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:49.193 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:49.193 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:64356 3.c 3:32785be9:::rbd_header.11218ba71f0d:head [watch reconnect cookie 140361410387072 gen 2] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e95)", 2024-09-13T06:42:49.193 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:48.473318+0000", 2024-09-13T06:42:49.193 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 120.63617860399999, 2024-09-13T06:42:49.193 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1458904379999999, 2024-09-13T06:42:49.193 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:49.194 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:49.194 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:49.194 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:49.194 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:49.194 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 64356 2024-09-13T06:42:49.194 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:49.194 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:49.194 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:49.194 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:49.194 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:48.473318+0000", 2024-09-13T06:42:49.194 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:49.194 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:49.194 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:49.194 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:49.195 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:48.473318+0000", 2024-09-13T06:42:49.195 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:49.195 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:49.195 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:49.195 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:49.195 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:48.473315+0000", 2024-09-13T06:42:49.195 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999971 2024-09-13T06:42:49.195 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:49.195 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:49.195 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:49.195 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:48.473329+0000", 2024-09-13T06:42:49.195 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.433e-05 2024-09-13T06:42:49.195 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:49.196 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:49.196 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:49.196 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:48.473363+0000", 2024-09-13T06:42:49.196 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.3592e-05 2024-09-13T06:42:49.196 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:49.196 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:49.196 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:49.196 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:48.473386+0000", 2024-09-13T06:42:49.196 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2708999999999999e-05 2024-09-13T06:42:49.196 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:49.196 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:49.196 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:49.196 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:48.473804+0000", 2024-09-13T06:42:49.196 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00041789399999999998 2024-09-13T06:42:49.197 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:49.197 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:49.197 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:42:49.197 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:48.473830+0000", 2024-09-13T06:42:49.197 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6869e-05 2024-09-13T06:42:49.197 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:49.197 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:49.197 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:49.197 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:49.614332+0000", 2024-09-13T06:42:49.198 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.140501107 2024-09-13T06:42:49.198 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:49.198 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:49.198 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for rw locks", 2024-09-13T06:42:49.198 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:49.614496+0000", 2024-09-13T06:42:49.198 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00016451200000000001 2024-09-13T06:42:49.198 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:49.198 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:49.198 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:49.198 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:49.617131+0000", 2024-09-13T06:42:49.199 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.002634843 2024-09-13T06:42:49.199 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:49.199 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:49.199 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:49.199 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:49.617204+0000", 2024-09-13T06:42:49.199 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.2991000000000006e-05 2024-09-13T06:42:49.199 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:49.199 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:49.199 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:49.199 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:49.619208+0000", 2024-09-13T06:42:49.199 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.002004381 2024-09-13T06:42:49.199 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:49.199 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:49.200 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:49.200 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:49.200 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:49.200 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:170155 3.7 3:e17728eb:::image_client.0-clone36.rbd:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e191)", 2024-09-13T06:42:49.200 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:42:31.436412+0000", 2024-09-13T06:42:49.200 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 17.673084781, 2024-09-13T06:42:49.200 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.97843703800000004, 2024-09-13T06:42:49.200 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:49.200 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:42:49.200 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:49.200 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:49.200 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:49.200 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 170155 2024-09-13T06:42:49.201 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:49.201 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:49.201 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:49.201 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:49.201 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:31.436412+0000", 2024-09-13T06:42:49.201 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:49.201 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:49.201 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:49.201 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:49.201 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:31.436412+0000", 2024-09-13T06:42:49.201 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:49.201 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:49.201 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:49.202 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:49.202 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:31.436410+0000", 2024-09-13T06:42:49.202 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999986 2024-09-13T06:42:49.202 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:49.202 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:49.202 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:49.202 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:31.436417+0000", 2024-09-13T06:42:49.202 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.6939999999999998e-06 2024-09-13T06:42:49.202 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:49.202 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:49.202 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:49.202 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:31.436430+0000", 2024-09-13T06:42:49.202 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3016999999999999e-05 2024-09-13T06:42:49.202 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:49.203 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:49.203 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:49.203 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:31.436437+0000", 2024-09-13T06:42:49.203 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.1069999999999999e-06 2024-09-13T06:42:49.203 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:49.203 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:49.203 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:49.203 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:31.436515+0000", 2024-09-13T06:42:49.203 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.7756000000000006e-05 2024-09-13T06:42:49.203 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:49.203 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:49.203 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:42:49.203 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:31.436523+0000", 2024-09-13T06:42:49.204 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.4970000000000001e-06 2024-09-13T06:42:49.204 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:49.204 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:49.204 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:49.204 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:32.414565+0000", 2024-09-13T06:42:49.204 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.97804144199999998 2024-09-13T06:42:49.204 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:49.204 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:49.204 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:49.204 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:32.414849+0000", 2024-09-13T06:42:49.204 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00028388600000000001 2024-09-13T06:42:49.204 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:49.204 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:49.205 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:49.205 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:49.205 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:49.205 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:42:49.206 INFO:teuthology.orchestra.run.smithi081.stdout:osd.4: {} 2024-09-13T06:42:49.206 INFO:teuthology.orchestra.run.smithi081.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-13T06:42:49.207 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-13T06:42:49.208 INFO:teuthology.orchestra.run.smithi081.stdout:osd.5: {} 2024-09-13T06:42:49.208 INFO:teuthology.orchestra.run.smithi081.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-13T06:42:49.208 INFO:teuthology.orchestra.run.smithi081.stdout:osd.6: {} 2024-09-13T06:42:49.208 INFO:teuthology.orchestra.run.smithi081.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-13T06:42:49.209 INFO:teuthology.orchestra.run.smithi081.stdout:5337 trunc from 0x17b6cbc to 0x5943bda 2024-09-13T06:42:49.209 INFO:teuthology.orchestra.run.smithi081.stdout:osd.7: {} 2024-09-13T06:42:49.209 INFO:teuthology.orchestra.run.smithi081.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-13T06:42:49.210 INFO:teuthology.orchestra.run.smithi081.stdout:5338 read 0x1d68770 thru 0x1d77834 (0xf0c5 bytes) 2024-09-13T06:42:49.210 INFO:teuthology.orchestra.run.smithi081.stdout:5339 read 0x4402203 thru 0x440cd4d (0xab4b bytes) 2024-09-13T06:42:49.211 INFO:teuthology.orchestra.run.smithi081.stdout:5343 writesame 0xda5be28 thru 0xda5f755 data_size 0xd(0x392e bytes) 2024-09-13T06:42:49.211 INFO:teuthology.orchestra.run.smithi081.stdout:5344 writesame 0xcaba106 thru 0xcac9abd data_size 0x8(0xf9b8 bytes) 2024-09-13T06:42:49.211 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-13T06:42:49.201+0000 7fa8bb18e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 36790) UID: 0 2024-09-13T06:42:49.237 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:42:49.237 INFO:teuthology.orchestra.run.smithi081.stdout:5346 punch from 0x4e25475 to 0x4e327ee, (0xd379 bytes) 2024-09-13T06:42:49.237 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:42:49.237 INFO:teuthology.orchestra.run.smithi081.stdout:5350 read 0x39651f0 thru 0x39676c0 (0x24d1 bytes) 2024-09-13T06:42:49.252 INFO:teuthology.orchestra.run.smithi081.stdout:5351 trunc from 0xda5f756 to 0x1690884 2024-09-13T06:42:49.283 INFO:teuthology.orchestra.run.smithi081.stdout:5355 trunc from 0x1690884 to 0xb6e5472 2024-09-13T06:42:49.296 INFO:teuthology.orchestra.run.smithi081.stdout:5356 writesame 0x10601d9 thru 0x106f454 data_size 0x2a(0xf27c bytes) 2024-09-13T06:42:49.305 INFO:teuthology.orchestra.run.smithi081.stdout:5357 write 0xb0fb00d thru 0xb109876 (0xe86a bytes) 2024-09-13T06:42:49.307 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:42:49.301+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:42:49.340 INFO:teuthology.orchestra.run.smithi081.stdout:5358 write 0xd7041c5 thru 0xd710799 (0xc5d5 bytes) 2024-09-13T06:42:49.357 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:42:49.357 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [], 2024-09-13T06:42:49.357 INFO:teuthology.orchestra.run.smithi139.stdout: "num_ops": 0 2024-09-13T06:42:49.357 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:42:49.368 INFO:teuthology.orchestra.run.smithi081.stdout:5359 clone 40 order 22 su 2097152 sc 4 2024-09-13T06:42:49.373 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-13T06:42:49.416 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:42:49.413+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:42:49.509 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:42:49.508+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:42:49.536 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:42:49.536 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [], 2024-09-13T06:42:49.536 INFO:teuthology.orchestra.run.smithi139.stdout: "complaint_time": 30, 2024-09-13T06:42:49.536 INFO:teuthology.orchestra.run.smithi139.stdout: "num_blocked_ops": 0 2024-09-13T06:42:49.536 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:42:49.550 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-13T06:42:49.610 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:42:49.612+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:42:49.672 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:42:49.672 INFO:teuthology.orchestra.run.smithi139.stdout: "size": 20, 2024-09-13T06:42:49.672 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 600, 2024-09-13T06:42:49.672 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [ 2024-09-13T06:42:49.672 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:49.672 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18706 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 3346432~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:42:49.673 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.846138+0000", 2024-09-13T06:42:49.673 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 177.82390617999999, 2024-09-13T06:42:49.673 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.102018712, 2024-09-13T06:42:49.673 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:49.673 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:49.673 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:49.673 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:49.673 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:49.673 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18706 2024-09-13T06:42:49.673 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:49.673 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:49.673 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:49.673 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:49.673 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846138+0000", 2024-09-13T06:42:49.674 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:49.674 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:49.674 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:49.674 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:49.674 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846138+0000", 2024-09-13T06:42:49.674 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:49.674 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:49.674 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:49.674 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:49.674 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846138+0000", 2024-09-13T06:42:49.674 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:49.674 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:49.674 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:49.674 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:49.674 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846141+0000", 2024-09-13T06:42:49.674 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.6969999999999999e-06 2024-09-13T06:42:49.675 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:49.675 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:49.675 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:49.675 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846150+0000", 2024-09-13T06:42:49.675 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6400000000000003e-06 2024-09-13T06:42:49.675 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:49.675 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:49.675 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:49.675 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846160+0000", 2024-09-13T06:42:49.675 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.3999999999999998e-06 2024-09-13T06:42:49.676 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:49.676 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:49.676 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:49.676 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.947764+0000", 2024-09-13T06:42:49.676 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101604085 2024-09-13T06:42:49.676 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:49.676 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:49.676 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:49.676 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.947888+0000", 2024-09-13T06:42:49.676 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000124113 2024-09-13T06:42:49.676 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:49.677 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:49.677 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:49.677 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.948157+0000", 2024-09-13T06:42:49.677 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00026943399999999998 2024-09-13T06:42:49.677 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:49.677 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:49.677 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:49.677 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:49.677 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:49.677 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18707 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 3375104~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:42:49.677 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.846207+0000", 2024-09-13T06:42:49.677 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 177.823837414, 2024-09-13T06:42:49.677 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10238114099999999, 2024-09-13T06:42:49.678 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:49.678 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:49.678 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:49.678 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:49.678 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:49.678 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18707 2024-09-13T06:42:49.678 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:49.678 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:49.678 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:49.678 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:49.678 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846207+0000", 2024-09-13T06:42:49.678 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:49.678 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:49.678 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:49.679 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:49.679 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846207+0000", 2024-09-13T06:42:49.679 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:49.679 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:49.679 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:49.679 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:49.679 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846206+0000", 2024-09-13T06:42:49.679 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:42:49.679 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:49.679 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:49.679 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:49.679 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846211+0000", 2024-09-13T06:42:49.679 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.3000000000000003e-06 2024-09-13T06:42:49.679 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:49.679 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:49.680 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:49.680 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846220+0000", 2024-09-13T06:42:49.680 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6199999999999994e-06 2024-09-13T06:42:49.680 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:49.680 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:49.680 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:49.680 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846228+0000", 2024-09-13T06:42:49.680 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.7500000000000003e-06 2024-09-13T06:42:49.680 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:49.680 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:49.680 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:49.680 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.948267+0000", 2024-09-13T06:42:49.680 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10203878700000001 2024-09-13T06:42:49.680 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:49.681 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:49.681 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:49.681 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.948435+0000", 2024-09-13T06:42:49.681 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00016796500000000001 2024-09-13T06:42:49.681 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:49.681 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:49.681 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:49.681 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.948588+0000", 2024-09-13T06:42:49.681 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00015373599999999999 2024-09-13T06:42:49.681 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:49.681 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:49.682 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:49.682 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:49.682 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:49.682 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18718 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 3690496~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:42:49.682 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.850174+0000", 2024-09-13T06:42:49.682 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 177.81987026100001, 2024-09-13T06:42:49.682 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101854154, 2024-09-13T06:42:49.682 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:49.682 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:49.682 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:49.682 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:49.682 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:49.683 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18718 2024-09-13T06:42:49.683 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:49.683 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:49.683 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:49.683 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:49.683 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850174+0000", 2024-09-13T06:42:49.683 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:49.683 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:49.683 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:49.683 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:49.683 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850174+0000", 2024-09-13T06:42:49.683 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:49.683 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:49.683 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:49.684 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:49.684 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850173+0000", 2024-09-13T06:42:49.684 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:42:49.684 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:49.684 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:49.684 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:49.684 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850178+0000", 2024-09-13T06:42:49.684 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.4129999999999999e-06 2024-09-13T06:42:49.684 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:49.684 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:49.684 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:49.684 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850188+0000", 2024-09-13T06:42:49.684 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.8600000000000005e-06 2024-09-13T06:42:49.684 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:49.684 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:49.685 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:49.685 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850195+0000", 2024-09-13T06:42:49.685 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.8730000000000007e-06 2024-09-13T06:42:49.685 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:49.685 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:49.685 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:49.685 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.951766+0000", 2024-09-13T06:42:49.685 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.1015703 2024-09-13T06:42:49.685 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:49.686 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:49.686 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:49.686 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.951879+0000", 2024-09-13T06:42:49.686 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000112932 2024-09-13T06:42:49.686 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:49.686 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:49.686 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:49.686 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.952029+0000", 2024-09-13T06:42:49.686 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000149846 2024-09-13T06:42:49.686 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:49.686 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:49.686 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:49.686 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:49.687 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:49.687 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18719 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 3719168~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:42:49.687 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.850202+0000", 2024-09-13T06:42:49.687 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 177.81984221799999, 2024-09-13T06:42:49.687 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.102191676, 2024-09-13T06:42:49.687 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:49.687 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:49.687 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:49.687 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:49.687 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:49.687 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18719 2024-09-13T06:42:49.687 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:49.687 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:49.688 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:49.688 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:49.688 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850202+0000", 2024-09-13T06:42:49.688 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:49.688 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:49.688 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:49.688 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:49.688 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850202+0000", 2024-09-13T06:42:49.688 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:49.688 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:49.689 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:49.689 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:49.689 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850202+0000", 2024-09-13T06:42:49.689 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:42:49.689 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:49.689 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:49.689 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:49.689 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850205+0000", 2024-09-13T06:42:49.689 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.89e-06 2024-09-13T06:42:49.689 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:49.689 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:49.689 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:49.689 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850216+0000", 2024-09-13T06:42:49.690 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0233e-05 2024-09-13T06:42:49.690 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:49.690 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:49.690 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:49.690 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850223+0000", 2024-09-13T06:42:49.690 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5299999999999999e-06 2024-09-13T06:42:49.690 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:49.690 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:49.690 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:49.690 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.952106+0000", 2024-09-13T06:42:49.690 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10188309299999999 2024-09-13T06:42:49.690 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:49.690 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:49.690 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:49.691 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.952233+0000", 2024-09-13T06:42:49.691 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000126993 2024-09-13T06:42:49.691 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:49.691 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:49.691 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:49.691 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.952394+0000", 2024-09-13T06:42:49.691 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000160791 2024-09-13T06:42:49.691 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:49.691 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:49.691 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:49.691 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:49.691 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:49.691 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18720 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 3747840~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:42:49.691 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.850726+0000", 2024-09-13T06:42:49.692 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 177.81931838899999, 2024-09-13T06:42:49.692 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10199504299999999, 2024-09-13T06:42:49.692 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:49.692 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:49.692 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:49.692 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:49.692 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:49.692 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18720 2024-09-13T06:42:49.692 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:49.692 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:49.692 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:49.692 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:49.693 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850726+0000", 2024-09-13T06:42:49.693 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:49.693 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:49.693 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:49.693 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:49.693 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850726+0000", 2024-09-13T06:42:49.693 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:49.693 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:49.693 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:49.693 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:49.693 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850229+0000", 2024-09-13T06:42:49.693 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9995027 2024-09-13T06:42:49.693 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:49.694 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:49.694 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:49.694 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850731+0000", 2024-09-13T06:42:49.694 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00050221599999999999 2024-09-13T06:42:49.694 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:49.694 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:49.694 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:49.694 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850751+0000", 2024-09-13T06:42:49.694 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.9703000000000001e-05 2024-09-13T06:42:49.694 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:49.694 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:49.694 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:49.694 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850764+0000", 2024-09-13T06:42:49.694 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3207000000000001e-05 2024-09-13T06:42:49.695 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:49.695 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:49.695 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:49.695 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.952454+0000", 2024-09-13T06:42:49.695 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101690102 2024-09-13T06:42:49.695 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:49.695 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:49.695 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:49.695 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.952571+0000", 2024-09-13T06:42:49.695 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000116556 2024-09-13T06:42:49.695 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:49.695 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:49.695 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:49.695 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.952721+0000", 2024-09-13T06:42:49.696 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000150419 2024-09-13T06:42:49.696 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:49.696 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:49.696 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:49.696 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:49.696 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:49.696 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18730 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 4034560~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:42:49.696 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.854013+0000", 2024-09-13T06:42:49.696 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 177.81603144799999, 2024-09-13T06:42:49.696 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10186914399999999, 2024-09-13T06:42:49.697 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:49.697 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:49.697 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:49.697 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:49.697 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:49.697 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18730 2024-09-13T06:42:49.697 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:49.697 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:49.697 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:49.697 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:49.697 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.854013+0000", 2024-09-13T06:42:49.697 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:49.697 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:49.697 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:49.698 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:49.698 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.854013+0000", 2024-09-13T06:42:49.698 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:49.698 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:49.698 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:49.698 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:49.698 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.854013+0000", 2024-09-13T06:42:49.698 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:49.698 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:49.698 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:49.698 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:49.698 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.854016+0000", 2024-09-13T06:42:49.698 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.1839999999999999e-06 2024-09-13T06:42:49.698 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:49.698 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:49.699 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:49.699 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.854025+0000", 2024-09-13T06:42:49.699 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.8030000000000003e-06 2024-09-13T06:42:49.699 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:49.699 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:49.699 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:49.700 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.854033+0000", 2024-09-13T06:42:49.700 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6500000000000002e-06 2024-09-13T06:42:49.700 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:49.700 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:49.700 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:49.700 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.955546+0000", 2024-09-13T06:42:49.700 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10151296 2024-09-13T06:42:49.700 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:49.700 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:49.700 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:49.700 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.955694+0000", 2024-09-13T06:42:49.701 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000147773 2024-09-13T06:42:49.701 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:49.701 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:49.701 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:49.701 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.955882+0000", 2024-09-13T06:42:49.701 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000188371 2024-09-13T06:42:49.701 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:49.701 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:49.701 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:49.701 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:49.701 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:49.701 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18742 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 4378624~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:42:49.701 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.857984+0000", 2024-09-13T06:42:49.702 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 177.812060325, 2024-09-13T06:42:49.702 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10179961799999999, 2024-09-13T06:42:49.702 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:49.702 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:49.702 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:49.702 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:49.702 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:49.702 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18742 2024-09-13T06:42:49.702 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:49.702 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:49.702 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:49.702 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:49.702 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.857984+0000", 2024-09-13T06:42:49.702 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:49.703 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:49.703 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:49.703 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:49.703 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.857984+0000", 2024-09-13T06:42:49.703 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:49.703 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:49.703 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:49.703 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:49.703 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.857983+0000", 2024-09-13T06:42:49.703 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:42:49.703 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:49.703 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:49.703 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:49.704 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.857987+0000", 2024-09-13T06:42:49.704 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0670000000000002e-06 2024-09-13T06:42:49.704 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:49.704 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:49.704 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:49.704 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.857997+0000", 2024-09-13T06:42:49.704 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6830000000000003e-06 2024-09-13T06:42:49.704 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:49.704 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:49.704 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:49.704 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.858006+0000", 2024-09-13T06:42:49.704 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.5739999999999996e-06 2024-09-13T06:42:49.704 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:49.704 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:49.705 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:49.705 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.959453+0000", 2024-09-13T06:42:49.705 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101447339 2024-09-13T06:42:49.705 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:49.705 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:49.705 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:49.705 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.959603+0000", 2024-09-13T06:42:49.705 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000150316 2024-09-13T06:42:49.705 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:49.705 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:49.705 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:49.705 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.959784+0000", 2024-09-13T06:42:49.705 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00018065900000000001 2024-09-13T06:42:49.706 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:49.706 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:49.706 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:49.706 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:49.706 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:49.706 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18743 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 4407296~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:42:49.706 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.858012+0000", 2024-09-13T06:42:49.706 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 177.812032332, 2024-09-13T06:42:49.706 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10210024500000001, 2024-09-13T06:42:49.706 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:49.707 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:49.707 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:49.707 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:49.707 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:49.707 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18743 2024-09-13T06:42:49.707 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:49.707 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:49.707 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:49.707 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:49.707 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.858012+0000", 2024-09-13T06:42:49.707 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:49.707 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:49.707 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:49.707 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:49.708 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.858012+0000", 2024-09-13T06:42:49.708 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:49.708 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:49.708 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:49.708 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:49.708 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.858011+0000", 2024-09-13T06:42:49.708 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:42:49.708 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:49.708 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:49.708 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:49.708 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.858016+0000", 2024-09-13T06:42:49.709 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0659999999999997e-06 2024-09-13T06:42:49.709 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:49.709 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:49.709 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:49.709 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.858024+0000", 2024-09-13T06:42:49.709 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.7700000000000007e-06 2024-09-13T06:42:49.709 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:49.709 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:49.709 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:49.709 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.858032+0000", 2024-09-13T06:42:49.709 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.7700000000000001e-06 2024-09-13T06:42:49.709 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:49.709 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:49.709 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:49.710 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.959850+0000", 2024-09-13T06:42:49.710 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.1018182 2024-09-13T06:42:49.710 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:49.710 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:49.710 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:49.710 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.959964+0000", 2024-09-13T06:42:49.710 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00011413600000000001 2024-09-13T06:42:49.710 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:49.710 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:49.711 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:49.711 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.960113+0000", 2024-09-13T06:42:49.711 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00014813900000000001 2024-09-13T06:42:49.711 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:49.711 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:49.711 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:49.711 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:49.711 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:49.711 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18755 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 4751360~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:42:49.711 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.862061+0000", 2024-09-13T06:42:49.711 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 177.80798408000001, 2024-09-13T06:42:49.711 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101907023, 2024-09-13T06:42:49.711 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:49.711 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:49.711 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:49.712 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:49.712 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:49.712 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18755 2024-09-13T06:42:49.712 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:49.712 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:49.712 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:49.712 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:49.712 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862061+0000", 2024-09-13T06:42:49.712 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:49.712 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:49.712 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:49.712 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:49.712 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862061+0000", 2024-09-13T06:42:49.713 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:49.713 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:49.713 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:49.713 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:49.713 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862060+0000", 2024-09-13T06:42:49.713 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:42:49.713 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:49.713 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:49.713 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:49.713 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862064+0000", 2024-09-13T06:42:49.713 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.3229999999999999e-06 2024-09-13T06:42:49.713 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:49.713 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:49.713 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:49.714 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862078+0000", 2024-09-13T06:42:49.714 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.433e-05 2024-09-13T06:42:49.714 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:49.714 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:49.714 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:49.714 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862086+0000", 2024-09-13T06:42:49.714 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.3869999999999997e-06 2024-09-13T06:42:49.714 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:49.714 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:49.714 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:49.714 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.963635+0000", 2024-09-13T06:42:49.714 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101549606 2024-09-13T06:42:49.714 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:49.714 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:49.715 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:49.715 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.963783+0000", 2024-09-13T06:42:49.715 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000147312 2024-09-13T06:42:49.715 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:49.715 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:49.715 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:49.715 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.963968+0000", 2024-09-13T06:42:49.715 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000185028 2024-09-13T06:42:49.715 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:49.715 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:49.715 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:49.715 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:49.715 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:49.716 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18756 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 4780032~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:42:49.716 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.862132+0000", 2024-09-13T06:42:49.716 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 177.80791223700001, 2024-09-13T06:42:49.716 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.102159295, 2024-09-13T06:42:49.716 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:49.716 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:49.716 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:49.716 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:49.716 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:49.716 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18756 2024-09-13T06:42:49.716 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:49.717 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:49.717 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:49.717 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:49.717 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862132+0000", 2024-09-13T06:42:49.717 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:49.717 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:49.717 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:49.717 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:49.717 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862132+0000", 2024-09-13T06:42:49.717 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:49.717 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:49.718 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:49.718 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:49.718 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862132+0000", 2024-09-13T06:42:49.718 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:42:49.718 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:49.718 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:49.718 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:49.718 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862136+0000", 2024-09-13T06:42:49.719 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.9559999999999999e-06 2024-09-13T06:42:49.719 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:49.719 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:49.719 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:49.719 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862145+0000", 2024-09-13T06:42:49.719 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6169999999999996e-06 2024-09-13T06:42:49.719 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:49.719 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:49.719 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:49.719 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862153+0000", 2024-09-13T06:42:49.719 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.8359999999999992e-06 2024-09-13T06:42:49.719 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:49.720 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:49.720 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:49.720 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.964018+0000", 2024-09-13T06:42:49.720 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101865421 2024-09-13T06:42:49.720 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:49.720 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:49.720 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:49.720 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.964140+0000", 2024-09-13T06:42:49.720 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000121172 2024-09-13T06:42:49.720 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:49.720 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:49.721 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:49.721 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.964292+0000", 2024-09-13T06:42:49.721 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00015202600000000001 2024-09-13T06:42:49.721 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:49.721 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:49.721 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:49.721 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:49.721 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:49.721 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18768 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 5124096~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:42:49.721 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.866345+0000", 2024-09-13T06:42:49.721 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 177.80369992999999, 2024-09-13T06:42:49.721 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101779361, 2024-09-13T06:42:49.722 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:49.722 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:49.722 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:49.722 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:49.722 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:49.722 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18768 2024-09-13T06:42:49.722 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:49.722 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:49.722 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:49.722 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:49.722 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.866345+0000", 2024-09-13T06:42:49.723 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:49.723 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:49.723 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:49.723 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:49.723 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.866345+0000", 2024-09-13T06:42:49.723 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:49.723 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:49.723 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:49.723 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:49.723 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.866344+0000", 2024-09-13T06:42:49.723 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:49.723 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:49.724 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:49.724 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:49.724 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.866348+0000", 2024-09-13T06:42:49.724 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.4300000000000002e-06 2024-09-13T06:42:49.724 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:49.724 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:49.724 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:49.724 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.866356+0000", 2024-09-13T06:42:49.724 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.5930000000000006e-06 2024-09-13T06:42:49.724 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:49.724 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:49.725 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:49.725 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.866364+0000", 2024-09-13T06:42:49.725 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5599999999999996e-06 2024-09-13T06:42:49.725 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:49.725 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:49.725 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:49.725 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.967865+0000", 2024-09-13T06:42:49.725 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101501683 2024-09-13T06:42:49.725 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:49.725 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:49.726 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:49.726 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.967981+0000", 2024-09-13T06:42:49.726 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000115643 2024-09-13T06:42:49.726 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:49.726 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:49.726 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:49.726 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.968124+0000", 2024-09-13T06:42:49.726 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00014305500000000001 2024-09-13T06:42:49.726 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:49.726 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:49.726 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:49.726 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:49.726 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:49.727 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18779 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 5439488~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:42:49.727 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.869996+0000", 2024-09-13T06:42:49.727 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 177.80004904500001, 2024-09-13T06:42:49.727 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10189577399999999, 2024-09-13T06:42:49.727 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:49.727 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:49.727 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:49.727 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:49.727 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:49.727 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18779 2024-09-13T06:42:49.727 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:49.727 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:49.728 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:49.728 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:49.728 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.869996+0000", 2024-09-13T06:42:49.728 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:49.728 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:49.728 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:49.728 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:49.728 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.869996+0000", 2024-09-13T06:42:49.728 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:49.728 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:49.728 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:49.729 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:49.729 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.869995+0000", 2024-09-13T06:42:49.729 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:49.729 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:49.729 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:49.729 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:49.729 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.869998+0000", 2024-09-13T06:42:49.729 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.2729999999999998e-06 2024-09-13T06:42:49.729 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:49.729 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:49.729 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:49.729 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.870007+0000", 2024-09-13T06:42:49.729 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.5760000000000006e-06 2024-09-13T06:42:49.730 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:49.730 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:49.730 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:49.730 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.870014+0000", 2024-09-13T06:42:49.730 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.1400000000000002e-06 2024-09-13T06:42:49.730 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:49.730 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:49.730 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:49.730 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.971631+0000", 2024-09-13T06:42:49.730 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101617503 2024-09-13T06:42:49.730 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:49.730 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:49.730 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:49.731 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.971747+0000", 2024-09-13T06:42:49.731 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00011599600000000001 2024-09-13T06:42:49.731 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:49.731 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:49.731 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:49.731 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.971891+0000", 2024-09-13T06:42:49.731 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000143912 2024-09-13T06:42:49.731 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:49.731 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:49.731 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:49.731 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:49.731 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:49.731 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18792 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 5812224~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:42:49.732 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.874371+0000", 2024-09-13T06:42:49.732 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 177.79567391500001, 2024-09-13T06:42:49.732 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101736005, 2024-09-13T06:42:49.732 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:49.732 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:49.732 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:49.732 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:49.732 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:49.732 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18792 2024-09-13T06:42:49.732 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:49.732 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:49.733 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:49.733 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:49.733 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874371+0000", 2024-09-13T06:42:49.733 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:49.733 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:49.733 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:49.733 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:49.733 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874371+0000", 2024-09-13T06:42:49.733 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:49.733 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:49.733 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:49.733 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:49.734 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874370+0000", 2024-09-13T06:42:49.734 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:49.734 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:49.734 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:49.734 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:49.734 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874374+0000", 2024-09-13T06:42:49.734 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.7239999999999998e-06 2024-09-13T06:42:49.734 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:49.734 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:49.734 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:49.734 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874385+0000", 2024-09-13T06:42:49.734 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1293e-05 2024-09-13T06:42:49.734 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:49.735 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:49.735 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:49.735 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874394+0000", 2024-09-13T06:42:49.735 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.0729999999999994e-06 2024-09-13T06:42:49.735 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:49.735 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:49.735 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:49.735 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.975850+0000", 2024-09-13T06:42:49.735 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10145599700000001 2024-09-13T06:42:49.735 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:49.735 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:49.736 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:49.736 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.975963+0000", 2024-09-13T06:42:49.736 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000112689 2024-09-13T06:42:49.736 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:49.736 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:49.736 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:49.736 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.976107+0000", 2024-09-13T06:42:49.736 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000143836 2024-09-13T06:42:49.736 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:49.736 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:49.736 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:49.737 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:49.737 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:49.737 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18793 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 5840896~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:42:49.737 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.874401+0000", 2024-09-13T06:42:49.737 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 177.79564388200001, 2024-09-13T06:42:49.737 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.102005516, 2024-09-13T06:42:49.737 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:49.737 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:49.737 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:49.737 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:49.737 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:49.737 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18793 2024-09-13T06:42:49.738 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:49.738 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:49.738 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:49.738 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:49.738 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874401+0000", 2024-09-13T06:42:49.738 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:49.738 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:49.738 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:49.738 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:49.738 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874401+0000", 2024-09-13T06:42:49.738 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:49.739 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:49.739 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:49.739 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:49.739 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874400+0000", 2024-09-13T06:42:49.739 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:42:49.739 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:49.739 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:49.739 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:49.739 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874404+0000", 2024-09-13T06:42:49.739 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0069999999999999e-06 2024-09-13T06:42:49.740 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:49.740 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:49.740 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:49.740 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874412+0000", 2024-09-13T06:42:49.740 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.5399999999999996e-06 2024-09-13T06:42:49.740 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:49.740 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:49.740 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:49.740 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874420+0000", 2024-09-13T06:42:49.740 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.6199999999999999e-06 2024-09-13T06:42:49.741 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:49.741 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:49.741 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:49.741 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.976150+0000", 2024-09-13T06:42:49.741 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101729874 2024-09-13T06:42:49.741 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:49.741 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:49.741 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:49.741 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.976261+0000", 2024-09-13T06:42:49.741 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000110819 2024-09-13T06:42:49.741 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:49.742 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:49.742 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:49.742 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.976406+0000", 2024-09-13T06:42:49.742 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000145489 2024-09-13T06:42:49.742 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:49.742 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:49.742 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:49.742 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:49.742 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:49.742 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18803 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 6127616~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:42:49.742 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.877851+0000", 2024-09-13T06:42:49.743 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 177.792193389, 2024-09-13T06:42:49.743 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101951584, 2024-09-13T06:42:49.743 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:49.743 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:49.743 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:49.743 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:49.743 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:49.743 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18803 2024-09-13T06:42:49.743 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:49.743 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:49.743 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:49.743 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:49.744 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.877851+0000", 2024-09-13T06:42:49.744 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:49.744 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:49.744 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:49.744 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:49.744 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.877851+0000", 2024-09-13T06:42:49.744 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:49.744 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:49.744 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:49.744 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:49.744 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.877851+0000", 2024-09-13T06:42:49.744 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:49.745 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:49.745 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:49.745 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:49.745 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.877854+0000", 2024-09-13T06:42:49.745 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.7929999999999999e-06 2024-09-13T06:42:49.745 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:49.745 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:49.745 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:49.745 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.877864+0000", 2024-09-13T06:42:49.745 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.2029999999999998e-06 2024-09-13T06:42:49.745 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:49.745 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:49.746 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:49.746 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.877873+0000", 2024-09-13T06:42:49.746 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.0440000000000001e-06 2024-09-13T06:42:49.746 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:49.746 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:49.746 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:49.746 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.979544+0000", 2024-09-13T06:42:49.746 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101671198 2024-09-13T06:42:49.746 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:49.746 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:49.746 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:49.746 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.979658+0000", 2024-09-13T06:42:49.746 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000114456 2024-09-13T06:42:49.747 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:49.747 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:49.747 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:49.747 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.979803+0000", 2024-09-13T06:42:49.747 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000144506 2024-09-13T06:42:49.747 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:49.747 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:49.747 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:49.747 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:49.747 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:49.747 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18807 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 6242304~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:42:49.747 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.879235+0000", 2024-09-13T06:42:49.747 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 177.79080935900001, 2024-09-13T06:42:49.748 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101781258, 2024-09-13T06:42:49.748 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:49.748 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:49.748 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:49.748 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:49.748 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:49.748 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18807 2024-09-13T06:42:49.748 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:49.748 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:49.748 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:49.748 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:49.748 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879235+0000", 2024-09-13T06:42:49.749 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:49.749 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:49.749 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:49.749 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:49.749 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879235+0000", 2024-09-13T06:42:49.749 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:49.749 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:49.749 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:49.749 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:49.749 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879235+0000", 2024-09-13T06:42:49.749 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:49.749 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:49.749 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:49.750 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:49.750 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879239+0000", 2024-09-13T06:42:49.750 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.963e-06 2024-09-13T06:42:49.750 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:49.750 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:49.750 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:49.750 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879247+0000", 2024-09-13T06:42:49.750 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6470000000000004e-06 2024-09-13T06:42:49.750 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:49.750 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:49.750 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:49.750 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879255+0000", 2024-09-13T06:42:49.750 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5429999999999996e-06 2024-09-13T06:42:49.750 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:49.751 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:49.751 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:49.751 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.980756+0000", 2024-09-13T06:42:49.751 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10150165999999999 2024-09-13T06:42:49.751 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:49.751 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:49.751 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:49.751 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.980868+0000", 2024-09-13T06:42:49.751 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000111196 2024-09-13T06:42:49.751 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:49.751 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:49.752 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:49.752 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.981017+0000", 2024-09-13T06:42:49.752 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000148846 2024-09-13T06:42:49.752 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:49.752 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:49.752 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:49.752 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:49.752 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:49.752 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18808 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 6270976~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:42:49.752 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.879261+0000", 2024-09-13T06:42:49.752 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 177.79078322000001, 2024-09-13T06:42:49.753 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.102057547, 2024-09-13T06:42:49.753 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:49.753 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:49.753 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:49.753 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:49.753 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:49.753 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18808 2024-09-13T06:42:49.753 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:49.753 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:49.753 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:49.754 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:49.754 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879261+0000", 2024-09-13T06:42:49.754 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:49.754 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:49.754 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:49.754 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:49.754 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879261+0000", 2024-09-13T06:42:49.754 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:49.754 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:49.754 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:49.754 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:49.754 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879261+0000", 2024-09-13T06:42:49.755 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:49.755 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:49.755 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:49.755 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:49.755 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879264+0000", 2024-09-13T06:42:49.755 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.523e-06 2024-09-13T06:42:49.755 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:49.755 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:49.755 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:49.755 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879273+0000", 2024-09-13T06:42:49.755 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6070000000000008e-06 2024-09-13T06:42:49.755 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:49.755 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:49.756 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:49.756 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879280+0000", 2024-09-13T06:42:49.756 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.4699999999999996e-06 2024-09-13T06:42:49.756 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:49.756 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:49.756 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:49.756 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.981060+0000", 2024-09-13T06:42:49.756 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10177934800000001 2024-09-13T06:42:49.756 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:49.756 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:49.756 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:49.756 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.981174+0000", 2024-09-13T06:42:49.757 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000114456 2024-09-13T06:42:49.757 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:49.757 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:49.757 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:49.757 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.981319+0000", 2024-09-13T06:42:49.757 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00014473900000000001 2024-09-13T06:42:49.757 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:49.757 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:49.757 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:49.757 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:49.757 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:49.758 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18811 3.9 3.140f5209 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:42:49.758 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.880449+0000", 2024-09-13T06:42:49.758 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 177.789595682, 2024-09-13T06:42:49.758 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101739355, 2024-09-13T06:42:49.758 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:49.758 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:42:49.758 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:49.758 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:49.758 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:49.758 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18811 2024-09-13T06:42:49.758 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:49.758 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:49.759 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:49.759 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:49.759 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880449+0000", 2024-09-13T06:42:49.759 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:49.759 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:49.759 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:49.759 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:49.759 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880449+0000", 2024-09-13T06:42:49.759 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:49.759 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:49.759 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:49.759 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:49.760 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880448+0000", 2024-09-13T06:42:49.760 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:42:49.760 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:49.760 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:49.760 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:49.760 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880452+0000", 2024-09-13T06:42:49.760 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0470000000000004e-06 2024-09-13T06:42:49.760 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:49.760 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:49.760 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:49.760 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880462+0000", 2024-09-13T06:42:49.760 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6530000000000006e-06 2024-09-13T06:42:49.761 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:49.761 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:49.761 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:49.761 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880472+0000", 2024-09-13T06:42:49.761 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0027000000000001e-05 2024-09-13T06:42:49.761 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:49.761 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:49.761 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:49.761 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.982172+0000", 2024-09-13T06:42:49.761 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10170043500000001 2024-09-13T06:42:49.761 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:49.761 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:49.762 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:49.762 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.982188+0000", 2024-09-13T06:42:49.762 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6172999999999999e-05 2024-09-13T06:42:49.762 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:49.762 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:49.762 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:49.762 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:49.762 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:49.762 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18812 3.9 3.140f5209 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:42:49.762 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.880478+0000", 2024-09-13T06:42:49.762 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 177.78956644499999, 2024-09-13T06:42:49.762 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10177795100000001, 2024-09-13T06:42:49.763 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:49.763 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:42:49.763 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:49.763 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:49.763 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:49.763 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18812 2024-09-13T06:42:49.763 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:49.763 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:49.763 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:49.763 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:49.763 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880478+0000", 2024-09-13T06:42:49.763 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:49.764 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:49.764 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:49.764 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:49.764 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880478+0000", 2024-09-13T06:42:49.764 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:49.764 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:49.764 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:49.764 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:49.764 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880477+0000", 2024-09-13T06:42:49.764 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:42:49.764 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:49.764 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:49.765 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:49.765 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880481+0000", 2024-09-13T06:42:49.765 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.827e-06 2024-09-13T06:42:49.765 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:49.765 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:49.765 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:49.765 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880490+0000", 2024-09-13T06:42:49.765 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6100000000000006e-06 2024-09-13T06:42:49.765 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:49.765 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:49.765 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:49.765 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880497+0000", 2024-09-13T06:42:49.765 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.7030000000000006e-06 2024-09-13T06:42:49.766 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:49.766 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:49.766 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:49.766 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.982241+0000", 2024-09-13T06:42:49.766 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10174351199999999 2024-09-13T06:42:49.766 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:49.766 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:49.766 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:49.766 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.982256+0000", 2024-09-13T06:42:49.766 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5143000000000001e-05 2024-09-13T06:42:49.766 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:49.766 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:49.766 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:49.767 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:49.767 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:49.767 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:160483 3.a 3:57f62123:::rbd_header.112138ed422:head [watch reconnect cookie 140361344088384 gen 3] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e177)", 2024-09-13T06:42:49.767 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:42:17.439011+0000", 2024-09-13T06:42:49.767 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 32.231033254000003, 2024-09-13T06:42:49.767 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.155518861, 2024-09-13T06:42:49.767 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:49.767 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:49.767 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:49.767 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:49.767 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:49.767 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 160483 2024-09-13T06:42:49.768 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:49.768 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:49.768 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:49.768 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:49.768 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:17.439011+0000", 2024-09-13T06:42:49.768 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:49.768 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:49.768 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:49.768 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:49.768 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:17.439011+0000", 2024-09-13T06:42:49.768 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:49.769 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:49.769 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:49.769 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:49.769 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:17.439009+0000", 2024-09-13T06:42:49.769 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999976 2024-09-13T06:42:49.769 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:49.769 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:49.769 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:49.769 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:17.439024+0000", 2024-09-13T06:42:49.769 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.464e-05 2024-09-13T06:42:49.769 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:49.770 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:49.770 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:49.770 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:17.439058+0000", 2024-09-13T06:42:49.770 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.4712999999999998e-05 2024-09-13T06:42:49.770 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:49.770 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:49.770 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:49.770 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:17.439085+0000", 2024-09-13T06:42:49.770 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.6216000000000001e-05 2024-09-13T06:42:49.770 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:49.770 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:49.770 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:49.771 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:17.439182+0000", 2024-09-13T06:42:49.771 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.7020000000000003e-05 2024-09-13T06:42:49.771 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:49.771 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:49.771 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:42:49.771 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:17.439204+0000", 2024-09-13T06:42:49.771 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.2276000000000002e-05 2024-09-13T06:42:49.771 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:49.771 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:49.771 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:49.771 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:18.588627+0000", 2024-09-13T06:42:49.772 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1494235829999999 2024-09-13T06:42:49.772 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:49.772 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:49.772 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for rw locks", 2024-09-13T06:42:49.772 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:18.589031+0000", 2024-09-13T06:42:49.772 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0004035 2024-09-13T06:42:49.772 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:49.772 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:49.772 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:49.772 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:18.590604+0000", 2024-09-13T06:42:49.772 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.001573234 2024-09-13T06:42:49.772 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:49.772 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:49.773 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:49.773 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:18.590791+0000", 2024-09-13T06:42:49.773 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000186701 2024-09-13T06:42:49.773 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:49.773 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:49.773 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:49.773 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:18.594530+0000", 2024-09-13T06:42:49.773 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0037394250000000002 2024-09-13T06:42:49.773 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:49.773 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:49.773 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:49.773 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:49.774 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:49.774 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:42:49.774 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-13T06:42:49.776 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-13T06:42:49.776 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-13T06:42:49.773+0000 7fa8bb18e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 36790) UID: 0 2024-09-13T06:42:49.875 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:42:49.872+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:42:49.953 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:42:49.953 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [], 2024-09-13T06:42:49.953 INFO:teuthology.orchestra.run.smithi139.stdout: "num_ops": 0 2024-09-13T06:42:49.954 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:42:49.967 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-13T06:42:49.976 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:42:49.976+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:42:50.077 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:42:50.077+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:42:50.090 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:42:50.090 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [], 2024-09-13T06:42:50.090 INFO:teuthology.orchestra.run.smithi139.stdout: "complaint_time": 30, 2024-09-13T06:42:50.090 INFO:teuthology.orchestra.run.smithi139.stdout: "num_blocked_ops": 0 2024-09-13T06:42:50.090 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:42:50.104 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-13T06:42:50.196 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-13T06:42:50.197+0000 7fa8bb18e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 36790) UID: 0 2024-09-13T06:42:50.273 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:42:50.273 INFO:teuthology.orchestra.run.smithi139.stdout: "size": 20, 2024-09-13T06:42:50.273 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 600, 2024-09-13T06:42:50.274 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [ 2024-09-13T06:42:50.274 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:50.274 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43299 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 432128~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:42:50.274 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589881+0000", 2024-09-13T06:42:50.274 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 148.68284684400001, 2024-09-13T06:42:50.274 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.079693849999999997, 2024-09-13T06:42:50.274 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:50.274 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:50.274 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:50.274 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:50.274 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:50.274 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43299 2024-09-13T06:42:50.274 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:50.275 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:50.275 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:50.275 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:50.275 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589881+0000", 2024-09-13T06:42:50.275 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:50.275 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:50.275 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:50.275 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:50.275 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589881+0000", 2024-09-13T06:42:50.275 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:50.275 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:50.275 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:50.275 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:50.275 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589880+0000", 2024-09-13T06:42:50.276 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:42:50.276 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:50.276 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:50.276 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:50.276 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589884+0000", 2024-09-13T06:42:50.276 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.053e-06 2024-09-13T06:42:50.276 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:50.276 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:50.276 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:50.276 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589893+0000", 2024-09-13T06:42:50.276 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.2129999999999997e-06 2024-09-13T06:42:50.276 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:50.276 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:50.277 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:50.277 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589901+0000", 2024-09-13T06:42:50.277 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.6399999999999997e-06 2024-09-13T06:42:50.277 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:50.277 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:50.277 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:50.277 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.669213+0000", 2024-09-13T06:42:50.277 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.079312074999999996 2024-09-13T06:42:50.277 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:50.277 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:50.277 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:50.277 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.669281+0000", 2024-09-13T06:42:50.277 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.8322000000000001e-05 2024-09-13T06:42:50.277 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:50.278 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:50.278 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:50.278 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.669575+0000", 2024-09-13T06:42:50.278 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00029349699999999999 2024-09-13T06:42:50.278 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:50.278 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:50.278 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:50.278 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:50.278 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:50.278 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43300 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 446464~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:42:50.278 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589909+0000", 2024-09-13T06:42:50.278 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 148.68281894899999, 2024-09-13T06:42:50.278 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.080339496999999996, 2024-09-13T06:42:50.279 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:50.279 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:50.279 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:50.279 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:50.279 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:50.279 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43300 2024-09-13T06:42:50.279 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:50.279 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:50.279 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:50.279 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:50.279 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589909+0000", 2024-09-13T06:42:50.279 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:50.279 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:50.279 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:50.280 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:50.280 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589909+0000", 2024-09-13T06:42:50.280 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:50.280 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:50.280 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:50.280 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:50.280 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589908+0000", 2024-09-13T06:42:50.280 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:42:50.280 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:50.280 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:50.280 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:50.280 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589912+0000", 2024-09-13T06:42:50.280 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.9430000000000002e-06 2024-09-13T06:42:50.281 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:50.281 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:50.281 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:50.281 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589920+0000", 2024-09-13T06:42:50.281 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.3860000000000007e-06 2024-09-13T06:42:50.281 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:50.281 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:50.281 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:50.281 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589928+0000", 2024-09-13T06:42:50.281 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.3329999999999999e-06 2024-09-13T06:42:50.281 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:50.281 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:50.281 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:50.281 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.669651+0000", 2024-09-13T06:42:50.282 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.079723204000000006 2024-09-13T06:42:50.282 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:50.282 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:50.282 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:50.282 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.669840+0000", 2024-09-13T06:42:50.282 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000189397 2024-09-13T06:42:50.282 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:50.282 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:50.282 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:50.282 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.670248+0000", 2024-09-13T06:42:50.282 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00040811100000000001 2024-09-13T06:42:50.282 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:50.282 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:50.282 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:50.283 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:50.283 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:50.283 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43301 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 460800~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:42:50.283 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589934+0000", 2024-09-13T06:42:50.283 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 148.68279427499999, 2024-09-13T06:42:50.283 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.080747474999999999, 2024-09-13T06:42:50.283 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:50.283 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:50.283 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:50.283 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:50.283 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:50.283 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43301 2024-09-13T06:42:50.283 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:50.284 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:50.284 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:50.284 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:50.284 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589934+0000", 2024-09-13T06:42:50.284 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:50.284 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:50.284 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:50.284 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:50.284 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589934+0000", 2024-09-13T06:42:50.284 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:50.284 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:50.284 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:50.284 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:50.284 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589933+0000", 2024-09-13T06:42:50.285 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:50.285 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:50.285 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:50.285 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:50.285 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589936+0000", 2024-09-13T06:42:50.285 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.4599999999999999e-06 2024-09-13T06:42:50.285 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:50.285 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:50.285 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:50.285 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589945+0000", 2024-09-13T06:42:50.285 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.2430000000000005e-06 2024-09-13T06:42:50.285 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:50.285 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:50.286 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:50.286 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589952+0000", 2024-09-13T06:42:50.286 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.3289999999999996e-06 2024-09-13T06:42:50.286 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:50.286 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:50.286 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:50.286 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.670280+0000", 2024-09-13T06:42:50.286 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.080328514000000004 2024-09-13T06:42:50.286 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:50.286 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:50.286 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:50.286 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.670376+0000", 2024-09-13T06:42:50.286 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.5752000000000001e-05 2024-09-13T06:42:50.286 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:50.287 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:50.287 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:50.287 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.670681+0000", 2024-09-13T06:42:50.287 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00030479699999999999 2024-09-13T06:42:50.287 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:50.287 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:50.287 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:50.287 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:50.287 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:50.287 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43302 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 475136~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:42:50.287 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589958+0000", 2024-09-13T06:42:50.287 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 148.682770213, 2024-09-13T06:42:50.287 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.081402394000000003, 2024-09-13T06:42:50.288 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:50.288 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:50.288 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:50.288 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:50.288 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:50.288 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43302 2024-09-13T06:42:50.288 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:50.288 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:50.288 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:50.288 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:50.288 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589958+0000", 2024-09-13T06:42:50.288 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:50.288 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:50.289 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:50.289 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:50.289 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589958+0000", 2024-09-13T06:42:50.289 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:50.289 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:50.289 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:50.289 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:50.289 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589957+0000", 2024-09-13T06:42:50.289 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:50.289 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:50.289 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:50.290 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:50.290 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589960+0000", 2024-09-13T06:42:50.290 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.4939999999999999e-06 2024-09-13T06:42:50.290 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:50.290 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:50.290 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:50.290 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589969+0000", 2024-09-13T06:42:50.290 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.3520000000000007e-06 2024-09-13T06:42:50.290 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:50.290 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:50.290 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:50.290 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589976+0000", 2024-09-13T06:42:50.290 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.3030000000000002e-06 2024-09-13T06:42:50.291 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:50.291 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:50.291 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:50.291 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.670765+0000", 2024-09-13T06:42:50.291 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.080789154000000002 2024-09-13T06:42:50.291 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:50.291 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:50.291 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:50.291 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.670960+0000", 2024-09-13T06:42:50.291 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00019464300000000001 2024-09-13T06:42:50.291 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:50.291 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:50.291 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:50.292 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.671360+0000", 2024-09-13T06:42:50.292 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00040005200000000002 2024-09-13T06:42:50.292 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:50.292 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:50.292 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:50.292 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:50.292 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:50.292 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43303 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 489472~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:42:50.292 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589985+0000", 2024-09-13T06:42:50.292 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 148.682743265, 2024-09-13T06:42:50.292 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.082024333000000005, 2024-09-13T06:42:50.292 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:50.292 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:50.293 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:50.293 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:50.293 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:50.293 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43303 2024-09-13T06:42:50.293 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:50.293 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:50.293 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:50.293 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:50.293 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589985+0000", 2024-09-13T06:42:50.293 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:50.293 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:50.293 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:50.293 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:50.294 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589985+0000", 2024-09-13T06:42:50.294 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:50.294 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:50.294 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:50.294 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:50.294 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589984+0000", 2024-09-13T06:42:50.294 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:42:50.294 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:50.294 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:50.294 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:50.294 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589987+0000", 2024-09-13T06:42:50.294 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.726e-06 2024-09-13T06:42:50.294 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:50.295 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:50.295 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:50.295 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589996+0000", 2024-09-13T06:42:50.295 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.5459999999999992e-06 2024-09-13T06:42:50.295 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:50.295 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:50.295 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:50.295 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590003+0000", 2024-09-13T06:42:50.295 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.4229999999999999e-06 2024-09-13T06:42:50.295 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:50.295 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:50.295 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:50.295 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.671426+0000", 2024-09-13T06:42:50.296 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.081422704999999998 2024-09-13T06:42:50.296 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:50.296 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:50.296 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:50.296 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.671615+0000", 2024-09-13T06:42:50.296 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000188875 2024-09-13T06:42:50.296 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:50.296 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:50.296 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:50.296 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.672009+0000", 2024-09-13T06:42:50.296 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000394015 2024-09-13T06:42:50.296 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:50.296 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:50.297 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:50.297 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:50.297 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:50.297 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43304 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 503808~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:42:50.297 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.590039+0000", 2024-09-13T06:42:50.297 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 148.68268871999999, 2024-09-13T06:42:50.297 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.082573880000000002, 2024-09-13T06:42:50.297 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:50.297 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:50.297 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:50.297 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:50.297 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:50.297 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43304 2024-09-13T06:42:50.297 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:50.298 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:50.298 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:50.298 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:50.298 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590039+0000", 2024-09-13T06:42:50.298 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:50.298 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:50.298 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:50.298 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:50.298 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590039+0000", 2024-09-13T06:42:50.298 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:50.298 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:50.298 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:50.298 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:50.298 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590038+0000", 2024-09-13T06:42:50.298 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:42:50.299 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:50.299 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:50.299 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:50.299 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590042+0000", 2024-09-13T06:42:50.299 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.9500000000000003e-06 2024-09-13T06:42:50.299 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:50.299 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:50.299 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:50.299 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590052+0000", 2024-09-13T06:42:50.299 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.3919999999999992e-06 2024-09-13T06:42:50.299 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:50.299 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:50.299 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:50.299 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590059+0000", 2024-09-13T06:42:50.299 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.7970000000000001e-06 2024-09-13T06:42:50.300 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:50.300 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:50.300 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:50.300 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.672078+0000", 2024-09-13T06:42:50.300 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.082018778000000001 2024-09-13T06:42:50.300 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:50.300 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:50.300 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:50.300 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.672266+0000", 2024-09-13T06:42:50.300 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00018807399999999999 2024-09-13T06:42:50.300 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:50.300 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:50.300 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:50.301 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.672613+0000", 2024-09-13T06:42:50.301 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00034677599999999997 2024-09-13T06:42:50.301 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:50.301 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:50.301 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:50.301 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:50.301 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:50.301 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43305 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 518144~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:42:50.301 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.590136+0000", 2024-09-13T06:42:50.301 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 148.682591532, 2024-09-13T06:42:50.301 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.082988206999999994, 2024-09-13T06:42:50.301 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:50.301 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:50.302 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:50.302 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:50.302 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:50.302 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43305 2024-09-13T06:42:50.302 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:50.302 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:50.302 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:50.302 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:50.302 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590136+0000", 2024-09-13T06:42:50.302 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:50.302 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:50.302 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:50.302 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:50.303 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590136+0000", 2024-09-13T06:42:50.303 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:50.303 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:50.303 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:50.303 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:50.303 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590135+0000", 2024-09-13T06:42:50.303 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:42:50.303 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:50.303 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:50.303 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:50.303 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590139+0000", 2024-09-13T06:42:50.303 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.9489999999999998e-06 2024-09-13T06:42:50.303 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:50.304 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:50.304 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:50.304 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590148+0000", 2024-09-13T06:42:50.304 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.9830000000000002e-06 2024-09-13T06:42:50.304 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:50.304 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:50.304 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:50.304 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590156+0000", 2024-09-13T06:42:50.304 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5229999999999998e-06 2024-09-13T06:42:50.304 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:50.304 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:50.304 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:50.304 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.672709+0000", 2024-09-13T06:42:50.305 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.082552886000000006 2024-09-13T06:42:50.305 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:50.305 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:50.305 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:50.305 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.672816+0000", 2024-09-13T06:42:50.305 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000107736 2024-09-13T06:42:50.305 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:50.305 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:50.305 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:50.305 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.673124+0000", 2024-09-13T06:42:50.305 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00030804900000000002 2024-09-13T06:42:50.305 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:50.305 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:50.305 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:50.306 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:50.306 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:50.306 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:66818 3.17 3.50afe697 (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e100)", 2024-09-13T06:42:50.306 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:53.498942+0000", 2024-09-13T06:42:50.306 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 116.773785347, 2024-09-13T06:42:50.306 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.011231284, 2024-09-13T06:42:50.306 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:50.306 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:42:50.306 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:50.306 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:50.306 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:50.306 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 66818 2024-09-13T06:42:50.307 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:50.307 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:50.307 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:50.307 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:50.307 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:53.498942+0000", 2024-09-13T06:42:50.307 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:50.307 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:50.307 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:50.307 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:50.307 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:53.498942+0000", 2024-09-13T06:42:50.307 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:50.307 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:50.307 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:50.308 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:50.308 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:53.498939+0000", 2024-09-13T06:42:50.308 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999967 2024-09-13T06:42:50.308 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:50.308 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:50.308 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:50.308 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:53.498954+0000", 2024-09-13T06:42:50.308 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5028000000000001e-05 2024-09-13T06:42:50.308 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:50.308 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:50.308 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:50.308 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:53.498986+0000", 2024-09-13T06:42:50.308 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.1993999999999999e-05 2024-09-13T06:42:50.309 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:50.309 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:50.309 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:50.309 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:53.499001+0000", 2024-09-13T06:42:50.309 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5166e-05 2024-09-13T06:42:50.309 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:50.309 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:50.309 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:50.309 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:53.505097+0000", 2024-09-13T06:42:50.309 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0060955610000000002 2024-09-13T06:42:50.309 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:50.309 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:50.309 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:42:50.309 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:53.505108+0000", 2024-09-13T06:42:50.310 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.084e-05 2024-09-13T06:42:50.310 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:50.310 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:50.310 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:50.310 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:54.510158+0000", 2024-09-13T06:42:50.310 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0050497549999999 2024-09-13T06:42:50.310 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:50.310 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:50.310 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:50.310 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:54.510174+0000", 2024-09-13T06:42:50.310 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6164e-05 2024-09-13T06:42:50.310 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:50.310 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:50.310 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:50.311 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:50.311 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:50.311 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:69764 3.2 3:47f10058:::rbd_data.11214956a993.0000000000000004:head [write-same] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e117)", 2024-09-13T06:42:50.311 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:41:11.371147+0000", 2024-09-13T06:42:50.311 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 98.901581037, 2024-09-13T06:42:50.311 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.03470167, 2024-09-13T06:42:50.311 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:50.311 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:42:50.311 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:50.311 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:50.311 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:50.311 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 69764 2024-09-13T06:42:50.311 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:50.312 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:50.312 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:50.312 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:50.312 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:11.371147+0000", 2024-09-13T06:42:50.312 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:50.312 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:50.312 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:50.312 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:50.312 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:11.371147+0000", 2024-09-13T06:42:50.312 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:50.312 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:50.312 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:50.312 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:50.312 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:11.371144+0000", 2024-09-13T06:42:50.313 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999967 2024-09-13T06:42:50.313 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:50.313 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:50.313 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:50.313 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:11.371161+0000", 2024-09-13T06:42:50.313 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7669e-05 2024-09-13T06:42:50.313 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:50.313 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:50.313 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:50.313 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:11.371198+0000", 2024-09-13T06:42:50.313 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.7014000000000002e-05 2024-09-13T06:42:50.313 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:50.313 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:50.313 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:50.314 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:11.371216+0000", 2024-09-13T06:42:50.314 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7425e-05 2024-09-13T06:42:50.314 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:50.314 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:50.314 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:50.314 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:11.371365+0000", 2024-09-13T06:42:50.314 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000149245 2024-09-13T06:42:50.314 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:50.314 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:50.314 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op must wait for map", 2024-09-13T06:42:50.314 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:11.371385+0000", 2024-09-13T06:42:50.314 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.0018999999999999e-05 2024-09-13T06:42:50.314 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:50.314 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:50.315 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:50.315 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:11.378406+0000", 2024-09-13T06:42:50.315 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0070207179999999996 2024-09-13T06:42:50.315 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:50.315 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:50.315 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:42:50.315 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:11.378429+0000", 2024-09-13T06:42:50.315 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.3453999999999999e-05 2024-09-13T06:42:50.315 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:50.315 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:50.315 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:50.315 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:12.405667+0000", 2024-09-13T06:42:50.315 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0272381690000001 2024-09-13T06:42:50.316 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:50.316 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:50.316 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:50.316 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:12.405848+0000", 2024-09-13T06:42:50.316 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00018112 2024-09-13T06:42:50.316 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:50.316 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:50.316 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:50.316 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:50.316 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:50.316 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:70346 3.16 3:69d35907:::rbd_object_map.11214956a993:head [read 0~36] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e122)", 2024-09-13T06:42:50.316 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:41:16.390917+0000", 2024-09-13T06:42:50.316 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 93.881810985000001, 2024-09-13T06:42:50.317 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.99327479799999996, 2024-09-13T06:42:50.317 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:50.317 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:50.317 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:50.317 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:50.317 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:50.317 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 70346 2024-09-13T06:42:50.317 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:50.317 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:50.317 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:50.317 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:50.317 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:16.390917+0000", 2024-09-13T06:42:50.317 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:50.318 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:50.318 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:50.318 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:50.318 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:16.390917+0000", 2024-09-13T06:42:50.318 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:50.318 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:50.318 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:50.318 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:50.318 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:16.390916+0000", 2024-09-13T06:42:50.318 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999986 2024-09-13T06:42:50.318 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:50.318 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:50.318 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:50.318 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:16.390922+0000", 2024-09-13T06:42:50.319 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.0480000000000004e-06 2024-09-13T06:42:50.319 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:50.319 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:50.319 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:50.319 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:16.390933+0000", 2024-09-13T06:42:50.319 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1387e-05 2024-09-13T06:42:50.319 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:50.319 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:50.319 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:50.319 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:16.390939+0000", 2024-09-13T06:42:50.319 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.8039999999999998e-06 2024-09-13T06:42:50.319 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:50.319 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:50.320 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:50.320 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:16.390983+0000", 2024-09-13T06:42:50.320 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.4663000000000003e-05 2024-09-13T06:42:50.320 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:50.320 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:50.320 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:42:50.320 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:16.390991+0000", 2024-09-13T06:42:50.320 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.8059999999999995e-06 2024-09-13T06:42:50.320 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:50.320 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:50.320 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:50.320 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:17.383624+0000", 2024-09-13T06:42:50.320 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.99263277299999997 2024-09-13T06:42:50.320 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:50.321 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:50.321 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:50.321 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:17.383891+0000", 2024-09-13T06:42:50.321 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00026717599999999999 2024-09-13T06:42:50.321 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:50.321 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:50.321 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:50.321 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:17.384192+0000", 2024-09-13T06:42:50.321 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00030047400000000001 2024-09-13T06:42:50.321 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:50.321 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:50.321 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:50.321 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:50.321 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:50.322 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:181624 3.1d 3:be5d0ef9:::rbd_data.11218aab7a9c.0000000000000000:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e203)", 2024-09-13T06:42:50.322 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:42:45.701744+0000", 2024-09-13T06:42:50.322 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 4.5709840650000002, 2024-09-13T06:42:50.322 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.69964504800000005, 2024-09-13T06:42:50.322 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:50.322 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:50.322 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:50.322 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:50.322 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:50.322 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 181624 2024-09-13T06:42:50.322 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:50.322 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:50.322 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:50.323 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:50.323 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.701744+0000", 2024-09-13T06:42:50.323 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:50.323 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:50.323 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:50.323 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:50.323 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.701744+0000", 2024-09-13T06:42:50.323 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:50.323 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:50.323 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:50.323 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:50.323 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.701741+0000", 2024-09-13T06:42:50.323 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999976 2024-09-13T06:42:50.324 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:50.324 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:50.324 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:50.324 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.701754+0000", 2024-09-13T06:42:50.324 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2632999999999999e-05 2024-09-13T06:42:50.324 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:50.324 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:50.324 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:50.324 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.701789+0000", 2024-09-13T06:42:50.324 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.4993999999999997e-05 2024-09-13T06:42:50.324 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:50.324 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:50.324 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:50.325 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.701806+0000", 2024-09-13T06:42:50.325 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7016000000000001e-05 2024-09-13T06:42:50.325 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:50.325 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:50.325 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:50.325 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.701905+0000", 2024-09-13T06:42:50.325 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.8895999999999996e-05 2024-09-13T06:42:50.325 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:50.325 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:50.325 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:42:50.325 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.701920+0000", 2024-09-13T06:42:50.325 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5013e-05 2024-09-13T06:42:50.325 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:50.325 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:50.326 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:50.326 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.400672+0000", 2024-09-13T06:42:50.326 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.69875254499999995 2024-09-13T06:42:50.326 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:50.326 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:50.326 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:50.326 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.401034+0000", 2024-09-13T06:42:50.326 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00036181700000000001 2024-09-13T06:42:50.326 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:50.326 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:50.326 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:50.326 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.401389+0000", 2024-09-13T06:42:50.326 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00035464399999999999 2024-09-13T06:42:50.326 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:50.327 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:50.327 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:50.327 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:50.327 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:50.327 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:181638 3.1d 3:be5d0ef9:::rbd_data.11218aab7a9c.0000000000000000:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e203)", 2024-09-13T06:42:50.327 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:42:45.707356+0000", 2024-09-13T06:42:50.327 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 4.5653713260000002, 2024-09-13T06:42:50.327 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.694720479, 2024-09-13T06:42:50.327 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:50.327 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:50.327 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:50.327 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:50.327 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:50.328 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 181638 2024-09-13T06:42:50.328 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:50.328 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:50.328 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:50.328 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:50.328 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707356+0000", 2024-09-13T06:42:50.328 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:50.328 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:50.328 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:50.328 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:50.328 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707356+0000", 2024-09-13T06:42:50.328 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:50.328 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:50.328 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:50.329 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:50.329 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707355+0000", 2024-09-13T06:42:50.329 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999981 2024-09-13T06:42:50.329 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:50.329 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:50.329 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:50.329 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707375+0000", 2024-09-13T06:42:50.329 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.0698000000000001e-05 2024-09-13T06:42:50.329 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:50.329 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:50.329 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:50.329 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707396+0000", 2024-09-13T06:42:50.329 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.1041000000000001e-05 2024-09-13T06:42:50.330 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:50.330 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:50.330 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:50.330 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707408+0000", 2024-09-13T06:42:50.330 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1583000000000001e-05 2024-09-13T06:42:50.330 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:50.330 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:50.330 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:50.330 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707513+0000", 2024-09-13T06:42:50.330 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000104981 2024-09-13T06:42:50.330 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:50.330 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:50.330 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:42:50.330 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707541+0000", 2024-09-13T06:42:50.331 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.8572999999999999e-05 2024-09-13T06:42:50.331 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:50.331 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:50.331 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:50.331 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.401666+0000", 2024-09-13T06:42:50.331 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.694124988 2024-09-13T06:42:50.331 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:50.331 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:50.331 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:50.331 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.401880+0000", 2024-09-13T06:42:50.331 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00021322100000000001 2024-09-13T06:42:50.331 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:50.331 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:50.332 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:50.332 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.402077+0000", 2024-09-13T06:42:50.332 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000197321 2024-09-13T06:42:50.332 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:50.332 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:50.332 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:50.332 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:50.332 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:50.332 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:181652 3.1d 3:be5d0ef9:::rbd_data.11218aab7a9c.0000000000000000:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e203)", 2024-09-13T06:42:50.332 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:42:45.707423+0000", 2024-09-13T06:42:50.332 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 4.5653047950000003, 2024-09-13T06:42:50.332 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.69480806699999997, 2024-09-13T06:42:50.332 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:50.333 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:50.333 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:50.333 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:50.333 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:50.333 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 181652 2024-09-13T06:42:50.333 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:50.333 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:50.333 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:50.333 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:50.333 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707423+0000", 2024-09-13T06:42:50.333 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:50.333 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:50.333 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:50.333 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:50.334 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707423+0000", 2024-09-13T06:42:50.334 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:50.334 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:50.334 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:50.334 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:50.334 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707423+0000", 2024-09-13T06:42:50.334 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:50.334 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:50.334 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:50.334 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:50.334 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707427+0000", 2024-09-13T06:42:50.334 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.2010000000000001e-06 2024-09-13T06:42:50.334 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:50.335 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:50.335 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:50.335 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707442+0000", 2024-09-13T06:42:50.335 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.4993e-05 2024-09-13T06:42:50.335 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:50.335 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:50.335 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:50.335 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707447+0000", 2024-09-13T06:42:50.335 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.2170000000000002e-06 2024-09-13T06:42:50.335 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:50.335 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:50.335 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:50.335 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707656+0000", 2024-09-13T06:42:50.336 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00020908600000000001 2024-09-13T06:42:50.336 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:50.336 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:50.336 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:42:50.336 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707684+0000", 2024-09-13T06:42:50.336 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.7766000000000001e-05 2024-09-13T06:42:50.336 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:50.336 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:50.336 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:50.336 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.402101+0000", 2024-09-13T06:42:50.336 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.69441698100000004 2024-09-13T06:42:50.336 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:50.336 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:50.337 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:50.337 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.402156+0000", 2024-09-13T06:42:50.337 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.4725000000000002e-05 2024-09-13T06:42:50.337 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:50.337 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:50.337 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:50.337 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.402231+0000", 2024-09-13T06:42:50.337 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5587999999999995e-05 2024-09-13T06:42:50.337 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:50.337 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:50.337 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:50.337 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:50.337 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:50.337 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:181666 3.1d 3:be5d0ef9:::rbd_data.11218aab7a9c.0000000000000000:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e203)", 2024-09-13T06:42:50.338 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:42:45.707478+0000", 2024-09-13T06:42:50.338 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 4.5652496090000003, 2024-09-13T06:42:50.338 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.69543359900000001, 2024-09-13T06:42:50.338 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:50.338 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:50.338 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:50.338 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:50.338 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:50.338 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 181666 2024-09-13T06:42:50.338 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:50.338 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:50.338 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:50.338 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:50.339 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707478+0000", 2024-09-13T06:42:50.339 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:50.339 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:50.339 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:50.339 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:50.339 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707478+0000", 2024-09-13T06:42:50.339 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:50.339 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:50.339 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:50.339 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:50.339 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707478+0000", 2024-09-13T06:42:50.339 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:50.339 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:50.339 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:50.340 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:50.340 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707481+0000", 2024-09-13T06:42:50.340 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.3589999999999999e-06 2024-09-13T06:42:50.340 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:50.340 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:50.340 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:50.340 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707492+0000", 2024-09-13T06:42:50.340 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0725e-05 2024-09-13T06:42:50.340 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:50.340 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:50.340 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:50.340 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707500+0000", 2024-09-13T06:42:50.340 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.1089999999999998e-06 2024-09-13T06:42:50.341 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:50.341 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:50.341 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:50.341 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707773+0000", 2024-09-13T06:42:50.341 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000273291 2024-09-13T06:42:50.341 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:50.341 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:50.341 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:42:50.341 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707784+0000", 2024-09-13T06:42:50.341 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0441999999999999e-05 2024-09-13T06:42:50.341 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:50.341 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:50.341 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:50.341 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.402290+0000", 2024-09-13T06:42:50.342 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.69450651500000005 2024-09-13T06:42:50.342 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:50.342 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:50.342 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:50.342 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.402489+0000", 2024-09-13T06:42:50.342 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000198999 2024-09-13T06:42:50.342 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:50.342 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:50.342 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:50.342 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.402912+0000", 2024-09-13T06:42:50.342 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00042257299999999998 2024-09-13T06:42:50.342 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:50.342 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:50.342 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:50.342 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:50.343 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:50.343 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:181680 3.1d 3:be5d0ef9:::rbd_data.11218aab7a9c.0000000000000000:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e203)", 2024-09-13T06:42:50.343 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:42:45.707517+0000", 2024-09-13T06:42:50.343 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 4.5652105729999999, 2024-09-13T06:42:50.343 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.69532440799999995, 2024-09-13T06:42:50.343 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:50.343 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:50.343 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:50.343 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:50.343 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:50.343 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 181680 2024-09-13T06:42:50.343 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:50.344 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:50.344 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:50.344 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:50.344 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707517+0000", 2024-09-13T06:42:50.344 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:50.344 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:50.344 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:50.344 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:50.344 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707517+0000", 2024-09-13T06:42:50.344 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:50.344 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:50.344 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:50.344 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:50.345 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707517+0000", 2024-09-13T06:42:50.345 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:50.345 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:50.345 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:50.345 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:50.345 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707519+0000", 2024-09-13T06:42:50.345 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.2800000000000002e-06 2024-09-13T06:42:50.345 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:50.345 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:50.345 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:50.345 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707527+0000", 2024-09-13T06:42:50.345 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.2660000000000001e-06 2024-09-13T06:42:50.345 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:50.345 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:50.346 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:50.346 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707535+0000", 2024-09-13T06:42:50.346 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.1760000000000004e-06 2024-09-13T06:42:50.346 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:50.346 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:50.346 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:50.346 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707838+0000", 2024-09-13T06:42:50.346 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00030318000000000001 2024-09-13T06:42:50.346 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:50.346 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:50.346 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:42:50.346 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707850+0000", 2024-09-13T06:42:50.346 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1787000000000001e-05 2024-09-13T06:42:50.347 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:50.347 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:50.347 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:50.347 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.402702+0000", 2024-09-13T06:42:50.347 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.69485264599999996 2024-09-13T06:42:50.347 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:50.347 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:50.347 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:50.347 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.402783+0000", 2024-09-13T06:42:50.347 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.1114999999999998e-05 2024-09-13T06:42:50.347 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:50.347 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:50.347 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:50.348 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.402842+0000", 2024-09-13T06:42:50.348 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.8322999999999997e-05 2024-09-13T06:42:50.348 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:50.348 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:50.348 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:50.348 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:50.348 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:50.348 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:181694 3.1d 3:be5d0ef9:::rbd_data.11218aab7a9c.0000000000000000:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e203)", 2024-09-13T06:42:50.348 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:42:45.707544+0000", 2024-09-13T06:42:50.348 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 4.5651838810000003, 2024-09-13T06:42:50.348 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.69580726699999995, 2024-09-13T06:42:50.348 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:50.348 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:50.348 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:50.349 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:50.349 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:50.349 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 181694 2024-09-13T06:42:50.349 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:50.349 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:50.349 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:50.349 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:50.349 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707544+0000", 2024-09-13T06:42:50.349 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:50.349 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:50.349 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:50.349 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:50.349 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707544+0000", 2024-09-13T06:42:50.350 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:50.350 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:50.350 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:50.350 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:50.350 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707543+0000", 2024-09-13T06:42:50.350 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:50.350 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:50.350 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:50.350 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:50.350 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707561+0000", 2024-09-13T06:42:50.350 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7804000000000001e-05 2024-09-13T06:42:50.350 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:50.350 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:50.350 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:50.351 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707575+0000", 2024-09-13T06:42:50.351 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3884e-05 2024-09-13T06:42:50.351 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:50.351 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:50.351 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:50.351 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707583+0000", 2024-09-13T06:42:50.351 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5730000000000002e-06 2024-09-13T06:42:50.351 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:50.351 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:50.351 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:50.351 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707899+0000", 2024-09-13T06:42:50.351 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00031663999999999998 2024-09-13T06:42:50.351 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:50.352 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:50.352 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:42:50.352 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707908+0000", 2024-09-13T06:42:50.352 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.1430000000000004e-06 2024-09-13T06:42:50.352 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:50.352 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:50.352 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:50.352 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.402973+0000", 2024-09-13T06:42:50.352 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.69506426099999996 2024-09-13T06:42:50.352 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:50.352 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:50.352 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:50.352 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.403155+0000", 2024-09-13T06:42:50.353 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00018245199999999999 2024-09-13T06:42:50.353 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:50.353 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:50.353 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:50.353 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.403351+0000", 2024-09-13T06:42:50.353 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000196028 2024-09-13T06:42:50.353 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:50.353 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:50.353 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:50.353 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:50.353 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:50.353 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:181708 3.1d 3:be5d0ef9:::rbd_data.11218aab7a9c.0000000000000000:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e203)", 2024-09-13T06:42:50.353 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:42:45.707622+0000", 2024-09-13T06:42:50.354 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 4.5651058369999999, 2024-09-13T06:42:50.354 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.69603707699999995, 2024-09-13T06:42:50.354 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:50.354 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:50.354 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:50.354 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:50.354 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:50.354 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 181708 2024-09-13T06:42:50.354 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:50.354 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:50.354 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:50.354 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:50.354 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707622+0000", 2024-09-13T06:42:50.354 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:50.355 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:50.355 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:50.355 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:50.355 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707622+0000", 2024-09-13T06:42:50.355 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:50.355 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:50.355 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:50.355 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:50.355 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707621+0000", 2024-09-13T06:42:50.355 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:50.355 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:50.355 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:50.355 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:50.356 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707624+0000", 2024-09-13T06:42:50.356 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.8210000000000002e-06 2024-09-13T06:42:50.356 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:50.356 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:50.356 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:50.356 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707631+0000", 2024-09-13T06:42:50.356 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.8460000000000002e-06 2024-09-13T06:42:50.356 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:50.356 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:50.356 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:50.356 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707635+0000", 2024-09-13T06:42:50.356 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.4610000000000001e-06 2024-09-13T06:42:50.356 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:50.356 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:50.357 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:50.357 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707955+0000", 2024-09-13T06:42:50.357 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00031982000000000001 2024-09-13T06:42:50.357 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:50.357 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:50.357 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:42:50.357 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707966+0000", 2024-09-13T06:42:50.357 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0822000000000001e-05 2024-09-13T06:42:50.357 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:50.357 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:50.357 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:50.357 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.403541+0000", 2024-09-13T06:42:50.357 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.69557444300000004 2024-09-13T06:42:50.358 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:50.358 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:50.358 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:50.358 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.403598+0000", 2024-09-13T06:42:50.358 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.7147e-05 2024-09-13T06:42:50.358 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:50.358 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:50.358 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:50.358 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.403659+0000", 2024-09-13T06:42:50.358 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.1373999999999999e-05 2024-09-13T06:42:50.358 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:50.359 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:50.359 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:50.359 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:50.359 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:50.359 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:181722 3.1d 3:be5d0ef9:::rbd_data.11218aab7a9c.0000000000000000:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e203)", 2024-09-13T06:42:50.359 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:42:45.707640+0000", 2024-09-13T06:42:50.359 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 4.5650873860000001, 2024-09-13T06:42:50.359 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.69620305800000004, 2024-09-13T06:42:50.359 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:50.359 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:50.359 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:50.359 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:50.359 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:50.360 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 181722 2024-09-13T06:42:50.360 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:50.360 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:50.360 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:50.360 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:50.360 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707640+0000", 2024-09-13T06:42:50.360 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:50.360 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:50.360 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:50.360 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:50.360 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707640+0000", 2024-09-13T06:42:50.360 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:50.361 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:50.361 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:50.361 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:50.361 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707640+0000", 2024-09-13T06:42:50.361 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:50.361 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:50.361 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:50.361 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:50.361 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707643+0000", 2024-09-13T06:42:50.361 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.213e-06 2024-09-13T06:42:50.361 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:50.361 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:50.361 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:50.362 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707651+0000", 2024-09-13T06:42:50.362 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.2290000000000003e-06 2024-09-13T06:42:50.362 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:50.362 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:50.362 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:50.362 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707656+0000", 2024-09-13T06:42:50.362 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.9320000000000004e-06 2024-09-13T06:42:50.362 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:50.362 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:50.362 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:50.362 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.708012+0000", 2024-09-13T06:42:50.362 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00035600600000000002 2024-09-13T06:42:50.362 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:50.363 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:50.363 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:42:50.363 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.708024+0000", 2024-09-13T06:42:50.363 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1336e-05 2024-09-13T06:42:50.363 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:50.363 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:50.363 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:50.363 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.403696+0000", 2024-09-13T06:42:50.363 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.69567234499999997 2024-09-13T06:42:50.363 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:50.363 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:50.363 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:50.364 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.403757+0000", 2024-09-13T06:42:50.364 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.0715999999999999e-05 2024-09-13T06:42:50.364 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:50.364 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:50.364 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:50.364 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.403843+0000", 2024-09-13T06:42:50.364 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6679000000000001e-05 2024-09-13T06:42:50.364 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:50.364 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:50.364 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:50.364 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:50.364 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:50.364 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:181736 3.1d 3:be5d0ef9:::rbd_data.11218aab7a9c.0000000000000000:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e203)", 2024-09-13T06:42:50.364 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:42:45.707661+0000", 2024-09-13T06:42:50.365 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 4.5650670189999998, 2024-09-13T06:42:50.365 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.69667210700000004, 2024-09-13T06:42:50.365 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:50.365 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:50.365 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:50.365 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:50.365 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:50.365 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 181736 2024-09-13T06:42:50.365 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:50.365 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:50.365 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:50.365 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:50.365 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707661+0000", 2024-09-13T06:42:50.365 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:50.366 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:50.366 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:50.366 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:50.366 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707661+0000", 2024-09-13T06:42:50.366 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:50.366 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:50.366 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:50.366 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:50.366 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707660+0000", 2024-09-13T06:42:50.366 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:50.366 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:50.366 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:50.367 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:50.367 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707664+0000", 2024-09-13T06:42:50.367 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.393e-06 2024-09-13T06:42:50.367 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:50.367 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:50.367 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:50.367 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707673+0000", 2024-09-13T06:42:50.367 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.5100000000000004e-06 2024-09-13T06:42:50.367 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:50.367 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:50.367 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:50.367 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707680+0000", 2024-09-13T06:42:50.367 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.8680000000000001e-06 2024-09-13T06:42:50.367 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:50.368 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:50.368 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:50.368 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.708068+0000", 2024-09-13T06:42:50.368 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00038784699999999997 2024-09-13T06:42:50.368 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:50.368 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:50.368 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:42:50.368 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.708078+0000", 2024-09-13T06:42:50.368 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.842e-06 2024-09-13T06:42:50.368 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:50.368 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:50.368 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:50.368 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.403924+0000", 2024-09-13T06:42:50.369 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.69584657699999997 2024-09-13T06:42:50.369 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:50.369 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:50.369 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:50.369 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.404135+0000", 2024-09-13T06:42:50.369 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000210662 2024-09-13T06:42:50.369 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:50.369 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:50.369 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:50.369 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.404333+0000", 2024-09-13T06:42:50.369 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00019787900000000001 2024-09-13T06:42:50.369 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:50.369 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:50.369 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:50.370 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:50.370 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:50.370 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:181750 3.1d 3.9f70ba7d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e203)", 2024-09-13T06:42:50.370 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:42:45.707687+0000", 2024-09-13T06:42:50.370 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 4.5650411560000004, 2024-09-13T06:42:50.370 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.69667232199999996, 2024-09-13T06:42:50.370 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:50.370 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:42:50.370 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:50.370 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:50.370 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:50.370 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 181750 2024-09-13T06:42:50.370 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:50.370 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:50.371 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:50.371 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:50.371 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707687+0000", 2024-09-13T06:42:50.371 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:50.371 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:50.371 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:50.371 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:50.371 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707687+0000", 2024-09-13T06:42:50.371 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:50.371 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:50.371 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:50.371 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:50.371 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707686+0000", 2024-09-13T06:42:50.371 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:50.372 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:50.372 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:50.372 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:50.372 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707689+0000", 2024-09-13T06:42:50.372 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.824e-06 2024-09-13T06:42:50.372 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:50.372 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:50.372 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:50.372 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707693+0000", 2024-09-13T06:42:50.372 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.5900000000000001e-06 2024-09-13T06:42:50.372 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:50.372 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:50.372 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:50.372 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707697+0000", 2024-09-13T06:42:50.373 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.6899999999999998e-06 2024-09-13T06:42:50.373 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:50.373 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:50.373 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:50.373 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.708109+0000", 2024-09-13T06:42:50.373 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00041220200000000002 2024-09-13T06:42:50.373 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:50.373 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:50.373 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:42:50.373 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.708118+0000", 2024-09-13T06:42:50.373 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6000000000000007e-06 2024-09-13T06:42:50.373 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:50.373 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:50.373 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:50.374 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.404353+0000", 2024-09-13T06:42:50.374 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.69623486400000001 2024-09-13T06:42:50.374 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:50.374 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:50.374 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:50.374 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.404359+0000", 2024-09-13T06:42:50.374 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.2480000000000001e-06 2024-09-13T06:42:50.374 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:50.374 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:50.374 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:50.374 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:50.374 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:50.374 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:42:50.376 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-13T06:42:50.376 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-13T06:42:50.377+0000 7fa8bb18e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 36790) UID: 0 2024-09-13T06:42:50.477 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:42:50.476+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:42:50.542 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:42:50.542 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [], 2024-09-13T06:42:50.542 INFO:teuthology.orchestra.run.smithi139.stdout: "num_ops": 0 2024-09-13T06:42:50.542 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:42:50.556 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-13T06:42:50.600 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:42:50.601+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:42:50.672 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:42:50.672 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [], 2024-09-13T06:42:50.673 INFO:teuthology.orchestra.run.smithi139.stdout: "complaint_time": 30, 2024-09-13T06:42:50.673 INFO:teuthology.orchestra.run.smithi139.stdout: "num_blocked_ops": 0 2024-09-13T06:42:50.673 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:42:50.678 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:42:50.680+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:42:50.686 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-13T06:42:50.714 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 7, 5, 3, 4] out_osds: [6] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-13T06:42:50.714 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-13T06:42:50.714 INFO:tasks.thrashosds.thrasher:Killing osd 6, live_osds are [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-13T06:42:50.715 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-09-13T06:42:50.715 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T06:42:50.719 INFO:teuthology.orchestra.run.smithi081.stderr:noscrub is set 2024-09-13T06:42:50.794 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:42:50.796+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:42:50.811 INFO:tasks.ceph.osd.6:Stopped 2024-09-13T06:42:50.811 INFO:tasks.thrashosds.thrasher:Testing ceph-objectstore-tool on down osd.6 2024-09-13T06:42:50.812 INFO:tasks.thrashosds.thrasher:remote for osd 6 is ubuntu@smithi139.front.sepia.ceph.com 2024-09-13T06:42:50.812 DEBUG:teuthology.orchestra.run.smithi139:> type ceph-objectstore-tool 2024-09-13T06:42:50.816 INFO:teuthology.orchestra.run.smithi139.stdout:ceph-objectstore-tool is /usr/bin/ceph-objectstore-tool 2024-09-13T06:42:50.816 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-objectstore-tool --err-to-stderr --no-mon-config '--log-file=/var/log/ceph/objectstore_tool.$pid.log' --data-path /var/lib/ceph/osd/ceph-6 --journal-path /var/lib/ceph/osd/ceph-6/journal --op list-pgs 2024-09-13T06:42:50.839 INFO:teuthology.orchestra.run.smithi139.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2024-09-13T06:42:50.842 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-13T06:42:50.842 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-13T06:42:50.884 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:42:50.885+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:42:50.977 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:42:50.977 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [ 2024-09-13T06:42:50.977 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:50.977 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_repop(client.4385.0:204755 3.3 e208/173 3:c52ec91b:::rbd_data.11213650bb32.0000000000000003:head v 208'609, mlcod=207'607)", 2024-09-13T06:42:50.977 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:42:50.972183+0000", 2024-09-13T06:42:50.977 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.0067797500000000002, 2024-09-13T06:42:50.978 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0068073680000000003, 2024-09-13T06:42:50.978 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:50.978 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:50.978 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:50.978 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:50.978 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:50.978 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:50.972183+0000", 2024-09-13T06:42:50.978 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:50.978 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:50.978 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:50.978 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:50.978 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:50.972183+0000", 2024-09-13T06:42:50.978 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:50.978 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:50.979 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:50.979 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:50.979 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:50.972180+0000", 2024-09-13T06:42:50.979 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999967 2024-09-13T06:42:50.979 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:50.979 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:50.979 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:50.979 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:50.978814+0000", 2024-09-13T06:42:50.979 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0066339950000000002 2024-09-13T06:42:50.979 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:50.979 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:50.979 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:50.979 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:50.978831+0000", 2024-09-13T06:42:50.979 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7187999999999999e-05 2024-09-13T06:42:50.980 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:50.980 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:50.980 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:50.980 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:50.978839+0000", 2024-09-13T06:42:50.980 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.2670000000000006e-06 2024-09-13T06:42:50.980 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:50.980 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:50.980 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:50.980 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:50.978894+0000", 2024-09-13T06:42:50.980 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.4657999999999997e-05 2024-09-13T06:42:50.980 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:50.980 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:50.980 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:50.981 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:50.978921+0000", 2024-09-13T06:42:50.981 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6639999999999999e-05 2024-09-13T06:42:50.981 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:50.981 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:50.981 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:50.981 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:50.981 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-13T06:42:50.981 INFO:teuthology.orchestra.run.smithi081.stdout: "num_ops": 1 2024-09-13T06:42:50.981 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:42:50.982 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:42:50.984+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:42:50.998 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-13T06:42:51.090 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:42:51.092+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:42:51.159 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:42:51.159 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-13T06:42:51.159 INFO:teuthology.orchestra.run.smithi081.stdout: "complaint_time": 30, 2024-09-13T06:42:51.160 INFO:teuthology.orchestra.run.smithi081.stdout: "num_blocked_ops": 0 2024-09-13T06:42:51.160 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:42:51.173 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-13T06:42:51.211 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-13T06:42:51.214 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:42:51.216+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:42:51.284 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:42:51.284+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:42:51.343 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:42:51.343 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 20, 2024-09-13T06:42:51.343 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 600, 2024-09-13T06:42:51.343 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [ 2024-09-13T06:42:51.343 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:51.343 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:37801 3.1 3:82e31015:::rbd_object_map.1121d8143c6e.0000000000000019:head [call] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e55)", 2024-09-13T06:42:51.344 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:05.646191+0000", 2024-09-13T06:42:51.344 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 165.697159086, 2024-09-13T06:42:51.344 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.72659507800000001, 2024-09-13T06:42:51.344 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:51.344 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:51.344 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:51.344 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:51.344 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:51.344 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 37801 2024-09-13T06:42:51.344 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:51.344 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:51.344 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:51.344 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:51.345 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:05.646191+0000", 2024-09-13T06:42:51.345 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:51.345 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:51.345 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:51.345 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:51.345 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:05.646191+0000", 2024-09-13T06:42:51.345 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:51.345 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:51.345 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:51.345 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:51.345 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:05.646188+0000", 2024-09-13T06:42:51.345 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999971 2024-09-13T06:42:51.345 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:51.346 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:51.346 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:51.346 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:05.646206+0000", 2024-09-13T06:42:51.346 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8182999999999999e-05 2024-09-13T06:42:51.346 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:51.346 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:51.346 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:51.346 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:05.646237+0000", 2024-09-13T06:42:51.346 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.1071000000000001e-05 2024-09-13T06:42:51.346 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:51.346 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:51.346 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:51.346 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:05.646251+0000", 2024-09-13T06:42:51.347 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3679000000000001e-05 2024-09-13T06:42:51.347 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:51.347 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:51.347 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:51.347 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:05.646321+0000", 2024-09-13T06:42:51.347 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.9831000000000003e-05 2024-09-13T06:42:51.347 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:51.347 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:51.347 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:42:51.347 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:05.646331+0000", 2024-09-13T06:42:51.347 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0242e-05 2024-09-13T06:42:51.347 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:51.347 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:51.347 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:51.348 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.371959+0000", 2024-09-13T06:42:51.348 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.72562817199999996 2024-09-13T06:42:51.348 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:51.348 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:51.348 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:51.348 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.372389+0000", 2024-09-13T06:42:51.348 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00042977400000000001 2024-09-13T06:42:51.348 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:51.348 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:51.348 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:51.348 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.372786+0000", 2024-09-13T06:42:51.348 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00039706099999999999 2024-09-13T06:42:51.348 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:51.349 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:51.349 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:51.349 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:51.349 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:51.349 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43182 3.17 3:ec5ebce4:::rbd_data.1121f5f2e1c0.0000000000000001:1f [read 333824~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:42:51.349 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.652985+0000", 2024-09-13T06:42:51.349 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 149.69036447299999, 2024-09-13T06:42:51.349 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123926616, 2024-09-13T06:42:51.349 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:51.349 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:51.349 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:51.349 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:51.349 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:51.349 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43182 2024-09-13T06:42:51.350 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:51.350 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:51.350 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:51.350 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:51.350 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.652985+0000", 2024-09-13T06:42:51.350 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:51.350 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:51.350 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:51.350 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:51.350 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.652985+0000", 2024-09-13T06:42:51.350 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:51.350 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:51.350 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:51.351 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:51.351 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.652985+0000", 2024-09-13T06:42:51.351 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:51.351 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:51.351 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:51.351 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:51.351 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.652987+0000", 2024-09-13T06:42:51.351 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0899999999999999e-06 2024-09-13T06:42:51.351 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:51.351 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:51.351 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:51.351 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.652994+0000", 2024-09-13T06:42:51.351 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3100000000000003e-06 2024-09-13T06:42:51.352 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:51.352 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:51.352 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:51.352 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.653000+0000", 2024-09-13T06:42:51.352 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2020000000000003e-06 2024-09-13T06:42:51.352 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:51.352 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:51.352 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:51.352 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.776635+0000", 2024-09-13T06:42:51.352 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.12363529400000001 2024-09-13T06:42:51.352 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:51.352 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:51.352 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:51.353 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.776676+0000", 2024-09-13T06:42:51.353 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.0745999999999999e-05 2024-09-13T06:42:51.353 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:51.353 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:51.353 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:51.353 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.776912+0000", 2024-09-13T06:42:51.353 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00023631300000000001 2024-09-13T06:42:51.353 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:51.353 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:51.353 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:51.353 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:51.353 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:51.353 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43194 3.17 3:ec5ebce4:::rbd_data.1121f5f2e1c0.0000000000000001:1f [read 495616~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:42:51.354 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.656645+0000", 2024-09-13T06:42:51.354 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 149.68670427999999, 2024-09-13T06:42:51.354 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.124088483, 2024-09-13T06:42:51.354 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:51.354 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:51.354 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:51.354 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:51.354 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:51.354 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43194 2024-09-13T06:42:51.354 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:51.354 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:51.354 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:51.354 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:51.355 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656645+0000", 2024-09-13T06:42:51.355 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:51.355 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:51.355 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:51.355 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:51.355 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656645+0000", 2024-09-13T06:42:51.355 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:51.355 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:51.355 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:51.355 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:51.355 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656645+0000", 2024-09-13T06:42:51.355 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:51.355 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:51.355 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:51.356 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:51.356 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656647+0000", 2024-09-13T06:42:51.356 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9180000000000001e-06 2024-09-13T06:42:51.356 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:51.356 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:51.356 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:51.356 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656653+0000", 2024-09-13T06:42:51.356 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7860000000000002e-06 2024-09-13T06:42:51.356 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:51.356 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:51.356 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:51.356 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656658+0000", 2024-09-13T06:42:51.356 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6949999999999999e-06 2024-09-13T06:42:51.356 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:51.357 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:51.357 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:51.357 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.780406+0000", 2024-09-13T06:42:51.357 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123748657 2024-09-13T06:42:51.357 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:51.357 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:51.357 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:51.357 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.780446+0000", 2024-09-13T06:42:51.357 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.9360999999999998e-05 2024-09-13T06:42:51.357 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:51.357 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:51.357 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:51.358 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.780734+0000", 2024-09-13T06:42:51.358 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00028838399999999998 2024-09-13T06:42:51.358 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:51.358 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:51.358 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:51.358 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:51.358 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:51.358 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43241 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 120832~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:42:51.358 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.660682+0000", 2024-09-13T06:42:51.358 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 149.682667342, 2024-09-13T06:42:51.358 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123958204, 2024-09-13T06:42:51.358 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:51.358 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:51.358 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:51.358 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:51.359 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:51.359 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43241 2024-09-13T06:42:51.359 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:51.359 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:51.359 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:51.359 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:51.359 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660682+0000", 2024-09-13T06:42:51.359 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:51.359 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:51.359 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:51.359 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:51.359 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660682+0000", 2024-09-13T06:42:51.359 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:51.359 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:51.359 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:51.360 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:51.360 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660682+0000", 2024-09-13T06:42:51.360 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:51.360 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:51.360 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:51.360 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:51.360 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660683+0000", 2024-09-13T06:42:51.360 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.308e-06 2024-09-13T06:42:51.360 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:51.360 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:51.360 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:51.360 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660686+0000", 2024-09-13T06:42:51.361 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.977e-06 2024-09-13T06:42:51.361 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:51.361 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:51.361 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:51.361 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660689+0000", 2024-09-13T06:42:51.361 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5830000000000001e-06 2024-09-13T06:42:51.361 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:51.361 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:51.361 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:51.361 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.784366+0000", 2024-09-13T06:42:51.361 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.12367713599999999 2024-09-13T06:42:51.361 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:51.361 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:51.361 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:51.362 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.784451+0000", 2024-09-13T06:42:51.362 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.4629999999999994e-05 2024-09-13T06:42:51.362 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:51.362 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:51.362 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:51.362 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.784641+0000", 2024-09-13T06:42:51.362 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00018984899999999999 2024-09-13T06:42:51.362 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:51.362 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:51.362 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:51.362 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:51.362 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:51.362 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43242 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 139264~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:42:51.363 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.660691+0000", 2024-09-13T06:42:51.363 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 149.68265836399999, 2024-09-13T06:42:51.363 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.124536443, 2024-09-13T06:42:51.363 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:51.363 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:51.363 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:51.363 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:51.363 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:51.363 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43242 2024-09-13T06:42:51.363 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:51.363 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:51.363 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:51.364 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:51.364 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660691+0000", 2024-09-13T06:42:51.364 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:51.364 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:51.364 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:51.364 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:51.364 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660691+0000", 2024-09-13T06:42:51.364 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:51.364 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:51.364 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:51.364 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:51.364 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660691+0000", 2024-09-13T06:42:51.364 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:42:51.364 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:51.365 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:51.365 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:51.365 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660696+0000", 2024-09-13T06:42:51.365 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0560000000000004e-06 2024-09-13T06:42:51.365 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:51.365 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:51.365 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:51.365 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660699+0000", 2024-09-13T06:42:51.365 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.2009999999999999e-06 2024-09-13T06:42:51.365 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:51.365 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:51.365 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:51.365 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660702+0000", 2024-09-13T06:42:51.366 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.633e-06 2024-09-13T06:42:51.366 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:51.366 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:51.366 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:51.366 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.784912+0000", 2024-09-13T06:42:51.366 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.124209497 2024-09-13T06:42:51.366 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:51.366 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:51.366 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:51.366 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.784995+0000", 2024-09-13T06:42:51.366 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.3891e-05 2024-09-13T06:42:51.366 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:51.366 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:51.366 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:51.367 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.785228+0000", 2024-09-13T06:42:51.367 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00023237400000000001 2024-09-13T06:42:51.367 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:51.367 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:51.367 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:51.367 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:51.367 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:51.367 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43243 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 153600~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:42:51.367 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.660705+0000", 2024-09-13T06:42:51.367 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 149.68264503099999, 2024-09-13T06:42:51.367 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.124825835, 2024-09-13T06:42:51.367 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:51.367 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:51.367 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:51.368 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:51.368 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:51.368 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43243 2024-09-13T06:42:51.368 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:51.368 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:51.368 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:51.368 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:51.368 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660705+0000", 2024-09-13T06:42:51.368 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:51.368 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:51.368 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:51.368 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:51.368 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660705+0000", 2024-09-13T06:42:51.368 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:51.369 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:51.369 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:51.369 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:51.369 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660705+0000", 2024-09-13T06:42:51.369 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:42:51.369 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:51.369 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:51.369 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:51.369 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660706+0000", 2024-09-13T06:42:51.369 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4339999999999999e-06 2024-09-13T06:42:51.369 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:51.369 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:51.369 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:51.370 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660709+0000", 2024-09-13T06:42:51.370 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9000000000000002e-06 2024-09-13T06:42:51.370 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:51.370 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:51.370 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:51.370 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660712+0000", 2024-09-13T06:42:51.370 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.0589999999999998e-06 2024-09-13T06:42:51.370 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:51.370 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:51.370 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:51.370 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.785318+0000", 2024-09-13T06:42:51.370 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.124606299 2024-09-13T06:42:51.370 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:51.371 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:51.371 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:51.371 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.785361+0000", 2024-09-13T06:42:51.371 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.3214999999999999e-05 2024-09-13T06:42:51.371 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:51.371 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:51.371 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:51.371 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.785531+0000", 2024-09-13T06:42:51.371 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00016914400000000001 2024-09-13T06:42:51.371 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:51.371 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:51.371 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:51.371 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:51.371 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:51.372 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43244 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 167936~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:42:51.372 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.660714+0000", 2024-09-13T06:42:51.372 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 149.68263561800001, 2024-09-13T06:42:51.372 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.125073248, 2024-09-13T06:42:51.372 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:51.372 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:51.372 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:51.372 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:51.372 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:51.372 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43244 2024-09-13T06:42:51.372 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:51.372 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:51.372 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:51.372 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:51.373 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660714+0000", 2024-09-13T06:42:51.373 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:51.373 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:51.373 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:51.373 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:51.373 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660714+0000", 2024-09-13T06:42:51.373 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:51.373 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:51.373 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:51.373 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:51.373 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660714+0000", 2024-09-13T06:42:51.373 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:42:51.374 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:51.374 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:51.374 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:51.374 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660715+0000", 2024-09-13T06:42:51.374 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2330000000000001e-06 2024-09-13T06:42:51.374 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:51.374 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:51.374 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:51.374 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660718+0000", 2024-09-13T06:42:51.374 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9569999999999998e-06 2024-09-13T06:42:51.374 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:51.374 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:51.374 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:51.374 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660721+0000", 2024-09-13T06:42:51.375 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.678e-06 2024-09-13T06:42:51.375 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:51.375 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:51.375 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:51.375 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.785557+0000", 2024-09-13T06:42:51.375 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.12483633199999999 2024-09-13T06:42:51.375 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:51.375 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:51.375 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:51.375 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.785618+0000", 2024-09-13T06:42:51.375 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0686000000000001e-05 2024-09-13T06:42:51.375 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:51.375 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:51.376 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:51.376 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.785787+0000", 2024-09-13T06:42:51.376 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00016957699999999999 2024-09-13T06:42:51.376 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:51.376 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:51.376 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:51.376 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:51.376 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:51.376 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43256 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 344064~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:42:51.376 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.664763+0000", 2024-09-13T06:42:51.376 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 149.67858710799999, 2024-09-13T06:42:51.376 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.12418359399999999, 2024-09-13T06:42:51.376 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:51.377 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:51.377 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:51.377 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:51.377 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:51.377 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43256 2024-09-13T06:42:51.377 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:51.377 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:51.377 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:51.377 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:51.377 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664763+0000", 2024-09-13T06:42:51.377 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:51.377 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:51.377 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:51.377 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:51.378 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664763+0000", 2024-09-13T06:42:51.378 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:51.378 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:51.378 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:51.378 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:51.378 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664762+0000", 2024-09-13T06:42:51.378 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:51.378 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:51.378 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:51.378 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:51.378 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664765+0000", 2024-09-13T06:42:51.378 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3290000000000001e-06 2024-09-13T06:42:51.378 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:51.378 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:51.379 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:51.379 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664771+0000", 2024-09-13T06:42:51.379 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.1319999999999999e-06 2024-09-13T06:42:51.379 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:51.379 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:51.379 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:51.379 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664776+0000", 2024-09-13T06:42:51.379 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.8840000000000002e-06 2024-09-13T06:42:51.379 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:51.379 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:51.379 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:51.379 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.788598+0000", 2024-09-13T06:42:51.380 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123821979 2024-09-13T06:42:51.380 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:51.380 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:51.380 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:51.380 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.788680+0000", 2024-09-13T06:42:51.380 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.2367999999999995e-05 2024-09-13T06:42:51.380 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:51.380 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:51.380 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:51.380 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.788946+0000", 2024-09-13T06:42:51.380 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00026629799999999999 2024-09-13T06:42:51.380 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:51.380 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:51.380 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:51.381 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:51.381 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:51.381 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43267 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 505856~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:42:51.381 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.669461+0000", 2024-09-13T06:42:51.381 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 149.673888554, 2024-09-13T06:42:51.381 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123933711, 2024-09-13T06:42:51.381 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:51.381 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:51.381 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:51.381 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:51.381 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:51.381 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43267 2024-09-13T06:42:51.381 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:51.381 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:51.382 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:51.382 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:51.382 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669461+0000", 2024-09-13T06:42:51.382 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:51.382 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:51.382 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:51.382 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:51.382 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669461+0000", 2024-09-13T06:42:51.382 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:51.382 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:51.382 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:51.382 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:51.382 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669461+0000", 2024-09-13T06:42:51.383 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:51.383 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:51.383 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:51.383 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:51.383 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669463+0000", 2024-09-13T06:42:51.383 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5629999999999999e-06 2024-09-13T06:42:51.383 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:51.383 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:51.383 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:51.383 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669473+0000", 2024-09-13T06:42:51.383 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.9520000000000006e-06 2024-09-13T06:42:51.383 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:51.383 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:51.383 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:51.384 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669479+0000", 2024-09-13T06:42:51.384 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8540000000000002e-06 2024-09-13T06:42:51.384 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:51.384 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:51.384 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:51.384 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.793137+0000", 2024-09-13T06:42:51.384 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.12365825699999999 2024-09-13T06:42:51.384 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:51.384 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:51.384 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:51.384 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.793181+0000", 2024-09-13T06:42:51.384 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.3773999999999998e-05 2024-09-13T06:42:51.384 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:51.384 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:51.384 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:51.385 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.793395+0000", 2024-09-13T06:42:51.385 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00021372399999999999 2024-09-13T06:42:51.385 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:51.385 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:51.385 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:51.385 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:51.385 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:51.385 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43268 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 520192~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:42:51.385 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.669484+0000", 2024-09-13T06:42:51.385 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 149.673865769, 2024-09-13T06:42:51.385 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.12441057899999999, 2024-09-13T06:42:51.385 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:51.385 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:51.385 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:51.386 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:51.386 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:51.386 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43268 2024-09-13T06:42:51.386 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:51.386 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:51.386 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:51.386 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:51.386 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669484+0000", 2024-09-13T06:42:51.386 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:51.386 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:51.386 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:51.386 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:51.386 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669484+0000", 2024-09-13T06:42:51.387 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:51.387 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:51.387 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:51.387 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:51.387 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669484+0000", 2024-09-13T06:42:51.387 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:51.387 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:51.387 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:51.387 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:51.387 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669486+0000", 2024-09-13T06:42:51.387 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6120000000000001e-06 2024-09-13T06:42:51.387 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:51.387 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:51.388 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:51.388 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669494+0000", 2024-09-13T06:42:51.388 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4819999999999997e-06 2024-09-13T06:42:51.388 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:51.388 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:51.388 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:51.388 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669497+0000", 2024-09-13T06:42:51.388 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9790000000000002e-06 2024-09-13T06:42:51.388 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:51.388 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:51.388 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:51.388 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.793559+0000", 2024-09-13T06:42:51.388 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.124062436 2024-09-13T06:42:51.389 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:51.389 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:51.389 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:51.389 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.793603+0000", 2024-09-13T06:42:51.389 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.3764999999999999e-05 2024-09-13T06:42:51.389 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:51.389 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:51.389 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:51.389 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.793895+0000", 2024-09-13T06:42:51.389 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00029168299999999999 2024-09-13T06:42:51.389 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:51.389 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:51.390 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:51.390 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:51.390 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:51.390 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:181627 3.1b 3:dbd5e871:::rbd_data.11218aab7a9c.0000000000000003:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e203)", 2024-09-13T06:42:51.390 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:42:45.704561+0000", 2024-09-13T06:42:51.390 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 5.6387889050000002, 2024-09-13T06:42:51.390 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.70481779099999997, 2024-09-13T06:42:51.390 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:51.390 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:51.390 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:51.390 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:51.390 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:51.390 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 181627 2024-09-13T06:42:51.390 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:51.391 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:51.391 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:51.391 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:51.391 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.704561+0000", 2024-09-13T06:42:51.391 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:51.391 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:51.391 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:51.391 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:51.391 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.704561+0000", 2024-09-13T06:42:51.391 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:51.391 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:51.391 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:51.391 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:51.392 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.704558+0000", 2024-09-13T06:42:51.392 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999976 2024-09-13T06:42:51.392 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:51.392 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:51.392 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:51.392 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.704570+0000", 2024-09-13T06:42:51.392 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2123000000000001e-05 2024-09-13T06:42:51.392 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:51.392 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:51.392 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:51.392 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.704596+0000", 2024-09-13T06:42:51.392 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5134e-05 2024-09-13T06:42:51.392 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:51.392 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:51.393 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:51.393 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.704609+0000", 2024-09-13T06:42:51.393 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3745e-05 2024-09-13T06:42:51.393 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:51.393 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:51.393 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:51.393 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.704797+0000", 2024-09-13T06:42:51.393 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00018797799999999999 2024-09-13T06:42:51.393 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:51.393 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:51.393 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:42:51.393 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.704816+0000", 2024-09-13T06:42:51.393 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8218000000000001e-05 2024-09-13T06:42:51.394 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:51.394 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:51.394 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:51.394 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:46.408816+0000", 2024-09-13T06:42:51.394 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.70399995500000001 2024-09-13T06:42:51.394 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:51.394 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:51.394 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:51.394 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:46.409111+0000", 2024-09-13T06:42:51.394 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000295202 2024-09-13T06:42:51.394 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:51.394 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:51.394 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:51.394 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:46.409379+0000", 2024-09-13T06:42:51.395 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00026792599999999998 2024-09-13T06:42:51.395 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:51.395 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:51.395 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:51.395 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:51.395 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:51.395 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:181641 3.1b 3:dbd5e871:::rbd_data.11218aab7a9c.0000000000000003:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e203)", 2024-09-13T06:42:51.395 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:42:45.704674+0000", 2024-09-13T06:42:51.395 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 5.6386758979999998, 2024-09-13T06:42:51.395 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.70579465600000002, 2024-09-13T06:42:51.395 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:51.395 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:51.395 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:51.395 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:51.396 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:51.396 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 181641 2024-09-13T06:42:51.396 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:51.396 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:51.396 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:51.396 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:51.396 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.704674+0000", 2024-09-13T06:42:51.396 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:51.396 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:51.396 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:51.396 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:51.396 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.704674+0000", 2024-09-13T06:42:51.396 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:51.396 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:51.397 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:51.397 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:51.397 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.704673+0000", 2024-09-13T06:42:51.397 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:51.397 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:51.397 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:51.397 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:51.397 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.704677+0000", 2024-09-13T06:42:51.397 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.6389999999999998e-06 2024-09-13T06:42:51.397 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:51.397 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:51.397 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:51.397 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.704691+0000", 2024-09-13T06:42:51.398 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3859999999999999e-05 2024-09-13T06:42:51.398 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:51.398 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:51.398 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:51.398 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.704699+0000", 2024-09-13T06:42:51.398 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.2339999999999994e-06 2024-09-13T06:42:51.398 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:51.398 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:51.398 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:51.398 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.704854+0000", 2024-09-13T06:42:51.398 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00015513899999999999 2024-09-13T06:42:51.398 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:51.398 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:51.398 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:42:51.399 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.704866+0000", 2024-09-13T06:42:51.399 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1855000000000001e-05 2024-09-13T06:42:51.399 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:51.399 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:51.399 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:51.399 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:46.410079+0000", 2024-09-13T06:42:51.399 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.705212477 2024-09-13T06:42:51.399 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:51.399 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:51.399 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:51.399 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:46.410279+0000", 2024-09-13T06:42:51.399 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000200614 2024-09-13T06:42:51.399 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:51.399 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:51.400 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:51.400 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:46.410469+0000", 2024-09-13T06:42:51.400 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00018939400000000001 2024-09-13T06:42:51.400 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:51.400 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:51.400 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:51.400 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:51.400 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:51.400 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:181655 3.1b 3:dbd5e871:::rbd_data.11218aab7a9c.0000000000000003:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e203)", 2024-09-13T06:42:51.400 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:42:45.704730+0000", 2024-09-13T06:42:51.400 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 5.63861949, 2024-09-13T06:42:51.400 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.70617977499999995, 2024-09-13T06:42:51.400 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:51.401 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:51.401 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:51.401 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:51.401 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:51.401 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 181655 2024-09-13T06:42:51.401 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:51.401 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:51.401 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:51.401 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:51.401 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.704730+0000", 2024-09-13T06:42:51.401 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:51.401 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:51.401 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:51.402 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:51.402 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.704730+0000", 2024-09-13T06:42:51.402 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:51.402 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:51.402 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:51.402 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:51.402 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.704730+0000", 2024-09-13T06:42:51.402 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:51.402 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:51.402 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:51.402 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:51.402 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.704733+0000", 2024-09-13T06:42:51.402 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.0000000000000001e-06 2024-09-13T06:42:51.403 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:51.403 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:51.403 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:51.403 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.704741+0000", 2024-09-13T06:42:51.403 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.0770000000000008e-06 2024-09-13T06:42:51.403 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:51.403 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:51.403 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:51.403 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.704747+0000", 2024-09-13T06:42:51.403 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.2110000000000003e-06 2024-09-13T06:42:51.403 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:51.403 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:51.403 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:51.404 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.706676+0000", 2024-09-13T06:42:51.404 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0019289820000000001 2024-09-13T06:42:51.404 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:51.404 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:51.404 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:42:51.404 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.706687+0000", 2024-09-13T06:42:51.404 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1382999999999999e-05 2024-09-13T06:42:51.404 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:51.404 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:51.404 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:51.404 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:46.410540+0000", 2024-09-13T06:42:51.404 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.70385235199999996 2024-09-13T06:42:51.404 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:51.405 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:51.405 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:51.405 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:46.410723+0000", 2024-09-13T06:42:51.405 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000182998 2024-09-13T06:42:51.405 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:51.405 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:51.405 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:51.405 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:46.410910+0000", 2024-09-13T06:42:51.405 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00018720299999999999 2024-09-13T06:42:51.405 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:51.405 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:51.406 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:51.406 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:51.406 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:51.406 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:181669 3.1b 3:dbd5e871:::rbd_data.11218aab7a9c.0000000000000003:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e203)", 2024-09-13T06:42:51.406 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:42:45.705356+0000", 2024-09-13T06:42:51.406 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 5.6379934819999997, 2024-09-13T06:42:51.406 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.70583958999999996, 2024-09-13T06:42:51.406 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:51.406 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:51.406 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:51.406 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:51.406 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:51.406 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 181669 2024-09-13T06:42:51.407 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:51.407 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:51.407 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:51.407 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:51.407 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.705356+0000", 2024-09-13T06:42:51.407 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:51.407 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:51.407 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:51.407 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:51.407 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.705356+0000", 2024-09-13T06:42:51.407 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:51.407 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:51.407 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:51.408 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:51.408 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.705356+0000", 2024-09-13T06:42:51.408 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:51.408 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:51.408 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:51.408 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:51.408 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.705360+0000", 2024-09-13T06:42:51.408 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.0069999999999999e-06 2024-09-13T06:42:51.408 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:51.408 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:51.408 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:51.408 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.705368+0000", 2024-09-13T06:42:51.408 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.3639999999999999e-06 2024-09-13T06:42:51.408 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:51.409 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:51.409 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:51.409 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.705375+0000", 2024-09-13T06:42:51.409 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.8839999999999997e-06 2024-09-13T06:42:51.409 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:51.409 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:51.409 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:51.409 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.706716+0000", 2024-09-13T06:42:51.409 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0013414589999999999 2024-09-13T06:42:51.409 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:51.409 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:51.409 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:42:51.409 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.706726+0000", 2024-09-13T06:42:51.410 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.5079999999999994e-06 2024-09-13T06:42:51.410 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:51.410 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:51.410 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:51.410 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:46.410966+0000", 2024-09-13T06:42:51.410 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.70424025800000001 2024-09-13T06:42:51.410 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:51.410 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:51.410 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:51.410 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:46.411099+0000", 2024-09-13T06:42:51.410 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000132395 2024-09-13T06:42:51.410 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:51.410 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:51.410 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:51.411 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:46.411196+0000", 2024-09-13T06:42:51.411 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.7344999999999997e-05 2024-09-13T06:42:51.411 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:51.411 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:51.411 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:51.411 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:51.411 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:51.411 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:181683 3.1b 3:dbd5e871:::rbd_data.11218aab7a9c.0000000000000003:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e203)", 2024-09-13T06:42:51.411 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:42:45.705404+0000", 2024-09-13T06:42:51.411 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 5.6379459760000001, 2024-09-13T06:42:51.411 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.70639211899999999, 2024-09-13T06:42:51.411 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:51.411 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:51.411 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:51.412 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:51.412 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:51.412 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 181683 2024-09-13T06:42:51.412 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:51.412 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:51.412 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:51.412 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:51.412 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.705404+0000", 2024-09-13T06:42:51.412 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:51.412 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:51.412 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:51.412 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:51.412 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.705404+0000", 2024-09-13T06:42:51.413 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:51.413 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:51.413 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:51.413 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:51.413 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.705403+0000", 2024-09-13T06:42:51.413 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:51.413 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:51.413 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:51.413 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:51.413 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.705406+0000", 2024-09-13T06:42:51.413 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.1499999999999999e-06 2024-09-13T06:42:51.413 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:51.413 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:51.414 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:51.414 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.705414+0000", 2024-09-13T06:42:51.414 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4259999999999997e-06 2024-09-13T06:42:51.414 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:51.414 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:51.414 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:51.414 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.705420+0000", 2024-09-13T06:42:51.414 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.4339999999999997e-06 2024-09-13T06:42:51.414 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:51.414 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:51.414 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:51.414 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.706753+0000", 2024-09-13T06:42:51.414 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0013326939999999999 2024-09-13T06:42:51.415 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:51.415 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:51.415 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:42:51.415 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.706762+0000", 2024-09-13T06:42:51.415 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.2439999999999999e-06 2024-09-13T06:42:51.415 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:51.415 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:51.415 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:51.415 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:46.411391+0000", 2024-09-13T06:42:51.415 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.70462912099999997 2024-09-13T06:42:51.415 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:51.415 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:51.416 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:51.416 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:46.411584+0000", 2024-09-13T06:42:51.416 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00019283399999999999 2024-09-13T06:42:51.416 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:51.416 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:51.416 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:51.416 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:46.411796+0000", 2024-09-13T06:42:51.416 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00021175299999999999 2024-09-13T06:42:51.416 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:51.416 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:51.416 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:51.416 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:51.416 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:51.417 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:181697 3.1b 3:dbd5e871:::rbd_data.11218aab7a9c.0000000000000003:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e203)", 2024-09-13T06:42:51.417 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:42:45.705447+0000", 2024-09-13T06:42:51.417 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 5.6379023259999999, 2024-09-13T06:42:51.417 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.70668603500000005, 2024-09-13T06:42:51.417 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:51.417 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:51.417 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:51.417 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:51.417 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:51.417 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 181697 2024-09-13T06:42:51.417 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:51.417 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:51.417 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:51.417 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:51.418 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.705447+0000", 2024-09-13T06:42:51.418 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:51.418 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:51.418 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:51.418 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:51.418 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.705447+0000", 2024-09-13T06:42:51.418 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:51.418 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:51.418 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:51.418 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:51.418 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.705447+0000", 2024-09-13T06:42:51.418 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:51.418 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:51.419 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:51.419 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:51.419 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.705450+0000", 2024-09-13T06:42:51.419 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.8830000000000002e-06 2024-09-13T06:42:51.419 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:51.419 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:51.419 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:51.419 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.705457+0000", 2024-09-13T06:42:51.419 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.097e-06 2024-09-13T06:42:51.419 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:51.419 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:51.419 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:51.419 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.705463+0000", 2024-09-13T06:42:51.420 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.2439999999999998e-06 2024-09-13T06:42:51.420 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:51.420 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:51.420 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:51.420 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.706790+0000", 2024-09-13T06:42:51.420 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.001326823 2024-09-13T06:42:51.420 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:51.420 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:51.420 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:42:51.420 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.706799+0000", 2024-09-13T06:42:51.420 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.3249999999999997e-06 2024-09-13T06:42:51.420 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:51.420 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:51.421 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:51.421 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:46.411884+0000", 2024-09-13T06:42:51.421 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.70508501599999995 2024-09-13T06:42:51.421 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:51.421 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:51.421 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:51.421 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:46.412010+0000", 2024-09-13T06:42:51.421 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000125635 2024-09-13T06:42:51.421 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:51.421 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:51.421 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:51.421 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:46.412133+0000", 2024-09-13T06:42:51.422 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000123492 2024-09-13T06:42:51.422 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:51.422 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:51.422 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:51.422 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:51.422 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:51.422 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:181711 3.1b 3:dbd5e871:::rbd_data.11218aab7a9c.0000000000000003:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e203)", 2024-09-13T06:42:51.422 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:42:45.705496+0000", 2024-09-13T06:42:51.422 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 5.6378537629999999, 2024-09-13T06:42:51.422 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.70714611199999999, 2024-09-13T06:42:51.422 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:51.422 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:51.423 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:51.423 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:51.423 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:51.423 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 181711 2024-09-13T06:42:51.423 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:51.423 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:51.423 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:51.423 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:51.423 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.705496+0000", 2024-09-13T06:42:51.423 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:51.423 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:51.423 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:51.423 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:51.424 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.705496+0000", 2024-09-13T06:42:51.424 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:51.424 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:51.424 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:51.424 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:51.424 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.705495+0000", 2024-09-13T06:42:51.424 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:51.424 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:51.424 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:51.424 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:51.424 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.705499+0000", 2024-09-13T06:42:51.424 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.1109999999999999e-06 2024-09-13T06:42:51.424 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:51.425 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:51.425 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:51.425 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.705506+0000", 2024-09-13T06:42:51.425 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.8830000000000006e-06 2024-09-13T06:42:51.425 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:51.425 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:51.425 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:51.425 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.705513+0000", 2024-09-13T06:42:51.425 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.2500000000000003e-06 2024-09-13T06:42:51.425 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:51.425 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:51.425 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:51.425 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.706828+0000", 2024-09-13T06:42:51.425 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0013155840000000001 2024-09-13T06:42:51.426 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:51.426 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:51.426 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:42:51.426 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.706837+0000", 2024-09-13T06:42:51.426 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.0489999999999993e-06 2024-09-13T06:42:51.426 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:51.426 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:51.426 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:51.426 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:46.412223+0000", 2024-09-13T06:42:51.426 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.70538530799999999 2024-09-13T06:42:51.426 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:51.426 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:51.427 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:51.427 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:46.412418+0000", 2024-09-13T06:42:51.427 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000195331 2024-09-13T06:42:51.427 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:51.427 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:51.427 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:51.427 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:46.412642+0000", 2024-09-13T06:42:51.427 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00022410099999999999 2024-09-13T06:42:51.427 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:51.427 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:51.427 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:51.427 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:51.427 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:51.427 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:181725 3.1b 3:dbd5e871:::rbd_data.11218aab7a9c.0000000000000003:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e203)", 2024-09-13T06:42:51.428 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:42:45.706863+0000", 2024-09-13T06:42:51.428 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 5.6364867189999996, 2024-09-13T06:42:51.428 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.70631271699999998, 2024-09-13T06:42:51.428 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:51.428 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:51.428 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:51.428 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:51.428 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:51.428 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 181725 2024-09-13T06:42:51.428 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:51.428 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:51.428 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:51.429 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:51.429 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.706863+0000", 2024-09-13T06:42:51.429 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:51.429 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:51.429 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:51.429 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:51.429 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.706863+0000", 2024-09-13T06:42:51.429 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:51.429 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:51.429 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:51.429 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:51.429 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.706862+0000", 2024-09-13T06:42:51.429 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.999999 2024-09-13T06:42:51.429 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:51.430 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:51.430 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:51.430 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.706869+0000", 2024-09-13T06:42:51.430 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.0899999999999999e-06 2024-09-13T06:42:51.430 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:51.430 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:51.430 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:51.430 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.706881+0000", 2024-09-13T06:42:51.430 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1727e-05 2024-09-13T06:42:51.430 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:51.430 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:51.430 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:51.430 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.706891+0000", 2024-09-13T06:42:51.431 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.9399999999999997e-06 2024-09-13T06:42:51.431 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:51.431 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:51.431 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:51.431 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.706952+0000", 2024-09-13T06:42:51.431 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.1106999999999996e-05 2024-09-13T06:42:51.431 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:51.431 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:51.431 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:42:51.431 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.706966+0000", 2024-09-13T06:42:51.431 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4173e-05 2024-09-13T06:42:51.431 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:51.431 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:51.432 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:51.432 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:46.412754+0000", 2024-09-13T06:42:51.432 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.70578759999999996 2024-09-13T06:42:51.432 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:51.432 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:51.432 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:51.432 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:46.412967+0000", 2024-09-13T06:42:51.432 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00021290999999999999 2024-09-13T06:42:51.432 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:51.432 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:51.432 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:51.432 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:46.413176+0000", 2024-09-13T06:42:51.432 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00020922099999999999 2024-09-13T06:42:51.433 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:51.433 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:51.433 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:51.433 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:51.433 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:51.433 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:181739 3.1b 3:dbd5e871:::rbd_data.11218aab7a9c.0000000000000003:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e203)", 2024-09-13T06:42:51.433 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:42:45.706937+0000", 2024-09-13T06:42:51.433 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 5.6364125080000003, 2024-09-13T06:42:51.433 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.70679418800000005, 2024-09-13T06:42:51.433 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:51.433 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:51.433 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:51.433 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:51.434 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:51.434 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 181739 2024-09-13T06:42:51.434 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:51.434 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:51.434 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:51.434 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:51.434 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.706937+0000", 2024-09-13T06:42:51.434 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:51.434 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:51.434 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:51.434 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:51.434 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.706937+0000", 2024-09-13T06:42:51.434 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:51.435 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:51.435 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:51.435 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:51.435 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.706937+0000", 2024-09-13T06:42:51.435 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:51.435 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:51.435 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:51.435 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:51.435 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.706940+0000", 2024-09-13T06:42:51.435 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.4290000000000001e-06 2024-09-13T06:42:51.435 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:51.435 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:51.435 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:51.435 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.706949+0000", 2024-09-13T06:42:51.436 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.7730000000000005e-06 2024-09-13T06:42:51.436 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:51.436 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:51.436 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:51.436 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.706956+0000", 2024-09-13T06:42:51.436 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4240000000000004e-06 2024-09-13T06:42:51.436 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:51.436 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:51.436 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:51.436 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.706999+0000", 2024-09-13T06:42:51.436 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.2410999999999998e-05 2024-09-13T06:42:51.436 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:51.436 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:51.437 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:42:51.437 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.707011+0000", 2024-09-13T06:42:51.437 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2140999999999999e-05 2024-09-13T06:42:51.437 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:51.437 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:51.437 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:51.437 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:46.413278+0000", 2024-09-13T06:42:51.437 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.70626747199999995 2024-09-13T06:42:51.437 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:51.437 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:51.437 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:51.437 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:46.413471+0000", 2024-09-13T06:42:51.437 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00019234699999999999 2024-09-13T06:42:51.438 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:51.438 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:51.438 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:51.438 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:46.413731+0000", 2024-09-13T06:42:51.438 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00026069 2024-09-13T06:42:51.438 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:51.438 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:51.438 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:51.438 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:51.438 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:51.438 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:181753 3.1b 3:dbd5e871:::rbd_data.11218aab7a9c.0000000000000003:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e203)", 2024-09-13T06:42:51.438 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:42:45.706987+0000", 2024-09-13T06:42:51.438 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 5.6363624249999997, 2024-09-13T06:42:51.439 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.70721309200000004, 2024-09-13T06:42:51.439 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:51.439 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:51.439 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:51.439 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:51.439 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:51.439 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 181753 2024-09-13T06:42:51.439 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:51.439 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:51.439 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:51.439 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:51.439 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.706987+0000", 2024-09-13T06:42:51.439 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:51.439 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:51.439 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:51.440 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:51.440 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.706987+0000", 2024-09-13T06:42:51.440 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:51.440 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:51.440 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:51.440 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:51.440 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.706987+0000", 2024-09-13T06:42:51.440 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:51.440 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:51.440 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:51.440 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:51.440 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.706990+0000", 2024-09-13T06:42:51.440 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.0759999999999999e-06 2024-09-13T06:42:51.440 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:51.441 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:51.441 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:51.441 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.706997+0000", 2024-09-13T06:42:51.441 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5809999999999999e-06 2024-09-13T06:42:51.441 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:51.441 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:51.441 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:51.441 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.707004+0000", 2024-09-13T06:42:51.441 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.7839999999999998e-06 2024-09-13T06:42:51.441 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:51.441 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:51.441 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:51.441 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.707046+0000", 2024-09-13T06:42:51.442 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.1474999999999998e-05 2024-09-13T06:42:51.442 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:51.442 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:51.442 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:42:51.442 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.707056+0000", 2024-09-13T06:42:51.442 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0825000000000001e-05 2024-09-13T06:42:51.442 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:51.442 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:51.442 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:51.442 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:46.413797+0000", 2024-09-13T06:42:51.442 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.70674101099999997 2024-09-13T06:42:51.442 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:51.442 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:51.442 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:51.443 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:46.413998+0000", 2024-09-13T06:42:51.443 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00020058700000000001 2024-09-13T06:42:51.443 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:51.443 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:51.443 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:51.443 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:46.414200+0000", 2024-09-13T06:42:51.443 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00020238400000000001 2024-09-13T06:42:51.443 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:51.443 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:51.443 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:51.443 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:51.443 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:51.443 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:42:51.445 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-13T06:42:51.445 INFO:teuthology.orchestra.run.smithi081.stdout:osd.0: {} 2024-09-13T06:42:51.446 INFO:teuthology.orchestra.run.smithi081.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-13T06:42:51.446 INFO:teuthology.orchestra.run.smithi081.stdout:osd.1: {} 2024-09-13T06:42:51.446 INFO:teuthology.orchestra.run.smithi081.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-13T06:42:51.447 INFO:teuthology.orchestra.run.smithi081.stdout:osd.2: {} 2024-09-13T06:42:51.447 INFO:teuthology.orchestra.run.smithi081.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-13T06:42:51.447 INFO:teuthology.orchestra.run.smithi081.stdout:osd.3: {} 2024-09-13T06:42:51.448 INFO:teuthology.orchestra.run.smithi081.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-13T06:42:51.448 INFO:teuthology.orchestra.run.smithi081.stdout:osd.4: {} 2024-09-13T06:42:51.448 INFO:teuthology.orchestra.run.smithi081.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-13T06:42:51.448 INFO:teuthology.orchestra.run.smithi081.stdout:osd.5: {} 2024-09-13T06:42:51.449 INFO:teuthology.orchestra.run.smithi081.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-13T06:42:51.449 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:42:51.445+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:42:51.546 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:42:51.544+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:42:51.566 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:42:51.566 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:42:51.580 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-13T06:42:51.646 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:42:51.645+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:42:51.747 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:42:51.748+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:42:51.750 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:42:51.750 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:42:51.768 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-13T06:42:51.854 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:42:51.856+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:42:51.913 INFO:teuthology.orchestra.run.smithi081.stdout:checking clone #38, image image_client.0-clone38 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent39 2024-09-13T06:42:51.944 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:42:51.944 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:42:51.949 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-13T06:42:51.949+0000 7fa8bb18e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 36790) UID: 0 2024-09-13T06:42:51.959 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-13T06:42:51.964 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:42:51.964 INFO:teuthology.orchestra.run.smithi081.stdout:5361 read 0x6f798d3 thru 0x6f7d85f (0x3f8d bytes) 2024-09-13T06:42:51.965 INFO:teuthology.orchestra.run.smithi081.stdout:5362 write 0xb235427 thru 0xb23a55f (0x5139 bytes) 2024-09-13T06:42:51.976 INFO:teuthology.orchestra.run.smithi081.stdout:5363 writesame 0x4943c4f thru 0x494b966 data_size 0x4(0x7d18 bytes) 2024-09-13T06:42:51.984 INFO:teuthology.orchestra.run.smithi081.stdout:5364 writesame 0xd304131 thru 0xd30d4c8 data_size 0x4(0x9398 bytes) 2024-09-13T06:42:51.993 INFO:teuthology.orchestra.run.smithi081.stdout:5365 read 0xd583626 thru 0xd586137 (0x2b12 bytes) 2024-09-13T06:42:52.003 INFO:teuthology.orchestra.run.smithi081.stdout:5366 write 0xe27af32 thru 0xe283950 (0x8a1f bytes) 2024-09-13T06:42:52.009 INFO:teuthology.orchestra.run.smithi081.stdout:5367 writesame 0x2e413ac thru 0x2e419cc data_size 0x1(0x621 bytes) 2024-09-13T06:42:52.014 INFO:teuthology.orchestra.run.smithi081.stdout:5370 write 0x9b5d thru 0x1560e (0xbab2 bytes) 2024-09-13T06:42:52.017 INFO:teuthology.orchestra.run.smithi081.stdout:5371 write 0x757ec7b thru 0x7586b9a (0x7f20 bytes) 2024-09-13T06:42:52.022 INFO:teuthology.orchestra.run.smithi081.stdout:5372 write 0xb7fa4cf thru 0xb7fe505 (0x4037 bytes) 2024-09-13T06:42:52.026 INFO:teuthology.orchestra.run.smithi081.stdout:5375 read 0x3770097 thru 0x377855e (0x84c8 bytes) 2024-09-13T06:42:52.026 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:42:52.032 INFO:teuthology.orchestra.run.smithi081.stdout:5377 write 0xe4b3518 thru 0xe4b7d35 (0x481e bytes) 2024-09-13T06:42:52.036 INFO:teuthology.orchestra.run.smithi081.stdout:5379 write 0x184f5e0 thru 0x1859598 (0x9fb9 bytes) 2024-09-13T06:42:52.049 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:42:52.049+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:42:52.051 INFO:teuthology.orchestra.run.smithi081.stdout:5381 trunc from 0xe4b7d36 to 0x5c5907f 2024-09-13T06:42:52.067 INFO:teuthology.orchestra.run.smithi081.stdout:5382 read 0x24f81ab thru 0x24f8d39 (0xb8f bytes) 2024-09-13T06:42:52.068 INFO:teuthology.orchestra.run.smithi081.stdout:5383 read 0x4a8388 thru 0x4ac2d0 (0x3f49 bytes) 2024-09-13T06:42:52.076 INFO:teuthology.orchestra.run.smithi081.stdout:5384 trunc from 0x5c5907f to 0xb012848 2024-09-13T06:42:52.098 INFO:teuthology.orchestra.run.smithi081.stdout:5385 writesame 0xce17e19 thru 0xce22b3b data_size 0x1(0xad23 bytes) 2024-09-13T06:42:52.099 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:42:52.100 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:42:52.106 INFO:teuthology.orchestra.run.smithi081.stdout:5386 trunc from 0xce22b3c to 0x71ef922 2024-09-13T06:42:52.118 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:42:52.121 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-13T06:42:52.131 INFO:teuthology.orchestra.run.smithi081.stdout:5388 trunc from 0x71ef922 to 0xd88293f 2024-09-13T06:42:52.141 INFO:teuthology.orchestra.run.smithi081.stdout:5389 punch from 0x81b976e to 0x81be408, (0x4c9a bytes) 2024-09-13T06:42:52.141 INFO:teuthology.orchestra.run.smithi081.stdout:5390 writesame 0x3b101b4 thru 0x3b19277 data_size 0x6d(0x90c4 bytes) 2024-09-13T06:42:52.146 INFO:teuthology.orchestra.run.smithi081.stdout:5392 write 0x1206856 thru 0x120fbda (0x9385 bytes) 2024-09-13T06:42:52.149 INFO:teuthology.orchestra.run.smithi081.stdout:5393 trunc from 0xd88293f to 0xd63dffd 2024-09-13T06:42:52.149 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:42:52.148+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:42:52.156 INFO:teuthology.orchestra.run.smithi081.stdout:5394 read 0x690e09b thru 0x691aa2a (0xc990 bytes) 2024-09-13T06:42:52.179 INFO:teuthology.orchestra.run.smithi081.stdout:5395 trunc from 0xd63dffd to 0x9ea481 2024-09-13T06:42:52.205 INFO:teuthology.orchestra.run.smithi081.stdout:5397 trunc from 0x9ea481 to 0x204e8b4 2024-09-13T06:42:52.212 INFO:teuthology.orchestra.run.smithi081.stdout:5398 write 0xdde10b thru 0xddec7f (0xb75 bytes) 2024-09-13T06:42:52.226 INFO:teuthology.orchestra.run.smithi081.stdout:5399 writesame 0x44d14d7 thru 0x44d25a9 data_size 0x1(0x10d3 bytes) 2024-09-13T06:42:52.233 INFO:teuthology.orchestra.run.smithi081.stdout:5400 trunc from 0x44d25aa to 0x8ba5a67 2024-09-13T06:42:52.251 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:42:52.249+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:42:52.252 INFO:teuthology.orchestra.run.smithi081.stdout:5402 write 0x92f6a75 thru 0x93040b4 (0xd640 bytes) 2024-09-13T06:42:52.257 INFO:teuthology.orchestra.run.smithi081.stdout:5403 punch from 0x2c5c553 to 0x2c61bae, (0x565b bytes) 2024-09-13T06:42:52.257 INFO:teuthology.orchestra.run.smithi081.stdout:5404 write 0x81aaaff thru 0x81af34f (0x4851 bytes) 2024-09-13T06:42:52.263 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:42:52.263 INFO:teuthology.orchestra.run.smithi081.stdout:5406 read 0x5fa04e7 thru 0x5fa287b (0x2395 bytes) 2024-09-13T06:42:52.268 INFO:teuthology.orchestra.run.smithi081.stdout:5407 trunc from 0x93040b5 to 0xb7b6fe1 2024-09-13T06:42:52.274 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:42:52.275 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:42:52.277 INFO:teuthology.orchestra.run.smithi081.stdout:5408 writesame 0xb57339d thru 0xb57dbc5 data_size 0x1(0xa829 bytes) 2024-09-13T06:42:52.289 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-13T06:42:52.338 INFO:teuthology.orchestra.run.smithi081.stdout:5409 writesame 0xb5f978b thru 0xb605d1a data_size 0x1d(0xc590 bytes) 2024-09-13T06:42:52.346 INFO:teuthology.orchestra.run.smithi081.stdout:5410 writesame 0x731a155 thru 0x731e886 data_size 0xd(0x4732 bytes) 2024-09-13T06:42:52.351 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:42:52.352+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:42:52.353 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:42:52.353 INFO:teuthology.orchestra.run.smithi081.stdout:5412 writesame 0x3d41c60 thru 0x3d433da data_size 0x1(0x177b bytes) 2024-09-13T06:42:52.365 INFO:teuthology.orchestra.run.smithi081.stdout:5413 read 0x25cad59 thru 0x25d19e9 (0x6c91 bytes) 2024-09-13T06:42:52.365 INFO:teuthology.orchestra.run.smithi081.stdout:5414 write 0x80518b6 thru 0x8057689 (0x5dd4 bytes) 2024-09-13T06:42:52.368 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:42:52.368 INFO:teuthology.orchestra.run.smithi081.stdout:5416 read 0x29167ff thru 0x291713a (0x93c bytes) 2024-09-13T06:42:52.378 INFO:teuthology.orchestra.run.smithi081.stdout:5417 write 0xc3e5539 thru 0xc3e6300 (0xdc8 bytes) 2024-09-13T06:42:52.383 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:42:52.384 INFO:teuthology.orchestra.run.smithi081.stdout:5419 write 0x157962c thru 0x15866f8 (0xd0cd bytes) 2024-09-13T06:42:52.412 INFO:teuthology.orchestra.run.smithi081.stdout:5420 trunc from 0xc3e6301 to 0x24e2ec6 2024-09-13T06:42:52.435 INFO:teuthology.orchestra.run.smithi081.stdout:5422 read 0x11021a7 thru 0x1110b63 (0xe9bd bytes) 2024-09-13T06:42:52.435 INFO:teuthology.orchestra.run.smithi081.stdout:5423 read 0x154e68d thru 0x155e235 (0xfba9 bytes) 2024-09-13T06:42:52.436 INFO:teuthology.orchestra.run.smithi081.stdout:5426 read 0x78e1f6 thru 0x795f2c (0x7d37 bytes) 2024-09-13T06:42:52.453 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:42:52.453+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:42:52.465 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:42:52.465 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:42:52.472 INFO:teuthology.orchestra.run.smithi081.stdout:5427 write 0xcd34be8 thru 0xcd37703 (0x2b1c bytes) 2024-09-13T06:42:52.479 INFO:teuthology.orchestra.run.smithi081.stdout:5428 read 0x83c4ef5 thru 0x83d0989 (0xba95 bytes) 2024-09-13T06:42:52.479 INFO:teuthology.orchestra.run.smithi081.stdout:5429 read 0x99c18bc thru 0x99c44b6 (0x2bfb bytes) 2024-09-13T06:42:52.480 INFO:teuthology.orchestra.run.smithi081.stdout:5433 write 0x21d3576 thru 0x21dc3f6 (0x8e81 bytes) 2024-09-13T06:42:52.481 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-13T06:42:52.494 INFO:teuthology.orchestra.run.smithi081.stdout:5434 trunc from 0xcd37704 to 0x9b5af62 2024-09-13T06:42:52.515 INFO:teuthology.orchestra.run.smithi081.stdout:5435 trunc from 0x9b5af62 to 0x84e597f 2024-09-13T06:42:52.530 INFO:teuthology.orchestra.run.smithi081.stdout:5436 trunc from 0x84e597f to 0xa624eac 2024-09-13T06:42:52.539 INFO:teuthology.orchestra.run.smithi081.stdout:5437 punch from 0x491b87d to 0x4920760, (0x4ee3 bytes) 2024-09-13T06:42:52.539 INFO:teuthology.orchestra.run.smithi081.stdout:5438 read 0x29bbf53 thru 0x29c016b (0x4219 bytes) 2024-09-13T06:42:52.540 INFO:teuthology.orchestra.run.smithi081.stdout:5439 read 0x550da1e thru 0x551850e (0xaaf1 bytes) 2024-09-13T06:42:52.540 INFO:teuthology.orchestra.run.smithi081.stdout:5440 writesame 0x14441ac thru 0x144838e data_size 0x1(0x41e3 bytes) 2024-09-13T06:42:52.553 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:42:52.553+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:42:52.564 INFO:teuthology.orchestra.run.smithi081.stdout:5441 read 0x8d875a6 thru 0x8d87a10 (0x46b bytes) 2024-09-13T06:42:52.565 INFO:teuthology.orchestra.run.smithi081.stdout:5444 writesame 0x2d2287f thru 0x2d30bf9 data_size 0x13(0xe37b bytes) 2024-09-13T06:42:52.593 INFO:teuthology.orchestra.run.smithi081.stdout:5446 writesame 0xc7a756c thru 0xc7b2b1f data_size 0x3a(0xb5b4 bytes) 2024-09-13T06:42:52.594 INFO:teuthology.orchestra.run.smithi081.stdout:5447 writesame 0xbb6a185 thru 0xbb75062 data_size 0x1b(0xaede bytes) 2024-09-13T06:42:52.602 INFO:teuthology.orchestra.run.smithi081.stdout:5449 punch from 0x9978db6 to 0x997f7d3, (0x6a1d bytes) 2024-09-13T06:42:52.602 INFO:teuthology.orchestra.run.smithi081.stdout:5450 punch from 0x3f5e31a to 0x3f61122, (0x2e08 bytes) 2024-09-13T06:42:52.602 INFO:teuthology.orchestra.run.smithi081.stdout:5451 read 0x79b9be0 thru 0x79c1037 (0x7458 bytes) 2024-09-13T06:42:52.603 INFO:teuthology.orchestra.run.smithi081.stdout:5452 read 0xae1b7cd thru 0xae1cf27 (0x175b bytes) 2024-09-13T06:42:52.603 INFO:teuthology.orchestra.run.smithi081.stdout:5455 writesame 0x98c2abb thru 0x98c77af data_size 0x21(0x4cf5 bytes) 2024-09-13T06:42:52.610 INFO:teuthology.orchestra.run.smithi081.stdout:5456 read 0x93b3250 thru 0x93b5c98 (0x2a49 bytes) 2024-09-13T06:42:52.610 INFO:teuthology.orchestra.run.smithi081.stdout:5457 read 0x3db9d44 thru 0x3dc3043 (0x9300 bytes) 2024-09-13T06:42:52.610 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:42:52.610 INFO:teuthology.orchestra.run.smithi081.stdout:5461 writesame 0x549fdd7 thru 0x54a07ef data_size 0xb(0xa19 bytes) 2024-09-13T06:42:52.618 INFO:teuthology.orchestra.run.smithi081.stdout:5463 write 0xb4de2b0 thru 0xb4ec6e8 (0xe439 bytes) 2024-09-13T06:42:52.626 INFO:teuthology.orchestra.run.smithi081.stdout:5467 punch from 0x92930a1 to 0x92996f2, (0x6651 bytes) 2024-09-13T06:42:52.626 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:42:52.626 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:42:52.638 INFO:teuthology.orchestra.run.smithi081.stdout:5468 writesame 0xcc835e3 thru 0xcc898b2 data_size 0x5d(0x62d0 bytes) 2024-09-13T06:42:52.638 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:42:52.638 INFO:teuthology.orchestra.run.smithi081.stdout:5471 writesame 0x92bbdc3 thru 0x92bd87a data_size 0x3c(0x1ab8 bytes) 2024-09-13T06:42:52.642 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-13T06:42:52.652 INFO:teuthology.orchestra.run.smithi081.stdout:5472 trunc from 0xcc898b3 to 0x9665405 2024-09-13T06:42:52.671 INFO:teuthology.orchestra.run.smithi081.stdout:5473 punch from 0x36b9e98 to 0x36c232f, (0x8497 bytes) 2024-09-13T06:42:52.672 INFO:teuthology.orchestra.run.smithi081.stdout:5474 read 0x4272e4a thru 0x4275d8e (0x2f45 bytes) 2024-09-13T06:42:52.672 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:42:52.672+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:42:52.674 INFO:tasks.thrashosds.thrasher:No PGs found for osd.6 2024-09-13T06:42:52.682 INFO:teuthology.orchestra.run.smithi081.stdout:5477 write 0xa49f754 thru 0xa4a408f (0x493c bytes) 2024-09-13T06:42:52.687 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:42:52.687 INFO:teuthology.orchestra.run.smithi081.stdout:5480 writesame 0x99a298b thru 0x99aeb8b data_size 0x81(0xc201 bytes) 2024-09-13T06:42:52.690 INFO:teuthology.orchestra.run.smithi081.stdout:5481 punch from 0x768dd09 to 0x769291e, (0x4c15 bytes) 2024-09-13T06:42:52.704 INFO:teuthology.orchestra.run.smithi081.stdout:5482 write 0xd6e4c82 thru 0xd6f3cf7 (0xf076 bytes) 2024-09-13T06:42:52.709 INFO:teuthology.orchestra.run.smithi081.stdout:5484 write 0x18aabc3 thru 0x18b2303 (0x7741 bytes) 2024-09-13T06:42:52.714 INFO:teuthology.orchestra.run.smithi081.stdout:5485 write 0x4abf92d thru 0x4acd789 (0xde5d bytes) 2024-09-13T06:42:52.719 INFO:teuthology.orchestra.run.smithi081.stdout:5487 clone 41 order 22 su 524288 sc 7 2024-09-13T06:42:52.751 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-13T06:42:52.790 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:42:52.790 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:42:52.790 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:42:52.792+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:42:52.805 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-13T06:42:52.856 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:42:52.853+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:42:52.957 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-13T06:42:52.957+0000 7fa8bb18e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 36790) UID: 0 2024-09-13T06:42:52.966 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:42:52.966 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:42:52.980 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-13T06:42:53.058 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:42:53.057+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:42:53.111 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:42:53.111 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:42:53.126 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-13T06:42:53.159 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:42:53.160+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:42:53.260 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:42:53.261+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:42:53.286 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:42:53.287 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:42:53.301 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-13T06:42:53.361 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:42:53.360+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:42:53.463 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:42:53.464+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:42:53.467 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:42:53.468 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:42:53.482 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-13T06:42:53.564 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:42:53.564+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:42:53.606 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:42:53.606 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:42:53.621 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-13T06:42:53.665 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:42:53.664+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:42:53.743 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:42:53.743 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:42:53.753 INFO:teuthology.orchestra.run.smithi081.stderr:nodeep-scrub is set 2024-09-13T06:42:53.760 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-13T06:42:53.804 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:42:53.805+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:42:53.865 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:42:53.865+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:42:53.889 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:42:53.889 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:42:53.903 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-13T06:42:53.966 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:42:53.968+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:42:54.064 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:42:54.064 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [], 2024-09-13T06:42:54.064 INFO:teuthology.orchestra.run.smithi139.stdout: "num_ops": 0 2024-09-13T06:42:54.065 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:42:54.067 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:42:54.068+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:42:54.078 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-13T06:42:54.168 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:42:54.169+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:42:54.193 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:42:54.194 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [], 2024-09-13T06:42:54.194 INFO:teuthology.orchestra.run.smithi139.stdout: "complaint_time": 30, 2024-09-13T06:42:54.194 INFO:teuthology.orchestra.run.smithi139.stdout: "num_blocked_ops": 0 2024-09-13T06:42:54.194 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:42:54.208 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-13T06:42:54.296 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-13T06:42:54.297+0000 7fa8bb18e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 36790) UID: 0 2024-09-13T06:42:54.371 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:42:54.372+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:42:54.374 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:42:54.374 INFO:teuthology.orchestra.run.smithi139.stdout: "size": 20, 2024-09-13T06:42:54.374 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 600, 2024-09-13T06:42:54.374 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [ 2024-09-13T06:42:54.374 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:54.374 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:175091 3.d 3:b6bd869c:::rbd_data.11213163dd15.000000000000003c:head [set-alloc-hint object_size 1048576 write_size 1048576,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e194)", 2024-09-13T06:42:54.375 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:42:35.318373+0000", 2024-09-13T06:42:54.375 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 19.053485002999999, 2024-09-13T06:42:54.375 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.022941579, 2024-09-13T06:42:54.375 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:54.375 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:42:54.375 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:54.375 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:54.375 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:54.375 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 175091 2024-09-13T06:42:54.375 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:54.375 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:54.375 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:54.375 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:54.375 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:35.318373+0000", 2024-09-13T06:42:54.376 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:54.376 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:54.376 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:54.376 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:54.376 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:35.318373+0000", 2024-09-13T06:42:54.376 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:54.376 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:54.376 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:54.376 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:54.376 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:35.318372+0000", 2024-09-13T06:42:54.376 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999986 2024-09-13T06:42:54.376 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:54.376 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:54.377 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:54.377 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:35.318381+0000", 2024-09-13T06:42:54.377 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.5000000000000005e-06 2024-09-13T06:42:54.377 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:54.377 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:54.377 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:54.377 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:35.318403+0000", 2024-09-13T06:42:54.377 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.196e-05 2024-09-13T06:42:54.377 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:54.377 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:54.377 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:54.377 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:35.318416+0000", 2024-09-13T06:42:54.378 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2962999999999999e-05 2024-09-13T06:42:54.378 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:54.378 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:54.378 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:54.378 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:35.318543+0000", 2024-09-13T06:42:54.378 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000126742 2024-09-13T06:42:54.378 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:54.378 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:54.378 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:54.378 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:35.318775+0000", 2024-09-13T06:42:54.378 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000232628 2024-09-13T06:42:54.378 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:54.378 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:54.379 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 5", 2024-09-13T06:42:54.379 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:35.322627+0000", 2024-09-13T06:42:54.379 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0038514410000000002 2024-09-13T06:42:54.379 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:54.379 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:54.379 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:42:54.379 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:35.341133+0000", 2024-09-13T06:42:54.379 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.018506383000000001 2024-09-13T06:42:54.379 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:54.379 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:54.379 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-13T06:42:54.379 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:35.341156+0000", 2024-09-13T06:42:54.379 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.3187e-05 2024-09-13T06:42:54.380 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:54.380 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:54.380 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-13T06:42:54.380 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:35.341244+0000", 2024-09-13T06:42:54.380 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.7885000000000003e-05 2024-09-13T06:42:54.380 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:54.380 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:54.380 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:54.380 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:35.341315+0000", 2024-09-13T06:42:54.380 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.0523000000000002e-05 2024-09-13T06:42:54.380 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:54.380 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:54.380 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:54.381 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:54.381 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:54.381 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:176024 3.13 3:cd614ecd:::rbd_data.11213163dd15.0000000000000007:70 [sparse-read 753664~98304 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e196)", 2024-09-13T06:42:54.381 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:42:36.674685+0000", 2024-09-13T06:42:54.381 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 17.697173244999998, 2024-09-13T06:42:54.381 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.014544555000000001, 2024-09-13T06:42:54.381 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:54.381 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:54.381 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:54.381 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:54.381 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:54.381 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 176024 2024-09-13T06:42:54.381 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:54.381 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:54.382 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:54.382 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:54.382 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.674685+0000", 2024-09-13T06:42:54.382 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:54.382 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:54.382 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:54.382 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:54.382 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.674685+0000", 2024-09-13T06:42:54.382 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:54.382 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:54.382 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:54.382 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:54.382 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.674684+0000", 2024-09-13T06:42:54.383 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:54.383 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:54.383 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:54.383 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:54.383 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.674688+0000", 2024-09-13T06:42:54.383 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.5659999999999998e-06 2024-09-13T06:42:54.383 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:54.383 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:54.383 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:54.383 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.674696+0000", 2024-09-13T06:42:54.383 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.5650000000000002e-06 2024-09-13T06:42:54.383 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:54.383 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:54.383 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:54.384 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.674704+0000", 2024-09-13T06:42:54.384 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.7870000000000002e-06 2024-09-13T06:42:54.384 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:54.384 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:54.384 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:54.384 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.688552+0000", 2024-09-13T06:42:54.384 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.013847488 2024-09-13T06:42:54.384 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:54.384 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:54.384 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:54.384 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.688675+0000", 2024-09-13T06:42:54.384 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00012327 2024-09-13T06:42:54.384 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:54.384 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:54.385 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:54.385 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.689230+0000", 2024-09-13T06:42:54.385 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00055459200000000002 2024-09-13T06:42:54.385 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:54.385 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:54.385 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:54.385 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:54.385 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:54.385 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:176046 3.13 3:cc7583b3:::rbd_data.11213163dd15.000000000000001d:70 [sparse-read 950272~98304 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e196)", 2024-09-13T06:42:54.385 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:42:36.674880+0000", 2024-09-13T06:42:54.385 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 17.696978276999999, 2024-09-13T06:42:54.385 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.015397575, 2024-09-13T06:42:54.385 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:54.386 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:54.386 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:54.386 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:54.386 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:54.386 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 176046 2024-09-13T06:42:54.386 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:54.386 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:54.386 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:54.386 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:54.386 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.674880+0000", 2024-09-13T06:42:54.386 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:54.386 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:54.387 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:54.387 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:54.387 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.674880+0000", 2024-09-13T06:42:54.387 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:54.387 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:54.387 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:54.387 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:54.387 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.674880+0000", 2024-09-13T06:42:54.387 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:54.387 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:54.387 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:54.387 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:54.387 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.674882+0000", 2024-09-13T06:42:54.387 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.7819999999999998e-06 2024-09-13T06:42:54.388 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:54.388 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:54.388 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:54.388 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.674890+0000", 2024-09-13T06:42:54.388 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.0260000000000007e-06 2024-09-13T06:42:54.388 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:54.388 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:54.388 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:54.389 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.674897+0000", 2024-09-13T06:42:54.389 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.3659999999999997e-06 2024-09-13T06:42:54.389 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:54.389 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:54.389 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:54.389 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.689291+0000", 2024-09-13T06:42:54.389 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.014394432 2024-09-13T06:42:54.389 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:54.389 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:54.389 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:54.389 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.689455+0000", 2024-09-13T06:42:54.389 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00016362700000000001 2024-09-13T06:42:54.390 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:54.390 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:54.390 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:54.390 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.690278+0000", 2024-09-13T06:42:54.390 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000822783 2024-09-13T06:42:54.390 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:54.390 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:54.390 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:54.390 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:54.390 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:54.390 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:176076 3.13 3:cb453d32:::rbd_data.11213163dd15.0000000000000025:70 [sparse-read 0~98304 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e196)", 2024-09-13T06:42:54.390 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:42:36.677831+0000", 2024-09-13T06:42:54.391 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 17.694027229, 2024-09-13T06:42:54.391 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.014266704, 2024-09-13T06:42:54.391 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:54.391 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:54.391 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:54.391 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:54.391 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:54.391 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 176076 2024-09-13T06:42:54.391 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:54.391 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:54.391 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:54.391 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:54.391 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.677831+0000", 2024-09-13T06:42:54.391 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:54.391 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:54.392 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:54.392 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:54.392 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.677831+0000", 2024-09-13T06:42:54.392 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:54.392 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:54.392 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:54.392 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:54.392 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.677831+0000", 2024-09-13T06:42:54.392 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:54.392 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:54.392 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:54.392 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:54.392 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.677833+0000", 2024-09-13T06:42:54.393 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.3920000000000001e-06 2024-09-13T06:42:54.393 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:54.393 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:54.393 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:54.393 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.677839+0000", 2024-09-13T06:42:54.393 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.3690000000000003e-06 2024-09-13T06:42:54.393 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:54.393 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:54.393 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:54.393 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.677849+0000", 2024-09-13T06:42:54.393 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.1970000000000002e-06 2024-09-13T06:42:54.393 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:54.393 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:54.394 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:54.394 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.691584+0000", 2024-09-13T06:42:54.394 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.013735614 2024-09-13T06:42:54.394 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:54.394 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:54.394 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:54.394 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.691661+0000", 2024-09-13T06:42:54.394 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.6620999999999997e-05 2024-09-13T06:42:54.394 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:54.394 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:54.394 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:54.394 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.692098+0000", 2024-09-13T06:42:54.394 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00043686700000000002 2024-09-13T06:42:54.394 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:54.394 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:54.395 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:54.395 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:54.395 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:54.395 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:176089 3.11 3:8b97f15f:::rbd_data.1121a23b99f7.0000000000000000:head [write 0~4194304 [fadvise_sequential+fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e196)", 2024-09-13T06:42:54.395 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:42:36.707298+0000", 2024-09-13T06:42:54.395 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 17.664559847, 2024-09-13T06:42:54.395 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.053333426000000003, 2024-09-13T06:42:54.395 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:54.395 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:42:54.395 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:54.395 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:54.395 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:54.395 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 176089 2024-09-13T06:42:54.396 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:54.396 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:54.396 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:54.396 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:54.396 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.707298+0000", 2024-09-13T06:42:54.396 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:54.396 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:54.396 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:54.396 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:54.396 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.707298+0000", 2024-09-13T06:42:54.396 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:54.396 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:54.397 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:54.397 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:54.397 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.707296+0000", 2024-09-13T06:42:54.397 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999976 2024-09-13T06:42:54.397 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:54.397 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:54.397 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:54.397 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.717511+0000", 2024-09-13T06:42:54.397 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.010215218999999999 2024-09-13T06:42:54.397 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:54.397 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:54.397 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:54.397 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.717555+0000", 2024-09-13T06:42:54.397 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.4159000000000002e-05 2024-09-13T06:42:54.397 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:54.398 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:54.398 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:54.398 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.717569+0000", 2024-09-13T06:42:54.398 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3543999999999999e-05 2024-09-13T06:42:54.398 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:54.398 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:54.398 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:54.398 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.717677+0000", 2024-09-13T06:42:54.398 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00010798699999999999 2024-09-13T06:42:54.398 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:54.398 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:54.398 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:54.398 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.717896+0000", 2024-09-13T06:42:54.398 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000219466 2024-09-13T06:42:54.399 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:54.399 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:54.399 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 4", 2024-09-13T06:42:54.399 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.718090+0000", 2024-09-13T06:42:54.399 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00019322799999999999 2024-09-13T06:42:54.399 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:54.399 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:54.399 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:42:54.399 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.751403+0000", 2024-09-13T06:42:54.399 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.033313493 2024-09-13T06:42:54.399 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:54.399 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:54.399 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-13T06:42:54.400 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.760523+0000", 2024-09-13T06:42:54.400 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0091197150000000005 2024-09-13T06:42:54.400 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:54.400 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:54.400 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-13T06:42:54.400 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.760581+0000", 2024-09-13T06:42:54.400 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.8007999999999998e-05 2024-09-13T06:42:54.400 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:54.400 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:54.400 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:54.400 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.760632+0000", 2024-09-13T06:42:54.400 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.1085999999999998e-05 2024-09-13T06:42:54.400 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:54.401 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:54.401 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:54.401 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:54.401 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:54.401 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:176090 3.e 3:77f86bf9:::rbd_data.1121a23b99f7.0000000000000001:head [write 0~4194304 [fadvise_sequential+fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e196)", 2024-09-13T06:42:54.401 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:42:36.717590+0000", 2024-09-13T06:42:54.401 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 17.654268365, 2024-09-13T06:42:54.401 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.049445965000000001, 2024-09-13T06:42:54.401 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:54.401 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:42:54.401 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:54.401 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:54.401 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:54.402 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 176090 2024-09-13T06:42:54.402 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:54.402 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:54.402 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:54.402 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:54.402 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.717590+0000", 2024-09-13T06:42:54.402 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:54.402 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:54.402 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:54.402 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:54.402 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.717590+0000", 2024-09-13T06:42:54.402 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:54.402 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:54.402 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:54.402 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:54.403 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.717588+0000", 2024-09-13T06:42:54.403 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999981 2024-09-13T06:42:54.403 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:54.403 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:54.403 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:54.403 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.723934+0000", 2024-09-13T06:42:54.403 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0063462589999999999 2024-09-13T06:42:54.403 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:54.403 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:54.403 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:54.403 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.723960+0000", 2024-09-13T06:42:54.403 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.6251e-05 2024-09-13T06:42:54.403 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:54.403 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:54.404 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:54.404 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.723976+0000", 2024-09-13T06:42:54.404 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5277e-05 2024-09-13T06:42:54.404 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:54.404 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:54.404 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:54.404 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.724154+0000", 2024-09-13T06:42:54.404 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00017814400000000001 2024-09-13T06:42:54.404 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:54.404 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:54.404 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:54.404 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.724534+0000", 2024-09-13T06:42:54.405 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00038054799999999998 2024-09-13T06:42:54.405 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:54.405 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:54.405 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-13T06:42:54.405 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.724926+0000", 2024-09-13T06:42:54.405 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00039199100000000001 2024-09-13T06:42:54.405 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:54.405 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:54.405 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:42:54.405 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.744509+0000", 2024-09-13T06:42:54.405 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.019582977000000001 2024-09-13T06:42:54.405 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:54.406 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:54.406 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-13T06:42:54.406 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.766937+0000", 2024-09-13T06:42:54.406 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.022427765999999998 2024-09-13T06:42:54.406 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:54.406 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:54.406 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-13T06:42:54.406 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.766987+0000", 2024-09-13T06:42:54.406 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.9898000000000002e-05 2024-09-13T06:42:54.406 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:54.406 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:54.406 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:54.406 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.767036+0000", 2024-09-13T06:42:54.407 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.8782000000000002e-05 2024-09-13T06:42:54.407 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:54.407 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:54.407 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:54.407 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:54.407 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:54.407 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:176094 3.f 3:f5ca80c1:::rbd_data.1121a23b99f7.0000000000000004:head [write 0~4194304 [fadvise_sequential+fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e196)", 2024-09-13T06:42:54.407 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:42:36.724239+0000", 2024-09-13T06:42:54.407 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 17.647619264999999, 2024-09-13T06:42:54.407 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.043501235999999999, 2024-09-13T06:42:54.407 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:54.407 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:42:54.407 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:54.408 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:54.408 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:54.408 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 176094 2024-09-13T06:42:54.408 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:54.408 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:54.408 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:54.408 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:54.408 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.724239+0000", 2024-09-13T06:42:54.408 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:54.408 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:54.408 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:54.408 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:54.408 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.724239+0000", 2024-09-13T06:42:54.409 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:54.409 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:54.409 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:54.409 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:54.409 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.724237+0000", 2024-09-13T06:42:54.409 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999981 2024-09-13T06:42:54.409 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:54.409 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:54.409 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:54.409 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.733673+0000", 2024-09-13T06:42:54.409 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0094352700000000008 2024-09-13T06:42:54.409 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:54.410 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:54.410 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:54.410 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.733703+0000", 2024-09-13T06:42:54.410 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.0102000000000001e-05 2024-09-13T06:42:54.410 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:54.410 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:54.410 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:54.410 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.733718+0000", 2024-09-13T06:42:54.410 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5199e-05 2024-09-13T06:42:54.410 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:54.410 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:54.410 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:54.410 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.733780+0000", 2024-09-13T06:42:54.411 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.1691000000000003e-05 2024-09-13T06:42:54.411 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:54.411 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:54.411 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:54.411 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.733928+0000", 2024-09-13T06:42:54.411 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000147987 2024-09-13T06:42:54.411 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:54.411 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:54.411 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 4", 2024-09-13T06:42:54.411 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.734036+0000", 2024-09-13T06:42:54.411 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000108925 2024-09-13T06:42:54.411 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:54.412 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:54.412 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:42:54.412 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.763741+0000", 2024-09-13T06:42:54.412 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.029704151000000002 2024-09-13T06:42:54.412 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:54.412 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:54.412 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-13T06:42:54.412 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.767615+0000", 2024-09-13T06:42:54.412 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0038739120000000002 2024-09-13T06:42:54.412 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:54.412 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:54.412 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-13T06:42:54.412 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.767693+0000", 2024-09-13T06:42:54.413 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.8573999999999997e-05 2024-09-13T06:42:54.413 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:54.413 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:54.413 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:54.413 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.767740+0000", 2024-09-13T06:42:54.413 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.7154000000000003e-05 2024-09-13T06:42:54.413 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:54.413 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:54.413 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:54.413 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:54.413 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:54.413 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop(client.4385.0:176223 3.7 e196/191 3:e16e66b2:::rbd_data.1121a23b99f7.0000000000000008:head v 196'460, mlcod=194'458)", 2024-09-13T06:42:54.413 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:42:36.748996+0000", 2024-09-13T06:42:54.414 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 17.622862656999999, 2024-09-13T06:42:54.414 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.029353471999999999, 2024-09-13T06:42:54.414 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:54.414 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:42:54.414 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:54.414 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:54.414 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:54.414 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.748996+0000", 2024-09-13T06:42:54.414 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:54.414 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:54.414 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:54.414 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:54.414 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.748996+0000", 2024-09-13T06:42:54.414 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:54.414 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:54.415 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:54.415 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:54.415 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.748995+0000", 2024-09-13T06:42:54.415 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:54.415 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:54.415 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:54.415 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:54.415 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.757604+0000", 2024-09-13T06:42:54.415 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0086086410000000002 2024-09-13T06:42:54.415 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:54.415 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:54.415 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:54.415 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.757619+0000", 2024-09-13T06:42:54.416 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5582000000000001e-05 2024-09-13T06:42:54.416 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:54.416 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:54.416 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:54.416 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.757629+0000", 2024-09-13T06:42:54.416 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.4720000000000001e-06 2024-09-13T06:42:54.416 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:54.416 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:54.416 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:54.416 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.759293+0000", 2024-09-13T06:42:54.416 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.001664682 2024-09-13T06:42:54.416 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:54.416 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:54.417 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:54.417 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.759325+0000", 2024-09-13T06:42:54.417 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.1353999999999998e-05 2024-09-13T06:42:54.417 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:54.417 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:54.417 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-13T06:42:54.417 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.778305+0000", 2024-09-13T06:42:54.417 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.018980311 2024-09-13T06:42:54.417 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:54.417 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:54.417 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:54.417 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.778349+0000", 2024-09-13T06:42:54.417 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.4016e-05 2024-09-13T06:42:54.417 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:54.418 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:54.418 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:54.418 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:54.418 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:54.418 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:176303 3.13 3:ce8be30a:::rbd_data.1121a23b99f7.000000000000000a:head [write 0~3145728 [fadvise_sequential+fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e196)", 2024-09-13T06:42:54.418 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:42:36.759206+0000", 2024-09-13T06:42:54.418 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 17.612652702999998, 2024-09-13T06:42:54.418 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.020206179000000001, 2024-09-13T06:42:54.418 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:54.418 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:42:54.418 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:54.418 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:54.418 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:54.419 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 176303 2024-09-13T06:42:54.419 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:54.419 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:54.419 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:54.419 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:54.419 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.759206+0000", 2024-09-13T06:42:54.419 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:54.419 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:54.419 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:54.419 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:54.419 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.759206+0000", 2024-09-13T06:42:54.419 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:54.419 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:54.420 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:54.420 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:54.420 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.759203+0000", 2024-09-13T06:42:54.420 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999976 2024-09-13T06:42:54.420 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:54.420 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:54.420 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:54.420 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.762301+0000", 2024-09-13T06:42:54.420 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0030975339999999999 2024-09-13T06:42:54.420 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:54.420 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:54.420 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:54.421 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.762321+0000", 2024-09-13T06:42:54.421 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.9830000000000002e-05 2024-09-13T06:42:54.421 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:54.421 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:54.421 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:54.421 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.762333+0000", 2024-09-13T06:42:54.421 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2133999999999999e-05 2024-09-13T06:42:54.421 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:54.421 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:54.421 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:54.421 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.763222+0000", 2024-09-13T06:42:54.421 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00088949299999999999 2024-09-13T06:42:54.421 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:54.421 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:54.422 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:54.422 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.763578+0000", 2024-09-13T06:42:54.422 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00035557999999999998 2024-09-13T06:42:54.422 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:54.422 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:54.422 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 4", 2024-09-13T06:42:54.422 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.763769+0000", 2024-09-13T06:42:54.422 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00019107400000000001 2024-09-13T06:42:54.422 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:54.423 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:54.423 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-13T06:42:54.423 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.778736+0000", 2024-09-13T06:42:54.423 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.014966742999999999 2024-09-13T06:42:54.423 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:54.423 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:54.423 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:42:54.423 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.779322+0000", 2024-09-13T06:42:54.423 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00058619100000000001 2024-09-13T06:42:54.423 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:54.423 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:54.423 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-13T06:42:54.423 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.779370+0000", 2024-09-13T06:42:54.423 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.833e-05 2024-09-13T06:42:54.424 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:54.424 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:54.424 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:54.424 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.779412+0000", 2024-09-13T06:42:54.424 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.1616999999999998e-05 2024-09-13T06:42:54.424 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:54.424 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:54.424 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:54.424 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:54.424 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:54.424 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:179929 3.f 3:f11c699a:::rbd_data.11213163dd15.0000000000000018:head [sparse-read 0~1048576] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e201)", 2024-09-13T06:42:54.424 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:42:41.697289+0000", 2024-09-13T06:42:54.424 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 12.674569394000001, 2024-09-13T06:42:54.425 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.014725775, 2024-09-13T06:42:54.425 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:54.425 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:54.425 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:54.425 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:54.425 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:54.425 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 179929 2024-09-13T06:42:54.425 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:54.425 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:54.425 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:54.425 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:54.425 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:41.697289+0000", 2024-09-13T06:42:54.425 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:54.426 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:54.426 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:54.426 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:54.426 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:41.697289+0000", 2024-09-13T06:42:54.426 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:54.426 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:54.426 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:54.426 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:54.426 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:41.697288+0000", 2024-09-13T06:42:54.426 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:42:54.426 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:54.426 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:54.426 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:54.427 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:41.697295+0000", 2024-09-13T06:42:54.427 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.9099999999999999e-06 2024-09-13T06:42:54.427 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:54.427 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:54.427 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:54.427 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:41.697314+0000", 2024-09-13T06:42:54.427 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.9446999999999999e-05 2024-09-13T06:42:54.427 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:54.427 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:54.427 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:54.427 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:41.697328+0000", 2024-09-13T06:42:54.427 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.42e-05 2024-09-13T06:42:54.427 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:54.427 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:54.427 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:54.428 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:41.707090+0000", 2024-09-13T06:42:54.428 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0097614869999999992 2024-09-13T06:42:54.428 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:54.428 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:54.428 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:54.428 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:41.707306+0000", 2024-09-13T06:42:54.428 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000216085 2024-09-13T06:42:54.428 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:54.428 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:54.428 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:54.428 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:41.712015+0000", 2024-09-13T06:42:54.428 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0047087830000000002 2024-09-13T06:42:54.428 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:54.429 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:54.429 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:54.429 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:54.429 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:54.429 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:179942 3.13 3:cb453d32:::rbd_data.11213163dd15.0000000000000025:head [sparse-read 0~1015808] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e201)", 2024-09-13T06:42:54.429 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:42:41.697558+0000", 2024-09-13T06:42:54.429 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 12.67429984, 2024-09-13T06:42:54.429 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.016654983000000002, 2024-09-13T06:42:54.429 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:54.429 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:54.429 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:54.429 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:54.430 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:54.430 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 179942 2024-09-13T06:42:54.430 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:54.430 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:54.430 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:54.430 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:54.430 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:41.697558+0000", 2024-09-13T06:42:54.430 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:54.430 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:54.430 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:54.430 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:54.430 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:41.697558+0000", 2024-09-13T06:42:54.431 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:54.431 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:54.431 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:54.431 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:54.431 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:41.697557+0000", 2024-09-13T06:42:54.431 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:42:54.431 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:54.431 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:54.431 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:54.431 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:41.697564+0000", 2024-09-13T06:42:54.431 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.3829999999999997e-06 2024-09-13T06:42:54.431 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:54.431 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:54.432 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:54.432 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:41.697583+0000", 2024-09-13T06:42:54.432 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.8770000000000002e-05 2024-09-13T06:42:54.432 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:54.432 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:54.432 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:54.432 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:41.697596+0000", 2024-09-13T06:42:54.432 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.33e-05 2024-09-13T06:42:54.432 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:54.432 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:54.432 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:54.432 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:41.711266+0000", 2024-09-13T06:42:54.432 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.013669768000000001 2024-09-13T06:42:54.433 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:54.433 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:54.433 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:54.433 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:41.711463+0000", 2024-09-13T06:42:54.433 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000197865 2024-09-13T06:42:54.433 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:54.433 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:54.433 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:54.433 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:41.714213+0000", 2024-09-13T06:42:54.433 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.002749937 2024-09-13T06:42:54.433 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:54.433 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:54.434 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:54.434 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:54.434 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:54.434 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:179971 3.13 3:cd6d4258:::rbd_data.11213163dd15.0000000000000042:head [sparse-read 0~25187] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e201)", 2024-09-13T06:42:54.434 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:42:41.697981+0000", 2024-09-13T06:42:54.434 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 12.67387776, 2024-09-13T06:42:54.434 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.017061026999999999, 2024-09-13T06:42:54.434 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:54.434 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:54.434 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:54.434 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:54.434 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:54.434 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 179971 2024-09-13T06:42:54.435 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:54.435 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:54.435 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:54.435 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:54.435 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:41.697981+0000", 2024-09-13T06:42:54.435 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:54.435 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:54.435 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:54.435 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:54.435 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:41.697981+0000", 2024-09-13T06:42:54.435 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:54.435 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:54.435 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:54.435 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:54.436 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:41.697980+0000", 2024-09-13T06:42:54.436 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:42:54.436 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:54.436 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:54.436 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:54.436 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:41.697985+0000", 2024-09-13T06:42:54.436 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.8629999999999996e-06 2024-09-13T06:42:54.436 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:54.436 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:54.436 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:54.436 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:41.698006+0000", 2024-09-13T06:42:54.436 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.0477000000000001e-05 2024-09-13T06:42:54.437 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:54.437 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:54.437 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:54.437 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:41.698019+0000", 2024-09-13T06:42:54.437 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3213e-05 2024-09-13T06:42:54.437 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:54.437 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:54.437 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:54.437 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:41.714306+0000", 2024-09-13T06:42:54.437 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.016287189000000001 2024-09-13T06:42:54.437 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:54.437 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:54.437 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:54.438 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:41.714511+0000", 2024-09-13T06:42:54.438 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00020438499999999999 2024-09-13T06:42:54.438 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:54.438 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:54.438 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:54.438 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:41.715042+0000", 2024-09-13T06:42:54.438 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00053083999999999998 2024-09-13T06:42:54.438 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:54.438 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:54.438 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:54.438 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:54.439 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:54.439 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:179980 3.f 3:f4615ec5:::rbd_data.11213163dd15.000000000000004b:head [sparse-read 0~32481] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e201)", 2024-09-13T06:42:54.439 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:42:41.698131+0000", 2024-09-13T06:42:54.439 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 12.673726778000001, 2024-09-13T06:42:54.439 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.015258558, 2024-09-13T06:42:54.439 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:54.439 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:54.439 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:54.439 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:54.439 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:54.439 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 179980 2024-09-13T06:42:54.439 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:54.439 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:54.440 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:54.440 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:54.440 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:41.698131+0000", 2024-09-13T06:42:54.440 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:54.440 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:54.440 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:54.440 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:54.440 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:41.698131+0000", 2024-09-13T06:42:54.440 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:54.440 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:54.440 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:54.440 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:54.440 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:41.698130+0000", 2024-09-13T06:42:54.441 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:42:54.441 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:54.441 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:54.441 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:54.441 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:41.698149+0000", 2024-09-13T06:42:54.441 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.8457e-05 2024-09-13T06:42:54.441 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:54.441 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:54.441 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:54.441 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:41.698167+0000", 2024-09-13T06:42:54.441 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7986e-05 2024-09-13T06:42:54.441 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:54.441 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:54.442 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:54.442 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:41.698181+0000", 2024-09-13T06:42:54.442 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3720000000000001e-05 2024-09-13T06:42:54.442 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:54.442 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:54.442 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:54.442 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:41.712123+0000", 2024-09-13T06:42:54.442 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.013942358 2024-09-13T06:42:54.442 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:54.442 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:54.442 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:54.442 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:41.712333+0000", 2024-09-13T06:42:54.442 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000210316 2024-09-13T06:42:54.443 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:54.443 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:54.443 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:54.443 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:41.713390+0000", 2024-09-13T06:42:54.443 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0010567409999999999 2024-09-13T06:42:54.443 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:54.443 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:54.443 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:54.443 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:54.443 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:54.443 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:179989 3.f 3:f04ca480:::rbd_data.11213163dd15.0000000000000054:head [sparse-read 0~1048576] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e201)", 2024-09-13T06:42:54.443 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:42:41.699796+0000", 2024-09-13T06:42:54.443 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 12.672062722, 2024-09-13T06:42:54.444 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.014670272, 2024-09-13T06:42:54.444 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:54.444 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:42:54.444 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:54.444 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:54.444 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:54.444 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 179989 2024-09-13T06:42:54.444 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:54.444 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:54.444 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:54.444 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:54.444 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:41.699796+0000", 2024-09-13T06:42:54.444 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:54.444 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:54.445 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:54.445 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:54.445 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:41.699796+0000", 2024-09-13T06:42:54.445 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:54.445 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:54.445 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:54.445 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:54.445 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:41.699794+0000", 2024-09-13T06:42:54.445 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:42:54.445 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:54.445 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:54.445 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:54.445 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:41.699801+0000", 2024-09-13T06:42:54.446 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.9800000000000001e-06 2024-09-13T06:42:54.446 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:54.446 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:54.446 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:54.446 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:41.699820+0000", 2024-09-13T06:42:54.446 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.8193999999999999e-05 2024-09-13T06:42:54.446 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:54.446 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:54.446 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:54.446 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:41.699834+0000", 2024-09-13T06:42:54.446 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.4516e-05 2024-09-13T06:42:54.446 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:54.446 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:54.446 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:54.447 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:41.713996+0000", 2024-09-13T06:42:54.447 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.014162024 2024-09-13T06:42:54.447 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:54.447 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:54.447 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:54.447 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:41.714466+0000", 2024-09-13T06:42:54.447 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00046974499999999998 2024-09-13T06:42:54.447 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:54.447 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:54.447 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:54.447 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:54.447 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:54.447 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:179992 3.13 3:cda86893:::rbd_data.11213163dd15.0000000000000057:head [sparse-read 0~1048576] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e201)", 2024-09-13T06:42:54.447 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:42:41.699847+0000", 2024-09-13T06:42:54.448 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 12.672011649, 2024-09-13T06:42:54.448 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.015577964999999999, 2024-09-13T06:42:54.448 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:54.448 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:42:54.448 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:54.448 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:54.448 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:54.448 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 179992 2024-09-13T06:42:54.448 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:54.448 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:54.448 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:54.448 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:54.448 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:41.699847+0000", 2024-09-13T06:42:54.448 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:54.449 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:54.449 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:54.449 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:54.449 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:41.699847+0000", 2024-09-13T06:42:54.449 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:54.449 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:54.449 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:54.449 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:54.449 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:41.699846+0000", 2024-09-13T06:42:54.449 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:42:54.449 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:54.449 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:54.450 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:54.450 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:41.699852+0000", 2024-09-13T06:42:54.450 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.1229999999999997e-06 2024-09-13T06:42:54.450 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:54.450 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:54.450 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:54.450 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:41.699870+0000", 2024-09-13T06:42:54.450 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.8369999999999999e-05 2024-09-13T06:42:54.450 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:54.450 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:54.450 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:54.450 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:41.699884+0000", 2024-09-13T06:42:54.450 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3716999999999999e-05 2024-09-13T06:42:54.450 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:54.451 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:54.451 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:54.451 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:41.715128+0000", 2024-09-13T06:42:54.451 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.015244491000000001 2024-09-13T06:42:54.451 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:54.451 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:54.451 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:54.451 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:41.715425+0000", 2024-09-13T06:42:54.451 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00029634099999999999 2024-09-13T06:42:54.451 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:54.451 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:54.451 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:54.451 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:54.451 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:54.452 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:180005 3.13 3:cec7a900:::rbd_data.11213163dd15.0000000000000064:head [sparse-read 0~1048576] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e201)", 2024-09-13T06:42:54.452 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:42:41.699914+0000", 2024-09-13T06:42:54.452 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 12.671944399999999, 2024-09-13T06:42:54.452 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.015794986, 2024-09-13T06:42:54.452 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:54.452 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:42:54.452 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:54.452 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:54.452 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:54.452 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 180005 2024-09-13T06:42:54.452 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:54.452 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:54.452 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:54.453 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:54.453 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:41.699914+0000", 2024-09-13T06:42:54.453 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:54.453 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:54.453 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:54.453 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:54.453 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:41.699914+0000", 2024-09-13T06:42:54.453 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:54.453 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:54.453 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:54.453 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:54.453 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:41.699913+0000", 2024-09-13T06:42:54.453 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:42:54.453 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:54.454 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:54.454 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:54.454 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:41.699919+0000", 2024-09-13T06:42:54.454 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.72e-06 2024-09-13T06:42:54.454 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:54.454 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:54.454 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:54.454 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:41.699938+0000", 2024-09-13T06:42:54.454 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.8955999999999999e-05 2024-09-13T06:42:54.454 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:54.454 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:54.454 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:54.454 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:41.699953+0000", 2024-09-13T06:42:54.455 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.502e-05 2024-09-13T06:42:54.455 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:54.455 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:54.455 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:54.455 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:41.715528+0000", 2024-09-13T06:42:54.455 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.015574955 2024-09-13T06:42:54.455 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:54.455 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:54.455 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:54.455 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:41.715709+0000", 2024-09-13T06:42:54.455 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00018044099999999999 2024-09-13T06:42:54.455 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:54.455 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:54.456 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:54.456 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:54.456 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:54.456 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:204693 3.e 3:70d886d1:::rbd_data.11213650bb32.0000000000000004:head [write 0~524288 [fadvise_sequential+fadvise_nocache],zero 524288~262144,write 786432~1310720 [fadvise_sequential+fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e208)", 2024-09-13T06:42:54.456 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:42:50.944136+0000", 2024-09-13T06:42:54.456 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 3.4277222040000002, 2024-09-13T06:42:54.456 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.023197766000000002, 2024-09-13T06:42:54.456 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:54.456 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:42:54.456 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:54.456 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:54.456 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:54.456 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 204693 2024-09-13T06:42:54.456 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:54.456 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:54.457 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:54.457 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:54.457 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:50.944136+0000", 2024-09-13T06:42:54.457 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:54.457 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:54.457 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:54.457 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:54.457 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:50.944136+0000", 2024-09-13T06:42:54.457 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:54.457 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:54.457 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:54.457 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:54.457 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:50.944134+0000", 2024-09-13T06:42:54.458 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999981 2024-09-13T06:42:54.458 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:54.458 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:54.458 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:54.458 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:50.947044+0000", 2024-09-13T06:42:54.458 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.002909273 2024-09-13T06:42:54.458 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:54.458 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:54.458 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:54.458 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:50.947072+0000", 2024-09-13T06:42:54.458 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.7968999999999999e-05 2024-09-13T06:42:54.458 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:54.458 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:54.458 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:54.459 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:50.947085+0000", 2024-09-13T06:42:54.459 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.328e-05 2024-09-13T06:42:54.459 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:54.459 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:54.459 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:54.459 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:50.947140+0000", 2024-09-13T06:42:54.459 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.5492999999999999e-05 2024-09-13T06:42:54.459 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:54.459 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:54.459 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:54.459 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:50.947253+0000", 2024-09-13T06:42:54.459 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00011259 2024-09-13T06:42:54.459 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:54.460 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:54.460 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-13T06:42:54.460 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:50.947400+0000", 2024-09-13T06:42:54.460 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00014672700000000001 2024-09-13T06:42:54.460 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:54.460 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:54.460 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-13T06:42:54.460 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:50.950413+0000", 2024-09-13T06:42:54.460 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.003013501 2024-09-13T06:42:54.460 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:54.460 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:54.460 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:42:54.460 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:50.967152+0000", 2024-09-13T06:42:54.460 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.016738388999999999 2024-09-13T06:42:54.461 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:54.461 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:54.461 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-13T06:42:54.461 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:50.967265+0000", 2024-09-13T06:42:54.461 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000113717 2024-09-13T06:42:54.461 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:54.461 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:54.461 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:54.461 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:50.967334+0000", 2024-09-13T06:42:54.461 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.8591999999999997e-05 2024-09-13T06:42:54.461 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:54.461 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:54.461 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:54.462 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:54.462 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:54.462 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:205233 3.15 3:a97b2891:::rbd_data.11213650bb32.000000000000002e:head [set-alloc-hint object_size 4194304 write_size 4194304,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e209)", 2024-09-13T06:42:54.462 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:42:52.282586+0000", 2024-09-13T06:42:54.462 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 2.089272421, 2024-09-13T06:42:54.462 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.056996628000000001, 2024-09-13T06:42:54.462 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:54.462 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:42:54.462 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:54.462 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:54.462 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:54.462 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 205233 2024-09-13T06:42:54.462 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:54.462 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:54.463 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:54.463 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:54.463 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:52.282586+0000", 2024-09-13T06:42:54.463 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:54.463 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:54.463 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:54.463 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:54.463 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:52.282586+0000", 2024-09-13T06:42:54.463 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:54.463 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:54.463 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:54.463 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:54.463 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:52.282583+0000", 2024-09-13T06:42:54.463 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999976 2024-09-13T06:42:54.463 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:54.464 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:54.464 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:54.464 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:52.282599+0000", 2024-09-13T06:42:54.464 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5065999999999999e-05 2024-09-13T06:42:54.464 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:54.464 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:54.464 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:54.464 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:52.282632+0000", 2024-09-13T06:42:54.464 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.3386999999999997e-05 2024-09-13T06:42:54.464 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:54.464 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:54.464 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:54.464 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:52.282654+0000", 2024-09-13T06:42:54.464 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.177e-05 2024-09-13T06:42:54.465 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:54.465 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:54.465 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:54.465 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:52.282753+0000", 2024-09-13T06:42:54.465 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.9685000000000005e-05 2024-09-13T06:42:54.465 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:54.465 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:54.465 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:54.465 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:52.283000+0000", 2024-09-13T06:42:54.465 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000246278 2024-09-13T06:42:54.465 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:54.465 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:54.465 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 3", 2024-09-13T06:42:54.465 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:52.292656+0000", 2024-09-13T06:42:54.465 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0096565980000000006 2024-09-13T06:42:54.466 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:54.466 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:54.466 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:42:54.466 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:52.339352+0000", 2024-09-13T06:42:54.466 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.046695309999999997 2024-09-13T06:42:54.466 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:54.466 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:54.466 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-13T06:42:54.466 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:52.339373+0000", 2024-09-13T06:42:54.466 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.1002999999999999e-05 2024-09-13T06:42:54.466 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:54.466 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:54.466 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-13T06:42:54.466 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:52.339464+0000", 2024-09-13T06:42:54.467 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.1131999999999994e-05 2024-09-13T06:42:54.467 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:54.467 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:54.467 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:54.467 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:52.339582+0000", 2024-09-13T06:42:54.467 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000118799 2024-09-13T06:42:54.467 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:54.467 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:54.467 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:54.467 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:54.467 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:54.467 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop_reply(client.4385.0:205233 3.15 e209/192 ondisk, result = 0)", 2024-09-13T06:42:54.467 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:42:52.322068+0000", 2024-09-13T06:42:54.468 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 2.0497905510000001, 2024-09-13T06:42:54.468 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.01729048, 2024-09-13T06:42:54.468 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:54.468 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:42:54.468 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:54.468 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:54.468 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:54.468 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:52.322068+0000", 2024-09-13T06:42:54.468 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:54.468 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:54.468 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:54.468 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:54.468 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:52.322068+0000", 2024-09-13T06:42:54.469 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:54.469 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:54.469 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:54.469 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:54.469 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:52.322066+0000", 2024-09-13T06:42:54.469 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999981 2024-09-13T06:42:54.469 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:54.469 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:54.469 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:54.469 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:52.322076+0000", 2024-09-13T06:42:54.469 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0832999999999999e-05 2024-09-13T06:42:54.469 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:54.469 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:54.470 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:54.470 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:52.322111+0000", 2024-09-13T06:42:54.470 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.4823000000000002e-05 2024-09-13T06:42:54.470 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:54.470 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:54.470 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:54.470 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:52.322127+0000", 2024-09-13T06:42:54.470 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6096999999999999e-05 2024-09-13T06:42:54.470 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:54.470 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:54.470 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:54.470 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:52.339322+0000", 2024-09-13T06:42:54.470 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.017195070999999999 2024-09-13T06:42:54.471 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:54.471 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:54.471 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:54.471 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:52.339339+0000", 2024-09-13T06:42:54.471 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6056999999999999e-05 2024-09-13T06:42:54.471 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:54.471 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:54.471 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:54.471 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:52.339358+0000", 2024-09-13T06:42:54.471 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.9666000000000001e-05 2024-09-13T06:42:54.471 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:54.471 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:54.471 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:54.472 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:54.472 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:54.472 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:205591 3.16 3:6bccb43d:::rbd_data.112120f04cfa.0000000000000000:head [write 0~1572864 [fadvise_sequential+fadvise_nocache],zero 2621440~1021484,write 3642924~27092 [fadvise_sequential+fadvise_nocache],zero 3670016~175043,write 3845059~30529 [fadvise_sequential+fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e211)", 2024-09-13T06:42:54.472 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:42:53.785943+0000", 2024-09-13T06:42:54.472 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.585915297, 2024-09-13T06:42:54.472 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.016043199000000001, 2024-09-13T06:42:54.472 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:42:54.472 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:42:54.472 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:42:54.472 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:42:54.472 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:54.472 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 205591 2024-09-13T06:42:54.473 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:54.473 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:42:54.473 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:54.473 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:42:54.473 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:53.785943+0000", 2024-09-13T06:42:54.473 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:54.473 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:54.473 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:54.473 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:42:54.473 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:53.785943+0000", 2024-09-13T06:42:54.473 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:42:54.473 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:54.474 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:54.474 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:42:54.474 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:53.785942+0000", 2024-09-13T06:42:54.474 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:42:54.474 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:54.474 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:54.474 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:42:54.474 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:53.788074+0000", 2024-09-13T06:42:54.474 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0021323330000000001 2024-09-13T06:42:54.474 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:54.474 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:54.474 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:42:54.474 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:53.788089+0000", 2024-09-13T06:42:54.474 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.4297999999999999e-05 2024-09-13T06:42:54.475 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:54.475 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:54.475 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:42:54.475 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:53.788097+0000", 2024-09-13T06:42:54.475 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.0460000000000006e-06 2024-09-13T06:42:54.475 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:54.475 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:54.475 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:42:54.475 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:53.788172+0000", 2024-09-13T06:42:54.475 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5068999999999996e-05 2024-09-13T06:42:54.475 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:54.475 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:54.475 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:42:54.476 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:53.788417+0000", 2024-09-13T06:42:54.476 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00024509100000000002 2024-09-13T06:42:54.476 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:54.476 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:54.476 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 5", 2024-09-13T06:42:54.476 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:53.788867+0000", 2024-09-13T06:42:54.476 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00045017899999999999 2024-09-13T06:42:54.476 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:54.476 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:54.476 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-13T06:42:54.476 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:53.801012+0000", 2024-09-13T06:42:54.476 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.01214486 2024-09-13T06:42:54.477 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:54.477 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:54.477 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:42:54.477 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:53.801845+0000", 2024-09-13T06:42:54.477 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000833339 2024-09-13T06:42:54.477 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:54.477 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:54.477 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-13T06:42:54.477 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:53.801926+0000", 2024-09-13T06:42:54.477 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.1026000000000007e-05 2024-09-13T06:42:54.477 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:42:54.477 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:42:54.477 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:42:54.477 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:53.801986+0000", 2024-09-13T06:42:54.478 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.9963999999999997e-05 2024-09-13T06:42:54.478 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:54.478 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:54.478 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:54.478 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:42:54.478 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:42:54.478 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:42:54.479 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-13T06:42:54.477+0000 7fa8bb18e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 36790) UID: 0 2024-09-13T06:42:54.480 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-13T06:42:54.580 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:42:54.581+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:42:54.614 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:42:54.614 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:42:54.628 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-13T06:42:54.681 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:42:54.681+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:42:54.752 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:42:54.752 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:42:54.774 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-13T06:42:54.818 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:42:54.820+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:42:54.883 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:42:54.881+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:42:54.899 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:42:54.899 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:42:54.918 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-13T06:42:54.933 INFO:teuthology.orchestra.run.smithi081.stdout:checking clone #39, image image_client.0-clone39 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent40 2024-09-13T06:42:54.984 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-13T06:42:54.985+0000 7fa8bb18e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 36790) UID: 0 2024-09-13T06:42:55.071 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:42:55.071 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:42:55.085 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:42:55.084+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:42:55.088 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-13T06:42:55.186 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:42:55.188+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:42:55.256 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:42:55.257 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:42:55.273 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-13T06:42:55.287 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-13T06:42:55.285+0000 7fa8bb18e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 36790) UID: 0 2024-09-13T06:42:55.388 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:42:55.388 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:42:55.388 INFO:teuthology.orchestra.run.smithi081.stdout:5491 read 0x5a8c195 thru 0x5a93674 (0x74e0 bytes) 2024-09-13T06:42:55.389 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:42:55.388+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:42:55.391 INFO:teuthology.orchestra.run.smithi081.stdout:5493 read 0xa1ce36d thru 0xa1d9c92 (0xb926 bytes) 2024-09-13T06:42:55.399 INFO:teuthology.orchestra.run.smithi081.stdout:5494 trunc from 0xd6f3cf8 to 0x81e2bae 2024-09-13T06:42:55.423 INFO:teuthology.orchestra.run.smithi081.stdout:5495 writesame 0x6b9c7c9 thru 0x6ba8621 data_size 0x25(0xbe59 bytes) 2024-09-13T06:42:55.430 INFO:teuthology.orchestra.run.smithi081.stdout:5497 punch from 0x6aad110 to 0x6ab4334, (0x7224 bytes) 2024-09-13T06:42:55.430 INFO:teuthology.orchestra.run.smithi081.stdout:5498 read 0x7b3b1c5 thru 0x7b43dfb (0x8c37 bytes) 2024-09-13T06:42:55.430 INFO:teuthology.orchestra.run.smithi081.stdout:5499 read 0x377542e thru 0x3783148 (0xdd1b bytes) 2024-09-13T06:42:55.441 INFO:teuthology.orchestra.run.smithi081.stdout:5500 writesame 0x97d2d90 thru 0x97e2672 data_size 0x1(0xf8e3 bytes) 2024-09-13T06:42:55.443 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:42:55.443 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:42:55.456 INFO:teuthology.orchestra.run.smithi081.stdout:5501 writesame 0xd8adaa5 thru 0xd8b7c3e data_size 0x2a(0xa19a bytes) 2024-09-13T06:42:55.456 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:42:55.456 INFO:teuthology.orchestra.run.smithi081.stdout:5503 punch from 0x4755a7c to 0x47617fe, (0xbd82 bytes) 2024-09-13T06:42:55.456 INFO:teuthology.orchestra.run.smithi081.stdout:5504 read 0x40aae0d thru 0x40b2fce (0x81c2 bytes) 2024-09-13T06:42:55.456 INFO:teuthology.orchestra.run.smithi081.stdout:5505 read 0x8afc69a thru 0x8aff83f (0x31a6 bytes) 2024-09-13T06:42:55.463 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-13T06:42:55.469 INFO:teuthology.orchestra.run.smithi081.stdout:5506 trunc from 0xd8b7c3f to 0x43f7a8e 2024-09-13T06:42:55.489 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:42:55.489+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:42:55.495 INFO:teuthology.orchestra.run.smithi081.stdout:5507 punch from 0x1d70c90 to 0x1d7ee2b, (0xe19b bytes) 2024-09-13T06:42:55.505 INFO:teuthology.orchestra.run.smithi081.stdout:5508 trunc from 0x43f7a8e to 0xa1fdbba 2024-09-13T06:42:55.527 INFO:teuthology.orchestra.run.smithi081.stdout:5509 writesame 0xee131d7 thru 0xee1e186 data_size 0x18(0xafb0 bytes) 2024-09-13T06:42:55.528 INFO:teuthology.orchestra.run.smithi081.stdout:5510 read 0x265c32c thru 0x266ba29 (0xf6fe bytes) 2024-09-13T06:42:55.528 INFO:teuthology.orchestra.run.smithi081.stdout:5511 writesame 0x8b5d121 thru 0x8b5df75 data_size 0x1(0xe55 bytes) 2024-09-13T06:42:55.557 INFO:teuthology.orchestra.run.smithi081.stdout:5512 trunc from 0xee1e187 to 0x57b53c 2024-09-13T06:42:55.589 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:42:55.589+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:42:55.604 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:42:55.604 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:42:55.619 INFO:teuthology.orchestra.run.smithi081.stdout:5513 write 0xdb63360 thru 0xdb6951b (0x61bc bytes) 2024-09-13T06:42:55.623 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-13T06:42:55.627 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:42:55.627 INFO:teuthology.orchestra.run.smithi081.stdout:5515 punch from 0xba268d7 to 0xba3313f, (0xc868 bytes) 2024-09-13T06:42:55.627 INFO:teuthology.orchestra.run.smithi081.stdout:5516 read 0xba104c5 thru 0xba1d571 (0xd0ad bytes) 2024-09-13T06:42:55.627 INFO:teuthology.orchestra.run.smithi081.stdout:5517 read 0x7a0847f thru 0x7a17a5b (0xf5dd bytes) 2024-09-13T06:42:55.627 INFO:teuthology.orchestra.run.smithi081.stdout:5518 write 0xa78f249 thru 0xa791b91 (0x2949 bytes) 2024-09-13T06:42:55.632 INFO:teuthology.orchestra.run.smithi081.stdout:5519 write 0xc89cbce thru 0xc8aad8e (0xe1c1 bytes) 2024-09-13T06:42:55.640 INFO:teuthology.orchestra.run.smithi081.stdout:5520 write 0x25c2161 thru 0x25c42e8 (0x2188 bytes) 2024-09-13T06:42:55.655 INFO:teuthology.orchestra.run.smithi081.stdout:5521 write 0xebe976f thru 0xebec630 (0x2ec2 bytes) 2024-09-13T06:42:55.660 INFO:teuthology.orchestra.run.smithi081.stdout:5522 writesame 0x2c2cc48 thru 0x2c33a3b data_size 0x3e(0x6df4 bytes) 2024-09-13T06:42:55.665 INFO:teuthology.orchestra.run.smithi081.stdout:5523 read 0xb56b3fd thru 0xb56db2b (0x272f bytes) 2024-09-13T06:42:55.665 INFO:teuthology.orchestra.run.smithi081.stdout:5524 writesame 0x28cd2cb thru 0x28d84ed data_size 0x1b(0xb223 bytes) 2024-09-13T06:42:55.669 INFO:teuthology.orchestra.run.smithi081.stdout:5525 read 0xe4d4cf0 thru 0xe4d7fda (0x32eb bytes) 2024-09-13T06:42:55.669 INFO:teuthology.orchestra.run.smithi081.stdout:5526 read 0x6764817 thru 0x676baab (0x7295 bytes) 2024-09-13T06:42:55.669 INFO:teuthology.orchestra.run.smithi081.stdout:5527 read 0x20581ff thru 0x2065b5d (0xd95f bytes) 2024-09-13T06:42:55.669 INFO:teuthology.orchestra.run.smithi081.stdout:5528 write 0xc662fab thru 0xc66cba8 (0x9bfe bytes) 2024-09-13T06:42:55.672 INFO:teuthology.orchestra.run.smithi081.stdout:5529 read 0xa00e8ac thru 0xa01dc6c (0xf3c1 bytes) 2024-09-13T06:42:55.676 INFO:teuthology.orchestra.run.smithi081.stdout:5530 trunc from 0xebec631 to 0xc657515 2024-09-13T06:42:55.690 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:42:55.688+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:42:55.695 INFO:teuthology.orchestra.run.smithi081.stdout:5531 punch from 0x66358be to 0x663c817, (0x6f59 bytes) 2024-09-13T06:42:55.695 INFO:teuthology.orchestra.run.smithi081.stdout:5532 read 0x6313ce6 thru 0x6323134 (0xf44f bytes) 2024-09-13T06:42:55.695 INFO:teuthology.orchestra.run.smithi081.stdout:5534 write 0x290600d thru 0x290e720 (0x8714 bytes) 2024-09-13T06:42:55.698 INFO:teuthology.orchestra.run.smithi081.stdout:5536 read 0x20d79b0 thru 0x20d9176 (0x17c7 bytes) 2024-09-13T06:42:55.698 INFO:teuthology.orchestra.run.smithi081.stdout:5537 punch from 0x4fbc9d7 to 0x4fcb1b7, (0xe7e0 bytes) 2024-09-13T06:42:55.711 INFO:teuthology.orchestra.run.smithi081.stdout:5538 write 0xe1c6205 thru 0xe1c7e90 (0x1c8c bytes) 2024-09-13T06:42:55.715 INFO:teuthology.orchestra.run.smithi081.stdout:5539 trunc from 0xe1c7e91 to 0xe1227eb 2024-09-13T06:42:55.730 INFO:teuthology.orchestra.run.smithi081.stdout:5540 read 0xd0b868e thru 0xd0c0cf2 (0x8665 bytes) 2024-09-13T06:42:55.731 INFO:teuthology.orchestra.run.smithi081.stdout:5542 writesame 0x59fafe8 thru 0x59fdfb9 data_size 0x1(0x2fd2 bytes) 2024-09-13T06:42:55.750 INFO:teuthology.orchestra.run.smithi081.stdout:5543 read 0xca8ccd7 thru 0xca96b75 (0x9e9f bytes) 2024-09-13T06:42:55.750 INFO:teuthology.orchestra.run.smithi081.stdout:5544 write 0xbfaa66 thru 0xbfdf9f (0x353a bytes) 2024-09-13T06:42:55.752 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:42:55.752 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:42:55.753 INFO:teuthology.orchestra.run.smithi081.stdout:5545 writesame 0x5bdacb4 thru 0x5be5aed data_size 0x1d(0xae3a bytes) 2024-09-13T06:42:55.762 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:42:55.762 INFO:teuthology.orchestra.run.smithi081.stdout:5548 punch from 0xd7b1db8 to 0xd7be44b, (0xc693 bytes) 2024-09-13T06:42:55.762 INFO:teuthology.orchestra.run.smithi081.stdout:5550 read 0xeef08d thru 0xefd24d (0xe1c1 bytes) 2024-09-13T06:42:55.763 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:42:55.763 INFO:teuthology.orchestra.run.smithi081.stdout:5552 read 0xcc0f38 thru 0xcc4fc4 (0x408d bytes) 2024-09-13T06:42:55.763 INFO:teuthology.orchestra.run.smithi081.stdout:5553 write 0x364fba2 thru 0x365a984 (0xade3 bytes) 2024-09-13T06:42:55.770 INFO:teuthology.orchestra.run.smithi081.stdout:5555 read 0xb4e03a7 thru 0xb4ece3b (0xca95 bytes) 2024-09-13T06:42:55.770 INFO:teuthology.orchestra.run.smithi081.stdout:5556 write 0x4d389de thru 0x4d3f759 (0x6d7c bytes) 2024-09-13T06:42:55.771 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-13T06:42:55.776 INFO:teuthology.orchestra.run.smithi081.stdout:5558 read 0x89e6e2a thru 0x89f2129 (0xb300 bytes) 2024-09-13T06:42:55.776 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:42:55.776 INFO:teuthology.orchestra.run.smithi081.stdout:5560 write 0x4c333b6 thru 0x4c404aa (0xd0f5 bytes) 2024-09-13T06:42:55.779 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-13T06:42:55.780 INFO:teuthology.orchestra.run.smithi081.stdout:5564 write 0x224450e thru 0x2246fb2 (0x2aa5 bytes) 2024-09-13T06:42:55.783 INFO:teuthology.orchestra.run.smithi081.stdout:5565 write 0xb14074 thru 0xb18c72 (0x4bff bytes) 2024-09-13T06:42:55.786 INFO:teuthology.orchestra.run.smithi081.stdout:5566 read 0xa1d4e38 thru 0xa1da696 (0x585f bytes) 2024-09-13T06:42:55.787 INFO:teuthology.orchestra.run.smithi081.stdout:5567 writesame 0x1821f29 thru 0x18278ac data_size 0x22(0x5984 bytes) 2024-09-13T06:42:55.790 INFO:teuthology.orchestra.run.smithi081.stdout:5568 write 0x340cb89 thru 0x340e963 (0x1ddb bytes) 2024-09-13T06:42:55.791 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:42:55.792+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:42:55.796 INFO:teuthology.orchestra.run.smithi081.stdout:5569 write 0xd52fee8 thru 0xd53deb4 (0xdfcd bytes) 2024-09-13T06:42:55.800 INFO:teuthology.orchestra.run.smithi081.stdout:5570 write 0x32c9248 thru 0x32d2085 (0x8e3e bytes) 2024-09-13T06:42:55.803 INFO:teuthology.orchestra.run.smithi081.stdout:5571 write 0x7219ab3 thru 0x721ae62 (0x13b0 bytes) 2024-09-13T06:42:55.807 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:42:55.807 INFO:teuthology.orchestra.run.smithi081.stdout:5573 writesame 0x44d4a65 thru 0x44de4aa data_size 0x62(0x9a46 bytes) 2024-09-13T06:42:55.813 INFO:teuthology.orchestra.run.smithi081.stdout:5574 writesame 0x81783b thru 0x826290 data_size 0x23(0xea56 bytes) 2024-09-13T06:42:55.815 INFO:teuthology.orchestra.run.smithi081.stdout:5576 write 0xc7f1579 thru 0xc7f92f1 (0x7d79 bytes) 2024-09-13T06:42:55.821 INFO:teuthology.orchestra.run.smithi081.stdout:5577 write 0x369cc6e thru 0x36a0621 (0x39b4 bytes) 2024-09-13T06:42:55.824 INFO:teuthology.orchestra.run.smithi081.stdout:5579 read 0x8228da4 thru 0x822c4f5 (0x3752 bytes) 2024-09-13T06:42:55.824 INFO:teuthology.orchestra.run.smithi081.stdout:5585 write 0x386d17e thru 0x3874c71 (0x7af4 bytes) 2024-09-13T06:42:55.827 INFO:teuthology.orchestra.run.smithi081.stdout:5587 punch from 0x328ee9b to 0x3293d6c, (0x4ed1 bytes) 2024-09-13T06:42:55.828 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:42:55.828 INFO:teuthology.orchestra.run.smithi081.stdout:5590 writesame 0xbd1883e thru 0xbd199a2 data_size 0x1(0x1165 bytes) 2024-09-13T06:42:55.833 INFO:teuthology.orchestra.run.smithi081.stdout:5591 read 0x74a1d4d thru 0x74a62c4 (0x4578 bytes) 2024-09-13T06:42:55.833 INFO:teuthology.orchestra.run.smithi081.stdout:5592 punch from 0x6145b04 to 0x614b4a0, (0x599c bytes) 2024-09-13T06:42:55.833 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:42:55.833 INFO:teuthology.orchestra.run.smithi081.stdout:5594 read 0xa0ff9f0 thru 0xa104a96 (0x50a7 bytes) 2024-09-13T06:42:55.847 INFO:teuthology.orchestra.run.smithi081.stdout:5596 trunc from 0xe1227eb to 0x5955071 2024-09-13T06:42:55.867 INFO:teuthology.orchestra.run.smithi081.stdout:5597 writesame 0xdffe53 thru 0xe08753 data_size 0x1b(0x8901 bytes) 2024-09-13T06:42:55.871 INFO:teuthology.orchestra.run.smithi081.stdout:5598 read 0x2120187 thru 0x21292ad (0x9127 bytes) 2024-09-13T06:42:55.872 INFO:teuthology.orchestra.run.smithi081.stdout:5599 trunc from 0x5955071 to 0x4c7a017 2024-09-13T06:42:55.891 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:42:55.892+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:42:55.892 INFO:teuthology.orchestra.run.smithi081.stdout:5600 punch from 0x24e594f to 0x24ec902, (0x6fb3 bytes) 2024-09-13T06:42:55.892 INFO:teuthology.orchestra.run.smithi081.stdout:5601 read 0x19fa04a thru 0x19fd1d9 (0x3190 bytes) 2024-09-13T06:42:55.909 INFO:teuthology.orchestra.run.smithi081.stdout:5602 write 0xa7033fb thru 0xa7082b2 (0x4eb8 bytes) 2024-09-13T06:42:55.910 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:42:55.911 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:42:55.915 INFO:teuthology.orchestra.run.smithi081.stdout:5603 read 0x89fe047 thru 0x8a0391d (0x58d7 bytes) 2024-09-13T06:42:55.915 INFO:teuthology.orchestra.run.smithi081.stdout:5605 read 0x60f8e69 thru 0x6103f36 (0xb0ce bytes) 2024-09-13T06:42:55.915 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:42:55.927 INFO:teuthology.orchestra.run.smithi081.stdout:5607 write 0xcf06fd6 thru 0xcf0c2cb (0x52f6 bytes) 2024-09-13T06:42:55.933 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-13T06:42:55.939 INFO:teuthology.orchestra.run.smithi081.stdout:5609 write 0xcf6a328 thru 0xcf77ba3 (0xd87c bytes) 2024-09-13T06:42:55.942 INFO:teuthology.orchestra.run.smithi081.stdout:5611 read 0x599bbca thru 0x599c791 (0xbc8 bytes) 2024-09-13T06:42:55.942 INFO:teuthology.orchestra.run.smithi081.stdout:5613 write 0x68da64b thru 0x68e0bd9 (0x658f bytes) 2024-09-13T06:42:55.948 INFO:teuthology.orchestra.run.smithi081.stdout:5614 punch from 0xa81d31 to 0xa825cc, (0x89b bytes) 2024-09-13T06:42:55.948 INFO:teuthology.orchestra.run.smithi081.stdout:5615 read 0xb90df8a thru 0xb90e552 (0x5c9 bytes) 2024-09-13T06:42:55.948 INFO:teuthology.orchestra.run.smithi081.stdout:5616 write 0x5559bd5 thru 0x555b66f (0x1a9b bytes) 2024-09-13T06:42:55.952 INFO:teuthology.orchestra.run.smithi081.stdout:5617 write 0x1c91a71 thru 0x1c9c6b7 (0xac47 bytes) 2024-09-13T06:42:55.956 INFO:teuthology.orchestra.run.smithi081.stdout:5619 write 0x645ef1a thru 0x646dae5 (0xebcc bytes) 2024-09-13T06:42:55.962 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:42:55.962 INFO:teuthology.orchestra.run.smithi081.stdout:5621 writesame 0x88dfcc6 thru 0x88ed4c6 data_size 0xb(0xd801 bytes) 2024-09-13T06:42:55.973 INFO:teuthology.orchestra.run.smithi081.stdout:5623 read 0x2a6a488 thru 0x2a77613 (0xd18c bytes) 2024-09-13T06:42:55.973 INFO:teuthology.orchestra.run.smithi081.stdout:5624 writesame 0x3b11c68 thru 0x3b198a9 data_size 0x5(0x7c42 bytes) 2024-09-13T06:42:55.986 INFO:teuthology.orchestra.run.smithi081.stdout:5625 read 0x2baa1ef thru 0x2bafb7d (0x598f bytes) 2024-09-13T06:42:55.986 INFO:teuthology.orchestra.run.smithi081.stdout:5626 punch from 0xab81a8b to 0xab8341c, (0x1991 bytes) 2024-09-13T06:42:55.986 INFO:teuthology.orchestra.run.smithi081.stdout:5628 write 0xc35aa67 thru 0xc363863 (0x8dfd bytes) 2024-09-13T06:42:55.992 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:42:55.992+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:42:55.992 INFO:teuthology.orchestra.run.smithi081.stdout:5629 writesame 0x3ce3e18 thru 0x3cf32d3 data_size 0x8a(0xf4bc bytes) 2024-09-13T06:42:55.996 INFO:teuthology.orchestra.run.smithi081.stdout:5630 write 0xcd4a216 thru 0xcd4e918 (0x4703 bytes) 2024-09-13T06:42:56.002 INFO:teuthology.orchestra.run.smithi081.stdout:5631 read 0x4570306 thru 0x457fa45 (0xf740 bytes) 2024-09-13T06:42:56.003 INFO:teuthology.orchestra.run.smithi081.stdout:5632 writesame 0x68983fd thru 0x68a7d77 data_size 0x3(0xf97b bytes) 2024-09-13T06:42:56.033 INFO:teuthology.orchestra.run.smithi081.stdout:5633 writesame 0x680bb53 thru 0x6815b20 data_size 0x5(0x9fce bytes) 2024-09-13T06:42:56.067 INFO:teuthology.orchestra.run.smithi081.stdout:5634 trunc from 0xcf77ba4 to 0x174b759 2024-09-13T06:42:56.070 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:42:56.070 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:42:56.093 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-13T06:42:56.094 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:42:56.092+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:42:56.130 INFO:teuthology.orchestra.run.smithi081.stdout:5635 writesame 0xc2ca272 thru 0xc2d2777 data_size 0x1(0x8506 bytes) 2024-09-13T06:42:56.130 INFO:teuthology.orchestra.run.smithi081.stdout:5636 read 0x4793317 thru 0x47983ea (0x50d4 bytes) 2024-09-13T06:42:56.130 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:42:56.130 INFO:teuthology.orchestra.run.smithi081.stdout:5639 write 0x3347aea thru 0x335203c (0xa553 bytes) 2024-09-13T06:42:56.135 INFO:teuthology.orchestra.run.smithi081.stdout:5640 read 0x4e8f379 thru 0x4e98abd (0x9745 bytes) 2024-09-13T06:42:56.136 INFO:teuthology.orchestra.run.smithi081.stdout:5643 punch from 0x7f5d125 to 0x7f630e7, (0x5fc2 bytes) 2024-09-13T06:42:56.142 INFO:teuthology.orchestra.run.smithi081.stdout:5644 trunc from 0xc2d2778 to 0x8ce41ac 2024-09-13T06:42:56.152 INFO:teuthology.orchestra.run.smithi081.stdout:5646 trunc from 0x8ce41ac to 0x9d117d6 2024-09-13T06:42:56.160 INFO:teuthology.orchestra.run.smithi081.stdout:5647 write 0x5e58c0 thru 0x5f1ce8 (0xc429 bytes) 2024-09-13T06:42:56.162 INFO:teuthology.orchestra.run.smithi081.stdout:5648 writesame 0x813cf65 thru 0x8142ee3 data_size 0x1d(0x5f7f bytes) 2024-09-13T06:42:56.168 INFO:teuthology.orchestra.run.smithi081.stdout:5649 write 0x2ef7b6f thru 0x2f05809 (0xdc9b bytes) 2024-09-13T06:42:56.175 INFO:teuthology.orchestra.run.smithi081.stdout:5650 punch from 0x55cc79 to 0x56baef, (0xee76 bytes) 2024-09-13T06:42:56.182 INFO:teuthology.orchestra.run.smithi081.stdout:5651 trunc from 0x9d117d6 to 0xec9fff3 2024-09-13T06:42:56.190 INFO:teuthology.orchestra.run.smithi081.stdout:5652 punch from 0xb1e85d0 to 0xb1ec325, (0x3d55 bytes) 2024-09-13T06:42:56.194 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:42:56.193+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:42:56.199 INFO:teuthology.orchestra.run.smithi081.stdout:5654 trunc from 0xec9fff3 to 0x8ac4672 2024-09-13T06:42:56.214 INFO:teuthology.orchestra.run.smithi081.stdout:5656 trunc from 0x8ac4672 to 0x5631adf 2024-09-13T06:42:56.248 INFO:teuthology.orchestra.run.smithi081.stdout:5658 writesame 0xa226169 thru 0xa226d19 data_size 0x1(0xbb1 bytes) 2024-09-13T06:42:56.249 INFO:teuthology.orchestra.run.smithi081.stdout:5659 read 0x4ef0d54 thru 0x4ef8e5f (0x810c bytes) 2024-09-13T06:42:56.260 INFO:teuthology.orchestra.run.smithi081.stdout:5660 write 0xb4fc757 thru 0xb4fdd36 (0x15e0 bytes) 2024-09-13T06:42:56.272 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:42:56.272 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:42:56.277 INFO:teuthology.orchestra.run.smithi081.stdout:5661 writesame 0xc4c702f thru 0xc4cdae5 data_size 0x1(0x6ab7 bytes) 2024-09-13T06:42:56.277 INFO:teuthology.orchestra.run.smithi081.stdout:5665 punch from 0x65c7d8f to 0x65ce68c, (0x68fd bytes) 2024-09-13T06:42:56.277 INFO:teuthology.orchestra.run.smithi081.stdout:5666 punch from 0x5b8d257 to 0x5b916b2, (0x445b bytes) 2024-09-13T06:42:56.277 INFO:teuthology.orchestra.run.smithi081.stdout:5667 write 0x52faf6e thru 0x530557c (0xa60f bytes) 2024-09-13T06:42:56.286 INFO:teuthology.orchestra.run.smithi081.stdout:5668 punch from 0x27ae36c to 0x27b44b9, (0x614d bytes) 2024-09-13T06:42:56.286 INFO:teuthology.orchestra.run.smithi081.stdout:5669 read 0xfa6491 thru 0xfac2e7 (0x5e57 bytes) 2024-09-13T06:42:56.286 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:42:56.287 INFO:teuthology.orchestra.run.smithi081.stdout:5672 read 0x9cc81f4 thru 0x9cd0707 (0x8514 bytes) 2024-09-13T06:42:56.289 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-13T06:42:56.294 INFO:teuthology.orchestra.run.smithi081.stdout:5673 write 0xc5ec32a thru 0xc5f4436 (0x810d bytes) 2024-09-13T06:42:56.295 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:42:56.293+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:42:56.299 INFO:teuthology.orchestra.run.smithi081.stdout:5674 read 0x4872bd7 thru 0x487bec2 (0x92ec bytes) 2024-09-13T06:42:56.315 INFO:teuthology.orchestra.run.smithi081.stdout:5675 trunc from 0xc5f4437 to 0x2a6b363 2024-09-13T06:42:56.339 INFO:teuthology.orchestra.run.smithi081.stderr:Error ENXIO: problem getting command descriptions from osd.6 2024-09-13T06:42:56.352 INFO:teuthology.orchestra.run.smithi081.stdout:5676 trunc from 0x2a6b363 to 0xdc6778a 2024-09-13T06:42:56.360 INFO:teuthology.orchestra.run.smithi081.stdout:5677 read 0x723e473 thru 0x724b45e (0xcfec bytes) 2024-09-13T06:42:56.360 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:42:56.360 INFO:teuthology.orchestra.run.smithi081.stdout:5679 write 0x6ce3361 thru 0x6ce3d39 (0x9d9 bytes) 2024-09-13T06:42:56.365 INFO:teuthology.orchestra.run.smithi081.stdout:5680 writesame 0x8fa1952 thru 0x8fa9964 data_size 0x3(0x8013 bytes) 2024-09-13T06:42:56.374 INFO:teuthology.orchestra.run.smithi081.stdout:osd.7: {} 2024-09-13T06:42:56.374 INFO:teuthology.orchestra.run.smithi081.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-13T06:42:56.375 INFO:teuthology.orchestra.run.smithi081.stdout:5681 read 0xd6f19fd thru 0xd6ff987 (0xdf8b bytes) 2024-09-13T06:42:56.375 INFO:teuthology.orchestra.run.smithi081.stdout:5683 read 0xa536c90 thru 0xa53998e (0x2cff bytes) 2024-09-13T06:42:56.375 INFO:teuthology.orchestra.run.smithi081.stdout:5684 read 0xd1fc451 thru 0xd201a2b (0x55db bytes) 2024-09-13T06:42:56.375 INFO:teuthology.orchestra.run.smithi081.stdout:5685 punch from 0x29080f7 to 0x29131eb, (0xb0f4 bytes) 2024-09-13T06:42:56.375 INFO:teuthology.orchestra.run.smithi081.stdout:5686 write 0x1b8afb8 thru 0x1b94719 (0x9762 bytes) 2024-09-13T06:42:56.378 INFO:teuthology.orchestra.run.smithi081.stdout:5687 write 0x18db3ab thru 0x18e2785 (0x73db bytes) 2024-09-13T06:42:56.379 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-13T06:42:56.379 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-13T06:42:56.382 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:42:56.382 INFO:teuthology.orchestra.run.smithi081.stdout:5691 punch from 0x488e77f to 0x489b815, (0xd096 bytes) 2024-09-13T06:42:56.382 INFO:teuthology.orchestra.run.smithi081.stdout:5692 punch from 0x81cab84 to 0x81d047f, (0x58fb bytes) 2024-09-13T06:42:56.382 INFO:teuthology.orchestra.run.smithi081.stdout:5694 write 0x5ca0648 thru 0x5ca21fe (0x1bb7 bytes) 2024-09-13T06:42:56.388 INFO:teuthology.orchestra.run.smithi081.stdout:5695 read 0x8aca525 thru 0x8ad144f (0x6f2b bytes) 2024-09-13T06:42:56.388 INFO:teuthology.orchestra.run.smithi081.stdout:5697 punch from 0x5678acb to 0x567f939, (0x6e6e bytes) 2024-09-13T06:42:56.388 INFO:teuthology.orchestra.run.smithi081.stdout:5698 trunc from 0xdc6778a to 0xda2372f 2024-09-13T06:42:56.396 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-13T06:42:56.397+0000 7fa8bb18e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 36790) UID: 0 2024-09-13T06:42:56.396 INFO:teuthology.orchestra.run.smithi081.stderr:noscrub is unset 2024-09-13T06:42:56.402 INFO:teuthology.orchestra.run.smithi081.stdout:5701 write 0x957071c thru 0x957e283 (0xdb68 bytes) 2024-09-13T06:42:56.410 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:42:56.410 INFO:teuthology.orchestra.run.smithi081.stdout:5703 read 0x4cfcf2e thru 0x4d08c57 (0xbd2a bytes) 2024-09-13T06:42:56.430 INFO:teuthology.orchestra.run.smithi081.stdout:5704 trunc from 0xda2372f to 0x25fc7fb 2024-09-13T06:42:56.447 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:42:56.448 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:42:56.453 INFO:teuthology.orchestra.run.smithi081.stdout:5705 punch from 0xfe2170 to 0xfeb399, (0x9229 bytes) 2024-09-13T06:42:56.460 INFO:teuthology.orchestra.run.smithi081.stdout:5706 trunc from 0x25fc7fb to 0x6dc6151 2024-09-13T06:42:56.467 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-13T06:42:56.468 INFO:teuthology.orchestra.run.smithi081.stdout:5707 punch from 0x4288b5b to 0x4296d82, (0xe227 bytes) 2024-09-13T06:42:56.486 INFO:teuthology.orchestra.run.smithi081.stdout:5709 write 0xe0be120 thru 0xe0c7d69 (0x9c4a bytes) 2024-09-13T06:42:56.489 INFO:teuthology.orchestra.run.smithi081.stdout:5711 write 0xd8bffe1 thru 0xd8ccf77 (0xcf97 bytes) 2024-09-13T06:42:56.494 INFO:teuthology.orchestra.run.smithi081.stdout:5712 read 0xc80b46b thru 0xc80d85b (0x23f1 bytes) 2024-09-13T06:42:56.495 INFO:teuthology.orchestra.run.smithi081.stdout:5713 writesame 0xc338ab4 thru 0xc3424ba data_size 0x2b(0x9a07 bytes) 2024-09-13T06:42:56.497 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:42:56.496+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:42:56.499 INFO:teuthology.orchestra.run.smithi081.stdout:5715 punch from 0xca0e850 to 0xca15a4a, (0x71fa bytes) 2024-09-13T06:42:56.499 INFO:teuthology.orchestra.run.smithi081.stdout:5716 write 0x2c52151 thru 0x2c54555 (0x2405 bytes) 2024-09-13T06:42:56.501 INFO:teuthology.orchestra.run.smithi081.stdout:5717 read 0x73c1925 thru 0x73c8c49 (0x7325 bytes) 2024-09-13T06:42:56.501 INFO:teuthology.orchestra.run.smithi081.stdout:5718 read 0xa21d2fa thru 0xa22d107 (0xfe0e bytes) 2024-09-13T06:42:56.508 INFO:teuthology.orchestra.run.smithi081.stdout:5719 writesame 0xe5ec17f thru 0xe5f56ea data_size 0x4(0x956c bytes) 2024-09-13T06:42:56.515 INFO:teuthology.orchestra.run.smithi081.stdout:5721 trunc from 0xe5f56eb to 0xaa1fe3b 2024-09-13T06:42:56.537 INFO:teuthology.orchestra.run.smithi081.stdout:5722 write 0x4e97183 thru 0x4ea70d3 (0xff51 bytes) 2024-09-13T06:42:56.562 INFO:teuthology.orchestra.run.smithi081.stdout:5723 writesame 0xd35cb5e thru 0xd368cdf data_size 0x3e(0xc182 bytes) 2024-09-13T06:42:56.562 INFO:teuthology.orchestra.run.smithi081.stdout:5724 punch from 0xecf098 to 0xecf182, (0xea bytes) 2024-09-13T06:42:56.579 INFO:teuthology.orchestra.run.smithi081.stdout:5726 trunc from 0xd368ce0 to 0x62852b3 2024-09-13T06:42:56.593 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:42:56.598 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:42:56.596+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:42:56.600 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:42:56.600 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:42:56.609 INFO:teuthology.orchestra.run.smithi081.stdout:5728 trunc from 0x62852b3 to 0xbd00595 2024-09-13T06:42:56.615 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-13T06:42:56.635 INFO:teuthology.orchestra.run.smithi081.stdout:5729 write 0xc09d1d0 thru 0xc09db2e (0x95f bytes) 2024-09-13T06:42:56.641 INFO:teuthology.orchestra.run.smithi081.stdout:5730 writesame 0x4ba104f thru 0x4ba5ea8 data_size 0x3(0x4e5a bytes) 2024-09-13T06:42:56.649 INFO:teuthology.orchestra.run.smithi081.stdout:5731 read 0xbf58f5f thru 0xbf5a0c3 (0x1165 bytes) 2024-09-13T06:42:56.649 INFO:teuthology.orchestra.run.smithi081.stdout:5732 write 0xa84ae7d thru 0xa84db72 (0x2cf6 bytes) 2024-09-13T06:42:56.651 INFO:teuthology.orchestra.run.smithi081.stdout:5733 read 0x647880d thru 0x64808e6 (0x80da bytes) 2024-09-13T06:42:56.651 INFO:teuthology.orchestra.run.smithi081.stdout:5734 read 0xb2ef231 thru 0xb2f21e8 (0x2fb8 bytes) 2024-09-13T06:42:56.656 INFO:teuthology.orchestra.run.smithi081.stdout:5735 trunc from 0xc09db2f to 0xa9f32c9 2024-09-13T06:42:56.673 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:42:56.674 INFO:teuthology.orchestra.run.smithi081.stdout:5738 writesame 0x3311abd thru 0x331adcf data_size 0x1(0x9313 bytes) 2024-09-13T06:42:56.698 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:42:56.700+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:42:56.720 INFO:teuthology.orchestra.run.smithi081.stdout:5739 read 0x31d328b thru 0x31da243 (0x6fb9 bytes) 2024-09-13T06:42:56.720 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:42:56.720 INFO:teuthology.orchestra.run.smithi081.stdout:5742 write 0x242a039 thru 0x24304cd (0x6495 bytes) 2024-09-13T06:42:56.724 INFO:teuthology.orchestra.run.smithi081.stdout:5743 punch from 0x9350d1f to 0x9360799, (0xfa7a bytes) 2024-09-13T06:42:56.724 INFO:teuthology.orchestra.run.smithi081.stdout:5744 writesame 0x3d5a007 thru 0x3d69ba7 data_size 0x1(0xfba1 bytes) 2024-09-13T06:42:56.740 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:42:56.741 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:42:56.756 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-13T06:42:56.799 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:42:56.800+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:42:56.806 INFO:teuthology.orchestra.run.smithi081.stdout:5745 trunc from 0xa9f32c9 to 0x5f4b3c6 2024-09-13T06:42:56.828 INFO:teuthology.orchestra.run.smithi081.stdout:5746 write 0x52db2fc thru 0x52de809 (0x350e bytes) 2024-09-13T06:42:56.864 INFO:teuthology.orchestra.run.smithi081.stdout:5752 writesame 0xd9dc74f thru 0xd9e533a data_size 0x12(0x8bec bytes) 2024-09-13T06:42:56.864 INFO:teuthology.orchestra.run.smithi081.stdout:5753 write 0x4cd0733 thru 0x4cd6dc0 (0x668e bytes) 2024-09-13T06:42:56.871 INFO:teuthology.orchestra.run.smithi081.stdout:5756 write 0xd1b67d6 thru 0xd1bd09d (0x68c8 bytes) 2024-09-13T06:42:56.878 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:42:56.878 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:42:56.879 INFO:teuthology.orchestra.run.smithi081.stdout:5758 punch from 0x7feae87 to 0x7ff5e99, (0xb012 bytes) 2024-09-13T06:42:56.879 INFO:teuthology.orchestra.run.smithi081.stdout:5760 read 0x406ab1f thru 0x40754b6 (0xa998 bytes) 2024-09-13T06:42:56.879 INFO:teuthology.orchestra.run.smithi081.stdout:5761 writesame 0xb097755 thru 0xb0a4fef data_size 0xb(0xd89b bytes) 2024-09-13T06:42:56.892 INFO:teuthology.orchestra.run.smithi081.stdout:5762 read 0xa10470d thru 0xa10d674 (0x8f68 bytes) 2024-09-13T06:42:56.892 INFO:teuthology.orchestra.run.smithi081.stdout:5763 punch from 0x18c7ab2 to 0x18c902c, (0x157a bytes) 2024-09-13T06:42:56.892 INFO:teuthology.orchestra.run.smithi081.stdout:5764 punch from 0x741ce88 to 0x7422ca0, (0x5e18 bytes) 2024-09-13T06:42:56.892 INFO:teuthology.orchestra.run.smithi081.stdout:5765 write 0x89228a7 thru 0x892e0fb (0xb855 bytes) 2024-09-13T06:42:56.894 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-13T06:42:56.899 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:42:56.900+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:42:56.931 INFO:teuthology.orchestra.run.smithi081.stdout:5767 trunc from 0xd9e533b to 0x1bcf70a 2024-09-13T06:42:56.956 INFO:teuthology.orchestra.run.smithi081.stdout:5771 punch from 0xaaf110 to 0xab21f0, (0x30e0 bytes) 2024-09-13T06:42:56.957 INFO:teuthology.orchestra.run.smithi081.stdout:5775 read 0x223a38 thru 0x228dca (0x5393 bytes) 2024-09-13T06:42:56.958 INFO:teuthology.orchestra.run.smithi081.stdout:5779 punch from 0x1338f0e to 0x133b2b4, (0x23a6 bytes) 2024-09-13T06:42:56.958 INFO:teuthology.orchestra.run.smithi081.stdout:5780 clone 42 order 25 su 262144 sc 7 2024-09-13T06:42:57.001 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:42:57.000+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:42:57.018 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:42:57.018 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:42:57.032 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-13T06:42:57.101 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:42:57.101+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:42:57.157 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:42:57.158 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:42:57.172 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-13T06:42:57.216 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:42:57.217+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:42:57.303 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:42:57.304+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:42:57.340 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:42:57.341 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:42:57.355 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-13T06:42:57.403 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:42:57.404+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:42:57.471 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:42:57.471 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:42:57.485 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-13T06:42:57.505 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:42:57.504+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:42:57.601 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:42:57.601 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:42:57.605 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:42:57.604+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:42:57.615 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-13T06:42:57.674 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 7, 5, 3, 4] out_osds: [6] dead_osds: [6] live_osds: [0, 1, 2, 3, 4, 5, 7] 2024-09-13T06:42:57.674 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-13T06:42:57.675 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap_items 2024-09-13T06:42:57.675 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-09-13T06:42:57.706 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:42:57.705+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:42:57.732 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:42:57.732 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:42:57.747 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-13T06:42:57.807 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:42:57.808+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:42:57.887 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:42:57.887 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:42:57.902 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-13T06:42:57.908 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:42:57.909+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:42:57.995 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T06:42:57.995 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:42:57.996 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 214, 2024-09-13T06:42:57.996 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "e5612297-d004-4957-927e-afa37f30d6cf", 2024-09-13T06:42:57.996 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-09-13T06:38:56.670231+0000", 2024-09-13T06:42:57.996 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-09-13T06:42:57.770474+0000", 2024-09-13T06:42:57.996 INFO:teuthology.orchestra.run.smithi081.stdout: "last_up_change": "2024-09-13T06:42:51.723548+0000", 2024-09-13T06:42:57.996 INFO:teuthology.orchestra.run.smithi081.stdout: "last_in_change": "2024-09-13T06:42:16.419321+0000", 2024-09-13T06:42:57.996 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": "nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-13T06:42:57.996 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_num": 5804032, 2024-09-13T06:42:57.996 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_set": [ 2024-09-13T06:42:57.996 INFO:teuthology.orchestra.run.smithi081.stdout: "nodeep-scrub", 2024-09-13T06:42:57.996 INFO:teuthology.orchestra.run.smithi081.stdout: "pglog_hardlimit", 2024-09-13T06:42:57.996 INFO:teuthology.orchestra.run.smithi081.stdout: "purged_snapdirs", 2024-09-13T06:42:57.996 INFO:teuthology.orchestra.run.smithi081.stdout: "recovery_deletes", 2024-09-13T06:42:57.997 INFO:teuthology.orchestra.run.smithi081.stdout: "sortbitwise" 2024-09-13T06:42:57.997 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-13T06:42:57.997 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_version": 5, 2024-09-13T06:42:57.997 INFO:teuthology.orchestra.run.smithi081.stdout: "full_ratio": 0.94999998807907104, 2024-09-13T06:42:57.997 INFO:teuthology.orchestra.run.smithi081.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-09-13T06:42:57.997 INFO:teuthology.orchestra.run.smithi081.stdout: "nearfull_ratio": 0.85000002384185791, 2024-09-13T06:42:57.997 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_snapshot": "", 2024-09-13T06:42:57.997 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_max": 3, 2024-09-13T06:42:57.997 INFO:teuthology.orchestra.run.smithi081.stdout: "max_osd": 8, 2024-09-13T06:42:57.997 INFO:teuthology.orchestra.run.smithi081.stdout: "require_min_compat_client": "luminous", 2024-09-13T06:42:57.997 INFO:teuthology.orchestra.run.smithi081.stdout: "min_compat_client": "luminous", 2024-09-13T06:42:57.997 INFO:teuthology.orchestra.run.smithi081.stdout: "require_osd_release": "reef", 2024-09-13T06:42:57.997 INFO:teuthology.orchestra.run.smithi081.stdout: "allow_crimson": false, 2024-09-13T06:42:57.998 INFO:teuthology.orchestra.run.smithi081.stdout: "pools": [ 2024-09-13T06:42:57.998 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:57.998 INFO:teuthology.orchestra.run.smithi081.stdout: "pool": 1, 2024-09-13T06:42:57.998 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_name": ".mgr", 2024-09-13T06:42:57.998 INFO:teuthology.orchestra.run.smithi081.stdout: "create_time": "2024-09-13T06:39:09.600726+0000", 2024-09-13T06:42:57.998 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-13T06:42:57.998 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_names": "hashpspool", 2024-09-13T06:42:57.998 INFO:teuthology.orchestra.run.smithi081.stdout: "type": 1, 2024-09-13T06:42:57.998 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 2, 2024-09-13T06:42:57.998 INFO:teuthology.orchestra.run.smithi081.stdout: "min_size": 1, 2024-09-13T06:42:57.998 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_rule": 0, 2024-09-13T06:42:57.998 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_count": 0, 2024-09-13T06:42:57.998 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_target": 0, 2024-09-13T06:42:57.999 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_barrier": 0, 2024-09-13T06:42:57.999 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-13T06:42:57.999 INFO:teuthology.orchestra.run.smithi081.stdout: "object_hash": 2, 2024-09-13T06:42:57.999 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_mode": "off", 2024-09-13T06:42:57.999 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num": 1, 2024-09-13T06:42:57.999 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num": 1, 2024-09-13T06:42:57.999 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num_target": 1, 2024-09-13T06:42:57.999 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_target": 1, 2024-09-13T06:42:57.999 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_pending": 1, 2024-09-13T06:42:57.999 INFO:teuthology.orchestra.run.smithi081.stdout: "last_pg_merge_meta": { 2024-09-13T06:42:57.999 INFO:teuthology.orchestra.run.smithi081.stdout: "source_pgid": "0.0", 2024-09-13T06:42:57.999 INFO:teuthology.orchestra.run.smithi081.stdout: "ready_epoch": 0, 2024-09-13T06:42:57.999 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_started": 0, 2024-09-13T06:42:58.000 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_clean": 0, 2024-09-13T06:42:58.000 INFO:teuthology.orchestra.run.smithi081.stdout: "source_version": "0'0", 2024-09-13T06:42:58.000 INFO:teuthology.orchestra.run.smithi081.stdout: "target_version": "0'0" 2024-09-13T06:42:58.000 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.000 INFO:teuthology.orchestra.run.smithi081.stdout: "last_change": "16", 2024-09-13T06:42:58.000 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend": "0", 2024-09-13T06:42:58.000 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-13T06:42:58.000 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_preluminous": "0", 2024-09-13T06:42:58.000 INFO:teuthology.orchestra.run.smithi081.stdout: "auid": 0, 2024-09-13T06:42:58.000 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_mode": "selfmanaged", 2024-09-13T06:42:58.000 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_seq": 0, 2024-09-13T06:42:58.000 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_epoch": 0, 2024-09-13T06:42:58.000 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_snaps": [], 2024-09-13T06:42:58.001 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps": "[]", 2024-09-13T06:42:58.001 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_bytes": 0, 2024-09-13T06:42:58.001 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_objects": 0, 2024-09-13T06:42:58.001 INFO:teuthology.orchestra.run.smithi081.stdout: "tiers": [], 2024-09-13T06:42:58.001 INFO:teuthology.orchestra.run.smithi081.stdout: "tier_of": -1, 2024-09-13T06:42:58.001 INFO:teuthology.orchestra.run.smithi081.stdout: "read_tier": -1, 2024-09-13T06:42:58.001 INFO:teuthology.orchestra.run.smithi081.stdout: "write_tier": -1, 2024-09-13T06:42:58.001 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_mode": "none", 2024-09-13T06:42:58.001 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_bytes": 0, 2024-09-13T06:42:58.001 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_objects": 0, 2024-09-13T06:42:58.001 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-13T06:42:58.001 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-13T06:42:58.001 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-13T06:42:58.002 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_flush_age": 0, 2024-09-13T06:42:58.002 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_evict_age": 0, 2024-09-13T06:42:58.002 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profile": "", 2024-09-13T06:42:58.002 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_params": { 2024-09-13T06:42:58.002 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "none" 2024-09-13T06:42:58.002 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.002 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_period": 0, 2024-09-13T06:42:58.002 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_count": 0, 2024-09-13T06:42:58.002 INFO:teuthology.orchestra.run.smithi081.stdout: "use_gmt_hitset": true, 2024-09-13T06:42:58.002 INFO:teuthology.orchestra.run.smithi081.stdout: "min_read_recency_for_promote": 0, 2024-09-13T06:42:58.002 INFO:teuthology.orchestra.run.smithi081.stdout: "min_write_recency_for_promote": 0, 2024-09-13T06:42:58.002 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_grade_decay_rate": 0, 2024-09-13T06:42:58.002 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_search_last_n": 0, 2024-09-13T06:42:58.003 INFO:teuthology.orchestra.run.smithi081.stdout: "grade_table": [], 2024-09-13T06:42:58.003 INFO:teuthology.orchestra.run.smithi081.stdout: "stripe_width": 0, 2024-09-13T06:42:58.003 INFO:teuthology.orchestra.run.smithi081.stdout: "expected_num_objects": 0, 2024-09-13T06:42:58.003 INFO:teuthology.orchestra.run.smithi081.stdout: "fast_read": false, 2024-09-13T06:42:58.003 INFO:teuthology.orchestra.run.smithi081.stdout: "options": { 2024-09-13T06:42:58.003 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_max": 32, 2024-09-13T06:42:58.003 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_min": 1 2024-09-13T06:42:58.003 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.003 INFO:teuthology.orchestra.run.smithi081.stdout: "application_metadata": { 2024-09-13T06:42:58.003 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": {} 2024-09-13T06:42:58.003 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.003 INFO:teuthology.orchestra.run.smithi081.stdout: "read_balance": { 2024-09-13T06:42:58.003 INFO:teuthology.orchestra.run.smithi081.stdout: "score_acting": 6.9000000953674316, 2024-09-13T06:42:58.003 INFO:teuthology.orchestra.run.smithi081.stdout: "score_stable": 6.9000000953674316, 2024-09-13T06:42:58.003 INFO:teuthology.orchestra.run.smithi081.stdout: "optimal_score": 0.28999999165534973, 2024-09-13T06:42:58.004 INFO:teuthology.orchestra.run.smithi081.stdout: "raw_score_acting": 2, 2024-09-13T06:42:58.004 INFO:teuthology.orchestra.run.smithi081.stdout: "raw_score_stable": 2, 2024-09-13T06:42:58.004 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity_weighted": 0.66389274597167969, 2024-09-13T06:42:58.004 INFO:teuthology.orchestra.run.smithi081.stdout: "average_primary_affinity": 0.75999999046325684, 2024-09-13T06:42:58.004 INFO:teuthology.orchestra.run.smithi081.stdout: "average_primary_affinity_weighted": 0.6600000262260437 2024-09-13T06:42:58.004 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:58.004 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.004 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.004 INFO:teuthology.orchestra.run.smithi081.stdout: "pool": 2, 2024-09-13T06:42:58.004 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_name": "rbd", 2024-09-13T06:42:58.004 INFO:teuthology.orchestra.run.smithi081.stdout: "create_time": "2024-09-13T06:39:15.802118+0000", 2024-09-13T06:42:58.004 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 8193, 2024-09-13T06:42:58.004 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-13T06:42:58.005 INFO:teuthology.orchestra.run.smithi081.stdout: "type": 1, 2024-09-13T06:42:58.005 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 2, 2024-09-13T06:42:58.005 INFO:teuthology.orchestra.run.smithi081.stdout: "min_size": 1, 2024-09-13T06:42:58.005 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_rule": 0, 2024-09-13T06:42:58.005 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_count": 0, 2024-09-13T06:42:58.005 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_target": 0, 2024-09-13T06:42:58.005 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_barrier": 0, 2024-09-13T06:42:58.005 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-13T06:42:58.005 INFO:teuthology.orchestra.run.smithi081.stdout: "object_hash": 2, 2024-09-13T06:42:58.005 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_mode": "off", 2024-09-13T06:42:58.005 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num": 8, 2024-09-13T06:42:58.005 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num": 8, 2024-09-13T06:42:58.005 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num_target": 8, 2024-09-13T06:42:58.005 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_target": 8, 2024-09-13T06:42:58.006 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_pending": 8, 2024-09-13T06:42:58.006 INFO:teuthology.orchestra.run.smithi081.stdout: "last_pg_merge_meta": { 2024-09-13T06:42:58.006 INFO:teuthology.orchestra.run.smithi081.stdout: "source_pgid": "0.0", 2024-09-13T06:42:58.006 INFO:teuthology.orchestra.run.smithi081.stdout: "ready_epoch": 0, 2024-09-13T06:42:58.006 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_started": 0, 2024-09-13T06:42:58.006 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_clean": 0, 2024-09-13T06:42:58.006 INFO:teuthology.orchestra.run.smithi081.stdout: "source_version": "0'0", 2024-09-13T06:42:58.006 INFO:teuthology.orchestra.run.smithi081.stdout: "target_version": "0'0" 2024-09-13T06:42:58.006 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.006 INFO:teuthology.orchestra.run.smithi081.stdout: "last_change": "20", 2024-09-13T06:42:58.006 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend": "0", 2024-09-13T06:42:58.006 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-13T06:42:58.006 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_preluminous": "0", 2024-09-13T06:42:58.006 INFO:teuthology.orchestra.run.smithi081.stdout: "auid": 0, 2024-09-13T06:42:58.007 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_mode": "selfmanaged", 2024-09-13T06:42:58.007 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_seq": 3, 2024-09-13T06:42:58.007 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_epoch": 20, 2024-09-13T06:42:58.007 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_snaps": [], 2024-09-13T06:42:58.007 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps": "[]", 2024-09-13T06:42:58.007 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_bytes": 0, 2024-09-13T06:42:58.007 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_objects": 0, 2024-09-13T06:42:58.007 INFO:teuthology.orchestra.run.smithi081.stdout: "tiers": [], 2024-09-13T06:42:58.007 INFO:teuthology.orchestra.run.smithi081.stdout: "tier_of": -1, 2024-09-13T06:42:58.007 INFO:teuthology.orchestra.run.smithi081.stdout: "read_tier": -1, 2024-09-13T06:42:58.007 INFO:teuthology.orchestra.run.smithi081.stdout: "write_tier": -1, 2024-09-13T06:42:58.007 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_mode": "none", 2024-09-13T06:42:58.007 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_bytes": 0, 2024-09-13T06:42:58.007 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_objects": 0, 2024-09-13T06:42:58.008 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-13T06:42:58.008 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-13T06:42:58.008 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-13T06:42:58.008 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_flush_age": 0, 2024-09-13T06:42:58.008 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_evict_age": 0, 2024-09-13T06:42:58.008 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profile": "", 2024-09-13T06:42:58.008 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_params": { 2024-09-13T06:42:58.008 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "none" 2024-09-13T06:42:58.008 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.008 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_period": 0, 2024-09-13T06:42:58.008 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_count": 0, 2024-09-13T06:42:58.008 INFO:teuthology.orchestra.run.smithi081.stdout: "use_gmt_hitset": true, 2024-09-13T06:42:58.008 INFO:teuthology.orchestra.run.smithi081.stdout: "min_read_recency_for_promote": 0, 2024-09-13T06:42:58.008 INFO:teuthology.orchestra.run.smithi081.stdout: "min_write_recency_for_promote": 0, 2024-09-13T06:42:58.009 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_grade_decay_rate": 0, 2024-09-13T06:42:58.009 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_search_last_n": 0, 2024-09-13T06:42:58.009 INFO:teuthology.orchestra.run.smithi081.stdout: "grade_table": [], 2024-09-13T06:42:58.009 INFO:teuthology.orchestra.run.smithi081.stdout: "stripe_width": 0, 2024-09-13T06:42:58.009 INFO:teuthology.orchestra.run.smithi081.stdout: "expected_num_objects": 0, 2024-09-13T06:42:58.009 INFO:teuthology.orchestra.run.smithi081.stdout: "fast_read": false, 2024-09-13T06:42:58.009 INFO:teuthology.orchestra.run.smithi081.stdout: "options": {}, 2024-09-13T06:42:58.009 INFO:teuthology.orchestra.run.smithi081.stdout: "application_metadata": { 2024-09-13T06:42:58.009 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd": {} 2024-09-13T06:42:58.009 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.009 INFO:teuthology.orchestra.run.smithi081.stdout: "read_balance": { 2024-09-13T06:42:58.009 INFO:teuthology.orchestra.run.smithi081.stdout: "score_acting": 2.630000114440918, 2024-09-13T06:42:58.009 INFO:teuthology.orchestra.run.smithi081.stdout: "score_stable": 2.630000114440918, 2024-09-13T06:42:58.010 INFO:teuthology.orchestra.run.smithi081.stdout: "optimal_score": 1, 2024-09-13T06:42:58.010 INFO:teuthology.orchestra.run.smithi081.stdout: "raw_score_acting": 2.630000114440918, 2024-09-13T06:42:58.010 INFO:teuthology.orchestra.run.smithi081.stdout: "raw_score_stable": 2.630000114440918, 2024-09-13T06:42:58.010 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity_weighted": 0.66389274597167969, 2024-09-13T06:42:58.010 INFO:teuthology.orchestra.run.smithi081.stdout: "average_primary_affinity": 0.75999999046325684, 2024-09-13T06:42:58.010 INFO:teuthology.orchestra.run.smithi081.stdout: "average_primary_affinity_weighted": 0.6600000262260437 2024-09-13T06:42:58.010 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:58.010 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.010 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.010 INFO:teuthology.orchestra.run.smithi081.stdout: "pool": 3, 2024-09-13T06:42:58.010 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_name": "pool_client.0", 2024-09-13T06:42:58.010 INFO:teuthology.orchestra.run.smithi081.stdout: "create_time": "2024-09-13T06:39:25.648942+0000", 2024-09-13T06:42:58.010 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 8193, 2024-09-13T06:42:58.010 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-13T06:42:58.011 INFO:teuthology.orchestra.run.smithi081.stdout: "type": 1, 2024-09-13T06:42:58.011 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 2, 2024-09-13T06:42:58.011 INFO:teuthology.orchestra.run.smithi081.stdout: "min_size": 1, 2024-09-13T06:42:58.011 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_rule": 0, 2024-09-13T06:42:58.011 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_count": 0, 2024-09-13T06:42:58.011 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_target": 0, 2024-09-13T06:42:58.011 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_barrier": 0, 2024-09-13T06:42:58.011 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-13T06:42:58.011 INFO:teuthology.orchestra.run.smithi081.stdout: "object_hash": 2, 2024-09-13T06:42:58.011 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_mode": "off", 2024-09-13T06:42:58.011 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num": 32, 2024-09-13T06:42:58.011 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num": 32, 2024-09-13T06:42:58.011 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num_target": 32, 2024-09-13T06:42:58.012 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_target": 32, 2024-09-13T06:42:58.012 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_pending": 32, 2024-09-13T06:42:58.012 INFO:teuthology.orchestra.run.smithi081.stdout: "last_pg_merge_meta": { 2024-09-13T06:42:58.012 INFO:teuthology.orchestra.run.smithi081.stdout: "source_pgid": "0.0", 2024-09-13T06:42:58.012 INFO:teuthology.orchestra.run.smithi081.stdout: "ready_epoch": 0, 2024-09-13T06:42:58.012 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_started": 0, 2024-09-13T06:42:58.012 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_clean": 0, 2024-09-13T06:42:58.012 INFO:teuthology.orchestra.run.smithi081.stdout: "source_version": "0'0", 2024-09-13T06:42:58.012 INFO:teuthology.orchestra.run.smithi081.stdout: "target_version": "0'0" 2024-09-13T06:42:58.012 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.012 INFO:teuthology.orchestra.run.smithi081.stdout: "last_change": "214", 2024-09-13T06:42:58.012 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend": "0", 2024-09-13T06:42:58.012 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-13T06:42:58.013 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_preluminous": "0", 2024-09-13T06:42:58.013 INFO:teuthology.orchestra.run.smithi081.stdout: "auid": 0, 2024-09-13T06:42:58.013 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_mode": "selfmanaged", 2024-09-13T06:42:58.013 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_seq": 127, 2024-09-13T06:42:58.013 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_epoch": 214, 2024-09-13T06:42:58.013 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_snaps": [], 2024-09-13T06:42:58.013 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps": "[]", 2024-09-13T06:42:58.013 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_bytes": 0, 2024-09-13T06:42:58.013 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_objects": 0, 2024-09-13T06:42:58.013 INFO:teuthology.orchestra.run.smithi081.stdout: "tiers": [], 2024-09-13T06:42:58.013 INFO:teuthology.orchestra.run.smithi081.stdout: "tier_of": -1, 2024-09-13T06:42:58.013 INFO:teuthology.orchestra.run.smithi081.stdout: "read_tier": -1, 2024-09-13T06:42:58.014 INFO:teuthology.orchestra.run.smithi081.stdout: "write_tier": -1, 2024-09-13T06:42:58.014 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_mode": "none", 2024-09-13T06:42:58.014 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_bytes": 0, 2024-09-13T06:42:58.014 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_objects": 0, 2024-09-13T06:42:58.014 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-13T06:42:58.014 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-13T06:42:58.014 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-13T06:42:58.014 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_flush_age": 0, 2024-09-13T06:42:58.014 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_evict_age": 0, 2024-09-13T06:42:58.014 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profile": "", 2024-09-13T06:42:58.014 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_params": { 2024-09-13T06:42:58.014 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "none" 2024-09-13T06:42:58.014 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.014 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_period": 0, 2024-09-13T06:42:58.015 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_count": 0, 2024-09-13T06:42:58.015 INFO:teuthology.orchestra.run.smithi081.stdout: "use_gmt_hitset": true, 2024-09-13T06:42:58.015 INFO:teuthology.orchestra.run.smithi081.stdout: "min_read_recency_for_promote": 0, 2024-09-13T06:42:58.015 INFO:teuthology.orchestra.run.smithi081.stdout: "min_write_recency_for_promote": 0, 2024-09-13T06:42:58.015 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_grade_decay_rate": 0, 2024-09-13T06:42:58.015 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_search_last_n": 0, 2024-09-13T06:42:58.015 INFO:teuthology.orchestra.run.smithi081.stdout: "grade_table": [], 2024-09-13T06:42:58.015 INFO:teuthology.orchestra.run.smithi081.stdout: "stripe_width": 0, 2024-09-13T06:42:58.015 INFO:teuthology.orchestra.run.smithi081.stdout: "expected_num_objects": 0, 2024-09-13T06:42:58.015 INFO:teuthology.orchestra.run.smithi081.stdout: "fast_read": false, 2024-09-13T06:42:58.015 INFO:teuthology.orchestra.run.smithi081.stdout: "options": {}, 2024-09-13T06:42:58.015 INFO:teuthology.orchestra.run.smithi081.stdout: "application_metadata": { 2024-09-13T06:42:58.015 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd": {} 2024-09-13T06:42:58.015 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.015 INFO:teuthology.orchestra.run.smithi081.stdout: "read_balance": { 2024-09-13T06:42:58.016 INFO:teuthology.orchestra.run.smithi081.stdout: "score_acting": 13.170000076293945, 2024-09-13T06:42:58.016 INFO:teuthology.orchestra.run.smithi081.stdout: "score_stable": 1.9700000286102295, 2024-09-13T06:42:58.016 INFO:teuthology.orchestra.run.smithi081.stdout: "optimal_score": 1, 2024-09-13T06:42:58.016 INFO:teuthology.orchestra.run.smithi081.stdout: "raw_score_acting": 13.170000076293945, 2024-09-13T06:42:58.016 INFO:teuthology.orchestra.run.smithi081.stdout: "raw_score_stable": 1.9700000286102295, 2024-09-13T06:42:58.016 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity_weighted": 0.66389274597167969, 2024-09-13T06:42:58.016 INFO:teuthology.orchestra.run.smithi081.stdout: "average_primary_affinity": 0.75999999046325684, 2024-09-13T06:42:58.016 INFO:teuthology.orchestra.run.smithi081.stdout: "average_primary_affinity_weighted": 0.6600000262260437, 2024-09-13T06:42:58.016 INFO:teuthology.orchestra.run.smithi081.stdout: "error_message": "pool 3 has acting primaries on OSD(s) with primary affinity 0, read balance score is not accurate" 2024-09-13T06:42:58.016 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:58.016 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:58.016 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-13T06:42:58.016 INFO:teuthology.orchestra.run.smithi081.stdout: "osds": [ 2024-09-13T06:42:58.017 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.017 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 0, 2024-09-13T06:42:58.017 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "54b0a3e4-58ad-4f95-86dc-29a11c9a1964", 2024-09-13T06:42:58.017 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2024-09-13T06:42:58.017 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2024-09-13T06:42:58.017 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2024-09-13T06:42:58.017 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 0, 2024-09-13T06:42:58.017 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2024-09-13T06:42:58.017 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2024-09-13T06:42:58.017 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2024-09-13T06:42:58.017 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 203, 2024-09-13T06:42:58.017 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2024-09-13T06:42:58.017 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2024-09-13T06:42:58.018 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-13T06:42:58.018 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:42:58.018 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.018 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:42:58.018 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6808", 2024-09-13T06:42:58.018 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 1904727940 2024-09-13T06:42:58.018 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.018 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.018 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:42:58.018 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6809", 2024-09-13T06:42:58.018 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 1904727940 2024-09-13T06:42:58.018 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:58.018 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:58.018 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.018 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2024-09-13T06:42:58.019 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:42:58.019 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.019 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:42:58.019 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6810", 2024-09-13T06:42:58.019 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 1904727940 2024-09-13T06:42:58.019 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.019 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.019 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:42:58.019 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6811", 2024-09-13T06:42:58.019 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 1904727940 2024-09-13T06:42:58.019 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:58.019 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:58.019 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.020 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2024-09-13T06:42:58.020 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:42:58.020 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.020 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:42:58.020 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6814", 2024-09-13T06:42:58.020 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 1904727940 2024-09-13T06:42:58.020 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.020 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.020 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:42:58.020 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6815", 2024-09-13T06:42:58.020 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 1904727940 2024-09-13T06:42:58.020 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:58.020 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:58.021 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.021 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2024-09-13T06:42:58.021 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:42:58.021 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.021 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:42:58.021 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6812", 2024-09-13T06:42:58.021 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 1904727940 2024-09-13T06:42:58.021 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.021 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.021 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:42:58.021 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6813", 2024-09-13T06:42:58.021 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 1904727940 2024-09-13T06:42:58.021 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:58.022 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:58.022 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.022 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6809/1904727940", 2024-09-13T06:42:58.022 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.81:6811/1904727940", 2024-09-13T06:42:58.022 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.81:6815/1904727940", 2024-09-13T06:42:58.022 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.81:6813/1904727940", 2024-09-13T06:42:58.022 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2024-09-13T06:42:58.022 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2024-09-13T06:42:58.022 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2024-09-13T06:42:58.022 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:58.022 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.022 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.022 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 1, 2024-09-13T06:42:58.022 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "a6dba5b9-c833-465e-a8a5-1741528b24c0", 2024-09-13T06:42:58.022 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2024-09-13T06:42:58.022 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2024-09-13T06:42:58.023 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2024-09-13T06:42:58.023 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2024-09-13T06:42:58.023 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2024-09-13T06:42:58.023 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2024-09-13T06:42:58.023 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2024-09-13T06:42:58.023 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 189, 2024-09-13T06:42:58.023 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2024-09-13T06:42:58.023 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2024-09-13T06:42:58.023 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-13T06:42:58.023 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:42:58.023 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.023 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:42:58.023 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6817", 2024-09-13T06:42:58.023 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 738205570 2024-09-13T06:42:58.024 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.024 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.024 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:42:58.024 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6819", 2024-09-13T06:42:58.024 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 738205570 2024-09-13T06:42:58.024 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:58.024 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:58.024 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.024 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2024-09-13T06:42:58.024 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:42:58.024 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.024 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:42:58.024 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6822", 2024-09-13T06:42:58.024 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 738205570 2024-09-13T06:42:58.024 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.025 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.025 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:42:58.025 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6824", 2024-09-13T06:42:58.025 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 738205570 2024-09-13T06:42:58.025 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:58.025 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:58.025 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.025 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2024-09-13T06:42:58.025 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:42:58.025 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.025 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:42:58.025 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6830", 2024-09-13T06:42:58.025 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 738205570 2024-09-13T06:42:58.025 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.026 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.026 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:42:58.026 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6831", 2024-09-13T06:42:58.026 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 738205570 2024-09-13T06:42:58.026 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:58.026 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:58.026 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.026 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2024-09-13T06:42:58.026 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:42:58.026 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.026 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:42:58.026 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6826", 2024-09-13T06:42:58.026 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 738205570 2024-09-13T06:42:58.026 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.027 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.027 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:42:58.027 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6829", 2024-09-13T06:42:58.027 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 738205570 2024-09-13T06:42:58.027 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:58.027 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:58.027 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.027 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6819/738205570", 2024-09-13T06:42:58.027 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.81:6824/738205570", 2024-09-13T06:42:58.027 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.81:6831/738205570", 2024-09-13T06:42:58.027 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.81:6829/738205570", 2024-09-13T06:42:58.027 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2024-09-13T06:42:58.027 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2024-09-13T06:42:58.027 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2024-09-13T06:42:58.027 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:58.028 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.028 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.028 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 2, 2024-09-13T06:42:58.028 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "6c45097e-44a2-454f-80a4-0fe879ccd52f", 2024-09-13T06:42:58.028 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2024-09-13T06:42:58.028 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2024-09-13T06:42:58.028 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2024-09-13T06:42:58.028 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2024-09-13T06:42:58.028 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2024-09-13T06:42:58.028 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2024-09-13T06:42:58.028 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2024-09-13T06:42:58.028 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 190, 2024-09-13T06:42:58.028 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2024-09-13T06:42:58.028 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2024-09-13T06:42:58.029 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-13T06:42:58.029 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:42:58.029 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.029 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:42:58.029 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6816", 2024-09-13T06:42:58.029 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 3558674335 2024-09-13T06:42:58.029 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.029 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.029 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:42:58.030 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6818", 2024-09-13T06:42:58.030 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 3558674335 2024-09-13T06:42:58.030 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:58.030 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:58.030 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.030 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2024-09-13T06:42:58.030 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:42:58.030 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.030 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:42:58.030 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6820", 2024-09-13T06:42:58.030 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 3558674335 2024-09-13T06:42:58.030 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.030 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.031 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:42:58.031 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6821", 2024-09-13T06:42:58.031 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 3558674335 2024-09-13T06:42:58.031 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:58.031 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:58.031 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.031 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2024-09-13T06:42:58.031 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:42:58.031 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.031 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:42:58.031 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6827", 2024-09-13T06:42:58.031 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 3558674335 2024-09-13T06:42:58.031 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.031 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.032 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:42:58.032 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6828", 2024-09-13T06:42:58.032 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 3558674335 2024-09-13T06:42:58.032 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:58.032 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:58.032 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.032 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2024-09-13T06:42:58.032 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:42:58.032 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.032 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:42:58.032 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6823", 2024-09-13T06:42:58.032 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 3558674335 2024-09-13T06:42:58.032 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.033 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.033 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:42:58.033 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6825", 2024-09-13T06:42:58.033 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 3558674335 2024-09-13T06:42:58.033 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:58.033 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:58.033 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.033 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6818/3558674335", 2024-09-13T06:42:58.033 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.81:6821/3558674335", 2024-09-13T06:42:58.033 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.81:6828/3558674335", 2024-09-13T06:42:58.033 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.81:6825/3558674335", 2024-09-13T06:42:58.033 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2024-09-13T06:42:58.033 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2024-09-13T06:42:58.033 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2024-09-13T06:42:58.034 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:58.034 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.034 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.034 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 3, 2024-09-13T06:42:58.034 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "31952760-06f3-4618-a5c4-f5c4fed3aadb", 2024-09-13T06:42:58.034 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2024-09-13T06:42:58.034 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2024-09-13T06:42:58.034 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2024-09-13T06:42:58.034 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2024-09-13T06:42:58.034 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2024-09-13T06:42:58.034 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2024-09-13T06:42:58.034 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2024-09-13T06:42:58.034 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 191, 2024-09-13T06:42:58.034 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2024-09-13T06:42:58.034 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2024-09-13T06:42:58.035 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-13T06:42:58.035 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:42:58.035 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.035 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:42:58.035 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6800", 2024-09-13T06:42:58.035 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 1886327229 2024-09-13T06:42:58.035 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.035 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.035 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:42:58.035 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6801", 2024-09-13T06:42:58.035 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 1886327229 2024-09-13T06:42:58.035 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:58.035 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:58.035 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.036 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2024-09-13T06:42:58.036 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:42:58.036 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.036 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:42:58.036 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6802", 2024-09-13T06:42:58.036 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 1886327229 2024-09-13T06:42:58.036 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.036 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.036 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:42:58.036 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6803", 2024-09-13T06:42:58.036 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 1886327229 2024-09-13T06:42:58.036 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:58.036 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:58.036 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.037 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2024-09-13T06:42:58.037 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:42:58.037 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.037 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:42:58.037 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6806", 2024-09-13T06:42:58.037 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 1886327229 2024-09-13T06:42:58.037 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.037 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.037 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:42:58.037 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6807", 2024-09-13T06:42:58.037 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 1886327229 2024-09-13T06:42:58.037 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:58.037 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:58.038 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.038 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2024-09-13T06:42:58.038 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:42:58.038 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.038 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:42:58.038 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6804", 2024-09-13T06:42:58.038 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 1886327229 2024-09-13T06:42:58.038 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.038 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.038 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:42:58.038 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6805", 2024-09-13T06:42:58.038 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 1886327229 2024-09-13T06:42:58.038 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:58.039 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:58.039 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.039 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6801/1886327229", 2024-09-13T06:42:58.039 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.81:6803/1886327229", 2024-09-13T06:42:58.039 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.81:6807/1886327229", 2024-09-13T06:42:58.039 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.81:6805/1886327229", 2024-09-13T06:42:58.039 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2024-09-13T06:42:58.039 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2024-09-13T06:42:58.039 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2024-09-13T06:42:58.039 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:58.039 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.039 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.039 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 4, 2024-09-13T06:42:58.040 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "c9bd2751-c836-43dc-b844-e13678cb2fd9", 2024-09-13T06:42:58.040 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2024-09-13T06:42:58.040 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2024-09-13T06:42:58.040 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0.58685302734375, 2024-09-13T06:42:58.040 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 0.649200439453125, 2024-09-13T06:42:58.040 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2024-09-13T06:42:58.040 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2024-09-13T06:42:58.040 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2024-09-13T06:42:58.040 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 191, 2024-09-13T06:42:58.040 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2024-09-13T06:42:58.040 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2024-09-13T06:42:58.040 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-13T06:42:58.040 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:42:58.041 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.041 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:42:58.041 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6817", 2024-09-13T06:42:58.041 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2184515621 2024-09-13T06:42:58.041 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.041 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.041 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:42:58.041 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6819", 2024-09-13T06:42:58.041 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2184515621 2024-09-13T06:42:58.041 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:58.041 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:58.041 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.041 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2024-09-13T06:42:58.042 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:42:58.042 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.042 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:42:58.042 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6820", 2024-09-13T06:42:58.042 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2184515621 2024-09-13T06:42:58.042 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.042 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.042 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:42:58.042 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6822", 2024-09-13T06:42:58.042 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2184515621 2024-09-13T06:42:58.042 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:58.042 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:58.042 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.043 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2024-09-13T06:42:58.043 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:42:58.043 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.043 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:42:58.043 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6827", 2024-09-13T06:42:58.043 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2184515621 2024-09-13T06:42:58.043 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.043 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.043 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:42:58.043 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6829", 2024-09-13T06:42:58.043 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2184515621 2024-09-13T06:42:58.043 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:58.043 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:58.043 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.044 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2024-09-13T06:42:58.044 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:42:58.044 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.044 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:42:58.044 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6824", 2024-09-13T06:42:58.044 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2184515621 2024-09-13T06:42:58.044 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.044 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.044 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:42:58.044 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6826", 2024-09-13T06:42:58.044 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2184515621 2024-09-13T06:42:58.044 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:58.044 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:58.044 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.045 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.139:6819/2184515621", 2024-09-13T06:42:58.045 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.139:6822/2184515621", 2024-09-13T06:42:58.045 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.139:6829/2184515621", 2024-09-13T06:42:58.045 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.139:6826/2184515621", 2024-09-13T06:42:58.045 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2024-09-13T06:42:58.045 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2024-09-13T06:42:58.045 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2024-09-13T06:42:58.045 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:58.045 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.045 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.045 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 5, 2024-09-13T06:42:58.045 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "2971b93a-6c9f-4b77-b526-4eac788fabf9", 2024-09-13T06:42:58.045 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2024-09-13T06:42:58.045 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2024-09-13T06:42:58.046 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2024-09-13T06:42:58.046 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 0.115264892578125, 2024-09-13T06:42:58.046 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2024-09-13T06:42:58.046 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2024-09-13T06:42:58.046 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2024-09-13T06:42:58.046 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 203, 2024-09-13T06:42:58.046 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2024-09-13T06:42:58.046 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2024-09-13T06:42:58.046 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-13T06:42:58.046 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:42:58.046 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.046 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:42:58.046 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6816", 2024-09-13T06:42:58.046 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 3982901834 2024-09-13T06:42:58.047 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.047 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.047 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:42:58.047 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6818", 2024-09-13T06:42:58.047 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 3982901834 2024-09-13T06:42:58.047 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:58.047 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:58.047 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.047 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2024-09-13T06:42:58.047 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:42:58.047 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.047 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:42:58.047 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6821", 2024-09-13T06:42:58.047 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 3982901834 2024-09-13T06:42:58.048 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.048 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.048 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:42:58.048 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6823", 2024-09-13T06:42:58.048 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 3982901834 2024-09-13T06:42:58.048 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:58.048 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:58.048 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.048 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2024-09-13T06:42:58.048 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:42:58.048 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.048 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:42:58.048 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6830", 2024-09-13T06:42:58.049 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 3982901834 2024-09-13T06:42:58.049 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.049 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.049 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:42:58.049 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6831", 2024-09-13T06:42:58.049 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 3982901834 2024-09-13T06:42:58.049 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:58.049 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:58.049 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.049 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2024-09-13T06:42:58.049 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:42:58.049 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.049 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:42:58.049 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6825", 2024-09-13T06:42:58.049 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 3982901834 2024-09-13T06:42:58.050 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.050 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.050 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:42:58.050 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6828", 2024-09-13T06:42:58.050 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 3982901834 2024-09-13T06:42:58.050 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:58.050 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:58.050 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.050 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.139:6818/3982901834", 2024-09-13T06:42:58.050 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.139:6823/3982901834", 2024-09-13T06:42:58.050 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.139:6831/3982901834", 2024-09-13T06:42:58.050 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.139:6828/3982901834", 2024-09-13T06:42:58.050 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2024-09-13T06:42:58.050 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2024-09-13T06:42:58.051 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2024-09-13T06:42:58.051 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:58.051 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.051 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.051 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 6, 2024-09-13T06:42:58.051 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "e1f786ce-579e-48cc-b212-83f881b94184", 2024-09-13T06:42:58.051 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 0, 2024-09-13T06:42:58.051 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 0, 2024-09-13T06:42:58.051 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-13T06:42:58.051 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 0.5466766357421875, 2024-09-13T06:42:58.051 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2024-09-13T06:42:58.051 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2024-09-13T06:42:58.051 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2024-09-13T06:42:58.052 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 170, 2024-09-13T06:42:58.052 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 209, 2024-09-13T06:42:58.052 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2024-09-13T06:42:58.052 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-13T06:42:58.052 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:42:58.052 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.052 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:42:58.052 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6800", 2024-09-13T06:42:58.052 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2283932666 2024-09-13T06:42:58.052 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.052 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.052 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:42:58.052 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6801", 2024-09-13T06:42:58.053 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2283932666 2024-09-13T06:42:58.053 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:58.053 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:58.053 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.053 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2024-09-13T06:42:58.053 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:42:58.053 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.053 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:42:58.053 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6802", 2024-09-13T06:42:58.053 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2283932666 2024-09-13T06:42:58.053 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.053 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.053 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:42:58.053 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6803", 2024-09-13T06:42:58.054 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2283932666 2024-09-13T06:42:58.054 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:58.054 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:58.054 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.054 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2024-09-13T06:42:58.054 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:42:58.054 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.054 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:42:58.054 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6806", 2024-09-13T06:42:58.054 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2283932666 2024-09-13T06:42:58.054 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.054 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.054 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:42:58.055 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6807", 2024-09-13T06:42:58.055 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2283932666 2024-09-13T06:42:58.055 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:58.055 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:58.055 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.055 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2024-09-13T06:42:58.055 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:42:58.055 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.055 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:42:58.055 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6804", 2024-09-13T06:42:58.055 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2283932666 2024-09-13T06:42:58.055 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.055 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.056 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:42:58.056 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6805", 2024-09-13T06:42:58.056 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2283932666 2024-09-13T06:42:58.056 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:58.056 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:58.056 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.056 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.139:6801/2283932666", 2024-09-13T06:42:58.056 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.139:6803/2283932666", 2024-09-13T06:42:58.056 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.139:6807/2283932666", 2024-09-13T06:42:58.056 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.139:6805/2283932666", 2024-09-13T06:42:58.056 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2024-09-13T06:42:58.056 INFO:teuthology.orchestra.run.smithi081.stdout: "exists" 2024-09-13T06:42:58.056 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:58.056 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.057 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.057 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 7, 2024-09-13T06:42:58.057 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "a287ddf6-84eb-4225-b267-25eee1657625", 2024-09-13T06:42:58.057 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2024-09-13T06:42:58.057 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2024-09-13T06:42:58.057 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2024-09-13T06:42:58.057 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2024-09-13T06:42:58.057 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 13, 2024-09-13T06:42:58.057 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 121, 2024-09-13T06:42:58.057 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 187, 2024-09-13T06:42:58.057 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 192, 2024-09-13T06:42:58.057 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 122, 2024-09-13T06:42:58.057 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2024-09-13T06:42:58.058 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-13T06:42:58.058 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:42:58.058 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.058 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:42:58.058 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6808", 2024-09-13T06:42:58.058 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 105054579 2024-09-13T06:42:58.058 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.058 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.058 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:42:58.058 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6809", 2024-09-13T06:42:58.058 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 105054579 2024-09-13T06:42:58.058 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:58.058 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:58.059 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.059 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2024-09-13T06:42:58.059 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:42:58.059 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.059 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:42:58.059 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6810", 2024-09-13T06:42:58.059 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 105054579 2024-09-13T06:42:58.059 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.059 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.059 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:42:58.059 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6811", 2024-09-13T06:42:58.059 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 105054579 2024-09-13T06:42:58.059 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:58.059 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:58.060 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.060 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2024-09-13T06:42:58.060 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:42:58.060 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.060 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:42:58.060 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6814", 2024-09-13T06:42:58.060 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 105054579 2024-09-13T06:42:58.060 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.060 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.060 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:42:58.060 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6815", 2024-09-13T06:42:58.060 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 105054579 2024-09-13T06:42:58.060 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:58.060 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:58.061 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.061 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2024-09-13T06:42:58.061 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:42:58.061 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.061 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:42:58.061 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6812", 2024-09-13T06:42:58.061 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 105054579 2024-09-13T06:42:58.061 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.061 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.061 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:42:58.061 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6813", 2024-09-13T06:42:58.061 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 105054579 2024-09-13T06:42:58.061 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:58.062 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:58.062 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.062 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.139:6809/105054579", 2024-09-13T06:42:58.062 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.139:6811/105054579", 2024-09-13T06:42:58.062 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.139:6815/105054579", 2024-09-13T06:42:58.062 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.139:6813/105054579", 2024-09-13T06:42:58.062 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2024-09-13T06:42:58.062 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2024-09-13T06:42:58.062 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2024-09-13T06:42:58.062 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:58.062 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:58.062 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-13T06:42:58.062 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_xinfo": [ 2024-09-13T06:42:58.063 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.063 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 0, 2024-09-13T06:42:58.063 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2024-09-13T06:42:58.063 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2024-09-13T06:42:58.063 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2024-09-13T06:42:58.063 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138322906710015, 2024-09-13T06:42:58.063 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2024-09-13T06:42:58.063 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2024-09-13T06:39:05.476871+0000", 2024-09-13T06:42:58.063 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2024-09-13T06:42:58.063 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.063 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.063 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 1, 2024-09-13T06:42:58.063 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2024-09-13T06:42:58.064 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2024-09-13T06:42:58.064 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2024-09-13T06:42:58.064 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138322906710015, 2024-09-13T06:42:58.064 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2024-09-13T06:42:58.064 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2024-09-13T06:39:05.455183+0000", 2024-09-13T06:42:58.064 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2024-09-13T06:42:58.064 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.064 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.064 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 2, 2024-09-13T06:42:58.064 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2024-09-13T06:42:58.064 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2024-09-13T06:42:58.064 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2024-09-13T06:42:58.064 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138322906710015, 2024-09-13T06:42:58.065 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2024-09-13T06:42:58.065 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2024-09-13T06:39:05.504853+0000", 2024-09-13T06:42:58.065 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2024-09-13T06:42:58.065 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.068 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.068 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 3, 2024-09-13T06:42:58.068 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2024-09-13T06:42:58.068 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2024-09-13T06:42:58.068 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2024-09-13T06:42:58.068 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138322906710015, 2024-09-13T06:42:58.068 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2024-09-13T06:42:58.068 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2024-09-13T06:39:05.372429+0000", 2024-09-13T06:42:58.069 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2024-09-13T06:42:58.069 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.069 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.069 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 4, 2024-09-13T06:42:58.069 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2024-09-13T06:42:58.069 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2024-09-13T06:42:58.069 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2024-09-13T06:42:58.069 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138322906710015, 2024-09-13T06:42:58.069 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2024-09-13T06:42:58.069 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2024-09-13T06:39:05.421023+0000", 2024-09-13T06:42:58.069 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2024-09-13T06:42:58.070 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.070 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.070 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 5, 2024-09-13T06:42:58.070 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2024-09-13T06:42:58.070 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2024-09-13T06:42:58.070 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2024-09-13T06:42:58.070 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138322906710015, 2024-09-13T06:42:58.070 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2024-09-13T06:42:58.070 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2024-09-13T06:39:05.477489+0000", 2024-09-13T06:42:58.070 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2024-09-13T06:42:58.070 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.070 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.070 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 6, 2024-09-13T06:42:58.071 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2024-09-13T06:42:58.071 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2024-09-13T06:42:58.071 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2024-09-13T06:42:58.071 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138322906710015, 2024-09-13T06:42:58.071 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 65536, 2024-09-13T06:42:58.071 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2024-09-13T06:39:05.314700+0000", 2024-09-13T06:42:58.071 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 209 2024-09-13T06:42:58.071 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.071 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.071 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 7, 2024-09-13T06:42:58.071 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2024-09-13T06:42:58.071 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2024-09-13T06:42:58.071 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2024-09-13T06:42:58.071 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138322906710015, 2024-09-13T06:42:58.072 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2024-09-13T06:42:58.072 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2024-09-13T06:39:05.462229+0000", 2024-09-13T06:42:58.072 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 122 2024-09-13T06:42:58.072 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:58.072 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-13T06:42:58.072 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_upmap": [ 2024-09-13T06:42:58.072 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.072 INFO:teuthology.orchestra.run.smithi081.stdout: "pgid": "3.1a", 2024-09-13T06:42:58.072 INFO:teuthology.orchestra.run.smithi081.stdout: "osds": [ 2024-09-13T06:42:58.072 INFO:teuthology.orchestra.run.smithi081.stdout: 2, 2024-09-13T06:42:58.072 INFO:teuthology.orchestra.run.smithi081.stdout: 6 2024-09-13T06:42:58.072 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:58.072 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:58.072 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-13T06:42:58.073 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_upmap_items": [], 2024-09-13T06:42:58.073 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_upmap_primaries": [], 2024-09-13T06:42:58.073 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_temp": [], 2024-09-13T06:42:58.073 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_temp": [], 2024-09-13T06:42:58.073 INFO:teuthology.orchestra.run.smithi081.stdout: "blocklist": {}, 2024-09-13T06:42:58.073 INFO:teuthology.orchestra.run.smithi081.stdout: "range_blocklist": {}, 2024-09-13T06:42:58.073 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profiles": { 2024-09-13T06:42:58.073 INFO:teuthology.orchestra.run.smithi081.stdout: "default": { 2024-09-13T06:42:58.073 INFO:teuthology.orchestra.run.smithi081.stdout: "crush-failure-domain": "osd", 2024-09-13T06:42:58.073 INFO:teuthology.orchestra.run.smithi081.stdout: "k": "2", 2024-09-13T06:42:58.073 INFO:teuthology.orchestra.run.smithi081.stdout: "m": "1", 2024-09-13T06:42:58.073 INFO:teuthology.orchestra.run.smithi081.stdout: "plugin": "jerasure", 2024-09-13T06:42:58.073 INFO:teuthology.orchestra.run.smithi081.stdout: "technique": "reed_sol_van" 2024-09-13T06:42:58.073 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:58.074 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.074 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps_queue": [ 2024-09-13T06:42:58.074 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.074 INFO:teuthology.orchestra.run.smithi081.stdout: "pool": 3, 2024-09-13T06:42:58.074 INFO:teuthology.orchestra.run.smithi081.stdout: "snaps": [ 2024-09-13T06:42:58.074 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.074 INFO:teuthology.orchestra.run.smithi081.stdout: "begin": 122, 2024-09-13T06:42:58.074 INFO:teuthology.orchestra.run.smithi081.stdout: "length": 1 2024-09-13T06:42:58.074 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.074 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.074 INFO:teuthology.orchestra.run.smithi081.stdout: "begin": 125, 2024-09-13T06:42:58.074 INFO:teuthology.orchestra.run.smithi081.stdout: "length": 1 2024-09-13T06:42:58.074 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:58.074 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:58.075 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:58.075 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-13T06:42:58.075 INFO:teuthology.orchestra.run.smithi081.stdout: "new_removed_snaps": [], 2024-09-13T06:42:58.075 INFO:teuthology.orchestra.run.smithi081.stdout: "new_purged_snaps": [], 2024-09-13T06:42:58.075 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_node_flags": {}, 2024-09-13T06:42:58.075 INFO:teuthology.orchestra.run.smithi081.stdout: "device_class_flags": {}, 2024-09-13T06:42:58.075 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": { 2024-09-13T06:42:58.075 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode_enabled": false, 2024-09-13T06:42:58.075 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_bucket_count": 0, 2024-09-13T06:42:58.075 INFO:teuthology.orchestra.run.smithi081.stdout: "degraded_stretch_mode": 0, 2024-09-13T06:42:58.075 INFO:teuthology.orchestra.run.smithi081.stdout: "recovering_stretch_mode": 0, 2024-09-13T06:42:58.075 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode_bucket": 0 2024-09-13T06:42:58.075 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:58.075 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:42:58.078 INFO:tasks.thrashosds.thrasher:j is {'epoch': 214, 'fsid': 'e5612297-d004-4957-927e-afa37f30d6cf', 'created': '2024-09-13T06:38:56.670231+0000', 'modified': '2024-09-13T06:42:57.770474+0000', 'last_up_change': '2024-09-13T06:42:51.723548+0000', 'last_in_change': '2024-09-13T06:42:16.419321+0000', 'flags': 'nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5804032, 'flags_set': ['nodeep-scrub', 'pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 5, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 3, 'max_osd': 8, 'require_min_compat_client': 'luminous', 'min_compat_client': 'luminous', 'require_osd_release': 'reef', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T06:39:09.600726+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 6.900000095367432, 'score_stable': 6.900000095367432, 'optimal_score': 0.28999999165534973, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 0.6638927459716797, 'average_primary_affinity': 0.7599999904632568, 'average_primary_affinity_weighted': 0.6600000262260437}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-09-13T06:39:15.802118+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 3, 'snap_epoch': 20, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2.630000114440918, 'score_stable': 2.630000114440918, 'optimal_score': 1, 'raw_score_acting': 2.630000114440918, 'raw_score_stable': 2.630000114440918, 'primary_affinity_weighted': 0.6638927459716797, 'average_primary_affinity': 0.7599999904632568, 'average_primary_affinity_weighted': 0.6600000262260437}}, {'pool': 3, 'pool_name': 'pool_client.0', 'create_time': '2024-09-13T06:39:25.648942+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '214', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 127, 'snap_epoch': 214, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 13.170000076293945, 'score_stable': 1.9700000286102295, 'optimal_score': 1, 'raw_score_acting': 13.170000076293945, 'raw_score_stable': 1.9700000286102295, 'primary_affinity_weighted': 0.6638927459716797, 'average_primary_affinity': 0.7599999904632568, 'average_primary_affinity_weighted': 0.6600000262260437, 'error_message': 'pool 3 has acting primaries on OSD(s) with primary affinity 0, read balance score is not accurate'}}], 'osds': [{'osd': 0, 'uuid': '54b0a3e4-58ad-4f95-86dc-29a11c9a1964', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 0, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 203, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6808', 'nonce': 1904727940}, {'type': 'v1', 'addr': '172.21.15.81:6809', 'nonce': 1904727940}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6810', 'nonce': 1904727940}, {'type': 'v1', 'addr': '172.21.15.81:6811', 'nonce': 1904727940}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6814', 'nonce': 1904727940}, {'type': 'v1', 'addr': '172.21.15.81:6815', 'nonce': 1904727940}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6812', 'nonce': 1904727940}, {'type': 'v1', 'addr': '172.21.15.81:6813', 'nonce': 1904727940}]}, 'public_addr': '172.21.15.81:6809/1904727940', 'cluster_addr': '172.21.15.81:6811/1904727940', 'heartbeat_back_addr': '172.21.15.81:6815/1904727940', 'heartbeat_front_addr': '172.21.15.81:6813/1904727940', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': 'a6dba5b9-c833-465e-a8a5-1741528b24c0', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 189, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6817', 'nonce': 738205570}, {'type': 'v1', 'addr': '172.21.15.81:6819', 'nonce': 738205570}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6822', 'nonce': 738205570}, {'type': 'v1', 'addr': '172.21.15.81:6824', 'nonce': 738205570}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6830', 'nonce': 738205570}, {'type': 'v1', 'addr': '172.21.15.81:6831', 'nonce': 738205570}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6826', 'nonce': 738205570}, {'type': 'v1', 'addr': '172.21.15.81:6829', 'nonce': 738205570}]}, 'public_addr': '172.21.15.81:6819/738205570', 'cluster_addr': '172.21.15.81:6824/738205570', 'heartbeat_back_addr': '172.21.15.81:6831/738205570', 'heartbeat_front_addr': '172.21.15.81:6829/738205570', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': '6c45097e-44a2-454f-80a4-0fe879ccd52f', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 190, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6816', 'nonce': 3558674335}, {'type': 'v1', 'addr': '172.21.15.81:6818', 'nonce': 3558674335}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6820', 'nonce': 3558674335}, {'type': 'v1', 'addr': '172.21.15.81:6821', 'nonce': 3558674335}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6827', 'nonce': 3558674335}, {'type': 'v1', 'addr': '172.21.15.81:6828', 'nonce': 3558674335}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6823', 'nonce': 3558674335}, {'type': 'v1', 'addr': '172.21.15.81:6825', 'nonce': 3558674335}]}, 'public_addr': '172.21.15.81:6818/3558674335', 'cluster_addr': '172.21.15.81:6821/3558674335', 'heartbeat_back_addr': '172.21.15.81:6828/3558674335', 'heartbeat_front_addr': '172.21.15.81:6825/3558674335', 'state': ['exists', 'up']}, {'osd': 3, 'uuid': '31952760-06f3-4618-a5c4-f5c4fed3aadb', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 191, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6800', 'nonce': 1886327229}, {'type': 'v1', 'addr': '172.21.15.81:6801', 'nonce': 1886327229}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6802', 'nonce': 1886327229}, {'type': 'v1', 'addr': '172.21.15.81:6803', 'nonce': 1886327229}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6806', 'nonce': 1886327229}, {'type': 'v1', 'addr': '172.21.15.81:6807', 'nonce': 1886327229}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6804', 'nonce': 1886327229}, {'type': 'v1', 'addr': '172.21.15.81:6805', 'nonce': 1886327229}]}, 'public_addr': '172.21.15.81:6801/1886327229', 'cluster_addr': '172.21.15.81:6803/1886327229', 'heartbeat_back_addr': '172.21.15.81:6807/1886327229', 'heartbeat_front_addr': '172.21.15.81:6805/1886327229', 'state': ['exists', 'up']}, {'osd': 4, 'uuid': 'c9bd2751-c836-43dc-b844-e13678cb2fd9', 'up': 1, 'in': 1, 'weight': 0.58685302734375, 'primary_affinity': 0.649200439453125, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 191, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.139:6817', 'nonce': 2184515621}, {'type': 'v1', 'addr': '172.21.15.139:6819', 'nonce': 2184515621}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.139:6820', 'nonce': 2184515621}, {'type': 'v1', 'addr': '172.21.15.139:6822', 'nonce': 2184515621}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.139:6827', 'nonce': 2184515621}, {'type': 'v1', 'addr': '172.21.15.139:6829', 'nonce': 2184515621}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.139:6824', 'nonce': 2184515621}, {'type': 'v1', 'addr': '172.21.15.139:6826', 'nonce': 2184515621}]}, 'public_addr': '172.21.15.139:6819/2184515621', 'cluster_addr': '172.21.15.139:6822/2184515621', 'heartbeat_back_addr': '172.21.15.139:6829/2184515621', 'heartbeat_front_addr': '172.21.15.139:6826/2184515621', 'state': ['exists', 'up']}, {'osd': 5, 'uuid': '2971b93a-6c9f-4b77-b526-4eac788fabf9', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 0.115264892578125, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 203, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.139:6816', 'nonce': 3982901834}, {'type': 'v1', 'addr': '172.21.15.139:6818', 'nonce': 3982901834}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.139:6821', 'nonce': 3982901834}, {'type': 'v1', 'addr': '172.21.15.139:6823', 'nonce': 3982901834}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.139:6830', 'nonce': 3982901834}, {'type': 'v1', 'addr': '172.21.15.139:6831', 'nonce': 3982901834}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.139:6825', 'nonce': 3982901834}, {'type': 'v1', 'addr': '172.21.15.139:6828', 'nonce': 3982901834}]}, 'public_addr': '172.21.15.139:6818/3982901834', 'cluster_addr': '172.21.15.139:6823/3982901834', 'heartbeat_back_addr': '172.21.15.139:6831/3982901834', 'heartbeat_front_addr': '172.21.15.139:6828/3982901834', 'state': ['exists', 'up']}, {'osd': 6, 'uuid': 'e1f786ce-579e-48cc-b212-83f881b94184', 'up': 0, 'in': 0, 'weight': 0, 'primary_affinity': 0.5466766357421875, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 170, 'down_at': 209, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.139:6800', 'nonce': 2283932666}, {'type': 'v1', 'addr': '172.21.15.139:6801', 'nonce': 2283932666}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.139:6802', 'nonce': 2283932666}, {'type': 'v1', 'addr': '172.21.15.139:6803', 'nonce': 2283932666}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.139:6806', 'nonce': 2283932666}, {'type': 'v1', 'addr': '172.21.15.139:6807', 'nonce': 2283932666}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.139:6804', 'nonce': 2283932666}, {'type': 'v1', 'addr': '172.21.15.139:6805', 'nonce': 2283932666}]}, 'public_addr': '172.21.15.139:6801/2283932666', 'cluster_addr': '172.21.15.139:6803/2283932666', 'heartbeat_back_addr': '172.21.15.139:6807/2283932666', 'heartbeat_front_addr': '172.21.15.139:6805/2283932666', 'state': ['exists']}, {'osd': 7, 'uuid': 'a287ddf6-84eb-4225-b267-25eee1657625', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 13, 'last_clean_end': 121, 'up_from': 187, 'up_thru': 192, 'down_at': 122, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.139:6808', 'nonce': 105054579}, {'type': 'v1', 'addr': '172.21.15.139:6809', 'nonce': 105054579}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.139:6810', 'nonce': 105054579}, {'type': 'v1', 'addr': '172.21.15.139:6811', 'nonce': 105054579}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.139:6814', 'nonce': 105054579}, {'type': 'v1', 'addr': '172.21.15.139:6815', 'nonce': 105054579}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.139:6812', 'nonce': 105054579}, {'type': 'v1', 'addr': '172.21.15.139:6813', 'nonce': 105054579}]}, 'public_addr': '172.21.15.139:6809/105054579', 'cluster_addr': '172.21.15.139:6811/105054579', 'heartbeat_back_addr': '172.21.15.139:6815/105054579', 'heartbeat_front_addr': '172.21.15.139:6813/105054579', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-13T06:39:05.476871+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-13T06:39:05.455183+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-13T06:39:05.504853+0000', 'dead_epoch': 0}, {'osd': 3, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-13T06:39:05.372429+0000', 'dead_epoch': 0}, {'osd': 4, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-13T06:39:05.421023+0000', 'dead_epoch': 0}, {'osd': 5, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-13T06:39:05.477489+0000', 'dead_epoch': 0}, {'osd': 6, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 65536, 'last_purged_snaps_scrub': '2024-09-13T06:39:05.314700+0000', 'dead_epoch': 209}, {'osd': 7, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-13T06:39:05.462229+0000', 'dead_epoch': 122}], 'pg_upmap': [{'pgid': '3.1a', 'osds': [2, 6]}], 'pg_upmap_items': [], 'pg_upmap_primaries': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [{'pool': 3, 'snaps': [{'begin': 122, 'length': 1}, {'begin': 125, 'length': 1}]}], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-09-13T06:42:58.078 INFO:tasks.thrashosds.thrasher:No pg_upmap entries; doing nothing 2024-09-13T06:42:58.079 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:42:58.079 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:42:58.079 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-13T06:42:58.080 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:42:58.076+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:42:58.178 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-13T06:42:58.177+0000 7fa8bb18e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 36790) UID: 0 2024-09-13T06:42:58.238 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:42:58.239 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:42:58.254 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-13T06:42:58.279 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-13T06:42:58.277+0000 7fa8bb18e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 36790) UID: 0 2024-09-13T06:42:58.375 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:42:58.375 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:42:58.380 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-13T06:42:58.380 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:42:58.381+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:42:58.390 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-13T06:42:58.435 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-13T06:42:58.480 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:42:58.480+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:42:58.518 INFO:teuthology.orchestra.run.smithi081.stdout:osd.0: {} 2024-09-13T06:42:58.518 INFO:teuthology.orchestra.run.smithi081.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-13T06:42:58.534 INFO:teuthology.orchestra.run.smithi081.stdout:osd.1: {} 2024-09-13T06:42:58.534 INFO:teuthology.orchestra.run.smithi081.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-13T06:42:58.551 INFO:teuthology.orchestra.run.smithi081.stdout:osd.2: {} 2024-09-13T06:42:58.551 INFO:teuthology.orchestra.run.smithi081.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-13T06:42:58.552 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:42:58.552 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-13T06:42:58.552 INFO:teuthology.orchestra.run.smithi081.stdout: "complaint_time": 30, 2024-09-13T06:42:58.552 INFO:teuthology.orchestra.run.smithi081.stdout: "num_blocked_ops": 0 2024-09-13T06:42:58.552 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:42:58.568 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-13T06:42:58.574 INFO:teuthology.orchestra.run.smithi081.stdout:osd.3: {} 2024-09-13T06:42:58.575 INFO:teuthology.orchestra.run.smithi081.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-13T06:42:58.608 INFO:teuthology.orchestra.run.smithi081.stdout:osd.4: {} 2024-09-13T06:42:58.609 INFO:teuthology.orchestra.run.smithi081.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-13T06:42:58.609 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:42:58.608+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:42:58.642 INFO:teuthology.orchestra.run.smithi081.stdout:osd.5: {} 2024-09-13T06:42:58.643 INFO:teuthology.orchestra.run.smithi081.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-13T06:42:58.643 INFO:teuthology.orchestra.run.smithi081.stderr:Error ENXIO: problem getting command descriptions from osd.6 2024-09-13T06:42:58.677 INFO:teuthology.orchestra.run.smithi081.stdout:osd.7: {} 2024-09-13T06:42:58.677 INFO:teuthology.orchestra.run.smithi081.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-13T06:42:58.685 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-13T06:42:58.686 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-13T06:42:58.686 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:42:58.684+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:42:58.692 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:42:58.692 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 20, 2024-09-13T06:42:58.692 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 600, 2024-09-13T06:42:58.692 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [ 2024-09-13T06:42:58.693 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.693 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:21979 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 14217216~4096 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:42:58.693 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.888811+0000", 2024-09-13T06:42:58.693 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 185.80336813, 2024-09-13T06:42:58.693 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049092969, 2024-09-13T06:42:58.693 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:58.693 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:58.693 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:58.693 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:58.693 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:58.693 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 21979 2024-09-13T06:42:58.693 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.694 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:58.694 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.694 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:58.694 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888811+0000", 2024-09-13T06:42:58.694 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:58.694 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.694 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.694 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:58.694 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888811+0000", 2024-09-13T06:42:58.694 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:58.694 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.694 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.694 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:58.695 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888811+0000", 2024-09-13T06:42:58.695 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:42:58.695 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.695 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.695 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:58.695 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888812+0000", 2024-09-13T06:42:58.695 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.204e-06 2024-09-13T06:42:58.695 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.695 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.695 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:58.695 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888815+0000", 2024-09-13T06:42:58.695 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9359999999999999e-06 2024-09-13T06:42:58.696 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.696 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.696 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:58.696 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888818+0000", 2024-09-13T06:42:58.696 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.7369999999999998e-06 2024-09-13T06:42:58.696 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.696 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.696 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:58.696 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.937663+0000", 2024-09-13T06:42:58.696 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.048844540999999998 2024-09-13T06:42:58.696 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.696 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.697 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:58.697 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.937709+0000", 2024-09-13T06:42:58.697 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6492999999999997e-05 2024-09-13T06:42:58.697 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.697 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.697 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:58.697 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.937904+0000", 2024-09-13T06:42:58.697 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00019526499999999999 2024-09-13T06:42:58.697 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:58.697 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:58.697 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:58.697 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.697 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.698 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:21980 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 14245888~4096 [fadvise_nocache]] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:42:58.698 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.888820+0000", 2024-09-13T06:42:58.698 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 185.80335945300001, 2024-09-13T06:42:58.698 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049357080999999997, 2024-09-13T06:42:58.698 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:58.698 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:58.698 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:58.698 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:58.698 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:58.698 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 21980 2024-09-13T06:42:58.698 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.698 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:58.698 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.699 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:58.699 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888820+0000", 2024-09-13T06:42:58.699 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:58.699 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.699 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.699 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:58.699 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888820+0000", 2024-09-13T06:42:58.699 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:58.699 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.699 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.699 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:58.699 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888820+0000", 2024-09-13T06:42:58.699 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:42:58.700 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.700 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.700 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:58.700 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888821+0000", 2024-09-13T06:42:58.700 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.122e-06 2024-09-13T06:42:58.700 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.700 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.700 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:58.700 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888824+0000", 2024-09-13T06:42:58.700 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.0580000000000002e-06 2024-09-13T06:42:58.700 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.700 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.701 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:58.701 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888827+0000", 2024-09-13T06:42:58.701 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.666e-06 2024-09-13T06:42:58.701 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.701 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.701 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:58.701 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.937935+0000", 2024-09-13T06:42:58.701 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049108329999999999 2024-09-13T06:42:58.701 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.701 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.701 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:58.701 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.937985+0000", 2024-09-13T06:42:58.701 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9694000000000002e-05 2024-09-13T06:42:58.702 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.702 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.702 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:58.702 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.938177+0000", 2024-09-13T06:42:58.702 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00019241899999999999 2024-09-13T06:42:58.702 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:58.702 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:58.702 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:58.702 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.702 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.702 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:21984 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:snapdir [list-snaps] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:42:58.702 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.888829+0000", 2024-09-13T06:42:58.703 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 185.80335067499999, 2024-09-13T06:42:58.703 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049524545000000003, 2024-09-13T06:42:58.703 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:58.703 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:58.703 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:58.703 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:58.703 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:58.703 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 21984 2024-09-13T06:42:58.703 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.703 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:58.703 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.703 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:58.703 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888829+0000", 2024-09-13T06:42:58.703 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:58.704 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.704 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.704 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:58.704 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888829+0000", 2024-09-13T06:42:58.704 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:58.704 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.704 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.704 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:58.704 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888829+0000", 2024-09-13T06:42:58.704 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:42:58.704 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.704 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.704 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:58.705 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888830+0000", 2024-09-13T06:42:58.705 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2529999999999999e-06 2024-09-13T06:42:58.705 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.705 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.705 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:58.705 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888835+0000", 2024-09-13T06:42:58.705 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.4729999999999999e-06 2024-09-13T06:42:58.705 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.705 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.705 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:58.705 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888840+0000", 2024-09-13T06:42:58.705 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0159999999999999e-06 2024-09-13T06:42:58.705 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.706 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.706 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:58.706 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.938199+0000", 2024-09-13T06:42:58.706 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049358974999999999 2024-09-13T06:42:58.706 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.706 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.706 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:58.706 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.938268+0000", 2024-09-13T06:42:58.706 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.8876999999999998e-05 2024-09-13T06:42:58.706 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.706 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.706 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:58.706 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.938353+0000", 2024-09-13T06:42:58.706 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.5155999999999996e-05 2024-09-13T06:42:58.707 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:58.707 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:58.707 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:58.707 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.707 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.707 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:21985 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 12587008~4096 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:42:58.707 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.888858+0000", 2024-09-13T06:42:58.707 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 185.803321525, 2024-09-13T06:42:58.707 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049674347000000001, 2024-09-13T06:42:58.707 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:58.707 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:58.707 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:58.708 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:58.708 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:58.708 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 21985 2024-09-13T06:42:58.708 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.708 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:58.708 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.708 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:58.708 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888858+0000", 2024-09-13T06:42:58.708 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:58.708 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.708 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.708 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:58.708 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888858+0000", 2024-09-13T06:42:58.708 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:58.709 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.709 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.709 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:58.709 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888857+0000", 2024-09-13T06:42:58.709 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:58.709 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.709 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.709 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:58.709 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888860+0000", 2024-09-13T06:42:58.709 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4739999999999999e-06 2024-09-13T06:42:58.709 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.709 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.710 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:58.710 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888867+0000", 2024-09-13T06:42:58.710 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.7170000000000002e-06 2024-09-13T06:42:58.710 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.710 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.710 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:58.710 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888871+0000", 2024-09-13T06:42:58.710 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5120000000000002e-06 2024-09-13T06:42:58.710 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.710 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.710 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:58.710 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.938389+0000", 2024-09-13T06:42:58.710 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049517717000000003 2024-09-13T06:42:58.710 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.711 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.711 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:58.711 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.938449+0000", 2024-09-13T06:42:58.711 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0513999999999997e-05 2024-09-13T06:42:58.711 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.711 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.711 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:58.711 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.938532+0000", 2024-09-13T06:42:58.711 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.2936999999999996e-05 2024-09-13T06:42:58.711 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:58.711 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:58.711 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:58.711 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.711 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.711 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:21986 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 12615680~4096 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:42:58.712 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.888875+0000", 2024-09-13T06:42:58.712 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 185.80330401200001, 2024-09-13T06:42:58.712 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049881781, 2024-09-13T06:42:58.712 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:58.712 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:58.712 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:58.712 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:58.712 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:58.712 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 21986 2024-09-13T06:42:58.712 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.712 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:58.712 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.712 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:58.712 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888875+0000", 2024-09-13T06:42:58.713 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:58.713 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.713 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.713 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:58.713 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888875+0000", 2024-09-13T06:42:58.713 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:58.713 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.713 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.713 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:58.713 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888875+0000", 2024-09-13T06:42:58.713 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:58.713 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.713 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.713 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:58.714 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888880+0000", 2024-09-13T06:42:58.714 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7600000000000002e-06 2024-09-13T06:42:58.714 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.714 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.714 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:58.714 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888887+0000", 2024-09-13T06:42:58.714 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3950000000000003e-06 2024-09-13T06:42:58.714 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.714 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.714 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:58.714 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888892+0000", 2024-09-13T06:42:58.714 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0409999999999997e-06 2024-09-13T06:42:58.714 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.714 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.715 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:58.715 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.938568+0000", 2024-09-13T06:42:58.715 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049675267000000002 2024-09-13T06:42:58.715 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.715 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.715 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:58.715 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.938653+0000", 2024-09-13T06:42:58.715 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.5792999999999997e-05 2024-09-13T06:42:58.715 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.715 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.715 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:58.715 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.938757+0000", 2024-09-13T06:42:58.715 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00010387699999999999 2024-09-13T06:42:58.715 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:58.715 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:58.716 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:58.716 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.716 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.716 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:21987 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 12644352~4096 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:42:58.716 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.888899+0000", 2024-09-13T06:42:58.716 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 185.80328066600001, 2024-09-13T06:42:58.716 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.050094056999999997, 2024-09-13T06:42:58.716 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:58.716 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:58.716 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:58.716 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:58.716 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:58.716 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 21987 2024-09-13T06:42:58.717 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.717 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:58.717 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.717 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:58.717 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888899+0000", 2024-09-13T06:42:58.717 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:58.717 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.717 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.717 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:58.717 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888899+0000", 2024-09-13T06:42:58.717 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:58.717 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.717 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.718 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:58.718 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888899+0000", 2024-09-13T06:42:58.718 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:58.718 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.718 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.718 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:58.718 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888901+0000", 2024-09-13T06:42:58.718 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2539999999999999e-06 2024-09-13T06:42:58.718 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.718 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.718 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:58.718 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888907+0000", 2024-09-13T06:42:58.718 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9009999999999999e-06 2024-09-13T06:42:58.719 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.719 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.719 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:58.719 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888912+0000", 2024-09-13T06:42:58.719 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9840000000000001e-06 2024-09-13T06:42:58.719 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.719 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.719 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:58.719 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.938810+0000", 2024-09-13T06:42:58.719 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049898835000000002 2024-09-13T06:42:58.719 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.719 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.719 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:58.719 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.938890+0000", 2024-09-13T06:42:58.720 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.9215000000000006e-05 2024-09-13T06:42:58.720 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.720 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.720 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:58.720 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.938993+0000", 2024-09-13T06:42:58.720 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000103194 2024-09-13T06:42:58.720 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:58.720 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:58.720 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:58.720 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.720 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.720 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:21988 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 12673024~4096 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:42:58.720 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.888916+0000", 2024-09-13T06:42:58.720 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 185.80326364999999, 2024-09-13T06:42:58.721 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.050203036999999999, 2024-09-13T06:42:58.721 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:58.721 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:58.721 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:58.721 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:58.721 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:58.721 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 21988 2024-09-13T06:42:58.721 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.721 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:58.721 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.721 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:58.721 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888916+0000", 2024-09-13T06:42:58.721 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:58.721 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.722 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.722 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:58.722 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888916+0000", 2024-09-13T06:42:58.722 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:58.722 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.722 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.722 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:58.722 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888915+0000", 2024-09-13T06:42:58.722 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:58.722 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.722 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.722 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:58.722 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888918+0000", 2024-09-13T06:42:58.723 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1500000000000002e-06 2024-09-13T06:42:58.723 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.723 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.723 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:58.723 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888925+0000", 2024-09-13T06:42:58.723 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.9380000000000003e-06 2024-09-13T06:42:58.723 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.723 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.723 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:58.723 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888933+0000", 2024-09-13T06:42:58.723 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.0560000000000005e-06 2024-09-13T06:42:58.723 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.723 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.724 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:58.724 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.939026+0000", 2024-09-13T06:42:58.724 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.050093499999999999 2024-09-13T06:42:58.724 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.724 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.724 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:58.724 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.939068+0000", 2024-09-13T06:42:58.724 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.1705999999999997e-05 2024-09-13T06:42:58.724 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.724 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.724 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:58.724 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.939119+0000", 2024-09-13T06:42:58.724 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.1048999999999999e-05 2024-09-13T06:42:58.725 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:58.725 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:58.725 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:58.725 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.725 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.725 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:21989 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 12701696~4096 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:42:58.725 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.888938+0000", 2024-09-13T06:42:58.725 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 185.80324132300001, 2024-09-13T06:42:58.725 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.050294393999999999, 2024-09-13T06:42:58.725 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:58.725 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:58.725 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:58.726 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:58.726 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:58.726 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 21989 2024-09-13T06:42:58.726 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.726 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:58.726 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.726 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:58.726 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888938+0000", 2024-09-13T06:42:58.726 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:58.726 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.726 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.726 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:58.727 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888938+0000", 2024-09-13T06:42:58.727 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:58.727 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.727 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.727 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:58.727 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888938+0000", 2024-09-13T06:42:58.727 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:58.727 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.727 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.727 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:58.727 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888940+0000", 2024-09-13T06:42:58.727 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5330000000000001e-06 2024-09-13T06:42:58.727 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.728 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.728 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:58.728 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888947+0000", 2024-09-13T06:42:58.728 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.2389999999999999e-06 2024-09-13T06:42:58.728 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.728 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.728 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:58.728 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.888952+0000", 2024-09-13T06:42:58.728 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.5720000000000002e-06 2024-09-13T06:42:58.728 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.728 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.728 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:58.729 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.939141+0000", 2024-09-13T06:42:58.729 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.050188903999999999 2024-09-13T06:42:58.729 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.729 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.729 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:58.729 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.939182+0000", 2024-09-13T06:42:58.729 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.0926000000000001e-05 2024-09-13T06:42:58.729 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.729 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.729 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:58.729 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.939233+0000", 2024-09-13T06:42:58.729 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0532999999999999e-05 2024-09-13T06:42:58.730 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:58.730 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:58.730 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:58.730 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.730 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.730 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:22007 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 13217792~4096 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:42:58.730 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.892771+0000", 2024-09-13T06:42:58.730 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 185.79940821700001, 2024-09-13T06:42:58.730 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049090024000000003, 2024-09-13T06:42:58.730 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:58.730 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:58.730 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:58.730 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:58.731 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:58.731 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 22007 2024-09-13T06:42:58.731 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.731 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:58.731 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.731 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:58.731 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892771+0000", 2024-09-13T06:42:58.731 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:58.731 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.731 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.731 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:58.731 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892771+0000", 2024-09-13T06:42:58.732 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:58.732 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.732 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.732 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:58.732 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892771+0000", 2024-09-13T06:42:58.732 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:42:58.732 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.732 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.732 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:58.732 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892772+0000", 2024-09-13T06:42:58.732 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.184e-06 2024-09-13T06:42:58.732 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.732 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.733 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:58.733 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892775+0000", 2024-09-13T06:42:58.733 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9179999999999998e-06 2024-09-13T06:42:58.733 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.733 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.733 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:58.733 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892778+0000", 2024-09-13T06:42:58.733 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4990000000000001e-06 2024-09-13T06:42:58.733 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.733 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.733 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:58.733 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.941760+0000", 2024-09-13T06:42:58.733 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.048982070000000003 2024-09-13T06:42:58.734 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.734 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.734 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:58.734 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.941808+0000", 2024-09-13T06:42:58.734 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.8278000000000001e-05 2024-09-13T06:42:58.734 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.734 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.734 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:58.734 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.941861+0000", 2024-09-13T06:42:58.734 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3284e-05 2024-09-13T06:42:58.734 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:58.734 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:58.735 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:58.735 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.735 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.735 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:22008 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 13246464~4096 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:42:58.735 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.892780+0000", 2024-09-13T06:42:58.735 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 185.79939956000001, 2024-09-13T06:42:58.735 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049200477999999999, 2024-09-13T06:42:58.735 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:58.735 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:58.735 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:58.735 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:58.735 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:58.735 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 22008 2024-09-13T06:42:58.736 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.736 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:58.736 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.736 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:58.736 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892780+0000", 2024-09-13T06:42:58.736 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:58.736 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.736 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.736 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:58.736 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892780+0000", 2024-09-13T06:42:58.736 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:58.736 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.737 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.737 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:58.737 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892780+0000", 2024-09-13T06:42:58.737 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:42:58.737 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.737 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.737 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:58.737 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892781+0000", 2024-09-13T06:42:58.737 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.083e-06 2024-09-13T06:42:58.737 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.737 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.737 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:58.738 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892784+0000", 2024-09-13T06:42:58.738 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.926e-06 2024-09-13T06:42:58.738 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.738 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.738 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:58.738 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892786+0000", 2024-09-13T06:42:58.738 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4490000000000002e-06 2024-09-13T06:42:58.738 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.738 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.738 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:58.738 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.941888+0000", 2024-09-13T06:42:58.738 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049102290999999999 2024-09-13T06:42:58.738 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.739 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.739 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:58.739 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.941929+0000", 2024-09-13T06:42:58.739 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.0541999999999999e-05 2024-09-13T06:42:58.739 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.739 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.739 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:58.739 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.941980+0000", 2024-09-13T06:42:58.739 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.1391999999999999e-05 2024-09-13T06:42:58.739 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:58.739 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:58.739 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:58.739 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.740 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.740 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:22009 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 13275136~4096 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:42:58.740 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.892788+0000", 2024-09-13T06:42:58.740 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 185.79939107600001, 2024-09-13T06:42:58.740 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049311926999999998, 2024-09-13T06:42:58.740 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:58.740 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:58.740 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:58.740 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:58.740 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:58.740 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 22009 2024-09-13T06:42:58.740 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.741 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:58.741 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.741 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:58.741 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892788+0000", 2024-09-13T06:42:58.741 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:58.741 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.741 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.741 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:58.741 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892788+0000", 2024-09-13T06:42:58.741 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:58.741 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.741 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.742 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:58.742 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892788+0000", 2024-09-13T06:42:58.742 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:42:58.742 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.742 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.742 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:58.742 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892789+0000", 2024-09-13T06:42:58.742 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1850000000000001e-06 2024-09-13T06:42:58.742 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.742 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.742 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:58.742 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892793+0000", 2024-09-13T06:42:58.743 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.9099999999999998e-06 2024-09-13T06:42:58.743 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.743 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.743 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:58.743 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892798+0000", 2024-09-13T06:42:58.743 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5070000000000002e-06 2024-09-13T06:42:58.743 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.743 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.743 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:58.743 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.942007+0000", 2024-09-13T06:42:58.743 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049208904999999997 2024-09-13T06:42:58.743 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.743 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.744 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:58.744 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.942049+0000", 2024-09-13T06:42:58.744 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.1922000000000003e-05 2024-09-13T06:42:58.744 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.744 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.744 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:58.744 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.942100+0000", 2024-09-13T06:42:58.744 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.1736000000000001e-05 2024-09-13T06:42:58.744 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:58.744 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:58.744 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:58.744 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.744 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.744 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:22010 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 13303808~4096 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:42:58.744 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.892817+0000", 2024-09-13T06:42:58.745 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 185.79936287999999, 2024-09-13T06:42:58.745 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049466149000000001, 2024-09-13T06:42:58.745 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:58.745 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:58.745 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:58.745 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:58.745 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:58.745 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 22010 2024-09-13T06:42:58.745 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.745 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:58.745 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.745 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:58.745 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892817+0000", 2024-09-13T06:42:58.745 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:58.746 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.746 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.746 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:58.746 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892817+0000", 2024-09-13T06:42:58.746 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:58.746 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.746 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.746 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:58.746 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892816+0000", 2024-09-13T06:42:58.746 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:58.746 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.746 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.746 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:58.746 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892821+0000", 2024-09-13T06:42:58.747 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9459999999999997e-06 2024-09-13T06:42:58.747 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.747 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.747 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:58.747 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892828+0000", 2024-09-13T06:42:58.747 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.6780000000000003e-06 2024-09-13T06:42:58.747 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.747 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.747 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:58.747 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892833+0000", 2024-09-13T06:42:58.747 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.8389999999999997e-06 2024-09-13T06:42:58.747 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.747 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.747 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:58.748 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.942127+0000", 2024-09-13T06:42:58.748 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049294163000000002 2024-09-13T06:42:58.748 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.748 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.748 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:58.748 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.942186+0000", 2024-09-13T06:42:58.748 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9335e-05 2024-09-13T06:42:58.748 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.748 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.748 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:58.748 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.942283+0000", 2024-09-13T06:42:58.748 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.6699000000000004e-05 2024-09-13T06:42:58.748 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:58.749 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:58.749 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:58.749 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.749 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.749 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:22011 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 13332480~4096 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:42:58.749 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.892838+0000", 2024-09-13T06:42:58.749 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 185.799341193, 2024-09-13T06:42:58.749 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049589214, 2024-09-13T06:42:58.749 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:58.749 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:58.749 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:58.749 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:58.750 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:58.750 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 22011 2024-09-13T06:42:58.750 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.750 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:58.750 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.750 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:58.750 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892838+0000", 2024-09-13T06:42:58.750 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:58.750 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.750 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.750 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:58.750 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892838+0000", 2024-09-13T06:42:58.750 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:58.750 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.750 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.751 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:58.751 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892838+0000", 2024-09-13T06:42:58.751 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:58.751 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.751 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.751 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:58.751 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892840+0000", 2024-09-13T06:42:58.751 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.136e-06 2024-09-13T06:42:58.751 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.751 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.751 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:58.751 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892852+0000", 2024-09-13T06:42:58.751 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2122e-05 2024-09-13T06:42:58.751 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.751 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.752 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:58.752 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.892862+0000", 2024-09-13T06:42:58.752 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.7049999999999994e-06 2024-09-13T06:42:58.752 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.752 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.752 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:58.752 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.942319+0000", 2024-09-13T06:42:58.752 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049456623999999998 2024-09-13T06:42:58.752 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.752 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.752 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:58.752 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.942363+0000", 2024-09-13T06:42:58.752 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4759000000000003e-05 2024-09-13T06:42:58.752 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.753 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.753 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:58.753 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.942428+0000", 2024-09-13T06:42:58.753 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.4221999999999996e-05 2024-09-13T06:42:58.753 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:58.753 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:58.753 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:58.753 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.753 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.753 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:22338 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 13611008~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:42:58.753 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.951070+0000", 2024-09-13T06:42:58.753 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 185.74110967199999, 2024-09-13T06:42:58.753 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049135817999999998, 2024-09-13T06:42:58.753 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:58.754 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:58.754 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:58.754 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:58.754 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:58.754 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 22338 2024-09-13T06:42:58.754 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.754 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:58.754 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.754 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:58.754 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951070+0000", 2024-09-13T06:42:58.754 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:58.754 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.754 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.755 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:58.755 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951070+0000", 2024-09-13T06:42:58.755 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:58.755 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.755 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.755 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:58.755 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951069+0000", 2024-09-13T06:42:58.755 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:58.755 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.755 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.755 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:58.755 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951072+0000", 2024-09-13T06:42:58.755 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5909999999999998e-06 2024-09-13T06:42:58.755 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.755 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.756 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:58.756 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951078+0000", 2024-09-13T06:42:58.756 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.4450000000000001e-06 2024-09-13T06:42:58.756 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.756 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.756 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:58.756 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951083+0000", 2024-09-13T06:42:58.756 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7790000000000003e-06 2024-09-13T06:42:58.756 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.756 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.756 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:58.756 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:53.000020+0000", 2024-09-13T06:42:58.756 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.048936999000000002 2024-09-13T06:42:58.756 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.757 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.757 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:58.757 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:53.000106+0000", 2024-09-13T06:42:58.757 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.5532999999999996e-05 2024-09-13T06:42:58.757 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.757 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.757 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:58.757 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:53.000206+0000", 2024-09-13T06:42:58.757 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.9852999999999994e-05 2024-09-13T06:42:58.757 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:58.757 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:58.757 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:58.757 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.757 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.757 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:22339 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 13639680~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:42:58.758 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.951088+0000", 2024-09-13T06:42:58.758 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 185.741091974, 2024-09-13T06:42:58.758 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049238202000000002, 2024-09-13T06:42:58.758 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:58.758 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:58.758 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:58.758 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:58.758 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:58.758 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 22339 2024-09-13T06:42:58.758 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.758 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:58.758 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.758 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:58.758 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951088+0000", 2024-09-13T06:42:58.759 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:58.759 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.759 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.759 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:58.759 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951088+0000", 2024-09-13T06:42:58.759 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:58.759 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.759 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.759 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:58.759 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951087+0000", 2024-09-13T06:42:58.759 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:58.759 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.759 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.759 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:58.759 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951089+0000", 2024-09-13T06:42:58.760 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.153e-06 2024-09-13T06:42:58.760 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.760 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.760 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:58.760 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951093+0000", 2024-09-13T06:42:58.760 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.7120000000000002e-06 2024-09-13T06:42:58.760 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.760 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.760 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:58.760 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951096+0000", 2024-09-13T06:42:58.760 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.0570000000000001e-06 2024-09-13T06:42:58.760 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.760 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.760 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:58.761 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:53.000220+0000", 2024-09-13T06:42:58.761 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049123989 2024-09-13T06:42:58.761 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.761 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.761 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:58.761 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:53.000271+0000", 2024-09-13T06:42:58.761 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.062e-05 2024-09-13T06:42:58.761 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.761 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.761 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:58.761 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:53.000326+0000", 2024-09-13T06:42:58.761 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.5121000000000003e-05 2024-09-13T06:42:58.761 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:58.761 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:58.762 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:58.762 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.762 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.762 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:22340 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 13668352~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:42:58.762 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.951200+0000", 2024-09-13T06:42:58.762 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 185.74097908499999, 2024-09-13T06:42:58.762 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049352350000000003, 2024-09-13T06:42:58.762 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:58.762 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:58.762 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:58.762 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:58.762 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:58.762 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 22340 2024-09-13T06:42:58.762 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.762 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:58.763 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.763 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:58.763 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951200+0000", 2024-09-13T06:42:58.763 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:58.763 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.763 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.763 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:58.763 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951200+0000", 2024-09-13T06:42:58.763 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:58.763 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.763 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.763 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:58.763 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951098+0000", 2024-09-13T06:42:58.763 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.999898 2024-09-13T06:42:58.764 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.764 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.764 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:58.764 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951204+0000", 2024-09-13T06:42:58.764 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000105398 2024-09-13T06:42:58.764 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.764 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.764 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:58.764 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951211+0000", 2024-09-13T06:42:58.764 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.43e-06 2024-09-13T06:42:58.764 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.764 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.764 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:58.764 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.951216+0000", 2024-09-13T06:42:58.765 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2800000000000003e-06 2024-09-13T06:42:58.765 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.765 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.765 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:58.765 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:53.000358+0000", 2024-09-13T06:42:58.765 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049142036 2024-09-13T06:42:58.765 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.765 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.765 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:58.765 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:53.000443+0000", 2024-09-13T06:42:58.765 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.4710999999999996e-05 2024-09-13T06:42:58.765 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.765 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.766 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:58.766 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:53.000553+0000", 2024-09-13T06:42:58.766 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000109622 2024-09-13T06:42:58.766 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:58.766 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:58.766 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:58.766 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.766 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.766 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:22348 3.0 3:065f8d0b:::rbd_data.112150cd58e1.0000000000000006:10 [read 13897728~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e44)", 2024-09-13T06:42:58.766 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:52.952783+0000", 2024-09-13T06:42:58.766 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 185.73939629700001, 2024-09-13T06:42:58.766 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.049120832000000003, 2024-09-13T06:42:58.766 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:58.767 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:58.767 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:58.767 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:58.767 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:58.767 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 22348 2024-09-13T06:42:58.767 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.767 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:58.767 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.767 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:58.767 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.952783+0000", 2024-09-13T06:42:58.767 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:58.767 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.767 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.767 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:58.768 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.952783+0000", 2024-09-13T06:42:58.768 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:58.768 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.768 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.768 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:58.768 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.952783+0000", 2024-09-13T06:42:58.768 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:58.768 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.768 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.768 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:58.768 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.952785+0000", 2024-09-13T06:42:58.768 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4980000000000001e-06 2024-09-13T06:42:58.768 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.768 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.769 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:58.769 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.952799+0000", 2024-09-13T06:42:58.769 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3825000000000001e-05 2024-09-13T06:42:58.769 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.769 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.769 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:58.769 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:52.952809+0000", 2024-09-13T06:42:58.769 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0043e-05 2024-09-13T06:42:58.769 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.769 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.769 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:58.769 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:53.001723+0000", 2024-09-13T06:42:58.769 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.048914065 2024-09-13T06:42:58.769 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.770 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.770 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:58.770 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:53.001807+0000", 2024-09-13T06:42:58.770 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.3776000000000006e-05 2024-09-13T06:42:58.770 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.770 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.770 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:58.770 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:53.001904+0000", 2024-09-13T06:42:58.770 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.7004999999999997e-05 2024-09-13T06:42:58.770 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:58.770 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:58.770 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:58.770 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.770 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.771 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:69045 3.0 3:05ea3821:::rbd_data.1121867cc19b.0000000000000000:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109)", 2024-09-13T06:42:58.771 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:41:03.637760+0000", 2024-09-13T06:42:58.771 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 115.05441953899999, 2024-09-13T06:42:58.771 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.052276712000000003, 2024-09-13T06:42:58.771 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:58.771 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:42:58.771 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:58.771 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:58.771 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:58.771 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 69045 2024-09-13T06:42:58.771 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.771 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:58.771 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.771 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:58.772 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:03.637760+0000", 2024-09-13T06:42:58.772 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:58.772 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.772 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.772 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:58.772 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:03.637760+0000", 2024-09-13T06:42:58.772 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:58.772 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.772 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.772 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:58.772 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:03.637758+0000", 2024-09-13T06:42:58.772 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999981 2024-09-13T06:42:58.772 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.772 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.773 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:58.773 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:03.637770+0000", 2024-09-13T06:42:58.773 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1533e-05 2024-09-13T06:42:58.773 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.773 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.773 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:58.773 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:03.637794+0000", 2024-09-13T06:42:58.773 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4243000000000002e-05 2024-09-13T06:42:58.773 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.773 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.773 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:58.773 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:03.637806+0000", 2024-09-13T06:42:58.773 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2033e-05 2024-09-13T06:42:58.774 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.774 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.774 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:58.774 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:03.637891+0000", 2024-09-13T06:42:58.774 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.5358000000000005e-05 2024-09-13T06:42:58.774 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.774 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.774 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:58.774 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:03.638042+0000", 2024-09-13T06:42:58.774 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000151073 2024-09-13T06:42:58.774 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.774 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.774 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 2", 2024-09-13T06:42:58.774 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:03.647124+0000", 2024-09-13T06:42:58.775 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0090821670000000004 2024-09-13T06:42:58.775 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.775 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.775 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:42:58.775 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:03.689849+0000", 2024-09-13T06:42:58.775 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.042724445999999999 2024-09-13T06:42:58.775 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.775 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.775 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-09-13T06:42:58.775 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:03.689871+0000", 2024-09-13T06:42:58.775 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1778999999999999e-05 2024-09-13T06:42:58.775 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.775 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.775 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:42:58.776 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:03.689965+0000", 2024-09-13T06:42:58.776 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.4312000000000001e-05 2024-09-13T06:42:58.776 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.776 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.776 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:58.776 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:03.690037+0000", 2024-09-13T06:42:58.776 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.1687999999999995e-05 2024-09-13T06:42:58.776 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:58.776 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:58.776 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:58.776 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.776 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.776 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:90987 3.6 3:6263dd97:::rbd_object_map.11212443ae03.0000000000000049:head [call] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-13T06:42:58.776 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:41:35.460333+0000", 2024-09-13T06:42:58.777 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 83.231846152000003, 2024-09-13T06:42:58.777 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0001633640000001, 2024-09-13T06:42:58.777 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:58.777 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:58.777 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:58.777 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:58.777 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:58.777 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 90987 2024-09-13T06:42:58.777 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.777 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:58.777 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.777 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:58.777 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:35.460333+0000", 2024-09-13T06:42:58.778 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:58.778 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.778 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.778 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:58.778 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:35.460333+0000", 2024-09-13T06:42:58.778 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:58.778 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.778 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.778 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:58.778 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:35.460330+0000", 2024-09-13T06:42:58.778 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999971 2024-09-13T06:42:58.778 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.779 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.779 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:58.779 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:35.460343+0000", 2024-09-13T06:42:58.779 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2695e-05 2024-09-13T06:42:58.779 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.779 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.779 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:58.779 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:35.460365+0000", 2024-09-13T06:42:58.779 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2473999999999999e-05 2024-09-13T06:42:58.779 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.779 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.779 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:58.779 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:35.460376+0000", 2024-09-13T06:42:58.779 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0383999999999999e-05 2024-09-13T06:42:58.780 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.780 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.780 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:58.780 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:35.460435+0000", 2024-09-13T06:42:58.780 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8650000000000003e-05 2024-09-13T06:42:58.780 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.780 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.780 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:42:58.780 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:35.460444+0000", 2024-09-13T06:42:58.780 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.0380000000000005e-06 2024-09-13T06:42:58.780 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.780 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.781 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:58.781 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:36.459433+0000", 2024-09-13T06:42:58.781 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.99898895799999998 2024-09-13T06:42:58.781 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.781 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.781 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:58.781 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:36.459622+0000", 2024-09-13T06:42:58.781 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00018940299999999999 2024-09-13T06:42:58.781 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.781 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.781 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:58.782 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:36.460497+0000", 2024-09-13T06:42:58.782 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00087481199999999999 2024-09-13T06:42:58.782 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:58.782 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:58.782 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:58.782 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.782 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.782 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:159632 3.a 3:57f62123:::rbd_header.112138ed422:head [create,call rbd.create in=9b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e167)", 2024-09-13T06:42:58.782 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:42:07.853351+0000", 2024-09-13T06:42:58.782 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 50.83882835, 2024-09-13T06:42:58.782 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.95572760999999995, 2024-09-13T06:42:58.782 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:58.782 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:42:58.782 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:58.783 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:58.783 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:58.783 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 159632 2024-09-13T06:42:58.783 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.783 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:58.783 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.783 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:58.783 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:07.853351+0000", 2024-09-13T06:42:58.783 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:58.783 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.783 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.783 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:58.783 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:07.853351+0000", 2024-09-13T06:42:58.783 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:58.783 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.784 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.784 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:58.784 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:07.853350+0000", 2024-09-13T06:42:58.784 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.999999 2024-09-13T06:42:58.784 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.784 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.784 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:58.784 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:07.853356+0000", 2024-09-13T06:42:58.784 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.1560000000000003e-06 2024-09-13T06:42:58.784 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.784 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.784 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:58.784 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:07.853365+0000", 2024-09-13T06:42:58.785 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.8079999999999999e-06 2024-09-13T06:42:58.785 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.785 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.785 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:58.785 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:07.853372+0000", 2024-09-13T06:42:58.785 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.5540000000000003e-06 2024-09-13T06:42:58.785 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.785 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.785 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:58.785 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:07.853430+0000", 2024-09-13T06:42:58.785 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8038000000000002e-05 2024-09-13T06:42:58.785 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.786 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.786 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:42:58.786 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:07.853444+0000", 2024-09-13T06:42:58.786 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3719e-05 2024-09-13T06:42:58.786 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.786 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.786 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:58.786 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:08.804052+0000", 2024-09-13T06:42:58.786 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.95060817799999997 2024-09-13T06:42:58.786 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.786 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.786 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:58.787 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:08.804234+0000", 2024-09-13T06:42:58.787 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00018192999999999999 2024-09-13T06:42:58.787 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.787 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.787 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 6", 2024-09-13T06:42:58.787 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:08.804797+0000", 2024-09-13T06:42:58.787 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00056282399999999996 2024-09-13T06:42:58.787 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.787 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.787 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-09-13T06:42:58.787 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:08.805704+0000", 2024-09-13T06:42:58.787 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00090781 2024-09-13T06:42:58.787 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.788 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.788 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:42:58.788 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:08.808907+0000", 2024-09-13T06:42:58.788 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0032031239999999999 2024-09-13T06:42:58.788 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.788 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.788 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:42:58.788 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:08.808998+0000", 2024-09-13T06:42:58.788 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.0191000000000004e-05 2024-09-13T06:42:58.788 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:58.788 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:58.788 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:58.788 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:08.809079+0000", 2024-09-13T06:42:58.788 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.1076999999999996e-05 2024-09-13T06:42:58.789 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:58.789 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:58.789 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:58.789 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:58.789 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:58.789 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:42:58.790 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-13T06:42:58.791 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:42:58.792+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:42:58.891 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:42:58.889+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:42:58.953 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:42:58.953 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-13T06:42:58.953 INFO:teuthology.orchestra.run.smithi081.stdout: "num_ops": 0 2024-09-13T06:42:58.953 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:42:58.967 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-13T06:42:58.992 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:42:58.989+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:42:59.084 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:42:59.084 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-13T06:42:59.084 INFO:teuthology.orchestra.run.smithi081.stdout: "complaint_time": 30, 2024-09-13T06:42:59.084 INFO:teuthology.orchestra.run.smithi081.stdout: "num_blocked_ops": 0 2024-09-13T06:42:59.084 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:42:59.092 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:42:59.093+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:42:59.097 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-13T06:42:59.193 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-13T06:42:59.193+0000 7fa8bb18e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 36790) UID: 0 2024-09-13T06:42:59.220 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:42:59.220 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 20, 2024-09-13T06:42:59.220 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 600, 2024-09-13T06:42:59.220 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [ 2024-09-13T06:42:59.220 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.220 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:36160 3.f 3:f62782c2:::rbd_object_map.11219660270d.0000000000000016:head [call] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-13T06:42:59.220 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:01.607291+0000", 2024-09-13T06:42:59.220 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 177.611319799, 2024-09-13T06:42:59.220 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.99619456699999998, 2024-09-13T06:42:59.220 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:59.220 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:59.220 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:59.220 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:59.221 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:59.221 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 36160 2024-09-13T06:42:59.221 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.221 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:59.221 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.221 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:59.221 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:01.607291+0000", 2024-09-13T06:42:59.221 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:59.221 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.221 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.221 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:59.221 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:01.607291+0000", 2024-09-13T06:42:59.221 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:59.222 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.222 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.222 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:59.222 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:01.607289+0000", 2024-09-13T06:42:59.222 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999976 2024-09-13T06:42:59.222 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.222 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.222 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:59.222 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:01.607302+0000", 2024-09-13T06:42:59.222 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3018e-05 2024-09-13T06:42:59.222 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.222 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.222 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:59.222 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:01.607323+0000", 2024-09-13T06:42:59.222 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1030999999999999e-05 2024-09-13T06:42:59.223 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.223 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.223 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:59.223 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:01.607342+0000", 2024-09-13T06:42:59.223 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8961e-05 2024-09-13T06:42:59.223 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.223 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.223 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:59.223 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:01.607425+0000", 2024-09-13T06:42:59.223 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.3171999999999996e-05 2024-09-13T06:42:59.223 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.223 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.224 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:42:59.224 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:01.607441+0000", 2024-09-13T06:42:59.224 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5996999999999999e-05 2024-09-13T06:42:59.224 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.224 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.224 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:59.224 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:02.596186+0000", 2024-09-13T06:42:59.224 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.98874432000000001 2024-09-13T06:42:59.224 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.224 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.224 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for missing object", 2024-09-13T06:42:59.224 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:02.596618+0000", 2024-09-13T06:42:59.224 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000432032 2024-09-13T06:42:59.225 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.225 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.225 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:59.225 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:02.600845+0000", 2024-09-13T06:42:59.225 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0042277410000000001 2024-09-13T06:42:59.225 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.225 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.225 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:59.225 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:02.601003+0000", 2024-09-13T06:42:59.225 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00015731999999999999 2024-09-13T06:42:59.225 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.225 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.225 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:59.225 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:02.603486+0000", 2024-09-13T06:42:59.226 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0024832510000000001 2024-09-13T06:42:59.226 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:59.226 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:59.226 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:59.226 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.226 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.226 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:37806 3.9 3:951cb95b:::rbd_data.1121d8143c6e.0000000000000002:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e56)", 2024-09-13T06:42:59.226 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:06.373482+0000", 2024-09-13T06:42:59.226 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 172.84512876299999, 2024-09-13T06:42:59.226 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.002476213, 2024-09-13T06:42:59.226 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:59.226 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:59.226 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:59.227 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:59.227 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:59.227 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 37806 2024-09-13T06:42:59.227 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.227 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:59.227 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.227 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:59.227 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.373482+0000", 2024-09-13T06:42:59.227 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:59.227 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.227 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.227 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:59.227 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.373482+0000", 2024-09-13T06:42:59.228 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:59.228 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.228 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.228 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:59.228 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.373479+0000", 2024-09-13T06:42:59.228 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999962 2024-09-13T06:42:59.228 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.228 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.228 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:59.228 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.373495+0000", 2024-09-13T06:42:59.228 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6640999999999999e-05 2024-09-13T06:42:59.228 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.229 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.229 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:59.229 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.373542+0000", 2024-09-13T06:42:59.229 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6229000000000001e-05 2024-09-13T06:42:59.229 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.229 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.229 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:59.229 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.373564+0000", 2024-09-13T06:42:59.229 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2684000000000002e-05 2024-09-13T06:42:59.229 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.229 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.229 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:59.230 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374268+0000", 2024-09-13T06:42:59.230 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00070363700000000001 2024-09-13T06:42:59.230 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.230 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.230 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:42:59.230 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374305+0000", 2024-09-13T06:42:59.230 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.6936e-05 2024-09-13T06:42:59.230 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.230 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.230 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:59.230 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.375175+0000", 2024-09-13T06:42:59.230 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.000870454 2024-09-13T06:42:59.230 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.230 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.231 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:59.231 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.375678+0000", 2024-09-13T06:42:59.231 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00050292499999999999 2024-09-13T06:42:59.231 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.231 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.231 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:59.231 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.375959+0000", 2024-09-13T06:42:59.231 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00028050599999999997 2024-09-13T06:42:59.231 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:59.231 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:59.231 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:59.231 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.231 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.232 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:37821 3.9 3:951cb95b:::rbd_data.1121d8143c6e.0000000000000002:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e56)", 2024-09-13T06:42:59.232 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:06.374454+0000", 2024-09-13T06:42:59.232 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 172.84415764600001, 2024-09-13T06:42:59.232 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.002545072, 2024-09-13T06:42:59.232 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:59.232 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:59.232 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:59.232 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:59.232 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:59.232 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 37821 2024-09-13T06:42:59.232 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.232 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:59.232 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.232 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:59.232 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374454+0000", 2024-09-13T06:42:59.233 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:59.233 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.233 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.233 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:59.233 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374454+0000", 2024-09-13T06:42:59.233 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:59.233 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.233 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.233 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:59.233 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374452+0000", 2024-09-13T06:42:59.233 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999981 2024-09-13T06:42:59.233 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.233 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.234 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:59.234 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374463+0000", 2024-09-13T06:42:59.234 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0756e-05 2024-09-13T06:42:59.234 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.234 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.234 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:59.234 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374487+0000", 2024-09-13T06:42:59.234 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4887000000000001e-05 2024-09-13T06:42:59.235 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.235 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.235 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:59.235 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374504+0000", 2024-09-13T06:42:59.235 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6852000000000001e-05 2024-09-13T06:42:59.235 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.235 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.235 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:59.235 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374829+0000", 2024-09-13T06:42:59.235 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000324684 2024-09-13T06:42:59.236 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.236 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.236 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:42:59.236 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374880+0000", 2024-09-13T06:42:59.236 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.1378000000000002e-05 2024-09-13T06:42:59.236 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.236 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.236 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:59.236 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.376423+0000", 2024-09-13T06:42:59.236 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.001542734 2024-09-13T06:42:59.236 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.236 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.236 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:59.237 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.376607+0000", 2024-09-13T06:42:59.237 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000183656 2024-09-13T06:42:59.237 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.237 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.237 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:59.237 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.376999+0000", 2024-09-13T06:42:59.237 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00039191200000000001 2024-09-13T06:42:59.237 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:59.237 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:59.238 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:59.238 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.238 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.238 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:37836 3.9 3:951cb95b:::rbd_data.1121d8143c6e.0000000000000002:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e56)", 2024-09-13T06:42:59.238 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:06.374929+0000", 2024-09-13T06:42:59.238 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 172.84368199400001, 2024-09-13T06:42:59.238 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.002778825, 2024-09-13T06:42:59.238 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:59.238 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:59.238 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:59.238 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:59.239 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:59.239 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 37836 2024-09-13T06:42:59.239 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.239 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:59.239 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.239 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:59.239 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374929+0000", 2024-09-13T06:42:59.239 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:59.239 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.239 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.239 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:59.240 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374929+0000", 2024-09-13T06:42:59.240 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:59.240 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.240 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.240 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:59.240 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374927+0000", 2024-09-13T06:42:59.240 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999981 2024-09-13T06:42:59.240 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.240 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.240 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:59.240 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374939+0000", 2024-09-13T06:42:59.240 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1846e-05 2024-09-13T06:42:59.240 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.241 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.241 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:59.241 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374962+0000", 2024-09-13T06:42:59.241 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3054e-05 2024-09-13T06:42:59.241 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.241 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.241 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:59.241 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374978+0000", 2024-09-13T06:42:59.241 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5899000000000001e-05 2024-09-13T06:42:59.241 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.241 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.241 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:59.242 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.375106+0000", 2024-09-13T06:42:59.242 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00012789 2024-09-13T06:42:59.242 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.242 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.242 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:42:59.242 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.375134+0000", 2024-09-13T06:42:59.242 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.8254000000000001e-05 2024-09-13T06:42:59.242 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.242 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.242 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:59.242 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.377082+0000", 2024-09-13T06:42:59.242 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0019471520000001 2024-09-13T06:42:59.242 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.242 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.243 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:59.243 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.377330+0000", 2024-09-13T06:42:59.243 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00024834199999999997 2024-09-13T06:42:59.243 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.243 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.243 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:59.243 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.377708+0000", 2024-09-13T06:42:59.243 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00037817100000000001 2024-09-13T06:42:59.243 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:59.243 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:59.243 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:59.243 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.243 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.244 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:37851 3.9 3:951cb95b:::rbd_data.1121d8143c6e.0000000000000002:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e56)", 2024-09-13T06:42:59.244 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:06.382636+0000", 2024-09-13T06:42:59.244 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 172.835975109, 2024-09-13T06:42:59.244 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.99582539400000003, 2024-09-13T06:42:59.244 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:59.244 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:59.244 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:59.244 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:59.244 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:59.244 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 37851 2024-09-13T06:42:59.244 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.244 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:59.244 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.245 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:59.245 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.382636+0000", 2024-09-13T06:42:59.245 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:59.245 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.245 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.245 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:59.245 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.382636+0000", 2024-09-13T06:42:59.245 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:59.245 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.245 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.245 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:59.245 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.382633+0000", 2024-09-13T06:42:59.245 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999971 2024-09-13T06:42:59.245 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.246 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.246 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:59.246 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.382652+0000", 2024-09-13T06:42:59.246 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8834999999999998e-05 2024-09-13T06:42:59.246 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.246 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.246 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:59.246 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.382695+0000", 2024-09-13T06:42:59.246 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.3136000000000002e-05 2024-09-13T06:42:59.246 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.246 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.246 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:59.246 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.382716+0000", 2024-09-13T06:42:59.246 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1421e-05 2024-09-13T06:42:59.247 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.247 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.247 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:59.247 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.382860+0000", 2024-09-13T06:42:59.247 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00014389200000000001 2024-09-13T06:42:59.247 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.247 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.247 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:42:59.247 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.382890+0000", 2024-09-13T06:42:59.247 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9827000000000001e-05 2024-09-13T06:42:59.247 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.248 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.248 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:59.248 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.377779+0000", 2024-09-13T06:42:59.248 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.99488842899999996 2024-09-13T06:42:59.248 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.248 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.248 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:59.248 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.378007+0000", 2024-09-13T06:42:59.248 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00022838099999999999 2024-09-13T06:42:59.248 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.249 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.249 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:59.249 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.378462+0000", 2024-09-13T06:42:59.249 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00045452300000000003 2024-09-13T06:42:59.249 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:59.249 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:59.249 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:59.249 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.249 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.249 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:37866 3.9 3:951cb95b:::rbd_data.1121d8143c6e.0000000000000002:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e56)", 2024-09-13T06:42:59.249 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:06.383951+0000", 2024-09-13T06:42:59.250 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 172.834660423, 2024-09-13T06:42:59.250 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.99517962299999996, 2024-09-13T06:42:59.250 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:59.250 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:59.250 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:59.250 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:59.250 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:59.250 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 37866 2024-09-13T06:42:59.250 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.251 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:59.251 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.251 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:59.251 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.383951+0000", 2024-09-13T06:42:59.251 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:59.251 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.251 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.251 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:59.251 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.383951+0000", 2024-09-13T06:42:59.251 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:59.251 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.251 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.251 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:59.252 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.383949+0000", 2024-09-13T06:42:59.252 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999981 2024-09-13T06:42:59.252 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.252 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.252 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:59.252 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.383961+0000", 2024-09-13T06:42:59.252 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1999e-05 2024-09-13T06:42:59.252 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.252 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.252 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:59.252 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384019+0000", 2024-09-13T06:42:59.252 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7621000000000003e-05 2024-09-13T06:42:59.252 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.252 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.253 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:59.253 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384040+0000", 2024-09-13T06:42:59.253 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1528000000000001e-05 2024-09-13T06:42:59.253 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.253 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.253 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:59.253 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384186+0000", 2024-09-13T06:42:59.253 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00014573799999999999 2024-09-13T06:42:59.253 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.253 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.253 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:42:59.253 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384204+0000", 2024-09-13T06:42:59.253 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7992e-05 2024-09-13T06:42:59.254 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.254 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.254 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:59.254 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.378536+0000", 2024-09-13T06:42:59.254 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.99433268600000002 2024-09-13T06:42:59.254 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.254 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.254 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:59.254 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.378771+0000", 2024-09-13T06:42:59.254 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00023445399999999999 2024-09-13T06:42:59.254 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.254 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.254 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:59.255 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.379130+0000", 2024-09-13T06:42:59.255 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00035954200000000002 2024-09-13T06:42:59.255 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:59.255 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:59.255 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:59.255 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.255 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.255 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:37881 3.9 3:951cb95b:::rbd_data.1121d8143c6e.0000000000000002:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e56)", 2024-09-13T06:42:59.255 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:06.384239+0000", 2024-09-13T06:42:59.255 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 172.83437200899999, 2024-09-13T06:42:59.255 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.99541483500000005, 2024-09-13T06:42:59.255 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:59.256 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:59.256 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:59.256 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:59.256 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:59.256 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 37881 2024-09-13T06:42:59.256 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.256 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:59.256 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.256 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:59.256 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384239+0000", 2024-09-13T06:42:59.256 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:59.256 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.257 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.257 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:59.257 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384239+0000", 2024-09-13T06:42:59.257 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:59.257 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.257 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.257 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:59.257 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384238+0000", 2024-09-13T06:42:59.257 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999986 2024-09-13T06:42:59.257 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.257 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.258 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:59.258 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384246+0000", 2024-09-13T06:42:59.258 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.2449999999999998e-06 2024-09-13T06:42:59.258 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.258 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.258 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:59.258 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384268+0000", 2024-09-13T06:42:59.258 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1518e-05 2024-09-13T06:42:59.258 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.258 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.258 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:59.258 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384282+0000", 2024-09-13T06:42:59.259 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4501999999999999e-05 2024-09-13T06:42:59.259 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.259 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.259 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:59.259 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384356+0000", 2024-09-13T06:42:59.259 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4265999999999997e-05 2024-09-13T06:42:59.259 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.259 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.259 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:42:59.259 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384370+0000", 2024-09-13T06:42:59.259 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3942e-05 2024-09-13T06:42:59.259 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.260 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.260 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:59.260 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.379199+0000", 2024-09-13T06:42:59.260 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.99482866599999997 2024-09-13T06:42:59.260 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.260 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.260 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:59.260 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.379347+0000", 2024-09-13T06:42:59.260 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00014749199999999999 2024-09-13T06:42:59.260 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.260 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.260 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:59.260 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.379654+0000", 2024-09-13T06:42:59.261 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00030752999999999998 2024-09-13T06:42:59.261 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:59.261 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:59.261 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:59.261 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.261 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.261 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:37896 3.9 3:951cb95b:::rbd_data.1121d8143c6e.0000000000000002:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e56)", 2024-09-13T06:42:59.261 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:06.384412+0000", 2024-09-13T06:42:59.261 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 172.834199576, 2024-09-13T06:42:59.261 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.99777835999999998, 2024-09-13T06:42:59.261 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:59.261 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:59.261 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:59.261 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:59.262 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:59.262 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 37896 2024-09-13T06:42:59.262 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.262 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:59.262 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.262 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:59.262 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384412+0000", 2024-09-13T06:42:59.262 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:59.262 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.262 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.262 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:59.262 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384412+0000", 2024-09-13T06:42:59.262 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:59.262 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.263 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.263 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:59.263 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384410+0000", 2024-09-13T06:42:59.263 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.999999 2024-09-13T06:42:59.263 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.263 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.263 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:59.263 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384418+0000", 2024-09-13T06:42:59.263 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.486e-06 2024-09-13T06:42:59.263 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.263 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.263 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:59.263 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384436+0000", 2024-09-13T06:42:59.263 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7668000000000001e-05 2024-09-13T06:42:59.263 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.264 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.264 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:59.264 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384449+0000", 2024-09-13T06:42:59.264 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3395e-05 2024-09-13T06:42:59.264 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.264 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.264 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:59.264 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384605+0000", 2024-09-13T06:42:59.264 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00015563099999999999 2024-09-13T06:42:59.264 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.264 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.264 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:42:59.264 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384635+0000", 2024-09-13T06:42:59.265 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.0383999999999999e-05 2024-09-13T06:42:59.265 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.265 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.265 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:59.265 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.379730+0000", 2024-09-13T06:42:59.265 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.99509493999999998 2024-09-13T06:42:59.265 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.265 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.265 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:59.265 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.379964+0000", 2024-09-13T06:42:59.265 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00023353499999999999 2024-09-13T06:42:59.265 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.265 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.265 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:59.266 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.382190+0000", 2024-09-13T06:42:59.266 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0022265039999999998 2024-09-13T06:42:59.266 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:59.266 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:59.266 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:59.266 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.266 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.266 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43223 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 393216~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:42:59.266 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558267+0000", 2024-09-13T06:42:59.266 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 157.66034426499999, 2024-09-13T06:42:59.266 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.062813151999999997, 2024-09-13T06:42:59.266 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:59.266 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:59.267 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:59.267 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:59.267 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:59.267 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43223 2024-09-13T06:42:59.267 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.267 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:59.267 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.267 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:59.267 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558267+0000", 2024-09-13T06:42:59.267 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:59.267 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.267 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.267 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:59.267 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558267+0000", 2024-09-13T06:42:59.268 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:59.268 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.268 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.268 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:59.268 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558266+0000", 2024-09-13T06:42:59.268 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:59.268 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.268 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.268 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:59.268 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558270+0000", 2024-09-13T06:42:59.268 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.2389999999999998e-06 2024-09-13T06:42:59.268 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.269 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.269 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:59.269 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558277+0000", 2024-09-13T06:42:59.269 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5680000000000002e-06 2024-09-13T06:42:59.269 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.269 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.269 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:59.269 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558282+0000", 2024-09-13T06:42:59.269 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7060000000000003e-06 2024-09-13T06:42:59.269 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.269 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.269 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:59.270 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.620731+0000", 2024-09-13T06:42:59.270 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.062448661000000003 2024-09-13T06:42:59.270 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.270 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.270 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:59.270 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.620806+0000", 2024-09-13T06:42:59.270 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5862e-05 2024-09-13T06:42:59.270 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.270 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.270 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:59.270 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.621080+0000", 2024-09-13T06:42:59.270 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00027368599999999998 2024-09-13T06:42:59.270 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:59.271 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:59.271 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:59.271 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.271 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.271 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43224 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 407552~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:42:59.271 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558286+0000", 2024-09-13T06:42:59.271 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 157.660324901, 2024-09-13T06:42:59.271 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.063179052999999999, 2024-09-13T06:42:59.271 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:59.271 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:59.271 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:59.271 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:59.271 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:59.271 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43224 2024-09-13T06:42:59.272 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.272 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:59.272 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.272 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:59.272 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558286+0000", 2024-09-13T06:42:59.272 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:59.272 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.272 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.272 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:59.272 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558286+0000", 2024-09-13T06:42:59.272 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:59.272 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.273 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.273 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:59.273 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558286+0000", 2024-09-13T06:42:59.273 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:59.273 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.273 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.273 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:59.273 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558288+0000", 2024-09-13T06:42:59.273 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.227e-06 2024-09-13T06:42:59.273 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.273 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.273 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:59.273 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558292+0000", 2024-09-13T06:42:59.274 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.6289999999999999e-06 2024-09-13T06:42:59.274 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.274 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.274 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:59.274 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558294+0000", 2024-09-13T06:42:59.274 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5409999999999999e-06 2024-09-13T06:42:59.274 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.274 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.274 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:59.274 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.621110+0000", 2024-09-13T06:42:59.274 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.062815776000000004 2024-09-13T06:42:59.274 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.275 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.275 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:59.275 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.621186+0000", 2024-09-13T06:42:59.275 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5570999999999999e-05 2024-09-13T06:42:59.275 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.275 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.275 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:59.275 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.621465+0000", 2024-09-13T06:42:59.275 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00027988200000000001 2024-09-13T06:42:59.275 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:59.275 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:59.275 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:59.275 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.276 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.276 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43225 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 421888~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:42:59.276 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558296+0000", 2024-09-13T06:42:59.276 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 157.66031493400001, 2024-09-13T06:42:59.276 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.063551110999999993, 2024-09-13T06:42:59.276 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:59.276 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:59.276 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:59.276 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:59.276 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:59.276 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43225 2024-09-13T06:42:59.276 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.277 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:59.277 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.277 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:59.277 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558296+0000", 2024-09-13T06:42:59.277 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:59.277 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.277 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.277 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:59.277 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558296+0000", 2024-09-13T06:42:59.277 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:59.277 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.277 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.278 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:59.278 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558296+0000", 2024-09-13T06:42:59.278 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:42:59.278 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.278 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.278 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:59.278 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558305+0000", 2024-09-13T06:42:59.278 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.5290000000000008e-06 2024-09-13T06:42:59.278 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.278 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.278 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:59.278 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558308+0000", 2024-09-13T06:42:59.278 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.5619999999999999e-06 2024-09-13T06:42:59.278 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.279 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.279 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:59.279 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558311+0000", 2024-09-13T06:42:59.279 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.43e-06 2024-09-13T06:42:59.279 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.279 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.279 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:59.279 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.621495+0000", 2024-09-13T06:42:59.279 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.063184289000000005 2024-09-13T06:42:59.279 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.279 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.279 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:59.279 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.621569+0000", 2024-09-13T06:42:59.280 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4250000000000002e-05 2024-09-13T06:42:59.280 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.280 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.280 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:59.280 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.621847+0000", 2024-09-13T06:42:59.280 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00027826400000000002 2024-09-13T06:42:59.280 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:59.280 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:59.280 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:59.280 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.280 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.280 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43226 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 436224~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:42:59.281 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558313+0000", 2024-09-13T06:42:59.281 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 157.66029829799999, 2024-09-13T06:42:59.281 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.063914420999999999, 2024-09-13T06:42:59.281 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:59.281 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:59.281 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:59.281 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:59.281 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:59.281 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43226 2024-09-13T06:42:59.281 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.281 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:59.281 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.282 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:59.282 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558313+0000", 2024-09-13T06:42:59.282 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:59.282 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.282 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.282 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:59.282 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558313+0000", 2024-09-13T06:42:59.282 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:59.282 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.282 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.282 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:59.282 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558313+0000", 2024-09-13T06:42:59.282 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:59.283 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.283 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.283 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:59.283 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558314+0000", 2024-09-13T06:42:59.283 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3740000000000001e-06 2024-09-13T06:42:59.283 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.283 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.283 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:59.283 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558317+0000", 2024-09-13T06:42:59.283 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9730000000000002e-06 2024-09-13T06:42:59.283 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.283 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.283 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:59.283 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558319+0000", 2024-09-13T06:42:59.284 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4059999999999999e-06 2024-09-13T06:42:59.284 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.284 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.284 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:59.284 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.621877+0000", 2024-09-13T06:42:59.284 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.063557408999999995 2024-09-13T06:42:59.284 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.284 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.284 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:59.284 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.621951+0000", 2024-09-13T06:42:59.284 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4487999999999996e-05 2024-09-13T06:42:59.284 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.285 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.285 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:59.285 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.622227+0000", 2024-09-13T06:42:59.285 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000276011 2024-09-13T06:42:59.285 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:59.285 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:59.285 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:59.285 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.285 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.285 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43227 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 450560~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:42:59.285 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558322+0000", 2024-09-13T06:42:59.285 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 157.66028971700001, 2024-09-13T06:42:59.285 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.064285348000000006, 2024-09-13T06:42:59.286 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:59.286 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:59.286 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:59.286 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:59.286 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:59.286 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43227 2024-09-13T06:42:59.286 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.286 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:59.286 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.286 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:59.286 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558322+0000", 2024-09-13T06:42:59.286 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:59.287 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.287 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.287 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:59.287 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558322+0000", 2024-09-13T06:42:59.287 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:59.287 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.287 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.287 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:59.287 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558321+0000", 2024-09-13T06:42:59.287 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:42:59.287 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.287 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.287 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:59.288 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558323+0000", 2024-09-13T06:42:59.288 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.576e-06 2024-09-13T06:42:59.288 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.288 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.288 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:59.288 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558328+0000", 2024-09-13T06:42:59.288 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0719999999999999e-06 2024-09-13T06:42:59.288 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.288 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.288 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:59.288 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558332+0000", 2024-09-13T06:42:59.288 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.8130000000000002e-06 2024-09-13T06:42:59.288 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.289 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.289 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:59.289 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.622255+0000", 2024-09-13T06:42:59.289 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.063923195000000002 2024-09-13T06:42:59.289 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.289 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.289 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:59.289 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.622330+0000", 2024-09-13T06:42:59.289 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5383000000000007e-05 2024-09-13T06:42:59.289 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.289 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.289 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:59.289 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.622607+0000", 2024-09-13T06:42:59.289 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00027651999999999999 2024-09-13T06:42:59.290 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:59.290 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:59.290 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:59.290 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.290 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.290 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43228 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 464896~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:42:59.290 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558335+0000", 2024-09-13T06:42:59.290 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 157.66027580799999, 2024-09-13T06:42:59.290 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.064652253000000007, 2024-09-13T06:42:59.291 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:59.291 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:59.291 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:59.291 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:59.291 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:59.291 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43228 2024-09-13T06:42:59.291 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.291 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:59.291 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.291 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:59.291 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558335+0000", 2024-09-13T06:42:59.291 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:59.292 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.292 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.292 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:59.292 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558335+0000", 2024-09-13T06:42:59.292 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:59.292 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.292 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.292 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:59.292 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558335+0000", 2024-09-13T06:42:59.292 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:59.292 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.292 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.293 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:59.293 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558337+0000", 2024-09-13T06:42:59.293 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1380000000000001e-06 2024-09-13T06:42:59.293 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.293 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.293 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:59.293 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558343+0000", 2024-09-13T06:42:59.293 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.5140000000000001e-06 2024-09-13T06:42:59.293 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.293 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.293 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:59.293 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558348+0000", 2024-09-13T06:42:59.293 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9640000000000002e-06 2024-09-13T06:42:59.294 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.294 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.294 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:59.294 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.622636+0000", 2024-09-13T06:42:59.294 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.064288260999999999 2024-09-13T06:42:59.294 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.294 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.294 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:59.294 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.622715+0000", 2024-09-13T06:42:59.294 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.9351000000000006e-05 2024-09-13T06:42:59.294 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.294 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.294 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:59.295 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.622988+0000", 2024-09-13T06:42:59.295 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00027242599999999998 2024-09-13T06:42:59.295 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:59.295 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:59.295 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:59.295 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.295 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.295 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43229 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 479232~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:42:59.295 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558352+0000", 2024-09-13T06:42:59.295 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 157.66025939299999, 2024-09-13T06:42:59.295 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.065018024999999993, 2024-09-13T06:42:59.295 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:59.295 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:59.296 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:59.296 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:59.296 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:59.296 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43229 2024-09-13T06:42:59.296 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.296 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:59.296 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.296 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:59.296 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558352+0000", 2024-09-13T06:42:59.296 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:59.296 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.296 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.297 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:59.297 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558352+0000", 2024-09-13T06:42:59.297 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:59.297 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.297 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.297 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:59.297 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558352+0000", 2024-09-13T06:42:59.297 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:59.297 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.297 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.297 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:59.297 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558354+0000", 2024-09-13T06:42:59.297 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4930000000000001e-06 2024-09-13T06:42:59.298 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.298 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.298 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:59.298 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558360+0000", 2024-09-13T06:42:59.298 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.263e-06 2024-09-13T06:42:59.298 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.298 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.298 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:59.298 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558369+0000", 2024-09-13T06:42:59.298 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.0829999999999993e-06 2024-09-13T06:42:59.298 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.298 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.298 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:59.298 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.623017+0000", 2024-09-13T06:42:59.299 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.064647799000000006 2024-09-13T06:42:59.299 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.299 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.299 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:59.299 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.623090+0000", 2024-09-13T06:42:59.299 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3071000000000006e-05 2024-09-13T06:42:59.299 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.299 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.299 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:59.299 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.623370+0000", 2024-09-13T06:42:59.299 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000279661 2024-09-13T06:42:59.299 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:59.300 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:59.300 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:59.300 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.300 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.300 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43230 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 493568~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:42:59.300 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558374+0000", 2024-09-13T06:42:59.300 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 157.66023709999999, 2024-09-13T06:42:59.300 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.065410435000000003, 2024-09-13T06:42:59.300 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:59.300 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:59.300 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:59.300 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:59.300 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:59.301 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43230 2024-09-13T06:42:59.301 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.301 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:59.301 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.301 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:59.301 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558374+0000", 2024-09-13T06:42:59.301 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:59.301 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.301 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.301 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:59.301 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558374+0000", 2024-09-13T06:42:59.301 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:59.301 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.302 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.302 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:59.302 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558374+0000", 2024-09-13T06:42:59.302 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:59.302 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.302 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.302 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:59.302 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558376+0000", 2024-09-13T06:42:59.302 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4430000000000002e-06 2024-09-13T06:42:59.302 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.302 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.302 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:59.303 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558382+0000", 2024-09-13T06:42:59.303 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3029999999999996e-06 2024-09-13T06:42:59.303 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.303 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.303 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:59.303 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558387+0000", 2024-09-13T06:42:59.303 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.1699999999999999e-06 2024-09-13T06:42:59.303 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.303 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.303 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:59.303 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.623400+0000", 2024-09-13T06:42:59.303 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.065013244999999997 2024-09-13T06:42:59.303 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.304 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.304 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:59.304 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.623474+0000", 2024-09-13T06:42:59.304 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3889999999999999e-05 2024-09-13T06:42:59.304 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.304 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.304 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:59.304 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.623785+0000", 2024-09-13T06:42:59.304 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00031080099999999998 2024-09-13T06:42:59.304 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:59.304 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:59.304 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:59.305 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.305 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.305 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43231 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 507904~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:42:59.305 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558391+0000", 2024-09-13T06:42:59.305 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 157.660220415, 2024-09-13T06:42:59.305 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.065788597000000004, 2024-09-13T06:42:59.305 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:59.305 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:59.305 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:59.305 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:59.305 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:59.305 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43231 2024-09-13T06:42:59.305 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.306 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:59.306 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.306 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:59.306 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558391+0000", 2024-09-13T06:42:59.306 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:59.306 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.306 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.306 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:59.306 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558391+0000", 2024-09-13T06:42:59.306 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:59.306 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.306 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.306 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:59.307 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558390+0000", 2024-09-13T06:42:59.307 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:59.307 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.307 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.307 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:59.307 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558393+0000", 2024-09-13T06:42:59.307 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2570000000000002e-06 2024-09-13T06:42:59.307 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.307 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.307 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:59.307 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558399+0000", 2024-09-13T06:42:59.307 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0419999999999999e-06 2024-09-13T06:42:59.307 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.307 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.308 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:59.308 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558403+0000", 2024-09-13T06:42:59.308 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6249999999999998e-06 2024-09-13T06:42:59.308 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.308 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.308 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:59.308 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.623811+0000", 2024-09-13T06:42:59.308 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.065407549999999995 2024-09-13T06:42:59.308 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.308 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.308 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:59.308 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.623877+0000", 2024-09-13T06:42:59.308 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.5902999999999996e-05 2024-09-13T06:42:59.309 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.309 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.309 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:59.309 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.624179+0000", 2024-09-13T06:42:59.309 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00030259999999999998 2024-09-13T06:42:59.309 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:59.309 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:59.309 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:59.309 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.309 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.309 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43232 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 522240~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:42:59.309 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558422+0000", 2024-09-13T06:42:59.310 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 157.66018963799999, 2024-09-13T06:42:59.310 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.066176061999999994, 2024-09-13T06:42:59.310 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:59.310 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:59.310 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:59.310 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:59.310 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:59.310 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43232 2024-09-13T06:42:59.310 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.310 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:59.310 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.310 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:59.310 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558422+0000", 2024-09-13T06:42:59.311 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:59.311 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.311 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.311 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:59.311 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558422+0000", 2024-09-13T06:42:59.311 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:59.311 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.311 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.311 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:59.311 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558421+0000", 2024-09-13T06:42:59.311 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:59.311 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.311 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.312 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:59.312 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558428+0000", 2024-09-13T06:42:59.312 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.1690000000000003e-06 2024-09-13T06:42:59.312 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.312 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.312 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:59.312 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558434+0000", 2024-09-13T06:42:59.312 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9309999999999996e-06 2024-09-13T06:42:59.312 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.312 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.312 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:59.312 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558447+0000", 2024-09-13T06:42:59.312 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.271e-05 2024-09-13T06:42:59.313 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.313 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.313 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:59.313 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.624209+0000", 2024-09-13T06:42:59.313 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.065762102000000003 2024-09-13T06:42:59.313 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.313 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.313 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:59.313 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.624282+0000", 2024-09-13T06:42:59.313 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.2889e-05 2024-09-13T06:42:59.313 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.313 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.313 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:59.314 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.624598+0000", 2024-09-13T06:42:59.314 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00031591399999999998 2024-09-13T06:42:59.314 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:59.314 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:59.314 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:59.314 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.314 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.314 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43486 3.f 3:f7da9c8f:::rbd_data.1121f5f2e1c0.000000000000000b:1f [read 260096~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:42:59.314 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.569088+0000", 2024-09-13T06:42:59.314 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 157.64952291500001, 2024-09-13T06:42:59.314 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.062579223000000003, 2024-09-13T06:42:59.314 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:59.314 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:59.315 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:59.315 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:59.315 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:59.315 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43486 2024-09-13T06:42:59.315 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.315 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:59.315 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.315 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:59.315 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.569088+0000", 2024-09-13T06:42:59.315 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:59.315 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.315 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.315 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:59.316 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.569088+0000", 2024-09-13T06:42:59.316 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:59.316 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.316 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.316 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:59.316 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.569088+0000", 2024-09-13T06:42:59.316 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:59.316 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.316 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.316 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:59.316 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.569091+0000", 2024-09-13T06:42:59.316 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9629999999999998e-06 2024-09-13T06:42:59.316 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.317 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.317 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:59.317 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.569097+0000", 2024-09-13T06:42:59.317 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.4160000000000001e-06 2024-09-13T06:42:59.317 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.317 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.317 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:59.317 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.569102+0000", 2024-09-13T06:42:59.317 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6659999999999999e-06 2024-09-13T06:42:59.317 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.317 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.317 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:59.317 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.631346+0000", 2024-09-13T06:42:59.318 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.062243896 2024-09-13T06:42:59.318 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.318 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.318 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:59.318 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.631413+0000", 2024-09-13T06:42:59.318 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.7638000000000005e-05 2024-09-13T06:42:59.318 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.318 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.318 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:59.318 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.631668+0000", 2024-09-13T06:42:59.318 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0002541 2024-09-13T06:42:59.318 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:59.318 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:59.319 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:59.319 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.319 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.319 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:170125 3.9 3:94e4bf8d:::rbd_object_map.1121fa0cc8a3.000000000000006d:head [writefull 0~37] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e190)", 2024-09-13T06:42:59.319 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:42:30.601501+0000", 2024-09-13T06:42:59.319 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 28.617110704000002, 2024-09-13T06:42:59.319 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.80498820000000004, 2024-09-13T06:42:59.319 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:59.319 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:42:59.319 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:59.319 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:59.319 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:59.319 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 170125 2024-09-13T06:42:59.319 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.320 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:59.320 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.320 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:59.320 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:30.601501+0000", 2024-09-13T06:42:59.320 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:59.320 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.320 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.320 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:59.320 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:30.601501+0000", 2024-09-13T06:42:59.320 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:59.320 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.320 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.320 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:59.321 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:30.601499+0000", 2024-09-13T06:42:59.321 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999986 2024-09-13T06:42:59.321 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.321 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.321 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:59.321 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:30.601506+0000", 2024-09-13T06:42:59.321 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.9940000000000003e-06 2024-09-13T06:42:59.321 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.321 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.321 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:59.321 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:30.601519+0000", 2024-09-13T06:42:59.321 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2875e-05 2024-09-13T06:42:59.321 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.322 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.322 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:59.322 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:30.601525+0000", 2024-09-13T06:42:59.322 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8549999999999998e-06 2024-09-13T06:42:59.322 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.322 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.322 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:59.322 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:30.601560+0000", 2024-09-13T06:42:59.322 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.5271000000000002e-05 2024-09-13T06:42:59.322 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.322 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.322 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:42:59.322 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:30.601566+0000", 2024-09-13T06:42:59.323 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3090000000000001e-06 2024-09-13T06:42:59.323 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.323 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.323 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:59.323 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:31.403017+0000", 2024-09-13T06:42:59.323 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.80145064200000005 2024-09-13T06:42:59.323 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.323 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.323 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:59.323 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:31.403252+0000", 2024-09-13T06:42:59.323 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000234718 2024-09-13T06:42:59.323 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.324 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.324 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 7", 2024-09-13T06:42:59.324 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:31.403521+0000", 2024-09-13T06:42:59.324 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00026917 2024-09-13T06:42:59.324 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.324 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.324 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-09-13T06:42:59.324 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:31.404918+0000", 2024-09-13T06:42:59.324 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.001397017 2024-09-13T06:42:59.324 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.324 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.324 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:42:59.325 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:31.406176+0000", 2024-09-13T06:42:59.325 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.001257998 2024-09-13T06:42:59.325 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.325 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.325 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:42:59.325 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:31.406334+0000", 2024-09-13T06:42:59.325 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00015819099999999999 2024-09-13T06:42:59.325 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.325 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.325 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:59.325 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:31.406489+0000", 2024-09-13T06:42:59.325 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00015476699999999999 2024-09-13T06:42:59.325 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:59.326 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:59.326 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:59.326 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:59.326 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:59.326 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:42:59.327 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-13T06:42:59.328 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:42:59.325+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:42:59.429 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:42:59.428+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:42:59.455 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:42:59.455 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-13T06:42:59.455 INFO:teuthology.orchestra.run.smithi081.stdout: "num_ops": 0 2024-09-13T06:42:59.456 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:42:59.469 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-13T06:42:59.554 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:42:59.556+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:42:59.626 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:42:59.626 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-13T06:42:59.626 INFO:teuthology.orchestra.run.smithi081.stdout: "complaint_time": 30, 2024-09-13T06:42:59.626 INFO:teuthology.orchestra.run.smithi081.stdout: "num_blocked_ops": 0 2024-09-13T06:42:59.626 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:42:59.630 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:42:59.629+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:42:59.640 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-13T06:42:59.731 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:42:59.732+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:42:59.790 INFO:teuthology.orchestra.run.smithi081.stderr:nodeep-scrub is unset 2024-09-13T06:42:59.817 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:42:59.817 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 20, 2024-09-13T06:42:59.818 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 600, 2024-09-13T06:42:59.818 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [ 2024-09-13T06:42:59.818 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.818 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:2226 3.15 3:af026987:::rbd_data.112173e2f1b7.0000000000000017:head [sparse-read 0~4194304] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-13T06:42:59.818 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:37.606562+0000", 2024-09-13T06:42:59.818 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 202.21045754400001, 2024-09-13T06:42:59.818 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.83322091700000001, 2024-09-13T06:42:59.818 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:59.818 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:42:59.818 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:59.818 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:59.818 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:59.818 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 2226 2024-09-13T06:42:59.818 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.819 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:59.819 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.819 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:59.819 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606562+0000", 2024-09-13T06:42:59.819 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:59.819 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.819 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.819 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:59.819 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606562+0000", 2024-09-13T06:42:59.819 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:59.819 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.819 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.819 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:59.820 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606561+0000", 2024-09-13T06:42:59.820 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:59.820 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.820 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.820 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:59.820 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606565+0000", 2024-09-13T06:42:59.820 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.4379999999999999e-06 2024-09-13T06:42:59.820 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.820 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.820 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:59.820 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606569+0000", 2024-09-13T06:42:59.820 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.425e-06 2024-09-13T06:42:59.820 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.821 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.821 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:59.821 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606572+0000", 2024-09-13T06:42:59.821 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.05e-06 2024-09-13T06:42:59.821 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.821 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.821 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:59.821 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606621+0000", 2024-09-13T06:42:59.821 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.8723000000000001e-05 2024-09-13T06:42:59.821 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.821 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.821 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:42:59.821 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606630+0000", 2024-09-13T06:42:59.821 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.8040000000000007e-06 2024-09-13T06:42:59.822 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.822 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.822 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:59.822 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.439648+0000", 2024-09-13T06:42:59.822 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.83301824800000002 2024-09-13T06:42:59.822 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.822 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.822 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:59.822 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.439782+0000", 2024-09-13T06:42:59.822 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00013466699999999999 2024-09-13T06:42:59.822 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:59.822 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:59.822 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:59.822 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.823 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.823 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25661 3.8 3:1180686c:::rbd_data.1121f2c5ee81.0000000000000009:13 [read 397312~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:42:59.823 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.436956+0000", 2024-09-13T06:42:59.823 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 183.38006300999999, 2024-09-13T06:42:59.823 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089036758999999993, 2024-09-13T06:42:59.823 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:59.823 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:59.823 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:59.823 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:59.823 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:59.823 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25661 2024-09-13T06:42:59.823 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.823 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:59.824 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.824 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:59.824 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436956+0000", 2024-09-13T06:42:59.824 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:59.824 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.824 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.824 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:59.824 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436956+0000", 2024-09-13T06:42:59.824 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:59.824 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.824 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.824 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:59.824 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436956+0000", 2024-09-13T06:42:59.824 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:59.825 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.825 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.825 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:59.825 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436958+0000", 2024-09-13T06:42:59.825 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1770000000000001e-06 2024-09-13T06:42:59.825 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.825 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.825 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:59.826 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436963+0000", 2024-09-13T06:42:59.826 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.6489999999999996e-06 2024-09-13T06:42:59.826 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.826 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.826 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:59.826 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436975+0000", 2024-09-13T06:42:59.826 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1783999999999999e-05 2024-09-13T06:42:59.826 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.827 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.827 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:59.827 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.525671+0000", 2024-09-13T06:42:59.827 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.088696292999999995 2024-09-13T06:42:59.827 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.827 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.827 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:59.827 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.525749+0000", 2024-09-13T06:42:59.827 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.7589000000000005e-05 2024-09-13T06:42:59.827 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.827 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.827 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:59.828 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.525993+0000", 2024-09-13T06:42:59.828 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00024381000000000001 2024-09-13T06:42:59.828 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:59.828 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:59.828 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:59.828 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.828 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.828 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25662 3.8 3:1180686c:::rbd_data.1121f2c5ee81.0000000000000009:13 [read 421888~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:42:59.828 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.436980+0000", 2024-09-13T06:42:59.828 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 183.38003869799999, 2024-09-13T06:42:59.828 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089367577000000004, 2024-09-13T06:42:59.828 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:59.828 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:59.828 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:59.829 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:59.829 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:59.829 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25662 2024-09-13T06:42:59.829 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.829 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:59.829 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.829 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:59.829 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436980+0000", 2024-09-13T06:42:59.829 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:59.829 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.829 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.829 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:59.829 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436980+0000", 2024-09-13T06:42:59.830 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:59.830 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.830 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.830 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:59.830 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436980+0000", 2024-09-13T06:42:59.830 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:59.830 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.830 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.830 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:59.830 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436982+0000", 2024-09-13T06:42:59.830 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3989999999999998e-06 2024-09-13T06:42:59.830 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.830 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.830 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:59.831 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436988+0000", 2024-09-13T06:42:59.831 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0039999999999996e-06 2024-09-13T06:42:59.831 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.831 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.831 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:59.831 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436993+0000", 2024-09-13T06:42:59.831 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6090000000000003e-06 2024-09-13T06:42:59.831 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.831 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.831 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:59.831 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.526035+0000", 2024-09-13T06:42:59.831 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089042248000000004 2024-09-13T06:42:59.831 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.831 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.832 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:59.832 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.526111+0000", 2024-09-13T06:42:59.832 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5643999999999996e-05 2024-09-13T06:42:59.832 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.832 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.832 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:59.832 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.526348+0000", 2024-09-13T06:42:59.832 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00023705800000000001 2024-09-13T06:42:59.832 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:59.832 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:59.832 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:59.832 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.832 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.833 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25663 3.8 3:1180686c:::rbd_data.1121f2c5ee81.0000000000000009:13 [read 466944~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:42:59.833 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.436998+0000", 2024-09-13T06:42:59.833 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 183.380021051, 2024-09-13T06:42:59.833 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089730867000000006, 2024-09-13T06:42:59.833 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:59.833 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:59.833 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:59.833 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:59.833 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:59.833 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25663 2024-09-13T06:42:59.833 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.833 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:59.834 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.834 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:59.834 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436998+0000", 2024-09-13T06:42:59.834 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:59.834 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.834 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.834 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:59.834 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436998+0000", 2024-09-13T06:42:59.834 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:59.834 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.834 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.834 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:59.834 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436998+0000", 2024-09-13T06:42:59.834 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:59.835 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.835 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.835 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:59.835 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437000+0000", 2024-09-13T06:42:59.835 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0940000000000002e-06 2024-09-13T06:42:59.835 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.835 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.835 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:59.835 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437005+0000", 2024-09-13T06:42:59.835 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.604e-06 2024-09-13T06:42:59.835 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.835 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.835 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:59.835 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437032+0000", 2024-09-13T06:42:59.836 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6407e-05 2024-09-13T06:42:59.836 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.836 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.836 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:59.836 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.526363+0000", 2024-09-13T06:42:59.836 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089331456000000004 2024-09-13T06:42:59.836 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.836 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.836 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:59.836 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.526404+0000", 2024-09-13T06:42:59.836 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.0887999999999999e-05 2024-09-13T06:42:59.836 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.837 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.837 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:59.837 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.526729+0000", 2024-09-13T06:42:59.837 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00032486 2024-09-13T06:42:59.837 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:59.837 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:59.837 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:59.837 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.837 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.837 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25664 3.8 3:1180686c:::rbd_data.1121f2c5ee81.0000000000000009:13 [read 491520~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:42:59.837 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.437040+0000", 2024-09-13T06:42:59.837 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 183.379979136, 2024-09-13T06:42:59.837 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.090016650000000004, 2024-09-13T06:42:59.837 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:59.838 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:59.838 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:59.838 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:59.838 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:59.838 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25664 2024-09-13T06:42:59.838 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.838 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:59.838 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.838 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:59.838 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437040+0000", 2024-09-13T06:42:59.838 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:59.838 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.838 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.839 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:59.839 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437040+0000", 2024-09-13T06:42:59.839 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:59.839 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.839 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.839 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:59.839 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437039+0000", 2024-09-13T06:42:59.839 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:59.839 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.839 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.839 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:59.839 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437047+0000", 2024-09-13T06:42:59.839 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4839999999999998e-06 2024-09-13T06:42:59.839 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.840 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.840 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:59.840 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437054+0000", 2024-09-13T06:42:59.840 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.8299999999999998e-06 2024-09-13T06:42:59.840 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.840 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.840 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:59.840 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437060+0000", 2024-09-13T06:42:59.840 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.1510000000000001e-06 2024-09-13T06:42:59.840 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.840 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.840 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:59.840 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.526772+0000", 2024-09-13T06:42:59.841 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089711737999999999 2024-09-13T06:42:59.841 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.841 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.841 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:59.841 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.526848+0000", 2024-09-13T06:42:59.841 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5870000000000004e-05 2024-09-13T06:42:59.841 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.841 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.841 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:59.841 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.527057+0000", 2024-09-13T06:42:59.841 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000209106 2024-09-13T06:42:59.841 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:59.841 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:59.841 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:59.842 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.842 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.842 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25740 3.18 3:1c662b96:::rbd_data.1121f2c5ee81.0000000000000010:13 [read 200704~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:42:59.842 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443352+0000", 2024-09-13T06:42:59.842 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 183.373667461, 2024-09-13T06:42:59.842 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089068222000000002, 2024-09-13T06:42:59.842 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:59.842 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:59.842 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:59.842 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:59.842 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:59.842 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25740 2024-09-13T06:42:59.842 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.842 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:59.843 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.843 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:59.843 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443352+0000", 2024-09-13T06:42:59.843 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:59.843 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.843 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.843 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:59.843 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443352+0000", 2024-09-13T06:42:59.843 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:59.843 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.843 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.843 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:59.843 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443351+0000", 2024-09-13T06:42:59.844 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:59.844 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.844 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.844 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:59.844 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443354+0000", 2024-09-13T06:42:59.844 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.841e-06 2024-09-13T06:42:59.844 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.844 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.844 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:59.844 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443361+0000", 2024-09-13T06:42:59.844 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.0010000000000004e-06 2024-09-13T06:42:59.844 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.845 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.845 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:59.845 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443366+0000", 2024-09-13T06:42:59.845 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7119999999999999e-06 2024-09-13T06:42:59.845 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.845 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.845 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:59.845 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532117+0000", 2024-09-13T06:42:59.845 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.088751327000000005 2024-09-13T06:42:59.845 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.845 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.845 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:59.845 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532193+0000", 2024-09-13T06:42:59.845 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5839000000000004e-05 2024-09-13T06:42:59.846 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.846 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.846 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:59.846 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532420+0000", 2024-09-13T06:42:59.846 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00022691000000000001 2024-09-13T06:42:59.846 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:59.846 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:59.846 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:59.846 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.846 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.846 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25741 3.18 3:1c662b96:::rbd_data.1121f2c5ee81.0000000000000010:13 [read 225280~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:42:59.846 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443378+0000", 2024-09-13T06:42:59.846 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 183.37364069399999, 2024-09-13T06:42:59.847 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089324107, 2024-09-13T06:42:59.847 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:59.847 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:59.847 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:59.847 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:59.847 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:59.847 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25741 2024-09-13T06:42:59.847 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.847 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:59.847 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.847 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:59.847 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443378+0000", 2024-09-13T06:42:59.847 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:59.848 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.848 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.848 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:59.848 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443378+0000", 2024-09-13T06:42:59.848 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:59.848 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.848 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.848 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:59.848 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443378+0000", 2024-09-13T06:42:59.848 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:59.848 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.848 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.848 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:59.849 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443380+0000", 2024-09-13T06:42:59.849 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3549999999999999e-06 2024-09-13T06:42:59.849 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.849 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.849 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:59.849 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443388+0000", 2024-09-13T06:42:59.849 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.7449999999999995e-06 2024-09-13T06:42:59.849 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.849 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.849 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:59.849 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443393+0000", 2024-09-13T06:42:59.849 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.4e-06 2024-09-13T06:42:59.849 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.850 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.850 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:59.850 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532454+0000", 2024-09-13T06:42:59.850 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089060941000000005 2024-09-13T06:42:59.850 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.850 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.850 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:59.850 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532512+0000", 2024-09-13T06:42:59.850 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7763000000000002e-05 2024-09-13T06:42:59.850 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.850 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.850 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:59.850 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532703+0000", 2024-09-13T06:42:59.850 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000190328 2024-09-13T06:42:59.851 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:59.851 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:59.851 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:59.851 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.851 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.851 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25742 3.18 3:1c662b96:::rbd_data.1121f2c5ee81.0000000000000010:13 [read 270336~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:42:59.851 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443398+0000", 2024-09-13T06:42:59.851 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 183.37362098200001, 2024-09-13T06:42:59.851 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089621836999999996, 2024-09-13T06:42:59.851 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:59.851 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:59.851 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:59.851 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:59.851 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:59.852 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25742 2024-09-13T06:42:59.852 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.852 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:59.852 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.852 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:59.852 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443398+0000", 2024-09-13T06:42:59.852 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:59.852 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.852 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.852 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:59.852 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443398+0000", 2024-09-13T06:42:59.852 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:59.853 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.853 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.853 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:59.853 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443398+0000", 2024-09-13T06:42:59.853 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:59.853 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.853 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.853 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:59.853 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443400+0000", 2024-09-13T06:42:59.853 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1849999999999998e-06 2024-09-13T06:42:59.853 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.853 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.853 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:59.853 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443407+0000", 2024-09-13T06:42:59.854 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3669999999999999e-06 2024-09-13T06:42:59.854 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.854 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.854 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:59.854 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443420+0000", 2024-09-13T06:42:59.854 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2645e-05 2024-09-13T06:42:59.854 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.854 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.854 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:59.854 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532742+0000", 2024-09-13T06:42:59.854 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089322200000000004 2024-09-13T06:42:59.854 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.854 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.855 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:59.855 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532818+0000", 2024-09-13T06:42:59.855 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.6019000000000005e-05 2024-09-13T06:42:59.855 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.855 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.855 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:59.855 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533020+0000", 2024-09-13T06:42:59.855 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000201721 2024-09-13T06:42:59.855 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:59.855 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:59.855 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:59.855 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.855 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.855 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25743 3.18 3:1c662b96:::rbd_data.1121f2c5ee81.0000000000000010:13 [read 294912~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:42:59.856 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443425+0000", 2024-09-13T06:42:59.856 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 183.37359397399999, 2024-09-13T06:42:59.856 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089864075000000002, 2024-09-13T06:42:59.856 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:59.856 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:59.856 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:59.856 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:59.856 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:59.856 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25743 2024-09-13T06:42:59.856 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.856 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:59.856 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.857 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:59.857 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443425+0000", 2024-09-13T06:42:59.857 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:59.857 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.857 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.857 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:59.857 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443425+0000", 2024-09-13T06:42:59.857 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:59.857 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.857 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.857 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:59.857 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443425+0000", 2024-09-13T06:42:59.857 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:59.857 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.858 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.858 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:59.858 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443432+0000", 2024-09-13T06:42:59.858 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3420000000000002e-06 2024-09-13T06:42:59.858 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.858 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.858 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:59.858 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443440+0000", 2024-09-13T06:42:59.858 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5689999999999999e-06 2024-09-13T06:42:59.858 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.858 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.858 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:59.858 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443445+0000", 2024-09-13T06:42:59.858 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9590000000000003e-06 2024-09-13T06:42:59.859 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.859 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.859 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:59.859 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533063+0000", 2024-09-13T06:42:59.859 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089617988999999995 2024-09-13T06:42:59.859 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.859 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.859 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:59.859 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533122+0000", 2024-09-13T06:42:59.859 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9052999999999999e-05 2024-09-13T06:42:59.859 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.859 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.859 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:59.860 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533289+0000", 2024-09-13T06:42:59.860 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00016752800000000001 2024-09-13T06:42:59.860 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:59.860 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:59.860 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:59.860 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.860 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.860 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25744 3.18 3.69d46638 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:42:59.860 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443449+0000", 2024-09-13T06:42:59.860 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 183.37356982700001, 2024-09-13T06:42:59.860 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089869148999999995, 2024-09-13T06:42:59.860 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:59.860 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:42:59.861 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:59.861 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:59.861 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:59.861 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25744 2024-09-13T06:42:59.861 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.861 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:59.861 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.861 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:59.861 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443449+0000", 2024-09-13T06:42:59.861 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:59.861 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.861 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.861 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:59.862 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443449+0000", 2024-09-13T06:42:59.862 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:59.862 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.862 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.862 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:59.862 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443449+0000", 2024-09-13T06:42:59.862 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:59.862 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.862 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.862 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:59.862 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443451+0000", 2024-09-13T06:42:59.862 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.244e-06 2024-09-13T06:42:59.862 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.862 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.863 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:59.863 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443457+0000", 2024-09-13T06:42:59.863 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.66e-06 2024-09-13T06:42:59.863 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.863 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.863 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:59.863 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443461+0000", 2024-09-13T06:42:59.863 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5449999999999997e-06 2024-09-13T06:42:59.863 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.863 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.863 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:59.863 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533311+0000", 2024-09-13T06:42:59.863 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089849729000000003 2024-09-13T06:42:59.864 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.864 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.864 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:59.864 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533318+0000", 2024-09-13T06:42:59.864 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.328e-06 2024-09-13T06:42:59.864 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:59.864 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:59.864 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:59.864 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.864 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.864 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25745 3.18 3.69d46638 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:42:59.864 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443466+0000", 2024-09-13T06:42:59.864 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 183.37355276900001, 2024-09-13T06:42:59.864 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089886743000000005, 2024-09-13T06:42:59.865 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:59.865 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:42:59.865 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:59.865 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:59.865 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:59.865 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25745 2024-09-13T06:42:59.865 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.865 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:59.865 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.865 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:59.865 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443466+0000", 2024-09-13T06:42:59.865 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:59.865 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.866 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.866 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:59.866 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443466+0000", 2024-09-13T06:42:59.866 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:59.866 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.866 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.866 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:59.866 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443466+0000", 2024-09-13T06:42:59.866 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:59.866 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.866 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.866 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:59.866 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443474+0000", 2024-09-13T06:42:59.866 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.1289999999999996e-06 2024-09-13T06:42:59.867 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.867 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.867 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:59.867 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443484+0000", 2024-09-13T06:42:59.867 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0654e-05 2024-09-13T06:42:59.867 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.867 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.867 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:59.867 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443490+0000", 2024-09-13T06:42:59.867 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8030000000000002e-06 2024-09-13T06:42:59.867 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.867 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.867 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:59.867 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533348+0000", 2024-09-13T06:42:59.868 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089857267000000005 2024-09-13T06:42:59.868 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.868 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.868 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:59.868 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533353+0000", 2024-09-13T06:42:59.868 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.5520000000000004e-06 2024-09-13T06:42:59.868 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:59.868 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:59.868 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:59.868 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.868 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.868 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25746 3.18 3.69d46638 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:42:59.868 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443495+0000", 2024-09-13T06:42:59.868 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 183.373523656, 2024-09-13T06:42:59.869 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089903725000000004, 2024-09-13T06:42:59.869 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:59.869 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:42:59.869 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:59.869 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:59.869 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:59.869 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25746 2024-09-13T06:42:59.869 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.869 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:59.869 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.869 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:59.869 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443495+0000", 2024-09-13T06:42:59.869 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:59.870 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.870 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.870 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:59.870 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443495+0000", 2024-09-13T06:42:59.870 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:59.870 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.870 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.870 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:59.870 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443495+0000", 2024-09-13T06:42:59.870 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:59.870 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.870 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.870 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:59.870 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443498+0000", 2024-09-13T06:42:59.871 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.7690000000000001e-06 2024-09-13T06:42:59.871 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.871 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.871 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:59.871 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443504+0000", 2024-09-13T06:42:59.871 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9710000000000001e-06 2024-09-13T06:42:59.871 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.871 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.871 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:59.871 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443508+0000", 2024-09-13T06:42:59.871 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4159999999999997e-06 2024-09-13T06:42:59.871 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.871 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.871 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:59.872 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533391+0000", 2024-09-13T06:42:59.872 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089882607000000003 2024-09-13T06:42:59.872 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.872 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.872 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:59.872 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533399+0000", 2024-09-13T06:42:59.872 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.4349999999999997e-06 2024-09-13T06:42:59.872 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:59.872 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:59.872 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:59.872 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.872 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.872 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25747 3.8 3.63996268 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:42:59.872 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443512+0000", 2024-09-13T06:42:59.872 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 183.37350692499999, 2024-09-13T06:42:59.873 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089880075000000004, 2024-09-13T06:42:59.873 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:59.873 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:42:59.873 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:59.873 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:59.873 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:59.873 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25747 2024-09-13T06:42:59.873 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.873 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:59.873 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.873 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:59.873 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443512+0000", 2024-09-13T06:42:59.873 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:59.873 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.874 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.874 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:59.874 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443512+0000", 2024-09-13T06:42:59.874 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:59.874 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.874 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.874 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:59.874 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443512+0000", 2024-09-13T06:42:59.874 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:59.874 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.874 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.874 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:59.874 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443514+0000", 2024-09-13T06:42:59.874 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0980000000000001e-06 2024-09-13T06:42:59.875 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.875 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.875 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:59.875 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443520+0000", 2024-09-13T06:42:59.875 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7069999999999997e-06 2024-09-13T06:42:59.875 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.875 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.875 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:59.875 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443524+0000", 2024-09-13T06:42:59.875 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5390000000000001e-06 2024-09-13T06:42:59.875 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.875 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.875 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:59.875 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533384+0000", 2024-09-13T06:42:59.875 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089859684999999995 2024-09-13T06:42:59.876 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.876 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.876 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:59.876 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533392+0000", 2024-09-13T06:42:59.876 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.3440000000000001e-06 2024-09-13T06:42:59.876 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:59.876 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:59.876 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:59.876 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.876 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.876 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25748 3.8 3.63996268 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:42:59.876 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443528+0000", 2024-09-13T06:42:59.876 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 183.37349079800001, 2024-09-13T06:42:59.877 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089890715999999996, 2024-09-13T06:42:59.877 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:59.877 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:42:59.877 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:59.877 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:59.877 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:59.877 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25748 2024-09-13T06:42:59.877 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.877 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:59.877 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.877 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:59.877 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443528+0000", 2024-09-13T06:42:59.877 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:59.878 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.878 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.878 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:59.878 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443528+0000", 2024-09-13T06:42:59.878 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:59.878 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.878 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.878 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:59.878 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443528+0000", 2024-09-13T06:42:59.878 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:59.878 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.878 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.878 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:59.879 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443530+0000", 2024-09-13T06:42:59.879 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0650000000000001e-06 2024-09-13T06:42:59.879 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.879 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.879 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:59.879 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443536+0000", 2024-09-13T06:42:59.879 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7259999999999999e-06 2024-09-13T06:42:59.879 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.879 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.879 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:59.879 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443540+0000", 2024-09-13T06:42:59.879 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5009999999999998e-06 2024-09-13T06:42:59.879 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.880 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.880 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:59.880 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533412+0000", 2024-09-13T06:42:59.880 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089871873000000005 2024-09-13T06:42:59.880 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.880 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.880 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:59.880 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533419+0000", 2024-09-13T06:42:59.880 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.883e-06 2024-09-13T06:42:59.880 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:59.880 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:59.880 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:59.880 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.880 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.881 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25749 3.8 3.63996268 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:42:59.881 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443545+0000", 2024-09-13T06:42:59.881 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 183.37347460199999, 2024-09-13T06:42:59.881 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089897988999999998, 2024-09-13T06:42:59.881 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:59.881 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:42:59.881 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:59.881 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:59.881 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:59.881 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25749 2024-09-13T06:42:59.881 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.881 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:59.881 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.882 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:59.882 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443545+0000", 2024-09-13T06:42:59.882 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:59.882 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.882 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.882 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:59.882 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443545+0000", 2024-09-13T06:42:59.882 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:59.882 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.882 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.882 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:59.882 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443544+0000", 2024-09-13T06:42:59.882 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:59.882 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.883 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.883 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:59.883 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443553+0000", 2024-09-13T06:42:59.883 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.4770000000000003e-06 2024-09-13T06:42:59.883 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.883 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.883 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:59.883 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443564+0000", 2024-09-13T06:42:59.883 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0986e-05 2024-09-13T06:42:59.883 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.883 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.883 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:59.883 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443569+0000", 2024-09-13T06:42:59.884 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2530000000000004e-06 2024-09-13T06:42:59.884 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.884 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.884 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:59.884 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533438+0000", 2024-09-13T06:42:59.884 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089868641999999999 2024-09-13T06:42:59.884 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.884 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.884 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:59.884 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533442+0000", 2024-09-13T06:42:59.884 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.989e-06 2024-09-13T06:42:59.884 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:59.884 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:59.885 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:59.885 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.885 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.885 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25750 3.8 3.63996268 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:42:59.885 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443574+0000", 2024-09-13T06:42:59.885 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 183.373445116, 2024-09-13T06:42:59.885 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089895143999999996, 2024-09-13T06:42:59.885 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:59.885 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:42:59.885 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:59.885 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:59.885 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:59.886 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25750 2024-09-13T06:42:59.886 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.886 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:59.886 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.886 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:59.886 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443574+0000", 2024-09-13T06:42:59.886 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:59.886 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.886 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.886 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:59.886 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443574+0000", 2024-09-13T06:42:59.886 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:59.886 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.887 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.887 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:59.887 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443574+0000", 2024-09-13T06:42:59.887 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:59.887 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.887 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.887 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:59.887 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443576+0000", 2024-09-13T06:42:59.887 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6910000000000002e-06 2024-09-13T06:42:59.887 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.887 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.887 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:59.887 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443583+0000", 2024-09-13T06:42:59.888 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.331e-06 2024-09-13T06:42:59.888 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.888 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.888 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:59.888 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443587+0000", 2024-09-13T06:42:59.888 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6129999999999997e-06 2024-09-13T06:42:59.888 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.888 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.888 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:59.888 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533464+0000", 2024-09-13T06:42:59.888 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089876605999999998 2024-09-13T06:42:59.888 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.888 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.889 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:59.889 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533469+0000", 2024-09-13T06:42:59.889 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3909999999999997e-06 2024-09-13T06:42:59.889 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:59.889 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:59.889 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:59.889 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.889 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.889 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25751 3.8 3.63996268 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:42:59.889 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443592+0000", 2024-09-13T06:42:59.889 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 183.373427419, 2024-09-13T06:42:59.889 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089913650999999997, 2024-09-13T06:42:59.889 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:59.890 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:42:59.890 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:59.890 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:59.890 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:59.890 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25751 2024-09-13T06:42:59.890 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.890 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:59.890 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.890 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:59.890 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443592+0000", 2024-09-13T06:42:59.890 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:59.890 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.890 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.891 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:59.891 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443592+0000", 2024-09-13T06:42:59.891 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:59.891 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.891 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.891 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:59.891 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443591+0000", 2024-09-13T06:42:59.891 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:59.891 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.891 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.891 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:59.891 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443594+0000", 2024-09-13T06:42:59.891 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3649999999999998e-06 2024-09-13T06:42:59.892 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.892 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.892 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:59.892 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443599+0000", 2024-09-13T06:42:59.892 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.699e-06 2024-09-13T06:42:59.892 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.892 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.892 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:59.892 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443611+0000", 2024-09-13T06:42:59.892 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1503e-05 2024-09-13T06:42:59.892 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.892 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.893 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:59.893 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533497+0000", 2024-09-13T06:42:59.893 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089886453000000005 2024-09-13T06:42:59.893 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.893 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.893 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:59.893 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533505+0000", 2024-09-13T06:42:59.893 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.9910000000000002e-06 2024-09-13T06:42:59.893 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:59.893 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:59.893 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:59.894 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.894 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.894 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25752 3.8 3.63996268 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:42:59.894 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443615+0000", 2024-09-13T06:42:59.894 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 183.37340363800001, 2024-09-13T06:42:59.894 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089905868999999999, 2024-09-13T06:42:59.894 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:59.895 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:42:59.895 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:59.895 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:59.895 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:59.895 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25752 2024-09-13T06:42:59.895 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.895 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:59.895 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.895 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:59.895 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443615+0000", 2024-09-13T06:42:59.895 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:59.895 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.895 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.895 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:59.896 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443615+0000", 2024-09-13T06:42:59.896 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:59.896 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.896 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.896 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:59.896 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443615+0000", 2024-09-13T06:42:59.896 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:42:59.896 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.896 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.896 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:59.896 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443617+0000", 2024-09-13T06:42:59.896 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3539999999999998e-06 2024-09-13T06:42:59.896 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.896 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.897 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:59.897 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443624+0000", 2024-09-13T06:42:59.897 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3600000000000001e-06 2024-09-13T06:42:59.897 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.897 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.897 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:59.897 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443628+0000", 2024-09-13T06:42:59.897 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.2350000000000001e-06 2024-09-13T06:42:59.897 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.897 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.897 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:59.897 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533517+0000", 2024-09-13T06:42:59.897 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089889029999999995 2024-09-13T06:42:59.898 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.898 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.898 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:59.898 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533521+0000", 2024-09-13T06:42:59.898 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.2529999999999998e-06 2024-09-13T06:42:59.898 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:59.898 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:59.898 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:59.898 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.898 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.898 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:64356 3.c 3:32785be9:::rbd_header.11218ba71f0d:head [watch reconnect cookie 140361410387072 gen 2] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e95)", 2024-09-13T06:42:59.898 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:48.473318+0000", 2024-09-13T06:42:59.898 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 131.34370124500001, 2024-09-13T06:42:59.899 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1458904379999999, 2024-09-13T06:42:59.899 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:59.899 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:42:59.899 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:59.899 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:59.899 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:59.899 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 64356 2024-09-13T06:42:59.899 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.899 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:59.899 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.899 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:59.899 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:48.473318+0000", 2024-09-13T06:42:59.899 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:59.900 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.900 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.900 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:59.900 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:48.473318+0000", 2024-09-13T06:42:59.900 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:59.900 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.900 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.900 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:59.900 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:48.473315+0000", 2024-09-13T06:42:59.900 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999971 2024-09-13T06:42:59.900 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.900 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.900 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:59.900 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:48.473329+0000", 2024-09-13T06:42:59.901 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.433e-05 2024-09-13T06:42:59.901 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.901 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.901 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:59.901 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:48.473363+0000", 2024-09-13T06:42:59.901 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.3592e-05 2024-09-13T06:42:59.901 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.901 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.901 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:59.901 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:48.473386+0000", 2024-09-13T06:42:59.901 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2708999999999999e-05 2024-09-13T06:42:59.901 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.901 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.902 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:59.902 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:48.473804+0000", 2024-09-13T06:42:59.902 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00041789399999999998 2024-09-13T06:42:59.902 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.902 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.902 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:42:59.902 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:48.473830+0000", 2024-09-13T06:42:59.902 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6869e-05 2024-09-13T06:42:59.902 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.902 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.902 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:59.902 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:49.614332+0000", 2024-09-13T06:42:59.902 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.140501107 2024-09-13T06:42:59.902 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.902 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.903 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for rw locks", 2024-09-13T06:42:59.903 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:49.614496+0000", 2024-09-13T06:42:59.903 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00016451200000000001 2024-09-13T06:42:59.903 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.903 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.903 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:59.903 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:49.617131+0000", 2024-09-13T06:42:59.903 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.002634843 2024-09-13T06:42:59.903 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.903 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.903 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:42:59.903 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:49.617204+0000", 2024-09-13T06:42:59.903 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.2991000000000006e-05 2024-09-13T06:42:59.903 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.903 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.904 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:59.904 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:49.619208+0000", 2024-09-13T06:42:59.904 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.002004381 2024-09-13T06:42:59.904 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:59.904 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:59.904 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:59.904 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.904 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.904 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:170155 3.7 3:e17728eb:::image_client.0-clone36.rbd:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e191)", 2024-09-13T06:42:59.904 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:42:31.436412+0000", 2024-09-13T06:42:59.904 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 28.380607422000001, 2024-09-13T06:42:59.904 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.97843703800000004, 2024-09-13T06:42:59.904 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:42:59.905 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:42:59.905 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:42:59.905 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:42:59.905 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:42:59.905 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 170155 2024-09-13T06:42:59.905 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.905 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:42:59.905 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.905 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:42:59.905 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:31.436412+0000", 2024-09-13T06:42:59.905 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:59.905 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.905 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.905 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:42:59.906 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:31.436412+0000", 2024-09-13T06:42:59.906 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:42:59.906 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.906 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.906 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:42:59.906 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:31.436410+0000", 2024-09-13T06:42:59.906 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999986 2024-09-13T06:42:59.906 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.906 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.906 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:42:59.906 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:31.436417+0000", 2024-09-13T06:42:59.906 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.6939999999999998e-06 2024-09-13T06:42:59.906 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.906 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.907 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:42:59.907 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:31.436430+0000", 2024-09-13T06:42:59.907 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3016999999999999e-05 2024-09-13T06:42:59.907 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.907 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.907 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:42:59.907 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:31.436437+0000", 2024-09-13T06:42:59.907 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.1069999999999999e-06 2024-09-13T06:42:59.907 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.907 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.907 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:59.907 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:31.436515+0000", 2024-09-13T06:42:59.907 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.7756000000000006e-05 2024-09-13T06:42:59.907 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.908 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.908 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:42:59.908 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:31.436523+0000", 2024-09-13T06:42:59.908 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.4970000000000001e-06 2024-09-13T06:42:59.908 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.908 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.908 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:42:59.908 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:32.414565+0000", 2024-09-13T06:42:59.908 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.97804144199999998 2024-09-13T06:42:59.908 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:42:59.908 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:42:59.908 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:42:59.908 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:32.414849+0000", 2024-09-13T06:42:59.909 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00028388600000000001 2024-09-13T06:42:59.909 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:59.909 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:59.909 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:59.909 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:42:59.909 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:42:59.909 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:42:59.911 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-13T06:42:59.911 INFO:teuthology.orchestra.run.smithi081.stdout:checking clone #40, image image_client.0-clone40 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent41 2024-09-13T06:42:59.911 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:42:59.912+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:43:00.011 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:43:00.012+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:43:00.042 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:43:00.043 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [], 2024-09-13T06:43:00.043 INFO:teuthology.orchestra.run.smithi139.stdout: "num_ops": 0 2024-09-13T06:43:00.043 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:43:00.057 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-13T06:43:00.112 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:43:00.112+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:43:00.174 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:43:00.174 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [], 2024-09-13T06:43:00.174 INFO:teuthology.orchestra.run.smithi139.stdout: "complaint_time": 30, 2024-09-13T06:43:00.175 INFO:teuthology.orchestra.run.smithi139.stdout: "num_blocked_ops": 0 2024-09-13T06:43:00.175 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:43:00.190 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-13T06:43:00.213 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:43:00.212+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:43:00.279 INFO:teuthology.orchestra.run.smithi081.stdout:5781 write 0xb688c44 thru 0xb6920b5 (0x9472 bytes) 2024-09-13T06:43:00.281 INFO:teuthology.orchestra.run.smithi081.stdout:5782 punch from 0x3225745 to 0x3229fd5, (0x4890 bytes) 2024-09-13T06:43:00.292 INFO:teuthology.orchestra.run.smithi081.stdout:5783 writesame 0xdcf5b55 thru 0xdd04b23 data_size 0x1(0xefcf bytes) 2024-09-13T06:43:00.308 INFO:teuthology.orchestra.run.smithi081.stdout:5784 trunc from 0xdd04b24 to 0x3595ee7 2024-09-13T06:43:00.314 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:43:00.312+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:43:00.319 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:43:00.319 INFO:teuthology.orchestra.run.smithi139.stdout: "size": 20, 2024-09-13T06:43:00.319 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 600, 2024-09-13T06:43:00.319 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [ 2024-09-13T06:43:00.319 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.319 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18706 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 3346432~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:43:00.319 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.846138+0000", 2024-09-13T06:43:00.320 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 188.47144503600001, 2024-09-13T06:43:00.320 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.102018712, 2024-09-13T06:43:00.320 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:00.320 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:00.320 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:00.320 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:00.320 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:00.320 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18706 2024-09-13T06:43:00.320 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.320 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:00.320 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.320 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:00.320 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846138+0000", 2024-09-13T06:43:00.321 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:00.321 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.321 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.321 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:00.321 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846138+0000", 2024-09-13T06:43:00.321 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:00.321 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.321 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.321 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:00.321 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846138+0000", 2024-09-13T06:43:00.324 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:00.324 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.324 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.324 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:00.324 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846141+0000", 2024-09-13T06:43:00.324 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.6969999999999999e-06 2024-09-13T06:43:00.324 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.324 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.324 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:00.325 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846150+0000", 2024-09-13T06:43:00.325 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6400000000000003e-06 2024-09-13T06:43:00.325 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.325 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.325 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:00.325 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846160+0000", 2024-09-13T06:43:00.325 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.3999999999999998e-06 2024-09-13T06:43:00.325 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.325 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.325 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:00.325 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.947764+0000", 2024-09-13T06:43:00.325 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101604085 2024-09-13T06:43:00.325 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.326 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.326 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:00.326 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.947888+0000", 2024-09-13T06:43:00.326 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000124113 2024-09-13T06:43:00.326 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.326 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.326 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:00.326 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.948157+0000", 2024-09-13T06:43:00.326 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00026943399999999998 2024-09-13T06:43:00.326 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:00.326 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:00.326 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:00.326 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.327 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.327 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18707 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 3375104~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:43:00.327 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.846207+0000", 2024-09-13T06:43:00.327 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 188.47137627000001, 2024-09-13T06:43:00.327 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10238114099999999, 2024-09-13T06:43:00.327 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:00.327 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:00.327 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:00.327 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:00.327 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:00.327 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18707 2024-09-13T06:43:00.327 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.327 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:00.328 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.328 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:00.328 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846207+0000", 2024-09-13T06:43:00.328 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:00.328 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.328 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.328 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:00.328 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846207+0000", 2024-09-13T06:43:00.328 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:00.328 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.328 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.328 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:00.328 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846206+0000", 2024-09-13T06:43:00.329 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:43:00.329 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.329 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.329 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:00.329 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846211+0000", 2024-09-13T06:43:00.329 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.3000000000000003e-06 2024-09-13T06:43:00.329 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.329 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.329 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:00.329 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846220+0000", 2024-09-13T06:43:00.329 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6199999999999994e-06 2024-09-13T06:43:00.329 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.329 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.330 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:00.330 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846228+0000", 2024-09-13T06:43:00.330 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.7500000000000003e-06 2024-09-13T06:43:00.330 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.330 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.330 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:00.330 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.948267+0000", 2024-09-13T06:43:00.330 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10203878700000001 2024-09-13T06:43:00.330 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.330 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.330 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:00.330 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.948435+0000", 2024-09-13T06:43:00.330 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00016796500000000001 2024-09-13T06:43:00.330 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.331 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.331 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:00.331 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.948588+0000", 2024-09-13T06:43:00.331 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00015373599999999999 2024-09-13T06:43:00.331 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:00.331 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:00.331 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:00.331 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.331 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.331 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18718 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 3690496~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:43:00.331 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.850174+0000", 2024-09-13T06:43:00.331 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 188.46740911699999, 2024-09-13T06:43:00.331 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101854154, 2024-09-13T06:43:00.332 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:00.332 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:00.332 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:00.332 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:00.332 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:00.332 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18718 2024-09-13T06:43:00.332 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.332 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:00.332 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.332 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:00.332 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850174+0000", 2024-09-13T06:43:00.332 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:00.332 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.333 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.333 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:00.333 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850174+0000", 2024-09-13T06:43:00.333 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:00.333 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.333 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.333 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:00.333 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850173+0000", 2024-09-13T06:43:00.333 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:43:00.333 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.333 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.333 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:00.333 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850178+0000", 2024-09-13T06:43:00.334 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.4129999999999999e-06 2024-09-13T06:43:00.334 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.334 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.334 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:00.334 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850188+0000", 2024-09-13T06:43:00.334 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.8600000000000005e-06 2024-09-13T06:43:00.334 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.334 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.334 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:00.334 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850195+0000", 2024-09-13T06:43:00.334 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.8730000000000007e-06 2024-09-13T06:43:00.334 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.334 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.335 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:00.335 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.951766+0000", 2024-09-13T06:43:00.335 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.1015703 2024-09-13T06:43:00.335 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.335 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.335 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:00.335 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.951879+0000", 2024-09-13T06:43:00.335 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000112932 2024-09-13T06:43:00.335 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.335 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.335 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:00.335 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.952029+0000", 2024-09-13T06:43:00.335 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000149846 2024-09-13T06:43:00.336 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:00.336 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:00.336 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:00.336 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.336 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.336 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18719 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 3719168~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:43:00.336 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.850202+0000", 2024-09-13T06:43:00.336 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 188.467381074, 2024-09-13T06:43:00.336 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.102191676, 2024-09-13T06:43:00.336 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:00.336 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:00.336 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:00.337 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:00.337 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:00.337 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18719 2024-09-13T06:43:00.337 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.337 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:00.337 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.337 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:00.337 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850202+0000", 2024-09-13T06:43:00.337 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:00.338 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.338 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.338 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:00.338 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850202+0000", 2024-09-13T06:43:00.338 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:00.338 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.338 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.338 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:00.338 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850202+0000", 2024-09-13T06:43:00.338 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:43:00.338 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.338 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.339 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:00.339 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850205+0000", 2024-09-13T06:43:00.339 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.89e-06 2024-09-13T06:43:00.339 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.339 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.339 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:00.339 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850216+0000", 2024-09-13T06:43:00.339 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0233e-05 2024-09-13T06:43:00.339 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.339 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.339 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:00.339 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850223+0000", 2024-09-13T06:43:00.339 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5299999999999999e-06 2024-09-13T06:43:00.339 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.340 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.340 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:00.340 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.952106+0000", 2024-09-13T06:43:00.340 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10188309299999999 2024-09-13T06:43:00.340 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.340 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.340 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:00.340 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.952233+0000", 2024-09-13T06:43:00.340 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000126993 2024-09-13T06:43:00.340 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.340 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.340 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:00.341 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.952394+0000", 2024-09-13T06:43:00.341 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000160791 2024-09-13T06:43:00.341 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:00.341 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:00.341 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:00.341 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.341 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.341 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18720 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 3747840~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:43:00.341 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.850726+0000", 2024-09-13T06:43:00.341 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 188.466857245, 2024-09-13T06:43:00.341 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10199504299999999, 2024-09-13T06:43:00.341 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:00.342 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:00.342 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:00.342 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:00.342 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:00.342 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18720 2024-09-13T06:43:00.342 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.342 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:00.342 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.342 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:00.342 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850726+0000", 2024-09-13T06:43:00.342 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:00.342 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.342 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.342 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:00.343 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850726+0000", 2024-09-13T06:43:00.343 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:00.343 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.343 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.343 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:00.343 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850229+0000", 2024-09-13T06:43:00.343 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9995027 2024-09-13T06:43:00.343 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.343 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.343 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:00.343 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850731+0000", 2024-09-13T06:43:00.343 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00050221599999999999 2024-09-13T06:43:00.343 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.344 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.344 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:00.344 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850751+0000", 2024-09-13T06:43:00.344 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.9703000000000001e-05 2024-09-13T06:43:00.344 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.344 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.344 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:00.344 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850764+0000", 2024-09-13T06:43:00.344 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3207000000000001e-05 2024-09-13T06:43:00.344 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.344 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.344 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:00.345 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.952454+0000", 2024-09-13T06:43:00.345 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101690102 2024-09-13T06:43:00.345 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.345 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.345 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:00.345 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.952571+0000", 2024-09-13T06:43:00.345 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000116556 2024-09-13T06:43:00.345 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.345 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.345 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:00.345 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.952721+0000", 2024-09-13T06:43:00.345 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000150419 2024-09-13T06:43:00.345 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:00.346 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:00.346 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:00.346 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.346 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.346 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18730 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 4034560~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:43:00.346 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.854013+0000", 2024-09-13T06:43:00.346 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 188.463570304, 2024-09-13T06:43:00.346 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10186914399999999, 2024-09-13T06:43:00.346 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:00.346 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:00.346 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:00.346 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:00.346 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:00.346 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18730 2024-09-13T06:43:00.347 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.347 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:00.347 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.347 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:00.347 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.854013+0000", 2024-09-13T06:43:00.347 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:00.347 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.347 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.347 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:00.347 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.854013+0000", 2024-09-13T06:43:00.347 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:00.347 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.347 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.347 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:00.348 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.854013+0000", 2024-09-13T06:43:00.348 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:00.348 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.348 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.348 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:00.348 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.854016+0000", 2024-09-13T06:43:00.348 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.1839999999999999e-06 2024-09-13T06:43:00.348 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.348 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.348 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:00.348 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.854025+0000", 2024-09-13T06:43:00.348 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.8030000000000003e-06 2024-09-13T06:43:00.348 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.349 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.349 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:00.349 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.854033+0000", 2024-09-13T06:43:00.349 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6500000000000002e-06 2024-09-13T06:43:00.349 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.349 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.349 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:00.349 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.955546+0000", 2024-09-13T06:43:00.349 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10151296 2024-09-13T06:43:00.349 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.349 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.349 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:00.349 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.955694+0000", 2024-09-13T06:43:00.349 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000147773 2024-09-13T06:43:00.350 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.350 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.350 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:00.350 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.955882+0000", 2024-09-13T06:43:00.350 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000188371 2024-09-13T06:43:00.350 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:00.350 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:00.350 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:00.350 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.350 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.350 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18742 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 4378624~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:43:00.350 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.857984+0000", 2024-09-13T06:43:00.350 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 188.45959918099999, 2024-09-13T06:43:00.350 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10179961799999999, 2024-09-13T06:43:00.351 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:00.351 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:00.351 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:00.351 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:00.351 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:00.351 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18742 2024-09-13T06:43:00.351 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.351 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:00.351 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.351 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:00.351 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.857984+0000", 2024-09-13T06:43:00.351 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:00.351 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.352 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.352 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:00.352 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.857984+0000", 2024-09-13T06:43:00.352 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:00.352 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.352 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.352 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:00.352 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.857983+0000", 2024-09-13T06:43:00.352 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:43:00.352 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.352 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.352 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:00.353 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.857987+0000", 2024-09-13T06:43:00.353 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0670000000000002e-06 2024-09-13T06:43:00.353 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.353 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.353 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:00.353 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.857997+0000", 2024-09-13T06:43:00.353 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6830000000000003e-06 2024-09-13T06:43:00.353 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.353 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.353 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:00.353 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.858006+0000", 2024-09-13T06:43:00.353 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.5739999999999996e-06 2024-09-13T06:43:00.353 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.354 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.354 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:00.354 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.959453+0000", 2024-09-13T06:43:00.354 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101447339 2024-09-13T06:43:00.354 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.354 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.354 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:00.354 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.959603+0000", 2024-09-13T06:43:00.354 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000150316 2024-09-13T06:43:00.354 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.354 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.354 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:00.354 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.959784+0000", 2024-09-13T06:43:00.355 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00018065900000000001 2024-09-13T06:43:00.355 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:00.355 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:00.355 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:00.355 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.355 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.355 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18743 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 4407296~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:43:00.355 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.858012+0000", 2024-09-13T06:43:00.355 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 188.45957118800001, 2024-09-13T06:43:00.355 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10210024500000001, 2024-09-13T06:43:00.355 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:00.355 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:00.355 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:00.356 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:00.356 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:00.356 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18743 2024-09-13T06:43:00.356 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.356 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:00.356 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.356 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:00.356 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.858012+0000", 2024-09-13T06:43:00.356 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:00.356 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.356 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.356 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:00.356 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.858012+0000", 2024-09-13T06:43:00.357 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:00.357 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.357 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.357 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:00.357 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.858011+0000", 2024-09-13T06:43:00.357 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:43:00.357 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.357 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.357 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:00.357 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.858016+0000", 2024-09-13T06:43:00.357 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0659999999999997e-06 2024-09-13T06:43:00.357 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.357 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.357 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:00.358 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.858024+0000", 2024-09-13T06:43:00.358 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.7700000000000007e-06 2024-09-13T06:43:00.358 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.358 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.358 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:00.358 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.858032+0000", 2024-09-13T06:43:00.358 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.7700000000000001e-06 2024-09-13T06:43:00.358 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.358 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.358 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:00.358 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.959850+0000", 2024-09-13T06:43:00.358 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.1018182 2024-09-13T06:43:00.358 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.359 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.359 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:00.359 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.959964+0000", 2024-09-13T06:43:00.359 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00011413600000000001 2024-09-13T06:43:00.359 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.359 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.359 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:00.359 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.960113+0000", 2024-09-13T06:43:00.359 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00014813900000000001 2024-09-13T06:43:00.359 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:00.359 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:00.359 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:00.359 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.360 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.360 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18755 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 4751360~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:43:00.360 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.862061+0000", 2024-09-13T06:43:00.360 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 188.45552293599999, 2024-09-13T06:43:00.360 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101907023, 2024-09-13T06:43:00.360 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:00.360 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:00.360 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:00.360 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:00.360 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:00.360 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18755 2024-09-13T06:43:00.360 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.360 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:00.361 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.361 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:00.361 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862061+0000", 2024-09-13T06:43:00.361 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:00.361 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.361 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.361 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:00.361 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862061+0000", 2024-09-13T06:43:00.361 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:00.361 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.361 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.361 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:00.361 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862060+0000", 2024-09-13T06:43:00.362 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:43:00.362 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.362 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.362 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:00.362 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862064+0000", 2024-09-13T06:43:00.362 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.3229999999999999e-06 2024-09-13T06:43:00.362 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.362 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.362 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:00.362 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862078+0000", 2024-09-13T06:43:00.362 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.433e-05 2024-09-13T06:43:00.362 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.362 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.362 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:00.362 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862086+0000", 2024-09-13T06:43:00.363 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.3869999999999997e-06 2024-09-13T06:43:00.363 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.363 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.363 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:00.363 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.963635+0000", 2024-09-13T06:43:00.363 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101549606 2024-09-13T06:43:00.363 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.363 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.363 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:00.363 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.963783+0000", 2024-09-13T06:43:00.363 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000147312 2024-09-13T06:43:00.363 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.363 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.363 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:00.363 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.963968+0000", 2024-09-13T06:43:00.364 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000185028 2024-09-13T06:43:00.364 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:00.364 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:00.364 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:00.364 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.364 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.364 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18756 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 4780032~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:43:00.364 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.862132+0000", 2024-09-13T06:43:00.364 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 188.45545109299999, 2024-09-13T06:43:00.364 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.102159295, 2024-09-13T06:43:00.364 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:00.364 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:00.364 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:00.365 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:00.365 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:00.365 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18756 2024-09-13T06:43:00.365 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.365 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:00.365 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.365 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:00.365 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862132+0000", 2024-09-13T06:43:00.365 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:00.365 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.365 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.365 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:00.365 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862132+0000", 2024-09-13T06:43:00.365 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:00.366 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.366 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.366 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:00.366 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862132+0000", 2024-09-13T06:43:00.366 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:43:00.366 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.366 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.366 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:00.366 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862136+0000", 2024-09-13T06:43:00.366 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.9559999999999999e-06 2024-09-13T06:43:00.366 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.366 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.366 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:00.367 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862145+0000", 2024-09-13T06:43:00.367 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6169999999999996e-06 2024-09-13T06:43:00.367 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.367 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.367 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:00.367 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862153+0000", 2024-09-13T06:43:00.367 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.8359999999999992e-06 2024-09-13T06:43:00.367 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.367 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.367 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:00.367 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.964018+0000", 2024-09-13T06:43:00.367 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101865421 2024-09-13T06:43:00.367 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.367 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.368 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:00.368 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.964140+0000", 2024-09-13T06:43:00.368 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000121172 2024-09-13T06:43:00.368 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.368 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.368 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:00.368 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.964292+0000", 2024-09-13T06:43:00.368 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00015202600000000001 2024-09-13T06:43:00.368 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:00.368 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:00.368 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:00.368 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.368 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.368 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18768 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 5124096~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:43:00.369 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.866345+0000", 2024-09-13T06:43:00.369 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 188.451238786, 2024-09-13T06:43:00.369 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101779361, 2024-09-13T06:43:00.369 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:00.369 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:00.369 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:00.369 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:00.369 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:00.369 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18768 2024-09-13T06:43:00.369 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.369 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:00.369 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.369 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:00.370 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.866345+0000", 2024-09-13T06:43:00.370 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:00.370 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.370 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.370 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:00.370 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.866345+0000", 2024-09-13T06:43:00.370 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:00.370 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.370 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.370 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:00.370 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.866344+0000", 2024-09-13T06:43:00.370 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:00.370 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.370 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.370 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:00.371 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.866348+0000", 2024-09-13T06:43:00.371 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.4300000000000002e-06 2024-09-13T06:43:00.371 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.371 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.371 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:00.371 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.866356+0000", 2024-09-13T06:43:00.371 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.5930000000000006e-06 2024-09-13T06:43:00.371 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.371 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.371 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:00.371 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.866364+0000", 2024-09-13T06:43:00.371 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5599999999999996e-06 2024-09-13T06:43:00.371 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.371 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.372 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:00.372 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.967865+0000", 2024-09-13T06:43:00.372 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101501683 2024-09-13T06:43:00.372 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.372 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.372 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:00.372 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.967981+0000", 2024-09-13T06:43:00.372 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000115643 2024-09-13T06:43:00.372 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.372 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.372 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:00.372 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.968124+0000", 2024-09-13T06:43:00.372 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00014305500000000001 2024-09-13T06:43:00.373 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:00.373 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:00.373 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:00.373 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.373 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.373 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18779 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 5439488~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:43:00.373 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.869996+0000", 2024-09-13T06:43:00.373 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 188.44758790099999, 2024-09-13T06:43:00.373 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10189577399999999, 2024-09-13T06:43:00.373 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:00.373 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:00.373 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:00.373 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:00.374 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:00.374 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18779 2024-09-13T06:43:00.374 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.374 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:00.374 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.374 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:00.374 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.869996+0000", 2024-09-13T06:43:00.374 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:00.374 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.374 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.374 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:00.374 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.869996+0000", 2024-09-13T06:43:00.374 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:00.374 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.375 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.375 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:00.375 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.869995+0000", 2024-09-13T06:43:00.375 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:00.375 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.375 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.375 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:00.375 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.869998+0000", 2024-09-13T06:43:00.375 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.2729999999999998e-06 2024-09-13T06:43:00.375 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.375 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.375 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:00.375 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.870007+0000", 2024-09-13T06:43:00.375 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.5760000000000006e-06 2024-09-13T06:43:00.376 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.376 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.376 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:00.376 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.870014+0000", 2024-09-13T06:43:00.376 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.1400000000000002e-06 2024-09-13T06:43:00.376 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.376 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.376 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:00.376 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.971631+0000", 2024-09-13T06:43:00.376 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101617503 2024-09-13T06:43:00.376 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.376 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.377 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:00.377 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.971747+0000", 2024-09-13T06:43:00.377 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00011599600000000001 2024-09-13T06:43:00.377 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.377 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.377 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:00.377 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.971891+0000", 2024-09-13T06:43:00.377 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000143912 2024-09-13T06:43:00.377 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:00.377 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:00.377 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:00.377 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.377 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.378 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18792 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 5812224~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:43:00.378 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.874371+0000", 2024-09-13T06:43:00.378 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 188.44321277099999, 2024-09-13T06:43:00.378 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101736005, 2024-09-13T06:43:00.378 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:00.378 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:00.378 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:00.378 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:00.378 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:00.378 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18792 2024-09-13T06:43:00.378 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.378 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:00.378 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.379 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:00.379 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874371+0000", 2024-09-13T06:43:00.379 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:00.379 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.379 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.379 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:00.379 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874371+0000", 2024-09-13T06:43:00.379 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:00.379 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.379 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.379 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:00.379 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874370+0000", 2024-09-13T06:43:00.379 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:00.379 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.380 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.380 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:00.380 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874374+0000", 2024-09-13T06:43:00.380 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.7239999999999998e-06 2024-09-13T06:43:00.380 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.380 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.380 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:00.380 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874385+0000", 2024-09-13T06:43:00.380 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1293e-05 2024-09-13T06:43:00.380 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.380 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.380 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:00.380 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874394+0000", 2024-09-13T06:43:00.381 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.0729999999999994e-06 2024-09-13T06:43:00.381 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.381 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.381 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:00.381 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.975850+0000", 2024-09-13T06:43:00.381 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10145599700000001 2024-09-13T06:43:00.381 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.381 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.381 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:00.381 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.975963+0000", 2024-09-13T06:43:00.381 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000112689 2024-09-13T06:43:00.381 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.381 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.382 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:00.382 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.976107+0000", 2024-09-13T06:43:00.382 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000143836 2024-09-13T06:43:00.382 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:00.382 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:00.382 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:00.382 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.382 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.382 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18793 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 5840896~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:43:00.382 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.874401+0000", 2024-09-13T06:43:00.382 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 188.44318273799999, 2024-09-13T06:43:00.382 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.102005516, 2024-09-13T06:43:00.382 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:00.383 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:00.383 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:00.383 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:00.383 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:00.383 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18793 2024-09-13T06:43:00.383 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.383 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:00.383 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.383 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:00.383 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874401+0000", 2024-09-13T06:43:00.383 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:00.383 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.383 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.384 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:00.384 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874401+0000", 2024-09-13T06:43:00.384 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:00.384 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.384 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.384 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:00.384 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874400+0000", 2024-09-13T06:43:00.384 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:43:00.384 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.384 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.384 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:00.385 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874404+0000", 2024-09-13T06:43:00.385 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0069999999999999e-06 2024-09-13T06:43:00.385 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.385 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.385 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:00.385 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874412+0000", 2024-09-13T06:43:00.385 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.5399999999999996e-06 2024-09-13T06:43:00.385 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.385 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.385 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:00.385 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874420+0000", 2024-09-13T06:43:00.385 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.6199999999999999e-06 2024-09-13T06:43:00.386 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.386 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.386 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:00.386 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.976150+0000", 2024-09-13T06:43:00.386 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101729874 2024-09-13T06:43:00.386 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.386 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.386 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:00.386 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.976261+0000", 2024-09-13T06:43:00.386 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000110819 2024-09-13T06:43:00.386 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.386 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.386 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:00.387 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.976406+0000", 2024-09-13T06:43:00.387 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000145489 2024-09-13T06:43:00.387 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:00.387 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:00.387 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:00.387 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.387 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.387 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18803 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 6127616~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:43:00.387 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.877851+0000", 2024-09-13T06:43:00.387 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 188.43973224499999, 2024-09-13T06:43:00.387 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101951584, 2024-09-13T06:43:00.387 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:00.387 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:00.388 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:00.388 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:00.388 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:00.388 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18803 2024-09-13T06:43:00.388 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.388 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:00.388 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.388 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:00.388 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.877851+0000", 2024-09-13T06:43:00.388 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:00.388 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.388 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.388 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:00.389 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.877851+0000", 2024-09-13T06:43:00.389 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:00.389 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.389 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.389 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:00.389 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.877851+0000", 2024-09-13T06:43:00.389 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:00.389 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.389 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.389 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:00.389 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.877854+0000", 2024-09-13T06:43:00.389 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.7929999999999999e-06 2024-09-13T06:43:00.389 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.390 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.390 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:00.390 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.877864+0000", 2024-09-13T06:43:00.390 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.2029999999999998e-06 2024-09-13T06:43:00.390 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.390 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.390 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:00.390 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.877873+0000", 2024-09-13T06:43:00.390 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.0440000000000001e-06 2024-09-13T06:43:00.390 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.390 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.390 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:00.390 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.979544+0000", 2024-09-13T06:43:00.391 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101671198 2024-09-13T06:43:00.391 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.391 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.391 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:00.391 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.979658+0000", 2024-09-13T06:43:00.391 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000114456 2024-09-13T06:43:00.391 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.391 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.391 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:00.391 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.979803+0000", 2024-09-13T06:43:00.391 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000144506 2024-09-13T06:43:00.391 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:00.391 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:00.391 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:00.392 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.392 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.392 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18807 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 6242304~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:43:00.392 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.879235+0000", 2024-09-13T06:43:00.392 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 188.43834821499999, 2024-09-13T06:43:00.392 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101781258, 2024-09-13T06:43:00.392 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:00.392 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:00.392 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:00.392 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:00.392 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:00.392 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18807 2024-09-13T06:43:00.392 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.393 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:00.393 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.393 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:00.393 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879235+0000", 2024-09-13T06:43:00.393 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:00.393 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.393 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.393 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:00.393 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879235+0000", 2024-09-13T06:43:00.393 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:00.393 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.393 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.394 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:00.394 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879235+0000", 2024-09-13T06:43:00.394 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:00.394 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.394 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.394 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:00.394 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879239+0000", 2024-09-13T06:43:00.394 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.963e-06 2024-09-13T06:43:00.394 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.394 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.394 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:00.394 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879247+0000", 2024-09-13T06:43:00.394 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6470000000000004e-06 2024-09-13T06:43:00.394 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.395 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.395 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:00.395 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879255+0000", 2024-09-13T06:43:00.395 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5429999999999996e-06 2024-09-13T06:43:00.395 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.395 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.395 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:00.395 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.980756+0000", 2024-09-13T06:43:00.395 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10150165999999999 2024-09-13T06:43:00.395 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.395 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.395 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:00.395 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.980868+0000", 2024-09-13T06:43:00.396 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000111196 2024-09-13T06:43:00.396 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.396 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.396 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:00.396 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.981017+0000", 2024-09-13T06:43:00.396 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000148846 2024-09-13T06:43:00.396 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:00.396 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:00.396 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:00.396 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.396 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.396 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18808 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 6270976~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:43:00.396 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.879261+0000", 2024-09-13T06:43:00.397 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 188.43832207599999, 2024-09-13T06:43:00.397 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.102057547, 2024-09-13T06:43:00.397 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:00.397 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:00.397 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:00.397 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:00.397 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:00.397 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18808 2024-09-13T06:43:00.397 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.397 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:00.397 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.397 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:00.397 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879261+0000", 2024-09-13T06:43:00.398 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:00.398 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.398 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.398 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:00.398 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879261+0000", 2024-09-13T06:43:00.398 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:00.398 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.398 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.398 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:00.398 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879261+0000", 2024-09-13T06:43:00.398 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:00.398 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.398 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.399 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:00.399 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879264+0000", 2024-09-13T06:43:00.399 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.523e-06 2024-09-13T06:43:00.399 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.399 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.399 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:00.399 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879273+0000", 2024-09-13T06:43:00.399 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6070000000000008e-06 2024-09-13T06:43:00.399 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.399 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.399 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:00.399 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879280+0000", 2024-09-13T06:43:00.399 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.4699999999999996e-06 2024-09-13T06:43:00.400 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.400 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.400 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:00.400 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.981060+0000", 2024-09-13T06:43:00.400 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10177934800000001 2024-09-13T06:43:00.400 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.400 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.400 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:00.400 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.981174+0000", 2024-09-13T06:43:00.400 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000114456 2024-09-13T06:43:00.400 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.400 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.400 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:00.401 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.981319+0000", 2024-09-13T06:43:00.401 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00014473900000000001 2024-09-13T06:43:00.401 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:00.401 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:00.401 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:00.401 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.401 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.401 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18811 3.9 3.140f5209 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:43:00.401 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.880449+0000", 2024-09-13T06:43:00.401 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 188.43713453800001, 2024-09-13T06:43:00.401 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101739355, 2024-09-13T06:43:00.401 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:00.402 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:43:00.402 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:00.402 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:00.402 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:00.402 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18811 2024-09-13T06:43:00.402 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.402 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:00.402 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.402 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:00.402 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880449+0000", 2024-09-13T06:43:00.402 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:00.402 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.402 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.402 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:00.402 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880449+0000", 2024-09-13T06:43:00.403 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:00.403 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.403 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.403 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:00.403 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880448+0000", 2024-09-13T06:43:00.403 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:43:00.403 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.403 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.403 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:00.403 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880452+0000", 2024-09-13T06:43:00.403 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0470000000000004e-06 2024-09-13T06:43:00.403 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.403 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.403 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:00.404 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880462+0000", 2024-09-13T06:43:00.404 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6530000000000006e-06 2024-09-13T06:43:00.404 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.404 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.404 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:00.404 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880472+0000", 2024-09-13T06:43:00.404 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0027000000000001e-05 2024-09-13T06:43:00.404 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.404 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.404 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:00.404 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.982172+0000", 2024-09-13T06:43:00.404 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10170043500000001 2024-09-13T06:43:00.404 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.404 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.405 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:00.405 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.982188+0000", 2024-09-13T06:43:00.405 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6172999999999999e-05 2024-09-13T06:43:00.405 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:00.405 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:00.405 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:00.405 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.405 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.405 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18812 3.9 3.140f5209 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:43:00.405 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.880478+0000", 2024-09-13T06:43:00.405 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 188.437105301, 2024-09-13T06:43:00.405 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10177795100000001, 2024-09-13T06:43:00.405 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:00.406 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:43:00.406 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:00.406 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:00.406 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:00.406 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18812 2024-09-13T06:43:00.406 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.406 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:00.406 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.406 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:00.406 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880478+0000", 2024-09-13T06:43:00.406 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:00.406 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.406 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.406 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:00.407 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880478+0000", 2024-09-13T06:43:00.407 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:00.407 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.407 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.407 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:00.407 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880477+0000", 2024-09-13T06:43:00.407 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:43:00.407 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.407 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.407 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:00.407 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880481+0000", 2024-09-13T06:43:00.407 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.827e-06 2024-09-13T06:43:00.407 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.408 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.408 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:00.408 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880490+0000", 2024-09-13T06:43:00.408 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6100000000000006e-06 2024-09-13T06:43:00.408 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.408 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.408 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:00.408 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880497+0000", 2024-09-13T06:43:00.408 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.7030000000000006e-06 2024-09-13T06:43:00.408 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.408 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.408 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:00.408 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.982241+0000", 2024-09-13T06:43:00.408 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10174351199999999 2024-09-13T06:43:00.409 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.409 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.409 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:00.409 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.982256+0000", 2024-09-13T06:43:00.409 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5143000000000001e-05 2024-09-13T06:43:00.409 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:00.409 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:00.409 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:00.409 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.409 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.409 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:160483 3.a 3:57f62123:::rbd_header.112138ed422:head [watch reconnect cookie 140361344088384 gen 3] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e177)", 2024-09-13T06:43:00.409 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:42:17.439011+0000", 2024-09-13T06:43:00.409 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 42.87857211, 2024-09-13T06:43:00.410 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.155518861, 2024-09-13T06:43:00.410 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:00.410 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:00.410 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:00.410 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:00.410 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:00.410 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 160483 2024-09-13T06:43:00.410 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.410 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:00.410 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.410 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:00.410 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:17.439011+0000", 2024-09-13T06:43:00.411 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:00.411 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.411 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.411 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:00.411 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:17.439011+0000", 2024-09-13T06:43:00.411 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:00.411 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.411 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.411 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:00.411 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:17.439009+0000", 2024-09-13T06:43:00.411 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999976 2024-09-13T06:43:00.411 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.411 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.411 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:00.412 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:17.439024+0000", 2024-09-13T06:43:00.412 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.464e-05 2024-09-13T06:43:00.412 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.412 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.412 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:00.412 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:17.439058+0000", 2024-09-13T06:43:00.412 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.4712999999999998e-05 2024-09-13T06:43:00.412 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.412 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.412 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:00.412 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:17.439085+0000", 2024-09-13T06:43:00.412 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.6216000000000001e-05 2024-09-13T06:43:00.412 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.413 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.413 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:00.413 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:17.439182+0000", 2024-09-13T06:43:00.413 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.7020000000000003e-05 2024-09-13T06:43:00.413 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.413 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.413 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:43:00.413 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:17.439204+0000", 2024-09-13T06:43:00.413 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.2276000000000002e-05 2024-09-13T06:43:00.413 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.413 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.413 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:00.413 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:18.588627+0000", 2024-09-13T06:43:00.414 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1494235829999999 2024-09-13T06:43:00.414 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.414 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.414 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for rw locks", 2024-09-13T06:43:00.414 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:18.589031+0000", 2024-09-13T06:43:00.414 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0004035 2024-09-13T06:43:00.414 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.414 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.414 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:00.414 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:18.590604+0000", 2024-09-13T06:43:00.414 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.001573234 2024-09-13T06:43:00.414 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.414 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.414 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:00.415 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:18.590791+0000", 2024-09-13T06:43:00.415 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000186701 2024-09-13T06:43:00.415 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.415 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.415 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:00.415 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:18.594530+0000", 2024-09-13T06:43:00.415 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0037394250000000002 2024-09-13T06:43:00.415 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:00.415 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:00.415 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:00.415 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:00.415 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:00.415 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:43:00.418 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-13T06:43:00.419 INFO:teuthology.orchestra.run.smithi081.stdout:5787 punch from 0x64c7ae to 0x656a50, (0xa2a2 bytes) 2024-09-13T06:43:00.419 INFO:teuthology.orchestra.run.smithi081.stdout:5788 trunc from 0x3595ee7 to 0x5565cf9 2024-09-13T06:43:00.419 INFO:teuthology.orchestra.run.smithi081.stdout:5789 read 0x405beed thru 0x40623cf (0x64e3 bytes) 2024-09-13T06:43:00.419 INFO:teuthology.orchestra.run.smithi081.stdout:5790 write 0xa261b81 thru 0xa268b90 (0x7010 bytes) 2024-09-13T06:43:00.419 INFO:teuthology.orchestra.run.smithi081.stdout:5791 punch from 0x4955c3 to 0x49fd79, (0xa7b6 bytes) 2024-09-13T06:43:00.419 INFO:teuthology.orchestra.run.smithi081.stdout:5792 punch from 0x1d07c2 to 0x1dc2d6, (0xbb14 bytes) 2024-09-13T06:43:00.419 INFO:teuthology.orchestra.run.smithi081.stdout:5795 punch from 0x7595659 to 0x75a3972, (0xe319 bytes) 2024-09-13T06:43:00.419 INFO:teuthology.orchestra.run.smithi081.stdout:5796 write 0xaa1b226 thru 0xaa2335b (0x8136 bytes) 2024-09-13T06:43:00.420 INFO:teuthology.orchestra.run.smithi081.stdout:5798 trunc from 0xaa2335c to 0x7900d4f 2024-09-13T06:43:00.420 INFO:teuthology.orchestra.run.smithi081.stdout:5799 punch from 0x4d2176c to 0x4d300d0, (0xe964 bytes) 2024-09-13T06:43:00.420 INFO:teuthology.orchestra.run.smithi081.stdout:5801 writesame 0x1c17091 thru 0x1c1b9ec data_size 0x2(0x495c bytes) 2024-09-13T06:43:00.420 INFO:teuthology.orchestra.run.smithi081.stdout:5802 read 0x50cb686 thru 0x50d77fd (0xc178 bytes) 2024-09-13T06:43:00.420 INFO:teuthology.orchestra.run.smithi081.stdout:5804 read 0x10b1aa4 thru 0x10b6b90 (0x50ed bytes) 2024-09-13T06:43:00.420 INFO:teuthology.orchestra.run.smithi081.stdout:5805 punch from 0x3578194 to 0x3583aeb, (0xb957 bytes) 2024-09-13T06:43:00.420 INFO:teuthology.orchestra.run.smithi081.stdout:5806 read 0x5a90a5e thru 0x5a94780 (0x3d23 bytes) 2024-09-13T06:43:00.420 INFO:teuthology.orchestra.run.smithi081.stdout:5808 punch from 0x6fa99bc to 0x6facf0e, (0x3552 bytes) 2024-09-13T06:43:00.420 INFO:teuthology.orchestra.run.smithi081.stdout:5810 writesame 0x6c162e4 thru 0x6c1bd48 data_size 0x1(0x5a65 bytes) 2024-09-13T06:43:00.420 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:43:00.416+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:43:00.424 INFO:teuthology.orchestra.run.smithi081.stdout:5811 write 0x54b1f96 thru 0x54c10c9 (0xf134 bytes) 2024-09-13T06:43:00.443 INFO:teuthology.orchestra.run.smithi081.stdout:5812 write 0xb42d725 thru 0xb42efd0 (0x18ac bytes) 2024-09-13T06:43:00.445 INFO:teuthology.orchestra.run.smithi081.stdout:5813 read 0x9b3259 thru 0x9bf6de (0xc486 bytes) 2024-09-13T06:43:00.462 INFO:teuthology.orchestra.run.smithi081.stdout:5814 writesame 0xe4536cd thru 0xe45770b data_size 0x1(0x403f bytes) 2024-09-13T06:43:00.462 INFO:teuthology.orchestra.run.smithi081.stdout:5817 read 0x2b1ea00 thru 0x2b2439d (0x599e bytes) 2024-09-13T06:43:00.487 INFO:teuthology.orchestra.run.smithi081.stdout:5818 trunc from 0xe45770c to 0x23f3f59 2024-09-13T06:43:00.502 INFO:teuthology.orchestra.run.smithi081.stdout:5820 punch from 0xf5ee2c to 0xf676cd, (0x88a1 bytes) 2024-09-13T06:43:00.517 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:43:00.516+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:43:00.520 INFO:teuthology.orchestra.run.smithi081.stdout:5821 writesame 0x68e81a1 thru 0x68ec30b data_size 0x1(0x416b bytes) 2024-09-13T06:43:00.536 INFO:teuthology.orchestra.run.smithi081.stdout:5822 trunc from 0x68ec30c to 0xd1a8c2b 2024-09-13T06:43:00.547 INFO:teuthology.orchestra.run.smithi081.stdout:5823 writesame 0x652d2cf thru 0x6536f63 data_size 0x1(0x9c95 bytes) 2024-09-13T06:43:00.552 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:43:00.552 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [], 2024-09-13T06:43:00.552 INFO:teuthology.orchestra.run.smithi139.stdout: "num_ops": 0 2024-09-13T06:43:00.552 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:43:00.568 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-13T06:43:00.593 INFO:teuthology.orchestra.run.smithi081.stdout:5824 read 0x77b81d0 thru 0x77c103c (0x8e6d bytes) 2024-09-13T06:43:00.594 INFO:teuthology.orchestra.run.smithi081.stdout:5825 write 0x398cb5d thru 0x399a472 (0xd916 bytes) 2024-09-13T06:43:00.612 INFO:teuthology.orchestra.run.smithi081.stdout:5826 write 0xdc29ccc thru 0xdc371d7 (0xd50c bytes) 2024-09-13T06:43:00.616 INFO:teuthology.orchestra.run.smithi081.stdout:5827 read 0xf67eb2 thru 0xf7602c (0xe17b bytes) 2024-09-13T06:43:00.617 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:43:00.617 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:43:00.617 INFO:teuthology.orchestra.run.smithi081.stdout:5830 read 0x63d55eb thru 0x63e4a8a (0xf4a0 bytes) 2024-09-13T06:43:00.618 INFO:teuthology.orchestra.run.smithi081.stdout:5831 punch from 0x502c9e4 to 0x503a3d4, (0xd9f0 bytes) 2024-09-13T06:43:00.618 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:43:00.620+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:43:00.626 INFO:teuthology.orchestra.run.smithi081.stdout:5832 trunc from 0xdc371d8 to 0xa214f7e 2024-09-13T06:43:00.642 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:43:00.642 INFO:teuthology.orchestra.run.smithi081.stdout:5837 read 0x4b805b8 thru 0x4b89e78 (0x98c1 bytes) 2024-09-13T06:43:00.642 INFO:teuthology.orchestra.run.smithi081.stdout:5839 writesame 0x43adef5 thru 0x43bc507 data_size 0x1d(0xe613 bytes) 2024-09-13T06:43:00.647 INFO:teuthology.orchestra.run.smithi081.stdout:5842 read 0x998fbfd thru 0x9990343 (0x747 bytes) 2024-09-13T06:43:00.648 INFO:teuthology.orchestra.run.smithi081.stdout:5843 write 0x804193c thru 0x8044e50 (0x3515 bytes) 2024-09-13T06:43:00.651 INFO:teuthology.orchestra.run.smithi081.stdout:5844 read 0x3d57bfd thru 0x3d63e5d (0xc261 bytes) 2024-09-13T06:43:00.652 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:43:00.652 INFO:teuthology.orchestra.run.smithi081.stdout:5846 punch from 0x3ab05f5 to 0x3ab87ec, (0x81f7 bytes) 2024-09-13T06:43:00.652 INFO:teuthology.orchestra.run.smithi081.stdout:5847 read 0x1e1e908 thru 0x1e1fe06 (0x14ff bytes) 2024-09-13T06:43:00.653 INFO:teuthology.orchestra.run.smithi081.stdout:5848 writesame 0x6e1394f thru 0x6e21299 data_size 0xd(0xd94b bytes) 2024-09-13T06:43:00.660 INFO:teuthology.orchestra.run.smithi081.stdout:5850 write 0x4b246c1 thru 0x4b2c4d4 (0x7e14 bytes) 2024-09-13T06:43:00.663 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:43:00.684 INFO:teuthology.orchestra.run.smithi081.stdout:5854 write 0xd1b5017 thru 0xd1c0f8a (0xbf74 bytes) 2024-09-13T06:43:00.687 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-13T06:43:00.691 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:43:00.691 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [], 2024-09-13T06:43:00.691 INFO:teuthology.orchestra.run.smithi139.stdout: "complaint_time": 30, 2024-09-13T06:43:00.691 INFO:teuthology.orchestra.run.smithi139.stdout: "num_blocked_ops": 0 2024-09-13T06:43:00.691 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:43:00.706 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-13T06:43:00.719 INFO:teuthology.orchestra.run.smithi081.stdout:5855 trunc from 0xd1c0f8b to 0x84c409 2024-09-13T06:43:00.719 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:43:00.720+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:43:00.732 INFO:teuthology.orchestra.run.smithi081.stdout:5856 read 0x55ab5d thru 0x564426 (0x98ca bytes) 2024-09-13T06:43:00.740 INFO:teuthology.orchestra.run.smithi081.stdout:5857 write 0x177b5d1 thru 0x17843b6 (0x8de6 bytes) 2024-09-13T06:43:00.752 INFO:teuthology.orchestra.run.smithi081.stdout:5858 trunc from 0x17843b7 to 0x5cb92e7 2024-09-13T06:43:00.759 INFO:teuthology.orchestra.run.smithi081.stdout:5859 punch from 0x51daa9f to 0x51e9e18, (0xf379 bytes) 2024-09-13T06:43:00.759 INFO:teuthology.orchestra.run.smithi081.stdout:5860 read 0x107f697 thru 0x108e92e (0xf298 bytes) 2024-09-13T06:43:00.773 INFO:teuthology.orchestra.run.smithi081.stdout:5862 write 0xa68c308 thru 0xa6941bb (0x7eb4 bytes) 2024-09-13T06:43:00.776 INFO:teuthology.orchestra.run.smithi081.stdout:5863 read 0xa7c36c thru 0xa7d0ad (0xd42 bytes) 2024-09-13T06:43:00.776 INFO:teuthology.orchestra.run.smithi081.stdout:5864 write 0x2ecc14e thru 0x2ed7cce (0xbb81 bytes) 2024-09-13T06:43:00.779 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:43:00.779 INFO:teuthology.orchestra.run.smithi081.stdout:5866 read 0x62540b2 thru 0x625dfe5 (0x9f34 bytes) 2024-09-13T06:43:00.780 INFO:teuthology.orchestra.run.smithi081.stdout:5867 writesame 0x957f6ac thru 0x9581e06 data_size 0x1f(0x275b bytes) 2024-09-13T06:43:00.782 INFO:teuthology.orchestra.run.smithi081.stdout:5868 read 0x3cf5376 thru 0x3cfb6e5 (0x6370 bytes) 2024-09-13T06:43:00.783 INFO:teuthology.orchestra.run.smithi081.stdout:5869 punch from 0x6e0541 to 0x6e0e9f, (0x95e bytes) 2024-09-13T06:43:00.783 INFO:teuthology.orchestra.run.smithi081.stdout:5871 write 0x5ae1a05 thru 0x5aed289 (0xb885 bytes) 2024-09-13T06:43:00.785 INFO:teuthology.orchestra.run.smithi081.stdout:5872 writesame 0xa40f6b4 thru 0xa410010 data_size 0x11(0x95d bytes) 2024-09-13T06:43:00.787 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:43:00.788 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:43:00.788 INFO:teuthology.orchestra.run.smithi081.stdout:5875 punch from 0xa450797 to 0xa45ce4a, (0xc6b3 bytes) 2024-09-13T06:43:00.788 INFO:teuthology.orchestra.run.smithi081.stdout:5876 punch from 0x17c8ab to 0x189440, (0xcb95 bytes) 2024-09-13T06:43:00.788 INFO:teuthology.orchestra.run.smithi081.stdout:5877 read 0x67153 thru 0x6e921 (0x77cf bytes) 2024-09-13T06:43:00.788 INFO:teuthology.orchestra.run.smithi081.stdout:5878 read 0x84d2f09 thru 0x84d63be (0x34b6 bytes) 2024-09-13T06:43:00.789 INFO:teuthology.orchestra.run.smithi081.stdout:5879 writesame 0x2663ffb thru 0x266d991 data_size 0x29(0x9997 bytes) 2024-09-13T06:43:00.790 INFO:teuthology.orchestra.run.smithi081.stdout:5880 punch from 0x271a772 to 0x2724eac, (0xa73a bytes) 2024-09-13T06:43:00.792 INFO:teuthology.orchestra.run.smithi081.stdout:5881 trunc from 0xa6941bc to 0x9cd8711 2024-09-13T06:43:00.803 INFO:teuthology.orchestra.run.smithi081.stdout:5882 read 0x80083da thru 0x8016b00 (0xe727 bytes) 2024-09-13T06:43:00.804 INFO:teuthology.orchestra.run.smithi081.stdout:5883 read 0x3e00bed thru 0x3e09be0 (0x8ff4 bytes) 2024-09-13T06:43:00.804 INFO:teuthology.orchestra.run.smithi081.stdout:5884 read 0x2348adb thru 0x2350fd0 (0x84f6 bytes) 2024-09-13T06:43:00.804 INFO:teuthology.orchestra.run.smithi081.stdout:5885 write 0x1cd95ab thru 0x1cdcbe2 (0x3638 bytes) 2024-09-13T06:43:00.806 INFO:teuthology.orchestra.run.smithi081.stdout:5886 punch from 0x3ad3495 to 0x3ade2ea, (0xae55 bytes) 2024-09-13T06:43:00.813 INFO:teuthology.orchestra.run.smithi081.stdout:5887 write 0x9e5b5ab thru 0x9e65f71 (0xa9c7 bytes) 2024-09-13T06:43:00.815 INFO:teuthology.orchestra.run.smithi081.stdout:5888 trunc from 0x9e65f72 to 0x98f60c3 2024-09-13T06:43:00.819 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:43:00.820+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:43:00.824 INFO:teuthology.orchestra.run.smithi081.stdout:5889 read 0x2bc2ec7 thru 0x2bc4745 (0x187f bytes) 2024-09-13T06:43:00.832 INFO:teuthology.orchestra.run.smithi081.stdout:5890 write 0xa551589 thru 0xa55fb25 (0xe59d bytes) 2024-09-13T06:43:00.834 INFO:teuthology.orchestra.run.smithi081.stdout:5891 read 0xa3def97 thru 0xa3eef28 (0xff92 bytes) 2024-09-13T06:43:00.838 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:43:00.838 INFO:teuthology.orchestra.run.smithi139.stdout: "size": 20, 2024-09-13T06:43:00.838 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 600, 2024-09-13T06:43:00.838 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [ 2024-09-13T06:43:00.838 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.838 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43299 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 432128~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:43:00.839 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589881+0000", 2024-09-13T06:43:00.839 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 159.24652135900001, 2024-09-13T06:43:00.839 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.079693849999999997, 2024-09-13T06:43:00.839 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:00.839 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:00.839 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:00.839 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:00.839 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:00.839 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43299 2024-09-13T06:43:00.839 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.839 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:00.839 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.840 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:00.840 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589881+0000", 2024-09-13T06:43:00.840 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:00.840 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.840 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.840 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:00.840 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589881+0000", 2024-09-13T06:43:00.840 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:00.841 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.841 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.841 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:00.841 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589880+0000", 2024-09-13T06:43:00.841 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:43:00.841 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.841 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.841 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:00.841 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589884+0000", 2024-09-13T06:43:00.841 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.053e-06 2024-09-13T06:43:00.841 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.841 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.842 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:00.842 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589893+0000", 2024-09-13T06:43:00.842 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.2129999999999997e-06 2024-09-13T06:43:00.842 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.842 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.842 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:00.843 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589901+0000", 2024-09-13T06:43:00.843 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.6399999999999997e-06 2024-09-13T06:43:00.843 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.843 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.843 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:00.843 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.669213+0000", 2024-09-13T06:43:00.843 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.079312074999999996 2024-09-13T06:43:00.843 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.843 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.843 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:00.844 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.669281+0000", 2024-09-13T06:43:00.844 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.8322000000000001e-05 2024-09-13T06:43:00.844 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.844 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.844 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:00.844 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.669575+0000", 2024-09-13T06:43:00.844 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00029349699999999999 2024-09-13T06:43:00.844 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:00.844 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:00.844 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:00.844 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.845 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.845 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43300 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 446464~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:43:00.845 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589909+0000", 2024-09-13T06:43:00.845 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 159.246493464, 2024-09-13T06:43:00.845 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.080339496999999996, 2024-09-13T06:43:00.845 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:00.845 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:00.845 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:00.845 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:00.845 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:00.845 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43300 2024-09-13T06:43:00.845 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.845 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:00.846 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.846 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:00.846 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589909+0000", 2024-09-13T06:43:00.846 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:00.846 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.846 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.846 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:00.847 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589909+0000", 2024-09-13T06:43:00.847 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:00.847 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.847 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.847 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:00.847 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589908+0000", 2024-09-13T06:43:00.847 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:43:00.847 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.847 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.847 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:00.847 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589912+0000", 2024-09-13T06:43:00.847 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.9430000000000002e-06 2024-09-13T06:43:00.848 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.848 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.848 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:00.848 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589920+0000", 2024-09-13T06:43:00.848 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.3860000000000007e-06 2024-09-13T06:43:00.848 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.848 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.848 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:00.848 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589928+0000", 2024-09-13T06:43:00.848 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.3329999999999999e-06 2024-09-13T06:43:00.848 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.848 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.849 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:00.849 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.669651+0000", 2024-09-13T06:43:00.849 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.079723204000000006 2024-09-13T06:43:00.849 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.849 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.849 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:00.849 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.669840+0000", 2024-09-13T06:43:00.849 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000189397 2024-09-13T06:43:00.849 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.849 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.850 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:00.850 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.670248+0000", 2024-09-13T06:43:00.850 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00040811100000000001 2024-09-13T06:43:00.850 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:00.850 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:00.850 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:00.850 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.850 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.850 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43301 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 460800~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:43:00.850 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589934+0000", 2024-09-13T06:43:00.850 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 159.24646878999999, 2024-09-13T06:43:00.850 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.080747474999999999, 2024-09-13T06:43:00.850 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:00.850 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:00.851 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:00.851 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:00.851 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:00.851 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43301 2024-09-13T06:43:00.851 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.851 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:00.851 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.851 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:00.851 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589934+0000", 2024-09-13T06:43:00.851 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:00.851 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.851 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.851 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:00.851 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589934+0000", 2024-09-13T06:43:00.852 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:00.852 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.852 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.852 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:00.852 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589933+0000", 2024-09-13T06:43:00.852 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:00.852 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.852 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.852 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:00.852 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589936+0000", 2024-09-13T06:43:00.852 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.4599999999999999e-06 2024-09-13T06:43:00.852 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.853 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.853 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:00.853 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589945+0000", 2024-09-13T06:43:00.853 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.2430000000000005e-06 2024-09-13T06:43:00.853 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.853 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.853 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:00.853 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589952+0000", 2024-09-13T06:43:00.853 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.3289999999999996e-06 2024-09-13T06:43:00.853 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.853 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.853 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:00.853 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.670280+0000", 2024-09-13T06:43:00.854 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.080328514000000004 2024-09-13T06:43:00.854 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.854 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.854 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:00.854 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.670376+0000", 2024-09-13T06:43:00.854 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.5752000000000001e-05 2024-09-13T06:43:00.854 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.854 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.854 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:00.854 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.670681+0000", 2024-09-13T06:43:00.854 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00030479699999999999 2024-09-13T06:43:00.854 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:00.854 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:00.854 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:00.855 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.855 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.855 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43302 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 475136~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:43:00.855 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589958+0000", 2024-09-13T06:43:00.855 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 159.246444728, 2024-09-13T06:43:00.855 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.081402394000000003, 2024-09-13T06:43:00.855 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:00.855 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:00.855 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:00.855 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:00.855 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:00.855 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43302 2024-09-13T06:43:00.855 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.856 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:00.856 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.856 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:00.856 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589958+0000", 2024-09-13T06:43:00.856 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:00.856 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.856 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.856 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:00.856 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589958+0000", 2024-09-13T06:43:00.856 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:00.857 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.857 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.857 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:00.857 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589957+0000", 2024-09-13T06:43:00.857 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:00.857 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.857 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.857 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:00.857 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589960+0000", 2024-09-13T06:43:00.857 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.4939999999999999e-06 2024-09-13T06:43:00.857 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.857 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.857 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:00.858 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589969+0000", 2024-09-13T06:43:00.858 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.3520000000000007e-06 2024-09-13T06:43:00.858 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.858 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.858 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:00.858 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589976+0000", 2024-09-13T06:43:00.858 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.3030000000000002e-06 2024-09-13T06:43:00.858 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.858 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.858 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:00.858 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.670765+0000", 2024-09-13T06:43:00.858 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.080789154000000002 2024-09-13T06:43:00.858 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.858 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.859 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:00.859 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.670960+0000", 2024-09-13T06:43:00.859 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00019464300000000001 2024-09-13T06:43:00.859 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.859 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.859 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:00.859 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.671360+0000", 2024-09-13T06:43:00.859 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00040005200000000002 2024-09-13T06:43:00.859 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:00.859 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:00.859 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:00.859 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.859 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.859 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43303 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 489472~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:43:00.860 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589985+0000", 2024-09-13T06:43:00.860 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 159.24641778, 2024-09-13T06:43:00.860 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.082024333000000005, 2024-09-13T06:43:00.860 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:00.860 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:00.860 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:00.860 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:00.860 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:00.860 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43303 2024-09-13T06:43:00.860 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.860 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:00.860 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.860 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:00.861 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589985+0000", 2024-09-13T06:43:00.861 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:00.861 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.861 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.861 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:00.861 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589985+0000", 2024-09-13T06:43:00.861 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:00.861 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.861 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.861 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:00.861 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589984+0000", 2024-09-13T06:43:00.861 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:43:00.861 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.862 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.862 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:00.862 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589987+0000", 2024-09-13T06:43:00.862 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.726e-06 2024-09-13T06:43:00.862 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.862 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.862 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:00.862 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589996+0000", 2024-09-13T06:43:00.862 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.5459999999999992e-06 2024-09-13T06:43:00.862 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.862 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.862 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:00.862 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590003+0000", 2024-09-13T06:43:00.863 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.4229999999999999e-06 2024-09-13T06:43:00.863 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.863 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.863 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:00.863 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.671426+0000", 2024-09-13T06:43:00.863 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.081422704999999998 2024-09-13T06:43:00.863 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.863 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.863 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:00.863 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.671615+0000", 2024-09-13T06:43:00.863 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000188875 2024-09-13T06:43:00.863 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.863 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.864 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:00.864 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.672009+0000", 2024-09-13T06:43:00.864 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000394015 2024-09-13T06:43:00.864 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:00.864 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:00.864 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:00.864 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.864 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.864 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43304 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 503808~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:43:00.864 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.590039+0000", 2024-09-13T06:43:00.864 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 159.24636323499999, 2024-09-13T06:43:00.864 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.082573880000000002, 2024-09-13T06:43:00.864 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:00.865 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:00.865 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:00.865 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:00.865 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:00.865 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43304 2024-09-13T06:43:00.865 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.865 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:00.865 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.865 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:00.865 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590039+0000", 2024-09-13T06:43:00.865 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:00.865 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.865 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.866 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:00.866 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590039+0000", 2024-09-13T06:43:00.866 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:00.866 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.866 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.866 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:00.866 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590038+0000", 2024-09-13T06:43:00.866 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:43:00.867 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.867 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.867 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:00.867 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590042+0000", 2024-09-13T06:43:00.867 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.9500000000000003e-06 2024-09-13T06:43:00.867 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.867 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.867 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:00.867 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590052+0000", 2024-09-13T06:43:00.867 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.3919999999999992e-06 2024-09-13T06:43:00.867 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.867 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.868 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:00.868 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590059+0000", 2024-09-13T06:43:00.868 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.7970000000000001e-06 2024-09-13T06:43:00.868 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.868 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.868 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:00.868 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.672078+0000", 2024-09-13T06:43:00.868 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.082018778000000001 2024-09-13T06:43:00.868 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.868 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.868 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:00.868 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.672266+0000", 2024-09-13T06:43:00.868 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00018807399999999999 2024-09-13T06:43:00.869 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.869 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.869 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:00.869 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.672613+0000", 2024-09-13T06:43:00.869 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00034677599999999997 2024-09-13T06:43:00.869 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:00.869 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:00.869 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:00.869 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.869 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.869 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43305 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 518144~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:43:00.869 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.590136+0000", 2024-09-13T06:43:00.869 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 159.24626604700001, 2024-09-13T06:43:00.869 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.082988206999999994, 2024-09-13T06:43:00.870 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:00.870 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:00.870 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:00.870 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:00.870 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:00.870 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43305 2024-09-13T06:43:00.870 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.870 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:00.870 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.870 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:00.870 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590136+0000", 2024-09-13T06:43:00.870 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:00.870 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.871 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.871 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:00.871 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590136+0000", 2024-09-13T06:43:00.871 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:00.871 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.871 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.871 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:00.871 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590135+0000", 2024-09-13T06:43:00.871 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:43:00.871 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.871 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.871 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:00.872 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590139+0000", 2024-09-13T06:43:00.872 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.9489999999999998e-06 2024-09-13T06:43:00.872 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.872 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.872 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:00.872 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590148+0000", 2024-09-13T06:43:00.872 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.9830000000000002e-06 2024-09-13T06:43:00.872 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.872 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.872 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:00.872 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590156+0000", 2024-09-13T06:43:00.873 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5229999999999998e-06 2024-09-13T06:43:00.873 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.873 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.873 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:00.873 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.672709+0000", 2024-09-13T06:43:00.873 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.082552886000000006 2024-09-13T06:43:00.873 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.873 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.873 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:00.873 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.672816+0000", 2024-09-13T06:43:00.873 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000107736 2024-09-13T06:43:00.874 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.874 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.874 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:00.874 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.673124+0000", 2024-09-13T06:43:00.874 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00030804900000000002 2024-09-13T06:43:00.874 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:00.874 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:00.874 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:00.874 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.874 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.874 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:66818 3.17 3.50afe697 (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e100)", 2024-09-13T06:43:00.874 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:53.498942+0000", 2024-09-13T06:43:00.874 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 127.337459862, 2024-09-13T06:43:00.875 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.011231284, 2024-09-13T06:43:00.875 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:00.875 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:43:00.875 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:00.875 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:00.875 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:00.875 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 66818 2024-09-13T06:43:00.875 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.875 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:00.875 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.875 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:00.875 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:53.498942+0000", 2024-09-13T06:43:00.875 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:00.875 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.876 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.876 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:00.876 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:53.498942+0000", 2024-09-13T06:43:00.876 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:00.876 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.876 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.876 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:00.876 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:53.498939+0000", 2024-09-13T06:43:00.876 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999967 2024-09-13T06:43:00.876 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.876 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.876 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:00.876 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:53.498954+0000", 2024-09-13T06:43:00.877 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5028000000000001e-05 2024-09-13T06:43:00.877 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.877 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.877 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:00.877 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:53.498986+0000", 2024-09-13T06:43:00.877 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.1993999999999999e-05 2024-09-13T06:43:00.877 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.877 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.877 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:00.877 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:53.499001+0000", 2024-09-13T06:43:00.877 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5166e-05 2024-09-13T06:43:00.877 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.878 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.878 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:00.878 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:53.505097+0000", 2024-09-13T06:43:00.878 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0060955610000000002 2024-09-13T06:43:00.878 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.878 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.878 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:43:00.878 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:53.505108+0000", 2024-09-13T06:43:00.878 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.084e-05 2024-09-13T06:43:00.878 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.878 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.878 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:00.878 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:54.510158+0000", 2024-09-13T06:43:00.878 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0050497549999999 2024-09-13T06:43:00.879 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.879 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.879 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:00.879 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:54.510174+0000", 2024-09-13T06:43:00.879 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6164e-05 2024-09-13T06:43:00.879 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:00.879 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:00.879 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:00.879 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.879 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.879 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:69764 3.2 3:47f10058:::rbd_data.11214956a993.0000000000000004:head [write-same] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e117)", 2024-09-13T06:43:00.879 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:41:11.371147+0000", 2024-09-13T06:43:00.879 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 109.465255552, 2024-09-13T06:43:00.879 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.03470167, 2024-09-13T06:43:00.880 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:00.880 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:43:00.880 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:00.880 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:00.880 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:00.880 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 69764 2024-09-13T06:43:00.880 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.880 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:00.880 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.880 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:00.880 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:11.371147+0000", 2024-09-13T06:43:00.880 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:00.880 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.881 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.881 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:00.881 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:11.371147+0000", 2024-09-13T06:43:00.881 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:00.881 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.881 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.881 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:00.881 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:11.371144+0000", 2024-09-13T06:43:00.881 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999967 2024-09-13T06:43:00.881 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.881 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.881 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:00.881 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:11.371161+0000", 2024-09-13T06:43:00.882 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7669e-05 2024-09-13T06:43:00.882 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.882 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.882 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:00.882 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:11.371198+0000", 2024-09-13T06:43:00.882 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.7014000000000002e-05 2024-09-13T06:43:00.882 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.882 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.882 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:00.882 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:11.371216+0000", 2024-09-13T06:43:00.882 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7425e-05 2024-09-13T06:43:00.882 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.882 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.883 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:00.883 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:11.371365+0000", 2024-09-13T06:43:00.883 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000149245 2024-09-13T06:43:00.883 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.883 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.883 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op must wait for map", 2024-09-13T06:43:00.883 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:11.371385+0000", 2024-09-13T06:43:00.883 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.0018999999999999e-05 2024-09-13T06:43:00.883 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.883 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.883 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:00.883 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:11.378406+0000", 2024-09-13T06:43:00.884 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0070207179999999996 2024-09-13T06:43:00.884 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.884 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.884 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:43:00.884 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:11.378429+0000", 2024-09-13T06:43:00.884 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.3453999999999999e-05 2024-09-13T06:43:00.884 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.884 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.884 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:00.884 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:12.405667+0000", 2024-09-13T06:43:00.884 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0272381690000001 2024-09-13T06:43:00.884 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.885 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.885 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:00.885 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:12.405848+0000", 2024-09-13T06:43:00.885 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00018112 2024-09-13T06:43:00.885 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:00.885 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:00.885 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:00.885 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.885 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.885 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:70346 3.16 3:69d35907:::rbd_object_map.11214956a993:head [read 0~36] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e122)", 2024-09-13T06:43:00.885 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:41:16.390917+0000", 2024-09-13T06:43:00.886 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 104.4454855, 2024-09-13T06:43:00.886 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.99327479799999996, 2024-09-13T06:43:00.886 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:00.886 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:00.886 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:00.886 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:00.886 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:00.886 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 70346 2024-09-13T06:43:00.886 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.886 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:00.887 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.887 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:00.887 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:16.390917+0000", 2024-09-13T06:43:00.887 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:00.887 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.887 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.887 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:00.887 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:16.390917+0000", 2024-09-13T06:43:00.887 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:00.887 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.887 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.888 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:00.888 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:16.390916+0000", 2024-09-13T06:43:00.888 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999986 2024-09-13T06:43:00.888 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.888 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.888 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:00.888 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:16.390922+0000", 2024-09-13T06:43:00.888 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.0480000000000004e-06 2024-09-13T06:43:00.888 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.888 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.888 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:00.888 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:16.390933+0000", 2024-09-13T06:43:00.889 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1387e-05 2024-09-13T06:43:00.889 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.889 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.889 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:00.889 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:16.390939+0000", 2024-09-13T06:43:00.889 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.8039999999999998e-06 2024-09-13T06:43:00.889 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.889 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.889 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:00.889 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:16.390983+0000", 2024-09-13T06:43:00.889 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.4663000000000003e-05 2024-09-13T06:43:00.889 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.890 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.890 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:43:00.890 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:16.390991+0000", 2024-09-13T06:43:00.890 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.8059999999999995e-06 2024-09-13T06:43:00.890 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.890 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.890 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:00.890 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:17.383624+0000", 2024-09-13T06:43:00.890 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.99263277299999997 2024-09-13T06:43:00.890 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.890 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.890 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:00.891 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:17.383891+0000", 2024-09-13T06:43:00.891 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00026717599999999999 2024-09-13T06:43:00.891 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.891 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.891 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:00.891 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:17.384192+0000", 2024-09-13T06:43:00.891 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00030047400000000001 2024-09-13T06:43:00.891 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:00.891 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:00.891 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:00.891 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.891 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.891 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:181624 3.1d 3:be5d0ef9:::rbd_data.11218aab7a9c.0000000000000000:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e203)", 2024-09-13T06:43:00.892 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:42:45.701744+0000", 2024-09-13T06:43:00.892 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 15.13465858, 2024-09-13T06:43:00.892 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.69964504800000005, 2024-09-13T06:43:00.892 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:00.892 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:00.892 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:00.892 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:00.892 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:00.892 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 181624 2024-09-13T06:43:00.892 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.892 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:00.892 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.893 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:00.893 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.701744+0000", 2024-09-13T06:43:00.893 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:00.893 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.893 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.893 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:00.893 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.701744+0000", 2024-09-13T06:43:00.893 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:00.893 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.893 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.893 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:00.893 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.701741+0000", 2024-09-13T06:43:00.893 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999976 2024-09-13T06:43:00.894 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.894 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.894 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:00.894 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.701754+0000", 2024-09-13T06:43:00.894 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2632999999999999e-05 2024-09-13T06:43:00.894 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.894 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.894 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:00.894 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.701789+0000", 2024-09-13T06:43:00.894 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.4993999999999997e-05 2024-09-13T06:43:00.894 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.894 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.894 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:00.895 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.701806+0000", 2024-09-13T06:43:00.895 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7016000000000001e-05 2024-09-13T06:43:00.895 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.895 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.895 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:00.895 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.701905+0000", 2024-09-13T06:43:00.895 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.8895999999999996e-05 2024-09-13T06:43:00.895 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.895 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.895 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:43:00.895 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.701920+0000", 2024-09-13T06:43:00.895 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5013e-05 2024-09-13T06:43:00.896 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.896 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.896 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:00.896 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.400672+0000", 2024-09-13T06:43:00.896 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.69875254499999995 2024-09-13T06:43:00.896 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.896 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.896 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:00.896 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.401034+0000", 2024-09-13T06:43:00.896 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00036181700000000001 2024-09-13T06:43:00.897 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.897 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.897 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:00.897 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.401389+0000", 2024-09-13T06:43:00.897 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00035464399999999999 2024-09-13T06:43:00.897 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:00.897 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:00.897 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:00.897 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.897 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.897 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:181638 3.1d 3:be5d0ef9:::rbd_data.11218aab7a9c.0000000000000000:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e203)", 2024-09-13T06:43:00.898 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:42:45.707356+0000", 2024-09-13T06:43:00.898 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 15.129045841, 2024-09-13T06:43:00.898 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.694720479, 2024-09-13T06:43:00.898 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:00.898 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:00.898 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:00.898 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:00.898 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:00.898 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 181638 2024-09-13T06:43:00.898 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.898 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:00.898 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.899 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:00.899 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707356+0000", 2024-09-13T06:43:00.899 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:00.899 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.899 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.899 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:00.899 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707356+0000", 2024-09-13T06:43:00.899 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:00.899 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.899 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.900 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:00.900 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707355+0000", 2024-09-13T06:43:00.900 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999981 2024-09-13T06:43:00.900 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.900 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.900 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:00.901 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707375+0000", 2024-09-13T06:43:00.901 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.0698000000000001e-05 2024-09-13T06:43:00.901 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.901 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.901 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:00.901 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707396+0000", 2024-09-13T06:43:00.901 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.1041000000000001e-05 2024-09-13T06:43:00.901 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.901 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.902 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:00.902 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707408+0000", 2024-09-13T06:43:00.902 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1583000000000001e-05 2024-09-13T06:43:00.902 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.902 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.902 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:00.902 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707513+0000", 2024-09-13T06:43:00.902 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000104981 2024-09-13T06:43:00.902 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.902 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.902 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:43:00.902 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707541+0000", 2024-09-13T06:43:00.902 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.8572999999999999e-05 2024-09-13T06:43:00.903 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.903 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.903 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:00.903 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.401666+0000", 2024-09-13T06:43:00.903 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.694124988 2024-09-13T06:43:00.903 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.903 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.903 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:00.903 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.401880+0000", 2024-09-13T06:43:00.903 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00021322100000000001 2024-09-13T06:43:00.903 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.903 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.904 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:00.904 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.402077+0000", 2024-09-13T06:43:00.904 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000197321 2024-09-13T06:43:00.904 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:00.904 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:00.904 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:00.904 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.904 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.904 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:181652 3.1d 3:be5d0ef9:::rbd_data.11218aab7a9c.0000000000000000:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e203)", 2024-09-13T06:43:00.904 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:42:45.707423+0000", 2024-09-13T06:43:00.904 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 15.12897931, 2024-09-13T06:43:00.904 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.69480806699999997, 2024-09-13T06:43:00.904 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:00.905 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:00.905 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:00.905 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:00.905 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:00.905 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 181652 2024-09-13T06:43:00.905 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.905 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:00.905 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.905 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:00.905 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707423+0000", 2024-09-13T06:43:00.905 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:00.905 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.905 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.905 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:00.906 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707423+0000", 2024-09-13T06:43:00.906 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:00.906 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.906 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.906 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:00.906 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707423+0000", 2024-09-13T06:43:00.906 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:00.906 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.906 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.906 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:00.906 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707427+0000", 2024-09-13T06:43:00.906 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.2010000000000001e-06 2024-09-13T06:43:00.906 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.906 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.907 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:00.907 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707442+0000", 2024-09-13T06:43:00.907 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.4993e-05 2024-09-13T06:43:00.907 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.907 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.907 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:00.907 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707447+0000", 2024-09-13T06:43:00.907 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.2170000000000002e-06 2024-09-13T06:43:00.907 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.907 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.907 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:00.907 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707656+0000", 2024-09-13T06:43:00.907 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00020908600000000001 2024-09-13T06:43:00.908 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.908 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.908 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:43:00.908 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707684+0000", 2024-09-13T06:43:00.908 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.7766000000000001e-05 2024-09-13T06:43:00.908 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.908 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.908 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:00.908 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.402101+0000", 2024-09-13T06:43:00.908 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.69441698100000004 2024-09-13T06:43:00.908 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.908 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.909 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:00.909 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.402156+0000", 2024-09-13T06:43:00.909 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.4725000000000002e-05 2024-09-13T06:43:00.909 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.909 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.909 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:00.909 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.402231+0000", 2024-09-13T06:43:00.909 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5587999999999995e-05 2024-09-13T06:43:00.909 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:00.909 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:00.909 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:00.909 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.909 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.909 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:181666 3.1d 3:be5d0ef9:::rbd_data.11218aab7a9c.0000000000000000:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e203)", 2024-09-13T06:43:00.910 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:42:45.707478+0000", 2024-09-13T06:43:00.910 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 15.128924123999999, 2024-09-13T06:43:00.910 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.69543359900000001, 2024-09-13T06:43:00.910 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:00.910 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:00.910 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:00.910 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:00.910 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:00.910 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 181666 2024-09-13T06:43:00.910 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.910 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:00.910 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.910 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:00.911 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707478+0000", 2024-09-13T06:43:00.911 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:00.911 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.911 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.911 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:00.911 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707478+0000", 2024-09-13T06:43:00.911 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:00.911 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.911 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.911 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:00.911 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707478+0000", 2024-09-13T06:43:00.911 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:00.911 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.912 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.912 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:00.912 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707481+0000", 2024-09-13T06:43:00.912 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.3589999999999999e-06 2024-09-13T06:43:00.912 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.912 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.912 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:00.912 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707492+0000", 2024-09-13T06:43:00.912 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0725e-05 2024-09-13T06:43:00.912 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.912 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.913 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:00.913 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707500+0000", 2024-09-13T06:43:00.913 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.1089999999999998e-06 2024-09-13T06:43:00.913 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.913 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.913 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:00.913 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707773+0000", 2024-09-13T06:43:00.913 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000273291 2024-09-13T06:43:00.913 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.913 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.913 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:43:00.913 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707784+0000", 2024-09-13T06:43:00.913 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0441999999999999e-05 2024-09-13T06:43:00.914 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.914 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.914 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:00.914 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.402290+0000", 2024-09-13T06:43:00.914 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.69450651500000005 2024-09-13T06:43:00.914 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.914 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.914 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:00.914 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.402489+0000", 2024-09-13T06:43:00.914 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000198999 2024-09-13T06:43:00.914 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.914 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.914 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:00.915 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.402912+0000", 2024-09-13T06:43:00.915 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00042257299999999998 2024-09-13T06:43:00.915 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:00.915 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:00.915 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:00.915 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.915 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.915 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:181680 3.1d 3:be5d0ef9:::rbd_data.11218aab7a9c.0000000000000000:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e203)", 2024-09-13T06:43:00.915 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:42:45.707517+0000", 2024-09-13T06:43:00.915 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 15.128885088000001, 2024-09-13T06:43:00.915 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.69532440799999995, 2024-09-13T06:43:00.915 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:00.915 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:00.915 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:00.916 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:00.916 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:00.916 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 181680 2024-09-13T06:43:00.916 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.916 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:00.916 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.916 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:00.916 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707517+0000", 2024-09-13T06:43:00.916 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:00.916 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.916 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.916 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:00.916 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707517+0000", 2024-09-13T06:43:00.917 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:00.917 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.917 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.917 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:00.917 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707517+0000", 2024-09-13T06:43:00.917 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:00.917 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.917 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.917 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:00.917 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707519+0000", 2024-09-13T06:43:00.917 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.2800000000000002e-06 2024-09-13T06:43:00.917 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.917 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.917 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:00.918 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707527+0000", 2024-09-13T06:43:00.918 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.2660000000000001e-06 2024-09-13T06:43:00.918 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.918 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.918 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:00.918 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707535+0000", 2024-09-13T06:43:00.918 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.1760000000000004e-06 2024-09-13T06:43:00.918 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.918 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.918 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:00.918 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707838+0000", 2024-09-13T06:43:00.918 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00030318000000000001 2024-09-13T06:43:00.918 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.919 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.919 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:43:00.919 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707850+0000", 2024-09-13T06:43:00.919 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1787000000000001e-05 2024-09-13T06:43:00.919 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.919 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.919 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:00.919 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.402702+0000", 2024-09-13T06:43:00.919 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.69485264599999996 2024-09-13T06:43:00.919 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.919 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.919 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:00.919 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.402783+0000", 2024-09-13T06:43:00.919 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.1114999999999998e-05 2024-09-13T06:43:00.920 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.920 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.920 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:00.920 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.402842+0000", 2024-09-13T06:43:00.920 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.8322999999999997e-05 2024-09-13T06:43:00.920 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:00.920 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:00.920 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:00.920 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.920 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.920 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:181694 3.1d 3:be5d0ef9:::rbd_data.11218aab7a9c.0000000000000000:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e203)", 2024-09-13T06:43:00.920 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:42:45.707544+0000", 2024-09-13T06:43:00.920 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 15.128858396, 2024-09-13T06:43:00.920 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.69580726699999995, 2024-09-13T06:43:00.921 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:00.921 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:00.921 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:00.921 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:00.921 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:00.921 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 181694 2024-09-13T06:43:00.921 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.921 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:00.921 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.921 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:00.921 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707544+0000", 2024-09-13T06:43:00.921 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:00.921 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.922 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.922 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:00.922 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707544+0000", 2024-09-13T06:43:00.922 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:00.922 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.922 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.922 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:00.922 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707543+0000", 2024-09-13T06:43:00.922 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:00.922 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.922 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.922 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:00.922 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707561+0000", 2024-09-13T06:43:00.923 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7804000000000001e-05 2024-09-13T06:43:00.923 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.923 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.923 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:00.923 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707575+0000", 2024-09-13T06:43:00.923 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3884e-05 2024-09-13T06:43:00.923 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.923 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.923 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:00.923 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707583+0000", 2024-09-13T06:43:00.923 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5730000000000002e-06 2024-09-13T06:43:00.923 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.923 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.924 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:00.924 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707899+0000", 2024-09-13T06:43:00.924 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00031663999999999998 2024-09-13T06:43:00.924 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.924 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.924 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:43:00.924 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707908+0000", 2024-09-13T06:43:00.924 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.1430000000000004e-06 2024-09-13T06:43:00.924 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.924 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.924 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:00.924 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.402973+0000", 2024-09-13T06:43:00.924 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.69506426099999996 2024-09-13T06:43:00.925 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.925 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.925 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:00.925 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.403155+0000", 2024-09-13T06:43:00.925 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00018245199999999999 2024-09-13T06:43:00.925 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.925 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.925 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:00.925 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.403351+0000", 2024-09-13T06:43:00.925 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000196028 2024-09-13T06:43:00.925 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:00.925 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:00.925 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:00.925 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.926 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.926 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:181708 3.1d 3:be5d0ef9:::rbd_data.11218aab7a9c.0000000000000000:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e203)", 2024-09-13T06:43:00.926 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:42:45.707622+0000", 2024-09-13T06:43:00.926 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 15.128780352, 2024-09-13T06:43:00.926 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.69603707699999995, 2024-09-13T06:43:00.926 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:00.926 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:00.926 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:00.926 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:00.926 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:00.926 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 181708 2024-09-13T06:43:00.926 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.926 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:00.926 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.927 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:00.927 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707622+0000", 2024-09-13T06:43:00.927 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:00.927 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.927 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.927 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:00.927 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707622+0000", 2024-09-13T06:43:00.927 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:00.927 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.927 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.927 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:00.927 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707621+0000", 2024-09-13T06:43:00.927 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:00.927 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.928 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.928 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:00.928 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707624+0000", 2024-09-13T06:43:00.928 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.8210000000000002e-06 2024-09-13T06:43:00.928 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.928 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.928 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:00.928 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707631+0000", 2024-09-13T06:43:00.928 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.8460000000000002e-06 2024-09-13T06:43:00.928 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.928 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.928 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:00.928 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707635+0000", 2024-09-13T06:43:00.929 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.4610000000000001e-06 2024-09-13T06:43:00.929 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.929 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.929 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:00.929 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707955+0000", 2024-09-13T06:43:00.929 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00031982000000000001 2024-09-13T06:43:00.929 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.929 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.929 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:43:00.929 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707966+0000", 2024-09-13T06:43:00.929 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0822000000000001e-05 2024-09-13T06:43:00.929 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.930 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.930 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:00.930 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.403541+0000", 2024-09-13T06:43:00.930 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.69557444300000004 2024-09-13T06:43:00.930 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.930 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.930 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:00.930 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.403598+0000", 2024-09-13T06:43:00.930 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.7147e-05 2024-09-13T06:43:00.930 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.930 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.930 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:00.930 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.403659+0000", 2024-09-13T06:43:00.931 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.1373999999999999e-05 2024-09-13T06:43:00.931 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:00.931 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:00.931 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:00.931 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.931 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.931 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:181722 3.1d 3:be5d0ef9:::rbd_data.11218aab7a9c.0000000000000000:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e203)", 2024-09-13T06:43:00.931 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:42:45.707640+0000", 2024-09-13T06:43:00.931 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 15.128761901000001, 2024-09-13T06:43:00.931 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.69620305800000004, 2024-09-13T06:43:00.931 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:00.931 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:00.931 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:00.931 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:00.932 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:00.932 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 181722 2024-09-13T06:43:00.932 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.932 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:00.932 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.932 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:00.932 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707640+0000", 2024-09-13T06:43:00.932 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:00.932 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.932 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.932 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:00.933 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707640+0000", 2024-09-13T06:43:00.933 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:00.933 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.933 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.933 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:00.933 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707640+0000", 2024-09-13T06:43:00.933 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:00.937 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.937 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.937 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:00.937 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707643+0000", 2024-09-13T06:43:00.937 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.213e-06 2024-09-13T06:43:00.937 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.937 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.937 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:00.937 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707651+0000", 2024-09-13T06:43:00.937 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.2290000000000003e-06 2024-09-13T06:43:00.937 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.937 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.938 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:00.938 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707656+0000", 2024-09-13T06:43:00.938 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.9320000000000004e-06 2024-09-13T06:43:00.938 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.938 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.938 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:00.938 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.708012+0000", 2024-09-13T06:43:00.938 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00035600600000000002 2024-09-13T06:43:00.938 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.938 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.938 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:43:00.938 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.708024+0000", 2024-09-13T06:43:00.938 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1336e-05 2024-09-13T06:43:00.939 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.939 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.939 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:00.939 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.403696+0000", 2024-09-13T06:43:00.939 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.69567234499999997 2024-09-13T06:43:00.939 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.939 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.939 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:00.939 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.403757+0000", 2024-09-13T06:43:00.939 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.0715999999999999e-05 2024-09-13T06:43:00.939 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.939 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.939 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:00.939 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.403843+0000", 2024-09-13T06:43:00.940 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6679000000000001e-05 2024-09-13T06:43:00.940 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:00.940 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:00.940 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:00.940 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.940 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.940 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:181736 3.1d 3:be5d0ef9:::rbd_data.11218aab7a9c.0000000000000000:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e203)", 2024-09-13T06:43:00.940 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:42:45.707661+0000", 2024-09-13T06:43:00.940 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 15.128741534, 2024-09-13T06:43:00.940 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.69667210700000004, 2024-09-13T06:43:00.940 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:00.940 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:00.940 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:00.941 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:00.941 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:00.941 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 181736 2024-09-13T06:43:00.941 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.941 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:00.941 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.941 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:00.941 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707661+0000", 2024-09-13T06:43:00.941 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:00.941 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.941 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.941 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:00.941 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707661+0000", 2024-09-13T06:43:00.941 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:00.942 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.942 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.942 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:00.942 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707660+0000", 2024-09-13T06:43:00.942 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:00.942 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.942 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.942 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:00.942 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707664+0000", 2024-09-13T06:43:00.942 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.393e-06 2024-09-13T06:43:00.943 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.943 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.943 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:00.943 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707673+0000", 2024-09-13T06:43:00.943 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.5100000000000004e-06 2024-09-13T06:43:00.943 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.943 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.943 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:00.943 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707680+0000", 2024-09-13T06:43:00.943 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.8680000000000001e-06 2024-09-13T06:43:00.943 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.943 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.943 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:00.944 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.708068+0000", 2024-09-13T06:43:00.944 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00038784699999999997 2024-09-13T06:43:00.944 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.944 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.944 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:43:00.944 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.708078+0000", 2024-09-13T06:43:00.944 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.842e-06 2024-09-13T06:43:00.944 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.944 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.944 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:00.944 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.403924+0000", 2024-09-13T06:43:00.944 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.69584657699999997 2024-09-13T06:43:00.944 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.945 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.945 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:00.945 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.404135+0000", 2024-09-13T06:43:00.945 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000210662 2024-09-13T06:43:00.945 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.945 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.945 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:00.946 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.404333+0000", 2024-09-13T06:43:00.946 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00019787900000000001 2024-09-13T06:43:00.946 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:00.946 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:00.946 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:00.946 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.946 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.946 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:181750 3.1d 3.9f70ba7d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e203)", 2024-09-13T06:43:00.946 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:42:45.707687+0000", 2024-09-13T06:43:00.946 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 15.128715671, 2024-09-13T06:43:00.946 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.69667232199999996, 2024-09-13T06:43:00.946 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:00.946 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:43:00.947 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:00.947 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:00.947 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:00.947 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 181750 2024-09-13T06:43:00.947 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.947 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:00.947 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.947 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:00.947 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707687+0000", 2024-09-13T06:43:00.947 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:00.947 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.947 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.947 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:00.948 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707687+0000", 2024-09-13T06:43:00.948 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:00.948 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.948 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.948 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:00.948 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707686+0000", 2024-09-13T06:43:00.948 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:00.948 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.948 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.948 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:00.948 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707689+0000", 2024-09-13T06:43:00.948 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.824e-06 2024-09-13T06:43:00.948 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.948 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.949 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:00.949 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707693+0000", 2024-09-13T06:43:00.949 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.5900000000000001e-06 2024-09-13T06:43:00.949 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.949 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.949 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:00.949 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707697+0000", 2024-09-13T06:43:00.949 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.6899999999999998e-06 2024-09-13T06:43:00.949 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.949 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.949 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:00.949 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.708109+0000", 2024-09-13T06:43:00.949 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00041220200000000002 2024-09-13T06:43:00.949 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.950 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.950 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:43:00.950 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.708118+0000", 2024-09-13T06:43:00.950 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6000000000000007e-06 2024-09-13T06:43:00.950 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.950 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.950 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:00.950 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.404353+0000", 2024-09-13T06:43:00.950 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.69623486400000001 2024-09-13T06:43:00.950 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:00.950 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:00.950 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:00.950 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.404359+0000", 2024-09-13T06:43:00.950 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.2480000000000001e-06 2024-09-13T06:43:00.950 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:00.951 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:00.951 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:00.951 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:00.951 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:00.951 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:43:00.952 INFO:teuthology.orchestra.run.smithi081.stdout:5893 write 0xaaa25f8 thru 0xaaaccca (0xa6d3 bytes) 2024-09-13T06:43:00.952 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:43:00.953 INFO:teuthology.orchestra.run.smithi081.stdout:osd.0: {} 2024-09-13T06:43:00.953 INFO:teuthology.orchestra.run.smithi081.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-13T06:43:00.954 INFO:teuthology.orchestra.run.smithi081.stdout:5897 write 0xe3eec29 thru 0xe3fda16 (0xedee bytes) 2024-09-13T06:43:00.954 INFO:teuthology.orchestra.run.smithi081.stdout:5898 clone 43 order 20 su 4096 sc 3 2024-09-13T06:43:00.954 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-13T06:43:00.954 INFO:teuthology.orchestra.run.smithi081.stdout:osd.1: {} 2024-09-13T06:43:00.955 INFO:teuthology.orchestra.run.smithi081.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-13T06:43:00.955 INFO:teuthology.orchestra.run.smithi081.stdout:osd.2: {} 2024-09-13T06:43:00.955 INFO:teuthology.orchestra.run.smithi081.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-13T06:43:00.956 INFO:teuthology.orchestra.run.smithi081.stdout:osd.3: {} 2024-09-13T06:43:00.956 INFO:teuthology.orchestra.run.smithi081.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-13T06:43:00.956 INFO:teuthology.orchestra.run.smithi081.stdout:osd.4: {} 2024-09-13T06:43:00.957 INFO:teuthology.orchestra.run.smithi081.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-13T06:43:00.957 INFO:teuthology.orchestra.run.smithi081.stdout:osd.5: {} 2024-09-13T06:43:00.957 INFO:teuthology.orchestra.run.smithi081.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-13T06:43:00.957 INFO:teuthology.orchestra.run.smithi081.stderr:Error ENXIO: problem getting command descriptions from osd.6 2024-09-13T06:43:00.958 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:43:00.952+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:43:00.958 INFO:teuthology.orchestra.run.smithi081.stdout:osd.7: {} 2024-09-13T06:43:00.958 INFO:teuthology.orchestra.run.smithi081.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-13T06:43:00.959 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-13T06:43:00.959 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-13T06:43:01.054 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-13T06:43:01.053+0000 7fa8bb18e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 36790) UID: 0 2024-09-13T06:43:01.089 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:43:01.089 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:43:01.100 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-13T06:43:01.155 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:43:01.156+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:43:01.256 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:43:01.256+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:43:01.267 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:43:01.267 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:43:01.281 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-13T06:43:01.357 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:43:01.356+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:43:01.405 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:43:01.405 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:43:01.422 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-13T06:43:01.466 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:43:01.468+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:43:01.552 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:43:01.552 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:43:01.558 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-13T06:43:01.557+0000 7fa8bb18e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 36790) UID: 0 2024-09-13T06:43:01.567 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-13T06:43:01.660 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-13T06:43:01.657+0000 7fa8bb18e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 36790) UID: 0 2024-09-13T06:43:01.727 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:43:01.727 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:43:01.740 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-13T06:43:01.760 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-13T06:43:01.761+0000 7fa8bb18e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 36790) UID: 0 2024-09-13T06:43:01.814 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-13T06:43:01.862 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:43:01.861+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:43:01.864 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:43:01.864 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:43:01.879 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-13T06:43:01.962 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:43:01.961+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:43:02.001 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:43:02.002 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:43:02.016 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-13T06:43:02.063 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-13T06:43:02.061+0000 7fa8bb18e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 36790) UID: 0 2024-09-13T06:43:02.132 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:43:02.132 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:43:02.146 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-13T06:43:02.164 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:43:02.165+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:43:02.260 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:43:02.261 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:43:02.265 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:43:02.264+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:43:02.273 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-13T06:43:02.366 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:43:02.365+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:43:02.403 INFO:teuthology.orchestra.run.smithi081.stderr:noscrub is set 2024-09-13T06:43:02.439 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:43:02.440 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:43:02.453 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-13T06:43:02.494 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:43:02.496+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:43:02.569 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:43:02.569+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:43:02.609 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:43:02.610 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:43:02.623 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-13T06:43:02.670 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:43:02.669+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:43:02.738 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:43:02.739 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:43:02.751 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-13T06:43:02.771 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-13T06:43:02.769+0000 7fa8bb18e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 36790) UID: 0 2024-09-13T06:43:02.861 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:43:02.861 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:43:02.872 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-13T06:43:02.873+0000 7fa8bb18e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 36790) UID: 0 2024-09-13T06:43:02.873 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-13T06:43:02.960 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-13T06:43:02.980 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:43:02.981 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:43:02.981 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:43:02.980+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:43:02.994 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-13T06:43:03.074 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-13T06:43:03.073+0000 7fa8bb18e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 36790) UID: 0 2024-09-13T06:43:03.078 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 7, 5, 3, 4] out_osds: [6] dead_osds: [6] live_osds: [0, 1, 2, 3, 4, 5, 7] 2024-09-13T06:43:03.078 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-13T06:43:03.079 INFO:tasks.thrashosds.thrasher:Reweighting by: {'max_change': '1.0', 'overage': '1000', 'type': 'test-reweight-by-utilization'} 2024-09-13T06:43:03.079 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd test-reweight-by-utilization 1000 1.0 2024-09-13T06:43:03.113 INFO:teuthology.orchestra.run.smithi081.stdout:osd.0: {} 2024-09-13T06:43:03.114 INFO:teuthology.orchestra.run.smithi081.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-13T06:43:03.132 INFO:teuthology.orchestra.run.smithi081.stdout:osd.1: {} 2024-09-13T06:43:03.133 INFO:teuthology.orchestra.run.smithi081.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-13T06:43:03.149 INFO:teuthology.orchestra.run.smithi081.stdout:osd.2: {} 2024-09-13T06:43:03.149 INFO:teuthology.orchestra.run.smithi081.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-13T06:43:03.166 INFO:teuthology.orchestra.run.smithi081.stdout:osd.3: {} 2024-09-13T06:43:03.166 INFO:teuthology.orchestra.run.smithi081.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-13T06:43:03.174 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:43:03.176+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:43:03.177 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:43:03.178 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 20, 2024-09-13T06:43:03.178 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 600, 2024-09-13T06:43:03.178 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [ 2024-09-13T06:43:03.178 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:03.178 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:2226 3.15 3:af026987:::rbd_data.112173e2f1b7.0000000000000017:head [sparse-read 0~4194304] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-13T06:43:03.179 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:37.606562+0000", 2024-09-13T06:43:03.179 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 205.57119869499999, 2024-09-13T06:43:03.179 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.83322091700000001, 2024-09-13T06:43:03.179 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:03.179 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:43:03.179 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:03.179 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:03.179 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:03.179 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 2226 2024-09-13T06:43:03.179 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:03.179 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:03.179 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:03.179 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:03.179 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606562+0000", 2024-09-13T06:43:03.180 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:03.180 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:03.180 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:03.180 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:03.180 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606562+0000", 2024-09-13T06:43:03.180 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:03.180 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:03.180 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:03.180 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:03.181 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606561+0000", 2024-09-13T06:43:03.181 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:03.181 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:03.181 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:03.181 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:03.181 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606565+0000", 2024-09-13T06:43:03.181 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.4379999999999999e-06 2024-09-13T06:43:03.181 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:03.182 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:03.182 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:03.182 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606569+0000", 2024-09-13T06:43:03.182 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.425e-06 2024-09-13T06:43:03.182 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:03.182 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:03.182 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:03.182 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606572+0000", 2024-09-13T06:43:03.182 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.05e-06 2024-09-13T06:43:03.182 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:03.182 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:03.182 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:03.182 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606621+0000", 2024-09-13T06:43:03.182 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.8723000000000001e-05 2024-09-13T06:43:03.183 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:03.183 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:03.183 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:43:03.183 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606630+0000", 2024-09-13T06:43:03.183 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.8040000000000007e-06 2024-09-13T06:43:03.183 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:03.183 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:03.183 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:03.183 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.439648+0000", 2024-09-13T06:43:03.183 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.83301824800000002 2024-09-13T06:43:03.183 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:03.183 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:03.184 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:03.184 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.439782+0000", 2024-09-13T06:43:03.184 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00013466699999999999 2024-09-13T06:43:03.184 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:03.184 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:03.184 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:03.184 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:03.184 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:03.184 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25661 3.8 3:1180686c:::rbd_data.1121f2c5ee81.0000000000000009:13 [read 397312~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:43:03.184 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.436956+0000", 2024-09-13T06:43:03.185 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 186.740804161, 2024-09-13T06:43:03.185 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089036758999999993, 2024-09-13T06:43:03.185 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:03.185 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:03.185 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:03.185 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:03.185 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:03.185 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25661 2024-09-13T06:43:03.185 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:03.185 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:03.185 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:03.185 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:03.186 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436956+0000", 2024-09-13T06:43:03.186 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:03.186 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:03.186 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:03.186 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:03.186 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436956+0000", 2024-09-13T06:43:03.186 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:03.186 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:03.186 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:03.186 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:03.186 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436956+0000", 2024-09-13T06:43:03.186 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:03.186 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:03.186 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:03.186 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:03.187 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436958+0000", 2024-09-13T06:43:03.187 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1770000000000001e-06 2024-09-13T06:43:03.187 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:03.187 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:03.187 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:03.187 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436963+0000", 2024-09-13T06:43:03.187 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.6489999999999996e-06 2024-09-13T06:43:03.187 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:03.187 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:03.187 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:03.187 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436975+0000", 2024-09-13T06:43:03.187 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1783999999999999e-05 2024-09-13T06:43:03.187 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:03.188 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:03.188 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:03.188 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.525671+0000", 2024-09-13T06:43:03.188 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.088696292999999995 2024-09-13T06:43:03.188 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:03.188 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:03.188 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:03.188 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.525749+0000", 2024-09-13T06:43:03.188 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.7589000000000005e-05 2024-09-13T06:43:03.188 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:03.188 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:03.188 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:03.188 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.525993+0000", 2024-09-13T06:43:03.189 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00024381000000000001 2024-09-13T06:43:03.189 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:03.189 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:03.189 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:03.189 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:03.189 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:03.189 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25662 3.8 3:1180686c:::rbd_data.1121f2c5ee81.0000000000000009:13 [read 421888~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:43:03.189 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.436980+0000", 2024-09-13T06:43:03.189 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 186.74077984900001, 2024-09-13T06:43:03.189 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089367577000000004, 2024-09-13T06:43:03.189 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:03.189 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:03.189 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:03.190 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:03.190 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:03.190 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25662 2024-09-13T06:43:03.190 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:03.190 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:03.190 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:03.190 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:03.190 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436980+0000", 2024-09-13T06:43:03.190 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:03.190 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:03.190 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:03.190 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:03.190 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436980+0000", 2024-09-13T06:43:03.190 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:03.191 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:03.191 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:03.191 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:03.191 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436980+0000", 2024-09-13T06:43:03.191 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:03.191 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:03.191 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:03.191 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:03.191 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436982+0000", 2024-09-13T06:43:03.191 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3989999999999998e-06 2024-09-13T06:43:03.192 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:03.192 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:03.192 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:03.192 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436988+0000", 2024-09-13T06:43:03.192 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0039999999999996e-06 2024-09-13T06:43:03.192 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:03.192 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:03.192 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:03.192 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436993+0000", 2024-09-13T06:43:03.192 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6090000000000003e-06 2024-09-13T06:43:03.193 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:03.193 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:03.193 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:03.193 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.526035+0000", 2024-09-13T06:43:03.193 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089042248000000004 2024-09-13T06:43:03.193 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:03.193 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:03.193 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:03.193 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.526111+0000", 2024-09-13T06:43:03.193 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5643999999999996e-05 2024-09-13T06:43:03.193 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:03.193 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:03.194 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:03.194 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.526348+0000", 2024-09-13T06:43:03.194 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00023705800000000001 2024-09-13T06:43:03.194 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:03.194 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:03.194 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:03.194 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:03.194 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:03.194 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25663 3.8 3:1180686c:::rbd_data.1121f2c5ee81.0000000000000009:13 [read 466944~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:43:03.195 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.436998+0000", 2024-09-13T06:43:03.195 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 186.74076220200001, 2024-09-13T06:43:03.195 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089730867000000006, 2024-09-13T06:43:03.195 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:03.195 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:03.195 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:03.195 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:03.195 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:03.195 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25663 2024-09-13T06:43:03.195 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:03.195 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:03.195 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:03.196 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:03.196 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436998+0000", 2024-09-13T06:43:03.196 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:03.196 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:03.196 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:03.196 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:03.196 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436998+0000", 2024-09-13T06:43:03.196 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:03.196 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:03.196 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:03.196 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:03.196 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436998+0000", 2024-09-13T06:43:03.197 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:03.197 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:03.197 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:03.197 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:03.197 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437000+0000", 2024-09-13T06:43:03.197 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0940000000000002e-06 2024-09-13T06:43:03.197 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:03.197 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:03.197 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:03.197 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437005+0000", 2024-09-13T06:43:03.197 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.604e-06 2024-09-13T06:43:03.197 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:03.198 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:03.198 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:03.198 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437032+0000", 2024-09-13T06:43:03.198 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6407e-05 2024-09-13T06:43:03.198 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:03.198 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:03.198 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:03.198 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.526363+0000", 2024-09-13T06:43:03.198 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089331456000000004 2024-09-13T06:43:03.198 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:03.198 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:03.198 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:03.198 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.526404+0000", 2024-09-13T06:43:03.198 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.0887999999999999e-05 2024-09-13T06:43:03.199 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:03.199 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:03.199 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:03.199 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.526729+0000", 2024-09-13T06:43:03.199 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00032486 2024-09-13T06:43:03.199 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:03.199 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:03.199 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:03.199 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:03.199 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:03.199 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25664 3.8 3:1180686c:::rbd_data.1121f2c5ee81.0000000000000009:13 [read 491520~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:43:03.199 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.437040+0000", 2024-09-13T06:43:03.199 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 186.74072028699999, 2024-09-13T06:43:03.199 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.090016650000000004, 2024-09-13T06:43:03.200 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:03.200 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:03.200 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:03.200 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:03.200 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:03.200 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25664 2024-09-13T06:43:03.200 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:03.200 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:03.200 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:03.200 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:03.200 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437040+0000", 2024-09-13T06:43:03.200 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:03.200 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:03.200 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:03.201 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:03.201 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437040+0000", 2024-09-13T06:43:03.201 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:03.201 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:03.201 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:03.201 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:03.201 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437039+0000", 2024-09-13T06:43:03.201 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:03.201 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:03.201 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:03.201 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:03.202 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437047+0000", 2024-09-13T06:43:03.202 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4839999999999998e-06 2024-09-13T06:43:03.202 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:03.202 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:03.202 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:03.202 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437054+0000", 2024-09-13T06:43:03.202 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.8299999999999998e-06 2024-09-13T06:43:03.202 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:03.203 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:03.203 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:03.203 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437060+0000", 2024-09-13T06:43:03.203 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.1510000000000001e-06 2024-09-13T06:43:03.203 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:03.203 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:03.203 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:03.203 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.526772+0000", 2024-09-13T06:43:03.203 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089711737999999999 2024-09-13T06:43:03.203 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:03.203 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:03.203 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:03.203 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.526848+0000", 2024-09-13T06:43:03.203 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5870000000000004e-05 2024-09-13T06:43:03.203 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:03.204 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:03.204 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:03.204 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.527057+0000", 2024-09-13T06:43:03.204 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000209106 2024-09-13T06:43:03.204 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:03.204 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:03.204 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:03.204 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:03.204 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:03.204 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25740 3.18 3:1c662b96:::rbd_data.1121f2c5ee81.0000000000000010:13 [read 200704~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:43:03.204 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443352+0000", 2024-09-13T06:43:03.204 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 186.73440861200001, 2024-09-13T06:43:03.204 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089068222000000002, 2024-09-13T06:43:03.204 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:03.205 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:03.205 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:03.205 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:03.205 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:03.205 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25740 2024-09-13T06:43:03.205 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:03.205 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:03.205 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:03.205 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:03.205 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443352+0000", 2024-09-13T06:43:03.205 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:03.206 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:03.206 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:03.206 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:03.206 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443352+0000", 2024-09-13T06:43:03.206 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:03.206 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:03.206 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:03.206 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:03.206 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443351+0000", 2024-09-13T06:43:03.206 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:03.206 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:03.206 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:03.206 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:03.206 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443354+0000", 2024-09-13T06:43:03.207 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.841e-06 2024-09-13T06:43:03.207 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:03.207 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:03.207 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:03.207 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443361+0000", 2024-09-13T06:43:03.207 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.0010000000000004e-06 2024-09-13T06:43:03.207 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:03.207 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:03.207 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:03.207 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443366+0000", 2024-09-13T06:43:03.207 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7119999999999999e-06 2024-09-13T06:43:03.207 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:03.207 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:03.207 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:03.207 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532117+0000", 2024-09-13T06:43:03.207 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.088751327000000005 2024-09-13T06:43:03.208 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:03.208 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:03.208 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:03.208 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532193+0000", 2024-09-13T06:43:03.208 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5839000000000004e-05 2024-09-13T06:43:03.208 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:03.208 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:03.208 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:03.208 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532420+0000", 2024-09-13T06:43:03.208 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00022691000000000001 2024-09-13T06:43:03.208 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:03.208 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:03.208 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:03.208 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:03.209 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:03.209 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25741 3.18 3:1c662b96:::rbd_data.1121f2c5ee81.0000000000000010:13 [read 225280~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:43:03.209 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443378+0000", 2024-09-13T06:43:03.209 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 186.734381845, 2024-09-13T06:43:03.209 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089324107, 2024-09-13T06:43:03.209 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:03.209 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:03.209 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:03.209 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:03.209 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:03.209 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25741 2024-09-13T06:43:03.209 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:03.209 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:03.210 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:03.210 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:03.210 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443378+0000", 2024-09-13T06:43:03.210 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:03.210 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:03.210 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:03.210 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:03.210 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443378+0000", 2024-09-13T06:43:03.210 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:03.210 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:03.210 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:03.210 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:03.210 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443378+0000", 2024-09-13T06:43:03.210 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:03.211 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:03.211 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:03.211 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:03.211 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443380+0000", 2024-09-13T06:43:03.211 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3549999999999999e-06 2024-09-13T06:43:03.211 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:03.211 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:03.211 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:03.211 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443388+0000", 2024-09-13T06:43:03.211 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.7449999999999995e-06 2024-09-13T06:43:03.211 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:03.211 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:03.211 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:03.211 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443393+0000", 2024-09-13T06:43:03.211 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.4e-06 2024-09-13T06:43:03.211 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:03.212 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:03.212 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:03.212 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532454+0000", 2024-09-13T06:43:03.212 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089060941000000005 2024-09-13T06:43:03.212 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:03.212 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:03.212 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:03.212 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532512+0000", 2024-09-13T06:43:03.212 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7763000000000002e-05 2024-09-13T06:43:03.212 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:03.212 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:03.213 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:03.213 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532703+0000", 2024-09-13T06:43:03.213 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000190328 2024-09-13T06:43:03.213 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:03.213 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:03.213 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:03.213 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:03.213 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:03.213 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25742 3.18 3:1c662b96:::rbd_data.1121f2c5ee81.0000000000000010:13 [read 270336~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:43:03.213 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443398+0000", 2024-09-13T06:43:03.213 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 186.73436213299999, 2024-09-13T06:43:03.214 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089621836999999996, 2024-09-13T06:43:03.214 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:03.214 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:03.214 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:03.214 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:03.214 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:03.214 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25742 2024-09-13T06:43:03.214 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:03.214 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:03.214 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:03.214 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:03.214 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443398+0000", 2024-09-13T06:43:03.214 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:03.214 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:03.214 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:03.215 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:03.215 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443398+0000", 2024-09-13T06:43:03.215 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:03.215 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:03.215 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:03.215 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:03.215 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443398+0000", 2024-09-13T06:43:03.215 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:03.215 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:03.215 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:03.215 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:03.215 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443400+0000", 2024-09-13T06:43:03.215 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1849999999999998e-06 2024-09-13T06:43:03.215 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:03.215 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:03.216 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:03.216 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443407+0000", 2024-09-13T06:43:03.216 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3669999999999999e-06 2024-09-13T06:43:03.216 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:03.216 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:03.216 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:03.216 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443420+0000", 2024-09-13T06:43:03.216 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2645e-05 2024-09-13T06:43:03.216 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:03.216 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:03.216 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:03.217 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532742+0000", 2024-09-13T06:43:03.217 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089322200000000004 2024-09-13T06:43:03.217 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:03.217 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:03.217 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:03.217 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532818+0000", 2024-09-13T06:43:03.217 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.6019000000000005e-05 2024-09-13T06:43:03.217 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:03.217 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:03.217 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:03.217 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533020+0000", 2024-09-13T06:43:03.217 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000201721 2024-09-13T06:43:03.217 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:03.218 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:03.218 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:03.218 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:03.218 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:03.218 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25743 3.18 3:1c662b96:::rbd_data.1121f2c5ee81.0000000000000010:13 [read 294912~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:43:03.218 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443425+0000", 2024-09-13T06:43:03.218 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 186.734335125, 2024-09-13T06:43:03.218 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089864075000000002, 2024-09-13T06:43:03.218 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:03.218 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:03.218 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:03.218 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:03.219 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:03.219 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25743 2024-09-13T06:43:03.219 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:03.219 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:03.219 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:03.219 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:03.219 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443425+0000", 2024-09-13T06:43:03.219 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:03.219 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:03.219 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:03.220 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:03.220 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443425+0000", 2024-09-13T06:43:03.220 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:03.220 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:03.220 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:03.220 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:03.220 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443425+0000", 2024-09-13T06:43:03.220 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:03.220 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:03.220 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:03.220 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:03.221 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443432+0000", 2024-09-13T06:43:03.221 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3420000000000002e-06 2024-09-13T06:43:03.221 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:03.221 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:03.221 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:03.221 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443440+0000", 2024-09-13T06:43:03.221 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5689999999999999e-06 2024-09-13T06:43:03.221 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:03.221 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:03.222 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:03.222 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443445+0000", 2024-09-13T06:43:03.222 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9590000000000003e-06 2024-09-13T06:43:03.222 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:03.222 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:03.222 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:03.222 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533063+0000", 2024-09-13T06:43:03.222 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089617988999999995 2024-09-13T06:43:03.222 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:03.222 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:03.222 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:03.222 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533122+0000", 2024-09-13T06:43:03.222 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9052999999999999e-05 2024-09-13T06:43:03.222 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:03.222 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:03.222 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:03.223 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533289+0000", 2024-09-13T06:43:03.223 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00016752800000000001 2024-09-13T06:43:03.223 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:03.223 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:03.223 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:03.223 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:03.223 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:03.223 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25744 3.18 3.69d46638 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:43:03.223 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443449+0000", 2024-09-13T06:43:03.223 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 186.734310978, 2024-09-13T06:43:03.223 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089869148999999995, 2024-09-13T06:43:03.224 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:03.224 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:43:03.224 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:03.224 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:03.224 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:03.224 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25744 2024-09-13T06:43:03.224 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:03.224 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:03.224 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:03.224 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:03.224 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443449+0000", 2024-09-13T06:43:03.224 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:03.224 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:03.225 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:03.225 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:03.225 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443449+0000", 2024-09-13T06:43:03.225 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:03.225 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:03.225 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:03.225 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:03.225 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443449+0000", 2024-09-13T06:43:03.225 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:03.225 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:03.225 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:03.225 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:03.226 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443451+0000", 2024-09-13T06:43:03.226 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.244e-06 2024-09-13T06:43:03.226 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:03.226 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:03.226 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:03.226 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443457+0000", 2024-09-13T06:43:03.226 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.66e-06 2024-09-13T06:43:03.226 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:03.226 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:03.226 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:03.226 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443461+0000", 2024-09-13T06:43:03.226 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5449999999999997e-06 2024-09-13T06:43:03.226 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:03.226 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:03.226 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:03.226 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533311+0000", 2024-09-13T06:43:03.227 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089849729000000003 2024-09-13T06:43:03.227 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:03.227 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:03.227 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:03.227 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533318+0000", 2024-09-13T06:43:03.227 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.328e-06 2024-09-13T06:43:03.227 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:03.227 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:03.227 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:03.227 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:03.227 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:03.227 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25745 3.18 3.69d46638 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:43:03.228 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443466+0000", 2024-09-13T06:43:03.228 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 186.73429392, 2024-09-13T06:43:03.228 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089886743000000005, 2024-09-13T06:43:03.228 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:03.228 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:43:03.228 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:03.228 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:03.228 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:03.228 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25745 2024-09-13T06:43:03.228 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:03.229 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:03.229 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:03.229 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:03.229 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443466+0000", 2024-09-13T06:43:03.229 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:03.229 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:03.229 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:03.229 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:03.229 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443466+0000", 2024-09-13T06:43:03.229 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:03.229 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:03.230 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:03.230 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:03.230 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443466+0000", 2024-09-13T06:43:03.230 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:03.230 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:03.230 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:03.230 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:03.230 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443474+0000", 2024-09-13T06:43:03.230 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.1289999999999996e-06 2024-09-13T06:43:03.230 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:03.230 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:03.230 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:03.231 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443484+0000", 2024-09-13T06:43:03.231 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0654e-05 2024-09-13T06:43:03.231 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:03.231 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:03.231 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:03.231 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443490+0000", 2024-09-13T06:43:03.231 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8030000000000002e-06 2024-09-13T06:43:03.231 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:03.231 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:03.231 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:03.231 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533348+0000", 2024-09-13T06:43:03.231 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089857267000000005 2024-09-13T06:43:03.232 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:03.232 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:03.232 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:03.232 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533353+0000", 2024-09-13T06:43:03.232 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.5520000000000004e-06 2024-09-13T06:43:03.232 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:03.232 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:03.232 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:03.232 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:03.233 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:03.233 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25746 3.18 3.69d46638 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:43:03.233 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443495+0000", 2024-09-13T06:43:03.233 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 186.73426480699999, 2024-09-13T06:43:03.233 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089903725000000004, 2024-09-13T06:43:03.233 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:03.233 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:43:03.233 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:03.233 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:03.233 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:03.233 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25746 2024-09-13T06:43:03.234 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:03.234 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:03.234 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:03.234 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:03.234 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443495+0000", 2024-09-13T06:43:03.234 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:03.234 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:03.234 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:03.234 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:03.234 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443495+0000", 2024-09-13T06:43:03.234 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:03.234 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:03.234 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:03.235 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:03.235 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443495+0000", 2024-09-13T06:43:03.235 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:03.235 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:03.235 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:03.235 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:03.235 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443498+0000", 2024-09-13T06:43:03.235 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.7690000000000001e-06 2024-09-13T06:43:03.235 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:03.235 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:03.235 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:03.235 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443504+0000", 2024-09-13T06:43:03.235 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9710000000000001e-06 2024-09-13T06:43:03.236 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:03.236 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:03.236 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:03.236 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443508+0000", 2024-09-13T06:43:03.236 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4159999999999997e-06 2024-09-13T06:43:03.236 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:03.236 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:03.236 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:03.236 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533391+0000", 2024-09-13T06:43:03.236 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089882607000000003 2024-09-13T06:43:03.236 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:03.236 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:03.237 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:03.237 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533399+0000", 2024-09-13T06:43:03.237 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.4349999999999997e-06 2024-09-13T06:43:03.237 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:03.237 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:03.237 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:03.237 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:03.237 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:03.237 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25747 3.8 3.63996268 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:43:03.237 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443512+0000", 2024-09-13T06:43:03.237 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 186.734248076, 2024-09-13T06:43:03.237 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089880075000000004, 2024-09-13T06:43:03.237 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:03.238 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:43:03.238 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:03.238 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:03.238 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:03.238 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25747 2024-09-13T06:43:03.238 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:03.238 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:03.238 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:03.238 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:03.238 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443512+0000", 2024-09-13T06:43:03.238 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:03.238 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:03.238 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:03.238 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:03.238 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443512+0000", 2024-09-13T06:43:03.239 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:03.239 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:03.239 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:03.239 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:03.239 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443512+0000", 2024-09-13T06:43:03.239 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:03.239 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:03.239 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:03.239 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:03.239 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443514+0000", 2024-09-13T06:43:03.239 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0980000000000001e-06 2024-09-13T06:43:03.239 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:03.239 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:03.239 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:03.239 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443520+0000", 2024-09-13T06:43:03.240 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7069999999999997e-06 2024-09-13T06:43:03.240 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:03.240 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:03.240 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:03.240 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443524+0000", 2024-09-13T06:43:03.240 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5390000000000001e-06 2024-09-13T06:43:03.240 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:03.240 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:03.240 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:03.240 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533384+0000", 2024-09-13T06:43:03.240 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089859684999999995 2024-09-13T06:43:03.241 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:03.241 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:03.241 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:03.241 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533392+0000", 2024-09-13T06:43:03.241 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.3440000000000001e-06 2024-09-13T06:43:03.241 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:03.241 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:03.241 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:03.241 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:03.241 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:03.241 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25748 3.8 3.63996268 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:43:03.242 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443528+0000", 2024-09-13T06:43:03.242 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 186.73423194899999, 2024-09-13T06:43:03.242 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089890715999999996, 2024-09-13T06:43:03.242 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:03.242 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:43:03.242 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:03.242 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:03.242 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:03.242 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25748 2024-09-13T06:43:03.242 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:03.242 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:03.243 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:03.243 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:03.243 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443528+0000", 2024-09-13T06:43:03.243 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:03.243 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:03.243 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:03.243 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:03.243 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443528+0000", 2024-09-13T06:43:03.243 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:03.243 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:03.243 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:03.243 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:03.243 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443528+0000", 2024-09-13T06:43:03.244 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:03.244 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:03.244 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:03.244 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:03.244 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443530+0000", 2024-09-13T06:43:03.244 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0650000000000001e-06 2024-09-13T06:43:03.244 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:03.244 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:03.244 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:03.244 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443536+0000", 2024-09-13T06:43:03.245 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7259999999999999e-06 2024-09-13T06:43:03.245 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:03.245 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:03.245 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:03.245 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443540+0000", 2024-09-13T06:43:03.245 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5009999999999998e-06 2024-09-13T06:43:03.245 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:03.245 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:03.245 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:03.245 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533412+0000", 2024-09-13T06:43:03.245 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089871873000000005 2024-09-13T06:43:03.246 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:03.246 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:03.246 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:03.246 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533419+0000", 2024-09-13T06:43:03.246 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.883e-06 2024-09-13T06:43:03.246 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:03.246 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:03.246 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:03.246 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:03.246 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:03.247 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25749 3.8 3.63996268 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:43:03.247 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443545+0000", 2024-09-13T06:43:03.247 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 186.734215753, 2024-09-13T06:43:03.247 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089897988999999998, 2024-09-13T06:43:03.247 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:03.247 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:43:03.247 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:03.247 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:03.247 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:03.247 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25749 2024-09-13T06:43:03.247 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:03.248 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:03.248 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:03.248 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:03.248 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443545+0000", 2024-09-13T06:43:03.248 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:03.248 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:03.248 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:03.248 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:03.248 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443545+0000", 2024-09-13T06:43:03.248 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:03.248 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:03.249 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:03.249 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:03.249 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443544+0000", 2024-09-13T06:43:03.249 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:03.249 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:03.249 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:03.249 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:03.249 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443553+0000", 2024-09-13T06:43:03.249 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.4770000000000003e-06 2024-09-13T06:43:03.249 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:03.249 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:03.249 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:03.249 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443564+0000", 2024-09-13T06:43:03.250 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0986e-05 2024-09-13T06:43:03.250 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:03.250 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:03.250 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:03.250 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443569+0000", 2024-09-13T06:43:03.250 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2530000000000004e-06 2024-09-13T06:43:03.250 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:03.250 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:03.250 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:03.250 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533438+0000", 2024-09-13T06:43:03.250 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089868641999999999 2024-09-13T06:43:03.250 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:03.251 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:03.251 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:03.251 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533442+0000", 2024-09-13T06:43:03.251 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.989e-06 2024-09-13T06:43:03.251 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:03.251 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:03.251 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:03.251 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:03.252 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:03.252 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25750 3.8 3.63996268 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:43:03.252 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443574+0000", 2024-09-13T06:43:03.252 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 186.73418626700001, 2024-09-13T06:43:03.252 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089895143999999996, 2024-09-13T06:43:03.252 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:03.252 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:43:03.252 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:03.252 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:03.252 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:03.252 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25750 2024-09-13T06:43:03.253 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:03.253 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:03.253 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:03.253 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:03.253 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443574+0000", 2024-09-13T06:43:03.253 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:03.253 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:03.253 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:03.253 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:03.253 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443574+0000", 2024-09-13T06:43:03.253 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:03.253 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:03.253 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:03.254 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:03.254 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443574+0000", 2024-09-13T06:43:03.254 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:03.254 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:03.254 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:03.254 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:03.254 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443576+0000", 2024-09-13T06:43:03.254 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6910000000000002e-06 2024-09-13T06:43:03.255 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:03.255 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:03.255 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:03.255 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443583+0000", 2024-09-13T06:43:03.255 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.331e-06 2024-09-13T06:43:03.255 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:03.255 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:03.255 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:03.255 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443587+0000", 2024-09-13T06:43:03.255 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6129999999999997e-06 2024-09-13T06:43:03.255 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:03.255 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:03.256 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:03.256 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533464+0000", 2024-09-13T06:43:03.256 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089876605999999998 2024-09-13T06:43:03.256 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:03.256 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:03.256 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:03.256 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533469+0000", 2024-09-13T06:43:03.256 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3909999999999997e-06 2024-09-13T06:43:03.256 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:03.256 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:03.256 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:03.256 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:03.256 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:03.257 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25751 3.8 3.63996268 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:43:03.257 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443592+0000", 2024-09-13T06:43:03.257 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 186.73416857000001, 2024-09-13T06:43:03.257 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089913650999999997, 2024-09-13T06:43:03.257 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:03.257 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:43:03.257 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:03.257 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:03.257 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:03.257 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25751 2024-09-13T06:43:03.257 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:03.257 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:03.257 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:03.258 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:03.258 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443592+0000", 2024-09-13T06:43:03.258 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:03.258 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:03.258 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:03.258 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:03.258 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443592+0000", 2024-09-13T06:43:03.258 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:03.258 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:03.259 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:03.259 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:03.259 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443591+0000", 2024-09-13T06:43:03.259 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:03.259 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:03.259 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:03.259 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:03.259 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443594+0000", 2024-09-13T06:43:03.259 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3649999999999998e-06 2024-09-13T06:43:03.259 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:03.259 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:03.259 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:03.260 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443599+0000", 2024-09-13T06:43:03.260 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.699e-06 2024-09-13T06:43:03.260 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:03.260 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:03.260 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:03.260 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443611+0000", 2024-09-13T06:43:03.260 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1503e-05 2024-09-13T06:43:03.260 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:03.260 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:03.260 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:03.260 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533497+0000", 2024-09-13T06:43:03.260 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089886453000000005 2024-09-13T06:43:03.260 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:03.261 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:03.261 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:03.261 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533505+0000", 2024-09-13T06:43:03.261 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.9910000000000002e-06 2024-09-13T06:43:03.261 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:03.261 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:03.261 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:03.261 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:03.261 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:03.261 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25752 3.8 3.63996268 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:43:03.261 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443615+0000", 2024-09-13T06:43:03.261 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 186.734144789, 2024-09-13T06:43:03.261 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089905868999999999, 2024-09-13T06:43:03.262 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:03.262 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:43:03.262 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:03.262 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:03.262 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:03.262 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25752 2024-09-13T06:43:03.262 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:03.262 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:03.262 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:03.262 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:03.262 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443615+0000", 2024-09-13T06:43:03.263 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:03.263 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:03.263 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:03.263 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:03.263 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443615+0000", 2024-09-13T06:43:03.263 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:03.263 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:03.263 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:03.263 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:03.263 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443615+0000", 2024-09-13T06:43:03.263 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:03.263 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:03.263 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:03.264 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:03.264 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443617+0000", 2024-09-13T06:43:03.264 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3539999999999998e-06 2024-09-13T06:43:03.264 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:03.264 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:03.264 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:03.264 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443624+0000", 2024-09-13T06:43:03.264 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3600000000000001e-06 2024-09-13T06:43:03.264 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:03.264 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:03.264 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:03.264 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443628+0000", 2024-09-13T06:43:03.264 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.2350000000000001e-06 2024-09-13T06:43:03.264 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:03.265 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:03.265 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:03.265 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533517+0000", 2024-09-13T06:43:03.265 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089889029999999995 2024-09-13T06:43:03.265 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:03.265 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:03.265 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:03.265 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533521+0000", 2024-09-13T06:43:03.265 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.2529999999999998e-06 2024-09-13T06:43:03.265 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:03.265 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:03.265 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:03.265 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:03.266 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:03.266 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:64356 3.c 3:32785be9:::rbd_header.11218ba71f0d:head [watch reconnect cookie 140361410387072 gen 2] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e95)", 2024-09-13T06:43:03.266 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:48.473318+0000", 2024-09-13T06:43:03.266 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 134.70444239599999, 2024-09-13T06:43:03.266 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1458904379999999, 2024-09-13T06:43:03.266 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:03.266 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:03.266 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:03.266 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:03.266 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:03.266 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 64356 2024-09-13T06:43:03.266 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:03.266 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:03.266 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:03.267 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:03.267 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:48.473318+0000", 2024-09-13T06:43:03.267 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:03.267 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:03.267 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:03.267 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:03.267 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:48.473318+0000", 2024-09-13T06:43:03.267 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:03.267 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:03.267 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:03.267 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:03.267 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:48.473315+0000", 2024-09-13T06:43:03.268 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999971 2024-09-13T06:43:03.268 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:03.268 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:03.268 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:03.268 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:48.473329+0000", 2024-09-13T06:43:03.268 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.433e-05 2024-09-13T06:43:03.268 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:03.268 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:03.268 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:03.268 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:48.473363+0000", 2024-09-13T06:43:03.268 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.3592e-05 2024-09-13T06:43:03.268 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:03.268 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:03.269 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:03.269 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:48.473386+0000", 2024-09-13T06:43:03.269 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2708999999999999e-05 2024-09-13T06:43:03.269 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:03.269 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:03.269 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:03.269 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:48.473804+0000", 2024-09-13T06:43:03.269 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00041789399999999998 2024-09-13T06:43:03.269 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:03.269 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:03.269 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:43:03.269 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:48.473830+0000", 2024-09-13T06:43:03.269 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6869e-05 2024-09-13T06:43:03.270 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:03.270 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:03.270 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:03.270 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:49.614332+0000", 2024-09-13T06:43:03.270 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.140501107 2024-09-13T06:43:03.270 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:03.270 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:03.270 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for rw locks", 2024-09-13T06:43:03.270 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:49.614496+0000", 2024-09-13T06:43:03.270 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00016451200000000001 2024-09-13T06:43:03.270 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:03.270 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:03.270 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:03.270 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:49.617131+0000", 2024-09-13T06:43:03.271 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.002634843 2024-09-13T06:43:03.271 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:03.271 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:03.271 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:03.271 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:49.617204+0000", 2024-09-13T06:43:03.271 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.2991000000000006e-05 2024-09-13T06:43:03.271 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:03.271 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:03.271 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:03.271 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:49.619208+0000", 2024-09-13T06:43:03.271 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.002004381 2024-09-13T06:43:03.271 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:03.271 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:03.271 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:03.271 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:03.272 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:03.272 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:170155 3.7 3:e17728eb:::image_client.0-clone36.rbd:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e191)", 2024-09-13T06:43:03.272 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:42:31.436412+0000", 2024-09-13T06:43:03.272 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 31.741348573, 2024-09-13T06:43:03.272 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.97843703800000004, 2024-09-13T06:43:03.272 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:03.272 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:43:03.272 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:03.272 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:03.272 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:03.272 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 170155 2024-09-13T06:43:03.272 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:03.272 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:03.272 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:03.273 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:03.273 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:31.436412+0000", 2024-09-13T06:43:03.273 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:03.273 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:03.273 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:03.273 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:03.273 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:31.436412+0000", 2024-09-13T06:43:03.273 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:03.273 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:03.273 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:03.273 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:03.273 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:31.436410+0000", 2024-09-13T06:43:03.273 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999986 2024-09-13T06:43:03.273 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:03.274 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:03.274 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:03.274 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:31.436417+0000", 2024-09-13T06:43:03.274 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.6939999999999998e-06 2024-09-13T06:43:03.274 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:03.274 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:03.274 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:03.274 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:31.436430+0000", 2024-09-13T06:43:03.274 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3016999999999999e-05 2024-09-13T06:43:03.274 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:03.274 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:03.274 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:03.274 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:31.436437+0000", 2024-09-13T06:43:03.274 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.1069999999999999e-06 2024-09-13T06:43:03.274 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:03.275 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:03.275 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:03.275 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:31.436515+0000", 2024-09-13T06:43:03.275 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.7756000000000006e-05 2024-09-13T06:43:03.275 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:03.275 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:03.275 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:43:03.275 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:31.436523+0000", 2024-09-13T06:43:03.275 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.4970000000000001e-06 2024-09-13T06:43:03.275 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:03.275 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:03.275 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:03.275 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:32.414565+0000", 2024-09-13T06:43:03.275 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.97804144199999998 2024-09-13T06:43:03.275 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:03.276 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:03.276 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:03.276 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:32.414849+0000", 2024-09-13T06:43:03.276 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00028388600000000001 2024-09-13T06:43:03.276 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:03.276 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:03.276 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:03.276 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:03.276 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:03.276 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:43:03.277 INFO:teuthology.orchestra.run.smithi081.stdout:osd.4: {} 2024-09-13T06:43:03.277 INFO:teuthology.orchestra.run.smithi081.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-13T06:43:03.278 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-13T06:43:03.279 INFO:teuthology.orchestra.run.smithi081.stdout:osd.5: {} 2024-09-13T06:43:03.279 INFO:teuthology.orchestra.run.smithi081.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-13T06:43:03.279 INFO:teuthology.orchestra.run.smithi081.stderr:Error ENXIO: problem getting command descriptions from osd.6 2024-09-13T06:43:03.279 INFO:teuthology.orchestra.run.smithi081.stdout:osd.7: {} 2024-09-13T06:43:03.280 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-13T06:43:03.280 INFO:teuthology.orchestra.run.smithi081.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-13T06:43:03.280 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-13T06:43:03.281 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:43:03.277+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:43:03.355 INFO:teuthology.orchestra.run.smithi081.stdout:moved 0 / 82 (0%) 2024-09-13T06:43:03.355 INFO:teuthology.orchestra.run.smithi081.stdout:avg 11.7143 2024-09-13T06:43:03.355 INFO:teuthology.orchestra.run.smithi081.stdout:stddev 2.24972 -> 2.24972 (expected baseline 3.16872) 2024-09-13T06:43:03.355 INFO:teuthology.orchestra.run.smithi081.stdout:min osd.2 with 8 -> 8 pgs (0.682927 -> 0.682927 * mean) 2024-09-13T06:43:03.355 INFO:teuthology.orchestra.run.smithi081.stdout:max osd.7 with 15 -> 15 pgs (1.28049 -> 1.28049 * mean) 2024-09-13T06:43:03.355 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T06:43:03.356 INFO:teuthology.orchestra.run.smithi081.stdout:oload 1000 2024-09-13T06:43:03.356 INFO:teuthology.orchestra.run.smithi081.stdout:max_change 1 2024-09-13T06:43:03.356 INFO:teuthology.orchestra.run.smithi081.stdout:max_change_osds 4 2024-09-13T06:43:03.356 INFO:teuthology.orchestra.run.smithi081.stdout:average_utilization 0.0017 2024-09-13T06:43:03.356 INFO:teuthology.orchestra.run.smithi081.stdout:overload_utilization 0.0169 2024-09-13T06:43:03.356 INFO:teuthology.orchestra.run.smithi081.stderr:no change 2024-09-13T06:43:03.372 INFO:tasks.thrashosds.thrasher:Reweighting by: {'max_change': '0.05', 'overage': '110', 'type': 'test-reweight-by-utilization'} 2024-09-13T06:43:03.462 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd test-reweight-by-utilization 110 0.05 2024-09-13T06:43:03.464 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:43:03.464 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [], 2024-09-13T06:43:03.464 INFO:teuthology.orchestra.run.smithi139.stdout: "num_ops": 0 2024-09-13T06:43:03.464 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:43:03.464 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-13T06:43:03.465 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:43:03.464+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:43:03.565 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:43:03.565+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:43:03.583 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:43:03.584 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [], 2024-09-13T06:43:03.584 INFO:teuthology.orchestra.run.smithi139.stdout: "complaint_time": 30, 2024-09-13T06:43:03.584 INFO:teuthology.orchestra.run.smithi139.stdout: "num_blocked_ops": 0 2024-09-13T06:43:03.584 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:43:03.600 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-13T06:43:03.688 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:43:03.689+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:43:03.750 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-09-13T06:43:03.748+0000 7f7f69d72640 -1 mgr.server reply reply (4) Interrupted system call no change 2024-09-13T06:43:03.750 INFO:teuthology.orchestra.run.smithi081.stdout:moved 4 / 82 (4.87805%) 2024-09-13T06:43:03.750 INFO:teuthology.orchestra.run.smithi081.stdout:avg 11.7143 2024-09-13T06:43:03.750 INFO:teuthology.orchestra.run.smithi081.stdout:stddev 2.24972 -> 2.60298 (expected baseline 3.16872) 2024-09-13T06:43:03.750 INFO:teuthology.orchestra.run.smithi081.stdout:min osd.2 with 8 -> 10 pgs (0.682927 -> 0.853658 * mean) 2024-09-13T06:43:03.750 INFO:teuthology.orchestra.run.smithi081.stdout:max osd.7 with 15 -> 16 pgs (1.28049 -> 1.36585 * mean) 2024-09-13T06:43:03.751 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T06:43:03.751 INFO:teuthology.orchestra.run.smithi081.stdout:oload 110 2024-09-13T06:43:03.751 INFO:teuthology.orchestra.run.smithi081.stdout:max_change 0.05 2024-09-13T06:43:03.751 INFO:teuthology.orchestra.run.smithi081.stdout:max_change_osds 4 2024-09-13T06:43:03.751 INFO:teuthology.orchestra.run.smithi081.stdout:average_utilization 0.0017 2024-09-13T06:43:03.751 INFO:teuthology.orchestra.run.smithi081.stdout:overload_utilization 0.0019 2024-09-13T06:43:03.751 INFO:teuthology.orchestra.run.smithi081.stdout:osd.3 weight 1.0000 -> 0.9500 2024-09-13T06:43:03.751 INFO:teuthology.orchestra.run.smithi081.stdout:osd.4 weight 0.5869 -> 0.5369 2024-09-13T06:43:03.751 INFO:teuthology.orchestra.run.smithi081.stdout:osd.5 weight 1.0000 -> 0.9500 2024-09-13T06:43:03.751 INFO:teuthology.orchestra.run.smithi081.stdout:osd.0 weight 1.0000 -> 0.9500 2024-09-13T06:43:03.751 INFO:teuthology.orchestra.run.smithi081.stderr:no change 2024-09-13T06:43:03.767 INFO:tasks.thrashosds.thrasher:Reweighting by: {'max_change': '1.0', 'overage': '1000', 'type': 'test-reweight-by-utilization'} 2024-09-13T06:43:03.767 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd test-reweight-by-utilization 1000 1.0 2024-09-13T06:43:03.768 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:43:03.768+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:43:03.770 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:43:03.770 INFO:teuthology.orchestra.run.smithi139.stdout: "size": 20, 2024-09-13T06:43:03.770 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 600, 2024-09-13T06:43:03.770 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [ 2024-09-13T06:43:03.770 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:03.770 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18706 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 3346432~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:43:03.770 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.846138+0000", 2024-09-13T06:43:03.770 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 191.922538062, 2024-09-13T06:43:03.771 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.102018712, 2024-09-13T06:43:03.771 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:03.771 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:03.771 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:03.771 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:03.771 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:03.771 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18706 2024-09-13T06:43:03.771 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:03.771 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:03.771 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:03.771 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:03.771 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846138+0000", 2024-09-13T06:43:03.771 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:03.772 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:03.772 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:03.772 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:03.772 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846138+0000", 2024-09-13T06:43:03.772 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:03.772 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:03.772 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:03.772 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:03.772 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846138+0000", 2024-09-13T06:43:03.772 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:03.772 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:03.772 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:03.773 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:03.773 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846141+0000", 2024-09-13T06:43:03.773 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.6969999999999999e-06 2024-09-13T06:43:03.773 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:03.773 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:03.773 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:03.773 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846150+0000", 2024-09-13T06:43:03.773 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6400000000000003e-06 2024-09-13T06:43:03.773 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:03.773 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:03.773 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:03.774 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846160+0000", 2024-09-13T06:43:03.774 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.3999999999999998e-06 2024-09-13T06:43:03.774 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:03.774 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:03.774 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:03.774 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.947764+0000", 2024-09-13T06:43:03.774 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101604085 2024-09-13T06:43:03.774 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:03.774 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:03.774 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:03.774 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.947888+0000", 2024-09-13T06:43:03.774 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000124113 2024-09-13T06:43:03.775 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:03.775 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:03.775 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:03.775 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.948157+0000", 2024-09-13T06:43:03.775 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00026943399999999998 2024-09-13T06:43:03.775 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:03.775 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:03.775 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:03.775 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:03.775 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:03.775 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18707 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 3375104~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:43:03.775 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.846207+0000", 2024-09-13T06:43:03.775 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 191.922469296, 2024-09-13T06:43:03.776 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10238114099999999, 2024-09-13T06:43:03.776 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:03.776 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:03.776 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:03.776 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:03.776 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:03.776 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18707 2024-09-13T06:43:03.776 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:03.776 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:03.776 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:03.776 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:03.776 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846207+0000", 2024-09-13T06:43:03.777 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:03.777 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:03.777 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:03.777 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:03.777 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846207+0000", 2024-09-13T06:43:03.777 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:03.777 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:03.777 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:03.777 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:03.777 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846206+0000", 2024-09-13T06:43:03.777 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:43:03.777 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:03.777 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:03.777 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:03.778 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846211+0000", 2024-09-13T06:43:03.778 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.3000000000000003e-06 2024-09-13T06:43:03.778 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:03.778 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:03.778 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:03.778 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846220+0000", 2024-09-13T06:43:03.778 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6199999999999994e-06 2024-09-13T06:43:03.778 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:03.778 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:03.778 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:03.778 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.846228+0000", 2024-09-13T06:43:03.778 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.7500000000000003e-06 2024-09-13T06:43:03.778 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:03.779 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:03.779 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:03.779 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.948267+0000", 2024-09-13T06:43:03.779 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10203878700000001 2024-09-13T06:43:03.779 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:03.779 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:03.779 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:03.779 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.948435+0000", 2024-09-13T06:43:03.779 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00016796500000000001 2024-09-13T06:43:03.779 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:03.779 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:03.779 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:03.779 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.948588+0000", 2024-09-13T06:43:03.780 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00015373599999999999 2024-09-13T06:43:03.780 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:03.780 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:03.780 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:03.780 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:03.780 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:03.780 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18718 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 3690496~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:43:03.780 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.850174+0000", 2024-09-13T06:43:03.780 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 191.91850214300001, 2024-09-13T06:43:03.780 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101854154, 2024-09-13T06:43:03.780 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:03.780 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:03.780 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:03.781 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:03.781 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:03.781 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18718 2024-09-13T06:43:03.781 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:03.781 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:03.781 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:03.781 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:03.781 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850174+0000", 2024-09-13T06:43:03.781 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:03.781 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:03.781 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:03.781 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:03.781 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850174+0000", 2024-09-13T06:43:03.782 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:03.782 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:03.782 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:03.782 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:03.782 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850173+0000", 2024-09-13T06:43:03.782 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:43:03.782 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:03.782 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:03.782 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:03.782 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850178+0000", 2024-09-13T06:43:03.782 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.4129999999999999e-06 2024-09-13T06:43:03.782 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:03.783 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:03.783 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:03.783 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850188+0000", 2024-09-13T06:43:03.783 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.8600000000000005e-06 2024-09-13T06:43:03.783 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:03.783 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:03.783 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:03.783 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850195+0000", 2024-09-13T06:43:03.783 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.8730000000000007e-06 2024-09-13T06:43:03.783 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:03.783 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:03.783 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:03.783 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.951766+0000", 2024-09-13T06:43:03.784 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.1015703 2024-09-13T06:43:03.784 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:03.784 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:03.784 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:03.784 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.951879+0000", 2024-09-13T06:43:03.784 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000112932 2024-09-13T06:43:03.784 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:03.784 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:03.784 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:03.784 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.952029+0000", 2024-09-13T06:43:03.784 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000149846 2024-09-13T06:43:03.785 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:03.785 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:03.785 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:03.785 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:03.785 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:03.785 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18719 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 3719168~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:43:03.785 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.850202+0000", 2024-09-13T06:43:03.785 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 191.9184741, 2024-09-13T06:43:03.785 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.102191676, 2024-09-13T06:43:03.785 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:03.785 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:03.785 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:03.785 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:03.786 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:03.786 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18719 2024-09-13T06:43:03.786 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:03.786 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:03.786 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:03.786 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:03.786 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850202+0000", 2024-09-13T06:43:03.786 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:03.786 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:03.786 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:03.786 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:03.786 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850202+0000", 2024-09-13T06:43:03.786 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:03.787 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:03.787 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:03.787 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:03.787 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850202+0000", 2024-09-13T06:43:03.787 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:43:03.787 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:03.787 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:03.787 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:03.787 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850205+0000", 2024-09-13T06:43:03.787 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.89e-06 2024-09-13T06:43:03.787 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:03.787 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:03.788 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:03.788 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850216+0000", 2024-09-13T06:43:03.788 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0233e-05 2024-09-13T06:43:03.788 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:03.788 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:03.788 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:03.788 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850223+0000", 2024-09-13T06:43:03.788 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5299999999999999e-06 2024-09-13T06:43:03.788 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:03.789 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:03.789 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:03.789 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.952106+0000", 2024-09-13T06:43:03.789 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10188309299999999 2024-09-13T06:43:03.789 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:03.789 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:03.789 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:03.789 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.952233+0000", 2024-09-13T06:43:03.789 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000126993 2024-09-13T06:43:03.789 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:03.789 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:03.789 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:03.789 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.952394+0000", 2024-09-13T06:43:03.790 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000160791 2024-09-13T06:43:03.790 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:03.790 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:03.790 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:03.790 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:03.790 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:03.790 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18720 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 3747840~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:43:03.790 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.850726+0000", 2024-09-13T06:43:03.790 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 191.917950271, 2024-09-13T06:43:03.790 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10199504299999999, 2024-09-13T06:43:03.790 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:03.790 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:03.790 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:03.791 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:03.791 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:03.791 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18720 2024-09-13T06:43:03.791 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:03.791 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:03.791 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:03.791 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:03.791 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850726+0000", 2024-09-13T06:43:03.791 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:03.791 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:03.791 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:03.791 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:03.792 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850726+0000", 2024-09-13T06:43:03.792 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:03.792 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:03.792 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:03.792 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:03.792 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850229+0000", 2024-09-13T06:43:03.792 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9995027 2024-09-13T06:43:03.792 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:03.792 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:03.792 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:03.792 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850731+0000", 2024-09-13T06:43:03.792 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00050221599999999999 2024-09-13T06:43:03.792 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:03.792 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:03.793 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:03.793 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850751+0000", 2024-09-13T06:43:03.793 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.9703000000000001e-05 2024-09-13T06:43:03.793 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:03.793 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:03.793 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:03.793 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.850764+0000", 2024-09-13T06:43:03.793 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3207000000000001e-05 2024-09-13T06:43:03.793 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:03.793 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:03.793 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:03.794 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.952454+0000", 2024-09-13T06:43:03.794 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101690102 2024-09-13T06:43:03.794 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:03.794 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:03.794 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:03.794 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.952571+0000", 2024-09-13T06:43:03.794 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000116556 2024-09-13T06:43:03.794 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:03.794 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:03.794 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:03.794 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.952721+0000", 2024-09-13T06:43:03.794 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000150419 2024-09-13T06:43:03.794 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:03.794 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:03.794 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:03.795 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:03.795 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:03.795 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18730 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 4034560~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:43:03.795 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.854013+0000", 2024-09-13T06:43:03.795 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 191.91466333, 2024-09-13T06:43:03.795 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10186914399999999, 2024-09-13T06:43:03.795 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:03.795 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:03.795 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:03.795 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:03.795 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:03.795 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18730 2024-09-13T06:43:03.795 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:03.796 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:03.796 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:03.796 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:03.796 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.854013+0000", 2024-09-13T06:43:03.796 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:03.796 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:03.796 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:03.796 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:03.796 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.854013+0000", 2024-09-13T06:43:03.796 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:03.796 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:03.796 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:03.796 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:03.797 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.854013+0000", 2024-09-13T06:43:03.797 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:03.797 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:03.797 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:03.797 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:03.797 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.854016+0000", 2024-09-13T06:43:03.797 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.1839999999999999e-06 2024-09-13T06:43:03.797 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:03.797 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:03.797 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:03.798 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.854025+0000", 2024-09-13T06:43:03.798 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.8030000000000003e-06 2024-09-13T06:43:03.798 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:03.798 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:03.798 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:03.798 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.854033+0000", 2024-09-13T06:43:03.798 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6500000000000002e-06 2024-09-13T06:43:03.798 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:03.798 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:03.798 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:03.798 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.955546+0000", 2024-09-13T06:43:03.798 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10151296 2024-09-13T06:43:03.798 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:03.799 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:03.799 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:03.799 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.955694+0000", 2024-09-13T06:43:03.799 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000147773 2024-09-13T06:43:03.799 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:03.799 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:03.799 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:03.799 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.955882+0000", 2024-09-13T06:43:03.799 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000188371 2024-09-13T06:43:03.799 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:03.799 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:03.799 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:03.800 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:03.800 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:03.800 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18742 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 4378624~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:43:03.800 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.857984+0000", 2024-09-13T06:43:03.800 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 191.91069220700001, 2024-09-13T06:43:03.800 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10179961799999999, 2024-09-13T06:43:03.800 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:03.800 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:03.800 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:03.800 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:03.800 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:03.800 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18742 2024-09-13T06:43:03.800 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:03.801 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:03.801 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:03.801 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:03.804 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.857984+0000", 2024-09-13T06:43:03.804 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:03.804 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:03.805 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:03.805 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:03.805 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.857984+0000", 2024-09-13T06:43:03.805 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:03.805 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:03.805 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:03.805 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:03.805 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.857983+0000", 2024-09-13T06:43:03.805 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:43:03.805 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:03.805 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:03.806 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:03.806 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.857987+0000", 2024-09-13T06:43:03.806 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0670000000000002e-06 2024-09-13T06:43:03.806 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:03.806 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:03.806 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:03.806 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.857997+0000", 2024-09-13T06:43:03.806 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6830000000000003e-06 2024-09-13T06:43:03.806 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:03.806 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:03.806 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:03.807 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.858006+0000", 2024-09-13T06:43:03.807 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.5739999999999996e-06 2024-09-13T06:43:03.807 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:03.807 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:03.807 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:03.807 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.959453+0000", 2024-09-13T06:43:03.807 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101447339 2024-09-13T06:43:03.807 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:03.807 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:03.807 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:03.807 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.959603+0000", 2024-09-13T06:43:03.807 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000150316 2024-09-13T06:43:03.807 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:03.808 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:03.808 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:03.808 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.959784+0000", 2024-09-13T06:43:03.808 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00018065900000000001 2024-09-13T06:43:03.808 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:03.808 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:03.808 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:03.808 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:03.808 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:03.808 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18743 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 4407296~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:43:03.808 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.858012+0000", 2024-09-13T06:43:03.808 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 191.91066421400001, 2024-09-13T06:43:03.809 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10210024500000001, 2024-09-13T06:43:03.809 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:03.809 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:03.809 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:03.809 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:03.809 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:03.809 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18743 2024-09-13T06:43:03.809 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:03.809 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:03.809 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:03.809 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:03.809 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.858012+0000", 2024-09-13T06:43:03.810 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:03.810 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:03.810 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:03.810 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:03.810 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.858012+0000", 2024-09-13T06:43:03.810 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:03.810 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:03.810 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:03.810 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:03.810 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.858011+0000", 2024-09-13T06:43:03.810 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:43:03.810 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:03.810 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:03.811 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:03.811 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.858016+0000", 2024-09-13T06:43:03.811 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0659999999999997e-06 2024-09-13T06:43:03.811 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:03.811 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:03.811 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:03.811 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.858024+0000", 2024-09-13T06:43:03.811 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.7700000000000007e-06 2024-09-13T06:43:03.811 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:03.811 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:03.811 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:03.811 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.858032+0000", 2024-09-13T06:43:03.811 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.7700000000000001e-06 2024-09-13T06:43:03.811 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:03.812 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:03.812 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:03.812 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.959850+0000", 2024-09-13T06:43:03.812 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.1018182 2024-09-13T06:43:03.812 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:03.812 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:03.812 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:03.812 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.959964+0000", 2024-09-13T06:43:03.812 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00011413600000000001 2024-09-13T06:43:03.812 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:03.812 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:03.812 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:03.812 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.960113+0000", 2024-09-13T06:43:03.813 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00014813900000000001 2024-09-13T06:43:03.813 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:03.813 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:03.813 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:03.813 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:03.813 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:03.813 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18755 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 4751360~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:43:03.813 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.862061+0000", 2024-09-13T06:43:03.813 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 191.90661596199999, 2024-09-13T06:43:03.813 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101907023, 2024-09-13T06:43:03.813 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:03.813 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:03.813 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:03.814 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:03.814 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:03.814 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18755 2024-09-13T06:43:03.814 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:03.814 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:03.814 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:03.814 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:03.814 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862061+0000", 2024-09-13T06:43:03.814 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:03.814 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:03.814 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:03.814 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:03.815 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862061+0000", 2024-09-13T06:43:03.815 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:03.815 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:03.815 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:03.815 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:03.815 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862060+0000", 2024-09-13T06:43:03.815 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:43:03.815 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:03.815 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:03.815 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:03.815 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862064+0000", 2024-09-13T06:43:03.815 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.3229999999999999e-06 2024-09-13T06:43:03.815 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:03.816 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:03.816 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:03.816 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862078+0000", 2024-09-13T06:43:03.816 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.433e-05 2024-09-13T06:43:03.816 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:03.816 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:03.816 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:03.816 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862086+0000", 2024-09-13T06:43:03.816 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.3869999999999997e-06 2024-09-13T06:43:03.816 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:03.816 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:03.816 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:03.816 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.963635+0000", 2024-09-13T06:43:03.817 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101549606 2024-09-13T06:43:03.817 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:03.817 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:03.817 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:03.817 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.963783+0000", 2024-09-13T06:43:03.817 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000147312 2024-09-13T06:43:03.817 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:03.817 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:03.817 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:03.817 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.963968+0000", 2024-09-13T06:43:03.817 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000185028 2024-09-13T06:43:03.817 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:03.817 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:03.818 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:03.818 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:03.818 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:03.818 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18756 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 4780032~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:43:03.818 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.862132+0000", 2024-09-13T06:43:03.818 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 191.90654411899999, 2024-09-13T06:43:03.818 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.102159295, 2024-09-13T06:43:03.818 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:03.818 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:03.818 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:03.818 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:03.818 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:03.818 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18756 2024-09-13T06:43:03.818 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:03.819 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:03.819 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:03.819 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:03.819 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862132+0000", 2024-09-13T06:43:03.819 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:03.819 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:03.819 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:03.819 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:03.819 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862132+0000", 2024-09-13T06:43:03.819 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:03.819 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:03.819 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:03.820 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:03.820 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862132+0000", 2024-09-13T06:43:03.820 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:43:03.820 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:03.820 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:03.820 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:03.820 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862136+0000", 2024-09-13T06:43:03.820 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.9559999999999999e-06 2024-09-13T06:43:03.820 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:03.820 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:03.820 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:03.820 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862145+0000", 2024-09-13T06:43:03.820 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6169999999999996e-06 2024-09-13T06:43:03.821 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:03.821 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:03.821 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:03.821 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.862153+0000", 2024-09-13T06:43:03.821 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.8359999999999992e-06 2024-09-13T06:43:03.821 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:03.821 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:03.821 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:03.821 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.964018+0000", 2024-09-13T06:43:03.821 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101865421 2024-09-13T06:43:03.821 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:03.821 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:03.822 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:03.822 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.964140+0000", 2024-09-13T06:43:03.822 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000121172 2024-09-13T06:43:03.822 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:03.822 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:03.822 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:03.822 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.964292+0000", 2024-09-13T06:43:03.822 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00015202600000000001 2024-09-13T06:43:03.822 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:03.822 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:03.822 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:03.822 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:03.822 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:03.823 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18768 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 5124096~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:43:03.823 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.866345+0000", 2024-09-13T06:43:03.823 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 191.902331812, 2024-09-13T06:43:03.823 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101779361, 2024-09-13T06:43:03.823 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:03.823 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:03.823 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:03.823 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:03.823 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:03.823 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18768 2024-09-13T06:43:03.823 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:03.823 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:03.823 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:03.823 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:03.824 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.866345+0000", 2024-09-13T06:43:03.824 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:03.824 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:03.824 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:03.824 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:03.824 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.866345+0000", 2024-09-13T06:43:03.824 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:03.824 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:03.824 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:03.824 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:03.824 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.866344+0000", 2024-09-13T06:43:03.824 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:03.824 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:03.825 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:03.825 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:03.825 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.866348+0000", 2024-09-13T06:43:03.825 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.4300000000000002e-06 2024-09-13T06:43:03.825 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:03.825 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:03.825 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:03.825 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.866356+0000", 2024-09-13T06:43:03.825 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.5930000000000006e-06 2024-09-13T06:43:03.825 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:03.825 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:03.825 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:03.825 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.866364+0000", 2024-09-13T06:43:03.826 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5599999999999996e-06 2024-09-13T06:43:03.826 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:03.826 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:03.826 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:03.826 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.967865+0000", 2024-09-13T06:43:03.826 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101501683 2024-09-13T06:43:03.826 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:03.826 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:03.826 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:03.826 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.967981+0000", 2024-09-13T06:43:03.826 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000115643 2024-09-13T06:43:03.826 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:03.826 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:03.826 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:03.827 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.968124+0000", 2024-09-13T06:43:03.827 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00014305500000000001 2024-09-13T06:43:03.827 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:03.827 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:03.827 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:03.827 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:03.827 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:03.827 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18779 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 5439488~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:43:03.827 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.869996+0000", 2024-09-13T06:43:03.827 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 191.89868092699999, 2024-09-13T06:43:03.827 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10189577399999999, 2024-09-13T06:43:03.827 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:03.827 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:03.828 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:03.828 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:03.828 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:03.828 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18779 2024-09-13T06:43:03.828 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:03.828 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:03.828 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:03.828 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:03.828 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.869996+0000", 2024-09-13T06:43:03.828 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:03.828 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:03.828 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:03.828 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:03.829 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.869996+0000", 2024-09-13T06:43:03.829 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:03.829 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:03.829 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:03.829 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:03.829 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.869995+0000", 2024-09-13T06:43:03.829 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:03.829 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:03.829 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:03.829 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:03.829 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.869998+0000", 2024-09-13T06:43:03.829 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.2729999999999998e-06 2024-09-13T06:43:03.829 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:03.830 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:03.830 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:03.830 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.870007+0000", 2024-09-13T06:43:03.830 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.5760000000000006e-06 2024-09-13T06:43:03.830 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:03.830 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:03.830 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:03.830 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.870014+0000", 2024-09-13T06:43:03.830 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.1400000000000002e-06 2024-09-13T06:43:03.830 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:03.830 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:03.830 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:03.830 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.971631+0000", 2024-09-13T06:43:03.831 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101617503 2024-09-13T06:43:03.831 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:03.831 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:03.831 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:03.831 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.971747+0000", 2024-09-13T06:43:03.831 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00011599600000000001 2024-09-13T06:43:03.831 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:03.831 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:03.831 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:03.831 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.971891+0000", 2024-09-13T06:43:03.831 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000143912 2024-09-13T06:43:03.831 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:03.831 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:03.832 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:03.832 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:03.832 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:03.832 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18792 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 5812224~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:43:03.832 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.874371+0000", 2024-09-13T06:43:03.832 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 191.89430579699999, 2024-09-13T06:43:03.832 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101736005, 2024-09-13T06:43:03.832 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:03.832 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:03.832 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:03.832 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:03.832 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:03.832 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18792 2024-09-13T06:43:03.832 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:03.833 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:03.833 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:03.833 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:03.833 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874371+0000", 2024-09-13T06:43:03.833 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:03.833 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:03.833 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:03.833 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:03.833 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874371+0000", 2024-09-13T06:43:03.833 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:03.833 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:03.833 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:03.834 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:03.834 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874370+0000", 2024-09-13T06:43:03.834 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:03.834 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:03.834 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:03.834 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:03.834 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874374+0000", 2024-09-13T06:43:03.834 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.7239999999999998e-06 2024-09-13T06:43:03.834 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:03.834 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:03.834 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:03.834 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874385+0000", 2024-09-13T06:43:03.834 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1293e-05 2024-09-13T06:43:03.834 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:03.835 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:03.835 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:03.835 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874394+0000", 2024-09-13T06:43:03.835 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.0729999999999994e-06 2024-09-13T06:43:03.835 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:03.835 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:03.835 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:03.835 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.975850+0000", 2024-09-13T06:43:03.835 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10145599700000001 2024-09-13T06:43:03.835 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:03.835 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:03.835 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:03.835 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.975963+0000", 2024-09-13T06:43:03.836 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000112689 2024-09-13T06:43:03.836 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:03.836 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:03.836 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:03.836 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.976107+0000", 2024-09-13T06:43:03.836 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000143836 2024-09-13T06:43:03.836 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:03.836 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:03.836 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:03.836 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:03.836 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:03.836 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18793 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 5840896~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:43:03.836 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.874401+0000", 2024-09-13T06:43:03.837 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 191.89427576400001, 2024-09-13T06:43:03.837 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.102005516, 2024-09-13T06:43:03.837 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:03.837 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:03.837 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:03.837 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:03.837 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:03.837 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18793 2024-09-13T06:43:03.837 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:03.837 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:03.837 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:03.837 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:03.837 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874401+0000", 2024-09-13T06:43:03.837 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:03.838 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:03.838 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:03.838 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:03.838 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874401+0000", 2024-09-13T06:43:03.838 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:03.838 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:03.838 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:03.838 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:03.838 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874400+0000", 2024-09-13T06:43:03.838 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:43:03.838 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:03.838 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:03.838 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:03.838 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874404+0000", 2024-09-13T06:43:03.839 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0069999999999999e-06 2024-09-13T06:43:03.839 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:03.839 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:03.839 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:03.839 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874412+0000", 2024-09-13T06:43:03.839 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.5399999999999996e-06 2024-09-13T06:43:03.839 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:03.839 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:03.839 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:03.839 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.874420+0000", 2024-09-13T06:43:03.839 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.6199999999999999e-06 2024-09-13T06:43:03.839 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:03.839 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:03.840 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:03.840 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.976150+0000", 2024-09-13T06:43:03.840 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101729874 2024-09-13T06:43:03.840 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:03.840 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:03.840 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:03.840 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.976261+0000", 2024-09-13T06:43:03.840 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000110819 2024-09-13T06:43:03.840 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:03.840 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:03.840 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:03.840 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.976406+0000", 2024-09-13T06:43:03.840 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000145489 2024-09-13T06:43:03.841 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:03.841 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:03.841 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:03.841 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:03.841 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:03.841 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18803 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 6127616~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:43:03.841 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.877851+0000", 2024-09-13T06:43:03.841 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 191.89082527100001, 2024-09-13T06:43:03.841 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101951584, 2024-09-13T06:43:03.841 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:03.841 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:03.841 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:03.842 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:03.842 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:03.842 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18803 2024-09-13T06:43:03.842 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:03.842 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:03.842 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:03.842 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:03.842 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.877851+0000", 2024-09-13T06:43:03.842 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:03.842 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:03.843 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:03.843 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:03.843 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.877851+0000", 2024-09-13T06:43:03.843 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:03.843 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:03.843 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:03.843 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:03.843 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.877851+0000", 2024-09-13T06:43:03.843 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:03.843 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:03.843 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:03.843 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:03.844 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.877854+0000", 2024-09-13T06:43:03.844 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.7929999999999999e-06 2024-09-13T06:43:03.844 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:03.844 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:03.844 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:03.844 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.877864+0000", 2024-09-13T06:43:03.844 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.2029999999999998e-06 2024-09-13T06:43:03.844 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:03.844 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:03.844 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:03.844 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.877873+0000", 2024-09-13T06:43:03.844 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.0440000000000001e-06 2024-09-13T06:43:03.844 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:03.845 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:03.845 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:03.845 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.979544+0000", 2024-09-13T06:43:03.845 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101671198 2024-09-13T06:43:03.845 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:03.845 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:03.845 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:03.845 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.979658+0000", 2024-09-13T06:43:03.845 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000114456 2024-09-13T06:43:03.845 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:03.845 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:03.845 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:03.845 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.979803+0000", 2024-09-13T06:43:03.846 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000144506 2024-09-13T06:43:03.846 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:03.846 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:03.846 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:03.846 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:03.846 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:03.846 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18807 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 6242304~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:43:03.846 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.879235+0000", 2024-09-13T06:43:03.846 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 191.88944124099999, 2024-09-13T06:43:03.846 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101781258, 2024-09-13T06:43:03.846 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:03.846 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:03.846 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:03.847 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:03.847 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:03.847 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18807 2024-09-13T06:43:03.847 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:03.847 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:03.847 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:03.847 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:03.847 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879235+0000", 2024-09-13T06:43:03.847 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:03.847 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:03.847 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:03.847 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:03.847 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879235+0000", 2024-09-13T06:43:03.848 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:03.848 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:03.848 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:03.848 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:03.848 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879235+0000", 2024-09-13T06:43:03.848 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:03.848 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:03.848 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:03.848 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:03.848 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879239+0000", 2024-09-13T06:43:03.848 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.963e-06 2024-09-13T06:43:03.848 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:03.848 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:03.849 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:03.849 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879247+0000", 2024-09-13T06:43:03.849 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6470000000000004e-06 2024-09-13T06:43:03.849 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:03.849 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:03.849 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:03.849 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879255+0000", 2024-09-13T06:43:03.849 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5429999999999996e-06 2024-09-13T06:43:03.849 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:03.849 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:03.849 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:03.849 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.980756+0000", 2024-09-13T06:43:03.850 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10150165999999999 2024-09-13T06:43:03.850 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:03.850 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:03.850 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:03.850 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.980868+0000", 2024-09-13T06:43:03.850 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000111196 2024-09-13T06:43:03.850 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:03.850 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:03.850 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:03.850 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.981017+0000", 2024-09-13T06:43:03.850 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000148846 2024-09-13T06:43:03.850 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:03.851 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:03.851 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:03.851 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:03.851 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:03.851 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18808 3.9 3:904af028:::rbd_data.112150cd58e1.0000000000000008:10 [read 6270976~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:43:03.851 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.879261+0000", 2024-09-13T06:43:03.851 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 191.88941510199999, 2024-09-13T06:43:03.851 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.102057547, 2024-09-13T06:43:03.851 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:03.851 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:03.851 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:03.851 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:03.851 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:03.852 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18808 2024-09-13T06:43:03.852 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:03.852 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:03.852 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:03.852 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:03.852 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879261+0000", 2024-09-13T06:43:03.852 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:03.852 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:03.852 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:03.852 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:03.852 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879261+0000", 2024-09-13T06:43:03.853 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:03.853 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:03.853 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:03.853 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:03.853 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879261+0000", 2024-09-13T06:43:03.853 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:03.853 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:03.853 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:03.853 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:03.853 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879264+0000", 2024-09-13T06:43:03.853 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.523e-06 2024-09-13T06:43:03.853 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:03.853 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:03.854 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:03.854 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879273+0000", 2024-09-13T06:43:03.854 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6070000000000008e-06 2024-09-13T06:43:03.854 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:03.854 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:03.854 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:03.854 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.879280+0000", 2024-09-13T06:43:03.854 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.4699999999999996e-06 2024-09-13T06:43:03.854 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:03.854 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:03.854 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:03.854 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.981060+0000", 2024-09-13T06:43:03.854 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10177934800000001 2024-09-13T06:43:03.855 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:03.855 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:03.855 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:03.855 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.981174+0000", 2024-09-13T06:43:03.855 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000114456 2024-09-13T06:43:03.855 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:03.855 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:03.855 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:03.855 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.981319+0000", 2024-09-13T06:43:03.855 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00014473900000000001 2024-09-13T06:43:03.855 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:03.855 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:03.856 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:03.856 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:03.856 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:03.856 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18811 3.9 3.140f5209 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:43:03.856 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.880449+0000", 2024-09-13T06:43:03.856 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 191.888227564, 2024-09-13T06:43:03.856 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.101739355, 2024-09-13T06:43:03.856 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:03.856 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:43:03.856 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:03.856 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:03.856 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:03.856 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18811 2024-09-13T06:43:03.857 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:03.857 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:03.857 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:03.857 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:03.857 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880449+0000", 2024-09-13T06:43:03.857 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:03.857 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:03.857 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:03.857 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:03.857 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880449+0000", 2024-09-13T06:43:03.857 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:03.857 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:03.857 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:03.858 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:03.858 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880448+0000", 2024-09-13T06:43:03.858 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:43:03.858 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:03.858 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:03.858 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:03.858 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880452+0000", 2024-09-13T06:43:03.858 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0470000000000004e-06 2024-09-13T06:43:03.858 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:03.858 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:03.858 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:03.858 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880462+0000", 2024-09-13T06:43:03.858 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6530000000000006e-06 2024-09-13T06:43:03.859 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:03.859 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:03.859 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:03.859 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880472+0000", 2024-09-13T06:43:03.859 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0027000000000001e-05 2024-09-13T06:43:03.859 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:03.859 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:03.859 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:03.859 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.982172+0000", 2024-09-13T06:43:03.859 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10170043500000001 2024-09-13T06:43:03.859 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:03.859 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:03.859 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:03.859 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.982188+0000", 2024-09-13T06:43:03.860 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6172999999999999e-05 2024-09-13T06:43:03.860 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:03.860 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:03.860 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:03.860 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:03.860 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:03.860 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:18812 3.9 3.140f5209 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-13T06:43:03.860 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:39:51.880478+0000", 2024-09-13T06:43:03.860 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 191.888198327, 2024-09-13T06:43:03.860 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10177795100000001, 2024-09-13T06:43:03.860 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:03.860 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:43:03.860 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:03.861 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:03.861 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:03.861 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 18812 2024-09-13T06:43:03.861 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:03.861 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:03.861 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:03.861 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:03.861 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880478+0000", 2024-09-13T06:43:03.861 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:03.861 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:03.861 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:03.861 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:03.862 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880478+0000", 2024-09-13T06:43:03.862 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:03.862 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:03.862 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:03.862 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:03.862 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880477+0000", 2024-09-13T06:43:03.862 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:43:03.862 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:03.862 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:03.862 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:03.862 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880481+0000", 2024-09-13T06:43:03.862 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.827e-06 2024-09-13T06:43:03.862 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:03.862 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:03.863 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:03.863 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880490+0000", 2024-09-13T06:43:03.863 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6100000000000006e-06 2024-09-13T06:43:03.863 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:03.863 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:03.863 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:03.863 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.880497+0000", 2024-09-13T06:43:03.863 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.7030000000000006e-06 2024-09-13T06:43:03.863 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:03.863 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:03.863 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:03.863 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.982241+0000", 2024-09-13T06:43:03.863 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.10174351199999999 2024-09-13T06:43:03.864 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:03.864 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:03.864 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:03.864 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:39:51.982256+0000", 2024-09-13T06:43:03.864 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5143000000000001e-05 2024-09-13T06:43:03.864 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:03.864 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:03.864 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:03.864 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:03.864 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:03.864 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:160483 3.a 3:57f62123:::rbd_header.112138ed422:head [watch reconnect cookie 140361344088384 gen 3] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e177)", 2024-09-13T06:43:03.864 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:42:17.439011+0000", 2024-09-13T06:43:03.864 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 46.329665136000003, 2024-09-13T06:43:03.865 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.155518861, 2024-09-13T06:43:03.865 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:03.865 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:03.865 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:03.865 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:03.865 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:03.865 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 160483 2024-09-13T06:43:03.865 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:03.865 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:03.865 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:03.865 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:03.865 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:17.439011+0000", 2024-09-13T06:43:03.865 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:03.866 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:03.866 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:03.866 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:03.866 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:17.439011+0000", 2024-09-13T06:43:03.866 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:03.866 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:03.866 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:03.866 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:03.866 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:17.439009+0000", 2024-09-13T06:43:03.866 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999976 2024-09-13T06:43:03.866 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:03.866 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:03.866 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:03.866 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:17.439024+0000", 2024-09-13T06:43:03.867 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.464e-05 2024-09-13T06:43:03.867 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:03.867 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:03.867 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:03.867 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:17.439058+0000", 2024-09-13T06:43:03.867 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.4712999999999998e-05 2024-09-13T06:43:03.867 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:03.867 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:03.867 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:03.867 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:17.439085+0000", 2024-09-13T06:43:03.867 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.6216000000000001e-05 2024-09-13T06:43:03.867 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:03.867 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:03.868 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:03.868 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:17.439182+0000", 2024-09-13T06:43:03.868 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.7020000000000003e-05 2024-09-13T06:43:03.868 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:03.868 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:03.868 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:43:03.868 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:17.439204+0000", 2024-09-13T06:43:03.868 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.2276000000000002e-05 2024-09-13T06:43:03.868 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:03.868 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:03.868 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:03.868 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:18.588627+0000", 2024-09-13T06:43:03.868 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1494235829999999 2024-09-13T06:43:03.869 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:03.869 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:03.869 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for rw locks", 2024-09-13T06:43:03.869 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:18.589031+0000", 2024-09-13T06:43:03.869 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0004035 2024-09-13T06:43:03.869 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:03.869 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:03.869 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:03.869 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:18.590604+0000", 2024-09-13T06:43:03.869 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.001573234 2024-09-13T06:43:03.869 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:03.869 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:03.870 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:03.870 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:18.590791+0000", 2024-09-13T06:43:03.870 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000186701 2024-09-13T06:43:03.870 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:03.870 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:03.870 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:03.870 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:18.594530+0000", 2024-09-13T06:43:03.870 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0037394250000000002 2024-09-13T06:43:03.870 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:03.870 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:03.870 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:03.870 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:03.870 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:03.871 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:43:03.872 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-13T06:43:03.873 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:43:03.872+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:43:03.973 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:43:03.972+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:43:04.043 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:43:04.043 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [], 2024-09-13T06:43:04.043 INFO:teuthology.orchestra.run.smithi139.stdout: "num_ops": 0 2024-09-13T06:43:04.043 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:43:04.057 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-13T06:43:04.104 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:43:04.105+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:43:04.170 INFO:teuthology.orchestra.run.smithi081.stdout:moved 0 / 82 (0%) 2024-09-13T06:43:04.170 INFO:teuthology.orchestra.run.smithi081.stdout:avg 11.7143 2024-09-13T06:43:04.170 INFO:teuthology.orchestra.run.smithi081.stdout:stddev 2.24972 -> 2.24972 (expected baseline 3.16872) 2024-09-13T06:43:04.170 INFO:teuthology.orchestra.run.smithi081.stdout:min osd.2 with 8 -> 8 pgs (0.682927 -> 0.682927 * mean) 2024-09-13T06:43:04.170 INFO:teuthology.orchestra.run.smithi081.stdout:max osd.7 with 15 -> 15 pgs (1.28049 -> 1.28049 * mean) 2024-09-13T06:43:04.170 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T06:43:04.170 INFO:teuthology.orchestra.run.smithi081.stdout:oload 1000 2024-09-13T06:43:04.170 INFO:teuthology.orchestra.run.smithi081.stdout:max_change 1 2024-09-13T06:43:04.170 INFO:teuthology.orchestra.run.smithi081.stdout:max_change_osds 4 2024-09-13T06:43:04.171 INFO:teuthology.orchestra.run.smithi081.stdout:average_utilization 0.0017 2024-09-13T06:43:04.171 INFO:teuthology.orchestra.run.smithi081.stdout:overload_utilization 0.0169 2024-09-13T06:43:04.171 INFO:teuthology.orchestra.run.smithi081.stderr:no change 2024-09-13T06:43:04.174 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:43:04.176+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:43:04.175 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:43:04.176 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [], 2024-09-13T06:43:04.176 INFO:teuthology.orchestra.run.smithi139.stdout: "complaint_time": 30, 2024-09-13T06:43:04.176 INFO:teuthology.orchestra.run.smithi139.stdout: "num_blocked_ops": 0 2024-09-13T06:43:04.176 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:43:04.188 INFO:tasks.thrashosds.thrasher:Reweighting by: {'max_change': '0.05', 'overage': '1000', 'type': 'reweight-by-utilization'} 2024-09-13T06:43:04.189 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight-by-utilization 1000 0.05 2024-09-13T06:43:04.190 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-13T06:43:04.275 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:43:04.276+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:43:04.362 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:43:04.362 INFO:teuthology.orchestra.run.smithi139.stdout: "size": 20, 2024-09-13T06:43:04.362 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 600, 2024-09-13T06:43:04.362 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [ 2024-09-13T06:43:04.362 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.363 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43299 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 432128~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:43:04.363 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589881+0000", 2024-09-13T06:43:04.363 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 162.76979332400001, 2024-09-13T06:43:04.363 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.079693849999999997, 2024-09-13T06:43:04.363 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:04.363 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:04.363 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:04.363 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:04.363 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:04.364 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43299 2024-09-13T06:43:04.364 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.364 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:04.364 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.364 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:04.364 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589881+0000", 2024-09-13T06:43:04.364 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:04.364 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.364 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.364 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:04.364 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589881+0000", 2024-09-13T06:43:04.364 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:04.365 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.365 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.365 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:04.365 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589880+0000", 2024-09-13T06:43:04.365 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:43:04.365 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.365 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.365 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:04.365 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589884+0000", 2024-09-13T06:43:04.365 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.053e-06 2024-09-13T06:43:04.365 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.365 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.365 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:04.366 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589893+0000", 2024-09-13T06:43:04.366 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.2129999999999997e-06 2024-09-13T06:43:04.366 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.366 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.366 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:04.366 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589901+0000", 2024-09-13T06:43:04.366 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.6399999999999997e-06 2024-09-13T06:43:04.366 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.366 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.366 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:04.366 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.669213+0000", 2024-09-13T06:43:04.366 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.079312074999999996 2024-09-13T06:43:04.366 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.366 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.366 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:04.367 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.669281+0000", 2024-09-13T06:43:04.367 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.8322000000000001e-05 2024-09-13T06:43:04.367 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.367 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.367 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:04.367 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.669575+0000", 2024-09-13T06:43:04.367 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00029349699999999999 2024-09-13T06:43:04.367 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:04.367 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:04.367 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:04.367 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.367 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.367 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43300 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 446464~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:43:04.367 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589909+0000", 2024-09-13T06:43:04.368 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 162.76976542899999, 2024-09-13T06:43:04.368 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.080339496999999996, 2024-09-13T06:43:04.368 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:04.368 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:04.368 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:04.368 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:04.368 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:04.368 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43300 2024-09-13T06:43:04.368 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.368 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:04.368 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.368 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:04.368 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589909+0000", 2024-09-13T06:43:04.368 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:04.368 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.369 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.369 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:04.369 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589909+0000", 2024-09-13T06:43:04.369 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:04.369 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.369 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.369 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:04.369 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589908+0000", 2024-09-13T06:43:04.369 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:43:04.369 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.369 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.369 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:04.369 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589912+0000", 2024-09-13T06:43:04.369 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.9430000000000002e-06 2024-09-13T06:43:04.370 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.370 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.370 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:04.370 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589920+0000", 2024-09-13T06:43:04.370 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.3860000000000007e-06 2024-09-13T06:43:04.370 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.370 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.370 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:04.370 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589928+0000", 2024-09-13T06:43:04.370 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.3329999999999999e-06 2024-09-13T06:43:04.370 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.370 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.370 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:04.371 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.669651+0000", 2024-09-13T06:43:04.371 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.079723204000000006 2024-09-13T06:43:04.371 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.371 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.371 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:04.371 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.669840+0000", 2024-09-13T06:43:04.371 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000189397 2024-09-13T06:43:04.371 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.371 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.371 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:04.371 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.670248+0000", 2024-09-13T06:43:04.371 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00040811100000000001 2024-09-13T06:43:04.371 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:04.371 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:04.371 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:04.372 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.372 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.372 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43301 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 460800~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:43:04.372 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589934+0000", 2024-09-13T06:43:04.372 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 162.76974075499999, 2024-09-13T06:43:04.372 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.080747474999999999, 2024-09-13T06:43:04.372 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:04.372 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:04.372 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:04.372 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:04.372 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:04.372 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43301 2024-09-13T06:43:04.373 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.373 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:04.373 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.373 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:04.373 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589934+0000", 2024-09-13T06:43:04.373 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:04.373 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.373 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.373 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:04.373 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589934+0000", 2024-09-13T06:43:04.373 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:04.373 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.373 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.374 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:04.374 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589933+0000", 2024-09-13T06:43:04.374 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:04.374 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.374 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.374 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:04.374 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589936+0000", 2024-09-13T06:43:04.374 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.4599999999999999e-06 2024-09-13T06:43:04.374 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.374 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.374 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:04.374 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589945+0000", 2024-09-13T06:43:04.375 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.2430000000000005e-06 2024-09-13T06:43:04.375 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.375 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.375 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:04.375 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589952+0000", 2024-09-13T06:43:04.375 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.3289999999999996e-06 2024-09-13T06:43:04.375 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.375 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.375 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:04.375 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.670280+0000", 2024-09-13T06:43:04.375 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.080328514000000004 2024-09-13T06:43:04.375 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.375 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.376 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:04.376 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.670376+0000", 2024-09-13T06:43:04.376 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.5752000000000001e-05 2024-09-13T06:43:04.376 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.376 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.376 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:04.376 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.670681+0000", 2024-09-13T06:43:04.376 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00030479699999999999 2024-09-13T06:43:04.376 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:04.376 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:04.376 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:04.376 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.377 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.377 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43302 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 475136~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:43:04.377 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589958+0000", 2024-09-13T06:43:04.377 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 162.76971669299999, 2024-09-13T06:43:04.377 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.081402394000000003, 2024-09-13T06:43:04.377 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:04.377 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:04.377 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:04.377 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:04.377 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:04.377 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43302 2024-09-13T06:43:04.377 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.378 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:04.378 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.378 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:04.378 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589958+0000", 2024-09-13T06:43:04.378 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:04.378 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.378 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.378 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:04.378 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589958+0000", 2024-09-13T06:43:04.378 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:04.378 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.378 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.379 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:04.379 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589957+0000", 2024-09-13T06:43:04.379 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:04.379 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.379 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.379 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:04.379 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589960+0000", 2024-09-13T06:43:04.379 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.4939999999999999e-06 2024-09-13T06:43:04.379 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.379 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.379 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:04.379 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589969+0000", 2024-09-13T06:43:04.379 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.3520000000000007e-06 2024-09-13T06:43:04.379 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.380 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.380 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:04.380 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589976+0000", 2024-09-13T06:43:04.380 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.3030000000000002e-06 2024-09-13T06:43:04.380 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.380 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.380 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:04.380 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.670765+0000", 2024-09-13T06:43:04.380 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.080789154000000002 2024-09-13T06:43:04.380 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.380 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.380 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:04.381 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.670960+0000", 2024-09-13T06:43:04.381 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00019464300000000001 2024-09-13T06:43:04.381 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.381 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.381 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:04.381 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.671360+0000", 2024-09-13T06:43:04.381 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00040005200000000002 2024-09-13T06:43:04.381 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:04.381 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:04.381 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:04.381 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.381 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.382 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43303 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 489472~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:43:04.382 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589985+0000", 2024-09-13T06:43:04.382 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 162.76968974499999, 2024-09-13T06:43:04.382 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.082024333000000005, 2024-09-13T06:43:04.382 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:04.382 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:04.382 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:04.382 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:04.382 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:04.382 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43303 2024-09-13T06:43:04.382 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.382 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:04.383 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.383 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:04.383 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589985+0000", 2024-09-13T06:43:04.383 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:04.383 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.383 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.383 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:04.383 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589985+0000", 2024-09-13T06:43:04.383 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:04.383 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.383 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.383 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:04.383 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589984+0000", 2024-09-13T06:43:04.384 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:43:04.384 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.384 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.384 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:04.384 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589987+0000", 2024-09-13T06:43:04.384 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.726e-06 2024-09-13T06:43:04.384 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.384 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.384 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:04.384 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589996+0000", 2024-09-13T06:43:04.384 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.5459999999999992e-06 2024-09-13T06:43:04.384 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.384 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.385 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:04.385 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590003+0000", 2024-09-13T06:43:04.385 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.4229999999999999e-06 2024-09-13T06:43:04.385 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.385 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.385 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:04.385 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.671426+0000", 2024-09-13T06:43:04.385 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.081422704999999998 2024-09-13T06:43:04.385 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.385 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.385 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:04.385 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.671615+0000", 2024-09-13T06:43:04.386 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000188875 2024-09-13T06:43:04.386 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.386 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.386 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:04.386 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.672009+0000", 2024-09-13T06:43:04.386 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000394015 2024-09-13T06:43:04.386 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:04.386 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:04.386 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:04.386 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.386 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.386 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43304 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 503808~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:43:04.386 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.590039+0000", 2024-09-13T06:43:04.386 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 162.76963520000001, 2024-09-13T06:43:04.386 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.082573880000000002, 2024-09-13T06:43:04.387 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:04.387 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:04.387 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:04.387 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:04.387 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:04.387 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43304 2024-09-13T06:43:04.387 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.387 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:04.387 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.387 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:04.387 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590039+0000", 2024-09-13T06:43:04.387 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:04.387 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.387 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.388 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:04.388 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590039+0000", 2024-09-13T06:43:04.388 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:04.388 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.388 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.388 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:04.388 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590038+0000", 2024-09-13T06:43:04.388 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:43:04.388 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.388 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.388 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:04.388 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590042+0000", 2024-09-13T06:43:04.388 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.9500000000000003e-06 2024-09-13T06:43:04.388 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.389 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.389 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:04.389 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590052+0000", 2024-09-13T06:43:04.389 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.3919999999999992e-06 2024-09-13T06:43:04.389 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.389 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.389 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:04.389 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590059+0000", 2024-09-13T06:43:04.389 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.7970000000000001e-06 2024-09-13T06:43:04.389 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.389 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.389 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:04.389 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.672078+0000", 2024-09-13T06:43:04.389 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.082018778000000001 2024-09-13T06:43:04.390 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.390 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.390 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:04.390 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.672266+0000", 2024-09-13T06:43:04.390 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00018807399999999999 2024-09-13T06:43:04.390 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.390 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.390 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:04.390 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.672613+0000", 2024-09-13T06:43:04.390 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00034677599999999997 2024-09-13T06:43:04.390 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:04.390 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:04.390 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:04.390 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.390 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.391 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43305 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 518144~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:43:04.391 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.590136+0000", 2024-09-13T06:43:04.391 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 162.769538012, 2024-09-13T06:43:04.391 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.082988206999999994, 2024-09-13T06:43:04.391 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:04.391 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:04.391 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:04.391 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:04.391 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:04.391 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43305 2024-09-13T06:43:04.391 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.391 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:04.391 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.392 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:04.392 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590136+0000", 2024-09-13T06:43:04.392 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:04.392 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.392 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.392 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:04.392 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590136+0000", 2024-09-13T06:43:04.392 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:04.392 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.392 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.392 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:04.392 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590135+0000", 2024-09-13T06:43:04.392 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:43:04.392 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.393 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.393 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:04.393 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590139+0000", 2024-09-13T06:43:04.393 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.9489999999999998e-06 2024-09-13T06:43:04.393 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.393 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.393 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:04.393 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590148+0000", 2024-09-13T06:43:04.393 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.9830000000000002e-06 2024-09-13T06:43:04.393 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.393 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.393 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:04.393 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590156+0000", 2024-09-13T06:43:04.393 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5229999999999998e-06 2024-09-13T06:43:04.394 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.394 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.394 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:04.394 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.672709+0000", 2024-09-13T06:43:04.394 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.082552886000000006 2024-09-13T06:43:04.394 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.394 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.394 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:04.394 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.672816+0000", 2024-09-13T06:43:04.394 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000107736 2024-09-13T06:43:04.394 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.394 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.394 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:04.394 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.673124+0000", 2024-09-13T06:43:04.394 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00030804900000000002 2024-09-13T06:43:04.395 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:04.395 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:04.395 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:04.395 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.395 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.395 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:66818 3.17 3.50afe697 (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e100)", 2024-09-13T06:43:04.395 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:53.498942+0000", 2024-09-13T06:43:04.395 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 130.860731827, 2024-09-13T06:43:04.395 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.011231284, 2024-09-13T06:43:04.395 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:04.395 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:43:04.395 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:04.395 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:04.395 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:04.396 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 66818 2024-09-13T06:43:04.396 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.396 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:04.396 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.396 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:04.396 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:53.498942+0000", 2024-09-13T06:43:04.396 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:04.396 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.396 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.396 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:04.396 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:53.498942+0000", 2024-09-13T06:43:04.396 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:04.396 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.396 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.397 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:04.397 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:53.498939+0000", 2024-09-13T06:43:04.397 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999967 2024-09-13T06:43:04.397 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.397 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.397 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:04.397 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:53.498954+0000", 2024-09-13T06:43:04.397 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5028000000000001e-05 2024-09-13T06:43:04.397 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.397 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.397 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:04.397 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:53.498986+0000", 2024-09-13T06:43:04.397 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.1993999999999999e-05 2024-09-13T06:43:04.398 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.398 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.398 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:04.398 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:53.499001+0000", 2024-09-13T06:43:04.398 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5166e-05 2024-09-13T06:43:04.398 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.398 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.398 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:04.398 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:53.505097+0000", 2024-09-13T06:43:04.398 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0060955610000000002 2024-09-13T06:43:04.398 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.398 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.399 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:43:04.399 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:53.505108+0000", 2024-09-13T06:43:04.399 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.084e-05 2024-09-13T06:43:04.399 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.399 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.399 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:04.399 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:54.510158+0000", 2024-09-13T06:43:04.399 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0050497549999999 2024-09-13T06:43:04.399 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.399 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.399 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:04.399 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:54.510174+0000", 2024-09-13T06:43:04.399 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6164e-05 2024-09-13T06:43:04.400 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:04.400 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:04.400 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:04.400 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.400 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.400 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:69764 3.2 3:47f10058:::rbd_data.11214956a993.0000000000000004:head [write-same] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e117)", 2024-09-13T06:43:04.400 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:41:11.371147+0000", 2024-09-13T06:43:04.400 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 112.98852751699999, 2024-09-13T06:43:04.400 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.03470167, 2024-09-13T06:43:04.400 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:04.400 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:43:04.400 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:04.400 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:04.401 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:04.401 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 69764 2024-09-13T06:43:04.401 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.401 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:04.401 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.401 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:04.401 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:11.371147+0000", 2024-09-13T06:43:04.401 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:04.401 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.401 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.401 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:04.401 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:11.371147+0000", 2024-09-13T06:43:04.401 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:04.402 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.402 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.402 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:04.402 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:11.371144+0000", 2024-09-13T06:43:04.402 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999967 2024-09-13T06:43:04.402 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.402 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.402 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:04.402 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:11.371161+0000", 2024-09-13T06:43:04.402 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7669e-05 2024-09-13T06:43:04.402 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.402 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.402 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:04.402 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:11.371198+0000", 2024-09-13T06:43:04.403 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.7014000000000002e-05 2024-09-13T06:43:04.403 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.403 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.403 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:04.403 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:11.371216+0000", 2024-09-13T06:43:04.403 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7425e-05 2024-09-13T06:43:04.403 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.403 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.403 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:04.403 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:11.371365+0000", 2024-09-13T06:43:04.403 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000149245 2024-09-13T06:43:04.403 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.403 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.403 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op must wait for map", 2024-09-13T06:43:04.403 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:11.371385+0000", 2024-09-13T06:43:04.403 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.0018999999999999e-05 2024-09-13T06:43:04.404 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.404 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.404 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:04.404 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:11.378406+0000", 2024-09-13T06:43:04.404 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0070207179999999996 2024-09-13T06:43:04.404 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.404 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.404 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:43:04.404 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:11.378429+0000", 2024-09-13T06:43:04.404 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.3453999999999999e-05 2024-09-13T06:43:04.404 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.404 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.404 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:04.404 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:12.405667+0000", 2024-09-13T06:43:04.405 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0272381690000001 2024-09-13T06:43:04.405 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.405 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.405 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:04.405 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:12.405848+0000", 2024-09-13T06:43:04.405 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00018112 2024-09-13T06:43:04.405 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:04.405 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:04.405 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:04.405 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.405 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.405 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:70346 3.16 3:69d35907:::rbd_object_map.11214956a993:head [read 0~36] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e122)", 2024-09-13T06:43:04.405 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:41:16.390917+0000", 2024-09-13T06:43:04.405 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 107.968757465, 2024-09-13T06:43:04.405 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.99327479799999996, 2024-09-13T06:43:04.406 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:04.406 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:04.406 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:04.406 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:04.406 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:04.406 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 70346 2024-09-13T06:43:04.406 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.406 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:04.406 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.406 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:04.406 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:16.390917+0000", 2024-09-13T06:43:04.406 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:04.406 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.406 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.406 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:04.407 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:16.390917+0000", 2024-09-13T06:43:04.407 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:04.407 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.407 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.407 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:04.407 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:16.390916+0000", 2024-09-13T06:43:04.407 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999986 2024-09-13T06:43:04.407 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.407 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.407 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:04.407 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:16.390922+0000", 2024-09-13T06:43:04.407 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.0480000000000004e-06 2024-09-13T06:43:04.407 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.407 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.407 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:04.408 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:16.390933+0000", 2024-09-13T06:43:04.408 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1387e-05 2024-09-13T06:43:04.408 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.408 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.408 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:04.408 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:16.390939+0000", 2024-09-13T06:43:04.408 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.8039999999999998e-06 2024-09-13T06:43:04.408 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.408 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.408 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:04.408 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:16.390983+0000", 2024-09-13T06:43:04.408 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.4663000000000003e-05 2024-09-13T06:43:04.408 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.409 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.409 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:43:04.409 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:16.390991+0000", 2024-09-13T06:43:04.409 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.8059999999999995e-06 2024-09-13T06:43:04.409 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.409 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.409 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:04.412 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:17.383624+0000", 2024-09-13T06:43:04.413 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.99263277299999997 2024-09-13T06:43:04.413 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.413 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.413 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:04.413 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:17.383891+0000", 2024-09-13T06:43:04.413 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00026717599999999999 2024-09-13T06:43:04.413 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.413 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.413 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:04.413 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:17.384192+0000", 2024-09-13T06:43:04.413 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00030047400000000001 2024-09-13T06:43:04.413 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:04.414 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:04.414 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:04.414 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.414 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.414 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:181624 3.1d 3:be5d0ef9:::rbd_data.11218aab7a9c.0000000000000000:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e203)", 2024-09-13T06:43:04.414 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:42:45.701744+0000", 2024-09-13T06:43:04.414 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 18.657930544999999, 2024-09-13T06:43:04.414 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.69964504800000005, 2024-09-13T06:43:04.414 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:04.414 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:04.414 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:04.414 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:04.414 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:04.415 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 181624 2024-09-13T06:43:04.415 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.415 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:04.415 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.415 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:04.415 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.701744+0000", 2024-09-13T06:43:04.415 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:04.415 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.415 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.415 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:04.415 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.701744+0000", 2024-09-13T06:43:04.415 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:04.415 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.415 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.416 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:04.416 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.701741+0000", 2024-09-13T06:43:04.416 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999976 2024-09-13T06:43:04.416 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.416 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.416 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:04.416 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.701754+0000", 2024-09-13T06:43:04.416 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2632999999999999e-05 2024-09-13T06:43:04.416 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.416 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.416 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:04.416 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.701789+0000", 2024-09-13T06:43:04.416 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.4993999999999997e-05 2024-09-13T06:43:04.417 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.417 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.417 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:04.417 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.701806+0000", 2024-09-13T06:43:04.417 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7016000000000001e-05 2024-09-13T06:43:04.417 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.417 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.417 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:04.417 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.701905+0000", 2024-09-13T06:43:04.417 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.8895999999999996e-05 2024-09-13T06:43:04.417 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.417 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.417 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:43:04.417 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.701920+0000", 2024-09-13T06:43:04.418 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5013e-05 2024-09-13T06:43:04.418 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.418 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.418 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:04.418 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.400672+0000", 2024-09-13T06:43:04.418 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.69875254499999995 2024-09-13T06:43:04.418 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.418 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.418 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:04.418 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.401034+0000", 2024-09-13T06:43:04.418 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00036181700000000001 2024-09-13T06:43:04.418 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.418 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.418 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:04.418 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.401389+0000", 2024-09-13T06:43:04.419 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00035464399999999999 2024-09-13T06:43:04.419 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:04.419 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:04.419 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:04.419 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.419 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.419 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:181638 3.1d 3:be5d0ef9:::rbd_data.11218aab7a9c.0000000000000000:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e203)", 2024-09-13T06:43:04.419 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:42:45.707356+0000", 2024-09-13T06:43:04.419 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 18.652317805999999, 2024-09-13T06:43:04.419 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.694720479, 2024-09-13T06:43:04.419 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:04.419 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:04.419 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:04.419 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:04.419 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:04.420 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 181638 2024-09-13T06:43:04.420 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.420 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:04.420 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.420 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:04.420 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707356+0000", 2024-09-13T06:43:04.420 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:04.420 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.420 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.420 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:04.420 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707356+0000", 2024-09-13T06:43:04.420 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:04.420 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.420 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.420 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:04.421 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707355+0000", 2024-09-13T06:43:04.421 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999981 2024-09-13T06:43:04.421 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.421 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.421 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:04.421 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707375+0000", 2024-09-13T06:43:04.421 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.0698000000000001e-05 2024-09-13T06:43:04.421 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.421 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.421 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:04.421 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707396+0000", 2024-09-13T06:43:04.421 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.1041000000000001e-05 2024-09-13T06:43:04.421 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.422 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.422 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:04.422 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707408+0000", 2024-09-13T06:43:04.422 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1583000000000001e-05 2024-09-13T06:43:04.422 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.422 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.422 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:04.422 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707513+0000", 2024-09-13T06:43:04.422 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000104981 2024-09-13T06:43:04.422 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.422 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.422 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:43:04.422 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707541+0000", 2024-09-13T06:43:04.423 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.8572999999999999e-05 2024-09-13T06:43:04.423 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.423 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.423 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:04.423 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.401666+0000", 2024-09-13T06:43:04.423 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.694124988 2024-09-13T06:43:04.423 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.423 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.423 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:04.423 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.401880+0000", 2024-09-13T06:43:04.423 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00021322100000000001 2024-09-13T06:43:04.423 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.424 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.424 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:04.424 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.402077+0000", 2024-09-13T06:43:04.424 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000197321 2024-09-13T06:43:04.424 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:04.424 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:04.424 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:04.424 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.424 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.424 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:181652 3.1d 3:be5d0ef9:::rbd_data.11218aab7a9c.0000000000000000:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e203)", 2024-09-13T06:43:04.424 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:42:45.707423+0000", 2024-09-13T06:43:04.424 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 18.652251275000001, 2024-09-13T06:43:04.424 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.69480806699999997, 2024-09-13T06:43:04.425 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:04.425 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:04.425 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:04.425 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:04.425 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:04.425 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 181652 2024-09-13T06:43:04.425 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.425 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:04.425 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.425 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:04.425 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707423+0000", 2024-09-13T06:43:04.425 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:04.425 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.426 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.426 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:04.426 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707423+0000", 2024-09-13T06:43:04.426 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:04.426 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.426 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.426 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:04.426 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707423+0000", 2024-09-13T06:43:04.426 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:04.426 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.426 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.426 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:04.426 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707427+0000", 2024-09-13T06:43:04.427 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.2010000000000001e-06 2024-09-13T06:43:04.427 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.427 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.427 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:04.427 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707442+0000", 2024-09-13T06:43:04.427 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.4993e-05 2024-09-13T06:43:04.427 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.427 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.427 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:04.427 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707447+0000", 2024-09-13T06:43:04.427 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.2170000000000002e-06 2024-09-13T06:43:04.427 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.427 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.428 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:04.428 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707656+0000", 2024-09-13T06:43:04.428 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00020908600000000001 2024-09-13T06:43:04.428 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.428 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.428 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:43:04.428 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707684+0000", 2024-09-13T06:43:04.428 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.7766000000000001e-05 2024-09-13T06:43:04.428 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.428 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.428 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:04.428 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.402101+0000", 2024-09-13T06:43:04.428 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.69441698100000004 2024-09-13T06:43:04.428 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.429 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.429 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:04.429 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.402156+0000", 2024-09-13T06:43:04.429 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.4725000000000002e-05 2024-09-13T06:43:04.429 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.429 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.429 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:04.429 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.402231+0000", 2024-09-13T06:43:04.429 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5587999999999995e-05 2024-09-13T06:43:04.429 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:04.429 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:04.429 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:04.430 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.430 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.430 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:181666 3.1d 3:be5d0ef9:::rbd_data.11218aab7a9c.0000000000000000:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e203)", 2024-09-13T06:43:04.430 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:42:45.707478+0000", 2024-09-13T06:43:04.430 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 18.652196089, 2024-09-13T06:43:04.430 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.69543359900000001, 2024-09-13T06:43:04.430 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:04.430 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:04.430 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:04.430 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:04.430 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:04.430 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 181666 2024-09-13T06:43:04.430 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.431 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:04.431 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.431 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:04.431 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707478+0000", 2024-09-13T06:43:04.431 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:04.431 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.431 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.431 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:04.431 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707478+0000", 2024-09-13T06:43:04.431 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:04.431 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.431 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.432 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:04.432 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707478+0000", 2024-09-13T06:43:04.432 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:04.432 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.432 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.432 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:04.432 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707481+0000", 2024-09-13T06:43:04.432 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.3589999999999999e-06 2024-09-13T06:43:04.432 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.432 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.432 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:04.432 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707492+0000", 2024-09-13T06:43:04.433 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0725e-05 2024-09-13T06:43:04.433 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.433 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.433 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:04.433 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707500+0000", 2024-09-13T06:43:04.433 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.1089999999999998e-06 2024-09-13T06:43:04.433 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.433 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.433 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:04.433 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707773+0000", 2024-09-13T06:43:04.433 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000273291 2024-09-13T06:43:04.433 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.433 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.434 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:43:04.434 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707784+0000", 2024-09-13T06:43:04.434 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0441999999999999e-05 2024-09-13T06:43:04.434 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.434 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.434 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:04.434 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.402290+0000", 2024-09-13T06:43:04.434 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.69450651500000005 2024-09-13T06:43:04.434 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.434 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.434 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:04.434 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.402489+0000", 2024-09-13T06:43:04.434 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000198999 2024-09-13T06:43:04.435 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.435 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.435 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:04.435 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.402912+0000", 2024-09-13T06:43:04.435 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00042257299999999998 2024-09-13T06:43:04.435 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:04.435 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:04.435 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:04.435 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.435 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.435 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:181680 3.1d 3:be5d0ef9:::rbd_data.11218aab7a9c.0000000000000000:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e203)", 2024-09-13T06:43:04.435 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:42:45.707517+0000", 2024-09-13T06:43:04.435 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 18.652157053, 2024-09-13T06:43:04.435 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.69532440799999995, 2024-09-13T06:43:04.436 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:04.436 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:04.436 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:04.436 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:04.436 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:04.436 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 181680 2024-09-13T06:43:04.436 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.436 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:04.436 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.436 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:04.436 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707517+0000", 2024-09-13T06:43:04.436 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:04.437 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.437 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.437 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:04.437 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707517+0000", 2024-09-13T06:43:04.437 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:04.437 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.437 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.437 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:04.437 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707517+0000", 2024-09-13T06:43:04.437 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:04.437 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.437 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.437 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:04.437 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707519+0000", 2024-09-13T06:43:04.438 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.2800000000000002e-06 2024-09-13T06:43:04.438 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.438 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.438 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:04.438 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707527+0000", 2024-09-13T06:43:04.438 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.2660000000000001e-06 2024-09-13T06:43:04.438 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.438 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.438 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:04.438 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707535+0000", 2024-09-13T06:43:04.438 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.1760000000000004e-06 2024-09-13T06:43:04.438 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.438 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.439 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:04.439 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707838+0000", 2024-09-13T06:43:04.439 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00030318000000000001 2024-09-13T06:43:04.439 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.439 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.439 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:43:04.439 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707850+0000", 2024-09-13T06:43:04.439 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1787000000000001e-05 2024-09-13T06:43:04.439 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.439 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.439 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:04.439 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.402702+0000", 2024-09-13T06:43:04.439 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.69485264599999996 2024-09-13T06:43:04.440 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.440 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.440 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:04.440 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.402783+0000", 2024-09-13T06:43:04.440 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.1114999999999998e-05 2024-09-13T06:43:04.440 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.440 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.440 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:04.440 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.402842+0000", 2024-09-13T06:43:04.440 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.8322999999999997e-05 2024-09-13T06:43:04.440 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:04.440 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:04.440 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:04.440 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.441 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.441 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:181694 3.1d 3:be5d0ef9:::rbd_data.11218aab7a9c.0000000000000000:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e203)", 2024-09-13T06:43:04.441 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:42:45.707544+0000", 2024-09-13T06:43:04.441 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 18.652130361000001, 2024-09-13T06:43:04.441 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.69580726699999995, 2024-09-13T06:43:04.441 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:04.441 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:04.441 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:04.441 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:04.441 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:04.441 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 181694 2024-09-13T06:43:04.441 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.441 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:04.442 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.442 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:04.442 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707544+0000", 2024-09-13T06:43:04.442 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:04.442 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.442 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.442 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:04.442 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707544+0000", 2024-09-13T06:43:04.442 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:04.442 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.442 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.442 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:04.442 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707543+0000", 2024-09-13T06:43:04.442 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:04.443 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.443 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.443 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:04.443 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707561+0000", 2024-09-13T06:43:04.443 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7804000000000001e-05 2024-09-13T06:43:04.443 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.443 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.443 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:04.443 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707575+0000", 2024-09-13T06:43:04.443 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3884e-05 2024-09-13T06:43:04.443 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.443 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.443 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:04.444 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707583+0000", 2024-09-13T06:43:04.444 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5730000000000002e-06 2024-09-13T06:43:04.444 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.444 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.444 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:04.444 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707899+0000", 2024-09-13T06:43:04.444 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00031663999999999998 2024-09-13T06:43:04.444 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.444 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.444 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:43:04.444 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707908+0000", 2024-09-13T06:43:04.444 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.1430000000000004e-06 2024-09-13T06:43:04.444 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.445 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.445 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:04.445 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.402973+0000", 2024-09-13T06:43:04.445 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.69506426099999996 2024-09-13T06:43:04.445 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.445 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.445 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:04.445 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.403155+0000", 2024-09-13T06:43:04.445 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00018245199999999999 2024-09-13T06:43:04.445 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.445 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.445 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:04.445 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.403351+0000", 2024-09-13T06:43:04.445 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000196028 2024-09-13T06:43:04.446 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:04.446 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:04.446 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:04.446 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.446 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.446 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:181708 3.1d 3:be5d0ef9:::rbd_data.11218aab7a9c.0000000000000000:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e203)", 2024-09-13T06:43:04.446 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:42:45.707622+0000", 2024-09-13T06:43:04.446 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 18.652052316999999, 2024-09-13T06:43:04.446 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.69603707699999995, 2024-09-13T06:43:04.446 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:04.446 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:04.446 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:04.446 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:04.447 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:04.447 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 181708 2024-09-13T06:43:04.447 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.447 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:04.447 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.447 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:04.447 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707622+0000", 2024-09-13T06:43:04.447 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:04.447 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.447 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.447 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:04.447 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707622+0000", 2024-09-13T06:43:04.447 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:04.447 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.448 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.448 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:04.448 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707621+0000", 2024-09-13T06:43:04.448 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:04.448 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.448 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.448 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:04.448 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707624+0000", 2024-09-13T06:43:04.448 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.8210000000000002e-06 2024-09-13T06:43:04.448 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.448 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.448 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:04.448 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707631+0000", 2024-09-13T06:43:04.449 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.8460000000000002e-06 2024-09-13T06:43:04.449 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.449 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.449 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:04.449 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707635+0000", 2024-09-13T06:43:04.449 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.4610000000000001e-06 2024-09-13T06:43:04.449 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.449 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.449 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:04.449 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707955+0000", 2024-09-13T06:43:04.449 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00031982000000000001 2024-09-13T06:43:04.449 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.449 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.449 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:43:04.449 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707966+0000", 2024-09-13T06:43:04.450 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0822000000000001e-05 2024-09-13T06:43:04.450 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.450 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.450 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:04.450 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.403541+0000", 2024-09-13T06:43:04.450 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.69557444300000004 2024-09-13T06:43:04.450 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.450 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.450 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:04.450 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.403598+0000", 2024-09-13T06:43:04.450 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.7147e-05 2024-09-13T06:43:04.450 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.450 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.450 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:04.451 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.403659+0000", 2024-09-13T06:43:04.451 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.1373999999999999e-05 2024-09-13T06:43:04.451 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:04.451 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:04.451 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:04.451 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.451 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.451 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:181722 3.1d 3:be5d0ef9:::rbd_data.11218aab7a9c.0000000000000000:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e203)", 2024-09-13T06:43:04.451 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:42:45.707640+0000", 2024-09-13T06:43:04.451 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 18.652033866, 2024-09-13T06:43:04.451 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.69620305800000004, 2024-09-13T06:43:04.451 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:04.452 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:04.452 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:04.452 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:04.452 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:04.452 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 181722 2024-09-13T06:43:04.452 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.452 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:04.452 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.452 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:04.452 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707640+0000", 2024-09-13T06:43:04.452 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:04.452 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.452 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.453 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:04.453 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707640+0000", 2024-09-13T06:43:04.453 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:04.453 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.453 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.453 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:04.453 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707640+0000", 2024-09-13T06:43:04.453 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:04.453 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.453 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.453 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:04.453 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707643+0000", 2024-09-13T06:43:04.454 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.213e-06 2024-09-13T06:43:04.454 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.454 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.454 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:04.454 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707651+0000", 2024-09-13T06:43:04.454 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.2290000000000003e-06 2024-09-13T06:43:04.454 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.454 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.454 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:04.454 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707656+0000", 2024-09-13T06:43:04.454 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.9320000000000004e-06 2024-09-13T06:43:04.454 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.454 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.454 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:04.455 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.708012+0000", 2024-09-13T06:43:04.455 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00035600600000000002 2024-09-13T06:43:04.455 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.455 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.455 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:43:04.455 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.708024+0000", 2024-09-13T06:43:04.455 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1336e-05 2024-09-13T06:43:04.455 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.455 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.455 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:04.455 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.403696+0000", 2024-09-13T06:43:04.455 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.69567234499999997 2024-09-13T06:43:04.455 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.455 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.455 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:04.455 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.403757+0000", 2024-09-13T06:43:04.456 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.0715999999999999e-05 2024-09-13T06:43:04.456 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.456 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.456 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:04.456 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.403843+0000", 2024-09-13T06:43:04.456 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6679000000000001e-05 2024-09-13T06:43:04.456 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:04.456 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:04.456 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:04.456 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.456 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.456 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:181736 3.1d 3:be5d0ef9:::rbd_data.11218aab7a9c.0000000000000000:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e203)", 2024-09-13T06:43:04.457 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:42:45.707661+0000", 2024-09-13T06:43:04.457 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 18.652013498999999, 2024-09-13T06:43:04.457 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.69667210700000004, 2024-09-13T06:43:04.457 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:04.457 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:04.457 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:04.457 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:04.457 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:04.457 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 181736 2024-09-13T06:43:04.457 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.457 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:04.457 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.457 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:04.457 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707661+0000", 2024-09-13T06:43:04.458 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:04.458 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.458 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.458 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:04.458 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707661+0000", 2024-09-13T06:43:04.458 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:04.458 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.458 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.458 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:04.458 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707660+0000", 2024-09-13T06:43:04.458 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:04.458 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.458 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.458 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:04.458 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707664+0000", 2024-09-13T06:43:04.459 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.393e-06 2024-09-13T06:43:04.459 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.459 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.459 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:04.459 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707673+0000", 2024-09-13T06:43:04.459 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.5100000000000004e-06 2024-09-13T06:43:04.459 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.459 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.459 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:04.459 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707680+0000", 2024-09-13T06:43:04.459 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.8680000000000001e-06 2024-09-13T06:43:04.459 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.459 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.459 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:04.459 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.708068+0000", 2024-09-13T06:43:04.460 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00038784699999999997 2024-09-13T06:43:04.460 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.460 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.460 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:43:04.460 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.708078+0000", 2024-09-13T06:43:04.460 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.842e-06 2024-09-13T06:43:04.460 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.460 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.460 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:04.460 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.403924+0000", 2024-09-13T06:43:04.460 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.69584657699999997 2024-09-13T06:43:04.460 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.460 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.460 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:04.460 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.404135+0000", 2024-09-13T06:43:04.461 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000210662 2024-09-13T06:43:04.461 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.461 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.461 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:04.461 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.404333+0000", 2024-09-13T06:43:04.461 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00019787900000000001 2024-09-13T06:43:04.461 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:04.461 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:04.461 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:04.461 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.461 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.461 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:181750 3.1d 3.9f70ba7d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e203)", 2024-09-13T06:43:04.461 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:42:45.707687+0000", 2024-09-13T06:43:04.461 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 18.651987636000001, 2024-09-13T06:43:04.461 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.69667232199999996, 2024-09-13T06:43:04.462 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:04.462 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:43:04.462 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:04.462 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:04.462 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:04.462 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 181750 2024-09-13T06:43:04.462 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.462 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:04.462 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.462 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:04.462 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707687+0000", 2024-09-13T06:43:04.462 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:04.462 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.462 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.462 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:04.463 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707687+0000", 2024-09-13T06:43:04.463 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:04.463 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.463 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.463 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:04.463 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707686+0000", 2024-09-13T06:43:04.463 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:04.463 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.464 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.464 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:04.464 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707689+0000", 2024-09-13T06:43:04.464 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.824e-06 2024-09-13T06:43:04.464 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.464 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.464 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:04.464 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707693+0000", 2024-09-13T06:43:04.464 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.5900000000000001e-06 2024-09-13T06:43:04.464 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.464 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.464 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:04.465 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707697+0000", 2024-09-13T06:43:04.465 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.6899999999999998e-06 2024-09-13T06:43:04.465 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.465 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.465 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:04.465 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.708109+0000", 2024-09-13T06:43:04.465 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00041220200000000002 2024-09-13T06:43:04.465 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.465 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.465 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:43:04.465 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.708118+0000", 2024-09-13T06:43:04.465 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6000000000000007e-06 2024-09-13T06:43:04.465 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.465 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.466 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:04.466 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.404353+0000", 2024-09-13T06:43:04.466 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.69623486400000001 2024-09-13T06:43:04.466 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.466 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.466 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:04.466 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.404359+0000", 2024-09-13T06:43:04.466 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.2480000000000001e-06 2024-09-13T06:43:04.466 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:04.466 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:04.466 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:04.466 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:04.467 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:04.467 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:43:04.467 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-13T06:43:04.468 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:43:04.468+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:43:04.469 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-13T06:43:04.555 INFO:teuthology.orchestra.run.smithi081.stdout:moved 0 / 82 (0%) 2024-09-13T06:43:04.555 INFO:teuthology.orchestra.run.smithi081.stdout:avg 11.7143 2024-09-13T06:43:04.556 INFO:teuthology.orchestra.run.smithi081.stdout:stddev 2.24972 -> 2.24972 (expected baseline 3.16872) 2024-09-13T06:43:04.556 INFO:teuthology.orchestra.run.smithi081.stdout:min osd.2 with 8 -> 8 pgs (0.682927 -> 0.682927 * mean) 2024-09-13T06:43:04.556 INFO:teuthology.orchestra.run.smithi081.stdout:max osd.7 with 15 -> 15 pgs (1.28049 -> 1.28049 * mean) 2024-09-13T06:43:04.556 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T06:43:04.556 INFO:teuthology.orchestra.run.smithi081.stdout:oload 1000 2024-09-13T06:43:04.556 INFO:teuthology.orchestra.run.smithi081.stdout:max_change 0.05 2024-09-13T06:43:04.556 INFO:teuthology.orchestra.run.smithi081.stdout:max_change_osds 4 2024-09-13T06:43:04.556 INFO:teuthology.orchestra.run.smithi081.stdout:average_utilization 0.0017 2024-09-13T06:43:04.556 INFO:teuthology.orchestra.run.smithi081.stdout:overload_utilization 0.0169 2024-09-13T06:43:04.557 INFO:teuthology.orchestra.run.smithi081.stderr:no change 2024-09-13T06:43:04.569 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:43:04.568+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:43:04.578 INFO:tasks.thrashosds.thrasher:Reweighting by: {'max_change': '0.05', 'overage': '110', 'type': 'test-reweight-by-utilization'} 2024-09-13T06:43:04.578 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd test-reweight-by-utilization 110 0.05 2024-09-13T06:43:04.596 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:43:04.596 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [], 2024-09-13T06:43:04.596 INFO:teuthology.orchestra.run.smithi139.stdout: "num_ops": 0 2024-09-13T06:43:04.597 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:43:04.611 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-13T06:43:04.669 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-13T06:43:04.669+0000 7fa8bb18e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 36790) UID: 0 2024-09-13T06:43:04.733 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:43:04.734 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [], 2024-09-13T06:43:04.734 INFO:teuthology.orchestra.run.smithi139.stdout: "complaint_time": 30, 2024-09-13T06:43:04.734 INFO:teuthology.orchestra.run.smithi139.stdout: "num_blocked_ops": 0 2024-09-13T06:43:04.734 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:43:04.748 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-13T06:43:04.792 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-13T06:43:04.793+0000 7fa8bb18e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 36790) UID: 0 2024-09-13T06:43:04.871 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:43:04.872+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:43:04.920 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:43:04.920 INFO:teuthology.orchestra.run.smithi139.stdout: "size": 20, 2024-09-13T06:43:04.921 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 600, 2024-09-13T06:43:04.921 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [ 2024-09-13T06:43:04.921 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.921 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:175091 3.d 3:b6bd869c:::rbd_data.11213163dd15.000000000000003c:head [set-alloc-hint object_size 1048576 write_size 1048576,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e194)", 2024-09-13T06:43:04.921 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:42:35.318373+0000", 2024-09-13T06:43:04.921 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 29.599674876999998, 2024-09-13T06:43:04.921 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.022941579, 2024-09-13T06:43:04.921 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:04.921 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:43:04.921 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:04.921 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:04.921 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:04.922 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 175091 2024-09-13T06:43:04.922 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.922 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:04.922 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.922 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:04.922 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:35.318373+0000", 2024-09-13T06:43:04.922 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:04.922 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.922 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.922 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:04.922 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:35.318373+0000", 2024-09-13T06:43:04.922 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:04.922 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.923 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.923 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:04.923 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:35.318372+0000", 2024-09-13T06:43:04.923 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999986 2024-09-13T06:43:04.923 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.923 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.923 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:04.923 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:35.318381+0000", 2024-09-13T06:43:04.923 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.5000000000000005e-06 2024-09-13T06:43:04.923 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.923 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.923 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:04.924 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:35.318403+0000", 2024-09-13T06:43:04.924 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.196e-05 2024-09-13T06:43:04.924 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.924 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.924 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:04.924 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:35.318416+0000", 2024-09-13T06:43:04.924 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2962999999999999e-05 2024-09-13T06:43:04.924 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.924 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.924 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:04.924 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:35.318543+0000", 2024-09-13T06:43:04.924 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000126742 2024-09-13T06:43:04.925 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.925 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.925 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:04.925 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:35.318775+0000", 2024-09-13T06:43:04.925 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000232628 2024-09-13T06:43:04.925 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.925 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.925 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 5", 2024-09-13T06:43:04.925 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:35.322627+0000", 2024-09-13T06:43:04.925 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0038514410000000002 2024-09-13T06:43:04.925 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.926 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.926 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:43:04.926 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:35.341133+0000", 2024-09-13T06:43:04.926 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.018506383000000001 2024-09-13T06:43:04.926 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.926 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.926 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-13T06:43:04.926 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:35.341156+0000", 2024-09-13T06:43:04.926 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.3187e-05 2024-09-13T06:43:04.926 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.926 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.926 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-13T06:43:04.926 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:35.341244+0000", 2024-09-13T06:43:04.927 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.7885000000000003e-05 2024-09-13T06:43:04.927 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.927 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.927 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:04.927 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:35.341315+0000", 2024-09-13T06:43:04.927 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.0523000000000002e-05 2024-09-13T06:43:04.927 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:04.927 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:04.927 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:04.927 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.927 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.927 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:176046 3.13 3:cc7583b3:::rbd_data.11213163dd15.000000000000001d:70 [sparse-read 950272~98304 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e196)", 2024-09-13T06:43:04.928 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:42:36.674880+0000", 2024-09-13T06:43:04.928 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 28.243168150999999, 2024-09-13T06:43:04.928 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.015397575, 2024-09-13T06:43:04.928 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:04.928 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:04.928 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:04.928 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:04.928 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:04.928 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 176046 2024-09-13T06:43:04.928 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.928 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:04.928 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.929 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:04.929 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.674880+0000", 2024-09-13T06:43:04.929 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:04.929 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.929 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.929 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:04.929 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.674880+0000", 2024-09-13T06:43:04.929 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:04.929 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.929 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.929 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:04.929 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.674880+0000", 2024-09-13T06:43:04.930 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:04.930 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.930 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.930 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:04.930 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.674882+0000", 2024-09-13T06:43:04.930 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.7819999999999998e-06 2024-09-13T06:43:04.930 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.930 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.930 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:04.930 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.674890+0000", 2024-09-13T06:43:04.930 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.0260000000000007e-06 2024-09-13T06:43:04.930 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.930 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.931 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:04.931 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.674897+0000", 2024-09-13T06:43:04.931 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.3659999999999997e-06 2024-09-13T06:43:04.931 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.931 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.931 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:04.931 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.689291+0000", 2024-09-13T06:43:04.931 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.014394432 2024-09-13T06:43:04.931 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.931 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.931 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:04.931 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.689455+0000", 2024-09-13T06:43:04.931 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00016362700000000001 2024-09-13T06:43:04.932 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.932 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.932 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:04.932 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.690278+0000", 2024-09-13T06:43:04.932 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000822783 2024-09-13T06:43:04.932 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:04.932 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:04.932 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:04.932 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.932 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.932 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:176089 3.11 3:8b97f15f:::rbd_data.1121a23b99f7.0000000000000000:head [write 0~4194304 [fadvise_sequential+fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e196)", 2024-09-13T06:43:04.932 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:42:36.707298+0000", 2024-09-13T06:43:04.933 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 28.210749720999999, 2024-09-13T06:43:04.933 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.053333426000000003, 2024-09-13T06:43:04.933 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:04.933 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:43:04.933 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:04.933 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:04.933 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:04.933 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 176089 2024-09-13T06:43:04.933 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.933 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:04.933 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.933 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:04.933 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.707298+0000", 2024-09-13T06:43:04.934 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:04.934 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.934 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.934 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:04.934 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.707298+0000", 2024-09-13T06:43:04.934 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:04.934 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.934 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.934 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:04.934 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.707296+0000", 2024-09-13T06:43:04.934 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999976 2024-09-13T06:43:04.934 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.934 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.934 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:04.935 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.717511+0000", 2024-09-13T06:43:04.935 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.010215218999999999 2024-09-13T06:43:04.935 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.935 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.935 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:04.935 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.717555+0000", 2024-09-13T06:43:04.935 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.4159000000000002e-05 2024-09-13T06:43:04.935 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.935 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.935 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:04.935 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.717569+0000", 2024-09-13T06:43:04.935 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3543999999999999e-05 2024-09-13T06:43:04.935 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.936 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.936 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:04.936 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.717677+0000", 2024-09-13T06:43:04.936 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00010798699999999999 2024-09-13T06:43:04.936 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.936 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.936 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:04.936 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.717896+0000", 2024-09-13T06:43:04.936 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000219466 2024-09-13T06:43:04.936 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.936 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.936 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 4", 2024-09-13T06:43:04.936 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.718090+0000", 2024-09-13T06:43:04.937 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00019322799999999999 2024-09-13T06:43:04.937 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.937 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.937 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:43:04.937 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.751403+0000", 2024-09-13T06:43:04.937 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.033313493 2024-09-13T06:43:04.937 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.937 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.937 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-13T06:43:04.937 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.760523+0000", 2024-09-13T06:43:04.937 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0091197150000000005 2024-09-13T06:43:04.937 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.937 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.938 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-13T06:43:04.938 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.760581+0000", 2024-09-13T06:43:04.938 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.8007999999999998e-05 2024-09-13T06:43:04.938 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.938 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.938 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:04.938 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.760632+0000", 2024-09-13T06:43:04.938 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.1085999999999998e-05 2024-09-13T06:43:04.938 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:04.938 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:04.938 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:04.938 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.938 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.939 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:176090 3.e 3:77f86bf9:::rbd_data.1121a23b99f7.0000000000000001:head [write 0~4194304 [fadvise_sequential+fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e196)", 2024-09-13T06:43:04.939 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:42:36.717590+0000", 2024-09-13T06:43:04.939 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 28.200458239, 2024-09-13T06:43:04.939 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.049445965000000001, 2024-09-13T06:43:04.939 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:04.939 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:43:04.939 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:04.939 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:04.939 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:04.939 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 176090 2024-09-13T06:43:04.939 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.939 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:04.939 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.939 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:04.940 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.717590+0000", 2024-09-13T06:43:04.940 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:04.940 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.940 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.940 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:04.940 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.717590+0000", 2024-09-13T06:43:04.940 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:04.940 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.940 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.940 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:04.940 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.717588+0000", 2024-09-13T06:43:04.940 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999981 2024-09-13T06:43:04.940 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.941 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.941 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:04.941 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.723934+0000", 2024-09-13T06:43:04.941 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0063462589999999999 2024-09-13T06:43:04.941 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.941 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.941 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:04.941 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.723960+0000", 2024-09-13T06:43:04.941 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.6251e-05 2024-09-13T06:43:04.941 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.941 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.941 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:04.941 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.723976+0000", 2024-09-13T06:43:04.941 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5277e-05 2024-09-13T06:43:04.942 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.942 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.942 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:04.942 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.724154+0000", 2024-09-13T06:43:04.942 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00017814400000000001 2024-09-13T06:43:04.942 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.942 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.942 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:04.942 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.724534+0000", 2024-09-13T06:43:04.942 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00038054799999999998 2024-09-13T06:43:04.942 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.942 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.942 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-13T06:43:04.943 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.724926+0000", 2024-09-13T06:43:04.943 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00039199100000000001 2024-09-13T06:43:04.943 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.943 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.943 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:43:04.943 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.744509+0000", 2024-09-13T06:43:04.943 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.019582977000000001 2024-09-13T06:43:04.943 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.943 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.943 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-13T06:43:04.943 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.766937+0000", 2024-09-13T06:43:04.943 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.022427765999999998 2024-09-13T06:43:04.943 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.944 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.944 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-13T06:43:04.944 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.766987+0000", 2024-09-13T06:43:04.944 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.9898000000000002e-05 2024-09-13T06:43:04.944 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.944 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.944 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:04.944 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.767036+0000", 2024-09-13T06:43:04.944 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.8782000000000002e-05 2024-09-13T06:43:04.944 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:04.944 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:04.944 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:04.945 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.945 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.945 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:176094 3.f 3:f5ca80c1:::rbd_data.1121a23b99f7.0000000000000004:head [write 0~4194304 [fadvise_sequential+fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e196)", 2024-09-13T06:43:04.945 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:42:36.724239+0000", 2024-09-13T06:43:04.945 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 28.193809138999999, 2024-09-13T06:43:04.945 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.043501235999999999, 2024-09-13T06:43:04.945 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:04.945 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:43:04.945 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:04.945 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:04.945 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:04.945 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 176094 2024-09-13T06:43:04.945 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.946 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:04.946 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.946 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:04.946 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.724239+0000", 2024-09-13T06:43:04.946 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:04.946 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.946 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.946 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:04.946 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.724239+0000", 2024-09-13T06:43:04.946 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:04.946 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.946 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.946 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:04.946 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.724237+0000", 2024-09-13T06:43:04.947 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999981 2024-09-13T06:43:04.947 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.947 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.947 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:04.947 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.733673+0000", 2024-09-13T06:43:04.947 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0094352700000000008 2024-09-13T06:43:04.947 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.947 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.947 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:04.947 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.733703+0000", 2024-09-13T06:43:04.947 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.0102000000000001e-05 2024-09-13T06:43:04.947 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.947 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.947 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:04.948 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.733718+0000", 2024-09-13T06:43:04.948 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5199e-05 2024-09-13T06:43:04.948 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.948 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.948 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:04.948 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.733780+0000", 2024-09-13T06:43:04.948 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.1691000000000003e-05 2024-09-13T06:43:04.948 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.948 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.948 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:04.948 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.733928+0000", 2024-09-13T06:43:04.948 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000147987 2024-09-13T06:43:04.948 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.949 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.949 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 4", 2024-09-13T06:43:04.949 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.734036+0000", 2024-09-13T06:43:04.949 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000108925 2024-09-13T06:43:04.949 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.949 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.949 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:43:04.949 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.763741+0000", 2024-09-13T06:43:04.949 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.029704151000000002 2024-09-13T06:43:04.949 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.949 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.949 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-13T06:43:04.949 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.767615+0000", 2024-09-13T06:43:04.949 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0038739120000000002 2024-09-13T06:43:04.950 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.950 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.950 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-13T06:43:04.950 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.767693+0000", 2024-09-13T06:43:04.950 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.8573999999999997e-05 2024-09-13T06:43:04.950 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.950 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.950 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:04.950 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.767740+0000", 2024-09-13T06:43:04.950 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.7154000000000003e-05 2024-09-13T06:43:04.950 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:04.950 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:04.950 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:04.951 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.951 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.951 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop(client.4385.0:176223 3.7 e196/191 3:e16e66b2:::rbd_data.1121a23b99f7.0000000000000008:head v 196'460, mlcod=194'458)", 2024-09-13T06:43:04.951 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:42:36.748996+0000", 2024-09-13T06:43:04.951 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 28.169052530999998, 2024-09-13T06:43:04.951 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.029353471999999999, 2024-09-13T06:43:04.951 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:04.951 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:43:04.951 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:04.951 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.951 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:04.951 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.748996+0000", 2024-09-13T06:43:04.951 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:04.952 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.952 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.952 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:04.952 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.748996+0000", 2024-09-13T06:43:04.952 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:04.952 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.952 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.952 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:04.952 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.748995+0000", 2024-09-13T06:43:04.952 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:04.952 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.952 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.952 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:04.953 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.757604+0000", 2024-09-13T06:43:04.953 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0086086410000000002 2024-09-13T06:43:04.953 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.953 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.953 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:04.953 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.757619+0000", 2024-09-13T06:43:04.953 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5582000000000001e-05 2024-09-13T06:43:04.953 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.953 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.953 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:04.953 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.757629+0000", 2024-09-13T06:43:04.953 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.4720000000000001e-06 2024-09-13T06:43:04.953 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.954 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.954 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:04.954 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.759293+0000", 2024-09-13T06:43:04.954 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.001664682 2024-09-13T06:43:04.954 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.954 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.954 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:04.954 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.759325+0000", 2024-09-13T06:43:04.954 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.1353999999999998e-05 2024-09-13T06:43:04.954 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.954 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.954 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-13T06:43:04.954 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.778305+0000", 2024-09-13T06:43:04.955 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.018980311 2024-09-13T06:43:04.955 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.955 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.955 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:04.955 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.778349+0000", 2024-09-13T06:43:04.955 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.4016e-05 2024-09-13T06:43:04.955 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:04.955 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:04.955 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:04.955 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.955 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.955 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:176303 3.13 3:ce8be30a:::rbd_data.1121a23b99f7.000000000000000a:head [write 0~3145728 [fadvise_sequential+fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e196)", 2024-09-13T06:43:04.955 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:42:36.759206+0000", 2024-09-13T06:43:04.956 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 28.158842577000001, 2024-09-13T06:43:04.956 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.020206179000000001, 2024-09-13T06:43:04.956 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:04.956 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:43:04.956 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:04.956 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:04.956 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:04.956 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 176303 2024-09-13T06:43:04.956 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.956 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:04.956 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.956 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:04.956 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.759206+0000", 2024-09-13T06:43:04.957 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:04.957 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.957 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.957 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:04.957 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.759206+0000", 2024-09-13T06:43:04.957 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:04.957 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.957 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.957 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:04.957 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.759203+0000", 2024-09-13T06:43:04.957 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999976 2024-09-13T06:43:04.957 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.957 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.957 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:04.958 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.762301+0000", 2024-09-13T06:43:04.958 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0030975339999999999 2024-09-13T06:43:04.958 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.958 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.958 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:04.958 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.762321+0000", 2024-09-13T06:43:04.958 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.9830000000000002e-05 2024-09-13T06:43:04.958 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.958 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.958 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:04.958 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.762333+0000", 2024-09-13T06:43:04.958 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2133999999999999e-05 2024-09-13T06:43:04.958 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.959 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.959 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:04.959 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.763222+0000", 2024-09-13T06:43:04.959 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00088949299999999999 2024-09-13T06:43:04.959 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.959 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.959 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:04.959 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.763578+0000", 2024-09-13T06:43:04.959 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00035557999999999998 2024-09-13T06:43:04.959 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.959 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.959 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 4", 2024-09-13T06:43:04.959 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.763769+0000", 2024-09-13T06:43:04.960 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00019107400000000001 2024-09-13T06:43:04.960 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.960 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.960 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-13T06:43:04.960 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.778736+0000", 2024-09-13T06:43:04.960 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.014966742999999999 2024-09-13T06:43:04.960 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.960 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.960 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:43:04.960 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.779322+0000", 2024-09-13T06:43:04.960 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00058619100000000001 2024-09-13T06:43:04.960 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.960 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.961 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-13T06:43:04.961 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.779370+0000", 2024-09-13T06:43:04.961 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.833e-05 2024-09-13T06:43:04.961 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.961 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.961 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:04.961 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.779412+0000", 2024-09-13T06:43:04.961 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.1616999999999998e-05 2024-09-13T06:43:04.961 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:04.961 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:04.961 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:04.961 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.961 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.962 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:179942 3.13 3:cb453d32:::rbd_data.11213163dd15.0000000000000025:head [sparse-read 0~1015808] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e201)", 2024-09-13T06:43:04.962 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:42:41.697558+0000", 2024-09-13T06:43:04.962 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 23.220489713999999, 2024-09-13T06:43:04.962 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.016654983000000002, 2024-09-13T06:43:04.962 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:04.962 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:04.962 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:04.962 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:04.962 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:04.962 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 179942 2024-09-13T06:43:04.962 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.962 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:04.963 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.963 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:04.963 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:41.697558+0000", 2024-09-13T06:43:04.963 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:04.963 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.963 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.963 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:04.963 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:41.697558+0000", 2024-09-13T06:43:04.963 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:04.963 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.963 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.963 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:04.963 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:41.697557+0000", 2024-09-13T06:43:04.964 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:43:04.964 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.964 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.964 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:04.964 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:41.697564+0000", 2024-09-13T06:43:04.964 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.3829999999999997e-06 2024-09-13T06:43:04.964 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.964 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.964 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:04.964 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:41.697583+0000", 2024-09-13T06:43:04.964 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.8770000000000002e-05 2024-09-13T06:43:04.964 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.964 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.965 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:04.965 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:41.697596+0000", 2024-09-13T06:43:04.965 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.33e-05 2024-09-13T06:43:04.965 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.965 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.965 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:04.965 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:41.711266+0000", 2024-09-13T06:43:04.965 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.013669768000000001 2024-09-13T06:43:04.965 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.965 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.965 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:04.965 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:41.711463+0000", 2024-09-13T06:43:04.965 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000197865 2024-09-13T06:43:04.966 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.966 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.966 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:04.966 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:41.714213+0000", 2024-09-13T06:43:04.966 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.002749937 2024-09-13T06:43:04.966 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:04.966 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:04.966 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:04.966 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.966 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.966 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:179971 3.13 3:cd6d4258:::rbd_data.11213163dd15.0000000000000042:head [sparse-read 0~25187] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e201)", 2024-09-13T06:43:04.966 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:42:41.697981+0000", 2024-09-13T06:43:04.966 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 23.220067633999999, 2024-09-13T06:43:04.966 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.017061026999999999, 2024-09-13T06:43:04.967 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:04.967 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:04.967 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:04.967 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:04.967 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:04.967 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 179971 2024-09-13T06:43:04.967 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.967 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:04.967 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.967 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:04.967 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:41.697981+0000", 2024-09-13T06:43:04.967 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:04.967 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.968 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.968 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:04.968 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:41.697981+0000", 2024-09-13T06:43:04.968 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:04.968 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.968 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.968 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:04.968 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:41.697980+0000", 2024-09-13T06:43:04.968 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:43:04.968 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.968 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.968 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:04.968 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:41.697985+0000", 2024-09-13T06:43:04.969 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.8629999999999996e-06 2024-09-13T06:43:04.969 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.969 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.969 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:04.969 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:41.698006+0000", 2024-09-13T06:43:04.969 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.0477000000000001e-05 2024-09-13T06:43:04.969 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.969 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.969 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:04.969 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:41.698019+0000", 2024-09-13T06:43:04.969 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3213e-05 2024-09-13T06:43:04.969 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.969 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.969 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:04.970 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:41.714306+0000", 2024-09-13T06:43:04.970 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.016287189000000001 2024-09-13T06:43:04.970 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.970 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.970 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:04.970 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:41.714511+0000", 2024-09-13T06:43:04.970 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00020438499999999999 2024-09-13T06:43:04.970 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.970 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.970 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:04.970 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:41.715042+0000", 2024-09-13T06:43:04.970 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00053083999999999998 2024-09-13T06:43:04.970 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:04.971 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:04.971 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:04.971 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.971 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.971 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:179980 3.f 3:f4615ec5:::rbd_data.11213163dd15.000000000000004b:head [sparse-read 0~32481] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e201)", 2024-09-13T06:43:04.971 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:42:41.698131+0000", 2024-09-13T06:43:04.971 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 23.219916651999998, 2024-09-13T06:43:04.971 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.015258558, 2024-09-13T06:43:04.971 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:04.971 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:04.971 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:04.971 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:04.972 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:04.972 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 179980 2024-09-13T06:43:04.972 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.972 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:04.972 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.972 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:04.972 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:41.698131+0000", 2024-09-13T06:43:04.972 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:04.972 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.972 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.972 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:04.972 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:41.698131+0000", 2024-09-13T06:43:04.972 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:04.972 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.973 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.973 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:04.973 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:41.698130+0000", 2024-09-13T06:43:04.973 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:43:04.973 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.973 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.973 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:04.973 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:41.698149+0000", 2024-09-13T06:43:04.973 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.8457e-05 2024-09-13T06:43:04.973 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.973 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.973 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:04.974 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:41.698167+0000", 2024-09-13T06:43:04.974 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7986e-05 2024-09-13T06:43:04.974 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.974 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.974 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:04.974 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:41.698181+0000", 2024-09-13T06:43:04.974 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3720000000000001e-05 2024-09-13T06:43:04.974 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.974 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.974 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:04.974 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:41.712123+0000", 2024-09-13T06:43:04.974 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.013942358 2024-09-13T06:43:04.974 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.974 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.974 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:04.975 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:41.712333+0000", 2024-09-13T06:43:04.975 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000210316 2024-09-13T06:43:04.975 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.975 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.975 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:04.975 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:41.713390+0000", 2024-09-13T06:43:04.975 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0010567409999999999 2024-09-13T06:43:04.975 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:04.975 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:04.975 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:04.975 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.975 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.975 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:179992 3.13 3:cda86893:::rbd_data.11213163dd15.0000000000000057:head [sparse-read 0~1048576] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e201)", 2024-09-13T06:43:04.975 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:42:41.699847+0000", 2024-09-13T06:43:04.975 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 23.218201523000001, 2024-09-13T06:43:04.975 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.015577964999999999, 2024-09-13T06:43:04.976 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:04.976 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:43:04.976 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:04.976 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:04.976 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:04.976 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 179992 2024-09-13T06:43:04.976 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.976 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:04.976 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.976 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:04.976 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:41.699847+0000", 2024-09-13T06:43:04.976 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:04.976 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.976 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.977 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:04.977 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:41.699847+0000", 2024-09-13T06:43:04.977 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:04.977 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.977 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.977 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:04.977 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:41.699846+0000", 2024-09-13T06:43:04.977 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:43:04.977 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.977 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.977 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:04.977 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:41.699852+0000", 2024-09-13T06:43:04.977 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.1229999999999997e-06 2024-09-13T06:43:04.977 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.978 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.978 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:04.978 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:41.699870+0000", 2024-09-13T06:43:04.978 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.8369999999999999e-05 2024-09-13T06:43:04.978 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.978 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.978 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:04.978 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:41.699884+0000", 2024-09-13T06:43:04.978 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3716999999999999e-05 2024-09-13T06:43:04.978 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.978 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.978 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:04.978 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:41.715128+0000", 2024-09-13T06:43:04.978 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.015244491000000001 2024-09-13T06:43:04.978 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.979 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.979 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:04.979 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:41.715425+0000", 2024-09-13T06:43:04.979 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00029634099999999999 2024-09-13T06:43:04.979 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:04.979 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:04.979 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:04.979 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.979 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.979 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:180005 3.13 3:cec7a900:::rbd_data.11213163dd15.0000000000000064:head [sparse-read 0~1048576] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e201)", 2024-09-13T06:43:04.979 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:42:41.699914+0000", 2024-09-13T06:43:04.979 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 23.218134274000001, 2024-09-13T06:43:04.979 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.015794986, 2024-09-13T06:43:04.979 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:04.980 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:43:04.980 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:04.980 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:04.980 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:04.980 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 180005 2024-09-13T06:43:04.980 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.980 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:04.980 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.980 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:04.980 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:41.699914+0000", 2024-09-13T06:43:04.980 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:04.980 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.980 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.980 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:04.980 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:41.699914+0000", 2024-09-13T06:43:04.981 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:04.981 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.981 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.981 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:04.981 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:41.699913+0000", 2024-09-13T06:43:04.981 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:43:04.981 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.981 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.981 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:04.981 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:41.699919+0000", 2024-09-13T06:43:04.981 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.72e-06 2024-09-13T06:43:04.981 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.981 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.981 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:04.982 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:41.699938+0000", 2024-09-13T06:43:04.982 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.8955999999999999e-05 2024-09-13T06:43:04.982 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.982 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.982 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:04.982 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:41.699953+0000", 2024-09-13T06:43:04.982 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.502e-05 2024-09-13T06:43:04.982 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.982 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.982 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:04.982 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:41.715528+0000", 2024-09-13T06:43:04.982 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.015574955 2024-09-13T06:43:04.982 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.982 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.983 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:04.983 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:41.715709+0000", 2024-09-13T06:43:04.983 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00018044099999999999 2024-09-13T06:43:04.983 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:04.983 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:04.983 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:04.983 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.983 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.983 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:204693 3.e 3:70d886d1:::rbd_data.11213650bb32.0000000000000004:head [write 0~524288 [fadvise_sequential+fadvise_nocache],zero 524288~262144,write 786432~1310720 [fadvise_sequential+fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e208)", 2024-09-13T06:43:04.983 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:42:50.944136+0000", 2024-09-13T06:43:04.983 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 13.973912078, 2024-09-13T06:43:04.983 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.023197766000000002, 2024-09-13T06:43:04.983 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:04.983 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:43:04.983 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:04.984 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:04.984 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:04.984 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 204693 2024-09-13T06:43:04.984 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.984 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:04.984 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.984 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:04.984 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:50.944136+0000", 2024-09-13T06:43:04.984 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:04.984 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.984 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.984 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:04.984 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:50.944136+0000", 2024-09-13T06:43:04.984 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:04.985 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.985 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.985 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:04.985 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:50.944134+0000", 2024-09-13T06:43:04.985 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999981 2024-09-13T06:43:04.985 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.985 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.985 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:04.985 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:50.947044+0000", 2024-09-13T06:43:04.985 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.002909273 2024-09-13T06:43:04.985 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.985 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.986 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:04.986 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:50.947072+0000", 2024-09-13T06:43:04.986 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.7968999999999999e-05 2024-09-13T06:43:04.986 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.986 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.986 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:04.986 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:50.947085+0000", 2024-09-13T06:43:04.986 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.328e-05 2024-09-13T06:43:04.986 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.986 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.986 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:04.986 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:50.947140+0000", 2024-09-13T06:43:04.987 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.5492999999999999e-05 2024-09-13T06:43:04.987 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.987 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.987 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:04.987 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:50.947253+0000", 2024-09-13T06:43:04.987 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00011259 2024-09-13T06:43:04.987 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.987 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.987 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-13T06:43:04.987 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:50.947400+0000", 2024-09-13T06:43:04.987 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00014672700000000001 2024-09-13T06:43:04.987 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.988 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.988 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-13T06:43:04.988 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:50.950413+0000", 2024-09-13T06:43:04.988 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.003013501 2024-09-13T06:43:04.988 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.988 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.988 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:43:04.988 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:50.967152+0000", 2024-09-13T06:43:04.988 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.016738388999999999 2024-09-13T06:43:04.988 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.988 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.988 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-13T06:43:04.988 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:50.967265+0000", 2024-09-13T06:43:04.989 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000113717 2024-09-13T06:43:04.989 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.989 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.989 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:04.989 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:50.967334+0000", 2024-09-13T06:43:04.989 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.8591999999999997e-05 2024-09-13T06:43:04.989 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:04.989 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:04.989 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:04.989 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.989 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.989 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:205233 3.15 3:a97b2891:::rbd_data.11213650bb32.000000000000002e:head [set-alloc-hint object_size 4194304 write_size 4194304,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e209)", 2024-09-13T06:43:04.989 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:42:52.282586+0000", 2024-09-13T06:43:04.990 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 12.635462295, 2024-09-13T06:43:04.990 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.056996628000000001, 2024-09-13T06:43:04.990 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:04.990 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:43:04.990 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:04.990 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:04.990 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:04.990 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 205233 2024-09-13T06:43:04.990 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.990 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:04.990 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.990 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:04.990 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:52.282586+0000", 2024-09-13T06:43:04.991 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:04.991 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.991 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.991 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:04.991 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:52.282586+0000", 2024-09-13T06:43:04.991 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:04.991 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.991 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.991 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:04.991 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:52.282583+0000", 2024-09-13T06:43:04.991 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999976 2024-09-13T06:43:04.991 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.991 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.992 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:04.992 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:52.282599+0000", 2024-09-13T06:43:04.992 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5065999999999999e-05 2024-09-13T06:43:04.992 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.992 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.992 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:04.992 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:52.282632+0000", 2024-09-13T06:43:04.992 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.3386999999999997e-05 2024-09-13T06:43:04.992 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.992 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.992 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:04.992 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:52.282654+0000", 2024-09-13T06:43:04.992 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.177e-05 2024-09-13T06:43:04.993 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.993 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.993 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:04.993 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:52.282753+0000", 2024-09-13T06:43:04.993 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.9685000000000005e-05 2024-09-13T06:43:04.993 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.993 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.993 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:04.993 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:52.283000+0000", 2024-09-13T06:43:04.993 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000246278 2024-09-13T06:43:04.993 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.993 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.993 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 3", 2024-09-13T06:43:04.993 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:52.292656+0000", 2024-09-13T06:43:04.994 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0096565980000000006 2024-09-13T06:43:04.994 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.994 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.994 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:43:04.994 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:52.339352+0000", 2024-09-13T06:43:04.994 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.046695309999999997 2024-09-13T06:43:04.994 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.994 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.994 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-13T06:43:04.994 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:52.339373+0000", 2024-09-13T06:43:04.994 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.1002999999999999e-05 2024-09-13T06:43:04.994 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.994 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.994 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-13T06:43:04.995 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:52.339464+0000", 2024-09-13T06:43:04.995 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.1131999999999994e-05 2024-09-13T06:43:04.995 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.995 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.995 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:04.995 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:52.339582+0000", 2024-09-13T06:43:04.995 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000118799 2024-09-13T06:43:04.995 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:04.995 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:04.995 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:04.995 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.995 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.995 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_repop_reply(client.4385.0:205233 3.15 e209/192 ondisk, result = 0)", 2024-09-13T06:43:04.995 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:42:52.322068+0000", 2024-09-13T06:43:04.995 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 12.595980425, 2024-09-13T06:43:04.996 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.01729048, 2024-09-13T06:43:04.996 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:04.996 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:04.996 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:04.996 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.996 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:04.996 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:52.322068+0000", 2024-09-13T06:43:04.996 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:04.996 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.996 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.996 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:04.996 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:52.322068+0000", 2024-09-13T06:43:04.996 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:04.997 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.997 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.997 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:04.997 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:52.322066+0000", 2024-09-13T06:43:04.997 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999981 2024-09-13T06:43:04.997 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.997 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.997 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:04.997 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:52.322076+0000", 2024-09-13T06:43:04.997 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0832999999999999e-05 2024-09-13T06:43:04.997 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.997 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.997 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:04.997 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:52.322111+0000", 2024-09-13T06:43:04.998 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.4823000000000002e-05 2024-09-13T06:43:04.998 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.998 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.998 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:04.998 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:52.322127+0000", 2024-09-13T06:43:04.998 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6096999999999999e-05 2024-09-13T06:43:04.998 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.998 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.998 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:04.998 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:52.339322+0000", 2024-09-13T06:43:04.998 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.017195070999999999 2024-09-13T06:43:04.998 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.998 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.998 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:04.998 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:52.339339+0000", 2024-09-13T06:43:04.999 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6056999999999999e-05 2024-09-13T06:43:04.999 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.999 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.999 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:04.999 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:52.339358+0000", 2024-09-13T06:43:04.999 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.9666000000000001e-05 2024-09-13T06:43:04.999 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:04.999 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:04.999 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:04.999 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:04.999 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:04.999 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:205591 3.16 3:6bccb43d:::rbd_data.112120f04cfa.0000000000000000:head [write 0~1572864 [fadvise_sequential+fadvise_nocache],zero 2621440~1021484,write 3642924~27092 [fadvise_sequential+fadvise_nocache],zero 3670016~175043,write 3845059~30529 [fadvise_sequential+fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e211)", 2024-09-13T06:43:04.999 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:42:53.785943+0000", 2024-09-13T06:43:04.999 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 11.132105170999999, 2024-09-13T06:43:04.999 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.016043199000000001, 2024-09-13T06:43:05.000 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:05.000 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:43:05.000 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:05.000 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:05.000 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:05.000 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 205591 2024-09-13T06:43:05.000 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:05.000 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:05.000 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:05.000 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:05.000 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:53.785943+0000", 2024-09-13T06:43:05.000 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:05.000 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:05.000 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:05.000 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:05.001 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:53.785943+0000", 2024-09-13T06:43:05.001 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:05.001 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:05.001 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:05.001 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:05.001 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:53.785942+0000", 2024-09-13T06:43:05.001 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:43:05.001 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:05.001 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:05.001 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:05.001 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:53.788074+0000", 2024-09-13T06:43:05.001 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0021323330000000001 2024-09-13T06:43:05.001 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:05.002 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:05.002 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:05.002 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:53.788089+0000", 2024-09-13T06:43:05.002 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.4297999999999999e-05 2024-09-13T06:43:05.002 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:05.002 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:05.002 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:05.002 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:53.788097+0000", 2024-09-13T06:43:05.002 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.0460000000000006e-06 2024-09-13T06:43:05.002 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:05.002 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:05.002 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:05.002 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:53.788172+0000", 2024-09-13T06:43:05.003 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5068999999999996e-05 2024-09-13T06:43:05.003 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:05.003 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:05.003 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:05.003 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:53.788417+0000", 2024-09-13T06:43:05.003 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00024509100000000002 2024-09-13T06:43:05.003 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:05.003 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:05.003 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 5", 2024-09-13T06:43:05.003 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:53.788867+0000", 2024-09-13T06:43:05.003 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00045017899999999999 2024-09-13T06:43:05.003 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:05.003 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:05.004 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-13T06:43:05.004 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:53.801012+0000", 2024-09-13T06:43:05.004 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.01214486 2024-09-13T06:43:05.004 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:05.004 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:05.004 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:43:05.004 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:53.801845+0000", 2024-09-13T06:43:05.004 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000833339 2024-09-13T06:43:05.004 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:05.004 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:05.004 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-13T06:43:05.004 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:53.801926+0000", 2024-09-13T06:43:05.004 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.1026000000000007e-05 2024-09-13T06:43:05.004 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:05.005 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:05.005 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:05.005 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:53.801986+0000", 2024-09-13T06:43:05.005 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.9963999999999997e-05 2024-09-13T06:43:05.005 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:05.005 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:05.005 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:05.005 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:05.005 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:05.005 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:206014 3.12 3:4a32852b:::rbd_data.1121e2e0f0e7.0000000000000049:head [sparse-read 0~186368] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e212)", 2024-09-13T06:43:05.005 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:42:55.040268+0000", 2024-09-13T06:43:05.005 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 9.8777797149999991, 2024-09-13T06:43:05.005 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.015009954000000001, 2024-09-13T06:43:05.006 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:05.006 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:05.006 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:05.006 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:05.006 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:05.006 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 206014 2024-09-13T06:43:05.006 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:05.006 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:05.006 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:05.006 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:05.006 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:55.040268+0000", 2024-09-13T06:43:05.006 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:05.006 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:05.006 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:05.007 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:05.007 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:55.040268+0000", 2024-09-13T06:43:05.007 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:05.007 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:05.007 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:05.007 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:05.007 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:55.040267+0000", 2024-09-13T06:43:05.007 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999986 2024-09-13T06:43:05.007 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:05.007 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:05.007 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:05.007 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:55.040274+0000", 2024-09-13T06:43:05.007 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.1930000000000004e-06 2024-09-13T06:43:05.007 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:05.007 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:05.008 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:05.008 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:55.040294+0000", 2024-09-13T06:43:05.008 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.9536000000000001e-05 2024-09-13T06:43:05.008 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:05.008 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:05.008 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:05.008 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:55.040308+0000", 2024-09-13T06:43:05.008 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.4543e-05 2024-09-13T06:43:05.008 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:05.008 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:05.008 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:05.008 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:55.050737+0000", 2024-09-13T06:43:05.008 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.01042833 2024-09-13T06:43:05.008 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:05.008 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:05.009 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:05.009 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:55.050944+0000", 2024-09-13T06:43:05.009 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000207328 2024-09-13T06:43:05.009 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:05.009 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:05.009 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:05.009 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:55.055278+0000", 2024-09-13T06:43:05.009 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0043343670000000004 2024-09-13T06:43:05.009 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:05.009 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:05.009 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:05.009 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:05.009 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:05.009 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:206067 3.12 3:4c872066:::rbd_data.1121e2e0f0e7.000000000000007e:head [sparse-read 0~262144] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e212)", 2024-09-13T06:43:05.009 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:42:55.041402+0000", 2024-09-13T06:43:05.010 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 9.8766464819999999, 2024-09-13T06:43:05.010 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.014804583, 2024-09-13T06:43:05.010 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:05.010 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:43:05.010 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:05.010 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:05.010 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:05.010 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 206067 2024-09-13T06:43:05.010 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:05.010 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:05.010 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:05.010 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:05.010 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:55.041402+0000", 2024-09-13T06:43:05.011 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:05.011 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:05.011 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:05.011 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:05.011 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:55.041402+0000", 2024-09-13T06:43:05.011 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:05.011 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:05.011 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:05.011 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:05.011 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:55.041401+0000", 2024-09-13T06:43:05.011 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:43:05.011 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:05.011 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:05.011 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:05.011 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:55.041407+0000", 2024-09-13T06:43:05.012 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.1999999999999999e-06 2024-09-13T06:43:05.012 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:05.012 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:05.012 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:05.012 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:55.041423+0000", 2024-09-13T06:43:05.012 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6379999999999999e-05 2024-09-13T06:43:05.012 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:05.012 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:05.012 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:05.012 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:55.041436+0000", 2024-09-13T06:43:05.012 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2612999999999999e-05 2024-09-13T06:43:05.012 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:05.012 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:05.012 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:05.012 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:55.055985+0000", 2024-09-13T06:43:05.013 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.014549608 2024-09-13T06:43:05.013 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:05.013 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:05.013 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:05.013 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:55.056206+0000", 2024-09-13T06:43:05.013 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000220845 2024-09-13T06:43:05.013 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:05.013 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:05.013 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:05.013 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:05.013 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:05.013 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:207003 3.d 3:b77f38f0:::rbd_data.112120f04cfa.0000000000000019:head [set-alloc-hint object_size 4194304 write_size 4194304,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e212)", 2024-09-13T06:43:05.013 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:42:55.735112+0000", 2024-09-13T06:43:05.014 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 9.1829366239999999, 2024-09-13T06:43:05.014 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.016754272000000001, 2024-09-13T06:43:05.014 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:05.014 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:43:05.014 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:05.014 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:05.014 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:05.014 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 207003 2024-09-13T06:43:05.014 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:05.014 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:05.014 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:05.014 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:05.014 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:55.735112+0000", 2024-09-13T06:43:05.014 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:05.014 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:05.015 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:05.015 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:05.015 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:55.735112+0000", 2024-09-13T06:43:05.015 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:05.015 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:05.015 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:05.015 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:05.015 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:55.735109+0000", 2024-09-13T06:43:05.015 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999976 2024-09-13T06:43:05.015 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:05.015 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:05.015 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:05.015 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:55.735123+0000", 2024-09-13T06:43:05.015 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3687e-05 2024-09-13T06:43:05.016 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:05.016 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:05.016 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:05.016 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:55.735155+0000", 2024-09-13T06:43:05.016 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.1959999999999999e-05 2024-09-13T06:43:05.016 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:05.016 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:05.016 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:05.016 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:55.735170+0000", 2024-09-13T06:43:05.016 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.4873e-05 2024-09-13T06:43:05.016 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:05.016 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:05.016 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:05.016 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:55.735242+0000", 2024-09-13T06:43:05.017 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.2461999999999998e-05 2024-09-13T06:43:05.017 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:05.017 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:05.017 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:05.017 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:55.735473+0000", 2024-09-13T06:43:05.017 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00023066499999999999 2024-09-13T06:43:05.017 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:05.017 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:05.017 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 5", 2024-09-13T06:43:05.017 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:55.738256+0000", 2024-09-13T06:43:05.017 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0027830239999999998 2024-09-13T06:43:05.017 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:05.017 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:05.017 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:43:05.018 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:55.751692+0000", 2024-09-13T06:43:05.018 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.013436480000000001 2024-09-13T06:43:05.018 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:05.018 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:05.018 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-13T06:43:05.018 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:55.751716+0000", 2024-09-13T06:43:05.018 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.3359000000000001e-05 2024-09-13T06:43:05.018 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:05.018 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:05.018 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-13T06:43:05.018 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:55.751802+0000", 2024-09-13T06:43:05.018 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.5842999999999998e-05 2024-09-13T06:43:05.018 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:05.018 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:05.018 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:05.018 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:55.751866+0000", 2024-09-13T06:43:05.019 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.4288999999999994e-05 2024-09-13T06:43:05.019 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:05.019 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:05.019 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:05.019 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:05.019 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:05.019 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:207128 3.16 3:6ff24189:::rbd_data.112120f04cfa.000000000000001b:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e212)", 2024-09-13T06:43:05.019 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:42:56.004876+0000", 2024-09-13T06:43:05.019 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 8.9131717889999997, 2024-09-13T06:43:05.019 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.029157267000000001, 2024-09-13T06:43:05.019 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:05.019 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:43:05.019 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:05.019 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:05.019 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:05.020 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 207128 2024-09-13T06:43:05.020 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:05.020 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:05.020 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:05.020 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:05.020 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:56.004876+0000", 2024-09-13T06:43:05.020 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:05.020 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:05.020 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:05.020 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:05.020 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:56.004876+0000", 2024-09-13T06:43:05.020 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:05.021 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:05.021 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:05.021 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:05.021 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:56.004875+0000", 2024-09-13T06:43:05.021 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999981 2024-09-13T06:43:05.021 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:05.021 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:05.021 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:05.021 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:56.004885+0000", 2024-09-13T06:43:05.021 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0864e-05 2024-09-13T06:43:05.021 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:05.021 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:05.021 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:05.021 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:56.004910+0000", 2024-09-13T06:43:05.022 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.4655999999999999e-05 2024-09-13T06:43:05.022 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:05.022 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:05.022 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:05.022 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:56.004924+0000", 2024-09-13T06:43:05.022 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.4205999999999999e-05 2024-09-13T06:43:05.022 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:05.022 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:05.022 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:05.022 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:56.004998+0000", 2024-09-13T06:43:05.022 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.3663000000000003e-05 2024-09-13T06:43:05.022 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:05.022 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:05.022 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:05.022 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:56.005138+0000", 2024-09-13T06:43:05.023 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000140452 2024-09-13T06:43:05.023 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:05.023 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:05.023 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 5", 2024-09-13T06:43:05.023 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:56.009245+0000", 2024-09-13T06:43:05.023 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0041062989999999999 2024-09-13T06:43:05.023 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:05.023 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:05.023 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-13T06:43:05.023 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:56.033784+0000", 2024-09-13T06:43:05.023 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.024539080000000001 2024-09-13T06:43:05.023 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:05.024 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:05.024 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:43:05.024 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:56.033884+0000", 2024-09-13T06:43:05.024 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000100012 2024-09-13T06:43:05.024 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:05.024 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:05.024 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-13T06:43:05.024 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:56.033967+0000", 2024-09-13T06:43:05.024 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.3702999999999995e-05 2024-09-13T06:43:05.024 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:05.024 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:05.024 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:05.024 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:56.034034+0000", 2024-09-13T06:43:05.024 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.6179000000000005e-05 2024-09-13T06:43:05.025 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:05.025 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:05.025 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:05.025 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:05.025 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:05.025 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:43:05.026 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-09-13T06:43:04.924+0000 7f7f69d72640 -1 mgr.server reply reply (4) Interrupted system call no change 2024-09-13T06:43:05.026 INFO:teuthology.orchestra.run.smithi081.stdout:moved 4 / 82 (4.87805%) 2024-09-13T06:43:05.027 INFO:teuthology.orchestra.run.smithi081.stdout:avg 11.7143 2024-09-13T06:43:05.027 INFO:teuthology.orchestra.run.smithi081.stdout:stddev 2.24972 -> 2.60298 (expected baseline 3.16872) 2024-09-13T06:43:05.027 INFO:teuthology.orchestra.run.smithi081.stdout:min osd.2 with 8 -> 10 pgs (0.682927 -> 0.853658 * mean) 2024-09-13T06:43:05.027 INFO:teuthology.orchestra.run.smithi081.stdout:max osd.7 with 15 -> 16 pgs (1.28049 -> 1.36585 * mean) 2024-09-13T06:43:05.027 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T06:43:05.027 INFO:teuthology.orchestra.run.smithi081.stdout:oload 110 2024-09-13T06:43:05.027 INFO:teuthology.orchestra.run.smithi081.stdout:max_change 0.05 2024-09-13T06:43:05.027 INFO:teuthology.orchestra.run.smithi081.stdout:max_change_osds 4 2024-09-13T06:43:05.027 INFO:teuthology.orchestra.run.smithi081.stdout:average_utilization 0.0017 2024-09-13T06:43:05.027 INFO:teuthology.orchestra.run.smithi081.stdout:overload_utilization 0.0019 2024-09-13T06:43:05.027 INFO:teuthology.orchestra.run.smithi081.stdout:osd.3 weight 1.0000 -> 0.9500 2024-09-13T06:43:05.027 INFO:teuthology.orchestra.run.smithi081.stdout:osd.4 weight 0.5869 -> 0.5369 2024-09-13T06:43:05.027 INFO:teuthology.orchestra.run.smithi081.stdout:osd.5 weight 1.0000 -> 0.9500 2024-09-13T06:43:05.027 INFO:teuthology.orchestra.run.smithi081.stdout:osd.0 weight 1.0000 -> 0.9500 2024-09-13T06:43:05.029 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-13T06:43:05.029 INFO:teuthology.orchestra.run.smithi081.stderr:no change 2024-09-13T06:43:05.030 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:43:05.028+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:43:05.128 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:43:05.128+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:43:05.229 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:43:05.228+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:43:05.245 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:43:05.245 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-13T06:43:05.245 INFO:teuthology.orchestra.run.smithi081.stdout: "num_ops": 0 2024-09-13T06:43:05.245 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:43:05.259 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-13T06:43:05.281 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-13T06:43:05.346 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:43:05.348+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:43:05.422 INFO:teuthology.orchestra.run.smithi081.stderr:nodeep-scrub is set 2024-09-13T06:43:05.428 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:43:05.428 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-13T06:43:05.428 INFO:teuthology.orchestra.run.smithi081.stdout: "complaint_time": 30, 2024-09-13T06:43:05.429 INFO:teuthology.orchestra.run.smithi081.stdout: "num_blocked_ops": 0 2024-09-13T06:43:05.429 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:43:05.430 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:43:05.432+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:43:05.448 INFO:teuthology.orchestra.run.smithi081.stdout:osd.0: {} 2024-09-13T06:43:05.448 INFO:teuthology.orchestra.run.smithi081.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-13T06:43:05.449 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-13T06:43:05.468 INFO:teuthology.orchestra.run.smithi081.stdout:osd.1: {} 2024-09-13T06:43:05.468 INFO:teuthology.orchestra.run.smithi081.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-13T06:43:05.487 INFO:teuthology.orchestra.run.smithi081.stdout:osd.2: {} 2024-09-13T06:43:05.487 INFO:teuthology.orchestra.run.smithi081.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-13T06:43:05.506 INFO:teuthology.orchestra.run.smithi081.stdout:osd.3: {} 2024-09-13T06:43:05.506 INFO:teuthology.orchestra.run.smithi081.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-13T06:43:05.530 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:43:05.532+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:43:05.532 INFO:teuthology.orchestra.run.smithi081.stdout:osd.4: {} 2024-09-13T06:43:05.532 INFO:teuthology.orchestra.run.smithi081.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-13T06:43:05.553 INFO:teuthology.orchestra.run.smithi081.stdout:osd.5: {} 2024-09-13T06:43:05.553 INFO:teuthology.orchestra.run.smithi081.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-13T06:43:05.554 INFO:teuthology.orchestra.run.smithi081.stderr:Error ENXIO: problem getting command descriptions from osd.6 2024-09-13T06:43:05.586 INFO:teuthology.orchestra.run.smithi081.stdout:osd.7: {} 2024-09-13T06:43:05.586 INFO:teuthology.orchestra.run.smithi081.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-13T06:43:05.590 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-13T06:43:05.590 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-13T06:43:05.624 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:43:05.624 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:43:05.632 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:43:05.633+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:43:05.642 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-13T06:43:05.733 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:43:05.733+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:43:05.829 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:43:05.829 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:43:05.834 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:43:05.836+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:43:05.843 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-13T06:43:05.935 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:43:05.936+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:43:06.017 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:43:06.017 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:43:06.036 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-13T06:43:06.037 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:43:06.036+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:43:06.137 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:43:06.136+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:43:06.196 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:43:06.196 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:43:06.210 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-13T06:43:06.254 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:43:06.256+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:43:06.338 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:43:06.340+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:43:06.373 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:43:06.373 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:43:06.393 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-13T06:43:06.439 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:43:06.437+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:43:06.540 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:43:06.540 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:43:06.541 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-13T06:43:06.541+0000 7fa8bb18e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 36790) UID: 0 2024-09-13T06:43:06.552 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-13T06:43:06.641 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:43:06.640+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:43:06.663 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:43:06.663 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:43:06.675 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-13T06:43:06.742 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-13T06:43:06.741+0000 7fa8bb18e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 36790) UID: 0 2024-09-13T06:43:06.833 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:43:06.834 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:43:06.843 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-13T06:43:06.841+0000 7fa8bb18e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 36790) UID: 0 2024-09-13T06:43:06.846 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-13T06:43:06.944 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:43:06.944+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:43:06.954 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:43:06.954 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:43:06.967 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-13T06:43:07.054 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:43:07.056+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:43:07.122 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:43:07.122 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:43:07.134 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-13T06:43:07.184 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-13T06:43:07.185+0000 7fa8bb18e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 36790) UID: 0 2024-09-13T06:43:07.246 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:43:07.245+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:43:07.263 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:43:07.264 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:43:07.277 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-13T06:43:07.347 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:43:07.348+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:43:07.449 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:43:07.448+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:43:07.450 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:43:07.450 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:43:07.451 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-13T06:43:07.467 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-13T06:43:07.550 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:43:07.548+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:43:07.591 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-13T06:43:07.604 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:43:07.605 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:43:07.621 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-13T06:43:07.654 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:43:07.652+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:43:07.752 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:43:07.752+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:43:07.777 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:43:07.777 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:43:07.778 INFO:teuthology.orchestra.run.smithi081.stdout:osd.0: {} 2024-09-13T06:43:07.778 INFO:teuthology.orchestra.run.smithi081.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-13T06:43:07.797 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-13T06:43:07.811 INFO:teuthology.orchestra.run.smithi081.stdout:osd.1: {} 2024-09-13T06:43:07.811 INFO:teuthology.orchestra.run.smithi081.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-13T06:43:07.843 INFO:teuthology.orchestra.run.smithi081.stdout:osd.2: {} 2024-09-13T06:43:07.843 INFO:teuthology.orchestra.run.smithi081.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-13T06:43:07.853 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:43:07.852+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:43:07.877 INFO:teuthology.orchestra.run.smithi081.stdout:osd.3: {} 2024-09-13T06:43:07.877 INFO:teuthology.orchestra.run.smithi081.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-13T06:43:07.910 INFO:teuthology.orchestra.run.smithi081.stdout:osd.4: {} 2024-09-13T06:43:07.910 INFO:teuthology.orchestra.run.smithi081.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-13T06:43:07.938 INFO:teuthology.orchestra.run.smithi081.stdout:osd.5: {} 2024-09-13T06:43:07.939 INFO:teuthology.orchestra.run.smithi081.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-13T06:43:07.939 INFO:teuthology.orchestra.run.smithi081.stderr:Error ENXIO: problem getting command descriptions from osd.6 2024-09-13T06:43:07.954 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:43:07.953+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:43:07.959 INFO:teuthology.orchestra.run.smithi081.stdout:osd.7: {} 2024-09-13T06:43:07.959 INFO:teuthology.orchestra.run.smithi081.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-13T06:43:07.963 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-13T06:43:07.964 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-13T06:43:07.971 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:43:07.971 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [], 2024-09-13T06:43:07.971 INFO:teuthology.orchestra.run.smithi139.stdout: "complaint_time": 30, 2024-09-13T06:43:07.971 INFO:teuthology.orchestra.run.smithi139.stdout: "num_blocked_ops": 0 2024-09-13T06:43:07.971 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:43:07.990 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-13T06:43:08.076 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-13T06:43:08.077+0000 7fa8bb18e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 36790) UID: 0 2024-09-13T06:43:08.156 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:43:08.157+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:43:08.158 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:43:08.158 INFO:teuthology.orchestra.run.smithi139.stdout: "size": 20, 2024-09-13T06:43:08.158 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 600, 2024-09-13T06:43:08.158 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [ 2024-09-13T06:43:08.158 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.158 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43299 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 432128~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:43:08.158 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589881+0000", 2024-09-13T06:43:08.158 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 166.56757579399999, 2024-09-13T06:43:08.158 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.079693849999999997, 2024-09-13T06:43:08.159 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:08.159 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:08.159 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:08.159 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:08.159 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:08.159 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43299 2024-09-13T06:43:08.159 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.159 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:08.159 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.159 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:08.159 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589881+0000", 2024-09-13T06:43:08.159 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:08.160 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.160 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.160 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:08.160 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589881+0000", 2024-09-13T06:43:08.160 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:08.160 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.160 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.160 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:08.160 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589880+0000", 2024-09-13T06:43:08.160 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:43:08.160 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.160 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.160 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:08.160 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589884+0000", 2024-09-13T06:43:08.161 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.053e-06 2024-09-13T06:43:08.161 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.161 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.161 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:08.161 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589893+0000", 2024-09-13T06:43:08.161 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.2129999999999997e-06 2024-09-13T06:43:08.161 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.161 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.161 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:08.161 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589901+0000", 2024-09-13T06:43:08.161 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.6399999999999997e-06 2024-09-13T06:43:08.161 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.162 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.162 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:08.162 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.669213+0000", 2024-09-13T06:43:08.162 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.079312074999999996 2024-09-13T06:43:08.162 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.162 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.162 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:08.162 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.669281+0000", 2024-09-13T06:43:08.162 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.8322000000000001e-05 2024-09-13T06:43:08.162 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.162 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.162 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:08.162 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.669575+0000", 2024-09-13T06:43:08.163 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00029349699999999999 2024-09-13T06:43:08.163 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:08.163 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:08.163 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:08.163 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.163 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.163 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43300 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 446464~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:43:08.163 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589909+0000", 2024-09-13T06:43:08.163 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 166.567547899, 2024-09-13T06:43:08.163 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.080339496999999996, 2024-09-13T06:43:08.163 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:08.163 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:08.163 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:08.164 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:08.164 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:08.164 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43300 2024-09-13T06:43:08.164 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.164 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:08.164 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.164 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:08.164 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589909+0000", 2024-09-13T06:43:08.164 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:08.164 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.164 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.164 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:08.164 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589909+0000", 2024-09-13T06:43:08.165 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:08.165 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.165 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.165 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:08.165 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589908+0000", 2024-09-13T06:43:08.165 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:43:08.165 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.165 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.165 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:08.165 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589912+0000", 2024-09-13T06:43:08.165 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.9430000000000002e-06 2024-09-13T06:43:08.165 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.165 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.166 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:08.166 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589920+0000", 2024-09-13T06:43:08.166 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.3860000000000007e-06 2024-09-13T06:43:08.166 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.166 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.166 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:08.166 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589928+0000", 2024-09-13T06:43:08.166 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.3329999999999999e-06 2024-09-13T06:43:08.166 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.166 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.166 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:08.166 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.669651+0000", 2024-09-13T06:43:08.166 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.079723204000000006 2024-09-13T06:43:08.167 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.167 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.167 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:08.167 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.669840+0000", 2024-09-13T06:43:08.167 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000189397 2024-09-13T06:43:08.167 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.167 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.167 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:08.167 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.670248+0000", 2024-09-13T06:43:08.168 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00040811100000000001 2024-09-13T06:43:08.168 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:08.168 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:08.168 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:08.168 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.168 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.168 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43301 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 460800~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:43:08.168 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589934+0000", 2024-09-13T06:43:08.168 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 166.567523225, 2024-09-13T06:43:08.168 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.080747474999999999, 2024-09-13T06:43:08.168 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:08.168 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:08.168 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:08.169 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:08.169 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:08.169 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43301 2024-09-13T06:43:08.169 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.169 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:08.169 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.169 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:08.169 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589934+0000", 2024-09-13T06:43:08.169 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:08.169 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.169 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.169 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:08.169 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589934+0000", 2024-09-13T06:43:08.169 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:08.170 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.170 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.170 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:08.170 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589933+0000", 2024-09-13T06:43:08.170 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:08.170 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.170 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.170 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:08.170 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589936+0000", 2024-09-13T06:43:08.170 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.4599999999999999e-06 2024-09-13T06:43:08.170 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.170 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.170 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:08.170 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589945+0000", 2024-09-13T06:43:08.171 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.2430000000000005e-06 2024-09-13T06:43:08.171 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.171 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.171 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:08.171 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589952+0000", 2024-09-13T06:43:08.171 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.3289999999999996e-06 2024-09-13T06:43:08.171 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.171 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.171 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:08.171 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.670280+0000", 2024-09-13T06:43:08.171 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.080328514000000004 2024-09-13T06:43:08.171 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.171 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.172 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:08.172 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.670376+0000", 2024-09-13T06:43:08.172 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.5752000000000001e-05 2024-09-13T06:43:08.172 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.172 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.172 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:08.172 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.670681+0000", 2024-09-13T06:43:08.172 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00030479699999999999 2024-09-13T06:43:08.172 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:08.172 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:08.172 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:08.172 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.172 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.173 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43302 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 475136~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:43:08.173 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589958+0000", 2024-09-13T06:43:08.173 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 166.56749916300001, 2024-09-13T06:43:08.173 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.081402394000000003, 2024-09-13T06:43:08.173 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:08.173 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:08.173 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:08.173 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:08.173 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:08.173 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43302 2024-09-13T06:43:08.173 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.173 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:08.174 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.174 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:08.174 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589958+0000", 2024-09-13T06:43:08.174 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:08.174 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.174 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.174 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:08.174 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589958+0000", 2024-09-13T06:43:08.174 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:08.174 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.174 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.174 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:08.174 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589957+0000", 2024-09-13T06:43:08.174 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:08.175 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.175 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.175 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:08.175 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589960+0000", 2024-09-13T06:43:08.175 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.4939999999999999e-06 2024-09-13T06:43:08.175 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.175 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.175 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:08.175 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589969+0000", 2024-09-13T06:43:08.175 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.3520000000000007e-06 2024-09-13T06:43:08.175 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.175 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.175 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:08.175 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589976+0000", 2024-09-13T06:43:08.176 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.3030000000000002e-06 2024-09-13T06:43:08.176 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.176 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.176 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:08.176 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.670765+0000", 2024-09-13T06:43:08.176 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.080789154000000002 2024-09-13T06:43:08.176 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.176 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.176 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:08.176 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.670960+0000", 2024-09-13T06:43:08.176 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00019464300000000001 2024-09-13T06:43:08.176 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.176 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.176 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:08.176 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.671360+0000", 2024-09-13T06:43:08.177 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00040005200000000002 2024-09-13T06:43:08.177 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:08.177 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:08.177 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:08.177 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.177 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.177 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43303 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 489472~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:43:08.177 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589985+0000", 2024-09-13T06:43:08.178 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 166.56747221500001, 2024-09-13T06:43:08.178 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.082024333000000005, 2024-09-13T06:43:08.178 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:08.178 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:08.178 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:08.178 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:08.178 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:08.178 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43303 2024-09-13T06:43:08.178 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.178 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:08.178 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.178 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:08.178 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589985+0000", 2024-09-13T06:43:08.178 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:08.179 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.179 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.179 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:08.179 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589985+0000", 2024-09-13T06:43:08.179 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:08.179 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.179 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.179 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:08.179 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589984+0000", 2024-09-13T06:43:08.179 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:43:08.179 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.179 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.180 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:08.180 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589987+0000", 2024-09-13T06:43:08.180 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.726e-06 2024-09-13T06:43:08.180 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.180 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.180 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:08.180 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589996+0000", 2024-09-13T06:43:08.180 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.5459999999999992e-06 2024-09-13T06:43:08.180 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.180 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.180 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:08.180 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590003+0000", 2024-09-13T06:43:08.180 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.4229999999999999e-06 2024-09-13T06:43:08.181 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.181 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.181 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:08.181 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.671426+0000", 2024-09-13T06:43:08.181 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.081422704999999998 2024-09-13T06:43:08.181 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.181 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.181 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:08.181 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.671615+0000", 2024-09-13T06:43:08.181 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000188875 2024-09-13T06:43:08.181 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.181 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.181 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:08.182 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.672009+0000", 2024-09-13T06:43:08.182 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000394015 2024-09-13T06:43:08.182 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:08.182 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:08.182 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:08.182 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.182 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.182 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43304 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 503808~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:43:08.182 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.590039+0000", 2024-09-13T06:43:08.182 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 166.56741767, 2024-09-13T06:43:08.182 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.082573880000000002, 2024-09-13T06:43:08.182 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:08.182 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:08.182 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:08.183 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:08.183 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:08.183 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43304 2024-09-13T06:43:08.183 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.183 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:08.183 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.183 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:08.183 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590039+0000", 2024-09-13T06:43:08.183 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:08.183 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.183 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.183 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:08.183 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590039+0000", 2024-09-13T06:43:08.184 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:08.184 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.184 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.184 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:08.184 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590038+0000", 2024-09-13T06:43:08.184 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:43:08.184 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.184 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.184 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:08.184 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590042+0000", 2024-09-13T06:43:08.184 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.9500000000000003e-06 2024-09-13T06:43:08.184 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.184 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.185 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:08.185 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590052+0000", 2024-09-13T06:43:08.185 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.3919999999999992e-06 2024-09-13T06:43:08.185 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.185 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.185 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:08.185 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590059+0000", 2024-09-13T06:43:08.185 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.7970000000000001e-06 2024-09-13T06:43:08.185 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.185 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.185 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:08.185 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.672078+0000", 2024-09-13T06:43:08.185 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.082018778000000001 2024-09-13T06:43:08.186 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.186 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.186 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:08.186 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.672266+0000", 2024-09-13T06:43:08.186 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00018807399999999999 2024-09-13T06:43:08.186 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.186 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.186 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:08.186 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.672613+0000", 2024-09-13T06:43:08.186 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00034677599999999997 2024-09-13T06:43:08.186 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:08.186 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:08.186 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:08.186 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.187 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.187 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43305 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 518144~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:43:08.187 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.590136+0000", 2024-09-13T06:43:08.187 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 166.56732048200001, 2024-09-13T06:43:08.187 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.082988206999999994, 2024-09-13T06:43:08.187 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:08.187 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:08.187 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:08.187 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:08.187 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:08.187 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43305 2024-09-13T06:43:08.187 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.187 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:08.188 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.188 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:08.188 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590136+0000", 2024-09-13T06:43:08.188 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:08.188 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.188 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.188 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:08.188 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590136+0000", 2024-09-13T06:43:08.188 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:08.188 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.188 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.188 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:08.189 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590135+0000", 2024-09-13T06:43:08.189 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:43:08.189 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.189 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.189 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:08.189 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590139+0000", 2024-09-13T06:43:08.189 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.9489999999999998e-06 2024-09-13T06:43:08.189 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.189 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.189 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:08.189 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590148+0000", 2024-09-13T06:43:08.189 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.9830000000000002e-06 2024-09-13T06:43:08.189 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.189 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.190 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:08.190 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590156+0000", 2024-09-13T06:43:08.190 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5229999999999998e-06 2024-09-13T06:43:08.190 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.190 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.190 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:08.190 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.672709+0000", 2024-09-13T06:43:08.190 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.082552886000000006 2024-09-13T06:43:08.190 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.190 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.190 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:08.190 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.672816+0000", 2024-09-13T06:43:08.190 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000107736 2024-09-13T06:43:08.191 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.191 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.191 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:08.191 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.673124+0000", 2024-09-13T06:43:08.191 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00030804900000000002 2024-09-13T06:43:08.191 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:08.191 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:08.191 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:08.191 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.191 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.191 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:66818 3.17 3.50afe697 (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e100)", 2024-09-13T06:43:08.191 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:53.498942+0000", 2024-09-13T06:43:08.192 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 134.65851429700001, 2024-09-13T06:43:08.192 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.011231284, 2024-09-13T06:43:08.192 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:08.192 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:43:08.192 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:08.192 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:08.192 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:08.192 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 66818 2024-09-13T06:43:08.192 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.192 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:08.192 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.193 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:08.193 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:53.498942+0000", 2024-09-13T06:43:08.193 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:08.193 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.193 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.193 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:08.193 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:53.498942+0000", 2024-09-13T06:43:08.193 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:08.193 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.193 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.193 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:08.193 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:53.498939+0000", 2024-09-13T06:43:08.193 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999967 2024-09-13T06:43:08.194 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.194 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.194 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:08.194 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:53.498954+0000", 2024-09-13T06:43:08.194 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5028000000000001e-05 2024-09-13T06:43:08.194 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.194 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.194 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:08.194 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:53.498986+0000", 2024-09-13T06:43:08.194 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.1993999999999999e-05 2024-09-13T06:43:08.194 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.194 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.194 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:08.195 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:53.499001+0000", 2024-09-13T06:43:08.195 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5166e-05 2024-09-13T06:43:08.195 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.195 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.195 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:08.195 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:53.505097+0000", 2024-09-13T06:43:08.195 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0060955610000000002 2024-09-13T06:43:08.195 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.195 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.195 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:43:08.195 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:53.505108+0000", 2024-09-13T06:43:08.195 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.084e-05 2024-09-13T06:43:08.195 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.195 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.195 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:08.196 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:54.510158+0000", 2024-09-13T06:43:08.196 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0050497549999999 2024-09-13T06:43:08.196 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.196 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.196 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:08.196 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:54.510174+0000", 2024-09-13T06:43:08.196 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6164e-05 2024-09-13T06:43:08.196 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:08.196 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:08.196 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:08.196 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.196 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.196 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:69764 3.2 3:47f10058:::rbd_data.11214956a993.0000000000000004:head [write-same] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e117)", 2024-09-13T06:43:08.197 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:41:11.371147+0000", 2024-09-13T06:43:08.197 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 116.786309987, 2024-09-13T06:43:08.197 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.03470167, 2024-09-13T06:43:08.197 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:08.197 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:43:08.197 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:08.197 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:08.197 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:08.197 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 69764 2024-09-13T06:43:08.197 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.197 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:08.197 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.197 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:08.198 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:11.371147+0000", 2024-09-13T06:43:08.198 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:08.198 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.198 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.198 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:08.198 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:11.371147+0000", 2024-09-13T06:43:08.198 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:08.198 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.198 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.198 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:08.198 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:11.371144+0000", 2024-09-13T06:43:08.198 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999967 2024-09-13T06:43:08.198 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.199 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.199 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:08.199 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:11.371161+0000", 2024-09-13T06:43:08.199 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7669e-05 2024-09-13T06:43:08.199 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.199 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.199 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:08.199 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:11.371198+0000", 2024-09-13T06:43:08.199 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.7014000000000002e-05 2024-09-13T06:43:08.199 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.199 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.199 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:08.199 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:11.371216+0000", 2024-09-13T06:43:08.199 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7425e-05 2024-09-13T06:43:08.200 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.200 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.200 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:08.200 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:11.371365+0000", 2024-09-13T06:43:08.200 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000149245 2024-09-13T06:43:08.200 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.200 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.200 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op must wait for map", 2024-09-13T06:43:08.200 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:11.371385+0000", 2024-09-13T06:43:08.200 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.0018999999999999e-05 2024-09-13T06:43:08.200 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.201 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.201 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:08.201 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:11.378406+0000", 2024-09-13T06:43:08.201 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0070207179999999996 2024-09-13T06:43:08.201 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.201 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.201 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:43:08.201 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:11.378429+0000", 2024-09-13T06:43:08.201 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.3453999999999999e-05 2024-09-13T06:43:08.201 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.201 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.201 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:08.201 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:12.405667+0000", 2024-09-13T06:43:08.202 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0272381690000001 2024-09-13T06:43:08.202 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.202 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.202 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:08.202 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:12.405848+0000", 2024-09-13T06:43:08.202 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00018112 2024-09-13T06:43:08.202 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:08.202 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:08.202 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:08.202 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.202 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.202 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:70346 3.16 3:69d35907:::rbd_object_map.11214956a993:head [read 0~36] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e122)", 2024-09-13T06:43:08.202 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:41:16.390917+0000", 2024-09-13T06:43:08.203 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 111.766539935, 2024-09-13T06:43:08.203 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.99327479799999996, 2024-09-13T06:43:08.203 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:08.203 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:08.203 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:08.203 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:08.203 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:08.203 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 70346 2024-09-13T06:43:08.203 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.203 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:08.203 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.204 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:08.204 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:16.390917+0000", 2024-09-13T06:43:08.204 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:08.204 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.204 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.204 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:08.204 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:16.390917+0000", 2024-09-13T06:43:08.204 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:08.204 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.204 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.204 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:08.204 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:16.390916+0000", 2024-09-13T06:43:08.204 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999986 2024-09-13T06:43:08.204 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.205 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.205 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:08.205 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:16.390922+0000", 2024-09-13T06:43:08.205 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.0480000000000004e-06 2024-09-13T06:43:08.205 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.205 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.205 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:08.205 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:16.390933+0000", 2024-09-13T06:43:08.205 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1387e-05 2024-09-13T06:43:08.205 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.205 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.205 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:08.205 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:16.390939+0000", 2024-09-13T06:43:08.206 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.8039999999999998e-06 2024-09-13T06:43:08.206 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.206 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.206 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:08.206 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:16.390983+0000", 2024-09-13T06:43:08.206 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.4663000000000003e-05 2024-09-13T06:43:08.206 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.206 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.206 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:43:08.206 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:16.390991+0000", 2024-09-13T06:43:08.206 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.8059999999999995e-06 2024-09-13T06:43:08.206 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.206 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.207 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:08.207 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:17.383624+0000", 2024-09-13T06:43:08.207 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.99263277299999997 2024-09-13T06:43:08.207 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.207 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.207 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:08.207 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:17.383891+0000", 2024-09-13T06:43:08.207 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00026717599999999999 2024-09-13T06:43:08.207 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.207 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.207 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:08.207 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:17.384192+0000", 2024-09-13T06:43:08.207 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00030047400000000001 2024-09-13T06:43:08.207 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:08.208 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:08.208 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:08.208 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.208 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.208 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:181624 3.1d 3:be5d0ef9:::rbd_data.11218aab7a9c.0000000000000000:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e203)", 2024-09-13T06:43:08.208 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:42:45.701744+0000", 2024-09-13T06:43:08.208 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 22.455713015000001, 2024-09-13T06:43:08.208 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.69964504800000005, 2024-09-13T06:43:08.208 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:08.208 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:08.208 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:08.209 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:08.209 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:08.209 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 181624 2024-09-13T06:43:08.209 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.209 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:08.209 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.209 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:08.209 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.701744+0000", 2024-09-13T06:43:08.209 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:08.209 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.209 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.209 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:08.210 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.701744+0000", 2024-09-13T06:43:08.210 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:08.210 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.210 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.210 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:08.210 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.701741+0000", 2024-09-13T06:43:08.210 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999976 2024-09-13T06:43:08.210 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.210 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.210 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:08.210 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.701754+0000", 2024-09-13T06:43:08.210 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2632999999999999e-05 2024-09-13T06:43:08.210 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.210 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.211 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:08.211 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.701789+0000", 2024-09-13T06:43:08.211 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.4993999999999997e-05 2024-09-13T06:43:08.211 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.211 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.211 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:08.211 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.701806+0000", 2024-09-13T06:43:08.211 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7016000000000001e-05 2024-09-13T06:43:08.211 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.211 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.211 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:08.211 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.701905+0000", 2024-09-13T06:43:08.211 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.8895999999999996e-05 2024-09-13T06:43:08.211 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.212 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.212 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:43:08.212 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.701920+0000", 2024-09-13T06:43:08.212 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5013e-05 2024-09-13T06:43:08.212 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.212 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.212 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:08.212 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.400672+0000", 2024-09-13T06:43:08.212 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.69875254499999995 2024-09-13T06:43:08.212 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.212 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.212 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:08.212 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.401034+0000", 2024-09-13T06:43:08.213 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00036181700000000001 2024-09-13T06:43:08.213 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.213 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.213 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:08.213 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.401389+0000", 2024-09-13T06:43:08.213 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00035464399999999999 2024-09-13T06:43:08.213 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:08.213 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:08.213 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:08.213 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.213 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.213 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:181638 3.1d 3:be5d0ef9:::rbd_data.11218aab7a9c.0000000000000000:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e203)", 2024-09-13T06:43:08.213 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:42:45.707356+0000", 2024-09-13T06:43:08.214 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 22.450100276000001, 2024-09-13T06:43:08.214 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.694720479, 2024-09-13T06:43:08.214 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:08.214 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:08.214 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:08.214 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:08.214 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:08.214 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 181638 2024-09-13T06:43:08.214 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.214 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:08.214 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.214 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:08.214 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707356+0000", 2024-09-13T06:43:08.214 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:08.215 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.215 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.215 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:08.215 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707356+0000", 2024-09-13T06:43:08.215 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:08.215 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.215 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.215 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:08.215 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707355+0000", 2024-09-13T06:43:08.215 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999981 2024-09-13T06:43:08.215 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.215 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.215 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:08.215 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707375+0000", 2024-09-13T06:43:08.215 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.0698000000000001e-05 2024-09-13T06:43:08.216 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.216 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.216 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:08.216 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707396+0000", 2024-09-13T06:43:08.216 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.1041000000000001e-05 2024-09-13T06:43:08.216 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.216 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.216 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:08.216 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707408+0000", 2024-09-13T06:43:08.216 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1583000000000001e-05 2024-09-13T06:43:08.216 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.216 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.216 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:08.216 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707513+0000", 2024-09-13T06:43:08.217 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000104981 2024-09-13T06:43:08.217 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.217 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.217 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:43:08.217 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707541+0000", 2024-09-13T06:43:08.217 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.8572999999999999e-05 2024-09-13T06:43:08.217 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.217 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.217 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:08.217 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.401666+0000", 2024-09-13T06:43:08.217 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.694124988 2024-09-13T06:43:08.217 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.217 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.218 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:08.218 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.401880+0000", 2024-09-13T06:43:08.218 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00021322100000000001 2024-09-13T06:43:08.218 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.218 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.218 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:08.218 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.402077+0000", 2024-09-13T06:43:08.218 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000197321 2024-09-13T06:43:08.218 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:08.218 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:08.218 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:08.218 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.218 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.218 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:181652 3.1d 3:be5d0ef9:::rbd_data.11218aab7a9c.0000000000000000:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e203)", 2024-09-13T06:43:08.219 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:42:45.707423+0000", 2024-09-13T06:43:08.219 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 22.450033744999999, 2024-09-13T06:43:08.219 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.69480806699999997, 2024-09-13T06:43:08.219 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:08.219 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:08.219 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:08.219 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:08.219 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:08.219 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 181652 2024-09-13T06:43:08.219 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.219 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:08.219 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.219 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:08.220 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707423+0000", 2024-09-13T06:43:08.220 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:08.220 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.220 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.220 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:08.220 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707423+0000", 2024-09-13T06:43:08.220 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:08.220 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.220 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.220 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:08.220 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707423+0000", 2024-09-13T06:43:08.220 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:08.220 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.220 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.221 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:08.221 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707427+0000", 2024-09-13T06:43:08.221 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.2010000000000001e-06 2024-09-13T06:43:08.221 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.221 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.221 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:08.221 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707442+0000", 2024-09-13T06:43:08.221 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.4993e-05 2024-09-13T06:43:08.221 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.221 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.221 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:08.221 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707447+0000", 2024-09-13T06:43:08.222 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.2170000000000002e-06 2024-09-13T06:43:08.222 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.222 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.222 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:08.222 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707656+0000", 2024-09-13T06:43:08.222 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00020908600000000001 2024-09-13T06:43:08.222 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.222 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.222 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:43:08.222 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707684+0000", 2024-09-13T06:43:08.222 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.7766000000000001e-05 2024-09-13T06:43:08.222 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.222 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.223 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:08.223 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.402101+0000", 2024-09-13T06:43:08.223 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.69441698100000004 2024-09-13T06:43:08.223 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.223 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.223 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:08.223 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.402156+0000", 2024-09-13T06:43:08.223 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.4725000000000002e-05 2024-09-13T06:43:08.223 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.223 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.223 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:08.223 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.402231+0000", 2024-09-13T06:43:08.224 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5587999999999995e-05 2024-09-13T06:43:08.224 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:08.224 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:08.224 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:08.224 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.224 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.224 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:181666 3.1d 3:be5d0ef9:::rbd_data.11218aab7a9c.0000000000000000:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e203)", 2024-09-13T06:43:08.224 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:42:45.707478+0000", 2024-09-13T06:43:08.224 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 22.449978559000002, 2024-09-13T06:43:08.224 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.69543359900000001, 2024-09-13T06:43:08.224 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:08.224 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:08.225 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:08.225 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:08.225 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:08.225 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 181666 2024-09-13T06:43:08.225 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.225 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:08.225 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.225 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:08.225 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707478+0000", 2024-09-13T06:43:08.225 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:08.225 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.225 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.225 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:08.226 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707478+0000", 2024-09-13T06:43:08.226 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:08.226 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.226 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.226 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:08.226 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707478+0000", 2024-09-13T06:43:08.226 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:08.226 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.226 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.226 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:08.226 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707481+0000", 2024-09-13T06:43:08.226 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.3589999999999999e-06 2024-09-13T06:43:08.226 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.227 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.227 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:08.227 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707492+0000", 2024-09-13T06:43:08.227 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0725e-05 2024-09-13T06:43:08.227 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.227 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.227 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:08.227 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707500+0000", 2024-09-13T06:43:08.227 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.1089999999999998e-06 2024-09-13T06:43:08.227 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.227 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.227 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:08.227 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707773+0000", 2024-09-13T06:43:08.227 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000273291 2024-09-13T06:43:08.228 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.228 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.228 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:43:08.228 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707784+0000", 2024-09-13T06:43:08.228 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0441999999999999e-05 2024-09-13T06:43:08.228 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.228 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.228 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:08.228 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.402290+0000", 2024-09-13T06:43:08.228 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.69450651500000005 2024-09-13T06:43:08.228 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.228 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.228 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:08.229 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.402489+0000", 2024-09-13T06:43:08.229 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000198999 2024-09-13T06:43:08.229 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.229 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.229 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:08.229 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.402912+0000", 2024-09-13T06:43:08.229 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00042257299999999998 2024-09-13T06:43:08.229 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:08.229 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:08.229 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:08.229 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.229 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.229 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:181680 3.1d 3:be5d0ef9:::rbd_data.11218aab7a9c.0000000000000000:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e203)", 2024-09-13T06:43:08.230 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:42:45.707517+0000", 2024-09-13T06:43:08.230 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 22.449939523000001, 2024-09-13T06:43:08.230 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.69532440799999995, 2024-09-13T06:43:08.230 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:08.230 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:08.230 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:08.230 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:08.230 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:08.230 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 181680 2024-09-13T06:43:08.230 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.230 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:08.230 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.230 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:08.231 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707517+0000", 2024-09-13T06:43:08.231 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:08.231 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.231 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.231 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:08.231 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707517+0000", 2024-09-13T06:43:08.231 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:08.231 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.231 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.231 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:08.231 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707517+0000", 2024-09-13T06:43:08.231 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:08.231 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.231 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.232 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:08.232 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707519+0000", 2024-09-13T06:43:08.232 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.2800000000000002e-06 2024-09-13T06:43:08.232 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.232 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.232 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:08.232 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707527+0000", 2024-09-13T06:43:08.232 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.2660000000000001e-06 2024-09-13T06:43:08.232 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.232 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.232 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:08.232 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707535+0000", 2024-09-13T06:43:08.233 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.1760000000000004e-06 2024-09-13T06:43:08.233 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.233 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.233 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:08.233 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707838+0000", 2024-09-13T06:43:08.233 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00030318000000000001 2024-09-13T06:43:08.233 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.233 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.233 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:43:08.233 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707850+0000", 2024-09-13T06:43:08.233 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1787000000000001e-05 2024-09-13T06:43:08.233 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.233 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.234 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:08.234 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.402702+0000", 2024-09-13T06:43:08.234 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.69485264599999996 2024-09-13T06:43:08.234 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.234 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.234 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:08.234 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.402783+0000", 2024-09-13T06:43:08.234 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.1114999999999998e-05 2024-09-13T06:43:08.234 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.234 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.234 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:08.234 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.402842+0000", 2024-09-13T06:43:08.235 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.8322999999999997e-05 2024-09-13T06:43:08.235 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:08.235 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:08.235 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:08.235 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.235 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.235 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:181694 3.1d 3:be5d0ef9:::rbd_data.11218aab7a9c.0000000000000000:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e203)", 2024-09-13T06:43:08.235 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:42:45.707544+0000", 2024-09-13T06:43:08.235 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 22.449912830999999, 2024-09-13T06:43:08.235 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.69580726699999995, 2024-09-13T06:43:08.235 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:08.235 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:08.235 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:08.236 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:08.236 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:08.236 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 181694 2024-09-13T06:43:08.236 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.236 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:08.236 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.236 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:08.236 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707544+0000", 2024-09-13T06:43:08.236 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:08.236 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.236 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.236 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:08.236 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707544+0000", 2024-09-13T06:43:08.237 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:08.237 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.237 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.237 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:08.237 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707543+0000", 2024-09-13T06:43:08.237 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:08.237 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.237 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.237 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:08.237 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707561+0000", 2024-09-13T06:43:08.237 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7804000000000001e-05 2024-09-13T06:43:08.237 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.238 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.238 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:08.238 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707575+0000", 2024-09-13T06:43:08.238 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3884e-05 2024-09-13T06:43:08.238 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.238 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.238 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:08.238 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707583+0000", 2024-09-13T06:43:08.238 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5730000000000002e-06 2024-09-13T06:43:08.238 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.238 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.238 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:08.238 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707899+0000", 2024-09-13T06:43:08.238 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00031663999999999998 2024-09-13T06:43:08.239 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.239 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.239 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:43:08.239 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707908+0000", 2024-09-13T06:43:08.239 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.1430000000000004e-06 2024-09-13T06:43:08.239 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.239 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.239 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:08.239 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.402973+0000", 2024-09-13T06:43:08.239 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.69506426099999996 2024-09-13T06:43:08.239 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.239 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.240 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:08.240 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.403155+0000", 2024-09-13T06:43:08.240 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00018245199999999999 2024-09-13T06:43:08.240 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.240 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.240 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:08.240 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.403351+0000", 2024-09-13T06:43:08.240 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000196028 2024-09-13T06:43:08.240 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:08.240 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:08.240 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:08.240 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.240 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.240 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:181708 3.1d 3:be5d0ef9:::rbd_data.11218aab7a9c.0000000000000000:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e203)", 2024-09-13T06:43:08.241 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:42:45.707622+0000", 2024-09-13T06:43:08.241 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 22.449834787, 2024-09-13T06:43:08.241 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.69603707699999995, 2024-09-13T06:43:08.241 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:08.241 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:08.241 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:08.241 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:08.241 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:08.241 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 181708 2024-09-13T06:43:08.241 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.241 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:08.241 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.241 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:08.242 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707622+0000", 2024-09-13T06:43:08.242 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:08.242 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.242 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.242 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:08.242 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707622+0000", 2024-09-13T06:43:08.242 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:08.242 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.242 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.242 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:08.242 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707621+0000", 2024-09-13T06:43:08.242 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:08.242 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.243 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.243 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:08.243 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707624+0000", 2024-09-13T06:43:08.243 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.8210000000000002e-06 2024-09-13T06:43:08.243 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.243 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.243 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:08.243 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707631+0000", 2024-09-13T06:43:08.243 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.8460000000000002e-06 2024-09-13T06:43:08.243 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.243 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.243 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:08.243 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707635+0000", 2024-09-13T06:43:08.244 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.4610000000000001e-06 2024-09-13T06:43:08.244 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.244 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.244 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:08.244 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707955+0000", 2024-09-13T06:43:08.244 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00031982000000000001 2024-09-13T06:43:08.244 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.244 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.244 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:43:08.244 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707966+0000", 2024-09-13T06:43:08.244 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0822000000000001e-05 2024-09-13T06:43:08.244 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.244 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.245 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:08.245 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.403541+0000", 2024-09-13T06:43:08.245 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.69557444300000004 2024-09-13T06:43:08.245 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.245 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.245 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:08.245 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.403598+0000", 2024-09-13T06:43:08.245 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.7147e-05 2024-09-13T06:43:08.245 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.245 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.245 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:08.245 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.403659+0000", 2024-09-13T06:43:08.245 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.1373999999999999e-05 2024-09-13T06:43:08.246 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:08.246 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:08.246 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:08.246 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.246 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.246 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:181722 3.1d 3:be5d0ef9:::rbd_data.11218aab7a9c.0000000000000000:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e203)", 2024-09-13T06:43:08.246 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:42:45.707640+0000", 2024-09-13T06:43:08.246 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 22.449816336000001, 2024-09-13T06:43:08.246 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.69620305800000004, 2024-09-13T06:43:08.246 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:08.246 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:08.246 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:08.246 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:08.246 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:08.247 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 181722 2024-09-13T06:43:08.247 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.247 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:08.247 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.247 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:08.247 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707640+0000", 2024-09-13T06:43:08.247 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:08.247 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.247 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.247 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:08.247 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707640+0000", 2024-09-13T06:43:08.247 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:08.247 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.248 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.248 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:08.248 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707640+0000", 2024-09-13T06:43:08.248 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:08.248 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.248 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.248 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:08.248 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707643+0000", 2024-09-13T06:43:08.248 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.213e-06 2024-09-13T06:43:08.248 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.248 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.249 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:08.249 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707651+0000", 2024-09-13T06:43:08.249 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.2290000000000003e-06 2024-09-13T06:43:08.249 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.249 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.249 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:08.249 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707656+0000", 2024-09-13T06:43:08.249 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.9320000000000004e-06 2024-09-13T06:43:08.249 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.249 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.249 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:08.249 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.708012+0000", 2024-09-13T06:43:08.249 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00035600600000000002 2024-09-13T06:43:08.250 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.250 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.250 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:43:08.250 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.708024+0000", 2024-09-13T06:43:08.250 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1336e-05 2024-09-13T06:43:08.250 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.250 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.250 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:08.250 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.403696+0000", 2024-09-13T06:43:08.250 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.69567234499999997 2024-09-13T06:43:08.250 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.250 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.251 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:08.251 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.403757+0000", 2024-09-13T06:43:08.251 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.0715999999999999e-05 2024-09-13T06:43:08.251 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.251 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.251 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:08.251 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.403843+0000", 2024-09-13T06:43:08.251 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6679000000000001e-05 2024-09-13T06:43:08.251 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:08.251 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:08.251 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:08.251 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.251 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.252 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:181736 3.1d 3:be5d0ef9:::rbd_data.11218aab7a9c.0000000000000000:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e203)", 2024-09-13T06:43:08.252 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:42:45.707661+0000", 2024-09-13T06:43:08.252 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 22.449795969, 2024-09-13T06:43:08.252 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.69667210700000004, 2024-09-13T06:43:08.252 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:08.252 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:08.252 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:08.252 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:08.252 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:08.252 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 181736 2024-09-13T06:43:08.252 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.252 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:08.252 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.253 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:08.253 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707661+0000", 2024-09-13T06:43:08.253 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:08.253 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.253 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.253 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:08.253 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707661+0000", 2024-09-13T06:43:08.253 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:08.253 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.253 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.253 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:08.253 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707660+0000", 2024-09-13T06:43:08.253 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:08.254 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.254 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.254 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:08.254 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707664+0000", 2024-09-13T06:43:08.254 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.393e-06 2024-09-13T06:43:08.254 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.254 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.254 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:08.254 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707673+0000", 2024-09-13T06:43:08.254 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.5100000000000004e-06 2024-09-13T06:43:08.254 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.254 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.254 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:08.255 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707680+0000", 2024-09-13T06:43:08.255 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.8680000000000001e-06 2024-09-13T06:43:08.255 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.255 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.255 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:08.255 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.708068+0000", 2024-09-13T06:43:08.255 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00038784699999999997 2024-09-13T06:43:08.255 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.255 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.255 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:43:08.255 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.708078+0000", 2024-09-13T06:43:08.255 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.842e-06 2024-09-13T06:43:08.255 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.255 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.256 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:08.256 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.403924+0000", 2024-09-13T06:43:08.256 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.69584657699999997 2024-09-13T06:43:08.256 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.256 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.256 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:08.256 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.404135+0000", 2024-09-13T06:43:08.256 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000210662 2024-09-13T06:43:08.256 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.256 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.256 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:08.256 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.404333+0000", 2024-09-13T06:43:08.256 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00019787900000000001 2024-09-13T06:43:08.256 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:08.257 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:08.257 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:08.257 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.257 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.257 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:181750 3.1d 3.9f70ba7d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e203)", 2024-09-13T06:43:08.257 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:42:45.707687+0000", 2024-09-13T06:43:08.257 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 22.449770105999999, 2024-09-13T06:43:08.257 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.69667232199999996, 2024-09-13T06:43:08.257 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:08.257 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:43:08.257 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:08.257 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:08.257 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:08.258 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 181750 2024-09-13T06:43:08.258 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.258 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:08.258 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.258 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:08.258 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707687+0000", 2024-09-13T06:43:08.258 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:08.258 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.258 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.258 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:08.258 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707687+0000", 2024-09-13T06:43:08.258 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:08.258 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.259 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.259 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:08.259 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707686+0000", 2024-09-13T06:43:08.259 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:08.259 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.259 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.259 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:08.259 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707689+0000", 2024-09-13T06:43:08.259 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.824e-06 2024-09-13T06:43:08.259 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.259 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.259 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:08.259 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707693+0000", 2024-09-13T06:43:08.259 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.5900000000000001e-06 2024-09-13T06:43:08.260 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.260 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.260 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:08.260 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707697+0000", 2024-09-13T06:43:08.260 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.6899999999999998e-06 2024-09-13T06:43:08.260 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.260 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.260 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:08.260 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.708109+0000", 2024-09-13T06:43:08.260 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00041220200000000002 2024-09-13T06:43:08.260 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.260 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.260 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:43:08.260 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.708118+0000", 2024-09-13T06:43:08.261 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6000000000000007e-06 2024-09-13T06:43:08.261 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.261 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.261 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:08.261 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.404353+0000", 2024-09-13T06:43:08.261 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.69623486400000001 2024-09-13T06:43:08.261 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.261 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.261 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:08.261 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.404359+0000", 2024-09-13T06:43:08.261 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.2480000000000001e-06 2024-09-13T06:43:08.261 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:08.261 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:08.261 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:08.262 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:08.262 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:08.262 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:43:08.263 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-13T06:43:08.264 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:43:08.261+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:43:08.363 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:43:08.361+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:43:08.408 INFO:teuthology.orchestra.run.smithi081.stderr:noscrub is unset 2024-09-13T06:43:08.464 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:43:08.464+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:43:08.470 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:43:08.470 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [], 2024-09-13T06:43:08.470 INFO:teuthology.orchestra.run.smithi139.stdout: "num_ops": 0 2024-09-13T06:43:08.470 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:43:08.488 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-13T06:43:08.580 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-13T06:43:08.581+0000 7fa8bb18e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 36790) UID: 0 2024-09-13T06:43:08.666 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:43:08.668+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:43:08.681 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:43:08.681 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [], 2024-09-13T06:43:08.681 INFO:teuthology.orchestra.run.smithi139.stdout: "complaint_time": 30, 2024-09-13T06:43:08.682 INFO:teuthology.orchestra.run.smithi139.stdout: "num_blocked_ops": 0 2024-09-13T06:43:08.682 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:43:08.697 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-13T06:43:08.767 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:43:08.768+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:43:08.868 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:43:08.868+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:43:08.874 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:43:08.874 INFO:teuthology.orchestra.run.smithi139.stdout: "size": 20, 2024-09-13T06:43:08.874 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 600, 2024-09-13T06:43:08.874 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [ 2024-09-13T06:43:08.874 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.874 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:176089 3.11 3:8b97f15f:::rbd_data.1121a23b99f7.0000000000000000:head [write 0~4194304 [fadvise_sequential+fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e196)", 2024-09-13T06:43:08.874 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:42:36.707298+0000", 2024-09-13T06:43:08.874 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 32.166486351000003, 2024-09-13T06:43:08.874 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.053333426000000003, 2024-09-13T06:43:08.874 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:08.875 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:43:08.875 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:08.875 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:08.875 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:08.875 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 176089 2024-09-13T06:43:08.875 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.875 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:08.875 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.875 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:08.875 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.707298+0000", 2024-09-13T06:43:08.875 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:08.875 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.875 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.875 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:08.876 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.707298+0000", 2024-09-13T06:43:08.876 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:08.876 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.876 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.876 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:08.876 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.707296+0000", 2024-09-13T06:43:08.876 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999976 2024-09-13T06:43:08.876 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.876 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.876 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:08.876 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.717511+0000", 2024-09-13T06:43:08.877 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.010215218999999999 2024-09-13T06:43:08.877 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.877 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.877 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:08.877 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.717555+0000", 2024-09-13T06:43:08.877 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.4159000000000002e-05 2024-09-13T06:43:08.877 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.877 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.877 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:08.877 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.717569+0000", 2024-09-13T06:43:08.877 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3543999999999999e-05 2024-09-13T06:43:08.877 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.877 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.878 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:08.878 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.717677+0000", 2024-09-13T06:43:08.878 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00010798699999999999 2024-09-13T06:43:08.878 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.878 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.878 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:08.878 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.717896+0000", 2024-09-13T06:43:08.878 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000219466 2024-09-13T06:43:08.878 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.878 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.878 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 4", 2024-09-13T06:43:08.878 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.718090+0000", 2024-09-13T06:43:08.878 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00019322799999999999 2024-09-13T06:43:08.879 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.879 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.879 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:43:08.879 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.751403+0000", 2024-09-13T06:43:08.879 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.033313493 2024-09-13T06:43:08.879 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.879 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.879 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-13T06:43:08.879 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.760523+0000", 2024-09-13T06:43:08.879 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0091197150000000005 2024-09-13T06:43:08.879 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.879 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.879 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-13T06:43:08.880 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.760581+0000", 2024-09-13T06:43:08.880 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.8007999999999998e-05 2024-09-13T06:43:08.880 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.880 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.880 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:08.880 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.760632+0000", 2024-09-13T06:43:08.880 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.1085999999999998e-05 2024-09-13T06:43:08.880 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:08.881 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:08.881 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:08.881 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.881 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.881 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:176090 3.e 3:77f86bf9:::rbd_data.1121a23b99f7.0000000000000001:head [write 0~4194304 [fadvise_sequential+fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e196)", 2024-09-13T06:43:08.881 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:42:36.717590+0000", 2024-09-13T06:43:08.881 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 32.156194868999997, 2024-09-13T06:43:08.881 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.049445965000000001, 2024-09-13T06:43:08.881 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:08.881 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:43:08.881 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:08.881 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:08.881 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:08.882 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 176090 2024-09-13T06:43:08.882 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.882 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:08.882 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.882 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:08.882 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.717590+0000", 2024-09-13T06:43:08.882 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:08.882 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.882 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.882 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:08.882 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.717590+0000", 2024-09-13T06:43:08.882 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:08.882 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.883 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.883 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:08.883 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.717588+0000", 2024-09-13T06:43:08.883 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999981 2024-09-13T06:43:08.883 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.883 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.883 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:08.883 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.723934+0000", 2024-09-13T06:43:08.883 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0063462589999999999 2024-09-13T06:43:08.883 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.883 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.883 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:08.883 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.723960+0000", 2024-09-13T06:43:08.884 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.6251e-05 2024-09-13T06:43:08.884 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.884 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.884 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:08.884 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.723976+0000", 2024-09-13T06:43:08.884 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5277e-05 2024-09-13T06:43:08.884 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.884 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.884 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:08.884 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.724154+0000", 2024-09-13T06:43:08.884 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00017814400000000001 2024-09-13T06:43:08.884 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.884 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.885 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:08.885 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.724534+0000", 2024-09-13T06:43:08.885 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00038054799999999998 2024-09-13T06:43:08.885 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.885 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.885 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-13T06:43:08.885 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.724926+0000", 2024-09-13T06:43:08.885 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00039199100000000001 2024-09-13T06:43:08.885 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.885 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.885 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:43:08.885 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.744509+0000", 2024-09-13T06:43:08.885 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.019582977000000001 2024-09-13T06:43:08.886 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.886 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.886 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-13T06:43:08.886 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.766937+0000", 2024-09-13T06:43:08.886 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.022427765999999998 2024-09-13T06:43:08.886 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.886 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.886 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-13T06:43:08.886 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.766987+0000", 2024-09-13T06:43:08.886 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.9898000000000002e-05 2024-09-13T06:43:08.886 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.886 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.887 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:08.887 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.767036+0000", 2024-09-13T06:43:08.887 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.8782000000000002e-05 2024-09-13T06:43:08.887 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:08.887 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:08.887 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:08.887 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.887 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.887 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:176094 3.f 3:f5ca80c1:::rbd_data.1121a23b99f7.0000000000000004:head [write 0~4194304 [fadvise_sequential+fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e196)", 2024-09-13T06:43:08.887 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:42:36.724239+0000", 2024-09-13T06:43:08.887 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 32.149545768999999, 2024-09-13T06:43:08.888 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.043501235999999999, 2024-09-13T06:43:08.888 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:08.888 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:43:08.888 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:08.888 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:08.888 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:08.888 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 176094 2024-09-13T06:43:08.888 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.888 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:08.888 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.888 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:08.889 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.724239+0000", 2024-09-13T06:43:08.889 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:08.889 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.889 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.889 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:08.889 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.724239+0000", 2024-09-13T06:43:08.889 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:08.889 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.889 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.889 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:08.889 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.724237+0000", 2024-09-13T06:43:08.890 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999981 2024-09-13T06:43:08.890 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.890 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.890 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:08.890 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.733673+0000", 2024-09-13T06:43:08.890 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0094352700000000008 2024-09-13T06:43:08.890 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.890 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.890 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:08.890 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.733703+0000", 2024-09-13T06:43:08.890 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.0102000000000001e-05 2024-09-13T06:43:08.891 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.891 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.891 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:08.891 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.733718+0000", 2024-09-13T06:43:08.891 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5199e-05 2024-09-13T06:43:08.891 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.891 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.891 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:08.891 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.733780+0000", 2024-09-13T06:43:08.891 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.1691000000000003e-05 2024-09-13T06:43:08.891 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.891 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.892 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:08.892 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.733928+0000", 2024-09-13T06:43:08.892 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000147987 2024-09-13T06:43:08.892 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.892 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.892 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 4", 2024-09-13T06:43:08.892 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.734036+0000", 2024-09-13T06:43:08.892 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000108925 2024-09-13T06:43:08.892 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.892 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.892 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:43:08.892 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.763741+0000", 2024-09-13T06:43:08.892 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.029704151000000002 2024-09-13T06:43:08.893 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.893 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.893 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-13T06:43:08.893 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.767615+0000", 2024-09-13T06:43:08.893 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0038739120000000002 2024-09-13T06:43:08.893 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.893 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.893 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-13T06:43:08.893 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.767693+0000", 2024-09-13T06:43:08.893 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.8573999999999997e-05 2024-09-13T06:43:08.893 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.893 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.894 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:08.894 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.767740+0000", 2024-09-13T06:43:08.894 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.7154000000000003e-05 2024-09-13T06:43:08.894 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:08.894 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:08.894 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:08.894 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.894 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.894 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:205233 3.15 3:a97b2891:::rbd_data.11213650bb32.000000000000002e:head [set-alloc-hint object_size 4194304 write_size 4194304,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e209)", 2024-09-13T06:43:08.894 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:42:52.282586+0000", 2024-09-13T06:43:08.894 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 16.591198925, 2024-09-13T06:43:08.894 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.056996628000000001, 2024-09-13T06:43:08.894 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:08.895 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:43:08.895 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:08.895 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:08.895 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:08.895 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 205233 2024-09-13T06:43:08.895 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.895 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:08.895 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.895 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:08.895 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:52.282586+0000", 2024-09-13T06:43:08.895 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:08.895 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.895 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.895 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:08.895 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:52.282586+0000", 2024-09-13T06:43:08.896 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:08.896 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.896 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.896 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:08.896 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:52.282583+0000", 2024-09-13T06:43:08.896 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999976 2024-09-13T06:43:08.896 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.896 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.896 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:08.896 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:52.282599+0000", 2024-09-13T06:43:08.896 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5065999999999999e-05 2024-09-13T06:43:08.896 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.896 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.896 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:08.897 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:52.282632+0000", 2024-09-13T06:43:08.897 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.3386999999999997e-05 2024-09-13T06:43:08.897 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.897 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.897 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:08.897 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:52.282654+0000", 2024-09-13T06:43:08.897 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.177e-05 2024-09-13T06:43:08.897 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.897 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.897 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:08.897 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:52.282753+0000", 2024-09-13T06:43:08.897 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.9685000000000005e-05 2024-09-13T06:43:08.897 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.898 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.898 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:08.898 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:52.283000+0000", 2024-09-13T06:43:08.898 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000246278 2024-09-13T06:43:08.898 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.898 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.898 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 3", 2024-09-13T06:43:08.898 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:52.292656+0000", 2024-09-13T06:43:08.898 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0096565980000000006 2024-09-13T06:43:08.898 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.898 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.898 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:43:08.898 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:52.339352+0000", 2024-09-13T06:43:08.898 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.046695309999999997 2024-09-13T06:43:08.899 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.899 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.899 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-13T06:43:08.899 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:52.339373+0000", 2024-09-13T06:43:08.899 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.1002999999999999e-05 2024-09-13T06:43:08.899 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.899 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.899 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-13T06:43:08.899 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:52.339464+0000", 2024-09-13T06:43:08.899 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.1131999999999994e-05 2024-09-13T06:43:08.899 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.899 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.899 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:08.899 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:52.339582+0000", 2024-09-13T06:43:08.899 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000118799 2024-09-13T06:43:08.900 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:08.900 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:08.900 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:08.900 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.900 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.900 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:237445 3.15 3:abdd9d42:::rbd_data.1121cb4a09ed.0000000000000008:82 [read 69632~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e224)", 2024-09-13T06:43:08.900 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:43:08.800334+0000", 2024-09-13T06:43:08.900 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.073450517000000007, 2024-09-13T06:43:08.900 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.032345681000000001, 2024-09-13T06:43:08.900 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:08.900 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:08.900 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:08.901 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:08.901 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:08.901 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 237445 2024-09-13T06:43:08.901 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.901 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:08.901 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.901 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:08.901 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800334+0000", 2024-09-13T06:43:08.901 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:08.901 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.901 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.901 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:08.901 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800334+0000", 2024-09-13T06:43:08.901 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:08.901 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.902 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.902 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:08.902 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800334+0000", 2024-09-13T06:43:08.902 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:08.902 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.902 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.902 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:08.902 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800338+0000", 2024-09-13T06:43:08.902 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.9539999999999998e-06 2024-09-13T06:43:08.902 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.902 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.902 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:08.902 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800342+0000", 2024-09-13T06:43:08.902 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.7249999999999999e-06 2024-09-13T06:43:08.903 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.903 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.903 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:08.903 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800345+0000", 2024-09-13T06:43:08.903 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.072e-06 2024-09-13T06:43:08.903 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.903 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.903 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:08.903 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.832482+0000", 2024-09-13T06:43:08.903 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.032137713999999998 2024-09-13T06:43:08.903 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.903 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.903 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:08.903 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.832571+0000", 2024-09-13T06:43:08.904 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.8252999999999997e-05 2024-09-13T06:43:08.904 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.904 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.904 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:08.904 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.832680+0000", 2024-09-13T06:43:08.904 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000109214 2024-09-13T06:43:08.904 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:08.904 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:08.904 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:08.904 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.904 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.904 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:237446 3.15 3:abdd9d42:::rbd_data.1121cb4a09ed.0000000000000008:82 [read 81920~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e224)", 2024-09-13T06:43:08.904 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:43:08.800348+0000", 2024-09-13T06:43:08.904 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.073437116999999996, 2024-09-13T06:43:08.905 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.032454446999999997, 2024-09-13T06:43:08.905 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:08.905 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:08.905 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:08.905 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:08.905 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:08.905 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 237446 2024-09-13T06:43:08.905 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.905 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:08.905 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.905 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:08.905 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800348+0000", 2024-09-13T06:43:08.905 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:08.906 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.906 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.906 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:08.906 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800348+0000", 2024-09-13T06:43:08.906 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:08.906 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.906 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.906 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:08.906 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800347+0000", 2024-09-13T06:43:08.906 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:08.906 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.906 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.906 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:08.907 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800349+0000", 2024-09-13T06:43:08.907 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.452e-06 2024-09-13T06:43:08.907 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.907 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.907 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:08.907 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800354+0000", 2024-09-13T06:43:08.907 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.0350000000000001e-06 2024-09-13T06:43:08.907 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.907 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.907 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:08.907 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800357+0000", 2024-09-13T06:43:08.907 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.179e-06 2024-09-13T06:43:08.907 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.907 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.908 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:08.908 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.832707+0000", 2024-09-13T06:43:08.908 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.032350071000000001 2024-09-13T06:43:08.908 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.908 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.908 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:08.908 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.832748+0000", 2024-09-13T06:43:08.908 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0587000000000003e-05 2024-09-13T06:43:08.908 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.908 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.908 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:08.908 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.832802+0000", 2024-09-13T06:43:08.908 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.4429999999999999e-05 2024-09-13T06:43:08.909 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:08.909 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:08.909 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:08.909 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.909 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.909 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:237447 3.15 3:abdd9d42:::rbd_data.1121cb4a09ed.0000000000000008:82 [read 94208~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e224)", 2024-09-13T06:43:08.909 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:43:08.800360+0000", 2024-09-13T06:43:08.909 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.073425204999999993, 2024-09-13T06:43:08.909 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.032679798000000003, 2024-09-13T06:43:08.909 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:08.909 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:08.909 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:08.909 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:08.910 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:08.910 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 237447 2024-09-13T06:43:08.910 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.910 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:08.910 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.910 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:08.910 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800360+0000", 2024-09-13T06:43:08.910 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:08.910 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.910 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.910 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:08.910 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800360+0000", 2024-09-13T06:43:08.911 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:08.911 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.911 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.911 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:08.911 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800359+0000", 2024-09-13T06:43:08.911 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:08.911 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.911 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.911 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:08.911 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800361+0000", 2024-09-13T06:43:08.911 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.463e-06 2024-09-13T06:43:08.912 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.912 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.912 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:08.912 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800364+0000", 2024-09-13T06:43:08.912 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.6279999999999998e-06 2024-09-13T06:43:08.912 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.912 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.912 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:08.912 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800367+0000", 2024-09-13T06:43:08.912 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.7259999999999998e-06 2024-09-13T06:43:08.912 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.912 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.912 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:08.913 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.832841+0000", 2024-09-13T06:43:08.913 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.032474115999999997 2024-09-13T06:43:08.913 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.913 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.913 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:08.913 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.832929+0000", 2024-09-13T06:43:08.913 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.7886000000000005e-05 2024-09-13T06:43:08.913 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.913 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.913 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:08.913 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.833039+0000", 2024-09-13T06:43:08.914 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00011024200000000001 2024-09-13T06:43:08.914 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:08.914 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:08.914 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:08.914 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.914 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.914 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:237448 3.15 3:abdd9d42:::rbd_data.1121cb4a09ed.0000000000000008:82 [read 106496~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e224)", 2024-09-13T06:43:08.914 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:43:08.800371+0000", 2024-09-13T06:43:08.914 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.073414066, 2024-09-13T06:43:08.914 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.032794221999999998, 2024-09-13T06:43:08.914 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:08.914 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:08.914 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:08.914 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:08.915 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:08.915 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 237448 2024-09-13T06:43:08.915 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.915 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:08.915 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.915 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:08.915 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800371+0000", 2024-09-13T06:43:08.915 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:08.915 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.915 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.915 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:08.915 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800371+0000", 2024-09-13T06:43:08.915 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:08.915 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.916 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.916 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:08.916 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800370+0000", 2024-09-13T06:43:08.916 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967296 2024-09-13T06:43:08.916 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.916 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.916 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:08.916 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800372+0000", 2024-09-13T06:43:08.916 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3510000000000001e-06 2024-09-13T06:43:08.916 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.916 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.916 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:08.916 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800376+0000", 2024-09-13T06:43:08.916 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.693e-06 2024-09-13T06:43:08.917 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.917 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.917 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:08.917 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800378+0000", 2024-09-13T06:43:08.917 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.8870000000000001e-06 2024-09-13T06:43:08.917 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.917 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.917 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:08.917 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.833069+0000", 2024-09-13T06:43:08.917 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.032690708999999998 2024-09-13T06:43:08.917 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.917 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.917 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:08.917 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.833110+0000", 2024-09-13T06:43:08.918 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.1356999999999997e-05 2024-09-13T06:43:08.918 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.918 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.918 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:08.918 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.833165+0000", 2024-09-13T06:43:08.918 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.4456999999999997e-05 2024-09-13T06:43:08.918 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:08.918 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:08.918 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:08.918 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.918 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.918 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:237449 3.15 3:abdd9d42:::rbd_data.1121cb4a09ed.0000000000000008:82 [read 118784~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e224)", 2024-09-13T06:43:08.918 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:43:08.800381+0000", 2024-09-13T06:43:08.918 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.073403923999999995, 2024-09-13T06:43:08.919 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.033007068000000001, 2024-09-13T06:43:08.919 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:08.919 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:08.919 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:08.919 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:08.919 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:08.919 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 237449 2024-09-13T06:43:08.919 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.919 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:08.919 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.919 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:08.919 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800381+0000", 2024-09-13T06:43:08.919 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:08.919 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.920 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.920 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:08.920 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800381+0000", 2024-09-13T06:43:08.920 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:08.920 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.920 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.920 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:08.920 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800381+0000", 2024-09-13T06:43:08.920 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967296 2024-09-13T06:43:08.920 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.920 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.920 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:08.920 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800382+0000", 2024-09-13T06:43:08.920 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.395e-06 2024-09-13T06:43:08.921 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.921 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.921 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:08.921 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800386+0000", 2024-09-13T06:43:08.921 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.574e-06 2024-09-13T06:43:08.921 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.921 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.921 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:08.921 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800388+0000", 2024-09-13T06:43:08.921 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.8729999999999999e-06 2024-09-13T06:43:08.921 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.921 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.921 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:08.922 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.833204+0000", 2024-09-13T06:43:08.922 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.032815986999999998 2024-09-13T06:43:08.922 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.922 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.922 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:08.922 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.833289+0000", 2024-09-13T06:43:08.922 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.4085999999999994e-05 2024-09-13T06:43:08.922 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.922 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.922 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:08.922 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.833388+0000", 2024-09-13T06:43:08.922 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.9380000000000001e-05 2024-09-13T06:43:08.923 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:08.923 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:08.923 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:08.923 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.923 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.923 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:237450 3.15 3:abdd9d42:::rbd_data.1121cb4a09ed.0000000000000008:82 [read 131072~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e224)", 2024-09-13T06:43:08.923 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:43:08.800392+0000", 2024-09-13T06:43:08.923 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.073392596000000004, 2024-09-13T06:43:08.923 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.033110507999999997, 2024-09-13T06:43:08.923 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:08.923 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:08.923 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:08.923 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:08.924 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:08.924 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 237450 2024-09-13T06:43:08.924 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.924 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:08.924 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.924 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:08.924 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800392+0000", 2024-09-13T06:43:08.924 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:08.924 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.924 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.924 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:08.924 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800392+0000", 2024-09-13T06:43:08.925 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:08.925 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.925 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.925 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:08.925 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800392+0000", 2024-09-13T06:43:08.925 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967296 2024-09-13T06:43:08.925 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.925 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.925 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:08.925 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800393+0000", 2024-09-13T06:43:08.925 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.375e-06 2024-09-13T06:43:08.925 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.925 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.925 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:08.926 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800397+0000", 2024-09-13T06:43:08.926 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.6109999999999998e-06 2024-09-13T06:43:08.926 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.926 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.926 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:08.926 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800400+0000", 2024-09-13T06:43:08.926 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.7580000000000001e-06 2024-09-13T06:43:08.926 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.926 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.926 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:08.926 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.833414+0000", 2024-09-13T06:43:08.926 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.033014767 2024-09-13T06:43:08.926 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.926 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.927 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:08.927 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.833453+0000", 2024-09-13T06:43:08.927 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.8711000000000003e-05 2024-09-13T06:43:08.927 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.927 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.927 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:08.927 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.833503+0000", 2024-09-13T06:43:08.927 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.9523e-05 2024-09-13T06:43:08.927 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:08.927 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:08.927 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:08.927 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.927 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.928 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:237451 3.15 3:abdd9d42:::rbd_data.1121cb4a09ed.0000000000000008:82 [read 143360~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e224)", 2024-09-13T06:43:08.928 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:43:08.800402+0000", 2024-09-13T06:43:08.928 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.073382777999999996, 2024-09-13T06:43:08.928 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.033337717000000003, 2024-09-13T06:43:08.928 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:08.928 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:08.928 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:08.928 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:08.928 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:08.928 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 237451 2024-09-13T06:43:08.928 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.928 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:08.928 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.928 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:08.929 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800402+0000", 2024-09-13T06:43:08.929 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:08.929 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.929 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.929 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:08.929 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800402+0000", 2024-09-13T06:43:08.929 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:08.929 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.929 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.929 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:08.929 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800402+0000", 2024-09-13T06:43:08.929 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967296 2024-09-13T06:43:08.930 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.930 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.930 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:08.930 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800403+0000", 2024-09-13T06:43:08.930 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.37e-06 2024-09-13T06:43:08.930 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.930 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.930 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:08.930 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800407+0000", 2024-09-13T06:43:08.930 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.6820000000000001e-06 2024-09-13T06:43:08.930 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.930 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.930 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:08.931 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800410+0000", 2024-09-13T06:43:08.931 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.7810000000000001e-06 2024-09-13T06:43:08.931 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.931 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.931 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:08.931 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.833550+0000", 2024-09-13T06:43:08.931 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.033140192999999998 2024-09-13T06:43:08.931 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.931 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.931 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:08.931 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.833634+0000", 2024-09-13T06:43:08.931 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.4097000000000005e-05 2024-09-13T06:43:08.931 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.931 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.932 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:08.932 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.833740+0000", 2024-09-13T06:43:08.932 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00010582300000000001 2024-09-13T06:43:08.932 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:08.932 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:08.932 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:08.932 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.932 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.932 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:237452 3.15 3:abdd9d42:::rbd_data.1121cb4a09ed.0000000000000008:82 [read 155648~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e224)", 2024-09-13T06:43:08.932 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:43:08.800412+0000", 2024-09-13T06:43:08.932 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.073372822000000004, 2024-09-13T06:43:08.932 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.033496535000000001, 2024-09-13T06:43:08.932 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:08.932 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:08.933 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:08.933 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:08.933 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:08.933 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 237452 2024-09-13T06:43:08.933 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.933 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:08.933 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.933 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:08.933 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800412+0000", 2024-09-13T06:43:08.933 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:08.933 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.933 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.933 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:08.934 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800412+0000", 2024-09-13T06:43:08.934 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:08.934 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.934 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.934 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:08.934 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800412+0000", 2024-09-13T06:43:08.934 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967296 2024-09-13T06:43:08.934 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.934 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.934 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:08.934 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800413+0000", 2024-09-13T06:43:08.934 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.342e-06 2024-09-13T06:43:08.934 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.934 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.935 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:08.935 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800417+0000", 2024-09-13T06:43:08.935 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.6480000000000001e-06 2024-09-13T06:43:08.935 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.935 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.935 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:08.935 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800419+0000", 2024-09-13T06:43:08.935 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.7920000000000001e-06 2024-09-13T06:43:08.935 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.935 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.935 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:08.935 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.833768+0000", 2024-09-13T06:43:08.935 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.033348587999999998 2024-09-13T06:43:08.935 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.936 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.936 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:08.936 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.833836+0000", 2024-09-13T06:43:08.936 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.8090999999999996e-05 2024-09-13T06:43:08.936 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.936 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.936 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:08.936 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.833908+0000", 2024-09-13T06:43:08.936 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.2311999999999995e-05 2024-09-13T06:43:08.936 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:08.936 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:08.936 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:08.936 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.937 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.937 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:237453 3.15 3:abdd9d42:::rbd_data.1121cb4a09ed.0000000000000008:82 [read 167936~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e224)", 2024-09-13T06:43:08.937 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:43:08.800422+0000", 2024-09-13T06:43:08.937 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.073362751000000004, 2024-09-13T06:43:08.937 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.033735223000000002, 2024-09-13T06:43:08.937 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:08.937 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:08.937 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:08.937 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:08.937 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:08.937 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 237453 2024-09-13T06:43:08.937 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.937 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:08.937 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.938 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:08.938 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800422+0000", 2024-09-13T06:43:08.938 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:08.938 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.938 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.938 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:08.938 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800422+0000", 2024-09-13T06:43:08.938 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:08.938 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.938 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.938 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:08.938 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800422+0000", 2024-09-13T06:43:08.938 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967296 2024-09-13T06:43:08.938 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.939 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.939 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:08.939 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800423+0000", 2024-09-13T06:43:08.939 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3489999999999999e-06 2024-09-13T06:43:08.939 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.939 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.939 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:08.939 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800427+0000", 2024-09-13T06:43:08.939 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.6610000000000002e-06 2024-09-13T06:43:08.939 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.939 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.939 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:08.939 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800430+0000", 2024-09-13T06:43:08.940 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.9869999999999999e-06 2024-09-13T06:43:08.940 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.940 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.940 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:08.940 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.833958+0000", 2024-09-13T06:43:08.940 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.033528020999999998 2024-09-13T06:43:08.940 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.940 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.940 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:08.940 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.834047+0000", 2024-09-13T06:43:08.940 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.9492000000000003e-05 2024-09-13T06:43:08.940 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.940 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.941 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:08.941 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.834157+0000", 2024-09-13T06:43:08.941 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000109948 2024-09-13T06:43:08.941 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:08.941 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:08.941 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:08.941 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.941 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.941 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:237454 3.15 3:abdd9d42:::rbd_data.1121cb4a09ed.0000000000000008:82 [read 180224~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e224)", 2024-09-13T06:43:08.941 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:43:08.800432+0000", 2024-09-13T06:43:08.941 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.073352544000000006, 2024-09-13T06:43:08.941 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.033853883000000001, 2024-09-13T06:43:08.941 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:08.942 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:08.942 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:08.942 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:08.942 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:08.942 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 237454 2024-09-13T06:43:08.942 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.942 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:08.942 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.942 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:08.942 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800432+0000", 2024-09-13T06:43:08.942 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:08.942 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.942 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.943 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:08.943 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800432+0000", 2024-09-13T06:43:08.943 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:08.943 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.943 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.943 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:08.943 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800432+0000", 2024-09-13T06:43:08.943 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:08.943 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.943 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.943 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:08.943 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800433+0000", 2024-09-13T06:43:08.943 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3379999999999999e-06 2024-09-13T06:43:08.944 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.944 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.944 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:08.944 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800437+0000", 2024-09-13T06:43:08.944 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.1679999999999997e-06 2024-09-13T06:43:08.944 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.944 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.944 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:08.944 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800440+0000", 2024-09-13T06:43:08.944 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.8830000000000002e-06 2024-09-13T06:43:08.944 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.944 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.944 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:08.945 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.834187+0000", 2024-09-13T06:43:08.945 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.033746532000000003 2024-09-13T06:43:08.945 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.945 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.945 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:08.945 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.834228+0000", 2024-09-13T06:43:08.945 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.087e-05 2024-09-13T06:43:08.945 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.945 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.945 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:08.945 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.834286+0000", 2024-09-13T06:43:08.945 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.8331000000000001e-05 2024-09-13T06:43:08.945 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:08.946 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:08.946 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:08.946 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.946 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.946 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:237455 3.15 3:abdd9d42:::rbd_data.1121cb4a09ed.0000000000000008:82 [read 192512~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e224)", 2024-09-13T06:43:08.946 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:43:08.800443+0000", 2024-09-13T06:43:08.946 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.073342070999999995, 2024-09-13T06:43:08.946 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.034083294, 2024-09-13T06:43:08.946 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:08.946 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:08.946 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:08.946 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:08.947 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:08.947 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 237455 2024-09-13T06:43:08.947 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.947 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:08.947 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.947 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:08.947 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800443+0000", 2024-09-13T06:43:08.947 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:08.947 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.947 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.947 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:08.947 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800443+0000", 2024-09-13T06:43:08.947 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:08.948 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.948 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.948 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:08.948 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800442+0000", 2024-09-13T06:43:08.948 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967296 2024-09-13T06:43:08.948 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.948 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.948 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:08.948 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800444+0000", 2024-09-13T06:43:08.948 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.443e-06 2024-09-13T06:43:08.948 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.948 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.948 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:08.949 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800448+0000", 2024-09-13T06:43:08.949 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.6770000000000001e-06 2024-09-13T06:43:08.949 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.949 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.949 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:08.949 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800451+0000", 2024-09-13T06:43:08.949 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.0920000000000002e-06 2024-09-13T06:43:08.949 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.949 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.949 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:08.949 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.834323+0000", 2024-09-13T06:43:08.950 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.033872145999999999 2024-09-13T06:43:08.950 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.950 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.950 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:08.950 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.834420+0000", 2024-09-13T06:43:08.950 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6898999999999995e-05 2024-09-13T06:43:08.950 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.950 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.950 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:08.950 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.834526+0000", 2024-09-13T06:43:08.950 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000106272 2024-09-13T06:43:08.950 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:08.950 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:08.950 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:08.951 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.951 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.951 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:237456 3.15 3:abdd9d42:::rbd_data.1121cb4a09ed.0000000000000008:82 [read 204800~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e224)", 2024-09-13T06:43:08.951 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:43:08.800453+0000", 2024-09-13T06:43:08.951 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.073331859999999999, 2024-09-13T06:43:08.951 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.034198615000000002, 2024-09-13T06:43:08.951 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:08.951 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:08.951 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:08.951 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:08.951 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:08.951 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 237456 2024-09-13T06:43:08.951 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.951 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:08.952 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.952 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:08.952 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800453+0000", 2024-09-13T06:43:08.952 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:08.952 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.952 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.952 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:08.952 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800453+0000", 2024-09-13T06:43:08.952 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:08.952 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.952 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.953 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:08.953 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800453+0000", 2024-09-13T06:43:08.953 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967296 2024-09-13T06:43:08.953 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.953 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.953 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:08.953 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800454+0000", 2024-09-13T06:43:08.953 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.361e-06 2024-09-13T06:43:08.953 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.953 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.953 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:08.954 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800458+0000", 2024-09-13T06:43:08.954 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.7189999999999999e-06 2024-09-13T06:43:08.954 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.954 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.954 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:08.954 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800461+0000", 2024-09-13T06:43:08.954 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.7599999999999998e-06 2024-09-13T06:43:08.954 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.954 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.954 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:08.954 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.834555+0000", 2024-09-13T06:43:08.955 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.034094192000000002 2024-09-13T06:43:08.955 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.955 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.955 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:08.955 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.834597+0000", 2024-09-13T06:43:08.955 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.2157000000000003e-05 2024-09-13T06:43:08.955 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.955 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.955 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:08.955 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.834652+0000", 2024-09-13T06:43:08.955 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.4660999999999997e-05 2024-09-13T06:43:08.956 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:08.956 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:08.956 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:08.956 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.956 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.956 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:237457 3.15 3:abdd9d42:::rbd_data.1121cb4a09ed.0000000000000008:82 [read 217088~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e224)", 2024-09-13T06:43:08.956 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:43:08.800463+0000", 2024-09-13T06:43:08.956 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.073321913000000002, 2024-09-13T06:43:08.956 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.034419130999999999, 2024-09-13T06:43:08.956 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:08.956 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:08.956 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:08.956 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:08.957 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:08.957 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 237457 2024-09-13T06:43:08.957 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.957 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:08.957 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.957 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:08.957 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800463+0000", 2024-09-13T06:43:08.957 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:08.957 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.957 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.957 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:08.957 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800463+0000", 2024-09-13T06:43:08.958 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:08.958 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.958 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.958 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:08.958 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800463+0000", 2024-09-13T06:43:08.958 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967296 2024-09-13T06:43:08.958 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.958 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.958 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:08.958 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800466+0000", 2024-09-13T06:43:08.958 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.8240000000000001e-06 2024-09-13T06:43:08.958 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.958 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.958 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:08.958 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800470+0000", 2024-09-13T06:43:08.959 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.7579999999999998e-06 2024-09-13T06:43:08.959 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.959 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.959 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:08.959 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800473+0000", 2024-09-13T06:43:08.959 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.875e-06 2024-09-13T06:43:08.959 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.959 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.959 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:08.959 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.834688+0000", 2024-09-13T06:43:08.959 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.034215039000000003 2024-09-13T06:43:08.959 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.960 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.960 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:08.960 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.834772+0000", 2024-09-13T06:43:08.960 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.3870999999999997e-05 2024-09-13T06:43:08.960 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.960 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.960 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:08.960 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.834882+0000", 2024-09-13T06:43:08.960 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00011 2024-09-13T06:43:08.960 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:08.960 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:08.960 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:08.960 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.960 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.961 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:237458 3.15 3:abdd9d42:::rbd_data.1121cb4a09ed.0000000000000008:82 [read 229376~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e224)", 2024-09-13T06:43:08.961 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:43:08.800476+0000", 2024-09-13T06:43:08.961 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.073309164999999996, 2024-09-13T06:43:08.961 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.034538358999999998, 2024-09-13T06:43:08.961 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:08.961 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:08.961 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:08.961 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:08.961 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:08.961 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 237458 2024-09-13T06:43:08.961 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.961 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:08.961 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.961 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:08.962 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800476+0000", 2024-09-13T06:43:08.962 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:08.962 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.962 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.962 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:08.962 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800476+0000", 2024-09-13T06:43:08.962 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:08.962 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.962 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.962 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:08.962 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800475+0000", 2024-09-13T06:43:08.962 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:08.962 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.962 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.963 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:08.963 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800477+0000", 2024-09-13T06:43:08.963 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.367e-06 2024-09-13T06:43:08.963 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.963 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.963 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:08.963 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800480+0000", 2024-09-13T06:43:08.963 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.7179999999999998e-06 2024-09-13T06:43:08.963 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.963 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.963 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:08.963 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800483+0000", 2024-09-13T06:43:08.964 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.807e-06 2024-09-13T06:43:08.964 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.964 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.964 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:08.964 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.834922+0000", 2024-09-13T06:43:08.964 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.034438261999999997 2024-09-13T06:43:08.964 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.964 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.964 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:08.964 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.834962+0000", 2024-09-13T06:43:08.964 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0287999999999998e-05 2024-09-13T06:43:08.964 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.964 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.965 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:08.965 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.835014+0000", 2024-09-13T06:43:08.965 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.2172999999999997e-05 2024-09-13T06:43:08.965 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:08.965 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:08.965 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:08.965 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.965 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.965 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:237459 3.15 3:abdd9d42:::rbd_data.1121cb4a09ed.0000000000000008:82 [read 241664~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e224)", 2024-09-13T06:43:08.965 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:43:08.800486+0000", 2024-09-13T06:43:08.965 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.073299024000000004, 2024-09-13T06:43:08.965 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.034771370000000003, 2024-09-13T06:43:08.965 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:08.966 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:08.966 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:08.966 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:08.966 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:08.966 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 237459 2024-09-13T06:43:08.966 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.966 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:08.966 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.966 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:08.966 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800486+0000", 2024-09-13T06:43:08.966 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:08.966 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.967 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.967 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:08.967 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800486+0000", 2024-09-13T06:43:08.967 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:08.967 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.967 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.967 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:08.967 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800485+0000", 2024-09-13T06:43:08.967 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:08.967 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.967 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.967 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:08.967 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800487+0000", 2024-09-13T06:43:08.968 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.297e-06 2024-09-13T06:43:08.968 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.968 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.968 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:08.968 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800491+0000", 2024-09-13T06:43:08.968 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.4569999999999998e-06 2024-09-13T06:43:08.968 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.968 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.968 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:08.968 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800494+0000", 2024-09-13T06:43:08.968 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.8710000000000001e-06 2024-09-13T06:43:08.968 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.969 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.969 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:08.969 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.835058+0000", 2024-09-13T06:43:08.969 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.034564117999999998 2024-09-13T06:43:08.969 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.969 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.969 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:08.969 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.835142+0000", 2024-09-13T06:43:08.969 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.352e-05 2024-09-13T06:43:08.969 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.969 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.969 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:08.970 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.835257+0000", 2024-09-13T06:43:08.970 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00011537 2024-09-13T06:43:08.970 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:08.970 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:08.970 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:08.970 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.970 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.970 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:237460 3.15 3:abdd9d42:::rbd_data.1121cb4a09ed.0000000000000008:82 [read 253952~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e224)", 2024-09-13T06:43:08.970 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:43:08.800511+0000", 2024-09-13T06:43:08.971 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.073273353999999999, 2024-09-13T06:43:08.971 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.034864764999999999, 2024-09-13T06:43:08.971 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:08.971 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:08.971 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:08.971 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:08.971 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:08.971 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 237460 2024-09-13T06:43:08.971 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.971 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:08.971 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.971 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:08.972 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800511+0000", 2024-09-13T06:43:08.972 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:08.972 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.972 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.972 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:08.972 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800511+0000", 2024-09-13T06:43:08.972 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:08.972 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.972 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.972 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:08.972 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800511+0000", 2024-09-13T06:43:08.972 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:08.973 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.973 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.973 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:08.973 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800513+0000", 2024-09-13T06:43:08.973 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6020000000000001e-06 2024-09-13T06:43:08.973 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.973 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.973 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:08.973 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800517+0000", 2024-09-13T06:43:08.973 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0559999999999998e-06 2024-09-13T06:43:08.973 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.973 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.973 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:08.974 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800521+0000", 2024-09-13T06:43:08.974 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.4050000000000002e-06 2024-09-13T06:43:08.974 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.974 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.974 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:08.974 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.835278+0000", 2024-09-13T06:43:08.974 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.034757154999999998 2024-09-13T06:43:08.974 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.974 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.974 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:08.974 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.835319+0000", 2024-09-13T06:43:08.974 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.1121000000000002e-05 2024-09-13T06:43:08.974 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:08.974 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:08.975 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:08.975 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.835376+0000", 2024-09-13T06:43:08.975 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.6820000000000001e-05 2024-09-13T06:43:08.975 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:08.975 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:08.975 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:08.975 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:08.975 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:08.975 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:43:08.977 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:43:08.977+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:43:08.977 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-13T06:43:09.077 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-13T06:43:09.077+0000 7fa8bb18e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 36790) UID: 0 2024-09-13T06:43:09.095 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:43:09.095 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-13T06:43:09.095 INFO:teuthology.orchestra.run.smithi081.stdout: "num_ops": 0 2024-09-13T06:43:09.095 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:43:09.108 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-13T06:43:09.179 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:43:09.177+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:43:09.215 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:43:09.215 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-13T06:43:09.215 INFO:teuthology.orchestra.run.smithi081.stdout: "complaint_time": 30, 2024-09-13T06:43:09.215 INFO:teuthology.orchestra.run.smithi081.stdout: "num_blocked_ops": 0 2024-09-13T06:43:09.215 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:43:09.227 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-13T06:43:09.280 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:43:09.280+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:43:09.340 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:43:09.340 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 20, 2024-09-13T06:43:09.340 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 600, 2024-09-13T06:43:09.341 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [ 2024-09-13T06:43:09.341 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.341 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:37801 3.1 3:82e31015:::rbd_object_map.1121d8143c6e.0000000000000019:head [call] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e55)", 2024-09-13T06:43:09.341 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:05.646191+0000", 2024-09-13T06:43:09.341 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 183.69468723400001, 2024-09-13T06:43:09.341 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.72659507800000001, 2024-09-13T06:43:09.341 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:09.341 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:09.341 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:09.341 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:09.341 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:09.341 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 37801 2024-09-13T06:43:09.342 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.342 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:09.342 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.342 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:09.342 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:05.646191+0000", 2024-09-13T06:43:09.342 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:09.342 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.342 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.342 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:09.342 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:05.646191+0000", 2024-09-13T06:43:09.342 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:09.342 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.343 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.343 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:09.343 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:05.646188+0000", 2024-09-13T06:43:09.343 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999971 2024-09-13T06:43:09.343 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.343 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.343 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:09.343 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:05.646206+0000", 2024-09-13T06:43:09.343 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8182999999999999e-05 2024-09-13T06:43:09.343 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.343 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.343 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:09.343 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:05.646237+0000", 2024-09-13T06:43:09.344 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.1071000000000001e-05 2024-09-13T06:43:09.344 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.344 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.344 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:09.344 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:05.646251+0000", 2024-09-13T06:43:09.344 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3679000000000001e-05 2024-09-13T06:43:09.344 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.344 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.344 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:09.344 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:05.646321+0000", 2024-09-13T06:43:09.344 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.9831000000000003e-05 2024-09-13T06:43:09.344 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.344 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.345 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:43:09.345 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:05.646331+0000", 2024-09-13T06:43:09.345 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0242e-05 2024-09-13T06:43:09.345 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.345 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.345 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:09.345 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.371959+0000", 2024-09-13T06:43:09.345 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.72562817199999996 2024-09-13T06:43:09.345 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.345 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.345 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:09.345 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.372389+0000", 2024-09-13T06:43:09.346 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00042977400000000001 2024-09-13T06:43:09.346 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.346 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.346 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:09.346 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.372786+0000", 2024-09-13T06:43:09.346 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00039706099999999999 2024-09-13T06:43:09.346 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:09.346 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:09.346 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:09.346 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.346 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.346 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43182 3.17 3:ec5ebce4:::rbd_data.1121f5f2e1c0.0000000000000001:1f [read 333824~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:43:09.346 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.652985+0000", 2024-09-13T06:43:09.347 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 167.687892621, 2024-09-13T06:43:09.347 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123926616, 2024-09-13T06:43:09.347 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:09.347 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:09.347 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:09.347 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:09.347 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:09.347 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43182 2024-09-13T06:43:09.347 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.347 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:09.347 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.347 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:09.347 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.652985+0000", 2024-09-13T06:43:09.347 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:09.348 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.348 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.348 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:09.348 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.652985+0000", 2024-09-13T06:43:09.348 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:09.348 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.348 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.348 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:09.348 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.652985+0000", 2024-09-13T06:43:09.348 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:09.348 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.348 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.348 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:09.348 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.652987+0000", 2024-09-13T06:43:09.349 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0899999999999999e-06 2024-09-13T06:43:09.349 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.349 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.349 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:09.349 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.652994+0000", 2024-09-13T06:43:09.349 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3100000000000003e-06 2024-09-13T06:43:09.349 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.349 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.349 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:09.349 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.653000+0000", 2024-09-13T06:43:09.349 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2020000000000003e-06 2024-09-13T06:43:09.349 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.349 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.350 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:09.350 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.776635+0000", 2024-09-13T06:43:09.350 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.12363529400000001 2024-09-13T06:43:09.350 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.350 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.350 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:09.350 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.776676+0000", 2024-09-13T06:43:09.350 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.0745999999999999e-05 2024-09-13T06:43:09.350 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.350 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.350 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:09.350 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.776912+0000", 2024-09-13T06:43:09.350 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00023631300000000001 2024-09-13T06:43:09.351 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:09.351 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:09.351 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:09.351 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.351 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.351 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43194 3.17 3:ec5ebce4:::rbd_data.1121f5f2e1c0.0000000000000001:1f [read 495616~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:43:09.351 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.656645+0000", 2024-09-13T06:43:09.351 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 167.684232428, 2024-09-13T06:43:09.351 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.124088483, 2024-09-13T06:43:09.351 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:09.351 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:09.351 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:09.351 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:09.352 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:09.352 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43194 2024-09-13T06:43:09.352 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.352 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:09.352 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.352 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:09.352 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656645+0000", 2024-09-13T06:43:09.352 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:09.352 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.352 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.352 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:09.352 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656645+0000", 2024-09-13T06:43:09.352 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:09.353 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.353 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.353 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:09.353 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656645+0000", 2024-09-13T06:43:09.353 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:09.353 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.353 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.353 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:09.353 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656647+0000", 2024-09-13T06:43:09.353 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9180000000000001e-06 2024-09-13T06:43:09.353 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.354 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.354 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:09.354 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656653+0000", 2024-09-13T06:43:09.354 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7860000000000002e-06 2024-09-13T06:43:09.354 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.354 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.354 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:09.354 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656658+0000", 2024-09-13T06:43:09.354 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6949999999999999e-06 2024-09-13T06:43:09.354 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.354 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.354 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:09.354 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.780406+0000", 2024-09-13T06:43:09.355 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123748657 2024-09-13T06:43:09.355 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.355 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.355 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:09.355 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.780446+0000", 2024-09-13T06:43:09.355 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.9360999999999998e-05 2024-09-13T06:43:09.355 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.355 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.355 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:09.355 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.780734+0000", 2024-09-13T06:43:09.355 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00028838399999999998 2024-09-13T06:43:09.355 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:09.356 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:09.356 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:09.356 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.356 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.356 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43241 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 120832~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:43:09.356 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.660682+0000", 2024-09-13T06:43:09.356 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 167.68019548999999, 2024-09-13T06:43:09.356 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123958204, 2024-09-13T06:43:09.356 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:09.356 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:09.356 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:09.356 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:09.356 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:09.357 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43241 2024-09-13T06:43:09.357 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.357 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:09.357 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.357 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:09.357 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660682+0000", 2024-09-13T06:43:09.357 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:09.357 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.357 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.357 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:09.357 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660682+0000", 2024-09-13T06:43:09.357 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:09.357 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.358 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.358 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:09.358 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660682+0000", 2024-09-13T06:43:09.358 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:09.358 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.358 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.358 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:09.358 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660683+0000", 2024-09-13T06:43:09.358 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.308e-06 2024-09-13T06:43:09.358 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.358 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.358 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:09.358 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660686+0000", 2024-09-13T06:43:09.359 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.977e-06 2024-09-13T06:43:09.359 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.359 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.359 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:09.359 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660689+0000", 2024-09-13T06:43:09.359 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5830000000000001e-06 2024-09-13T06:43:09.359 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.359 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.359 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:09.359 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.784366+0000", 2024-09-13T06:43:09.359 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.12367713599999999 2024-09-13T06:43:09.359 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.360 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.360 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:09.360 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.784451+0000", 2024-09-13T06:43:09.360 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.4629999999999994e-05 2024-09-13T06:43:09.360 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.360 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.360 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:09.360 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.784641+0000", 2024-09-13T06:43:09.360 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00018984899999999999 2024-09-13T06:43:09.360 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:09.360 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:09.360 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:09.360 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.361 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.361 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43242 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 139264~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:43:09.361 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.660691+0000", 2024-09-13T06:43:09.361 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 167.68018651200001, 2024-09-13T06:43:09.361 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.124536443, 2024-09-13T06:43:09.361 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:09.361 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:09.361 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:09.361 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:09.361 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:09.361 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43242 2024-09-13T06:43:09.361 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.361 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:09.361 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.362 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:09.362 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660691+0000", 2024-09-13T06:43:09.362 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:09.362 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.362 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.362 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:09.362 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660691+0000", 2024-09-13T06:43:09.362 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:09.362 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.362 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.362 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:09.362 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660691+0000", 2024-09-13T06:43:09.362 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:43:09.362 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.363 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.363 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:09.363 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660696+0000", 2024-09-13T06:43:09.363 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0560000000000004e-06 2024-09-13T06:43:09.363 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.363 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.363 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:09.363 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660699+0000", 2024-09-13T06:43:09.363 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.2009999999999999e-06 2024-09-13T06:43:09.363 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.363 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.363 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:09.363 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660702+0000", 2024-09-13T06:43:09.364 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.633e-06 2024-09-13T06:43:09.364 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.364 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.364 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:09.364 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.784912+0000", 2024-09-13T06:43:09.364 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.124209497 2024-09-13T06:43:09.364 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.364 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.364 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:09.364 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.784995+0000", 2024-09-13T06:43:09.364 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.3891e-05 2024-09-13T06:43:09.364 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.364 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.365 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:09.365 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.785228+0000", 2024-09-13T06:43:09.365 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00023237400000000001 2024-09-13T06:43:09.365 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:09.365 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:09.365 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:09.365 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.365 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.365 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43243 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 153600~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:43:09.365 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.660705+0000", 2024-09-13T06:43:09.365 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 167.68017317900001, 2024-09-13T06:43:09.365 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.124825835, 2024-09-13T06:43:09.365 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:09.366 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:09.366 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:09.366 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:09.366 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:09.366 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43243 2024-09-13T06:43:09.366 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.366 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:09.366 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.366 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:09.366 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660705+0000", 2024-09-13T06:43:09.366 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:09.366 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.367 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.367 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:09.367 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660705+0000", 2024-09-13T06:43:09.367 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:09.367 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.367 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.367 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:09.367 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660705+0000", 2024-09-13T06:43:09.367 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:43:09.367 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.367 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.367 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:09.367 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660706+0000", 2024-09-13T06:43:09.367 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4339999999999999e-06 2024-09-13T06:43:09.367 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.368 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.368 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:09.368 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660709+0000", 2024-09-13T06:43:09.368 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9000000000000002e-06 2024-09-13T06:43:09.368 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.368 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.368 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:09.368 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660712+0000", 2024-09-13T06:43:09.368 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.0589999999999998e-06 2024-09-13T06:43:09.368 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.368 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.368 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:09.368 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.785318+0000", 2024-09-13T06:43:09.368 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.124606299 2024-09-13T06:43:09.369 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.369 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.369 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:09.369 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.785361+0000", 2024-09-13T06:43:09.369 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.3214999999999999e-05 2024-09-13T06:43:09.369 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.369 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.369 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:09.369 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.785531+0000", 2024-09-13T06:43:09.369 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00016914400000000001 2024-09-13T06:43:09.369 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:09.369 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:09.369 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:09.369 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.370 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.370 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43244 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 167936~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:43:09.370 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.660714+0000", 2024-09-13T06:43:09.370 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 167.68016376599999, 2024-09-13T06:43:09.370 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.125073248, 2024-09-13T06:43:09.370 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:09.370 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:09.370 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:09.370 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:09.370 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:09.370 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43244 2024-09-13T06:43:09.370 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.370 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:09.370 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.371 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:09.371 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660714+0000", 2024-09-13T06:43:09.371 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:09.371 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.371 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.371 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:09.371 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660714+0000", 2024-09-13T06:43:09.371 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:09.371 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.371 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.371 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:09.371 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660714+0000", 2024-09-13T06:43:09.371 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:43:09.371 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.372 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.372 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:09.372 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660715+0000", 2024-09-13T06:43:09.372 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2330000000000001e-06 2024-09-13T06:43:09.372 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.372 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.372 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:09.372 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660718+0000", 2024-09-13T06:43:09.372 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9569999999999998e-06 2024-09-13T06:43:09.372 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.372 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.372 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:09.372 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660721+0000", 2024-09-13T06:43:09.373 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.678e-06 2024-09-13T06:43:09.373 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.373 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.373 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:09.373 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.785557+0000", 2024-09-13T06:43:09.373 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.12483633199999999 2024-09-13T06:43:09.373 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.373 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.373 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:09.373 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.785618+0000", 2024-09-13T06:43:09.373 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0686000000000001e-05 2024-09-13T06:43:09.373 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.373 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.374 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:09.374 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.785787+0000", 2024-09-13T06:43:09.374 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00016957699999999999 2024-09-13T06:43:09.374 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:09.374 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:09.374 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:09.374 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.374 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.374 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43256 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 344064~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:43:09.374 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.664763+0000", 2024-09-13T06:43:09.374 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 167.676115256, 2024-09-13T06:43:09.374 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.12418359399999999, 2024-09-13T06:43:09.374 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:09.374 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:09.375 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:09.375 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:09.375 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:09.375 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43256 2024-09-13T06:43:09.375 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.375 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:09.375 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.375 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:09.375 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664763+0000", 2024-09-13T06:43:09.375 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:09.375 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.375 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.375 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:09.375 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664763+0000", 2024-09-13T06:43:09.376 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:09.376 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.376 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.376 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:09.376 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664762+0000", 2024-09-13T06:43:09.376 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:09.376 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.376 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.376 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:09.376 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664765+0000", 2024-09-13T06:43:09.376 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3290000000000001e-06 2024-09-13T06:43:09.376 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.376 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.376 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:09.377 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664771+0000", 2024-09-13T06:43:09.377 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.1319999999999999e-06 2024-09-13T06:43:09.377 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.377 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.377 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:09.377 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664776+0000", 2024-09-13T06:43:09.377 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.8840000000000002e-06 2024-09-13T06:43:09.377 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.377 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.377 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:09.377 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.788598+0000", 2024-09-13T06:43:09.377 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123821979 2024-09-13T06:43:09.377 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.378 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.378 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:09.378 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.788680+0000", 2024-09-13T06:43:09.378 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.2367999999999995e-05 2024-09-13T06:43:09.378 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.378 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.378 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:09.378 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.788946+0000", 2024-09-13T06:43:09.378 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00026629799999999999 2024-09-13T06:43:09.378 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:09.378 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:09.378 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:09.378 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.378 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.379 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43267 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 505856~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:43:09.379 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.669461+0000", 2024-09-13T06:43:09.379 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 167.67141670199999, 2024-09-13T06:43:09.379 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123933711, 2024-09-13T06:43:09.379 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:09.379 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:09.379 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:09.379 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:09.379 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:09.379 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43267 2024-09-13T06:43:09.379 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.379 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:09.379 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.379 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:09.380 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669461+0000", 2024-09-13T06:43:09.380 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:09.380 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.380 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.380 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:09.380 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669461+0000", 2024-09-13T06:43:09.380 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:09.380 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.380 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.380 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:09.380 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669461+0000", 2024-09-13T06:43:09.380 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:09.380 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.381 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.381 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:09.381 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669463+0000", 2024-09-13T06:43:09.381 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5629999999999999e-06 2024-09-13T06:43:09.381 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.381 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.381 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:09.381 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669473+0000", 2024-09-13T06:43:09.381 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.9520000000000006e-06 2024-09-13T06:43:09.381 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.381 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.381 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:09.382 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669479+0000", 2024-09-13T06:43:09.382 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8540000000000002e-06 2024-09-13T06:43:09.382 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.382 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.382 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:09.382 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.793137+0000", 2024-09-13T06:43:09.382 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.12365825699999999 2024-09-13T06:43:09.382 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.382 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.382 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:09.383 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.793181+0000", 2024-09-13T06:43:09.383 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.3773999999999998e-05 2024-09-13T06:43:09.383 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.383 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.383 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:09.383 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.793395+0000", 2024-09-13T06:43:09.383 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00021372399999999999 2024-09-13T06:43:09.383 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:09.383 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:09.383 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:09.383 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.383 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.384 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43268 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 520192~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:43:09.384 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.669484+0000", 2024-09-13T06:43:09.384 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 167.67139391699999, 2024-09-13T06:43:09.384 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.12441057899999999, 2024-09-13T06:43:09.384 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:09.384 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:09.384 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:09.384 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:09.384 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:09.384 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43268 2024-09-13T06:43:09.384 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.384 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:09.384 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.385 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:09.385 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669484+0000", 2024-09-13T06:43:09.385 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:09.385 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.385 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.385 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:09.385 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669484+0000", 2024-09-13T06:43:09.385 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:09.385 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.385 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.385 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:09.385 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669484+0000", 2024-09-13T06:43:09.385 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:09.385 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.386 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.386 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:09.386 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669486+0000", 2024-09-13T06:43:09.386 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6120000000000001e-06 2024-09-13T06:43:09.386 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.386 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.386 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:09.386 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669494+0000", 2024-09-13T06:43:09.386 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4819999999999997e-06 2024-09-13T06:43:09.386 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.386 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.386 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:09.386 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669497+0000", 2024-09-13T06:43:09.386 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9790000000000002e-06 2024-09-13T06:43:09.387 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.387 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.387 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:09.387 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.793559+0000", 2024-09-13T06:43:09.387 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.124062436 2024-09-13T06:43:09.387 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.387 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.387 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:09.387 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.793603+0000", 2024-09-13T06:43:09.387 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.3764999999999999e-05 2024-09-13T06:43:09.387 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.387 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.387 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:09.387 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.793895+0000", 2024-09-13T06:43:09.388 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00029168299999999999 2024-09-13T06:43:09.388 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:09.388 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:09.388 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:09.388 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.388 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.388 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:181627 3.1b 3:dbd5e871:::rbd_data.11218aab7a9c.0000000000000003:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e203)", 2024-09-13T06:43:09.388 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:42:45.704561+0000", 2024-09-13T06:43:09.388 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 23.636317052999999, 2024-09-13T06:43:09.388 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.70481779099999997, 2024-09-13T06:43:09.388 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:09.388 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:09.388 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:09.389 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:09.389 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:09.389 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 181627 2024-09-13T06:43:09.389 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.389 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:09.389 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.389 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:09.389 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.704561+0000", 2024-09-13T06:43:09.389 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:09.389 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.389 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.389 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:09.389 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.704561+0000", 2024-09-13T06:43:09.389 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:09.390 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.390 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.390 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:09.390 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.704558+0000", 2024-09-13T06:43:09.390 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999976 2024-09-13T06:43:09.390 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.390 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.390 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:09.390 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.704570+0000", 2024-09-13T06:43:09.390 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2123000000000001e-05 2024-09-13T06:43:09.390 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.390 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.390 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:09.390 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.704596+0000", 2024-09-13T06:43:09.391 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5134e-05 2024-09-13T06:43:09.391 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.391 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.391 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:09.391 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.704609+0000", 2024-09-13T06:43:09.391 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3745e-05 2024-09-13T06:43:09.391 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.391 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.391 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:09.391 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.704797+0000", 2024-09-13T06:43:09.391 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00018797799999999999 2024-09-13T06:43:09.391 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.391 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.392 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:43:09.392 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.704816+0000", 2024-09-13T06:43:09.392 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8218000000000001e-05 2024-09-13T06:43:09.392 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.392 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.392 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:09.392 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:46.408816+0000", 2024-09-13T06:43:09.392 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.70399995500000001 2024-09-13T06:43:09.392 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.392 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.392 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:09.392 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:46.409111+0000", 2024-09-13T06:43:09.392 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000295202 2024-09-13T06:43:09.393 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.393 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.393 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:09.393 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:46.409379+0000", 2024-09-13T06:43:09.393 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00026792599999999998 2024-09-13T06:43:09.393 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:09.393 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:09.393 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:09.393 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.393 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.393 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:181641 3.1b 3:dbd5e871:::rbd_data.11218aab7a9c.0000000000000003:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e203)", 2024-09-13T06:43:09.393 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:42:45.704674+0000", 2024-09-13T06:43:09.393 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 23.636204046, 2024-09-13T06:43:09.394 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.70579465600000002, 2024-09-13T06:43:09.394 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:09.394 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:09.394 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:09.394 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:09.394 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:09.394 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 181641 2024-09-13T06:43:09.394 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.394 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:09.394 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.394 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:09.394 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.704674+0000", 2024-09-13T06:43:09.394 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:09.394 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.395 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.395 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:09.395 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.704674+0000", 2024-09-13T06:43:09.395 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:09.395 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.395 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.395 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:09.395 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.704673+0000", 2024-09-13T06:43:09.395 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:09.395 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.395 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.395 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:09.395 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.704677+0000", 2024-09-13T06:43:09.395 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.6389999999999998e-06 2024-09-13T06:43:09.396 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.396 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.396 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:09.396 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.704691+0000", 2024-09-13T06:43:09.396 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3859999999999999e-05 2024-09-13T06:43:09.396 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.396 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.396 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:09.396 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.704699+0000", 2024-09-13T06:43:09.396 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.2339999999999994e-06 2024-09-13T06:43:09.396 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.396 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.396 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:09.396 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.704854+0000", 2024-09-13T06:43:09.397 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00015513899999999999 2024-09-13T06:43:09.397 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.397 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.397 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:43:09.397 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.704866+0000", 2024-09-13T06:43:09.397 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1855000000000001e-05 2024-09-13T06:43:09.397 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.397 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.397 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:09.397 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:46.410079+0000", 2024-09-13T06:43:09.397 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.705212477 2024-09-13T06:43:09.397 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.398 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.398 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:09.398 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:46.410279+0000", 2024-09-13T06:43:09.398 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000200614 2024-09-13T06:43:09.398 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.398 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.398 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:09.398 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:46.410469+0000", 2024-09-13T06:43:09.398 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00018939400000000001 2024-09-13T06:43:09.398 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:09.398 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:09.398 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:09.398 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.398 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.399 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:181655 3.1b 3:dbd5e871:::rbd_data.11218aab7a9c.0000000000000003:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e203)", 2024-09-13T06:43:09.399 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:42:45.704730+0000", 2024-09-13T06:43:09.399 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 23.636147638000001, 2024-09-13T06:43:09.399 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.70617977499999995, 2024-09-13T06:43:09.399 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:09.399 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:09.399 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:09.399 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:09.399 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:09.399 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 181655 2024-09-13T06:43:09.399 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.399 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:09.399 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.400 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:09.400 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.704730+0000", 2024-09-13T06:43:09.400 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:09.400 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.400 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.400 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:09.400 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.704730+0000", 2024-09-13T06:43:09.400 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:09.400 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.400 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.400 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:09.400 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.704730+0000", 2024-09-13T06:43:09.400 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:09.400 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.401 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.401 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:09.401 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.704733+0000", 2024-09-13T06:43:09.401 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.0000000000000001e-06 2024-09-13T06:43:09.401 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.401 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.401 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:09.401 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.704741+0000", 2024-09-13T06:43:09.401 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.0770000000000008e-06 2024-09-13T06:43:09.401 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.401 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.401 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:09.401 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.704747+0000", 2024-09-13T06:43:09.402 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.2110000000000003e-06 2024-09-13T06:43:09.402 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.402 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.402 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:09.402 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.706676+0000", 2024-09-13T06:43:09.402 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0019289820000000001 2024-09-13T06:43:09.402 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.402 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.402 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:43:09.402 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.706687+0000", 2024-09-13T06:43:09.402 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1382999999999999e-05 2024-09-13T06:43:09.402 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.402 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.402 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:09.403 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:46.410540+0000", 2024-09-13T06:43:09.403 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.70385235199999996 2024-09-13T06:43:09.403 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.403 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.403 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:09.403 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:46.410723+0000", 2024-09-13T06:43:09.403 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000182998 2024-09-13T06:43:09.403 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.403 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.403 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:09.403 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:46.410910+0000", 2024-09-13T06:43:09.403 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00018720299999999999 2024-09-13T06:43:09.404 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:09.404 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:09.404 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:09.404 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.404 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.404 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:181669 3.1b 3:dbd5e871:::rbd_data.11218aab7a9c.0000000000000003:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e203)", 2024-09-13T06:43:09.404 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:42:45.705356+0000", 2024-09-13T06:43:09.404 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 23.63552163, 2024-09-13T06:43:09.404 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.70583958999999996, 2024-09-13T06:43:09.404 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:09.404 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:09.404 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:09.404 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:09.404 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:09.405 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 181669 2024-09-13T06:43:09.405 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.405 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:09.405 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.405 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:09.405 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.705356+0000", 2024-09-13T06:43:09.405 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:09.405 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.405 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.405 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:09.405 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.705356+0000", 2024-09-13T06:43:09.405 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:09.405 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.405 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.406 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:09.406 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.705356+0000", 2024-09-13T06:43:09.406 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:09.406 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.406 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.406 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:09.406 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.705360+0000", 2024-09-13T06:43:09.406 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.0069999999999999e-06 2024-09-13T06:43:09.406 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.406 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.406 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:09.406 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.705368+0000", 2024-09-13T06:43:09.406 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.3639999999999999e-06 2024-09-13T06:43:09.407 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.407 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.407 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:09.407 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.705375+0000", 2024-09-13T06:43:09.407 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.8839999999999997e-06 2024-09-13T06:43:09.407 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.407 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.407 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:09.407 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.706716+0000", 2024-09-13T06:43:09.407 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0013414589999999999 2024-09-13T06:43:09.407 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.407 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.407 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:43:09.408 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.706726+0000", 2024-09-13T06:43:09.408 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.5079999999999994e-06 2024-09-13T06:43:09.408 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.408 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.408 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:09.408 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:46.410966+0000", 2024-09-13T06:43:09.408 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.70424025800000001 2024-09-13T06:43:09.408 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.408 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.408 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:09.408 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:46.411099+0000", 2024-09-13T06:43:09.408 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000132395 2024-09-13T06:43:09.409 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.409 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.409 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:09.409 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:46.411196+0000", 2024-09-13T06:43:09.409 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.7344999999999997e-05 2024-09-13T06:43:09.409 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:09.409 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:09.409 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:09.409 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.409 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.409 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:181683 3.1b 3:dbd5e871:::rbd_data.11218aab7a9c.0000000000000003:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e203)", 2024-09-13T06:43:09.409 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:42:45.705404+0000", 2024-09-13T06:43:09.409 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 23.635474124000002, 2024-09-13T06:43:09.410 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.70639211899999999, 2024-09-13T06:43:09.410 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:09.410 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:09.410 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:09.410 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:09.410 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:09.410 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 181683 2024-09-13T06:43:09.410 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.410 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:09.410 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.410 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:09.410 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.705404+0000", 2024-09-13T06:43:09.410 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:09.411 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.411 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.411 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:09.411 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.705404+0000", 2024-09-13T06:43:09.411 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:09.411 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.411 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.411 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:09.411 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.705403+0000", 2024-09-13T06:43:09.411 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:09.411 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.411 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.411 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:09.412 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.705406+0000", 2024-09-13T06:43:09.412 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.1499999999999999e-06 2024-09-13T06:43:09.412 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.412 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.412 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:09.412 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.705414+0000", 2024-09-13T06:43:09.412 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4259999999999997e-06 2024-09-13T06:43:09.412 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.412 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.412 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:09.412 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.705420+0000", 2024-09-13T06:43:09.412 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.4339999999999997e-06 2024-09-13T06:43:09.413 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.413 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.413 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:09.413 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.706753+0000", 2024-09-13T06:43:09.413 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0013326939999999999 2024-09-13T06:43:09.413 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.413 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.413 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:43:09.413 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.706762+0000", 2024-09-13T06:43:09.413 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.2439999999999999e-06 2024-09-13T06:43:09.413 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.413 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.413 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:09.414 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:46.411391+0000", 2024-09-13T06:43:09.414 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.70462912099999997 2024-09-13T06:43:09.414 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.414 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.414 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:09.414 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:46.411584+0000", 2024-09-13T06:43:09.414 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00019283399999999999 2024-09-13T06:43:09.414 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.414 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.414 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:09.414 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:46.411796+0000", 2024-09-13T06:43:09.414 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00021175299999999999 2024-09-13T06:43:09.415 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:09.415 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:09.415 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:09.415 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.415 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.415 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:181697 3.1b 3:dbd5e871:::rbd_data.11218aab7a9c.0000000000000003:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e203)", 2024-09-13T06:43:09.415 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:42:45.705447+0000", 2024-09-13T06:43:09.415 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 23.635430474, 2024-09-13T06:43:09.415 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.70668603500000005, 2024-09-13T06:43:09.415 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:09.415 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:09.415 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:09.415 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:09.416 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:09.416 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 181697 2024-09-13T06:43:09.416 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.416 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:09.416 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.416 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:09.416 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.705447+0000", 2024-09-13T06:43:09.416 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:09.416 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.416 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.416 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:09.416 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.705447+0000", 2024-09-13T06:43:09.416 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:09.416 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.417 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.417 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:09.417 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.705447+0000", 2024-09-13T06:43:09.417 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:09.417 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.417 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.417 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:09.417 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.705450+0000", 2024-09-13T06:43:09.417 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.8830000000000002e-06 2024-09-13T06:43:09.417 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.417 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.417 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:09.417 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.705457+0000", 2024-09-13T06:43:09.417 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.097e-06 2024-09-13T06:43:09.418 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.418 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.418 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:09.418 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.705463+0000", 2024-09-13T06:43:09.418 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.2439999999999998e-06 2024-09-13T06:43:09.418 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.418 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.418 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:09.418 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.706790+0000", 2024-09-13T06:43:09.418 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.001326823 2024-09-13T06:43:09.418 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.418 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.418 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:43:09.418 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.706799+0000", 2024-09-13T06:43:09.419 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.3249999999999997e-06 2024-09-13T06:43:09.419 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.419 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.419 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:09.419 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:46.411884+0000", 2024-09-13T06:43:09.419 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.70508501599999995 2024-09-13T06:43:09.419 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.419 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.419 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:09.419 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:46.412010+0000", 2024-09-13T06:43:09.419 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000125635 2024-09-13T06:43:09.419 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.419 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.419 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:09.420 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:46.412133+0000", 2024-09-13T06:43:09.420 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000123492 2024-09-13T06:43:09.420 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:09.420 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:09.420 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:09.420 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.420 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.420 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:181711 3.1b 3:dbd5e871:::rbd_data.11218aab7a9c.0000000000000003:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e203)", 2024-09-13T06:43:09.420 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:42:45.705496+0000", 2024-09-13T06:43:09.420 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 23.635381911, 2024-09-13T06:43:09.420 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.70714611199999999, 2024-09-13T06:43:09.420 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:09.420 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:09.420 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:09.421 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:09.421 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:09.421 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 181711 2024-09-13T06:43:09.421 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.421 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:09.421 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.421 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:09.421 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.705496+0000", 2024-09-13T06:43:09.421 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:09.421 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.421 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.421 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:09.421 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.705496+0000", 2024-09-13T06:43:09.421 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:09.422 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.422 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.422 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:09.422 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.705495+0000", 2024-09-13T06:43:09.422 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:09.422 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.422 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.422 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:09.422 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.705499+0000", 2024-09-13T06:43:09.422 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.1109999999999999e-06 2024-09-13T06:43:09.422 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.422 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.422 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:09.423 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.705506+0000", 2024-09-13T06:43:09.423 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.8830000000000006e-06 2024-09-13T06:43:09.423 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.423 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.423 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:09.423 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.705513+0000", 2024-09-13T06:43:09.423 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.2500000000000003e-06 2024-09-13T06:43:09.423 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.423 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.423 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:09.423 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.706828+0000", 2024-09-13T06:43:09.423 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0013155840000000001 2024-09-13T06:43:09.423 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.423 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.424 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:43:09.424 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.706837+0000", 2024-09-13T06:43:09.424 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.0489999999999993e-06 2024-09-13T06:43:09.424 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.424 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.424 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:09.424 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:46.412223+0000", 2024-09-13T06:43:09.424 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.70538530799999999 2024-09-13T06:43:09.424 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.424 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.424 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:09.424 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:46.412418+0000", 2024-09-13T06:43:09.425 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000195331 2024-09-13T06:43:09.425 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.425 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.425 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:09.425 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:46.412642+0000", 2024-09-13T06:43:09.425 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00022410099999999999 2024-09-13T06:43:09.425 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:09.425 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:09.425 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:09.425 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.425 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.425 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:181725 3.1b 3:dbd5e871:::rbd_data.11218aab7a9c.0000000000000003:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e203)", 2024-09-13T06:43:09.425 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:42:45.706863+0000", 2024-09-13T06:43:09.426 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 23.634014867000001, 2024-09-13T06:43:09.426 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.70631271699999998, 2024-09-13T06:43:09.426 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:09.426 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:09.426 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:09.426 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:09.426 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:09.426 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 181725 2024-09-13T06:43:09.426 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.426 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:09.426 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.426 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:09.426 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.706863+0000", 2024-09-13T06:43:09.426 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:09.426 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.427 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.427 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:09.427 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.706863+0000", 2024-09-13T06:43:09.427 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:09.427 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.427 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.427 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:09.427 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.706862+0000", 2024-09-13T06:43:09.427 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.999999 2024-09-13T06:43:09.427 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.427 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.427 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:09.427 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.706869+0000", 2024-09-13T06:43:09.427 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.0899999999999999e-06 2024-09-13T06:43:09.428 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.428 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.428 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:09.428 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.706881+0000", 2024-09-13T06:43:09.428 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1727e-05 2024-09-13T06:43:09.428 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.428 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.428 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:09.428 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.706891+0000", 2024-09-13T06:43:09.428 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.9399999999999997e-06 2024-09-13T06:43:09.428 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.428 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.428 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:09.429 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.706952+0000", 2024-09-13T06:43:09.429 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.1106999999999996e-05 2024-09-13T06:43:09.429 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.429 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.429 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:43:09.429 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.706966+0000", 2024-09-13T06:43:09.429 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4173e-05 2024-09-13T06:43:09.429 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.429 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.429 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:09.429 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:46.412754+0000", 2024-09-13T06:43:09.429 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.70578759999999996 2024-09-13T06:43:09.430 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.430 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.430 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:09.430 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:46.412967+0000", 2024-09-13T06:43:09.430 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00021290999999999999 2024-09-13T06:43:09.430 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.430 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.430 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:09.430 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:46.413176+0000", 2024-09-13T06:43:09.430 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00020922099999999999 2024-09-13T06:43:09.430 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:09.430 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:09.430 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:09.431 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.431 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.431 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:181739 3.1b 3:dbd5e871:::rbd_data.11218aab7a9c.0000000000000003:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e203)", 2024-09-13T06:43:09.431 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:42:45.706937+0000", 2024-09-13T06:43:09.431 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 23.633940656, 2024-09-13T06:43:09.431 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.70679418800000005, 2024-09-13T06:43:09.431 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:09.431 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:09.431 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:09.431 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:09.431 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:09.431 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 181739 2024-09-13T06:43:09.431 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.432 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:09.432 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.432 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:09.432 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.706937+0000", 2024-09-13T06:43:09.432 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:09.432 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.432 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.432 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:09.432 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.706937+0000", 2024-09-13T06:43:09.432 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:09.432 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.432 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.432 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:09.433 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.706937+0000", 2024-09-13T06:43:09.433 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:09.433 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.433 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.433 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:09.433 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.706940+0000", 2024-09-13T06:43:09.433 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.4290000000000001e-06 2024-09-13T06:43:09.433 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.433 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.433 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:09.433 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.706949+0000", 2024-09-13T06:43:09.433 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.7730000000000005e-06 2024-09-13T06:43:09.433 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.434 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.434 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:09.434 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.706956+0000", 2024-09-13T06:43:09.434 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4240000000000004e-06 2024-09-13T06:43:09.434 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.434 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.434 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:09.434 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.706999+0000", 2024-09-13T06:43:09.434 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.2410999999999998e-05 2024-09-13T06:43:09.434 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.434 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.434 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:43:09.434 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.707011+0000", 2024-09-13T06:43:09.435 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2140999999999999e-05 2024-09-13T06:43:09.435 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.435 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.435 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:09.435 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:46.413278+0000", 2024-09-13T06:43:09.435 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.70626747199999995 2024-09-13T06:43:09.435 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.435 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.435 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:09.435 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:46.413471+0000", 2024-09-13T06:43:09.435 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00019234699999999999 2024-09-13T06:43:09.435 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.435 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.435 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:09.435 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:46.413731+0000", 2024-09-13T06:43:09.436 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00026069 2024-09-13T06:43:09.436 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:09.436 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:09.436 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:09.436 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.436 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.436 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:181753 3.1b 3:dbd5e871:::rbd_data.11218aab7a9c.0000000000000003:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e203)", 2024-09-13T06:43:09.436 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:42:45.706987+0000", 2024-09-13T06:43:09.436 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 23.633890572999999, 2024-09-13T06:43:09.436 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.70721309200000004, 2024-09-13T06:43:09.436 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:09.436 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:09.436 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:09.437 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:09.437 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:09.437 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 181753 2024-09-13T06:43:09.437 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.437 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:09.437 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.437 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:09.437 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.706987+0000", 2024-09-13T06:43:09.437 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:09.437 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.437 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.437 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:09.437 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.706987+0000", 2024-09-13T06:43:09.438 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:09.438 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.438 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.438 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:09.438 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.706987+0000", 2024-09-13T06:43:09.438 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:09.438 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.438 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.438 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:09.438 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.706990+0000", 2024-09-13T06:43:09.439 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.0759999999999999e-06 2024-09-13T06:43:09.439 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.439 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.439 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:09.439 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.706997+0000", 2024-09-13T06:43:09.439 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5809999999999999e-06 2024-09-13T06:43:09.439 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.439 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.439 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:09.439 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.707004+0000", 2024-09-13T06:43:09.439 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.7839999999999998e-06 2024-09-13T06:43:09.439 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.440 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.440 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:09.440 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.707046+0000", 2024-09-13T06:43:09.440 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.1474999999999998e-05 2024-09-13T06:43:09.440 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.440 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.440 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:43:09.440 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.707056+0000", 2024-09-13T06:43:09.440 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0825000000000001e-05 2024-09-13T06:43:09.440 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.440 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.440 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:09.441 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:46.413797+0000", 2024-09-13T06:43:09.441 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.70674101099999997 2024-09-13T06:43:09.441 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.441 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.441 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:09.441 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:46.413998+0000", 2024-09-13T06:43:09.441 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00020058700000000001 2024-09-13T06:43:09.441 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.441 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.441 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:09.441 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:46.414200+0000", 2024-09-13T06:43:09.441 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00020238400000000001 2024-09-13T06:43:09.442 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:09.442 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:09.442 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:09.442 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:09.442 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:09.442 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:43:09.444 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-13T06:43:09.444 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:43:09.441+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:43:09.544 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-13T06:43:09.545+0000 7fa8bb18e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 36790) UID: 0 2024-09-13T06:43:09.607 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:43:09.607 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-13T06:43:09.607 INFO:teuthology.orchestra.run.smithi081.stdout: "num_ops": 0 2024-09-13T06:43:09.607 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:43:09.620 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-13T06:43:09.636 INFO:teuthology.orchestra.run.smithi081.stdout:checking clone #41, image image_client.0-clone41 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent42 2024-09-13T06:43:09.645 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:43:09.644+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:43:09.693 INFO:teuthology.orchestra.run.smithi081.stdout:5899 trunc from 0xe3fda17 to 0xe9b5837 2024-09-13T06:43:09.712 INFO:teuthology.orchestra.run.smithi081.stdout:5901 punch from 0x117cf3c to 0x11817ce, (0x4892 bytes) 2024-09-13T06:43:09.720 INFO:teuthology.orchestra.run.smithi081.stdout:5902 trunc from 0xe9b5837 to 0x8a1185c 2024-09-13T06:43:09.746 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:43:09.745+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:43:09.750 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:43:09.750 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-13T06:43:09.750 INFO:teuthology.orchestra.run.smithi081.stdout: "complaint_time": 30, 2024-09-13T06:43:09.750 INFO:teuthology.orchestra.run.smithi081.stdout: "num_blocked_ops": 0 2024-09-13T06:43:09.750 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:43:09.757 INFO:teuthology.orchestra.run.smithi081.stdout:5903 read 0x1ace0f7 thru 0x1ad6636 (0x8540 bytes) 2024-09-13T06:43:09.758 INFO:teuthology.orchestra.run.smithi081.stdout:5904 writesame 0x7e6db34 thru 0x7e7d5cf data_size 0x56(0xfa9c bytes) 2024-09-13T06:43:09.762 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:43:09.762 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:43:09.762 INFO:teuthology.orchestra.run.smithi081.stdout:5911 read 0x5a7160f thru 0x5a75b90 (0x4582 bytes) 2024-09-13T06:43:09.763 INFO:teuthology.orchestra.run.smithi081.stdout:5912 read 0x9bb9bf thru 0x9c8b8e (0xd1d0 bytes) 2024-09-13T06:43:09.764 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-13T06:43:09.764 INFO:teuthology.orchestra.run.smithi081.stdout:5913 read 0x809889c thru 0x80a4e4c (0xc5b1 bytes) 2024-09-13T06:43:09.768 INFO:teuthology.orchestra.run.smithi081.stdout:5914 trunc from 0x8a1185c to 0x74253e7 2024-09-13T06:43:09.795 INFO:teuthology.orchestra.run.smithi081.stdout:5916 write 0x64d20ba thru 0x64dc8d0 (0xa817 bytes) 2024-09-13T06:43:09.799 INFO:teuthology.orchestra.run.smithi081.stdout:5917 write 0x12bdfdc thru 0x12cc7fe (0xe823 bytes) 2024-09-13T06:43:09.803 INFO:teuthology.orchestra.run.smithi081.stdout:5918 writesame 0x2b9303d thru 0x2b944e6 data_size 0x17(0x14aa bytes) 2024-09-13T06:43:09.807 INFO:teuthology.orchestra.run.smithi081.stdout:5919 read 0x51c8e32 thru 0x51c9ff8 (0x11c7 bytes) 2024-09-13T06:43:09.808 INFO:teuthology.orchestra.run.smithi081.stdout:5920 write 0x10ef155 thru 0x10f8436 (0x92e2 bytes) 2024-09-13T06:43:09.811 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:43:09.811 INFO:teuthology.orchestra.run.smithi081.stdout:5922 punch from 0x385f87f to 0x3867bad, (0x832e bytes) 2024-09-13T06:43:09.812 INFO:teuthology.orchestra.run.smithi081.stdout:5923 write 0x37111f2 thru 0x371b171 (0x9f80 bytes) 2024-09-13T06:43:09.827 INFO:teuthology.orchestra.run.smithi081.stdout:5925 writesame 0x8873368 thru 0x8878d24 data_size 0x1(0x59bd bytes) 2024-09-13T06:43:09.827 INFO:teuthology.orchestra.run.smithi081.stdout:5926 write 0x2083ed3 thru 0x208899e (0x4acc bytes) 2024-09-13T06:43:09.830 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:43:09.830 INFO:teuthology.orchestra.run.smithi081.stdout:5929 read 0xe51d1f thru 0xe5a7c1 (0x8aa3 bytes) 2024-09-13T06:43:09.831 INFO:teuthology.orchestra.run.smithi081.stdout:5930 write 0x2997d5e thru 0x299b36f (0x3612 bytes) 2024-09-13T06:43:09.834 INFO:teuthology.orchestra.run.smithi081.stdout:5932 read 0x58d2647 thru 0x58ddd27 (0xb6e1 bytes) 2024-09-13T06:43:09.835 INFO:teuthology.orchestra.run.smithi081.stdout:5933 read 0x21d0703 thru 0x21d25ec (0x1eea bytes) 2024-09-13T06:43:09.836 INFO:teuthology.orchestra.run.smithi081.stdout:5934 write 0x5a2b499 thru 0x5a30b58 (0x56c0 bytes) 2024-09-13T06:43:09.839 INFO:teuthology.orchestra.run.smithi081.stdout:5936 read 0x1cb5f7a thru 0x1cc1984 (0xba0b bytes) 2024-09-13T06:43:09.840 INFO:teuthology.orchestra.run.smithi081.stdout:5937 write 0xb684f9 thru 0xb69107 (0xc0f bytes) 2024-09-13T06:43:09.848 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:43:09.849+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:43:09.860 INFO:teuthology.orchestra.run.smithi081.stdout:5938 write 0xc681ab7 thru 0xc68fd45 (0xe28f bytes) 2024-09-13T06:43:09.879 INFO:teuthology.orchestra.run.smithi081.stdout:5939 write 0xd0a0c74 thru 0xd0aa5bf (0x994c bytes) 2024-09-13T06:43:09.887 INFO:teuthology.orchestra.run.smithi081.stdout:5941 write 0x7a610e2 thru 0x7a664e6 (0x5405 bytes) 2024-09-13T06:43:09.894 INFO:teuthology.orchestra.run.smithi081.stdout:5942 punch from 0x1e6dd88 to 0x1e70d8a, (0x3002 bytes) 2024-09-13T06:43:09.894 INFO:teuthology.orchestra.run.smithi081.stdout:5943 punch from 0x9b4ebf2 to 0x9b4fa1d, (0xe2b bytes) 2024-09-13T06:43:09.894 INFO:teuthology.orchestra.run.smithi081.stdout:5944 write 0x4179430 thru 0x41849c1 (0xb592 bytes) 2024-09-13T06:43:09.897 INFO:teuthology.orchestra.run.smithi081.stdout:5947 writesame 0x239414f thru 0x23963dc data_size 0x1(0x228e bytes) 2024-09-13T06:43:09.899 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:43:09.899 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 20, 2024-09-13T06:43:09.899 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 600, 2024-09-13T06:43:09.899 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [ 2024-09-13T06:43:09.899 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.900 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:90987 3.6 3:6263dd97:::rbd_object_map.11212443ae03.0000000000000049:head [call] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-13T06:43:09.900 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:41:35.460333+0000", 2024-09-13T06:43:09.900 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 94.439258476000006, 2024-09-13T06:43:09.900 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0001633640000001, 2024-09-13T06:43:09.900 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:09.900 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:09.900 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:09.900 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:09.900 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:09.900 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 90987 2024-09-13T06:43:09.900 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.900 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:09.900 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.901 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:09.901 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:35.460333+0000", 2024-09-13T06:43:09.901 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:09.901 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.901 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.901 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:09.901 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:35.460333+0000", 2024-09-13T06:43:09.901 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:09.901 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.901 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.901 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:09.901 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:35.460330+0000", 2024-09-13T06:43:09.901 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999971 2024-09-13T06:43:09.901 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.901 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.902 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:09.902 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:35.460343+0000", 2024-09-13T06:43:09.902 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2695e-05 2024-09-13T06:43:09.902 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.902 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.902 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:09.902 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:35.460365+0000", 2024-09-13T06:43:09.902 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2473999999999999e-05 2024-09-13T06:43:09.902 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.902 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.902 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:09.902 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:35.460376+0000", 2024-09-13T06:43:09.902 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0383999999999999e-05 2024-09-13T06:43:09.902 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.903 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.903 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:09.903 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:35.460435+0000", 2024-09-13T06:43:09.903 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8650000000000003e-05 2024-09-13T06:43:09.903 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.903 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.903 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:43:09.903 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:35.460444+0000", 2024-09-13T06:43:09.903 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.0380000000000005e-06 2024-09-13T06:43:09.903 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.903 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.903 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:09.904 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:36.459433+0000", 2024-09-13T06:43:09.904 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.99898895799999998 2024-09-13T06:43:09.904 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.904 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.904 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:09.904 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:36.459622+0000", 2024-09-13T06:43:09.904 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00018940299999999999 2024-09-13T06:43:09.904 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.904 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.904 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:09.904 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:36.460497+0000", 2024-09-13T06:43:09.904 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00087481199999999999 2024-09-13T06:43:09.904 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:09.904 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:09.905 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:09.905 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.905 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.905 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:159632 3.a 3:57f62123:::rbd_header.112138ed422:head [create,call rbd.create in=9b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e167)", 2024-09-13T06:43:09.905 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:42:07.853351+0000", 2024-09-13T06:43:09.905 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 62.046240674000003, 2024-09-13T06:43:09.905 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.95572760999999995, 2024-09-13T06:43:09.905 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:09.905 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:43:09.905 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:09.905 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:09.905 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:09.905 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 159632 2024-09-13T06:43:09.906 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.906 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:09.906 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.906 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:09.906 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:07.853351+0000", 2024-09-13T06:43:09.906 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:09.906 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.906 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.906 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:09.906 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:07.853351+0000", 2024-09-13T06:43:09.906 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:09.906 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.906 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.906 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:09.906 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:07.853350+0000", 2024-09-13T06:43:09.907 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.999999 2024-09-13T06:43:09.907 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.907 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.907 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:09.907 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:07.853356+0000", 2024-09-13T06:43:09.907 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.1560000000000003e-06 2024-09-13T06:43:09.907 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.907 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.907 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:09.907 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:07.853365+0000", 2024-09-13T06:43:09.907 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.8079999999999999e-06 2024-09-13T06:43:09.907 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.907 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.907 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:09.907 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:07.853372+0000", 2024-09-13T06:43:09.907 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.5540000000000003e-06 2024-09-13T06:43:09.908 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.908 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.908 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:09.908 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:07.853430+0000", 2024-09-13T06:43:09.908 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8038000000000002e-05 2024-09-13T06:43:09.908 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.908 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.908 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:43:09.908 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:07.853444+0000", 2024-09-13T06:43:09.908 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3719e-05 2024-09-13T06:43:09.908 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.908 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.908 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:09.909 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:08.804052+0000", 2024-09-13T06:43:09.909 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.95060817799999997 2024-09-13T06:43:09.909 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.909 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.909 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:09.910 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:08.804234+0000", 2024-09-13T06:43:09.910 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00018192999999999999 2024-09-13T06:43:09.910 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.910 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.910 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 6", 2024-09-13T06:43:09.910 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:08.804797+0000", 2024-09-13T06:43:09.910 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00056282399999999996 2024-09-13T06:43:09.910 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.910 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.910 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-09-13T06:43:09.910 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:08.805704+0000", 2024-09-13T06:43:09.911 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00090781 2024-09-13T06:43:09.911 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.911 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.911 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:43:09.911 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:08.808907+0000", 2024-09-13T06:43:09.911 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0032031239999999999 2024-09-13T06:43:09.911 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.911 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.911 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:43:09.911 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:08.808998+0000", 2024-09-13T06:43:09.911 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.0191000000000004e-05 2024-09-13T06:43:09.911 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.911 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.912 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:09.912 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:08.809079+0000", 2024-09-13T06:43:09.912 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.1076999999999996e-05 2024-09-13T06:43:09.912 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:09.912 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:09.912 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:09.912 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.912 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.912 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:209556 3.6 3:673cd4d4:::rbd_data.1121cb4a09ed.0000000000000002:82 [read 831488~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e220)", 2024-09-13T06:43:09.912 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:43:05.152927+0000", 2024-09-13T06:43:09.912 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 4.7466646739999998, 2024-09-13T06:43:09.912 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054987033999999997, 2024-09-13T06:43:09.912 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:09.913 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:09.913 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:09.913 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:09.913 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:09.913 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 209556 2024-09-13T06:43:09.913 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.913 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:09.913 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.913 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:09.913 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.152927+0000", 2024-09-13T06:43:09.913 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:09.913 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.913 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.914 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:09.914 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.152927+0000", 2024-09-13T06:43:09.914 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:09.914 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.914 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.914 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:09.914 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.152927+0000", 2024-09-13T06:43:09.914 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:09.914 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.914 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.914 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:09.914 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.152929+0000", 2024-09-13T06:43:09.914 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.514e-06 2024-09-13T06:43:09.915 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.915 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.915 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:09.915 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.152935+0000", 2024-09-13T06:43:09.915 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.5249999999999996e-06 2024-09-13T06:43:09.915 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.915 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.915 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:09.915 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.152939+0000", 2024-09-13T06:43:09.915 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.3209999999999998e-06 2024-09-13T06:43:09.915 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.915 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.916 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:09.916 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.207752+0000", 2024-09-13T06:43:09.916 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054813273000000003 2024-09-13T06:43:09.916 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.916 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.916 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:09.916 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.207834+0000", 2024-09-13T06:43:09.916 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.1317999999999996e-05 2024-09-13T06:43:09.916 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.916 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.916 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:09.916 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.207914+0000", 2024-09-13T06:43:09.916 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.0568000000000005e-05 2024-09-13T06:43:09.916 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:09.916 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:09.917 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:09.917 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.917 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.917 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:209557 3.6 3:673cd4d4:::rbd_data.1121cb4a09ed.0000000000000002:82 [read 843776~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e220)", 2024-09-13T06:43:09.917 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:43:05.152944+0000", 2024-09-13T06:43:09.917 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 4.7466481700000003, 2024-09-13T06:43:09.917 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.055174645000000001, 2024-09-13T06:43:09.917 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:09.917 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:09.917 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:09.918 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:09.918 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:09.918 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 209557 2024-09-13T06:43:09.918 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.918 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:09.918 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.918 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:09.918 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.152944+0000", 2024-09-13T06:43:09.918 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:09.918 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.918 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.918 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:09.918 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.152944+0000", 2024-09-13T06:43:09.919 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:09.919 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.919 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.919 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:09.919 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.152943+0000", 2024-09-13T06:43:09.919 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:09.919 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.919 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.919 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:09.919 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.152946+0000", 2024-09-13T06:43:09.919 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2419999999999999e-06 2024-09-13T06:43:09.919 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.919 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.919 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:09.920 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.152951+0000", 2024-09-13T06:43:09.920 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7570000000000001e-06 2024-09-13T06:43:09.920 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.920 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.920 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:09.920 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.152955+0000", 2024-09-13T06:43:09.920 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.0080000000000004e-06 2024-09-13T06:43:09.920 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.920 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.920 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:09.920 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.207958+0000", 2024-09-13T06:43:09.920 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.055002896000000003 2024-09-13T06:43:09.920 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.921 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.921 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:09.921 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.208041+0000", 2024-09-13T06:43:09.921 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.2962999999999998e-05 2024-09-13T06:43:09.921 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.921 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.921 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:09.921 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.208118+0000", 2024-09-13T06:43:09.921 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.7181000000000005e-05 2024-09-13T06:43:09.921 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:09.921 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:09.921 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:09.921 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.921 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.922 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:209558 3.6 3:673cd4d4:::rbd_data.1121cb4a09ed.0000000000000002:82 [read 856064~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e220)", 2024-09-13T06:43:09.922 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:43:05.152960+0000", 2024-09-13T06:43:09.922 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 4.7466319759999998, 2024-09-13T06:43:09.922 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.055296975999999998, 2024-09-13T06:43:09.922 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:09.922 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:09.922 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:09.922 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:09.922 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:09.922 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 209558 2024-09-13T06:43:09.922 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.922 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:09.922 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.922 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:09.922 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.152960+0000", 2024-09-13T06:43:09.923 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:09.923 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.923 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.923 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:09.923 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.152960+0000", 2024-09-13T06:43:09.923 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:09.923 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.923 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.923 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:09.923 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.152959+0000", 2024-09-13T06:43:09.923 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:09.923 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.923 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.923 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:09.924 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.152962+0000", 2024-09-13T06:43:09.924 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6709999999999999e-06 2024-09-13T06:43:09.924 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.924 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.924 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:09.924 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.152968+0000", 2024-09-13T06:43:09.924 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.5589999999999996e-06 2024-09-13T06:43:09.924 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.924 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.924 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:09.924 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.152972+0000", 2024-09-13T06:43:09.924 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.216e-06 2024-09-13T06:43:09.924 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.924 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.925 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:09.925 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.208146+0000", 2024-09-13T06:43:09.925 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.055173627000000003 2024-09-13T06:43:09.925 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.925 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.925 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:09.925 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.208193+0000", 2024-09-13T06:43:09.925 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7200000000000002e-05 2024-09-13T06:43:09.929 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.929 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.929 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:09.929 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.208257+0000", 2024-09-13T06:43:09.929 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.4058000000000002e-05 2024-09-13T06:43:09.929 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:09.929 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:09.929 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:09.929 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.929 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.930 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:209559 3.6 3:673cd4d4:::rbd_data.1121cb4a09ed.0000000000000002:82 [read 868352~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e220)", 2024-09-13T06:43:09.930 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:43:05.152976+0000", 2024-09-13T06:43:09.930 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 4.7466158629999997, 2024-09-13T06:43:09.930 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.055514239, 2024-09-13T06:43:09.930 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:09.930 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:09.930 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:09.930 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:09.930 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:09.930 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 209559 2024-09-13T06:43:09.930 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.931 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:09.931 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.931 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:09.931 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.152976+0000", 2024-09-13T06:43:09.931 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:09.931 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.931 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.931 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:09.931 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.152976+0000", 2024-09-13T06:43:09.931 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:09.931 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.931 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.931 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:09.932 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.152976+0000", 2024-09-13T06:43:09.932 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:09.932 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.932 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.932 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:09.932 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.152978+0000", 2024-09-13T06:43:09.932 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2189999999999998e-06 2024-09-13T06:43:09.932 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.932 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.932 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:09.932 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.152983+0000", 2024-09-13T06:43:09.932 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3639999999999998e-06 2024-09-13T06:43:09.932 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.933 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.933 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:09.933 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.152987+0000", 2024-09-13T06:43:09.933 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.9469999999999996e-06 2024-09-13T06:43:09.933 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.933 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.933 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:09.933 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.208301+0000", 2024-09-13T06:43:09.933 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.055314292000000001 2024-09-13T06:43:09.933 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.933 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.933 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:09.933 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.208385+0000", 2024-09-13T06:43:09.934 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.3755e-05 2024-09-13T06:43:09.934 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.934 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.934 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:09.934 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.208490+0000", 2024-09-13T06:43:09.934 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00010498800000000001 2024-09-13T06:43:09.934 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:09.934 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:09.934 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:09.934 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.934 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.935 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:209560 3.6 3:673cd4d4:::rbd_data.1121cb4a09ed.0000000000000002:82 [read 880640~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e220)", 2024-09-13T06:43:09.935 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:43:05.152991+0000", 2024-09-13T06:43:09.935 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 4.746600774, 2024-09-13T06:43:09.935 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.05572912, 2024-09-13T06:43:09.935 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:09.935 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:09.935 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:09.935 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:09.935 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:09.935 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 209560 2024-09-13T06:43:09.935 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.935 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:09.935 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.935 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:09.936 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.152991+0000", 2024-09-13T06:43:09.936 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:09.936 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.936 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.936 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:09.936 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.152991+0000", 2024-09-13T06:43:09.936 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:09.936 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.936 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.936 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:09.936 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.152991+0000", 2024-09-13T06:43:09.936 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:09.936 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.936 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.937 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:09.937 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.152993+0000", 2024-09-13T06:43:09.937 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3159999999999999e-06 2024-09-13T06:43:09.937 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.937 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.937 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:09.937 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.152999+0000", 2024-09-13T06:43:09.937 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8529999999999997e-06 2024-09-13T06:43:09.937 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.937 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.937 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:09.937 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153004+0000", 2024-09-13T06:43:09.937 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6210000000000003e-06 2024-09-13T06:43:09.937 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.938 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.938 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:09.938 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.208530+0000", 2024-09-13T06:43:09.938 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.055526407999999999 2024-09-13T06:43:09.938 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.938 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.938 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:09.938 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.208616+0000", 2024-09-13T06:43:09.938 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.6483000000000005e-05 2024-09-13T06:43:09.938 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.938 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.938 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:09.938 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.208720+0000", 2024-09-13T06:43:09.938 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00010376 2024-09-13T06:43:09.939 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:09.939 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:09.939 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:09.939 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.939 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.939 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:209561 3.6 3:673cd4d4:::rbd_data.1121cb4a09ed.0000000000000002:82 [read 892928~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e220)", 2024-09-13T06:43:09.939 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:43:05.153008+0000", 2024-09-13T06:43:09.939 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 4.7465838800000002, 2024-09-13T06:43:09.939 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0559225, 2024-09-13T06:43:09.939 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:09.939 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:09.939 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:09.939 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:09.939 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:09.939 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 209561 2024-09-13T06:43:09.940 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.940 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:09.940 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.940 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:09.940 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153008+0000", 2024-09-13T06:43:09.940 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:09.940 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.940 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.940 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:09.940 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153008+0000", 2024-09-13T06:43:09.940 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:09.940 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.940 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.940 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:09.941 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153008+0000", 2024-09-13T06:43:09.941 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:09.941 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.941 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.941 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:09.941 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153010+0000", 2024-09-13T06:43:09.941 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.8210000000000002e-06 2024-09-13T06:43:09.941 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.941 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.941 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:09.941 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153016+0000", 2024-09-13T06:43:09.941 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.575e-06 2024-09-13T06:43:09.941 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.942 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.942 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:09.942 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153020+0000", 2024-09-13T06:43:09.942 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.408e-06 2024-09-13T06:43:09.942 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.942 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.942 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:09.942 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.208751+0000", 2024-09-13T06:43:09.942 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.055730225000000001 2024-09-13T06:43:09.942 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.942 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.942 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:09.942 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.208825+0000", 2024-09-13T06:43:09.943 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4548999999999994e-05 2024-09-13T06:43:09.943 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.943 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.943 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:09.943 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.208930+0000", 2024-09-13T06:43:09.943 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00010529700000000001 2024-09-13T06:43:09.943 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:09.943 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:09.943 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:09.943 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.943 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.943 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:209562 3.6 3:673cd4d4:::rbd_data.1121cb4a09ed.0000000000000002:82 [read 905216~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e220)", 2024-09-13T06:43:09.944 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:43:05.153024+0000", 2024-09-13T06:43:09.944 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 4.746567454, 2024-09-13T06:43:09.944 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.056099906999999997, 2024-09-13T06:43:09.944 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:09.944 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:09.944 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:09.944 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:09.944 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:09.944 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 209562 2024-09-13T06:43:09.944 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.944 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:09.944 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.944 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:09.945 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153024+0000", 2024-09-13T06:43:09.945 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:09.945 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.945 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.945 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:09.945 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153024+0000", 2024-09-13T06:43:09.945 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:09.945 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.945 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.945 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:09.945 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153024+0000", 2024-09-13T06:43:09.945 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:09.945 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.945 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.946 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:09.946 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153026+0000", 2024-09-13T06:43:09.946 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.165e-06 2024-09-13T06:43:09.946 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.946 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.946 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:09.946 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153031+0000", 2024-09-13T06:43:09.946 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.1669999999999998e-06 2024-09-13T06:43:09.946 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.946 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.946 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:09.946 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153035+0000", 2024-09-13T06:43:09.946 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.0799999999999999e-06 2024-09-13T06:43:09.946 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.947 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.947 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:09.947 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.208956+0000", 2024-09-13T06:43:09.947 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.055920848000000002 2024-09-13T06:43:09.947 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.947 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.947 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:09.947 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.209032+0000", 2024-09-13T06:43:09.947 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5809999999999994e-05 2024-09-13T06:43:09.947 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.947 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.947 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:09.947 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.209124+0000", 2024-09-13T06:43:09.948 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.2157999999999994e-05 2024-09-13T06:43:09.948 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:09.948 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:09.948 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:09.948 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.948 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.948 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:209563 3.6 3:673cd4d4:::rbd_data.1121cb4a09ed.0000000000000002:82 [read 917504~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e220)", 2024-09-13T06:43:09.948 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:43:05.153039+0000", 2024-09-13T06:43:09.948 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 4.7465524910000001, 2024-09-13T06:43:09.948 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.056280030000000002, 2024-09-13T06:43:09.948 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:09.948 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:09.949 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:09.949 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:09.949 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:09.949 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 209563 2024-09-13T06:43:09.949 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.949 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:09.949 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.949 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:09.949 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153039+0000", 2024-09-13T06:43:09.949 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:09.949 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.949 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.949 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:09.950 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153039+0000", 2024-09-13T06:43:09.950 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:09.950 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.950 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.950 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:09.950 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153039+0000", 2024-09-13T06:43:09.950 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:09.950 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.950 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.950 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:09.950 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153041+0000", 2024-09-13T06:43:09.950 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3800000000000001e-06 2024-09-13T06:43:09.950 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.951 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.951 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:09.951 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153047+0000", 2024-09-13T06:43:09.951 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2059999999999998e-06 2024-09-13T06:43:09.951 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.951 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.951 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:09.951 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153051+0000", 2024-09-13T06:43:09.951 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.0980000000000004e-06 2024-09-13T06:43:09.951 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.951 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.951 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:09.951 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.209150+0000", 2024-09-13T06:43:09.952 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.056099351999999998 2024-09-13T06:43:09.952 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.952 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.952 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:09.952 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.209226+0000", 2024-09-13T06:43:09.952 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5939999999999995e-05 2024-09-13T06:43:09.952 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.952 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.952 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:09.952 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.209319+0000", 2024-09-13T06:43:09.952 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.3399000000000005e-05 2024-09-13T06:43:09.953 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:09.953 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:09.953 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:09.953 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.953 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.953 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:209564 3.6 3:673cd4d4:::rbd_data.1121cb4a09ed.0000000000000002:82 [read 929792~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e220)", 2024-09-13T06:43:09.953 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:43:05.153055+0000", 2024-09-13T06:43:09.953 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 4.7465372449999998, 2024-09-13T06:43:09.953 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.056404468999999999, 2024-09-13T06:43:09.953 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:09.953 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:09.953 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:09.953 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:09.954 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:09.954 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 209564 2024-09-13T06:43:09.954 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.954 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:09.954 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.954 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:09.954 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153055+0000", 2024-09-13T06:43:09.954 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:09.954 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.954 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.954 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:09.954 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153055+0000", 2024-09-13T06:43:09.954 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:09.954 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.954 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.955 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:09.955 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153054+0000", 2024-09-13T06:43:09.955 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:09.955 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.955 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.955 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:09.955 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153056+0000", 2024-09-13T06:43:09.955 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1600000000000001e-06 2024-09-13T06:43:09.955 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.955 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.955 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:09.955 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153062+0000", 2024-09-13T06:43:09.955 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2549999999999997e-06 2024-09-13T06:43:09.955 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.955 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.956 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:09.956 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153066+0000", 2024-09-13T06:43:09.956 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.0400000000000003e-06 2024-09-13T06:43:09.956 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.956 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.956 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:09.956 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.209342+0000", 2024-09-13T06:43:09.956 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.056276640000000003 2024-09-13T06:43:09.956 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.956 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.956 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:09.956 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.209382+0000", 2024-09-13T06:43:09.957 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.9626999999999999e-05 2024-09-13T06:43:09.957 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.957 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.957 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:09.957 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.209459+0000", 2024-09-13T06:43:09.957 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.7072999999999999e-05 2024-09-13T06:43:09.957 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:09.957 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:09.957 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:09.957 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.957 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.957 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:209565 3.6 3:673cd4d4:::rbd_data.1121cb4a09ed.0000000000000002:82 [read 942080~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e220)", 2024-09-13T06:43:09.957 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:43:05.153070+0000", 2024-09-13T06:43:09.958 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 4.746522272, 2024-09-13T06:43:09.958 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.056688545999999999, 2024-09-13T06:43:09.958 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:09.958 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:09.958 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:09.958 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:09.958 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:09.958 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 209565 2024-09-13T06:43:09.958 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.958 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:09.958 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.958 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:09.958 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153070+0000", 2024-09-13T06:43:09.959 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:09.959 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.959 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.959 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:09.959 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153070+0000", 2024-09-13T06:43:09.959 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:09.959 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.959 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.959 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:09.959 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153069+0000", 2024-09-13T06:43:09.959 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:09.959 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.960 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.960 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:09.960 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153071+0000", 2024-09-13T06:43:09.960 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1780000000000002e-06 2024-09-13T06:43:09.960 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.960 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.960 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:09.960 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153077+0000", 2024-09-13T06:43:09.960 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3639999999999998e-06 2024-09-13T06:43:09.960 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.960 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.960 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:09.960 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153081+0000", 2024-09-13T06:43:09.960 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.1640000000000003e-06 2024-09-13T06:43:09.961 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.961 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.961 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:09.961 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.209486+0000", 2024-09-13T06:43:09.961 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.056405258999999999 2024-09-13T06:43:09.961 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.961 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.961 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:09.961 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.209560+0000", 2024-09-13T06:43:09.961 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4247999999999998e-05 2024-09-13T06:43:09.961 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.961 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.961 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:09.962 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.209758+0000", 2024-09-13T06:43:09.962 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000197634 2024-09-13T06:43:09.962 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:09.962 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:09.962 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:09.962 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.962 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.962 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:209566 3.6 3:673cd4d4:::rbd_data.1121cb4a09ed.0000000000000002:82 [read 954368~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e220)", 2024-09-13T06:43:09.962 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:43:05.153085+0000", 2024-09-13T06:43:09.962 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 4.7465069629999999, 2024-09-13T06:43:09.962 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.057070779000000002, 2024-09-13T06:43:09.962 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:09.962 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:09.963 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:09.963 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:09.963 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:09.963 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 209566 2024-09-13T06:43:09.963 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.963 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:09.963 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.963 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:09.963 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153085+0000", 2024-09-13T06:43:09.963 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:09.963 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.963 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.963 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:09.964 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153085+0000", 2024-09-13T06:43:09.964 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:09.964 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.964 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.964 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:09.964 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153085+0000", 2024-09-13T06:43:09.964 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:09.964 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.964 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.964 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:09.964 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153087+0000", 2024-09-13T06:43:09.964 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1220000000000002e-06 2024-09-13T06:43:09.965 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.965 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.965 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:09.965 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153092+0000", 2024-09-13T06:43:09.965 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3090000000000003e-06 2024-09-13T06:43:09.965 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.965 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.965 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:09.965 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153096+0000", 2024-09-13T06:43:09.965 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.1819999999999999e-06 2024-09-13T06:43:09.965 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.965 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.966 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:09.966 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.209787+0000", 2024-09-13T06:43:09.966 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.056690819000000003 2024-09-13T06:43:09.966 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.966 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.966 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:09.966 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.209863+0000", 2024-09-13T06:43:09.966 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5551999999999998e-05 2024-09-13T06:43:09.966 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.966 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.966 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:09.966 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.210156+0000", 2024-09-13T06:43:09.966 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00029310499999999999 2024-09-13T06:43:09.966 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:09.967 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:09.967 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:09.967 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.967 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.967 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:209567 3.6 3:673cd4d4:::rbd_data.1121cb4a09ed.0000000000000002:82 [read 966656~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e220)", 2024-09-13T06:43:09.967 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:43:05.153100+0000", 2024-09-13T06:43:09.967 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 4.7464915899999998, 2024-09-13T06:43:09.967 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.057459567000000003, 2024-09-13T06:43:09.967 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:09.967 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:09.967 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:09.967 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:09.967 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:09.968 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 209567 2024-09-13T06:43:09.968 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.968 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:09.968 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.968 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:09.968 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153100+0000", 2024-09-13T06:43:09.968 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:09.968 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.968 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.968 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:09.968 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153100+0000", 2024-09-13T06:43:09.968 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:09.968 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.968 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.969 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:09.969 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153100+0000", 2024-09-13T06:43:09.969 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:09.969 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.969 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.969 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:09.969 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153105+0000", 2024-09-13T06:43:09.969 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.5400000000000003e-06 2024-09-13T06:43:09.969 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.969 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.969 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:09.969 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153111+0000", 2024-09-13T06:43:09.969 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.541e-06 2024-09-13T06:43:09.970 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.970 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.970 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:09.970 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153115+0000", 2024-09-13T06:43:09.970 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.104e-06 2024-09-13T06:43:09.970 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.970 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.970 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:09.970 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.210183+0000", 2024-09-13T06:43:09.970 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.057067842000000001 2024-09-13T06:43:09.970 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.970 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.970 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:09.971 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.210257+0000", 2024-09-13T06:43:09.971 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3726999999999994e-05 2024-09-13T06:43:09.971 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.971 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.971 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:09.971 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.210560+0000", 2024-09-13T06:43:09.971 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00030318899999999999 2024-09-13T06:43:09.971 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:09.971 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:09.971 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:09.971 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.971 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.971 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:209568 3.6 3:673cd4d4:::rbd_data.1121cb4a09ed.0000000000000002:82 [read 978944~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e220)", 2024-09-13T06:43:09.971 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:43:05.153119+0000", 2024-09-13T06:43:09.972 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 4.7464723900000001, 2024-09-13T06:43:09.972 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.057810786000000003, 2024-09-13T06:43:09.972 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:09.972 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:09.972 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:09.972 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:09.972 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:09.972 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 209568 2024-09-13T06:43:09.972 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.972 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:09.972 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.972 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:09.972 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153119+0000", 2024-09-13T06:43:09.972 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:09.973 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.973 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.973 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:09.973 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153119+0000", 2024-09-13T06:43:09.973 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:09.973 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.973 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.973 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:09.973 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153119+0000", 2024-09-13T06:43:09.973 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:09.973 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.973 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.973 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:09.973 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153121+0000", 2024-09-13T06:43:09.974 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.21e-06 2024-09-13T06:43:09.974 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.974 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.974 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:09.974 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153127+0000", 2024-09-13T06:43:09.974 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.4670000000000003e-06 2024-09-13T06:43:09.974 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.974 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.974 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:09.974 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153131+0000", 2024-09-13T06:43:09.974 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.2629999999999997e-06 2024-09-13T06:43:09.974 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.974 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.975 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:09.975 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.210587+0000", 2024-09-13T06:43:09.975 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.05745567 2024-09-13T06:43:09.975 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.975 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.975 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:09.975 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.210660+0000", 2024-09-13T06:43:09.975 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3430000000000007e-05 2024-09-13T06:43:09.975 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.975 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.975 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:09.975 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.210930+0000", 2024-09-13T06:43:09.975 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000270127 2024-09-13T06:43:09.975 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:09.976 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:09.976 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:09.976 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.976 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.976 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:209569 3.6 3:673cd4d4:::rbd_data.1121cb4a09ed.0000000000000002:82 [read 991232~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e220)", 2024-09-13T06:43:09.976 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:43:05.153135+0000", 2024-09-13T06:43:09.976 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 4.7464569650000001, 2024-09-13T06:43:09.976 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.058283125999999998, 2024-09-13T06:43:09.976 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:09.976 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:09.976 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:09.976 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:09.976 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:09.977 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 209569 2024-09-13T06:43:09.977 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.977 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:09.977 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.977 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:09.977 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153135+0000", 2024-09-13T06:43:09.977 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:09.977 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.977 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.977 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:09.977 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153135+0000", 2024-09-13T06:43:09.978 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:09.978 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.978 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.978 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:09.978 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153135+0000", 2024-09-13T06:43:09.978 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:09.978 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.978 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.978 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:09.978 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153136+0000", 2024-09-13T06:43:09.978 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9069999999999999e-06 2024-09-13T06:43:09.978 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.978 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.979 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:09.979 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153142+0000", 2024-09-13T06:43:09.979 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3009999999999997e-06 2024-09-13T06:43:09.979 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.979 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.979 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:09.979 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153146+0000", 2024-09-13T06:43:09.979 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.442e-06 2024-09-13T06:43:09.979 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.979 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.979 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:09.979 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.210959+0000", 2024-09-13T06:43:09.979 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.057812456999999998 2024-09-13T06:43:09.979 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.980 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.980 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:09.980 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.211038+0000", 2024-09-13T06:43:09.980 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.9140999999999993e-05 2024-09-13T06:43:09.980 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.980 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.980 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:09.980 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.211418+0000", 2024-09-13T06:43:09.980 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00038017500000000001 2024-09-13T06:43:09.980 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:09.980 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:09.980 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:09.980 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.981 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.981 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:209570 3.6 3:673cd4d4:::rbd_data.1121cb4a09ed.0000000000000002:82 [read 1003520~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e220)", 2024-09-13T06:43:09.981 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:43:05.153151+0000", 2024-09-13T06:43:09.981 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 4.7464410820000005, 2024-09-13T06:43:09.981 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.058499886000000001, 2024-09-13T06:43:09.981 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:09.981 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:09.981 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:09.981 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:09.981 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:09.981 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 209570 2024-09-13T06:43:09.981 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.982 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:09.982 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.982 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:09.982 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153151+0000", 2024-09-13T06:43:09.982 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:09.982 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.982 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.982 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:09.982 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153151+0000", 2024-09-13T06:43:09.982 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:09.982 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.982 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.982 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:09.983 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153150+0000", 2024-09-13T06:43:09.983 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:09.983 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.983 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.983 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:09.983 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153153+0000", 2024-09-13T06:43:09.983 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3630000000000001e-06 2024-09-13T06:43:09.983 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.983 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.983 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:09.983 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153159+0000", 2024-09-13T06:43:09.983 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3690000000000003e-06 2024-09-13T06:43:09.983 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.984 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.984 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:09.984 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153164+0000", 2024-09-13T06:43:09.984 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5379999999999996e-06 2024-09-13T06:43:09.984 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.984 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.984 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:09.984 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.211448+0000", 2024-09-13T06:43:09.984 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.058283926 2024-09-13T06:43:09.984 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.984 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.984 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:09.984 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.211508+0000", 2024-09-13T06:43:09.985 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0741e-05 2024-09-13T06:43:09.985 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.985 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.985 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:09.985 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.211651+0000", 2024-09-13T06:43:09.985 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00014232200000000001 2024-09-13T06:43:09.985 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:09.985 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:09.985 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:09.985 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.985 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.985 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:209571 3.6 3:673cd4d4:::rbd_data.1121cb4a09ed.0000000000000002:82 [read 1015808~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e220)", 2024-09-13T06:43:09.985 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:43:05.153168+0000", 2024-09-13T06:43:09.985 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 4.7464235710000002, 2024-09-13T06:43:09.986 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.058709363000000001, 2024-09-13T06:43:09.986 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:09.986 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:09.986 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:09.986 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:09.986 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:09.986 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 209571 2024-09-13T06:43:09.986 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.986 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:09.986 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.986 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:09.986 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153168+0000", 2024-09-13T06:43:09.987 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:09.987 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.987 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.987 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:09.987 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153168+0000", 2024-09-13T06:43:09.987 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:09.987 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.987 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.987 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:09.987 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153168+0000", 2024-09-13T06:43:09.987 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:09.987 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.987 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.988 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:09.988 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153170+0000", 2024-09-13T06:43:09.988 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4499999999999998e-06 2024-09-13T06:43:09.988 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.988 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.988 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:09.988 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153176+0000", 2024-09-13T06:43:09.988 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0050000000000001e-06 2024-09-13T06:43:09.988 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.988 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.988 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:09.988 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153181+0000", 2024-09-13T06:43:09.988 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.267e-06 2024-09-13T06:43:09.989 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.989 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.989 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:09.989 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.211678+0000", 2024-09-13T06:43:09.989 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.058497751000000001 2024-09-13T06:43:09.989 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.989 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.989 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:09.989 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.211744+0000", 2024-09-13T06:43:09.989 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.5266999999999997e-05 2024-09-13T06:43:09.989 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.989 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.989 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:09.989 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.211878+0000", 2024-09-13T06:43:09.990 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00013394500000000001 2024-09-13T06:43:09.990 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:09.990 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:09.990 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:09.990 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.990 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.990 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:209572 3.6 3:673cd4d4:::rbd_data.1121cb4a09ed.0000000000000002:82 [read 1028096~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e220)", 2024-09-13T06:43:09.990 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:43:05.153185+0000", 2024-09-13T06:43:09.990 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 4.746407176, 2024-09-13T06:43:09.990 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.058928534999999997, 2024-09-13T06:43:09.990 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:09.990 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:09.990 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:09.991 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:09.991 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:09.991 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 209572 2024-09-13T06:43:09.991 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.991 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:09.991 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.991 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:09.991 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153185+0000", 2024-09-13T06:43:09.991 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:09.991 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.991 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.991 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:09.991 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153185+0000", 2024-09-13T06:43:09.992 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:09.992 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.992 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.992 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:09.992 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153184+0000", 2024-09-13T06:43:09.992 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:09.992 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.992 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.992 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:09.992 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153186+0000", 2024-09-13T06:43:09.992 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1040000000000001e-06 2024-09-13T06:43:09.992 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.992 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.993 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:09.993 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153191+0000", 2024-09-13T06:43:09.993 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0409999999999997e-06 2024-09-13T06:43:09.993 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.993 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.993 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:09.993 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153196+0000", 2024-09-13T06:43:09.993 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.2200000000000003e-06 2024-09-13T06:43:09.993 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.993 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.993 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:09.993 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.211906+0000", 2024-09-13T06:43:09.993 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.058709960999999998 2024-09-13T06:43:09.994 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.994 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.994 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:09.994 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.211977+0000", 2024-09-13T06:43:09.994 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.1080000000000004e-05 2024-09-13T06:43:09.994 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.994 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.994 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:09.994 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.212113+0000", 2024-09-13T06:43:09.994 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00013644500000000001 2024-09-13T06:43:09.994 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:09.994 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:09.994 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:09.995 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.995 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.995 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:209573 3.6 3:673cd4d4:::rbd_data.1121cb4a09ed.0000000000000002:82 [read 1040384~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e220)", 2024-09-13T06:43:09.995 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:43:05.153199+0000", 2024-09-13T06:43:09.995 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 4.7463923860000001, 2024-09-13T06:43:09.995 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.059182414000000003, 2024-09-13T06:43:09.995 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:09.995 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:09.995 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:09.995 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:09.995 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:09.995 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 209573 2024-09-13T06:43:09.995 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.996 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:09.996 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.996 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:09.996 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153199+0000", 2024-09-13T06:43:09.996 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:09.996 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.996 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.996 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:09.996 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153199+0000", 2024-09-13T06:43:09.996 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:09.996 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.996 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.996 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:09.996 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153199+0000", 2024-09-13T06:43:09.997 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:09.997 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.997 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.997 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:09.997 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153201+0000", 2024-09-13T06:43:09.997 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0470000000000001e-06 2024-09-13T06:43:09.997 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.997 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.997 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:09.997 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153207+0000", 2024-09-13T06:43:09.997 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3730000000000001e-06 2024-09-13T06:43:09.997 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.997 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.997 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:09.997 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153211+0000", 2024-09-13T06:43:09.998 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.053e-06 2024-09-13T06:43:09.998 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.998 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.998 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:09.998 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.212141+0000", 2024-09-13T06:43:09.998 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.058930064999999997 2024-09-13T06:43:09.998 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.998 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.998 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:09.998 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.212214+0000", 2024-09-13T06:43:09.998 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3096999999999995e-05 2024-09-13T06:43:09.998 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:09.998 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:09.998 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:09.998 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.212382+0000", 2024-09-13T06:43:09.999 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000168138 2024-09-13T06:43:09.999 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:09.999 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:09.999 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:09.999 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:09.999 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:09.999 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:43:09.999 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-13T06:43:10.001 INFO:teuthology.orchestra.run.smithi081.stdout:5948 read 0x59e1c24 thru 0x59f17da (0xfbb7 bytes) 2024-09-13T06:43:10.001 INFO:teuthology.orchestra.run.smithi081.stdout:5949 read 0xfa957e thru 0xfa9bce (0x651 bytes) 2024-09-13T06:43:10.001 INFO:teuthology.orchestra.run.smithi081.stdout:5950 write 0x4a777aa thru 0x4a817fe (0xa055 bytes) 2024-09-13T06:43:10.001 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:43:10.001 INFO:teuthology.orchestra.run.smithi081.stdout:5953 read 0x16c476a thru 0x16ce573 (0x9e0a bytes) 2024-09-13T06:43:10.001 INFO:teuthology.orchestra.run.smithi081.stdout:5955 punch from 0x1baedc4 to 0x1bbb6bb, (0xc8f7 bytes) 2024-09-13T06:43:10.001 INFO:teuthology.orchestra.run.smithi081.stdout:5957 writesame 0x943e798 thru 0x94410a8 data_size 0x1(0x2911 bytes) 2024-09-13T06:43:10.002 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-13T06:43:10.003 INFO:teuthology.orchestra.run.smithi081.stdout:5958 write 0xd94bd63 thru 0xd954811 (0x8aaf bytes) 2024-09-13T06:43:10.003 INFO:teuthology.orchestra.run.smithi081.stdout:5961 read 0x7c436d9 thru 0x7c44d47 (0x166f bytes) 2024-09-13T06:43:10.003 INFO:teuthology.orchestra.run.smithi081.stdout:5962 write 0xd6644fb thru 0xd66ffb4 (0xbaba bytes) 2024-09-13T06:43:10.004 INFO:teuthology.orchestra.run.smithi081.stdout:5963 trunc from 0xd954812 to 0xd8b1e6e 2024-09-13T06:43:10.004 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:43:10.004 INFO:teuthology.orchestra.run.smithi081.stdout:5967 punch from 0xb5ab925 to 0xb5bab49, (0xf224 bytes) 2024-09-13T06:43:10.004 INFO:teuthology.orchestra.run.smithi081.stdout:5968 trunc from 0xd8b1e6e to 0xbfadd11 2024-09-13T06:43:10.004 INFO:teuthology.orchestra.run.smithi081.stdout:5969 writesame 0x3ab878b thru 0x3ac60a8 data_size 0x1(0xd91e bytes) 2024-09-13T06:43:10.004 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:43:10.000+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:43:10.015 INFO:teuthology.orchestra.run.smithi081.stdout:5971 read 0xbb4247c thru 0xbb440b8 (0x1c3d bytes) 2024-09-13T06:43:10.016 INFO:teuthology.orchestra.run.smithi081.stdout:5972 writesame 0x733186 thru 0x735790 data_size 0x1(0x260b bytes) 2024-09-13T06:43:10.024 INFO:teuthology.orchestra.run.smithi081.stdout:5974 read 0x2ee9ca1 thru 0x2eea622 (0x982 bytes) 2024-09-13T06:43:10.025 INFO:teuthology.orchestra.run.smithi081.stdout:5977 read 0x18fb6f5 thru 0x1907262 (0xbb6e bytes) 2024-09-13T06:43:10.026 INFO:teuthology.orchestra.run.smithi081.stdout:5978 write 0x9172a52 thru 0x9177efd (0x54ac bytes) 2024-09-13T06:43:10.030 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 7, 5, 3, 4] out_osds: [6] dead_osds: [6] live_osds: [0, 1, 2, 3, 4, 5, 7] 2024-09-13T06:43:10.030 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-13T06:43:10.030 INFO:tasks.thrashosds.thrasher:inject_pause on osd.2 2024-09-13T06:43:10.030 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-09-13T06:43:10.030 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-09-13T06:43:10.031 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok config set filestore_inject_stall 3 2024-09-13T06:43:10.045 INFO:teuthology.orchestra.run.smithi081.stdout:5979 write 0xc9d0e12 thru 0xc9dc409 (0xb5f8 bytes) 2024-09-13T06:43:10.053 INFO:teuthology.orchestra.run.smithi081.stdout:5980 read 0x1e9497 thru 0x1f7515 (0xe07f bytes) 2024-09-13T06:43:10.055 INFO:teuthology.orchestra.run.smithi081.stdout:5981 trunc from 0xc9dc40a to 0xc3480d9 2024-09-13T06:43:10.072 INFO:teuthology.orchestra.run.smithi081.stdout:5982 write 0x38ea6f1 thru 0x38f250a (0x7e1a bytes) 2024-09-13T06:43:10.091 INFO:teuthology.orchestra.run.smithi081.stdout:5983 trunc from 0xc3480d9 to 0x196e265 2024-09-13T06:43:10.101 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:43:10.100+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:43:10.158 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:43:10.173 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:43:10.173 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-13T06:43:10.173 INFO:teuthology.orchestra.run.smithi081.stdout: "num_ops": 0 2024-09-13T06:43:10.173 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:43:10.178 INFO:teuthology.orchestra.run.smithi081.stdout:5988 writesame 0x8c1a6a2 thru 0x8c1d2db data_size 0x4a(0x2c3a bytes) 2024-09-13T06:43:10.188 INFO:teuthology.orchestra.run.smithi081.stdout:osd.0: {} 2024-09-13T06:43:10.188 INFO:teuthology.orchestra.run.smithi081.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-13T06:43:10.193 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:43:10.193 INFO:teuthology.orchestra.run.smithi081.stdout: "success": "filestore_inject_stall = '' (not observed, change may require restart) " 2024-09-13T06:43:10.193 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:43:10.194 INFO:teuthology.orchestra.run.smithi081.stdout:5989 write 0xca7fa7c thru 0xca81376 (0x18fb bytes) 2024-09-13T06:43:10.200 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-13T06:43:10.201 INFO:teuthology.orchestra.run.smithi081.stdout:5991 writesame 0x5f9e2a thru 0x5fc269 data_size 0x40(0x2440 bytes) 2024-09-13T06:43:10.202 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:43:10.200+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:43:10.210 INFO:teuthology.orchestra.run.smithi081.stdout:osd.1: {} 2024-09-13T06:43:10.211 INFO:teuthology.orchestra.run.smithi081.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-13T06:43:10.217 INFO:teuthology.orchestra.run.smithi081.stdout:5992 trunc from 0xca81377 to 0x403abeb 2024-09-13T06:43:10.230 INFO:teuthology.orchestra.run.smithi081.stdout:osd.2: {} 2024-09-13T06:43:10.231 INFO:teuthology.orchestra.run.smithi081.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-13T06:43:10.232 INFO:teuthology.orchestra.run.smithi081.stdout:5993 punch from 0x319fdeb to 0x31a6612, (0x6827 bytes) 2024-09-13T06:43:10.247 INFO:teuthology.orchestra.run.smithi081.stdout:5995 trunc from 0x403abeb to 0xe3a518f 2024-09-13T06:43:10.247 INFO:teuthology.orchestra.run.smithi081.stdout:osd.3: {} 2024-09-13T06:43:10.248 INFO:teuthology.orchestra.run.smithi081.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-13T06:43:10.257 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:43:10.257 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:43:10.257 INFO:teuthology.orchestra.run.smithi081.stdout:compare and write disabled 2024-09-13T06:43:10.257 INFO:teuthology.orchestra.run.smithi081.stdout:6000 write 0xd10738b thru 0xd112a51 (0xb6c7 bytes) 2024-09-13T06:43:10.270 INFO:teuthology.orchestra.run.smithi081.stdout:osd.4: {} 2024-09-13T06:43:10.270 INFO:teuthology.orchestra.run.smithi081.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-13T06:43:10.283 INFO:teuthology.orchestra.run.smithi081.stdout:checking clone #42, image image_client.0-clone42 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent43 2024-09-13T06:43:10.291 INFO:teuthology.orchestra.run.smithi081.stdout:osd.5: {} 2024-09-13T06:43:10.291 INFO:teuthology.orchestra.run.smithi081.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-13T06:43:10.291 INFO:teuthology.orchestra.run.smithi081.stderr:Error ENXIO: problem getting command descriptions from osd.6 2024-09-13T06:43:10.302 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:43:10.304+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:43:10.312 INFO:teuthology.orchestra.run.smithi081.stdout:osd.7: {} 2024-09-13T06:43:10.312 INFO:teuthology.orchestra.run.smithi081.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-13T06:43:10.316 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-13T06:43:10.316 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-13T06:43:10.331 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:43:10.331 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:43:10.349 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-13T06:43:10.432 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-13T06:43:10.434 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:43:10.436+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:43:10.505 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:43:10.505+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:43:10.519 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:43:10.519 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:43:10.540 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-13T06:43:10.605 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:43:10.604+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:43:10.657 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:43:10.657 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:43:10.670 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-13T06:43:10.706 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-13T06:43:10.705+0000 7fa8bb18e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 36790) UID: 0 2024-09-13T06:43:10.807 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:43:10.805+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:43:10.837 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:43:10.837 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:43:10.851 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-13T06:43:10.908 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:43:10.908+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:43:10.972 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:43:10.972 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:43:10.985 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-13T06:43:11.030 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:43:11.032+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:43:11.110 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:43:11.112+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:43:11.116 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:43:11.116 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:43:11.130 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-13T06:43:11.211 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:43:11.212+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:43:11.255 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:43:11.256 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:43:11.270 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-13T06:43:11.312 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:43:11.312+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:43:11.389 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:43:11.389 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:43:11.404 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-13T06:43:11.409 INFO:teuthology.orchestra.run.smithi081.stderr:nodeep-scrub is unset 2024-09-13T06:43:11.413 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:43:11.412+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:43:11.514 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-13T06:43:11.513+0000 7fa8bb18e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 36790) UID: 0 2024-09-13T06:43:11.535 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:43:11.535 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:43:11.550 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-13T06:43:11.615 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:43:11.616+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:43:11.716 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-13T06:43:11.717+0000 7fa8bb18e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 36790) UID: 0 2024-09-13T06:43:11.716 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:43:11.716 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:43:11.732 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-13T06:43:11.817 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:43:11.816+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:43:11.898 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:43:11.898 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:43:11.912 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-13T06:43:11.918 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:43:11.920+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:43:12.019 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:43:12.017+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:43:12.029 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:43:12.029 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:43:12.043 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-13T06:43:12.120 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:43:12.120+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:43:12.208 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:43:12.208 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:43:12.221 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:43:12.220+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:43:12.222 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-13T06:43:12.317 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-13T06:43:12.322 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:43:12.321+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:43:12.340 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:43:12.340 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:43:12.354 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-13T06:43:12.423 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:43:12.424+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:43:12.483 INFO:teuthology.orchestra.run.smithi081.stdout:osd.0: {} 2024-09-13T06:43:12.483 INFO:teuthology.orchestra.run.smithi081.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-13T06:43:12.498 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:43:12.498 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-13T06:43:12.498 INFO:teuthology.orchestra.run.smithi081.stdout: "num_ops": 0 2024-09-13T06:43:12.498 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:43:12.503 INFO:teuthology.orchestra.run.smithi081.stdout:osd.1: {} 2024-09-13T06:43:12.503 INFO:teuthology.orchestra.run.smithi081.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-13T06:43:12.513 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-13T06:43:12.522 INFO:teuthology.orchestra.run.smithi081.stdout:osd.2: {} 2024-09-13T06:43:12.522 INFO:teuthology.orchestra.run.smithi081.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-13T06:43:12.524 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:43:12.525+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:43:12.544 INFO:teuthology.orchestra.run.smithi081.stdout:osd.3: {} 2024-09-13T06:43:12.544 INFO:teuthology.orchestra.run.smithi081.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-13T06:43:12.579 INFO:teuthology.orchestra.run.smithi081.stdout:osd.4: {} 2024-09-13T06:43:12.579 INFO:teuthology.orchestra.run.smithi081.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-13T06:43:12.613 INFO:teuthology.orchestra.run.smithi081.stdout:osd.5: {} 2024-09-13T06:43:12.614 INFO:teuthology.orchestra.run.smithi081.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-13T06:43:12.614 INFO:teuthology.orchestra.run.smithi081.stderr:Error ENXIO: problem getting command descriptions from osd.6 2024-09-13T06:43:12.625 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:43:12.624+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:43:12.635 INFO:teuthology.orchestra.run.smithi081.stdout:osd.7: {} 2024-09-13T06:43:12.635 INFO:teuthology.orchestra.run.smithi081.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-13T06:43:12.639 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-13T06:43:12.640 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-13T06:43:12.661 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:43:12.661 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-13T06:43:12.661 INFO:teuthology.orchestra.run.smithi081.stdout: "complaint_time": 30, 2024-09-13T06:43:12.661 INFO:teuthology.orchestra.run.smithi081.stdout: "num_blocked_ops": 0 2024-09-13T06:43:12.661 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:43:12.675 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-13T06:43:12.762 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:43:12.764+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:43:12.826 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:43:12.828+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:43:12.841 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:43:12.841 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 20, 2024-09-13T06:43:12.841 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 600, 2024-09-13T06:43:12.841 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [ 2024-09-13T06:43:12.841 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:12.841 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:37801 3.1 3:82e31015:::rbd_object_map.1121d8143c6e.0000000000000019:head [call] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e55)", 2024-09-13T06:43:12.841 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:05.646191+0000", 2024-09-13T06:43:12.842 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 187.19393228600001, 2024-09-13T06:43:12.842 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.72659507800000001, 2024-09-13T06:43:12.842 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:12.842 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:12.842 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:12.842 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:12.842 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:12.842 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 37801 2024-09-13T06:43:12.842 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:12.842 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:12.842 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:12.842 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:12.842 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:05.646191+0000", 2024-09-13T06:43:12.842 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:12.843 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:12.843 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:12.843 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:12.843 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:05.646191+0000", 2024-09-13T06:43:12.843 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:12.843 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:12.843 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:12.843 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:12.843 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:05.646188+0000", 2024-09-13T06:43:12.843 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999971 2024-09-13T06:43:12.843 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:12.843 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:12.843 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:12.844 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:05.646206+0000", 2024-09-13T06:43:12.844 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8182999999999999e-05 2024-09-13T06:43:12.844 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:12.844 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:12.844 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:12.844 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:05.646237+0000", 2024-09-13T06:43:12.844 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.1071000000000001e-05 2024-09-13T06:43:12.844 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:12.844 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:12.844 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:12.844 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:05.646251+0000", 2024-09-13T06:43:12.844 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3679000000000001e-05 2024-09-13T06:43:12.844 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:12.845 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:12.845 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:12.845 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:05.646321+0000", 2024-09-13T06:43:12.845 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.9831000000000003e-05 2024-09-13T06:43:12.845 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:12.845 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:12.845 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:43:12.845 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:05.646331+0000", 2024-09-13T06:43:12.845 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0242e-05 2024-09-13T06:43:12.845 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:12.845 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:12.845 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:12.845 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.371959+0000", 2024-09-13T06:43:12.846 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.72562817199999996 2024-09-13T06:43:12.846 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:12.846 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:12.846 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:12.846 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.372389+0000", 2024-09-13T06:43:12.846 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00042977400000000001 2024-09-13T06:43:12.846 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:12.846 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:12.846 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:12.846 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.372786+0000", 2024-09-13T06:43:12.846 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00039706099999999999 2024-09-13T06:43:12.846 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:12.846 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:12.847 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:12.847 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:12.847 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:12.847 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43182 3.17 3:ec5ebce4:::rbd_data.1121f5f2e1c0.0000000000000001:1f [read 333824~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:43:12.847 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.652985+0000", 2024-09-13T06:43:12.847 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 171.187137673, 2024-09-13T06:43:12.847 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123926616, 2024-09-13T06:43:12.847 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:12.847 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:12.847 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:12.847 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:12.847 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:12.847 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43182 2024-09-13T06:43:12.847 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:12.848 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:12.848 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:12.848 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:12.848 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.652985+0000", 2024-09-13T06:43:12.848 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:12.848 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:12.848 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:12.848 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:12.848 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.652985+0000", 2024-09-13T06:43:12.848 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:12.848 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:12.848 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:12.848 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:12.849 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.652985+0000", 2024-09-13T06:43:12.849 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:12.849 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:12.849 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:12.849 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:12.849 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.652987+0000", 2024-09-13T06:43:12.849 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0899999999999999e-06 2024-09-13T06:43:12.849 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:12.849 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:12.849 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:12.849 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.652994+0000", 2024-09-13T06:43:12.849 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3100000000000003e-06 2024-09-13T06:43:12.849 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:12.850 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:12.850 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:12.850 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.653000+0000", 2024-09-13T06:43:12.850 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2020000000000003e-06 2024-09-13T06:43:12.850 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:12.850 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:12.850 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:12.850 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.776635+0000", 2024-09-13T06:43:12.850 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.12363529400000001 2024-09-13T06:43:12.850 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:12.850 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:12.850 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:12.850 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.776676+0000", 2024-09-13T06:43:12.851 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.0745999999999999e-05 2024-09-13T06:43:12.851 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:12.851 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:12.851 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:12.851 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.776912+0000", 2024-09-13T06:43:12.851 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00023631300000000001 2024-09-13T06:43:12.851 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:12.851 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:12.851 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:12.851 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:12.851 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:12.851 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43194 3.17 3:ec5ebce4:::rbd_data.1121f5f2e1c0.0000000000000001:1f [read 495616~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:43:12.851 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.656645+0000", 2024-09-13T06:43:12.851 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 171.18347747999999, 2024-09-13T06:43:12.852 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.124088483, 2024-09-13T06:43:12.852 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:12.852 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:12.852 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:12.852 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:12.852 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:12.852 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43194 2024-09-13T06:43:12.852 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:12.852 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:12.852 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:12.852 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:12.852 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656645+0000", 2024-09-13T06:43:12.852 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:12.852 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:12.853 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:12.853 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:12.853 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656645+0000", 2024-09-13T06:43:12.853 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:12.853 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:12.853 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:12.853 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:12.853 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656645+0000", 2024-09-13T06:43:12.853 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:12.853 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:12.853 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:12.853 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:12.853 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656647+0000", 2024-09-13T06:43:12.854 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9180000000000001e-06 2024-09-13T06:43:12.854 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:12.854 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:12.854 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:12.854 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656653+0000", 2024-09-13T06:43:12.854 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7860000000000002e-06 2024-09-13T06:43:12.854 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:12.854 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:12.854 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:12.854 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656658+0000", 2024-09-13T06:43:12.854 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6949999999999999e-06 2024-09-13T06:43:12.854 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:12.854 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:12.855 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:12.855 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.780406+0000", 2024-09-13T06:43:12.855 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123748657 2024-09-13T06:43:12.855 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:12.855 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:12.855 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:12.855 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.780446+0000", 2024-09-13T06:43:12.855 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.9360999999999998e-05 2024-09-13T06:43:12.855 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:12.855 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:12.855 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:12.855 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.780734+0000", 2024-09-13T06:43:12.855 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00028838399999999998 2024-09-13T06:43:12.856 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:12.856 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:12.856 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:12.856 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:12.856 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:12.856 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43241 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 120832~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:43:12.856 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.660682+0000", 2024-09-13T06:43:12.856 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 171.17944054200001, 2024-09-13T06:43:12.856 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123958204, 2024-09-13T06:43:12.856 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:12.856 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:12.856 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:12.856 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:12.857 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:12.857 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43241 2024-09-13T06:43:12.857 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:12.857 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:12.857 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:12.857 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:12.857 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660682+0000", 2024-09-13T06:43:12.857 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:12.857 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:12.857 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:12.857 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:12.857 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660682+0000", 2024-09-13T06:43:12.857 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:12.858 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:12.858 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:12.858 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:12.858 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660682+0000", 2024-09-13T06:43:12.858 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:12.858 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:12.858 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:12.858 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:12.858 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660683+0000", 2024-09-13T06:43:12.858 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.308e-06 2024-09-13T06:43:12.858 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:12.858 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:12.858 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:12.858 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660686+0000", 2024-09-13T06:43:12.859 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.977e-06 2024-09-13T06:43:12.859 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:12.859 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:12.859 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:12.859 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660689+0000", 2024-09-13T06:43:12.859 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5830000000000001e-06 2024-09-13T06:43:12.859 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:12.859 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:12.859 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:12.859 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.784366+0000", 2024-09-13T06:43:12.859 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.12367713599999999 2024-09-13T06:43:12.859 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:12.859 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:12.860 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:12.860 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.784451+0000", 2024-09-13T06:43:12.860 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.4629999999999994e-05 2024-09-13T06:43:12.860 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:12.860 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:12.860 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:12.860 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.784641+0000", 2024-09-13T06:43:12.860 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00018984899999999999 2024-09-13T06:43:12.860 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:12.860 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:12.860 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:12.860 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:12.860 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:12.860 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43242 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 139264~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:43:12.861 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.660691+0000", 2024-09-13T06:43:12.861 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 171.179431564, 2024-09-13T06:43:12.861 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.124536443, 2024-09-13T06:43:12.861 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:12.861 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:12.861 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:12.861 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:12.861 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:12.861 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43242 2024-09-13T06:43:12.861 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:12.861 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:12.861 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:12.861 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:12.862 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660691+0000", 2024-09-13T06:43:12.862 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:12.862 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:12.862 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:12.862 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:12.862 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660691+0000", 2024-09-13T06:43:12.862 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:12.862 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:12.862 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:12.862 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:12.862 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660691+0000", 2024-09-13T06:43:12.862 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:43:12.862 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:12.862 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:12.863 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:12.863 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660696+0000", 2024-09-13T06:43:12.863 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0560000000000004e-06 2024-09-13T06:43:12.863 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:12.863 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:12.863 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:12.863 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660699+0000", 2024-09-13T06:43:12.863 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.2009999999999999e-06 2024-09-13T06:43:12.863 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:12.863 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:12.863 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:12.863 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660702+0000", 2024-09-13T06:43:12.863 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.633e-06 2024-09-13T06:43:12.863 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:12.864 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:12.864 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:12.864 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.784912+0000", 2024-09-13T06:43:12.864 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.124209497 2024-09-13T06:43:12.864 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:12.864 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:12.864 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:12.864 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.784995+0000", 2024-09-13T06:43:12.864 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.3891e-05 2024-09-13T06:43:12.864 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:12.864 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:12.864 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:12.864 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.785228+0000", 2024-09-13T06:43:12.864 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00023237400000000001 2024-09-13T06:43:12.865 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:12.865 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:12.865 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:12.865 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:12.865 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:12.865 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43243 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 153600~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:43:12.865 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.660705+0000", 2024-09-13T06:43:12.865 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 171.179418231, 2024-09-13T06:43:12.865 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.124825835, 2024-09-13T06:43:12.865 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:12.865 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:12.865 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:12.865 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:12.866 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:12.866 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43243 2024-09-13T06:43:12.866 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:12.866 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:12.866 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:12.866 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:12.866 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660705+0000", 2024-09-13T06:43:12.866 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:12.866 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:12.866 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:12.866 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:12.866 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660705+0000", 2024-09-13T06:43:12.866 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:12.867 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:12.867 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:12.867 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:12.867 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660705+0000", 2024-09-13T06:43:12.867 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:43:12.867 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:12.867 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:12.867 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:12.867 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660706+0000", 2024-09-13T06:43:12.867 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4339999999999999e-06 2024-09-13T06:43:12.867 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:12.867 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:12.867 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:12.867 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660709+0000", 2024-09-13T06:43:12.867 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9000000000000002e-06 2024-09-13T06:43:12.868 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:12.868 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:12.868 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:12.868 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660712+0000", 2024-09-13T06:43:12.868 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.0589999999999998e-06 2024-09-13T06:43:12.868 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:12.868 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:12.868 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:12.868 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.785318+0000", 2024-09-13T06:43:12.868 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.124606299 2024-09-13T06:43:12.868 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:12.868 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:12.868 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:12.868 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.785361+0000", 2024-09-13T06:43:12.868 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.3214999999999999e-05 2024-09-13T06:43:12.869 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:12.869 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:12.869 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:12.869 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.785531+0000", 2024-09-13T06:43:12.869 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00016914400000000001 2024-09-13T06:43:12.869 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:12.869 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:12.869 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:12.869 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:12.869 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:12.869 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43244 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 167936~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:43:12.869 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.660714+0000", 2024-09-13T06:43:12.869 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 171.17940881800001, 2024-09-13T06:43:12.869 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.125073248, 2024-09-13T06:43:12.870 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:12.870 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:12.870 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:12.870 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:12.870 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:12.870 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43244 2024-09-13T06:43:12.870 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:12.870 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:12.870 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:12.870 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:12.870 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660714+0000", 2024-09-13T06:43:12.870 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:12.870 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:12.871 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:12.871 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:12.871 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660714+0000", 2024-09-13T06:43:12.871 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:12.871 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:12.871 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:12.871 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:12.871 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660714+0000", 2024-09-13T06:43:12.871 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:43:12.871 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:12.871 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:12.871 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:12.871 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660715+0000", 2024-09-13T06:43:12.871 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2330000000000001e-06 2024-09-13T06:43:12.871 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:12.872 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:12.872 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:12.872 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660718+0000", 2024-09-13T06:43:12.872 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9569999999999998e-06 2024-09-13T06:43:12.872 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:12.872 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:12.872 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:12.872 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660721+0000", 2024-09-13T06:43:12.872 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.678e-06 2024-09-13T06:43:12.872 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:12.872 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:12.872 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:12.872 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.785557+0000", 2024-09-13T06:43:12.872 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.12483633199999999 2024-09-13T06:43:12.872 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:12.873 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:12.873 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:12.873 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.785618+0000", 2024-09-13T06:43:12.873 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0686000000000001e-05 2024-09-13T06:43:12.873 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:12.873 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:12.873 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:12.873 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.785787+0000", 2024-09-13T06:43:12.873 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00016957699999999999 2024-09-13T06:43:12.873 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:12.873 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:12.873 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:12.873 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:12.873 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:12.874 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43256 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 344064~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:43:12.874 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.664763+0000", 2024-09-13T06:43:12.874 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 171.17536030799999, 2024-09-13T06:43:12.874 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.12418359399999999, 2024-09-13T06:43:12.874 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:12.874 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:12.874 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:12.874 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:12.874 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:12.874 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43256 2024-09-13T06:43:12.874 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:12.874 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:12.874 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:12.874 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:12.874 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664763+0000", 2024-09-13T06:43:12.875 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:12.875 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:12.875 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:12.875 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:12.875 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664763+0000", 2024-09-13T06:43:12.875 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:12.875 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:12.875 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:12.875 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:12.875 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664762+0000", 2024-09-13T06:43:12.875 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:12.875 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:12.875 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:12.875 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:12.875 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664765+0000", 2024-09-13T06:43:12.876 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3290000000000001e-06 2024-09-13T06:43:12.876 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:12.876 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:12.876 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:12.876 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664771+0000", 2024-09-13T06:43:12.876 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.1319999999999999e-06 2024-09-13T06:43:12.876 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:12.876 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:12.876 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:12.876 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664776+0000", 2024-09-13T06:43:12.876 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.8840000000000002e-06 2024-09-13T06:43:12.876 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:12.876 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:12.876 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:12.876 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.788598+0000", 2024-09-13T06:43:12.877 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123821979 2024-09-13T06:43:12.877 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:12.877 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:12.877 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:12.877 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.788680+0000", 2024-09-13T06:43:12.877 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.2367999999999995e-05 2024-09-13T06:43:12.877 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:12.877 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:12.877 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:12.877 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.788946+0000", 2024-09-13T06:43:12.877 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00026629799999999999 2024-09-13T06:43:12.877 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:12.877 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:12.877 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:12.878 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:12.878 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:12.878 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43267 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 505856~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:43:12.878 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.669461+0000", 2024-09-13T06:43:12.878 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 171.17066175400001, 2024-09-13T06:43:12.878 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123933711, 2024-09-13T06:43:12.878 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:12.878 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:12.878 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:12.878 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:12.878 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:12.878 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43267 2024-09-13T06:43:12.878 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:12.878 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:12.879 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:12.879 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:12.879 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669461+0000", 2024-09-13T06:43:12.879 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:12.879 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:12.879 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:12.879 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:12.879 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669461+0000", 2024-09-13T06:43:12.879 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:12.879 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:12.879 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:12.879 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:12.879 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669461+0000", 2024-09-13T06:43:12.879 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:12.880 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:12.880 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:12.880 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:12.880 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669463+0000", 2024-09-13T06:43:12.880 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5629999999999999e-06 2024-09-13T06:43:12.880 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:12.880 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:12.880 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:12.880 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669473+0000", 2024-09-13T06:43:12.881 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.9520000000000006e-06 2024-09-13T06:43:12.881 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:12.881 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:12.881 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:12.881 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669479+0000", 2024-09-13T06:43:12.881 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8540000000000002e-06 2024-09-13T06:43:12.881 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:12.881 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:12.881 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:12.881 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.793137+0000", 2024-09-13T06:43:12.881 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.12365825699999999 2024-09-13T06:43:12.881 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:12.882 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:12.882 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:12.882 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.793181+0000", 2024-09-13T06:43:12.882 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.3773999999999998e-05 2024-09-13T06:43:12.882 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:12.882 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:12.882 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:12.882 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.793395+0000", 2024-09-13T06:43:12.882 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00021372399999999999 2024-09-13T06:43:12.882 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:12.882 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:12.882 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:12.883 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:12.883 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:12.883 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43268 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 520192~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:43:12.883 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.669484+0000", 2024-09-13T06:43:12.883 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 171.17063896900001, 2024-09-13T06:43:12.883 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.12441057899999999, 2024-09-13T06:43:12.883 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:12.883 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:12.883 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:12.883 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:12.883 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:12.883 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43268 2024-09-13T06:43:12.883 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:12.883 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:12.884 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:12.884 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:12.884 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669484+0000", 2024-09-13T06:43:12.884 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:12.884 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:12.884 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:12.884 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:12.884 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669484+0000", 2024-09-13T06:43:12.884 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:12.884 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:12.884 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:12.884 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:12.885 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669484+0000", 2024-09-13T06:43:12.885 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:12.885 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:12.885 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:12.885 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:12.885 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669486+0000", 2024-09-13T06:43:12.885 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6120000000000001e-06 2024-09-13T06:43:12.885 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:12.885 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:12.885 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:12.885 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669494+0000", 2024-09-13T06:43:12.885 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4819999999999997e-06 2024-09-13T06:43:12.885 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:12.886 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:12.886 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:12.886 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669497+0000", 2024-09-13T06:43:12.886 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9790000000000002e-06 2024-09-13T06:43:12.886 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:12.886 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:12.886 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:12.886 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.793559+0000", 2024-09-13T06:43:12.886 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.124062436 2024-09-13T06:43:12.886 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:12.886 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:12.886 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:12.886 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.793603+0000", 2024-09-13T06:43:12.886 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.3764999999999999e-05 2024-09-13T06:43:12.887 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:12.887 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:12.887 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:12.887 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.793895+0000", 2024-09-13T06:43:12.887 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00029168299999999999 2024-09-13T06:43:12.887 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:12.887 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:12.887 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:12.887 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:12.887 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:12.887 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:181627 3.1b 3:dbd5e871:::rbd_data.11218aab7a9c.0000000000000003:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e203)", 2024-09-13T06:43:12.887 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:42:45.704561+0000", 2024-09-13T06:43:12.887 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 27.135562104999998, 2024-09-13T06:43:12.888 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.70481779099999997, 2024-09-13T06:43:12.888 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:12.888 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:12.888 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:12.888 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:12.888 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:12.888 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 181627 2024-09-13T06:43:12.888 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:12.888 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:12.888 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:12.888 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:12.888 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.704561+0000", 2024-09-13T06:43:12.888 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:12.889 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:12.889 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:12.889 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:12.889 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.704561+0000", 2024-09-13T06:43:12.889 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:12.889 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:12.889 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:12.889 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:12.889 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.704558+0000", 2024-09-13T06:43:12.889 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999976 2024-09-13T06:43:12.889 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:12.889 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:12.889 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:12.889 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.704570+0000", 2024-09-13T06:43:12.890 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2123000000000001e-05 2024-09-13T06:43:12.890 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:12.890 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:12.890 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:12.890 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.704596+0000", 2024-09-13T06:43:12.890 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5134e-05 2024-09-13T06:43:12.890 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:12.890 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:12.890 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:12.890 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.704609+0000", 2024-09-13T06:43:12.890 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3745e-05 2024-09-13T06:43:12.890 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:12.890 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:12.890 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:12.890 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.704797+0000", 2024-09-13T06:43:12.891 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00018797799999999999 2024-09-13T06:43:12.891 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:12.891 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:12.891 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:43:12.891 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.704816+0000", 2024-09-13T06:43:12.891 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8218000000000001e-05 2024-09-13T06:43:12.891 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:12.891 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:12.891 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:12.891 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:46.408816+0000", 2024-09-13T06:43:12.891 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.70399995500000001 2024-09-13T06:43:12.891 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:12.891 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:12.891 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:12.892 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:46.409111+0000", 2024-09-13T06:43:12.892 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000295202 2024-09-13T06:43:12.892 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:12.892 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:12.892 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:12.892 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:46.409379+0000", 2024-09-13T06:43:12.892 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00026792599999999998 2024-09-13T06:43:12.892 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:12.892 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:12.892 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:12.892 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:12.892 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:12.892 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:181641 3.1b 3:dbd5e871:::rbd_data.11218aab7a9c.0000000000000003:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e203)", 2024-09-13T06:43:12.892 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:42:45.704674+0000", 2024-09-13T06:43:12.893 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 27.135449097999999, 2024-09-13T06:43:12.893 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.70579465600000002, 2024-09-13T06:43:12.893 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:12.893 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:12.893 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:12.893 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:12.893 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:12.893 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 181641 2024-09-13T06:43:12.893 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:12.893 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:12.893 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:12.893 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:12.893 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.704674+0000", 2024-09-13T06:43:12.894 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:12.894 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:12.894 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:12.894 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:12.894 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.704674+0000", 2024-09-13T06:43:12.894 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:12.894 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:12.894 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:12.894 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:12.894 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.704673+0000", 2024-09-13T06:43:12.894 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:12.894 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:12.894 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:12.894 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:12.894 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.704677+0000", 2024-09-13T06:43:12.895 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.6389999999999998e-06 2024-09-13T06:43:12.895 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:12.895 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:12.895 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:12.895 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.704691+0000", 2024-09-13T06:43:12.895 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3859999999999999e-05 2024-09-13T06:43:12.895 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:12.895 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:12.895 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:12.895 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.704699+0000", 2024-09-13T06:43:12.895 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.2339999999999994e-06 2024-09-13T06:43:12.895 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:12.895 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:12.896 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:12.896 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.704854+0000", 2024-09-13T06:43:12.896 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00015513899999999999 2024-09-13T06:43:12.896 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:12.896 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:12.896 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:43:12.896 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.704866+0000", 2024-09-13T06:43:12.896 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1855000000000001e-05 2024-09-13T06:43:12.896 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:12.896 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:12.896 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:12.896 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:46.410079+0000", 2024-09-13T06:43:12.896 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.705212477 2024-09-13T06:43:12.897 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:12.897 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:12.897 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:12.897 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:46.410279+0000", 2024-09-13T06:43:12.897 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000200614 2024-09-13T06:43:12.897 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:12.897 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:12.897 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:12.897 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:46.410469+0000", 2024-09-13T06:43:12.897 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00018939400000000001 2024-09-13T06:43:12.897 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:12.897 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:12.897 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:12.897 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:12.897 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:12.898 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:181655 3.1b 3:dbd5e871:::rbd_data.11218aab7a9c.0000000000000003:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e203)", 2024-09-13T06:43:12.898 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:42:45.704730+0000", 2024-09-13T06:43:12.898 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 27.13539269, 2024-09-13T06:43:12.898 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.70617977499999995, 2024-09-13T06:43:12.898 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:12.898 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:12.898 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:12.898 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:12.898 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:12.898 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 181655 2024-09-13T06:43:12.898 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:12.898 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:12.898 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:12.898 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:12.898 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.704730+0000", 2024-09-13T06:43:12.899 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:12.899 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:12.899 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:12.899 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:12.899 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.704730+0000", 2024-09-13T06:43:12.899 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:12.899 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:12.899 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:12.899 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:12.899 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.704730+0000", 2024-09-13T06:43:12.899 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:12.899 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:12.899 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:12.899 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:12.899 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.704733+0000", 2024-09-13T06:43:12.900 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.0000000000000001e-06 2024-09-13T06:43:12.900 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:12.900 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:12.900 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:12.900 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.704741+0000", 2024-09-13T06:43:12.900 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.0770000000000008e-06 2024-09-13T06:43:12.900 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:12.900 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:12.900 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:12.900 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.704747+0000", 2024-09-13T06:43:12.900 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.2110000000000003e-06 2024-09-13T06:43:12.900 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:12.900 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:12.900 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:12.900 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.706676+0000", 2024-09-13T06:43:12.901 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0019289820000000001 2024-09-13T06:43:12.901 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:12.901 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:12.901 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:43:12.901 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.706687+0000", 2024-09-13T06:43:12.901 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1382999999999999e-05 2024-09-13T06:43:12.901 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:12.901 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:12.901 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:12.901 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:46.410540+0000", 2024-09-13T06:43:12.901 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.70385235199999996 2024-09-13T06:43:12.901 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:12.901 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:12.901 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:12.902 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:46.410723+0000", 2024-09-13T06:43:12.902 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000182998 2024-09-13T06:43:12.902 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:12.902 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:12.902 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:12.902 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:46.410910+0000", 2024-09-13T06:43:12.902 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00018720299999999999 2024-09-13T06:43:12.902 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:12.902 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:12.902 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:12.902 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:12.902 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:12.902 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:181669 3.1b 3:dbd5e871:::rbd_data.11218aab7a9c.0000000000000003:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e203)", 2024-09-13T06:43:12.902 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:42:45.705356+0000", 2024-09-13T06:43:12.903 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 27.134766681999999, 2024-09-13T06:43:12.903 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.70583958999999996, 2024-09-13T06:43:12.903 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:12.903 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:12.903 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:12.903 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:12.903 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:12.903 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 181669 2024-09-13T06:43:12.903 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:12.903 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:12.903 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:12.903 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:12.903 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.705356+0000", 2024-09-13T06:43:12.903 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:12.903 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:12.904 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:12.904 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:12.904 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.705356+0000", 2024-09-13T06:43:12.904 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:12.904 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:12.904 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:12.904 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:12.904 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.705356+0000", 2024-09-13T06:43:12.904 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:12.904 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:12.904 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:12.904 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:12.904 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.705360+0000", 2024-09-13T06:43:12.904 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.0069999999999999e-06 2024-09-13T06:43:12.905 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:12.905 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:12.905 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:12.905 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.705368+0000", 2024-09-13T06:43:12.905 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.3639999999999999e-06 2024-09-13T06:43:12.905 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:12.905 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:12.905 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:12.905 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.705375+0000", 2024-09-13T06:43:12.905 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.8839999999999997e-06 2024-09-13T06:43:12.905 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:12.905 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:12.905 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:12.905 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.706716+0000", 2024-09-13T06:43:12.905 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0013414589999999999 2024-09-13T06:43:12.906 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:12.906 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:12.906 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:43:12.906 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.706726+0000", 2024-09-13T06:43:12.906 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.5079999999999994e-06 2024-09-13T06:43:12.906 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:12.906 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:12.906 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:12.906 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:46.410966+0000", 2024-09-13T06:43:12.906 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.70424025800000001 2024-09-13T06:43:12.906 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:12.906 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:12.906 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:12.906 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:46.411099+0000", 2024-09-13T06:43:12.906 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000132395 2024-09-13T06:43:12.907 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:12.907 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:12.907 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:12.907 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:46.411196+0000", 2024-09-13T06:43:12.907 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.7344999999999997e-05 2024-09-13T06:43:12.907 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:12.907 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:12.907 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:12.907 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:12.907 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:12.907 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:181683 3.1b 3:dbd5e871:::rbd_data.11218aab7a9c.0000000000000003:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e203)", 2024-09-13T06:43:12.907 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:42:45.705404+0000", 2024-09-13T06:43:12.907 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 27.134719176000001, 2024-09-13T06:43:12.907 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.70639211899999999, 2024-09-13T06:43:12.907 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:12.907 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:12.908 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:12.908 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:12.908 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:12.908 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 181683 2024-09-13T06:43:12.908 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:12.908 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:12.908 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:12.908 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:12.908 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.705404+0000", 2024-09-13T06:43:12.908 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:12.908 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:12.908 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:12.908 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:12.908 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.705404+0000", 2024-09-13T06:43:12.908 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:12.909 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:12.909 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:12.909 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:12.909 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.705403+0000", 2024-09-13T06:43:12.909 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:12.909 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:12.909 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:12.909 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:12.909 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.705406+0000", 2024-09-13T06:43:12.909 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.1499999999999999e-06 2024-09-13T06:43:12.909 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:12.909 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:12.909 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:12.909 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.705414+0000", 2024-09-13T06:43:12.910 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4259999999999997e-06 2024-09-13T06:43:12.910 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:12.910 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:12.910 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:12.910 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.705420+0000", 2024-09-13T06:43:12.910 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.4339999999999997e-06 2024-09-13T06:43:12.910 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:12.910 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:12.910 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:12.910 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.706753+0000", 2024-09-13T06:43:12.910 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0013326939999999999 2024-09-13T06:43:12.910 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:12.910 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:12.910 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:43:12.910 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.706762+0000", 2024-09-13T06:43:12.911 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.2439999999999999e-06 2024-09-13T06:43:12.911 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:12.911 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:12.911 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:12.911 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:46.411391+0000", 2024-09-13T06:43:12.911 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.70462912099999997 2024-09-13T06:43:12.911 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:12.911 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:12.911 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:12.911 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:46.411584+0000", 2024-09-13T06:43:12.911 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00019283399999999999 2024-09-13T06:43:12.911 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:12.911 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:12.911 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:12.911 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:46.411796+0000", 2024-09-13T06:43:12.912 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00021175299999999999 2024-09-13T06:43:12.912 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:12.912 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:12.912 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:12.912 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:12.912 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:12.912 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:181697 3.1b 3:dbd5e871:::rbd_data.11218aab7a9c.0000000000000003:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e203)", 2024-09-13T06:43:12.912 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:42:45.705447+0000", 2024-09-13T06:43:12.912 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 27.134675525999999, 2024-09-13T06:43:12.912 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.70668603500000005, 2024-09-13T06:43:12.912 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:12.912 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:12.912 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:12.912 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:12.912 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:12.913 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 181697 2024-09-13T06:43:12.913 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:12.913 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:12.913 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:12.913 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:12.913 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.705447+0000", 2024-09-13T06:43:12.913 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:12.913 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:12.913 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:12.913 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:12.913 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.705447+0000", 2024-09-13T06:43:12.913 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:12.913 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:12.913 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:12.913 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:12.914 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.705447+0000", 2024-09-13T06:43:12.914 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:12.914 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:12.914 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:12.914 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:12.914 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.705450+0000", 2024-09-13T06:43:12.914 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.8830000000000002e-06 2024-09-13T06:43:12.914 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:12.914 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:12.914 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:12.914 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.705457+0000", 2024-09-13T06:43:12.914 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.097e-06 2024-09-13T06:43:12.914 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:12.914 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:12.914 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:12.914 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.705463+0000", 2024-09-13T06:43:12.915 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.2439999999999998e-06 2024-09-13T06:43:12.915 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:12.915 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:12.915 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:12.915 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.706790+0000", 2024-09-13T06:43:12.915 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.001326823 2024-09-13T06:43:12.915 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:12.915 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:12.915 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:43:12.915 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.706799+0000", 2024-09-13T06:43:12.915 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.3249999999999997e-06 2024-09-13T06:43:12.915 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:12.915 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:12.916 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:12.916 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:46.411884+0000", 2024-09-13T06:43:12.916 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.70508501599999995 2024-09-13T06:43:12.916 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:12.916 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:12.916 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:12.916 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:46.412010+0000", 2024-09-13T06:43:12.916 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000125635 2024-09-13T06:43:12.916 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:12.916 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:12.916 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:12.916 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:46.412133+0000", 2024-09-13T06:43:12.916 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000123492 2024-09-13T06:43:12.916 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:12.917 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:12.917 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:12.917 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:12.917 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:12.917 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:181711 3.1b 3:dbd5e871:::rbd_data.11218aab7a9c.0000000000000003:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e203)", 2024-09-13T06:43:12.917 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:42:45.705496+0000", 2024-09-13T06:43:12.917 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 27.134626962999999, 2024-09-13T06:43:12.917 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.70714611199999999, 2024-09-13T06:43:12.917 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:12.917 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:12.917 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:12.917 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:12.917 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:12.917 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 181711 2024-09-13T06:43:12.918 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:12.918 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:12.918 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:12.918 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:12.918 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.705496+0000", 2024-09-13T06:43:12.918 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:12.918 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:12.918 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:12.918 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:12.918 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.705496+0000", 2024-09-13T06:43:12.918 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:12.918 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:12.918 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:12.918 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:12.919 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.705495+0000", 2024-09-13T06:43:12.919 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:12.919 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:12.919 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:12.919 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:12.919 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.705499+0000", 2024-09-13T06:43:12.919 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.1109999999999999e-06 2024-09-13T06:43:12.919 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:12.919 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:12.919 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:12.919 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.705506+0000", 2024-09-13T06:43:12.919 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.8830000000000006e-06 2024-09-13T06:43:12.919 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:12.919 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:12.920 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:12.920 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.705513+0000", 2024-09-13T06:43:12.920 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.2500000000000003e-06 2024-09-13T06:43:12.920 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:12.920 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:12.920 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:12.920 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.706828+0000", 2024-09-13T06:43:12.920 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0013155840000000001 2024-09-13T06:43:12.920 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:12.920 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:12.920 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:43:12.920 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.706837+0000", 2024-09-13T06:43:12.920 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.0489999999999993e-06 2024-09-13T06:43:12.921 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:12.921 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:12.921 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:12.921 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:46.412223+0000", 2024-09-13T06:43:12.921 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.70538530799999999 2024-09-13T06:43:12.921 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:12.921 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:12.921 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:12.921 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:46.412418+0000", 2024-09-13T06:43:12.921 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000195331 2024-09-13T06:43:12.921 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:12.921 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:12.921 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:12.922 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:46.412642+0000", 2024-09-13T06:43:12.922 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00022410099999999999 2024-09-13T06:43:12.922 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:12.922 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:12.922 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:12.922 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:12.922 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:12.922 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:181725 3.1b 3:dbd5e871:::rbd_data.11218aab7a9c.0000000000000003:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e203)", 2024-09-13T06:43:12.922 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:42:45.706863+0000", 2024-09-13T06:43:12.922 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 27.133259919, 2024-09-13T06:43:12.922 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.70631271699999998, 2024-09-13T06:43:12.922 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:12.922 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:12.922 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:12.923 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:12.923 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:12.923 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 181725 2024-09-13T06:43:12.923 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:12.923 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:12.923 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:12.923 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:12.923 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.706863+0000", 2024-09-13T06:43:12.923 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:12.923 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:12.923 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:12.923 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:12.923 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.706863+0000", 2024-09-13T06:43:12.923 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:12.924 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:12.924 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:12.924 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:12.924 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.706862+0000", 2024-09-13T06:43:12.924 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.999999 2024-09-13T06:43:12.924 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:12.924 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:12.924 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:12.924 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.706869+0000", 2024-09-13T06:43:12.924 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.0899999999999999e-06 2024-09-13T06:43:12.924 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:12.924 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:12.924 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:12.924 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.706881+0000", 2024-09-13T06:43:12.924 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1727e-05 2024-09-13T06:43:12.925 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:12.925 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:12.925 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:12.925 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.706891+0000", 2024-09-13T06:43:12.925 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.9399999999999997e-06 2024-09-13T06:43:12.925 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:12.925 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:12.925 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:12.925 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.706952+0000", 2024-09-13T06:43:12.925 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.1106999999999996e-05 2024-09-13T06:43:12.925 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:12.925 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:12.925 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:43:12.925 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.706966+0000", 2024-09-13T06:43:12.926 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4173e-05 2024-09-13T06:43:12.926 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:12.926 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:12.926 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:12.926 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:46.412754+0000", 2024-09-13T06:43:12.926 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.70578759999999996 2024-09-13T06:43:12.926 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:12.926 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:12.926 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:12.926 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:46.412967+0000", 2024-09-13T06:43:12.926 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00021290999999999999 2024-09-13T06:43:12.926 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:12.926 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:12.926 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:12.926 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:46.413176+0000", 2024-09-13T06:43:12.927 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00020922099999999999 2024-09-13T06:43:12.927 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:12.927 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:12.927 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:12.927 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:12.927 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:12.927 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:181739 3.1b 3:dbd5e871:::rbd_data.11218aab7a9c.0000000000000003:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e203)", 2024-09-13T06:43:12.927 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:42:45.706937+0000", 2024-09-13T06:43:12.927 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 27.133185707999999, 2024-09-13T06:43:12.927 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.70679418800000005, 2024-09-13T06:43:12.927 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:12.927 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:12.927 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:12.927 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:12.928 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:12.928 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 181739 2024-09-13T06:43:12.928 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:12.928 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:12.928 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:12.928 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:12.928 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.706937+0000", 2024-09-13T06:43:12.928 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:12.928 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:12.928 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:12.928 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:12.928 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.706937+0000", 2024-09-13T06:43:12.928 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:12.928 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:12.929 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:12.929 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:12.929 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.706937+0000", 2024-09-13T06:43:12.929 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:12.929 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:12.929 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:12.929 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:12.929 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.706940+0000", 2024-09-13T06:43:12.929 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.4290000000000001e-06 2024-09-13T06:43:12.929 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:12.929 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:12.929 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:12.929 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.706949+0000", 2024-09-13T06:43:12.930 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.7730000000000005e-06 2024-09-13T06:43:12.930 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:12.930 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:12.930 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:12.930 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.706956+0000", 2024-09-13T06:43:12.930 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4240000000000004e-06 2024-09-13T06:43:12.930 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:12.930 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:12.930 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:12.930 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.706999+0000", 2024-09-13T06:43:12.930 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.2410999999999998e-05 2024-09-13T06:43:12.930 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:12.930 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:12.930 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:43:12.931 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.707011+0000", 2024-09-13T06:43:12.931 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2140999999999999e-05 2024-09-13T06:43:12.931 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:12.931 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:12.931 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:12.931 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:46.413278+0000", 2024-09-13T06:43:12.931 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.70626747199999995 2024-09-13T06:43:12.931 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:12.931 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:12.931 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:12.931 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:46.413471+0000", 2024-09-13T06:43:12.931 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00019234699999999999 2024-09-13T06:43:12.931 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:12.931 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:12.931 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:12.932 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:46.413731+0000", 2024-09-13T06:43:12.932 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00026069 2024-09-13T06:43:12.932 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:12.932 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:12.932 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:12.932 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:12.932 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:12.932 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:181753 3.1b 3:dbd5e871:::rbd_data.11218aab7a9c.0000000000000003:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e203)", 2024-09-13T06:43:12.932 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:42:45.706987+0000", 2024-09-13T06:43:12.932 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 27.133135625000001, 2024-09-13T06:43:12.932 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.70721309200000004, 2024-09-13T06:43:12.932 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:12.932 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:12.932 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:12.932 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:12.933 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:12.933 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 181753 2024-09-13T06:43:12.933 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:12.933 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:12.933 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:12.933 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:12.933 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.706987+0000", 2024-09-13T06:43:12.933 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:12.933 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:12.933 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:12.933 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:12.933 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.706987+0000", 2024-09-13T06:43:12.933 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:12.933 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:12.933 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:12.934 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:12.934 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.706987+0000", 2024-09-13T06:43:12.934 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:12.934 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:12.934 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:12.934 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:12.934 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.706990+0000", 2024-09-13T06:43:12.934 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.0759999999999999e-06 2024-09-13T06:43:12.934 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:12.934 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:12.934 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:12.934 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.706997+0000", 2024-09-13T06:43:12.934 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5809999999999999e-06 2024-09-13T06:43:12.934 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:12.934 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:12.935 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:12.935 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.707004+0000", 2024-09-13T06:43:12.935 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.7839999999999998e-06 2024-09-13T06:43:12.935 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:12.935 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:12.935 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:12.935 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.707046+0000", 2024-09-13T06:43:12.935 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.1474999999999998e-05 2024-09-13T06:43:12.935 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:12.935 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:12.935 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:43:12.935 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.707056+0000", 2024-09-13T06:43:12.935 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0825000000000001e-05 2024-09-13T06:43:12.935 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:12.935 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:12.935 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:12.936 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:46.413797+0000", 2024-09-13T06:43:12.936 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.70674101099999997 2024-09-13T06:43:12.936 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:12.936 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:12.936 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:12.936 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:46.413998+0000", 2024-09-13T06:43:12.936 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00020058700000000001 2024-09-13T06:43:12.936 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:12.936 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:12.936 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:12.936 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:46.414200+0000", 2024-09-13T06:43:12.936 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00020238400000000001 2024-09-13T06:43:12.936 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:12.936 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:12.936 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:12.937 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:12.937 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:12.937 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:43:12.938 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-13T06:43:12.938 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:43:12.940+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:43:13.039 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-13T06:43:13.037+0000 7fa8bb18e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 36790) UID: 0 2024-09-13T06:43:13.109 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:43:13.109 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-13T06:43:13.109 INFO:teuthology.orchestra.run.smithi081.stdout: "num_ops": 0 2024-09-13T06:43:13.109 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:43:13.124 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-13T06:43:13.170 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:43:13.172+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:43:13.242 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:43:13.241+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:43:13.244 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:43:13.244 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-13T06:43:13.244 INFO:teuthology.orchestra.run.smithi081.stdout: "complaint_time": 30, 2024-09-13T06:43:13.244 INFO:teuthology.orchestra.run.smithi081.stdout: "num_blocked_ops": 0 2024-09-13T06:43:13.244 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:43:13.259 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-13T06:43:13.343 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:43:13.341+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:43:13.419 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:43:13.419 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 20, 2024-09-13T06:43:13.419 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 600, 2024-09-13T06:43:13.420 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [ 2024-09-13T06:43:13.420 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:13.420 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:90987 3.6 3:6263dd97:::rbd_object_map.11212443ae03.0000000000000049:head [call] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-13T06:43:13.420 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:41:35.460333+0000", 2024-09-13T06:43:13.420 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 97.959365121999994, 2024-09-13T06:43:13.420 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0001633640000001, 2024-09-13T06:43:13.420 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:13.420 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:13.420 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:13.420 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:13.420 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:13.420 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 90987 2024-09-13T06:43:13.421 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:13.421 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:13.421 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:13.421 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:13.421 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:35.460333+0000", 2024-09-13T06:43:13.421 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:13.421 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:13.421 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:13.421 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:13.421 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:35.460333+0000", 2024-09-13T06:43:13.421 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:13.422 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:13.422 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:13.422 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:13.422 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:35.460330+0000", 2024-09-13T06:43:13.422 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999971 2024-09-13T06:43:13.422 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:13.422 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:13.422 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:13.422 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:35.460343+0000", 2024-09-13T06:43:13.423 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2695e-05 2024-09-13T06:43:13.423 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:13.423 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:13.423 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:13.423 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:35.460365+0000", 2024-09-13T06:43:13.423 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2473999999999999e-05 2024-09-13T06:43:13.423 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:13.423 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:13.423 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:13.424 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:35.460376+0000", 2024-09-13T06:43:13.424 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0383999999999999e-05 2024-09-13T06:43:13.424 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:13.424 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:13.424 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:13.424 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:35.460435+0000", 2024-09-13T06:43:13.424 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8650000000000003e-05 2024-09-13T06:43:13.425 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:13.425 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:13.425 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:43:13.425 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:35.460444+0000", 2024-09-13T06:43:13.425 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.0380000000000005e-06 2024-09-13T06:43:13.425 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:13.425 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:13.425 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:13.425 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:36.459433+0000", 2024-09-13T06:43:13.426 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.99898895799999998 2024-09-13T06:43:13.426 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:13.426 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:13.426 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:13.426 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:36.459622+0000", 2024-09-13T06:43:13.426 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00018940299999999999 2024-09-13T06:43:13.426 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:13.426 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:13.426 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:13.427 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:36.460497+0000", 2024-09-13T06:43:13.427 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00087481199999999999 2024-09-13T06:43:13.427 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:13.427 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:13.427 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:13.427 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:13.427 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:13.427 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:159632 3.a 3:57f62123:::rbd_header.112138ed422:head [create,call rbd.create in=9b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e167)", 2024-09-13T06:43:13.428 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:42:07.853351+0000", 2024-09-13T06:43:13.428 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 65.566347320000006, 2024-09-13T06:43:13.428 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.95572760999999995, 2024-09-13T06:43:13.428 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:13.428 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:43:13.428 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:13.428 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:13.429 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:13.429 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 159632 2024-09-13T06:43:13.429 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:13.429 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:13.429 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:13.429 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:13.429 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:07.853351+0000", 2024-09-13T06:43:13.429 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:13.429 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:13.430 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:13.430 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:13.430 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:07.853351+0000", 2024-09-13T06:43:13.430 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:13.430 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:13.430 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:13.430 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:13.430 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:07.853350+0000", 2024-09-13T06:43:13.430 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.999999 2024-09-13T06:43:13.431 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:13.431 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:13.431 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:13.431 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:07.853356+0000", 2024-09-13T06:43:13.431 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.1560000000000003e-06 2024-09-13T06:43:13.431 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:13.431 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:13.431 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:13.431 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:07.853365+0000", 2024-09-13T06:43:13.431 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.8079999999999999e-06 2024-09-13T06:43:13.432 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:13.432 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:13.432 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:13.432 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:07.853372+0000", 2024-09-13T06:43:13.432 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.5540000000000003e-06 2024-09-13T06:43:13.432 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:13.432 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:13.432 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:13.432 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:07.853430+0000", 2024-09-13T06:43:13.432 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8038000000000002e-05 2024-09-13T06:43:13.432 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:13.432 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:13.433 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:43:13.433 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:07.853444+0000", 2024-09-13T06:43:13.433 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3719e-05 2024-09-13T06:43:13.433 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:13.433 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:13.433 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:13.433 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:08.804052+0000", 2024-09-13T06:43:13.433 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.95060817799999997 2024-09-13T06:43:13.433 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:13.433 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:13.433 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:13.433 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:08.804234+0000", 2024-09-13T06:43:13.434 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00018192999999999999 2024-09-13T06:43:13.434 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:13.434 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:13.434 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 6", 2024-09-13T06:43:13.434 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:08.804797+0000", 2024-09-13T06:43:13.434 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00056282399999999996 2024-09-13T06:43:13.434 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:13.434 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:13.434 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-09-13T06:43:13.434 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:08.805704+0000", 2024-09-13T06:43:13.434 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00090781 2024-09-13T06:43:13.434 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:13.434 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:13.434 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:43:13.435 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:08.808907+0000", 2024-09-13T06:43:13.435 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0032031239999999999 2024-09-13T06:43:13.435 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:13.435 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:13.435 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:43:13.435 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:08.808998+0000", 2024-09-13T06:43:13.435 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.0191000000000004e-05 2024-09-13T06:43:13.435 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:13.435 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:13.435 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:13.435 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:08.809079+0000", 2024-09-13T06:43:13.436 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.1076999999999996e-05 2024-09-13T06:43:13.436 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:13.436 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:13.436 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:13.436 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:13.436 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:13.436 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:209556 3.6 3:673cd4d4:::rbd_data.1121cb4a09ed.0000000000000002:82 [read 831488~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e220)", 2024-09-13T06:43:13.436 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:43:05.152927+0000", 2024-09-13T06:43:13.437 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 8.2667713200000001, 2024-09-13T06:43:13.437 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054987033999999997, 2024-09-13T06:43:13.437 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:13.437 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:13.437 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:13.437 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:13.437 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:13.437 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 209556 2024-09-13T06:43:13.438 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:13.438 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:13.438 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:13.438 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:13.438 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.152927+0000", 2024-09-13T06:43:13.438 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:13.438 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:13.438 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:13.438 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:13.438 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.152927+0000", 2024-09-13T06:43:13.439 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:13.439 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:13.439 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:13.439 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:13.439 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.152927+0000", 2024-09-13T06:43:13.439 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:13.439 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:13.439 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:13.439 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:13.440 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.152929+0000", 2024-09-13T06:43:13.440 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.514e-06 2024-09-13T06:43:13.440 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:13.440 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:13.440 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:13.440 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.152935+0000", 2024-09-13T06:43:13.440 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.5249999999999996e-06 2024-09-13T06:43:13.440 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:13.440 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:13.440 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:13.441 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.152939+0000", 2024-09-13T06:43:13.441 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.3209999999999998e-06 2024-09-13T06:43:13.441 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:13.441 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:13.441 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:13.441 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.207752+0000", 2024-09-13T06:43:13.441 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054813273000000003 2024-09-13T06:43:13.441 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:13.441 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:13.441 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:13.442 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.207834+0000", 2024-09-13T06:43:13.442 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.1317999999999996e-05 2024-09-13T06:43:13.442 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:13.442 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:13.442 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:13.442 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.207914+0000", 2024-09-13T06:43:13.442 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.0568000000000005e-05 2024-09-13T06:43:13.443 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:13.443 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:13.443 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:13.443 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:13.443 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:13.443 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:209557 3.6 3:673cd4d4:::rbd_data.1121cb4a09ed.0000000000000002:82 [read 843776~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e220)", 2024-09-13T06:43:13.443 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:43:05.152944+0000", 2024-09-13T06:43:13.443 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 8.2667548160000006, 2024-09-13T06:43:13.444 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.055174645000000001, 2024-09-13T06:43:13.444 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:13.444 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:13.444 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:13.444 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:13.444 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:13.444 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 209557 2024-09-13T06:43:13.444 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:13.445 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:13.445 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:13.445 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:13.445 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.152944+0000", 2024-09-13T06:43:13.445 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:13.445 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:13.445 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:13.445 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:13.445 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.152944+0000", 2024-09-13T06:43:13.446 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:13.446 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:13.446 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:13.446 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:13.446 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.152943+0000", 2024-09-13T06:43:13.446 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:13.446 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:13.446 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:13.446 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:13.446 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.152946+0000", 2024-09-13T06:43:13.446 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2419999999999999e-06 2024-09-13T06:43:13.447 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:13.447 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:13.447 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:13.447 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.152951+0000", 2024-09-13T06:43:13.447 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7570000000000001e-06 2024-09-13T06:43:13.447 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:13.447 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:13.447 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:13.447 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.152955+0000", 2024-09-13T06:43:13.447 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.0080000000000004e-06 2024-09-13T06:43:13.447 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:13.447 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:13.448 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:13.448 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.207958+0000", 2024-09-13T06:43:13.448 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.055002896000000003 2024-09-13T06:43:13.448 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:13.448 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:13.448 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:13.448 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.208041+0000", 2024-09-13T06:43:13.448 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.2962999999999998e-05 2024-09-13T06:43:13.448 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:13.449 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:13.449 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:13.449 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.208118+0000", 2024-09-13T06:43:13.449 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.7181000000000005e-05 2024-09-13T06:43:13.449 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:13.449 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:13.449 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:13.449 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:13.450 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:13.450 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:209558 3.6 3:673cd4d4:::rbd_data.1121cb4a09ed.0000000000000002:82 [read 856064~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e220)", 2024-09-13T06:43:13.450 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:43:05.152960+0000", 2024-09-13T06:43:13.450 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 8.2667386220000001, 2024-09-13T06:43:13.450 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.055296975999999998, 2024-09-13T06:43:13.450 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:13.450 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:13.450 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:13.451 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:13.451 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:13.451 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 209558 2024-09-13T06:43:13.451 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:13.451 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:13.451 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:13.451 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:13.451 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.152960+0000", 2024-09-13T06:43:13.452 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:13.452 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:13.452 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:13.452 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:13.452 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.152960+0000", 2024-09-13T06:43:13.452 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:13.452 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:13.452 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:13.452 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:13.453 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.152959+0000", 2024-09-13T06:43:13.453 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:13.453 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:13.453 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:13.453 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:13.453 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.152962+0000", 2024-09-13T06:43:13.453 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6709999999999999e-06 2024-09-13T06:43:13.453 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:13.453 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:13.454 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:13.454 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.152968+0000", 2024-09-13T06:43:13.454 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.5589999999999996e-06 2024-09-13T06:43:13.454 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:13.454 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:13.454 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:13.454 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.152972+0000", 2024-09-13T06:43:13.454 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.216e-06 2024-09-13T06:43:13.454 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:13.454 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:13.455 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:13.455 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.208146+0000", 2024-09-13T06:43:13.455 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.055173627000000003 2024-09-13T06:43:13.455 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:13.455 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:13.455 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:13.455 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.208193+0000", 2024-09-13T06:43:13.455 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7200000000000002e-05 2024-09-13T06:43:13.455 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:13.455 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:13.455 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:13.455 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.208257+0000", 2024-09-13T06:43:13.455 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.4058000000000002e-05 2024-09-13T06:43:13.455 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:13.456 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:13.456 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:13.456 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:13.456 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:13.456 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:209559 3.6 3:673cd4d4:::rbd_data.1121cb4a09ed.0000000000000002:82 [read 868352~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e220)", 2024-09-13T06:43:13.456 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:43:05.152976+0000", 2024-09-13T06:43:13.456 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 8.2667225089999992, 2024-09-13T06:43:13.456 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.055514239, 2024-09-13T06:43:13.456 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:13.456 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:13.456 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:13.457 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:13.457 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:13.457 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 209559 2024-09-13T06:43:13.457 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:13.457 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:13.457 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:13.457 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:13.457 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.152976+0000", 2024-09-13T06:43:13.457 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:13.458 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:13.458 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:13.458 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:13.458 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.152976+0000", 2024-09-13T06:43:13.458 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:13.458 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:13.458 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:13.458 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:13.459 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.152976+0000", 2024-09-13T06:43:13.459 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:13.459 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:13.459 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:13.459 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:13.459 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.152978+0000", 2024-09-13T06:43:13.460 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2189999999999998e-06 2024-09-13T06:43:13.460 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:13.460 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:13.460 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:13.460 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.152983+0000", 2024-09-13T06:43:13.460 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3639999999999998e-06 2024-09-13T06:43:13.460 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:13.460 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:13.460 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:13.461 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.152987+0000", 2024-09-13T06:43:13.461 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.9469999999999996e-06 2024-09-13T06:43:13.461 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:13.461 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:13.461 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:13.461 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.208301+0000", 2024-09-13T06:43:13.461 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.055314292000000001 2024-09-13T06:43:13.461 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:13.462 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:13.462 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:13.462 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.208385+0000", 2024-09-13T06:43:13.462 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.3755e-05 2024-09-13T06:43:13.462 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:13.462 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:13.462 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:13.462 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.208490+0000", 2024-09-13T06:43:13.462 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00010498800000000001 2024-09-13T06:43:13.463 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:13.463 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:13.463 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:13.463 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:13.463 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:13.463 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:209560 3.6 3:673cd4d4:::rbd_data.1121cb4a09ed.0000000000000002:82 [read 880640~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e220)", 2024-09-13T06:43:13.463 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:43:05.152991+0000", 2024-09-13T06:43:13.463 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 8.2667074199999995, 2024-09-13T06:43:13.464 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.05572912, 2024-09-13T06:43:13.464 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:13.464 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:13.464 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:13.464 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:13.464 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:13.464 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 209560 2024-09-13T06:43:13.464 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:13.465 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:13.465 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:13.465 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:13.465 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.152991+0000", 2024-09-13T06:43:13.465 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:13.465 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:13.465 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:13.465 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:13.465 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.152991+0000", 2024-09-13T06:43:13.466 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:13.466 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:13.466 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:13.466 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:13.466 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.152991+0000", 2024-09-13T06:43:13.466 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:13.466 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:13.466 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:13.466 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:13.467 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.152993+0000", 2024-09-13T06:43:13.467 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3159999999999999e-06 2024-09-13T06:43:13.467 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:13.467 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:13.467 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:13.467 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.152999+0000", 2024-09-13T06:43:13.467 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8529999999999997e-06 2024-09-13T06:43:13.467 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:13.467 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:13.467 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:13.467 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153004+0000", 2024-09-13T06:43:13.467 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6210000000000003e-06 2024-09-13T06:43:13.467 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:13.468 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:13.468 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:13.468 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.208530+0000", 2024-09-13T06:43:13.468 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.055526407999999999 2024-09-13T06:43:13.468 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:13.468 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:13.468 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:13.468 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.208616+0000", 2024-09-13T06:43:13.468 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.6483000000000005e-05 2024-09-13T06:43:13.469 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:13.469 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:13.469 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:13.469 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.208720+0000", 2024-09-13T06:43:13.469 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00010376 2024-09-13T06:43:13.469 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:13.469 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:13.469 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:13.469 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:13.469 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:13.470 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:209561 3.6 3:673cd4d4:::rbd_data.1121cb4a09ed.0000000000000002:82 [read 892928~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e220)", 2024-09-13T06:43:13.470 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:43:05.153008+0000", 2024-09-13T06:43:13.470 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 8.2666905259999997, 2024-09-13T06:43:13.470 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0559225, 2024-09-13T06:43:13.470 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:13.470 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:13.470 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:13.470 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:13.470 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:13.471 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 209561 2024-09-13T06:43:13.471 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:13.471 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:13.471 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:13.471 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:13.471 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153008+0000", 2024-09-13T06:43:13.471 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:13.471 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:13.472 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:13.472 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:13.472 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153008+0000", 2024-09-13T06:43:13.472 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:13.472 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:13.472 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:13.472 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:13.472 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153008+0000", 2024-09-13T06:43:13.473 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:13.473 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:13.473 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:13.473 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:13.473 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153010+0000", 2024-09-13T06:43:13.473 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.8210000000000002e-06 2024-09-13T06:43:13.473 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:13.473 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:13.473 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:13.474 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153016+0000", 2024-09-13T06:43:13.474 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.575e-06 2024-09-13T06:43:13.474 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:13.474 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:13.474 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:13.474 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153020+0000", 2024-09-13T06:43:13.474 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.408e-06 2024-09-13T06:43:13.474 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:13.475 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:13.475 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:13.475 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.208751+0000", 2024-09-13T06:43:13.475 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.055730225000000001 2024-09-13T06:43:13.475 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:13.475 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:13.475 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:13.475 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.208825+0000", 2024-09-13T06:43:13.475 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4548999999999994e-05 2024-09-13T06:43:13.476 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:13.476 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:13.476 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:13.476 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.208930+0000", 2024-09-13T06:43:13.476 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00010529700000000001 2024-09-13T06:43:13.476 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:13.476 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:13.477 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:13.477 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:13.477 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:13.477 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:209562 3.6 3:673cd4d4:::rbd_data.1121cb4a09ed.0000000000000002:82 [read 905216~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e220)", 2024-09-13T06:43:13.477 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:43:05.153024+0000", 2024-09-13T06:43:13.477 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 8.2666740999999995, 2024-09-13T06:43:13.477 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.056099906999999997, 2024-09-13T06:43:13.477 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:13.477 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:13.477 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:13.478 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:13.478 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:13.478 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 209562 2024-09-13T06:43:13.478 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:13.478 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:13.478 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:13.478 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:13.478 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153024+0000", 2024-09-13T06:43:13.478 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:13.478 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:13.478 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:13.479 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:13.479 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153024+0000", 2024-09-13T06:43:13.479 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:13.479 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:13.479 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:13.479 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:13.479 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153024+0000", 2024-09-13T06:43:13.479 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:13.479 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:13.479 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:13.479 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:13.480 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153026+0000", 2024-09-13T06:43:13.480 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.165e-06 2024-09-13T06:43:13.480 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:13.480 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:13.480 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:13.480 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153031+0000", 2024-09-13T06:43:13.480 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.1669999999999998e-06 2024-09-13T06:43:13.480 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:13.480 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:13.480 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:13.481 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153035+0000", 2024-09-13T06:43:13.481 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.0799999999999999e-06 2024-09-13T06:43:13.481 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:13.481 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:13.481 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:13.481 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.208956+0000", 2024-09-13T06:43:13.481 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.055920848000000002 2024-09-13T06:43:13.481 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:13.481 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:13.481 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:13.482 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.209032+0000", 2024-09-13T06:43:13.482 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5809999999999994e-05 2024-09-13T06:43:13.482 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:13.482 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:13.482 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:13.482 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.209124+0000", 2024-09-13T06:43:13.482 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.2157999999999994e-05 2024-09-13T06:43:13.482 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:13.482 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:13.482 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:13.483 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:13.483 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:13.483 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:209563 3.6 3:673cd4d4:::rbd_data.1121cb4a09ed.0000000000000002:82 [read 917504~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e220)", 2024-09-13T06:43:13.483 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:43:05.153039+0000", 2024-09-13T06:43:13.483 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 8.2666591369999995, 2024-09-13T06:43:13.483 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.056280030000000002, 2024-09-13T06:43:13.483 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:13.483 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:13.484 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:13.484 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:13.484 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:13.484 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 209563 2024-09-13T06:43:13.484 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:13.484 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:13.484 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:13.484 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:13.484 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153039+0000", 2024-09-13T06:43:13.485 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:13.485 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:13.485 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:13.485 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:13.485 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153039+0000", 2024-09-13T06:43:13.485 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:13.485 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:13.485 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:13.485 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:13.486 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153039+0000", 2024-09-13T06:43:13.486 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:13.486 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:13.486 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:13.486 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:13.486 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153041+0000", 2024-09-13T06:43:13.486 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3800000000000001e-06 2024-09-13T06:43:13.486 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:13.487 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:13.487 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:13.487 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153047+0000", 2024-09-13T06:43:13.487 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2059999999999998e-06 2024-09-13T06:43:13.487 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:13.487 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:13.487 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:13.487 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153051+0000", 2024-09-13T06:43:13.488 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.0980000000000004e-06 2024-09-13T06:43:13.488 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:13.488 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:13.488 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:13.488 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.209150+0000", 2024-09-13T06:43:13.488 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.056099351999999998 2024-09-13T06:43:13.488 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:13.488 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:13.488 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:13.489 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.209226+0000", 2024-09-13T06:43:13.489 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5939999999999995e-05 2024-09-13T06:43:13.489 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:13.489 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:13.489 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:13.489 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.209319+0000", 2024-09-13T06:43:13.489 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.3399000000000005e-05 2024-09-13T06:43:13.489 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:13.489 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:13.490 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:13.490 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:13.490 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:13.490 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:209564 3.6 3:673cd4d4:::rbd_data.1121cb4a09ed.0000000000000002:82 [read 929792~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e220)", 2024-09-13T06:43:13.490 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:43:05.153055+0000", 2024-09-13T06:43:13.490 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 8.2666438909999993, 2024-09-13T06:43:13.490 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.056404468999999999, 2024-09-13T06:43:13.490 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:13.490 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:13.490 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:13.490 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:13.491 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:13.491 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 209564 2024-09-13T06:43:13.491 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:13.491 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:13.491 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:13.491 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:13.491 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153055+0000", 2024-09-13T06:43:13.491 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:13.491 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:13.491 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:13.491 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:13.492 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153055+0000", 2024-09-13T06:43:13.492 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:13.492 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:13.492 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:13.492 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:13.492 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153054+0000", 2024-09-13T06:43:13.492 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:13.492 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:13.492 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:13.493 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:13.493 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153056+0000", 2024-09-13T06:43:13.493 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1600000000000001e-06 2024-09-13T06:43:13.493 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:13.493 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:13.493 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:13.493 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153062+0000", 2024-09-13T06:43:13.493 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2549999999999997e-06 2024-09-13T06:43:13.493 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:13.493 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:13.493 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:13.494 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153066+0000", 2024-09-13T06:43:13.494 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.0400000000000003e-06 2024-09-13T06:43:13.494 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:13.494 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:13.494 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:13.494 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.209342+0000", 2024-09-13T06:43:13.494 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.056276640000000003 2024-09-13T06:43:13.494 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:13.494 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:13.494 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:13.494 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.209382+0000", 2024-09-13T06:43:13.494 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.9626999999999999e-05 2024-09-13T06:43:13.495 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:13.495 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:13.495 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:13.495 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.209459+0000", 2024-09-13T06:43:13.495 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.7072999999999999e-05 2024-09-13T06:43:13.495 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:13.495 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:13.495 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:13.495 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:13.495 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:13.495 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:209565 3.6 3:673cd4d4:::rbd_data.1121cb4a09ed.0000000000000002:82 [read 942080~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e220)", 2024-09-13T06:43:13.495 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:43:05.153070+0000", 2024-09-13T06:43:13.495 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 8.2666289180000003, 2024-09-13T06:43:13.495 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.056688545999999999, 2024-09-13T06:43:13.496 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:13.496 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:13.496 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:13.496 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:13.496 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:13.496 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 209565 2024-09-13T06:43:13.496 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:13.496 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:13.496 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:13.496 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:13.496 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153070+0000", 2024-09-13T06:43:13.496 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:13.496 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:13.496 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:13.497 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:13.497 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153070+0000", 2024-09-13T06:43:13.497 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:13.497 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:13.497 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:13.497 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:13.497 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153069+0000", 2024-09-13T06:43:13.497 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:13.497 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:13.497 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:13.497 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:13.497 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153071+0000", 2024-09-13T06:43:13.498 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1780000000000002e-06 2024-09-13T06:43:13.498 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:13.498 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:13.498 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:13.498 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153077+0000", 2024-09-13T06:43:13.498 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3639999999999998e-06 2024-09-13T06:43:13.498 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:13.499 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:13.499 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:13.499 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153081+0000", 2024-09-13T06:43:13.499 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.1640000000000003e-06 2024-09-13T06:43:13.499 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:13.499 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:13.499 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:13.499 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.209486+0000", 2024-09-13T06:43:13.499 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.056405258999999999 2024-09-13T06:43:13.499 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:13.499 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:13.499 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:13.499 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.209560+0000", 2024-09-13T06:43:13.499 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4247999999999998e-05 2024-09-13T06:43:13.499 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:13.500 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:13.500 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:13.500 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.209758+0000", 2024-09-13T06:43:13.500 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000197634 2024-09-13T06:43:13.500 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:13.500 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:13.500 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:13.500 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:13.500 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:13.500 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:209566 3.6 3:673cd4d4:::rbd_data.1121cb4a09ed.0000000000000002:82 [read 954368~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e220)", 2024-09-13T06:43:13.500 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:43:05.153085+0000", 2024-09-13T06:43:13.500 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 8.2666136090000002, 2024-09-13T06:43:13.500 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.057070779000000002, 2024-09-13T06:43:13.501 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:13.501 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:13.501 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:13.501 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:13.501 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:13.501 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 209566 2024-09-13T06:43:13.501 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:13.501 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:13.501 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:13.501 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:13.501 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153085+0000", 2024-09-13T06:43:13.501 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:13.501 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:13.501 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:13.501 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:13.502 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153085+0000", 2024-09-13T06:43:13.502 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:13.502 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:13.502 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:13.502 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:13.502 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153085+0000", 2024-09-13T06:43:13.502 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:13.502 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:13.502 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:13.502 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:13.502 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153087+0000", 2024-09-13T06:43:13.502 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1220000000000002e-06 2024-09-13T06:43:13.502 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:13.503 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:13.503 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:13.503 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153092+0000", 2024-09-13T06:43:13.503 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3090000000000003e-06 2024-09-13T06:43:13.503 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:13.503 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:13.503 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:13.503 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153096+0000", 2024-09-13T06:43:13.503 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.1819999999999999e-06 2024-09-13T06:43:13.503 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:13.503 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:13.503 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:13.503 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.209787+0000", 2024-09-13T06:43:13.503 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.056690819000000003 2024-09-13T06:43:13.504 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:13.504 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:13.504 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:13.504 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.209863+0000", 2024-09-13T06:43:13.504 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5551999999999998e-05 2024-09-13T06:43:13.504 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:13.504 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:13.504 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:13.504 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.210156+0000", 2024-09-13T06:43:13.504 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00029310499999999999 2024-09-13T06:43:13.504 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:13.504 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:13.504 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:13.505 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:13.505 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:13.505 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:209567 3.6 3:673cd4d4:::rbd_data.1121cb4a09ed.0000000000000002:82 [read 966656~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e220)", 2024-09-13T06:43:13.505 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:43:05.153100+0000", 2024-09-13T06:43:13.505 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 8.2665982360000001, 2024-09-13T06:43:13.505 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.057459567000000003, 2024-09-13T06:43:13.505 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:13.505 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:13.505 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:13.505 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:13.505 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:13.505 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 209567 2024-09-13T06:43:13.506 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:13.506 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:13.506 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:13.506 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:13.506 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153100+0000", 2024-09-13T06:43:13.506 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:13.506 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:13.506 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:13.506 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:13.506 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153100+0000", 2024-09-13T06:43:13.506 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:13.506 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:13.506 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:13.507 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:13.507 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153100+0000", 2024-09-13T06:43:13.507 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:13.507 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:13.507 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:13.507 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:13.507 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153105+0000", 2024-09-13T06:43:13.507 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.5400000000000003e-06 2024-09-13T06:43:13.507 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:13.508 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:13.508 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:13.508 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153111+0000", 2024-09-13T06:43:13.508 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.541e-06 2024-09-13T06:43:13.508 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:13.508 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:13.508 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:13.508 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153115+0000", 2024-09-13T06:43:13.508 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.104e-06 2024-09-13T06:43:13.508 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:13.508 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:13.508 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:13.508 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.210183+0000", 2024-09-13T06:43:13.509 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.057067842000000001 2024-09-13T06:43:13.509 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:13.509 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:13.509 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:13.509 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.210257+0000", 2024-09-13T06:43:13.509 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3726999999999994e-05 2024-09-13T06:43:13.509 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:13.509 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:13.509 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:13.509 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.210560+0000", 2024-09-13T06:43:13.509 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00030318899999999999 2024-09-13T06:43:13.509 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:13.510 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:13.510 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:13.510 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:13.510 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:13.510 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:209568 3.6 3:673cd4d4:::rbd_data.1121cb4a09ed.0000000000000002:82 [read 978944~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e220)", 2024-09-13T06:43:13.510 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:43:05.153119+0000", 2024-09-13T06:43:13.510 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 8.2665790359999995, 2024-09-13T06:43:13.510 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.057810786000000003, 2024-09-13T06:43:13.510 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:13.510 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:13.510 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:13.510 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:13.510 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:13.510 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 209568 2024-09-13T06:43:13.511 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:13.511 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:13.511 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:13.511 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:13.511 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153119+0000", 2024-09-13T06:43:13.511 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:13.511 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:13.511 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:13.511 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:13.511 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153119+0000", 2024-09-13T06:43:13.511 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:13.511 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:13.511 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:13.512 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:13.512 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153119+0000", 2024-09-13T06:43:13.512 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:13.512 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:13.512 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:13.512 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:13.512 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153121+0000", 2024-09-13T06:43:13.512 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.21e-06 2024-09-13T06:43:13.512 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:13.513 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:13.513 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:13.513 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153127+0000", 2024-09-13T06:43:13.513 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.4670000000000003e-06 2024-09-13T06:43:13.513 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:13.513 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:13.513 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:13.513 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153131+0000", 2024-09-13T06:43:13.513 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.2629999999999997e-06 2024-09-13T06:43:13.513 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:13.513 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:13.513 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:13.513 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.210587+0000", 2024-09-13T06:43:13.514 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.05745567 2024-09-13T06:43:13.514 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:13.514 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:13.514 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:13.514 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.210660+0000", 2024-09-13T06:43:13.514 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3430000000000007e-05 2024-09-13T06:43:13.514 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:13.514 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:13.514 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:13.514 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.210930+0000", 2024-09-13T06:43:13.514 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000270127 2024-09-13T06:43:13.514 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:13.514 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:13.514 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:13.514 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:13.515 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:13.515 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:209569 3.6 3:673cd4d4:::rbd_data.1121cb4a09ed.0000000000000002:82 [read 991232~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e220)", 2024-09-13T06:43:13.515 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:43:05.153135+0000", 2024-09-13T06:43:13.515 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 8.2665636110000005, 2024-09-13T06:43:13.515 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.058283125999999998, 2024-09-13T06:43:13.515 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:13.515 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:13.515 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:13.515 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:13.515 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:13.515 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 209569 2024-09-13T06:43:13.515 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:13.515 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:13.515 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:13.516 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:13.516 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153135+0000", 2024-09-13T06:43:13.516 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:13.516 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:13.516 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:13.516 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:13.516 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153135+0000", 2024-09-13T06:43:13.516 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:13.516 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:13.516 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:13.516 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:13.516 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153135+0000", 2024-09-13T06:43:13.516 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:13.517 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:13.517 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:13.517 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:13.517 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153136+0000", 2024-09-13T06:43:13.517 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9069999999999999e-06 2024-09-13T06:43:13.517 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:13.517 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:13.517 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:13.517 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153142+0000", 2024-09-13T06:43:13.517 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3009999999999997e-06 2024-09-13T06:43:13.517 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:13.517 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:13.517 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:13.518 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153146+0000", 2024-09-13T06:43:13.518 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.442e-06 2024-09-13T06:43:13.518 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:13.518 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:13.518 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:13.518 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.210959+0000", 2024-09-13T06:43:13.518 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.057812456999999998 2024-09-13T06:43:13.518 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:13.518 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:13.518 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:13.518 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.211038+0000", 2024-09-13T06:43:13.518 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.9140999999999993e-05 2024-09-13T06:43:13.518 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:13.519 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:13.519 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:13.519 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.211418+0000", 2024-09-13T06:43:13.519 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00038017500000000001 2024-09-13T06:43:13.519 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:13.519 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:13.519 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:13.519 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:13.519 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:13.519 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:209570 3.6 3:673cd4d4:::rbd_data.1121cb4a09ed.0000000000000002:82 [read 1003520~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e220)", 2024-09-13T06:43:13.519 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:43:05.153151+0000", 2024-09-13T06:43:13.519 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 8.2665477280000008, 2024-09-13T06:43:13.519 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.058499886000000001, 2024-09-13T06:43:13.519 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:13.520 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:13.520 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:13.520 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:13.520 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:13.520 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 209570 2024-09-13T06:43:13.520 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:13.520 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:13.520 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:13.520 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:13.520 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153151+0000", 2024-09-13T06:43:13.520 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:13.520 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:13.520 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:13.520 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:13.521 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153151+0000", 2024-09-13T06:43:13.521 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:13.521 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:13.521 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:13.521 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:13.521 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153150+0000", 2024-09-13T06:43:13.521 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:13.521 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:13.521 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:13.521 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:13.521 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153153+0000", 2024-09-13T06:43:13.521 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3630000000000001e-06 2024-09-13T06:43:13.521 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:13.522 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:13.522 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:13.522 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153159+0000", 2024-09-13T06:43:13.522 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3690000000000003e-06 2024-09-13T06:43:13.522 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:13.522 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:13.522 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:13.522 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153164+0000", 2024-09-13T06:43:13.522 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5379999999999996e-06 2024-09-13T06:43:13.522 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:13.522 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:13.522 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:13.522 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.211448+0000", 2024-09-13T06:43:13.523 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.058283926 2024-09-13T06:43:13.523 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:13.523 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:13.523 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:13.523 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.211508+0000", 2024-09-13T06:43:13.523 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0741e-05 2024-09-13T06:43:13.523 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:13.523 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:13.523 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:13.523 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.211651+0000", 2024-09-13T06:43:13.523 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00014232200000000001 2024-09-13T06:43:13.523 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:13.523 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:13.524 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:13.524 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:13.524 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:13.524 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:209571 3.6 3:673cd4d4:::rbd_data.1121cb4a09ed.0000000000000002:82 [read 1015808~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e220)", 2024-09-13T06:43:13.524 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:43:05.153168+0000", 2024-09-13T06:43:13.524 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 8.2665302169999997, 2024-09-13T06:43:13.524 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.058709363000000001, 2024-09-13T06:43:13.524 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:13.524 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:13.524 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:13.524 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:13.524 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:13.524 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 209571 2024-09-13T06:43:13.524 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:13.525 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:13.525 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:13.525 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:13.525 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153168+0000", 2024-09-13T06:43:13.525 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:13.525 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:13.525 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:13.525 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:13.525 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153168+0000", 2024-09-13T06:43:13.525 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:13.525 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:13.525 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:13.525 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:13.525 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153168+0000", 2024-09-13T06:43:13.526 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:13.526 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:13.526 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:13.526 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:13.526 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153170+0000", 2024-09-13T06:43:13.526 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4499999999999998e-06 2024-09-13T06:43:13.526 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:13.526 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:13.526 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:13.526 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153176+0000", 2024-09-13T06:43:13.526 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0050000000000001e-06 2024-09-13T06:43:13.526 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:13.526 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:13.527 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:13.527 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153181+0000", 2024-09-13T06:43:13.527 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.267e-06 2024-09-13T06:43:13.527 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:13.527 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:13.527 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:13.527 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.211678+0000", 2024-09-13T06:43:13.527 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.058497751000000001 2024-09-13T06:43:13.527 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:13.527 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:13.527 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:13.527 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.211744+0000", 2024-09-13T06:43:13.527 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.5266999999999997e-05 2024-09-13T06:43:13.527 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:13.528 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:13.528 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:13.528 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.211878+0000", 2024-09-13T06:43:13.528 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00013394500000000001 2024-09-13T06:43:13.528 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:13.528 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:13.528 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:13.528 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:13.528 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:13.528 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:209572 3.6 3:673cd4d4:::rbd_data.1121cb4a09ed.0000000000000002:82 [read 1028096~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e220)", 2024-09-13T06:43:13.528 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:43:05.153185+0000", 2024-09-13T06:43:13.528 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 8.2665138220000003, 2024-09-13T06:43:13.528 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.058928534999999997, 2024-09-13T06:43:13.529 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:13.529 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:13.529 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:13.529 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:13.529 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:13.529 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 209572 2024-09-13T06:43:13.529 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:13.529 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:13.529 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:13.529 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:13.529 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153185+0000", 2024-09-13T06:43:13.529 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:13.530 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:13.530 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:13.530 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:13.530 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153185+0000", 2024-09-13T06:43:13.530 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:13.530 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:13.530 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:13.530 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:13.530 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153184+0000", 2024-09-13T06:43:13.530 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:13.530 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:13.530 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:13.531 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:13.531 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153186+0000", 2024-09-13T06:43:13.531 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1040000000000001e-06 2024-09-13T06:43:13.531 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:13.531 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:13.531 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:13.531 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153191+0000", 2024-09-13T06:43:13.531 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0409999999999997e-06 2024-09-13T06:43:13.531 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:13.531 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:13.531 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:13.531 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153196+0000", 2024-09-13T06:43:13.531 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.2200000000000003e-06 2024-09-13T06:43:13.531 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:13.532 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:13.532 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:13.532 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.211906+0000", 2024-09-13T06:43:13.532 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.058709960999999998 2024-09-13T06:43:13.532 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:13.532 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:13.532 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:13.532 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.211977+0000", 2024-09-13T06:43:13.532 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.1080000000000004e-05 2024-09-13T06:43:13.532 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:13.532 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:13.532 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:13.532 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.212113+0000", 2024-09-13T06:43:13.532 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00013644500000000001 2024-09-13T06:43:13.533 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:13.533 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:13.533 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:13.533 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:13.533 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:13.533 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:209573 3.6 3:673cd4d4:::rbd_data.1121cb4a09ed.0000000000000002:82 [read 1040384~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e220)", 2024-09-13T06:43:13.533 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:43:05.153199+0000", 2024-09-13T06:43:13.533 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 8.2664990320000005, 2024-09-13T06:43:13.533 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.059182414000000003, 2024-09-13T06:43:13.533 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:13.533 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:13.533 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:13.533 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:13.534 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:13.534 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 209573 2024-09-13T06:43:13.534 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:13.534 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:13.534 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:13.534 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:13.534 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153199+0000", 2024-09-13T06:43:13.534 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:13.534 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:13.534 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:13.534 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:13.534 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153199+0000", 2024-09-13T06:43:13.534 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:13.534 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:13.534 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:13.535 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:13.535 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153199+0000", 2024-09-13T06:43:13.535 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:13.535 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:13.535 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:13.535 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:13.535 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153201+0000", 2024-09-13T06:43:13.535 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0470000000000001e-06 2024-09-13T06:43:13.535 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:13.535 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:13.535 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:13.535 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153207+0000", 2024-09-13T06:43:13.535 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3730000000000001e-06 2024-09-13T06:43:13.535 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:13.535 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:13.536 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:13.536 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153211+0000", 2024-09-13T06:43:13.536 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.053e-06 2024-09-13T06:43:13.536 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:13.536 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:13.536 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:13.536 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.212141+0000", 2024-09-13T06:43:13.536 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.058930064999999997 2024-09-13T06:43:13.536 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:13.536 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:13.536 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:13.536 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.212214+0000", 2024-09-13T06:43:13.536 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3096999999999995e-05 2024-09-13T06:43:13.537 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:13.537 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:13.537 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:13.537 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.212382+0000", 2024-09-13T06:43:13.537 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000168138 2024-09-13T06:43:13.537 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:13.537 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:13.537 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:13.537 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:13.537 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:13.537 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:43:13.538 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-13T06:43:13.539 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-13T06:43:13.540 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:43:13.537+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:43:13.640 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:43:13.641+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:43:13.723 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:43:13.723 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-13T06:43:13.723 INFO:teuthology.orchestra.run.smithi081.stdout: "num_ops": 0 2024-09-13T06:43:13.723 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:43:13.740 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-13T06:43:13.741 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:43:13.740+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:43:13.842 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:43:13.841+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:43:13.854 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:43:13.854 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-13T06:43:13.854 INFO:teuthology.orchestra.run.smithi081.stdout: "complaint_time": 30, 2024-09-13T06:43:13.854 INFO:teuthology.orchestra.run.smithi081.stdout: "num_blocked_ops": 0 2024-09-13T06:43:13.854 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:43:13.868 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-13T06:43:13.943 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:43:13.944+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:43:13.998 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:43:13.998 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 20, 2024-09-13T06:43:13.998 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 600, 2024-09-13T06:43:13.998 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [ 2024-09-13T06:43:13.998 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:13.998 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:36160 3.f 3:f62782c2:::rbd_object_map.11219660270d.0000000000000016:head [call] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-13T06:43:13.998 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:01.607291+0000", 2024-09-13T06:43:13.998 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 192.389528036, 2024-09-13T06:43:13.998 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.99619456699999998, 2024-09-13T06:43:13.998 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:13.998 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:13.999 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:13.999 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:13.999 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:13.999 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 36160 2024-09-13T06:43:13.999 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:13.999 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:13.999 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:13.999 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:13.999 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:01.607291+0000", 2024-09-13T06:43:13.999 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:13.999 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:13.999 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:13.999 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:14.000 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:01.607291+0000", 2024-09-13T06:43:14.000 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:14.000 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.000 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.000 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:14.000 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:01.607289+0000", 2024-09-13T06:43:14.000 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999976 2024-09-13T06:43:14.000 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.000 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.000 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:14.000 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:01.607302+0000", 2024-09-13T06:43:14.000 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3018e-05 2024-09-13T06:43:14.000 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.001 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.001 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:14.001 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:01.607323+0000", 2024-09-13T06:43:14.001 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1030999999999999e-05 2024-09-13T06:43:14.001 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.001 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.001 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:14.001 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:01.607342+0000", 2024-09-13T06:43:14.001 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8961e-05 2024-09-13T06:43:14.001 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.001 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.001 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:14.001 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:01.607425+0000", 2024-09-13T06:43:14.002 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.3171999999999996e-05 2024-09-13T06:43:14.002 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.002 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.002 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:43:14.002 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:01.607441+0000", 2024-09-13T06:43:14.002 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5996999999999999e-05 2024-09-13T06:43:14.002 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.002 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.002 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:14.002 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:02.596186+0000", 2024-09-13T06:43:14.002 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.98874432000000001 2024-09-13T06:43:14.002 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.002 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.003 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for missing object", 2024-09-13T06:43:14.003 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:02.596618+0000", 2024-09-13T06:43:14.003 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000432032 2024-09-13T06:43:14.003 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.003 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.003 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:14.003 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:02.600845+0000", 2024-09-13T06:43:14.003 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0042277410000000001 2024-09-13T06:43:14.003 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.003 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.003 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:14.003 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:02.601003+0000", 2024-09-13T06:43:14.003 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00015731999999999999 2024-09-13T06:43:14.003 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.004 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.004 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:14.004 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:02.603486+0000", 2024-09-13T06:43:14.004 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0024832510000000001 2024-09-13T06:43:14.004 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:14.004 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:14.004 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:14.004 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.004 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.004 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:37806 3.9 3:951cb95b:::rbd_data.1121d8143c6e.0000000000000002:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e56)", 2024-09-13T06:43:14.004 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:06.373482+0000", 2024-09-13T06:43:14.004 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 187.62333699999999, 2024-09-13T06:43:14.004 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.002476213, 2024-09-13T06:43:14.005 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:14.005 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:14.005 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:14.005 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:14.005 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:14.005 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 37806 2024-09-13T06:43:14.005 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.005 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:14.005 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.005 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:14.005 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.373482+0000", 2024-09-13T06:43:14.005 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:14.005 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.005 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.006 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:14.006 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.373482+0000", 2024-09-13T06:43:14.006 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:14.006 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.006 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.006 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:14.006 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.373479+0000", 2024-09-13T06:43:14.006 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999962 2024-09-13T06:43:14.006 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.006 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.006 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:14.006 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.373495+0000", 2024-09-13T06:43:14.006 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6640999999999999e-05 2024-09-13T06:43:14.007 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.007 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.007 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:14.007 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.373542+0000", 2024-09-13T06:43:14.007 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6229000000000001e-05 2024-09-13T06:43:14.007 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.007 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.007 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:14.007 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.373564+0000", 2024-09-13T06:43:14.007 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2684000000000002e-05 2024-09-13T06:43:14.007 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.007 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.007 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:14.007 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374268+0000", 2024-09-13T06:43:14.008 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00070363700000000001 2024-09-13T06:43:14.008 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.008 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.008 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:43:14.008 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374305+0000", 2024-09-13T06:43:14.008 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.6936e-05 2024-09-13T06:43:14.008 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.008 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.008 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:14.008 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.375175+0000", 2024-09-13T06:43:14.008 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.000870454 2024-09-13T06:43:14.008 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.008 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.009 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:14.009 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.375678+0000", 2024-09-13T06:43:14.009 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00050292499999999999 2024-09-13T06:43:14.009 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.009 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.009 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:14.009 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.375959+0000", 2024-09-13T06:43:14.009 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00028050599999999997 2024-09-13T06:43:14.009 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:14.009 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:14.009 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:14.009 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.009 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.009 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:37821 3.9 3:951cb95b:::rbd_data.1121d8143c6e.0000000000000002:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e56)", 2024-09-13T06:43:14.010 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:06.374454+0000", 2024-09-13T06:43:14.010 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 187.62236588299999, 2024-09-13T06:43:14.010 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.002545072, 2024-09-13T06:43:14.010 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:14.010 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:14.010 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:14.010 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:14.010 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:14.010 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 37821 2024-09-13T06:43:14.010 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.010 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:14.010 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.010 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:14.011 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374454+0000", 2024-09-13T06:43:14.011 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:14.011 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.011 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.011 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:14.011 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374454+0000", 2024-09-13T06:43:14.011 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:14.011 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.011 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.011 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:14.011 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374452+0000", 2024-09-13T06:43:14.011 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999981 2024-09-13T06:43:14.012 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.012 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.012 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:14.012 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374463+0000", 2024-09-13T06:43:14.012 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0756e-05 2024-09-13T06:43:14.012 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.012 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.012 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:14.012 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374487+0000", 2024-09-13T06:43:14.012 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4887000000000001e-05 2024-09-13T06:43:14.012 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.012 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.012 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:14.013 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374504+0000", 2024-09-13T06:43:14.013 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6852000000000001e-05 2024-09-13T06:43:14.013 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.013 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.013 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:14.013 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374829+0000", 2024-09-13T06:43:14.013 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000324684 2024-09-13T06:43:14.013 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.013 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.013 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:43:14.013 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374880+0000", 2024-09-13T06:43:14.013 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.1378000000000002e-05 2024-09-13T06:43:14.013 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.014 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.014 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:14.014 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.376423+0000", 2024-09-13T06:43:14.014 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.001542734 2024-09-13T06:43:14.014 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.014 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.014 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:14.014 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.376607+0000", 2024-09-13T06:43:14.014 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000183656 2024-09-13T06:43:14.014 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.014 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.014 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:14.014 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.376999+0000", 2024-09-13T06:43:14.015 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00039191200000000001 2024-09-13T06:43:14.015 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:14.015 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:14.015 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:14.015 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.015 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.015 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:37836 3.9 3:951cb95b:::rbd_data.1121d8143c6e.0000000000000002:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e56)", 2024-09-13T06:43:14.015 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:06.374929+0000", 2024-09-13T06:43:14.015 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 187.62189023100001, 2024-09-13T06:43:14.015 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.002778825, 2024-09-13T06:43:14.015 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:14.015 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:14.015 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:14.015 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:14.016 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:14.016 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 37836 2024-09-13T06:43:14.016 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.016 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:14.016 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.016 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:14.016 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374929+0000", 2024-09-13T06:43:14.016 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:14.016 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.016 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.016 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:14.016 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374929+0000", 2024-09-13T06:43:14.016 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:14.017 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.017 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.017 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:14.017 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374927+0000", 2024-09-13T06:43:14.017 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999981 2024-09-13T06:43:14.017 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.017 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.017 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:14.017 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374939+0000", 2024-09-13T06:43:14.017 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1846e-05 2024-09-13T06:43:14.017 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.017 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.017 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:14.017 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374962+0000", 2024-09-13T06:43:14.018 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3054e-05 2024-09-13T06:43:14.018 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.018 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.018 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:14.018 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374978+0000", 2024-09-13T06:43:14.018 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5899000000000001e-05 2024-09-13T06:43:14.018 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.018 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.018 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:14.018 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.375106+0000", 2024-09-13T06:43:14.018 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00012789 2024-09-13T06:43:14.018 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.018 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.019 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:43:14.019 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.375134+0000", 2024-09-13T06:43:14.019 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.8254000000000001e-05 2024-09-13T06:43:14.019 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.019 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.019 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:14.019 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.377082+0000", 2024-09-13T06:43:14.019 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0019471520000001 2024-09-13T06:43:14.019 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.019 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.019 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:14.019 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.377330+0000", 2024-09-13T06:43:14.020 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00024834199999999997 2024-09-13T06:43:14.020 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.020 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.020 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:14.020 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.377708+0000", 2024-09-13T06:43:14.020 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00037817100000000001 2024-09-13T06:43:14.020 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:14.020 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:14.020 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:14.020 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.020 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.020 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:37851 3.9 3:951cb95b:::rbd_data.1121d8143c6e.0000000000000002:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e56)", 2024-09-13T06:43:14.020 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:06.382636+0000", 2024-09-13T06:43:14.020 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 187.614183346, 2024-09-13T06:43:14.021 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.99582539400000003, 2024-09-13T06:43:14.021 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:14.021 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:14.021 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:14.021 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:14.021 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:14.021 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 37851 2024-09-13T06:43:14.021 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.021 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:14.021 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.021 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:14.021 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.382636+0000", 2024-09-13T06:43:14.022 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:14.022 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.022 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.022 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:14.022 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.382636+0000", 2024-09-13T06:43:14.022 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:14.022 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.022 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.022 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:14.022 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.382633+0000", 2024-09-13T06:43:14.022 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999971 2024-09-13T06:43:14.022 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.022 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.022 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:14.023 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.382652+0000", 2024-09-13T06:43:14.023 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8834999999999998e-05 2024-09-13T06:43:14.023 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.023 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.023 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:14.023 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.382695+0000", 2024-09-13T06:43:14.023 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.3136000000000002e-05 2024-09-13T06:43:14.023 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.023 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.023 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:14.023 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.382716+0000", 2024-09-13T06:43:14.023 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1421e-05 2024-09-13T06:43:14.023 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.024 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.024 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:14.024 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.382860+0000", 2024-09-13T06:43:14.024 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00014389200000000001 2024-09-13T06:43:14.024 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.024 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.024 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:43:14.024 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.382890+0000", 2024-09-13T06:43:14.024 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9827000000000001e-05 2024-09-13T06:43:14.024 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.024 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.024 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:14.024 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.377779+0000", 2024-09-13T06:43:14.024 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.99488842899999996 2024-09-13T06:43:14.025 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.025 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.025 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:14.025 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.378007+0000", 2024-09-13T06:43:14.025 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00022838099999999999 2024-09-13T06:43:14.025 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.025 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.025 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:14.025 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.378462+0000", 2024-09-13T06:43:14.025 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00045452300000000003 2024-09-13T06:43:14.025 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:14.025 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:14.025 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:14.025 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.026 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.026 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:37866 3.9 3:951cb95b:::rbd_data.1121d8143c6e.0000000000000002:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e56)", 2024-09-13T06:43:14.026 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:06.383951+0000", 2024-09-13T06:43:14.026 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 187.61286866, 2024-09-13T06:43:14.026 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.99517962299999996, 2024-09-13T06:43:14.026 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:14.026 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:14.026 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:14.026 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:14.026 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:14.026 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 37866 2024-09-13T06:43:14.026 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.026 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:14.027 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.027 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:14.027 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.383951+0000", 2024-09-13T06:43:14.027 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:14.027 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.027 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.027 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:14.027 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.383951+0000", 2024-09-13T06:43:14.027 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:14.027 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.027 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.027 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:14.027 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.383949+0000", 2024-09-13T06:43:14.028 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999981 2024-09-13T06:43:14.028 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.028 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.028 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:14.028 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.383961+0000", 2024-09-13T06:43:14.028 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1999e-05 2024-09-13T06:43:14.028 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.028 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.028 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:14.028 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384019+0000", 2024-09-13T06:43:14.028 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7621000000000003e-05 2024-09-13T06:43:14.028 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.028 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.029 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:14.029 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384040+0000", 2024-09-13T06:43:14.029 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1528000000000001e-05 2024-09-13T06:43:14.029 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.029 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.029 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:14.029 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384186+0000", 2024-09-13T06:43:14.029 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00014573799999999999 2024-09-13T06:43:14.029 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.029 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.029 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:43:14.029 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384204+0000", 2024-09-13T06:43:14.029 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7992e-05 2024-09-13T06:43:14.029 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.030 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.030 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:14.030 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.378536+0000", 2024-09-13T06:43:14.030 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.99433268600000002 2024-09-13T06:43:14.030 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.030 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.030 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:14.030 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.378771+0000", 2024-09-13T06:43:14.030 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00023445399999999999 2024-09-13T06:43:14.030 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.030 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.030 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:14.031 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.379130+0000", 2024-09-13T06:43:14.031 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00035954200000000002 2024-09-13T06:43:14.031 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:14.031 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:14.031 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:14.031 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.031 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.031 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:37881 3.9 3:951cb95b:::rbd_data.1121d8143c6e.0000000000000002:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e56)", 2024-09-13T06:43:14.031 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:06.384239+0000", 2024-09-13T06:43:14.031 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 187.61258024599999, 2024-09-13T06:43:14.031 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.99541483500000005, 2024-09-13T06:43:14.031 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:14.031 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:14.032 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:14.032 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:14.032 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:14.032 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 37881 2024-09-13T06:43:14.032 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.032 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:14.032 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.032 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:14.032 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384239+0000", 2024-09-13T06:43:14.032 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:14.032 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.032 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.032 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:14.033 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384239+0000", 2024-09-13T06:43:14.033 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:14.033 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.033 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.033 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:14.033 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384238+0000", 2024-09-13T06:43:14.033 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999986 2024-09-13T06:43:14.033 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.033 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.033 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:14.033 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384246+0000", 2024-09-13T06:43:14.033 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.2449999999999998e-06 2024-09-13T06:43:14.033 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.034 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.034 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:14.034 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384268+0000", 2024-09-13T06:43:14.034 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1518e-05 2024-09-13T06:43:14.034 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.034 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.034 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:14.034 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384282+0000", 2024-09-13T06:43:14.034 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4501999999999999e-05 2024-09-13T06:43:14.034 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.034 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.034 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:14.034 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384356+0000", 2024-09-13T06:43:14.034 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4265999999999997e-05 2024-09-13T06:43:14.035 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.035 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.035 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:43:14.035 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384370+0000", 2024-09-13T06:43:14.035 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3942e-05 2024-09-13T06:43:14.035 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.035 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.035 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:14.035 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.379199+0000", 2024-09-13T06:43:14.035 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.99482866599999997 2024-09-13T06:43:14.035 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.035 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.035 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:14.036 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.379347+0000", 2024-09-13T06:43:14.036 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00014749199999999999 2024-09-13T06:43:14.036 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.036 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.036 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:14.036 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.379654+0000", 2024-09-13T06:43:14.036 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00030752999999999998 2024-09-13T06:43:14.036 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:14.036 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:14.036 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:14.036 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.036 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.036 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:37896 3.9 3:951cb95b:::rbd_data.1121d8143c6e.0000000000000002:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e56)", 2024-09-13T06:43:14.036 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:06.384412+0000", 2024-09-13T06:43:14.037 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 187.612407813, 2024-09-13T06:43:14.037 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.99777835999999998, 2024-09-13T06:43:14.037 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:14.037 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:14.037 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:14.037 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:14.037 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:14.037 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 37896 2024-09-13T06:43:14.037 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.037 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:14.037 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.037 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:14.037 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384412+0000", 2024-09-13T06:43:14.038 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:14.038 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.038 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.038 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:14.038 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384412+0000", 2024-09-13T06:43:14.038 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:14.038 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.038 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.038 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:14.038 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384410+0000", 2024-09-13T06:43:14.038 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.999999 2024-09-13T06:43:14.038 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.038 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.038 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:14.038 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384418+0000", 2024-09-13T06:43:14.039 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.486e-06 2024-09-13T06:43:14.039 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.039 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.039 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:14.039 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384436+0000", 2024-09-13T06:43:14.039 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7668000000000001e-05 2024-09-13T06:43:14.039 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.039 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.039 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:14.039 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384449+0000", 2024-09-13T06:43:14.039 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3395e-05 2024-09-13T06:43:14.039 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.039 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.040 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:14.040 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384605+0000", 2024-09-13T06:43:14.040 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00015563099999999999 2024-09-13T06:43:14.040 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.040 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.040 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:43:14.040 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384635+0000", 2024-09-13T06:43:14.040 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.0383999999999999e-05 2024-09-13T06:43:14.040 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.040 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.040 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:14.040 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.379730+0000", 2024-09-13T06:43:14.040 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.99509493999999998 2024-09-13T06:43:14.040 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.041 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.041 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:14.041 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.379964+0000", 2024-09-13T06:43:14.041 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00023353499999999999 2024-09-13T06:43:14.041 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.041 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.041 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:14.041 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.382190+0000", 2024-09-13T06:43:14.041 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0022265039999999998 2024-09-13T06:43:14.041 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:14.041 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:14.041 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:14.041 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.041 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.042 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43223 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 393216~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:43:14.042 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558267+0000", 2024-09-13T06:43:14.042 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 172.43855250199999, 2024-09-13T06:43:14.042 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.062813151999999997, 2024-09-13T06:43:14.042 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:14.042 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:14.042 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:14.042 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:14.042 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:14.042 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43223 2024-09-13T06:43:14.042 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.042 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:14.042 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.043 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:14.043 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558267+0000", 2024-09-13T06:43:14.043 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:14.043 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.043 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.043 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:14.043 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558267+0000", 2024-09-13T06:43:14.043 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:14.043 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.043 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.043 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:14.043 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558266+0000", 2024-09-13T06:43:14.043 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:14.044 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.044 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.044 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:14.044 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558270+0000", 2024-09-13T06:43:14.044 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.2389999999999998e-06 2024-09-13T06:43:14.044 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.044 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.044 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:14.044 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558277+0000", 2024-09-13T06:43:14.044 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5680000000000002e-06 2024-09-13T06:43:14.044 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.044 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.045 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:14.045 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558282+0000", 2024-09-13T06:43:14.045 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7060000000000003e-06 2024-09-13T06:43:14.045 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.045 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.045 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:14.045 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.620731+0000", 2024-09-13T06:43:14.045 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.062448661000000003 2024-09-13T06:43:14.045 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.045 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.045 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:14.045 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.620806+0000", 2024-09-13T06:43:14.045 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5862e-05 2024-09-13T06:43:14.046 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.046 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.046 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:14.046 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.621080+0000", 2024-09-13T06:43:14.046 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00027368599999999998 2024-09-13T06:43:14.046 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:14.046 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:14.046 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:14.046 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.046 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.046 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43224 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 407552~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:43:14.046 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558286+0000", 2024-09-13T06:43:14.047 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 172.438533138, 2024-09-13T06:43:14.047 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.063179052999999999, 2024-09-13T06:43:14.047 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:14.047 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:14.047 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:14.047 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:14.047 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:14.047 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43224 2024-09-13T06:43:14.047 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.047 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:14.047 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.047 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:14.047 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558286+0000", 2024-09-13T06:43:14.048 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:14.048 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.048 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.048 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:14.048 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558286+0000", 2024-09-13T06:43:14.048 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:14.048 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.048 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.048 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:14.048 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558286+0000", 2024-09-13T06:43:14.048 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:14.048 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.048 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.048 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:14.049 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558288+0000", 2024-09-13T06:43:14.049 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.227e-06 2024-09-13T06:43:14.049 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.049 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.049 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:14.049 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558292+0000", 2024-09-13T06:43:14.049 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.6289999999999999e-06 2024-09-13T06:43:14.049 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.049 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.049 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:14.049 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558294+0000", 2024-09-13T06:43:14.049 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5409999999999999e-06 2024-09-13T06:43:14.049 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.050 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.050 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:14.050 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.621110+0000", 2024-09-13T06:43:14.050 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.062815776000000004 2024-09-13T06:43:14.050 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.050 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.050 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:14.050 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.621186+0000", 2024-09-13T06:43:14.050 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5570999999999999e-05 2024-09-13T06:43:14.050 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.050 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.050 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:14.050 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.621465+0000", 2024-09-13T06:43:14.051 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00027988200000000001 2024-09-13T06:43:14.051 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:14.051 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:14.051 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:14.051 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.051 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.051 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43225 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 421888~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:43:14.051 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558296+0000", 2024-09-13T06:43:14.051 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 172.43852317100001, 2024-09-13T06:43:14.051 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.063551110999999993, 2024-09-13T06:43:14.051 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:14.051 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:14.051 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:14.051 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:14.052 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:14.052 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43225 2024-09-13T06:43:14.052 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.052 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:14.052 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.052 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:14.052 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558296+0000", 2024-09-13T06:43:14.052 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:14.052 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.052 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.052 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:14.052 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558296+0000", 2024-09-13T06:43:14.053 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:14.053 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.053 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.053 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:14.053 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558296+0000", 2024-09-13T06:43:14.053 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:43:14.053 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.053 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.053 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:14.053 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558305+0000", 2024-09-13T06:43:14.053 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.5290000000000008e-06 2024-09-13T06:43:14.053 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.053 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.053 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:14.054 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558308+0000", 2024-09-13T06:43:14.054 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.5619999999999999e-06 2024-09-13T06:43:14.054 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.054 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.054 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:14.054 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558311+0000", 2024-09-13T06:43:14.054 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.43e-06 2024-09-13T06:43:14.054 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.054 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.054 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:14.054 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.621495+0000", 2024-09-13T06:43:14.054 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.063184289000000005 2024-09-13T06:43:14.054 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.054 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.054 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:14.055 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.621569+0000", 2024-09-13T06:43:14.055 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4250000000000002e-05 2024-09-13T06:43:14.055 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.055 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.055 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:14.055 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.621847+0000", 2024-09-13T06:43:14.055 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00027826400000000002 2024-09-13T06:43:14.055 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:14.055 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:14.055 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:14.055 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.055 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.055 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43226 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 436224~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:43:14.055 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558313+0000", 2024-09-13T06:43:14.055 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 172.43850653499999, 2024-09-13T06:43:14.056 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.063914420999999999, 2024-09-13T06:43:14.056 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:14.056 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:14.056 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:14.056 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:14.056 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:14.056 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43226 2024-09-13T06:43:14.056 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.056 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:14.056 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.056 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:14.056 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558313+0000", 2024-09-13T06:43:14.057 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:14.057 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.057 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.057 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:14.057 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558313+0000", 2024-09-13T06:43:14.057 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:14.057 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.057 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.057 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:14.057 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558313+0000", 2024-09-13T06:43:14.057 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:14.057 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.058 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.058 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:14.058 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558314+0000", 2024-09-13T06:43:14.058 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3740000000000001e-06 2024-09-13T06:43:14.058 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.058 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.058 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:14.058 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558317+0000", 2024-09-13T06:43:14.058 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9730000000000002e-06 2024-09-13T06:43:14.058 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.058 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.058 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:14.058 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558319+0000", 2024-09-13T06:43:14.058 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4059999999999999e-06 2024-09-13T06:43:14.059 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.059 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.059 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:14.059 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.621877+0000", 2024-09-13T06:43:14.059 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.063557408999999995 2024-09-13T06:43:14.059 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.059 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.059 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:14.059 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.621951+0000", 2024-09-13T06:43:14.059 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4487999999999996e-05 2024-09-13T06:43:14.059 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.059 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.059 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:14.060 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.622227+0000", 2024-09-13T06:43:14.060 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000276011 2024-09-13T06:43:14.060 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:14.060 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:14.060 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:14.060 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.060 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.060 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43227 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 450560~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:43:14.060 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558322+0000", 2024-09-13T06:43:14.060 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 172.43849795400001, 2024-09-13T06:43:14.060 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.064285348000000006, 2024-09-13T06:43:14.060 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:14.060 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:14.061 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:14.061 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:14.061 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:14.061 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43227 2024-09-13T06:43:14.061 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.061 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:14.061 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.061 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:14.061 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558322+0000", 2024-09-13T06:43:14.061 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:14.061 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.061 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.062 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:14.062 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558322+0000", 2024-09-13T06:43:14.062 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:14.062 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.062 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.062 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:14.062 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558321+0000", 2024-09-13T06:43:14.062 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:43:14.062 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.062 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.062 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:14.062 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558323+0000", 2024-09-13T06:43:14.062 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.576e-06 2024-09-13T06:43:14.063 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.063 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.063 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:14.063 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558328+0000", 2024-09-13T06:43:14.063 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0719999999999999e-06 2024-09-13T06:43:14.063 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.063 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.063 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:14.063 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558332+0000", 2024-09-13T06:43:14.063 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.8130000000000002e-06 2024-09-13T06:43:14.063 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.063 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.064 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:14.064 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.622255+0000", 2024-09-13T06:43:14.064 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.063923195000000002 2024-09-13T06:43:14.064 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.064 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.064 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:14.064 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.622330+0000", 2024-09-13T06:43:14.064 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5383000000000007e-05 2024-09-13T06:43:14.064 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.064 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.064 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:14.064 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.622607+0000", 2024-09-13T06:43:14.064 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00027651999999999999 2024-09-13T06:43:14.065 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:14.065 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:14.065 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:14.065 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.065 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.065 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43228 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 464896~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:43:14.065 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558335+0000", 2024-09-13T06:43:14.065 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 172.438484045, 2024-09-13T06:43:14.065 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.064652253000000007, 2024-09-13T06:43:14.065 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:14.065 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:14.065 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:14.065 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:14.066 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:14.066 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43228 2024-09-13T06:43:14.066 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.066 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:14.066 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.066 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:14.066 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558335+0000", 2024-09-13T06:43:14.066 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:14.066 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.066 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.066 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:14.066 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558335+0000", 2024-09-13T06:43:14.066 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:14.067 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.067 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.067 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:14.067 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558335+0000", 2024-09-13T06:43:14.067 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:14.067 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.067 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.067 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:14.067 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558337+0000", 2024-09-13T06:43:14.067 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1380000000000001e-06 2024-09-13T06:43:14.067 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.067 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.067 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:14.068 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558343+0000", 2024-09-13T06:43:14.068 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.5140000000000001e-06 2024-09-13T06:43:14.068 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.068 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.068 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:14.068 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558348+0000", 2024-09-13T06:43:14.068 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9640000000000002e-06 2024-09-13T06:43:14.068 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.068 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.068 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:14.068 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.622636+0000", 2024-09-13T06:43:14.068 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.064288260999999999 2024-09-13T06:43:14.068 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.068 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.069 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:14.069 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.622715+0000", 2024-09-13T06:43:14.069 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.9351000000000006e-05 2024-09-13T06:43:14.069 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.069 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.069 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:14.069 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.622988+0000", 2024-09-13T06:43:14.069 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00027242599999999998 2024-09-13T06:43:14.069 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:14.069 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:14.069 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:14.069 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.069 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.070 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43229 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 479232~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:43:14.070 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558352+0000", 2024-09-13T06:43:14.070 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 172.43846762999999, 2024-09-13T06:43:14.070 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.065018024999999993, 2024-09-13T06:43:14.070 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:14.070 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:14.070 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:14.070 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:14.070 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:14.070 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43229 2024-09-13T06:43:14.070 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.070 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:14.071 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.071 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:14.071 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558352+0000", 2024-09-13T06:43:14.071 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:14.071 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.071 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.071 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:14.071 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558352+0000", 2024-09-13T06:43:14.071 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:14.071 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.071 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.071 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:14.071 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558352+0000", 2024-09-13T06:43:14.072 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:14.072 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.072 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.072 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:14.072 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558354+0000", 2024-09-13T06:43:14.072 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4930000000000001e-06 2024-09-13T06:43:14.072 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.072 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.072 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:14.072 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558360+0000", 2024-09-13T06:43:14.072 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.263e-06 2024-09-13T06:43:14.072 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.072 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.073 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:14.073 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558369+0000", 2024-09-13T06:43:14.073 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.0829999999999993e-06 2024-09-13T06:43:14.073 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.073 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.073 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:14.073 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.623017+0000", 2024-09-13T06:43:14.073 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.064647799000000006 2024-09-13T06:43:14.073 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.073 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.073 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:14.073 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.623090+0000", 2024-09-13T06:43:14.073 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3071000000000006e-05 2024-09-13T06:43:14.074 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.074 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.074 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:14.074 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.623370+0000", 2024-09-13T06:43:14.074 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000279661 2024-09-13T06:43:14.074 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:14.074 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:14.074 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:14.074 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.074 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.074 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43230 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 493568~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:43:14.074 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558374+0000", 2024-09-13T06:43:14.074 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 172.43844533699999, 2024-09-13T06:43:14.075 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.065410435000000003, 2024-09-13T06:43:14.075 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:14.075 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:14.075 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:14.075 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:14.075 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:14.075 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43230 2024-09-13T06:43:14.075 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.075 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:14.075 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.075 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:14.075 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558374+0000", 2024-09-13T06:43:14.075 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:14.076 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.076 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.076 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:14.076 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558374+0000", 2024-09-13T06:43:14.076 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:14.076 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.076 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.076 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:14.076 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558374+0000", 2024-09-13T06:43:14.076 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:14.076 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.076 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.076 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:14.077 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558376+0000", 2024-09-13T06:43:14.077 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4430000000000002e-06 2024-09-13T06:43:14.077 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.077 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.077 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:14.077 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558382+0000", 2024-09-13T06:43:14.077 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3029999999999996e-06 2024-09-13T06:43:14.077 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.077 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.077 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:14.077 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558387+0000", 2024-09-13T06:43:14.077 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.1699999999999999e-06 2024-09-13T06:43:14.077 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.078 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.078 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:14.078 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.623400+0000", 2024-09-13T06:43:14.078 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.065013244999999997 2024-09-13T06:43:14.078 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.078 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.078 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:14.078 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.623474+0000", 2024-09-13T06:43:14.078 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3889999999999999e-05 2024-09-13T06:43:14.078 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.078 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.078 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:14.078 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.623785+0000", 2024-09-13T06:43:14.079 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00031080099999999998 2024-09-13T06:43:14.079 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:14.079 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:14.079 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:14.079 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.079 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.079 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43231 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 507904~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:43:14.079 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558391+0000", 2024-09-13T06:43:14.079 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 172.438428652, 2024-09-13T06:43:14.079 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.065788597000000004, 2024-09-13T06:43:14.079 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:14.079 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:14.079 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:14.079 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:14.080 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:14.080 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43231 2024-09-13T06:43:14.080 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.080 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:14.080 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.080 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:14.080 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558391+0000", 2024-09-13T06:43:14.080 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:14.080 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.080 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.080 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:14.080 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558391+0000", 2024-09-13T06:43:14.081 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:14.081 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.081 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.081 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:14.081 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558390+0000", 2024-09-13T06:43:14.081 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:14.081 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.081 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.081 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:14.081 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558393+0000", 2024-09-13T06:43:14.081 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2570000000000002e-06 2024-09-13T06:43:14.081 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.081 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.082 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:14.082 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558399+0000", 2024-09-13T06:43:14.082 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0419999999999999e-06 2024-09-13T06:43:14.082 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.082 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.082 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:14.082 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558403+0000", 2024-09-13T06:43:14.082 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6249999999999998e-06 2024-09-13T06:43:14.082 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.082 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.082 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:14.082 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.623811+0000", 2024-09-13T06:43:14.082 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.065407549999999995 2024-09-13T06:43:14.082 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.083 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.083 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:14.083 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.623877+0000", 2024-09-13T06:43:14.083 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.5902999999999996e-05 2024-09-13T06:43:14.083 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.083 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.083 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:14.083 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.624179+0000", 2024-09-13T06:43:14.083 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00030259999999999998 2024-09-13T06:43:14.083 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:14.083 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:14.083 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:14.084 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.084 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.084 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43232 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 522240~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:43:14.084 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558422+0000", 2024-09-13T06:43:14.084 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 172.43839787499999, 2024-09-13T06:43:14.084 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.066176061999999994, 2024-09-13T06:43:14.084 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:14.084 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:14.084 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:14.084 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:14.084 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:14.084 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43232 2024-09-13T06:43:14.084 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.085 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:14.085 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.085 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:14.085 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558422+0000", 2024-09-13T06:43:14.085 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:14.085 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.085 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.085 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:14.085 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558422+0000", 2024-09-13T06:43:14.085 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:14.085 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.085 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.085 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:14.086 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558421+0000", 2024-09-13T06:43:14.086 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:14.086 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.086 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.086 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:14.086 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558428+0000", 2024-09-13T06:43:14.086 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.1690000000000003e-06 2024-09-13T06:43:14.086 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.086 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.086 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:14.086 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558434+0000", 2024-09-13T06:43:14.086 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9309999999999996e-06 2024-09-13T06:43:14.086 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.087 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.087 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:14.087 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558447+0000", 2024-09-13T06:43:14.087 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.271e-05 2024-09-13T06:43:14.087 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.087 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.087 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:14.087 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.624209+0000", 2024-09-13T06:43:14.087 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.065762102000000003 2024-09-13T06:43:14.087 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.087 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.087 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:14.087 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.624282+0000", 2024-09-13T06:43:14.087 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.2889e-05 2024-09-13T06:43:14.088 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.088 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.088 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:14.088 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.624598+0000", 2024-09-13T06:43:14.088 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00031591399999999998 2024-09-13T06:43:14.088 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:14.088 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:14.088 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:14.088 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.089 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.089 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43486 3.f 3:f7da9c8f:::rbd_data.1121f5f2e1c0.000000000000000b:1f [read 260096~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:43:14.089 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.569088+0000", 2024-09-13T06:43:14.089 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 172.42773115200001, 2024-09-13T06:43:14.089 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.062579223000000003, 2024-09-13T06:43:14.089 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:14.089 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:14.089 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:14.089 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:14.089 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:14.089 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43486 2024-09-13T06:43:14.089 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.090 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:14.090 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.090 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:14.090 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.569088+0000", 2024-09-13T06:43:14.090 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:14.090 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.090 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.090 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:14.090 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.569088+0000", 2024-09-13T06:43:14.090 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:14.090 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.090 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.090 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:14.091 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.569088+0000", 2024-09-13T06:43:14.091 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:14.091 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.091 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.091 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:14.091 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.569091+0000", 2024-09-13T06:43:14.091 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9629999999999998e-06 2024-09-13T06:43:14.091 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.091 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.091 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:14.091 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.569097+0000", 2024-09-13T06:43:14.091 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.4160000000000001e-06 2024-09-13T06:43:14.092 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.092 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.092 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:14.092 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.569102+0000", 2024-09-13T06:43:14.092 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6659999999999999e-06 2024-09-13T06:43:14.092 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.092 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.092 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:14.092 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.631346+0000", 2024-09-13T06:43:14.092 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.062243896 2024-09-13T06:43:14.092 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.092 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.092 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:14.093 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.631413+0000", 2024-09-13T06:43:14.093 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.7638000000000005e-05 2024-09-13T06:43:14.093 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.093 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.093 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:14.093 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.631668+0000", 2024-09-13T06:43:14.093 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0002541 2024-09-13T06:43:14.093 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:14.093 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:14.093 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:14.093 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.093 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.093 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:170125 3.9 3:94e4bf8d:::rbd_object_map.1121fa0cc8a3.000000000000006d:head [writefull 0~37] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e190)", 2024-09-13T06:43:14.094 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:42:30.601501+0000", 2024-09-13T06:43:14.094 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 43.395318940999999, 2024-09-13T06:43:14.094 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.80498820000000004, 2024-09-13T06:43:14.094 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:14.094 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:43:14.094 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:14.094 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:14.094 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:14.094 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 170125 2024-09-13T06:43:14.094 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.094 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:14.094 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.094 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:14.095 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:30.601501+0000", 2024-09-13T06:43:14.095 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:14.095 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.095 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.095 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:14.095 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:30.601501+0000", 2024-09-13T06:43:14.095 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:14.095 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.095 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.095 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:14.095 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:30.601499+0000", 2024-09-13T06:43:14.095 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999986 2024-09-13T06:43:14.095 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.095 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.096 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:14.096 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:30.601506+0000", 2024-09-13T06:43:14.096 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.9940000000000003e-06 2024-09-13T06:43:14.096 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.096 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.096 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:14.096 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:30.601519+0000", 2024-09-13T06:43:14.096 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2875e-05 2024-09-13T06:43:14.096 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.096 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.096 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:14.096 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:30.601525+0000", 2024-09-13T06:43:14.096 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8549999999999998e-06 2024-09-13T06:43:14.097 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.097 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.097 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:14.097 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:30.601560+0000", 2024-09-13T06:43:14.097 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.5271000000000002e-05 2024-09-13T06:43:14.097 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.097 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.097 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:43:14.097 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:30.601566+0000", 2024-09-13T06:43:14.097 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3090000000000001e-06 2024-09-13T06:43:14.097 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.097 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.097 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:14.098 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:31.403017+0000", 2024-09-13T06:43:14.098 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.80145064200000005 2024-09-13T06:43:14.098 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.098 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.098 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:14.098 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:31.403252+0000", 2024-09-13T06:43:14.098 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000234718 2024-09-13T06:43:14.098 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.098 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.098 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 7", 2024-09-13T06:43:14.098 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:31.403521+0000", 2024-09-13T06:43:14.098 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00026917 2024-09-13T06:43:14.098 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.098 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.099 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-09-13T06:43:14.099 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:31.404918+0000", 2024-09-13T06:43:14.099 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.001397017 2024-09-13T06:43:14.099 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.099 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.099 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:43:14.099 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:31.406176+0000", 2024-09-13T06:43:14.099 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.001257998 2024-09-13T06:43:14.099 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.099 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.099 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:43:14.099 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:31.406334+0000", 2024-09-13T06:43:14.099 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00015819099999999999 2024-09-13T06:43:14.100 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.100 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.100 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:14.100 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:31.406489+0000", 2024-09-13T06:43:14.100 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00015476699999999999 2024-09-13T06:43:14.100 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:14.100 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:14.100 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:14.100 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:14.100 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:14.100 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:43:14.102 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-13T06:43:14.102 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:43:14.104+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:43:14.203 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-13T06:43:14.201+0000 7fa8bb18e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 36790) UID: 0 2024-09-13T06:43:14.272 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:43:14.272 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-13T06:43:14.273 INFO:teuthology.orchestra.run.smithi081.stdout: "num_ops": 0 2024-09-13T06:43:14.273 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:43:14.286 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-13T06:43:14.304 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:43:14.305+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:43:14.405 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:43:14.405 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-13T06:43:14.405 INFO:teuthology.orchestra.run.smithi081.stdout: "complaint_time": 30, 2024-09-13T06:43:14.405 INFO:teuthology.orchestra.run.smithi081.stdout: "num_blocked_ops": 0 2024-09-13T06:43:14.405 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:43:14.406 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:43:14.404+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:43:14.419 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-13T06:43:14.453 INFO:teuthology.orchestra.run.smithi081.stderr:noscrub is set 2024-09-13T06:43:14.522 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:43:14.524+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:43:14.588 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:43:14.588 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 20, 2024-09-13T06:43:14.588 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 600, 2024-09-13T06:43:14.588 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [ 2024-09-13T06:43:14.588 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.589 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:2226 3.15 3:af026987:::rbd_data.112173e2f1b7.0000000000000017:head [sparse-read 0~4194304] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-13T06:43:14.589 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:37.606562+0000", 2024-09-13T06:43:14.589 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 216.97888544899999, 2024-09-13T06:43:14.589 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.83322091700000001, 2024-09-13T06:43:14.589 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:14.589 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:43:14.589 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:14.589 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:14.589 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:14.589 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 2226 2024-09-13T06:43:14.589 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.589 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:14.589 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.590 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:14.590 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606562+0000", 2024-09-13T06:43:14.590 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:14.590 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.590 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.590 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:14.590 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606562+0000", 2024-09-13T06:43:14.590 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:14.590 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.590 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.590 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:14.590 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606561+0000", 2024-09-13T06:43:14.590 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:14.591 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.591 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.591 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:14.591 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606565+0000", 2024-09-13T06:43:14.591 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.4379999999999999e-06 2024-09-13T06:43:14.591 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.591 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.591 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:14.591 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606569+0000", 2024-09-13T06:43:14.591 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.425e-06 2024-09-13T06:43:14.591 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.591 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.592 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:14.592 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606572+0000", 2024-09-13T06:43:14.592 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.05e-06 2024-09-13T06:43:14.592 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.592 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.592 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:14.592 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606621+0000", 2024-09-13T06:43:14.592 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.8723000000000001e-05 2024-09-13T06:43:14.592 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.592 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.592 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:43:14.592 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606630+0000", 2024-09-13T06:43:14.592 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.8040000000000007e-06 2024-09-13T06:43:14.593 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.593 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.593 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:14.593 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.439648+0000", 2024-09-13T06:43:14.593 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.83301824800000002 2024-09-13T06:43:14.593 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.593 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.593 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:14.593 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.439782+0000", 2024-09-13T06:43:14.593 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00013466699999999999 2024-09-13T06:43:14.593 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:14.593 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:14.594 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:14.594 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.594 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.594 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25661 3.8 3:1180686c:::rbd_data.1121f2c5ee81.0000000000000009:13 [read 397312~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:43:14.594 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.436956+0000", 2024-09-13T06:43:14.594 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 198.148490915, 2024-09-13T06:43:14.594 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089036758999999993, 2024-09-13T06:43:14.594 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:14.594 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:14.594 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:14.594 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:14.594 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:14.594 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25661 2024-09-13T06:43:14.594 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.595 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:14.595 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.595 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:14.595 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436956+0000", 2024-09-13T06:43:14.595 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:14.595 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.595 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.595 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:14.595 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436956+0000", 2024-09-13T06:43:14.595 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:14.595 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.595 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.595 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:14.596 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436956+0000", 2024-09-13T06:43:14.596 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:14.596 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.596 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.596 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:14.596 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436958+0000", 2024-09-13T06:43:14.596 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1770000000000001e-06 2024-09-13T06:43:14.596 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.596 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.596 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:14.596 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436963+0000", 2024-09-13T06:43:14.596 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.6489999999999996e-06 2024-09-13T06:43:14.596 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.596 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.597 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:14.597 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436975+0000", 2024-09-13T06:43:14.597 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1783999999999999e-05 2024-09-13T06:43:14.597 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.597 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.597 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:14.597 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.525671+0000", 2024-09-13T06:43:14.597 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.088696292999999995 2024-09-13T06:43:14.597 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.597 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.597 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:14.597 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.525749+0000", 2024-09-13T06:43:14.597 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.7589000000000005e-05 2024-09-13T06:43:14.597 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.598 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.598 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:14.598 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.525993+0000", 2024-09-13T06:43:14.598 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00024381000000000001 2024-09-13T06:43:14.598 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:14.598 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:14.598 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:14.598 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.598 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.598 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25662 3.8 3:1180686c:::rbd_data.1121f2c5ee81.0000000000000009:13 [read 421888~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:43:14.598 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.436980+0000", 2024-09-13T06:43:14.598 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 198.148466603, 2024-09-13T06:43:14.598 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089367577000000004, 2024-09-13T06:43:14.598 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:14.599 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:14.599 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:14.599 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:14.599 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:14.599 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25662 2024-09-13T06:43:14.599 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.599 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:14.599 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.599 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:14.599 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436980+0000", 2024-09-13T06:43:14.599 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:14.599 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.599 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.599 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:14.600 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436980+0000", 2024-09-13T06:43:14.600 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:14.600 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.600 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.600 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:14.600 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436980+0000", 2024-09-13T06:43:14.600 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:14.600 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.600 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.600 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:14.600 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436982+0000", 2024-09-13T06:43:14.600 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3989999999999998e-06 2024-09-13T06:43:14.600 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.601 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.601 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:14.601 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436988+0000", 2024-09-13T06:43:14.601 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0039999999999996e-06 2024-09-13T06:43:14.601 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.601 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.601 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:14.601 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436993+0000", 2024-09-13T06:43:14.601 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6090000000000003e-06 2024-09-13T06:43:14.601 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.601 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.601 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:14.601 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.526035+0000", 2024-09-13T06:43:14.602 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089042248000000004 2024-09-13T06:43:14.602 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.602 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.602 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:14.602 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.526111+0000", 2024-09-13T06:43:14.602 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5643999999999996e-05 2024-09-13T06:43:14.602 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.602 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.602 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:14.602 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.526348+0000", 2024-09-13T06:43:14.603 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00023705800000000001 2024-09-13T06:43:14.603 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:14.603 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:14.603 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:14.603 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.603 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.603 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25663 3.8 3:1180686c:::rbd_data.1121f2c5ee81.0000000000000009:13 [read 466944~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:43:14.603 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.436998+0000", 2024-09-13T06:43:14.603 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 198.14844895600001, 2024-09-13T06:43:14.603 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089730867000000006, 2024-09-13T06:43:14.603 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:14.603 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:14.603 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:14.604 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:14.604 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:14.604 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25663 2024-09-13T06:43:14.604 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.604 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:14.604 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.604 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:14.604 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436998+0000", 2024-09-13T06:43:14.604 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:14.604 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.604 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.604 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:14.604 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436998+0000", 2024-09-13T06:43:14.604 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:14.605 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.605 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.605 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:14.605 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436998+0000", 2024-09-13T06:43:14.605 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:14.605 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.605 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.605 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:14.605 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437000+0000", 2024-09-13T06:43:14.605 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0940000000000002e-06 2024-09-13T06:43:14.605 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.605 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.605 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:14.605 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437005+0000", 2024-09-13T06:43:14.605 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.604e-06 2024-09-13T06:43:14.606 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.606 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.606 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:14.606 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437032+0000", 2024-09-13T06:43:14.606 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6407e-05 2024-09-13T06:43:14.606 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.606 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.606 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:14.606 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.526363+0000", 2024-09-13T06:43:14.606 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089331456000000004 2024-09-13T06:43:14.606 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.606 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.606 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:14.606 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.526404+0000", 2024-09-13T06:43:14.607 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.0887999999999999e-05 2024-09-13T06:43:14.607 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.607 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.607 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:14.607 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.526729+0000", 2024-09-13T06:43:14.607 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00032486 2024-09-13T06:43:14.607 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:14.607 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:14.607 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:14.607 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.607 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.607 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25664 3.8 3:1180686c:::rbd_data.1121f2c5ee81.0000000000000009:13 [read 491520~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:43:14.607 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.437040+0000", 2024-09-13T06:43:14.608 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 198.14840704100001, 2024-09-13T06:43:14.608 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.090016650000000004, 2024-09-13T06:43:14.608 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:14.608 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:14.608 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:14.608 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:14.608 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:14.608 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25664 2024-09-13T06:43:14.608 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.608 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:14.608 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.608 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:14.608 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437040+0000", 2024-09-13T06:43:14.609 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:14.609 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.609 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.609 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:14.609 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437040+0000", 2024-09-13T06:43:14.609 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:14.609 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.609 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.609 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:14.609 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437039+0000", 2024-09-13T06:43:14.609 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:14.609 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.609 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.609 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:14.609 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437047+0000", 2024-09-13T06:43:14.610 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4839999999999998e-06 2024-09-13T06:43:14.610 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.610 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.610 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:14.610 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437054+0000", 2024-09-13T06:43:14.610 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.8299999999999998e-06 2024-09-13T06:43:14.610 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.610 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.610 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:14.610 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437060+0000", 2024-09-13T06:43:14.610 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.1510000000000001e-06 2024-09-13T06:43:14.610 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.610 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.610 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:14.610 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.526772+0000", 2024-09-13T06:43:14.611 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089711737999999999 2024-09-13T06:43:14.611 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.611 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.611 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:14.611 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.526848+0000", 2024-09-13T06:43:14.611 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5870000000000004e-05 2024-09-13T06:43:14.611 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.611 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.611 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:14.611 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.527057+0000", 2024-09-13T06:43:14.611 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000209106 2024-09-13T06:43:14.611 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:14.611 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:14.611 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:14.612 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.612 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.612 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25740 3.18 3:1c662b96:::rbd_data.1121f2c5ee81.0000000000000010:13 [read 200704~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:43:14.612 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443352+0000", 2024-09-13T06:43:14.612 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 198.14209536600001, 2024-09-13T06:43:14.612 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089068222000000002, 2024-09-13T06:43:14.612 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:14.612 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:14.612 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:14.612 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:14.612 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:14.612 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25740 2024-09-13T06:43:14.612 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.612 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:14.613 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.613 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:14.613 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443352+0000", 2024-09-13T06:43:14.613 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:14.613 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.613 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.613 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:14.613 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443352+0000", 2024-09-13T06:43:14.613 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:14.613 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.613 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.613 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:14.613 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443351+0000", 2024-09-13T06:43:14.614 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:14.614 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.614 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.614 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:14.614 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443354+0000", 2024-09-13T06:43:14.614 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.841e-06 2024-09-13T06:43:14.614 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.614 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.614 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:14.614 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443361+0000", 2024-09-13T06:43:14.614 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.0010000000000004e-06 2024-09-13T06:43:14.614 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.614 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.614 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:14.615 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443366+0000", 2024-09-13T06:43:14.615 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7119999999999999e-06 2024-09-13T06:43:14.615 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.615 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.615 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:14.615 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532117+0000", 2024-09-13T06:43:14.615 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.088751327000000005 2024-09-13T06:43:14.615 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.615 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.615 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:14.615 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532193+0000", 2024-09-13T06:43:14.615 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5839000000000004e-05 2024-09-13T06:43:14.615 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.615 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.615 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:14.616 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532420+0000", 2024-09-13T06:43:14.616 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00022691000000000001 2024-09-13T06:43:14.616 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:14.616 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:14.616 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:14.616 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.616 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.616 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25741 3.18 3:1c662b96:::rbd_data.1121f2c5ee81.0000000000000010:13 [read 225280~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:43:14.616 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443378+0000", 2024-09-13T06:43:14.616 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 198.142068599, 2024-09-13T06:43:14.616 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089324107, 2024-09-13T06:43:14.616 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:14.616 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:14.616 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:14.616 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:14.617 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:14.617 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25741 2024-09-13T06:43:14.617 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.617 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:14.617 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.617 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:14.617 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443378+0000", 2024-09-13T06:43:14.617 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:14.617 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.617 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.617 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:14.617 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443378+0000", 2024-09-13T06:43:14.617 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:14.617 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.617 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.618 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:14.618 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443378+0000", 2024-09-13T06:43:14.618 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:14.618 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.618 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.618 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:14.618 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443380+0000", 2024-09-13T06:43:14.618 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3549999999999999e-06 2024-09-13T06:43:14.618 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.618 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.618 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:14.618 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443388+0000", 2024-09-13T06:43:14.618 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.7449999999999995e-06 2024-09-13T06:43:14.618 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.618 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.618 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:14.619 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443393+0000", 2024-09-13T06:43:14.619 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.4e-06 2024-09-13T06:43:14.619 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.619 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.619 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:14.619 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532454+0000", 2024-09-13T06:43:14.619 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089060941000000005 2024-09-13T06:43:14.619 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.619 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.619 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:14.619 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532512+0000", 2024-09-13T06:43:14.619 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7763000000000002e-05 2024-09-13T06:43:14.619 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.619 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.620 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:14.620 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532703+0000", 2024-09-13T06:43:14.620 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000190328 2024-09-13T06:43:14.620 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:14.620 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:14.620 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:14.620 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.620 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.620 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25742 3.18 3:1c662b96:::rbd_data.1121f2c5ee81.0000000000000010:13 [read 270336~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:43:14.620 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443398+0000", 2024-09-13T06:43:14.620 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 198.14204888699999, 2024-09-13T06:43:14.620 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089621836999999996, 2024-09-13T06:43:14.620 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:14.620 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:14.620 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:14.621 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:14.621 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:14.621 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25742 2024-09-13T06:43:14.621 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.621 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:14.621 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.621 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:14.621 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443398+0000", 2024-09-13T06:43:14.621 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:14.621 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.621 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.622 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:14.622 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443398+0000", 2024-09-13T06:43:14.622 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:14.622 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.622 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.622 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:14.622 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443398+0000", 2024-09-13T06:43:14.622 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:14.622 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.622 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.622 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:14.622 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443400+0000", 2024-09-13T06:43:14.622 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1849999999999998e-06 2024-09-13T06:43:14.623 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.623 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.623 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:14.623 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443407+0000", 2024-09-13T06:43:14.623 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3669999999999999e-06 2024-09-13T06:43:14.623 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.623 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.623 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:14.623 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443420+0000", 2024-09-13T06:43:14.623 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2645e-05 2024-09-13T06:43:14.623 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.623 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.623 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:14.624 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532742+0000", 2024-09-13T06:43:14.624 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089322200000000004 2024-09-13T06:43:14.624 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.624 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.624 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:14.624 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532818+0000", 2024-09-13T06:43:14.624 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.6019000000000005e-05 2024-09-13T06:43:14.624 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.624 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.624 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:14.624 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533020+0000", 2024-09-13T06:43:14.624 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000201721 2024-09-13T06:43:14.624 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:14.625 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:14.625 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:14.625 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.625 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.625 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25743 3.18 3:1c662b96:::rbd_data.1121f2c5ee81.0000000000000010:13 [read 294912~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:43:14.625 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443425+0000", 2024-09-13T06:43:14.625 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 198.142021879, 2024-09-13T06:43:14.625 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089864075000000002, 2024-09-13T06:43:14.625 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:14.625 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:14.625 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:14.625 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:14.625 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:14.626 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25743 2024-09-13T06:43:14.626 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.626 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:14.626 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.626 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:14.626 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443425+0000", 2024-09-13T06:43:14.626 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:14.626 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.626 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.626 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:14.626 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443425+0000", 2024-09-13T06:43:14.626 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:14.626 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.626 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.627 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:14.627 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443425+0000", 2024-09-13T06:43:14.627 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:14.627 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.627 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.627 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:14.627 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443432+0000", 2024-09-13T06:43:14.627 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3420000000000002e-06 2024-09-13T06:43:14.627 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.627 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.627 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:14.627 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443440+0000", 2024-09-13T06:43:14.627 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5689999999999999e-06 2024-09-13T06:43:14.627 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.628 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.628 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:14.628 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443445+0000", 2024-09-13T06:43:14.628 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9590000000000003e-06 2024-09-13T06:43:14.628 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.628 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.628 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:14.628 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533063+0000", 2024-09-13T06:43:14.628 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089617988999999995 2024-09-13T06:43:14.628 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.628 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.628 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:14.628 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533122+0000", 2024-09-13T06:43:14.628 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9052999999999999e-05 2024-09-13T06:43:14.629 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.629 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.629 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:14.629 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533289+0000", 2024-09-13T06:43:14.629 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00016752800000000001 2024-09-13T06:43:14.629 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:14.629 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:14.629 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:14.629 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.629 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.629 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25744 3.18 3.69d46638 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:43:14.629 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443449+0000", 2024-09-13T06:43:14.629 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 198.14199773199999, 2024-09-13T06:43:14.630 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089869148999999995, 2024-09-13T06:43:14.630 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:14.630 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:43:14.630 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:14.630 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:14.630 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:14.630 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25744 2024-09-13T06:43:14.630 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.630 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:14.630 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.630 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:14.630 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443449+0000", 2024-09-13T06:43:14.630 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:14.630 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.631 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.631 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:14.631 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443449+0000", 2024-09-13T06:43:14.631 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:14.631 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.631 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.631 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:14.631 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443449+0000", 2024-09-13T06:43:14.631 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:14.631 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.631 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.631 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:14.631 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443451+0000", 2024-09-13T06:43:14.632 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.244e-06 2024-09-13T06:43:14.632 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.632 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.632 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:14.632 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443457+0000", 2024-09-13T06:43:14.632 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.66e-06 2024-09-13T06:43:14.632 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.632 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.632 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:14.632 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443461+0000", 2024-09-13T06:43:14.632 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5449999999999997e-06 2024-09-13T06:43:14.632 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.633 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.633 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:14.633 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533311+0000", 2024-09-13T06:43:14.633 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089849729000000003 2024-09-13T06:43:14.633 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.633 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.633 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:14.633 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533318+0000", 2024-09-13T06:43:14.633 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.328e-06 2024-09-13T06:43:14.633 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:14.633 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:14.633 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:14.633 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.633 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.634 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25745 3.18 3.69d46638 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:43:14.634 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443466+0000", 2024-09-13T06:43:14.634 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 198.141980674, 2024-09-13T06:43:14.634 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089886743000000005, 2024-09-13T06:43:14.634 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:14.634 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:43:14.634 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:14.634 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:14.634 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:14.634 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25745 2024-09-13T06:43:14.634 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.634 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:14.634 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.634 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:14.635 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443466+0000", 2024-09-13T06:43:14.635 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:14.635 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.635 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.635 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:14.635 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443466+0000", 2024-09-13T06:43:14.635 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:14.635 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.635 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.635 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:14.635 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443466+0000", 2024-09-13T06:43:14.635 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:14.635 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.636 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.636 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:14.636 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443474+0000", 2024-09-13T06:43:14.636 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.1289999999999996e-06 2024-09-13T06:43:14.636 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.636 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.636 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:14.636 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443484+0000", 2024-09-13T06:43:14.636 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0654e-05 2024-09-13T06:43:14.636 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.636 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.636 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:14.636 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443490+0000", 2024-09-13T06:43:14.636 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8030000000000002e-06 2024-09-13T06:43:14.637 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.637 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.637 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:14.637 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533348+0000", 2024-09-13T06:43:14.637 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089857267000000005 2024-09-13T06:43:14.637 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.637 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.637 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:14.637 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533353+0000", 2024-09-13T06:43:14.637 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.5520000000000004e-06 2024-09-13T06:43:14.637 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:14.637 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:14.637 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:14.637 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.638 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.638 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25746 3.18 3.69d46638 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:43:14.638 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443495+0000", 2024-09-13T06:43:14.638 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 198.14195156100001, 2024-09-13T06:43:14.638 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089903725000000004, 2024-09-13T06:43:14.638 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:14.638 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:43:14.638 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:14.638 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:14.638 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:14.638 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25746 2024-09-13T06:43:14.638 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.638 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:14.638 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.639 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:14.639 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443495+0000", 2024-09-13T06:43:14.639 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:14.639 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.639 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.639 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:14.639 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443495+0000", 2024-09-13T06:43:14.639 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:14.639 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.639 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.639 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:14.639 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443495+0000", 2024-09-13T06:43:14.639 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:14.639 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.640 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.640 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:14.640 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443498+0000", 2024-09-13T06:43:14.640 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.7690000000000001e-06 2024-09-13T06:43:14.640 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.640 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.640 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:14.640 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443504+0000", 2024-09-13T06:43:14.640 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9710000000000001e-06 2024-09-13T06:43:14.640 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.640 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.640 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:14.640 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443508+0000", 2024-09-13T06:43:14.641 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4159999999999997e-06 2024-09-13T06:43:14.641 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.641 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.641 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:14.641 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533391+0000", 2024-09-13T06:43:14.641 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089882607000000003 2024-09-13T06:43:14.641 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.641 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.641 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:14.641 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533399+0000", 2024-09-13T06:43:14.641 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.4349999999999997e-06 2024-09-13T06:43:14.641 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:14.641 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:14.642 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:14.642 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.642 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.642 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25747 3.8 3.63996268 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:43:14.642 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443512+0000", 2024-09-13T06:43:14.642 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 198.14193483, 2024-09-13T06:43:14.642 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089880075000000004, 2024-09-13T06:43:14.642 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:14.642 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:43:14.642 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:14.642 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:14.642 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:14.642 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25747 2024-09-13T06:43:14.642 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.643 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:14.643 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.643 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:14.643 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443512+0000", 2024-09-13T06:43:14.643 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:14.643 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.643 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.643 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:14.643 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443512+0000", 2024-09-13T06:43:14.643 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:14.643 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.643 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.643 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:14.644 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443512+0000", 2024-09-13T06:43:14.644 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:14.644 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.644 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.644 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:14.644 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443514+0000", 2024-09-13T06:43:14.644 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0980000000000001e-06 2024-09-13T06:43:14.644 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.644 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.644 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:14.644 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443520+0000", 2024-09-13T06:43:14.644 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7069999999999997e-06 2024-09-13T06:43:14.644 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.644 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.645 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:14.645 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443524+0000", 2024-09-13T06:43:14.645 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5390000000000001e-06 2024-09-13T06:43:14.645 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.645 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.645 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:14.645 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533384+0000", 2024-09-13T06:43:14.645 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089859684999999995 2024-09-13T06:43:14.645 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.645 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.645 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:14.645 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533392+0000", 2024-09-13T06:43:14.645 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.3440000000000001e-06 2024-09-13T06:43:14.646 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:14.646 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:14.646 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:14.646 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.646 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.646 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25748 3.8 3.63996268 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:43:14.646 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443528+0000", 2024-09-13T06:43:14.646 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 198.14191870299999, 2024-09-13T06:43:14.646 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089890715999999996, 2024-09-13T06:43:14.646 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:14.646 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:43:14.646 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:14.646 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:14.647 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:14.647 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25748 2024-09-13T06:43:14.647 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.647 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:14.647 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.647 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:14.647 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443528+0000", 2024-09-13T06:43:14.647 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:14.647 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.647 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.647 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:14.647 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443528+0000", 2024-09-13T06:43:14.647 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:14.647 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.648 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.648 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:14.648 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443528+0000", 2024-09-13T06:43:14.648 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:14.648 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.648 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.648 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:14.648 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443530+0000", 2024-09-13T06:43:14.648 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0650000000000001e-06 2024-09-13T06:43:14.648 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.648 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.648 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:14.648 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443536+0000", 2024-09-13T06:43:14.649 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7259999999999999e-06 2024-09-13T06:43:14.649 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.649 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.649 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:14.649 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443540+0000", 2024-09-13T06:43:14.649 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5009999999999998e-06 2024-09-13T06:43:14.649 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.649 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.649 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:14.649 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533412+0000", 2024-09-13T06:43:14.649 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089871873000000005 2024-09-13T06:43:14.649 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.649 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.650 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:14.650 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533419+0000", 2024-09-13T06:43:14.650 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.883e-06 2024-09-13T06:43:14.650 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:14.650 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:14.650 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:14.650 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.650 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.650 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25749 3.8 3.63996268 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:43:14.650 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443545+0000", 2024-09-13T06:43:14.650 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 198.141902507, 2024-09-13T06:43:14.650 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089897988999999998, 2024-09-13T06:43:14.650 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:14.650 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:43:14.651 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:14.651 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:14.651 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:14.651 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25749 2024-09-13T06:43:14.651 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.651 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:14.651 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.651 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:14.651 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443545+0000", 2024-09-13T06:43:14.651 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:14.651 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.651 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.651 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:14.652 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443545+0000", 2024-09-13T06:43:14.652 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:14.652 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.652 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.652 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:14.652 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443544+0000", 2024-09-13T06:43:14.652 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:14.652 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.652 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.652 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:14.652 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443553+0000", 2024-09-13T06:43:14.652 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.4770000000000003e-06 2024-09-13T06:43:14.652 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.652 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.653 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:14.653 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443564+0000", 2024-09-13T06:43:14.653 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0986e-05 2024-09-13T06:43:14.653 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.653 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.653 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:14.653 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443569+0000", 2024-09-13T06:43:14.653 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2530000000000004e-06 2024-09-13T06:43:14.653 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.653 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.653 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:14.653 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533438+0000", 2024-09-13T06:43:14.653 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089868641999999999 2024-09-13T06:43:14.654 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.654 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.654 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:14.654 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533442+0000", 2024-09-13T06:43:14.654 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.989e-06 2024-09-13T06:43:14.654 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:14.654 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:14.654 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:14.654 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.654 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.654 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25750 3.8 3.63996268 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:43:14.654 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443574+0000", 2024-09-13T06:43:14.654 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 198.14187302100001, 2024-09-13T06:43:14.655 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089895143999999996, 2024-09-13T06:43:14.655 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:14.655 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:43:14.655 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:14.655 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:14.655 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:14.655 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25750 2024-09-13T06:43:14.655 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.655 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:14.655 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.655 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:14.655 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443574+0000", 2024-09-13T06:43:14.655 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:14.656 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.656 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.656 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:14.656 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443574+0000", 2024-09-13T06:43:14.656 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:14.656 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.656 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.656 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:14.656 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443574+0000", 2024-09-13T06:43:14.656 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:14.656 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.656 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.656 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:14.657 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443576+0000", 2024-09-13T06:43:14.657 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6910000000000002e-06 2024-09-13T06:43:14.657 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.657 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.657 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:14.657 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443583+0000", 2024-09-13T06:43:14.657 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.331e-06 2024-09-13T06:43:14.657 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.657 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.657 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:14.657 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443587+0000", 2024-09-13T06:43:14.657 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6129999999999997e-06 2024-09-13T06:43:14.657 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.658 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.658 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:14.658 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533464+0000", 2024-09-13T06:43:14.658 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089876605999999998 2024-09-13T06:43:14.658 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.658 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.658 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:14.658 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533469+0000", 2024-09-13T06:43:14.658 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3909999999999997e-06 2024-09-13T06:43:14.658 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:14.658 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:14.658 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:14.658 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.658 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.659 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25751 3.8 3.63996268 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:43:14.659 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443592+0000", 2024-09-13T06:43:14.659 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 198.14185532400001, 2024-09-13T06:43:14.659 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089913650999999997, 2024-09-13T06:43:14.659 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:14.659 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:43:14.659 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:14.659 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:14.659 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:14.659 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25751 2024-09-13T06:43:14.659 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.659 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:14.659 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.659 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:14.660 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443592+0000", 2024-09-13T06:43:14.660 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:14.660 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.660 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.660 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:14.660 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443592+0000", 2024-09-13T06:43:14.660 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:14.660 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.660 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.660 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:14.660 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443591+0000", 2024-09-13T06:43:14.660 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:14.660 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.661 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.661 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:14.661 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443594+0000", 2024-09-13T06:43:14.661 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3649999999999998e-06 2024-09-13T06:43:14.661 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.661 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.661 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:14.661 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443599+0000", 2024-09-13T06:43:14.661 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.699e-06 2024-09-13T06:43:14.661 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.661 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.661 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:14.661 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443611+0000", 2024-09-13T06:43:14.662 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1503e-05 2024-09-13T06:43:14.662 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.662 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.662 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:14.662 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533497+0000", 2024-09-13T06:43:14.662 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089886453000000005 2024-09-13T06:43:14.662 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.662 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.662 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:14.662 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533505+0000", 2024-09-13T06:43:14.662 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.9910000000000002e-06 2024-09-13T06:43:14.662 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:14.662 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:14.662 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:14.663 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.663 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.663 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25752 3.8 3.63996268 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:43:14.663 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443615+0000", 2024-09-13T06:43:14.663 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 198.141831543, 2024-09-13T06:43:14.663 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089905868999999999, 2024-09-13T06:43:14.663 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:14.663 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:43:14.663 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:14.663 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:14.663 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:14.663 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25752 2024-09-13T06:43:14.663 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.663 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:14.664 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.664 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:14.664 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443615+0000", 2024-09-13T06:43:14.664 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:14.664 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.664 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.664 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:14.664 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443615+0000", 2024-09-13T06:43:14.664 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:14.664 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.664 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.664 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:14.664 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443615+0000", 2024-09-13T06:43:14.665 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:14.665 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.665 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.665 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:14.665 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443617+0000", 2024-09-13T06:43:14.665 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3539999999999998e-06 2024-09-13T06:43:14.665 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.665 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.665 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:14.665 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443624+0000", 2024-09-13T06:43:14.665 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3600000000000001e-06 2024-09-13T06:43:14.665 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.665 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.665 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:14.666 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443628+0000", 2024-09-13T06:43:14.666 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.2350000000000001e-06 2024-09-13T06:43:14.666 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.666 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.666 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:14.666 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533517+0000", 2024-09-13T06:43:14.666 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089889029999999995 2024-09-13T06:43:14.666 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.666 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.666 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:14.666 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533521+0000", 2024-09-13T06:43:14.666 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.2529999999999998e-06 2024-09-13T06:43:14.666 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:14.666 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:14.666 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:14.667 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.667 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.667 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:64356 3.c 3:32785be9:::rbd_header.11218ba71f0d:head [watch reconnect cookie 140361410387072 gen 2] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e95)", 2024-09-13T06:43:14.667 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:48.473318+0000", 2024-09-13T06:43:14.667 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 146.11212914999999, 2024-09-13T06:43:14.667 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1458904379999999, 2024-09-13T06:43:14.667 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:14.667 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:14.667 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:14.667 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:14.667 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:14.667 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 64356 2024-09-13T06:43:14.667 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.667 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:14.667 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.667 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:14.668 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:48.473318+0000", 2024-09-13T06:43:14.668 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:14.668 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.668 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.668 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:14.668 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:48.473318+0000", 2024-09-13T06:43:14.668 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:14.668 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.668 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.668 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:14.668 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:48.473315+0000", 2024-09-13T06:43:14.668 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999971 2024-09-13T06:43:14.668 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.668 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.669 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:14.669 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:48.473329+0000", 2024-09-13T06:43:14.669 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.433e-05 2024-09-13T06:43:14.669 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.669 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.669 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:14.669 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:48.473363+0000", 2024-09-13T06:43:14.669 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.3592e-05 2024-09-13T06:43:14.669 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.669 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.669 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:14.669 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:48.473386+0000", 2024-09-13T06:43:14.669 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2708999999999999e-05 2024-09-13T06:43:14.669 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.669 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.670 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:14.670 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:48.473804+0000", 2024-09-13T06:43:14.670 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00041789399999999998 2024-09-13T06:43:14.670 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.670 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.670 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:43:14.670 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:48.473830+0000", 2024-09-13T06:43:14.670 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6869e-05 2024-09-13T06:43:14.670 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.670 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.670 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:14.670 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:49.614332+0000", 2024-09-13T06:43:14.670 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.140501107 2024-09-13T06:43:14.670 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.670 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.670 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for rw locks", 2024-09-13T06:43:14.671 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:49.614496+0000", 2024-09-13T06:43:14.671 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00016451200000000001 2024-09-13T06:43:14.671 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.671 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.671 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:14.671 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:49.617131+0000", 2024-09-13T06:43:14.671 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.002634843 2024-09-13T06:43:14.671 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.671 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.671 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:14.671 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:49.617204+0000", 2024-09-13T06:43:14.671 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.2991000000000006e-05 2024-09-13T06:43:14.671 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.671 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.671 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:14.672 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:49.619208+0000", 2024-09-13T06:43:14.672 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.002004381 2024-09-13T06:43:14.672 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:14.672 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:14.672 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:14.672 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.672 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.672 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:170155 3.7 3:e17728eb:::image_client.0-clone36.rbd:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e191)", 2024-09-13T06:43:14.672 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:42:31.436412+0000", 2024-09-13T06:43:14.672 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 43.149035327, 2024-09-13T06:43:14.672 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.97843703800000004, 2024-09-13T06:43:14.672 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:14.672 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:43:14.673 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:14.673 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:14.673 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:14.673 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 170155 2024-09-13T06:43:14.673 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.673 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:14.673 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.673 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:14.673 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:31.436412+0000", 2024-09-13T06:43:14.673 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:14.673 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.673 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.673 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:14.674 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:31.436412+0000", 2024-09-13T06:43:14.674 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:14.674 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.674 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.674 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:14.674 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:31.436410+0000", 2024-09-13T06:43:14.674 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999986 2024-09-13T06:43:14.674 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.674 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.674 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:14.674 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:31.436417+0000", 2024-09-13T06:43:14.674 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.6939999999999998e-06 2024-09-13T06:43:14.674 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.675 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.675 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:14.675 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:31.436430+0000", 2024-09-13T06:43:14.675 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3016999999999999e-05 2024-09-13T06:43:14.675 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.675 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.675 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:14.675 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:31.436437+0000", 2024-09-13T06:43:14.675 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.1069999999999999e-06 2024-09-13T06:43:14.675 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.675 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.675 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:14.675 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:31.436515+0000", 2024-09-13T06:43:14.676 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.7756000000000006e-05 2024-09-13T06:43:14.676 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.676 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.676 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:43:14.676 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:31.436523+0000", 2024-09-13T06:43:14.676 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.4970000000000001e-06 2024-09-13T06:43:14.676 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.676 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.676 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:14.676 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:32.414565+0000", 2024-09-13T06:43:14.676 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.97804144199999998 2024-09-13T06:43:14.676 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:14.676 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:14.677 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:14.677 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:32.414849+0000", 2024-09-13T06:43:14.677 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00028388600000000001 2024-09-13T06:43:14.677 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:14.677 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:14.677 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:14.677 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:14.677 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:14.677 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:43:14.678 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-13T06:43:14.679 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-13T06:43:14.679 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:43:14.680+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:43:14.779 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:43:14.780+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:43:14.810 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:43:14.810 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [], 2024-09-13T06:43:14.811 INFO:teuthology.orchestra.run.smithi139.stdout: "num_ops": 0 2024-09-13T06:43:14.811 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:43:14.824 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-13T06:43:14.869 INFO:teuthology.orchestra.run.smithi081.stdout:osd.0: {} 2024-09-13T06:43:14.870 INFO:teuthology.orchestra.run.smithi081.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-13T06:43:14.880 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:43:14.881+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:43:14.886 INFO:teuthology.orchestra.run.smithi081.stdout:osd.1: {} 2024-09-13T06:43:14.887 INFO:teuthology.orchestra.run.smithi081.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-13T06:43:14.902 INFO:teuthology.orchestra.run.smithi081.stdout:osd.2: {} 2024-09-13T06:43:14.902 INFO:teuthology.orchestra.run.smithi081.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-13T06:43:14.918 INFO:teuthology.orchestra.run.smithi081.stdout:osd.3: {} 2024-09-13T06:43:14.919 INFO:teuthology.orchestra.run.smithi081.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-13T06:43:14.937 INFO:teuthology.orchestra.run.smithi081.stdout:osd.4: {} 2024-09-13T06:43:14.937 INFO:teuthology.orchestra.run.smithi081.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-13T06:43:14.949 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:43:14.949 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:43:14.957 INFO:teuthology.orchestra.run.smithi081.stdout:osd.5: {} 2024-09-13T06:43:14.957 INFO:teuthology.orchestra.run.smithi081.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-13T06:43:14.957 INFO:teuthology.orchestra.run.smithi081.stderr:Error ENXIO: problem getting command descriptions from osd.6 2024-09-13T06:43:14.963 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-13T06:43:14.976 INFO:teuthology.orchestra.run.smithi081.stdout:osd.7: {} 2024-09-13T06:43:14.977 INFO:teuthology.orchestra.run.smithi081.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-13T06:43:14.980 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-13T06:43:14.980 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-13T06:43:15.008 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:43:15.009+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:43:15.082 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-13T06:43:15.081+0000 7fa8bb18e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 36790) UID: 0 2024-09-13T06:43:15.131 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:43:15.131 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:43:15.146 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-13T06:43:15.183 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:43:15.184+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:43:15.219 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 7, 5, 3, 4] out_osds: [6] dead_osds: [6] live_osds: [0, 1, 2, 3, 4, 5, 7] 2024-09-13T06:43:15.219 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-13T06:43:15.219 INFO:tasks.thrashosds.thrasher:inject_pause on osd.1 2024-09-13T06:43:15.219 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-09-13T06:43:15.219 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-09-13T06:43:15.219 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok config set filestore_inject_stall 3 2024-09-13T06:43:15.284 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:43:15.281+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:43:15.313 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:43:15.314 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:43:15.328 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-13T06:43:15.350 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:43:15.350 INFO:teuthology.orchestra.run.smithi081.stdout: "success": "" 2024-09-13T06:43:15.350 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:43:15.384 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:43:15.384+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:43:15.485 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:43:15.484+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:43:15.496 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:43:15.496 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:43:15.510 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-13T06:43:15.585 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:43:15.584+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:43:15.632 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:43:15.633 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:43:15.647 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-13T06:43:15.691 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:43:15.693+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:43:15.770 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:43:15.771 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:43:15.784 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-13T06:43:15.787 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:43:15.788+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:43:15.888 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:43:15.888+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:43:15.953 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:43:15.953 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:43:15.967 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-13T06:43:16.012 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:43:16.013+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:43:16.089 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:43:16.089 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:43:16.089 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:43:16.089+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:43:16.103 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-13T06:43:16.190 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-13T06:43:16.189+0000 7fa8bb18e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 36790) UID: 0 2024-09-13T06:43:16.233 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:43:16.233 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:43:16.247 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-13T06:43:16.291 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-13T06:43:16.289+0000 7fa8bb18e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 36790) UID: 0 2024-09-13T06:43:16.370 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:43:16.370 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:43:16.384 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-13T06:43:16.430 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:43:16.432+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:43:16.481 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-13T06:43:16.521 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:43:16.521 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:43:16.522 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:43:16.524+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:43:16.540 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-13T06:43:16.594 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:43:16.593+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:43:16.695 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:43:16.693+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:43:16.703 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:43:16.703 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:43:16.717 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-13T06:43:16.796 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:43:16.796+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:43:16.832 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:43:16.832 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:43:16.846 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-13T06:43:16.938 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:43:16.940+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:43:16.981 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-13T06:43:16.998 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-13T06:43:16.997+0000 7fa8bb18e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 36790) UID: 0 2024-09-13T06:43:17.011 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:43:17.011 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:43:17.026 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-13T06:43:17.118 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:43:17.120+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:43:17.120 INFO:teuthology.orchestra.run.smithi081.stdout:osd.0: {} 2024-09-13T06:43:17.120 INFO:teuthology.orchestra.run.smithi081.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-13T06:43:17.136 INFO:teuthology.orchestra.run.smithi081.stdout:osd.1: {} 2024-09-13T06:43:17.137 INFO:teuthology.orchestra.run.smithi081.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-13T06:43:17.153 INFO:teuthology.orchestra.run.smithi081.stdout:osd.2: {} 2024-09-13T06:43:17.153 INFO:teuthology.orchestra.run.smithi081.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-13T06:43:17.171 INFO:teuthology.orchestra.run.smithi081.stdout:osd.3: {} 2024-09-13T06:43:17.171 INFO:teuthology.orchestra.run.smithi081.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-13T06:43:17.191 INFO:teuthology.orchestra.run.smithi081.stdout:osd.4: {} 2024-09-13T06:43:17.191 INFO:teuthology.orchestra.run.smithi081.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-13T06:43:17.193 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:43:17.193 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-13T06:43:17.193 INFO:teuthology.orchestra.run.smithi081.stdout: "num_ops": 0 2024-09-13T06:43:17.193 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:43:17.199 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:43:17.200+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:43:17.207 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-13T06:43:17.211 INFO:teuthology.orchestra.run.smithi081.stdout:osd.5: {} 2024-09-13T06:43:17.212 INFO:teuthology.orchestra.run.smithi081.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-13T06:43:17.216 INFO:teuthology.orchestra.run.smithi081.stderr:Error ENXIO: problem getting command descriptions from osd.6 2024-09-13T06:43:17.235 INFO:teuthology.orchestra.run.smithi081.stdout:osd.7: {} 2024-09-13T06:43:17.235 INFO:teuthology.orchestra.run.smithi081.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-13T06:43:17.238 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-13T06:43:17.238 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-13T06:43:17.301 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:43:17.300+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:43:17.325 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:43:17.325 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-13T06:43:17.325 INFO:teuthology.orchestra.run.smithi081.stdout: "complaint_time": 30, 2024-09-13T06:43:17.325 INFO:teuthology.orchestra.run.smithi081.stdout: "num_blocked_ops": 0 2024-09-13T06:43:17.325 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:43:17.339 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-13T06:43:17.401 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:43:17.401+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:43:17.462 INFO:teuthology.orchestra.run.smithi081.stderr:nodeep-scrub is set 2024-09-13T06:43:17.502 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:43:17.501+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:43:17.516 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:43:17.516 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 20, 2024-09-13T06:43:17.516 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 600, 2024-09-13T06:43:17.516 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [ 2024-09-13T06:43:17.516 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:17.516 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:36160 3.f 3:f62782c2:::rbd_object_map.11219660270d.0000000000000016:head [call] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-13T06:43:17.516 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:01.607291+0000", 2024-09-13T06:43:17.516 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 195.90891436800001, 2024-09-13T06:43:17.516 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.99619456699999998, 2024-09-13T06:43:17.517 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:17.517 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:17.517 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:17.517 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:17.517 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:17.517 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 36160 2024-09-13T06:43:17.517 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:17.517 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:17.517 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:17.517 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:17.517 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:01.607291+0000", 2024-09-13T06:43:17.517 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:17.517 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:17.518 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:17.518 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:17.518 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:01.607291+0000", 2024-09-13T06:43:17.518 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:17.518 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:17.518 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:17.518 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:17.518 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:01.607289+0000", 2024-09-13T06:43:17.518 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999976 2024-09-13T06:43:17.518 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:17.518 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:17.518 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:17.518 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:01.607302+0000", 2024-09-13T06:43:17.519 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3018e-05 2024-09-13T06:43:17.519 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:17.519 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:17.519 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:17.519 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:01.607323+0000", 2024-09-13T06:43:17.519 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1030999999999999e-05 2024-09-13T06:43:17.519 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:17.519 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:17.519 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:17.519 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:01.607342+0000", 2024-09-13T06:43:17.519 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8961e-05 2024-09-13T06:43:17.519 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:17.520 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:17.520 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:17.520 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:01.607425+0000", 2024-09-13T06:43:17.520 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.3171999999999996e-05 2024-09-13T06:43:17.520 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:17.520 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:17.520 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:43:17.520 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:01.607441+0000", 2024-09-13T06:43:17.520 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5996999999999999e-05 2024-09-13T06:43:17.520 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:17.520 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:17.520 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:17.521 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:02.596186+0000", 2024-09-13T06:43:17.521 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.98874432000000001 2024-09-13T06:43:17.521 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:17.521 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:17.521 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for missing object", 2024-09-13T06:43:17.521 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:02.596618+0000", 2024-09-13T06:43:17.521 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000432032 2024-09-13T06:43:17.521 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:17.521 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:17.521 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:17.521 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:02.600845+0000", 2024-09-13T06:43:17.521 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0042277410000000001 2024-09-13T06:43:17.522 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:17.522 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:17.522 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:17.522 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:02.601003+0000", 2024-09-13T06:43:17.522 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00015731999999999999 2024-09-13T06:43:17.522 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:17.522 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:17.522 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:17.522 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:02.603486+0000", 2024-09-13T06:43:17.522 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0024832510000000001 2024-09-13T06:43:17.522 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:17.522 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:17.522 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:17.523 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:17.523 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:17.523 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:37806 3.9 3:951cb95b:::rbd_data.1121d8143c6e.0000000000000002:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e56)", 2024-09-13T06:43:17.523 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:06.373482+0000", 2024-09-13T06:43:17.523 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 191.142723332, 2024-09-13T06:43:17.523 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.002476213, 2024-09-13T06:43:17.523 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:17.523 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:17.523 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:17.523 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:17.523 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:17.523 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 37806 2024-09-13T06:43:17.523 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:17.524 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:17.524 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:17.524 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:17.524 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.373482+0000", 2024-09-13T06:43:17.524 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:17.524 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:17.524 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:17.524 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:17.524 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.373482+0000", 2024-09-13T06:43:17.524 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:17.524 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:17.524 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:17.525 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:17.525 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.373479+0000", 2024-09-13T06:43:17.525 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999962 2024-09-13T06:43:17.525 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:17.525 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:17.525 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:17.525 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.373495+0000", 2024-09-13T06:43:17.525 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6640999999999999e-05 2024-09-13T06:43:17.525 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:17.525 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:17.525 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:17.525 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.373542+0000", 2024-09-13T06:43:17.526 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6229000000000001e-05 2024-09-13T06:43:17.526 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:17.526 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:17.526 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:17.526 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.373564+0000", 2024-09-13T06:43:17.526 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2684000000000002e-05 2024-09-13T06:43:17.526 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:17.526 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:17.526 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:17.526 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374268+0000", 2024-09-13T06:43:17.526 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00070363700000000001 2024-09-13T06:43:17.526 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:17.527 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:17.527 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:43:17.527 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374305+0000", 2024-09-13T06:43:17.527 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.6936e-05 2024-09-13T06:43:17.527 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:17.527 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:17.527 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:17.527 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.375175+0000", 2024-09-13T06:43:17.527 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.000870454 2024-09-13T06:43:17.527 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:17.527 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:17.527 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:17.528 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.375678+0000", 2024-09-13T06:43:17.528 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00050292499999999999 2024-09-13T06:43:17.528 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:17.528 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:17.528 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:17.528 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.375959+0000", 2024-09-13T06:43:17.528 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00028050599999999997 2024-09-13T06:43:17.528 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:17.528 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:17.528 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:17.528 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:17.528 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:17.529 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:37821 3.9 3:951cb95b:::rbd_data.1121d8143c6e.0000000000000002:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e56)", 2024-09-13T06:43:17.529 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:06.374454+0000", 2024-09-13T06:43:17.529 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 191.141752215, 2024-09-13T06:43:17.529 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.002545072, 2024-09-13T06:43:17.529 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:17.529 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:17.529 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:17.529 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:17.529 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:17.529 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 37821 2024-09-13T06:43:17.529 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:17.529 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:17.529 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:17.530 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:17.530 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374454+0000", 2024-09-13T06:43:17.530 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:17.530 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:17.530 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:17.530 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:17.530 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374454+0000", 2024-09-13T06:43:17.530 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:17.530 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:17.530 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:17.530 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:17.530 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374452+0000", 2024-09-13T06:43:17.530 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999981 2024-09-13T06:43:17.531 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:17.531 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:17.531 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:17.531 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374463+0000", 2024-09-13T06:43:17.531 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0756e-05 2024-09-13T06:43:17.531 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:17.531 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:17.531 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:17.531 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374487+0000", 2024-09-13T06:43:17.531 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4887000000000001e-05 2024-09-13T06:43:17.531 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:17.531 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:17.532 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:17.532 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374504+0000", 2024-09-13T06:43:17.532 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6852000000000001e-05 2024-09-13T06:43:17.532 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:17.532 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:17.532 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:17.532 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374829+0000", 2024-09-13T06:43:17.532 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000324684 2024-09-13T06:43:17.532 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:17.532 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:17.532 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:43:17.533 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374880+0000", 2024-09-13T06:43:17.533 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.1378000000000002e-05 2024-09-13T06:43:17.533 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:17.533 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:17.533 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:17.533 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.376423+0000", 2024-09-13T06:43:17.533 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.001542734 2024-09-13T06:43:17.533 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:17.533 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:17.533 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:17.533 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.376607+0000", 2024-09-13T06:43:17.533 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000183656 2024-09-13T06:43:17.533 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:17.534 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:17.534 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:17.534 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.376999+0000", 2024-09-13T06:43:17.534 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00039191200000000001 2024-09-13T06:43:17.534 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:17.534 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:17.534 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:17.534 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:17.534 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:17.534 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:37836 3.9 3:951cb95b:::rbd_data.1121d8143c6e.0000000000000002:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e56)", 2024-09-13T06:43:17.534 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:06.374929+0000", 2024-09-13T06:43:17.534 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 191.14127656299999, 2024-09-13T06:43:17.535 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.002778825, 2024-09-13T06:43:17.535 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:17.535 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:17.535 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:17.535 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:17.535 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:17.535 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 37836 2024-09-13T06:43:17.535 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:17.535 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:17.535 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:17.535 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:17.535 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374929+0000", 2024-09-13T06:43:17.536 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:17.536 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:17.536 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:17.536 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:17.536 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374929+0000", 2024-09-13T06:43:17.536 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:17.536 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:17.536 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:17.536 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:17.536 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374927+0000", 2024-09-13T06:43:17.536 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999981 2024-09-13T06:43:17.536 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:17.537 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:17.537 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:17.537 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374939+0000", 2024-09-13T06:43:17.537 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1846e-05 2024-09-13T06:43:17.537 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:17.537 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:17.537 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:17.537 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374962+0000", 2024-09-13T06:43:17.537 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3054e-05 2024-09-13T06:43:17.537 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:17.537 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:17.537 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:17.538 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374978+0000", 2024-09-13T06:43:17.538 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5899000000000001e-05 2024-09-13T06:43:17.538 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:17.538 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:17.538 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:17.538 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.375106+0000", 2024-09-13T06:43:17.538 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00012789 2024-09-13T06:43:17.538 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:17.538 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:17.538 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:43:17.538 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.375134+0000", 2024-09-13T06:43:17.538 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.8254000000000001e-05 2024-09-13T06:43:17.538 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:17.539 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:17.539 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:17.539 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.377082+0000", 2024-09-13T06:43:17.539 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0019471520000001 2024-09-13T06:43:17.539 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:17.539 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:17.539 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:17.539 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.377330+0000", 2024-09-13T06:43:17.539 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00024834199999999997 2024-09-13T06:43:17.539 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:17.539 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:17.539 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:17.539 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.377708+0000", 2024-09-13T06:43:17.540 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00037817100000000001 2024-09-13T06:43:17.540 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:17.540 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:17.540 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:17.540 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:17.540 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:17.540 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:37851 3.9 3:951cb95b:::rbd_data.1121d8143c6e.0000000000000002:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e56)", 2024-09-13T06:43:17.540 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:06.382636+0000", 2024-09-13T06:43:17.540 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 191.13356967799999, 2024-09-13T06:43:17.540 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.99582539400000003, 2024-09-13T06:43:17.540 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:17.540 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:17.541 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:17.541 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:17.541 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:17.541 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 37851 2024-09-13T06:43:17.541 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:17.541 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:17.541 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:17.541 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:17.541 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.382636+0000", 2024-09-13T06:43:17.541 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:17.541 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:17.541 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:17.541 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:17.542 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.382636+0000", 2024-09-13T06:43:17.542 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:17.542 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:17.542 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:17.542 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:17.542 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.382633+0000", 2024-09-13T06:43:17.542 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999971 2024-09-13T06:43:17.542 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:17.542 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:17.542 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:17.542 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.382652+0000", 2024-09-13T06:43:17.543 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8834999999999998e-05 2024-09-13T06:43:17.543 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:17.543 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:17.543 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:17.543 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.382695+0000", 2024-09-13T06:43:17.543 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.3136000000000002e-05 2024-09-13T06:43:17.543 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:17.543 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:17.543 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:17.543 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.382716+0000", 2024-09-13T06:43:17.543 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1421e-05 2024-09-13T06:43:17.543 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:17.543 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:17.544 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:17.544 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.382860+0000", 2024-09-13T06:43:17.544 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00014389200000000001 2024-09-13T06:43:17.544 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:17.544 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:17.544 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:43:17.544 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.382890+0000", 2024-09-13T06:43:17.544 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9827000000000001e-05 2024-09-13T06:43:17.544 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:17.544 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:17.544 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:17.544 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.377779+0000", 2024-09-13T06:43:17.545 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.99488842899999996 2024-09-13T06:43:17.545 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:17.545 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:17.545 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:17.545 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.378007+0000", 2024-09-13T06:43:17.545 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00022838099999999999 2024-09-13T06:43:17.545 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:17.545 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:17.545 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:17.545 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.378462+0000", 2024-09-13T06:43:17.545 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00045452300000000003 2024-09-13T06:43:17.545 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:17.545 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:17.546 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:17.546 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:17.546 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:17.546 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:37866 3.9 3:951cb95b:::rbd_data.1121d8143c6e.0000000000000002:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e56)", 2024-09-13T06:43:17.546 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:06.383951+0000", 2024-09-13T06:43:17.546 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 191.13225499199999, 2024-09-13T06:43:17.546 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.99517962299999996, 2024-09-13T06:43:17.546 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:17.546 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:17.546 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:17.546 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:17.546 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:17.546 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 37866 2024-09-13T06:43:17.546 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:17.547 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:17.547 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:17.547 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:17.547 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.383951+0000", 2024-09-13T06:43:17.547 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:17.547 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:17.547 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:17.547 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:17.547 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.383951+0000", 2024-09-13T06:43:17.547 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:17.547 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:17.547 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:17.547 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:17.548 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.383949+0000", 2024-09-13T06:43:17.548 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999981 2024-09-13T06:43:17.548 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:17.548 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:17.548 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:17.548 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.383961+0000", 2024-09-13T06:43:17.548 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1999e-05 2024-09-13T06:43:17.548 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:17.548 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:17.548 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:17.548 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384019+0000", 2024-09-13T06:43:17.548 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7621000000000003e-05 2024-09-13T06:43:17.548 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:17.549 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:17.549 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:17.549 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384040+0000", 2024-09-13T06:43:17.549 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1528000000000001e-05 2024-09-13T06:43:17.549 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:17.549 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:17.549 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:17.549 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384186+0000", 2024-09-13T06:43:17.549 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00014573799999999999 2024-09-13T06:43:17.549 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:17.549 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:17.549 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:43:17.549 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384204+0000", 2024-09-13T06:43:17.550 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7992e-05 2024-09-13T06:43:17.550 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:17.550 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:17.550 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:17.550 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.378536+0000", 2024-09-13T06:43:17.550 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.99433268600000002 2024-09-13T06:43:17.550 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:17.550 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:17.550 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:17.550 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.378771+0000", 2024-09-13T06:43:17.550 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00023445399999999999 2024-09-13T06:43:17.550 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:17.550 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:17.550 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:17.551 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.379130+0000", 2024-09-13T06:43:17.551 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00035954200000000002 2024-09-13T06:43:17.551 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:17.551 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:17.551 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:17.551 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:17.551 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:17.551 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:37881 3.9 3:951cb95b:::rbd_data.1121d8143c6e.0000000000000002:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e56)", 2024-09-13T06:43:17.551 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:06.384239+0000", 2024-09-13T06:43:17.551 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 191.131966578, 2024-09-13T06:43:17.551 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.99541483500000005, 2024-09-13T06:43:17.551 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:17.551 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:17.552 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:17.552 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:17.552 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:17.552 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 37881 2024-09-13T06:43:17.552 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:17.552 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:17.552 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:17.552 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:17.552 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384239+0000", 2024-09-13T06:43:17.552 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:17.552 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:17.552 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:17.552 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:17.553 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384239+0000", 2024-09-13T06:43:17.553 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:17.553 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:17.553 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:17.553 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:17.553 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384238+0000", 2024-09-13T06:43:17.553 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999986 2024-09-13T06:43:17.553 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:17.553 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:17.553 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:17.553 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384246+0000", 2024-09-13T06:43:17.553 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.2449999999999998e-06 2024-09-13T06:43:17.553 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:17.554 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:17.554 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:17.554 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384268+0000", 2024-09-13T06:43:17.554 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1518e-05 2024-09-13T06:43:17.554 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:17.554 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:17.554 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:17.554 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384282+0000", 2024-09-13T06:43:17.554 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4501999999999999e-05 2024-09-13T06:43:17.554 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:17.554 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:17.554 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:17.554 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384356+0000", 2024-09-13T06:43:17.555 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4265999999999997e-05 2024-09-13T06:43:17.555 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:17.555 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:17.555 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:43:17.555 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384370+0000", 2024-09-13T06:43:17.555 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3942e-05 2024-09-13T06:43:17.555 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:17.555 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:17.555 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:17.555 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.379199+0000", 2024-09-13T06:43:17.555 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.99482866599999997 2024-09-13T06:43:17.555 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:17.555 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:17.555 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:17.556 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.379347+0000", 2024-09-13T06:43:17.556 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00014749199999999999 2024-09-13T06:43:17.556 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:17.556 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:17.556 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:17.556 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.379654+0000", 2024-09-13T06:43:17.556 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00030752999999999998 2024-09-13T06:43:17.556 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:17.556 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:17.556 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:17.556 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:17.556 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:17.557 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:37896 3.9 3:951cb95b:::rbd_data.1121d8143c6e.0000000000000002:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e56)", 2024-09-13T06:43:17.557 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:06.384412+0000", 2024-09-13T06:43:17.557 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 191.13179414499999, 2024-09-13T06:43:17.557 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.99777835999999998, 2024-09-13T06:43:17.557 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:17.557 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:17.557 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:17.557 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:17.557 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:17.557 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 37896 2024-09-13T06:43:17.557 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:17.557 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:17.557 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:17.557 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:17.558 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384412+0000", 2024-09-13T06:43:17.558 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:17.558 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:17.558 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:17.558 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:17.558 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384412+0000", 2024-09-13T06:43:17.558 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:17.558 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:17.558 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:17.558 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:17.558 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384410+0000", 2024-09-13T06:43:17.558 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.999999 2024-09-13T06:43:17.558 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:17.559 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:17.559 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:17.559 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384418+0000", 2024-09-13T06:43:17.559 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.486e-06 2024-09-13T06:43:17.559 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:17.559 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:17.559 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:17.559 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384436+0000", 2024-09-13T06:43:17.559 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7668000000000001e-05 2024-09-13T06:43:17.559 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:17.559 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:17.559 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:17.559 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384449+0000", 2024-09-13T06:43:17.559 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3395e-05 2024-09-13T06:43:17.560 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:17.560 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:17.560 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:17.560 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384605+0000", 2024-09-13T06:43:17.560 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00015563099999999999 2024-09-13T06:43:17.560 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:17.560 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:17.560 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:43:17.560 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384635+0000", 2024-09-13T06:43:17.560 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.0383999999999999e-05 2024-09-13T06:43:17.560 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:17.560 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:17.561 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:17.561 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.379730+0000", 2024-09-13T06:43:17.561 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.99509493999999998 2024-09-13T06:43:17.561 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:17.561 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:17.561 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:17.561 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.379964+0000", 2024-09-13T06:43:17.561 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00023353499999999999 2024-09-13T06:43:17.561 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:17.561 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:17.561 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:17.561 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.382190+0000", 2024-09-13T06:43:17.561 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0022265039999999998 2024-09-13T06:43:17.562 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:17.562 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:17.562 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:17.562 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:17.562 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:17.562 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43223 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 393216~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:43:17.562 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558267+0000", 2024-09-13T06:43:17.562 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 175.957938834, 2024-09-13T06:43:17.562 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.062813151999999997, 2024-09-13T06:43:17.562 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:17.562 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:17.562 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:17.563 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:17.563 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:17.563 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43223 2024-09-13T06:43:17.563 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:17.563 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:17.563 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:17.563 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:17.563 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558267+0000", 2024-09-13T06:43:17.563 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:17.563 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:17.563 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:17.563 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:17.564 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558267+0000", 2024-09-13T06:43:17.564 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:17.564 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:17.564 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:17.564 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:17.564 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558266+0000", 2024-09-13T06:43:17.564 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:17.564 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:17.564 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:17.564 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:17.564 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558270+0000", 2024-09-13T06:43:17.564 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.2389999999999998e-06 2024-09-13T06:43:17.564 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:17.564 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:17.565 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:17.565 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558277+0000", 2024-09-13T06:43:17.565 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5680000000000002e-06 2024-09-13T06:43:17.565 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:17.565 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:17.565 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:17.565 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558282+0000", 2024-09-13T06:43:17.565 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7060000000000003e-06 2024-09-13T06:43:17.565 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:17.565 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:17.565 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:17.565 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.620731+0000", 2024-09-13T06:43:17.565 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.062448661000000003 2024-09-13T06:43:17.566 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:17.566 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:17.566 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:17.566 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.620806+0000", 2024-09-13T06:43:17.566 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5862e-05 2024-09-13T06:43:17.566 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:17.566 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:17.566 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:17.566 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.621080+0000", 2024-09-13T06:43:17.566 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00027368599999999998 2024-09-13T06:43:17.566 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:17.566 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:17.566 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:17.567 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:17.567 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:17.567 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43224 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 407552~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:43:17.567 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558286+0000", 2024-09-13T06:43:17.567 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 175.95791947000001, 2024-09-13T06:43:17.567 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.063179052999999999, 2024-09-13T06:43:17.567 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:17.567 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:17.567 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:17.567 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:17.567 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:17.567 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43224 2024-09-13T06:43:17.568 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:17.568 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:17.568 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:17.568 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:17.568 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558286+0000", 2024-09-13T06:43:17.568 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:17.568 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:17.568 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:17.568 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:17.568 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558286+0000", 2024-09-13T06:43:17.568 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:17.568 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:17.568 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:17.569 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:17.569 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558286+0000", 2024-09-13T06:43:17.569 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:17.569 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:17.569 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:17.569 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:17.569 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558288+0000", 2024-09-13T06:43:17.569 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.227e-06 2024-09-13T06:43:17.569 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:17.569 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:17.569 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:17.569 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558292+0000", 2024-09-13T06:43:17.569 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.6289999999999999e-06 2024-09-13T06:43:17.570 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:17.570 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:17.570 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:17.570 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558294+0000", 2024-09-13T06:43:17.570 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5409999999999999e-06 2024-09-13T06:43:17.570 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:17.570 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:17.570 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:17.570 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.621110+0000", 2024-09-13T06:43:17.570 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.062815776000000004 2024-09-13T06:43:17.570 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:17.570 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:17.570 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:17.570 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.621186+0000", 2024-09-13T06:43:17.570 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5570999999999999e-05 2024-09-13T06:43:17.571 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:17.571 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:17.571 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:17.571 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.621465+0000", 2024-09-13T06:43:17.571 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00027988200000000001 2024-09-13T06:43:17.571 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:17.571 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:17.571 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:17.571 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:17.571 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:17.571 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43225 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 421888~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:43:17.571 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558296+0000", 2024-09-13T06:43:17.571 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 175.957909503, 2024-09-13T06:43:17.572 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.063551110999999993, 2024-09-13T06:43:17.572 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:17.572 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:17.572 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:17.572 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:17.572 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:17.572 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43225 2024-09-13T06:43:17.572 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:17.572 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:17.572 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:17.572 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:17.572 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558296+0000", 2024-09-13T06:43:17.572 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:17.573 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:17.573 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:17.573 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:17.573 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558296+0000", 2024-09-13T06:43:17.573 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:17.573 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:17.573 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:17.573 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:17.573 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558296+0000", 2024-09-13T06:43:17.573 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:43:17.573 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:17.573 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:17.574 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:17.574 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558305+0000", 2024-09-13T06:43:17.574 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.5290000000000008e-06 2024-09-13T06:43:17.574 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:17.574 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:17.574 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:17.574 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558308+0000", 2024-09-13T06:43:17.574 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.5619999999999999e-06 2024-09-13T06:43:17.574 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:17.574 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:17.574 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:17.574 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558311+0000", 2024-09-13T06:43:17.575 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.43e-06 2024-09-13T06:43:17.575 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:17.575 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:17.575 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:17.575 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.621495+0000", 2024-09-13T06:43:17.575 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.063184289000000005 2024-09-13T06:43:17.575 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:17.575 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:17.575 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:17.575 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.621569+0000", 2024-09-13T06:43:17.575 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4250000000000002e-05 2024-09-13T06:43:17.575 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:17.575 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:17.576 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:17.576 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.621847+0000", 2024-09-13T06:43:17.576 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00027826400000000002 2024-09-13T06:43:17.576 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:17.576 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:17.576 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:17.576 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:17.576 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:17.576 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43226 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 436224~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:43:17.576 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558313+0000", 2024-09-13T06:43:17.576 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 175.957892867, 2024-09-13T06:43:17.576 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.063914420999999999, 2024-09-13T06:43:17.576 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:17.577 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:17.577 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:17.577 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:17.577 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:17.577 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43226 2024-09-13T06:43:17.577 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:17.577 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:17.577 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:17.577 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:17.577 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558313+0000", 2024-09-13T06:43:17.577 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:17.577 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:17.578 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:17.578 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:17.578 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558313+0000", 2024-09-13T06:43:17.578 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:17.578 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:17.578 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:17.578 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:17.578 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558313+0000", 2024-09-13T06:43:17.578 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:17.578 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:17.578 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:17.578 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:17.578 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558314+0000", 2024-09-13T06:43:17.579 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3740000000000001e-06 2024-09-13T06:43:17.579 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:17.579 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:17.579 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:17.579 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558317+0000", 2024-09-13T06:43:17.579 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9730000000000002e-06 2024-09-13T06:43:17.579 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:17.579 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:17.579 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:17.579 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558319+0000", 2024-09-13T06:43:17.579 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4059999999999999e-06 2024-09-13T06:43:17.579 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:17.579 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:17.580 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:17.580 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.621877+0000", 2024-09-13T06:43:17.580 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.063557408999999995 2024-09-13T06:43:17.580 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:17.580 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:17.580 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:17.580 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.621951+0000", 2024-09-13T06:43:17.580 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4487999999999996e-05 2024-09-13T06:43:17.580 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:17.580 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:17.580 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:17.580 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.622227+0000", 2024-09-13T06:43:17.580 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000276011 2024-09-13T06:43:17.581 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:17.581 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:17.581 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:17.581 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:17.581 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:17.581 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43227 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 450560~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:43:17.581 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558322+0000", 2024-09-13T06:43:17.581 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 175.957884286, 2024-09-13T06:43:17.581 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.064285348000000006, 2024-09-13T06:43:17.581 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:17.581 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:17.581 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:17.581 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:17.581 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:17.581 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43227 2024-09-13T06:43:17.582 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:17.582 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:17.582 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:17.582 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:17.582 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558322+0000", 2024-09-13T06:43:17.582 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:17.582 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:17.582 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:17.582 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:17.582 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558322+0000", 2024-09-13T06:43:17.582 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:17.582 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:17.582 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:17.583 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:17.583 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558321+0000", 2024-09-13T06:43:17.583 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:43:17.583 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:17.583 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:17.583 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:17.583 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558323+0000", 2024-09-13T06:43:17.583 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.576e-06 2024-09-13T06:43:17.583 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:17.583 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:17.583 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:17.583 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558328+0000", 2024-09-13T06:43:17.583 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0719999999999999e-06 2024-09-13T06:43:17.584 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:17.584 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:17.584 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:17.584 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558332+0000", 2024-09-13T06:43:17.584 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.8130000000000002e-06 2024-09-13T06:43:17.584 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:17.584 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:17.584 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:17.584 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.622255+0000", 2024-09-13T06:43:17.584 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.063923195000000002 2024-09-13T06:43:17.584 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:17.584 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:17.584 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:17.584 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.622330+0000", 2024-09-13T06:43:17.585 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5383000000000007e-05 2024-09-13T06:43:17.585 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:17.585 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:17.585 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:17.585 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.622607+0000", 2024-09-13T06:43:17.585 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00027651999999999999 2024-09-13T06:43:17.585 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:17.585 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:17.585 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:17.585 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:17.585 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:17.585 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43228 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 464896~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:43:17.585 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558335+0000", 2024-09-13T06:43:17.585 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 175.95787037700001, 2024-09-13T06:43:17.586 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.064652253000000007, 2024-09-13T06:43:17.586 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:17.586 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:17.586 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:17.586 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:17.586 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:17.586 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43228 2024-09-13T06:43:17.586 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:17.586 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:17.586 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:17.586 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:17.586 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558335+0000", 2024-09-13T06:43:17.586 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:17.586 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:17.586 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:17.587 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:17.587 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558335+0000", 2024-09-13T06:43:17.587 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:17.587 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:17.587 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:17.587 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:17.587 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558335+0000", 2024-09-13T06:43:17.587 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:17.587 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:17.587 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:17.587 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:17.587 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558337+0000", 2024-09-13T06:43:17.587 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1380000000000001e-06 2024-09-13T06:43:17.587 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:17.587 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:17.588 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:17.588 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558343+0000", 2024-09-13T06:43:17.588 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.5140000000000001e-06 2024-09-13T06:43:17.588 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:17.588 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:17.588 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:17.588 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558348+0000", 2024-09-13T06:43:17.588 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9640000000000002e-06 2024-09-13T06:43:17.588 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:17.588 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:17.588 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:17.588 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.622636+0000", 2024-09-13T06:43:17.589 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.064288260999999999 2024-09-13T06:43:17.589 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:17.589 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:17.589 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:17.589 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.622715+0000", 2024-09-13T06:43:17.589 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.9351000000000006e-05 2024-09-13T06:43:17.589 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:17.589 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:17.589 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:17.589 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.622988+0000", 2024-09-13T06:43:17.589 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00027242599999999998 2024-09-13T06:43:17.589 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:17.589 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:17.589 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:17.590 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:17.590 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:17.590 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43229 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 479232~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:43:17.590 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558352+0000", 2024-09-13T06:43:17.590 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 175.957853962, 2024-09-13T06:43:17.590 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.065018024999999993, 2024-09-13T06:43:17.590 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:17.590 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:17.590 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:17.590 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:17.590 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:17.590 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43229 2024-09-13T06:43:17.590 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:17.591 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:17.591 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:17.591 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:17.591 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558352+0000", 2024-09-13T06:43:17.591 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:17.591 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:17.591 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:17.591 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:17.591 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558352+0000", 2024-09-13T06:43:17.591 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:17.591 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:17.591 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:17.591 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:17.592 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558352+0000", 2024-09-13T06:43:17.592 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:17.592 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:17.592 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:17.592 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:17.592 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558354+0000", 2024-09-13T06:43:17.592 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4930000000000001e-06 2024-09-13T06:43:17.592 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:17.592 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:17.592 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:17.592 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558360+0000", 2024-09-13T06:43:17.592 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.263e-06 2024-09-13T06:43:17.593 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:17.593 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:17.593 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:17.593 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558369+0000", 2024-09-13T06:43:17.593 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.0829999999999993e-06 2024-09-13T06:43:17.593 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:17.593 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:17.593 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:17.593 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.623017+0000", 2024-09-13T06:43:17.593 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.064647799000000006 2024-09-13T06:43:17.593 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:17.593 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:17.593 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:17.593 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.623090+0000", 2024-09-13T06:43:17.594 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3071000000000006e-05 2024-09-13T06:43:17.594 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:17.594 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:17.594 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:17.594 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.623370+0000", 2024-09-13T06:43:17.594 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000279661 2024-09-13T06:43:17.594 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:17.594 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:17.594 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:17.594 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:17.594 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:17.594 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43230 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 493568~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:43:17.594 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558374+0000", 2024-09-13T06:43:17.594 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 175.957831669, 2024-09-13T06:43:17.594 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.065410435000000003, 2024-09-13T06:43:17.595 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:17.595 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:17.595 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:17.595 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:17.595 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:17.595 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43230 2024-09-13T06:43:17.595 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:17.595 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:17.595 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:17.595 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:17.595 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558374+0000", 2024-09-13T06:43:17.595 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:17.595 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:17.595 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:17.596 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:17.596 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558374+0000", 2024-09-13T06:43:17.596 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:17.596 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:17.596 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:17.596 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:17.596 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558374+0000", 2024-09-13T06:43:17.596 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:17.596 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:17.596 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:17.596 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:17.596 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558376+0000", 2024-09-13T06:43:17.596 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4430000000000002e-06 2024-09-13T06:43:17.596 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:17.597 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:17.597 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:17.597 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558382+0000", 2024-09-13T06:43:17.597 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3029999999999996e-06 2024-09-13T06:43:17.597 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:17.597 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:17.597 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:17.597 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558387+0000", 2024-09-13T06:43:17.597 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.1699999999999999e-06 2024-09-13T06:43:17.597 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:17.597 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:17.597 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:17.597 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.623400+0000", 2024-09-13T06:43:17.598 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.065013244999999997 2024-09-13T06:43:17.598 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:17.598 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:17.598 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:17.598 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.623474+0000", 2024-09-13T06:43:17.598 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3889999999999999e-05 2024-09-13T06:43:17.598 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:17.598 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:17.598 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:17.598 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.623785+0000", 2024-09-13T06:43:17.598 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00031080099999999998 2024-09-13T06:43:17.598 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:17.598 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:17.598 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:17.599 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:17.599 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:17.599 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43231 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 507904~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:43:17.599 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558391+0000", 2024-09-13T06:43:17.599 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 175.95781498400001, 2024-09-13T06:43:17.599 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.065788597000000004, 2024-09-13T06:43:17.599 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:17.599 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:17.599 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:17.599 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:17.599 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:17.599 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43231 2024-09-13T06:43:17.599 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:17.600 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:17.600 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:17.600 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:17.600 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558391+0000", 2024-09-13T06:43:17.600 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:17.600 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:17.600 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:17.600 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:17.600 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558391+0000", 2024-09-13T06:43:17.600 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:17.600 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:17.600 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:17.600 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:17.601 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558390+0000", 2024-09-13T06:43:17.601 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:17.601 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:17.601 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:17.601 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:17.601 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558393+0000", 2024-09-13T06:43:17.601 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2570000000000002e-06 2024-09-13T06:43:17.601 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:17.601 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:17.601 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:17.601 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558399+0000", 2024-09-13T06:43:17.601 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0419999999999999e-06 2024-09-13T06:43:17.602 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:17.602 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:17.602 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:17.602 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558403+0000", 2024-09-13T06:43:17.602 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6249999999999998e-06 2024-09-13T06:43:17.602 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:17.602 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:17.602 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:17.602 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.623811+0000", 2024-09-13T06:43:17.602 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.065407549999999995 2024-09-13T06:43:17.602 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:17.602 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:17.603 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:17.603 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.623877+0000", 2024-09-13T06:43:17.603 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.5902999999999996e-05 2024-09-13T06:43:17.603 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:17.603 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:17.603 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:17.603 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.624179+0000", 2024-09-13T06:43:17.603 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00030259999999999998 2024-09-13T06:43:17.603 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:17.603 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:17.603 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:17.603 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:17.603 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:17.604 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43232 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 522240~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:43:17.604 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558422+0000", 2024-09-13T06:43:17.604 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 175.957784207, 2024-09-13T06:43:17.604 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.066176061999999994, 2024-09-13T06:43:17.604 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:17.604 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:17.604 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:17.604 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:17.604 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:17.604 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43232 2024-09-13T06:43:17.604 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:17.604 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:17.604 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:17.605 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:17.605 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558422+0000", 2024-09-13T06:43:17.605 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:17.605 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:17.605 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:17.605 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:17.605 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558422+0000", 2024-09-13T06:43:17.605 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:17.605 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:17.605 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:17.605 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:17.605 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558421+0000", 2024-09-13T06:43:17.605 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:17.606 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:17.606 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:17.606 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:17.606 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558428+0000", 2024-09-13T06:43:17.606 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.1690000000000003e-06 2024-09-13T06:43:17.606 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:17.606 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:17.606 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:17.606 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558434+0000", 2024-09-13T06:43:17.606 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9309999999999996e-06 2024-09-13T06:43:17.606 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:17.606 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:17.606 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:17.606 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558447+0000", 2024-09-13T06:43:17.606 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.271e-05 2024-09-13T06:43:17.607 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:17.607 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:17.607 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:17.607 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.624209+0000", 2024-09-13T06:43:17.607 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.065762102000000003 2024-09-13T06:43:17.607 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:17.607 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:17.607 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:17.607 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.624282+0000", 2024-09-13T06:43:17.607 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.2889e-05 2024-09-13T06:43:17.607 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:17.607 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:17.607 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:17.608 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.624598+0000", 2024-09-13T06:43:17.608 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00031591399999999998 2024-09-13T06:43:17.608 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:17.608 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:17.608 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:17.608 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:17.608 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:17.608 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43486 3.f 3:f7da9c8f:::rbd_data.1121f5f2e1c0.000000000000000b:1f [read 260096~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:43:17.608 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.569088+0000", 2024-09-13T06:43:17.608 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 175.94711748399999, 2024-09-13T06:43:17.608 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.062579223000000003, 2024-09-13T06:43:17.608 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:17.608 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:17.609 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:17.609 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:17.609 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:17.609 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43486 2024-09-13T06:43:17.609 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:17.609 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:17.609 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:17.609 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:17.609 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.569088+0000", 2024-09-13T06:43:17.609 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:17.609 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:17.609 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:17.609 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:17.609 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.569088+0000", 2024-09-13T06:43:17.610 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:17.610 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:17.610 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:17.610 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:17.610 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.569088+0000", 2024-09-13T06:43:17.610 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:17.610 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:17.610 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:17.610 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:17.610 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.569091+0000", 2024-09-13T06:43:17.610 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9629999999999998e-06 2024-09-13T06:43:17.610 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:17.610 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:17.610 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:17.610 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.569097+0000", 2024-09-13T06:43:17.611 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.4160000000000001e-06 2024-09-13T06:43:17.611 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:17.611 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:17.611 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:17.611 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.569102+0000", 2024-09-13T06:43:17.611 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6659999999999999e-06 2024-09-13T06:43:17.611 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:17.611 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:17.611 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:17.611 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.631346+0000", 2024-09-13T06:43:17.611 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.062243896 2024-09-13T06:43:17.611 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:17.611 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:17.612 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:17.612 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.631413+0000", 2024-09-13T06:43:17.612 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.7638000000000005e-05 2024-09-13T06:43:17.612 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:17.612 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:17.612 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:17.612 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.631668+0000", 2024-09-13T06:43:17.612 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0002541 2024-09-13T06:43:17.612 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:17.612 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:17.612 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:17.612 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:17.613 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:17.613 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:170125 3.9 3:94e4bf8d:::rbd_object_map.1121fa0cc8a3.000000000000006d:head [writefull 0~37] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e190)", 2024-09-13T06:43:17.613 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:42:30.601501+0000", 2024-09-13T06:43:17.613 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 46.914705273000003, 2024-09-13T06:43:17.613 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.80498820000000004, 2024-09-13T06:43:17.613 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:17.613 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:43:17.613 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:17.613 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:17.613 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:17.613 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 170125 2024-09-13T06:43:17.613 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:17.613 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:17.614 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:17.614 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:17.614 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:30.601501+0000", 2024-09-13T06:43:17.614 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:17.614 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:17.614 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:17.614 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:17.614 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:30.601501+0000", 2024-09-13T06:43:17.614 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:17.614 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:17.614 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:17.614 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:17.614 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:30.601499+0000", 2024-09-13T06:43:17.615 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999986 2024-09-13T06:43:17.615 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:17.615 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:17.615 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:17.615 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:30.601506+0000", 2024-09-13T06:43:17.615 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.9940000000000003e-06 2024-09-13T06:43:17.615 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:17.615 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:17.615 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:17.615 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:30.601519+0000", 2024-09-13T06:43:17.615 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2875e-05 2024-09-13T06:43:17.615 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:17.615 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:17.616 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:17.616 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:30.601525+0000", 2024-09-13T06:43:17.616 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8549999999999998e-06 2024-09-13T06:43:17.616 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:17.616 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:17.616 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:17.616 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:30.601560+0000", 2024-09-13T06:43:17.616 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.5271000000000002e-05 2024-09-13T06:43:17.616 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:17.616 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:17.616 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:43:17.616 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:30.601566+0000", 2024-09-13T06:43:17.616 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3090000000000001e-06 2024-09-13T06:43:17.617 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:17.617 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:17.617 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:17.617 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:31.403017+0000", 2024-09-13T06:43:17.617 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.80145064200000005 2024-09-13T06:43:17.617 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:17.617 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:17.617 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:17.617 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:31.403252+0000", 2024-09-13T06:43:17.617 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000234718 2024-09-13T06:43:17.617 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:17.617 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:17.617 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 7", 2024-09-13T06:43:17.617 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:31.403521+0000", 2024-09-13T06:43:17.617 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00026917 2024-09-13T06:43:17.618 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:17.618 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:17.618 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-09-13T06:43:17.618 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:31.404918+0000", 2024-09-13T06:43:17.618 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.001397017 2024-09-13T06:43:17.618 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:17.618 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:17.618 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:43:17.618 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:31.406176+0000", 2024-09-13T06:43:17.618 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.001257998 2024-09-13T06:43:17.618 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:17.618 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:17.618 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:43:17.618 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:31.406334+0000", 2024-09-13T06:43:17.619 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00015819099999999999 2024-09-13T06:43:17.619 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:17.619 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:17.619 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:17.619 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:31.406489+0000", 2024-09-13T06:43:17.619 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00015476699999999999 2024-09-13T06:43:17.619 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:17.619 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:17.619 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:17.619 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:17.619 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:17.619 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:43:17.621 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-13T06:43:17.621 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:43:17.620+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:43:17.722 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-13T06:43:17.721+0000 7fa8bb18e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 36790) UID: 0 2024-09-13T06:43:17.790 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:43:17.790 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-13T06:43:17.790 INFO:teuthology.orchestra.run.smithi081.stdout: "num_ops": 0 2024-09-13T06:43:17.790 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:43:17.804 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-13T06:43:17.850 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:43:17.852+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:43:17.924 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:43:17.925+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:43:17.926 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:43:17.926 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-13T06:43:17.926 INFO:teuthology.orchestra.run.smithi081.stdout: "complaint_time": 30, 2024-09-13T06:43:17.926 INFO:teuthology.orchestra.run.smithi081.stdout: "num_blocked_ops": 0 2024-09-13T06:43:17.926 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:43:17.940 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-13T06:43:18.024 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:43:18.025+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:43:18.115 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:43:18.115 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 20, 2024-09-13T06:43:18.115 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 600, 2024-09-13T06:43:18.115 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [ 2024-09-13T06:43:18.115 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:18.115 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:2226 3.15 3:af026987:::rbd_data.112173e2f1b7.0000000000000017:head [sparse-read 0~4194304] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-13T06:43:18.116 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:37.606562+0000", 2024-09-13T06:43:18.116 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 220.50785956799999, 2024-09-13T06:43:18.116 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.83322091700000001, 2024-09-13T06:43:18.116 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:18.116 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:43:18.116 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:18.116 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:18.116 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:18.116 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 2226 2024-09-13T06:43:18.116 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:18.116 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:18.116 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:18.116 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:18.117 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606562+0000", 2024-09-13T06:43:18.117 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:18.117 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:18.117 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:18.117 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:18.117 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606562+0000", 2024-09-13T06:43:18.117 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:18.117 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:18.117 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:18.117 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:18.117 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606561+0000", 2024-09-13T06:43:18.117 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:18.117 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:18.117 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:18.118 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:18.118 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606565+0000", 2024-09-13T06:43:18.118 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.4379999999999999e-06 2024-09-13T06:43:18.118 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:18.118 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:18.118 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:18.118 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606569+0000", 2024-09-13T06:43:18.118 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.425e-06 2024-09-13T06:43:18.118 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:18.118 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:18.118 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:18.118 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606572+0000", 2024-09-13T06:43:18.118 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.05e-06 2024-09-13T06:43:18.118 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:18.118 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:18.119 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:18.119 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606621+0000", 2024-09-13T06:43:18.119 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.8723000000000001e-05 2024-09-13T06:43:18.119 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:18.119 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:18.119 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:43:18.119 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606630+0000", 2024-09-13T06:43:18.119 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.8040000000000007e-06 2024-09-13T06:43:18.119 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:18.119 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:18.119 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:18.119 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.439648+0000", 2024-09-13T06:43:18.119 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.83301824800000002 2024-09-13T06:43:18.119 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:18.119 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:18.120 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:18.120 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.439782+0000", 2024-09-13T06:43:18.120 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00013466699999999999 2024-09-13T06:43:18.120 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:18.120 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:18.120 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:18.120 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:18.120 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:18.120 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25661 3.8 3:1180686c:::rbd_data.1121f2c5ee81.0000000000000009:13 [read 397312~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:43:18.120 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.436956+0000", 2024-09-13T06:43:18.120 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 201.67746503399999, 2024-09-13T06:43:18.120 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089036758999999993, 2024-09-13T06:43:18.120 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:18.120 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:18.121 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:18.121 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:18.121 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:18.121 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25661 2024-09-13T06:43:18.121 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:18.121 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:18.121 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:18.121 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:18.121 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436956+0000", 2024-09-13T06:43:18.121 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:18.121 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:18.121 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:18.121 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:18.122 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436956+0000", 2024-09-13T06:43:18.122 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:18.122 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:18.122 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:18.122 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:18.122 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436956+0000", 2024-09-13T06:43:18.122 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:18.122 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:18.122 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:18.122 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:18.122 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436958+0000", 2024-09-13T06:43:18.122 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1770000000000001e-06 2024-09-13T06:43:18.122 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:18.122 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:18.122 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:18.123 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436963+0000", 2024-09-13T06:43:18.123 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.6489999999999996e-06 2024-09-13T06:43:18.123 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:18.123 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:18.123 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:18.123 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436975+0000", 2024-09-13T06:43:18.123 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1783999999999999e-05 2024-09-13T06:43:18.123 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:18.123 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:18.123 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:18.123 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.525671+0000", 2024-09-13T06:43:18.123 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.088696292999999995 2024-09-13T06:43:18.123 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:18.123 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:18.124 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:18.124 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.525749+0000", 2024-09-13T06:43:18.124 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.7589000000000005e-05 2024-09-13T06:43:18.124 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:18.124 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:18.124 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:18.124 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.525993+0000", 2024-09-13T06:43:18.124 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00024381000000000001 2024-09-13T06:43:18.124 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:18.124 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:18.124 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:18.124 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:18.124 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:18.124 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25662 3.8 3:1180686c:::rbd_data.1121f2c5ee81.0000000000000009:13 [read 421888~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:43:18.125 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.436980+0000", 2024-09-13T06:43:18.125 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 201.677440722, 2024-09-13T06:43:18.125 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089367577000000004, 2024-09-13T06:43:18.125 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:18.125 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:18.125 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:18.125 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:18.125 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:18.125 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25662 2024-09-13T06:43:18.125 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:18.125 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:18.125 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:18.125 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:18.126 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436980+0000", 2024-09-13T06:43:18.126 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:18.126 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:18.126 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:18.126 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:18.126 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436980+0000", 2024-09-13T06:43:18.126 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:18.126 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:18.126 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:18.126 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:18.126 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436980+0000", 2024-09-13T06:43:18.126 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:18.126 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:18.126 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:18.127 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:18.127 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436982+0000", 2024-09-13T06:43:18.127 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3989999999999998e-06 2024-09-13T06:43:18.127 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:18.127 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:18.127 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:18.127 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436988+0000", 2024-09-13T06:43:18.127 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0039999999999996e-06 2024-09-13T06:43:18.127 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:18.127 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:18.127 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:18.127 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436993+0000", 2024-09-13T06:43:18.127 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6090000000000003e-06 2024-09-13T06:43:18.128 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:18.128 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:18.128 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:18.128 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.526035+0000", 2024-09-13T06:43:18.128 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089042248000000004 2024-09-13T06:43:18.128 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:18.128 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:18.128 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:18.128 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.526111+0000", 2024-09-13T06:43:18.128 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5643999999999996e-05 2024-09-13T06:43:18.128 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:18.128 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:18.128 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:18.129 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.526348+0000", 2024-09-13T06:43:18.129 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00023705800000000001 2024-09-13T06:43:18.129 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:18.129 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:18.129 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:18.129 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:18.129 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:18.129 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25663 3.8 3:1180686c:::rbd_data.1121f2c5ee81.0000000000000009:13 [read 466944~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:43:18.129 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.436998+0000", 2024-09-13T06:43:18.129 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 201.67742307500001, 2024-09-13T06:43:18.129 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089730867000000006, 2024-09-13T06:43:18.129 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:18.129 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:18.129 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:18.130 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:18.130 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:18.130 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25663 2024-09-13T06:43:18.130 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:18.130 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:18.130 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:18.130 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:18.130 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436998+0000", 2024-09-13T06:43:18.130 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:18.130 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:18.130 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:18.130 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:18.130 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436998+0000", 2024-09-13T06:43:18.131 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:18.131 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:18.131 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:18.131 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:18.131 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436998+0000", 2024-09-13T06:43:18.131 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:18.131 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:18.131 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:18.131 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:18.131 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437000+0000", 2024-09-13T06:43:18.131 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0940000000000002e-06 2024-09-13T06:43:18.131 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:18.131 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:18.131 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:18.132 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437005+0000", 2024-09-13T06:43:18.132 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.604e-06 2024-09-13T06:43:18.132 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:18.132 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:18.132 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:18.132 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437032+0000", 2024-09-13T06:43:18.132 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6407e-05 2024-09-13T06:43:18.132 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:18.132 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:18.132 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:18.132 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.526363+0000", 2024-09-13T06:43:18.132 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089331456000000004 2024-09-13T06:43:18.132 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:18.133 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:18.133 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:18.133 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.526404+0000", 2024-09-13T06:43:18.133 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.0887999999999999e-05 2024-09-13T06:43:18.133 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:18.133 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:18.133 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:18.133 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.526729+0000", 2024-09-13T06:43:18.133 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00032486 2024-09-13T06:43:18.133 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:18.133 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:18.133 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:18.133 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:18.134 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:18.134 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25664 3.8 3:1180686c:::rbd_data.1121f2c5ee81.0000000000000009:13 [read 491520~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:43:18.134 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.437040+0000", 2024-09-13T06:43:18.134 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 201.67738116000001, 2024-09-13T06:43:18.134 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.090016650000000004, 2024-09-13T06:43:18.134 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:18.134 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:18.134 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:18.134 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:18.134 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:18.134 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25664 2024-09-13T06:43:18.134 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:18.134 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:18.134 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:18.135 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:18.135 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437040+0000", 2024-09-13T06:43:18.135 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:18.135 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:18.135 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:18.135 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:18.135 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437040+0000", 2024-09-13T06:43:18.135 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:18.135 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:18.135 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:18.135 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:18.135 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437039+0000", 2024-09-13T06:43:18.135 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:18.135 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:18.136 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:18.136 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:18.136 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437047+0000", 2024-09-13T06:43:18.136 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4839999999999998e-06 2024-09-13T06:43:18.136 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:18.136 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:18.136 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:18.136 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437054+0000", 2024-09-13T06:43:18.136 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.8299999999999998e-06 2024-09-13T06:43:18.136 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:18.136 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:18.136 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:18.136 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437060+0000", 2024-09-13T06:43:18.137 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.1510000000000001e-06 2024-09-13T06:43:18.137 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:18.137 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:18.137 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:18.137 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.526772+0000", 2024-09-13T06:43:18.137 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089711737999999999 2024-09-13T06:43:18.137 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:18.137 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:18.137 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:18.137 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.526848+0000", 2024-09-13T06:43:18.137 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5870000000000004e-05 2024-09-13T06:43:18.137 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:18.137 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:18.138 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:18.138 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.527057+0000", 2024-09-13T06:43:18.138 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000209106 2024-09-13T06:43:18.138 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:18.138 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:18.138 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:18.138 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:18.138 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:18.138 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25740 3.18 3:1c662b96:::rbd_data.1121f2c5ee81.0000000000000010:13 [read 200704~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:43:18.138 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443352+0000", 2024-09-13T06:43:18.138 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 201.671069485, 2024-09-13T06:43:18.138 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089068222000000002, 2024-09-13T06:43:18.138 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:18.139 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:18.139 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:18.139 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:18.139 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:18.139 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25740 2024-09-13T06:43:18.139 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:18.139 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:18.139 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:18.139 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:18.139 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443352+0000", 2024-09-13T06:43:18.139 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:18.139 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:18.140 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:18.140 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:18.140 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443352+0000", 2024-09-13T06:43:18.140 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:18.140 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:18.140 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:18.140 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:18.140 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443351+0000", 2024-09-13T06:43:18.140 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:18.140 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:18.140 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:18.140 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:18.140 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443354+0000", 2024-09-13T06:43:18.141 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.841e-06 2024-09-13T06:43:18.141 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:18.141 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:18.141 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:18.141 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443361+0000", 2024-09-13T06:43:18.141 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.0010000000000004e-06 2024-09-13T06:43:18.141 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:18.141 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:18.141 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:18.141 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443366+0000", 2024-09-13T06:43:18.141 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7119999999999999e-06 2024-09-13T06:43:18.141 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:18.141 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:18.142 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:18.142 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532117+0000", 2024-09-13T06:43:18.142 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.088751327000000005 2024-09-13T06:43:18.142 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:18.142 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:18.142 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:18.142 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532193+0000", 2024-09-13T06:43:18.142 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5839000000000004e-05 2024-09-13T06:43:18.142 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:18.142 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:18.142 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:18.142 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532420+0000", 2024-09-13T06:43:18.143 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00022691000000000001 2024-09-13T06:43:18.143 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:18.143 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:18.143 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:18.143 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:18.143 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:18.143 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25741 3.18 3:1c662b96:::rbd_data.1121f2c5ee81.0000000000000010:13 [read 225280~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:43:18.143 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443378+0000", 2024-09-13T06:43:18.143 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 201.671042718, 2024-09-13T06:43:18.143 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089324107, 2024-09-13T06:43:18.143 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:18.143 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:18.143 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:18.144 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:18.144 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:18.144 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25741 2024-09-13T06:43:18.144 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:18.144 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:18.144 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:18.144 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:18.144 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443378+0000", 2024-09-13T06:43:18.144 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:18.144 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:18.144 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:18.144 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:18.145 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443378+0000", 2024-09-13T06:43:18.145 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:18.145 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:18.145 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:18.145 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:18.145 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443378+0000", 2024-09-13T06:43:18.145 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:18.145 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:18.145 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:18.145 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:18.145 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443380+0000", 2024-09-13T06:43:18.145 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3549999999999999e-06 2024-09-13T06:43:18.145 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:18.146 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:18.146 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:18.146 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443388+0000", 2024-09-13T06:43:18.146 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.7449999999999995e-06 2024-09-13T06:43:18.146 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:18.146 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:18.146 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:18.146 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443393+0000", 2024-09-13T06:43:18.146 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.4e-06 2024-09-13T06:43:18.146 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:18.146 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:18.146 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:18.146 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532454+0000", 2024-09-13T06:43:18.147 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089060941000000005 2024-09-13T06:43:18.147 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:18.147 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:18.147 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:18.147 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532512+0000", 2024-09-13T06:43:18.147 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7763000000000002e-05 2024-09-13T06:43:18.147 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:18.147 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:18.147 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:18.147 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532703+0000", 2024-09-13T06:43:18.147 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000190328 2024-09-13T06:43:18.147 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:18.148 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:18.148 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:18.148 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:18.148 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:18.148 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25742 3.18 3:1c662b96:::rbd_data.1121f2c5ee81.0000000000000010:13 [read 270336~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:43:18.148 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443398+0000", 2024-09-13T06:43:18.148 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 201.67102300600001, 2024-09-13T06:43:18.148 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089621836999999996, 2024-09-13T06:43:18.148 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:18.148 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:18.148 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:18.148 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:18.148 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:18.149 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25742 2024-09-13T06:43:18.149 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:18.149 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:18.149 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:18.149 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:18.149 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443398+0000", 2024-09-13T06:43:18.149 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:18.149 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:18.149 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:18.149 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:18.149 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443398+0000", 2024-09-13T06:43:18.149 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:18.149 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:18.150 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:18.150 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:18.150 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443398+0000", 2024-09-13T06:43:18.150 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:18.150 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:18.150 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:18.150 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:18.150 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443400+0000", 2024-09-13T06:43:18.150 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1849999999999998e-06 2024-09-13T06:43:18.150 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:18.150 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:18.150 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:18.150 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443407+0000", 2024-09-13T06:43:18.150 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3669999999999999e-06 2024-09-13T06:43:18.151 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:18.151 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:18.151 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:18.151 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443420+0000", 2024-09-13T06:43:18.151 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2645e-05 2024-09-13T06:43:18.151 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:18.151 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:18.151 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:18.151 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532742+0000", 2024-09-13T06:43:18.151 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089322200000000004 2024-09-13T06:43:18.151 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:18.151 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:18.151 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:18.151 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532818+0000", 2024-09-13T06:43:18.152 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.6019000000000005e-05 2024-09-13T06:43:18.152 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:18.152 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:18.152 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:18.152 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533020+0000", 2024-09-13T06:43:18.152 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000201721 2024-09-13T06:43:18.152 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:18.152 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:18.152 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:18.152 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:18.152 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:18.152 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25743 3.18 3:1c662b96:::rbd_data.1121f2c5ee81.0000000000000010:13 [read 294912~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:43:18.152 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443425+0000", 2024-09-13T06:43:18.153 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 201.670995998, 2024-09-13T06:43:18.153 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089864075000000002, 2024-09-13T06:43:18.153 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:18.153 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:18.153 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:18.153 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:18.153 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:18.153 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25743 2024-09-13T06:43:18.153 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:18.153 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:18.153 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:18.153 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:18.154 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443425+0000", 2024-09-13T06:43:18.154 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:18.154 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:18.154 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:18.154 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:18.154 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443425+0000", 2024-09-13T06:43:18.154 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:18.154 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:18.154 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:18.154 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:18.154 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443425+0000", 2024-09-13T06:43:18.154 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:18.154 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:18.154 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:18.155 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:18.155 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443432+0000", 2024-09-13T06:43:18.155 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3420000000000002e-06 2024-09-13T06:43:18.155 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:18.155 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:18.155 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:18.155 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443440+0000", 2024-09-13T06:43:18.155 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5689999999999999e-06 2024-09-13T06:43:18.155 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:18.155 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:18.155 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:18.155 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443445+0000", 2024-09-13T06:43:18.155 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9590000000000003e-06 2024-09-13T06:43:18.156 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:18.156 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:18.156 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:18.156 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533063+0000", 2024-09-13T06:43:18.156 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089617988999999995 2024-09-13T06:43:18.156 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:18.156 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:18.156 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:18.156 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533122+0000", 2024-09-13T06:43:18.156 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9052999999999999e-05 2024-09-13T06:43:18.156 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:18.156 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:18.156 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:18.156 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533289+0000", 2024-09-13T06:43:18.157 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00016752800000000001 2024-09-13T06:43:18.157 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:18.157 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:18.157 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:18.157 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:18.157 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:18.157 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25744 3.18 3.69d46638 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:43:18.157 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443449+0000", 2024-09-13T06:43:18.157 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 201.67097185099999, 2024-09-13T06:43:18.157 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089869148999999995, 2024-09-13T06:43:18.157 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:18.157 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:43:18.157 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:18.158 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:18.158 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:18.158 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25744 2024-09-13T06:43:18.158 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:18.158 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:18.158 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:18.158 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:18.158 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443449+0000", 2024-09-13T06:43:18.158 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:18.158 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:18.158 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:18.158 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:18.158 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443449+0000", 2024-09-13T06:43:18.159 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:18.159 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:18.159 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:18.159 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:18.159 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443449+0000", 2024-09-13T06:43:18.159 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:18.159 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:18.159 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:18.159 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:18.159 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443451+0000", 2024-09-13T06:43:18.159 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.244e-06 2024-09-13T06:43:18.159 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:18.160 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:18.160 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:18.160 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443457+0000", 2024-09-13T06:43:18.160 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.66e-06 2024-09-13T06:43:18.160 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:18.160 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:18.160 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:18.160 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443461+0000", 2024-09-13T06:43:18.160 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5449999999999997e-06 2024-09-13T06:43:18.160 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:18.160 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:18.160 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:18.160 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533311+0000", 2024-09-13T06:43:18.161 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089849729000000003 2024-09-13T06:43:18.161 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:18.161 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:18.161 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:18.161 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533318+0000", 2024-09-13T06:43:18.161 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.328e-06 2024-09-13T06:43:18.161 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:18.161 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:18.161 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:18.161 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:18.161 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:18.161 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25745 3.18 3.69d46638 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:43:18.161 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443466+0000", 2024-09-13T06:43:18.162 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 201.67095479299999, 2024-09-13T06:43:18.162 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089886743000000005, 2024-09-13T06:43:18.162 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:18.162 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:43:18.162 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:18.162 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:18.162 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:18.162 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25745 2024-09-13T06:43:18.162 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:18.162 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:18.162 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:18.162 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:18.162 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443466+0000", 2024-09-13T06:43:18.163 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:18.163 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:18.163 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:18.163 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:18.163 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443466+0000", 2024-09-13T06:43:18.163 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:18.163 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:18.163 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:18.163 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:18.163 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443466+0000", 2024-09-13T06:43:18.163 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:18.163 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:18.163 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:18.164 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:18.164 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443474+0000", 2024-09-13T06:43:18.164 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.1289999999999996e-06 2024-09-13T06:43:18.164 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:18.164 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:18.164 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:18.164 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443484+0000", 2024-09-13T06:43:18.164 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0654e-05 2024-09-13T06:43:18.164 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:18.164 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:18.164 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:18.164 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443490+0000", 2024-09-13T06:43:18.164 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8030000000000002e-06 2024-09-13T06:43:18.165 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:18.165 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:18.165 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:18.165 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533348+0000", 2024-09-13T06:43:18.165 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089857267000000005 2024-09-13T06:43:18.165 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:18.165 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:18.165 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:18.165 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533353+0000", 2024-09-13T06:43:18.165 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.5520000000000004e-06 2024-09-13T06:43:18.165 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:18.165 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:18.165 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:18.166 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:18.166 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:18.166 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25746 3.18 3.69d46638 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:43:18.166 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443495+0000", 2024-09-13T06:43:18.166 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 201.67092568000001, 2024-09-13T06:43:18.166 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089903725000000004, 2024-09-13T06:43:18.166 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:18.166 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:43:18.166 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:18.166 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:18.166 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:18.166 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25746 2024-09-13T06:43:18.166 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:18.167 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:18.167 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:18.167 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:18.167 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443495+0000", 2024-09-13T06:43:18.167 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:18.167 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:18.167 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:18.167 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:18.167 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443495+0000", 2024-09-13T06:43:18.167 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:18.167 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:18.167 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:18.167 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:18.167 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443495+0000", 2024-09-13T06:43:18.168 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:18.168 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:18.168 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:18.168 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:18.168 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443498+0000", 2024-09-13T06:43:18.168 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.7690000000000001e-06 2024-09-13T06:43:18.168 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:18.168 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:18.168 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:18.168 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443504+0000", 2024-09-13T06:43:18.168 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9710000000000001e-06 2024-09-13T06:43:18.168 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:18.168 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:18.169 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:18.169 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443508+0000", 2024-09-13T06:43:18.169 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4159999999999997e-06 2024-09-13T06:43:18.169 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:18.169 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:18.169 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:18.169 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533391+0000", 2024-09-13T06:43:18.169 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089882607000000003 2024-09-13T06:43:18.169 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:18.169 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:18.169 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:18.169 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533399+0000", 2024-09-13T06:43:18.170 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.4349999999999997e-06 2024-09-13T06:43:18.170 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:18.170 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:18.170 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:18.170 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:18.170 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:18.170 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25747 3.8 3.63996268 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:43:18.170 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443512+0000", 2024-09-13T06:43:18.170 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 201.67090894899999, 2024-09-13T06:43:18.170 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089880075000000004, 2024-09-13T06:43:18.170 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:18.170 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:43:18.170 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:18.170 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:18.171 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:18.171 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25747 2024-09-13T06:43:18.171 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:18.171 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:18.171 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:18.171 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:18.171 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443512+0000", 2024-09-13T06:43:18.171 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:18.171 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:18.171 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:18.171 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:18.171 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443512+0000", 2024-09-13T06:43:18.171 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:18.171 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:18.172 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:18.172 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:18.172 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443512+0000", 2024-09-13T06:43:18.172 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:18.172 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:18.172 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:18.172 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:18.172 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443514+0000", 2024-09-13T06:43:18.172 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0980000000000001e-06 2024-09-13T06:43:18.172 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:18.172 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:18.172 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:18.172 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443520+0000", 2024-09-13T06:43:18.173 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7069999999999997e-06 2024-09-13T06:43:18.173 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:18.173 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:18.173 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:18.173 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443524+0000", 2024-09-13T06:43:18.173 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5390000000000001e-06 2024-09-13T06:43:18.173 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:18.173 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:18.173 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:18.173 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533384+0000", 2024-09-13T06:43:18.173 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089859684999999995 2024-09-13T06:43:18.173 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:18.174 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:18.174 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:18.174 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533392+0000", 2024-09-13T06:43:18.174 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.3440000000000001e-06 2024-09-13T06:43:18.174 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:18.174 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:18.174 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:18.174 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:18.174 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:18.174 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25748 3.8 3.63996268 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:43:18.174 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443528+0000", 2024-09-13T06:43:18.174 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 201.67089282200001, 2024-09-13T06:43:18.174 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089890715999999996, 2024-09-13T06:43:18.175 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:18.175 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:43:18.175 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:18.175 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:18.175 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:18.175 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25748 2024-09-13T06:43:18.175 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:18.175 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:18.175 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:18.175 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:18.175 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443528+0000", 2024-09-13T06:43:18.175 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:18.175 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:18.176 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:18.176 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:18.176 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443528+0000", 2024-09-13T06:43:18.176 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:18.176 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:18.176 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:18.176 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:18.176 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443528+0000", 2024-09-13T06:43:18.176 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:18.176 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:18.176 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:18.176 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:18.177 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443530+0000", 2024-09-13T06:43:18.177 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0650000000000001e-06 2024-09-13T06:43:18.177 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:18.177 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:18.177 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:18.177 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443536+0000", 2024-09-13T06:43:18.177 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7259999999999999e-06 2024-09-13T06:43:18.177 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:18.177 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:18.177 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:18.177 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443540+0000", 2024-09-13T06:43:18.177 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5009999999999998e-06 2024-09-13T06:43:18.177 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:18.178 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:18.178 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:18.178 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533412+0000", 2024-09-13T06:43:18.178 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089871873000000005 2024-09-13T06:43:18.178 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:18.178 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:18.178 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:18.178 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533419+0000", 2024-09-13T06:43:18.178 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.883e-06 2024-09-13T06:43:18.178 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:18.178 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:18.178 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:18.178 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:18.178 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:18.179 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25749 3.8 3.63996268 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:43:18.179 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443545+0000", 2024-09-13T06:43:18.179 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 201.67087662599999, 2024-09-13T06:43:18.179 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089897988999999998, 2024-09-13T06:43:18.179 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:18.179 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:43:18.179 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:18.179 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:18.179 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:18.179 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25749 2024-09-13T06:43:18.179 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:18.179 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:18.179 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:18.179 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:18.180 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443545+0000", 2024-09-13T06:43:18.180 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:18.180 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:18.180 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:18.180 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:18.180 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443545+0000", 2024-09-13T06:43:18.180 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:18.180 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:18.180 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:18.180 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:18.180 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443544+0000", 2024-09-13T06:43:18.180 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:18.180 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:18.180 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:18.180 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:18.181 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443553+0000", 2024-09-13T06:43:18.181 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.4770000000000003e-06 2024-09-13T06:43:18.181 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:18.181 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:18.181 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:18.181 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443564+0000", 2024-09-13T06:43:18.181 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0986e-05 2024-09-13T06:43:18.181 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:18.181 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:18.181 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:18.181 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443569+0000", 2024-09-13T06:43:18.181 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2530000000000004e-06 2024-09-13T06:43:18.181 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:18.182 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:18.182 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:18.182 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533438+0000", 2024-09-13T06:43:18.182 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089868641999999999 2024-09-13T06:43:18.182 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:18.182 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:18.182 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:18.182 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533442+0000", 2024-09-13T06:43:18.182 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.989e-06 2024-09-13T06:43:18.182 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:18.182 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:18.182 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:18.182 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:18.183 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:18.183 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25750 3.8 3.63996268 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:43:18.183 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443574+0000", 2024-09-13T06:43:18.183 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 201.67084714000001, 2024-09-13T06:43:18.183 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089895143999999996, 2024-09-13T06:43:18.183 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:18.183 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:43:18.183 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:18.183 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:18.183 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:18.183 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25750 2024-09-13T06:43:18.183 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:18.183 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:18.184 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:18.184 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:18.184 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443574+0000", 2024-09-13T06:43:18.184 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:18.184 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:18.184 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:18.184 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:18.184 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443574+0000", 2024-09-13T06:43:18.184 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:18.184 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:18.184 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:18.184 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:18.184 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443574+0000", 2024-09-13T06:43:18.184 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:18.185 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:18.185 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:18.185 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:18.185 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443576+0000", 2024-09-13T06:43:18.185 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6910000000000002e-06 2024-09-13T06:43:18.185 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:18.185 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:18.185 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:18.185 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443583+0000", 2024-09-13T06:43:18.185 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.331e-06 2024-09-13T06:43:18.185 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:18.185 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:18.185 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:18.185 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443587+0000", 2024-09-13T06:43:18.185 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6129999999999997e-06 2024-09-13T06:43:18.186 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:18.186 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:18.186 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:18.186 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533464+0000", 2024-09-13T06:43:18.186 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089876605999999998 2024-09-13T06:43:18.186 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:18.186 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:18.186 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:18.186 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533469+0000", 2024-09-13T06:43:18.186 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3909999999999997e-06 2024-09-13T06:43:18.186 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:18.186 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:18.186 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:18.186 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:18.187 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:18.187 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25751 3.8 3.63996268 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:43:18.187 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443592+0000", 2024-09-13T06:43:18.187 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 201.670829443, 2024-09-13T06:43:18.187 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089913650999999997, 2024-09-13T06:43:18.187 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:18.187 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:43:18.187 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:18.187 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:18.187 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:18.187 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25751 2024-09-13T06:43:18.187 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:18.187 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:18.187 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:18.188 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:18.188 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443592+0000", 2024-09-13T06:43:18.188 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:18.188 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:18.188 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:18.188 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:18.188 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443592+0000", 2024-09-13T06:43:18.188 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:18.188 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:18.188 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:18.188 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:18.188 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443591+0000", 2024-09-13T06:43:18.188 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:18.188 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:18.189 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:18.189 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:18.189 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443594+0000", 2024-09-13T06:43:18.189 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3649999999999998e-06 2024-09-13T06:43:18.189 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:18.189 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:18.189 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:18.189 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443599+0000", 2024-09-13T06:43:18.189 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.699e-06 2024-09-13T06:43:18.189 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:18.189 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:18.189 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:18.189 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443611+0000", 2024-09-13T06:43:18.190 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1503e-05 2024-09-13T06:43:18.190 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:18.190 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:18.190 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:18.190 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533497+0000", 2024-09-13T06:43:18.190 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089886453000000005 2024-09-13T06:43:18.190 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:18.190 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:18.190 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:18.190 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533505+0000", 2024-09-13T06:43:18.190 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.9910000000000002e-06 2024-09-13T06:43:18.190 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:18.190 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:18.190 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:18.191 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:18.191 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:18.191 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25752 3.8 3.63996268 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:43:18.191 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443615+0000", 2024-09-13T06:43:18.191 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 201.67080566199999, 2024-09-13T06:43:18.191 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089905868999999999, 2024-09-13T06:43:18.191 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:18.191 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:43:18.191 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:18.191 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:18.191 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:18.191 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25752 2024-09-13T06:43:18.191 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:18.191 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:18.192 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:18.192 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:18.192 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443615+0000", 2024-09-13T06:43:18.192 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:18.192 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:18.192 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:18.192 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:18.192 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443615+0000", 2024-09-13T06:43:18.192 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:18.192 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:18.192 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:18.192 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:18.192 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443615+0000", 2024-09-13T06:43:18.193 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:18.193 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:18.193 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:18.193 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:18.193 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443617+0000", 2024-09-13T06:43:18.193 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3539999999999998e-06 2024-09-13T06:43:18.193 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:18.193 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:18.193 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:18.193 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443624+0000", 2024-09-13T06:43:18.193 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3600000000000001e-06 2024-09-13T06:43:18.193 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:18.194 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:18.194 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:18.194 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443628+0000", 2024-09-13T06:43:18.194 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.2350000000000001e-06 2024-09-13T06:43:18.194 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:18.194 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:18.194 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:18.194 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533517+0000", 2024-09-13T06:43:18.194 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089889029999999995 2024-09-13T06:43:18.194 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:18.194 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:18.194 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:18.194 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533521+0000", 2024-09-13T06:43:18.195 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.2529999999999998e-06 2024-09-13T06:43:18.195 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:18.195 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:18.195 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:18.195 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:18.195 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:18.195 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:64356 3.c 3:32785be9:::rbd_header.11218ba71f0d:head [watch reconnect cookie 140361410387072 gen 2] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e95)", 2024-09-13T06:43:18.195 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:48.473318+0000", 2024-09-13T06:43:18.195 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 149.64110326900001, 2024-09-13T06:43:18.195 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1458904379999999, 2024-09-13T06:43:18.195 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:18.195 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:18.195 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:18.195 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:18.196 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:18.196 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 64356 2024-09-13T06:43:18.196 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:18.196 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:18.196 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:18.196 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:18.196 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:48.473318+0000", 2024-09-13T06:43:18.196 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:18.196 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:18.196 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:18.196 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:18.196 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:48.473318+0000", 2024-09-13T06:43:18.197 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:18.197 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:18.197 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:18.197 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:18.197 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:48.473315+0000", 2024-09-13T06:43:18.197 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999971 2024-09-13T06:43:18.197 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:18.197 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:18.197 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:18.197 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:48.473329+0000", 2024-09-13T06:43:18.197 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.433e-05 2024-09-13T06:43:18.197 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:18.197 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:18.197 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:18.198 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:48.473363+0000", 2024-09-13T06:43:18.198 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.3592e-05 2024-09-13T06:43:18.198 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:18.198 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:18.198 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:18.198 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:48.473386+0000", 2024-09-13T06:43:18.198 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2708999999999999e-05 2024-09-13T06:43:18.198 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:18.198 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:18.198 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:18.198 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:48.473804+0000", 2024-09-13T06:43:18.198 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00041789399999999998 2024-09-13T06:43:18.199 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:18.199 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:18.199 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:43:18.199 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:48.473830+0000", 2024-09-13T06:43:18.199 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6869e-05 2024-09-13T06:43:18.199 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:18.199 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:18.199 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:18.199 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:49.614332+0000", 2024-09-13T06:43:18.199 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.140501107 2024-09-13T06:43:18.199 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:18.199 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:18.199 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for rw locks", 2024-09-13T06:43:18.200 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:49.614496+0000", 2024-09-13T06:43:18.200 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00016451200000000001 2024-09-13T06:43:18.200 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:18.200 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:18.200 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:18.200 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:49.617131+0000", 2024-09-13T06:43:18.200 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.002634843 2024-09-13T06:43:18.200 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:18.200 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:18.200 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:18.200 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:49.617204+0000", 2024-09-13T06:43:18.200 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.2991000000000006e-05 2024-09-13T06:43:18.200 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:18.201 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:18.201 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:18.201 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:49.619208+0000", 2024-09-13T06:43:18.201 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.002004381 2024-09-13T06:43:18.201 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:18.201 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:18.201 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:18.201 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:18.201 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:18.201 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:170155 3.7 3:e17728eb:::image_client.0-clone36.rbd:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e191)", 2024-09-13T06:43:18.201 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:42:31.436412+0000", 2024-09-13T06:43:18.201 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 46.678009445999997, 2024-09-13T06:43:18.202 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.97843703800000004, 2024-09-13T06:43:18.202 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:18.202 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:43:18.202 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:18.202 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:18.202 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:18.202 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 170155 2024-09-13T06:43:18.202 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:18.202 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:18.202 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:18.202 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:18.202 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:31.436412+0000", 2024-09-13T06:43:18.202 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:18.202 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:18.203 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:18.203 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:18.203 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:31.436412+0000", 2024-09-13T06:43:18.203 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:18.203 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:18.203 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:18.203 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:18.203 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:31.436410+0000", 2024-09-13T06:43:18.203 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999986 2024-09-13T06:43:18.203 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:18.203 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:18.203 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:18.203 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:31.436417+0000", 2024-09-13T06:43:18.204 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.6939999999999998e-06 2024-09-13T06:43:18.204 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:18.204 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:18.204 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:18.204 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:31.436430+0000", 2024-09-13T06:43:18.204 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3016999999999999e-05 2024-09-13T06:43:18.204 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:18.204 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:18.204 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:18.204 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:31.436437+0000", 2024-09-13T06:43:18.204 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.1069999999999999e-06 2024-09-13T06:43:18.204 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:18.204 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:18.204 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:18.205 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:31.436515+0000", 2024-09-13T06:43:18.205 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.7756000000000006e-05 2024-09-13T06:43:18.205 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:18.205 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:18.205 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:43:18.205 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:31.436523+0000", 2024-09-13T06:43:18.205 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.4970000000000001e-06 2024-09-13T06:43:18.205 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:18.205 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:18.205 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:18.205 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:32.414565+0000", 2024-09-13T06:43:18.205 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.97804144199999998 2024-09-13T06:43:18.206 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:18.206 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:18.206 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:18.206 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:32.414849+0000", 2024-09-13T06:43:18.206 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00028388600000000001 2024-09-13T06:43:18.206 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:18.206 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:18.206 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:18.206 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:18.206 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:18.206 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:43:18.208 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-13T06:43:18.208 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:43:18.208+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:43:18.309 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:43:18.308+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:43:18.338 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:43:18.339 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [], 2024-09-13T06:43:18.339 INFO:teuthology.orchestra.run.smithi139.stdout: "num_ops": 0 2024-09-13T06:43:18.339 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:43:18.354 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-13T06:43:18.410 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-13T06:43:18.409+0000 7fa8bb18e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 36790) UID: 0 2024-09-13T06:43:18.478 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:43:18.478 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [], 2024-09-13T06:43:18.478 INFO:teuthology.orchestra.run.smithi139.stdout: "complaint_time": 30, 2024-09-13T06:43:18.478 INFO:teuthology.orchestra.run.smithi139.stdout: "num_blocked_ops": 0 2024-09-13T06:43:18.478 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:43:18.495 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-13T06:43:18.536 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-13T06:43:18.537+0000 7fa8bb18e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 36790) UID: 0 2024-09-13T06:43:18.611 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:43:18.612+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:43:18.667 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:43:18.667 INFO:teuthology.orchestra.run.smithi139.stdout: "size": 20, 2024-09-13T06:43:18.667 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 600, 2024-09-13T06:43:18.667 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [ 2024-09-13T06:43:18.668 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:18.668 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:160483 3.a 3:57f62123:::rbd_header.112138ed422:head [watch reconnect cookie 140361344088384 gen 3] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e177)", 2024-09-13T06:43:18.668 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:42:17.439011+0000", 2024-09-13T06:43:18.668 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 61.226192771999997, 2024-09-13T06:43:18.668 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.155518861, 2024-09-13T06:43:18.668 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:18.668 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:18.668 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:18.668 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:18.668 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:18.668 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 160483 2024-09-13T06:43:18.668 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:18.668 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:18.669 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:18.669 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:18.669 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:17.439011+0000", 2024-09-13T06:43:18.669 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:18.669 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:18.669 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:18.669 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:18.669 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:17.439011+0000", 2024-09-13T06:43:18.669 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:18.669 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:18.669 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:18.669 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:18.670 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:17.439009+0000", 2024-09-13T06:43:18.670 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999976 2024-09-13T06:43:18.670 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:18.670 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:18.670 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:18.670 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:17.439024+0000", 2024-09-13T06:43:18.670 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.464e-05 2024-09-13T06:43:18.670 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:18.670 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:18.670 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:18.670 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:17.439058+0000", 2024-09-13T06:43:18.670 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.4712999999999998e-05 2024-09-13T06:43:18.670 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:18.671 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:18.671 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:18.671 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:17.439085+0000", 2024-09-13T06:43:18.671 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.6216000000000001e-05 2024-09-13T06:43:18.671 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:18.671 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:18.671 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:18.671 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:17.439182+0000", 2024-09-13T06:43:18.671 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.7020000000000003e-05 2024-09-13T06:43:18.671 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:18.671 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:18.671 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:43:18.671 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:17.439204+0000", 2024-09-13T06:43:18.672 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.2276000000000002e-05 2024-09-13T06:43:18.672 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:18.672 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:18.672 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:18.672 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:18.588627+0000", 2024-09-13T06:43:18.672 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1494235829999999 2024-09-13T06:43:18.672 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:18.672 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:18.672 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for rw locks", 2024-09-13T06:43:18.672 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:18.589031+0000", 2024-09-13T06:43:18.672 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0004035 2024-09-13T06:43:18.672 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:18.673 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:18.673 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:18.673 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:18.590604+0000", 2024-09-13T06:43:18.673 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.001573234 2024-09-13T06:43:18.673 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:18.673 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:18.673 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:18.673 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:18.590791+0000", 2024-09-13T06:43:18.673 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000186701 2024-09-13T06:43:18.673 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:18.673 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:18.673 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:18.674 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:18.594530+0000", 2024-09-13T06:43:18.674 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0037394250000000002 2024-09-13T06:43:18.674 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:18.674 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:18.674 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:18.674 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:18.674 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:18.674 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:208355 3.14 3:2d339b7f:::rbd_data.1121cb4a09ed.0000000000000003:snapdir [list-snaps] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e219)", 2024-09-13T06:43:18.674 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:43:03.420412+0000", 2024-09-13T06:43:18.674 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 15.244792636, 2024-09-13T06:43:18.674 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.705233864, 2024-09-13T06:43:18.675 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:18.675 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:18.675 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:18.675 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:18.675 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:18.675 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 208355 2024-09-13T06:43:18.675 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:18.675 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:18.675 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:18.675 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:18.675 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420412+0000", 2024-09-13T06:43:18.675 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:18.675 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:18.675 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:18.676 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:18.676 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420412+0000", 2024-09-13T06:43:18.676 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:18.676 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:18.676 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:18.676 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:18.676 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420409+0000", 2024-09-13T06:43:18.676 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999981 2024-09-13T06:43:18.676 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:18.676 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:18.676 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:18.676 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420420+0000", 2024-09-13T06:43:18.676 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0716e-05 2024-09-13T06:43:18.677 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:18.677 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:18.677 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:18.677 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420440+0000", 2024-09-13T06:43:18.677 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.9850000000000001e-05 2024-09-13T06:43:18.677 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:18.677 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:18.677 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:18.677 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420456+0000", 2024-09-13T06:43:18.677 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5667000000000001e-05 2024-09-13T06:43:18.677 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:18.677 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:18.677 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:18.678 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420724+0000", 2024-09-13T06:43:18.678 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00026873400000000002 2024-09-13T06:43:18.678 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:18.678 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:18.678 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:43:18.678 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420740+0000", 2024-09-13T06:43:18.678 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5486999999999999e-05 2024-09-13T06:43:18.678 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:18.678 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:18.678 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:18.678 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.125004+0000", 2024-09-13T06:43:18.678 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7042643119999998 2024-09-13T06:43:18.678 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:18.678 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:18.679 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:18.679 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.125293+0000", 2024-09-13T06:43:18.679 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000288664 2024-09-13T06:43:18.679 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:18.679 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:18.679 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:18.679 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.125645+0000", 2024-09-13T06:43:18.679 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00035247700000000002 2024-09-13T06:43:18.679 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:18.679 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:18.679 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:18.679 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:18.679 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:18.679 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:208362 3.14 3:2d339b7f:::rbd_data.1121cb4a09ed.0000000000000003:snapdir [list-snaps] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e219)", 2024-09-13T06:43:18.679 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:43:03.420469+0000", 2024-09-13T06:43:18.679 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 15.244735159999999, 2024-09-13T06:43:18.680 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.706123917, 2024-09-13T06:43:18.680 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:18.680 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:18.680 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:18.680 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:18.680 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:18.680 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 208362 2024-09-13T06:43:18.680 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:18.680 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:18.680 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:18.680 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:18.680 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420469+0000", 2024-09-13T06:43:18.680 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:18.681 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:18.681 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:18.681 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:18.681 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420469+0000", 2024-09-13T06:43:18.681 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:18.681 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:18.681 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:18.681 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:18.681 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420468+0000", 2024-09-13T06:43:18.681 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:18.681 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:18.681 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:18.681 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:18.682 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420473+0000", 2024-09-13T06:43:18.682 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.7099999999999998e-06 2024-09-13T06:43:18.682 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:18.682 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:18.682 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:18.682 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420483+0000", 2024-09-13T06:43:18.682 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.7960000000000007e-06 2024-09-13T06:43:18.682 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:18.682 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:18.682 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:18.682 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420491+0000", 2024-09-13T06:43:18.682 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.8169999999999999e-06 2024-09-13T06:43:18.682 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:18.683 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:18.683 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:18.683 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420829+0000", 2024-09-13T06:43:18.683 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000338494 2024-09-13T06:43:18.683 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:18.683 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:18.683 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:43:18.683 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420857+0000", 2024-09-13T06:43:18.683 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.8140000000000002e-05 2024-09-13T06:43:18.683 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:18.683 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:18.683 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:18.683 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.126086+0000", 2024-09-13T06:43:18.684 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7052288369999999 2024-09-13T06:43:18.684 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:18.684 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:18.684 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:18.684 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.126269+0000", 2024-09-13T06:43:18.684 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000183301 2024-09-13T06:43:18.684 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:18.684 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:18.684 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:18.684 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.126593+0000", 2024-09-13T06:43:18.684 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00032352800000000001 2024-09-13T06:43:18.684 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:18.684 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:18.684 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:18.685 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:18.685 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:18.685 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:208369 3.14 3:2d339b7f:::rbd_data.1121cb4a09ed.0000000000000003:snapdir [list-snaps] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e219)", 2024-09-13T06:43:18.685 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:43:03.420498+0000", 2024-09-13T06:43:18.685 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 15.244706116, 2024-09-13T06:43:18.685 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.706613895, 2024-09-13T06:43:18.685 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:18.685 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:18.685 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:18.685 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:18.685 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:18.685 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 208369 2024-09-13T06:43:18.685 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:18.685 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:18.686 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:18.686 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:18.686 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420498+0000", 2024-09-13T06:43:18.686 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:18.686 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:18.686 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:18.686 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:18.686 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420498+0000", 2024-09-13T06:43:18.686 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:18.686 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:18.686 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:18.686 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:18.686 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420497+0000", 2024-09-13T06:43:18.687 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:18.687 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:18.687 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:18.687 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:18.687 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420501+0000", 2024-09-13T06:43:18.687 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.737e-06 2024-09-13T06:43:18.687 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:18.687 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:18.687 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:18.687 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420522+0000", 2024-09-13T06:43:18.687 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.1152999999999999e-05 2024-09-13T06:43:18.687 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:18.687 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:18.687 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:18.687 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420533+0000", 2024-09-13T06:43:18.688 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0366999999999999e-05 2024-09-13T06:43:18.688 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:18.688 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:18.688 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:18.688 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420968+0000", 2024-09-13T06:43:18.688 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00043495900000000001 2024-09-13T06:43:18.688 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:18.688 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:18.688 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:43:18.688 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420977+0000", 2024-09-13T06:43:18.688 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.8039999999999996e-06 2024-09-13T06:43:18.688 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:18.688 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:18.689 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:18.689 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.126670+0000", 2024-09-13T06:43:18.689 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7056928760000001 2024-09-13T06:43:18.689 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:18.689 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:18.689 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:18.689 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.126833+0000", 2024-09-13T06:43:18.689 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00016253200000000001 2024-09-13T06:43:18.689 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:18.689 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:18.689 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:18.689 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.127112+0000", 2024-09-13T06:43:18.689 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000279141 2024-09-13T06:43:18.689 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:18.690 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:18.690 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:18.690 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:18.690 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:18.690 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:208376 3.14 3:2d339b7f:::rbd_data.1121cb4a09ed.0000000000000003:snapdir [list-snaps] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e219)", 2024-09-13T06:43:18.690 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:43:03.420541+0000", 2024-09-13T06:43:18.690 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 15.24466286, 2024-09-13T06:43:18.690 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7070606820000001, 2024-09-13T06:43:18.690 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:18.690 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:18.690 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:18.690 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:18.690 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:18.690 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 208376 2024-09-13T06:43:18.691 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:18.691 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:18.691 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:18.691 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:18.691 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420541+0000", 2024-09-13T06:43:18.691 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:18.691 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:18.691 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:18.691 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:18.691 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420541+0000", 2024-09-13T06:43:18.691 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:18.691 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:18.691 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:18.691 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:18.692 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420541+0000", 2024-09-13T06:43:18.692 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:18.692 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:18.692 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:18.692 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:18.692 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420544+0000", 2024-09-13T06:43:18.692 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.5530000000000001e-06 2024-09-13T06:43:18.692 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:18.692 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:18.692 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:18.692 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420557+0000", 2024-09-13T06:43:18.692 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2663000000000001e-05 2024-09-13T06:43:18.692 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:18.693 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:18.693 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:18.693 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420572+0000", 2024-09-13T06:43:18.693 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5463000000000001e-05 2024-09-13T06:43:18.693 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:18.693 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:18.693 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:18.693 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.421070+0000", 2024-09-13T06:43:18.693 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00049723599999999997 2024-09-13T06:43:18.693 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:18.693 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:18.693 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:43:18.693 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.421092+0000", 2024-09-13T06:43:18.693 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.2354e-05 2024-09-13T06:43:18.694 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:18.694 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:18.694 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:18.694 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.127184+0000", 2024-09-13T06:43:18.694 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7060917330000001 2024-09-13T06:43:18.694 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:18.694 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:18.694 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:18.694 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.127340+0000", 2024-09-13T06:43:18.694 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00015640200000000001 2024-09-13T06:43:18.694 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:18.694 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:18.694 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:18.694 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.127602+0000", 2024-09-13T06:43:18.695 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00026192799999999998 2024-09-13T06:43:18.695 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:18.695 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:18.695 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:18.695 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:18.695 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:18.695 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:208383 3.14 3:2d339b7f:::rbd_data.1121cb4a09ed.0000000000000003:snapdir [list-snaps] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e219)", 2024-09-13T06:43:18.695 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:43:03.420585+0000", 2024-09-13T06:43:18.695 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 15.244619007000001, 2024-09-13T06:43:18.695 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.707457405, 2024-09-13T06:43:18.695 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:18.695 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:18.695 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:18.695 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:18.695 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:18.696 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 208383 2024-09-13T06:43:18.696 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:18.696 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:18.696 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:18.696 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:18.696 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420585+0000", 2024-09-13T06:43:18.696 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:18.696 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:18.696 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:18.696 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:18.696 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420585+0000", 2024-09-13T06:43:18.696 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:18.696 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:18.696 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:18.697 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:18.697 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420584+0000", 2024-09-13T06:43:18.697 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:43:18.697 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:18.697 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:18.697 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:18.697 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420614+0000", 2024-09-13T06:43:18.697 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.9886000000000002e-05 2024-09-13T06:43:18.697 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:18.697 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:18.697 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:18.697 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420640+0000", 2024-09-13T06:43:18.697 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.5663000000000001e-05 2024-09-13T06:43:18.698 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:18.698 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:18.698 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:18.698 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420669+0000", 2024-09-13T06:43:18.698 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.9289999999999999e-05 2024-09-13T06:43:18.698 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:18.698 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:18.698 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:18.698 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.421168+0000", 2024-09-13T06:43:18.698 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00049857600000000003 2024-09-13T06:43:18.698 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:18.698 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:18.698 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:43:18.698 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.421177+0000", 2024-09-13T06:43:18.698 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.533e-06 2024-09-13T06:43:18.699 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:18.699 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:18.699 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:18.699 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.127648+0000", 2024-09-13T06:43:18.699 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7064713569999999 2024-09-13T06:43:18.699 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:18.699 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:18.699 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:18.699 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.127794+0000", 2024-09-13T06:43:18.699 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00014589200000000001 2024-09-13T06:43:18.699 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:18.699 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:18.699 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:18.699 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.128043+0000", 2024-09-13T06:43:18.700 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00024821799999999997 2024-09-13T06:43:18.700 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:18.700 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:18.700 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:18.700 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:18.700 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:18.700 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:208390 3.14 3:2d339b7f:::rbd_data.1121cb4a09ed.0000000000000003:snapdir [list-snaps] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e219)", 2024-09-13T06:43:18.700 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:43:03.420713+0000", 2024-09-13T06:43:18.700 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 15.244491048, 2024-09-13T06:43:18.700 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7077568059999999, 2024-09-13T06:43:18.700 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:18.700 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:18.700 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:18.700 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:18.700 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:18.701 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 208390 2024-09-13T06:43:18.701 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:18.701 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:18.701 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:18.701 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:18.701 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420713+0000", 2024-09-13T06:43:18.701 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:18.701 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:18.701 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:18.701 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:18.701 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420713+0000", 2024-09-13T06:43:18.701 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:18.701 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:18.701 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:18.701 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:18.702 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420712+0000", 2024-09-13T06:43:18.702 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:43:18.702 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:18.702 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:18.702 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:18.702 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420719+0000", 2024-09-13T06:43:18.702 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.883e-06 2024-09-13T06:43:18.702 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:18.702 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:18.702 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:18.702 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420737+0000", 2024-09-13T06:43:18.702 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.8082999999999999e-05 2024-09-13T06:43:18.702 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:18.702 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:18.703 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:18.703 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420757+0000", 2024-09-13T06:43:18.703 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.0256999999999999e-05 2024-09-13T06:43:18.703 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:18.703 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:18.703 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:18.703 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.421258+0000", 2024-09-13T06:43:18.703 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00050028500000000005 2024-09-13T06:43:18.703 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:18.703 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:18.703 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:43:18.703 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.421282+0000", 2024-09-13T06:43:18.703 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.4236999999999999e-05 2024-09-13T06:43:18.703 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:18.704 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:18.704 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:18.704 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.128087+0000", 2024-09-13T06:43:18.704 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.706805551 2024-09-13T06:43:18.704 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:18.704 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:18.704 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:18.704 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.128231+0000", 2024-09-13T06:43:18.704 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00014348200000000001 2024-09-13T06:43:18.704 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:18.704 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:18.704 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:18.704 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.128470+0000", 2024-09-13T06:43:18.704 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000239058 2024-09-13T06:43:18.705 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:18.705 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:18.705 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:18.705 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:18.705 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:18.705 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:208397 3.14 3:2d339b7f:::rbd_data.1121cb4a09ed.0000000000000003:snapdir [list-snaps] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e219)", 2024-09-13T06:43:18.705 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:43:03.420772+0000", 2024-09-13T06:43:18.705 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 15.244431669000001, 2024-09-13T06:43:18.705 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7081308659999999, 2024-09-13T06:43:18.705 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:18.705 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:18.705 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:18.705 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:18.706 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:18.706 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 208397 2024-09-13T06:43:18.706 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:18.706 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:18.706 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:18.706 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:18.706 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420772+0000", 2024-09-13T06:43:18.706 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:18.706 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:18.706 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:18.706 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:18.706 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420772+0000", 2024-09-13T06:43:18.706 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:18.706 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:18.707 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:18.707 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:18.707 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420772+0000", 2024-09-13T06:43:18.707 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:43:18.707 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:18.707 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:18.707 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:18.707 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420777+0000", 2024-09-13T06:43:18.707 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.8329999999999999e-06 2024-09-13T06:43:18.707 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:18.707 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:18.707 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:18.707 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420795+0000", 2024-09-13T06:43:18.707 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7677e-05 2024-09-13T06:43:18.707 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:18.708 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:18.708 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:18.708 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420811+0000", 2024-09-13T06:43:18.708 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5673000000000001e-05 2024-09-13T06:43:18.708 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:18.708 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:18.708 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:18.708 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.421352+0000", 2024-09-13T06:43:18.708 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00054091199999999995 2024-09-13T06:43:18.708 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:18.708 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:18.708 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:43:18.708 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.421364+0000", 2024-09-13T06:43:18.708 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.182e-05 2024-09-13T06:43:18.709 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:18.709 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:18.709 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:18.709 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.128512+0000", 2024-09-13T06:43:18.709 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.707148584 2024-09-13T06:43:18.709 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:18.709 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:18.709 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:18.709 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.128653+0000", 2024-09-13T06:43:18.709 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00014127599999999999 2024-09-13T06:43:18.709 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:18.709 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:18.709 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:18.709 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.128903+0000", 2024-09-13T06:43:18.710 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000249941 2024-09-13T06:43:18.710 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:18.710 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:18.710 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:18.710 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:18.710 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:18.710 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:208404 3.14 3:2d339b7f:::rbd_data.1121cb4a09ed.0000000000000003:snapdir [list-snaps] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e219)", 2024-09-13T06:43:18.710 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:43:03.420837+0000", 2024-09-13T06:43:18.710 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 15.244367033, 2024-09-13T06:43:18.710 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.70849154, 2024-09-13T06:43:18.710 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:18.710 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:18.710 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:18.710 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:18.711 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:18.711 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 208404 2024-09-13T06:43:18.711 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:18.711 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:18.711 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:18.711 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:18.711 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420837+0000", 2024-09-13T06:43:18.711 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:18.711 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:18.711 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:18.711 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:18.711 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420837+0000", 2024-09-13T06:43:18.711 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:18.711 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:18.712 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:18.712 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:18.712 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420836+0000", 2024-09-13T06:43:18.712 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999986 2024-09-13T06:43:18.712 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:18.712 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:18.712 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:18.712 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420842+0000", 2024-09-13T06:43:18.712 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.4400000000000002e-06 2024-09-13T06:43:18.712 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:18.712 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:18.712 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:18.712 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420860+0000", 2024-09-13T06:43:18.712 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7487e-05 2024-09-13T06:43:18.713 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:18.713 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:18.713 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:18.713 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420916+0000", 2024-09-13T06:43:18.713 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.6276999999999997e-05 2024-09-13T06:43:18.713 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:18.713 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:18.713 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:18.713 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.421450+0000", 2024-09-13T06:43:18.713 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00053433500000000004 2024-09-13T06:43:18.713 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:18.713 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:18.713 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:43:18.714 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.421474+0000", 2024-09-13T06:43:18.714 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.3799e-05 2024-09-13T06:43:18.714 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:18.714 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:18.714 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:18.714 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.128945+0000", 2024-09-13T06:43:18.714 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.707470912 2024-09-13T06:43:18.714 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:18.714 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:18.714 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:18.714 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.129087+0000", 2024-09-13T06:43:18.714 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00014170900000000001 2024-09-13T06:43:18.714 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:18.714 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:18.715 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:18.715 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.129329+0000", 2024-09-13T06:43:18.715 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000241831 2024-09-13T06:43:18.715 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:18.715 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:18.715 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:18.715 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:18.715 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:18.715 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:208411 3.14 3:2d339b7f:::rbd_data.1121cb4a09ed.0000000000000003:snapdir [list-snaps] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e219)", 2024-09-13T06:43:18.715 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:43:03.420964+0000", 2024-09-13T06:43:18.715 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 15.244239801000001, 2024-09-13T06:43:18.715 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.708812754, 2024-09-13T06:43:18.716 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:18.716 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:18.716 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:18.716 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:18.716 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:18.716 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 208411 2024-09-13T06:43:18.716 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:18.716 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:18.716 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:18.716 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:18.716 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420964+0000", 2024-09-13T06:43:18.716 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:18.717 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:18.717 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:18.717 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:18.717 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420964+0000", 2024-09-13T06:43:18.717 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:18.717 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:18.717 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:18.717 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:18.717 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420963+0000", 2024-09-13T06:43:18.717 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:43:18.717 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:18.717 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:18.717 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:18.718 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420969+0000", 2024-09-13T06:43:18.718 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.7540000000000003e-06 2024-09-13T06:43:18.718 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:18.718 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:18.718 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:18.718 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420979+0000", 2024-09-13T06:43:18.718 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0067e-05 2024-09-13T06:43:18.718 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:18.718 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:18.718 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:18.718 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420987+0000", 2024-09-13T06:43:18.718 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.6990000000000003e-06 2024-09-13T06:43:18.718 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:18.719 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:18.719 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:18.719 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.421563+0000", 2024-09-13T06:43:18.719 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00057654899999999999 2024-09-13T06:43:18.719 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:18.719 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:18.719 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:43:18.719 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.421573+0000", 2024-09-13T06:43:18.719 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.9669999999999996e-06 2024-09-13T06:43:18.719 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:18.719 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:18.719 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:18.719 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.129372+0000", 2024-09-13T06:43:18.719 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.707798602 2024-09-13T06:43:18.720 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:18.720 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:18.720 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:18.720 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.129514+0000", 2024-09-13T06:43:18.720 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00014191200000000001 2024-09-13T06:43:18.720 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:18.720 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:18.720 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:18.720 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.129777+0000", 2024-09-13T06:43:18.720 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00026320100000000002 2024-09-13T06:43:18.720 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:18.720 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:18.720 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:18.721 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:18.721 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:18.721 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:208418 3.14 3:2d339b7f:::rbd_data.1121cb4a09ed.0000000000000003:snapdir [list-snaps] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e219)", 2024-09-13T06:43:18.721 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:43:03.421005+0000", 2024-09-13T06:43:18.721 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 15.244198717, 2024-09-13T06:43:18.721 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7096508159999999, 2024-09-13T06:43:18.721 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:18.721 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:18.721 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:18.721 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:18.721 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:18.721 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 208418 2024-09-13T06:43:18.721 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:18.721 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:18.722 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:18.722 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:18.722 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.421005+0000", 2024-09-13T06:43:18.722 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:18.722 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:18.722 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:18.722 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:18.722 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.421005+0000", 2024-09-13T06:43:18.722 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:18.722 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:18.722 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:18.722 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:18.722 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.421005+0000", 2024-09-13T06:43:18.723 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:18.723 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:18.723 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:18.723 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:18.723 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.421008+0000", 2024-09-13T06:43:18.723 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.2550000000000002e-06 2024-09-13T06:43:18.723 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:18.723 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:18.723 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:18.723 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.421015+0000", 2024-09-13T06:43:18.723 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.0600000000000002e-06 2024-09-13T06:43:18.723 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:18.723 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:18.724 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:18.724 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.421021+0000", 2024-09-13T06:43:18.724 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.8139999999999997e-06 2024-09-13T06:43:18.724 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:18.724 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:18.724 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:18.724 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.421638+0000", 2024-09-13T06:43:18.724 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00061702600000000001 2024-09-13T06:43:18.724 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:18.724 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:18.724 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:43:18.724 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.421659+0000", 2024-09-13T06:43:18.724 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.0894e-05 2024-09-13T06:43:18.725 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:18.725 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:18.725 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:18.725 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.129858+0000", 2024-09-13T06:43:18.725 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.708198632 2024-09-13T06:43:18.725 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:18.725 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:18.725 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:18.725 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.130158+0000", 2024-09-13T06:43:18.725 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00030000099999999999 2024-09-13T06:43:18.725 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:18.725 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:18.725 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:18.725 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.130656+0000", 2024-09-13T06:43:18.726 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00049864199999999999 2024-09-13T06:43:18.726 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:18.726 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:18.726 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:18.726 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:18.726 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:18.726 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:209008 3.3 3:c6ff3074:::rbd_data.1121cb4a09ed.0000000000000001:82 [read 397312~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e220)", 2024-09-13T06:43:18.726 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:43:05.165956+0000", 2024-09-13T06:43:18.726 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 13.499248407, 2024-09-13T06:43:18.726 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.120605692, 2024-09-13T06:43:18.726 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:18.726 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:18.726 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:18.727 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:18.727 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:18.727 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 209008 2024-09-13T06:43:18.727 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:18.727 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:18.727 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:18.727 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:18.727 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.165956+0000", 2024-09-13T06:43:18.727 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:18.727 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:18.727 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:18.727 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:18.727 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.165956+0000", 2024-09-13T06:43:18.727 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:18.728 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:18.728 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:18.728 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:18.728 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.165955+0000", 2024-09-13T06:43:18.728 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:43:18.728 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:18.728 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:18.728 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:18.728 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.165960+0000", 2024-09-13T06:43:18.728 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.6200000000000004e-06 2024-09-13T06:43:18.728 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:18.728 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:18.728 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:18.729 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.165998+0000", 2024-09-13T06:43:18.729 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.7703000000000001e-05 2024-09-13T06:43:18.729 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:18.729 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:18.729 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:18.729 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.166012+0000", 2024-09-13T06:43:18.729 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3682999999999999e-05 2024-09-13T06:43:18.729 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:18.729 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:18.729 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:18.729 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.286043+0000", 2024-09-13T06:43:18.729 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.120030867 2024-09-13T06:43:18.729 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:18.729 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:18.730 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:18.730 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.286196+0000", 2024-09-13T06:43:18.730 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000153759 2024-09-13T06:43:18.730 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:18.730 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:18.730 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:18.730 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.286561+0000", 2024-09-13T06:43:18.730 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00036504700000000002 2024-09-13T06:43:18.730 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:18.730 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:18.730 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:18.730 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:18.730 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:18.730 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:209009 3.3 3:c6ff3074:::rbd_data.1121cb4a09ed.0000000000000001:82 [read 409600~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e220)", 2024-09-13T06:43:18.731 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:43:05.166111+0000", 2024-09-13T06:43:18.731 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 13.499092762, 2024-09-13T06:43:18.731 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.121025172, 2024-09-13T06:43:18.731 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:18.731 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:18.731 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:18.731 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:18.731 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:18.731 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 209009 2024-09-13T06:43:18.731 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:18.731 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:18.731 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:18.731 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:18.731 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.166111+0000", 2024-09-13T06:43:18.732 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:18.732 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:18.732 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:18.732 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:18.732 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.166111+0000", 2024-09-13T06:43:18.732 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:18.732 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:18.732 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:18.732 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:18.732 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.166023+0000", 2024-09-13T06:43:18.732 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999113 2024-09-13T06:43:18.732 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:18.732 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:18.733 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:18.733 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.166118+0000", 2024-09-13T06:43:18.733 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.5818999999999999e-05 2024-09-13T06:43:18.733 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:18.733 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:18.733 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:18.733 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.166145+0000", 2024-09-13T06:43:18.733 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.6679999999999999e-05 2024-09-13T06:43:18.733 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:18.733 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:18.733 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:18.733 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.166162+0000", 2024-09-13T06:43:18.733 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6413e-05 2024-09-13T06:43:18.734 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:18.734 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:18.734 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:18.734 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.286636+0000", 2024-09-13T06:43:18.734 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.120474003 2024-09-13T06:43:18.734 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:18.734 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:18.734 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:18.734 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.286799+0000", 2024-09-13T06:43:18.734 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00016363900000000001 2024-09-13T06:43:18.734 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:18.734 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:18.734 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:18.735 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.287137+0000", 2024-09-13T06:43:18.735 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00033736699999999998 2024-09-13T06:43:18.735 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:18.735 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:18.735 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:18.735 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:18.735 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:18.735 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:209010 3.3 3:c6ff3074:::rbd_data.1121cb4a09ed.0000000000000001:82 [read 421888~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e220)", 2024-09-13T06:43:18.735 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:43:05.167018+0000", 2024-09-13T06:43:18.735 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 13.498186583000001, 2024-09-13T06:43:18.735 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.120709894, 2024-09-13T06:43:18.735 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:18.735 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:18.735 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:18.736 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:18.736 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:18.736 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 209010 2024-09-13T06:43:18.736 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:18.736 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:18.736 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:18.736 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:18.736 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.167018+0000", 2024-09-13T06:43:18.736 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:18.736 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:18.736 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:18.736 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:18.736 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.167018+0000", 2024-09-13T06:43:18.737 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:18.737 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:18.737 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:18.737 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:18.737 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.166214+0000", 2024-09-13T06:43:18.737 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9991961 2024-09-13T06:43:18.737 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:18.737 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:18.737 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:18.737 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.167039+0000", 2024-09-13T06:43:18.737 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00082531599999999998 2024-09-13T06:43:18.737 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:18.737 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:18.737 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:18.738 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.167083+0000", 2024-09-13T06:43:18.738 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.4079999999999998e-05 2024-09-13T06:43:18.738 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:18.738 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:18.738 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:18.738 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.167113+0000", 2024-09-13T06:43:18.738 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.025e-05 2024-09-13T06:43:18.738 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:18.738 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:18.739 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:18.739 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.287229+0000", 2024-09-13T06:43:18.739 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.12011563 2024-09-13T06:43:18.739 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:18.739 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:18.739 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:18.739 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.287369+0000", 2024-09-13T06:43:18.739 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00014040499999999999 2024-09-13T06:43:18.739 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:18.739 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:18.739 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:18.739 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.287727+0000", 2024-09-13T06:43:18.739 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000358043 2024-09-13T06:43:18.740 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:18.740 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:18.740 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:18.740 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:18.740 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:18.740 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:209011 3.3 3:c6ff3074:::rbd_data.1121cb4a09ed.0000000000000001:82 [read 434176~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e220)", 2024-09-13T06:43:18.740 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:43:05.167765+0000", 2024-09-13T06:43:18.740 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 13.497439089, 2024-09-13T06:43:18.740 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.12054767199999999, 2024-09-13T06:43:18.740 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:18.740 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:18.740 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:18.740 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:18.741 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:18.741 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 209011 2024-09-13T06:43:18.741 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:18.741 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:18.741 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:18.741 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:18.741 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.167765+0000", 2024-09-13T06:43:18.741 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:18.741 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:18.741 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:18.741 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:18.741 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.167765+0000", 2024-09-13T06:43:18.741 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:18.742 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:18.742 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:18.742 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:18.742 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.167131+0000", 2024-09-13T06:43:18.742 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9993658 2024-09-13T06:43:18.742 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:18.742 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:18.742 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:18.742 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.167772+0000", 2024-09-13T06:43:18.742 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00064152399999999998 2024-09-13T06:43:18.742 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:18.742 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:18.742 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:18.742 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.167791+0000", 2024-09-13T06:43:18.743 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.8944e-05 2024-09-13T06:43:18.743 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:18.743 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:18.743 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:18.743 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.167805+0000", 2024-09-13T06:43:18.743 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.395e-05 2024-09-13T06:43:18.743 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:18.743 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:18.743 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:18.743 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.287803+0000", 2024-09-13T06:43:18.743 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.11999747099999999 2024-09-13T06:43:18.743 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:18.744 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:18.744 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:18.744 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.287964+0000", 2024-09-13T06:43:18.744 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00016155100000000001 2024-09-13T06:43:18.744 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:18.744 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:18.744 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:18.744 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.288313+0000", 2024-09-13T06:43:18.744 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00034865699999999999 2024-09-13T06:43:18.744 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:18.744 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:18.744 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:18.744 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:18.745 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:18.745 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:209012 3.3 3:c6ff3074:::rbd_data.1121cb4a09ed.0000000000000001:82 [read 446464~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e220)", 2024-09-13T06:43:18.745 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:43:05.168733+0000", 2024-09-13T06:43:18.745 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 13.496470968000001, 2024-09-13T06:43:18.745 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.12007113699999999, 2024-09-13T06:43:18.745 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:18.745 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:18.745 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:18.745 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:18.745 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:18.745 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 209012 2024-09-13T06:43:18.745 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:18.745 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:18.746 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:18.746 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:18.746 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.168733+0000", 2024-09-13T06:43:18.746 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:18.746 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:18.746 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:18.746 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:18.746 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.168733+0000", 2024-09-13T06:43:18.746 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:18.746 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:18.746 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:18.746 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:18.746 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.167815+0000", 2024-09-13T06:43:18.746 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9990816 2024-09-13T06:43:18.747 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:18.747 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:18.747 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:18.747 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.168749+0000", 2024-09-13T06:43:18.747 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00093412200000000001 2024-09-13T06:43:18.747 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:18.747 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:18.747 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:18.747 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.168776+0000", 2024-09-13T06:43:18.747 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.654e-05 2024-09-13T06:43:18.747 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:18.747 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:18.747 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:18.747 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.168814+0000", 2024-09-13T06:43:18.748 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.8702999999999999e-05 2024-09-13T06:43:18.748 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:18.748 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:18.748 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:18.748 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.288381+0000", 2024-09-13T06:43:18.748 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.119566731 2024-09-13T06:43:18.748 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:18.748 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:18.748 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:18.748 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.288516+0000", 2024-09-13T06:43:18.748 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00013502499999999999 2024-09-13T06:43:18.748 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:18.748 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:18.749 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:18.749 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.288804+0000", 2024-09-13T06:43:18.749 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00028836399999999999 2024-09-13T06:43:18.749 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:18.749 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:18.749 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:18.749 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:18.749 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:18.749 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:209013 3.3 3:c6ff3074:::rbd_data.1121cb4a09ed.0000000000000001:82 [read 458752~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e220)", 2024-09-13T06:43:18.749 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:43:05.168880+0000", 2024-09-13T06:43:18.749 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 13.496324005, 2024-09-13T06:43:18.749 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.120462023, 2024-09-13T06:43:18.749 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:18.750 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:18.750 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:18.750 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:18.750 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:18.750 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 209013 2024-09-13T06:43:18.750 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:18.750 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:18.750 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:18.750 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:18.750 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.168880+0000", 2024-09-13T06:43:18.750 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:18.750 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:18.750 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:18.751 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:18.751 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.168880+0000", 2024-09-13T06:43:18.751 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:18.751 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:18.751 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:18.751 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:18.751 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.168879+0000", 2024-09-13T06:43:18.751 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999986 2024-09-13T06:43:18.751 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:18.751 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:18.751 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:18.751 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.168888+0000", 2024-09-13T06:43:18.751 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.9930000000000001e-06 2024-09-13T06:43:18.752 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:18.752 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:18.752 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:18.752 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.168908+0000", 2024-09-13T06:43:18.752 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.0276999999999999e-05 2024-09-13T06:43:18.752 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:18.752 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:18.752 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:18.752 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.168923+0000", 2024-09-13T06:43:18.752 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5543e-05 2024-09-13T06:43:18.752 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:18.752 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:18.752 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:18.753 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.288875+0000", 2024-09-13T06:43:18.753 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.119951748 2024-09-13T06:43:18.753 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:18.753 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:18.753 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:18.753 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.289007+0000", 2024-09-13T06:43:18.753 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00013142899999999999 2024-09-13T06:43:18.753 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:18.753 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:18.753 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:18.753 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.289342+0000", 2024-09-13T06:43:18.753 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00033566999999999999 2024-09-13T06:43:18.753 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:18.753 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:18.754 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:18.754 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:18.754 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:18.754 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:209014 3.3 3:c6ff3074:::rbd_data.1121cb4a09ed.0000000000000001:82 [read 471040~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e220)", 2024-09-13T06:43:18.754 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:43:05.169105+0000", 2024-09-13T06:43:18.754 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 13.496099547, 2024-09-13T06:43:18.754 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.12087680000000001, 2024-09-13T06:43:18.754 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:18.754 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:18.754 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:18.754 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:18.754 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:18.754 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 209014 2024-09-13T06:43:18.755 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:18.755 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:18.755 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:18.755 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:18.755 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.169105+0000", 2024-09-13T06:43:18.755 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:18.755 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:18.755 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:18.755 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:18.755 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.169105+0000", 2024-09-13T06:43:18.755 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:18.755 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:18.755 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:18.755 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:18.756 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.168936+0000", 2024-09-13T06:43:18.756 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9998312 2024-09-13T06:43:18.756 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:18.756 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:18.756 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:18.756 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.169115+0000", 2024-09-13T06:43:18.756 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00017854500000000001 2024-09-13T06:43:18.756 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:18.756 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:18.756 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:18.756 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.169140+0000", 2024-09-13T06:43:18.756 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.5853000000000001e-05 2024-09-13T06:43:18.757 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:18.757 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:18.757 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:18.757 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.169160+0000", 2024-09-13T06:43:18.757 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.9415999999999998e-05 2024-09-13T06:43:18.757 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:18.757 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:18.757 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:18.757 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.289414+0000", 2024-09-13T06:43:18.757 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.120253785 2024-09-13T06:43:18.757 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:18.758 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:18.758 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:18.758 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.289579+0000", 2024-09-13T06:43:18.758 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00016506299999999999 2024-09-13T06:43:18.758 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:18.758 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:18.758 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:18.758 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.289981+0000", 2024-09-13T06:43:18.758 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000402743 2024-09-13T06:43:18.758 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:18.758 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:18.758 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:18.758 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:18.758 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:18.759 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:209015 3.3 3:c6ff3074:::rbd_data.1121cb4a09ed.0000000000000001:82 [read 483328~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e220)", 2024-09-13T06:43:18.759 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:43:05.169496+0000", 2024-09-13T06:43:18.759 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 13.495708497000001, 2024-09-13T06:43:18.759 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.12105229200000001, 2024-09-13T06:43:18.759 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:18.759 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:18.759 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:18.759 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:18.759 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:18.759 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 209015 2024-09-13T06:43:18.759 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:18.759 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:18.759 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:18.760 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:18.760 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.169496+0000", 2024-09-13T06:43:18.760 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:18.760 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:18.760 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:18.760 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:18.760 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.169496+0000", 2024-09-13T06:43:18.760 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:18.760 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:18.760 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:18.760 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:18.760 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.169177+0000", 2024-09-13T06:43:18.760 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999681 2024-09-13T06:43:18.761 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:18.761 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:18.761 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:18.761 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.169509+0000", 2024-09-13T06:43:18.761 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00033226099999999998 2024-09-13T06:43:18.761 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:18.761 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:18.761 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:18.761 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.169544+0000", 2024-09-13T06:43:18.761 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.5573e-05 2024-09-13T06:43:18.761 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:18.761 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:18.761 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:18.761 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.169560+0000", 2024-09-13T06:43:18.762 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5636000000000001e-05 2024-09-13T06:43:18.762 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:18.762 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:18.762 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:18.762 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.290055+0000", 2024-09-13T06:43:18.762 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.12049523400000001 2024-09-13T06:43:18.762 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:18.762 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:18.762 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:18.762 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.290201+0000", 2024-09-13T06:43:18.762 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000145742 2024-09-13T06:43:18.762 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:18.762 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:18.763 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:18.763 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.290548+0000", 2024-09-13T06:43:18.763 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00034698699999999999 2024-09-13T06:43:18.763 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:18.763 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:18.763 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:18.763 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:18.763 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:18.763 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:209016 3.3 3:c6ff3074:::rbd_data.1121cb4a09ed.0000000000000001:82 [read 495616~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e220)", 2024-09-13T06:43:18.763 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:43:05.169893+0000", 2024-09-13T06:43:18.763 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 13.495310984, 2024-09-13T06:43:18.763 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.121278814, 2024-09-13T06:43:18.763 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:18.763 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:18.764 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:18.764 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:18.764 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:18.764 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 209016 2024-09-13T06:43:18.764 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:18.764 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:18.764 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:18.764 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:18.764 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.169893+0000", 2024-09-13T06:43:18.764 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:18.764 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:18.764 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:18.765 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:18.765 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.169893+0000", 2024-09-13T06:43:18.765 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:18.765 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:18.765 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:18.765 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:18.765 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.169572+0000", 2024-09-13T06:43:18.765 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9996786 2024-09-13T06:43:18.765 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:18.765 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:18.765 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:18.765 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.169903+0000", 2024-09-13T06:43:18.765 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00033101400000000003 2024-09-13T06:43:18.765 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:18.765 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:18.766 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:18.766 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.169933+0000", 2024-09-13T06:43:18.766 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.9913e-05 2024-09-13T06:43:18.766 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:18.766 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:18.766 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:18.766 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.169949+0000", 2024-09-13T06:43:18.766 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6313000000000001e-05 2024-09-13T06:43:18.766 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:18.766 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:18.766 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:18.766 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.290622+0000", 2024-09-13T06:43:18.766 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.120672795 2024-09-13T06:43:18.766 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:18.767 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:18.767 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:18.767 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.290788+0000", 2024-09-13T06:43:18.767 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00016597899999999999 2024-09-13T06:43:18.767 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:18.767 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:18.767 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:18.767 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.291172+0000", 2024-09-13T06:43:18.767 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00038422700000000001 2024-09-13T06:43:18.767 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:18.767 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:18.767 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:18.767 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:18.767 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:18.768 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:43:18.769 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-13T06:43:18.769 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:43:18.769+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:43:18.870 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:43:18.869+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:43:18.939 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:43:18.939 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [], 2024-09-13T06:43:18.939 INFO:teuthology.orchestra.run.smithi139.stdout: "num_ops": 0 2024-09-13T06:43:18.940 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:43:18.954 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-13T06:43:18.970 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:43:18.972+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:43:19.071 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-13T06:43:19.073+0000 7fa8bb18e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 36790) UID: 0 2024-09-13T06:43:19.119 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:43:19.119 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [], 2024-09-13T06:43:19.119 INFO:teuthology.orchestra.run.smithi139.stdout: "complaint_time": 30, 2024-09-13T06:43:19.120 INFO:teuthology.orchestra.run.smithi139.stdout: "num_blocked_ops": 0 2024-09-13T06:43:19.120 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:43:19.133 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-13T06:43:19.173 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:43:19.172+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:43:19.239 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-13T06:43:19.286 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:43:19.288+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:43:19.301 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:43:19.301 INFO:teuthology.orchestra.run.smithi139.stdout: "size": 20, 2024-09-13T06:43:19.301 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 600, 2024-09-13T06:43:19.301 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [ 2024-09-13T06:43:19.301 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:19.301 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43299 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 432128~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:43:19.301 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589881+0000", 2024-09-13T06:43:19.301 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 177.70990280199999, 2024-09-13T06:43:19.302 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.079693849999999997, 2024-09-13T06:43:19.302 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:19.302 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:19.302 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:19.302 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:19.302 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:19.302 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43299 2024-09-13T06:43:19.302 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:19.302 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:19.302 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:19.302 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:19.302 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589881+0000", 2024-09-13T06:43:19.302 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:19.302 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:19.303 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:19.303 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:19.303 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589881+0000", 2024-09-13T06:43:19.303 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:19.303 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:19.303 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:19.303 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:19.303 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589880+0000", 2024-09-13T06:43:19.303 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:43:19.303 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:19.303 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:19.303 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:19.303 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589884+0000", 2024-09-13T06:43:19.303 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.053e-06 2024-09-13T06:43:19.304 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:19.304 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:19.304 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:19.304 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589893+0000", 2024-09-13T06:43:19.304 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.2129999999999997e-06 2024-09-13T06:43:19.304 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:19.304 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:19.304 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:19.304 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589901+0000", 2024-09-13T06:43:19.304 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.6399999999999997e-06 2024-09-13T06:43:19.304 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:19.304 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:19.304 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:19.305 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.669213+0000", 2024-09-13T06:43:19.305 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.079312074999999996 2024-09-13T06:43:19.305 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:19.305 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:19.305 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:19.305 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.669281+0000", 2024-09-13T06:43:19.305 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.8322000000000001e-05 2024-09-13T06:43:19.305 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:19.305 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:19.305 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:19.305 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.669575+0000", 2024-09-13T06:43:19.305 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00029349699999999999 2024-09-13T06:43:19.305 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:19.306 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:19.306 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:19.306 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:19.306 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:19.306 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43300 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 446464~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:43:19.306 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589909+0000", 2024-09-13T06:43:19.306 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 177.709874907, 2024-09-13T06:43:19.306 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.080339496999999996, 2024-09-13T06:43:19.306 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:19.306 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:19.306 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:19.306 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:19.306 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:19.306 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43300 2024-09-13T06:43:19.307 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:19.307 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:19.307 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:19.307 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:19.307 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589909+0000", 2024-09-13T06:43:19.307 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:19.307 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:19.307 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:19.307 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:19.307 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589909+0000", 2024-09-13T06:43:19.307 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:19.307 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:19.307 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:19.308 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:19.308 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589908+0000", 2024-09-13T06:43:19.308 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:43:19.308 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:19.308 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:19.308 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:19.308 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589912+0000", 2024-09-13T06:43:19.308 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.9430000000000002e-06 2024-09-13T06:43:19.308 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:19.308 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:19.308 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:19.308 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589920+0000", 2024-09-13T06:43:19.308 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.3860000000000007e-06 2024-09-13T06:43:19.309 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:19.309 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:19.309 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:19.309 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589928+0000", 2024-09-13T06:43:19.309 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.3329999999999999e-06 2024-09-13T06:43:19.309 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:19.309 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:19.309 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:19.309 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.669651+0000", 2024-09-13T06:43:19.309 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.079723204000000006 2024-09-13T06:43:19.309 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:19.309 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:19.309 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:19.310 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.669840+0000", 2024-09-13T06:43:19.310 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000189397 2024-09-13T06:43:19.310 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:19.310 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:19.310 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:19.310 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.670248+0000", 2024-09-13T06:43:19.310 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00040811100000000001 2024-09-13T06:43:19.310 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:19.310 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:19.310 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:19.310 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:19.310 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:19.310 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43301 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 460800~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:43:19.311 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589934+0000", 2024-09-13T06:43:19.311 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 177.709850233, 2024-09-13T06:43:19.311 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.080747474999999999, 2024-09-13T06:43:19.311 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:19.311 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:19.311 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:19.311 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:19.311 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:19.311 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43301 2024-09-13T06:43:19.311 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:19.311 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:19.311 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:19.311 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:19.311 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589934+0000", 2024-09-13T06:43:19.312 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:19.312 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:19.312 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:19.312 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:19.312 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589934+0000", 2024-09-13T06:43:19.312 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:19.312 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:19.312 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:19.312 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:19.312 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589933+0000", 2024-09-13T06:43:19.312 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:19.312 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:19.313 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:19.313 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:19.313 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589936+0000", 2024-09-13T06:43:19.313 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.4599999999999999e-06 2024-09-13T06:43:19.313 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:19.313 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:19.313 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:19.313 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589945+0000", 2024-09-13T06:43:19.313 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.2430000000000005e-06 2024-09-13T06:43:19.313 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:19.313 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:19.313 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:19.314 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589952+0000", 2024-09-13T06:43:19.314 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.3289999999999996e-06 2024-09-13T06:43:19.314 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:19.314 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:19.314 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:19.314 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.670280+0000", 2024-09-13T06:43:19.314 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.080328514000000004 2024-09-13T06:43:19.314 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:19.314 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:19.314 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:19.314 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.670376+0000", 2024-09-13T06:43:19.314 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.5752000000000001e-05 2024-09-13T06:43:19.314 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:19.315 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:19.315 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:19.315 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.670681+0000", 2024-09-13T06:43:19.315 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00030479699999999999 2024-09-13T06:43:19.315 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:19.315 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:19.315 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:19.315 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:19.315 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:19.315 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43302 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 475136~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:43:19.315 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589958+0000", 2024-09-13T06:43:19.315 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 177.709826171, 2024-09-13T06:43:19.315 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.081402394000000003, 2024-09-13T06:43:19.316 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:19.316 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:19.316 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:19.316 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:19.316 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:19.316 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43302 2024-09-13T06:43:19.316 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:19.316 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:19.316 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:19.316 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:19.316 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589958+0000", 2024-09-13T06:43:19.316 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:19.317 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:19.317 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:19.317 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:19.317 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589958+0000", 2024-09-13T06:43:19.317 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:19.317 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:19.317 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:19.317 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:19.317 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589957+0000", 2024-09-13T06:43:19.317 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:19.317 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:19.317 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:19.318 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:19.318 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589960+0000", 2024-09-13T06:43:19.318 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.4939999999999999e-06 2024-09-13T06:43:19.318 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:19.318 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:19.318 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:19.318 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589969+0000", 2024-09-13T06:43:19.318 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.3520000000000007e-06 2024-09-13T06:43:19.318 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:19.318 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:19.318 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:19.318 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589976+0000", 2024-09-13T06:43:19.318 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.3030000000000002e-06 2024-09-13T06:43:19.319 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:19.319 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:19.319 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:19.319 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.670765+0000", 2024-09-13T06:43:19.319 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.080789154000000002 2024-09-13T06:43:19.319 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:19.319 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:19.319 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:19.319 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.670960+0000", 2024-09-13T06:43:19.319 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00019464300000000001 2024-09-13T06:43:19.319 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:19.319 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:19.319 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:19.319 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.671360+0000", 2024-09-13T06:43:19.319 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00040005200000000002 2024-09-13T06:43:19.320 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:19.320 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:19.320 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:19.320 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:19.320 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:19.320 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43303 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 489472~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:43:19.320 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589985+0000", 2024-09-13T06:43:19.320 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 177.709799223, 2024-09-13T06:43:19.320 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.082024333000000005, 2024-09-13T06:43:19.321 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:19.321 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:19.321 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:19.321 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:19.321 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:19.321 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43303 2024-09-13T06:43:19.321 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:19.321 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:19.321 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:19.321 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:19.321 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589985+0000", 2024-09-13T06:43:19.321 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:19.321 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:19.321 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:19.322 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:19.322 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589985+0000", 2024-09-13T06:43:19.322 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:19.322 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:19.322 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:19.322 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:19.322 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589984+0000", 2024-09-13T06:43:19.322 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:43:19.322 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:19.322 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:19.322 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:19.322 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589987+0000", 2024-09-13T06:43:19.322 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.726e-06 2024-09-13T06:43:19.322 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:19.322 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:19.323 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:19.323 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589996+0000", 2024-09-13T06:43:19.323 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.5459999999999992e-06 2024-09-13T06:43:19.323 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:19.323 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:19.323 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:19.323 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590003+0000", 2024-09-13T06:43:19.323 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.4229999999999999e-06 2024-09-13T06:43:19.323 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:19.323 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:19.323 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:19.323 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.671426+0000", 2024-09-13T06:43:19.323 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.081422704999999998 2024-09-13T06:43:19.323 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:19.323 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:19.324 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:19.324 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.671615+0000", 2024-09-13T06:43:19.324 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000188875 2024-09-13T06:43:19.324 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:19.324 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:19.324 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:19.324 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.672009+0000", 2024-09-13T06:43:19.324 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000394015 2024-09-13T06:43:19.324 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:19.324 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:19.324 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:19.324 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:19.324 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:19.325 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43304 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 503808~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:43:19.325 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.590039+0000", 2024-09-13T06:43:19.325 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 177.70974467799999, 2024-09-13T06:43:19.325 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.082573880000000002, 2024-09-13T06:43:19.325 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:19.325 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:19.325 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:19.325 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:19.325 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:19.325 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43304 2024-09-13T06:43:19.325 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:19.325 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:19.325 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:19.326 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:19.326 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590039+0000", 2024-09-13T06:43:19.326 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:19.326 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:19.326 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:19.326 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:19.326 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590039+0000", 2024-09-13T06:43:19.326 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:19.326 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:19.326 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:19.326 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:19.326 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590038+0000", 2024-09-13T06:43:19.326 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:43:19.326 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:19.327 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:19.327 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:19.327 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590042+0000", 2024-09-13T06:43:19.327 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.9500000000000003e-06 2024-09-13T06:43:19.327 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:19.327 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:19.327 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:19.327 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590052+0000", 2024-09-13T06:43:19.327 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.3919999999999992e-06 2024-09-13T06:43:19.327 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:19.327 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:19.327 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:19.327 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590059+0000", 2024-09-13T06:43:19.327 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.7970000000000001e-06 2024-09-13T06:43:19.327 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:19.328 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:19.328 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:19.328 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.672078+0000", 2024-09-13T06:43:19.328 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.082018778000000001 2024-09-13T06:43:19.328 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:19.328 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:19.328 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:19.328 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.672266+0000", 2024-09-13T06:43:19.328 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00018807399999999999 2024-09-13T06:43:19.328 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:19.328 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:19.328 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:19.328 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.672613+0000", 2024-09-13T06:43:19.329 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00034677599999999997 2024-09-13T06:43:19.329 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:19.329 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:19.329 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:19.329 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:19.329 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:19.329 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43305 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 518144~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:43:19.329 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.590136+0000", 2024-09-13T06:43:19.329 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 177.70964749000001, 2024-09-13T06:43:19.329 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.082988206999999994, 2024-09-13T06:43:19.329 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:19.329 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:19.330 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:19.330 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:19.330 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:19.330 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43305 2024-09-13T06:43:19.330 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:19.330 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:19.330 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:19.330 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:19.330 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590136+0000", 2024-09-13T06:43:19.330 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:19.330 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:19.330 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:19.330 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:19.331 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590136+0000", 2024-09-13T06:43:19.331 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:19.331 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:19.331 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:19.331 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:19.331 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590135+0000", 2024-09-13T06:43:19.331 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:43:19.331 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:19.331 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:19.331 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:19.331 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590139+0000", 2024-09-13T06:43:19.331 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.9489999999999998e-06 2024-09-13T06:43:19.331 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:19.332 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:19.332 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:19.332 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590148+0000", 2024-09-13T06:43:19.332 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.9830000000000002e-06 2024-09-13T06:43:19.332 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:19.332 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:19.332 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:19.332 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590156+0000", 2024-09-13T06:43:19.332 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5229999999999998e-06 2024-09-13T06:43:19.332 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:19.332 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:19.332 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:19.333 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.672709+0000", 2024-09-13T06:43:19.333 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.082552886000000006 2024-09-13T06:43:19.333 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:19.333 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:19.333 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:19.333 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.672816+0000", 2024-09-13T06:43:19.333 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000107736 2024-09-13T06:43:19.333 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:19.333 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:19.333 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:19.333 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.673124+0000", 2024-09-13T06:43:19.333 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00030804900000000002 2024-09-13T06:43:19.333 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:19.334 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:19.334 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:19.334 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:19.334 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:19.334 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:66818 3.17 3.50afe697 (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e100)", 2024-09-13T06:43:19.334 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:53.498942+0000", 2024-09-13T06:43:19.334 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 145.80084130500001, 2024-09-13T06:43:19.334 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.011231284, 2024-09-13T06:43:19.334 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:19.334 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:43:19.334 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:19.334 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:19.334 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:19.334 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 66818 2024-09-13T06:43:19.335 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:19.335 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:19.335 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:19.335 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:19.335 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:53.498942+0000", 2024-09-13T06:43:19.335 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:19.335 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:19.335 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:19.335 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:19.335 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:53.498942+0000", 2024-09-13T06:43:19.335 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:19.335 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:19.335 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:19.335 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:19.336 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:53.498939+0000", 2024-09-13T06:43:19.336 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999967 2024-09-13T06:43:19.336 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:19.336 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:19.336 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:19.336 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:53.498954+0000", 2024-09-13T06:43:19.336 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5028000000000001e-05 2024-09-13T06:43:19.336 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:19.336 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:19.336 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:19.336 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:53.498986+0000", 2024-09-13T06:43:19.336 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.1993999999999999e-05 2024-09-13T06:43:19.336 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:19.336 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:19.337 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:19.337 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:53.499001+0000", 2024-09-13T06:43:19.337 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5166e-05 2024-09-13T06:43:19.337 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:19.337 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:19.337 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:19.337 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:53.505097+0000", 2024-09-13T06:43:19.337 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0060955610000000002 2024-09-13T06:43:19.337 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:19.337 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:19.337 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:43:19.337 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:53.505108+0000", 2024-09-13T06:43:19.337 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.084e-05 2024-09-13T06:43:19.337 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:19.338 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:19.338 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:19.338 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:54.510158+0000", 2024-09-13T06:43:19.338 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0050497549999999 2024-09-13T06:43:19.338 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:19.338 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:19.338 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:19.338 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:54.510174+0000", 2024-09-13T06:43:19.338 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6164e-05 2024-09-13T06:43:19.338 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:19.338 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:19.338 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:19.338 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:19.338 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:19.339 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:69764 3.2 3:47f10058:::rbd_data.11214956a993.0000000000000004:head [write-same] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e117)", 2024-09-13T06:43:19.339 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:41:11.371147+0000", 2024-09-13T06:43:19.339 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 127.92863699500001, 2024-09-13T06:43:19.339 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.03470167, 2024-09-13T06:43:19.339 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:19.339 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:43:19.339 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:19.339 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:19.339 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:19.339 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 69764 2024-09-13T06:43:19.339 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:19.339 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:19.339 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:19.339 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:19.339 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:11.371147+0000", 2024-09-13T06:43:19.340 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:19.340 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:19.340 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:19.340 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:19.340 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:11.371147+0000", 2024-09-13T06:43:19.340 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:19.340 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:19.340 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:19.340 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:19.340 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:11.371144+0000", 2024-09-13T06:43:19.340 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999967 2024-09-13T06:43:19.340 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:19.340 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:19.341 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:19.341 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:11.371161+0000", 2024-09-13T06:43:19.341 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7669e-05 2024-09-13T06:43:19.341 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:19.341 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:19.341 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:19.341 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:11.371198+0000", 2024-09-13T06:43:19.341 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.7014000000000002e-05 2024-09-13T06:43:19.341 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:19.341 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:19.341 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:19.341 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:11.371216+0000", 2024-09-13T06:43:19.341 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7425e-05 2024-09-13T06:43:19.341 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:19.341 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:19.342 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:19.342 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:11.371365+0000", 2024-09-13T06:43:19.342 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000149245 2024-09-13T06:43:19.342 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:19.342 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:19.342 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op must wait for map", 2024-09-13T06:43:19.342 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:11.371385+0000", 2024-09-13T06:43:19.342 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.0018999999999999e-05 2024-09-13T06:43:19.342 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:19.342 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:19.342 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:19.342 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:11.378406+0000", 2024-09-13T06:43:19.342 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0070207179999999996 2024-09-13T06:43:19.342 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:19.342 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:19.343 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:43:19.343 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:11.378429+0000", 2024-09-13T06:43:19.343 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.3453999999999999e-05 2024-09-13T06:43:19.343 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:19.343 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:19.343 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:19.343 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:12.405667+0000", 2024-09-13T06:43:19.343 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0272381690000001 2024-09-13T06:43:19.343 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:19.343 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:19.343 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:19.343 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:12.405848+0000", 2024-09-13T06:43:19.343 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00018112 2024-09-13T06:43:19.343 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:19.344 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:19.344 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:19.344 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:19.344 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:19.344 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:70346 3.16 3:69d35907:::rbd_object_map.11214956a993:head [read 0~36] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e122)", 2024-09-13T06:43:19.344 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:41:16.390917+0000", 2024-09-13T06:43:19.344 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 122.90886694300001, 2024-09-13T06:43:19.344 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.99327479799999996, 2024-09-13T06:43:19.344 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:19.344 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:19.344 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:19.344 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:19.344 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:19.344 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 70346 2024-09-13T06:43:19.345 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:19.345 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:19.345 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:19.345 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:19.345 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:16.390917+0000", 2024-09-13T06:43:19.345 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:19.345 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:19.345 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:19.345 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:19.345 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:16.390917+0000", 2024-09-13T06:43:19.345 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:19.345 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:19.345 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:19.345 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:19.346 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:16.390916+0000", 2024-09-13T06:43:19.346 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999986 2024-09-13T06:43:19.346 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:19.346 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:19.346 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:19.346 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:16.390922+0000", 2024-09-13T06:43:19.346 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.0480000000000004e-06 2024-09-13T06:43:19.346 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:19.346 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:19.346 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:19.346 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:16.390933+0000", 2024-09-13T06:43:19.346 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1387e-05 2024-09-13T06:43:19.346 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:19.346 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:19.346 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:19.347 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:16.390939+0000", 2024-09-13T06:43:19.347 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.8039999999999998e-06 2024-09-13T06:43:19.347 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:19.347 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:19.347 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:19.347 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:16.390983+0000", 2024-09-13T06:43:19.347 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.4663000000000003e-05 2024-09-13T06:43:19.347 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:19.347 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:19.347 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:43:19.347 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:16.390991+0000", 2024-09-13T06:43:19.347 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.8059999999999995e-06 2024-09-13T06:43:19.347 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:19.347 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:19.348 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:19.348 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:17.383624+0000", 2024-09-13T06:43:19.348 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.99263277299999997 2024-09-13T06:43:19.348 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:19.348 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:19.348 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:19.348 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:17.383891+0000", 2024-09-13T06:43:19.348 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00026717599999999999 2024-09-13T06:43:19.348 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:19.348 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:19.348 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:19.348 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:17.384192+0000", 2024-09-13T06:43:19.348 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00030047400000000001 2024-09-13T06:43:19.348 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:19.349 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:19.349 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:19.349 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:19.349 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:19.349 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:181624 3.1d 3:be5d0ef9:::rbd_data.11218aab7a9c.0000000000000000:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e203)", 2024-09-13T06:43:19.349 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:42:45.701744+0000", 2024-09-13T06:43:19.349 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 33.598040023000003, 2024-09-13T06:43:19.349 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.69964504800000005, 2024-09-13T06:43:19.349 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:19.349 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:19.349 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:19.349 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:19.349 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:19.350 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 181624 2024-09-13T06:43:19.350 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:19.350 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:19.350 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:19.350 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:19.350 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.701744+0000", 2024-09-13T06:43:19.350 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:19.350 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:19.350 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:19.350 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:19.350 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.701744+0000", 2024-09-13T06:43:19.350 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:19.350 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:19.350 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:19.351 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:19.351 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.701741+0000", 2024-09-13T06:43:19.351 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999976 2024-09-13T06:43:19.351 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:19.351 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:19.351 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:19.351 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.701754+0000", 2024-09-13T06:43:19.351 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2632999999999999e-05 2024-09-13T06:43:19.351 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:19.351 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:19.351 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:19.351 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.701789+0000", 2024-09-13T06:43:19.351 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.4993999999999997e-05 2024-09-13T06:43:19.351 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:19.352 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:19.352 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:19.352 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.701806+0000", 2024-09-13T06:43:19.352 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7016000000000001e-05 2024-09-13T06:43:19.352 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:19.352 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:19.352 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:19.352 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.701905+0000", 2024-09-13T06:43:19.352 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.8895999999999996e-05 2024-09-13T06:43:19.352 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:19.352 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:19.352 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:43:19.352 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.701920+0000", 2024-09-13T06:43:19.352 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5013e-05 2024-09-13T06:43:19.353 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:19.353 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:19.353 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:19.353 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.400672+0000", 2024-09-13T06:43:19.353 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.69875254499999995 2024-09-13T06:43:19.353 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:19.353 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:19.353 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:19.353 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.401034+0000", 2024-09-13T06:43:19.353 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00036181700000000001 2024-09-13T06:43:19.353 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:19.353 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:19.353 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:19.353 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.401389+0000", 2024-09-13T06:43:19.354 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00035464399999999999 2024-09-13T06:43:19.354 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:19.354 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:19.354 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:19.354 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:19.354 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:19.354 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:181638 3.1d 3:be5d0ef9:::rbd_data.11218aab7a9c.0000000000000000:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e203)", 2024-09-13T06:43:19.354 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:42:45.707356+0000", 2024-09-13T06:43:19.354 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 33.592427284000003, 2024-09-13T06:43:19.354 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.694720479, 2024-09-13T06:43:19.354 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:19.354 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:19.354 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:19.354 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:19.354 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:19.355 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 181638 2024-09-13T06:43:19.355 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:19.355 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:19.355 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:19.355 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:19.355 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707356+0000", 2024-09-13T06:43:19.355 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:19.355 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:19.355 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:19.355 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:19.355 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707356+0000", 2024-09-13T06:43:19.355 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:19.355 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:19.355 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:19.355 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:19.356 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707355+0000", 2024-09-13T06:43:19.356 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999981 2024-09-13T06:43:19.356 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:19.356 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:19.356 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:19.356 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707375+0000", 2024-09-13T06:43:19.356 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.0698000000000001e-05 2024-09-13T06:43:19.356 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:19.356 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:19.356 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:19.356 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707396+0000", 2024-09-13T06:43:19.356 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.1041000000000001e-05 2024-09-13T06:43:19.356 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:19.356 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:19.357 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:19.357 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707408+0000", 2024-09-13T06:43:19.357 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1583000000000001e-05 2024-09-13T06:43:19.357 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:19.357 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:19.357 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:19.357 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707513+0000", 2024-09-13T06:43:19.357 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000104981 2024-09-13T06:43:19.357 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:19.357 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:19.357 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:43:19.357 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707541+0000", 2024-09-13T06:43:19.357 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.8572999999999999e-05 2024-09-13T06:43:19.358 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:19.358 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:19.358 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:19.358 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.401666+0000", 2024-09-13T06:43:19.358 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.694124988 2024-09-13T06:43:19.358 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:19.358 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:19.358 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:19.358 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.401880+0000", 2024-09-13T06:43:19.358 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00021322100000000001 2024-09-13T06:43:19.358 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:19.358 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:19.358 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:19.358 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.402077+0000", 2024-09-13T06:43:19.358 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000197321 2024-09-13T06:43:19.359 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:19.359 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:19.359 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:19.359 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:19.359 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:19.359 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:181652 3.1d 3:be5d0ef9:::rbd_data.11218aab7a9c.0000000000000000:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e203)", 2024-09-13T06:43:19.359 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:42:45.707423+0000", 2024-09-13T06:43:19.359 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 33.592360753000001, 2024-09-13T06:43:19.359 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.69480806699999997, 2024-09-13T06:43:19.359 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:19.359 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:19.359 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:19.359 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:19.359 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:19.359 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 181652 2024-09-13T06:43:19.360 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:19.360 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:19.360 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:19.360 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:19.360 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707423+0000", 2024-09-13T06:43:19.360 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:19.360 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:19.360 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:19.360 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:19.360 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707423+0000", 2024-09-13T06:43:19.360 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:19.360 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:19.360 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:19.360 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:19.361 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707423+0000", 2024-09-13T06:43:19.361 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:19.361 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:19.361 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:19.361 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:19.361 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707427+0000", 2024-09-13T06:43:19.361 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.2010000000000001e-06 2024-09-13T06:43:19.361 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:19.361 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:19.361 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:19.361 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707442+0000", 2024-09-13T06:43:19.361 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.4993e-05 2024-09-13T06:43:19.361 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:19.361 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:19.362 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:19.362 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707447+0000", 2024-09-13T06:43:19.362 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.2170000000000002e-06 2024-09-13T06:43:19.362 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:19.362 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:19.362 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:19.362 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707656+0000", 2024-09-13T06:43:19.362 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00020908600000000001 2024-09-13T06:43:19.362 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:19.362 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:19.362 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:43:19.362 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707684+0000", 2024-09-13T06:43:19.362 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.7766000000000001e-05 2024-09-13T06:43:19.363 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:19.363 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:19.363 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:19.363 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.402101+0000", 2024-09-13T06:43:19.363 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.69441698100000004 2024-09-13T06:43:19.363 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:19.363 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:19.363 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:19.363 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.402156+0000", 2024-09-13T06:43:19.363 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.4725000000000002e-05 2024-09-13T06:43:19.363 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:19.363 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:19.363 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:19.364 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.402231+0000", 2024-09-13T06:43:19.364 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5587999999999995e-05 2024-09-13T06:43:19.364 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:19.364 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:19.364 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:19.364 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:19.364 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:19.364 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:181666 3.1d 3:be5d0ef9:::rbd_data.11218aab7a9c.0000000000000000:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e203)", 2024-09-13T06:43:19.364 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:42:45.707478+0000", 2024-09-13T06:43:19.364 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 33.592305566999997, 2024-09-13T06:43:19.364 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.69543359900000001, 2024-09-13T06:43:19.364 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:19.364 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:19.365 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:19.365 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:19.365 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:19.365 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 181666 2024-09-13T06:43:19.365 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:19.365 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:19.365 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:19.365 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:19.365 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707478+0000", 2024-09-13T06:43:19.365 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:19.365 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:19.365 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:19.365 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:19.366 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707478+0000", 2024-09-13T06:43:19.366 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:19.366 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:19.366 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:19.366 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:19.366 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707478+0000", 2024-09-13T06:43:19.366 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:19.366 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:19.366 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:19.366 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:19.366 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707481+0000", 2024-09-13T06:43:19.366 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.3589999999999999e-06 2024-09-13T06:43:19.366 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:19.366 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:19.367 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:19.367 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707492+0000", 2024-09-13T06:43:19.367 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0725e-05 2024-09-13T06:43:19.367 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:19.367 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:19.367 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:19.367 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707500+0000", 2024-09-13T06:43:19.367 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.1089999999999998e-06 2024-09-13T06:43:19.367 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:19.367 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:19.367 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:19.367 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707773+0000", 2024-09-13T06:43:19.367 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000273291 2024-09-13T06:43:19.367 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:19.368 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:19.368 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:43:19.368 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707784+0000", 2024-09-13T06:43:19.368 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0441999999999999e-05 2024-09-13T06:43:19.368 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:19.368 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:19.368 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:19.368 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.402290+0000", 2024-09-13T06:43:19.368 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.69450651500000005 2024-09-13T06:43:19.368 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:19.368 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:19.368 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:19.368 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.402489+0000", 2024-09-13T06:43:19.369 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000198999 2024-09-13T06:43:19.369 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:19.369 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:19.369 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:19.369 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.402912+0000", 2024-09-13T06:43:19.369 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00042257299999999998 2024-09-13T06:43:19.369 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:19.369 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:19.369 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:19.369 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:19.369 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:19.369 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:181680 3.1d 3:be5d0ef9:::rbd_data.11218aab7a9c.0000000000000000:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e203)", 2024-09-13T06:43:19.369 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:42:45.707517+0000", 2024-09-13T06:43:19.369 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 33.592266531, 2024-09-13T06:43:19.370 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.69532440799999995, 2024-09-13T06:43:19.370 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:19.370 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:19.370 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:19.370 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:19.370 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:19.370 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 181680 2024-09-13T06:43:19.370 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:19.370 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:19.370 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:19.370 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:19.370 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707517+0000", 2024-09-13T06:43:19.370 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:19.370 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:19.370 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:19.371 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:19.371 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707517+0000", 2024-09-13T06:43:19.371 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:19.371 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:19.371 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:19.371 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:19.371 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707517+0000", 2024-09-13T06:43:19.371 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:19.371 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:19.371 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:19.371 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:19.371 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707519+0000", 2024-09-13T06:43:19.371 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.2800000000000002e-06 2024-09-13T06:43:19.371 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:19.371 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:19.371 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:19.372 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707527+0000", 2024-09-13T06:43:19.372 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.2660000000000001e-06 2024-09-13T06:43:19.372 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:19.372 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:19.372 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:19.372 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707535+0000", 2024-09-13T06:43:19.372 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.1760000000000004e-06 2024-09-13T06:43:19.372 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:19.372 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:19.372 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:19.372 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707838+0000", 2024-09-13T06:43:19.372 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00030318000000000001 2024-09-13T06:43:19.372 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:19.373 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:19.373 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:43:19.373 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707850+0000", 2024-09-13T06:43:19.373 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1787000000000001e-05 2024-09-13T06:43:19.373 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:19.373 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:19.373 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:19.373 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.402702+0000", 2024-09-13T06:43:19.373 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.69485264599999996 2024-09-13T06:43:19.373 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:19.373 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:19.373 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:19.373 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.402783+0000", 2024-09-13T06:43:19.373 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.1114999999999998e-05 2024-09-13T06:43:19.374 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:19.374 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:19.374 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:19.374 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.402842+0000", 2024-09-13T06:43:19.374 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.8322999999999997e-05 2024-09-13T06:43:19.374 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:19.374 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:19.374 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:19.374 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:19.374 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:19.374 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:181694 3.1d 3:be5d0ef9:::rbd_data.11218aab7a9c.0000000000000000:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e203)", 2024-09-13T06:43:19.374 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:42:45.707544+0000", 2024-09-13T06:43:19.374 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 33.592239839000001, 2024-09-13T06:43:19.374 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.69580726699999995, 2024-09-13T06:43:19.374 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:19.375 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:19.375 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:19.375 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:19.375 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:19.375 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 181694 2024-09-13T06:43:19.375 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:19.375 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:19.375 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:19.375 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:19.375 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707544+0000", 2024-09-13T06:43:19.375 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:19.375 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:19.375 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:19.375 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:19.375 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707544+0000", 2024-09-13T06:43:19.376 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:19.376 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:19.376 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:19.376 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:19.376 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707543+0000", 2024-09-13T06:43:19.376 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:19.376 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:19.376 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:19.376 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:19.376 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707561+0000", 2024-09-13T06:43:19.376 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7804000000000001e-05 2024-09-13T06:43:19.376 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:19.376 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:19.376 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:19.377 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707575+0000", 2024-09-13T06:43:19.377 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3884e-05 2024-09-13T06:43:19.377 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:19.377 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:19.377 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:19.377 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707583+0000", 2024-09-13T06:43:19.377 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5730000000000002e-06 2024-09-13T06:43:19.377 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:19.377 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:19.377 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:19.377 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707899+0000", 2024-09-13T06:43:19.377 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00031663999999999998 2024-09-13T06:43:19.377 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:19.377 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:19.377 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:43:19.378 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707908+0000", 2024-09-13T06:43:19.378 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.1430000000000004e-06 2024-09-13T06:43:19.378 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:19.378 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:19.378 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:19.378 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.402973+0000", 2024-09-13T06:43:19.378 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.69506426099999996 2024-09-13T06:43:19.378 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:19.378 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:19.378 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:19.378 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.403155+0000", 2024-09-13T06:43:19.378 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00018245199999999999 2024-09-13T06:43:19.378 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:19.378 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:19.378 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:19.379 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.403351+0000", 2024-09-13T06:43:19.379 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000196028 2024-09-13T06:43:19.379 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:19.379 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:19.379 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:19.379 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:19.379 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:19.379 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:181708 3.1d 3:be5d0ef9:::rbd_data.11218aab7a9c.0000000000000000:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e203)", 2024-09-13T06:43:19.379 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:42:45.707622+0000", 2024-09-13T06:43:19.379 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 33.592161795000003, 2024-09-13T06:43:19.379 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.69603707699999995, 2024-09-13T06:43:19.379 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:19.379 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:19.379 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:19.380 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:19.380 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:19.380 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 181708 2024-09-13T06:43:19.380 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:19.380 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:19.380 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:19.380 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:19.380 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707622+0000", 2024-09-13T06:43:19.380 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:19.380 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:19.380 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:19.380 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:19.380 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707622+0000", 2024-09-13T06:43:19.380 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:19.381 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:19.381 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:19.381 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:19.381 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707621+0000", 2024-09-13T06:43:19.381 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:19.381 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:19.381 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:19.381 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:19.381 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707624+0000", 2024-09-13T06:43:19.381 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.8210000000000002e-06 2024-09-13T06:43:19.381 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:19.381 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:19.381 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:19.381 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707631+0000", 2024-09-13T06:43:19.381 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.8460000000000002e-06 2024-09-13T06:43:19.382 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:19.382 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:19.382 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:19.382 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707635+0000", 2024-09-13T06:43:19.382 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.4610000000000001e-06 2024-09-13T06:43:19.382 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:19.382 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:19.382 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:19.382 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707955+0000", 2024-09-13T06:43:19.382 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00031982000000000001 2024-09-13T06:43:19.382 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:19.382 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:19.382 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:43:19.383 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707966+0000", 2024-09-13T06:43:19.383 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0822000000000001e-05 2024-09-13T06:43:19.383 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:19.383 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:19.383 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:19.383 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.403541+0000", 2024-09-13T06:43:19.383 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.69557444300000004 2024-09-13T06:43:19.383 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:19.383 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:19.383 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:19.383 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.403598+0000", 2024-09-13T06:43:19.383 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.7147e-05 2024-09-13T06:43:19.383 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:19.384 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:19.384 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:19.384 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.403659+0000", 2024-09-13T06:43:19.384 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.1373999999999999e-05 2024-09-13T06:43:19.384 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:19.384 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:19.384 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:19.384 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:19.384 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:19.384 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:181722 3.1d 3:be5d0ef9:::rbd_data.11218aab7a9c.0000000000000000:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e203)", 2024-09-13T06:43:19.384 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:42:45.707640+0000", 2024-09-13T06:43:19.384 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 33.592143344, 2024-09-13T06:43:19.384 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.69620305800000004, 2024-09-13T06:43:19.384 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:19.385 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:19.385 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:19.385 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:19.385 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:19.385 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 181722 2024-09-13T06:43:19.385 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:19.385 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:19.385 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:19.385 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:19.385 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707640+0000", 2024-09-13T06:43:19.385 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:19.385 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:19.385 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:19.386 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:19.386 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707640+0000", 2024-09-13T06:43:19.386 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:19.386 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:19.386 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:19.386 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:19.386 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707640+0000", 2024-09-13T06:43:19.386 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:19.386 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:19.386 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:19.386 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:19.386 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707643+0000", 2024-09-13T06:43:19.386 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.213e-06 2024-09-13T06:43:19.386 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:19.387 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:19.387 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:19.387 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707651+0000", 2024-09-13T06:43:19.387 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.2290000000000003e-06 2024-09-13T06:43:19.387 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:19.387 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:19.387 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:19.387 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707656+0000", 2024-09-13T06:43:19.387 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.9320000000000004e-06 2024-09-13T06:43:19.387 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:19.387 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:19.387 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:19.387 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.708012+0000", 2024-09-13T06:43:19.387 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00035600600000000002 2024-09-13T06:43:19.388 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:19.388 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:19.388 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:43:19.388 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.708024+0000", 2024-09-13T06:43:19.388 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1336e-05 2024-09-13T06:43:19.388 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:19.388 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:19.388 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:19.388 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.403696+0000", 2024-09-13T06:43:19.388 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.69567234499999997 2024-09-13T06:43:19.388 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:19.388 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:19.388 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:19.388 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.403757+0000", 2024-09-13T06:43:19.389 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.0715999999999999e-05 2024-09-13T06:43:19.389 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:19.389 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:19.389 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:19.389 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.403843+0000", 2024-09-13T06:43:19.389 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6679000000000001e-05 2024-09-13T06:43:19.389 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:19.389 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:19.389 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:19.389 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:19.389 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:19.389 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:181736 3.1d 3:be5d0ef9:::rbd_data.11218aab7a9c.0000000000000000:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e203)", 2024-09-13T06:43:19.389 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:42:45.707661+0000", 2024-09-13T06:43:19.389 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 33.592122977000002, 2024-09-13T06:43:19.389 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.69667210700000004, 2024-09-13T06:43:19.390 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:19.390 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:19.390 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:19.390 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:19.390 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:19.390 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 181736 2024-09-13T06:43:19.390 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:19.390 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:19.390 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:19.390 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:19.390 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707661+0000", 2024-09-13T06:43:19.390 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:19.391 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:19.391 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:19.391 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:19.391 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707661+0000", 2024-09-13T06:43:19.391 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:19.391 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:19.391 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:19.391 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:19.391 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707660+0000", 2024-09-13T06:43:19.391 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:19.391 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:19.391 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:19.391 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:19.391 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707664+0000", 2024-09-13T06:43:19.391 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.393e-06 2024-09-13T06:43:19.392 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:19.392 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:19.392 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:19.392 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707673+0000", 2024-09-13T06:43:19.392 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.5100000000000004e-06 2024-09-13T06:43:19.392 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:19.392 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:19.392 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:19.392 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707680+0000", 2024-09-13T06:43:19.392 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.8680000000000001e-06 2024-09-13T06:43:19.392 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:19.392 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:19.392 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:19.392 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.708068+0000", 2024-09-13T06:43:19.393 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00038784699999999997 2024-09-13T06:43:19.393 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:19.393 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:19.393 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:43:19.393 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.708078+0000", 2024-09-13T06:43:19.393 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.842e-06 2024-09-13T06:43:19.393 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:19.393 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:19.393 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:19.393 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.403924+0000", 2024-09-13T06:43:19.393 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.69584657699999997 2024-09-13T06:43:19.393 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:19.394 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:19.394 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:19.394 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.404135+0000", 2024-09-13T06:43:19.394 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000210662 2024-09-13T06:43:19.394 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:19.394 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:19.394 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:19.394 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.404333+0000", 2024-09-13T06:43:19.394 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00019787900000000001 2024-09-13T06:43:19.394 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:19.394 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:19.394 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:19.394 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:19.395 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:19.395 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:181750 3.1d 3.9f70ba7d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e203)", 2024-09-13T06:43:19.395 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:42:45.707687+0000", 2024-09-13T06:43:19.395 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 33.592097113999998, 2024-09-13T06:43:19.395 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.69667232199999996, 2024-09-13T06:43:19.395 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:19.395 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:43:19.395 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:19.395 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:19.395 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:19.395 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 181750 2024-09-13T06:43:19.395 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:19.395 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:19.395 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:19.396 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:19.396 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707687+0000", 2024-09-13T06:43:19.396 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:19.396 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:19.396 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:19.396 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:19.396 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707687+0000", 2024-09-13T06:43:19.396 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:19.396 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:19.396 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:19.396 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:19.396 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707686+0000", 2024-09-13T06:43:19.396 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:19.396 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:19.397 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:19.397 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:19.397 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707689+0000", 2024-09-13T06:43:19.397 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.824e-06 2024-09-13T06:43:19.397 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:19.397 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:19.397 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:19.397 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707693+0000", 2024-09-13T06:43:19.397 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.5900000000000001e-06 2024-09-13T06:43:19.397 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:19.397 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:19.397 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:19.397 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707697+0000", 2024-09-13T06:43:19.397 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.6899999999999998e-06 2024-09-13T06:43:19.398 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:19.398 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:19.398 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:19.398 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.708109+0000", 2024-09-13T06:43:19.398 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00041220200000000002 2024-09-13T06:43:19.398 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:19.398 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:19.398 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:43:19.398 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.708118+0000", 2024-09-13T06:43:19.398 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6000000000000007e-06 2024-09-13T06:43:19.398 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:19.398 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:19.398 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:19.398 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.404353+0000", 2024-09-13T06:43:19.399 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.69623486400000001 2024-09-13T06:43:19.399 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:19.399 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:19.399 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:19.399 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.404359+0000", 2024-09-13T06:43:19.399 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.2480000000000001e-06 2024-09-13T06:43:19.399 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:19.399 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:19.399 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:19.399 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:19.399 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:19.399 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:43:19.400 INFO:teuthology.orchestra.run.smithi081.stdout:osd.0: {} 2024-09-13T06:43:19.401 INFO:teuthology.orchestra.run.smithi081.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-13T06:43:19.401 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:43:19.400+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:43:19.402 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-13T06:43:19.404 INFO:teuthology.orchestra.run.smithi081.stdout:osd.1: {} 2024-09-13T06:43:19.405 INFO:teuthology.orchestra.run.smithi081.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-13T06:43:19.422 INFO:teuthology.orchestra.run.smithi081.stdout:osd.2: {} 2024-09-13T06:43:19.422 INFO:teuthology.orchestra.run.smithi081.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-13T06:43:19.439 INFO:teuthology.orchestra.run.smithi081.stdout:osd.3: {} 2024-09-13T06:43:19.439 INFO:teuthology.orchestra.run.smithi081.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-13T06:43:19.457 INFO:teuthology.orchestra.run.smithi081.stdout:osd.4: {} 2024-09-13T06:43:19.458 INFO:teuthology.orchestra.run.smithi081.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-13T06:43:19.475 INFO:teuthology.orchestra.run.smithi081.stdout:osd.5: {} 2024-09-13T06:43:19.476 INFO:teuthology.orchestra.run.smithi081.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-13T06:43:19.476 INFO:teuthology.orchestra.run.smithi081.stderr:Error ENXIO: problem getting command descriptions from osd.6 2024-09-13T06:43:19.489 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-13T06:43:19.503 INFO:teuthology.orchestra.run.smithi081.stdout:osd.7: {} 2024-09-13T06:43:19.503 INFO:teuthology.orchestra.run.smithi081.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-13T06:43:19.503 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:43:19.504+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:43:19.507 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-13T06:43:19.508 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-13T06:43:19.538 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:43:19.538 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:43:19.553 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-13T06:43:19.605 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:43:19.604+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:43:19.678 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:43:19.678 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:43:19.692 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-13T06:43:19.735 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-13T06:43:19.737+0000 7fa8bb18e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 36790) UID: 0 2024-09-13T06:43:19.804 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:43:19.805+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:43:19.807 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:43:19.807 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:43:19.822 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-13T06:43:19.905 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:43:19.904+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:43:19.940 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:43:19.941 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:43:19.954 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-13T06:43:20.006 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:43:20.005+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:43:20.107 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:43:20.108+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:43:20.117 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:43:20.117 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:43:20.132 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-13T06:43:20.208 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:43:20.209+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:43:20.296 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:43:20.296 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:43:20.309 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:43:20.308+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:43:20.310 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-13T06:43:20.365 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 7, 5, 3, 4] out_osds: [6] dead_osds: [6] live_osds: [0, 1, 2, 3, 4, 5, 7] 2024-09-13T06:43:20.365 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-13T06:43:20.365 INFO:tasks.thrashosds.thrasher:primary_affinity 2024-09-13T06:43:20.365 INFO:tasks.thrashosds.thrasher:Setting osd 5 primary_affinity to 0.000000 2024-09-13T06:43:20.365 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 5 0 2024-09-13T06:43:20.450 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:43:20.452+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:43:20.485 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:43:20.485 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:43:20.502 INFO:teuthology.orchestra.run.smithi081.stderr:noscrub is unset 2024-09-13T06:43:20.507 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-13T06:43:20.529 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:43:20.528+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:43:20.618 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:43:20.620+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:43:20.694 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:43:20.694 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:43:20.709 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-13T06:43:20.711 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:43:20.713+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:43:20.812 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:43:20.813+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:43:20.872 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:43:20.873 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:43:20.887 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-13T06:43:20.913 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:43:20.913+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:43:21.005 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:43:21.006 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:43:21.014 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:43:21.015+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:43:21.020 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-13T06:43:21.115 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:43:21.115+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:43:21.184 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:43:21.184 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:43:21.199 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-13T06:43:21.216 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:43:21.217+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:43:21.318 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:43:21.317+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:43:21.362 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:43:21.362 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:43:21.376 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-13T06:43:21.404 INFO:teuthology.orchestra.run.smithi081.stderr:set osd.5 primary-affinity to 0 (802) 2024-09-13T06:43:21.419 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:43:21.417+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:43:21.508 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-13T06:43:21.514 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:43:21.514 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:43:21.520 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-13T06:43:21.521+0000 7fa8bb18e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 36790) UID: 0 2024-09-13T06:43:21.532 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-13T06:43:21.621 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:43:21.619+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:43:21.652 INFO:teuthology.orchestra.run.smithi081.stdout:osd.0: {} 2024-09-13T06:43:21.652 INFO:teuthology.orchestra.run.smithi081.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-13T06:43:21.684 INFO:teuthology.orchestra.run.smithi081.stdout:osd.1: {} 2024-09-13T06:43:21.684 INFO:teuthology.orchestra.run.smithi081.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-13T06:43:21.714 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:43:21.714 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:43:21.715 INFO:teuthology.orchestra.run.smithi081.stdout:osd.2: {} 2024-09-13T06:43:21.715 INFO:teuthology.orchestra.run.smithi081.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-13T06:43:21.721 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:43:21.719+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:43:21.734 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-13T06:43:21.741 INFO:teuthology.orchestra.run.smithi081.stdout:osd.3: {} 2024-09-13T06:43:21.742 INFO:teuthology.orchestra.run.smithi081.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-13T06:43:21.762 INFO:teuthology.orchestra.run.smithi081.stdout:osd.4: {} 2024-09-13T06:43:21.763 INFO:teuthology.orchestra.run.smithi081.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-13T06:43:21.783 INFO:teuthology.orchestra.run.smithi081.stdout:osd.5: {} 2024-09-13T06:43:21.783 INFO:teuthology.orchestra.run.smithi081.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-13T06:43:21.783 INFO:teuthology.orchestra.run.smithi081.stderr:Error ENXIO: problem getting command descriptions from osd.6 2024-09-13T06:43:21.803 INFO:teuthology.orchestra.run.smithi081.stdout:osd.7: {} 2024-09-13T06:43:21.803 INFO:teuthology.orchestra.run.smithi081.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-13T06:43:21.807 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-13T06:43:21.808 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-13T06:43:21.850 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:43:21.851+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:43:21.859 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:43:21.859 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 20, 2024-09-13T06:43:21.859 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 600, 2024-09-13T06:43:21.859 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [ 2024-09-13T06:43:21.859 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:21.860 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:2226 3.15 3:af026987:::rbd_data.112173e2f1b7.0000000000000017:head [sparse-read 0~4194304] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-13T06:43:21.860 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:37.606562+0000", 2024-09-13T06:43:21.860 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 224.253342704, 2024-09-13T06:43:21.860 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.83322091700000001, 2024-09-13T06:43:21.860 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:21.860 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:43:21.860 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:21.860 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:21.860 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:21.861 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 2226 2024-09-13T06:43:21.861 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:21.861 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:21.861 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:21.861 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:21.861 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606562+0000", 2024-09-13T06:43:21.861 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:21.861 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:21.861 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:21.861 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:21.862 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606562+0000", 2024-09-13T06:43:21.862 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:21.862 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:21.862 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:21.862 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:21.862 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606561+0000", 2024-09-13T06:43:21.862 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:21.862 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:21.862 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:21.862 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:21.862 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606565+0000", 2024-09-13T06:43:21.862 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.4379999999999999e-06 2024-09-13T06:43:21.863 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:21.863 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:21.863 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:21.863 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606569+0000", 2024-09-13T06:43:21.863 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.425e-06 2024-09-13T06:43:21.863 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:21.863 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:21.863 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:21.863 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606572+0000", 2024-09-13T06:43:21.863 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.05e-06 2024-09-13T06:43:21.863 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:21.864 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:21.864 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:21.864 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606621+0000", 2024-09-13T06:43:21.864 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.8723000000000001e-05 2024-09-13T06:43:21.864 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:21.864 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:21.864 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:43:21.864 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606630+0000", 2024-09-13T06:43:21.864 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.8040000000000007e-06 2024-09-13T06:43:21.864 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:21.864 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:21.864 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:21.865 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.439648+0000", 2024-09-13T06:43:21.865 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.83301824800000002 2024-09-13T06:43:21.865 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:21.865 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:21.865 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:21.865 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.439782+0000", 2024-09-13T06:43:21.865 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00013466699999999999 2024-09-13T06:43:21.865 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:21.865 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:21.865 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:21.865 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:21.866 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:21.866 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25661 3.8 3:1180686c:::rbd_data.1121f2c5ee81.0000000000000009:13 [read 397312~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:43:21.866 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.436956+0000", 2024-09-13T06:43:21.866 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 205.42294817000001, 2024-09-13T06:43:21.866 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089036758999999993, 2024-09-13T06:43:21.866 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:21.866 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:21.866 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:21.866 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:21.866 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:21.866 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25661 2024-09-13T06:43:21.867 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:21.867 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:21.867 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:21.867 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:21.867 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436956+0000", 2024-09-13T06:43:21.867 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:21.867 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:21.867 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:21.867 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:21.867 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436956+0000", 2024-09-13T06:43:21.867 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:21.867 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:21.867 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:21.868 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:21.868 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436956+0000", 2024-09-13T06:43:21.868 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:21.868 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:21.868 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:21.868 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:21.868 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436958+0000", 2024-09-13T06:43:21.868 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1770000000000001e-06 2024-09-13T06:43:21.868 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:21.868 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:21.868 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:21.869 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436963+0000", 2024-09-13T06:43:21.869 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.6489999999999996e-06 2024-09-13T06:43:21.869 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:21.869 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:21.869 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:21.869 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436975+0000", 2024-09-13T06:43:21.869 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1783999999999999e-05 2024-09-13T06:43:21.869 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:21.869 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:21.870 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:21.870 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.525671+0000", 2024-09-13T06:43:21.870 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.088696292999999995 2024-09-13T06:43:21.870 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:21.870 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:21.870 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:21.870 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.525749+0000", 2024-09-13T06:43:21.870 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.7589000000000005e-05 2024-09-13T06:43:21.870 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:21.870 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:21.870 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:21.870 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.525993+0000", 2024-09-13T06:43:21.871 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00024381000000000001 2024-09-13T06:43:21.871 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:21.871 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:21.871 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:21.871 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:21.871 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:21.871 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25662 3.8 3:1180686c:::rbd_data.1121f2c5ee81.0000000000000009:13 [read 421888~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:43:21.871 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.436980+0000", 2024-09-13T06:43:21.871 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 205.42292385799999, 2024-09-13T06:43:21.871 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089367577000000004, 2024-09-13T06:43:21.871 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:21.871 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:21.872 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:21.872 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:21.872 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:21.872 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25662 2024-09-13T06:43:21.872 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:21.872 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:21.872 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:21.872 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:21.872 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436980+0000", 2024-09-13T06:43:21.872 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:21.872 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:21.873 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:21.873 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:21.873 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436980+0000", 2024-09-13T06:43:21.873 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:21.873 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:21.873 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:21.873 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:21.873 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436980+0000", 2024-09-13T06:43:21.873 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:21.873 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:21.874 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:21.874 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:21.874 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436982+0000", 2024-09-13T06:43:21.874 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3989999999999998e-06 2024-09-13T06:43:21.874 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:21.874 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:21.874 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:21.874 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436988+0000", 2024-09-13T06:43:21.875 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0039999999999996e-06 2024-09-13T06:43:21.875 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:21.875 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:21.875 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:21.875 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436993+0000", 2024-09-13T06:43:21.875 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6090000000000003e-06 2024-09-13T06:43:21.875 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:21.875 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:21.875 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:21.875 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.526035+0000", 2024-09-13T06:43:21.875 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089042248000000004 2024-09-13T06:43:21.875 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:21.876 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:21.876 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:21.876 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.526111+0000", 2024-09-13T06:43:21.876 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5643999999999996e-05 2024-09-13T06:43:21.876 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:21.876 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:21.876 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:21.876 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.526348+0000", 2024-09-13T06:43:21.877 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00023705800000000001 2024-09-13T06:43:21.877 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:21.877 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:21.877 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:21.877 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:21.877 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:21.878 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25663 3.8 3:1180686c:::rbd_data.1121f2c5ee81.0000000000000009:13 [read 466944~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:43:21.878 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.436998+0000", 2024-09-13T06:43:21.878 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 205.422906211, 2024-09-13T06:43:21.878 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089730867000000006, 2024-09-13T06:43:21.878 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:21.878 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:21.878 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:21.878 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:21.878 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:21.878 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25663 2024-09-13T06:43:21.878 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:21.879 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:21.879 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:21.879 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:21.879 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436998+0000", 2024-09-13T06:43:21.879 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:21.879 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:21.879 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:21.879 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:21.879 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436998+0000", 2024-09-13T06:43:21.879 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:21.879 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:21.879 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:21.880 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:21.880 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436998+0000", 2024-09-13T06:43:21.880 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:21.880 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:21.880 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:21.880 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:21.880 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437000+0000", 2024-09-13T06:43:21.880 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0940000000000002e-06 2024-09-13T06:43:21.880 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:21.880 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:21.880 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:21.881 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437005+0000", 2024-09-13T06:43:21.881 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.604e-06 2024-09-13T06:43:21.881 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:21.881 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:21.881 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:21.881 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437032+0000", 2024-09-13T06:43:21.881 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6407e-05 2024-09-13T06:43:21.881 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:21.882 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:21.882 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:21.882 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.526363+0000", 2024-09-13T06:43:21.882 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089331456000000004 2024-09-13T06:43:21.882 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:21.882 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:21.882 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:21.882 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.526404+0000", 2024-09-13T06:43:21.882 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.0887999999999999e-05 2024-09-13T06:43:21.882 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:21.882 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:21.883 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:21.883 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.526729+0000", 2024-09-13T06:43:21.883 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00032486 2024-09-13T06:43:21.883 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:21.883 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:21.883 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:21.883 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:21.883 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:21.883 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25664 3.8 3:1180686c:::rbd_data.1121f2c5ee81.0000000000000009:13 [read 491520~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:43:21.883 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.437040+0000", 2024-09-13T06:43:21.883 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 205.422864296, 2024-09-13T06:43:21.884 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.090016650000000004, 2024-09-13T06:43:21.884 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:21.884 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:21.884 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:21.884 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:21.884 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:21.884 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25664 2024-09-13T06:43:21.884 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:21.884 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:21.884 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:21.884 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:21.885 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437040+0000", 2024-09-13T06:43:21.885 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:21.885 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:21.885 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:21.885 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:21.885 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437040+0000", 2024-09-13T06:43:21.885 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:21.885 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:21.885 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:21.885 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:21.886 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437039+0000", 2024-09-13T06:43:21.886 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:21.886 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:21.886 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:21.886 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:21.886 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437047+0000", 2024-09-13T06:43:21.886 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4839999999999998e-06 2024-09-13T06:43:21.886 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:21.886 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:21.886 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:21.886 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437054+0000", 2024-09-13T06:43:21.886 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.8299999999999998e-06 2024-09-13T06:43:21.887 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:21.887 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:21.887 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:21.887 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437060+0000", 2024-09-13T06:43:21.887 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.1510000000000001e-06 2024-09-13T06:43:21.887 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:21.887 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:21.887 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:21.887 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.526772+0000", 2024-09-13T06:43:21.887 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089711737999999999 2024-09-13T06:43:21.888 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:21.888 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:21.888 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:21.888 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.526848+0000", 2024-09-13T06:43:21.888 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5870000000000004e-05 2024-09-13T06:43:21.888 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:21.889 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:21.889 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:21.889 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.527057+0000", 2024-09-13T06:43:21.889 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000209106 2024-09-13T06:43:21.889 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:21.889 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:21.889 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:21.889 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:21.889 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:21.889 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25740 3.18 3:1c662b96:::rbd_data.1121f2c5ee81.0000000000000010:13 [read 200704~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:43:21.889 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443352+0000", 2024-09-13T06:43:21.890 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 205.41655262099999, 2024-09-13T06:43:21.890 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089068222000000002, 2024-09-13T06:43:21.890 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:21.890 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:21.890 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:21.890 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:21.890 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:21.890 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25740 2024-09-13T06:43:21.890 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:21.890 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:21.890 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:21.890 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:21.890 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443352+0000", 2024-09-13T06:43:21.891 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:21.891 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:21.891 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:21.891 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:21.891 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443352+0000", 2024-09-13T06:43:21.891 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:21.891 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:21.891 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:21.891 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:21.891 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443351+0000", 2024-09-13T06:43:21.891 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:21.891 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:21.891 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:21.892 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:21.892 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443354+0000", 2024-09-13T06:43:21.892 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.841e-06 2024-09-13T06:43:21.892 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:21.892 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:21.892 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:21.892 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443361+0000", 2024-09-13T06:43:21.892 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.0010000000000004e-06 2024-09-13T06:43:21.892 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:21.892 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:21.892 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:21.892 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443366+0000", 2024-09-13T06:43:21.892 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7119999999999999e-06 2024-09-13T06:43:21.893 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:21.893 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:21.893 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:21.893 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532117+0000", 2024-09-13T06:43:21.893 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.088751327000000005 2024-09-13T06:43:21.893 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:21.893 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:21.893 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:21.893 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532193+0000", 2024-09-13T06:43:21.893 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5839000000000004e-05 2024-09-13T06:43:21.893 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:21.893 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:21.893 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:21.894 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532420+0000", 2024-09-13T06:43:21.894 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00022691000000000001 2024-09-13T06:43:21.894 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:21.894 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:21.894 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:21.894 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:21.894 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:21.894 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25741 3.18 3:1c662b96:::rbd_data.1121f2c5ee81.0000000000000010:13 [read 225280~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:43:21.894 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443378+0000", 2024-09-13T06:43:21.894 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 205.41652585400001, 2024-09-13T06:43:21.894 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089324107, 2024-09-13T06:43:21.894 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:21.894 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:21.894 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:21.895 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:21.895 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:21.895 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25741 2024-09-13T06:43:21.895 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:21.895 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:21.895 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:21.895 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:21.895 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443378+0000", 2024-09-13T06:43:21.895 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:21.895 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:21.895 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:21.895 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:21.896 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443378+0000", 2024-09-13T06:43:21.896 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:21.896 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:21.896 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:21.896 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:21.896 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443378+0000", 2024-09-13T06:43:21.896 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:21.896 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:21.896 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:21.896 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:21.896 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443380+0000", 2024-09-13T06:43:21.896 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3549999999999999e-06 2024-09-13T06:43:21.897 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:21.897 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:21.897 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:21.897 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443388+0000", 2024-09-13T06:43:21.897 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.7449999999999995e-06 2024-09-13T06:43:21.897 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:21.897 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:21.897 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:21.897 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443393+0000", 2024-09-13T06:43:21.897 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.4e-06 2024-09-13T06:43:21.897 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:21.897 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:21.897 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:21.898 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532454+0000", 2024-09-13T06:43:21.898 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089060941000000005 2024-09-13T06:43:21.898 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:21.898 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:21.898 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:21.898 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532512+0000", 2024-09-13T06:43:21.898 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7763000000000002e-05 2024-09-13T06:43:21.898 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:21.898 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:21.898 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:21.898 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532703+0000", 2024-09-13T06:43:21.898 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000190328 2024-09-13T06:43:21.898 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:21.899 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:21.899 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:21.899 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:21.899 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:21.899 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25742 3.18 3:1c662b96:::rbd_data.1121f2c5ee81.0000000000000010:13 [read 270336~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:43:21.899 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443398+0000", 2024-09-13T06:43:21.899 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 205.416506142, 2024-09-13T06:43:21.899 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089621836999999996, 2024-09-13T06:43:21.899 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:21.899 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:21.899 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:21.899 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:21.899 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:21.900 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25742 2024-09-13T06:43:21.900 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:21.900 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:21.900 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:21.900 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:21.900 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443398+0000", 2024-09-13T06:43:21.900 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:21.900 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:21.900 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:21.900 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:21.900 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443398+0000", 2024-09-13T06:43:21.900 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:21.900 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:21.901 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:21.901 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:21.901 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443398+0000", 2024-09-13T06:43:21.901 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:21.901 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:21.901 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:21.901 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:21.901 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443400+0000", 2024-09-13T06:43:21.901 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1849999999999998e-06 2024-09-13T06:43:21.901 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:21.901 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:21.901 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:21.901 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443407+0000", 2024-09-13T06:43:21.902 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3669999999999999e-06 2024-09-13T06:43:21.902 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:21.902 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:21.902 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:21.902 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443420+0000", 2024-09-13T06:43:21.902 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2645e-05 2024-09-13T06:43:21.902 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:21.902 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:21.902 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:21.902 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532742+0000", 2024-09-13T06:43:21.902 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089322200000000004 2024-09-13T06:43:21.902 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:21.902 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:21.903 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:21.903 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532818+0000", 2024-09-13T06:43:21.903 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.6019000000000005e-05 2024-09-13T06:43:21.903 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:21.903 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:21.903 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:21.903 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533020+0000", 2024-09-13T06:43:21.903 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000201721 2024-09-13T06:43:21.903 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:21.903 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:21.903 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:21.903 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:21.903 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:21.903 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25743 3.18 3:1c662b96:::rbd_data.1121f2c5ee81.0000000000000010:13 [read 294912~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:43:21.904 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443425+0000", 2024-09-13T06:43:21.904 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 205.41647913400001, 2024-09-13T06:43:21.904 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089864075000000002, 2024-09-13T06:43:21.904 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:21.904 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:21.904 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:21.904 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:21.904 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:21.904 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25743 2024-09-13T06:43:21.904 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:21.904 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:21.904 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:21.904 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:21.905 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443425+0000", 2024-09-13T06:43:21.905 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:21.905 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:21.905 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:21.905 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:21.905 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443425+0000", 2024-09-13T06:43:21.905 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:21.905 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:21.905 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:21.905 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:21.905 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443425+0000", 2024-09-13T06:43:21.905 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:21.905 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:21.905 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:21.906 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:21.906 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443432+0000", 2024-09-13T06:43:21.906 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3420000000000002e-06 2024-09-13T06:43:21.906 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:21.906 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:21.906 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:21.906 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443440+0000", 2024-09-13T06:43:21.906 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5689999999999999e-06 2024-09-13T06:43:21.906 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:21.906 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:21.906 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:21.906 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443445+0000", 2024-09-13T06:43:21.907 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9590000000000003e-06 2024-09-13T06:43:21.907 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:21.907 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:21.907 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:21.907 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533063+0000", 2024-09-13T06:43:21.907 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089617988999999995 2024-09-13T06:43:21.907 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:21.907 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:21.907 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:21.907 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533122+0000", 2024-09-13T06:43:21.907 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9052999999999999e-05 2024-09-13T06:43:21.907 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:21.907 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:21.908 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:21.908 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533289+0000", 2024-09-13T06:43:21.908 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00016752800000000001 2024-09-13T06:43:21.908 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:21.908 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:21.908 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:21.908 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:21.908 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:21.908 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25744 3.18 3.69d46638 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:43:21.908 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443449+0000", 2024-09-13T06:43:21.908 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 205.41645498700001, 2024-09-13T06:43:21.908 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089869148999999995, 2024-09-13T06:43:21.908 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:21.909 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:43:21.909 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:21.909 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:21.909 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:21.909 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25744 2024-09-13T06:43:21.909 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:21.909 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:21.909 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:21.909 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:21.909 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443449+0000", 2024-09-13T06:43:21.909 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:21.909 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:21.909 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:21.910 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:21.910 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443449+0000", 2024-09-13T06:43:21.910 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:21.910 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:21.910 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:21.910 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:21.910 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443449+0000", 2024-09-13T06:43:21.910 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:21.910 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:21.910 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:21.910 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:21.910 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443451+0000", 2024-09-13T06:43:21.911 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.244e-06 2024-09-13T06:43:21.911 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:21.911 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:21.911 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:21.911 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443457+0000", 2024-09-13T06:43:21.911 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.66e-06 2024-09-13T06:43:21.911 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:21.911 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:21.911 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:21.911 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443461+0000", 2024-09-13T06:43:21.911 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5449999999999997e-06 2024-09-13T06:43:21.911 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:21.911 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:21.912 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:21.912 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533311+0000", 2024-09-13T06:43:21.912 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089849729000000003 2024-09-13T06:43:21.912 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:21.912 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:21.912 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:21.912 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533318+0000", 2024-09-13T06:43:21.912 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.328e-06 2024-09-13T06:43:21.912 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:21.912 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:21.912 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:21.912 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:21.913 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:21.913 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25745 3.18 3.69d46638 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:43:21.913 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443466+0000", 2024-09-13T06:43:21.913 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 205.41643792900001, 2024-09-13T06:43:21.913 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089886743000000005, 2024-09-13T06:43:21.913 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:21.913 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:43:21.913 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:21.913 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:21.913 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:21.913 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25745 2024-09-13T06:43:21.913 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:21.913 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:21.913 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:21.914 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:21.914 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443466+0000", 2024-09-13T06:43:21.914 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:21.914 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:21.914 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:21.914 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:21.914 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443466+0000", 2024-09-13T06:43:21.914 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:21.914 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:21.914 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:21.914 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:21.914 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443466+0000", 2024-09-13T06:43:21.914 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:21.915 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:21.915 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:21.915 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:21.915 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443474+0000", 2024-09-13T06:43:21.915 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.1289999999999996e-06 2024-09-13T06:43:21.915 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:21.915 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:21.915 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:21.915 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443484+0000", 2024-09-13T06:43:21.915 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0654e-05 2024-09-13T06:43:21.915 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:21.915 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:21.915 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:21.915 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443490+0000", 2024-09-13T06:43:21.916 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8030000000000002e-06 2024-09-13T06:43:21.916 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:21.916 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:21.916 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:21.916 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533348+0000", 2024-09-13T06:43:21.916 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089857267000000005 2024-09-13T06:43:21.916 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:21.916 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:21.916 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:21.917 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533353+0000", 2024-09-13T06:43:21.917 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.5520000000000004e-06 2024-09-13T06:43:21.917 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:21.917 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:21.917 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:21.917 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:21.917 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:21.917 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25746 3.18 3.69d46638 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:43:21.917 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443495+0000", 2024-09-13T06:43:21.917 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 205.416408816, 2024-09-13T06:43:21.917 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089903725000000004, 2024-09-13T06:43:21.917 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:21.917 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:43:21.918 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:21.918 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:21.918 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:21.918 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25746 2024-09-13T06:43:21.918 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:21.918 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:21.918 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:21.918 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:21.918 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443495+0000", 2024-09-13T06:43:21.918 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:21.918 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:21.918 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:21.918 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:21.918 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443495+0000", 2024-09-13T06:43:21.919 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:21.919 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:21.919 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:21.919 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:21.919 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443495+0000", 2024-09-13T06:43:21.919 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:21.919 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:21.919 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:21.919 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:21.919 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443498+0000", 2024-09-13T06:43:21.919 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.7690000000000001e-06 2024-09-13T06:43:21.919 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:21.919 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:21.919 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:21.920 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443504+0000", 2024-09-13T06:43:21.920 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9710000000000001e-06 2024-09-13T06:43:21.920 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:21.920 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:21.920 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:21.920 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443508+0000", 2024-09-13T06:43:21.920 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4159999999999997e-06 2024-09-13T06:43:21.920 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:21.920 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:21.920 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:21.920 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533391+0000", 2024-09-13T06:43:21.920 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089882607000000003 2024-09-13T06:43:21.921 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:21.921 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:21.921 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:21.921 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533399+0000", 2024-09-13T06:43:21.921 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.4349999999999997e-06 2024-09-13T06:43:21.921 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:21.921 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:21.921 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:21.921 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:21.921 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:21.921 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25747 3.8 3.63996268 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:43:21.921 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443512+0000", 2024-09-13T06:43:21.921 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 205.41639208500001, 2024-09-13T06:43:21.922 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089880075000000004, 2024-09-13T06:43:21.922 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:21.922 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:43:21.922 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:21.922 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:21.922 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:21.922 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25747 2024-09-13T06:43:21.922 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:21.922 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:21.922 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:21.922 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:21.922 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443512+0000", 2024-09-13T06:43:21.922 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:21.922 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:21.923 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:21.923 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:21.923 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443512+0000", 2024-09-13T06:43:21.923 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:21.923 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:21.923 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:21.923 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:21.923 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443512+0000", 2024-09-13T06:43:21.923 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:21.923 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:21.923 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:21.923 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:21.923 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443514+0000", 2024-09-13T06:43:21.924 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0980000000000001e-06 2024-09-13T06:43:21.924 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:21.924 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:21.924 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:21.924 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443520+0000", 2024-09-13T06:43:21.924 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7069999999999997e-06 2024-09-13T06:43:21.924 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:21.924 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:21.924 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:21.924 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443524+0000", 2024-09-13T06:43:21.924 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5390000000000001e-06 2024-09-13T06:43:21.924 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:21.924 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:21.925 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:21.925 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533384+0000", 2024-09-13T06:43:21.925 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089859684999999995 2024-09-13T06:43:21.925 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:21.925 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:21.925 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:21.925 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533392+0000", 2024-09-13T06:43:21.925 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.3440000000000001e-06 2024-09-13T06:43:21.925 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:21.925 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:21.925 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:21.925 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:21.925 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:21.926 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25748 3.8 3.63996268 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:43:21.926 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443528+0000", 2024-09-13T06:43:21.926 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 205.416375958, 2024-09-13T06:43:21.926 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089890715999999996, 2024-09-13T06:43:21.926 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:21.926 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:43:21.926 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:21.926 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:21.926 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:21.926 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25748 2024-09-13T06:43:21.926 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:21.926 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:21.927 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:21.927 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:21.927 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443528+0000", 2024-09-13T06:43:21.927 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:21.927 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:21.927 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:21.927 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:21.927 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443528+0000", 2024-09-13T06:43:21.927 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:21.927 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:21.927 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:21.927 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:21.927 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443528+0000", 2024-09-13T06:43:21.928 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:21.928 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:21.928 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:21.928 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:21.928 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443530+0000", 2024-09-13T06:43:21.928 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0650000000000001e-06 2024-09-13T06:43:21.928 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:21.928 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:21.928 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:21.928 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443536+0000", 2024-09-13T06:43:21.928 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7259999999999999e-06 2024-09-13T06:43:21.928 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:21.928 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:21.929 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:21.929 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443540+0000", 2024-09-13T06:43:21.929 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5009999999999998e-06 2024-09-13T06:43:21.929 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:21.929 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:21.929 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:21.929 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533412+0000", 2024-09-13T06:43:21.929 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089871873000000005 2024-09-13T06:43:21.929 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:21.929 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:21.929 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:21.929 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533419+0000", 2024-09-13T06:43:21.929 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.883e-06 2024-09-13T06:43:21.930 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:21.930 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:21.930 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:21.930 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:21.930 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:21.930 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25749 3.8 3.63996268 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:43:21.930 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443545+0000", 2024-09-13T06:43:21.930 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 205.41635976200001, 2024-09-13T06:43:21.930 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089897988999999998, 2024-09-13T06:43:21.931 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:21.931 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:43:21.931 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:21.931 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:21.931 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:21.931 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25749 2024-09-13T06:43:21.931 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:21.931 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:21.931 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:21.931 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:21.931 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443545+0000", 2024-09-13T06:43:21.931 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:21.932 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:21.932 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:21.932 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:21.932 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443545+0000", 2024-09-13T06:43:21.932 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:21.932 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:21.932 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:21.932 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:21.932 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443544+0000", 2024-09-13T06:43:21.932 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:21.932 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:21.932 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:21.932 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:21.933 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443553+0000", 2024-09-13T06:43:21.933 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.4770000000000003e-06 2024-09-13T06:43:21.933 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:21.933 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:21.933 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:21.933 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443564+0000", 2024-09-13T06:43:21.933 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0986e-05 2024-09-13T06:43:21.933 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:21.933 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:21.933 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:21.933 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443569+0000", 2024-09-13T06:43:21.933 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2530000000000004e-06 2024-09-13T06:43:21.933 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:21.934 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:21.934 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:21.934 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533438+0000", 2024-09-13T06:43:21.934 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089868641999999999 2024-09-13T06:43:21.934 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:21.934 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:21.934 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:21.934 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533442+0000", 2024-09-13T06:43:21.934 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.989e-06 2024-09-13T06:43:21.934 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:21.934 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:21.934 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:21.934 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:21.935 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:21.935 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25750 3.8 3.63996268 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:43:21.935 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443574+0000", 2024-09-13T06:43:21.935 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 205.416330276, 2024-09-13T06:43:21.935 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089895143999999996, 2024-09-13T06:43:21.935 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:21.935 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:43:21.935 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:21.935 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:21.935 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:21.935 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25750 2024-09-13T06:43:21.935 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:21.935 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:21.936 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:21.936 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:21.936 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443574+0000", 2024-09-13T06:43:21.936 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:21.936 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:21.936 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:21.936 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:21.936 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443574+0000", 2024-09-13T06:43:21.936 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:21.936 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:21.936 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:21.936 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:21.936 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443574+0000", 2024-09-13T06:43:21.937 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:21.937 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:21.937 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:21.937 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:21.937 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443576+0000", 2024-09-13T06:43:21.937 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6910000000000002e-06 2024-09-13T06:43:21.937 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:21.937 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:21.937 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:21.937 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443583+0000", 2024-09-13T06:43:21.937 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.331e-06 2024-09-13T06:43:21.937 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:21.937 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:21.938 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:21.938 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443587+0000", 2024-09-13T06:43:21.938 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6129999999999997e-06 2024-09-13T06:43:21.938 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:21.938 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:21.938 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:21.938 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533464+0000", 2024-09-13T06:43:21.938 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089876605999999998 2024-09-13T06:43:21.938 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:21.938 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:21.938 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:21.938 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533469+0000", 2024-09-13T06:43:21.938 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3909999999999997e-06 2024-09-13T06:43:21.939 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:21.939 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:21.939 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:21.939 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:21.939 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:21.939 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25751 3.8 3.63996268 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:43:21.939 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443592+0000", 2024-09-13T06:43:21.939 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 205.41631257899999, 2024-09-13T06:43:21.939 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089913650999999997, 2024-09-13T06:43:21.939 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:21.939 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:43:21.939 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:21.939 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:21.939 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:21.940 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25751 2024-09-13T06:43:21.940 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:21.940 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:21.940 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:21.940 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:21.940 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443592+0000", 2024-09-13T06:43:21.940 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:21.940 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:21.940 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:21.940 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:21.940 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443592+0000", 2024-09-13T06:43:21.940 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:21.940 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:21.941 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:21.941 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:21.941 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443591+0000", 2024-09-13T06:43:21.941 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:21.941 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:21.941 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:21.941 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:21.941 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443594+0000", 2024-09-13T06:43:21.941 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3649999999999998e-06 2024-09-13T06:43:21.941 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:21.941 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:21.941 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:21.942 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443599+0000", 2024-09-13T06:43:21.942 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.699e-06 2024-09-13T06:43:21.942 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:21.942 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:21.942 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:21.942 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443611+0000", 2024-09-13T06:43:21.942 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1503e-05 2024-09-13T06:43:21.942 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:21.942 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:21.942 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:21.942 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533497+0000", 2024-09-13T06:43:21.942 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089886453000000005 2024-09-13T06:43:21.942 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:21.943 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:21.943 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:21.943 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533505+0000", 2024-09-13T06:43:21.943 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.9910000000000002e-06 2024-09-13T06:43:21.943 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:21.943 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:21.943 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:21.943 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:21.943 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:21.943 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25752 3.8 3.63996268 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:43:21.943 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443615+0000", 2024-09-13T06:43:21.943 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 205.41628879800001, 2024-09-13T06:43:21.944 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089905868999999999, 2024-09-13T06:43:21.944 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:21.944 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:43:21.944 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:21.944 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:21.944 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:21.944 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25752 2024-09-13T06:43:21.944 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:21.944 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:21.944 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:21.944 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:21.944 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443615+0000", 2024-09-13T06:43:21.944 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:21.945 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:21.945 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:21.945 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:21.945 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443615+0000", 2024-09-13T06:43:21.945 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:21.945 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:21.945 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:21.945 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:21.945 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443615+0000", 2024-09-13T06:43:21.945 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:21.945 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:21.945 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:21.945 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:21.946 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443617+0000", 2024-09-13T06:43:21.946 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3539999999999998e-06 2024-09-13T06:43:21.946 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:21.946 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:21.946 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:21.946 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443624+0000", 2024-09-13T06:43:21.946 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3600000000000001e-06 2024-09-13T06:43:21.946 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:21.946 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:21.946 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:21.946 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443628+0000", 2024-09-13T06:43:21.946 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.2350000000000001e-06 2024-09-13T06:43:21.946 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:21.947 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:21.947 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:21.947 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533517+0000", 2024-09-13T06:43:21.947 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089889029999999995 2024-09-13T06:43:21.947 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:21.947 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:21.947 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:21.947 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533521+0000", 2024-09-13T06:43:21.947 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.2529999999999998e-06 2024-09-13T06:43:21.947 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:21.947 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:21.947 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:21.947 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:21.947 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:21.948 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:64356 3.c 3:32785be9:::rbd_header.11218ba71f0d:head [watch reconnect cookie 140361410387072 gen 2] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e95)", 2024-09-13T06:43:21.948 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:48.473318+0000", 2024-09-13T06:43:21.948 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 153.386586405, 2024-09-13T06:43:21.948 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1458904379999999, 2024-09-13T06:43:21.948 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:21.948 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:21.948 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:21.948 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:21.948 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:21.948 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 64356 2024-09-13T06:43:21.948 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:21.948 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:21.948 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:21.949 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:21.949 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:48.473318+0000", 2024-09-13T06:43:21.949 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:21.949 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:21.949 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:21.949 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:21.949 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:48.473318+0000", 2024-09-13T06:43:21.949 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:21.949 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:21.949 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:21.949 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:21.949 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:48.473315+0000", 2024-09-13T06:43:21.950 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999971 2024-09-13T06:43:21.950 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:21.950 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:21.950 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:21.950 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:48.473329+0000", 2024-09-13T06:43:21.950 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.433e-05 2024-09-13T06:43:21.950 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:21.950 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:21.950 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:21.950 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:48.473363+0000", 2024-09-13T06:43:21.950 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.3592e-05 2024-09-13T06:43:21.950 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:21.950 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:21.950 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:21.950 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:48.473386+0000", 2024-09-13T06:43:21.950 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2708999999999999e-05 2024-09-13T06:43:21.951 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:21.951 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:21.951 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:21.951 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:48.473804+0000", 2024-09-13T06:43:21.951 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00041789399999999998 2024-09-13T06:43:21.951 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:21.951 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:21.951 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:43:21.951 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:48.473830+0000", 2024-09-13T06:43:21.951 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6869e-05 2024-09-13T06:43:21.951 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:21.951 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:21.951 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:21.951 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:49.614332+0000", 2024-09-13T06:43:21.951 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.140501107 2024-09-13T06:43:21.952 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:21.952 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:21.952 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for rw locks", 2024-09-13T06:43:21.952 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:49.614496+0000", 2024-09-13T06:43:21.952 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00016451200000000001 2024-09-13T06:43:21.952 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:21.952 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:21.952 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:21.952 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:49.617131+0000", 2024-09-13T06:43:21.952 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.002634843 2024-09-13T06:43:21.952 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:21.952 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:21.952 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:21.952 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:49.617204+0000", 2024-09-13T06:43:21.952 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.2991000000000006e-05 2024-09-13T06:43:21.953 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:21.953 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:21.953 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:21.953 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:49.619208+0000", 2024-09-13T06:43:21.953 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.002004381 2024-09-13T06:43:21.953 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:21.953 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:21.953 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:21.953 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:21.953 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:21.953 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:170155 3.7 3:e17728eb:::image_client.0-clone36.rbd:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e191)", 2024-09-13T06:43:21.953 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:42:31.436412+0000", 2024-09-13T06:43:21.953 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 50.423492582000002, 2024-09-13T06:43:21.953 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.97843703800000004, 2024-09-13T06:43:21.954 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:21.954 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:43:21.954 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:21.954 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:21.954 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:21.954 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 170155 2024-09-13T06:43:21.954 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:21.954 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:21.954 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:21.954 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:21.954 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:31.436412+0000", 2024-09-13T06:43:21.954 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:21.954 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:21.954 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:21.955 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:21.955 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:31.436412+0000", 2024-09-13T06:43:21.955 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:21.955 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:21.955 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:21.955 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:21.955 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:31.436410+0000", 2024-09-13T06:43:21.955 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999986 2024-09-13T06:43:21.955 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:21.955 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:21.955 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:21.955 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:31.436417+0000", 2024-09-13T06:43:21.955 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.6939999999999998e-06 2024-09-13T06:43:21.955 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:21.955 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:21.956 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:21.956 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:31.436430+0000", 2024-09-13T06:43:21.956 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3016999999999999e-05 2024-09-13T06:43:21.956 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:21.956 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:21.956 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:21.956 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:31.436437+0000", 2024-09-13T06:43:21.956 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.1069999999999999e-06 2024-09-13T06:43:21.956 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:21.956 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:21.956 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:21.956 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:31.436515+0000", 2024-09-13T06:43:21.956 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.7756000000000006e-05 2024-09-13T06:43:21.957 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:21.957 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:21.957 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:43:21.957 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:31.436523+0000", 2024-09-13T06:43:21.957 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.4970000000000001e-06 2024-09-13T06:43:21.957 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:21.957 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:21.957 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:21.957 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:32.414565+0000", 2024-09-13T06:43:21.957 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.97804144199999998 2024-09-13T06:43:21.957 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:21.957 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:21.957 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:21.958 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:32.414849+0000", 2024-09-13T06:43:21.958 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00028388600000000001 2024-09-13T06:43:21.958 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:21.958 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:21.958 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:21.958 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:21.958 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:21.958 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:43:21.959 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-13T06:43:21.960 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:43:21.961+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:43:22.061 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:43:22.059+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:43:22.092 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:43:22.092 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [], 2024-09-13T06:43:22.092 INFO:teuthology.orchestra.run.smithi139.stdout: "num_ops": 0 2024-09-13T06:43:22.092 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:43:22.106 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-13T06:43:22.162 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:43:22.161+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:43:22.227 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:43:22.228 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [], 2024-09-13T06:43:22.228 INFO:teuthology.orchestra.run.smithi139.stdout: "complaint_time": 30, 2024-09-13T06:43:22.228 INFO:teuthology.orchestra.run.smithi139.stdout: "num_blocked_ops": 0 2024-09-13T06:43:22.228 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:43:22.241 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-13T06:43:22.284 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:43:22.285+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:43:22.365 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:43:22.363+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:43:22.411 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:43:22.411 INFO:teuthology.orchestra.run.smithi139.stdout: "size": 20, 2024-09-13T06:43:22.411 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 600, 2024-09-13T06:43:22.411 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [ 2024-09-13T06:43:22.411 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:22.411 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:160483 3.a 3:57f62123:::rbd_header.112138ed422:head [watch reconnect cookie 140361344088384 gen 3] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e177)", 2024-09-13T06:43:22.411 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:42:17.439011+0000", 2024-09-13T06:43:22.411 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 64.969896665999997, 2024-09-13T06:43:22.411 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.155518861, 2024-09-13T06:43:22.411 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:22.411 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:22.412 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:22.412 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:22.412 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:22.412 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 160483 2024-09-13T06:43:22.412 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:22.412 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:22.412 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:22.412 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:22.412 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:17.439011+0000", 2024-09-13T06:43:22.412 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:22.412 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:22.412 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:22.412 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:22.413 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:17.439011+0000", 2024-09-13T06:43:22.413 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:22.413 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:22.413 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:22.413 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:22.413 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:17.439009+0000", 2024-09-13T06:43:22.413 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999976 2024-09-13T06:43:22.413 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:22.413 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:22.413 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:22.413 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:17.439024+0000", 2024-09-13T06:43:22.413 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.464e-05 2024-09-13T06:43:22.414 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:22.414 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:22.414 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:22.414 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:17.439058+0000", 2024-09-13T06:43:22.414 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.4712999999999998e-05 2024-09-13T06:43:22.414 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:22.414 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:22.414 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:22.414 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:17.439085+0000", 2024-09-13T06:43:22.414 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.6216000000000001e-05 2024-09-13T06:43:22.414 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:22.414 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:22.414 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:22.415 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:17.439182+0000", 2024-09-13T06:43:22.415 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.7020000000000003e-05 2024-09-13T06:43:22.415 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:22.415 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:22.415 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:43:22.415 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:17.439204+0000", 2024-09-13T06:43:22.415 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.2276000000000002e-05 2024-09-13T06:43:22.415 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:22.415 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:22.415 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:22.415 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:18.588627+0000", 2024-09-13T06:43:22.415 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1494235829999999 2024-09-13T06:43:22.415 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:22.415 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:22.416 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for rw locks", 2024-09-13T06:43:22.416 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:18.589031+0000", 2024-09-13T06:43:22.416 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0004035 2024-09-13T06:43:22.416 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:22.416 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:22.416 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:22.416 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:18.590604+0000", 2024-09-13T06:43:22.416 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.001573234 2024-09-13T06:43:22.416 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:22.416 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:22.416 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:22.416 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:18.590791+0000", 2024-09-13T06:43:22.416 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000186701 2024-09-13T06:43:22.417 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:22.417 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:22.417 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:22.417 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:18.594530+0000", 2024-09-13T06:43:22.417 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0037394250000000002 2024-09-13T06:43:22.417 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:22.417 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:22.417 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:22.417 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:22.417 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:22.417 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:208355 3.14 3:2d339b7f:::rbd_data.1121cb4a09ed.0000000000000003:snapdir [list-snaps] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e219)", 2024-09-13T06:43:22.417 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:43:03.420412+0000", 2024-09-13T06:43:22.417 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 18.988496529999999, 2024-09-13T06:43:22.418 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.705233864, 2024-09-13T06:43:22.418 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:22.418 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:22.418 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:22.418 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:22.418 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:22.418 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 208355 2024-09-13T06:43:22.418 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:22.418 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:22.418 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:22.418 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:22.418 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420412+0000", 2024-09-13T06:43:22.418 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:22.419 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:22.419 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:22.419 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:22.419 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420412+0000", 2024-09-13T06:43:22.419 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:22.419 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:22.419 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:22.419 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:22.419 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420409+0000", 2024-09-13T06:43:22.419 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999981 2024-09-13T06:43:22.419 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:22.419 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:22.419 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:22.420 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420420+0000", 2024-09-13T06:43:22.420 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0716e-05 2024-09-13T06:43:22.420 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:22.420 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:22.420 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:22.420 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420440+0000", 2024-09-13T06:43:22.420 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.9850000000000001e-05 2024-09-13T06:43:22.420 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:22.420 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:22.420 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:22.420 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420456+0000", 2024-09-13T06:43:22.420 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5667000000000001e-05 2024-09-13T06:43:22.420 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:22.421 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:22.421 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:22.421 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420724+0000", 2024-09-13T06:43:22.421 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00026873400000000002 2024-09-13T06:43:22.421 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:22.421 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:22.421 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:43:22.421 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420740+0000", 2024-09-13T06:43:22.421 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5486999999999999e-05 2024-09-13T06:43:22.421 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:22.421 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:22.421 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:22.421 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.125004+0000", 2024-09-13T06:43:22.422 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7042643119999998 2024-09-13T06:43:22.422 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:22.422 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:22.422 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:22.422 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.125293+0000", 2024-09-13T06:43:22.422 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000288664 2024-09-13T06:43:22.422 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:22.422 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:22.422 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:22.422 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.125645+0000", 2024-09-13T06:43:22.422 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00035247700000000002 2024-09-13T06:43:22.422 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:22.423 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:22.423 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:22.423 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:22.423 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:22.423 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:208362 3.14 3:2d339b7f:::rbd_data.1121cb4a09ed.0000000000000003:snapdir [list-snaps] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e219)", 2024-09-13T06:43:22.423 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:43:03.420469+0000", 2024-09-13T06:43:22.423 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 18.988439054000001, 2024-09-13T06:43:22.423 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.706123917, 2024-09-13T06:43:22.423 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:22.423 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:22.423 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:22.423 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:22.423 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:22.423 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 208362 2024-09-13T06:43:22.424 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:22.424 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:22.424 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:22.424 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:22.424 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420469+0000", 2024-09-13T06:43:22.424 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:22.424 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:22.424 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:22.424 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:22.424 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420469+0000", 2024-09-13T06:43:22.424 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:22.424 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:22.424 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:22.425 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:22.425 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420468+0000", 2024-09-13T06:43:22.425 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:22.425 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:22.425 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:22.425 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:22.425 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420473+0000", 2024-09-13T06:43:22.425 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.7099999999999998e-06 2024-09-13T06:43:22.425 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:22.425 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:22.425 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:22.425 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420483+0000", 2024-09-13T06:43:22.426 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.7960000000000007e-06 2024-09-13T06:43:22.426 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:22.426 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:22.426 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:22.426 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420491+0000", 2024-09-13T06:43:22.426 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.8169999999999999e-06 2024-09-13T06:43:22.426 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:22.426 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:22.426 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:22.426 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420829+0000", 2024-09-13T06:43:22.426 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000338494 2024-09-13T06:43:22.426 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:22.426 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:22.426 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:43:22.427 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420857+0000", 2024-09-13T06:43:22.427 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.8140000000000002e-05 2024-09-13T06:43:22.427 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:22.427 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:22.427 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:22.427 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.126086+0000", 2024-09-13T06:43:22.427 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7052288369999999 2024-09-13T06:43:22.427 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:22.427 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:22.427 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:22.427 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.126269+0000", 2024-09-13T06:43:22.427 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000183301 2024-09-13T06:43:22.427 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:22.427 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:22.427 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:22.428 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.126593+0000", 2024-09-13T06:43:22.428 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00032352800000000001 2024-09-13T06:43:22.428 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:22.428 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:22.428 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:22.428 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:22.428 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:22.428 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:208369 3.14 3:2d339b7f:::rbd_data.1121cb4a09ed.0000000000000003:snapdir [list-snaps] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e219)", 2024-09-13T06:43:22.428 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:43:03.420498+0000", 2024-09-13T06:43:22.428 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 18.988410009999999, 2024-09-13T06:43:22.428 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.706613895, 2024-09-13T06:43:22.428 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:22.428 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:22.428 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:22.429 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:22.429 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:22.429 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 208369 2024-09-13T06:43:22.429 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:22.429 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:22.429 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:22.429 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:22.429 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420498+0000", 2024-09-13T06:43:22.429 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:22.429 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:22.429 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:22.429 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:22.429 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420498+0000", 2024-09-13T06:43:22.430 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:22.430 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:22.430 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:22.430 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:22.430 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420497+0000", 2024-09-13T06:43:22.430 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:22.430 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:22.430 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:22.430 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:22.430 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420501+0000", 2024-09-13T06:43:22.430 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.737e-06 2024-09-13T06:43:22.430 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:22.430 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:22.430 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:22.430 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420522+0000", 2024-09-13T06:43:22.431 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.1152999999999999e-05 2024-09-13T06:43:22.431 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:22.431 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:22.431 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:22.431 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420533+0000", 2024-09-13T06:43:22.431 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0366999999999999e-05 2024-09-13T06:43:22.431 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:22.431 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:22.431 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:22.431 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420968+0000", 2024-09-13T06:43:22.431 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00043495900000000001 2024-09-13T06:43:22.431 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:22.431 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:22.431 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:43:22.432 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420977+0000", 2024-09-13T06:43:22.432 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.8039999999999996e-06 2024-09-13T06:43:22.432 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:22.432 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:22.432 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:22.432 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.126670+0000", 2024-09-13T06:43:22.432 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7056928760000001 2024-09-13T06:43:22.432 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:22.433 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:22.433 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:22.433 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.126833+0000", 2024-09-13T06:43:22.433 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00016253200000000001 2024-09-13T06:43:22.433 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:22.433 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:22.433 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:22.433 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.127112+0000", 2024-09-13T06:43:22.433 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000279141 2024-09-13T06:43:22.433 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:22.433 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:22.433 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:22.433 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:22.434 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:22.434 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:208376 3.14 3:2d339b7f:::rbd_data.1121cb4a09ed.0000000000000003:snapdir [list-snaps] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e219)", 2024-09-13T06:43:22.434 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:43:03.420541+0000", 2024-09-13T06:43:22.434 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 18.988366754000001, 2024-09-13T06:43:22.434 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7070606820000001, 2024-09-13T06:43:22.434 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:22.434 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:22.434 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:22.434 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:22.434 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:22.434 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 208376 2024-09-13T06:43:22.434 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:22.434 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:22.434 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:22.435 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:22.435 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420541+0000", 2024-09-13T06:43:22.435 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:22.435 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:22.435 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:22.435 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:22.435 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420541+0000", 2024-09-13T06:43:22.435 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:22.435 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:22.435 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:22.435 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:22.435 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420541+0000", 2024-09-13T06:43:22.435 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:22.436 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:22.436 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:22.436 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:22.436 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420544+0000", 2024-09-13T06:43:22.436 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.5530000000000001e-06 2024-09-13T06:43:22.436 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:22.436 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:22.436 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:22.436 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420557+0000", 2024-09-13T06:43:22.436 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2663000000000001e-05 2024-09-13T06:43:22.436 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:22.436 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:22.436 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:22.436 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420572+0000", 2024-09-13T06:43:22.437 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5463000000000001e-05 2024-09-13T06:43:22.437 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:22.437 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:22.437 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:22.437 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.421070+0000", 2024-09-13T06:43:22.437 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00049723599999999997 2024-09-13T06:43:22.437 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:22.437 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:22.437 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:43:22.437 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.421092+0000", 2024-09-13T06:43:22.437 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.2354e-05 2024-09-13T06:43:22.437 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:22.437 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:22.438 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:22.438 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.127184+0000", 2024-09-13T06:43:22.438 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7060917330000001 2024-09-13T06:43:22.438 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:22.438 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:22.438 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:22.438 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.127340+0000", 2024-09-13T06:43:22.438 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00015640200000000001 2024-09-13T06:43:22.438 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:22.438 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:22.438 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:22.438 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.127602+0000", 2024-09-13T06:43:22.438 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00026192799999999998 2024-09-13T06:43:22.438 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:22.439 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:22.439 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:22.439 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:22.439 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:22.439 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:208383 3.14 3:2d339b7f:::rbd_data.1121cb4a09ed.0000000000000003:snapdir [list-snaps] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e219)", 2024-09-13T06:43:22.439 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:43:03.420585+0000", 2024-09-13T06:43:22.439 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 18.988322901, 2024-09-13T06:43:22.439 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.707457405, 2024-09-13T06:43:22.439 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:22.439 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:22.439 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:22.439 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:22.439 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:22.440 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 208383 2024-09-13T06:43:22.440 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:22.440 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:22.440 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:22.440 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:22.440 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420585+0000", 2024-09-13T06:43:22.440 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:22.440 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:22.440 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:22.440 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:22.440 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420585+0000", 2024-09-13T06:43:22.440 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:22.440 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:22.441 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:22.441 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:22.441 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420584+0000", 2024-09-13T06:43:22.441 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:43:22.441 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:22.441 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:22.441 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:22.441 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420614+0000", 2024-09-13T06:43:22.441 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.9886000000000002e-05 2024-09-13T06:43:22.441 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:22.441 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:22.441 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:22.441 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420640+0000", 2024-09-13T06:43:22.441 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.5663000000000001e-05 2024-09-13T06:43:22.442 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:22.442 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:22.442 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:22.442 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420669+0000", 2024-09-13T06:43:22.442 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.9289999999999999e-05 2024-09-13T06:43:22.442 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:22.442 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:22.442 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:22.442 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.421168+0000", 2024-09-13T06:43:22.442 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00049857600000000003 2024-09-13T06:43:22.442 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:22.442 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:22.442 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:43:22.442 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.421177+0000", 2024-09-13T06:43:22.443 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.533e-06 2024-09-13T06:43:22.443 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:22.443 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:22.443 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:22.443 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.127648+0000", 2024-09-13T06:43:22.443 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7064713569999999 2024-09-13T06:43:22.443 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:22.443 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:22.443 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:22.443 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.127794+0000", 2024-09-13T06:43:22.443 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00014589200000000001 2024-09-13T06:43:22.443 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:22.443 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:22.444 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:22.444 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.128043+0000", 2024-09-13T06:43:22.444 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00024821799999999997 2024-09-13T06:43:22.444 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:22.444 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:22.444 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:22.444 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:22.444 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:22.444 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:208390 3.14 3:2d339b7f:::rbd_data.1121cb4a09ed.0000000000000003:snapdir [list-snaps] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e219)", 2024-09-13T06:43:22.444 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:43:03.420713+0000", 2024-09-13T06:43:22.444 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 18.988194942, 2024-09-13T06:43:22.444 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7077568059999999, 2024-09-13T06:43:22.444 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:22.444 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:22.444 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:22.444 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:22.445 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:22.445 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 208390 2024-09-13T06:43:22.445 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:22.445 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:22.445 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:22.445 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:22.445 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420713+0000", 2024-09-13T06:43:22.445 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:22.445 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:22.445 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:22.445 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:22.445 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420713+0000", 2024-09-13T06:43:22.445 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:22.446 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:22.446 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:22.446 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:22.446 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420712+0000", 2024-09-13T06:43:22.446 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:43:22.446 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:22.446 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:22.446 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:22.446 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420719+0000", 2024-09-13T06:43:22.446 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.883e-06 2024-09-13T06:43:22.446 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:22.446 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:22.446 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:22.446 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420737+0000", 2024-09-13T06:43:22.447 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.8082999999999999e-05 2024-09-13T06:43:22.447 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:22.447 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:22.447 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:22.447 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420757+0000", 2024-09-13T06:43:22.447 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.0256999999999999e-05 2024-09-13T06:43:22.447 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:22.447 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:22.447 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:22.447 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.421258+0000", 2024-09-13T06:43:22.447 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00050028500000000005 2024-09-13T06:43:22.447 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:22.447 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:22.447 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:43:22.447 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.421282+0000", 2024-09-13T06:43:22.447 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.4236999999999999e-05 2024-09-13T06:43:22.448 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:22.448 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:22.448 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:22.448 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.128087+0000", 2024-09-13T06:43:22.448 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.706805551 2024-09-13T06:43:22.448 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:22.448 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:22.448 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:22.448 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.128231+0000", 2024-09-13T06:43:22.448 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00014348200000000001 2024-09-13T06:43:22.448 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:22.448 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:22.448 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:22.448 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.128470+0000", 2024-09-13T06:43:22.449 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000239058 2024-09-13T06:43:22.449 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:22.449 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:22.449 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:22.449 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:22.449 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:22.449 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:208397 3.14 3:2d339b7f:::rbd_data.1121cb4a09ed.0000000000000003:snapdir [list-snaps] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e219)", 2024-09-13T06:43:22.449 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:43:03.420772+0000", 2024-09-13T06:43:22.449 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 18.988135563, 2024-09-13T06:43:22.449 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7081308659999999, 2024-09-13T06:43:22.449 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:22.449 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:22.449 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:22.449 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:22.450 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:22.450 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 208397 2024-09-13T06:43:22.450 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:22.450 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:22.450 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:22.450 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:22.450 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420772+0000", 2024-09-13T06:43:22.450 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:22.450 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:22.450 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:22.450 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:22.450 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420772+0000", 2024-09-13T06:43:22.450 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:22.450 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:22.451 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:22.451 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:22.451 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420772+0000", 2024-09-13T06:43:22.451 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:43:22.451 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:22.451 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:22.451 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:22.451 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420777+0000", 2024-09-13T06:43:22.451 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.8329999999999999e-06 2024-09-13T06:43:22.451 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:22.451 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:22.451 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:22.451 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420795+0000", 2024-09-13T06:43:22.451 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7677e-05 2024-09-13T06:43:22.452 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:22.452 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:22.452 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:22.452 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420811+0000", 2024-09-13T06:43:22.452 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5673000000000001e-05 2024-09-13T06:43:22.452 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:22.452 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:22.452 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:22.452 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.421352+0000", 2024-09-13T06:43:22.452 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00054091199999999995 2024-09-13T06:43:22.452 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:22.452 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:22.452 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:43:22.452 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.421364+0000", 2024-09-13T06:43:22.452 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.182e-05 2024-09-13T06:43:22.453 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:22.453 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:22.453 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:22.453 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.128512+0000", 2024-09-13T06:43:22.453 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.707148584 2024-09-13T06:43:22.453 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:22.453 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:22.453 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:22.453 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.128653+0000", 2024-09-13T06:43:22.453 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00014127599999999999 2024-09-13T06:43:22.453 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:22.453 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:22.453 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:22.453 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.128903+0000", 2024-09-13T06:43:22.454 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000249941 2024-09-13T06:43:22.454 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:22.454 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:22.454 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:22.454 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:22.454 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:22.454 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:208404 3.14 3:2d339b7f:::rbd_data.1121cb4a09ed.0000000000000003:snapdir [list-snaps] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e219)", 2024-09-13T06:43:22.454 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:43:03.420837+0000", 2024-09-13T06:43:22.454 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 18.988070926999999, 2024-09-13T06:43:22.454 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.70849154, 2024-09-13T06:43:22.454 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:22.454 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:22.454 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:22.454 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:22.455 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:22.455 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 208404 2024-09-13T06:43:22.455 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:22.455 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:22.455 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:22.455 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:22.455 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420837+0000", 2024-09-13T06:43:22.455 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:22.455 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:22.455 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:22.455 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:22.455 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420837+0000", 2024-09-13T06:43:22.455 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:22.455 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:22.455 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:22.456 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:22.456 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420836+0000", 2024-09-13T06:43:22.456 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999986 2024-09-13T06:43:22.456 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:22.456 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:22.456 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:22.456 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420842+0000", 2024-09-13T06:43:22.456 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.4400000000000002e-06 2024-09-13T06:43:22.456 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:22.456 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:22.456 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:22.456 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420860+0000", 2024-09-13T06:43:22.456 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7487e-05 2024-09-13T06:43:22.456 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:22.457 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:22.457 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:22.457 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420916+0000", 2024-09-13T06:43:22.457 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.6276999999999997e-05 2024-09-13T06:43:22.457 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:22.457 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:22.457 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:22.457 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.421450+0000", 2024-09-13T06:43:22.457 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00053433500000000004 2024-09-13T06:43:22.457 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:22.457 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:22.457 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:43:22.457 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.421474+0000", 2024-09-13T06:43:22.457 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.3799e-05 2024-09-13T06:43:22.457 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:22.458 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:22.458 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:22.458 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.128945+0000", 2024-09-13T06:43:22.458 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.707470912 2024-09-13T06:43:22.458 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:22.458 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:22.458 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:22.458 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.129087+0000", 2024-09-13T06:43:22.458 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00014170900000000001 2024-09-13T06:43:22.458 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:22.458 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:22.458 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:22.458 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.129329+0000", 2024-09-13T06:43:22.458 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000241831 2024-09-13T06:43:22.458 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:22.459 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:22.459 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:22.459 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:22.459 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:22.459 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:208411 3.14 3:2d339b7f:::rbd_data.1121cb4a09ed.0000000000000003:snapdir [list-snaps] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e219)", 2024-09-13T06:43:22.459 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:43:03.420964+0000", 2024-09-13T06:43:22.459 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 18.987943694999998, 2024-09-13T06:43:22.459 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.708812754, 2024-09-13T06:43:22.459 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:22.459 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:22.459 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:22.459 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:22.459 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:22.459 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 208411 2024-09-13T06:43:22.459 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:22.460 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:22.460 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:22.460 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:22.460 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420964+0000", 2024-09-13T06:43:22.460 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:22.460 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:22.460 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:22.460 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:22.460 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420964+0000", 2024-09-13T06:43:22.460 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:22.460 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:22.460 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:22.460 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:22.460 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420963+0000", 2024-09-13T06:43:22.460 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:43:22.461 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:22.461 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:22.461 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:22.461 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420969+0000", 2024-09-13T06:43:22.461 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.7540000000000003e-06 2024-09-13T06:43:22.461 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:22.461 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:22.461 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:22.461 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420979+0000", 2024-09-13T06:43:22.461 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0067e-05 2024-09-13T06:43:22.461 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:22.461 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:22.461 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:22.461 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420987+0000", 2024-09-13T06:43:22.462 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.6990000000000003e-06 2024-09-13T06:43:22.462 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:22.462 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:22.462 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:22.462 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.421563+0000", 2024-09-13T06:43:22.462 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00057654899999999999 2024-09-13T06:43:22.462 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:22.462 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:22.462 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:43:22.462 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.421573+0000", 2024-09-13T06:43:22.462 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.9669999999999996e-06 2024-09-13T06:43:22.462 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:22.462 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:22.462 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:22.463 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.129372+0000", 2024-09-13T06:43:22.463 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.707798602 2024-09-13T06:43:22.463 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:22.463 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:22.463 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:22.463 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.129514+0000", 2024-09-13T06:43:22.463 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00014191200000000001 2024-09-13T06:43:22.463 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:22.463 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:22.463 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:22.463 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.129777+0000", 2024-09-13T06:43:22.463 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00026320100000000002 2024-09-13T06:43:22.463 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:22.463 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:22.463 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:22.464 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:22.464 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:22.464 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:208418 3.14 3:2d339b7f:::rbd_data.1121cb4a09ed.0000000000000003:snapdir [list-snaps] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e219)", 2024-09-13T06:43:22.464 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:43:03.421005+0000", 2024-09-13T06:43:22.464 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 18.987902610999999, 2024-09-13T06:43:22.464 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7096508159999999, 2024-09-13T06:43:22.464 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:22.464 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:22.464 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:22.464 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:22.464 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:22.464 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 208418 2024-09-13T06:43:22.464 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:22.464 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:22.464 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:22.464 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:22.465 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.421005+0000", 2024-09-13T06:43:22.465 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:22.465 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:22.465 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:22.465 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:22.465 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.421005+0000", 2024-09-13T06:43:22.465 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:22.465 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:22.465 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:22.465 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:22.465 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.421005+0000", 2024-09-13T06:43:22.465 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:22.465 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:22.465 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:22.465 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:22.466 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.421008+0000", 2024-09-13T06:43:22.466 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.2550000000000002e-06 2024-09-13T06:43:22.466 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:22.466 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:22.466 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:22.466 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.421015+0000", 2024-09-13T06:43:22.466 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.0600000000000002e-06 2024-09-13T06:43:22.466 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:22.466 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:22.466 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:22.466 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.421021+0000", 2024-09-13T06:43:22.466 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.8139999999999997e-06 2024-09-13T06:43:22.466 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:22.467 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:22.467 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:22.467 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.421638+0000", 2024-09-13T06:43:22.467 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00061702600000000001 2024-09-13T06:43:22.467 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:22.467 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:22.467 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:43:22.467 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.421659+0000", 2024-09-13T06:43:22.467 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.0894e-05 2024-09-13T06:43:22.467 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:22.467 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:22.467 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:22.467 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.129858+0000", 2024-09-13T06:43:22.467 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.708198632 2024-09-13T06:43:22.467 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:22.468 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:22.468 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:22.468 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.130158+0000", 2024-09-13T06:43:22.468 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00030000099999999999 2024-09-13T06:43:22.468 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:22.468 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:22.468 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:22.468 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.130656+0000", 2024-09-13T06:43:22.468 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00049864199999999999 2024-09-13T06:43:22.468 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:22.468 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:22.468 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:22.468 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:22.468 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:22.468 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:209008 3.3 3:c6ff3074:::rbd_data.1121cb4a09ed.0000000000000001:82 [read 397312~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e220)", 2024-09-13T06:43:22.469 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:43:05.165956+0000", 2024-09-13T06:43:22.469 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 17.242952300999999, 2024-09-13T06:43:22.469 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.120605692, 2024-09-13T06:43:22.469 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:22.469 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:22.469 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:22.469 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:22.469 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:22.469 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 209008 2024-09-13T06:43:22.469 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:22.469 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:22.469 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:22.469 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:22.469 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.165956+0000", 2024-09-13T06:43:22.469 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:22.470 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:22.470 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:22.470 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:22.470 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.165956+0000", 2024-09-13T06:43:22.470 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:22.470 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:22.470 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:22.470 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:22.470 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.165955+0000", 2024-09-13T06:43:22.470 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:43:22.470 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:22.470 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:22.470 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:22.470 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.165960+0000", 2024-09-13T06:43:22.470 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.6200000000000004e-06 2024-09-13T06:43:22.471 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:22.471 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:22.471 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:22.471 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.165998+0000", 2024-09-13T06:43:22.471 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.7703000000000001e-05 2024-09-13T06:43:22.471 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:22.471 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:22.471 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:22.471 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.166012+0000", 2024-09-13T06:43:22.471 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3682999999999999e-05 2024-09-13T06:43:22.471 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:22.471 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:22.471 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:22.471 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.286043+0000", 2024-09-13T06:43:22.471 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.120030867 2024-09-13T06:43:22.471 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:22.472 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:22.472 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:22.472 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.286196+0000", 2024-09-13T06:43:22.472 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000153759 2024-09-13T06:43:22.472 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:22.472 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:22.472 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:22.472 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.286561+0000", 2024-09-13T06:43:22.472 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00036504700000000002 2024-09-13T06:43:22.472 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:22.472 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:22.472 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:22.472 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:22.472 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:22.472 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:209009 3.3 3:c6ff3074:::rbd_data.1121cb4a09ed.0000000000000001:82 [read 409600~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e220)", 2024-09-13T06:43:22.473 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:43:05.166111+0000", 2024-09-13T06:43:22.473 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 17.242796655999999, 2024-09-13T06:43:22.473 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.121025172, 2024-09-13T06:43:22.473 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:22.473 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:22.473 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:22.473 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:22.473 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:22.473 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 209009 2024-09-13T06:43:22.473 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:22.473 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:22.473 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:22.474 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:22.474 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.166111+0000", 2024-09-13T06:43:22.474 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:22.474 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:22.474 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:22.474 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:22.474 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.166111+0000", 2024-09-13T06:43:22.474 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:22.474 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:22.474 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:22.474 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:22.474 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.166023+0000", 2024-09-13T06:43:22.474 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999113 2024-09-13T06:43:22.474 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:22.474 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:22.475 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:22.475 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.166118+0000", 2024-09-13T06:43:22.475 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.5818999999999999e-05 2024-09-13T06:43:22.475 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:22.475 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:22.475 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:22.475 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.166145+0000", 2024-09-13T06:43:22.475 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.6679999999999999e-05 2024-09-13T06:43:22.475 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:22.475 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:22.475 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:22.475 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.166162+0000", 2024-09-13T06:43:22.475 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6413e-05 2024-09-13T06:43:22.475 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:22.475 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:22.476 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:22.476 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.286636+0000", 2024-09-13T06:43:22.476 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.120474003 2024-09-13T06:43:22.476 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:22.476 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:22.476 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:22.476 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.286799+0000", 2024-09-13T06:43:22.476 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00016363900000000001 2024-09-13T06:43:22.476 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:22.476 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:22.476 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:22.476 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.287137+0000", 2024-09-13T06:43:22.477 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00033736699999999998 2024-09-13T06:43:22.477 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:22.477 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:22.477 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:22.477 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:22.477 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:22.477 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:209010 3.3 3:c6ff3074:::rbd_data.1121cb4a09ed.0000000000000001:82 [read 421888~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e220)", 2024-09-13T06:43:22.477 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:43:05.167018+0000", 2024-09-13T06:43:22.477 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 17.241890476999998, 2024-09-13T06:43:22.477 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.120709894, 2024-09-13T06:43:22.477 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:22.477 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:22.477 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:22.477 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:22.478 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:22.478 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 209010 2024-09-13T06:43:22.478 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:22.478 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:22.478 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:22.478 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:22.478 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.167018+0000", 2024-09-13T06:43:22.478 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:22.478 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:22.478 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:22.478 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:22.478 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.167018+0000", 2024-09-13T06:43:22.478 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:22.478 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:22.478 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:22.479 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:22.479 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.166214+0000", 2024-09-13T06:43:22.479 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9991961 2024-09-13T06:43:22.479 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:22.479 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:22.479 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:22.479 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.167039+0000", 2024-09-13T06:43:22.479 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00082531599999999998 2024-09-13T06:43:22.479 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:22.479 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:22.479 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:22.479 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.167083+0000", 2024-09-13T06:43:22.479 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.4079999999999998e-05 2024-09-13T06:43:22.479 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:22.479 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:22.480 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:22.480 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.167113+0000", 2024-09-13T06:43:22.480 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.025e-05 2024-09-13T06:43:22.480 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:22.480 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:22.480 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:22.480 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.287229+0000", 2024-09-13T06:43:22.480 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.12011563 2024-09-13T06:43:22.480 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:22.480 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:22.480 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:22.480 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.287369+0000", 2024-09-13T06:43:22.480 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00014040499999999999 2024-09-13T06:43:22.480 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:22.481 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:22.481 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:22.481 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.287727+0000", 2024-09-13T06:43:22.481 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000358043 2024-09-13T06:43:22.481 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:22.481 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:22.481 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:22.481 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:22.481 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:22.481 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:209011 3.3 3:c6ff3074:::rbd_data.1121cb4a09ed.0000000000000001:82 [read 434176~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e220)", 2024-09-13T06:43:22.481 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:43:05.167765+0000", 2024-09-13T06:43:22.481 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 17.241142983, 2024-09-13T06:43:22.481 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.12054767199999999, 2024-09-13T06:43:22.481 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:22.481 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:22.482 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:22.482 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:22.482 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:22.482 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 209011 2024-09-13T06:43:22.482 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:22.482 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:22.482 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:22.482 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:22.482 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.167765+0000", 2024-09-13T06:43:22.482 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:22.482 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:22.482 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:22.482 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:22.482 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.167765+0000", 2024-09-13T06:43:22.483 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:22.483 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:22.483 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:22.483 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:22.483 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.167131+0000", 2024-09-13T06:43:22.483 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9993658 2024-09-13T06:43:22.483 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:22.483 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:22.483 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:22.483 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.167772+0000", 2024-09-13T06:43:22.483 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00064152399999999998 2024-09-13T06:43:22.483 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:22.483 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:22.484 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:22.484 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.167791+0000", 2024-09-13T06:43:22.484 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.8944e-05 2024-09-13T06:43:22.484 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:22.484 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:22.484 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:22.484 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.167805+0000", 2024-09-13T06:43:22.484 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.395e-05 2024-09-13T06:43:22.484 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:22.484 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:22.484 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:22.484 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.287803+0000", 2024-09-13T06:43:22.484 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.11999747099999999 2024-09-13T06:43:22.484 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:22.484 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:22.485 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:22.485 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.287964+0000", 2024-09-13T06:43:22.485 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00016155100000000001 2024-09-13T06:43:22.485 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:22.485 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:22.485 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:22.485 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.288313+0000", 2024-09-13T06:43:22.485 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00034865699999999999 2024-09-13T06:43:22.485 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:22.485 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:22.485 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:22.485 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:22.485 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:22.485 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:209012 3.3 3:c6ff3074:::rbd_data.1121cb4a09ed.0000000000000001:82 [read 446464~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e220)", 2024-09-13T06:43:22.485 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:43:05.168733+0000", 2024-09-13T06:43:22.486 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 17.240174862, 2024-09-13T06:43:22.486 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.12007113699999999, 2024-09-13T06:43:22.486 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:22.486 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:22.486 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:22.486 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:22.486 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:22.486 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 209012 2024-09-13T06:43:22.486 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:22.486 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:22.486 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:22.486 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:22.486 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.168733+0000", 2024-09-13T06:43:22.486 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:22.486 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:22.487 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:22.487 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:22.487 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.168733+0000", 2024-09-13T06:43:22.487 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:22.487 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:22.487 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:22.487 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:22.487 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.167815+0000", 2024-09-13T06:43:22.487 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9990816 2024-09-13T06:43:22.487 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:22.487 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:22.487 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:22.487 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.168749+0000", 2024-09-13T06:43:22.487 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00093412200000000001 2024-09-13T06:43:22.487 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:22.488 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:22.488 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:22.488 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.168776+0000", 2024-09-13T06:43:22.488 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.654e-05 2024-09-13T06:43:22.488 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:22.488 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:22.488 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:22.488 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.168814+0000", 2024-09-13T06:43:22.488 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.8702999999999999e-05 2024-09-13T06:43:22.488 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:22.488 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:22.488 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:22.488 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.288381+0000", 2024-09-13T06:43:22.488 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.119566731 2024-09-13T06:43:22.488 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:22.489 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:22.489 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:22.489 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.288516+0000", 2024-09-13T06:43:22.489 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00013502499999999999 2024-09-13T06:43:22.489 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:22.489 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:22.489 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:22.489 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.288804+0000", 2024-09-13T06:43:22.489 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00028836399999999999 2024-09-13T06:43:22.489 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:22.489 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:22.489 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:22.489 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:22.489 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:22.490 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:209013 3.3 3:c6ff3074:::rbd_data.1121cb4a09ed.0000000000000001:82 [read 458752~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e220)", 2024-09-13T06:43:22.490 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:43:05.168880+0000", 2024-09-13T06:43:22.490 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 17.240027899000001, 2024-09-13T06:43:22.490 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.120462023, 2024-09-13T06:43:22.490 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:22.490 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:22.490 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:22.490 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:22.490 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:22.490 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 209013 2024-09-13T06:43:22.490 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:22.490 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:22.490 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:22.490 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:22.490 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.168880+0000", 2024-09-13T06:43:22.491 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:22.491 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:22.491 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:22.491 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:22.491 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.168880+0000", 2024-09-13T06:43:22.491 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:22.491 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:22.491 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:22.491 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:22.491 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.168879+0000", 2024-09-13T06:43:22.491 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999986 2024-09-13T06:43:22.491 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:22.491 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:22.491 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:22.491 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.168888+0000", 2024-09-13T06:43:22.492 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.9930000000000001e-06 2024-09-13T06:43:22.492 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:22.492 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:22.492 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:22.492 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.168908+0000", 2024-09-13T06:43:22.492 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.0276999999999999e-05 2024-09-13T06:43:22.492 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:22.492 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:22.492 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:22.492 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.168923+0000", 2024-09-13T06:43:22.492 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5543e-05 2024-09-13T06:43:22.492 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:22.492 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:22.492 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:22.492 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.288875+0000", 2024-09-13T06:43:22.492 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.119951748 2024-09-13T06:43:22.493 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:22.493 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:22.493 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:22.493 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.289007+0000", 2024-09-13T06:43:22.493 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00013142899999999999 2024-09-13T06:43:22.493 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:22.493 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:22.493 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:22.493 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.289342+0000", 2024-09-13T06:43:22.493 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00033566999999999999 2024-09-13T06:43:22.493 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:22.493 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:22.493 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:22.494 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:22.494 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:22.494 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:209014 3.3 3:c6ff3074:::rbd_data.1121cb4a09ed.0000000000000001:82 [read 471040~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e220)", 2024-09-13T06:43:22.494 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:43:05.169105+0000", 2024-09-13T06:43:22.494 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 17.239803440999999, 2024-09-13T06:43:22.494 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.12087680000000001, 2024-09-13T06:43:22.494 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:22.494 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:22.494 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:22.494 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:22.494 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:22.494 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 209014 2024-09-13T06:43:22.494 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:22.494 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:22.495 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:22.495 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:22.495 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.169105+0000", 2024-09-13T06:43:22.495 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:22.495 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:22.495 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:22.495 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:22.495 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.169105+0000", 2024-09-13T06:43:22.495 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:22.495 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:22.495 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:22.495 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:22.495 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.168936+0000", 2024-09-13T06:43:22.495 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9998312 2024-09-13T06:43:22.495 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:22.495 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:22.496 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:22.496 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.169115+0000", 2024-09-13T06:43:22.496 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00017854500000000001 2024-09-13T06:43:22.496 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:22.496 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:22.496 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:22.496 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.169140+0000", 2024-09-13T06:43:22.496 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.5853000000000001e-05 2024-09-13T06:43:22.496 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:22.496 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:22.496 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:22.496 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.169160+0000", 2024-09-13T06:43:22.496 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.9415999999999998e-05 2024-09-13T06:43:22.497 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:22.497 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:22.497 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:22.497 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.289414+0000", 2024-09-13T06:43:22.497 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.120253785 2024-09-13T06:43:22.497 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:22.497 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:22.497 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:22.497 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.289579+0000", 2024-09-13T06:43:22.497 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00016506299999999999 2024-09-13T06:43:22.497 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:22.497 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:22.497 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:22.497 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.289981+0000", 2024-09-13T06:43:22.498 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000402743 2024-09-13T06:43:22.498 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:22.498 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:22.498 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:22.498 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:22.498 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:22.498 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:209015 3.3 3:c6ff3074:::rbd_data.1121cb4a09ed.0000000000000001:82 [read 483328~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e220)", 2024-09-13T06:43:22.498 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:43:05.169496+0000", 2024-09-13T06:43:22.498 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 17.239412390999998, 2024-09-13T06:43:22.498 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.12105229200000001, 2024-09-13T06:43:22.498 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:22.498 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:22.498 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:22.499 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:22.499 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:22.499 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 209015 2024-09-13T06:43:22.499 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:22.499 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:22.499 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:22.499 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:22.499 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.169496+0000", 2024-09-13T06:43:22.499 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:22.499 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:22.499 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:22.499 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:22.499 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.169496+0000", 2024-09-13T06:43:22.499 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:22.499 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:22.500 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:22.500 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:22.500 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.169177+0000", 2024-09-13T06:43:22.500 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999681 2024-09-13T06:43:22.500 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:22.500 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:22.500 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:22.500 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.169509+0000", 2024-09-13T06:43:22.500 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00033226099999999998 2024-09-13T06:43:22.500 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:22.500 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:22.500 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:22.500 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.169544+0000", 2024-09-13T06:43:22.501 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.5573e-05 2024-09-13T06:43:22.501 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:22.501 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:22.501 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:22.501 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.169560+0000", 2024-09-13T06:43:22.501 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5636000000000001e-05 2024-09-13T06:43:22.501 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:22.501 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:22.501 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:22.501 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.290055+0000", 2024-09-13T06:43:22.501 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.12049523400000001 2024-09-13T06:43:22.501 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:22.501 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:22.501 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:22.502 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.290201+0000", 2024-09-13T06:43:22.502 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000145742 2024-09-13T06:43:22.502 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:22.502 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:22.502 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:22.502 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.290548+0000", 2024-09-13T06:43:22.502 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00034698699999999999 2024-09-13T06:43:22.502 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:22.502 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:22.502 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:22.502 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:22.502 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:22.502 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:209016 3.3 3:c6ff3074:::rbd_data.1121cb4a09ed.0000000000000001:82 [read 495616~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e220)", 2024-09-13T06:43:22.502 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:43:05.169893+0000", 2024-09-13T06:43:22.503 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 17.239014877999999, 2024-09-13T06:43:22.503 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.121278814, 2024-09-13T06:43:22.503 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:22.503 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:22.503 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:22.503 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:22.503 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:22.503 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 209016 2024-09-13T06:43:22.503 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:22.503 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:22.503 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:22.503 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:22.503 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.169893+0000", 2024-09-13T06:43:22.503 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:22.504 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:22.504 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:22.504 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:22.504 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.169893+0000", 2024-09-13T06:43:22.504 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:22.504 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:22.504 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:22.504 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:22.504 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.169572+0000", 2024-09-13T06:43:22.504 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9996786 2024-09-13T06:43:22.504 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:22.504 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:22.504 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:22.505 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.169903+0000", 2024-09-13T06:43:22.505 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00033101400000000003 2024-09-13T06:43:22.505 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:22.505 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:22.505 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:22.505 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.169933+0000", 2024-09-13T06:43:22.505 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.9913e-05 2024-09-13T06:43:22.505 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:22.505 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:22.505 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:22.505 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.169949+0000", 2024-09-13T06:43:22.505 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6313000000000001e-05 2024-09-13T06:43:22.505 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:22.506 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:22.506 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:22.506 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.290622+0000", 2024-09-13T06:43:22.506 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.120672795 2024-09-13T06:43:22.506 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:22.506 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:22.506 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:22.506 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.290788+0000", 2024-09-13T06:43:22.506 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00016597899999999999 2024-09-13T06:43:22.506 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:22.506 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:22.506 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:22.506 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.291172+0000", 2024-09-13T06:43:22.506 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00038422700000000001 2024-09-13T06:43:22.507 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:22.507 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:22.507 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:22.507 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:22.507 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:22.507 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:43:22.508 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-13T06:43:22.509 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:43:22.507+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:43:22.530 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-13T06:43:22.609 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-13T06:43:22.609+0000 7fa8bb18e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 36790) UID: 0 2024-09-13T06:43:22.639 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:43:22.639 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [], 2024-09-13T06:43:22.639 INFO:teuthology.orchestra.run.smithi139.stdout: "num_ops": 0 2024-09-13T06:43:22.639 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:43:22.653 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-13T06:43:22.740 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:43:22.741+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:43:22.811 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:43:22.813+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:43:22.821 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:43:22.821 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [], 2024-09-13T06:43:22.821 INFO:teuthology.orchestra.run.smithi139.stdout: "complaint_time": 30, 2024-09-13T06:43:22.821 INFO:teuthology.orchestra.run.smithi139.stdout: "num_blocked_ops": 0 2024-09-13T06:43:22.821 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:43:22.835 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-13T06:43:22.912 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:43:22.911+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:43:23.006 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:43:23.006 INFO:teuthology.orchestra.run.smithi139.stdout: "size": 20, 2024-09-13T06:43:23.006 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 600, 2024-09-13T06:43:23.006 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [ 2024-09-13T06:43:23.006 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.006 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43299 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 432128~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:43:23.006 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589881+0000", 2024-09-13T06:43:23.007 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 181.414547126, 2024-09-13T06:43:23.007 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.079693849999999997, 2024-09-13T06:43:23.007 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:23.007 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:23.007 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:23.007 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:23.007 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:23.007 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43299 2024-09-13T06:43:23.007 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.007 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:23.007 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.007 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:23.007 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589881+0000", 2024-09-13T06:43:23.007 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:23.008 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.008 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.008 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:23.008 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589881+0000", 2024-09-13T06:43:23.008 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:23.008 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.008 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.008 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:23.008 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589880+0000", 2024-09-13T06:43:23.008 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:43:23.008 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.008 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.008 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:23.008 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589884+0000", 2024-09-13T06:43:23.009 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.053e-06 2024-09-13T06:43:23.009 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.009 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.009 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:23.009 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589893+0000", 2024-09-13T06:43:23.009 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.2129999999999997e-06 2024-09-13T06:43:23.009 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.009 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.009 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:23.009 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589901+0000", 2024-09-13T06:43:23.009 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.6399999999999997e-06 2024-09-13T06:43:23.009 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.009 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.009 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:23.010 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.669213+0000", 2024-09-13T06:43:23.010 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.079312074999999996 2024-09-13T06:43:23.010 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.010 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.010 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:23.010 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.669281+0000", 2024-09-13T06:43:23.010 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.8322000000000001e-05 2024-09-13T06:43:23.010 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.010 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.010 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:23.010 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.669575+0000", 2024-09-13T06:43:23.010 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00029349699999999999 2024-09-13T06:43:23.010 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:23.010 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:23.010 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:23.011 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.011 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.011 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43300 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 446464~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:43:23.011 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589909+0000", 2024-09-13T06:43:23.011 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 181.41451923100001, 2024-09-13T06:43:23.011 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.080339496999999996, 2024-09-13T06:43:23.011 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:23.011 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:23.011 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:23.011 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:23.011 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:23.011 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43300 2024-09-13T06:43:23.011 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.011 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:23.012 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.012 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:23.012 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589909+0000", 2024-09-13T06:43:23.012 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:23.012 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.012 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.012 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:23.012 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589909+0000", 2024-09-13T06:43:23.012 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:23.012 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.012 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.012 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:23.012 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589908+0000", 2024-09-13T06:43:23.013 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:43:23.013 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.013 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.013 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:23.013 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589912+0000", 2024-09-13T06:43:23.013 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.9430000000000002e-06 2024-09-13T06:43:23.013 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.013 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.013 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:23.013 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589920+0000", 2024-09-13T06:43:23.013 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.3860000000000007e-06 2024-09-13T06:43:23.013 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.013 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.014 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:23.014 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589928+0000", 2024-09-13T06:43:23.014 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.3329999999999999e-06 2024-09-13T06:43:23.014 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.014 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.014 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:23.014 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.669651+0000", 2024-09-13T06:43:23.014 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.079723204000000006 2024-09-13T06:43:23.014 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.014 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.014 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:23.014 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.669840+0000", 2024-09-13T06:43:23.014 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000189397 2024-09-13T06:43:23.014 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.014 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.015 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:23.015 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.670248+0000", 2024-09-13T06:43:23.015 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00040811100000000001 2024-09-13T06:43:23.015 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:23.015 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:23.015 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:23.015 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.015 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.015 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43301 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 460800~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:43:23.015 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589934+0000", 2024-09-13T06:43:23.015 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 181.41449455700001, 2024-09-13T06:43:23.015 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.080747474999999999, 2024-09-13T06:43:23.015 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:23.016 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:23.016 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:23.016 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:23.016 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:23.016 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43301 2024-09-13T06:43:23.016 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.016 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:23.016 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.016 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:23.016 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589934+0000", 2024-09-13T06:43:23.016 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:23.016 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.016 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.016 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:23.017 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589934+0000", 2024-09-13T06:43:23.017 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:23.017 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.017 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.017 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:23.017 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589933+0000", 2024-09-13T06:43:23.017 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:23.017 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.017 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.017 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:23.017 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589936+0000", 2024-09-13T06:43:23.017 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.4599999999999999e-06 2024-09-13T06:43:23.017 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.017 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.018 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:23.018 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589945+0000", 2024-09-13T06:43:23.018 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.2430000000000005e-06 2024-09-13T06:43:23.018 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.018 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.018 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:23.018 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589952+0000", 2024-09-13T06:43:23.018 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.3289999999999996e-06 2024-09-13T06:43:23.018 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.018 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.018 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:23.018 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.670280+0000", 2024-09-13T06:43:23.018 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.080328514000000004 2024-09-13T06:43:23.018 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.018 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.019 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:23.019 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.670376+0000", 2024-09-13T06:43:23.019 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.5752000000000001e-05 2024-09-13T06:43:23.019 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.019 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.019 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:23.019 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.670681+0000", 2024-09-13T06:43:23.019 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00030479699999999999 2024-09-13T06:43:23.019 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:23.019 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:23.019 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:23.019 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.019 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.020 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43302 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 475136~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:43:23.020 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589958+0000", 2024-09-13T06:43:23.020 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 181.41447049499999, 2024-09-13T06:43:23.020 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.081402394000000003, 2024-09-13T06:43:23.020 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:23.020 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:23.020 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:23.020 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:23.020 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:23.020 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43302 2024-09-13T06:43:23.020 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.020 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:23.021 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.021 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:23.021 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589958+0000", 2024-09-13T06:43:23.021 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:23.021 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.021 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.021 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:23.021 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589958+0000", 2024-09-13T06:43:23.021 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:23.021 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.021 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.021 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:23.021 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589957+0000", 2024-09-13T06:43:23.021 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:23.022 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.022 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.022 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:23.022 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589960+0000", 2024-09-13T06:43:23.022 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.4939999999999999e-06 2024-09-13T06:43:23.022 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.022 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.022 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:23.022 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589969+0000", 2024-09-13T06:43:23.022 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.3520000000000007e-06 2024-09-13T06:43:23.022 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.022 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.022 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:23.022 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589976+0000", 2024-09-13T06:43:23.022 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.3030000000000002e-06 2024-09-13T06:43:23.023 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.023 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.023 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:23.023 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.670765+0000", 2024-09-13T06:43:23.023 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.080789154000000002 2024-09-13T06:43:23.023 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.023 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.023 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:23.023 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.670960+0000", 2024-09-13T06:43:23.023 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00019464300000000001 2024-09-13T06:43:23.023 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.023 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.023 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:23.023 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.671360+0000", 2024-09-13T06:43:23.024 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00040005200000000002 2024-09-13T06:43:23.024 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:23.024 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:23.024 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:23.024 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.024 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.024 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43303 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 489472~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:43:23.024 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589985+0000", 2024-09-13T06:43:23.024 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 181.41444354699999, 2024-09-13T06:43:23.024 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.082024333000000005, 2024-09-13T06:43:23.024 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:23.024 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:23.024 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:23.025 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:23.025 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:23.025 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43303 2024-09-13T06:43:23.025 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.025 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:23.025 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.025 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:23.025 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589985+0000", 2024-09-13T06:43:23.025 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:23.025 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.025 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.025 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:23.025 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589985+0000", 2024-09-13T06:43:23.025 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:23.026 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.026 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.026 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:23.026 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589984+0000", 2024-09-13T06:43:23.026 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:43:23.026 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.026 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.026 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:23.026 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589987+0000", 2024-09-13T06:43:23.026 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.726e-06 2024-09-13T06:43:23.026 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.026 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.026 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:23.026 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589996+0000", 2024-09-13T06:43:23.026 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.5459999999999992e-06 2024-09-13T06:43:23.027 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.027 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.027 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:23.027 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590003+0000", 2024-09-13T06:43:23.027 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.4229999999999999e-06 2024-09-13T06:43:23.027 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.027 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.027 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:23.027 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.671426+0000", 2024-09-13T06:43:23.027 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.081422704999999998 2024-09-13T06:43:23.027 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.027 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.027 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:23.028 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.671615+0000", 2024-09-13T06:43:23.028 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000188875 2024-09-13T06:43:23.028 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.028 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.028 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:23.028 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.672009+0000", 2024-09-13T06:43:23.028 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000394015 2024-09-13T06:43:23.028 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:23.028 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:23.028 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:23.028 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.028 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.028 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43304 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 503808~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:43:23.028 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.590039+0000", 2024-09-13T06:43:23.028 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 181.41438900200001, 2024-09-13T06:43:23.029 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.082573880000000002, 2024-09-13T06:43:23.029 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:23.029 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:23.029 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:23.029 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:23.029 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:23.029 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43304 2024-09-13T06:43:23.029 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.029 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:23.029 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.029 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:23.029 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590039+0000", 2024-09-13T06:43:23.029 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:23.030 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.030 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.030 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:23.030 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590039+0000", 2024-09-13T06:43:23.030 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:23.030 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.030 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.030 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:23.030 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590038+0000", 2024-09-13T06:43:23.030 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:43:23.030 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.030 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.030 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:23.030 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590042+0000", 2024-09-13T06:43:23.030 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.9500000000000003e-06 2024-09-13T06:43:23.031 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.031 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.031 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:23.031 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590052+0000", 2024-09-13T06:43:23.031 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.3919999999999992e-06 2024-09-13T06:43:23.031 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.031 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.031 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:23.031 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590059+0000", 2024-09-13T06:43:23.031 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.7970000000000001e-06 2024-09-13T06:43:23.031 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.031 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.031 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:23.031 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.672078+0000", 2024-09-13T06:43:23.031 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.082018778000000001 2024-09-13T06:43:23.032 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.032 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.032 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:23.032 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.672266+0000", 2024-09-13T06:43:23.032 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00018807399999999999 2024-09-13T06:43:23.032 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.032 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.032 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:23.032 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.672613+0000", 2024-09-13T06:43:23.032 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00034677599999999997 2024-09-13T06:43:23.032 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:23.032 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:23.032 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:23.032 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.033 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.033 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43305 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 518144~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:43:23.033 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.590136+0000", 2024-09-13T06:43:23.033 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 181.41429181399999, 2024-09-13T06:43:23.033 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.082988206999999994, 2024-09-13T06:43:23.033 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:23.033 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:23.033 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:23.033 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:23.033 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:23.033 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43305 2024-09-13T06:43:23.033 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.033 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:23.033 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.033 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:23.034 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590136+0000", 2024-09-13T06:43:23.034 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:23.034 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.034 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.034 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:23.034 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590136+0000", 2024-09-13T06:43:23.034 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:23.034 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.034 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.035 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:23.035 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590135+0000", 2024-09-13T06:43:23.035 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:43:23.035 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.035 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.035 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:23.035 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590139+0000", 2024-09-13T06:43:23.035 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.9489999999999998e-06 2024-09-13T06:43:23.035 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.035 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.035 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:23.035 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590148+0000", 2024-09-13T06:43:23.035 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.9830000000000002e-06 2024-09-13T06:43:23.035 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.036 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.036 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:23.036 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590156+0000", 2024-09-13T06:43:23.036 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5229999999999998e-06 2024-09-13T06:43:23.036 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.036 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.036 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:23.036 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.672709+0000", 2024-09-13T06:43:23.036 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.082552886000000006 2024-09-13T06:43:23.036 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.036 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.036 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:23.036 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.672816+0000", 2024-09-13T06:43:23.036 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000107736 2024-09-13T06:43:23.036 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.037 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.037 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:23.037 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.673124+0000", 2024-09-13T06:43:23.037 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00030804900000000002 2024-09-13T06:43:23.037 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:23.037 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:23.037 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:23.037 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.041 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.041 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:66818 3.17 3.50afe697 (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e100)", 2024-09-13T06:43:23.041 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:53.498942+0000", 2024-09-13T06:43:23.041 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 149.50548562899999, 2024-09-13T06:43:23.041 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.011231284, 2024-09-13T06:43:23.041 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:23.041 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:43:23.041 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:23.041 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:23.041 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:23.041 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 66818 2024-09-13T06:43:23.042 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.042 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:23.042 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.042 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:23.042 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:53.498942+0000", 2024-09-13T06:43:23.042 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:23.042 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.042 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.042 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:23.042 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:53.498942+0000", 2024-09-13T06:43:23.042 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:23.042 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.042 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.042 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:23.042 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:53.498939+0000", 2024-09-13T06:43:23.043 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999967 2024-09-13T06:43:23.043 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.043 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.043 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:23.043 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:53.498954+0000", 2024-09-13T06:43:23.043 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5028000000000001e-05 2024-09-13T06:43:23.043 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.043 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.043 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:23.043 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:53.498986+0000", 2024-09-13T06:43:23.043 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.1993999999999999e-05 2024-09-13T06:43:23.043 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.043 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.043 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:23.044 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:53.499001+0000", 2024-09-13T06:43:23.044 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5166e-05 2024-09-13T06:43:23.044 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.044 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.044 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:23.044 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:53.505097+0000", 2024-09-13T06:43:23.044 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0060955610000000002 2024-09-13T06:43:23.044 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.044 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.045 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:43:23.045 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:53.505108+0000", 2024-09-13T06:43:23.045 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.084e-05 2024-09-13T06:43:23.045 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.045 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.045 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:23.045 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:54.510158+0000", 2024-09-13T06:43:23.045 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0050497549999999 2024-09-13T06:43:23.045 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.045 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.045 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:23.045 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:54.510174+0000", 2024-09-13T06:43:23.046 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6164e-05 2024-09-13T06:43:23.046 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:23.046 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:23.046 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:23.046 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.046 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.046 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:69764 3.2 3:47f10058:::rbd_data.11214956a993.0000000000000004:head [write-same] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e117)", 2024-09-13T06:43:23.046 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:41:11.371147+0000", 2024-09-13T06:43:23.046 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 131.63328131899999, 2024-09-13T06:43:23.046 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.03470167, 2024-09-13T06:43:23.046 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:23.047 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:43:23.047 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:23.047 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:23.047 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:23.047 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 69764 2024-09-13T06:43:23.047 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.047 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:23.047 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.047 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:23.047 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:11.371147+0000", 2024-09-13T06:43:23.047 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:23.047 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.047 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.048 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:23.048 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:11.371147+0000", 2024-09-13T06:43:23.048 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:23.048 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.048 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.048 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:23.048 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:11.371144+0000", 2024-09-13T06:43:23.048 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999967 2024-09-13T06:43:23.048 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.048 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.048 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:23.048 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:11.371161+0000", 2024-09-13T06:43:23.048 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7669e-05 2024-09-13T06:43:23.048 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.048 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.049 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:23.049 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:11.371198+0000", 2024-09-13T06:43:23.049 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.7014000000000002e-05 2024-09-13T06:43:23.049 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.049 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.049 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:23.049 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:11.371216+0000", 2024-09-13T06:43:23.049 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7425e-05 2024-09-13T06:43:23.049 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.049 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.049 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:23.049 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:11.371365+0000", 2024-09-13T06:43:23.049 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000149245 2024-09-13T06:43:23.049 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.050 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.050 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op must wait for map", 2024-09-13T06:43:23.050 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:11.371385+0000", 2024-09-13T06:43:23.050 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.0018999999999999e-05 2024-09-13T06:43:23.050 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.050 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.050 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:23.050 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:11.378406+0000", 2024-09-13T06:43:23.050 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0070207179999999996 2024-09-13T06:43:23.050 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.050 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.050 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:43:23.050 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:11.378429+0000", 2024-09-13T06:43:23.051 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.3453999999999999e-05 2024-09-13T06:43:23.051 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.051 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.051 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:23.051 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:12.405667+0000", 2024-09-13T06:43:23.051 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0272381690000001 2024-09-13T06:43:23.051 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.051 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.051 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:23.051 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:12.405848+0000", 2024-09-13T06:43:23.051 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00018112 2024-09-13T06:43:23.051 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:23.051 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:23.051 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:23.052 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.052 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.052 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:70346 3.16 3:69d35907:::rbd_object_map.11214956a993:head [read 0~36] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e122)", 2024-09-13T06:43:23.052 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:41:16.390917+0000", 2024-09-13T06:43:23.052 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 126.61351126700001, 2024-09-13T06:43:23.052 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.99327479799999996, 2024-09-13T06:43:23.052 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:23.052 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:23.052 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:23.052 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:23.052 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:23.052 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 70346 2024-09-13T06:43:23.053 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.053 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:23.053 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.053 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:23.053 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:16.390917+0000", 2024-09-13T06:43:23.053 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:23.053 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.053 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.053 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:23.053 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:16.390917+0000", 2024-09-13T06:43:23.053 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:23.053 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.053 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.053 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:23.054 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:16.390916+0000", 2024-09-13T06:43:23.054 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999986 2024-09-13T06:43:23.054 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.054 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.054 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:23.054 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:16.390922+0000", 2024-09-13T06:43:23.054 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.0480000000000004e-06 2024-09-13T06:43:23.054 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.054 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.054 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:23.054 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:16.390933+0000", 2024-09-13T06:43:23.054 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1387e-05 2024-09-13T06:43:23.054 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.054 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.054 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:23.055 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:16.390939+0000", 2024-09-13T06:43:23.055 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.8039999999999998e-06 2024-09-13T06:43:23.055 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.055 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.055 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:23.055 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:16.390983+0000", 2024-09-13T06:43:23.055 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.4663000000000003e-05 2024-09-13T06:43:23.055 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.055 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.055 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:43:23.055 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:16.390991+0000", 2024-09-13T06:43:23.055 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.8059999999999995e-06 2024-09-13T06:43:23.055 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.056 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.056 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:23.056 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:17.383624+0000", 2024-09-13T06:43:23.056 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.99263277299999997 2024-09-13T06:43:23.056 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.056 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.056 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:23.056 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:17.383891+0000", 2024-09-13T06:43:23.056 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00026717599999999999 2024-09-13T06:43:23.056 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.056 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.056 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:23.056 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:17.384192+0000", 2024-09-13T06:43:23.057 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00030047400000000001 2024-09-13T06:43:23.057 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:23.057 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:23.057 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:23.057 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.057 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.057 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:181624 3.1d 3:be5d0ef9:::rbd_data.11218aab7a9c.0000000000000000:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e203)", 2024-09-13T06:43:23.057 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:42:45.701744+0000", 2024-09-13T06:43:23.057 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 37.302684347000003, 2024-09-13T06:43:23.057 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.69964504800000005, 2024-09-13T06:43:23.057 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:23.057 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:23.057 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:23.058 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:23.058 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:23.058 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 181624 2024-09-13T06:43:23.058 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.058 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:23.058 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.058 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:23.058 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.701744+0000", 2024-09-13T06:43:23.058 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:23.058 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.058 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.058 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:23.058 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.701744+0000", 2024-09-13T06:43:23.059 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:23.059 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.059 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.059 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:23.059 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.701741+0000", 2024-09-13T06:43:23.059 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999976 2024-09-13T06:43:23.059 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.059 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.059 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:23.059 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.701754+0000", 2024-09-13T06:43:23.059 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2632999999999999e-05 2024-09-13T06:43:23.059 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.059 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.059 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:23.060 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.701789+0000", 2024-09-13T06:43:23.060 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.4993999999999997e-05 2024-09-13T06:43:23.060 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.060 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.060 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:23.060 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.701806+0000", 2024-09-13T06:43:23.060 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7016000000000001e-05 2024-09-13T06:43:23.060 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.060 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.060 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:23.060 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.701905+0000", 2024-09-13T06:43:23.060 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.8895999999999996e-05 2024-09-13T06:43:23.061 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.061 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.061 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:43:23.061 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.701920+0000", 2024-09-13T06:43:23.061 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5013e-05 2024-09-13T06:43:23.061 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.061 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.061 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:23.061 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.400672+0000", 2024-09-13T06:43:23.061 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.69875254499999995 2024-09-13T06:43:23.061 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.061 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.061 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:23.061 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.401034+0000", 2024-09-13T06:43:23.062 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00036181700000000001 2024-09-13T06:43:23.062 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.062 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.062 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:23.062 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.401389+0000", 2024-09-13T06:43:23.062 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00035464399999999999 2024-09-13T06:43:23.062 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:23.062 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:23.062 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:23.062 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.062 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.062 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:181638 3.1d 3:be5d0ef9:::rbd_data.11218aab7a9c.0000000000000000:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e203)", 2024-09-13T06:43:23.062 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:42:45.707356+0000", 2024-09-13T06:43:23.063 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 37.297071608000003, 2024-09-13T06:43:23.063 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.694720479, 2024-09-13T06:43:23.063 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:23.063 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:23.063 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:23.063 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:23.063 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:23.063 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 181638 2024-09-13T06:43:23.063 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.063 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:23.063 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.063 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:23.063 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707356+0000", 2024-09-13T06:43:23.064 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:23.064 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.064 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.064 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:23.064 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707356+0000", 2024-09-13T06:43:23.064 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:23.064 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.064 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.064 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:23.064 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707355+0000", 2024-09-13T06:43:23.064 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999981 2024-09-13T06:43:23.064 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.065 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.065 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:23.065 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707375+0000", 2024-09-13T06:43:23.065 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.0698000000000001e-05 2024-09-13T06:43:23.065 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.065 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.065 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:23.065 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707396+0000", 2024-09-13T06:43:23.065 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.1041000000000001e-05 2024-09-13T06:43:23.065 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.065 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.065 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:23.065 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707408+0000", 2024-09-13T06:43:23.066 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1583000000000001e-05 2024-09-13T06:43:23.066 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.066 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.066 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:23.066 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707513+0000", 2024-09-13T06:43:23.066 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000104981 2024-09-13T06:43:23.066 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.066 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.066 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:43:23.066 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707541+0000", 2024-09-13T06:43:23.066 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.8572999999999999e-05 2024-09-13T06:43:23.066 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.066 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.067 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:23.067 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.401666+0000", 2024-09-13T06:43:23.067 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.694124988 2024-09-13T06:43:23.067 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.067 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.067 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:23.067 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.401880+0000", 2024-09-13T06:43:23.067 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00021322100000000001 2024-09-13T06:43:23.067 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.067 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.067 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:23.067 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.402077+0000", 2024-09-13T06:43:23.067 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000197321 2024-09-13T06:43:23.068 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:23.068 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:23.068 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:23.068 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.068 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.068 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:181652 3.1d 3:be5d0ef9:::rbd_data.11218aab7a9c.0000000000000000:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e203)", 2024-09-13T06:43:23.068 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:42:45.707423+0000", 2024-09-13T06:43:23.068 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 37.297005077000001, 2024-09-13T06:43:23.068 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.69480806699999997, 2024-09-13T06:43:23.068 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:23.068 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:23.068 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:23.069 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:23.069 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:23.069 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 181652 2024-09-13T06:43:23.069 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.069 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:23.069 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.069 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:23.069 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707423+0000", 2024-09-13T06:43:23.069 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:23.069 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.069 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.069 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:23.070 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707423+0000", 2024-09-13T06:43:23.070 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:23.070 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.070 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.070 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:23.070 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707423+0000", 2024-09-13T06:43:23.070 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:23.070 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.070 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.070 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:23.070 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707427+0000", 2024-09-13T06:43:23.070 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.2010000000000001e-06 2024-09-13T06:43:23.070 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.070 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.071 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:23.071 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707442+0000", 2024-09-13T06:43:23.071 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.4993e-05 2024-09-13T06:43:23.071 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.071 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.071 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:23.071 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707447+0000", 2024-09-13T06:43:23.071 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.2170000000000002e-06 2024-09-13T06:43:23.071 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.071 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.071 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:23.071 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707656+0000", 2024-09-13T06:43:23.071 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00020908600000000001 2024-09-13T06:43:23.072 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.072 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.072 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:43:23.072 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707684+0000", 2024-09-13T06:43:23.072 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.7766000000000001e-05 2024-09-13T06:43:23.072 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.072 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.072 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:23.072 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.402101+0000", 2024-09-13T06:43:23.072 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.69441698100000004 2024-09-13T06:43:23.072 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.072 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.072 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:23.073 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.402156+0000", 2024-09-13T06:43:23.073 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.4725000000000002e-05 2024-09-13T06:43:23.073 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.073 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.073 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:23.073 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.402231+0000", 2024-09-13T06:43:23.073 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5587999999999995e-05 2024-09-13T06:43:23.073 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:23.073 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:23.073 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:23.073 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.073 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.073 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:181666 3.1d 3:be5d0ef9:::rbd_data.11218aab7a9c.0000000000000000:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e203)", 2024-09-13T06:43:23.074 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:42:45.707478+0000", 2024-09-13T06:43:23.074 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 37.296949890999997, 2024-09-13T06:43:23.074 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.69543359900000001, 2024-09-13T06:43:23.074 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:23.074 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:23.074 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:23.074 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:23.074 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:23.074 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 181666 2024-09-13T06:43:23.074 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.074 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:23.074 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.074 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:23.075 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707478+0000", 2024-09-13T06:43:23.075 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:23.075 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.075 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.075 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:23.075 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707478+0000", 2024-09-13T06:43:23.075 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:23.075 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.075 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.075 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:23.075 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707478+0000", 2024-09-13T06:43:23.075 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:23.075 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.075 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.076 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:23.076 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707481+0000", 2024-09-13T06:43:23.076 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.3589999999999999e-06 2024-09-13T06:43:23.076 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.076 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.076 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:23.076 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707492+0000", 2024-09-13T06:43:23.076 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0725e-05 2024-09-13T06:43:23.076 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.076 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.076 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:23.076 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707500+0000", 2024-09-13T06:43:23.076 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.1089999999999998e-06 2024-09-13T06:43:23.076 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.077 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.077 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:23.077 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707773+0000", 2024-09-13T06:43:23.077 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000273291 2024-09-13T06:43:23.077 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.077 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.077 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:43:23.077 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707784+0000", 2024-09-13T06:43:23.077 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0441999999999999e-05 2024-09-13T06:43:23.077 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.077 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.077 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:23.077 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.402290+0000", 2024-09-13T06:43:23.078 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.69450651500000005 2024-09-13T06:43:23.078 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.078 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.078 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:23.078 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.402489+0000", 2024-09-13T06:43:23.078 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000198999 2024-09-13T06:43:23.078 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.078 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.078 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:23.078 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.402912+0000", 2024-09-13T06:43:23.078 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00042257299999999998 2024-09-13T06:43:23.078 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:23.079 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:23.079 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:23.079 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.079 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.079 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:181680 3.1d 3:be5d0ef9:::rbd_data.11218aab7a9c.0000000000000000:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e203)", 2024-09-13T06:43:23.079 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:42:45.707517+0000", 2024-09-13T06:43:23.079 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 37.296910855, 2024-09-13T06:43:23.079 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.69532440799999995, 2024-09-13T06:43:23.079 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:23.079 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:23.079 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:23.079 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:23.079 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:23.079 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 181680 2024-09-13T06:43:23.079 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.080 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:23.080 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.080 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:23.080 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707517+0000", 2024-09-13T06:43:23.080 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:23.080 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.080 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.080 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:23.080 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707517+0000", 2024-09-13T06:43:23.080 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:23.080 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.080 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.080 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:23.080 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707517+0000", 2024-09-13T06:43:23.081 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:23.081 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.081 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.081 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:23.081 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707519+0000", 2024-09-13T06:43:23.081 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.2800000000000002e-06 2024-09-13T06:43:23.081 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.081 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.081 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:23.081 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707527+0000", 2024-09-13T06:43:23.081 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.2660000000000001e-06 2024-09-13T06:43:23.081 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.081 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.082 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:23.082 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707535+0000", 2024-09-13T06:43:23.082 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.1760000000000004e-06 2024-09-13T06:43:23.082 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.082 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.082 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:23.082 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707838+0000", 2024-09-13T06:43:23.082 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00030318000000000001 2024-09-13T06:43:23.082 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.082 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.082 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:43:23.082 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707850+0000", 2024-09-13T06:43:23.082 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1787000000000001e-05 2024-09-13T06:43:23.082 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.083 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.083 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:23.083 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.402702+0000", 2024-09-13T06:43:23.083 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.69485264599999996 2024-09-13T06:43:23.083 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.083 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.083 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:23.083 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.402783+0000", 2024-09-13T06:43:23.083 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.1114999999999998e-05 2024-09-13T06:43:23.083 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.083 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.083 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:23.083 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.402842+0000", 2024-09-13T06:43:23.083 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.8322999999999997e-05 2024-09-13T06:43:23.083 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:23.084 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:23.084 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:23.084 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.084 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.084 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:181694 3.1d 3:be5d0ef9:::rbd_data.11218aab7a9c.0000000000000000:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e203)", 2024-09-13T06:43:23.084 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:42:45.707544+0000", 2024-09-13T06:43:23.084 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 37.296884163000001, 2024-09-13T06:43:23.084 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.69580726699999995, 2024-09-13T06:43:23.084 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:23.084 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:23.084 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:23.084 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:23.084 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:23.085 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 181694 2024-09-13T06:43:23.085 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.085 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:23.085 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.085 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:23.085 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707544+0000", 2024-09-13T06:43:23.085 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:23.085 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.085 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.085 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:23.085 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707544+0000", 2024-09-13T06:43:23.085 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:23.085 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.086 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.086 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:23.086 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707543+0000", 2024-09-13T06:43:23.086 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:23.086 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.086 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.086 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:23.086 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707561+0000", 2024-09-13T06:43:23.086 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7804000000000001e-05 2024-09-13T06:43:23.086 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.086 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.086 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:23.086 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707575+0000", 2024-09-13T06:43:23.087 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3884e-05 2024-09-13T06:43:23.087 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.087 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.087 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:23.087 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707583+0000", 2024-09-13T06:43:23.087 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5730000000000002e-06 2024-09-13T06:43:23.087 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.087 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.087 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:23.087 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707899+0000", 2024-09-13T06:43:23.087 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00031663999999999998 2024-09-13T06:43:23.087 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.087 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.088 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:43:23.088 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707908+0000", 2024-09-13T06:43:23.088 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.1430000000000004e-06 2024-09-13T06:43:23.088 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.088 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.088 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:23.088 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.402973+0000", 2024-09-13T06:43:23.088 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.69506426099999996 2024-09-13T06:43:23.088 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.088 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.088 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:23.088 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.403155+0000", 2024-09-13T06:43:23.088 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00018245199999999999 2024-09-13T06:43:23.089 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.089 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.089 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:23.089 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.403351+0000", 2024-09-13T06:43:23.089 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000196028 2024-09-13T06:43:23.089 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:23.089 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:23.089 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:23.089 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.089 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.089 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:181708 3.1d 3:be5d0ef9:::rbd_data.11218aab7a9c.0000000000000000:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e203)", 2024-09-13T06:43:23.089 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:42:45.707622+0000", 2024-09-13T06:43:23.090 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 37.296806119000003, 2024-09-13T06:43:23.090 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.69603707699999995, 2024-09-13T06:43:23.090 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:23.090 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:23.090 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:23.090 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:23.090 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:23.090 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 181708 2024-09-13T06:43:23.090 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.090 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:23.090 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.090 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:23.090 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707622+0000", 2024-09-13T06:43:23.091 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:23.091 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.091 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.091 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:23.091 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707622+0000", 2024-09-13T06:43:23.091 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:23.091 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.091 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.091 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:23.091 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707621+0000", 2024-09-13T06:43:23.091 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:23.091 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.091 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.092 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:23.092 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707624+0000", 2024-09-13T06:43:23.092 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.8210000000000002e-06 2024-09-13T06:43:23.092 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.092 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.092 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:23.092 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707631+0000", 2024-09-13T06:43:23.092 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.8460000000000002e-06 2024-09-13T06:43:23.092 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.092 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.092 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:23.092 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707635+0000", 2024-09-13T06:43:23.092 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.4610000000000001e-06 2024-09-13T06:43:23.093 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.093 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.093 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:23.093 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707955+0000", 2024-09-13T06:43:23.093 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00031982000000000001 2024-09-13T06:43:23.093 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.093 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.093 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:43:23.093 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707966+0000", 2024-09-13T06:43:23.093 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0822000000000001e-05 2024-09-13T06:43:23.093 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.093 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.093 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:23.094 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.403541+0000", 2024-09-13T06:43:23.094 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.69557444300000004 2024-09-13T06:43:23.094 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.094 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.094 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:23.094 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.403598+0000", 2024-09-13T06:43:23.094 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.7147e-05 2024-09-13T06:43:23.094 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.094 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.094 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:23.094 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.403659+0000", 2024-09-13T06:43:23.094 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.1373999999999999e-05 2024-09-13T06:43:23.094 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:23.094 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:23.094 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:23.095 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.095 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.095 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:181722 3.1d 3:be5d0ef9:::rbd_data.11218aab7a9c.0000000000000000:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e203)", 2024-09-13T06:43:23.095 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:42:45.707640+0000", 2024-09-13T06:43:23.095 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 37.296787668, 2024-09-13T06:43:23.095 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.69620305800000004, 2024-09-13T06:43:23.095 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:23.095 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:23.095 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:23.095 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:23.095 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:23.095 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 181722 2024-09-13T06:43:23.095 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.095 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:23.095 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.096 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:23.096 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707640+0000", 2024-09-13T06:43:23.096 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:23.096 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.096 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.096 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:23.096 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707640+0000", 2024-09-13T06:43:23.096 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:23.096 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.096 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.096 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:23.096 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707640+0000", 2024-09-13T06:43:23.096 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:23.096 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.097 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.097 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:23.097 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707643+0000", 2024-09-13T06:43:23.097 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.213e-06 2024-09-13T06:43:23.097 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.097 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.097 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:23.097 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707651+0000", 2024-09-13T06:43:23.097 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.2290000000000003e-06 2024-09-13T06:43:23.097 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.097 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.097 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:23.097 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707656+0000", 2024-09-13T06:43:23.097 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.9320000000000004e-06 2024-09-13T06:43:23.098 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.098 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.098 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:23.098 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.708012+0000", 2024-09-13T06:43:23.098 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00035600600000000002 2024-09-13T06:43:23.098 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.098 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.098 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:43:23.098 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.708024+0000", 2024-09-13T06:43:23.098 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1336e-05 2024-09-13T06:43:23.098 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.098 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.098 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:23.098 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.403696+0000", 2024-09-13T06:43:23.099 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.69567234499999997 2024-09-13T06:43:23.099 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.099 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.099 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:23.099 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.403757+0000", 2024-09-13T06:43:23.099 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.0715999999999999e-05 2024-09-13T06:43:23.099 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.099 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.099 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:23.099 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.403843+0000", 2024-09-13T06:43:23.099 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6679000000000001e-05 2024-09-13T06:43:23.099 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:23.099 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:23.099 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:23.100 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.100 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.100 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:181736 3.1d 3:be5d0ef9:::rbd_data.11218aab7a9c.0000000000000000:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e203)", 2024-09-13T06:43:23.100 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:42:45.707661+0000", 2024-09-13T06:43:23.100 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 37.296767301000003, 2024-09-13T06:43:23.100 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.69667210700000004, 2024-09-13T06:43:23.100 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:23.100 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:23.100 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:23.100 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:23.100 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:23.100 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 181736 2024-09-13T06:43:23.100 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.100 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:23.101 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.101 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:23.101 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707661+0000", 2024-09-13T06:43:23.101 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:23.101 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.101 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.101 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:23.101 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707661+0000", 2024-09-13T06:43:23.101 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:23.101 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.101 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.101 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:23.101 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707660+0000", 2024-09-13T06:43:23.102 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:23.102 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.102 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.102 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:23.102 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707664+0000", 2024-09-13T06:43:23.102 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.393e-06 2024-09-13T06:43:23.102 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.102 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.102 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:23.102 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707673+0000", 2024-09-13T06:43:23.102 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.5100000000000004e-06 2024-09-13T06:43:23.102 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.103 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.103 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:23.103 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707680+0000", 2024-09-13T06:43:23.103 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.8680000000000001e-06 2024-09-13T06:43:23.103 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.103 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.103 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:23.103 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.708068+0000", 2024-09-13T06:43:23.103 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00038784699999999997 2024-09-13T06:43:23.103 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.103 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.103 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:43:23.103 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.708078+0000", 2024-09-13T06:43:23.104 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.842e-06 2024-09-13T06:43:23.104 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.104 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.104 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:23.104 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.403924+0000", 2024-09-13T06:43:23.104 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.69584657699999997 2024-09-13T06:43:23.104 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.104 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.104 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:23.104 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.404135+0000", 2024-09-13T06:43:23.104 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000210662 2024-09-13T06:43:23.104 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.104 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.104 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:23.105 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.404333+0000", 2024-09-13T06:43:23.105 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00019787900000000001 2024-09-13T06:43:23.105 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:23.105 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:23.105 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:23.105 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.105 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.105 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:181750 3.1d 3.9f70ba7d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e203)", 2024-09-13T06:43:23.105 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:42:45.707687+0000", 2024-09-13T06:43:23.105 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 37.296741437999998, 2024-09-13T06:43:23.105 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.69667232199999996, 2024-09-13T06:43:23.105 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:23.106 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:43:23.106 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:23.106 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:23.106 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:23.106 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 181750 2024-09-13T06:43:23.106 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.106 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:23.106 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.106 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:23.106 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707687+0000", 2024-09-13T06:43:23.106 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:23.106 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.106 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.106 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:23.107 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707687+0000", 2024-09-13T06:43:23.107 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:23.107 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.107 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.107 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:23.107 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707686+0000", 2024-09-13T06:43:23.107 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:23.107 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.107 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.107 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:23.107 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707689+0000", 2024-09-13T06:43:23.107 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.824e-06 2024-09-13T06:43:23.107 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.107 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.108 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:23.108 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707693+0000", 2024-09-13T06:43:23.108 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.5900000000000001e-06 2024-09-13T06:43:23.108 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.108 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.108 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:23.108 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707697+0000", 2024-09-13T06:43:23.108 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.6899999999999998e-06 2024-09-13T06:43:23.108 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.108 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.108 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:23.108 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.708109+0000", 2024-09-13T06:43:23.109 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00041220200000000002 2024-09-13T06:43:23.109 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.109 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.109 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:43:23.109 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.708118+0000", 2024-09-13T06:43:23.109 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6000000000000007e-06 2024-09-13T06:43:23.109 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.109 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.109 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:23.109 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.404353+0000", 2024-09-13T06:43:23.109 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.69623486400000001 2024-09-13T06:43:23.109 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.109 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.110 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:23.110 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.404359+0000", 2024-09-13T06:43:23.110 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.2480000000000001e-06 2024-09-13T06:43:23.110 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:23.110 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:23.110 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:23.110 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:23.110 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:23.110 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:43:23.112 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-13T06:43:23.112 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:43:23.111+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:43:23.213 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:43:23.211+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:43:23.237 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:43:23.238 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [], 2024-09-13T06:43:23.238 INFO:teuthology.orchestra.run.smithi139.stdout: "num_ops": 0 2024-09-13T06:43:23.238 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:43:23.253 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-13T06:43:23.313 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:43:23.313+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:43:23.376 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:43:23.376 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [], 2024-09-13T06:43:23.377 INFO:teuthology.orchestra.run.smithi139.stdout: "complaint_time": 30, 2024-09-13T06:43:23.377 INFO:teuthology.orchestra.run.smithi139.stdout: "num_blocked_ops": 0 2024-09-13T06:43:23.377 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:43:23.391 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-13T06:43:23.432 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:43:23.433+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:43:23.514 INFO:teuthology.orchestra.run.smithi081.stderr:nodeep-scrub is unset 2024-09-13T06:43:23.515 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:43:23.513+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:43:23.563 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:43:23.564 INFO:teuthology.orchestra.run.smithi139.stdout: "size": 20, 2024-09-13T06:43:23.564 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 600, 2024-09-13T06:43:23.564 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [ 2024-09-13T06:43:23.564 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.564 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:176089 3.11 3:8b97f15f:::rbd_data.1121a23b99f7.0000000000000000:head [write 0~4194304 [fadvise_sequential+fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e196)", 2024-09-13T06:43:23.564 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:42:36.707298+0000", 2024-09-13T06:43:23.564 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 46.856725695000002, 2024-09-13T06:43:23.564 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.053333426000000003, 2024-09-13T06:43:23.564 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:23.564 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:43:23.564 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:23.565 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:23.565 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:23.565 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 176089 2024-09-13T06:43:23.565 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.565 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:23.565 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.565 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:23.565 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.707298+0000", 2024-09-13T06:43:23.565 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:23.565 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.565 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.565 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:23.565 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.707298+0000", 2024-09-13T06:43:23.566 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:23.566 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.566 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.566 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:23.566 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.707296+0000", 2024-09-13T06:43:23.566 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999976 2024-09-13T06:43:23.566 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.566 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.566 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:23.566 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.717511+0000", 2024-09-13T06:43:23.567 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.010215218999999999 2024-09-13T06:43:23.567 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.567 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.567 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:23.567 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.717555+0000", 2024-09-13T06:43:23.567 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.4159000000000002e-05 2024-09-13T06:43:23.567 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.567 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.567 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:23.567 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.717569+0000", 2024-09-13T06:43:23.567 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3543999999999999e-05 2024-09-13T06:43:23.567 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.567 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.567 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:23.567 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.717677+0000", 2024-09-13T06:43:23.568 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00010798699999999999 2024-09-13T06:43:23.568 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.568 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.568 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:23.568 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.717896+0000", 2024-09-13T06:43:23.568 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000219466 2024-09-13T06:43:23.568 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.568 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.568 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 4", 2024-09-13T06:43:23.568 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.718090+0000", 2024-09-13T06:43:23.568 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00019322799999999999 2024-09-13T06:43:23.568 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.568 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.569 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:43:23.569 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.751403+0000", 2024-09-13T06:43:23.569 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.033313493 2024-09-13T06:43:23.569 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.569 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.569 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-13T06:43:23.569 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.760523+0000", 2024-09-13T06:43:23.569 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0091197150000000005 2024-09-13T06:43:23.569 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.569 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.569 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-13T06:43:23.569 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.760581+0000", 2024-09-13T06:43:23.569 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.8007999999999998e-05 2024-09-13T06:43:23.570 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.570 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.570 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:23.570 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.760632+0000", 2024-09-13T06:43:23.570 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.1085999999999998e-05 2024-09-13T06:43:23.570 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:23.570 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:23.570 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:23.570 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.570 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.570 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:176090 3.e 3:77f86bf9:::rbd_data.1121a23b99f7.0000000000000001:head [write 0~4194304 [fadvise_sequential+fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e196)", 2024-09-13T06:43:23.570 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:42:36.717590+0000", 2024-09-13T06:43:23.570 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 46.846434213000002, 2024-09-13T06:43:23.570 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.049445965000000001, 2024-09-13T06:43:23.570 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:23.571 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:43:23.571 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:23.571 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:23.571 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:23.571 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 176090 2024-09-13T06:43:23.571 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.571 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:23.571 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.571 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:23.571 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.717590+0000", 2024-09-13T06:43:23.571 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:23.571 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.571 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.571 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:23.571 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.717590+0000", 2024-09-13T06:43:23.572 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:23.572 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.572 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.572 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:23.572 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.717588+0000", 2024-09-13T06:43:23.572 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999981 2024-09-13T06:43:23.572 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.572 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.572 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:23.572 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.723934+0000", 2024-09-13T06:43:23.572 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0063462589999999999 2024-09-13T06:43:23.572 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.572 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.572 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:23.573 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.723960+0000", 2024-09-13T06:43:23.573 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.6251e-05 2024-09-13T06:43:23.573 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.573 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.573 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:23.573 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.723976+0000", 2024-09-13T06:43:23.573 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5277e-05 2024-09-13T06:43:23.573 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.573 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.573 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:23.573 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.724154+0000", 2024-09-13T06:43:23.573 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00017814400000000001 2024-09-13T06:43:23.573 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.574 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.574 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:23.574 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.724534+0000", 2024-09-13T06:43:23.574 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00038054799999999998 2024-09-13T06:43:23.574 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.574 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.574 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-13T06:43:23.574 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.724926+0000", 2024-09-13T06:43:23.574 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00039199100000000001 2024-09-13T06:43:23.574 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.574 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.574 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:43:23.574 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.744509+0000", 2024-09-13T06:43:23.575 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.019582977000000001 2024-09-13T06:43:23.575 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.575 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.575 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-13T06:43:23.575 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.766937+0000", 2024-09-13T06:43:23.575 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.022427765999999998 2024-09-13T06:43:23.575 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.575 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.575 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-13T06:43:23.575 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.766987+0000", 2024-09-13T06:43:23.575 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.9898000000000002e-05 2024-09-13T06:43:23.575 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.575 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.575 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:23.576 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.767036+0000", 2024-09-13T06:43:23.576 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.8782000000000002e-05 2024-09-13T06:43:23.576 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:23.576 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:23.576 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:23.576 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.576 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.576 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:176094 3.f 3:f5ca80c1:::rbd_data.1121a23b99f7.0000000000000004:head [write 0~4194304 [fadvise_sequential+fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e196)", 2024-09-13T06:43:23.576 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:42:36.724239+0000", 2024-09-13T06:43:23.576 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 46.839785112999998, 2024-09-13T06:43:23.576 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.043501235999999999, 2024-09-13T06:43:23.576 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:23.576 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:43:23.576 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:23.576 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:23.577 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:23.577 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 176094 2024-09-13T06:43:23.577 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.577 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:23.577 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.577 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:23.577 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.724239+0000", 2024-09-13T06:43:23.577 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:23.577 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.577 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.577 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:23.577 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.724239+0000", 2024-09-13T06:43:23.577 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:23.578 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.578 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.578 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:23.578 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.724237+0000", 2024-09-13T06:43:23.578 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999981 2024-09-13T06:43:23.578 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.578 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.578 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:23.578 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.733673+0000", 2024-09-13T06:43:23.578 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0094352700000000008 2024-09-13T06:43:23.578 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.578 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.578 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:23.578 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.733703+0000", 2024-09-13T06:43:23.579 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.0102000000000001e-05 2024-09-13T06:43:23.579 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.579 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.579 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:23.579 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.733718+0000", 2024-09-13T06:43:23.579 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5199e-05 2024-09-13T06:43:23.579 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.579 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.579 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:23.579 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.733780+0000", 2024-09-13T06:43:23.579 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.1691000000000003e-05 2024-09-13T06:43:23.579 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.579 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.580 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:23.580 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.733928+0000", 2024-09-13T06:43:23.580 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000147987 2024-09-13T06:43:23.580 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.580 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.580 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 4", 2024-09-13T06:43:23.580 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.734036+0000", 2024-09-13T06:43:23.580 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000108925 2024-09-13T06:43:23.580 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.580 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.580 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:43:23.580 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.763741+0000", 2024-09-13T06:43:23.580 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.029704151000000002 2024-09-13T06:43:23.581 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.581 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.581 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-13T06:43:23.581 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.767615+0000", 2024-09-13T06:43:23.581 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0038739120000000002 2024-09-13T06:43:23.581 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.581 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.581 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-13T06:43:23.581 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.767693+0000", 2024-09-13T06:43:23.581 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.8573999999999997e-05 2024-09-13T06:43:23.581 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.581 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.581 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:23.581 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.767740+0000", 2024-09-13T06:43:23.582 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.7154000000000003e-05 2024-09-13T06:43:23.582 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:23.582 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:23.582 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:23.582 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.582 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.582 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:205233 3.15 3:a97b2891:::rbd_data.11213650bb32.000000000000002e:head [set-alloc-hint object_size 4194304 write_size 4194304,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e209)", 2024-09-13T06:43:23.582 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:42:52.282586+0000", 2024-09-13T06:43:23.582 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 31.281438268999999, 2024-09-13T06:43:23.582 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.056996628000000001, 2024-09-13T06:43:23.582 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:23.582 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:43:23.582 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:23.582 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:23.583 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:23.583 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 205233 2024-09-13T06:43:23.583 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.583 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:23.583 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.583 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:23.583 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:52.282586+0000", 2024-09-13T06:43:23.583 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:23.583 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.583 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.583 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:23.583 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:52.282586+0000", 2024-09-13T06:43:23.583 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:23.583 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.584 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.584 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:23.584 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:52.282583+0000", 2024-09-13T06:43:23.584 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999976 2024-09-13T06:43:23.584 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.584 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.584 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:23.584 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:52.282599+0000", 2024-09-13T06:43:23.584 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5065999999999999e-05 2024-09-13T06:43:23.584 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.584 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.584 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:23.584 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:52.282632+0000", 2024-09-13T06:43:23.584 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.3386999999999997e-05 2024-09-13T06:43:23.585 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.585 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.585 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:23.585 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:52.282654+0000", 2024-09-13T06:43:23.585 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.177e-05 2024-09-13T06:43:23.585 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.585 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.585 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:23.585 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:52.282753+0000", 2024-09-13T06:43:23.585 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.9685000000000005e-05 2024-09-13T06:43:23.585 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.585 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.585 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:23.585 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:52.283000+0000", 2024-09-13T06:43:23.586 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000246278 2024-09-13T06:43:23.586 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.586 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.586 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 3", 2024-09-13T06:43:23.586 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:52.292656+0000", 2024-09-13T06:43:23.586 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0096565980000000006 2024-09-13T06:43:23.586 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.586 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.586 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:43:23.586 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:52.339352+0000", 2024-09-13T06:43:23.586 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.046695309999999997 2024-09-13T06:43:23.586 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.586 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.586 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-13T06:43:23.587 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:52.339373+0000", 2024-09-13T06:43:23.587 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.1002999999999999e-05 2024-09-13T06:43:23.587 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.587 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.587 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-13T06:43:23.587 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:52.339464+0000", 2024-09-13T06:43:23.587 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.1131999999999994e-05 2024-09-13T06:43:23.587 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.587 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.587 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:23.587 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:52.339582+0000", 2024-09-13T06:43:23.587 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000118799 2024-09-13T06:43:23.587 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:23.587 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:23.587 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:23.588 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.588 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.588 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:237445 3.15 3:abdd9d42:::rbd_data.1121cb4a09ed.0000000000000008:82 [read 69632~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e224)", 2024-09-13T06:43:23.588 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:43:08.800334+0000", 2024-09-13T06:43:23.588 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 14.763689861, 2024-09-13T06:43:23.588 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.032345681000000001, 2024-09-13T06:43:23.588 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:23.588 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:23.588 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:23.588 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:23.588 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:23.588 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 237445 2024-09-13T06:43:23.588 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.588 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:23.589 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.589 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:23.589 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800334+0000", 2024-09-13T06:43:23.589 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:23.589 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.589 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.589 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:23.589 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800334+0000", 2024-09-13T06:43:23.589 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:23.589 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.589 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.589 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:23.590 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800334+0000", 2024-09-13T06:43:23.590 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:23.590 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.590 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.590 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:23.590 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800338+0000", 2024-09-13T06:43:23.590 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.9539999999999998e-06 2024-09-13T06:43:23.590 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.590 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.590 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:23.590 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800342+0000", 2024-09-13T06:43:23.590 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.7249999999999999e-06 2024-09-13T06:43:23.590 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.590 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.591 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:23.591 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800345+0000", 2024-09-13T06:43:23.591 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.072e-06 2024-09-13T06:43:23.591 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.591 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.591 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:23.591 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.832482+0000", 2024-09-13T06:43:23.591 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.032137713999999998 2024-09-13T06:43:23.591 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.591 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.591 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:23.591 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.832571+0000", 2024-09-13T06:43:23.591 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.8252999999999997e-05 2024-09-13T06:43:23.591 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.591 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.592 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:23.592 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.832680+0000", 2024-09-13T06:43:23.592 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000109214 2024-09-13T06:43:23.592 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:23.592 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:23.592 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:23.592 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.592 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.592 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:237446 3.15 3:abdd9d42:::rbd_data.1121cb4a09ed.0000000000000008:82 [read 81920~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e224)", 2024-09-13T06:43:23.592 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:43:08.800348+0000", 2024-09-13T06:43:23.592 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 14.763676460999999, 2024-09-13T06:43:23.592 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.032454446999999997, 2024-09-13T06:43:23.592 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:23.592 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:23.593 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:23.593 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:23.593 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:23.593 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 237446 2024-09-13T06:43:23.593 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.593 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:23.593 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.593 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:23.593 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800348+0000", 2024-09-13T06:43:23.593 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:23.593 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.593 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.593 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:23.594 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800348+0000", 2024-09-13T06:43:23.594 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:23.594 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.594 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.594 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:23.594 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800347+0000", 2024-09-13T06:43:23.594 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:23.594 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.594 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.594 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:23.594 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800349+0000", 2024-09-13T06:43:23.594 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.452e-06 2024-09-13T06:43:23.594 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.594 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.595 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:23.595 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800354+0000", 2024-09-13T06:43:23.595 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.0350000000000001e-06 2024-09-13T06:43:23.595 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.595 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.595 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:23.595 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800357+0000", 2024-09-13T06:43:23.595 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.179e-06 2024-09-13T06:43:23.595 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.595 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.595 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:23.595 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.832707+0000", 2024-09-13T06:43:23.595 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.032350071000000001 2024-09-13T06:43:23.595 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.596 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.596 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:23.596 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.832748+0000", 2024-09-13T06:43:23.596 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0587000000000003e-05 2024-09-13T06:43:23.596 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.596 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.596 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:23.596 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.832802+0000", 2024-09-13T06:43:23.596 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.4429999999999999e-05 2024-09-13T06:43:23.596 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:23.596 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:23.596 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:23.596 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.596 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.596 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:237447 3.15 3:abdd9d42:::rbd_data.1121cb4a09ed.0000000000000008:82 [read 94208~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e224)", 2024-09-13T06:43:23.597 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:43:08.800360+0000", 2024-09-13T06:43:23.597 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 14.763664549, 2024-09-13T06:43:23.597 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.032679798000000003, 2024-09-13T06:43:23.597 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:23.597 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:23.597 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:23.597 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:23.597 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:23.597 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 237447 2024-09-13T06:43:23.597 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.597 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:23.597 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.597 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:23.597 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800360+0000", 2024-09-13T06:43:23.598 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:23.598 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.598 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.598 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:23.598 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800360+0000", 2024-09-13T06:43:23.598 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:23.598 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.598 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.598 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:23.598 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800359+0000", 2024-09-13T06:43:23.598 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:23.598 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.598 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.598 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:23.598 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800361+0000", 2024-09-13T06:43:23.599 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.463e-06 2024-09-13T06:43:23.599 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.599 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.599 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:23.599 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800364+0000", 2024-09-13T06:43:23.599 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.6279999999999998e-06 2024-09-13T06:43:23.599 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.599 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.599 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:23.599 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800367+0000", 2024-09-13T06:43:23.599 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.7259999999999998e-06 2024-09-13T06:43:23.599 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.599 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.599 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:23.600 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.832841+0000", 2024-09-13T06:43:23.600 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.032474115999999997 2024-09-13T06:43:23.600 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.600 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.600 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:23.600 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.832929+0000", 2024-09-13T06:43:23.600 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.7886000000000005e-05 2024-09-13T06:43:23.600 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.600 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.600 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:23.600 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.833039+0000", 2024-09-13T06:43:23.600 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00011024200000000001 2024-09-13T06:43:23.600 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:23.600 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:23.601 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:23.601 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.601 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.601 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:237448 3.15 3:abdd9d42:::rbd_data.1121cb4a09ed.0000000000000008:82 [read 106496~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e224)", 2024-09-13T06:43:23.601 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:43:08.800371+0000", 2024-09-13T06:43:23.601 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 14.76365341, 2024-09-13T06:43:23.601 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.032794221999999998, 2024-09-13T06:43:23.601 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:23.601 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:23.601 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:23.601 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:23.601 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:23.601 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 237448 2024-09-13T06:43:23.601 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.602 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:23.602 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.602 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:23.602 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800371+0000", 2024-09-13T06:43:23.602 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:23.602 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.602 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.602 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:23.602 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800371+0000", 2024-09-13T06:43:23.602 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:23.602 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.602 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.602 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:23.602 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800370+0000", 2024-09-13T06:43:23.602 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967296 2024-09-13T06:43:23.603 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.603 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.603 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:23.603 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800372+0000", 2024-09-13T06:43:23.603 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3510000000000001e-06 2024-09-13T06:43:23.603 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.603 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.603 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:23.603 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800376+0000", 2024-09-13T06:43:23.603 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.693e-06 2024-09-13T06:43:23.603 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.603 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.603 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:23.603 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800378+0000", 2024-09-13T06:43:23.604 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.8870000000000001e-06 2024-09-13T06:43:23.604 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.604 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.604 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:23.604 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.833069+0000", 2024-09-13T06:43:23.604 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.032690708999999998 2024-09-13T06:43:23.604 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.604 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.604 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:23.604 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.833110+0000", 2024-09-13T06:43:23.604 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.1356999999999997e-05 2024-09-13T06:43:23.604 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.604 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.604 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:23.604 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.833165+0000", 2024-09-13T06:43:23.605 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.4456999999999997e-05 2024-09-13T06:43:23.605 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:23.605 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:23.605 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:23.605 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.605 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.605 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:237449 3.15 3:abdd9d42:::rbd_data.1121cb4a09ed.0000000000000008:82 [read 118784~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e224)", 2024-09-13T06:43:23.605 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:43:08.800381+0000", 2024-09-13T06:43:23.605 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 14.763643267999999, 2024-09-13T06:43:23.605 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.033007068000000001, 2024-09-13T06:43:23.605 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:23.605 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:23.605 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:23.605 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:23.606 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:23.606 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 237449 2024-09-13T06:43:23.606 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.606 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:23.606 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.606 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:23.606 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800381+0000", 2024-09-13T06:43:23.606 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:23.606 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.606 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.606 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:23.606 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800381+0000", 2024-09-13T06:43:23.606 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:23.606 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.607 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.607 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:23.607 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800381+0000", 2024-09-13T06:43:23.607 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967296 2024-09-13T06:43:23.607 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.607 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.607 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:23.607 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800382+0000", 2024-09-13T06:43:23.607 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.395e-06 2024-09-13T06:43:23.607 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.607 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.607 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:23.607 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800386+0000", 2024-09-13T06:43:23.607 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.574e-06 2024-09-13T06:43:23.607 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.608 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.608 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:23.608 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800388+0000", 2024-09-13T06:43:23.608 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.8729999999999999e-06 2024-09-13T06:43:23.608 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.608 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.608 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:23.608 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.833204+0000", 2024-09-13T06:43:23.608 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.032815986999999998 2024-09-13T06:43:23.608 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.608 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.608 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:23.608 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.833289+0000", 2024-09-13T06:43:23.608 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.4085999999999994e-05 2024-09-13T06:43:23.609 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.609 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.609 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:23.609 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.833388+0000", 2024-09-13T06:43:23.609 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.9380000000000001e-05 2024-09-13T06:43:23.609 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:23.609 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:23.609 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:23.609 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.609 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.609 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:237450 3.15 3:abdd9d42:::rbd_data.1121cb4a09ed.0000000000000008:82 [read 131072~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e224)", 2024-09-13T06:43:23.609 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:43:08.800392+0000", 2024-09-13T06:43:23.609 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 14.76363194, 2024-09-13T06:43:23.609 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.033110507999999997, 2024-09-13T06:43:23.610 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:23.610 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:23.610 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:23.610 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:23.610 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:23.610 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 237450 2024-09-13T06:43:23.610 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.610 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:23.610 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.610 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:23.610 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800392+0000", 2024-09-13T06:43:23.610 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:23.610 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.610 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.611 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:23.611 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800392+0000", 2024-09-13T06:43:23.611 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:23.611 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.611 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.611 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:23.611 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800392+0000", 2024-09-13T06:43:23.611 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967296 2024-09-13T06:43:23.611 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.611 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.611 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:23.611 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800393+0000", 2024-09-13T06:43:23.611 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.375e-06 2024-09-13T06:43:23.611 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.611 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.612 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:23.612 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800397+0000", 2024-09-13T06:43:23.612 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.6109999999999998e-06 2024-09-13T06:43:23.612 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.612 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.612 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:23.612 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800400+0000", 2024-09-13T06:43:23.612 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.7580000000000001e-06 2024-09-13T06:43:23.612 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.612 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.612 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:23.612 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.833414+0000", 2024-09-13T06:43:23.612 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.033014767 2024-09-13T06:43:23.612 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.613 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.613 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:23.613 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.833453+0000", 2024-09-13T06:43:23.613 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.8711000000000003e-05 2024-09-13T06:43:23.613 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.613 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.613 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:23.613 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.833503+0000", 2024-09-13T06:43:23.613 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.9523e-05 2024-09-13T06:43:23.613 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:23.613 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:23.613 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:23.613 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.613 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.613 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:237451 3.15 3:abdd9d42:::rbd_data.1121cb4a09ed.0000000000000008:82 [read 143360~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e224)", 2024-09-13T06:43:23.614 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:43:08.800402+0000", 2024-09-13T06:43:23.614 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 14.763622121999999, 2024-09-13T06:43:23.614 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.033337717000000003, 2024-09-13T06:43:23.614 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:23.614 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:23.614 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:23.614 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:23.614 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:23.614 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 237451 2024-09-13T06:43:23.614 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.614 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:23.614 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.614 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:23.615 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800402+0000", 2024-09-13T06:43:23.615 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:23.615 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.615 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.615 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:23.615 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800402+0000", 2024-09-13T06:43:23.615 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:23.615 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.615 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.615 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:23.615 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800402+0000", 2024-09-13T06:43:23.615 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967296 2024-09-13T06:43:23.615 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.615 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.615 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:23.616 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800403+0000", 2024-09-13T06:43:23.616 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.37e-06 2024-09-13T06:43:23.616 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.616 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.616 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:23.616 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800407+0000", 2024-09-13T06:43:23.616 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.6820000000000001e-06 2024-09-13T06:43:23.616 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.616 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.616 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:23.616 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800410+0000", 2024-09-13T06:43:23.616 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.7810000000000001e-06 2024-09-13T06:43:23.616 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.617 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.617 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:23.617 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.833550+0000", 2024-09-13T06:43:23.617 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.033140192999999998 2024-09-13T06:43:23.617 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.617 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.617 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:23.617 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.833634+0000", 2024-09-13T06:43:23.617 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.4097000000000005e-05 2024-09-13T06:43:23.617 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.617 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.617 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:23.617 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.833740+0000", 2024-09-13T06:43:23.617 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00010582300000000001 2024-09-13T06:43:23.618 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:23.618 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:23.618 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:23.618 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.618 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.618 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:237452 3.15 3:abdd9d42:::rbd_data.1121cb4a09ed.0000000000000008:82 [read 155648~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e224)", 2024-09-13T06:43:23.618 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:43:08.800412+0000", 2024-09-13T06:43:23.618 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 14.763612166, 2024-09-13T06:43:23.618 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.033496535000000001, 2024-09-13T06:43:23.618 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:23.618 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:23.618 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:23.618 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:23.618 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:23.618 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 237452 2024-09-13T06:43:23.619 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.619 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:23.619 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.619 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:23.619 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800412+0000", 2024-09-13T06:43:23.619 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:23.619 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.619 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.619 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:23.619 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800412+0000", 2024-09-13T06:43:23.619 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:23.619 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.619 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.620 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:23.620 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800412+0000", 2024-09-13T06:43:23.620 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967296 2024-09-13T06:43:23.620 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.620 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.620 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:23.620 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800413+0000", 2024-09-13T06:43:23.620 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.342e-06 2024-09-13T06:43:23.620 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.620 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.620 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:23.620 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800417+0000", 2024-09-13T06:43:23.620 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.6480000000000001e-06 2024-09-13T06:43:23.620 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.621 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.621 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:23.621 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800419+0000", 2024-09-13T06:43:23.621 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.7920000000000001e-06 2024-09-13T06:43:23.621 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.621 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.621 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:23.621 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.833768+0000", 2024-09-13T06:43:23.621 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.033348587999999998 2024-09-13T06:43:23.621 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.621 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.621 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:23.621 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.833836+0000", 2024-09-13T06:43:23.622 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.8090999999999996e-05 2024-09-13T06:43:23.622 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.622 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.622 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:23.622 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.833908+0000", 2024-09-13T06:43:23.622 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.2311999999999995e-05 2024-09-13T06:43:23.622 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:23.622 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:23.622 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:23.622 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.622 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.622 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:237453 3.15 3:abdd9d42:::rbd_data.1121cb4a09ed.0000000000000008:82 [read 167936~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e224)", 2024-09-13T06:43:23.622 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:43:08.800422+0000", 2024-09-13T06:43:23.622 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 14.763602095, 2024-09-13T06:43:23.623 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.033735223000000002, 2024-09-13T06:43:23.623 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:23.623 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:23.623 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:23.623 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:23.623 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:23.623 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 237453 2024-09-13T06:43:23.623 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.623 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:23.623 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.623 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:23.623 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800422+0000", 2024-09-13T06:43:23.623 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:23.624 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.624 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.624 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:23.624 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800422+0000", 2024-09-13T06:43:23.624 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:23.624 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.624 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.624 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:23.624 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800422+0000", 2024-09-13T06:43:23.624 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967296 2024-09-13T06:43:23.624 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.624 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.624 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:23.624 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800423+0000", 2024-09-13T06:43:23.624 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3489999999999999e-06 2024-09-13T06:43:23.625 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.625 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.625 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:23.625 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800427+0000", 2024-09-13T06:43:23.625 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.6610000000000002e-06 2024-09-13T06:43:23.625 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.625 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.625 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:23.625 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800430+0000", 2024-09-13T06:43:23.625 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.9869999999999999e-06 2024-09-13T06:43:23.625 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.625 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.625 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:23.626 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.833958+0000", 2024-09-13T06:43:23.626 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.033528020999999998 2024-09-13T06:43:23.626 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.626 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.626 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:23.626 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.834047+0000", 2024-09-13T06:43:23.626 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.9492000000000003e-05 2024-09-13T06:43:23.626 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.626 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.626 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:23.626 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.834157+0000", 2024-09-13T06:43:23.626 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000109948 2024-09-13T06:43:23.626 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:23.626 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:23.627 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:23.627 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.627 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.627 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:237454 3.15 3:abdd9d42:::rbd_data.1121cb4a09ed.0000000000000008:82 [read 180224~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e224)", 2024-09-13T06:43:23.627 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:43:08.800432+0000", 2024-09-13T06:43:23.627 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 14.763591888000001, 2024-09-13T06:43:23.627 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.033853883000000001, 2024-09-13T06:43:23.627 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:23.627 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:23.627 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:23.627 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:23.627 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:23.627 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 237454 2024-09-13T06:43:23.628 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.628 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:23.628 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.628 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:23.628 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800432+0000", 2024-09-13T06:43:23.628 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:23.628 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.628 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.628 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:23.628 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800432+0000", 2024-09-13T06:43:23.628 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:23.628 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.629 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.629 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:23.629 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800432+0000", 2024-09-13T06:43:23.629 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:23.629 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.629 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.629 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:23.629 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800433+0000", 2024-09-13T06:43:23.629 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3379999999999999e-06 2024-09-13T06:43:23.629 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.629 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.629 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:23.629 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800437+0000", 2024-09-13T06:43:23.630 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.1679999999999997e-06 2024-09-13T06:43:23.630 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.630 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.630 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:23.630 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800440+0000", 2024-09-13T06:43:23.630 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.8830000000000002e-06 2024-09-13T06:43:23.630 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.630 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.630 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:23.630 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.834187+0000", 2024-09-13T06:43:23.630 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.033746532000000003 2024-09-13T06:43:23.630 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.631 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.631 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:23.631 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.834228+0000", 2024-09-13T06:43:23.631 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.087e-05 2024-09-13T06:43:23.631 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.631 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.631 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:23.631 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.834286+0000", 2024-09-13T06:43:23.631 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.8331000000000001e-05 2024-09-13T06:43:23.631 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:23.631 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:23.631 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:23.631 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.631 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.631 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:237455 3.15 3:abdd9d42:::rbd_data.1121cb4a09ed.0000000000000008:82 [read 192512~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e224)", 2024-09-13T06:43:23.632 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:43:08.800443+0000", 2024-09-13T06:43:23.632 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 14.763581415000001, 2024-09-13T06:43:23.632 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.034083294, 2024-09-13T06:43:23.632 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:23.632 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:23.632 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:23.632 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:23.632 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:23.632 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 237455 2024-09-13T06:43:23.632 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.632 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:23.632 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.632 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:23.633 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800443+0000", 2024-09-13T06:43:23.633 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:23.633 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.633 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.633 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:23.633 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800443+0000", 2024-09-13T06:43:23.633 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:23.633 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.633 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.633 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:23.633 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800442+0000", 2024-09-13T06:43:23.633 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967296 2024-09-13T06:43:23.634 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.634 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.634 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:23.634 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800444+0000", 2024-09-13T06:43:23.634 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.443e-06 2024-09-13T06:43:23.634 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.634 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.634 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:23.634 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800448+0000", 2024-09-13T06:43:23.634 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.6770000000000001e-06 2024-09-13T06:43:23.634 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.634 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.634 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:23.635 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800451+0000", 2024-09-13T06:43:23.635 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.0920000000000002e-06 2024-09-13T06:43:23.635 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.635 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.635 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:23.635 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.834323+0000", 2024-09-13T06:43:23.635 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.033872145999999999 2024-09-13T06:43:23.635 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.635 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.635 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:23.635 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.834420+0000", 2024-09-13T06:43:23.635 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6898999999999995e-05 2024-09-13T06:43:23.635 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.636 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.636 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:23.636 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.834526+0000", 2024-09-13T06:43:23.636 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000106272 2024-09-13T06:43:23.636 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:23.636 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:23.636 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:23.637 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.637 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.637 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:237456 3.15 3:abdd9d42:::rbd_data.1121cb4a09ed.0000000000000008:82 [read 204800~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e224)", 2024-09-13T06:43:23.637 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:43:08.800453+0000", 2024-09-13T06:43:23.637 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 14.763571204, 2024-09-13T06:43:23.637 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.034198615000000002, 2024-09-13T06:43:23.637 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:23.637 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:23.637 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:23.637 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:23.637 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:23.637 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 237456 2024-09-13T06:43:23.638 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.638 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:23.638 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.638 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:23.638 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800453+0000", 2024-09-13T06:43:23.638 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:23.638 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.638 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.638 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:23.638 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800453+0000", 2024-09-13T06:43:23.638 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:23.638 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.638 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.638 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:23.638 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800453+0000", 2024-09-13T06:43:23.639 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967296 2024-09-13T06:43:23.639 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.639 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.639 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:23.639 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800454+0000", 2024-09-13T06:43:23.639 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.361e-06 2024-09-13T06:43:23.639 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.639 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.639 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:23.639 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800458+0000", 2024-09-13T06:43:23.639 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.7189999999999999e-06 2024-09-13T06:43:23.639 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.639 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.639 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:23.640 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800461+0000", 2024-09-13T06:43:23.640 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.7599999999999998e-06 2024-09-13T06:43:23.640 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.640 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.640 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:23.640 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.834555+0000", 2024-09-13T06:43:23.640 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.034094192000000002 2024-09-13T06:43:23.640 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.640 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.640 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:23.640 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.834597+0000", 2024-09-13T06:43:23.640 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.2157000000000003e-05 2024-09-13T06:43:23.640 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.641 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.641 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:23.641 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.834652+0000", 2024-09-13T06:43:23.641 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.4660999999999997e-05 2024-09-13T06:43:23.641 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:23.641 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:23.641 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:23.641 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.641 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.641 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:237457 3.15 3:abdd9d42:::rbd_data.1121cb4a09ed.0000000000000008:82 [read 217088~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e224)", 2024-09-13T06:43:23.641 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:43:08.800463+0000", 2024-09-13T06:43:23.641 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 14.763561256999999, 2024-09-13T06:43:23.641 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.034419130999999999, 2024-09-13T06:43:23.641 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:23.641 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:23.642 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:23.642 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:23.642 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:23.642 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 237457 2024-09-13T06:43:23.642 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.642 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:23.642 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.642 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:23.642 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800463+0000", 2024-09-13T06:43:23.642 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:23.642 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.642 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.642 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:23.642 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800463+0000", 2024-09-13T06:43:23.642 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:23.643 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.643 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.643 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:23.643 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800463+0000", 2024-09-13T06:43:23.643 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967296 2024-09-13T06:43:23.643 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.643 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.643 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:23.643 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800466+0000", 2024-09-13T06:43:23.643 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.8240000000000001e-06 2024-09-13T06:43:23.643 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.643 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.644 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:23.644 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800470+0000", 2024-09-13T06:43:23.644 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.7579999999999998e-06 2024-09-13T06:43:23.644 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.644 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.644 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:23.644 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800473+0000", 2024-09-13T06:43:23.644 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.875e-06 2024-09-13T06:43:23.644 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.644 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.644 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:23.644 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.834688+0000", 2024-09-13T06:43:23.644 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.034215039000000003 2024-09-13T06:43:23.645 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.645 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.645 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:23.645 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.834772+0000", 2024-09-13T06:43:23.645 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.3870999999999997e-05 2024-09-13T06:43:23.645 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.645 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.645 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:23.645 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.834882+0000", 2024-09-13T06:43:23.645 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00011 2024-09-13T06:43:23.645 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:23.645 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:23.645 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:23.646 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.646 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.646 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:237458 3.15 3:abdd9d42:::rbd_data.1121cb4a09ed.0000000000000008:82 [read 229376~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e224)", 2024-09-13T06:43:23.646 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:43:08.800476+0000", 2024-09-13T06:43:23.646 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 14.763548509, 2024-09-13T06:43:23.646 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.034538358999999998, 2024-09-13T06:43:23.646 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:23.646 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:23.646 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:23.646 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:23.646 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:23.646 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 237458 2024-09-13T06:43:23.647 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.647 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:23.647 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.647 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:23.647 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800476+0000", 2024-09-13T06:43:23.647 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:23.647 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.647 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.647 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:23.647 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800476+0000", 2024-09-13T06:43:23.647 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:23.647 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.647 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.648 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:23.648 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800475+0000", 2024-09-13T06:43:23.648 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:23.648 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.648 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.648 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:23.648 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800477+0000", 2024-09-13T06:43:23.648 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.367e-06 2024-09-13T06:43:23.648 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.648 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.648 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:23.648 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800480+0000", 2024-09-13T06:43:23.649 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.7179999999999998e-06 2024-09-13T06:43:23.649 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.649 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.649 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:23.649 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800483+0000", 2024-09-13T06:43:23.649 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.807e-06 2024-09-13T06:43:23.649 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.649 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.649 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:23.649 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.834922+0000", 2024-09-13T06:43:23.649 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.034438261999999997 2024-09-13T06:43:23.649 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.649 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.650 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:23.650 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.834962+0000", 2024-09-13T06:43:23.650 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0287999999999998e-05 2024-09-13T06:43:23.650 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.650 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.650 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:23.650 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.835014+0000", 2024-09-13T06:43:23.650 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.2172999999999997e-05 2024-09-13T06:43:23.650 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:23.650 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:23.650 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:23.650 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.650 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.651 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:237459 3.15 3:abdd9d42:::rbd_data.1121cb4a09ed.0000000000000008:82 [read 241664~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e224)", 2024-09-13T06:43:23.651 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:43:08.800486+0000", 2024-09-13T06:43:23.651 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 14.763538368000001, 2024-09-13T06:43:23.651 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.034771370000000003, 2024-09-13T06:43:23.651 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:23.651 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:23.651 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:23.651 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:23.651 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:23.651 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 237459 2024-09-13T06:43:23.651 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.651 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:23.651 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.652 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:23.652 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800486+0000", 2024-09-13T06:43:23.652 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:23.652 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.652 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.652 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:23.652 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800486+0000", 2024-09-13T06:43:23.652 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:23.652 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.652 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.652 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:23.652 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800485+0000", 2024-09-13T06:43:23.652 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:23.652 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.653 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.653 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:23.653 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800487+0000", 2024-09-13T06:43:23.653 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.297e-06 2024-09-13T06:43:23.653 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.653 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.653 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:23.653 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800491+0000", 2024-09-13T06:43:23.653 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.4569999999999998e-06 2024-09-13T06:43:23.653 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.653 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.653 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:23.653 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800494+0000", 2024-09-13T06:43:23.654 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.8710000000000001e-06 2024-09-13T06:43:23.654 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.654 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.654 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:23.654 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.835058+0000", 2024-09-13T06:43:23.654 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.034564117999999998 2024-09-13T06:43:23.654 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.654 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.654 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:23.654 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.835142+0000", 2024-09-13T06:43:23.654 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.352e-05 2024-09-13T06:43:23.654 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.654 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.655 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:23.655 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.835257+0000", 2024-09-13T06:43:23.655 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00011537 2024-09-13T06:43:23.655 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:23.655 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:23.655 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:23.655 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.655 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.655 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:237460 3.15 3:abdd9d42:::rbd_data.1121cb4a09ed.0000000000000008:82 [read 253952~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e224)", 2024-09-13T06:43:23.655 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:43:08.800511+0000", 2024-09-13T06:43:23.655 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 14.763512698, 2024-09-13T06:43:23.655 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.034864764999999999, 2024-09-13T06:43:23.655 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:23.656 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:23.656 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:23.656 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:23.656 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:23.656 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 237460 2024-09-13T06:43:23.656 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.656 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:23.656 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.656 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:23.656 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800511+0000", 2024-09-13T06:43:23.656 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:23.656 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.657 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.657 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:23.657 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800511+0000", 2024-09-13T06:43:23.657 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:23.657 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.657 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.657 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:23.657 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800511+0000", 2024-09-13T06:43:23.657 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:23.657 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.657 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.657 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:23.658 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800513+0000", 2024-09-13T06:43:23.658 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6020000000000001e-06 2024-09-13T06:43:23.658 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.658 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.658 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:23.658 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800517+0000", 2024-09-13T06:43:23.658 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0559999999999998e-06 2024-09-13T06:43:23.658 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.658 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.658 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:23.658 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800521+0000", 2024-09-13T06:43:23.658 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.4050000000000002e-06 2024-09-13T06:43:23.658 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.658 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.659 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:23.659 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.835278+0000", 2024-09-13T06:43:23.659 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.034757154999999998 2024-09-13T06:43:23.659 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.659 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.659 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:23.659 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.835319+0000", 2024-09-13T06:43:23.659 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.1121000000000002e-05 2024-09-13T06:43:23.659 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:23.659 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:23.659 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:23.660 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.835376+0000", 2024-09-13T06:43:23.660 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.6820000000000001e-05 2024-09-13T06:43:23.660 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:23.660 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:23.660 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:23.660 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:23.660 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:23.660 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:43:23.662 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-13T06:43:23.662 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:43:23.663+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:43:23.762 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:43:23.763+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:43:23.796 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:43:23.797 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-13T06:43:23.797 INFO:teuthology.orchestra.run.smithi081.stdout: "num_ops": 0 2024-09-13T06:43:23.797 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:43:23.809 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-13T06:43:23.811 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-13T06:43:23.898 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:43:23.899+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:43:23.965 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-13T06:43:23.965+0000 7fa8bb18e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 36790) UID: 0 2024-09-13T06:43:23.978 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:43:23.978 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-13T06:43:23.979 INFO:teuthology.orchestra.run.smithi081.stdout: "complaint_time": 30, 2024-09-13T06:43:23.979 INFO:teuthology.orchestra.run.smithi081.stdout: "num_blocked_ops": 0 2024-09-13T06:43:23.979 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:43:23.995 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-13T06:43:24.005 INFO:teuthology.orchestra.run.smithi081.stdout:osd.0: {} 2024-09-13T06:43:24.006 INFO:teuthology.orchestra.run.smithi081.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-13T06:43:24.022 INFO:teuthology.orchestra.run.smithi081.stdout:osd.1: {} 2024-09-13T06:43:24.022 INFO:teuthology.orchestra.run.smithi081.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-13T06:43:24.038 INFO:teuthology.orchestra.run.smithi081.stdout:osd.2: {} 2024-09-13T06:43:24.038 INFO:teuthology.orchestra.run.smithi081.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-13T06:43:24.054 INFO:teuthology.orchestra.run.smithi081.stdout:osd.3: {} 2024-09-13T06:43:24.054 INFO:teuthology.orchestra.run.smithi081.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-13T06:43:24.065 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:43:24.063+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:43:24.074 INFO:teuthology.orchestra.run.smithi081.stdout:osd.4: {} 2024-09-13T06:43:24.075 INFO:teuthology.orchestra.run.smithi081.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-13T06:43:24.095 INFO:teuthology.orchestra.run.smithi081.stdout:osd.5: {} 2024-09-13T06:43:24.095 INFO:teuthology.orchestra.run.smithi081.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-13T06:43:24.095 INFO:teuthology.orchestra.run.smithi081.stderr:Error ENXIO: problem getting command descriptions from osd.6 2024-09-13T06:43:24.115 INFO:teuthology.orchestra.run.smithi081.stdout:osd.7: {} 2024-09-13T06:43:24.115 INFO:teuthology.orchestra.run.smithi081.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-13T06:43:24.118 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:43:24.118 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:43:24.118 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-13T06:43:24.119 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-13T06:43:24.132 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-13T06:43:24.174 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:43:24.175+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:43:24.268 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-13T06:43:24.269+0000 7fa8bb18e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 36790) UID: 0 2024-09-13T06:43:24.287 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:43:24.288 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:43:24.302 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-13T06:43:24.370 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:43:24.367+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:43:24.420 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:43:24.420 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:43:24.434 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-13T06:43:24.478 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:43:24.479+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:43:24.572 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:43:24.573+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:43:24.612 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:43:24.612 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:43:24.628 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-13T06:43:24.674 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:43:24.675+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:43:24.763 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:43:24.763 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:43:24.773 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:43:24.771+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:43:24.778 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-13T06:43:24.874 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:43:24.873+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:43:24.944 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:43:24.944 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:43:24.958 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-13T06:43:24.975 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:43:24.973+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:43:25.075 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:43:25.075 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:43:25.075 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:43:25.075+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:43:25.089 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-13T06:43:25.176 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:43:25.175+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:43:25.246 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:43:25.246 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:43:25.260 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-13T06:43:25.277 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:43:25.277+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:43:25.378 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:43:25.379+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:43:25.422 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:43:25.423 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:43:25.437 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-13T06:43:25.479 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:43:25.479+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:43:25.542 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-13T06:43:25.586 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:43:25.587+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:43:25.616 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:43:25.616 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:43:25.635 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-13T06:43:25.682 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:43:25.683+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:43:25.767 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:43:25.767 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:43:25.781 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-13T06:43:25.782 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:43:25.779+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:43:25.882 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:43:25.883+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:43:25.904 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:43:25.904 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:43:25.918 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-13T06:43:25.983 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-13T06:43:25.981+0000 7fa8bb18e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 36790) UID: 0 2024-09-13T06:43:26.035 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:43:26.035 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:43:26.050 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-13T06:43:26.084 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:43:26.083+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:43:26.120 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-13T06:43:26.185 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-13T06:43:26.185+0000 7fa8bb18e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 36790) UID: 0 2024-09-13T06:43:26.216 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:43:26.216 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:43:26.230 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-13T06:43:26.275 INFO:teuthology.orchestra.run.smithi081.stdout:osd.0: {} 2024-09-13T06:43:26.275 INFO:teuthology.orchestra.run.smithi081.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-13T06:43:26.285 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:43:26.283+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:43:26.291 INFO:teuthology.orchestra.run.smithi081.stdout:osd.1: {} 2024-09-13T06:43:26.291 INFO:teuthology.orchestra.run.smithi081.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-13T06:43:26.307 INFO:teuthology.orchestra.run.smithi081.stdout:osd.2: {} 2024-09-13T06:43:26.307 INFO:teuthology.orchestra.run.smithi081.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-13T06:43:26.323 INFO:teuthology.orchestra.run.smithi081.stdout:osd.3: {} 2024-09-13T06:43:26.324 INFO:teuthology.orchestra.run.smithi081.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-13T06:43:26.341 INFO:teuthology.orchestra.run.smithi081.stdout:osd.4: {} 2024-09-13T06:43:26.342 INFO:teuthology.orchestra.run.smithi081.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-13T06:43:26.360 INFO:teuthology.orchestra.run.smithi081.stdout:osd.5: {} 2024-09-13T06:43:26.360 INFO:teuthology.orchestra.run.smithi081.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-13T06:43:26.361 INFO:teuthology.orchestra.run.smithi081.stderr:Error ENXIO: problem getting command descriptions from osd.6 2024-09-13T06:43:26.379 INFO:teuthology.orchestra.run.smithi081.stdout:osd.7: {} 2024-09-13T06:43:26.379 INFO:teuthology.orchestra.run.smithi081.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-13T06:43:26.382 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-13T06:43:26.383 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-13T06:43:26.390 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:43:26.390 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [], 2024-09-13T06:43:26.390 INFO:teuthology.orchestra.run.smithi139.stdout: "complaint_time": 30, 2024-09-13T06:43:26.391 INFO:teuthology.orchestra.run.smithi139.stdout: "num_blocked_ops": 0 2024-09-13T06:43:26.391 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:43:26.405 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-13T06:43:26.408 INFO:teuthology.orchestra.run.smithi081.stderr:noscrub is set 2024-09-13T06:43:26.408 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:43:26.407+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:43:26.430 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 7, 5, 3, 4] out_osds: [6] dead_osds: [6] live_osds: [0, 1, 2, 3, 4, 5, 7] 2024-09-13T06:43:26.430 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-13T06:43:26.430 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap_items 2024-09-13T06:43:26.430 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-09-13T06:43:26.487 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:43:26.485+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:43:26.545 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:43:26.546 INFO:teuthology.orchestra.run.smithi139.stdout: "size": 20, 2024-09-13T06:43:26.546 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 600, 2024-09-13T06:43:26.546 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [ 2024-09-13T06:43:26.546 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:26.546 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43299 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 432128~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:43:26.546 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589881+0000", 2024-09-13T06:43:26.546 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 184.9554747, 2024-09-13T06:43:26.546 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.079693849999999997, 2024-09-13T06:43:26.546 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:26.546 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:26.547 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:26.547 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:26.547 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:26.547 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43299 2024-09-13T06:43:26.547 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:26.547 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:26.547 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:26.547 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:26.547 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589881+0000", 2024-09-13T06:43:26.547 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:26.547 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:26.547 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:26.548 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:26.548 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589881+0000", 2024-09-13T06:43:26.548 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:26.548 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:26.548 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:26.548 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:26.548 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589880+0000", 2024-09-13T06:43:26.548 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:43:26.548 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:26.548 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:26.548 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:26.548 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589884+0000", 2024-09-13T06:43:26.549 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.053e-06 2024-09-13T06:43:26.549 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:26.549 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:26.549 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:26.549 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589893+0000", 2024-09-13T06:43:26.549 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.2129999999999997e-06 2024-09-13T06:43:26.549 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:26.549 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:26.549 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:26.549 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589901+0000", 2024-09-13T06:43:26.549 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.6399999999999997e-06 2024-09-13T06:43:26.549 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:26.549 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:26.550 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:26.550 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.669213+0000", 2024-09-13T06:43:26.550 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.079312074999999996 2024-09-13T06:43:26.550 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:26.550 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:26.550 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:26.550 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.669281+0000", 2024-09-13T06:43:26.550 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.8322000000000001e-05 2024-09-13T06:43:26.550 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:26.550 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:26.550 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:26.550 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.669575+0000", 2024-09-13T06:43:26.550 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00029349699999999999 2024-09-13T06:43:26.550 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:26.551 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:26.551 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:26.551 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:26.551 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:26.551 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43300 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 446464~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:43:26.551 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589909+0000", 2024-09-13T06:43:26.551 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 184.95544680500001, 2024-09-13T06:43:26.551 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.080339496999999996, 2024-09-13T06:43:26.551 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:26.551 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:26.551 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:26.552 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:26.552 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:26.552 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43300 2024-09-13T06:43:26.552 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:26.552 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:26.552 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:26.552 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:26.552 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589909+0000", 2024-09-13T06:43:26.552 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:26.552 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:26.552 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:26.552 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:26.553 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589909+0000", 2024-09-13T06:43:26.553 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:26.553 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:26.553 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:26.553 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:26.553 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589908+0000", 2024-09-13T06:43:26.553 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:43:26.553 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:26.553 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:26.553 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:26.554 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589912+0000", 2024-09-13T06:43:26.554 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.9430000000000002e-06 2024-09-13T06:43:26.554 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:26.554 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:26.554 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:26.554 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589920+0000", 2024-09-13T06:43:26.554 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.3860000000000007e-06 2024-09-13T06:43:26.554 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:26.554 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:26.554 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:26.554 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589928+0000", 2024-09-13T06:43:26.554 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.3329999999999999e-06 2024-09-13T06:43:26.555 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:26.555 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:26.555 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:26.555 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.669651+0000", 2024-09-13T06:43:26.555 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.079723204000000006 2024-09-13T06:43:26.555 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:26.555 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:26.555 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:26.555 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.669840+0000", 2024-09-13T06:43:26.555 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000189397 2024-09-13T06:43:26.555 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:26.556 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:26.556 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:26.556 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.670248+0000", 2024-09-13T06:43:26.556 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00040811100000000001 2024-09-13T06:43:26.556 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:26.556 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:26.556 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:26.556 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:26.556 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:26.556 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43301 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 460800~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:43:26.556 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589934+0000", 2024-09-13T06:43:26.556 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 184.95542213100001, 2024-09-13T06:43:26.557 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.080747474999999999, 2024-09-13T06:43:26.557 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:26.557 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:26.557 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:26.557 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:26.557 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:26.557 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43301 2024-09-13T06:43:26.557 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:26.557 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:26.557 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:26.557 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:26.557 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589934+0000", 2024-09-13T06:43:26.557 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:26.557 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:26.558 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:26.558 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:26.558 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589934+0000", 2024-09-13T06:43:26.558 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:26.558 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:26.558 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:26.558 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:26.558 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589933+0000", 2024-09-13T06:43:26.558 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:26.558 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:26.558 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:26.558 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:26.558 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589936+0000", 2024-09-13T06:43:26.558 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.4599999999999999e-06 2024-09-13T06:43:26.559 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:26.559 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:26.559 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:26.559 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589945+0000", 2024-09-13T06:43:26.559 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.2430000000000005e-06 2024-09-13T06:43:26.559 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:26.559 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:26.559 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:26.559 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589952+0000", 2024-09-13T06:43:26.559 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.3289999999999996e-06 2024-09-13T06:43:26.559 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:26.559 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:26.559 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:26.560 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.670280+0000", 2024-09-13T06:43:26.560 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.080328514000000004 2024-09-13T06:43:26.560 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:26.560 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:26.560 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:26.560 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.670376+0000", 2024-09-13T06:43:26.560 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.5752000000000001e-05 2024-09-13T06:43:26.560 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:26.560 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:26.560 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:26.560 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.670681+0000", 2024-09-13T06:43:26.560 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00030479699999999999 2024-09-13T06:43:26.560 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:26.561 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:26.561 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:26.561 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:26.561 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:26.561 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43302 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 475136~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:43:26.561 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589958+0000", 2024-09-13T06:43:26.561 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 184.95539806900001, 2024-09-13T06:43:26.561 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.081402394000000003, 2024-09-13T06:43:26.561 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:26.561 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:26.561 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:26.561 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:26.561 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:26.562 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43302 2024-09-13T06:43:26.562 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:26.562 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:26.562 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:26.562 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:26.562 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589958+0000", 2024-09-13T06:43:26.562 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:26.562 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:26.562 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:26.562 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:26.562 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589958+0000", 2024-09-13T06:43:26.562 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:26.562 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:26.563 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:26.563 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:26.563 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589957+0000", 2024-09-13T06:43:26.563 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:26.563 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:26.563 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:26.563 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:26.563 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589960+0000", 2024-09-13T06:43:26.563 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.4939999999999999e-06 2024-09-13T06:43:26.563 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:26.563 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:26.563 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:26.563 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589969+0000", 2024-09-13T06:43:26.564 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.3520000000000007e-06 2024-09-13T06:43:26.564 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:26.564 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:26.564 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:26.564 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589976+0000", 2024-09-13T06:43:26.564 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.3030000000000002e-06 2024-09-13T06:43:26.564 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:26.564 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:26.564 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:26.564 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.670765+0000", 2024-09-13T06:43:26.564 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.080789154000000002 2024-09-13T06:43:26.564 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:26.565 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:26.565 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:26.565 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.670960+0000", 2024-09-13T06:43:26.565 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00019464300000000001 2024-09-13T06:43:26.565 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:26.565 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:26.565 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:26.565 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.671360+0000", 2024-09-13T06:43:26.565 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00040005200000000002 2024-09-13T06:43:26.565 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:26.565 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:26.565 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:26.565 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:26.566 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:26.566 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43303 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 489472~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:43:26.566 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589985+0000", 2024-09-13T06:43:26.566 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 184.95537112100001, 2024-09-13T06:43:26.566 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.082024333000000005, 2024-09-13T06:43:26.566 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:26.566 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:26.566 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:26.566 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:26.566 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:26.566 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43303 2024-09-13T06:43:26.566 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:26.566 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:26.567 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:26.567 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:26.567 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589985+0000", 2024-09-13T06:43:26.567 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:26.567 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:26.567 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:26.567 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:26.567 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589985+0000", 2024-09-13T06:43:26.567 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:26.567 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:26.567 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:26.567 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:26.567 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589984+0000", 2024-09-13T06:43:26.568 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:43:26.568 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:26.568 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:26.568 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:26.568 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589987+0000", 2024-09-13T06:43:26.568 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.726e-06 2024-09-13T06:43:26.568 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:26.568 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:26.568 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:26.568 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589996+0000", 2024-09-13T06:43:26.568 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.5459999999999992e-06 2024-09-13T06:43:26.569 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:26.569 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:26.569 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:26.569 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590003+0000", 2024-09-13T06:43:26.569 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.4229999999999999e-06 2024-09-13T06:43:26.569 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:26.569 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:26.569 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:26.569 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.671426+0000", 2024-09-13T06:43:26.569 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.081422704999999998 2024-09-13T06:43:26.569 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:26.569 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:26.569 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:26.570 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.671615+0000", 2024-09-13T06:43:26.570 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000188875 2024-09-13T06:43:26.570 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:26.570 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:26.570 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:26.570 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.672009+0000", 2024-09-13T06:43:26.570 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000394015 2024-09-13T06:43:26.570 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:26.570 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:26.570 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:26.570 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:26.570 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:26.570 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43304 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 503808~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:43:26.571 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.590039+0000", 2024-09-13T06:43:26.571 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 184.955316576, 2024-09-13T06:43:26.571 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.082573880000000002, 2024-09-13T06:43:26.571 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:26.571 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:26.571 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:26.571 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:26.571 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:26.571 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43304 2024-09-13T06:43:26.571 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:26.571 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:26.571 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:26.571 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:26.572 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590039+0000", 2024-09-13T06:43:26.572 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:26.572 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:26.572 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:26.572 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:26.572 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590039+0000", 2024-09-13T06:43:26.572 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:26.572 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:26.572 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:26.572 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:26.572 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590038+0000", 2024-09-13T06:43:26.572 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:43:26.572 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:26.573 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:26.573 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:26.573 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590042+0000", 2024-09-13T06:43:26.573 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.9500000000000003e-06 2024-09-13T06:43:26.573 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:26.573 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:26.573 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:26.573 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590052+0000", 2024-09-13T06:43:26.573 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.3919999999999992e-06 2024-09-13T06:43:26.573 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:26.573 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:26.573 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:26.573 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590059+0000", 2024-09-13T06:43:26.574 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.7970000000000001e-06 2024-09-13T06:43:26.574 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:26.574 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:26.574 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:26.574 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.672078+0000", 2024-09-13T06:43:26.574 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.082018778000000001 2024-09-13T06:43:26.574 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:26.574 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:26.574 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:26.574 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.672266+0000", 2024-09-13T06:43:26.574 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00018807399999999999 2024-09-13T06:43:26.574 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:26.574 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:26.574 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:26.575 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.672613+0000", 2024-09-13T06:43:26.575 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00034677599999999997 2024-09-13T06:43:26.575 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:26.575 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:26.575 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:26.575 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:26.575 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:26.575 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43305 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 518144~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:43:26.575 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.590136+0000", 2024-09-13T06:43:26.575 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 184.95521938799999, 2024-09-13T06:43:26.575 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.082988206999999994, 2024-09-13T06:43:26.575 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:26.575 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:26.575 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:26.576 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:26.576 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:26.576 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43305 2024-09-13T06:43:26.576 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:26.576 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:26.576 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:26.576 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:26.576 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590136+0000", 2024-09-13T06:43:26.576 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:26.576 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:26.576 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:26.576 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:26.577 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590136+0000", 2024-09-13T06:43:26.577 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:26.577 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:26.577 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:26.577 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:26.577 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590135+0000", 2024-09-13T06:43:26.577 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:43:26.577 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:26.577 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:26.577 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:26.577 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590139+0000", 2024-09-13T06:43:26.577 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.9489999999999998e-06 2024-09-13T06:43:26.577 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:26.578 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:26.578 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:26.578 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590148+0000", 2024-09-13T06:43:26.578 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.9830000000000002e-06 2024-09-13T06:43:26.578 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:26.578 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:26.578 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:26.578 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590156+0000", 2024-09-13T06:43:26.578 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5229999999999998e-06 2024-09-13T06:43:26.578 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:26.578 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:26.578 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:26.578 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.672709+0000", 2024-09-13T06:43:26.579 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.082552886000000006 2024-09-13T06:43:26.579 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:26.579 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:26.579 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:26.579 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.672816+0000", 2024-09-13T06:43:26.579 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000107736 2024-09-13T06:43:26.579 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:26.579 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:26.579 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:26.579 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.673124+0000", 2024-09-13T06:43:26.579 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00030804900000000002 2024-09-13T06:43:26.579 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:26.579 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:26.579 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:26.580 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:26.580 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:26.580 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:66818 3.17 3.50afe697 (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e100)", 2024-09-13T06:43:26.580 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:53.498942+0000", 2024-09-13T06:43:26.580 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 153.04641320299999, 2024-09-13T06:43:26.580 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.011231284, 2024-09-13T06:43:26.580 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:26.580 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:43:26.580 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:26.580 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:26.580 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:26.581 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 66818 2024-09-13T06:43:26.581 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:26.581 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:26.581 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:26.581 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:26.581 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:53.498942+0000", 2024-09-13T06:43:26.581 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:26.581 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:26.581 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:26.581 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:26.581 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:53.498942+0000", 2024-09-13T06:43:26.581 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:26.581 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:26.582 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:26.582 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:26.582 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:53.498939+0000", 2024-09-13T06:43:26.582 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999967 2024-09-13T06:43:26.582 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:26.582 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:26.582 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:26.582 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:53.498954+0000", 2024-09-13T06:43:26.582 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5028000000000001e-05 2024-09-13T06:43:26.582 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:26.582 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:26.582 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:26.582 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:53.498986+0000", 2024-09-13T06:43:26.583 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.1993999999999999e-05 2024-09-13T06:43:26.583 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:26.583 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:26.583 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:26.583 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:53.499001+0000", 2024-09-13T06:43:26.583 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5166e-05 2024-09-13T06:43:26.583 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:26.583 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:26.583 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:26.583 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:53.505097+0000", 2024-09-13T06:43:26.583 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0060955610000000002 2024-09-13T06:43:26.583 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:26.583 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:26.584 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:43:26.584 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:53.505108+0000", 2024-09-13T06:43:26.584 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.084e-05 2024-09-13T06:43:26.584 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:26.584 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:26.584 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:26.584 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:54.510158+0000", 2024-09-13T06:43:26.584 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0050497549999999 2024-09-13T06:43:26.584 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:26.584 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:26.584 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:26.585 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:54.510174+0000", 2024-09-13T06:43:26.585 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6164e-05 2024-09-13T06:43:26.585 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:26.585 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:26.585 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:26.585 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:26.585 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:26.585 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:69764 3.2 3:47f10058:::rbd_data.11214956a993.0000000000000004:head [write-same] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e117)", 2024-09-13T06:43:26.585 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:41:11.371147+0000", 2024-09-13T06:43:26.585 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 135.17420889300001, 2024-09-13T06:43:26.585 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.03470167, 2024-09-13T06:43:26.585 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:26.585 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:43:26.586 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:26.586 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:26.586 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:26.586 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 69764 2024-09-13T06:43:26.586 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:26.586 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:26.586 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:26.586 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:26.586 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:11.371147+0000", 2024-09-13T06:43:26.586 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:26.586 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:26.586 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:26.586 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:26.587 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:11.371147+0000", 2024-09-13T06:43:26.587 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:26.587 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:26.587 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:26.587 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:26.587 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:11.371144+0000", 2024-09-13T06:43:26.587 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999967 2024-09-13T06:43:26.587 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:26.587 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:26.587 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:26.587 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:11.371161+0000", 2024-09-13T06:43:26.587 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7669e-05 2024-09-13T06:43:26.587 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:26.587 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:26.588 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:26.588 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:11.371198+0000", 2024-09-13T06:43:26.588 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.7014000000000002e-05 2024-09-13T06:43:26.588 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:26.588 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:26.588 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:26.588 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:11.371216+0000", 2024-09-13T06:43:26.588 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7425e-05 2024-09-13T06:43:26.588 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:26.588 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:26.588 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:26.588 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:11.371365+0000", 2024-09-13T06:43:26.588 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000149245 2024-09-13T06:43:26.589 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:26.589 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:26.589 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op must wait for map", 2024-09-13T06:43:26.589 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:11.371385+0000", 2024-09-13T06:43:26.589 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.0018999999999999e-05 2024-09-13T06:43:26.589 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:26.589 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:26.589 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:26.589 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:11.378406+0000", 2024-09-13T06:43:26.589 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0070207179999999996 2024-09-13T06:43:26.589 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:26.589 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:26.589 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:43:26.590 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:11.378429+0000", 2024-09-13T06:43:26.590 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.3453999999999999e-05 2024-09-13T06:43:26.590 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:26.590 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:26.590 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:26.590 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:12.405667+0000", 2024-09-13T06:43:26.590 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0272381690000001 2024-09-13T06:43:26.590 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:26.590 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:26.590 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:26.590 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:12.405848+0000", 2024-09-13T06:43:26.590 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00018112 2024-09-13T06:43:26.590 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:26.591 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:26.591 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:26.591 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:26.591 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:26.591 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:70346 3.16 3:69d35907:::rbd_object_map.11214956a993:head [read 0~36] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e122)", 2024-09-13T06:43:26.591 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:41:16.390917+0000", 2024-09-13T06:43:26.591 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 130.154438841, 2024-09-13T06:43:26.591 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.99327479799999996, 2024-09-13T06:43:26.591 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:26.591 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:26.591 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:26.591 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:26.591 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:26.592 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 70346 2024-09-13T06:43:26.592 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:26.592 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:26.592 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:26.592 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:26.592 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:16.390917+0000", 2024-09-13T06:43:26.592 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:26.592 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:26.592 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:26.592 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:26.592 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:16.390917+0000", 2024-09-13T06:43:26.592 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:26.593 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:26.593 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:26.593 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:26.593 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:16.390916+0000", 2024-09-13T06:43:26.593 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999986 2024-09-13T06:43:26.593 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:26.593 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:26.593 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:26.593 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:16.390922+0000", 2024-09-13T06:43:26.593 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.0480000000000004e-06 2024-09-13T06:43:26.593 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:26.593 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:26.594 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:26.594 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:16.390933+0000", 2024-09-13T06:43:26.594 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1387e-05 2024-09-13T06:43:26.594 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:26.594 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:26.594 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:26.594 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:16.390939+0000", 2024-09-13T06:43:26.594 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.8039999999999998e-06 2024-09-13T06:43:26.594 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:26.594 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:26.594 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:26.595 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:16.390983+0000", 2024-09-13T06:43:26.595 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.4663000000000003e-05 2024-09-13T06:43:26.595 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:26.595 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:26.595 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:43:26.595 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:16.390991+0000", 2024-09-13T06:43:26.595 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.8059999999999995e-06 2024-09-13T06:43:26.595 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:26.595 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:26.595 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:26.595 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:17.383624+0000", 2024-09-13T06:43:26.595 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.99263277299999997 2024-09-13T06:43:26.596 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:26.596 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:26.596 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:26.596 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:17.383891+0000", 2024-09-13T06:43:26.596 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00026717599999999999 2024-09-13T06:43:26.596 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:26.596 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:26.596 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:26.596 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:17.384192+0000", 2024-09-13T06:43:26.596 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00030047400000000001 2024-09-13T06:43:26.596 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:26.596 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:26.596 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:26.597 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:26.597 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:26.597 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:181624 3.1d 3:be5d0ef9:::rbd_data.11218aab7a9c.0000000000000000:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e203)", 2024-09-13T06:43:26.597 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:42:45.701744+0000", 2024-09-13T06:43:26.597 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 40.843611920999997, 2024-09-13T06:43:26.597 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.69964504800000005, 2024-09-13T06:43:26.597 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:26.597 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:26.597 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:26.597 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:26.597 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:26.597 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 181624 2024-09-13T06:43:26.597 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:26.597 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:26.598 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:26.598 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:26.598 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.701744+0000", 2024-09-13T06:43:26.598 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:26.598 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:26.598 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:26.598 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:26.598 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.701744+0000", 2024-09-13T06:43:26.598 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:26.598 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:26.598 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:26.598 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:26.598 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.701741+0000", 2024-09-13T06:43:26.599 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999976 2024-09-13T06:43:26.599 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:26.599 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:26.599 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:26.599 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.701754+0000", 2024-09-13T06:43:26.599 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2632999999999999e-05 2024-09-13T06:43:26.599 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:26.599 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:26.599 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:26.599 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.701789+0000", 2024-09-13T06:43:26.599 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.4993999999999997e-05 2024-09-13T06:43:26.599 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:26.599 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:26.599 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:26.600 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.701806+0000", 2024-09-13T06:43:26.600 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7016000000000001e-05 2024-09-13T06:43:26.600 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:26.600 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:26.600 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:26.600 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.701905+0000", 2024-09-13T06:43:26.600 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.8895999999999996e-05 2024-09-13T06:43:26.600 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:26.600 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:26.600 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:43:26.600 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.701920+0000", 2024-09-13T06:43:26.600 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5013e-05 2024-09-13T06:43:26.600 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:26.600 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:26.601 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:26.601 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.400672+0000", 2024-09-13T06:43:26.601 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.69875254499999995 2024-09-13T06:43:26.601 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:26.601 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:26.601 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:26.601 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.401034+0000", 2024-09-13T06:43:26.601 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00036181700000000001 2024-09-13T06:43:26.601 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:26.601 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:26.601 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:26.601 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.401389+0000", 2024-09-13T06:43:26.601 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00035464399999999999 2024-09-13T06:43:26.602 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:26.602 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:26.602 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:26.602 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:26.602 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:26.602 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:181638 3.1d 3:be5d0ef9:::rbd_data.11218aab7a9c.0000000000000000:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e203)", 2024-09-13T06:43:26.602 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:42:45.707356+0000", 2024-09-13T06:43:26.602 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 40.837999181999997, 2024-09-13T06:43:26.602 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.694720479, 2024-09-13T06:43:26.602 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:26.602 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:26.602 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:26.602 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:26.603 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:26.603 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 181638 2024-09-13T06:43:26.603 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:26.603 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:26.603 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:26.603 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:26.603 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707356+0000", 2024-09-13T06:43:26.603 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:26.603 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:26.603 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:26.603 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:26.603 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707356+0000", 2024-09-13T06:43:26.603 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:26.604 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:26.604 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:26.604 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:26.604 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707355+0000", 2024-09-13T06:43:26.604 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999981 2024-09-13T06:43:26.604 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:26.604 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:26.604 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:26.604 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707375+0000", 2024-09-13T06:43:26.604 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.0698000000000001e-05 2024-09-13T06:43:26.604 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:26.604 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:26.604 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:26.605 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707396+0000", 2024-09-13T06:43:26.605 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.1041000000000001e-05 2024-09-13T06:43:26.605 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:26.605 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:26.605 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:26.605 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707408+0000", 2024-09-13T06:43:26.605 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1583000000000001e-05 2024-09-13T06:43:26.605 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:26.605 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:26.605 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:26.605 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707513+0000", 2024-09-13T06:43:26.606 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000104981 2024-09-13T06:43:26.606 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:26.606 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:26.606 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:43:26.606 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707541+0000", 2024-09-13T06:43:26.606 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.8572999999999999e-05 2024-09-13T06:43:26.606 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:26.606 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:26.606 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:26.606 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.401666+0000", 2024-09-13T06:43:26.606 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.694124988 2024-09-13T06:43:26.607 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:26.607 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:26.607 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:26.607 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.401880+0000", 2024-09-13T06:43:26.607 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00021322100000000001 2024-09-13T06:43:26.607 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:26.607 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:26.607 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:26.607 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.402077+0000", 2024-09-13T06:43:26.607 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000197321 2024-09-13T06:43:26.607 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:26.607 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:26.607 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:26.607 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:26.608 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:26.608 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:181652 3.1d 3:be5d0ef9:::rbd_data.11218aab7a9c.0000000000000000:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e203)", 2024-09-13T06:43:26.608 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:42:45.707423+0000", 2024-09-13T06:43:26.608 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 40.837932651000003, 2024-09-13T06:43:26.608 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.69480806699999997, 2024-09-13T06:43:26.608 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:26.608 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:26.608 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:26.608 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:26.608 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:26.608 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 181652 2024-09-13T06:43:26.608 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:26.608 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:26.609 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:26.609 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:26.609 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707423+0000", 2024-09-13T06:43:26.609 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:26.609 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:26.609 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:26.609 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:26.609 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707423+0000", 2024-09-13T06:43:26.609 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:26.609 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:26.609 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:26.609 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:26.609 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707423+0000", 2024-09-13T06:43:26.610 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:26.610 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:26.610 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:26.610 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:26.610 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707427+0000", 2024-09-13T06:43:26.610 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.2010000000000001e-06 2024-09-13T06:43:26.610 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:26.610 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:26.610 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:26.610 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707442+0000", 2024-09-13T06:43:26.610 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.4993e-05 2024-09-13T06:43:26.610 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:26.610 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:26.610 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:26.611 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707447+0000", 2024-09-13T06:43:26.611 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.2170000000000002e-06 2024-09-13T06:43:26.611 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:26.611 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:26.611 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:26.611 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707656+0000", 2024-09-13T06:43:26.611 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00020908600000000001 2024-09-13T06:43:26.611 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:26.611 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:26.611 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:43:26.611 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707684+0000", 2024-09-13T06:43:26.611 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.7766000000000001e-05 2024-09-13T06:43:26.611 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:26.611 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:26.612 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:26.612 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.402101+0000", 2024-09-13T06:43:26.612 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.69441698100000004 2024-09-13T06:43:26.612 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:26.612 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:26.612 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:26.612 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.402156+0000", 2024-09-13T06:43:26.612 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.4725000000000002e-05 2024-09-13T06:43:26.612 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:26.612 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:26.612 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:26.612 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.402231+0000", 2024-09-13T06:43:26.612 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5587999999999995e-05 2024-09-13T06:43:26.613 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:26.613 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:26.613 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:26.613 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:26.613 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:26.613 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:181666 3.1d 3:be5d0ef9:::rbd_data.11218aab7a9c.0000000000000000:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e203)", 2024-09-13T06:43:26.613 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:42:45.707478+0000", 2024-09-13T06:43:26.613 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 40.837877464999998, 2024-09-13T06:43:26.613 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.69543359900000001, 2024-09-13T06:43:26.613 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:26.613 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:26.613 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:26.613 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:26.613 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:26.614 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 181666 2024-09-13T06:43:26.614 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:26.614 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:26.614 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:26.614 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:26.614 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707478+0000", 2024-09-13T06:43:26.614 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:26.614 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:26.614 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:26.614 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:26.614 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707478+0000", 2024-09-13T06:43:26.614 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:26.614 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:26.615 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:26.615 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:26.615 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707478+0000", 2024-09-13T06:43:26.615 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:26.615 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:26.615 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:26.615 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:26.615 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707481+0000", 2024-09-13T06:43:26.615 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.3589999999999999e-06 2024-09-13T06:43:26.615 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:26.615 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:26.615 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:26.615 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707492+0000", 2024-09-13T06:43:26.615 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0725e-05 2024-09-13T06:43:26.616 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:26.616 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:26.616 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:26.616 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707500+0000", 2024-09-13T06:43:26.616 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.1089999999999998e-06 2024-09-13T06:43:26.616 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:26.616 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:26.616 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:26.616 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707773+0000", 2024-09-13T06:43:26.616 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000273291 2024-09-13T06:43:26.616 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:26.616 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:26.617 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:43:26.617 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707784+0000", 2024-09-13T06:43:26.617 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0441999999999999e-05 2024-09-13T06:43:26.617 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:26.617 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:26.617 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:26.617 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.402290+0000", 2024-09-13T06:43:26.617 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.69450651500000005 2024-09-13T06:43:26.617 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:26.617 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:26.617 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:26.617 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.402489+0000", 2024-09-13T06:43:26.617 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000198999 2024-09-13T06:43:26.618 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:26.618 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:26.618 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:26.618 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.402912+0000", 2024-09-13T06:43:26.618 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00042257299999999998 2024-09-13T06:43:26.618 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:26.618 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:26.618 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:26.618 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:26.618 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:26.618 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:181680 3.1d 3:be5d0ef9:::rbd_data.11218aab7a9c.0000000000000000:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e203)", 2024-09-13T06:43:26.618 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:42:45.707517+0000", 2024-09-13T06:43:26.618 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 40.837838429000001, 2024-09-13T06:43:26.619 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.69532440799999995, 2024-09-13T06:43:26.619 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:26.619 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:26.619 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:26.619 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:26.619 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:26.619 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 181680 2024-09-13T06:43:26.619 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:26.619 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:26.619 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:26.619 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:26.619 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707517+0000", 2024-09-13T06:43:26.619 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:26.620 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:26.620 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:26.620 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:26.620 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707517+0000", 2024-09-13T06:43:26.620 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:26.620 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:26.620 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:26.620 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:26.620 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707517+0000", 2024-09-13T06:43:26.620 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:26.620 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:26.620 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:26.620 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:26.621 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707519+0000", 2024-09-13T06:43:26.621 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.2800000000000002e-06 2024-09-13T06:43:26.621 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:26.621 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:26.621 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:26.621 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707527+0000", 2024-09-13T06:43:26.621 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.2660000000000001e-06 2024-09-13T06:43:26.621 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:26.621 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:26.621 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:26.621 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707535+0000", 2024-09-13T06:43:26.621 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.1760000000000004e-06 2024-09-13T06:43:26.621 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:26.622 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:26.622 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:26.622 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707838+0000", 2024-09-13T06:43:26.622 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00030318000000000001 2024-09-13T06:43:26.622 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:26.622 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:26.622 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:43:26.622 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707850+0000", 2024-09-13T06:43:26.622 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1787000000000001e-05 2024-09-13T06:43:26.622 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:26.622 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:26.622 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:26.622 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.402702+0000", 2024-09-13T06:43:26.622 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.69485264599999996 2024-09-13T06:43:26.623 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:26.623 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:26.623 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:26.623 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.402783+0000", 2024-09-13T06:43:26.623 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.1114999999999998e-05 2024-09-13T06:43:26.623 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:26.623 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:26.623 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:26.623 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.402842+0000", 2024-09-13T06:43:26.623 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.8322999999999997e-05 2024-09-13T06:43:26.623 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:26.623 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:26.623 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:26.624 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:26.624 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:26.624 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:181694 3.1d 3:be5d0ef9:::rbd_data.11218aab7a9c.0000000000000000:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e203)", 2024-09-13T06:43:26.624 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:42:45.707544+0000", 2024-09-13T06:43:26.624 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 40.837811737000003, 2024-09-13T06:43:26.624 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.69580726699999995, 2024-09-13T06:43:26.624 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:26.624 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:26.624 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:26.624 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:26.624 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:26.624 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 181694 2024-09-13T06:43:26.624 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:26.624 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:26.625 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:26.625 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:26.625 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707544+0000", 2024-09-13T06:43:26.625 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:26.625 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:26.625 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:26.625 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:26.625 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707544+0000", 2024-09-13T06:43:26.625 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:26.625 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:26.625 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:26.625 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:26.625 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707543+0000", 2024-09-13T06:43:26.626 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:26.626 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:26.626 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:26.626 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:26.626 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707561+0000", 2024-09-13T06:43:26.626 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7804000000000001e-05 2024-09-13T06:43:26.626 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:26.626 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:26.626 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:26.626 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707575+0000", 2024-09-13T06:43:26.626 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3884e-05 2024-09-13T06:43:26.626 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:26.626 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:26.627 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:26.627 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707583+0000", 2024-09-13T06:43:26.627 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5730000000000002e-06 2024-09-13T06:43:26.627 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:26.627 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:26.627 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:26.627 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707899+0000", 2024-09-13T06:43:26.627 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00031663999999999998 2024-09-13T06:43:26.627 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:26.627 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:26.627 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:43:26.627 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707908+0000", 2024-09-13T06:43:26.627 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.1430000000000004e-06 2024-09-13T06:43:26.627 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:26.628 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:26.628 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:26.628 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.402973+0000", 2024-09-13T06:43:26.628 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.69506426099999996 2024-09-13T06:43:26.628 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:26.628 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:26.628 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:26.628 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.403155+0000", 2024-09-13T06:43:26.628 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00018245199999999999 2024-09-13T06:43:26.628 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:26.628 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:26.628 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:26.628 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.403351+0000", 2024-09-13T06:43:26.629 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000196028 2024-09-13T06:43:26.629 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:26.629 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:26.629 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:26.629 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:26.629 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:26.629 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:181708 3.1d 3:be5d0ef9:::rbd_data.11218aab7a9c.0000000000000000:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e203)", 2024-09-13T06:43:26.629 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:42:45.707622+0000", 2024-09-13T06:43:26.629 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 40.837733692999997, 2024-09-13T06:43:26.629 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.69603707699999995, 2024-09-13T06:43:26.629 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:26.629 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:26.629 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:26.629 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:26.630 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:26.630 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 181708 2024-09-13T06:43:26.630 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:26.630 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:26.630 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:26.630 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:26.630 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707622+0000", 2024-09-13T06:43:26.630 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:26.630 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:26.630 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:26.630 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:26.630 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707622+0000", 2024-09-13T06:43:26.630 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:26.630 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:26.631 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:26.631 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:26.631 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707621+0000", 2024-09-13T06:43:26.631 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:26.631 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:26.631 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:26.631 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:26.631 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707624+0000", 2024-09-13T06:43:26.631 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.8210000000000002e-06 2024-09-13T06:43:26.631 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:26.631 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:26.631 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:26.631 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707631+0000", 2024-09-13T06:43:26.632 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.8460000000000002e-06 2024-09-13T06:43:26.632 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:26.632 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:26.632 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:26.632 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707635+0000", 2024-09-13T06:43:26.632 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.4610000000000001e-06 2024-09-13T06:43:26.632 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:26.632 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:26.632 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:26.632 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707955+0000", 2024-09-13T06:43:26.632 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00031982000000000001 2024-09-13T06:43:26.632 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:26.632 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:26.633 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:43:26.633 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707966+0000", 2024-09-13T06:43:26.633 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0822000000000001e-05 2024-09-13T06:43:26.633 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:26.633 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:26.633 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:26.633 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.403541+0000", 2024-09-13T06:43:26.633 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.69557444300000004 2024-09-13T06:43:26.633 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:26.633 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:26.633 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:26.633 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.403598+0000", 2024-09-13T06:43:26.633 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.7147e-05 2024-09-13T06:43:26.634 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:26.634 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:26.634 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:26.634 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.403659+0000", 2024-09-13T06:43:26.634 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.1373999999999999e-05 2024-09-13T06:43:26.634 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:26.634 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:26.634 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:26.634 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:26.634 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:26.634 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:181722 3.1d 3:be5d0ef9:::rbd_data.11218aab7a9c.0000000000000000:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e203)", 2024-09-13T06:43:26.634 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:42:45.707640+0000", 2024-09-13T06:43:26.634 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 40.837715242000002, 2024-09-13T06:43:26.635 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.69620305800000004, 2024-09-13T06:43:26.635 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:26.635 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:26.635 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:26.635 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:26.635 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:26.635 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 181722 2024-09-13T06:43:26.635 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:26.635 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:26.635 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:26.635 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:26.635 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707640+0000", 2024-09-13T06:43:26.636 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:26.636 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:26.636 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:26.636 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:26.636 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707640+0000", 2024-09-13T06:43:26.636 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:26.636 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:26.636 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:26.636 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:26.636 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707640+0000", 2024-09-13T06:43:26.636 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:26.636 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:26.636 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:26.637 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:26.637 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707643+0000", 2024-09-13T06:43:26.637 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.213e-06 2024-09-13T06:43:26.637 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:26.637 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:26.637 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:26.637 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707651+0000", 2024-09-13T06:43:26.637 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.2290000000000003e-06 2024-09-13T06:43:26.637 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:26.637 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:26.637 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:26.637 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707656+0000", 2024-09-13T06:43:26.638 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.9320000000000004e-06 2024-09-13T06:43:26.638 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:26.638 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:26.638 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:26.638 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.708012+0000", 2024-09-13T06:43:26.638 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00035600600000000002 2024-09-13T06:43:26.638 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:26.638 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:26.638 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:43:26.638 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.708024+0000", 2024-09-13T06:43:26.638 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1336e-05 2024-09-13T06:43:26.638 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:26.638 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:26.639 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:26.639 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.403696+0000", 2024-09-13T06:43:26.639 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.69567234499999997 2024-09-13T06:43:26.639 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:26.639 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:26.639 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:26.639 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.403757+0000", 2024-09-13T06:43:26.639 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.0715999999999999e-05 2024-09-13T06:43:26.639 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:26.639 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:26.639 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:26.639 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.403843+0000", 2024-09-13T06:43:26.639 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6679000000000001e-05 2024-09-13T06:43:26.640 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:26.640 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:26.640 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:26.640 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:26.640 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:26.640 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:181736 3.1d 3:be5d0ef9:::rbd_data.11218aab7a9c.0000000000000000:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e203)", 2024-09-13T06:43:26.640 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:42:45.707661+0000", 2024-09-13T06:43:26.640 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 40.837694874999997, 2024-09-13T06:43:26.640 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.69667210700000004, 2024-09-13T06:43:26.640 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:26.640 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:26.640 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:26.640 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:26.641 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:26.641 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 181736 2024-09-13T06:43:26.641 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:26.641 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:26.641 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:26.641 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:26.641 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707661+0000", 2024-09-13T06:43:26.641 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:26.641 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:26.641 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:26.641 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:26.641 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707661+0000", 2024-09-13T06:43:26.641 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:26.642 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:26.642 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:26.642 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:26.642 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707660+0000", 2024-09-13T06:43:26.642 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:26.642 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:26.642 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:26.642 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:26.642 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707664+0000", 2024-09-13T06:43:26.642 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.393e-06 2024-09-13T06:43:26.642 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:26.642 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:26.642 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:26.642 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707673+0000", 2024-09-13T06:43:26.643 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.5100000000000004e-06 2024-09-13T06:43:26.643 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:26.643 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:26.643 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:26.643 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707680+0000", 2024-09-13T06:43:26.643 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.8680000000000001e-06 2024-09-13T06:43:26.643 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:26.643 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:26.643 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:26.643 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.708068+0000", 2024-09-13T06:43:26.643 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00038784699999999997 2024-09-13T06:43:26.643 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:26.643 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:26.643 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:43:26.644 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.708078+0000", 2024-09-13T06:43:26.644 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.842e-06 2024-09-13T06:43:26.644 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:26.644 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:26.644 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:26.644 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.403924+0000", 2024-09-13T06:43:26.644 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.69584657699999997 2024-09-13T06:43:26.644 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:26.644 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:26.644 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:26.644 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.404135+0000", 2024-09-13T06:43:26.644 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000210662 2024-09-13T06:43:26.644 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:26.645 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:26.645 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:26.645 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.404333+0000", 2024-09-13T06:43:26.645 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00019787900000000001 2024-09-13T06:43:26.645 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:26.645 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:26.645 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:26.645 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:26.645 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:26.645 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:181750 3.1d 3.9f70ba7d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e203)", 2024-09-13T06:43:26.645 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:42:45.707687+0000", 2024-09-13T06:43:26.645 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 40.837669011999999, 2024-09-13T06:43:26.645 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.69667232199999996, 2024-09-13T06:43:26.646 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:26.646 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:43:26.646 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:26.646 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:26.646 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:26.646 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 181750 2024-09-13T06:43:26.646 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:26.646 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:26.646 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:26.646 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:26.646 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707687+0000", 2024-09-13T06:43:26.646 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:26.646 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:26.646 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:26.647 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:26.647 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707687+0000", 2024-09-13T06:43:26.647 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:26.647 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:26.647 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:26.647 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:26.647 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707686+0000", 2024-09-13T06:43:26.647 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:26.647 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:26.647 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:26.647 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:26.647 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707689+0000", 2024-09-13T06:43:26.647 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.824e-06 2024-09-13T06:43:26.648 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:26.648 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:26.648 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:26.648 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707693+0000", 2024-09-13T06:43:26.648 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.5900000000000001e-06 2024-09-13T06:43:26.648 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:26.648 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:26.648 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:26.648 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707697+0000", 2024-09-13T06:43:26.648 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.6899999999999998e-06 2024-09-13T06:43:26.648 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:26.649 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:26.649 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:26.649 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.708109+0000", 2024-09-13T06:43:26.649 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00041220200000000002 2024-09-13T06:43:26.649 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:26.649 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:26.649 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:43:26.649 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.708118+0000", 2024-09-13T06:43:26.649 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6000000000000007e-06 2024-09-13T06:43:26.649 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:26.649 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:26.649 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:26.649 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.404353+0000", 2024-09-13T06:43:26.650 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.69623486400000001 2024-09-13T06:43:26.650 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:26.650 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:26.650 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:26.650 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.404359+0000", 2024-09-13T06:43:26.650 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.2480000000000001e-06 2024-09-13T06:43:26.650 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:26.650 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:26.650 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:26.650 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:26.650 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:26.650 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:43:26.652 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-13T06:43:26.652 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:43:26.653+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:43:26.753 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:43:26.753+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:43:26.806 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T06:43:26.806 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:43:26.807 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 241, 2024-09-13T06:43:26.807 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "e5612297-d004-4957-927e-afa37f30d6cf", 2024-09-13T06:43:26.807 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-09-13T06:38:56.670231+0000", 2024-09-13T06:43:26.807 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-09-13T06:43:26.401455+0000", 2024-09-13T06:43:26.807 INFO:teuthology.orchestra.run.smithi081.stdout: "last_up_change": "2024-09-13T06:42:51.723548+0000", 2024-09-13T06:43:26.807 INFO:teuthology.orchestra.run.smithi081.stdout: "last_in_change": "2024-09-13T06:42:16.419321+0000", 2024-09-13T06:43:26.807 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": "noscrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-13T06:43:26.807 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_num": 5801984, 2024-09-13T06:43:26.807 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_set": [ 2024-09-13T06:43:26.807 INFO:teuthology.orchestra.run.smithi081.stdout: "noscrub", 2024-09-13T06:43:26.807 INFO:teuthology.orchestra.run.smithi081.stdout: "pglog_hardlimit", 2024-09-13T06:43:26.807 INFO:teuthology.orchestra.run.smithi081.stdout: "purged_snapdirs", 2024-09-13T06:43:26.807 INFO:teuthology.orchestra.run.smithi081.stdout: "recovery_deletes", 2024-09-13T06:43:26.808 INFO:teuthology.orchestra.run.smithi081.stdout: "sortbitwise" 2024-09-13T06:43:26.808 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-13T06:43:26.808 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_version": 5, 2024-09-13T06:43:26.808 INFO:teuthology.orchestra.run.smithi081.stdout: "full_ratio": 0.94999998807907104, 2024-09-13T06:43:26.808 INFO:teuthology.orchestra.run.smithi081.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-09-13T06:43:26.808 INFO:teuthology.orchestra.run.smithi081.stdout: "nearfull_ratio": 0.85000002384185791, 2024-09-13T06:43:26.808 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_snapshot": "", 2024-09-13T06:43:26.808 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_max": 3, 2024-09-13T06:43:26.808 INFO:teuthology.orchestra.run.smithi081.stdout: "max_osd": 8, 2024-09-13T06:43:26.808 INFO:teuthology.orchestra.run.smithi081.stdout: "require_min_compat_client": "luminous", 2024-09-13T06:43:26.808 INFO:teuthology.orchestra.run.smithi081.stdout: "min_compat_client": "luminous", 2024-09-13T06:43:26.808 INFO:teuthology.orchestra.run.smithi081.stdout: "require_osd_release": "reef", 2024-09-13T06:43:26.809 INFO:teuthology.orchestra.run.smithi081.stdout: "allow_crimson": false, 2024-09-13T06:43:26.809 INFO:teuthology.orchestra.run.smithi081.stdout: "pools": [ 2024-09-13T06:43:26.809 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:26.809 INFO:teuthology.orchestra.run.smithi081.stdout: "pool": 1, 2024-09-13T06:43:26.809 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_name": ".mgr", 2024-09-13T06:43:26.809 INFO:teuthology.orchestra.run.smithi081.stdout: "create_time": "2024-09-13T06:39:09.600726+0000", 2024-09-13T06:43:26.809 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-13T06:43:26.809 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_names": "hashpspool", 2024-09-13T06:43:26.809 INFO:teuthology.orchestra.run.smithi081.stdout: "type": 1, 2024-09-13T06:43:26.809 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 2, 2024-09-13T06:43:26.809 INFO:teuthology.orchestra.run.smithi081.stdout: "min_size": 1, 2024-09-13T06:43:26.809 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_rule": 0, 2024-09-13T06:43:26.809 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_count": 0, 2024-09-13T06:43:26.810 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_target": 0, 2024-09-13T06:43:26.810 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_barrier": 0, 2024-09-13T06:43:26.810 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-13T06:43:26.810 INFO:teuthology.orchestra.run.smithi081.stdout: "object_hash": 2, 2024-09-13T06:43:26.810 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_mode": "off", 2024-09-13T06:43:26.810 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num": 1, 2024-09-13T06:43:26.810 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num": 1, 2024-09-13T06:43:26.810 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num_target": 1, 2024-09-13T06:43:26.810 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_target": 1, 2024-09-13T06:43:26.810 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_pending": 1, 2024-09-13T06:43:26.810 INFO:teuthology.orchestra.run.smithi081.stdout: "last_pg_merge_meta": { 2024-09-13T06:43:26.810 INFO:teuthology.orchestra.run.smithi081.stdout: "source_pgid": "0.0", 2024-09-13T06:43:26.810 INFO:teuthology.orchestra.run.smithi081.stdout: "ready_epoch": 0, 2024-09-13T06:43:26.811 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_started": 0, 2024-09-13T06:43:26.811 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_clean": 0, 2024-09-13T06:43:26.811 INFO:teuthology.orchestra.run.smithi081.stdout: "source_version": "0'0", 2024-09-13T06:43:26.811 INFO:teuthology.orchestra.run.smithi081.stdout: "target_version": "0'0" 2024-09-13T06:43:26.811 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:26.811 INFO:teuthology.orchestra.run.smithi081.stdout: "last_change": "16", 2024-09-13T06:43:26.811 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend": "0", 2024-09-13T06:43:26.811 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-13T06:43:26.811 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_preluminous": "0", 2024-09-13T06:43:26.811 INFO:teuthology.orchestra.run.smithi081.stdout: "auid": 0, 2024-09-13T06:43:26.811 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_mode": "selfmanaged", 2024-09-13T06:43:26.811 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_seq": 0, 2024-09-13T06:43:26.811 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_epoch": 0, 2024-09-13T06:43:26.812 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_snaps": [], 2024-09-13T06:43:26.812 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps": "[]", 2024-09-13T06:43:26.812 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_bytes": 0, 2024-09-13T06:43:26.812 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_objects": 0, 2024-09-13T06:43:26.812 INFO:teuthology.orchestra.run.smithi081.stdout: "tiers": [], 2024-09-13T06:43:26.812 INFO:teuthology.orchestra.run.smithi081.stdout: "tier_of": -1, 2024-09-13T06:43:26.812 INFO:teuthology.orchestra.run.smithi081.stdout: "read_tier": -1, 2024-09-13T06:43:26.812 INFO:teuthology.orchestra.run.smithi081.stdout: "write_tier": -1, 2024-09-13T06:43:26.812 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_mode": "none", 2024-09-13T06:43:26.812 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_bytes": 0, 2024-09-13T06:43:26.812 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_objects": 0, 2024-09-13T06:43:26.812 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-13T06:43:26.812 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-13T06:43:26.813 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-13T06:43:26.813 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_flush_age": 0, 2024-09-13T06:43:26.813 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_evict_age": 0, 2024-09-13T06:43:26.813 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profile": "", 2024-09-13T06:43:26.813 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_params": { 2024-09-13T06:43:26.813 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "none" 2024-09-13T06:43:26.813 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:26.813 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_period": 0, 2024-09-13T06:43:26.813 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_count": 0, 2024-09-13T06:43:26.813 INFO:teuthology.orchestra.run.smithi081.stdout: "use_gmt_hitset": true, 2024-09-13T06:43:26.813 INFO:teuthology.orchestra.run.smithi081.stdout: "min_read_recency_for_promote": 0, 2024-09-13T06:43:26.813 INFO:teuthology.orchestra.run.smithi081.stdout: "min_write_recency_for_promote": 0, 2024-09-13T06:43:26.813 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_grade_decay_rate": 0, 2024-09-13T06:43:26.814 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_search_last_n": 0, 2024-09-13T06:43:26.814 INFO:teuthology.orchestra.run.smithi081.stdout: "grade_table": [], 2024-09-13T06:43:26.814 INFO:teuthology.orchestra.run.smithi081.stdout: "stripe_width": 0, 2024-09-13T06:43:26.814 INFO:teuthology.orchestra.run.smithi081.stdout: "expected_num_objects": 0, 2024-09-13T06:43:26.814 INFO:teuthology.orchestra.run.smithi081.stdout: "fast_read": false, 2024-09-13T06:43:26.814 INFO:teuthology.orchestra.run.smithi081.stdout: "options": { 2024-09-13T06:43:26.814 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_max": 32, 2024-09-13T06:43:26.814 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_min": 1 2024-09-13T06:43:26.814 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:26.814 INFO:teuthology.orchestra.run.smithi081.stdout: "application_metadata": { 2024-09-13T06:43:26.814 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": {} 2024-09-13T06:43:26.814 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:26.814 INFO:teuthology.orchestra.run.smithi081.stdout: "read_balance": { 2024-09-13T06:43:26.814 INFO:teuthology.orchestra.run.smithi081.stdout: "score_acting": 6.059999942779541, 2024-09-13T06:43:26.815 INFO:teuthology.orchestra.run.smithi081.stdout: "score_stable": 6.059999942779541, 2024-09-13T06:43:26.815 INFO:teuthology.orchestra.run.smithi081.stdout: "optimal_score": 0.33000001311302185, 2024-09-13T06:43:26.815 INFO:teuthology.orchestra.run.smithi081.stdout: "raw_score_acting": 2, 2024-09-13T06:43:26.815 INFO:teuthology.orchestra.run.smithi081.stdout: "raw_score_stable": 2, 2024-09-13T06:43:26.815 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity_weighted": 0.64948463439941406, 2024-09-13T06:43:26.815 INFO:teuthology.orchestra.run.smithi081.stdout: "average_primary_affinity": 0.87000000476837158, 2024-09-13T06:43:26.815 INFO:teuthology.orchestra.run.smithi081.stdout: "average_primary_affinity_weighted": 0.64999997615814209 2024-09-13T06:43:26.815 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:26.815 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:26.815 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:26.815 INFO:teuthology.orchestra.run.smithi081.stdout: "pool": 2, 2024-09-13T06:43:26.815 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_name": "rbd", 2024-09-13T06:43:26.815 INFO:teuthology.orchestra.run.smithi081.stdout: "create_time": "2024-09-13T06:39:15.802118+0000", 2024-09-13T06:43:26.816 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 8193, 2024-09-13T06:43:26.816 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-13T06:43:26.816 INFO:teuthology.orchestra.run.smithi081.stdout: "type": 1, 2024-09-13T06:43:26.816 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 2, 2024-09-13T06:43:26.816 INFO:teuthology.orchestra.run.smithi081.stdout: "min_size": 1, 2024-09-13T06:43:26.816 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_rule": 0, 2024-09-13T06:43:26.816 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_count": 0, 2024-09-13T06:43:26.816 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_target": 0, 2024-09-13T06:43:26.816 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_barrier": 0, 2024-09-13T06:43:26.816 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-13T06:43:26.816 INFO:teuthology.orchestra.run.smithi081.stdout: "object_hash": 2, 2024-09-13T06:43:26.816 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_mode": "off", 2024-09-13T06:43:26.816 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num": 8, 2024-09-13T06:43:26.817 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num": 8, 2024-09-13T06:43:26.817 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num_target": 8, 2024-09-13T06:43:26.817 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_target": 8, 2024-09-13T06:43:26.817 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_pending": 8, 2024-09-13T06:43:26.817 INFO:teuthology.orchestra.run.smithi081.stdout: "last_pg_merge_meta": { 2024-09-13T06:43:26.817 INFO:teuthology.orchestra.run.smithi081.stdout: "source_pgid": "0.0", 2024-09-13T06:43:26.817 INFO:teuthology.orchestra.run.smithi081.stdout: "ready_epoch": 0, 2024-09-13T06:43:26.817 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_started": 0, 2024-09-13T06:43:26.817 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_clean": 0, 2024-09-13T06:43:26.817 INFO:teuthology.orchestra.run.smithi081.stdout: "source_version": "0'0", 2024-09-13T06:43:26.817 INFO:teuthology.orchestra.run.smithi081.stdout: "target_version": "0'0" 2024-09-13T06:43:26.817 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:26.817 INFO:teuthology.orchestra.run.smithi081.stdout: "last_change": "20", 2024-09-13T06:43:26.817 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend": "0", 2024-09-13T06:43:26.818 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-13T06:43:26.818 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_preluminous": "0", 2024-09-13T06:43:26.818 INFO:teuthology.orchestra.run.smithi081.stdout: "auid": 0, 2024-09-13T06:43:26.818 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_mode": "selfmanaged", 2024-09-13T06:43:26.818 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_seq": 3, 2024-09-13T06:43:26.818 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_epoch": 20, 2024-09-13T06:43:26.818 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_snaps": [], 2024-09-13T06:43:26.818 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps": "[]", 2024-09-13T06:43:26.818 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_bytes": 0, 2024-09-13T06:43:26.818 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_objects": 0, 2024-09-13T06:43:26.818 INFO:teuthology.orchestra.run.smithi081.stdout: "tiers": [], 2024-09-13T06:43:26.818 INFO:teuthology.orchestra.run.smithi081.stdout: "tier_of": -1, 2024-09-13T06:43:26.819 INFO:teuthology.orchestra.run.smithi081.stdout: "read_tier": -1, 2024-09-13T06:43:26.819 INFO:teuthology.orchestra.run.smithi081.stdout: "write_tier": -1, 2024-09-13T06:43:26.819 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_mode": "none", 2024-09-13T06:43:26.819 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_bytes": 0, 2024-09-13T06:43:26.819 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_objects": 0, 2024-09-13T06:43:26.819 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-13T06:43:26.819 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-13T06:43:26.819 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-13T06:43:26.819 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_flush_age": 0, 2024-09-13T06:43:26.819 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_evict_age": 0, 2024-09-13T06:43:26.819 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profile": "", 2024-09-13T06:43:26.819 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_params": { 2024-09-13T06:43:26.819 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "none" 2024-09-13T06:43:26.819 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:26.820 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_period": 0, 2024-09-13T06:43:26.820 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_count": 0, 2024-09-13T06:43:26.820 INFO:teuthology.orchestra.run.smithi081.stdout: "use_gmt_hitset": true, 2024-09-13T06:43:26.820 INFO:teuthology.orchestra.run.smithi081.stdout: "min_read_recency_for_promote": 0, 2024-09-13T06:43:26.820 INFO:teuthology.orchestra.run.smithi081.stdout: "min_write_recency_for_promote": 0, 2024-09-13T06:43:26.820 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_grade_decay_rate": 0, 2024-09-13T06:43:26.820 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_search_last_n": 0, 2024-09-13T06:43:26.820 INFO:teuthology.orchestra.run.smithi081.stdout: "grade_table": [], 2024-09-13T06:43:26.820 INFO:teuthology.orchestra.run.smithi081.stdout: "stripe_width": 0, 2024-09-13T06:43:26.820 INFO:teuthology.orchestra.run.smithi081.stdout: "expected_num_objects": 0, 2024-09-13T06:43:26.820 INFO:teuthology.orchestra.run.smithi081.stdout: "fast_read": false, 2024-09-13T06:43:26.820 INFO:teuthology.orchestra.run.smithi081.stdout: "options": {}, 2024-09-13T06:43:26.821 INFO:teuthology.orchestra.run.smithi081.stdout: "application_metadata": { 2024-09-13T06:43:26.821 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd": {} 2024-09-13T06:43:26.821 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:26.821 INFO:teuthology.orchestra.run.smithi081.stdout: "read_balance": { 2024-09-13T06:43:26.821 INFO:teuthology.orchestra.run.smithi081.stdout: "score_acting": 2.25, 2024-09-13T06:43:26.821 INFO:teuthology.orchestra.run.smithi081.stdout: "score_stable": 2.25, 2024-09-13T06:43:26.821 INFO:teuthology.orchestra.run.smithi081.stdout: "optimal_score": 1.1699999570846558, 2024-09-13T06:43:26.821 INFO:teuthology.orchestra.run.smithi081.stdout: "raw_score_acting": 2.630000114440918, 2024-09-13T06:43:26.821 INFO:teuthology.orchestra.run.smithi081.stdout: "raw_score_stable": 2.630000114440918, 2024-09-13T06:43:26.821 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity_weighted": 0.64948463439941406, 2024-09-13T06:43:26.821 INFO:teuthology.orchestra.run.smithi081.stdout: "average_primary_affinity": 0.87000000476837158, 2024-09-13T06:43:26.821 INFO:teuthology.orchestra.run.smithi081.stdout: "average_primary_affinity_weighted": 0.64999997615814209 2024-09-13T06:43:26.821 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:26.821 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:26.822 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:26.822 INFO:teuthology.orchestra.run.smithi081.stdout: "pool": 3, 2024-09-13T06:43:26.822 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_name": "pool_client.0", 2024-09-13T06:43:26.822 INFO:teuthology.orchestra.run.smithi081.stdout: "create_time": "2024-09-13T06:39:25.648942+0000", 2024-09-13T06:43:26.822 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 8193, 2024-09-13T06:43:26.822 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-13T06:43:26.822 INFO:teuthology.orchestra.run.smithi081.stdout: "type": 1, 2024-09-13T06:43:26.822 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 2, 2024-09-13T06:43:26.822 INFO:teuthology.orchestra.run.smithi081.stdout: "min_size": 1, 2024-09-13T06:43:26.822 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_rule": 0, 2024-09-13T06:43:26.822 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_count": 0, 2024-09-13T06:43:26.822 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_target": 0, 2024-09-13T06:43:26.822 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_barrier": 0, 2024-09-13T06:43:26.823 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-13T06:43:26.823 INFO:teuthology.orchestra.run.smithi081.stdout: "object_hash": 2, 2024-09-13T06:43:26.823 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_mode": "off", 2024-09-13T06:43:26.823 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num": 32, 2024-09-13T06:43:26.823 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num": 32, 2024-09-13T06:43:26.823 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num_target": 32, 2024-09-13T06:43:26.823 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_target": 32, 2024-09-13T06:43:26.823 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_pending": 32, 2024-09-13T06:43:26.823 INFO:teuthology.orchestra.run.smithi081.stdout: "last_pg_merge_meta": { 2024-09-13T06:43:26.823 INFO:teuthology.orchestra.run.smithi081.stdout: "source_pgid": "0.0", 2024-09-13T06:43:26.823 INFO:teuthology.orchestra.run.smithi081.stdout: "ready_epoch": 0, 2024-09-13T06:43:26.823 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_started": 0, 2024-09-13T06:43:26.823 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_clean": 0, 2024-09-13T06:43:26.824 INFO:teuthology.orchestra.run.smithi081.stdout: "source_version": "0'0", 2024-09-13T06:43:26.824 INFO:teuthology.orchestra.run.smithi081.stdout: "target_version": "0'0" 2024-09-13T06:43:26.824 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:26.824 INFO:teuthology.orchestra.run.smithi081.stdout: "last_change": "241", 2024-09-13T06:43:26.824 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend": "0", 2024-09-13T06:43:26.824 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-13T06:43:26.824 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_preluminous": "0", 2024-09-13T06:43:26.824 INFO:teuthology.orchestra.run.smithi081.stdout: "auid": 0, 2024-09-13T06:43:26.824 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_mode": "selfmanaged", 2024-09-13T06:43:26.824 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_seq": 147, 2024-09-13T06:43:26.824 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_epoch": 241, 2024-09-13T06:43:26.824 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_snaps": [], 2024-09-13T06:43:26.825 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps": "[]", 2024-09-13T06:43:26.825 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_bytes": 0, 2024-09-13T06:43:26.825 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_objects": 0, 2024-09-13T06:43:26.825 INFO:teuthology.orchestra.run.smithi081.stdout: "tiers": [], 2024-09-13T06:43:26.825 INFO:teuthology.orchestra.run.smithi081.stdout: "tier_of": -1, 2024-09-13T06:43:26.825 INFO:teuthology.orchestra.run.smithi081.stdout: "read_tier": -1, 2024-09-13T06:43:26.825 INFO:teuthology.orchestra.run.smithi081.stdout: "write_tier": -1, 2024-09-13T06:43:26.825 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_mode": "none", 2024-09-13T06:43:26.825 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_bytes": 0, 2024-09-13T06:43:26.825 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_objects": 0, 2024-09-13T06:43:26.825 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-13T06:43:26.825 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-13T06:43:26.825 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-13T06:43:26.826 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_flush_age": 0, 2024-09-13T06:43:26.826 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_evict_age": 0, 2024-09-13T06:43:26.826 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profile": "", 2024-09-13T06:43:26.826 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_params": { 2024-09-13T06:43:26.826 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "none" 2024-09-13T06:43:26.826 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:26.826 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_period": 0, 2024-09-13T06:43:26.826 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_count": 0, 2024-09-13T06:43:26.826 INFO:teuthology.orchestra.run.smithi081.stdout: "use_gmt_hitset": true, 2024-09-13T06:43:26.826 INFO:teuthology.orchestra.run.smithi081.stdout: "min_read_recency_for_promote": 0, 2024-09-13T06:43:26.826 INFO:teuthology.orchestra.run.smithi081.stdout: "min_write_recency_for_promote": 0, 2024-09-13T06:43:26.826 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_grade_decay_rate": 0, 2024-09-13T06:43:26.826 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_search_last_n": 0, 2024-09-13T06:43:26.826 INFO:teuthology.orchestra.run.smithi081.stdout: "grade_table": [], 2024-09-13T06:43:26.827 INFO:teuthology.orchestra.run.smithi081.stdout: "stripe_width": 0, 2024-09-13T06:43:26.827 INFO:teuthology.orchestra.run.smithi081.stdout: "expected_num_objects": 0, 2024-09-13T06:43:26.827 INFO:teuthology.orchestra.run.smithi081.stdout: "fast_read": false, 2024-09-13T06:43:26.827 INFO:teuthology.orchestra.run.smithi081.stdout: "options": {}, 2024-09-13T06:43:26.827 INFO:teuthology.orchestra.run.smithi081.stdout: "application_metadata": { 2024-09-13T06:43:26.827 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd": {} 2024-09-13T06:43:26.827 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:26.827 INFO:teuthology.orchestra.run.smithi081.stdout: "read_balance": { 2024-09-13T06:43:26.827 INFO:teuthology.orchestra.run.smithi081.stdout: "error_message": "pool 3 has some PGs where all OSDs are with primary_affinity 0 (at least pg 3.10), read balance score may not be reliable", 2024-09-13T06:43:26.827 INFO:teuthology.orchestra.run.smithi081.stdout: "score_acting": 0, 2024-09-13T06:43:26.827 INFO:teuthology.orchestra.run.smithi081.stdout: "score_stable": 0 2024-09-13T06:43:26.827 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:26.827 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:26.827 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-13T06:43:26.827 INFO:teuthology.orchestra.run.smithi081.stdout: "osds": [ 2024-09-13T06:43:26.828 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:26.828 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 0, 2024-09-13T06:43:26.828 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "54b0a3e4-58ad-4f95-86dc-29a11c9a1964", 2024-09-13T06:43:26.828 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2024-09-13T06:43:26.828 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2024-09-13T06:43:26.828 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2024-09-13T06:43:26.828 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 0, 2024-09-13T06:43:26.828 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2024-09-13T06:43:26.828 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2024-09-13T06:43:26.828 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2024-09-13T06:43:26.828 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 236, 2024-09-13T06:43:26.828 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2024-09-13T06:43:26.829 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2024-09-13T06:43:26.829 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-13T06:43:26.829 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:43:26.829 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:26.829 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:43:26.829 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6808", 2024-09-13T06:43:26.829 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 1904727940 2024-09-13T06:43:26.829 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:26.829 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:26.829 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:43:26.829 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6809", 2024-09-13T06:43:26.829 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 1904727940 2024-09-13T06:43:26.829 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:26.830 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:26.830 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:26.830 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2024-09-13T06:43:26.830 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:43:26.830 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:26.830 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:43:26.830 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6810", 2024-09-13T06:43:26.830 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 1904727940 2024-09-13T06:43:26.830 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:26.830 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:26.830 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:43:26.830 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6811", 2024-09-13T06:43:26.830 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 1904727940 2024-09-13T06:43:26.831 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:26.831 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:26.831 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:26.831 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2024-09-13T06:43:26.831 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:43:26.831 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:26.831 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:43:26.831 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6814", 2024-09-13T06:43:26.831 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 1904727940 2024-09-13T06:43:26.831 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:26.831 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:26.832 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:43:26.832 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6815", 2024-09-13T06:43:26.832 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 1904727940 2024-09-13T06:43:26.832 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:26.832 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:26.832 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:26.832 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2024-09-13T06:43:26.832 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:43:26.832 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:26.832 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:43:26.832 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6812", 2024-09-13T06:43:26.832 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 1904727940 2024-09-13T06:43:26.833 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:26.833 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:26.833 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:43:26.833 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6813", 2024-09-13T06:43:26.833 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 1904727940 2024-09-13T06:43:26.833 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:26.833 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:26.833 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:26.833 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6809/1904727940", 2024-09-13T06:43:26.833 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.81:6811/1904727940", 2024-09-13T06:43:26.833 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.81:6815/1904727940", 2024-09-13T06:43:26.833 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.81:6813/1904727940", 2024-09-13T06:43:26.833 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2024-09-13T06:43:26.834 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2024-09-13T06:43:26.834 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2024-09-13T06:43:26.834 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:26.834 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:26.834 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:26.834 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 1, 2024-09-13T06:43:26.834 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "a6dba5b9-c833-465e-a8a5-1741528b24c0", 2024-09-13T06:43:26.834 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2024-09-13T06:43:26.834 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2024-09-13T06:43:26.834 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2024-09-13T06:43:26.834 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2024-09-13T06:43:26.835 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2024-09-13T06:43:26.835 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2024-09-13T06:43:26.835 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2024-09-13T06:43:26.835 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 221, 2024-09-13T06:43:26.835 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2024-09-13T06:43:26.835 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2024-09-13T06:43:26.835 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-13T06:43:26.835 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:43:26.835 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:26.835 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:43:26.835 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6817", 2024-09-13T06:43:26.835 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 738205570 2024-09-13T06:43:26.835 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:26.836 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:26.836 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:43:26.836 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6819", 2024-09-13T06:43:26.836 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 738205570 2024-09-13T06:43:26.836 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:26.836 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:26.836 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:26.836 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2024-09-13T06:43:26.836 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:43:26.836 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:26.836 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:43:26.836 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6822", 2024-09-13T06:43:26.837 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 738205570 2024-09-13T06:43:26.837 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:26.837 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:26.837 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:43:26.837 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6824", 2024-09-13T06:43:26.837 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 738205570 2024-09-13T06:43:26.837 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:26.837 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:26.837 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:26.837 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2024-09-13T06:43:26.837 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:43:26.837 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:26.837 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:43:26.838 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6830", 2024-09-13T06:43:26.838 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 738205570 2024-09-13T06:43:26.838 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:26.838 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:26.838 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:43:26.838 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6831", 2024-09-13T06:43:26.838 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 738205570 2024-09-13T06:43:26.838 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:26.838 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:26.838 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:26.838 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2024-09-13T06:43:26.838 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:43:26.838 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:26.839 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:43:26.839 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6826", 2024-09-13T06:43:26.839 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 738205570 2024-09-13T06:43:26.839 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:26.839 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:26.839 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:43:26.839 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6829", 2024-09-13T06:43:26.839 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 738205570 2024-09-13T06:43:26.839 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:26.839 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:26.839 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:26.839 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6819/738205570", 2024-09-13T06:43:26.839 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.81:6824/738205570", 2024-09-13T06:43:26.840 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.81:6831/738205570", 2024-09-13T06:43:26.840 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.81:6829/738205570", 2024-09-13T06:43:26.840 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2024-09-13T06:43:26.840 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2024-09-13T06:43:26.840 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2024-09-13T06:43:26.840 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:26.840 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:26.840 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:26.840 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 2, 2024-09-13T06:43:26.840 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "6c45097e-44a2-454f-80a4-0fe879ccd52f", 2024-09-13T06:43:26.840 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2024-09-13T06:43:26.840 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2024-09-13T06:43:26.840 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2024-09-13T06:43:26.840 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2024-09-13T06:43:26.841 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2024-09-13T06:43:26.841 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2024-09-13T06:43:26.841 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2024-09-13T06:43:26.841 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 222, 2024-09-13T06:43:26.841 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2024-09-13T06:43:26.841 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2024-09-13T06:43:26.841 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-13T06:43:26.841 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:43:26.841 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:26.841 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:43:26.841 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6816", 2024-09-13T06:43:26.841 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 3558674335 2024-09-13T06:43:26.842 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:26.842 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:26.842 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:43:26.842 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6818", 2024-09-13T06:43:26.842 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 3558674335 2024-09-13T06:43:26.842 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:26.842 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:26.842 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:26.842 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2024-09-13T06:43:26.842 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:43:26.842 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:26.842 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:43:26.842 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6820", 2024-09-13T06:43:26.842 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 3558674335 2024-09-13T06:43:26.843 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:26.843 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:26.843 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:43:26.843 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6821", 2024-09-13T06:43:26.843 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 3558674335 2024-09-13T06:43:26.843 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:26.843 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:26.843 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:26.843 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2024-09-13T06:43:26.843 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:43:26.843 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:26.843 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:43:26.843 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6827", 2024-09-13T06:43:26.843 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 3558674335 2024-09-13T06:43:26.844 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:26.844 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:26.844 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:43:26.844 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6828", 2024-09-13T06:43:26.844 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 3558674335 2024-09-13T06:43:26.844 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:26.844 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:26.844 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:26.844 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2024-09-13T06:43:26.844 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:43:26.844 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:26.844 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:43:26.844 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6823", 2024-09-13T06:43:26.845 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 3558674335 2024-09-13T06:43:26.845 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:26.845 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:26.845 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:43:26.845 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6825", 2024-09-13T06:43:26.845 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 3558674335 2024-09-13T06:43:26.845 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:26.845 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:26.845 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:26.845 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6818/3558674335", 2024-09-13T06:43:26.845 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.81:6821/3558674335", 2024-09-13T06:43:26.845 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.81:6828/3558674335", 2024-09-13T06:43:26.846 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.81:6825/3558674335", 2024-09-13T06:43:26.846 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2024-09-13T06:43:26.846 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2024-09-13T06:43:26.846 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2024-09-13T06:43:26.846 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:26.846 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:26.846 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:26.846 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 3, 2024-09-13T06:43:26.846 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "31952760-06f3-4618-a5c4-f5c4fed3aadb", 2024-09-13T06:43:26.846 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2024-09-13T06:43:26.846 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2024-09-13T06:43:26.846 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2024-09-13T06:43:26.846 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2024-09-13T06:43:26.847 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2024-09-13T06:43:26.847 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2024-09-13T06:43:26.847 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2024-09-13T06:43:26.847 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 191, 2024-09-13T06:43:26.847 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2024-09-13T06:43:26.847 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2024-09-13T06:43:26.847 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-13T06:43:26.847 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:43:26.847 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:26.847 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:43:26.847 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6800", 2024-09-13T06:43:26.847 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 1886327229 2024-09-13T06:43:26.847 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:26.848 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:26.848 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:43:26.848 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6801", 2024-09-13T06:43:26.848 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 1886327229 2024-09-13T06:43:26.848 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:26.848 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:26.848 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:26.848 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2024-09-13T06:43:26.848 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:43:26.848 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:26.848 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:43:26.848 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6802", 2024-09-13T06:43:26.849 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 1886327229 2024-09-13T06:43:26.849 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:26.849 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:26.849 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:43:26.849 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6803", 2024-09-13T06:43:26.849 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 1886327229 2024-09-13T06:43:26.849 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:26.849 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:26.849 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:26.849 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2024-09-13T06:43:26.849 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:43:26.849 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:26.849 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:43:26.850 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6806", 2024-09-13T06:43:26.850 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 1886327229 2024-09-13T06:43:26.850 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:26.850 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:26.850 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:43:26.850 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6807", 2024-09-13T06:43:26.850 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 1886327229 2024-09-13T06:43:26.850 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:26.850 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:26.850 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:26.850 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2024-09-13T06:43:26.850 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:43:26.850 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:26.850 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:43:26.851 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6804", 2024-09-13T06:43:26.851 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 1886327229 2024-09-13T06:43:26.851 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:26.851 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:26.851 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:43:26.851 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6805", 2024-09-13T06:43:26.851 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 1886327229 2024-09-13T06:43:26.851 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:26.851 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:26.851 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:26.851 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6801/1886327229", 2024-09-13T06:43:26.851 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.81:6803/1886327229", 2024-09-13T06:43:26.851 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.81:6807/1886327229", 2024-09-13T06:43:26.852 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.81:6805/1886327229", 2024-09-13T06:43:26.852 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2024-09-13T06:43:26.852 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2024-09-13T06:43:26.852 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2024-09-13T06:43:26.852 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:26.852 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:26.852 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:26.852 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 4, 2024-09-13T06:43:26.852 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "c9bd2751-c836-43dc-b844-e13678cb2fd9", 2024-09-13T06:43:26.852 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2024-09-13T06:43:26.852 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2024-09-13T06:43:26.852 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0.58685302734375, 2024-09-13T06:43:26.852 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 0.649200439453125, 2024-09-13T06:43:26.853 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2024-09-13T06:43:26.853 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2024-09-13T06:43:26.853 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2024-09-13T06:43:26.853 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 221, 2024-09-13T06:43:26.853 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2024-09-13T06:43:26.853 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2024-09-13T06:43:26.853 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-13T06:43:26.853 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:43:26.853 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:26.853 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:43:26.853 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6817", 2024-09-13T06:43:26.853 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2184515621 2024-09-13T06:43:26.853 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:26.854 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:26.854 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:43:26.854 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6819", 2024-09-13T06:43:26.854 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2184515621 2024-09-13T06:43:26.854 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:26.854 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:26.854 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:26.854 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2024-09-13T06:43:26.854 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:43:26.854 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:26.854 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:43:26.854 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6820", 2024-09-13T06:43:26.855 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2184515621 2024-09-13T06:43:26.855 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:26.855 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:26.855 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:43:26.855 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6822", 2024-09-13T06:43:26.855 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2184515621 2024-09-13T06:43:26.855 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:26.855 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:26.855 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:26.855 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2024-09-13T06:43:26.855 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:43:26.855 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:26.856 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:43:26.856 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6827", 2024-09-13T06:43:26.856 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2184515621 2024-09-13T06:43:26.856 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:26.856 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:26.856 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:43:26.856 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6829", 2024-09-13T06:43:26.856 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2184515621 2024-09-13T06:43:26.856 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:26.856 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:26.856 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:26.856 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2024-09-13T06:43:26.856 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:43:26.857 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:26.857 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:43:26.857 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6824", 2024-09-13T06:43:26.857 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2184515621 2024-09-13T06:43:26.857 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:26.857 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:26.857 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:43:26.857 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6826", 2024-09-13T06:43:26.857 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2184515621 2024-09-13T06:43:26.857 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:26.857 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:26.857 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:26.857 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.139:6819/2184515621", 2024-09-13T06:43:26.858 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.139:6822/2184515621", 2024-09-13T06:43:26.858 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.139:6829/2184515621", 2024-09-13T06:43:26.858 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.139:6826/2184515621", 2024-09-13T06:43:26.858 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2024-09-13T06:43:26.858 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2024-09-13T06:43:26.858 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2024-09-13T06:43:26.858 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:26.858 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:26.858 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:26.858 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 5, 2024-09-13T06:43:26.858 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "2971b93a-6c9f-4b77-b526-4eac788fabf9", 2024-09-13T06:43:26.858 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2024-09-13T06:43:26.858 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2024-09-13T06:43:26.858 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2024-09-13T06:43:26.858 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 0, 2024-09-13T06:43:26.859 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2024-09-13T06:43:26.859 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2024-09-13T06:43:26.859 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2024-09-13T06:43:26.859 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 203, 2024-09-13T06:43:26.859 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2024-09-13T06:43:26.859 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2024-09-13T06:43:26.859 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-13T06:43:26.859 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:43:26.859 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:26.859 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:43:26.859 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6816", 2024-09-13T06:43:26.859 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 3982901834 2024-09-13T06:43:26.859 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:26.860 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:26.860 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:43:26.860 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6818", 2024-09-13T06:43:26.860 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 3982901834 2024-09-13T06:43:26.860 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:26.860 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:26.860 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:26.860 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2024-09-13T06:43:26.860 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:43:26.860 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:26.860 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:43:26.860 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6821", 2024-09-13T06:43:26.860 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 3982901834 2024-09-13T06:43:26.860 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:26.861 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:26.861 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:43:26.861 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6823", 2024-09-13T06:43:26.861 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 3982901834 2024-09-13T06:43:26.861 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:26.861 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:26.861 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:26.861 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2024-09-13T06:43:26.861 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:43:26.861 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:26.861 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:43:26.861 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6830", 2024-09-13T06:43:26.861 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 3982901834 2024-09-13T06:43:26.861 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:26.862 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:26.862 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:43:26.862 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6831", 2024-09-13T06:43:26.862 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 3982901834 2024-09-13T06:43:26.862 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:26.862 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:26.862 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:26.862 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2024-09-13T06:43:26.862 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:43:26.862 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:26.862 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:43:26.862 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6825", 2024-09-13T06:43:26.862 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 3982901834 2024-09-13T06:43:26.862 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:26.863 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:26.863 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:43:26.863 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6828", 2024-09-13T06:43:26.863 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 3982901834 2024-09-13T06:43:26.863 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:26.863 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:26.863 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:26.863 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.139:6818/3982901834", 2024-09-13T06:43:26.863 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.139:6823/3982901834", 2024-09-13T06:43:26.863 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.139:6831/3982901834", 2024-09-13T06:43:26.863 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.139:6828/3982901834", 2024-09-13T06:43:26.863 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2024-09-13T06:43:26.863 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2024-09-13T06:43:26.863 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2024-09-13T06:43:26.864 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:26.864 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:26.864 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:26.864 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 6, 2024-09-13T06:43:26.864 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "e1f786ce-579e-48cc-b212-83f881b94184", 2024-09-13T06:43:26.864 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 0, 2024-09-13T06:43:26.864 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 0, 2024-09-13T06:43:26.864 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-13T06:43:26.864 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 0.5466766357421875, 2024-09-13T06:43:26.864 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2024-09-13T06:43:26.864 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2024-09-13T06:43:26.864 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2024-09-13T06:43:26.865 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 170, 2024-09-13T06:43:26.865 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 209, 2024-09-13T06:43:26.865 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2024-09-13T06:43:26.865 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-13T06:43:26.865 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:43:26.865 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:26.865 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:43:26.865 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6800", 2024-09-13T06:43:26.865 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2283932666 2024-09-13T06:43:26.865 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:26.865 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:26.865 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:43:26.865 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6801", 2024-09-13T06:43:26.865 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2283932666 2024-09-13T06:43:26.866 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:26.866 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:26.866 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:26.866 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2024-09-13T06:43:26.866 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:43:26.866 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:26.866 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:43:26.866 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6802", 2024-09-13T06:43:26.866 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2283932666 2024-09-13T06:43:26.866 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:26.866 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:26.866 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:43:26.866 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6803", 2024-09-13T06:43:26.866 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2283932666 2024-09-13T06:43:26.867 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:26.867 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:26.867 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:26.867 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2024-09-13T06:43:26.867 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:43:26.867 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:26.867 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:43:26.867 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6806", 2024-09-13T06:43:26.867 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2283932666 2024-09-13T06:43:26.867 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:26.867 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:26.867 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:43:26.867 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6807", 2024-09-13T06:43:26.867 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2283932666 2024-09-13T06:43:26.868 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:26.868 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:26.868 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:26.868 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2024-09-13T06:43:26.868 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:43:26.868 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:26.868 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:43:26.868 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6804", 2024-09-13T06:43:26.868 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2283932666 2024-09-13T06:43:26.868 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:26.868 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:26.868 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:43:26.868 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6805", 2024-09-13T06:43:26.868 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2283932666 2024-09-13T06:43:26.869 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:26.869 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:26.869 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:26.869 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.139:6801/2283932666", 2024-09-13T06:43:26.869 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.139:6803/2283932666", 2024-09-13T06:43:26.869 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.139:6807/2283932666", 2024-09-13T06:43:26.869 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.139:6805/2283932666", 2024-09-13T06:43:26.869 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2024-09-13T06:43:26.869 INFO:teuthology.orchestra.run.smithi081.stdout: "exists" 2024-09-13T06:43:26.869 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:26.869 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:26.869 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:26.869 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 7, 2024-09-13T06:43:26.869 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "a287ddf6-84eb-4225-b267-25eee1657625", 2024-09-13T06:43:26.869 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2024-09-13T06:43:26.870 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2024-09-13T06:43:26.870 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2024-09-13T06:43:26.870 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2024-09-13T06:43:26.870 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 13, 2024-09-13T06:43:26.870 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 121, 2024-09-13T06:43:26.870 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 187, 2024-09-13T06:43:26.870 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 192, 2024-09-13T06:43:26.870 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 122, 2024-09-13T06:43:26.870 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2024-09-13T06:43:26.870 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-13T06:43:26.870 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:43:26.870 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:26.870 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:43:26.870 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6808", 2024-09-13T06:43:26.871 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 105054579 2024-09-13T06:43:26.871 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:26.871 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:26.871 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:43:26.871 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6809", 2024-09-13T06:43:26.871 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 105054579 2024-09-13T06:43:26.871 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:26.871 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:26.871 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:26.871 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2024-09-13T06:43:26.871 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:43:26.871 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:26.872 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:43:26.872 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6810", 2024-09-13T06:43:26.872 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 105054579 2024-09-13T06:43:26.872 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:26.872 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:26.872 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:43:26.872 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6811", 2024-09-13T06:43:26.872 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 105054579 2024-09-13T06:43:26.872 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:26.872 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:26.872 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:26.872 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2024-09-13T06:43:26.872 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:43:26.873 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:26.873 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:43:26.873 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6814", 2024-09-13T06:43:26.873 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 105054579 2024-09-13T06:43:26.873 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:26.873 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:26.873 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:43:26.873 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6815", 2024-09-13T06:43:26.873 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 105054579 2024-09-13T06:43:26.873 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:26.873 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:26.873 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:26.874 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2024-09-13T06:43:26.874 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:43:26.874 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:26.874 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:43:26.874 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6812", 2024-09-13T06:43:26.874 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 105054579 2024-09-13T06:43:26.874 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:26.874 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:26.874 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:43:26.874 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6813", 2024-09-13T06:43:26.874 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 105054579 2024-09-13T06:43:26.874 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:26.874 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:26.875 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:26.875 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.139:6809/105054579", 2024-09-13T06:43:26.875 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.139:6811/105054579", 2024-09-13T06:43:26.875 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.139:6815/105054579", 2024-09-13T06:43:26.875 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.139:6813/105054579", 2024-09-13T06:43:26.875 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2024-09-13T06:43:26.875 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2024-09-13T06:43:26.875 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2024-09-13T06:43:26.875 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:26.875 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:26.875 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-13T06:43:26.875 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_xinfo": [ 2024-09-13T06:43:26.875 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:26.875 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 0, 2024-09-13T06:43:26.876 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2024-09-13T06:43:26.876 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2024-09-13T06:43:26.876 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2024-09-13T06:43:26.876 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138322906710015, 2024-09-13T06:43:26.876 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2024-09-13T06:43:26.876 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2024-09-13T06:39:05.476871+0000", 2024-09-13T06:43:26.876 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2024-09-13T06:43:26.876 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:26.876 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:26.876 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 1, 2024-09-13T06:43:26.876 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2024-09-13T06:43:26.876 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2024-09-13T06:43:26.876 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2024-09-13T06:43:26.877 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138322906710015, 2024-09-13T06:43:26.877 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2024-09-13T06:43:26.877 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2024-09-13T06:39:05.455183+0000", 2024-09-13T06:43:26.877 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2024-09-13T06:43:26.877 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:26.877 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:26.877 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 2, 2024-09-13T06:43:26.877 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2024-09-13T06:43:26.877 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2024-09-13T06:43:26.877 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2024-09-13T06:43:26.877 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138322906710015, 2024-09-13T06:43:26.877 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2024-09-13T06:43:26.878 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2024-09-13T06:39:05.504853+0000", 2024-09-13T06:43:26.878 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2024-09-13T06:43:26.878 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:26.878 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:26.878 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 3, 2024-09-13T06:43:26.878 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2024-09-13T06:43:26.878 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2024-09-13T06:43:26.878 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2024-09-13T06:43:26.878 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138322906710015, 2024-09-13T06:43:26.878 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2024-09-13T06:43:26.878 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2024-09-13T06:39:05.372429+0000", 2024-09-13T06:43:26.878 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2024-09-13T06:43:26.878 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:26.879 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:26.879 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 4, 2024-09-13T06:43:26.879 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2024-09-13T06:43:26.879 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2024-09-13T06:43:26.879 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2024-09-13T06:43:26.879 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138322906710015, 2024-09-13T06:43:26.879 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2024-09-13T06:43:26.879 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2024-09-13T06:39:05.421023+0000", 2024-09-13T06:43:26.879 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2024-09-13T06:43:26.879 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:26.879 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:26.879 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 5, 2024-09-13T06:43:26.879 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2024-09-13T06:43:26.880 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2024-09-13T06:43:26.880 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2024-09-13T06:43:26.880 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138322906710015, 2024-09-13T06:43:26.880 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2024-09-13T06:43:26.880 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2024-09-13T06:39:05.477489+0000", 2024-09-13T06:43:26.880 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2024-09-13T06:43:26.880 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:26.880 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:26.880 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 6, 2024-09-13T06:43:26.880 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2024-09-13T06:43:26.880 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2024-09-13T06:43:26.880 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2024-09-13T06:43:26.880 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138322906710015, 2024-09-13T06:43:26.880 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 65536, 2024-09-13T06:43:26.881 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2024-09-13T06:39:05.314700+0000", 2024-09-13T06:43:26.881 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 209 2024-09-13T06:43:26.881 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:26.881 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:26.881 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 7, 2024-09-13T06:43:26.881 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2024-09-13T06:43:26.881 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2024-09-13T06:43:26.881 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2024-09-13T06:43:26.881 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138322906710015, 2024-09-13T06:43:26.881 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2024-09-13T06:43:26.881 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2024-09-13T06:39:05.462229+0000", 2024-09-13T06:43:26.881 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 122 2024-09-13T06:43:26.881 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:26.882 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-13T06:43:26.882 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_upmap": [ 2024-09-13T06:43:26.882 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:26.882 INFO:teuthology.orchestra.run.smithi081.stdout: "pgid": "3.1a", 2024-09-13T06:43:26.882 INFO:teuthology.orchestra.run.smithi081.stdout: "osds": [ 2024-09-13T06:43:26.882 INFO:teuthology.orchestra.run.smithi081.stdout: 2, 2024-09-13T06:43:26.882 INFO:teuthology.orchestra.run.smithi081.stdout: 6 2024-09-13T06:43:26.882 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:26.882 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:26.882 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-13T06:43:26.882 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_upmap_items": [ 2024-09-13T06:43:26.882 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:26.882 INFO:teuthology.orchestra.run.smithi081.stdout: "pgid": "3.14", 2024-09-13T06:43:26.882 INFO:teuthology.orchestra.run.smithi081.stdout: "mappings": [ 2024-09-13T06:43:26.883 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:26.883 INFO:teuthology.orchestra.run.smithi081.stdout: "from": 4, 2024-09-13T06:43:26.883 INFO:teuthology.orchestra.run.smithi081.stdout: "to": 2 2024-09-13T06:43:26.883 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:26.883 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:26.883 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:26.883 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:26.883 INFO:teuthology.orchestra.run.smithi081.stdout: "pgid": "3.1b", 2024-09-13T06:43:26.883 INFO:teuthology.orchestra.run.smithi081.stdout: "mappings": [ 2024-09-13T06:43:26.883 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:26.883 INFO:teuthology.orchestra.run.smithi081.stdout: "from": 4, 2024-09-13T06:43:26.883 INFO:teuthology.orchestra.run.smithi081.stdout: "to": 1 2024-09-13T06:43:26.883 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:26.884 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:26.884 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:26.884 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-13T06:43:26.884 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_upmap_primaries": [], 2024-09-13T06:43:26.884 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_temp": [], 2024-09-13T06:43:26.884 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_temp": [], 2024-09-13T06:43:26.884 INFO:teuthology.orchestra.run.smithi081.stdout: "blocklist": {}, 2024-09-13T06:43:26.884 INFO:teuthology.orchestra.run.smithi081.stdout: "range_blocklist": {}, 2024-09-13T06:43:26.884 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profiles": { 2024-09-13T06:43:26.884 INFO:teuthology.orchestra.run.smithi081.stdout: "default": { 2024-09-13T06:43:26.884 INFO:teuthology.orchestra.run.smithi081.stdout: "crush-failure-domain": "osd", 2024-09-13T06:43:26.884 INFO:teuthology.orchestra.run.smithi081.stdout: "k": "2", 2024-09-13T06:43:26.884 INFO:teuthology.orchestra.run.smithi081.stdout: "m": "1", 2024-09-13T06:43:26.884 INFO:teuthology.orchestra.run.smithi081.stdout: "plugin": "jerasure", 2024-09-13T06:43:26.885 INFO:teuthology.orchestra.run.smithi081.stdout: "technique": "reed_sol_van" 2024-09-13T06:43:26.885 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:26.885 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:26.885 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps_queue": [ 2024-09-13T06:43:26.885 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:26.885 INFO:teuthology.orchestra.run.smithi081.stdout: "pool": 3, 2024-09-13T06:43:26.885 INFO:teuthology.orchestra.run.smithi081.stdout: "snaps": [ 2024-09-13T06:43:26.885 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:26.885 INFO:teuthology.orchestra.run.smithi081.stdout: "begin": 88, 2024-09-13T06:43:26.885 INFO:teuthology.orchestra.run.smithi081.stdout: "length": 1 2024-09-13T06:43:26.885 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:26.885 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:26.885 INFO:teuthology.orchestra.run.smithi081.stdout: "begin": 91, 2024-09-13T06:43:26.885 INFO:teuthology.orchestra.run.smithi081.stdout: "length": 1 2024-09-13T06:43:26.886 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:26.886 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:26.886 INFO:teuthology.orchestra.run.smithi081.stdout: "begin": 94, 2024-09-13T06:43:26.886 INFO:teuthology.orchestra.run.smithi081.stdout: "length": 1 2024-09-13T06:43:26.886 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:26.886 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:26.886 INFO:teuthology.orchestra.run.smithi081.stdout: "begin": 97, 2024-09-13T06:43:26.886 INFO:teuthology.orchestra.run.smithi081.stdout: "length": 1 2024-09-13T06:43:26.886 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:26.886 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:26.886 INFO:teuthology.orchestra.run.smithi081.stdout: "begin": 100, 2024-09-13T06:43:26.886 INFO:teuthology.orchestra.run.smithi081.stdout: "length": 1 2024-09-13T06:43:26.886 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:26.886 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:26.887 INFO:teuthology.orchestra.run.smithi081.stdout: "begin": 103, 2024-09-13T06:43:26.887 INFO:teuthology.orchestra.run.smithi081.stdout: "length": 1 2024-09-13T06:43:26.887 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:26.887 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:26.887 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:26.887 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-13T06:43:26.887 INFO:teuthology.orchestra.run.smithi081.stdout: "new_removed_snaps": [ 2024-09-13T06:43:26.887 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:26.887 INFO:teuthology.orchestra.run.smithi081.stdout: "pool": 3, 2024-09-13T06:43:26.887 INFO:teuthology.orchestra.run.smithi081.stdout: "snaps": [ 2024-09-13T06:43:26.887 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:26.887 INFO:teuthology.orchestra.run.smithi081.stdout: "begin": 88, 2024-09-13T06:43:26.887 INFO:teuthology.orchestra.run.smithi081.stdout: "length": 1 2024-09-13T06:43:26.887 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:26.888 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:26.888 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:26.888 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-13T06:43:26.888 INFO:teuthology.orchestra.run.smithi081.stdout: "new_purged_snaps": [ 2024-09-13T06:43:26.888 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:26.888 INFO:teuthology.orchestra.run.smithi081.stdout: "pool": 3, 2024-09-13T06:43:26.888 INFO:teuthology.orchestra.run.smithi081.stdout: "snaps": [ 2024-09-13T06:43:26.888 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:26.888 INFO:teuthology.orchestra.run.smithi081.stdout: "begin": 106, 2024-09-13T06:43:26.888 INFO:teuthology.orchestra.run.smithi081.stdout: "length": 1 2024-09-13T06:43:26.888 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:26.888 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:26.888 INFO:teuthology.orchestra.run.smithi081.stdout: "begin": 109, 2024-09-13T06:43:26.889 INFO:teuthology.orchestra.run.smithi081.stdout: "length": 1 2024-09-13T06:43:26.889 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:26.889 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:26.889 INFO:teuthology.orchestra.run.smithi081.stdout: "begin": 112, 2024-09-13T06:43:26.889 INFO:teuthology.orchestra.run.smithi081.stdout: "length": 1 2024-09-13T06:43:26.889 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:26.889 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:26.889 INFO:teuthology.orchestra.run.smithi081.stdout: "begin": 115, 2024-09-13T06:43:26.889 INFO:teuthology.orchestra.run.smithi081.stdout: "length": 1 2024-09-13T06:43:26.889 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:26.889 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:26.889 INFO:teuthology.orchestra.run.smithi081.stdout: "begin": 118, 2024-09-13T06:43:26.889 INFO:teuthology.orchestra.run.smithi081.stdout: "length": 1 2024-09-13T06:43:26.889 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:26.890 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:26.890 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:26.890 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-13T06:43:26.890 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_node_flags": {}, 2024-09-13T06:43:26.890 INFO:teuthology.orchestra.run.smithi081.stdout: "device_class_flags": {}, 2024-09-13T06:43:26.890 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": { 2024-09-13T06:43:26.890 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode_enabled": false, 2024-09-13T06:43:26.890 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_bucket_count": 0, 2024-09-13T06:43:26.890 INFO:teuthology.orchestra.run.smithi081.stdout: "degraded_stretch_mode": 0, 2024-09-13T06:43:26.890 INFO:teuthology.orchestra.run.smithi081.stdout: "recovering_stretch_mode": 0, 2024-09-13T06:43:26.890 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode_bucket": 0 2024-09-13T06:43:26.890 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:26.890 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:43:26.892 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:43:26.892 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [], 2024-09-13T06:43:26.893 INFO:teuthology.orchestra.run.smithi139.stdout: "num_ops": 0 2024-09-13T06:43:26.893 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:43:26.894 INFO:tasks.thrashosds.thrasher:j is {'epoch': 241, 'fsid': 'e5612297-d004-4957-927e-afa37f30d6cf', 'created': '2024-09-13T06:38:56.670231+0000', 'modified': '2024-09-13T06:43:26.401455+0000', 'last_up_change': '2024-09-13T06:42:51.723548+0000', 'last_in_change': '2024-09-13T06:42:16.419321+0000', 'flags': 'noscrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5801984, 'flags_set': ['noscrub', 'pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 5, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 3, 'max_osd': 8, 'require_min_compat_client': 'luminous', 'min_compat_client': 'luminous', 'require_osd_release': 'reef', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T06:39:09.600726+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 6.059999942779541, 'score_stable': 6.059999942779541, 'optimal_score': 0.33000001311302185, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 0.6494846343994141, 'average_primary_affinity': 0.8700000047683716, 'average_primary_affinity_weighted': 0.6499999761581421}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-09-13T06:39:15.802118+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 3, 'snap_epoch': 20, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1.1699999570846558, 'raw_score_acting': 2.630000114440918, 'raw_score_stable': 2.630000114440918, 'primary_affinity_weighted': 0.6494846343994141, 'average_primary_affinity': 0.8700000047683716, 'average_primary_affinity_weighted': 0.6499999761581421}}, {'pool': 3, 'pool_name': 'pool_client.0', 'create_time': '2024-09-13T06:39:25.648942+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '241', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 147, 'snap_epoch': 241, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'error_message': 'pool 3 has some PGs where all OSDs are with primary_affinity 0 (at least pg 3.10), read balance score may not be reliable', 'score_acting': 0, 'score_stable': 0}}], 'osds': [{'osd': 0, 'uuid': '54b0a3e4-58ad-4f95-86dc-29a11c9a1964', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 0, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 236, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6808', 'nonce': 1904727940}, {'type': 'v1', 'addr': '172.21.15.81:6809', 'nonce': 1904727940}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6810', 'nonce': 1904727940}, {'type': 'v1', 'addr': '172.21.15.81:6811', 'nonce': 1904727940}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6814', 'nonce': 1904727940}, {'type': 'v1', 'addr': '172.21.15.81:6815', 'nonce': 1904727940}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6812', 'nonce': 1904727940}, {'type': 'v1', 'addr': '172.21.15.81:6813', 'nonce': 1904727940}]}, 'public_addr': '172.21.15.81:6809/1904727940', 'cluster_addr': '172.21.15.81:6811/1904727940', 'heartbeat_back_addr': '172.21.15.81:6815/1904727940', 'heartbeat_front_addr': '172.21.15.81:6813/1904727940', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': 'a6dba5b9-c833-465e-a8a5-1741528b24c0', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 221, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6817', 'nonce': 738205570}, {'type': 'v1', 'addr': '172.21.15.81:6819', 'nonce': 738205570}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6822', 'nonce': 738205570}, {'type': 'v1', 'addr': '172.21.15.81:6824', 'nonce': 738205570}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6830', 'nonce': 738205570}, {'type': 'v1', 'addr': '172.21.15.81:6831', 'nonce': 738205570}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6826', 'nonce': 738205570}, {'type': 'v1', 'addr': '172.21.15.81:6829', 'nonce': 738205570}]}, 'public_addr': '172.21.15.81:6819/738205570', 'cluster_addr': '172.21.15.81:6824/738205570', 'heartbeat_back_addr': '172.21.15.81:6831/738205570', 'heartbeat_front_addr': '172.21.15.81:6829/738205570', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': '6c45097e-44a2-454f-80a4-0fe879ccd52f', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 222, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6816', 'nonce': 3558674335}, {'type': 'v1', 'addr': '172.21.15.81:6818', 'nonce': 3558674335}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6820', 'nonce': 3558674335}, {'type': 'v1', 'addr': '172.21.15.81:6821', 'nonce': 3558674335}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6827', 'nonce': 3558674335}, {'type': 'v1', 'addr': '172.21.15.81:6828', 'nonce': 3558674335}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6823', 'nonce': 3558674335}, {'type': 'v1', 'addr': '172.21.15.81:6825', 'nonce': 3558674335}]}, 'public_addr': '172.21.15.81:6818/3558674335', 'cluster_addr': '172.21.15.81:6821/3558674335', 'heartbeat_back_addr': '172.21.15.81:6828/3558674335', 'heartbeat_front_addr': '172.21.15.81:6825/3558674335', 'state': ['exists', 'up']}, {'osd': 3, 'uuid': '31952760-06f3-4618-a5c4-f5c4fed3aadb', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 191, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6800', 'nonce': 1886327229}, {'type': 'v1', 'addr': '172.21.15.81:6801', 'nonce': 1886327229}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6802', 'nonce': 1886327229}, {'type': 'v1', 'addr': '172.21.15.81:6803', 'nonce': 1886327229}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6806', 'nonce': 1886327229}, {'type': 'v1', 'addr': '172.21.15.81:6807', 'nonce': 1886327229}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6804', 'nonce': 1886327229}, {'type': 'v1', 'addr': '172.21.15.81:6805', 'nonce': 1886327229}]}, 'public_addr': '172.21.15.81:6801/1886327229', 'cluster_addr': '172.21.15.81:6803/1886327229', 'heartbeat_back_addr': '172.21.15.81:6807/1886327229', 'heartbeat_front_addr': '172.21.15.81:6805/1886327229', 'state': ['exists', 'up']}, {'osd': 4, 'uuid': 'c9bd2751-c836-43dc-b844-e13678cb2fd9', 'up': 1, 'in': 1, 'weight': 0.58685302734375, 'primary_affinity': 0.649200439453125, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 221, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.139:6817', 'nonce': 2184515621}, {'type': 'v1', 'addr': '172.21.15.139:6819', 'nonce': 2184515621}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.139:6820', 'nonce': 2184515621}, {'type': 'v1', 'addr': '172.21.15.139:6822', 'nonce': 2184515621}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.139:6827', 'nonce': 2184515621}, {'type': 'v1', 'addr': '172.21.15.139:6829', 'nonce': 2184515621}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.139:6824', 'nonce': 2184515621}, {'type': 'v1', 'addr': '172.21.15.139:6826', 'nonce': 2184515621}]}, 'public_addr': '172.21.15.139:6819/2184515621', 'cluster_addr': '172.21.15.139:6822/2184515621', 'heartbeat_back_addr': '172.21.15.139:6829/2184515621', 'heartbeat_front_addr': '172.21.15.139:6826/2184515621', 'state': ['exists', 'up']}, {'osd': 5, 'uuid': '2971b93a-6c9f-4b77-b526-4eac788fabf9', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 0, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 203, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.139:6816', 'nonce': 3982901834}, {'type': 'v1', 'addr': '172.21.15.139:6818', 'nonce': 3982901834}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.139:6821', 'nonce': 3982901834}, {'type': 'v1', 'addr': '172.21.15.139:6823', 'nonce': 3982901834}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.139:6830', 'nonce': 3982901834}, {'type': 'v1', 'addr': '172.21.15.139:6831', 'nonce': 3982901834}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.139:6825', 'nonce': 3982901834}, {'type': 'v1', 'addr': '172.21.15.139:6828', 'nonce': 3982901834}]}, 'public_addr': '172.21.15.139:6818/3982901834', 'cluster_addr': '172.21.15.139:6823/3982901834', 'heartbeat_back_addr': '172.21.15.139:6831/3982901834', 'heartbeat_front_addr': '172.21.15.139:6828/3982901834', 'state': ['exists', 'up']}, {'osd': 6, 'uuid': 'e1f786ce-579e-48cc-b212-83f881b94184', 'up': 0, 'in': 0, 'weight': 0, 'primary_affinity': 0.5466766357421875, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 170, 'down_at': 209, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.139:6800', 'nonce': 2283932666}, {'type': 'v1', 'addr': '172.21.15.139:6801', 'nonce': 2283932666}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.139:6802', 'nonce': 2283932666}, {'type': 'v1', 'addr': '172.21.15.139:6803', 'nonce': 2283932666}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.139:6806', 'nonce': 2283932666}, {'type': 'v1', 'addr': '172.21.15.139:6807', 'nonce': 2283932666}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.139:6804', 'nonce': 2283932666}, {'type': 'v1', 'addr': '172.21.15.139:6805', 'nonce': 2283932666}]}, 'public_addr': '172.21.15.139:6801/2283932666', 'cluster_addr': '172.21.15.139:6803/2283932666', 'heartbeat_back_addr': '172.21.15.139:6807/2283932666', 'heartbeat_front_addr': '172.21.15.139:6805/2283932666', 'state': ['exists']}, {'osd': 7, 'uuid': 'a287ddf6-84eb-4225-b267-25eee1657625', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 13, 'last_clean_end': 121, 'up_from': 187, 'up_thru': 192, 'down_at': 122, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.139:6808', 'nonce': 105054579}, {'type': 'v1', 'addr': '172.21.15.139:6809', 'nonce': 105054579}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.139:6810', 'nonce': 105054579}, {'type': 'v1', 'addr': '172.21.15.139:6811', 'nonce': 105054579}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.139:6814', 'nonce': 105054579}, {'type': 'v1', 'addr': '172.21.15.139:6815', 'nonce': 105054579}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.139:6812', 'nonce': 105054579}, {'type': 'v1', 'addr': '172.21.15.139:6813', 'nonce': 105054579}]}, 'public_addr': '172.21.15.139:6809/105054579', 'cluster_addr': '172.21.15.139:6811/105054579', 'heartbeat_back_addr': '172.21.15.139:6815/105054579', 'heartbeat_front_addr': '172.21.15.139:6813/105054579', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-13T06:39:05.476871+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-13T06:39:05.455183+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-13T06:39:05.504853+0000', 'dead_epoch': 0}, {'osd': 3, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-13T06:39:05.372429+0000', 'dead_epoch': 0}, {'osd': 4, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-13T06:39:05.421023+0000', 'dead_epoch': 0}, {'osd': 5, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-13T06:39:05.477489+0000', 'dead_epoch': 0}, {'osd': 6, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 65536, 'last_purged_snaps_scrub': '2024-09-13T06:39:05.314700+0000', 'dead_epoch': 209}, {'osd': 7, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-13T06:39:05.462229+0000', 'dead_epoch': 122}], 'pg_upmap': [{'pgid': '3.1a', 'osds': [2, 6]}], 'pg_upmap_items': [{'pgid': '3.14', 'mappings': [{'from': 4, 'to': 2}]}, {'pgid': '3.1b', 'mappings': [{'from': 4, 'to': 1}]}], 'pg_upmap_primaries': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [{'pool': 3, 'snaps': [{'begin': 88, 'length': 1}, {'begin': 91, 'length': 1}, {'begin': 94, 'length': 1}, {'begin': 97, 'length': 1}, {'begin': 100, 'length': 1}, {'begin': 103, 'length': 1}]}], 'new_removed_snaps': [{'pool': 3, 'snaps': [{'begin': 88, 'length': 1}]}], 'new_purged_snaps': [{'pool': 3, 'snaps': [{'begin': 106, 'length': 1}, {'begin': 109, 'length': 1}, {'begin': 112, 'length': 1}, {'begin': 115, 'length': 1}, {'begin': 118, 'length': 1}]}], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-09-13T06:43:26.894 INFO:tasks.thrashosds.thrasher:Clearing pg_upmap on 3.1b 2024-09-13T06:43:26.894 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd rm-pg-upmap-items 3.1b 2024-09-13T06:43:26.894 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-13T06:43:26.895 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:43:26.893+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:43:26.993 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:43:26.991+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:43:27.062 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:43:27.062 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [], 2024-09-13T06:43:27.062 INFO:teuthology.orchestra.run.smithi139.stdout: "complaint_time": 30, 2024-09-13T06:43:27.062 INFO:teuthology.orchestra.run.smithi139.stdout: "num_blocked_ops": 0 2024-09-13T06:43:27.062 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:43:27.076 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-13T06:43:27.094 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:43:27.095+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:43:27.195 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-13T06:43:27.193+0000 7fa8bb18e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 36790) UID: 0 2024-09-13T06:43:27.198 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:43:27.198 INFO:teuthology.orchestra.run.smithi139.stdout: "size": 20, 2024-09-13T06:43:27.198 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 600, 2024-09-13T06:43:27.198 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [ 2024-09-13T06:43:27.198 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:27.198 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:176089 3.11 3:8b97f15f:::rbd_data.1121a23b99f7.0000000000000000:head [write 0~4194304 [fadvise_sequential+fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e196)", 2024-09-13T06:43:27.198 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:42:36.707298+0000", 2024-09-13T06:43:27.198 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 50.488859165000001, 2024-09-13T06:43:27.198 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.053333426000000003, 2024-09-13T06:43:27.198 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:27.199 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:43:27.199 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:27.199 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:27.199 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:27.199 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 176089 2024-09-13T06:43:27.199 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:27.199 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:27.199 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:27.199 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:27.199 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.707298+0000", 2024-09-13T06:43:27.199 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:27.199 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:27.199 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:27.200 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:27.200 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.707298+0000", 2024-09-13T06:43:27.200 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:27.200 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:27.200 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:27.200 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:27.200 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.707296+0000", 2024-09-13T06:43:27.200 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999976 2024-09-13T06:43:27.200 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:27.200 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:27.200 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:27.201 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.717511+0000", 2024-09-13T06:43:27.201 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.010215218999999999 2024-09-13T06:43:27.201 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:27.201 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:27.201 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:27.201 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.717555+0000", 2024-09-13T06:43:27.201 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.4159000000000002e-05 2024-09-13T06:43:27.201 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:27.201 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:27.201 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:27.201 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.717569+0000", 2024-09-13T06:43:27.202 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3543999999999999e-05 2024-09-13T06:43:27.202 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:27.202 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:27.202 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:27.202 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.717677+0000", 2024-09-13T06:43:27.202 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00010798699999999999 2024-09-13T06:43:27.202 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:27.202 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:27.202 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:27.202 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.717896+0000", 2024-09-13T06:43:27.202 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000219466 2024-09-13T06:43:27.202 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:27.202 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:27.202 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 4", 2024-09-13T06:43:27.203 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.718090+0000", 2024-09-13T06:43:27.203 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00019322799999999999 2024-09-13T06:43:27.203 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:27.203 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:27.203 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:43:27.203 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.751403+0000", 2024-09-13T06:43:27.203 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.033313493 2024-09-13T06:43:27.203 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:27.203 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:27.203 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-13T06:43:27.203 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.760523+0000", 2024-09-13T06:43:27.203 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0091197150000000005 2024-09-13T06:43:27.204 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:27.204 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:27.204 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-13T06:43:27.204 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.760581+0000", 2024-09-13T06:43:27.204 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.8007999999999998e-05 2024-09-13T06:43:27.204 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:27.204 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:27.204 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:27.204 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.760632+0000", 2024-09-13T06:43:27.204 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.1085999999999998e-05 2024-09-13T06:43:27.204 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:27.204 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:27.204 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:27.205 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:27.205 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:27.205 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:176090 3.e 3:77f86bf9:::rbd_data.1121a23b99f7.0000000000000001:head [write 0~4194304 [fadvise_sequential+fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e196)", 2024-09-13T06:43:27.205 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:42:36.717590+0000", 2024-09-13T06:43:27.205 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 50.478567683000001, 2024-09-13T06:43:27.205 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.049445965000000001, 2024-09-13T06:43:27.205 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:27.205 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:43:27.205 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:27.205 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:27.205 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:27.205 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 176090 2024-09-13T06:43:27.205 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:27.205 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:27.206 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:27.206 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:27.206 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.717590+0000", 2024-09-13T06:43:27.206 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:27.206 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:27.206 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:27.206 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:27.206 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.717590+0000", 2024-09-13T06:43:27.206 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:27.206 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:27.206 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:27.206 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:27.206 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.717588+0000", 2024-09-13T06:43:27.207 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999981 2024-09-13T06:43:27.207 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:27.207 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:27.207 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:27.207 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.723934+0000", 2024-09-13T06:43:27.207 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0063462589999999999 2024-09-13T06:43:27.207 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:27.207 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:27.207 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:27.207 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.723960+0000", 2024-09-13T06:43:27.207 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.6251e-05 2024-09-13T06:43:27.207 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:27.207 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:27.207 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:27.207 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.723976+0000", 2024-09-13T06:43:27.208 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5277e-05 2024-09-13T06:43:27.208 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:27.208 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:27.208 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:27.208 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.724154+0000", 2024-09-13T06:43:27.208 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00017814400000000001 2024-09-13T06:43:27.208 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:27.208 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:27.208 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:27.208 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.724534+0000", 2024-09-13T06:43:27.208 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00038054799999999998 2024-09-13T06:43:27.208 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:27.208 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:27.209 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-13T06:43:27.209 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.724926+0000", 2024-09-13T06:43:27.209 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00039199100000000001 2024-09-13T06:43:27.209 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:27.209 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:27.209 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:43:27.209 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.744509+0000", 2024-09-13T06:43:27.209 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.019582977000000001 2024-09-13T06:43:27.209 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:27.209 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:27.209 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-13T06:43:27.209 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.766937+0000", 2024-09-13T06:43:27.210 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.022427765999999998 2024-09-13T06:43:27.210 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:27.210 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:27.210 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-13T06:43:27.210 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.766987+0000", 2024-09-13T06:43:27.210 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.9898000000000002e-05 2024-09-13T06:43:27.210 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:27.210 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:27.210 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:27.210 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.767036+0000", 2024-09-13T06:43:27.210 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.8782000000000002e-05 2024-09-13T06:43:27.210 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:27.210 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:27.211 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:27.211 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:27.211 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:27.211 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:176094 3.f 3:f5ca80c1:::rbd_data.1121a23b99f7.0000000000000004:head [write 0~4194304 [fadvise_sequential+fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e196)", 2024-09-13T06:43:27.211 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:42:36.724239+0000", 2024-09-13T06:43:27.211 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 50.471918582999997, 2024-09-13T06:43:27.211 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.043501235999999999, 2024-09-13T06:43:27.211 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:27.211 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:43:27.211 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:27.211 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:27.211 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:27.211 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 176094 2024-09-13T06:43:27.211 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:27.212 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:27.212 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:27.212 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:27.212 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.724239+0000", 2024-09-13T06:43:27.212 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:27.212 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:27.212 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:27.212 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:27.212 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.724239+0000", 2024-09-13T06:43:27.212 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:27.212 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:27.212 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:27.212 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:27.213 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.724237+0000", 2024-09-13T06:43:27.213 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999981 2024-09-13T06:43:27.213 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:27.213 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:27.213 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:27.213 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.733673+0000", 2024-09-13T06:43:27.213 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0094352700000000008 2024-09-13T06:43:27.213 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:27.213 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:27.213 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:27.213 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.733703+0000", 2024-09-13T06:43:27.213 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.0102000000000001e-05 2024-09-13T06:43:27.213 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:27.214 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:27.214 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:27.214 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.733718+0000", 2024-09-13T06:43:27.214 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5199e-05 2024-09-13T06:43:27.214 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:27.214 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:27.214 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:27.214 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.733780+0000", 2024-09-13T06:43:27.214 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.1691000000000003e-05 2024-09-13T06:43:27.214 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:27.214 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:27.214 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:27.214 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.733928+0000", 2024-09-13T06:43:27.215 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000147987 2024-09-13T06:43:27.215 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:27.215 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:27.215 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 4", 2024-09-13T06:43:27.215 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.734036+0000", 2024-09-13T06:43:27.215 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000108925 2024-09-13T06:43:27.215 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:27.215 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:27.215 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:43:27.215 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.763741+0000", 2024-09-13T06:43:27.215 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.029704151000000002 2024-09-13T06:43:27.215 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:27.215 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:27.215 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-13T06:43:27.216 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.767615+0000", 2024-09-13T06:43:27.216 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0038739120000000002 2024-09-13T06:43:27.216 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:27.216 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:27.216 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-13T06:43:27.216 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.767693+0000", 2024-09-13T06:43:27.216 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.8573999999999997e-05 2024-09-13T06:43:27.216 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:27.216 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:27.216 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:27.216 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.767740+0000", 2024-09-13T06:43:27.216 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.7154000000000003e-05 2024-09-13T06:43:27.216 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:27.217 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:27.217 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:27.217 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:27.217 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:27.217 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:205233 3.15 3:a97b2891:::rbd_data.11213650bb32.000000000000002e:head [set-alloc-hint object_size 4194304 write_size 4194304,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e209)", 2024-09-13T06:43:27.217 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:42:52.282586+0000", 2024-09-13T06:43:27.217 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 34.913571738999998, 2024-09-13T06:43:27.217 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.056996628000000001, 2024-09-13T06:43:27.217 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:27.217 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:43:27.217 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:27.217 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:27.218 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:27.218 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 205233 2024-09-13T06:43:27.218 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:27.218 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:27.218 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:27.218 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:27.218 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:52.282586+0000", 2024-09-13T06:43:27.218 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:27.218 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:27.218 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:27.218 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:27.218 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:52.282586+0000", 2024-09-13T06:43:27.218 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:27.218 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:27.219 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:27.219 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:27.219 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:52.282583+0000", 2024-09-13T06:43:27.219 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999976 2024-09-13T06:43:27.219 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:27.219 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:27.219 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:27.219 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:52.282599+0000", 2024-09-13T06:43:27.219 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5065999999999999e-05 2024-09-13T06:43:27.219 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:27.219 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:27.219 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:27.219 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:52.282632+0000", 2024-09-13T06:43:27.220 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.3386999999999997e-05 2024-09-13T06:43:27.220 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:27.220 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:27.220 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:27.220 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:52.282654+0000", 2024-09-13T06:43:27.220 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.177e-05 2024-09-13T06:43:27.220 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:27.220 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:27.220 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:27.220 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:52.282753+0000", 2024-09-13T06:43:27.220 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.9685000000000005e-05 2024-09-13T06:43:27.220 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:27.220 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:27.221 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:27.221 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:52.283000+0000", 2024-09-13T06:43:27.221 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000246278 2024-09-13T06:43:27.221 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:27.221 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:27.221 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 3", 2024-09-13T06:43:27.221 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:52.292656+0000", 2024-09-13T06:43:27.221 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0096565980000000006 2024-09-13T06:43:27.221 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:27.221 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:27.221 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:43:27.221 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:52.339352+0000", 2024-09-13T06:43:27.221 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.046695309999999997 2024-09-13T06:43:27.222 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:27.222 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:27.222 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-13T06:43:27.222 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:52.339373+0000", 2024-09-13T06:43:27.222 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.1002999999999999e-05 2024-09-13T06:43:27.222 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:27.222 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:27.222 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-13T06:43:27.222 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:52.339464+0000", 2024-09-13T06:43:27.222 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.1131999999999994e-05 2024-09-13T06:43:27.222 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:27.222 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:27.222 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:27.222 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:52.339582+0000", 2024-09-13T06:43:27.223 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000118799 2024-09-13T06:43:27.223 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:27.223 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:27.223 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:27.223 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:27.223 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:27.223 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:237445 3.15 3:abdd9d42:::rbd_data.1121cb4a09ed.0000000000000008:82 [read 69632~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e224)", 2024-09-13T06:43:27.223 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:43:08.800334+0000", 2024-09-13T06:43:27.223 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 18.395823330999999, 2024-09-13T06:43:27.223 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.032345681000000001, 2024-09-13T06:43:27.223 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:27.223 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:27.223 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:27.224 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:27.224 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:27.224 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 237445 2024-09-13T06:43:27.224 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:27.224 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:27.224 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:27.224 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:27.224 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800334+0000", 2024-09-13T06:43:27.224 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:27.224 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:27.224 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:27.224 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:27.224 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800334+0000", 2024-09-13T06:43:27.224 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:27.225 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:27.225 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:27.225 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:27.225 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800334+0000", 2024-09-13T06:43:27.225 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:27.225 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:27.225 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:27.225 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:27.225 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800338+0000", 2024-09-13T06:43:27.225 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.9539999999999998e-06 2024-09-13T06:43:27.225 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:27.225 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:27.225 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:27.226 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800342+0000", 2024-09-13T06:43:27.226 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.7249999999999999e-06 2024-09-13T06:43:27.226 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:27.226 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:27.226 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:27.226 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800345+0000", 2024-09-13T06:43:27.226 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.072e-06 2024-09-13T06:43:27.226 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:27.226 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:27.226 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:27.226 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.832482+0000", 2024-09-13T06:43:27.226 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.032137713999999998 2024-09-13T06:43:27.226 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:27.226 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:27.227 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:27.227 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.832571+0000", 2024-09-13T06:43:27.227 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.8252999999999997e-05 2024-09-13T06:43:27.227 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:27.227 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:27.227 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:27.227 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.832680+0000", 2024-09-13T06:43:27.227 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000109214 2024-09-13T06:43:27.227 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:27.227 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:27.227 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:27.227 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:27.227 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:27.228 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:237446 3.15 3:abdd9d42:::rbd_data.1121cb4a09ed.0000000000000008:82 [read 81920~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e224)", 2024-09-13T06:43:27.228 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:43:08.800348+0000", 2024-09-13T06:43:27.228 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 18.395809930999999, 2024-09-13T06:43:27.228 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.032454446999999997, 2024-09-13T06:43:27.228 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:27.228 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:27.228 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:27.228 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:27.228 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:27.228 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 237446 2024-09-13T06:43:27.228 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:27.228 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:27.228 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:27.229 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:27.229 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800348+0000", 2024-09-13T06:43:27.229 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:27.229 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:27.229 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:27.229 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:27.229 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800348+0000", 2024-09-13T06:43:27.229 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:27.229 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:27.229 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:27.229 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:27.229 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800347+0000", 2024-09-13T06:43:27.230 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:27.230 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:27.230 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:27.230 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:27.230 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800349+0000", 2024-09-13T06:43:27.230 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.452e-06 2024-09-13T06:43:27.230 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:27.230 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:27.230 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:27.230 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800354+0000", 2024-09-13T06:43:27.230 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.0350000000000001e-06 2024-09-13T06:43:27.230 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:27.230 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:27.231 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:27.231 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800357+0000", 2024-09-13T06:43:27.231 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.179e-06 2024-09-13T06:43:27.231 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:27.231 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:27.231 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:27.231 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.832707+0000", 2024-09-13T06:43:27.231 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.032350071000000001 2024-09-13T06:43:27.231 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:27.231 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:27.231 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:27.231 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.832748+0000", 2024-09-13T06:43:27.232 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0587000000000003e-05 2024-09-13T06:43:27.232 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:27.232 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:27.232 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:27.232 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.832802+0000", 2024-09-13T06:43:27.232 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.4429999999999999e-05 2024-09-13T06:43:27.232 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:27.232 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:27.232 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:27.232 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:27.232 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:27.232 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:237447 3.15 3:abdd9d42:::rbd_data.1121cb4a09ed.0000000000000008:82 [read 94208~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e224)", 2024-09-13T06:43:27.233 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:43:08.800360+0000", 2024-09-13T06:43:27.233 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 18.395798019000001, 2024-09-13T06:43:27.233 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.032679798000000003, 2024-09-13T06:43:27.233 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:27.233 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:27.233 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:27.233 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:27.233 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:27.233 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 237447 2024-09-13T06:43:27.233 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:27.233 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:27.233 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:27.233 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:27.234 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800360+0000", 2024-09-13T06:43:27.234 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:27.234 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:27.234 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:27.234 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:27.234 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800360+0000", 2024-09-13T06:43:27.234 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:27.234 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:27.234 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:27.234 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:27.234 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800359+0000", 2024-09-13T06:43:27.234 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:27.234 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:27.234 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:27.235 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:27.235 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800361+0000", 2024-09-13T06:43:27.235 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.463e-06 2024-09-13T06:43:27.235 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:27.235 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:27.235 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:27.235 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800364+0000", 2024-09-13T06:43:27.235 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.6279999999999998e-06 2024-09-13T06:43:27.235 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:27.235 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:27.235 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:27.235 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800367+0000", 2024-09-13T06:43:27.235 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.7259999999999998e-06 2024-09-13T06:43:27.236 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:27.236 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:27.236 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:27.236 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.832841+0000", 2024-09-13T06:43:27.236 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.032474115999999997 2024-09-13T06:43:27.236 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:27.236 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:27.236 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:27.236 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.832929+0000", 2024-09-13T06:43:27.236 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.7886000000000005e-05 2024-09-13T06:43:27.236 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:27.236 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:27.236 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:27.237 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.833039+0000", 2024-09-13T06:43:27.237 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00011024200000000001 2024-09-13T06:43:27.237 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:27.237 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:27.237 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:27.237 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:27.237 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:27.237 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:237448 3.15 3:abdd9d42:::rbd_data.1121cb4a09ed.0000000000000008:82 [read 106496~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e224)", 2024-09-13T06:43:27.237 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:43:08.800371+0000", 2024-09-13T06:43:27.237 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 18.395786879999999, 2024-09-13T06:43:27.237 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.032794221999999998, 2024-09-13T06:43:27.237 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:27.237 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:27.238 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:27.238 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:27.238 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:27.238 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 237448 2024-09-13T06:43:27.238 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:27.238 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:27.238 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:27.238 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:27.238 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800371+0000", 2024-09-13T06:43:27.238 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:27.238 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:27.238 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:27.238 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:27.238 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800371+0000", 2024-09-13T06:43:27.239 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:27.239 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:27.239 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:27.239 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:27.239 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800370+0000", 2024-09-13T06:43:27.239 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967296 2024-09-13T06:43:27.239 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:27.239 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:27.239 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:27.239 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800372+0000", 2024-09-13T06:43:27.239 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3510000000000001e-06 2024-09-13T06:43:27.239 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:27.239 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:27.240 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:27.240 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800376+0000", 2024-09-13T06:43:27.240 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.693e-06 2024-09-13T06:43:27.240 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:27.240 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:27.240 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:27.240 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800378+0000", 2024-09-13T06:43:27.240 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.8870000000000001e-06 2024-09-13T06:43:27.240 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:27.241 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:27.241 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:27.241 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.833069+0000", 2024-09-13T06:43:27.241 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.032690708999999998 2024-09-13T06:43:27.241 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:27.241 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:27.241 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:27.241 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.833110+0000", 2024-09-13T06:43:27.241 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.1356999999999997e-05 2024-09-13T06:43:27.241 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:27.241 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:27.241 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:27.242 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.833165+0000", 2024-09-13T06:43:27.242 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.4456999999999997e-05 2024-09-13T06:43:27.242 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:27.242 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:27.242 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:27.242 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:27.242 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:27.242 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:237449 3.15 3:abdd9d42:::rbd_data.1121cb4a09ed.0000000000000008:82 [read 118784~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e224)", 2024-09-13T06:43:27.242 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:43:08.800381+0000", 2024-09-13T06:43:27.242 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 18.395776737999999, 2024-09-13T06:43:27.242 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.033007068000000001, 2024-09-13T06:43:27.242 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:27.242 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:27.243 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:27.243 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:27.243 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:27.243 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 237449 2024-09-13T06:43:27.243 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:27.243 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:27.243 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:27.243 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:27.243 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800381+0000", 2024-09-13T06:43:27.243 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:27.243 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:27.243 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:27.244 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:27.244 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800381+0000", 2024-09-13T06:43:27.244 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:27.244 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:27.244 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:27.244 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:27.244 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800381+0000", 2024-09-13T06:43:27.244 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967296 2024-09-13T06:43:27.244 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:27.244 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:27.244 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:27.244 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800382+0000", 2024-09-13T06:43:27.245 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.395e-06 2024-09-13T06:43:27.245 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:27.245 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:27.245 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:27.245 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800386+0000", 2024-09-13T06:43:27.245 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.574e-06 2024-09-13T06:43:27.245 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:27.245 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:27.245 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:27.245 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800388+0000", 2024-09-13T06:43:27.245 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.8729999999999999e-06 2024-09-13T06:43:27.245 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:27.246 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:27.246 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:27.246 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.833204+0000", 2024-09-13T06:43:27.246 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.032815986999999998 2024-09-13T06:43:27.246 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:27.246 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:27.246 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:27.246 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.833289+0000", 2024-09-13T06:43:27.246 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.4085999999999994e-05 2024-09-13T06:43:27.246 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:27.246 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:27.246 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:27.246 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.833388+0000", 2024-09-13T06:43:27.247 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.9380000000000001e-05 2024-09-13T06:43:27.247 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:27.247 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:27.247 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:27.247 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:27.247 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:27.247 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:237450 3.15 3:abdd9d42:::rbd_data.1121cb4a09ed.0000000000000008:82 [read 131072~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e224)", 2024-09-13T06:43:27.247 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:43:08.800392+0000", 2024-09-13T06:43:27.247 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 18.395765409999999, 2024-09-13T06:43:27.247 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.033110507999999997, 2024-09-13T06:43:27.247 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:27.247 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:27.247 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:27.248 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:27.248 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:27.248 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 237450 2024-09-13T06:43:27.248 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:27.248 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:27.248 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:27.248 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:27.248 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800392+0000", 2024-09-13T06:43:27.248 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:27.248 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:27.248 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:27.248 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:27.248 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800392+0000", 2024-09-13T06:43:27.249 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:27.249 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:27.249 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:27.249 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:27.249 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800392+0000", 2024-09-13T06:43:27.249 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967296 2024-09-13T06:43:27.249 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:27.249 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:27.249 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:27.249 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800393+0000", 2024-09-13T06:43:27.249 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.375e-06 2024-09-13T06:43:27.249 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:27.249 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:27.249 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:27.250 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800397+0000", 2024-09-13T06:43:27.250 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.6109999999999998e-06 2024-09-13T06:43:27.250 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:27.250 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:27.250 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:27.250 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800400+0000", 2024-09-13T06:43:27.250 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.7580000000000001e-06 2024-09-13T06:43:27.250 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:27.250 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:27.250 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:27.250 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.833414+0000", 2024-09-13T06:43:27.250 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.033014767 2024-09-13T06:43:27.250 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:27.251 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:27.251 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:27.251 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.833453+0000", 2024-09-13T06:43:27.251 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.8711000000000003e-05 2024-09-13T06:43:27.251 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:27.251 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:27.251 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:27.251 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.833503+0000", 2024-09-13T06:43:27.251 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.9523e-05 2024-09-13T06:43:27.251 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:27.251 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:27.251 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:27.251 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:27.252 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:27.252 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:237451 3.15 3:abdd9d42:::rbd_data.1121cb4a09ed.0000000000000008:82 [read 143360~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e224)", 2024-09-13T06:43:27.252 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:43:08.800402+0000", 2024-09-13T06:43:27.252 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 18.395755592, 2024-09-13T06:43:27.252 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.033337717000000003, 2024-09-13T06:43:27.252 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:27.252 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:27.252 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:27.252 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:27.252 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:27.252 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 237451 2024-09-13T06:43:27.252 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:27.252 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:27.253 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:27.253 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:27.253 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800402+0000", 2024-09-13T06:43:27.253 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:27.253 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:27.253 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:27.253 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:27.253 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800402+0000", 2024-09-13T06:43:27.253 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:27.253 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:27.253 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:27.253 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:27.253 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800402+0000", 2024-09-13T06:43:27.254 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967296 2024-09-13T06:43:27.254 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:27.254 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:27.254 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:27.254 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800403+0000", 2024-09-13T06:43:27.254 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.37e-06 2024-09-13T06:43:27.254 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:27.254 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:27.254 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:27.254 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800407+0000", 2024-09-13T06:43:27.254 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.6820000000000001e-06 2024-09-13T06:43:27.254 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:27.255 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:27.255 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:27.255 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800410+0000", 2024-09-13T06:43:27.255 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.7810000000000001e-06 2024-09-13T06:43:27.255 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:27.255 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:27.255 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:27.255 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.833550+0000", 2024-09-13T06:43:27.255 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.033140192999999998 2024-09-13T06:43:27.255 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:27.255 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:27.255 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:27.255 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.833634+0000", 2024-09-13T06:43:27.256 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.4097000000000005e-05 2024-09-13T06:43:27.256 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:27.256 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:27.256 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:27.256 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.833740+0000", 2024-09-13T06:43:27.256 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00010582300000000001 2024-09-13T06:43:27.256 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:27.256 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:27.256 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:27.256 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:27.256 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:27.256 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:237452 3.15 3:abdd9d42:::rbd_data.1121cb4a09ed.0000000000000008:82 [read 155648~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e224)", 2024-09-13T06:43:27.257 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:43:08.800412+0000", 2024-09-13T06:43:27.257 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 18.395745636000001, 2024-09-13T06:43:27.257 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.033496535000000001, 2024-09-13T06:43:27.257 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:27.257 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:27.257 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:27.257 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:27.257 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:27.257 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 237452 2024-09-13T06:43:27.257 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:27.257 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:27.257 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:27.258 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:27.258 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800412+0000", 2024-09-13T06:43:27.258 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:27.258 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:27.258 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:27.258 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:27.258 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800412+0000", 2024-09-13T06:43:27.258 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:27.258 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:27.258 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:27.258 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:27.258 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800412+0000", 2024-09-13T06:43:27.259 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967296 2024-09-13T06:43:27.259 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:27.259 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:27.259 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:27.259 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800413+0000", 2024-09-13T06:43:27.259 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.342e-06 2024-09-13T06:43:27.259 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:27.259 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:27.259 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:27.259 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800417+0000", 2024-09-13T06:43:27.259 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.6480000000000001e-06 2024-09-13T06:43:27.259 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:27.259 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:27.259 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:27.260 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800419+0000", 2024-09-13T06:43:27.260 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.7920000000000001e-06 2024-09-13T06:43:27.260 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:27.260 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:27.260 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:27.260 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.833768+0000", 2024-09-13T06:43:27.260 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.033348587999999998 2024-09-13T06:43:27.260 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:27.260 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:27.260 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:27.260 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.833836+0000", 2024-09-13T06:43:27.260 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.8090999999999996e-05 2024-09-13T06:43:27.260 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:27.261 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:27.261 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:27.261 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.833908+0000", 2024-09-13T06:43:27.261 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.2311999999999995e-05 2024-09-13T06:43:27.261 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:27.261 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:27.261 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:27.261 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:27.261 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:27.261 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:237453 3.15 3:abdd9d42:::rbd_data.1121cb4a09ed.0000000000000008:82 [read 167936~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e224)", 2024-09-13T06:43:27.261 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:43:08.800422+0000", 2024-09-13T06:43:27.261 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 18.395735564999999, 2024-09-13T06:43:27.262 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.033735223000000002, 2024-09-13T06:43:27.262 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:27.262 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:27.262 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:27.262 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:27.262 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:27.262 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 237453 2024-09-13T06:43:27.262 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:27.262 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:27.262 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:27.262 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:27.262 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800422+0000", 2024-09-13T06:43:27.262 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:27.262 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:27.263 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:27.263 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:27.263 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800422+0000", 2024-09-13T06:43:27.263 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:27.263 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:27.263 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:27.263 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:27.263 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800422+0000", 2024-09-13T06:43:27.263 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967296 2024-09-13T06:43:27.263 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:27.263 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:27.263 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:27.264 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800423+0000", 2024-09-13T06:43:27.264 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3489999999999999e-06 2024-09-13T06:43:27.264 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:27.264 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:27.264 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:27.264 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800427+0000", 2024-09-13T06:43:27.264 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.6610000000000002e-06 2024-09-13T06:43:27.264 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:27.264 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:27.264 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:27.264 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800430+0000", 2024-09-13T06:43:27.264 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.9869999999999999e-06 2024-09-13T06:43:27.264 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:27.265 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:27.265 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:27.265 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.833958+0000", 2024-09-13T06:43:27.265 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.033528020999999998 2024-09-13T06:43:27.265 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:27.265 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:27.265 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:27.265 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.834047+0000", 2024-09-13T06:43:27.265 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.9492000000000003e-05 2024-09-13T06:43:27.265 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:27.265 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:27.265 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:27.265 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.834157+0000", 2024-09-13T06:43:27.265 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000109948 2024-09-13T06:43:27.266 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:27.266 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:27.266 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:27.266 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:27.266 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:27.266 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:237454 3.15 3:abdd9d42:::rbd_data.1121cb4a09ed.0000000000000008:82 [read 180224~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e224)", 2024-09-13T06:43:27.266 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:43:08.800432+0000", 2024-09-13T06:43:27.266 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 18.395725358, 2024-09-13T06:43:27.266 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.033853883000000001, 2024-09-13T06:43:27.266 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:27.266 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:27.266 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:27.266 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:27.266 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:27.267 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 237454 2024-09-13T06:43:27.267 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:27.267 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:27.267 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:27.267 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:27.267 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800432+0000", 2024-09-13T06:43:27.267 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:27.267 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:27.267 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:27.267 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:27.267 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800432+0000", 2024-09-13T06:43:27.267 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:27.267 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:27.267 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:27.268 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:27.268 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800432+0000", 2024-09-13T06:43:27.268 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:27.268 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:27.268 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:27.268 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:27.268 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800433+0000", 2024-09-13T06:43:27.268 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3379999999999999e-06 2024-09-13T06:43:27.268 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:27.268 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:27.268 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:27.268 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800437+0000", 2024-09-13T06:43:27.268 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.1679999999999997e-06 2024-09-13T06:43:27.269 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:27.269 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:27.269 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:27.269 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800440+0000", 2024-09-13T06:43:27.269 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.8830000000000002e-06 2024-09-13T06:43:27.269 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:27.269 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:27.269 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:27.269 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.834187+0000", 2024-09-13T06:43:27.269 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.033746532000000003 2024-09-13T06:43:27.269 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:27.269 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:27.269 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:27.270 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.834228+0000", 2024-09-13T06:43:27.270 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.087e-05 2024-09-13T06:43:27.270 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:27.270 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:27.270 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:27.270 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.834286+0000", 2024-09-13T06:43:27.270 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.8331000000000001e-05 2024-09-13T06:43:27.270 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:27.270 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:27.270 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:27.270 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:27.270 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:27.270 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:237455 3.15 3:abdd9d42:::rbd_data.1121cb4a09ed.0000000000000008:82 [read 192512~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e224)", 2024-09-13T06:43:27.271 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:43:08.800443+0000", 2024-09-13T06:43:27.271 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 18.395714885, 2024-09-13T06:43:27.271 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.034083294, 2024-09-13T06:43:27.271 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:27.271 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:27.271 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:27.271 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:27.271 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:27.271 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 237455 2024-09-13T06:43:27.271 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:27.271 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:27.271 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:27.271 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:27.271 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800443+0000", 2024-09-13T06:43:27.272 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:27.272 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:27.272 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:27.272 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:27.272 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800443+0000", 2024-09-13T06:43:27.272 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:27.272 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:27.272 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:27.272 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:27.272 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800442+0000", 2024-09-13T06:43:27.272 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967296 2024-09-13T06:43:27.272 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:27.272 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:27.273 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:27.273 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800444+0000", 2024-09-13T06:43:27.273 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.443e-06 2024-09-13T06:43:27.273 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:27.273 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:27.273 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:27.273 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800448+0000", 2024-09-13T06:43:27.273 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.6770000000000001e-06 2024-09-13T06:43:27.273 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:27.273 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:27.273 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:27.273 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800451+0000", 2024-09-13T06:43:27.273 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.0920000000000002e-06 2024-09-13T06:43:27.273 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:27.274 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:27.274 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:27.274 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.834323+0000", 2024-09-13T06:43:27.274 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.033872145999999999 2024-09-13T06:43:27.274 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:27.274 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:27.274 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:27.274 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.834420+0000", 2024-09-13T06:43:27.274 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6898999999999995e-05 2024-09-13T06:43:27.274 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:27.274 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:27.274 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:27.274 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.834526+0000", 2024-09-13T06:43:27.275 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000106272 2024-09-13T06:43:27.275 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:27.275 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:27.275 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:27.275 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:27.275 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:27.275 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:237456 3.15 3:abdd9d42:::rbd_data.1121cb4a09ed.0000000000000008:82 [read 204800~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e224)", 2024-09-13T06:43:27.275 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:43:08.800453+0000", 2024-09-13T06:43:27.275 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 18.395704674000001, 2024-09-13T06:43:27.275 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.034198615000000002, 2024-09-13T06:43:27.275 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:27.275 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:27.275 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:27.276 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:27.276 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:27.276 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 237456 2024-09-13T06:43:27.276 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:27.276 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:27.276 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:27.276 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:27.276 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800453+0000", 2024-09-13T06:43:27.276 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:27.276 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:27.276 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:27.276 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:27.276 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800453+0000", 2024-09-13T06:43:27.277 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:27.277 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:27.277 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:27.277 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:27.277 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800453+0000", 2024-09-13T06:43:27.277 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967296 2024-09-13T06:43:27.277 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:27.277 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:27.277 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:27.277 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800454+0000", 2024-09-13T06:43:27.277 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.361e-06 2024-09-13T06:43:27.277 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:27.277 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:27.277 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:27.278 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800458+0000", 2024-09-13T06:43:27.278 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.7189999999999999e-06 2024-09-13T06:43:27.278 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:27.278 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:27.278 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:27.278 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800461+0000", 2024-09-13T06:43:27.278 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.7599999999999998e-06 2024-09-13T06:43:27.278 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:27.278 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:27.278 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:27.278 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.834555+0000", 2024-09-13T06:43:27.278 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.034094192000000002 2024-09-13T06:43:27.278 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:27.279 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:27.279 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:27.279 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.834597+0000", 2024-09-13T06:43:27.279 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.2157000000000003e-05 2024-09-13T06:43:27.279 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:27.279 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:27.279 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:27.279 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.834652+0000", 2024-09-13T06:43:27.279 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.4660999999999997e-05 2024-09-13T06:43:27.279 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:27.279 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:27.279 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:27.279 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:27.279 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:27.280 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:237457 3.15 3:abdd9d42:::rbd_data.1121cb4a09ed.0000000000000008:82 [read 217088~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e224)", 2024-09-13T06:43:27.280 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:43:08.800463+0000", 2024-09-13T06:43:27.280 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 18.395694726999999, 2024-09-13T06:43:27.280 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.034419130999999999, 2024-09-13T06:43:27.280 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:27.280 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:27.280 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:27.280 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:27.280 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:27.280 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 237457 2024-09-13T06:43:27.280 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:27.280 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:27.280 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:27.281 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:27.281 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800463+0000", 2024-09-13T06:43:27.281 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:27.281 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:27.281 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:27.281 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:27.281 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800463+0000", 2024-09-13T06:43:27.281 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:27.281 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:27.281 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:27.281 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:27.281 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800463+0000", 2024-09-13T06:43:27.281 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967296 2024-09-13T06:43:27.281 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:27.282 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:27.282 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:27.282 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800466+0000", 2024-09-13T06:43:27.282 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.8240000000000001e-06 2024-09-13T06:43:27.282 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:27.282 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:27.282 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:27.282 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800470+0000", 2024-09-13T06:43:27.282 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.7579999999999998e-06 2024-09-13T06:43:27.282 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:27.282 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:27.282 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:27.282 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800473+0000", 2024-09-13T06:43:27.282 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.875e-06 2024-09-13T06:43:27.283 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:27.283 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:27.283 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:27.283 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.834688+0000", 2024-09-13T06:43:27.283 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.034215039000000003 2024-09-13T06:43:27.283 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:27.283 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:27.283 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:27.283 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.834772+0000", 2024-09-13T06:43:27.283 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.3870999999999997e-05 2024-09-13T06:43:27.283 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:27.283 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:27.283 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:27.284 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.834882+0000", 2024-09-13T06:43:27.284 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00011 2024-09-13T06:43:27.284 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:27.284 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:27.284 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:27.284 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:27.284 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:27.284 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:237458 3.15 3:abdd9d42:::rbd_data.1121cb4a09ed.0000000000000008:82 [read 229376~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e224)", 2024-09-13T06:43:27.284 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:43:08.800476+0000", 2024-09-13T06:43:27.284 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 18.395681978999999, 2024-09-13T06:43:27.284 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.034538358999999998, 2024-09-13T06:43:27.284 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:27.285 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:27.285 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:27.285 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:27.285 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:27.285 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 237458 2024-09-13T06:43:27.285 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:27.285 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:27.285 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:27.285 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:27.285 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800476+0000", 2024-09-13T06:43:27.285 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:27.285 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:27.285 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:27.286 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:27.286 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800476+0000", 2024-09-13T06:43:27.286 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:27.286 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:27.286 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:27.286 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:27.286 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800475+0000", 2024-09-13T06:43:27.286 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:27.286 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:27.286 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:27.286 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:27.286 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800477+0000", 2024-09-13T06:43:27.287 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.367e-06 2024-09-13T06:43:27.287 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:27.287 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:27.287 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:27.287 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800480+0000", 2024-09-13T06:43:27.287 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.7179999999999998e-06 2024-09-13T06:43:27.287 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:27.287 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:27.287 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:27.287 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800483+0000", 2024-09-13T06:43:27.287 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.807e-06 2024-09-13T06:43:27.287 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:27.287 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:27.288 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:27.288 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.834922+0000", 2024-09-13T06:43:27.288 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.034438261999999997 2024-09-13T06:43:27.288 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:27.288 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:27.288 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:27.288 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.834962+0000", 2024-09-13T06:43:27.288 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0287999999999998e-05 2024-09-13T06:43:27.288 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:27.288 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:27.288 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:27.288 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.835014+0000", 2024-09-13T06:43:27.288 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.2172999999999997e-05 2024-09-13T06:43:27.288 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:27.289 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:27.289 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:27.289 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:27.289 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:27.289 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:237459 3.15 3:abdd9d42:::rbd_data.1121cb4a09ed.0000000000000008:82 [read 241664~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e224)", 2024-09-13T06:43:27.289 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:43:08.800486+0000", 2024-09-13T06:43:27.289 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 18.395671837999998, 2024-09-13T06:43:27.289 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.034771370000000003, 2024-09-13T06:43:27.289 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:27.289 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:27.289 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:27.289 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:27.289 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:27.290 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 237459 2024-09-13T06:43:27.290 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:27.290 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:27.290 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:27.290 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:27.290 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800486+0000", 2024-09-13T06:43:27.290 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:27.290 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:27.290 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:27.290 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:27.290 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800486+0000", 2024-09-13T06:43:27.290 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:27.290 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:27.291 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:27.291 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:27.291 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800485+0000", 2024-09-13T06:43:27.291 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:27.291 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:27.291 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:27.291 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:27.291 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800487+0000", 2024-09-13T06:43:27.291 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.297e-06 2024-09-13T06:43:27.291 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:27.291 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:27.291 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:27.291 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800491+0000", 2024-09-13T06:43:27.292 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.4569999999999998e-06 2024-09-13T06:43:27.292 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:27.292 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:27.292 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:27.292 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800494+0000", 2024-09-13T06:43:27.292 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.8710000000000001e-06 2024-09-13T06:43:27.292 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:27.292 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:27.292 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:27.292 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.835058+0000", 2024-09-13T06:43:27.292 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.034564117999999998 2024-09-13T06:43:27.292 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:27.292 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:27.293 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:27.293 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.835142+0000", 2024-09-13T06:43:27.293 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.352e-05 2024-09-13T06:43:27.293 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:27.293 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:27.293 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:27.293 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.835257+0000", 2024-09-13T06:43:27.293 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00011537 2024-09-13T06:43:27.293 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:27.293 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:27.293 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:27.293 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:27.293 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:27.294 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:237460 3.15 3:abdd9d42:::rbd_data.1121cb4a09ed.0000000000000008:82 [read 253952~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e224)", 2024-09-13T06:43:27.294 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:43:08.800511+0000", 2024-09-13T06:43:27.294 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 18.395646167999999, 2024-09-13T06:43:27.294 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.034864764999999999, 2024-09-13T06:43:27.294 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:27.294 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:27.294 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:27.294 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:27.294 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:27.294 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 237460 2024-09-13T06:43:27.294 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:27.294 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:27.294 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:27.294 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:27.295 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800511+0000", 2024-09-13T06:43:27.295 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:27.295 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:27.295 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:27.295 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:27.295 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800511+0000", 2024-09-13T06:43:27.295 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:27.295 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:27.295 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:27.295 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:27.295 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800511+0000", 2024-09-13T06:43:27.295 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:27.295 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:27.296 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:27.296 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:27.296 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800513+0000", 2024-09-13T06:43:27.296 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6020000000000001e-06 2024-09-13T06:43:27.296 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:27.296 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:27.296 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:27.296 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800517+0000", 2024-09-13T06:43:27.296 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0559999999999998e-06 2024-09-13T06:43:27.296 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:27.296 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:27.296 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:27.297 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800521+0000", 2024-09-13T06:43:27.297 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.4050000000000002e-06 2024-09-13T06:43:27.297 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:27.297 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:27.297 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:27.297 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.835278+0000", 2024-09-13T06:43:27.297 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.034757154999999998 2024-09-13T06:43:27.297 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:27.297 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:27.297 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:27.297 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.835319+0000", 2024-09-13T06:43:27.297 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.1121000000000002e-05 2024-09-13T06:43:27.297 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:27.297 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:27.298 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:27.298 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.835376+0000", 2024-09-13T06:43:27.298 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.6820000000000001e-05 2024-09-13T06:43:27.298 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:27.298 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:27.298 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:27.298 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:27.299 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:27.300 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:43:27.301 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-13T06:43:27.302 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:43:27.299+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:43:27.402 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:43:27.403+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:43:27.426 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:43:27.426 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-13T06:43:27.427 INFO:teuthology.orchestra.run.smithi081.stdout: "num_ops": 0 2024-09-13T06:43:27.427 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:43:27.441 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-13T06:43:27.526 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:43:27.527+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:43:27.556 INFO:teuthology.orchestra.run.smithi081.stderr:clear 3.1b pg_upmap_items mapping 2024-09-13T06:43:27.618 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:43:27.618 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-13T06:43:27.618 INFO:teuthology.orchestra.run.smithi081.stdout: "complaint_time": 30, 2024-09-13T06:43:27.619 INFO:teuthology.orchestra.run.smithi081.stdout: "num_blocked_ops": 0 2024-09-13T06:43:27.619 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:43:27.619 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:43:27.619+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:43:27.633 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-13T06:43:27.705 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:43:27.705+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:43:27.803 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:43:27.803 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 20, 2024-09-13T06:43:27.803 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 600, 2024-09-13T06:43:27.803 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [ 2024-09-13T06:43:27.804 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:27.804 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:37801 3.1 3:82e31015:::rbd_object_map.1121d8143c6e.0000000000000019:head [call] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e55)", 2024-09-13T06:43:27.804 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:05.646191+0000", 2024-09-13T06:43:27.804 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 202.15581993199999, 2024-09-13T06:43:27.804 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.72659507800000001, 2024-09-13T06:43:27.804 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:27.804 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:27.804 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:27.804 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:27.804 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:27.804 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 37801 2024-09-13T06:43:27.804 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:27.805 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:27.805 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:27.805 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:27.805 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:05.646191+0000", 2024-09-13T06:43:27.805 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:27.805 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:27.805 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:27.805 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:27.805 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:05.646191+0000", 2024-09-13T06:43:27.805 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:27.805 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:27.805 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:27.805 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:27.806 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:05.646188+0000", 2024-09-13T06:43:27.806 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999971 2024-09-13T06:43:27.806 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:27.806 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:27.806 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:27.806 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:05.646206+0000", 2024-09-13T06:43:27.806 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8182999999999999e-05 2024-09-13T06:43:27.806 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:27.806 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:27.806 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:27.806 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:05.646237+0000", 2024-09-13T06:43:27.806 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.1071000000000001e-05 2024-09-13T06:43:27.806 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:27.807 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:27.807 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:27.807 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:05.646251+0000", 2024-09-13T06:43:27.807 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3679000000000001e-05 2024-09-13T06:43:27.807 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:27.807 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:27.807 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:27.807 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:05.646321+0000", 2024-09-13T06:43:27.807 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.9831000000000003e-05 2024-09-13T06:43:27.807 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:27.808 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:27.808 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:43:27.808 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:05.646331+0000", 2024-09-13T06:43:27.808 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0242e-05 2024-09-13T06:43:27.808 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:27.808 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:27.808 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:27.808 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.371959+0000", 2024-09-13T06:43:27.808 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.72562817199999996 2024-09-13T06:43:27.808 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:27.808 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:27.808 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:27.808 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.372389+0000", 2024-09-13T06:43:27.809 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00042977400000000001 2024-09-13T06:43:27.809 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:27.809 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:27.809 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:27.809 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.372786+0000", 2024-09-13T06:43:27.809 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00039706099999999999 2024-09-13T06:43:27.809 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:27.809 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:27.809 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:27.809 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:27.809 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:27.809 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43182 3.17 3:ec5ebce4:::rbd_data.1121f5f2e1c0.0000000000000001:1f [read 333824~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:43:27.809 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.652985+0000", 2024-09-13T06:43:27.810 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 186.149025319, 2024-09-13T06:43:27.810 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123926616, 2024-09-13T06:43:27.810 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:27.810 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:27.810 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:27.810 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:27.810 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:27.810 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43182 2024-09-13T06:43:27.810 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:27.810 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:27.810 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:27.810 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:27.810 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.652985+0000", 2024-09-13T06:43:27.810 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:27.811 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:27.811 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:27.811 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:27.811 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.652985+0000", 2024-09-13T06:43:27.811 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:27.811 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:27.811 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:27.811 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:27.812 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.652985+0000", 2024-09-13T06:43:27.812 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:27.812 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:27.812 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:27.812 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:27.812 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.652987+0000", 2024-09-13T06:43:27.812 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0899999999999999e-06 2024-09-13T06:43:27.812 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:27.812 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:27.812 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:27.812 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.652994+0000", 2024-09-13T06:43:27.812 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3100000000000003e-06 2024-09-13T06:43:27.812 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:27.813 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:27.813 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:27.813 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.653000+0000", 2024-09-13T06:43:27.813 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2020000000000003e-06 2024-09-13T06:43:27.813 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:27.813 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:27.813 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:27.813 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.776635+0000", 2024-09-13T06:43:27.813 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.12363529400000001 2024-09-13T06:43:27.813 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:27.813 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:27.813 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:27.813 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.776676+0000", 2024-09-13T06:43:27.814 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.0745999999999999e-05 2024-09-13T06:43:27.814 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:27.814 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:27.814 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:27.814 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.776912+0000", 2024-09-13T06:43:27.814 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00023631300000000001 2024-09-13T06:43:27.814 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:27.814 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:27.814 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:27.814 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:27.814 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:27.814 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43194 3.17 3:ec5ebce4:::rbd_data.1121f5f2e1c0.0000000000000001:1f [read 495616~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:43:27.814 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.656645+0000", 2024-09-13T06:43:27.814 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 186.145365126, 2024-09-13T06:43:27.815 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.124088483, 2024-09-13T06:43:27.815 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:27.815 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:27.815 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:27.815 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:27.815 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:27.815 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43194 2024-09-13T06:43:27.815 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:27.815 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:27.815 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:27.815 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:27.815 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656645+0000", 2024-09-13T06:43:27.815 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:27.816 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:27.816 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:27.816 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:27.816 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656645+0000", 2024-09-13T06:43:27.816 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:27.816 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:27.816 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:27.816 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:27.816 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656645+0000", 2024-09-13T06:43:27.816 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:27.816 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:27.816 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:27.816 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:27.817 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656647+0000", 2024-09-13T06:43:27.817 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9180000000000001e-06 2024-09-13T06:43:27.817 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:27.817 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:27.817 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:27.817 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656653+0000", 2024-09-13T06:43:27.817 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7860000000000002e-06 2024-09-13T06:43:27.817 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:27.817 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:27.817 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:27.817 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656658+0000", 2024-09-13T06:43:27.817 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6949999999999999e-06 2024-09-13T06:43:27.817 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:27.818 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:27.818 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:27.818 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.780406+0000", 2024-09-13T06:43:27.818 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123748657 2024-09-13T06:43:27.818 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:27.818 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:27.818 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:27.818 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.780446+0000", 2024-09-13T06:43:27.818 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.9360999999999998e-05 2024-09-13T06:43:27.818 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:27.818 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:27.818 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:27.818 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.780734+0000", 2024-09-13T06:43:27.819 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00028838399999999998 2024-09-13T06:43:27.819 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:27.819 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:27.819 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:27.819 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:27.819 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:27.819 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43241 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 120832~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:43:27.819 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.660682+0000", 2024-09-13T06:43:27.819 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 186.14132818799999, 2024-09-13T06:43:27.819 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123958204, 2024-09-13T06:43:27.819 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:27.819 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:27.819 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:27.819 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:27.820 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:27.820 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43241 2024-09-13T06:43:27.820 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:27.820 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:27.820 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:27.820 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:27.820 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660682+0000", 2024-09-13T06:43:27.820 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:27.820 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:27.820 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:27.820 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:27.820 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660682+0000", 2024-09-13T06:43:27.820 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:27.821 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:27.821 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:27.821 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:27.821 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660682+0000", 2024-09-13T06:43:27.821 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:27.821 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:27.821 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:27.821 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:27.821 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660683+0000", 2024-09-13T06:43:27.821 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.308e-06 2024-09-13T06:43:27.821 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:27.821 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:27.821 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:27.821 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660686+0000", 2024-09-13T06:43:27.822 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.977e-06 2024-09-13T06:43:27.822 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:27.822 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:27.822 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:27.822 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660689+0000", 2024-09-13T06:43:27.822 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5830000000000001e-06 2024-09-13T06:43:27.822 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:27.822 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:27.822 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:27.822 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.784366+0000", 2024-09-13T06:43:27.822 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.12367713599999999 2024-09-13T06:43:27.822 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:27.822 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:27.823 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:27.823 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.784451+0000", 2024-09-13T06:43:27.823 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.4629999999999994e-05 2024-09-13T06:43:27.823 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:27.823 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:27.823 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:27.823 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.784641+0000", 2024-09-13T06:43:27.823 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00018984899999999999 2024-09-13T06:43:27.823 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:27.823 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:27.823 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:27.823 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:27.823 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:27.823 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43242 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 139264~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:43:27.824 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.660691+0000", 2024-09-13T06:43:27.824 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 186.14131921000001, 2024-09-13T06:43:27.824 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.124536443, 2024-09-13T06:43:27.824 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:27.824 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:27.824 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:27.824 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:27.824 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:27.824 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43242 2024-09-13T06:43:27.824 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:27.824 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:27.824 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:27.824 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:27.825 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660691+0000", 2024-09-13T06:43:27.825 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:27.825 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:27.825 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:27.825 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:27.825 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660691+0000", 2024-09-13T06:43:27.825 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:27.825 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:27.825 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:27.825 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:27.825 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660691+0000", 2024-09-13T06:43:27.825 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:43:27.825 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:27.825 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:27.826 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:27.826 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660696+0000", 2024-09-13T06:43:27.826 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0560000000000004e-06 2024-09-13T06:43:27.826 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:27.826 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:27.826 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:27.826 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660699+0000", 2024-09-13T06:43:27.826 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.2009999999999999e-06 2024-09-13T06:43:27.826 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:27.826 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:27.826 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:27.826 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660702+0000", 2024-09-13T06:43:27.826 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.633e-06 2024-09-13T06:43:27.826 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:27.827 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:27.827 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:27.827 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.784912+0000", 2024-09-13T06:43:27.827 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.124209497 2024-09-13T06:43:27.827 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:27.827 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:27.827 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:27.827 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.784995+0000", 2024-09-13T06:43:27.827 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.3891e-05 2024-09-13T06:43:27.827 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:27.827 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:27.827 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:27.827 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.785228+0000", 2024-09-13T06:43:27.827 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00023237400000000001 2024-09-13T06:43:27.828 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:27.828 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:27.828 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:27.828 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:27.828 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:27.828 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43243 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 153600~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:43:27.828 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.660705+0000", 2024-09-13T06:43:27.828 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 186.14130587700001, 2024-09-13T06:43:27.828 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.124825835, 2024-09-13T06:43:27.828 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:27.828 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:27.828 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:27.828 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:27.828 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:27.829 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43243 2024-09-13T06:43:27.829 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:27.829 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:27.829 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:27.829 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:27.829 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660705+0000", 2024-09-13T06:43:27.829 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:27.829 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:27.829 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:27.829 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:27.829 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660705+0000", 2024-09-13T06:43:27.829 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:27.829 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:27.829 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:27.830 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:27.830 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660705+0000", 2024-09-13T06:43:27.830 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:43:27.830 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:27.830 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:27.830 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:27.830 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660706+0000", 2024-09-13T06:43:27.830 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4339999999999999e-06 2024-09-13T06:43:27.830 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:27.830 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:27.830 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:27.830 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660709+0000", 2024-09-13T06:43:27.830 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9000000000000002e-06 2024-09-13T06:43:27.830 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:27.831 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:27.831 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:27.831 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660712+0000", 2024-09-13T06:43:27.831 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.0589999999999998e-06 2024-09-13T06:43:27.831 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:27.831 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:27.831 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:27.831 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.785318+0000", 2024-09-13T06:43:27.831 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.124606299 2024-09-13T06:43:27.831 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:27.831 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:27.831 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:27.831 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.785361+0000", 2024-09-13T06:43:27.831 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.3214999999999999e-05 2024-09-13T06:43:27.832 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:27.832 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:27.832 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:27.832 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.785531+0000", 2024-09-13T06:43:27.832 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00016914400000000001 2024-09-13T06:43:27.832 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:27.832 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:27.832 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:27.832 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:27.832 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:27.832 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43244 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 167936~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:43:27.832 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.660714+0000", 2024-09-13T06:43:27.832 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 186.14129646399999, 2024-09-13T06:43:27.833 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.125073248, 2024-09-13T06:43:27.833 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:27.833 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:27.833 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:27.833 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:27.833 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:27.833 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43244 2024-09-13T06:43:27.833 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:27.833 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:27.833 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:27.833 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:27.833 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660714+0000", 2024-09-13T06:43:27.834 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:27.834 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:27.834 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:27.834 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:27.834 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660714+0000", 2024-09-13T06:43:27.834 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:27.834 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:27.834 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:27.834 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:27.834 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660714+0000", 2024-09-13T06:43:27.834 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:43:27.834 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:27.834 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:27.834 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:27.834 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660715+0000", 2024-09-13T06:43:27.835 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2330000000000001e-06 2024-09-13T06:43:27.835 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:27.835 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:27.835 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:27.835 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660718+0000", 2024-09-13T06:43:27.835 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9569999999999998e-06 2024-09-13T06:43:27.835 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:27.835 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:27.835 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:27.835 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660721+0000", 2024-09-13T06:43:27.835 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.678e-06 2024-09-13T06:43:27.835 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:27.835 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:27.836 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:27.836 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.785557+0000", 2024-09-13T06:43:27.836 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.12483633199999999 2024-09-13T06:43:27.836 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:27.836 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:27.836 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:27.836 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.785618+0000", 2024-09-13T06:43:27.836 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0686000000000001e-05 2024-09-13T06:43:27.836 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:27.836 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:27.836 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:27.836 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.785787+0000", 2024-09-13T06:43:27.836 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00016957699999999999 2024-09-13T06:43:27.836 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:27.837 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:27.837 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:27.837 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:27.837 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:27.837 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43256 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 344064~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:43:27.837 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.664763+0000", 2024-09-13T06:43:27.837 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 186.137247954, 2024-09-13T06:43:27.837 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.12418359399999999, 2024-09-13T06:43:27.837 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:27.837 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:27.837 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:27.837 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:27.838 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:27.838 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43256 2024-09-13T06:43:27.838 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:27.838 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:27.838 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:27.838 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:27.838 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664763+0000", 2024-09-13T06:43:27.838 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:27.838 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:27.838 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:27.838 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:27.838 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664763+0000", 2024-09-13T06:43:27.838 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:27.839 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:27.839 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:27.839 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:27.839 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664762+0000", 2024-09-13T06:43:27.839 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:27.839 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:27.839 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:27.839 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:27.839 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664765+0000", 2024-09-13T06:43:27.839 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3290000000000001e-06 2024-09-13T06:43:27.839 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:27.839 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:27.839 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:27.839 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664771+0000", 2024-09-13T06:43:27.840 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.1319999999999999e-06 2024-09-13T06:43:27.840 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:27.840 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:27.840 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:27.840 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664776+0000", 2024-09-13T06:43:27.840 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.8840000000000002e-06 2024-09-13T06:43:27.840 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:27.840 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:27.840 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:27.840 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.788598+0000", 2024-09-13T06:43:27.840 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123821979 2024-09-13T06:43:27.840 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:27.840 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:27.840 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:27.841 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.788680+0000", 2024-09-13T06:43:27.841 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.2367999999999995e-05 2024-09-13T06:43:27.841 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:27.841 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:27.841 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:27.841 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.788946+0000", 2024-09-13T06:43:27.841 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00026629799999999999 2024-09-13T06:43:27.841 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:27.841 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:27.841 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:27.841 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:27.841 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:27.841 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43267 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 505856~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:43:27.842 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.669461+0000", 2024-09-13T06:43:27.842 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 186.13254939999999, 2024-09-13T06:43:27.842 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123933711, 2024-09-13T06:43:27.842 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:27.842 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:27.842 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:27.842 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:27.842 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:27.842 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43267 2024-09-13T06:43:27.842 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:27.842 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:27.842 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:27.843 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:27.843 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669461+0000", 2024-09-13T06:43:27.843 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:27.843 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:27.843 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:27.843 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:27.843 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669461+0000", 2024-09-13T06:43:27.843 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:27.843 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:27.843 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:27.843 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:27.843 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669461+0000", 2024-09-13T06:43:27.843 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:27.844 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:27.844 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:27.844 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:27.844 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669463+0000", 2024-09-13T06:43:27.844 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5629999999999999e-06 2024-09-13T06:43:27.844 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:27.844 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:27.844 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:27.844 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669473+0000", 2024-09-13T06:43:27.844 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.9520000000000006e-06 2024-09-13T06:43:27.844 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:27.844 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:27.844 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:27.845 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669479+0000", 2024-09-13T06:43:27.845 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8540000000000002e-06 2024-09-13T06:43:27.845 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:27.845 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:27.845 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:27.845 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.793137+0000", 2024-09-13T06:43:27.845 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.12365825699999999 2024-09-13T06:43:27.845 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:27.845 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:27.845 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:27.845 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.793181+0000", 2024-09-13T06:43:27.845 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.3773999999999998e-05 2024-09-13T06:43:27.845 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:27.846 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:27.846 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:27.846 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.793395+0000", 2024-09-13T06:43:27.846 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00021372399999999999 2024-09-13T06:43:27.846 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:27.846 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:27.846 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:27.846 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:27.846 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:27.846 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43268 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 520192~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:43:27.846 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.669484+0000", 2024-09-13T06:43:27.846 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 186.13252661499999, 2024-09-13T06:43:27.846 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.12441057899999999, 2024-09-13T06:43:27.846 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:27.846 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:27.847 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:27.847 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:27.847 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:27.847 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43268 2024-09-13T06:43:27.847 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:27.847 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:27.847 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:27.847 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:27.847 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669484+0000", 2024-09-13T06:43:27.847 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:27.847 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:27.847 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:27.847 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:27.848 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669484+0000", 2024-09-13T06:43:27.848 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:27.848 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:27.848 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:27.848 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:27.848 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669484+0000", 2024-09-13T06:43:27.848 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:27.848 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:27.848 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:27.848 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:27.848 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669486+0000", 2024-09-13T06:43:27.848 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6120000000000001e-06 2024-09-13T06:43:27.848 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:27.848 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:27.849 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:27.849 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669494+0000", 2024-09-13T06:43:27.849 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4819999999999997e-06 2024-09-13T06:43:27.849 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:27.849 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:27.849 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:27.849 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669497+0000", 2024-09-13T06:43:27.849 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9790000000000002e-06 2024-09-13T06:43:27.849 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:27.849 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:27.849 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:27.849 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.793559+0000", 2024-09-13T06:43:27.850 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.124062436 2024-09-13T06:43:27.850 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:27.850 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:27.850 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:27.850 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.793603+0000", 2024-09-13T06:43:27.850 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.3764999999999999e-05 2024-09-13T06:43:27.850 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:27.850 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:27.850 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:27.850 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.793895+0000", 2024-09-13T06:43:27.850 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00029168299999999999 2024-09-13T06:43:27.850 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:27.850 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:27.851 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:27.851 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:27.851 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:27.851 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:181627 3.1b 3:dbd5e871:::rbd_data.11218aab7a9c.0000000000000003:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e203)", 2024-09-13T06:43:27.851 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:42:45.704561+0000", 2024-09-13T06:43:27.851 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 42.097449750999999, 2024-09-13T06:43:27.851 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.70481779099999997, 2024-09-13T06:43:27.851 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:27.851 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:27.851 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:27.851 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:27.851 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:27.851 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 181627 2024-09-13T06:43:27.851 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:27.852 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:27.852 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:27.852 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:27.852 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.704561+0000", 2024-09-13T06:43:27.852 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:27.852 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:27.852 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:27.852 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:27.852 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.704561+0000", 2024-09-13T06:43:27.852 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:27.852 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:27.852 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:27.852 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:27.853 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.704558+0000", 2024-09-13T06:43:27.853 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999976 2024-09-13T06:43:27.853 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:27.853 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:27.853 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:27.853 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.704570+0000", 2024-09-13T06:43:27.853 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2123000000000001e-05 2024-09-13T06:43:27.853 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:27.853 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:27.853 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:27.853 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.704596+0000", 2024-09-13T06:43:27.853 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5134e-05 2024-09-13T06:43:27.853 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:27.853 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:27.854 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:27.854 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.704609+0000", 2024-09-13T06:43:27.854 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3745e-05 2024-09-13T06:43:27.854 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:27.854 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:27.854 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:27.854 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.704797+0000", 2024-09-13T06:43:27.854 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00018797799999999999 2024-09-13T06:43:27.854 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:27.854 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:27.854 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:43:27.854 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.704816+0000", 2024-09-13T06:43:27.854 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8218000000000001e-05 2024-09-13T06:43:27.855 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:27.855 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:27.855 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:27.855 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:46.408816+0000", 2024-09-13T06:43:27.855 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.70399995500000001 2024-09-13T06:43:27.855 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:27.855 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:27.855 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:27.855 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:46.409111+0000", 2024-09-13T06:43:27.855 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000295202 2024-09-13T06:43:27.855 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:27.855 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:27.855 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:27.856 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:46.409379+0000", 2024-09-13T06:43:27.856 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00026792599999999998 2024-09-13T06:43:27.856 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:27.856 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:27.856 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:27.856 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:27.856 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:27.856 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:181641 3.1b 3:dbd5e871:::rbd_data.11218aab7a9c.0000000000000003:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e203)", 2024-09-13T06:43:27.856 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:42:45.704674+0000", 2024-09-13T06:43:27.856 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 42.097336744000003, 2024-09-13T06:43:27.856 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.70579465600000002, 2024-09-13T06:43:27.856 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:27.857 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:27.857 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:27.857 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:27.857 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:27.857 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 181641 2024-09-13T06:43:27.857 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:27.857 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:27.857 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:27.857 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:27.857 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.704674+0000", 2024-09-13T06:43:27.857 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:27.857 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:27.857 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:27.857 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:27.858 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.704674+0000", 2024-09-13T06:43:27.858 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:27.858 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:27.858 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:27.858 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:27.858 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.704673+0000", 2024-09-13T06:43:27.858 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:27.858 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:27.858 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:27.858 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:27.858 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.704677+0000", 2024-09-13T06:43:27.858 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.6389999999999998e-06 2024-09-13T06:43:27.858 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:27.859 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:27.859 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:27.859 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.704691+0000", 2024-09-13T06:43:27.859 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3859999999999999e-05 2024-09-13T06:43:27.859 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:27.859 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:27.859 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:27.859 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.704699+0000", 2024-09-13T06:43:27.859 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.2339999999999994e-06 2024-09-13T06:43:27.859 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:27.859 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:27.859 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:27.859 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.704854+0000", 2024-09-13T06:43:27.860 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00015513899999999999 2024-09-13T06:43:27.860 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:27.860 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:27.860 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:43:27.860 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.704866+0000", 2024-09-13T06:43:27.860 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1855000000000001e-05 2024-09-13T06:43:27.860 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:27.860 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:27.860 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:27.860 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:46.410079+0000", 2024-09-13T06:43:27.860 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.705212477 2024-09-13T06:43:27.860 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:27.860 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:27.860 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:27.860 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:46.410279+0000", 2024-09-13T06:43:27.861 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000200614 2024-09-13T06:43:27.861 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:27.861 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:27.861 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:27.861 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:46.410469+0000", 2024-09-13T06:43:27.861 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00018939400000000001 2024-09-13T06:43:27.861 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:27.861 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:27.861 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:27.861 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:27.861 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:27.861 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:181655 3.1b 3:dbd5e871:::rbd_data.11218aab7a9c.0000000000000003:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e203)", 2024-09-13T06:43:27.861 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:42:45.704730+0000", 2024-09-13T06:43:27.861 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 42.097280335999997, 2024-09-13T06:43:27.862 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.70617977499999995, 2024-09-13T06:43:27.862 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:27.862 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:27.862 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:27.862 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:27.862 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:27.862 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 181655 2024-09-13T06:43:27.862 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:27.862 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:27.862 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:27.862 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:27.862 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.704730+0000", 2024-09-13T06:43:27.862 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:27.863 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:27.863 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:27.863 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:27.863 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.704730+0000", 2024-09-13T06:43:27.863 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:27.863 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:27.863 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:27.863 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:27.863 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.704730+0000", 2024-09-13T06:43:27.863 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:27.863 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:27.863 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:27.863 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:27.864 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.704733+0000", 2024-09-13T06:43:27.864 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.0000000000000001e-06 2024-09-13T06:43:27.864 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:27.864 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:27.864 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:27.864 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.704741+0000", 2024-09-13T06:43:27.864 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.0770000000000008e-06 2024-09-13T06:43:27.864 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:27.864 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:27.864 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:27.864 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.704747+0000", 2024-09-13T06:43:27.864 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.2110000000000003e-06 2024-09-13T06:43:27.864 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:27.865 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:27.865 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:27.865 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.706676+0000", 2024-09-13T06:43:27.865 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0019289820000000001 2024-09-13T06:43:27.865 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:27.865 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:27.865 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:43:27.865 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.706687+0000", 2024-09-13T06:43:27.865 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1382999999999999e-05 2024-09-13T06:43:27.865 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:27.865 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:27.865 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:27.865 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:46.410540+0000", 2024-09-13T06:43:27.865 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.70385235199999996 2024-09-13T06:43:27.866 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:27.866 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:27.866 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:27.866 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:46.410723+0000", 2024-09-13T06:43:27.866 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000182998 2024-09-13T06:43:27.866 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:27.866 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:27.866 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:27.866 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:46.410910+0000", 2024-09-13T06:43:27.866 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00018720299999999999 2024-09-13T06:43:27.866 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:27.866 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:27.866 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:27.866 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:27.866 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:27.867 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:181669 3.1b 3:dbd5e871:::rbd_data.11218aab7a9c.0000000000000003:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e203)", 2024-09-13T06:43:27.867 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:42:45.705356+0000", 2024-09-13T06:43:27.867 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 42.096654328, 2024-09-13T06:43:27.867 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.70583958999999996, 2024-09-13T06:43:27.867 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:27.867 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:27.867 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:27.867 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:27.867 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:27.867 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 181669 2024-09-13T06:43:27.867 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:27.867 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:27.867 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:27.867 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:27.867 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.705356+0000", 2024-09-13T06:43:27.868 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:27.868 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:27.868 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:27.868 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:27.868 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.705356+0000", 2024-09-13T06:43:27.868 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:27.868 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:27.868 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:27.868 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:27.868 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.705356+0000", 2024-09-13T06:43:27.868 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:27.868 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:27.868 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:27.868 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:27.868 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.705360+0000", 2024-09-13T06:43:27.869 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.0069999999999999e-06 2024-09-13T06:43:27.869 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:27.869 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:27.869 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:27.869 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.705368+0000", 2024-09-13T06:43:27.869 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.3639999999999999e-06 2024-09-13T06:43:27.869 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:27.869 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:27.869 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:27.869 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.705375+0000", 2024-09-13T06:43:27.869 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.8839999999999997e-06 2024-09-13T06:43:27.869 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:27.869 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:27.869 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:27.870 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.706716+0000", 2024-09-13T06:43:27.870 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0013414589999999999 2024-09-13T06:43:27.870 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:27.870 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:27.870 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:43:27.870 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.706726+0000", 2024-09-13T06:43:27.870 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.5079999999999994e-06 2024-09-13T06:43:27.870 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:27.870 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:27.870 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:27.870 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:46.410966+0000", 2024-09-13T06:43:27.870 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.70424025800000001 2024-09-13T06:43:27.870 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:27.870 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:27.870 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:27.871 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:46.411099+0000", 2024-09-13T06:43:27.871 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000132395 2024-09-13T06:43:27.871 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:27.871 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:27.871 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:27.871 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:46.411196+0000", 2024-09-13T06:43:27.871 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.7344999999999997e-05 2024-09-13T06:43:27.871 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:27.871 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:27.871 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:27.871 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:27.871 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:27.871 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:181683 3.1b 3:dbd5e871:::rbd_data.11218aab7a9c.0000000000000003:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e203)", 2024-09-13T06:43:27.872 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:42:45.705404+0000", 2024-09-13T06:43:27.872 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 42.096606821999998, 2024-09-13T06:43:27.872 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.70639211899999999, 2024-09-13T06:43:27.872 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:27.872 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:27.872 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:27.872 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:27.872 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:27.872 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 181683 2024-09-13T06:43:27.872 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:27.872 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:27.872 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:27.872 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:27.872 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.705404+0000", 2024-09-13T06:43:27.873 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:27.873 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:27.873 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:27.873 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:27.873 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.705404+0000", 2024-09-13T06:43:27.873 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:27.873 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:27.873 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:27.873 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:27.873 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.705403+0000", 2024-09-13T06:43:27.873 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:27.873 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:27.873 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:27.873 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:27.874 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.705406+0000", 2024-09-13T06:43:27.874 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.1499999999999999e-06 2024-09-13T06:43:27.874 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:27.874 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:27.874 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:27.874 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.705414+0000", 2024-09-13T06:43:27.874 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4259999999999997e-06 2024-09-13T06:43:27.874 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:27.874 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:27.874 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:27.874 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.705420+0000", 2024-09-13T06:43:27.874 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.4339999999999997e-06 2024-09-13T06:43:27.874 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:27.874 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:27.875 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:27.875 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.706753+0000", 2024-09-13T06:43:27.875 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0013326939999999999 2024-09-13T06:43:27.875 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:27.875 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:27.875 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:43:27.875 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.706762+0000", 2024-09-13T06:43:27.875 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.2439999999999999e-06 2024-09-13T06:43:27.875 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:27.875 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:27.875 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:27.875 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:46.411391+0000", 2024-09-13T06:43:27.875 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.70462912099999997 2024-09-13T06:43:27.876 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:27.876 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:27.876 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:27.876 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:46.411584+0000", 2024-09-13T06:43:27.876 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00019283399999999999 2024-09-13T06:43:27.876 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:27.876 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:27.876 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:27.876 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:46.411796+0000", 2024-09-13T06:43:27.876 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00021175299999999999 2024-09-13T06:43:27.876 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:27.876 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:27.876 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:27.877 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:27.877 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:27.877 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:181697 3.1b 3:dbd5e871:::rbd_data.11218aab7a9c.0000000000000003:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e203)", 2024-09-13T06:43:27.877 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:42:45.705447+0000", 2024-09-13T06:43:27.877 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 42.096563172000003, 2024-09-13T06:43:27.877 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.70668603500000005, 2024-09-13T06:43:27.877 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:27.877 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:27.877 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:27.877 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:27.877 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:27.877 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 181697 2024-09-13T06:43:27.877 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:27.878 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:27.878 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:27.878 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:27.878 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.705447+0000", 2024-09-13T06:43:27.878 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:27.878 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:27.878 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:27.878 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:27.878 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.705447+0000", 2024-09-13T06:43:27.878 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:27.878 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:27.878 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:27.878 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:27.878 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.705447+0000", 2024-09-13T06:43:27.879 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:27.879 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:27.879 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:27.879 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:27.879 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.705450+0000", 2024-09-13T06:43:27.879 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.8830000000000002e-06 2024-09-13T06:43:27.879 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:27.879 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:27.879 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:27.879 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.705457+0000", 2024-09-13T06:43:27.879 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.097e-06 2024-09-13T06:43:27.879 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:27.879 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:27.880 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:27.880 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.705463+0000", 2024-09-13T06:43:27.880 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.2439999999999998e-06 2024-09-13T06:43:27.880 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:27.880 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:27.880 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:27.880 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.706790+0000", 2024-09-13T06:43:27.880 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.001326823 2024-09-13T06:43:27.880 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:27.880 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:27.880 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:43:27.880 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.706799+0000", 2024-09-13T06:43:27.881 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.3249999999999997e-06 2024-09-13T06:43:27.881 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:27.881 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:27.881 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:27.881 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:46.411884+0000", 2024-09-13T06:43:27.881 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.70508501599999995 2024-09-13T06:43:27.881 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:27.881 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:27.881 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:27.881 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:46.412010+0000", 2024-09-13T06:43:27.881 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000125635 2024-09-13T06:43:27.881 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:27.881 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:27.882 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:27.882 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:46.412133+0000", 2024-09-13T06:43:27.882 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000123492 2024-09-13T06:43:27.882 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:27.882 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:27.882 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:27.882 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:27.882 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:27.882 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:181711 3.1b 3:dbd5e871:::rbd_data.11218aab7a9c.0000000000000003:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e203)", 2024-09-13T06:43:27.882 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:42:45.705496+0000", 2024-09-13T06:43:27.882 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 42.096514609000003, 2024-09-13T06:43:27.882 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.70714611199999999, 2024-09-13T06:43:27.882 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:27.882 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:27.883 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:27.883 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:27.883 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:27.883 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 181711 2024-09-13T06:43:27.883 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:27.883 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:27.883 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:27.883 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:27.883 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.705496+0000", 2024-09-13T06:43:27.883 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:27.883 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:27.883 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:27.883 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:27.884 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.705496+0000", 2024-09-13T06:43:27.884 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:27.884 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:27.884 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:27.884 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:27.884 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.705495+0000", 2024-09-13T06:43:27.884 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:27.884 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:27.884 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:27.884 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:27.884 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.705499+0000", 2024-09-13T06:43:27.884 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.1109999999999999e-06 2024-09-13T06:43:27.884 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:27.885 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:27.885 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:27.885 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.705506+0000", 2024-09-13T06:43:27.885 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.8830000000000006e-06 2024-09-13T06:43:27.885 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:27.885 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:27.885 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:27.885 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.705513+0000", 2024-09-13T06:43:27.885 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.2500000000000003e-06 2024-09-13T06:43:27.885 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:27.885 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:27.885 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:27.885 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.706828+0000", 2024-09-13T06:43:27.886 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0013155840000000001 2024-09-13T06:43:27.886 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:27.886 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:27.886 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:43:27.886 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.706837+0000", 2024-09-13T06:43:27.886 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.0489999999999993e-06 2024-09-13T06:43:27.886 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:27.886 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:27.886 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:27.886 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:46.412223+0000", 2024-09-13T06:43:27.886 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.70538530799999999 2024-09-13T06:43:27.886 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:27.886 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:27.886 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:27.887 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:46.412418+0000", 2024-09-13T06:43:27.887 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000195331 2024-09-13T06:43:27.887 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:27.887 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:27.887 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:27.887 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:46.412642+0000", 2024-09-13T06:43:27.887 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00022410099999999999 2024-09-13T06:43:27.887 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:27.887 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:27.887 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:27.887 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:27.887 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:27.887 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:181725 3.1b 3:dbd5e871:::rbd_data.11218aab7a9c.0000000000000003:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e203)", 2024-09-13T06:43:27.887 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:42:45.706863+0000", 2024-09-13T06:43:27.888 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 42.095147564999998, 2024-09-13T06:43:27.888 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.70631271699999998, 2024-09-13T06:43:27.888 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:27.888 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:27.888 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:27.888 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:27.888 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:27.888 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 181725 2024-09-13T06:43:27.888 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:27.888 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:27.888 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:27.888 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:27.888 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.706863+0000", 2024-09-13T06:43:27.888 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:27.889 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:27.889 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:27.889 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:27.889 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.706863+0000", 2024-09-13T06:43:27.889 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:27.889 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:27.889 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:27.889 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:27.889 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.706862+0000", 2024-09-13T06:43:27.889 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.999999 2024-09-13T06:43:27.889 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:27.889 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:27.889 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:27.890 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.706869+0000", 2024-09-13T06:43:27.890 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.0899999999999999e-06 2024-09-13T06:43:27.890 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:27.890 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:27.890 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:27.890 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.706881+0000", 2024-09-13T06:43:27.890 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1727e-05 2024-09-13T06:43:27.890 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:27.890 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:27.890 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:27.890 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.706891+0000", 2024-09-13T06:43:27.890 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.9399999999999997e-06 2024-09-13T06:43:27.890 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:27.891 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:27.891 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:27.891 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.706952+0000", 2024-09-13T06:43:27.891 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.1106999999999996e-05 2024-09-13T06:43:27.891 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:27.891 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:27.891 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:43:27.891 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.706966+0000", 2024-09-13T06:43:27.891 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4173e-05 2024-09-13T06:43:27.891 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:27.891 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:27.891 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:27.891 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:46.412754+0000", 2024-09-13T06:43:27.891 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.70578759999999996 2024-09-13T06:43:27.892 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:27.892 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:27.892 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:27.892 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:46.412967+0000", 2024-09-13T06:43:27.892 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00021290999999999999 2024-09-13T06:43:27.892 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:27.892 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:27.892 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:27.892 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:46.413176+0000", 2024-09-13T06:43:27.892 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00020922099999999999 2024-09-13T06:43:27.892 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:27.892 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:27.892 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:27.892 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:27.893 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:27.893 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:181739 3.1b 3:dbd5e871:::rbd_data.11218aab7a9c.0000000000000003:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e203)", 2024-09-13T06:43:27.893 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:42:45.706937+0000", 2024-09-13T06:43:27.893 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 42.095073354, 2024-09-13T06:43:27.893 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.70679418800000005, 2024-09-13T06:43:27.893 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:27.893 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:27.893 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:27.893 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:27.893 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:27.893 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 181739 2024-09-13T06:43:27.893 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:27.894 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:27.894 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:27.894 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:27.894 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.706937+0000", 2024-09-13T06:43:27.894 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:27.894 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:27.894 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:27.894 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:27.894 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.706937+0000", 2024-09-13T06:43:27.894 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:27.894 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:27.894 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:27.894 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:27.894 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.706937+0000", 2024-09-13T06:43:27.894 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:27.895 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:27.895 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:27.895 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:27.895 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.706940+0000", 2024-09-13T06:43:27.895 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.4290000000000001e-06 2024-09-13T06:43:27.895 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:27.895 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:27.895 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:27.895 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.706949+0000", 2024-09-13T06:43:27.895 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.7730000000000005e-06 2024-09-13T06:43:27.895 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:27.895 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:27.895 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:27.895 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.706956+0000", 2024-09-13T06:43:27.896 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4240000000000004e-06 2024-09-13T06:43:27.896 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:27.896 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:27.896 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:27.896 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.706999+0000", 2024-09-13T06:43:27.896 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.2410999999999998e-05 2024-09-13T06:43:27.896 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:27.896 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:27.896 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:43:27.896 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.707011+0000", 2024-09-13T06:43:27.896 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2140999999999999e-05 2024-09-13T06:43:27.896 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:27.896 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:27.896 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:27.897 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:46.413278+0000", 2024-09-13T06:43:27.897 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.70626747199999995 2024-09-13T06:43:27.897 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:27.897 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:27.897 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:27.897 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:46.413471+0000", 2024-09-13T06:43:27.897 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00019234699999999999 2024-09-13T06:43:27.897 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:27.897 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:27.897 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:27.897 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:46.413731+0000", 2024-09-13T06:43:27.897 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00026069 2024-09-13T06:43:27.897 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:27.897 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:27.898 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:27.898 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:27.898 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:27.898 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:181753 3.1b 3:dbd5e871:::rbd_data.11218aab7a9c.0000000000000003:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e203)", 2024-09-13T06:43:27.898 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:42:45.706987+0000", 2024-09-13T06:43:27.898 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 42.095023271000002, 2024-09-13T06:43:27.898 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.70721309200000004, 2024-09-13T06:43:27.898 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:27.898 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:27.898 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:27.898 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:27.898 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:27.898 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 181753 2024-09-13T06:43:27.899 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:27.899 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:27.899 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:27.899 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:27.899 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.706987+0000", 2024-09-13T06:43:27.899 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:27.899 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:27.899 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:27.899 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:27.899 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.706987+0000", 2024-09-13T06:43:27.899 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:27.899 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:27.899 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:27.899 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:27.900 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.706987+0000", 2024-09-13T06:43:27.900 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:27.900 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:27.900 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:27.900 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:27.900 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.706990+0000", 2024-09-13T06:43:27.900 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.0759999999999999e-06 2024-09-13T06:43:27.900 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:27.900 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:27.900 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:27.900 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.706997+0000", 2024-09-13T06:43:27.900 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5809999999999999e-06 2024-09-13T06:43:27.900 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:27.901 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:27.901 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:27.901 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.707004+0000", 2024-09-13T06:43:27.901 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.7839999999999998e-06 2024-09-13T06:43:27.901 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:27.901 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:27.901 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:27.901 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.707046+0000", 2024-09-13T06:43:27.901 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.1474999999999998e-05 2024-09-13T06:43:27.901 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:27.901 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:27.901 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:43:27.901 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.707056+0000", 2024-09-13T06:43:27.902 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0825000000000001e-05 2024-09-13T06:43:27.902 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:27.902 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:27.902 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:27.902 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:46.413797+0000", 2024-09-13T06:43:27.902 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.70674101099999997 2024-09-13T06:43:27.902 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:27.902 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:27.902 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:27.902 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:46.413998+0000", 2024-09-13T06:43:27.902 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00020058700000000001 2024-09-13T06:43:27.902 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:27.902 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:27.902 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:27.903 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:46.414200+0000", 2024-09-13T06:43:27.903 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00020238400000000001 2024-09-13T06:43:27.903 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:27.903 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:27.903 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:27.903 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:27.903 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:27.903 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:43:27.905 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-13T06:43:27.905 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:43:27.905+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:43:28.006 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:43:28.003+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:43:28.032 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:43:28.032 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-13T06:43:28.032 INFO:teuthology.orchestra.run.smithi081.stdout: "num_ops": 0 2024-09-13T06:43:28.032 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:43:28.046 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-13T06:43:28.134 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:43:28.135+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:43:28.208 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:43:28.209+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:43:28.213 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:43:28.213 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-13T06:43:28.214 INFO:teuthology.orchestra.run.smithi081.stdout: "complaint_time": 30, 2024-09-13T06:43:28.214 INFO:teuthology.orchestra.run.smithi081.stdout: "num_blocked_ops": 0 2024-09-13T06:43:28.214 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:43:28.228 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-13T06:43:28.314 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:43:28.315+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:43:28.384 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-13T06:43:28.398 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:43:28.398 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 20, 2024-09-13T06:43:28.398 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 600, 2024-09-13T06:43:28.398 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [ 2024-09-13T06:43:28.398 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:28.398 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:90987 3.6 3:6263dd97:::rbd_object_map.11212443ae03.0000000000000049:head [call] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-13T06:43:28.398 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:41:35.460333+0000", 2024-09-13T06:43:28.398 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 112.936490612, 2024-09-13T06:43:28.398 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0001633640000001, 2024-09-13T06:43:28.398 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:28.399 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:28.399 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:28.399 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:28.399 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:28.399 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 90987 2024-09-13T06:43:28.399 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:28.399 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:28.399 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:28.399 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:28.399 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:35.460333+0000", 2024-09-13T06:43:28.399 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:28.399 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:28.399 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:28.399 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:28.400 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:35.460333+0000", 2024-09-13T06:43:28.400 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:28.400 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:28.400 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:28.400 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:28.400 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:35.460330+0000", 2024-09-13T06:43:28.400 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999971 2024-09-13T06:43:28.400 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:28.400 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:28.400 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:28.400 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:35.460343+0000", 2024-09-13T06:43:28.400 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2695e-05 2024-09-13T06:43:28.400 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:28.400 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:28.401 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:28.401 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:35.460365+0000", 2024-09-13T06:43:28.401 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2473999999999999e-05 2024-09-13T06:43:28.401 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:28.401 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:28.401 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:28.401 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:35.460376+0000", 2024-09-13T06:43:28.401 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0383999999999999e-05 2024-09-13T06:43:28.401 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:28.401 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:28.401 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:28.401 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:35.460435+0000", 2024-09-13T06:43:28.401 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8650000000000003e-05 2024-09-13T06:43:28.402 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:28.402 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:28.402 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:43:28.402 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:35.460444+0000", 2024-09-13T06:43:28.402 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.0380000000000005e-06 2024-09-13T06:43:28.402 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:28.402 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:28.402 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:28.402 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:36.459433+0000", 2024-09-13T06:43:28.402 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.99898895799999998 2024-09-13T06:43:28.402 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:28.402 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:28.402 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:28.403 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:36.459622+0000", 2024-09-13T06:43:28.403 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00018940299999999999 2024-09-13T06:43:28.403 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:28.403 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:28.403 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:28.403 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:36.460497+0000", 2024-09-13T06:43:28.403 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00087481199999999999 2024-09-13T06:43:28.403 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:28.403 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:28.403 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:28.403 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:28.403 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:28.403 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:159632 3.a 3:57f62123:::rbd_header.112138ed422:head [create,call rbd.create in=9b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e167)", 2024-09-13T06:43:28.404 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:42:07.853351+0000", 2024-09-13T06:43:28.404 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 80.543472809999997, 2024-09-13T06:43:28.404 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.95572760999999995, 2024-09-13T06:43:28.404 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:28.404 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:43:28.404 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:28.404 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:28.404 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:28.404 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 159632 2024-09-13T06:43:28.404 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:28.404 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:28.404 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:28.404 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:28.404 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:07.853351+0000", 2024-09-13T06:43:28.405 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:28.405 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:28.405 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:28.405 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:28.405 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:07.853351+0000", 2024-09-13T06:43:28.405 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:28.405 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:28.405 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:28.405 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:28.405 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:07.853350+0000", 2024-09-13T06:43:28.405 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.999999 2024-09-13T06:43:28.405 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:28.405 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:28.405 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:28.405 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:07.853356+0000", 2024-09-13T06:43:28.406 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.1560000000000003e-06 2024-09-13T06:43:28.406 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:28.406 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:28.406 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:28.406 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:07.853365+0000", 2024-09-13T06:43:28.406 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.8079999999999999e-06 2024-09-13T06:43:28.406 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:28.406 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:28.406 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:28.406 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:07.853372+0000", 2024-09-13T06:43:28.406 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.5540000000000003e-06 2024-09-13T06:43:28.406 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:28.406 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:28.406 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:28.406 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:07.853430+0000", 2024-09-13T06:43:28.407 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8038000000000002e-05 2024-09-13T06:43:28.407 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:28.407 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:28.407 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:43:28.407 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:07.853444+0000", 2024-09-13T06:43:28.407 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3719e-05 2024-09-13T06:43:28.407 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:28.407 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:28.407 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:28.407 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:08.804052+0000", 2024-09-13T06:43:28.407 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.95060817799999997 2024-09-13T06:43:28.407 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:28.407 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:28.407 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:28.407 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:08.804234+0000", 2024-09-13T06:43:28.408 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00018192999999999999 2024-09-13T06:43:28.408 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:28.408 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:28.408 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 6", 2024-09-13T06:43:28.408 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:08.804797+0000", 2024-09-13T06:43:28.408 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00056282399999999996 2024-09-13T06:43:28.408 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:28.408 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:28.408 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-09-13T06:43:28.408 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:08.805704+0000", 2024-09-13T06:43:28.408 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00090781 2024-09-13T06:43:28.408 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:28.408 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:28.408 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:43:28.409 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:08.808907+0000", 2024-09-13T06:43:28.409 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0032031239999999999 2024-09-13T06:43:28.409 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:28.409 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:28.409 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:43:28.409 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:08.808998+0000", 2024-09-13T06:43:28.409 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.0191000000000004e-05 2024-09-13T06:43:28.409 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:28.409 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:28.409 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:28.409 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:08.809079+0000", 2024-09-13T06:43:28.409 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.1076999999999996e-05 2024-09-13T06:43:28.409 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:28.409 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:28.410 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:28.410 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:28.410 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:28.410 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:209556 3.6 3:673cd4d4:::rbd_data.1121cb4a09ed.0000000000000002:82 [read 831488~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e220)", 2024-09-13T06:43:28.410 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:43:05.152927+0000", 2024-09-13T06:43:28.410 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 23.243896809999999, 2024-09-13T06:43:28.410 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054987033999999997, 2024-09-13T06:43:28.410 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:28.410 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:28.410 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:28.410 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:28.410 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:28.410 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 209556 2024-09-13T06:43:28.410 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:28.410 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:28.411 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:28.411 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:28.411 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.152927+0000", 2024-09-13T06:43:28.411 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:28.411 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:28.411 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:28.411 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:28.411 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.152927+0000", 2024-09-13T06:43:28.411 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:28.411 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:28.411 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:28.411 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:28.411 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.152927+0000", 2024-09-13T06:43:28.412 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:28.412 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:28.412 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:28.412 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:28.412 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.152929+0000", 2024-09-13T06:43:28.412 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.514e-06 2024-09-13T06:43:28.412 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:28.412 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:28.412 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:28.412 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.152935+0000", 2024-09-13T06:43:28.412 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.5249999999999996e-06 2024-09-13T06:43:28.412 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:28.412 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:28.413 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:28.413 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.152939+0000", 2024-09-13T06:43:28.413 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.3209999999999998e-06 2024-09-13T06:43:28.413 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:28.413 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:28.413 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:28.413 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.207752+0000", 2024-09-13T06:43:28.413 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054813273000000003 2024-09-13T06:43:28.413 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:28.413 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:28.413 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:28.414 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.207834+0000", 2024-09-13T06:43:28.414 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.1317999999999996e-05 2024-09-13T06:43:28.414 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:28.414 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:28.414 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:28.414 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.207914+0000", 2024-09-13T06:43:28.414 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.0568000000000005e-05 2024-09-13T06:43:28.414 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:28.414 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:28.414 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:28.414 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:28.414 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:28.414 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:209557 3.6 3:673cd4d4:::rbd_data.1121cb4a09ed.0000000000000002:82 [read 843776~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e220)", 2024-09-13T06:43:28.415 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:43:05.152944+0000", 2024-09-13T06:43:28.415 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 23.243880306000001, 2024-09-13T06:43:28.415 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.055174645000000001, 2024-09-13T06:43:28.415 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:28.415 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:28.415 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:28.415 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:28.415 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:28.415 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 209557 2024-09-13T06:43:28.415 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:28.415 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:28.415 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:28.415 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:28.415 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.152944+0000", 2024-09-13T06:43:28.415 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:28.416 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:28.416 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:28.416 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:28.416 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.152944+0000", 2024-09-13T06:43:28.416 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:28.416 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:28.416 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:28.416 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:28.416 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.152943+0000", 2024-09-13T06:43:28.416 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:28.416 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:28.416 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:28.416 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:28.417 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.152946+0000", 2024-09-13T06:43:28.417 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2419999999999999e-06 2024-09-13T06:43:28.417 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:28.417 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:28.417 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:28.417 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.152951+0000", 2024-09-13T06:43:28.417 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7570000000000001e-06 2024-09-13T06:43:28.417 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:28.417 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:28.417 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:28.417 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.152955+0000", 2024-09-13T06:43:28.417 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.0080000000000004e-06 2024-09-13T06:43:28.417 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:28.418 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:28.418 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:28.418 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.207958+0000", 2024-09-13T06:43:28.418 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.055002896000000003 2024-09-13T06:43:28.418 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:28.418 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:28.418 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:28.418 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.208041+0000", 2024-09-13T06:43:28.418 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.2962999999999998e-05 2024-09-13T06:43:28.418 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:28.418 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:28.418 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:28.418 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.208118+0000", 2024-09-13T06:43:28.418 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.7181000000000005e-05 2024-09-13T06:43:28.419 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:28.419 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:28.419 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:28.419 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:28.419 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:28.419 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:209558 3.6 3:673cd4d4:::rbd_data.1121cb4a09ed.0000000000000002:82 [read 856064~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e220)", 2024-09-13T06:43:28.419 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:43:05.152960+0000", 2024-09-13T06:43:28.419 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 23.243864112000001, 2024-09-13T06:43:28.419 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.055296975999999998, 2024-09-13T06:43:28.419 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:28.419 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:28.419 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:28.419 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:28.420 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:28.420 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 209558 2024-09-13T06:43:28.420 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:28.420 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:28.420 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:28.420 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:28.420 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.152960+0000", 2024-09-13T06:43:28.420 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:28.420 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:28.420 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:28.420 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:28.420 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.152960+0000", 2024-09-13T06:43:28.420 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:28.420 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:28.421 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:28.421 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:28.421 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.152959+0000", 2024-09-13T06:43:28.421 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:28.421 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:28.421 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:28.421 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:28.421 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.152962+0000", 2024-09-13T06:43:28.421 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6709999999999999e-06 2024-09-13T06:43:28.421 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:28.421 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:28.421 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:28.422 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.152968+0000", 2024-09-13T06:43:28.422 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.5589999999999996e-06 2024-09-13T06:43:28.422 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:28.422 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:28.422 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:28.422 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.152972+0000", 2024-09-13T06:43:28.422 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.216e-06 2024-09-13T06:43:28.422 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:28.422 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:28.422 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:28.422 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.208146+0000", 2024-09-13T06:43:28.422 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.055173627000000003 2024-09-13T06:43:28.422 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:28.422 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:28.423 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:28.423 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.208193+0000", 2024-09-13T06:43:28.423 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7200000000000002e-05 2024-09-13T06:43:28.423 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:28.423 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:28.423 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:28.423 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.208257+0000", 2024-09-13T06:43:28.423 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.4058000000000002e-05 2024-09-13T06:43:28.423 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:28.423 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:28.423 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:28.423 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:28.423 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:28.424 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:209559 3.6 3:673cd4d4:::rbd_data.1121cb4a09ed.0000000000000002:82 [read 868352~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e220)", 2024-09-13T06:43:28.424 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:43:05.152976+0000", 2024-09-13T06:43:28.424 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 23.243847999, 2024-09-13T06:43:28.424 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.055514239, 2024-09-13T06:43:28.424 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:28.424 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:28.424 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:28.424 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:28.424 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:28.424 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 209559 2024-09-13T06:43:28.424 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:28.424 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:28.424 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:28.425 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:28.425 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.152976+0000", 2024-09-13T06:43:28.425 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:28.425 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:28.425 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:28.425 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:28.425 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.152976+0000", 2024-09-13T06:43:28.425 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:28.425 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:28.425 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:28.425 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:28.425 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.152976+0000", 2024-09-13T06:43:28.425 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:28.425 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:28.426 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:28.426 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:28.426 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.152978+0000", 2024-09-13T06:43:28.426 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2189999999999998e-06 2024-09-13T06:43:28.426 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:28.426 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:28.426 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:28.426 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.152983+0000", 2024-09-13T06:43:28.426 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3639999999999998e-06 2024-09-13T06:43:28.426 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:28.426 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:28.426 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:28.426 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.152987+0000", 2024-09-13T06:43:28.427 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.9469999999999996e-06 2024-09-13T06:43:28.427 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:28.427 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:28.427 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:28.427 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.208301+0000", 2024-09-13T06:43:28.427 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.055314292000000001 2024-09-13T06:43:28.427 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:28.427 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:28.427 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:28.427 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.208385+0000", 2024-09-13T06:43:28.427 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.3755e-05 2024-09-13T06:43:28.427 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:28.427 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:28.427 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:28.428 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.208490+0000", 2024-09-13T06:43:28.428 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00010498800000000001 2024-09-13T06:43:28.428 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:28.428 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:28.428 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:28.428 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:28.428 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:28.428 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:209560 3.6 3:673cd4d4:::rbd_data.1121cb4a09ed.0000000000000002:82 [read 880640~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e220)", 2024-09-13T06:43:28.428 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:43:05.152991+0000", 2024-09-13T06:43:28.428 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 23.243832909999998, 2024-09-13T06:43:28.428 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.05572912, 2024-09-13T06:43:28.428 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:28.428 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:28.428 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:28.428 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:28.429 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:28.429 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 209560 2024-09-13T06:43:28.429 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:28.429 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:28.429 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:28.429 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:28.429 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.152991+0000", 2024-09-13T06:43:28.429 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:28.429 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:28.429 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:28.429 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:28.429 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.152991+0000", 2024-09-13T06:43:28.429 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:28.429 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:28.430 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:28.430 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:28.430 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.152991+0000", 2024-09-13T06:43:28.430 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:28.430 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:28.430 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:28.430 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:28.430 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.152993+0000", 2024-09-13T06:43:28.430 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3159999999999999e-06 2024-09-13T06:43:28.430 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:28.430 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:28.430 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:28.430 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.152999+0000", 2024-09-13T06:43:28.430 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8529999999999997e-06 2024-09-13T06:43:28.430 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:28.431 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:28.431 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:28.431 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153004+0000", 2024-09-13T06:43:28.431 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6210000000000003e-06 2024-09-13T06:43:28.431 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:28.431 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:28.431 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:28.431 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.208530+0000", 2024-09-13T06:43:28.431 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.055526407999999999 2024-09-13T06:43:28.431 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:28.431 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:28.431 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:28.431 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.208616+0000", 2024-09-13T06:43:28.431 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.6483000000000005e-05 2024-09-13T06:43:28.431 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:28.432 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:28.432 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:28.432 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.208720+0000", 2024-09-13T06:43:28.432 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00010376 2024-09-13T06:43:28.432 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:28.432 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:28.432 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:28.432 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:28.432 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:28.432 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:209561 3.6 3:673cd4d4:::rbd_data.1121cb4a09ed.0000000000000002:82 [read 892928~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e220)", 2024-09-13T06:43:28.432 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:43:05.153008+0000", 2024-09-13T06:43:28.432 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 23.243816016, 2024-09-13T06:43:28.432 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0559225, 2024-09-13T06:43:28.432 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:28.433 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:28.433 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:28.433 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:28.433 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:28.433 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 209561 2024-09-13T06:43:28.433 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:28.433 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:28.433 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:28.433 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:28.433 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153008+0000", 2024-09-13T06:43:28.433 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:28.433 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:28.433 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:28.434 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:28.434 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153008+0000", 2024-09-13T06:43:28.434 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:28.434 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:28.434 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:28.434 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:28.434 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153008+0000", 2024-09-13T06:43:28.434 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:28.434 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:28.434 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:28.434 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:28.434 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153010+0000", 2024-09-13T06:43:28.434 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.8210000000000002e-06 2024-09-13T06:43:28.434 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:28.435 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:28.435 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:28.435 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153016+0000", 2024-09-13T06:43:28.435 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.575e-06 2024-09-13T06:43:28.435 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:28.435 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:28.435 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:28.435 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153020+0000", 2024-09-13T06:43:28.435 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.408e-06 2024-09-13T06:43:28.435 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:28.435 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:28.435 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:28.435 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.208751+0000", 2024-09-13T06:43:28.435 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.055730225000000001 2024-09-13T06:43:28.436 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:28.436 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:28.436 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:28.436 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.208825+0000", 2024-09-13T06:43:28.436 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4548999999999994e-05 2024-09-13T06:43:28.436 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:28.436 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:28.436 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:28.436 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.208930+0000", 2024-09-13T06:43:28.436 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00010529700000000001 2024-09-13T06:43:28.436 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:28.436 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:28.436 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:28.436 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:28.436 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:28.437 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:209562 3.6 3:673cd4d4:::rbd_data.1121cb4a09ed.0000000000000002:82 [read 905216~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e220)", 2024-09-13T06:43:28.437 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:43:05.153024+0000", 2024-09-13T06:43:28.437 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 23.243799589999998, 2024-09-13T06:43:28.437 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.056099906999999997, 2024-09-13T06:43:28.437 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:28.437 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:28.437 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:28.437 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:28.437 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:28.437 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 209562 2024-09-13T06:43:28.437 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:28.437 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:28.437 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:28.438 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:28.438 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153024+0000", 2024-09-13T06:43:28.438 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:28.438 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:28.438 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:28.438 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:28.438 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153024+0000", 2024-09-13T06:43:28.438 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:28.438 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:28.438 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:28.438 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:28.438 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153024+0000", 2024-09-13T06:43:28.438 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:28.438 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:28.439 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:28.439 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:28.439 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153026+0000", 2024-09-13T06:43:28.439 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.165e-06 2024-09-13T06:43:28.439 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:28.439 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:28.439 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:28.439 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153031+0000", 2024-09-13T06:43:28.439 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.1669999999999998e-06 2024-09-13T06:43:28.439 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:28.439 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:28.439 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:28.439 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153035+0000", 2024-09-13T06:43:28.439 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.0799999999999999e-06 2024-09-13T06:43:28.440 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:28.440 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:28.440 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:28.440 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.208956+0000", 2024-09-13T06:43:28.440 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.055920848000000002 2024-09-13T06:43:28.440 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:28.440 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:28.440 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:28.440 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.209032+0000", 2024-09-13T06:43:28.440 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5809999999999994e-05 2024-09-13T06:43:28.440 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:28.440 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:28.440 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:28.440 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.209124+0000", 2024-09-13T06:43:28.441 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.2157999999999994e-05 2024-09-13T06:43:28.441 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:28.441 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:28.441 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:28.441 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:28.441 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:28.441 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:209563 3.6 3:673cd4d4:::rbd_data.1121cb4a09ed.0000000000000002:82 [read 917504~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e220)", 2024-09-13T06:43:28.441 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:43:05.153039+0000", 2024-09-13T06:43:28.441 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 23.243784627, 2024-09-13T06:43:28.441 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.056280030000000002, 2024-09-13T06:43:28.441 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:28.441 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:28.442 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:28.442 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:28.442 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:28.442 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 209563 2024-09-13T06:43:28.442 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:28.442 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:28.442 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:28.442 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:28.442 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153039+0000", 2024-09-13T06:43:28.442 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:28.442 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:28.442 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:28.442 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:28.442 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153039+0000", 2024-09-13T06:43:28.442 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:28.443 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:28.443 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:28.443 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:28.443 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153039+0000", 2024-09-13T06:43:28.443 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:28.443 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:28.443 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:28.443 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:28.443 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153041+0000", 2024-09-13T06:43:28.443 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3800000000000001e-06 2024-09-13T06:43:28.443 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:28.443 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:28.443 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:28.444 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153047+0000", 2024-09-13T06:43:28.444 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2059999999999998e-06 2024-09-13T06:43:28.444 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:28.444 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:28.444 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:28.444 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153051+0000", 2024-09-13T06:43:28.444 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.0980000000000004e-06 2024-09-13T06:43:28.444 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:28.444 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:28.444 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:28.444 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.209150+0000", 2024-09-13T06:43:28.444 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.056099351999999998 2024-09-13T06:43:28.445 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:28.445 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:28.445 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:28.445 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.209226+0000", 2024-09-13T06:43:28.445 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5939999999999995e-05 2024-09-13T06:43:28.445 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:28.445 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:28.445 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:28.445 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.209319+0000", 2024-09-13T06:43:28.445 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.3399000000000005e-05 2024-09-13T06:43:28.445 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:28.445 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:28.446 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:28.446 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:28.446 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:28.446 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:209564 3.6 3:673cd4d4:::rbd_data.1121cb4a09ed.0000000000000002:82 [read 929792~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e220)", 2024-09-13T06:43:28.446 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:43:05.153055+0000", 2024-09-13T06:43:28.446 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 23.243769381, 2024-09-13T06:43:28.446 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.056404468999999999, 2024-09-13T06:43:28.446 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:28.446 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:28.446 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:28.446 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:28.446 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:28.446 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 209564 2024-09-13T06:43:28.446 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:28.447 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:28.447 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:28.447 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:28.447 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153055+0000", 2024-09-13T06:43:28.447 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:28.447 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:28.447 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:28.447 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:28.447 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153055+0000", 2024-09-13T06:43:28.447 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:28.447 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:28.447 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:28.448 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:28.448 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153054+0000", 2024-09-13T06:43:28.448 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:28.448 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:28.448 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:28.448 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:28.448 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153056+0000", 2024-09-13T06:43:28.448 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1600000000000001e-06 2024-09-13T06:43:28.448 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:28.448 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:28.448 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:28.448 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153062+0000", 2024-09-13T06:43:28.448 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2549999999999997e-06 2024-09-13T06:43:28.449 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:28.449 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:28.449 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:28.449 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153066+0000", 2024-09-13T06:43:28.449 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.0400000000000003e-06 2024-09-13T06:43:28.449 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:28.449 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:28.449 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:28.449 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.209342+0000", 2024-09-13T06:43:28.449 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.056276640000000003 2024-09-13T06:43:28.449 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:28.449 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:28.449 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:28.449 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.209382+0000", 2024-09-13T06:43:28.450 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.9626999999999999e-05 2024-09-13T06:43:28.450 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:28.450 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:28.450 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:28.450 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.209459+0000", 2024-09-13T06:43:28.450 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.7072999999999999e-05 2024-09-13T06:43:28.450 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:28.450 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:28.450 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:28.450 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:28.450 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:28.450 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:209565 3.6 3:673cd4d4:::rbd_data.1121cb4a09ed.0000000000000002:82 [read 942080~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e220)", 2024-09-13T06:43:28.450 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:43:05.153070+0000", 2024-09-13T06:43:28.451 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 23.243754408000001, 2024-09-13T06:43:28.451 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.056688545999999999, 2024-09-13T06:43:28.451 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:28.451 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:28.451 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:28.451 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:28.451 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:28.451 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 209565 2024-09-13T06:43:28.451 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:28.451 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:28.451 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:28.451 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:28.451 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153070+0000", 2024-09-13T06:43:28.451 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:28.451 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:28.452 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:28.452 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:28.452 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153070+0000", 2024-09-13T06:43:28.452 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:28.452 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:28.452 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:28.452 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:28.452 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153069+0000", 2024-09-13T06:43:28.452 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:28.452 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:28.452 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:28.453 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:28.453 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153071+0000", 2024-09-13T06:43:28.453 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1780000000000002e-06 2024-09-13T06:43:28.453 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:28.453 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:28.453 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:28.453 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153077+0000", 2024-09-13T06:43:28.453 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3639999999999998e-06 2024-09-13T06:43:28.453 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:28.453 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:28.453 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:28.453 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153081+0000", 2024-09-13T06:43:28.454 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.1640000000000003e-06 2024-09-13T06:43:28.454 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:28.454 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:28.454 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:28.454 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.209486+0000", 2024-09-13T06:43:28.454 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.056405258999999999 2024-09-13T06:43:28.454 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:28.454 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:28.454 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:28.454 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.209560+0000", 2024-09-13T06:43:28.454 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4247999999999998e-05 2024-09-13T06:43:28.454 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:28.454 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:28.455 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:28.455 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.209758+0000", 2024-09-13T06:43:28.455 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000197634 2024-09-13T06:43:28.455 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:28.455 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:28.455 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:28.455 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:28.455 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:28.455 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:209566 3.6 3:673cd4d4:::rbd_data.1121cb4a09ed.0000000000000002:82 [read 954368~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e220)", 2024-09-13T06:43:28.455 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:43:05.153085+0000", 2024-09-13T06:43:28.455 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 23.243739098999999, 2024-09-13T06:43:28.455 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.057070779000000002, 2024-09-13T06:43:28.455 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:28.456 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:28.456 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:28.456 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:28.456 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:28.456 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 209566 2024-09-13T06:43:28.456 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:28.456 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:28.456 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:28.456 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:28.456 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153085+0000", 2024-09-13T06:43:28.456 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:28.456 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:28.457 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:28.457 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:28.457 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153085+0000", 2024-09-13T06:43:28.457 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:28.457 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:28.457 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:28.457 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:28.457 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153085+0000", 2024-09-13T06:43:28.457 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:28.457 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:28.457 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:28.457 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:28.457 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153087+0000", 2024-09-13T06:43:28.458 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1220000000000002e-06 2024-09-13T06:43:28.458 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:28.458 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:28.458 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:28.458 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153092+0000", 2024-09-13T06:43:28.458 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3090000000000003e-06 2024-09-13T06:43:28.458 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:28.458 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:28.458 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:28.458 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153096+0000", 2024-09-13T06:43:28.458 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.1819999999999999e-06 2024-09-13T06:43:28.458 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:28.458 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:28.458 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:28.459 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.209787+0000", 2024-09-13T06:43:28.459 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.056690819000000003 2024-09-13T06:43:28.459 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:28.459 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:28.459 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:28.459 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.209863+0000", 2024-09-13T06:43:28.459 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5551999999999998e-05 2024-09-13T06:43:28.459 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:28.459 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:28.459 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:28.459 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.210156+0000", 2024-09-13T06:43:28.459 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00029310499999999999 2024-09-13T06:43:28.459 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:28.460 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:28.460 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:28.460 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:28.460 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:28.460 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:209567 3.6 3:673cd4d4:::rbd_data.1121cb4a09ed.0000000000000002:82 [read 966656~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e220)", 2024-09-13T06:43:28.460 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:43:05.153100+0000", 2024-09-13T06:43:28.460 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 23.243723725999999, 2024-09-13T06:43:28.460 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.057459567000000003, 2024-09-13T06:43:28.460 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:28.460 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:28.460 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:28.460 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:28.461 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:28.461 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 209567 2024-09-13T06:43:28.461 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:28.461 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:28.461 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:28.461 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:28.461 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153100+0000", 2024-09-13T06:43:28.461 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:28.461 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:28.461 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:28.461 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:28.461 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153100+0000", 2024-09-13T06:43:28.461 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:28.462 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:28.462 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:28.462 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:28.462 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153100+0000", 2024-09-13T06:43:28.462 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:28.462 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:28.462 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:28.462 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:28.462 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153105+0000", 2024-09-13T06:43:28.462 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.5400000000000003e-06 2024-09-13T06:43:28.462 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:28.462 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:28.462 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:28.462 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153111+0000", 2024-09-13T06:43:28.463 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.541e-06 2024-09-13T06:43:28.463 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:28.463 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:28.463 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:28.463 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153115+0000", 2024-09-13T06:43:28.463 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.104e-06 2024-09-13T06:43:28.463 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:28.463 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:28.463 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:28.463 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.210183+0000", 2024-09-13T06:43:28.463 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.057067842000000001 2024-09-13T06:43:28.463 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:28.463 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:28.464 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:28.464 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.210257+0000", 2024-09-13T06:43:28.464 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3726999999999994e-05 2024-09-13T06:43:28.464 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:28.464 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:28.464 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:28.464 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.210560+0000", 2024-09-13T06:43:28.464 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00030318899999999999 2024-09-13T06:43:28.464 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:28.464 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:28.464 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:28.464 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:28.464 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:28.465 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:209568 3.6 3:673cd4d4:::rbd_data.1121cb4a09ed.0000000000000002:82 [read 978944~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e220)", 2024-09-13T06:43:28.465 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:43:05.153119+0000", 2024-09-13T06:43:28.465 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 23.243704525999998, 2024-09-13T06:43:28.465 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.057810786000000003, 2024-09-13T06:43:28.465 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:28.465 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:28.465 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:28.465 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:28.465 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:28.465 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 209568 2024-09-13T06:43:28.465 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:28.465 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:28.466 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:28.466 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:28.466 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153119+0000", 2024-09-13T06:43:28.466 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:28.466 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:28.466 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:28.466 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:28.466 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153119+0000", 2024-09-13T06:43:28.466 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:28.466 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:28.466 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:28.466 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:28.466 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153119+0000", 2024-09-13T06:43:28.467 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:28.467 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:28.467 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:28.467 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:28.467 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153121+0000", 2024-09-13T06:43:28.467 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.21e-06 2024-09-13T06:43:28.467 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:28.467 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:28.467 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:28.467 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153127+0000", 2024-09-13T06:43:28.467 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.4670000000000003e-06 2024-09-13T06:43:28.467 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:28.467 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:28.467 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:28.468 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153131+0000", 2024-09-13T06:43:28.468 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.2629999999999997e-06 2024-09-13T06:43:28.468 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:28.468 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:28.468 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:28.468 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.210587+0000", 2024-09-13T06:43:28.468 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.05745567 2024-09-13T06:43:28.468 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:28.468 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:28.468 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:28.468 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.210660+0000", 2024-09-13T06:43:28.468 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3430000000000007e-05 2024-09-13T06:43:28.468 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:28.469 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:28.469 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:28.469 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.210930+0000", 2024-09-13T06:43:28.469 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000270127 2024-09-13T06:43:28.469 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:28.469 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:28.469 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:28.469 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:28.469 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:28.469 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:209569 3.6 3:673cd4d4:::rbd_data.1121cb4a09ed.0000000000000002:82 [read 991232~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e220)", 2024-09-13T06:43:28.469 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:43:05.153135+0000", 2024-09-13T06:43:28.469 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 23.243689101000001, 2024-09-13T06:43:28.469 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.058283125999999998, 2024-09-13T06:43:28.470 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:28.470 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:28.470 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:28.470 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:28.470 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:28.470 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 209569 2024-09-13T06:43:28.470 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:28.470 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:28.470 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:28.470 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:28.470 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153135+0000", 2024-09-13T06:43:28.470 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:28.471 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:28.471 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:28.471 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:28.471 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153135+0000", 2024-09-13T06:43:28.471 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:28.471 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:28.471 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:28.471 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:28.471 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153135+0000", 2024-09-13T06:43:28.471 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:28.471 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:28.471 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:28.471 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:28.472 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153136+0000", 2024-09-13T06:43:28.472 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9069999999999999e-06 2024-09-13T06:43:28.472 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:28.472 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:28.472 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:28.472 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153142+0000", 2024-09-13T06:43:28.472 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3009999999999997e-06 2024-09-13T06:43:28.472 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:28.472 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:28.472 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:28.472 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153146+0000", 2024-09-13T06:43:28.472 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.442e-06 2024-09-13T06:43:28.473 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:28.473 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:28.473 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:28.473 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.210959+0000", 2024-09-13T06:43:28.473 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.057812456999999998 2024-09-13T06:43:28.473 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:28.473 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:28.473 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:28.473 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.211038+0000", 2024-09-13T06:43:28.473 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.9140999999999993e-05 2024-09-13T06:43:28.473 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:28.473 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:28.474 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:28.474 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.211418+0000", 2024-09-13T06:43:28.474 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00038017500000000001 2024-09-13T06:43:28.474 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:28.474 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:28.474 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:28.474 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:28.474 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:28.474 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:209570 3.6 3:673cd4d4:::rbd_data.1121cb4a09ed.0000000000000002:82 [read 1003520~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e220)", 2024-09-13T06:43:28.474 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:43:05.153151+0000", 2024-09-13T06:43:28.474 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 23.243673218000001, 2024-09-13T06:43:28.474 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.058499886000000001, 2024-09-13T06:43:28.474 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:28.475 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:28.475 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:28.475 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:28.475 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:28.475 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 209570 2024-09-13T06:43:28.475 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:28.475 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:28.475 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:28.475 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:28.475 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153151+0000", 2024-09-13T06:43:28.475 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:28.475 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:28.475 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:28.475 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:28.476 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153151+0000", 2024-09-13T06:43:28.476 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:28.476 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:28.476 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:28.476 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:28.476 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153150+0000", 2024-09-13T06:43:28.476 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:28.476 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:28.476 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:28.476 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:28.476 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153153+0000", 2024-09-13T06:43:28.476 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3630000000000001e-06 2024-09-13T06:43:28.477 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:28.477 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:28.477 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:28.477 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153159+0000", 2024-09-13T06:43:28.477 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3690000000000003e-06 2024-09-13T06:43:28.477 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:28.477 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:28.477 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:28.477 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153164+0000", 2024-09-13T06:43:28.477 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5379999999999996e-06 2024-09-13T06:43:28.477 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:28.477 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:28.477 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:28.477 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.211448+0000", 2024-09-13T06:43:28.478 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.058283926 2024-09-13T06:43:28.478 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:28.478 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:28.478 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:28.478 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.211508+0000", 2024-09-13T06:43:28.478 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0741e-05 2024-09-13T06:43:28.478 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:28.478 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:28.478 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:28.478 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.211651+0000", 2024-09-13T06:43:28.478 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00014232200000000001 2024-09-13T06:43:28.478 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:28.479 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:28.479 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:28.479 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:28.479 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:28.479 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:209571 3.6 3:673cd4d4:::rbd_data.1121cb4a09ed.0000000000000002:82 [read 1015808~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e220)", 2024-09-13T06:43:28.479 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:43:05.153168+0000", 2024-09-13T06:43:28.479 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 23.243655706999999, 2024-09-13T06:43:28.479 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.058709363000000001, 2024-09-13T06:43:28.479 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:28.479 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:28.479 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:28.479 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:28.479 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:28.479 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 209571 2024-09-13T06:43:28.480 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:28.480 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:28.480 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:28.480 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:28.480 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153168+0000", 2024-09-13T06:43:28.480 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:28.480 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:28.480 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:28.480 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:28.480 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153168+0000", 2024-09-13T06:43:28.480 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:28.480 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:28.481 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:28.481 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:28.481 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153168+0000", 2024-09-13T06:43:28.481 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:28.481 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:28.481 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:28.481 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:28.481 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153170+0000", 2024-09-13T06:43:28.481 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4499999999999998e-06 2024-09-13T06:43:28.481 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:28.481 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:28.481 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:28.481 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153176+0000", 2024-09-13T06:43:28.482 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0050000000000001e-06 2024-09-13T06:43:28.482 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:28.482 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:28.482 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:28.482 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153181+0000", 2024-09-13T06:43:28.482 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.267e-06 2024-09-13T06:43:28.482 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:28.482 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:28.482 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:28.482 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.211678+0000", 2024-09-13T06:43:28.482 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.058497751000000001 2024-09-13T06:43:28.482 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:28.482 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:28.482 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:28.483 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.211744+0000", 2024-09-13T06:43:28.483 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.5266999999999997e-05 2024-09-13T06:43:28.483 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:28.483 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:28.483 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:28.483 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.211878+0000", 2024-09-13T06:43:28.483 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00013394500000000001 2024-09-13T06:43:28.483 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:28.483 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:28.483 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:28.483 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:28.483 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:28.483 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:209572 3.6 3:673cd4d4:::rbd_data.1121cb4a09ed.0000000000000002:82 [read 1028096~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e220)", 2024-09-13T06:43:28.483 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:43:05.153185+0000", 2024-09-13T06:43:28.484 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 23.243639311999999, 2024-09-13T06:43:28.484 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.058928534999999997, 2024-09-13T06:43:28.484 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:28.484 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:28.484 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:28.484 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:28.484 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:28.484 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 209572 2024-09-13T06:43:28.484 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:28.484 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:28.484 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:28.484 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:28.485 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153185+0000", 2024-09-13T06:43:28.485 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:28.485 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:28.485 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:28.485 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:28.485 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153185+0000", 2024-09-13T06:43:28.485 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:28.485 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:28.485 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:28.485 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:28.485 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153184+0000", 2024-09-13T06:43:28.485 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:28.485 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:28.486 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:28.486 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:28.486 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153186+0000", 2024-09-13T06:43:28.486 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1040000000000001e-06 2024-09-13T06:43:28.486 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:28.486 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:28.486 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:28.486 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153191+0000", 2024-09-13T06:43:28.486 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0409999999999997e-06 2024-09-13T06:43:28.486 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:28.486 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:28.486 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:28.486 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153196+0000", 2024-09-13T06:43:28.486 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.2200000000000003e-06 2024-09-13T06:43:28.486 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:28.487 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:28.487 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:28.487 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.211906+0000", 2024-09-13T06:43:28.487 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.058709960999999998 2024-09-13T06:43:28.487 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:28.487 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:28.487 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:28.487 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.211977+0000", 2024-09-13T06:43:28.487 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.1080000000000004e-05 2024-09-13T06:43:28.487 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:28.487 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:28.487 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:28.487 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.212113+0000", 2024-09-13T06:43:28.487 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00013644500000000001 2024-09-13T06:43:28.488 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:28.488 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:28.488 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:28.488 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:28.488 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:28.488 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:209573 3.6 3:673cd4d4:::rbd_data.1121cb4a09ed.0000000000000002:82 [read 1040384~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e220)", 2024-09-13T06:43:28.488 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:43:05.153199+0000", 2024-09-13T06:43:28.488 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 23.243624522000001, 2024-09-13T06:43:28.488 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.059182414000000003, 2024-09-13T06:43:28.488 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:28.488 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:28.488 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:28.489 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:28.489 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:28.489 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 209573 2024-09-13T06:43:28.489 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:28.489 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:28.489 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:28.489 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:28.489 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153199+0000", 2024-09-13T06:43:28.489 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:28.489 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:28.489 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:28.489 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:28.489 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153199+0000", 2024-09-13T06:43:28.489 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:28.490 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:28.490 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:28.490 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:28.490 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153199+0000", 2024-09-13T06:43:28.490 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:28.490 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:28.490 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:28.490 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:28.490 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153201+0000", 2024-09-13T06:43:28.490 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0470000000000001e-06 2024-09-13T06:43:28.490 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:28.490 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:28.490 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:28.491 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153207+0000", 2024-09-13T06:43:28.491 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3730000000000001e-06 2024-09-13T06:43:28.491 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:28.491 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:28.491 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:28.492 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153211+0000", 2024-09-13T06:43:28.492 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.053e-06 2024-09-13T06:43:28.492 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:28.492 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:28.492 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:28.492 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.212141+0000", 2024-09-13T06:43:28.492 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.058930064999999997 2024-09-13T06:43:28.492 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:28.493 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:28.493 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:28.493 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.212214+0000", 2024-09-13T06:43:28.493 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3096999999999995e-05 2024-09-13T06:43:28.493 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:28.493 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:28.493 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:28.493 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.212382+0000", 2024-09-13T06:43:28.493 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000168138 2024-09-13T06:43:28.493 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:28.493 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:28.494 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:28.494 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:28.494 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:28.494 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:43:28.494 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-13T06:43:28.496 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-13T06:43:28.496 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:43:28.495+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:43:28.530 INFO:teuthology.orchestra.run.smithi081.stdout:osd.0: {} 2024-09-13T06:43:28.530 INFO:teuthology.orchestra.run.smithi081.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-13T06:43:28.547 INFO:teuthology.orchestra.run.smithi081.stdout:osd.1: {} 2024-09-13T06:43:28.547 INFO:teuthology.orchestra.run.smithi081.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-13T06:43:28.569 INFO:teuthology.orchestra.run.smithi081.stdout:osd.2: {} 2024-09-13T06:43:28.569 INFO:teuthology.orchestra.run.smithi081.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-13T06:43:28.588 INFO:teuthology.orchestra.run.smithi081.stdout:osd.3: {} 2024-09-13T06:43:28.588 INFO:teuthology.orchestra.run.smithi081.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-13T06:43:28.596 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:43:28.595+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:43:28.609 INFO:teuthology.orchestra.run.smithi081.stdout:osd.4: {} 2024-09-13T06:43:28.609 INFO:teuthology.orchestra.run.smithi081.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-13T06:43:28.634 INFO:teuthology.orchestra.run.smithi081.stdout:osd.5: {} 2024-09-13T06:43:28.635 INFO:teuthology.orchestra.run.smithi081.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-13T06:43:28.635 INFO:teuthology.orchestra.run.smithi081.stderr:Error ENXIO: problem getting command descriptions from osd.6 2024-09-13T06:43:28.657 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:43:28.657 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:43:28.658 INFO:teuthology.orchestra.run.smithi081.stdout:osd.7: {} 2024-09-13T06:43:28.659 INFO:teuthology.orchestra.run.smithi081.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-13T06:43:28.662 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-13T06:43:28.663 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-13T06:43:28.678 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-13T06:43:28.722 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:43:28.723+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:43:28.797 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:43:28.795+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:43:28.835 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:43:28.835 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:43:28.848 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-13T06:43:28.934 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:43:28.935+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:43:28.997 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:43:28.997 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:43:29.000 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-13T06:43:29.001+0000 7fa8bb18e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 36790) UID: 0 2024-09-13T06:43:29.011 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-13T06:43:29.100 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:43:29.099+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:43:29.176 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:43:29.176 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:43:29.192 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-13T06:43:29.201 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:43:29.201+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:43:29.302 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-13T06:43:29.301+0000 7fa8bb18e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 36790) UID: 0 2024-09-13T06:43:29.354 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:43:29.354 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:43:29.368 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-13T06:43:29.418 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:43:29.419+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:43:29.488 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:43:29.488 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:43:29.502 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-13T06:43:29.503 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-13T06:43:29.505+0000 7fa8bb18e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 36790) UID: 0 2024-09-13T06:43:29.575 INFO:teuthology.orchestra.run.smithi081.stderr:nodeep-scrub is set 2024-09-13T06:43:29.604 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:43:29.603+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:43:29.644 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:43:29.644 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:43:29.663 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-13T06:43:29.707 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:43:29.709+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:43:29.804 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:43:29.805 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:43:29.805 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:43:29.805+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:43:29.823 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-13T06:43:29.911 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:43:29.913+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:43:29.988 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:43:29.988 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:43:30.003 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-13T06:43:30.048 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-13T06:43:30.049+0000 7fa8bb18e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 36790) UID: 0 2024-09-13T06:43:30.107 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:43:30.109+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:43:30.171 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:43:30.171 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:43:30.186 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-13T06:43:30.209 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:43:30.207+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:43:30.310 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:43:30.311+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:43:30.353 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:43:30.354 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:43:30.368 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-13T06:43:30.411 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:43:30.411+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:43:30.486 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:43:30.486 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:43:30.501 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-13T06:43:30.548 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:43:30.549+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:43:30.613 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:43:30.611+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:43:30.624 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:43:30.624 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:43:30.638 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-13T06:43:30.664 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-13T06:43:30.714 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:43:30.715+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:43:30.815 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:43:30.815+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:43:30.818 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:43:30.818 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:43:30.833 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-13T06:43:30.839 INFO:teuthology.orchestra.run.smithi081.stdout:osd.0: {} 2024-09-13T06:43:30.839 INFO:teuthology.orchestra.run.smithi081.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-13T06:43:30.856 INFO:teuthology.orchestra.run.smithi081.stdout:osd.1: {} 2024-09-13T06:43:30.856 INFO:teuthology.orchestra.run.smithi081.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-13T06:43:30.872 INFO:teuthology.orchestra.run.smithi081.stdout:osd.2: {} 2024-09-13T06:43:30.872 INFO:teuthology.orchestra.run.smithi081.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-13T06:43:30.888 INFO:teuthology.orchestra.run.smithi081.stdout:osd.3: {} 2024-09-13T06:43:30.888 INFO:teuthology.orchestra.run.smithi081.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-13T06:43:30.905 INFO:teuthology.orchestra.run.smithi081.stdout:osd.4: {} 2024-09-13T06:43:30.905 INFO:teuthology.orchestra.run.smithi081.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-13T06:43:30.915 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:43:30.915+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:43:30.924 INFO:teuthology.orchestra.run.smithi081.stdout:osd.5: {} 2024-09-13T06:43:30.925 INFO:teuthology.orchestra.run.smithi081.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-13T06:43:30.925 INFO:teuthology.orchestra.run.smithi081.stderr:Error ENXIO: problem getting command descriptions from osd.6 2024-09-13T06:43:30.942 INFO:teuthology.orchestra.run.smithi081.stdout:osd.7: {} 2024-09-13T06:43:30.942 INFO:teuthology.orchestra.run.smithi081.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-13T06:43:30.946 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-13T06:43:30.946 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-13T06:43:30.958 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:43:30.958 INFO:teuthology.orchestra.run.smithi139.stdout: "size": 20, 2024-09-13T06:43:30.958 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 600, 2024-09-13T06:43:30.958 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [ 2024-09-13T06:43:30.958 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:30.958 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:176089 3.11 3:8b97f15f:::rbd_data.1121a23b99f7.0000000000000000:head [write 0~4194304 [fadvise_sequential+fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e196)", 2024-09-13T06:43:30.959 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:42:36.707298+0000", 2024-09-13T06:43:30.959 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 54.250905545999998, 2024-09-13T06:43:30.959 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.053333426000000003, 2024-09-13T06:43:30.959 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:30.959 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:43:30.959 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:30.959 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:30.959 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:30.959 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 176089 2024-09-13T06:43:30.959 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:30.959 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:30.959 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:30.959 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:30.960 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.707298+0000", 2024-09-13T06:43:30.960 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:30.960 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:30.960 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:30.960 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:30.960 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.707298+0000", 2024-09-13T06:43:30.960 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:30.960 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:30.960 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:30.960 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:30.960 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.707296+0000", 2024-09-13T06:43:30.960 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999976 2024-09-13T06:43:30.960 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:30.961 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:30.961 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:30.961 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.717511+0000", 2024-09-13T06:43:30.961 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.010215218999999999 2024-09-13T06:43:30.961 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:30.961 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:30.961 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:30.961 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.717555+0000", 2024-09-13T06:43:30.962 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.4159000000000002e-05 2024-09-13T06:43:30.962 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:30.962 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:30.962 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:30.962 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.717569+0000", 2024-09-13T06:43:30.962 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3543999999999999e-05 2024-09-13T06:43:30.962 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:30.962 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:30.962 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:30.962 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.717677+0000", 2024-09-13T06:43:30.962 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00010798699999999999 2024-09-13T06:43:30.963 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:30.963 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:30.963 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:30.963 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.717896+0000", 2024-09-13T06:43:30.963 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000219466 2024-09-13T06:43:30.963 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:30.963 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:30.963 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 4", 2024-09-13T06:43:30.963 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.718090+0000", 2024-09-13T06:43:30.963 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00019322799999999999 2024-09-13T06:43:30.963 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:30.963 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:30.963 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:43:30.964 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.751403+0000", 2024-09-13T06:43:30.964 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.033313493 2024-09-13T06:43:30.964 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:30.964 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:30.964 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-13T06:43:30.964 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.760523+0000", 2024-09-13T06:43:30.964 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0091197150000000005 2024-09-13T06:43:30.964 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:30.964 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:30.964 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-13T06:43:30.964 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.760581+0000", 2024-09-13T06:43:30.964 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.8007999999999998e-05 2024-09-13T06:43:30.965 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:30.965 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:30.965 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:30.965 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.760632+0000", 2024-09-13T06:43:30.965 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.1085999999999998e-05 2024-09-13T06:43:30.965 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:30.965 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:30.966 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:30.966 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:30.966 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:30.966 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:176090 3.e 3:77f86bf9:::rbd_data.1121a23b99f7.0000000000000001:head [write 0~4194304 [fadvise_sequential+fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e196)", 2024-09-13T06:43:30.966 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:42:36.717590+0000", 2024-09-13T06:43:30.966 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 54.240614063999999, 2024-09-13T06:43:30.966 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.049445965000000001, 2024-09-13T06:43:30.966 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:30.966 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:43:30.967 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:30.967 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:30.967 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:30.967 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 176090 2024-09-13T06:43:30.967 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:30.967 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:30.967 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:30.967 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:30.967 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.717590+0000", 2024-09-13T06:43:30.967 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:30.967 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:30.967 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:30.967 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:30.968 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.717590+0000", 2024-09-13T06:43:30.968 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:30.968 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:30.968 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:30.968 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:30.968 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.717588+0000", 2024-09-13T06:43:30.968 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999981 2024-09-13T06:43:30.968 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:30.968 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:30.968 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:30.968 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.723934+0000", 2024-09-13T06:43:30.968 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0063462589999999999 2024-09-13T06:43:30.968 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:30.968 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:30.969 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:30.969 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.723960+0000", 2024-09-13T06:43:30.969 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.6251e-05 2024-09-13T06:43:30.969 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:30.969 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:30.969 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:30.969 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.723976+0000", 2024-09-13T06:43:30.969 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5277e-05 2024-09-13T06:43:30.969 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:30.969 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:30.970 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:30.970 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.724154+0000", 2024-09-13T06:43:30.970 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00017814400000000001 2024-09-13T06:43:30.970 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:30.970 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:30.970 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:30.970 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.724534+0000", 2024-09-13T06:43:30.970 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00038054799999999998 2024-09-13T06:43:30.970 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:30.970 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:30.970 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-13T06:43:30.970 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.724926+0000", 2024-09-13T06:43:30.970 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00039199100000000001 2024-09-13T06:43:30.970 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:30.970 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:30.971 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:43:30.971 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.744509+0000", 2024-09-13T06:43:30.971 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.019582977000000001 2024-09-13T06:43:30.971 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:30.971 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:30.971 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-13T06:43:30.971 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.766937+0000", 2024-09-13T06:43:30.971 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.022427765999999998 2024-09-13T06:43:30.971 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:30.971 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:30.971 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-13T06:43:30.971 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.766987+0000", 2024-09-13T06:43:30.971 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.9898000000000002e-05 2024-09-13T06:43:30.972 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:30.972 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:30.972 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:30.972 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.767036+0000", 2024-09-13T06:43:30.972 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.8782000000000002e-05 2024-09-13T06:43:30.972 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:30.972 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:30.972 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:30.972 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:30.972 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:30.972 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:176094 3.f 3:f5ca80c1:::rbd_data.1121a23b99f7.0000000000000004:head [write 0~4194304 [fadvise_sequential+fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e196)", 2024-09-13T06:43:30.972 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:42:36.724239+0000", 2024-09-13T06:43:30.972 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 54.233964964000002, 2024-09-13T06:43:30.973 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.043501235999999999, 2024-09-13T06:43:30.973 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:30.973 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:43:30.973 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:30.973 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:30.973 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:30.973 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 176094 2024-09-13T06:43:30.973 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:30.973 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:30.973 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:30.973 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:30.973 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.724239+0000", 2024-09-13T06:43:30.974 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:30.974 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:30.974 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:30.974 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:30.974 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.724239+0000", 2024-09-13T06:43:30.974 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:30.974 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:30.974 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:30.974 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:30.974 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.724237+0000", 2024-09-13T06:43:30.974 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999981 2024-09-13T06:43:30.974 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:30.974 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:30.975 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:30.975 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.733673+0000", 2024-09-13T06:43:30.975 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0094352700000000008 2024-09-13T06:43:30.975 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:30.975 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:30.975 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:30.975 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.733703+0000", 2024-09-13T06:43:30.975 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.0102000000000001e-05 2024-09-13T06:43:30.975 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:30.975 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:30.975 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:30.976 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.733718+0000", 2024-09-13T06:43:30.976 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5199e-05 2024-09-13T06:43:30.976 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:30.976 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:30.976 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:30.976 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.733780+0000", 2024-09-13T06:43:30.976 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.1691000000000003e-05 2024-09-13T06:43:30.976 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:30.977 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:30.977 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:30.977 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.733928+0000", 2024-09-13T06:43:30.977 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000147987 2024-09-13T06:43:30.977 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:30.977 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:30.977 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 4", 2024-09-13T06:43:30.977 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.734036+0000", 2024-09-13T06:43:30.977 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000108925 2024-09-13T06:43:30.978 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:30.978 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:30.978 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:43:30.978 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.763741+0000", 2024-09-13T06:43:30.978 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.029704151000000002 2024-09-13T06:43:30.978 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:30.978 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:30.978 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-13T06:43:30.978 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.767615+0000", 2024-09-13T06:43:30.978 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0038739120000000002 2024-09-13T06:43:30.979 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:30.979 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:30.979 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-13T06:43:30.979 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.767693+0000", 2024-09-13T06:43:30.979 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.8573999999999997e-05 2024-09-13T06:43:30.979 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:30.979 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:30.979 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:30.979 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.767740+0000", 2024-09-13T06:43:30.979 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.7154000000000003e-05 2024-09-13T06:43:30.979 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:30.979 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:30.979 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:30.980 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:30.980 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:30.980 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:205233 3.15 3:a97b2891:::rbd_data.11213650bb32.000000000000002e:head [set-alloc-hint object_size 4194304 write_size 4194304,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e209)", 2024-09-13T06:43:30.980 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:42:52.282586+0000", 2024-09-13T06:43:30.980 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 38.675618120000003, 2024-09-13T06:43:30.980 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.056996628000000001, 2024-09-13T06:43:30.980 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:30.980 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:43:30.980 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:30.980 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:30.980 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:30.980 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 205233 2024-09-13T06:43:30.980 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:30.981 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:30.981 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:30.981 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:30.981 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:52.282586+0000", 2024-09-13T06:43:30.981 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:30.981 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:30.981 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:30.981 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:30.981 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:52.282586+0000", 2024-09-13T06:43:30.981 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:30.981 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:30.981 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:30.981 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:30.982 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:52.282583+0000", 2024-09-13T06:43:30.982 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999976 2024-09-13T06:43:30.982 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:30.982 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:30.982 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:30.982 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:52.282599+0000", 2024-09-13T06:43:30.982 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5065999999999999e-05 2024-09-13T06:43:30.982 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:30.982 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:30.982 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:30.982 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:52.282632+0000", 2024-09-13T06:43:30.983 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.3386999999999997e-05 2024-09-13T06:43:30.983 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:30.983 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:30.983 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:30.983 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:52.282654+0000", 2024-09-13T06:43:30.983 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.177e-05 2024-09-13T06:43:30.983 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:30.983 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:30.983 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:30.983 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:52.282753+0000", 2024-09-13T06:43:30.983 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.9685000000000005e-05 2024-09-13T06:43:30.983 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:30.983 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:30.983 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:30.984 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:52.283000+0000", 2024-09-13T06:43:30.984 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000246278 2024-09-13T06:43:30.984 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:30.984 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:30.984 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 3", 2024-09-13T06:43:30.984 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:52.292656+0000", 2024-09-13T06:43:30.984 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0096565980000000006 2024-09-13T06:43:30.984 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:30.984 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:30.984 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:43:30.984 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:52.339352+0000", 2024-09-13T06:43:30.984 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.046695309999999997 2024-09-13T06:43:30.984 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:30.985 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:30.985 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-13T06:43:30.985 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:52.339373+0000", 2024-09-13T06:43:30.985 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.1002999999999999e-05 2024-09-13T06:43:30.985 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:30.985 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:30.985 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-13T06:43:30.985 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:52.339464+0000", 2024-09-13T06:43:30.985 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.1131999999999994e-05 2024-09-13T06:43:30.985 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:30.985 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:30.985 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:30.986 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:52.339582+0000", 2024-09-13T06:43:30.986 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000118799 2024-09-13T06:43:30.986 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:30.986 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:30.986 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:30.986 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:30.986 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:30.986 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:237445 3.15 3:abdd9d42:::rbd_data.1121cb4a09ed.0000000000000008:82 [read 69632~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e224)", 2024-09-13T06:43:30.986 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:43:08.800334+0000", 2024-09-13T06:43:30.986 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 22.157869712, 2024-09-13T06:43:30.986 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.032345681000000001, 2024-09-13T06:43:30.986 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:30.986 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:30.987 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:30.987 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:30.987 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:30.987 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 237445 2024-09-13T06:43:30.987 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:30.987 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:30.987 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:30.987 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:30.987 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800334+0000", 2024-09-13T06:43:30.987 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:30.987 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:30.987 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:30.988 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:30.988 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800334+0000", 2024-09-13T06:43:30.988 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:30.988 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:30.988 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:30.988 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:30.988 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800334+0000", 2024-09-13T06:43:30.988 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:30.988 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:30.988 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:30.988 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:30.988 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800338+0000", 2024-09-13T06:43:30.989 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.9539999999999998e-06 2024-09-13T06:43:30.989 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:30.989 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:30.989 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:30.989 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800342+0000", 2024-09-13T06:43:30.989 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.7249999999999999e-06 2024-09-13T06:43:30.989 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:30.989 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:30.989 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:30.989 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800345+0000", 2024-09-13T06:43:30.989 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.072e-06 2024-09-13T06:43:30.989 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:30.989 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:30.990 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:30.990 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.832482+0000", 2024-09-13T06:43:30.990 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.032137713999999998 2024-09-13T06:43:30.990 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:30.990 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:30.990 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:30.990 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.832571+0000", 2024-09-13T06:43:30.990 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.8252999999999997e-05 2024-09-13T06:43:30.990 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:30.990 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:30.990 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:30.990 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.832680+0000", 2024-09-13T06:43:30.991 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000109214 2024-09-13T06:43:30.991 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:30.991 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:30.991 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:30.991 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:30.991 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:30.991 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:237446 3.15 3:abdd9d42:::rbd_data.1121cb4a09ed.0000000000000008:82 [read 81920~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e224)", 2024-09-13T06:43:30.991 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:43:08.800348+0000", 2024-09-13T06:43:30.991 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 22.157856312, 2024-09-13T06:43:30.991 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.032454446999999997, 2024-09-13T06:43:30.991 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:30.991 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:30.991 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:30.991 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:30.992 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:30.992 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 237446 2024-09-13T06:43:30.992 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:30.992 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:30.992 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:30.992 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:30.992 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800348+0000", 2024-09-13T06:43:30.992 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:30.992 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:30.992 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:30.992 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:30.992 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800348+0000", 2024-09-13T06:43:30.993 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:30.993 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:30.993 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:30.993 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:30.993 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800347+0000", 2024-09-13T06:43:30.993 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:30.993 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:30.993 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:30.993 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:30.993 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800349+0000", 2024-09-13T06:43:30.993 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.452e-06 2024-09-13T06:43:30.993 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:30.994 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:30.994 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:30.994 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800354+0000", 2024-09-13T06:43:30.994 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.0350000000000001e-06 2024-09-13T06:43:30.994 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:30.994 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:30.994 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:30.994 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800357+0000", 2024-09-13T06:43:30.994 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.179e-06 2024-09-13T06:43:30.994 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:30.994 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:30.994 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:30.995 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.832707+0000", 2024-09-13T06:43:30.995 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.032350071000000001 2024-09-13T06:43:30.995 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:30.995 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:30.995 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:30.995 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.832748+0000", 2024-09-13T06:43:30.995 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0587000000000003e-05 2024-09-13T06:43:30.995 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:30.995 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:30.995 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:30.995 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.832802+0000", 2024-09-13T06:43:30.995 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.4429999999999999e-05 2024-09-13T06:43:30.996 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:30.996 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:30.996 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:30.996 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:30.996 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:30.996 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:237447 3.15 3:abdd9d42:::rbd_data.1121cb4a09ed.0000000000000008:82 [read 94208~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e224)", 2024-09-13T06:43:30.996 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:43:08.800360+0000", 2024-09-13T06:43:30.996 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 22.157844399999998, 2024-09-13T06:43:30.996 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.032679798000000003, 2024-09-13T06:43:30.996 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:30.996 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:30.996 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:30.997 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:30.997 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:30.997 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 237447 2024-09-13T06:43:30.997 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:30.997 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:30.997 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:30.997 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:30.997 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800360+0000", 2024-09-13T06:43:30.997 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:30.997 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:30.997 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:30.997 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:30.997 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800360+0000", 2024-09-13T06:43:30.997 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:30.998 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:30.998 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:30.998 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:30.998 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800359+0000", 2024-09-13T06:43:30.998 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:30.998 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:30.998 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:30.998 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:30.998 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800361+0000", 2024-09-13T06:43:30.998 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.463e-06 2024-09-13T06:43:30.998 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:30.998 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:30.998 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:30.998 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800364+0000", 2024-09-13T06:43:30.999 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.6279999999999998e-06 2024-09-13T06:43:30.999 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:30.999 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:30.999 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:30.999 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800367+0000", 2024-09-13T06:43:30.999 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.7259999999999998e-06 2024-09-13T06:43:30.999 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:30.999 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:30.999 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:30.999 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.832841+0000", 2024-09-13T06:43:30.999 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.032474115999999997 2024-09-13T06:43:30.999 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:30.999 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:30.999 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:31.000 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.832929+0000", 2024-09-13T06:43:31.000 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.7886000000000005e-05 2024-09-13T06:43:31.000 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:31.000 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:31.000 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:31.000 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.833039+0000", 2024-09-13T06:43:31.000 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00011024200000000001 2024-09-13T06:43:31.000 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:31.000 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:31.000 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:31.000 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:31.000 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:31.000 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:237448 3.15 3:abdd9d42:::rbd_data.1121cb4a09ed.0000000000000008:82 [read 106496~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e224)", 2024-09-13T06:43:31.000 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:43:08.800371+0000", 2024-09-13T06:43:31.000 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 22.157833261, 2024-09-13T06:43:31.001 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.032794221999999998, 2024-09-13T06:43:31.001 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:31.001 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:31.001 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:31.001 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:31.001 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:31.001 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 237448 2024-09-13T06:43:31.001 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:31.001 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:31.001 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:31.001 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:31.001 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800371+0000", 2024-09-13T06:43:31.001 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:31.002 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:31.002 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:31.002 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:31.002 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800371+0000", 2024-09-13T06:43:31.002 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:31.002 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:31.002 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:31.002 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:31.002 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800370+0000", 2024-09-13T06:43:31.002 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967296 2024-09-13T06:43:31.002 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:31.002 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:31.003 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:31.003 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800372+0000", 2024-09-13T06:43:31.003 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3510000000000001e-06 2024-09-13T06:43:31.003 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:31.003 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:31.003 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:31.003 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800376+0000", 2024-09-13T06:43:31.003 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.693e-06 2024-09-13T06:43:31.003 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:31.003 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:31.003 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:31.003 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800378+0000", 2024-09-13T06:43:31.004 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.8870000000000001e-06 2024-09-13T06:43:31.004 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:31.004 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:31.004 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:31.004 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.833069+0000", 2024-09-13T06:43:31.004 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.032690708999999998 2024-09-13T06:43:31.004 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:31.004 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:31.004 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:31.004 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.833110+0000", 2024-09-13T06:43:31.004 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.1356999999999997e-05 2024-09-13T06:43:31.004 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:31.004 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:31.005 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:31.005 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.833165+0000", 2024-09-13T06:43:31.005 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.4456999999999997e-05 2024-09-13T06:43:31.005 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:31.005 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:31.005 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:31.005 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:31.005 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:31.005 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:237449 3.15 3:abdd9d42:::rbd_data.1121cb4a09ed.0000000000000008:82 [read 118784~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e224)", 2024-09-13T06:43:31.006 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:43:08.800381+0000", 2024-09-13T06:43:31.006 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 22.157823119, 2024-09-13T06:43:31.006 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.033007068000000001, 2024-09-13T06:43:31.006 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:31.006 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:31.006 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:31.006 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:31.006 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:31.006 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 237449 2024-09-13T06:43:31.006 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:31.006 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:31.006 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:31.006 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:31.006 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800381+0000", 2024-09-13T06:43:31.007 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:31.007 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:31.007 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:31.007 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:31.007 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800381+0000", 2024-09-13T06:43:31.007 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:31.007 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:31.007 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:31.007 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:31.007 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800381+0000", 2024-09-13T06:43:31.007 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967296 2024-09-13T06:43:31.007 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:31.007 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:31.007 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:31.008 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800382+0000", 2024-09-13T06:43:31.008 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.395e-06 2024-09-13T06:43:31.008 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:31.008 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:31.008 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:31.008 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800386+0000", 2024-09-13T06:43:31.008 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.574e-06 2024-09-13T06:43:31.008 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:31.008 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:31.008 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:31.008 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800388+0000", 2024-09-13T06:43:31.008 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.8729999999999999e-06 2024-09-13T06:43:31.008 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:31.008 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:31.008 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:31.009 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.833204+0000", 2024-09-13T06:43:31.009 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.032815986999999998 2024-09-13T06:43:31.009 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:31.009 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:31.009 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:31.009 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.833289+0000", 2024-09-13T06:43:31.009 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.4085999999999994e-05 2024-09-13T06:43:31.009 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:31.009 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:31.009 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:31.009 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.833388+0000", 2024-09-13T06:43:31.009 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.9380000000000001e-05 2024-09-13T06:43:31.009 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:31.010 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:31.010 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:31.010 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:31.010 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:31.010 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:237450 3.15 3:abdd9d42:::rbd_data.1121cb4a09ed.0000000000000008:82 [read 131072~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e224)", 2024-09-13T06:43:31.010 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:43:08.800392+0000", 2024-09-13T06:43:31.010 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 22.157811791, 2024-09-13T06:43:31.010 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.033110507999999997, 2024-09-13T06:43:31.010 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:31.010 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:31.010 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:31.010 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:31.010 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:31.010 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 237450 2024-09-13T06:43:31.011 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:31.011 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:31.011 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:31.011 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:31.011 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800392+0000", 2024-09-13T06:43:31.011 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:31.011 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:31.011 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:31.011 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:31.011 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800392+0000", 2024-09-13T06:43:31.011 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:31.011 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:31.012 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:31.012 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:31.012 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800392+0000", 2024-09-13T06:43:31.012 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967296 2024-09-13T06:43:31.012 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:31.012 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:31.012 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:31.012 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800393+0000", 2024-09-13T06:43:31.012 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.375e-06 2024-09-13T06:43:31.012 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:31.012 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:31.012 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:31.012 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800397+0000", 2024-09-13T06:43:31.013 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.6109999999999998e-06 2024-09-13T06:43:31.013 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:31.013 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:31.013 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:31.013 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800400+0000", 2024-09-13T06:43:31.013 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.7580000000000001e-06 2024-09-13T06:43:31.013 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:31.013 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:31.013 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:31.013 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.833414+0000", 2024-09-13T06:43:31.013 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.033014767 2024-09-13T06:43:31.013 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:31.013 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:31.014 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:31.014 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.833453+0000", 2024-09-13T06:43:31.014 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.8711000000000003e-05 2024-09-13T06:43:31.014 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:31.014 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:31.014 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:31.014 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.833503+0000", 2024-09-13T06:43:31.014 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.9523e-05 2024-09-13T06:43:31.014 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:31.014 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:31.014 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:31.014 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:31.014 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:31.015 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:237451 3.15 3:abdd9d42:::rbd_data.1121cb4a09ed.0000000000000008:82 [read 143360~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e224)", 2024-09-13T06:43:31.015 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:43:08.800402+0000", 2024-09-13T06:43:31.015 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 22.157801973000002, 2024-09-13T06:43:31.015 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.033337717000000003, 2024-09-13T06:43:31.015 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:31.015 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:31.015 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:31.015 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:31.015 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:31.015 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 237451 2024-09-13T06:43:31.015 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:31.015 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:31.015 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:31.016 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:31.016 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800402+0000", 2024-09-13T06:43:31.016 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:31.016 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:31.016 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:31.016 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:31.016 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800402+0000", 2024-09-13T06:43:31.016 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:31.016 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:31.016 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:31.016 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:31.017 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800402+0000", 2024-09-13T06:43:31.017 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967296 2024-09-13T06:43:31.017 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:31.017 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:31.017 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:31.017 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800403+0000", 2024-09-13T06:43:31.017 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.37e-06 2024-09-13T06:43:31.017 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:31.017 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:31.017 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:31.017 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800407+0000", 2024-09-13T06:43:31.017 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.6820000000000001e-06 2024-09-13T06:43:31.017 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:31.018 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:31.018 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:31.018 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800410+0000", 2024-09-13T06:43:31.018 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.7810000000000001e-06 2024-09-13T06:43:31.018 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:31.018 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:31.018 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:31.018 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.833550+0000", 2024-09-13T06:43:31.018 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.033140192999999998 2024-09-13T06:43:31.018 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:31.018 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:31.018 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:31.018 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.833634+0000", 2024-09-13T06:43:31.018 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.4097000000000005e-05 2024-09-13T06:43:31.019 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:31.019 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:31.019 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:31.019 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.833740+0000", 2024-09-13T06:43:31.019 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00010582300000000001 2024-09-13T06:43:31.019 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:31.019 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:31.019 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:31.019 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:31.019 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:31.019 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:237452 3.15 3:abdd9d42:::rbd_data.1121cb4a09ed.0000000000000008:82 [read 155648~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e224)", 2024-09-13T06:43:31.019 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:43:08.800412+0000", 2024-09-13T06:43:31.019 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 22.157792016999998, 2024-09-13T06:43:31.020 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.033496535000000001, 2024-09-13T06:43:31.020 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:31.020 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:31.020 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:31.020 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:31.020 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:31.020 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 237452 2024-09-13T06:43:31.020 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:31.020 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:31.020 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:31.020 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:31.020 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800412+0000", 2024-09-13T06:43:31.020 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:31.021 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:31.021 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:31.021 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:31.021 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800412+0000", 2024-09-13T06:43:31.021 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:31.021 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:31.021 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:31.021 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:31.021 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800412+0000", 2024-09-13T06:43:31.021 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967296 2024-09-13T06:43:31.021 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:31.021 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:31.021 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:31.022 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800413+0000", 2024-09-13T06:43:31.022 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.342e-06 2024-09-13T06:43:31.022 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:31.022 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:31.022 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:31.022 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800417+0000", 2024-09-13T06:43:31.022 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.6480000000000001e-06 2024-09-13T06:43:31.022 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:31.022 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:31.022 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:31.022 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800419+0000", 2024-09-13T06:43:31.022 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.7920000000000001e-06 2024-09-13T06:43:31.023 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:31.023 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:31.023 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:31.023 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.833768+0000", 2024-09-13T06:43:31.023 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.033348587999999998 2024-09-13T06:43:31.023 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:31.023 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:31.023 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:31.023 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.833836+0000", 2024-09-13T06:43:31.023 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.8090999999999996e-05 2024-09-13T06:43:31.023 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:31.023 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:31.024 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:31.024 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.833908+0000", 2024-09-13T06:43:31.024 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.2311999999999995e-05 2024-09-13T06:43:31.024 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:31.024 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:31.024 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:31.024 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:31.024 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:31.024 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:237453 3.15 3:abdd9d42:::rbd_data.1121cb4a09ed.0000000000000008:82 [read 167936~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e224)", 2024-09-13T06:43:31.024 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:43:08.800422+0000", 2024-09-13T06:43:31.024 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 22.157781946, 2024-09-13T06:43:31.025 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.033735223000000002, 2024-09-13T06:43:31.025 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:31.025 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:31.025 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:31.025 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:31.025 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:31.025 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 237453 2024-09-13T06:43:31.025 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:31.025 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:31.025 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:31.025 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:31.025 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800422+0000", 2024-09-13T06:43:31.025 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:31.026 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:31.026 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:31.026 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:31.026 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800422+0000", 2024-09-13T06:43:31.026 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:31.026 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:31.026 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:31.026 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:31.026 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800422+0000", 2024-09-13T06:43:31.026 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967296 2024-09-13T06:43:31.026 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:31.026 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:31.026 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:31.026 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800423+0000", 2024-09-13T06:43:31.027 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3489999999999999e-06 2024-09-13T06:43:31.027 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:31.027 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:31.027 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:31.027 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800427+0000", 2024-09-13T06:43:31.027 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.6610000000000002e-06 2024-09-13T06:43:31.027 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:31.027 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:31.027 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:31.027 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800430+0000", 2024-09-13T06:43:31.027 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.9869999999999999e-06 2024-09-13T06:43:31.028 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:31.028 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:31.028 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:31.028 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.833958+0000", 2024-09-13T06:43:31.028 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.033528020999999998 2024-09-13T06:43:31.028 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:31.028 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:31.028 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:31.028 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.834047+0000", 2024-09-13T06:43:31.028 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.9492000000000003e-05 2024-09-13T06:43:31.028 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:31.028 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:31.028 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:31.028 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.834157+0000", 2024-09-13T06:43:31.029 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000109948 2024-09-13T06:43:31.029 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:31.029 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:31.029 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:31.029 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:31.029 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:31.029 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:237454 3.15 3:abdd9d42:::rbd_data.1121cb4a09ed.0000000000000008:82 [read 180224~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e224)", 2024-09-13T06:43:31.029 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:43:08.800432+0000", 2024-09-13T06:43:31.029 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 22.157771739000001, 2024-09-13T06:43:31.029 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.033853883000000001, 2024-09-13T06:43:31.029 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:31.029 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:31.030 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:31.030 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:31.030 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:31.030 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 237454 2024-09-13T06:43:31.030 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:31.030 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:31.030 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:31.030 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:31.030 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800432+0000", 2024-09-13T06:43:31.030 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:31.030 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:31.030 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:31.030 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:31.031 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800432+0000", 2024-09-13T06:43:31.031 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:31.031 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:31.031 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:31.031 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:31.031 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800432+0000", 2024-09-13T06:43:31.031 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:31.031 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:31.031 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:31.031 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:31.031 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800433+0000", 2024-09-13T06:43:31.031 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3379999999999999e-06 2024-09-13T06:43:31.031 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:31.031 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:31.031 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:31.032 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800437+0000", 2024-09-13T06:43:31.032 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.1679999999999997e-06 2024-09-13T06:43:31.032 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:31.032 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:31.032 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:31.032 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800440+0000", 2024-09-13T06:43:31.032 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.8830000000000002e-06 2024-09-13T06:43:31.032 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:31.032 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:31.032 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:31.032 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.834187+0000", 2024-09-13T06:43:31.032 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.033746532000000003 2024-09-13T06:43:31.032 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:31.032 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:31.033 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:31.033 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.834228+0000", 2024-09-13T06:43:31.033 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.087e-05 2024-09-13T06:43:31.033 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:31.033 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:31.033 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:31.033 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.834286+0000", 2024-09-13T06:43:31.033 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.8331000000000001e-05 2024-09-13T06:43:31.033 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:31.033 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:31.033 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:31.033 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:31.033 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:31.033 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:237455 3.15 3:abdd9d42:::rbd_data.1121cb4a09ed.0000000000000008:82 [read 192512~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e224)", 2024-09-13T06:43:31.034 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:43:08.800443+0000", 2024-09-13T06:43:31.034 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 22.157761266000001, 2024-09-13T06:43:31.034 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.034083294, 2024-09-13T06:43:31.034 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:31.034 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:31.034 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:31.034 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:31.034 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:31.034 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 237455 2024-09-13T06:43:31.034 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:31.034 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:31.034 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:31.034 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:31.034 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800443+0000", 2024-09-13T06:43:31.035 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:31.035 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:31.035 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:31.035 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:31.035 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800443+0000", 2024-09-13T06:43:31.035 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:31.035 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:31.035 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:31.035 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:31.035 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800442+0000", 2024-09-13T06:43:31.035 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967296 2024-09-13T06:43:31.035 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:31.035 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:31.035 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:31.036 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800444+0000", 2024-09-13T06:43:31.036 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.443e-06 2024-09-13T06:43:31.036 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:31.036 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:31.036 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:31.036 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800448+0000", 2024-09-13T06:43:31.036 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.6770000000000001e-06 2024-09-13T06:43:31.036 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:31.036 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:31.036 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:31.036 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800451+0000", 2024-09-13T06:43:31.036 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.0920000000000002e-06 2024-09-13T06:43:31.036 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:31.036 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:31.037 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:31.037 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.834323+0000", 2024-09-13T06:43:31.037 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.033872145999999999 2024-09-13T06:43:31.037 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:31.037 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:31.037 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:31.037 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.834420+0000", 2024-09-13T06:43:31.037 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6898999999999995e-05 2024-09-13T06:43:31.037 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:31.037 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:31.037 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:31.037 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.834526+0000", 2024-09-13T06:43:31.038 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000106272 2024-09-13T06:43:31.038 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:31.038 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:31.038 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:31.038 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:31.038 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:31.038 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:237456 3.15 3:abdd9d42:::rbd_data.1121cb4a09ed.0000000000000008:82 [read 204800~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e224)", 2024-09-13T06:43:31.038 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:43:08.800453+0000", 2024-09-13T06:43:31.038 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 22.157751054999999, 2024-09-13T06:43:31.038 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.034198615000000002, 2024-09-13T06:43:31.038 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:31.038 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:31.038 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:31.039 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:31.039 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:31.039 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 237456 2024-09-13T06:43:31.039 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:31.039 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:31.039 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:31.039 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:31.039 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800453+0000", 2024-09-13T06:43:31.039 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:31.039 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:31.039 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:31.039 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:31.039 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800453+0000", 2024-09-13T06:43:31.039 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:31.040 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:31.040 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:31.040 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:31.040 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800453+0000", 2024-09-13T06:43:31.040 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967296 2024-09-13T06:43:31.040 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:31.040 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:31.040 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:31.040 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800454+0000", 2024-09-13T06:43:31.040 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.361e-06 2024-09-13T06:43:31.040 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:31.040 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:31.040 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:31.040 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800458+0000", 2024-09-13T06:43:31.041 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.7189999999999999e-06 2024-09-13T06:43:31.041 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:31.041 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:31.041 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:31.041 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800461+0000", 2024-09-13T06:43:31.041 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.7599999999999998e-06 2024-09-13T06:43:31.041 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:31.041 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:31.041 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:31.041 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.834555+0000", 2024-09-13T06:43:31.041 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.034094192000000002 2024-09-13T06:43:31.041 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:31.041 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:31.041 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:31.042 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.834597+0000", 2024-09-13T06:43:31.042 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.2157000000000003e-05 2024-09-13T06:43:31.042 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:31.042 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:31.042 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:31.042 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.834652+0000", 2024-09-13T06:43:31.042 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.4660999999999997e-05 2024-09-13T06:43:31.042 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:31.042 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:31.042 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:31.042 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:31.042 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:31.042 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:237457 3.15 3:abdd9d42:::rbd_data.1121cb4a09ed.0000000000000008:82 [read 217088~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e224)", 2024-09-13T06:43:31.043 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:43:08.800463+0000", 2024-09-13T06:43:31.043 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 22.157741108, 2024-09-13T06:43:31.043 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.034419130999999999, 2024-09-13T06:43:31.043 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:31.043 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:31.043 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:31.043 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:31.043 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:31.043 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 237457 2024-09-13T06:43:31.043 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:31.044 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:31.044 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:31.044 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:31.044 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800463+0000", 2024-09-13T06:43:31.044 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:31.044 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:31.044 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:31.044 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:31.044 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800463+0000", 2024-09-13T06:43:31.044 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:31.044 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:31.044 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:31.044 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:31.045 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800463+0000", 2024-09-13T06:43:31.045 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967296 2024-09-13T06:43:31.045 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:31.045 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:31.045 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:31.045 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800466+0000", 2024-09-13T06:43:31.045 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.8240000000000001e-06 2024-09-13T06:43:31.045 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:31.045 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:31.045 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:31.045 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800470+0000", 2024-09-13T06:43:31.045 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.7579999999999998e-06 2024-09-13T06:43:31.045 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:31.046 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:31.046 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:31.046 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800473+0000", 2024-09-13T06:43:31.046 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.875e-06 2024-09-13T06:43:31.046 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:31.046 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:31.046 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:31.046 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.834688+0000", 2024-09-13T06:43:31.046 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.034215039000000003 2024-09-13T06:43:31.046 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:31.046 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:31.046 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:31.046 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.834772+0000", 2024-09-13T06:43:31.046 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.3870999999999997e-05 2024-09-13T06:43:31.047 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:31.047 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:31.047 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:31.047 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.834882+0000", 2024-09-13T06:43:31.047 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00011 2024-09-13T06:43:31.047 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:31.047 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:31.047 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:31.047 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:31.047 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:31.047 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:237458 3.15 3:abdd9d42:::rbd_data.1121cb4a09ed.0000000000000008:82 [read 229376~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e224)", 2024-09-13T06:43:31.047 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:43:08.800476+0000", 2024-09-13T06:43:31.047 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 22.15772836, 2024-09-13T06:43:31.048 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.034538358999999998, 2024-09-13T06:43:31.048 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:31.048 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:31.048 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:31.048 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:31.048 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:31.048 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 237458 2024-09-13T06:43:31.048 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:31.048 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:31.048 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:31.048 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:31.048 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800476+0000", 2024-09-13T06:43:31.049 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:31.049 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:31.049 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:31.049 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:31.049 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800476+0000", 2024-09-13T06:43:31.049 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:31.049 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:31.049 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:31.049 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:31.049 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800475+0000", 2024-09-13T06:43:31.049 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:31.050 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:31.050 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:31.050 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:31.050 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800477+0000", 2024-09-13T06:43:31.050 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.367e-06 2024-09-13T06:43:31.050 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:31.050 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:31.050 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:31.050 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800480+0000", 2024-09-13T06:43:31.050 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.7179999999999998e-06 2024-09-13T06:43:31.050 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:31.050 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:31.050 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:31.051 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800483+0000", 2024-09-13T06:43:31.051 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.807e-06 2024-09-13T06:43:31.051 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:31.051 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:31.051 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:31.051 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.834922+0000", 2024-09-13T06:43:31.051 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.034438261999999997 2024-09-13T06:43:31.051 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:31.051 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:31.051 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:31.051 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.834962+0000", 2024-09-13T06:43:31.051 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0287999999999998e-05 2024-09-13T06:43:31.051 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:31.052 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:31.052 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:31.052 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.835014+0000", 2024-09-13T06:43:31.052 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.2172999999999997e-05 2024-09-13T06:43:31.052 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:31.052 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:31.052 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:31.052 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:31.052 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:31.052 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:237459 3.15 3:abdd9d42:::rbd_data.1121cb4a09ed.0000000000000008:82 [read 241664~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e224)", 2024-09-13T06:43:31.052 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:43:08.800486+0000", 2024-09-13T06:43:31.052 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 22.157718218999999, 2024-09-13T06:43:31.052 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.034771370000000003, 2024-09-13T06:43:31.052 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:31.053 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:31.053 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:31.053 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:31.053 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:31.053 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 237459 2024-09-13T06:43:31.053 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:31.053 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:31.053 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:31.053 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:31.053 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800486+0000", 2024-09-13T06:43:31.053 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:31.053 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:31.053 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:31.054 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:31.054 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800486+0000", 2024-09-13T06:43:31.054 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:31.054 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:31.054 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:31.054 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:31.054 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800485+0000", 2024-09-13T06:43:31.054 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:31.054 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:31.054 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:31.054 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:31.055 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800487+0000", 2024-09-13T06:43:31.055 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.297e-06 2024-09-13T06:43:31.055 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:31.055 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:31.055 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:31.055 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800491+0000", 2024-09-13T06:43:31.055 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.4569999999999998e-06 2024-09-13T06:43:31.055 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:31.055 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:31.055 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:31.055 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800494+0000", 2024-09-13T06:43:31.055 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.8710000000000001e-06 2024-09-13T06:43:31.055 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:31.056 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:31.056 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:31.056 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.835058+0000", 2024-09-13T06:43:31.056 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.034564117999999998 2024-09-13T06:43:31.056 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:31.056 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:31.056 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:31.056 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.835142+0000", 2024-09-13T06:43:31.056 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.352e-05 2024-09-13T06:43:31.056 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:31.056 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:31.056 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:31.056 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.835257+0000", 2024-09-13T06:43:31.057 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00011537 2024-09-13T06:43:31.057 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:31.057 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:31.057 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:31.057 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:31.057 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:31.058 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:237460 3.15 3:abdd9d42:::rbd_data.1121cb4a09ed.0000000000000008:82 [read 253952~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e224)", 2024-09-13T06:43:31.058 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:43:08.800511+0000", 2024-09-13T06:43:31.058 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 22.157692549, 2024-09-13T06:43:31.058 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.034864764999999999, 2024-09-13T06:43:31.058 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:31.058 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:31.059 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:31.059 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:31.059 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:31.059 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 237460 2024-09-13T06:43:31.059 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:31.059 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:31.060 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:31.060 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:31.060 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800511+0000", 2024-09-13T06:43:31.060 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:31.060 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:31.060 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:31.061 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:31.061 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800511+0000", 2024-09-13T06:43:31.061 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:31.061 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:31.061 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:31.061 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:31.062 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800511+0000", 2024-09-13T06:43:31.062 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:31.062 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:31.062 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:31.062 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:31.063 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800513+0000", 2024-09-13T06:43:31.063 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6020000000000001e-06 2024-09-13T06:43:31.063 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:31.063 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:31.063 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:31.063 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800517+0000", 2024-09-13T06:43:31.064 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0559999999999998e-06 2024-09-13T06:43:31.064 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:31.064 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:31.064 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:31.064 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800521+0000", 2024-09-13T06:43:31.065 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.4050000000000002e-06 2024-09-13T06:43:31.065 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:31.065 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:31.065 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:31.066 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.835278+0000", 2024-09-13T06:43:31.066 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.034757154999999998 2024-09-13T06:43:31.066 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:31.066 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:31.066 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:31.067 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.835319+0000", 2024-09-13T06:43:31.067 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.1121000000000002e-05 2024-09-13T06:43:31.067 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:31.067 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:31.067 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:31.067 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.835376+0000", 2024-09-13T06:43:31.068 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.6820000000000001e-05 2024-09-13T06:43:31.068 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:31.068 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:31.068 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:31.068 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:31.069 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:31.069 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:43:31.071 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:43:31.069+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:43:31.072 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-13T06:43:31.172 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:43:31.171+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:43:31.199 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:43:31.200 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-13T06:43:31.200 INFO:teuthology.orchestra.run.smithi081.stdout: "num_ops": 0 2024-09-13T06:43:31.200 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:43:31.215 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-13T06:43:31.273 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:43:31.273+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:43:31.374 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-13T06:43:31.373+0000 7fa8bb18e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 36790) UID: 0 2024-09-13T06:43:31.378 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:43:31.378 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-13T06:43:31.378 INFO:teuthology.orchestra.run.smithi081.stdout: "complaint_time": 30, 2024-09-13T06:43:31.379 INFO:teuthology.orchestra.run.smithi081.stdout: "num_blocked_ops": 0 2024-09-13T06:43:31.379 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:43:31.392 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-13T06:43:31.475 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:43:31.475+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:43:31.524 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:43:31.524 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 20, 2024-09-13T06:43:31.524 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 600, 2024-09-13T06:43:31.524 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [ 2024-09-13T06:43:31.524 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:31.524 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:37801 3.1 3:82e31015:::rbd_object_map.1121d8143c6e.0000000000000019:head [call] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e55)", 2024-09-13T06:43:31.524 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:05.646191+0000", 2024-09-13T06:43:31.524 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 205.877708248, 2024-09-13T06:43:31.524 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.72659507800000001, 2024-09-13T06:43:31.525 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:31.525 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:31.525 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:31.525 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:31.525 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:31.525 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 37801 2024-09-13T06:43:31.525 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:31.525 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:31.525 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:31.525 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:31.525 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:05.646191+0000", 2024-09-13T06:43:31.525 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:31.525 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:31.526 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:31.526 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:31.526 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:05.646191+0000", 2024-09-13T06:43:31.526 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:31.526 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:31.526 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:31.526 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:31.526 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:05.646188+0000", 2024-09-13T06:43:31.526 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999971 2024-09-13T06:43:31.526 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:31.526 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:31.526 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:31.526 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:05.646206+0000", 2024-09-13T06:43:31.527 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8182999999999999e-05 2024-09-13T06:43:31.527 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:31.527 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:31.527 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:31.527 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:05.646237+0000", 2024-09-13T06:43:31.527 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.1071000000000001e-05 2024-09-13T06:43:31.527 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:31.527 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:31.527 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:31.527 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:05.646251+0000", 2024-09-13T06:43:31.527 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3679000000000001e-05 2024-09-13T06:43:31.527 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:31.527 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:31.527 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:31.528 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:05.646321+0000", 2024-09-13T06:43:31.528 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.9831000000000003e-05 2024-09-13T06:43:31.528 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:31.528 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:31.528 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:43:31.528 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:05.646331+0000", 2024-09-13T06:43:31.528 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0242e-05 2024-09-13T06:43:31.528 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:31.528 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:31.528 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:31.528 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.371959+0000", 2024-09-13T06:43:31.528 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.72562817199999996 2024-09-13T06:43:31.528 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:31.528 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:31.529 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:31.529 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.372389+0000", 2024-09-13T06:43:31.529 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00042977400000000001 2024-09-13T06:43:31.529 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:31.529 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:31.529 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:31.529 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.372786+0000", 2024-09-13T06:43:31.529 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00039706099999999999 2024-09-13T06:43:31.529 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:31.529 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:31.529 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:31.529 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:31.529 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:31.529 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43182 3.17 3:ec5ebce4:::rbd_data.1121f5f2e1c0.0000000000000001:1f [read 333824~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:43:31.530 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.652985+0000", 2024-09-13T06:43:31.530 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 189.87091363499999, 2024-09-13T06:43:31.530 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123926616, 2024-09-13T06:43:31.530 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:31.530 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:31.530 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:31.530 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:31.530 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:31.530 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43182 2024-09-13T06:43:31.530 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:31.530 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:31.530 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:31.530 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:31.530 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.652985+0000", 2024-09-13T06:43:31.531 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:31.531 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:31.531 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:31.531 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:31.531 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.652985+0000", 2024-09-13T06:43:31.531 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:31.531 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:31.531 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:31.531 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:31.531 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.652985+0000", 2024-09-13T06:43:31.531 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:31.531 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:31.531 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:31.532 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:31.532 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.652987+0000", 2024-09-13T06:43:31.532 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0899999999999999e-06 2024-09-13T06:43:31.532 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:31.532 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:31.532 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:31.532 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.652994+0000", 2024-09-13T06:43:31.532 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3100000000000003e-06 2024-09-13T06:43:31.532 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:31.532 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:31.532 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:31.532 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.653000+0000", 2024-09-13T06:43:31.532 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2020000000000003e-06 2024-09-13T06:43:31.532 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:31.533 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:31.533 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:31.533 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.776635+0000", 2024-09-13T06:43:31.533 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.12363529400000001 2024-09-13T06:43:31.533 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:31.533 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:31.533 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:31.533 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.776676+0000", 2024-09-13T06:43:31.533 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.0745999999999999e-05 2024-09-13T06:43:31.533 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:31.533 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:31.533 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:31.533 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.776912+0000", 2024-09-13T06:43:31.533 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00023631300000000001 2024-09-13T06:43:31.534 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:31.534 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:31.534 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:31.534 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:31.534 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:31.534 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43194 3.17 3:ec5ebce4:::rbd_data.1121f5f2e1c0.0000000000000001:1f [read 495616~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:43:31.534 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.656645+0000", 2024-09-13T06:43:31.534 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 189.86725344199999, 2024-09-13T06:43:31.534 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.124088483, 2024-09-13T06:43:31.534 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:31.534 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:31.534 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:31.534 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:31.534 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:31.535 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43194 2024-09-13T06:43:31.535 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:31.535 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:31.535 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:31.535 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:31.535 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656645+0000", 2024-09-13T06:43:31.535 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:31.535 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:31.535 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:31.535 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:31.535 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656645+0000", 2024-09-13T06:43:31.535 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:31.535 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:31.535 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:31.536 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:31.536 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656645+0000", 2024-09-13T06:43:31.536 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:31.536 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:31.536 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:31.536 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:31.536 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656647+0000", 2024-09-13T06:43:31.536 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9180000000000001e-06 2024-09-13T06:43:31.536 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:31.536 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:31.536 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:31.536 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656653+0000", 2024-09-13T06:43:31.536 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7860000000000002e-06 2024-09-13T06:43:31.536 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:31.537 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:31.537 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:31.537 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656658+0000", 2024-09-13T06:43:31.537 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6949999999999999e-06 2024-09-13T06:43:31.537 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:31.537 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:31.537 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:31.537 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.780406+0000", 2024-09-13T06:43:31.537 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123748657 2024-09-13T06:43:31.537 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:31.537 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:31.537 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:31.537 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.780446+0000", 2024-09-13T06:43:31.537 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.9360999999999998e-05 2024-09-13T06:43:31.538 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:31.538 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:31.538 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:31.538 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.780734+0000", 2024-09-13T06:43:31.538 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00028838399999999998 2024-09-13T06:43:31.538 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:31.538 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:31.538 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:31.538 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:31.538 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:31.538 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43241 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 120832~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:43:31.538 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.660682+0000", 2024-09-13T06:43:31.538 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 189.86321650400001, 2024-09-13T06:43:31.539 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123958204, 2024-09-13T06:43:31.539 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:31.539 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:31.539 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:31.539 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:31.539 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:31.539 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43241 2024-09-13T06:43:31.539 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:31.539 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:31.539 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:31.539 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:31.539 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660682+0000", 2024-09-13T06:43:31.539 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:31.540 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:31.540 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:31.540 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:31.540 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660682+0000", 2024-09-13T06:43:31.540 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:31.540 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:31.540 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:31.540 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:31.540 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660682+0000", 2024-09-13T06:43:31.540 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:31.540 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:31.540 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:31.540 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:31.540 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660683+0000", 2024-09-13T06:43:31.541 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.308e-06 2024-09-13T06:43:31.541 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:31.541 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:31.541 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:31.541 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660686+0000", 2024-09-13T06:43:31.541 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.977e-06 2024-09-13T06:43:31.541 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:31.541 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:31.541 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:31.541 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660689+0000", 2024-09-13T06:43:31.541 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5830000000000001e-06 2024-09-13T06:43:31.541 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:31.541 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:31.541 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:31.542 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.784366+0000", 2024-09-13T06:43:31.542 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.12367713599999999 2024-09-13T06:43:31.542 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:31.542 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:31.542 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:31.542 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.784451+0000", 2024-09-13T06:43:31.542 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.4629999999999994e-05 2024-09-13T06:43:31.542 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:31.542 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:31.542 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:31.542 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.784641+0000", 2024-09-13T06:43:31.542 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00018984899999999999 2024-09-13T06:43:31.542 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:31.543 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:31.543 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:31.543 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:31.543 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:31.543 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43242 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 139264~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:43:31.543 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.660691+0000", 2024-09-13T06:43:31.543 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 189.863207526, 2024-09-13T06:43:31.543 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.124536443, 2024-09-13T06:43:31.543 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:31.543 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:31.543 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:31.543 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:31.543 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:31.544 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43242 2024-09-13T06:43:31.544 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:31.544 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:31.544 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:31.544 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:31.544 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660691+0000", 2024-09-13T06:43:31.544 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:31.544 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:31.544 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:31.544 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:31.544 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660691+0000", 2024-09-13T06:43:31.544 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:31.545 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:31.545 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:31.545 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:31.545 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660691+0000", 2024-09-13T06:43:31.545 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:43:31.545 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:31.545 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:31.545 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:31.545 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660696+0000", 2024-09-13T06:43:31.545 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0560000000000004e-06 2024-09-13T06:43:31.545 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:31.545 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:31.545 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:31.546 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660699+0000", 2024-09-13T06:43:31.546 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.2009999999999999e-06 2024-09-13T06:43:31.546 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:31.546 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:31.546 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:31.546 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660702+0000", 2024-09-13T06:43:31.546 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.633e-06 2024-09-13T06:43:31.546 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:31.546 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:31.546 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:31.546 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.784912+0000", 2024-09-13T06:43:31.546 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.124209497 2024-09-13T06:43:31.546 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:31.547 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:31.547 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:31.547 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.784995+0000", 2024-09-13T06:43:31.547 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.3891e-05 2024-09-13T06:43:31.547 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:31.547 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:31.547 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:31.547 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.785228+0000", 2024-09-13T06:43:31.547 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00023237400000000001 2024-09-13T06:43:31.547 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:31.547 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:31.547 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:31.547 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:31.548 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:31.548 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43243 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 153600~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:43:31.548 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.660705+0000", 2024-09-13T06:43:31.548 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 189.863194193, 2024-09-13T06:43:31.548 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.124825835, 2024-09-13T06:43:31.548 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:31.548 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:31.548 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:31.548 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:31.548 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:31.548 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43243 2024-09-13T06:43:31.548 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:31.548 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:31.549 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:31.549 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:31.549 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660705+0000", 2024-09-13T06:43:31.549 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:31.549 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:31.549 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:31.549 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:31.549 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660705+0000", 2024-09-13T06:43:31.549 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:31.549 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:31.549 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:31.549 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:31.549 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660705+0000", 2024-09-13T06:43:31.550 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:43:31.550 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:31.550 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:31.550 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:31.550 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660706+0000", 2024-09-13T06:43:31.550 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4339999999999999e-06 2024-09-13T06:43:31.550 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:31.550 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:31.550 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:31.550 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660709+0000", 2024-09-13T06:43:31.550 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9000000000000002e-06 2024-09-13T06:43:31.550 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:31.550 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:31.550 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:31.551 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660712+0000", 2024-09-13T06:43:31.551 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.0589999999999998e-06 2024-09-13T06:43:31.551 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:31.551 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:31.551 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:31.551 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.785318+0000", 2024-09-13T06:43:31.551 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.124606299 2024-09-13T06:43:31.551 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:31.551 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:31.551 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:31.551 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.785361+0000", 2024-09-13T06:43:31.551 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.3214999999999999e-05 2024-09-13T06:43:31.551 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:31.552 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:31.552 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:31.552 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.785531+0000", 2024-09-13T06:43:31.552 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00016914400000000001 2024-09-13T06:43:31.552 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:31.552 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:31.552 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:31.552 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:31.552 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:31.552 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43244 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 167936~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:43:31.552 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.660714+0000", 2024-09-13T06:43:31.552 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 189.86318478000001, 2024-09-13T06:43:31.553 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.125073248, 2024-09-13T06:43:31.553 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:31.553 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:31.553 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:31.553 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:31.553 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:31.553 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43244 2024-09-13T06:43:31.553 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:31.553 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:31.553 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:31.553 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:31.553 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660714+0000", 2024-09-13T06:43:31.553 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:31.553 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:31.554 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:31.554 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:31.554 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660714+0000", 2024-09-13T06:43:31.554 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:31.554 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:31.554 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:31.554 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:31.554 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660714+0000", 2024-09-13T06:43:31.554 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:43:31.554 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:31.554 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:31.554 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:31.554 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660715+0000", 2024-09-13T06:43:31.554 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2330000000000001e-06 2024-09-13T06:43:31.555 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:31.555 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:31.555 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:31.555 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660718+0000", 2024-09-13T06:43:31.555 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9569999999999998e-06 2024-09-13T06:43:31.555 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:31.555 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:31.555 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:31.555 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660721+0000", 2024-09-13T06:43:31.555 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.678e-06 2024-09-13T06:43:31.555 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:31.555 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:31.555 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:31.555 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.785557+0000", 2024-09-13T06:43:31.556 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.12483633199999999 2024-09-13T06:43:31.556 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:31.556 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:31.556 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:31.556 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.785618+0000", 2024-09-13T06:43:31.556 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0686000000000001e-05 2024-09-13T06:43:31.556 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:31.556 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:31.556 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:31.556 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.785787+0000", 2024-09-13T06:43:31.556 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00016957699999999999 2024-09-13T06:43:31.556 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:31.556 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:31.556 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:31.557 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:31.557 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:31.557 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43256 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 344064~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:43:31.557 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.664763+0000", 2024-09-13T06:43:31.557 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 189.85913626999999, 2024-09-13T06:43:31.557 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.12418359399999999, 2024-09-13T06:43:31.557 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:31.557 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:31.557 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:31.557 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:31.557 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:31.557 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43256 2024-09-13T06:43:31.557 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:31.557 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:31.558 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:31.558 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:31.558 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664763+0000", 2024-09-13T06:43:31.558 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:31.558 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:31.558 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:31.558 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:31.558 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664763+0000", 2024-09-13T06:43:31.558 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:31.558 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:31.558 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:31.558 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:31.558 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664762+0000", 2024-09-13T06:43:31.558 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:31.558 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:31.559 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:31.559 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:31.559 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664765+0000", 2024-09-13T06:43:31.559 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3290000000000001e-06 2024-09-13T06:43:31.559 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:31.559 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:31.559 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:31.559 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664771+0000", 2024-09-13T06:43:31.559 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.1319999999999999e-06 2024-09-13T06:43:31.559 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:31.559 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:31.559 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:31.559 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664776+0000", 2024-09-13T06:43:31.559 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.8840000000000002e-06 2024-09-13T06:43:31.560 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:31.560 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:31.560 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:31.560 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.788598+0000", 2024-09-13T06:43:31.560 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123821979 2024-09-13T06:43:31.560 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:31.560 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:31.560 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:31.560 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.788680+0000", 2024-09-13T06:43:31.560 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.2367999999999995e-05 2024-09-13T06:43:31.560 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:31.560 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:31.560 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:31.560 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.788946+0000", 2024-09-13T06:43:31.561 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00026629799999999999 2024-09-13T06:43:31.561 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:31.561 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:31.561 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:31.561 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:31.561 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:31.561 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43267 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 505856~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:43:31.561 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.669461+0000", 2024-09-13T06:43:31.561 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 189.85443771600001, 2024-09-13T06:43:31.561 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123933711, 2024-09-13T06:43:31.561 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:31.561 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:31.561 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:31.561 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:31.561 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:31.562 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43267 2024-09-13T06:43:31.562 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:31.562 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:31.562 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:31.562 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:31.562 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669461+0000", 2024-09-13T06:43:31.562 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:31.562 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:31.562 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:31.562 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:31.562 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669461+0000", 2024-09-13T06:43:31.562 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:31.562 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:31.562 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:31.563 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:31.563 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669461+0000", 2024-09-13T06:43:31.563 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:31.563 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:31.563 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:31.563 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:31.563 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669463+0000", 2024-09-13T06:43:31.563 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5629999999999999e-06 2024-09-13T06:43:31.563 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:31.563 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:31.563 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:31.563 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669473+0000", 2024-09-13T06:43:31.563 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.9520000000000006e-06 2024-09-13T06:43:31.564 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:31.564 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:31.564 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:31.564 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669479+0000", 2024-09-13T06:43:31.564 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8540000000000002e-06 2024-09-13T06:43:31.564 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:31.564 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:31.564 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:31.564 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.793137+0000", 2024-09-13T06:43:31.564 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.12365825699999999 2024-09-13T06:43:31.564 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:31.564 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:31.564 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:31.565 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.793181+0000", 2024-09-13T06:43:31.565 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.3773999999999998e-05 2024-09-13T06:43:31.565 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:31.565 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:31.565 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:31.565 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.793395+0000", 2024-09-13T06:43:31.565 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00021372399999999999 2024-09-13T06:43:31.565 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:31.565 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:31.565 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:31.565 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:31.565 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:31.565 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43268 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 520192~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:43:31.565 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.669484+0000", 2024-09-13T06:43:31.566 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 189.85441493100001, 2024-09-13T06:43:31.566 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.12441057899999999, 2024-09-13T06:43:31.566 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:31.566 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:31.566 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:31.566 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:31.566 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:31.566 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43268 2024-09-13T06:43:31.566 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:31.566 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:31.566 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:31.566 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:31.566 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669484+0000", 2024-09-13T06:43:31.567 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:31.567 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:31.567 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:31.567 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:31.567 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669484+0000", 2024-09-13T06:43:31.567 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:31.567 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:31.567 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:31.567 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:31.568 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669484+0000", 2024-09-13T06:43:31.568 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:31.568 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:31.568 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:31.568 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:31.568 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669486+0000", 2024-09-13T06:43:31.568 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6120000000000001e-06 2024-09-13T06:43:31.568 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:31.568 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:31.568 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:31.568 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669494+0000", 2024-09-13T06:43:31.568 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4819999999999997e-06 2024-09-13T06:43:31.569 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:31.569 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:31.569 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:31.569 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669497+0000", 2024-09-13T06:43:31.569 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9790000000000002e-06 2024-09-13T06:43:31.569 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:31.569 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:31.569 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:31.569 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.793559+0000", 2024-09-13T06:43:31.569 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.124062436 2024-09-13T06:43:31.569 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:31.569 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:31.569 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:31.569 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.793603+0000", 2024-09-13T06:43:31.570 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.3764999999999999e-05 2024-09-13T06:43:31.570 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:31.570 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:31.570 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:31.570 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.793895+0000", 2024-09-13T06:43:31.570 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00029168299999999999 2024-09-13T06:43:31.570 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:31.570 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:31.570 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:31.570 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:31.570 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:31.570 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:181627 3.1b 3:dbd5e871:::rbd_data.11218aab7a9c.0000000000000003:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e203)", 2024-09-13T06:43:31.570 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:42:45.704561+0000", 2024-09-13T06:43:31.570 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 45.819338066999997, 2024-09-13T06:43:31.571 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.70481779099999997, 2024-09-13T06:43:31.571 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:31.571 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:31.571 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:31.571 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:31.571 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:31.571 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 181627 2024-09-13T06:43:31.571 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:31.571 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:31.571 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:31.571 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:31.571 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.704561+0000", 2024-09-13T06:43:31.571 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:31.571 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:31.572 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:31.572 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:31.572 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.704561+0000", 2024-09-13T06:43:31.572 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:31.572 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:31.572 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:31.572 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:31.572 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.704558+0000", 2024-09-13T06:43:31.572 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999976 2024-09-13T06:43:31.572 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:31.572 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:31.572 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:31.572 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.704570+0000", 2024-09-13T06:43:31.572 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2123000000000001e-05 2024-09-13T06:43:31.573 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:31.573 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:31.573 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:31.573 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.704596+0000", 2024-09-13T06:43:31.573 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5134e-05 2024-09-13T06:43:31.573 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:31.573 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:31.573 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:31.573 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.704609+0000", 2024-09-13T06:43:31.573 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3745e-05 2024-09-13T06:43:31.573 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:31.573 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:31.573 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:31.573 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.704797+0000", 2024-09-13T06:43:31.574 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00018797799999999999 2024-09-13T06:43:31.574 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:31.574 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:31.574 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:43:31.574 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.704816+0000", 2024-09-13T06:43:31.574 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8218000000000001e-05 2024-09-13T06:43:31.574 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:31.574 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:31.574 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:31.574 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:46.408816+0000", 2024-09-13T06:43:31.574 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.70399995500000001 2024-09-13T06:43:31.574 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:31.574 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:31.574 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:31.575 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:46.409111+0000", 2024-09-13T06:43:31.575 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000295202 2024-09-13T06:43:31.575 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:31.575 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:31.575 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:31.575 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:46.409379+0000", 2024-09-13T06:43:31.575 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00026792599999999998 2024-09-13T06:43:31.575 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:31.575 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:31.575 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:31.575 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:31.575 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:31.576 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:181641 3.1b 3:dbd5e871:::rbd_data.11218aab7a9c.0000000000000003:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e203)", 2024-09-13T06:43:31.576 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:42:45.704674+0000", 2024-09-13T06:43:31.576 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 45.819225060000001, 2024-09-13T06:43:31.576 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.70579465600000002, 2024-09-13T06:43:31.576 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:31.576 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:31.576 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:31.576 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:31.576 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:31.576 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 181641 2024-09-13T06:43:31.576 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:31.576 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:31.576 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:31.576 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:31.577 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.704674+0000", 2024-09-13T06:43:31.577 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:31.577 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:31.577 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:31.577 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:31.577 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.704674+0000", 2024-09-13T06:43:31.577 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:31.577 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:31.577 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:31.577 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:31.577 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.704673+0000", 2024-09-13T06:43:31.577 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:31.577 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:31.577 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:31.578 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:31.578 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.704677+0000", 2024-09-13T06:43:31.578 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.6389999999999998e-06 2024-09-13T06:43:31.578 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:31.578 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:31.578 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:31.578 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.704691+0000", 2024-09-13T06:43:31.578 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3859999999999999e-05 2024-09-13T06:43:31.578 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:31.578 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:31.578 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:31.578 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.704699+0000", 2024-09-13T06:43:31.578 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.2339999999999994e-06 2024-09-13T06:43:31.578 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:31.578 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:31.579 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:31.579 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.704854+0000", 2024-09-13T06:43:31.579 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00015513899999999999 2024-09-13T06:43:31.579 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:31.579 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:31.579 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:43:31.579 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.704866+0000", 2024-09-13T06:43:31.579 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1855000000000001e-05 2024-09-13T06:43:31.579 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:31.579 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:31.579 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:31.579 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:46.410079+0000", 2024-09-13T06:43:31.579 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.705212477 2024-09-13T06:43:31.580 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:31.580 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:31.580 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:31.580 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:46.410279+0000", 2024-09-13T06:43:31.580 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000200614 2024-09-13T06:43:31.580 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:31.580 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:31.580 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:31.580 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:46.410469+0000", 2024-09-13T06:43:31.580 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00018939400000000001 2024-09-13T06:43:31.580 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:31.580 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:31.580 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:31.580 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:31.580 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:31.581 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:181655 3.1b 3:dbd5e871:::rbd_data.11218aab7a9c.0000000000000003:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e203)", 2024-09-13T06:43:31.581 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:42:45.704730+0000", 2024-09-13T06:43:31.581 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 45.819168652000002, 2024-09-13T06:43:31.581 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.70617977499999995, 2024-09-13T06:43:31.581 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:31.581 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:31.581 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:31.581 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:31.581 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:31.581 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 181655 2024-09-13T06:43:31.581 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:31.581 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:31.581 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:31.582 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:31.582 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.704730+0000", 2024-09-13T06:43:31.582 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:31.582 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:31.582 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:31.582 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:31.582 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.704730+0000", 2024-09-13T06:43:31.582 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:31.582 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:31.582 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:31.582 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:31.582 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.704730+0000", 2024-09-13T06:43:31.582 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:31.583 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:31.583 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:31.583 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:31.583 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.704733+0000", 2024-09-13T06:43:31.583 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.0000000000000001e-06 2024-09-13T06:43:31.583 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:31.583 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:31.583 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:31.583 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.704741+0000", 2024-09-13T06:43:31.583 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.0770000000000008e-06 2024-09-13T06:43:31.583 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:31.583 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:31.583 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:31.583 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.704747+0000", 2024-09-13T06:43:31.584 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.2110000000000003e-06 2024-09-13T06:43:31.584 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:31.584 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:31.584 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:31.584 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.706676+0000", 2024-09-13T06:43:31.584 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0019289820000000001 2024-09-13T06:43:31.584 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:31.584 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:31.584 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:43:31.584 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.706687+0000", 2024-09-13T06:43:31.584 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1382999999999999e-05 2024-09-13T06:43:31.584 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:31.584 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:31.585 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:31.585 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:46.410540+0000", 2024-09-13T06:43:31.585 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.70385235199999996 2024-09-13T06:43:31.585 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:31.585 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:31.585 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:31.585 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:46.410723+0000", 2024-09-13T06:43:31.585 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000182998 2024-09-13T06:43:31.585 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:31.585 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:31.585 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:31.585 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:46.410910+0000", 2024-09-13T06:43:31.585 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00018720299999999999 2024-09-13T06:43:31.586 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:31.586 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:31.586 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:31.586 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:31.586 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:31.586 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:181669 3.1b 3:dbd5e871:::rbd_data.11218aab7a9c.0000000000000003:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e203)", 2024-09-13T06:43:31.586 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:42:45.705356+0000", 2024-09-13T06:43:31.586 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 45.818542643999997, 2024-09-13T06:43:31.586 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.70583958999999996, 2024-09-13T06:43:31.586 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:31.586 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:31.586 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:31.586 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:31.586 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:31.587 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 181669 2024-09-13T06:43:31.587 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:31.587 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:31.587 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:31.587 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:31.587 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.705356+0000", 2024-09-13T06:43:31.587 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:31.587 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:31.587 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:31.587 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:31.587 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.705356+0000", 2024-09-13T06:43:31.587 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:31.587 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:31.588 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:31.588 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:31.588 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.705356+0000", 2024-09-13T06:43:31.588 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:31.588 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:31.588 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:31.588 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:31.588 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.705360+0000", 2024-09-13T06:43:31.588 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.0069999999999999e-06 2024-09-13T06:43:31.588 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:31.588 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:31.588 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:31.588 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.705368+0000", 2024-09-13T06:43:31.589 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.3639999999999999e-06 2024-09-13T06:43:31.589 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:31.589 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:31.589 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:31.589 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.705375+0000", 2024-09-13T06:43:31.589 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.8839999999999997e-06 2024-09-13T06:43:31.589 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:31.589 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:31.589 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:31.589 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.706716+0000", 2024-09-13T06:43:31.589 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0013414589999999999 2024-09-13T06:43:31.589 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:31.589 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:31.590 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:43:31.590 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.706726+0000", 2024-09-13T06:43:31.590 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.5079999999999994e-06 2024-09-13T06:43:31.590 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:31.590 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:31.590 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:31.590 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:46.410966+0000", 2024-09-13T06:43:31.590 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.70424025800000001 2024-09-13T06:43:31.590 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:31.590 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:31.590 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:31.590 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:46.411099+0000", 2024-09-13T06:43:31.591 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000132395 2024-09-13T06:43:31.591 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:31.591 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:31.591 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:31.591 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:46.411196+0000", 2024-09-13T06:43:31.591 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.7344999999999997e-05 2024-09-13T06:43:31.591 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:31.591 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:31.591 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:31.591 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:31.591 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:31.591 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:181683 3.1b 3:dbd5e871:::rbd_data.11218aab7a9c.0000000000000003:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e203)", 2024-09-13T06:43:31.591 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:42:45.705404+0000", 2024-09-13T06:43:31.591 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 45.818495138000003, 2024-09-13T06:43:31.592 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.70639211899999999, 2024-09-13T06:43:31.592 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:31.592 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:31.592 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:31.592 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:31.592 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:31.592 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 181683 2024-09-13T06:43:31.592 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:31.592 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:31.592 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:31.592 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:31.592 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.705404+0000", 2024-09-13T06:43:31.592 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:31.593 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:31.593 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:31.593 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:31.593 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.705404+0000", 2024-09-13T06:43:31.593 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:31.593 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:31.593 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:31.593 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:31.593 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.705403+0000", 2024-09-13T06:43:31.593 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:31.593 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:31.593 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:31.593 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:31.594 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.705406+0000", 2024-09-13T06:43:31.594 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.1499999999999999e-06 2024-09-13T06:43:31.594 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:31.594 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:31.594 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:31.594 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.705414+0000", 2024-09-13T06:43:31.594 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4259999999999997e-06 2024-09-13T06:43:31.594 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:31.594 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:31.594 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:31.594 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.705420+0000", 2024-09-13T06:43:31.594 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.4339999999999997e-06 2024-09-13T06:43:31.594 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:31.594 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:31.594 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:31.595 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.706753+0000", 2024-09-13T06:43:31.595 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0013326939999999999 2024-09-13T06:43:31.595 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:31.595 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:31.595 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:43:31.595 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.706762+0000", 2024-09-13T06:43:31.595 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.2439999999999999e-06 2024-09-13T06:43:31.595 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:31.595 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:31.595 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:31.595 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:46.411391+0000", 2024-09-13T06:43:31.595 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.70462912099999997 2024-09-13T06:43:31.595 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:31.596 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:31.596 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:31.596 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:46.411584+0000", 2024-09-13T06:43:31.596 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00019283399999999999 2024-09-13T06:43:31.596 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:31.596 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:31.596 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:31.596 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:46.411796+0000", 2024-09-13T06:43:31.596 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00021175299999999999 2024-09-13T06:43:31.596 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:31.596 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:31.596 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:31.596 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:31.597 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:31.597 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:181697 3.1b 3:dbd5e871:::rbd_data.11218aab7a9c.0000000000000003:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e203)", 2024-09-13T06:43:31.597 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:42:45.705447+0000", 2024-09-13T06:43:31.597 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 45.818451488000001, 2024-09-13T06:43:31.597 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.70668603500000005, 2024-09-13T06:43:31.597 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:31.597 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:31.597 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:31.597 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:31.597 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:31.597 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 181697 2024-09-13T06:43:31.597 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:31.597 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:31.597 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:31.598 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:31.598 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.705447+0000", 2024-09-13T06:43:31.598 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:31.598 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:31.598 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:31.598 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:31.598 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.705447+0000", 2024-09-13T06:43:31.598 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:31.598 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:31.598 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:31.598 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:31.598 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.705447+0000", 2024-09-13T06:43:31.598 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:31.599 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:31.599 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:31.599 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:31.599 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.705450+0000", 2024-09-13T06:43:31.599 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.8830000000000002e-06 2024-09-13T06:43:31.599 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:31.599 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:31.599 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:31.599 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.705457+0000", 2024-09-13T06:43:31.599 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.097e-06 2024-09-13T06:43:31.599 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:31.599 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:31.599 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:31.599 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.705463+0000", 2024-09-13T06:43:31.600 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.2439999999999998e-06 2024-09-13T06:43:31.600 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:31.600 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:31.600 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:31.600 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.706790+0000", 2024-09-13T06:43:31.600 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.001326823 2024-09-13T06:43:31.600 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:31.600 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:31.600 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:43:31.600 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.706799+0000", 2024-09-13T06:43:31.600 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.3249999999999997e-06 2024-09-13T06:43:31.600 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:31.600 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:31.600 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:31.601 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:46.411884+0000", 2024-09-13T06:43:31.601 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.70508501599999995 2024-09-13T06:43:31.601 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:31.601 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:31.601 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:31.601 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:46.412010+0000", 2024-09-13T06:43:31.601 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000125635 2024-09-13T06:43:31.601 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:31.601 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:31.601 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:31.601 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:46.412133+0000", 2024-09-13T06:43:31.601 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000123492 2024-09-13T06:43:31.601 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:31.601 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:31.602 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:31.602 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:31.602 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:31.602 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:181711 3.1b 3:dbd5e871:::rbd_data.11218aab7a9c.0000000000000003:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e203)", 2024-09-13T06:43:31.602 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:42:45.705496+0000", 2024-09-13T06:43:31.602 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 45.818402925000001, 2024-09-13T06:43:31.602 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.70714611199999999, 2024-09-13T06:43:31.602 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:31.602 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:31.602 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:31.602 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:31.602 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:31.602 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 181711 2024-09-13T06:43:31.602 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:31.603 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:31.603 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:31.603 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:31.603 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.705496+0000", 2024-09-13T06:43:31.603 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:31.603 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:31.603 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:31.603 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:31.603 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.705496+0000", 2024-09-13T06:43:31.603 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:31.603 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:31.603 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:31.603 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:31.603 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.705495+0000", 2024-09-13T06:43:31.604 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:31.604 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:31.604 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:31.604 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:31.604 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.705499+0000", 2024-09-13T06:43:31.604 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.1109999999999999e-06 2024-09-13T06:43:31.604 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:31.604 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:31.604 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:31.604 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.705506+0000", 2024-09-13T06:43:31.604 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.8830000000000006e-06 2024-09-13T06:43:31.604 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:31.604 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:31.605 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:31.605 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.705513+0000", 2024-09-13T06:43:31.605 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.2500000000000003e-06 2024-09-13T06:43:31.605 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:31.605 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:31.605 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:31.605 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.706828+0000", 2024-09-13T06:43:31.605 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0013155840000000001 2024-09-13T06:43:31.605 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:31.605 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:31.605 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:43:31.605 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.706837+0000", 2024-09-13T06:43:31.605 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.0489999999999993e-06 2024-09-13T06:43:31.605 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:31.606 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:31.606 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:31.606 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:46.412223+0000", 2024-09-13T06:43:31.606 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.70538530799999999 2024-09-13T06:43:31.606 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:31.606 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:31.606 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:31.606 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:46.412418+0000", 2024-09-13T06:43:31.606 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000195331 2024-09-13T06:43:31.606 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:31.606 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:31.606 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:31.606 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:46.412642+0000", 2024-09-13T06:43:31.607 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00022410099999999999 2024-09-13T06:43:31.607 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:31.607 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:31.607 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:31.607 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:31.607 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:31.607 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:181725 3.1b 3:dbd5e871:::rbd_data.11218aab7a9c.0000000000000003:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e203)", 2024-09-13T06:43:31.607 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:42:45.706863+0000", 2024-09-13T06:43:31.607 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 45.817035881000002, 2024-09-13T06:43:31.607 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.70631271699999998, 2024-09-13T06:43:31.607 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:31.607 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:31.607 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:31.608 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:31.608 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:31.608 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 181725 2024-09-13T06:43:31.608 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:31.608 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:31.608 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:31.608 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:31.608 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.706863+0000", 2024-09-13T06:43:31.608 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:31.608 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:31.608 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:31.608 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:31.608 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.706863+0000", 2024-09-13T06:43:31.608 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:31.609 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:31.609 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:31.609 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:31.609 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.706862+0000", 2024-09-13T06:43:31.609 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.999999 2024-09-13T06:43:31.609 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:31.609 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:31.609 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:31.609 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.706869+0000", 2024-09-13T06:43:31.609 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.0899999999999999e-06 2024-09-13T06:43:31.609 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:31.609 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:31.609 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:31.609 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.706881+0000", 2024-09-13T06:43:31.610 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1727e-05 2024-09-13T06:43:31.610 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:31.610 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:31.610 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:31.610 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.706891+0000", 2024-09-13T06:43:31.610 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.9399999999999997e-06 2024-09-13T06:43:31.610 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:31.610 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:31.610 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:31.610 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.706952+0000", 2024-09-13T06:43:31.610 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.1106999999999996e-05 2024-09-13T06:43:31.610 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:31.610 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:31.611 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:43:31.611 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.706966+0000", 2024-09-13T06:43:31.611 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4173e-05 2024-09-13T06:43:31.611 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:31.611 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:31.611 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:31.611 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:46.412754+0000", 2024-09-13T06:43:31.611 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.70578759999999996 2024-09-13T06:43:31.611 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:31.611 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:31.611 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:31.611 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:46.412967+0000", 2024-09-13T06:43:31.611 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00021290999999999999 2024-09-13T06:43:31.611 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:31.612 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:31.612 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:31.612 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:46.413176+0000", 2024-09-13T06:43:31.612 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00020922099999999999 2024-09-13T06:43:31.612 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:31.612 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:31.612 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:31.612 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:31.612 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:31.612 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:181739 3.1b 3:dbd5e871:::rbd_data.11218aab7a9c.0000000000000003:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e203)", 2024-09-13T06:43:31.612 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:42:45.706937+0000", 2024-09-13T06:43:31.612 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 45.816961669999998, 2024-09-13T06:43:31.613 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.70679418800000005, 2024-09-13T06:43:31.613 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:31.613 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:31.613 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:31.613 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:31.613 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:31.613 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 181739 2024-09-13T06:43:31.613 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:31.613 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:31.613 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:31.613 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:31.613 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.706937+0000", 2024-09-13T06:43:31.613 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:31.614 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:31.614 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:31.614 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:31.614 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.706937+0000", 2024-09-13T06:43:31.614 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:31.614 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:31.614 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:31.614 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:31.614 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.706937+0000", 2024-09-13T06:43:31.614 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:31.614 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:31.614 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:31.614 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:31.615 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.706940+0000", 2024-09-13T06:43:31.615 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.4290000000000001e-06 2024-09-13T06:43:31.615 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:31.615 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:31.615 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:31.615 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.706949+0000", 2024-09-13T06:43:31.615 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.7730000000000005e-06 2024-09-13T06:43:31.615 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:31.615 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:31.615 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:31.615 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.706956+0000", 2024-09-13T06:43:31.615 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4240000000000004e-06 2024-09-13T06:43:31.615 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:31.616 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:31.616 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:31.616 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.706999+0000", 2024-09-13T06:43:31.616 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.2410999999999998e-05 2024-09-13T06:43:31.616 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:31.616 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:31.616 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:43:31.616 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.707011+0000", 2024-09-13T06:43:31.616 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2140999999999999e-05 2024-09-13T06:43:31.616 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:31.616 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:31.616 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:31.616 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:46.413278+0000", 2024-09-13T06:43:31.617 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.70626747199999995 2024-09-13T06:43:31.617 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:31.617 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:31.617 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:31.617 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:46.413471+0000", 2024-09-13T06:43:31.617 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00019234699999999999 2024-09-13T06:43:31.617 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:31.617 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:31.617 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:31.617 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:46.413731+0000", 2024-09-13T06:43:31.617 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00026069 2024-09-13T06:43:31.617 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:31.617 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:31.618 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:31.618 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:31.618 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:31.618 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:181753 3.1b 3:dbd5e871:::rbd_data.11218aab7a9c.0000000000000003:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e203)", 2024-09-13T06:43:31.618 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:42:45.706987+0000", 2024-09-13T06:43:31.618 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 45.816911587, 2024-09-13T06:43:31.618 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.70721309200000004, 2024-09-13T06:43:31.618 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:31.618 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:31.618 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:31.618 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:31.618 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:31.618 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 181753 2024-09-13T06:43:31.619 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:31.619 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:31.619 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:31.619 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:31.619 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.706987+0000", 2024-09-13T06:43:31.619 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:31.619 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:31.619 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:31.619 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:31.619 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.706987+0000", 2024-09-13T06:43:31.619 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:31.619 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:31.619 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:31.619 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:31.620 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.706987+0000", 2024-09-13T06:43:31.620 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:31.620 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:31.620 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:31.620 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:31.620 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.706990+0000", 2024-09-13T06:43:31.620 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.0759999999999999e-06 2024-09-13T06:43:31.620 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:31.620 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:31.620 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:31.620 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.706997+0000", 2024-09-13T06:43:31.620 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5809999999999999e-06 2024-09-13T06:43:31.621 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:31.621 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:31.621 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:31.621 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.707004+0000", 2024-09-13T06:43:31.621 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.7839999999999998e-06 2024-09-13T06:43:31.621 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:31.621 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:31.621 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:31.621 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.707046+0000", 2024-09-13T06:43:31.621 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.1474999999999998e-05 2024-09-13T06:43:31.621 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:31.621 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:31.621 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:43:31.621 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.707056+0000", 2024-09-13T06:43:31.622 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0825000000000001e-05 2024-09-13T06:43:31.622 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:31.622 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:31.622 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:31.622 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:46.413797+0000", 2024-09-13T06:43:31.622 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.70674101099999997 2024-09-13T06:43:31.622 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:31.622 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:31.622 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:31.622 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:46.413998+0000", 2024-09-13T06:43:31.622 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00020058700000000001 2024-09-13T06:43:31.622 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:31.622 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:31.623 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:31.623 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:46.414200+0000", 2024-09-13T06:43:31.623 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00020238400000000001 2024-09-13T06:43:31.623 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:31.623 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:31.623 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:31.623 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:31.623 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:31.623 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:43:31.624 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-13T06:43:31.625 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-13T06:43:31.625 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:43:31.623+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:43:31.726 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:43:31.725+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:43:31.791 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:43:31.791 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-13T06:43:31.791 INFO:teuthology.orchestra.run.smithi081.stdout: "num_ops": 0 2024-09-13T06:43:31.791 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:43:31.806 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-13T06:43:31.826 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:43:31.825+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:43:31.919 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:43:31.919 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-13T06:43:31.919 INFO:teuthology.orchestra.run.smithi081.stdout: "complaint_time": 30, 2024-09-13T06:43:31.919 INFO:teuthology.orchestra.run.smithi081.stdout: "num_blocked_ops": 0 2024-09-13T06:43:31.919 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:43:31.927 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:43:31.927+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:43:31.933 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-13T06:43:32.028 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:43:32.029+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:43:32.094 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:43:32.094 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 20, 2024-09-13T06:43:32.094 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 600, 2024-09-13T06:43:32.094 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [ 2024-09-13T06:43:32.094 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.094 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:90987 3.6 3:6263dd97:::rbd_object_map.11212443ae03.0000000000000049:head [call] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-13T06:43:32.094 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:41:35.460333+0000", 2024-09-13T06:43:32.094 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 116.632460202, 2024-09-13T06:43:32.095 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0001633640000001, 2024-09-13T06:43:32.095 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:32.095 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:32.095 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:32.095 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:32.095 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:32.095 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 90987 2024-09-13T06:43:32.095 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.095 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:32.095 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.095 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:32.095 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:35.460333+0000", 2024-09-13T06:43:32.095 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:32.096 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.096 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.096 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:32.096 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:35.460333+0000", 2024-09-13T06:43:32.096 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:32.096 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.096 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.096 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:32.096 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:35.460330+0000", 2024-09-13T06:43:32.096 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999971 2024-09-13T06:43:32.096 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.096 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.096 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:32.097 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:35.460343+0000", 2024-09-13T06:43:32.097 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2695e-05 2024-09-13T06:43:32.097 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.097 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.097 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:32.097 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:35.460365+0000", 2024-09-13T06:43:32.097 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2473999999999999e-05 2024-09-13T06:43:32.097 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.097 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.097 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:32.097 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:35.460376+0000", 2024-09-13T06:43:32.097 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0383999999999999e-05 2024-09-13T06:43:32.097 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.097 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.098 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:32.098 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:35.460435+0000", 2024-09-13T06:43:32.098 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8650000000000003e-05 2024-09-13T06:43:32.098 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.098 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.098 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:43:32.098 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:35.460444+0000", 2024-09-13T06:43:32.098 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.0380000000000005e-06 2024-09-13T06:43:32.098 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.098 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.098 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:32.098 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:36.459433+0000", 2024-09-13T06:43:32.098 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.99898895799999998 2024-09-13T06:43:32.099 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.099 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.099 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:32.099 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:36.459622+0000", 2024-09-13T06:43:32.099 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00018940299999999999 2024-09-13T06:43:32.099 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.099 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.099 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:32.099 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:36.460497+0000", 2024-09-13T06:43:32.099 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00087481199999999999 2024-09-13T06:43:32.099 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:32.099 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:32.099 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:32.099 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.100 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.100 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:159632 3.a 3:57f62123:::rbd_header.112138ed422:head [create,call rbd.create in=9b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e167)", 2024-09-13T06:43:32.100 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:42:07.853351+0000", 2024-09-13T06:43:32.100 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 84.239442400000001, 2024-09-13T06:43:32.100 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.95572760999999995, 2024-09-13T06:43:32.100 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:32.100 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:43:32.100 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:32.100 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:32.100 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:32.100 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 159632 2024-09-13T06:43:32.100 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.101 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:32.101 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.101 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:32.101 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:07.853351+0000", 2024-09-13T06:43:32.101 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:32.101 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.101 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.101 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:32.101 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:07.853351+0000", 2024-09-13T06:43:32.101 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:32.101 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.101 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.101 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:32.102 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:07.853350+0000", 2024-09-13T06:43:32.102 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.999999 2024-09-13T06:43:32.102 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.102 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.102 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:32.102 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:07.853356+0000", 2024-09-13T06:43:32.102 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.1560000000000003e-06 2024-09-13T06:43:32.102 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.102 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.102 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:32.102 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:07.853365+0000", 2024-09-13T06:43:32.102 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.8079999999999999e-06 2024-09-13T06:43:32.102 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.103 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.103 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:32.103 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:07.853372+0000", 2024-09-13T06:43:32.103 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.5540000000000003e-06 2024-09-13T06:43:32.103 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.103 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.103 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:32.103 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:07.853430+0000", 2024-09-13T06:43:32.103 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8038000000000002e-05 2024-09-13T06:43:32.103 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.103 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.103 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:43:32.103 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:07.853444+0000", 2024-09-13T06:43:32.104 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3719e-05 2024-09-13T06:43:32.104 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.104 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.104 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:32.104 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:08.804052+0000", 2024-09-13T06:43:32.104 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.95060817799999997 2024-09-13T06:43:32.104 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.104 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.104 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:32.104 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:08.804234+0000", 2024-09-13T06:43:32.104 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00018192999999999999 2024-09-13T06:43:32.104 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.104 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.105 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 6", 2024-09-13T06:43:32.105 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:08.804797+0000", 2024-09-13T06:43:32.105 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00056282399999999996 2024-09-13T06:43:32.105 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.105 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.105 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-09-13T06:43:32.105 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:08.805704+0000", 2024-09-13T06:43:32.105 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00090781 2024-09-13T06:43:32.105 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.105 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.105 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:43:32.105 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:08.808907+0000", 2024-09-13T06:43:32.105 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0032031239999999999 2024-09-13T06:43:32.106 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.106 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.106 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:43:32.106 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:08.808998+0000", 2024-09-13T06:43:32.106 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.0191000000000004e-05 2024-09-13T06:43:32.106 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.106 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.106 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:32.106 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:08.809079+0000", 2024-09-13T06:43:32.106 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.1076999999999996e-05 2024-09-13T06:43:32.106 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:32.106 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:32.106 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:32.107 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.107 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.107 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:209556 3.6 3:673cd4d4:::rbd_data.1121cb4a09ed.0000000000000002:82 [read 831488~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e220)", 2024-09-13T06:43:32.107 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:43:05.152927+0000", 2024-09-13T06:43:32.107 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 26.9398664, 2024-09-13T06:43:32.107 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054987033999999997, 2024-09-13T06:43:32.107 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:32.107 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:32.107 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:32.107 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:32.107 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:32.107 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 209556 2024-09-13T06:43:32.107 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.107 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:32.107 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.108 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:32.108 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.152927+0000", 2024-09-13T06:43:32.108 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:32.108 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.108 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.108 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:32.108 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.152927+0000", 2024-09-13T06:43:32.108 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:32.108 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.108 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.108 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:32.108 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.152927+0000", 2024-09-13T06:43:32.108 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:32.109 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.109 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.109 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:32.109 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.152929+0000", 2024-09-13T06:43:32.109 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.514e-06 2024-09-13T06:43:32.109 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.109 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.109 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:32.109 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.152935+0000", 2024-09-13T06:43:32.109 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.5249999999999996e-06 2024-09-13T06:43:32.109 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.109 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.109 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:32.109 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.152939+0000", 2024-09-13T06:43:32.110 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.3209999999999998e-06 2024-09-13T06:43:32.110 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.110 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.110 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:32.110 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.207752+0000", 2024-09-13T06:43:32.110 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054813273000000003 2024-09-13T06:43:32.110 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.110 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.110 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:32.110 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.207834+0000", 2024-09-13T06:43:32.110 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.1317999999999996e-05 2024-09-13T06:43:32.110 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.110 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.111 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:32.111 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.207914+0000", 2024-09-13T06:43:32.111 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.0568000000000005e-05 2024-09-13T06:43:32.111 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:32.111 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:32.111 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:32.111 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.111 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.111 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:209557 3.6 3:673cd4d4:::rbd_data.1121cb4a09ed.0000000000000002:82 [read 843776~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e220)", 2024-09-13T06:43:32.111 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:43:05.152944+0000", 2024-09-13T06:43:32.111 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 26.939849895999998, 2024-09-13T06:43:32.111 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.055174645000000001, 2024-09-13T06:43:32.111 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:32.112 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:32.112 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:32.112 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:32.112 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:32.112 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 209557 2024-09-13T06:43:32.112 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.112 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:32.112 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.112 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:32.112 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.152944+0000", 2024-09-13T06:43:32.112 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:32.112 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.112 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.113 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:32.113 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.152944+0000", 2024-09-13T06:43:32.113 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:32.113 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.113 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.113 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:32.113 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.152943+0000", 2024-09-13T06:43:32.113 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:32.113 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.113 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.113 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:32.113 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.152946+0000", 2024-09-13T06:43:32.114 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2419999999999999e-06 2024-09-13T06:43:32.114 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.114 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.114 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:32.114 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.152951+0000", 2024-09-13T06:43:32.114 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7570000000000001e-06 2024-09-13T06:43:32.114 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.114 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.114 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:32.114 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.152955+0000", 2024-09-13T06:43:32.114 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.0080000000000004e-06 2024-09-13T06:43:32.114 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.114 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.115 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:32.115 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.207958+0000", 2024-09-13T06:43:32.115 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.055002896000000003 2024-09-13T06:43:32.115 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.115 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.115 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:32.115 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.208041+0000", 2024-09-13T06:43:32.115 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.2962999999999998e-05 2024-09-13T06:43:32.115 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.115 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.115 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:32.115 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.208118+0000", 2024-09-13T06:43:32.115 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.7181000000000005e-05 2024-09-13T06:43:32.115 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:32.115 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:32.116 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:32.116 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.116 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.116 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:209558 3.6 3:673cd4d4:::rbd_data.1121cb4a09ed.0000000000000002:82 [read 856064~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e220)", 2024-09-13T06:43:32.116 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:43:05.152960+0000", 2024-09-13T06:43:32.116 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 26.939833702000001, 2024-09-13T06:43:32.116 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.055296975999999998, 2024-09-13T06:43:32.116 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:32.116 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:32.116 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:32.116 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:32.116 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:32.116 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 209558 2024-09-13T06:43:32.116 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.117 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:32.117 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.117 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:32.117 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.152960+0000", 2024-09-13T06:43:32.117 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:32.117 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.117 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.117 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:32.117 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.152960+0000", 2024-09-13T06:43:32.117 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:32.117 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.117 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.117 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:32.118 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.152959+0000", 2024-09-13T06:43:32.118 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:32.118 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.118 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.118 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:32.118 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.152962+0000", 2024-09-13T06:43:32.118 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6709999999999999e-06 2024-09-13T06:43:32.119 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.119 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.119 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:32.119 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.152968+0000", 2024-09-13T06:43:32.119 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.5589999999999996e-06 2024-09-13T06:43:32.119 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.119 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.119 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:32.119 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.152972+0000", 2024-09-13T06:43:32.119 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.216e-06 2024-09-13T06:43:32.119 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.120 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.120 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:32.120 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.208146+0000", 2024-09-13T06:43:32.120 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.055173627000000003 2024-09-13T06:43:32.120 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.120 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.120 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:32.120 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.208193+0000", 2024-09-13T06:43:32.120 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7200000000000002e-05 2024-09-13T06:43:32.120 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.120 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.120 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:32.120 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.208257+0000", 2024-09-13T06:43:32.120 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.4058000000000002e-05 2024-09-13T06:43:32.121 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:32.121 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:32.121 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:32.121 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.121 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.121 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:209559 3.6 3:673cd4d4:::rbd_data.1121cb4a09ed.0000000000000002:82 [read 868352~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e220)", 2024-09-13T06:43:32.121 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:43:05.152976+0000", 2024-09-13T06:43:32.121 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 26.939817589, 2024-09-13T06:43:32.121 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.055514239, 2024-09-13T06:43:32.121 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:32.121 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:32.121 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:32.122 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:32.122 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:32.122 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 209559 2024-09-13T06:43:32.122 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.122 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:32.122 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.122 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:32.122 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.152976+0000", 2024-09-13T06:43:32.122 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:32.122 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.122 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.122 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:32.122 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.152976+0000", 2024-09-13T06:43:32.122 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:32.123 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.123 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.123 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:32.123 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.152976+0000", 2024-09-13T06:43:32.123 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:32.123 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.123 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.123 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:32.123 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.152978+0000", 2024-09-13T06:43:32.123 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2189999999999998e-06 2024-09-13T06:43:32.123 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.123 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.123 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:32.123 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.152983+0000", 2024-09-13T06:43:32.124 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3639999999999998e-06 2024-09-13T06:43:32.124 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.124 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.124 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:32.124 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.152987+0000", 2024-09-13T06:43:32.124 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.9469999999999996e-06 2024-09-13T06:43:32.124 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.124 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.124 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:32.124 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.208301+0000", 2024-09-13T06:43:32.124 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.055314292000000001 2024-09-13T06:43:32.124 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.124 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.125 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:32.125 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.208385+0000", 2024-09-13T06:43:32.125 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.3755e-05 2024-09-13T06:43:32.125 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.125 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.125 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:32.125 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.208490+0000", 2024-09-13T06:43:32.125 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00010498800000000001 2024-09-13T06:43:32.125 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:32.125 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:32.125 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:32.125 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.125 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.126 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:209560 3.6 3:673cd4d4:::rbd_data.1121cb4a09ed.0000000000000002:82 [read 880640~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e220)", 2024-09-13T06:43:32.126 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:43:05.152991+0000", 2024-09-13T06:43:32.126 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 26.939802499999999, 2024-09-13T06:43:32.126 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.05572912, 2024-09-13T06:43:32.126 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:32.126 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:32.126 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:32.126 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:32.126 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:32.126 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 209560 2024-09-13T06:43:32.126 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.126 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:32.126 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.127 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:32.127 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.152991+0000", 2024-09-13T06:43:32.127 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:32.127 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.127 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.127 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:32.127 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.152991+0000", 2024-09-13T06:43:32.127 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:32.127 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.127 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.127 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:32.127 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.152991+0000", 2024-09-13T06:43:32.127 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:32.128 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.128 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.128 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:32.128 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.152993+0000", 2024-09-13T06:43:32.128 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3159999999999999e-06 2024-09-13T06:43:32.128 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.128 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.128 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:32.128 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.152999+0000", 2024-09-13T06:43:32.128 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8529999999999997e-06 2024-09-13T06:43:32.128 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.128 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.128 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:32.129 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153004+0000", 2024-09-13T06:43:32.129 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6210000000000003e-06 2024-09-13T06:43:32.129 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.129 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.129 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:32.129 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.208530+0000", 2024-09-13T06:43:32.129 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.055526407999999999 2024-09-13T06:43:32.129 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.129 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.129 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:32.129 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.208616+0000", 2024-09-13T06:43:32.129 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.6483000000000005e-05 2024-09-13T06:43:32.130 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.130 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.130 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:32.130 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.208720+0000", 2024-09-13T06:43:32.130 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00010376 2024-09-13T06:43:32.130 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:32.130 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:32.130 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:32.130 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.130 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.130 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:209561 3.6 3:673cd4d4:::rbd_data.1121cb4a09ed.0000000000000002:82 [read 892928~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e220)", 2024-09-13T06:43:32.130 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:43:05.153008+0000", 2024-09-13T06:43:32.130 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 26.939785606000001, 2024-09-13T06:43:32.131 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0559225, 2024-09-13T06:43:32.131 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:32.131 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:32.131 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:32.131 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:32.131 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:32.131 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 209561 2024-09-13T06:43:32.131 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.131 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:32.131 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.131 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:32.131 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153008+0000", 2024-09-13T06:43:32.131 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:32.132 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.132 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.132 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:32.132 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153008+0000", 2024-09-13T06:43:32.132 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:32.132 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.132 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.132 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:32.132 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153008+0000", 2024-09-13T06:43:32.132 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:32.132 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.132 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.132 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:32.132 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153010+0000", 2024-09-13T06:43:32.133 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.8210000000000002e-06 2024-09-13T06:43:32.133 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.133 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.133 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:32.133 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153016+0000", 2024-09-13T06:43:32.133 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.575e-06 2024-09-13T06:43:32.133 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.133 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.133 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:32.133 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153020+0000", 2024-09-13T06:43:32.133 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.408e-06 2024-09-13T06:43:32.133 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.133 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.133 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:32.134 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.208751+0000", 2024-09-13T06:43:32.134 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.055730225000000001 2024-09-13T06:43:32.134 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.134 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.134 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:32.134 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.208825+0000", 2024-09-13T06:43:32.134 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4548999999999994e-05 2024-09-13T06:43:32.134 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.134 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.134 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:32.134 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.208930+0000", 2024-09-13T06:43:32.134 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00010529700000000001 2024-09-13T06:43:32.135 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:32.135 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:32.135 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:32.135 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.135 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.135 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:209562 3.6 3:673cd4d4:::rbd_data.1121cb4a09ed.0000000000000002:82 [read 905216~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e220)", 2024-09-13T06:43:32.135 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:43:05.153024+0000", 2024-09-13T06:43:32.135 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 26.939769179999999, 2024-09-13T06:43:32.135 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.056099906999999997, 2024-09-13T06:43:32.135 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:32.135 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:32.135 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:32.135 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:32.135 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:32.135 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 209562 2024-09-13T06:43:32.136 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.136 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:32.136 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.136 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:32.136 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153024+0000", 2024-09-13T06:43:32.136 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:32.136 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.136 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.136 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:32.136 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153024+0000", 2024-09-13T06:43:32.136 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:32.136 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.137 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.137 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:32.137 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153024+0000", 2024-09-13T06:43:32.137 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:32.137 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.137 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.137 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:32.137 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153026+0000", 2024-09-13T06:43:32.137 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.165e-06 2024-09-13T06:43:32.137 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.137 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.137 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:32.137 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153031+0000", 2024-09-13T06:43:32.138 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.1669999999999998e-06 2024-09-13T06:43:32.138 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.138 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.138 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:32.138 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153035+0000", 2024-09-13T06:43:32.138 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.0799999999999999e-06 2024-09-13T06:43:32.138 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.138 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.138 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:32.138 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.208956+0000", 2024-09-13T06:43:32.138 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.055920848000000002 2024-09-13T06:43:32.138 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.139 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.139 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:32.139 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.209032+0000", 2024-09-13T06:43:32.139 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5809999999999994e-05 2024-09-13T06:43:32.139 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.139 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.139 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:32.139 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.209124+0000", 2024-09-13T06:43:32.139 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.2157999999999994e-05 2024-09-13T06:43:32.139 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:32.139 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:32.139 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:32.139 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.140 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.140 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:209563 3.6 3:673cd4d4:::rbd_data.1121cb4a09ed.0000000000000002:82 [read 917504~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e220)", 2024-09-13T06:43:32.140 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:43:05.153039+0000", 2024-09-13T06:43:32.140 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 26.939754217000001, 2024-09-13T06:43:32.140 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.056280030000000002, 2024-09-13T06:43:32.140 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:32.140 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:32.140 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:32.140 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:32.140 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:32.140 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 209563 2024-09-13T06:43:32.140 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.140 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:32.140 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.140 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:32.141 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153039+0000", 2024-09-13T06:43:32.141 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:32.141 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.141 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.141 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:32.141 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153039+0000", 2024-09-13T06:43:32.141 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:32.141 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.141 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.141 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:32.141 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153039+0000", 2024-09-13T06:43:32.141 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:32.141 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.141 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.142 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:32.142 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153041+0000", 2024-09-13T06:43:32.142 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3800000000000001e-06 2024-09-13T06:43:32.142 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.142 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.142 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:32.142 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153047+0000", 2024-09-13T06:43:32.142 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2059999999999998e-06 2024-09-13T06:43:32.142 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.142 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.142 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:32.142 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153051+0000", 2024-09-13T06:43:32.142 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.0980000000000004e-06 2024-09-13T06:43:32.143 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.143 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.143 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:32.143 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.209150+0000", 2024-09-13T06:43:32.143 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.056099351999999998 2024-09-13T06:43:32.143 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.143 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.143 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:32.143 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.209226+0000", 2024-09-13T06:43:32.143 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5939999999999995e-05 2024-09-13T06:43:32.143 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.143 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.143 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:32.144 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.209319+0000", 2024-09-13T06:43:32.144 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.3399000000000005e-05 2024-09-13T06:43:32.144 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:32.144 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:32.144 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:32.144 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.144 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.144 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:209564 3.6 3:673cd4d4:::rbd_data.1121cb4a09ed.0000000000000002:82 [read 929792~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e220)", 2024-09-13T06:43:32.144 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:43:05.153055+0000", 2024-09-13T06:43:32.144 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 26.939738971000001, 2024-09-13T06:43:32.144 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.056404468999999999, 2024-09-13T06:43:32.144 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:32.144 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:32.145 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:32.145 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:32.145 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:32.145 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 209564 2024-09-13T06:43:32.145 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.145 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:32.145 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.145 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:32.145 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153055+0000", 2024-09-13T06:43:32.145 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:32.145 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.145 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.145 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:32.145 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153055+0000", 2024-09-13T06:43:32.146 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:32.146 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.146 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.146 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:32.146 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153054+0000", 2024-09-13T06:43:32.146 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:32.146 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.146 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.146 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:32.146 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153056+0000", 2024-09-13T06:43:32.146 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1600000000000001e-06 2024-09-13T06:43:32.146 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.146 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.147 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:32.147 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153062+0000", 2024-09-13T06:43:32.147 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2549999999999997e-06 2024-09-13T06:43:32.147 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.147 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.147 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:32.147 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153066+0000", 2024-09-13T06:43:32.147 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.0400000000000003e-06 2024-09-13T06:43:32.147 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.147 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.147 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:32.147 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.209342+0000", 2024-09-13T06:43:32.147 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.056276640000000003 2024-09-13T06:43:32.148 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.148 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.148 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:32.148 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.209382+0000", 2024-09-13T06:43:32.148 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.9626999999999999e-05 2024-09-13T06:43:32.148 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.148 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.148 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:32.148 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.209459+0000", 2024-09-13T06:43:32.148 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.7072999999999999e-05 2024-09-13T06:43:32.148 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:32.148 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:32.148 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:32.148 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.149 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.149 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:209565 3.6 3:673cd4d4:::rbd_data.1121cb4a09ed.0000000000000002:82 [read 942080~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e220)", 2024-09-13T06:43:32.149 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:43:05.153070+0000", 2024-09-13T06:43:32.149 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 26.939723998000002, 2024-09-13T06:43:32.149 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.056688545999999999, 2024-09-13T06:43:32.149 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:32.149 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:32.149 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:32.149 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:32.149 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:32.149 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 209565 2024-09-13T06:43:32.149 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.149 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:32.150 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.150 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:32.150 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153070+0000", 2024-09-13T06:43:32.150 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:32.150 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.150 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.150 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:32.150 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153070+0000", 2024-09-13T06:43:32.150 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:32.150 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.150 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.150 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:32.150 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153069+0000", 2024-09-13T06:43:32.151 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:32.151 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.151 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.151 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:32.151 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153071+0000", 2024-09-13T06:43:32.151 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1780000000000002e-06 2024-09-13T06:43:32.151 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.151 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.151 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:32.151 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153077+0000", 2024-09-13T06:43:32.151 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3639999999999998e-06 2024-09-13T06:43:32.151 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.151 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.151 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:32.152 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153081+0000", 2024-09-13T06:43:32.152 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.1640000000000003e-06 2024-09-13T06:43:32.152 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.152 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.152 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:32.152 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.209486+0000", 2024-09-13T06:43:32.152 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.056405258999999999 2024-09-13T06:43:32.152 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.152 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.152 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:32.152 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.209560+0000", 2024-09-13T06:43:32.152 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4247999999999998e-05 2024-09-13T06:43:32.152 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.153 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.153 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:32.153 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.209758+0000", 2024-09-13T06:43:32.153 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000197634 2024-09-13T06:43:32.153 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:32.153 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:32.153 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:32.153 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.153 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.153 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:209566 3.6 3:673cd4d4:::rbd_data.1121cb4a09ed.0000000000000002:82 [read 954368~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e220)", 2024-09-13T06:43:32.153 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:43:05.153085+0000", 2024-09-13T06:43:32.153 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 26.939708689, 2024-09-13T06:43:32.153 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.057070779000000002, 2024-09-13T06:43:32.154 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:32.154 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:32.154 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:32.154 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:32.154 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:32.154 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 209566 2024-09-13T06:43:32.154 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.154 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:32.154 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.154 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:32.154 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153085+0000", 2024-09-13T06:43:32.154 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:32.154 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.154 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.155 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:32.155 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153085+0000", 2024-09-13T06:43:32.155 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:32.155 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.155 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.155 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:32.155 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153085+0000", 2024-09-13T06:43:32.155 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:32.155 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.155 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.155 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:32.155 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153087+0000", 2024-09-13T06:43:32.155 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1220000000000002e-06 2024-09-13T06:43:32.155 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.156 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.156 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:32.156 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153092+0000", 2024-09-13T06:43:32.156 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3090000000000003e-06 2024-09-13T06:43:32.156 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.156 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.156 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:32.156 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153096+0000", 2024-09-13T06:43:32.156 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.1819999999999999e-06 2024-09-13T06:43:32.156 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.156 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.156 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:32.156 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.209787+0000", 2024-09-13T06:43:32.156 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.056690819000000003 2024-09-13T06:43:32.157 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.157 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.157 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:32.157 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.209863+0000", 2024-09-13T06:43:32.157 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5551999999999998e-05 2024-09-13T06:43:32.157 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.157 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.157 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:32.157 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.210156+0000", 2024-09-13T06:43:32.157 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00029310499999999999 2024-09-13T06:43:32.157 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:32.157 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:32.157 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:32.157 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.158 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.158 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:209567 3.6 3:673cd4d4:::rbd_data.1121cb4a09ed.0000000000000002:82 [read 966656~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e220)", 2024-09-13T06:43:32.158 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:43:05.153100+0000", 2024-09-13T06:43:32.158 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 26.939693316, 2024-09-13T06:43:32.158 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.057459567000000003, 2024-09-13T06:43:32.158 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:32.158 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:32.158 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:32.158 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:32.158 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:32.158 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 209567 2024-09-13T06:43:32.158 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.158 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:32.159 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.159 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:32.159 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153100+0000", 2024-09-13T06:43:32.159 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:32.159 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.159 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.159 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:32.159 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153100+0000", 2024-09-13T06:43:32.159 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:32.159 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.159 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.159 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:32.159 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153100+0000", 2024-09-13T06:43:32.159 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:32.160 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.160 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.160 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:32.160 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153105+0000", 2024-09-13T06:43:32.160 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.5400000000000003e-06 2024-09-13T06:43:32.160 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.160 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.160 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:32.160 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153111+0000", 2024-09-13T06:43:32.160 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.541e-06 2024-09-13T06:43:32.160 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.160 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.160 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:32.160 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153115+0000", 2024-09-13T06:43:32.161 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.104e-06 2024-09-13T06:43:32.161 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.161 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.161 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:32.161 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.210183+0000", 2024-09-13T06:43:32.161 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.057067842000000001 2024-09-13T06:43:32.161 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.161 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.161 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:32.161 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.210257+0000", 2024-09-13T06:43:32.161 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3726999999999994e-05 2024-09-13T06:43:32.161 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.161 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.161 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:32.162 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.210560+0000", 2024-09-13T06:43:32.162 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00030318899999999999 2024-09-13T06:43:32.162 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:32.162 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:32.162 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:32.162 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.162 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.162 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:209568 3.6 3:673cd4d4:::rbd_data.1121cb4a09ed.0000000000000002:82 [read 978944~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e220)", 2024-09-13T06:43:32.162 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:43:05.153119+0000", 2024-09-13T06:43:32.162 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 26.939674115999999, 2024-09-13T06:43:32.162 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.057810786000000003, 2024-09-13T06:43:32.162 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:32.162 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:32.162 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:32.162 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:32.162 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:32.163 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 209568 2024-09-13T06:43:32.163 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.163 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:32.163 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.163 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:32.163 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153119+0000", 2024-09-13T06:43:32.163 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:32.163 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.163 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.163 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:32.163 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153119+0000", 2024-09-13T06:43:32.163 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:32.163 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.163 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.164 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:32.164 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153119+0000", 2024-09-13T06:43:32.164 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:32.164 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.164 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.164 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:32.164 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153121+0000", 2024-09-13T06:43:32.164 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.21e-06 2024-09-13T06:43:32.164 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.164 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.164 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:32.164 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153127+0000", 2024-09-13T06:43:32.164 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.4670000000000003e-06 2024-09-13T06:43:32.164 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.165 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.165 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:32.165 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153131+0000", 2024-09-13T06:43:32.165 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.2629999999999997e-06 2024-09-13T06:43:32.165 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.165 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.165 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:32.165 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.210587+0000", 2024-09-13T06:43:32.165 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.05745567 2024-09-13T06:43:32.165 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.165 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.165 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:32.165 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.210660+0000", 2024-09-13T06:43:32.166 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3430000000000007e-05 2024-09-13T06:43:32.166 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.166 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.166 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:32.166 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.210930+0000", 2024-09-13T06:43:32.166 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000270127 2024-09-13T06:43:32.166 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:32.166 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:32.166 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:32.166 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.166 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.166 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:209569 3.6 3:673cd4d4:::rbd_data.1121cb4a09ed.0000000000000002:82 [read 991232~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e220)", 2024-09-13T06:43:32.166 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:43:05.153135+0000", 2024-09-13T06:43:32.166 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 26.939658690999998, 2024-09-13T06:43:32.166 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.058283125999999998, 2024-09-13T06:43:32.167 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:32.167 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:32.167 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:32.167 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:32.167 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:32.167 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 209569 2024-09-13T06:43:32.167 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.167 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:32.167 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.167 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:32.168 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153135+0000", 2024-09-13T06:43:32.168 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:32.168 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.168 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.168 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:32.168 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153135+0000", 2024-09-13T06:43:32.168 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:32.168 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.168 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.168 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:32.168 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153135+0000", 2024-09-13T06:43:32.168 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:32.169 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.169 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.169 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:32.169 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153136+0000", 2024-09-13T06:43:32.169 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9069999999999999e-06 2024-09-13T06:43:32.169 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.169 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.169 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:32.169 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153142+0000", 2024-09-13T06:43:32.169 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3009999999999997e-06 2024-09-13T06:43:32.169 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.169 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.169 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:32.170 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153146+0000", 2024-09-13T06:43:32.170 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.442e-06 2024-09-13T06:43:32.170 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.170 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.170 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:32.170 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.210959+0000", 2024-09-13T06:43:32.170 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.057812456999999998 2024-09-13T06:43:32.170 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.170 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.170 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:32.170 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.211038+0000", 2024-09-13T06:43:32.170 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.9140999999999993e-05 2024-09-13T06:43:32.170 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.170 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.171 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:32.171 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.211418+0000", 2024-09-13T06:43:32.171 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00038017500000000001 2024-09-13T06:43:32.171 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:32.171 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:32.171 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:32.171 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.171 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.171 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:209570 3.6 3:673cd4d4:::rbd_data.1121cb4a09ed.0000000000000002:82 [read 1003520~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e220)", 2024-09-13T06:43:32.171 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:43:05.153151+0000", 2024-09-13T06:43:32.171 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 26.939642807999999, 2024-09-13T06:43:32.171 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.058499886000000001, 2024-09-13T06:43:32.171 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:32.171 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:32.171 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:32.172 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:32.172 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:32.172 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 209570 2024-09-13T06:43:32.172 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.172 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:32.172 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.172 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:32.172 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153151+0000", 2024-09-13T06:43:32.172 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:32.172 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.172 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.172 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:32.172 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153151+0000", 2024-09-13T06:43:32.172 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:32.172 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.173 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.173 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:32.173 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153150+0000", 2024-09-13T06:43:32.173 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:32.173 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.173 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.173 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:32.173 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153153+0000", 2024-09-13T06:43:32.173 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3630000000000001e-06 2024-09-13T06:43:32.173 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.173 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.173 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:32.173 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153159+0000", 2024-09-13T06:43:32.173 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3690000000000003e-06 2024-09-13T06:43:32.174 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.174 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.174 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:32.174 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153164+0000", 2024-09-13T06:43:32.174 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5379999999999996e-06 2024-09-13T06:43:32.174 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.174 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.174 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:32.174 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.211448+0000", 2024-09-13T06:43:32.174 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.058283926 2024-09-13T06:43:32.175 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.175 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.175 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:32.175 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.211508+0000", 2024-09-13T06:43:32.175 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0741e-05 2024-09-13T06:43:32.175 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.175 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.175 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:32.175 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.211651+0000", 2024-09-13T06:43:32.175 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00014232200000000001 2024-09-13T06:43:32.175 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:32.175 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:32.175 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:32.176 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.176 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.176 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:209571 3.6 3:673cd4d4:::rbd_data.1121cb4a09ed.0000000000000002:82 [read 1015808~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e220)", 2024-09-13T06:43:32.176 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:43:05.153168+0000", 2024-09-13T06:43:32.176 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 26.939625296999999, 2024-09-13T06:43:32.176 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.058709363000000001, 2024-09-13T06:43:32.176 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:32.176 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:32.176 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:32.176 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:32.176 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:32.176 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 209571 2024-09-13T06:43:32.176 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.176 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:32.177 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.177 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:32.177 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153168+0000", 2024-09-13T06:43:32.177 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:32.177 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.177 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.177 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:32.177 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153168+0000", 2024-09-13T06:43:32.177 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:32.177 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.177 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.177 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:32.177 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153168+0000", 2024-09-13T06:43:32.178 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:32.178 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.178 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.178 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:32.178 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153170+0000", 2024-09-13T06:43:32.178 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4499999999999998e-06 2024-09-13T06:43:32.178 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.178 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.178 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:32.178 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153176+0000", 2024-09-13T06:43:32.178 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0050000000000001e-06 2024-09-13T06:43:32.178 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.178 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.178 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:32.179 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153181+0000", 2024-09-13T06:43:32.179 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.267e-06 2024-09-13T06:43:32.179 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.179 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.179 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:32.179 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.211678+0000", 2024-09-13T06:43:32.179 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.058497751000000001 2024-09-13T06:43:32.179 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.179 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.179 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:32.179 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.211744+0000", 2024-09-13T06:43:32.179 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.5266999999999997e-05 2024-09-13T06:43:32.179 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.179 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.179 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:32.179 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.211878+0000", 2024-09-13T06:43:32.180 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00013394500000000001 2024-09-13T06:43:32.180 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:32.180 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:32.180 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:32.180 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.180 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.180 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:209572 3.6 3:673cd4d4:::rbd_data.1121cb4a09ed.0000000000000002:82 [read 1028096~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e220)", 2024-09-13T06:43:32.180 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:43:05.153185+0000", 2024-09-13T06:43:32.180 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 26.939608902, 2024-09-13T06:43:32.180 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.058928534999999997, 2024-09-13T06:43:32.180 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:32.180 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:32.180 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:32.180 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:32.181 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:32.181 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 209572 2024-09-13T06:43:32.181 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.181 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:32.181 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.181 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:32.181 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153185+0000", 2024-09-13T06:43:32.181 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:32.181 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.181 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.181 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:32.181 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153185+0000", 2024-09-13T06:43:32.181 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:32.182 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.182 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.182 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:32.182 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153184+0000", 2024-09-13T06:43:32.182 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:32.182 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.182 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.182 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:32.182 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153186+0000", 2024-09-13T06:43:32.182 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1040000000000001e-06 2024-09-13T06:43:32.182 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.182 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.182 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:32.182 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153191+0000", 2024-09-13T06:43:32.183 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0409999999999997e-06 2024-09-13T06:43:32.183 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.183 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.183 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:32.183 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153196+0000", 2024-09-13T06:43:32.183 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.2200000000000003e-06 2024-09-13T06:43:32.183 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.183 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.183 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:32.183 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.211906+0000", 2024-09-13T06:43:32.183 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.058709960999999998 2024-09-13T06:43:32.183 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.183 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.184 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:32.184 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.211977+0000", 2024-09-13T06:43:32.184 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.1080000000000004e-05 2024-09-13T06:43:32.184 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.184 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.184 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:32.184 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.212113+0000", 2024-09-13T06:43:32.184 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00013644500000000001 2024-09-13T06:43:32.184 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:32.184 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:32.184 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:32.184 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.184 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.184 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:209573 3.6 3:673cd4d4:::rbd_data.1121cb4a09ed.0000000000000002:82 [read 1040384~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e220)", 2024-09-13T06:43:32.185 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:43:05.153199+0000", 2024-09-13T06:43:32.185 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 26.939594112000002, 2024-09-13T06:43:32.185 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.059182414000000003, 2024-09-13T06:43:32.185 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:32.185 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:32.185 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:32.185 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:32.185 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:32.185 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 209573 2024-09-13T06:43:32.185 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.185 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:32.185 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.185 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:32.185 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153199+0000", 2024-09-13T06:43:32.186 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:32.186 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.186 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.186 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:32.186 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153199+0000", 2024-09-13T06:43:32.186 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:32.186 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.186 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.186 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:32.186 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153199+0000", 2024-09-13T06:43:32.186 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:32.186 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.186 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.186 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:32.187 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153201+0000", 2024-09-13T06:43:32.187 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0470000000000001e-06 2024-09-13T06:43:32.187 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.187 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.187 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:32.187 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153207+0000", 2024-09-13T06:43:32.187 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3730000000000001e-06 2024-09-13T06:43:32.187 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.187 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.187 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:32.187 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153211+0000", 2024-09-13T06:43:32.187 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.053e-06 2024-09-13T06:43:32.187 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.188 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.188 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:32.188 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.212141+0000", 2024-09-13T06:43:32.188 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.058930064999999997 2024-09-13T06:43:32.188 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.188 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.188 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:32.188 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.212214+0000", 2024-09-13T06:43:32.188 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3096999999999995e-05 2024-09-13T06:43:32.188 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.188 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.188 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:32.188 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.212382+0000", 2024-09-13T06:43:32.188 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000168138 2024-09-13T06:43:32.189 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:32.189 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:32.189 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:32.189 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:32.189 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:32.189 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:43:32.190 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-13T06:43:32.191 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:43:32.189+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:43:32.292 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:43:32.291+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:43:32.318 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:43:32.318 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-13T06:43:32.318 INFO:teuthology.orchestra.run.smithi081.stdout: "num_ops": 0 2024-09-13T06:43:32.318 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:43:32.332 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-13T06:43:32.392 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:43:32.393+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:43:32.412 INFO:teuthology.orchestra.run.smithi081.stderr:noscrub is unset 2024-09-13T06:43:32.493 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:43:32.491+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:43:32.507 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:43:32.507 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-13T06:43:32.507 INFO:teuthology.orchestra.run.smithi081.stdout: "complaint_time": 30, 2024-09-13T06:43:32.507 INFO:teuthology.orchestra.run.smithi081.stdout: "num_blocked_ops": 0 2024-09-13T06:43:32.507 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:43:32.522 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-13T06:43:32.584 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 7, 5, 3, 4] out_osds: [6] dead_osds: [6] live_osds: [0, 1, 2, 3, 4, 5, 7] 2024-09-13T06:43:32.584 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-13T06:43:32.584 INFO:tasks.thrashosds.thrasher:Removing osd 1, in_osds are: [0, 1, 2, 7, 5, 3, 4] 2024-09-13T06:43:32.584 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd out 1 2024-09-13T06:43:32.610 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:43:32.611+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:43:32.694 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:43:32.694 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 20, 2024-09-13T06:43:32.694 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 600, 2024-09-13T06:43:32.694 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [ 2024-09-13T06:43:32.695 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.695 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:36160 3.f 3:f62782c2:::rbd_object_map.11219660270d.0000000000000016:head [call] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-13T06:43:32.695 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:01.607291+0000", 2024-09-13T06:43:32.695 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 211.08537259299999, 2024-09-13T06:43:32.695 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.99619456699999998, 2024-09-13T06:43:32.695 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:32.695 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:32.695 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:32.695 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:32.695 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:32.695 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 36160 2024-09-13T06:43:32.695 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.695 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:32.695 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.696 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:32.696 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:01.607291+0000", 2024-09-13T06:43:32.696 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:32.696 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.696 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.696 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:32.696 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:01.607291+0000", 2024-09-13T06:43:32.696 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:32.696 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.696 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.696 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:32.696 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:01.607289+0000", 2024-09-13T06:43:32.696 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999976 2024-09-13T06:43:32.696 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.697 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.697 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:32.697 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:01.607302+0000", 2024-09-13T06:43:32.697 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3018e-05 2024-09-13T06:43:32.697 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.697 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.697 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:32.697 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:01.607323+0000", 2024-09-13T06:43:32.697 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1030999999999999e-05 2024-09-13T06:43:32.697 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.697 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.697 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:32.697 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:01.607342+0000", 2024-09-13T06:43:32.698 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8961e-05 2024-09-13T06:43:32.698 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.698 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.698 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:32.698 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:01.607425+0000", 2024-09-13T06:43:32.698 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.3171999999999996e-05 2024-09-13T06:43:32.698 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.698 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.698 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:43:32.698 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:01.607441+0000", 2024-09-13T06:43:32.698 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5996999999999999e-05 2024-09-13T06:43:32.698 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.698 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.698 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:32.699 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:02.596186+0000", 2024-09-13T06:43:32.699 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.98874432000000001 2024-09-13T06:43:32.699 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.699 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.699 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for missing object", 2024-09-13T06:43:32.699 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:02.596618+0000", 2024-09-13T06:43:32.699 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000432032 2024-09-13T06:43:32.699 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.699 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.699 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:32.699 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:02.600845+0000", 2024-09-13T06:43:32.699 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0042277410000000001 2024-09-13T06:43:32.699 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.699 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.699 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:32.699 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:02.601003+0000", 2024-09-13T06:43:32.700 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00015731999999999999 2024-09-13T06:43:32.700 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.700 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.700 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:32.700 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:02.603486+0000", 2024-09-13T06:43:32.700 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0024832510000000001 2024-09-13T06:43:32.700 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:32.700 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:32.700 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:32.700 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.700 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.700 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:37806 3.9 3:951cb95b:::rbd_data.1121d8143c6e.0000000000000002:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e56)", 2024-09-13T06:43:32.700 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:06.373482+0000", 2024-09-13T06:43:32.700 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 206.31918155700001, 2024-09-13T06:43:32.701 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.002476213, 2024-09-13T06:43:32.701 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:32.701 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:32.701 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:32.701 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:32.701 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:32.701 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 37806 2024-09-13T06:43:32.701 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.701 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:32.701 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.701 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:32.701 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.373482+0000", 2024-09-13T06:43:32.702 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:32.702 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.702 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.702 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:32.702 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.373482+0000", 2024-09-13T06:43:32.702 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:32.702 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.702 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.702 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:32.702 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.373479+0000", 2024-09-13T06:43:32.702 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999962 2024-09-13T06:43:32.702 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.702 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.702 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:32.703 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.373495+0000", 2024-09-13T06:43:32.703 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6640999999999999e-05 2024-09-13T06:43:32.703 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.703 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.703 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:32.703 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.373542+0000", 2024-09-13T06:43:32.703 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6229000000000001e-05 2024-09-13T06:43:32.703 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.703 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.703 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:32.703 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.373564+0000", 2024-09-13T06:43:32.703 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2684000000000002e-05 2024-09-13T06:43:32.703 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.703 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.704 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:32.704 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374268+0000", 2024-09-13T06:43:32.704 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00070363700000000001 2024-09-13T06:43:32.704 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.704 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.704 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:43:32.704 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374305+0000", 2024-09-13T06:43:32.704 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.6936e-05 2024-09-13T06:43:32.704 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.704 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.704 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:32.704 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.375175+0000", 2024-09-13T06:43:32.704 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.000870454 2024-09-13T06:43:32.705 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.705 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.705 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:32.705 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.375678+0000", 2024-09-13T06:43:32.705 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00050292499999999999 2024-09-13T06:43:32.705 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.705 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.705 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:32.705 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.375959+0000", 2024-09-13T06:43:32.705 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00028050599999999997 2024-09-13T06:43:32.705 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:32.705 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:32.705 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:32.706 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.706 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.706 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:37821 3.9 3:951cb95b:::rbd_data.1121d8143c6e.0000000000000002:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e56)", 2024-09-13T06:43:32.706 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:06.374454+0000", 2024-09-13T06:43:32.706 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 206.31821044, 2024-09-13T06:43:32.706 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.002545072, 2024-09-13T06:43:32.706 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:32.706 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:32.706 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:32.706 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:32.706 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:32.706 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 37821 2024-09-13T06:43:32.706 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.707 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:32.707 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.707 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:32.707 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374454+0000", 2024-09-13T06:43:32.707 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:32.707 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.707 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.707 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:32.707 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374454+0000", 2024-09-13T06:43:32.707 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:32.707 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.707 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.707 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:32.707 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374452+0000", 2024-09-13T06:43:32.708 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999981 2024-09-13T06:43:32.708 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.708 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.708 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:32.708 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374463+0000", 2024-09-13T06:43:32.708 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0756e-05 2024-09-13T06:43:32.708 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.708 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.708 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:32.708 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374487+0000", 2024-09-13T06:43:32.708 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4887000000000001e-05 2024-09-13T06:43:32.708 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.709 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.709 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:32.709 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374504+0000", 2024-09-13T06:43:32.709 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6852000000000001e-05 2024-09-13T06:43:32.709 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.709 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.709 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:32.709 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374829+0000", 2024-09-13T06:43:32.709 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000324684 2024-09-13T06:43:32.709 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.709 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.709 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:43:32.709 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374880+0000", 2024-09-13T06:43:32.710 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.1378000000000002e-05 2024-09-13T06:43:32.710 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.710 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.710 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:32.710 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.376423+0000", 2024-09-13T06:43:32.710 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.001542734 2024-09-13T06:43:32.710 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.710 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.710 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:32.710 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.376607+0000", 2024-09-13T06:43:32.710 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000183656 2024-09-13T06:43:32.710 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.710 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.710 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:32.711 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.376999+0000", 2024-09-13T06:43:32.711 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00039191200000000001 2024-09-13T06:43:32.711 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:32.711 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:32.711 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:32.711 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.711 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.711 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:37836 3.9 3:951cb95b:::rbd_data.1121d8143c6e.0000000000000002:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e56)", 2024-09-13T06:43:32.711 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:06.374929+0000", 2024-09-13T06:43:32.711 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 206.317734788, 2024-09-13T06:43:32.711 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.002778825, 2024-09-13T06:43:32.711 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:32.711 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:32.711 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:32.712 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:32.712 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:32.712 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 37836 2024-09-13T06:43:32.712 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.712 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:32.712 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.712 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:32.712 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374929+0000", 2024-09-13T06:43:32.712 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:32.712 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.712 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.712 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:32.712 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374929+0000", 2024-09-13T06:43:32.713 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:32.713 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.713 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.713 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:32.713 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374927+0000", 2024-09-13T06:43:32.713 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999981 2024-09-13T06:43:32.713 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.713 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.713 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:32.713 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374939+0000", 2024-09-13T06:43:32.713 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1846e-05 2024-09-13T06:43:32.713 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.713 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.714 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:32.714 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374962+0000", 2024-09-13T06:43:32.714 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3054e-05 2024-09-13T06:43:32.714 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.714 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.714 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:32.714 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374978+0000", 2024-09-13T06:43:32.714 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5899000000000001e-05 2024-09-13T06:43:32.714 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.714 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.714 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:32.714 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.375106+0000", 2024-09-13T06:43:32.714 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00012789 2024-09-13T06:43:32.714 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.714 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.715 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:43:32.715 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.375134+0000", 2024-09-13T06:43:32.715 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.8254000000000001e-05 2024-09-13T06:43:32.715 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.715 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.715 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:32.715 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.377082+0000", 2024-09-13T06:43:32.715 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0019471520000001 2024-09-13T06:43:32.715 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.715 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.715 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:32.716 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.377330+0000", 2024-09-13T06:43:32.716 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00024834199999999997 2024-09-13T06:43:32.716 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.716 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.716 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:32.716 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.377708+0000", 2024-09-13T06:43:32.716 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00037817100000000001 2024-09-13T06:43:32.716 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:32.716 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:32.716 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:32.716 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.716 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.716 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:37851 3.9 3:951cb95b:::rbd_data.1121d8143c6e.0000000000000002:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e56)", 2024-09-13T06:43:32.717 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:06.382636+0000", 2024-09-13T06:43:32.717 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 206.31002790299999, 2024-09-13T06:43:32.717 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.99582539400000003, 2024-09-13T06:43:32.717 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:32.717 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:32.717 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:32.717 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:32.717 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:32.717 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 37851 2024-09-13T06:43:32.717 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.717 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:32.717 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.717 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:32.718 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.382636+0000", 2024-09-13T06:43:32.718 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:32.718 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.718 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.718 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:32.718 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.382636+0000", 2024-09-13T06:43:32.718 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:32.718 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.718 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.718 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:32.718 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.382633+0000", 2024-09-13T06:43:32.718 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999971 2024-09-13T06:43:32.718 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.719 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.719 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:32.719 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.382652+0000", 2024-09-13T06:43:32.719 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8834999999999998e-05 2024-09-13T06:43:32.719 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.719 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.719 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:32.719 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.382695+0000", 2024-09-13T06:43:32.719 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.3136000000000002e-05 2024-09-13T06:43:32.719 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.719 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.719 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:32.719 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.382716+0000", 2024-09-13T06:43:32.719 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1421e-05 2024-09-13T06:43:32.720 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.720 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.720 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:32.720 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.382860+0000", 2024-09-13T06:43:32.720 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00014389200000000001 2024-09-13T06:43:32.720 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.720 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.720 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:43:32.720 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.382890+0000", 2024-09-13T06:43:32.720 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9827000000000001e-05 2024-09-13T06:43:32.720 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.720 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.720 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:32.720 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.377779+0000", 2024-09-13T06:43:32.721 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.99488842899999996 2024-09-13T06:43:32.721 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.721 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.721 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:32.721 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.378007+0000", 2024-09-13T06:43:32.721 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00022838099999999999 2024-09-13T06:43:32.721 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.721 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.721 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:32.721 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.378462+0000", 2024-09-13T06:43:32.721 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00045452300000000003 2024-09-13T06:43:32.721 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:32.721 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:32.722 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:32.722 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.722 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.722 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:37866 3.9 3:951cb95b:::rbd_data.1121d8143c6e.0000000000000002:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e56)", 2024-09-13T06:43:32.722 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:06.383951+0000", 2024-09-13T06:43:32.722 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 206.30871321699999, 2024-09-13T06:43:32.722 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.99517962299999996, 2024-09-13T06:43:32.722 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:32.722 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:32.722 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:32.722 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:32.722 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:32.722 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 37866 2024-09-13T06:43:32.722 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.722 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:32.723 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.723 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:32.723 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.383951+0000", 2024-09-13T06:43:32.723 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:32.723 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.723 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.723 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:32.723 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.383951+0000", 2024-09-13T06:43:32.723 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:32.723 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.723 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.723 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:32.723 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.383949+0000", 2024-09-13T06:43:32.724 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999981 2024-09-13T06:43:32.724 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.724 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.724 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:32.724 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.383961+0000", 2024-09-13T06:43:32.724 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1999e-05 2024-09-13T06:43:32.724 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.724 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.724 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:32.724 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384019+0000", 2024-09-13T06:43:32.724 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7621000000000003e-05 2024-09-13T06:43:32.724 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.725 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.725 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:32.725 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384040+0000", 2024-09-13T06:43:32.725 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1528000000000001e-05 2024-09-13T06:43:32.725 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.725 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.725 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:32.725 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384186+0000", 2024-09-13T06:43:32.725 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00014573799999999999 2024-09-13T06:43:32.725 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.725 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.725 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:43:32.725 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384204+0000", 2024-09-13T06:43:32.726 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7992e-05 2024-09-13T06:43:32.726 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.726 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.726 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:32.726 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.378536+0000", 2024-09-13T06:43:32.726 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.99433268600000002 2024-09-13T06:43:32.726 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.726 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.726 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:32.726 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.378771+0000", 2024-09-13T06:43:32.726 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00023445399999999999 2024-09-13T06:43:32.726 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.726 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.727 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:32.727 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.379130+0000", 2024-09-13T06:43:32.727 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00035954200000000002 2024-09-13T06:43:32.727 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:32.727 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:32.727 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:32.727 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.727 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.727 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:37881 3.9 3:951cb95b:::rbd_data.1121d8143c6e.0000000000000002:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e56)", 2024-09-13T06:43:32.727 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:06.384239+0000", 2024-09-13T06:43:32.727 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 206.30842480300001, 2024-09-13T06:43:32.727 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.99541483500000005, 2024-09-13T06:43:32.728 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:32.728 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:32.728 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:32.728 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:32.728 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:32.728 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 37881 2024-09-13T06:43:32.728 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.728 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:32.728 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.728 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:32.728 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384239+0000", 2024-09-13T06:43:32.728 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:32.728 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.729 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.729 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:32.729 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384239+0000", 2024-09-13T06:43:32.729 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:32.729 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.729 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.729 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:32.729 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384238+0000", 2024-09-13T06:43:32.729 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999986 2024-09-13T06:43:32.729 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.729 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.729 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:32.730 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384246+0000", 2024-09-13T06:43:32.730 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.2449999999999998e-06 2024-09-13T06:43:32.730 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.730 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.730 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:32.730 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384268+0000", 2024-09-13T06:43:32.730 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1518e-05 2024-09-13T06:43:32.730 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.730 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.730 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:32.730 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384282+0000", 2024-09-13T06:43:32.730 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4501999999999999e-05 2024-09-13T06:43:32.730 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.730 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.731 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:32.731 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384356+0000", 2024-09-13T06:43:32.731 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4265999999999997e-05 2024-09-13T06:43:32.731 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.731 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.731 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:43:32.731 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384370+0000", 2024-09-13T06:43:32.731 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3942e-05 2024-09-13T06:43:32.731 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.731 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.731 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:32.731 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.379199+0000", 2024-09-13T06:43:32.731 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.99482866599999997 2024-09-13T06:43:32.732 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.732 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.732 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:32.732 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.379347+0000", 2024-09-13T06:43:32.732 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00014749199999999999 2024-09-13T06:43:32.732 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.732 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.732 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:32.732 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.379654+0000", 2024-09-13T06:43:32.732 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00030752999999999998 2024-09-13T06:43:32.732 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:32.732 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:32.733 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:32.733 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.733 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.733 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:37896 3.9 3:951cb95b:::rbd_data.1121d8143c6e.0000000000000002:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e56)", 2024-09-13T06:43:32.733 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:06.384412+0000", 2024-09-13T06:43:32.733 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 206.30825236999999, 2024-09-13T06:43:32.733 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.99777835999999998, 2024-09-13T06:43:32.733 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:32.733 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:32.733 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:32.733 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:32.733 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:32.734 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 37896 2024-09-13T06:43:32.734 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.734 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:32.734 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.734 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:32.734 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384412+0000", 2024-09-13T06:43:32.734 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:32.734 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.734 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.734 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:32.734 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384412+0000", 2024-09-13T06:43:32.734 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:32.734 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.734 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.735 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:32.735 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384410+0000", 2024-09-13T06:43:32.735 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.999999 2024-09-13T06:43:32.735 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.735 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.735 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:32.735 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384418+0000", 2024-09-13T06:43:32.735 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.486e-06 2024-09-13T06:43:32.735 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.735 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.735 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:32.735 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384436+0000", 2024-09-13T06:43:32.735 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7668000000000001e-05 2024-09-13T06:43:32.735 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.736 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.736 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:32.736 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384449+0000", 2024-09-13T06:43:32.736 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3395e-05 2024-09-13T06:43:32.736 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.736 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.736 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:32.736 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384605+0000", 2024-09-13T06:43:32.736 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00015563099999999999 2024-09-13T06:43:32.736 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.736 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.736 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:43:32.736 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384635+0000", 2024-09-13T06:43:32.737 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.0383999999999999e-05 2024-09-13T06:43:32.737 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.737 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.737 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:32.737 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.379730+0000", 2024-09-13T06:43:32.737 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.99509493999999998 2024-09-13T06:43:32.737 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.737 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.737 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:32.737 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.379964+0000", 2024-09-13T06:43:32.737 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00023353499999999999 2024-09-13T06:43:32.737 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.737 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.737 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:32.738 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.382190+0000", 2024-09-13T06:43:32.738 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0022265039999999998 2024-09-13T06:43:32.738 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:32.738 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:32.738 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:32.738 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.738 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.738 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43223 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 393216~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:43:32.738 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558267+0000", 2024-09-13T06:43:32.738 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 191.13439705900001, 2024-09-13T06:43:32.738 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.062813151999999997, 2024-09-13T06:43:32.738 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:32.739 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:32.739 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:32.739 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:32.739 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:32.739 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43223 2024-09-13T06:43:32.739 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.739 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:32.739 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.739 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:32.739 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558267+0000", 2024-09-13T06:43:32.739 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:32.739 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.739 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.740 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:32.740 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558267+0000", 2024-09-13T06:43:32.740 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:32.740 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.740 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.740 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:32.740 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558266+0000", 2024-09-13T06:43:32.740 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:32.740 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.740 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.740 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:32.740 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558270+0000", 2024-09-13T06:43:32.740 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.2389999999999998e-06 2024-09-13T06:43:32.741 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.741 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.741 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:32.741 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558277+0000", 2024-09-13T06:43:32.741 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5680000000000002e-06 2024-09-13T06:43:32.741 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.741 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.741 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:32.741 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558282+0000", 2024-09-13T06:43:32.741 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7060000000000003e-06 2024-09-13T06:43:32.741 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.741 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.741 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:32.742 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.620731+0000", 2024-09-13T06:43:32.742 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.062448661000000003 2024-09-13T06:43:32.742 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.742 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.742 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:32.742 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.620806+0000", 2024-09-13T06:43:32.742 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5862e-05 2024-09-13T06:43:32.742 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.742 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.742 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:32.742 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.621080+0000", 2024-09-13T06:43:32.742 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00027368599999999998 2024-09-13T06:43:32.743 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:32.743 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:32.743 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:32.743 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.743 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.743 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43224 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 407552~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:43:32.743 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558286+0000", 2024-09-13T06:43:32.743 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 191.13437769500001, 2024-09-13T06:43:32.743 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.063179052999999999, 2024-09-13T06:43:32.743 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:32.743 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:32.743 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:32.743 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:32.744 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:32.744 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43224 2024-09-13T06:43:32.744 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.744 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:32.744 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.744 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:32.744 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558286+0000", 2024-09-13T06:43:32.744 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:32.744 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.744 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.744 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:32.744 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558286+0000", 2024-09-13T06:43:32.745 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:32.745 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.745 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.745 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:32.745 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558286+0000", 2024-09-13T06:43:32.745 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:32.745 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.745 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.745 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:32.745 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558288+0000", 2024-09-13T06:43:32.745 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.227e-06 2024-09-13T06:43:32.745 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.745 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.745 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:32.746 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558292+0000", 2024-09-13T06:43:32.746 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.6289999999999999e-06 2024-09-13T06:43:32.746 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.746 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.746 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:32.746 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558294+0000", 2024-09-13T06:43:32.746 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5409999999999999e-06 2024-09-13T06:43:32.746 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.746 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.746 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:32.746 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.621110+0000", 2024-09-13T06:43:32.746 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.062815776000000004 2024-09-13T06:43:32.746 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.746 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.747 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:32.747 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.621186+0000", 2024-09-13T06:43:32.747 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5570999999999999e-05 2024-09-13T06:43:32.747 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.747 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.747 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:32.747 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.621465+0000", 2024-09-13T06:43:32.747 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00027988200000000001 2024-09-13T06:43:32.747 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:32.747 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:32.747 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:32.747 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.747 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.747 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43225 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 421888~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:43:32.748 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558296+0000", 2024-09-13T06:43:32.748 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 191.134367728, 2024-09-13T06:43:32.748 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.063551110999999993, 2024-09-13T06:43:32.748 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:32.748 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:32.748 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:32.748 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:32.748 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:32.748 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43225 2024-09-13T06:43:32.748 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.748 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:32.748 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.748 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:32.749 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558296+0000", 2024-09-13T06:43:32.749 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:32.749 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.749 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.749 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:32.749 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558296+0000", 2024-09-13T06:43:32.749 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:32.749 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.749 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.749 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:32.749 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558296+0000", 2024-09-13T06:43:32.749 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:43:32.749 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.750 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.750 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:32.750 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558305+0000", 2024-09-13T06:43:32.750 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.5290000000000008e-06 2024-09-13T06:43:32.750 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.750 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.750 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:32.750 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558308+0000", 2024-09-13T06:43:32.750 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.5619999999999999e-06 2024-09-13T06:43:32.750 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.750 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.750 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:32.750 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558311+0000", 2024-09-13T06:43:32.750 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.43e-06 2024-09-13T06:43:32.751 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.751 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.751 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:32.751 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.621495+0000", 2024-09-13T06:43:32.751 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.063184289000000005 2024-09-13T06:43:32.751 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.751 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.751 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:32.751 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.621569+0000", 2024-09-13T06:43:32.751 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4250000000000002e-05 2024-09-13T06:43:32.751 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.751 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.751 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:32.752 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.621847+0000", 2024-09-13T06:43:32.752 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00027826400000000002 2024-09-13T06:43:32.752 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:32.752 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:32.752 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:32.752 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.752 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.752 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43226 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 436224~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:43:32.752 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558313+0000", 2024-09-13T06:43:32.752 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 191.134351092, 2024-09-13T06:43:32.752 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.063914420999999999, 2024-09-13T06:43:32.752 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:32.753 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:32.753 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:32.753 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:32.753 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:32.753 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43226 2024-09-13T06:43:32.753 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.753 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:32.753 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.753 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:32.753 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558313+0000", 2024-09-13T06:43:32.753 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:32.753 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.753 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.754 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:32.754 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558313+0000", 2024-09-13T06:43:32.754 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:32.754 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.754 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.754 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:32.754 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558313+0000", 2024-09-13T06:43:32.754 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:32.754 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.754 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.754 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:32.754 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558314+0000", 2024-09-13T06:43:32.754 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3740000000000001e-06 2024-09-13T06:43:32.755 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.755 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.755 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:32.755 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558317+0000", 2024-09-13T06:43:32.755 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9730000000000002e-06 2024-09-13T06:43:32.755 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.755 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.755 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:32.755 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558319+0000", 2024-09-13T06:43:32.755 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4059999999999999e-06 2024-09-13T06:43:32.755 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.755 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.755 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:32.756 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.621877+0000", 2024-09-13T06:43:32.756 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.063557408999999995 2024-09-13T06:43:32.756 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.756 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.756 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:32.756 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.621951+0000", 2024-09-13T06:43:32.756 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4487999999999996e-05 2024-09-13T06:43:32.756 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.756 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.756 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:32.756 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.622227+0000", 2024-09-13T06:43:32.756 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000276011 2024-09-13T06:43:32.756 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:32.757 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:32.757 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:32.757 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.757 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.757 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43227 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 450560~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:43:32.757 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558322+0000", 2024-09-13T06:43:32.757 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 191.134342511, 2024-09-13T06:43:32.757 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.064285348000000006, 2024-09-13T06:43:32.757 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:32.757 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:32.757 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:32.757 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:32.757 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:32.757 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43227 2024-09-13T06:43:32.758 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.758 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:32.758 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.758 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:32.758 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558322+0000", 2024-09-13T06:43:32.758 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:32.758 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.758 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.758 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:32.758 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558322+0000", 2024-09-13T06:43:32.758 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:32.758 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.758 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.759 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:32.759 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558321+0000", 2024-09-13T06:43:32.759 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:43:32.759 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.759 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.759 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:32.759 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558323+0000", 2024-09-13T06:43:32.759 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.576e-06 2024-09-13T06:43:32.759 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.759 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.759 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:32.759 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558328+0000", 2024-09-13T06:43:32.759 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0719999999999999e-06 2024-09-13T06:43:32.760 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.760 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.760 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:32.760 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558332+0000", 2024-09-13T06:43:32.760 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.8130000000000002e-06 2024-09-13T06:43:32.760 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.760 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.760 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:32.760 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.622255+0000", 2024-09-13T06:43:32.760 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.063923195000000002 2024-09-13T06:43:32.760 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.760 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.760 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:32.761 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.622330+0000", 2024-09-13T06:43:32.761 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5383000000000007e-05 2024-09-13T06:43:32.761 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.761 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.761 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:32.761 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.622607+0000", 2024-09-13T06:43:32.761 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00027651999999999999 2024-09-13T06:43:32.761 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:32.761 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:32.761 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:32.761 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.761 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.761 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43228 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 464896~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:43:32.762 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558335+0000", 2024-09-13T06:43:32.762 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 191.13432860200001, 2024-09-13T06:43:32.762 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.064652253000000007, 2024-09-13T06:43:32.762 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:32.762 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:32.762 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:32.762 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:32.762 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:32.762 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43228 2024-09-13T06:43:32.762 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.762 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:32.762 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.762 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:32.762 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558335+0000", 2024-09-13T06:43:32.763 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:32.763 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.763 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.763 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:32.763 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558335+0000", 2024-09-13T06:43:32.763 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:32.763 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.763 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.763 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:32.763 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558335+0000", 2024-09-13T06:43:32.763 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:32.763 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.763 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.763 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:32.764 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558337+0000", 2024-09-13T06:43:32.764 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1380000000000001e-06 2024-09-13T06:43:32.764 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.764 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.764 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:32.764 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558343+0000", 2024-09-13T06:43:32.764 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.5140000000000001e-06 2024-09-13T06:43:32.764 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.764 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.764 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:32.764 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558348+0000", 2024-09-13T06:43:32.764 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9640000000000002e-06 2024-09-13T06:43:32.764 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.765 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.765 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:32.765 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.622636+0000", 2024-09-13T06:43:32.765 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.064288260999999999 2024-09-13T06:43:32.765 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.765 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.765 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:32.765 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.622715+0000", 2024-09-13T06:43:32.765 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.9351000000000006e-05 2024-09-13T06:43:32.765 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.765 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.765 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:32.765 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.622988+0000", 2024-09-13T06:43:32.765 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00027242599999999998 2024-09-13T06:43:32.766 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:32.766 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:32.766 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:32.766 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.766 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.766 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43229 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 479232~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:43:32.766 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558352+0000", 2024-09-13T06:43:32.766 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 191.13431218700001, 2024-09-13T06:43:32.766 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.065018024999999993, 2024-09-13T06:43:32.766 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:32.766 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:32.766 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:32.766 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:32.767 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:32.767 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43229 2024-09-13T06:43:32.767 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.767 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:32.767 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.767 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:32.767 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558352+0000", 2024-09-13T06:43:32.767 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:32.767 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.767 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.767 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:32.767 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558352+0000", 2024-09-13T06:43:32.767 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:32.768 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.768 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.768 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:32.768 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558352+0000", 2024-09-13T06:43:32.768 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:32.768 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.768 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.768 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:32.768 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558354+0000", 2024-09-13T06:43:32.768 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4930000000000001e-06 2024-09-13T06:43:32.768 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.768 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.768 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:32.769 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558360+0000", 2024-09-13T06:43:32.769 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.263e-06 2024-09-13T06:43:32.769 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.769 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.769 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:32.769 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558369+0000", 2024-09-13T06:43:32.769 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.0829999999999993e-06 2024-09-13T06:43:32.769 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.769 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.769 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:32.769 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.623017+0000", 2024-09-13T06:43:32.769 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.064647799000000006 2024-09-13T06:43:32.769 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.770 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.770 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:32.770 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.623090+0000", 2024-09-13T06:43:32.770 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3071000000000006e-05 2024-09-13T06:43:32.770 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.770 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.770 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:32.770 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.623370+0000", 2024-09-13T06:43:32.770 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000279661 2024-09-13T06:43:32.770 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:32.770 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:32.770 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:32.770 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.771 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.771 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43230 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 493568~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:43:32.771 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558374+0000", 2024-09-13T06:43:32.771 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 191.13428989400001, 2024-09-13T06:43:32.771 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.065410435000000003, 2024-09-13T06:43:32.771 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:32.771 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:32.771 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:32.771 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:32.771 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:32.771 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43230 2024-09-13T06:43:32.771 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.771 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:32.772 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.772 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:32.772 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558374+0000", 2024-09-13T06:43:32.772 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:32.772 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.772 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.772 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:32.772 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558374+0000", 2024-09-13T06:43:32.772 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:32.772 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.772 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.772 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:32.772 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558374+0000", 2024-09-13T06:43:32.773 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:32.773 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.773 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.773 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:32.773 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558376+0000", 2024-09-13T06:43:32.773 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4430000000000002e-06 2024-09-13T06:43:32.773 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.773 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.773 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:32.773 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558382+0000", 2024-09-13T06:43:32.773 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3029999999999996e-06 2024-09-13T06:43:32.773 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.773 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.774 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:32.774 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558387+0000", 2024-09-13T06:43:32.774 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.1699999999999999e-06 2024-09-13T06:43:32.774 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.774 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.774 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:32.774 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.623400+0000", 2024-09-13T06:43:32.774 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.065013244999999997 2024-09-13T06:43:32.774 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.774 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.774 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:32.774 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.623474+0000", 2024-09-13T06:43:32.774 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3889999999999999e-05 2024-09-13T06:43:32.775 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.775 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.775 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:32.775 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.623785+0000", 2024-09-13T06:43:32.775 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00031080099999999998 2024-09-13T06:43:32.775 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:32.775 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:32.775 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:32.775 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.775 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.775 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43231 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 507904~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:43:32.775 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558391+0000", 2024-09-13T06:43:32.775 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 191.13427320900001, 2024-09-13T06:43:32.775 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.065788597000000004, 2024-09-13T06:43:32.776 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:32.776 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:32.776 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:32.776 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:32.776 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:32.776 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43231 2024-09-13T06:43:32.776 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.776 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:32.776 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.776 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:32.776 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558391+0000", 2024-09-13T06:43:32.776 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:32.776 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.777 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.777 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:32.777 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558391+0000", 2024-09-13T06:43:32.777 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:32.777 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.777 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.777 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:32.777 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558390+0000", 2024-09-13T06:43:32.777 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:32.777 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.777 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.777 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:32.777 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558393+0000", 2024-09-13T06:43:32.778 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2570000000000002e-06 2024-09-13T06:43:32.778 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.778 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.778 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:32.778 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558399+0000", 2024-09-13T06:43:32.778 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0419999999999999e-06 2024-09-13T06:43:32.778 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.778 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.778 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:32.778 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558403+0000", 2024-09-13T06:43:32.778 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6249999999999998e-06 2024-09-13T06:43:32.778 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.778 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.779 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:32.779 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.623811+0000", 2024-09-13T06:43:32.779 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.065407549999999995 2024-09-13T06:43:32.779 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.779 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.779 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:32.779 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.623877+0000", 2024-09-13T06:43:32.779 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.5902999999999996e-05 2024-09-13T06:43:32.779 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.779 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.779 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:32.779 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.624179+0000", 2024-09-13T06:43:32.779 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00030259999999999998 2024-09-13T06:43:32.779 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:32.780 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:32.780 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:32.780 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.780 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.780 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43232 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 522240~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:43:32.780 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558422+0000", 2024-09-13T06:43:32.780 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 191.13424243200001, 2024-09-13T06:43:32.780 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.066176061999999994, 2024-09-13T06:43:32.780 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:32.780 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:32.780 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:32.780 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:32.780 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:32.781 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43232 2024-09-13T06:43:32.781 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.781 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:32.781 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.781 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:32.781 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558422+0000", 2024-09-13T06:43:32.781 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:32.781 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.781 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.781 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:32.781 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558422+0000", 2024-09-13T06:43:32.781 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:32.781 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.782 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.782 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:32.782 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558421+0000", 2024-09-13T06:43:32.782 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:32.782 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.782 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.782 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:32.782 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558428+0000", 2024-09-13T06:43:32.782 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.1690000000000003e-06 2024-09-13T06:43:32.782 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.782 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.782 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:32.783 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558434+0000", 2024-09-13T06:43:32.783 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9309999999999996e-06 2024-09-13T06:43:32.783 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.783 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.783 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:32.783 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558447+0000", 2024-09-13T06:43:32.783 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.271e-05 2024-09-13T06:43:32.783 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.783 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.783 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:32.783 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.624209+0000", 2024-09-13T06:43:32.783 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.065762102000000003 2024-09-13T06:43:32.783 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.784 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.784 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:32.784 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.624282+0000", 2024-09-13T06:43:32.784 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.2889e-05 2024-09-13T06:43:32.784 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.784 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.784 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:32.784 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.624598+0000", 2024-09-13T06:43:32.784 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00031591399999999998 2024-09-13T06:43:32.784 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:32.784 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:32.784 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:32.784 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.785 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.785 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43486 3.f 3:f7da9c8f:::rbd_data.1121f5f2e1c0.000000000000000b:1f [read 260096~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:43:32.785 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.569088+0000", 2024-09-13T06:43:32.785 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 191.12357570899999, 2024-09-13T06:43:32.785 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.062579223000000003, 2024-09-13T06:43:32.785 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:32.785 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:32.785 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:32.785 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:32.785 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:32.785 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43486 2024-09-13T06:43:32.785 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.786 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:32.786 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.786 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:32.786 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.569088+0000", 2024-09-13T06:43:32.786 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:32.786 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.786 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.786 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:32.786 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.569088+0000", 2024-09-13T06:43:32.786 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:32.786 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.786 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.786 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:32.787 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.569088+0000", 2024-09-13T06:43:32.787 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:32.787 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.787 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.787 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:32.787 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.569091+0000", 2024-09-13T06:43:32.787 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9629999999999998e-06 2024-09-13T06:43:32.787 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.787 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.787 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:32.787 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.569097+0000", 2024-09-13T06:43:32.787 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.4160000000000001e-06 2024-09-13T06:43:32.787 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.788 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.788 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:32.788 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.569102+0000", 2024-09-13T06:43:32.788 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6659999999999999e-06 2024-09-13T06:43:32.788 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.788 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.788 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:32.788 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.631346+0000", 2024-09-13T06:43:32.788 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.062243896 2024-09-13T06:43:32.788 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.788 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.788 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:32.789 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.631413+0000", 2024-09-13T06:43:32.789 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.7638000000000005e-05 2024-09-13T06:43:32.789 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.789 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.789 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:32.789 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.631668+0000", 2024-09-13T06:43:32.789 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0002541 2024-09-13T06:43:32.789 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:32.789 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:32.789 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:32.789 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.789 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.789 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:170125 3.9 3:94e4bf8d:::rbd_object_map.1121fa0cc8a3.000000000000006d:head [writefull 0~37] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e190)", 2024-09-13T06:43:32.790 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:42:30.601501+0000", 2024-09-13T06:43:32.790 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 62.091163498, 2024-09-13T06:43:32.790 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.80498820000000004, 2024-09-13T06:43:32.790 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:32.790 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:43:32.790 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:32.790 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:32.790 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:32.790 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 170125 2024-09-13T06:43:32.790 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.790 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:32.790 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.790 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:32.791 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:30.601501+0000", 2024-09-13T06:43:32.791 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:32.791 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.791 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.791 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:32.791 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:30.601501+0000", 2024-09-13T06:43:32.791 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:32.791 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.791 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.791 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:32.791 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:30.601499+0000", 2024-09-13T06:43:32.791 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999986 2024-09-13T06:43:32.791 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.792 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.792 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:32.792 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:30.601506+0000", 2024-09-13T06:43:32.792 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.9940000000000003e-06 2024-09-13T06:43:32.792 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.792 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.792 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:32.792 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:30.601519+0000", 2024-09-13T06:43:32.792 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2875e-05 2024-09-13T06:43:32.792 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.792 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.792 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:32.792 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:30.601525+0000", 2024-09-13T06:43:32.793 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8549999999999998e-06 2024-09-13T06:43:32.793 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.793 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.793 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:32.793 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:30.601560+0000", 2024-09-13T06:43:32.793 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.5271000000000002e-05 2024-09-13T06:43:32.793 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.793 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.793 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:43:32.793 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:30.601566+0000", 2024-09-13T06:43:32.793 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3090000000000001e-06 2024-09-13T06:43:32.793 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.793 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.794 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:32.794 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:31.403017+0000", 2024-09-13T06:43:32.794 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.80145064200000005 2024-09-13T06:43:32.794 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.794 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.794 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:32.794 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:31.403252+0000", 2024-09-13T06:43:32.794 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000234718 2024-09-13T06:43:32.794 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.794 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.794 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 7", 2024-09-13T06:43:32.794 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:31.403521+0000", 2024-09-13T06:43:32.794 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00026917 2024-09-13T06:43:32.794 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.795 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.795 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-09-13T06:43:32.795 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:31.404918+0000", 2024-09-13T06:43:32.795 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.001397017 2024-09-13T06:43:32.795 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.795 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.795 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:43:32.795 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:31.406176+0000", 2024-09-13T06:43:32.795 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.001257998 2024-09-13T06:43:32.795 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.795 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.795 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:43:32.795 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:31.406334+0000", 2024-09-13T06:43:32.796 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00015819099999999999 2024-09-13T06:43:32.796 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:32.796 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:32.796 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:32.796 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:31.406489+0000", 2024-09-13T06:43:32.796 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00015476699999999999 2024-09-13T06:43:32.796 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:32.796 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:32.796 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:32.796 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:32.796 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:32.796 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:43:32.797 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:43:32.695+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:43:32.798 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-13T06:43:32.842 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:43:32.843+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:43:32.900 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:43:32.901+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:43:32.911 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-13T06:43:32.911+0000 7fcdeb9fe640 -1 mon.a@0(leader).osd e247 definitely_dead 0 2024-09-13T06:43:32.947 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-13T06:43:32.970 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:43:32.970 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-13T06:43:32.971 INFO:teuthology.orchestra.run.smithi081.stdout: "num_ops": 0 2024-09-13T06:43:32.971 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:43:32.987 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-13T06:43:33.034 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:43:33.035+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:43:33.100 INFO:teuthology.orchestra.run.smithi081.stdout:osd.0: {} 2024-09-13T06:43:33.101 INFO:teuthology.orchestra.run.smithi081.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-13T06:43:33.102 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-13T06:43:33.101+0000 7fa8bb18e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 36790) UID: 0 2024-09-13T06:43:33.118 INFO:teuthology.orchestra.run.smithi081.stdout:osd.1: {} 2024-09-13T06:43:33.118 INFO:teuthology.orchestra.run.smithi081.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-13T06:43:33.135 INFO:teuthology.orchestra.run.smithi081.stdout:osd.2: {} 2024-09-13T06:43:33.136 INFO:teuthology.orchestra.run.smithi081.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-13T06:43:33.152 INFO:teuthology.orchestra.run.smithi081.stdout:osd.3: {} 2024-09-13T06:43:33.152 INFO:teuthology.orchestra.run.smithi081.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-13T06:43:33.165 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:43:33.166 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:43:33.172 INFO:teuthology.orchestra.run.smithi081.stdout:osd.4: {} 2024-09-13T06:43:33.172 INFO:teuthology.orchestra.run.smithi081.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-13T06:43:33.180 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-13T06:43:33.192 INFO:teuthology.orchestra.run.smithi081.stdout:osd.5: {} 2024-09-13T06:43:33.193 INFO:teuthology.orchestra.run.smithi081.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-13T06:43:33.193 INFO:teuthology.orchestra.run.smithi081.stderr:Error ENXIO: problem getting command descriptions from osd.6 2024-09-13T06:43:33.203 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:43:33.203+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:43:33.212 INFO:teuthology.orchestra.run.smithi081.stdout:osd.7: {} 2024-09-13T06:43:33.213 INFO:teuthology.orchestra.run.smithi081.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-13T06:43:33.216 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-13T06:43:33.216 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-13T06:43:33.298 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:43:33.299 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:43:33.304 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:43:33.305+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:43:33.312 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-13T06:43:33.405 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:43:33.403+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:43:33.443 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:43:33.443 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:43:33.457 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-13T06:43:33.505 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:43:33.503+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:43:33.578 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:43:33.579 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:43:33.593 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-13T06:43:33.620 INFO:teuthology.orchestra.run.smithi081.stderr:marked out osd.1. 2024-09-13T06:43:33.643 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:43:33.645+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:43:33.707 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:43:33.705+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:43:33.715 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:43:33.715 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:43:33.729 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-13T06:43:33.808 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:43:33.807+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:43:33.894 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:43:33.894 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:43:33.909 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-13T06:43:33.909 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:43:33.909+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:43:34.010 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:43:34.009+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:43:34.072 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:43:34.073 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:43:34.087 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-13T06:43:34.110 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:43:34.111+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:43:34.211 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:43:34.211+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:43:34.253 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:43:34.253 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:43:34.267 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-13T06:43:34.312 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:43:34.311+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:43:34.385 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:43:34.385 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:43:34.399 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-13T06:43:34.413 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:43:34.411+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:43:34.437 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-13T06:43:34.514 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:43:34.513+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:43:34.517 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:43:34.517 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:43:34.532 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-13T06:43:34.619 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-13T06:43:34.621+0000 7fa8bb18e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 36790) UID: 0 2024-09-13T06:43:34.702 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:43:34.702 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:43:34.715 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:43:34.713+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:43:34.716 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-13T06:43:34.816 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:43:34.815+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:43:34.838 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:43:34.838 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:43:34.852 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-13T06:43:34.938 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:43:34.939+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:43:35.011 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:43:35.011 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:43:35.018 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:43:35.019+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:43:35.024 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-13T06:43:35.119 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:43:35.121+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:43:35.191 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:43:35.191 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:43:35.205 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-13T06:43:35.218 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-13T06:43:35.254 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:43:35.255+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:43:35.321 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:43:35.319+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:43:35.324 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:43:35.324 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:43:35.336 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-13T06:43:35.390 INFO:teuthology.orchestra.run.smithi081.stdout:osd.0: {} 2024-09-13T06:43:35.390 INFO:teuthology.orchestra.run.smithi081.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-13T06:43:35.406 INFO:teuthology.orchestra.run.smithi081.stdout:osd.1: {} 2024-09-13T06:43:35.406 INFO:teuthology.orchestra.run.smithi081.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-13T06:43:35.421 INFO:teuthology.orchestra.run.smithi081.stdout:osd.2: {} 2024-09-13T06:43:35.421 INFO:teuthology.orchestra.run.smithi081.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-13T06:43:35.422 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:43:35.421+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:43:35.438 INFO:teuthology.orchestra.run.smithi081.stdout:osd.3: {} 2024-09-13T06:43:35.438 INFO:teuthology.orchestra.run.smithi081.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-13T06:43:35.458 INFO:teuthology.orchestra.run.smithi081.stdout:osd.4: {} 2024-09-13T06:43:35.458 INFO:teuthology.orchestra.run.smithi081.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-13T06:43:35.477 INFO:teuthology.orchestra.run.smithi081.stdout:osd.5: {} 2024-09-13T06:43:35.477 INFO:teuthology.orchestra.run.smithi081.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-13T06:43:35.478 INFO:teuthology.orchestra.run.smithi081.stderr:Error ENXIO: problem getting command descriptions from osd.6 2024-09-13T06:43:35.492 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:43:35.493 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-13T06:43:35.493 INFO:teuthology.orchestra.run.smithi081.stdout: "complaint_time": 30, 2024-09-13T06:43:35.493 INFO:teuthology.orchestra.run.smithi081.stdout: "num_blocked_ops": 0 2024-09-13T06:43:35.493 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:43:35.498 INFO:teuthology.orchestra.run.smithi081.stdout:osd.7: {} 2024-09-13T06:43:35.498 INFO:teuthology.orchestra.run.smithi081.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-13T06:43:35.502 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-13T06:43:35.503 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-13T06:43:35.506 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-13T06:43:35.550 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:43:35.551+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:43:35.609 INFO:teuthology.orchestra.run.smithi081.stderr:nodeep-scrub is unset 2024-09-13T06:43:35.623 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:43:35.623+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:43:35.698 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:43:35.698 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 20, 2024-09-13T06:43:35.698 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 600, 2024-09-13T06:43:35.698 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [ 2024-09-13T06:43:35.698 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:35.699 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:90987 3.6 3:6263dd97:::rbd_object_map.11212443ae03.0000000000000049:head [call] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-13T06:43:35.699 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:41:35.460333+0000", 2024-09-13T06:43:35.699 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 120.23781561600001, 2024-09-13T06:43:35.699 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0001633640000001, 2024-09-13T06:43:35.699 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:35.699 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:35.699 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:35.699 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:35.699 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:35.699 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 90987 2024-09-13T06:43:35.699 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:35.699 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:35.699 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:35.700 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:35.700 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:35.460333+0000", 2024-09-13T06:43:35.700 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:35.700 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:35.700 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:35.700 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:35.700 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:35.460333+0000", 2024-09-13T06:43:35.700 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:35.700 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:35.700 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:35.700 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:35.700 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:35.460330+0000", 2024-09-13T06:43:35.701 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999971 2024-09-13T06:43:35.701 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:35.701 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:35.701 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:35.701 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:35.460343+0000", 2024-09-13T06:43:35.701 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2695e-05 2024-09-13T06:43:35.701 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:35.701 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:35.701 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:35.701 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:35.460365+0000", 2024-09-13T06:43:35.701 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2473999999999999e-05 2024-09-13T06:43:35.701 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:35.702 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:35.702 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:35.702 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:35.460376+0000", 2024-09-13T06:43:35.702 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0383999999999999e-05 2024-09-13T06:43:35.702 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:35.702 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:35.702 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:35.702 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:35.460435+0000", 2024-09-13T06:43:35.702 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8650000000000003e-05 2024-09-13T06:43:35.702 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:35.702 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:35.702 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:43:35.702 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:35.460444+0000", 2024-09-13T06:43:35.703 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.0380000000000005e-06 2024-09-13T06:43:35.703 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:35.703 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:35.703 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:35.703 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:36.459433+0000", 2024-09-13T06:43:35.703 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.99898895799999998 2024-09-13T06:43:35.703 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:35.703 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:35.703 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:35.703 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:36.459622+0000", 2024-09-13T06:43:35.703 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00018940299999999999 2024-09-13T06:43:35.704 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:35.704 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:35.704 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:35.704 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:36.460497+0000", 2024-09-13T06:43:35.704 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00087481199999999999 2024-09-13T06:43:35.704 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:35.704 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:35.704 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:35.704 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:35.704 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:35.704 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:159632 3.a 3:57f62123:::rbd_header.112138ed422:head [create,call rbd.create in=9b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e167)", 2024-09-13T06:43:35.705 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:42:07.853351+0000", 2024-09-13T06:43:35.705 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 87.844797814000003, 2024-09-13T06:43:35.705 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.95572760999999995, 2024-09-13T06:43:35.705 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:35.705 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:43:35.705 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:35.705 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:35.705 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:35.705 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 159632 2024-09-13T06:43:35.705 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:35.705 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:35.705 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:35.705 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:35.706 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:07.853351+0000", 2024-09-13T06:43:35.706 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:35.706 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:35.706 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:35.706 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:35.706 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:07.853351+0000", 2024-09-13T06:43:35.706 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:35.706 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:35.706 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:35.706 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:35.706 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:07.853350+0000", 2024-09-13T06:43:35.706 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.999999 2024-09-13T06:43:35.706 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:35.706 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:35.707 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:35.707 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:07.853356+0000", 2024-09-13T06:43:35.707 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.1560000000000003e-06 2024-09-13T06:43:35.707 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:35.707 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:35.707 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:35.707 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:07.853365+0000", 2024-09-13T06:43:35.707 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.8079999999999999e-06 2024-09-13T06:43:35.707 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:35.707 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:35.707 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:35.707 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:07.853372+0000", 2024-09-13T06:43:35.707 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.5540000000000003e-06 2024-09-13T06:43:35.707 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:35.708 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:35.708 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:35.708 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:07.853430+0000", 2024-09-13T06:43:35.708 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8038000000000002e-05 2024-09-13T06:43:35.708 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:35.708 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:35.708 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:43:35.708 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:07.853444+0000", 2024-09-13T06:43:35.708 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3719e-05 2024-09-13T06:43:35.708 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:35.708 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:35.708 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:35.709 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:08.804052+0000", 2024-09-13T06:43:35.709 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.95060817799999997 2024-09-13T06:43:35.709 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:35.709 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:35.709 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:35.709 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:08.804234+0000", 2024-09-13T06:43:35.709 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00018192999999999999 2024-09-13T06:43:35.709 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:35.709 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:35.709 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 6", 2024-09-13T06:43:35.709 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:08.804797+0000", 2024-09-13T06:43:35.709 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00056282399999999996 2024-09-13T06:43:35.709 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:35.709 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:35.710 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-09-13T06:43:35.710 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:08.805704+0000", 2024-09-13T06:43:35.710 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00090781 2024-09-13T06:43:35.710 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:35.710 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:35.710 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:43:35.710 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:08.808907+0000", 2024-09-13T06:43:35.710 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0032031239999999999 2024-09-13T06:43:35.710 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:35.710 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:35.710 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:43:35.710 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:08.808998+0000", 2024-09-13T06:43:35.710 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.0191000000000004e-05 2024-09-13T06:43:35.710 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:35.711 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:35.711 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:35.711 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:08.809079+0000", 2024-09-13T06:43:35.711 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.1076999999999996e-05 2024-09-13T06:43:35.711 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:35.711 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:35.711 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:35.711 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:35.711 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:35.711 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:209556 3.6 3:673cd4d4:::rbd_data.1121cb4a09ed.0000000000000002:82 [read 831488~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e220)", 2024-09-13T06:43:35.711 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:43:05.152927+0000", 2024-09-13T06:43:35.711 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 30.545221814000001, 2024-09-13T06:43:35.712 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054987033999999997, 2024-09-13T06:43:35.712 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:35.712 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:35.712 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:35.712 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:35.712 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:35.712 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 209556 2024-09-13T06:43:35.712 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:35.712 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:35.712 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:35.712 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:35.712 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.152927+0000", 2024-09-13T06:43:35.712 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:35.712 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:35.713 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:35.713 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:35.713 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.152927+0000", 2024-09-13T06:43:35.713 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:35.713 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:35.713 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:35.713 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:35.713 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.152927+0000", 2024-09-13T06:43:35.713 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:35.713 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:35.713 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:35.713 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:35.714 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.152929+0000", 2024-09-13T06:43:35.714 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.514e-06 2024-09-13T06:43:35.714 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:35.714 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:35.714 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:35.714 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.152935+0000", 2024-09-13T06:43:35.714 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.5249999999999996e-06 2024-09-13T06:43:35.714 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:35.714 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:35.714 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:35.714 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.152939+0000", 2024-09-13T06:43:35.714 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.3209999999999998e-06 2024-09-13T06:43:35.714 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:35.714 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:35.715 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:35.715 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.207752+0000", 2024-09-13T06:43:35.715 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054813273000000003 2024-09-13T06:43:35.715 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:35.715 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:35.715 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:35.715 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.207834+0000", 2024-09-13T06:43:35.715 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.1317999999999996e-05 2024-09-13T06:43:35.715 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:35.715 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:35.715 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:35.715 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.207914+0000", 2024-09-13T06:43:35.716 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.0568000000000005e-05 2024-09-13T06:43:35.716 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:35.716 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:35.716 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:35.716 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:35.716 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:35.716 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:209557 3.6 3:673cd4d4:::rbd_data.1121cb4a09ed.0000000000000002:82 [read 843776~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e220)", 2024-09-13T06:43:35.716 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:43:05.152944+0000", 2024-09-13T06:43:35.716 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 30.54520531, 2024-09-13T06:43:35.716 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.055174645000000001, 2024-09-13T06:43:35.716 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:35.716 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:35.716 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:35.717 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:35.717 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:35.717 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 209557 2024-09-13T06:43:35.717 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:35.717 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:35.717 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:35.717 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:35.717 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.152944+0000", 2024-09-13T06:43:35.717 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:35.717 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:35.717 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:35.717 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:35.717 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.152944+0000", 2024-09-13T06:43:35.718 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:35.718 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:35.718 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:35.718 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:35.718 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.152943+0000", 2024-09-13T06:43:35.718 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:35.718 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:35.718 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:35.718 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:35.718 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.152946+0000", 2024-09-13T06:43:35.718 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2419999999999999e-06 2024-09-13T06:43:35.718 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:35.718 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:35.718 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:35.719 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.152951+0000", 2024-09-13T06:43:35.719 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7570000000000001e-06 2024-09-13T06:43:35.719 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:35.719 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:35.719 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:35.719 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.152955+0000", 2024-09-13T06:43:35.719 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.0080000000000004e-06 2024-09-13T06:43:35.720 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:35.720 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:35.720 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:35.720 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.207958+0000", 2024-09-13T06:43:35.720 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.055002896000000003 2024-09-13T06:43:35.720 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:35.720 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:35.720 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:35.720 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.208041+0000", 2024-09-13T06:43:35.720 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.2962999999999998e-05 2024-09-13T06:43:35.720 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:35.720 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:35.720 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:35.720 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.208118+0000", 2024-09-13T06:43:35.721 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.7181000000000005e-05 2024-09-13T06:43:35.721 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:35.721 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:35.721 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:35.721 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:35.721 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:35.721 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:209558 3.6 3:673cd4d4:::rbd_data.1121cb4a09ed.0000000000000002:82 [read 856064~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e220)", 2024-09-13T06:43:35.721 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:43:05.152960+0000", 2024-09-13T06:43:35.721 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 30.545189116, 2024-09-13T06:43:35.721 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.055296975999999998, 2024-09-13T06:43:35.721 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:35.721 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:35.722 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:35.722 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:35.722 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:35.722 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 209558 2024-09-13T06:43:35.722 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:35.722 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:35.722 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:35.722 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:35.722 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.152960+0000", 2024-09-13T06:43:35.722 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:35.722 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:35.722 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:35.722 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:35.723 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.152960+0000", 2024-09-13T06:43:35.723 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:35.723 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:35.723 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:35.723 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:35.723 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.152959+0000", 2024-09-13T06:43:35.723 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:35.723 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:35.723 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:35.723 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:35.723 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.152962+0000", 2024-09-13T06:43:35.723 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6709999999999999e-06 2024-09-13T06:43:35.724 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:35.724 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:35.724 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:35.724 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.152968+0000", 2024-09-13T06:43:35.724 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.5589999999999996e-06 2024-09-13T06:43:35.724 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:35.724 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:35.724 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:35.724 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.152972+0000", 2024-09-13T06:43:35.724 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.216e-06 2024-09-13T06:43:35.724 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:35.724 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:35.724 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:35.725 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.208146+0000", 2024-09-13T06:43:35.725 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.055173627000000003 2024-09-13T06:43:35.725 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:35.725 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:35.725 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:35.725 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.208193+0000", 2024-09-13T06:43:35.725 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7200000000000002e-05 2024-09-13T06:43:35.725 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:35.725 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:35.725 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:35.725 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.208257+0000", 2024-09-13T06:43:35.725 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.4058000000000002e-05 2024-09-13T06:43:35.725 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:35.725 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:35.726 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:35.726 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:35.726 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:35.726 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:209559 3.6 3:673cd4d4:::rbd_data.1121cb4a09ed.0000000000000002:82 [read 868352~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e220)", 2024-09-13T06:43:35.726 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:43:05.152976+0000", 2024-09-13T06:43:35.726 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 30.545173002999999, 2024-09-13T06:43:35.726 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.055514239, 2024-09-13T06:43:35.726 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:35.727 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:35.727 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:35.727 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:35.727 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:35.727 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 209559 2024-09-13T06:43:35.727 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:35.727 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:35.727 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:35.727 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:35.727 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.152976+0000", 2024-09-13T06:43:35.727 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:35.727 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:35.727 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:35.728 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:35.728 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.152976+0000", 2024-09-13T06:43:35.728 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:35.728 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:35.728 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:35.728 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:35.728 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.152976+0000", 2024-09-13T06:43:35.728 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:35.728 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:35.728 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:35.728 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:35.728 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.152978+0000", 2024-09-13T06:43:35.728 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2189999999999998e-06 2024-09-13T06:43:35.729 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:35.729 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:35.729 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:35.729 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.152983+0000", 2024-09-13T06:43:35.729 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3639999999999998e-06 2024-09-13T06:43:35.729 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:35.729 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:35.729 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:35.729 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.152987+0000", 2024-09-13T06:43:35.729 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.9469999999999996e-06 2024-09-13T06:43:35.729 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:35.729 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:35.730 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:35.730 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.208301+0000", 2024-09-13T06:43:35.730 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.055314292000000001 2024-09-13T06:43:35.730 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:35.730 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:35.730 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:35.730 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.208385+0000", 2024-09-13T06:43:35.730 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.3755e-05 2024-09-13T06:43:35.730 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:35.730 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:35.730 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:35.731 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.208490+0000", 2024-09-13T06:43:35.731 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00010498800000000001 2024-09-13T06:43:35.731 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:35.731 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:35.731 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:35.731 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:35.731 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:35.731 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:209560 3.6 3:673cd4d4:::rbd_data.1121cb4a09ed.0000000000000002:82 [read 880640~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e220)", 2024-09-13T06:43:35.731 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:43:05.152991+0000", 2024-09-13T06:43:35.731 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 30.545157914000001, 2024-09-13T06:43:35.731 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.05572912, 2024-09-13T06:43:35.731 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:35.731 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:35.732 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:35.732 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:35.732 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:35.732 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 209560 2024-09-13T06:43:35.732 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:35.732 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:35.732 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:35.732 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:35.732 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.152991+0000", 2024-09-13T06:43:35.732 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:35.732 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:35.732 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:35.733 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:35.733 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.152991+0000", 2024-09-13T06:43:35.733 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:35.733 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:35.733 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:35.733 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:35.733 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.152991+0000", 2024-09-13T06:43:35.733 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:35.733 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:35.733 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:35.733 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:35.733 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.152993+0000", 2024-09-13T06:43:35.734 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3159999999999999e-06 2024-09-13T06:43:35.734 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:35.734 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:35.734 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:35.734 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.152999+0000", 2024-09-13T06:43:35.734 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8529999999999997e-06 2024-09-13T06:43:35.734 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:35.734 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:35.734 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:35.734 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153004+0000", 2024-09-13T06:43:35.734 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6210000000000003e-06 2024-09-13T06:43:35.734 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:35.734 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:35.735 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:35.735 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.208530+0000", 2024-09-13T06:43:35.735 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.055526407999999999 2024-09-13T06:43:35.735 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:35.735 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:35.735 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:35.735 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.208616+0000", 2024-09-13T06:43:35.735 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.6483000000000005e-05 2024-09-13T06:43:35.735 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:35.735 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:35.735 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:35.735 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.208720+0000", 2024-09-13T06:43:35.736 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00010376 2024-09-13T06:43:35.736 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:35.736 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:35.736 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:35.736 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:35.736 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:35.736 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:209561 3.6 3:673cd4d4:::rbd_data.1121cb4a09ed.0000000000000002:82 [read 892928~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e220)", 2024-09-13T06:43:35.736 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:43:05.153008+0000", 2024-09-13T06:43:35.736 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 30.545141019999999, 2024-09-13T06:43:35.736 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0559225, 2024-09-13T06:43:35.736 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:35.736 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:35.736 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:35.737 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:35.737 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:35.737 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 209561 2024-09-13T06:43:35.737 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:35.737 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:35.737 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:35.737 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:35.737 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153008+0000", 2024-09-13T06:43:35.737 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:35.737 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:35.737 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:35.737 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:35.738 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153008+0000", 2024-09-13T06:43:35.738 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:35.738 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:35.738 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:35.738 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:35.738 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153008+0000", 2024-09-13T06:43:35.738 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:35.738 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:35.738 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:35.738 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:35.738 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153010+0000", 2024-09-13T06:43:35.738 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.8210000000000002e-06 2024-09-13T06:43:35.738 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:35.739 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:35.739 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:35.739 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153016+0000", 2024-09-13T06:43:35.739 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.575e-06 2024-09-13T06:43:35.739 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:35.739 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:35.739 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:35.739 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153020+0000", 2024-09-13T06:43:35.739 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.408e-06 2024-09-13T06:43:35.739 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:35.739 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:35.739 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:35.739 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.208751+0000", 2024-09-13T06:43:35.740 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.055730225000000001 2024-09-13T06:43:35.740 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:35.740 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:35.740 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:35.740 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.208825+0000", 2024-09-13T06:43:35.740 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4548999999999994e-05 2024-09-13T06:43:35.740 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:35.740 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:35.740 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:35.740 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.208930+0000", 2024-09-13T06:43:35.740 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00010529700000000001 2024-09-13T06:43:35.740 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:35.741 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:35.741 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:35.741 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:35.741 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:35.741 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:209562 3.6 3:673cd4d4:::rbd_data.1121cb4a09ed.0000000000000002:82 [read 905216~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e220)", 2024-09-13T06:43:35.741 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:43:05.153024+0000", 2024-09-13T06:43:35.741 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 30.545124594000001, 2024-09-13T06:43:35.741 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.056099906999999997, 2024-09-13T06:43:35.741 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:35.741 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:35.741 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:35.741 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:35.741 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:35.742 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 209562 2024-09-13T06:43:35.742 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:35.742 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:35.742 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:35.742 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:35.742 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153024+0000", 2024-09-13T06:43:35.742 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:35.742 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:35.742 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:35.742 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:35.742 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153024+0000", 2024-09-13T06:43:35.742 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:35.742 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:35.742 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:35.743 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:35.743 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153024+0000", 2024-09-13T06:43:35.743 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:35.743 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:35.743 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:35.743 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:35.743 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153026+0000", 2024-09-13T06:43:35.743 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.165e-06 2024-09-13T06:43:35.743 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:35.743 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:35.743 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:35.743 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153031+0000", 2024-09-13T06:43:35.743 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.1669999999999998e-06 2024-09-13T06:43:35.744 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:35.744 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:35.744 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:35.744 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153035+0000", 2024-09-13T06:43:35.744 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.0799999999999999e-06 2024-09-13T06:43:35.744 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:35.744 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:35.744 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:35.744 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.208956+0000", 2024-09-13T06:43:35.744 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.055920848000000002 2024-09-13T06:43:35.744 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:35.744 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:35.744 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:35.745 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.209032+0000", 2024-09-13T06:43:35.745 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5809999999999994e-05 2024-09-13T06:43:35.745 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:35.745 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:35.745 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:35.745 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.209124+0000", 2024-09-13T06:43:35.745 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.2157999999999994e-05 2024-09-13T06:43:35.745 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:35.745 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:35.745 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:35.745 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:35.745 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:35.745 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:209563 3.6 3:673cd4d4:::rbd_data.1121cb4a09ed.0000000000000002:82 [read 917504~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e220)", 2024-09-13T06:43:35.745 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:43:05.153039+0000", 2024-09-13T06:43:35.746 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 30.545109630999999, 2024-09-13T06:43:35.746 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.056280030000000002, 2024-09-13T06:43:35.746 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:35.746 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:35.746 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:35.746 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:35.746 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:35.746 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 209563 2024-09-13T06:43:35.746 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:35.746 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:35.746 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:35.746 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:35.746 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153039+0000", 2024-09-13T06:43:35.747 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:35.747 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:35.747 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:35.747 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:35.747 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153039+0000", 2024-09-13T06:43:35.747 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:35.747 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:35.747 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:35.747 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:35.747 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153039+0000", 2024-09-13T06:43:35.747 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:35.747 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:35.747 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:35.747 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:35.748 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153041+0000", 2024-09-13T06:43:35.748 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3800000000000001e-06 2024-09-13T06:43:35.748 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:35.748 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:35.748 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:35.748 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153047+0000", 2024-09-13T06:43:35.748 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2059999999999998e-06 2024-09-13T06:43:35.748 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:35.748 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:35.748 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:35.748 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153051+0000", 2024-09-13T06:43:35.748 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.0980000000000004e-06 2024-09-13T06:43:35.749 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:35.749 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:35.749 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:35.749 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.209150+0000", 2024-09-13T06:43:35.749 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.056099351999999998 2024-09-13T06:43:35.749 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:35.749 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:35.749 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:35.749 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.209226+0000", 2024-09-13T06:43:35.749 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5939999999999995e-05 2024-09-13T06:43:35.749 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:35.749 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:35.749 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:35.749 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.209319+0000", 2024-09-13T06:43:35.750 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.3399000000000005e-05 2024-09-13T06:43:35.750 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:35.750 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:35.750 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:35.750 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:35.750 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:35.750 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:209564 3.6 3:673cd4d4:::rbd_data.1121cb4a09ed.0000000000000002:82 [read 929792~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e220)", 2024-09-13T06:43:35.750 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:43:05.153055+0000", 2024-09-13T06:43:35.750 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 30.545094384999999, 2024-09-13T06:43:35.750 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.056404468999999999, 2024-09-13T06:43:35.750 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:35.750 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:35.750 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:35.751 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:35.751 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:35.751 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 209564 2024-09-13T06:43:35.751 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:35.751 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:35.751 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:35.751 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:35.751 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153055+0000", 2024-09-13T06:43:35.751 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:35.751 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:35.751 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:35.751 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:35.751 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153055+0000", 2024-09-13T06:43:35.752 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:35.752 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:35.752 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:35.752 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:35.752 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153054+0000", 2024-09-13T06:43:35.752 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:35.752 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:35.752 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:35.752 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:35.752 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153056+0000", 2024-09-13T06:43:35.752 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1600000000000001e-06 2024-09-13T06:43:35.752 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:35.752 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:35.752 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:35.753 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153062+0000", 2024-09-13T06:43:35.753 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2549999999999997e-06 2024-09-13T06:43:35.753 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:35.753 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:35.753 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:35.753 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153066+0000", 2024-09-13T06:43:35.753 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.0400000000000003e-06 2024-09-13T06:43:35.753 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:35.753 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:35.753 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:35.753 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.209342+0000", 2024-09-13T06:43:35.753 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.056276640000000003 2024-09-13T06:43:35.753 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:35.754 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:35.754 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:35.754 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.209382+0000", 2024-09-13T06:43:35.754 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.9626999999999999e-05 2024-09-13T06:43:35.754 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:35.754 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:35.754 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:35.754 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.209459+0000", 2024-09-13T06:43:35.754 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.7072999999999999e-05 2024-09-13T06:43:35.754 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:35.754 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:35.754 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:35.754 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:35.755 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:35.755 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:209565 3.6 3:673cd4d4:::rbd_data.1121cb4a09ed.0000000000000002:82 [read 942080~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e220)", 2024-09-13T06:43:35.755 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:43:05.153070+0000", 2024-09-13T06:43:35.755 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 30.545079412, 2024-09-13T06:43:35.755 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.056688545999999999, 2024-09-13T06:43:35.755 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:35.755 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:35.755 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:35.755 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:35.755 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:35.755 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 209565 2024-09-13T06:43:35.755 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:35.755 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:35.755 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:35.756 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:35.756 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153070+0000", 2024-09-13T06:43:35.756 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:35.756 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:35.756 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:35.756 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:35.756 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153070+0000", 2024-09-13T06:43:35.756 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:35.756 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:35.756 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:35.756 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:35.756 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153069+0000", 2024-09-13T06:43:35.756 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:35.757 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:35.757 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:35.757 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:35.757 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153071+0000", 2024-09-13T06:43:35.757 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1780000000000002e-06 2024-09-13T06:43:35.757 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:35.757 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:35.757 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:35.757 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153077+0000", 2024-09-13T06:43:35.757 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3639999999999998e-06 2024-09-13T06:43:35.757 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:35.757 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:35.757 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:35.758 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153081+0000", 2024-09-13T06:43:35.758 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.1640000000000003e-06 2024-09-13T06:43:35.758 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:35.758 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:35.758 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:35.758 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.209486+0000", 2024-09-13T06:43:35.758 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.056405258999999999 2024-09-13T06:43:35.758 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:35.758 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:35.758 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:35.758 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.209560+0000", 2024-09-13T06:43:35.758 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4247999999999998e-05 2024-09-13T06:43:35.758 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:35.758 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:35.759 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:35.759 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.209758+0000", 2024-09-13T06:43:35.759 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000197634 2024-09-13T06:43:35.759 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:35.759 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:35.759 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:35.759 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:35.759 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:35.759 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:209566 3.6 3:673cd4d4:::rbd_data.1121cb4a09ed.0000000000000002:82 [read 954368~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e220)", 2024-09-13T06:43:35.759 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:43:05.153085+0000", 2024-09-13T06:43:35.759 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 30.545064103000001, 2024-09-13T06:43:35.759 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.057070779000000002, 2024-09-13T06:43:35.759 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:35.760 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:35.760 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:35.760 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:35.760 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:35.760 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 209566 2024-09-13T06:43:35.760 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:35.760 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:35.760 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:35.760 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:35.760 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153085+0000", 2024-09-13T06:43:35.760 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:35.760 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:35.760 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:35.761 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:35.761 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153085+0000", 2024-09-13T06:43:35.761 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:35.761 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:35.761 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:35.761 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:35.761 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153085+0000", 2024-09-13T06:43:35.761 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:35.761 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:35.761 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:35.761 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:35.761 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153087+0000", 2024-09-13T06:43:35.761 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1220000000000002e-06 2024-09-13T06:43:35.762 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:35.762 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:35.762 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:35.762 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153092+0000", 2024-09-13T06:43:35.762 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3090000000000003e-06 2024-09-13T06:43:35.762 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:35.762 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:35.762 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:35.762 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153096+0000", 2024-09-13T06:43:35.762 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.1819999999999999e-06 2024-09-13T06:43:35.762 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:35.762 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:35.762 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:35.762 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.209787+0000", 2024-09-13T06:43:35.763 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.056690819000000003 2024-09-13T06:43:35.763 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:35.763 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:35.763 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:35.763 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.209863+0000", 2024-09-13T06:43:35.763 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5551999999999998e-05 2024-09-13T06:43:35.763 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:35.763 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:35.763 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:35.763 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.210156+0000", 2024-09-13T06:43:35.763 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00029310499999999999 2024-09-13T06:43:35.763 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:35.763 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:35.764 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:35.764 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:35.764 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:35.764 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:209567 3.6 3:673cd4d4:::rbd_data.1121cb4a09ed.0000000000000002:82 [read 966656~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e220)", 2024-09-13T06:43:35.764 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:43:05.153100+0000", 2024-09-13T06:43:35.764 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 30.545048730000001, 2024-09-13T06:43:35.764 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.057459567000000003, 2024-09-13T06:43:35.764 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:35.764 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:35.764 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:35.764 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:35.764 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:35.764 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 209567 2024-09-13T06:43:35.764 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:35.765 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:35.765 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:35.765 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:35.765 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153100+0000", 2024-09-13T06:43:35.765 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:35.765 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:35.765 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:35.765 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:35.765 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153100+0000", 2024-09-13T06:43:35.765 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:35.765 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:35.765 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:35.765 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:35.766 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153100+0000", 2024-09-13T06:43:35.766 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:35.766 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:35.766 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:35.766 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:35.766 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153105+0000", 2024-09-13T06:43:35.766 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.5400000000000003e-06 2024-09-13T06:43:35.766 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:35.766 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:35.766 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:35.766 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153111+0000", 2024-09-13T06:43:35.766 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.541e-06 2024-09-13T06:43:35.766 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:35.766 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:35.767 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:35.767 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153115+0000", 2024-09-13T06:43:35.767 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.104e-06 2024-09-13T06:43:35.767 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:35.767 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:35.767 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:35.767 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.210183+0000", 2024-09-13T06:43:35.767 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.057067842000000001 2024-09-13T06:43:35.767 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:35.767 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:35.767 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:35.767 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.210257+0000", 2024-09-13T06:43:35.767 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3726999999999994e-05 2024-09-13T06:43:35.768 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:35.768 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:35.768 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:35.768 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.210560+0000", 2024-09-13T06:43:35.768 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00030318899999999999 2024-09-13T06:43:35.768 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:35.768 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:35.768 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:35.768 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:35.768 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:35.768 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:209568 3.6 3:673cd4d4:::rbd_data.1121cb4a09ed.0000000000000002:82 [read 978944~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e220)", 2024-09-13T06:43:35.768 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:43:05.153119+0000", 2024-09-13T06:43:35.768 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 30.545029530000001, 2024-09-13T06:43:35.768 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.057810786000000003, 2024-09-13T06:43:35.769 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:35.769 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:35.769 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:35.769 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:35.769 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:35.769 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 209568 2024-09-13T06:43:35.769 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:35.769 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:35.769 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:35.769 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:35.769 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153119+0000", 2024-09-13T06:43:35.769 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:35.769 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:35.769 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:35.770 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:35.770 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153119+0000", 2024-09-13T06:43:35.770 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:35.770 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:35.770 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:35.770 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:35.770 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153119+0000", 2024-09-13T06:43:35.770 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:35.770 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:35.770 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:35.770 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:35.770 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153121+0000", 2024-09-13T06:43:35.770 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.21e-06 2024-09-13T06:43:35.771 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:35.771 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:35.771 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:35.771 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153127+0000", 2024-09-13T06:43:35.771 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.4670000000000003e-06 2024-09-13T06:43:35.771 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:35.771 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:35.771 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:35.771 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153131+0000", 2024-09-13T06:43:35.771 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.2629999999999997e-06 2024-09-13T06:43:35.771 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:35.771 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:35.771 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:35.772 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.210587+0000", 2024-09-13T06:43:35.772 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.05745567 2024-09-13T06:43:35.772 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:35.772 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:35.772 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:35.772 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.210660+0000", 2024-09-13T06:43:35.772 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3430000000000007e-05 2024-09-13T06:43:35.772 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:35.772 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:35.772 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:35.772 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.210930+0000", 2024-09-13T06:43:35.772 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000270127 2024-09-13T06:43:35.772 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:35.773 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:35.773 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:35.773 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:35.773 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:35.773 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:209569 3.6 3:673cd4d4:::rbd_data.1121cb4a09ed.0000000000000002:82 [read 991232~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e220)", 2024-09-13T06:43:35.773 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:43:05.153135+0000", 2024-09-13T06:43:35.773 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 30.545014105, 2024-09-13T06:43:35.773 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.058283125999999998, 2024-09-13T06:43:35.773 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:35.773 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:35.773 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:35.773 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:35.773 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:35.774 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 209569 2024-09-13T06:43:35.774 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:35.774 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:35.774 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:35.774 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:35.774 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153135+0000", 2024-09-13T06:43:35.774 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:35.774 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:35.774 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:35.774 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:35.774 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153135+0000", 2024-09-13T06:43:35.774 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:35.774 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:35.775 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:35.775 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:35.775 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153135+0000", 2024-09-13T06:43:35.775 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:35.775 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:35.775 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:35.775 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:35.775 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153136+0000", 2024-09-13T06:43:35.775 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9069999999999999e-06 2024-09-13T06:43:35.775 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:35.775 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:35.775 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:35.775 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153142+0000", 2024-09-13T06:43:35.776 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3009999999999997e-06 2024-09-13T06:43:35.776 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:35.776 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:35.776 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:35.776 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153146+0000", 2024-09-13T06:43:35.776 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.442e-06 2024-09-13T06:43:35.776 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:35.776 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:35.776 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:35.776 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.210959+0000", 2024-09-13T06:43:35.776 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.057812456999999998 2024-09-13T06:43:35.776 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:35.776 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:35.777 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:35.777 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.211038+0000", 2024-09-13T06:43:35.777 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.9140999999999993e-05 2024-09-13T06:43:35.777 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:35.777 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:35.777 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:35.777 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.211418+0000", 2024-09-13T06:43:35.777 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00038017500000000001 2024-09-13T06:43:35.777 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:35.777 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:35.777 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:35.777 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:35.777 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:35.778 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:209570 3.6 3:673cd4d4:::rbd_data.1121cb4a09ed.0000000000000002:82 [read 1003520~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e220)", 2024-09-13T06:43:35.778 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:43:05.153151+0000", 2024-09-13T06:43:35.778 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 30.544998222, 2024-09-13T06:43:35.778 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.058499886000000001, 2024-09-13T06:43:35.778 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:35.778 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:35.778 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:35.778 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:35.778 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:35.778 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 209570 2024-09-13T06:43:35.778 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:35.778 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:35.778 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:35.779 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:35.779 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153151+0000", 2024-09-13T06:43:35.779 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:35.779 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:35.779 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:35.779 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:35.779 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153151+0000", 2024-09-13T06:43:35.779 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:35.779 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:35.779 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:35.779 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:35.779 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153150+0000", 2024-09-13T06:43:35.779 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:35.779 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:35.780 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:35.780 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:35.780 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153153+0000", 2024-09-13T06:43:35.780 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3630000000000001e-06 2024-09-13T06:43:35.780 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:35.780 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:35.780 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:35.780 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153159+0000", 2024-09-13T06:43:35.780 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3690000000000003e-06 2024-09-13T06:43:35.780 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:35.780 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:35.780 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:35.780 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153164+0000", 2024-09-13T06:43:35.781 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5379999999999996e-06 2024-09-13T06:43:35.781 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:35.781 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:35.781 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:35.781 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.211448+0000", 2024-09-13T06:43:35.781 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.058283926 2024-09-13T06:43:35.781 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:35.781 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:35.781 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:35.781 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.211508+0000", 2024-09-13T06:43:35.781 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0741e-05 2024-09-13T06:43:35.781 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:35.781 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:35.782 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:35.782 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.211651+0000", 2024-09-13T06:43:35.782 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00014232200000000001 2024-09-13T06:43:35.782 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:35.782 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:35.782 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:35.782 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:35.782 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:35.782 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:209571 3.6 3:673cd4d4:::rbd_data.1121cb4a09ed.0000000000000002:82 [read 1015808~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e220)", 2024-09-13T06:43:35.782 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:43:05.153168+0000", 2024-09-13T06:43:35.783 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 30.544980711000001, 2024-09-13T06:43:35.783 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.058709363000000001, 2024-09-13T06:43:35.783 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:35.783 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:35.783 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:35.783 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:35.783 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:35.783 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 209571 2024-09-13T06:43:35.783 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:35.783 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:35.783 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:35.784 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:35.784 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153168+0000", 2024-09-13T06:43:35.784 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:35.784 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:35.784 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:35.784 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:35.784 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153168+0000", 2024-09-13T06:43:35.784 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:35.784 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:35.784 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:35.784 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:35.784 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153168+0000", 2024-09-13T06:43:35.784 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:35.784 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:35.785 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:35.785 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:35.785 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153170+0000", 2024-09-13T06:43:35.785 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4499999999999998e-06 2024-09-13T06:43:35.785 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:35.785 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:35.785 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:35.785 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153176+0000", 2024-09-13T06:43:35.785 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0050000000000001e-06 2024-09-13T06:43:35.785 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:35.785 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:35.785 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:35.785 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153181+0000", 2024-09-13T06:43:35.786 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.267e-06 2024-09-13T06:43:35.786 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:35.786 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:35.786 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:35.786 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.211678+0000", 2024-09-13T06:43:35.786 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.058497751000000001 2024-09-13T06:43:35.786 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:35.786 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:35.786 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:35.786 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.211744+0000", 2024-09-13T06:43:35.786 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.5266999999999997e-05 2024-09-13T06:43:35.786 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:35.786 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:35.787 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:35.787 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.211878+0000", 2024-09-13T06:43:35.787 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00013394500000000001 2024-09-13T06:43:35.787 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:35.787 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:35.787 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:35.787 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:35.787 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:35.787 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:209572 3.6 3:673cd4d4:::rbd_data.1121cb4a09ed.0000000000000002:82 [read 1028096~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e220)", 2024-09-13T06:43:35.787 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:43:05.153185+0000", 2024-09-13T06:43:35.787 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 30.544964316000002, 2024-09-13T06:43:35.787 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.058928534999999997, 2024-09-13T06:43:35.787 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:35.788 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:35.788 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:35.788 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:35.788 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:35.788 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 209572 2024-09-13T06:43:35.788 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:35.788 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:35.788 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:35.788 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:35.788 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153185+0000", 2024-09-13T06:43:35.788 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:35.788 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:35.789 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:35.789 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:35.789 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153185+0000", 2024-09-13T06:43:35.789 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:35.789 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:35.789 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:35.789 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:35.789 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153184+0000", 2024-09-13T06:43:35.789 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:35.789 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:35.789 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:35.789 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:35.789 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153186+0000", 2024-09-13T06:43:35.790 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1040000000000001e-06 2024-09-13T06:43:35.790 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:35.790 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:35.790 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:35.790 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153191+0000", 2024-09-13T06:43:35.790 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0409999999999997e-06 2024-09-13T06:43:35.790 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:35.790 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:35.790 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:35.790 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153196+0000", 2024-09-13T06:43:35.790 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.2200000000000003e-06 2024-09-13T06:43:35.790 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:35.790 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:35.791 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:35.791 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.211906+0000", 2024-09-13T06:43:35.791 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.058709960999999998 2024-09-13T06:43:35.791 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:35.791 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:35.791 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:35.791 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.211977+0000", 2024-09-13T06:43:35.791 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.1080000000000004e-05 2024-09-13T06:43:35.791 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:35.791 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:35.791 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:35.791 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.212113+0000", 2024-09-13T06:43:35.791 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00013644500000000001 2024-09-13T06:43:35.791 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:35.792 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:35.792 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:35.792 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:35.792 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:35.792 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:209573 3.6 3:673cd4d4:::rbd_data.1121cb4a09ed.0000000000000002:82 [read 1040384~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e220)", 2024-09-13T06:43:35.792 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:43:05.153199+0000", 2024-09-13T06:43:35.792 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 30.544949526, 2024-09-13T06:43:35.792 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.059182414000000003, 2024-09-13T06:43:35.792 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:35.792 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:35.792 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:35.792 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:35.792 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:35.793 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 209573 2024-09-13T06:43:35.793 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:35.793 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:35.793 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:35.793 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:35.793 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153199+0000", 2024-09-13T06:43:35.793 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:35.793 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:35.793 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:35.793 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:35.793 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153199+0000", 2024-09-13T06:43:35.793 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:35.793 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:35.793 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:35.794 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:35.794 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153199+0000", 2024-09-13T06:43:35.794 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:35.794 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:35.794 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:35.794 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:35.794 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153201+0000", 2024-09-13T06:43:35.794 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0470000000000001e-06 2024-09-13T06:43:35.794 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:35.794 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:35.794 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:35.794 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153207+0000", 2024-09-13T06:43:35.794 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3730000000000001e-06 2024-09-13T06:43:35.795 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:35.795 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:35.795 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:35.795 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153211+0000", 2024-09-13T06:43:35.795 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.053e-06 2024-09-13T06:43:35.795 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:35.795 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:35.795 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:35.795 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.212141+0000", 2024-09-13T06:43:35.795 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.058930064999999997 2024-09-13T06:43:35.795 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:35.795 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:35.795 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:35.796 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.212214+0000", 2024-09-13T06:43:35.796 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3096999999999995e-05 2024-09-13T06:43:35.796 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:35.796 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:35.796 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:35.796 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.212382+0000", 2024-09-13T06:43:35.796 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000168138 2024-09-13T06:43:35.796 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:35.796 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:35.796 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:35.796 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:35.796 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:35.796 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:43:35.798 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-13T06:43:35.798 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:43:35.795+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:43:35.898 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-13T06:43:35.897+0000 7fa8bb18e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 36790) UID: 0 2024-09-13T06:43:35.992 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:43:35.993 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [ 2024-09-13T06:43:35.993 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:35.993 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "MOSDPGPushReply(3.4 250/249 [PushReplyOp(3:24e85914:::rbd_data.11218ba71f0d.0000000000000009:head)])", 2024-09-13T06:43:35.993 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:43:35.994280+0000", 2024-09-13T06:43:35.993 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 0.000118806, 2024-09-13T06:43:35.993 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00013899800000000001, 2024-09-13T06:43:35.993 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:35.993 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:43:35.993 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:35.993 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:35.993 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:35.993 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:35.994280+0000", 2024-09-13T06:43:35.994 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:35.994 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:35.994 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:35.994 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:35.994 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:35.994280+0000", 2024-09-13T06:43:35.994 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:35.994 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:35.994 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:35.994 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:35.994 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:35.994280+0000", 2024-09-13T06:43:35.994 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:35.994 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:35.994 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:35.995 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:35.995 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:35.994285+0000", 2024-09-13T06:43:35.995 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3029999999999999e-06 2024-09-13T06:43:35.995 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:35.995 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:35.995 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:35.995 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:35.994298+0000", 2024-09-13T06:43:35.995 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.291e-05 2024-09-13T06:43:35.995 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:35.995 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:35.995 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:35.995 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:35.994305+0000", 2024-09-13T06:43:35.995 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3860000000000001e-06 2024-09-13T06:43:35.996 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:35.996 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:35.996 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:35.996 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:35.994349+0000", 2024-09-13T06:43:35.996 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.3174999999999999e-05 2024-09-13T06:43:35.996 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:35.996 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:35.996 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:35.996 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:35.996 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-13T06:43:35.996 INFO:teuthology.orchestra.run.smithi081.stdout: "num_ops": 1 2024-09-13T06:43:35.996 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:43:35.999 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-13T06:43:36.001+0000 7fa8bb18e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 36790) UID: 0 2024-09-13T06:43:36.010 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-13T06:43:36.100 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:43:36.101+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:43:36.151 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:43:36.151 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-13T06:43:36.151 INFO:teuthology.orchestra.run.smithi081.stdout: "complaint_time": 30, 2024-09-13T06:43:36.151 INFO:teuthology.orchestra.run.smithi081.stdout: "num_blocked_ops": 0 2024-09-13T06:43:36.151 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:43:36.166 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-13T06:43:36.210 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:43:36.211+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:43:36.280 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:43:36.280 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 20, 2024-09-13T06:43:36.280 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 600, 2024-09-13T06:43:36.280 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [ 2024-09-13T06:43:36.281 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.281 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:36160 3.f 3:f62782c2:::rbd_object_map.11219660270d.0000000000000016:head [call] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-13T06:43:36.281 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:01.607291+0000", 2024-09-13T06:43:36.281 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 214.672238851, 2024-09-13T06:43:36.281 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.99619456699999998, 2024-09-13T06:43:36.281 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:36.281 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:36.281 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:36.281 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:36.281 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:36.281 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 36160 2024-09-13T06:43:36.281 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.282 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:36.282 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.282 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:36.282 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:01.607291+0000", 2024-09-13T06:43:36.282 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:36.282 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.282 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.282 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:36.282 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:01.607291+0000", 2024-09-13T06:43:36.282 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:36.282 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.282 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.283 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:36.283 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:01.607289+0000", 2024-09-13T06:43:36.283 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999976 2024-09-13T06:43:36.283 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.283 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.283 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:36.283 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:01.607302+0000", 2024-09-13T06:43:36.283 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3018e-05 2024-09-13T06:43:36.283 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.283 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.283 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:36.283 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:01.607323+0000", 2024-09-13T06:43:36.283 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1030999999999999e-05 2024-09-13T06:43:36.284 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.284 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.284 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:36.284 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:01.607342+0000", 2024-09-13T06:43:36.284 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8961e-05 2024-09-13T06:43:36.284 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.284 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.284 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:36.284 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:01.607425+0000", 2024-09-13T06:43:36.284 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.3171999999999996e-05 2024-09-13T06:43:36.284 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.284 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.284 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:43:36.285 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:01.607441+0000", 2024-09-13T06:43:36.285 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5996999999999999e-05 2024-09-13T06:43:36.285 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.285 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.285 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:36.285 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:02.596186+0000", 2024-09-13T06:43:36.285 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.98874432000000001 2024-09-13T06:43:36.285 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.285 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.285 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for missing object", 2024-09-13T06:43:36.285 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:02.596618+0000", 2024-09-13T06:43:36.285 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000432032 2024-09-13T06:43:36.285 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.286 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.286 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:36.286 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:02.600845+0000", 2024-09-13T06:43:36.286 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0042277410000000001 2024-09-13T06:43:36.286 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.286 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.286 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:36.286 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:02.601003+0000", 2024-09-13T06:43:36.286 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00015731999999999999 2024-09-13T06:43:36.286 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.286 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.286 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:36.286 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:02.603486+0000", 2024-09-13T06:43:36.287 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0024832510000000001 2024-09-13T06:43:36.287 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:36.287 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:36.287 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:36.287 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.287 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.287 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:37806 3.9 3:951cb95b:::rbd_data.1121d8143c6e.0000000000000002:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e56)", 2024-09-13T06:43:36.287 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:06.373482+0000", 2024-09-13T06:43:36.287 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 209.90604781499999, 2024-09-13T06:43:36.287 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.002476213, 2024-09-13T06:43:36.287 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:36.287 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:36.288 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:36.288 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:36.288 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:36.288 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 37806 2024-09-13T06:43:36.288 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.288 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:36.288 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.288 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:36.288 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.373482+0000", 2024-09-13T06:43:36.288 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:36.288 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.288 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.288 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:36.288 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.373482+0000", 2024-09-13T06:43:36.288 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:36.289 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.289 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.289 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:36.289 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.373479+0000", 2024-09-13T06:43:36.289 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999962 2024-09-13T06:43:36.289 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.289 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.289 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:36.289 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.373495+0000", 2024-09-13T06:43:36.289 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6640999999999999e-05 2024-09-13T06:43:36.289 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.289 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.289 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:36.290 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.373542+0000", 2024-09-13T06:43:36.290 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6229000000000001e-05 2024-09-13T06:43:36.290 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.290 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.290 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:36.290 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.373564+0000", 2024-09-13T06:43:36.290 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2684000000000002e-05 2024-09-13T06:43:36.290 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.290 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.290 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:36.290 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374268+0000", 2024-09-13T06:43:36.290 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00070363700000000001 2024-09-13T06:43:36.290 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.290 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.291 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:43:36.291 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374305+0000", 2024-09-13T06:43:36.291 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.6936e-05 2024-09-13T06:43:36.291 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.291 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.291 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:36.291 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.375175+0000", 2024-09-13T06:43:36.291 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.000870454 2024-09-13T06:43:36.291 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.291 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.291 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:36.291 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.375678+0000", 2024-09-13T06:43:36.291 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00050292499999999999 2024-09-13T06:43:36.292 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.292 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.292 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:36.292 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.375959+0000", 2024-09-13T06:43:36.292 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00028050599999999997 2024-09-13T06:43:36.292 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:36.292 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:36.292 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:36.292 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.292 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.292 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:37821 3.9 3:951cb95b:::rbd_data.1121d8143c6e.0000000000000002:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e56)", 2024-09-13T06:43:36.292 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:06.374454+0000", 2024-09-13T06:43:36.293 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 209.90507669799999, 2024-09-13T06:43:36.293 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.002545072, 2024-09-13T06:43:36.293 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:36.293 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:36.293 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:36.293 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:36.293 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:36.293 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 37821 2024-09-13T06:43:36.293 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.293 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:36.293 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.293 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:36.293 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374454+0000", 2024-09-13T06:43:36.294 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:36.294 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.294 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.294 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:36.294 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374454+0000", 2024-09-13T06:43:36.294 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:36.294 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.294 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.294 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:36.294 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374452+0000", 2024-09-13T06:43:36.294 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999981 2024-09-13T06:43:36.294 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.294 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.295 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:36.295 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374463+0000", 2024-09-13T06:43:36.295 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0756e-05 2024-09-13T06:43:36.295 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.295 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.295 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:36.295 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374487+0000", 2024-09-13T06:43:36.295 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4887000000000001e-05 2024-09-13T06:43:36.295 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.295 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.295 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:36.295 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374504+0000", 2024-09-13T06:43:36.296 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6852000000000001e-05 2024-09-13T06:43:36.296 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.296 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.296 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:36.296 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374829+0000", 2024-09-13T06:43:36.296 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000324684 2024-09-13T06:43:36.296 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.296 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.296 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:43:36.296 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374880+0000", 2024-09-13T06:43:36.296 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.1378000000000002e-05 2024-09-13T06:43:36.296 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.296 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.297 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:36.297 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.376423+0000", 2024-09-13T06:43:36.297 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.001542734 2024-09-13T06:43:36.297 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.297 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.297 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:36.297 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.376607+0000", 2024-09-13T06:43:36.297 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000183656 2024-09-13T06:43:36.297 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.297 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.297 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:36.297 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.376999+0000", 2024-09-13T06:43:36.298 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00039191200000000001 2024-09-13T06:43:36.298 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:36.298 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:36.298 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:36.298 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.298 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.298 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:37836 3.9 3:951cb95b:::rbd_data.1121d8143c6e.0000000000000002:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e56)", 2024-09-13T06:43:36.298 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:06.374929+0000", 2024-09-13T06:43:36.298 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 209.90460104600001, 2024-09-13T06:43:36.298 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.002778825, 2024-09-13T06:43:36.298 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:36.298 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:36.298 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:36.299 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:36.299 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:36.299 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 37836 2024-09-13T06:43:36.299 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.299 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:36.299 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.299 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:36.299 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374929+0000", 2024-09-13T06:43:36.299 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:36.299 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.299 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.299 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:36.300 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374929+0000", 2024-09-13T06:43:36.300 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:36.300 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.300 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.300 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:36.300 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374927+0000", 2024-09-13T06:43:36.300 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999981 2024-09-13T06:43:36.300 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.300 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.300 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:36.300 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374939+0000", 2024-09-13T06:43:36.300 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1846e-05 2024-09-13T06:43:36.300 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.300 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.301 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:36.301 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374962+0000", 2024-09-13T06:43:36.301 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3054e-05 2024-09-13T06:43:36.301 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.301 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.301 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:36.301 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374978+0000", 2024-09-13T06:43:36.301 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5899000000000001e-05 2024-09-13T06:43:36.301 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.301 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.301 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:36.301 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.375106+0000", 2024-09-13T06:43:36.301 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00012789 2024-09-13T06:43:36.302 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.302 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.302 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:43:36.302 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.375134+0000", 2024-09-13T06:43:36.302 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.8254000000000001e-05 2024-09-13T06:43:36.302 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.302 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.302 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:36.302 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.377082+0000", 2024-09-13T06:43:36.302 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0019471520000001 2024-09-13T06:43:36.302 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.302 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.302 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:36.303 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.377330+0000", 2024-09-13T06:43:36.303 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00024834199999999997 2024-09-13T06:43:36.303 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.303 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.303 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:36.303 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.377708+0000", 2024-09-13T06:43:36.303 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00037817100000000001 2024-09-13T06:43:36.303 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:36.303 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:36.303 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:36.303 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.303 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.303 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:37851 3.9 3:951cb95b:::rbd_data.1121d8143c6e.0000000000000002:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e56)", 2024-09-13T06:43:36.303 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:06.382636+0000", 2024-09-13T06:43:36.304 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 209.89689416100001, 2024-09-13T06:43:36.304 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.99582539400000003, 2024-09-13T06:43:36.304 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:36.304 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:36.304 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:36.304 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:36.304 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:36.304 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 37851 2024-09-13T06:43:36.304 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.304 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:36.304 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.304 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:36.304 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.382636+0000", 2024-09-13T06:43:36.304 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:36.304 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.305 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.305 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:36.305 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.382636+0000", 2024-09-13T06:43:36.305 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:36.305 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.305 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.305 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:36.305 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.382633+0000", 2024-09-13T06:43:36.305 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999971 2024-09-13T06:43:36.305 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.305 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.305 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:36.305 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.382652+0000", 2024-09-13T06:43:36.305 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8834999999999998e-05 2024-09-13T06:43:36.306 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.306 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.306 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:36.306 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.382695+0000", 2024-09-13T06:43:36.306 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.3136000000000002e-05 2024-09-13T06:43:36.306 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.306 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.306 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:36.306 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.382716+0000", 2024-09-13T06:43:36.306 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1421e-05 2024-09-13T06:43:36.306 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.306 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.306 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:36.306 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.382860+0000", 2024-09-13T06:43:36.306 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00014389200000000001 2024-09-13T06:43:36.307 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.307 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.307 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:43:36.307 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.382890+0000", 2024-09-13T06:43:36.307 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9827000000000001e-05 2024-09-13T06:43:36.307 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.307 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.307 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:36.307 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.377779+0000", 2024-09-13T06:43:36.307 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.99488842899999996 2024-09-13T06:43:36.307 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.307 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.307 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:36.307 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.378007+0000", 2024-09-13T06:43:36.308 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00022838099999999999 2024-09-13T06:43:36.308 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.308 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.308 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:36.308 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.378462+0000", 2024-09-13T06:43:36.308 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00045452300000000003 2024-09-13T06:43:36.308 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:36.308 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:36.308 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:36.308 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.308 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.308 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:37866 3.9 3:951cb95b:::rbd_data.1121d8143c6e.0000000000000002:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e56)", 2024-09-13T06:43:36.308 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:06.383951+0000", 2024-09-13T06:43:36.308 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 209.89557947500001, 2024-09-13T06:43:36.308 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.99517962299999996, 2024-09-13T06:43:36.309 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:36.309 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:36.309 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:36.309 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:36.309 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:36.309 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 37866 2024-09-13T06:43:36.309 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.309 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:36.309 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.309 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:36.309 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.383951+0000", 2024-09-13T06:43:36.309 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:36.309 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.310 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.310 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:36.310 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.383951+0000", 2024-09-13T06:43:36.310 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:36.310 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.310 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.310 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:36.310 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.383949+0000", 2024-09-13T06:43:36.310 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999981 2024-09-13T06:43:36.310 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.310 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.310 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:36.310 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.383961+0000", 2024-09-13T06:43:36.310 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1999e-05 2024-09-13T06:43:36.310 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.311 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.311 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:36.311 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384019+0000", 2024-09-13T06:43:36.311 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7621000000000003e-05 2024-09-13T06:43:36.311 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.311 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.311 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:36.311 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384040+0000", 2024-09-13T06:43:36.311 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1528000000000001e-05 2024-09-13T06:43:36.311 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.311 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.311 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:36.311 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384186+0000", 2024-09-13T06:43:36.311 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00014573799999999999 2024-09-13T06:43:36.311 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.312 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.312 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:43:36.312 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384204+0000", 2024-09-13T06:43:36.312 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7992e-05 2024-09-13T06:43:36.312 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.312 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.312 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:36.312 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.378536+0000", 2024-09-13T06:43:36.312 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.99433268600000002 2024-09-13T06:43:36.312 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.312 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.312 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:36.312 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.378771+0000", 2024-09-13T06:43:36.312 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00023445399999999999 2024-09-13T06:43:36.313 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.313 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.313 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:36.313 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.379130+0000", 2024-09-13T06:43:36.313 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00035954200000000002 2024-09-13T06:43:36.313 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:36.313 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:36.313 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:36.313 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.313 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.313 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:37881 3.9 3:951cb95b:::rbd_data.1121d8143c6e.0000000000000002:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e56)", 2024-09-13T06:43:36.313 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:06.384239+0000", 2024-09-13T06:43:36.314 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 209.89529106099999, 2024-09-13T06:43:36.314 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.99541483500000005, 2024-09-13T06:43:36.314 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:36.314 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:36.314 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:36.314 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:36.314 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:36.314 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 37881 2024-09-13T06:43:36.314 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.314 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:36.314 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.314 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:36.314 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384239+0000", 2024-09-13T06:43:36.315 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:36.315 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.315 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.315 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:36.315 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384239+0000", 2024-09-13T06:43:36.315 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:36.315 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.315 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.315 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:36.315 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384238+0000", 2024-09-13T06:43:36.315 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999986 2024-09-13T06:43:36.315 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.315 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.315 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:36.315 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384246+0000", 2024-09-13T06:43:36.316 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.2449999999999998e-06 2024-09-13T06:43:36.316 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.316 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.316 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:36.316 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384268+0000", 2024-09-13T06:43:36.316 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1518e-05 2024-09-13T06:43:36.316 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.316 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.316 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:36.316 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384282+0000", 2024-09-13T06:43:36.316 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4501999999999999e-05 2024-09-13T06:43:36.316 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.316 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.316 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:36.317 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384356+0000", 2024-09-13T06:43:36.317 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4265999999999997e-05 2024-09-13T06:43:36.317 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.317 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.317 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:43:36.317 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384370+0000", 2024-09-13T06:43:36.317 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3942e-05 2024-09-13T06:43:36.317 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.317 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.317 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:36.317 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.379199+0000", 2024-09-13T06:43:36.317 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.99482866599999997 2024-09-13T06:43:36.317 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.318 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.318 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:36.318 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.379347+0000", 2024-09-13T06:43:36.318 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00014749199999999999 2024-09-13T06:43:36.318 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.318 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.318 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:36.318 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.379654+0000", 2024-09-13T06:43:36.318 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00030752999999999998 2024-09-13T06:43:36.318 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:36.318 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:36.318 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:36.318 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.318 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.319 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:37896 3.9 3:951cb95b:::rbd_data.1121d8143c6e.0000000000000002:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e56)", 2024-09-13T06:43:36.319 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:06.384412+0000", 2024-09-13T06:43:36.319 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 209.89511862800001, 2024-09-13T06:43:36.319 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.99777835999999998, 2024-09-13T06:43:36.319 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:36.319 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:36.319 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:36.319 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:36.319 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:36.319 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 37896 2024-09-13T06:43:36.319 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.319 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:36.319 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.319 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:36.319 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384412+0000", 2024-09-13T06:43:36.320 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:36.320 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.320 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.320 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:36.320 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384412+0000", 2024-09-13T06:43:36.320 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:36.320 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.320 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.320 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:36.320 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384410+0000", 2024-09-13T06:43:36.320 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.999999 2024-09-13T06:43:36.320 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.320 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.320 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:36.321 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384418+0000", 2024-09-13T06:43:36.321 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.486e-06 2024-09-13T06:43:36.321 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.321 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.321 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:36.321 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384436+0000", 2024-09-13T06:43:36.321 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7668000000000001e-05 2024-09-13T06:43:36.321 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.321 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.321 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:36.321 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384449+0000", 2024-09-13T06:43:36.321 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3395e-05 2024-09-13T06:43:36.321 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.321 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.322 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:36.322 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384605+0000", 2024-09-13T06:43:36.322 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00015563099999999999 2024-09-13T06:43:36.322 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.322 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.322 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:43:36.322 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384635+0000", 2024-09-13T06:43:36.322 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.0383999999999999e-05 2024-09-13T06:43:36.322 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.322 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.322 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:36.322 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.379730+0000", 2024-09-13T06:43:36.322 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.99509493999999998 2024-09-13T06:43:36.322 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.322 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.323 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:36.323 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.379964+0000", 2024-09-13T06:43:36.323 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00023353499999999999 2024-09-13T06:43:36.323 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.323 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.323 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:36.323 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.382190+0000", 2024-09-13T06:43:36.323 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0022265039999999998 2024-09-13T06:43:36.323 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:36.323 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:36.323 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:36.323 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.323 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.324 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43223 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 393216~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:43:36.324 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558267+0000", 2024-09-13T06:43:36.324 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 194.72126331699999, 2024-09-13T06:43:36.324 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.062813151999999997, 2024-09-13T06:43:36.324 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:36.324 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:36.324 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:36.324 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:36.324 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:36.324 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43223 2024-09-13T06:43:36.324 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.324 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:36.324 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.324 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:36.325 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558267+0000", 2024-09-13T06:43:36.325 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:36.325 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.325 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.325 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:36.325 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558267+0000", 2024-09-13T06:43:36.325 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:36.325 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.325 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.325 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:36.325 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558266+0000", 2024-09-13T06:43:36.325 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:36.325 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.325 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.326 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:36.326 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558270+0000", 2024-09-13T06:43:36.326 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.2389999999999998e-06 2024-09-13T06:43:36.326 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.326 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.326 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:36.326 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558277+0000", 2024-09-13T06:43:36.326 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5680000000000002e-06 2024-09-13T06:43:36.326 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.326 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.326 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:36.326 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558282+0000", 2024-09-13T06:43:36.326 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7060000000000003e-06 2024-09-13T06:43:36.326 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.327 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.327 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:36.327 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.620731+0000", 2024-09-13T06:43:36.327 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.062448661000000003 2024-09-13T06:43:36.327 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.327 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.327 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:36.327 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.620806+0000", 2024-09-13T06:43:36.327 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5862e-05 2024-09-13T06:43:36.327 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.327 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.327 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:36.328 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.621080+0000", 2024-09-13T06:43:36.328 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00027368599999999998 2024-09-13T06:43:36.328 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:36.328 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:36.328 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:36.328 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.328 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.328 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43224 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 407552~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:43:36.328 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558286+0000", 2024-09-13T06:43:36.328 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 194.721243953, 2024-09-13T06:43:36.328 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.063179052999999999, 2024-09-13T06:43:36.328 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:36.328 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:36.329 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:36.329 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:36.329 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:36.329 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43224 2024-09-13T06:43:36.329 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.329 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:36.329 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.329 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:36.329 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558286+0000", 2024-09-13T06:43:36.329 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:36.329 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.329 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.329 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:36.329 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558286+0000", 2024-09-13T06:43:36.330 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:36.330 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.330 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.330 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:36.330 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558286+0000", 2024-09-13T06:43:36.330 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:36.330 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.330 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.330 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:36.330 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558288+0000", 2024-09-13T06:43:36.330 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.227e-06 2024-09-13T06:43:36.330 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.330 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.331 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:36.331 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558292+0000", 2024-09-13T06:43:36.331 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.6289999999999999e-06 2024-09-13T06:43:36.331 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.331 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.331 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:36.331 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558294+0000", 2024-09-13T06:43:36.331 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5409999999999999e-06 2024-09-13T06:43:36.331 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.331 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.331 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:36.331 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.621110+0000", 2024-09-13T06:43:36.331 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.062815776000000004 2024-09-13T06:43:36.331 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.331 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.332 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:36.332 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.621186+0000", 2024-09-13T06:43:36.332 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5570999999999999e-05 2024-09-13T06:43:36.332 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.332 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.332 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:36.332 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.621465+0000", 2024-09-13T06:43:36.332 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00027988200000000001 2024-09-13T06:43:36.332 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:36.332 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:36.332 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:36.332 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.332 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.332 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43225 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 421888~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:43:36.333 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558296+0000", 2024-09-13T06:43:36.333 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 194.72123398599999, 2024-09-13T06:43:36.333 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.063551110999999993, 2024-09-13T06:43:36.333 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:36.333 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:36.333 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:36.333 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:36.333 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:36.333 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43225 2024-09-13T06:43:36.333 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.333 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:36.333 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.333 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:36.334 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558296+0000", 2024-09-13T06:43:36.334 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:36.334 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.334 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.334 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:36.334 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558296+0000", 2024-09-13T06:43:36.334 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:36.334 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.334 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.334 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:36.334 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558296+0000", 2024-09-13T06:43:36.334 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:43:36.334 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.334 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.335 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:36.335 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558305+0000", 2024-09-13T06:43:36.335 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.5290000000000008e-06 2024-09-13T06:43:36.335 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.335 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.335 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:36.335 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558308+0000", 2024-09-13T06:43:36.335 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.5619999999999999e-06 2024-09-13T06:43:36.335 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.335 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.335 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:36.335 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558311+0000", 2024-09-13T06:43:36.335 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.43e-06 2024-09-13T06:43:36.335 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.335 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.336 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:36.336 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.621495+0000", 2024-09-13T06:43:36.336 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.063184289000000005 2024-09-13T06:43:36.336 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.336 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.336 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:36.336 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.621569+0000", 2024-09-13T06:43:36.336 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4250000000000002e-05 2024-09-13T06:43:36.336 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.336 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.336 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:36.336 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.621847+0000", 2024-09-13T06:43:36.336 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00027826400000000002 2024-09-13T06:43:36.336 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:36.337 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:36.337 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:36.337 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.337 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.337 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43226 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 436224~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:43:36.337 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558313+0000", 2024-09-13T06:43:36.337 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 194.72121734999999, 2024-09-13T06:43:36.337 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.063914420999999999, 2024-09-13T06:43:36.337 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:36.337 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:36.337 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:36.337 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:36.337 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:36.338 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43226 2024-09-13T06:43:36.338 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.338 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:36.338 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.338 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:36.338 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558313+0000", 2024-09-13T06:43:36.338 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:36.338 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.338 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.338 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:36.338 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558313+0000", 2024-09-13T06:43:36.338 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:36.338 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.338 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.339 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:36.339 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558313+0000", 2024-09-13T06:43:36.339 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:36.339 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.339 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.339 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:36.339 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558314+0000", 2024-09-13T06:43:36.339 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3740000000000001e-06 2024-09-13T06:43:36.339 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.339 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.339 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:36.339 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558317+0000", 2024-09-13T06:43:36.339 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9730000000000002e-06 2024-09-13T06:43:36.340 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.340 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.340 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:36.340 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558319+0000", 2024-09-13T06:43:36.340 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4059999999999999e-06 2024-09-13T06:43:36.340 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.340 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.340 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:36.340 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.621877+0000", 2024-09-13T06:43:36.340 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.063557408999999995 2024-09-13T06:43:36.340 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.340 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.340 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:36.340 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.621951+0000", 2024-09-13T06:43:36.341 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4487999999999996e-05 2024-09-13T06:43:36.341 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.341 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.341 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:36.341 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.622227+0000", 2024-09-13T06:43:36.341 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000276011 2024-09-13T06:43:36.341 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:36.341 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:36.341 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:36.341 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.341 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.341 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43227 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 450560~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:43:36.341 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558322+0000", 2024-09-13T06:43:36.342 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 194.72120876899999, 2024-09-13T06:43:36.342 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.064285348000000006, 2024-09-13T06:43:36.342 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:36.342 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:36.342 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:36.342 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:36.342 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:36.342 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43227 2024-09-13T06:43:36.342 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.342 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:36.342 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.342 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:36.342 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558322+0000", 2024-09-13T06:43:36.342 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:36.342 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.343 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.343 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:36.343 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558322+0000", 2024-09-13T06:43:36.343 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:36.343 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.343 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.343 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:36.343 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558321+0000", 2024-09-13T06:43:36.343 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:43:36.343 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.343 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.343 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:36.343 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558323+0000", 2024-09-13T06:43:36.343 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.576e-06 2024-09-13T06:43:36.343 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.344 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.344 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:36.344 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558328+0000", 2024-09-13T06:43:36.344 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0719999999999999e-06 2024-09-13T06:43:36.344 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.344 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.344 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:36.344 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558332+0000", 2024-09-13T06:43:36.344 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.8130000000000002e-06 2024-09-13T06:43:36.344 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.344 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.344 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:36.344 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.622255+0000", 2024-09-13T06:43:36.344 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.063923195000000002 2024-09-13T06:43:36.345 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.345 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.345 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:36.345 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.622330+0000", 2024-09-13T06:43:36.345 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5383000000000007e-05 2024-09-13T06:43:36.345 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.345 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.345 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:36.345 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.622607+0000", 2024-09-13T06:43:36.345 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00027651999999999999 2024-09-13T06:43:36.345 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:36.347 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:36.348 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:36.348 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.348 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.348 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43228 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 464896~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:43:36.348 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558335+0000", 2024-09-13T06:43:36.348 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 194.72119486, 2024-09-13T06:43:36.348 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.064652253000000007, 2024-09-13T06:43:36.348 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:36.348 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:36.348 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:36.348 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:36.349 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:36.349 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43228 2024-09-13T06:43:36.349 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.349 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:36.349 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.349 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:36.349 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558335+0000", 2024-09-13T06:43:36.349 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:36.349 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.349 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.349 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:36.349 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558335+0000", 2024-09-13T06:43:36.349 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:36.350 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.350 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.350 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:36.350 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558335+0000", 2024-09-13T06:43:36.350 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:36.350 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.350 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.350 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:36.350 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558337+0000", 2024-09-13T06:43:36.350 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1380000000000001e-06 2024-09-13T06:43:36.350 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.350 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.350 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:36.350 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558343+0000", 2024-09-13T06:43:36.351 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.5140000000000001e-06 2024-09-13T06:43:36.351 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.351 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.351 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:36.351 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558348+0000", 2024-09-13T06:43:36.351 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9640000000000002e-06 2024-09-13T06:43:36.351 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.351 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.351 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:36.351 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.622636+0000", 2024-09-13T06:43:36.351 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.064288260999999999 2024-09-13T06:43:36.351 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.351 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.351 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:36.352 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.622715+0000", 2024-09-13T06:43:36.352 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.9351000000000006e-05 2024-09-13T06:43:36.352 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.352 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.352 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:36.352 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.622988+0000", 2024-09-13T06:43:36.352 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00027242599999999998 2024-09-13T06:43:36.352 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:36.352 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:36.352 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:36.352 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.352 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.352 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43229 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 479232~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:43:36.352 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558352+0000", 2024-09-13T06:43:36.353 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 194.72117844499999, 2024-09-13T06:43:36.353 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.065018024999999993, 2024-09-13T06:43:36.353 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:36.353 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:36.353 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:36.353 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:36.353 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:36.353 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43229 2024-09-13T06:43:36.353 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.353 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:36.353 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.353 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:36.353 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558352+0000", 2024-09-13T06:43:36.353 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:36.354 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.354 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.354 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:36.354 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558352+0000", 2024-09-13T06:43:36.354 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:36.354 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.354 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.354 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:36.354 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558352+0000", 2024-09-13T06:43:36.354 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:36.354 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.354 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.354 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:36.354 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558354+0000", 2024-09-13T06:43:36.354 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4930000000000001e-06 2024-09-13T06:43:36.355 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.355 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.355 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:36.355 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558360+0000", 2024-09-13T06:43:36.355 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.263e-06 2024-09-13T06:43:36.355 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.355 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.355 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:36.355 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558369+0000", 2024-09-13T06:43:36.355 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.0829999999999993e-06 2024-09-13T06:43:36.355 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.355 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.355 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:36.355 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.623017+0000", 2024-09-13T06:43:36.356 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.064647799000000006 2024-09-13T06:43:36.356 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.356 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.356 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:36.356 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.623090+0000", 2024-09-13T06:43:36.356 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3071000000000006e-05 2024-09-13T06:43:36.356 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.356 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.356 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:36.356 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.623370+0000", 2024-09-13T06:43:36.356 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000279661 2024-09-13T06:43:36.356 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:36.357 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:36.357 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:36.357 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.357 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.357 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43230 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 493568~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:43:36.357 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558374+0000", 2024-09-13T06:43:36.357 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 194.72115615199999, 2024-09-13T06:43:36.357 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.065410435000000003, 2024-09-13T06:43:36.357 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:36.357 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:36.357 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:36.357 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:36.358 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:36.358 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43230 2024-09-13T06:43:36.358 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.358 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:36.358 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.358 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:36.358 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558374+0000", 2024-09-13T06:43:36.358 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:36.358 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.358 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.358 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:36.358 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558374+0000", 2024-09-13T06:43:36.358 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:36.358 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.359 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.359 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:36.359 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558374+0000", 2024-09-13T06:43:36.359 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:36.359 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.359 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.359 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:36.359 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558376+0000", 2024-09-13T06:43:36.359 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4430000000000002e-06 2024-09-13T06:43:36.359 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.359 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.359 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:36.359 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558382+0000", 2024-09-13T06:43:36.359 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3029999999999996e-06 2024-09-13T06:43:36.360 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.360 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.360 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:36.360 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558387+0000", 2024-09-13T06:43:36.360 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.1699999999999999e-06 2024-09-13T06:43:36.360 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.360 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.360 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:36.360 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.623400+0000", 2024-09-13T06:43:36.360 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.065013244999999997 2024-09-13T06:43:36.360 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.360 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.360 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:36.360 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.623474+0000", 2024-09-13T06:43:36.361 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3889999999999999e-05 2024-09-13T06:43:36.361 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.361 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.361 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:36.361 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.623785+0000", 2024-09-13T06:43:36.361 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00031080099999999998 2024-09-13T06:43:36.361 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:36.361 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:36.361 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:36.361 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.361 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.361 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43231 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 507904~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:43:36.361 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558391+0000", 2024-09-13T06:43:36.361 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 194.721139467, 2024-09-13T06:43:36.361 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.065788597000000004, 2024-09-13T06:43:36.362 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:36.362 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:36.362 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:36.362 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:36.362 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:36.362 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43231 2024-09-13T06:43:36.362 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.362 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:36.362 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.362 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:36.362 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558391+0000", 2024-09-13T06:43:36.362 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:36.362 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.362 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.363 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:36.363 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558391+0000", 2024-09-13T06:43:36.363 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:36.363 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.363 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.363 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:36.363 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558390+0000", 2024-09-13T06:43:36.363 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:36.363 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.363 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.363 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:36.363 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558393+0000", 2024-09-13T06:43:36.363 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2570000000000002e-06 2024-09-13T06:43:36.363 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.363 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.364 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:36.364 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558399+0000", 2024-09-13T06:43:36.364 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0419999999999999e-06 2024-09-13T06:43:36.364 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.364 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.364 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:36.364 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558403+0000", 2024-09-13T06:43:36.364 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6249999999999998e-06 2024-09-13T06:43:36.364 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.364 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.364 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:36.364 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.623811+0000", 2024-09-13T06:43:36.364 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.065407549999999995 2024-09-13T06:43:36.364 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.365 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.365 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:36.365 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.623877+0000", 2024-09-13T06:43:36.365 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.5902999999999996e-05 2024-09-13T06:43:36.365 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.365 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.365 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:36.365 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.624179+0000", 2024-09-13T06:43:36.365 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00030259999999999998 2024-09-13T06:43:36.365 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:36.365 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:36.365 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:36.365 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.366 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.366 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43232 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 522240~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:43:36.366 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558422+0000", 2024-09-13T06:43:36.366 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 194.72110868999999, 2024-09-13T06:43:36.366 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.066176061999999994, 2024-09-13T06:43:36.366 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:36.366 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:36.366 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:36.366 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:36.366 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:36.366 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43232 2024-09-13T06:43:36.366 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.366 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:36.367 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.367 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:36.367 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558422+0000", 2024-09-13T06:43:36.367 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:36.367 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.367 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.367 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:36.367 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558422+0000", 2024-09-13T06:43:36.367 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:36.367 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.367 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.367 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:36.367 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558421+0000", 2024-09-13T06:43:36.367 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:36.368 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.368 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.368 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:36.368 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558428+0000", 2024-09-13T06:43:36.368 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.1690000000000003e-06 2024-09-13T06:43:36.368 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.368 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.368 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:36.368 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558434+0000", 2024-09-13T06:43:36.368 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9309999999999996e-06 2024-09-13T06:43:36.368 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.368 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.368 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:36.369 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558447+0000", 2024-09-13T06:43:36.369 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.271e-05 2024-09-13T06:43:36.369 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.369 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.369 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:36.369 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.624209+0000", 2024-09-13T06:43:36.369 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.065762102000000003 2024-09-13T06:43:36.369 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.369 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.369 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:36.369 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.624282+0000", 2024-09-13T06:43:36.369 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.2889e-05 2024-09-13T06:43:36.369 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.369 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.369 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:36.370 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.624598+0000", 2024-09-13T06:43:36.370 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00031591399999999998 2024-09-13T06:43:36.370 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:36.370 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:36.370 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:36.370 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.370 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.370 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43486 3.f 3:f7da9c8f:::rbd_data.1121f5f2e1c0.000000000000000b:1f [read 260096~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:43:36.370 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.569088+0000", 2024-09-13T06:43:36.370 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 194.71044196700001, 2024-09-13T06:43:36.370 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.062579223000000003, 2024-09-13T06:43:36.370 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:36.370 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:36.370 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:36.370 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:36.371 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:36.371 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43486 2024-09-13T06:43:36.371 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.371 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:36.371 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.371 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:36.371 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.569088+0000", 2024-09-13T06:43:36.371 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:36.371 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.371 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.371 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:36.372 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.569088+0000", 2024-09-13T06:43:36.372 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:36.372 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.372 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.372 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:36.372 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.569088+0000", 2024-09-13T06:43:36.372 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:36.372 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.372 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.372 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:36.372 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.569091+0000", 2024-09-13T06:43:36.372 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9629999999999998e-06 2024-09-13T06:43:36.372 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.373 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.373 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:36.373 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.569097+0000", 2024-09-13T06:43:36.373 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.4160000000000001e-06 2024-09-13T06:43:36.373 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.373 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.373 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:36.373 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.569102+0000", 2024-09-13T06:43:36.373 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6659999999999999e-06 2024-09-13T06:43:36.373 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.373 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.373 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:36.373 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.631346+0000", 2024-09-13T06:43:36.373 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.062243896 2024-09-13T06:43:36.374 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.374 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.374 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:36.374 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.631413+0000", 2024-09-13T06:43:36.374 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.7638000000000005e-05 2024-09-13T06:43:36.374 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.374 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.374 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:36.374 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.631668+0000", 2024-09-13T06:43:36.374 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0002541 2024-09-13T06:43:36.374 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:36.374 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:36.374 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:36.375 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.375 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.375 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:170125 3.9 3:94e4bf8d:::rbd_object_map.1121fa0cc8a3.000000000000006d:head [writefull 0~37] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e190)", 2024-09-13T06:43:36.375 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:42:30.601501+0000", 2024-09-13T06:43:36.375 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 65.678029756000001, 2024-09-13T06:43:36.375 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.80498820000000004, 2024-09-13T06:43:36.375 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:36.375 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:43:36.375 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:36.375 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:36.375 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:36.375 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 170125 2024-09-13T06:43:36.375 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.375 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:36.376 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.376 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:36.376 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:30.601501+0000", 2024-09-13T06:43:36.376 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:36.376 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.376 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.376 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:36.376 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:30.601501+0000", 2024-09-13T06:43:36.376 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:36.376 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.376 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.376 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:36.376 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:30.601499+0000", 2024-09-13T06:43:36.376 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999986 2024-09-13T06:43:36.377 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.377 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.377 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:36.377 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:30.601506+0000", 2024-09-13T06:43:36.377 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.9940000000000003e-06 2024-09-13T06:43:36.377 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.377 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.377 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:36.377 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:30.601519+0000", 2024-09-13T06:43:36.377 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2875e-05 2024-09-13T06:43:36.377 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.377 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.377 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:36.377 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:30.601525+0000", 2024-09-13T06:43:36.377 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8549999999999998e-06 2024-09-13T06:43:36.378 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.378 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.378 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:36.378 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:30.601560+0000", 2024-09-13T06:43:36.378 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.5271000000000002e-05 2024-09-13T06:43:36.378 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.378 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.378 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:43:36.378 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:30.601566+0000", 2024-09-13T06:43:36.378 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3090000000000001e-06 2024-09-13T06:43:36.378 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.378 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.379 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:36.379 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:31.403017+0000", 2024-09-13T06:43:36.379 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.80145064200000005 2024-09-13T06:43:36.379 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.379 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.379 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:36.379 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:31.403252+0000", 2024-09-13T06:43:36.379 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000234718 2024-09-13T06:43:36.379 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.379 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.379 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 7", 2024-09-13T06:43:36.379 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:31.403521+0000", 2024-09-13T06:43:36.379 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00026917 2024-09-13T06:43:36.379 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.379 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.380 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-09-13T06:43:36.380 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:31.404918+0000", 2024-09-13T06:43:36.380 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.001397017 2024-09-13T06:43:36.380 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.380 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.380 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:43:36.380 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:31.406176+0000", 2024-09-13T06:43:36.380 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.001257998 2024-09-13T06:43:36.380 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.380 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.380 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:43:36.380 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:31.406334+0000", 2024-09-13T06:43:36.380 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00015819099999999999 2024-09-13T06:43:36.380 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.381 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.381 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:36.381 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:31.406489+0000", 2024-09-13T06:43:36.381 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00015476699999999999 2024-09-13T06:43:36.381 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:36.381 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:36.381 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:36.381 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:36.381 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:36.381 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:43:36.382 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-13T06:43:36.383 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:43:36.381+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:43:36.484 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:43:36.483+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:43:36.537 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:43:36.537 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-13T06:43:36.537 INFO:teuthology.orchestra.run.smithi081.stdout: "num_ops": 0 2024-09-13T06:43:36.537 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:43:36.550 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-13T06:43:36.594 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:43:36.595+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:43:36.686 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:43:36.685+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:43:36.716 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:43:36.716 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-13T06:43:36.716 INFO:teuthology.orchestra.run.smithi081.stdout: "complaint_time": 30, 2024-09-13T06:43:36.716 INFO:teuthology.orchestra.run.smithi081.stdout: "num_blocked_ops": 0 2024-09-13T06:43:36.716 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:43:36.730 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-13T06:43:36.787 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-13T06:43:36.785+0000 7fa8bb18e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 36790) UID: 0 2024-09-13T06:43:36.850 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:43:36.850 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 20, 2024-09-13T06:43:36.851 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 600, 2024-09-13T06:43:36.851 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [ 2024-09-13T06:43:36.851 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.851 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:2226 3.15 3:af026987:::rbd_data.112173e2f1b7.0000000000000017:head [sparse-read 0~4194304] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-13T06:43:36.851 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:37.606562+0000", 2024-09-13T06:43:36.851 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 239.24256115899999, 2024-09-13T06:43:36.851 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.83322091700000001, 2024-09-13T06:43:36.851 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:36.851 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:43:36.851 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:36.851 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:36.851 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:36.852 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 2226 2024-09-13T06:43:36.852 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.852 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:36.852 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.852 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:36.852 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606562+0000", 2024-09-13T06:43:36.852 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:36.852 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.852 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.852 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:36.852 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606562+0000", 2024-09-13T06:43:36.852 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:36.853 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.853 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.853 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:36.853 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606561+0000", 2024-09-13T06:43:36.853 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:36.853 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.853 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.853 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:36.853 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606565+0000", 2024-09-13T06:43:36.853 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.4379999999999999e-06 2024-09-13T06:43:36.853 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.853 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.854 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:36.854 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606569+0000", 2024-09-13T06:43:36.854 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.425e-06 2024-09-13T06:43:36.854 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.854 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.854 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:36.854 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606572+0000", 2024-09-13T06:43:36.854 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.05e-06 2024-09-13T06:43:36.854 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.854 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.854 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:36.854 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606621+0000", 2024-09-13T06:43:36.855 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.8723000000000001e-05 2024-09-13T06:43:36.855 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.855 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.855 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:43:36.855 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606630+0000", 2024-09-13T06:43:36.855 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.8040000000000007e-06 2024-09-13T06:43:36.855 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.855 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.855 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:36.855 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.439648+0000", 2024-09-13T06:43:36.855 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.83301824800000002 2024-09-13T06:43:36.855 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.855 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.856 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:36.856 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.439782+0000", 2024-09-13T06:43:36.856 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00013466699999999999 2024-09-13T06:43:36.856 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:36.856 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:36.856 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:36.856 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.856 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.856 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25661 3.8 3:1180686c:::rbd_data.1121f2c5ee81.0000000000000009:13 [read 397312~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:43:36.856 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.436956+0000", 2024-09-13T06:43:36.856 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 220.412166625, 2024-09-13T06:43:36.856 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089036758999999993, 2024-09-13T06:43:36.857 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:36.857 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:36.857 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:36.857 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:36.857 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:36.857 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25661 2024-09-13T06:43:36.857 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.857 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:36.857 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.857 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:36.857 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436956+0000", 2024-09-13T06:43:36.857 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:36.858 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.858 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.858 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:36.858 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436956+0000", 2024-09-13T06:43:36.858 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:36.858 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.858 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.858 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:36.858 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436956+0000", 2024-09-13T06:43:36.858 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:36.858 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.858 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.859 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:36.859 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436958+0000", 2024-09-13T06:43:36.859 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1770000000000001e-06 2024-09-13T06:43:36.859 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.859 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.859 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:36.859 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436963+0000", 2024-09-13T06:43:36.859 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.6489999999999996e-06 2024-09-13T06:43:36.859 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.859 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.859 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:36.859 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436975+0000", 2024-09-13T06:43:36.859 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1783999999999999e-05 2024-09-13T06:43:36.859 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.860 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.860 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:36.860 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.525671+0000", 2024-09-13T06:43:36.860 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.088696292999999995 2024-09-13T06:43:36.860 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.860 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.860 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:36.860 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.525749+0000", 2024-09-13T06:43:36.860 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.7589000000000005e-05 2024-09-13T06:43:36.860 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.860 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.860 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:36.860 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.525993+0000", 2024-09-13T06:43:36.860 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00024381000000000001 2024-09-13T06:43:36.861 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:36.861 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:36.861 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:36.861 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.861 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.861 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25662 3.8 3:1180686c:::rbd_data.1121f2c5ee81.0000000000000009:13 [read 421888~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:43:36.861 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.436980+0000", 2024-09-13T06:43:36.861 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 220.412142313, 2024-09-13T06:43:36.861 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089367577000000004, 2024-09-13T06:43:36.861 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:36.861 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:36.861 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:36.861 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:36.862 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:36.862 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25662 2024-09-13T06:43:36.862 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.862 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:36.862 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.862 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:36.862 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436980+0000", 2024-09-13T06:43:36.862 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:36.862 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.862 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.862 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:36.862 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436980+0000", 2024-09-13T06:43:36.862 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:36.862 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.863 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.863 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:36.863 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436980+0000", 2024-09-13T06:43:36.863 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:36.863 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.863 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.863 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:36.863 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436982+0000", 2024-09-13T06:43:36.863 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3989999999999998e-06 2024-09-13T06:43:36.863 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.863 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.863 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:36.863 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436988+0000", 2024-09-13T06:43:36.863 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0039999999999996e-06 2024-09-13T06:43:36.864 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.864 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.864 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:36.864 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436993+0000", 2024-09-13T06:43:36.864 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6090000000000003e-06 2024-09-13T06:43:36.864 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.864 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.864 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:36.864 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.526035+0000", 2024-09-13T06:43:36.864 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089042248000000004 2024-09-13T06:43:36.864 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.864 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.864 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:36.865 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.526111+0000", 2024-09-13T06:43:36.865 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5643999999999996e-05 2024-09-13T06:43:36.865 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.865 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.865 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:36.865 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.526348+0000", 2024-09-13T06:43:36.865 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00023705800000000001 2024-09-13T06:43:36.865 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:36.865 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:36.865 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:36.865 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.865 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.865 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25663 3.8 3:1180686c:::rbd_data.1121f2c5ee81.0000000000000009:13 [read 466944~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:43:36.866 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.436998+0000", 2024-09-13T06:43:36.866 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 220.41212466600001, 2024-09-13T06:43:36.866 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089730867000000006, 2024-09-13T06:43:36.866 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:36.866 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:36.866 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:36.866 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:36.866 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:36.866 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25663 2024-09-13T06:43:36.866 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.866 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:36.866 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.866 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:36.866 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436998+0000", 2024-09-13T06:43:36.867 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:36.867 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.867 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.867 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:36.867 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436998+0000", 2024-09-13T06:43:36.867 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:36.867 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.867 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.867 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:36.867 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436998+0000", 2024-09-13T06:43:36.867 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:36.867 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.867 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.867 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:36.868 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437000+0000", 2024-09-13T06:43:36.868 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0940000000000002e-06 2024-09-13T06:43:36.868 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.868 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.868 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:36.868 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437005+0000", 2024-09-13T06:43:36.868 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.604e-06 2024-09-13T06:43:36.868 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.868 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.868 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:36.868 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437032+0000", 2024-09-13T06:43:36.868 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6407e-05 2024-09-13T06:43:36.868 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.869 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.869 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:36.869 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.526363+0000", 2024-09-13T06:43:36.869 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089331456000000004 2024-09-13T06:43:36.869 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.869 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.869 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:36.869 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.526404+0000", 2024-09-13T06:43:36.869 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.0887999999999999e-05 2024-09-13T06:43:36.869 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.869 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.869 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:36.869 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.526729+0000", 2024-09-13T06:43:36.870 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00032486 2024-09-13T06:43:36.870 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:36.870 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:36.870 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:36.870 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.870 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.870 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25664 3.8 3:1180686c:::rbd_data.1121f2c5ee81.0000000000000009:13 [read 491520~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:43:36.870 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.437040+0000", 2024-09-13T06:43:36.870 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 220.41208275100001, 2024-09-13T06:43:36.870 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.090016650000000004, 2024-09-13T06:43:36.870 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:36.870 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:36.870 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:36.870 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:36.871 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:36.871 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25664 2024-09-13T06:43:36.871 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.871 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:36.871 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.871 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:36.871 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437040+0000", 2024-09-13T06:43:36.871 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:36.871 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.871 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.871 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:36.871 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437040+0000", 2024-09-13T06:43:36.871 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:36.871 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.872 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.872 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:36.872 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437039+0000", 2024-09-13T06:43:36.872 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:36.872 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.872 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.872 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:36.872 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437047+0000", 2024-09-13T06:43:36.872 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4839999999999998e-06 2024-09-13T06:43:36.872 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.872 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.872 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:36.872 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437054+0000", 2024-09-13T06:43:36.873 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.8299999999999998e-06 2024-09-13T06:43:36.873 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.873 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.873 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:36.873 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437060+0000", 2024-09-13T06:43:36.873 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.1510000000000001e-06 2024-09-13T06:43:36.873 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.873 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.873 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:36.873 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.526772+0000", 2024-09-13T06:43:36.873 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089711737999999999 2024-09-13T06:43:36.873 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.873 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.874 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:36.874 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.526848+0000", 2024-09-13T06:43:36.874 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5870000000000004e-05 2024-09-13T06:43:36.874 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.874 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.874 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:36.874 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.527057+0000", 2024-09-13T06:43:36.874 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000209106 2024-09-13T06:43:36.874 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:36.874 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:36.874 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:36.874 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.874 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.874 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25740 3.18 3:1c662b96:::rbd_data.1121f2c5ee81.0000000000000010:13 [read 200704~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:43:36.875 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443352+0000", 2024-09-13T06:43:36.875 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 220.40577107600001, 2024-09-13T06:43:36.875 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089068222000000002, 2024-09-13T06:43:36.875 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:36.875 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:36.875 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:36.875 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:36.875 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:36.875 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25740 2024-09-13T06:43:36.875 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.875 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:36.875 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.875 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:36.876 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443352+0000", 2024-09-13T06:43:36.876 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:36.876 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.876 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.876 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:36.876 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443352+0000", 2024-09-13T06:43:36.876 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:36.876 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.876 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.876 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:36.876 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443351+0000", 2024-09-13T06:43:36.876 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:36.876 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.876 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.877 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:36.877 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443354+0000", 2024-09-13T06:43:36.877 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.841e-06 2024-09-13T06:43:36.877 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.877 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.877 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:36.877 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443361+0000", 2024-09-13T06:43:36.877 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.0010000000000004e-06 2024-09-13T06:43:36.877 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.877 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.877 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:36.877 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443366+0000", 2024-09-13T06:43:36.877 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7119999999999999e-06 2024-09-13T06:43:36.878 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.878 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.878 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:36.878 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532117+0000", 2024-09-13T06:43:36.878 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.088751327000000005 2024-09-13T06:43:36.878 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.878 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.878 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:36.878 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532193+0000", 2024-09-13T06:43:36.879 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5839000000000004e-05 2024-09-13T06:43:36.879 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.879 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.879 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:36.879 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532420+0000", 2024-09-13T06:43:36.879 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00022691000000000001 2024-09-13T06:43:36.879 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:36.879 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:36.879 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:36.879 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.879 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.879 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25741 3.18 3:1c662b96:::rbd_data.1121f2c5ee81.0000000000000010:13 [read 225280~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:43:36.879 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443378+0000", 2024-09-13T06:43:36.879 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 220.405744309, 2024-09-13T06:43:36.880 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089324107, 2024-09-13T06:43:36.880 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:36.880 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:36.880 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:36.880 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:36.880 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:36.880 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25741 2024-09-13T06:43:36.880 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.880 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:36.880 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.880 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:36.880 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443378+0000", 2024-09-13T06:43:36.881 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:36.881 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.881 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.881 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:36.881 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443378+0000", 2024-09-13T06:43:36.881 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:36.881 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.881 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.881 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:36.881 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443378+0000", 2024-09-13T06:43:36.881 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:36.881 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.881 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.881 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:36.882 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443380+0000", 2024-09-13T06:43:36.882 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3549999999999999e-06 2024-09-13T06:43:36.882 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.882 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.882 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:36.882 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443388+0000", 2024-09-13T06:43:36.882 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.7449999999999995e-06 2024-09-13T06:43:36.882 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.882 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.882 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:36.882 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443393+0000", 2024-09-13T06:43:36.882 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.4e-06 2024-09-13T06:43:36.882 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.882 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.883 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:36.883 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532454+0000", 2024-09-13T06:43:36.883 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089060941000000005 2024-09-13T06:43:36.883 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.883 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.883 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:36.883 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532512+0000", 2024-09-13T06:43:36.883 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7763000000000002e-05 2024-09-13T06:43:36.883 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.883 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.883 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:36.883 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532703+0000", 2024-09-13T06:43:36.883 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000190328 2024-09-13T06:43:36.884 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:36.884 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:36.884 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:36.884 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.884 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.884 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25742 3.18 3:1c662b96:::rbd_data.1121f2c5ee81.0000000000000010:13 [read 270336~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:43:36.884 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443398+0000", 2024-09-13T06:43:36.884 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 220.40572459699999, 2024-09-13T06:43:36.884 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089621836999999996, 2024-09-13T06:43:36.884 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:36.884 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:36.884 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:36.884 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:36.885 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:36.885 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25742 2024-09-13T06:43:36.885 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.885 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:36.885 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.885 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:36.885 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443398+0000", 2024-09-13T06:43:36.885 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:36.885 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.885 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.885 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:36.885 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443398+0000", 2024-09-13T06:43:36.886 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:36.886 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.886 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.886 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:36.886 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443398+0000", 2024-09-13T06:43:36.886 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:36.886 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.886 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.886 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:36.886 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443400+0000", 2024-09-13T06:43:36.886 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1849999999999998e-06 2024-09-13T06:43:36.886 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.886 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.887 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:36.887 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443407+0000", 2024-09-13T06:43:36.887 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3669999999999999e-06 2024-09-13T06:43:36.887 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.887 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.887 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:36.887 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443420+0000", 2024-09-13T06:43:36.887 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2645e-05 2024-09-13T06:43:36.887 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.887 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.887 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:36.887 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532742+0000", 2024-09-13T06:43:36.887 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089322200000000004 2024-09-13T06:43:36.887 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.888 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.888 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:36.888 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532818+0000", 2024-09-13T06:43:36.888 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.6019000000000005e-05 2024-09-13T06:43:36.888 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.888 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.888 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:36.888 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533020+0000", 2024-09-13T06:43:36.888 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000201721 2024-09-13T06:43:36.888 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:36.888 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:36.888 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:36.888 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.889 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.889 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25743 3.18 3:1c662b96:::rbd_data.1121f2c5ee81.0000000000000010:13 [read 294912~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:43:36.889 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443425+0000", 2024-09-13T06:43:36.889 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 220.405697589, 2024-09-13T06:43:36.889 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089864075000000002, 2024-09-13T06:43:36.889 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:36.889 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:36.889 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:36.889 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:36.889 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:36.889 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25743 2024-09-13T06:43:36.889 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.890 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:36.890 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.890 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:36.890 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443425+0000", 2024-09-13T06:43:36.890 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:36.890 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.890 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.890 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:36.890 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443425+0000", 2024-09-13T06:43:36.890 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:36.890 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.890 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.890 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:36.890 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443425+0000", 2024-09-13T06:43:36.891 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:36.891 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.891 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.891 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:36.891 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443432+0000", 2024-09-13T06:43:36.891 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3420000000000002e-06 2024-09-13T06:43:36.891 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.891 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.891 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:36.891 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443440+0000", 2024-09-13T06:43:36.891 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5689999999999999e-06 2024-09-13T06:43:36.891 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.891 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.892 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:36.892 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443445+0000", 2024-09-13T06:43:36.892 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9590000000000003e-06 2024-09-13T06:43:36.892 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.892 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.892 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:36.892 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533063+0000", 2024-09-13T06:43:36.892 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089617988999999995 2024-09-13T06:43:36.892 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.892 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.892 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:36.892 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533122+0000", 2024-09-13T06:43:36.892 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9052999999999999e-05 2024-09-13T06:43:36.893 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.893 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.893 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:36.893 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533289+0000", 2024-09-13T06:43:36.893 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00016752800000000001 2024-09-13T06:43:36.893 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:36.893 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:36.893 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:36.893 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.893 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.893 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25744 3.18 3.69d46638 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:43:36.894 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443449+0000", 2024-09-13T06:43:36.894 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 220.40567344199999, 2024-09-13T06:43:36.894 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089869148999999995, 2024-09-13T06:43:36.894 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:36.894 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:43:36.894 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:36.894 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:36.894 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:36.894 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25744 2024-09-13T06:43:36.894 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.894 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:36.894 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.894 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:36.894 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443449+0000", 2024-09-13T06:43:36.895 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:36.895 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.895 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.895 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:36.895 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443449+0000", 2024-09-13T06:43:36.895 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:36.895 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.895 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.895 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:36.895 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443449+0000", 2024-09-13T06:43:36.895 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:36.895 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.895 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.896 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:36.896 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443451+0000", 2024-09-13T06:43:36.896 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.244e-06 2024-09-13T06:43:36.896 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.896 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.896 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:36.896 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443457+0000", 2024-09-13T06:43:36.896 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.66e-06 2024-09-13T06:43:36.896 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.896 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.896 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:36.896 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443461+0000", 2024-09-13T06:43:36.896 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5449999999999997e-06 2024-09-13T06:43:36.896 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.897 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.897 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:36.897 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533311+0000", 2024-09-13T06:43:36.897 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089849729000000003 2024-09-13T06:43:36.897 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.897 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.897 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:36.897 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533318+0000", 2024-09-13T06:43:36.897 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.328e-06 2024-09-13T06:43:36.897 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:36.897 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:36.897 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:36.897 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.898 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.898 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25745 3.18 3.69d46638 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:43:36.898 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443466+0000", 2024-09-13T06:43:36.898 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 220.405656384, 2024-09-13T06:43:36.898 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089886743000000005, 2024-09-13T06:43:36.898 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:36.898 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:43:36.898 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:36.898 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:36.898 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:36.898 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25745 2024-09-13T06:43:36.898 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.898 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:36.899 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.899 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:36.899 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443466+0000", 2024-09-13T06:43:36.899 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:36.899 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.899 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.899 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:36.899 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443466+0000", 2024-09-13T06:43:36.899 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:36.899 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.899 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.899 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:36.899 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443466+0000", 2024-09-13T06:43:36.899 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:36.900 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.900 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.900 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:36.900 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443474+0000", 2024-09-13T06:43:36.900 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.1289999999999996e-06 2024-09-13T06:43:36.900 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.900 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.900 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:36.901 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443484+0000", 2024-09-13T06:43:36.901 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0654e-05 2024-09-13T06:43:36.901 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.901 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.901 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:36.901 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443490+0000", 2024-09-13T06:43:36.901 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8030000000000002e-06 2024-09-13T06:43:36.901 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.901 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.901 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:36.901 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533348+0000", 2024-09-13T06:43:36.901 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089857267000000005 2024-09-13T06:43:36.901 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.902 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.902 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:36.902 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533353+0000", 2024-09-13T06:43:36.902 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.5520000000000004e-06 2024-09-13T06:43:36.902 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:36.902 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:36.902 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:36.902 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.902 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.902 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25746 3.18 3.69d46638 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:43:36.902 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443495+0000", 2024-09-13T06:43:36.902 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 220.40562727099999, 2024-09-13T06:43:36.902 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089903725000000004, 2024-09-13T06:43:36.902 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:36.903 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:43:36.903 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:36.903 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:36.903 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:36.903 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25746 2024-09-13T06:43:36.903 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.903 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:36.903 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.903 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:36.903 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443495+0000", 2024-09-13T06:43:36.903 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:36.903 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.903 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.904 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:36.904 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443495+0000", 2024-09-13T06:43:36.904 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:36.904 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.904 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.904 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:36.904 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443495+0000", 2024-09-13T06:43:36.904 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:36.904 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.904 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.904 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:36.904 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443498+0000", 2024-09-13T06:43:36.904 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.7690000000000001e-06 2024-09-13T06:43:36.905 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.905 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.905 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:36.905 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443504+0000", 2024-09-13T06:43:36.905 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9710000000000001e-06 2024-09-13T06:43:36.905 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.905 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.905 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:36.905 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443508+0000", 2024-09-13T06:43:36.905 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4159999999999997e-06 2024-09-13T06:43:36.905 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.905 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.905 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:36.906 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533391+0000", 2024-09-13T06:43:36.906 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089882607000000003 2024-09-13T06:43:36.906 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.906 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.906 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:36.906 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533399+0000", 2024-09-13T06:43:36.906 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.4349999999999997e-06 2024-09-13T06:43:36.906 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:36.906 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:36.906 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:36.906 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.906 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.906 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25747 3.8 3.63996268 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:43:36.906 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443512+0000", 2024-09-13T06:43:36.907 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 220.40561054, 2024-09-13T06:43:36.907 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089880075000000004, 2024-09-13T06:43:36.907 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:36.907 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:43:36.907 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:36.907 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:36.907 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:36.907 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25747 2024-09-13T06:43:36.907 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.907 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:36.907 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.907 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:36.907 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443512+0000", 2024-09-13T06:43:36.907 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:36.908 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.908 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.908 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:36.908 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443512+0000", 2024-09-13T06:43:36.908 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:36.908 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.908 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.908 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:36.908 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443512+0000", 2024-09-13T06:43:36.908 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:36.908 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.908 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.908 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:36.909 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443514+0000", 2024-09-13T06:43:36.909 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0980000000000001e-06 2024-09-13T06:43:36.909 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.909 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.909 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:36.909 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443520+0000", 2024-09-13T06:43:36.909 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7069999999999997e-06 2024-09-13T06:43:36.909 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.909 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.909 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:36.909 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443524+0000", 2024-09-13T06:43:36.909 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5390000000000001e-06 2024-09-13T06:43:36.909 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.910 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.910 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:36.910 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533384+0000", 2024-09-13T06:43:36.910 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089859684999999995 2024-09-13T06:43:36.910 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.910 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.910 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:36.910 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533392+0000", 2024-09-13T06:43:36.910 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.3440000000000001e-06 2024-09-13T06:43:36.910 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:36.910 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:36.910 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:36.910 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.911 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.911 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25748 3.8 3.63996268 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:43:36.911 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443528+0000", 2024-09-13T06:43:36.911 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 220.40559441299999, 2024-09-13T06:43:36.911 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089890715999999996, 2024-09-13T06:43:36.911 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:36.911 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:43:36.911 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:36.911 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:36.911 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:36.911 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25748 2024-09-13T06:43:36.911 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.911 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:36.912 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.912 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:36.912 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443528+0000", 2024-09-13T06:43:36.912 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:36.912 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.912 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.912 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:36.912 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443528+0000", 2024-09-13T06:43:36.912 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:36.912 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.912 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.912 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:36.912 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443528+0000", 2024-09-13T06:43:36.912 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:36.913 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.913 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.913 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:36.913 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443530+0000", 2024-09-13T06:43:36.913 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0650000000000001e-06 2024-09-13T06:43:36.913 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.913 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.913 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:36.913 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443536+0000", 2024-09-13T06:43:36.913 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7259999999999999e-06 2024-09-13T06:43:36.913 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.913 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.913 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:36.914 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443540+0000", 2024-09-13T06:43:36.914 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5009999999999998e-06 2024-09-13T06:43:36.914 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.914 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.914 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:36.914 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533412+0000", 2024-09-13T06:43:36.914 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089871873000000005 2024-09-13T06:43:36.914 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.914 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.914 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:36.914 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533419+0000", 2024-09-13T06:43:36.914 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.883e-06 2024-09-13T06:43:36.914 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:36.915 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:36.915 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:36.915 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.915 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.915 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25749 3.8 3.63996268 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:43:36.915 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443545+0000", 2024-09-13T06:43:36.915 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 220.405578217, 2024-09-13T06:43:36.915 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089897988999999998, 2024-09-13T06:43:36.915 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:36.915 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:43:36.916 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:36.916 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:36.916 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:36.916 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25749 2024-09-13T06:43:36.916 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.916 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:36.916 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.916 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:36.916 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443545+0000", 2024-09-13T06:43:36.916 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:36.916 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.916 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.916 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:36.917 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443545+0000", 2024-09-13T06:43:36.917 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:36.917 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.917 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.917 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:36.917 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443544+0000", 2024-09-13T06:43:36.917 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:36.917 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.917 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.917 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:36.917 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443553+0000", 2024-09-13T06:43:36.917 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.4770000000000003e-06 2024-09-13T06:43:36.917 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.918 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.918 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:36.918 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443564+0000", 2024-09-13T06:43:36.918 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0986e-05 2024-09-13T06:43:36.918 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.918 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.918 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:36.918 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443569+0000", 2024-09-13T06:43:36.918 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2530000000000004e-06 2024-09-13T06:43:36.918 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.918 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.918 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:36.918 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533438+0000", 2024-09-13T06:43:36.918 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089868641999999999 2024-09-13T06:43:36.919 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.919 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.919 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:36.919 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533442+0000", 2024-09-13T06:43:36.919 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.989e-06 2024-09-13T06:43:36.919 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:36.919 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:36.919 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:36.919 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.919 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.919 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25750 3.8 3.63996268 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:43:36.919 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443574+0000", 2024-09-13T06:43:36.919 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 220.40554873100001, 2024-09-13T06:43:36.919 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089895143999999996, 2024-09-13T06:43:36.920 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:36.920 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:43:36.920 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:36.920 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:36.920 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:36.920 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25750 2024-09-13T06:43:36.920 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.920 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:36.920 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.920 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:36.920 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443574+0000", 2024-09-13T06:43:36.920 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:36.920 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.921 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.921 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:36.921 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443574+0000", 2024-09-13T06:43:36.921 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:36.921 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.921 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.921 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:36.921 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443574+0000", 2024-09-13T06:43:36.921 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:36.921 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.921 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.921 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:36.921 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443576+0000", 2024-09-13T06:43:36.921 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6910000000000002e-06 2024-09-13T06:43:36.922 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.922 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.922 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:36.922 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443583+0000", 2024-09-13T06:43:36.922 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.331e-06 2024-09-13T06:43:36.922 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.922 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.922 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:36.922 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443587+0000", 2024-09-13T06:43:36.922 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6129999999999997e-06 2024-09-13T06:43:36.922 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.923 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.923 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:36.923 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533464+0000", 2024-09-13T06:43:36.923 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089876605999999998 2024-09-13T06:43:36.923 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.923 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.923 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:36.923 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533469+0000", 2024-09-13T06:43:36.923 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3909999999999997e-06 2024-09-13T06:43:36.923 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:36.924 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:36.924 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:36.924 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.924 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.924 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25751 3.8 3.63996268 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:43:36.924 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443592+0000", 2024-09-13T06:43:36.924 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 220.40553103400001, 2024-09-13T06:43:36.924 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089913650999999997, 2024-09-13T06:43:36.924 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:36.924 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:43:36.924 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:36.924 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:36.925 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:36.925 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25751 2024-09-13T06:43:36.925 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.925 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:36.925 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.925 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:36.925 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443592+0000", 2024-09-13T06:43:36.925 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:36.925 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.925 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.925 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:36.926 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443592+0000", 2024-09-13T06:43:36.926 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:36.926 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.926 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.926 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:36.926 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443591+0000", 2024-09-13T06:43:36.926 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:36.926 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.926 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.926 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:36.927 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443594+0000", 2024-09-13T06:43:36.927 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3649999999999998e-06 2024-09-13T06:43:36.927 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.927 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.927 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:36.927 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443599+0000", 2024-09-13T06:43:36.927 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.699e-06 2024-09-13T06:43:36.927 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.927 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.927 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:36.927 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443611+0000", 2024-09-13T06:43:36.927 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1503e-05 2024-09-13T06:43:36.927 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.928 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.928 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:36.928 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533497+0000", 2024-09-13T06:43:36.928 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089886453000000005 2024-09-13T06:43:36.928 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.928 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.928 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:36.928 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533505+0000", 2024-09-13T06:43:36.928 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.9910000000000002e-06 2024-09-13T06:43:36.928 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:36.928 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:36.928 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:36.928 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.929 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.929 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25752 3.8 3.63996268 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:43:36.929 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443615+0000", 2024-09-13T06:43:36.929 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 220.405507253, 2024-09-13T06:43:36.929 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089905868999999999, 2024-09-13T06:43:36.929 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:36.929 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:43:36.929 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:36.929 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:36.929 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:36.929 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25752 2024-09-13T06:43:36.929 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.929 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:36.930 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.930 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:36.930 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443615+0000", 2024-09-13T06:43:36.930 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:36.930 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.930 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.930 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:36.930 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443615+0000", 2024-09-13T06:43:36.930 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:36.930 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.930 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.930 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:36.930 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443615+0000", 2024-09-13T06:43:36.931 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:36.931 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.931 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.931 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:36.931 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443617+0000", 2024-09-13T06:43:36.931 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3539999999999998e-06 2024-09-13T06:43:36.931 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.931 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.931 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:36.931 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443624+0000", 2024-09-13T06:43:36.931 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3600000000000001e-06 2024-09-13T06:43:36.931 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.931 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.932 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:36.932 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443628+0000", 2024-09-13T06:43:36.932 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.2350000000000001e-06 2024-09-13T06:43:36.932 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.932 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.932 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:36.932 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533517+0000", 2024-09-13T06:43:36.932 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089889029999999995 2024-09-13T06:43:36.932 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.932 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.932 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:36.932 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533521+0000", 2024-09-13T06:43:36.932 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.2529999999999998e-06 2024-09-13T06:43:36.933 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:36.933 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:36.933 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:36.933 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.933 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.933 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:64356 3.c 3:32785be9:::rbd_header.11218ba71f0d:head [watch reconnect cookie 140361410387072 gen 2] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e95)", 2024-09-13T06:43:36.933 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:48.473318+0000", 2024-09-13T06:43:36.933 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 168.37580485999999, 2024-09-13T06:43:36.933 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1458904379999999, 2024-09-13T06:43:36.933 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:36.933 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:36.933 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:36.933 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:36.934 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:36.934 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 64356 2024-09-13T06:43:36.934 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.934 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:36.934 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.934 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:36.934 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:48.473318+0000", 2024-09-13T06:43:36.934 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:36.934 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.934 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.934 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:36.934 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:48.473318+0000", 2024-09-13T06:43:36.934 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:36.934 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.934 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.935 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:36.935 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:48.473315+0000", 2024-09-13T06:43:36.935 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999971 2024-09-13T06:43:36.935 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.935 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.935 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:36.935 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:48.473329+0000", 2024-09-13T06:43:36.935 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.433e-05 2024-09-13T06:43:36.935 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.935 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.935 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:36.935 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:48.473363+0000", 2024-09-13T06:43:36.935 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.3592e-05 2024-09-13T06:43:36.936 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.936 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.936 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:36.936 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:48.473386+0000", 2024-09-13T06:43:36.936 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2708999999999999e-05 2024-09-13T06:43:36.936 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.936 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.936 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:36.936 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:48.473804+0000", 2024-09-13T06:43:36.936 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00041789399999999998 2024-09-13T06:43:36.936 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.936 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.936 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:43:36.936 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:48.473830+0000", 2024-09-13T06:43:36.937 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6869e-05 2024-09-13T06:43:36.937 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.937 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.937 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:36.937 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:49.614332+0000", 2024-09-13T06:43:36.937 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.140501107 2024-09-13T06:43:36.937 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.937 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.937 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for rw locks", 2024-09-13T06:43:36.937 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:49.614496+0000", 2024-09-13T06:43:36.937 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00016451200000000001 2024-09-13T06:43:36.937 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.937 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.937 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:36.938 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:49.617131+0000", 2024-09-13T06:43:36.938 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.002634843 2024-09-13T06:43:36.938 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.938 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.938 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:36.938 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:49.617204+0000", 2024-09-13T06:43:36.938 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.2991000000000006e-05 2024-09-13T06:43:36.938 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.938 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.938 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:36.938 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:49.619208+0000", 2024-09-13T06:43:36.938 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.002004381 2024-09-13T06:43:36.938 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:36.939 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:36.939 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:36.939 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.939 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.939 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:170155 3.7 3:e17728eb:::image_client.0-clone36.rbd:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e191)", 2024-09-13T06:43:36.939 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:42:31.436412+0000", 2024-09-13T06:43:36.939 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 65.412711036999994, 2024-09-13T06:43:36.939 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.97843703800000004, 2024-09-13T06:43:36.939 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:36.939 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:43:36.939 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:36.939 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:36.939 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:36.940 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 170155 2024-09-13T06:43:36.940 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.940 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:36.940 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.940 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:36.940 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:31.436412+0000", 2024-09-13T06:43:36.940 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:36.940 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.940 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.940 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:36.940 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:31.436412+0000", 2024-09-13T06:43:36.940 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:36.940 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.940 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.941 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:36.941 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:31.436410+0000", 2024-09-13T06:43:36.941 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999986 2024-09-13T06:43:36.941 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.941 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.941 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:36.941 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:31.436417+0000", 2024-09-13T06:43:36.941 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.6939999999999998e-06 2024-09-13T06:43:36.941 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.941 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.941 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:36.941 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:31.436430+0000", 2024-09-13T06:43:36.941 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3016999999999999e-05 2024-09-13T06:43:36.942 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.942 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.942 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:36.942 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:31.436437+0000", 2024-09-13T06:43:36.942 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.1069999999999999e-06 2024-09-13T06:43:36.942 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.942 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.942 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:36.942 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:31.436515+0000", 2024-09-13T06:43:36.942 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.7756000000000006e-05 2024-09-13T06:43:36.942 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.942 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.942 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:43:36.942 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:31.436523+0000", 2024-09-13T06:43:36.943 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.4970000000000001e-06 2024-09-13T06:43:36.943 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.943 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.943 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:36.943 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:32.414565+0000", 2024-09-13T06:43:36.943 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.97804144199999998 2024-09-13T06:43:36.943 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:36.943 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:36.943 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:36.943 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:32.414849+0000", 2024-09-13T06:43:36.943 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00028388600000000001 2024-09-13T06:43:36.943 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:36.943 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:36.944 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:36.944 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:36.944 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:36.944 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:43:36.945 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-13T06:43:36.946 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:43:36.943+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:43:37.046 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-13T06:43:37.045+0000 7fa8bb18e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 36790) UID: 0 2024-09-13T06:43:37.076 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:43:37.076 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [ 2024-09-13T06:43:37.077 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:37.077 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:242330 3.1a 3.ac0e573a (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e251)", 2024-09-13T06:43:37.077 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:43:36.447499+0000", 2024-09-13T06:43:37.077 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 0.63060413299999996, 2024-09-13T06:43:37.077 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.63064800200000004, 2024-09-13T06:43:37.077 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:37.077 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "waiting for peered", 2024-09-13T06:43:37.077 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:37.077 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:37.077 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:37.077 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 242330 2024-09-13T06:43:37.077 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:37.077 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:37.078 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:37.078 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:37.078 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:36.447499+0000", 2024-09-13T06:43:37.078 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:37.078 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:37.078 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:37.078 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:37.078 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:36.447499+0000", 2024-09-13T06:43:37.078 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:37.078 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:37.078 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:37.079 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:37.079 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:36.447497+0000", 2024-09-13T06:43:37.079 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999976 2024-09-13T06:43:37.079 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:37.079 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:37.079 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:37.079 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:36.447510+0000", 2024-09-13T06:43:37.079 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3298999999999999e-05 2024-09-13T06:43:37.079 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:37.079 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:37.079 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:37.079 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:36.447542+0000", 2024-09-13T06:43:37.079 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.163e-05 2024-09-13T06:43:37.080 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:37.080 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:37.080 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:37.080 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:36.447556+0000", 2024-09-13T06:43:37.080 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.4416999999999999e-05 2024-09-13T06:43:37.080 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:37.080 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:37.080 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:37.080 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:36.447667+0000", 2024-09-13T06:43:37.080 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000110886 2024-09-13T06:43:37.080 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:37.080 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:37.080 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:43:37.080 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:36.447688+0000", 2024-09-13T06:43:37.081 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.0656e-05 2024-09-13T06:43:37.081 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:37.081 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:37.081 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:37.081 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:37.081 INFO:teuthology.orchestra.run.smithi139.stdout: ], 2024-09-13T06:43:37.081 INFO:teuthology.orchestra.run.smithi139.stdout: "num_ops": 1 2024-09-13T06:43:37.081 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:43:37.091 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-13T06:43:37.146 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:43:37.147+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:43:37.247 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:43:37.247+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:43:37.260 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:43:37.260 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [], 2024-09-13T06:43:37.261 INFO:teuthology.orchestra.run.smithi139.stdout: "complaint_time": 30, 2024-09-13T06:43:37.261 INFO:teuthology.orchestra.run.smithi139.stdout: "num_blocked_ops": 0 2024-09-13T06:43:37.261 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:43:37.275 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-13T06:43:37.349 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:43:37.347+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:43:37.397 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:43:37.397 INFO:teuthology.orchestra.run.smithi139.stdout: "size": 20, 2024-09-13T06:43:37.397 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 600, 2024-09-13T06:43:37.397 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [ 2024-09-13T06:43:37.397 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:37.398 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:160483 3.a 3:57f62123:::rbd_header.112138ed422:head [watch reconnect cookie 140361344088384 gen 3] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e177)", 2024-09-13T06:43:37.398 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:42:17.439011+0000", 2024-09-13T06:43:37.398 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 79.956189413000004, 2024-09-13T06:43:37.398 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.155518861, 2024-09-13T06:43:37.398 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:37.398 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:37.398 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:37.398 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:37.398 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:37.398 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 160483 2024-09-13T06:43:37.398 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:37.399 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:37.399 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:37.399 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:37.399 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:17.439011+0000", 2024-09-13T06:43:37.399 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:37.399 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:37.399 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:37.399 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:37.399 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:17.439011+0000", 2024-09-13T06:43:37.399 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:37.399 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:37.399 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:37.399 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:37.400 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:17.439009+0000", 2024-09-13T06:43:37.400 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999976 2024-09-13T06:43:37.400 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:37.400 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:37.400 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:37.400 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:17.439024+0000", 2024-09-13T06:43:37.400 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.464e-05 2024-09-13T06:43:37.400 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:37.400 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:37.400 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:37.400 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:17.439058+0000", 2024-09-13T06:43:37.400 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.4712999999999998e-05 2024-09-13T06:43:37.401 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:37.401 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:37.401 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:37.401 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:17.439085+0000", 2024-09-13T06:43:37.401 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.6216000000000001e-05 2024-09-13T06:43:37.401 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:37.401 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:37.401 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:37.401 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:17.439182+0000", 2024-09-13T06:43:37.401 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.7020000000000003e-05 2024-09-13T06:43:37.401 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:37.402 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:37.402 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:43:37.402 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:17.439204+0000", 2024-09-13T06:43:37.402 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.2276000000000002e-05 2024-09-13T06:43:37.402 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:37.402 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:37.402 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:37.402 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:18.588627+0000", 2024-09-13T06:43:37.402 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1494235829999999 2024-09-13T06:43:37.402 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:37.402 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:37.402 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for rw locks", 2024-09-13T06:43:37.403 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:18.589031+0000", 2024-09-13T06:43:37.403 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0004035 2024-09-13T06:43:37.403 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:37.403 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:37.403 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:37.403 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:18.590604+0000", 2024-09-13T06:43:37.403 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.001573234 2024-09-13T06:43:37.403 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:37.403 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:37.403 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:37.403 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:18.590791+0000", 2024-09-13T06:43:37.403 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000186701 2024-09-13T06:43:37.403 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:37.404 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:37.404 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:37.404 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:18.594530+0000", 2024-09-13T06:43:37.404 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0037394250000000002 2024-09-13T06:43:37.404 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:37.404 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:37.404 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:37.404 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:37.404 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:37.404 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:208355 3.14 3:2d339b7f:::rbd_data.1121cb4a09ed.0000000000000003:snapdir [list-snaps] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e219)", 2024-09-13T06:43:37.404 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:43:03.420412+0000", 2024-09-13T06:43:37.404 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 33.974789276999999, 2024-09-13T06:43:37.405 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.705233864, 2024-09-13T06:43:37.405 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:37.405 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:37.405 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:37.405 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:37.405 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:37.405 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 208355 2024-09-13T06:43:37.405 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:37.405 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:37.405 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:37.405 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:37.406 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420412+0000", 2024-09-13T06:43:37.406 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:37.406 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:37.406 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:37.406 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:37.406 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420412+0000", 2024-09-13T06:43:37.406 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:37.406 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:37.406 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:37.406 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:37.406 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420409+0000", 2024-09-13T06:43:37.406 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999981 2024-09-13T06:43:37.406 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:37.407 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:37.407 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:37.407 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420420+0000", 2024-09-13T06:43:37.407 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0716e-05 2024-09-13T06:43:37.407 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:37.407 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:37.407 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:37.407 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420440+0000", 2024-09-13T06:43:37.407 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.9850000000000001e-05 2024-09-13T06:43:37.407 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:37.407 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:37.407 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:37.407 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420456+0000", 2024-09-13T06:43:37.408 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5667000000000001e-05 2024-09-13T06:43:37.408 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:37.408 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:37.408 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:37.408 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420724+0000", 2024-09-13T06:43:37.408 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00026873400000000002 2024-09-13T06:43:37.408 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:37.408 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:37.408 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:43:37.408 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420740+0000", 2024-09-13T06:43:37.408 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5486999999999999e-05 2024-09-13T06:43:37.408 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:37.409 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:37.409 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:37.409 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.125004+0000", 2024-09-13T06:43:37.409 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7042643119999998 2024-09-13T06:43:37.409 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:37.409 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:37.409 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:37.409 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.125293+0000", 2024-09-13T06:43:37.409 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000288664 2024-09-13T06:43:37.409 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:37.409 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:37.409 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:37.410 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.125645+0000", 2024-09-13T06:43:37.410 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00035247700000000002 2024-09-13T06:43:37.410 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:37.410 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:37.410 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:37.410 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:37.410 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:37.410 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:208362 3.14 3:2d339b7f:::rbd_data.1121cb4a09ed.0000000000000003:snapdir [list-snaps] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e219)", 2024-09-13T06:43:37.410 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:43:03.420469+0000", 2024-09-13T06:43:37.410 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 33.974731800999997, 2024-09-13T06:43:37.410 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.706123917, 2024-09-13T06:43:37.410 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:37.410 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:37.410 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:37.411 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:37.411 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:37.411 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 208362 2024-09-13T06:43:37.411 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:37.411 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:37.411 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:37.411 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:37.411 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420469+0000", 2024-09-13T06:43:37.411 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:37.411 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:37.411 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:37.411 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:37.412 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420469+0000", 2024-09-13T06:43:37.412 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:37.412 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:37.412 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:37.412 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:37.412 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420468+0000", 2024-09-13T06:43:37.412 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:37.412 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:37.412 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:37.412 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:37.412 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420473+0000", 2024-09-13T06:43:37.412 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.7099999999999998e-06 2024-09-13T06:43:37.412 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:37.413 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:37.413 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:37.413 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420483+0000", 2024-09-13T06:43:37.413 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.7960000000000007e-06 2024-09-13T06:43:37.413 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:37.413 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:37.413 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:37.413 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420491+0000", 2024-09-13T06:43:37.413 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.8169999999999999e-06 2024-09-13T06:43:37.413 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:37.413 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:37.413 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:37.414 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420829+0000", 2024-09-13T06:43:37.414 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000338494 2024-09-13T06:43:37.414 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:37.414 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:37.414 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:43:37.414 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420857+0000", 2024-09-13T06:43:37.414 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.8140000000000002e-05 2024-09-13T06:43:37.414 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:37.414 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:37.414 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:37.414 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.126086+0000", 2024-09-13T06:43:37.414 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7052288369999999 2024-09-13T06:43:37.414 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:37.414 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:37.415 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:37.415 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.126269+0000", 2024-09-13T06:43:37.415 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000183301 2024-09-13T06:43:37.415 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:37.415 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:37.415 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:37.415 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.126593+0000", 2024-09-13T06:43:37.415 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00032352800000000001 2024-09-13T06:43:37.415 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:37.415 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:37.415 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:37.415 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:37.415 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:37.416 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:208369 3.14 3:2d339b7f:::rbd_data.1121cb4a09ed.0000000000000003:snapdir [list-snaps] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e219)", 2024-09-13T06:43:37.416 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:43:03.420498+0000", 2024-09-13T06:43:37.416 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 33.974702757000003, 2024-09-13T06:43:37.416 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.706613895, 2024-09-13T06:43:37.416 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:37.416 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:37.416 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:37.416 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:37.416 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:37.416 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 208369 2024-09-13T06:43:37.416 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:37.416 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:37.416 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:37.417 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:37.417 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420498+0000", 2024-09-13T06:43:37.417 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:37.417 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:37.417 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:37.417 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:37.417 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420498+0000", 2024-09-13T06:43:37.417 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:37.417 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:37.417 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:37.417 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:37.417 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420497+0000", 2024-09-13T06:43:37.417 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:37.418 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:37.418 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:37.418 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:37.418 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420501+0000", 2024-09-13T06:43:37.418 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.737e-06 2024-09-13T06:43:37.418 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:37.418 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:37.418 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:37.418 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420522+0000", 2024-09-13T06:43:37.418 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.1152999999999999e-05 2024-09-13T06:43:37.418 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:37.418 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:37.418 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:37.419 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420533+0000", 2024-09-13T06:43:37.419 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0366999999999999e-05 2024-09-13T06:43:37.419 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:37.419 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:37.419 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:37.419 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420968+0000", 2024-09-13T06:43:37.419 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00043495900000000001 2024-09-13T06:43:37.419 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:37.419 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:37.419 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:43:37.419 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420977+0000", 2024-09-13T06:43:37.419 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.8039999999999996e-06 2024-09-13T06:43:37.419 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:37.420 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:37.420 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:37.420 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.126670+0000", 2024-09-13T06:43:37.420 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7056928760000001 2024-09-13T06:43:37.420 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:37.420 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:37.420 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:37.420 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.126833+0000", 2024-09-13T06:43:37.420 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00016253200000000001 2024-09-13T06:43:37.420 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:37.420 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:37.420 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:37.421 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.127112+0000", 2024-09-13T06:43:37.421 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000279141 2024-09-13T06:43:37.421 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:37.421 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:37.421 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:37.421 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:37.421 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:37.421 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:208376 3.14 3:2d339b7f:::rbd_data.1121cb4a09ed.0000000000000003:snapdir [list-snaps] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e219)", 2024-09-13T06:43:37.421 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:43:03.420541+0000", 2024-09-13T06:43:37.421 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 33.974659500999998, 2024-09-13T06:43:37.422 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7070606820000001, 2024-09-13T06:43:37.422 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:37.422 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:37.422 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:37.422 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:37.422 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:37.422 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 208376 2024-09-13T06:43:37.422 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:37.422 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:37.422 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:37.422 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:37.422 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420541+0000", 2024-09-13T06:43:37.423 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:37.423 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:37.423 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:37.423 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:37.423 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420541+0000", 2024-09-13T06:43:37.423 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:37.423 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:37.423 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:37.423 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:37.423 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420541+0000", 2024-09-13T06:43:37.423 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:37.423 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:37.423 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:37.424 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:37.424 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420544+0000", 2024-09-13T06:43:37.424 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.5530000000000001e-06 2024-09-13T06:43:37.424 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:37.424 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:37.424 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:37.424 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420557+0000", 2024-09-13T06:43:37.424 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2663000000000001e-05 2024-09-13T06:43:37.424 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:37.424 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:37.424 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:37.424 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420572+0000", 2024-09-13T06:43:37.424 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5463000000000001e-05 2024-09-13T06:43:37.425 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:37.425 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:37.425 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:37.425 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.421070+0000", 2024-09-13T06:43:37.425 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00049723599999999997 2024-09-13T06:43:37.425 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:37.425 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:37.425 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:43:37.425 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.421092+0000", 2024-09-13T06:43:37.425 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.2354e-05 2024-09-13T06:43:37.425 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:37.426 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:37.426 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:37.426 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.127184+0000", 2024-09-13T06:43:37.426 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7060917330000001 2024-09-13T06:43:37.426 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:37.426 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:37.426 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:37.426 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.127340+0000", 2024-09-13T06:43:37.426 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00015640200000000001 2024-09-13T06:43:37.426 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:37.426 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:37.426 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:37.426 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.127602+0000", 2024-09-13T06:43:37.427 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00026192799999999998 2024-09-13T06:43:37.427 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:37.427 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:37.427 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:37.427 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:37.427 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:37.427 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:208383 3.14 3:2d339b7f:::rbd_data.1121cb4a09ed.0000000000000003:snapdir [list-snaps] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e219)", 2024-09-13T06:43:37.427 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:43:03.420585+0000", 2024-09-13T06:43:37.427 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 33.974615647999997, 2024-09-13T06:43:37.427 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.707457405, 2024-09-13T06:43:37.427 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:37.427 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:37.427 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:37.428 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:37.428 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:37.428 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 208383 2024-09-13T06:43:37.428 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:37.428 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:37.428 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:37.428 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:37.428 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420585+0000", 2024-09-13T06:43:37.428 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:37.428 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:37.428 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:37.428 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:37.428 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420585+0000", 2024-09-13T06:43:37.429 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:37.429 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:37.429 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:37.429 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:37.429 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420584+0000", 2024-09-13T06:43:37.429 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:43:37.429 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:37.429 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:37.429 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:37.429 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420614+0000", 2024-09-13T06:43:37.429 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.9886000000000002e-05 2024-09-13T06:43:37.429 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:37.429 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:37.430 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:37.430 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420640+0000", 2024-09-13T06:43:37.430 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.5663000000000001e-05 2024-09-13T06:43:37.430 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:37.430 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:37.430 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:37.430 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420669+0000", 2024-09-13T06:43:37.430 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.9289999999999999e-05 2024-09-13T06:43:37.430 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:37.430 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:37.430 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:37.430 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.421168+0000", 2024-09-13T06:43:37.430 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00049857600000000003 2024-09-13T06:43:37.430 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:37.431 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:37.431 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:43:37.431 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.421177+0000", 2024-09-13T06:43:37.431 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.533e-06 2024-09-13T06:43:37.431 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:37.431 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:37.431 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:37.431 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.127648+0000", 2024-09-13T06:43:37.431 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7064713569999999 2024-09-13T06:43:37.431 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:37.431 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:37.431 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:37.431 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.127794+0000", 2024-09-13T06:43:37.432 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00014589200000000001 2024-09-13T06:43:37.432 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:37.432 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:37.432 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:37.432 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.128043+0000", 2024-09-13T06:43:37.432 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00024821799999999997 2024-09-13T06:43:37.432 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:37.432 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:37.432 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:37.432 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:37.432 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:37.432 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:208390 3.14 3:2d339b7f:::rbd_data.1121cb4a09ed.0000000000000003:snapdir [list-snaps] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e219)", 2024-09-13T06:43:37.432 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:43:03.420713+0000", 2024-09-13T06:43:37.433 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 33.974487689, 2024-09-13T06:43:37.433 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7077568059999999, 2024-09-13T06:43:37.433 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:37.433 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:37.433 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:37.433 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:37.433 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:37.433 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 208390 2024-09-13T06:43:37.433 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:37.433 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:37.433 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:37.434 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:37.434 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420713+0000", 2024-09-13T06:43:37.434 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:37.434 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:37.434 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:37.434 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:37.434 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420713+0000", 2024-09-13T06:43:37.434 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:37.434 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:37.434 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:37.434 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:37.434 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420712+0000", 2024-09-13T06:43:37.434 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:43:37.435 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:37.435 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:37.435 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:37.435 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420719+0000", 2024-09-13T06:43:37.435 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.883e-06 2024-09-13T06:43:37.435 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:37.435 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:37.435 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:37.435 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420737+0000", 2024-09-13T06:43:37.435 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.8082999999999999e-05 2024-09-13T06:43:37.435 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:37.435 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:37.436 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:37.436 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420757+0000", 2024-09-13T06:43:37.436 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.0256999999999999e-05 2024-09-13T06:43:37.436 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:37.436 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:37.436 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:37.436 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.421258+0000", 2024-09-13T06:43:37.436 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00050028500000000005 2024-09-13T06:43:37.436 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:37.436 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:37.436 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:43:37.436 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.421282+0000", 2024-09-13T06:43:37.436 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.4236999999999999e-05 2024-09-13T06:43:37.437 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:37.437 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:37.437 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:37.437 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.128087+0000", 2024-09-13T06:43:37.437 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.706805551 2024-09-13T06:43:37.437 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:37.437 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:37.437 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:37.437 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.128231+0000", 2024-09-13T06:43:37.437 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00014348200000000001 2024-09-13T06:43:37.437 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:37.437 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:37.437 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:37.438 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.128470+0000", 2024-09-13T06:43:37.438 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000239058 2024-09-13T06:43:37.438 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:37.438 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:37.438 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:37.438 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:37.438 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:37.438 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:208397 3.14 3:2d339b7f:::rbd_data.1121cb4a09ed.0000000000000003:snapdir [list-snaps] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e219)", 2024-09-13T06:43:37.438 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:43:03.420772+0000", 2024-09-13T06:43:37.438 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 33.97442831, 2024-09-13T06:43:37.438 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7081308659999999, 2024-09-13T06:43:37.438 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:37.438 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:37.439 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:37.439 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:37.439 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:37.439 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 208397 2024-09-13T06:43:37.439 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:37.439 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:37.439 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:37.439 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:37.439 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420772+0000", 2024-09-13T06:43:37.439 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:37.439 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:37.439 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:37.439 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:37.439 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420772+0000", 2024-09-13T06:43:37.440 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:37.440 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:37.440 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:37.440 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:37.440 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420772+0000", 2024-09-13T06:43:37.440 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:43:37.440 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:37.440 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:37.440 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:37.440 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420777+0000", 2024-09-13T06:43:37.440 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.8329999999999999e-06 2024-09-13T06:43:37.440 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:37.440 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:37.441 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:37.441 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420795+0000", 2024-09-13T06:43:37.441 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7677e-05 2024-09-13T06:43:37.441 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:37.441 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:37.441 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:37.441 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420811+0000", 2024-09-13T06:43:37.441 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5673000000000001e-05 2024-09-13T06:43:37.441 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:37.441 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:37.441 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:37.441 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.421352+0000", 2024-09-13T06:43:37.441 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00054091199999999995 2024-09-13T06:43:37.442 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:37.442 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:37.442 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:43:37.442 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.421364+0000", 2024-09-13T06:43:37.442 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.182e-05 2024-09-13T06:43:37.442 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:37.442 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:37.442 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:37.442 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.128512+0000", 2024-09-13T06:43:37.442 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.707148584 2024-09-13T06:43:37.442 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:37.442 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:37.442 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:37.443 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.128653+0000", 2024-09-13T06:43:37.443 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00014127599999999999 2024-09-13T06:43:37.443 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:37.443 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:37.443 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:37.443 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.128903+0000", 2024-09-13T06:43:37.443 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000249941 2024-09-13T06:43:37.443 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:37.443 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:37.443 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:37.443 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:37.443 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:37.443 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:208404 3.14 3:2d339b7f:::rbd_data.1121cb4a09ed.0000000000000003:snapdir [list-snaps] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e219)", 2024-09-13T06:43:37.444 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:43:03.420837+0000", 2024-09-13T06:43:37.444 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 33.974363674000003, 2024-09-13T06:43:37.444 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.70849154, 2024-09-13T06:43:37.444 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:37.444 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:37.444 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:37.444 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:37.444 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:37.444 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 208404 2024-09-13T06:43:37.444 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:37.444 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:37.444 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:37.444 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:37.445 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420837+0000", 2024-09-13T06:43:37.445 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:37.445 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:37.445 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:37.445 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:37.445 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420837+0000", 2024-09-13T06:43:37.445 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:37.445 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:37.445 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:37.445 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:37.445 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420836+0000", 2024-09-13T06:43:37.445 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999986 2024-09-13T06:43:37.445 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:37.446 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:37.446 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:37.446 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420842+0000", 2024-09-13T06:43:37.446 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.4400000000000002e-06 2024-09-13T06:43:37.446 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:37.446 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:37.446 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:37.446 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420860+0000", 2024-09-13T06:43:37.446 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7487e-05 2024-09-13T06:43:37.446 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:37.446 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:37.446 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:37.446 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420916+0000", 2024-09-13T06:43:37.446 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.6276999999999997e-05 2024-09-13T06:43:37.447 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:37.447 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:37.447 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:37.447 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.421450+0000", 2024-09-13T06:43:37.447 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00053433500000000004 2024-09-13T06:43:37.447 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:37.447 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:37.447 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:43:37.447 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.421474+0000", 2024-09-13T06:43:37.447 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.3799e-05 2024-09-13T06:43:37.447 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:37.447 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:37.447 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:37.447 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.128945+0000", 2024-09-13T06:43:37.448 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.707470912 2024-09-13T06:43:37.448 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:37.448 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:37.448 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:37.448 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.129087+0000", 2024-09-13T06:43:37.448 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00014170900000000001 2024-09-13T06:43:37.448 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:37.448 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:37.448 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:37.448 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.129329+0000", 2024-09-13T06:43:37.448 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000241831 2024-09-13T06:43:37.448 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:37.448 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:37.448 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:37.449 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:37.449 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:37.449 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:208411 3.14 3:2d339b7f:::rbd_data.1121cb4a09ed.0000000000000003:snapdir [list-snaps] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e219)", 2024-09-13T06:43:37.449 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:43:03.420964+0000", 2024-09-13T06:43:37.449 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 33.974236441999999, 2024-09-13T06:43:37.449 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.708812754, 2024-09-13T06:43:37.449 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:37.449 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:37.449 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:37.449 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:37.449 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:37.449 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 208411 2024-09-13T06:43:37.450 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:37.450 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:37.450 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:37.450 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:37.450 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420964+0000", 2024-09-13T06:43:37.450 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:37.450 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:37.450 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:37.450 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:37.450 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420964+0000", 2024-09-13T06:43:37.450 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:37.450 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:37.450 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:37.450 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:37.450 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420963+0000", 2024-09-13T06:43:37.451 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:43:37.451 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:37.451 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:37.451 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:37.451 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420969+0000", 2024-09-13T06:43:37.451 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.7540000000000003e-06 2024-09-13T06:43:37.451 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:37.451 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:37.451 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:37.451 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420979+0000", 2024-09-13T06:43:37.451 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0067e-05 2024-09-13T06:43:37.451 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:37.451 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:37.452 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:37.452 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420987+0000", 2024-09-13T06:43:37.452 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.6990000000000003e-06 2024-09-13T06:43:37.452 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:37.452 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:37.452 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:37.452 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.421563+0000", 2024-09-13T06:43:37.452 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00057654899999999999 2024-09-13T06:43:37.452 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:37.452 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:37.452 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:43:37.452 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.421573+0000", 2024-09-13T06:43:37.452 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.9669999999999996e-06 2024-09-13T06:43:37.453 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:37.453 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:37.453 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:37.453 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.129372+0000", 2024-09-13T06:43:37.453 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.707798602 2024-09-13T06:43:37.453 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:37.453 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:37.453 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:37.453 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.129514+0000", 2024-09-13T06:43:37.453 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00014191200000000001 2024-09-13T06:43:37.453 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:37.453 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:37.453 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:37.454 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.129777+0000", 2024-09-13T06:43:37.454 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00026320100000000002 2024-09-13T06:43:37.454 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:37.454 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:37.454 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:37.454 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:37.454 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:37.454 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:208418 3.14 3:2d339b7f:::rbd_data.1121cb4a09ed.0000000000000003:snapdir [list-snaps] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e219)", 2024-09-13T06:43:37.454 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:43:03.421005+0000", 2024-09-13T06:43:37.454 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 33.974195358000003, 2024-09-13T06:43:37.454 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7096508159999999, 2024-09-13T06:43:37.454 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:37.454 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:37.454 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:37.455 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:37.455 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:37.455 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 208418 2024-09-13T06:43:37.455 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:37.455 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:37.455 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:37.455 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:37.455 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.421005+0000", 2024-09-13T06:43:37.455 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:37.455 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:37.455 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:37.455 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:37.455 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.421005+0000", 2024-09-13T06:43:37.455 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:37.455 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:37.456 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:37.456 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:37.456 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.421005+0000", 2024-09-13T06:43:37.456 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:37.456 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:37.456 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:37.456 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:37.456 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.421008+0000", 2024-09-13T06:43:37.456 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.2550000000000002e-06 2024-09-13T06:43:37.456 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:37.456 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:37.456 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:37.456 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.421015+0000", 2024-09-13T06:43:37.456 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.0600000000000002e-06 2024-09-13T06:43:37.457 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:37.457 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:37.457 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:37.457 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.421021+0000", 2024-09-13T06:43:37.457 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.8139999999999997e-06 2024-09-13T06:43:37.457 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:37.457 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:37.457 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:37.457 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.421638+0000", 2024-09-13T06:43:37.457 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00061702600000000001 2024-09-13T06:43:37.457 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:37.457 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:37.458 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:43:37.458 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.421659+0000", 2024-09-13T06:43:37.458 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.0894e-05 2024-09-13T06:43:37.458 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:37.458 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:37.458 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:37.458 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.129858+0000", 2024-09-13T06:43:37.458 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.708198632 2024-09-13T06:43:37.458 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:37.458 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:37.458 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:37.458 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.130158+0000", 2024-09-13T06:43:37.458 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00030000099999999999 2024-09-13T06:43:37.459 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:37.459 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:37.459 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:37.459 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.130656+0000", 2024-09-13T06:43:37.459 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00049864199999999999 2024-09-13T06:43:37.459 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:37.459 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:37.459 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:37.459 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:37.459 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:37.459 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:209008 3.3 3:c6ff3074:::rbd_data.1121cb4a09ed.0000000000000001:82 [read 397312~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e220)", 2024-09-13T06:43:37.459 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:43:05.165956+0000", 2024-09-13T06:43:37.459 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 32.229245048000003, 2024-09-13T06:43:37.459 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.120605692, 2024-09-13T06:43:37.460 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:37.460 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:37.460 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:37.460 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:37.460 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:37.460 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 209008 2024-09-13T06:43:37.460 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:37.460 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:37.460 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:37.460 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:37.460 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.165956+0000", 2024-09-13T06:43:37.460 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:37.461 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:37.461 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:37.461 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:37.461 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.165956+0000", 2024-09-13T06:43:37.461 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:37.461 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:37.461 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:37.461 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:37.461 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.165955+0000", 2024-09-13T06:43:37.461 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:43:37.461 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:37.461 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:37.461 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:37.462 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.165960+0000", 2024-09-13T06:43:37.462 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.6200000000000004e-06 2024-09-13T06:43:37.462 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:37.462 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:37.462 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:37.462 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.165998+0000", 2024-09-13T06:43:37.462 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.7703000000000001e-05 2024-09-13T06:43:37.462 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:37.462 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:37.462 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:37.462 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.166012+0000", 2024-09-13T06:43:37.462 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3682999999999999e-05 2024-09-13T06:43:37.462 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:37.462 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:37.463 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:37.463 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.286043+0000", 2024-09-13T06:43:37.463 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.120030867 2024-09-13T06:43:37.463 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:37.463 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:37.463 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:37.463 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.286196+0000", 2024-09-13T06:43:37.463 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000153759 2024-09-13T06:43:37.463 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:37.463 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:37.463 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:37.463 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.286561+0000", 2024-09-13T06:43:37.464 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00036504700000000002 2024-09-13T06:43:37.464 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:37.464 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:37.464 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:37.464 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:37.464 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:37.464 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:209009 3.3 3:c6ff3074:::rbd_data.1121cb4a09ed.0000000000000001:82 [read 409600~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e220)", 2024-09-13T06:43:37.464 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:43:05.166111+0000", 2024-09-13T06:43:37.464 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 32.229089403000003, 2024-09-13T06:43:37.464 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.121025172, 2024-09-13T06:43:37.464 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:37.464 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:37.465 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:37.465 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:37.465 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:37.465 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 209009 2024-09-13T06:43:37.465 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:37.465 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:37.465 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:37.465 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:37.465 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.166111+0000", 2024-09-13T06:43:37.465 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:37.465 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:37.465 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:37.465 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:37.466 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.166111+0000", 2024-09-13T06:43:37.466 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:37.466 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:37.466 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:37.466 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:37.466 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.166023+0000", 2024-09-13T06:43:37.466 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999113 2024-09-13T06:43:37.466 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:37.466 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:37.466 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:37.467 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.166118+0000", 2024-09-13T06:43:37.467 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.5818999999999999e-05 2024-09-13T06:43:37.467 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:37.467 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:37.467 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:37.467 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.166145+0000", 2024-09-13T06:43:37.467 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.6679999999999999e-05 2024-09-13T06:43:37.467 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:37.467 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:37.467 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:37.467 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.166162+0000", 2024-09-13T06:43:37.467 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6413e-05 2024-09-13T06:43:37.467 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:37.468 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:37.468 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:37.468 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.286636+0000", 2024-09-13T06:43:37.468 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.120474003 2024-09-13T06:43:37.468 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:37.468 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:37.468 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:37.468 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.286799+0000", 2024-09-13T06:43:37.468 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00016363900000000001 2024-09-13T06:43:37.468 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:37.468 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:37.468 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:37.468 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.287137+0000", 2024-09-13T06:43:37.468 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00033736699999999998 2024-09-13T06:43:37.469 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:37.469 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:37.469 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:37.469 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:37.469 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:37.469 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:209010 3.3 3:c6ff3074:::rbd_data.1121cb4a09ed.0000000000000001:82 [read 421888~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e220)", 2024-09-13T06:43:37.469 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:43:05.167018+0000", 2024-09-13T06:43:37.469 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 32.228183223999999, 2024-09-13T06:43:37.469 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.120709894, 2024-09-13T06:43:37.469 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:37.469 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:37.469 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:37.469 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:37.470 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:37.470 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 209010 2024-09-13T06:43:37.470 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:37.470 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:37.470 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:37.470 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:37.470 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.167018+0000", 2024-09-13T06:43:37.470 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:37.470 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:37.470 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:37.470 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:37.470 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.167018+0000", 2024-09-13T06:43:37.470 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:37.470 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:37.471 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:37.471 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:37.471 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.166214+0000", 2024-09-13T06:43:37.471 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9991961 2024-09-13T06:43:37.471 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:37.471 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:37.471 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:37.471 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.167039+0000", 2024-09-13T06:43:37.471 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00082531599999999998 2024-09-13T06:43:37.471 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:37.471 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:37.471 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:37.471 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.167083+0000", 2024-09-13T06:43:37.471 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.4079999999999998e-05 2024-09-13T06:43:37.472 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:37.472 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:37.472 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:37.472 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.167113+0000", 2024-09-13T06:43:37.472 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.025e-05 2024-09-13T06:43:37.472 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:37.472 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:37.472 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:37.472 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.287229+0000", 2024-09-13T06:43:37.472 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.12011563 2024-09-13T06:43:37.472 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:37.472 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:37.472 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:37.473 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.287369+0000", 2024-09-13T06:43:37.473 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00014040499999999999 2024-09-13T06:43:37.473 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:37.473 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:37.473 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:37.473 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.287727+0000", 2024-09-13T06:43:37.473 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000358043 2024-09-13T06:43:37.473 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:37.473 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:37.473 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:37.473 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:37.473 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:37.473 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:209011 3.3 3:c6ff3074:::rbd_data.1121cb4a09ed.0000000000000001:82 [read 434176~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e220)", 2024-09-13T06:43:37.474 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:43:05.167765+0000", 2024-09-13T06:43:37.474 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 32.227435730000003, 2024-09-13T06:43:37.474 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.12054767199999999, 2024-09-13T06:43:37.474 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:37.474 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:37.474 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:37.474 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:37.474 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:37.474 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 209011 2024-09-13T06:43:37.474 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:37.474 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:37.474 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:37.474 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:37.474 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.167765+0000", 2024-09-13T06:43:37.475 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:37.475 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:37.475 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:37.475 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:37.475 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.167765+0000", 2024-09-13T06:43:37.475 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:37.475 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:37.475 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:37.475 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:37.475 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.167131+0000", 2024-09-13T06:43:37.475 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9993658 2024-09-13T06:43:37.475 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:37.475 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:37.475 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:37.476 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.167772+0000", 2024-09-13T06:43:37.476 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00064152399999999998 2024-09-13T06:43:37.476 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:37.476 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:37.476 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:37.476 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.167791+0000", 2024-09-13T06:43:37.476 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.8944e-05 2024-09-13T06:43:37.476 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:37.476 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:37.476 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:37.476 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.167805+0000", 2024-09-13T06:43:37.476 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.395e-05 2024-09-13T06:43:37.476 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:37.477 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:37.477 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:37.477 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.287803+0000", 2024-09-13T06:43:37.477 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.11999747099999999 2024-09-13T06:43:37.477 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:37.477 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:37.477 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:37.477 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.287964+0000", 2024-09-13T06:43:37.477 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00016155100000000001 2024-09-13T06:43:37.477 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:37.477 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:37.477 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:37.477 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.288313+0000", 2024-09-13T06:43:37.478 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00034865699999999999 2024-09-13T06:43:37.478 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:37.478 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:37.478 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:37.478 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:37.478 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:37.478 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:209012 3.3 3:c6ff3074:::rbd_data.1121cb4a09ed.0000000000000001:82 [read 446464~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e220)", 2024-09-13T06:43:37.478 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:43:05.168733+0000", 2024-09-13T06:43:37.478 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 32.226467608999997, 2024-09-13T06:43:37.478 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.12007113699999999, 2024-09-13T06:43:37.478 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:37.478 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:37.478 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:37.479 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:37.479 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:37.479 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 209012 2024-09-13T06:43:37.479 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:37.479 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:37.479 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:37.479 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:37.479 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.168733+0000", 2024-09-13T06:43:37.479 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:37.479 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:37.479 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:37.479 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:37.479 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.168733+0000", 2024-09-13T06:43:37.480 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:37.480 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:37.480 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:37.480 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:37.480 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.167815+0000", 2024-09-13T06:43:37.480 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9990816 2024-09-13T06:43:37.480 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:37.480 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:37.480 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:37.480 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.168749+0000", 2024-09-13T06:43:37.480 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00093412200000000001 2024-09-13T06:43:37.481 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:37.481 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:37.481 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:37.481 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.168776+0000", 2024-09-13T06:43:37.481 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.654e-05 2024-09-13T06:43:37.481 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:37.481 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:37.481 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:37.481 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.168814+0000", 2024-09-13T06:43:37.481 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.8702999999999999e-05 2024-09-13T06:43:37.481 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:37.481 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:37.481 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:37.482 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.288381+0000", 2024-09-13T06:43:37.482 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.119566731 2024-09-13T06:43:37.482 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:37.482 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:37.482 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:37.482 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.288516+0000", 2024-09-13T06:43:37.482 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00013502499999999999 2024-09-13T06:43:37.482 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:37.482 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:37.482 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:37.482 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.288804+0000", 2024-09-13T06:43:37.482 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00028836399999999999 2024-09-13T06:43:37.482 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:37.483 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:37.483 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:37.483 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:37.483 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:37.483 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:209013 3.3 3:c6ff3074:::rbd_data.1121cb4a09ed.0000000000000001:82 [read 458752~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e220)", 2024-09-13T06:43:37.483 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:43:05.168880+0000", 2024-09-13T06:43:37.483 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 32.226320645999998, 2024-09-13T06:43:37.483 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.120462023, 2024-09-13T06:43:37.483 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:37.483 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:37.483 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:37.483 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:37.483 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:37.484 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 209013 2024-09-13T06:43:37.484 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:37.484 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:37.484 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:37.484 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:37.484 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.168880+0000", 2024-09-13T06:43:37.484 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:37.484 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:37.484 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:37.484 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:37.484 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.168880+0000", 2024-09-13T06:43:37.484 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:37.485 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:37.485 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:37.485 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:37.485 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.168879+0000", 2024-09-13T06:43:37.485 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999986 2024-09-13T06:43:37.485 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:37.485 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:37.485 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:37.485 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.168888+0000", 2024-09-13T06:43:37.485 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.9930000000000001e-06 2024-09-13T06:43:37.485 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:37.485 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:37.485 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:37.486 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.168908+0000", 2024-09-13T06:43:37.486 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.0276999999999999e-05 2024-09-13T06:43:37.486 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:37.486 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:37.486 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:37.486 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.168923+0000", 2024-09-13T06:43:37.486 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5543e-05 2024-09-13T06:43:37.486 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:37.486 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:37.486 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:37.486 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.288875+0000", 2024-09-13T06:43:37.486 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.119951748 2024-09-13T06:43:37.486 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:37.487 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:37.487 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:37.487 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.289007+0000", 2024-09-13T06:43:37.487 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00013142899999999999 2024-09-13T06:43:37.487 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:37.487 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:37.487 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:37.487 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.289342+0000", 2024-09-13T06:43:37.487 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00033566999999999999 2024-09-13T06:43:37.487 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:37.487 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:37.487 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:37.488 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:37.488 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:37.488 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:209014 3.3 3:c6ff3074:::rbd_data.1121cb4a09ed.0000000000000001:82 [read 471040~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e220)", 2024-09-13T06:43:37.488 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:43:05.169105+0000", 2024-09-13T06:43:37.488 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 32.226096188, 2024-09-13T06:43:37.488 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.12087680000000001, 2024-09-13T06:43:37.488 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:37.488 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:37.488 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:37.488 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:37.488 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:37.488 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 209014 2024-09-13T06:43:37.488 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:37.489 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:37.489 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:37.489 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:37.489 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.169105+0000", 2024-09-13T06:43:37.489 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:37.489 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:37.489 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:37.489 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:37.489 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.169105+0000", 2024-09-13T06:43:37.489 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:37.489 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:37.489 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:37.489 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:37.490 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.168936+0000", 2024-09-13T06:43:37.490 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9998312 2024-09-13T06:43:37.490 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:37.490 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:37.490 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:37.490 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.169115+0000", 2024-09-13T06:43:37.490 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00017854500000000001 2024-09-13T06:43:37.490 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:37.490 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:37.490 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:37.490 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.169140+0000", 2024-09-13T06:43:37.490 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.5853000000000001e-05 2024-09-13T06:43:37.490 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:37.491 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:37.491 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:37.491 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.169160+0000", 2024-09-13T06:43:37.491 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.9415999999999998e-05 2024-09-13T06:43:37.491 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:37.491 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:37.491 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:37.491 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.289414+0000", 2024-09-13T06:43:37.491 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.120253785 2024-09-13T06:43:37.491 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:37.491 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:37.491 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:37.491 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.289579+0000", 2024-09-13T06:43:37.491 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00016506299999999999 2024-09-13T06:43:37.492 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:37.492 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:37.492 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:37.492 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.289981+0000", 2024-09-13T06:43:37.492 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000402743 2024-09-13T06:43:37.492 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:37.492 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:37.492 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:37.492 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:37.492 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:37.492 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:209015 3.3 3:c6ff3074:::rbd_data.1121cb4a09ed.0000000000000001:82 [read 483328~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e220)", 2024-09-13T06:43:37.492 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:43:05.169496+0000", 2024-09-13T06:43:37.492 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 32.225705138000002, 2024-09-13T06:43:37.493 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.12105229200000001, 2024-09-13T06:43:37.493 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:37.493 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:37.493 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:37.493 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:37.493 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:37.493 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 209015 2024-09-13T06:43:37.493 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:37.493 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:37.493 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:37.493 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:37.493 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.169496+0000", 2024-09-13T06:43:37.493 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:37.494 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:37.494 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:37.494 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:37.494 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.169496+0000", 2024-09-13T06:43:37.494 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:37.494 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:37.494 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:37.494 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:37.494 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.169177+0000", 2024-09-13T06:43:37.495 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999681 2024-09-13T06:43:37.495 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:37.495 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:37.495 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:37.495 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.169509+0000", 2024-09-13T06:43:37.495 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00033226099999999998 2024-09-13T06:43:37.495 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:37.495 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:37.495 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:37.495 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.169544+0000", 2024-09-13T06:43:37.495 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.5573e-05 2024-09-13T06:43:37.495 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:37.496 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:37.496 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:37.496 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.169560+0000", 2024-09-13T06:43:37.496 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5636000000000001e-05 2024-09-13T06:43:37.496 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:37.496 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:37.496 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:37.496 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.290055+0000", 2024-09-13T06:43:37.496 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.12049523400000001 2024-09-13T06:43:37.496 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:37.496 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:37.496 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:37.497 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.290201+0000", 2024-09-13T06:43:37.497 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000145742 2024-09-13T06:43:37.497 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:37.497 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:37.497 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:37.497 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.290548+0000", 2024-09-13T06:43:37.497 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00034698699999999999 2024-09-13T06:43:37.497 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:37.497 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:37.497 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:37.497 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:37.497 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:37.497 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:209016 3.3 3:c6ff3074:::rbd_data.1121cb4a09ed.0000000000000001:82 [read 495616~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e220)", 2024-09-13T06:43:37.498 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:43:05.169893+0000", 2024-09-13T06:43:37.498 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 32.225307624999999, 2024-09-13T06:43:37.498 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.121278814, 2024-09-13T06:43:37.498 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:37.498 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:37.498 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:37.498 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:37.498 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:37.498 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 209016 2024-09-13T06:43:37.498 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:37.498 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:37.498 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:37.498 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:37.499 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.169893+0000", 2024-09-13T06:43:37.499 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:37.499 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:37.499 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:37.499 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:37.499 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.169893+0000", 2024-09-13T06:43:37.499 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:37.499 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:37.499 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:37.499 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:37.499 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.169572+0000", 2024-09-13T06:43:37.499 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9996786 2024-09-13T06:43:37.499 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:37.499 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:37.500 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:37.500 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.169903+0000", 2024-09-13T06:43:37.500 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00033101400000000003 2024-09-13T06:43:37.500 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:37.500 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:37.500 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:37.500 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.169933+0000", 2024-09-13T06:43:37.500 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.9913e-05 2024-09-13T06:43:37.500 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:37.500 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:37.500 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:37.500 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.169949+0000", 2024-09-13T06:43:37.500 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6313000000000001e-05 2024-09-13T06:43:37.501 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:37.501 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:37.501 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:37.501 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.290622+0000", 2024-09-13T06:43:37.501 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.120672795 2024-09-13T06:43:37.501 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:37.501 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:37.501 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:37.501 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.290788+0000", 2024-09-13T06:43:37.501 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00016597899999999999 2024-09-13T06:43:37.501 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:37.501 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:37.502 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:37.502 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.291172+0000", 2024-09-13T06:43:37.502 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00038422700000000001 2024-09-13T06:43:37.502 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:37.502 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:37.502 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:37.502 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:37.502 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:37.502 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:43:37.504 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-13T06:43:37.504 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-13T06:43:37.505 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:43:37.503+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:43:37.605 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:43:37.603+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:43:37.639 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:43:37.640 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [], 2024-09-13T06:43:37.640 INFO:teuthology.orchestra.run.smithi139.stdout: "num_ops": 0 2024-09-13T06:43:37.640 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:43:37.651 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-13T06:43:37.654 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-13T06:43:37.670 INFO:teuthology.orchestra.run.smithi081.stdout:osd.0: {} 2024-09-13T06:43:37.670 INFO:teuthology.orchestra.run.smithi081.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-13T06:43:37.686 INFO:teuthology.orchestra.run.smithi081.stdout:osd.1: {} 2024-09-13T06:43:37.686 INFO:teuthology.orchestra.run.smithi081.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-13T06:43:37.703 INFO:teuthology.orchestra.run.smithi081.stdout:osd.2: {} 2024-09-13T06:43:37.703 INFO:teuthology.orchestra.run.smithi081.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-13T06:43:37.705 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:43:37.705+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:43:37.724 INFO:teuthology.orchestra.run.smithi081.stdout:osd.3: {} 2024-09-13T06:43:37.725 INFO:teuthology.orchestra.run.smithi081.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-13T06:43:37.759 INFO:teuthology.orchestra.run.smithi081.stdout:osd.4: {} 2024-09-13T06:43:37.759 INFO:teuthology.orchestra.run.smithi081.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-13T06:43:37.779 INFO:teuthology.orchestra.run.smithi081.stdout:osd.5: {} 2024-09-13T06:43:37.780 INFO:teuthology.orchestra.run.smithi081.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-13T06:43:37.780 INFO:teuthology.orchestra.run.smithi081.stderr:Error ENXIO: problem getting command descriptions from osd.6 2024-09-13T06:43:37.780 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:43:37.780 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:43:37.794 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-13T06:43:37.801 INFO:teuthology.orchestra.run.smithi081.stdout:osd.7: {} 2024-09-13T06:43:37.801 INFO:teuthology.orchestra.run.smithi081.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-13T06:43:37.804 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-13T06:43:37.804 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-13T06:43:37.846 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:43:37.847+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:43:37.908 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:43:37.909+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:43:37.955 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:43:37.955 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:43:37.969 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-13T06:43:38.009 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:43:38.007+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:43:38.110 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:43:38.111+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:43:38.133 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:43:38.133 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:43:38.148 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-13T06:43:38.211 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:43:38.211+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:43:38.270 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:43:38.270 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:43:38.284 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-13T06:43:38.312 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:43:38.311+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:43:38.406 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:43:38.406 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:43:38.413 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:43:38.411+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:43:38.421 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-13T06:43:38.431 INFO:teuthology.orchestra.run.smithi081.stderr:noscrub is set 2024-09-13T06:43:38.513 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:43:38.511+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:43:38.565 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:43:38.565 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:43:38.580 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-13T06:43:38.622 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:43:38.623+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:43:38.645 INFO:tasks.thrashosds.thrasher:in_osds: [0, 2, 7, 5, 3, 4] out_osds: [6, 1] dead_osds: [6] live_osds: [0, 1, 2, 3, 4, 5, 7] 2024-09-13T06:43:38.645 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-13T06:43:38.645 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap 2024-09-13T06:43:38.645 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-09-13T06:43:38.716 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:43:38.715+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:43:38.745 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:43:38.746 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:43:38.761 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-13T06:43:38.817 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:43:38.817+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:43:38.915 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:43:38.915 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:43:38.917 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:43:38.915+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:43:38.928 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-13T06:43:38.971 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T06:43:38.971 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:43:38.971 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 253, 2024-09-13T06:43:38.971 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "e5612297-d004-4957-927e-afa37f30d6cf", 2024-09-13T06:43:38.971 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-09-13T06:38:56.670231+0000", 2024-09-13T06:43:38.971 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-09-13T06:43:38.410775+0000", 2024-09-13T06:43:38.971 INFO:teuthology.orchestra.run.smithi081.stdout: "last_up_change": "2024-09-13T06:42:51.723548+0000", 2024-09-13T06:43:38.971 INFO:teuthology.orchestra.run.smithi081.stdout: "last_in_change": "2024-09-13T06:43:33.597346+0000", 2024-09-13T06:43:38.971 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": "noscrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-13T06:43:38.972 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_num": 5801984, 2024-09-13T06:43:38.972 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_set": [ 2024-09-13T06:43:38.972 INFO:teuthology.orchestra.run.smithi081.stdout: "noscrub", 2024-09-13T06:43:38.972 INFO:teuthology.orchestra.run.smithi081.stdout: "pglog_hardlimit", 2024-09-13T06:43:38.972 INFO:teuthology.orchestra.run.smithi081.stdout: "purged_snapdirs", 2024-09-13T06:43:38.972 INFO:teuthology.orchestra.run.smithi081.stdout: "recovery_deletes", 2024-09-13T06:43:38.972 INFO:teuthology.orchestra.run.smithi081.stdout: "sortbitwise" 2024-09-13T06:43:38.972 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-13T06:43:38.972 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_version": 5, 2024-09-13T06:43:38.972 INFO:teuthology.orchestra.run.smithi081.stdout: "full_ratio": 0.94999998807907104, 2024-09-13T06:43:38.972 INFO:teuthology.orchestra.run.smithi081.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-09-13T06:43:38.972 INFO:teuthology.orchestra.run.smithi081.stdout: "nearfull_ratio": 0.85000002384185791, 2024-09-13T06:43:38.973 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_snapshot": "", 2024-09-13T06:43:38.973 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_max": 3, 2024-09-13T06:43:38.973 INFO:teuthology.orchestra.run.smithi081.stdout: "max_osd": 8, 2024-09-13T06:43:38.973 INFO:teuthology.orchestra.run.smithi081.stdout: "require_min_compat_client": "luminous", 2024-09-13T06:43:38.973 INFO:teuthology.orchestra.run.smithi081.stdout: "min_compat_client": "luminous", 2024-09-13T06:43:38.973 INFO:teuthology.orchestra.run.smithi081.stdout: "require_osd_release": "reef", 2024-09-13T06:43:38.973 INFO:teuthology.orchestra.run.smithi081.stdout: "allow_crimson": false, 2024-09-13T06:43:38.973 INFO:teuthology.orchestra.run.smithi081.stdout: "pools": [ 2024-09-13T06:43:38.973 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:38.973 INFO:teuthology.orchestra.run.smithi081.stdout: "pool": 1, 2024-09-13T06:43:38.973 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_name": ".mgr", 2024-09-13T06:43:38.973 INFO:teuthology.orchestra.run.smithi081.stdout: "create_time": "2024-09-13T06:39:09.600726+0000", 2024-09-13T06:43:38.974 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-13T06:43:38.974 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_names": "hashpspool", 2024-09-13T06:43:38.974 INFO:teuthology.orchestra.run.smithi081.stdout: "type": 1, 2024-09-13T06:43:38.974 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 2, 2024-09-13T06:43:38.974 INFO:teuthology.orchestra.run.smithi081.stdout: "min_size": 1, 2024-09-13T06:43:38.974 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_rule": 0, 2024-09-13T06:43:38.974 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_count": 0, 2024-09-13T06:43:38.974 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_target": 0, 2024-09-13T06:43:38.974 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_barrier": 0, 2024-09-13T06:43:38.974 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-13T06:43:38.974 INFO:teuthology.orchestra.run.smithi081.stdout: "object_hash": 2, 2024-09-13T06:43:38.974 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_mode": "off", 2024-09-13T06:43:38.974 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num": 1, 2024-09-13T06:43:38.975 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num": 1, 2024-09-13T06:43:38.975 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num_target": 1, 2024-09-13T06:43:38.975 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_target": 1, 2024-09-13T06:43:38.975 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_pending": 1, 2024-09-13T06:43:38.975 INFO:teuthology.orchestra.run.smithi081.stdout: "last_pg_merge_meta": { 2024-09-13T06:43:38.975 INFO:teuthology.orchestra.run.smithi081.stdout: "source_pgid": "0.0", 2024-09-13T06:43:38.975 INFO:teuthology.orchestra.run.smithi081.stdout: "ready_epoch": 0, 2024-09-13T06:43:38.975 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_started": 0, 2024-09-13T06:43:38.975 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_clean": 0, 2024-09-13T06:43:38.975 INFO:teuthology.orchestra.run.smithi081.stdout: "source_version": "0'0", 2024-09-13T06:43:38.975 INFO:teuthology.orchestra.run.smithi081.stdout: "target_version": "0'0" 2024-09-13T06:43:38.975 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:38.975 INFO:teuthology.orchestra.run.smithi081.stdout: "last_change": "16", 2024-09-13T06:43:38.976 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend": "0", 2024-09-13T06:43:38.976 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-13T06:43:38.976 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_preluminous": "0", 2024-09-13T06:43:38.976 INFO:teuthology.orchestra.run.smithi081.stdout: "auid": 0, 2024-09-13T06:43:38.976 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_mode": "selfmanaged", 2024-09-13T06:43:38.976 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_seq": 0, 2024-09-13T06:43:38.976 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_epoch": 0, 2024-09-13T06:43:38.976 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_snaps": [], 2024-09-13T06:43:38.976 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps": "[]", 2024-09-13T06:43:38.976 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_bytes": 0, 2024-09-13T06:43:38.977 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_objects": 0, 2024-09-13T06:43:38.977 INFO:teuthology.orchestra.run.smithi081.stdout: "tiers": [], 2024-09-13T06:43:38.977 INFO:teuthology.orchestra.run.smithi081.stdout: "tier_of": -1, 2024-09-13T06:43:38.977 INFO:teuthology.orchestra.run.smithi081.stdout: "read_tier": -1, 2024-09-13T06:43:38.977 INFO:teuthology.orchestra.run.smithi081.stdout: "write_tier": -1, 2024-09-13T06:43:38.977 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_mode": "none", 2024-09-13T06:43:38.977 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_bytes": 0, 2024-09-13T06:43:38.977 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_objects": 0, 2024-09-13T06:43:38.977 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-13T06:43:38.977 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-13T06:43:38.977 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-13T06:43:38.977 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_flush_age": 0, 2024-09-13T06:43:38.978 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_evict_age": 0, 2024-09-13T06:43:38.978 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profile": "", 2024-09-13T06:43:38.978 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_params": { 2024-09-13T06:43:38.978 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "none" 2024-09-13T06:43:38.978 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:38.978 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_period": 0, 2024-09-13T06:43:38.978 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_count": 0, 2024-09-13T06:43:38.978 INFO:teuthology.orchestra.run.smithi081.stdout: "use_gmt_hitset": true, 2024-09-13T06:43:38.978 INFO:teuthology.orchestra.run.smithi081.stdout: "min_read_recency_for_promote": 0, 2024-09-13T06:43:38.978 INFO:teuthology.orchestra.run.smithi081.stdout: "min_write_recency_for_promote": 0, 2024-09-13T06:43:38.978 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_grade_decay_rate": 0, 2024-09-13T06:43:38.978 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_search_last_n": 0, 2024-09-13T06:43:38.978 INFO:teuthology.orchestra.run.smithi081.stdout: "grade_table": [], 2024-09-13T06:43:38.979 INFO:teuthology.orchestra.run.smithi081.stdout: "stripe_width": 0, 2024-09-13T06:43:38.979 INFO:teuthology.orchestra.run.smithi081.stdout: "expected_num_objects": 0, 2024-09-13T06:43:38.979 INFO:teuthology.orchestra.run.smithi081.stdout: "fast_read": false, 2024-09-13T06:43:38.979 INFO:teuthology.orchestra.run.smithi081.stdout: "options": { 2024-09-13T06:43:38.979 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_max": 32, 2024-09-13T06:43:38.979 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_min": 1 2024-09-13T06:43:38.979 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:38.979 INFO:teuthology.orchestra.run.smithi081.stdout: "application_metadata": { 2024-09-13T06:43:38.979 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": {} 2024-09-13T06:43:38.979 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:38.979 INFO:teuthology.orchestra.run.smithi081.stdout: "read_balance": { 2024-09-13T06:43:38.979 INFO:teuthology.orchestra.run.smithi081.stdout: "score_acting": 6.059999942779541, 2024-09-13T06:43:38.979 INFO:teuthology.orchestra.run.smithi081.stdout: "score_stable": 6.059999942779541, 2024-09-13T06:43:38.980 INFO:teuthology.orchestra.run.smithi081.stdout: "optimal_score": 0.33000001311302185, 2024-09-13T06:43:38.980 INFO:teuthology.orchestra.run.smithi081.stdout: "raw_score_acting": 2, 2024-09-13T06:43:38.980 INFO:teuthology.orchestra.run.smithi081.stdout: "raw_score_stable": 2, 2024-09-13T06:43:38.980 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity_weighted": 0.64948463439941406, 2024-09-13T06:43:38.980 INFO:teuthology.orchestra.run.smithi081.stdout: "average_primary_affinity": 0.87000000476837158, 2024-09-13T06:43:38.980 INFO:teuthology.orchestra.run.smithi081.stdout: "average_primary_affinity_weighted": 0.64999997615814209 2024-09-13T06:43:38.980 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:38.980 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:38.980 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:38.981 INFO:teuthology.orchestra.run.smithi081.stdout: "pool": 2, 2024-09-13T06:43:38.981 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_name": "rbd", 2024-09-13T06:43:38.981 INFO:teuthology.orchestra.run.smithi081.stdout: "create_time": "2024-09-13T06:39:15.802118+0000", 2024-09-13T06:43:38.981 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 8193, 2024-09-13T06:43:38.981 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-13T06:43:38.981 INFO:teuthology.orchestra.run.smithi081.stdout: "type": 1, 2024-09-13T06:43:38.981 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 2, 2024-09-13T06:43:38.981 INFO:teuthology.orchestra.run.smithi081.stdout: "min_size": 1, 2024-09-13T06:43:38.981 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_rule": 0, 2024-09-13T06:43:38.981 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_count": 0, 2024-09-13T06:43:38.982 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_target": 0, 2024-09-13T06:43:38.982 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_barrier": 0, 2024-09-13T06:43:38.982 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-13T06:43:38.982 INFO:teuthology.orchestra.run.smithi081.stdout: "object_hash": 2, 2024-09-13T06:43:38.982 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_mode": "off", 2024-09-13T06:43:38.982 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num": 8, 2024-09-13T06:43:38.982 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num": 8, 2024-09-13T06:43:38.982 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num_target": 8, 2024-09-13T06:43:38.982 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_target": 8, 2024-09-13T06:43:38.982 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_pending": 8, 2024-09-13T06:43:38.982 INFO:teuthology.orchestra.run.smithi081.stdout: "last_pg_merge_meta": { 2024-09-13T06:43:38.982 INFO:teuthology.orchestra.run.smithi081.stdout: "source_pgid": "0.0", 2024-09-13T06:43:38.983 INFO:teuthology.orchestra.run.smithi081.stdout: "ready_epoch": 0, 2024-09-13T06:43:38.983 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_started": 0, 2024-09-13T06:43:38.983 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_clean": 0, 2024-09-13T06:43:38.983 INFO:teuthology.orchestra.run.smithi081.stdout: "source_version": "0'0", 2024-09-13T06:43:38.983 INFO:teuthology.orchestra.run.smithi081.stdout: "target_version": "0'0" 2024-09-13T06:43:38.983 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:38.983 INFO:teuthology.orchestra.run.smithi081.stdout: "last_change": "20", 2024-09-13T06:43:38.983 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend": "0", 2024-09-13T06:43:38.983 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-13T06:43:38.983 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_preluminous": "0", 2024-09-13T06:43:38.983 INFO:teuthology.orchestra.run.smithi081.stdout: "auid": 0, 2024-09-13T06:43:38.983 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_mode": "selfmanaged", 2024-09-13T06:43:38.984 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_seq": 3, 2024-09-13T06:43:38.984 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_epoch": 20, 2024-09-13T06:43:38.984 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_snaps": [], 2024-09-13T06:43:38.984 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps": "[]", 2024-09-13T06:43:38.984 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_bytes": 0, 2024-09-13T06:43:38.984 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_objects": 0, 2024-09-13T06:43:38.984 INFO:teuthology.orchestra.run.smithi081.stdout: "tiers": [], 2024-09-13T06:43:38.984 INFO:teuthology.orchestra.run.smithi081.stdout: "tier_of": -1, 2024-09-13T06:43:38.984 INFO:teuthology.orchestra.run.smithi081.stdout: "read_tier": -1, 2024-09-13T06:43:38.984 INFO:teuthology.orchestra.run.smithi081.stdout: "write_tier": -1, 2024-09-13T06:43:38.984 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_mode": "none", 2024-09-13T06:43:38.985 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_bytes": 0, 2024-09-13T06:43:38.985 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_objects": 0, 2024-09-13T06:43:38.985 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-13T06:43:38.985 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-13T06:43:38.985 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-13T06:43:38.985 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_flush_age": 0, 2024-09-13T06:43:38.985 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_evict_age": 0, 2024-09-13T06:43:38.985 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profile": "", 2024-09-13T06:43:38.985 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_params": { 2024-09-13T06:43:38.985 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "none" 2024-09-13T06:43:38.985 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:38.985 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_period": 0, 2024-09-13T06:43:38.985 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_count": 0, 2024-09-13T06:43:38.986 INFO:teuthology.orchestra.run.smithi081.stdout: "use_gmt_hitset": true, 2024-09-13T06:43:38.986 INFO:teuthology.orchestra.run.smithi081.stdout: "min_read_recency_for_promote": 0, 2024-09-13T06:43:38.986 INFO:teuthology.orchestra.run.smithi081.stdout: "min_write_recency_for_promote": 0, 2024-09-13T06:43:38.986 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_grade_decay_rate": 0, 2024-09-13T06:43:38.986 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_search_last_n": 0, 2024-09-13T06:43:38.986 INFO:teuthology.orchestra.run.smithi081.stdout: "grade_table": [], 2024-09-13T06:43:38.986 INFO:teuthology.orchestra.run.smithi081.stdout: "stripe_width": 0, 2024-09-13T06:43:38.986 INFO:teuthology.orchestra.run.smithi081.stdout: "expected_num_objects": 0, 2024-09-13T06:43:38.986 INFO:teuthology.orchestra.run.smithi081.stdout: "fast_read": false, 2024-09-13T06:43:38.986 INFO:teuthology.orchestra.run.smithi081.stdout: "options": {}, 2024-09-13T06:43:38.986 INFO:teuthology.orchestra.run.smithi081.stdout: "application_metadata": { 2024-09-13T06:43:38.986 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd": {} 2024-09-13T06:43:38.986 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:38.986 INFO:teuthology.orchestra.run.smithi081.stdout: "read_balance": { 2024-09-13T06:43:38.987 INFO:teuthology.orchestra.run.smithi081.stdout: "error_message": "pool 2 has some PGs where all OSDs are with primary_affinity 0 (at least pg 2.2), read balance score may not be reliable", 2024-09-13T06:43:38.987 INFO:teuthology.orchestra.run.smithi081.stdout: "score_acting": 0, 2024-09-13T06:43:38.987 INFO:teuthology.orchestra.run.smithi081.stdout: "score_stable": 0 2024-09-13T06:43:38.987 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:38.987 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:38.987 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:38.987 INFO:teuthology.orchestra.run.smithi081.stdout: "pool": 3, 2024-09-13T06:43:38.987 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_name": "pool_client.0", 2024-09-13T06:43:38.987 INFO:teuthology.orchestra.run.smithi081.stdout: "create_time": "2024-09-13T06:39:25.648942+0000", 2024-09-13T06:43:38.987 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 8193, 2024-09-13T06:43:38.987 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-13T06:43:38.987 INFO:teuthology.orchestra.run.smithi081.stdout: "type": 1, 2024-09-13T06:43:38.987 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 2, 2024-09-13T06:43:38.988 INFO:teuthology.orchestra.run.smithi081.stdout: "min_size": 1, 2024-09-13T06:43:38.988 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_rule": 0, 2024-09-13T06:43:38.988 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_count": 0, 2024-09-13T06:43:38.988 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_target": 0, 2024-09-13T06:43:38.988 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_barrier": 0, 2024-09-13T06:43:38.988 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-13T06:43:38.988 INFO:teuthology.orchestra.run.smithi081.stdout: "object_hash": 2, 2024-09-13T06:43:38.988 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_mode": "off", 2024-09-13T06:43:38.988 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num": 32, 2024-09-13T06:43:38.988 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num": 32, 2024-09-13T06:43:38.988 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num_target": 32, 2024-09-13T06:43:38.988 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_target": 32, 2024-09-13T06:43:38.988 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_pending": 32, 2024-09-13T06:43:38.989 INFO:teuthology.orchestra.run.smithi081.stdout: "last_pg_merge_meta": { 2024-09-13T06:43:38.989 INFO:teuthology.orchestra.run.smithi081.stdout: "source_pgid": "0.0", 2024-09-13T06:43:38.989 INFO:teuthology.orchestra.run.smithi081.stdout: "ready_epoch": 0, 2024-09-13T06:43:38.989 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_started": 0, 2024-09-13T06:43:38.989 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_clean": 0, 2024-09-13T06:43:38.989 INFO:teuthology.orchestra.run.smithi081.stdout: "source_version": "0'0", 2024-09-13T06:43:38.989 INFO:teuthology.orchestra.run.smithi081.stdout: "target_version": "0'0" 2024-09-13T06:43:38.989 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:38.989 INFO:teuthology.orchestra.run.smithi081.stdout: "last_change": "253", 2024-09-13T06:43:38.989 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend": "0", 2024-09-13T06:43:38.989 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-13T06:43:38.989 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_preluminous": "0", 2024-09-13T06:43:38.989 INFO:teuthology.orchestra.run.smithi081.stdout: "auid": 0, 2024-09-13T06:43:38.990 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_mode": "selfmanaged", 2024-09-13T06:43:38.990 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_seq": 155, 2024-09-13T06:43:38.990 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_epoch": 253, 2024-09-13T06:43:38.990 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_snaps": [], 2024-09-13T06:43:38.990 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps": "[]", 2024-09-13T06:43:38.990 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_bytes": 0, 2024-09-13T06:43:38.990 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_objects": 0, 2024-09-13T06:43:38.990 INFO:teuthology.orchestra.run.smithi081.stdout: "tiers": [], 2024-09-13T06:43:38.990 INFO:teuthology.orchestra.run.smithi081.stdout: "tier_of": -1, 2024-09-13T06:43:38.990 INFO:teuthology.orchestra.run.smithi081.stdout: "read_tier": -1, 2024-09-13T06:43:38.990 INFO:teuthology.orchestra.run.smithi081.stdout: "write_tier": -1, 2024-09-13T06:43:38.990 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_mode": "none", 2024-09-13T06:43:38.990 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_bytes": 0, 2024-09-13T06:43:38.990 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_objects": 0, 2024-09-13T06:43:38.990 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-13T06:43:38.991 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-13T06:43:38.991 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-13T06:43:38.991 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_flush_age": 0, 2024-09-13T06:43:38.991 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_evict_age": 0, 2024-09-13T06:43:38.991 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profile": "", 2024-09-13T06:43:38.991 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_params": { 2024-09-13T06:43:38.991 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "none" 2024-09-13T06:43:38.991 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:38.991 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_period": 0, 2024-09-13T06:43:38.991 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_count": 0, 2024-09-13T06:43:38.991 INFO:teuthology.orchestra.run.smithi081.stdout: "use_gmt_hitset": true, 2024-09-13T06:43:38.991 INFO:teuthology.orchestra.run.smithi081.stdout: "min_read_recency_for_promote": 0, 2024-09-13T06:43:38.991 INFO:teuthology.orchestra.run.smithi081.stdout: "min_write_recency_for_promote": 0, 2024-09-13T06:43:38.992 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_grade_decay_rate": 0, 2024-09-13T06:43:38.992 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_search_last_n": 0, 2024-09-13T06:43:38.992 INFO:teuthology.orchestra.run.smithi081.stdout: "grade_table": [], 2024-09-13T06:43:38.992 INFO:teuthology.orchestra.run.smithi081.stdout: "stripe_width": 0, 2024-09-13T06:43:38.992 INFO:teuthology.orchestra.run.smithi081.stdout: "expected_num_objects": 0, 2024-09-13T06:43:38.992 INFO:teuthology.orchestra.run.smithi081.stdout: "fast_read": false, 2024-09-13T06:43:38.992 INFO:teuthology.orchestra.run.smithi081.stdout: "options": {}, 2024-09-13T06:43:38.992 INFO:teuthology.orchestra.run.smithi081.stdout: "application_metadata": { 2024-09-13T06:43:38.993 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd": {} 2024-09-13T06:43:38.993 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:38.993 INFO:teuthology.orchestra.run.smithi081.stdout: "read_balance": { 2024-09-13T06:43:38.993 INFO:teuthology.orchestra.run.smithi081.stdout: "error_message": "pool 3 has some PGs where all OSDs are with primary_affinity 0 (at least pg 3.10), read balance score may not be reliable", 2024-09-13T06:43:38.993 INFO:teuthology.orchestra.run.smithi081.stdout: "score_acting": 0, 2024-09-13T06:43:38.993 INFO:teuthology.orchestra.run.smithi081.stdout: "score_stable": 0 2024-09-13T06:43:38.993 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:38.993 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:38.993 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-13T06:43:38.993 INFO:teuthology.orchestra.run.smithi081.stdout: "osds": [ 2024-09-13T06:43:38.993 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:38.993 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 0, 2024-09-13T06:43:38.993 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "54b0a3e4-58ad-4f95-86dc-29a11c9a1964", 2024-09-13T06:43:38.994 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2024-09-13T06:43:38.994 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2024-09-13T06:43:38.994 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2024-09-13T06:43:38.994 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 0, 2024-09-13T06:43:38.994 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2024-09-13T06:43:38.994 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2024-09-13T06:43:38.994 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2024-09-13T06:43:38.994 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 250, 2024-09-13T06:43:38.995 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2024-09-13T06:43:38.995 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2024-09-13T06:43:38.995 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-13T06:43:38.995 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:43:38.995 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:38.995 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:43:38.995 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6808", 2024-09-13T06:43:38.995 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 1904727940 2024-09-13T06:43:38.995 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:38.995 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:38.995 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:43:38.995 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6809", 2024-09-13T06:43:38.995 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 1904727940 2024-09-13T06:43:38.996 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:38.996 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:38.996 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:38.996 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2024-09-13T06:43:38.996 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:43:38.996 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:38.996 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:43:38.996 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6810", 2024-09-13T06:43:38.996 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 1904727940 2024-09-13T06:43:38.996 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:38.996 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:38.996 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:43:38.996 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6811", 2024-09-13T06:43:38.997 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 1904727940 2024-09-13T06:43:38.997 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:38.997 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:38.997 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:38.997 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2024-09-13T06:43:38.997 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:43:38.997 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:38.997 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:43:38.997 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6814", 2024-09-13T06:43:38.997 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 1904727940 2024-09-13T06:43:38.997 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:38.997 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:38.997 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:43:38.998 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6815", 2024-09-13T06:43:38.998 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 1904727940 2024-09-13T06:43:38.998 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:38.998 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:38.998 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:38.998 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2024-09-13T06:43:38.998 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:43:38.998 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:38.998 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:43:38.998 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6812", 2024-09-13T06:43:38.998 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 1904727940 2024-09-13T06:43:38.998 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:38.998 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:38.998 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:43:38.999 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6813", 2024-09-13T06:43:38.999 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 1904727940 2024-09-13T06:43:38.999 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:38.999 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:38.999 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:38.999 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6809/1904727940", 2024-09-13T06:43:38.999 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.81:6811/1904727940", 2024-09-13T06:43:38.999 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.81:6815/1904727940", 2024-09-13T06:43:38.999 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.81:6813/1904727940", 2024-09-13T06:43:38.999 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2024-09-13T06:43:38.999 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2024-09-13T06:43:38.999 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2024-09-13T06:43:39.000 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:39.000 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:39.000 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:39.000 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 1, 2024-09-13T06:43:39.000 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "a6dba5b9-c833-465e-a8a5-1741528b24c0", 2024-09-13T06:43:39.000 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2024-09-13T06:43:39.000 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 0, 2024-09-13T06:43:39.000 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-13T06:43:39.000 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2024-09-13T06:43:39.000 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2024-09-13T06:43:39.000 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2024-09-13T06:43:39.000 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2024-09-13T06:43:39.000 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 221, 2024-09-13T06:43:39.001 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2024-09-13T06:43:39.001 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2024-09-13T06:43:39.001 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-13T06:43:39.001 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:43:39.001 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:39.001 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:43:39.001 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6817", 2024-09-13T06:43:39.001 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 738205570 2024-09-13T06:43:39.001 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:39.001 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:39.001 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:43:39.001 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6819", 2024-09-13T06:43:39.001 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 738205570 2024-09-13T06:43:39.002 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:39.002 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:39.002 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:39.002 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2024-09-13T06:43:39.002 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:43:39.002 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:39.002 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:43:39.002 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6822", 2024-09-13T06:43:39.002 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 738205570 2024-09-13T06:43:39.002 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:39.002 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:39.002 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:43:39.002 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6824", 2024-09-13T06:43:39.003 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 738205570 2024-09-13T06:43:39.003 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:39.003 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:39.003 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:39.003 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2024-09-13T06:43:39.003 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:43:39.003 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:39.003 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:43:39.003 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6830", 2024-09-13T06:43:39.003 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 738205570 2024-09-13T06:43:39.003 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:39.003 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:39.003 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:43:39.004 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6831", 2024-09-13T06:43:39.004 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 738205570 2024-09-13T06:43:39.004 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:39.004 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:39.004 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:39.004 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2024-09-13T06:43:39.004 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:43:39.004 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:39.004 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:43:39.004 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6826", 2024-09-13T06:43:39.004 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 738205570 2024-09-13T06:43:39.004 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:39.004 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:39.005 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:43:39.005 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6829", 2024-09-13T06:43:39.005 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 738205570 2024-09-13T06:43:39.005 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:39.005 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:39.005 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:39.005 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6819/738205570", 2024-09-13T06:43:39.005 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.81:6824/738205570", 2024-09-13T06:43:39.005 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.81:6831/738205570", 2024-09-13T06:43:39.005 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.81:6829/738205570", 2024-09-13T06:43:39.005 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2024-09-13T06:43:39.005 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2024-09-13T06:43:39.005 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2024-09-13T06:43:39.006 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:39.006 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:39.006 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:39.006 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 2, 2024-09-13T06:43:39.006 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "6c45097e-44a2-454f-80a4-0fe879ccd52f", 2024-09-13T06:43:39.006 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2024-09-13T06:43:39.006 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2024-09-13T06:43:39.006 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2024-09-13T06:43:39.006 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2024-09-13T06:43:39.006 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2024-09-13T06:43:39.006 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2024-09-13T06:43:39.006 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2024-09-13T06:43:39.006 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 251, 2024-09-13T06:43:39.007 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2024-09-13T06:43:39.007 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2024-09-13T06:43:39.007 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-13T06:43:39.007 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:43:39.007 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:39.007 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:43:39.007 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6816", 2024-09-13T06:43:39.007 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 3558674335 2024-09-13T06:43:39.007 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:39.007 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:39.007 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:43:39.007 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6818", 2024-09-13T06:43:39.007 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 3558674335 2024-09-13T06:43:39.008 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:39.008 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:39.008 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:39.008 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2024-09-13T06:43:39.008 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:43:39.008 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:39.008 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:43:39.008 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6820", 2024-09-13T06:43:39.008 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 3558674335 2024-09-13T06:43:39.008 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:39.008 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:39.008 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:43:39.008 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6821", 2024-09-13T06:43:39.009 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 3558674335 2024-09-13T06:43:39.009 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:39.009 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:39.009 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:39.009 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2024-09-13T06:43:39.009 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:43:39.009 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:39.009 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:43:39.009 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6827", 2024-09-13T06:43:39.009 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 3558674335 2024-09-13T06:43:39.009 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:39.009 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:39.010 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:43:39.010 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6828", 2024-09-13T06:43:39.010 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 3558674335 2024-09-13T06:43:39.010 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:39.010 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:39.010 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:39.010 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2024-09-13T06:43:39.010 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:43:39.010 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:39.010 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:43:39.010 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6823", 2024-09-13T06:43:39.010 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 3558674335 2024-09-13T06:43:39.010 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:39.010 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:39.011 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:43:39.011 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6825", 2024-09-13T06:43:39.011 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 3558674335 2024-09-13T06:43:39.011 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:39.011 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:39.011 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:39.011 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6818/3558674335", 2024-09-13T06:43:39.011 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.81:6821/3558674335", 2024-09-13T06:43:39.011 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.81:6828/3558674335", 2024-09-13T06:43:39.011 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.81:6825/3558674335", 2024-09-13T06:43:39.011 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2024-09-13T06:43:39.011 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2024-09-13T06:43:39.011 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2024-09-13T06:43:39.012 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:39.012 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:39.012 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:39.012 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 3, 2024-09-13T06:43:39.012 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "31952760-06f3-4618-a5c4-f5c4fed3aadb", 2024-09-13T06:43:39.012 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2024-09-13T06:43:39.012 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2024-09-13T06:43:39.012 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2024-09-13T06:43:39.012 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2024-09-13T06:43:39.012 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2024-09-13T06:43:39.012 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2024-09-13T06:43:39.012 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2024-09-13T06:43:39.012 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 251, 2024-09-13T06:43:39.013 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2024-09-13T06:43:39.013 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2024-09-13T06:43:39.013 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-13T06:43:39.013 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:43:39.013 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:39.013 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:43:39.013 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6800", 2024-09-13T06:43:39.013 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 1886327229 2024-09-13T06:43:39.013 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:39.014 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:39.014 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:43:39.014 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6801", 2024-09-13T06:43:39.014 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 1886327229 2024-09-13T06:43:39.014 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:39.014 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:39.014 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:39.014 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2024-09-13T06:43:39.014 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:43:39.014 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:39.014 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:43:39.014 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6802", 2024-09-13T06:43:39.015 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 1886327229 2024-09-13T06:43:39.015 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:39.015 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:39.015 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:43:39.015 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6803", 2024-09-13T06:43:39.015 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 1886327229 2024-09-13T06:43:39.015 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:39.015 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:39.015 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:39.015 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2024-09-13T06:43:39.015 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:43:39.015 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:39.015 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:43:39.016 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6806", 2024-09-13T06:43:39.016 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 1886327229 2024-09-13T06:43:39.016 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:39.016 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:39.016 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:43:39.016 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6807", 2024-09-13T06:43:39.016 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 1886327229 2024-09-13T06:43:39.016 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:39.017 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:39.017 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:39.017 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2024-09-13T06:43:39.017 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:43:39.017 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:39.017 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:43:39.017 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6804", 2024-09-13T06:43:39.017 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 1886327229 2024-09-13T06:43:39.017 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:39.017 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:39.018 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:43:39.018 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6805", 2024-09-13T06:43:39.018 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 1886327229 2024-09-13T06:43:39.018 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:39.018 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:39.018 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:39.018 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6801/1886327229", 2024-09-13T06:43:39.018 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.81:6803/1886327229", 2024-09-13T06:43:39.018 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.81:6807/1886327229", 2024-09-13T06:43:39.019 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.81:6805/1886327229", 2024-09-13T06:43:39.019 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2024-09-13T06:43:39.019 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2024-09-13T06:43:39.019 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2024-09-13T06:43:39.019 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:39.019 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:39.019 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:39.019 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 4, 2024-09-13T06:43:39.019 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "c9bd2751-c836-43dc-b844-e13678cb2fd9", 2024-09-13T06:43:39.019 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2024-09-13T06:43:39.019 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2024-09-13T06:43:39.019 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0.58685302734375, 2024-09-13T06:43:39.019 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 0.649200439453125, 2024-09-13T06:43:39.019 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2024-09-13T06:43:39.020 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2024-09-13T06:43:39.020 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2024-09-13T06:43:39.020 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 251, 2024-09-13T06:43:39.020 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2024-09-13T06:43:39.020 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2024-09-13T06:43:39.020 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-13T06:43:39.020 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:43:39.020 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:39.020 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:43:39.020 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6817", 2024-09-13T06:43:39.020 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2184515621 2024-09-13T06:43:39.020 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:39.021 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:39.021 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:43:39.021 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6819", 2024-09-13T06:43:39.021 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2184515621 2024-09-13T06:43:39.021 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:39.021 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:39.021 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:39.021 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2024-09-13T06:43:39.021 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:43:39.021 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:39.021 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:43:39.021 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6820", 2024-09-13T06:43:39.021 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2184515621 2024-09-13T06:43:39.021 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:39.022 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:39.022 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:43:39.022 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6822", 2024-09-13T06:43:39.022 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2184515621 2024-09-13T06:43:39.022 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:39.022 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:39.022 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:39.022 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2024-09-13T06:43:39.022 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:43:39.022 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:39.022 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:43:39.022 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6827", 2024-09-13T06:43:39.022 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2184515621 2024-09-13T06:43:39.022 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:39.023 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:39.023 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:43:39.023 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6829", 2024-09-13T06:43:39.023 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2184515621 2024-09-13T06:43:39.023 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:39.023 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:39.023 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:39.023 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2024-09-13T06:43:39.023 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:43:39.023 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:39.023 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:43:39.023 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6824", 2024-09-13T06:43:39.023 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2184515621 2024-09-13T06:43:39.023 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:39.024 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:39.024 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:43:39.024 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6826", 2024-09-13T06:43:39.024 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2184515621 2024-09-13T06:43:39.024 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:39.024 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:39.024 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:39.024 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.139:6819/2184515621", 2024-09-13T06:43:39.024 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.139:6822/2184515621", 2024-09-13T06:43:39.024 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.139:6829/2184515621", 2024-09-13T06:43:39.024 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.139:6826/2184515621", 2024-09-13T06:43:39.024 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2024-09-13T06:43:39.024 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2024-09-13T06:43:39.024 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2024-09-13T06:43:39.025 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:39.025 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:39.025 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:39.025 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 5, 2024-09-13T06:43:39.025 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "2971b93a-6c9f-4b77-b526-4eac788fabf9", 2024-09-13T06:43:39.025 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2024-09-13T06:43:39.025 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2024-09-13T06:43:39.025 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2024-09-13T06:43:39.025 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 0, 2024-09-13T06:43:39.025 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2024-09-13T06:43:39.025 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2024-09-13T06:43:39.025 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2024-09-13T06:43:39.025 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 248, 2024-09-13T06:43:39.026 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2024-09-13T06:43:39.026 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2024-09-13T06:43:39.026 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-13T06:43:39.026 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:43:39.026 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:39.026 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:43:39.026 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6816", 2024-09-13T06:43:39.026 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 3982901834 2024-09-13T06:43:39.026 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:39.026 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:39.026 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:43:39.026 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6818", 2024-09-13T06:43:39.026 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 3982901834 2024-09-13T06:43:39.026 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:39.027 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:39.027 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:39.027 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2024-09-13T06:43:39.027 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:43:39.027 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:39.027 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:43:39.027 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6821", 2024-09-13T06:43:39.027 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 3982901834 2024-09-13T06:43:39.027 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:39.027 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:39.027 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:43:39.027 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6823", 2024-09-13T06:43:39.027 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 3982901834 2024-09-13T06:43:39.027 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:39.028 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:39.028 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:39.028 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2024-09-13T06:43:39.028 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:43:39.028 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:39.028 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:43:39.028 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6830", 2024-09-13T06:43:39.028 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 3982901834 2024-09-13T06:43:39.028 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:39.028 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:39.028 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:43:39.028 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6831", 2024-09-13T06:43:39.028 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 3982901834 2024-09-13T06:43:39.029 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:39.029 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:39.029 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:39.029 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2024-09-13T06:43:39.029 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:43:39.029 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:39.029 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:43:39.029 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6825", 2024-09-13T06:43:39.029 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 3982901834 2024-09-13T06:43:39.029 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:39.029 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:39.029 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:43:39.029 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6828", 2024-09-13T06:43:39.030 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 3982901834 2024-09-13T06:43:39.030 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:39.030 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:39.030 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:39.030 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.139:6818/3982901834", 2024-09-13T06:43:39.030 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.139:6823/3982901834", 2024-09-13T06:43:39.030 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.139:6831/3982901834", 2024-09-13T06:43:39.030 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.139:6828/3982901834", 2024-09-13T06:43:39.030 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2024-09-13T06:43:39.030 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2024-09-13T06:43:39.030 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2024-09-13T06:43:39.030 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:39.031 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:39.031 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:39.031 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 6, 2024-09-13T06:43:39.031 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "e1f786ce-579e-48cc-b212-83f881b94184", 2024-09-13T06:43:39.031 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 0, 2024-09-13T06:43:39.031 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 0, 2024-09-13T06:43:39.031 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-13T06:43:39.031 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 0.5466766357421875, 2024-09-13T06:43:39.031 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2024-09-13T06:43:39.031 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2024-09-13T06:43:39.031 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2024-09-13T06:43:39.031 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 170, 2024-09-13T06:43:39.031 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 209, 2024-09-13T06:43:39.031 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2024-09-13T06:43:39.032 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-13T06:43:39.032 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:43:39.032 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:39.032 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:43:39.032 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6800", 2024-09-13T06:43:39.032 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2283932666 2024-09-13T06:43:39.032 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:39.032 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:39.032 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:43:39.032 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6801", 2024-09-13T06:43:39.032 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2283932666 2024-09-13T06:43:39.032 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:39.032 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:39.033 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:39.033 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2024-09-13T06:43:39.033 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:43:39.033 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:39.033 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:43:39.033 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6802", 2024-09-13T06:43:39.033 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2283932666 2024-09-13T06:43:39.033 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:39.033 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:39.033 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:43:39.033 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6803", 2024-09-13T06:43:39.033 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2283932666 2024-09-13T06:43:39.033 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:39.034 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:39.034 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:39.034 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2024-09-13T06:43:39.034 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:43:39.034 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:39.034 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:43:39.034 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6806", 2024-09-13T06:43:39.034 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2283932666 2024-09-13T06:43:39.034 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:39.034 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:39.034 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:43:39.034 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6807", 2024-09-13T06:43:39.034 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2283932666 2024-09-13T06:43:39.035 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:39.035 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:39.035 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:39.035 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2024-09-13T06:43:39.035 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:43:39.035 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:39.035 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:43:39.035 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6804", 2024-09-13T06:43:39.035 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2283932666 2024-09-13T06:43:39.035 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:39.035 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:39.035 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:43:39.035 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6805", 2024-09-13T06:43:39.036 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2283932666 2024-09-13T06:43:39.036 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:39.036 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:39.036 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:39.036 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.139:6801/2283932666", 2024-09-13T06:43:39.036 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.139:6803/2283932666", 2024-09-13T06:43:39.036 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.139:6807/2283932666", 2024-09-13T06:43:39.036 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.139:6805/2283932666", 2024-09-13T06:43:39.036 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2024-09-13T06:43:39.036 INFO:teuthology.orchestra.run.smithi081.stdout: "exists" 2024-09-13T06:43:39.037 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:39.037 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:39.037 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:39.037 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 7, 2024-09-13T06:43:39.037 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "a287ddf6-84eb-4225-b267-25eee1657625", 2024-09-13T06:43:39.037 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2024-09-13T06:43:39.037 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2024-09-13T06:43:39.037 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2024-09-13T06:43:39.037 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2024-09-13T06:43:39.037 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 13, 2024-09-13T06:43:39.037 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 121, 2024-09-13T06:43:39.037 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 187, 2024-09-13T06:43:39.037 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 251, 2024-09-13T06:43:39.038 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 122, 2024-09-13T06:43:39.038 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2024-09-13T06:43:39.038 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-13T06:43:39.038 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:43:39.038 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:39.038 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:43:39.038 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6808", 2024-09-13T06:43:39.038 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 105054579 2024-09-13T06:43:39.038 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:39.038 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:39.038 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:43:39.038 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6809", 2024-09-13T06:43:39.038 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 105054579 2024-09-13T06:43:39.038 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:39.038 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:39.039 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:39.039 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2024-09-13T06:43:39.039 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:43:39.039 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:39.039 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:43:39.039 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6810", 2024-09-13T06:43:39.039 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 105054579 2024-09-13T06:43:39.039 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:39.039 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:39.039 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:43:39.039 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6811", 2024-09-13T06:43:39.039 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 105054579 2024-09-13T06:43:39.039 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:39.039 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:39.040 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:39.040 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2024-09-13T06:43:39.040 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:43:39.040 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:39.040 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:43:39.040 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6814", 2024-09-13T06:43:39.040 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 105054579 2024-09-13T06:43:39.040 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:39.040 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:39.040 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:43:39.040 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6815", 2024-09-13T06:43:39.040 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 105054579 2024-09-13T06:43:39.040 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:39.041 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:39.041 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:39.041 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2024-09-13T06:43:39.041 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:43:39.041 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:39.041 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:43:39.041 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6812", 2024-09-13T06:43:39.041 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 105054579 2024-09-13T06:43:39.041 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:39.041 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:39.041 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:43:39.041 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6813", 2024-09-13T06:43:39.041 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 105054579 2024-09-13T06:43:39.042 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:39.042 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:39.042 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:39.042 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.139:6809/105054579", 2024-09-13T06:43:39.042 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.139:6811/105054579", 2024-09-13T06:43:39.042 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.139:6815/105054579", 2024-09-13T06:43:39.042 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.139:6813/105054579", 2024-09-13T06:43:39.042 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2024-09-13T06:43:39.042 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2024-09-13T06:43:39.042 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2024-09-13T06:43:39.042 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:39.042 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:39.042 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-13T06:43:39.042 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_xinfo": [ 2024-09-13T06:43:39.043 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:39.043 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 0, 2024-09-13T06:43:39.043 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2024-09-13T06:43:39.043 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2024-09-13T06:43:39.043 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2024-09-13T06:43:39.043 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138322906710015, 2024-09-13T06:43:39.043 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2024-09-13T06:43:39.043 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2024-09-13T06:39:05.476871+0000", 2024-09-13T06:43:39.043 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2024-09-13T06:43:39.043 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:39.043 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:39.043 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 1, 2024-09-13T06:43:39.043 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2024-09-13T06:43:39.043 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2024-09-13T06:43:39.044 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2024-09-13T06:43:39.044 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138322906710015, 2024-09-13T06:43:39.044 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 65536, 2024-09-13T06:43:39.044 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2024-09-13T06:39:05.455183+0000", 2024-09-13T06:43:39.044 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2024-09-13T06:43:39.044 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:39.044 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:39.044 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 2, 2024-09-13T06:43:39.044 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2024-09-13T06:43:39.044 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2024-09-13T06:43:39.044 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2024-09-13T06:43:39.044 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138322906710015, 2024-09-13T06:43:39.045 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2024-09-13T06:43:39.045 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2024-09-13T06:39:05.504853+0000", 2024-09-13T06:43:39.045 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2024-09-13T06:43:39.045 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:39.045 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:39.045 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 3, 2024-09-13T06:43:39.045 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2024-09-13T06:43:39.045 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2024-09-13T06:43:39.045 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2024-09-13T06:43:39.045 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138322906710015, 2024-09-13T06:43:39.045 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2024-09-13T06:43:39.045 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2024-09-13T06:39:05.372429+0000", 2024-09-13T06:43:39.046 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2024-09-13T06:43:39.046 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:39.046 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:39.046 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 4, 2024-09-13T06:43:39.046 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2024-09-13T06:43:39.046 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2024-09-13T06:43:39.046 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2024-09-13T06:43:39.046 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138322906710015, 2024-09-13T06:43:39.046 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2024-09-13T06:43:39.046 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2024-09-13T06:39:05.421023+0000", 2024-09-13T06:43:39.047 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2024-09-13T06:43:39.047 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:39.047 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:39.047 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 5, 2024-09-13T06:43:39.047 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2024-09-13T06:43:39.047 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2024-09-13T06:43:39.047 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2024-09-13T06:43:39.047 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138322906710015, 2024-09-13T06:43:39.047 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2024-09-13T06:43:39.047 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2024-09-13T06:39:05.477489+0000", 2024-09-13T06:43:39.047 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2024-09-13T06:43:39.047 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:39.047 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:39.047 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 6, 2024-09-13T06:43:39.048 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2024-09-13T06:43:39.048 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2024-09-13T06:43:39.048 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2024-09-13T06:43:39.048 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138322906710015, 2024-09-13T06:43:39.048 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 65536, 2024-09-13T06:43:39.048 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2024-09-13T06:39:05.314700+0000", 2024-09-13T06:43:39.048 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 209 2024-09-13T06:43:39.048 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:39.048 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:39.048 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 7, 2024-09-13T06:43:39.048 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2024-09-13T06:43:39.048 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2024-09-13T06:43:39.048 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2024-09-13T06:43:39.049 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138322906710015, 2024-09-13T06:43:39.049 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2024-09-13T06:43:39.049 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2024-09-13T06:39:05.462229+0000", 2024-09-13T06:43:39.049 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 122 2024-09-13T06:43:39.049 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:39.049 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-13T06:43:39.049 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_upmap": [ 2024-09-13T06:43:39.049 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:39.049 INFO:teuthology.orchestra.run.smithi081.stdout: "pgid": "3.1a", 2024-09-13T06:43:39.049 INFO:teuthology.orchestra.run.smithi081.stdout: "osds": [ 2024-09-13T06:43:39.049 INFO:teuthology.orchestra.run.smithi081.stdout: 2, 2024-09-13T06:43:39.049 INFO:teuthology.orchestra.run.smithi081.stdout: 6 2024-09-13T06:43:39.050 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:39.050 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:39.050 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-13T06:43:39.050 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_upmap_items": [ 2024-09-13T06:43:39.050 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:39.050 INFO:teuthology.orchestra.run.smithi081.stdout: "pgid": "3.14", 2024-09-13T06:43:39.050 INFO:teuthology.orchestra.run.smithi081.stdout: "mappings": [ 2024-09-13T06:43:39.050 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:39.050 INFO:teuthology.orchestra.run.smithi081.stdout: "from": 4, 2024-09-13T06:43:39.050 INFO:teuthology.orchestra.run.smithi081.stdout: "to": 2 2024-09-13T06:43:39.050 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:39.050 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:39.050 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:39.050 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-13T06:43:39.051 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_upmap_primaries": [], 2024-09-13T06:43:39.051 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_temp": [], 2024-09-13T06:43:39.051 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_temp": [], 2024-09-13T06:43:39.051 INFO:teuthology.orchestra.run.smithi081.stdout: "blocklist": {}, 2024-09-13T06:43:39.051 INFO:teuthology.orchestra.run.smithi081.stdout: "range_blocklist": {}, 2024-09-13T06:43:39.051 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profiles": { 2024-09-13T06:43:39.051 INFO:teuthology.orchestra.run.smithi081.stdout: "default": { 2024-09-13T06:43:39.051 INFO:teuthology.orchestra.run.smithi081.stdout: "crush-failure-domain": "osd", 2024-09-13T06:43:39.051 INFO:teuthology.orchestra.run.smithi081.stdout: "k": "2", 2024-09-13T06:43:39.051 INFO:teuthology.orchestra.run.smithi081.stdout: "m": "1", 2024-09-13T06:43:39.051 INFO:teuthology.orchestra.run.smithi081.stdout: "plugin": "jerasure", 2024-09-13T06:43:39.052 INFO:teuthology.orchestra.run.smithi081.stdout: "technique": "reed_sol_van" 2024-09-13T06:43:39.052 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:39.052 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:39.052 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps_queue": [ 2024-09-13T06:43:39.052 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:39.052 INFO:teuthology.orchestra.run.smithi081.stdout: "pool": 3, 2024-09-13T06:43:39.052 INFO:teuthology.orchestra.run.smithi081.stdout: "snaps": [ 2024-09-13T06:43:39.052 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:39.052 INFO:teuthology.orchestra.run.smithi081.stdout: "begin": 64, 2024-09-13T06:43:39.052 INFO:teuthology.orchestra.run.smithi081.stdout: "length": 1 2024-09-13T06:43:39.052 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:39.052 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:39.052 INFO:teuthology.orchestra.run.smithi081.stdout: "begin": 67, 2024-09-13T06:43:39.053 INFO:teuthology.orchestra.run.smithi081.stdout: "length": 1 2024-09-13T06:43:39.053 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:39.053 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:39.053 INFO:teuthology.orchestra.run.smithi081.stdout: "begin": 70, 2024-09-13T06:43:39.053 INFO:teuthology.orchestra.run.smithi081.stdout: "length": 1 2024-09-13T06:43:39.053 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:39.053 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:39.053 INFO:teuthology.orchestra.run.smithi081.stdout: "begin": 73, 2024-09-13T06:43:39.053 INFO:teuthology.orchestra.run.smithi081.stdout: "length": 1 2024-09-13T06:43:39.053 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:39.053 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:39.053 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:39.053 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-13T06:43:39.054 INFO:teuthology.orchestra.run.smithi081.stdout: "new_removed_snaps": [ 2024-09-13T06:43:39.054 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:39.054 INFO:teuthology.orchestra.run.smithi081.stdout: "pool": 3, 2024-09-13T06:43:39.054 INFO:teuthology.orchestra.run.smithi081.stdout: "snaps": [ 2024-09-13T06:43:39.054 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:39.054 INFO:teuthology.orchestra.run.smithi081.stdout: "begin": 64, 2024-09-13T06:43:39.054 INFO:teuthology.orchestra.run.smithi081.stdout: "length": 1 2024-09-13T06:43:39.054 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:39.054 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:39.054 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:39.054 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-13T06:43:39.054 INFO:teuthology.orchestra.run.smithi081.stdout: "new_purged_snaps": [], 2024-09-13T06:43:39.054 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_node_flags": {}, 2024-09-13T06:43:39.054 INFO:teuthology.orchestra.run.smithi081.stdout: "device_class_flags": {}, 2024-09-13T06:43:39.055 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": { 2024-09-13T06:43:39.055 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode_enabled": false, 2024-09-13T06:43:39.055 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_bucket_count": 0, 2024-09-13T06:43:39.055 INFO:teuthology.orchestra.run.smithi081.stdout: "degraded_stretch_mode": 0, 2024-09-13T06:43:39.055 INFO:teuthology.orchestra.run.smithi081.stdout: "recovering_stretch_mode": 0, 2024-09-13T06:43:39.055 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode_bucket": 0 2024-09-13T06:43:39.055 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:39.055 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:43:39.058 INFO:tasks.thrashosds.thrasher:j is {'epoch': 253, 'fsid': 'e5612297-d004-4957-927e-afa37f30d6cf', 'created': '2024-09-13T06:38:56.670231+0000', 'modified': '2024-09-13T06:43:38.410775+0000', 'last_up_change': '2024-09-13T06:42:51.723548+0000', 'last_in_change': '2024-09-13T06:43:33.597346+0000', 'flags': 'noscrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5801984, 'flags_set': ['noscrub', 'pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 5, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 3, 'max_osd': 8, 'require_min_compat_client': 'luminous', 'min_compat_client': 'luminous', 'require_osd_release': 'reef', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T06:39:09.600726+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 6.059999942779541, 'score_stable': 6.059999942779541, 'optimal_score': 0.33000001311302185, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 0.6494846343994141, 'average_primary_affinity': 0.8700000047683716, 'average_primary_affinity_weighted': 0.6499999761581421}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-09-13T06:39:15.802118+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 3, 'snap_epoch': 20, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'error_message': 'pool 2 has some PGs where all OSDs are with primary_affinity 0 (at least pg 2.2), read balance score may not be reliable', 'score_acting': 0, 'score_stable': 0}}, {'pool': 3, 'pool_name': 'pool_client.0', 'create_time': '2024-09-13T06:39:25.648942+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '253', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 155, 'snap_epoch': 253, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'error_message': 'pool 3 has some PGs where all OSDs are with primary_affinity 0 (at least pg 3.10), read balance score may not be reliable', 'score_acting': 0, 'score_stable': 0}}], 'osds': [{'osd': 0, 'uuid': '54b0a3e4-58ad-4f95-86dc-29a11c9a1964', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 0, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 250, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6808', 'nonce': 1904727940}, {'type': 'v1', 'addr': '172.21.15.81:6809', 'nonce': 1904727940}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6810', 'nonce': 1904727940}, {'type': 'v1', 'addr': '172.21.15.81:6811', 'nonce': 1904727940}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6814', 'nonce': 1904727940}, {'type': 'v1', 'addr': '172.21.15.81:6815', 'nonce': 1904727940}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6812', 'nonce': 1904727940}, {'type': 'v1', 'addr': '172.21.15.81:6813', 'nonce': 1904727940}]}, 'public_addr': '172.21.15.81:6809/1904727940', 'cluster_addr': '172.21.15.81:6811/1904727940', 'heartbeat_back_addr': '172.21.15.81:6815/1904727940', 'heartbeat_front_addr': '172.21.15.81:6813/1904727940', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': 'a6dba5b9-c833-465e-a8a5-1741528b24c0', 'up': 1, 'in': 0, 'weight': 0, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 221, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6817', 'nonce': 738205570}, {'type': 'v1', 'addr': '172.21.15.81:6819', 'nonce': 738205570}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6822', 'nonce': 738205570}, {'type': 'v1', 'addr': '172.21.15.81:6824', 'nonce': 738205570}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6830', 'nonce': 738205570}, {'type': 'v1', 'addr': '172.21.15.81:6831', 'nonce': 738205570}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6826', 'nonce': 738205570}, {'type': 'v1', 'addr': '172.21.15.81:6829', 'nonce': 738205570}]}, 'public_addr': '172.21.15.81:6819/738205570', 'cluster_addr': '172.21.15.81:6824/738205570', 'heartbeat_back_addr': '172.21.15.81:6831/738205570', 'heartbeat_front_addr': '172.21.15.81:6829/738205570', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': '6c45097e-44a2-454f-80a4-0fe879ccd52f', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 251, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6816', 'nonce': 3558674335}, {'type': 'v1', 'addr': '172.21.15.81:6818', 'nonce': 3558674335}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6820', 'nonce': 3558674335}, {'type': 'v1', 'addr': '172.21.15.81:6821', 'nonce': 3558674335}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6827', 'nonce': 3558674335}, {'type': 'v1', 'addr': '172.21.15.81:6828', 'nonce': 3558674335}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6823', 'nonce': 3558674335}, {'type': 'v1', 'addr': '172.21.15.81:6825', 'nonce': 3558674335}]}, 'public_addr': '172.21.15.81:6818/3558674335', 'cluster_addr': '172.21.15.81:6821/3558674335', 'heartbeat_back_addr': '172.21.15.81:6828/3558674335', 'heartbeat_front_addr': '172.21.15.81:6825/3558674335', 'state': ['exists', 'up']}, {'osd': 3, 'uuid': '31952760-06f3-4618-a5c4-f5c4fed3aadb', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 251, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6800', 'nonce': 1886327229}, {'type': 'v1', 'addr': '172.21.15.81:6801', 'nonce': 1886327229}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6802', 'nonce': 1886327229}, {'type': 'v1', 'addr': '172.21.15.81:6803', 'nonce': 1886327229}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6806', 'nonce': 1886327229}, {'type': 'v1', 'addr': '172.21.15.81:6807', 'nonce': 1886327229}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6804', 'nonce': 1886327229}, {'type': 'v1', 'addr': '172.21.15.81:6805', 'nonce': 1886327229}]}, 'public_addr': '172.21.15.81:6801/1886327229', 'cluster_addr': '172.21.15.81:6803/1886327229', 'heartbeat_back_addr': '172.21.15.81:6807/1886327229', 'heartbeat_front_addr': '172.21.15.81:6805/1886327229', 'state': ['exists', 'up']}, {'osd': 4, 'uuid': 'c9bd2751-c836-43dc-b844-e13678cb2fd9', 'up': 1, 'in': 1, 'weight': 0.58685302734375, 'primary_affinity': 0.649200439453125, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 251, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.139:6817', 'nonce': 2184515621}, {'type': 'v1', 'addr': '172.21.15.139:6819', 'nonce': 2184515621}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.139:6820', 'nonce': 2184515621}, {'type': 'v1', 'addr': '172.21.15.139:6822', 'nonce': 2184515621}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.139:6827', 'nonce': 2184515621}, {'type': 'v1', 'addr': '172.21.15.139:6829', 'nonce': 2184515621}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.139:6824', 'nonce': 2184515621}, {'type': 'v1', 'addr': '172.21.15.139:6826', 'nonce': 2184515621}]}, 'public_addr': '172.21.15.139:6819/2184515621', 'cluster_addr': '172.21.15.139:6822/2184515621', 'heartbeat_back_addr': '172.21.15.139:6829/2184515621', 'heartbeat_front_addr': '172.21.15.139:6826/2184515621', 'state': ['exists', 'up']}, {'osd': 5, 'uuid': '2971b93a-6c9f-4b77-b526-4eac788fabf9', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 0, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 248, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.139:6816', 'nonce': 3982901834}, {'type': 'v1', 'addr': '172.21.15.139:6818', 'nonce': 3982901834}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.139:6821', 'nonce': 3982901834}, {'type': 'v1', 'addr': '172.21.15.139:6823', 'nonce': 3982901834}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.139:6830', 'nonce': 3982901834}, {'type': 'v1', 'addr': '172.21.15.139:6831', 'nonce': 3982901834}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.139:6825', 'nonce': 3982901834}, {'type': 'v1', 'addr': '172.21.15.139:6828', 'nonce': 3982901834}]}, 'public_addr': '172.21.15.139:6818/3982901834', 'cluster_addr': '172.21.15.139:6823/3982901834', 'heartbeat_back_addr': '172.21.15.139:6831/3982901834', 'heartbeat_front_addr': '172.21.15.139:6828/3982901834', 'state': ['exists', 'up']}, {'osd': 6, 'uuid': 'e1f786ce-579e-48cc-b212-83f881b94184', 'up': 0, 'in': 0, 'weight': 0, 'primary_affinity': 0.5466766357421875, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 170, 'down_at': 209, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.139:6800', 'nonce': 2283932666}, {'type': 'v1', 'addr': '172.21.15.139:6801', 'nonce': 2283932666}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.139:6802', 'nonce': 2283932666}, {'type': 'v1', 'addr': '172.21.15.139:6803', 'nonce': 2283932666}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.139:6806', 'nonce': 2283932666}, {'type': 'v1', 'addr': '172.21.15.139:6807', 'nonce': 2283932666}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.139:6804', 'nonce': 2283932666}, {'type': 'v1', 'addr': '172.21.15.139:6805', 'nonce': 2283932666}]}, 'public_addr': '172.21.15.139:6801/2283932666', 'cluster_addr': '172.21.15.139:6803/2283932666', 'heartbeat_back_addr': '172.21.15.139:6807/2283932666', 'heartbeat_front_addr': '172.21.15.139:6805/2283932666', 'state': ['exists']}, {'osd': 7, 'uuid': 'a287ddf6-84eb-4225-b267-25eee1657625', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 13, 'last_clean_end': 121, 'up_from': 187, 'up_thru': 251, 'down_at': 122, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.139:6808', 'nonce': 105054579}, {'type': 'v1', 'addr': '172.21.15.139:6809', 'nonce': 105054579}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.139:6810', 'nonce': 105054579}, {'type': 'v1', 'addr': '172.21.15.139:6811', 'nonce': 105054579}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.139:6814', 'nonce': 105054579}, {'type': 'v1', 'addr': '172.21.15.139:6815', 'nonce': 105054579}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.139:6812', 'nonce': 105054579}, {'type': 'v1', 'addr': '172.21.15.139:6813', 'nonce': 105054579}]}, 'public_addr': '172.21.15.139:6809/105054579', 'cluster_addr': '172.21.15.139:6811/105054579', 'heartbeat_back_addr': '172.21.15.139:6815/105054579', 'heartbeat_front_addr': '172.21.15.139:6813/105054579', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-13T06:39:05.476871+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 65536, 'last_purged_snaps_scrub': '2024-09-13T06:39:05.455183+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-13T06:39:05.504853+0000', 'dead_epoch': 0}, {'osd': 3, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-13T06:39:05.372429+0000', 'dead_epoch': 0}, {'osd': 4, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-13T06:39:05.421023+0000', 'dead_epoch': 0}, {'osd': 5, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-13T06:39:05.477489+0000', 'dead_epoch': 0}, {'osd': 6, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 65536, 'last_purged_snaps_scrub': '2024-09-13T06:39:05.314700+0000', 'dead_epoch': 209}, {'osd': 7, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-13T06:39:05.462229+0000', 'dead_epoch': 122}], 'pg_upmap': [{'pgid': '3.1a', 'osds': [2, 6]}], 'pg_upmap_items': [{'pgid': '3.14', 'mappings': [{'from': 4, 'to': 2}]}], 'pg_upmap_primaries': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [{'pool': 3, 'snaps': [{'begin': 64, 'length': 1}, {'begin': 67, 'length': 1}, {'begin': 70, 'length': 1}, {'begin': 73, 'length': 1}]}], 'new_removed_snaps': [{'pool': 3, 'snaps': [{'begin': 64, 'length': 1}]}], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-09-13T06:43:39.058 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T06:43:39.058 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:43:39.055+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:43:39.087 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:43:39.087 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:43:39.101 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-13T06:43:39.194 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:43:39.195+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:43:39.258 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:43:39.259+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:43:39.276 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:43:39.277 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:43:39.292 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-13T06:43:39.378 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:43:39.379+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:43:39.388 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T06:43:39.389 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-09-13T06:43:39.407 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":380,"stamp":"2024-09-13T06:43:38.422574+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":695902080,"num_objects":706,"num_object_clones":0,"num_object_copies":1412,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":706,"num_whiteouts":0,"num_read":232427,"num_read_kb":1398695,"num_write":31998,"num_write_kb":1011013,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5569,"num_bytes_recovered":408869068,"num_keys_recovered":823,"num_objects_omap":24,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":23007,"ondisk_log_size":23007,"up":82,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":71,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":657732,"kb_used_data":312612,"kb_used_omap":17,"kb_used_meta":345006,"kb_avail":565573308,"statfs":{"total":579820584960,"available":579147067392,"internally_reserved":0,"allocated":320114688,"data_stored":309185316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":17653,"internal_metadata":353286923},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,1],"upper_bound":4},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-51698311,"num_objects":-146,"num_object_clones":0,"num_object_copies":-292,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-6,"num_objects_misplaced":-16,"num_objects_unfound":0,"num_objects_dirty":-146,"num_whiteouts":0,"num_read":632,"num_read_kb":543,"num_write":234,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":243,"num_bytes_recovered":6943144,"num_keys_recovered":11,"num_objects_omap":-4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"3.819199"},"pg_stats":[{"pgid":"3.1f","version":"248'696","reported_seq":5897,"reported_epoch":248,"state":"active+clean","last_fresh":"2024-09-13T06:43:33.627534+0000","last_change":"2024-09-13T06:43:33.609124+0000","last_active":"2024-09-13T06:43:33.627534+0000","last_peered":"2024-09-13T06:43:33.627534+0000","last_clean":"2024-09-13T06:43:33.627534+0000","last_became_active":"2024-09-13T06:40:57.385213+0000","last_became_peered":"2024-09-13T06:40:57.385213+0000","last_unstale":"2024-09-13T06:43:33.627534+0000","last_undegraded":"2024-09-13T06:43:33.627534+0000","last_fullsized":"2024-09-13T06:43:33.627534+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":696,"log_dups_size":0,"ondisk_log_size":696,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:46:17.100560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001663737,"stat_sum":{"num_bytes":13349152,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":6114,"num_read_kb":33853,"num_write":967,"num_write_kb":37079,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":72,"num_bytes_recovered":6114482,"num_keys_recovered":44,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"46","length":"1"},{"start":"49","length":"1"},{"start":"4c","length":"1"},{"start":"4f","length":"1"},{"start":"52","length":"1"},{"start":"55","length":"1"},{"start":"58","length":"1"},{"start":"5b","length":"1"}]},{"pgid":"3.1e","version":"247'1048","reported_seq":6535,"reported_epoch":248,"state":"active+clean","last_fresh":"2024-09-13T06:43:33.616827+0000","last_change":"2024-09-13T06:43:33.616827+0000","last_active":"2024-09-13T06:43:33.616827+0000","last_peered":"2024-09-13T06:43:33.616827+0000","last_clean":"2024-09-13T06:43:33.616827+0000","last_became_active":"2024-09-13T06:42:20.497251+0000","last_became_peered":"2024-09-13T06:42:20.497251+0000","last_unstale":"2024-09-13T06:43:33.616827+0000","last_undegraded":"2024-09-13T06:43:33.616827+0000","last_fullsized":"2024-09-13T06:43:33.616827+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":1048,"log_dups_size":0,"ondisk_log_size":1048,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:28:59.805885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.010669234,"stat_sum":{"num_bytes":15923379,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":8593,"num_read_kb":55058,"num_write":1573,"num_write_kb":29149,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":211,"num_bytes_recovered":16489974,"num_keys_recovered":55,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"46","length":"1"},{"start":"49","length":"1"},{"start":"4c","length":"1"},{"start":"4f","length":"1"},{"start":"52","length":"1"},{"start":"55","length":"1"},{"start":"58","length":"1"},{"start":"5b","length":"1"}]},{"pgid":"3.1d","version":"246'1016","reported_seq":5465,"reported_epoch":248,"state":"active+clean","last_fresh":"2024-09-13T06:43:33.618878+0000","last_change":"2024-09-13T06:43:33.618878+0000","last_active":"2024-09-13T06:43:33.618878+0000","last_peered":"2024-09-13T06:43:33.618878+0000","last_clean":"2024-09-13T06:43:33.618878+0000","last_became_active":"2024-09-13T06:42:46.399222+0000","last_became_peered":"2024-09-13T06:42:46.399222+0000","last_unstale":"2024-09-13T06:43:33.618878+0000","last_undegraded":"2024-09-13T06:43:33.618878+0000","last_fullsized":"2024-09-13T06:43:33.618878+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":1016,"log_dups_size":0,"ondisk_log_size":1016,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:15:56.908464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058463000000000005,"stat_sum":{"num_bytes":8574187,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":6234,"num_read_kb":28043,"num_write":1577,"num_write_kb":33260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":206,"num_bytes_recovered":8442088,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"46","length":"1"},{"start":"49","length":"1"},{"start":"4c","length":"1"},{"start":"4f","length":"1"},{"start":"52","length":"1"},{"start":"55","length":"1"},{"start":"58","length":"1"},{"start":"5b","length":"1"}]},{"pgid":"3.1c","version":"247'752","reported_seq":7955,"reported_epoch":248,"state":"active+clean","last_fresh":"2024-09-13T06:43:33.632063+0000","last_change":"2024-09-13T06:43:33.604267+0000","last_active":"2024-09-13T06:43:33.632063+0000","last_peered":"2024-09-13T06:43:33.632063+0000","last_clean":"2024-09-13T06:43:33.632063+0000","last_became_active":"2024-09-13T06:42:15.428168+0000","last_became_peered":"2024-09-13T06:42:15.428168+0000","last_unstale":"2024-09-13T06:43:33.632063+0000","last_undegraded":"2024-09-13T06:43:33.632063+0000","last_fullsized":"2024-09-13T06:43:33.632063+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":752,"log_dups_size":0,"ondisk_log_size":752,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:34:09.928140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047684000000000002,"stat_sum":{"num_bytes":15794464,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":8930,"num_read_kb":69550,"num_write":861,"num_write_kb":31828,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":350,"num_bytes_recovered":42380134,"num_keys_recovered":286,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"46","length":"1"},{"start":"49","length":"1"},{"start":"4c","length":"1"},{"start":"4f","length":"1"},{"start":"52","length":"1"},{"start":"55","length":"1"},{"start":"58","length":"1"},{"start":"5b","length":"1"}]},{"pgid":"3.1b","version":"247'761","reported_seq":4776,"reported_epoch":248,"state":"active+clean","last_fresh":"2024-09-13T06:43:33.610608+0000","last_change":"2024-09-13T06:43:33.610608+0000","last_active":"2024-09-13T06:43:33.610608+0000","last_peered":"2024-09-13T06:43:33.610608+0000","last_clean":"2024-09-13T06:43:33.610608+0000","last_became_active":"2024-09-13T06:43:31.415608+0000","last_became_peered":"2024-09-13T06:43:31.415608+0000","last_unstale":"2024-09-13T06:43:33.610608+0000","last_undegraded":"2024-09-13T06:43:33.610608+0000","last_fullsized":"2024-09-13T06:43:33.610608+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":761,"log_dups_size":0,"ondisk_log_size":761,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:39:01.416782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00155854,"stat_sum":{"num_bytes":16889677,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":5306,"num_read_kb":36687,"num_write":995,"num_write_kb":33354,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":295,"num_bytes_recovered":25415745,"num_keys_recovered":55,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"46","length":"1"},{"start":"49","length":"1"},{"start":"4c","length":"1"},{"start":"4f","length":"1"},{"start":"52","length":"1"},{"start":"55","length":"1"},{"start":"58","length":"1"},{"start":"5b","length":"1"}]},{"pgid":"3.1a","version":"245'461","reported_seq":6509,"reported_epoch":249,"state":"remapped+peering","last_fresh":"2024-09-13T06:43:34.605983+0000","last_change":"2024-09-13T06:43:34.606421+0000","last_active":"2024-09-13T06:43:33.604261+0000","last_peered":"2024-09-13T06:43:32.604124+0000","last_clean":"2024-09-13T06:43:32.604124+0000","last_became_active":"2024-09-13T06:42:20.496310+0000","last_became_peered":"2024-09-13T06:42:20.496310+0000","last_unstale":"2024-09-13T06:43:34.605983+0000","last_undegraded":"2024-09-13T06:43:34.605983+0000","last_fullsized":"2024-09-13T06:43:34.605983+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":461,"log_dups_size":0,"ondisk_log_size":461,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:13:58.896743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00085574999999999996,"stat_sum":{"num_bytes":12455994,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":6285,"num_read_kb":42833,"num_write":630,"num_write_kb":32415,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":148,"num_bytes_recovered":8668348,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1,2],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"49","length":"1"},{"start":"4c","length":"1"},{"start":"4f","length":"1"},{"start":"52","length":"1"},{"start":"55","length":"1"},{"start":"58","length":"1"},{"start":"5b","length":"1"}]},{"pgid":"3.19","version":"247'661","reported_seq":8072,"reported_epoch":249,"state":"remapped+peering","last_fresh":"2024-09-13T06:43:34.607661+0000","last_change":"2024-09-13T06:43:34.607661+0000","last_active":"2024-09-13T06:43:33.606009+0000","last_peered":"2024-09-13T06:43:32.556114+0000","last_clean":"2024-09-13T06:43:32.556114+0000","last_became_active":"2024-09-13T06:41:14.401959+0000","last_became_peered":"2024-09-13T06:41:14.401959+0000","last_unstale":"2024-09-13T06:43:34.607661+0000","last_undegraded":"2024-09-13T06:43:34.607661+0000","last_fullsized":"2024-09-13T06:43:34.607661+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":661,"log_dups_size":0,"ondisk_log_size":661,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:14:41.404121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001870919,"stat_sum":{"num_bytes":37233235,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":8394,"num_read_kb":35904,"num_write":719,"num_write_kb":28560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":102,"num_bytes_recovered":11654030,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"49","length":"1"},{"start":"4c","length":"1"},{"start":"4f","length":"1"},{"start":"52","length":"1"},{"start":"55","length":"1"},{"start":"58","length":"1"},{"start":"5b","length":"1"}]},{"pgid":"3.18","version":"245'630","reported_seq":6763,"reported_epoch":248,"state":"active+clean","last_fresh":"2024-09-13T06:43:33.607659+0000","last_change":"2024-09-13T06:43:33.607659+0000","last_active":"2024-09-13T06:43:33.607659+0000","last_peered":"2024-09-13T06:43:33.607659+0000","last_clean":"2024-09-13T06:43:33.607659+0000","last_became_active":"2024-09-13T06:41:14.395301+0000","last_became_peered":"2024-09-13T06:41:14.395301+0000","last_unstale":"2024-09-13T06:43:33.607659+0000","last_undegraded":"2024-09-13T06:43:33.607659+0000","last_fullsized":"2024-09-13T06:43:33.607659+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":630,"log_dups_size":0,"ondisk_log_size":630,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:10:49.528345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0032103280000000001,"stat_sum":{"num_bytes":13491730,"num_objects":33,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":0,"num_read":6391,"num_read_kb":55040,"num_write":789,"num_write_kb":38866,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":117,"num_bytes_recovered":13142180,"num_keys_recovered":22,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"46","length":"1"},{"start":"49","length":"1"},{"start":"4c","length":"1"},{"start":"4f","length":"1"},{"start":"52","length":"1"},{"start":"55","length":"1"},{"start":"58","length":"1"},{"start":"5b","length":"1"}]},{"pgid":"3.17","version":"245'1440","reported_seq":5639,"reported_epoch":248,"state":"active+clean","last_fresh":"2024-09-13T06:43:33.611935+0000","last_change":"2024-09-13T06:43:33.611935+0000","last_active":"2024-09-13T06:43:33.611935+0000","last_peered":"2024-09-13T06:43:33.611935+0000","last_clean":"2024-09-13T06:43:33.611935+0000","last_became_active":"2024-09-13T06:43:22.521039+0000","last_became_peered":"2024-09-13T06:43:22.521039+0000","last_unstale":"2024-09-13T06:43:33.611935+0000","last_undegraded":"2024-09-13T06:43:33.611935+0000","last_fullsized":"2024-09-13T06:43:33.611935+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":1440,"log_dups_size":0,"ondisk_log_size":1440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:58:28.305131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002053727,"stat_sum":{"num_bytes":14409474,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":9387,"num_read_kb":41600,"num_write":2146,"num_write_kb":32712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":112,"num_bytes_recovered":14950263,"num_keys_recovered":22,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"46","length":"1"},{"start":"49","length":"1"},{"start":"4c","length":"1"},{"start":"4f","length":"1"},{"start":"52","length":"1"},{"start":"55","length":"1"},{"start":"58","length":"1"},{"start":"5b","length":"1"}]},{"pgid":"3.16","version":"245'687","reported_seq":5132,"reported_epoch":251,"state":"active+clean","last_fresh":"2024-09-13T06:43:36.415945+0000","last_change":"2024-09-13T06:43:36.416446+0000","last_active":"2024-09-13T06:43:36.415945+0000","last_peered":"2024-09-13T06:43:36.415945+0000","last_clean":"2024-09-13T06:43:36.415945+0000","last_became_active":"2024-09-13T06:42:31.405705+0000","last_became_peered":"2024-09-13T06:42:31.405705+0000","last_unstale":"2024-09-13T06:43:36.415945+0000","last_undegraded":"2024-09-13T06:43:36.415945+0000","last_fullsized":"2024-09-13T06:43:36.415945+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":687,"log_dups_size":0,"ondisk_log_size":687,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:03:35.986532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0022635979999999999,"stat_sum":{"num_bytes":12700166,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":5070,"num_read_kb":28255,"num_write":998,"num_write_kb":23178,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":197,"num_bytes_recovered":7394092,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"43","length":"1"},{"start":"46","length":"1"},{"start":"49","length":"1"}]},{"pgid":"3.15","version":"250'337","reported_seq":6000,"reported_epoch":251,"state":"active+clean","last_fresh":"2024-09-13T06:43:36.416080+0000","last_change":"2024-09-13T06:43:36.417229+0000","last_active":"2024-09-13T06:43:36.416080+0000","last_peered":"2024-09-13T06:43:36.416080+0000","last_clean":"2024-09-13T06:43:36.416080+0000","last_became_active":"2024-09-13T06:42:33.408009+0000","last_became_peered":"2024-09-13T06:42:33.408009+0000","last_unstale":"2024-09-13T06:43:36.416080+0000","last_undegraded":"2024-09-13T06:43:36.416080+0000","last_fullsized":"2024-09-13T06:43:36.416080+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":337,"log_dups_size":0,"ondisk_log_size":337,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:09:11.995853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0030323749999999999,"stat_sum":{"num_bytes":15718230,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":5036,"num_read_kb":48021,"num_write":449,"num_write_kb":27276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":157,"num_bytes_recovered":13242563,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"43","length":"1"},{"start":"46","length":"1"},{"start":"49","length":"1"}]},{"pgid":"3.14","version":"245'551","reported_seq":9765,"reported_epoch":248,"state":"active+clean","last_fresh":"2024-09-13T06:43:33.616071+0000","last_change":"2024-09-13T06:43:33.616071+0000","last_active":"2024-09-13T06:43:33.616071+0000","last_peered":"2024-09-13T06:43:33.616071+0000","last_clean":"2024-09-13T06:43:33.616071+0000","last_became_active":"2024-09-13T06:43:07.411439+0000","last_became_peered":"2024-09-13T06:43:07.411439+0000","last_unstale":"2024-09-13T06:43:33.616071+0000","last_undegraded":"2024-09-13T06:43:33.616071+0000","last_fullsized":"2024-09-13T06:43:33.616071+0000","mapping_epoch":222,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":223,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":551,"log_dups_size":0,"ondisk_log_size":551,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:39:12.394393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002940233,"stat_sum":{"num_bytes":14589464,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":8841,"num_read_kb":61733,"num_write":739,"num_write_kb":30273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":366,"num_bytes_recovered":26160973,"num_keys_recovered":33,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"46","length":"1"},{"start":"49","length":"1"},{"start":"4c","length":"1"},{"start":"4f","length":"1"},{"start":"52","length":"1"},{"start":"55","length":"1"},{"start":"58","length":"1"},{"start":"5b","length":"1"}]},{"pgid":"2.7","version":"0'0","reported_seq":155,"reported_epoch":250,"state":"active+clean","last_fresh":"2024-09-13T06:43:35.617591+0000","last_change":"2024-09-13T06:42:29.589159+0000","last_active":"2024-09-13T06:43:35.617591+0000","last_peered":"2024-09-13T06:43:35.617591+0000","last_clean":"2024-09-13T06:43:35.617591+0000","last_became_active":"2024-09-13T06:42:29.588711+0000","last_became_peered":"2024-09-13T06:42:29.588711+0000","last_unstale":"2024-09-13T06:43:35.617591+0000","last_undegraded":"2024-09-13T06:43:35.617591+0000","last_fullsized":"2024-09-13T06:43:35.617591+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_clean_scrub_stamp":"2024-09-13T06:39:16.508974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:11:11.029014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00080324699999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.6","version":"247'589","reported_seq":10055,"reported_epoch":249,"state":"remapped+peering","last_fresh":"2024-09-13T06:43:34.609515+0000","last_change":"2024-09-13T06:43:34.609515+0000","last_active":"2024-09-13T06:43:34.609515+0000","last_peered":"2024-09-13T06:43:32.420298+0000","last_clean":"2024-09-13T06:43:32.420298+0000","last_became_active":"2024-09-13T06:41:36.458736+0000","last_became_peered":"2024-09-13T06:41:36.458736+0000","last_unstale":"2024-09-13T06:43:34.609515+0000","last_undegraded":"2024-09-13T06:43:34.609515+0000","last_fullsized":"2024-09-13T06:43:34.609515+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":589,"log_dups_size":0,"ondisk_log_size":589,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:17:01.046883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0021324740000000001,"stat_sum":{"num_bytes":7109794,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":9362,"num_read_kb":51407,"num_write":851,"num_write_kb":40903,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":0,"purged_snaps":[{"start":"49","length":"1"},{"start":"4c","length":"1"},{"start":"4f","length":"1"},{"start":"52","length":"1"},{"start":"55","length":"1"},{"start":"58","length":"1"},{"start":"5b","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":185,"reported_epoch":249,"state":"active+clean","last_fresh":"2024-09-13T06:43:34.609483+0000","last_change":"2024-09-13T06:43:34.608579+0000","last_active":"2024-09-13T06:43:34.609483+0000","last_peered":"2024-09-13T06:43:34.609483+0000","last_clean":"2024-09-13T06:43:34.609483+0000","last_became_active":"2024-09-13T06:43:34.608239+0000","last_became_peered":"2024-09-13T06:43:34.608239+0000","last_unstale":"2024-09-13T06:43:34.609483+0000","last_undegraded":"2024-09-13T06:43:34.609483+0000","last_fullsized":"2024-09-13T06:43:34.609483+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_clean_scrub_stamp":"2024-09-13T06:39:16.508974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:17:15.027663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00097079800000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"245'675","reported_seq":6888,"reported_epoch":248,"state":"active+clean","last_fresh":"2024-09-13T06:43:33.618198+0000","last_change":"2024-09-13T06:43:33.618198+0000","last_active":"2024-09-13T06:43:33.618198+0000","last_peered":"2024-09-13T06:43:33.618198+0000","last_clean":"2024-09-13T06:43:33.618198+0000","last_became_active":"2024-09-13T06:42:32.413006+0000","last_became_peered":"2024-09-13T06:42:32.413006+0000","last_unstale":"2024-09-13T06:43:33.618198+0000","last_undegraded":"2024-09-13T06:43:33.618198+0000","last_fullsized":"2024-09-13T06:43:33.618198+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":675,"log_dups_size":0,"ondisk_log_size":675,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:38:01.774494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.011532835999999999,"stat_sum":{"num_bytes":9330916,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":6521,"num_read_kb":33119,"num_write":794,"num_write_kb":30039,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":213,"num_bytes_recovered":15100645,"num_keys_recovered":11,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"46","length":"1"},{"start":"49","length":"1"},{"start":"4c","length":"1"},{"start":"4f","length":"1"},{"start":"52","length":"1"},{"start":"55","length":"1"},{"start":"58","length":"1"},{"start":"5b","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":127,"reported_epoch":250,"state":"active+clean","last_fresh":"2024-09-13T06:43:35.613011+0000","last_change":"2024-09-13T06:42:28.563276+0000","last_active":"2024-09-13T06:43:35.613011+0000","last_peered":"2024-09-13T06:43:35.613011+0000","last_clean":"2024-09-13T06:43:35.613011+0000","last_became_active":"2024-09-13T06:42:28.562827+0000","last_became_peered":"2024-09-13T06:42:28.562827+0000","last_unstale":"2024-09-13T06:43:35.613011+0000","last_undegraded":"2024-09-13T06:43:35.613011+0000","last_fullsized":"2024-09-13T06:43:35.613011+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_clean_scrub_stamp":"2024-09-13T06:39:16.508974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:10:47.285603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"245'902","reported_seq":6191,"reported_epoch":249,"state":"remapped+peering","last_fresh":"2024-09-13T06:43:34.605982+0000","last_change":"2024-09-13T06:43:34.605982+0000","last_active":"2024-09-13T06:43:33.615062+0000","last_peered":"2024-09-13T06:43:30.769576+0000","last_clean":"2024-09-13T06:43:30.769576+0000","last_became_active":"2024-09-13T06:39:27.452904+0000","last_became_peered":"2024-09-13T06:39:27.452904+0000","last_unstale":"2024-09-13T06:43:34.605982+0000","last_undegraded":"2024-09-13T06:43:34.605982+0000","last_fullsized":"2024-09-13T06:43:34.605982+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":902,"log_dups_size":0,"ondisk_log_size":902,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:43:19.714080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015630469999999999,"stat_sum":{"num_bytes":13551710,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":7497,"num_read_kb":38471,"num_write":1280,"num_write_kb":32642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"49","length":"1"},{"start":"4c","length":"1"},{"start":"4f","length":"1"},{"start":"52","length":"1"},{"start":"55","length":"1"},{"start":"58","length":"1"},{"start":"5b","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":251,"state":"active+clean","last_fresh":"2024-09-13T06:43:36.413218+0000","last_change":"2024-09-13T06:43:34.612177+0000","last_active":"2024-09-13T06:43:36.413218+0000","last_peered":"2024-09-13T06:43:36.413218+0000","last_clean":"2024-09-13T06:43:36.413218+0000","last_became_active":"2024-09-13T06:43:34.611702+0000","last_became_peered":"2024-09-13T06:43:34.611702+0000","last_unstale":"2024-09-13T06:43:36.413218+0000","last_undegraded":"2024-09-13T06:43:36.413218+0000","last_fullsized":"2024-09-13T06:43:36.413218+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_clean_scrub_stamp":"2024-09-13T06:39:16.508974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:29:32.146159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.5","version":"245'613","reported_seq":7595,"reported_epoch":248,"state":"active+clean","last_fresh":"2024-09-13T06:43:33.618801+0000","last_change":"2024-09-13T06:43:33.618801+0000","last_active":"2024-09-13T06:43:33.618801+0000","last_peered":"2024-09-13T06:43:33.618801+0000","last_clean":"2024-09-13T06:43:33.618801+0000","last_became_active":"2024-09-13T06:41:14.403171+0000","last_became_peered":"2024-09-13T06:41:14.403171+0000","last_unstale":"2024-09-13T06:43:33.618801+0000","last_undegraded":"2024-09-13T06:43:33.618801+0000","last_fullsized":"2024-09-13T06:43:33.618801+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":613,"log_dups_size":0,"ondisk_log_size":613,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:19:47.780898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.012111510000000001,"stat_sum":{"num_bytes":8949509,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":7574,"num_read_kb":41319,"num_write":990,"num_write_kb":26615,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":158,"num_bytes_recovered":4212424,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"46","length":"1"},{"start":"49","length":"1"},{"start":"4c","length":"1"},{"start":"4f","length":"1"},{"start":"52","length":"1"},{"start":"55","length":"1"},{"start":"58","length":"1"},{"start":"5b","length":"1"}]},{"pgid":"3.3","version":"247'878","reported_seq":20715,"reported_epoch":248,"state":"active+clean","last_fresh":"2024-09-13T06:43:33.604200+0000","last_change":"2024-09-13T06:43:33.604200+0000","last_active":"2024-09-13T06:43:33.604200+0000","last_peered":"2024-09-13T06:43:33.604200+0000","last_clean":"2024-09-13T06:43:33.604200+0000","last_became_active":"2024-09-13T06:42:14.417898+0000","last_became_peered":"2024-09-13T06:42:14.417898+0000","last_unstale":"2024-09-13T06:43:33.604200+0000","last_undegraded":"2024-09-13T06:43:33.604200+0000","last_fullsized":"2024-09-13T06:43:33.604200+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":878,"log_dups_size":0,"ondisk_log_size":878,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:36:48.644752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000477672,"stat_sum":{"num_bytes":36980020,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":20854,"num_read_kb":92444,"num_write":1203,"num_write_kb":30316,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":207,"num_bytes_recovered":9898606,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"46","length":"1"},{"start":"49","length":"1"},{"start":"4c","length":"1"},{"start":"4f","length":"1"},{"start":"52","length":"1"},{"start":"55","length":"1"},{"start":"58","length":"1"},{"start":"5b","length":"1"}]},{"pgid":"2.2","version":"20'2","reported_seq":63,"reported_epoch":249,"state":"active+clean","last_fresh":"2024-09-13T06:43:34.616695+0000","last_change":"2024-09-13T06:43:34.616076+0000","last_active":"2024-09-13T06:43:34.616695+0000","last_peered":"2024-09-13T06:43:34.616695+0000","last_clean":"2024-09-13T06:43:34.616695+0000","last_became_active":"2024-09-13T06:43:34.612620+0000","last_became_peered":"2024-09-13T06:43:34.612620+0000","last_unstale":"2024-09-13T06:43:34.616695+0000","last_undegraded":"2024-09-13T06:43:34.616695+0000","last_fullsized":"2024-09-13T06:43:34.616695+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_clean_scrub_stamp":"2024-09-13T06:39:16.508974+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:10:49.709282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":38,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"247'805","reported_seq":9982,"reported_epoch":249,"state":"remapped+peering","last_fresh":"2024-09-13T06:43:34.605698+0000","last_change":"2024-09-13T06:43:34.605698+0000","last_active":"2024-09-13T06:43:33.614520+0000","last_peered":"2024-09-13T06:43:32.419872+0000","last_clean":"2024-09-13T06:43:32.419872+0000","last_became_active":"2024-09-13T06:39:27.453029+0000","last_became_peered":"2024-09-13T06:39:27.453029+0000","last_unstale":"2024-09-13T06:43:34.605698+0000","last_undegraded":"2024-09-13T06:43:34.605698+0000","last_fullsized":"2024-09-13T06:43:34.605698+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":805,"log_dups_size":0,"ondisk_log_size":805,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:46:23.515087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020396590000000001,"stat_sum":{"num_bytes":85902795,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":11068,"num_read_kb":62930,"num_write":1141,"num_write_kb":36957,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"49","length":"1"},{"start":"4c","length":"1"},{"start":"4f","length":"1"},{"start":"52","length":"1"},{"start":"55","length":"1"},{"start":"58","length":"1"},{"start":"5b","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":262,"reported_epoch":248,"state":"active+clean","last_fresh":"2024-09-13T06:43:33.615823+0000","last_change":"2024-09-13T06:41:11.392095+0000","last_active":"2024-09-13T06:43:33.615823+0000","last_peered":"2024-09-13T06:43:33.615823+0000","last_clean":"2024-09-13T06:43:33.615823+0000","last_became_active":"2024-09-13T06:41:11.391688+0000","last_became_peered":"2024-09-13T06:41:11.391688+0000","last_unstale":"2024-09-13T06:43:33.615823+0000","last_undegraded":"2024-09-13T06:43:33.615823+0000","last_fullsized":"2024-09-13T06:43:33.615823+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_clean_scrub_stamp":"2024-09-13T06:39:16.508974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:41:17.729629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00033592499999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"247'1083","reported_seq":5810,"reported_epoch":248,"state":"active+clean","last_fresh":"2024-09-13T06:43:33.619058+0000","last_change":"2024-09-13T06:43:33.619058+0000","last_active":"2024-09-13T06:43:33.619058+0000","last_peered":"2024-09-13T06:43:33.619058+0000","last_clean":"2024-09-13T06:43:33.619058+0000","last_became_active":"2024-09-13T06:41:15.399065+0000","last_became_peered":"2024-09-13T06:41:15.399065+0000","last_unstale":"2024-09-13T06:43:33.619058+0000","last_undegraded":"2024-09-13T06:43:33.619058+0000","last_fullsized":"2024-09-13T06:43:33.619058+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":1083,"log_dups_size":0,"ondisk_log_size":1083,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:56:49.571998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.012139878999999999,"stat_sum":{"num_bytes":10312323,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":7931,"num_read_kb":36173,"num_write":1613,"num_write_kb":33100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":110,"num_bytes_recovered":7863454,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"46","length":"1"},{"start":"49","length":"1"},{"start":"4c","length":"1"},{"start":"4f","length":"1"},{"start":"52","length":"1"},{"start":"55","length":"1"},{"start":"58","length":"1"},{"start":"5b","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":135,"reported_epoch":250,"state":"active+clean","last_fresh":"2024-09-13T06:43:35.612949+0000","last_change":"2024-09-13T06:43:34.613029+0000","last_active":"2024-09-13T06:43:35.612949+0000","last_peered":"2024-09-13T06:43:35.612949+0000","last_clean":"2024-09-13T06:43:35.612949+0000","last_became_active":"2024-09-13T06:43:34.612709+0000","last_became_peered":"2024-09-13T06:43:34.612709+0000","last_unstale":"2024-09-13T06:43:35.612949+0000","last_undegraded":"2024-09-13T06:43:35.612949+0000","last_fullsized":"2024-09-13T06:43:35.612949+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_clean_scrub_stamp":"2024-09-13T06:39:16.508974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:36:21.752296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"245'332","reported_seq":3588,"reported_epoch":248,"state":"active+clean","last_fresh":"2024-09-13T06:43:33.607421+0000","last_change":"2024-09-13T06:43:33.607421+0000","last_active":"2024-09-13T06:43:33.607421+0000","last_peered":"2024-09-13T06:43:33.607421+0000","last_clean":"2024-09-13T06:43:33.607421+0000","last_became_active":"2024-09-13T06:41:15.399301+0000","last_became_peered":"2024-09-13T06:41:15.399301+0000","last_unstale":"2024-09-13T06:43:33.607421+0000","last_undegraded":"2024-09-13T06:43:33.607421+0000","last_fullsized":"2024-09-13T06:43:33.607421+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":332,"log_dups_size":0,"ondisk_log_size":332,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:53:18.137873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0022637439999999998,"stat_sum":{"num_bytes":25117091,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":2515,"num_read_kb":19826,"num_write":412,"num_write_kb":20943,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":169,"num_bytes_recovered":5233325,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"46","length":"1"},{"start":"49","length":"1"},{"start":"4c","length":"1"},{"start":"4f","length":"1"},{"start":"52","length":"1"},{"start":"55","length":"1"},{"start":"58","length":"1"},{"start":"5b","length":"1"}]},{"pgid":"2.3","version":"18'1","reported_seq":202,"reported_epoch":248,"state":"active+clean","last_fresh":"2024-09-13T06:43:33.613195+0000","last_change":"2024-09-13T06:40:54.530159+0000","last_active":"2024-09-13T06:43:33.613195+0000","last_peered":"2024-09-13T06:43:33.613195+0000","last_clean":"2024-09-13T06:43:33.613195+0000","last_became_active":"2024-09-13T06:40:54.525969+0000","last_became_peered":"2024-09-13T06:40:54.525969+0000","last_unstale":"2024-09-13T06:43:33.613195+0000","last_undegraded":"2024-09-13T06:43:33.613195+0000","last_fullsized":"2024-09-13T06:43:33.613195+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_clean_scrub_stamp":"2024-09-13T06:39:16.508974+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:51:26.690993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":343,"reported_epoch":250,"state":"active+clean","last_fresh":"2024-09-13T06:43:35.612711+0000","last_change":"2024-09-13T06:42:28.563168+0000","last_active":"2024-09-13T06:43:35.612711+0000","last_peered":"2024-09-13T06:43:35.612711+0000","last_clean":"2024-09-13T06:43:35.612711+0000","last_became_active":"2024-09-13T06:42:28.562642+0000","last_became_peered":"2024-09-13T06:42:28.562642+0000","last_unstale":"2024-09-13T06:43:35.612711+0000","last_undegraded":"2024-09-13T06:43:35.612711+0000","last_fullsized":"2024-09-13T06:43:35.612711+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:10.110558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:10.110558+0000","last_clean_scrub_stamp":"2024-09-13T06:39:10.110558+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:05:54.866043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"247'621","reported_seq":9977,"reported_epoch":249,"state":"remapped+peering","last_fresh":"2024-09-13T06:43:34.607557+0000","last_change":"2024-09-13T06:43:34.607699+0000","last_active":"2024-09-13T06:43:33.606271+0000","last_peered":"2024-09-13T06:43:32.542993+0000","last_clean":"2024-09-13T06:43:32.542993+0000","last_became_active":"2024-09-13T06:41:14.402355+0000","last_became_peered":"2024-09-13T06:41:14.402355+0000","last_unstale":"2024-09-13T06:43:34.607557+0000","last_undegraded":"2024-09-13T06:43:34.607557+0000","last_fullsized":"2024-09-13T06:43:34.607557+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":621,"log_dups_size":0,"ondisk_log_size":621,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:20:44.261570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00066761700000000002,"stat_sum":{"num_bytes":18588608,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":9546,"num_read_kb":46144,"num_write":801,"num_write_kb":32512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":120,"num_bytes_recovered":7985058,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1,7],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"49","length":"1"},{"start":"4c","length":"1"},{"start":"4f","length":"1"},{"start":"52","length":"1"},{"start":"55","length":"1"},{"start":"58","length":"1"},{"start":"5b","length":"1"}]},{"pgid":"3.9","version":"245'738","reported_seq":10440,"reported_epoch":248,"state":"active+clean","last_fresh":"2024-09-13T06:43:33.616610+0000","last_change":"2024-09-13T06:43:33.616610+0000","last_active":"2024-09-13T06:43:33.616610+0000","last_peered":"2024-09-13T06:43:33.616610+0000","last_clean":"2024-09-13T06:43:33.616610+0000","last_became_active":"2024-09-13T06:42:31.400279+0000","last_became_peered":"2024-09-13T06:42:31.400279+0000","last_unstale":"2024-09-13T06:43:33.616610+0000","last_undegraded":"2024-09-13T06:43:33.616610+0000","last_fullsized":"2024-09-13T06:43:33.616610+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":738,"log_dups_size":0,"ondisk_log_size":738,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:54:37.651638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012375540000000001,"stat_sum":{"num_bytes":29912209,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":10697,"num_read_kb":51621,"num_write":896,"num_write_kb":34612,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":137,"num_bytes_recovered":16579571,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"46","length":"1"},{"start":"49","length":"1"},{"start":"4c","length":"1"},{"start":"4f","length":"1"},{"start":"52","length":"1"},{"start":"55","length":"1"},{"start":"58","length":"1"},{"start":"5b","length":"1"}]},{"pgid":"3.a","version":"247'692","reported_seq":7604,"reported_epoch":249,"state":"remapped+peering","last_fresh":"2024-09-13T06:43:34.605162+0000","last_change":"2024-09-13T06:43:34.605335+0000","last_active":"2024-09-13T06:43:33.604529+0000","last_peered":"2024-09-13T06:43:32.541801+0000","last_clean":"2024-09-13T06:43:32.541801+0000","last_became_active":"2024-09-13T06:42:20.498545+0000","last_became_peered":"2024-09-13T06:42:20.498545+0000","last_unstale":"2024-09-13T06:43:34.605162+0000","last_undegraded":"2024-09-13T06:43:34.605162+0000","last_fullsized":"2024-09-13T06:43:34.605162+0000","mapping_epoch":249,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":692,"log_dups_size":0,"ondisk_log_size":692,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:28:27.449774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000779574,"stat_sum":{"num_bytes":13012754,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":8073,"num_read_kb":46916,"num_write":830,"num_write_kb":28065,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":364,"num_bytes_recovered":24732267,"num_keys_recovered":89,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1,3],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"49","length":"1"},{"start":"4c","length":"1"},{"start":"4f","length":"1"},{"start":"52","length":"1"},{"start":"55","length":"1"},{"start":"58","length":"1"},{"start":"5b","length":"1"}]},{"pgid":"3.b","version":"245'771","reported_seq":5224,"reported_epoch":248,"state":"active+clean","last_fresh":"2024-09-13T06:43:33.611791+0000","last_change":"2024-09-13T06:43:33.611791+0000","last_active":"2024-09-13T06:43:33.611791+0000","last_peered":"2024-09-13T06:43:33.611791+0000","last_clean":"2024-09-13T06:43:33.611791+0000","last_became_active":"2024-09-13T06:41:15.399204+0000","last_became_peered":"2024-09-13T06:41:15.399204+0000","last_unstale":"2024-09-13T06:43:33.611791+0000","last_undegraded":"2024-09-13T06:43:33.611791+0000","last_fullsized":"2024-09-13T06:43:33.611791+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":771,"log_dups_size":0,"ondisk_log_size":771,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:27:03.298272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.006415568,"stat_sum":{"num_bytes":10005019,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":6303,"num_read_kb":57512,"num_write":1115,"num_write_kb":24648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":117,"num_bytes_recovered":13256568,"num_keys_recovered":44,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"46","length":"1"},{"start":"49","length":"1"},{"start":"4c","length":"1"},{"start":"4f","length":"1"},{"start":"52","length":"1"},{"start":"55","length":"1"},{"start":"58","length":"1"},{"start":"5b","length":"1"}]},{"pgid":"3.c","version":"246'502","reported_seq":6259,"reported_epoch":248,"state":"active+clean","last_fresh":"2024-09-13T06:43:33.612898+0000","last_change":"2024-09-13T06:43:33.612898+0000","last_active":"2024-09-13T06:43:33.612898+0000","last_peered":"2024-09-13T06:43:33.612898+0000","last_clean":"2024-09-13T06:43:33.612898+0000","last_became_active":"2024-09-13T06:41:14.402410+0000","last_became_peered":"2024-09-13T06:41:14.402410+0000","last_unstale":"2024-09-13T06:43:33.612898+0000","last_undegraded":"2024-09-13T06:43:33.612898+0000","last_fullsized":"2024-09-13T06:43:33.612898+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":502,"log_dups_size":0,"ondisk_log_size":502,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:58:50.947568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0069807200000000002,"stat_sum":{"num_bytes":24550041,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":5837,"num_read_kb":31423,"num_write":601,"num_write_kb":25670,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":184,"num_bytes_recovered":16410936,"num_keys_recovered":88,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"46","length":"1"},{"start":"49","length":"1"},{"start":"4c","length":"1"},{"start":"4f","length":"1"},{"start":"52","length":"1"},{"start":"55","length":"1"},{"start":"58","length":"1"},{"start":"5b","length":"1"}]},{"pgid":"3.d","version":"250'862","reported_seq":2758,"reported_epoch":251,"state":"active+clean","last_fresh":"2024-09-13T06:43:36.417560+0000","last_change":"2024-09-13T06:43:36.417950+0000","last_active":"2024-09-13T06:43:36.417560+0000","last_peered":"2024-09-13T06:43:36.417560+0000","last_clean":"2024-09-13T06:43:36.417560+0000","last_became_active":"2024-09-13T06:42:32.411927+0000","last_became_peered":"2024-09-13T06:42:32.411927+0000","last_unstale":"2024-09-13T06:43:36.417560+0000","last_undegraded":"2024-09-13T06:43:36.417560+0000","last_fullsized":"2024-09-13T06:43:36.417560+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":862,"log_dups_size":0,"ondisk_log_size":862,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:40:44.787780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00148861,"stat_sum":{"num_bytes":13693171,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":4844,"num_read_kb":26163,"num_write":1499,"num_write_kb":30083,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":140,"num_bytes_recovered":11278110,"num_keys_recovered":11,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"43","length":"1"},{"start":"46","length":"1"},{"start":"49","length":"1"}]},{"pgid":"3.e","version":"245'523","reported_seq":3351,"reported_epoch":251,"state":"peering","last_fresh":"2024-09-13T06:43:36.416682+0000","last_change":"2024-09-13T06:43:36.417274+0000","last_active":"2024-09-13T06:43:36.416682+0000","last_peered":"2024-09-13T06:43:36.107019+0000","last_clean":"2024-09-13T06:43:32.432299+0000","last_became_active":"2024-09-13T06:43:35.646655+0000","last_became_peered":"2024-09-13T06:43:35.646655+0000","last_unstale":"2024-09-13T06:43:36.416682+0000","last_undegraded":"2024-09-13T06:43:36.416682+0000","last_fullsized":"2024-09-13T06:43:36.416682+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":523,"log_dups_size":0,"ondisk_log_size":523,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:47:18.283931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0031534229999999998,"stat_sum":{"num_bytes":25629911,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":3837,"num_read_kb":43543,"num_write":622,"num_write_kb":29227,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":243,"num_bytes_recovered":12695191,"num_keys_recovered":11,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,1],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"49","length":"1"},{"start":"4c","length":"1"},{"start":"4f","length":"1"},{"start":"52","length":"1"},{"start":"55","length":"1"},{"start":"58","length":"1"},{"start":"5b","length":"1"}]},{"pgid":"3.f","version":"247'626","reported_seq":4563,"reported_epoch":251,"state":"active+clean","last_fresh":"2024-09-13T06:43:36.416958+0000","last_change":"2024-09-13T06:43:36.417462+0000","last_active":"2024-09-13T06:43:36.416958+0000","last_peered":"2024-09-13T06:43:36.416958+0000","last_clean":"2024-09-13T06:43:36.416958+0000","last_became_active":"2024-09-13T06:42:33.412054+0000","last_became_peered":"2024-09-13T06:42:33.412054+0000","last_unstale":"2024-09-13T06:43:36.416958+0000","last_undegraded":"2024-09-13T06:43:36.416958+0000","last_fullsized":"2024-09-13T06:43:36.416958+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":626,"log_dups_size":0,"ondisk_log_size":626,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:07:06.963404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0021014559999999998,"stat_sum":{"num_bytes":46442520,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":4641,"num_read_kb":45261,"num_write":943,"num_write_kb":45280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":394,"num_bytes_recovered":42768786,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"43","length":"1"},{"start":"46","length":"1"},{"start":"49","length":"1"}]},{"pgid":"3.10","version":"247'751","reported_seq":4650,"reported_epoch":248,"state":"active+clean","last_fresh":"2024-09-13T06:43:33.609282+0000","last_change":"2024-09-13T06:43:33.609282+0000","last_active":"2024-09-13T06:43:33.609282+0000","last_peered":"2024-09-13T06:43:33.609282+0000","last_clean":"2024-09-13T06:43:33.609282+0000","last_became_active":"2024-09-13T06:42:20.497165+0000","last_became_peered":"2024-09-13T06:42:20.497165+0000","last_unstale":"2024-09-13T06:43:33.609282+0000","last_undegraded":"2024-09-13T06:43:33.609282+0000","last_fullsized":"2024-09-13T06:43:33.609282+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":751,"log_dups_size":0,"ondisk_log_size":751,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:40:33.464362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001371817,"stat_sum":{"num_bytes":14556709,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":5352,"num_read_kb":29299,"num_write":1072,"num_write_kb":36173,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":124,"num_bytes_recovered":6622441,"num_keys_recovered":20,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"46","length":"1"},{"start":"49","length":"1"},{"start":"4c","length":"1"},{"start":"4f","length":"1"},{"start":"52","length":"1"},{"start":"55","length":"1"},{"start":"58","length":"1"},{"start":"5b","length":"1"}]},{"pgid":"3.11","version":"247'469","reported_seq":6095,"reported_epoch":251,"state":"active+clean","last_fresh":"2024-09-13T06:43:36.413936+0000","last_change":"2024-09-13T06:43:36.414630+0000","last_active":"2024-09-13T06:43:36.413936+0000","last_peered":"2024-09-13T06:43:36.413936+0000","last_clean":"2024-09-13T06:43:36.413936+0000","last_became_active":"2024-09-13T06:42:33.411668+0000","last_became_peered":"2024-09-13T06:42:33.411668+0000","last_unstale":"2024-09-13T06:43:36.413936+0000","last_undegraded":"2024-09-13T06:43:36.413936+0000","last_fullsized":"2024-09-13T06:43:36.413936+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":469,"log_dups_size":0,"ondisk_log_size":469,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:43:01.814094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012958030000000001,"stat_sum":{"num_bytes":37971054,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":5306,"num_read_kb":34061,"num_write":626,"num_write_kb":25707,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":245,"num_bytes_recovered":7089272,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"43","length":"1"},{"start":"46","length":"1"},{"start":"49","length":"1"}]},{"pgid":"3.12","version":"250'853","reported_seq":4697,"reported_epoch":251,"state":"active+clean","last_fresh":"2024-09-13T06:43:36.414764+0000","last_change":"2024-09-13T06:43:36.415232+0000","last_active":"2024-09-13T06:43:36.414764+0000","last_peered":"2024-09-13T06:43:36.414764+0000","last_clean":"2024-09-13T06:43:36.414764+0000","last_became_active":"2024-09-13T06:42:31.398973+0000","last_became_peered":"2024-09-13T06:42:31.398973+0000","last_unstale":"2024-09-13T06:43:36.414764+0000","last_undegraded":"2024-09-13T06:43:36.414764+0000","last_fullsized":"2024-09-13T06:43:36.414764+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":853,"log_dups_size":0,"ondisk_log_size":853,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:13:09.038749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0017872820000000001,"stat_sum":{"num_bytes":62954104,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":5679,"num_read_kb":38645,"num_write":1258,"num_write_kb":35644,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":107,"num_bytes_recovered":3682200,"num_keys_recovered":21,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"43","length":"1"},{"start":"46","length":"1"},{"start":"49","length":"1"}]},{"pgid":"3.13","version":"245'562","reported_seq":4285,"reported_epoch":251,"state":"active+clean","last_fresh":"2024-09-13T06:43:36.414107+0000","last_change":"2024-09-13T06:43:36.415204+0000","last_active":"2024-09-13T06:43:36.414107+0000","last_peered":"2024-09-13T06:43:36.414107+0000","last_clean":"2024-09-13T06:43:36.414107+0000","last_became_active":"2024-09-13T06:42:31.402800+0000","last_became_peered":"2024-09-13T06:42:31.402800+0000","last_unstale":"2024-09-13T06:43:36.414107+0000","last_undegraded":"2024-09-13T06:43:36.414107+0000","last_fullsized":"2024-09-13T06:43:36.414107+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":562,"log_dups_size":0,"ondisk_log_size":562,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:59:41.167052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001748896,"stat_sum":{"num_bytes":9612283,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":4293,"num_read_kb":35741,"num_write":847,"num_write_kb":31509,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":196,"num_bytes_recovered":8224568,"num_keys_recovered":11,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"43","length":"1"},{"start":"46","length":"1"},{"start":"49","length":"1"}]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":695311693,"num_objects":702,"num_object_clones":0,"num_object_copies":1404,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":702,"num_whiteouts":0,"num_read":232311,"num_read_kb":1398595,"num_write":31837,"num_write_kb":1008595,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5561,"num_bytes_recovered":407688294,"num_keys_recovered":823,"num_objects_omap":24,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":359772160,"data_stored":357463197,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8096,"internal_metadata":0},"log_size":22887,"ondisk_log_size":22887,"up":64,"acting":57,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":38,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":3}],"osd_stats":[{"osd":7,"up_from":187,"seq":803158884367,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":111844,"kb_used_data":70800,"kb_used_omap":9,"kb_used_meta":41014,"kb_avail":94259996,"statfs":{"total":96636764160,"available":96522235904,"internally_reserved":0,"allocated":72499200,"data_stored":70611359,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9685,"internal_metadata":41998891},"hb_peers":[0,1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 06:43:31 2024","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.3160000000000001,"5min":1.3160000000000001,"15min":1.3160000000000001},"last":0.56799999999999995}]},{"osd":1,"last update":"Fri Sep 13 06:43:31 2024","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.749,"15min":0.749},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.115,"5min":1.115,"15min":1.115},"last":0.73899999999999999}]},{"osd":2,"last update":"Fri Sep 13 06:43:31 2024","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.748,"15min":0.748},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.212,"5min":1.212,"15min":1.212},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.2929999999999999,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":1.0449999999999999}]},{"osd":3,"last update":"Fri Sep 13 06:43:31 2024","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.081,"5min":1.081,"15min":1.081},"last":0.82199999999999995},{"interface":"front","average":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.5069999999999999,"5min":1.5069999999999999,"15min":1.5069999999999999},"last":0.872}]},{"osd":4,"last update":"Fri Sep 13 06:43:31 2024","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.363,"5min":1.363,"15min":1.363},"last":1.091},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.3320000000000001,"5min":1.3320000000000001,"15min":1.3320000000000001},"last":1.3120000000000001}]},{"osd":5,"last update":"Fri Sep 13 06:43:31 2024","interfaces":[{"interface":"back","average":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.2509999999999999,"5min":1.2509999999999999,"15min":1.2509999999999999},"last":1.238},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.131,"5min":1.131,"15min":1.131},"last":1.1439999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0189999999999999}]}]},{"osd":6,"up_from":0,"seq":55834574894,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},{"osd":5,"up_from":13,"seq":55834574904,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":112240,"kb_used_data":45024,"kb_used_omap":1,"kb_used_meta":67198,"kb_avail":94259600,"statfs":{"total":96636764160,"available":96521830400,"internally_reserved":0,"allocated":46104576,"data_stored":44291913,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":68811206},"hb_peers":[0,1,2,3,4,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 06:43:18 2024","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.72699999999999998,"15min":0.76900000000000002},"min":{"1min":0.39600000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":1.014,"5min":1.6679999999999999,"15min":1.6679999999999999},"last":0.84999999999999998},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.77600000000000002,"15min":0.80100000000000005},"min":{"1min":0.438,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.0660000000000001,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":0.94599999999999995}]},{"osd":1,"last update":"Fri Sep 13 06:43:18 2024","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.73899999999999999,"15min":0.751},"min":{"1min":0.53000000000000003,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.97099999999999997,"5min":1.341,"15min":1.341},"last":0.748},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.71499999999999997,"15min":0.745},"min":{"1min":0.34100000000000003,"5min":0.317,"15min":0.317},"max":{"1min":1.0880000000000001,"5min":1.722,"15min":1.722},"last":0.64800000000000002}]},{"osd":2,"last update":"Fri Sep 13 06:43:18 2024","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.82199999999999995,"15min":0.86499999999999999},"min":{"1min":0.50900000000000001,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.256,"5min":1.833,"15min":1.833},"last":0.82399999999999995},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.78000000000000003,"15min":0.79400000000000004},"min":{"1min":0.57199999999999995,"5min":0.435,"15min":0.435},"max":{"1min":1.0569999999999999,"5min":1.4279999999999999,"15min":1.4279999999999999},"last":0.72599999999999998}]},{"osd":3,"last update":"Fri Sep 13 06:43:18 2024","interfaces":[{"interface":"back","average":{"1min":0.84599999999999997,"5min":0.79500000000000004,"15min":0.77300000000000002},"min":{"1min":0.65300000000000002,"5min":0.434,"15min":0.434},"max":{"1min":1.885,"5min":1.885,"15min":1.885},"last":0.91600000000000004},{"interface":"front","average":{"1min":0.91000000000000003,"5min":0.86399999999999999,"15min":0.86599999999999999},"min":{"1min":0.59299999999999997,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.907,"5min":1.907,"15min":1.907},"last":0.873}]},{"osd":4,"last update":"Fri Sep 13 06:43:18 2024","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.84599999999999997,"15min":0.80800000000000005},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":1.155,"5min":6.3179999999999996,"15min":6.3179999999999996},"last":0.54800000000000004},{"interface":"front","average":{"1min":1.1599999999999999,"5min":1.0649999999999999,"15min":0.91400000000000003},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":8.3279999999999994,"5min":15.553000000000001,"15min":15.553000000000001},"last":0.51000000000000001}]},{"osd":6,"last update":"Fri Sep 13 06:42:12 2024","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.86299999999999999,"15min":0.877},"min":{"1min":0.40000000000000002,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.9610000000000001,"5min":1.9610000000000001,"15min":1.9610000000000001},"last":0.5},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.86099999999999999,"15min":0.87},"min":{"1min":0.39000000000000001,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.206,"5min":1.968,"15min":1.968},"last":0.84999999999999998}]},{"osd":7,"last update":"Fri Sep 13 06:43:28 2024","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":1.375,"5min":1.375,"15min":1.375},"last":0.97799999999999998},{"interface":"front","average":{"1min":0.874,"5min":0.874,"15min":0.874},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.276,"5min":1.276,"15min":1.276},"last":0.68100000000000005}]}]},{"osd":4,"up_from":13,"seq":55834574904,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":99288,"kb_used_data":50124,"kb_used_omap":1,"kb_used_meta":49150,"kb_avail":94272552,"statfs":{"total":96636764160,"available":96535093248,"internally_reserved":0,"allocated":51326976,"data_stored":49532552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":50330054},"hb_peers":[0,1,2,3,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,1],"upper_bound":4},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 06:43:15 2024","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.86399999999999999,"15min":1.014},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":1.0649999999999999,"5min":5.8230000000000004,"15min":5.8230000000000004},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.73299999999999998,"15min":0.75600000000000001},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":1.091,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":0.50700000000000001}]},{"osd":1,"last update":"Fri Sep 13 06:43:15 2024","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.80800000000000005,"15min":0.755},"min":{"1min":0.372,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.0349999999999999,"5min":10.156000000000001,"15min":10.156000000000001},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.747,"5min":0.79900000000000004,"15min":0.84399999999999997},"min":{"1min":0.39800000000000002,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.111,"5min":1.286,"15min":1.286},"last":0.83199999999999996}]},{"osd":2,"last update":"Fri Sep 13 06:43:15 2024","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.77500000000000002,"15min":0.83099999999999996},"min":{"1min":0.43099999999999999,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":1.6000000000000001,"5min":1.6000000000000001,"15min":1.6000000000000001},"last":0.79500000000000004},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.80000000000000004,"15min":0.81599999999999995},"min":{"1min":0.42499999999999999,"5min":0.374,"15min":0.374},"max":{"1min":1.097,"5min":1.3540000000000001,"15min":1.3540000000000001},"last":0.71599999999999997}]},{"osd":3,"last update":"Fri Sep 13 06:43:15 2024","interfaces":[{"interface":"back","average":{"1min":0.85899999999999999,"5min":0.86599999999999999,"15min":0.90800000000000003},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.3660000000000001,"5min":1.4810000000000001,"15min":1.4810000000000001},"last":0.88200000000000001},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.97199999999999998,"15min":0.93100000000000005},"min":{"1min":0.41299999999999998,"5min":0.374,"15min":0.374},"max":{"1min":1.4319999999999999,"5min":10.195,"15min":10.195},"last":0.76000000000000001}]},{"osd":5,"last update":"Fri Sep 13 06:43:15 2024","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.83499999999999996,"15min":0.86299999999999999},"min":{"1min":0.38400000000000001,"5min":0.249,"15min":0.249},"max":{"1min":1.478,"5min":2.9790000000000001,"15min":2.9790000000000001},"last":1.016},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.874,"15min":0.92400000000000004},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":1.49,"5min":1.8779999999999999,"15min":1.8779999999999999},"last":0.96899999999999997}]},{"osd":6,"last update":"Fri Sep 13 06:42:14 2024","interfaces":[{"interface":"back","average":{"1min":0.90100000000000002,"5min":0.92100000000000004,"15min":0.82899999999999996},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":1.6100000000000001,"5min":10.016999999999999,"15min":10.016999999999999},"last":0.89500000000000002},{"interface":"front","average":{"1min":0.86699999999999999,"5min":0.93300000000000005,"15min":0.95999999999999996},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.2030000000000001,"5min":2.0750000000000002,"15min":2.0750000000000002},"last":0.91200000000000003}]},{"osd":7,"last update":"Fri Sep 13 06:43:31 2024","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"last":0.91000000000000003},{"interface":"front","average":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.234,"5min":1.234,"15min":1.234},"last":1.121}]}]},{"osd":3,"up_from":13,"seq":55834574907,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":120184,"kb_used_data":52968,"kb_used_omap":1,"kb_used_meta":67198,"kb_avail":94251656,"statfs":{"total":96636764160,"available":96513695744,"internally_reserved":0,"allocated":54239232,"data_stored":52396838,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":68811208},"hb_peers":[0,1,2,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 06:43:12 2024","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.55500000000000005,"15min":0.56699999999999995},"min":{"1min":0.28699999999999998,"5min":0.191,"15min":0.191},"max":{"1min":1.014,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.63300000000000001,"15min":0.66300000000000003},"min":{"1min":0.38100000000000001,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.89100000000000001,"5min":1.2789999999999999,"15min":1.2789999999999999},"last":0.625}]},{"osd":1,"last update":"Fri Sep 13 06:43:12 2024","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.56999999999999995,"15min":0.59299999999999997},"min":{"1min":0.39500000000000002,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.88800000000000001,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.623,"15min":0.67500000000000004},"min":{"1min":0.28399999999999997,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":1.28,"5min":1.589,"15min":1.589},"last":0.72799999999999998}]},{"osd":2,"last update":"Fri Sep 13 06:43:12 2024","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.63800000000000001,"15min":0.65500000000000003},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":1.1850000000000001,"5min":1.323,"15min":1.323},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.61099999999999999,"15min":0.63100000000000001},"min":{"1min":0.32700000000000001,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.998,"5min":1.409,"15min":1.409},"last":0.66600000000000004}]},{"osd":4,"last update":"Fri Sep 13 06:43:12 2024","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.84599999999999997,"15min":0.90100000000000002},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":1.159,"5min":1.7929999999999999,"15min":1.7929999999999999},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.77600000000000002,"15min":0.78700000000000003},"min":{"1min":0.44700000000000001,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.04,"5min":1.3240000000000001,"15min":1.3240000000000001},"last":0.89000000000000001}]},{"osd":5,"last update":"Fri Sep 13 06:43:12 2024","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.83099999999999996,"15min":0.85699999999999998},"min":{"1min":0.47899999999999998,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.115,"5min":1.3799999999999999,"15min":1.3799999999999999},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.88,"5min":0.83499999999999996,"15min":0.86299999999999999},"min":{"1min":0.63800000000000001,"5min":0.433,"15min":0.433},"max":{"1min":1.1379999999999999,"5min":1.206,"15min":1.206},"last":0.85699999999999998}]},{"osd":6,"last update":"Fri Sep 13 06:42:11 2024","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.88500000000000001,"15min":0.91100000000000003},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.135,"5min":1.532,"15min":1.532},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.95299999999999996,"15min":0.98999999999999999},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.2250000000000001,"5min":1.825,"15min":1.825},"last":0.72999999999999998}]},{"osd":7,"last update":"Fri Sep 13 06:43:31 2024","interfaces":[{"interface":"back","average":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.3799999999999999,"5min":1.3799999999999999,"15min":1.3799999999999999},"last":0.96199999999999997},{"interface":"front","average":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":2.0459999999999998,"5min":2.0459999999999998,"15min":2.0459999999999998},"last":0.97899999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574904,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":86024,"kb_used_data":36860,"kb_used_omap":1,"kb_used_meta":49150,"kb_avail":94285816,"statfs":{"total":96636764160,"available":96548675584,"internally_reserved":0,"allocated":37744640,"data_stored":36005051,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":50330054},"hb_peers":[0,1,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 06:43:17 2024","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.66100000000000003,"15min":0.56000000000000005},"min":{"1min":0.33000000000000002,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":1.24,"5min":8.6449999999999996,"15min":8.6449999999999996},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.64100000000000001,"15min":0.60699999999999998},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.97199999999999998,"5min":4.0380000000000003,"15min":4.0380000000000003},"last":0.59899999999999998}]},{"osd":1,"last update":"Fri Sep 13 06:43:17 2024","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.64400000000000002,"15min":0.621},"min":{"1min":0.28499999999999998,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.94299999999999995,"5min":3.4649999999999999,"15min":3.4649999999999999},"last":0.502},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.66200000000000003,"15min":0.60199999999999998},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":1.1000000000000001,"5min":3.8159999999999998,"15min":3.8159999999999998},"last":0.56499999999999995}]},{"osd":3,"last update":"Fri Sep 13 06:43:17 2024","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.64500000000000002,"15min":0.58499999999999996},"min":{"1min":0.29399999999999998,"5min":0.249,"15min":0.249},"max":{"1min":0.93899999999999995,"5min":3.407,"15min":3.407},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.72599999999999998,"15min":0.68300000000000005},"min":{"1min":0.317,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.325,"5min":3.2639999999999998,"15min":3.2639999999999998},"last":0.53400000000000003}]},{"osd":4,"last update":"Fri Sep 13 06:43:17 2024","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.88900000000000001,"15min":0.88900000000000001},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.1539999999999999,"5min":3.1179999999999999,"15min":3.1179999999999999},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.79600000000000004,"5min":1.075,"15min":0.94499999999999995},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":1.1799999999999999,"5min":21.081,"15min":21.081},"last":0.64500000000000002}]},{"osd":5,"last update":"Fri Sep 13 06:43:17 2024","interfaces":[{"interface":"back","average":{"1min":0.80300000000000005,"5min":0.84999999999999998,"15min":0.84399999999999997},"min":{"1min":0.46100000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":1.333,"5min":2.2389999999999999,"15min":2.2389999999999999},"last":0.748},{"interface":"front","average":{"1min":0.86499999999999999,"5min":0.90600000000000003,"15min":0.871},"min":{"1min":0.56299999999999994,"5min":0.377,"15min":0.377},"max":{"1min":1.2350000000000001,"5min":3.3290000000000002,"15min":3.3290000000000002},"last":0.63200000000000001}]},{"osd":6,"last update":"Fri Sep 13 06:42:15 2024","interfaces":[{"interface":"back","average":{"1min":0.86799999999999999,"5min":0.94199999999999995,"15min":0.92600000000000005},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.274,"5min":3.923,"15min":3.923},"last":0.84999999999999998},{"interface":"front","average":{"1min":0.97799999999999998,"5min":0.90500000000000003,"15min":0.879},"min":{"1min":0.60899999999999999,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":2.2080000000000002,"5min":2.2120000000000002,"15min":2.2120000000000002},"last":0.873}]},{"osd":7,"last update":"Fri Sep 13 06:43:33 2024","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.236,"5min":1.236,"15min":1.236},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.375,"5min":1.375,"15min":1.375},"last":0.71499999999999997}]}]},{"osd":1,"up_from":0,"seq":55834574904,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},{"osd":0,"up_from":13,"seq":55834574903,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":128152,"kb_used_data":56836,"kb_used_omap":1,"kb_used_meta":71294,"kb_avail":94243688,"statfs":{"total":96636764160,"available":96505536512,"internally_reserved":0,"allocated":58200064,"data_stored":56347603,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":73005510},"hb_peers":[1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 06:43:11 2024","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.53800000000000003,"15min":0.52600000000000002},"min":{"1min":0.19900000000000001,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":1.103,"5min":1.2270000000000001,"15min":1.2270000000000001},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.53900000000000003,"15min":0.53300000000000003},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":1.024,"5min":1.222,"15min":1.222},"last":0.64200000000000002}]},{"osd":2,"last update":"Fri Sep 13 06:43:11 2024","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.58799999999999997,"15min":0.55000000000000004},"min":{"1min":0.217,"5min":0.217,"15min":0.217},"max":{"1min":1.1859999999999999,"5min":1.839,"15min":1.839},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.58099999999999996,"15min":0.56499999999999995},"min":{"1min":0.27600000000000002,"5min":0.245,"15min":0.245},"max":{"1min":0.91200000000000003,"5min":1.359,"15min":1.359},"last":0.76500000000000001}]},{"osd":3,"last update":"Fri Sep 13 06:43:11 2024","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.56499999999999995,"15min":0.54700000000000004},"min":{"1min":0.316,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.85199999999999998,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.85199999999999998},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.71499999999999997,"15min":0.68899999999999995},"min":{"1min":0.26100000000000001,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":1.256,"5min":4.9630000000000001,"15min":4.9630000000000001},"last":0.81699999999999995}]},{"osd":4,"last update":"Fri Sep 13 06:43:11 2024","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.78300000000000003,"15min":0.78700000000000003},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":1.2849999999999999,"5min":1.5449999999999999,"15min":1.5449999999999999},"last":0.98699999999999999},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.77300000000000002,"15min":0.79600000000000004},"min":{"1min":0.438,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.97899999999999998,"5min":1.6319999999999999,"15min":1.6319999999999999},"last":1.006}]},{"osd":5,"last update":"Fri Sep 13 06:43:11 2024","interfaces":[{"interface":"back","average":{"1min":0.89700000000000002,"5min":0.84799999999999998,"15min":0.84799999999999998},"min":{"1min":0.42299999999999999,"5min":0.378,"15min":0.378},"max":{"1min":1.359,"5min":1.4059999999999999,"15min":1.4059999999999999},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.85399999999999998,"15min":0.86899999999999999},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.1439999999999999,"5min":1.5740000000000001,"15min":1.5740000000000001},"last":0.92700000000000005}]},{"osd":6,"last update":"Fri Sep 13 06:42:11 2024","interfaces":[{"interface":"back","average":{"1min":0.89800000000000002,"5min":0.91200000000000003,"15min":0.93100000000000005},"min":{"1min":0.55300000000000005,"5min":0.499,"15min":0.499},"max":{"1min":1.571,"5min":2.4969999999999999,"15min":2.4969999999999999},"last":0.83099999999999996},{"interface":"front","average":{"1min":0.878,"5min":0.89600000000000002,"15min":0.90600000000000003},"min":{"1min":0.51800000000000002,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.208,"5min":2.0419999999999998,"15min":2.0419999999999998},"last":0.874}]},{"osd":7,"last update":"Fri Sep 13 06:43:30 2024","interfaces":[{"interface":"back","average":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.9419999999999999,"5min":1.9419999999999999,"15min":1.9419999999999999},"last":0.95999999999999996},{"interface":"front","average":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.901,"5min":1.901,"15min":1.901},"last":1.034}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":54591488,"data_stored":54248239,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40300544,"data_stored":40018962,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":34738176,"data_stored":34501926,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":51232768,"data_stored":50893713,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":48320512,"data_stored":48029427,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":43098112,"data_stored":42789341,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12685312,"data_stored":12590125,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":74805248,"data_stored":74391464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8096,"internal_metadata":0}]}} 2024-09-13T06:43:39.410 INFO:tasks.thrashosds.thrasher:Setting 3.9 to [2, 6] 2024-09-13T06:43:39.410 INFO:tasks.thrashosds.thrasher:cmd ['osd', 'pg-upmap', '3.9', '2', '6'] 2024-09-13T06:43:39.410 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pg-upmap 3.9 2 6 2024-09-13T06:43:39.453 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:43:39.454 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:43:39.460 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:43:39.461+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:43:39.470 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-13T06:43:39.561 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:43:39.559+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:43:39.641 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:43:39.642 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:43:39.655 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-13T06:43:39.699 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:43:39.699+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:43:39.762 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:43:39.761+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:43:39.805 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-13T06:43:39.808 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:43:39.808 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:43:39.822 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-13T06:43:39.863 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:43:39.865+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:43:39.949 INFO:teuthology.orchestra.run.smithi081.stdout:osd.0: {} 2024-09-13T06:43:39.949 INFO:teuthology.orchestra.run.smithi081.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-13T06:43:39.964 INFO:teuthology.orchestra.run.smithi081.stdout:osd.1: {} 2024-09-13T06:43:39.964 INFO:teuthology.orchestra.run.smithi081.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-13T06:43:39.965 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:43:39.965+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:43:39.979 INFO:teuthology.orchestra.run.smithi081.stdout:osd.2: {} 2024-09-13T06:43:39.979 INFO:teuthology.orchestra.run.smithi081.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-13T06:43:39.986 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:43:39.986 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 20, 2024-09-13T06:43:39.986 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 600, 2024-09-13T06:43:39.986 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [ 2024-09-13T06:43:39.986 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:39.987 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:36160 3.f 3:f62782c2:::rbd_object_map.11219660270d.0000000000000016:head [call] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-13T06:43:39.987 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:01.607291+0000", 2024-09-13T06:43:39.987 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 218.379656001, 2024-09-13T06:43:39.987 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.99619456699999998, 2024-09-13T06:43:39.987 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:39.987 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:39.987 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:39.987 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:39.987 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:39.987 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 36160 2024-09-13T06:43:39.987 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:39.987 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:39.987 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:39.988 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:39.988 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:01.607291+0000", 2024-09-13T06:43:39.988 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:39.988 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:39.988 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:39.988 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:39.988 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:01.607291+0000", 2024-09-13T06:43:39.988 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:39.988 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:39.988 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:39.988 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:39.988 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:01.607289+0000", 2024-09-13T06:43:39.988 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999976 2024-09-13T06:43:39.989 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:39.989 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:39.989 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:39.989 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:01.607302+0000", 2024-09-13T06:43:39.989 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3018e-05 2024-09-13T06:43:39.989 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:39.989 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:39.989 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:39.989 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:01.607323+0000", 2024-09-13T06:43:39.989 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1030999999999999e-05 2024-09-13T06:43:39.989 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:39.989 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:39.989 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:39.989 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:01.607342+0000", 2024-09-13T06:43:39.990 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8961e-05 2024-09-13T06:43:39.990 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:39.990 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:39.990 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:39.990 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:01.607425+0000", 2024-09-13T06:43:39.990 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.3171999999999996e-05 2024-09-13T06:43:39.990 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:39.990 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:39.990 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:43:39.990 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:01.607441+0000", 2024-09-13T06:43:39.990 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5996999999999999e-05 2024-09-13T06:43:39.990 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:39.990 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:39.990 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:39.991 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:02.596186+0000", 2024-09-13T06:43:39.991 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.98874432000000001 2024-09-13T06:43:39.991 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:39.991 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:39.991 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for missing object", 2024-09-13T06:43:39.991 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:02.596618+0000", 2024-09-13T06:43:39.991 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000432032 2024-09-13T06:43:39.991 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:39.991 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:39.991 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:39.991 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:02.600845+0000", 2024-09-13T06:43:39.991 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0042277410000000001 2024-09-13T06:43:39.991 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:39.991 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:39.992 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:39.992 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:02.601003+0000", 2024-09-13T06:43:39.992 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00015731999999999999 2024-09-13T06:43:39.992 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:39.992 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:39.992 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:39.992 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:02.603486+0000", 2024-09-13T06:43:39.992 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0024832510000000001 2024-09-13T06:43:39.992 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:39.992 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:39.992 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:39.992 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:39.992 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:39.993 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:37806 3.9 3:951cb95b:::rbd_data.1121d8143c6e.0000000000000002:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e56)", 2024-09-13T06:43:39.993 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:06.373482+0000", 2024-09-13T06:43:39.993 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 213.61346496499999, 2024-09-13T06:43:39.993 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.002476213, 2024-09-13T06:43:39.993 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:39.993 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:39.993 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:39.993 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:39.993 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:39.993 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 37806 2024-09-13T06:43:39.993 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:39.994 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:39.994 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:39.994 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:39.994 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.373482+0000", 2024-09-13T06:43:39.994 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:39.994 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:39.994 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:39.994 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:39.994 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.373482+0000", 2024-09-13T06:43:39.994 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:39.994 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:39.994 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:39.994 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:39.995 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.373479+0000", 2024-09-13T06:43:39.995 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999962 2024-09-13T06:43:39.995 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:39.995 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:39.995 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:39.995 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.373495+0000", 2024-09-13T06:43:39.995 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6640999999999999e-05 2024-09-13T06:43:39.995 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:39.995 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:39.995 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:39.995 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.373542+0000", 2024-09-13T06:43:39.995 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6229000000000001e-05 2024-09-13T06:43:39.995 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:39.996 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:39.996 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:39.996 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.373564+0000", 2024-09-13T06:43:39.996 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2684000000000002e-05 2024-09-13T06:43:39.996 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:39.996 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:39.996 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:39.996 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374268+0000", 2024-09-13T06:43:39.996 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00070363700000000001 2024-09-13T06:43:39.996 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:39.996 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:39.996 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:43:39.996 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374305+0000", 2024-09-13T06:43:39.997 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.6936e-05 2024-09-13T06:43:39.997 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:39.997 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:39.997 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:39.997 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.375175+0000", 2024-09-13T06:43:39.997 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.000870454 2024-09-13T06:43:39.997 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:39.997 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:39.997 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:39.997 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.375678+0000", 2024-09-13T06:43:39.997 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00050292499999999999 2024-09-13T06:43:39.997 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:39.998 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:39.998 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:39.998 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.375959+0000", 2024-09-13T06:43:39.998 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00028050599999999997 2024-09-13T06:43:39.998 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:39.998 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:39.998 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:39.998 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:39.998 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:39.998 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:37821 3.9 3:951cb95b:::rbd_data.1121d8143c6e.0000000000000002:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e56)", 2024-09-13T06:43:39.998 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:06.374454+0000", 2024-09-13T06:43:39.998 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 213.61249384800001, 2024-09-13T06:43:39.998 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.002545072, 2024-09-13T06:43:39.999 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:39.999 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:39.999 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:39.999 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:39.999 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:39.999 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 37821 2024-09-13T06:43:39.999 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:39.999 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:39.999 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:39.999 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:39.999 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374454+0000", 2024-09-13T06:43:40.000 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:40.000 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.000 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.000 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:40.000 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374454+0000", 2024-09-13T06:43:40.000 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:40.000 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.000 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.000 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:40.000 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374452+0000", 2024-09-13T06:43:40.000 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999981 2024-09-13T06:43:40.001 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.001 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.001 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:40.001 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374463+0000", 2024-09-13T06:43:40.001 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0756e-05 2024-09-13T06:43:40.001 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.001 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.001 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:40.001 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374487+0000", 2024-09-13T06:43:40.001 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4887000000000001e-05 2024-09-13T06:43:40.001 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.001 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.002 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:40.002 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374504+0000", 2024-09-13T06:43:40.002 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6852000000000001e-05 2024-09-13T06:43:40.002 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.002 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.002 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:40.002 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374829+0000", 2024-09-13T06:43:40.002 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000324684 2024-09-13T06:43:40.002 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.002 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.002 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:43:40.002 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374880+0000", 2024-09-13T06:43:40.002 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.1378000000000002e-05 2024-09-13T06:43:40.003 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.003 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.003 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:40.003 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.376423+0000", 2024-09-13T06:43:40.003 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.001542734 2024-09-13T06:43:40.003 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.003 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.003 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:40.003 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.376607+0000", 2024-09-13T06:43:40.003 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000183656 2024-09-13T06:43:40.003 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.003 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.003 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:40.004 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.376999+0000", 2024-09-13T06:43:40.004 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00039191200000000001 2024-09-13T06:43:40.004 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:40.004 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:40.004 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:40.004 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.004 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.004 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:37836 3.9 3:951cb95b:::rbd_data.1121d8143c6e.0000000000000002:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e56)", 2024-09-13T06:43:40.004 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:06.374929+0000", 2024-09-13T06:43:40.004 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 213.61201819600001, 2024-09-13T06:43:40.004 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.002778825, 2024-09-13T06:43:40.004 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:40.004 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:40.004 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:40.005 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:40.005 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:40.005 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 37836 2024-09-13T06:43:40.005 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.005 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:40.005 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.005 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:40.005 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374929+0000", 2024-09-13T06:43:40.005 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:40.005 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.005 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.005 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:40.005 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374929+0000", 2024-09-13T06:43:40.006 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:40.006 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.006 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.006 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:40.006 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374927+0000", 2024-09-13T06:43:40.006 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999981 2024-09-13T06:43:40.006 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.006 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.006 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:40.006 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374939+0000", 2024-09-13T06:43:40.006 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1846e-05 2024-09-13T06:43:40.006 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.007 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.007 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:40.007 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374962+0000", 2024-09-13T06:43:40.007 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3054e-05 2024-09-13T06:43:40.007 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.007 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.007 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:40.007 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374978+0000", 2024-09-13T06:43:40.007 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5899000000000001e-05 2024-09-13T06:43:40.007 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.007 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.007 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:40.007 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.375106+0000", 2024-09-13T06:43:40.007 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00012789 2024-09-13T06:43:40.008 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.008 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.008 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:43:40.008 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.375134+0000", 2024-09-13T06:43:40.008 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.8254000000000001e-05 2024-09-13T06:43:40.008 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.008 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.008 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:40.008 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.377082+0000", 2024-09-13T06:43:40.008 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0019471520000001 2024-09-13T06:43:40.008 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.008 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.008 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:40.008 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.377330+0000", 2024-09-13T06:43:40.009 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00024834199999999997 2024-09-13T06:43:40.009 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.009 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.009 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:40.009 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.377708+0000", 2024-09-13T06:43:40.009 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00037817100000000001 2024-09-13T06:43:40.009 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:40.009 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:40.009 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:40.009 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.009 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.009 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:37851 3.9 3:951cb95b:::rbd_data.1121d8143c6e.0000000000000002:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e56)", 2024-09-13T06:43:40.009 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:06.382636+0000", 2024-09-13T06:43:40.010 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 213.604311311, 2024-09-13T06:43:40.010 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.99582539400000003, 2024-09-13T06:43:40.010 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:40.010 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:40.010 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:40.010 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:40.010 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:40.010 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 37851 2024-09-13T06:43:40.010 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.010 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:40.010 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.010 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:40.010 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.382636+0000", 2024-09-13T06:43:40.011 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:40.011 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.011 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.011 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:40.011 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.382636+0000", 2024-09-13T06:43:40.011 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:40.011 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.011 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.011 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:40.011 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.382633+0000", 2024-09-13T06:43:40.011 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999971 2024-09-13T06:43:40.011 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.011 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.012 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:40.012 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.382652+0000", 2024-09-13T06:43:40.012 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8834999999999998e-05 2024-09-13T06:43:40.012 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.012 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.012 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:40.012 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.382695+0000", 2024-09-13T06:43:40.012 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.3136000000000002e-05 2024-09-13T06:43:40.012 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.012 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.012 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:40.012 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.382716+0000", 2024-09-13T06:43:40.012 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1421e-05 2024-09-13T06:43:40.013 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.013 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.013 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:40.013 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.382860+0000", 2024-09-13T06:43:40.013 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00014389200000000001 2024-09-13T06:43:40.013 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.013 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.013 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:43:40.013 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.382890+0000", 2024-09-13T06:43:40.013 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9827000000000001e-05 2024-09-13T06:43:40.013 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.013 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.013 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:40.014 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.377779+0000", 2024-09-13T06:43:40.014 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.99488842899999996 2024-09-13T06:43:40.014 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.014 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.014 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:40.014 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.378007+0000", 2024-09-13T06:43:40.014 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00022838099999999999 2024-09-13T06:43:40.014 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.014 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.014 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:40.015 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.378462+0000", 2024-09-13T06:43:40.015 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00045452300000000003 2024-09-13T06:43:40.015 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:40.015 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:40.015 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:40.015 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.015 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.015 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:37866 3.9 3:951cb95b:::rbd_data.1121d8143c6e.0000000000000002:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e56)", 2024-09-13T06:43:40.015 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:06.383951+0000", 2024-09-13T06:43:40.015 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 213.602996625, 2024-09-13T06:43:40.015 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.99517962299999996, 2024-09-13T06:43:40.015 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:40.015 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:40.016 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:40.016 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:40.016 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:40.016 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 37866 2024-09-13T06:43:40.016 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.016 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:40.016 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.016 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:40.016 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.383951+0000", 2024-09-13T06:43:40.016 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:40.016 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.016 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.017 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:40.017 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.383951+0000", 2024-09-13T06:43:40.017 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:40.017 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.017 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.017 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:40.017 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.383949+0000", 2024-09-13T06:43:40.017 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999981 2024-09-13T06:43:40.017 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.017 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.017 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:40.017 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.383961+0000", 2024-09-13T06:43:40.017 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1999e-05 2024-09-13T06:43:40.017 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.018 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.018 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:40.018 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384019+0000", 2024-09-13T06:43:40.018 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7621000000000003e-05 2024-09-13T06:43:40.018 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.018 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.018 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:40.018 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384040+0000", 2024-09-13T06:43:40.018 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1528000000000001e-05 2024-09-13T06:43:40.018 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.018 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.018 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:40.018 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384186+0000", 2024-09-13T06:43:40.018 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00014573799999999999 2024-09-13T06:43:40.019 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.019 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.019 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:43:40.019 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384204+0000", 2024-09-13T06:43:40.019 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7992e-05 2024-09-13T06:43:40.019 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.019 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.019 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:40.019 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.378536+0000", 2024-09-13T06:43:40.019 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.99433268600000002 2024-09-13T06:43:40.019 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.019 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.019 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:40.019 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.378771+0000", 2024-09-13T06:43:40.020 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00023445399999999999 2024-09-13T06:43:40.020 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.020 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.020 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:40.020 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.379130+0000", 2024-09-13T06:43:40.020 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00035954200000000002 2024-09-13T06:43:40.020 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:40.020 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:40.020 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:40.020 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.020 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.020 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:37881 3.9 3:951cb95b:::rbd_data.1121d8143c6e.0000000000000002:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e56)", 2024-09-13T06:43:40.020 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:06.384239+0000", 2024-09-13T06:43:40.021 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 213.60270821099999, 2024-09-13T06:43:40.021 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.99541483500000005, 2024-09-13T06:43:40.021 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:40.021 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:40.021 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:40.021 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:40.021 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:40.021 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 37881 2024-09-13T06:43:40.021 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.021 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:40.021 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.021 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:40.021 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384239+0000", 2024-09-13T06:43:40.022 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:40.022 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.022 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.022 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:40.022 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384239+0000", 2024-09-13T06:43:40.022 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:40.022 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.022 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.022 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:40.022 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384238+0000", 2024-09-13T06:43:40.022 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999986 2024-09-13T06:43:40.023 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.023 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.023 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:40.023 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384246+0000", 2024-09-13T06:43:40.023 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.2449999999999998e-06 2024-09-13T06:43:40.023 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.023 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.023 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:40.023 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384268+0000", 2024-09-13T06:43:40.023 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1518e-05 2024-09-13T06:43:40.024 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.024 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.024 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:40.024 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384282+0000", 2024-09-13T06:43:40.024 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4501999999999999e-05 2024-09-13T06:43:40.024 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.024 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.024 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:40.024 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384356+0000", 2024-09-13T06:43:40.024 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4265999999999997e-05 2024-09-13T06:43:40.024 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.025 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.025 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:43:40.025 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384370+0000", 2024-09-13T06:43:40.025 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3942e-05 2024-09-13T06:43:40.025 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.025 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.025 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:40.025 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.379199+0000", 2024-09-13T06:43:40.025 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.99482866599999997 2024-09-13T06:43:40.025 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.025 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.025 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:40.026 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.379347+0000", 2024-09-13T06:43:40.026 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00014749199999999999 2024-09-13T06:43:40.026 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.026 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.026 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:40.026 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.379654+0000", 2024-09-13T06:43:40.026 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00030752999999999998 2024-09-13T06:43:40.026 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:40.026 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:40.026 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:40.026 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.026 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.027 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:37896 3.9 3:951cb95b:::rbd_data.1121d8143c6e.0000000000000002:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e56)", 2024-09-13T06:43:40.027 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:06.384412+0000", 2024-09-13T06:43:40.027 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 213.602535778, 2024-09-13T06:43:40.027 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.99777835999999998, 2024-09-13T06:43:40.027 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:40.027 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:40.027 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:40.027 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:40.027 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:40.027 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 37896 2024-09-13T06:43:40.027 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.027 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:40.027 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.027 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:40.028 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384412+0000", 2024-09-13T06:43:40.028 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:40.028 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.028 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.028 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:40.028 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384412+0000", 2024-09-13T06:43:40.028 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:40.028 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.028 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.028 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:40.028 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384410+0000", 2024-09-13T06:43:40.028 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.999999 2024-09-13T06:43:40.028 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.028 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.029 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:40.029 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384418+0000", 2024-09-13T06:43:40.029 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.486e-06 2024-09-13T06:43:40.029 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.029 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.029 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:40.029 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384436+0000", 2024-09-13T06:43:40.029 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7668000000000001e-05 2024-09-13T06:43:40.029 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.029 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.029 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:40.029 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384449+0000", 2024-09-13T06:43:40.029 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3395e-05 2024-09-13T06:43:40.030 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.030 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.030 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:40.030 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384605+0000", 2024-09-13T06:43:40.030 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00015563099999999999 2024-09-13T06:43:40.030 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.030 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.030 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:43:40.030 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384635+0000", 2024-09-13T06:43:40.030 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.0383999999999999e-05 2024-09-13T06:43:40.030 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.030 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.031 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:40.031 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.379730+0000", 2024-09-13T06:43:40.031 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.99509493999999998 2024-09-13T06:43:40.031 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.031 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.031 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:40.031 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.379964+0000", 2024-09-13T06:43:40.031 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00023353499999999999 2024-09-13T06:43:40.031 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.031 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.031 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:40.032 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.382190+0000", 2024-09-13T06:43:40.032 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0022265039999999998 2024-09-13T06:43:40.032 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:40.032 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:40.032 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:40.032 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.032 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.032 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43223 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 393216~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:43:40.032 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558267+0000", 2024-09-13T06:43:40.032 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 198.42868046699999, 2024-09-13T06:43:40.032 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.062813151999999997, 2024-09-13T06:43:40.032 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:40.032 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:40.033 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:40.033 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:40.033 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:40.033 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43223 2024-09-13T06:43:40.033 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.033 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:40.033 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.033 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:40.033 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558267+0000", 2024-09-13T06:43:40.033 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:40.033 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.034 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.034 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:40.034 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558267+0000", 2024-09-13T06:43:40.034 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:40.034 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.034 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.034 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:40.034 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558266+0000", 2024-09-13T06:43:40.034 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:40.034 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.034 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.034 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:40.035 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558270+0000", 2024-09-13T06:43:40.035 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.2389999999999998e-06 2024-09-13T06:43:40.035 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.035 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.035 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:40.035 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558277+0000", 2024-09-13T06:43:40.035 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5680000000000002e-06 2024-09-13T06:43:40.035 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.035 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.035 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:40.035 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558282+0000", 2024-09-13T06:43:40.036 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7060000000000003e-06 2024-09-13T06:43:40.036 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.036 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.036 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:40.036 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.620731+0000", 2024-09-13T06:43:40.036 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.062448661000000003 2024-09-13T06:43:40.036 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.036 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.036 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:40.037 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.620806+0000", 2024-09-13T06:43:40.037 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5862e-05 2024-09-13T06:43:40.037 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.037 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.037 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:40.037 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.621080+0000", 2024-09-13T06:43:40.037 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00027368599999999998 2024-09-13T06:43:40.037 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:40.037 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:40.037 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:40.037 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.037 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.038 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43224 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 407552~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:43:40.038 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558286+0000", 2024-09-13T06:43:40.038 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 198.428661103, 2024-09-13T06:43:40.038 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.063179052999999999, 2024-09-13T06:43:40.038 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:40.038 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:40.038 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:40.038 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:40.038 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:40.038 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43224 2024-09-13T06:43:40.038 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.038 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:40.039 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.039 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:40.039 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558286+0000", 2024-09-13T06:43:40.039 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:40.039 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.039 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.039 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:40.039 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558286+0000", 2024-09-13T06:43:40.039 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:40.039 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.039 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.039 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:40.040 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558286+0000", 2024-09-13T06:43:40.040 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:40.040 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.040 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.040 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:40.040 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558288+0000", 2024-09-13T06:43:40.040 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.227e-06 2024-09-13T06:43:40.040 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.040 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.040 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:40.040 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558292+0000", 2024-09-13T06:43:40.040 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.6289999999999999e-06 2024-09-13T06:43:40.040 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.041 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.041 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:40.041 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558294+0000", 2024-09-13T06:43:40.041 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5409999999999999e-06 2024-09-13T06:43:40.041 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.041 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.041 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:40.041 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.621110+0000", 2024-09-13T06:43:40.041 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.062815776000000004 2024-09-13T06:43:40.041 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.041 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.042 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:40.042 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.621186+0000", 2024-09-13T06:43:40.042 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5570999999999999e-05 2024-09-13T06:43:40.042 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.042 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.042 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:40.042 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.621465+0000", 2024-09-13T06:43:40.042 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00027988200000000001 2024-09-13T06:43:40.042 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:40.042 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:40.042 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:40.042 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.042 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.043 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43225 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 421888~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:43:40.043 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558296+0000", 2024-09-13T06:43:40.043 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 198.42865113600001, 2024-09-13T06:43:40.043 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.063551110999999993, 2024-09-13T06:43:40.043 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:40.043 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:40.043 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:40.043 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:40.043 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:40.043 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43225 2024-09-13T06:43:40.043 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.043 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:40.043 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.044 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:40.044 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558296+0000", 2024-09-13T06:43:40.044 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:40.044 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.044 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.044 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:40.044 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558296+0000", 2024-09-13T06:43:40.044 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:40.044 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.044 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.044 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:40.044 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558296+0000", 2024-09-13T06:43:40.044 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:43:40.045 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.045 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.045 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:40.045 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558305+0000", 2024-09-13T06:43:40.045 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.5290000000000008e-06 2024-09-13T06:43:40.045 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.045 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.045 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:40.045 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558308+0000", 2024-09-13T06:43:40.045 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.5619999999999999e-06 2024-09-13T06:43:40.045 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.045 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.045 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:40.046 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558311+0000", 2024-09-13T06:43:40.046 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.43e-06 2024-09-13T06:43:40.046 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.046 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.046 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:40.046 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.621495+0000", 2024-09-13T06:43:40.046 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.063184289000000005 2024-09-13T06:43:40.046 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.046 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.046 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:40.046 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.621569+0000", 2024-09-13T06:43:40.046 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4250000000000002e-05 2024-09-13T06:43:40.046 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.047 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.047 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:40.047 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.621847+0000", 2024-09-13T06:43:40.047 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00027826400000000002 2024-09-13T06:43:40.047 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:40.047 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:40.047 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:40.047 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.047 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.047 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43226 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 436224~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:43:40.047 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558313+0000", 2024-09-13T06:43:40.047 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 198.42863449999999, 2024-09-13T06:43:40.047 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.063914420999999999, 2024-09-13T06:43:40.048 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:40.048 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:40.048 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:40.048 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:40.048 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:40.048 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43226 2024-09-13T06:43:40.048 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.048 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:40.048 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.048 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:40.048 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558313+0000", 2024-09-13T06:43:40.048 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:40.048 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.049 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.049 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:40.049 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558313+0000", 2024-09-13T06:43:40.049 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:40.049 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.049 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.049 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:40.049 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558313+0000", 2024-09-13T06:43:40.049 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:40.049 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.049 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.049 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:40.050 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558314+0000", 2024-09-13T06:43:40.050 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3740000000000001e-06 2024-09-13T06:43:40.050 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.050 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.050 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:40.050 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558317+0000", 2024-09-13T06:43:40.050 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9730000000000002e-06 2024-09-13T06:43:40.050 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.050 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.050 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:40.050 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558319+0000", 2024-09-13T06:43:40.050 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4059999999999999e-06 2024-09-13T06:43:40.050 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.051 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.051 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:40.051 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.621877+0000", 2024-09-13T06:43:40.051 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.063557408999999995 2024-09-13T06:43:40.051 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.051 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.051 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:40.051 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.621951+0000", 2024-09-13T06:43:40.051 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4487999999999996e-05 2024-09-13T06:43:40.051 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.051 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.051 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:40.051 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.622227+0000", 2024-09-13T06:43:40.052 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000276011 2024-09-13T06:43:40.052 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:40.052 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:40.052 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:40.052 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.052 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.052 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43227 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 450560~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:43:40.052 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558322+0000", 2024-09-13T06:43:40.052 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 198.42862591900001, 2024-09-13T06:43:40.052 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.064285348000000006, 2024-09-13T06:43:40.052 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:40.052 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:40.052 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:40.053 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:40.053 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:40.053 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43227 2024-09-13T06:43:40.053 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.053 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:40.053 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.053 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:40.053 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558322+0000", 2024-09-13T06:43:40.053 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:40.053 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.053 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.053 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:40.054 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558322+0000", 2024-09-13T06:43:40.054 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:40.054 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.054 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.054 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:40.054 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558321+0000", 2024-09-13T06:43:40.054 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:43:40.054 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.054 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.054 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:40.054 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558323+0000", 2024-09-13T06:43:40.054 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.576e-06 2024-09-13T06:43:40.054 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.055 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.055 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:40.055 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558328+0000", 2024-09-13T06:43:40.055 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0719999999999999e-06 2024-09-13T06:43:40.055 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.055 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.055 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:40.055 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558332+0000", 2024-09-13T06:43:40.055 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.8130000000000002e-06 2024-09-13T06:43:40.055 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.055 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.055 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:40.055 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.622255+0000", 2024-09-13T06:43:40.055 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.063923195000000002 2024-09-13T06:43:40.056 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.056 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.056 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:40.056 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.622330+0000", 2024-09-13T06:43:40.056 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5383000000000007e-05 2024-09-13T06:43:40.056 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.056 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.056 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:40.056 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.622607+0000", 2024-09-13T06:43:40.056 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00027651999999999999 2024-09-13T06:43:40.056 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:40.056 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:40.056 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:40.057 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.057 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.057 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43228 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 464896~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:43:40.057 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558335+0000", 2024-09-13T06:43:40.057 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 198.42861200999999, 2024-09-13T06:43:40.057 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.064652253000000007, 2024-09-13T06:43:40.057 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:40.057 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:40.057 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:40.057 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:40.057 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:40.057 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43228 2024-09-13T06:43:40.058 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.058 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:40.058 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.058 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:40.058 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558335+0000", 2024-09-13T06:43:40.058 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:40.058 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.058 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.058 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:40.058 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558335+0000", 2024-09-13T06:43:40.058 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:40.058 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.058 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.058 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:40.058 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558335+0000", 2024-09-13T06:43:40.059 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:40.059 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.059 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.059 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:40.059 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558337+0000", 2024-09-13T06:43:40.059 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1380000000000001e-06 2024-09-13T06:43:40.059 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.059 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.059 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:40.059 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558343+0000", 2024-09-13T06:43:40.059 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.5140000000000001e-06 2024-09-13T06:43:40.059 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.059 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.059 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:40.060 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558348+0000", 2024-09-13T06:43:40.060 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9640000000000002e-06 2024-09-13T06:43:40.060 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.060 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.060 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:40.060 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.622636+0000", 2024-09-13T06:43:40.060 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.064288260999999999 2024-09-13T06:43:40.060 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.060 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.060 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:40.060 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.622715+0000", 2024-09-13T06:43:40.060 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.9351000000000006e-05 2024-09-13T06:43:40.060 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.060 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.061 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:40.061 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.622988+0000", 2024-09-13T06:43:40.061 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00027242599999999998 2024-09-13T06:43:40.061 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:40.061 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:40.061 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:40.061 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.061 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.061 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43229 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 479232~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:43:40.061 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558352+0000", 2024-09-13T06:43:40.061 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 198.42859559499999, 2024-09-13T06:43:40.061 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.065018024999999993, 2024-09-13T06:43:40.061 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:40.061 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:40.062 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:40.062 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:40.062 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:40.062 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43229 2024-09-13T06:43:40.062 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.062 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:40.062 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.062 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:40.062 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558352+0000", 2024-09-13T06:43:40.062 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:40.062 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.062 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.062 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:40.062 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558352+0000", 2024-09-13T06:43:40.063 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:40.063 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.063 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.063 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:40.063 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558352+0000", 2024-09-13T06:43:40.063 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:40.063 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.063 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.063 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:40.063 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558354+0000", 2024-09-13T06:43:40.063 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4930000000000001e-06 2024-09-13T06:43:40.063 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.063 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.063 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:40.064 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558360+0000", 2024-09-13T06:43:40.064 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.263e-06 2024-09-13T06:43:40.064 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.064 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.064 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:40.064 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558369+0000", 2024-09-13T06:43:40.064 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.0829999999999993e-06 2024-09-13T06:43:40.064 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.064 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.064 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:40.064 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.623017+0000", 2024-09-13T06:43:40.064 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.064647799000000006 2024-09-13T06:43:40.064 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.065 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.065 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:40.065 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.623090+0000", 2024-09-13T06:43:40.065 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3071000000000006e-05 2024-09-13T06:43:40.065 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.065 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.065 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:40.065 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.623370+0000", 2024-09-13T06:43:40.065 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000279661 2024-09-13T06:43:40.065 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:40.065 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:40.065 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:40.065 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.065 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.066 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43230 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 493568~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:43:40.066 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558374+0000", 2024-09-13T06:43:40.066 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 198.42857330199999, 2024-09-13T06:43:40.066 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.065410435000000003, 2024-09-13T06:43:40.066 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:40.066 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:40.066 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:40.066 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:40.066 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:40.066 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43230 2024-09-13T06:43:40.066 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.066 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:40.067 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.067 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:40.067 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558374+0000", 2024-09-13T06:43:40.067 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:40.067 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.067 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.067 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:40.067 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558374+0000", 2024-09-13T06:43:40.067 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:40.067 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.067 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.067 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:40.067 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558374+0000", 2024-09-13T06:43:40.067 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:40.068 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.068 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.068 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:40.068 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558376+0000", 2024-09-13T06:43:40.068 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4430000000000002e-06 2024-09-13T06:43:40.068 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.068 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.068 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:40.068 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558382+0000", 2024-09-13T06:43:40.068 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3029999999999996e-06 2024-09-13T06:43:40.068 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.068 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.068 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:40.068 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558387+0000", 2024-09-13T06:43:40.069 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.1699999999999999e-06 2024-09-13T06:43:40.069 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.069 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.069 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:40.069 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.623400+0000", 2024-09-13T06:43:40.069 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.065013244999999997 2024-09-13T06:43:40.069 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.069 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.069 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:40.069 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.623474+0000", 2024-09-13T06:43:40.069 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3889999999999999e-05 2024-09-13T06:43:40.069 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.069 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.069 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:40.070 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.623785+0000", 2024-09-13T06:43:40.070 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00031080099999999998 2024-09-13T06:43:40.070 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:40.070 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:40.070 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:40.070 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.070 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.070 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43231 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 507904~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:43:40.070 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558391+0000", 2024-09-13T06:43:40.070 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 198.428556617, 2024-09-13T06:43:40.070 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.065788597000000004, 2024-09-13T06:43:40.070 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:40.070 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:40.070 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:40.071 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:40.071 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:40.071 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43231 2024-09-13T06:43:40.071 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.071 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:40.071 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.071 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:40.071 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558391+0000", 2024-09-13T06:43:40.071 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:40.071 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.071 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.071 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:40.071 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558391+0000", 2024-09-13T06:43:40.071 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:40.072 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.072 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.072 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:40.072 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558390+0000", 2024-09-13T06:43:40.072 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:40.072 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.072 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.072 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:40.072 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558393+0000", 2024-09-13T06:43:40.072 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2570000000000002e-06 2024-09-13T06:43:40.072 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.072 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.072 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:40.072 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558399+0000", 2024-09-13T06:43:40.073 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0419999999999999e-06 2024-09-13T06:43:40.073 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.073 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.073 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:40.073 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558403+0000", 2024-09-13T06:43:40.073 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6249999999999998e-06 2024-09-13T06:43:40.073 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.073 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.073 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:40.073 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.623811+0000", 2024-09-13T06:43:40.073 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.065407549999999995 2024-09-13T06:43:40.073 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.073 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.073 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:40.074 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.623877+0000", 2024-09-13T06:43:40.074 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.5902999999999996e-05 2024-09-13T06:43:40.074 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.074 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.074 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:40.074 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.624179+0000", 2024-09-13T06:43:40.074 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00030259999999999998 2024-09-13T06:43:40.074 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:40.074 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:40.074 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:40.074 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.074 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.074 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43232 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 522240~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:43:40.075 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558422+0000", 2024-09-13T06:43:40.075 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 198.42852583999999, 2024-09-13T06:43:40.075 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.066176061999999994, 2024-09-13T06:43:40.075 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:40.075 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:40.075 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:40.075 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:40.075 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:40.075 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43232 2024-09-13T06:43:40.075 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.075 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:40.075 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.075 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:40.075 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558422+0000", 2024-09-13T06:43:40.075 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:40.076 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.076 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.076 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:40.076 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558422+0000", 2024-09-13T06:43:40.076 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:40.076 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.076 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.076 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:40.076 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558421+0000", 2024-09-13T06:43:40.076 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:40.076 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.077 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.077 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:40.077 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558428+0000", 2024-09-13T06:43:40.077 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.1690000000000003e-06 2024-09-13T06:43:40.077 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.077 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.077 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:40.077 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558434+0000", 2024-09-13T06:43:40.077 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9309999999999996e-06 2024-09-13T06:43:40.077 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.077 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.077 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:40.078 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558447+0000", 2024-09-13T06:43:40.078 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.271e-05 2024-09-13T06:43:40.078 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.078 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.078 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:40.078 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.624209+0000", 2024-09-13T06:43:40.078 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.065762102000000003 2024-09-13T06:43:40.078 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.078 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.078 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:40.078 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.624282+0000", 2024-09-13T06:43:40.078 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.2889e-05 2024-09-13T06:43:40.079 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.079 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.079 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:40.079 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.624598+0000", 2024-09-13T06:43:40.079 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00031591399999999998 2024-09-13T06:43:40.079 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:40.079 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:40.079 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:40.079 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.079 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.079 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43486 3.f 3:f7da9c8f:::rbd_data.1121f5f2e1c0.000000000000000b:1f [read 260096~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:43:40.079 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.569088+0000", 2024-09-13T06:43:40.079 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 198.41785911700001, 2024-09-13T06:43:40.079 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.062579223000000003, 2024-09-13T06:43:40.080 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:40.080 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:40.080 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:40.080 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:40.080 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:40.080 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43486 2024-09-13T06:43:40.080 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.080 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:40.080 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.080 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:40.080 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.569088+0000", 2024-09-13T06:43:40.080 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:40.081 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.081 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.081 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:40.081 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.569088+0000", 2024-09-13T06:43:40.081 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:40.081 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.081 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.081 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:40.081 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.569088+0000", 2024-09-13T06:43:40.081 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:40.081 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.081 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.082 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:40.082 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.569091+0000", 2024-09-13T06:43:40.082 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9629999999999998e-06 2024-09-13T06:43:40.082 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.082 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.082 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:40.082 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.569097+0000", 2024-09-13T06:43:40.082 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.4160000000000001e-06 2024-09-13T06:43:40.082 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.082 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.082 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:40.083 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.569102+0000", 2024-09-13T06:43:40.083 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6659999999999999e-06 2024-09-13T06:43:40.083 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.083 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.083 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:40.083 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.631346+0000", 2024-09-13T06:43:40.083 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.062243896 2024-09-13T06:43:40.083 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.083 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.083 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:40.083 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.631413+0000", 2024-09-13T06:43:40.084 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.7638000000000005e-05 2024-09-13T06:43:40.084 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.084 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.084 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:40.084 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.631668+0000", 2024-09-13T06:43:40.084 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0002541 2024-09-13T06:43:40.084 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:40.084 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:40.084 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:40.084 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.084 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.084 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:170125 3.9 3:94e4bf8d:::rbd_object_map.1121fa0cc8a3.000000000000006d:head [writefull 0~37] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e190)", 2024-09-13T06:43:40.085 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:42:30.601501+0000", 2024-09-13T06:43:40.085 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 69.385446905999999, 2024-09-13T06:43:40.085 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.80498820000000004, 2024-09-13T06:43:40.085 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:40.085 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:43:40.085 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:40.085 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:40.085 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:40.085 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 170125 2024-09-13T06:43:40.085 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.085 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:40.085 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.086 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:40.086 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:30.601501+0000", 2024-09-13T06:43:40.086 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:40.086 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.086 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.086 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:40.086 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:30.601501+0000", 2024-09-13T06:43:40.086 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:40.086 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.086 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.086 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:40.086 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:30.601499+0000", 2024-09-13T06:43:40.086 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999986 2024-09-13T06:43:40.086 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.087 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.087 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:40.087 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:30.601506+0000", 2024-09-13T06:43:40.087 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.9940000000000003e-06 2024-09-13T06:43:40.087 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.087 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.087 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:40.087 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:30.601519+0000", 2024-09-13T06:43:40.087 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2875e-05 2024-09-13T06:43:40.087 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.087 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.087 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:40.087 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:30.601525+0000", 2024-09-13T06:43:40.088 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8549999999999998e-06 2024-09-13T06:43:40.088 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.088 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.088 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:40.088 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:30.601560+0000", 2024-09-13T06:43:40.088 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.5271000000000002e-05 2024-09-13T06:43:40.088 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.088 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.088 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:43:40.088 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:30.601566+0000", 2024-09-13T06:43:40.088 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3090000000000001e-06 2024-09-13T06:43:40.088 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.088 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.089 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:40.089 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:31.403017+0000", 2024-09-13T06:43:40.089 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.80145064200000005 2024-09-13T06:43:40.089 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.089 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.089 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:40.089 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:31.403252+0000", 2024-09-13T06:43:40.089 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000234718 2024-09-13T06:43:40.089 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.089 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.089 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 7", 2024-09-13T06:43:40.089 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:31.403521+0000", 2024-09-13T06:43:40.089 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00026917 2024-09-13T06:43:40.089 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.090 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.090 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-09-13T06:43:40.090 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:31.404918+0000", 2024-09-13T06:43:40.090 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.001397017 2024-09-13T06:43:40.090 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.090 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.090 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:43:40.090 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:31.406176+0000", 2024-09-13T06:43:40.090 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.001257998 2024-09-13T06:43:40.090 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.090 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.090 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:43:40.090 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:31.406334+0000", 2024-09-13T06:43:40.090 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00015819099999999999 2024-09-13T06:43:40.090 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.091 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.091 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:40.091 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:31.406489+0000", 2024-09-13T06:43:40.091 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00015476699999999999 2024-09-13T06:43:40.091 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:40.091 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:40.091 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:40.091 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:40.091 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:40.091 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:43:40.092 INFO:teuthology.orchestra.run.smithi081.stdout:osd.3: {} 2024-09-13T06:43:40.092 INFO:teuthology.orchestra.run.smithi081.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-13T06:43:40.093 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-13T06:43:40.094 INFO:teuthology.orchestra.run.smithi081.stdout:osd.4: {} 2024-09-13T06:43:40.094 INFO:teuthology.orchestra.run.smithi081.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-13T06:43:40.094 INFO:teuthology.orchestra.run.smithi081.stdout:osd.5: {} 2024-09-13T06:43:40.095 INFO:teuthology.orchestra.run.smithi081.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-13T06:43:40.095 INFO:teuthology.orchestra.run.smithi081.stderr:Error ENXIO: problem getting command descriptions from osd.6 2024-09-13T06:43:40.095 INFO:teuthology.orchestra.run.smithi081.stdout:osd.7: {} 2024-09-13T06:43:40.096 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-13T06:43:40.096 INFO:teuthology.orchestra.run.smithi081.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-13T06:43:40.096 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-13T06:43:40.097 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:43:40.093+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:43:40.194 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-13T06:43:40.193+0000 7fa8bb18e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 36790) UID: 0 2024-09-13T06:43:40.255 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:43:40.255 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-13T06:43:40.256 INFO:teuthology.orchestra.run.smithi081.stdout: "num_ops": 0 2024-09-13T06:43:40.256 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:43:40.268 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-13T06:43:40.294 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:43:40.293+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:43:40.390 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:43:40.390 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-13T06:43:40.390 INFO:teuthology.orchestra.run.smithi081.stdout: "complaint_time": 30, 2024-09-13T06:43:40.390 INFO:teuthology.orchestra.run.smithi081.stdout: "num_blocked_ops": 0 2024-09-13T06:43:40.390 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:43:40.394 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:43:40.395+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:43:40.404 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-13T06:43:40.437 INFO:teuthology.orchestra.run.smithi081.stderr:set 3.9 pg_upmap mapping to [2,6] 2024-09-13T06:43:40.459 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-13T06:43:40.495 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-13T06:43:40.497+0000 7fa8bb18e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 36790) UID: 0 2024-09-13T06:43:40.560 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:43:40.560 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 20, 2024-09-13T06:43:40.560 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 600, 2024-09-13T06:43:40.560 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [ 2024-09-13T06:43:40.561 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.561 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:2226 3.15 3:af026987:::rbd_data.112173e2f1b7.0000000000000017:head [sparse-read 0~4194304] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-13T06:43:40.561 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:37.606562+0000", 2024-09-13T06:43:40.561 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 242.95428132000001, 2024-09-13T06:43:40.561 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.83322091700000001, 2024-09-13T06:43:40.561 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:40.561 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:43:40.561 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:40.561 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:40.561 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:40.561 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 2226 2024-09-13T06:43:40.561 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.561 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:40.562 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.562 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:40.562 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606562+0000", 2024-09-13T06:43:40.562 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:40.562 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.562 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.562 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:40.562 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606562+0000", 2024-09-13T06:43:40.562 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:40.562 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.562 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.562 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:40.562 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606561+0000", 2024-09-13T06:43:40.563 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:40.563 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.563 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.563 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:40.563 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606565+0000", 2024-09-13T06:43:40.563 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.4379999999999999e-06 2024-09-13T06:43:40.563 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.563 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.563 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:40.563 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606569+0000", 2024-09-13T06:43:40.563 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.425e-06 2024-09-13T06:43:40.563 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.563 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.564 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:40.564 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606572+0000", 2024-09-13T06:43:40.564 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.05e-06 2024-09-13T06:43:40.564 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.564 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.564 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:40.564 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606621+0000", 2024-09-13T06:43:40.564 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.8723000000000001e-05 2024-09-13T06:43:40.564 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.564 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.564 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:43:40.564 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606630+0000", 2024-09-13T06:43:40.564 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.8040000000000007e-06 2024-09-13T06:43:40.565 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.565 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.565 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:40.565 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.439648+0000", 2024-09-13T06:43:40.565 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.83301824800000002 2024-09-13T06:43:40.565 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.565 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.565 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:40.565 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.439782+0000", 2024-09-13T06:43:40.565 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00013466699999999999 2024-09-13T06:43:40.565 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:40.565 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:40.565 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:40.566 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.566 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.566 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25661 3.8 3:1180686c:::rbd_data.1121f2c5ee81.0000000000000009:13 [read 397312~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:43:40.566 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.436956+0000", 2024-09-13T06:43:40.566 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 224.12388678600001, 2024-09-13T06:43:40.566 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089036758999999993, 2024-09-13T06:43:40.566 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:40.566 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:40.566 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:40.566 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:40.566 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:40.566 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25661 2024-09-13T06:43:40.566 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.567 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:40.567 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.567 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:40.567 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436956+0000", 2024-09-13T06:43:40.567 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:40.567 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.567 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.567 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:40.567 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436956+0000", 2024-09-13T06:43:40.567 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:40.567 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.567 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.567 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:40.568 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436956+0000", 2024-09-13T06:43:40.568 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:40.568 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.568 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.568 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:40.568 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436958+0000", 2024-09-13T06:43:40.568 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1770000000000001e-06 2024-09-13T06:43:40.568 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.568 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.568 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:40.568 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436963+0000", 2024-09-13T06:43:40.568 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.6489999999999996e-06 2024-09-13T06:43:40.568 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.569 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.569 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:40.569 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436975+0000", 2024-09-13T06:43:40.569 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1783999999999999e-05 2024-09-13T06:43:40.569 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.569 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.569 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:40.569 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.525671+0000", 2024-09-13T06:43:40.569 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.088696292999999995 2024-09-13T06:43:40.569 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.569 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.569 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:40.569 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.525749+0000", 2024-09-13T06:43:40.570 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.7589000000000005e-05 2024-09-13T06:43:40.570 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.570 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.570 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:40.570 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.525993+0000", 2024-09-13T06:43:40.570 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00024381000000000001 2024-09-13T06:43:40.570 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:40.570 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:40.570 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:40.570 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.570 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.570 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25662 3.8 3:1180686c:::rbd_data.1121f2c5ee81.0000000000000009:13 [read 421888~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:43:40.570 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.436980+0000", 2024-09-13T06:43:40.571 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 224.12386247399999, 2024-09-13T06:43:40.571 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089367577000000004, 2024-09-13T06:43:40.571 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:40.571 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:40.571 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:40.571 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:40.571 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:40.571 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25662 2024-09-13T06:43:40.571 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.571 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:40.571 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.571 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:40.571 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436980+0000", 2024-09-13T06:43:40.572 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:40.572 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.572 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.572 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:40.572 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436980+0000", 2024-09-13T06:43:40.572 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:40.572 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.572 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.572 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:40.572 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436980+0000", 2024-09-13T06:43:40.572 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:40.572 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.573 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.573 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:40.573 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436982+0000", 2024-09-13T06:43:40.573 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3989999999999998e-06 2024-09-13T06:43:40.573 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.573 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.573 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:40.573 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436988+0000", 2024-09-13T06:43:40.573 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0039999999999996e-06 2024-09-13T06:43:40.573 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.573 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.573 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:40.573 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436993+0000", 2024-09-13T06:43:40.574 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6090000000000003e-06 2024-09-13T06:43:40.574 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.574 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.574 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:40.574 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.526035+0000", 2024-09-13T06:43:40.574 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089042248000000004 2024-09-13T06:43:40.574 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.574 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.574 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:40.574 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.526111+0000", 2024-09-13T06:43:40.574 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5643999999999996e-05 2024-09-13T06:43:40.574 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.574 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.574 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:40.575 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.526348+0000", 2024-09-13T06:43:40.575 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00023705800000000001 2024-09-13T06:43:40.575 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:40.575 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:40.575 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:40.575 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.575 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.575 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25663 3.8 3:1180686c:::rbd_data.1121f2c5ee81.0000000000000009:13 [read 466944~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:43:40.575 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.436998+0000", 2024-09-13T06:43:40.575 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 224.123844827, 2024-09-13T06:43:40.575 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089730867000000006, 2024-09-13T06:43:40.575 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:40.575 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:40.576 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:40.576 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:40.576 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:40.576 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25663 2024-09-13T06:43:40.576 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.576 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:40.576 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.576 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:40.576 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436998+0000", 2024-09-13T06:43:40.576 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:40.576 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.576 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.576 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:40.577 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436998+0000", 2024-09-13T06:43:40.577 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:40.577 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.577 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.577 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:40.577 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436998+0000", 2024-09-13T06:43:40.577 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:40.577 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.577 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.577 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:40.577 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437000+0000", 2024-09-13T06:43:40.577 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0940000000000002e-06 2024-09-13T06:43:40.577 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.578 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.578 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:40.578 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437005+0000", 2024-09-13T06:43:40.578 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.604e-06 2024-09-13T06:43:40.578 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.578 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.578 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:40.578 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437032+0000", 2024-09-13T06:43:40.578 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6407e-05 2024-09-13T06:43:40.578 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.578 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.578 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:40.578 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.526363+0000", 2024-09-13T06:43:40.578 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089331456000000004 2024-09-13T06:43:40.579 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.579 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.579 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:40.579 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.526404+0000", 2024-09-13T06:43:40.579 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.0887999999999999e-05 2024-09-13T06:43:40.579 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.579 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.579 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:40.579 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.526729+0000", 2024-09-13T06:43:40.579 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00032486 2024-09-13T06:43:40.579 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:40.579 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:40.580 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:40.580 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.580 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.580 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25664 3.8 3:1180686c:::rbd_data.1121f2c5ee81.0000000000000009:13 [read 491520~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:43:40.580 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.437040+0000", 2024-09-13T06:43:40.580 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 224.123802912, 2024-09-13T06:43:40.580 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.090016650000000004, 2024-09-13T06:43:40.580 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:40.580 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:40.580 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:40.580 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:40.580 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:40.580 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25664 2024-09-13T06:43:40.580 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.581 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:40.581 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.581 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:40.581 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437040+0000", 2024-09-13T06:43:40.581 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:40.581 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.581 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.581 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:40.581 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437040+0000", 2024-09-13T06:43:40.581 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:40.581 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.581 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.582 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:40.582 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437039+0000", 2024-09-13T06:43:40.582 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:40.582 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.582 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.582 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:40.582 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437047+0000", 2024-09-13T06:43:40.582 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4839999999999998e-06 2024-09-13T06:43:40.582 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.582 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.582 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:40.582 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437054+0000", 2024-09-13T06:43:40.582 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.8299999999999998e-06 2024-09-13T06:43:40.583 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.583 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.583 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:40.583 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437060+0000", 2024-09-13T06:43:40.583 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.1510000000000001e-06 2024-09-13T06:43:40.583 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.583 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.583 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:40.583 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.526772+0000", 2024-09-13T06:43:40.583 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089711737999999999 2024-09-13T06:43:40.583 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.583 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.584 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:40.584 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.526848+0000", 2024-09-13T06:43:40.584 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5870000000000004e-05 2024-09-13T06:43:40.584 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.584 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.584 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:40.584 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.527057+0000", 2024-09-13T06:43:40.584 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000209106 2024-09-13T06:43:40.584 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:40.584 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:40.584 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:40.584 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.585 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.585 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25740 3.18 3:1c662b96:::rbd_data.1121f2c5ee81.0000000000000010:13 [read 200704~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:43:40.585 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443352+0000", 2024-09-13T06:43:40.585 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 224.117491237, 2024-09-13T06:43:40.585 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089068222000000002, 2024-09-13T06:43:40.585 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:40.585 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:40.585 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:40.585 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:40.585 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:40.585 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25740 2024-09-13T06:43:40.585 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.585 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:40.585 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.586 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:40.586 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443352+0000", 2024-09-13T06:43:40.586 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:40.586 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.586 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.586 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:40.586 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443352+0000", 2024-09-13T06:43:40.586 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:40.586 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.586 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.586 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:40.586 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443351+0000", 2024-09-13T06:43:40.586 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:40.587 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.587 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.587 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:40.587 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443354+0000", 2024-09-13T06:43:40.587 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.841e-06 2024-09-13T06:43:40.587 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.587 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.587 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:40.587 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443361+0000", 2024-09-13T06:43:40.587 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.0010000000000004e-06 2024-09-13T06:43:40.587 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.587 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.587 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:40.587 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443366+0000", 2024-09-13T06:43:40.588 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7119999999999999e-06 2024-09-13T06:43:40.588 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.588 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.588 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:40.588 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532117+0000", 2024-09-13T06:43:40.588 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.088751327000000005 2024-09-13T06:43:40.588 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.588 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.588 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:40.588 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532193+0000", 2024-09-13T06:43:40.589 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5839000000000004e-05 2024-09-13T06:43:40.589 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.589 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.589 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:40.589 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532420+0000", 2024-09-13T06:43:40.589 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00022691000000000001 2024-09-13T06:43:40.589 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:40.589 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:40.589 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:40.589 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.589 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.589 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25741 3.18 3:1c662b96:::rbd_data.1121f2c5ee81.0000000000000010:13 [read 225280~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:43:40.590 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443378+0000", 2024-09-13T06:43:40.590 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 224.11746446999999, 2024-09-13T06:43:40.590 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089324107, 2024-09-13T06:43:40.590 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:40.590 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:40.590 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:40.590 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:40.590 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:40.590 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25741 2024-09-13T06:43:40.590 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.590 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:40.590 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.591 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:40.591 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443378+0000", 2024-09-13T06:43:40.591 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:40.591 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.591 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.591 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:40.591 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443378+0000", 2024-09-13T06:43:40.591 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:40.591 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.591 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.591 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:40.591 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443378+0000", 2024-09-13T06:43:40.591 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:40.591 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.592 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.592 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:40.592 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443380+0000", 2024-09-13T06:43:40.592 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3549999999999999e-06 2024-09-13T06:43:40.592 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.592 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.592 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:40.592 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443388+0000", 2024-09-13T06:43:40.592 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.7449999999999995e-06 2024-09-13T06:43:40.592 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.592 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.592 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:40.593 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443393+0000", 2024-09-13T06:43:40.593 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.4e-06 2024-09-13T06:43:40.593 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.593 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.593 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:40.593 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532454+0000", 2024-09-13T06:43:40.593 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089060941000000005 2024-09-13T06:43:40.593 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.593 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.593 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:40.593 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532512+0000", 2024-09-13T06:43:40.593 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7763000000000002e-05 2024-09-13T06:43:40.594 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.594 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.594 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:40.594 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532703+0000", 2024-09-13T06:43:40.594 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000190328 2024-09-13T06:43:40.594 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:40.594 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:40.594 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:40.594 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.594 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.594 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25742 3.18 3:1c662b96:::rbd_data.1121f2c5ee81.0000000000000010:13 [read 270336~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:43:40.594 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443398+0000", 2024-09-13T06:43:40.594 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 224.117444758, 2024-09-13T06:43:40.594 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089621836999999996, 2024-09-13T06:43:40.595 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:40.595 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:40.595 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:40.595 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:40.595 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:40.595 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25742 2024-09-13T06:43:40.595 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.595 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:40.595 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.595 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:40.595 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443398+0000", 2024-09-13T06:43:40.595 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:40.595 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.595 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.596 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:40.596 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443398+0000", 2024-09-13T06:43:40.596 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:40.596 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.596 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.596 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:40.596 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443398+0000", 2024-09-13T06:43:40.596 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:40.596 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.596 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.596 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:40.596 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443400+0000", 2024-09-13T06:43:40.597 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1849999999999998e-06 2024-09-13T06:43:40.597 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.597 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.597 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:40.597 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443407+0000", 2024-09-13T06:43:40.597 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3669999999999999e-06 2024-09-13T06:43:40.597 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.597 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.597 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:40.597 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443420+0000", 2024-09-13T06:43:40.597 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2645e-05 2024-09-13T06:43:40.597 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.597 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.598 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:40.598 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532742+0000", 2024-09-13T06:43:40.598 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089322200000000004 2024-09-13T06:43:40.598 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.598 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.598 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:40.598 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532818+0000", 2024-09-13T06:43:40.598 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.6019000000000005e-05 2024-09-13T06:43:40.598 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.598 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.598 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:40.598 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533020+0000", 2024-09-13T06:43:40.598 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000201721 2024-09-13T06:43:40.599 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:40.599 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:40.599 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:40.599 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.599 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.599 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25743 3.18 3:1c662b96:::rbd_data.1121f2c5ee81.0000000000000010:13 [read 294912~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:43:40.599 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443425+0000", 2024-09-13T06:43:40.599 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 224.11741774999999, 2024-09-13T06:43:40.599 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089864075000000002, 2024-09-13T06:43:40.599 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:40.599 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:40.599 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:40.600 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:40.600 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:40.600 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25743 2024-09-13T06:43:40.600 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.600 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:40.600 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.600 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:40.600 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443425+0000", 2024-09-13T06:43:40.600 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:40.600 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.600 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.600 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:40.600 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443425+0000", 2024-09-13T06:43:40.601 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:40.601 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.601 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.601 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:40.601 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443425+0000", 2024-09-13T06:43:40.601 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:40.601 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.601 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.601 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:40.601 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443432+0000", 2024-09-13T06:43:40.601 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3420000000000002e-06 2024-09-13T06:43:40.601 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.601 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.601 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:40.602 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443440+0000", 2024-09-13T06:43:40.602 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5689999999999999e-06 2024-09-13T06:43:40.602 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.602 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.602 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:40.602 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443445+0000", 2024-09-13T06:43:40.602 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9590000000000003e-06 2024-09-13T06:43:40.602 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.602 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.602 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:40.602 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533063+0000", 2024-09-13T06:43:40.602 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089617988999999995 2024-09-13T06:43:40.603 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.603 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.603 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:40.603 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533122+0000", 2024-09-13T06:43:40.603 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9052999999999999e-05 2024-09-13T06:43:40.603 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.603 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.603 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:40.603 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533289+0000", 2024-09-13T06:43:40.603 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00016752800000000001 2024-09-13T06:43:40.603 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:40.603 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:40.603 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:40.604 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.604 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.604 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25744 3.18 3.69d46638 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:43:40.604 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443449+0000", 2024-09-13T06:43:40.604 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 224.11739360300001, 2024-09-13T06:43:40.604 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089869148999999995, 2024-09-13T06:43:40.604 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:40.604 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:43:40.604 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:40.604 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:40.604 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:40.604 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25744 2024-09-13T06:43:40.604 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.605 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:40.605 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.605 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:40.605 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443449+0000", 2024-09-13T06:43:40.605 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:40.605 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.605 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.605 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:40.605 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443449+0000", 2024-09-13T06:43:40.605 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:40.605 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.605 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.605 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:40.606 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443449+0000", 2024-09-13T06:43:40.606 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:40.606 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.606 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.606 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:40.606 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443451+0000", 2024-09-13T06:43:40.606 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.244e-06 2024-09-13T06:43:40.606 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.606 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.606 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:40.606 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443457+0000", 2024-09-13T06:43:40.606 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.66e-06 2024-09-13T06:43:40.606 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.606 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.607 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:40.607 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443461+0000", 2024-09-13T06:43:40.607 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5449999999999997e-06 2024-09-13T06:43:40.607 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.607 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.607 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:40.607 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533311+0000", 2024-09-13T06:43:40.607 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089849729000000003 2024-09-13T06:43:40.607 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.607 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.607 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:40.607 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533318+0000", 2024-09-13T06:43:40.608 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.328e-06 2024-09-13T06:43:40.608 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:40.608 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:40.608 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:40.608 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.608 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.608 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25745 3.18 3.69d46638 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:43:40.608 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443466+0000", 2024-09-13T06:43:40.608 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 224.11737654500001, 2024-09-13T06:43:40.608 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089886743000000005, 2024-09-13T06:43:40.608 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:40.608 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:43:40.609 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:40.609 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:40.609 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:40.609 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25745 2024-09-13T06:43:40.609 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.609 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:40.609 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.609 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:40.609 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443466+0000", 2024-09-13T06:43:40.609 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:40.609 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.609 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.609 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:40.609 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443466+0000", 2024-09-13T06:43:40.610 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:40.610 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.610 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.610 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:40.610 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443466+0000", 2024-09-13T06:43:40.610 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:40.610 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.610 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.610 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:40.610 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443474+0000", 2024-09-13T06:43:40.610 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.1289999999999996e-06 2024-09-13T06:43:40.610 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.610 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.610 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:40.611 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443484+0000", 2024-09-13T06:43:40.611 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0654e-05 2024-09-13T06:43:40.611 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.611 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.611 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:40.611 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443490+0000", 2024-09-13T06:43:40.611 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8030000000000002e-06 2024-09-13T06:43:40.611 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.611 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.611 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:40.611 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533348+0000", 2024-09-13T06:43:40.611 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089857267000000005 2024-09-13T06:43:40.612 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.612 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.612 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:40.612 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533353+0000", 2024-09-13T06:43:40.612 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.5520000000000004e-06 2024-09-13T06:43:40.612 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:40.612 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:40.612 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:40.612 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.612 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.612 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25746 3.18 3.69d46638 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:43:40.612 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443495+0000", 2024-09-13T06:43:40.612 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 224.117347432, 2024-09-13T06:43:40.613 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089903725000000004, 2024-09-13T06:43:40.613 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:40.613 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:43:40.613 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:40.613 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:40.613 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:40.613 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25746 2024-09-13T06:43:40.613 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.613 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:40.613 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.613 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:40.613 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443495+0000", 2024-09-13T06:43:40.613 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:40.614 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.614 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.614 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:40.614 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443495+0000", 2024-09-13T06:43:40.614 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:40.614 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.614 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.614 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:40.614 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443495+0000", 2024-09-13T06:43:40.614 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:40.614 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.614 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.614 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:40.614 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443498+0000", 2024-09-13T06:43:40.615 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.7690000000000001e-06 2024-09-13T06:43:40.615 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.615 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.615 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:40.615 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443504+0000", 2024-09-13T06:43:40.615 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9710000000000001e-06 2024-09-13T06:43:40.615 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.615 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.615 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:40.615 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443508+0000", 2024-09-13T06:43:40.615 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4159999999999997e-06 2024-09-13T06:43:40.615 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.616 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.616 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:40.616 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533391+0000", 2024-09-13T06:43:40.616 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089882607000000003 2024-09-13T06:43:40.616 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.616 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.616 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:40.616 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533399+0000", 2024-09-13T06:43:40.616 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.4349999999999997e-06 2024-09-13T06:43:40.616 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:40.616 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:40.616 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:40.617 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.617 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.617 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25747 3.8 3.63996268 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:43:40.617 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443512+0000", 2024-09-13T06:43:40.617 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 224.11733070099999, 2024-09-13T06:43:40.617 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089880075000000004, 2024-09-13T06:43:40.617 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:40.617 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:43:40.617 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:40.617 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:40.617 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:40.617 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25747 2024-09-13T06:43:40.617 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.618 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:40.618 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.618 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:40.618 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443512+0000", 2024-09-13T06:43:40.618 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:40.618 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.618 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.618 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:40.618 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443512+0000", 2024-09-13T06:43:40.618 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:40.618 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.618 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.618 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:40.619 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443512+0000", 2024-09-13T06:43:40.619 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:40.619 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.619 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.619 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:40.619 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443514+0000", 2024-09-13T06:43:40.619 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0980000000000001e-06 2024-09-13T06:43:40.619 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.619 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.619 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:40.619 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443520+0000", 2024-09-13T06:43:40.619 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7069999999999997e-06 2024-09-13T06:43:40.620 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.620 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.620 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:40.620 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443524+0000", 2024-09-13T06:43:40.620 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5390000000000001e-06 2024-09-13T06:43:40.620 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.620 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.620 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:40.620 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533384+0000", 2024-09-13T06:43:40.620 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089859684999999995 2024-09-13T06:43:40.620 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.620 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.620 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:40.621 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533392+0000", 2024-09-13T06:43:40.621 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.3440000000000001e-06 2024-09-13T06:43:40.621 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:40.621 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:40.621 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:40.621 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.621 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.621 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25748 3.8 3.63996268 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:43:40.621 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443528+0000", 2024-09-13T06:43:40.621 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 224.11731457400001, 2024-09-13T06:43:40.621 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089890715999999996, 2024-09-13T06:43:40.621 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:40.622 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:43:40.622 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:40.622 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:40.622 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:40.622 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25748 2024-09-13T06:43:40.622 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.622 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:40.622 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.622 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:40.622 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443528+0000", 2024-09-13T06:43:40.622 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:40.622 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.622 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.623 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:40.623 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443528+0000", 2024-09-13T06:43:40.623 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:40.623 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.623 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.623 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:40.623 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443528+0000", 2024-09-13T06:43:40.623 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:40.623 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.623 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.623 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:40.623 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443530+0000", 2024-09-13T06:43:40.623 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0650000000000001e-06 2024-09-13T06:43:40.624 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.624 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.624 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:40.624 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443536+0000", 2024-09-13T06:43:40.624 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7259999999999999e-06 2024-09-13T06:43:40.624 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.624 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.624 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:40.624 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443540+0000", 2024-09-13T06:43:40.624 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5009999999999998e-06 2024-09-13T06:43:40.624 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.624 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.625 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:40.625 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533412+0000", 2024-09-13T06:43:40.625 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089871873000000005 2024-09-13T06:43:40.625 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.625 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.625 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:40.625 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533419+0000", 2024-09-13T06:43:40.625 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.883e-06 2024-09-13T06:43:40.625 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:40.625 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:40.625 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:40.625 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.625 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.626 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25749 3.8 3.63996268 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:43:40.626 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443545+0000", 2024-09-13T06:43:40.626 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 224.11729837799999, 2024-09-13T06:43:40.626 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089897988999999998, 2024-09-13T06:43:40.626 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:40.626 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:43:40.626 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:40.626 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:40.626 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:40.626 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25749 2024-09-13T06:43:40.626 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.626 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:40.626 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.627 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:40.627 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443545+0000", 2024-09-13T06:43:40.627 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:40.627 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.627 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.627 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:40.627 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443545+0000", 2024-09-13T06:43:40.627 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:40.627 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.627 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.627 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:40.627 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443544+0000", 2024-09-13T06:43:40.627 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:40.628 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.628 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.628 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:40.628 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443553+0000", 2024-09-13T06:43:40.628 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.4770000000000003e-06 2024-09-13T06:43:40.628 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.628 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.628 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:40.628 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443564+0000", 2024-09-13T06:43:40.628 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0986e-05 2024-09-13T06:43:40.628 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.628 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.629 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:40.629 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443569+0000", 2024-09-13T06:43:40.629 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2530000000000004e-06 2024-09-13T06:43:40.629 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.629 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.629 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:40.629 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533438+0000", 2024-09-13T06:43:40.629 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089868641999999999 2024-09-13T06:43:40.629 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.629 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.629 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:40.629 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533442+0000", 2024-09-13T06:43:40.629 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.989e-06 2024-09-13T06:43:40.630 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:40.630 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:40.630 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:40.630 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.630 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.630 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25750 3.8 3.63996268 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:43:40.630 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443574+0000", 2024-09-13T06:43:40.630 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 224.117268892, 2024-09-13T06:43:40.630 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089895143999999996, 2024-09-13T06:43:40.630 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:40.630 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:43:40.630 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:40.630 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:40.630 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:40.631 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25750 2024-09-13T06:43:40.631 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.631 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:40.631 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.631 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:40.631 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443574+0000", 2024-09-13T06:43:40.631 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:40.631 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.631 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.631 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:40.631 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443574+0000", 2024-09-13T06:43:40.631 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:40.631 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.631 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.632 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:40.632 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443574+0000", 2024-09-13T06:43:40.632 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:40.632 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.632 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.632 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:40.632 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443576+0000", 2024-09-13T06:43:40.632 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6910000000000002e-06 2024-09-13T06:43:40.632 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.632 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.632 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:40.632 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443583+0000", 2024-09-13T06:43:40.632 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.331e-06 2024-09-13T06:43:40.632 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.633 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.633 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:40.633 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443587+0000", 2024-09-13T06:43:40.633 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6129999999999997e-06 2024-09-13T06:43:40.633 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.633 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.633 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:40.633 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533464+0000", 2024-09-13T06:43:40.633 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089876605999999998 2024-09-13T06:43:40.633 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.633 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.633 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:40.633 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533469+0000", 2024-09-13T06:43:40.634 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3909999999999997e-06 2024-09-13T06:43:40.634 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:40.634 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:40.634 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:40.634 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.634 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.634 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25751 3.8 3.63996268 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:43:40.634 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443592+0000", 2024-09-13T06:43:40.634 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 224.11725119499999, 2024-09-13T06:43:40.634 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089913650999999997, 2024-09-13T06:43:40.634 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:40.634 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:43:40.634 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:40.634 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:40.634 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:40.635 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25751 2024-09-13T06:43:40.635 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.635 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:40.635 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.635 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:40.635 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443592+0000", 2024-09-13T06:43:40.635 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:40.635 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.635 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.635 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:40.635 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443592+0000", 2024-09-13T06:43:40.635 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:40.635 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.636 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.636 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:40.636 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443591+0000", 2024-09-13T06:43:40.636 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:40.636 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.636 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.636 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:40.636 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443594+0000", 2024-09-13T06:43:40.636 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3649999999999998e-06 2024-09-13T06:43:40.636 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.636 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.636 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:40.636 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443599+0000", 2024-09-13T06:43:40.637 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.699e-06 2024-09-13T06:43:40.637 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.637 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.637 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:40.637 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443611+0000", 2024-09-13T06:43:40.637 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1503e-05 2024-09-13T06:43:40.637 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.637 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.637 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:40.637 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533497+0000", 2024-09-13T06:43:40.637 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089886453000000005 2024-09-13T06:43:40.637 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.637 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.638 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:40.638 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533505+0000", 2024-09-13T06:43:40.638 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.9910000000000002e-06 2024-09-13T06:43:40.638 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:40.638 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:40.638 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:40.638 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.638 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.638 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25752 3.8 3.63996268 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:43:40.638 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443615+0000", 2024-09-13T06:43:40.638 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 224.11722741400001, 2024-09-13T06:43:40.638 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089905868999999999, 2024-09-13T06:43:40.638 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:40.639 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:43:40.639 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:40.639 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:40.639 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:40.639 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25752 2024-09-13T06:43:40.639 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.639 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:40.639 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.639 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:40.639 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443615+0000", 2024-09-13T06:43:40.639 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:40.639 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.639 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.640 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:40.640 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443615+0000", 2024-09-13T06:43:40.640 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:40.640 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.640 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.640 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:40.640 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443615+0000", 2024-09-13T06:43:40.640 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:40.640 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.640 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.640 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:40.640 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443617+0000", 2024-09-13T06:43:40.640 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3539999999999998e-06 2024-09-13T06:43:40.641 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.641 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.641 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:40.641 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443624+0000", 2024-09-13T06:43:40.641 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3600000000000001e-06 2024-09-13T06:43:40.641 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.641 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.641 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:40.641 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443628+0000", 2024-09-13T06:43:40.641 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.2350000000000001e-06 2024-09-13T06:43:40.641 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.641 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.641 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:40.642 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533517+0000", 2024-09-13T06:43:40.642 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089889029999999995 2024-09-13T06:43:40.642 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.642 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.642 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:40.642 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533521+0000", 2024-09-13T06:43:40.642 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.2529999999999998e-06 2024-09-13T06:43:40.642 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:40.642 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:40.642 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:40.642 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.642 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.642 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:64356 3.c 3:32785be9:::rbd_header.11218ba71f0d:head [watch reconnect cookie 140361410387072 gen 2] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e95)", 2024-09-13T06:43:40.642 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:48.473318+0000", 2024-09-13T06:43:40.643 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 172.087525021, 2024-09-13T06:43:40.643 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1458904379999999, 2024-09-13T06:43:40.643 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:40.643 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:40.643 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:40.643 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:40.643 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:40.643 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 64356 2024-09-13T06:43:40.643 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.643 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:40.643 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.643 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:40.643 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:48.473318+0000", 2024-09-13T06:43:40.644 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:40.644 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.644 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.644 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:40.644 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:48.473318+0000", 2024-09-13T06:43:40.644 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:40.644 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.644 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.644 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:40.644 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:48.473315+0000", 2024-09-13T06:43:40.644 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999971 2024-09-13T06:43:40.644 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.644 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.645 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:40.645 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:48.473329+0000", 2024-09-13T06:43:40.645 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.433e-05 2024-09-13T06:43:40.645 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.645 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.645 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:40.645 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:48.473363+0000", 2024-09-13T06:43:40.645 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.3592e-05 2024-09-13T06:43:40.645 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.645 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.645 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:40.645 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:48.473386+0000", 2024-09-13T06:43:40.645 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2708999999999999e-05 2024-09-13T06:43:40.645 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.645 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.646 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:40.646 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:48.473804+0000", 2024-09-13T06:43:40.646 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00041789399999999998 2024-09-13T06:43:40.646 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.646 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.646 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:43:40.646 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:48.473830+0000", 2024-09-13T06:43:40.646 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6869e-05 2024-09-13T06:43:40.646 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.646 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.646 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:40.646 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:49.614332+0000", 2024-09-13T06:43:40.646 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.140501107 2024-09-13T06:43:40.646 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.647 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.647 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for rw locks", 2024-09-13T06:43:40.647 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:49.614496+0000", 2024-09-13T06:43:40.647 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00016451200000000001 2024-09-13T06:43:40.647 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.647 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.647 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:40.647 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:49.617131+0000", 2024-09-13T06:43:40.647 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.002634843 2024-09-13T06:43:40.647 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.647 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.647 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:40.647 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:49.617204+0000", 2024-09-13T06:43:40.647 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.2991000000000006e-05 2024-09-13T06:43:40.648 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.648 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.648 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:40.648 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:49.619208+0000", 2024-09-13T06:43:40.648 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.002004381 2024-09-13T06:43:40.648 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:40.648 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:40.648 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:40.648 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.648 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.648 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:170155 3.7 3:e17728eb:::image_client.0-clone36.rbd:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e191)", 2024-09-13T06:43:40.648 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:42:31.436412+0000", 2024-09-13T06:43:40.648 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 69.124431197999996, 2024-09-13T06:43:40.648 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.97843703800000004, 2024-09-13T06:43:40.649 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:40.649 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:43:40.649 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:40.649 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:40.649 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:40.649 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 170155 2024-09-13T06:43:40.649 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.649 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:40.649 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.649 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:40.649 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:31.436412+0000", 2024-09-13T06:43:40.649 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:40.649 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.650 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.650 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:40.650 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:31.436412+0000", 2024-09-13T06:43:40.650 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:40.650 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.652 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.652 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:40.652 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:31.436410+0000", 2024-09-13T06:43:40.652 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999986 2024-09-13T06:43:40.652 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.652 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.652 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:40.652 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:31.436417+0000", 2024-09-13T06:43:40.652 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.6939999999999998e-06 2024-09-13T06:43:40.652 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.652 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.652 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:40.653 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:31.436430+0000", 2024-09-13T06:43:40.653 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3016999999999999e-05 2024-09-13T06:43:40.653 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.653 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.653 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:40.653 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:31.436437+0000", 2024-09-13T06:43:40.653 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.1069999999999999e-06 2024-09-13T06:43:40.653 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.653 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.653 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:40.653 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:31.436515+0000", 2024-09-13T06:43:40.653 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.7756000000000006e-05 2024-09-13T06:43:40.653 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.654 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.654 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:43:40.654 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:31.436523+0000", 2024-09-13T06:43:40.654 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.4970000000000001e-06 2024-09-13T06:43:40.654 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.654 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.654 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:40.654 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:32.414565+0000", 2024-09-13T06:43:40.654 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.97804144199999998 2024-09-13T06:43:40.654 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:40.654 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:40.654 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:40.654 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:32.414849+0000", 2024-09-13T06:43:40.654 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00028388600000000001 2024-09-13T06:43:40.655 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:40.655 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:40.655 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:40.655 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:40.655 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:40.655 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:43:40.656 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-13T06:43:40.657 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-13T06:43:40.657+0000 7fa8bb18e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 36790) UID: 0 2024-09-13T06:43:40.758 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:43:40.755+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:43:40.786 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:43:40.786 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [], 2024-09-13T06:43:40.786 INFO:teuthology.orchestra.run.smithi139.stdout: "num_ops": 0 2024-09-13T06:43:40.786 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:43:40.800 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-13T06:43:40.861 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:43:40.859+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:43:40.923 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:43:40.923 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [], 2024-09-13T06:43:40.923 INFO:teuthology.orchestra.run.smithi139.stdout: "complaint_time": 30, 2024-09-13T06:43:40.923 INFO:teuthology.orchestra.run.smithi139.stdout: "num_blocked_ops": 0 2024-09-13T06:43:40.923 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:43:40.937 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-13T06:43:40.962 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:43:40.963+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:43:41.058 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:43:41.058 INFO:teuthology.orchestra.run.smithi139.stdout: "size": 20, 2024-09-13T06:43:41.058 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 600, 2024-09-13T06:43:41.058 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [ 2024-09-13T06:43:41.058 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.058 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:160483 3.a 3:57f62123:::rbd_header.112138ed422:head [watch reconnect cookie 140361344088384 gen 3] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e177)", 2024-09-13T06:43:41.058 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:42:17.439011+0000", 2024-09-13T06:43:41.058 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 83.617031415, 2024-09-13T06:43:41.058 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.155518861, 2024-09-13T06:43:41.059 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:41.059 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:41.059 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:41.059 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:41.059 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:41.059 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 160483 2024-09-13T06:43:41.059 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.059 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:41.059 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.059 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:41.059 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:17.439011+0000", 2024-09-13T06:43:41.059 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:41.059 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.059 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.060 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:41.060 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:17.439011+0000", 2024-09-13T06:43:41.060 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:41.060 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.060 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.060 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:41.060 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:17.439009+0000", 2024-09-13T06:43:41.060 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999976 2024-09-13T06:43:41.060 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.060 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.060 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:41.060 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:17.439024+0000", 2024-09-13T06:43:41.060 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.464e-05 2024-09-13T06:43:41.060 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.061 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.061 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:41.061 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:17.439058+0000", 2024-09-13T06:43:41.061 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.4712999999999998e-05 2024-09-13T06:43:41.061 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.061 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.061 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:41.061 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:17.439085+0000", 2024-09-13T06:43:41.061 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.6216000000000001e-05 2024-09-13T06:43:41.064 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.064 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.064 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:41.064 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:17.439182+0000", 2024-09-13T06:43:41.064 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.7020000000000003e-05 2024-09-13T06:43:41.064 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.064 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.064 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:43:41.064 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:17.439204+0000", 2024-09-13T06:43:41.065 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.2276000000000002e-05 2024-09-13T06:43:41.065 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.065 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.065 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:41.065 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:18.588627+0000", 2024-09-13T06:43:41.065 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1494235829999999 2024-09-13T06:43:41.065 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.065 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.066 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for rw locks", 2024-09-13T06:43:41.066 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:18.589031+0000", 2024-09-13T06:43:41.066 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0004035 2024-09-13T06:43:41.066 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.066 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.066 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:41.066 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:18.590604+0000", 2024-09-13T06:43:41.066 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.001573234 2024-09-13T06:43:41.066 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.066 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.066 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:41.066 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:18.590791+0000", 2024-09-13T06:43:41.067 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000186701 2024-09-13T06:43:41.067 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.067 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.067 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:41.067 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:18.594530+0000", 2024-09-13T06:43:41.067 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0037394250000000002 2024-09-13T06:43:41.067 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:41.067 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:41.067 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:41.067 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.067 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.067 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:208355 3.14 3:2d339b7f:::rbd_data.1121cb4a09ed.0000000000000003:snapdir [list-snaps] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e219)", 2024-09-13T06:43:41.068 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:43:03.420412+0000", 2024-09-13T06:43:41.068 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 37.635631279000002, 2024-09-13T06:43:41.068 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.705233864, 2024-09-13T06:43:41.068 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:41.068 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:41.068 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:41.068 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:41.068 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:41.068 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 208355 2024-09-13T06:43:41.068 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.068 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:41.068 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.068 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:41.068 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420412+0000", 2024-09-13T06:43:41.069 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:41.069 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.069 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.069 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:41.069 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420412+0000", 2024-09-13T06:43:41.069 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:41.069 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.069 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.069 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:41.069 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420409+0000", 2024-09-13T06:43:41.069 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999981 2024-09-13T06:43:41.069 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.069 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.070 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:41.070 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420420+0000", 2024-09-13T06:43:41.070 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0716e-05 2024-09-13T06:43:41.070 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.070 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.070 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:41.070 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420440+0000", 2024-09-13T06:43:41.070 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.9850000000000001e-05 2024-09-13T06:43:41.070 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.070 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.070 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:41.070 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420456+0000", 2024-09-13T06:43:41.070 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5667000000000001e-05 2024-09-13T06:43:41.070 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.071 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.071 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:41.071 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420724+0000", 2024-09-13T06:43:41.071 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00026873400000000002 2024-09-13T06:43:41.071 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.071 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.071 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:43:41.071 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420740+0000", 2024-09-13T06:43:41.071 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5486999999999999e-05 2024-09-13T06:43:41.071 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.071 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.071 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:41.071 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.125004+0000", 2024-09-13T06:43:41.072 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7042643119999998 2024-09-13T06:43:41.072 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.072 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.072 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:41.072 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.125293+0000", 2024-09-13T06:43:41.072 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000288664 2024-09-13T06:43:41.072 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.072 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.072 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:41.072 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.125645+0000", 2024-09-13T06:43:41.072 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00035247700000000002 2024-09-13T06:43:41.072 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:41.072 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:41.073 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:41.073 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.073 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.073 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:208362 3.14 3:2d339b7f:::rbd_data.1121cb4a09ed.0000000000000003:snapdir [list-snaps] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e219)", 2024-09-13T06:43:41.073 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:43:03.420469+0000", 2024-09-13T06:43:41.073 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 37.635573803, 2024-09-13T06:43:41.073 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.706123917, 2024-09-13T06:43:41.073 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:41.073 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:41.073 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:41.073 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:41.073 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:41.073 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 208362 2024-09-13T06:43:41.073 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.074 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:41.074 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.074 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:41.074 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420469+0000", 2024-09-13T06:43:41.074 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:41.074 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.074 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.074 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:41.074 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420469+0000", 2024-09-13T06:43:41.074 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:41.074 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.074 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.074 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:41.074 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420468+0000", 2024-09-13T06:43:41.075 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:41.075 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.075 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.075 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:41.075 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420473+0000", 2024-09-13T06:43:41.075 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.7099999999999998e-06 2024-09-13T06:43:41.075 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.075 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.075 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:41.075 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420483+0000", 2024-09-13T06:43:41.075 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.7960000000000007e-06 2024-09-13T06:43:41.075 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.075 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.076 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:41.076 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420491+0000", 2024-09-13T06:43:41.076 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.8169999999999999e-06 2024-09-13T06:43:41.076 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.076 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.076 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:41.076 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420829+0000", 2024-09-13T06:43:41.076 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000338494 2024-09-13T06:43:41.076 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.076 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.076 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:43:41.076 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420857+0000", 2024-09-13T06:43:41.076 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.8140000000000002e-05 2024-09-13T06:43:41.077 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.077 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.077 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:41.077 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.126086+0000", 2024-09-13T06:43:41.077 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7052288369999999 2024-09-13T06:43:41.077 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.077 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.077 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:41.077 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.126269+0000", 2024-09-13T06:43:41.077 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000183301 2024-09-13T06:43:41.077 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.077 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.077 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:41.078 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.126593+0000", 2024-09-13T06:43:41.078 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00032352800000000001 2024-09-13T06:43:41.078 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:41.078 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:41.078 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:41.078 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.078 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.078 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:208369 3.14 3:2d339b7f:::rbd_data.1121cb4a09ed.0000000000000003:snapdir [list-snaps] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e219)", 2024-09-13T06:43:41.078 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:43:03.420498+0000", 2024-09-13T06:43:41.078 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 37.635544758999998, 2024-09-13T06:43:41.078 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.706613895, 2024-09-13T06:43:41.078 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:41.078 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:41.078 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:41.079 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:41.079 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:41.079 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 208369 2024-09-13T06:43:41.079 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.079 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:41.079 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.079 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:41.079 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420498+0000", 2024-09-13T06:43:41.079 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:41.079 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.079 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.079 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:41.079 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420498+0000", 2024-09-13T06:43:41.079 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:41.080 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.080 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.080 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:41.080 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420497+0000", 2024-09-13T06:43:41.080 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:41.080 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.080 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.080 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:41.080 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420501+0000", 2024-09-13T06:43:41.080 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.737e-06 2024-09-13T06:43:41.080 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.080 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.080 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:41.080 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420522+0000", 2024-09-13T06:43:41.081 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.1152999999999999e-05 2024-09-13T06:43:41.081 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.081 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.081 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:41.081 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420533+0000", 2024-09-13T06:43:41.081 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0366999999999999e-05 2024-09-13T06:43:41.081 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.081 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.081 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:41.081 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420968+0000", 2024-09-13T06:43:41.081 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00043495900000000001 2024-09-13T06:43:41.081 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.081 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.082 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:43:41.082 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420977+0000", 2024-09-13T06:43:41.082 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.8039999999999996e-06 2024-09-13T06:43:41.082 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.082 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.082 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:41.082 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.126670+0000", 2024-09-13T06:43:41.082 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7056928760000001 2024-09-13T06:43:41.082 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.082 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.082 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:41.082 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.126833+0000", 2024-09-13T06:43:41.082 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00016253200000000001 2024-09-13T06:43:41.083 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.083 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.083 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:41.083 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.127112+0000", 2024-09-13T06:43:41.083 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000279141 2024-09-13T06:43:41.083 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:41.083 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:41.083 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:41.083 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.083 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.083 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:208376 3.14 3:2d339b7f:::rbd_data.1121cb4a09ed.0000000000000003:snapdir [list-snaps] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e219)", 2024-09-13T06:43:41.083 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:43:03.420541+0000", 2024-09-13T06:43:41.083 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 37.635501503, 2024-09-13T06:43:41.083 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7070606820000001, 2024-09-13T06:43:41.084 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:41.084 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:41.084 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:41.084 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:41.084 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:41.084 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 208376 2024-09-13T06:43:41.084 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.084 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:41.084 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.084 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:41.084 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420541+0000", 2024-09-13T06:43:41.084 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:41.084 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.085 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.085 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:41.085 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420541+0000", 2024-09-13T06:43:41.085 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:41.085 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.085 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.085 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:41.085 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420541+0000", 2024-09-13T06:43:41.085 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:41.085 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.085 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.085 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:41.086 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420544+0000", 2024-09-13T06:43:41.086 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.5530000000000001e-06 2024-09-13T06:43:41.086 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.086 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.086 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:41.086 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420557+0000", 2024-09-13T06:43:41.086 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2663000000000001e-05 2024-09-13T06:43:41.086 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.086 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.086 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:41.086 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420572+0000", 2024-09-13T06:43:41.086 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5463000000000001e-05 2024-09-13T06:43:41.086 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.087 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.087 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:41.087 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.421070+0000", 2024-09-13T06:43:41.087 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00049723599999999997 2024-09-13T06:43:41.087 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.087 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.087 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:43:41.087 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.421092+0000", 2024-09-13T06:43:41.087 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.2354e-05 2024-09-13T06:43:41.087 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.087 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.087 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:41.087 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.127184+0000", 2024-09-13T06:43:41.087 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7060917330000001 2024-09-13T06:43:41.088 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.088 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.088 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:41.088 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.127340+0000", 2024-09-13T06:43:41.088 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00015640200000000001 2024-09-13T06:43:41.088 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.088 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.088 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:41.088 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.127602+0000", 2024-09-13T06:43:41.088 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00026192799999999998 2024-09-13T06:43:41.088 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:41.088 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:41.088 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:41.089 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.089 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.089 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:208383 3.14 3:2d339b7f:::rbd_data.1121cb4a09ed.0000000000000003:snapdir [list-snaps] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e219)", 2024-09-13T06:43:41.089 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:43:03.420585+0000", 2024-09-13T06:43:41.089 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 37.635457649999999, 2024-09-13T06:43:41.089 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.707457405, 2024-09-13T06:43:41.089 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:41.089 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:41.089 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:41.089 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:41.089 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:41.089 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 208383 2024-09-13T06:43:41.089 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.090 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:41.090 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.090 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:41.090 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420585+0000", 2024-09-13T06:43:41.090 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:41.090 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.090 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.090 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:41.090 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420585+0000", 2024-09-13T06:43:41.090 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:41.090 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.090 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.090 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:41.091 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420584+0000", 2024-09-13T06:43:41.091 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:43:41.091 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.091 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.091 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:41.091 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420614+0000", 2024-09-13T06:43:41.091 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.9886000000000002e-05 2024-09-13T06:43:41.091 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.091 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.091 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:41.091 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420640+0000", 2024-09-13T06:43:41.091 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.5663000000000001e-05 2024-09-13T06:43:41.091 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.091 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.092 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:41.092 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420669+0000", 2024-09-13T06:43:41.092 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.9289999999999999e-05 2024-09-13T06:43:41.092 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.092 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.092 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:41.092 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.421168+0000", 2024-09-13T06:43:41.092 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00049857600000000003 2024-09-13T06:43:41.092 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.092 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.092 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:43:41.092 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.421177+0000", 2024-09-13T06:43:41.092 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.533e-06 2024-09-13T06:43:41.092 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.092 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.093 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:41.093 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.127648+0000", 2024-09-13T06:43:41.093 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7064713569999999 2024-09-13T06:43:41.093 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.093 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.093 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:41.093 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.127794+0000", 2024-09-13T06:43:41.093 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00014589200000000001 2024-09-13T06:43:41.093 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.093 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.093 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:41.093 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.128043+0000", 2024-09-13T06:43:41.093 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00024821799999999997 2024-09-13T06:43:41.094 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:41.094 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:41.094 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:41.094 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.094 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.094 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:208390 3.14 3:2d339b7f:::rbd_data.1121cb4a09ed.0000000000000003:snapdir [list-snaps] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e219)", 2024-09-13T06:43:41.094 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:43:03.420713+0000", 2024-09-13T06:43:41.094 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 37.635329691000003, 2024-09-13T06:43:41.094 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7077568059999999, 2024-09-13T06:43:41.094 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:41.094 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:41.094 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:41.094 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:41.094 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:41.095 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 208390 2024-09-13T06:43:41.095 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.095 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:41.095 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.095 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:41.095 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420713+0000", 2024-09-13T06:43:41.095 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:41.095 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.095 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.095 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:41.095 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420713+0000", 2024-09-13T06:43:41.095 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:41.095 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.096 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.096 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:41.096 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420712+0000", 2024-09-13T06:43:41.096 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:43:41.096 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.096 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.096 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:41.096 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420719+0000", 2024-09-13T06:43:41.096 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.883e-06 2024-09-13T06:43:41.096 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.096 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.096 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:41.096 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420737+0000", 2024-09-13T06:43:41.096 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.8082999999999999e-05 2024-09-13T06:43:41.097 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.097 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.097 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:41.097 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420757+0000", 2024-09-13T06:43:41.097 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.0256999999999999e-05 2024-09-13T06:43:41.097 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.097 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.097 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:41.097 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.421258+0000", 2024-09-13T06:43:41.097 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00050028500000000005 2024-09-13T06:43:41.097 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.097 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.097 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:43:41.097 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.421282+0000", 2024-09-13T06:43:41.098 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.4236999999999999e-05 2024-09-13T06:43:41.098 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.098 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.098 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:41.098 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.128087+0000", 2024-09-13T06:43:41.098 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.706805551 2024-09-13T06:43:41.098 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.099 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.099 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:41.099 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.128231+0000", 2024-09-13T06:43:41.099 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00014348200000000001 2024-09-13T06:43:41.100 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.100 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.100 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:41.100 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.128470+0000", 2024-09-13T06:43:41.100 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000239058 2024-09-13T06:43:41.100 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:41.100 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:41.100 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:41.100 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.100 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.100 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:208397 3.14 3:2d339b7f:::rbd_data.1121cb4a09ed.0000000000000003:snapdir [list-snaps] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e219)", 2024-09-13T06:43:41.101 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:43:03.420772+0000", 2024-09-13T06:43:41.101 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 37.635270312000003, 2024-09-13T06:43:41.101 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7081308659999999, 2024-09-13T06:43:41.101 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:41.101 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:41.101 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:41.101 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:41.101 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:41.101 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 208397 2024-09-13T06:43:41.101 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.101 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:41.101 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.102 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:41.102 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420772+0000", 2024-09-13T06:43:41.102 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:41.102 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.102 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.102 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:41.102 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420772+0000", 2024-09-13T06:43:41.102 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:41.102 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.102 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.102 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:41.102 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420772+0000", 2024-09-13T06:43:41.102 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:43:41.102 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.103 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.103 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:41.103 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420777+0000", 2024-09-13T06:43:41.103 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.8329999999999999e-06 2024-09-13T06:43:41.103 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.103 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.103 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:41.103 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420795+0000", 2024-09-13T06:43:41.103 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7677e-05 2024-09-13T06:43:41.103 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.103 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.103 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:41.103 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420811+0000", 2024-09-13T06:43:41.104 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5673000000000001e-05 2024-09-13T06:43:41.104 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.104 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.104 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:41.104 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.421352+0000", 2024-09-13T06:43:41.104 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00054091199999999995 2024-09-13T06:43:41.104 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.104 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.104 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:43:41.104 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.421364+0000", 2024-09-13T06:43:41.104 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.182e-05 2024-09-13T06:43:41.104 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.104 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.105 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:41.105 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.128512+0000", 2024-09-13T06:43:41.105 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.707148584 2024-09-13T06:43:41.105 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.105 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.105 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:41.105 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.128653+0000", 2024-09-13T06:43:41.105 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00014127599999999999 2024-09-13T06:43:41.105 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.105 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.105 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:41.105 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.128903+0000", 2024-09-13T06:43:41.105 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000249941 2024-09-13T06:43:41.106 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:41.106 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:41.106 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:41.106 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.106 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.106 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:208404 3.14 3:2d339b7f:::rbd_data.1121cb4a09ed.0000000000000003:snapdir [list-snaps] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e219)", 2024-09-13T06:43:41.106 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:43:03.420837+0000", 2024-09-13T06:43:41.106 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 37.635205675999998, 2024-09-13T06:43:41.106 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.70849154, 2024-09-13T06:43:41.106 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:41.106 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:41.106 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:41.106 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:41.106 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:41.107 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 208404 2024-09-13T06:43:41.107 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.107 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:41.107 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.107 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:41.107 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420837+0000", 2024-09-13T06:43:41.107 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:41.107 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.107 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.108 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:41.108 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420837+0000", 2024-09-13T06:43:41.108 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:41.108 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.108 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.108 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:41.108 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420836+0000", 2024-09-13T06:43:41.108 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999986 2024-09-13T06:43:41.108 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.108 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.108 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:41.108 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420842+0000", 2024-09-13T06:43:41.108 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.4400000000000002e-06 2024-09-13T06:43:41.109 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.109 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.109 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:41.109 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420860+0000", 2024-09-13T06:43:41.109 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7487e-05 2024-09-13T06:43:41.109 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.109 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.109 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:41.109 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420916+0000", 2024-09-13T06:43:41.109 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.6276999999999997e-05 2024-09-13T06:43:41.109 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.109 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.109 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:41.110 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.421450+0000", 2024-09-13T06:43:41.110 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00053433500000000004 2024-09-13T06:43:41.110 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.110 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.110 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:43:41.110 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.421474+0000", 2024-09-13T06:43:41.110 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.3799e-05 2024-09-13T06:43:41.110 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.110 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.110 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:41.110 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.128945+0000", 2024-09-13T06:43:41.110 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.707470912 2024-09-13T06:43:41.110 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.111 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.111 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:41.111 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.129087+0000", 2024-09-13T06:43:41.111 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00014170900000000001 2024-09-13T06:43:41.111 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.111 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.111 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:41.111 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.129329+0000", 2024-09-13T06:43:41.111 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000241831 2024-09-13T06:43:41.111 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:41.111 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:41.111 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:41.111 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.111 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.112 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:208411 3.14 3:2d339b7f:::rbd_data.1121cb4a09ed.0000000000000003:snapdir [list-snaps] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e219)", 2024-09-13T06:43:41.112 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:43:03.420964+0000", 2024-09-13T06:43:41.112 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 37.635078444000001, 2024-09-13T06:43:41.112 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.708812754, 2024-09-13T06:43:41.112 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:41.112 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:41.112 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:41.112 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:41.112 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:41.112 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 208411 2024-09-13T06:43:41.112 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.112 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:41.112 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.113 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:41.113 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420964+0000", 2024-09-13T06:43:41.113 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:41.113 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.113 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.113 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:41.113 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420964+0000", 2024-09-13T06:43:41.113 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:41.113 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.113 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.113 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:41.113 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420963+0000", 2024-09-13T06:43:41.113 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:43:41.114 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.114 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.114 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:41.114 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420969+0000", 2024-09-13T06:43:41.114 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.7540000000000003e-06 2024-09-13T06:43:41.114 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.114 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.114 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:41.114 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420979+0000", 2024-09-13T06:43:41.114 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0067e-05 2024-09-13T06:43:41.114 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.114 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.114 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:41.114 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420987+0000", 2024-09-13T06:43:41.115 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.6990000000000003e-06 2024-09-13T06:43:41.115 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.115 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.115 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:41.115 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.421563+0000", 2024-09-13T06:43:41.115 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00057654899999999999 2024-09-13T06:43:41.115 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.115 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.115 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:43:41.115 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.421573+0000", 2024-09-13T06:43:41.115 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.9669999999999996e-06 2024-09-13T06:43:41.115 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.115 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.116 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:41.116 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.129372+0000", 2024-09-13T06:43:41.116 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.707798602 2024-09-13T06:43:41.116 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.116 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.116 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:41.116 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.129514+0000", 2024-09-13T06:43:41.116 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00014191200000000001 2024-09-13T06:43:41.116 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.116 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.116 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:41.116 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.129777+0000", 2024-09-13T06:43:41.116 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00026320100000000002 2024-09-13T06:43:41.117 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:41.117 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:41.117 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:41.117 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.117 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.117 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:208418 3.14 3:2d339b7f:::rbd_data.1121cb4a09ed.0000000000000003:snapdir [list-snaps] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e219)", 2024-09-13T06:43:41.117 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:43:03.421005+0000", 2024-09-13T06:43:41.117 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 37.635037359999998, 2024-09-13T06:43:41.117 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7096508159999999, 2024-09-13T06:43:41.117 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:41.117 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:41.117 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:41.117 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:41.117 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:41.118 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 208418 2024-09-13T06:43:41.118 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.118 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:41.118 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.118 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:41.118 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.421005+0000", 2024-09-13T06:43:41.118 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:41.118 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.118 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.118 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:41.118 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.421005+0000", 2024-09-13T06:43:41.118 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:41.118 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.119 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.119 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:41.119 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.421005+0000", 2024-09-13T06:43:41.119 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:41.119 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.119 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.119 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:41.119 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.421008+0000", 2024-09-13T06:43:41.119 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.2550000000000002e-06 2024-09-13T06:43:41.119 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.119 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.119 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:41.119 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.421015+0000", 2024-09-13T06:43:41.119 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.0600000000000002e-06 2024-09-13T06:43:41.120 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.120 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.120 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:41.120 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.421021+0000", 2024-09-13T06:43:41.120 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.8139999999999997e-06 2024-09-13T06:43:41.120 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.120 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.120 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:41.120 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.421638+0000", 2024-09-13T06:43:41.120 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00061702600000000001 2024-09-13T06:43:41.120 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.120 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.121 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:43:41.121 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.421659+0000", 2024-09-13T06:43:41.121 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.0894e-05 2024-09-13T06:43:41.121 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.121 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.121 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:41.121 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.129858+0000", 2024-09-13T06:43:41.121 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.708198632 2024-09-13T06:43:41.121 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.121 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.121 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:41.121 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.130158+0000", 2024-09-13T06:43:41.121 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00030000099999999999 2024-09-13T06:43:41.121 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.122 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.122 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:41.122 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.130656+0000", 2024-09-13T06:43:41.122 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00049864199999999999 2024-09-13T06:43:41.122 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:41.122 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:41.122 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:41.122 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.122 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.122 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:209008 3.3 3:c6ff3074:::rbd_data.1121cb4a09ed.0000000000000001:82 [read 397312~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e220)", 2024-09-13T06:43:41.122 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:43:05.165956+0000", 2024-09-13T06:43:41.122 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 35.890087049999998, 2024-09-13T06:43:41.122 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.120605692, 2024-09-13T06:43:41.123 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:41.123 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:41.123 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:41.123 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:41.123 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:41.123 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 209008 2024-09-13T06:43:41.123 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.123 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:41.123 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.123 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:41.123 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.165956+0000", 2024-09-13T06:43:41.123 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:41.123 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.124 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.124 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:41.124 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.165956+0000", 2024-09-13T06:43:41.124 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:41.124 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.124 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.124 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:41.124 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.165955+0000", 2024-09-13T06:43:41.124 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:43:41.124 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.124 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.124 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:41.124 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.165960+0000", 2024-09-13T06:43:41.125 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.6200000000000004e-06 2024-09-13T06:43:41.125 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.125 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.125 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:41.125 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.165998+0000", 2024-09-13T06:43:41.125 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.7703000000000001e-05 2024-09-13T06:43:41.125 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.125 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.125 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:41.125 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.166012+0000", 2024-09-13T06:43:41.125 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3682999999999999e-05 2024-09-13T06:43:41.125 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.125 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.125 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:41.126 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.286043+0000", 2024-09-13T06:43:41.126 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.120030867 2024-09-13T06:43:41.126 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.126 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.126 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:41.126 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.286196+0000", 2024-09-13T06:43:41.126 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000153759 2024-09-13T06:43:41.126 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.126 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.126 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:41.126 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.286561+0000", 2024-09-13T06:43:41.126 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00036504700000000002 2024-09-13T06:43:41.126 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:41.126 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:41.127 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:41.127 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.127 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.127 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:209009 3.3 3:c6ff3074:::rbd_data.1121cb4a09ed.0000000000000001:82 [read 409600~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e220)", 2024-09-13T06:43:41.127 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:43:05.166111+0000", 2024-09-13T06:43:41.127 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 35.889931404999999, 2024-09-13T06:43:41.127 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.121025172, 2024-09-13T06:43:41.127 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:41.127 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:41.127 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:41.127 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:41.127 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:41.127 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 209009 2024-09-13T06:43:41.128 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.128 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:41.128 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.128 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:41.128 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.166111+0000", 2024-09-13T06:43:41.128 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:41.128 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.128 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.128 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:41.128 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.166111+0000", 2024-09-13T06:43:41.128 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:41.128 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.128 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.128 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:41.129 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.166023+0000", 2024-09-13T06:43:41.129 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999113 2024-09-13T06:43:41.129 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.129 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.129 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:41.129 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.166118+0000", 2024-09-13T06:43:41.129 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.5818999999999999e-05 2024-09-13T06:43:41.129 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.129 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.129 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:41.129 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.166145+0000", 2024-09-13T06:43:41.129 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.6679999999999999e-05 2024-09-13T06:43:41.129 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.130 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.130 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:41.130 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.166162+0000", 2024-09-13T06:43:41.130 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6413e-05 2024-09-13T06:43:41.130 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.130 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.130 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:41.130 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.286636+0000", 2024-09-13T06:43:41.130 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.120474003 2024-09-13T06:43:41.130 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.130 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.130 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:41.130 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.286799+0000", 2024-09-13T06:43:41.130 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00016363900000000001 2024-09-13T06:43:41.131 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.131 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.131 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:41.131 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.287137+0000", 2024-09-13T06:43:41.131 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00033736699999999998 2024-09-13T06:43:41.131 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:41.131 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:41.131 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:41.131 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.131 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.131 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:209010 3.3 3:c6ff3074:::rbd_data.1121cb4a09ed.0000000000000001:82 [read 421888~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e220)", 2024-09-13T06:43:41.131 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:43:05.167018+0000", 2024-09-13T06:43:41.131 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 35.889025226000001, 2024-09-13T06:43:41.131 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.120709894, 2024-09-13T06:43:41.132 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:41.132 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:41.132 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:41.132 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:41.132 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:41.132 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 209010 2024-09-13T06:43:41.132 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.132 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:41.132 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.132 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:41.132 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.167018+0000", 2024-09-13T06:43:41.132 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:41.132 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.133 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.133 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:41.133 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.167018+0000", 2024-09-13T06:43:41.133 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:41.133 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.133 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.133 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:41.133 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.166214+0000", 2024-09-13T06:43:41.133 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9991961 2024-09-13T06:43:41.133 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.133 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.133 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:41.133 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.167039+0000", 2024-09-13T06:43:41.134 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00082531599999999998 2024-09-13T06:43:41.134 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.134 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.134 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:41.134 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.167083+0000", 2024-09-13T06:43:41.134 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.4079999999999998e-05 2024-09-13T06:43:41.134 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.134 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.134 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:41.134 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.167113+0000", 2024-09-13T06:43:41.134 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.025e-05 2024-09-13T06:43:41.134 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.134 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.134 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:41.135 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.287229+0000", 2024-09-13T06:43:41.135 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.12011563 2024-09-13T06:43:41.135 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.135 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.135 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:41.135 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.287369+0000", 2024-09-13T06:43:41.135 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00014040499999999999 2024-09-13T06:43:41.135 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.135 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.135 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:41.135 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.287727+0000", 2024-09-13T06:43:41.135 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000358043 2024-09-13T06:43:41.135 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:41.136 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:41.136 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:41.136 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.136 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.136 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:209011 3.3 3:c6ff3074:::rbd_data.1121cb4a09ed.0000000000000001:82 [read 434176~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e220)", 2024-09-13T06:43:41.136 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:43:05.167765+0000", 2024-09-13T06:43:41.136 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 35.888277731999999, 2024-09-13T06:43:41.136 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.12054767199999999, 2024-09-13T06:43:41.136 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:41.136 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:41.136 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:41.136 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:41.136 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:41.137 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 209011 2024-09-13T06:43:41.137 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.137 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:41.137 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.137 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:41.137 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.167765+0000", 2024-09-13T06:43:41.137 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:41.137 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.137 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.137 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:41.137 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.167765+0000", 2024-09-13T06:43:41.137 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:41.137 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.138 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.138 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:41.138 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.167131+0000", 2024-09-13T06:43:41.138 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9993658 2024-09-13T06:43:41.138 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.138 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.138 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:41.138 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.167772+0000", 2024-09-13T06:43:41.138 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00064152399999999998 2024-09-13T06:43:41.138 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.138 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.138 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:41.138 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.167791+0000", 2024-09-13T06:43:41.139 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.8944e-05 2024-09-13T06:43:41.139 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.139 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.139 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:41.139 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.167805+0000", 2024-09-13T06:43:41.139 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.395e-05 2024-09-13T06:43:41.139 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.139 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.139 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:41.139 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.287803+0000", 2024-09-13T06:43:41.139 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.11999747099999999 2024-09-13T06:43:41.140 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.140 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.140 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:41.140 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.287964+0000", 2024-09-13T06:43:41.140 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00016155100000000001 2024-09-13T06:43:41.140 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.140 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.140 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:41.140 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.288313+0000", 2024-09-13T06:43:41.140 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00034865699999999999 2024-09-13T06:43:41.140 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:41.141 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:41.141 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:41.141 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.141 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.141 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:209013 3.3 3:c6ff3074:::rbd_data.1121cb4a09ed.0000000000000001:82 [read 458752~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e220)", 2024-09-13T06:43:41.141 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:43:05.168880+0000", 2024-09-13T06:43:41.141 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 35.887162648, 2024-09-13T06:43:41.141 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.120462023, 2024-09-13T06:43:41.141 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:41.141 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:41.141 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:41.141 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:41.141 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:41.142 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 209013 2024-09-13T06:43:41.142 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.142 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:41.142 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.142 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:41.142 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.168880+0000", 2024-09-13T06:43:41.142 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:41.142 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.142 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.142 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:41.142 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.168880+0000", 2024-09-13T06:43:41.142 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:41.142 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.142 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.143 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:41.143 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.168879+0000", 2024-09-13T06:43:41.143 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999986 2024-09-13T06:43:41.143 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.143 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.143 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:41.143 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.168888+0000", 2024-09-13T06:43:41.143 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.9930000000000001e-06 2024-09-13T06:43:41.143 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.143 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.143 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:41.143 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.168908+0000", 2024-09-13T06:43:41.143 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.0276999999999999e-05 2024-09-13T06:43:41.144 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.144 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.144 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:41.144 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.168923+0000", 2024-09-13T06:43:41.144 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5543e-05 2024-09-13T06:43:41.144 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.144 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.144 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:41.144 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.288875+0000", 2024-09-13T06:43:41.144 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.119951748 2024-09-13T06:43:41.144 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.144 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.144 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:41.145 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.289007+0000", 2024-09-13T06:43:41.145 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00013142899999999999 2024-09-13T06:43:41.145 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.145 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.145 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:41.145 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.289342+0000", 2024-09-13T06:43:41.145 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00033566999999999999 2024-09-13T06:43:41.145 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:41.145 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:41.145 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:41.145 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.145 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.145 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:209014 3.3 3:c6ff3074:::rbd_data.1121cb4a09ed.0000000000000001:82 [read 471040~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e220)", 2024-09-13T06:43:41.145 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:43:05.169105+0000", 2024-09-13T06:43:41.146 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 35.886938190000002, 2024-09-13T06:43:41.146 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.12087680000000001, 2024-09-13T06:43:41.146 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:41.146 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:41.146 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:41.146 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:41.146 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:41.146 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 209014 2024-09-13T06:43:41.146 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.146 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:41.146 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.146 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:41.146 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.169105+0000", 2024-09-13T06:43:41.146 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:41.147 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.147 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.147 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:41.147 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.169105+0000", 2024-09-13T06:43:41.147 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:41.147 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.147 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.147 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:41.147 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.168936+0000", 2024-09-13T06:43:41.147 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9998312 2024-09-13T06:43:41.147 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.147 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.147 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:41.148 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.169115+0000", 2024-09-13T06:43:41.148 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00017854500000000001 2024-09-13T06:43:41.148 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.148 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.148 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:41.148 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.169140+0000", 2024-09-13T06:43:41.148 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.5853000000000001e-05 2024-09-13T06:43:41.148 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.148 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.148 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:41.148 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.169160+0000", 2024-09-13T06:43:41.148 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.9415999999999998e-05 2024-09-13T06:43:41.148 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.149 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.149 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:41.149 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.289414+0000", 2024-09-13T06:43:41.149 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.120253785 2024-09-13T06:43:41.149 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.149 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.149 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:41.149 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.289579+0000", 2024-09-13T06:43:41.149 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00016506299999999999 2024-09-13T06:43:41.149 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.149 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.149 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:41.149 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.289981+0000", 2024-09-13T06:43:41.150 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000402743 2024-09-13T06:43:41.150 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:41.150 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:41.150 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:41.150 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.150 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.150 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:209015 3.3 3:c6ff3074:::rbd_data.1121cb4a09ed.0000000000000001:82 [read 483328~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e220)", 2024-09-13T06:43:41.150 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:43:05.169496+0000", 2024-09-13T06:43:41.150 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 35.886547139999998, 2024-09-13T06:43:41.150 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.12105229200000001, 2024-09-13T06:43:41.150 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:41.150 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:41.150 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:41.150 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:41.151 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:41.151 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 209015 2024-09-13T06:43:41.151 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.151 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:41.151 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.151 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:41.151 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.169496+0000", 2024-09-13T06:43:41.151 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:41.151 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.151 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.151 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:41.151 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.169496+0000", 2024-09-13T06:43:41.151 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:41.152 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.152 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.152 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:41.152 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.169177+0000", 2024-09-13T06:43:41.152 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999681 2024-09-13T06:43:41.152 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.152 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.152 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:41.152 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.169509+0000", 2024-09-13T06:43:41.152 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00033226099999999998 2024-09-13T06:43:41.152 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.152 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.152 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:41.153 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.169544+0000", 2024-09-13T06:43:41.153 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.5573e-05 2024-09-13T06:43:41.153 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.153 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.153 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:41.153 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.169560+0000", 2024-09-13T06:43:41.153 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5636000000000001e-05 2024-09-13T06:43:41.153 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.153 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.153 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:41.153 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.290055+0000", 2024-09-13T06:43:41.153 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.12049523400000001 2024-09-13T06:43:41.153 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.154 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.154 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:41.154 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.290201+0000", 2024-09-13T06:43:41.154 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000145742 2024-09-13T06:43:41.154 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.154 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.154 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:41.154 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.290548+0000", 2024-09-13T06:43:41.154 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00034698699999999999 2024-09-13T06:43:41.154 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:41.154 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:41.154 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:41.154 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.154 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.155 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:209016 3.3 3:c6ff3074:::rbd_data.1121cb4a09ed.0000000000000001:82 [read 495616~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e220)", 2024-09-13T06:43:41.155 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:43:05.169893+0000", 2024-09-13T06:43:41.155 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 35.886149627000002, 2024-09-13T06:43:41.155 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.121278814, 2024-09-13T06:43:41.155 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:41.155 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:41.155 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:41.155 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:41.155 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:41.155 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 209016 2024-09-13T06:43:41.155 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.155 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:41.155 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.156 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:41.156 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.169893+0000", 2024-09-13T06:43:41.156 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:41.156 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.156 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.156 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:41.156 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.169893+0000", 2024-09-13T06:43:41.156 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:41.156 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.156 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.156 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:41.156 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.169572+0000", 2024-09-13T06:43:41.156 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9996786 2024-09-13T06:43:41.157 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.157 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.157 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:41.157 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.169903+0000", 2024-09-13T06:43:41.157 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00033101400000000003 2024-09-13T06:43:41.157 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.157 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.157 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:41.157 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.169933+0000", 2024-09-13T06:43:41.157 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.9913e-05 2024-09-13T06:43:41.157 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.157 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.157 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:41.158 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.169949+0000", 2024-09-13T06:43:41.158 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6313000000000001e-05 2024-09-13T06:43:41.158 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.158 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.158 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:41.158 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.290622+0000", 2024-09-13T06:43:41.158 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.120672795 2024-09-13T06:43:41.158 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.158 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.158 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:41.158 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.290788+0000", 2024-09-13T06:43:41.158 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00016597899999999999 2024-09-13T06:43:41.158 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.159 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.159 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:41.159 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.291172+0000", 2024-09-13T06:43:41.159 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00038422700000000001 2024-09-13T06:43:41.159 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:41.159 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:41.159 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:41.159 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.159 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.159 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:242330 3.1a 3:5cea7035:::rbd_info:head [call rbd.metadata_list in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e251)", 2024-09-13T06:43:41.159 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:43:36.447499+0000", 2024-09-13T06:43:41.159 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 4.6085438480000001, 2024-09-13T06:43:41.159 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.97783059900000002, 2024-09-13T06:43:41.159 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:41.160 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:41.160 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:41.160 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:41.160 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:41.160 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 242330 2024-09-13T06:43:41.160 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.160 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:41.160 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.160 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:41.160 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:36.447499+0000", 2024-09-13T06:43:41.160 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:41.160 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.160 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.161 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:41.161 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:36.447499+0000", 2024-09-13T06:43:41.161 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:41.161 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.161 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.161 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:41.161 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:36.447497+0000", 2024-09-13T06:43:41.161 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999976 2024-09-13T06:43:41.161 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.161 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.161 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:41.161 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:36.447510+0000", 2024-09-13T06:43:41.161 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3298999999999999e-05 2024-09-13T06:43:41.162 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.162 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.162 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:41.162 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:36.447542+0000", 2024-09-13T06:43:41.162 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.163e-05 2024-09-13T06:43:41.162 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.162 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.162 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:41.162 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:36.447556+0000", 2024-09-13T06:43:41.162 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.4416999999999999e-05 2024-09-13T06:43:41.162 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.162 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.162 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:41.162 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:36.447667+0000", 2024-09-13T06:43:41.163 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000110886 2024-09-13T06:43:41.163 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.163 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.163 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:43:41.163 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:36.447688+0000", 2024-09-13T06:43:41.163 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.0656e-05 2024-09-13T06:43:41.163 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.163 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.163 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:41.163 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:37.424923+0000", 2024-09-13T06:43:41.163 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.97723487399999998 2024-09-13T06:43:41.163 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.163 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.164 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:41.164 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:37.425107+0000", 2024-09-13T06:43:41.164 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00018405900000000001 2024-09-13T06:43:41.164 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.164 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.164 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:41.164 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:37.425330+0000", 2024-09-13T06:43:41.164 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00022296800000000001 2024-09-13T06:43:41.164 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:41.164 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:41.164 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:41.164 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:41.164 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:41.165 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:43:41.166 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-13T06:43:41.166 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:43:41.165+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:43:41.268 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:43:41.267+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:43:41.333 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:43:41.333 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [], 2024-09-13T06:43:41.334 INFO:teuthology.orchestra.run.smithi139.stdout: "num_ops": 0 2024-09-13T06:43:41.334 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:43:41.347 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-13T06:43:41.391 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-13T06:43:41.393+0000 7fa8bb18e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 36790) UID: 0 2024-09-13T06:43:41.416 INFO:teuthology.orchestra.run.smithi081.stderr:nodeep-scrub is set 2024-09-13T06:43:41.468 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:43:41.468 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [], 2024-09-13T06:43:41.468 INFO:teuthology.orchestra.run.smithi139.stdout: "complaint_time": 30, 2024-09-13T06:43:41.468 INFO:teuthology.orchestra.run.smithi139.stdout: "num_blocked_ops": 0 2024-09-13T06:43:41.468 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:43:41.468 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-13T06:43:41.469+0000 7fa8bb18e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 36790) UID: 0 2024-09-13T06:43:41.483 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-13T06:43:41.587 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:43:41.573+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:43:41.664 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:43:41.664 INFO:teuthology.orchestra.run.smithi139.stdout: "size": 20, 2024-09-13T06:43:41.664 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 600, 2024-09-13T06:43:41.665 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [ 2024-09-13T06:43:41.665 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.665 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43299 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 432128~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:43:41.665 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589881+0000", 2024-09-13T06:43:41.665 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 200.07310603799999, 2024-09-13T06:43:41.665 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.079693849999999997, 2024-09-13T06:43:41.665 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:41.665 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:41.665 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:41.665 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:41.666 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:41.666 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43299 2024-09-13T06:43:41.666 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.666 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:41.666 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.666 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:41.666 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589881+0000", 2024-09-13T06:43:41.666 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:41.666 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.666 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.667 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:41.667 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589881+0000", 2024-09-13T06:43:41.667 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:41.667 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.667 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.667 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:41.667 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589880+0000", 2024-09-13T06:43:41.667 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:43:41.667 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.667 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.668 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:41.668 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589884+0000", 2024-09-13T06:43:41.668 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.053e-06 2024-09-13T06:43:41.668 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.668 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.668 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:41.668 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589893+0000", 2024-09-13T06:43:41.668 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.2129999999999997e-06 2024-09-13T06:43:41.668 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.668 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.669 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:41.669 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589901+0000", 2024-09-13T06:43:41.669 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.6399999999999997e-06 2024-09-13T06:43:41.669 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.669 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.669 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:41.669 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.669213+0000", 2024-09-13T06:43:41.669 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.079312074999999996 2024-09-13T06:43:41.669 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.669 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.670 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:41.670 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.669281+0000", 2024-09-13T06:43:41.670 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.8322000000000001e-05 2024-09-13T06:43:41.670 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.670 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.670 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:41.670 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.669575+0000", 2024-09-13T06:43:41.670 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00029349699999999999 2024-09-13T06:43:41.670 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:41.670 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:41.670 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:41.670 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.671 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.671 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43300 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 446464~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:43:41.671 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589909+0000", 2024-09-13T06:43:41.671 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 200.073078143, 2024-09-13T06:43:41.671 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.080339496999999996, 2024-09-13T06:43:41.671 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:41.671 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:41.671 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:41.671 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:41.672 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:41.672 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43300 2024-09-13T06:43:41.672 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.672 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:41.672 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.672 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:41.672 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589909+0000", 2024-09-13T06:43:41.672 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:41.672 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.672 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.672 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:41.672 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589909+0000", 2024-09-13T06:43:41.673 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:41.673 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.673 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.673 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:41.673 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589908+0000", 2024-09-13T06:43:41.673 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:43:41.673 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.673 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.673 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:41.673 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589912+0000", 2024-09-13T06:43:41.673 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.9430000000000002e-06 2024-09-13T06:43:41.674 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.674 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.674 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:41.674 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589920+0000", 2024-09-13T06:43:41.674 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.3860000000000007e-06 2024-09-13T06:43:41.674 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.674 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.674 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:41.674 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589928+0000", 2024-09-13T06:43:41.674 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.3329999999999999e-06 2024-09-13T06:43:41.674 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.674 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.675 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:41.675 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.669651+0000", 2024-09-13T06:43:41.675 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.079723204000000006 2024-09-13T06:43:41.675 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.675 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.675 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:41.675 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.669840+0000", 2024-09-13T06:43:41.675 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000189397 2024-09-13T06:43:41.675 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.675 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.675 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:41.676 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.670248+0000", 2024-09-13T06:43:41.676 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00040811100000000001 2024-09-13T06:43:41.676 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:41.676 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:41.676 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:41.676 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.676 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.676 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43301 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 460800~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:43:41.676 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589934+0000", 2024-09-13T06:43:41.676 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 200.073053469, 2024-09-13T06:43:41.676 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.080747474999999999, 2024-09-13T06:43:41.676 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:41.677 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:41.677 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:41.677 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:41.677 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:41.677 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43301 2024-09-13T06:43:41.677 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.677 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:41.677 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.677 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:41.680 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589934+0000", 2024-09-13T06:43:41.680 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:41.680 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.680 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.680 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:41.680 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589934+0000", 2024-09-13T06:43:41.680 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:41.680 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.680 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.681 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:41.681 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589933+0000", 2024-09-13T06:43:41.681 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:41.681 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.681 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.681 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:41.681 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589936+0000", 2024-09-13T06:43:41.681 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.4599999999999999e-06 2024-09-13T06:43:41.681 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.681 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.681 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:41.681 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589945+0000", 2024-09-13T06:43:41.681 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.2430000000000005e-06 2024-09-13T06:43:41.682 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.682 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.682 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:41.682 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589952+0000", 2024-09-13T06:43:41.682 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.3289999999999996e-06 2024-09-13T06:43:41.682 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.682 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.682 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:41.682 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.670280+0000", 2024-09-13T06:43:41.682 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.080328514000000004 2024-09-13T06:43:41.682 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.682 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.682 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:41.683 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.670376+0000", 2024-09-13T06:43:41.683 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.5752000000000001e-05 2024-09-13T06:43:41.683 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.683 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.683 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:41.683 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.670681+0000", 2024-09-13T06:43:41.683 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00030479699999999999 2024-09-13T06:43:41.683 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:41.683 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:41.683 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:41.683 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.683 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.683 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43302 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 475136~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:43:41.684 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589958+0000", 2024-09-13T06:43:41.684 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 200.07302940700001, 2024-09-13T06:43:41.684 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.081402394000000003, 2024-09-13T06:43:41.684 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:41.684 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:41.684 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:41.684 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:41.684 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:41.684 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43302 2024-09-13T06:43:41.684 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.684 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:41.685 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.685 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:41.685 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589958+0000", 2024-09-13T06:43:41.685 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:41.685 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.685 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.685 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:41.685 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589958+0000", 2024-09-13T06:43:41.685 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:41.685 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.685 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.685 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:41.685 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589957+0000", 2024-09-13T06:43:41.685 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:41.686 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.686 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.686 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:41.686 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589960+0000", 2024-09-13T06:43:41.686 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.4939999999999999e-06 2024-09-13T06:43:41.686 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.686 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.686 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:41.686 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589969+0000", 2024-09-13T06:43:41.686 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.3520000000000007e-06 2024-09-13T06:43:41.686 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.686 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.686 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:41.687 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589976+0000", 2024-09-13T06:43:41.687 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.3030000000000002e-06 2024-09-13T06:43:41.687 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.687 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.687 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:41.687 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.670765+0000", 2024-09-13T06:43:41.687 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.080789154000000002 2024-09-13T06:43:41.687 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.687 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.687 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:41.687 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.670960+0000", 2024-09-13T06:43:41.687 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00019464300000000001 2024-09-13T06:43:41.687 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.688 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.688 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:41.688 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.671360+0000", 2024-09-13T06:43:41.688 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00040005200000000002 2024-09-13T06:43:41.688 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:41.688 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:41.688 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:41.688 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.688 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.688 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43303 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 489472~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:43:41.688 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589985+0000", 2024-09-13T06:43:41.688 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 200.07300245900001, 2024-09-13T06:43:41.689 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.082024333000000005, 2024-09-13T06:43:41.689 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:41.689 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:41.689 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:41.689 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:41.689 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:41.689 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43303 2024-09-13T06:43:41.689 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.689 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:41.689 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.689 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:41.689 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589985+0000", 2024-09-13T06:43:41.690 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:41.690 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.690 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.690 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:41.690 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589985+0000", 2024-09-13T06:43:41.690 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:41.690 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.690 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.690 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:41.690 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589984+0000", 2024-09-13T06:43:41.690 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:43:41.690 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.690 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.691 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:41.691 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589987+0000", 2024-09-13T06:43:41.691 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.726e-06 2024-09-13T06:43:41.691 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.691 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.691 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:41.691 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589996+0000", 2024-09-13T06:43:41.691 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.5459999999999992e-06 2024-09-13T06:43:41.691 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.691 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.691 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:41.691 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590003+0000", 2024-09-13T06:43:41.692 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.4229999999999999e-06 2024-09-13T06:43:41.692 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.692 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.692 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:41.692 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.671426+0000", 2024-09-13T06:43:41.692 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.081422704999999998 2024-09-13T06:43:41.692 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.692 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.692 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:41.692 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.671615+0000", 2024-09-13T06:43:41.692 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000188875 2024-09-13T06:43:41.692 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.692 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.693 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:41.693 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.672009+0000", 2024-09-13T06:43:41.693 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000394015 2024-09-13T06:43:41.693 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:41.693 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:41.693 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:41.693 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.693 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.693 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43304 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 503808~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:43:41.693 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.590039+0000", 2024-09-13T06:43:41.693 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 200.072947914, 2024-09-13T06:43:41.694 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.082573880000000002, 2024-09-13T06:43:41.694 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:41.694 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:41.694 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:41.694 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:41.694 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:41.694 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43304 2024-09-13T06:43:41.694 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.694 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:41.695 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.695 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:41.695 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590039+0000", 2024-09-13T06:43:41.695 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:41.695 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.695 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.696 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:41.696 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590039+0000", 2024-09-13T06:43:41.696 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:41.696 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.696 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.696 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:41.696 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590038+0000", 2024-09-13T06:43:41.696 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:43:41.696 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.697 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.697 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:41.697 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590042+0000", 2024-09-13T06:43:41.697 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.9500000000000003e-06 2024-09-13T06:43:41.697 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.697 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.697 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:41.697 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590052+0000", 2024-09-13T06:43:41.697 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.3919999999999992e-06 2024-09-13T06:43:41.697 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.697 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.698 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:41.698 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590059+0000", 2024-09-13T06:43:41.698 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.7970000000000001e-06 2024-09-13T06:43:41.698 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.698 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.698 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:41.698 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.672078+0000", 2024-09-13T06:43:41.698 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.082018778000000001 2024-09-13T06:43:41.698 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.698 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.698 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:41.698 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.672266+0000", 2024-09-13T06:43:41.698 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00018807399999999999 2024-09-13T06:43:41.698 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.698 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.699 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:41.699 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.672613+0000", 2024-09-13T06:43:41.699 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00034677599999999997 2024-09-13T06:43:41.699 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:41.699 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:41.699 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:41.699 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.699 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.699 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43305 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 518144~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:43:41.699 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.590136+0000", 2024-09-13T06:43:41.699 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 200.07285072600001, 2024-09-13T06:43:41.700 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.082988206999999994, 2024-09-13T06:43:41.700 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:41.700 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:41.700 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:41.700 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:41.700 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:41.700 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43305 2024-09-13T06:43:41.700 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.700 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:41.700 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.700 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:41.700 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590136+0000", 2024-09-13T06:43:41.700 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:41.700 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.701 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.701 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:41.701 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590136+0000", 2024-09-13T06:43:41.701 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:41.701 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.701 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.701 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:41.701 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590135+0000", 2024-09-13T06:43:41.701 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:43:41.701 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.701 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.701 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:41.702 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590139+0000", 2024-09-13T06:43:41.702 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.9489999999999998e-06 2024-09-13T06:43:41.702 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.702 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.702 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:41.702 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590148+0000", 2024-09-13T06:43:41.702 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.9830000000000002e-06 2024-09-13T06:43:41.702 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.702 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.702 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:41.702 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590156+0000", 2024-09-13T06:43:41.702 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5229999999999998e-06 2024-09-13T06:43:41.702 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.702 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.703 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:41.703 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.672709+0000", 2024-09-13T06:43:41.703 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.082552886000000006 2024-09-13T06:43:41.703 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.703 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.703 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:41.703 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.672816+0000", 2024-09-13T06:43:41.703 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000107736 2024-09-13T06:43:41.703 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.703 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.704 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:41.704 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.673124+0000", 2024-09-13T06:43:41.704 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00030804900000000002 2024-09-13T06:43:41.704 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:41.704 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:41.704 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:41.704 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.704 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.704 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:66818 3.17 3.50afe697 (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e100)", 2024-09-13T06:43:41.704 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:53.498942+0000", 2024-09-13T06:43:41.704 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 168.16404454100001, 2024-09-13T06:43:41.704 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.011231284, 2024-09-13T06:43:41.705 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:41.705 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:43:41.705 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:41.705 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:41.705 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:41.705 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 66818 2024-09-13T06:43:41.705 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.705 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:41.705 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.705 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:41.705 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:53.498942+0000", 2024-09-13T06:43:41.705 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:41.706 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.706 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.706 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:41.706 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:53.498942+0000", 2024-09-13T06:43:41.706 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:41.706 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.706 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.706 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:41.706 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:53.498939+0000", 2024-09-13T06:43:41.706 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999967 2024-09-13T06:43:41.706 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.706 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.706 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:41.706 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:53.498954+0000", 2024-09-13T06:43:41.707 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5028000000000001e-05 2024-09-13T06:43:41.707 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.707 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.707 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:41.707 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:53.498986+0000", 2024-09-13T06:43:41.707 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.1993999999999999e-05 2024-09-13T06:43:41.707 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.707 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.707 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:41.707 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:53.499001+0000", 2024-09-13T06:43:41.707 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5166e-05 2024-09-13T06:43:41.707 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.707 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.707 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:41.708 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:53.505097+0000", 2024-09-13T06:43:41.708 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0060955610000000002 2024-09-13T06:43:41.708 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.708 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.708 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:43:41.708 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:53.505108+0000", 2024-09-13T06:43:41.708 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.084e-05 2024-09-13T06:43:41.708 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.708 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.708 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:41.708 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:54.510158+0000", 2024-09-13T06:43:41.708 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0050497549999999 2024-09-13T06:43:41.708 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.708 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.709 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:41.709 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:54.510174+0000", 2024-09-13T06:43:41.709 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6164e-05 2024-09-13T06:43:41.709 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:41.709 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:41.709 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:41.709 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.709 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.709 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:69764 3.2 3:47f10058:::rbd_data.11214956a993.0000000000000004:head [write-same] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e117)", 2024-09-13T06:43:41.709 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:41:11.371147+0000", 2024-09-13T06:43:41.709 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 150.29184023100001, 2024-09-13T06:43:41.709 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.03470167, 2024-09-13T06:43:41.710 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:41.710 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:43:41.710 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:41.710 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:41.710 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:41.710 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 69764 2024-09-13T06:43:41.710 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.710 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:41.710 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.710 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:41.710 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:11.371147+0000", 2024-09-13T06:43:41.710 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:41.710 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.710 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.710 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:41.711 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:11.371147+0000", 2024-09-13T06:43:41.711 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:41.711 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.711 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.711 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:41.711 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:11.371144+0000", 2024-09-13T06:43:41.711 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999967 2024-09-13T06:43:41.711 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.711 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.711 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:41.711 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:11.371161+0000", 2024-09-13T06:43:41.711 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7669e-05 2024-09-13T06:43:41.711 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.712 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.712 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:41.712 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:11.371198+0000", 2024-09-13T06:43:41.712 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.7014000000000002e-05 2024-09-13T06:43:41.712 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.712 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.712 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:41.712 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:11.371216+0000", 2024-09-13T06:43:41.712 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7425e-05 2024-09-13T06:43:41.712 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.712 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.712 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:41.712 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:11.371365+0000", 2024-09-13T06:43:41.713 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000149245 2024-09-13T06:43:41.713 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.713 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.713 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op must wait for map", 2024-09-13T06:43:41.713 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:11.371385+0000", 2024-09-13T06:43:41.713 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.0018999999999999e-05 2024-09-13T06:43:41.713 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.713 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.713 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:41.713 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:11.378406+0000", 2024-09-13T06:43:41.713 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0070207179999999996 2024-09-13T06:43:41.713 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.713 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.713 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:43:41.714 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:11.378429+0000", 2024-09-13T06:43:41.714 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.3453999999999999e-05 2024-09-13T06:43:41.714 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.714 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.714 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:41.714 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:12.405667+0000", 2024-09-13T06:43:41.714 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0272381690000001 2024-09-13T06:43:41.714 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.714 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.714 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:41.714 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:12.405848+0000", 2024-09-13T06:43:41.714 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00018112 2024-09-13T06:43:41.714 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:41.714 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:41.715 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:41.715 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.715 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.715 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:70346 3.16 3:69d35907:::rbd_object_map.11214956a993:head [read 0~36] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e122)", 2024-09-13T06:43:41.715 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:41:16.390917+0000", 2024-09-13T06:43:41.715 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 145.272070179, 2024-09-13T06:43:41.715 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.99327479799999996, 2024-09-13T06:43:41.715 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:41.715 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:41.715 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:41.715 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:41.715 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:41.715 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 70346 2024-09-13T06:43:41.715 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.716 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:41.716 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.716 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:41.716 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:16.390917+0000", 2024-09-13T06:43:41.716 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:41.716 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.716 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.716 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:41.716 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:16.390917+0000", 2024-09-13T06:43:41.716 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:41.716 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.716 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.716 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:41.716 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:16.390916+0000", 2024-09-13T06:43:41.717 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999986 2024-09-13T06:43:41.717 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.717 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.717 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:41.717 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:16.390922+0000", 2024-09-13T06:43:41.717 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.0480000000000004e-06 2024-09-13T06:43:41.717 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.717 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.717 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:41.717 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:16.390933+0000", 2024-09-13T06:43:41.717 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1387e-05 2024-09-13T06:43:41.717 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.718 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.718 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:41.718 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:16.390939+0000", 2024-09-13T06:43:41.718 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.8039999999999998e-06 2024-09-13T06:43:41.718 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.718 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.718 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:41.718 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:16.390983+0000", 2024-09-13T06:43:41.718 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.4663000000000003e-05 2024-09-13T06:43:41.718 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.718 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.718 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:43:41.718 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:16.390991+0000", 2024-09-13T06:43:41.718 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.8059999999999995e-06 2024-09-13T06:43:41.719 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.719 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.719 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:41.719 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:17.383624+0000", 2024-09-13T06:43:41.719 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.99263277299999997 2024-09-13T06:43:41.719 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.719 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.719 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:41.719 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:17.383891+0000", 2024-09-13T06:43:41.719 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00026717599999999999 2024-09-13T06:43:41.719 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.719 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.719 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:41.719 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:17.384192+0000", 2024-09-13T06:43:41.720 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00030047400000000001 2024-09-13T06:43:41.720 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:41.720 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:41.720 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:41.720 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.720 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.720 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:181624 3.1d 3:be5d0ef9:::rbd_data.11218aab7a9c.0000000000000000:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e203)", 2024-09-13T06:43:41.720 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:42:45.701744+0000", 2024-09-13T06:43:41.720 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 55.961243259, 2024-09-13T06:43:41.720 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.69964504800000005, 2024-09-13T06:43:41.720 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:41.720 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:41.720 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:41.720 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:41.721 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:41.721 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 181624 2024-09-13T06:43:41.721 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.721 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:41.721 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.721 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:41.721 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.701744+0000", 2024-09-13T06:43:41.721 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:41.721 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.721 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.721 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:41.721 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.701744+0000", 2024-09-13T06:43:41.722 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:41.722 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.722 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.722 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:41.722 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.701741+0000", 2024-09-13T06:43:41.722 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999976 2024-09-13T06:43:41.722 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.722 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.722 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:41.722 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.701754+0000", 2024-09-13T06:43:41.722 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2632999999999999e-05 2024-09-13T06:43:41.722 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.723 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.723 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:41.723 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.701789+0000", 2024-09-13T06:43:41.723 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.4993999999999997e-05 2024-09-13T06:43:41.723 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.723 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.723 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:41.723 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.701806+0000", 2024-09-13T06:43:41.723 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7016000000000001e-05 2024-09-13T06:43:41.723 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.723 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.723 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:41.724 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.701905+0000", 2024-09-13T06:43:41.724 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.8895999999999996e-05 2024-09-13T06:43:41.724 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.724 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.724 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:43:41.724 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.701920+0000", 2024-09-13T06:43:41.724 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5013e-05 2024-09-13T06:43:41.724 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.725 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.725 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:41.725 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.400672+0000", 2024-09-13T06:43:41.725 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.69875254499999995 2024-09-13T06:43:41.725 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.725 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.725 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:41.725 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.401034+0000", 2024-09-13T06:43:41.725 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00036181700000000001 2024-09-13T06:43:41.725 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.725 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.726 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:41.726 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.401389+0000", 2024-09-13T06:43:41.726 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00035464399999999999 2024-09-13T06:43:41.726 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:41.726 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:41.726 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:41.726 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.726 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.726 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:181638 3.1d 3:be5d0ef9:::rbd_data.11218aab7a9c.0000000000000000:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e203)", 2024-09-13T06:43:41.726 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:42:45.707356+0000", 2024-09-13T06:43:41.726 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 55.95563052, 2024-09-13T06:43:41.726 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.694720479, 2024-09-13T06:43:41.727 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:41.727 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:41.727 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:41.727 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:41.727 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:41.727 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 181638 2024-09-13T06:43:41.727 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.727 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:41.727 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.727 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:41.727 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707356+0000", 2024-09-13T06:43:41.728 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:41.728 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.728 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.728 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:41.728 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707356+0000", 2024-09-13T06:43:41.728 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:41.728 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.728 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.728 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:41.729 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707355+0000", 2024-09-13T06:43:41.729 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999981 2024-09-13T06:43:41.729 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.729 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.729 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:41.729 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707375+0000", 2024-09-13T06:43:41.729 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.0698000000000001e-05 2024-09-13T06:43:41.729 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.729 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.729 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:41.729 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707396+0000", 2024-09-13T06:43:41.729 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.1041000000000001e-05 2024-09-13T06:43:41.730 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.730 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.730 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:41.730 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707408+0000", 2024-09-13T06:43:41.730 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1583000000000001e-05 2024-09-13T06:43:41.730 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.730 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.730 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:41.730 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707513+0000", 2024-09-13T06:43:41.730 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000104981 2024-09-13T06:43:41.730 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.730 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.731 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:43:41.731 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707541+0000", 2024-09-13T06:43:41.731 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.8572999999999999e-05 2024-09-13T06:43:41.731 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.731 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.731 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:41.731 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.401666+0000", 2024-09-13T06:43:41.731 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.694124988 2024-09-13T06:43:41.731 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.731 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.731 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:41.731 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.401880+0000", 2024-09-13T06:43:41.731 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00021322100000000001 2024-09-13T06:43:41.732 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.732 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.732 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:41.732 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.402077+0000", 2024-09-13T06:43:41.732 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000197321 2024-09-13T06:43:41.732 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:41.732 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:41.732 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:41.732 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.732 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.732 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:181652 3.1d 3:be5d0ef9:::rbd_data.11218aab7a9c.0000000000000000:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e203)", 2024-09-13T06:43:41.732 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:42:45.707423+0000", 2024-09-13T06:43:41.733 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 55.955563988999998, 2024-09-13T06:43:41.733 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.69480806699999997, 2024-09-13T06:43:41.733 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:41.733 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:41.733 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:41.733 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:41.733 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:41.733 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 181652 2024-09-13T06:43:41.733 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.733 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:41.733 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.733 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:41.733 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707423+0000", 2024-09-13T06:43:41.734 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:41.734 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.734 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.734 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:41.734 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707423+0000", 2024-09-13T06:43:41.734 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:41.734 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.734 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.734 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:41.734 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707423+0000", 2024-09-13T06:43:41.734 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:41.734 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.734 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.734 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:41.734 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707427+0000", 2024-09-13T06:43:41.735 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.2010000000000001e-06 2024-09-13T06:43:41.735 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.735 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.735 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:41.735 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707442+0000", 2024-09-13T06:43:41.735 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.4993e-05 2024-09-13T06:43:41.735 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.735 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.735 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:41.735 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707447+0000", 2024-09-13T06:43:41.735 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.2170000000000002e-06 2024-09-13T06:43:41.735 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.735 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.735 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:41.736 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707656+0000", 2024-09-13T06:43:41.736 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00020908600000000001 2024-09-13T06:43:41.736 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.736 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.736 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:43:41.736 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707684+0000", 2024-09-13T06:43:41.736 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.7766000000000001e-05 2024-09-13T06:43:41.736 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.736 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.736 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:41.736 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.402101+0000", 2024-09-13T06:43:41.736 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.69441698100000004 2024-09-13T06:43:41.736 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.736 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.737 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:41.737 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.402156+0000", 2024-09-13T06:43:41.737 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.4725000000000002e-05 2024-09-13T06:43:41.737 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.737 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.737 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:41.737 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.402231+0000", 2024-09-13T06:43:41.737 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5587999999999995e-05 2024-09-13T06:43:41.737 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:41.737 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:41.737 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:41.737 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.737 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.737 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:181666 3.1d 3:be5d0ef9:::rbd_data.11218aab7a9c.0000000000000000:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e203)", 2024-09-13T06:43:41.737 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:42:45.707478+0000", 2024-09-13T06:43:41.738 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 55.955508803000001, 2024-09-13T06:43:41.738 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.69543359900000001, 2024-09-13T06:43:41.738 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:41.738 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:41.738 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:41.738 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:41.738 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:41.738 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 181666 2024-09-13T06:43:41.738 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.738 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:41.738 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.738 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:41.738 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707478+0000", 2024-09-13T06:43:41.738 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:41.738 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.739 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.739 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:41.739 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707478+0000", 2024-09-13T06:43:41.739 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:41.739 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.739 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.739 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:41.739 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707478+0000", 2024-09-13T06:43:41.739 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:41.739 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.739 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.739 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:41.739 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707481+0000", 2024-09-13T06:43:41.739 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.3589999999999999e-06 2024-09-13T06:43:41.739 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.740 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.740 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:41.740 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707492+0000", 2024-09-13T06:43:41.740 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0725e-05 2024-09-13T06:43:41.740 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.740 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.740 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:41.740 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707500+0000", 2024-09-13T06:43:41.740 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.1089999999999998e-06 2024-09-13T06:43:41.740 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.740 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.740 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:41.740 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707773+0000", 2024-09-13T06:43:41.741 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000273291 2024-09-13T06:43:41.741 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.741 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.741 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:43:41.741 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707784+0000", 2024-09-13T06:43:41.741 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0441999999999999e-05 2024-09-13T06:43:41.741 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.741 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.741 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:41.741 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.402290+0000", 2024-09-13T06:43:41.741 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.69450651500000005 2024-09-13T06:43:41.741 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.741 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.741 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:41.742 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.402489+0000", 2024-09-13T06:43:41.742 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000198999 2024-09-13T06:43:41.742 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.742 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.742 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:41.742 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.402912+0000", 2024-09-13T06:43:41.742 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00042257299999999998 2024-09-13T06:43:41.742 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:41.742 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:41.742 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:41.742 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.742 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.742 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:181680 3.1d 3:be5d0ef9:::rbd_data.11218aab7a9c.0000000000000000:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e203)", 2024-09-13T06:43:41.743 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:42:45.707517+0000", 2024-09-13T06:43:41.743 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 55.955469766999997, 2024-09-13T06:43:41.743 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.69532440799999995, 2024-09-13T06:43:41.743 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:41.743 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:41.743 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:41.743 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:41.743 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:41.743 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 181680 2024-09-13T06:43:41.743 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.743 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:41.743 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.743 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:41.743 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707517+0000", 2024-09-13T06:43:41.743 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:41.744 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.744 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.744 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:41.744 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707517+0000", 2024-09-13T06:43:41.744 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:41.744 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.744 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.744 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:41.744 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707517+0000", 2024-09-13T06:43:41.744 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:41.744 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.744 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.744 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:41.744 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707519+0000", 2024-09-13T06:43:41.745 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.2800000000000002e-06 2024-09-13T06:43:41.745 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.745 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.745 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:41.745 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707527+0000", 2024-09-13T06:43:41.745 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.2660000000000001e-06 2024-09-13T06:43:41.745 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.745 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.745 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:41.745 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707535+0000", 2024-09-13T06:43:41.745 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.1760000000000004e-06 2024-09-13T06:43:41.745 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.745 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.746 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:41.746 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707838+0000", 2024-09-13T06:43:41.746 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00030318000000000001 2024-09-13T06:43:41.746 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.746 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.746 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:43:41.746 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707850+0000", 2024-09-13T06:43:41.746 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1787000000000001e-05 2024-09-13T06:43:41.746 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.746 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.746 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:41.746 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.402702+0000", 2024-09-13T06:43:41.746 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.69485264599999996 2024-09-13T06:43:41.746 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.747 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.747 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:41.747 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.402783+0000", 2024-09-13T06:43:41.747 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.1114999999999998e-05 2024-09-13T06:43:41.747 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.747 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.747 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:41.747 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.402842+0000", 2024-09-13T06:43:41.747 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.8322999999999997e-05 2024-09-13T06:43:41.747 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:41.747 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:41.747 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:41.747 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.748 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.748 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:181694 3.1d 3:be5d0ef9:::rbd_data.11218aab7a9c.0000000000000000:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e203)", 2024-09-13T06:43:41.748 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:42:45.707544+0000", 2024-09-13T06:43:41.748 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 55.955443074999998, 2024-09-13T06:43:41.748 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.69580726699999995, 2024-09-13T06:43:41.748 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:41.748 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:41.748 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:41.748 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:41.748 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:41.748 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 181694 2024-09-13T06:43:41.748 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.748 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:41.748 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.748 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:41.749 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707544+0000", 2024-09-13T06:43:41.749 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:41.749 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.749 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.749 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:41.749 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707544+0000", 2024-09-13T06:43:41.749 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:41.749 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.749 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.749 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:41.749 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707543+0000", 2024-09-13T06:43:41.749 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:41.749 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.750 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.750 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:41.750 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707561+0000", 2024-09-13T06:43:41.750 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7804000000000001e-05 2024-09-13T06:43:41.750 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.750 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.750 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:41.750 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707575+0000", 2024-09-13T06:43:41.750 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3884e-05 2024-09-13T06:43:41.750 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.750 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.750 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:41.751 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707583+0000", 2024-09-13T06:43:41.751 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5730000000000002e-06 2024-09-13T06:43:41.751 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.751 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.751 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:41.751 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707899+0000", 2024-09-13T06:43:41.751 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00031663999999999998 2024-09-13T06:43:41.751 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.751 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.751 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:43:41.751 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707908+0000", 2024-09-13T06:43:41.751 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.1430000000000004e-06 2024-09-13T06:43:41.751 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.752 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.752 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:41.752 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.402973+0000", 2024-09-13T06:43:41.752 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.69506426099999996 2024-09-13T06:43:41.752 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.752 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.752 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:41.752 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.403155+0000", 2024-09-13T06:43:41.752 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00018245199999999999 2024-09-13T06:43:41.752 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.752 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.752 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:41.752 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.403351+0000", 2024-09-13T06:43:41.753 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000196028 2024-09-13T06:43:41.753 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:41.753 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:41.753 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:41.753 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.753 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.753 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:181708 3.1d 3:be5d0ef9:::rbd_data.11218aab7a9c.0000000000000000:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e203)", 2024-09-13T06:43:41.753 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:42:45.707622+0000", 2024-09-13T06:43:41.753 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 55.955365030999999, 2024-09-13T06:43:41.753 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.69603707699999995, 2024-09-13T06:43:41.753 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:41.753 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:41.754 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:41.754 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:41.754 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:41.754 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 181708 2024-09-13T06:43:41.754 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.754 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:41.754 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.754 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:41.754 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707622+0000", 2024-09-13T06:43:41.754 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:41.754 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.754 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.754 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:41.755 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707622+0000", 2024-09-13T06:43:41.755 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:41.755 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.755 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.755 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:41.755 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707621+0000", 2024-09-13T06:43:41.755 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:41.755 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.755 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.755 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:41.755 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707624+0000", 2024-09-13T06:43:41.755 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.8210000000000002e-06 2024-09-13T06:43:41.755 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.756 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.756 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:41.756 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707631+0000", 2024-09-13T06:43:41.756 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.8460000000000002e-06 2024-09-13T06:43:41.756 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.756 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.756 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:41.756 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707635+0000", 2024-09-13T06:43:41.756 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.4610000000000001e-06 2024-09-13T06:43:41.756 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.756 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.756 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:41.756 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707955+0000", 2024-09-13T06:43:41.756 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00031982000000000001 2024-09-13T06:43:41.757 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.757 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.757 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:43:41.757 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707966+0000", 2024-09-13T06:43:41.757 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0822000000000001e-05 2024-09-13T06:43:41.757 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.757 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.757 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:41.757 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.403541+0000", 2024-09-13T06:43:41.757 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.69557444300000004 2024-09-13T06:43:41.757 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.758 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.758 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:41.758 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.403598+0000", 2024-09-13T06:43:41.758 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.7147e-05 2024-09-13T06:43:41.758 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.758 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.758 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:41.758 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.403659+0000", 2024-09-13T06:43:41.758 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.1373999999999999e-05 2024-09-13T06:43:41.758 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:41.758 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:41.758 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:41.758 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.759 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.759 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:181722 3.1d 3:be5d0ef9:::rbd_data.11218aab7a9c.0000000000000000:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e203)", 2024-09-13T06:43:41.759 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:42:45.707640+0000", 2024-09-13T06:43:41.759 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 55.955346579999997, 2024-09-13T06:43:41.759 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.69620305800000004, 2024-09-13T06:43:41.759 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:41.759 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:41.759 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:41.759 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:41.759 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:41.759 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 181722 2024-09-13T06:43:41.759 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.759 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:41.759 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.759 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:41.760 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707640+0000", 2024-09-13T06:43:41.760 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:41.760 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.760 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.760 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:41.760 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707640+0000", 2024-09-13T06:43:41.760 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:41.760 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.760 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.760 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:41.760 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707640+0000", 2024-09-13T06:43:41.760 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:41.760 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.761 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.761 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:41.761 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707643+0000", 2024-09-13T06:43:41.761 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.213e-06 2024-09-13T06:43:41.761 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.761 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.761 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:41.761 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707651+0000", 2024-09-13T06:43:41.761 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.2290000000000003e-06 2024-09-13T06:43:41.761 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.761 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.761 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:41.761 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707656+0000", 2024-09-13T06:43:41.761 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.9320000000000004e-06 2024-09-13T06:43:41.761 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.762 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.762 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:41.762 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.708012+0000", 2024-09-13T06:43:41.762 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00035600600000000002 2024-09-13T06:43:41.762 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.762 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.762 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:43:41.762 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.708024+0000", 2024-09-13T06:43:41.762 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1336e-05 2024-09-13T06:43:41.762 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.762 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.762 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:41.762 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.403696+0000", 2024-09-13T06:43:41.763 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.69567234499999997 2024-09-13T06:43:41.763 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.763 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.763 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:41.763 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.403757+0000", 2024-09-13T06:43:41.763 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.0715999999999999e-05 2024-09-13T06:43:41.763 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.763 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.763 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:41.763 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.403843+0000", 2024-09-13T06:43:41.763 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6679000000000001e-05 2024-09-13T06:43:41.763 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:41.763 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:41.764 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:41.764 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.764 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.764 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:181736 3.1d 3:be5d0ef9:::rbd_data.11218aab7a9c.0000000000000000:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e203)", 2024-09-13T06:43:41.764 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:42:45.707661+0000", 2024-09-13T06:43:41.764 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 55.955326212999999, 2024-09-13T06:43:41.764 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.69667210700000004, 2024-09-13T06:43:41.764 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:41.764 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:41.764 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:41.764 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:41.764 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:41.764 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 181736 2024-09-13T06:43:41.764 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.765 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:41.765 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.765 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:41.765 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707661+0000", 2024-09-13T06:43:41.765 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:41.765 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.765 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.765 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:41.765 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707661+0000", 2024-09-13T06:43:41.765 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:41.765 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.765 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.765 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:41.765 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707660+0000", 2024-09-13T06:43:41.766 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:41.766 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.766 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.766 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:41.766 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707664+0000", 2024-09-13T06:43:41.766 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.393e-06 2024-09-13T06:43:41.766 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.766 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.766 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:41.766 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707673+0000", 2024-09-13T06:43:41.766 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.5100000000000004e-06 2024-09-13T06:43:41.766 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.766 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.766 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:41.767 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707680+0000", 2024-09-13T06:43:41.767 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.8680000000000001e-06 2024-09-13T06:43:41.767 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.767 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.767 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:41.767 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.708068+0000", 2024-09-13T06:43:41.767 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00038784699999999997 2024-09-13T06:43:41.767 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.767 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.767 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:43:41.767 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.708078+0000", 2024-09-13T06:43:41.767 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.842e-06 2024-09-13T06:43:41.767 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.767 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.767 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:41.768 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.403924+0000", 2024-09-13T06:43:41.768 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.69584657699999997 2024-09-13T06:43:41.768 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.768 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.768 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:41.768 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.404135+0000", 2024-09-13T06:43:41.768 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000210662 2024-09-13T06:43:41.768 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.768 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.768 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:41.768 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.404333+0000", 2024-09-13T06:43:41.768 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00019787900000000001 2024-09-13T06:43:41.768 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:41.768 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:41.768 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:41.769 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.769 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.769 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:181750 3.1d 3.9f70ba7d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e203)", 2024-09-13T06:43:41.769 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:42:45.707687+0000", 2024-09-13T06:43:41.769 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 55.955300350000002, 2024-09-13T06:43:41.769 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.69667232199999996, 2024-09-13T06:43:41.769 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:41.769 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:43:41.769 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:41.769 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:41.769 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:41.769 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 181750 2024-09-13T06:43:41.770 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.770 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:41.770 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.770 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:41.770 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707687+0000", 2024-09-13T06:43:41.770 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:41.770 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.770 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.770 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:41.770 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707687+0000", 2024-09-13T06:43:41.770 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:41.770 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.770 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.770 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:41.770 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707686+0000", 2024-09-13T06:43:41.771 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:41.771 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.771 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.771 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:41.771 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707689+0000", 2024-09-13T06:43:41.771 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.824e-06 2024-09-13T06:43:41.771 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.771 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.771 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:41.771 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707693+0000", 2024-09-13T06:43:41.771 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.5900000000000001e-06 2024-09-13T06:43:41.771 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.771 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.771 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:41.771 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707697+0000", 2024-09-13T06:43:41.772 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.6899999999999998e-06 2024-09-13T06:43:41.772 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.772 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.772 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:41.772 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.708109+0000", 2024-09-13T06:43:41.772 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00041220200000000002 2024-09-13T06:43:41.772 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.772 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.772 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:43:41.772 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.708118+0000", 2024-09-13T06:43:41.772 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6000000000000007e-06 2024-09-13T06:43:41.772 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.772 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.772 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:41.773 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.404353+0000", 2024-09-13T06:43:41.773 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.69623486400000001 2024-09-13T06:43:41.773 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:41.773 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:41.773 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:41.773 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.404359+0000", 2024-09-13T06:43:41.773 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.2480000000000001e-06 2024-09-13T06:43:41.773 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:41.773 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:41.773 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:41.773 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:41.773 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:41.774 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:43:41.775 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-13T06:43:41.776 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-13T06:43:41.777+0000 7fa8bb18e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 36790) UID: 0 2024-09-13T06:43:41.876 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:43:41.875+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:43:41.950 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:43:41.951 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [], 2024-09-13T06:43:41.951 INFO:teuthology.orchestra.run.smithi139.stdout: "num_ops": 0 2024-09-13T06:43:41.951 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:43:41.964 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-13T06:43:42.011 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:43:42.013+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:43:42.078 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:43:42.077+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:43:42.088 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:43:42.088 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [], 2024-09-13T06:43:42.088 INFO:teuthology.orchestra.run.smithi139.stdout: "complaint_time": 30, 2024-09-13T06:43:42.088 INFO:teuthology.orchestra.run.smithi139.stdout: "num_blocked_ops": 0 2024-09-13T06:43:42.088 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:43:42.097 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-13T06:43:42.102 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-13T06:43:42.187 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:43:42.189+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:43:42.249 INFO:teuthology.orchestra.run.smithi081.stdout:osd.0: {} 2024-09-13T06:43:42.250 INFO:teuthology.orchestra.run.smithi081.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-13T06:43:42.265 INFO:teuthology.orchestra.run.smithi081.stdout:osd.1: {} 2024-09-13T06:43:42.265 INFO:teuthology.orchestra.run.smithi081.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-13T06:43:42.271 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:43:42.271 INFO:teuthology.orchestra.run.smithi139.stdout: "size": 20, 2024-09-13T06:43:42.271 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 600, 2024-09-13T06:43:42.271 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [ 2024-09-13T06:43:42.271 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:42.271 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:176089 3.11 3:8b97f15f:::rbd_data.1121a23b99f7.0000000000000000:head [write 0~4194304 [fadvise_sequential+fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e196)", 2024-09-13T06:43:42.271 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:42:36.707298+0000", 2024-09-13T06:43:42.271 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 65.562095506999995, 2024-09-13T06:43:42.271 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.053333426000000003, 2024-09-13T06:43:42.271 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:42.271 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:43:42.271 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:42.272 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:42.272 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:42.272 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 176089 2024-09-13T06:43:42.272 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:42.272 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:42.272 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:42.272 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:42.272 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.707298+0000", 2024-09-13T06:43:42.272 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:42.272 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:42.272 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:42.273 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:42.273 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.707298+0000", 2024-09-13T06:43:42.273 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:42.273 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:42.273 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:42.273 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:42.273 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.707296+0000", 2024-09-13T06:43:42.273 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999976 2024-09-13T06:43:42.273 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:42.273 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:42.273 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:42.273 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.717511+0000", 2024-09-13T06:43:42.273 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.010215218999999999 2024-09-13T06:43:42.274 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:42.274 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:42.274 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:42.274 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.717555+0000", 2024-09-13T06:43:42.274 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.4159000000000002e-05 2024-09-13T06:43:42.274 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:42.274 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:42.274 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:42.274 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.717569+0000", 2024-09-13T06:43:42.274 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3543999999999999e-05 2024-09-13T06:43:42.274 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:42.274 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:42.274 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:42.275 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.717677+0000", 2024-09-13T06:43:42.275 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00010798699999999999 2024-09-13T06:43:42.275 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:42.275 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:42.275 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:42.275 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.717896+0000", 2024-09-13T06:43:42.275 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000219466 2024-09-13T06:43:42.275 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:42.275 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:42.275 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 4", 2024-09-13T06:43:42.275 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.718090+0000", 2024-09-13T06:43:42.275 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00019322799999999999 2024-09-13T06:43:42.275 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:42.276 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:42.276 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:43:42.276 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.751403+0000", 2024-09-13T06:43:42.276 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.033313493 2024-09-13T06:43:42.276 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:42.276 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:42.276 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-13T06:43:42.276 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.760523+0000", 2024-09-13T06:43:42.276 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0091197150000000005 2024-09-13T06:43:42.276 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:42.276 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:42.276 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-13T06:43:42.276 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.760581+0000", 2024-09-13T06:43:42.277 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.8007999999999998e-05 2024-09-13T06:43:42.277 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:42.277 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:42.277 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:42.277 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.760632+0000", 2024-09-13T06:43:42.277 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.1085999999999998e-05 2024-09-13T06:43:42.277 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:42.277 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:42.277 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:42.277 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:42.277 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:42.278 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:176090 3.e 3:77f86bf9:::rbd_data.1121a23b99f7.0000000000000001:head [write 0~4194304 [fadvise_sequential+fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e196)", 2024-09-13T06:43:42.278 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:42:36.717590+0000", 2024-09-13T06:43:42.278 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 65.551804024999996, 2024-09-13T06:43:42.278 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.049445965000000001, 2024-09-13T06:43:42.278 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:42.278 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:43:42.278 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:42.278 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:42.278 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:42.278 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 176090 2024-09-13T06:43:42.278 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:42.278 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:42.278 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:42.279 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:42.279 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.717590+0000", 2024-09-13T06:43:42.279 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:42.279 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:42.279 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:42.279 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:42.279 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.717590+0000", 2024-09-13T06:43:42.279 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:42.279 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:42.279 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:42.279 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:42.279 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.717588+0000", 2024-09-13T06:43:42.279 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999981 2024-09-13T06:43:42.280 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:42.280 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:42.280 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:42.280 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.723934+0000", 2024-09-13T06:43:42.280 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0063462589999999999 2024-09-13T06:43:42.280 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:42.280 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:42.280 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:42.280 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.723960+0000", 2024-09-13T06:43:42.280 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.6251e-05 2024-09-13T06:43:42.280 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:42.280 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:42.281 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:42.281 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.723976+0000", 2024-09-13T06:43:42.281 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5277e-05 2024-09-13T06:43:42.281 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:42.281 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:42.281 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:42.281 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.724154+0000", 2024-09-13T06:43:42.281 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00017814400000000001 2024-09-13T06:43:42.281 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:42.281 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:42.281 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:42.281 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.724534+0000", 2024-09-13T06:43:42.281 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00038054799999999998 2024-09-13T06:43:42.282 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:42.282 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:42.282 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-13T06:43:42.282 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.724926+0000", 2024-09-13T06:43:42.282 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00039199100000000001 2024-09-13T06:43:42.282 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:42.282 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:42.282 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:43:42.282 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.744509+0000", 2024-09-13T06:43:42.282 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.019582977000000001 2024-09-13T06:43:42.282 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:42.282 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:42.282 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-13T06:43:42.283 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.766937+0000", 2024-09-13T06:43:42.283 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.022427765999999998 2024-09-13T06:43:42.283 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:42.283 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:42.283 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-13T06:43:42.283 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.766987+0000", 2024-09-13T06:43:42.283 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.9898000000000002e-05 2024-09-13T06:43:42.283 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:42.283 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:42.283 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:42.283 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.767036+0000", 2024-09-13T06:43:42.283 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.8782000000000002e-05 2024-09-13T06:43:42.283 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:42.283 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:42.284 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:42.284 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:42.284 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:42.284 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:176094 3.f 3:f5ca80c1:::rbd_data.1121a23b99f7.0000000000000004:head [write 0~4194304 [fadvise_sequential+fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e196)", 2024-09-13T06:43:42.284 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:42:36.724239+0000", 2024-09-13T06:43:42.284 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 65.545154925000006, 2024-09-13T06:43:42.284 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.043501235999999999, 2024-09-13T06:43:42.284 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:42.284 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:43:42.284 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:42.284 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:42.284 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:42.284 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 176094 2024-09-13T06:43:42.285 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:42.285 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:42.285 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:42.285 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:42.285 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.724239+0000", 2024-09-13T06:43:42.285 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:42.285 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:42.285 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:42.285 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:42.285 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.724239+0000", 2024-09-13T06:43:42.285 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:42.285 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:42.286 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:42.286 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:42.286 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.724237+0000", 2024-09-13T06:43:42.286 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999981 2024-09-13T06:43:42.286 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:42.286 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:42.286 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:42.286 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.733673+0000", 2024-09-13T06:43:42.286 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0094352700000000008 2024-09-13T06:43:42.286 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:42.286 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:42.286 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:42.286 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.733703+0000", 2024-09-13T06:43:42.286 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.0102000000000001e-05 2024-09-13T06:43:42.286 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:42.287 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:42.287 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:42.287 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.733718+0000", 2024-09-13T06:43:42.287 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5199e-05 2024-09-13T06:43:42.287 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:42.287 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:42.287 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:42.287 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.733780+0000", 2024-09-13T06:43:42.287 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.1691000000000003e-05 2024-09-13T06:43:42.287 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:42.287 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:42.287 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:42.287 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.733928+0000", 2024-09-13T06:43:42.287 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000147987 2024-09-13T06:43:42.288 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:42.288 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:42.288 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 4", 2024-09-13T06:43:42.288 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.734036+0000", 2024-09-13T06:43:42.288 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000108925 2024-09-13T06:43:42.288 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:42.288 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:42.288 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:43:42.288 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.763741+0000", 2024-09-13T06:43:42.288 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.029704151000000002 2024-09-13T06:43:42.288 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:42.288 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:42.288 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-13T06:43:42.289 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.767615+0000", 2024-09-13T06:43:42.289 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0038739120000000002 2024-09-13T06:43:42.289 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:42.289 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:42.289 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-13T06:43:42.289 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.767693+0000", 2024-09-13T06:43:42.289 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.8573999999999997e-05 2024-09-13T06:43:42.289 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:42.289 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:42.289 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:42.289 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.767740+0000", 2024-09-13T06:43:42.289 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.7154000000000003e-05 2024-09-13T06:43:42.289 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:42.289 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:42.290 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:42.290 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:42.290 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:42.290 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:205233 3.15 3:a97b2891:::rbd_data.11213650bb32.000000000000002e:head [set-alloc-hint object_size 4194304 write_size 4194304,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e209)", 2024-09-13T06:43:42.290 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:42:52.282586+0000", 2024-09-13T06:43:42.290 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 49.986808081, 2024-09-13T06:43:42.290 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.056996628000000001, 2024-09-13T06:43:42.290 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:42.290 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:43:42.290 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:42.290 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:42.290 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:42.290 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 205233 2024-09-13T06:43:42.290 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:42.290 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:42.291 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:42.291 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:42.291 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:52.282586+0000", 2024-09-13T06:43:42.291 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:42.291 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:42.291 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:42.291 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:42.291 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:52.282586+0000", 2024-09-13T06:43:42.291 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:42.291 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:42.291 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:42.291 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:42.291 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:52.282583+0000", 2024-09-13T06:43:42.292 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999976 2024-09-13T06:43:42.292 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:42.292 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:42.292 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:42.292 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:52.282599+0000", 2024-09-13T06:43:42.292 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5065999999999999e-05 2024-09-13T06:43:42.292 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:42.292 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:42.292 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:42.292 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:52.282632+0000", 2024-09-13T06:43:42.292 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.3386999999999997e-05 2024-09-13T06:43:42.292 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:42.292 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:42.293 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:42.293 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:52.282654+0000", 2024-09-13T06:43:42.293 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.177e-05 2024-09-13T06:43:42.293 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:42.293 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:42.293 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:42.293 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:52.282753+0000", 2024-09-13T06:43:42.293 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.9685000000000005e-05 2024-09-13T06:43:42.293 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:42.293 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:42.296 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:42.296 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:52.283000+0000", 2024-09-13T06:43:42.296 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000246278 2024-09-13T06:43:42.296 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:42.296 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:42.296 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 3", 2024-09-13T06:43:42.297 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:52.292656+0000", 2024-09-13T06:43:42.297 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0096565980000000006 2024-09-13T06:43:42.297 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:42.297 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:42.297 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:43:42.297 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:52.339352+0000", 2024-09-13T06:43:42.297 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.046695309999999997 2024-09-13T06:43:42.297 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:42.297 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:42.297 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-13T06:43:42.297 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:52.339373+0000", 2024-09-13T06:43:42.297 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.1002999999999999e-05 2024-09-13T06:43:42.297 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:42.298 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:42.298 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-13T06:43:42.298 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:52.339464+0000", 2024-09-13T06:43:42.298 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.1131999999999994e-05 2024-09-13T06:43:42.298 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:42.298 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:42.298 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:42.298 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:52.339582+0000", 2024-09-13T06:43:42.298 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000118799 2024-09-13T06:43:42.298 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:42.298 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:42.298 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:42.298 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:42.299 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:42.299 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:237445 3.15 3:abdd9d42:::rbd_data.1121cb4a09ed.0000000000000008:82 [read 69632~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e224)", 2024-09-13T06:43:42.299 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:43:08.800334+0000", 2024-09-13T06:43:42.299 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 33.469059672999997, 2024-09-13T06:43:42.299 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.032345681000000001, 2024-09-13T06:43:42.299 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:42.299 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:42.299 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:42.299 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:42.299 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:42.299 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 237445 2024-09-13T06:43:42.299 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:42.299 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:42.299 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:42.300 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:42.300 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800334+0000", 2024-09-13T06:43:42.300 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:42.300 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:42.300 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:42.300 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:42.300 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800334+0000", 2024-09-13T06:43:42.300 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:42.300 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:42.300 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:42.300 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:42.300 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800334+0000", 2024-09-13T06:43:42.301 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:42.301 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:42.301 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:42.301 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:42.301 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800338+0000", 2024-09-13T06:43:42.301 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.9539999999999998e-06 2024-09-13T06:43:42.301 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:42.301 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:42.301 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:42.301 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800342+0000", 2024-09-13T06:43:42.301 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.7249999999999999e-06 2024-09-13T06:43:42.301 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:42.301 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:42.302 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:42.302 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800345+0000", 2024-09-13T06:43:42.302 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.072e-06 2024-09-13T06:43:42.302 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:42.302 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:42.302 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:42.302 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.832482+0000", 2024-09-13T06:43:42.302 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.032137713999999998 2024-09-13T06:43:42.302 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:42.302 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:42.302 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:42.302 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.832571+0000", 2024-09-13T06:43:42.302 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.8252999999999997e-05 2024-09-13T06:43:42.303 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:42.303 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:42.303 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:42.303 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.832680+0000", 2024-09-13T06:43:42.303 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000109214 2024-09-13T06:43:42.303 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:42.303 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:42.303 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:42.303 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:42.303 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:42.303 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:237446 3.15 3:abdd9d42:::rbd_data.1121cb4a09ed.0000000000000008:82 [read 81920~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e224)", 2024-09-13T06:43:42.303 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:43:08.800348+0000", 2024-09-13T06:43:42.303 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 33.469046273000004, 2024-09-13T06:43:42.304 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.032454446999999997, 2024-09-13T06:43:42.304 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:42.304 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:42.304 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:42.304 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:42.304 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:42.304 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 237446 2024-09-13T06:43:42.304 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:42.304 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:42.304 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:42.304 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:42.304 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800348+0000", 2024-09-13T06:43:42.304 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:42.305 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:42.305 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:42.305 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:42.305 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800348+0000", 2024-09-13T06:43:42.305 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:42.305 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:42.305 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:42.305 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:42.305 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800347+0000", 2024-09-13T06:43:42.305 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:42.305 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:42.305 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:42.305 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:42.306 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800349+0000", 2024-09-13T06:43:42.306 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.452e-06 2024-09-13T06:43:42.306 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:42.306 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:42.306 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:42.306 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800354+0000", 2024-09-13T06:43:42.306 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.0350000000000001e-06 2024-09-13T06:43:42.306 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:42.306 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:42.306 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:42.306 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800357+0000", 2024-09-13T06:43:42.306 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.179e-06 2024-09-13T06:43:42.306 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:42.307 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:42.307 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:42.307 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.832707+0000", 2024-09-13T06:43:42.307 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.032350071000000001 2024-09-13T06:43:42.307 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:42.307 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:42.307 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:42.307 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.832748+0000", 2024-09-13T06:43:42.307 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0587000000000003e-05 2024-09-13T06:43:42.307 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:42.307 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:42.307 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:42.307 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.832802+0000", 2024-09-13T06:43:42.308 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.4429999999999999e-05 2024-09-13T06:43:42.308 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:42.308 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:42.308 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:42.308 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:42.308 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:42.308 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:237447 3.15 3:abdd9d42:::rbd_data.1121cb4a09ed.0000000000000008:82 [read 94208~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e224)", 2024-09-13T06:43:42.308 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:43:08.800360+0000", 2024-09-13T06:43:42.308 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 33.469034360999999, 2024-09-13T06:43:42.308 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.032679798000000003, 2024-09-13T06:43:42.308 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:42.308 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:42.309 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:42.309 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:42.309 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:42.309 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 237447 2024-09-13T06:43:42.309 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:42.309 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:42.309 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:42.309 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:42.309 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800360+0000", 2024-09-13T06:43:42.309 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:42.309 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:42.309 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:42.309 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:42.310 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800360+0000", 2024-09-13T06:43:42.310 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:42.310 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:42.310 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:42.310 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:42.310 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800359+0000", 2024-09-13T06:43:42.310 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:42.310 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:42.310 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:42.310 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:42.310 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800361+0000", 2024-09-13T06:43:42.310 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.463e-06 2024-09-13T06:43:42.310 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:42.310 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:42.311 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:42.311 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800364+0000", 2024-09-13T06:43:42.311 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.6279999999999998e-06 2024-09-13T06:43:42.311 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:42.311 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:42.311 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:42.311 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800367+0000", 2024-09-13T06:43:42.311 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.7259999999999998e-06 2024-09-13T06:43:42.311 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:42.311 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:42.311 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:42.311 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.832841+0000", 2024-09-13T06:43:42.311 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.032474115999999997 2024-09-13T06:43:42.312 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:42.312 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:42.312 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:42.312 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.832929+0000", 2024-09-13T06:43:42.312 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.7886000000000005e-05 2024-09-13T06:43:42.312 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:42.312 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:42.312 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:42.312 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.833039+0000", 2024-09-13T06:43:42.312 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00011024200000000001 2024-09-13T06:43:42.312 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:42.312 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:42.313 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:42.313 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:42.313 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:42.313 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:237448 3.15 3:abdd9d42:::rbd_data.1121cb4a09ed.0000000000000008:82 [read 106496~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e224)", 2024-09-13T06:43:42.313 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:43:08.800371+0000", 2024-09-13T06:43:42.313 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 33.469023221999997, 2024-09-13T06:43:42.313 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.032794221999999998, 2024-09-13T06:43:42.313 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:42.313 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:42.313 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:42.313 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:42.313 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:42.314 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 237448 2024-09-13T06:43:42.314 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:42.314 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:42.314 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:42.314 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:42.314 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800371+0000", 2024-09-13T06:43:42.314 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:42.314 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:42.314 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:42.314 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:42.314 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800371+0000", 2024-09-13T06:43:42.314 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:42.314 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:42.314 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:42.315 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:42.315 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800370+0000", 2024-09-13T06:43:42.315 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967296 2024-09-13T06:43:42.315 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:42.315 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:42.315 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:42.315 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800372+0000", 2024-09-13T06:43:42.315 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3510000000000001e-06 2024-09-13T06:43:42.315 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:42.315 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:42.315 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:42.315 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800376+0000", 2024-09-13T06:43:42.315 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.693e-06 2024-09-13T06:43:42.315 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:42.316 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:42.316 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:42.316 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800378+0000", 2024-09-13T06:43:42.316 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.8870000000000001e-06 2024-09-13T06:43:42.316 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:42.316 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:42.316 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:42.316 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.833069+0000", 2024-09-13T06:43:42.316 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.032690708999999998 2024-09-13T06:43:42.316 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:42.316 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:42.316 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:42.316 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.833110+0000", 2024-09-13T06:43:42.317 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.1356999999999997e-05 2024-09-13T06:43:42.317 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:42.317 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:42.317 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:42.317 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.833165+0000", 2024-09-13T06:43:42.317 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.4456999999999997e-05 2024-09-13T06:43:42.317 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:42.317 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:42.317 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:42.317 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:42.317 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:42.317 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:237449 3.15 3:abdd9d42:::rbd_data.1121cb4a09ed.0000000000000008:82 [read 118784~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e224)", 2024-09-13T06:43:42.317 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:43:08.800381+0000", 2024-09-13T06:43:42.317 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 33.469013080000003, 2024-09-13T06:43:42.318 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.033007068000000001, 2024-09-13T06:43:42.318 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:42.318 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:42.318 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:42.318 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:42.318 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:42.318 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 237449 2024-09-13T06:43:42.318 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:42.318 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:42.318 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:42.318 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:42.318 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800381+0000", 2024-09-13T06:43:42.318 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:42.318 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:42.318 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:42.319 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:42.319 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800381+0000", 2024-09-13T06:43:42.319 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:42.319 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:42.319 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:42.319 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:42.319 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800381+0000", 2024-09-13T06:43:42.319 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967296 2024-09-13T06:43:42.319 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:42.319 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:42.319 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:42.319 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800382+0000", 2024-09-13T06:43:42.319 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.395e-06 2024-09-13T06:43:42.319 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:42.320 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:42.320 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:42.320 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800386+0000", 2024-09-13T06:43:42.320 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.574e-06 2024-09-13T06:43:42.320 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:42.320 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:42.320 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:42.320 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800388+0000", 2024-09-13T06:43:42.320 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.8729999999999999e-06 2024-09-13T06:43:42.320 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:42.320 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:42.320 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:42.320 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.833204+0000", 2024-09-13T06:43:42.320 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.032815986999999998 2024-09-13T06:43:42.321 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:42.321 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:42.321 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:42.321 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.833289+0000", 2024-09-13T06:43:42.321 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.4085999999999994e-05 2024-09-13T06:43:42.321 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:42.321 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:42.321 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:42.321 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.833388+0000", 2024-09-13T06:43:42.321 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.9380000000000001e-05 2024-09-13T06:43:42.321 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:42.321 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:42.321 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:42.321 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:42.322 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:42.322 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:237450 3.15 3:abdd9d42:::rbd_data.1121cb4a09ed.0000000000000008:82 [read 131072~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e224)", 2024-09-13T06:43:42.322 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:43:08.800392+0000", 2024-09-13T06:43:42.322 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 33.469001751999997, 2024-09-13T06:43:42.322 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.033110507999999997, 2024-09-13T06:43:42.322 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:42.322 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:42.322 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:42.322 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:42.322 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:42.322 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 237450 2024-09-13T06:43:42.322 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:42.323 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:42.323 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:42.323 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:42.323 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800392+0000", 2024-09-13T06:43:42.323 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:42.323 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:42.323 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:42.323 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:42.323 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800392+0000", 2024-09-13T06:43:42.323 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:42.323 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:42.324 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:42.324 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:42.324 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800392+0000", 2024-09-13T06:43:42.324 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967296 2024-09-13T06:43:42.324 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:42.324 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:42.324 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:42.324 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800393+0000", 2024-09-13T06:43:42.324 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.375e-06 2024-09-13T06:43:42.324 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:42.324 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:42.324 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:42.324 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800397+0000", 2024-09-13T06:43:42.325 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.6109999999999998e-06 2024-09-13T06:43:42.325 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:42.325 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:42.325 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:42.325 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800400+0000", 2024-09-13T06:43:42.325 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.7580000000000001e-06 2024-09-13T06:43:42.325 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:42.325 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:42.325 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:42.325 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.833414+0000", 2024-09-13T06:43:42.325 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.033014767 2024-09-13T06:43:42.325 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:42.325 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:42.326 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:42.326 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.833453+0000", 2024-09-13T06:43:42.326 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.8711000000000003e-05 2024-09-13T06:43:42.326 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:42.326 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:42.326 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:42.326 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.833503+0000", 2024-09-13T06:43:42.326 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.9523e-05 2024-09-13T06:43:42.326 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:42.326 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:42.326 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:42.326 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:42.326 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:42.326 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:237451 3.15 3:abdd9d42:::rbd_data.1121cb4a09ed.0000000000000008:82 [read 143360~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e224)", 2024-09-13T06:43:42.327 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:43:08.800402+0000", 2024-09-13T06:43:42.327 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 33.468991934000002, 2024-09-13T06:43:42.327 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.033337717000000003, 2024-09-13T06:43:42.327 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:42.327 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:42.327 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:42.327 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:42.327 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:42.327 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 237451 2024-09-13T06:43:42.327 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:42.327 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:42.327 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:42.327 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:42.327 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800402+0000", 2024-09-13T06:43:42.328 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:42.328 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:42.328 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:42.328 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:42.328 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800402+0000", 2024-09-13T06:43:42.328 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:42.328 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:42.328 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:42.328 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:42.328 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800402+0000", 2024-09-13T06:43:42.328 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967296 2024-09-13T06:43:42.328 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:42.329 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:42.329 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:42.329 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800403+0000", 2024-09-13T06:43:42.329 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.37e-06 2024-09-13T06:43:42.329 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:42.329 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:42.329 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:42.329 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800407+0000", 2024-09-13T06:43:42.329 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.6820000000000001e-06 2024-09-13T06:43:42.329 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:42.329 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:42.329 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:42.329 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800410+0000", 2024-09-13T06:43:42.330 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.7810000000000001e-06 2024-09-13T06:43:42.330 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:42.330 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:42.330 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:42.330 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.833550+0000", 2024-09-13T06:43:42.330 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.033140192999999998 2024-09-13T06:43:42.330 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:42.330 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:42.330 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:42.330 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.833634+0000", 2024-09-13T06:43:42.330 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.4097000000000005e-05 2024-09-13T06:43:42.330 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:42.330 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:42.331 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:42.331 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.833740+0000", 2024-09-13T06:43:42.331 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00010582300000000001 2024-09-13T06:43:42.331 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:42.331 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:42.331 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:42.331 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:42.331 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:42.331 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:237452 3.15 3:abdd9d42:::rbd_data.1121cb4a09ed.0000000000000008:82 [read 155648~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e224)", 2024-09-13T06:43:42.331 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:43:08.800412+0000", 2024-09-13T06:43:42.331 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 33.468981978000002, 2024-09-13T06:43:42.331 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.033496535000000001, 2024-09-13T06:43:42.331 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:42.332 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:42.332 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:42.332 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:42.332 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:42.332 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 237452 2024-09-13T06:43:42.332 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:42.332 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:42.332 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:42.332 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:42.332 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800412+0000", 2024-09-13T06:43:42.332 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:42.332 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:42.332 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:42.333 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:42.333 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800412+0000", 2024-09-13T06:43:42.333 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:42.333 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:42.333 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:42.333 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:42.333 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800412+0000", 2024-09-13T06:43:42.333 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967296 2024-09-13T06:43:42.333 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:42.333 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:42.333 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:42.333 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800413+0000", 2024-09-13T06:43:42.333 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.342e-06 2024-09-13T06:43:42.334 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:42.334 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:42.334 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:42.334 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800417+0000", 2024-09-13T06:43:42.334 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.6480000000000001e-06 2024-09-13T06:43:42.334 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:42.334 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:42.334 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:42.334 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800419+0000", 2024-09-13T06:43:42.334 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.7920000000000001e-06 2024-09-13T06:43:42.334 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:42.334 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:42.334 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:42.335 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.833768+0000", 2024-09-13T06:43:42.335 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.033348587999999998 2024-09-13T06:43:42.335 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:42.335 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:42.335 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:42.335 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.833836+0000", 2024-09-13T06:43:42.335 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.8090999999999996e-05 2024-09-13T06:43:42.335 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:42.335 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:42.335 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:42.335 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.833908+0000", 2024-09-13T06:43:42.335 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.2311999999999995e-05 2024-09-13T06:43:42.335 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:42.335 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:42.336 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:42.336 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:42.336 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:42.336 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:237453 3.15 3:abdd9d42:::rbd_data.1121cb4a09ed.0000000000000008:82 [read 167936~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e224)", 2024-09-13T06:43:42.336 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:43:08.800422+0000", 2024-09-13T06:43:42.336 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 33.468971906999997, 2024-09-13T06:43:42.336 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.033735223000000002, 2024-09-13T06:43:42.336 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:42.336 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:42.336 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:42.336 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:42.336 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:42.337 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 237453 2024-09-13T06:43:42.337 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:42.337 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:42.337 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:42.337 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:42.337 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800422+0000", 2024-09-13T06:43:42.337 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:42.337 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:42.337 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:42.337 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:42.337 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800422+0000", 2024-09-13T06:43:42.337 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:42.337 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:42.338 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:42.338 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:42.338 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800422+0000", 2024-09-13T06:43:42.338 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967296 2024-09-13T06:43:42.338 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:42.338 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:42.338 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:42.338 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800423+0000", 2024-09-13T06:43:42.338 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3489999999999999e-06 2024-09-13T06:43:42.338 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:42.338 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:42.338 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:42.338 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800427+0000", 2024-09-13T06:43:42.339 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.6610000000000002e-06 2024-09-13T06:43:42.339 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:42.339 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:42.339 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:42.339 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800430+0000", 2024-09-13T06:43:42.339 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.9869999999999999e-06 2024-09-13T06:43:42.339 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:42.339 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:42.339 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:42.339 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.833958+0000", 2024-09-13T06:43:42.339 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.033528020999999998 2024-09-13T06:43:42.339 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:42.339 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:42.340 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:42.340 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.834047+0000", 2024-09-13T06:43:42.340 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.9492000000000003e-05 2024-09-13T06:43:42.340 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:42.340 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:42.340 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:42.340 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.834157+0000", 2024-09-13T06:43:42.340 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000109948 2024-09-13T06:43:42.340 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:42.340 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:42.340 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:42.340 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:42.340 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:42.341 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:237454 3.15 3:abdd9d42:::rbd_data.1121cb4a09ed.0000000000000008:82 [read 180224~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e224)", 2024-09-13T06:43:42.341 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:43:08.800432+0000", 2024-09-13T06:43:42.341 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 33.468961700000001, 2024-09-13T06:43:42.341 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.033853883000000001, 2024-09-13T06:43:42.341 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:42.341 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:42.341 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:42.341 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:42.341 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:42.341 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 237454 2024-09-13T06:43:42.341 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:42.341 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:42.342 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:42.342 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:42.342 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800432+0000", 2024-09-13T06:43:42.342 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:42.342 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:42.342 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:42.342 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:42.342 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800432+0000", 2024-09-13T06:43:42.342 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:42.342 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:42.342 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:42.342 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:42.342 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800432+0000", 2024-09-13T06:43:42.343 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:42.343 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:42.343 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:42.343 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:42.343 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800433+0000", 2024-09-13T06:43:42.343 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3379999999999999e-06 2024-09-13T06:43:42.343 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:42.343 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:42.343 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:42.343 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800437+0000", 2024-09-13T06:43:42.343 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.1679999999999997e-06 2024-09-13T06:43:42.343 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:42.343 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:42.344 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:42.344 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800440+0000", 2024-09-13T06:43:42.344 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.8830000000000002e-06 2024-09-13T06:43:42.344 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:42.344 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:42.344 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:42.344 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.834187+0000", 2024-09-13T06:43:42.344 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.033746532000000003 2024-09-13T06:43:42.344 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:42.344 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:42.344 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:42.344 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.834228+0000", 2024-09-13T06:43:42.345 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.087e-05 2024-09-13T06:43:42.345 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:42.345 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:42.345 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:42.345 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.834286+0000", 2024-09-13T06:43:42.345 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.8331000000000001e-05 2024-09-13T06:43:42.345 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:42.345 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:42.345 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:42.345 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:42.345 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:42.345 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:237455 3.15 3:abdd9d42:::rbd_data.1121cb4a09ed.0000000000000008:82 [read 192512~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e224)", 2024-09-13T06:43:42.345 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:43:08.800443+0000", 2024-09-13T06:43:42.346 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 33.468951226999998, 2024-09-13T06:43:42.346 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.034083294, 2024-09-13T06:43:42.346 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:42.346 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:42.346 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:42.346 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:42.346 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:42.346 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 237455 2024-09-13T06:43:42.346 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:42.346 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:42.346 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:42.346 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:42.346 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800443+0000", 2024-09-13T06:43:42.346 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:42.346 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:42.347 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:42.347 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:42.347 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800443+0000", 2024-09-13T06:43:42.347 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:42.347 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:42.347 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:42.347 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:42.347 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800442+0000", 2024-09-13T06:43:42.347 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967296 2024-09-13T06:43:42.347 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:42.347 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:42.347 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:42.347 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800444+0000", 2024-09-13T06:43:42.348 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.443e-06 2024-09-13T06:43:42.348 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:42.348 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:42.348 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:42.348 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800448+0000", 2024-09-13T06:43:42.348 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.6770000000000001e-06 2024-09-13T06:43:42.348 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:42.348 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:42.348 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:42.348 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800451+0000", 2024-09-13T06:43:42.348 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.0920000000000002e-06 2024-09-13T06:43:42.348 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:42.348 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:42.348 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:42.349 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.834323+0000", 2024-09-13T06:43:42.349 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.033872145999999999 2024-09-13T06:43:42.349 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:42.349 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:42.349 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:42.349 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.834420+0000", 2024-09-13T06:43:42.349 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6898999999999995e-05 2024-09-13T06:43:42.349 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:42.349 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:42.349 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:42.349 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.834526+0000", 2024-09-13T06:43:42.349 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000106272 2024-09-13T06:43:42.350 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:42.350 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:42.350 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:42.350 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:42.350 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:42.350 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:237456 3.15 3:abdd9d42:::rbd_data.1121cb4a09ed.0000000000000008:82 [read 204800~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e224)", 2024-09-13T06:43:42.350 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:43:08.800453+0000", 2024-09-13T06:43:42.350 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 33.468941016000002, 2024-09-13T06:43:42.350 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.034198615000000002, 2024-09-13T06:43:42.350 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:42.350 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:42.350 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:42.350 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:42.351 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:42.351 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 237456 2024-09-13T06:43:42.351 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:42.351 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:42.351 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:42.351 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:42.351 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800453+0000", 2024-09-13T06:43:42.351 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:42.351 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:42.351 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:42.351 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:42.351 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800453+0000", 2024-09-13T06:43:42.351 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:42.352 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:42.352 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:42.352 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:42.352 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800453+0000", 2024-09-13T06:43:42.352 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967296 2024-09-13T06:43:42.352 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:42.352 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:42.352 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:42.352 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800454+0000", 2024-09-13T06:43:42.352 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.361e-06 2024-09-13T06:43:42.352 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:42.352 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:42.352 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:42.353 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800458+0000", 2024-09-13T06:43:42.353 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.7189999999999999e-06 2024-09-13T06:43:42.353 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:42.353 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:42.353 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:42.353 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800461+0000", 2024-09-13T06:43:42.353 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.7599999999999998e-06 2024-09-13T06:43:42.353 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:42.353 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:42.353 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:42.353 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.834555+0000", 2024-09-13T06:43:42.353 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.034094192000000002 2024-09-13T06:43:42.353 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:42.354 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:42.354 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:42.354 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.834597+0000", 2024-09-13T06:43:42.354 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.2157000000000003e-05 2024-09-13T06:43:42.354 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:42.354 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:42.354 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:42.354 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.834652+0000", 2024-09-13T06:43:42.354 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.4660999999999997e-05 2024-09-13T06:43:42.354 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:42.354 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:42.354 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:42.354 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:42.355 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:42.355 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:237457 3.15 3:abdd9d42:::rbd_data.1121cb4a09ed.0000000000000008:82 [read 217088~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e224)", 2024-09-13T06:43:42.355 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:43:08.800463+0000", 2024-09-13T06:43:42.355 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 33.468931069, 2024-09-13T06:43:42.355 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.034419130999999999, 2024-09-13T06:43:42.355 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:42.355 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:42.355 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:42.355 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:42.355 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:42.355 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 237457 2024-09-13T06:43:42.355 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:42.355 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:42.356 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:42.356 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:42.356 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800463+0000", 2024-09-13T06:43:42.356 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:42.356 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:42.356 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:42.356 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:42.356 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800463+0000", 2024-09-13T06:43:42.356 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:42.356 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:42.356 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:42.356 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:42.357 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800463+0000", 2024-09-13T06:43:42.357 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967296 2024-09-13T06:43:42.357 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:42.357 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:42.357 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:42.357 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800466+0000", 2024-09-13T06:43:42.357 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.8240000000000001e-06 2024-09-13T06:43:42.357 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:42.357 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:42.357 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:42.357 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800470+0000", 2024-09-13T06:43:42.357 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.7579999999999998e-06 2024-09-13T06:43:42.357 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:42.357 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:42.358 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:42.358 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800473+0000", 2024-09-13T06:43:42.358 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.875e-06 2024-09-13T06:43:42.358 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:42.358 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:42.358 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:42.358 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.834688+0000", 2024-09-13T06:43:42.358 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.034215039000000003 2024-09-13T06:43:42.358 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:42.358 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:42.358 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:42.358 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.834772+0000", 2024-09-13T06:43:42.358 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.3870999999999997e-05 2024-09-13T06:43:42.358 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:42.359 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:42.359 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:42.359 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.834882+0000", 2024-09-13T06:43:42.359 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00011 2024-09-13T06:43:42.359 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:42.359 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:42.359 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:42.359 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:42.359 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:42.359 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:237458 3.15 3:abdd9d42:::rbd_data.1121cb4a09ed.0000000000000008:82 [read 229376~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e224)", 2024-09-13T06:43:42.359 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:43:08.800476+0000", 2024-09-13T06:43:42.359 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 33.468918320999997, 2024-09-13T06:43:42.360 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.034538358999999998, 2024-09-13T06:43:42.360 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:42.360 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:42.360 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:42.360 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:42.360 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:42.360 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 237458 2024-09-13T06:43:42.360 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:42.360 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:42.360 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:42.360 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:42.360 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800476+0000", 2024-09-13T06:43:42.360 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:42.361 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:42.361 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:42.361 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:42.361 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800476+0000", 2024-09-13T06:43:42.361 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:42.361 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:42.361 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:42.361 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:42.361 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800475+0000", 2024-09-13T06:43:42.362 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:42.362 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:42.362 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:42.362 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:42.362 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800477+0000", 2024-09-13T06:43:42.362 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.367e-06 2024-09-13T06:43:42.362 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:42.362 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:42.362 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:42.362 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800480+0000", 2024-09-13T06:43:42.363 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.7179999999999998e-06 2024-09-13T06:43:42.363 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:42.363 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:42.363 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:42.363 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800483+0000", 2024-09-13T06:43:42.363 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.807e-06 2024-09-13T06:43:42.363 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:42.363 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:42.363 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:42.363 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.834922+0000", 2024-09-13T06:43:42.363 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.034438261999999997 2024-09-13T06:43:42.363 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:42.363 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:42.364 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:42.364 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.834962+0000", 2024-09-13T06:43:42.364 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0287999999999998e-05 2024-09-13T06:43:42.364 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:42.364 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:42.364 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:42.364 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.835014+0000", 2024-09-13T06:43:42.364 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.2172999999999997e-05 2024-09-13T06:43:42.364 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:42.364 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:42.364 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:42.364 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:42.364 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:42.364 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:237459 3.15 3:abdd9d42:::rbd_data.1121cb4a09ed.0000000000000008:82 [read 241664~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e224)", 2024-09-13T06:43:42.365 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:43:08.800486+0000", 2024-09-13T06:43:42.365 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 33.46890818, 2024-09-13T06:43:42.365 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.034771370000000003, 2024-09-13T06:43:42.365 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:42.365 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:42.365 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:42.365 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:42.365 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:42.365 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 237459 2024-09-13T06:43:42.365 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:42.365 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:42.365 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:42.365 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:42.366 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800486+0000", 2024-09-13T06:43:42.366 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:42.366 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:42.366 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:42.366 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:42.366 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800486+0000", 2024-09-13T06:43:42.366 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:42.366 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:42.366 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:42.366 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:42.366 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800485+0000", 2024-09-13T06:43:42.366 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:42.366 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:42.367 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:42.367 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:42.367 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800487+0000", 2024-09-13T06:43:42.367 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.297e-06 2024-09-13T06:43:42.367 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:42.367 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:42.367 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:42.367 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800491+0000", 2024-09-13T06:43:42.367 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.4569999999999998e-06 2024-09-13T06:43:42.367 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:42.367 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:42.367 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:42.367 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800494+0000", 2024-09-13T06:43:42.368 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.8710000000000001e-06 2024-09-13T06:43:42.368 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:42.368 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:42.368 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:42.368 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.835058+0000", 2024-09-13T06:43:42.368 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.034564117999999998 2024-09-13T06:43:42.368 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:42.368 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:42.368 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:42.368 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.835142+0000", 2024-09-13T06:43:42.368 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.352e-05 2024-09-13T06:43:42.368 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:42.369 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:42.369 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:42.369 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.835257+0000", 2024-09-13T06:43:42.369 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00011537 2024-09-13T06:43:42.369 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:42.369 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:42.369 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:42.369 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:42.369 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:42.369 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:237460 3.15 3:abdd9d42:::rbd_data.1121cb4a09ed.0000000000000008:82 [read 253952~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e224)", 2024-09-13T06:43:42.369 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:43:08.800511+0000", 2024-09-13T06:43:42.369 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 33.46888251, 2024-09-13T06:43:42.369 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.034864764999999999, 2024-09-13T06:43:42.369 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:42.370 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:42.370 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:42.370 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:42.370 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:42.370 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 237460 2024-09-13T06:43:42.370 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:42.370 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:42.370 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:42.370 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:42.370 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800511+0000", 2024-09-13T06:43:42.370 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:42.370 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:42.370 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:42.370 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:42.371 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800511+0000", 2024-09-13T06:43:42.371 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:42.371 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:42.371 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:42.371 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:42.371 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800511+0000", 2024-09-13T06:43:42.371 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:42.371 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:42.371 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:42.371 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:42.371 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800513+0000", 2024-09-13T06:43:42.371 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6020000000000001e-06 2024-09-13T06:43:42.371 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:42.372 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:42.372 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:42.372 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800517+0000", 2024-09-13T06:43:42.372 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0559999999999998e-06 2024-09-13T06:43:42.372 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:42.372 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:42.372 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:42.372 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800521+0000", 2024-09-13T06:43:42.372 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.4050000000000002e-06 2024-09-13T06:43:42.372 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:42.372 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:42.372 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:42.373 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.835278+0000", 2024-09-13T06:43:42.373 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.034757154999999998 2024-09-13T06:43:42.373 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:42.373 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:42.373 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:42.373 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.835319+0000", 2024-09-13T06:43:42.373 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.1121000000000002e-05 2024-09-13T06:43:42.373 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:42.373 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:42.373 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:42.373 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.835376+0000", 2024-09-13T06:43:42.373 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.6820000000000001e-05 2024-09-13T06:43:42.374 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:42.374 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:42.374 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:42.374 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:42.374 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:42.374 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:43:42.375 INFO:teuthology.orchestra.run.smithi081.stdout:osd.2: {} 2024-09-13T06:43:42.375 INFO:teuthology.orchestra.run.smithi081.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-13T06:43:42.376 INFO:teuthology.orchestra.run.smithi081.stdout:osd.3: {} 2024-09-13T06:43:42.376 INFO:teuthology.orchestra.run.smithi081.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-13T06:43:42.376 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-13T06:43:42.377 INFO:teuthology.orchestra.run.smithi081.stdout:osd.4: {} 2024-09-13T06:43:42.377 INFO:teuthology.orchestra.run.smithi081.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-13T06:43:42.378 INFO:teuthology.orchestra.run.smithi081.stdout:osd.5: {} 2024-09-13T06:43:42.378 INFO:teuthology.orchestra.run.smithi081.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-13T06:43:42.378 INFO:teuthology.orchestra.run.smithi081.stderr:Error ENXIO: problem getting command descriptions from osd.6 2024-09-13T06:43:42.378 INFO:teuthology.orchestra.run.smithi081.stdout:osd.7: {} 2024-09-13T06:43:42.379 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-13T06:43:42.379 INFO:teuthology.orchestra.run.smithi081.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-13T06:43:42.379 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-13T06:43:42.379 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:43:42.375+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:43:42.476 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:43:42.475+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:43:42.553 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:43:42.553 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:43:42.568 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-13T06:43:42.577 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-13T06:43:42.577+0000 7fa8bb18e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 36790) UID: 0 2024-09-13T06:43:42.677 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:43:42.677+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:43:42.736 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:43:42.736 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:43:42.750 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-13T06:43:42.794 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:43:42.795+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:43:42.872 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:43:42.873 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:43:42.879 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-13T06:43:42.881+0000 7fa8bb18e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 36790) UID: 0 2024-09-13T06:43:42.888 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-13T06:43:42.980 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:43:42.979+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:43:43.053 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:43:43.053 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:43:43.067 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-13T06:43:43.081 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:43:43.081+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:43:43.182 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:43:43.181+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:43:43.233 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:43:43.233 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:43:43.247 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-13T06:43:43.283 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:43:43.285+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:43:43.369 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:43:43.370 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:43:43.384 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-13T06:43:43.385 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:43:43.385+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:43:43.444 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-13T06:43:43.485 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-13T06:43:43.485+0000 7fa8bb18e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 36790) UID: 0 2024-09-13T06:43:43.525 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:43:43.525 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:43:43.539 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-13T06:43:43.586 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:43:43.585+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:43:43.672 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:43:43.673 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:43:43.686 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:43:43.685+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:43:43.687 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-13T06:43:43.787 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-13T06:43:43.789+0000 7fa8bb18e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 36790) UID: 0 2024-09-13T06:43:43.803 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:43:43.803 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:43:43.817 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-13T06:43:43.888 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:43:43.887+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:43:43.938 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:43:43.938 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:43:43.952 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-13T06:43:43.998 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:43:43.999+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:43:44.089 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:43:44.087+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:43:44.119 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:43:44.119 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:43:44.136 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-13T06:43:44.190 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-13T06:43:44.189+0000 7fa8bb18e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 36790) UID: 0 2024-09-13T06:43:44.291 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:43:44.293+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:43:44.297 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:43:44.297 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:43:44.311 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-13T06:43:44.380 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-13T06:43:44.392 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-13T06:43:44.393+0000 7fa8bb18e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 36790) UID: 0 2024-09-13T06:43:44.444 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:43:44.444 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:43:44.458 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-13T06:43:44.477 INFO:teuthology.orchestra.run.smithi081.stderr:noscrub is unset 2024-09-13T06:43:44.493 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:43:44.491+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:43:44.536 INFO:teuthology.orchestra.run.smithi081.stdout:osd.0: {} 2024-09-13T06:43:44.536 INFO:teuthology.orchestra.run.smithi081.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-13T06:43:44.553 INFO:teuthology.orchestra.run.smithi081.stdout:osd.1: {} 2024-09-13T06:43:44.553 INFO:teuthology.orchestra.run.smithi081.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-13T06:43:44.571 INFO:teuthology.orchestra.run.smithi081.stdout:osd.2: {} 2024-09-13T06:43:44.571 INFO:teuthology.orchestra.run.smithi081.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-13T06:43:44.594 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:43:44.593+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:43:44.600 INFO:teuthology.orchestra.run.smithi081.stdout:osd.3: {} 2024-09-13T06:43:44.600 INFO:teuthology.orchestra.run.smithi081.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-13T06:43:44.628 INFO:teuthology.orchestra.run.smithi081.stdout:osd.4: {} 2024-09-13T06:43:44.628 INFO:teuthology.orchestra.run.smithi081.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-13T06:43:44.645 INFO:teuthology.orchestra.run.smithi081.stdout:osd.5: {} 2024-09-13T06:43:44.646 INFO:teuthology.orchestra.run.smithi081.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-13T06:43:44.646 INFO:teuthology.orchestra.run.smithi081.stderr:Error ENXIO: problem getting command descriptions from osd.6 2024-09-13T06:43:44.649 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:43:44.649 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [], 2024-09-13T06:43:44.649 INFO:teuthology.orchestra.run.smithi139.stdout: "complaint_time": 30, 2024-09-13T06:43:44.649 INFO:teuthology.orchestra.run.smithi139.stdout: "num_blocked_ops": 0 2024-09-13T06:43:44.649 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:43:44.663 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-13T06:43:44.667 INFO:teuthology.orchestra.run.smithi081.stdout:osd.7: {} 2024-09-13T06:43:44.668 INFO:teuthology.orchestra.run.smithi081.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-13T06:43:44.671 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-13T06:43:44.671 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-13T06:43:44.718 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:43:44.719+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:43:44.796 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:43:44.795+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:43:44.824 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:43:44.824 INFO:teuthology.orchestra.run.smithi139.stdout: "size": 20, 2024-09-13T06:43:44.824 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 600, 2024-09-13T06:43:44.824 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [ 2024-09-13T06:43:44.824 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:44.824 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:160483 3.a 3:57f62123:::rbd_header.112138ed422:head [watch reconnect cookie 140361344088384 gen 3] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e177)", 2024-09-13T06:43:44.825 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:42:17.439011+0000", 2024-09-13T06:43:44.825 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 87.385259473999994, 2024-09-13T06:43:44.825 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.155518861, 2024-09-13T06:43:44.825 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:44.825 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:44.825 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:44.825 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:44.825 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:44.825 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 160483 2024-09-13T06:43:44.825 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:44.825 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:44.825 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:44.826 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:44.826 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:17.439011+0000", 2024-09-13T06:43:44.826 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:44.826 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:44.826 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:44.826 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:44.826 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:17.439011+0000", 2024-09-13T06:43:44.826 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:44.826 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:44.826 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:44.826 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:44.826 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:17.439009+0000", 2024-09-13T06:43:44.827 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999976 2024-09-13T06:43:44.827 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:44.827 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:44.827 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:44.827 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:17.439024+0000", 2024-09-13T06:43:44.827 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.464e-05 2024-09-13T06:43:44.827 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:44.827 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:44.827 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:44.827 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:17.439058+0000", 2024-09-13T06:43:44.827 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.4712999999999998e-05 2024-09-13T06:43:44.827 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:44.827 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:44.827 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:44.828 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:17.439085+0000", 2024-09-13T06:43:44.828 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.6216000000000001e-05 2024-09-13T06:43:44.828 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:44.828 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:44.828 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:44.828 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:17.439182+0000", 2024-09-13T06:43:44.828 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.7020000000000003e-05 2024-09-13T06:43:44.828 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:44.828 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:44.828 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:43:44.828 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:17.439204+0000", 2024-09-13T06:43:44.828 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.2276000000000002e-05 2024-09-13T06:43:44.828 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:44.829 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:44.829 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:44.829 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:18.588627+0000", 2024-09-13T06:43:44.829 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1494235829999999 2024-09-13T06:43:44.829 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:44.829 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:44.829 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for rw locks", 2024-09-13T06:43:44.829 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:18.589031+0000", 2024-09-13T06:43:44.829 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0004035 2024-09-13T06:43:44.829 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:44.829 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:44.829 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:44.829 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:18.590604+0000", 2024-09-13T06:43:44.829 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.001573234 2024-09-13T06:43:44.830 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:44.830 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:44.830 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:44.830 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:18.590791+0000", 2024-09-13T06:43:44.830 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000186701 2024-09-13T06:43:44.830 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:44.830 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:44.830 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:44.830 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:18.594530+0000", 2024-09-13T06:43:44.830 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0037394250000000002 2024-09-13T06:43:44.830 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:44.830 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:44.830 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:44.831 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:44.831 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:44.831 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:208355 3.14 3:2d339b7f:::rbd_data.1121cb4a09ed.0000000000000003:snapdir [list-snaps] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e219)", 2024-09-13T06:43:44.831 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:43:03.420412+0000", 2024-09-13T06:43:44.831 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 41.403859337999997, 2024-09-13T06:43:44.831 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.705233864, 2024-09-13T06:43:44.831 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:44.831 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:44.831 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:44.831 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:44.831 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:44.831 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 208355 2024-09-13T06:43:44.831 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:44.832 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:44.832 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:44.832 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:44.832 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420412+0000", 2024-09-13T06:43:44.832 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:44.832 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:44.832 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:44.832 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:44.832 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420412+0000", 2024-09-13T06:43:44.832 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:44.832 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:44.832 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:44.832 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:44.833 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420409+0000", 2024-09-13T06:43:44.833 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999981 2024-09-13T06:43:44.833 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:44.833 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:44.833 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:44.833 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420420+0000", 2024-09-13T06:43:44.833 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0716e-05 2024-09-13T06:43:44.833 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:44.833 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:44.834 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:44.834 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420440+0000", 2024-09-13T06:43:44.835 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.9850000000000001e-05 2024-09-13T06:43:44.835 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:44.835 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:44.835 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:44.835 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420456+0000", 2024-09-13T06:43:44.835 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5667000000000001e-05 2024-09-13T06:43:44.835 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:44.835 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:44.835 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:44.835 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420724+0000", 2024-09-13T06:43:44.835 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00026873400000000002 2024-09-13T06:43:44.835 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:44.835 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:44.836 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:43:44.836 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420740+0000", 2024-09-13T06:43:44.836 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5486999999999999e-05 2024-09-13T06:43:44.836 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:44.836 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:44.836 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:44.836 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.125004+0000", 2024-09-13T06:43:44.836 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7042643119999998 2024-09-13T06:43:44.836 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:44.836 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:44.836 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:44.836 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.125293+0000", 2024-09-13T06:43:44.836 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000288664 2024-09-13T06:43:44.836 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:44.837 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:44.837 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:44.837 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.125645+0000", 2024-09-13T06:43:44.837 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00035247700000000002 2024-09-13T06:43:44.837 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:44.837 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:44.837 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:44.837 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:44.837 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:44.837 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:208362 3.14 3:2d339b7f:::rbd_data.1121cb4a09ed.0000000000000003:snapdir [list-snaps] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e219)", 2024-09-13T06:43:44.837 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:43:03.420469+0000", 2024-09-13T06:43:44.837 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 41.403801862000002, 2024-09-13T06:43:44.837 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.706123917, 2024-09-13T06:43:44.838 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:44.838 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:44.838 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:44.838 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:44.838 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:44.838 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 208362 2024-09-13T06:43:44.838 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:44.838 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:44.838 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:44.838 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:44.838 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420469+0000", 2024-09-13T06:43:44.838 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:44.838 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:44.838 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:44.839 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:44.839 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420469+0000", 2024-09-13T06:43:44.839 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:44.839 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:44.839 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:44.839 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:44.839 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420468+0000", 2024-09-13T06:43:44.839 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:44.839 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:44.839 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:44.839 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:44.839 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420473+0000", 2024-09-13T06:43:44.839 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.7099999999999998e-06 2024-09-13T06:43:44.839 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:44.840 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:44.840 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:44.840 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420483+0000", 2024-09-13T06:43:44.840 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.7960000000000007e-06 2024-09-13T06:43:44.840 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:44.840 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:44.840 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:44.840 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420491+0000", 2024-09-13T06:43:44.840 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.8169999999999999e-06 2024-09-13T06:43:44.840 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:44.840 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:44.840 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:44.840 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420829+0000", 2024-09-13T06:43:44.841 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000338494 2024-09-13T06:43:44.841 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:44.841 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:44.841 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:43:44.841 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420857+0000", 2024-09-13T06:43:44.841 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.8140000000000002e-05 2024-09-13T06:43:44.841 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:44.841 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:44.841 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:44.841 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.126086+0000", 2024-09-13T06:43:44.841 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7052288369999999 2024-09-13T06:43:44.841 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:44.841 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:44.842 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:44.842 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.126269+0000", 2024-09-13T06:43:44.842 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000183301 2024-09-13T06:43:44.842 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:44.842 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:44.842 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:44.842 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.126593+0000", 2024-09-13T06:43:44.842 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00032352800000000001 2024-09-13T06:43:44.842 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:44.842 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:44.842 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:44.842 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:44.842 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:44.842 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:208369 3.14 3:2d339b7f:::rbd_data.1121cb4a09ed.0000000000000003:snapdir [list-snaps] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e219)", 2024-09-13T06:43:44.843 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:43:03.420498+0000", 2024-09-13T06:43:44.843 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 41.403772818, 2024-09-13T06:43:44.843 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.706613895, 2024-09-13T06:43:44.843 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:44.843 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:44.843 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:44.843 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:44.843 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:44.843 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 208369 2024-09-13T06:43:44.843 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:44.843 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:44.843 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:44.843 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:44.843 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420498+0000", 2024-09-13T06:43:44.844 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:44.844 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:44.844 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:44.844 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:44.844 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420498+0000", 2024-09-13T06:43:44.844 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:44.844 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:44.844 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:44.844 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:44.844 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420497+0000", 2024-09-13T06:43:44.844 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:44.844 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:44.844 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:44.845 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:44.845 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420501+0000", 2024-09-13T06:43:44.845 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.737e-06 2024-09-13T06:43:44.845 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:44.845 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:44.845 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:44.845 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420522+0000", 2024-09-13T06:43:44.845 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.1152999999999999e-05 2024-09-13T06:43:44.845 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:44.845 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:44.846 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:44.846 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420533+0000", 2024-09-13T06:43:44.846 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0366999999999999e-05 2024-09-13T06:43:44.846 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:44.846 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:44.846 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:44.846 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420968+0000", 2024-09-13T06:43:44.846 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00043495900000000001 2024-09-13T06:43:44.846 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:44.846 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:44.847 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:43:44.847 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420977+0000", 2024-09-13T06:43:44.847 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.8039999999999996e-06 2024-09-13T06:43:44.847 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:44.847 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:44.847 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:44.847 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.126670+0000", 2024-09-13T06:43:44.847 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7056928760000001 2024-09-13T06:43:44.847 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:44.847 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:44.848 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:44.848 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.126833+0000", 2024-09-13T06:43:44.848 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00016253200000000001 2024-09-13T06:43:44.848 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:44.848 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:44.848 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:44.848 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.127112+0000", 2024-09-13T06:43:44.848 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000279141 2024-09-13T06:43:44.848 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:44.848 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:44.848 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:44.848 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:44.848 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:44.848 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:208376 3.14 3:2d339b7f:::rbd_data.1121cb4a09ed.0000000000000003:snapdir [list-snaps] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e219)", 2024-09-13T06:43:44.849 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:43:03.420541+0000", 2024-09-13T06:43:44.849 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 41.403729562000002, 2024-09-13T06:43:44.849 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7070606820000001, 2024-09-13T06:43:44.849 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:44.849 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:44.849 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:44.849 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:44.849 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:44.849 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 208376 2024-09-13T06:43:44.849 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:44.849 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:44.849 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:44.849 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:44.850 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420541+0000", 2024-09-13T06:43:44.850 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:44.850 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:44.850 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:44.850 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:44.850 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420541+0000", 2024-09-13T06:43:44.850 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:44.850 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:44.850 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:44.850 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:44.850 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420541+0000", 2024-09-13T06:43:44.850 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:44.850 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:44.851 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:44.851 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:44.851 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420544+0000", 2024-09-13T06:43:44.851 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.5530000000000001e-06 2024-09-13T06:43:44.851 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:44.851 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:44.851 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:44.851 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420557+0000", 2024-09-13T06:43:44.851 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2663000000000001e-05 2024-09-13T06:43:44.851 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:44.851 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:44.851 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:44.851 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420572+0000", 2024-09-13T06:43:44.851 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5463000000000001e-05 2024-09-13T06:43:44.852 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:44.852 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:44.852 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:44.852 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.421070+0000", 2024-09-13T06:43:44.852 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00049723599999999997 2024-09-13T06:43:44.852 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:44.852 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:44.852 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:43:44.852 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.421092+0000", 2024-09-13T06:43:44.852 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.2354e-05 2024-09-13T06:43:44.852 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:44.852 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:44.852 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:44.853 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.127184+0000", 2024-09-13T06:43:44.853 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7060917330000001 2024-09-13T06:43:44.853 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:44.853 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:44.853 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:44.853 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.127340+0000", 2024-09-13T06:43:44.853 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00015640200000000001 2024-09-13T06:43:44.853 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:44.853 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:44.853 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:44.853 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.127602+0000", 2024-09-13T06:43:44.853 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00026192799999999998 2024-09-13T06:43:44.853 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:44.853 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:44.854 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:44.854 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:44.854 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:44.854 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:208383 3.14 3:2d339b7f:::rbd_data.1121cb4a09ed.0000000000000003:snapdir [list-snaps] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e219)", 2024-09-13T06:43:44.854 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:43:03.420585+0000", 2024-09-13T06:43:44.854 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 41.403685709000001, 2024-09-13T06:43:44.854 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.707457405, 2024-09-13T06:43:44.854 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:44.854 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:44.854 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:44.854 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:44.854 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:44.854 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 208383 2024-09-13T06:43:44.854 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:44.854 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:44.854 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:44.855 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:44.855 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420585+0000", 2024-09-13T06:43:44.855 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:44.855 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:44.855 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:44.855 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:44.855 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420585+0000", 2024-09-13T06:43:44.855 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:44.855 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:44.855 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:44.855 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:44.855 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420584+0000", 2024-09-13T06:43:44.855 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:43:44.855 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:44.855 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:44.856 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:44.856 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420614+0000", 2024-09-13T06:43:44.856 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.9886000000000002e-05 2024-09-13T06:43:44.856 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:44.856 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:44.856 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:44.856 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420640+0000", 2024-09-13T06:43:44.856 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.5663000000000001e-05 2024-09-13T06:43:44.856 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:44.856 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:44.856 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:44.856 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420669+0000", 2024-09-13T06:43:44.856 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.9289999999999999e-05 2024-09-13T06:43:44.856 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:44.857 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:44.857 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:44.857 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.421168+0000", 2024-09-13T06:43:44.857 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00049857600000000003 2024-09-13T06:43:44.857 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:44.857 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:44.857 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:43:44.857 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.421177+0000", 2024-09-13T06:43:44.857 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.533e-06 2024-09-13T06:43:44.857 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:44.857 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:44.857 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:44.857 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.127648+0000", 2024-09-13T06:43:44.858 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7064713569999999 2024-09-13T06:43:44.858 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:44.858 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:44.858 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:44.858 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.127794+0000", 2024-09-13T06:43:44.858 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00014589200000000001 2024-09-13T06:43:44.858 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:44.858 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:44.858 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:44.858 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.128043+0000", 2024-09-13T06:43:44.858 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00024821799999999997 2024-09-13T06:43:44.858 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:44.858 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:44.859 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:44.859 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:44.859 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:44.859 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:208390 3.14 3:2d339b7f:::rbd_data.1121cb4a09ed.0000000000000003:snapdir [list-snaps] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e219)", 2024-09-13T06:43:44.859 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:43:03.420713+0000", 2024-09-13T06:43:44.859 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 41.403557749999997, 2024-09-13T06:43:44.859 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7077568059999999, 2024-09-13T06:43:44.859 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:44.859 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:44.859 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:44.859 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:44.859 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:44.859 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 208390 2024-09-13T06:43:44.859 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:44.859 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:44.860 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:44.860 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:44.860 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420713+0000", 2024-09-13T06:43:44.860 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:44.860 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:44.860 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:44.860 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:44.860 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420713+0000", 2024-09-13T06:43:44.860 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:44.860 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:44.860 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:44.860 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:44.860 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420712+0000", 2024-09-13T06:43:44.861 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:43:44.861 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:44.861 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:44.861 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:44.861 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420719+0000", 2024-09-13T06:43:44.861 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.883e-06 2024-09-13T06:43:44.861 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:44.861 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:44.861 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:44.861 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420737+0000", 2024-09-13T06:43:44.861 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.8082999999999999e-05 2024-09-13T06:43:44.861 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:44.861 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:44.862 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:44.862 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420757+0000", 2024-09-13T06:43:44.862 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.0256999999999999e-05 2024-09-13T06:43:44.862 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:44.862 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:44.862 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:44.862 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.421258+0000", 2024-09-13T06:43:44.862 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00050028500000000005 2024-09-13T06:43:44.862 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:44.862 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:44.862 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:43:44.862 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.421282+0000", 2024-09-13T06:43:44.862 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.4236999999999999e-05 2024-09-13T06:43:44.862 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:44.863 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:44.863 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:44.863 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.128087+0000", 2024-09-13T06:43:44.863 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.706805551 2024-09-13T06:43:44.863 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:44.863 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:44.863 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:44.863 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.128231+0000", 2024-09-13T06:43:44.863 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00014348200000000001 2024-09-13T06:43:44.863 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:44.863 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:44.863 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:44.863 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.128470+0000", 2024-09-13T06:43:44.863 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000239058 2024-09-13T06:43:44.863 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:44.864 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:44.864 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:44.864 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:44.864 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:44.864 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:208397 3.14 3:2d339b7f:::rbd_data.1121cb4a09ed.0000000000000003:snapdir [list-snaps] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e219)", 2024-09-13T06:43:44.864 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:43:03.420772+0000", 2024-09-13T06:43:44.864 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 41.403498370999998, 2024-09-13T06:43:44.864 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7081308659999999, 2024-09-13T06:43:44.864 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:44.864 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:44.864 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:44.864 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:44.864 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:44.864 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 208397 2024-09-13T06:43:44.864 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:44.865 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:44.865 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:44.865 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:44.865 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420772+0000", 2024-09-13T06:43:44.865 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:44.865 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:44.865 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:44.865 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:44.865 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420772+0000", 2024-09-13T06:43:44.865 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:44.865 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:44.865 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:44.865 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:44.865 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420772+0000", 2024-09-13T06:43:44.865 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:43:44.866 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:44.866 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:44.866 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:44.866 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420777+0000", 2024-09-13T06:43:44.866 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.8329999999999999e-06 2024-09-13T06:43:44.866 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:44.866 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:44.866 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:44.866 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420795+0000", 2024-09-13T06:43:44.866 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7677e-05 2024-09-13T06:43:44.866 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:44.867 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:44.867 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:44.867 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420811+0000", 2024-09-13T06:43:44.867 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5673000000000001e-05 2024-09-13T06:43:44.867 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:44.867 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:44.867 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:44.867 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.421352+0000", 2024-09-13T06:43:44.867 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00054091199999999995 2024-09-13T06:43:44.867 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:44.867 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:44.867 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:43:44.867 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.421364+0000", 2024-09-13T06:43:44.867 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.182e-05 2024-09-13T06:43:44.867 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:44.868 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:44.868 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:44.868 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.128512+0000", 2024-09-13T06:43:44.868 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.707148584 2024-09-13T06:43:44.868 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:44.868 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:44.868 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:44.868 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.128653+0000", 2024-09-13T06:43:44.868 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00014127599999999999 2024-09-13T06:43:44.868 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:44.868 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:44.868 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:44.868 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.128903+0000", 2024-09-13T06:43:44.868 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000249941 2024-09-13T06:43:44.869 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:44.869 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:44.869 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:44.869 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:44.869 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:44.869 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:208404 3.14 3:2d339b7f:::rbd_data.1121cb4a09ed.0000000000000003:snapdir [list-snaps] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e219)", 2024-09-13T06:43:44.869 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:43:03.420837+0000", 2024-09-13T06:43:44.869 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 41.403433735, 2024-09-13T06:43:44.869 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.70849154, 2024-09-13T06:43:44.869 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:44.869 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:44.869 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:44.869 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:44.869 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:44.869 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 208404 2024-09-13T06:43:44.870 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:44.870 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:44.870 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:44.870 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:44.870 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420837+0000", 2024-09-13T06:43:44.870 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:44.870 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:44.870 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:44.870 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:44.870 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420837+0000", 2024-09-13T06:43:44.870 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:44.870 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:44.870 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:44.870 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:44.870 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420836+0000", 2024-09-13T06:43:44.871 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999986 2024-09-13T06:43:44.871 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:44.871 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:44.871 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:44.871 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420842+0000", 2024-09-13T06:43:44.871 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.4400000000000002e-06 2024-09-13T06:43:44.871 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:44.871 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:44.871 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:44.871 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420860+0000", 2024-09-13T06:43:44.871 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7487e-05 2024-09-13T06:43:44.871 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:44.871 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:44.871 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:44.871 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420916+0000", 2024-09-13T06:43:44.872 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.6276999999999997e-05 2024-09-13T06:43:44.872 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:44.872 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:44.872 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:44.872 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.421450+0000", 2024-09-13T06:43:44.872 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00053433500000000004 2024-09-13T06:43:44.872 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:44.872 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:44.872 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:43:44.872 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.421474+0000", 2024-09-13T06:43:44.872 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.3799e-05 2024-09-13T06:43:44.872 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:44.872 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:44.872 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:44.873 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.128945+0000", 2024-09-13T06:43:44.873 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.707470912 2024-09-13T06:43:44.873 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:44.873 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:44.873 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:44.873 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.129087+0000", 2024-09-13T06:43:44.873 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00014170900000000001 2024-09-13T06:43:44.873 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:44.873 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:44.873 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:44.873 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.129329+0000", 2024-09-13T06:43:44.873 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000241831 2024-09-13T06:43:44.873 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:44.873 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:44.873 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:44.874 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:44.874 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:44.874 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:208411 3.14 3:2d339b7f:::rbd_data.1121cb4a09ed.0000000000000003:snapdir [list-snaps] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e219)", 2024-09-13T06:43:44.874 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:43:03.420964+0000", 2024-09-13T06:43:44.874 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 41.403306503000003, 2024-09-13T06:43:44.874 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.708812754, 2024-09-13T06:43:44.874 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:44.874 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:44.874 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:44.874 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:44.874 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:44.874 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 208411 2024-09-13T06:43:44.875 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:44.875 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:44.875 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:44.875 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:44.875 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420964+0000", 2024-09-13T06:43:44.875 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:44.875 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:44.875 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:44.875 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:44.875 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420964+0000", 2024-09-13T06:43:44.875 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:44.875 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:44.875 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:44.875 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:44.876 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420963+0000", 2024-09-13T06:43:44.876 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:43:44.876 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:44.876 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:44.876 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:44.876 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420969+0000", 2024-09-13T06:43:44.876 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.7540000000000003e-06 2024-09-13T06:43:44.876 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:44.876 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:44.876 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:44.876 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420979+0000", 2024-09-13T06:43:44.876 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0067e-05 2024-09-13T06:43:44.876 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:44.876 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:44.877 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:44.877 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420987+0000", 2024-09-13T06:43:44.877 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.6990000000000003e-06 2024-09-13T06:43:44.877 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:44.877 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:44.877 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:44.877 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.421563+0000", 2024-09-13T06:43:44.877 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00057654899999999999 2024-09-13T06:43:44.877 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:44.877 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:44.877 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:43:44.877 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.421573+0000", 2024-09-13T06:43:44.877 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.9669999999999996e-06 2024-09-13T06:43:44.877 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:44.878 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:44.878 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:44.878 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.129372+0000", 2024-09-13T06:43:44.878 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.707798602 2024-09-13T06:43:44.878 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:44.878 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:44.878 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:44.878 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.129514+0000", 2024-09-13T06:43:44.878 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00014191200000000001 2024-09-13T06:43:44.878 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:44.878 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:44.878 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:44.878 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.129777+0000", 2024-09-13T06:43:44.878 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00026320100000000002 2024-09-13T06:43:44.879 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:44.879 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:44.879 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:44.879 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:44.879 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:44.879 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:208418 3.14 3:2d339b7f:::rbd_data.1121cb4a09ed.0000000000000003:snapdir [list-snaps] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e219)", 2024-09-13T06:43:44.879 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:43:03.421005+0000", 2024-09-13T06:43:44.879 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 41.403265419, 2024-09-13T06:43:44.879 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7096508159999999, 2024-09-13T06:43:44.879 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:44.879 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:44.879 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:44.879 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:44.879 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:44.880 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 208418 2024-09-13T06:43:44.880 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:44.880 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:44.880 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:44.880 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:44.880 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.421005+0000", 2024-09-13T06:43:44.880 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:44.880 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:44.880 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:44.880 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:44.880 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.421005+0000", 2024-09-13T06:43:44.880 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:44.880 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:44.880 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:44.881 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:44.881 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.421005+0000", 2024-09-13T06:43:44.881 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:44.881 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:44.881 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:44.881 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:44.881 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.421008+0000", 2024-09-13T06:43:44.881 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.2550000000000002e-06 2024-09-13T06:43:44.881 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:44.881 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:44.882 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:44.882 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.421015+0000", 2024-09-13T06:43:44.882 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.0600000000000002e-06 2024-09-13T06:43:44.882 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:44.882 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:44.882 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:44.882 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.421021+0000", 2024-09-13T06:43:44.882 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.8139999999999997e-06 2024-09-13T06:43:44.882 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:44.882 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:44.882 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:44.882 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.421638+0000", 2024-09-13T06:43:44.882 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00061702600000000001 2024-09-13T06:43:44.883 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:44.883 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:44.883 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:43:44.883 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.421659+0000", 2024-09-13T06:43:44.883 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.0894e-05 2024-09-13T06:43:44.883 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:44.883 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:44.883 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:44.883 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.129858+0000", 2024-09-13T06:43:44.883 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.708198632 2024-09-13T06:43:44.883 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:44.883 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:44.883 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:44.883 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.130158+0000", 2024-09-13T06:43:44.884 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00030000099999999999 2024-09-13T06:43:44.884 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:44.884 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:44.884 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:44.884 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.130656+0000", 2024-09-13T06:43:44.884 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00049864199999999999 2024-09-13T06:43:44.884 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:44.884 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:44.884 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:44.885 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:44.885 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:44.885 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:209008 3.3 3:c6ff3074:::rbd_data.1121cb4a09ed.0000000000000001:82 [read 397312~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e220)", 2024-09-13T06:43:44.885 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:43:05.165956+0000", 2024-09-13T06:43:44.885 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 39.658315109, 2024-09-13T06:43:44.885 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.120605692, 2024-09-13T06:43:44.885 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:44.885 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:44.885 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:44.885 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:44.885 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:44.885 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 209008 2024-09-13T06:43:44.885 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:44.886 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:44.886 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:44.886 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:44.886 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.165956+0000", 2024-09-13T06:43:44.886 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:44.886 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:44.886 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:44.886 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:44.886 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.165956+0000", 2024-09-13T06:43:44.886 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:44.886 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:44.886 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:44.886 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:44.886 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.165955+0000", 2024-09-13T06:43:44.887 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:43:44.887 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:44.887 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:44.887 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:44.887 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.165960+0000", 2024-09-13T06:43:44.887 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.6200000000000004e-06 2024-09-13T06:43:44.887 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:44.887 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:44.887 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:44.887 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.165998+0000", 2024-09-13T06:43:44.887 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.7703000000000001e-05 2024-09-13T06:43:44.887 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:44.887 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:44.888 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:44.888 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.166012+0000", 2024-09-13T06:43:44.888 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3682999999999999e-05 2024-09-13T06:43:44.888 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:44.888 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:44.888 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:44.888 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.286043+0000", 2024-09-13T06:43:44.888 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.120030867 2024-09-13T06:43:44.888 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:44.888 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:44.888 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:44.888 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.286196+0000", 2024-09-13T06:43:44.888 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000153759 2024-09-13T06:43:44.888 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:44.889 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:44.889 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:44.889 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.286561+0000", 2024-09-13T06:43:44.889 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00036504700000000002 2024-09-13T06:43:44.889 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:44.889 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:44.889 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:44.889 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:44.889 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:44.889 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:209009 3.3 3:c6ff3074:::rbd_data.1121cb4a09ed.0000000000000001:82 [read 409600~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e220)", 2024-09-13T06:43:44.889 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:43:05.166111+0000", 2024-09-13T06:43:44.889 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 39.658159464000001, 2024-09-13T06:43:44.889 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.121025172, 2024-09-13T06:43:44.890 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:44.890 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:44.890 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:44.890 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:44.890 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:44.890 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 209009 2024-09-13T06:43:44.890 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:44.890 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:44.890 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:44.890 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:44.890 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.166111+0000", 2024-09-13T06:43:44.890 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:44.890 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:44.890 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:44.891 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:44.891 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.166111+0000", 2024-09-13T06:43:44.891 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:44.891 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:44.891 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:44.891 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:44.891 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.166023+0000", 2024-09-13T06:43:44.891 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999113 2024-09-13T06:43:44.891 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:44.891 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:44.891 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:44.891 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.166118+0000", 2024-09-13T06:43:44.891 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.5818999999999999e-05 2024-09-13T06:43:44.892 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:44.892 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:44.892 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:44.892 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.166145+0000", 2024-09-13T06:43:44.892 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.6679999999999999e-05 2024-09-13T06:43:44.892 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:44.892 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:44.892 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:44.892 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.166162+0000", 2024-09-13T06:43:44.892 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6413e-05 2024-09-13T06:43:44.892 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:44.892 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:44.892 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:44.893 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.286636+0000", 2024-09-13T06:43:44.893 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.120474003 2024-09-13T06:43:44.893 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:44.893 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:44.893 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:44.893 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.286799+0000", 2024-09-13T06:43:44.893 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00016363900000000001 2024-09-13T06:43:44.893 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:44.893 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:44.893 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:44.893 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.287137+0000", 2024-09-13T06:43:44.893 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00033736699999999998 2024-09-13T06:43:44.893 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:44.893 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:44.894 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:44.894 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:44.894 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:44.894 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:209010 3.3 3:c6ff3074:::rbd_data.1121cb4a09ed.0000000000000001:82 [read 421888~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e220)", 2024-09-13T06:43:44.894 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:43:05.167018+0000", 2024-09-13T06:43:44.894 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 39.657253285000003, 2024-09-13T06:43:44.894 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.120709894, 2024-09-13T06:43:44.894 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:44.894 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:44.894 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:44.894 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:44.894 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:44.894 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 209010 2024-09-13T06:43:44.894 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:44.895 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:44.895 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:44.895 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:44.895 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.167018+0000", 2024-09-13T06:43:44.895 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:44.895 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:44.895 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:44.895 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:44.895 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.167018+0000", 2024-09-13T06:43:44.895 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:44.895 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:44.895 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:44.895 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:44.895 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.166214+0000", 2024-09-13T06:43:44.896 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9991961 2024-09-13T06:43:44.896 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:44.896 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:44.896 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:44.896 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.167039+0000", 2024-09-13T06:43:44.896 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00082531599999999998 2024-09-13T06:43:44.896 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:44.896 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:44.896 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:44.896 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.167083+0000", 2024-09-13T06:43:44.896 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.4079999999999998e-05 2024-09-13T06:43:44.896 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:44.897 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:44.897 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:44.897 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.167113+0000", 2024-09-13T06:43:44.897 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.025e-05 2024-09-13T06:43:44.897 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:44.897 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:44.897 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:44.897 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.287229+0000", 2024-09-13T06:43:44.897 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.12011563 2024-09-13T06:43:44.897 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:44.897 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:44.897 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:44.897 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.287369+0000", 2024-09-13T06:43:44.897 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00014040499999999999 2024-09-13T06:43:44.898 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:44.898 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:44.898 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:44.898 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.287727+0000", 2024-09-13T06:43:44.898 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000358043 2024-09-13T06:43:44.898 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:44.898 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:44.898 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:44.898 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:44.898 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:44.898 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:209011 3.3 3:c6ff3074:::rbd_data.1121cb4a09ed.0000000000000001:82 [read 434176~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e220)", 2024-09-13T06:43:44.898 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:43:05.167765+0000", 2024-09-13T06:43:44.898 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 39.656505791000001, 2024-09-13T06:43:44.898 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.12054767199999999, 2024-09-13T06:43:44.899 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:44.899 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:44.899 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:44.899 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:44.899 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:44.899 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 209011 2024-09-13T06:43:44.899 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:44.899 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:44.899 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:44.899 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:44.899 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.167765+0000", 2024-09-13T06:43:44.899 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:44.899 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:44.899 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:44.900 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:44.900 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.167765+0000", 2024-09-13T06:43:44.900 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:44.900 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:44.900 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:44.900 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:44.900 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.167131+0000", 2024-09-13T06:43:44.900 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9993658 2024-09-13T06:43:44.900 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:44.900 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:44.900 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:44.900 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.167772+0000", 2024-09-13T06:43:44.901 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00064152399999999998 2024-09-13T06:43:44.901 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:44.901 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:44.901 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:44.901 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.167791+0000", 2024-09-13T06:43:44.901 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.8944e-05 2024-09-13T06:43:44.901 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:44.901 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:44.901 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:44.901 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.167805+0000", 2024-09-13T06:43:44.901 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.395e-05 2024-09-13T06:43:44.901 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:44.901 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:44.901 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:44.902 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.287803+0000", 2024-09-13T06:43:44.902 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.11999747099999999 2024-09-13T06:43:44.902 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:44.902 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:44.902 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:44.902 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.287964+0000", 2024-09-13T06:43:44.902 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00016155100000000001 2024-09-13T06:43:44.902 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:44.902 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:44.902 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:44.902 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.288313+0000", 2024-09-13T06:43:44.902 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00034865699999999999 2024-09-13T06:43:44.902 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:44.902 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:44.903 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:44.903 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:44.903 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:44.903 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:209013 3.3 3:c6ff3074:::rbd_data.1121cb4a09ed.0000000000000001:82 [read 458752~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e220)", 2024-09-13T06:43:44.903 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:43:05.168880+0000", 2024-09-13T06:43:44.903 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 39.655390707000002, 2024-09-13T06:43:44.903 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.120462023, 2024-09-13T06:43:44.903 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:44.903 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:44.903 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:44.903 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:44.903 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:44.903 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 209013 2024-09-13T06:43:44.903 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:44.904 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:44.904 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:44.904 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:44.904 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.168880+0000", 2024-09-13T06:43:44.904 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:44.904 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:44.904 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:44.904 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:44.904 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.168880+0000", 2024-09-13T06:43:44.904 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:44.904 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:44.904 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:44.904 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:44.905 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.168879+0000", 2024-09-13T06:43:44.905 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999986 2024-09-13T06:43:44.905 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:44.905 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:44.905 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:44.905 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.168888+0000", 2024-09-13T06:43:44.905 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.9930000000000001e-06 2024-09-13T06:43:44.905 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:44.905 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:44.905 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:44.905 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.168908+0000", 2024-09-13T06:43:44.905 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.0276999999999999e-05 2024-09-13T06:43:44.905 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:44.905 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:44.906 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:44.906 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.168923+0000", 2024-09-13T06:43:44.906 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5543e-05 2024-09-13T06:43:44.906 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:44.906 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:44.906 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:44.906 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.288875+0000", 2024-09-13T06:43:44.906 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.119951748 2024-09-13T06:43:44.906 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:44.906 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:44.906 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:44.906 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.289007+0000", 2024-09-13T06:43:44.906 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00013142899999999999 2024-09-13T06:43:44.907 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:44.907 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:44.907 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:44.907 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.289342+0000", 2024-09-13T06:43:44.907 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00033566999999999999 2024-09-13T06:43:44.907 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:44.907 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:44.907 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:44.907 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:44.907 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:44.907 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:209014 3.3 3:c6ff3074:::rbd_data.1121cb4a09ed.0000000000000001:82 [read 471040~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e220)", 2024-09-13T06:43:44.907 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:43:05.169105+0000", 2024-09-13T06:43:44.907 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 39.655166248999997, 2024-09-13T06:43:44.907 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.12087680000000001, 2024-09-13T06:43:44.908 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:44.908 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:44.908 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:44.908 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:44.908 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:44.908 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 209014 2024-09-13T06:43:44.908 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:44.908 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:44.908 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:44.908 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:44.908 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.169105+0000", 2024-09-13T06:43:44.908 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:44.908 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:44.908 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:44.909 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:44.909 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.169105+0000", 2024-09-13T06:43:44.909 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:44.909 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:44.909 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:44.909 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:44.909 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.168936+0000", 2024-09-13T06:43:44.909 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9998312 2024-09-13T06:43:44.909 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:44.909 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:44.909 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:44.909 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.169115+0000", 2024-09-13T06:43:44.909 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00017854500000000001 2024-09-13T06:43:44.910 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:44.910 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:44.910 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:44.910 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.169140+0000", 2024-09-13T06:43:44.910 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.5853000000000001e-05 2024-09-13T06:43:44.910 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:44.910 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:44.910 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:44.910 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.169160+0000", 2024-09-13T06:43:44.910 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.9415999999999998e-05 2024-09-13T06:43:44.910 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:44.910 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:44.910 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:44.910 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.289414+0000", 2024-09-13T06:43:44.911 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.120253785 2024-09-13T06:43:44.911 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:44.911 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:44.911 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:44.911 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.289579+0000", 2024-09-13T06:43:44.911 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00016506299999999999 2024-09-13T06:43:44.911 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:44.911 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:44.911 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:44.911 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.289981+0000", 2024-09-13T06:43:44.911 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000402743 2024-09-13T06:43:44.911 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:44.911 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:44.912 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:44.912 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:44.912 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:44.912 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:209015 3.3 3:c6ff3074:::rbd_data.1121cb4a09ed.0000000000000001:82 [read 483328~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e220)", 2024-09-13T06:43:44.912 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:43:05.169496+0000", 2024-09-13T06:43:44.912 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 39.654775198999999, 2024-09-13T06:43:44.912 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.12105229200000001, 2024-09-13T06:43:44.912 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:44.912 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:44.912 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:44.912 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:44.912 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:44.912 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 209015 2024-09-13T06:43:44.913 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:44.913 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:44.913 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:44.913 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:44.913 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.169496+0000", 2024-09-13T06:43:44.913 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:44.913 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:44.913 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:44.913 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:44.913 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.169496+0000", 2024-09-13T06:43:44.913 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:44.913 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:44.913 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:44.913 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:44.914 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.169177+0000", 2024-09-13T06:43:44.914 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999681 2024-09-13T06:43:44.914 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:44.914 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:44.914 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:44.914 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.169509+0000", 2024-09-13T06:43:44.914 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00033226099999999998 2024-09-13T06:43:44.914 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:44.914 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:44.914 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:44.914 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.169544+0000", 2024-09-13T06:43:44.914 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.5573e-05 2024-09-13T06:43:44.914 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:44.914 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:44.914 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:44.915 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.169560+0000", 2024-09-13T06:43:44.915 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5636000000000001e-05 2024-09-13T06:43:44.915 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:44.915 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:44.915 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:44.915 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.290055+0000", 2024-09-13T06:43:44.915 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.12049523400000001 2024-09-13T06:43:44.915 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:44.915 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:44.915 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:44.915 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.290201+0000", 2024-09-13T06:43:44.915 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000145742 2024-09-13T06:43:44.916 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:44.916 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:44.916 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:44.916 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.290548+0000", 2024-09-13T06:43:44.916 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00034698699999999999 2024-09-13T06:43:44.916 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:44.916 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:44.916 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:44.916 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:44.916 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:44.916 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:209016 3.3 3:c6ff3074:::rbd_data.1121cb4a09ed.0000000000000001:82 [read 495616~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e220)", 2024-09-13T06:43:44.917 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:43:05.169893+0000", 2024-09-13T06:43:44.917 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 39.654377685999997, 2024-09-13T06:43:44.917 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.121278814, 2024-09-13T06:43:44.917 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:44.917 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:44.917 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:44.917 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:44.917 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:44.917 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 209016 2024-09-13T06:43:44.917 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:44.917 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:44.917 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:44.917 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:44.917 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.169893+0000", 2024-09-13T06:43:44.918 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:44.918 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:44.918 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:44.918 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:44.918 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.169893+0000", 2024-09-13T06:43:44.918 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:44.918 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:44.918 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:44.918 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:44.918 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.169572+0000", 2024-09-13T06:43:44.918 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9996786 2024-09-13T06:43:44.918 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:44.918 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:44.918 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:44.919 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.169903+0000", 2024-09-13T06:43:44.919 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00033101400000000003 2024-09-13T06:43:44.919 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:44.919 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:44.919 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:44.919 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.169933+0000", 2024-09-13T06:43:44.919 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.9913e-05 2024-09-13T06:43:44.919 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:44.919 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:44.919 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:44.919 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.169949+0000", 2024-09-13T06:43:44.919 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6313000000000001e-05 2024-09-13T06:43:44.919 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:44.919 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:44.920 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:44.920 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.290622+0000", 2024-09-13T06:43:44.920 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.120672795 2024-09-13T06:43:44.920 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:44.920 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:44.920 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:44.920 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.290788+0000", 2024-09-13T06:43:44.920 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00016597899999999999 2024-09-13T06:43:44.920 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:44.920 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:44.920 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:44.920 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.291172+0000", 2024-09-13T06:43:44.920 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00038422700000000001 2024-09-13T06:43:44.920 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:44.921 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:44.921 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:44.921 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:44.921 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:44.921 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:242330 3.1a 3:5cea7035:::rbd_info:head [call rbd.metadata_list in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e251)", 2024-09-13T06:43:44.921 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:43:36.447499+0000", 2024-09-13T06:43:44.921 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 8.3767719070000002, 2024-09-13T06:43:44.921 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.97783059900000002, 2024-09-13T06:43:44.921 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:44.921 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:44.921 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:44.921 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:44.921 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:44.922 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 242330 2024-09-13T06:43:44.922 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:44.922 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:44.922 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:44.922 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:44.922 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:36.447499+0000", 2024-09-13T06:43:44.922 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:44.922 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:44.922 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:44.922 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:44.922 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:36.447499+0000", 2024-09-13T06:43:44.922 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:44.922 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:44.922 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:44.923 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:44.923 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:36.447497+0000", 2024-09-13T06:43:44.923 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999976 2024-09-13T06:43:44.923 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:44.923 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:44.923 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:44.923 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:36.447510+0000", 2024-09-13T06:43:44.923 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3298999999999999e-05 2024-09-13T06:43:44.923 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:44.923 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:44.923 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:44.923 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:36.447542+0000", 2024-09-13T06:43:44.923 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.163e-05 2024-09-13T06:43:44.923 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:44.924 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:44.924 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:44.924 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:36.447556+0000", 2024-09-13T06:43:44.924 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.4416999999999999e-05 2024-09-13T06:43:44.924 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:44.924 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:44.924 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:44.924 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:36.447667+0000", 2024-09-13T06:43:44.924 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000110886 2024-09-13T06:43:44.924 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:44.924 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:44.924 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:43:44.924 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:36.447688+0000", 2024-09-13T06:43:44.925 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.0656e-05 2024-09-13T06:43:44.925 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:44.925 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:44.925 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:44.925 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:37.424923+0000", 2024-09-13T06:43:44.925 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.97723487399999998 2024-09-13T06:43:44.925 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:44.925 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:44.925 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:44.925 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:37.425107+0000", 2024-09-13T06:43:44.925 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00018405900000000001 2024-09-13T06:43:44.925 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:44.925 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:44.926 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:44.926 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:37.425330+0000", 2024-09-13T06:43:44.926 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00022296800000000001 2024-09-13T06:43:44.926 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:44.926 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:44.926 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:44.926 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:44.926 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:44.926 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:43:44.928 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-13T06:43:44.928 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:43:44.927+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:43:45.029 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:43:45.027+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:43:45.055 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:43:45.055 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [], 2024-09-13T06:43:45.055 INFO:teuthology.orchestra.run.smithi139.stdout: "num_ops": 0 2024-09-13T06:43:45.055 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:43:45.069 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-13T06:43:45.129 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:43:45.127+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:43:45.193 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:43:45.193 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [], 2024-09-13T06:43:45.193 INFO:teuthology.orchestra.run.smithi139.stdout: "complaint_time": 30, 2024-09-13T06:43:45.193 INFO:teuthology.orchestra.run.smithi139.stdout: "num_blocked_ops": 0 2024-09-13T06:43:45.193 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:43:45.207 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-13T06:43:45.230 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:43:45.231+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:43:45.332 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:43:45.331+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:43:45.333 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:43:45.333 INFO:teuthology.orchestra.run.smithi139.stdout: "size": 20, 2024-09-13T06:43:45.334 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 600, 2024-09-13T06:43:45.334 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [ 2024-09-13T06:43:45.334 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:45.334 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43299 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 432128~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:43:45.334 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589881+0000", 2024-09-13T06:43:45.335 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 203.741240922, 2024-09-13T06:43:45.335 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.079693849999999997, 2024-09-13T06:43:45.335 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:45.335 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:45.336 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:45.336 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:45.336 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:45.336 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43299 2024-09-13T06:43:45.336 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:45.337 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:45.337 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:45.337 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:45.337 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589881+0000", 2024-09-13T06:43:45.337 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:45.337 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:45.338 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:45.338 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:45.338 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589881+0000", 2024-09-13T06:43:45.338 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:45.338 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:45.339 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:45.339 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:45.339 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589880+0000", 2024-09-13T06:43:45.339 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:43:45.339 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:45.339 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:45.340 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:45.340 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589884+0000", 2024-09-13T06:43:45.340 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.053e-06 2024-09-13T06:43:45.340 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:45.340 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:45.341 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:45.341 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589893+0000", 2024-09-13T06:43:45.341 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.2129999999999997e-06 2024-09-13T06:43:45.341 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:45.341 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:45.341 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:45.342 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589901+0000", 2024-09-13T06:43:45.342 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.6399999999999997e-06 2024-09-13T06:43:45.342 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:45.342 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:45.342 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:45.343 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.669213+0000", 2024-09-13T06:43:45.343 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.079312074999999996 2024-09-13T06:43:45.343 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:45.343 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:45.343 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:45.343 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.669281+0000", 2024-09-13T06:43:45.344 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.8322000000000001e-05 2024-09-13T06:43:45.344 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:45.344 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:45.344 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:45.344 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.669575+0000", 2024-09-13T06:43:45.345 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00029349699999999999 2024-09-13T06:43:45.345 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:45.345 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:45.345 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:45.345 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:45.346 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:45.346 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43300 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 446464~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:43:45.346 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589909+0000", 2024-09-13T06:43:45.346 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 203.74121302699999, 2024-09-13T06:43:45.346 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.080339496999999996, 2024-09-13T06:43:45.347 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:45.347 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:45.347 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:45.347 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:45.347 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:45.347 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43300 2024-09-13T06:43:45.348 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:45.348 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:45.348 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:45.348 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:45.348 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589909+0000", 2024-09-13T06:43:45.349 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:45.349 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:45.349 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:45.349 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:45.349 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589909+0000", 2024-09-13T06:43:45.350 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:45.350 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:45.350 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:45.350 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:45.351 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589908+0000", 2024-09-13T06:43:45.351 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:43:45.351 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:45.351 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:45.351 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:45.352 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589912+0000", 2024-09-13T06:43:45.352 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.9430000000000002e-06 2024-09-13T06:43:45.352 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:45.352 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:45.352 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:45.353 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589920+0000", 2024-09-13T06:43:45.353 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.3860000000000007e-06 2024-09-13T06:43:45.353 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:45.353 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:45.353 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:45.354 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589928+0000", 2024-09-13T06:43:45.354 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.3329999999999999e-06 2024-09-13T06:43:45.354 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:45.354 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:45.354 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:45.355 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.669651+0000", 2024-09-13T06:43:45.355 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.079723204000000006 2024-09-13T06:43:45.355 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:45.355 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:45.355 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:45.355 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.669840+0000", 2024-09-13T06:43:45.356 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000189397 2024-09-13T06:43:45.356 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:45.356 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:45.356 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:45.356 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.670248+0000", 2024-09-13T06:43:45.357 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00040811100000000001 2024-09-13T06:43:45.357 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:45.357 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:45.357 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:45.357 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:45.358 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:45.358 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43301 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 460800~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:43:45.358 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589934+0000", 2024-09-13T06:43:45.358 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 203.74118835300001, 2024-09-13T06:43:45.358 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.080747474999999999, 2024-09-13T06:43:45.358 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:45.359 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:45.359 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:45.359 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:45.359 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:45.359 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43301 2024-09-13T06:43:45.359 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:45.360 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:45.360 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:45.360 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:45.360 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589934+0000", 2024-09-13T06:43:45.360 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:45.360 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:45.361 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:45.361 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:45.361 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589934+0000", 2024-09-13T06:43:45.361 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:45.361 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:45.362 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:45.362 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:45.362 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589933+0000", 2024-09-13T06:43:45.362 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:45.362 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:45.362 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:45.363 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:45.363 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589936+0000", 2024-09-13T06:43:45.363 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.4599999999999999e-06 2024-09-13T06:43:45.363 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:45.363 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:45.364 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:45.364 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589945+0000", 2024-09-13T06:43:45.364 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.2430000000000005e-06 2024-09-13T06:43:45.364 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:45.364 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:45.364 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:45.365 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589952+0000", 2024-09-13T06:43:45.365 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.3289999999999996e-06 2024-09-13T06:43:45.365 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:45.365 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:45.365 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:45.366 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.670280+0000", 2024-09-13T06:43:45.366 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.080328514000000004 2024-09-13T06:43:45.366 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:45.366 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:45.366 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:45.366 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.670376+0000", 2024-09-13T06:43:45.367 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.5752000000000001e-05 2024-09-13T06:43:45.367 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:45.367 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:45.367 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:45.367 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.670681+0000", 2024-09-13T06:43:45.368 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00030479699999999999 2024-09-13T06:43:45.368 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:45.368 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:45.368 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:45.368 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:45.369 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:45.372 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43302 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 475136~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:43:45.372 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589958+0000", 2024-09-13T06:43:45.372 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 203.74116429099999, 2024-09-13T06:43:45.373 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.081402394000000003, 2024-09-13T06:43:45.373 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:45.373 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:45.373 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:45.373 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:45.373 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:45.373 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43302 2024-09-13T06:43:45.373 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:45.373 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:45.373 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:45.373 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:45.373 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589958+0000", 2024-09-13T06:43:45.374 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:45.374 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:45.374 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:45.374 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:45.374 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589958+0000", 2024-09-13T06:43:45.374 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:45.374 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:45.374 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:45.374 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:45.374 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589957+0000", 2024-09-13T06:43:45.374 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:45.374 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:45.374 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:45.374 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:45.375 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589960+0000", 2024-09-13T06:43:45.375 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.4939999999999999e-06 2024-09-13T06:43:45.375 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:45.375 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:45.375 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:45.375 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589969+0000", 2024-09-13T06:43:45.375 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.3520000000000007e-06 2024-09-13T06:43:45.375 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:45.375 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:45.375 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:45.375 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589976+0000", 2024-09-13T06:43:45.375 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.3030000000000002e-06 2024-09-13T06:43:45.376 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:45.376 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:45.376 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:45.376 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.670765+0000", 2024-09-13T06:43:45.376 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.080789154000000002 2024-09-13T06:43:45.376 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:45.376 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:45.376 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:45.376 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.670960+0000", 2024-09-13T06:43:45.376 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00019464300000000001 2024-09-13T06:43:45.376 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:45.376 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:45.376 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:45.377 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.671360+0000", 2024-09-13T06:43:45.377 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00040005200000000002 2024-09-13T06:43:45.377 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:45.377 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:45.377 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:45.377 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:45.377 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:45.377 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43303 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 489472~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:43:45.377 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589985+0000", 2024-09-13T06:43:45.377 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 203.74113734299999, 2024-09-13T06:43:45.377 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.082024333000000005, 2024-09-13T06:43:45.377 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:45.378 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:45.378 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:45.378 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:45.378 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:45.378 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43303 2024-09-13T06:43:45.378 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:45.378 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:45.378 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:45.378 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:45.378 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589985+0000", 2024-09-13T06:43:45.378 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:45.378 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:45.378 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:45.379 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:45.379 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589985+0000", 2024-09-13T06:43:45.379 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:45.379 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:45.379 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:45.379 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:45.379 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589984+0000", 2024-09-13T06:43:45.379 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:43:45.379 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:45.379 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:45.379 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:45.379 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589987+0000", 2024-09-13T06:43:45.379 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.726e-06 2024-09-13T06:43:45.379 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:45.380 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:45.380 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:45.380 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589996+0000", 2024-09-13T06:43:45.380 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.5459999999999992e-06 2024-09-13T06:43:45.380 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:45.380 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:45.380 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:45.380 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590003+0000", 2024-09-13T06:43:45.380 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.4229999999999999e-06 2024-09-13T06:43:45.380 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:45.380 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:45.380 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:45.381 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.671426+0000", 2024-09-13T06:43:45.381 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.081422704999999998 2024-09-13T06:43:45.381 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:45.381 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:45.381 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:45.381 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.671615+0000", 2024-09-13T06:43:45.381 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000188875 2024-09-13T06:43:45.381 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:45.381 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:45.381 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:45.381 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.672009+0000", 2024-09-13T06:43:45.381 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000394015 2024-09-13T06:43:45.381 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:45.382 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:45.382 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:45.382 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:45.382 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:45.382 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43304 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 503808~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:43:45.382 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.590039+0000", 2024-09-13T06:43:45.382 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 203.74108279800001, 2024-09-13T06:43:45.382 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.082573880000000002, 2024-09-13T06:43:45.382 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:45.382 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:45.382 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:45.383 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:45.383 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:45.383 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43304 2024-09-13T06:43:45.383 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:45.383 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:45.383 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:45.383 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:45.384 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590039+0000", 2024-09-13T06:43:45.384 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:45.384 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:45.384 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:45.384 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:45.384 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590039+0000", 2024-09-13T06:43:45.384 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:45.384 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:45.384 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:45.384 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:45.384 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590038+0000", 2024-09-13T06:43:45.384 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:43:45.385 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:45.385 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:45.385 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:45.385 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590042+0000", 2024-09-13T06:43:45.385 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.9500000000000003e-06 2024-09-13T06:43:45.385 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:45.385 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:45.385 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:45.385 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590052+0000", 2024-09-13T06:43:45.385 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.3919999999999992e-06 2024-09-13T06:43:45.385 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:45.385 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:45.386 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:45.386 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590059+0000", 2024-09-13T06:43:45.386 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.7970000000000001e-06 2024-09-13T06:43:45.386 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:45.386 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:45.386 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:45.386 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.672078+0000", 2024-09-13T06:43:45.386 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.082018778000000001 2024-09-13T06:43:45.386 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:45.386 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:45.386 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:45.386 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.672266+0000", 2024-09-13T06:43:45.386 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00018807399999999999 2024-09-13T06:43:45.387 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:45.387 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:45.387 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:45.387 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.672613+0000", 2024-09-13T06:43:45.387 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00034677599999999997 2024-09-13T06:43:45.387 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:45.387 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:45.387 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:45.387 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:45.387 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:45.387 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43305 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 518144~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:43:45.387 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.590136+0000", 2024-09-13T06:43:45.387 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 203.74098561, 2024-09-13T06:43:45.388 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.082988206999999994, 2024-09-13T06:43:45.388 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:45.388 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:45.388 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:45.388 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:45.388 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:45.388 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43305 2024-09-13T06:43:45.388 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:45.388 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:45.388 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:45.388 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:45.388 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590136+0000", 2024-09-13T06:43:45.388 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:45.389 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:45.389 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:45.389 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:45.389 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590136+0000", 2024-09-13T06:43:45.389 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:45.389 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:45.389 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:45.389 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:45.389 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590135+0000", 2024-09-13T06:43:45.389 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:43:45.389 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:45.389 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:45.389 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:45.390 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590139+0000", 2024-09-13T06:43:45.390 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.9489999999999998e-06 2024-09-13T06:43:45.390 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:45.390 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:45.390 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:45.390 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590148+0000", 2024-09-13T06:43:45.390 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.9830000000000002e-06 2024-09-13T06:43:45.390 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:45.390 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:45.390 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:45.390 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590156+0000", 2024-09-13T06:43:45.390 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5229999999999998e-06 2024-09-13T06:43:45.390 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:45.390 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:45.391 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:45.391 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.672709+0000", 2024-09-13T06:43:45.391 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.082552886000000006 2024-09-13T06:43:45.391 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:45.391 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:45.391 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:45.391 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.672816+0000", 2024-09-13T06:43:45.391 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000107736 2024-09-13T06:43:45.391 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:45.391 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:45.391 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:45.391 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.673124+0000", 2024-09-13T06:43:45.391 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00030804900000000002 2024-09-13T06:43:45.391 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:45.391 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:45.392 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:45.392 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:45.392 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:45.392 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:66818 3.17 3.50afe697 (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e100)", 2024-09-13T06:43:45.392 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:53.498942+0000", 2024-09-13T06:43:45.392 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 171.83217942499999, 2024-09-13T06:43:45.392 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.011231284, 2024-09-13T06:43:45.392 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:45.392 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:43:45.392 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:45.393 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:45.393 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:45.393 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 66818 2024-09-13T06:43:45.393 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:45.393 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:45.393 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:45.393 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:45.393 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:53.498942+0000", 2024-09-13T06:43:45.393 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:45.393 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:45.393 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:45.394 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:45.394 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:53.498942+0000", 2024-09-13T06:43:45.394 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:45.394 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:45.394 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:45.394 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:45.394 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:53.498939+0000", 2024-09-13T06:43:45.394 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999967 2024-09-13T06:43:45.394 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:45.394 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:45.395 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:45.395 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:53.498954+0000", 2024-09-13T06:43:45.395 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5028000000000001e-05 2024-09-13T06:43:45.395 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:45.395 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:45.395 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:45.395 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:53.498986+0000", 2024-09-13T06:43:45.395 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.1993999999999999e-05 2024-09-13T06:43:45.395 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:45.395 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:45.395 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:45.396 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:53.499001+0000", 2024-09-13T06:43:45.396 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5166e-05 2024-09-13T06:43:45.396 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:45.396 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:45.396 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:45.396 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:53.505097+0000", 2024-09-13T06:43:45.396 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0060955610000000002 2024-09-13T06:43:45.396 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:45.396 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:45.396 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:43:45.396 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:53.505108+0000", 2024-09-13T06:43:45.396 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.084e-05 2024-09-13T06:43:45.396 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:45.397 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:45.397 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:45.397 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:54.510158+0000", 2024-09-13T06:43:45.397 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0050497549999999 2024-09-13T06:43:45.397 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:45.397 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:45.397 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:45.397 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:54.510174+0000", 2024-09-13T06:43:45.397 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6164e-05 2024-09-13T06:43:45.397 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:45.397 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:45.397 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:45.397 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:45.397 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:45.398 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:69764 3.2 3:47f10058:::rbd_data.11214956a993.0000000000000004:head [write-same] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e117)", 2024-09-13T06:43:45.398 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:41:11.371147+0000", 2024-09-13T06:43:45.398 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 153.95997511499999, 2024-09-13T06:43:45.398 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.03470167, 2024-09-13T06:43:45.398 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:45.398 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:43:45.398 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:45.398 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:45.398 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:45.398 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 69764 2024-09-13T06:43:45.398 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:45.399 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:45.399 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:45.399 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:45.399 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:11.371147+0000", 2024-09-13T06:43:45.399 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:45.399 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:45.399 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:45.399 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:45.399 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:11.371147+0000", 2024-09-13T06:43:45.399 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:45.399 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:45.399 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:45.400 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:45.400 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:11.371144+0000", 2024-09-13T06:43:45.400 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999967 2024-09-13T06:43:45.400 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:45.400 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:45.400 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:45.400 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:11.371161+0000", 2024-09-13T06:43:45.401 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7669e-05 2024-09-13T06:43:45.401 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:45.401 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:45.401 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:45.401 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:11.371198+0000", 2024-09-13T06:43:45.401 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.7014000000000002e-05 2024-09-13T06:43:45.401 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:45.401 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:45.401 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:45.401 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:11.371216+0000", 2024-09-13T06:43:45.401 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7425e-05 2024-09-13T06:43:45.401 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:45.401 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:45.402 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:45.402 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:11.371365+0000", 2024-09-13T06:43:45.402 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000149245 2024-09-13T06:43:45.402 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:45.402 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:45.402 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op must wait for map", 2024-09-13T06:43:45.402 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:11.371385+0000", 2024-09-13T06:43:45.402 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.0018999999999999e-05 2024-09-13T06:43:45.402 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:45.402 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:45.402 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:45.402 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:11.378406+0000", 2024-09-13T06:43:45.403 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0070207179999999996 2024-09-13T06:43:45.403 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:45.403 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:45.403 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:43:45.403 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:11.378429+0000", 2024-09-13T06:43:45.403 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.3453999999999999e-05 2024-09-13T06:43:45.403 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:45.403 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:45.403 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:45.403 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:12.405667+0000", 2024-09-13T06:43:45.403 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0272381690000001 2024-09-13T06:43:45.404 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:45.404 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:45.404 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:45.404 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:12.405848+0000", 2024-09-13T06:43:45.404 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00018112 2024-09-13T06:43:45.404 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:45.404 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:45.404 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:45.404 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:45.405 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:45.405 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:70346 3.16 3:69d35907:::rbd_object_map.11214956a993:head [read 0~36] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e122)", 2024-09-13T06:43:45.405 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:41:16.390917+0000", 2024-09-13T06:43:45.405 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 148.94020506300001, 2024-09-13T06:43:45.405 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.99327479799999996, 2024-09-13T06:43:45.405 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:45.405 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:45.405 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:45.405 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:45.405 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:45.406 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 70346 2024-09-13T06:43:45.406 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:45.406 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:45.406 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:45.406 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:45.406 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:16.390917+0000", 2024-09-13T06:43:45.406 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:45.406 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:45.406 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:45.406 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:45.406 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:16.390917+0000", 2024-09-13T06:43:45.406 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:45.406 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:45.407 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:45.407 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:45.407 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:16.390916+0000", 2024-09-13T06:43:45.407 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999986 2024-09-13T06:43:45.407 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:45.407 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:45.407 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:45.407 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:16.390922+0000", 2024-09-13T06:43:45.407 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.0480000000000004e-06 2024-09-13T06:43:45.407 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:45.407 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:45.407 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:45.408 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:16.390933+0000", 2024-09-13T06:43:45.408 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1387e-05 2024-09-13T06:43:45.408 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:45.408 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:45.408 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:45.408 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:16.390939+0000", 2024-09-13T06:43:45.408 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.8039999999999998e-06 2024-09-13T06:43:45.408 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:45.408 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:45.408 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:45.408 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:16.390983+0000", 2024-09-13T06:43:45.408 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.4663000000000003e-05 2024-09-13T06:43:45.408 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:45.408 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:45.409 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:43:45.409 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:16.390991+0000", 2024-09-13T06:43:45.409 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.8059999999999995e-06 2024-09-13T06:43:45.409 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:45.409 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:45.409 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:45.409 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:17.383624+0000", 2024-09-13T06:43:45.409 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.99263277299999997 2024-09-13T06:43:45.409 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:45.409 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:45.409 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:45.409 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:17.383891+0000", 2024-09-13T06:43:45.409 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00026717599999999999 2024-09-13T06:43:45.409 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:45.410 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:45.410 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:45.410 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:17.384192+0000", 2024-09-13T06:43:45.410 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00030047400000000001 2024-09-13T06:43:45.410 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:45.410 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:45.410 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:45.410 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:45.410 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:45.410 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:181624 3.1d 3:be5d0ef9:::rbd_data.11218aab7a9c.0000000000000000:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e203)", 2024-09-13T06:43:45.410 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:42:45.701744+0000", 2024-09-13T06:43:45.410 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 59.629378142999997, 2024-09-13T06:43:45.410 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.69964504800000005, 2024-09-13T06:43:45.410 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:45.410 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:45.411 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:45.411 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:45.411 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:45.411 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 181624 2024-09-13T06:43:45.411 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:45.411 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:45.411 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:45.411 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:45.411 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.701744+0000", 2024-09-13T06:43:45.411 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:45.411 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:45.411 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:45.411 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:45.411 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.701744+0000", 2024-09-13T06:43:45.411 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:45.412 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:45.412 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:45.412 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:45.412 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.701741+0000", 2024-09-13T06:43:45.412 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999976 2024-09-13T06:43:45.412 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:45.412 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:45.412 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:45.412 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.701754+0000", 2024-09-13T06:43:45.412 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2632999999999999e-05 2024-09-13T06:43:45.412 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:45.412 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:45.412 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:45.413 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.701789+0000", 2024-09-13T06:43:45.413 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.4993999999999997e-05 2024-09-13T06:43:45.413 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:45.413 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:45.413 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:45.413 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.701806+0000", 2024-09-13T06:43:45.413 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7016000000000001e-05 2024-09-13T06:43:45.413 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:45.413 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:45.413 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:45.413 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.701905+0000", 2024-09-13T06:43:45.413 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.8895999999999996e-05 2024-09-13T06:43:45.413 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:45.414 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:45.414 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:43:45.414 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.701920+0000", 2024-09-13T06:43:45.414 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5013e-05 2024-09-13T06:43:45.414 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:45.414 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:45.414 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:45.414 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.400672+0000", 2024-09-13T06:43:45.414 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.69875254499999995 2024-09-13T06:43:45.414 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:45.414 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:45.414 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:45.414 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.401034+0000", 2024-09-13T06:43:45.414 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00036181700000000001 2024-09-13T06:43:45.414 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:45.415 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:45.415 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:45.415 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.401389+0000", 2024-09-13T06:43:45.415 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00035464399999999999 2024-09-13T06:43:45.415 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:45.415 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:45.415 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:45.415 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:45.415 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:45.415 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:181638 3.1d 3:be5d0ef9:::rbd_data.11218aab7a9c.0000000000000000:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e203)", 2024-09-13T06:43:45.415 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:42:45.707356+0000", 2024-09-13T06:43:45.415 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 59.623765403999997, 2024-09-13T06:43:45.416 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.694720479, 2024-09-13T06:43:45.416 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:45.416 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:45.416 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:45.416 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:45.416 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:45.416 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 181638 2024-09-13T06:43:45.416 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:45.416 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:45.416 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:45.416 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:45.416 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707356+0000", 2024-09-13T06:43:45.417 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:45.417 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:45.417 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:45.417 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:45.417 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707356+0000", 2024-09-13T06:43:45.417 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:45.417 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:45.417 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:45.417 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:45.417 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707355+0000", 2024-09-13T06:43:45.417 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999981 2024-09-13T06:43:45.417 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:45.417 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:45.418 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:45.418 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707375+0000", 2024-09-13T06:43:45.418 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.0698000000000001e-05 2024-09-13T06:43:45.418 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:45.418 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:45.418 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:45.418 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707396+0000", 2024-09-13T06:43:45.418 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.1041000000000001e-05 2024-09-13T06:43:45.418 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:45.419 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:45.419 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:45.419 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707408+0000", 2024-09-13T06:43:45.419 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1583000000000001e-05 2024-09-13T06:43:45.419 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:45.419 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:45.419 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:45.419 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707513+0000", 2024-09-13T06:43:45.419 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000104981 2024-09-13T06:43:45.419 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:45.419 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:45.419 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:43:45.419 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707541+0000", 2024-09-13T06:43:45.419 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.8572999999999999e-05 2024-09-13T06:43:45.420 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:45.420 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:45.420 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:45.420 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.401666+0000", 2024-09-13T06:43:45.420 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.694124988 2024-09-13T06:43:45.420 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:45.420 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:45.420 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:45.420 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.401880+0000", 2024-09-13T06:43:45.420 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00021322100000000001 2024-09-13T06:43:45.420 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:45.420 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:45.420 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:45.420 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.402077+0000", 2024-09-13T06:43:45.421 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000197321 2024-09-13T06:43:45.421 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:45.421 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:45.421 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:45.421 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:45.421 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:45.421 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:181652 3.1d 3:be5d0ef9:::rbd_data.11218aab7a9c.0000000000000000:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e203)", 2024-09-13T06:43:45.421 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:42:45.707423+0000", 2024-09-13T06:43:45.421 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 59.623698873000002, 2024-09-13T06:43:45.421 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.69480806699999997, 2024-09-13T06:43:45.421 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:45.421 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:45.421 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:45.422 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:45.422 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:45.422 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 181652 2024-09-13T06:43:45.422 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:45.422 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:45.422 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:45.422 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:45.422 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707423+0000", 2024-09-13T06:43:45.422 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:45.422 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:45.422 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:45.422 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:45.422 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707423+0000", 2024-09-13T06:43:45.422 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:45.423 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:45.423 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:45.423 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:45.423 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707423+0000", 2024-09-13T06:43:45.423 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:45.423 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:45.423 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:45.423 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:45.423 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707427+0000", 2024-09-13T06:43:45.423 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.2010000000000001e-06 2024-09-13T06:43:45.423 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:45.423 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:45.423 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:45.423 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707442+0000", 2024-09-13T06:43:45.424 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.4993e-05 2024-09-13T06:43:45.424 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:45.424 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:45.424 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:45.424 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707447+0000", 2024-09-13T06:43:45.424 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.2170000000000002e-06 2024-09-13T06:43:45.424 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:45.424 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:45.424 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:45.424 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707656+0000", 2024-09-13T06:43:45.424 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00020908600000000001 2024-09-13T06:43:45.424 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:45.425 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:45.425 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:43:45.425 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707684+0000", 2024-09-13T06:43:45.425 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.7766000000000001e-05 2024-09-13T06:43:45.425 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:45.425 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:45.425 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:45.425 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.402101+0000", 2024-09-13T06:43:45.425 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.69441698100000004 2024-09-13T06:43:45.425 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:45.425 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:45.425 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:45.425 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.402156+0000", 2024-09-13T06:43:45.425 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.4725000000000002e-05 2024-09-13T06:43:45.426 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:45.426 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:45.426 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:45.426 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.402231+0000", 2024-09-13T06:43:45.426 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5587999999999995e-05 2024-09-13T06:43:45.426 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:45.426 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:45.426 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:45.426 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:45.426 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:45.426 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:181666 3.1d 3:be5d0ef9:::rbd_data.11218aab7a9c.0000000000000000:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e203)", 2024-09-13T06:43:45.426 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:42:45.707478+0000", 2024-09-13T06:43:45.426 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 59.623643686999998, 2024-09-13T06:43:45.426 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.69543359900000001, 2024-09-13T06:43:45.427 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:45.427 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:45.427 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:45.427 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:45.427 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:45.427 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 181666 2024-09-13T06:43:45.427 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:45.427 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:45.427 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:45.427 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:45.427 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707478+0000", 2024-09-13T06:43:45.427 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:45.427 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:45.427 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:45.428 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:45.428 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707478+0000", 2024-09-13T06:43:45.428 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:45.428 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:45.428 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:45.428 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:45.428 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707478+0000", 2024-09-13T06:43:45.428 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:45.428 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:45.428 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:45.428 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:45.428 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707481+0000", 2024-09-13T06:43:45.428 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.3589999999999999e-06 2024-09-13T06:43:45.428 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:45.429 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:45.429 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:45.429 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707492+0000", 2024-09-13T06:43:45.429 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0725e-05 2024-09-13T06:43:45.429 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:45.429 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:45.429 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:45.429 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707500+0000", 2024-09-13T06:43:45.429 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.1089999999999998e-06 2024-09-13T06:43:45.429 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:45.429 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:45.429 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:45.430 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707773+0000", 2024-09-13T06:43:45.430 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000273291 2024-09-13T06:43:45.430 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:45.430 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:45.430 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:43:45.430 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707784+0000", 2024-09-13T06:43:45.430 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0441999999999999e-05 2024-09-13T06:43:45.430 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:45.430 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:45.430 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:45.430 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.402290+0000", 2024-09-13T06:43:45.430 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.69450651500000005 2024-09-13T06:43:45.430 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:45.430 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:45.431 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:45.431 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.402489+0000", 2024-09-13T06:43:45.431 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000198999 2024-09-13T06:43:45.431 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:45.431 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:45.431 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:45.431 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.402912+0000", 2024-09-13T06:43:45.431 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00042257299999999998 2024-09-13T06:43:45.431 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:45.431 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:45.431 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:45.431 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:45.431 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:45.432 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:181680 3.1d 3:be5d0ef9:::rbd_data.11218aab7a9c.0000000000000000:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e203)", 2024-09-13T06:43:45.432 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:42:45.707517+0000", 2024-09-13T06:43:45.432 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 59.623604651000001, 2024-09-13T06:43:45.432 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.69532440799999995, 2024-09-13T06:43:45.432 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:45.432 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:45.432 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:45.432 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:45.432 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:45.432 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 181680 2024-09-13T06:43:45.432 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:45.432 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:45.432 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:45.432 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:45.433 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707517+0000", 2024-09-13T06:43:45.433 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:45.433 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:45.433 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:45.433 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:45.433 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707517+0000", 2024-09-13T06:43:45.433 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:45.433 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:45.433 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:45.433 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:45.433 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707517+0000", 2024-09-13T06:43:45.433 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:45.433 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:45.434 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:45.434 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:45.434 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707519+0000", 2024-09-13T06:43:45.434 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.2800000000000002e-06 2024-09-13T06:43:45.434 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:45.434 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:45.434 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:45.434 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707527+0000", 2024-09-13T06:43:45.434 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.2660000000000001e-06 2024-09-13T06:43:45.434 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:45.434 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:45.434 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:45.434 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707535+0000", 2024-09-13T06:43:45.435 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.1760000000000004e-06 2024-09-13T06:43:45.435 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:45.435 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:45.435 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:45.435 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707838+0000", 2024-09-13T06:43:45.435 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00030318000000000001 2024-09-13T06:43:45.435 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:45.435 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:45.435 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:43:45.435 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707850+0000", 2024-09-13T06:43:45.435 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1787000000000001e-05 2024-09-13T06:43:45.435 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:45.435 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:45.436 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:45.436 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.402702+0000", 2024-09-13T06:43:45.436 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.69485264599999996 2024-09-13T06:43:45.436 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:45.436 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:45.436 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:45.436 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.402783+0000", 2024-09-13T06:43:45.436 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.1114999999999998e-05 2024-09-13T06:43:45.436 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:45.436 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:45.436 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:45.436 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.402842+0000", 2024-09-13T06:43:45.436 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.8322999999999997e-05 2024-09-13T06:43:45.437 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:45.437 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:45.437 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:45.437 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:45.437 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:45.437 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:181694 3.1d 3:be5d0ef9:::rbd_data.11218aab7a9c.0000000000000000:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e203)", 2024-09-13T06:43:45.437 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:42:45.707544+0000", 2024-09-13T06:43:45.437 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 59.623577959000002, 2024-09-13T06:43:45.437 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.69580726699999995, 2024-09-13T06:43:45.437 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:45.437 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:45.437 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:45.437 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:45.438 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:45.438 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 181694 2024-09-13T06:43:45.438 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:45.438 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:45.438 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:45.438 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:45.438 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707544+0000", 2024-09-13T06:43:45.438 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:45.438 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:45.438 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:45.438 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:45.438 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707544+0000", 2024-09-13T06:43:45.438 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:45.439 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:45.439 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:45.439 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:45.439 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707543+0000", 2024-09-13T06:43:45.439 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:45.439 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:45.439 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:45.439 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:45.439 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707561+0000", 2024-09-13T06:43:45.439 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7804000000000001e-05 2024-09-13T06:43:45.439 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:45.439 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:45.439 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:45.439 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707575+0000", 2024-09-13T06:43:45.440 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3884e-05 2024-09-13T06:43:45.440 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:45.440 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:45.440 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:45.440 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707583+0000", 2024-09-13T06:43:45.440 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5730000000000002e-06 2024-09-13T06:43:45.440 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:45.440 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:45.440 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:45.440 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707899+0000", 2024-09-13T06:43:45.440 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00031663999999999998 2024-09-13T06:43:45.440 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:45.440 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:45.441 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:43:45.441 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707908+0000", 2024-09-13T06:43:45.441 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.1430000000000004e-06 2024-09-13T06:43:45.441 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:45.441 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:45.441 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:45.441 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.402973+0000", 2024-09-13T06:43:45.441 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.69506426099999996 2024-09-13T06:43:45.441 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:45.441 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:45.441 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:45.441 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.403155+0000", 2024-09-13T06:43:45.441 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00018245199999999999 2024-09-13T06:43:45.442 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:45.442 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:45.442 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:45.442 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.403351+0000", 2024-09-13T06:43:45.442 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000196028 2024-09-13T06:43:45.442 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:45.442 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:45.442 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:45.442 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:45.442 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:45.442 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:181708 3.1d 3:be5d0ef9:::rbd_data.11218aab7a9c.0000000000000000:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e203)", 2024-09-13T06:43:45.442 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:42:45.707622+0000", 2024-09-13T06:43:45.442 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 59.623499914999996, 2024-09-13T06:43:45.443 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.69603707699999995, 2024-09-13T06:43:45.443 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:45.443 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:45.443 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:45.443 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:45.443 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:45.443 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 181708 2024-09-13T06:43:45.443 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:45.443 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:45.443 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:45.443 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:45.443 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707622+0000", 2024-09-13T06:43:45.444 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:45.444 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:45.444 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:45.444 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:45.444 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707622+0000", 2024-09-13T06:43:45.444 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:45.444 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:45.444 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:45.444 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:45.444 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707621+0000", 2024-09-13T06:43:45.444 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:45.444 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:45.444 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:45.444 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:45.445 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707624+0000", 2024-09-13T06:43:45.445 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.8210000000000002e-06 2024-09-13T06:43:45.445 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:45.445 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:45.445 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:45.445 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707631+0000", 2024-09-13T06:43:45.445 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.8460000000000002e-06 2024-09-13T06:43:45.445 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:45.445 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:45.445 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:45.445 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707635+0000", 2024-09-13T06:43:45.445 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.4610000000000001e-06 2024-09-13T06:43:45.445 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:45.445 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:45.446 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:45.446 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707955+0000", 2024-09-13T06:43:45.446 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00031982000000000001 2024-09-13T06:43:45.446 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:45.446 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:45.446 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:43:45.446 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707966+0000", 2024-09-13T06:43:45.446 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0822000000000001e-05 2024-09-13T06:43:45.446 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:45.446 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:45.446 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:45.446 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.403541+0000", 2024-09-13T06:43:45.446 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.69557444300000004 2024-09-13T06:43:45.446 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:45.447 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:45.447 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:45.447 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.403598+0000", 2024-09-13T06:43:45.447 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.7147e-05 2024-09-13T06:43:45.447 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:45.447 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:45.447 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:45.447 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.403659+0000", 2024-09-13T06:43:45.447 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.1373999999999999e-05 2024-09-13T06:43:45.447 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:45.447 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:45.447 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:45.447 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:45.447 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:45.448 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:181722 3.1d 3:be5d0ef9:::rbd_data.11218aab7a9c.0000000000000000:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e203)", 2024-09-13T06:43:45.448 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:42:45.707640+0000", 2024-09-13T06:43:45.448 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 59.623481464000001, 2024-09-13T06:43:45.448 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.69620305800000004, 2024-09-13T06:43:45.448 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:45.448 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:45.448 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:45.448 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:45.448 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:45.448 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 181722 2024-09-13T06:43:45.448 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:45.448 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:45.448 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:45.449 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:45.449 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707640+0000", 2024-09-13T06:43:45.449 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:45.449 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:45.449 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:45.449 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:45.449 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707640+0000", 2024-09-13T06:43:45.449 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:45.449 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:45.449 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:45.449 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:45.449 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707640+0000", 2024-09-13T06:43:45.449 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:45.449 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:45.450 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:45.450 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:45.450 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707643+0000", 2024-09-13T06:43:45.450 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.213e-06 2024-09-13T06:43:45.450 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:45.450 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:45.450 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:45.450 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707651+0000", 2024-09-13T06:43:45.450 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.2290000000000003e-06 2024-09-13T06:43:45.450 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:45.450 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:45.450 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:45.451 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707656+0000", 2024-09-13T06:43:45.451 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.9320000000000004e-06 2024-09-13T06:43:45.451 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:45.451 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:45.451 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:45.451 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.708012+0000", 2024-09-13T06:43:45.451 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00035600600000000002 2024-09-13T06:43:45.451 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:45.451 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:45.451 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:43:45.451 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.708024+0000", 2024-09-13T06:43:45.451 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1336e-05 2024-09-13T06:43:45.451 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:45.451 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:45.452 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:45.452 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.403696+0000", 2024-09-13T06:43:45.452 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.69567234499999997 2024-09-13T06:43:45.452 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:45.452 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:45.452 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:45.452 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.403757+0000", 2024-09-13T06:43:45.452 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.0715999999999999e-05 2024-09-13T06:43:45.452 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:45.452 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:45.452 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:45.452 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.403843+0000", 2024-09-13T06:43:45.453 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6679000000000001e-05 2024-09-13T06:43:45.453 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:45.453 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:45.453 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:45.453 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:45.453 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:45.453 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:181736 3.1d 3:be5d0ef9:::rbd_data.11218aab7a9c.0000000000000000:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e203)", 2024-09-13T06:43:45.453 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:42:45.707661+0000", 2024-09-13T06:43:45.453 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 59.623461097000003, 2024-09-13T06:43:45.453 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.69667210700000004, 2024-09-13T06:43:45.453 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:45.453 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:45.453 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:45.454 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:45.454 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:45.454 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 181736 2024-09-13T06:43:45.454 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:45.454 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:45.454 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:45.454 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:45.454 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707661+0000", 2024-09-13T06:43:45.454 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:45.454 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:45.454 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:45.454 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:45.454 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707661+0000", 2024-09-13T06:43:45.454 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:45.455 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:45.455 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:45.455 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:45.455 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707660+0000", 2024-09-13T06:43:45.455 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:45.455 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:45.455 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:45.455 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:45.455 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707664+0000", 2024-09-13T06:43:45.455 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.393e-06 2024-09-13T06:43:45.455 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:45.455 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:45.455 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:45.456 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707673+0000", 2024-09-13T06:43:45.456 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.5100000000000004e-06 2024-09-13T06:43:45.456 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:45.456 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:45.456 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:45.456 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707680+0000", 2024-09-13T06:43:45.456 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.8680000000000001e-06 2024-09-13T06:43:45.456 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:45.456 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:45.456 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:45.456 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.708068+0000", 2024-09-13T06:43:45.456 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00038784699999999997 2024-09-13T06:43:45.456 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:45.457 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:45.457 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:43:45.457 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.708078+0000", 2024-09-13T06:43:45.457 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.842e-06 2024-09-13T06:43:45.457 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:45.457 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:45.457 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:45.457 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.403924+0000", 2024-09-13T06:43:45.457 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.69584657699999997 2024-09-13T06:43:45.457 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:45.457 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:45.457 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:45.458 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.404135+0000", 2024-09-13T06:43:45.458 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000210662 2024-09-13T06:43:45.458 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:45.458 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:45.458 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:45.458 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.404333+0000", 2024-09-13T06:43:45.458 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00019787900000000001 2024-09-13T06:43:45.458 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:45.458 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:45.458 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:45.458 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:45.458 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:45.458 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:181750 3.1d 3.9f70ba7d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e203)", 2024-09-13T06:43:45.459 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:42:45.707687+0000", 2024-09-13T06:43:45.459 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 59.623435233999999, 2024-09-13T06:43:45.459 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.69667232199999996, 2024-09-13T06:43:45.459 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:45.459 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:43:45.459 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:45.459 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:45.459 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:45.459 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 181750 2024-09-13T06:43:45.459 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:45.459 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:45.459 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:45.459 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:45.460 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707687+0000", 2024-09-13T06:43:45.460 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:45.460 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:45.460 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:45.460 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:45.460 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707687+0000", 2024-09-13T06:43:45.460 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:45.460 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:45.460 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:45.460 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:45.460 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707686+0000", 2024-09-13T06:43:45.460 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:45.460 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:45.460 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:45.461 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:45.461 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707689+0000", 2024-09-13T06:43:45.461 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.824e-06 2024-09-13T06:43:45.461 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:45.461 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:45.461 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:45.461 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707693+0000", 2024-09-13T06:43:45.461 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.5900000000000001e-06 2024-09-13T06:43:45.461 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:45.461 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:45.461 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:45.461 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707697+0000", 2024-09-13T06:43:45.461 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.6899999999999998e-06 2024-09-13T06:43:45.461 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:45.462 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:45.462 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:45.462 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.708109+0000", 2024-09-13T06:43:45.462 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00041220200000000002 2024-09-13T06:43:45.462 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:45.462 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:45.462 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:43:45.462 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.708118+0000", 2024-09-13T06:43:45.462 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6000000000000007e-06 2024-09-13T06:43:45.462 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:45.462 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:45.462 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:45.462 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.404353+0000", 2024-09-13T06:43:45.462 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.69623486400000001 2024-09-13T06:43:45.463 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:45.463 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:45.463 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:45.463 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.404359+0000", 2024-09-13T06:43:45.463 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.2480000000000001e-06 2024-09-13T06:43:45.463 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:45.463 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:45.463 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:45.463 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:45.463 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:45.463 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:43:45.464 INFO:tasks.thrashosds.thrasher:in_osds: [0, 2, 7, 5, 3, 4] out_osds: [6, 1] dead_osds: [6] live_osds: [0, 1, 2, 3, 4, 5, 7] 2024-09-13T06:43:45.464 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-13T06:43:45.464 INFO:tasks.thrashosds.thrasher:inject_pause on osd.7 2024-09-13T06:43:45.464 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-09-13T06:43:45.464 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-09-13T06:43:45.465 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok config set filestore_inject_stall 3 2024-09-13T06:43:45.466 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:43:45.463+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:43:45.466 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-13T06:43:45.565 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-13T06:43:45.564+0000 7fa8bb18e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 36790) UID: 0 2024-09-13T06:43:45.637 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:43:45.637 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [], 2024-09-13T06:43:45.637 INFO:teuthology.orchestra.run.smithi139.stdout: "num_ops": 0 2024-09-13T06:43:45.637 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:43:45.646 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:43:45.646 INFO:teuthology.orchestra.run.smithi139.stdout: "success": "filestore_inject_stall = '' (not observed, change may require restart) " 2024-09-13T06:43:45.646 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:43:45.658 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-13T06:43:45.666 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:43:45.663+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:43:45.766 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-13T06:43:45.764+0000 7fa8bb18e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 36790) UID: 0 2024-09-13T06:43:45.831 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:43:45.831 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [], 2024-09-13T06:43:45.831 INFO:teuthology.orchestra.run.smithi139.stdout: "complaint_time": 30, 2024-09-13T06:43:45.831 INFO:teuthology.orchestra.run.smithi139.stdout: "num_blocked_ops": 0 2024-09-13T06:43:45.831 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:43:45.845 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-13T06:43:45.887 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:43:45.888+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:43:45.969 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-13T06:43:45.968+0000 7fa8bb18e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 36790) UID: 0 2024-09-13T06:43:46.010 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:43:46.010 INFO:teuthology.orchestra.run.smithi139.stdout: "size": 20, 2024-09-13T06:43:46.010 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 600, 2024-09-13T06:43:46.011 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [ 2024-09-13T06:43:46.011 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:46.011 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:176089 3.11 3:8b97f15f:::rbd_data.1121a23b99f7.0000000000000000:head [write 0~4194304 [fadvise_sequential+fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e196)", 2024-09-13T06:43:46.011 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:42:36.707298+0000", 2024-09-13T06:43:46.011 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 69.301733142000003, 2024-09-13T06:43:46.011 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.053333426000000003, 2024-09-13T06:43:46.011 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:46.011 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:43:46.011 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:46.011 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:46.011 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:46.011 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 176089 2024-09-13T06:43:46.011 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:46.011 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:46.012 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:46.012 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:46.012 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.707298+0000", 2024-09-13T06:43:46.012 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:46.012 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:46.012 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:46.012 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:46.012 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.707298+0000", 2024-09-13T06:43:46.012 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:46.012 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:46.012 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:46.012 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:46.013 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.707296+0000", 2024-09-13T06:43:46.013 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999976 2024-09-13T06:43:46.013 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:46.013 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:46.013 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:46.013 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.717511+0000", 2024-09-13T06:43:46.013 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.010215218999999999 2024-09-13T06:43:46.013 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:46.013 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:46.013 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:46.013 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.717555+0000", 2024-09-13T06:43:46.013 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.4159000000000002e-05 2024-09-13T06:43:46.013 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:46.014 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:46.014 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:46.014 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.717569+0000", 2024-09-13T06:43:46.014 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3543999999999999e-05 2024-09-13T06:43:46.014 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:46.014 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:46.014 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:46.014 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.717677+0000", 2024-09-13T06:43:46.014 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00010798699999999999 2024-09-13T06:43:46.014 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:46.014 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:46.014 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:46.015 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.717896+0000", 2024-09-13T06:43:46.015 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000219466 2024-09-13T06:43:46.015 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:46.015 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:46.015 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 4", 2024-09-13T06:43:46.015 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.718090+0000", 2024-09-13T06:43:46.015 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00019322799999999999 2024-09-13T06:43:46.015 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:46.015 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:46.015 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:43:46.015 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.751403+0000", 2024-09-13T06:43:46.015 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.033313493 2024-09-13T06:43:46.015 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:46.015 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:46.015 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-13T06:43:46.016 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.760523+0000", 2024-09-13T06:43:46.016 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0091197150000000005 2024-09-13T06:43:46.016 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:46.016 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:46.016 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-13T06:43:46.016 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.760581+0000", 2024-09-13T06:43:46.016 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.8007999999999998e-05 2024-09-13T06:43:46.016 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:46.016 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:46.016 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:46.016 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.760632+0000", 2024-09-13T06:43:46.016 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.1085999999999998e-05 2024-09-13T06:43:46.016 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:46.016 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:46.017 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:46.017 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:46.017 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:46.017 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:176090 3.e 3:77f86bf9:::rbd_data.1121a23b99f7.0000000000000001:head [write 0~4194304 [fadvise_sequential+fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e196)", 2024-09-13T06:43:46.017 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:42:36.717590+0000", 2024-09-13T06:43:46.017 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 69.291441660000004, 2024-09-13T06:43:46.017 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.049445965000000001, 2024-09-13T06:43:46.017 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:46.017 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:43:46.017 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:46.017 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:46.017 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:46.017 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 176090 2024-09-13T06:43:46.018 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:46.018 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:46.018 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:46.018 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:46.018 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.717590+0000", 2024-09-13T06:43:46.018 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:46.018 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:46.018 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:46.018 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:46.018 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.717590+0000", 2024-09-13T06:43:46.018 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:46.018 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:46.018 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:46.018 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:46.019 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.717588+0000", 2024-09-13T06:43:46.019 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999981 2024-09-13T06:43:46.019 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:46.019 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:46.019 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:46.019 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.723934+0000", 2024-09-13T06:43:46.019 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0063462589999999999 2024-09-13T06:43:46.019 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:46.019 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:46.019 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:46.020 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.723960+0000", 2024-09-13T06:43:46.020 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.6251e-05 2024-09-13T06:43:46.020 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:46.020 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:46.020 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:46.020 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.723976+0000", 2024-09-13T06:43:46.020 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5277e-05 2024-09-13T06:43:46.020 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:46.020 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:46.020 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:46.020 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.724154+0000", 2024-09-13T06:43:46.020 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00017814400000000001 2024-09-13T06:43:46.020 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:46.021 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:46.021 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:46.021 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.724534+0000", 2024-09-13T06:43:46.021 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00038054799999999998 2024-09-13T06:43:46.021 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:46.021 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:46.021 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-13T06:43:46.021 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.724926+0000", 2024-09-13T06:43:46.021 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00039199100000000001 2024-09-13T06:43:46.021 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:46.021 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:46.021 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:43:46.021 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.744509+0000", 2024-09-13T06:43:46.021 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.019582977000000001 2024-09-13T06:43:46.022 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:46.022 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:46.022 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-13T06:43:46.022 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.766937+0000", 2024-09-13T06:43:46.022 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.022427765999999998 2024-09-13T06:43:46.022 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:46.022 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:46.022 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-13T06:43:46.022 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.766987+0000", 2024-09-13T06:43:46.022 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.9898000000000002e-05 2024-09-13T06:43:46.022 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:46.022 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:46.022 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:46.023 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.767036+0000", 2024-09-13T06:43:46.023 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.8782000000000002e-05 2024-09-13T06:43:46.023 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:46.023 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:46.023 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:46.023 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:46.023 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:46.023 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:176094 3.f 3:f5ca80c1:::rbd_data.1121a23b99f7.0000000000000004:head [write 0~4194304 [fadvise_sequential+fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e196)", 2024-09-13T06:43:46.023 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:42:36.724239+0000", 2024-09-13T06:43:46.023 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 69.28479256, 2024-09-13T06:43:46.023 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.043501235999999999, 2024-09-13T06:43:46.023 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:46.023 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:43:46.023 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:46.024 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:46.024 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:46.024 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 176094 2024-09-13T06:43:46.024 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:46.024 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:46.024 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:46.024 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:46.024 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.724239+0000", 2024-09-13T06:43:46.024 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:46.024 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:46.024 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:46.024 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:46.024 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.724239+0000", 2024-09-13T06:43:46.025 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:46.025 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:46.025 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:46.025 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:46.025 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.724237+0000", 2024-09-13T06:43:46.025 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999981 2024-09-13T06:43:46.025 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:46.025 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:46.025 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:46.025 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.733673+0000", 2024-09-13T06:43:46.025 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0094352700000000008 2024-09-13T06:43:46.025 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:46.025 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:46.026 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:46.026 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.733703+0000", 2024-09-13T06:43:46.026 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.0102000000000001e-05 2024-09-13T06:43:46.026 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:46.026 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:46.026 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:46.026 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.733718+0000", 2024-09-13T06:43:46.026 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5199e-05 2024-09-13T06:43:46.026 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:46.026 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:46.026 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:46.026 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.733780+0000", 2024-09-13T06:43:46.026 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.1691000000000003e-05 2024-09-13T06:43:46.027 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:46.027 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:46.027 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:46.027 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.733928+0000", 2024-09-13T06:43:46.027 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000147987 2024-09-13T06:43:46.027 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:46.027 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:46.027 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 4", 2024-09-13T06:43:46.027 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.734036+0000", 2024-09-13T06:43:46.027 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000108925 2024-09-13T06:43:46.027 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:46.027 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:46.027 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:43:46.028 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.763741+0000", 2024-09-13T06:43:46.028 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.029704151000000002 2024-09-13T06:43:46.028 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:46.028 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:46.028 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-13T06:43:46.028 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.767615+0000", 2024-09-13T06:43:46.028 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0038739120000000002 2024-09-13T06:43:46.028 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:46.028 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:46.028 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-13T06:43:46.028 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.767693+0000", 2024-09-13T06:43:46.028 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.8573999999999997e-05 2024-09-13T06:43:46.028 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:46.029 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:46.029 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:46.029 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.767740+0000", 2024-09-13T06:43:46.029 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.7154000000000003e-05 2024-09-13T06:43:46.029 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:46.029 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:46.029 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:46.029 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:46.029 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:46.029 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:205233 3.15 3:a97b2891:::rbd_data.11213650bb32.000000000000002e:head [set-alloc-hint object_size 4194304 write_size 4194304,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e209)", 2024-09-13T06:43:46.029 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:42:52.282586+0000", 2024-09-13T06:43:46.029 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 53.726445716000001, 2024-09-13T06:43:46.030 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.056996628000000001, 2024-09-13T06:43:46.030 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:46.030 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:43:46.030 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:46.030 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:46.030 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:46.030 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 205233 2024-09-13T06:43:46.030 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:46.030 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:46.030 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:46.030 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:46.030 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:52.282586+0000", 2024-09-13T06:43:46.030 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:46.031 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:46.031 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:46.031 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:46.031 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:52.282586+0000", 2024-09-13T06:43:46.031 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:46.031 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:46.031 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:46.031 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:46.031 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:52.282583+0000", 2024-09-13T06:43:46.031 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999976 2024-09-13T06:43:46.031 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:46.031 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:46.031 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:46.031 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:52.282599+0000", 2024-09-13T06:43:46.032 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5065999999999999e-05 2024-09-13T06:43:46.032 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:46.032 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:46.032 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:46.032 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:52.282632+0000", 2024-09-13T06:43:46.032 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.3386999999999997e-05 2024-09-13T06:43:46.032 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:46.032 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:46.032 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:46.032 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:52.282654+0000", 2024-09-13T06:43:46.032 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.177e-05 2024-09-13T06:43:46.032 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:46.033 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:46.033 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:46.033 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:52.282753+0000", 2024-09-13T06:43:46.033 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.9685000000000005e-05 2024-09-13T06:43:46.033 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:46.033 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:46.033 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:46.033 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:52.283000+0000", 2024-09-13T06:43:46.033 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000246278 2024-09-13T06:43:46.033 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:46.033 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:46.033 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 3", 2024-09-13T06:43:46.033 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:52.292656+0000", 2024-09-13T06:43:46.033 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0096565980000000006 2024-09-13T06:43:46.034 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:46.034 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:46.034 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:43:46.034 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:52.339352+0000", 2024-09-13T06:43:46.034 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.046695309999999997 2024-09-13T06:43:46.034 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:46.034 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:46.034 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-13T06:43:46.034 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:52.339373+0000", 2024-09-13T06:43:46.034 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.1002999999999999e-05 2024-09-13T06:43:46.034 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:46.034 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:46.034 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-13T06:43:46.034 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:52.339464+0000", 2024-09-13T06:43:46.035 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.1131999999999994e-05 2024-09-13T06:43:46.035 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:46.035 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:46.035 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:46.035 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:52.339582+0000", 2024-09-13T06:43:46.035 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000118799 2024-09-13T06:43:46.035 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:46.035 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:46.035 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:46.035 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:46.035 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:46.035 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:237445 3.15 3:abdd9d42:::rbd_data.1121cb4a09ed.0000000000000008:82 [read 69632~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e224)", 2024-09-13T06:43:46.035 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:43:08.800334+0000", 2024-09-13T06:43:46.035 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 37.208697307999998, 2024-09-13T06:43:46.035 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.032345681000000001, 2024-09-13T06:43:46.035 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:46.036 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:46.036 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:46.036 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:46.036 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:46.036 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 237445 2024-09-13T06:43:46.036 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:46.036 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:46.036 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:46.036 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:46.036 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800334+0000", 2024-09-13T06:43:46.036 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:46.036 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:46.036 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:46.036 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:46.037 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800334+0000", 2024-09-13T06:43:46.037 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:46.037 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:46.037 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:46.037 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:46.037 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800334+0000", 2024-09-13T06:43:46.037 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:46.037 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:46.037 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:46.037 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:46.037 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800338+0000", 2024-09-13T06:43:46.037 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.9539999999999998e-06 2024-09-13T06:43:46.037 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:46.038 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:46.038 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:46.038 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800342+0000", 2024-09-13T06:43:46.038 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.7249999999999999e-06 2024-09-13T06:43:46.038 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:46.038 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:46.038 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:46.038 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800345+0000", 2024-09-13T06:43:46.038 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.072e-06 2024-09-13T06:43:46.038 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:46.038 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:46.038 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:46.038 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.832482+0000", 2024-09-13T06:43:46.038 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.032137713999999998 2024-09-13T06:43:46.039 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:46.039 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:46.039 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:46.039 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.832571+0000", 2024-09-13T06:43:46.039 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.8252999999999997e-05 2024-09-13T06:43:46.039 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:46.039 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:46.039 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:46.039 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.832680+0000", 2024-09-13T06:43:46.039 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000109214 2024-09-13T06:43:46.039 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:46.039 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:46.039 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:46.040 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:46.040 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:46.040 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:237446 3.15 3:abdd9d42:::rbd_data.1121cb4a09ed.0000000000000008:82 [read 81920~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e224)", 2024-09-13T06:43:46.040 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:43:08.800348+0000", 2024-09-13T06:43:46.040 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 37.208683907999998, 2024-09-13T06:43:46.040 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.032454446999999997, 2024-09-13T06:43:46.040 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:46.040 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:46.040 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:46.040 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:46.040 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:46.040 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 237446 2024-09-13T06:43:46.040 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:46.040 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:46.040 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:46.041 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:46.041 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800348+0000", 2024-09-13T06:43:46.041 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:46.041 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:46.041 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:46.041 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:46.041 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800348+0000", 2024-09-13T06:43:46.041 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:46.041 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:46.041 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:46.041 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:46.041 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800347+0000", 2024-09-13T06:43:46.041 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:46.042 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:46.042 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:46.042 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:46.042 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800349+0000", 2024-09-13T06:43:46.042 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.452e-06 2024-09-13T06:43:46.042 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:46.042 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:46.042 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:46.042 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800354+0000", 2024-09-13T06:43:46.042 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.0350000000000001e-06 2024-09-13T06:43:46.042 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:46.042 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:46.042 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:46.042 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800357+0000", 2024-09-13T06:43:46.043 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.179e-06 2024-09-13T06:43:46.043 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:46.043 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:46.043 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:46.043 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.832707+0000", 2024-09-13T06:43:46.043 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.032350071000000001 2024-09-13T06:43:46.043 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:46.043 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:46.043 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:46.043 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.832748+0000", 2024-09-13T06:43:46.043 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0587000000000003e-05 2024-09-13T06:43:46.043 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:46.043 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:46.044 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:46.044 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.832802+0000", 2024-09-13T06:43:46.044 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.4429999999999999e-05 2024-09-13T06:43:46.044 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:46.044 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:46.044 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:46.044 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:46.044 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:46.044 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:237447 3.15 3:abdd9d42:::rbd_data.1121cb4a09ed.0000000000000008:82 [read 94208~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e224)", 2024-09-13T06:43:46.044 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:43:08.800360+0000", 2024-09-13T06:43:46.044 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 37.208671996, 2024-09-13T06:43:46.044 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.032679798000000003, 2024-09-13T06:43:46.044 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:46.045 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:46.045 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:46.045 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:46.045 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:46.045 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 237447 2024-09-13T06:43:46.045 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:46.045 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:46.045 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:46.045 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:46.045 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800360+0000", 2024-09-13T06:43:46.045 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:46.045 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:46.045 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:46.045 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:46.046 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800360+0000", 2024-09-13T06:43:46.046 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:46.046 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:46.046 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:46.046 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:46.046 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800359+0000", 2024-09-13T06:43:46.046 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:46.046 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:46.046 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:46.046 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:46.046 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800361+0000", 2024-09-13T06:43:46.046 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.463e-06 2024-09-13T06:43:46.046 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:46.046 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:46.047 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:46.047 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800364+0000", 2024-09-13T06:43:46.047 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.6279999999999998e-06 2024-09-13T06:43:46.047 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:46.047 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:46.047 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:46.047 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800367+0000", 2024-09-13T06:43:46.047 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.7259999999999998e-06 2024-09-13T06:43:46.047 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:46.047 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:46.047 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:46.047 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.832841+0000", 2024-09-13T06:43:46.047 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.032474115999999997 2024-09-13T06:43:46.047 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:46.048 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:46.048 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:46.048 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.832929+0000", 2024-09-13T06:43:46.048 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.7886000000000005e-05 2024-09-13T06:43:46.048 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:46.048 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:46.048 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:46.048 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.833039+0000", 2024-09-13T06:43:46.048 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00011024200000000001 2024-09-13T06:43:46.048 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:46.048 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:46.048 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:46.048 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:46.049 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:46.049 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:237448 3.15 3:abdd9d42:::rbd_data.1121cb4a09ed.0000000000000008:82 [read 106496~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e224)", 2024-09-13T06:43:46.049 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:43:08.800371+0000", 2024-09-13T06:43:46.049 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 37.208660856999998, 2024-09-13T06:43:46.049 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.032794221999999998, 2024-09-13T06:43:46.049 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:46.049 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:46.049 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:46.049 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:46.049 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:46.049 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 237448 2024-09-13T06:43:46.049 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:46.050 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:46.050 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:46.050 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:46.050 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800371+0000", 2024-09-13T06:43:46.050 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:46.050 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:46.050 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:46.050 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:46.050 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800371+0000", 2024-09-13T06:43:46.050 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:46.050 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:46.050 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:46.050 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:46.050 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800370+0000", 2024-09-13T06:43:46.051 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967296 2024-09-13T06:43:46.051 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:46.051 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:46.051 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:46.051 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800372+0000", 2024-09-13T06:43:46.051 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3510000000000001e-06 2024-09-13T06:43:46.051 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:46.051 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:46.051 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:46.051 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800376+0000", 2024-09-13T06:43:46.051 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.693e-06 2024-09-13T06:43:46.051 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:46.051 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:46.052 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:46.052 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800378+0000", 2024-09-13T06:43:46.052 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.8870000000000001e-06 2024-09-13T06:43:46.052 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:46.052 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:46.052 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:46.052 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.833069+0000", 2024-09-13T06:43:46.052 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.032690708999999998 2024-09-13T06:43:46.052 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:46.052 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:46.052 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:46.052 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.833110+0000", 2024-09-13T06:43:46.052 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.1356999999999997e-05 2024-09-13T06:43:46.052 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:46.052 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:46.053 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:46.053 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.833165+0000", 2024-09-13T06:43:46.053 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.4456999999999997e-05 2024-09-13T06:43:46.053 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:46.053 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:46.053 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:46.053 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:46.053 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:46.053 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:237449 3.15 3:abdd9d42:::rbd_data.1121cb4a09ed.0000000000000008:82 [read 118784~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e224)", 2024-09-13T06:43:46.053 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:43:08.800381+0000", 2024-09-13T06:43:46.053 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 37.208650714999997, 2024-09-13T06:43:46.053 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.033007068000000001, 2024-09-13T06:43:46.053 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:46.053 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:46.054 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:46.054 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:46.054 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:46.054 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 237449 2024-09-13T06:43:46.054 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:46.054 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:46.054 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:46.054 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:46.054 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800381+0000", 2024-09-13T06:43:46.054 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:46.054 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:46.054 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:46.054 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:46.054 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800381+0000", 2024-09-13T06:43:46.055 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:46.055 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:46.055 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:46.055 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:46.055 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800381+0000", 2024-09-13T06:43:46.055 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967296 2024-09-13T06:43:46.055 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:46.055 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:46.055 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:46.055 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800382+0000", 2024-09-13T06:43:46.055 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.395e-06 2024-09-13T06:43:46.055 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:46.055 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:46.055 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:46.056 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800386+0000", 2024-09-13T06:43:46.056 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.574e-06 2024-09-13T06:43:46.056 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:46.056 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:46.056 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:46.056 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800388+0000", 2024-09-13T06:43:46.056 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.8729999999999999e-06 2024-09-13T06:43:46.056 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:46.056 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:46.056 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:46.056 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.833204+0000", 2024-09-13T06:43:46.056 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.032815986999999998 2024-09-13T06:43:46.056 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:46.056 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:46.057 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:46.057 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.833289+0000", 2024-09-13T06:43:46.057 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.4085999999999994e-05 2024-09-13T06:43:46.057 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:46.057 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:46.057 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:46.057 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.833388+0000", 2024-09-13T06:43:46.057 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.9380000000000001e-05 2024-09-13T06:43:46.057 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:46.057 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:46.057 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:46.057 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:46.057 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:46.058 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:237450 3.15 3:abdd9d42:::rbd_data.1121cb4a09ed.0000000000000008:82 [read 131072~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e224)", 2024-09-13T06:43:46.058 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:43:08.800392+0000", 2024-09-13T06:43:46.058 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 37.208639386999998, 2024-09-13T06:43:46.058 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.033110507999999997, 2024-09-13T06:43:46.058 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:46.058 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:46.058 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:46.058 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:46.058 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:46.058 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 237450 2024-09-13T06:43:46.058 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:46.058 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:46.058 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:46.059 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:46.059 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800392+0000", 2024-09-13T06:43:46.059 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:46.059 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:46.059 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:46.059 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:46.059 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800392+0000", 2024-09-13T06:43:46.059 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:46.059 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:46.059 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:46.059 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:46.059 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800392+0000", 2024-09-13T06:43:46.059 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967296 2024-09-13T06:43:46.059 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:46.060 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:46.060 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:46.060 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800393+0000", 2024-09-13T06:43:46.060 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.375e-06 2024-09-13T06:43:46.060 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:46.060 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:46.060 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:46.060 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800397+0000", 2024-09-13T06:43:46.060 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.6109999999999998e-06 2024-09-13T06:43:46.060 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:46.060 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:46.060 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:46.060 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800400+0000", 2024-09-13T06:43:46.061 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.7580000000000001e-06 2024-09-13T06:43:46.061 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:46.061 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:46.061 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:46.061 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.833414+0000", 2024-09-13T06:43:46.061 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.033014767 2024-09-13T06:43:46.061 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:46.061 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:46.061 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:46.061 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.833453+0000", 2024-09-13T06:43:46.061 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.8711000000000003e-05 2024-09-13T06:43:46.061 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:46.061 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:46.062 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:46.062 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.833503+0000", 2024-09-13T06:43:46.062 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.9523e-05 2024-09-13T06:43:46.062 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:46.062 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:46.062 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:46.062 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:46.062 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:46.062 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:237451 3.15 3:abdd9d42:::rbd_data.1121cb4a09ed.0000000000000008:82 [read 143360~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e224)", 2024-09-13T06:43:46.062 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:43:08.800402+0000", 2024-09-13T06:43:46.062 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 37.208629569000003, 2024-09-13T06:43:46.062 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.033337717000000003, 2024-09-13T06:43:46.062 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:46.062 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:46.063 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:46.063 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:46.063 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:46.063 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 237451 2024-09-13T06:43:46.063 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:46.063 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:46.063 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:46.063 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:46.063 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800402+0000", 2024-09-13T06:43:46.063 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:46.063 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:46.063 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:46.063 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:46.064 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800402+0000", 2024-09-13T06:43:46.064 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:46.064 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:46.064 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:46.064 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:46.064 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800402+0000", 2024-09-13T06:43:46.064 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967296 2024-09-13T06:43:46.064 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:46.064 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:46.064 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:46.064 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800403+0000", 2024-09-13T06:43:46.064 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.37e-06 2024-09-13T06:43:46.064 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:46.064 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:46.065 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:46.065 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800407+0000", 2024-09-13T06:43:46.065 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.6820000000000001e-06 2024-09-13T06:43:46.065 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:46.065 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:46.065 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:46.065 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800410+0000", 2024-09-13T06:43:46.065 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.7810000000000001e-06 2024-09-13T06:43:46.065 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:46.065 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:46.065 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:46.065 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.833550+0000", 2024-09-13T06:43:46.065 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.033140192999999998 2024-09-13T06:43:46.065 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:46.066 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:46.066 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:46.066 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.833634+0000", 2024-09-13T06:43:46.066 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.4097000000000005e-05 2024-09-13T06:43:46.066 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:46.066 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:46.066 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:46.066 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.833740+0000", 2024-09-13T06:43:46.066 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00010582300000000001 2024-09-13T06:43:46.066 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:46.066 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:46.066 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:46.066 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:46.066 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:46.067 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:237452 3.15 3:abdd9d42:::rbd_data.1121cb4a09ed.0000000000000008:82 [read 155648~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e224)", 2024-09-13T06:43:46.067 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:43:08.800412+0000", 2024-09-13T06:43:46.067 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 37.208619613000003, 2024-09-13T06:43:46.067 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.033496535000000001, 2024-09-13T06:43:46.067 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:46.067 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:46.067 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:46.067 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:46.067 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:46.067 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 237452 2024-09-13T06:43:46.067 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:46.067 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:46.067 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:46.067 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:46.067 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800412+0000", 2024-09-13T06:43:46.068 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:46.068 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:46.068 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:46.068 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:46.068 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800412+0000", 2024-09-13T06:43:46.068 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:46.068 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:46.068 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:46.068 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:46.068 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800412+0000", 2024-09-13T06:43:46.068 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967296 2024-09-13T06:43:46.068 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:46.068 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:46.068 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:46.069 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800413+0000", 2024-09-13T06:43:46.069 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.342e-06 2024-09-13T06:43:46.069 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:46.069 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:46.069 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:46.069 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800417+0000", 2024-09-13T06:43:46.069 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.6480000000000001e-06 2024-09-13T06:43:46.069 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:46.069 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:46.069 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:46.069 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800419+0000", 2024-09-13T06:43:46.069 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.7920000000000001e-06 2024-09-13T06:43:46.069 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:46.069 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:46.070 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:46.070 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.833768+0000", 2024-09-13T06:43:46.070 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.033348587999999998 2024-09-13T06:43:46.070 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:46.070 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:46.070 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:46.070 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.833836+0000", 2024-09-13T06:43:46.070 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.8090999999999996e-05 2024-09-13T06:43:46.070 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:46.070 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:46.070 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:46.070 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.833908+0000", 2024-09-13T06:43:46.070 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.2311999999999995e-05 2024-09-13T06:43:46.071 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:46.071 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:46.071 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:46.071 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:46.071 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:46.071 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:237453 3.15 3:abdd9d42:::rbd_data.1121cb4a09ed.0000000000000008:82 [read 167936~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e224)", 2024-09-13T06:43:46.071 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:43:08.800422+0000", 2024-09-13T06:43:46.071 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 37.208609541999998, 2024-09-13T06:43:46.071 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.033735223000000002, 2024-09-13T06:43:46.071 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:46.071 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:46.071 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:46.071 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:46.071 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:46.072 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 237453 2024-09-13T06:43:46.072 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:46.072 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:46.072 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:46.072 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:46.072 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800422+0000", 2024-09-13T06:43:46.072 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:46.072 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:46.072 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:46.072 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:46.072 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800422+0000", 2024-09-13T06:43:46.072 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:46.073 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:46.073 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:46.073 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:46.073 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800422+0000", 2024-09-13T06:43:46.073 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967296 2024-09-13T06:43:46.073 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:46.073 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:46.073 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:46.073 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800423+0000", 2024-09-13T06:43:46.073 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3489999999999999e-06 2024-09-13T06:43:46.073 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:46.073 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:46.074 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:46.074 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800427+0000", 2024-09-13T06:43:46.074 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.6610000000000002e-06 2024-09-13T06:43:46.074 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:46.074 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:46.074 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:46.074 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800430+0000", 2024-09-13T06:43:46.074 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.9869999999999999e-06 2024-09-13T06:43:46.074 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:46.074 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:46.074 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:46.074 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.833958+0000", 2024-09-13T06:43:46.074 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.033528020999999998 2024-09-13T06:43:46.075 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:46.075 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:46.075 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:46.075 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.834047+0000", 2024-09-13T06:43:46.075 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.9492000000000003e-05 2024-09-13T06:43:46.075 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:46.075 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:46.075 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:46.075 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.834157+0000", 2024-09-13T06:43:46.075 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000109948 2024-09-13T06:43:46.075 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:46.075 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:46.075 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:46.076 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:46.076 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:46.076 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:237454 3.15 3:abdd9d42:::rbd_data.1121cb4a09ed.0000000000000008:82 [read 180224~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e224)", 2024-09-13T06:43:46.076 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:43:08.800432+0000", 2024-09-13T06:43:46.076 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 37.208599335000002, 2024-09-13T06:43:46.076 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.033853883000000001, 2024-09-13T06:43:46.076 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:46.076 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:46.076 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:46.076 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:46.076 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:46.076 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 237454 2024-09-13T06:43:46.076 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:46.077 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:46.077 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:46.077 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:46.077 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800432+0000", 2024-09-13T06:43:46.077 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:46.077 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:46.077 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:46.077 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:46.077 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800432+0000", 2024-09-13T06:43:46.077 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:46.077 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:46.077 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:46.077 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:46.078 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800432+0000", 2024-09-13T06:43:46.078 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:46.078 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:46.078 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:46.078 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:46.078 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800433+0000", 2024-09-13T06:43:46.078 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3379999999999999e-06 2024-09-13T06:43:46.078 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:46.078 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:46.078 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:46.078 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800437+0000", 2024-09-13T06:43:46.078 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.1679999999999997e-06 2024-09-13T06:43:46.078 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:46.078 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:46.079 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:46.079 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800440+0000", 2024-09-13T06:43:46.079 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.8830000000000002e-06 2024-09-13T06:43:46.079 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:46.079 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:46.079 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:46.079 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.834187+0000", 2024-09-13T06:43:46.079 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.033746532000000003 2024-09-13T06:43:46.079 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:46.079 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:46.079 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:46.079 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.834228+0000", 2024-09-13T06:43:46.079 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.087e-05 2024-09-13T06:43:46.079 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:46.080 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:46.080 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:46.080 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.834286+0000", 2024-09-13T06:43:46.080 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.8331000000000001e-05 2024-09-13T06:43:46.080 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:46.080 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:46.080 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:46.080 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:46.080 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:46.080 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:237455 3.15 3:abdd9d42:::rbd_data.1121cb4a09ed.0000000000000008:82 [read 192512~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e224)", 2024-09-13T06:43:46.080 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:43:08.800443+0000", 2024-09-13T06:43:46.080 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 37.208588861999999, 2024-09-13T06:43:46.080 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.034083294, 2024-09-13T06:43:46.081 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:46.081 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:46.081 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:46.081 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:46.081 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:46.081 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 237455 2024-09-13T06:43:46.081 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:46.081 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:46.081 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:46.081 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:46.081 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800443+0000", 2024-09-13T06:43:46.081 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:46.081 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:46.081 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:46.082 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:46.082 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800443+0000", 2024-09-13T06:43:46.082 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:46.082 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:46.082 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:46.082 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:46.082 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800442+0000", 2024-09-13T06:43:46.082 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967296 2024-09-13T06:43:46.082 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:46.082 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:46.082 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:46.082 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800444+0000", 2024-09-13T06:43:46.082 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.443e-06 2024-09-13T06:43:46.082 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:46.083 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:46.083 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:46.083 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800448+0000", 2024-09-13T06:43:46.083 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.6770000000000001e-06 2024-09-13T06:43:46.083 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:46.083 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:46.083 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:46.083 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800451+0000", 2024-09-13T06:43:46.083 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.0920000000000002e-06 2024-09-13T06:43:46.083 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:46.083 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:46.083 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:46.083 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.834323+0000", 2024-09-13T06:43:46.084 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.033872145999999999 2024-09-13T06:43:46.084 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:46.084 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:46.084 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:46.084 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.834420+0000", 2024-09-13T06:43:46.084 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6898999999999995e-05 2024-09-13T06:43:46.084 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:46.084 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:46.084 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:46.084 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.834526+0000", 2024-09-13T06:43:46.084 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000106272 2024-09-13T06:43:46.084 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:46.084 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:46.084 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:46.085 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:46.085 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:46.085 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:237456 3.15 3:abdd9d42:::rbd_data.1121cb4a09ed.0000000000000008:82 [read 204800~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e224)", 2024-09-13T06:43:46.085 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:43:08.800453+0000", 2024-09-13T06:43:46.085 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 37.208578651000003, 2024-09-13T06:43:46.085 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.034198615000000002, 2024-09-13T06:43:46.085 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:46.085 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:46.085 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:46.085 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:46.085 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:46.085 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 237456 2024-09-13T06:43:46.085 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:46.085 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:46.086 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:46.086 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:46.086 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800453+0000", 2024-09-13T06:43:46.086 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:46.086 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:46.086 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:46.086 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:46.086 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800453+0000", 2024-09-13T06:43:46.086 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:46.086 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:46.086 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:46.086 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:46.086 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800453+0000", 2024-09-13T06:43:46.086 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967296 2024-09-13T06:43:46.086 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:46.087 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:46.087 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:46.087 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800454+0000", 2024-09-13T06:43:46.087 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.361e-06 2024-09-13T06:43:46.087 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:46.087 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:46.087 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:46.087 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800458+0000", 2024-09-13T06:43:46.087 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.7189999999999999e-06 2024-09-13T06:43:46.087 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:46.087 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:46.087 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:46.087 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800461+0000", 2024-09-13T06:43:46.087 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.7599999999999998e-06 2024-09-13T06:43:46.088 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:46.088 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:46.088 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:46.088 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.834555+0000", 2024-09-13T06:43:46.088 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.034094192000000002 2024-09-13T06:43:46.088 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:46.088 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:46.088 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:46.088 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.834597+0000", 2024-09-13T06:43:46.088 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.2157000000000003e-05 2024-09-13T06:43:46.088 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:46.088 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:46.088 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:46.088 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.834652+0000", 2024-09-13T06:43:46.088 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.4660999999999997e-05 2024-09-13T06:43:46.089 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:46.089 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:46.089 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:46.089 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:46.089 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:46.089 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:237457 3.15 3:abdd9d42:::rbd_data.1121cb4a09ed.0000000000000008:82 [read 217088~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e224)", 2024-09-13T06:43:46.089 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:43:08.800463+0000", 2024-09-13T06:43:46.089 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 37.208568704000001, 2024-09-13T06:43:46.089 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.034419130999999999, 2024-09-13T06:43:46.089 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:46.089 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:46.089 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:46.089 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:46.089 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:46.090 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 237457 2024-09-13T06:43:46.090 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:46.090 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:46.090 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:46.090 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:46.090 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800463+0000", 2024-09-13T06:43:46.090 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:46.090 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:46.090 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:46.090 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:46.090 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800463+0000", 2024-09-13T06:43:46.090 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:46.090 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:46.090 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:46.091 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:46.091 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800463+0000", 2024-09-13T06:43:46.091 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967296 2024-09-13T06:43:46.091 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:46.091 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:46.091 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:46.091 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800466+0000", 2024-09-13T06:43:46.091 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.8240000000000001e-06 2024-09-13T06:43:46.091 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:46.091 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:46.091 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:46.091 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800470+0000", 2024-09-13T06:43:46.091 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.7579999999999998e-06 2024-09-13T06:43:46.091 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:46.092 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:46.092 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:46.092 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800473+0000", 2024-09-13T06:43:46.092 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.875e-06 2024-09-13T06:43:46.092 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:46.092 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:46.092 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:46.092 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.834688+0000", 2024-09-13T06:43:46.092 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.034215039000000003 2024-09-13T06:43:46.092 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:46.092 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:46.092 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:46.092 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.834772+0000", 2024-09-13T06:43:46.092 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.3870999999999997e-05 2024-09-13T06:43:46.092 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:46.093 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:46.093 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:46.093 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.834882+0000", 2024-09-13T06:43:46.093 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00011 2024-09-13T06:43:46.093 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:46.093 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:46.093 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:46.093 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:46.093 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:46.093 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:237458 3.15 3:abdd9d42:::rbd_data.1121cb4a09ed.0000000000000008:82 [read 229376~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e224)", 2024-09-13T06:43:46.093 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:43:08.800476+0000", 2024-09-13T06:43:46.093 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 37.208555955999998, 2024-09-13T06:43:46.093 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.034538358999999998, 2024-09-13T06:43:46.093 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:46.094 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:46.094 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:46.094 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:46.094 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:46.094 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 237458 2024-09-13T06:43:46.094 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:46.094 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:46.094 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:46.094 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:46.094 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800476+0000", 2024-09-13T06:43:46.094 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:46.094 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:46.094 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:46.095 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:46.095 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800476+0000", 2024-09-13T06:43:46.095 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:46.095 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:46.095 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:46.095 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:46.095 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800475+0000", 2024-09-13T06:43:46.095 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:46.095 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:46.095 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:46.095 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:46.095 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800477+0000", 2024-09-13T06:43:46.095 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.367e-06 2024-09-13T06:43:46.095 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:46.095 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:46.096 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:46.096 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800480+0000", 2024-09-13T06:43:46.096 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.7179999999999998e-06 2024-09-13T06:43:46.096 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:46.096 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:46.096 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:46.096 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800483+0000", 2024-09-13T06:43:46.096 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.807e-06 2024-09-13T06:43:46.096 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:46.096 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:46.096 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:46.096 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.834922+0000", 2024-09-13T06:43:46.096 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.034438261999999997 2024-09-13T06:43:46.097 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:46.097 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:46.097 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:46.097 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.834962+0000", 2024-09-13T06:43:46.097 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0287999999999998e-05 2024-09-13T06:43:46.097 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:46.097 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:46.097 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:46.097 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.835014+0000", 2024-09-13T06:43:46.097 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.2172999999999997e-05 2024-09-13T06:43:46.097 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:46.097 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:46.097 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:46.098 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:46.098 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:46.098 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:237459 3.15 3:abdd9d42:::rbd_data.1121cb4a09ed.0000000000000008:82 [read 241664~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e224)", 2024-09-13T06:43:46.098 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:43:08.800486+0000", 2024-09-13T06:43:46.098 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 37.208545815000001, 2024-09-13T06:43:46.098 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.034771370000000003, 2024-09-13T06:43:46.098 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:46.098 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:46.098 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:46.098 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:46.098 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:46.098 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 237459 2024-09-13T06:43:46.098 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:46.099 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:46.099 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:46.099 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:46.099 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800486+0000", 2024-09-13T06:43:46.099 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:46.099 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:46.099 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:46.099 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:46.099 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800486+0000", 2024-09-13T06:43:46.099 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:46.099 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:46.099 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:46.099 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:46.099 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800485+0000", 2024-09-13T06:43:46.100 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:46.100 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:46.100 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:46.100 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:46.100 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800487+0000", 2024-09-13T06:43:46.100 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.297e-06 2024-09-13T06:43:46.100 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:46.100 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:46.100 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:46.100 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800491+0000", 2024-09-13T06:43:46.100 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.4569999999999998e-06 2024-09-13T06:43:46.100 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:46.100 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:46.101 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:46.101 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800494+0000", 2024-09-13T06:43:46.101 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.8710000000000001e-06 2024-09-13T06:43:46.101 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:46.101 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:46.101 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:46.101 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.835058+0000", 2024-09-13T06:43:46.101 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.034564117999999998 2024-09-13T06:43:46.101 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:46.101 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:46.101 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:46.101 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.835142+0000", 2024-09-13T06:43:46.101 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.352e-05 2024-09-13T06:43:46.102 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:46.102 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:46.102 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:46.102 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.835257+0000", 2024-09-13T06:43:46.102 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00011537 2024-09-13T06:43:46.102 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:46.102 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:46.102 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:46.102 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:46.102 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:46.102 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:237460 3.15 3:abdd9d42:::rbd_data.1121cb4a09ed.0000000000000008:82 [read 253952~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e224)", 2024-09-13T06:43:46.102 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:43:08.800511+0000", 2024-09-13T06:43:46.102 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 37.208520145000001, 2024-09-13T06:43:46.103 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.034864764999999999, 2024-09-13T06:43:46.103 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:46.103 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:46.103 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:46.103 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:46.103 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:46.103 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 237460 2024-09-13T06:43:46.103 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:46.103 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:46.103 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:46.103 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:46.103 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800511+0000", 2024-09-13T06:43:46.103 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:46.103 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:46.104 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:46.104 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:46.104 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800511+0000", 2024-09-13T06:43:46.104 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:46.104 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:46.104 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:46.104 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:46.104 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800511+0000", 2024-09-13T06:43:46.104 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:46.104 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:46.104 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:46.104 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:46.104 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800513+0000", 2024-09-13T06:43:46.105 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6020000000000001e-06 2024-09-13T06:43:46.105 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:46.105 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:46.105 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:46.105 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800517+0000", 2024-09-13T06:43:46.105 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0559999999999998e-06 2024-09-13T06:43:46.105 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:46.105 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:46.105 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:46.105 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800521+0000", 2024-09-13T06:43:46.105 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.4050000000000002e-06 2024-09-13T06:43:46.105 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:46.105 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:46.105 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:46.106 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.835278+0000", 2024-09-13T06:43:46.106 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.034757154999999998 2024-09-13T06:43:46.106 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:46.106 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:46.106 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:46.106 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.835319+0000", 2024-09-13T06:43:46.106 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.1121000000000002e-05 2024-09-13T06:43:46.106 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:46.106 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:46.106 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:46.106 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.835376+0000", 2024-09-13T06:43:46.106 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.6820000000000001e-05 2024-09-13T06:43:46.106 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:46.106 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:46.106 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:46.107 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:46.107 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:46.107 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:43:46.108 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-13T06:43:46.109 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:43:46.107+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:43:46.210 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:43:46.207+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:43:46.240 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:43:46.240 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-13T06:43:46.240 INFO:teuthology.orchestra.run.smithi081.stdout: "num_ops": 0 2024-09-13T06:43:46.240 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:43:46.254 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-13T06:43:46.310 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:43:46.308+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:43:46.411 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:43:46.411+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:43:46.425 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:43:46.425 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-13T06:43:46.425 INFO:teuthology.orchestra.run.smithi081.stdout: "complaint_time": 30, 2024-09-13T06:43:46.425 INFO:teuthology.orchestra.run.smithi081.stdout: "num_blocked_ops": 0 2024-09-13T06:43:46.425 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:43:46.443 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-13T06:43:46.501 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-13T06:43:46.512 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-13T06:43:46.512+0000 7fa8bb18e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 36790) UID: 0 2024-09-13T06:43:46.614 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:43:46.612+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:43:46.621 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:43:46.622 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 20, 2024-09-13T06:43:46.622 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 600, 2024-09-13T06:43:46.622 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [ 2024-09-13T06:43:46.622 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:46.622 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:37801 3.1 3:82e31015:::rbd_object_map.1121d8143c6e.0000000000000019:head [call] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e55)", 2024-09-13T06:43:46.622 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:05.646191+0000", 2024-09-13T06:43:46.622 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 220.97539176000001, 2024-09-13T06:43:46.622 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.72659507800000001, 2024-09-13T06:43:46.622 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:46.622 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:46.622 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:46.622 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:46.623 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:46.623 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 37801 2024-09-13T06:43:46.623 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:46.623 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:46.623 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:46.623 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:46.623 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:05.646191+0000", 2024-09-13T06:43:46.623 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:46.623 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:46.624 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:46.624 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:46.624 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:05.646191+0000", 2024-09-13T06:43:46.624 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:46.624 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:46.624 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:46.624 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:46.624 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:05.646188+0000", 2024-09-13T06:43:46.624 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999971 2024-09-13T06:43:46.624 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:46.624 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:46.624 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:46.624 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:05.646206+0000", 2024-09-13T06:43:46.625 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8182999999999999e-05 2024-09-13T06:43:46.625 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:46.625 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:46.625 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:46.625 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:05.646237+0000", 2024-09-13T06:43:46.625 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.1071000000000001e-05 2024-09-13T06:43:46.625 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:46.625 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:46.625 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:46.625 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:05.646251+0000", 2024-09-13T06:43:46.625 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3679000000000001e-05 2024-09-13T06:43:46.625 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:46.625 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:46.626 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:46.626 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:05.646321+0000", 2024-09-13T06:43:46.626 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.9831000000000003e-05 2024-09-13T06:43:46.626 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:46.626 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:46.626 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:43:46.626 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:05.646331+0000", 2024-09-13T06:43:46.626 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0242e-05 2024-09-13T06:43:46.626 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:46.626 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:46.626 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:46.626 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.371959+0000", 2024-09-13T06:43:46.626 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.72562817199999996 2024-09-13T06:43:46.626 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:46.627 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:46.627 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:46.627 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.372389+0000", 2024-09-13T06:43:46.627 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00042977400000000001 2024-09-13T06:43:46.627 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:46.627 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:46.627 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:46.627 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.372786+0000", 2024-09-13T06:43:46.627 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00039706099999999999 2024-09-13T06:43:46.627 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:46.627 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:46.627 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:46.627 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:46.627 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:46.628 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43182 3.17 3:ec5ebce4:::rbd_data.1121f5f2e1c0.0000000000000001:1f [read 333824~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:43:46.628 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.652985+0000", 2024-09-13T06:43:46.628 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 204.968597147, 2024-09-13T06:43:46.628 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123926616, 2024-09-13T06:43:46.628 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:46.628 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:46.628 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:46.628 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:46.628 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:46.628 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43182 2024-09-13T06:43:46.628 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:46.628 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:46.628 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:46.629 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:46.629 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.652985+0000", 2024-09-13T06:43:46.629 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:46.629 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:46.629 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:46.629 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:46.629 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.652985+0000", 2024-09-13T06:43:46.629 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:46.629 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:46.629 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:46.629 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:46.629 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.652985+0000", 2024-09-13T06:43:46.630 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:46.630 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:46.630 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:46.630 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:46.630 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.652987+0000", 2024-09-13T06:43:46.630 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0899999999999999e-06 2024-09-13T06:43:46.630 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:46.630 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:46.630 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:46.630 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.652994+0000", 2024-09-13T06:43:46.630 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3100000000000003e-06 2024-09-13T06:43:46.630 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:46.630 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:46.631 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:46.631 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.653000+0000", 2024-09-13T06:43:46.631 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2020000000000003e-06 2024-09-13T06:43:46.631 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:46.631 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:46.631 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:46.631 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.776635+0000", 2024-09-13T06:43:46.631 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.12363529400000001 2024-09-13T06:43:46.631 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:46.631 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:46.631 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:46.631 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.776676+0000", 2024-09-13T06:43:46.631 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.0745999999999999e-05 2024-09-13T06:43:46.631 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:46.632 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:46.632 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:46.632 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.776912+0000", 2024-09-13T06:43:46.632 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00023631300000000001 2024-09-13T06:43:46.632 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:46.632 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:46.632 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:46.632 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:46.632 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:46.632 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43194 3.17 3:ec5ebce4:::rbd_data.1121f5f2e1c0.0000000000000001:1f [read 495616~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:43:46.633 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.656645+0000", 2024-09-13T06:43:46.633 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 204.964936954, 2024-09-13T06:43:46.633 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.124088483, 2024-09-13T06:43:46.633 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:46.633 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:46.633 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:46.633 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:46.633 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:46.633 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43194 2024-09-13T06:43:46.633 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:46.633 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:46.633 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:46.633 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:46.634 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656645+0000", 2024-09-13T06:43:46.634 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:46.634 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:46.634 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:46.634 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:46.634 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656645+0000", 2024-09-13T06:43:46.634 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:46.634 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:46.634 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:46.634 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:46.634 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656645+0000", 2024-09-13T06:43:46.634 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:46.634 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:46.635 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:46.635 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:46.635 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656647+0000", 2024-09-13T06:43:46.635 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9180000000000001e-06 2024-09-13T06:43:46.635 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:46.635 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:46.635 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:46.635 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656653+0000", 2024-09-13T06:43:46.635 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7860000000000002e-06 2024-09-13T06:43:46.635 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:46.635 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:46.635 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:46.635 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656658+0000", 2024-09-13T06:43:46.635 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6949999999999999e-06 2024-09-13T06:43:46.636 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:46.636 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:46.636 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:46.636 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.780406+0000", 2024-09-13T06:43:46.636 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123748657 2024-09-13T06:43:46.636 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:46.636 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:46.636 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:46.636 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.780446+0000", 2024-09-13T06:43:46.636 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.9360999999999998e-05 2024-09-13T06:43:46.636 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:46.636 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:46.636 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:46.636 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.780734+0000", 2024-09-13T06:43:46.637 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00028838399999999998 2024-09-13T06:43:46.637 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:46.637 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:46.637 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:46.637 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:46.637 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:46.637 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43241 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 120832~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:43:46.637 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.660682+0000", 2024-09-13T06:43:46.637 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 204.96090001600001, 2024-09-13T06:43:46.637 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123958204, 2024-09-13T06:43:46.637 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:46.637 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:46.637 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:46.638 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:46.638 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:46.638 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43241 2024-09-13T06:43:46.638 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:46.638 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:46.638 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:46.638 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:46.638 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660682+0000", 2024-09-13T06:43:46.638 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:46.638 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:46.638 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:46.638 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:46.638 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660682+0000", 2024-09-13T06:43:46.639 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:46.639 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:46.639 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:46.639 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:46.639 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660682+0000", 2024-09-13T06:43:46.639 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:46.639 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:46.639 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:46.639 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:46.639 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660683+0000", 2024-09-13T06:43:46.639 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.308e-06 2024-09-13T06:43:46.639 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:46.639 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:46.640 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:46.640 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660686+0000", 2024-09-13T06:43:46.640 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.977e-06 2024-09-13T06:43:46.640 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:46.640 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:46.640 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:46.640 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660689+0000", 2024-09-13T06:43:46.640 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5830000000000001e-06 2024-09-13T06:43:46.640 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:46.640 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:46.640 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:46.640 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.784366+0000", 2024-09-13T06:43:46.641 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.12367713599999999 2024-09-13T06:43:46.641 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:46.641 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:46.641 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:46.641 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.784451+0000", 2024-09-13T06:43:46.641 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.4629999999999994e-05 2024-09-13T06:43:46.641 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:46.641 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:46.641 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:46.641 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.784641+0000", 2024-09-13T06:43:46.641 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00018984899999999999 2024-09-13T06:43:46.641 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:46.642 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:46.642 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:46.642 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:46.642 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:46.642 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43242 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 139264~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:43:46.642 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.660691+0000", 2024-09-13T06:43:46.642 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 204.960891038, 2024-09-13T06:43:46.642 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.124536443, 2024-09-13T06:43:46.642 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:46.642 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:46.642 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:46.642 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:46.643 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:46.643 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43242 2024-09-13T06:43:46.643 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:46.643 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:46.643 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:46.643 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:46.643 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660691+0000", 2024-09-13T06:43:46.643 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:46.643 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:46.643 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:46.643 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:46.643 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660691+0000", 2024-09-13T06:43:46.644 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:46.644 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:46.644 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:46.644 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:46.644 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660691+0000", 2024-09-13T06:43:46.644 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:43:46.644 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:46.644 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:46.644 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:46.644 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660696+0000", 2024-09-13T06:43:46.644 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0560000000000004e-06 2024-09-13T06:43:46.644 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:46.645 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:46.645 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:46.645 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660699+0000", 2024-09-13T06:43:46.645 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.2009999999999999e-06 2024-09-13T06:43:46.645 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:46.645 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:46.645 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:46.645 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660702+0000", 2024-09-13T06:43:46.645 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.633e-06 2024-09-13T06:43:46.645 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:46.645 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:46.645 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:46.646 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.784912+0000", 2024-09-13T06:43:46.646 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.124209497 2024-09-13T06:43:46.646 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:46.646 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:46.646 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:46.646 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.784995+0000", 2024-09-13T06:43:46.646 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.3891e-05 2024-09-13T06:43:46.646 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:46.646 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:46.646 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:46.646 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.785228+0000", 2024-09-13T06:43:46.646 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00023237400000000001 2024-09-13T06:43:46.646 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:46.647 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:46.647 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:46.647 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:46.647 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:46.647 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43243 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 153600~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:43:46.647 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.660705+0000", 2024-09-13T06:43:46.647 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 204.960877705, 2024-09-13T06:43:46.647 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.124825835, 2024-09-13T06:43:46.647 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:46.647 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:46.647 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:46.647 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:46.647 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:46.648 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43243 2024-09-13T06:43:46.648 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:46.648 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:46.648 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:46.648 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:46.648 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660705+0000", 2024-09-13T06:43:46.648 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:46.648 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:46.648 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:46.648 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:46.648 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660705+0000", 2024-09-13T06:43:46.648 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:46.649 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:46.649 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:46.649 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:46.649 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660705+0000", 2024-09-13T06:43:46.649 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:43:46.649 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:46.649 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:46.649 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:46.649 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660706+0000", 2024-09-13T06:43:46.649 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4339999999999999e-06 2024-09-13T06:43:46.649 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:46.649 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:46.649 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:46.650 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660709+0000", 2024-09-13T06:43:46.650 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9000000000000002e-06 2024-09-13T06:43:46.650 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:46.650 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:46.650 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:46.650 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660712+0000", 2024-09-13T06:43:46.650 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.0589999999999998e-06 2024-09-13T06:43:46.650 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:46.650 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:46.650 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:46.650 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.785318+0000", 2024-09-13T06:43:46.650 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.124606299 2024-09-13T06:43:46.650 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:46.650 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:46.650 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:46.651 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.785361+0000", 2024-09-13T06:43:46.651 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.3214999999999999e-05 2024-09-13T06:43:46.651 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:46.651 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:46.651 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:46.651 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.785531+0000", 2024-09-13T06:43:46.651 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00016914400000000001 2024-09-13T06:43:46.651 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:46.651 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:46.651 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:46.651 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:46.651 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:46.651 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43244 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 167936~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:43:46.651 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.660714+0000", 2024-09-13T06:43:46.652 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 204.96086829199999, 2024-09-13T06:43:46.652 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.125073248, 2024-09-13T06:43:46.652 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:46.652 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:46.652 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:46.652 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:46.652 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:46.652 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43244 2024-09-13T06:43:46.652 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:46.652 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:46.652 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:46.652 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:46.652 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660714+0000", 2024-09-13T06:43:46.653 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:46.653 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:46.653 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:46.653 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:46.653 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660714+0000", 2024-09-13T06:43:46.653 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:46.653 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:46.653 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:46.653 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:46.653 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660714+0000", 2024-09-13T06:43:46.653 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:43:46.653 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:46.654 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:46.654 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:46.654 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660715+0000", 2024-09-13T06:43:46.654 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2330000000000001e-06 2024-09-13T06:43:46.654 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:46.654 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:46.654 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:46.654 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660718+0000", 2024-09-13T06:43:46.654 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9569999999999998e-06 2024-09-13T06:43:46.654 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:46.654 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:46.654 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:46.654 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660721+0000", 2024-09-13T06:43:46.655 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.678e-06 2024-09-13T06:43:46.655 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:46.655 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:46.655 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:46.655 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.785557+0000", 2024-09-13T06:43:46.655 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.12483633199999999 2024-09-13T06:43:46.655 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:46.655 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:46.655 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:46.655 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.785618+0000", 2024-09-13T06:43:46.655 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0686000000000001e-05 2024-09-13T06:43:46.655 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:46.655 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:46.656 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:46.656 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.785787+0000", 2024-09-13T06:43:46.656 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00016957699999999999 2024-09-13T06:43:46.656 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:46.656 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:46.656 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:46.656 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:46.656 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:46.656 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43256 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 344064~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:43:46.656 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.664763+0000", 2024-09-13T06:43:46.656 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 204.956819782, 2024-09-13T06:43:46.656 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.12418359399999999, 2024-09-13T06:43:46.657 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:46.657 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:46.657 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:46.657 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:46.657 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:46.657 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43256 2024-09-13T06:43:46.657 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:46.657 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:46.657 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:46.657 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:46.657 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664763+0000", 2024-09-13T06:43:46.657 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:46.658 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:46.658 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:46.658 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:46.658 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664763+0000", 2024-09-13T06:43:46.658 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:46.658 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:46.658 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:46.658 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:46.658 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664762+0000", 2024-09-13T06:43:46.658 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:46.658 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:46.658 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:46.658 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:46.658 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664765+0000", 2024-09-13T06:43:46.659 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3290000000000001e-06 2024-09-13T06:43:46.659 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:46.659 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:46.659 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:46.659 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664771+0000", 2024-09-13T06:43:46.659 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.1319999999999999e-06 2024-09-13T06:43:46.659 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:46.659 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:46.659 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:46.659 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664776+0000", 2024-09-13T06:43:46.660 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.8840000000000002e-06 2024-09-13T06:43:46.660 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:46.660 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:46.660 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:46.660 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.788598+0000", 2024-09-13T06:43:46.660 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123821979 2024-09-13T06:43:46.660 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:46.660 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:46.660 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:46.660 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.788680+0000", 2024-09-13T06:43:46.660 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.2367999999999995e-05 2024-09-13T06:43:46.660 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:46.660 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:46.661 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:46.661 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.788946+0000", 2024-09-13T06:43:46.661 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00026629799999999999 2024-09-13T06:43:46.661 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:46.661 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:46.661 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:46.661 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:46.661 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:46.661 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43267 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 505856~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:43:46.661 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.669461+0000", 2024-09-13T06:43:46.661 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 204.95212122800001, 2024-09-13T06:43:46.661 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123933711, 2024-09-13T06:43:46.661 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:46.662 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:46.662 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:46.662 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:46.662 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:46.662 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43267 2024-09-13T06:43:46.662 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:46.662 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:46.662 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:46.662 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:46.662 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669461+0000", 2024-09-13T06:43:46.662 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:46.662 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:46.662 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:46.663 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:46.663 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669461+0000", 2024-09-13T06:43:46.663 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:46.663 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:46.663 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:46.663 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:46.663 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669461+0000", 2024-09-13T06:43:46.663 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:46.663 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:46.663 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:46.663 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:46.663 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669463+0000", 2024-09-13T06:43:46.663 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5629999999999999e-06 2024-09-13T06:43:46.664 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:46.664 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:46.664 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:46.664 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669473+0000", 2024-09-13T06:43:46.664 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.9520000000000006e-06 2024-09-13T06:43:46.664 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:46.664 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:46.664 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:46.664 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669479+0000", 2024-09-13T06:43:46.664 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8540000000000002e-06 2024-09-13T06:43:46.664 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:46.664 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:46.664 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:46.664 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.793137+0000", 2024-09-13T06:43:46.665 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.12365825699999999 2024-09-13T06:43:46.665 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:46.665 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:46.665 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:46.665 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.793181+0000", 2024-09-13T06:43:46.665 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.3773999999999998e-05 2024-09-13T06:43:46.665 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:46.665 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:46.665 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:46.665 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.793395+0000", 2024-09-13T06:43:46.665 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00021372399999999999 2024-09-13T06:43:46.665 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:46.665 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:46.666 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:46.666 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:46.666 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:46.666 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43268 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 520192~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:43:46.666 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.669484+0000", 2024-09-13T06:43:46.666 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 204.95209844300001, 2024-09-13T06:43:46.666 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.12441057899999999, 2024-09-13T06:43:46.666 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:46.666 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:46.666 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:46.666 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:46.666 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:46.666 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43268 2024-09-13T06:43:46.667 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:46.667 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:46.667 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:46.667 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:46.667 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669484+0000", 2024-09-13T06:43:46.667 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:46.667 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:46.667 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:46.667 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:46.667 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669484+0000", 2024-09-13T06:43:46.667 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:46.667 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:46.667 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:46.668 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:46.668 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669484+0000", 2024-09-13T06:43:46.668 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:46.668 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:46.668 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:46.668 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:46.668 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669486+0000", 2024-09-13T06:43:46.668 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6120000000000001e-06 2024-09-13T06:43:46.668 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:46.668 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:46.668 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:46.668 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669494+0000", 2024-09-13T06:43:46.668 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4819999999999997e-06 2024-09-13T06:43:46.669 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:46.669 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:46.669 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:46.669 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669497+0000", 2024-09-13T06:43:46.669 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9790000000000002e-06 2024-09-13T06:43:46.669 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:46.669 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:46.669 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:46.669 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.793559+0000", 2024-09-13T06:43:46.669 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.124062436 2024-09-13T06:43:46.669 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:46.669 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:46.669 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:46.670 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.793603+0000", 2024-09-13T06:43:46.670 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.3764999999999999e-05 2024-09-13T06:43:46.670 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:46.670 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:46.670 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:46.670 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.793895+0000", 2024-09-13T06:43:46.670 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00029168299999999999 2024-09-13T06:43:46.670 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:46.670 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:46.670 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:46.670 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:46.670 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:46.670 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:181627 3.1b 3:dbd5e871:::rbd_data.11218aab7a9c.0000000000000003:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e203)", 2024-09-13T06:43:46.670 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:42:45.704561+0000", 2024-09-13T06:43:46.671 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 60.917021579, 2024-09-13T06:43:46.671 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.70481779099999997, 2024-09-13T06:43:46.671 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:46.671 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:46.671 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:46.671 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:46.671 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:46.671 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 181627 2024-09-13T06:43:46.671 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:46.671 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:46.671 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:46.671 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:46.672 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.704561+0000", 2024-09-13T06:43:46.672 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:46.672 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:46.672 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:46.672 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:46.672 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.704561+0000", 2024-09-13T06:43:46.672 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:46.672 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:46.672 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:46.672 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:46.672 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.704558+0000", 2024-09-13T06:43:46.672 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999976 2024-09-13T06:43:46.672 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:46.673 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:46.673 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:46.673 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.704570+0000", 2024-09-13T06:43:46.673 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2123000000000001e-05 2024-09-13T06:43:46.673 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:46.673 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:46.673 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:46.673 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.704596+0000", 2024-09-13T06:43:46.673 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5134e-05 2024-09-13T06:43:46.673 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:46.673 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:46.673 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:46.674 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.704609+0000", 2024-09-13T06:43:46.674 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3745e-05 2024-09-13T06:43:46.674 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:46.674 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:46.674 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:46.674 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.704797+0000", 2024-09-13T06:43:46.674 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00018797799999999999 2024-09-13T06:43:46.674 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:46.674 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:46.674 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:43:46.674 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.704816+0000", 2024-09-13T06:43:46.674 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8218000000000001e-05 2024-09-13T06:43:46.674 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:46.674 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:46.675 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:46.675 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:46.408816+0000", 2024-09-13T06:43:46.675 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.70399995500000001 2024-09-13T06:43:46.675 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:46.675 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:46.675 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:46.675 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:46.409111+0000", 2024-09-13T06:43:46.675 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000295202 2024-09-13T06:43:46.675 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:46.675 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:46.675 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:46.675 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:46.409379+0000", 2024-09-13T06:43:46.675 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00026792599999999998 2024-09-13T06:43:46.676 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:46.676 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:46.676 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:46.676 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:46.676 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:46.676 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:181641 3.1b 3:dbd5e871:::rbd_data.11218aab7a9c.0000000000000003:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e203)", 2024-09-13T06:43:46.676 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:42:45.704674+0000", 2024-09-13T06:43:46.676 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 60.916908571999997, 2024-09-13T06:43:46.676 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.70579465600000002, 2024-09-13T06:43:46.676 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:46.676 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:46.676 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:46.676 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:46.677 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:46.677 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 181641 2024-09-13T06:43:46.677 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:46.677 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:46.677 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:46.677 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:46.677 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.704674+0000", 2024-09-13T06:43:46.677 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:46.677 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:46.677 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:46.677 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:46.677 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.704674+0000", 2024-09-13T06:43:46.677 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:46.678 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:46.678 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:46.678 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:46.678 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.704673+0000", 2024-09-13T06:43:46.678 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:46.678 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:46.678 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:46.678 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:46.678 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.704677+0000", 2024-09-13T06:43:46.678 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.6389999999999998e-06 2024-09-13T06:43:46.678 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:46.678 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:46.678 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:46.678 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.704691+0000", 2024-09-13T06:43:46.679 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3859999999999999e-05 2024-09-13T06:43:46.679 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:46.679 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:46.679 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:46.679 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.704699+0000", 2024-09-13T06:43:46.679 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.2339999999999994e-06 2024-09-13T06:43:46.679 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:46.679 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:46.679 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:46.679 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.704854+0000", 2024-09-13T06:43:46.679 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00015513899999999999 2024-09-13T06:43:46.679 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:46.679 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:46.679 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:43:46.679 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.704866+0000", 2024-09-13T06:43:46.680 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1855000000000001e-05 2024-09-13T06:43:46.680 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:46.680 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:46.680 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:46.680 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:46.410079+0000", 2024-09-13T06:43:46.680 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.705212477 2024-09-13T06:43:46.680 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:46.680 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:46.680 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:46.680 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:46.410279+0000", 2024-09-13T06:43:46.680 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000200614 2024-09-13T06:43:46.680 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:46.680 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:46.681 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:46.681 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:46.410469+0000", 2024-09-13T06:43:46.681 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00018939400000000001 2024-09-13T06:43:46.681 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:46.681 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:46.681 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:46.681 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:46.681 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:46.681 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:181655 3.1b 3:dbd5e871:::rbd_data.11218aab7a9c.0000000000000003:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e203)", 2024-09-13T06:43:46.681 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:42:45.704730+0000", 2024-09-13T06:43:46.681 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 60.916852163999998, 2024-09-13T06:43:46.681 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.70617977499999995, 2024-09-13T06:43:46.681 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:46.681 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:46.682 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:46.682 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:46.682 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:46.682 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 181655 2024-09-13T06:43:46.682 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:46.682 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:46.682 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:46.682 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:46.682 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.704730+0000", 2024-09-13T06:43:46.682 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:46.682 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:46.682 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:46.682 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:46.682 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.704730+0000", 2024-09-13T06:43:46.683 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:46.683 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:46.683 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:46.683 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:46.683 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.704730+0000", 2024-09-13T06:43:46.683 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:46.683 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:46.683 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:46.683 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:46.683 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.704733+0000", 2024-09-13T06:43:46.683 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.0000000000000001e-06 2024-09-13T06:43:46.683 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:46.683 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:46.684 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:46.684 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.704741+0000", 2024-09-13T06:43:46.684 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.0770000000000008e-06 2024-09-13T06:43:46.684 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:46.684 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:46.684 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:46.684 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.704747+0000", 2024-09-13T06:43:46.684 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.2110000000000003e-06 2024-09-13T06:43:46.684 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:46.684 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:46.684 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:46.684 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.706676+0000", 2024-09-13T06:43:46.685 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0019289820000000001 2024-09-13T06:43:46.685 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:46.685 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:46.685 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:43:46.685 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.706687+0000", 2024-09-13T06:43:46.685 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1382999999999999e-05 2024-09-13T06:43:46.685 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:46.685 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:46.685 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:46.685 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:46.410540+0000", 2024-09-13T06:43:46.685 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.70385235199999996 2024-09-13T06:43:46.685 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:46.686 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:46.686 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:46.686 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:46.410723+0000", 2024-09-13T06:43:46.686 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000182998 2024-09-13T06:43:46.686 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:46.686 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:46.686 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:46.686 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:46.410910+0000", 2024-09-13T06:43:46.686 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00018720299999999999 2024-09-13T06:43:46.686 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:46.686 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:46.686 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:46.686 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:46.687 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:46.687 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:181669 3.1b 3:dbd5e871:::rbd_data.11218aab7a9c.0000000000000003:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e203)", 2024-09-13T06:43:46.687 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:42:45.705356+0000", 2024-09-13T06:43:46.687 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 60.916226156, 2024-09-13T06:43:46.687 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.70583958999999996, 2024-09-13T06:43:46.687 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:46.687 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:46.687 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:46.687 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:46.687 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:46.687 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 181669 2024-09-13T06:43:46.687 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:46.687 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:46.687 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:46.688 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:46.688 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.705356+0000", 2024-09-13T06:43:46.688 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:46.688 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:46.688 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:46.688 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:46.688 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.705356+0000", 2024-09-13T06:43:46.688 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:46.688 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:46.688 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:46.688 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:46.688 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.705356+0000", 2024-09-13T06:43:46.689 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:46.689 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:46.689 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:46.689 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:46.689 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.705360+0000", 2024-09-13T06:43:46.689 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.0069999999999999e-06 2024-09-13T06:43:46.689 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:46.689 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:46.689 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:46.689 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.705368+0000", 2024-09-13T06:43:46.689 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.3639999999999999e-06 2024-09-13T06:43:46.689 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:46.689 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:46.690 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:46.690 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.705375+0000", 2024-09-13T06:43:46.690 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.8839999999999997e-06 2024-09-13T06:43:46.690 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:46.690 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:46.690 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:46.690 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.706716+0000", 2024-09-13T06:43:46.690 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0013414589999999999 2024-09-13T06:43:46.690 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:46.690 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:46.690 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:43:46.690 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.706726+0000", 2024-09-13T06:43:46.690 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.5079999999999994e-06 2024-09-13T06:43:46.691 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:46.691 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:46.691 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:46.691 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:46.410966+0000", 2024-09-13T06:43:46.691 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.70424025800000001 2024-09-13T06:43:46.691 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:46.691 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:46.691 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:46.691 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:46.411099+0000", 2024-09-13T06:43:46.691 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000132395 2024-09-13T06:43:46.691 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:46.691 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:46.691 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:46.692 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:46.411196+0000", 2024-09-13T06:43:46.692 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.7344999999999997e-05 2024-09-13T06:43:46.692 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:46.692 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:46.692 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:46.692 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:46.692 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:46.692 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:181683 3.1b 3:dbd5e871:::rbd_data.11218aab7a9c.0000000000000003:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e203)", 2024-09-13T06:43:46.692 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:42:45.705404+0000", 2024-09-13T06:43:46.692 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 60.916178649999999, 2024-09-13T06:43:46.692 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.70639211899999999, 2024-09-13T06:43:46.692 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:46.692 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:46.693 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:46.693 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:46.693 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:46.693 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 181683 2024-09-13T06:43:46.693 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:46.693 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:46.693 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:46.693 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:46.694 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.705404+0000", 2024-09-13T06:43:46.694 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:46.694 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:46.694 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:46.694 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:46.694 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.705404+0000", 2024-09-13T06:43:46.694 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:46.695 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:46.695 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:46.695 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:46.695 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.705403+0000", 2024-09-13T06:43:46.695 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:46.695 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:46.695 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:46.695 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:46.695 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.705406+0000", 2024-09-13T06:43:46.695 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.1499999999999999e-06 2024-09-13T06:43:46.695 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:46.695 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:46.695 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:46.696 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.705414+0000", 2024-09-13T06:43:46.696 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4259999999999997e-06 2024-09-13T06:43:46.696 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:46.696 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:46.696 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:46.696 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.705420+0000", 2024-09-13T06:43:46.696 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.4339999999999997e-06 2024-09-13T06:43:46.696 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:46.696 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:46.696 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:46.696 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.706753+0000", 2024-09-13T06:43:46.696 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0013326939999999999 2024-09-13T06:43:46.696 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:46.697 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:46.697 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:43:46.697 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.706762+0000", 2024-09-13T06:43:46.697 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.2439999999999999e-06 2024-09-13T06:43:46.697 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:46.697 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:46.697 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:46.697 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:46.411391+0000", 2024-09-13T06:43:46.697 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.70462912099999997 2024-09-13T06:43:46.697 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:46.697 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:46.697 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:46.697 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:46.411584+0000", 2024-09-13T06:43:46.698 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00019283399999999999 2024-09-13T06:43:46.698 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:46.698 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:46.698 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:46.698 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:46.411796+0000", 2024-09-13T06:43:46.698 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00021175299999999999 2024-09-13T06:43:46.698 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:46.698 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:46.698 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:46.698 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:46.698 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:46.698 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:181697 3.1b 3:dbd5e871:::rbd_data.11218aab7a9c.0000000000000003:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e203)", 2024-09-13T06:43:46.698 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:42:45.705447+0000", 2024-09-13T06:43:46.698 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 60.916134999999997, 2024-09-13T06:43:46.699 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.70668603500000005, 2024-09-13T06:43:46.699 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:46.699 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:46.699 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:46.699 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:46.699 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:46.699 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 181697 2024-09-13T06:43:46.699 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:46.699 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:46.699 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:46.699 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:46.699 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.705447+0000", 2024-09-13T06:43:46.699 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:46.700 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:46.700 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:46.700 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:46.700 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.705447+0000", 2024-09-13T06:43:46.700 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:46.700 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:46.700 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:46.700 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:46.700 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.705447+0000", 2024-09-13T06:43:46.700 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:46.700 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:46.700 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:46.700 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:46.701 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.705450+0000", 2024-09-13T06:43:46.701 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.8830000000000002e-06 2024-09-13T06:43:46.701 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:46.701 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:46.701 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:46.701 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.705457+0000", 2024-09-13T06:43:46.701 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.097e-06 2024-09-13T06:43:46.701 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:46.701 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:46.701 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:46.701 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.705463+0000", 2024-09-13T06:43:46.701 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.2439999999999998e-06 2024-09-13T06:43:46.701 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:46.702 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:46.702 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:46.702 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.706790+0000", 2024-09-13T06:43:46.702 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.001326823 2024-09-13T06:43:46.702 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:46.702 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:46.702 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:43:46.702 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.706799+0000", 2024-09-13T06:43:46.702 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.3249999999999997e-06 2024-09-13T06:43:46.702 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:46.702 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:46.702 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:46.702 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:46.411884+0000", 2024-09-13T06:43:46.702 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.70508501599999995 2024-09-13T06:43:46.703 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:46.703 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:46.703 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:46.703 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:46.412010+0000", 2024-09-13T06:43:46.703 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000125635 2024-09-13T06:43:46.703 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:46.703 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:46.703 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:46.703 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:46.412133+0000", 2024-09-13T06:43:46.703 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000123492 2024-09-13T06:43:46.703 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:46.703 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:46.703 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:46.704 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:46.704 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:46.704 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:181711 3.1b 3:dbd5e871:::rbd_data.11218aab7a9c.0000000000000003:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e203)", 2024-09-13T06:43:46.704 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:42:45.705496+0000", 2024-09-13T06:43:46.704 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 60.916086436999997, 2024-09-13T06:43:46.704 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.70714611199999999, 2024-09-13T06:43:46.704 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:46.704 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:46.704 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:46.704 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:46.704 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:46.704 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 181711 2024-09-13T06:43:46.705 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:46.705 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:46.705 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:46.705 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:46.705 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.705496+0000", 2024-09-13T06:43:46.705 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:46.705 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:46.705 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:46.705 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:46.705 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.705496+0000", 2024-09-13T06:43:46.706 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:46.706 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:46.706 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:46.706 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:46.706 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.705495+0000", 2024-09-13T06:43:46.706 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:46.706 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:46.706 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:46.706 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:46.706 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.705499+0000", 2024-09-13T06:43:46.706 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.1109999999999999e-06 2024-09-13T06:43:46.706 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:46.706 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:46.707 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:46.707 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.705506+0000", 2024-09-13T06:43:46.707 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.8830000000000006e-06 2024-09-13T06:43:46.707 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:46.707 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:46.707 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:46.707 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.705513+0000", 2024-09-13T06:43:46.707 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.2500000000000003e-06 2024-09-13T06:43:46.707 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:46.707 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:46.707 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:46.707 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.706828+0000", 2024-09-13T06:43:46.707 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0013155840000000001 2024-09-13T06:43:46.708 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:46.708 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:46.708 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:43:46.708 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.706837+0000", 2024-09-13T06:43:46.708 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.0489999999999993e-06 2024-09-13T06:43:46.708 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:46.708 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:46.708 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:46.708 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:46.412223+0000", 2024-09-13T06:43:46.708 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.70538530799999999 2024-09-13T06:43:46.708 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:46.708 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:46.708 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:46.709 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:46.412418+0000", 2024-09-13T06:43:46.709 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000195331 2024-09-13T06:43:46.709 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:46.709 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:46.709 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:46.709 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:46.412642+0000", 2024-09-13T06:43:46.709 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00022410099999999999 2024-09-13T06:43:46.709 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:46.709 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:46.709 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:46.709 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:46.709 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:46.709 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:181725 3.1b 3:dbd5e871:::rbd_data.11218aab7a9c.0000000000000003:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e203)", 2024-09-13T06:43:46.709 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:42:45.706863+0000", 2024-09-13T06:43:46.710 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 60.914719392999999, 2024-09-13T06:43:46.710 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.70631271699999998, 2024-09-13T06:43:46.710 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:46.710 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:46.710 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:46.710 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:46.710 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:46.710 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 181725 2024-09-13T06:43:46.710 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:46.710 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:46.710 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:46.710 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:46.710 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.706863+0000", 2024-09-13T06:43:46.711 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:46.711 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:46.711 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:46.711 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:46.711 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.706863+0000", 2024-09-13T06:43:46.711 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:46.711 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:46.711 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:46.711 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:46.711 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.706862+0000", 2024-09-13T06:43:46.711 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.999999 2024-09-13T06:43:46.711 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:46.711 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:46.712 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:46.712 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.706869+0000", 2024-09-13T06:43:46.712 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.0899999999999999e-06 2024-09-13T06:43:46.712 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:46.712 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:46.712 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:46.712 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.706881+0000", 2024-09-13T06:43:46.712 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1727e-05 2024-09-13T06:43:46.712 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:46.712 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:46.712 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:46.712 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.706891+0000", 2024-09-13T06:43:46.712 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.9399999999999997e-06 2024-09-13T06:43:46.713 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:46.713 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:46.713 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:46.713 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.706952+0000", 2024-09-13T06:43:46.713 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.1106999999999996e-05 2024-09-13T06:43:46.713 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:46.713 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:46.713 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:43:46.713 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.706966+0000", 2024-09-13T06:43:46.713 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4173e-05 2024-09-13T06:43:46.713 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:46.713 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:46.714 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:46.714 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:46.412754+0000", 2024-09-13T06:43:46.714 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.70578759999999996 2024-09-13T06:43:46.714 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:46.714 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:46.714 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:46.714 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:46.412967+0000", 2024-09-13T06:43:46.714 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00021290999999999999 2024-09-13T06:43:46.714 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:46.714 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:46.714 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:46.714 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:46.413176+0000", 2024-09-13T06:43:46.714 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00020922099999999999 2024-09-13T06:43:46.715 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:46.715 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:46.715 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:46.715 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:46.715 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:46.715 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:181739 3.1b 3:dbd5e871:::rbd_data.11218aab7a9c.0000000000000003:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e203)", 2024-09-13T06:43:46.715 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:42:45.706937+0000", 2024-09-13T06:43:46.715 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 60.914645182000001, 2024-09-13T06:43:46.715 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.70679418800000005, 2024-09-13T06:43:46.715 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:46.715 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:46.715 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:46.715 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:46.716 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:46.716 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 181739 2024-09-13T06:43:46.716 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:46.716 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:46.716 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:46.716 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:46.716 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.706937+0000", 2024-09-13T06:43:46.716 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:46.716 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:46.716 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:46.716 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:46.716 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.706937+0000", 2024-09-13T06:43:46.716 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:46.716 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:46.716 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:46.717 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:46.717 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.706937+0000", 2024-09-13T06:43:46.717 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:46.717 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:46.717 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:46.717 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:46.717 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.706940+0000", 2024-09-13T06:43:46.717 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.4290000000000001e-06 2024-09-13T06:43:46.717 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:46.717 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:46.717 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:46.717 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.706949+0000", 2024-09-13T06:43:46.717 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.7730000000000005e-06 2024-09-13T06:43:46.717 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:46.718 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:46.718 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:46.718 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.706956+0000", 2024-09-13T06:43:46.718 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4240000000000004e-06 2024-09-13T06:43:46.718 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:46.718 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:46.718 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:46.718 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.706999+0000", 2024-09-13T06:43:46.718 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.2410999999999998e-05 2024-09-13T06:43:46.718 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:46.718 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:46.718 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:43:46.718 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.707011+0000", 2024-09-13T06:43:46.718 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2140999999999999e-05 2024-09-13T06:43:46.719 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:46.719 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:46.719 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:46.719 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:46.413278+0000", 2024-09-13T06:43:46.719 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.70626747199999995 2024-09-13T06:43:46.719 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:46.719 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:46.719 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:46.719 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:46.413471+0000", 2024-09-13T06:43:46.719 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00019234699999999999 2024-09-13T06:43:46.719 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:46.719 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:46.719 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:46.719 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:46.413731+0000", 2024-09-13T06:43:46.719 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00026069 2024-09-13T06:43:46.720 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:46.720 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:46.720 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:46.720 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:46.720 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:46.720 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:181753 3.1b 3:dbd5e871:::rbd_data.11218aab7a9c.0000000000000003:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e203)", 2024-09-13T06:43:46.720 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:42:45.706987+0000", 2024-09-13T06:43:46.720 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 60.914595099000003, 2024-09-13T06:43:46.720 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.70721309200000004, 2024-09-13T06:43:46.720 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:46.720 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:46.720 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:46.720 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:46.721 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:46.721 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 181753 2024-09-13T06:43:46.721 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:46.721 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:46.721 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:46.721 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:46.721 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.706987+0000", 2024-09-13T06:43:46.721 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:46.721 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:46.721 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:46.721 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:46.721 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.706987+0000", 2024-09-13T06:43:46.721 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:46.721 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:46.722 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:46.722 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:46.722 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.706987+0000", 2024-09-13T06:43:46.722 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:46.722 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:46.722 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:46.722 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:46.722 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.706990+0000", 2024-09-13T06:43:46.722 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.0759999999999999e-06 2024-09-13T06:43:46.722 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:46.722 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:46.722 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:46.722 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.706997+0000", 2024-09-13T06:43:46.722 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5809999999999999e-06 2024-09-13T06:43:46.723 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:46.723 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:46.723 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:46.723 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.707004+0000", 2024-09-13T06:43:46.723 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.7839999999999998e-06 2024-09-13T06:43:46.723 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:46.723 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:46.723 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:46.723 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.707046+0000", 2024-09-13T06:43:46.723 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.1474999999999998e-05 2024-09-13T06:43:46.723 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:46.723 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:46.723 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:43:46.724 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.707056+0000", 2024-09-13T06:43:46.724 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0825000000000001e-05 2024-09-13T06:43:46.724 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:46.724 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:46.724 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:46.724 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:46.413797+0000", 2024-09-13T06:43:46.724 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.70674101099999997 2024-09-13T06:43:46.724 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:46.724 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:46.724 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:46.724 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:46.413998+0000", 2024-09-13T06:43:46.724 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00020058700000000001 2024-09-13T06:43:46.724 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:46.725 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:46.725 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:46.725 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:46.414200+0000", 2024-09-13T06:43:46.725 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00020238400000000001 2024-09-13T06:43:46.725 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:46.725 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:46.725 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:46.725 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:46.725 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:46.725 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:43:46.726 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-13T06:43:46.727 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-13T06:43:46.728 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:43:46.728+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:43:46.829 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:43:46.827+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:43:46.896 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:43:46.896 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-13T06:43:46.896 INFO:teuthology.orchestra.run.smithi081.stdout: "num_ops": 0 2024-09-13T06:43:46.896 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:43:46.906 INFO:teuthology.orchestra.run.smithi081.stdout:osd.0: {} 2024-09-13T06:43:46.906 INFO:teuthology.orchestra.run.smithi081.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-13T06:43:46.910 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-13T06:43:46.923 INFO:teuthology.orchestra.run.smithi081.stdout:osd.1: {} 2024-09-13T06:43:46.923 INFO:teuthology.orchestra.run.smithi081.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-13T06:43:46.929 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:43:46.928+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:43:46.941 INFO:teuthology.orchestra.run.smithi081.stdout:osd.2: {} 2024-09-13T06:43:46.941 INFO:teuthology.orchestra.run.smithi081.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-13T06:43:46.957 INFO:teuthology.orchestra.run.smithi081.stdout:osd.3: {} 2024-09-13T06:43:46.957 INFO:teuthology.orchestra.run.smithi081.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-13T06:43:46.977 INFO:teuthology.orchestra.run.smithi081.stdout:osd.4: {} 2024-09-13T06:43:46.977 INFO:teuthology.orchestra.run.smithi081.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-13T06:43:46.997 INFO:teuthology.orchestra.run.smithi081.stdout:osd.5: {} 2024-09-13T06:43:46.997 INFO:teuthology.orchestra.run.smithi081.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-13T06:43:46.997 INFO:teuthology.orchestra.run.smithi081.stderr:Error ENXIO: problem getting command descriptions from osd.6 2024-09-13T06:43:47.020 INFO:teuthology.orchestra.run.smithi081.stdout:osd.7: {} 2024-09-13T06:43:47.020 INFO:teuthology.orchestra.run.smithi081.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-13T06:43:47.021 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-13T06:43:47.022 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-13T06:43:47.037 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:43:47.037 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:43:47.037 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:43:47.035+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:43:47.050 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-13T06:43:47.142 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:43:47.143+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:43:47.224 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:43:47.224 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:43:47.232 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:43:47.232+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:43:47.236 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-13T06:43:47.333 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:43:47.331+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:43:47.395 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:43:47.395 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:43:47.409 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-13T06:43:47.450 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:43:47.451+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:43:47.499 INFO:teuthology.orchestra.run.smithi081.stderr:nodeep-scrub is unset 2024-09-13T06:43:47.535 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:43:47.532+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:43:47.587 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:43:47.587 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:43:47.603 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-13T06:43:47.646 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:43:47.647+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:43:47.722 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:43:47.722 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:43:47.736 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-13T06:43:47.737 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:43:47.736+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:43:47.837 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:43:47.835+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:43:47.899 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:43:47.899 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:43:47.913 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-13T06:43:47.954 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:43:47.955+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:43:48.039 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:43:48.036+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:43:48.070 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:43:48.070 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:43:48.084 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-13T06:43:48.140 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:43:48.139+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:43:48.199 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:43:48.200 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:43:48.214 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-13T06:43:48.254 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:43:48.255+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:43:48.342 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:43:48.340+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:43:48.347 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:43:48.348 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:43:48.362 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-13T06:43:48.443 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:43:48.443+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:43:48.525 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:43:48.526 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:43:48.542 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-13T06:43:48.543 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:43:48.543+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:43:48.644 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:43:48.643+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:43:48.677 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:43:48.678 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:43:48.695 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-13T06:43:48.745 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:43:48.744+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:43:48.819 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:43:48.819 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:43:48.834 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-13T06:43:48.876 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:43:48.876+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:43:48.948 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:43:48.947+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:43:48.994 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:43:48.994 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:43:49.009 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-13T06:43:49.023 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-13T06:43:49.070 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:43:49.071+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:43:49.132 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:43:49.132 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:43:49.146 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-13T06:43:49.149 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:43:49.147+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:43:49.176 INFO:teuthology.orchestra.run.smithi081.stdout:osd.0: {} 2024-09-13T06:43:49.177 INFO:teuthology.orchestra.run.smithi081.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-13T06:43:49.192 INFO:teuthology.orchestra.run.smithi081.stdout:osd.1: {} 2024-09-13T06:43:49.193 INFO:teuthology.orchestra.run.smithi081.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-13T06:43:49.209 INFO:teuthology.orchestra.run.smithi081.stdout:osd.2: {} 2024-09-13T06:43:49.209 INFO:teuthology.orchestra.run.smithi081.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-13T06:43:49.226 INFO:teuthology.orchestra.run.smithi081.stdout:osd.3: {} 2024-09-13T06:43:49.227 INFO:teuthology.orchestra.run.smithi081.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-13T06:43:49.246 INFO:teuthology.orchestra.run.smithi081.stdout:osd.4: {} 2024-09-13T06:43:49.246 INFO:teuthology.orchestra.run.smithi081.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-13T06:43:49.250 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:43:49.247+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:43:49.267 INFO:teuthology.orchestra.run.smithi081.stdout:osd.5: {} 2024-09-13T06:43:49.267 INFO:teuthology.orchestra.run.smithi081.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-13T06:43:49.267 INFO:teuthology.orchestra.run.smithi081.stderr:Error ENXIO: problem getting command descriptions from osd.6 2024-09-13T06:43:49.268 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:43:49.268 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:43:49.283 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-13T06:43:49.287 INFO:teuthology.orchestra.run.smithi081.stdout:osd.7: {} 2024-09-13T06:43:49.287 INFO:teuthology.orchestra.run.smithi081.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-13T06:43:49.293 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-13T06:43:49.294 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-13T06:43:49.351 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:43:49.351+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:43:49.400 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:43:49.400 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [], 2024-09-13T06:43:49.400 INFO:teuthology.orchestra.run.smithi139.stdout: "complaint_time": 30, 2024-09-13T06:43:49.400 INFO:teuthology.orchestra.run.smithi139.stdout: "num_blocked_ops": 0 2024-09-13T06:43:49.400 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:43:49.415 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-13T06:43:49.459 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:43:49.460+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:43:49.523 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-13T06:43:49.539 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:43:49.539 INFO:teuthology.orchestra.run.smithi139.stdout: "size": 20, 2024-09-13T06:43:49.540 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 600, 2024-09-13T06:43:49.540 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [ 2024-09-13T06:43:49.540 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:49.540 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:176089 3.11 3:8b97f15f:::rbd_data.1121a23b99f7.0000000000000000:head [write 0~4194304 [fadvise_sequential+fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e196)", 2024-09-13T06:43:49.540 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:42:36.707298+0000", 2024-09-13T06:43:49.540 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 72.832359737000004, 2024-09-13T06:43:49.540 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.053333426000000003, 2024-09-13T06:43:49.540 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:49.540 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:43:49.540 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:49.540 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:49.540 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:49.541 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 176089 2024-09-13T06:43:49.541 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:49.541 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:49.541 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:49.541 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:49.541 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.707298+0000", 2024-09-13T06:43:49.541 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:49.541 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:49.541 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:49.541 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:49.541 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.707298+0000", 2024-09-13T06:43:49.541 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:49.542 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:49.542 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:49.542 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:49.542 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.707296+0000", 2024-09-13T06:43:49.542 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999976 2024-09-13T06:43:49.542 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:49.542 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:49.542 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:49.542 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.717511+0000", 2024-09-13T06:43:49.542 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.010215218999999999 2024-09-13T06:43:49.542 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:49.542 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:49.542 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:49.543 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.717555+0000", 2024-09-13T06:43:49.543 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.4159000000000002e-05 2024-09-13T06:43:49.543 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:49.543 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:49.543 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:49.543 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.717569+0000", 2024-09-13T06:43:49.543 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3543999999999999e-05 2024-09-13T06:43:49.543 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:49.543 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:49.543 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:49.543 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.717677+0000", 2024-09-13T06:43:49.543 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00010798699999999999 2024-09-13T06:43:49.543 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:49.544 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:49.544 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:49.544 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.717896+0000", 2024-09-13T06:43:49.544 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000219466 2024-09-13T06:43:49.544 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:49.544 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:49.544 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 4", 2024-09-13T06:43:49.544 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.718090+0000", 2024-09-13T06:43:49.544 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00019322799999999999 2024-09-13T06:43:49.544 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:49.544 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:49.544 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:43:49.544 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.751403+0000", 2024-09-13T06:43:49.545 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.033313493 2024-09-13T06:43:49.545 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:49.545 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:49.545 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-13T06:43:49.545 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.760523+0000", 2024-09-13T06:43:49.545 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0091197150000000005 2024-09-13T06:43:49.545 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:49.545 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:49.545 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-13T06:43:49.545 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.760581+0000", 2024-09-13T06:43:49.545 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.8007999999999998e-05 2024-09-13T06:43:49.545 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:49.545 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:49.546 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:49.546 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.760632+0000", 2024-09-13T06:43:49.546 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.1085999999999998e-05 2024-09-13T06:43:49.546 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:49.546 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:49.546 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:49.546 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:49.546 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:49.546 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:176090 3.e 3:77f86bf9:::rbd_data.1121a23b99f7.0000000000000001:head [write 0~4194304 [fadvise_sequential+fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e196)", 2024-09-13T06:43:49.546 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:42:36.717590+0000", 2024-09-13T06:43:49.546 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 72.822068255000005, 2024-09-13T06:43:49.546 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.049445965000000001, 2024-09-13T06:43:49.546 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:49.546 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:43:49.546 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:49.547 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:49.547 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:49.547 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 176090 2024-09-13T06:43:49.547 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:49.547 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:49.547 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:49.547 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:49.547 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.717590+0000", 2024-09-13T06:43:49.547 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:49.547 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:49.547 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:49.547 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:49.547 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.717590+0000", 2024-09-13T06:43:49.547 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:49.547 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:49.548 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:49.548 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:49.548 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.717588+0000", 2024-09-13T06:43:49.548 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999981 2024-09-13T06:43:49.548 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:49.548 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:49.548 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:49.548 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.723934+0000", 2024-09-13T06:43:49.548 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0063462589999999999 2024-09-13T06:43:49.548 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:49.548 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:49.548 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:49.548 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.723960+0000", 2024-09-13T06:43:49.549 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.6251e-05 2024-09-13T06:43:49.549 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:49.549 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:49.549 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:49.549 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.723976+0000", 2024-09-13T06:43:49.549 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5277e-05 2024-09-13T06:43:49.549 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:49.549 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:49.549 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:49.549 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.724154+0000", 2024-09-13T06:43:49.549 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00017814400000000001 2024-09-13T06:43:49.549 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:49.549 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:49.549 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:49.550 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.724534+0000", 2024-09-13T06:43:49.550 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00038054799999999998 2024-09-13T06:43:49.550 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:49.550 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:49.550 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-13T06:43:49.550 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.724926+0000", 2024-09-13T06:43:49.550 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00039199100000000001 2024-09-13T06:43:49.550 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:49.550 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:49.550 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:43:49.550 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.744509+0000", 2024-09-13T06:43:49.550 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.019582977000000001 2024-09-13T06:43:49.551 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:49.551 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:49.551 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-13T06:43:49.551 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.766937+0000", 2024-09-13T06:43:49.551 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.022427765999999998 2024-09-13T06:43:49.551 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:49.551 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:49.551 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-13T06:43:49.551 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.766987+0000", 2024-09-13T06:43:49.551 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.9898000000000002e-05 2024-09-13T06:43:49.551 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:49.551 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:49.551 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:49.551 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.767036+0000", 2024-09-13T06:43:49.552 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.8782000000000002e-05 2024-09-13T06:43:49.552 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:49.552 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:49.552 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:49.552 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:49.552 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:49.552 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:176094 3.f 3:f5ca80c1:::rbd_data.1121a23b99f7.0000000000000004:head [write 0~4194304 [fadvise_sequential+fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e196)", 2024-09-13T06:43:49.552 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:42:36.724239+0000", 2024-09-13T06:43:49.552 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 72.815419155000001, 2024-09-13T06:43:49.552 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.043501235999999999, 2024-09-13T06:43:49.552 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:49.552 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:43:49.552 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:49.553 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:49.553 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:49.553 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 176094 2024-09-13T06:43:49.553 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:49.553 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:49.553 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:49.553 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:49.553 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.724239+0000", 2024-09-13T06:43:49.553 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:49.553 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:49.553 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:49.553 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:49.553 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.724239+0000", 2024-09-13T06:43:49.553 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:49.554 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:49.554 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:49.554 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:49.554 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.724237+0000", 2024-09-13T06:43:49.554 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999981 2024-09-13T06:43:49.554 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:49.554 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:49.554 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:49.554 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.733673+0000", 2024-09-13T06:43:49.554 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0094352700000000008 2024-09-13T06:43:49.554 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:49.554 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:49.554 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:49.554 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.733703+0000", 2024-09-13T06:43:49.555 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.0102000000000001e-05 2024-09-13T06:43:49.555 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:49.555 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:49.555 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:49.555 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.733718+0000", 2024-09-13T06:43:49.555 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5199e-05 2024-09-13T06:43:49.555 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:49.555 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:49.555 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:49.555 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.733780+0000", 2024-09-13T06:43:49.555 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.1691000000000003e-05 2024-09-13T06:43:49.555 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:49.555 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:49.555 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:49.556 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.733928+0000", 2024-09-13T06:43:49.556 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000147987 2024-09-13T06:43:49.556 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:49.556 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:49.556 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 4", 2024-09-13T06:43:49.556 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.734036+0000", 2024-09-13T06:43:49.556 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000108925 2024-09-13T06:43:49.556 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:49.556 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:49.556 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:43:49.556 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.763741+0000", 2024-09-13T06:43:49.556 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.029704151000000002 2024-09-13T06:43:49.556 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:49.556 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:49.557 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-13T06:43:49.557 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.767615+0000", 2024-09-13T06:43:49.557 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0038739120000000002 2024-09-13T06:43:49.557 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:49.557 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:49.557 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-13T06:43:49.557 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.767693+0000", 2024-09-13T06:43:49.557 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.8573999999999997e-05 2024-09-13T06:43:49.557 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:49.557 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:49.557 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:49.557 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.767740+0000", 2024-09-13T06:43:49.557 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.7154000000000003e-05 2024-09-13T06:43:49.558 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:49.558 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:49.558 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:49.558 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:49.558 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:49.558 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:205233 3.15 3:a97b2891:::rbd_data.11213650bb32.000000000000002e:head [set-alloc-hint object_size 4194304 write_size 4194304,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e209)", 2024-09-13T06:43:49.558 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:42:52.282586+0000", 2024-09-13T06:43:49.558 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 57.257072311000002, 2024-09-13T06:43:49.558 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.056996628000000001, 2024-09-13T06:43:49.558 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:49.558 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:43:49.558 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:49.558 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:49.559 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:49.559 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 205233 2024-09-13T06:43:49.559 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:49.559 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:49.559 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:49.559 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:49.559 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:52.282586+0000", 2024-09-13T06:43:49.559 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:49.559 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:49.559 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:49.559 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:49.559 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:52.282586+0000", 2024-09-13T06:43:49.560 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:49.560 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:49.560 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:49.560 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:49.560 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:52.282583+0000", 2024-09-13T06:43:49.560 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999976 2024-09-13T06:43:49.560 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:49.560 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:49.560 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:49.560 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:52.282599+0000", 2024-09-13T06:43:49.560 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5065999999999999e-05 2024-09-13T06:43:49.560 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:49.560 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:49.560 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:49.561 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:52.282632+0000", 2024-09-13T06:43:49.561 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.3386999999999997e-05 2024-09-13T06:43:49.561 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:49.561 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:49.561 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:49.561 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:52.282654+0000", 2024-09-13T06:43:49.561 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.177e-05 2024-09-13T06:43:49.561 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:49.561 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:49.561 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:49.561 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:52.282753+0000", 2024-09-13T06:43:49.561 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.9685000000000005e-05 2024-09-13T06:43:49.561 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:49.562 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:49.562 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:49.562 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:52.283000+0000", 2024-09-13T06:43:49.562 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000246278 2024-09-13T06:43:49.562 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:49.562 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:49.562 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 3", 2024-09-13T06:43:49.562 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:52.292656+0000", 2024-09-13T06:43:49.562 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0096565980000000006 2024-09-13T06:43:49.562 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:49.562 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:49.562 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:43:49.562 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:52.339352+0000", 2024-09-13T06:43:49.563 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.046695309999999997 2024-09-13T06:43:49.563 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:49.563 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:49.563 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-13T06:43:49.563 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:52.339373+0000", 2024-09-13T06:43:49.563 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.1002999999999999e-05 2024-09-13T06:43:49.563 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:49.563 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:49.563 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-13T06:43:49.563 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:52.339464+0000", 2024-09-13T06:43:49.563 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.1131999999999994e-05 2024-09-13T06:43:49.563 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:49.563 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:49.564 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:49.564 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:52.339582+0000", 2024-09-13T06:43:49.564 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000118799 2024-09-13T06:43:49.564 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:49.564 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:49.564 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:49.564 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:49.564 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:49.564 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:237445 3.15 3:abdd9d42:::rbd_data.1121cb4a09ed.0000000000000008:82 [read 69632~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e224)", 2024-09-13T06:43:49.564 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:43:08.800334+0000", 2024-09-13T06:43:49.564 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 40.739323902999999, 2024-09-13T06:43:49.564 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.032345681000000001, 2024-09-13T06:43:49.564 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:49.565 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:49.565 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:49.565 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:49.565 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:49.565 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 237445 2024-09-13T06:43:49.565 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:49.565 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:49.565 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:49.565 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:49.565 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800334+0000", 2024-09-13T06:43:49.565 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:49.565 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:49.565 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:49.566 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:49.566 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800334+0000", 2024-09-13T06:43:49.566 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:49.566 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:49.566 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:49.566 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:49.566 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800334+0000", 2024-09-13T06:43:49.566 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:49.566 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:49.566 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:49.566 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:49.566 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800338+0000", 2024-09-13T06:43:49.566 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.9539999999999998e-06 2024-09-13T06:43:49.567 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:49.567 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:49.567 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:49.567 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800342+0000", 2024-09-13T06:43:49.567 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.7249999999999999e-06 2024-09-13T06:43:49.567 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:49.567 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:49.567 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:49.567 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800345+0000", 2024-09-13T06:43:49.567 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.072e-06 2024-09-13T06:43:49.567 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:49.567 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:49.567 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:49.568 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.832482+0000", 2024-09-13T06:43:49.568 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.032137713999999998 2024-09-13T06:43:49.568 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:49.568 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:49.568 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:49.568 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.832571+0000", 2024-09-13T06:43:49.568 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.8252999999999997e-05 2024-09-13T06:43:49.568 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:49.568 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:49.568 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:49.568 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.832680+0000", 2024-09-13T06:43:49.568 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000109214 2024-09-13T06:43:49.568 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:49.568 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:49.569 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:49.569 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:49.569 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:49.569 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:237446 3.15 3:abdd9d42:::rbd_data.1121cb4a09ed.0000000000000008:82 [read 81920~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e224)", 2024-09-13T06:43:49.569 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:43:08.800348+0000", 2024-09-13T06:43:49.569 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 40.739310502999999, 2024-09-13T06:43:49.569 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.032454446999999997, 2024-09-13T06:43:49.569 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:49.569 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:49.569 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:49.569 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:49.569 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:49.569 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 237446 2024-09-13T06:43:49.569 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:49.570 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:49.570 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:49.570 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:49.570 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800348+0000", 2024-09-13T06:43:49.570 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:49.570 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:49.570 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:49.570 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:49.570 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800348+0000", 2024-09-13T06:43:49.570 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:49.570 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:49.570 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:49.570 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:49.570 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800347+0000", 2024-09-13T06:43:49.571 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:49.571 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:49.571 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:49.571 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:49.571 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800349+0000", 2024-09-13T06:43:49.571 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.452e-06 2024-09-13T06:43:49.571 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:49.571 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:49.571 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:49.571 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800354+0000", 2024-09-13T06:43:49.571 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.0350000000000001e-06 2024-09-13T06:43:49.571 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:49.571 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:49.571 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:49.572 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800357+0000", 2024-09-13T06:43:49.572 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.179e-06 2024-09-13T06:43:49.572 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:49.572 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:49.572 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:49.572 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.832707+0000", 2024-09-13T06:43:49.572 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.032350071000000001 2024-09-13T06:43:49.572 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:49.572 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:49.572 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:49.572 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.832748+0000", 2024-09-13T06:43:49.572 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0587000000000003e-05 2024-09-13T06:43:49.573 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:49.573 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:49.573 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:49.573 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.832802+0000", 2024-09-13T06:43:49.573 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.4429999999999999e-05 2024-09-13T06:43:49.573 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:49.573 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:49.573 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:49.573 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:49.573 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:49.573 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:237447 3.15 3:abdd9d42:::rbd_data.1121cb4a09ed.0000000000000008:82 [read 94208~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e224)", 2024-09-13T06:43:49.573 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:43:08.800360+0000", 2024-09-13T06:43:49.573 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 40.739298591000001, 2024-09-13T06:43:49.574 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.032679798000000003, 2024-09-13T06:43:49.574 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:49.574 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:49.574 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:49.574 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:49.574 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:49.574 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 237447 2024-09-13T06:43:49.574 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:49.574 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:49.574 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:49.574 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:49.574 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800360+0000", 2024-09-13T06:43:49.574 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:49.575 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:49.575 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:49.575 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:49.575 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800360+0000", 2024-09-13T06:43:49.575 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:49.575 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:49.575 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:49.575 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:49.575 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800359+0000", 2024-09-13T06:43:49.575 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:49.576 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:49.576 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:49.576 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:49.576 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800361+0000", 2024-09-13T06:43:49.576 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.463e-06 2024-09-13T06:43:49.576 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:49.576 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:49.576 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:49.576 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800364+0000", 2024-09-13T06:43:49.576 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.6279999999999998e-06 2024-09-13T06:43:49.576 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:49.576 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:49.577 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:49.577 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800367+0000", 2024-09-13T06:43:49.577 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.7259999999999998e-06 2024-09-13T06:43:49.577 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:49.577 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:49.577 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:49.577 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.832841+0000", 2024-09-13T06:43:49.577 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.032474115999999997 2024-09-13T06:43:49.577 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:49.578 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:49.578 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:49.578 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.832929+0000", 2024-09-13T06:43:49.578 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.7886000000000005e-05 2024-09-13T06:43:49.578 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:49.578 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:49.578 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:49.578 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.833039+0000", 2024-09-13T06:43:49.578 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00011024200000000001 2024-09-13T06:43:49.578 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:49.578 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:49.578 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:49.579 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:49.579 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:49.579 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:237448 3.15 3:abdd9d42:::rbd_data.1121cb4a09ed.0000000000000008:82 [read 106496~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e224)", 2024-09-13T06:43:49.579 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:43:08.800371+0000", 2024-09-13T06:43:49.579 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 40.739287451999999, 2024-09-13T06:43:49.579 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.032794221999999998, 2024-09-13T06:43:49.579 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:49.579 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:49.579 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:49.579 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:49.579 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:49.579 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 237448 2024-09-13T06:43:49.579 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:49.579 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:49.580 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:49.580 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:49.580 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800371+0000", 2024-09-13T06:43:49.580 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:49.580 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:49.580 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:49.580 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:49.580 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800371+0000", 2024-09-13T06:43:49.580 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:49.580 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:49.580 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:49.580 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:49.580 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800370+0000", 2024-09-13T06:43:49.580 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967296 2024-09-13T06:43:49.581 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:49.581 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:49.581 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:49.581 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800372+0000", 2024-09-13T06:43:49.581 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3510000000000001e-06 2024-09-13T06:43:49.581 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:49.581 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:49.581 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:49.581 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800376+0000", 2024-09-13T06:43:49.581 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.693e-06 2024-09-13T06:43:49.581 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:49.581 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:49.581 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:49.581 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800378+0000", 2024-09-13T06:43:49.582 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.8870000000000001e-06 2024-09-13T06:43:49.582 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:49.582 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:49.582 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:49.582 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.833069+0000", 2024-09-13T06:43:49.582 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.032690708999999998 2024-09-13T06:43:49.582 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:49.582 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:49.582 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:49.582 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.833110+0000", 2024-09-13T06:43:49.582 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.1356999999999997e-05 2024-09-13T06:43:49.582 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:49.582 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:49.582 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:49.583 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.833165+0000", 2024-09-13T06:43:49.583 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.4456999999999997e-05 2024-09-13T06:43:49.583 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:49.583 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:49.583 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:49.583 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:49.583 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:49.583 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:237449 3.15 3:abdd9d42:::rbd_data.1121cb4a09ed.0000000000000008:82 [read 118784~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e224)", 2024-09-13T06:43:49.583 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:43:08.800381+0000", 2024-09-13T06:43:49.583 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 40.739277309999999, 2024-09-13T06:43:49.583 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.033007068000000001, 2024-09-13T06:43:49.583 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:49.583 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:49.583 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:49.583 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:49.584 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:49.584 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 237449 2024-09-13T06:43:49.584 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:49.584 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:49.584 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:49.584 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:49.584 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800381+0000", 2024-09-13T06:43:49.584 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:49.584 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:49.584 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:49.584 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:49.584 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800381+0000", 2024-09-13T06:43:49.584 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:49.584 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:49.585 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:49.585 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:49.585 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800381+0000", 2024-09-13T06:43:49.585 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967296 2024-09-13T06:43:49.585 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:49.585 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:49.585 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:49.585 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800382+0000", 2024-09-13T06:43:49.585 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.395e-06 2024-09-13T06:43:49.585 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:49.585 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:49.585 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:49.585 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800386+0000", 2024-09-13T06:43:49.585 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.574e-06 2024-09-13T06:43:49.586 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:49.586 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:49.586 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:49.586 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800388+0000", 2024-09-13T06:43:49.586 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.8729999999999999e-06 2024-09-13T06:43:49.586 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:49.586 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:49.586 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:49.586 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.833204+0000", 2024-09-13T06:43:49.586 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.032815986999999998 2024-09-13T06:43:49.586 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:49.586 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:49.586 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:49.586 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.833289+0000", 2024-09-13T06:43:49.586 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.4085999999999994e-05 2024-09-13T06:43:49.587 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:49.587 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:49.587 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:49.587 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.833388+0000", 2024-09-13T06:43:49.587 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.9380000000000001e-05 2024-09-13T06:43:49.587 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:49.587 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:49.587 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:49.587 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:49.587 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:49.587 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:237450 3.15 3:abdd9d42:::rbd_data.1121cb4a09ed.0000000000000008:82 [read 131072~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e224)", 2024-09-13T06:43:49.587 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:43:08.800392+0000", 2024-09-13T06:43:49.587 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 40.739265981999999, 2024-09-13T06:43:49.587 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.033110507999999997, 2024-09-13T06:43:49.587 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:49.588 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:49.588 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:49.588 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:49.588 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:49.588 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 237450 2024-09-13T06:43:49.588 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:49.588 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:49.588 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:49.588 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:49.588 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800392+0000", 2024-09-13T06:43:49.588 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:49.588 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:49.588 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:49.588 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:49.589 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800392+0000", 2024-09-13T06:43:49.589 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:49.589 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:49.589 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:49.589 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:49.589 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800392+0000", 2024-09-13T06:43:49.589 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967296 2024-09-13T06:43:49.589 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:49.589 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:49.589 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:49.589 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800393+0000", 2024-09-13T06:43:49.589 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.375e-06 2024-09-13T06:43:49.589 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:49.590 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:49.590 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:49.590 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800397+0000", 2024-09-13T06:43:49.590 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.6109999999999998e-06 2024-09-13T06:43:49.590 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:49.590 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:49.590 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:49.590 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800400+0000", 2024-09-13T06:43:49.590 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.7580000000000001e-06 2024-09-13T06:43:49.590 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:49.590 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:49.590 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:49.591 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.833414+0000", 2024-09-13T06:43:49.591 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.033014767 2024-09-13T06:43:49.591 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:49.591 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:49.591 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:49.591 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.833453+0000", 2024-09-13T06:43:49.591 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.8711000000000003e-05 2024-09-13T06:43:49.591 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:49.591 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:49.591 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:49.591 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.833503+0000", 2024-09-13T06:43:49.591 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.9523e-05 2024-09-13T06:43:49.591 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:49.591 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:49.592 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:49.592 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:49.592 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:49.592 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:237451 3.15 3:abdd9d42:::rbd_data.1121cb4a09ed.0000000000000008:82 [read 143360~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e224)", 2024-09-13T06:43:49.592 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:43:08.800402+0000", 2024-09-13T06:43:49.592 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 40.739256163999997, 2024-09-13T06:43:49.592 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.033337717000000003, 2024-09-13T06:43:49.592 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:49.592 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:49.592 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:49.592 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:49.592 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:49.592 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 237451 2024-09-13T06:43:49.593 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:49.593 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:49.593 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:49.593 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:49.593 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800402+0000", 2024-09-13T06:43:49.593 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:49.593 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:49.593 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:49.593 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:49.593 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800402+0000", 2024-09-13T06:43:49.593 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:49.593 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:49.593 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:49.593 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:49.594 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800402+0000", 2024-09-13T06:43:49.594 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967296 2024-09-13T06:43:49.594 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:49.594 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:49.594 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:49.594 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800403+0000", 2024-09-13T06:43:49.594 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.37e-06 2024-09-13T06:43:49.594 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:49.594 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:49.594 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:49.594 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800407+0000", 2024-09-13T06:43:49.594 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.6820000000000001e-06 2024-09-13T06:43:49.594 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:49.595 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:49.595 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:49.595 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800410+0000", 2024-09-13T06:43:49.595 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.7810000000000001e-06 2024-09-13T06:43:49.595 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:49.595 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:49.595 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:49.595 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.833550+0000", 2024-09-13T06:43:49.595 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.033140192999999998 2024-09-13T06:43:49.595 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:49.595 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:49.595 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:49.595 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.833634+0000", 2024-09-13T06:43:49.595 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.4097000000000005e-05 2024-09-13T06:43:49.596 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:49.596 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:49.596 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:49.596 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.833740+0000", 2024-09-13T06:43:49.596 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00010582300000000001 2024-09-13T06:43:49.596 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:49.596 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:49.596 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:49.596 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:49.596 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:49.596 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:237452 3.15 3:abdd9d42:::rbd_data.1121cb4a09ed.0000000000000008:82 [read 155648~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e224)", 2024-09-13T06:43:49.596 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:43:08.800412+0000", 2024-09-13T06:43:49.596 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 40.739246207999997, 2024-09-13T06:43:49.596 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.033496535000000001, 2024-09-13T06:43:49.597 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:49.597 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:49.597 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:49.597 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:49.597 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:49.597 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 237452 2024-09-13T06:43:49.597 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:49.597 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:49.597 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:49.597 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:49.597 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800412+0000", 2024-09-13T06:43:49.597 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:49.597 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:49.598 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:49.598 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:49.598 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800412+0000", 2024-09-13T06:43:49.598 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:49.598 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:49.598 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:49.598 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:49.598 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800412+0000", 2024-09-13T06:43:49.598 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967296 2024-09-13T06:43:49.598 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:49.598 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:49.598 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:49.598 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800413+0000", 2024-09-13T06:43:49.599 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.342e-06 2024-09-13T06:43:49.599 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:49.599 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:49.599 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:49.599 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800417+0000", 2024-09-13T06:43:49.599 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.6480000000000001e-06 2024-09-13T06:43:49.599 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:49.599 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:49.599 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:49.599 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800419+0000", 2024-09-13T06:43:49.599 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.7920000000000001e-06 2024-09-13T06:43:49.599 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:49.599 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:49.599 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:49.600 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.833768+0000", 2024-09-13T06:43:49.600 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.033348587999999998 2024-09-13T06:43:49.600 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:49.600 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:49.600 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:49.600 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.833836+0000", 2024-09-13T06:43:49.600 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.8090999999999996e-05 2024-09-13T06:43:49.600 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:49.600 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:49.600 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:49.600 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.833908+0000", 2024-09-13T06:43:49.600 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.2311999999999995e-05 2024-09-13T06:43:49.600 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:49.601 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:49.601 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:49.601 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:49.601 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:49.601 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:237453 3.15 3:abdd9d42:::rbd_data.1121cb4a09ed.0000000000000008:82 [read 167936~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e224)", 2024-09-13T06:43:49.601 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:43:08.800422+0000", 2024-09-13T06:43:49.601 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 40.739236136999999, 2024-09-13T06:43:49.601 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.033735223000000002, 2024-09-13T06:43:49.601 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:49.601 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:49.601 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:49.601 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:49.601 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:49.602 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 237453 2024-09-13T06:43:49.602 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:49.602 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:49.602 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:49.602 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:49.602 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800422+0000", 2024-09-13T06:43:49.602 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:49.602 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:49.602 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:49.602 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:49.602 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800422+0000", 2024-09-13T06:43:49.602 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:49.602 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:49.602 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:49.603 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:49.603 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800422+0000", 2024-09-13T06:43:49.603 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967296 2024-09-13T06:43:49.603 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:49.603 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:49.603 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:49.603 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800423+0000", 2024-09-13T06:43:49.603 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3489999999999999e-06 2024-09-13T06:43:49.603 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:49.603 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:49.603 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:49.603 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800427+0000", 2024-09-13T06:43:49.603 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.6610000000000002e-06 2024-09-13T06:43:49.604 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:49.604 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:49.604 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:49.604 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800430+0000", 2024-09-13T06:43:49.604 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.9869999999999999e-06 2024-09-13T06:43:49.604 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:49.604 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:49.604 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:49.604 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.833958+0000", 2024-09-13T06:43:49.604 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.033528020999999998 2024-09-13T06:43:49.604 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:49.604 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:49.604 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:49.605 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.834047+0000", 2024-09-13T06:43:49.605 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.9492000000000003e-05 2024-09-13T06:43:49.605 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:49.605 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:49.605 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:49.605 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.834157+0000", 2024-09-13T06:43:49.605 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000109948 2024-09-13T06:43:49.605 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:49.605 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:49.605 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:49.605 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:49.605 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:49.606 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:237454 3.15 3:abdd9d42:::rbd_data.1121cb4a09ed.0000000000000008:82 [read 180224~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e224)", 2024-09-13T06:43:49.606 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:43:08.800432+0000", 2024-09-13T06:43:49.606 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 40.739225930000003, 2024-09-13T06:43:49.606 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.033853883000000001, 2024-09-13T06:43:49.606 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:49.606 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:49.606 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:49.606 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:49.606 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:49.606 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 237454 2024-09-13T06:43:49.606 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:49.606 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:49.606 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:49.607 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:49.607 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800432+0000", 2024-09-13T06:43:49.607 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:49.607 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:49.607 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:49.607 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:49.607 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800432+0000", 2024-09-13T06:43:49.607 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:49.607 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:49.607 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:49.607 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:49.607 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800432+0000", 2024-09-13T06:43:49.607 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:49.607 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:49.608 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:49.608 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:49.608 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800433+0000", 2024-09-13T06:43:49.608 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3379999999999999e-06 2024-09-13T06:43:49.608 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:49.608 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:49.608 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:49.608 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800437+0000", 2024-09-13T06:43:49.608 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.1679999999999997e-06 2024-09-13T06:43:49.608 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:49.608 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:49.608 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:49.609 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800440+0000", 2024-09-13T06:43:49.609 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.8830000000000002e-06 2024-09-13T06:43:49.609 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:49.609 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:49.609 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:49.609 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.834187+0000", 2024-09-13T06:43:49.609 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.033746532000000003 2024-09-13T06:43:49.609 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:49.609 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:49.609 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:49.609 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.834228+0000", 2024-09-13T06:43:49.609 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.087e-05 2024-09-13T06:43:49.609 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:49.610 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:49.610 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:49.610 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.834286+0000", 2024-09-13T06:43:49.610 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.8331000000000001e-05 2024-09-13T06:43:49.610 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:49.610 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:49.610 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:49.610 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:49.610 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:49.610 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:237455 3.15 3:abdd9d42:::rbd_data.1121cb4a09ed.0000000000000008:82 [read 192512~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e224)", 2024-09-13T06:43:49.610 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:43:08.800443+0000", 2024-09-13T06:43:49.610 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 40.739215457, 2024-09-13T06:43:49.610 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.034083294, 2024-09-13T06:43:49.611 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:49.611 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:49.611 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:49.611 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:49.611 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:49.611 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 237455 2024-09-13T06:43:49.611 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:49.611 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:49.611 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:49.611 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:49.611 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800443+0000", 2024-09-13T06:43:49.611 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:49.611 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:49.611 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:49.612 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:49.612 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800443+0000", 2024-09-13T06:43:49.612 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:49.612 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:49.612 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:49.612 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:49.612 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800442+0000", 2024-09-13T06:43:49.612 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967296 2024-09-13T06:43:49.612 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:49.612 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:49.612 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:49.612 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800444+0000", 2024-09-13T06:43:49.612 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.443e-06 2024-09-13T06:43:49.613 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:49.613 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:49.613 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:49.613 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800448+0000", 2024-09-13T06:43:49.613 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.6770000000000001e-06 2024-09-13T06:43:49.613 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:49.613 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:49.613 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:49.613 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800451+0000", 2024-09-13T06:43:49.613 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.0920000000000002e-06 2024-09-13T06:43:49.613 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:49.613 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:49.613 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:49.614 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.834323+0000", 2024-09-13T06:43:49.614 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.033872145999999999 2024-09-13T06:43:49.614 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:49.614 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:49.614 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:49.614 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.834420+0000", 2024-09-13T06:43:49.614 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6898999999999995e-05 2024-09-13T06:43:49.614 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:49.614 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:49.614 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:49.614 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.834526+0000", 2024-09-13T06:43:49.614 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000106272 2024-09-13T06:43:49.614 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:49.615 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:49.615 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:49.615 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:49.615 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:49.615 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:237456 3.15 3:abdd9d42:::rbd_data.1121cb4a09ed.0000000000000008:82 [read 204800~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e224)", 2024-09-13T06:43:49.615 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:43:08.800453+0000", 2024-09-13T06:43:49.615 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 40.739205245999997, 2024-09-13T06:43:49.615 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.034198615000000002, 2024-09-13T06:43:49.615 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:49.615 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:49.615 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:49.615 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:49.615 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:49.615 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 237456 2024-09-13T06:43:49.616 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:49.616 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:49.616 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:49.616 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:49.616 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800453+0000", 2024-09-13T06:43:49.616 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:49.616 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:49.616 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:49.616 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:49.616 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800453+0000", 2024-09-13T06:43:49.616 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:49.616 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:49.616 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:49.617 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:49.617 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800453+0000", 2024-09-13T06:43:49.617 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967296 2024-09-13T06:43:49.617 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:49.617 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:49.617 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:49.617 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800454+0000", 2024-09-13T06:43:49.617 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.361e-06 2024-09-13T06:43:49.617 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:49.617 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:49.617 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:49.617 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800458+0000", 2024-09-13T06:43:49.617 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.7189999999999999e-06 2024-09-13T06:43:49.618 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:49.618 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:49.618 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:49.618 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800461+0000", 2024-09-13T06:43:49.618 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.7599999999999998e-06 2024-09-13T06:43:49.618 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:49.618 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:49.618 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:49.618 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.834555+0000", 2024-09-13T06:43:49.618 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.034094192000000002 2024-09-13T06:43:49.618 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:49.618 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:49.618 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:49.618 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.834597+0000", 2024-09-13T06:43:49.619 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.2157000000000003e-05 2024-09-13T06:43:49.619 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:49.619 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:49.619 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:49.619 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.834652+0000", 2024-09-13T06:43:49.619 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.4660999999999997e-05 2024-09-13T06:43:49.619 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:49.619 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:49.619 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:49.619 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:49.619 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:49.619 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:237457 3.15 3:abdd9d42:::rbd_data.1121cb4a09ed.0000000000000008:82 [read 217088~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e224)", 2024-09-13T06:43:49.619 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:43:08.800463+0000", 2024-09-13T06:43:49.620 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 40.739195299000002, 2024-09-13T06:43:49.620 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.034419130999999999, 2024-09-13T06:43:49.620 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:49.620 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:49.620 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:49.620 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:49.620 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:49.620 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 237457 2024-09-13T06:43:49.620 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:49.620 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:49.620 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:49.620 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:49.620 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800463+0000", 2024-09-13T06:43:49.621 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:49.621 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:49.621 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:49.621 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:49.621 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800463+0000", 2024-09-13T06:43:49.621 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:49.621 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:49.621 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:49.621 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:49.621 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800463+0000", 2024-09-13T06:43:49.621 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967296 2024-09-13T06:43:49.621 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:49.621 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:49.621 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:49.622 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800466+0000", 2024-09-13T06:43:49.622 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.8240000000000001e-06 2024-09-13T06:43:49.622 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:49.622 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:49.622 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:49.622 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800470+0000", 2024-09-13T06:43:49.622 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.7579999999999998e-06 2024-09-13T06:43:49.622 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:49.622 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:49.622 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:49.622 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800473+0000", 2024-09-13T06:43:49.622 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.875e-06 2024-09-13T06:43:49.622 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:49.623 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:49.623 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:49.623 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.834688+0000", 2024-09-13T06:43:49.623 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.034215039000000003 2024-09-13T06:43:49.623 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:49.623 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:49.623 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:49.623 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.834772+0000", 2024-09-13T06:43:49.623 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.3870999999999997e-05 2024-09-13T06:43:49.623 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:49.623 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:49.623 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:49.623 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.834882+0000", 2024-09-13T06:43:49.623 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00011 2024-09-13T06:43:49.624 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:49.624 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:49.624 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:49.624 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:49.624 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:49.624 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:237458 3.15 3:abdd9d42:::rbd_data.1121cb4a09ed.0000000000000008:82 [read 229376~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e224)", 2024-09-13T06:43:49.624 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:43:08.800476+0000", 2024-09-13T06:43:49.624 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 40.739182550999999, 2024-09-13T06:43:49.624 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.034538358999999998, 2024-09-13T06:43:49.624 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:49.624 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:49.624 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:49.624 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:49.624 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:49.625 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 237458 2024-09-13T06:43:49.625 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:49.625 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:49.625 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:49.625 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:49.625 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800476+0000", 2024-09-13T06:43:49.625 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:49.625 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:49.625 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:49.625 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:49.625 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800476+0000", 2024-09-13T06:43:49.625 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:49.625 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:49.625 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:49.625 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:49.626 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800475+0000", 2024-09-13T06:43:49.626 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:49.626 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:49.626 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:49.626 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:49.626 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800477+0000", 2024-09-13T06:43:49.626 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.367e-06 2024-09-13T06:43:49.626 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:49.626 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:49.626 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:49.626 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800480+0000", 2024-09-13T06:43:49.626 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.7179999999999998e-06 2024-09-13T06:43:49.627 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:49.627 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:49.627 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:49.627 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800483+0000", 2024-09-13T06:43:49.627 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.807e-06 2024-09-13T06:43:49.627 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:49.627 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:49.627 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:49.627 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.834922+0000", 2024-09-13T06:43:49.627 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.034438261999999997 2024-09-13T06:43:49.627 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:49.627 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:49.627 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:49.627 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.834962+0000", 2024-09-13T06:43:49.628 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0287999999999998e-05 2024-09-13T06:43:49.628 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:49.628 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:49.628 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:49.628 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.835014+0000", 2024-09-13T06:43:49.628 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.2172999999999997e-05 2024-09-13T06:43:49.628 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:49.628 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:49.628 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:49.628 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:49.628 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:49.628 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:237459 3.15 3:abdd9d42:::rbd_data.1121cb4a09ed.0000000000000008:82 [read 241664~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e224)", 2024-09-13T06:43:49.628 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:43:08.800486+0000", 2024-09-13T06:43:49.628 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 40.739172410000002, 2024-09-13T06:43:49.629 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.034771370000000003, 2024-09-13T06:43:49.629 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:49.629 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:49.629 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:49.629 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:49.629 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:49.629 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 237459 2024-09-13T06:43:49.629 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:49.629 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:49.629 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:49.629 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:49.629 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800486+0000", 2024-09-13T06:43:49.629 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:49.630 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:49.630 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:49.630 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:49.630 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800486+0000", 2024-09-13T06:43:49.630 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:49.630 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:49.630 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:49.630 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:49.630 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800485+0000", 2024-09-13T06:43:49.630 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:49.630 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:49.630 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:49.630 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:49.630 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800487+0000", 2024-09-13T06:43:49.631 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.297e-06 2024-09-13T06:43:49.631 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:49.631 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:49.631 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:49.631 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800491+0000", 2024-09-13T06:43:49.631 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.4569999999999998e-06 2024-09-13T06:43:49.631 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:49.631 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:49.631 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:49.631 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800494+0000", 2024-09-13T06:43:49.631 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.8710000000000001e-06 2024-09-13T06:43:49.631 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:49.631 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:49.632 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:49.632 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.835058+0000", 2024-09-13T06:43:49.632 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.034564117999999998 2024-09-13T06:43:49.632 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:49.632 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:49.632 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:49.632 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.835142+0000", 2024-09-13T06:43:49.632 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.352e-05 2024-09-13T06:43:49.632 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:49.632 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:49.632 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:49.632 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.835257+0000", 2024-09-13T06:43:49.632 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00011537 2024-09-13T06:43:49.633 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:49.633 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:49.633 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:49.633 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:49.633 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:49.633 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:237460 3.15 3:abdd9d42:::rbd_data.1121cb4a09ed.0000000000000008:82 [read 253952~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e224)", 2024-09-13T06:43:49.633 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:43:08.800511+0000", 2024-09-13T06:43:49.633 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 40.739146740000002, 2024-09-13T06:43:49.633 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.034864764999999999, 2024-09-13T06:43:49.633 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:49.633 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:49.633 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:49.633 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:49.634 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:49.634 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 237460 2024-09-13T06:43:49.634 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:49.634 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:49.634 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:49.634 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:49.634 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800511+0000", 2024-09-13T06:43:49.634 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:49.634 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:49.634 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:49.634 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:49.634 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800511+0000", 2024-09-13T06:43:49.634 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:49.634 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:49.635 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:49.635 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:49.635 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800511+0000", 2024-09-13T06:43:49.635 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:49.635 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:49.635 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:49.635 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:49.635 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800513+0000", 2024-09-13T06:43:49.635 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6020000000000001e-06 2024-09-13T06:43:49.635 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:49.635 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:49.635 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:49.635 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800517+0000", 2024-09-13T06:43:49.635 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0559999999999998e-06 2024-09-13T06:43:49.636 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:49.636 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:49.636 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:49.636 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800521+0000", 2024-09-13T06:43:49.636 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.4050000000000002e-06 2024-09-13T06:43:49.636 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:49.636 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:49.636 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:49.636 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.835278+0000", 2024-09-13T06:43:49.636 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.034757154999999998 2024-09-13T06:43:49.636 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:49.636 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:49.637 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:49.637 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.835319+0000", 2024-09-13T06:43:49.637 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.1121000000000002e-05 2024-09-13T06:43:49.637 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:49.637 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:49.637 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:49.637 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.835376+0000", 2024-09-13T06:43:49.637 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.6820000000000001e-05 2024-09-13T06:43:49.637 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:49.637 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:49.637 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:49.637 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:49.637 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:49.638 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:43:49.639 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:43:49.636+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:43:49.639 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-13T06:43:49.740 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-13T06:43:49.740+0000 7fa8bb18e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 36790) UID: 0 2024-09-13T06:43:49.767 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:43:49.767 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-13T06:43:49.767 INFO:teuthology.orchestra.run.smithi081.stdout: "num_ops": 0 2024-09-13T06:43:49.767 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:43:49.783 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-13T06:43:49.841 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:43:49.839+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:43:49.903 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:43:49.903 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-13T06:43:49.903 INFO:teuthology.orchestra.run.smithi081.stdout: "complaint_time": 30, 2024-09-13T06:43:49.903 INFO:teuthology.orchestra.run.smithi081.stdout: "num_blocked_ops": 0 2024-09-13T06:43:49.903 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:43:49.917 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-13T06:43:49.958 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:43:49.959+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:43:50.043 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:43:50.043+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:43:50.084 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:43:50.084 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 20, 2024-09-13T06:43:50.084 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 600, 2024-09-13T06:43:50.084 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [ 2024-09-13T06:43:50.084 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.085 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:37801 3.1 3:82e31015:::rbd_object_map.1121d8143c6e.0000000000000019:head [call] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e55)", 2024-09-13T06:43:50.085 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:05.646191+0000", 2024-09-13T06:43:50.085 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 224.43699342100001, 2024-09-13T06:43:50.085 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.72659507800000001, 2024-09-13T06:43:50.085 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:50.085 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:50.085 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:50.085 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:50.085 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:50.085 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 37801 2024-09-13T06:43:50.085 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.085 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:50.085 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.086 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:50.086 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:05.646191+0000", 2024-09-13T06:43:50.086 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:50.086 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.086 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.086 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:50.086 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:05.646191+0000", 2024-09-13T06:43:50.086 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:50.086 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.086 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.086 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:50.086 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:05.646188+0000", 2024-09-13T06:43:50.086 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999971 2024-09-13T06:43:50.086 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.087 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.087 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:50.087 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:05.646206+0000", 2024-09-13T06:43:50.087 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8182999999999999e-05 2024-09-13T06:43:50.087 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.087 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.087 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:50.087 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:05.646237+0000", 2024-09-13T06:43:50.087 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.1071000000000001e-05 2024-09-13T06:43:50.087 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.087 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.087 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:50.087 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:05.646251+0000", 2024-09-13T06:43:50.088 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3679000000000001e-05 2024-09-13T06:43:50.088 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.088 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.088 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:50.088 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:05.646321+0000", 2024-09-13T06:43:50.088 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.9831000000000003e-05 2024-09-13T06:43:50.088 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.088 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.088 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:43:50.088 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:05.646331+0000", 2024-09-13T06:43:50.088 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0242e-05 2024-09-13T06:43:50.088 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.088 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.089 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:50.089 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.371959+0000", 2024-09-13T06:43:50.089 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.72562817199999996 2024-09-13T06:43:50.089 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.089 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.089 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:50.089 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.372389+0000", 2024-09-13T06:43:50.089 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00042977400000000001 2024-09-13T06:43:50.089 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.089 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.089 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:50.089 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.372786+0000", 2024-09-13T06:43:50.089 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00039706099999999999 2024-09-13T06:43:50.090 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:50.090 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:50.090 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:50.090 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.090 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.090 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43182 3.17 3:ec5ebce4:::rbd_data.1121f5f2e1c0.0000000000000001:1f [read 333824~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:43:50.090 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.652985+0000", 2024-09-13T06:43:50.090 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 208.430198808, 2024-09-13T06:43:50.090 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123926616, 2024-09-13T06:43:50.090 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:50.090 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:50.090 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:50.090 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:50.091 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:50.091 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43182 2024-09-13T06:43:50.091 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.091 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:50.091 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.091 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:50.091 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.652985+0000", 2024-09-13T06:43:50.091 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:50.091 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.091 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.091 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:50.091 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.652985+0000", 2024-09-13T06:43:50.091 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:50.092 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.092 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.092 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:50.092 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.652985+0000", 2024-09-13T06:43:50.092 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:50.092 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.092 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.092 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:50.092 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.652987+0000", 2024-09-13T06:43:50.092 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0899999999999999e-06 2024-09-13T06:43:50.092 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.092 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.092 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:50.093 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.652994+0000", 2024-09-13T06:43:50.093 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3100000000000003e-06 2024-09-13T06:43:50.093 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.093 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.093 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:50.093 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.653000+0000", 2024-09-13T06:43:50.093 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2020000000000003e-06 2024-09-13T06:43:50.093 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.093 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.093 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:50.093 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.776635+0000", 2024-09-13T06:43:50.093 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.12363529400000001 2024-09-13T06:43:50.093 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.093 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.094 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:50.094 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.776676+0000", 2024-09-13T06:43:50.094 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.0745999999999999e-05 2024-09-13T06:43:50.094 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.094 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.094 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:50.094 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.776912+0000", 2024-09-13T06:43:50.094 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00023631300000000001 2024-09-13T06:43:50.094 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:50.094 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:50.094 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:50.094 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.094 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.095 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43194 3.17 3:ec5ebce4:::rbd_data.1121f5f2e1c0.0000000000000001:1f [read 495616~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:43:50.095 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.656645+0000", 2024-09-13T06:43:50.095 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 208.426538615, 2024-09-13T06:43:50.095 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.124088483, 2024-09-13T06:43:50.095 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:50.095 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:50.095 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:50.095 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:50.095 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:50.095 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43194 2024-09-13T06:43:50.095 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.095 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:50.095 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.095 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:50.096 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656645+0000", 2024-09-13T06:43:50.096 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:50.096 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.096 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.096 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:50.096 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656645+0000", 2024-09-13T06:43:50.096 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:50.096 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.096 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.096 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:50.096 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656645+0000", 2024-09-13T06:43:50.096 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:50.096 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.097 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.097 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:50.097 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656647+0000", 2024-09-13T06:43:50.097 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9180000000000001e-06 2024-09-13T06:43:50.097 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.097 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.097 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:50.097 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656653+0000", 2024-09-13T06:43:50.097 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7860000000000002e-06 2024-09-13T06:43:50.097 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.097 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.097 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:50.097 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656658+0000", 2024-09-13T06:43:50.098 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6949999999999999e-06 2024-09-13T06:43:50.098 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.098 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.098 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:50.098 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.780406+0000", 2024-09-13T06:43:50.098 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123748657 2024-09-13T06:43:50.098 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.098 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.098 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:50.098 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.780446+0000", 2024-09-13T06:43:50.098 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.9360999999999998e-05 2024-09-13T06:43:50.098 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.098 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.098 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:50.099 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.780734+0000", 2024-09-13T06:43:50.099 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00028838399999999998 2024-09-13T06:43:50.099 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:50.099 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:50.099 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:50.099 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.099 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.099 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43241 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 120832~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:43:50.099 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.660682+0000", 2024-09-13T06:43:50.099 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 208.42250167700001, 2024-09-13T06:43:50.099 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123958204, 2024-09-13T06:43:50.099 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:50.099 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:50.100 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:50.100 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:50.100 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:50.100 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43241 2024-09-13T06:43:50.100 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.100 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:50.100 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.100 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:50.100 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660682+0000", 2024-09-13T06:43:50.100 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:50.100 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.100 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.100 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:50.101 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660682+0000", 2024-09-13T06:43:50.101 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:50.101 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.101 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.101 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:50.101 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660682+0000", 2024-09-13T06:43:50.101 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:50.101 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.101 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.101 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:50.103 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660683+0000", 2024-09-13T06:43:50.103 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.308e-06 2024-09-13T06:43:50.103 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.103 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.104 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:50.104 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660686+0000", 2024-09-13T06:43:50.104 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.977e-06 2024-09-13T06:43:50.104 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.104 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.104 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:50.104 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660689+0000", 2024-09-13T06:43:50.104 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5830000000000001e-06 2024-09-13T06:43:50.104 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.104 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.104 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:50.104 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.784366+0000", 2024-09-13T06:43:50.104 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.12367713599999999 2024-09-13T06:43:50.105 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.105 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.105 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:50.105 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.784451+0000", 2024-09-13T06:43:50.105 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.4629999999999994e-05 2024-09-13T06:43:50.105 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.105 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.105 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:50.105 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.784641+0000", 2024-09-13T06:43:50.105 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00018984899999999999 2024-09-13T06:43:50.105 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:50.105 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:50.105 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:50.105 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.106 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.106 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43242 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 139264~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:43:50.106 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.660691+0000", 2024-09-13T06:43:50.106 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 208.422492699, 2024-09-13T06:43:50.106 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.124536443, 2024-09-13T06:43:50.106 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:50.106 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:50.106 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:50.106 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:50.106 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:50.106 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43242 2024-09-13T06:43:50.106 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.106 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:50.106 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.107 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:50.107 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660691+0000", 2024-09-13T06:43:50.107 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:50.107 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.107 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.107 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:50.107 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660691+0000", 2024-09-13T06:43:50.107 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:50.107 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.107 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.107 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:50.107 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660691+0000", 2024-09-13T06:43:50.107 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:43:50.107 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.107 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.108 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:50.108 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660696+0000", 2024-09-13T06:43:50.108 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0560000000000004e-06 2024-09-13T06:43:50.108 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.108 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.108 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:50.108 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660699+0000", 2024-09-13T06:43:50.108 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.2009999999999999e-06 2024-09-13T06:43:50.108 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.108 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.108 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:50.108 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660702+0000", 2024-09-13T06:43:50.108 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.633e-06 2024-09-13T06:43:50.108 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.109 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.109 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:50.109 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.784912+0000", 2024-09-13T06:43:50.109 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.124209497 2024-09-13T06:43:50.109 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.109 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.109 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:50.109 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.784995+0000", 2024-09-13T06:43:50.109 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.3891e-05 2024-09-13T06:43:50.109 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.109 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.109 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:50.109 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.785228+0000", 2024-09-13T06:43:50.109 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00023237400000000001 2024-09-13T06:43:50.110 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:50.110 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:50.110 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:50.110 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.110 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.110 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43243 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 153600~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:43:50.110 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.660705+0000", 2024-09-13T06:43:50.110 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 208.422479366, 2024-09-13T06:43:50.110 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.124825835, 2024-09-13T06:43:50.110 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:50.110 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:50.110 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:50.110 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:50.110 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:50.111 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43243 2024-09-13T06:43:50.111 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.111 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:50.111 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.111 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:50.112 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660705+0000", 2024-09-13T06:43:50.112 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:50.112 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.112 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.112 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:50.112 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660705+0000", 2024-09-13T06:43:50.112 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:50.112 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.112 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.112 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:50.112 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660705+0000", 2024-09-13T06:43:50.112 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:43:50.113 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.113 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.113 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:50.113 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660706+0000", 2024-09-13T06:43:50.113 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4339999999999999e-06 2024-09-13T06:43:50.113 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.113 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.113 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:50.113 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660709+0000", 2024-09-13T06:43:50.113 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9000000000000002e-06 2024-09-13T06:43:50.113 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.113 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.113 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:50.113 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660712+0000", 2024-09-13T06:43:50.114 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.0589999999999998e-06 2024-09-13T06:43:50.114 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.114 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.114 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:50.114 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.785318+0000", 2024-09-13T06:43:50.114 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.124606299 2024-09-13T06:43:50.114 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.114 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.114 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:50.114 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.785361+0000", 2024-09-13T06:43:50.114 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.3214999999999999e-05 2024-09-13T06:43:50.114 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.114 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.114 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:50.115 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.785531+0000", 2024-09-13T06:43:50.115 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00016914400000000001 2024-09-13T06:43:50.115 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:50.115 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:50.115 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:50.115 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.115 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.115 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43244 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 167936~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:43:50.115 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.660714+0000", 2024-09-13T06:43:50.115 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 208.42246995299999, 2024-09-13T06:43:50.115 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.125073248, 2024-09-13T06:43:50.115 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:50.115 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:50.116 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:50.116 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:50.116 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:50.116 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43244 2024-09-13T06:43:50.116 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.116 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:50.116 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.116 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:50.116 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660714+0000", 2024-09-13T06:43:50.116 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:50.116 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.116 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.116 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:50.117 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660714+0000", 2024-09-13T06:43:50.117 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:50.117 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.117 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.117 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:50.117 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660714+0000", 2024-09-13T06:43:50.117 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:43:50.117 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.117 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.117 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:50.117 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660715+0000", 2024-09-13T06:43:50.117 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2330000000000001e-06 2024-09-13T06:43:50.117 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.118 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.118 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:50.118 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660718+0000", 2024-09-13T06:43:50.118 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9569999999999998e-06 2024-09-13T06:43:50.118 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.118 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.118 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:50.118 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660721+0000", 2024-09-13T06:43:50.118 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.678e-06 2024-09-13T06:43:50.118 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.118 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.118 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:50.118 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.785557+0000", 2024-09-13T06:43:50.118 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.12483633199999999 2024-09-13T06:43:50.118 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.119 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.119 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:50.119 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.785618+0000", 2024-09-13T06:43:50.119 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0686000000000001e-05 2024-09-13T06:43:50.119 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.119 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.119 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:50.119 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.785787+0000", 2024-09-13T06:43:50.119 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00016957699999999999 2024-09-13T06:43:50.119 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:50.119 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:50.119 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:50.119 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.119 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.120 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43256 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 344064~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:43:50.120 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.664763+0000", 2024-09-13T06:43:50.120 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 208.418421443, 2024-09-13T06:43:50.120 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.12418359399999999, 2024-09-13T06:43:50.120 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:50.120 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:50.120 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:50.120 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:50.120 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:50.120 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43256 2024-09-13T06:43:50.120 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.120 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:50.120 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.120 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:50.121 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664763+0000", 2024-09-13T06:43:50.121 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:50.121 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.121 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.121 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:50.121 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664763+0000", 2024-09-13T06:43:50.121 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:50.121 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.121 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.121 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:50.121 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664762+0000", 2024-09-13T06:43:50.121 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:50.121 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.122 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.122 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:50.122 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664765+0000", 2024-09-13T06:43:50.122 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3290000000000001e-06 2024-09-13T06:43:50.122 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.122 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.122 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:50.122 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664771+0000", 2024-09-13T06:43:50.122 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.1319999999999999e-06 2024-09-13T06:43:50.122 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.122 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.122 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:50.122 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664776+0000", 2024-09-13T06:43:50.122 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.8840000000000002e-06 2024-09-13T06:43:50.122 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.123 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.123 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:50.123 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.788598+0000", 2024-09-13T06:43:50.123 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123821979 2024-09-13T06:43:50.123 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.123 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.123 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:50.123 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.788680+0000", 2024-09-13T06:43:50.123 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.2367999999999995e-05 2024-09-13T06:43:50.123 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.123 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.123 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:50.123 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.788946+0000", 2024-09-13T06:43:50.123 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00026629799999999999 2024-09-13T06:43:50.124 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:50.124 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:50.124 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:50.124 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.124 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.124 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43267 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 505856~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:43:50.124 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.669461+0000", 2024-09-13T06:43:50.124 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 208.41372288900001, 2024-09-13T06:43:50.124 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123933711, 2024-09-13T06:43:50.124 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:50.124 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:50.124 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:50.124 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:50.125 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:50.125 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43267 2024-09-13T06:43:50.125 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.125 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:50.125 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.125 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:50.125 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669461+0000", 2024-09-13T06:43:50.125 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:50.125 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.125 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.125 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:50.125 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669461+0000", 2024-09-13T06:43:50.125 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:50.125 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.126 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.126 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:50.126 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669461+0000", 2024-09-13T06:43:50.126 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:50.126 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.126 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.126 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:50.126 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669463+0000", 2024-09-13T06:43:50.126 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5629999999999999e-06 2024-09-13T06:43:50.126 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.126 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.126 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:50.126 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669473+0000", 2024-09-13T06:43:50.126 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.9520000000000006e-06 2024-09-13T06:43:50.127 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.127 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.127 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:50.127 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669479+0000", 2024-09-13T06:43:50.127 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8540000000000002e-06 2024-09-13T06:43:50.127 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.127 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.127 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:50.127 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.793137+0000", 2024-09-13T06:43:50.127 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.12365825699999999 2024-09-13T06:43:50.127 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.127 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.127 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:50.127 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.793181+0000", 2024-09-13T06:43:50.128 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.3773999999999998e-05 2024-09-13T06:43:50.128 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.128 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.128 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:50.128 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.793395+0000", 2024-09-13T06:43:50.128 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00021372399999999999 2024-09-13T06:43:50.128 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:50.128 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:50.128 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:50.128 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.128 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.128 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43268 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 520192~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:43:50.128 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.669484+0000", 2024-09-13T06:43:50.128 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 208.41370010399999, 2024-09-13T06:43:50.129 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.12441057899999999, 2024-09-13T06:43:50.129 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:50.129 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:50.129 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:50.129 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:50.129 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:50.129 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43268 2024-09-13T06:43:50.129 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.129 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:50.129 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.129 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:50.129 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669484+0000", 2024-09-13T06:43:50.129 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:50.129 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.130 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.130 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:50.130 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669484+0000", 2024-09-13T06:43:50.130 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:50.130 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.130 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.130 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:50.130 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669484+0000", 2024-09-13T06:43:50.130 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:50.130 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.130 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.130 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:50.130 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669486+0000", 2024-09-13T06:43:50.130 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6120000000000001e-06 2024-09-13T06:43:50.130 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.131 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.131 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:50.131 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669494+0000", 2024-09-13T06:43:50.131 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4819999999999997e-06 2024-09-13T06:43:50.131 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.131 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.131 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:50.131 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669497+0000", 2024-09-13T06:43:50.131 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9790000000000002e-06 2024-09-13T06:43:50.131 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.131 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.131 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:50.131 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.793559+0000", 2024-09-13T06:43:50.131 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.124062436 2024-09-13T06:43:50.132 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.132 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.132 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:50.132 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.793603+0000", 2024-09-13T06:43:50.132 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.3764999999999999e-05 2024-09-13T06:43:50.132 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.132 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.132 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:50.132 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.793895+0000", 2024-09-13T06:43:50.132 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00029168299999999999 2024-09-13T06:43:50.132 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:50.132 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:50.132 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:50.133 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.133 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.133 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:181627 3.1b 3:dbd5e871:::rbd_data.11218aab7a9c.0000000000000003:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e203)", 2024-09-13T06:43:50.133 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:42:45.704561+0000", 2024-09-13T06:43:50.133 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 64.378623239999996, 2024-09-13T06:43:50.133 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.70481779099999997, 2024-09-13T06:43:50.133 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:50.133 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:50.133 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:50.133 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:50.133 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:50.133 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 181627 2024-09-13T06:43:50.133 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.134 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:50.134 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.134 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:50.134 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.704561+0000", 2024-09-13T06:43:50.134 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:50.134 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.134 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.134 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:50.134 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.704561+0000", 2024-09-13T06:43:50.134 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:50.134 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.134 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.134 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:50.135 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.704558+0000", 2024-09-13T06:43:50.135 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999976 2024-09-13T06:43:50.135 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.135 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.135 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:50.135 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.704570+0000", 2024-09-13T06:43:50.135 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2123000000000001e-05 2024-09-13T06:43:50.135 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.135 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.135 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:50.135 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.704596+0000", 2024-09-13T06:43:50.135 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5134e-05 2024-09-13T06:43:50.135 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.136 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.136 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:50.136 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.704609+0000", 2024-09-13T06:43:50.136 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3745e-05 2024-09-13T06:43:50.136 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.136 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.136 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:50.136 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.704797+0000", 2024-09-13T06:43:50.136 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00018797799999999999 2024-09-13T06:43:50.136 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.136 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.136 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:43:50.136 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.704816+0000", 2024-09-13T06:43:50.136 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8218000000000001e-05 2024-09-13T06:43:50.137 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.137 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.137 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:50.137 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:46.408816+0000", 2024-09-13T06:43:50.137 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.70399995500000001 2024-09-13T06:43:50.137 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.137 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.137 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:50.137 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:46.409111+0000", 2024-09-13T06:43:50.137 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000295202 2024-09-13T06:43:50.137 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.137 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.137 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:50.138 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:46.409379+0000", 2024-09-13T06:43:50.138 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00026792599999999998 2024-09-13T06:43:50.138 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:50.138 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:50.138 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:50.138 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.138 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.138 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:181641 3.1b 3:dbd5e871:::rbd_data.11218aab7a9c.0000000000000003:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e203)", 2024-09-13T06:43:50.138 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:42:45.704674+0000", 2024-09-13T06:43:50.138 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 64.378510233, 2024-09-13T06:43:50.138 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.70579465600000002, 2024-09-13T06:43:50.138 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:50.138 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:50.139 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:50.139 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:50.139 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:50.139 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 181641 2024-09-13T06:43:50.139 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.139 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:50.139 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.139 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:50.139 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.704674+0000", 2024-09-13T06:43:50.139 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:50.139 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.139 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.139 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:50.139 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.704674+0000", 2024-09-13T06:43:50.139 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:50.140 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.140 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.140 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:50.140 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.704673+0000", 2024-09-13T06:43:50.140 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:50.140 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.140 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.140 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:50.140 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.704677+0000", 2024-09-13T06:43:50.140 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.6389999999999998e-06 2024-09-13T06:43:50.140 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.140 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.140 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:50.141 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.704691+0000", 2024-09-13T06:43:50.141 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3859999999999999e-05 2024-09-13T06:43:50.141 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.141 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.141 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:50.141 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.704699+0000", 2024-09-13T06:43:50.141 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.2339999999999994e-06 2024-09-13T06:43:50.141 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.141 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.141 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:50.141 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.704854+0000", 2024-09-13T06:43:50.141 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00015513899999999999 2024-09-13T06:43:50.141 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.141 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.142 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:43:50.142 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.704866+0000", 2024-09-13T06:43:50.142 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1855000000000001e-05 2024-09-13T06:43:50.142 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.142 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.142 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:50.142 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:46.410079+0000", 2024-09-13T06:43:50.142 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.705212477 2024-09-13T06:43:50.142 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.142 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.142 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:50.142 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:46.410279+0000", 2024-09-13T06:43:50.142 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000200614 2024-09-13T06:43:50.142 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.143 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.143 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:50.143 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:46.410469+0000", 2024-09-13T06:43:50.143 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00018939400000000001 2024-09-13T06:43:50.143 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:50.143 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:50.143 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:50.143 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.143 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.143 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:181655 3.1b 3:dbd5e871:::rbd_data.11218aab7a9c.0000000000000003:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e203)", 2024-09-13T06:43:50.143 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:42:45.704730+0000", 2024-09-13T06:43:50.143 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 64.378453824999994, 2024-09-13T06:43:50.143 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.70617977499999995, 2024-09-13T06:43:50.144 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:50.144 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:50.144 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:50.144 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:50.144 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:50.144 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 181655 2024-09-13T06:43:50.144 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.144 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:50.144 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.144 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:50.144 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.704730+0000", 2024-09-13T06:43:50.144 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:50.145 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.145 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.145 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:50.145 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.704730+0000", 2024-09-13T06:43:50.145 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:50.145 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.145 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.145 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:50.145 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.704730+0000", 2024-09-13T06:43:50.145 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:50.145 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.145 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.145 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:50.145 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.704733+0000", 2024-09-13T06:43:50.146 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.0000000000000001e-06 2024-09-13T06:43:50.146 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.146 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.146 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:50.146 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.704741+0000", 2024-09-13T06:43:50.146 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.0770000000000008e-06 2024-09-13T06:43:50.146 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.146 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.146 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:50.146 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.704747+0000", 2024-09-13T06:43:50.146 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.2110000000000003e-06 2024-09-13T06:43:50.146 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.146 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.147 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:50.147 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.706676+0000", 2024-09-13T06:43:50.147 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0019289820000000001 2024-09-13T06:43:50.147 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.147 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.147 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:43:50.147 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.706687+0000", 2024-09-13T06:43:50.147 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1382999999999999e-05 2024-09-13T06:43:50.147 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.147 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.147 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:50.147 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:46.410540+0000", 2024-09-13T06:43:50.147 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.70385235199999996 2024-09-13T06:43:50.147 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.147 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.148 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:50.148 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:46.410723+0000", 2024-09-13T06:43:50.148 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000182998 2024-09-13T06:43:50.148 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.148 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.148 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:50.148 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:46.410910+0000", 2024-09-13T06:43:50.148 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00018720299999999999 2024-09-13T06:43:50.148 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:50.148 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:50.148 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:50.148 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.148 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.149 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:181669 3.1b 3:dbd5e871:::rbd_data.11218aab7a9c.0000000000000003:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e203)", 2024-09-13T06:43:50.149 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:42:45.705356+0000", 2024-09-13T06:43:50.149 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 64.377827816999996, 2024-09-13T06:43:50.149 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.70583958999999996, 2024-09-13T06:43:50.149 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:50.149 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:50.149 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:50.149 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:50.149 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:50.149 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 181669 2024-09-13T06:43:50.149 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.149 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:50.149 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.150 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:50.150 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.705356+0000", 2024-09-13T06:43:50.150 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:50.150 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.150 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.150 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:50.150 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.705356+0000", 2024-09-13T06:43:50.150 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:50.150 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.150 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.150 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:50.150 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.705356+0000", 2024-09-13T06:43:50.150 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:50.150 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.150 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.151 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:50.151 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.705360+0000", 2024-09-13T06:43:50.151 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.0069999999999999e-06 2024-09-13T06:43:50.151 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.151 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.151 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:50.151 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.705368+0000", 2024-09-13T06:43:50.151 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.3639999999999999e-06 2024-09-13T06:43:50.151 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.151 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.151 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:50.151 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.705375+0000", 2024-09-13T06:43:50.151 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.8839999999999997e-06 2024-09-13T06:43:50.152 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.152 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.152 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:50.152 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.706716+0000", 2024-09-13T06:43:50.152 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0013414589999999999 2024-09-13T06:43:50.152 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.152 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.152 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:43:50.152 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.706726+0000", 2024-09-13T06:43:50.152 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.5079999999999994e-06 2024-09-13T06:43:50.152 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.152 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.152 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:50.153 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:46.410966+0000", 2024-09-13T06:43:50.153 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.70424025800000001 2024-09-13T06:43:50.153 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.153 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.153 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:50.153 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:46.411099+0000", 2024-09-13T06:43:50.153 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000132395 2024-09-13T06:43:50.153 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.153 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.153 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:50.154 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:46.411196+0000", 2024-09-13T06:43:50.154 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.7344999999999997e-05 2024-09-13T06:43:50.154 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:50.154 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:50.154 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:50.154 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.154 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.154 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:181683 3.1b 3:dbd5e871:::rbd_data.11218aab7a9c.0000000000000003:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e203)", 2024-09-13T06:43:50.154 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:42:45.705404+0000", 2024-09-13T06:43:50.154 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 64.377780310999995, 2024-09-13T06:43:50.154 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.70639211899999999, 2024-09-13T06:43:50.154 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:50.154 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:50.154 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:50.155 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:50.155 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:50.155 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 181683 2024-09-13T06:43:50.155 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.155 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:50.155 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.155 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:50.155 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.705404+0000", 2024-09-13T06:43:50.155 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:50.155 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.155 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.155 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:50.155 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.705404+0000", 2024-09-13T06:43:50.156 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:50.156 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.156 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.156 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:50.156 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.705403+0000", 2024-09-13T06:43:50.156 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:50.156 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.156 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.156 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:50.156 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.705406+0000", 2024-09-13T06:43:50.156 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.1499999999999999e-06 2024-09-13T06:43:50.156 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.156 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.157 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:50.157 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.705414+0000", 2024-09-13T06:43:50.157 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4259999999999997e-06 2024-09-13T06:43:50.157 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.157 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.157 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:50.157 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.705420+0000", 2024-09-13T06:43:50.157 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.4339999999999997e-06 2024-09-13T06:43:50.157 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.157 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.157 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:50.157 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.706753+0000", 2024-09-13T06:43:50.157 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0013326939999999999 2024-09-13T06:43:50.158 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.158 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.158 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:43:50.158 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.706762+0000", 2024-09-13T06:43:50.158 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.2439999999999999e-06 2024-09-13T06:43:50.158 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.158 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.158 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:50.158 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:46.411391+0000", 2024-09-13T06:43:50.158 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.70462912099999997 2024-09-13T06:43:50.158 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.158 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.158 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:50.158 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:46.411584+0000", 2024-09-13T06:43:50.159 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00019283399999999999 2024-09-13T06:43:50.159 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.159 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.159 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:50.159 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:46.411796+0000", 2024-09-13T06:43:50.159 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00021175299999999999 2024-09-13T06:43:50.159 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:50.159 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:50.159 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:50.159 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.159 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.159 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:181697 3.1b 3:dbd5e871:::rbd_data.11218aab7a9c.0000000000000003:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e203)", 2024-09-13T06:43:50.159 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:42:45.705447+0000", 2024-09-13T06:43:50.159 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 64.377736661, 2024-09-13T06:43:50.160 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.70668603500000005, 2024-09-13T06:43:50.160 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:50.160 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:50.160 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:50.160 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:50.160 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:50.160 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 181697 2024-09-13T06:43:50.160 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.160 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:50.160 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.160 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:50.160 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.705447+0000", 2024-09-13T06:43:50.160 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:50.161 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.161 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.161 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:50.161 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.705447+0000", 2024-09-13T06:43:50.161 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:50.161 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.161 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.161 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:50.161 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.705447+0000", 2024-09-13T06:43:50.161 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:50.161 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.161 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.161 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:50.161 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.705450+0000", 2024-09-13T06:43:50.161 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.8830000000000002e-06 2024-09-13T06:43:50.162 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.162 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.162 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:50.162 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.705457+0000", 2024-09-13T06:43:50.162 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.097e-06 2024-09-13T06:43:50.162 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.162 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.162 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:50.162 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.705463+0000", 2024-09-13T06:43:50.162 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.2439999999999998e-06 2024-09-13T06:43:50.162 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.162 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.162 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:50.163 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.706790+0000", 2024-09-13T06:43:50.163 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.001326823 2024-09-13T06:43:50.163 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.163 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.163 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:43:50.163 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.706799+0000", 2024-09-13T06:43:50.163 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.3249999999999997e-06 2024-09-13T06:43:50.163 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.163 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.163 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:50.163 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:46.411884+0000", 2024-09-13T06:43:50.163 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.70508501599999995 2024-09-13T06:43:50.163 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.163 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.164 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:50.164 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:46.412010+0000", 2024-09-13T06:43:50.164 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000125635 2024-09-13T06:43:50.164 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.164 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.164 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:50.164 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:46.412133+0000", 2024-09-13T06:43:50.164 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000123492 2024-09-13T06:43:50.164 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:50.164 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:50.164 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:50.164 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.164 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.165 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:181711 3.1b 3:dbd5e871:::rbd_data.11218aab7a9c.0000000000000003:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e203)", 2024-09-13T06:43:50.165 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:42:45.705496+0000", 2024-09-13T06:43:50.165 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 64.377688097999993, 2024-09-13T06:43:50.165 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.70714611199999999, 2024-09-13T06:43:50.165 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:50.165 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:50.165 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:50.165 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:50.165 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:50.165 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 181711 2024-09-13T06:43:50.165 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.165 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:50.165 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.166 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:50.166 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.705496+0000", 2024-09-13T06:43:50.166 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:50.166 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.166 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.166 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:50.166 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.705496+0000", 2024-09-13T06:43:50.166 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:50.166 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.166 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.166 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:50.166 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.705495+0000", 2024-09-13T06:43:50.166 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:50.166 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.167 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.167 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:50.167 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.705499+0000", 2024-09-13T06:43:50.167 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.1109999999999999e-06 2024-09-13T06:43:50.167 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.167 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.167 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:50.167 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.705506+0000", 2024-09-13T06:43:50.167 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.8830000000000006e-06 2024-09-13T06:43:50.167 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.167 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.167 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:50.167 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.705513+0000", 2024-09-13T06:43:50.167 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.2500000000000003e-06 2024-09-13T06:43:50.168 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.168 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.168 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:50.168 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.706828+0000", 2024-09-13T06:43:50.168 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0013155840000000001 2024-09-13T06:43:50.168 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.168 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.168 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:43:50.168 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.706837+0000", 2024-09-13T06:43:50.168 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.0489999999999993e-06 2024-09-13T06:43:50.168 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.168 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.168 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:50.169 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:46.412223+0000", 2024-09-13T06:43:50.169 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.70538530799999999 2024-09-13T06:43:50.169 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.169 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.169 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:50.169 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:46.412418+0000", 2024-09-13T06:43:50.169 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000195331 2024-09-13T06:43:50.169 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.169 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.169 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:50.169 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:46.412642+0000", 2024-09-13T06:43:50.169 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00022410099999999999 2024-09-13T06:43:50.169 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:50.169 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:50.170 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:50.170 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.170 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.170 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:181725 3.1b 3:dbd5e871:::rbd_data.11218aab7a9c.0000000000000003:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e203)", 2024-09-13T06:43:50.170 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:42:45.706863+0000", 2024-09-13T06:43:50.170 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 64.376321054000002, 2024-09-13T06:43:50.170 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.70631271699999998, 2024-09-13T06:43:50.170 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:50.170 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:50.170 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:50.170 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:50.170 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:50.170 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 181725 2024-09-13T06:43:50.171 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.171 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:50.171 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.171 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:50.171 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.706863+0000", 2024-09-13T06:43:50.171 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:50.171 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.171 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.171 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:50.171 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.706863+0000", 2024-09-13T06:43:50.171 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:50.171 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.171 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.171 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:50.171 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.706862+0000", 2024-09-13T06:43:50.172 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.999999 2024-09-13T06:43:50.172 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.172 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.172 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:50.172 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.706869+0000", 2024-09-13T06:43:50.172 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.0899999999999999e-06 2024-09-13T06:43:50.172 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.172 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.172 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:50.172 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.706881+0000", 2024-09-13T06:43:50.172 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1727e-05 2024-09-13T06:43:50.172 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.172 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.172 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:50.173 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.706891+0000", 2024-09-13T06:43:50.173 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.9399999999999997e-06 2024-09-13T06:43:50.173 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.173 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.173 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:50.173 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.706952+0000", 2024-09-13T06:43:50.173 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.1106999999999996e-05 2024-09-13T06:43:50.173 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.173 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.173 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:43:50.173 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.706966+0000", 2024-09-13T06:43:50.174 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4173e-05 2024-09-13T06:43:50.174 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.174 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.174 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:50.174 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:46.412754+0000", 2024-09-13T06:43:50.174 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.70578759999999996 2024-09-13T06:43:50.174 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.174 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.174 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:50.174 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:46.412967+0000", 2024-09-13T06:43:50.174 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00021290999999999999 2024-09-13T06:43:50.174 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.174 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.174 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:50.175 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:46.413176+0000", 2024-09-13T06:43:50.175 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00020922099999999999 2024-09-13T06:43:50.175 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:50.175 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:50.175 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:50.175 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.175 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.175 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:181739 3.1b 3:dbd5e871:::rbd_data.11218aab7a9c.0000000000000003:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e203)", 2024-09-13T06:43:50.175 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:42:45.706937+0000", 2024-09-13T06:43:50.175 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 64.376246843000004, 2024-09-13T06:43:50.175 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.70679418800000005, 2024-09-13T06:43:50.175 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:50.175 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:50.175 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:50.176 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:50.176 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:50.176 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 181739 2024-09-13T06:43:50.176 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.176 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:50.176 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.176 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:50.176 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.706937+0000", 2024-09-13T06:43:50.176 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:50.176 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.176 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.176 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:50.176 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.706937+0000", 2024-09-13T06:43:50.176 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:50.177 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.177 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.177 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:50.177 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.706937+0000", 2024-09-13T06:43:50.177 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:50.177 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.177 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.177 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:50.177 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.706940+0000", 2024-09-13T06:43:50.177 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.4290000000000001e-06 2024-09-13T06:43:50.177 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.177 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.177 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:50.178 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.706949+0000", 2024-09-13T06:43:50.178 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.7730000000000005e-06 2024-09-13T06:43:50.178 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.178 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.178 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:50.178 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.706956+0000", 2024-09-13T06:43:50.178 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4240000000000004e-06 2024-09-13T06:43:50.178 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.178 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.178 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:50.178 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.706999+0000", 2024-09-13T06:43:50.178 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.2410999999999998e-05 2024-09-13T06:43:50.178 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.178 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.179 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:43:50.179 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.707011+0000", 2024-09-13T06:43:50.179 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2140999999999999e-05 2024-09-13T06:43:50.179 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.179 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.179 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:50.179 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:46.413278+0000", 2024-09-13T06:43:50.179 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.70626747199999995 2024-09-13T06:43:50.179 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.179 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.179 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:50.179 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:46.413471+0000", 2024-09-13T06:43:50.179 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00019234699999999999 2024-09-13T06:43:50.180 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.180 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.180 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:50.180 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:46.413731+0000", 2024-09-13T06:43:50.180 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00026069 2024-09-13T06:43:50.180 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:50.180 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:50.180 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:50.180 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.180 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.180 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:181753 3.1b 3:dbd5e871:::rbd_data.11218aab7a9c.0000000000000003:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e203)", 2024-09-13T06:43:50.180 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:42:45.706987+0000", 2024-09-13T06:43:50.180 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 64.376196759999999, 2024-09-13T06:43:50.181 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.70721309200000004, 2024-09-13T06:43:50.181 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:50.181 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:50.181 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:50.181 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:50.181 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:50.181 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 181753 2024-09-13T06:43:50.181 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.181 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:50.181 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.181 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:50.181 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.706987+0000", 2024-09-13T06:43:50.181 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:50.182 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.182 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.182 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:50.182 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.706987+0000", 2024-09-13T06:43:50.182 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:50.182 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.182 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.182 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:50.182 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.706987+0000", 2024-09-13T06:43:50.182 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:50.182 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.182 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.182 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:50.183 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.706990+0000", 2024-09-13T06:43:50.183 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.0759999999999999e-06 2024-09-13T06:43:50.183 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.183 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.183 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:50.183 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.706997+0000", 2024-09-13T06:43:50.183 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5809999999999999e-06 2024-09-13T06:43:50.183 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.183 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.183 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:50.183 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.707004+0000", 2024-09-13T06:43:50.183 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.7839999999999998e-06 2024-09-13T06:43:50.183 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.183 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.184 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:50.184 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.707046+0000", 2024-09-13T06:43:50.184 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.1474999999999998e-05 2024-09-13T06:43:50.184 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.184 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.184 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:43:50.184 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.707056+0000", 2024-09-13T06:43:50.184 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0825000000000001e-05 2024-09-13T06:43:50.184 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.184 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.184 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:50.184 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:46.413797+0000", 2024-09-13T06:43:50.184 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.70674101099999997 2024-09-13T06:43:50.185 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.185 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.185 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:50.185 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:46.413998+0000", 2024-09-13T06:43:50.185 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00020058700000000001 2024-09-13T06:43:50.185 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.185 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.185 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:50.185 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:46.414200+0000", 2024-09-13T06:43:50.185 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00020238400000000001 2024-09-13T06:43:50.185 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:50.185 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:50.185 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:50.185 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:50.186 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:50.186 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:43:50.187 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-13T06:43:50.187 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:43:50.184+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:43:50.288 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:43:50.287+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:43:50.356 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:43:50.356 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-13T06:43:50.356 INFO:teuthology.orchestra.run.smithi081.stdout: "num_ops": 0 2024-09-13T06:43:50.356 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:43:50.370 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-13T06:43:50.388 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-13T06:43:50.388+0000 7fa8bb18e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 36790) UID: 0 2024-09-13T06:43:50.489 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:43:50.487+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:43:50.544 INFO:teuthology.orchestra.run.smithi081.stderr:noscrub is set 2024-09-13T06:43:50.546 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:43:50.546 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-13T06:43:50.546 INFO:teuthology.orchestra.run.smithi081.stdout: "complaint_time": 30, 2024-09-13T06:43:50.546 INFO:teuthology.orchestra.run.smithi081.stdout: "num_blocked_ops": 0 2024-09-13T06:43:50.546 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:43:50.565 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-13T06:43:50.615 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:43:50.615+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:43:50.669 INFO:tasks.thrashosds.thrasher:in_osds: [0, 2, 7, 5, 3, 4] out_osds: [6, 1] dead_osds: [6] live_osds: [0, 1, 2, 3, 4, 5, 7] 2024-09-13T06:43:50.669 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-13T06:43:50.669 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap 2024-09-13T06:43:50.669 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-09-13T06:43:50.714 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:43:50.715+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:43:50.758 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:43:50.758 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 20, 2024-09-13T06:43:50.758 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 600, 2024-09-13T06:43:50.758 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [ 2024-09-13T06:43:50.758 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.758 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:90987 3.6 3:6263dd97:::rbd_object_map.11212443ae03.0000000000000049:head [call] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-13T06:43:50.758 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:41:35.460333+0000", 2024-09-13T06:43:50.759 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 135.29717291599999, 2024-09-13T06:43:50.759 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0001633640000001, 2024-09-13T06:43:50.759 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:50.759 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:50.759 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:50.759 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:50.759 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:50.759 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 90987 2024-09-13T06:43:50.759 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.759 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:50.759 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.759 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:50.760 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:35.460333+0000", 2024-09-13T06:43:50.760 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:50.760 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.760 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.760 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:50.760 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:35.460333+0000", 2024-09-13T06:43:50.760 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:50.760 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.760 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.760 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:50.760 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:35.460330+0000", 2024-09-13T06:43:50.760 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999971 2024-09-13T06:43:50.760 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.760 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.761 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:50.761 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:35.460343+0000", 2024-09-13T06:43:50.761 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2695e-05 2024-09-13T06:43:50.761 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.761 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.761 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:50.761 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:35.460365+0000", 2024-09-13T06:43:50.761 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2473999999999999e-05 2024-09-13T06:43:50.761 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.761 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.761 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:50.761 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:35.460376+0000", 2024-09-13T06:43:50.761 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0383999999999999e-05 2024-09-13T06:43:50.761 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.762 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.762 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:50.762 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:35.460435+0000", 2024-09-13T06:43:50.762 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8650000000000003e-05 2024-09-13T06:43:50.762 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.762 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.762 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:43:50.762 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:35.460444+0000", 2024-09-13T06:43:50.762 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.0380000000000005e-06 2024-09-13T06:43:50.762 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.762 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.762 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:50.762 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:36.459433+0000", 2024-09-13T06:43:50.762 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.99898895799999998 2024-09-13T06:43:50.763 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.763 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.763 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:50.763 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:36.459622+0000", 2024-09-13T06:43:50.763 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00018940299999999999 2024-09-13T06:43:50.763 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.763 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.763 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:50.763 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:36.460497+0000", 2024-09-13T06:43:50.763 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00087481199999999999 2024-09-13T06:43:50.763 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:50.763 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:50.763 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:50.763 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.763 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.764 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:159632 3.a 3:57f62123:::rbd_header.112138ed422:head [create,call rbd.create in=9b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e167)", 2024-09-13T06:43:50.764 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:42:07.853351+0000", 2024-09-13T06:43:50.764 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 102.90415511400001, 2024-09-13T06:43:50.764 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.95572760999999995, 2024-09-13T06:43:50.764 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:50.764 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:43:50.764 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:50.764 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:50.764 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:50.764 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 159632 2024-09-13T06:43:50.764 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.764 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:50.764 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.764 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:50.765 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:07.853351+0000", 2024-09-13T06:43:50.765 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:50.765 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.765 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.765 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:50.765 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:07.853351+0000", 2024-09-13T06:43:50.765 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:50.765 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.765 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.765 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:50.765 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:07.853350+0000", 2024-09-13T06:43:50.765 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.999999 2024-09-13T06:43:50.766 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.766 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.766 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:50.766 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:07.853356+0000", 2024-09-13T06:43:50.766 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.1560000000000003e-06 2024-09-13T06:43:50.766 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.766 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.766 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:50.766 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:07.853365+0000", 2024-09-13T06:43:50.766 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.8079999999999999e-06 2024-09-13T06:43:50.766 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.766 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.766 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:50.766 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:07.853372+0000", 2024-09-13T06:43:50.767 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.5540000000000003e-06 2024-09-13T06:43:50.767 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.767 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.767 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:50.767 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:07.853430+0000", 2024-09-13T06:43:50.767 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8038000000000002e-05 2024-09-13T06:43:50.767 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.767 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.767 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:43:50.767 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:07.853444+0000", 2024-09-13T06:43:50.767 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3719e-05 2024-09-13T06:43:50.767 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.767 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.767 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:50.768 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:08.804052+0000", 2024-09-13T06:43:50.768 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.95060817799999997 2024-09-13T06:43:50.768 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.768 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.768 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:50.768 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:08.804234+0000", 2024-09-13T06:43:50.768 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00018192999999999999 2024-09-13T06:43:50.768 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.768 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.768 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 6", 2024-09-13T06:43:50.768 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:08.804797+0000", 2024-09-13T06:43:50.768 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00056282399999999996 2024-09-13T06:43:50.768 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.768 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.769 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-09-13T06:43:50.769 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:08.805704+0000", 2024-09-13T06:43:50.769 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00090781 2024-09-13T06:43:50.769 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.769 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.769 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:43:50.769 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:08.808907+0000", 2024-09-13T06:43:50.769 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0032031239999999999 2024-09-13T06:43:50.769 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.769 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.769 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:43:50.769 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:08.808998+0000", 2024-09-13T06:43:50.769 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.0191000000000004e-05 2024-09-13T06:43:50.770 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.770 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.770 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:50.770 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:08.809079+0000", 2024-09-13T06:43:50.770 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.1076999999999996e-05 2024-09-13T06:43:50.770 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:50.770 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:50.770 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:50.770 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.770 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.770 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:209556 3.6 3:673cd4d4:::rbd_data.1121cb4a09ed.0000000000000002:82 [read 831488~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e220)", 2024-09-13T06:43:50.770 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:43:05.152927+0000", 2024-09-13T06:43:50.770 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 45.604579114000003, 2024-09-13T06:43:50.770 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054987033999999997, 2024-09-13T06:43:50.770 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:50.771 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:50.771 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:50.771 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:50.771 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:50.771 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 209556 2024-09-13T06:43:50.771 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.771 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:50.771 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.771 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:50.771 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.152927+0000", 2024-09-13T06:43:50.771 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:50.771 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.771 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.771 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:50.771 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.152927+0000", 2024-09-13T06:43:50.772 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:50.772 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.772 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.772 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:50.772 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.152927+0000", 2024-09-13T06:43:50.772 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:50.772 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.772 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.772 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:50.772 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.152929+0000", 2024-09-13T06:43:50.772 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.514e-06 2024-09-13T06:43:50.772 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.772 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.773 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:50.773 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.152935+0000", 2024-09-13T06:43:50.773 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.5249999999999996e-06 2024-09-13T06:43:50.773 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.773 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.773 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:50.773 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.152939+0000", 2024-09-13T06:43:50.773 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.3209999999999998e-06 2024-09-13T06:43:50.773 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.773 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.773 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:50.773 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.207752+0000", 2024-09-13T06:43:50.773 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054813273000000003 2024-09-13T06:43:50.774 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.774 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.774 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:50.774 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.207834+0000", 2024-09-13T06:43:50.774 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.1317999999999996e-05 2024-09-13T06:43:50.774 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.774 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.774 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:50.774 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.207914+0000", 2024-09-13T06:43:50.774 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.0568000000000005e-05 2024-09-13T06:43:50.774 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:50.774 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:50.774 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:50.775 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.775 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.775 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:209557 3.6 3:673cd4d4:::rbd_data.1121cb4a09ed.0000000000000002:82 [read 843776~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e220)", 2024-09-13T06:43:50.775 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:43:05.152944+0000", 2024-09-13T06:43:50.775 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 45.604562610000002, 2024-09-13T06:43:50.775 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.055174645000000001, 2024-09-13T06:43:50.775 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:50.775 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:50.775 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:50.775 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:50.775 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:50.775 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 209557 2024-09-13T06:43:50.775 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.776 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:50.776 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.776 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:50.776 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.152944+0000", 2024-09-13T06:43:50.776 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:50.776 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.776 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.776 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:50.776 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.152944+0000", 2024-09-13T06:43:50.776 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:50.776 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.776 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.776 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:50.776 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.152943+0000", 2024-09-13T06:43:50.777 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:50.777 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.777 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.777 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:50.777 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.152946+0000", 2024-09-13T06:43:50.777 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2419999999999999e-06 2024-09-13T06:43:50.777 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.777 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.777 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:50.777 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.152951+0000", 2024-09-13T06:43:50.777 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7570000000000001e-06 2024-09-13T06:43:50.777 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.777 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.778 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:50.778 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.152955+0000", 2024-09-13T06:43:50.778 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.0080000000000004e-06 2024-09-13T06:43:50.778 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.778 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.778 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:50.778 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.207958+0000", 2024-09-13T06:43:50.778 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.055002896000000003 2024-09-13T06:43:50.778 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.778 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.778 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:50.778 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.208041+0000", 2024-09-13T06:43:50.778 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.2962999999999998e-05 2024-09-13T06:43:50.778 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.779 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.779 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:50.779 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.208118+0000", 2024-09-13T06:43:50.779 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.7181000000000005e-05 2024-09-13T06:43:50.779 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:50.779 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:50.779 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:50.779 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.779 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.779 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:209558 3.6 3:673cd4d4:::rbd_data.1121cb4a09ed.0000000000000002:82 [read 856064~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e220)", 2024-09-13T06:43:50.779 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:43:05.152960+0000", 2024-09-13T06:43:50.779 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 45.604546415999998, 2024-09-13T06:43:50.779 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.055296975999999998, 2024-09-13T06:43:50.780 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:50.780 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:50.780 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:50.780 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:50.780 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:50.780 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 209558 2024-09-13T06:43:50.780 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.780 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:50.780 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.780 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:50.780 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.152960+0000", 2024-09-13T06:43:50.780 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:50.780 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.781 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.781 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:50.781 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.152960+0000", 2024-09-13T06:43:50.781 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:50.781 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.781 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.781 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:50.781 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.152959+0000", 2024-09-13T06:43:50.781 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:50.781 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.781 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.781 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:50.782 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.152962+0000", 2024-09-13T06:43:50.782 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6709999999999999e-06 2024-09-13T06:43:50.782 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.782 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.782 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:50.782 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.152968+0000", 2024-09-13T06:43:50.782 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.5589999999999996e-06 2024-09-13T06:43:50.782 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.782 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.782 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:50.782 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.152972+0000", 2024-09-13T06:43:50.782 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.216e-06 2024-09-13T06:43:50.783 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.783 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.783 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:50.783 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.208146+0000", 2024-09-13T06:43:50.783 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.055173627000000003 2024-09-13T06:43:50.783 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.783 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.783 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:50.783 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.208193+0000", 2024-09-13T06:43:50.783 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7200000000000002e-05 2024-09-13T06:43:50.783 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.783 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.783 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:50.784 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.208257+0000", 2024-09-13T06:43:50.784 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.4058000000000002e-05 2024-09-13T06:43:50.784 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:50.784 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:50.784 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:50.784 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.784 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.784 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:209559 3.6 3:673cd4d4:::rbd_data.1121cb4a09ed.0000000000000002:82 [read 868352~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e220)", 2024-09-13T06:43:50.784 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:43:05.152976+0000", 2024-09-13T06:43:50.784 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 45.604530302999997, 2024-09-13T06:43:50.784 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.055514239, 2024-09-13T06:43:50.784 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:50.785 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:50.785 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:50.785 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:50.785 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:50.785 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 209559 2024-09-13T06:43:50.785 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.785 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:50.785 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.785 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:50.785 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.152976+0000", 2024-09-13T06:43:50.785 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:50.785 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.786 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.786 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:50.786 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.152976+0000", 2024-09-13T06:43:50.786 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:50.786 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.786 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.786 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:50.786 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.152976+0000", 2024-09-13T06:43:50.786 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:50.786 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.786 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.786 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:50.786 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.152978+0000", 2024-09-13T06:43:50.786 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2189999999999998e-06 2024-09-13T06:43:50.787 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.787 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.787 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:50.787 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.152983+0000", 2024-09-13T06:43:50.787 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3639999999999998e-06 2024-09-13T06:43:50.787 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.787 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.787 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:50.787 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.152987+0000", 2024-09-13T06:43:50.787 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.9469999999999996e-06 2024-09-13T06:43:50.787 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.787 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.788 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:50.788 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.208301+0000", 2024-09-13T06:43:50.788 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.055314292000000001 2024-09-13T06:43:50.788 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.788 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.788 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:50.788 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.208385+0000", 2024-09-13T06:43:50.788 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.3755e-05 2024-09-13T06:43:50.788 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.788 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.788 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:50.788 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.208490+0000", 2024-09-13T06:43:50.788 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00010498800000000001 2024-09-13T06:43:50.788 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:50.789 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:50.789 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:50.789 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.789 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.789 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:209560 3.6 3:673cd4d4:::rbd_data.1121cb4a09ed.0000000000000002:82 [read 880640~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e220)", 2024-09-13T06:43:50.789 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:43:05.152991+0000", 2024-09-13T06:43:50.789 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 45.604515214000003, 2024-09-13T06:43:50.789 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.05572912, 2024-09-13T06:43:50.789 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:50.789 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:50.789 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:50.789 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:50.789 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:50.790 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 209560 2024-09-13T06:43:50.790 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.790 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:50.790 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.790 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:50.790 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.152991+0000", 2024-09-13T06:43:50.790 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:50.790 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.790 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.790 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:50.790 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.152991+0000", 2024-09-13T06:43:50.790 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:50.790 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.790 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.791 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:50.791 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.152991+0000", 2024-09-13T06:43:50.791 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:50.791 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.791 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.791 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:50.791 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.152993+0000", 2024-09-13T06:43:50.791 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3159999999999999e-06 2024-09-13T06:43:50.791 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.791 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.791 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:50.791 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.152999+0000", 2024-09-13T06:43:50.791 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8529999999999997e-06 2024-09-13T06:43:50.791 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.791 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.792 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:50.792 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153004+0000", 2024-09-13T06:43:50.792 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6210000000000003e-06 2024-09-13T06:43:50.792 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.792 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.792 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:50.792 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.208530+0000", 2024-09-13T06:43:50.792 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.055526407999999999 2024-09-13T06:43:50.792 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.792 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.792 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:50.792 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.208616+0000", 2024-09-13T06:43:50.792 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.6483000000000005e-05 2024-09-13T06:43:50.793 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.793 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.793 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:50.793 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.208720+0000", 2024-09-13T06:43:50.793 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00010376 2024-09-13T06:43:50.793 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:50.793 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:50.793 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:50.793 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.793 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.793 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:209561 3.6 3:673cd4d4:::rbd_data.1121cb4a09ed.0000000000000002:82 [read 892928~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e220)", 2024-09-13T06:43:50.793 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:43:05.153008+0000", 2024-09-13T06:43:50.794 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 45.604498319999998, 2024-09-13T06:43:50.794 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0559225, 2024-09-13T06:43:50.794 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:50.794 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:50.794 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:50.794 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:50.794 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:50.794 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 209561 2024-09-13T06:43:50.794 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.794 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:50.794 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.794 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:50.794 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153008+0000", 2024-09-13T06:43:50.795 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:50.795 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.795 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.795 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:50.795 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153008+0000", 2024-09-13T06:43:50.795 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:50.795 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.795 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.795 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:50.795 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153008+0000", 2024-09-13T06:43:50.795 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:50.795 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.795 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.795 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:50.795 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153010+0000", 2024-09-13T06:43:50.796 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.8210000000000002e-06 2024-09-13T06:43:50.796 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.796 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.796 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:50.796 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153016+0000", 2024-09-13T06:43:50.796 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.575e-06 2024-09-13T06:43:50.796 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.796 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.796 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:50.796 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153020+0000", 2024-09-13T06:43:50.796 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.408e-06 2024-09-13T06:43:50.796 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.796 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.796 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:50.797 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.208751+0000", 2024-09-13T06:43:50.797 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.055730225000000001 2024-09-13T06:43:50.797 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.797 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.797 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:50.797 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.208825+0000", 2024-09-13T06:43:50.797 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4548999999999994e-05 2024-09-13T06:43:50.797 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.797 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.797 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:50.797 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.208930+0000", 2024-09-13T06:43:50.797 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00010529700000000001 2024-09-13T06:43:50.797 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:50.797 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:50.797 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:50.798 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.798 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.798 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:209562 3.6 3:673cd4d4:::rbd_data.1121cb4a09ed.0000000000000002:82 [read 905216~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e220)", 2024-09-13T06:43:50.798 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:43:05.153024+0000", 2024-09-13T06:43:50.798 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 45.604481894000003, 2024-09-13T06:43:50.798 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.056099906999999997, 2024-09-13T06:43:50.798 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:50.798 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:50.798 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:50.798 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:50.798 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:50.798 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 209562 2024-09-13T06:43:50.798 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.798 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:50.799 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.799 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:50.799 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153024+0000", 2024-09-13T06:43:50.799 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:50.799 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.799 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.799 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:50.799 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153024+0000", 2024-09-13T06:43:50.799 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:50.799 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.799 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.799 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:50.799 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153024+0000", 2024-09-13T06:43:50.799 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:50.800 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.800 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.800 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:50.800 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153026+0000", 2024-09-13T06:43:50.800 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.165e-06 2024-09-13T06:43:50.800 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.800 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.800 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:50.800 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153031+0000", 2024-09-13T06:43:50.800 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.1669999999999998e-06 2024-09-13T06:43:50.800 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.800 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.800 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:50.800 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153035+0000", 2024-09-13T06:43:50.801 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.0799999999999999e-06 2024-09-13T06:43:50.801 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.801 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.801 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:50.801 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.208956+0000", 2024-09-13T06:43:50.801 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.055920848000000002 2024-09-13T06:43:50.801 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.801 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.801 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:50.801 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.209032+0000", 2024-09-13T06:43:50.801 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5809999999999994e-05 2024-09-13T06:43:50.801 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.802 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.802 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:50.802 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.209124+0000", 2024-09-13T06:43:50.802 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.2157999999999994e-05 2024-09-13T06:43:50.802 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:50.802 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:50.802 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:50.802 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.802 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.802 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:209563 3.6 3:673cd4d4:::rbd_data.1121cb4a09ed.0000000000000002:82 [read 917504~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e220)", 2024-09-13T06:43:50.802 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:43:05.153039+0000", 2024-09-13T06:43:50.802 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 45.604466930999997, 2024-09-13T06:43:50.802 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.056280030000000002, 2024-09-13T06:43:50.802 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:50.803 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:50.803 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:50.803 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:50.803 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:50.803 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 209563 2024-09-13T06:43:50.803 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.803 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:50.803 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.803 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:50.803 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153039+0000", 2024-09-13T06:43:50.803 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:50.803 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.803 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.803 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:50.804 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153039+0000", 2024-09-13T06:43:50.804 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:50.804 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.804 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.804 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:50.804 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153039+0000", 2024-09-13T06:43:50.804 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:50.804 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.804 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.804 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:50.804 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153041+0000", 2024-09-13T06:43:50.804 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3800000000000001e-06 2024-09-13T06:43:50.804 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.805 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.805 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:50.805 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153047+0000", 2024-09-13T06:43:50.805 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2059999999999998e-06 2024-09-13T06:43:50.805 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.805 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.805 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:50.805 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153051+0000", 2024-09-13T06:43:50.805 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.0980000000000004e-06 2024-09-13T06:43:50.805 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.805 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.805 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:50.805 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.209150+0000", 2024-09-13T06:43:50.806 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.056099351999999998 2024-09-13T06:43:50.806 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.806 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.806 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:50.806 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.209226+0000", 2024-09-13T06:43:50.806 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5939999999999995e-05 2024-09-13T06:43:50.806 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.806 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.806 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:50.806 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.209319+0000", 2024-09-13T06:43:50.806 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.3399000000000005e-05 2024-09-13T06:43:50.806 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:50.806 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:50.807 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:50.807 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.807 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.807 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:209564 3.6 3:673cd4d4:::rbd_data.1121cb4a09ed.0000000000000002:82 [read 929792~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e220)", 2024-09-13T06:43:50.807 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:43:05.153055+0000", 2024-09-13T06:43:50.807 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 45.604451685000001, 2024-09-13T06:43:50.807 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.056404468999999999, 2024-09-13T06:43:50.807 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:50.807 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:50.807 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:50.807 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:50.807 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:50.807 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 209564 2024-09-13T06:43:50.807 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.807 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:50.808 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.808 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:50.808 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153055+0000", 2024-09-13T06:43:50.808 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:50.808 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.808 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.808 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:50.808 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153055+0000", 2024-09-13T06:43:50.808 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:50.808 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.808 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.808 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:50.809 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153054+0000", 2024-09-13T06:43:50.809 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:50.809 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.809 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.809 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:50.809 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153056+0000", 2024-09-13T06:43:50.809 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1600000000000001e-06 2024-09-13T06:43:50.809 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.809 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.809 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:50.809 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153062+0000", 2024-09-13T06:43:50.809 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2549999999999997e-06 2024-09-13T06:43:50.809 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.810 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.810 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:50.810 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153066+0000", 2024-09-13T06:43:50.810 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.0400000000000003e-06 2024-09-13T06:43:50.810 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.810 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.810 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:50.810 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.209342+0000", 2024-09-13T06:43:50.810 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.056276640000000003 2024-09-13T06:43:50.810 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.810 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.810 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:50.810 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.209382+0000", 2024-09-13T06:43:50.811 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.9626999999999999e-05 2024-09-13T06:43:50.811 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.811 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.811 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:50.811 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.209459+0000", 2024-09-13T06:43:50.811 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.7072999999999999e-05 2024-09-13T06:43:50.811 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:50.811 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:50.811 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:50.811 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.811 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.811 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:209565 3.6 3:673cd4d4:::rbd_data.1121cb4a09ed.0000000000000002:82 [read 942080~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e220)", 2024-09-13T06:43:50.811 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:43:05.153070+0000", 2024-09-13T06:43:50.811 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 45.604436712000002, 2024-09-13T06:43:50.812 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.056688545999999999, 2024-09-13T06:43:50.812 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:50.812 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:50.812 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:50.812 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:50.812 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:50.812 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 209565 2024-09-13T06:43:50.812 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.812 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:50.812 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.812 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:50.812 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153070+0000", 2024-09-13T06:43:50.812 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:50.813 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.813 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.813 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:50.813 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153070+0000", 2024-09-13T06:43:50.813 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:50.813 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.813 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.813 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:50.813 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153069+0000", 2024-09-13T06:43:50.813 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:50.813 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.813 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.814 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:50.814 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153071+0000", 2024-09-13T06:43:50.814 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1780000000000002e-06 2024-09-13T06:43:50.814 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.814 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.814 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:50.814 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153077+0000", 2024-09-13T06:43:50.814 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3639999999999998e-06 2024-09-13T06:43:50.814 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.814 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.814 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:50.814 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153081+0000", 2024-09-13T06:43:50.814 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.1640000000000003e-06 2024-09-13T06:43:50.815 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.815 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.815 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:50.815 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.209486+0000", 2024-09-13T06:43:50.815 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.056405258999999999 2024-09-13T06:43:50.815 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.815 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.815 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:50.815 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.209560+0000", 2024-09-13T06:43:50.815 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4247999999999998e-05 2024-09-13T06:43:50.815 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.815 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.815 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:50.816 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.209758+0000", 2024-09-13T06:43:50.816 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000197634 2024-09-13T06:43:50.816 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:50.816 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:50.816 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:50.816 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.816 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.816 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:209566 3.6 3:673cd4d4:::rbd_data.1121cb4a09ed.0000000000000002:82 [read 954368~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e220)", 2024-09-13T06:43:50.816 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:43:05.153085+0000", 2024-09-13T06:43:50.816 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 45.604421403000003, 2024-09-13T06:43:50.816 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.057070779000000002, 2024-09-13T06:43:50.816 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:50.816 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:50.817 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:50.817 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:50.817 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:50.817 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 209566 2024-09-13T06:43:50.817 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.817 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:50.817 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.817 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:50.817 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153085+0000", 2024-09-13T06:43:50.817 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:50.817 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.817 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.817 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:50.817 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153085+0000", 2024-09-13T06:43:50.817 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:50.818 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.818 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.818 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:50.818 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153085+0000", 2024-09-13T06:43:50.818 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:50.818 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.818 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.818 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:50.818 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153087+0000", 2024-09-13T06:43:50.818 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1220000000000002e-06 2024-09-13T06:43:50.818 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.818 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.818 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:50.819 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153092+0000", 2024-09-13T06:43:50.819 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3090000000000003e-06 2024-09-13T06:43:50.819 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.819 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.819 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:50.819 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153096+0000", 2024-09-13T06:43:50.819 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.1819999999999999e-06 2024-09-13T06:43:50.819 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.819 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.819 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:50.819 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.209787+0000", 2024-09-13T06:43:50.819 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.056690819000000003 2024-09-13T06:43:50.819 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.819 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.820 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:50.820 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.209863+0000", 2024-09-13T06:43:50.820 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5551999999999998e-05 2024-09-13T06:43:50.820 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.820 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.820 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:50.820 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.210156+0000", 2024-09-13T06:43:50.820 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00029310499999999999 2024-09-13T06:43:50.820 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:50.820 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:50.820 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:50.820 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.820 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.821 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:209567 3.6 3:673cd4d4:::rbd_data.1121cb4a09ed.0000000000000002:82 [read 966656~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e220)", 2024-09-13T06:43:50.821 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:43:05.153100+0000", 2024-09-13T06:43:50.821 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 45.60440603, 2024-09-13T06:43:50.821 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.057459567000000003, 2024-09-13T06:43:50.821 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:50.821 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:50.821 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:50.821 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:50.821 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:50.821 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 209567 2024-09-13T06:43:50.821 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.821 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:50.821 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.822 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:50.822 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153100+0000", 2024-09-13T06:43:50.822 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:50.822 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.822 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.822 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:50.822 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153100+0000", 2024-09-13T06:43:50.822 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:50.822 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.822 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.822 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:50.822 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153100+0000", 2024-09-13T06:43:50.822 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:50.822 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.822 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.823 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:50.823 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153105+0000", 2024-09-13T06:43:50.823 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.5400000000000003e-06 2024-09-13T06:43:50.823 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.823 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.823 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:50.823 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153111+0000", 2024-09-13T06:43:50.823 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.541e-06 2024-09-13T06:43:50.823 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.823 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.823 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:50.823 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153115+0000", 2024-09-13T06:43:50.823 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.104e-06 2024-09-13T06:43:50.824 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.824 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.824 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:50.824 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.210183+0000", 2024-09-13T06:43:50.824 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.057067842000000001 2024-09-13T06:43:50.824 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.824 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.824 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:50.824 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.210257+0000", 2024-09-13T06:43:50.824 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3726999999999994e-05 2024-09-13T06:43:50.824 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.824 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.824 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:50.825 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.210560+0000", 2024-09-13T06:43:50.825 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00030318899999999999 2024-09-13T06:43:50.825 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:50.825 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:50.825 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:50.825 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.825 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.825 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:209568 3.6 3:673cd4d4:::rbd_data.1121cb4a09ed.0000000000000002:82 [read 978944~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e220)", 2024-09-13T06:43:50.825 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:43:05.153119+0000", 2024-09-13T06:43:50.825 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 45.604386830000003, 2024-09-13T06:43:50.825 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.057810786000000003, 2024-09-13T06:43:50.825 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:50.825 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:50.826 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:50.826 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:50.826 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:50.826 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 209568 2024-09-13T06:43:50.826 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.826 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:50.826 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.826 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:50.826 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153119+0000", 2024-09-13T06:43:50.826 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:50.826 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.826 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.826 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:50.826 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153119+0000", 2024-09-13T06:43:50.827 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:50.827 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.827 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.827 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:50.827 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153119+0000", 2024-09-13T06:43:50.827 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:50.827 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.827 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.827 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:50.827 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153121+0000", 2024-09-13T06:43:50.827 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.21e-06 2024-09-13T06:43:50.827 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.827 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.827 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:50.828 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153127+0000", 2024-09-13T06:43:50.828 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.4670000000000003e-06 2024-09-13T06:43:50.828 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.828 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.828 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:50.828 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153131+0000", 2024-09-13T06:43:50.828 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.2629999999999997e-06 2024-09-13T06:43:50.828 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.828 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.828 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:50.828 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.210587+0000", 2024-09-13T06:43:50.828 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.05745567 2024-09-13T06:43:50.828 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.829 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.829 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:50.829 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.210660+0000", 2024-09-13T06:43:50.829 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3430000000000007e-05 2024-09-13T06:43:50.829 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.829 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.829 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:50.829 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.210930+0000", 2024-09-13T06:43:50.829 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000270127 2024-09-13T06:43:50.829 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:50.829 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:50.829 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:50.829 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.829 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.830 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:209569 3.6 3:673cd4d4:::rbd_data.1121cb4a09ed.0000000000000002:82 [read 991232~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e220)", 2024-09-13T06:43:50.830 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:43:05.153135+0000", 2024-09-13T06:43:50.830 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 45.604371405000002, 2024-09-13T06:43:50.830 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.058283125999999998, 2024-09-13T06:43:50.830 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:50.830 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:50.830 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:50.830 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:50.830 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:50.830 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 209569 2024-09-13T06:43:50.830 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.830 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:50.830 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.831 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:50.831 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153135+0000", 2024-09-13T06:43:50.831 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:50.831 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.831 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.831 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:50.831 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153135+0000", 2024-09-13T06:43:50.831 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:50.831 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.831 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.831 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:50.831 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153135+0000", 2024-09-13T06:43:50.831 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:50.831 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.832 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.832 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:50.832 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153136+0000", 2024-09-13T06:43:50.832 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9069999999999999e-06 2024-09-13T06:43:50.832 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.832 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.832 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:50.832 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153142+0000", 2024-09-13T06:43:50.832 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3009999999999997e-06 2024-09-13T06:43:50.832 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.832 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.832 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:50.832 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153146+0000", 2024-09-13T06:43:50.833 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.442e-06 2024-09-13T06:43:50.833 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.833 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.833 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:50.833 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.210959+0000", 2024-09-13T06:43:50.833 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.057812456999999998 2024-09-13T06:43:50.833 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.833 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.833 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:50.833 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.211038+0000", 2024-09-13T06:43:50.833 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.9140999999999993e-05 2024-09-13T06:43:50.833 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.833 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.834 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:50.834 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.211418+0000", 2024-09-13T06:43:50.834 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00038017500000000001 2024-09-13T06:43:50.834 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:50.834 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:50.834 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:50.834 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.834 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.834 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:209570 3.6 3:673cd4d4:::rbd_data.1121cb4a09ed.0000000000000002:82 [read 1003520~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e220)", 2024-09-13T06:43:50.834 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:43:05.153151+0000", 2024-09-13T06:43:50.834 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 45.604355521999999, 2024-09-13T06:43:50.834 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.058499886000000001, 2024-09-13T06:43:50.834 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:50.834 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:50.835 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:50.835 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:50.835 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:50.835 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 209570 2024-09-13T06:43:50.835 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.835 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:50.835 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.835 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:50.835 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153151+0000", 2024-09-13T06:43:50.835 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:50.835 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.835 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.835 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:50.835 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153151+0000", 2024-09-13T06:43:50.836 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:50.836 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.836 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.836 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:50.836 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153150+0000", 2024-09-13T06:43:50.836 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:50.836 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.836 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.836 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:50.836 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153153+0000", 2024-09-13T06:43:50.836 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3630000000000001e-06 2024-09-13T06:43:50.836 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.836 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.836 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:50.837 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153159+0000", 2024-09-13T06:43:50.837 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3690000000000003e-06 2024-09-13T06:43:50.837 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.837 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.837 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:50.837 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153164+0000", 2024-09-13T06:43:50.837 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5379999999999996e-06 2024-09-13T06:43:50.837 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.837 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.837 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:50.837 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.211448+0000", 2024-09-13T06:43:50.837 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.058283926 2024-09-13T06:43:50.838 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.838 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.838 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:50.838 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.211508+0000", 2024-09-13T06:43:50.838 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0741e-05 2024-09-13T06:43:50.838 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.838 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.838 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:50.838 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.211651+0000", 2024-09-13T06:43:50.838 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00014232200000000001 2024-09-13T06:43:50.838 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:50.838 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:50.838 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:50.839 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.839 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.839 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:209571 3.6 3:673cd4d4:::rbd_data.1121cb4a09ed.0000000000000002:82 [read 1015808~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e220)", 2024-09-13T06:43:50.839 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:43:05.153168+0000", 2024-09-13T06:43:50.839 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 45.604338011000003, 2024-09-13T06:43:50.839 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.058709363000000001, 2024-09-13T06:43:50.839 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:50.839 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:50.839 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:50.839 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:50.839 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:50.839 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 209571 2024-09-13T06:43:50.839 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.839 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:50.839 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.840 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:50.840 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153168+0000", 2024-09-13T06:43:50.840 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:50.840 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.840 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.840 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:50.840 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153168+0000", 2024-09-13T06:43:50.840 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:50.840 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.840 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.840 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:50.840 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153168+0000", 2024-09-13T06:43:50.840 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:50.841 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.841 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.841 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:50.841 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153170+0000", 2024-09-13T06:43:50.841 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4499999999999998e-06 2024-09-13T06:43:50.841 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.841 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.841 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:50.841 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153176+0000", 2024-09-13T06:43:50.841 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0050000000000001e-06 2024-09-13T06:43:50.841 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.841 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.841 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:50.842 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153181+0000", 2024-09-13T06:43:50.842 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.267e-06 2024-09-13T06:43:50.842 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.842 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.842 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:50.842 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.211678+0000", 2024-09-13T06:43:50.842 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.058497751000000001 2024-09-13T06:43:50.842 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.842 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.842 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:50.842 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.211744+0000", 2024-09-13T06:43:50.842 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.5266999999999997e-05 2024-09-13T06:43:50.842 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.842 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.843 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:50.843 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.211878+0000", 2024-09-13T06:43:50.843 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00013394500000000001 2024-09-13T06:43:50.843 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:50.843 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:50.843 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:50.843 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.843 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.843 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:209572 3.6 3:673cd4d4:::rbd_data.1121cb4a09ed.0000000000000002:82 [read 1028096~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e220)", 2024-09-13T06:43:50.843 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:43:05.153185+0000", 2024-09-13T06:43:50.843 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 45.604321616, 2024-09-13T06:43:50.843 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.058928534999999997, 2024-09-13T06:43:50.843 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:50.844 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:50.844 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:50.844 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:50.844 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:50.844 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 209572 2024-09-13T06:43:50.844 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.844 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:50.844 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.844 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:50.844 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153185+0000", 2024-09-13T06:43:50.844 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:50.844 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.845 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.845 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:50.845 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153185+0000", 2024-09-13T06:43:50.845 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:50.845 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.845 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.845 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:50.845 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153184+0000", 2024-09-13T06:43:50.845 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:50.845 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.845 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.845 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:50.845 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153186+0000", 2024-09-13T06:43:50.846 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1040000000000001e-06 2024-09-13T06:43:50.846 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.846 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.846 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:50.846 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153191+0000", 2024-09-13T06:43:50.846 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0409999999999997e-06 2024-09-13T06:43:50.846 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.846 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.846 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:50.846 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153196+0000", 2024-09-13T06:43:50.846 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.2200000000000003e-06 2024-09-13T06:43:50.846 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.846 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.847 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:50.847 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.211906+0000", 2024-09-13T06:43:50.847 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.058709960999999998 2024-09-13T06:43:50.847 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.847 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.847 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:50.847 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.211977+0000", 2024-09-13T06:43:50.847 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.1080000000000004e-05 2024-09-13T06:43:50.847 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.847 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.847 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:50.847 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.212113+0000", 2024-09-13T06:43:50.847 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00013644500000000001 2024-09-13T06:43:50.847 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:50.848 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:50.848 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:50.848 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.848 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.848 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:209573 3.6 3:673cd4d4:::rbd_data.1121cb4a09ed.0000000000000002:82 [read 1040384~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e220)", 2024-09-13T06:43:50.848 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:43:05.153199+0000", 2024-09-13T06:43:50.848 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 45.604306825999998, 2024-09-13T06:43:50.848 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.059182414000000003, 2024-09-13T06:43:50.848 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:50.848 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:50.848 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:50.848 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:50.848 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:50.849 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 209573 2024-09-13T06:43:50.849 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.849 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:50.849 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.849 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:50.849 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153199+0000", 2024-09-13T06:43:50.849 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:50.849 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.849 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.849 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:50.849 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153199+0000", 2024-09-13T06:43:50.849 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:50.850 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.850 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.850 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:50.850 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153199+0000", 2024-09-13T06:43:50.850 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:50.850 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.850 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.850 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:50.850 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153201+0000", 2024-09-13T06:43:50.850 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0470000000000001e-06 2024-09-13T06:43:50.850 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.850 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.850 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:50.850 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153207+0000", 2024-09-13T06:43:50.850 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3730000000000001e-06 2024-09-13T06:43:50.851 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.851 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.851 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:50.851 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153211+0000", 2024-09-13T06:43:50.851 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.053e-06 2024-09-13T06:43:50.851 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.851 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.851 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:50.851 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.212141+0000", 2024-09-13T06:43:50.851 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.058930064999999997 2024-09-13T06:43:50.851 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.851 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.851 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:50.851 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.212214+0000", 2024-09-13T06:43:50.852 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3096999999999995e-05 2024-09-13T06:43:50.852 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.852 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.852 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:50.852 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.212382+0000", 2024-09-13T06:43:50.852 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000168138 2024-09-13T06:43:50.852 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:50.852 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:50.852 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:50.852 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:50.852 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:50.852 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:43:50.854 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-13T06:43:50.854 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:43:50.852+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:43:50.955 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:43:50.956+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:43:50.970 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T06:43:50.970 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:43:50.970 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 265, 2024-09-13T06:43:50.970 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "e5612297-d004-4957-927e-afa37f30d6cf", 2024-09-13T06:43:50.970 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-09-13T06:38:56.670231+0000", 2024-09-13T06:43:50.970 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-09-13T06:43:50.519369+0000", 2024-09-13T06:43:50.970 INFO:teuthology.orchestra.run.smithi081.stdout: "last_up_change": "2024-09-13T06:42:51.723548+0000", 2024-09-13T06:43:50.970 INFO:teuthology.orchestra.run.smithi081.stdout: "last_in_change": "2024-09-13T06:43:33.597346+0000", 2024-09-13T06:43:50.970 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": "noscrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-13T06:43:50.970 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_num": 5801984, 2024-09-13T06:43:50.971 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_set": [ 2024-09-13T06:43:50.971 INFO:teuthology.orchestra.run.smithi081.stdout: "noscrub", 2024-09-13T06:43:50.971 INFO:teuthology.orchestra.run.smithi081.stdout: "pglog_hardlimit", 2024-09-13T06:43:50.971 INFO:teuthology.orchestra.run.smithi081.stdout: "purged_snapdirs", 2024-09-13T06:43:50.971 INFO:teuthology.orchestra.run.smithi081.stdout: "recovery_deletes", 2024-09-13T06:43:50.971 INFO:teuthology.orchestra.run.smithi081.stdout: "sortbitwise" 2024-09-13T06:43:50.971 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-13T06:43:50.971 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_version": 5, 2024-09-13T06:43:50.971 INFO:teuthology.orchestra.run.smithi081.stdout: "full_ratio": 0.94999998807907104, 2024-09-13T06:43:50.971 INFO:teuthology.orchestra.run.smithi081.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-09-13T06:43:50.971 INFO:teuthology.orchestra.run.smithi081.stdout: "nearfull_ratio": 0.85000002384185791, 2024-09-13T06:43:50.971 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_snapshot": "", 2024-09-13T06:43:50.971 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_max": 3, 2024-09-13T06:43:50.972 INFO:teuthology.orchestra.run.smithi081.stdout: "max_osd": 8, 2024-09-13T06:43:50.972 INFO:teuthology.orchestra.run.smithi081.stdout: "require_min_compat_client": "luminous", 2024-09-13T06:43:50.972 INFO:teuthology.orchestra.run.smithi081.stdout: "min_compat_client": "luminous", 2024-09-13T06:43:50.972 INFO:teuthology.orchestra.run.smithi081.stdout: "require_osd_release": "reef", 2024-09-13T06:43:50.972 INFO:teuthology.orchestra.run.smithi081.stdout: "allow_crimson": false, 2024-09-13T06:43:50.972 INFO:teuthology.orchestra.run.smithi081.stdout: "pools": [ 2024-09-13T06:43:50.972 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.972 INFO:teuthology.orchestra.run.smithi081.stdout: "pool": 1, 2024-09-13T06:43:50.972 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_name": ".mgr", 2024-09-13T06:43:50.972 INFO:teuthology.orchestra.run.smithi081.stdout: "create_time": "2024-09-13T06:39:09.600726+0000", 2024-09-13T06:43:50.972 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-13T06:43:50.972 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_names": "hashpspool", 2024-09-13T06:43:50.973 INFO:teuthology.orchestra.run.smithi081.stdout: "type": 1, 2024-09-13T06:43:50.973 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 2, 2024-09-13T06:43:50.973 INFO:teuthology.orchestra.run.smithi081.stdout: "min_size": 1, 2024-09-13T06:43:50.973 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_rule": 0, 2024-09-13T06:43:50.973 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_count": 0, 2024-09-13T06:43:50.973 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_target": 0, 2024-09-13T06:43:50.973 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_barrier": 0, 2024-09-13T06:43:50.973 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-13T06:43:50.973 INFO:teuthology.orchestra.run.smithi081.stdout: "object_hash": 2, 2024-09-13T06:43:50.973 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_mode": "off", 2024-09-13T06:43:50.973 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num": 1, 2024-09-13T06:43:50.973 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num": 1, 2024-09-13T06:43:50.973 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num_target": 1, 2024-09-13T06:43:50.974 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_target": 1, 2024-09-13T06:43:50.974 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_pending": 1, 2024-09-13T06:43:50.974 INFO:teuthology.orchestra.run.smithi081.stdout: "last_pg_merge_meta": { 2024-09-13T06:43:50.974 INFO:teuthology.orchestra.run.smithi081.stdout: "source_pgid": "0.0", 2024-09-13T06:43:50.974 INFO:teuthology.orchestra.run.smithi081.stdout: "ready_epoch": 0, 2024-09-13T06:43:50.974 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_started": 0, 2024-09-13T06:43:50.974 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_clean": 0, 2024-09-13T06:43:50.974 INFO:teuthology.orchestra.run.smithi081.stdout: "source_version": "0'0", 2024-09-13T06:43:50.974 INFO:teuthology.orchestra.run.smithi081.stdout: "target_version": "0'0" 2024-09-13T06:43:50.974 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.974 INFO:teuthology.orchestra.run.smithi081.stdout: "last_change": "16", 2024-09-13T06:43:50.974 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend": "0", 2024-09-13T06:43:50.974 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-13T06:43:50.975 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_preluminous": "0", 2024-09-13T06:43:50.975 INFO:teuthology.orchestra.run.smithi081.stdout: "auid": 0, 2024-09-13T06:43:50.975 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_mode": "selfmanaged", 2024-09-13T06:43:50.975 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_seq": 0, 2024-09-13T06:43:50.975 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_epoch": 0, 2024-09-13T06:43:50.975 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_snaps": [], 2024-09-13T06:43:50.975 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps": "[]", 2024-09-13T06:43:50.975 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_bytes": 0, 2024-09-13T06:43:50.975 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_objects": 0, 2024-09-13T06:43:50.975 INFO:teuthology.orchestra.run.smithi081.stdout: "tiers": [], 2024-09-13T06:43:50.975 INFO:teuthology.orchestra.run.smithi081.stdout: "tier_of": -1, 2024-09-13T06:43:50.975 INFO:teuthology.orchestra.run.smithi081.stdout: "read_tier": -1, 2024-09-13T06:43:50.975 INFO:teuthology.orchestra.run.smithi081.stdout: "write_tier": -1, 2024-09-13T06:43:50.976 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_mode": "none", 2024-09-13T06:43:50.976 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_bytes": 0, 2024-09-13T06:43:50.976 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_objects": 0, 2024-09-13T06:43:50.976 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-13T06:43:50.976 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-13T06:43:50.976 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-13T06:43:50.976 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_flush_age": 0, 2024-09-13T06:43:50.976 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_evict_age": 0, 2024-09-13T06:43:50.976 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profile": "", 2024-09-13T06:43:50.976 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_params": { 2024-09-13T06:43:50.976 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "none" 2024-09-13T06:43:50.976 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.976 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_period": 0, 2024-09-13T06:43:50.977 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_count": 0, 2024-09-13T06:43:50.977 INFO:teuthology.orchestra.run.smithi081.stdout: "use_gmt_hitset": true, 2024-09-13T06:43:50.977 INFO:teuthology.orchestra.run.smithi081.stdout: "min_read_recency_for_promote": 0, 2024-09-13T06:43:50.977 INFO:teuthology.orchestra.run.smithi081.stdout: "min_write_recency_for_promote": 0, 2024-09-13T06:43:50.977 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_grade_decay_rate": 0, 2024-09-13T06:43:50.977 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_search_last_n": 0, 2024-09-13T06:43:50.977 INFO:teuthology.orchestra.run.smithi081.stdout: "grade_table": [], 2024-09-13T06:43:50.977 INFO:teuthology.orchestra.run.smithi081.stdout: "stripe_width": 0, 2024-09-13T06:43:50.977 INFO:teuthology.orchestra.run.smithi081.stdout: "expected_num_objects": 0, 2024-09-13T06:43:50.977 INFO:teuthology.orchestra.run.smithi081.stdout: "fast_read": false, 2024-09-13T06:43:50.977 INFO:teuthology.orchestra.run.smithi081.stdout: "options": { 2024-09-13T06:43:50.977 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_max": 32, 2024-09-13T06:43:50.978 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_min": 1 2024-09-13T06:43:50.978 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.978 INFO:teuthology.orchestra.run.smithi081.stdout: "application_metadata": { 2024-09-13T06:43:50.978 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": {} 2024-09-13T06:43:50.978 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.978 INFO:teuthology.orchestra.run.smithi081.stdout: "read_balance": { 2024-09-13T06:43:50.978 INFO:teuthology.orchestra.run.smithi081.stdout: "score_acting": 6.059999942779541, 2024-09-13T06:43:50.978 INFO:teuthology.orchestra.run.smithi081.stdout: "score_stable": 6.059999942779541, 2024-09-13T06:43:50.978 INFO:teuthology.orchestra.run.smithi081.stdout: "optimal_score": 0.33000001311302185, 2024-09-13T06:43:50.978 INFO:teuthology.orchestra.run.smithi081.stdout: "raw_score_acting": 2, 2024-09-13T06:43:50.978 INFO:teuthology.orchestra.run.smithi081.stdout: "raw_score_stable": 2, 2024-09-13T06:43:50.978 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity_weighted": 0.64948463439941406, 2024-09-13T06:43:50.978 INFO:teuthology.orchestra.run.smithi081.stdout: "average_primary_affinity": 0.87000000476837158, 2024-09-13T06:43:50.978 INFO:teuthology.orchestra.run.smithi081.stdout: "average_primary_affinity_weighted": 0.64999997615814209 2024-09-13T06:43:50.979 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:50.979 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.979 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.979 INFO:teuthology.orchestra.run.smithi081.stdout: "pool": 2, 2024-09-13T06:43:50.979 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_name": "rbd", 2024-09-13T06:43:50.979 INFO:teuthology.orchestra.run.smithi081.stdout: "create_time": "2024-09-13T06:39:15.802118+0000", 2024-09-13T06:43:50.979 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 8193, 2024-09-13T06:43:50.979 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-13T06:43:50.979 INFO:teuthology.orchestra.run.smithi081.stdout: "type": 1, 2024-09-13T06:43:50.979 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 2, 2024-09-13T06:43:50.979 INFO:teuthology.orchestra.run.smithi081.stdout: "min_size": 1, 2024-09-13T06:43:50.979 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_rule": 0, 2024-09-13T06:43:50.979 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_count": 0, 2024-09-13T06:43:50.980 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_target": 0, 2024-09-13T06:43:50.980 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_barrier": 0, 2024-09-13T06:43:50.980 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-13T06:43:50.980 INFO:teuthology.orchestra.run.smithi081.stdout: "object_hash": 2, 2024-09-13T06:43:50.980 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_mode": "off", 2024-09-13T06:43:50.980 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num": 8, 2024-09-13T06:43:50.980 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num": 8, 2024-09-13T06:43:50.980 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num_target": 8, 2024-09-13T06:43:50.980 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_target": 8, 2024-09-13T06:43:50.980 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_pending": 8, 2024-09-13T06:43:50.980 INFO:teuthology.orchestra.run.smithi081.stdout: "last_pg_merge_meta": { 2024-09-13T06:43:50.980 INFO:teuthology.orchestra.run.smithi081.stdout: "source_pgid": "0.0", 2024-09-13T06:43:50.980 INFO:teuthology.orchestra.run.smithi081.stdout: "ready_epoch": 0, 2024-09-13T06:43:50.980 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_started": 0, 2024-09-13T06:43:50.981 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_clean": 0, 2024-09-13T06:43:50.981 INFO:teuthology.orchestra.run.smithi081.stdout: "source_version": "0'0", 2024-09-13T06:43:50.981 INFO:teuthology.orchestra.run.smithi081.stdout: "target_version": "0'0" 2024-09-13T06:43:50.981 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.981 INFO:teuthology.orchestra.run.smithi081.stdout: "last_change": "20", 2024-09-13T06:43:50.981 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend": "0", 2024-09-13T06:43:50.981 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-13T06:43:50.981 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_preluminous": "0", 2024-09-13T06:43:50.981 INFO:teuthology.orchestra.run.smithi081.stdout: "auid": 0, 2024-09-13T06:43:50.981 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_mode": "selfmanaged", 2024-09-13T06:43:50.981 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_seq": 3, 2024-09-13T06:43:50.981 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_epoch": 20, 2024-09-13T06:43:50.981 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_snaps": [], 2024-09-13T06:43:50.982 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps": "[]", 2024-09-13T06:43:50.982 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_bytes": 0, 2024-09-13T06:43:50.982 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_objects": 0, 2024-09-13T06:43:50.982 INFO:teuthology.orchestra.run.smithi081.stdout: "tiers": [], 2024-09-13T06:43:50.982 INFO:teuthology.orchestra.run.smithi081.stdout: "tier_of": -1, 2024-09-13T06:43:50.982 INFO:teuthology.orchestra.run.smithi081.stdout: "read_tier": -1, 2024-09-13T06:43:50.982 INFO:teuthology.orchestra.run.smithi081.stdout: "write_tier": -1, 2024-09-13T06:43:50.982 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_mode": "none", 2024-09-13T06:43:50.982 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_bytes": 0, 2024-09-13T06:43:50.982 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_objects": 0, 2024-09-13T06:43:50.982 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-13T06:43:50.982 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-13T06:43:50.982 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-13T06:43:50.983 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_flush_age": 0, 2024-09-13T06:43:50.983 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_evict_age": 0, 2024-09-13T06:43:50.983 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profile": "", 2024-09-13T06:43:50.983 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_params": { 2024-09-13T06:43:50.983 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "none" 2024-09-13T06:43:50.983 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.983 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_period": 0, 2024-09-13T06:43:50.983 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_count": 0, 2024-09-13T06:43:50.983 INFO:teuthology.orchestra.run.smithi081.stdout: "use_gmt_hitset": true, 2024-09-13T06:43:50.983 INFO:teuthology.orchestra.run.smithi081.stdout: "min_read_recency_for_promote": 0, 2024-09-13T06:43:50.983 INFO:teuthology.orchestra.run.smithi081.stdout: "min_write_recency_for_promote": 0, 2024-09-13T06:43:50.983 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_grade_decay_rate": 0, 2024-09-13T06:43:50.983 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_search_last_n": 0, 2024-09-13T06:43:50.984 INFO:teuthology.orchestra.run.smithi081.stdout: "grade_table": [], 2024-09-13T06:43:50.984 INFO:teuthology.orchestra.run.smithi081.stdout: "stripe_width": 0, 2024-09-13T06:43:50.984 INFO:teuthology.orchestra.run.smithi081.stdout: "expected_num_objects": 0, 2024-09-13T06:43:50.984 INFO:teuthology.orchestra.run.smithi081.stdout: "fast_read": false, 2024-09-13T06:43:50.984 INFO:teuthology.orchestra.run.smithi081.stdout: "options": {}, 2024-09-13T06:43:50.984 INFO:teuthology.orchestra.run.smithi081.stdout: "application_metadata": { 2024-09-13T06:43:50.984 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd": {} 2024-09-13T06:43:50.984 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.984 INFO:teuthology.orchestra.run.smithi081.stdout: "read_balance": { 2024-09-13T06:43:50.984 INFO:teuthology.orchestra.run.smithi081.stdout: "error_message": "pool 2 has some PGs where all OSDs are with primary_affinity 0 (at least pg 2.2), read balance score may not be reliable", 2024-09-13T06:43:50.984 INFO:teuthology.orchestra.run.smithi081.stdout: "score_acting": 0, 2024-09-13T06:43:50.984 INFO:teuthology.orchestra.run.smithi081.stdout: "score_stable": 0 2024-09-13T06:43:50.984 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:50.985 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.985 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.985 INFO:teuthology.orchestra.run.smithi081.stdout: "pool": 3, 2024-09-13T06:43:50.985 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_name": "pool_client.0", 2024-09-13T06:43:50.985 INFO:teuthology.orchestra.run.smithi081.stdout: "create_time": "2024-09-13T06:39:25.648942+0000", 2024-09-13T06:43:50.985 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 8193, 2024-09-13T06:43:50.985 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-13T06:43:50.985 INFO:teuthology.orchestra.run.smithi081.stdout: "type": 1, 2024-09-13T06:43:50.985 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 2, 2024-09-13T06:43:50.985 INFO:teuthology.orchestra.run.smithi081.stdout: "min_size": 1, 2024-09-13T06:43:50.985 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_rule": 0, 2024-09-13T06:43:50.985 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_count": 0, 2024-09-13T06:43:50.985 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_target": 0, 2024-09-13T06:43:50.985 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_barrier": 0, 2024-09-13T06:43:50.986 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-13T06:43:50.986 INFO:teuthology.orchestra.run.smithi081.stdout: "object_hash": 2, 2024-09-13T06:43:50.986 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_mode": "off", 2024-09-13T06:43:50.986 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num": 32, 2024-09-13T06:43:50.986 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num": 32, 2024-09-13T06:43:50.986 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num_target": 32, 2024-09-13T06:43:50.986 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_target": 32, 2024-09-13T06:43:50.986 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_pending": 32, 2024-09-13T06:43:50.986 INFO:teuthology.orchestra.run.smithi081.stdout: "last_pg_merge_meta": { 2024-09-13T06:43:50.986 INFO:teuthology.orchestra.run.smithi081.stdout: "source_pgid": "0.0", 2024-09-13T06:43:50.986 INFO:teuthology.orchestra.run.smithi081.stdout: "ready_epoch": 0, 2024-09-13T06:43:50.986 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_started": 0, 2024-09-13T06:43:50.986 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_clean": 0, 2024-09-13T06:43:50.987 INFO:teuthology.orchestra.run.smithi081.stdout: "source_version": "0'0", 2024-09-13T06:43:50.987 INFO:teuthology.orchestra.run.smithi081.stdout: "target_version": "0'0" 2024-09-13T06:43:50.987 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.987 INFO:teuthology.orchestra.run.smithi081.stdout: "last_change": "265", 2024-09-13T06:43:50.987 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend": "0", 2024-09-13T06:43:50.987 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-13T06:43:50.987 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_preluminous": "0", 2024-09-13T06:43:50.987 INFO:teuthology.orchestra.run.smithi081.stdout: "auid": 0, 2024-09-13T06:43:50.987 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_mode": "selfmanaged", 2024-09-13T06:43:50.987 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_seq": 167, 2024-09-13T06:43:50.987 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_epoch": 265, 2024-09-13T06:43:50.987 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_snaps": [], 2024-09-13T06:43:50.987 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps": "[]", 2024-09-13T06:43:50.988 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_bytes": 0, 2024-09-13T06:43:50.988 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_objects": 0, 2024-09-13T06:43:50.988 INFO:teuthology.orchestra.run.smithi081.stdout: "tiers": [], 2024-09-13T06:43:50.988 INFO:teuthology.orchestra.run.smithi081.stdout: "tier_of": -1, 2024-09-13T06:43:50.988 INFO:teuthology.orchestra.run.smithi081.stdout: "read_tier": -1, 2024-09-13T06:43:50.988 INFO:teuthology.orchestra.run.smithi081.stdout: "write_tier": -1, 2024-09-13T06:43:50.988 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_mode": "none", 2024-09-13T06:43:50.988 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_bytes": 0, 2024-09-13T06:43:50.988 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_objects": 0, 2024-09-13T06:43:50.988 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-13T06:43:50.988 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-13T06:43:50.988 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-13T06:43:50.989 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_flush_age": 0, 2024-09-13T06:43:50.989 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_evict_age": 0, 2024-09-13T06:43:50.989 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profile": "", 2024-09-13T06:43:50.989 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_params": { 2024-09-13T06:43:50.989 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "none" 2024-09-13T06:43:50.989 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.989 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_period": 0, 2024-09-13T06:43:50.989 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_count": 0, 2024-09-13T06:43:50.989 INFO:teuthology.orchestra.run.smithi081.stdout: "use_gmt_hitset": true, 2024-09-13T06:43:50.989 INFO:teuthology.orchestra.run.smithi081.stdout: "min_read_recency_for_promote": 0, 2024-09-13T06:43:50.989 INFO:teuthology.orchestra.run.smithi081.stdout: "min_write_recency_for_promote": 0, 2024-09-13T06:43:50.989 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_grade_decay_rate": 0, 2024-09-13T06:43:50.989 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_search_last_n": 0, 2024-09-13T06:43:50.990 INFO:teuthology.orchestra.run.smithi081.stdout: "grade_table": [], 2024-09-13T06:43:50.990 INFO:teuthology.orchestra.run.smithi081.stdout: "stripe_width": 0, 2024-09-13T06:43:50.990 INFO:teuthology.orchestra.run.smithi081.stdout: "expected_num_objects": 0, 2024-09-13T06:43:50.990 INFO:teuthology.orchestra.run.smithi081.stdout: "fast_read": false, 2024-09-13T06:43:50.990 INFO:teuthology.orchestra.run.smithi081.stdout: "options": {}, 2024-09-13T06:43:50.990 INFO:teuthology.orchestra.run.smithi081.stdout: "application_metadata": { 2024-09-13T06:43:50.990 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd": {} 2024-09-13T06:43:50.990 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.990 INFO:teuthology.orchestra.run.smithi081.stdout: "read_balance": { 2024-09-13T06:43:50.990 INFO:teuthology.orchestra.run.smithi081.stdout: "error_message": "pool 3 has some PGs where all OSDs are with primary_affinity 0 (at least pg 3.10), read balance score may not be reliable", 2024-09-13T06:43:50.990 INFO:teuthology.orchestra.run.smithi081.stdout: "score_acting": 0, 2024-09-13T06:43:50.990 INFO:teuthology.orchestra.run.smithi081.stdout: "score_stable": 0 2024-09-13T06:43:50.990 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:50.991 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:50.991 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-13T06:43:50.991 INFO:teuthology.orchestra.run.smithi081.stdout: "osds": [ 2024-09-13T06:43:50.991 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.991 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 0, 2024-09-13T06:43:50.991 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "54b0a3e4-58ad-4f95-86dc-29a11c9a1964", 2024-09-13T06:43:50.991 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2024-09-13T06:43:50.991 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2024-09-13T06:43:50.991 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2024-09-13T06:43:50.991 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 0, 2024-09-13T06:43:50.991 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2024-09-13T06:43:50.991 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2024-09-13T06:43:50.991 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2024-09-13T06:43:50.992 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 250, 2024-09-13T06:43:50.992 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2024-09-13T06:43:50.992 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2024-09-13T06:43:50.992 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-13T06:43:50.992 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:43:50.992 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.992 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:43:50.992 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6808", 2024-09-13T06:43:50.992 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 1904727940 2024-09-13T06:43:50.992 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.992 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.992 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:43:50.992 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6809", 2024-09-13T06:43:50.993 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 1904727940 2024-09-13T06:43:50.993 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:50.993 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:50.993 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.993 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2024-09-13T06:43:50.993 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:43:50.993 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.993 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:43:50.993 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6810", 2024-09-13T06:43:50.993 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 1904727940 2024-09-13T06:43:50.993 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.993 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.993 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:43:50.994 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6811", 2024-09-13T06:43:50.994 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 1904727940 2024-09-13T06:43:50.994 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:50.994 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:50.994 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.994 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2024-09-13T06:43:50.994 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:43:50.994 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.994 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:43:50.994 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6814", 2024-09-13T06:43:50.994 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 1904727940 2024-09-13T06:43:50.994 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.994 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.995 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:43:50.995 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6815", 2024-09-13T06:43:50.995 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 1904727940 2024-09-13T06:43:50.995 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:50.995 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:50.995 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.995 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2024-09-13T06:43:50.995 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:43:50.995 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.995 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:43:50.995 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6812", 2024-09-13T06:43:50.995 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 1904727940 2024-09-13T06:43:50.995 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.996 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.996 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:43:50.996 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6813", 2024-09-13T06:43:50.996 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 1904727940 2024-09-13T06:43:50.996 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:50.996 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:50.996 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.996 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6809/1904727940", 2024-09-13T06:43:50.996 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.81:6811/1904727940", 2024-09-13T06:43:50.996 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.81:6815/1904727940", 2024-09-13T06:43:50.996 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.81:6813/1904727940", 2024-09-13T06:43:50.996 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2024-09-13T06:43:50.996 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2024-09-13T06:43:50.997 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2024-09-13T06:43:50.997 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:50.997 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.997 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.997 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 1, 2024-09-13T06:43:50.997 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "a6dba5b9-c833-465e-a8a5-1741528b24c0", 2024-09-13T06:43:50.997 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2024-09-13T06:43:50.997 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 0, 2024-09-13T06:43:50.997 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-13T06:43:50.997 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2024-09-13T06:43:50.997 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2024-09-13T06:43:50.997 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2024-09-13T06:43:50.997 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2024-09-13T06:43:50.998 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 221, 2024-09-13T06:43:50.998 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2024-09-13T06:43:50.998 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2024-09-13T06:43:50.998 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-13T06:43:50.998 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:43:50.998 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.998 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:43:50.998 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6817", 2024-09-13T06:43:50.998 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 738205570 2024-09-13T06:43:50.998 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.998 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.998 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:43:50.998 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6819", 2024-09-13T06:43:50.999 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 738205570 2024-09-13T06:43:50.999 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:50.999 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:50.999 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.999 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2024-09-13T06:43:50.999 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:43:50.999 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.999 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:43:50.999 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6822", 2024-09-13T06:43:50.999 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 738205570 2024-09-13T06:43:50.999 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:50.999 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:50.999 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:43:51.000 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6824", 2024-09-13T06:43:51.000 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 738205570 2024-09-13T06:43:51.000 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:51.000 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:51.000 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.000 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2024-09-13T06:43:51.000 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:43:51.000 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.000 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:43:51.000 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6830", 2024-09-13T06:43:51.000 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 738205570 2024-09-13T06:43:51.000 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.000 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.001 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:43:51.001 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6831", 2024-09-13T06:43:51.001 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 738205570 2024-09-13T06:43:51.001 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:51.001 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:51.001 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.001 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2024-09-13T06:43:51.001 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:43:51.001 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.001 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:43:51.001 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6826", 2024-09-13T06:43:51.001 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 738205570 2024-09-13T06:43:51.001 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.002 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.002 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:43:51.002 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6829", 2024-09-13T06:43:51.002 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 738205570 2024-09-13T06:43:51.002 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:51.002 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:51.002 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.002 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6819/738205570", 2024-09-13T06:43:51.002 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.81:6824/738205570", 2024-09-13T06:43:51.002 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.81:6831/738205570", 2024-09-13T06:43:51.002 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.81:6829/738205570", 2024-09-13T06:43:51.002 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2024-09-13T06:43:51.002 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2024-09-13T06:43:51.003 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2024-09-13T06:43:51.003 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:51.003 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.003 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.003 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 2, 2024-09-13T06:43:51.003 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "6c45097e-44a2-454f-80a4-0fe879ccd52f", 2024-09-13T06:43:51.003 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2024-09-13T06:43:51.003 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2024-09-13T06:43:51.003 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2024-09-13T06:43:51.003 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2024-09-13T06:43:51.003 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2024-09-13T06:43:51.003 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2024-09-13T06:43:51.003 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2024-09-13T06:43:51.003 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 251, 2024-09-13T06:43:51.004 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2024-09-13T06:43:51.004 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2024-09-13T06:43:51.004 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-13T06:43:51.004 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:43:51.004 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.004 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:43:51.004 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6816", 2024-09-13T06:43:51.004 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 3558674335 2024-09-13T06:43:51.004 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.004 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.004 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:43:51.004 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6818", 2024-09-13T06:43:51.004 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 3558674335 2024-09-13T06:43:51.005 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:51.005 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:51.005 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.005 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2024-09-13T06:43:51.005 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:43:51.005 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.005 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:43:51.005 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6820", 2024-09-13T06:43:51.005 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 3558674335 2024-09-13T06:43:51.005 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.005 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.005 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:43:51.005 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6821", 2024-09-13T06:43:51.006 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 3558674335 2024-09-13T06:43:51.006 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:51.006 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:51.006 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.006 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2024-09-13T06:43:51.006 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:43:51.006 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.006 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:43:51.006 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6827", 2024-09-13T06:43:51.006 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 3558674335 2024-09-13T06:43:51.006 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.006 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.006 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:43:51.007 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6828", 2024-09-13T06:43:51.007 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 3558674335 2024-09-13T06:43:51.007 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:51.007 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:51.007 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.007 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2024-09-13T06:43:51.007 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:43:51.007 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.007 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:43:51.007 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6823", 2024-09-13T06:43:51.007 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 3558674335 2024-09-13T06:43:51.007 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.007 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.008 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:43:51.008 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6825", 2024-09-13T06:43:51.008 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 3558674335 2024-09-13T06:43:51.008 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:51.008 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:51.008 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.008 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6818/3558674335", 2024-09-13T06:43:51.008 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.81:6821/3558674335", 2024-09-13T06:43:51.008 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.81:6828/3558674335", 2024-09-13T06:43:51.008 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.81:6825/3558674335", 2024-09-13T06:43:51.008 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2024-09-13T06:43:51.008 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2024-09-13T06:43:51.008 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2024-09-13T06:43:51.009 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:51.009 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.009 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.009 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 3, 2024-09-13T06:43:51.009 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "31952760-06f3-4618-a5c4-f5c4fed3aadb", 2024-09-13T06:43:51.009 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2024-09-13T06:43:51.009 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2024-09-13T06:43:51.009 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2024-09-13T06:43:51.009 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2024-09-13T06:43:51.009 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2024-09-13T06:43:51.009 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2024-09-13T06:43:51.009 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2024-09-13T06:43:51.009 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 251, 2024-09-13T06:43:51.010 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2024-09-13T06:43:51.010 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2024-09-13T06:43:51.010 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-13T06:43:51.010 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:43:51.010 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.010 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:43:51.010 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6800", 2024-09-13T06:43:51.010 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 1886327229 2024-09-13T06:43:51.010 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.010 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.010 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:43:51.010 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6801", 2024-09-13T06:43:51.010 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 1886327229 2024-09-13T06:43:51.011 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:51.011 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:51.011 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.011 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2024-09-13T06:43:51.011 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:43:51.011 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.011 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:43:51.011 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6802", 2024-09-13T06:43:51.011 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 1886327229 2024-09-13T06:43:51.011 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.011 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.011 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:43:51.011 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6803", 2024-09-13T06:43:51.012 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 1886327229 2024-09-13T06:43:51.012 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:51.012 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:51.012 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.012 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2024-09-13T06:43:51.012 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:43:51.012 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.012 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:43:51.012 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6806", 2024-09-13T06:43:51.012 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 1886327229 2024-09-13T06:43:51.012 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.012 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.012 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:43:51.013 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6807", 2024-09-13T06:43:51.013 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 1886327229 2024-09-13T06:43:51.013 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:51.013 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:51.013 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.013 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2024-09-13T06:43:51.013 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:43:51.013 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.013 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:43:51.013 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6804", 2024-09-13T06:43:51.013 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 1886327229 2024-09-13T06:43:51.013 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.014 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.014 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:43:51.014 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6805", 2024-09-13T06:43:51.014 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 1886327229 2024-09-13T06:43:51.014 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:51.014 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:51.014 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.014 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6801/1886327229", 2024-09-13T06:43:51.014 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.81:6803/1886327229", 2024-09-13T06:43:51.014 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.81:6807/1886327229", 2024-09-13T06:43:51.014 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.81:6805/1886327229", 2024-09-13T06:43:51.014 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2024-09-13T06:43:51.014 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2024-09-13T06:43:51.015 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2024-09-13T06:43:51.015 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:51.015 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.015 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.015 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 4, 2024-09-13T06:43:51.015 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "c9bd2751-c836-43dc-b844-e13678cb2fd9", 2024-09-13T06:43:51.015 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2024-09-13T06:43:51.015 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2024-09-13T06:43:51.015 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0.58685302734375, 2024-09-13T06:43:51.015 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 0.649200439453125, 2024-09-13T06:43:51.015 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2024-09-13T06:43:51.015 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2024-09-13T06:43:51.015 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2024-09-13T06:43:51.016 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 251, 2024-09-13T06:43:51.016 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2024-09-13T06:43:51.016 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2024-09-13T06:43:51.016 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-13T06:43:51.016 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:43:51.016 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.016 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:43:51.016 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6817", 2024-09-13T06:43:51.016 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2184515621 2024-09-13T06:43:51.016 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.016 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.016 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:43:51.017 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6819", 2024-09-13T06:43:51.017 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2184515621 2024-09-13T06:43:51.017 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:51.017 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:51.017 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.017 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2024-09-13T06:43:51.017 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:43:51.017 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.017 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:43:51.017 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6820", 2024-09-13T06:43:51.017 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2184515621 2024-09-13T06:43:51.017 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.017 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.018 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:43:51.018 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6822", 2024-09-13T06:43:51.018 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2184515621 2024-09-13T06:43:51.018 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:51.018 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:51.018 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.018 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2024-09-13T06:43:51.018 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:43:51.018 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.018 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:43:51.018 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6827", 2024-09-13T06:43:51.018 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2184515621 2024-09-13T06:43:51.018 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.018 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.018 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:43:51.019 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6829", 2024-09-13T06:43:51.019 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2184515621 2024-09-13T06:43:51.019 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:51.019 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:51.019 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.019 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2024-09-13T06:43:51.019 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:43:51.019 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.019 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:43:51.019 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6824", 2024-09-13T06:43:51.019 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2184515621 2024-09-13T06:43:51.019 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.019 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.020 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:43:51.020 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6826", 2024-09-13T06:43:51.020 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2184515621 2024-09-13T06:43:51.020 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:51.020 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:51.020 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.020 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.139:6819/2184515621", 2024-09-13T06:43:51.020 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.139:6822/2184515621", 2024-09-13T06:43:51.020 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.139:6829/2184515621", 2024-09-13T06:43:51.020 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.139:6826/2184515621", 2024-09-13T06:43:51.020 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2024-09-13T06:43:51.020 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2024-09-13T06:43:51.020 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2024-09-13T06:43:51.021 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:51.021 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.021 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.021 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 5, 2024-09-13T06:43:51.021 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "2971b93a-6c9f-4b77-b526-4eac788fabf9", 2024-09-13T06:43:51.021 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2024-09-13T06:43:51.021 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2024-09-13T06:43:51.021 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2024-09-13T06:43:51.021 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 0, 2024-09-13T06:43:51.021 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2024-09-13T06:43:51.021 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2024-09-13T06:43:51.021 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2024-09-13T06:43:51.021 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 248, 2024-09-13T06:43:51.021 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2024-09-13T06:43:51.022 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2024-09-13T06:43:51.022 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-13T06:43:51.022 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:43:51.022 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.022 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:43:51.022 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6816", 2024-09-13T06:43:51.022 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 3982901834 2024-09-13T06:43:51.022 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.022 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.022 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:43:51.022 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6818", 2024-09-13T06:43:51.022 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 3982901834 2024-09-13T06:43:51.022 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:51.023 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:51.023 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.023 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2024-09-13T06:43:51.023 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:43:51.023 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.023 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:43:51.023 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6821", 2024-09-13T06:43:51.023 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 3982901834 2024-09-13T06:43:51.023 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.023 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.023 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:43:51.023 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6823", 2024-09-13T06:43:51.023 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 3982901834 2024-09-13T06:43:51.023 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:51.024 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:51.024 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.024 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2024-09-13T06:43:51.024 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:43:51.024 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.024 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:43:51.024 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6830", 2024-09-13T06:43:51.024 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 3982901834 2024-09-13T06:43:51.024 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.024 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.024 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:43:51.024 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6831", 2024-09-13T06:43:51.025 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 3982901834 2024-09-13T06:43:51.025 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:51.025 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:51.025 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.025 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2024-09-13T06:43:51.025 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:43:51.025 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.025 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:43:51.025 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6825", 2024-09-13T06:43:51.025 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 3982901834 2024-09-13T06:43:51.025 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.025 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.025 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:43:51.026 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6828", 2024-09-13T06:43:51.026 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 3982901834 2024-09-13T06:43:51.026 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:51.026 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:51.026 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.026 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.139:6818/3982901834", 2024-09-13T06:43:51.026 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.139:6823/3982901834", 2024-09-13T06:43:51.026 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.139:6831/3982901834", 2024-09-13T06:43:51.026 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.139:6828/3982901834", 2024-09-13T06:43:51.026 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2024-09-13T06:43:51.026 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2024-09-13T06:43:51.026 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2024-09-13T06:43:51.026 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:51.026 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.026 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.027 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 6, 2024-09-13T06:43:51.027 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "e1f786ce-579e-48cc-b212-83f881b94184", 2024-09-13T06:43:51.027 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 0, 2024-09-13T06:43:51.027 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 0, 2024-09-13T06:43:51.027 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-13T06:43:51.027 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 0.5466766357421875, 2024-09-13T06:43:51.027 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2024-09-13T06:43:51.027 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2024-09-13T06:43:51.027 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2024-09-13T06:43:51.027 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 170, 2024-09-13T06:43:51.027 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 209, 2024-09-13T06:43:51.027 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2024-09-13T06:43:51.027 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-13T06:43:51.028 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:43:51.028 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.028 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:43:51.028 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6800", 2024-09-13T06:43:51.028 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2283932666 2024-09-13T06:43:51.028 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.028 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.028 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:43:51.028 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6801", 2024-09-13T06:43:51.028 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2283932666 2024-09-13T06:43:51.028 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:51.028 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:51.028 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.029 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2024-09-13T06:43:51.029 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:43:51.029 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.029 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:43:51.029 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6802", 2024-09-13T06:43:51.029 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2283932666 2024-09-13T06:43:51.029 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.029 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.029 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:43:51.029 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6803", 2024-09-13T06:43:51.029 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2283932666 2024-09-13T06:43:51.029 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:51.029 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:51.030 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.030 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2024-09-13T06:43:51.030 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:43:51.030 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.030 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:43:51.030 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6806", 2024-09-13T06:43:51.030 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2283932666 2024-09-13T06:43:51.030 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.030 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.030 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:43:51.030 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6807", 2024-09-13T06:43:51.030 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2283932666 2024-09-13T06:43:51.030 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:51.030 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:51.031 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.031 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2024-09-13T06:43:51.031 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:43:51.031 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.031 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:43:51.031 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6804", 2024-09-13T06:43:51.031 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2283932666 2024-09-13T06:43:51.031 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.031 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.031 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:43:51.031 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6805", 2024-09-13T06:43:51.031 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2283932666 2024-09-13T06:43:51.031 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:51.031 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:51.032 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.032 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.139:6801/2283932666", 2024-09-13T06:43:51.032 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.139:6803/2283932666", 2024-09-13T06:43:51.032 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.139:6807/2283932666", 2024-09-13T06:43:51.032 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.139:6805/2283932666", 2024-09-13T06:43:51.032 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2024-09-13T06:43:51.032 INFO:teuthology.orchestra.run.smithi081.stdout: "exists" 2024-09-13T06:43:51.032 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:51.032 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.032 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.032 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 7, 2024-09-13T06:43:51.032 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "a287ddf6-84eb-4225-b267-25eee1657625", 2024-09-13T06:43:51.032 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2024-09-13T06:43:51.032 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2024-09-13T06:43:51.033 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2024-09-13T06:43:51.033 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2024-09-13T06:43:51.033 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 13, 2024-09-13T06:43:51.033 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 121, 2024-09-13T06:43:51.033 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 187, 2024-09-13T06:43:51.033 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 251, 2024-09-13T06:43:51.033 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 122, 2024-09-13T06:43:51.033 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2024-09-13T06:43:51.033 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-13T06:43:51.033 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:43:51.033 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.033 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:43:51.033 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6808", 2024-09-13T06:43:51.034 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 105054579 2024-09-13T06:43:51.034 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.034 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.034 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:43:51.034 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6809", 2024-09-13T06:43:51.034 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 105054579 2024-09-13T06:43:51.034 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:51.034 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:51.034 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.034 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2024-09-13T06:43:51.034 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:43:51.034 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.034 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:43:51.035 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6810", 2024-09-13T06:43:51.035 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 105054579 2024-09-13T06:43:51.035 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.035 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.035 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:43:51.035 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6811", 2024-09-13T06:43:51.035 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 105054579 2024-09-13T06:43:51.035 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:51.035 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:51.035 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.035 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2024-09-13T06:43:51.035 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:43:51.035 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.036 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:43:51.036 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6814", 2024-09-13T06:43:51.036 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 105054579 2024-09-13T06:43:51.036 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.036 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.036 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:43:51.036 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6815", 2024-09-13T06:43:51.036 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 105054579 2024-09-13T06:43:51.036 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:51.036 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:51.036 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.036 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2024-09-13T06:43:51.036 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:43:51.036 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.037 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:43:51.037 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6812", 2024-09-13T06:43:51.037 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 105054579 2024-09-13T06:43:51.037 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.037 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.037 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:43:51.037 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6813", 2024-09-13T06:43:51.037 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 105054579 2024-09-13T06:43:51.037 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:51.037 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:51.037 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.037 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.139:6809/105054579", 2024-09-13T06:43:51.037 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.139:6811/105054579", 2024-09-13T06:43:51.038 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.139:6815/105054579", 2024-09-13T06:43:51.038 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.139:6813/105054579", 2024-09-13T06:43:51.038 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2024-09-13T06:43:51.038 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2024-09-13T06:43:51.038 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2024-09-13T06:43:51.038 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:51.038 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:51.038 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-13T06:43:51.038 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_xinfo": [ 2024-09-13T06:43:51.038 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.038 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 0, 2024-09-13T06:43:51.038 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2024-09-13T06:43:51.039 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2024-09-13T06:43:51.039 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2024-09-13T06:43:51.039 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138322906710015, 2024-09-13T06:43:51.039 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2024-09-13T06:43:51.039 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2024-09-13T06:39:05.476871+0000", 2024-09-13T06:43:51.039 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2024-09-13T06:43:51.039 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.039 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.039 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 1, 2024-09-13T06:43:51.039 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2024-09-13T06:43:51.040 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2024-09-13T06:43:51.040 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2024-09-13T06:43:51.040 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138322906710015, 2024-09-13T06:43:51.040 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 65536, 2024-09-13T06:43:51.040 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2024-09-13T06:39:05.455183+0000", 2024-09-13T06:43:51.040 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2024-09-13T06:43:51.040 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.040 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.040 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 2, 2024-09-13T06:43:51.040 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2024-09-13T06:43:51.040 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2024-09-13T06:43:51.040 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2024-09-13T06:43:51.040 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138322906710015, 2024-09-13T06:43:51.041 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2024-09-13T06:43:51.041 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2024-09-13T06:39:05.504853+0000", 2024-09-13T06:43:51.041 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2024-09-13T06:43:51.041 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.041 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.041 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 3, 2024-09-13T06:43:51.041 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2024-09-13T06:43:51.041 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2024-09-13T06:43:51.041 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2024-09-13T06:43:51.041 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138322906710015, 2024-09-13T06:43:51.041 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2024-09-13T06:43:51.041 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2024-09-13T06:39:05.372429+0000", 2024-09-13T06:43:51.041 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2024-09-13T06:43:51.042 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.042 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.042 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 4, 2024-09-13T06:43:51.042 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2024-09-13T06:43:51.042 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2024-09-13T06:43:51.042 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2024-09-13T06:43:51.042 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138322906710015, 2024-09-13T06:43:51.042 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2024-09-13T06:43:51.042 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2024-09-13T06:39:05.421023+0000", 2024-09-13T06:43:51.042 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2024-09-13T06:43:51.042 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.042 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.042 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 5, 2024-09-13T06:43:51.042 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2024-09-13T06:43:51.043 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2024-09-13T06:43:51.043 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2024-09-13T06:43:51.043 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138322906710015, 2024-09-13T06:43:51.043 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2024-09-13T06:43:51.043 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2024-09-13T06:39:05.477489+0000", 2024-09-13T06:43:51.043 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2024-09-13T06:43:51.043 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.043 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.043 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 6, 2024-09-13T06:43:51.043 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2024-09-13T06:43:51.043 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2024-09-13T06:43:51.043 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2024-09-13T06:43:51.043 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138322906710015, 2024-09-13T06:43:51.043 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 65536, 2024-09-13T06:43:51.044 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2024-09-13T06:39:05.314700+0000", 2024-09-13T06:43:51.044 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 209 2024-09-13T06:43:51.044 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.044 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.044 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 7, 2024-09-13T06:43:51.044 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2024-09-13T06:43:51.044 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2024-09-13T06:43:51.044 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2024-09-13T06:43:51.044 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138322906710015, 2024-09-13T06:43:51.044 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2024-09-13T06:43:51.044 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2024-09-13T06:39:05.462229+0000", 2024-09-13T06:43:51.044 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 122 2024-09-13T06:43:51.045 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:51.045 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-13T06:43:51.045 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_upmap": [ 2024-09-13T06:43:51.045 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.045 INFO:teuthology.orchestra.run.smithi081.stdout: "pgid": "3.9", 2024-09-13T06:43:51.045 INFO:teuthology.orchestra.run.smithi081.stdout: "osds": [ 2024-09-13T06:43:51.045 INFO:teuthology.orchestra.run.smithi081.stdout: 2, 2024-09-13T06:43:51.045 INFO:teuthology.orchestra.run.smithi081.stdout: 6 2024-09-13T06:43:51.045 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:51.045 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.045 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.045 INFO:teuthology.orchestra.run.smithi081.stdout: "pgid": "3.1a", 2024-09-13T06:43:51.045 INFO:teuthology.orchestra.run.smithi081.stdout: "osds": [ 2024-09-13T06:43:51.046 INFO:teuthology.orchestra.run.smithi081.stdout: 2, 2024-09-13T06:43:51.046 INFO:teuthology.orchestra.run.smithi081.stdout: 6 2024-09-13T06:43:51.046 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:51.046 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:51.046 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-13T06:43:51.046 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_upmap_items": [ 2024-09-13T06:43:51.046 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.046 INFO:teuthology.orchestra.run.smithi081.stdout: "pgid": "3.14", 2024-09-13T06:43:51.046 INFO:teuthology.orchestra.run.smithi081.stdout: "mappings": [ 2024-09-13T06:43:51.046 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.046 INFO:teuthology.orchestra.run.smithi081.stdout: "from": 4, 2024-09-13T06:43:51.046 INFO:teuthology.orchestra.run.smithi081.stdout: "to": 2 2024-09-13T06:43:51.046 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:51.047 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:51.047 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:51.047 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-13T06:43:51.047 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_upmap_primaries": [], 2024-09-13T06:43:51.047 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_temp": [], 2024-09-13T06:43:51.047 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_temp": [], 2024-09-13T06:43:51.047 INFO:teuthology.orchestra.run.smithi081.stdout: "blocklist": {}, 2024-09-13T06:43:51.047 INFO:teuthology.orchestra.run.smithi081.stdout: "range_blocklist": {}, 2024-09-13T06:43:51.047 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profiles": { 2024-09-13T06:43:51.047 INFO:teuthology.orchestra.run.smithi081.stdout: "default": { 2024-09-13T06:43:51.047 INFO:teuthology.orchestra.run.smithi081.stdout: "crush-failure-domain": "osd", 2024-09-13T06:43:51.047 INFO:teuthology.orchestra.run.smithi081.stdout: "k": "2", 2024-09-13T06:43:51.047 INFO:teuthology.orchestra.run.smithi081.stdout: "m": "1", 2024-09-13T06:43:51.048 INFO:teuthology.orchestra.run.smithi081.stdout: "plugin": "jerasure", 2024-09-13T06:43:51.048 INFO:teuthology.orchestra.run.smithi081.stdout: "technique": "reed_sol_van" 2024-09-13T06:43:51.048 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:51.048 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.048 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps_queue": [ 2024-09-13T06:43:51.048 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.048 INFO:teuthology.orchestra.run.smithi081.stdout: "pool": 3, 2024-09-13T06:43:51.048 INFO:teuthology.orchestra.run.smithi081.stdout: "snaps": [ 2024-09-13T06:43:51.048 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.048 INFO:teuthology.orchestra.run.smithi081.stdout: "begin": 28, 2024-09-13T06:43:51.048 INFO:teuthology.orchestra.run.smithi081.stdout: "length": 1 2024-09-13T06:43:51.048 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.048 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.049 INFO:teuthology.orchestra.run.smithi081.stdout: "begin": 31, 2024-09-13T06:43:51.049 INFO:teuthology.orchestra.run.smithi081.stdout: "length": 1 2024-09-13T06:43:51.049 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.049 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.049 INFO:teuthology.orchestra.run.smithi081.stdout: "begin": 34, 2024-09-13T06:43:51.049 INFO:teuthology.orchestra.run.smithi081.stdout: "length": 1 2024-09-13T06:43:51.049 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.049 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.049 INFO:teuthology.orchestra.run.smithi081.stdout: "begin": 37, 2024-09-13T06:43:51.049 INFO:teuthology.orchestra.run.smithi081.stdout: "length": 1 2024-09-13T06:43:51.049 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.049 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.050 INFO:teuthology.orchestra.run.smithi081.stdout: "begin": 40, 2024-09-13T06:43:51.050 INFO:teuthology.orchestra.run.smithi081.stdout: "length": 1 2024-09-13T06:43:51.050 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.050 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.050 INFO:teuthology.orchestra.run.smithi081.stdout: "begin": 43, 2024-09-13T06:43:51.050 INFO:teuthology.orchestra.run.smithi081.stdout: "length": 1 2024-09-13T06:43:51.050 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.050 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.050 INFO:teuthology.orchestra.run.smithi081.stdout: "begin": 46, 2024-09-13T06:43:51.050 INFO:teuthology.orchestra.run.smithi081.stdout: "length": 1 2024-09-13T06:43:51.050 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.050 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.050 INFO:teuthology.orchestra.run.smithi081.stdout: "begin": 49, 2024-09-13T06:43:51.051 INFO:teuthology.orchestra.run.smithi081.stdout: "length": 1 2024-09-13T06:43:51.051 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.051 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.051 INFO:teuthology.orchestra.run.smithi081.stdout: "begin": 52, 2024-09-13T06:43:51.051 INFO:teuthology.orchestra.run.smithi081.stdout: "length": 1 2024-09-13T06:43:51.051 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.051 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.051 INFO:teuthology.orchestra.run.smithi081.stdout: "begin": 55, 2024-09-13T06:43:51.051 INFO:teuthology.orchestra.run.smithi081.stdout: "length": 1 2024-09-13T06:43:51.051 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.051 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.051 INFO:teuthology.orchestra.run.smithi081.stdout: "begin": 58, 2024-09-13T06:43:51.051 INFO:teuthology.orchestra.run.smithi081.stdout: "length": 1 2024-09-13T06:43:51.051 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:51.052 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:51.052 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:51.052 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-13T06:43:51.052 INFO:teuthology.orchestra.run.smithi081.stdout: "new_removed_snaps": [ 2024-09-13T06:43:51.052 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.052 INFO:teuthology.orchestra.run.smithi081.stdout: "pool": 3, 2024-09-13T06:43:51.052 INFO:teuthology.orchestra.run.smithi081.stdout: "snaps": [ 2024-09-13T06:43:51.052 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.052 INFO:teuthology.orchestra.run.smithi081.stdout: "begin": 28, 2024-09-13T06:43:51.052 INFO:teuthology.orchestra.run.smithi081.stdout: "length": 1 2024-09-13T06:43:51.052 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:51.052 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:51.052 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:51.053 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-13T06:43:51.053 INFO:teuthology.orchestra.run.smithi081.stdout: "new_purged_snaps": [], 2024-09-13T06:43:51.053 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_node_flags": {}, 2024-09-13T06:43:51.053 INFO:teuthology.orchestra.run.smithi081.stdout: "device_class_flags": {}, 2024-09-13T06:43:51.053 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": { 2024-09-13T06:43:51.053 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode_enabled": false, 2024-09-13T06:43:51.053 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_bucket_count": 0, 2024-09-13T06:43:51.053 INFO:teuthology.orchestra.run.smithi081.stdout: "degraded_stretch_mode": 0, 2024-09-13T06:43:51.053 INFO:teuthology.orchestra.run.smithi081.stdout: "recovering_stretch_mode": 0, 2024-09-13T06:43:51.053 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode_bucket": 0 2024-09-13T06:43:51.053 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:51.053 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:43:51.055 INFO:tasks.thrashosds.thrasher:j is {'epoch': 265, 'fsid': 'e5612297-d004-4957-927e-afa37f30d6cf', 'created': '2024-09-13T06:38:56.670231+0000', 'modified': '2024-09-13T06:43:50.519369+0000', 'last_up_change': '2024-09-13T06:42:51.723548+0000', 'last_in_change': '2024-09-13T06:43:33.597346+0000', 'flags': 'noscrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5801984, 'flags_set': ['noscrub', 'pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 5, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 3, 'max_osd': 8, 'require_min_compat_client': 'luminous', 'min_compat_client': 'luminous', 'require_osd_release': 'reef', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T06:39:09.600726+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 6.059999942779541, 'score_stable': 6.059999942779541, 'optimal_score': 0.33000001311302185, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 0.6494846343994141, 'average_primary_affinity': 0.8700000047683716, 'average_primary_affinity_weighted': 0.6499999761581421}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-09-13T06:39:15.802118+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 3, 'snap_epoch': 20, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'error_message': 'pool 2 has some PGs where all OSDs are with primary_affinity 0 (at least pg 2.2), read balance score may not be reliable', 'score_acting': 0, 'score_stable': 0}}, {'pool': 3, 'pool_name': 'pool_client.0', 'create_time': '2024-09-13T06:39:25.648942+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '265', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 167, 'snap_epoch': 265, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'error_message': 'pool 3 has some PGs where all OSDs are with primary_affinity 0 (at least pg 3.10), read balance score may not be reliable', 'score_acting': 0, 'score_stable': 0}}], 'osds': [{'osd': 0, 'uuid': '54b0a3e4-58ad-4f95-86dc-29a11c9a1964', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 0, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 250, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6808', 'nonce': 1904727940}, {'type': 'v1', 'addr': '172.21.15.81:6809', 'nonce': 1904727940}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6810', 'nonce': 1904727940}, {'type': 'v1', 'addr': '172.21.15.81:6811', 'nonce': 1904727940}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6814', 'nonce': 1904727940}, {'type': 'v1', 'addr': '172.21.15.81:6815', 'nonce': 1904727940}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6812', 'nonce': 1904727940}, {'type': 'v1', 'addr': '172.21.15.81:6813', 'nonce': 1904727940}]}, 'public_addr': '172.21.15.81:6809/1904727940', 'cluster_addr': '172.21.15.81:6811/1904727940', 'heartbeat_back_addr': '172.21.15.81:6815/1904727940', 'heartbeat_front_addr': '172.21.15.81:6813/1904727940', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': 'a6dba5b9-c833-465e-a8a5-1741528b24c0', 'up': 1, 'in': 0, 'weight': 0, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 221, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6817', 'nonce': 738205570}, {'type': 'v1', 'addr': '172.21.15.81:6819', 'nonce': 738205570}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6822', 'nonce': 738205570}, {'type': 'v1', 'addr': '172.21.15.81:6824', 'nonce': 738205570}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6830', 'nonce': 738205570}, {'type': 'v1', 'addr': '172.21.15.81:6831', 'nonce': 738205570}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6826', 'nonce': 738205570}, {'type': 'v1', 'addr': '172.21.15.81:6829', 'nonce': 738205570}]}, 'public_addr': '172.21.15.81:6819/738205570', 'cluster_addr': '172.21.15.81:6824/738205570', 'heartbeat_back_addr': '172.21.15.81:6831/738205570', 'heartbeat_front_addr': '172.21.15.81:6829/738205570', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': '6c45097e-44a2-454f-80a4-0fe879ccd52f', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 251, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6816', 'nonce': 3558674335}, {'type': 'v1', 'addr': '172.21.15.81:6818', 'nonce': 3558674335}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6820', 'nonce': 3558674335}, {'type': 'v1', 'addr': '172.21.15.81:6821', 'nonce': 3558674335}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6827', 'nonce': 3558674335}, {'type': 'v1', 'addr': '172.21.15.81:6828', 'nonce': 3558674335}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6823', 'nonce': 3558674335}, {'type': 'v1', 'addr': '172.21.15.81:6825', 'nonce': 3558674335}]}, 'public_addr': '172.21.15.81:6818/3558674335', 'cluster_addr': '172.21.15.81:6821/3558674335', 'heartbeat_back_addr': '172.21.15.81:6828/3558674335', 'heartbeat_front_addr': '172.21.15.81:6825/3558674335', 'state': ['exists', 'up']}, {'osd': 3, 'uuid': '31952760-06f3-4618-a5c4-f5c4fed3aadb', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 251, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6800', 'nonce': 1886327229}, {'type': 'v1', 'addr': '172.21.15.81:6801', 'nonce': 1886327229}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6802', 'nonce': 1886327229}, {'type': 'v1', 'addr': '172.21.15.81:6803', 'nonce': 1886327229}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6806', 'nonce': 1886327229}, {'type': 'v1', 'addr': '172.21.15.81:6807', 'nonce': 1886327229}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6804', 'nonce': 1886327229}, {'type': 'v1', 'addr': '172.21.15.81:6805', 'nonce': 1886327229}]}, 'public_addr': '172.21.15.81:6801/1886327229', 'cluster_addr': '172.21.15.81:6803/1886327229', 'heartbeat_back_addr': '172.21.15.81:6807/1886327229', 'heartbeat_front_addr': '172.21.15.81:6805/1886327229', 'state': ['exists', 'up']}, {'osd': 4, 'uuid': 'c9bd2751-c836-43dc-b844-e13678cb2fd9', 'up': 1, 'in': 1, 'weight': 0.58685302734375, 'primary_affinity': 0.649200439453125, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 251, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.139:6817', 'nonce': 2184515621}, {'type': 'v1', 'addr': '172.21.15.139:6819', 'nonce': 2184515621}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.139:6820', 'nonce': 2184515621}, {'type': 'v1', 'addr': '172.21.15.139:6822', 'nonce': 2184515621}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.139:6827', 'nonce': 2184515621}, {'type': 'v1', 'addr': '172.21.15.139:6829', 'nonce': 2184515621}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.139:6824', 'nonce': 2184515621}, {'type': 'v1', 'addr': '172.21.15.139:6826', 'nonce': 2184515621}]}, 'public_addr': '172.21.15.139:6819/2184515621', 'cluster_addr': '172.21.15.139:6822/2184515621', 'heartbeat_back_addr': '172.21.15.139:6829/2184515621', 'heartbeat_front_addr': '172.21.15.139:6826/2184515621', 'state': ['exists', 'up']}, {'osd': 5, 'uuid': '2971b93a-6c9f-4b77-b526-4eac788fabf9', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 0, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 248, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.139:6816', 'nonce': 3982901834}, {'type': 'v1', 'addr': '172.21.15.139:6818', 'nonce': 3982901834}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.139:6821', 'nonce': 3982901834}, {'type': 'v1', 'addr': '172.21.15.139:6823', 'nonce': 3982901834}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.139:6830', 'nonce': 3982901834}, {'type': 'v1', 'addr': '172.21.15.139:6831', 'nonce': 3982901834}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.139:6825', 'nonce': 3982901834}, {'type': 'v1', 'addr': '172.21.15.139:6828', 'nonce': 3982901834}]}, 'public_addr': '172.21.15.139:6818/3982901834', 'cluster_addr': '172.21.15.139:6823/3982901834', 'heartbeat_back_addr': '172.21.15.139:6831/3982901834', 'heartbeat_front_addr': '172.21.15.139:6828/3982901834', 'state': ['exists', 'up']}, {'osd': 6, 'uuid': 'e1f786ce-579e-48cc-b212-83f881b94184', 'up': 0, 'in': 0, 'weight': 0, 'primary_affinity': 0.5466766357421875, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 170, 'down_at': 209, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.139:6800', 'nonce': 2283932666}, {'type': 'v1', 'addr': '172.21.15.139:6801', 'nonce': 2283932666}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.139:6802', 'nonce': 2283932666}, {'type': 'v1', 'addr': '172.21.15.139:6803', 'nonce': 2283932666}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.139:6806', 'nonce': 2283932666}, {'type': 'v1', 'addr': '172.21.15.139:6807', 'nonce': 2283932666}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.139:6804', 'nonce': 2283932666}, {'type': 'v1', 'addr': '172.21.15.139:6805', 'nonce': 2283932666}]}, 'public_addr': '172.21.15.139:6801/2283932666', 'cluster_addr': '172.21.15.139:6803/2283932666', 'heartbeat_back_addr': '172.21.15.139:6807/2283932666', 'heartbeat_front_addr': '172.21.15.139:6805/2283932666', 'state': ['exists']}, {'osd': 7, 'uuid': 'a287ddf6-84eb-4225-b267-25eee1657625', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 13, 'last_clean_end': 121, 'up_from': 187, 'up_thru': 251, 'down_at': 122, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.139:6808', 'nonce': 105054579}, {'type': 'v1', 'addr': '172.21.15.139:6809', 'nonce': 105054579}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.139:6810', 'nonce': 105054579}, {'type': 'v1', 'addr': '172.21.15.139:6811', 'nonce': 105054579}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.139:6814', 'nonce': 105054579}, {'type': 'v1', 'addr': '172.21.15.139:6815', 'nonce': 105054579}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.139:6812', 'nonce': 105054579}, {'type': 'v1', 'addr': '172.21.15.139:6813', 'nonce': 105054579}]}, 'public_addr': '172.21.15.139:6809/105054579', 'cluster_addr': '172.21.15.139:6811/105054579', 'heartbeat_back_addr': '172.21.15.139:6815/105054579', 'heartbeat_front_addr': '172.21.15.139:6813/105054579', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-13T06:39:05.476871+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 65536, 'last_purged_snaps_scrub': '2024-09-13T06:39:05.455183+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-13T06:39:05.504853+0000', 'dead_epoch': 0}, {'osd': 3, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-13T06:39:05.372429+0000', 'dead_epoch': 0}, {'osd': 4, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-13T06:39:05.421023+0000', 'dead_epoch': 0}, {'osd': 5, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-13T06:39:05.477489+0000', 'dead_epoch': 0}, {'osd': 6, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 65536, 'last_purged_snaps_scrub': '2024-09-13T06:39:05.314700+0000', 'dead_epoch': 209}, {'osd': 7, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-13T06:39:05.462229+0000', 'dead_epoch': 122}], 'pg_upmap': [{'pgid': '3.9', 'osds': [2, 6]}, {'pgid': '3.1a', 'osds': [2, 6]}], 'pg_upmap_items': [{'pgid': '3.14', 'mappings': [{'from': 4, 'to': 2}]}], 'pg_upmap_primaries': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [{'pool': 3, 'snaps': [{'begin': 28, 'length': 1}, {'begin': 31, 'length': 1}, {'begin': 34, 'length': 1}, {'begin': 37, 'length': 1}, {'begin': 40, 'length': 1}, {'begin': 43, 'length': 1}, {'begin': 46, 'length': 1}, {'begin': 49, 'length': 1}, {'begin': 52, 'length': 1}, {'begin': 55, 'length': 1}, {'begin': 58, 'length': 1}]}], 'new_removed_snaps': [{'pool': 3, 'snaps': [{'begin': 28, 'length': 1}]}], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-09-13T06:43:51.055 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T06:43:51.056 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:43:51.056 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-13T06:43:51.057 INFO:teuthology.orchestra.run.smithi081.stdout: "num_ops": 0 2024-09-13T06:43:51.057 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:43:51.057 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-13T06:43:51.058 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-13T06:43:51.056+0000 7fa8bb18e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 36790) UID: 0 2024-09-13T06:43:51.159 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:43:51.159+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:43:51.220 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:43:51.220 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-13T06:43:51.220 INFO:teuthology.orchestra.run.smithi081.stdout: "complaint_time": 30, 2024-09-13T06:43:51.221 INFO:teuthology.orchestra.run.smithi081.stdout: "num_blocked_ops": 0 2024-09-13T06:43:51.221 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:43:51.238 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-13T06:43:51.260 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-13T06:43:51.260+0000 7fa8bb18e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 36790) UID: 0 2024-09-13T06:43:51.295 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-13T06:43:51.370 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:43:51.371+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:43:51.400 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T06:43:51.401 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-09-13T06:43:51.402 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:43:51.402 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 20, 2024-09-13T06:43:51.402 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 600, 2024-09-13T06:43:51.403 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [ 2024-09-13T06:43:51.403 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.403 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:36160 3.f 3:f62782c2:::rbd_object_map.11219660270d.0000000000000016:head [call] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-13T06:43:51.403 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:01.607291+0000", 2024-09-13T06:43:51.403 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 229.79498662399999, 2024-09-13T06:43:51.403 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.99619456699999998, 2024-09-13T06:43:51.403 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:51.403 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:51.403 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:51.403 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:51.403 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:51.403 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 36160 2024-09-13T06:43:51.404 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.404 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:51.404 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.404 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:51.404 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:01.607291+0000", 2024-09-13T06:43:51.404 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:51.404 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.404 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.404 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:51.404 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:01.607291+0000", 2024-09-13T06:43:51.404 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:51.404 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.404 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.405 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:51.405 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:01.607289+0000", 2024-09-13T06:43:51.405 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999976 2024-09-13T06:43:51.405 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.405 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.405 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:51.405 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:01.607302+0000", 2024-09-13T06:43:51.405 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3018e-05 2024-09-13T06:43:51.405 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.405 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.405 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:51.405 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:01.607323+0000", 2024-09-13T06:43:51.405 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1030999999999999e-05 2024-09-13T06:43:51.406 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.406 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.406 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:51.406 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:01.607342+0000", 2024-09-13T06:43:51.406 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8961e-05 2024-09-13T06:43:51.406 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.406 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.406 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:51.406 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:01.607425+0000", 2024-09-13T06:43:51.406 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.3171999999999996e-05 2024-09-13T06:43:51.406 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.406 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.406 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:43:51.406 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:01.607441+0000", 2024-09-13T06:43:51.407 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5996999999999999e-05 2024-09-13T06:43:51.407 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.407 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.407 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:51.407 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:02.596186+0000", 2024-09-13T06:43:51.407 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.98874432000000001 2024-09-13T06:43:51.407 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.407 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.407 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for missing object", 2024-09-13T06:43:51.407 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:02.596618+0000", 2024-09-13T06:43:51.407 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000432032 2024-09-13T06:43:51.407 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.407 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.408 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:51.408 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:02.600845+0000", 2024-09-13T06:43:51.408 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0042277410000000001 2024-09-13T06:43:51.408 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.408 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.408 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:51.408 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:02.601003+0000", 2024-09-13T06:43:51.408 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00015731999999999999 2024-09-13T06:43:51.408 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.408 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.408 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:51.408 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:02.603486+0000", 2024-09-13T06:43:51.408 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0024832510000000001 2024-09-13T06:43:51.409 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:51.409 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:51.409 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:51.409 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.409 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.409 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:37806 3.9 3:951cb95b:::rbd_data.1121d8143c6e.0000000000000002:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e56)", 2024-09-13T06:43:51.409 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:06.373482+0000", 2024-09-13T06:43:51.409 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 225.02879558800001, 2024-09-13T06:43:51.409 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.002476213, 2024-09-13T06:43:51.409 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:51.409 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:51.409 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:51.409 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:51.409 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:51.410 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 37806 2024-09-13T06:43:51.410 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.410 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:51.410 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.410 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:51.410 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.373482+0000", 2024-09-13T06:43:51.410 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:51.410 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.410 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.410 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:51.410 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.373482+0000", 2024-09-13T06:43:51.410 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:51.410 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.411 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.411 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:51.411 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.373479+0000", 2024-09-13T06:43:51.411 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999962 2024-09-13T06:43:51.411 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.411 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.411 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:51.411 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.373495+0000", 2024-09-13T06:43:51.411 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6640999999999999e-05 2024-09-13T06:43:51.411 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.411 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.411 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:51.411 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.373542+0000", 2024-09-13T06:43:51.411 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6229000000000001e-05 2024-09-13T06:43:51.412 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.412 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.412 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:51.412 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.373564+0000", 2024-09-13T06:43:51.412 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2684000000000002e-05 2024-09-13T06:43:51.412 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.412 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.412 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:51.412 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374268+0000", 2024-09-13T06:43:51.412 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00070363700000000001 2024-09-13T06:43:51.412 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.412 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.413 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:43:51.413 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374305+0000", 2024-09-13T06:43:51.413 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.6936e-05 2024-09-13T06:43:51.413 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.413 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.413 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:51.413 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.375175+0000", 2024-09-13T06:43:51.413 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.000870454 2024-09-13T06:43:51.413 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.413 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.413 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:51.413 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.375678+0000", 2024-09-13T06:43:51.413 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00050292499999999999 2024-09-13T06:43:51.413 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.414 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.414 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:51.414 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.375959+0000", 2024-09-13T06:43:51.414 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00028050599999999997 2024-09-13T06:43:51.414 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:51.414 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:51.414 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:51.414 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.415 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.415 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:37821 3.9 3:951cb95b:::rbd_data.1121d8143c6e.0000000000000002:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e56)", 2024-09-13T06:43:51.415 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:06.374454+0000", 2024-09-13T06:43:51.415 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 225.027824471, 2024-09-13T06:43:51.415 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.002545072, 2024-09-13T06:43:51.415 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:51.415 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:51.415 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:51.415 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:51.415 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:51.416 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 37821 2024-09-13T06:43:51.416 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.416 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:51.416 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.416 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:51.416 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374454+0000", 2024-09-13T06:43:51.416 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:51.416 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.416 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.416 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:51.417 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374454+0000", 2024-09-13T06:43:51.417 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:51.417 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.417 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.417 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:51.417 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374452+0000", 2024-09-13T06:43:51.417 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999981 2024-09-13T06:43:51.417 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.417 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.417 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:51.418 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374463+0000", 2024-09-13T06:43:51.418 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0756e-05 2024-09-13T06:43:51.418 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.418 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.418 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:51.418 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374487+0000", 2024-09-13T06:43:51.418 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4887000000000001e-05 2024-09-13T06:43:51.418 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.418 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.418 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:51.418 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374504+0000", 2024-09-13T06:43:51.418 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6852000000000001e-05 2024-09-13T06:43:51.419 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.419 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.419 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:51.419 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374829+0000", 2024-09-13T06:43:51.419 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000324684 2024-09-13T06:43:51.419 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.419 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.419 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:43:51.419 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374880+0000", 2024-09-13T06:43:51.419 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.1378000000000002e-05 2024-09-13T06:43:51.419 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.419 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.419 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:51.420 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.376423+0000", 2024-09-13T06:43:51.420 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.001542734 2024-09-13T06:43:51.420 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.420 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.420 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:51.420 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.376607+0000", 2024-09-13T06:43:51.420 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000183656 2024-09-13T06:43:51.420 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.420 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.420 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:51.420 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.376999+0000", 2024-09-13T06:43:51.420 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00039191200000000001 2024-09-13T06:43:51.421 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:51.421 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:51.421 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:51.421 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.421 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.421 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:37836 3.9 3:951cb95b:::rbd_data.1121d8143c6e.0000000000000002:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e56)", 2024-09-13T06:43:51.421 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:06.374929+0000", 2024-09-13T06:43:51.421 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 225.027348819, 2024-09-13T06:43:51.421 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.002778825, 2024-09-13T06:43:51.421 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:51.421 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:51.421 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:51.421 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:51.422 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:51.422 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 37836 2024-09-13T06:43:51.422 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.422 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:51.422 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.422 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:51.422 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374929+0000", 2024-09-13T06:43:51.422 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:51.422 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.422 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.422 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:51.422 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374929+0000", 2024-09-13T06:43:51.422 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:51.423 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.423 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.423 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:51.423 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374927+0000", 2024-09-13T06:43:51.423 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999981 2024-09-13T06:43:51.423 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.423 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.423 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:51.423 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374939+0000", 2024-09-13T06:43:51.423 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1846e-05 2024-09-13T06:43:51.423 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.423 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.423 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:51.424 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374962+0000", 2024-09-13T06:43:51.424 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3054e-05 2024-09-13T06:43:51.424 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.424 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.424 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:51.424 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374978+0000", 2024-09-13T06:43:51.424 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5899000000000001e-05 2024-09-13T06:43:51.424 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.424 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.424 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:51.424 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.375106+0000", 2024-09-13T06:43:51.424 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00012789 2024-09-13T06:43:51.425 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.425 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.425 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:43:51.425 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.375134+0000", 2024-09-13T06:43:51.425 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.8254000000000001e-05 2024-09-13T06:43:51.425 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.425 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.425 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:51.425 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.377082+0000", 2024-09-13T06:43:51.425 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0019471520000001 2024-09-13T06:43:51.425 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.425 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.425 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:51.426 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.377330+0000", 2024-09-13T06:43:51.426 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00024834199999999997 2024-09-13T06:43:51.426 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.426 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.426 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:51.426 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.377708+0000", 2024-09-13T06:43:51.426 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00037817100000000001 2024-09-13T06:43:51.426 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:51.426 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:51.426 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:51.426 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.426 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.426 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:37851 3.9 3:951cb95b:::rbd_data.1121d8143c6e.0000000000000002:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e56)", 2024-09-13T06:43:51.427 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:06.382636+0000", 2024-09-13T06:43:51.427 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 225.01964193399999, 2024-09-13T06:43:51.427 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.99582539400000003, 2024-09-13T06:43:51.427 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:51.427 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:51.427 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:51.427 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:51.427 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:51.427 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 37851 2024-09-13T06:43:51.427 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.427 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:51.427 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.427 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:51.428 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.382636+0000", 2024-09-13T06:43:51.428 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:51.428 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.428 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.428 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:51.428 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.382636+0000", 2024-09-13T06:43:51.428 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:51.428 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.428 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.428 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:51.428 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.382633+0000", 2024-09-13T06:43:51.428 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999971 2024-09-13T06:43:51.428 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.428 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.429 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:51.429 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.382652+0000", 2024-09-13T06:43:51.429 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8834999999999998e-05 2024-09-13T06:43:51.429 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.429 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.429 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:51.429 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.382695+0000", 2024-09-13T06:43:51.429 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.3136000000000002e-05 2024-09-13T06:43:51.429 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.429 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.429 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:51.429 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.382716+0000", 2024-09-13T06:43:51.429 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1421e-05 2024-09-13T06:43:51.430 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.430 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.430 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:51.430 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.382860+0000", 2024-09-13T06:43:51.430 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00014389200000000001 2024-09-13T06:43:51.430 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.430 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.430 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:43:51.430 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.382890+0000", 2024-09-13T06:43:51.430 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9827000000000001e-05 2024-09-13T06:43:51.430 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.430 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.430 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:51.430 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.377779+0000", 2024-09-13T06:43:51.430 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.99488842899999996 2024-09-13T06:43:51.431 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.431 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.431 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:51.431 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.378007+0000", 2024-09-13T06:43:51.431 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00022838099999999999 2024-09-13T06:43:51.431 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.431 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.431 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:51.431 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.378462+0000", 2024-09-13T06:43:51.431 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00045452300000000003 2024-09-13T06:43:51.431 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:51.431 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:51.431 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:51.431 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.431 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.432 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:37866 3.9 3:951cb95b:::rbd_data.1121d8143c6e.0000000000000002:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e56)", 2024-09-13T06:43:51.432 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:06.383951+0000", 2024-09-13T06:43:51.432 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 225.01832724799999, 2024-09-13T06:43:51.432 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.99517962299999996, 2024-09-13T06:43:51.432 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:51.432 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:51.432 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:51.432 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:51.432 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:51.432 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 37866 2024-09-13T06:43:51.432 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.432 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:51.433 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.433 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:51.433 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.383951+0000", 2024-09-13T06:43:51.433 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:51.433 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.433 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.433 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:51.433 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.383951+0000", 2024-09-13T06:43:51.433 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:51.433 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.433 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.433 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:51.433 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.383949+0000", 2024-09-13T06:43:51.433 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999981 2024-09-13T06:43:51.434 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.434 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.434 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:51.434 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.383961+0000", 2024-09-13T06:43:51.434 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1999e-05 2024-09-13T06:43:51.434 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.434 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.434 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:51.434 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384019+0000", 2024-09-13T06:43:51.434 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7621000000000003e-05 2024-09-13T06:43:51.434 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.434 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.435 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:51.435 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384040+0000", 2024-09-13T06:43:51.435 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1528000000000001e-05 2024-09-13T06:43:51.435 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.435 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.435 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:51.435 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384186+0000", 2024-09-13T06:43:51.435 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00014573799999999999 2024-09-13T06:43:51.435 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.435 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.435 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:43:51.435 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384204+0000", 2024-09-13T06:43:51.435 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7992e-05 2024-09-13T06:43:51.436 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.436 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.436 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:51.436 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.378536+0000", 2024-09-13T06:43:51.436 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.99433268600000002 2024-09-13T06:43:51.436 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.436 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.436 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:51.436 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.378771+0000", 2024-09-13T06:43:51.436 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00023445399999999999 2024-09-13T06:43:51.436 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.436 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.436 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:51.436 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.379130+0000", 2024-09-13T06:43:51.437 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00035954200000000002 2024-09-13T06:43:51.437 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:51.437 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:51.437 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:51.437 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.437 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.437 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:37881 3.9 3:951cb95b:::rbd_data.1121d8143c6e.0000000000000002:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e56)", 2024-09-13T06:43:51.437 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:06.384239+0000", 2024-09-13T06:43:51.437 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 225.01803883400001, 2024-09-13T06:43:51.437 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.99541483500000005, 2024-09-13T06:43:51.437 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:51.437 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:51.437 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:51.438 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:51.438 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:51.438 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 37881 2024-09-13T06:43:51.438 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.438 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:51.438 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.438 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:51.438 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384239+0000", 2024-09-13T06:43:51.438 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:51.438 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.438 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.438 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:51.438 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384239+0000", 2024-09-13T06:43:51.439 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:51.439 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.439 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.439 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:51.439 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384238+0000", 2024-09-13T06:43:51.439 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999986 2024-09-13T06:43:51.439 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.439 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.439 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:51.439 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384246+0000", 2024-09-13T06:43:51.439 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.2449999999999998e-06 2024-09-13T06:43:51.439 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.439 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.440 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:51.440 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384268+0000", 2024-09-13T06:43:51.440 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1518e-05 2024-09-13T06:43:51.440 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.440 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.440 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:51.440 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384282+0000", 2024-09-13T06:43:51.440 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4501999999999999e-05 2024-09-13T06:43:51.440 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.441 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.441 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:51.441 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384356+0000", 2024-09-13T06:43:51.441 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4265999999999997e-05 2024-09-13T06:43:51.441 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.441 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.441 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:43:51.441 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384370+0000", 2024-09-13T06:43:51.441 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3942e-05 2024-09-13T06:43:51.441 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.441 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.441 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:51.441 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.379199+0000", 2024-09-13T06:43:51.442 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.99482866599999997 2024-09-13T06:43:51.442 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.442 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.442 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:51.442 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.379347+0000", 2024-09-13T06:43:51.442 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00014749199999999999 2024-09-13T06:43:51.442 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.442 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.442 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:51.442 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.379654+0000", 2024-09-13T06:43:51.442 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00030752999999999998 2024-09-13T06:43:51.443 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:51.443 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:51.443 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:51.443 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.443 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.443 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:37896 3.9 3:951cb95b:::rbd_data.1121d8143c6e.0000000000000002:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e56)", 2024-09-13T06:43:51.443 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:06.384412+0000", 2024-09-13T06:43:51.443 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 225.01786640099999, 2024-09-13T06:43:51.443 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.99777835999999998, 2024-09-13T06:43:51.443 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:51.443 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:51.443 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:51.444 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:51.444 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:51.444 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 37896 2024-09-13T06:43:51.444 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.444 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:51.444 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.444 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:51.444 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384412+0000", 2024-09-13T06:43:51.444 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:51.444 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.444 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.444 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:51.445 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384412+0000", 2024-09-13T06:43:51.445 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:51.445 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.445 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.445 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:51.445 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384410+0000", 2024-09-13T06:43:51.445 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.999999 2024-09-13T06:43:51.445 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.445 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.445 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:51.445 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384418+0000", 2024-09-13T06:43:51.445 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.486e-06 2024-09-13T06:43:51.445 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.445 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.446 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:51.446 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384436+0000", 2024-09-13T06:43:51.446 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7668000000000001e-05 2024-09-13T06:43:51.446 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.446 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.446 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:51.446 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384449+0000", 2024-09-13T06:43:51.446 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3395e-05 2024-09-13T06:43:51.446 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.446 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.446 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:51.446 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384605+0000", 2024-09-13T06:43:51.447 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00015563099999999999 2024-09-13T06:43:51.447 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.447 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.447 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:43:51.447 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384635+0000", 2024-09-13T06:43:51.447 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.0383999999999999e-05 2024-09-13T06:43:51.447 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.447 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.447 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:51.447 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.379730+0000", 2024-09-13T06:43:51.447 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.99509493999999998 2024-09-13T06:43:51.447 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.447 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.448 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:51.448 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.379964+0000", 2024-09-13T06:43:51.448 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00023353499999999999 2024-09-13T06:43:51.448 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.448 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.448 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:51.448 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.382190+0000", 2024-09-13T06:43:51.448 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0022265039999999998 2024-09-13T06:43:51.448 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:51.448 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:51.448 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:51.448 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.448 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.449 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43223 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 393216~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:43:51.449 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558267+0000", 2024-09-13T06:43:51.449 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 209.84401109000001, 2024-09-13T06:43:51.449 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.062813151999999997, 2024-09-13T06:43:51.449 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:51.449 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:51.449 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:51.449 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:51.449 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:51.449 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43223 2024-09-13T06:43:51.449 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.449 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:51.450 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.450 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:51.450 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558267+0000", 2024-09-13T06:43:51.450 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:51.450 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.450 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.450 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:51.450 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558267+0000", 2024-09-13T06:43:51.450 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:51.450 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.450 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.450 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:51.450 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558266+0000", 2024-09-13T06:43:51.451 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:51.451 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.451 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.451 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:51.451 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558270+0000", 2024-09-13T06:43:51.451 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.2389999999999998e-06 2024-09-13T06:43:51.451 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.451 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.451 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:51.451 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558277+0000", 2024-09-13T06:43:51.451 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5680000000000002e-06 2024-09-13T06:43:51.451 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.451 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.452 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:51.452 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558282+0000", 2024-09-13T06:43:51.452 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7060000000000003e-06 2024-09-13T06:43:51.452 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.452 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.452 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:51.452 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.620731+0000", 2024-09-13T06:43:51.452 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.062448661000000003 2024-09-13T06:43:51.452 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.452 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.452 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:51.452 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.620806+0000", 2024-09-13T06:43:51.452 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5862e-05 2024-09-13T06:43:51.453 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.453 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.453 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:51.453 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.621080+0000", 2024-09-13T06:43:51.453 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00027368599999999998 2024-09-13T06:43:51.453 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:51.453 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:51.453 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:51.453 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.453 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.453 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43224 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 407552~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:43:51.453 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558286+0000", 2024-09-13T06:43:51.454 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 209.84399172600001, 2024-09-13T06:43:51.454 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.063179052999999999, 2024-09-13T06:43:51.454 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:51.454 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:51.454 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:51.454 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:51.454 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:51.454 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43224 2024-09-13T06:43:51.454 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.454 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:51.454 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.454 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:51.454 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558286+0000", 2024-09-13T06:43:51.455 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:51.455 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.455 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.455 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:51.455 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558286+0000", 2024-09-13T06:43:51.455 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:51.455 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.455 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.455 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:51.455 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558286+0000", 2024-09-13T06:43:51.455 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:51.455 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.455 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.455 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:51.456 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558288+0000", 2024-09-13T06:43:51.456 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.227e-06 2024-09-13T06:43:51.456 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.456 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.456 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:51.456 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558292+0000", 2024-09-13T06:43:51.456 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.6289999999999999e-06 2024-09-13T06:43:51.456 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.456 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.456 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:51.456 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558294+0000", 2024-09-13T06:43:51.456 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5409999999999999e-06 2024-09-13T06:43:51.456 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.457 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.457 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:51.457 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.621110+0000", 2024-09-13T06:43:51.457 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.062815776000000004 2024-09-13T06:43:51.457 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.457 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.457 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:51.457 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.621186+0000", 2024-09-13T06:43:51.457 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5570999999999999e-05 2024-09-13T06:43:51.457 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.457 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.457 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:51.457 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.621465+0000", 2024-09-13T06:43:51.458 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00027988200000000001 2024-09-13T06:43:51.458 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:51.458 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:51.458 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:51.458 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.458 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.458 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43225 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 421888~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:43:51.458 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558296+0000", 2024-09-13T06:43:51.458 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 209.843981759, 2024-09-13T06:43:51.458 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.063551110999999993, 2024-09-13T06:43:51.458 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:51.458 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:51.458 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:51.459 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:51.459 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:51.459 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43225 2024-09-13T06:43:51.459 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.459 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:51.459 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.459 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:51.459 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558296+0000", 2024-09-13T06:43:51.459 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:51.459 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.459 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.459 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:51.459 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558296+0000", 2024-09-13T06:43:51.459 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:51.460 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.460 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.460 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:51.460 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558296+0000", 2024-09-13T06:43:51.460 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:43:51.460 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.460 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.460 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:51.460 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558305+0000", 2024-09-13T06:43:51.460 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.5290000000000008e-06 2024-09-13T06:43:51.460 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.460 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.460 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:51.461 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558308+0000", 2024-09-13T06:43:51.461 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.5619999999999999e-06 2024-09-13T06:43:51.461 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.461 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.461 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:51.461 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558311+0000", 2024-09-13T06:43:51.461 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.43e-06 2024-09-13T06:43:51.461 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.461 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.461 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:51.461 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.621495+0000", 2024-09-13T06:43:51.461 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.063184289000000005 2024-09-13T06:43:51.461 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.462 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.462 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:51.462 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.621569+0000", 2024-09-13T06:43:51.462 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4250000000000002e-05 2024-09-13T06:43:51.462 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.462 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.462 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:51.462 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.621847+0000", 2024-09-13T06:43:51.462 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00027826400000000002 2024-09-13T06:43:51.462 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:51.462 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:51.462 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:51.462 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.463 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.463 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43226 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 436224~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:43:51.463 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558313+0000", 2024-09-13T06:43:51.463 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 209.843965123, 2024-09-13T06:43:51.463 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.063914420999999999, 2024-09-13T06:43:51.463 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:51.463 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:51.463 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:51.463 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:51.463 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:51.463 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43226 2024-09-13T06:43:51.463 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.463 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:51.463 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.464 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:51.464 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558313+0000", 2024-09-13T06:43:51.464 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:51.464 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.464 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.464 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:51.464 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558313+0000", 2024-09-13T06:43:51.464 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:51.464 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.464 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.464 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:51.464 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558313+0000", 2024-09-13T06:43:51.464 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:51.465 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.465 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.465 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:51.465 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558314+0000", 2024-09-13T06:43:51.465 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3740000000000001e-06 2024-09-13T06:43:51.465 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.465 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.465 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:51.465 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558317+0000", 2024-09-13T06:43:51.465 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9730000000000002e-06 2024-09-13T06:43:51.465 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.465 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.465 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:51.466 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558319+0000", 2024-09-13T06:43:51.466 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4059999999999999e-06 2024-09-13T06:43:51.466 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.466 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.466 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:51.466 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.621877+0000", 2024-09-13T06:43:51.466 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.063557408999999995 2024-09-13T06:43:51.466 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.466 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.466 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:51.466 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.621951+0000", 2024-09-13T06:43:51.466 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4487999999999996e-05 2024-09-13T06:43:51.466 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.466 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.466 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:51.467 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.622227+0000", 2024-09-13T06:43:51.467 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000276011 2024-09-13T06:43:51.467 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:51.467 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:51.467 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:51.467 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.467 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.467 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43227 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 450560~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:43:51.467 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558322+0000", 2024-09-13T06:43:51.467 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 209.843956542, 2024-09-13T06:43:51.467 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.064285348000000006, 2024-09-13T06:43:51.467 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:51.467 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:51.467 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:51.468 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:51.468 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:51.468 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43227 2024-09-13T06:43:51.468 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.468 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:51.468 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.468 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:51.468 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558322+0000", 2024-09-13T06:43:51.468 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:51.468 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.468 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.468 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:51.469 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558322+0000", 2024-09-13T06:43:51.469 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:51.469 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.469 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.469 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:51.469 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558321+0000", 2024-09-13T06:43:51.469 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:43:51.469 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.469 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.469 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:51.469 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558323+0000", 2024-09-13T06:43:51.469 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.576e-06 2024-09-13T06:43:51.470 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.470 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.470 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:51.470 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558328+0000", 2024-09-13T06:43:51.470 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0719999999999999e-06 2024-09-13T06:43:51.470 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.470 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.470 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:51.470 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558332+0000", 2024-09-13T06:43:51.470 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.8130000000000002e-06 2024-09-13T06:43:51.470 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.470 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.470 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:51.471 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.622255+0000", 2024-09-13T06:43:51.471 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.063923195000000002 2024-09-13T06:43:51.471 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.471 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.471 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:51.471 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.622330+0000", 2024-09-13T06:43:51.471 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5383000000000007e-05 2024-09-13T06:43:51.471 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.471 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.471 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:51.471 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.622607+0000", 2024-09-13T06:43:51.471 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00027651999999999999 2024-09-13T06:43:51.471 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:51.472 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:51.472 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:51.472 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.472 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.472 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43228 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 464896~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:43:51.472 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558335+0000", 2024-09-13T06:43:51.472 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 209.84394263300001, 2024-09-13T06:43:51.472 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.064652253000000007, 2024-09-13T06:43:51.472 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:51.472 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:51.472 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:51.472 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:51.472 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:51.473 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43228 2024-09-13T06:43:51.473 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.473 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:51.473 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.473 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:51.473 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558335+0000", 2024-09-13T06:43:51.473 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:51.473 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.473 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.473 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:51.473 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558335+0000", 2024-09-13T06:43:51.473 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:51.473 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.474 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.474 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:51.474 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558335+0000", 2024-09-13T06:43:51.474 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:51.474 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.474 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.474 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:51.474 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558337+0000", 2024-09-13T06:43:51.474 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1380000000000001e-06 2024-09-13T06:43:51.474 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.474 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.474 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:51.474 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558343+0000", 2024-09-13T06:43:51.474 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.5140000000000001e-06 2024-09-13T06:43:51.475 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.475 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.475 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:51.475 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558348+0000", 2024-09-13T06:43:51.475 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9640000000000002e-06 2024-09-13T06:43:51.475 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.475 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.475 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:51.475 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.622636+0000", 2024-09-13T06:43:51.475 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.064288260999999999 2024-09-13T06:43:51.475 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.475 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.476 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:51.476 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.622715+0000", 2024-09-13T06:43:51.476 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.9351000000000006e-05 2024-09-13T06:43:51.476 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.476 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.476 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:51.476 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.622988+0000", 2024-09-13T06:43:51.476 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00027242599999999998 2024-09-13T06:43:51.476 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:51.476 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:51.476 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:51.476 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.476 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.477 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43229 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 479232~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:43:51.477 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558352+0000", 2024-09-13T06:43:51.477 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 209.84392621800001, 2024-09-13T06:43:51.477 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.065018024999999993, 2024-09-13T06:43:51.477 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:51.477 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:51.477 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:51.477 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:51.477 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:51.477 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43229 2024-09-13T06:43:51.477 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.477 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:51.477 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.477 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:51.478 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558352+0000", 2024-09-13T06:43:51.478 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:51.478 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.478 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.478 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:51.478 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558352+0000", 2024-09-13T06:43:51.478 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:51.478 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.478 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.478 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:51.478 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558352+0000", 2024-09-13T06:43:51.478 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:51.479 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.479 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.479 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:51.479 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558354+0000", 2024-09-13T06:43:51.479 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4930000000000001e-06 2024-09-13T06:43:51.479 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.479 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.479 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:51.479 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558360+0000", 2024-09-13T06:43:51.479 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.263e-06 2024-09-13T06:43:51.479 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.479 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.479 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:51.480 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558369+0000", 2024-09-13T06:43:51.480 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.0829999999999993e-06 2024-09-13T06:43:51.480 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.480 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.480 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:51.480 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.623017+0000", 2024-09-13T06:43:51.480 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.064647799000000006 2024-09-13T06:43:51.480 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.480 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.480 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:51.480 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.623090+0000", 2024-09-13T06:43:51.480 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3071000000000006e-05 2024-09-13T06:43:51.480 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.481 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.481 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:51.481 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.623370+0000", 2024-09-13T06:43:51.481 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000279661 2024-09-13T06:43:51.481 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:51.481 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:51.481 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:51.481 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.481 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.481 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43230 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 493568~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:43:51.481 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558374+0000", 2024-09-13T06:43:51.482 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 209.84390392500001, 2024-09-13T06:43:51.482 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.065410435000000003, 2024-09-13T06:43:51.482 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:51.482 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:51.482 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:51.482 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:51.482 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:51.482 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43230 2024-09-13T06:43:51.482 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.482 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:51.482 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.482 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:51.482 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558374+0000", 2024-09-13T06:43:51.483 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:51.483 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.483 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.483 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:51.483 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558374+0000", 2024-09-13T06:43:51.483 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:51.483 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.483 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.483 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:51.483 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558374+0000", 2024-09-13T06:43:51.483 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:51.483 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.484 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.484 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:51.484 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558376+0000", 2024-09-13T06:43:51.484 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4430000000000002e-06 2024-09-13T06:43:51.484 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.484 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.484 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:51.484 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558382+0000", 2024-09-13T06:43:51.484 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3029999999999996e-06 2024-09-13T06:43:51.484 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.485 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.485 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:51.485 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558387+0000", 2024-09-13T06:43:51.485 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.1699999999999999e-06 2024-09-13T06:43:51.485 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.485 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.485 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:51.485 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.623400+0000", 2024-09-13T06:43:51.485 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.065013244999999997 2024-09-13T06:43:51.485 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.485 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.485 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:51.485 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.623474+0000", 2024-09-13T06:43:51.486 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3889999999999999e-05 2024-09-13T06:43:51.486 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.486 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.486 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:51.486 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.623785+0000", 2024-09-13T06:43:51.486 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00031080099999999998 2024-09-13T06:43:51.486 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:51.486 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:51.486 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:51.486 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.486 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.486 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43231 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 507904~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:43:51.487 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558391+0000", 2024-09-13T06:43:51.487 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 209.84388723999999, 2024-09-13T06:43:51.487 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.065788597000000004, 2024-09-13T06:43:51.487 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:51.487 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:51.487 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:51.487 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:51.487 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:51.487 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43231 2024-09-13T06:43:51.487 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.487 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:51.487 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.487 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:51.488 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558391+0000", 2024-09-13T06:43:51.488 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:51.488 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.488 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.488 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:51.488 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558391+0000", 2024-09-13T06:43:51.488 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:51.488 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.488 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.488 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:51.488 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558390+0000", 2024-09-13T06:43:51.488 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:51.488 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.489 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.489 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:51.489 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558393+0000", 2024-09-13T06:43:51.489 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2570000000000002e-06 2024-09-13T06:43:51.489 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.489 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.489 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:51.489 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558399+0000", 2024-09-13T06:43:51.489 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0419999999999999e-06 2024-09-13T06:43:51.489 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.489 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.489 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:51.490 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558403+0000", 2024-09-13T06:43:51.490 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6249999999999998e-06 2024-09-13T06:43:51.490 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.490 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.490 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:51.490 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.623811+0000", 2024-09-13T06:43:51.490 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.065407549999999995 2024-09-13T06:43:51.490 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.490 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.490 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:51.490 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.623877+0000", 2024-09-13T06:43:51.490 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.5902999999999996e-05 2024-09-13T06:43:51.491 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.491 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.491 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:51.491 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.624179+0000", 2024-09-13T06:43:51.491 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00030259999999999998 2024-09-13T06:43:51.491 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:51.491 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:51.491 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:51.491 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.491 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.491 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43232 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 522240~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:43:51.491 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558422+0000", 2024-09-13T06:43:51.491 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 209.84385646300001, 2024-09-13T06:43:51.492 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.066176061999999994, 2024-09-13T06:43:51.492 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:51.492 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:51.492 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:51.492 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:51.492 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:51.492 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43232 2024-09-13T06:43:51.492 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.492 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:51.492 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.492 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:51.492 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558422+0000", 2024-09-13T06:43:51.492 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:51.492 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.493 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.493 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:51.493 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558422+0000", 2024-09-13T06:43:51.493 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:51.493 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.493 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.493 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:51.493 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558421+0000", 2024-09-13T06:43:51.493 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:51.493 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.493 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.493 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:51.493 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558428+0000", 2024-09-13T06:43:51.494 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.1690000000000003e-06 2024-09-13T06:43:51.494 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.494 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.494 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:51.494 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558434+0000", 2024-09-13T06:43:51.494 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9309999999999996e-06 2024-09-13T06:43:51.494 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.494 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.494 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:51.494 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558447+0000", 2024-09-13T06:43:51.494 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.271e-05 2024-09-13T06:43:51.494 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.494 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.495 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:51.495 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.624209+0000", 2024-09-13T06:43:51.495 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.065762102000000003 2024-09-13T06:43:51.495 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.495 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.495 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:51.495 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.624282+0000", 2024-09-13T06:43:51.495 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.2889e-05 2024-09-13T06:43:51.495 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.495 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.495 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:51.495 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.624598+0000", 2024-09-13T06:43:51.496 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00031591399999999998 2024-09-13T06:43:51.496 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:51.496 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:51.496 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:51.496 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.496 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.496 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43486 3.f 3:f7da9c8f:::rbd_data.1121f5f2e1c0.000000000000000b:1f [read 260096~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:43:51.496 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.569088+0000", 2024-09-13T06:43:51.496 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 209.83318973999999, 2024-09-13T06:43:51.496 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.062579223000000003, 2024-09-13T06:43:51.496 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:51.496 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:51.496 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:51.497 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:51.497 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:51.497 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43486 2024-09-13T06:43:51.497 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.497 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:51.497 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.497 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:51.497 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.569088+0000", 2024-09-13T06:43:51.497 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:51.497 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.497 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.497 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:51.498 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.569088+0000", 2024-09-13T06:43:51.498 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:51.498 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.498 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.498 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:51.498 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.569088+0000", 2024-09-13T06:43:51.498 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:51.498 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.498 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.498 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:51.498 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.569091+0000", 2024-09-13T06:43:51.498 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9629999999999998e-06 2024-09-13T06:43:51.498 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.499 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.499 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:51.499 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.569097+0000", 2024-09-13T06:43:51.499 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.4160000000000001e-06 2024-09-13T06:43:51.499 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.499 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.499 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:51.499 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.569102+0000", 2024-09-13T06:43:51.499 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6659999999999999e-06 2024-09-13T06:43:51.499 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.499 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.499 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:51.499 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.631346+0000", 2024-09-13T06:43:51.500 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.062243896 2024-09-13T06:43:51.500 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.500 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.500 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:51.500 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.631413+0000", 2024-09-13T06:43:51.500 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.7638000000000005e-05 2024-09-13T06:43:51.500 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.500 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.500 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:51.500 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.631668+0000", 2024-09-13T06:43:51.500 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0002541 2024-09-13T06:43:51.500 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:51.501 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:51.501 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:51.501 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.501 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.501 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:170125 3.9 3:94e4bf8d:::rbd_object_map.1121fa0cc8a3.000000000000006d:head [writefull 0~37] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e190)", 2024-09-13T06:43:51.501 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:42:30.601501+0000", 2024-09-13T06:43:51.501 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 80.800777529000001, 2024-09-13T06:43:51.501 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.80498820000000004, 2024-09-13T06:43:51.501 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:51.501 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:43:51.501 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:51.501 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:51.502 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:51.502 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 170125 2024-09-13T06:43:51.502 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.502 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:51.502 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.502 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:51.502 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:30.601501+0000", 2024-09-13T06:43:51.502 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:51.502 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.502 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.502 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:51.502 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:30.601501+0000", 2024-09-13T06:43:51.502 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:51.502 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.502 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.503 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:51.503 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:30.601499+0000", 2024-09-13T06:43:51.503 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999986 2024-09-13T06:43:51.503 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.503 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.503 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:51.503 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:30.601506+0000", 2024-09-13T06:43:51.503 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.9940000000000003e-06 2024-09-13T06:43:51.503 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.503 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.503 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:51.503 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:30.601519+0000", 2024-09-13T06:43:51.503 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2875e-05 2024-09-13T06:43:51.503 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.504 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.504 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:51.504 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:30.601525+0000", 2024-09-13T06:43:51.504 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8549999999999998e-06 2024-09-13T06:43:51.504 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.504 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.504 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:51.504 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:30.601560+0000", 2024-09-13T06:43:51.504 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.5271000000000002e-05 2024-09-13T06:43:51.504 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.504 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.504 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:43:51.504 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:30.601566+0000", 2024-09-13T06:43:51.504 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3090000000000001e-06 2024-09-13T06:43:51.505 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.505 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.505 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:51.505 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:31.403017+0000", 2024-09-13T06:43:51.505 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.80145064200000005 2024-09-13T06:43:51.505 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.505 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.505 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:51.505 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:31.403252+0000", 2024-09-13T06:43:51.505 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000234718 2024-09-13T06:43:51.505 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.505 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.505 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 7", 2024-09-13T06:43:51.505 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:31.403521+0000", 2024-09-13T06:43:51.506 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00026917 2024-09-13T06:43:51.506 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.506 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.506 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-09-13T06:43:51.506 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:31.404918+0000", 2024-09-13T06:43:51.506 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.001397017 2024-09-13T06:43:51.506 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.506 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.506 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:43:51.506 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:31.406176+0000", 2024-09-13T06:43:51.506 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.001257998 2024-09-13T06:43:51.506 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.506 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.506 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:43:51.507 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:31.406334+0000", 2024-09-13T06:43:51.507 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00015819099999999999 2024-09-13T06:43:51.507 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:51.507 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:51.507 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:51.507 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:31.406489+0000", 2024-09-13T06:43:51.507 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00015476699999999999 2024-09-13T06:43:51.507 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:51.507 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:51.507 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:51.507 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:51.507 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:51.507 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:43:51.509 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-13T06:43:51.510 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":398,"stamp":"2024-09-13T06:43:50.536958+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":224831066,"num_objects":264,"num_object_clones":0,"num_object_copies":528,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":264,"num_whiteouts":0,"num_read":235447,"num_read_kb":1401290,"num_write":32906,"num_write_kb":1011203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6618,"num_bytes_recovered":444610618,"num_keys_recovered":867,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":23956,"ondisk_log_size":23956,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":528680,"kb_used_data":163632,"kb_used_omap":17,"kb_used_meta":363054,"kb_avail":565702360,"statfs":{"total":579820584960,"available":579279216640,"internally_reserved":0,"allocated":167559168,"data_stored":157163896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":17653,"internal_metadata":371768075},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-68564088,"num_objects":-150,"num_object_clones":0,"num_object_copies":-300,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-150,"num_whiteouts":0,"num_read":1399,"num_read_kb":1213,"num_write":343,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.123981"},"pg_stats":[{"pgid":"3.1f","version":"264'734","reported_seq":6081,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-13T06:43:49.529066+0000","last_change":"2024-09-13T06:43:49.529066+0000","last_active":"2024-09-13T06:43:49.529066+0000","last_peered":"2024-09-13T06:43:49.529066+0000","last_clean":"2024-09-13T06:43:49.529066+0000","last_became_active":"2024-09-13T06:40:57.385213+0000","last_became_peered":"2024-09-13T06:40:57.385213+0000","last_unstale":"2024-09-13T06:43:49.529066+0000","last_undegraded":"2024-09-13T06:43:49.529066+0000","last_fullsized":"2024-09-13T06:43:49.529066+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":734,"log_dups_size":0,"ondisk_log_size":734,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:46:17.100560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002460636,"stat_sum":{"num_bytes":7233062,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":6311,"num_read_kb":34023,"num_write":1002,"num_write_kb":37089,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":72,"num_bytes_recovered":6114482,"num_keys_recovered":44,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"1f","length":"1"},{"start":"22","length":"1"},{"start":"25","length":"1"},{"start":"28","length":"1"},{"start":"2b","length":"1"},{"start":"2e","length":"1"},{"start":"31","length":"1"},{"start":"34","length":"1"},{"start":"37","length":"1"},{"start":"3a","length":"1"}]},{"pgid":"3.1e","version":"264'1104","reported_seq":6741,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-13T06:43:49.657409+0000","last_change":"2024-09-13T06:43:49.532545+0000","last_active":"2024-09-13T06:43:49.657409+0000","last_peered":"2024-09-13T06:43:49.657409+0000","last_clean":"2024-09-13T06:43:49.657409+0000","last_became_active":"2024-09-13T06:42:20.497251+0000","last_became_peered":"2024-09-13T06:42:20.497251+0000","last_unstale":"2024-09-13T06:43:49.657409+0000","last_undegraded":"2024-09-13T06:43:49.657409+0000","last_fullsized":"2024-09-13T06:43:49.657409+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":1104,"log_dups_size":0,"ondisk_log_size":1104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:28:59.805885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0045091230000000003,"stat_sum":{"num_bytes":2376874,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":8806,"num_read_kb":55237,"num_write":1626,"num_write_kb":29160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":211,"num_bytes_recovered":16489974,"num_keys_recovered":55,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"1f","length":"1"},{"start":"22","length":"1"},{"start":"25","length":"1"},{"start":"28","length":"1"},{"start":"2b","length":"1"},{"start":"2e","length":"1"},{"start":"31","length":"1"},{"start":"34","length":"1"},{"start":"37","length":"1"},{"start":"3a","length":"1"}]},{"pgid":"3.1d","version":"263'1034","reported_seq":5557,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-13T06:43:49.538184+0000","last_change":"2024-09-13T06:43:49.538698+0000","last_active":"2024-09-13T06:43:49.538184+0000","last_peered":"2024-09-13T06:43:49.538184+0000","last_clean":"2024-09-13T06:43:49.538184+0000","last_became_active":"2024-09-13T06:42:46.399222+0000","last_became_peered":"2024-09-13T06:42:46.399222+0000","last_unstale":"2024-09-13T06:43:49.538184+0000","last_undegraded":"2024-09-13T06:43:49.538184+0000","last_fullsized":"2024-09-13T06:43:49.538184+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":1034,"log_dups_size":0,"ondisk_log_size":1034,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:15:56.908464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00064862199999999996,"stat_sum":{"num_bytes":5024691,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":6265,"num_read_kb":28067,"num_write":1597,"num_write_kb":33265,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":206,"num_bytes_recovered":8442088,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"1f","length":"1"},{"start":"22","length":"1"},{"start":"25","length":"1"},{"start":"28","length":"1"},{"start":"2b","length":"1"},{"start":"2e","length":"1"},{"start":"31","length":"1"},{"start":"34","length":"1"},{"start":"37","length":"1"},{"start":"3a","length":"1"}]},{"pgid":"3.1c","version":"264'827","reported_seq":8285,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-13T06:43:49.679428+0000","last_change":"2024-09-13T06:43:49.538506+0000","last_active":"2024-09-13T06:43:49.679428+0000","last_peered":"2024-09-13T06:43:49.679428+0000","last_clean":"2024-09-13T06:43:49.679428+0000","last_became_active":"2024-09-13T06:42:15.428168+0000","last_became_peered":"2024-09-13T06:42:15.428168+0000","last_unstale":"2024-09-13T06:43:49.679428+0000","last_undegraded":"2024-09-13T06:43:49.679428+0000","last_fullsized":"2024-09-13T06:43:49.679428+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":827,"log_dups_size":0,"ondisk_log_size":827,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:34:09.928140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0039066370000000001,"stat_sum":{"num_bytes":3870720,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":9348,"num_read_kb":69922,"num_write":940,"num_write_kb":31840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":350,"num_bytes_recovered":42380134,"num_keys_recovered":286,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"1f","length":"1"},{"start":"22","length":"1"},{"start":"25","length":"1"},{"start":"28","length":"1"},{"start":"2b","length":"1"},{"start":"2e","length":"1"},{"start":"31","length":"1"},{"start":"34","length":"1"},{"start":"37","length":"1"},{"start":"3a","length":"1"}]},{"pgid":"3.1b","version":"264'828","reported_seq":5060,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-13T06:43:49.669403+0000","last_change":"2024-09-13T06:43:49.530584+0000","last_active":"2024-09-13T06:43:49.669403+0000","last_peered":"2024-09-13T06:43:49.669403+0000","last_clean":"2024-09-13T06:43:49.669403+0000","last_became_active":"2024-09-13T06:43:31.415608+0000","last_became_peered":"2024-09-13T06:43:31.415608+0000","last_unstale":"2024-09-13T06:43:49.669403+0000","last_undegraded":"2024-09-13T06:43:49.669403+0000","last_fullsized":"2024-09-13T06:43:49.669403+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":828,"log_dups_size":0,"ondisk_log_size":828,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:39:01.416782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0032266059999999999,"stat_sum":{"num_bytes":12646074,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":5683,"num_read_kb":37013,"num_write":1054,"num_write_kb":33371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":295,"num_bytes_recovered":25415745,"num_keys_recovered":55,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"1f","length":"1"},{"start":"22","length":"1"},{"start":"25","length":"1"},{"start":"28","length":"1"},{"start":"2b","length":"1"},{"start":"2e","length":"1"},{"start":"31","length":"1"},{"start":"34","length":"1"},{"start":"37","length":"1"},{"start":"3a","length":"1"}]},{"pgid":"3.1a","version":"264'488","reported_seq":7004,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-13T06:43:49.704475+0000","last_change":"2024-09-13T06:43:49.534873+0000","last_active":"2024-09-13T06:43:49.704475+0000","last_peered":"2024-09-13T06:43:49.704475+0000","last_clean":"2024-09-13T06:43:49.704475+0000","last_became_active":"2024-09-13T06:43:37.423048+0000","last_became_peered":"2024-09-13T06:43:37.423048+0000","last_unstale":"2024-09-13T06:43:49.704475+0000","last_undegraded":"2024-09-13T06:43:49.704475+0000","last_fullsized":"2024-09-13T06:43:49.704475+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":488,"log_dups_size":0,"ondisk_log_size":488,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:43:32.323544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00051379699999999997,"stat_sum":{"num_bytes":3137366,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":6403,"num_read_kb":42942,"num_write":659,"num_write_kb":32420,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":293,"num_bytes_recovered":12907351,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"1f","length":"1"},{"start":"22","length":"1"},{"start":"25","length":"1"},{"start":"28","length":"1"},{"start":"2b","length":"1"},{"start":"2e","length":"1"},{"start":"31","length":"1"},{"start":"34","length":"1"},{"start":"37","length":"1"},{"start":"3a","length":"1"}]},{"pgid":"3.19","version":"259'675","reported_seq":8474,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-13T06:43:49.531220+0000","last_change":"2024-09-13T06:43:49.531884+0000","last_active":"2024-09-13T06:43:49.531220+0000","last_peered":"2024-09-13T06:43:49.531220+0000","last_clean":"2024-09-13T06:43:49.531220+0000","last_became_active":"2024-09-13T06:43:37.424701+0000","last_became_peered":"2024-09-13T06:43:37.424701+0000","last_unstale":"2024-09-13T06:43:49.531220+0000","last_undegraded":"2024-09-13T06:43:49.531220+0000","last_fullsized":"2024-09-13T06:43:49.531220+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":675,"log_dups_size":0,"ondisk_log_size":675,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:38:49.358150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0039527570000000003,"stat_sum":{"num_bytes":10658312,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":8400,"num_read_kb":35906,"num_write":733,"num_write_kb":28560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":250,"num_bytes_recovered":17539742,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"1f","length":"1"},{"start":"22","length":"1"},{"start":"25","length":"1"},{"start":"28","length":"1"},{"start":"2b","length":"1"},{"start":"2e","length":"1"},{"start":"31","length":"1"},{"start":"34","length":"1"},{"start":"37","length":"1"},{"start":"3a","length":"1"}]},{"pgid":"3.18","version":"264'673","reported_seq":6951,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-13T06:43:49.530196+0000","last_change":"2024-09-13T06:43:49.530196+0000","last_active":"2024-09-13T06:43:49.530196+0000","last_peered":"2024-09-13T06:43:49.530196+0000","last_clean":"2024-09-13T06:43:49.530196+0000","last_became_active":"2024-09-13T06:41:14.395301+0000","last_became_peered":"2024-09-13T06:41:14.395301+0000","last_unstale":"2024-09-13T06:43:49.530196+0000","last_undegraded":"2024-09-13T06:43:49.530196+0000","last_fullsized":"2024-09-13T06:43:49.530196+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":673,"log_dups_size":0,"ondisk_log_size":673,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:10:49.528345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0030916989999999998,"stat_sum":{"num_bytes":5316039,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":6569,"num_read_kb":55193,"num_write":827,"num_write_kb":38872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":117,"num_bytes_recovered":13142180,"num_keys_recovered":22,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"1f","length":"1"},{"start":"22","length":"1"},{"start":"25","length":"1"},{"start":"28","length":"1"},{"start":"2b","length":"1"},{"start":"2e","length":"1"},{"start":"31","length":"1"},{"start":"34","length":"1"},{"start":"37","length":"1"},{"start":"3a","length":"1"}]},{"pgid":"3.17","version":"264'1483","reported_seq":5761,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-13T06:43:49.530465+0000","last_change":"2024-09-13T06:43:49.530465+0000","last_active":"2024-09-13T06:43:49.530465+0000","last_peered":"2024-09-13T06:43:49.530465+0000","last_clean":"2024-09-13T06:43:49.530465+0000","last_became_active":"2024-09-13T06:43:22.521039+0000","last_became_peered":"2024-09-13T06:43:22.521039+0000","last_unstale":"2024-09-13T06:43:49.530465+0000","last_undegraded":"2024-09-13T06:43:49.530465+0000","last_fullsized":"2024-09-13T06:43:49.530465+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":1483,"log_dups_size":0,"ondisk_log_size":1483,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:58:28.305131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0033268780000000001,"stat_sum":{"num_bytes":7343556,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":9451,"num_read_kb":41649,"num_write":2193,"num_write_kb":32722,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":112,"num_bytes_recovered":14950263,"num_keys_recovered":22,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"1f","length":"1"},{"start":"22","length":"1"},{"start":"25","length":"1"},{"start":"28","length":"1"},{"start":"2b","length":"1"},{"start":"2e","length":"1"},{"start":"31","length":"1"},{"start":"34","length":"1"},{"start":"37","length":"1"},{"start":"3a","length":"1"}]},{"pgid":"3.16","version":"260'708","reported_seq":5205,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-13T06:43:46.527185+0000","last_change":"2024-09-13T06:43:46.527708+0000","last_active":"2024-09-13T06:43:46.527185+0000","last_peered":"2024-09-13T06:43:46.527185+0000","last_clean":"2024-09-13T06:43:46.527185+0000","last_became_active":"2024-09-13T06:42:31.405705+0000","last_became_peered":"2024-09-13T06:42:31.405705+0000","last_unstale":"2024-09-13T06:43:46.527185+0000","last_undegraded":"2024-09-13T06:43:46.527185+0000","last_fullsized":"2024-09-13T06:43:46.527185+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":708,"log_dups_size":0,"ondisk_log_size":708,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:03:35.986532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010091550000000001,"stat_sum":{"num_bytes":4952793,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":5101,"num_read_kb":28279,"num_write":1021,"num_write_kb":23183,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":197,"num_bytes_recovered":7394092,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"28","length":"1"},{"start":"2b","length":"1"},{"start":"2e","length":"1"},{"start":"31","length":"1"},{"start":"34","length":"1"},{"start":"37","length":"1"},{"start":"3a","length":"1"}]},{"pgid":"3.15","version":"260'350","reported_seq":6061,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-13T06:43:46.529038+0000","last_change":"2024-09-13T06:43:46.529527+0000","last_active":"2024-09-13T06:43:46.529038+0000","last_peered":"2024-09-13T06:43:46.529038+0000","last_clean":"2024-09-13T06:43:46.529038+0000","last_became_active":"2024-09-13T06:42:33.408009+0000","last_became_peered":"2024-09-13T06:42:33.408009+0000","last_unstale":"2024-09-13T06:43:46.529038+0000","last_undegraded":"2024-09-13T06:43:46.529038+0000","last_fullsized":"2024-09-13T06:43:46.529038+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":350,"log_dups_size":0,"ondisk_log_size":350,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:09:11.995853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0023926730000000001,"stat_sum":{"num_bytes":4415454,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":5036,"num_read_kb":48021,"num_write":462,"num_write_kb":27276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":157,"num_bytes_recovered":13242563,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"28","length":"1"},{"start":"2b","length":"1"},{"start":"2e","length":"1"},{"start":"31","length":"1"},{"start":"34","length":"1"},{"start":"37","length":"1"},{"start":"3a","length":"1"}]},{"pgid":"3.14","version":"259'558","reported_seq":9842,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-13T06:43:49.612449+0000","last_change":"2024-09-13T06:43:49.612740+0000","last_active":"2024-09-13T06:43:49.612449+0000","last_peered":"2024-09-13T06:43:49.612449+0000","last_clean":"2024-09-13T06:43:49.612449+0000","last_became_active":"2024-09-13T06:43:07.411439+0000","last_became_peered":"2024-09-13T06:43:07.411439+0000","last_unstale":"2024-09-13T06:43:49.612449+0000","last_undegraded":"2024-09-13T06:43:49.612449+0000","last_fullsized":"2024-09-13T06:43:49.612449+0000","mapping_epoch":222,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":223,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":558,"log_dups_size":0,"ondisk_log_size":558,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:39:12.394393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001722892,"stat_sum":{"num_bytes":7151128,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":8841,"num_read_kb":61733,"num_write":746,"num_write_kb":30273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":366,"num_bytes_recovered":26160973,"num_keys_recovered":33,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"1f","length":"1"},{"start":"22","length":"1"},{"start":"25","length":"1"},{"start":"28","length":"1"},{"start":"2b","length":"1"},{"start":"2e","length":"1"},{"start":"31","length":"1"},{"start":"34","length":"1"},{"start":"37","length":"1"},{"start":"3a","length":"1"}]},{"pgid":"2.7","version":"0'0","reported_seq":165,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-13T06:43:45.656744+0000","last_change":"2024-09-13T06:42:29.589159+0000","last_active":"2024-09-13T06:43:45.656744+0000","last_peered":"2024-09-13T06:43:45.656744+0000","last_clean":"2024-09-13T06:43:45.656744+0000","last_became_active":"2024-09-13T06:42:29.588711+0000","last_became_peered":"2024-09-13T06:42:29.588711+0000","last_unstale":"2024-09-13T06:43:45.656744+0000","last_undegraded":"2024-09-13T06:43:45.656744+0000","last_fullsized":"2024-09-13T06:43:45.656744+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_clean_scrub_stamp":"2024-09-13T06:39:16.508974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:11:11.029014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00080324699999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.6","version":"264'628","reported_seq":10324,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-13T06:43:49.659883+0000","last_change":"2024-09-13T06:43:49.538112+0000","last_active":"2024-09-13T06:43:49.659883+0000","last_peered":"2024-09-13T06:43:49.659883+0000","last_clean":"2024-09-13T06:43:49.659883+0000","last_became_active":"2024-09-13T06:43:37.421945+0000","last_became_peered":"2024-09-13T06:43:37.421945+0000","last_unstale":"2024-09-13T06:43:49.659883+0000","last_undegraded":"2024-09-13T06:43:49.659883+0000","last_fullsized":"2024-09-13T06:43:49.659883+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":628,"log_dups_size":0,"ondisk_log_size":628,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:22:04.557114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.003436232,"stat_sum":{"num_bytes":1825376,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":9397,"num_read_kb":51433,"num_write":878,"num_write_kb":40908,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":179,"num_bytes_recovered":1257624,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"1f","length":"1"},{"start":"22","length":"1"},{"start":"25","length":"1"},{"start":"28","length":"1"},{"start":"2b","length":"1"},{"start":"2e","length":"1"},{"start":"31","length":"1"},{"start":"34","length":"1"},{"start":"37","length":"1"},{"start":"3a","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":200,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-13T06:43:48.514430+0000","last_change":"2024-09-13T06:43:34.608579+0000","last_active":"2024-09-13T06:43:48.514430+0000","last_peered":"2024-09-13T06:43:48.514430+0000","last_clean":"2024-09-13T06:43:48.514430+0000","last_became_active":"2024-09-13T06:43:34.608239+0000","last_became_peered":"2024-09-13T06:43:34.608239+0000","last_unstale":"2024-09-13T06:43:48.514430+0000","last_undegraded":"2024-09-13T06:43:48.514430+0000","last_fullsized":"2024-09-13T06:43:48.514430+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_clean_scrub_stamp":"2024-09-13T06:39:16.508974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:17:15.027663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00097079800000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"264'689","reported_seq":6972,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-13T06:43:49.533418+0000","last_change":"2024-09-13T06:43:49.533418+0000","last_active":"2024-09-13T06:43:49.533418+0000","last_peered":"2024-09-13T06:43:49.533418+0000","last_clean":"2024-09-13T06:43:49.533418+0000","last_became_active":"2024-09-13T06:42:32.413006+0000","last_became_peered":"2024-09-13T06:42:32.413006+0000","last_unstale":"2024-09-13T06:43:49.533418+0000","last_undegraded":"2024-09-13T06:43:49.533418+0000","last_fullsized":"2024-09-13T06:43:49.533418+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":689,"log_dups_size":0,"ondisk_log_size":689,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:38:01.774494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0052068549999999998,"stat_sum":{"num_bytes":2519040,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":6521,"num_read_kb":33119,"num_write":808,"num_write_kb":30039,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":213,"num_bytes_recovered":15100645,"num_keys_recovered":11,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"1f","length":"1"},{"start":"22","length":"1"},{"start":"25","length":"1"},{"start":"28","length":"1"},{"start":"2b","length":"1"},{"start":"2e","length":"1"},{"start":"31","length":"1"},{"start":"34","length":"1"},{"start":"37","length":"1"},{"start":"3a","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":137,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-13T06:43:45.656202+0000","last_change":"2024-09-13T06:42:28.563276+0000","last_active":"2024-09-13T06:43:45.656202+0000","last_peered":"2024-09-13T06:43:45.656202+0000","last_clean":"2024-09-13T06:43:45.656202+0000","last_became_active":"2024-09-13T06:42:28.562827+0000","last_became_peered":"2024-09-13T06:42:28.562827+0000","last_unstale":"2024-09-13T06:43:45.656202+0000","last_undegraded":"2024-09-13T06:43:45.656202+0000","last_fullsized":"2024-09-13T06:43:45.656202+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_clean_scrub_stamp":"2024-09-13T06:39:16.508974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:10:47.285603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"264'930","reported_seq":6605,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-13T06:43:49.612884+0000","last_change":"2024-09-13T06:43:49.612884+0000","last_active":"2024-09-13T06:43:49.612884+0000","last_peered":"2024-09-13T06:43:49.612884+0000","last_clean":"2024-09-13T06:43:49.612884+0000","last_became_active":"2024-09-13T06:43:37.425174+0000","last_became_peered":"2024-09-13T06:43:37.425174+0000","last_unstale":"2024-09-13T06:43:49.612884+0000","last_undegraded":"2024-09-13T06:43:49.612884+0000","last_fullsized":"2024-09-13T06:43:49.612884+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":930,"log_dups_size":0,"ondisk_log_size":930,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:57:13.635932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014828529999999999,"stat_sum":{"num_bytes":5768425,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":7532,"num_read_kb":38497,"num_write":1310,"num_write_kb":32647,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":146,"num_bytes_recovered":6712133,"num_keys_recovered":11,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"1f","length":"1"},{"start":"22","length":"1"},{"start":"25","length":"1"},{"start":"28","length":"1"},{"start":"2b","length":"1"},{"start":"2e","length":"1"},{"start":"31","length":"1"},{"start":"34","length":"1"},{"start":"37","length":"1"},{"start":"3a","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-13T06:43:45.656120+0000","last_change":"2024-09-13T06:43:34.612177+0000","last_active":"2024-09-13T06:43:45.656120+0000","last_peered":"2024-09-13T06:43:45.656120+0000","last_clean":"2024-09-13T06:43:45.656120+0000","last_became_active":"2024-09-13T06:43:34.611702+0000","last_became_peered":"2024-09-13T06:43:34.611702+0000","last_unstale":"2024-09-13T06:43:45.656120+0000","last_undegraded":"2024-09-13T06:43:45.656120+0000","last_fullsized":"2024-09-13T06:43:45.656120+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_clean_scrub_stamp":"2024-09-13T06:39:16.508974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:29:32.146159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.5","version":"262'633","reported_seq":7689,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-13T06:43:49.533684+0000","last_change":"2024-09-13T06:43:49.534155+0000","last_active":"2024-09-13T06:43:49.533684+0000","last_peered":"2024-09-13T06:43:49.533684+0000","last_clean":"2024-09-13T06:43:49.533684+0000","last_became_active":"2024-09-13T06:41:14.403171+0000","last_became_peered":"2024-09-13T06:41:14.403171+0000","last_unstale":"2024-09-13T06:43:49.533684+0000","last_undegraded":"2024-09-13T06:43:49.533684+0000","last_fullsized":"2024-09-13T06:43:49.533684+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":633,"log_dups_size":0,"ondisk_log_size":633,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:19:47.780898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.004436405,"stat_sum":{"num_bytes":1740460,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":7605,"num_read_kb":41343,"num_write":1012,"num_write_kb":26620,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":158,"num_bytes_recovered":4212424,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"1f","length":"1"},{"start":"22","length":"1"},{"start":"25","length":"1"},{"start":"28","length":"1"},{"start":"2b","length":"1"},{"start":"2e","length":"1"},{"start":"31","length":"1"},{"start":"34","length":"1"},{"start":"37","length":"1"},{"start":"3a","length":"1"}]},{"pgid":"3.3","version":"264'949","reported_seq":20913,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-13T06:43:49.690131+0000","last_change":"2024-09-13T06:43:49.538670+0000","last_active":"2024-09-13T06:43:49.690131+0000","last_peered":"2024-09-13T06:43:49.690131+0000","last_clean":"2024-09-13T06:43:49.690131+0000","last_became_active":"2024-09-13T06:42:14.417898+0000","last_became_peered":"2024-09-13T06:42:14.417898+0000","last_unstale":"2024-09-13T06:43:49.690131+0000","last_undegraded":"2024-09-13T06:43:49.690131+0000","last_fullsized":"2024-09-13T06:43:49.690131+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":949,"log_dups_size":0,"ondisk_log_size":949,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:36:48.644752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0036670990000000001,"stat_sum":{"num_bytes":13029717,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":20940,"num_read_kb":92529,"num_write":1274,"num_write_kb":30358,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":207,"num_bytes_recovered":9898606,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"1f","length":"1"},{"start":"22","length":"1"},{"start":"25","length":"1"},{"start":"28","length":"1"},{"start":"2b","length":"1"},{"start":"2e","length":"1"},{"start":"31","length":"1"},{"start":"34","length":"1"},{"start":"37","length":"1"},{"start":"3a","length":"1"}]},{"pgid":"2.2","version":"20'2","reported_seq":78,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-13T06:43:48.626590+0000","last_change":"2024-09-13T06:43:34.616076+0000","last_active":"2024-09-13T06:43:48.626590+0000","last_peered":"2024-09-13T06:43:48.626590+0000","last_clean":"2024-09-13T06:43:48.626590+0000","last_became_active":"2024-09-13T06:43:34.612620+0000","last_became_peered":"2024-09-13T06:43:34.612620+0000","last_unstale":"2024-09-13T06:43:48.626590+0000","last_undegraded":"2024-09-13T06:43:48.626590+0000","last_fullsized":"2024-09-13T06:43:48.626590+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_clean_scrub_stamp":"2024-09-13T06:39:16.508974+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:10:49.709282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":38,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"264'840","reported_seq":10412,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-13T06:43:49.612374+0000","last_change":"2024-09-13T06:43:49.612374+0000","last_active":"2024-09-13T06:43:49.612374+0000","last_peered":"2024-09-13T06:43:49.612374+0000","last_clean":"2024-09-13T06:43:49.612374+0000","last_became_active":"2024-09-13T06:43:37.425432+0000","last_became_peered":"2024-09-13T06:43:37.425432+0000","last_unstale":"2024-09-13T06:43:49.612374+0000","last_undegraded":"2024-09-13T06:43:49.612374+0000","last_fullsized":"2024-09-13T06:43:49.612374+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":840,"log_dups_size":0,"ondisk_log_size":840,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:51:34.051090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0016055500000000001,"stat_sum":{"num_bytes":15429291,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":11244,"num_read_kb":63082,"num_write":1171,"num_write_kb":36963,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":117,"num_bytes_recovered":9805516,"num_keys_recovered":11,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"1f","length":"1"},{"start":"22","length":"1"},{"start":"25","length":"1"},{"start":"28","length":"1"},{"start":"2b","length":"1"},{"start":"2e","length":"1"},{"start":"31","length":"1"},{"start":"34","length":"1"},{"start":"37","length":"1"},{"start":"3a","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":277,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-13T06:43:48.669235+0000","last_change":"2024-09-13T06:41:11.392095+0000","last_active":"2024-09-13T06:43:48.669235+0000","last_peered":"2024-09-13T06:43:48.669235+0000","last_clean":"2024-09-13T06:43:48.669235+0000","last_became_active":"2024-09-13T06:41:11.391688+0000","last_became_peered":"2024-09-13T06:41:11.391688+0000","last_unstale":"2024-09-13T06:43:48.669235+0000","last_undegraded":"2024-09-13T06:43:48.669235+0000","last_fullsized":"2024-09-13T06:43:48.669235+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_clean_scrub_stamp":"2024-09-13T06:39:16.508974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:41:17.729629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00033592499999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"264'1097","reported_seq":5895,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-13T06:43:49.731533+0000","last_change":"2024-09-13T06:43:49.532881+0000","last_active":"2024-09-13T06:43:49.731533+0000","last_peered":"2024-09-13T06:43:49.731533+0000","last_clean":"2024-09-13T06:43:49.731533+0000","last_became_active":"2024-09-13T06:41:15.399065+0000","last_became_peered":"2024-09-13T06:41:15.399065+0000","last_unstale":"2024-09-13T06:43:49.731533+0000","last_undegraded":"2024-09-13T06:43:49.731533+0000","last_fullsized":"2024-09-13T06:43:49.731533+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":1097,"log_dups_size":0,"ondisk_log_size":1097,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:56:49.571998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0047815590000000003,"stat_sum":{"num_bytes":2355843,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":7937,"num_read_kb":36177,"num_write":1626,"num_write_kb":33101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":110,"num_bytes_recovered":7863454,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"1f","length":"1"},{"start":"22","length":"1"},{"start":"25","length":"1"},{"start":"28","length":"1"},{"start":"2b","length":"1"},{"start":"2e","length":"1"},{"start":"31","length":"1"},{"start":"34","length":"1"},{"start":"37","length":"1"},{"start":"3a","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":145,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-13T06:43:45.655495+0000","last_change":"2024-09-13T06:43:34.613029+0000","last_active":"2024-09-13T06:43:45.655495+0000","last_peered":"2024-09-13T06:43:45.655495+0000","last_clean":"2024-09-13T06:43:45.655495+0000","last_became_active":"2024-09-13T06:43:34.612709+0000","last_became_peered":"2024-09-13T06:43:34.612709+0000","last_unstale":"2024-09-13T06:43:45.655495+0000","last_undegraded":"2024-09-13T06:43:45.655495+0000","last_fullsized":"2024-09-13T06:43:45.655495+0000","mapping_epoch":248,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":249,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_clean_scrub_stamp":"2024-09-13T06:39:16.508974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:36:21.752296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"263'342","reported_seq":3671,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-13T06:43:49.528831+0000","last_change":"2024-09-13T06:43:49.529385+0000","last_active":"2024-09-13T06:43:49.528831+0000","last_peered":"2024-09-13T06:43:49.528831+0000","last_clean":"2024-09-13T06:43:49.528831+0000","last_became_active":"2024-09-13T06:41:15.399301+0000","last_became_peered":"2024-09-13T06:41:15.399301+0000","last_unstale":"2024-09-13T06:43:49.528831+0000","last_undegraded":"2024-09-13T06:43:49.528831+0000","last_fullsized":"2024-09-13T06:43:49.528831+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":342,"log_dups_size":0,"ondisk_log_size":342,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:53:18.137873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0025502680000000001,"stat_sum":{"num_bytes":4798777,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2520,"num_read_kb":19828,"num_write":422,"num_write_kb":20943,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":169,"num_bytes_recovered":5233325,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"1f","length":"1"},{"start":"22","length":"1"},{"start":"25","length":"1"},{"start":"28","length":"1"},{"start":"2b","length":"1"},{"start":"2e","length":"1"},{"start":"31","length":"1"},{"start":"34","length":"1"},{"start":"37","length":"1"},{"start":"3a","length":"1"}]},{"pgid":"2.3","version":"18'1","reported_seq":217,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-13T06:43:48.668326+0000","last_change":"2024-09-13T06:40:54.530159+0000","last_active":"2024-09-13T06:43:48.668326+0000","last_peered":"2024-09-13T06:43:48.668326+0000","last_clean":"2024-09-13T06:43:48.668326+0000","last_became_active":"2024-09-13T06:40:54.525969+0000","last_became_peered":"2024-09-13T06:40:54.525969+0000","last_unstale":"2024-09-13T06:43:48.668326+0000","last_undegraded":"2024-09-13T06:43:48.668326+0000","last_fullsized":"2024-09-13T06:43:48.668326+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_clean_scrub_stamp":"2024-09-13T06:39:16.508974+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:51:26.690993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":353,"reported_epoch":260,"state":"active+clean","last_fresh":"2024-09-13T06:43:45.655506+0000","last_change":"2024-09-13T06:42:28.563168+0000","last_active":"2024-09-13T06:43:45.655506+0000","last_peered":"2024-09-13T06:43:45.655506+0000","last_clean":"2024-09-13T06:43:45.655506+0000","last_became_active":"2024-09-13T06:42:28.562642+0000","last_became_peered":"2024-09-13T06:42:28.562642+0000","last_unstale":"2024-09-13T06:43:45.655506+0000","last_undegraded":"2024-09-13T06:43:45.655506+0000","last_fullsized":"2024-09-13T06:43:45.655506+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:10.110558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:10.110558+0000","last_clean_scrub_stamp":"2024-09-13T06:39:10.110558+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:05:54.866043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"262'640","reported_seq":10412,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-13T06:43:49.528631+0000","last_change":"2024-09-13T06:43:49.531914+0000","last_active":"2024-09-13T06:43:49.528631+0000","last_peered":"2024-09-13T06:43:49.528631+0000","last_clean":"2024-09-13T06:43:49.528631+0000","last_became_active":"2024-09-13T06:43:37.430464+0000","last_became_peered":"2024-09-13T06:43:37.430464+0000","last_unstale":"2024-09-13T06:43:49.528631+0000","last_undegraded":"2024-09-13T06:43:49.528631+0000","last_fullsized":"2024-09-13T06:43:49.528631+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":640,"log_dups_size":0,"ondisk_log_size":640,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:48:19.702253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.005376451,"stat_sum":{"num_bytes":12316688,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":9549,"num_read_kb":46145,"num_write":820,"num_write_kb":32512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":283,"num_bytes_recovered":11977587,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"1f","length":"1"},{"start":"22","length":"1"},{"start":"25","length":"1"},{"start":"28","length":"1"},{"start":"2b","length":"1"},{"start":"2e","length":"1"},{"start":"31","length":"1"},{"start":"34","length":"1"},{"start":"37","length":"1"},{"start":"3a","length":"1"}]},{"pgid":"3.9","version":"263'750","reported_seq":10524,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-13T06:43:49.612222+0000","last_change":"2024-09-13T06:43:49.612497+0000","last_active":"2024-09-13T06:43:49.612222+0000","last_peered":"2024-09-13T06:43:49.612222+0000","last_clean":"2024-09-13T06:43:49.612222+0000","last_became_active":"2024-09-13T06:42:31.400279+0000","last_became_peered":"2024-09-13T06:42:31.400279+0000","last_unstale":"2024-09-13T06:43:49.612222+0000","last_undegraded":"2024-09-13T06:43:49.612222+0000","last_fullsized":"2024-09-13T06:43:49.612222+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":750,"log_dups_size":0,"ondisk_log_size":750,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:54:37.651638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015140970000000001,"stat_sum":{"num_bytes":23179411,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":10700,"num_read_kb":51622,"num_write":908,"num_write_kb":34612,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":137,"num_bytes_recovered":16579571,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"1f","length":"1"},{"start":"22","length":"1"},{"start":"25","length":"1"},{"start":"28","length":"1"},{"start":"2b","length":"1"},{"start":"2e","length":"1"},{"start":"31","length":"1"},{"start":"34","length":"1"},{"start":"37","length":"1"},{"start":"3a","length":"1"}]},{"pgid":"3.a","version":"264'711","reported_seq":8036,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-13T06:43:49.735733+0000","last_change":"2024-09-13T06:43:49.535009+0000","last_active":"2024-09-13T06:43:49.735733+0000","last_peered":"2024-09-13T06:43:49.735733+0000","last_clean":"2024-09-13T06:43:49.735733+0000","last_became_active":"2024-09-13T06:43:37.418917+0000","last_became_peered":"2024-09-13T06:43:37.418917+0000","last_unstale":"2024-09-13T06:43:49.735733+0000","last_undegraded":"2024-09-13T06:43:49.735733+0000","last_fullsized":"2024-09-13T06:43:49.735733+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":711,"log_dups_size":0,"ondisk_log_size":711,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:45:07.058251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000586101,"stat_sum":{"num_bytes":3383296,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":8146,"num_read_kb":46976,"num_write":850,"num_write_kb":28070,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":515,"num_bytes_recovered":28581300,"num_keys_recovered":111,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"1f","length":"1"},{"start":"22","length":"1"},{"start":"25","length":"1"},{"start":"28","length":"1"},{"start":"2b","length":"1"},{"start":"2e","length":"1"},{"start":"31","length":"1"},{"start":"34","length":"1"},{"start":"37","length":"1"},{"start":"3a","length":"1"}]},{"pgid":"3.b","version":"263'808","reported_seq":5404,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-13T06:43:49.530389+0000","last_change":"2024-09-13T06:43:49.531039+0000","last_active":"2024-09-13T06:43:49.530389+0000","last_peered":"2024-09-13T06:43:49.530389+0000","last_clean":"2024-09-13T06:43:49.530389+0000","last_became_active":"2024-09-13T06:41:15.399204+0000","last_became_peered":"2024-09-13T06:41:15.399204+0000","last_unstale":"2024-09-13T06:43:49.530389+0000","last_undegraded":"2024-09-13T06:43:49.530389+0000","last_fullsized":"2024-09-13T06:43:49.530389+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":808,"log_dups_size":0,"ondisk_log_size":808,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:27:03.298272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0036484220000000001,"stat_sum":{"num_bytes":1405076,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":6479,"num_read_kb":57664,"num_write":1147,"num_write_kb":24654,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":117,"num_bytes_recovered":13256568,"num_keys_recovered":44,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"1f","length":"1"},{"start":"22","length":"1"},{"start":"25","length":"1"},{"start":"28","length":"1"},{"start":"2b","length":"1"},{"start":"2e","length":"1"},{"start":"31","length":"1"},{"start":"34","length":"1"},{"start":"37","length":"1"},{"start":"3a","length":"1"}]},{"pgid":"3.c","version":"264'542","reported_seq":6444,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-13T06:43:49.533796+0000","last_change":"2024-09-13T06:43:49.533796+0000","last_active":"2024-09-13T06:43:49.533796+0000","last_peered":"2024-09-13T06:43:49.533796+0000","last_clean":"2024-09-13T06:43:49.533796+0000","last_became_active":"2024-09-13T06:41:14.402410+0000","last_became_peered":"2024-09-13T06:41:14.402410+0000","last_unstale":"2024-09-13T06:43:49.533796+0000","last_undegraded":"2024-09-13T06:43:49.533796+0000","last_fullsized":"2024-09-13T06:43:49.533796+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":542,"log_dups_size":0,"ondisk_log_size":542,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:58:50.947568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0047184540000000004,"stat_sum":{"num_bytes":15063516,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":6014,"num_read_kb":31576,"num_write":635,"num_write_kb":25676,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":184,"num_bytes_recovered":16410936,"num_keys_recovered":88,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"1f","length":"1"},{"start":"22","length":"1"},{"start":"25","length":"1"},{"start":"28","length":"1"},{"start":"2b","length":"1"},{"start":"2e","length":"1"},{"start":"31","length":"1"},{"start":"34","length":"1"},{"start":"37","length":"1"},{"start":"3a","length":"1"}]},{"pgid":"3.d","version":"259'870","reported_seq":2814,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-13T06:43:46.528423+0000","last_change":"2024-09-13T06:43:46.528914+0000","last_active":"2024-09-13T06:43:46.528423+0000","last_peered":"2024-09-13T06:43:46.528423+0000","last_clean":"2024-09-13T06:43:46.528423+0000","last_became_active":"2024-09-13T06:42:32.411927+0000","last_became_peered":"2024-09-13T06:42:32.411927+0000","last_unstale":"2024-09-13T06:43:46.528423+0000","last_undegraded":"2024-09-13T06:43:46.528423+0000","last_fullsized":"2024-09-13T06:43:46.528423+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":870,"log_dups_size":0,"ondisk_log_size":870,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:40:44.787780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001991184,"stat_sum":{"num_bytes":8089843,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":4844,"num_read_kb":26163,"num_write":1507,"num_write_kb":30083,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":140,"num_bytes_recovered":11278110,"num_keys_recovered":11,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"28","length":"1"},{"start":"2b","length":"1"},{"start":"2e","length":"1"},{"start":"31","length":"1"},{"start":"34","length":"1"},{"start":"37","length":"1"},{"start":"3a","length":"1"}]},{"pgid":"3.e","version":"259'542","reported_seq":3437,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-13T06:43:46.530189+0000","last_change":"2024-09-13T06:43:46.531210+0000","last_active":"2024-09-13T06:43:46.530189+0000","last_peered":"2024-09-13T06:43:46.530189+0000","last_clean":"2024-09-13T06:43:46.530189+0000","last_became_active":"2024-09-13T06:43:37.424128+0000","last_became_peered":"2024-09-13T06:43:37.424128+0000","last_unstale":"2024-09-13T06:43:46.530189+0000","last_undegraded":"2024-09-13T06:43:46.530189+0000","last_fullsized":"2024-09-13T06:43:46.530189+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":542,"log_dups_size":0,"ondisk_log_size":542,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:40:59.711700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0029171420000000002,"stat_sum":{"num_bytes":7247027,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":3868,"num_read_kb":43567,"num_write":643,"num_write_kb":29232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":243,"num_bytes_recovered":12695191,"num_keys_recovered":11,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"28","length":"1"},{"start":"2b","length":"1"},{"start":"2e","length":"1"},{"start":"31","length":"1"},{"start":"34","length":"1"},{"start":"37","length":"1"},{"start":"3a","length":"1"}]},{"pgid":"3.f","version":"261'637","reported_seq":4622,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-13T06:43:46.532179+0000","last_change":"2024-09-13T06:43:46.532179+0000","last_active":"2024-09-13T06:43:46.532179+0000","last_peered":"2024-09-13T06:43:46.532179+0000","last_clean":"2024-09-13T06:43:46.532179+0000","last_became_active":"2024-09-13T06:42:33.412054+0000","last_became_peered":"2024-09-13T06:42:33.412054+0000","last_unstale":"2024-09-13T06:43:46.532179+0000","last_undegraded":"2024-09-13T06:43:46.532179+0000","last_fullsized":"2024-09-13T06:43:46.532179+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":637,"log_dups_size":0,"ondisk_log_size":637,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:07:06.963404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0038513610000000002,"stat_sum":{"num_bytes":14731468,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":4641,"num_read_kb":45261,"num_write":954,"num_write_kb":45280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":394,"num_bytes_recovered":42768786,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"28","length":"1"},{"start":"2b","length":"1"},{"start":"2e","length":"1"},{"start":"31","length":"1"},{"start":"34","length":"1"},{"start":"37","length":"1"},{"start":"3a","length":"1"}]},{"pgid":"3.10","version":"262'801","reported_seq":4846,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-13T06:43:49.528644+0000","last_change":"2024-09-13T06:43:49.529088+0000","last_active":"2024-09-13T06:43:49.528644+0000","last_peered":"2024-09-13T06:43:49.528644+0000","last_clean":"2024-09-13T06:43:49.528644+0000","last_became_active":"2024-09-13T06:42:20.497165+0000","last_became_peered":"2024-09-13T06:42:20.497165+0000","last_unstale":"2024-09-13T06:43:49.528644+0000","last_undegraded":"2024-09-13T06:43:49.528644+0000","last_fullsized":"2024-09-13T06:43:49.528644+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":801,"log_dups_size":0,"ondisk_log_size":801,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:40:33.464362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0021084879999999999,"stat_sum":{"num_bytes":5100699,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":5556,"num_read_kb":29474,"num_write":1118,"num_write_kb":36184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":124,"num_bytes_recovered":6622441,"num_keys_recovered":20,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"1f","length":"1"},{"start":"22","length":"1"},{"start":"25","length":"1"},{"start":"28","length":"1"},{"start":"2b","length":"1"},{"start":"2e","length":"1"},{"start":"31","length":"1"},{"start":"34","length":"1"},{"start":"37","length":"1"},{"start":"3a","length":"1"}]},{"pgid":"3.11","version":"260'478","reported_seq":6152,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-13T06:43:46.530018+0000","last_change":"2024-09-13T06:43:46.530705+0000","last_active":"2024-09-13T06:43:46.530018+0000","last_peered":"2024-09-13T06:43:46.530018+0000","last_clean":"2024-09-13T06:43:46.530018+0000","last_became_active":"2024-09-13T06:42:33.411668+0000","last_became_peered":"2024-09-13T06:42:33.411668+0000","last_unstale":"2024-09-13T06:43:46.530018+0000","last_undegraded":"2024-09-13T06:43:46.530018+0000","last_fullsized":"2024-09-13T06:43:46.530018+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":478,"log_dups_size":0,"ondisk_log_size":478,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:43:01.814094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.003271553,"stat_sum":{"num_bytes":4464694,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":5306,"num_read_kb":34061,"num_write":635,"num_write_kb":25707,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":245,"num_bytes_recovered":7089272,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"28","length":"1"},{"start":"2b","length":"1"},{"start":"2e","length":"1"},{"start":"31","length":"1"},{"start":"34","length":"1"},{"start":"37","length":"1"},{"start":"3a","length":"1"}]},{"pgid":"3.12","version":"260'891","reported_seq":4854,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-13T06:43:46.528238+0000","last_change":"2024-09-13T06:43:46.528769+0000","last_active":"2024-09-13T06:43:46.528238+0000","last_peered":"2024-09-13T06:43:46.528238+0000","last_clean":"2024-09-13T06:43:46.528238+0000","last_became_active":"2024-09-13T06:42:31.398973+0000","last_became_peered":"2024-09-13T06:42:31.398973+0000","last_unstale":"2024-09-13T06:43:46.528238+0000","last_undegraded":"2024-09-13T06:43:46.528238+0000","last_fullsized":"2024-09-13T06:43:46.528238+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":891,"log_dups_size":0,"ondisk_log_size":891,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:13:09.038749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002178859,"stat_sum":{"num_bytes":5844786,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":5852,"num_read_kb":38796,"num_write":1291,"num_write_kb":35650,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":107,"num_bytes_recovered":3682200,"num_keys_recovered":21,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"28","length":"1"},{"start":"2b","length":"1"},{"start":"2e","length":"1"},{"start":"31","length":"1"},{"start":"34","length":"1"},{"start":"37","length":"1"},{"start":"3a","length":"1"}]},{"pgid":"3.13","version":"259'596","reported_seq":4438,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-13T06:43:46.529220+0000","last_change":"2024-09-13T06:43:46.529757+0000","last_active":"2024-09-13T06:43:46.529220+0000","last_peered":"2024-09-13T06:43:46.529220+0000","last_clean":"2024-09-13T06:43:46.529220+0000","last_became_active":"2024-09-13T06:42:31.402800+0000","last_became_peered":"2024-09-13T06:42:31.402800+0000","last_unstale":"2024-09-13T06:43:46.529220+0000","last_undegraded":"2024-09-13T06:43:46.529220+0000","last_fullsized":"2024-09-13T06:43:46.529220+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":596,"log_dups_size":0,"ondisk_log_size":596,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:59:41.167052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002592572,"stat_sum":{"num_bytes":1821177,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":4466,"num_read_kb":35892,"num_write":876,"num_write_kb":31515,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":196,"num_bytes_recovered":8224568,"num_keys_recovered":11,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"28","length":"1"},{"start":"2b","length":"1"},{"start":"2e","length":"1"},{"start":"31","length":"1"},{"start":"34","length":"1"},{"start":"37","length":"1"},{"start":"3a","length":"1"}]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":224240679,"num_objects":260,"num_object_clones":0,"num_object_copies":520,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":260,"num_whiteouts":0,"num_read":235331,"num_read_kb":1401190,"num_write":32745,"num_write_kb":1008785,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6610,"num_bytes_recovered":443429844,"num_keys_recovered":867,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":192081920,"data_stored":190894025,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8096,"internal_metadata":0},"log_size":23836,"ondisk_log_size":23836,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":38,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":3}],"osd_stats":[{"osd":7,"up_from":187,"seq":803158884369,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":70600,"kb_used_data":41852,"kb_used_omap":9,"kb_used_meta":28726,"kb_avail":94301240,"statfs":{"total":96636764160,"available":96564469760,"internally_reserved":0,"allocated":42856448,"data_stored":41047286,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9685,"internal_metadata":29415979},"hb_peers":[0,1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 06:43:31 2024","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.3160000000000001,"5min":1.3160000000000001,"15min":1.3160000000000001},"last":0.60199999999999998}]},{"osd":1,"last update":"Fri Sep 13 06:43:31 2024","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.749,"15min":0.749},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.115,"5min":1.115,"15min":1.115},"last":0.81499999999999995}]},{"osd":2,"last update":"Fri Sep 13 06:43:31 2024","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.748,"15min":0.748},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.212,"5min":1.212,"15min":1.212},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.2929999999999999,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":0.84699999999999998}]},{"osd":3,"last update":"Fri Sep 13 06:43:31 2024","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.081,"5min":1.081,"15min":1.081},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.5069999999999999,"5min":1.5069999999999999,"15min":1.5069999999999999},"last":0.82899999999999996}]},{"osd":4,"last update":"Fri Sep 13 06:43:31 2024","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.363,"5min":1.363,"15min":1.363},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.3320000000000001,"5min":1.3320000000000001,"15min":1.3320000000000001},"last":0.56399999999999995}]},{"osd":5,"last update":"Fri Sep 13 06:43:31 2024","interfaces":[{"interface":"back","average":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.2509999999999999,"5min":1.2509999999999999,"15min":1.2509999999999999},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.131,"5min":1.131,"15min":1.131},"last":0.71299999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0189999999999999}]}]},{"osd":6,"up_from":0,"seq":55834574894,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},{"osd":5,"up_from":13,"seq":55834574907,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":96320,"kb_used_data":29100,"kb_used_omap":1,"kb_used_meta":67198,"kb_avail":94275520,"statfs":{"total":96636764160,"available":96538132480,"internally_reserved":0,"allocated":29798400,"data_stored":28081945,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":68811206},"hb_peers":[0,1,2,3,4,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 06:43:18 2024","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.72699999999999998,"15min":0.76900000000000002},"min":{"1min":0.39600000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":1.014,"5min":1.6679999999999999,"15min":1.6679999999999999},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.77600000000000002,"15min":0.80100000000000005},"min":{"1min":0.438,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.0660000000000001,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":0.79600000000000004}]},{"osd":1,"last update":"Fri Sep 13 06:43:18 2024","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.73899999999999999,"15min":0.751},"min":{"1min":0.53000000000000003,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.97099999999999997,"5min":1.341,"15min":1.341},"last":0.95599999999999996},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.71499999999999997,"15min":0.745},"min":{"1min":0.34100000000000003,"5min":0.317,"15min":0.317},"max":{"1min":1.0880000000000001,"5min":1.722,"15min":1.722},"last":0.53500000000000003}]},{"osd":2,"last update":"Fri Sep 13 06:43:18 2024","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.82199999999999995,"15min":0.86499999999999999},"min":{"1min":0.50900000000000001,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.256,"5min":1.833,"15min":1.833},"last":1.0189999999999999},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.78000000000000003,"15min":0.79400000000000004},"min":{"1min":0.57199999999999995,"5min":0.435,"15min":0.435},"max":{"1min":1.0569999999999999,"5min":1.4279999999999999,"15min":1.4279999999999999},"last":0.69399999999999995}]},{"osd":3,"last update":"Fri Sep 13 06:43:18 2024","interfaces":[{"interface":"back","average":{"1min":0.84599999999999997,"5min":0.79500000000000004,"15min":0.77300000000000002},"min":{"1min":0.65300000000000002,"5min":0.434,"15min":0.434},"max":{"1min":1.885,"5min":1.885,"15min":1.885},"last":0.86299999999999999},{"interface":"front","average":{"1min":0.91000000000000003,"5min":0.86399999999999999,"15min":0.86599999999999999},"min":{"1min":0.59299999999999997,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.907,"5min":1.907,"15min":1.907},"last":1.0900000000000001}]},{"osd":4,"last update":"Fri Sep 13 06:43:18 2024","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.84599999999999997,"15min":0.80800000000000005},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":1.155,"5min":6.3179999999999996,"15min":6.3179999999999996},"last":0.90900000000000003},{"interface":"front","average":{"1min":1.1599999999999999,"5min":1.0649999999999999,"15min":0.91400000000000003},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":8.3279999999999994,"5min":15.553000000000001,"15min":15.553000000000001},"last":1.2370000000000001}]},{"osd":6,"last update":"Fri Sep 13 06:42:12 2024","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.86299999999999999,"15min":0.877},"min":{"1min":0.40000000000000002,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.9610000000000001,"5min":1.9610000000000001,"15min":1.9610000000000001},"last":0.5},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.86099999999999999,"15min":0.87},"min":{"1min":0.39000000000000001,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.206,"5min":1.968,"15min":1.968},"last":0.84999999999999998}]},{"osd":7,"last update":"Fri Sep 13 06:43:28 2024","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":1.375,"5min":1.375,"15min":1.375},"last":1.129},{"interface":"front","average":{"1min":0.874,"5min":0.874,"15min":0.874},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.276,"5min":1.276,"15min":1.276},"last":1.2}]}]},{"osd":4,"up_from":13,"seq":55834574907,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":73948,"kb_used_data":22900,"kb_used_omap":1,"kb_used_meta":49150,"kb_avail":94297892,"statfs":{"total":96636764160,"available":96561041408,"internally_reserved":0,"allocated":23449600,"data_stored":21754746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":50330054},"hb_peers":[0,1,2,3,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 06:43:15 2024","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.86399999999999999,"15min":1.014},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":1.0649999999999999,"5min":5.8230000000000004,"15min":5.8230000000000004},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.73299999999999998,"15min":0.75600000000000001},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":1.091,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":0.83799999999999997}]},{"osd":1,"last update":"Fri Sep 13 06:43:15 2024","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.80800000000000005,"15min":0.755},"min":{"1min":0.372,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.0349999999999999,"5min":10.156000000000001,"15min":10.156000000000001},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.747,"5min":0.79900000000000004,"15min":0.84399999999999997},"min":{"1min":0.39800000000000002,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.111,"5min":1.286,"15min":1.286},"last":0.69599999999999995}]},{"osd":2,"last update":"Fri Sep 13 06:43:15 2024","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.77500000000000002,"15min":0.83099999999999996},"min":{"1min":0.43099999999999999,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":1.6000000000000001,"5min":1.6000000000000001,"15min":1.6000000000000001},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.80000000000000004,"15min":0.81599999999999995},"min":{"1min":0.42499999999999999,"5min":0.374,"15min":0.374},"max":{"1min":1.097,"5min":1.3540000000000001,"15min":1.3540000000000001},"last":0.93200000000000005}]},{"osd":3,"last update":"Fri Sep 13 06:43:15 2024","interfaces":[{"interface":"back","average":{"1min":0.85899999999999999,"5min":0.86599999999999999,"15min":0.90800000000000003},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.3660000000000001,"5min":1.4810000000000001,"15min":1.4810000000000001},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.97199999999999998,"15min":0.93100000000000005},"min":{"1min":0.41299999999999998,"5min":0.374,"15min":0.374},"max":{"1min":1.4319999999999999,"5min":10.195,"15min":10.195},"last":0.77500000000000002}]},{"osd":5,"last update":"Fri Sep 13 06:43:15 2024","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.83499999999999996,"15min":0.86299999999999999},"min":{"1min":0.38400000000000001,"5min":0.249,"15min":0.249},"max":{"1min":1.478,"5min":2.9790000000000001,"15min":2.9790000000000001},"last":1.075},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.874,"15min":0.92400000000000004},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":1.49,"5min":1.8779999999999999,"15min":1.8779999999999999},"last":0.97099999999999997}]},{"osd":6,"last update":"Fri Sep 13 06:42:14 2024","interfaces":[{"interface":"back","average":{"1min":0.90100000000000002,"5min":0.92100000000000004,"15min":0.82899999999999996},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":1.6100000000000001,"5min":10.016999999999999,"15min":10.016999999999999},"last":0.89500000000000002},{"interface":"front","average":{"1min":0.86699999999999999,"5min":0.93300000000000005,"15min":0.95999999999999996},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.2030000000000001,"5min":2.0750000000000002,"15min":2.0750000000000002},"last":0.91200000000000003}]},{"osd":7,"last update":"Fri Sep 13 06:43:31 2024","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"last":0.90600000000000003},{"interface":"front","average":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.234,"5min":1.234,"15min":1.234},"last":1.014}]}]},{"osd":3,"up_from":13,"seq":55834574910,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":90636,"kb_used_data":19320,"kb_used_omap":1,"kb_used_meta":71294,"kb_avail":94281204,"statfs":{"total":96636764160,"available":96543952896,"internally_reserved":0,"allocated":19783680,"data_stored":18061364,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":73005512},"hb_peers":[0,1,2,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 06:43:12 2024","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.55500000000000005,"15min":0.56699999999999995},"min":{"1min":0.28699999999999998,"5min":0.191,"15min":0.191},"max":{"1min":1.014,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.63300000000000001,"15min":0.66300000000000003},"min":{"1min":0.38100000000000001,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.89100000000000001,"5min":1.2789999999999999,"15min":1.2789999999999999},"last":0.75}]},{"osd":1,"last update":"Fri Sep 13 06:43:12 2024","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.56999999999999995,"15min":0.59299999999999997},"min":{"1min":0.39500000000000002,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.88800000000000001,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.85399999999999998},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.623,"15min":0.67500000000000004},"min":{"1min":0.28399999999999997,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":1.28,"5min":1.589,"15min":1.589},"last":0.81499999999999995}]},{"osd":2,"last update":"Fri Sep 13 06:43:12 2024","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.63800000000000001,"15min":0.65500000000000003},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":1.1850000000000001,"5min":1.323,"15min":1.323},"last":0.89100000000000001},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.61099999999999999,"15min":0.63100000000000001},"min":{"1min":0.32700000000000001,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.998,"5min":1.409,"15min":1.409},"last":0.67000000000000004}]},{"osd":4,"last update":"Fri Sep 13 06:43:12 2024","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.84599999999999997,"15min":0.90100000000000002},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":1.159,"5min":1.7929999999999999,"15min":1.7929999999999999},"last":1.02},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.77600000000000002,"15min":0.78700000000000003},"min":{"1min":0.44700000000000001,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.04,"5min":1.3240000000000001,"15min":1.3240000000000001},"last":0.96499999999999997}]},{"osd":5,"last update":"Fri Sep 13 06:43:12 2024","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.83099999999999996,"15min":0.85699999999999998},"min":{"1min":0.47899999999999998,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.115,"5min":1.3799999999999999,"15min":1.3799999999999999},"last":0.79500000000000004},{"interface":"front","average":{"1min":0.88,"5min":0.83499999999999996,"15min":0.86299999999999999},"min":{"1min":0.63800000000000001,"5min":0.433,"15min":0.433},"max":{"1min":1.1379999999999999,"5min":1.206,"15min":1.206},"last":0.93200000000000005}]},{"osd":6,"last update":"Fri Sep 13 06:42:11 2024","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.88500000000000001,"15min":0.91100000000000003},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.135,"5min":1.532,"15min":1.532},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.95299999999999996,"15min":0.98999999999999999},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.2250000000000001,"5min":1.825,"15min":1.825},"last":0.72999999999999998}]},{"osd":7,"last update":"Fri Sep 13 06:43:31 2024","interfaces":[{"interface":"back","average":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.3799999999999999,"5min":1.3799999999999999,"15min":1.3799999999999999},"last":0.99299999999999999},{"interface":"front","average":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":2.0459999999999998,"5min":2.0459999999999998,"15min":2.0459999999999998},"last":1.079}]}]},{"osd":2,"up_from":13,"seq":55834574907,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":72064,"kb_used_data":18804,"kb_used_omap":1,"kb_used_meta":53246,"kb_avail":94299776,"statfs":{"total":96636764160,"available":96562970624,"internally_reserved":0,"allocated":19255296,"data_stored":17547487,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":54524358},"hb_peers":[0,1,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 06:43:17 2024","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.66100000000000003,"15min":0.56000000000000005},"min":{"1min":0.33000000000000002,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":1.24,"5min":8.6449999999999996,"15min":8.6449999999999996},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.64100000000000001,"15min":0.60699999999999998},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.97199999999999998,"5min":4.0380000000000003,"15min":4.0380000000000003},"last":0.30299999999999999}]},{"osd":1,"last update":"Fri Sep 13 06:43:17 2024","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.64400000000000002,"15min":0.621},"min":{"1min":0.28499999999999998,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.94299999999999995,"5min":3.4649999999999999,"15min":3.4649999999999999},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.66200000000000003,"15min":0.60199999999999998},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":1.1000000000000001,"5min":3.8159999999999998,"15min":3.8159999999999998},"last":0.41199999999999998}]},{"osd":3,"last update":"Fri Sep 13 06:43:17 2024","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.64500000000000002,"15min":0.58499999999999996},"min":{"1min":0.29399999999999998,"5min":0.249,"15min":0.249},"max":{"1min":0.93899999999999995,"5min":3.407,"15min":3.407},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.72599999999999998,"15min":0.68300000000000005},"min":{"1min":0.317,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.325,"5min":3.2639999999999998,"15min":3.2639999999999998},"last":0.53000000000000003}]},{"osd":4,"last update":"Fri Sep 13 06:43:17 2024","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.88900000000000001,"15min":0.88900000000000001},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.1539999999999999,"5min":3.1179999999999999,"15min":3.1179999999999999},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.79600000000000004,"5min":1.075,"15min":0.94499999999999995},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":1.1799999999999999,"5min":21.081,"15min":21.081},"last":0.46800000000000003}]},{"osd":5,"last update":"Fri Sep 13 06:43:17 2024","interfaces":[{"interface":"back","average":{"1min":0.80300000000000005,"5min":0.84999999999999998,"15min":0.84399999999999997},"min":{"1min":0.46100000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":1.333,"5min":2.2389999999999999,"15min":2.2389999999999999},"last":0.85299999999999998},{"interface":"front","average":{"1min":0.86499999999999999,"5min":0.90600000000000003,"15min":0.871},"min":{"1min":0.56299999999999994,"5min":0.377,"15min":0.377},"max":{"1min":1.2350000000000001,"5min":3.3290000000000002,"15min":3.3290000000000002},"last":0.77600000000000002}]},{"osd":6,"last update":"Fri Sep 13 06:42:15 2024","interfaces":[{"interface":"back","average":{"1min":0.86799999999999999,"5min":0.94199999999999995,"15min":0.92600000000000005},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.274,"5min":3.923,"15min":3.923},"last":0.84999999999999998},{"interface":"front","average":{"1min":0.97799999999999998,"5min":0.90500000000000003,"15min":0.879},"min":{"1min":0.60899999999999999,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":2.2080000000000002,"5min":2.2120000000000002,"15min":2.2120000000000002},"last":0.873}]},{"osd":7,"last update":"Fri Sep 13 06:43:33 2024","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.236,"5min":1.236,"15min":1.236},"last":0.626},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.375,"5min":1.375,"15min":1.375},"last":0.80300000000000005}]}]},{"osd":1,"up_from":0,"seq":55834574907,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},{"osd":0,"up_from":13,"seq":55834574906,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":125112,"kb_used_data":31656,"kb_used_omap":1,"kb_used_meta":93438,"kb_avail":94246728,"statfs":{"total":96636764160,"available":96508649472,"internally_reserved":0,"allocated":32415744,"data_stored":30671068,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":95680966},"hb_peers":[1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 06:43:11 2024","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.53800000000000003,"15min":0.52600000000000002},"min":{"1min":0.19900000000000001,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":1.103,"5min":1.2270000000000001,"15min":1.2270000000000001},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.53900000000000003,"15min":0.53300000000000003},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":1.024,"5min":1.222,"15min":1.222},"last":0.84299999999999997}]},{"osd":2,"last update":"Fri Sep 13 06:43:11 2024","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.58799999999999997,"15min":0.55000000000000004},"min":{"1min":0.217,"5min":0.217,"15min":0.217},"max":{"1min":1.1859999999999999,"5min":1.839,"15min":1.839},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.58099999999999996,"15min":0.56499999999999995},"min":{"1min":0.27600000000000002,"5min":0.245,"15min":0.245},"max":{"1min":0.91200000000000003,"5min":1.359,"15min":1.359},"last":0.71099999999999997}]},{"osd":3,"last update":"Fri Sep 13 06:43:11 2024","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.56499999999999995,"15min":0.54700000000000004},"min":{"1min":0.316,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.85199999999999998,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.71499999999999997,"15min":0.68899999999999995},"min":{"1min":0.26100000000000001,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":1.256,"5min":4.9630000000000001,"15min":4.9630000000000001},"last":0.95899999999999996}]},{"osd":4,"last update":"Fri Sep 13 06:43:11 2024","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.78300000000000003,"15min":0.78700000000000003},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":1.2849999999999999,"5min":1.5449999999999999,"15min":1.5449999999999999},"last":0.92500000000000004},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.77300000000000002,"15min":0.79600000000000004},"min":{"1min":0.438,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.97899999999999998,"5min":1.6319999999999999,"15min":1.6319999999999999},"last":0.879}]},{"osd":5,"last update":"Fri Sep 13 06:43:11 2024","interfaces":[{"interface":"back","average":{"1min":0.89700000000000002,"5min":0.84799999999999998,"15min":0.84799999999999998},"min":{"1min":0.42299999999999999,"5min":0.378,"15min":0.378},"max":{"1min":1.359,"5min":1.4059999999999999,"15min":1.4059999999999999},"last":1.0820000000000001},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.85399999999999998,"15min":0.86899999999999999},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.1439999999999999,"5min":1.5740000000000001,"15min":1.5740000000000001},"last":0.98999999999999999}]},{"osd":6,"last update":"Fri Sep 13 06:42:11 2024","interfaces":[{"interface":"back","average":{"1min":0.89800000000000002,"5min":0.91200000000000003,"15min":0.93100000000000005},"min":{"1min":0.55300000000000005,"5min":0.499,"15min":0.499},"max":{"1min":1.571,"5min":2.4969999999999999,"15min":2.4969999999999999},"last":0.83099999999999996},{"interface":"front","average":{"1min":0.878,"5min":0.89600000000000002,"15min":0.90600000000000003},"min":{"1min":0.51800000000000002,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.208,"5min":2.0419999999999998,"15min":2.0419999999999998},"last":0.874}]},{"osd":7,"last update":"Fri Sep 13 06:43:30 2024","interfaces":[{"interface":"back","average":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.9419999999999999,"5min":1.9419999999999999,"15min":1.9419999999999999},"last":1.137},{"interface":"front","average":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.901,"5min":1.901,"15min":1.901},"last":1.0469999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":26689536,"data_stored":26552457,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40300544,"data_stored":40018962,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":14745600,"data_stored":14636603,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":14995456,"data_stored":14870022,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20246528,"data_stored":20149060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":24248320,"data_stored":24123974,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12685312,"data_stored":12590125,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":38170624,"data_stored":37952822,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8096,"internal_metadata":0}]}} 2024-09-13T06:43:51.513 INFO:tasks.thrashosds.thrasher:Setting 3.1a to [5, 2] 2024-09-13T06:43:51.513 INFO:tasks.thrashosds.thrasher:cmd ['osd', 'pg-upmap', '3.1a', '5', '2'] 2024-09-13T06:43:51.513 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pg-upmap 3.1a 5 2 2024-09-13T06:43:51.514 INFO:teuthology.orchestra.run.smithi081.stdout:osd.0: {} 2024-09-13T06:43:51.514 INFO:teuthology.orchestra.run.smithi081.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-13T06:43:51.514 INFO:teuthology.orchestra.run.smithi081.stdout:osd.1: {} 2024-09-13T06:43:51.515 INFO:teuthology.orchestra.run.smithi081.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-13T06:43:51.515 INFO:teuthology.orchestra.run.smithi081.stdout:osd.2: {} 2024-09-13T06:43:51.515 INFO:teuthology.orchestra.run.smithi081.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-13T06:43:51.516 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-13T06:43:51.508+0000 7fa8bb18e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 36790) UID: 0 2024-09-13T06:43:51.527 INFO:teuthology.orchestra.run.smithi081.stdout:osd.3: {} 2024-09-13T06:43:51.527 INFO:teuthology.orchestra.run.smithi081.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-13T06:43:51.553 INFO:teuthology.orchestra.run.smithi081.stdout:osd.4: {} 2024-09-13T06:43:51.553 INFO:teuthology.orchestra.run.smithi081.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-13T06:43:51.589 INFO:teuthology.orchestra.run.smithi081.stdout:osd.5: {} 2024-09-13T06:43:51.589 INFO:teuthology.orchestra.run.smithi081.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-13T06:43:51.589 INFO:teuthology.orchestra.run.smithi081.stderr:Error ENXIO: problem getting command descriptions from osd.6 2024-09-13T06:43:51.610 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-13T06:43:51.608+0000 7fa8bb18e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 36790) UID: 0 2024-09-13T06:43:51.624 INFO:teuthology.orchestra.run.smithi081.stdout:osd.7: {} 2024-09-13T06:43:51.624 INFO:teuthology.orchestra.run.smithi081.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-13T06:43:51.627 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-13T06:43:51.628 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-13T06:43:51.666 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:43:51.666 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:43:51.679 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-13T06:43:51.711 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:43:51.708+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:43:51.812 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:43:51.812+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:43:51.830 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:43:51.831 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:43:51.844 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-13T06:43:51.913 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:43:51.911+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:43:51.951 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:43:51.951 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:43:51.965 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-13T06:43:52.014 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:43:52.015+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:43:52.099 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:43:52.099 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:43:52.114 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-13T06:43:52.115 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:43:52.115+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:43:52.216 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:43:52.215+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:43:52.236 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:43:52.236 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:43:52.250 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-13T06:43:52.318 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:43:52.315+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:43:52.374 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:43:52.374 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:43:52.388 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-13T06:43:52.418 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:43:52.419+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:43:52.506 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:43:52.506 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:43:52.519 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:43:52.516+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:43:52.520 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-13T06:43:52.556 INFO:teuthology.orchestra.run.smithi081.stderr:set 3.1a pg_upmap mapping to [5,2] 2024-09-13T06:43:52.570 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-13T06:43:52.620 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:43:52.620+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:43:52.686 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:43:52.687 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:43:52.701 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-13T06:43:52.720 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:43:52.719+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:43:52.822 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:43:52.819+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:43:52.867 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:43:52.867 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:43:52.881 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-13T06:43:52.923 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:43:52.923+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:43:53.005 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:43:53.005 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:43:53.019 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-13T06:43:53.024 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:43:53.023+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:43:53.125 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:43:53.124+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:43:53.137 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:43:53.138 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:43:53.152 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-13T06:43:53.225 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:43:53.223+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:43:53.321 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:43:53.321 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:43:53.326 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:43:53.324+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:43:53.335 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-13T06:43:53.427 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:43:53.427+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:43:53.467 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:43:53.468 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:43:53.481 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-13T06:43:53.549 INFO:teuthology.orchestra.run.smithi081.stderr:nodeep-scrub is set 2024-09-13T06:43:53.550 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:43:53.547+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:43:53.629 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-13T06:43:53.629 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:43:53.627+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:43:53.660 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:43:53.660 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:43:53.674 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-13T06:43:53.762 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:43:53.763+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:43:53.765 INFO:teuthology.orchestra.run.smithi081.stdout:osd.0: {} 2024-09-13T06:43:53.765 INFO:teuthology.orchestra.run.smithi081.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-13T06:43:53.782 INFO:teuthology.orchestra.run.smithi081.stdout:osd.1: {} 2024-09-13T06:43:53.782 INFO:teuthology.orchestra.run.smithi081.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-13T06:43:53.799 INFO:teuthology.orchestra.run.smithi081.stdout:osd.2: {} 2024-09-13T06:43:53.799 INFO:teuthology.orchestra.run.smithi081.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-13T06:43:53.815 INFO:teuthology.orchestra.run.smithi081.stdout:osd.3: {} 2024-09-13T06:43:53.815 INFO:teuthology.orchestra.run.smithi081.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-13T06:43:53.829 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:43:53.827+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:43:53.834 INFO:teuthology.orchestra.run.smithi081.stdout:osd.4: {} 2024-09-13T06:43:53.835 INFO:teuthology.orchestra.run.smithi081.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-13T06:43:53.847 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:43:53.848 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 20, 2024-09-13T06:43:53.848 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 600, 2024-09-13T06:43:53.848 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [ 2024-09-13T06:43:53.848 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:53.848 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:37801 3.1 3:82e31015:::rbd_object_map.1121d8143c6e.0000000000000019:head [call] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e55)", 2024-09-13T06:43:53.848 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:05.646191+0000", 2024-09-13T06:43:53.848 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 228.20043103, 2024-09-13T06:43:53.848 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.72659507800000001, 2024-09-13T06:43:53.848 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:53.848 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:53.849 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:53.849 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:53.849 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:53.849 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 37801 2024-09-13T06:43:53.849 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:53.849 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:53.850 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:53.850 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:53.850 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:05.646191+0000", 2024-09-13T06:43:53.850 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:53.850 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:53.850 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:53.850 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:53.850 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:05.646191+0000", 2024-09-13T06:43:53.850 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:53.850 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:53.850 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:53.850 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:53.851 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:05.646188+0000", 2024-09-13T06:43:53.851 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999971 2024-09-13T06:43:53.851 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:53.851 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:53.851 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:53.851 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:05.646206+0000", 2024-09-13T06:43:53.851 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8182999999999999e-05 2024-09-13T06:43:53.851 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:53.851 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:53.851 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:53.851 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:05.646237+0000", 2024-09-13T06:43:53.851 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.1071000000000001e-05 2024-09-13T06:43:53.851 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:53.852 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:53.852 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:53.852 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:05.646251+0000", 2024-09-13T06:43:53.852 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3679000000000001e-05 2024-09-13T06:43:53.852 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:53.852 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:53.852 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:53.852 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:05.646321+0000", 2024-09-13T06:43:53.852 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.9831000000000003e-05 2024-09-13T06:43:53.852 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:53.852 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:53.852 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:43:53.853 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:05.646331+0000", 2024-09-13T06:43:53.853 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0242e-05 2024-09-13T06:43:53.853 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:53.853 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:53.853 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:53.853 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.371959+0000", 2024-09-13T06:43:53.853 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.72562817199999996 2024-09-13T06:43:53.853 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:53.853 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:53.853 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:53.853 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.372389+0000", 2024-09-13T06:43:53.853 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00042977400000000001 2024-09-13T06:43:53.853 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:53.854 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:53.854 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:53.854 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.372786+0000", 2024-09-13T06:43:53.854 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00039706099999999999 2024-09-13T06:43:53.854 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:53.854 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:53.854 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:53.854 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:53.854 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:53.854 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43182 3.17 3:ec5ebce4:::rbd_data.1121f5f2e1c0.0000000000000001:1f [read 333824~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:43:53.854 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.652985+0000", 2024-09-13T06:43:53.854 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 212.19363641699999, 2024-09-13T06:43:53.854 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123926616, 2024-09-13T06:43:53.854 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:53.855 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:53.855 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:53.855 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:53.855 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:53.855 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43182 2024-09-13T06:43:53.855 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:53.855 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:53.855 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:53.855 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:53.855 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.652985+0000", 2024-09-13T06:43:53.855 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:53.855 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:53.855 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:53.856 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:53.856 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.652985+0000", 2024-09-13T06:43:53.856 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:53.856 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:53.856 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:53.856 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:53.856 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.652985+0000", 2024-09-13T06:43:53.856 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:53.856 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:53.856 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:53.856 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:53.856 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.652987+0000", 2024-09-13T06:43:53.856 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0899999999999999e-06 2024-09-13T06:43:53.856 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:53.857 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:53.857 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:53.857 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.652994+0000", 2024-09-13T06:43:53.857 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3100000000000003e-06 2024-09-13T06:43:53.857 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:53.857 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:53.857 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:53.857 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.653000+0000", 2024-09-13T06:43:53.857 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2020000000000003e-06 2024-09-13T06:43:53.857 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:53.857 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:53.857 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:53.857 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.776635+0000", 2024-09-13T06:43:53.857 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.12363529400000001 2024-09-13T06:43:53.858 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:53.858 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:53.858 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:53.858 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.776676+0000", 2024-09-13T06:43:53.858 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.0745999999999999e-05 2024-09-13T06:43:53.858 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:53.858 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:53.858 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:53.858 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.776912+0000", 2024-09-13T06:43:53.858 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00023631300000000001 2024-09-13T06:43:53.858 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:53.858 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:53.858 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:53.858 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:53.858 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:53.859 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43194 3.17 3:ec5ebce4:::rbd_data.1121f5f2e1c0.0000000000000001:1f [read 495616~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:43:53.859 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.656645+0000", 2024-09-13T06:43:53.859 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 212.18997622399999, 2024-09-13T06:43:53.859 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.124088483, 2024-09-13T06:43:53.859 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:53.859 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:53.859 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:53.859 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:53.859 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:53.859 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43194 2024-09-13T06:43:53.859 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:53.859 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:53.859 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:53.859 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:53.859 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656645+0000", 2024-09-13T06:43:53.860 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:53.860 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:53.860 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:53.860 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:53.860 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656645+0000", 2024-09-13T06:43:53.860 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:53.860 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:53.860 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:53.860 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:53.860 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656645+0000", 2024-09-13T06:43:53.860 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:53.860 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:53.860 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:53.860 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:53.861 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656647+0000", 2024-09-13T06:43:53.861 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9180000000000001e-06 2024-09-13T06:43:53.861 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:53.861 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:53.861 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:53.861 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656653+0000", 2024-09-13T06:43:53.861 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7860000000000002e-06 2024-09-13T06:43:53.861 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:53.861 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:53.861 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:53.861 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656658+0000", 2024-09-13T06:43:53.861 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6949999999999999e-06 2024-09-13T06:43:53.862 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:53.862 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:53.862 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:53.862 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.780406+0000", 2024-09-13T06:43:53.862 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123748657 2024-09-13T06:43:53.862 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:53.862 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:53.862 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:53.862 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.780446+0000", 2024-09-13T06:43:53.862 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.9360999999999998e-05 2024-09-13T06:43:53.862 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:53.862 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:53.862 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:53.862 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.780734+0000", 2024-09-13T06:43:53.862 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00028838399999999998 2024-09-13T06:43:53.863 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:53.863 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:53.863 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:53.863 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:53.863 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:53.863 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43241 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 120832~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:43:53.863 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.660682+0000", 2024-09-13T06:43:53.863 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 212.18593928600001, 2024-09-13T06:43:53.863 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123958204, 2024-09-13T06:43:53.863 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:53.863 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:53.863 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:53.863 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:53.863 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:53.863 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43241 2024-09-13T06:43:53.864 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:53.864 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:53.864 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:53.864 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:53.864 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660682+0000", 2024-09-13T06:43:53.864 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:53.864 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:53.864 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:53.864 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:53.864 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660682+0000", 2024-09-13T06:43:53.864 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:53.864 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:53.864 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:53.865 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:53.865 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660682+0000", 2024-09-13T06:43:53.865 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:53.865 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:53.865 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:53.865 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:53.865 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660683+0000", 2024-09-13T06:43:53.865 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.308e-06 2024-09-13T06:43:53.865 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:53.865 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:53.865 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:53.865 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660686+0000", 2024-09-13T06:43:53.865 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.977e-06 2024-09-13T06:43:53.865 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:53.866 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:53.866 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:53.866 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660689+0000", 2024-09-13T06:43:53.866 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5830000000000001e-06 2024-09-13T06:43:53.866 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:53.866 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:53.866 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:53.866 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.784366+0000", 2024-09-13T06:43:53.866 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.12367713599999999 2024-09-13T06:43:53.866 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:53.866 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:53.866 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:53.866 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.784451+0000", 2024-09-13T06:43:53.867 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.4629999999999994e-05 2024-09-13T06:43:53.867 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:53.867 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:53.867 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:53.867 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.784641+0000", 2024-09-13T06:43:53.867 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00018984899999999999 2024-09-13T06:43:53.867 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:53.867 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:53.867 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:53.867 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:53.867 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:53.867 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43242 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 139264~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:43:53.867 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.660691+0000", 2024-09-13T06:43:53.867 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 212.185930308, 2024-09-13T06:43:53.868 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.124536443, 2024-09-13T06:43:53.868 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:53.868 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:53.868 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:53.868 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:53.868 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:53.868 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43242 2024-09-13T06:43:53.868 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:53.868 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:53.868 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:53.868 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:53.868 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660691+0000", 2024-09-13T06:43:53.868 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:53.868 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:53.869 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:53.869 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:53.869 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660691+0000", 2024-09-13T06:43:53.869 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:53.869 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:53.869 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:53.869 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:53.869 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660691+0000", 2024-09-13T06:43:53.869 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:43:53.869 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:53.869 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:53.869 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:53.869 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660696+0000", 2024-09-13T06:43:53.869 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0560000000000004e-06 2024-09-13T06:43:53.870 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:53.870 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:53.870 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:53.870 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660699+0000", 2024-09-13T06:43:53.870 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.2009999999999999e-06 2024-09-13T06:43:53.870 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:53.870 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:53.870 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:53.870 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660702+0000", 2024-09-13T06:43:53.870 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.633e-06 2024-09-13T06:43:53.870 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:53.870 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:53.870 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:53.870 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.784912+0000", 2024-09-13T06:43:53.871 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.124209497 2024-09-13T06:43:53.871 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:53.871 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:53.871 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:53.871 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.784995+0000", 2024-09-13T06:43:53.871 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.3891e-05 2024-09-13T06:43:53.871 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:53.871 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:53.871 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:53.871 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.785228+0000", 2024-09-13T06:43:53.871 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00023237400000000001 2024-09-13T06:43:53.871 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:53.871 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:53.871 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:53.872 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:53.872 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:53.872 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43243 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 153600~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:43:53.872 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.660705+0000", 2024-09-13T06:43:53.872 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 212.185916975, 2024-09-13T06:43:53.872 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.124825835, 2024-09-13T06:43:53.872 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:53.872 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:53.872 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:53.872 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:53.872 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:53.872 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43243 2024-09-13T06:43:53.872 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:53.873 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:53.873 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:53.873 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:53.873 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660705+0000", 2024-09-13T06:43:53.873 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:53.873 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:53.873 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:53.873 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:53.873 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660705+0000", 2024-09-13T06:43:53.873 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:53.873 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:53.873 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:53.873 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:53.874 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660705+0000", 2024-09-13T06:43:53.874 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:43:53.874 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:53.874 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:53.874 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:53.874 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660706+0000", 2024-09-13T06:43:53.874 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4339999999999999e-06 2024-09-13T06:43:53.874 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:53.874 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:53.874 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:53.874 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660709+0000", 2024-09-13T06:43:53.874 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9000000000000002e-06 2024-09-13T06:43:53.875 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:53.875 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:53.875 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:53.875 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660712+0000", 2024-09-13T06:43:53.875 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.0589999999999998e-06 2024-09-13T06:43:53.875 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:53.875 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:53.875 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:53.875 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.785318+0000", 2024-09-13T06:43:53.875 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.124606299 2024-09-13T06:43:53.875 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:53.875 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:53.875 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:53.875 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.785361+0000", 2024-09-13T06:43:53.876 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.3214999999999999e-05 2024-09-13T06:43:53.876 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:53.876 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:53.876 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:53.876 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.785531+0000", 2024-09-13T06:43:53.876 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00016914400000000001 2024-09-13T06:43:53.876 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:53.876 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:53.876 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:53.876 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:53.876 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:53.876 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43244 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 167936~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:43:53.877 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.660714+0000", 2024-09-13T06:43:53.877 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 212.18590756200001, 2024-09-13T06:43:53.877 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.125073248, 2024-09-13T06:43:53.877 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:53.877 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:53.877 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:53.877 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:53.877 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:53.877 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43244 2024-09-13T06:43:53.877 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:53.877 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:53.877 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:53.878 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:53.878 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660714+0000", 2024-09-13T06:43:53.878 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:53.878 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:53.878 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:53.878 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:53.878 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660714+0000", 2024-09-13T06:43:53.878 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:53.878 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:53.878 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:53.878 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:53.878 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660714+0000", 2024-09-13T06:43:53.878 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:43:53.879 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:53.879 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:53.879 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:53.879 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660715+0000", 2024-09-13T06:43:53.879 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2330000000000001e-06 2024-09-13T06:43:53.879 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:53.879 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:53.879 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:53.879 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660718+0000", 2024-09-13T06:43:53.879 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9569999999999998e-06 2024-09-13T06:43:53.879 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:53.879 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:53.879 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:53.879 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660721+0000", 2024-09-13T06:43:53.880 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.678e-06 2024-09-13T06:43:53.880 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:53.880 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:53.880 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:53.880 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.785557+0000", 2024-09-13T06:43:53.880 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.12483633199999999 2024-09-13T06:43:53.880 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:53.880 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:53.880 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:53.880 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.785618+0000", 2024-09-13T06:43:53.880 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0686000000000001e-05 2024-09-13T06:43:53.880 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:53.881 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:53.881 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:53.881 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.785787+0000", 2024-09-13T06:43:53.881 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00016957699999999999 2024-09-13T06:43:53.881 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:53.881 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:53.881 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:53.881 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:53.881 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:53.881 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43256 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 344064~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:43:53.881 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.664763+0000", 2024-09-13T06:43:53.881 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 212.18185905199999, 2024-09-13T06:43:53.881 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.12418359399999999, 2024-09-13T06:43:53.881 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:53.882 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:53.882 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:53.882 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:53.882 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:53.882 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43256 2024-09-13T06:43:53.882 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:53.882 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:53.882 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:53.882 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:53.882 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664763+0000", 2024-09-13T06:43:53.882 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:53.882 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:53.882 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:53.883 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:53.883 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664763+0000", 2024-09-13T06:43:53.883 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:53.883 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:53.883 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:53.883 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:53.883 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664762+0000", 2024-09-13T06:43:53.883 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:53.883 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:53.883 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:53.883 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:53.883 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664765+0000", 2024-09-13T06:43:53.883 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3290000000000001e-06 2024-09-13T06:43:53.883 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:53.883 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:53.884 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:53.884 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664771+0000", 2024-09-13T06:43:53.884 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.1319999999999999e-06 2024-09-13T06:43:53.884 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:53.884 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:53.884 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:53.884 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664776+0000", 2024-09-13T06:43:53.884 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.8840000000000002e-06 2024-09-13T06:43:53.884 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:53.884 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:53.884 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:53.884 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.788598+0000", 2024-09-13T06:43:53.884 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123821979 2024-09-13T06:43:53.885 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:53.885 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:53.885 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:53.885 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.788680+0000", 2024-09-13T06:43:53.885 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.2367999999999995e-05 2024-09-13T06:43:53.885 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:53.885 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:53.885 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:53.885 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.788946+0000", 2024-09-13T06:43:53.885 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00026629799999999999 2024-09-13T06:43:53.885 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:53.885 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:53.885 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:53.885 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:53.886 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:53.886 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43267 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 505856~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:43:53.886 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.669461+0000", 2024-09-13T06:43:53.886 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 212.17716049800001, 2024-09-13T06:43:53.886 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123933711, 2024-09-13T06:43:53.886 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:53.886 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:53.886 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:53.886 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:53.886 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:53.886 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43267 2024-09-13T06:43:53.886 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:53.886 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:53.886 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:53.887 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:53.887 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669461+0000", 2024-09-13T06:43:53.887 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:53.887 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:53.887 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:53.887 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:53.887 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669461+0000", 2024-09-13T06:43:53.887 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:53.887 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:53.887 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:53.887 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:53.887 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669461+0000", 2024-09-13T06:43:53.887 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:53.887 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:53.888 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:53.888 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:53.888 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669463+0000", 2024-09-13T06:43:53.888 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5629999999999999e-06 2024-09-13T06:43:53.888 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:53.888 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:53.888 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:53.888 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669473+0000", 2024-09-13T06:43:53.888 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.9520000000000006e-06 2024-09-13T06:43:53.888 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:53.888 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:53.888 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:53.888 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669479+0000", 2024-09-13T06:43:53.888 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8540000000000002e-06 2024-09-13T06:43:53.889 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:53.889 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:53.889 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:53.889 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.793137+0000", 2024-09-13T06:43:53.889 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.12365825699999999 2024-09-13T06:43:53.889 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:53.889 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:53.889 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:53.889 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.793181+0000", 2024-09-13T06:43:53.889 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.3773999999999998e-05 2024-09-13T06:43:53.889 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:53.889 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:53.889 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:53.889 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.793395+0000", 2024-09-13T06:43:53.890 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00021372399999999999 2024-09-13T06:43:53.890 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:53.890 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:53.890 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:53.890 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:53.890 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:53.890 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43268 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 520192~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:43:53.890 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.669484+0000", 2024-09-13T06:43:53.890 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 212.17713771300001, 2024-09-13T06:43:53.890 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.12441057899999999, 2024-09-13T06:43:53.890 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:53.890 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:53.890 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:53.890 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:53.891 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:53.891 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43268 2024-09-13T06:43:53.891 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:53.891 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:53.891 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:53.891 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:53.891 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669484+0000", 2024-09-13T06:43:53.891 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:53.891 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:53.891 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:53.891 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:53.891 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669484+0000", 2024-09-13T06:43:53.891 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:53.891 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:53.892 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:53.892 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:53.892 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669484+0000", 2024-09-13T06:43:53.892 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:53.892 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:53.892 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:53.892 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:53.892 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669486+0000", 2024-09-13T06:43:53.892 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6120000000000001e-06 2024-09-13T06:43:53.892 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:53.892 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:53.892 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:53.893 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669494+0000", 2024-09-13T06:43:53.893 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4819999999999997e-06 2024-09-13T06:43:53.893 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:53.893 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:53.893 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:53.893 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669497+0000", 2024-09-13T06:43:53.893 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9790000000000002e-06 2024-09-13T06:43:53.893 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:53.893 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:53.893 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:53.893 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.793559+0000", 2024-09-13T06:43:53.893 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.124062436 2024-09-13T06:43:53.893 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:53.893 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:53.894 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:53.894 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.793603+0000", 2024-09-13T06:43:53.894 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.3764999999999999e-05 2024-09-13T06:43:53.894 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:53.894 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:53.894 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:53.894 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.793895+0000", 2024-09-13T06:43:53.894 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00029168299999999999 2024-09-13T06:43:53.894 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:53.894 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:53.894 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:53.894 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:53.894 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:53.894 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:181627 3.1b 3:dbd5e871:::rbd_data.11218aab7a9c.0000000000000003:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e203)", 2024-09-13T06:43:53.895 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:42:45.704561+0000", 2024-09-13T06:43:53.895 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 68.142060849000003, 2024-09-13T06:43:53.895 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.70481779099999997, 2024-09-13T06:43:53.895 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:53.895 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:53.895 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:53.895 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:53.895 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:53.895 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 181627 2024-09-13T06:43:53.895 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:53.895 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:53.895 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:53.895 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:53.895 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.704561+0000", 2024-09-13T06:43:53.896 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:53.896 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:53.896 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:53.896 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:53.896 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.704561+0000", 2024-09-13T06:43:53.896 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:53.896 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:53.896 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:53.896 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:53.896 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.704558+0000", 2024-09-13T06:43:53.896 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999976 2024-09-13T06:43:53.896 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:53.897 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:53.897 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:53.897 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.704570+0000", 2024-09-13T06:43:53.897 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2123000000000001e-05 2024-09-13T06:43:53.897 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:53.897 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:53.897 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:53.897 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.704596+0000", 2024-09-13T06:43:53.897 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5134e-05 2024-09-13T06:43:53.897 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:53.897 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:53.897 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:53.897 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.704609+0000", 2024-09-13T06:43:53.898 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3745e-05 2024-09-13T06:43:53.898 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:53.898 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:53.898 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:53.898 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.704797+0000", 2024-09-13T06:43:53.898 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00018797799999999999 2024-09-13T06:43:53.898 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:53.898 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:53.898 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:43:53.898 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.704816+0000", 2024-09-13T06:43:53.898 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8218000000000001e-05 2024-09-13T06:43:53.898 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:53.898 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:53.898 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:53.899 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:46.408816+0000", 2024-09-13T06:43:53.899 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.70399995500000001 2024-09-13T06:43:53.899 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:53.899 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:53.899 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:53.899 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:46.409111+0000", 2024-09-13T06:43:53.899 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000295202 2024-09-13T06:43:53.899 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:53.899 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:53.899 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:53.899 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:46.409379+0000", 2024-09-13T06:43:53.899 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00026792599999999998 2024-09-13T06:43:53.899 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:53.899 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:53.900 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:53.900 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:53.900 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:53.900 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:181641 3.1b 3:dbd5e871:::rbd_data.11218aab7a9c.0000000000000003:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e203)", 2024-09-13T06:43:53.900 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:42:45.704674+0000", 2024-09-13T06:43:53.900 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 68.141947841999993, 2024-09-13T06:43:53.900 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.70579465600000002, 2024-09-13T06:43:53.900 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:53.900 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:53.900 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:53.900 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:53.900 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:53.900 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 181641 2024-09-13T06:43:53.901 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:53.901 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:53.901 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:53.901 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:53.901 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.704674+0000", 2024-09-13T06:43:53.901 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:53.901 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:53.901 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:53.901 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:53.901 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.704674+0000", 2024-09-13T06:43:53.901 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:53.901 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:53.901 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:53.901 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:53.902 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.704673+0000", 2024-09-13T06:43:53.902 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:53.902 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:53.902 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:53.902 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:53.902 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.704677+0000", 2024-09-13T06:43:53.902 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.6389999999999998e-06 2024-09-13T06:43:53.902 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:53.902 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:53.902 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:53.902 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.704691+0000", 2024-09-13T06:43:53.902 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3859999999999999e-05 2024-09-13T06:43:53.902 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:53.903 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:53.903 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:53.903 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.704699+0000", 2024-09-13T06:43:53.903 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.2339999999999994e-06 2024-09-13T06:43:53.903 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:53.903 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:53.903 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:53.903 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.704854+0000", 2024-09-13T06:43:53.903 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00015513899999999999 2024-09-13T06:43:53.903 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:53.903 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:53.903 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:43:53.903 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.704866+0000", 2024-09-13T06:43:53.903 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1855000000000001e-05 2024-09-13T06:43:53.903 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:53.904 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:53.904 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:53.904 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:46.410079+0000", 2024-09-13T06:43:53.904 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.705212477 2024-09-13T06:43:53.904 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:53.904 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:53.904 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:53.904 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:46.410279+0000", 2024-09-13T06:43:53.904 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000200614 2024-09-13T06:43:53.904 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:53.904 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:53.904 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:53.904 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:46.410469+0000", 2024-09-13T06:43:53.905 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00018939400000000001 2024-09-13T06:43:53.905 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:53.905 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:53.905 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:53.905 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:53.905 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:53.905 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:181655 3.1b 3:dbd5e871:::rbd_data.11218aab7a9c.0000000000000003:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e203)", 2024-09-13T06:43:53.905 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:42:45.704730+0000", 2024-09-13T06:43:53.905 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 68.141891434000001, 2024-09-13T06:43:53.905 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.70617977499999995, 2024-09-13T06:43:53.905 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:53.905 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:53.905 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:53.906 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:53.906 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:53.906 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 181655 2024-09-13T06:43:53.906 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:53.906 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:53.906 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:53.906 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:53.906 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.704730+0000", 2024-09-13T06:43:53.906 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:53.906 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:53.906 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:53.906 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:53.907 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.704730+0000", 2024-09-13T06:43:53.907 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:53.907 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:53.907 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:53.907 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:53.907 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.704730+0000", 2024-09-13T06:43:53.907 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:53.907 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:53.907 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:53.907 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:53.907 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.704733+0000", 2024-09-13T06:43:53.907 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.0000000000000001e-06 2024-09-13T06:43:53.907 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:53.907 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:53.907 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:53.908 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.704741+0000", 2024-09-13T06:43:53.908 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.0770000000000008e-06 2024-09-13T06:43:53.908 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:53.908 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:53.908 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:53.908 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.704747+0000", 2024-09-13T06:43:53.908 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.2110000000000003e-06 2024-09-13T06:43:53.908 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:53.908 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:53.908 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:53.908 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.706676+0000", 2024-09-13T06:43:53.908 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0019289820000000001 2024-09-13T06:43:53.908 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:53.908 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:53.909 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:43:53.909 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.706687+0000", 2024-09-13T06:43:53.909 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1382999999999999e-05 2024-09-13T06:43:53.909 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:53.909 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:53.909 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:53.909 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:46.410540+0000", 2024-09-13T06:43:53.909 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.70385235199999996 2024-09-13T06:43:53.909 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:53.909 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:53.909 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:53.909 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:46.410723+0000", 2024-09-13T06:43:53.909 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000182998 2024-09-13T06:43:53.909 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:53.910 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:53.910 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:53.910 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:46.410910+0000", 2024-09-13T06:43:53.910 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00018720299999999999 2024-09-13T06:43:53.910 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:53.910 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:53.910 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:53.910 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:53.910 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:53.910 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:181669 3.1b 3:dbd5e871:::rbd_data.11218aab7a9c.0000000000000003:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e203)", 2024-09-13T06:43:53.910 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:42:45.705356+0000", 2024-09-13T06:43:53.910 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 68.141265426000004, 2024-09-13T06:43:53.910 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.70583958999999996, 2024-09-13T06:43:53.910 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:53.910 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:53.911 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:53.911 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:53.911 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:53.911 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 181669 2024-09-13T06:43:53.911 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:53.911 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:53.911 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:53.911 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:53.911 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.705356+0000", 2024-09-13T06:43:53.911 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:53.911 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:53.911 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:53.911 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:53.911 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.705356+0000", 2024-09-13T06:43:53.911 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:53.912 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:53.912 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:53.912 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:53.912 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.705356+0000", 2024-09-13T06:43:53.912 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:53.912 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:53.912 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:53.912 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:53.912 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.705360+0000", 2024-09-13T06:43:53.912 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.0069999999999999e-06 2024-09-13T06:43:53.912 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:53.912 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:53.912 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:53.913 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.705368+0000", 2024-09-13T06:43:53.913 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.3639999999999999e-06 2024-09-13T06:43:53.913 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:53.913 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:53.913 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:53.913 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.705375+0000", 2024-09-13T06:43:53.913 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.8839999999999997e-06 2024-09-13T06:43:53.913 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:53.913 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:53.914 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:53.914 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.706716+0000", 2024-09-13T06:43:53.914 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0013414589999999999 2024-09-13T06:43:53.914 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:53.914 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:53.914 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:43:53.914 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.706726+0000", 2024-09-13T06:43:53.914 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.5079999999999994e-06 2024-09-13T06:43:53.914 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:53.914 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:53.914 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:53.914 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:46.410966+0000", 2024-09-13T06:43:53.914 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.70424025800000001 2024-09-13T06:43:53.914 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:53.914 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:53.915 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:53.915 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:46.411099+0000", 2024-09-13T06:43:53.915 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000132395 2024-09-13T06:43:53.915 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:53.915 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:53.915 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:53.915 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:46.411196+0000", 2024-09-13T06:43:53.915 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.7344999999999997e-05 2024-09-13T06:43:53.915 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:53.915 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:53.915 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:53.915 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:53.915 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:53.915 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:181683 3.1b 3:dbd5e871:::rbd_data.11218aab7a9c.0000000000000003:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e203)", 2024-09-13T06:43:53.916 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:42:45.705404+0000", 2024-09-13T06:43:53.916 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 68.141217920000003, 2024-09-13T06:43:53.916 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.70639211899999999, 2024-09-13T06:43:53.916 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:53.916 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:53.916 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:53.916 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:53.916 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:53.916 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 181683 2024-09-13T06:43:53.916 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:53.916 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:53.916 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:53.916 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:53.917 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.705404+0000", 2024-09-13T06:43:53.917 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:53.917 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:53.917 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:53.917 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:53.917 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.705404+0000", 2024-09-13T06:43:53.917 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:53.917 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:53.917 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:53.917 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:53.917 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.705403+0000", 2024-09-13T06:43:53.917 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:53.917 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:53.917 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:53.918 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:53.918 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.705406+0000", 2024-09-13T06:43:53.918 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.1499999999999999e-06 2024-09-13T06:43:53.918 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:53.918 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:53.918 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:53.918 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.705414+0000", 2024-09-13T06:43:53.918 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4259999999999997e-06 2024-09-13T06:43:53.918 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:53.918 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:53.918 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:53.918 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.705420+0000", 2024-09-13T06:43:53.918 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.4339999999999997e-06 2024-09-13T06:43:53.919 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:53.919 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:53.919 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:53.919 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.706753+0000", 2024-09-13T06:43:53.919 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0013326939999999999 2024-09-13T06:43:53.919 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:53.919 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:53.919 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:43:53.919 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.706762+0000", 2024-09-13T06:43:53.919 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.2439999999999999e-06 2024-09-13T06:43:53.919 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:53.919 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:53.919 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:53.919 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:46.411391+0000", 2024-09-13T06:43:53.920 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.70462912099999997 2024-09-13T06:43:53.920 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:53.920 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:53.920 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:53.920 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:46.411584+0000", 2024-09-13T06:43:53.920 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00019283399999999999 2024-09-13T06:43:53.920 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:53.920 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:53.920 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:53.920 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:46.411796+0000", 2024-09-13T06:43:53.920 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00021175299999999999 2024-09-13T06:43:53.920 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:53.920 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:53.921 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:53.921 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:53.921 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:53.921 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:181697 3.1b 3:dbd5e871:::rbd_data.11218aab7a9c.0000000000000003:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e203)", 2024-09-13T06:43:53.921 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:42:45.705447+0000", 2024-09-13T06:43:53.921 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 68.141174269999993, 2024-09-13T06:43:53.921 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.70668603500000005, 2024-09-13T06:43:53.921 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:53.921 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:53.921 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:53.921 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:53.921 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:53.922 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 181697 2024-09-13T06:43:53.922 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:53.922 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:53.922 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:53.922 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:53.922 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.705447+0000", 2024-09-13T06:43:53.922 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:53.922 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:53.922 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:53.922 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:53.922 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.705447+0000", 2024-09-13T06:43:53.922 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:53.922 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:53.922 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:53.923 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:53.923 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.705447+0000", 2024-09-13T06:43:53.923 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:53.923 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:53.923 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:53.923 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:53.923 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.705450+0000", 2024-09-13T06:43:53.923 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.8830000000000002e-06 2024-09-13T06:43:53.923 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:53.923 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:53.923 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:53.923 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.705457+0000", 2024-09-13T06:43:53.923 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.097e-06 2024-09-13T06:43:53.924 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:53.924 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:53.924 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:53.924 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.705463+0000", 2024-09-13T06:43:53.924 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.2439999999999998e-06 2024-09-13T06:43:53.924 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:53.924 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:53.924 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:53.924 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.706790+0000", 2024-09-13T06:43:53.924 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.001326823 2024-09-13T06:43:53.924 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:53.924 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:53.924 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:43:53.925 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.706799+0000", 2024-09-13T06:43:53.925 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.3249999999999997e-06 2024-09-13T06:43:53.925 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:53.925 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:53.925 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:53.925 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:46.411884+0000", 2024-09-13T06:43:53.925 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.70508501599999995 2024-09-13T06:43:53.925 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:53.925 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:53.925 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:53.925 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:46.412010+0000", 2024-09-13T06:43:53.925 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000125635 2024-09-13T06:43:53.925 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:53.926 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:53.926 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:53.926 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:46.412133+0000", 2024-09-13T06:43:53.926 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000123492 2024-09-13T06:43:53.926 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:53.926 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:53.926 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:53.926 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:53.926 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:53.926 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:181711 3.1b 3:dbd5e871:::rbd_data.11218aab7a9c.0000000000000003:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e203)", 2024-09-13T06:43:53.926 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:42:45.705496+0000", 2024-09-13T06:43:53.926 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 68.141125707, 2024-09-13T06:43:53.927 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.70714611199999999, 2024-09-13T06:43:53.927 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:53.927 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:53.927 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:53.927 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:53.927 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:53.927 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 181711 2024-09-13T06:43:53.927 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:53.927 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:53.927 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:53.927 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:53.927 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.705496+0000", 2024-09-13T06:43:53.927 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:53.927 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:53.928 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:53.928 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:53.928 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.705496+0000", 2024-09-13T06:43:53.928 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:53.928 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:53.928 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:53.928 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:53.928 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.705495+0000", 2024-09-13T06:43:53.928 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:53.928 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:53.928 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:53.928 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:53.928 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.705499+0000", 2024-09-13T06:43:53.929 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.1109999999999999e-06 2024-09-13T06:43:53.929 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:53.929 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:53.929 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:53.929 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.705506+0000", 2024-09-13T06:43:53.929 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.8830000000000006e-06 2024-09-13T06:43:53.929 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:53.929 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:53.929 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:53.929 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.705513+0000", 2024-09-13T06:43:53.929 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.2500000000000003e-06 2024-09-13T06:43:53.929 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:53.929 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:53.930 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:53.930 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.706828+0000", 2024-09-13T06:43:53.930 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0013155840000000001 2024-09-13T06:43:53.930 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:53.930 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:53.930 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:43:53.930 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.706837+0000", 2024-09-13T06:43:53.930 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.0489999999999993e-06 2024-09-13T06:43:53.930 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:53.930 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:53.930 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:53.930 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:46.412223+0000", 2024-09-13T06:43:53.930 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.70538530799999999 2024-09-13T06:43:53.931 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:53.931 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:53.931 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:53.931 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:46.412418+0000", 2024-09-13T06:43:53.931 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000195331 2024-09-13T06:43:53.931 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:53.931 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:53.931 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:53.931 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:46.412642+0000", 2024-09-13T06:43:53.931 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00022410099999999999 2024-09-13T06:43:53.931 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:53.931 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:53.931 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:53.931 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:53.931 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:53.932 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:181725 3.1b 3:dbd5e871:::rbd_data.11218aab7a9c.0000000000000003:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e203)", 2024-09-13T06:43:53.932 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:42:45.706863+0000", 2024-09-13T06:43:53.932 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 68.139758662999995, 2024-09-13T06:43:53.932 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.70631271699999998, 2024-09-13T06:43:53.932 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:53.932 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:53.932 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:53.932 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:53.932 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:53.932 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 181725 2024-09-13T06:43:53.932 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:53.932 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:53.932 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:53.933 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:53.933 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.706863+0000", 2024-09-13T06:43:53.933 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:53.933 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:53.933 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:53.933 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:53.933 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.706863+0000", 2024-09-13T06:43:53.933 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:53.933 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:53.933 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:53.933 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:53.933 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.706862+0000", 2024-09-13T06:43:53.933 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.999999 2024-09-13T06:43:53.933 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:53.934 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:53.934 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:53.934 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.706869+0000", 2024-09-13T06:43:53.934 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.0899999999999999e-06 2024-09-13T06:43:53.934 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:53.934 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:53.934 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:53.934 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.706881+0000", 2024-09-13T06:43:53.934 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1727e-05 2024-09-13T06:43:53.934 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:53.934 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:53.934 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:53.935 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.706891+0000", 2024-09-13T06:43:53.935 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.9399999999999997e-06 2024-09-13T06:43:53.935 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:53.935 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:53.935 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:53.935 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.706952+0000", 2024-09-13T06:43:53.935 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.1106999999999996e-05 2024-09-13T06:43:53.935 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:53.935 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:53.935 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:43:53.935 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.706966+0000", 2024-09-13T06:43:53.935 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4173e-05 2024-09-13T06:43:53.935 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:53.935 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:53.936 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:53.936 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:46.412754+0000", 2024-09-13T06:43:53.936 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.70578759999999996 2024-09-13T06:43:53.936 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:53.936 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:53.936 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:53.936 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:46.412967+0000", 2024-09-13T06:43:53.936 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00021290999999999999 2024-09-13T06:43:53.936 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:53.936 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:53.936 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:53.936 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:46.413176+0000", 2024-09-13T06:43:53.936 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00020922099999999999 2024-09-13T06:43:53.937 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:53.937 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:53.937 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:53.937 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:53.937 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:53.937 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:181739 3.1b 3:dbd5e871:::rbd_data.11218aab7a9c.0000000000000003:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e203)", 2024-09-13T06:43:53.937 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:42:45.706937+0000", 2024-09-13T06:43:53.937 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 68.139684451999997, 2024-09-13T06:43:53.937 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.70679418800000005, 2024-09-13T06:43:53.937 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:53.937 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:53.937 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:53.937 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:53.938 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:53.938 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 181739 2024-09-13T06:43:53.938 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:53.938 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:53.938 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:53.938 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:53.938 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.706937+0000", 2024-09-13T06:43:53.938 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:53.938 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:53.938 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:53.938 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:53.938 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.706937+0000", 2024-09-13T06:43:53.938 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:53.938 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:53.939 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:53.939 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:53.939 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.706937+0000", 2024-09-13T06:43:53.939 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:53.939 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:53.939 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:53.939 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:53.939 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.706940+0000", 2024-09-13T06:43:53.939 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.4290000000000001e-06 2024-09-13T06:43:53.939 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:53.939 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:53.939 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:53.939 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.706949+0000", 2024-09-13T06:43:53.939 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.7730000000000005e-06 2024-09-13T06:43:53.940 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:53.940 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:53.940 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:53.940 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.706956+0000", 2024-09-13T06:43:53.940 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4240000000000004e-06 2024-09-13T06:43:53.940 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:53.940 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:53.940 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:53.940 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.706999+0000", 2024-09-13T06:43:53.940 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.2410999999999998e-05 2024-09-13T06:43:53.940 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:53.940 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:53.941 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:43:53.941 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.707011+0000", 2024-09-13T06:43:53.941 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2140999999999999e-05 2024-09-13T06:43:53.941 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:53.941 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:53.941 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:53.941 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:46.413278+0000", 2024-09-13T06:43:53.941 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.70626747199999995 2024-09-13T06:43:53.941 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:53.942 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:53.942 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:53.942 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:46.413471+0000", 2024-09-13T06:43:53.942 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00019234699999999999 2024-09-13T06:43:53.942 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:53.942 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:53.942 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:53.942 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:46.413731+0000", 2024-09-13T06:43:53.942 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00026069 2024-09-13T06:43:53.942 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:53.942 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:53.942 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:53.942 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:53.943 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:53.943 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:181753 3.1b 3:dbd5e871:::rbd_data.11218aab7a9c.0000000000000003:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e203)", 2024-09-13T06:43:53.943 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:42:45.706987+0000", 2024-09-13T06:43:53.943 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 68.139634369000007, 2024-09-13T06:43:53.943 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.70721309200000004, 2024-09-13T06:43:53.943 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:53.943 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:53.943 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:53.943 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:53.943 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:53.943 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 181753 2024-09-13T06:43:53.943 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:53.943 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:53.943 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:53.944 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:53.944 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.706987+0000", 2024-09-13T06:43:53.944 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:53.944 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:53.944 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:53.944 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:53.944 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.706987+0000", 2024-09-13T06:43:53.944 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:53.944 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:53.944 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:53.944 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:53.944 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.706987+0000", 2024-09-13T06:43:53.944 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:53.945 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:53.945 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:53.945 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:53.945 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.706990+0000", 2024-09-13T06:43:53.945 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.0759999999999999e-06 2024-09-13T06:43:53.945 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:53.945 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:53.945 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:53.945 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.706997+0000", 2024-09-13T06:43:53.945 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5809999999999999e-06 2024-09-13T06:43:53.945 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:53.945 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:53.945 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:53.946 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.707004+0000", 2024-09-13T06:43:53.946 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.7839999999999998e-06 2024-09-13T06:43:53.946 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:53.946 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:53.946 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:53.946 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.707046+0000", 2024-09-13T06:43:53.946 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.1474999999999998e-05 2024-09-13T06:43:53.946 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:53.946 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:53.946 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:43:53.946 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.707056+0000", 2024-09-13T06:43:53.946 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0825000000000001e-05 2024-09-13T06:43:53.946 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:53.946 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:53.947 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:53.947 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:46.413797+0000", 2024-09-13T06:43:53.947 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.70674101099999997 2024-09-13T06:43:53.947 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:53.947 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:53.947 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:53.947 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:46.413998+0000", 2024-09-13T06:43:53.947 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00020058700000000001 2024-09-13T06:43:53.947 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:53.947 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:53.947 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:53.947 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:46.414200+0000", 2024-09-13T06:43:53.947 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00020238400000000001 2024-09-13T06:43:53.947 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:53.947 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:53.948 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:53.948 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:53.948 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:53.948 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:43:53.949 INFO:teuthology.orchestra.run.smithi081.stdout:osd.5: {} 2024-09-13T06:43:53.949 INFO:teuthology.orchestra.run.smithi081.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-13T06:43:53.949 INFO:teuthology.orchestra.run.smithi081.stderr:Error ENXIO: problem getting command descriptions from osd.6 2024-09-13T06:43:53.950 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-13T06:43:53.951 INFO:teuthology.orchestra.run.smithi081.stdout:osd.7: {} 2024-09-13T06:43:53.951 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-13T06:43:53.952 INFO:teuthology.orchestra.run.smithi081.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-13T06:43:53.952 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-13T06:43:53.952 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:43:53.947+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:43:54.051 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:43:54.051+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:43:54.116 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:43:54.116 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-13T06:43:54.116 INFO:teuthology.orchestra.run.smithi081.stdout: "num_ops": 0 2024-09-13T06:43:54.116 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:43:54.130 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-13T06:43:54.151 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-13T06:43:54.152+0000 7fa8bb18e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 36790) UID: 0 2024-09-13T06:43:54.253 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:43:54.252+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:43:54.289 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:43:54.289 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-13T06:43:54.289 INFO:teuthology.orchestra.run.smithi081.stdout: "complaint_time": 30, 2024-09-13T06:43:54.289 INFO:teuthology.orchestra.run.smithi081.stdout: "num_blocked_ops": 0 2024-09-13T06:43:54.290 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:43:54.302 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-13T06:43:54.353 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:43:54.352+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:43:54.413 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:43:54.413 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 20, 2024-09-13T06:43:54.413 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 600, 2024-09-13T06:43:54.414 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [ 2024-09-13T06:43:54.414 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:54.414 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:90987 3.6 3:6263dd97:::rbd_object_map.11212443ae03.0000000000000049:head [call] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e137)", 2024-09-13T06:43:54.414 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:41:35.460333+0000", 2024-09-13T06:43:54.414 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 138.95203825799999, 2024-09-13T06:43:54.414 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0001633640000001, 2024-09-13T06:43:54.414 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:54.414 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:54.414 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:54.414 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:54.414 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:54.414 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 90987 2024-09-13T06:43:54.414 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:54.415 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:54.415 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:54.415 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:54.415 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:35.460333+0000", 2024-09-13T06:43:54.415 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:54.415 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:54.415 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:54.415 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:54.415 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:35.460333+0000", 2024-09-13T06:43:54.415 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:54.415 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:54.415 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:54.415 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:54.415 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:35.460330+0000", 2024-09-13T06:43:54.416 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999971 2024-09-13T06:43:54.416 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:54.416 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:54.416 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:54.416 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:35.460343+0000", 2024-09-13T06:43:54.416 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2695e-05 2024-09-13T06:43:54.416 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:54.416 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:54.416 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:54.416 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:35.460365+0000", 2024-09-13T06:43:54.416 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2473999999999999e-05 2024-09-13T06:43:54.416 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:54.416 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:54.417 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:54.417 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:35.460376+0000", 2024-09-13T06:43:54.417 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0383999999999999e-05 2024-09-13T06:43:54.417 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:54.417 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:54.417 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:54.417 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:35.460435+0000", 2024-09-13T06:43:54.417 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8650000000000003e-05 2024-09-13T06:43:54.417 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:54.417 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:54.417 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:43:54.417 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:35.460444+0000", 2024-09-13T06:43:54.418 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.0380000000000005e-06 2024-09-13T06:43:54.418 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:54.418 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:54.418 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:54.418 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:36.459433+0000", 2024-09-13T06:43:54.418 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.99898895799999998 2024-09-13T06:43:54.418 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:54.418 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:54.418 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:54.418 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:36.459622+0000", 2024-09-13T06:43:54.418 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00018940299999999999 2024-09-13T06:43:54.418 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:54.418 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:54.418 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:54.419 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:41:36.460497+0000", 2024-09-13T06:43:54.419 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00087481199999999999 2024-09-13T06:43:54.419 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:54.419 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:54.419 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:54.419 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:54.419 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:54.419 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:159632 3.a 3:57f62123:::rbd_header.112138ed422:head [create,call rbd.create in=9b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e167)", 2024-09-13T06:43:54.419 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:42:07.853351+0000", 2024-09-13T06:43:54.419 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 106.559020456, 2024-09-13T06:43:54.419 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.95572760999999995, 2024-09-13T06:43:54.419 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:54.420 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:43:54.420 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:54.420 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:54.420 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:54.420 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 159632 2024-09-13T06:43:54.420 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:54.420 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:54.420 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:54.420 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:54.420 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:07.853351+0000", 2024-09-13T06:43:54.420 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:54.420 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:54.420 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:54.421 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:54.421 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:07.853351+0000", 2024-09-13T06:43:54.421 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:54.421 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:54.421 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:54.421 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:54.421 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:07.853350+0000", 2024-09-13T06:43:54.421 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.999999 2024-09-13T06:43:54.421 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:54.421 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:54.421 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:54.421 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:07.853356+0000", 2024-09-13T06:43:54.422 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.1560000000000003e-06 2024-09-13T06:43:54.422 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:54.422 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:54.422 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:54.422 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:07.853365+0000", 2024-09-13T06:43:54.422 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.8079999999999999e-06 2024-09-13T06:43:54.422 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:54.422 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:54.422 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:54.422 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:07.853372+0000", 2024-09-13T06:43:54.422 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.5540000000000003e-06 2024-09-13T06:43:54.422 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:54.422 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:54.423 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:54.423 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:07.853430+0000", 2024-09-13T06:43:54.423 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8038000000000002e-05 2024-09-13T06:43:54.423 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:54.423 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:54.423 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:43:54.423 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:07.853444+0000", 2024-09-13T06:43:54.423 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3719e-05 2024-09-13T06:43:54.423 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:54.423 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:54.423 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:54.423 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:08.804052+0000", 2024-09-13T06:43:54.423 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.95060817799999997 2024-09-13T06:43:54.424 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:54.424 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:54.424 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:54.424 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:08.804234+0000", 2024-09-13T06:43:54.424 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00018192999999999999 2024-09-13T06:43:54.424 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:54.424 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:54.424 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 6", 2024-09-13T06:43:54.424 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:08.804797+0000", 2024-09-13T06:43:54.424 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00056282399999999996 2024-09-13T06:43:54.424 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:54.424 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:54.424 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-09-13T06:43:54.425 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:08.805704+0000", 2024-09-13T06:43:54.425 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00090781 2024-09-13T06:43:54.425 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:54.425 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:54.425 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:43:54.425 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:08.808907+0000", 2024-09-13T06:43:54.425 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0032031239999999999 2024-09-13T06:43:54.425 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:54.425 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:54.425 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:43:54.425 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:08.808998+0000", 2024-09-13T06:43:54.425 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.0191000000000004e-05 2024-09-13T06:43:54.425 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:54.426 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:54.426 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:54.426 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:08.809079+0000", 2024-09-13T06:43:54.426 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.1076999999999996e-05 2024-09-13T06:43:54.426 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:54.426 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:54.426 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:54.426 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:54.426 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:54.426 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:209556 3.6 3:673cd4d4:::rbd_data.1121cb4a09ed.0000000000000002:82 [read 831488~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e220)", 2024-09-13T06:43:54.426 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:43:05.152927+0000", 2024-09-13T06:43:54.426 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 49.259444455999997, 2024-09-13T06:43:54.426 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054987033999999997, 2024-09-13T06:43:54.427 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:54.427 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:54.427 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:54.427 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:54.427 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:54.427 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 209556 2024-09-13T06:43:54.427 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:54.427 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:54.427 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:54.427 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:54.427 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.152927+0000", 2024-09-13T06:43:54.427 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:54.427 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:54.428 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:54.428 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:54.428 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.152927+0000", 2024-09-13T06:43:54.428 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:54.428 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:54.428 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:54.428 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:54.428 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.152927+0000", 2024-09-13T06:43:54.428 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:54.428 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:54.428 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:54.428 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:54.429 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.152929+0000", 2024-09-13T06:43:54.429 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.514e-06 2024-09-13T06:43:54.429 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:54.429 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:54.429 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:54.429 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.152935+0000", 2024-09-13T06:43:54.429 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.5249999999999996e-06 2024-09-13T06:43:54.429 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:54.429 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:54.429 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:54.429 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.152939+0000", 2024-09-13T06:43:54.429 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.3209999999999998e-06 2024-09-13T06:43:54.430 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:54.430 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:54.430 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:54.430 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.207752+0000", 2024-09-13T06:43:54.430 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.054813273000000003 2024-09-13T06:43:54.430 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:54.430 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:54.430 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:54.430 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.207834+0000", 2024-09-13T06:43:54.430 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.1317999999999996e-05 2024-09-13T06:43:54.430 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:54.430 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:54.430 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:54.430 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.207914+0000", 2024-09-13T06:43:54.431 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.0568000000000005e-05 2024-09-13T06:43:54.431 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:54.431 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:54.431 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:54.431 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:54.431 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:54.431 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:209557 3.6 3:673cd4d4:::rbd_data.1121cb4a09ed.0000000000000002:82 [read 843776~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e220)", 2024-09-13T06:43:54.431 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:43:05.152944+0000", 2024-09-13T06:43:54.431 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 49.259427952000003, 2024-09-13T06:43:54.431 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.055174645000000001, 2024-09-13T06:43:54.431 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:54.431 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:54.431 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:54.432 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:54.432 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:54.432 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 209557 2024-09-13T06:43:54.432 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:54.432 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:54.432 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:54.432 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:54.432 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.152944+0000", 2024-09-13T06:43:54.432 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:54.432 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:54.432 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:54.433 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:54.433 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.152944+0000", 2024-09-13T06:43:54.433 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:54.433 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:54.433 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:54.433 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:54.433 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.152943+0000", 2024-09-13T06:43:54.433 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:54.433 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:54.433 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:54.433 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:54.433 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.152946+0000", 2024-09-13T06:43:54.433 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2419999999999999e-06 2024-09-13T06:43:54.433 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:54.434 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:54.434 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:54.434 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.152951+0000", 2024-09-13T06:43:54.434 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7570000000000001e-06 2024-09-13T06:43:54.434 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:54.434 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:54.434 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:54.434 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.152955+0000", 2024-09-13T06:43:54.434 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.0080000000000004e-06 2024-09-13T06:43:54.434 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:54.434 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:54.434 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:54.434 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.207958+0000", 2024-09-13T06:43:54.435 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.055002896000000003 2024-09-13T06:43:54.435 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:54.435 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:54.435 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:54.435 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.208041+0000", 2024-09-13T06:43:54.435 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.2962999999999998e-05 2024-09-13T06:43:54.435 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:54.435 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:54.435 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:54.435 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.208118+0000", 2024-09-13T06:43:54.435 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.7181000000000005e-05 2024-09-13T06:43:54.435 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:54.435 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:54.436 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:54.436 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:54.436 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:54.436 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:209558 3.6 3:673cd4d4:::rbd_data.1121cb4a09ed.0000000000000002:82 [read 856064~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e220)", 2024-09-13T06:43:54.436 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:43:05.152960+0000", 2024-09-13T06:43:54.436 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 49.259411757999999, 2024-09-13T06:43:54.436 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.055296975999999998, 2024-09-13T06:43:54.436 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:54.436 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:54.436 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:54.436 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:54.436 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:54.436 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 209558 2024-09-13T06:43:54.437 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:54.437 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:54.437 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:54.437 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:54.437 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.152960+0000", 2024-09-13T06:43:54.437 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:54.437 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:54.437 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:54.437 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:54.437 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.152960+0000", 2024-09-13T06:43:54.437 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:54.437 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:54.437 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:54.438 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:54.438 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.152959+0000", 2024-09-13T06:43:54.438 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:54.438 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:54.438 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:54.438 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:54.438 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.152962+0000", 2024-09-13T06:43:54.438 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6709999999999999e-06 2024-09-13T06:43:54.438 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:54.438 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:54.438 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:54.438 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.152968+0000", 2024-09-13T06:43:54.438 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.5589999999999996e-06 2024-09-13T06:43:54.439 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:54.439 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:54.439 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:54.439 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.152972+0000", 2024-09-13T06:43:54.439 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.216e-06 2024-09-13T06:43:54.439 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:54.439 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:54.439 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:54.439 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.208146+0000", 2024-09-13T06:43:54.439 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.055173627000000003 2024-09-13T06:43:54.439 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:54.439 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:54.439 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:54.440 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.208193+0000", 2024-09-13T06:43:54.440 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7200000000000002e-05 2024-09-13T06:43:54.440 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:54.440 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:54.440 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:54.440 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.208257+0000", 2024-09-13T06:43:54.440 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.4058000000000002e-05 2024-09-13T06:43:54.440 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:54.440 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:54.440 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:54.440 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:54.440 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:54.440 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:209559 3.6 3:673cd4d4:::rbd_data.1121cb4a09ed.0000000000000002:82 [read 868352~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e220)", 2024-09-13T06:43:54.441 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:43:05.152976+0000", 2024-09-13T06:43:54.441 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 49.259395644999998, 2024-09-13T06:43:54.441 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.055514239, 2024-09-13T06:43:54.441 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:54.441 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:54.441 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:54.441 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:54.441 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:54.441 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 209559 2024-09-13T06:43:54.441 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:54.441 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:54.441 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:54.441 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:54.442 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.152976+0000", 2024-09-13T06:43:54.442 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:54.442 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:54.442 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:54.442 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:54.442 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.152976+0000", 2024-09-13T06:43:54.442 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:54.442 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:54.442 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:54.442 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:54.442 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.152976+0000", 2024-09-13T06:43:54.442 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:54.442 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:54.442 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:54.443 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:54.443 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.152978+0000", 2024-09-13T06:43:54.443 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2189999999999998e-06 2024-09-13T06:43:54.443 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:54.443 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:54.443 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:54.443 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.152983+0000", 2024-09-13T06:43:54.443 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3639999999999998e-06 2024-09-13T06:43:54.443 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:54.443 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:54.443 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:54.443 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.152987+0000", 2024-09-13T06:43:54.444 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.9469999999999996e-06 2024-09-13T06:43:54.444 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:54.444 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:54.444 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:54.444 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.208301+0000", 2024-09-13T06:43:54.444 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.055314292000000001 2024-09-13T06:43:54.444 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:54.444 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:54.444 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:54.444 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.208385+0000", 2024-09-13T06:43:54.444 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.3755e-05 2024-09-13T06:43:54.444 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:54.444 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:54.445 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:54.445 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.208490+0000", 2024-09-13T06:43:54.445 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00010498800000000001 2024-09-13T06:43:54.445 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:54.445 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:54.445 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:54.445 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:54.445 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:54.445 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:209560 3.6 3:673cd4d4:::rbd_data.1121cb4a09ed.0000000000000002:82 [read 880640~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e220)", 2024-09-13T06:43:54.445 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:43:05.152991+0000", 2024-09-13T06:43:54.445 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 49.259380555999996, 2024-09-13T06:43:54.445 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.05572912, 2024-09-13T06:43:54.445 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:54.446 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:54.446 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:54.446 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:54.446 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:54.446 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 209560 2024-09-13T06:43:54.446 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:54.446 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:54.446 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:54.446 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:54.446 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.152991+0000", 2024-09-13T06:43:54.446 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:54.446 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:54.446 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:54.446 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:54.447 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.152991+0000", 2024-09-13T06:43:54.447 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:54.447 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:54.447 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:54.447 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:54.447 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.152991+0000", 2024-09-13T06:43:54.447 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:54.447 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:54.447 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:54.447 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:54.447 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.152993+0000", 2024-09-13T06:43:54.447 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3159999999999999e-06 2024-09-13T06:43:54.447 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:54.448 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:54.448 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:54.448 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.152999+0000", 2024-09-13T06:43:54.448 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8529999999999997e-06 2024-09-13T06:43:54.448 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:54.448 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:54.448 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:54.448 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153004+0000", 2024-09-13T06:43:54.448 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6210000000000003e-06 2024-09-13T06:43:54.448 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:54.448 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:54.448 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:54.448 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.208530+0000", 2024-09-13T06:43:54.448 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.055526407999999999 2024-09-13T06:43:54.449 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:54.449 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:54.449 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:54.449 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.208616+0000", 2024-09-13T06:43:54.449 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.6483000000000005e-05 2024-09-13T06:43:54.449 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:54.449 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:54.449 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:54.449 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.208720+0000", 2024-09-13T06:43:54.449 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00010376 2024-09-13T06:43:54.449 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:54.449 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:54.449 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:54.449 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:54.450 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:54.450 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:209561 3.6 3:673cd4d4:::rbd_data.1121cb4a09ed.0000000000000002:82 [read 892928~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e220)", 2024-09-13T06:43:54.450 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:43:05.153008+0000", 2024-09-13T06:43:54.450 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 49.259363661999998, 2024-09-13T06:43:54.450 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0559225, 2024-09-13T06:43:54.450 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:54.450 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:54.450 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:54.450 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:54.450 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:54.450 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 209561 2024-09-13T06:43:54.450 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:54.450 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:54.450 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:54.450 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:54.451 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153008+0000", 2024-09-13T06:43:54.451 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:54.451 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:54.451 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:54.451 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:54.451 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153008+0000", 2024-09-13T06:43:54.451 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:54.451 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:54.451 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:54.451 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:54.451 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153008+0000", 2024-09-13T06:43:54.451 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:54.451 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:54.452 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:54.452 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:54.452 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153010+0000", 2024-09-13T06:43:54.452 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.8210000000000002e-06 2024-09-13T06:43:54.452 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:54.452 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:54.452 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:54.452 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153016+0000", 2024-09-13T06:43:54.452 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.575e-06 2024-09-13T06:43:54.452 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:54.452 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:54.452 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:54.452 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153020+0000", 2024-09-13T06:43:54.453 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.408e-06 2024-09-13T06:43:54.453 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:54.453 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:54.453 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:54.453 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.208751+0000", 2024-09-13T06:43:54.453 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.055730225000000001 2024-09-13T06:43:54.453 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:54.453 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:54.453 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:54.453 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.208825+0000", 2024-09-13T06:43:54.453 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4548999999999994e-05 2024-09-13T06:43:54.453 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:54.453 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:54.454 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:54.454 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.208930+0000", 2024-09-13T06:43:54.454 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00010529700000000001 2024-09-13T06:43:54.454 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:54.454 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:54.454 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:54.454 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:54.454 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:54.454 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:209562 3.6 3:673cd4d4:::rbd_data.1121cb4a09ed.0000000000000002:82 [read 905216~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e220)", 2024-09-13T06:43:54.454 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:43:05.153024+0000", 2024-09-13T06:43:54.454 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 49.259347235999996, 2024-09-13T06:43:54.454 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.056099906999999997, 2024-09-13T06:43:54.455 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:54.455 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:54.455 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:54.455 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:54.455 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:54.455 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 209562 2024-09-13T06:43:54.455 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:54.455 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:54.455 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:54.455 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:54.455 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153024+0000", 2024-09-13T06:43:54.455 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:54.455 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:54.455 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:54.455 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:54.456 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153024+0000", 2024-09-13T06:43:54.456 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:54.456 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:54.456 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:54.456 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:54.456 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153024+0000", 2024-09-13T06:43:54.456 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:54.456 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:54.456 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:54.456 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:54.456 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153026+0000", 2024-09-13T06:43:54.456 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.165e-06 2024-09-13T06:43:54.456 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:54.457 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:54.457 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:54.457 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153031+0000", 2024-09-13T06:43:54.457 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.1669999999999998e-06 2024-09-13T06:43:54.457 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:54.457 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:54.457 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:54.457 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153035+0000", 2024-09-13T06:43:54.457 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.0799999999999999e-06 2024-09-13T06:43:54.457 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:54.457 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:54.457 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:54.457 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.208956+0000", 2024-09-13T06:43:54.458 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.055920848000000002 2024-09-13T06:43:54.458 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:54.458 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:54.458 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:54.458 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.209032+0000", 2024-09-13T06:43:54.458 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5809999999999994e-05 2024-09-13T06:43:54.458 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:54.458 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:54.458 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:54.458 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.209124+0000", 2024-09-13T06:43:54.458 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.2157999999999994e-05 2024-09-13T06:43:54.458 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:54.458 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:54.458 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:54.459 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:54.459 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:54.459 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:209563 3.6 3:673cd4d4:::rbd_data.1121cb4a09ed.0000000000000002:82 [read 917504~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e220)", 2024-09-13T06:43:54.459 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:43:05.153039+0000", 2024-09-13T06:43:54.459 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 49.259332272999998, 2024-09-13T06:43:54.459 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.056280030000000002, 2024-09-13T06:43:54.459 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:54.459 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:54.459 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:54.459 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:54.459 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:54.459 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 209563 2024-09-13T06:43:54.459 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:54.460 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:54.460 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:54.460 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:54.460 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153039+0000", 2024-09-13T06:43:54.460 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:54.460 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:54.460 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:54.460 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:54.460 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153039+0000", 2024-09-13T06:43:54.460 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:54.460 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:54.460 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:54.461 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:54.461 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153039+0000", 2024-09-13T06:43:54.461 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:54.461 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:54.461 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:54.461 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:54.461 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153041+0000", 2024-09-13T06:43:54.461 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3800000000000001e-06 2024-09-13T06:43:54.461 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:54.461 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:54.461 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:54.461 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153047+0000", 2024-09-13T06:43:54.461 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2059999999999998e-06 2024-09-13T06:43:54.461 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:54.461 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:54.462 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:54.462 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153051+0000", 2024-09-13T06:43:54.462 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.0980000000000004e-06 2024-09-13T06:43:54.462 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:54.462 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:54.462 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:54.462 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.209150+0000", 2024-09-13T06:43:54.462 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.056099351999999998 2024-09-13T06:43:54.462 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:54.462 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:54.462 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:54.462 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.209226+0000", 2024-09-13T06:43:54.462 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5939999999999995e-05 2024-09-13T06:43:54.463 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:54.463 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:54.463 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:54.463 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.209319+0000", 2024-09-13T06:43:54.463 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.3399000000000005e-05 2024-09-13T06:43:54.463 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:54.463 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:54.463 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:54.463 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:54.463 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:54.463 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:209564 3.6 3:673cd4d4:::rbd_data.1121cb4a09ed.0000000000000002:82 [read 929792~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e220)", 2024-09-13T06:43:54.463 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:43:05.153055+0000", 2024-09-13T06:43:54.463 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 49.259317027000002, 2024-09-13T06:43:54.463 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.056404468999999999, 2024-09-13T06:43:54.463 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:54.464 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:54.464 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:54.464 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:54.464 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:54.464 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 209564 2024-09-13T06:43:54.464 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:54.464 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:54.464 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:54.464 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:54.464 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153055+0000", 2024-09-13T06:43:54.464 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:54.464 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:54.464 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:54.464 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:54.465 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153055+0000", 2024-09-13T06:43:54.465 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:54.465 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:54.465 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:54.465 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:54.465 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153054+0000", 2024-09-13T06:43:54.465 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:54.465 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:54.465 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:54.465 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:54.465 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153056+0000", 2024-09-13T06:43:54.465 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1600000000000001e-06 2024-09-13T06:43:54.465 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:54.465 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:54.466 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:54.466 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153062+0000", 2024-09-13T06:43:54.466 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2549999999999997e-06 2024-09-13T06:43:54.466 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:54.466 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:54.466 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:54.466 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153066+0000", 2024-09-13T06:43:54.466 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.0400000000000003e-06 2024-09-13T06:43:54.466 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:54.466 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:54.466 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:54.466 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.209342+0000", 2024-09-13T06:43:54.466 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.056276640000000003 2024-09-13T06:43:54.466 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:54.467 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:54.467 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:54.467 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.209382+0000", 2024-09-13T06:43:54.467 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.9626999999999999e-05 2024-09-13T06:43:54.467 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:54.467 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:54.467 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:54.467 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.209459+0000", 2024-09-13T06:43:54.467 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.7072999999999999e-05 2024-09-13T06:43:54.467 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:54.467 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:54.467 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:54.467 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:54.467 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:54.468 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:209565 3.6 3:673cd4d4:::rbd_data.1121cb4a09ed.0000000000000002:82 [read 942080~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e220)", 2024-09-13T06:43:54.468 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:43:05.153070+0000", 2024-09-13T06:43:54.468 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 49.259302054000003, 2024-09-13T06:43:54.468 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.056688545999999999, 2024-09-13T06:43:54.468 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:54.468 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:54.468 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:54.468 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:54.468 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:54.468 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 209565 2024-09-13T06:43:54.468 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:54.468 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:54.468 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:54.468 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:54.469 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153070+0000", 2024-09-13T06:43:54.469 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:54.469 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:54.469 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:54.469 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:54.469 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153070+0000", 2024-09-13T06:43:54.469 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:54.469 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:54.469 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:54.469 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:54.469 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153069+0000", 2024-09-13T06:43:54.469 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:54.469 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:54.470 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:54.470 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:54.470 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153071+0000", 2024-09-13T06:43:54.470 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1780000000000002e-06 2024-09-13T06:43:54.470 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:54.470 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:54.470 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:54.470 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153077+0000", 2024-09-13T06:43:54.470 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3639999999999998e-06 2024-09-13T06:43:54.470 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:54.470 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:54.470 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:54.470 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153081+0000", 2024-09-13T06:43:54.470 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.1640000000000003e-06 2024-09-13T06:43:54.471 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:54.471 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:54.471 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:54.471 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.209486+0000", 2024-09-13T06:43:54.471 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.056405258999999999 2024-09-13T06:43:54.471 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:54.471 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:54.471 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:54.471 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.209560+0000", 2024-09-13T06:43:54.471 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4247999999999998e-05 2024-09-13T06:43:54.471 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:54.471 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:54.471 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:54.471 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.209758+0000", 2024-09-13T06:43:54.471 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000197634 2024-09-13T06:43:54.472 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:54.472 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:54.472 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:54.472 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:54.472 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:54.472 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:209566 3.6 3:673cd4d4:::rbd_data.1121cb4a09ed.0000000000000002:82 [read 954368~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e220)", 2024-09-13T06:43:54.472 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:43:05.153085+0000", 2024-09-13T06:43:54.472 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 49.259286744999997, 2024-09-13T06:43:54.472 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.057070779000000002, 2024-09-13T06:43:54.472 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:54.472 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:54.472 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:54.473 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:54.473 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:54.473 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 209566 2024-09-13T06:43:54.473 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:54.473 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:54.473 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:54.473 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:54.473 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153085+0000", 2024-09-13T06:43:54.473 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:54.473 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:54.473 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:54.473 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:54.473 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153085+0000", 2024-09-13T06:43:54.473 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:54.474 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:54.474 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:54.474 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:54.474 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153085+0000", 2024-09-13T06:43:54.474 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:54.474 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:54.474 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:54.474 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:54.474 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153087+0000", 2024-09-13T06:43:54.474 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1220000000000002e-06 2024-09-13T06:43:54.474 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:54.474 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:54.474 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:54.474 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153092+0000", 2024-09-13T06:43:54.475 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3090000000000003e-06 2024-09-13T06:43:54.475 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:54.475 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:54.475 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:54.475 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153096+0000", 2024-09-13T06:43:54.475 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.1819999999999999e-06 2024-09-13T06:43:54.475 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:54.475 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:54.475 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:54.475 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.209787+0000", 2024-09-13T06:43:54.475 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.056690819000000003 2024-09-13T06:43:54.475 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:54.475 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:54.476 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:54.476 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.209863+0000", 2024-09-13T06:43:54.476 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5551999999999998e-05 2024-09-13T06:43:54.476 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:54.476 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:54.476 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:54.476 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.210156+0000", 2024-09-13T06:43:54.476 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00029310499999999999 2024-09-13T06:43:54.476 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:54.476 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:54.476 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:54.476 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:54.476 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:54.477 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:209567 3.6 3:673cd4d4:::rbd_data.1121cb4a09ed.0000000000000002:82 [read 966656~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e220)", 2024-09-13T06:43:54.477 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:43:05.153100+0000", 2024-09-13T06:43:54.477 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 49.259271372000001, 2024-09-13T06:43:54.477 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.057459567000000003, 2024-09-13T06:43:54.477 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:54.477 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:54.477 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:54.477 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:54.477 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:54.477 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 209567 2024-09-13T06:43:54.477 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:54.477 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:54.478 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:54.478 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:54.478 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153100+0000", 2024-09-13T06:43:54.478 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:54.478 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:54.478 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:54.478 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:54.478 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153100+0000", 2024-09-13T06:43:54.478 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:54.478 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:54.478 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:54.478 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:54.478 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153100+0000", 2024-09-13T06:43:54.478 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:54.479 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:54.479 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:54.479 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:54.479 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153105+0000", 2024-09-13T06:43:54.479 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.5400000000000003e-06 2024-09-13T06:43:54.479 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:54.479 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:54.479 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:54.479 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153111+0000", 2024-09-13T06:43:54.479 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.541e-06 2024-09-13T06:43:54.479 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:54.479 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:54.479 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:54.479 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153115+0000", 2024-09-13T06:43:54.480 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.104e-06 2024-09-13T06:43:54.480 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:54.480 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:54.480 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:54.480 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.210183+0000", 2024-09-13T06:43:54.480 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.057067842000000001 2024-09-13T06:43:54.480 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:54.480 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:54.480 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:54.480 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.210257+0000", 2024-09-13T06:43:54.480 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3726999999999994e-05 2024-09-13T06:43:54.480 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:54.480 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:54.481 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:54.481 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.210560+0000", 2024-09-13T06:43:54.481 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00030318899999999999 2024-09-13T06:43:54.481 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:54.481 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:54.481 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:54.481 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:54.481 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:54.481 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:209568 3.6 3:673cd4d4:::rbd_data.1121cb4a09ed.0000000000000002:82 [read 978944~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e220)", 2024-09-13T06:43:54.481 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:43:05.153119+0000", 2024-09-13T06:43:54.481 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 49.259252171999997, 2024-09-13T06:43:54.481 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.057810786000000003, 2024-09-13T06:43:54.481 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:54.481 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:54.482 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:54.482 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:54.482 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:54.482 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 209568 2024-09-13T06:43:54.482 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:54.482 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:54.482 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:54.482 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:54.482 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153119+0000", 2024-09-13T06:43:54.482 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:54.482 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:54.482 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:54.483 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:54.483 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153119+0000", 2024-09-13T06:43:54.483 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:54.483 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:54.483 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:54.483 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:54.483 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153119+0000", 2024-09-13T06:43:54.483 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:54.483 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:54.483 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:54.483 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:54.483 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153121+0000", 2024-09-13T06:43:54.483 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.21e-06 2024-09-13T06:43:54.484 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:54.484 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:54.484 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:54.484 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153127+0000", 2024-09-13T06:43:54.484 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.4670000000000003e-06 2024-09-13T06:43:54.484 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:54.484 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:54.484 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:54.484 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153131+0000", 2024-09-13T06:43:54.484 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.2629999999999997e-06 2024-09-13T06:43:54.484 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:54.484 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:54.484 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:54.484 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.210587+0000", 2024-09-13T06:43:54.485 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.05745567 2024-09-13T06:43:54.485 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:54.485 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:54.485 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:54.485 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.210660+0000", 2024-09-13T06:43:54.485 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3430000000000007e-05 2024-09-13T06:43:54.485 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:54.485 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:54.485 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:54.485 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.210930+0000", 2024-09-13T06:43:54.485 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000270127 2024-09-13T06:43:54.485 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:54.486 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:54.486 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:54.486 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:54.486 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:54.486 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:209569 3.6 3:673cd4d4:::rbd_data.1121cb4a09ed.0000000000000002:82 [read 991232~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e220)", 2024-09-13T06:43:54.486 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:43:05.153135+0000", 2024-09-13T06:43:54.486 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 49.259236747000003, 2024-09-13T06:43:54.486 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.058283125999999998, 2024-09-13T06:43:54.486 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:54.486 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:54.486 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:54.486 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:54.486 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:54.487 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 209569 2024-09-13T06:43:54.487 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:54.487 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:54.487 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:54.487 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:54.487 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153135+0000", 2024-09-13T06:43:54.487 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:54.487 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:54.487 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:54.487 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:54.487 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153135+0000", 2024-09-13T06:43:54.487 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:54.487 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:54.488 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:54.488 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:54.488 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153135+0000", 2024-09-13T06:43:54.488 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:54.488 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:54.488 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:54.488 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:54.488 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153136+0000", 2024-09-13T06:43:54.488 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9069999999999999e-06 2024-09-13T06:43:54.488 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:54.489 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:54.489 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:54.489 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153142+0000", 2024-09-13T06:43:54.489 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3009999999999997e-06 2024-09-13T06:43:54.489 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:54.489 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:54.489 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:54.489 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153146+0000", 2024-09-13T06:43:54.489 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.442e-06 2024-09-13T06:43:54.489 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:54.489 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:54.489 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:54.489 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.210959+0000", 2024-09-13T06:43:54.490 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.057812456999999998 2024-09-13T06:43:54.490 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:54.490 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:54.490 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:54.490 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.211038+0000", 2024-09-13T06:43:54.490 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.9140999999999993e-05 2024-09-13T06:43:54.490 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:54.490 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:54.490 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:54.490 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.211418+0000", 2024-09-13T06:43:54.490 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00038017500000000001 2024-09-13T06:43:54.490 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:54.490 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:54.491 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:54.491 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:54.491 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:54.491 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:209570 3.6 3:673cd4d4:::rbd_data.1121cb4a09ed.0000000000000002:82 [read 1003520~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e220)", 2024-09-13T06:43:54.491 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:43:05.153151+0000", 2024-09-13T06:43:54.491 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 49.259220864, 2024-09-13T06:43:54.491 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.058499886000000001, 2024-09-13T06:43:54.491 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:54.491 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:54.491 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:54.491 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:54.491 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:54.491 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 209570 2024-09-13T06:43:54.491 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:54.492 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:54.492 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:54.492 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:54.492 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153151+0000", 2024-09-13T06:43:54.492 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:54.492 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:54.492 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:54.492 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:54.492 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153151+0000", 2024-09-13T06:43:54.492 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:54.492 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:54.492 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:54.492 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:54.492 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153150+0000", 2024-09-13T06:43:54.493 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:54.493 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:54.493 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:54.493 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:54.493 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153153+0000", 2024-09-13T06:43:54.493 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3630000000000001e-06 2024-09-13T06:43:54.493 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:54.493 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:54.493 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:54.493 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153159+0000", 2024-09-13T06:43:54.493 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3690000000000003e-06 2024-09-13T06:43:54.493 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:54.493 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:54.494 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:54.494 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153164+0000", 2024-09-13T06:43:54.494 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5379999999999996e-06 2024-09-13T06:43:54.494 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:54.494 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:54.494 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:54.494 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.211448+0000", 2024-09-13T06:43:54.494 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.058283926 2024-09-13T06:43:54.494 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:54.494 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:54.494 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:54.494 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.211508+0000", 2024-09-13T06:43:54.494 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0741e-05 2024-09-13T06:43:54.494 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:54.495 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:54.495 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:54.495 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.211651+0000", 2024-09-13T06:43:54.495 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00014232200000000001 2024-09-13T06:43:54.495 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:54.495 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:54.495 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:54.495 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:54.495 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:54.495 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:209571 3.6 3:673cd4d4:::rbd_data.1121cb4a09ed.0000000000000002:82 [read 1015808~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e220)", 2024-09-13T06:43:54.495 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:43:05.153168+0000", 2024-09-13T06:43:54.495 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 49.259203352999997, 2024-09-13T06:43:54.496 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.058709363000000001, 2024-09-13T06:43:54.496 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:54.496 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:54.496 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:54.496 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:54.496 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:54.496 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 209571 2024-09-13T06:43:54.496 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:54.496 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:54.496 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:54.496 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:54.496 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153168+0000", 2024-09-13T06:43:54.496 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:54.497 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:54.497 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:54.497 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:54.497 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153168+0000", 2024-09-13T06:43:54.497 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:54.497 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:54.497 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:54.497 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:54.497 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153168+0000", 2024-09-13T06:43:54.497 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:54.497 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:54.497 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:54.497 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:54.497 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153170+0000", 2024-09-13T06:43:54.498 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4499999999999998e-06 2024-09-13T06:43:54.498 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:54.498 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:54.498 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:54.498 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153176+0000", 2024-09-13T06:43:54.498 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0050000000000001e-06 2024-09-13T06:43:54.498 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:54.498 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:54.498 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:54.498 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153181+0000", 2024-09-13T06:43:54.498 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.267e-06 2024-09-13T06:43:54.498 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:54.498 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:54.498 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:54.498 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.211678+0000", 2024-09-13T06:43:54.499 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.058497751000000001 2024-09-13T06:43:54.499 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:54.499 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:54.499 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:54.499 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.211744+0000", 2024-09-13T06:43:54.499 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.5266999999999997e-05 2024-09-13T06:43:54.499 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:54.499 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:54.499 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:54.499 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.211878+0000", 2024-09-13T06:43:54.499 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00013394500000000001 2024-09-13T06:43:54.499 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:54.499 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:54.499 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:54.500 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:54.500 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:54.500 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:209572 3.6 3:673cd4d4:::rbd_data.1121cb4a09ed.0000000000000002:82 [read 1028096~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e220)", 2024-09-13T06:43:54.500 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:43:05.153185+0000", 2024-09-13T06:43:54.500 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 49.259186958000001, 2024-09-13T06:43:54.500 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.058928534999999997, 2024-09-13T06:43:54.500 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:54.500 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:54.500 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:54.500 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:54.500 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:54.500 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 209572 2024-09-13T06:43:54.500 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:54.500 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:54.501 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:54.501 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:54.501 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153185+0000", 2024-09-13T06:43:54.501 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:54.501 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:54.501 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:54.501 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:54.501 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153185+0000", 2024-09-13T06:43:54.501 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:54.501 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:54.501 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:54.501 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:54.501 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153184+0000", 2024-09-13T06:43:54.502 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:54.502 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:54.502 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:54.502 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:54.502 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153186+0000", 2024-09-13T06:43:54.502 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1040000000000001e-06 2024-09-13T06:43:54.502 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:54.502 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:54.502 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:54.502 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153191+0000", 2024-09-13T06:43:54.502 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0409999999999997e-06 2024-09-13T06:43:54.502 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:54.502 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:54.502 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:54.503 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153196+0000", 2024-09-13T06:43:54.503 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.2200000000000003e-06 2024-09-13T06:43:54.503 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:54.503 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:54.503 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:54.503 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.211906+0000", 2024-09-13T06:43:54.503 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.058709960999999998 2024-09-13T06:43:54.503 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:54.503 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:54.503 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:54.503 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.211977+0000", 2024-09-13T06:43:54.503 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.1080000000000004e-05 2024-09-13T06:43:54.503 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:54.503 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:54.503 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:54.504 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.212113+0000", 2024-09-13T06:43:54.504 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00013644500000000001 2024-09-13T06:43:54.504 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:54.504 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:54.504 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:54.504 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:54.504 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:54.504 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:209573 3.6 3:673cd4d4:::rbd_data.1121cb4a09ed.0000000000000002:82 [read 1040384~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e220)", 2024-09-13T06:43:54.504 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:43:05.153199+0000", 2024-09-13T06:43:54.504 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 49.259172167999999, 2024-09-13T06:43:54.504 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.059182414000000003, 2024-09-13T06:43:54.504 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:54.505 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:54.505 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:54.505 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:54.505 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:54.505 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 209573 2024-09-13T06:43:54.505 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:54.505 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:54.505 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:54.505 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:54.505 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153199+0000", 2024-09-13T06:43:54.505 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:54.505 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:54.505 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:54.506 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:54.506 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153199+0000", 2024-09-13T06:43:54.506 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:54.506 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:54.506 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:54.506 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:54.506 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153199+0000", 2024-09-13T06:43:54.506 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:54.506 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:54.506 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:54.506 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:54.506 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153201+0000", 2024-09-13T06:43:54.506 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0470000000000001e-06 2024-09-13T06:43:54.506 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:54.507 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:54.507 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:54.507 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153207+0000", 2024-09-13T06:43:54.507 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3730000000000001e-06 2024-09-13T06:43:54.507 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:54.507 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:54.507 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:54.507 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.153211+0000", 2024-09-13T06:43:54.507 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.053e-06 2024-09-13T06:43:54.507 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:54.507 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:54.507 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:54.507 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.212141+0000", 2024-09-13T06:43:54.508 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.058930064999999997 2024-09-13T06:43:54.508 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:54.508 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:54.508 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:54.508 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.212214+0000", 2024-09-13T06:43:54.508 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3096999999999995e-05 2024-09-13T06:43:54.508 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:54.508 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:54.508 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:54.508 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:43:05.212382+0000", 2024-09-13T06:43:54.508 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000168138 2024-09-13T06:43:54.508 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:54.508 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:54.509 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:54.509 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:54.509 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:54.509 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:43:54.510 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-13T06:43:54.511 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:43:54.511+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:43:54.611 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:43:54.611+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:43:54.684 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:43:54.685 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-13T06:43:54.685 INFO:teuthology.orchestra.run.smithi081.stdout: "num_ops": 0 2024-09-13T06:43:54.685 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:43:54.701 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-13T06:43:54.742 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:43:54.743+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:43:54.813 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:43:54.812+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:43:54.871 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:43:54.871 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-13T06:43:54.871 INFO:teuthology.orchestra.run.smithi081.stdout: "complaint_time": 30, 2024-09-13T06:43:54.871 INFO:teuthology.orchestra.run.smithi081.stdout: "num_blocked_ops": 0 2024-09-13T06:43:54.871 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:43:54.886 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-13T06:43:54.930 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:43:54.931+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:43:55.017 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:43:55.015+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:43:55.019 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:43:55.019 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 20, 2024-09-13T06:43:55.019 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 600, 2024-09-13T06:43:55.019 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [ 2024-09-13T06:43:55.020 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.020 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:36160 3.f 3:f62782c2:::rbd_object_map.11219660270d.0000000000000016:head [call] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-13T06:43:55.020 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:01.607291+0000", 2024-09-13T06:43:55.020 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 233.41169693200001, 2024-09-13T06:43:55.020 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.99619456699999998, 2024-09-13T06:43:55.020 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:55.020 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:55.020 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:55.020 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:55.020 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:55.020 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 36160 2024-09-13T06:43:55.020 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.020 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:55.021 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.021 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:55.021 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:01.607291+0000", 2024-09-13T06:43:55.021 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:55.021 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.021 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.021 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:55.021 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:01.607291+0000", 2024-09-13T06:43:55.021 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:55.021 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.021 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.021 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:55.021 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:01.607289+0000", 2024-09-13T06:43:55.022 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999976 2024-09-13T06:43:55.022 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.022 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.022 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:55.022 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:01.607302+0000", 2024-09-13T06:43:55.022 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3018e-05 2024-09-13T06:43:55.022 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.022 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.022 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:55.022 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:01.607323+0000", 2024-09-13T06:43:55.022 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1030999999999999e-05 2024-09-13T06:43:55.022 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.022 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.022 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:55.022 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:01.607342+0000", 2024-09-13T06:43:55.023 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8961e-05 2024-09-13T06:43:55.023 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.023 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.023 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:55.023 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:01.607425+0000", 2024-09-13T06:43:55.023 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.3171999999999996e-05 2024-09-13T06:43:55.023 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.023 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.023 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:43:55.023 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:01.607441+0000", 2024-09-13T06:43:55.023 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5996999999999999e-05 2024-09-13T06:43:55.023 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.024 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.024 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:55.024 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:02.596186+0000", 2024-09-13T06:43:55.024 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.98874432000000001 2024-09-13T06:43:55.024 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.024 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.024 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for missing object", 2024-09-13T06:43:55.024 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:02.596618+0000", 2024-09-13T06:43:55.024 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000432032 2024-09-13T06:43:55.024 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.024 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.024 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:55.024 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:02.600845+0000", 2024-09-13T06:43:55.025 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0042277410000000001 2024-09-13T06:43:55.025 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.025 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.025 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:55.025 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:02.601003+0000", 2024-09-13T06:43:55.025 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00015731999999999999 2024-09-13T06:43:55.025 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.025 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.025 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:55.025 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:02.603486+0000", 2024-09-13T06:43:55.025 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0024832510000000001 2024-09-13T06:43:55.025 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:55.025 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:55.025 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:55.025 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.026 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.026 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:37806 3.9 3:951cb95b:::rbd_data.1121d8143c6e.0000000000000002:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e56)", 2024-09-13T06:43:55.026 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:06.373482+0000", 2024-09-13T06:43:55.026 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 228.645505896, 2024-09-13T06:43:55.026 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.002476213, 2024-09-13T06:43:55.026 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:55.026 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:55.026 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:55.026 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:55.026 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:55.026 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 37806 2024-09-13T06:43:55.026 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.026 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:55.027 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.027 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:55.027 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.373482+0000", 2024-09-13T06:43:55.027 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:55.027 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.027 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.027 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:55.027 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.373482+0000", 2024-09-13T06:43:55.027 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:55.027 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.027 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.027 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:55.027 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.373479+0000", 2024-09-13T06:43:55.028 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999962 2024-09-13T06:43:55.028 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.028 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.028 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:55.028 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.373495+0000", 2024-09-13T06:43:55.028 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6640999999999999e-05 2024-09-13T06:43:55.028 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.028 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.028 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:55.028 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.373542+0000", 2024-09-13T06:43:55.028 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6229000000000001e-05 2024-09-13T06:43:55.028 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.028 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.028 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:55.028 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.373564+0000", 2024-09-13T06:43:55.029 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2684000000000002e-05 2024-09-13T06:43:55.029 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.029 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.029 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:55.029 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374268+0000", 2024-09-13T06:43:55.029 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00070363700000000001 2024-09-13T06:43:55.029 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.029 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.029 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:43:55.029 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374305+0000", 2024-09-13T06:43:55.029 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.6936e-05 2024-09-13T06:43:55.029 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.029 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.029 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:55.030 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.375175+0000", 2024-09-13T06:43:55.030 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.000870454 2024-09-13T06:43:55.030 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.030 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.030 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:55.030 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.375678+0000", 2024-09-13T06:43:55.030 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00050292499999999999 2024-09-13T06:43:55.030 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.030 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.030 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:55.030 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.375959+0000", 2024-09-13T06:43:55.030 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00028050599999999997 2024-09-13T06:43:55.030 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:55.030 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:55.031 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:55.031 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.031 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.031 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:37821 3.9 3:951cb95b:::rbd_data.1121d8143c6e.0000000000000002:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e56)", 2024-09-13T06:43:55.031 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:06.374454+0000", 2024-09-13T06:43:55.031 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 228.644534779, 2024-09-13T06:43:55.031 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.002545072, 2024-09-13T06:43:55.031 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:55.031 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:55.031 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:55.031 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:55.031 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:55.031 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 37821 2024-09-13T06:43:55.031 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.032 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:55.032 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.032 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:55.032 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374454+0000", 2024-09-13T06:43:55.032 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:55.032 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.032 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.032 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:55.032 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374454+0000", 2024-09-13T06:43:55.032 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:55.032 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.032 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.032 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:55.032 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374452+0000", 2024-09-13T06:43:55.033 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999981 2024-09-13T06:43:55.033 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.033 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.033 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:55.033 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374463+0000", 2024-09-13T06:43:55.033 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0756e-05 2024-09-13T06:43:55.033 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.033 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.033 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:55.033 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374487+0000", 2024-09-13T06:43:55.033 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4887000000000001e-05 2024-09-13T06:43:55.033 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.034 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.034 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:55.034 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374504+0000", 2024-09-13T06:43:55.034 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6852000000000001e-05 2024-09-13T06:43:55.034 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.034 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.034 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:55.034 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374829+0000", 2024-09-13T06:43:55.034 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000324684 2024-09-13T06:43:55.034 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.034 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.034 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:43:55.034 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374880+0000", 2024-09-13T06:43:55.034 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.1378000000000002e-05 2024-09-13T06:43:55.035 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.035 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.035 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:55.035 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.376423+0000", 2024-09-13T06:43:55.035 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.001542734 2024-09-13T06:43:55.035 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.035 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.035 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:55.035 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.376607+0000", 2024-09-13T06:43:55.035 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000183656 2024-09-13T06:43:55.035 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.035 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.035 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:55.036 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.376999+0000", 2024-09-13T06:43:55.036 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00039191200000000001 2024-09-13T06:43:55.036 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:55.036 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:55.036 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:55.036 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.036 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.036 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:37836 3.9 3:951cb95b:::rbd_data.1121d8143c6e.0000000000000002:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e56)", 2024-09-13T06:43:55.036 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:06.374929+0000", 2024-09-13T06:43:55.036 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 228.64405912699999, 2024-09-13T06:43:55.036 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.002778825, 2024-09-13T06:43:55.036 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:55.036 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:55.036 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:55.036 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:55.037 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:55.037 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 37836 2024-09-13T06:43:55.037 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.037 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:55.037 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.037 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:55.037 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374929+0000", 2024-09-13T06:43:55.037 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:55.037 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.037 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.037 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:55.038 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374929+0000", 2024-09-13T06:43:55.038 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:55.038 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.038 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.038 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:55.038 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374927+0000", 2024-09-13T06:43:55.038 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999981 2024-09-13T06:43:55.038 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.038 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.038 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:55.038 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374939+0000", 2024-09-13T06:43:55.038 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1846e-05 2024-09-13T06:43:55.038 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.038 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.038 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:55.039 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374962+0000", 2024-09-13T06:43:55.039 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3054e-05 2024-09-13T06:43:55.039 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.039 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.039 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:55.039 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374978+0000", 2024-09-13T06:43:55.039 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5899000000000001e-05 2024-09-13T06:43:55.039 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.039 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.039 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:55.039 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.375106+0000", 2024-09-13T06:43:55.039 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00012789 2024-09-13T06:43:55.039 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.039 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.039 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:43:55.040 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.375134+0000", 2024-09-13T06:43:55.040 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.8254000000000001e-05 2024-09-13T06:43:55.040 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.040 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.040 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:55.040 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.377082+0000", 2024-09-13T06:43:55.040 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0019471520000001 2024-09-13T06:43:55.040 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.040 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.040 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:55.040 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.377330+0000", 2024-09-13T06:43:55.040 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00024834199999999997 2024-09-13T06:43:55.040 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.041 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.041 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:55.041 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.377708+0000", 2024-09-13T06:43:55.041 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00037817100000000001 2024-09-13T06:43:55.041 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:55.041 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:55.041 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:55.041 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.041 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.041 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:37851 3.9 3:951cb95b:::rbd_data.1121d8143c6e.0000000000000002:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e56)", 2024-09-13T06:43:55.041 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:06.382636+0000", 2024-09-13T06:43:55.041 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 228.63635224199999, 2024-09-13T06:43:55.041 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.99582539400000003, 2024-09-13T06:43:55.041 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:55.042 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:55.042 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:55.042 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:55.042 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:55.042 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 37851 2024-09-13T06:43:55.042 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.042 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:55.042 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.042 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:55.042 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.382636+0000", 2024-09-13T06:43:55.042 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:55.042 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.042 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.042 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:55.043 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.382636+0000", 2024-09-13T06:43:55.043 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:55.043 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.043 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.043 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:55.043 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.382633+0000", 2024-09-13T06:43:55.043 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999971 2024-09-13T06:43:55.043 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.043 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.043 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:55.043 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.382652+0000", 2024-09-13T06:43:55.043 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8834999999999998e-05 2024-09-13T06:43:55.043 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.043 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.043 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:55.044 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.382695+0000", 2024-09-13T06:43:55.044 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.3136000000000002e-05 2024-09-13T06:43:55.044 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.044 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.044 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:55.044 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.382716+0000", 2024-09-13T06:43:55.044 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1421e-05 2024-09-13T06:43:55.044 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.044 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.044 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:55.044 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.382860+0000", 2024-09-13T06:43:55.044 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00014389200000000001 2024-09-13T06:43:55.044 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.044 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.044 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:43:55.045 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.382890+0000", 2024-09-13T06:43:55.045 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9827000000000001e-05 2024-09-13T06:43:55.045 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.045 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.045 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:55.045 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.377779+0000", 2024-09-13T06:43:55.045 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.99488842899999996 2024-09-13T06:43:55.045 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.045 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.045 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:55.045 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.378007+0000", 2024-09-13T06:43:55.045 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00022838099999999999 2024-09-13T06:43:55.045 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.045 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.046 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:55.046 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.378462+0000", 2024-09-13T06:43:55.046 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00045452300000000003 2024-09-13T06:43:55.046 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:55.046 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:55.046 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:55.046 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.046 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.046 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:37866 3.9 3:951cb95b:::rbd_data.1121d8143c6e.0000000000000002:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e56)", 2024-09-13T06:43:55.046 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:06.383951+0000", 2024-09-13T06:43:55.046 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 228.63503755599999, 2024-09-13T06:43:55.046 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.99517962299999996, 2024-09-13T06:43:55.046 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:55.046 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:55.046 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:55.047 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:55.047 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:55.047 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 37866 2024-09-13T06:43:55.047 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.047 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:55.047 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.047 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:55.047 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.383951+0000", 2024-09-13T06:43:55.047 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:55.047 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.047 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.047 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:55.048 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.383951+0000", 2024-09-13T06:43:55.048 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:55.048 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.048 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.048 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:55.048 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.383949+0000", 2024-09-13T06:43:55.048 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999981 2024-09-13T06:43:55.048 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.048 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.048 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:55.048 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.383961+0000", 2024-09-13T06:43:55.048 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1999e-05 2024-09-13T06:43:55.049 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.049 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.049 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:55.049 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384019+0000", 2024-09-13T06:43:55.049 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7621000000000003e-05 2024-09-13T06:43:55.049 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.049 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.049 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:55.049 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384040+0000", 2024-09-13T06:43:55.049 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1528000000000001e-05 2024-09-13T06:43:55.049 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.049 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.049 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:55.049 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384186+0000", 2024-09-13T06:43:55.050 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00014573799999999999 2024-09-13T06:43:55.050 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.050 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.050 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:43:55.050 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384204+0000", 2024-09-13T06:43:55.050 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7992e-05 2024-09-13T06:43:55.050 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.050 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.050 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:55.050 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.378536+0000", 2024-09-13T06:43:55.050 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.99433268600000002 2024-09-13T06:43:55.050 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.050 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.050 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:55.050 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.378771+0000", 2024-09-13T06:43:55.051 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00023445399999999999 2024-09-13T06:43:55.051 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.051 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.051 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:55.051 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.379130+0000", 2024-09-13T06:43:55.051 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00035954200000000002 2024-09-13T06:43:55.051 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:55.051 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:55.051 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:55.051 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.051 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.051 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:37881 3.9 3:951cb95b:::rbd_data.1121d8143c6e.0000000000000002:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e56)", 2024-09-13T06:43:55.051 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:06.384239+0000", 2024-09-13T06:43:55.052 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 228.634749142, 2024-09-13T06:43:55.052 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.99541483500000005, 2024-09-13T06:43:55.052 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:55.052 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:55.052 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:55.052 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:55.052 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:55.052 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 37881 2024-09-13T06:43:55.052 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.052 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:55.052 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.052 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:55.052 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384239+0000", 2024-09-13T06:43:55.052 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:55.053 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.053 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.053 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:55.053 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384239+0000", 2024-09-13T06:43:55.053 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:55.053 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.053 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.053 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:55.053 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384238+0000", 2024-09-13T06:43:55.053 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999986 2024-09-13T06:43:55.053 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.053 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.053 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:55.053 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384246+0000", 2024-09-13T06:43:55.054 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.2449999999999998e-06 2024-09-13T06:43:55.054 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.054 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.054 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:55.054 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384268+0000", 2024-09-13T06:43:55.054 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1518e-05 2024-09-13T06:43:55.054 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.054 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.054 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:55.054 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384282+0000", 2024-09-13T06:43:55.054 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4501999999999999e-05 2024-09-13T06:43:55.054 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.054 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.054 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:55.055 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384356+0000", 2024-09-13T06:43:55.055 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4265999999999997e-05 2024-09-13T06:43:55.055 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.055 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.055 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:43:55.055 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384370+0000", 2024-09-13T06:43:55.055 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3942e-05 2024-09-13T06:43:55.055 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.055 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.055 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:55.055 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.379199+0000", 2024-09-13T06:43:55.055 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.99482866599999997 2024-09-13T06:43:55.055 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.056 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.056 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:55.056 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.379347+0000", 2024-09-13T06:43:55.056 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00014749199999999999 2024-09-13T06:43:55.056 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.056 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.056 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:55.056 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.379654+0000", 2024-09-13T06:43:55.056 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00030752999999999998 2024-09-13T06:43:55.056 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:55.056 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:55.056 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:55.056 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.057 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.057 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:37896 3.9 3:951cb95b:::rbd_data.1121d8143c6e.0000000000000002:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e56)", 2024-09-13T06:43:55.057 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:06.384412+0000", 2024-09-13T06:43:55.057 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 228.63457670899999, 2024-09-13T06:43:55.057 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.99777835999999998, 2024-09-13T06:43:55.057 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:55.057 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:55.057 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:55.057 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:55.057 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:55.057 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 37896 2024-09-13T06:43:55.057 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.057 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:55.057 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.057 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:55.058 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384412+0000", 2024-09-13T06:43:55.058 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:55.058 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.058 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.058 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:55.058 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384412+0000", 2024-09-13T06:43:55.058 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:55.058 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.058 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.058 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:55.058 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384410+0000", 2024-09-13T06:43:55.058 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.999999 2024-09-13T06:43:55.058 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.059 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.059 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:55.059 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384418+0000", 2024-09-13T06:43:55.059 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.486e-06 2024-09-13T06:43:55.059 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.059 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.059 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:55.059 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384436+0000", 2024-09-13T06:43:55.059 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7668000000000001e-05 2024-09-13T06:43:55.059 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.059 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.059 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:55.059 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384449+0000", 2024-09-13T06:43:55.059 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3395e-05 2024-09-13T06:43:55.059 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.059 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.060 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:55.060 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384605+0000", 2024-09-13T06:43:55.060 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00015563099999999999 2024-09-13T06:43:55.060 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.060 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.060 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:43:55.060 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384635+0000", 2024-09-13T06:43:55.060 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.0383999999999999e-05 2024-09-13T06:43:55.060 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.060 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.060 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:55.060 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.379730+0000", 2024-09-13T06:43:55.060 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.99509493999999998 2024-09-13T06:43:55.060 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.061 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.061 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:55.061 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.379964+0000", 2024-09-13T06:43:55.061 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00023353499999999999 2024-09-13T06:43:55.061 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.061 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.061 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:55.061 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.382190+0000", 2024-09-13T06:43:55.061 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0022265039999999998 2024-09-13T06:43:55.061 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:55.061 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:55.061 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:55.061 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.062 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.062 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43223 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 393216~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:43:55.062 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558267+0000", 2024-09-13T06:43:55.062 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 213.460721398, 2024-09-13T06:43:55.062 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.062813151999999997, 2024-09-13T06:43:55.062 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:55.062 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:55.062 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:55.062 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:55.062 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:55.062 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43223 2024-09-13T06:43:55.062 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.062 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:55.062 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.063 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:55.063 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558267+0000", 2024-09-13T06:43:55.063 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:55.063 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.063 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.063 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:55.063 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558267+0000", 2024-09-13T06:43:55.063 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:55.063 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.063 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.063 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:55.063 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558266+0000", 2024-09-13T06:43:55.063 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:55.063 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.063 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.064 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:55.064 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558270+0000", 2024-09-13T06:43:55.064 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.2389999999999998e-06 2024-09-13T06:43:55.064 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.064 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.064 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:55.064 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558277+0000", 2024-09-13T06:43:55.064 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5680000000000002e-06 2024-09-13T06:43:55.064 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.064 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.064 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:55.064 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558282+0000", 2024-09-13T06:43:55.064 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7060000000000003e-06 2024-09-13T06:43:55.064 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.065 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.065 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:55.065 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.620731+0000", 2024-09-13T06:43:55.065 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.062448661000000003 2024-09-13T06:43:55.065 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.065 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.065 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:55.065 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.620806+0000", 2024-09-13T06:43:55.065 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5862e-05 2024-09-13T06:43:55.065 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.065 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.065 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:55.065 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.621080+0000", 2024-09-13T06:43:55.065 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00027368599999999998 2024-09-13T06:43:55.065 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:55.066 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:55.066 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:55.066 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.066 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.066 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43224 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 407552~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:43:55.066 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558286+0000", 2024-09-13T06:43:55.066 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 213.46070203400001, 2024-09-13T06:43:55.066 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.063179052999999999, 2024-09-13T06:43:55.066 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:55.066 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:55.066 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:55.066 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:55.066 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:55.066 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43224 2024-09-13T06:43:55.066 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.067 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:55.067 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.067 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:55.067 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558286+0000", 2024-09-13T06:43:55.067 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:55.067 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.067 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.067 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:55.067 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558286+0000", 2024-09-13T06:43:55.067 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:55.067 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.067 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.067 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:55.067 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558286+0000", 2024-09-13T06:43:55.067 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:55.068 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.068 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.068 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:55.068 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558288+0000", 2024-09-13T06:43:55.068 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.227e-06 2024-09-13T06:43:55.068 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.068 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.068 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:55.068 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558292+0000", 2024-09-13T06:43:55.068 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.6289999999999999e-06 2024-09-13T06:43:55.068 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.068 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.068 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:55.068 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558294+0000", 2024-09-13T06:43:55.069 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5409999999999999e-06 2024-09-13T06:43:55.069 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.069 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.069 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:55.069 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.621110+0000", 2024-09-13T06:43:55.069 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.062815776000000004 2024-09-13T06:43:55.069 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.069 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.069 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:55.069 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.621186+0000", 2024-09-13T06:43:55.069 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5570999999999999e-05 2024-09-13T06:43:55.069 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.069 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.069 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:55.070 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.621465+0000", 2024-09-13T06:43:55.070 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00027988200000000001 2024-09-13T06:43:55.070 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:55.070 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:55.070 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:55.070 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.070 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.070 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43225 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 421888~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:43:55.070 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558296+0000", 2024-09-13T06:43:55.070 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 213.460692067, 2024-09-13T06:43:55.070 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.063551110999999993, 2024-09-13T06:43:55.070 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:55.070 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:55.070 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:55.070 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:55.071 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:55.071 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43225 2024-09-13T06:43:55.071 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.071 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:55.071 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.071 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:55.071 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558296+0000", 2024-09-13T06:43:55.071 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:55.071 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.071 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.071 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:55.071 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558296+0000", 2024-09-13T06:43:55.071 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:55.071 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.072 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.072 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:55.072 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558296+0000", 2024-09-13T06:43:55.072 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:43:55.072 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.072 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.072 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:55.072 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558305+0000", 2024-09-13T06:43:55.072 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.5290000000000008e-06 2024-09-13T06:43:55.072 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.072 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.072 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:55.072 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558308+0000", 2024-09-13T06:43:55.072 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.5619999999999999e-06 2024-09-13T06:43:55.073 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.073 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.073 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:55.073 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558311+0000", 2024-09-13T06:43:55.073 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.43e-06 2024-09-13T06:43:55.073 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.073 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.073 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:55.073 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.621495+0000", 2024-09-13T06:43:55.073 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.063184289000000005 2024-09-13T06:43:55.073 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.073 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.073 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:55.073 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.621569+0000", 2024-09-13T06:43:55.073 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4250000000000002e-05 2024-09-13T06:43:55.074 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.074 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.074 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:55.074 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.621847+0000", 2024-09-13T06:43:55.074 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00027826400000000002 2024-09-13T06:43:55.074 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:55.074 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:55.074 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:55.074 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.074 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.074 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43226 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 436224~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:43:55.074 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558313+0000", 2024-09-13T06:43:55.074 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 213.460675431, 2024-09-13T06:43:55.075 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.063914420999999999, 2024-09-13T06:43:55.075 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:55.075 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:55.075 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:55.075 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:55.075 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:55.075 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43226 2024-09-13T06:43:55.075 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.075 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:55.075 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.075 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:55.075 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558313+0000", 2024-09-13T06:43:55.075 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:55.075 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.075 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.076 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:55.076 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558313+0000", 2024-09-13T06:43:55.076 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:55.076 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.076 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.076 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:55.076 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558313+0000", 2024-09-13T06:43:55.076 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:55.076 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.076 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.076 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:55.076 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558314+0000", 2024-09-13T06:43:55.076 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3740000000000001e-06 2024-09-13T06:43:55.076 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.076 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.077 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:55.077 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558317+0000", 2024-09-13T06:43:55.077 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9730000000000002e-06 2024-09-13T06:43:55.077 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.077 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.077 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:55.077 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558319+0000", 2024-09-13T06:43:55.077 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4059999999999999e-06 2024-09-13T06:43:55.077 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.077 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.077 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:55.077 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.621877+0000", 2024-09-13T06:43:55.077 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.063557408999999995 2024-09-13T06:43:55.077 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.077 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.078 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:55.078 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.621951+0000", 2024-09-13T06:43:55.078 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4487999999999996e-05 2024-09-13T06:43:55.078 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.078 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.078 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:55.078 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.622227+0000", 2024-09-13T06:43:55.078 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000276011 2024-09-13T06:43:55.078 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:55.078 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:55.078 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:55.078 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.079 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.079 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43227 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 450560~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:43:55.079 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558322+0000", 2024-09-13T06:43:55.079 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 213.46066685, 2024-09-13T06:43:55.079 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.064285348000000006, 2024-09-13T06:43:55.079 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:55.079 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:55.079 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:55.079 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:55.079 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:55.079 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43227 2024-09-13T06:43:55.079 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.079 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:55.079 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.080 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:55.080 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558322+0000", 2024-09-13T06:43:55.080 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:55.080 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.080 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.080 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:55.080 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558322+0000", 2024-09-13T06:43:55.080 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:55.080 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.080 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.080 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:55.080 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558321+0000", 2024-09-13T06:43:55.080 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:43:55.080 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.080 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.081 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:55.081 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558323+0000", 2024-09-13T06:43:55.081 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.576e-06 2024-09-13T06:43:55.081 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.081 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.081 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:55.081 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558328+0000", 2024-09-13T06:43:55.081 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0719999999999999e-06 2024-09-13T06:43:55.081 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.081 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.081 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:55.081 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558332+0000", 2024-09-13T06:43:55.081 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.8130000000000002e-06 2024-09-13T06:43:55.081 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.081 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.082 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:55.082 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.622255+0000", 2024-09-13T06:43:55.082 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.063923195000000002 2024-09-13T06:43:55.082 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.082 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.082 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:55.082 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.622330+0000", 2024-09-13T06:43:55.082 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5383000000000007e-05 2024-09-13T06:43:55.082 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.082 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.082 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:55.082 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.622607+0000", 2024-09-13T06:43:55.082 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00027651999999999999 2024-09-13T06:43:55.082 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:55.082 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:55.083 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:55.083 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.083 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.083 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43228 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 464896~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:43:55.083 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558335+0000", 2024-09-13T06:43:55.083 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 213.46065294100001, 2024-09-13T06:43:55.083 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.064652253000000007, 2024-09-13T06:43:55.083 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:55.083 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:55.083 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:55.083 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:55.083 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:55.083 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43228 2024-09-13T06:43:55.083 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.083 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:55.084 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.084 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:55.084 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558335+0000", 2024-09-13T06:43:55.084 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:55.084 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.084 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.084 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:55.084 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558335+0000", 2024-09-13T06:43:55.084 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:55.084 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.084 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.084 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:55.084 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558335+0000", 2024-09-13T06:43:55.084 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:55.085 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.085 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.085 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:55.085 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558337+0000", 2024-09-13T06:43:55.085 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1380000000000001e-06 2024-09-13T06:43:55.085 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.085 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.085 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:55.085 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558343+0000", 2024-09-13T06:43:55.085 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.5140000000000001e-06 2024-09-13T06:43:55.085 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.085 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.085 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:55.086 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558348+0000", 2024-09-13T06:43:55.086 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9640000000000002e-06 2024-09-13T06:43:55.086 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.086 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.086 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:55.086 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.622636+0000", 2024-09-13T06:43:55.086 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.064288260999999999 2024-09-13T06:43:55.086 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.086 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.086 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:55.086 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.622715+0000", 2024-09-13T06:43:55.086 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.9351000000000006e-05 2024-09-13T06:43:55.086 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.086 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.086 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:55.087 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.622988+0000", 2024-09-13T06:43:55.087 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00027242599999999998 2024-09-13T06:43:55.087 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:55.087 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:55.087 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:55.087 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.087 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.087 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43229 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 479232~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:43:55.087 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558352+0000", 2024-09-13T06:43:55.087 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 213.460636526, 2024-09-13T06:43:55.087 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.065018024999999993, 2024-09-13T06:43:55.087 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:55.087 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:55.087 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:55.088 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:55.088 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:55.088 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43229 2024-09-13T06:43:55.088 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.088 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:55.088 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.088 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:55.088 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558352+0000", 2024-09-13T06:43:55.088 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:55.088 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.088 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.088 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:55.088 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558352+0000", 2024-09-13T06:43:55.089 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:55.089 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.089 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.089 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:55.089 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558352+0000", 2024-09-13T06:43:55.089 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:55.089 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.089 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.089 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:55.089 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558354+0000", 2024-09-13T06:43:55.089 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4930000000000001e-06 2024-09-13T06:43:55.089 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.089 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.090 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:55.090 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558360+0000", 2024-09-13T06:43:55.090 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.263e-06 2024-09-13T06:43:55.090 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.090 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.090 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:55.090 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558369+0000", 2024-09-13T06:43:55.090 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.0829999999999993e-06 2024-09-13T06:43:55.090 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.090 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.090 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:55.090 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.623017+0000", 2024-09-13T06:43:55.090 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.064647799000000006 2024-09-13T06:43:55.091 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.091 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.091 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:55.091 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.623090+0000", 2024-09-13T06:43:55.091 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3071000000000006e-05 2024-09-13T06:43:55.091 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.091 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.091 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:55.091 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.623370+0000", 2024-09-13T06:43:55.091 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000279661 2024-09-13T06:43:55.091 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:55.091 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:55.091 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:55.092 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.092 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.092 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43230 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 493568~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:43:55.092 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558374+0000", 2024-09-13T06:43:55.092 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 213.460614233, 2024-09-13T06:43:55.092 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.065410435000000003, 2024-09-13T06:43:55.092 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:55.092 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:55.092 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:55.092 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:55.092 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:55.092 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43230 2024-09-13T06:43:55.092 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.093 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:55.093 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.093 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:55.093 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558374+0000", 2024-09-13T06:43:55.093 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:55.093 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.093 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.093 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:55.093 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558374+0000", 2024-09-13T06:43:55.093 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:55.093 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.093 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.093 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:55.094 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558374+0000", 2024-09-13T06:43:55.094 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:55.094 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.094 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.094 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:55.094 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558376+0000", 2024-09-13T06:43:55.094 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4430000000000002e-06 2024-09-13T06:43:55.094 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.094 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.094 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:55.094 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558382+0000", 2024-09-13T06:43:55.094 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3029999999999996e-06 2024-09-13T06:43:55.094 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.095 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.095 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:55.095 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558387+0000", 2024-09-13T06:43:55.095 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.1699999999999999e-06 2024-09-13T06:43:55.095 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.095 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.095 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:55.095 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.623400+0000", 2024-09-13T06:43:55.095 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.065013244999999997 2024-09-13T06:43:55.095 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.095 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.095 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:55.095 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.623474+0000", 2024-09-13T06:43:55.096 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3889999999999999e-05 2024-09-13T06:43:55.096 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.096 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.096 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:55.096 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.623785+0000", 2024-09-13T06:43:55.096 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00031080099999999998 2024-09-13T06:43:55.096 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:55.096 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:55.096 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:55.096 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.096 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.096 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43231 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 507904~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:43:55.096 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558391+0000", 2024-09-13T06:43:55.096 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 213.46059754800001, 2024-09-13T06:43:55.096 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.065788597000000004, 2024-09-13T06:43:55.097 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:55.097 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:55.097 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:55.097 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:55.097 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:55.097 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43231 2024-09-13T06:43:55.097 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.097 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:55.097 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.097 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:55.097 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558391+0000", 2024-09-13T06:43:55.097 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:55.097 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.098 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.098 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:55.098 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558391+0000", 2024-09-13T06:43:55.098 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:55.098 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.098 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.098 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:55.098 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558390+0000", 2024-09-13T06:43:55.098 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:55.098 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.098 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.098 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:55.098 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558393+0000", 2024-09-13T06:43:55.098 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2570000000000002e-06 2024-09-13T06:43:55.099 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.099 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.099 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:55.099 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558399+0000", 2024-09-13T06:43:55.099 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0419999999999999e-06 2024-09-13T06:43:55.099 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.099 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.099 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:55.099 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558403+0000", 2024-09-13T06:43:55.099 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6249999999999998e-06 2024-09-13T06:43:55.099 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.099 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.099 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:55.099 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.623811+0000", 2024-09-13T06:43:55.099 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.065407549999999995 2024-09-13T06:43:55.100 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.100 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.100 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:55.100 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.623877+0000", 2024-09-13T06:43:55.100 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.5902999999999996e-05 2024-09-13T06:43:55.100 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.100 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.100 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:55.100 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.624179+0000", 2024-09-13T06:43:55.100 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00030259999999999998 2024-09-13T06:43:55.100 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:55.100 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:55.100 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:55.100 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.101 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.101 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43232 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 522240~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:43:55.101 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558422+0000", 2024-09-13T06:43:55.101 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 213.460566771, 2024-09-13T06:43:55.101 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.066176061999999994, 2024-09-13T06:43:55.101 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:55.101 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:55.101 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:55.101 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:55.101 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:55.101 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43232 2024-09-13T06:43:55.101 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.101 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:55.102 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.102 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:55.102 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558422+0000", 2024-09-13T06:43:55.102 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:55.102 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.102 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.102 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:55.102 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558422+0000", 2024-09-13T06:43:55.102 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:55.102 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.102 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.102 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:55.102 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558421+0000", 2024-09-13T06:43:55.102 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:55.103 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.103 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.103 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:55.103 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558428+0000", 2024-09-13T06:43:55.103 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.1690000000000003e-06 2024-09-13T06:43:55.103 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.103 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.103 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:55.103 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558434+0000", 2024-09-13T06:43:55.103 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9309999999999996e-06 2024-09-13T06:43:55.103 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.103 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.104 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:55.104 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558447+0000", 2024-09-13T06:43:55.104 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.271e-05 2024-09-13T06:43:55.104 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.104 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.104 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:55.104 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.624209+0000", 2024-09-13T06:43:55.104 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.065762102000000003 2024-09-13T06:43:55.104 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.104 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.104 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:55.104 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.624282+0000", 2024-09-13T06:43:55.104 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.2889e-05 2024-09-13T06:43:55.104 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.105 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.105 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:55.105 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.624598+0000", 2024-09-13T06:43:55.105 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00031591399999999998 2024-09-13T06:43:55.105 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:55.105 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:55.105 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:55.105 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.105 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.105 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43486 3.f 3:f7da9c8f:::rbd_data.1121f5f2e1c0.000000000000000b:1f [read 260096~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:43:55.105 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.569088+0000", 2024-09-13T06:43:55.105 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 213.44990004799999, 2024-09-13T06:43:55.105 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.062579223000000003, 2024-09-13T06:43:55.106 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:55.106 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:55.106 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:55.106 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:55.106 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:55.106 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43486 2024-09-13T06:43:55.106 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.106 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:55.106 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.106 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:55.106 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.569088+0000", 2024-09-13T06:43:55.106 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:55.106 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.106 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.107 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:55.107 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.569088+0000", 2024-09-13T06:43:55.107 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:55.107 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.107 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.107 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:55.107 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.569088+0000", 2024-09-13T06:43:55.107 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:55.107 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.107 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.107 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:55.107 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.569091+0000", 2024-09-13T06:43:55.107 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9629999999999998e-06 2024-09-13T06:43:55.107 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.107 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.108 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:55.108 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.569097+0000", 2024-09-13T06:43:55.108 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.4160000000000001e-06 2024-09-13T06:43:55.108 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.108 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.108 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:55.108 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.569102+0000", 2024-09-13T06:43:55.108 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6659999999999999e-06 2024-09-13T06:43:55.108 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.108 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.108 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:55.108 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.631346+0000", 2024-09-13T06:43:55.108 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.062243896 2024-09-13T06:43:55.109 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.109 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.109 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:55.109 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.631413+0000", 2024-09-13T06:43:55.109 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.7638000000000005e-05 2024-09-13T06:43:55.109 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.109 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.109 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:55.109 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.631668+0000", 2024-09-13T06:43:55.109 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0002541 2024-09-13T06:43:55.109 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:55.109 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:55.109 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:55.110 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.110 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.110 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:170125 3.9 3:94e4bf8d:::rbd_object_map.1121fa0cc8a3.000000000000006d:head [writefull 0~37] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e190)", 2024-09-13T06:43:55.110 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:42:30.601501+0000", 2024-09-13T06:43:55.110 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 84.417487836999996, 2024-09-13T06:43:55.110 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.80498820000000004, 2024-09-13T06:43:55.110 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:55.110 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:43:55.110 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:55.110 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:55.110 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:55.110 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 170125 2024-09-13T06:43:55.110 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.110 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:55.111 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.111 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:55.111 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:30.601501+0000", 2024-09-13T06:43:55.111 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:55.111 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.111 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.111 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:55.111 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:30.601501+0000", 2024-09-13T06:43:55.111 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:55.111 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.111 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.111 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:55.111 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:30.601499+0000", 2024-09-13T06:43:55.112 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999986 2024-09-13T06:43:55.112 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.112 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.112 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:55.112 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:30.601506+0000", 2024-09-13T06:43:55.112 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.9940000000000003e-06 2024-09-13T06:43:55.112 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.112 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.112 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:55.112 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:30.601519+0000", 2024-09-13T06:43:55.112 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2875e-05 2024-09-13T06:43:55.112 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.112 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.112 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:55.113 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:30.601525+0000", 2024-09-13T06:43:55.113 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8549999999999998e-06 2024-09-13T06:43:55.113 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.113 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.113 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:55.113 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:30.601560+0000", 2024-09-13T06:43:55.113 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.5271000000000002e-05 2024-09-13T06:43:55.113 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.113 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.113 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:43:55.113 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:30.601566+0000", 2024-09-13T06:43:55.113 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3090000000000001e-06 2024-09-13T06:43:55.113 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.114 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.114 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:55.114 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:31.403017+0000", 2024-09-13T06:43:55.114 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.80145064200000005 2024-09-13T06:43:55.114 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.114 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.114 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:55.114 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:31.403252+0000", 2024-09-13T06:43:55.114 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000234718 2024-09-13T06:43:55.114 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.114 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.114 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 7", 2024-09-13T06:43:55.115 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:31.403521+0000", 2024-09-13T06:43:55.115 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00026917 2024-09-13T06:43:55.115 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.115 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.115 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-09-13T06:43:55.115 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:31.404918+0000", 2024-09-13T06:43:55.115 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.001397017 2024-09-13T06:43:55.115 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.115 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.115 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:43:55.115 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:31.406176+0000", 2024-09-13T06:43:55.115 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.001257998 2024-09-13T06:43:55.115 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.115 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.116 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:43:55.116 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:31.406334+0000", 2024-09-13T06:43:55.116 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00015819099999999999 2024-09-13T06:43:55.116 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.116 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.116 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:55.116 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:31.406489+0000", 2024-09-13T06:43:55.116 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00015476699999999999 2024-09-13T06:43:55.116 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:55.116 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:55.116 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:55.116 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:55.116 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:55.116 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:43:55.118 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-13T06:43:55.118 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:43:55.116+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:43:55.218 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:43:55.219+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:43:55.288 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:43:55.289 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-13T06:43:55.289 INFO:teuthology.orchestra.run.smithi081.stdout: "num_ops": 0 2024-09-13T06:43:55.289 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:43:55.302 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-13T06:43:55.346 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:43:55.347+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:43:55.421 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:43:55.420+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:43:55.468 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:43:55.468 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-13T06:43:55.468 INFO:teuthology.orchestra.run.smithi081.stdout: "complaint_time": 30, 2024-09-13T06:43:55.468 INFO:teuthology.orchestra.run.smithi081.stdout: "num_blocked_ops": 0 2024-09-13T06:43:55.468 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:43:55.482 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-13T06:43:55.526 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:43:55.527+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:43:55.580 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-13T06:43:55.614 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:43:55.614 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 20, 2024-09-13T06:43:55.615 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 600, 2024-09-13T06:43:55.615 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [ 2024-09-13T06:43:55.615 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.615 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:2226 3.15 3:af026987:::rbd_data.112173e2f1b7.0000000000000017:head [sparse-read 0~4194304] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-13T06:43:55.615 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:37.606562+0000", 2024-09-13T06:43:55.615 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 258.00765921999999, 2024-09-13T06:43:55.615 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.83322091700000001, 2024-09-13T06:43:55.615 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:55.615 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:43:55.615 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:55.615 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:55.615 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:55.615 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 2226 2024-09-13T06:43:55.615 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.616 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:55.616 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.616 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:55.616 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606562+0000", 2024-09-13T06:43:55.616 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:55.616 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.616 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.616 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:55.616 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606562+0000", 2024-09-13T06:43:55.616 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:55.616 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.616 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.616 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:55.616 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606561+0000", 2024-09-13T06:43:55.616 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:55.617 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.617 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.617 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:55.617 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606565+0000", 2024-09-13T06:43:55.617 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.4379999999999999e-06 2024-09-13T06:43:55.617 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.617 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.617 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:55.617 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606569+0000", 2024-09-13T06:43:55.617 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.425e-06 2024-09-13T06:43:55.617 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.618 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.618 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:55.618 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606572+0000", 2024-09-13T06:43:55.618 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.05e-06 2024-09-13T06:43:55.618 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.618 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.618 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:55.618 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606621+0000", 2024-09-13T06:43:55.618 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.8723000000000001e-05 2024-09-13T06:43:55.618 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.619 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.619 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:43:55.619 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606630+0000", 2024-09-13T06:43:55.619 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.8040000000000007e-06 2024-09-13T06:43:55.619 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.619 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.619 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:55.619 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.439648+0000", 2024-09-13T06:43:55.619 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.83301824800000002 2024-09-13T06:43:55.619 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.619 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.619 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:55.619 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.439782+0000", 2024-09-13T06:43:55.619 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00013466699999999999 2024-09-13T06:43:55.619 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:55.620 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:55.620 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:55.620 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.620 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.620 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25661 3.8 3:1180686c:::rbd_data.1121f2c5ee81.0000000000000009:13 [read 397312~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:43:55.620 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.436956+0000", 2024-09-13T06:43:55.620 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 239.177264686, 2024-09-13T06:43:55.620 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089036758999999993, 2024-09-13T06:43:55.620 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:55.620 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:55.620 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:55.620 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:55.620 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:55.620 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25661 2024-09-13T06:43:55.621 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.621 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:55.621 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.621 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:55.621 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436956+0000", 2024-09-13T06:43:55.621 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:55.621 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.621 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.621 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:55.621 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436956+0000", 2024-09-13T06:43:55.621 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:55.621 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.621 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.622 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:55.622 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436956+0000", 2024-09-13T06:43:55.622 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:55.622 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.622 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.622 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:55.622 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436958+0000", 2024-09-13T06:43:55.622 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1770000000000001e-06 2024-09-13T06:43:55.622 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.622 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.622 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:55.622 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436963+0000", 2024-09-13T06:43:55.622 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.6489999999999996e-06 2024-09-13T06:43:55.622 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.622 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.623 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:55.623 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436975+0000", 2024-09-13T06:43:55.623 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1783999999999999e-05 2024-09-13T06:43:55.623 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.623 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.623 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:55.623 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.525671+0000", 2024-09-13T06:43:55.623 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.088696292999999995 2024-09-13T06:43:55.623 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.623 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.623 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:55.623 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.525749+0000", 2024-09-13T06:43:55.623 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.7589000000000005e-05 2024-09-13T06:43:55.623 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.623 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.624 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:55.624 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.525993+0000", 2024-09-13T06:43:55.624 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00024381000000000001 2024-09-13T06:43:55.624 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:55.624 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:55.624 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:55.624 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.624 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.624 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25662 3.8 3:1180686c:::rbd_data.1121f2c5ee81.0000000000000009:13 [read 421888~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:43:55.624 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.436980+0000", 2024-09-13T06:43:55.624 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 239.17724037400001, 2024-09-13T06:43:55.624 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089367577000000004, 2024-09-13T06:43:55.624 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:55.625 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:55.625 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:55.625 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:55.625 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:55.625 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25662 2024-09-13T06:43:55.625 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.625 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:55.625 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.625 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:55.625 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436980+0000", 2024-09-13T06:43:55.625 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:55.625 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.625 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.625 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:55.626 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436980+0000", 2024-09-13T06:43:55.626 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:55.626 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.626 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.626 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:55.626 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436980+0000", 2024-09-13T06:43:55.626 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:55.626 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.626 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.626 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:55.626 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436982+0000", 2024-09-13T06:43:55.626 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3989999999999998e-06 2024-09-13T06:43:55.626 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.626 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.626 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:55.627 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436988+0000", 2024-09-13T06:43:55.627 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0039999999999996e-06 2024-09-13T06:43:55.627 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.627 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.627 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:55.627 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436993+0000", 2024-09-13T06:43:55.627 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6090000000000003e-06 2024-09-13T06:43:55.627 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.627 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.627 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:55.627 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.526035+0000", 2024-09-13T06:43:55.627 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089042248000000004 2024-09-13T06:43:55.627 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.628 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.628 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:55.628 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.526111+0000", 2024-09-13T06:43:55.628 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5643999999999996e-05 2024-09-13T06:43:55.628 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.628 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.628 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:55.628 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.526348+0000", 2024-09-13T06:43:55.628 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00023705800000000001 2024-09-13T06:43:55.628 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:55.628 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:55.628 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:55.628 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.629 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.629 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25663 3.8 3:1180686c:::rbd_data.1121f2c5ee81.0000000000000009:13 [read 466944~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:43:55.629 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.436998+0000", 2024-09-13T06:43:55.629 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 239.17722272699999, 2024-09-13T06:43:55.629 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089730867000000006, 2024-09-13T06:43:55.629 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:55.629 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:55.629 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:55.629 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:55.629 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:55.629 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25663 2024-09-13T06:43:55.629 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.629 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:55.629 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.629 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:55.630 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436998+0000", 2024-09-13T06:43:55.630 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:55.630 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.630 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.630 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:55.630 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436998+0000", 2024-09-13T06:43:55.630 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:55.630 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.630 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.630 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:55.630 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436998+0000", 2024-09-13T06:43:55.630 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:55.630 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.630 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.630 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:55.631 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437000+0000", 2024-09-13T06:43:55.631 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0940000000000002e-06 2024-09-13T06:43:55.631 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.631 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.631 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:55.631 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437005+0000", 2024-09-13T06:43:55.631 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.604e-06 2024-09-13T06:43:55.631 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.631 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.631 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:55.631 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437032+0000", 2024-09-13T06:43:55.631 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6407e-05 2024-09-13T06:43:55.631 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.632 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.632 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:55.632 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.526363+0000", 2024-09-13T06:43:55.632 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089331456000000004 2024-09-13T06:43:55.632 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.632 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.632 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:55.632 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.526404+0000", 2024-09-13T06:43:55.632 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.0887999999999999e-05 2024-09-13T06:43:55.632 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.632 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.632 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:55.632 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.526729+0000", 2024-09-13T06:43:55.633 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00032486 2024-09-13T06:43:55.633 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:55.633 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:55.633 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:55.633 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.633 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.633 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25664 3.8 3:1180686c:::rbd_data.1121f2c5ee81.0000000000000009:13 [read 491520~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:43:55.633 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.437040+0000", 2024-09-13T06:43:55.633 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 239.17718081199999, 2024-09-13T06:43:55.633 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.090016650000000004, 2024-09-13T06:43:55.633 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:55.633 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:55.633 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:55.633 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:55.634 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:55.634 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25664 2024-09-13T06:43:55.634 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.634 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:55.634 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.634 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:55.634 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437040+0000", 2024-09-13T06:43:55.634 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:55.634 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.634 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.634 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:55.634 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437040+0000", 2024-09-13T06:43:55.634 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:55.634 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.634 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.635 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:55.635 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437039+0000", 2024-09-13T06:43:55.635 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:55.635 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.635 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.635 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:55.635 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437047+0000", 2024-09-13T06:43:55.635 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4839999999999998e-06 2024-09-13T06:43:55.635 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.635 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.635 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:55.635 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437054+0000", 2024-09-13T06:43:55.635 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.8299999999999998e-06 2024-09-13T06:43:55.635 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.636 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.636 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:55.636 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437060+0000", 2024-09-13T06:43:55.636 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.1510000000000001e-06 2024-09-13T06:43:55.636 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.636 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.636 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:55.636 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.526772+0000", 2024-09-13T06:43:55.636 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089711737999999999 2024-09-13T06:43:55.636 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.636 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.636 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:55.636 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.526848+0000", 2024-09-13T06:43:55.636 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5870000000000004e-05 2024-09-13T06:43:55.637 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.637 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.637 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:55.637 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.527057+0000", 2024-09-13T06:43:55.637 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000209106 2024-09-13T06:43:55.637 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:55.637 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:55.637 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:55.637 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.637 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.637 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25740 3.18 3:1c662b96:::rbd_data.1121f2c5ee81.0000000000000010:13 [read 200704~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:43:55.637 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443352+0000", 2024-09-13T06:43:55.637 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 239.17086913700001, 2024-09-13T06:43:55.637 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089068222000000002, 2024-09-13T06:43:55.638 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:55.638 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:55.638 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:55.638 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:55.638 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:55.638 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25740 2024-09-13T06:43:55.638 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.638 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:55.638 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.638 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:55.638 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443352+0000", 2024-09-13T06:43:55.638 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:55.639 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.639 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.639 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:55.639 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443352+0000", 2024-09-13T06:43:55.639 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:55.639 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.639 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.639 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:55.639 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443351+0000", 2024-09-13T06:43:55.639 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:55.639 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.639 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.639 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:55.639 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443354+0000", 2024-09-13T06:43:55.640 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.841e-06 2024-09-13T06:43:55.640 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.640 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.640 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:55.640 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443361+0000", 2024-09-13T06:43:55.640 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.0010000000000004e-06 2024-09-13T06:43:55.640 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.640 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.640 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:55.640 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443366+0000", 2024-09-13T06:43:55.640 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7119999999999999e-06 2024-09-13T06:43:55.640 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.640 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.640 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:55.641 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532117+0000", 2024-09-13T06:43:55.641 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.088751327000000005 2024-09-13T06:43:55.641 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.641 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.641 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:55.641 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532193+0000", 2024-09-13T06:43:55.641 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5839000000000004e-05 2024-09-13T06:43:55.641 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.641 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.641 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:55.641 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532420+0000", 2024-09-13T06:43:55.641 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00022691000000000001 2024-09-13T06:43:55.641 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:55.641 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:55.641 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:55.642 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.642 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.642 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25741 3.18 3:1c662b96:::rbd_data.1121f2c5ee81.0000000000000010:13 [read 225280~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:43:55.642 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443378+0000", 2024-09-13T06:43:55.642 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 239.17084237, 2024-09-13T06:43:55.642 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089324107, 2024-09-13T06:43:55.642 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:55.642 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:55.642 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:55.642 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:55.642 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:55.642 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25741 2024-09-13T06:43:55.642 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.643 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:55.643 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.643 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:55.643 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443378+0000", 2024-09-13T06:43:55.643 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:55.643 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.643 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.643 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:55.643 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443378+0000", 2024-09-13T06:43:55.643 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:55.643 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.643 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.643 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:55.643 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443378+0000", 2024-09-13T06:43:55.643 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:55.644 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.644 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.644 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:55.644 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443380+0000", 2024-09-13T06:43:55.644 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3549999999999999e-06 2024-09-13T06:43:55.644 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.644 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.644 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:55.644 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443388+0000", 2024-09-13T06:43:55.644 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.7449999999999995e-06 2024-09-13T06:43:55.644 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.644 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.644 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:55.644 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443393+0000", 2024-09-13T06:43:55.644 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.4e-06 2024-09-13T06:43:55.645 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.645 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.645 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:55.645 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532454+0000", 2024-09-13T06:43:55.645 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089060941000000005 2024-09-13T06:43:55.645 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.645 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.645 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:55.645 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532512+0000", 2024-09-13T06:43:55.645 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7763000000000002e-05 2024-09-13T06:43:55.645 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.645 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.645 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:55.645 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532703+0000", 2024-09-13T06:43:55.646 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000190328 2024-09-13T06:43:55.646 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:55.646 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:55.646 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:55.646 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.646 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.646 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25742 3.18 3:1c662b96:::rbd_data.1121f2c5ee81.0000000000000010:13 [read 270336~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:43:55.646 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443398+0000", 2024-09-13T06:43:55.646 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 239.17082265799999, 2024-09-13T06:43:55.646 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089621836999999996, 2024-09-13T06:43:55.646 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:55.646 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:55.646 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:55.646 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:55.646 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:55.646 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25742 2024-09-13T06:43:55.647 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.647 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:55.647 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.647 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:55.647 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443398+0000", 2024-09-13T06:43:55.647 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:55.647 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.647 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.647 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:55.647 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443398+0000", 2024-09-13T06:43:55.647 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:55.647 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.647 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.647 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:55.648 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443398+0000", 2024-09-13T06:43:55.648 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:55.648 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.648 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.648 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:55.648 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443400+0000", 2024-09-13T06:43:55.648 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1849999999999998e-06 2024-09-13T06:43:55.648 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.648 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.648 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:55.648 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443407+0000", 2024-09-13T06:43:55.648 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3669999999999999e-06 2024-09-13T06:43:55.648 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.648 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.649 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:55.649 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443420+0000", 2024-09-13T06:43:55.649 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2645e-05 2024-09-13T06:43:55.649 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.649 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.649 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:55.649 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532742+0000", 2024-09-13T06:43:55.649 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089322200000000004 2024-09-13T06:43:55.649 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.649 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.649 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:55.649 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532818+0000", 2024-09-13T06:43:55.649 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.6019000000000005e-05 2024-09-13T06:43:55.649 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.649 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.650 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:55.650 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533020+0000", 2024-09-13T06:43:55.650 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000201721 2024-09-13T06:43:55.650 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:55.650 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:55.650 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:55.650 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.650 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.650 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25743 3.18 3:1c662b96:::rbd_data.1121f2c5ee81.0000000000000010:13 [read 294912~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:43:55.650 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443425+0000", 2024-09-13T06:43:55.650 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 239.17079565, 2024-09-13T06:43:55.650 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089864075000000002, 2024-09-13T06:43:55.650 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:55.651 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:55.651 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:55.651 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:55.651 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:55.651 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25743 2024-09-13T06:43:55.651 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.651 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:55.651 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.651 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:55.651 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443425+0000", 2024-09-13T06:43:55.651 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:55.651 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.651 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.652 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:55.652 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443425+0000", 2024-09-13T06:43:55.652 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:55.652 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.652 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.652 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:55.652 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443425+0000", 2024-09-13T06:43:55.652 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:55.652 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.652 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.652 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:55.652 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443432+0000", 2024-09-13T06:43:55.652 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3420000000000002e-06 2024-09-13T06:43:55.653 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.653 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.653 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:55.653 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443440+0000", 2024-09-13T06:43:55.653 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5689999999999999e-06 2024-09-13T06:43:55.653 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.653 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.653 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:55.653 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443445+0000", 2024-09-13T06:43:55.653 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9590000000000003e-06 2024-09-13T06:43:55.653 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.653 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.654 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:55.654 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533063+0000", 2024-09-13T06:43:55.654 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089617988999999995 2024-09-13T06:43:55.654 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.654 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.654 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:55.654 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533122+0000", 2024-09-13T06:43:55.654 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9052999999999999e-05 2024-09-13T06:43:55.654 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.654 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.654 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:55.654 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533289+0000", 2024-09-13T06:43:55.654 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00016752800000000001 2024-09-13T06:43:55.654 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:55.655 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:55.655 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:55.655 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.655 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.655 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25744 3.18 3.69d46638 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:43:55.655 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443449+0000", 2024-09-13T06:43:55.655 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 239.170771503, 2024-09-13T06:43:55.655 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089869148999999995, 2024-09-13T06:43:55.655 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:55.655 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:43:55.655 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:55.655 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:55.655 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:55.655 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25744 2024-09-13T06:43:55.656 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.656 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:55.656 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.656 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:55.656 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443449+0000", 2024-09-13T06:43:55.656 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:55.656 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.656 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.656 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:55.656 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443449+0000", 2024-09-13T06:43:55.656 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:55.656 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.657 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.657 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:55.657 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443449+0000", 2024-09-13T06:43:55.657 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:55.657 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.657 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.657 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:55.657 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443451+0000", 2024-09-13T06:43:55.657 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.244e-06 2024-09-13T06:43:55.657 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.657 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.657 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:55.657 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443457+0000", 2024-09-13T06:43:55.658 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.66e-06 2024-09-13T06:43:55.658 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.658 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.658 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:55.658 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443461+0000", 2024-09-13T06:43:55.658 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5449999999999997e-06 2024-09-13T06:43:55.658 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.658 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.658 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:55.658 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533311+0000", 2024-09-13T06:43:55.658 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089849729000000003 2024-09-13T06:43:55.658 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.658 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.658 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:55.659 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533318+0000", 2024-09-13T06:43:55.659 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.328e-06 2024-09-13T06:43:55.659 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:55.659 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:55.659 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:55.659 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.659 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.659 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25745 3.18 3.69d46638 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:43:55.659 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443466+0000", 2024-09-13T06:43:55.659 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 239.170754445, 2024-09-13T06:43:55.659 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089886743000000005, 2024-09-13T06:43:55.659 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:55.659 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:43:55.660 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:55.660 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:55.660 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:55.660 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25745 2024-09-13T06:43:55.660 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.660 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:55.660 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.660 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:55.660 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443466+0000", 2024-09-13T06:43:55.660 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:55.660 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.660 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.660 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:55.661 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443466+0000", 2024-09-13T06:43:55.661 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:55.661 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.661 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.661 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:55.661 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443466+0000", 2024-09-13T06:43:55.661 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:55.661 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.661 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.661 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:55.661 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443474+0000", 2024-09-13T06:43:55.661 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.1289999999999996e-06 2024-09-13T06:43:55.661 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.661 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.662 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:55.662 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443484+0000", 2024-09-13T06:43:55.662 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0654e-05 2024-09-13T06:43:55.662 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.662 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.662 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:55.662 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443490+0000", 2024-09-13T06:43:55.662 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8030000000000002e-06 2024-09-13T06:43:55.662 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.662 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.662 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:55.662 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533348+0000", 2024-09-13T06:43:55.662 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089857267000000005 2024-09-13T06:43:55.663 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.663 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.663 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:55.663 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533353+0000", 2024-09-13T06:43:55.663 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.5520000000000004e-06 2024-09-13T06:43:55.663 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:55.663 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:55.663 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:55.663 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.663 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.663 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25746 3.18 3.69d46638 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:43:55.663 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443495+0000", 2024-09-13T06:43:55.663 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 239.17072533199999, 2024-09-13T06:43:55.663 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089903725000000004, 2024-09-13T06:43:55.664 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:55.664 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:43:55.664 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:55.664 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:55.664 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:55.664 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25746 2024-09-13T06:43:55.664 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.664 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:55.664 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.664 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:55.664 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443495+0000", 2024-09-13T06:43:55.664 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:55.664 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.665 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.665 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:55.665 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443495+0000", 2024-09-13T06:43:55.665 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:55.665 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.665 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.665 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:55.665 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443495+0000", 2024-09-13T06:43:55.665 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:55.665 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.665 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.665 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:55.665 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443498+0000", 2024-09-13T06:43:55.665 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.7690000000000001e-06 2024-09-13T06:43:55.665 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.666 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.666 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:55.666 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443504+0000", 2024-09-13T06:43:55.666 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9710000000000001e-06 2024-09-13T06:43:55.666 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.666 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.666 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:55.666 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443508+0000", 2024-09-13T06:43:55.666 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4159999999999997e-06 2024-09-13T06:43:55.666 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.666 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.666 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:55.666 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533391+0000", 2024-09-13T06:43:55.667 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089882607000000003 2024-09-13T06:43:55.667 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.667 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.667 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:55.667 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533399+0000", 2024-09-13T06:43:55.667 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.4349999999999997e-06 2024-09-13T06:43:55.667 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:55.667 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:55.667 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:55.667 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.667 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.667 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25747 3.8 3.63996268 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:43:55.667 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443512+0000", 2024-09-13T06:43:55.667 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 239.170708601, 2024-09-13T06:43:55.668 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089880075000000004, 2024-09-13T06:43:55.668 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:55.668 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:43:55.668 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:55.668 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:55.668 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:55.668 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25747 2024-09-13T06:43:55.668 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.668 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:55.668 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.668 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:55.668 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443512+0000", 2024-09-13T06:43:55.668 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:55.668 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.669 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.669 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:55.669 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443512+0000", 2024-09-13T06:43:55.669 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:55.669 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.669 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.669 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:55.669 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443512+0000", 2024-09-13T06:43:55.669 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:55.669 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.669 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.669 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:55.669 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443514+0000", 2024-09-13T06:43:55.669 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0980000000000001e-06 2024-09-13T06:43:55.670 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.670 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.670 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:55.670 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443520+0000", 2024-09-13T06:43:55.670 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7069999999999997e-06 2024-09-13T06:43:55.670 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.670 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.670 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:55.670 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443524+0000", 2024-09-13T06:43:55.670 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5390000000000001e-06 2024-09-13T06:43:55.670 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.670 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.670 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:55.671 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533384+0000", 2024-09-13T06:43:55.671 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089859684999999995 2024-09-13T06:43:55.671 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.671 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.671 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:55.671 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533392+0000", 2024-09-13T06:43:55.671 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.3440000000000001e-06 2024-09-13T06:43:55.671 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:55.671 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:55.671 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:55.671 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.671 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.671 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25748 3.8 3.63996268 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:43:55.671 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443528+0000", 2024-09-13T06:43:55.671 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 239.17069247399999, 2024-09-13T06:43:55.672 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089890715999999996, 2024-09-13T06:43:55.672 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:55.672 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:43:55.672 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:55.672 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:55.672 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:55.672 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25748 2024-09-13T06:43:55.672 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.672 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:55.672 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.672 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:55.672 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443528+0000", 2024-09-13T06:43:55.672 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:55.672 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.672 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.673 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:55.673 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443528+0000", 2024-09-13T06:43:55.673 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:55.673 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.673 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.673 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:55.673 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443528+0000", 2024-09-13T06:43:55.673 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:55.673 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.673 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.673 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:55.673 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443530+0000", 2024-09-13T06:43:55.673 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0650000000000001e-06 2024-09-13T06:43:55.673 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.674 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.674 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:55.674 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443536+0000", 2024-09-13T06:43:55.674 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7259999999999999e-06 2024-09-13T06:43:55.674 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.674 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.674 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:55.674 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443540+0000", 2024-09-13T06:43:55.674 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5009999999999998e-06 2024-09-13T06:43:55.674 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.674 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.674 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:55.674 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533412+0000", 2024-09-13T06:43:55.674 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089871873000000005 2024-09-13T06:43:55.675 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.675 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.675 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:55.675 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533419+0000", 2024-09-13T06:43:55.675 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.883e-06 2024-09-13T06:43:55.675 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:55.675 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:55.675 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:55.675 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.675 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.675 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25749 3.8 3.63996268 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:43:55.675 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443545+0000", 2024-09-13T06:43:55.675 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 239.170676278, 2024-09-13T06:43:55.675 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089897988999999998, 2024-09-13T06:43:55.676 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:55.676 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:43:55.676 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:55.676 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:55.676 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:55.676 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25749 2024-09-13T06:43:55.676 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.676 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:55.676 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.676 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:55.676 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443545+0000", 2024-09-13T06:43:55.676 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:55.676 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.677 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.677 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:55.677 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443545+0000", 2024-09-13T06:43:55.677 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:55.677 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.677 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.677 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:55.677 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443544+0000", 2024-09-13T06:43:55.677 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:55.677 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.677 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.677 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:55.678 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443553+0000", 2024-09-13T06:43:55.678 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.4770000000000003e-06 2024-09-13T06:43:55.678 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.678 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.678 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:55.678 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443564+0000", 2024-09-13T06:43:55.678 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0986e-05 2024-09-13T06:43:55.678 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.678 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.678 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:55.678 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443569+0000", 2024-09-13T06:43:55.678 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2530000000000004e-06 2024-09-13T06:43:55.678 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.678 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.679 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:55.679 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533438+0000", 2024-09-13T06:43:55.679 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089868641999999999 2024-09-13T06:43:55.679 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.679 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.679 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:55.679 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533442+0000", 2024-09-13T06:43:55.679 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.989e-06 2024-09-13T06:43:55.679 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:55.679 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:55.679 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:55.679 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.679 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.679 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25750 3.8 3.63996268 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:43:55.680 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443574+0000", 2024-09-13T06:43:55.680 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 239.17064679200001, 2024-09-13T06:43:55.680 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089895143999999996, 2024-09-13T06:43:55.680 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:55.680 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:43:55.680 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:55.680 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:55.680 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:55.680 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25750 2024-09-13T06:43:55.680 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.680 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:55.680 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.680 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:55.681 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443574+0000", 2024-09-13T06:43:55.681 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:55.681 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.681 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.681 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:55.681 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443574+0000", 2024-09-13T06:43:55.681 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:55.681 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.681 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.681 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:55.681 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443574+0000", 2024-09-13T06:43:55.681 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:55.681 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.681 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.681 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:55.682 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443576+0000", 2024-09-13T06:43:55.682 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6910000000000002e-06 2024-09-13T06:43:55.682 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.682 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.682 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:55.682 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443583+0000", 2024-09-13T06:43:55.682 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.331e-06 2024-09-13T06:43:55.682 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.682 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.682 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:55.682 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443587+0000", 2024-09-13T06:43:55.682 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6129999999999997e-06 2024-09-13T06:43:55.682 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.682 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.683 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:55.683 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533464+0000", 2024-09-13T06:43:55.683 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089876605999999998 2024-09-13T06:43:55.683 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.683 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.683 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:55.683 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533469+0000", 2024-09-13T06:43:55.683 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3909999999999997e-06 2024-09-13T06:43:55.683 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:55.683 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:55.683 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:55.683 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.683 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.683 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25751 3.8 3.63996268 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:43:55.684 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443592+0000", 2024-09-13T06:43:55.684 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 239.17062909500001, 2024-09-13T06:43:55.684 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089913650999999997, 2024-09-13T06:43:55.684 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:55.684 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:43:55.684 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:55.684 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:55.684 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:55.684 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25751 2024-09-13T06:43:55.684 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.684 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:55.684 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.684 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:55.684 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443592+0000", 2024-09-13T06:43:55.685 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:55.685 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.685 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.685 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:55.685 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443592+0000", 2024-09-13T06:43:55.685 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:55.685 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.685 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.685 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:55.685 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443591+0000", 2024-09-13T06:43:55.685 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:55.685 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.685 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.686 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:55.686 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443594+0000", 2024-09-13T06:43:55.686 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3649999999999998e-06 2024-09-13T06:43:55.686 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.686 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.686 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:55.686 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443599+0000", 2024-09-13T06:43:55.686 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.699e-06 2024-09-13T06:43:55.686 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.686 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.686 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:55.686 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443611+0000", 2024-09-13T06:43:55.686 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1503e-05 2024-09-13T06:43:55.687 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.687 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.687 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:55.687 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533497+0000", 2024-09-13T06:43:55.687 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089886453000000005 2024-09-13T06:43:55.687 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.687 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.687 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:55.687 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533505+0000", 2024-09-13T06:43:55.687 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.9910000000000002e-06 2024-09-13T06:43:55.687 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:55.687 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:55.687 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:55.687 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.688 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.688 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25752 3.8 3.63996268 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:43:55.688 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443615+0000", 2024-09-13T06:43:55.688 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 239.170605314, 2024-09-13T06:43:55.688 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089905868999999999, 2024-09-13T06:43:55.688 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:55.688 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:43:55.688 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:55.688 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:55.688 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:55.688 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25752 2024-09-13T06:43:55.688 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.689 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:55.689 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.689 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:55.689 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443615+0000", 2024-09-13T06:43:55.689 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:55.689 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.689 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.689 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:55.689 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443615+0000", 2024-09-13T06:43:55.689 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:55.689 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.689 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.689 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:55.689 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443615+0000", 2024-09-13T06:43:55.690 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:55.690 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.690 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.690 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:55.690 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443617+0000", 2024-09-13T06:43:55.690 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3539999999999998e-06 2024-09-13T06:43:55.690 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.690 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.690 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:55.690 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443624+0000", 2024-09-13T06:43:55.690 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3600000000000001e-06 2024-09-13T06:43:55.690 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.690 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.691 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:55.691 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443628+0000", 2024-09-13T06:43:55.691 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.2350000000000001e-06 2024-09-13T06:43:55.691 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.691 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.691 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:55.691 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533517+0000", 2024-09-13T06:43:55.691 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089889029999999995 2024-09-13T06:43:55.691 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.691 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.691 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:55.691 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533521+0000", 2024-09-13T06:43:55.691 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.2529999999999998e-06 2024-09-13T06:43:55.691 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:55.692 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:55.692 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:55.692 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.692 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.692 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:64356 3.c 3:32785be9:::rbd_header.11218ba71f0d:head [watch reconnect cookie 140361410387072 gen 2] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e95)", 2024-09-13T06:43:55.692 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:48.473318+0000", 2024-09-13T06:43:55.692 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 187.14090292099999, 2024-09-13T06:43:55.692 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1458904379999999, 2024-09-13T06:43:55.692 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:55.692 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:55.692 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:55.692 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:55.692 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:55.693 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 64356 2024-09-13T06:43:55.693 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.693 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:55.693 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.693 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:55.693 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:48.473318+0000", 2024-09-13T06:43:55.693 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:55.693 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.693 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.693 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:55.693 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:48.473318+0000", 2024-09-13T06:43:55.693 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:55.693 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.694 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.694 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:55.694 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:48.473315+0000", 2024-09-13T06:43:55.694 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999971 2024-09-13T06:43:55.694 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.694 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.694 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:55.694 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:48.473329+0000", 2024-09-13T06:43:55.694 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.433e-05 2024-09-13T06:43:55.694 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.694 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.694 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:55.694 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:48.473363+0000", 2024-09-13T06:43:55.694 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.3592e-05 2024-09-13T06:43:55.695 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.695 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.695 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:55.695 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:48.473386+0000", 2024-09-13T06:43:55.695 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2708999999999999e-05 2024-09-13T06:43:55.695 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.695 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.695 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:55.695 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:48.473804+0000", 2024-09-13T06:43:55.695 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00041789399999999998 2024-09-13T06:43:55.695 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.695 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.695 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:43:55.696 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:48.473830+0000", 2024-09-13T06:43:55.696 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6869e-05 2024-09-13T06:43:55.696 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.696 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.696 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:55.696 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:49.614332+0000", 2024-09-13T06:43:55.696 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.140501107 2024-09-13T06:43:55.696 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.696 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.696 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for rw locks", 2024-09-13T06:43:55.696 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:49.614496+0000", 2024-09-13T06:43:55.696 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00016451200000000001 2024-09-13T06:43:55.696 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.696 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.697 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:55.697 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:49.617131+0000", 2024-09-13T06:43:55.697 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.002634843 2024-09-13T06:43:55.697 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.697 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.697 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:55.697 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:49.617204+0000", 2024-09-13T06:43:55.697 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.2991000000000006e-05 2024-09-13T06:43:55.697 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.697 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.697 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:55.697 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:49.619208+0000", 2024-09-13T06:43:55.697 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.002004381 2024-09-13T06:43:55.697 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:55.698 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:55.698 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:55.698 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.698 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.698 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:170155 3.7 3:e17728eb:::image_client.0-clone36.rbd:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e191)", 2024-09-13T06:43:55.698 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:42:31.436412+0000", 2024-09-13T06:43:55.698 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 84.177809097999997, 2024-09-13T06:43:55.698 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.97843703800000004, 2024-09-13T06:43:55.698 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:55.698 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:43:55.698 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:55.698 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:55.698 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:55.698 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 170155 2024-09-13T06:43:55.699 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.699 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:55.699 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.699 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:55.699 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:31.436412+0000", 2024-09-13T06:43:55.699 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:55.699 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.699 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.699 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:55.699 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:31.436412+0000", 2024-09-13T06:43:55.699 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:55.700 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.700 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.700 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:55.700 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:31.436410+0000", 2024-09-13T06:43:55.700 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999986 2024-09-13T06:43:55.700 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.700 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.700 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:55.700 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:31.436417+0000", 2024-09-13T06:43:55.700 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.6939999999999998e-06 2024-09-13T06:43:55.700 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.700 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.701 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:55.701 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:31.436430+0000", 2024-09-13T06:43:55.701 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3016999999999999e-05 2024-09-13T06:43:55.701 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.701 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.701 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:55.701 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:31.436437+0000", 2024-09-13T06:43:55.701 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.1069999999999999e-06 2024-09-13T06:43:55.701 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.701 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.701 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:55.701 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:31.436515+0000", 2024-09-13T06:43:55.701 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.7756000000000006e-05 2024-09-13T06:43:55.701 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.702 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.702 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:43:55.702 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:31.436523+0000", 2024-09-13T06:43:55.702 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.4970000000000001e-06 2024-09-13T06:43:55.702 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.702 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.702 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:55.702 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:32.414565+0000", 2024-09-13T06:43:55.702 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.97804144199999998 2024-09-13T06:43:55.702 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:55.702 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:55.702 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:55.702 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:32.414849+0000", 2024-09-13T06:43:55.702 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00028388600000000001 2024-09-13T06:43:55.702 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:55.703 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:55.703 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:55.703 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:55.703 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:55.703 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:43:55.704 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-13T06:43:55.705 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:43:55.704+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:43:55.805 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-13T06:43:55.804+0000 7fa8bb18e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 36790) UID: 0 2024-09-13T06:43:55.836 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:43:55.836 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [], 2024-09-13T06:43:55.836 INFO:teuthology.orchestra.run.smithi139.stdout: "num_ops": 0 2024-09-13T06:43:55.837 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:43:55.850 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-13T06:43:55.906 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:43:55.907+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:43:55.953 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-13T06:43:56.007 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:43:56.008+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:43:56.013 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:43:56.014 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [], 2024-09-13T06:43:56.014 INFO:teuthology.orchestra.run.smithi139.stdout: "complaint_time": 30, 2024-09-13T06:43:56.014 INFO:teuthology.orchestra.run.smithi139.stdout: "num_blocked_ops": 0 2024-09-13T06:43:56.014 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:43:56.028 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-13T06:43:56.103 INFO:teuthology.orchestra.run.smithi081.stdout:osd.0: {} 2024-09-13T06:43:56.103 INFO:teuthology.orchestra.run.smithi081.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-13T06:43:56.119 INFO:teuthology.orchestra.run.smithi081.stdout:osd.1: {} 2024-09-13T06:43:56.119 INFO:teuthology.orchestra.run.smithi081.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-13T06:43:56.119 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:43:56.120+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:43:56.136 INFO:teuthology.orchestra.run.smithi081.stdout:osd.2: {} 2024-09-13T06:43:56.136 INFO:teuthology.orchestra.run.smithi081.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-13T06:43:56.153 INFO:teuthology.orchestra.run.smithi081.stdout:osd.3: {} 2024-09-13T06:43:56.153 INFO:teuthology.orchestra.run.smithi081.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-13T06:43:56.173 INFO:teuthology.orchestra.run.smithi081.stdout:osd.4: {} 2024-09-13T06:43:56.173 INFO:teuthology.orchestra.run.smithi081.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-13T06:43:56.193 INFO:teuthology.orchestra.run.smithi081.stdout:osd.5: {} 2024-09-13T06:43:56.193 INFO:teuthology.orchestra.run.smithi081.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-13T06:43:56.193 INFO:teuthology.orchestra.run.smithi081.stderr:Error ENXIO: problem getting command descriptions from osd.6 2024-09-13T06:43:56.202 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:43:56.202 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:43:56.209 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:43:56.208+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:43:56.213 INFO:teuthology.orchestra.run.smithi081.stdout:osd.7: {} 2024-09-13T06:43:56.213 INFO:teuthology.orchestra.run.smithi081.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-13T06:43:56.216 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-13T06:43:56.217 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-13T06:43:56.217 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-13T06:43:56.310 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:43:56.308+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:43:56.383 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:43:56.383 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:43:56.397 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-13T06:43:56.412 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:43:56.411+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:43:56.425 INFO:teuthology.orchestra.run.smithi081.stderr:noscrub is unset 2024-09-13T06:43:56.513 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:43:56.511+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:43:56.578 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:43:56.578 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:43:56.595 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-13T06:43:56.614 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:43:56.615+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:43:56.715 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:43:56.715+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:43:56.716 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:43:56.716 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:43:56.731 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-13T06:43:56.816 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-13T06:43:56.816+0000 7fa8bb18e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 36790) UID: 0 2024-09-13T06:43:56.851 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:43:56.851 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:43:56.865 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-13T06:43:56.916 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:43:56.915+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:43:57.017 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-13T06:43:57.016+0000 7fa8bb18e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 36790) UID: 0 2024-09-13T06:43:57.024 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:43:57.024 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:43:57.038 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-13T06:43:57.123 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:43:57.124+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:43:57.201 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:43:57.201 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:43:57.215 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-13T06:43:57.259 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:43:57.260+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:43:57.320 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:43:57.319+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:43:57.347 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:43:57.347 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:43:57.361 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-13T06:43:57.450 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:43:57.451+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:43:57.522 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-13T06:43:57.520+0000 7fa8bb18e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 36790) UID: 0 2024-09-13T06:43:57.525 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:43:57.525 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:43:57.539 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-13T06:43:57.582 INFO:tasks.thrashosds.thrasher:in_osds: [0, 2, 7, 5, 3, 4] out_osds: [6, 1] dead_osds: [6] live_osds: [0, 1, 2, 3, 4, 5, 7] 2024-09-13T06:43:57.582 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-13T06:43:57.582 INFO:tasks.thrashosds.thrasher:Removing osd 2, in_osds are: [0, 2, 7, 5, 3, 4] 2024-09-13T06:43:57.582 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd out 2 2024-09-13T06:43:57.623 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:43:57.620+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:43:57.716 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:43:57.716 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:43:57.723 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-13T06:43:57.724+0000 7fa8bb18e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 36790) UID: 0 2024-09-13T06:43:57.734 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-13T06:43:57.824 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:43:57.824+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:43:57.851 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:43:57.852 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:43:57.865 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-13T06:43:57.899 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-13T06:43:57.899+0000 7fcdeb9fe640 -1 mon.a@0(leader).osd e272 definitely_dead 0 2024-09-13T06:43:57.925 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:43:57.923+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:43:57.984 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:43:57.984 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:43:57.998 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-13T06:43:58.025 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:43:58.024+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:43:58.126 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:43:58.127+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:43:58.161 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:43:58.161 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:43:58.174 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-13T06:43:58.218 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-13T06:43:58.227 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:43:58.228+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:43:58.328 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:43:58.327+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:43:58.338 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:43:58.338 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:43:58.353 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-13T06:43:58.366 INFO:teuthology.orchestra.run.smithi081.stdout:osd.0: {} 2024-09-13T06:43:58.367 INFO:teuthology.orchestra.run.smithi081.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-13T06:43:58.384 INFO:teuthology.orchestra.run.smithi081.stdout:osd.1: {} 2024-09-13T06:43:58.384 INFO:teuthology.orchestra.run.smithi081.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-13T06:43:58.399 INFO:teuthology.orchestra.run.smithi081.stdout:osd.2: {} 2024-09-13T06:43:58.399 INFO:teuthology.orchestra.run.smithi081.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-13T06:43:58.414 INFO:teuthology.orchestra.run.smithi081.stdout:osd.3: {} 2024-09-13T06:43:58.415 INFO:teuthology.orchestra.run.smithi081.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-13T06:43:58.429 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:43:58.427+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:43:58.435 INFO:teuthology.orchestra.run.smithi081.stdout:osd.4: {} 2024-09-13T06:43:58.435 INFO:teuthology.orchestra.run.smithi081.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-13T06:43:58.453 INFO:teuthology.orchestra.run.smithi081.stdout:osd.5: {} 2024-09-13T06:43:58.454 INFO:teuthology.orchestra.run.smithi081.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-13T06:43:58.454 INFO:teuthology.orchestra.run.smithi081.stderr:Error ENXIO: problem getting command descriptions from osd.6 2024-09-13T06:43:58.454 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-13T06:43:58.474 INFO:teuthology.orchestra.run.smithi081.stdout:osd.7: {} 2024-09-13T06:43:58.474 INFO:teuthology.orchestra.run.smithi081.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-13T06:43:58.477 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-13T06:43:58.478 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-13T06:43:58.478 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:43:58.478 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-13T06:43:58.478 INFO:teuthology.orchestra.run.smithi081.stdout: "complaint_time": 30, 2024-09-13T06:43:58.478 INFO:teuthology.orchestra.run.smithi081.stdout: "num_blocked_ops": 0 2024-09-13T06:43:58.478 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:43:58.492 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-13T06:43:58.538 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:43:58.539+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:43:58.603 INFO:teuthology.orchestra.run.smithi081.stderr:marked out osd.2. 2024-09-13T06:43:58.631 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:43:58.632+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:43:58.678 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:43:58.678 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 20, 2024-09-13T06:43:58.678 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 600, 2024-09-13T06:43:58.678 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [ 2024-09-13T06:43:58.678 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:58.678 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:36160 3.f 3:f62782c2:::rbd_object_map.11219660270d.0000000000000016:head [call] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-13T06:43:58.679 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:01.607291+0000", 2024-09-13T06:43:58.679 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 237.070074221, 2024-09-13T06:43:58.679 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.99619456699999998, 2024-09-13T06:43:58.679 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:58.679 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:58.679 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:58.679 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:58.679 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:58.679 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 36160 2024-09-13T06:43:58.679 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:58.679 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:58.679 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:58.679 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:58.680 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:01.607291+0000", 2024-09-13T06:43:58.680 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:58.680 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:58.680 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:58.680 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:58.680 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:01.607291+0000", 2024-09-13T06:43:58.680 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:58.680 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:58.680 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:58.680 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:58.680 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:01.607289+0000", 2024-09-13T06:43:58.680 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999976 2024-09-13T06:43:58.680 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:58.681 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:58.681 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:58.681 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:01.607302+0000", 2024-09-13T06:43:58.681 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3018e-05 2024-09-13T06:43:58.681 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:58.681 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:58.681 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:58.681 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:01.607323+0000", 2024-09-13T06:43:58.681 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1030999999999999e-05 2024-09-13T06:43:58.681 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:58.681 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:58.682 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:58.682 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:01.607342+0000", 2024-09-13T06:43:58.682 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8961e-05 2024-09-13T06:43:58.682 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:58.682 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:58.682 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:58.682 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:01.607425+0000", 2024-09-13T06:43:58.682 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.3171999999999996e-05 2024-09-13T06:43:58.682 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:58.682 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:58.682 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:43:58.682 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:01.607441+0000", 2024-09-13T06:43:58.682 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5996999999999999e-05 2024-09-13T06:43:58.683 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:58.683 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:58.683 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:58.683 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:02.596186+0000", 2024-09-13T06:43:58.683 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.98874432000000001 2024-09-13T06:43:58.683 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:58.683 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:58.683 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for missing object", 2024-09-13T06:43:58.683 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:02.596618+0000", 2024-09-13T06:43:58.683 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000432032 2024-09-13T06:43:58.683 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:58.683 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:58.683 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:58.683 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:02.600845+0000", 2024-09-13T06:43:58.683 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0042277410000000001 2024-09-13T06:43:58.684 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:58.684 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:58.684 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:58.684 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:02.601003+0000", 2024-09-13T06:43:58.684 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00015731999999999999 2024-09-13T06:43:58.684 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:58.684 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:58.684 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:58.684 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:02.603486+0000", 2024-09-13T06:43:58.684 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0024832510000000001 2024-09-13T06:43:58.684 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:58.684 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:58.685 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:58.685 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:58.685 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:58.685 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:37806 3.9 3:951cb95b:::rbd_data.1121d8143c6e.0000000000000002:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e56)", 2024-09-13T06:43:58.685 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:06.373482+0000", 2024-09-13T06:43:58.685 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 232.30388318499999, 2024-09-13T06:43:58.685 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.002476213, 2024-09-13T06:43:58.685 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:58.685 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:58.685 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:58.685 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:58.685 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:58.685 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 37806 2024-09-13T06:43:58.686 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:58.686 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:58.686 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:58.686 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:58.686 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.373482+0000", 2024-09-13T06:43:58.686 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:58.686 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:58.686 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:58.686 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:58.686 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.373482+0000", 2024-09-13T06:43:58.686 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:58.686 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:58.686 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:58.686 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:58.687 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.373479+0000", 2024-09-13T06:43:58.687 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999962 2024-09-13T06:43:58.687 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:58.687 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:58.687 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:58.687 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.373495+0000", 2024-09-13T06:43:58.687 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6640999999999999e-05 2024-09-13T06:43:58.687 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:58.687 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:58.687 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:58.687 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.373542+0000", 2024-09-13T06:43:58.687 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6229000000000001e-05 2024-09-13T06:43:58.687 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:58.687 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:58.688 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:58.688 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.373564+0000", 2024-09-13T06:43:58.688 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2684000000000002e-05 2024-09-13T06:43:58.688 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:58.688 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:58.688 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:58.688 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374268+0000", 2024-09-13T06:43:58.688 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00070363700000000001 2024-09-13T06:43:58.688 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:58.688 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:58.688 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:43:58.688 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374305+0000", 2024-09-13T06:43:58.688 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.6936e-05 2024-09-13T06:43:58.688 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:58.689 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:58.689 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:58.689 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.375175+0000", 2024-09-13T06:43:58.689 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.000870454 2024-09-13T06:43:58.689 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:58.689 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:58.689 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:58.689 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.375678+0000", 2024-09-13T06:43:58.689 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00050292499999999999 2024-09-13T06:43:58.689 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:58.689 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:58.689 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:58.689 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.375959+0000", 2024-09-13T06:43:58.690 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00028050599999999997 2024-09-13T06:43:58.690 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:58.690 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:58.690 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:58.690 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:58.690 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:58.690 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:37821 3.9 3:951cb95b:::rbd_data.1121d8143c6e.0000000000000002:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e56)", 2024-09-13T06:43:58.690 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:06.374454+0000", 2024-09-13T06:43:58.690 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 232.30291206800001, 2024-09-13T06:43:58.690 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.002545072, 2024-09-13T06:43:58.690 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:58.690 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:58.690 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:58.691 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:58.691 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:58.691 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 37821 2024-09-13T06:43:58.691 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:58.691 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:58.691 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:58.691 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:58.691 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374454+0000", 2024-09-13T06:43:58.691 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:58.691 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:58.691 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:58.691 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:58.691 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374454+0000", 2024-09-13T06:43:58.691 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:58.691 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:58.692 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:58.692 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:58.692 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374452+0000", 2024-09-13T06:43:58.692 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999981 2024-09-13T06:43:58.692 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:58.692 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:58.692 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:58.692 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374463+0000", 2024-09-13T06:43:58.692 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0756e-05 2024-09-13T06:43:58.692 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:58.692 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:58.692 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:58.692 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374487+0000", 2024-09-13T06:43:58.693 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4887000000000001e-05 2024-09-13T06:43:58.693 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:58.693 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:58.693 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:58.693 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374504+0000", 2024-09-13T06:43:58.693 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.6852000000000001e-05 2024-09-13T06:43:58.693 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:58.693 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:58.693 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:58.693 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374829+0000", 2024-09-13T06:43:58.693 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000324684 2024-09-13T06:43:58.693 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:58.693 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:58.693 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:43:58.694 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374880+0000", 2024-09-13T06:43:58.694 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.1378000000000002e-05 2024-09-13T06:43:58.694 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:58.694 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:58.694 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:58.694 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.376423+0000", 2024-09-13T06:43:58.694 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.001542734 2024-09-13T06:43:58.694 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:58.694 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:58.694 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:58.694 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.376607+0000", 2024-09-13T06:43:58.694 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000183656 2024-09-13T06:43:58.694 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:58.695 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:58.695 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:58.695 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.376999+0000", 2024-09-13T06:43:58.695 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00039191200000000001 2024-09-13T06:43:58.695 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:58.695 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:58.695 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:58.695 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:58.695 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:58.695 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:37836 3.9 3:951cb95b:::rbd_data.1121d8143c6e.0000000000000002:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e56)", 2024-09-13T06:43:58.695 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:06.374929+0000", 2024-09-13T06:43:58.695 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 232.30243641600001, 2024-09-13T06:43:58.695 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.002778825, 2024-09-13T06:43:58.695 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:58.695 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:58.696 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:58.696 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:58.696 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:58.696 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 37836 2024-09-13T06:43:58.696 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:58.696 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:58.696 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:58.696 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:58.696 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374929+0000", 2024-09-13T06:43:58.696 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:58.696 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:58.696 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:58.697 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:58.697 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374929+0000", 2024-09-13T06:43:58.697 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:58.697 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:58.697 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:58.697 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:58.697 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374927+0000", 2024-09-13T06:43:58.697 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999981 2024-09-13T06:43:58.697 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:58.697 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:58.697 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:58.697 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374939+0000", 2024-09-13T06:43:58.698 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1846e-05 2024-09-13T06:43:58.698 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:58.698 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:58.698 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:58.698 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374962+0000", 2024-09-13T06:43:58.698 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3054e-05 2024-09-13T06:43:58.698 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:58.698 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:58.698 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:58.698 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.374978+0000", 2024-09-13T06:43:58.698 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.5899000000000001e-05 2024-09-13T06:43:58.698 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:58.699 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:58.699 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:58.699 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.375106+0000", 2024-09-13T06:43:58.699 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00012789 2024-09-13T06:43:58.699 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:58.699 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:58.699 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:43:58.699 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.375134+0000", 2024-09-13T06:43:58.699 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.8254000000000001e-05 2024-09-13T06:43:58.699 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:58.699 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:58.699 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:58.699 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.377082+0000", 2024-09-13T06:43:58.699 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0019471520000001 2024-09-13T06:43:58.700 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:58.700 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:58.700 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:58.700 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.377330+0000", 2024-09-13T06:43:58.700 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00024834199999999997 2024-09-13T06:43:58.700 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:58.700 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:58.700 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:58.700 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.377708+0000", 2024-09-13T06:43:58.700 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00037817100000000001 2024-09-13T06:43:58.700 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:58.700 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:58.701 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:58.701 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:58.701 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:58.701 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:37851 3.9 3:951cb95b:::rbd_data.1121d8143c6e.0000000000000002:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e56)", 2024-09-13T06:43:58.701 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:06.382636+0000", 2024-09-13T06:43:58.701 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 232.294729531, 2024-09-13T06:43:58.701 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.99582539400000003, 2024-09-13T06:43:58.701 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:58.701 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:58.701 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:58.701 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:58.701 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:58.701 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 37851 2024-09-13T06:43:58.702 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:58.702 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:58.702 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:58.702 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:58.702 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.382636+0000", 2024-09-13T06:43:58.702 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:58.702 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:58.702 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:58.702 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:58.702 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.382636+0000", 2024-09-13T06:43:58.702 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:58.702 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:58.702 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:58.703 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:58.703 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.382633+0000", 2024-09-13T06:43:58.703 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999971 2024-09-13T06:43:58.703 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:58.703 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:58.703 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:58.703 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.382652+0000", 2024-09-13T06:43:58.703 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8834999999999998e-05 2024-09-13T06:43:58.703 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:58.703 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:58.703 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:58.703 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.382695+0000", 2024-09-13T06:43:58.703 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.3136000000000002e-05 2024-09-13T06:43:58.704 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:58.704 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:58.704 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:58.704 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.382716+0000", 2024-09-13T06:43:58.704 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1421e-05 2024-09-13T06:43:58.704 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:58.704 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:58.704 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:58.704 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.382860+0000", 2024-09-13T06:43:58.704 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00014389200000000001 2024-09-13T06:43:58.704 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:58.704 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:58.704 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:43:58.705 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.382890+0000", 2024-09-13T06:43:58.705 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9827000000000001e-05 2024-09-13T06:43:58.705 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:58.705 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:58.705 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:58.705 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.377779+0000", 2024-09-13T06:43:58.705 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.99488842899999996 2024-09-13T06:43:58.705 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:58.705 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:58.705 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:58.705 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.378007+0000", 2024-09-13T06:43:58.705 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00022838099999999999 2024-09-13T06:43:58.705 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:58.706 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:58.706 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:58.706 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.378462+0000", 2024-09-13T06:43:58.706 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00045452300000000003 2024-09-13T06:43:58.706 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:58.706 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:58.706 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:58.706 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:58.706 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:58.706 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:37866 3.9 3:951cb95b:::rbd_data.1121d8143c6e.0000000000000002:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e56)", 2024-09-13T06:43:58.706 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:06.383951+0000", 2024-09-13T06:43:58.706 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 232.293414845, 2024-09-13T06:43:58.706 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.99517962299999996, 2024-09-13T06:43:58.706 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:58.707 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:58.707 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:58.707 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:58.707 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:58.707 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 37866 2024-09-13T06:43:58.707 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:58.707 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:58.707 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:58.707 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:58.707 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.383951+0000", 2024-09-13T06:43:58.707 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:58.707 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:58.708 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:58.708 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:58.708 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.383951+0000", 2024-09-13T06:43:58.708 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:58.708 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:58.708 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:58.708 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:58.708 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.383949+0000", 2024-09-13T06:43:58.708 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999981 2024-09-13T06:43:58.708 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:58.708 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:58.708 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:58.708 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.383961+0000", 2024-09-13T06:43:58.709 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1999e-05 2024-09-13T06:43:58.709 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:58.709 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:58.709 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:58.709 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384019+0000", 2024-09-13T06:43:58.709 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7621000000000003e-05 2024-09-13T06:43:58.709 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:58.709 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:58.709 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:58.709 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384040+0000", 2024-09-13T06:43:58.709 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1528000000000001e-05 2024-09-13T06:43:58.709 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:58.709 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:58.710 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:58.710 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384186+0000", 2024-09-13T06:43:58.710 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00014573799999999999 2024-09-13T06:43:58.710 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:58.710 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:58.710 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:43:58.710 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384204+0000", 2024-09-13T06:43:58.710 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7992e-05 2024-09-13T06:43:58.710 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:58.710 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:58.710 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:58.710 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.378536+0000", 2024-09-13T06:43:58.710 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.99433268600000002 2024-09-13T06:43:58.711 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:58.711 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:58.711 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:58.711 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.378771+0000", 2024-09-13T06:43:58.711 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00023445399999999999 2024-09-13T06:43:58.711 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:58.711 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:58.711 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:58.711 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.379130+0000", 2024-09-13T06:43:58.711 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00035954200000000002 2024-09-13T06:43:58.711 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:58.711 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:58.711 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:58.711 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:58.712 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:58.712 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:37881 3.9 3:951cb95b:::rbd_data.1121d8143c6e.0000000000000002:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e56)", 2024-09-13T06:43:58.712 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:06.384239+0000", 2024-09-13T06:43:58.712 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 232.29312643099999, 2024-09-13T06:43:58.712 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.99541483500000005, 2024-09-13T06:43:58.712 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:58.712 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:58.712 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:58.712 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:58.712 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:58.712 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 37881 2024-09-13T06:43:58.712 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:58.712 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:58.713 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:58.713 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:58.713 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384239+0000", 2024-09-13T06:43:58.713 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:58.713 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:58.713 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:58.713 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:58.713 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384239+0000", 2024-09-13T06:43:58.713 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:58.713 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:58.713 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:58.713 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:58.713 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384238+0000", 2024-09-13T06:43:58.714 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999986 2024-09-13T06:43:58.714 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:58.714 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:58.714 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:58.714 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384246+0000", 2024-09-13T06:43:58.714 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.2449999999999998e-06 2024-09-13T06:43:58.714 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:58.714 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:58.714 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:58.714 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384268+0000", 2024-09-13T06:43:58.714 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1518e-05 2024-09-13T06:43:58.714 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:58.714 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:58.714 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:58.715 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384282+0000", 2024-09-13T06:43:58.715 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4501999999999999e-05 2024-09-13T06:43:58.715 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:58.715 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:58.715 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:58.715 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384356+0000", 2024-09-13T06:43:58.715 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4265999999999997e-05 2024-09-13T06:43:58.715 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:58.715 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:58.715 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:43:58.715 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384370+0000", 2024-09-13T06:43:58.715 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3942e-05 2024-09-13T06:43:58.715 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:58.715 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:58.716 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:58.716 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.379199+0000", 2024-09-13T06:43:58.716 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.99482866599999997 2024-09-13T06:43:58.716 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:58.716 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:58.716 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:58.716 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.379347+0000", 2024-09-13T06:43:58.716 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00014749199999999999 2024-09-13T06:43:58.716 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:58.716 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:58.716 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:58.716 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.379654+0000", 2024-09-13T06:43:58.716 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00030752999999999998 2024-09-13T06:43:58.716 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:58.717 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:58.717 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:58.717 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:58.717 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:58.717 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:37896 3.9 3:951cb95b:::rbd_data.1121d8143c6e.0000000000000002:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e56)", 2024-09-13T06:43:58.717 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:06.384412+0000", 2024-09-13T06:43:58.717 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 232.292953998, 2024-09-13T06:43:58.717 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.99777835999999998, 2024-09-13T06:43:58.717 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:58.717 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:58.717 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:58.717 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:58.717 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:58.718 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 37896 2024-09-13T06:43:58.718 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:58.718 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:58.718 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:58.718 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:58.718 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384412+0000", 2024-09-13T06:43:58.718 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:58.718 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:58.718 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:58.718 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:58.718 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384412+0000", 2024-09-13T06:43:58.718 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:58.718 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:58.718 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:58.718 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:58.719 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384410+0000", 2024-09-13T06:43:58.719 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.999999 2024-09-13T06:43:58.719 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:58.719 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:58.719 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:58.719 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384418+0000", 2024-09-13T06:43:58.719 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.486e-06 2024-09-13T06:43:58.719 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:58.719 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:58.719 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:58.719 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384436+0000", 2024-09-13T06:43:58.719 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.7668000000000001e-05 2024-09-13T06:43:58.719 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:58.719 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:58.720 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:58.720 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384449+0000", 2024-09-13T06:43:58.720 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3395e-05 2024-09-13T06:43:58.720 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:58.720 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:58.720 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:58.720 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384605+0000", 2024-09-13T06:43:58.720 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00015563099999999999 2024-09-13T06:43:58.720 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:58.720 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:58.720 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:43:58.720 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.384635+0000", 2024-09-13T06:43:58.720 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.0383999999999999e-05 2024-09-13T06:43:58.720 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:58.721 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:58.721 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:58.721 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.379730+0000", 2024-09-13T06:43:58.721 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.99509493999999998 2024-09-13T06:43:58.721 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:58.721 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:58.721 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:58.721 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.379964+0000", 2024-09-13T06:43:58.721 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00023353499999999999 2024-09-13T06:43:58.721 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:58.721 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:58.721 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:58.721 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:07.382190+0000", 2024-09-13T06:43:58.722 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0022265039999999998 2024-09-13T06:43:58.722 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:58.722 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:58.722 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:58.722 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:58.722 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:58.722 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43223 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 393216~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:43:58.722 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558267+0000", 2024-09-13T06:43:58.722 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 217.11909868699999, 2024-09-13T06:43:58.722 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.062813151999999997, 2024-09-13T06:43:58.722 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:58.722 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:58.722 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:58.722 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:58.723 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:58.723 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43223 2024-09-13T06:43:58.723 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:58.723 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:58.723 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:58.723 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:58.723 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558267+0000", 2024-09-13T06:43:58.723 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:58.723 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:58.723 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:58.723 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:58.723 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558267+0000", 2024-09-13T06:43:58.723 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:58.723 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:58.724 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:58.724 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:58.724 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558266+0000", 2024-09-13T06:43:58.724 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:58.724 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:58.724 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:58.724 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:58.724 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558270+0000", 2024-09-13T06:43:58.724 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.2389999999999998e-06 2024-09-13T06:43:58.724 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:58.724 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:58.724 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:58.724 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558277+0000", 2024-09-13T06:43:58.724 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5680000000000002e-06 2024-09-13T06:43:58.725 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:58.725 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:58.725 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:58.725 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558282+0000", 2024-09-13T06:43:58.725 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7060000000000003e-06 2024-09-13T06:43:58.725 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:58.725 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:58.725 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:58.725 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.620731+0000", 2024-09-13T06:43:58.725 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.062448661000000003 2024-09-13T06:43:58.725 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:58.725 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:58.725 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:58.725 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.620806+0000", 2024-09-13T06:43:58.726 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5862e-05 2024-09-13T06:43:58.726 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:58.726 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:58.726 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:58.726 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.621080+0000", 2024-09-13T06:43:58.726 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00027368599999999998 2024-09-13T06:43:58.726 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:58.726 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:58.726 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:58.726 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:58.726 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:58.726 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43224 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 407552~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:43:58.726 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558286+0000", 2024-09-13T06:43:58.726 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 217.11907932299999, 2024-09-13T06:43:58.727 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.063179052999999999, 2024-09-13T06:43:58.727 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:58.727 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:58.727 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:58.727 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:58.727 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:58.727 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43224 2024-09-13T06:43:58.727 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:58.727 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:58.727 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:58.727 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:58.727 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558286+0000", 2024-09-13T06:43:58.727 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:58.728 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:58.728 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:58.728 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:58.728 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558286+0000", 2024-09-13T06:43:58.728 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:58.728 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:58.728 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:58.728 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:58.728 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558286+0000", 2024-09-13T06:43:58.728 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:58.728 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:58.728 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:58.728 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:58.729 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558288+0000", 2024-09-13T06:43:58.729 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.227e-06 2024-09-13T06:43:58.729 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:58.729 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:58.729 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:58.729 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558292+0000", 2024-09-13T06:43:58.729 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.6289999999999999e-06 2024-09-13T06:43:58.729 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:58.729 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:58.729 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:58.729 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558294+0000", 2024-09-13T06:43:58.729 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5409999999999999e-06 2024-09-13T06:43:58.729 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:58.730 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:58.730 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:58.730 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.621110+0000", 2024-09-13T06:43:58.730 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.062815776000000004 2024-09-13T06:43:58.730 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:58.730 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:58.730 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:58.730 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.621186+0000", 2024-09-13T06:43:58.730 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5570999999999999e-05 2024-09-13T06:43:58.730 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:58.730 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:58.730 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:58.730 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.621465+0000", 2024-09-13T06:43:58.731 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00027988200000000001 2024-09-13T06:43:58.731 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:58.731 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:58.731 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:58.731 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:58.731 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:58.731 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43225 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 421888~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:43:58.731 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558296+0000", 2024-09-13T06:43:58.731 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 217.11906935600001, 2024-09-13T06:43:58.731 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.063551110999999993, 2024-09-13T06:43:58.731 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:58.731 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:58.731 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:58.732 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:58.732 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:58.732 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43225 2024-09-13T06:43:58.732 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:58.732 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:58.732 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:58.732 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:58.732 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558296+0000", 2024-09-13T06:43:58.732 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:58.732 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:58.732 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:58.732 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:58.732 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558296+0000", 2024-09-13T06:43:58.733 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:58.733 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:58.733 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:58.733 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:58.733 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558296+0000", 2024-09-13T06:43:58.733 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:43:58.733 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:58.733 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:58.733 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:58.733 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558305+0000", 2024-09-13T06:43:58.733 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.5290000000000008e-06 2024-09-13T06:43:58.734 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:58.734 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:58.734 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:58.734 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558308+0000", 2024-09-13T06:43:58.734 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.5619999999999999e-06 2024-09-13T06:43:58.734 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:58.734 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:58.734 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:58.734 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558311+0000", 2024-09-13T06:43:58.734 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.43e-06 2024-09-13T06:43:58.734 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:58.734 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:58.734 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:58.734 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.621495+0000", 2024-09-13T06:43:58.735 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.063184289000000005 2024-09-13T06:43:58.735 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:58.735 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:58.735 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:58.735 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.621569+0000", 2024-09-13T06:43:58.735 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4250000000000002e-05 2024-09-13T06:43:58.735 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:58.735 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:58.735 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:58.735 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.621847+0000", 2024-09-13T06:43:58.735 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00027826400000000002 2024-09-13T06:43:58.735 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:58.735 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:58.735 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:58.736 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:58.736 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:58.736 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43226 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 436224~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:43:58.736 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558313+0000", 2024-09-13T06:43:58.736 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 217.11905272000001, 2024-09-13T06:43:58.736 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.063914420999999999, 2024-09-13T06:43:58.736 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:58.736 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:58.736 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:58.736 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:58.736 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:58.736 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43226 2024-09-13T06:43:58.736 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:58.736 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:58.737 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:58.737 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:58.737 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558313+0000", 2024-09-13T06:43:58.737 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:58.737 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:58.737 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:58.737 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:58.737 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558313+0000", 2024-09-13T06:43:58.737 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:58.737 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:58.737 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:58.737 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:58.737 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558313+0000", 2024-09-13T06:43:58.737 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:58.738 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:58.738 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:58.738 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:58.738 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558314+0000", 2024-09-13T06:43:58.738 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3740000000000001e-06 2024-09-13T06:43:58.738 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:58.738 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:58.738 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:58.738 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558317+0000", 2024-09-13T06:43:58.738 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9730000000000002e-06 2024-09-13T06:43:58.738 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:58.738 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:58.738 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:58.739 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558319+0000", 2024-09-13T06:43:58.739 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4059999999999999e-06 2024-09-13T06:43:58.739 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:58.739 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:58.739 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:58.739 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.621877+0000", 2024-09-13T06:43:58.739 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.063557408999999995 2024-09-13T06:43:58.739 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:58.739 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:58.739 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:58.739 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.621951+0000", 2024-09-13T06:43:58.739 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4487999999999996e-05 2024-09-13T06:43:58.739 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:58.739 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:58.740 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:58.740 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.622227+0000", 2024-09-13T06:43:58.740 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000276011 2024-09-13T06:43:58.740 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:58.740 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:58.740 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:58.740 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:58.740 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:58.740 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43227 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 450560~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:43:58.740 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558322+0000", 2024-09-13T06:43:58.740 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 217.11904413900001, 2024-09-13T06:43:58.740 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.064285348000000006, 2024-09-13T06:43:58.741 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:58.741 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:58.741 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:58.741 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:58.741 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:58.741 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43227 2024-09-13T06:43:58.741 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:58.741 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:58.741 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:58.741 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:58.741 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558322+0000", 2024-09-13T06:43:58.741 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:58.741 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:58.742 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:58.742 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:58.742 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558322+0000", 2024-09-13T06:43:58.742 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:58.742 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:58.742 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:58.742 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:58.742 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558321+0000", 2024-09-13T06:43:58.742 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:43:58.742 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:58.742 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:58.742 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:58.742 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558323+0000", 2024-09-13T06:43:58.743 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.576e-06 2024-09-13T06:43:58.743 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:58.743 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:58.743 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:58.743 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558328+0000", 2024-09-13T06:43:58.743 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0719999999999999e-06 2024-09-13T06:43:58.743 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:58.743 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:58.743 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:58.743 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558332+0000", 2024-09-13T06:43:58.743 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.8130000000000002e-06 2024-09-13T06:43:58.743 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:58.744 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:58.744 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:58.744 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.622255+0000", 2024-09-13T06:43:58.744 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.063923195000000002 2024-09-13T06:43:58.744 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:58.744 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:58.744 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:58.744 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.622330+0000", 2024-09-13T06:43:58.744 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5383000000000007e-05 2024-09-13T06:43:58.744 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:58.744 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:58.744 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:58.744 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.622607+0000", 2024-09-13T06:43:58.745 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00027651999999999999 2024-09-13T06:43:58.745 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:58.745 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:58.745 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:58.745 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:58.745 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:58.745 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43228 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 464896~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:43:58.745 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558335+0000", 2024-09-13T06:43:58.745 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 217.11903022999999, 2024-09-13T06:43:58.745 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.064652253000000007, 2024-09-13T06:43:58.745 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:58.745 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:58.745 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:58.746 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:58.746 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:58.746 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43228 2024-09-13T06:43:58.746 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:58.746 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:58.746 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:58.746 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:58.746 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558335+0000", 2024-09-13T06:43:58.746 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:58.746 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:58.746 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:58.746 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:58.746 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558335+0000", 2024-09-13T06:43:58.747 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:58.747 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:58.747 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:58.747 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:58.747 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558335+0000", 2024-09-13T06:43:58.747 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:58.747 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:58.747 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:58.747 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:58.747 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558337+0000", 2024-09-13T06:43:58.747 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1380000000000001e-06 2024-09-13T06:43:58.747 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:58.747 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:58.748 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:58.748 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558343+0000", 2024-09-13T06:43:58.748 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.5140000000000001e-06 2024-09-13T06:43:58.748 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:58.748 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:58.748 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:58.748 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558348+0000", 2024-09-13T06:43:58.748 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9640000000000002e-06 2024-09-13T06:43:58.748 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:58.748 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:58.748 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:58.748 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.622636+0000", 2024-09-13T06:43:58.749 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.064288260999999999 2024-09-13T06:43:58.749 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:58.749 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:58.749 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:58.749 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.622715+0000", 2024-09-13T06:43:58.749 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.9351000000000006e-05 2024-09-13T06:43:58.749 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:58.749 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:58.749 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:58.749 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.622988+0000", 2024-09-13T06:43:58.749 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00027242599999999998 2024-09-13T06:43:58.749 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:58.749 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:58.749 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:58.750 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:58.750 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:58.750 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43229 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 479232~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:43:58.750 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558352+0000", 2024-09-13T06:43:58.750 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 217.11901381499999, 2024-09-13T06:43:58.750 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.065018024999999993, 2024-09-13T06:43:58.750 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:58.750 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:58.750 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:58.750 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:58.750 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:58.750 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43229 2024-09-13T06:43:58.750 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:58.750 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:58.751 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:58.751 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:58.751 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558352+0000", 2024-09-13T06:43:58.751 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:58.751 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:58.751 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:58.751 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:58.751 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558352+0000", 2024-09-13T06:43:58.751 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:58.751 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:58.751 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:58.751 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:58.751 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558352+0000", 2024-09-13T06:43:58.752 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:58.752 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:58.752 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:58.752 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:58.752 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558354+0000", 2024-09-13T06:43:58.752 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4930000000000001e-06 2024-09-13T06:43:58.752 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:58.752 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:58.752 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:58.752 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558360+0000", 2024-09-13T06:43:58.752 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.263e-06 2024-09-13T06:43:58.752 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:58.752 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:58.753 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:58.753 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558369+0000", 2024-09-13T06:43:58.753 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.0829999999999993e-06 2024-09-13T06:43:58.753 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:58.753 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:58.753 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:58.753 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.623017+0000", 2024-09-13T06:43:58.753 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.064647799000000006 2024-09-13T06:43:58.753 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:58.753 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:58.753 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:58.753 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.623090+0000", 2024-09-13T06:43:58.753 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3071000000000006e-05 2024-09-13T06:43:58.754 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:58.754 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:58.754 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:58.754 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.623370+0000", 2024-09-13T06:43:58.754 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000279661 2024-09-13T06:43:58.754 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:58.754 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:58.754 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:58.754 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:58.754 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:58.754 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43230 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 493568~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:43:58.754 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558374+0000", 2024-09-13T06:43:58.754 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 217.11899152199999, 2024-09-13T06:43:58.755 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.065410435000000003, 2024-09-13T06:43:58.755 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:58.755 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:58.755 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:58.755 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:58.755 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:58.755 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43230 2024-09-13T06:43:58.755 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:58.755 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:58.755 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:58.755 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:58.755 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558374+0000", 2024-09-13T06:43:58.755 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:58.756 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:58.756 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:58.756 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:58.756 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558374+0000", 2024-09-13T06:43:58.756 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:58.756 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:58.756 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:58.756 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:58.756 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558374+0000", 2024-09-13T06:43:58.756 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:58.756 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:58.756 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:58.757 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:58.757 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558376+0000", 2024-09-13T06:43:58.757 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.4430000000000002e-06 2024-09-13T06:43:58.757 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:58.757 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:58.757 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:58.757 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558382+0000", 2024-09-13T06:43:58.757 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3029999999999996e-06 2024-09-13T06:43:58.757 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:58.757 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:58.757 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:58.757 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558387+0000", 2024-09-13T06:43:58.757 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.1699999999999999e-06 2024-09-13T06:43:58.757 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:58.758 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:58.758 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:58.758 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.623400+0000", 2024-09-13T06:43:58.758 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.065013244999999997 2024-09-13T06:43:58.758 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:58.758 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:58.758 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:58.758 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.623474+0000", 2024-09-13T06:43:58.758 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3889999999999999e-05 2024-09-13T06:43:58.758 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:58.758 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:58.758 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:58.758 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.623785+0000", 2024-09-13T06:43:58.758 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00031080099999999998 2024-09-13T06:43:58.759 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:58.759 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:58.759 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:58.759 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:58.759 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:58.759 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43231 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 507904~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:43:58.759 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558391+0000", 2024-09-13T06:43:58.759 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 217.118974837, 2024-09-13T06:43:58.759 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.065788597000000004, 2024-09-13T06:43:58.759 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:58.759 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:58.759 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:58.759 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:58.759 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:58.759 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43231 2024-09-13T06:43:58.760 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:58.760 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:58.760 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:58.760 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:58.760 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558391+0000", 2024-09-13T06:43:58.760 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:58.760 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:58.760 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:58.760 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:58.760 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558391+0000", 2024-09-13T06:43:58.760 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:58.760 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:58.760 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:58.760 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:58.761 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558390+0000", 2024-09-13T06:43:58.761 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:58.761 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:58.761 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:58.761 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:58.761 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558393+0000", 2024-09-13T06:43:58.761 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2570000000000002e-06 2024-09-13T06:43:58.761 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:58.761 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:58.761 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:58.761 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558399+0000", 2024-09-13T06:43:58.761 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0419999999999999e-06 2024-09-13T06:43:58.761 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:58.761 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:58.762 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:58.762 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558403+0000", 2024-09-13T06:43:58.762 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6249999999999998e-06 2024-09-13T06:43:58.762 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:58.762 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:58.762 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:58.762 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.623811+0000", 2024-09-13T06:43:58.762 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.065407549999999995 2024-09-13T06:43:58.762 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:58.762 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:58.762 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:58.762 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.623877+0000", 2024-09-13T06:43:58.762 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.5902999999999996e-05 2024-09-13T06:43:58.762 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:58.763 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:58.763 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:58.763 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.624179+0000", 2024-09-13T06:43:58.763 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00030259999999999998 2024-09-13T06:43:58.763 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:58.763 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:58.763 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:58.763 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:58.763 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:58.763 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43232 3.f 3:f1d1305f:::rbd_data.1121f5f2e1c0.0000000000000002:1f [read 522240~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:43:58.763 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.558422+0000", 2024-09-13T06:43:58.763 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 217.11894405999999, 2024-09-13T06:43:58.763 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.066176061999999994, 2024-09-13T06:43:58.763 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:58.764 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:58.764 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:58.764 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:58.764 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:58.764 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43232 2024-09-13T06:43:58.764 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:58.764 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:58.764 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:58.764 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:58.764 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558422+0000", 2024-09-13T06:43:58.764 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:58.764 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:58.764 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:58.765 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:58.765 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558422+0000", 2024-09-13T06:43:58.765 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:58.765 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:58.765 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:58.765 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:58.765 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558421+0000", 2024-09-13T06:43:58.765 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:58.765 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:58.765 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:58.765 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:58.765 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558428+0000", 2024-09-13T06:43:58.765 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.1690000000000003e-06 2024-09-13T06:43:58.765 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:58.766 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:58.766 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:58.766 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558434+0000", 2024-09-13T06:43:58.766 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9309999999999996e-06 2024-09-13T06:43:58.766 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:58.766 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:58.766 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:58.766 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.558447+0000", 2024-09-13T06:43:58.766 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.271e-05 2024-09-13T06:43:58.766 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:58.766 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:58.766 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:58.766 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.624209+0000", 2024-09-13T06:43:58.766 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.065762102000000003 2024-09-13T06:43:58.766 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:58.767 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:58.767 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:58.767 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.624282+0000", 2024-09-13T06:43:58.767 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.2889e-05 2024-09-13T06:43:58.767 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:58.767 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:58.767 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:58.767 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.624598+0000", 2024-09-13T06:43:58.767 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00031591399999999998 2024-09-13T06:43:58.767 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:58.767 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:58.767 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:58.767 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:58.768 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:58.768 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43486 3.f 3:f7da9c8f:::rbd_data.1121f5f2e1c0.000000000000000b:1f [read 260096~2048 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:43:58.768 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.569088+0000", 2024-09-13T06:43:58.768 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 217.108277337, 2024-09-13T06:43:58.768 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.062579223000000003, 2024-09-13T06:43:58.768 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:58.768 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:58.768 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:58.768 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:58.768 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:58.768 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43486 2024-09-13T06:43:58.768 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:58.768 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:58.769 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:58.769 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:58.769 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.569088+0000", 2024-09-13T06:43:58.769 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:58.769 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:58.769 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:58.769 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:58.769 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.569088+0000", 2024-09-13T06:43:58.769 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:58.769 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:58.769 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:58.769 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:58.769 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.569088+0000", 2024-09-13T06:43:58.769 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:58.770 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:58.770 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:58.770 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:58.770 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.569091+0000", 2024-09-13T06:43:58.770 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9629999999999998e-06 2024-09-13T06:43:58.770 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:58.770 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:58.770 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:58.770 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.569097+0000", 2024-09-13T06:43:58.771 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.4160000000000001e-06 2024-09-13T06:43:58.771 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:58.771 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:58.771 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:58.771 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.569102+0000", 2024-09-13T06:43:58.771 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6659999999999999e-06 2024-09-13T06:43:58.771 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:58.771 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:58.771 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:58.771 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.631346+0000", 2024-09-13T06:43:58.771 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.062243896 2024-09-13T06:43:58.771 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:58.771 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:58.771 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:58.772 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.631413+0000", 2024-09-13T06:43:58.772 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.7638000000000005e-05 2024-09-13T06:43:58.772 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:58.772 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:58.772 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:58.772 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.631668+0000", 2024-09-13T06:43:58.772 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0002541 2024-09-13T06:43:58.772 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:58.772 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:58.772 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:58.772 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:58.772 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:58.772 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:170125 3.9 3:94e4bf8d:::rbd_object_map.1121fa0cc8a3.000000000000006d:head [writefull 0~37] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e190)", 2024-09-13T06:43:58.772 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:42:30.601501+0000", 2024-09-13T06:43:58.772 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 88.075865125999997, 2024-09-13T06:43:58.773 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.80498820000000004, 2024-09-13T06:43:58.773 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:58.773 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:43:58.773 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:58.773 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:58.773 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:58.773 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 170125 2024-09-13T06:43:58.773 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:58.773 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:58.773 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:58.773 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:58.773 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:30.601501+0000", 2024-09-13T06:43:58.773 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:58.773 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:58.774 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:58.774 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:58.774 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:30.601501+0000", 2024-09-13T06:43:58.774 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:58.774 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:58.774 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:58.774 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:58.774 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:30.601499+0000", 2024-09-13T06:43:58.774 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999986 2024-09-13T06:43:58.774 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:58.774 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:58.774 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:58.774 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:30.601506+0000", 2024-09-13T06:43:58.775 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.9940000000000003e-06 2024-09-13T06:43:58.775 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:58.775 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:58.775 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:58.775 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:30.601519+0000", 2024-09-13T06:43:58.775 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2875e-05 2024-09-13T06:43:58.775 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:58.775 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:58.775 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:58.775 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:30.601525+0000", 2024-09-13T06:43:58.775 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8549999999999998e-06 2024-09-13T06:43:58.775 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:58.775 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:58.775 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:58.776 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:30.601560+0000", 2024-09-13T06:43:58.776 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.5271000000000002e-05 2024-09-13T06:43:58.776 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:58.776 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:58.776 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:43:58.776 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:30.601566+0000", 2024-09-13T06:43:58.776 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3090000000000001e-06 2024-09-13T06:43:58.776 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:58.776 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:58.776 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:58.776 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:31.403017+0000", 2024-09-13T06:43:58.776 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.80145064200000005 2024-09-13T06:43:58.776 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:58.776 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:58.777 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:58.777 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:31.403252+0000", 2024-09-13T06:43:58.777 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000234718 2024-09-13T06:43:58.777 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:58.777 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:58.777 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for subops from 7", 2024-09-13T06:43:58.777 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:31.403521+0000", 2024-09-13T06:43:58.777 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00026917 2024-09-13T06:43:58.777 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:58.777 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:58.777 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "op_commit", 2024-09-13T06:43:58.777 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:31.404918+0000", 2024-09-13T06:43:58.777 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.001397017 2024-09-13T06:43:58.778 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:58.778 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:58.778 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:43:58.778 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:31.406176+0000", 2024-09-13T06:43:58.778 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.001257998 2024-09-13T06:43:58.778 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:58.778 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:58.778 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "commit_sent", 2024-09-13T06:43:58.778 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:31.406334+0000", 2024-09-13T06:43:58.778 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00015819099999999999 2024-09-13T06:43:58.778 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:58.778 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:58.778 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:58.778 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:31.406489+0000", 2024-09-13T06:43:58.779 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00015476699999999999 2024-09-13T06:43:58.779 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:58.779 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:58.779 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:58.779 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:58.779 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:58.779 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:43:58.780 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-13T06:43:58.781 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-13T06:43:58.780+0000 7fa8bb18e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 36790) UID: 0 2024-09-13T06:43:58.881 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:43:58.879+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:43:58.887 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:43:58.887 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-13T06:43:58.887 INFO:teuthology.orchestra.run.smithi081.stdout: "num_ops": 0 2024-09-13T06:43:58.887 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:43:58.901 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-13T06:43:58.990 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:43:58.991+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:43:59.056 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:43:59.057 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-13T06:43:59.057 INFO:teuthology.orchestra.run.smithi081.stdout: "complaint_time": 30, 2024-09-13T06:43:59.057 INFO:teuthology.orchestra.run.smithi081.stdout: "num_blocked_ops": 0 2024-09-13T06:43:59.057 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:43:59.069 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-13T06:43:59.083 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-13T06:43:59.084+0000 7fa8bb18e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 36790) UID: 0 2024-09-13T06:43:59.184 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-13T06:43:59.184+0000 7fa8bb18e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 36790) UID: 0 2024-09-13T06:43:59.227 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:43:59.227 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 20, 2024-09-13T06:43:59.228 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 600, 2024-09-13T06:43:59.228 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [ 2024-09-13T06:43:59.228 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:59.228 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:2226 3.15 3:af026987:::rbd_data.112173e2f1b7.0000000000000017:head [sparse-read 0~4194304] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-13T06:43:59.228 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:37.606562+0000", 2024-09-13T06:43:59.228 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 261.61986943400001, 2024-09-13T06:43:59.228 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.83322091700000001, 2024-09-13T06:43:59.228 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:59.228 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:43:59.228 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:59.228 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:59.228 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:59.229 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 2226 2024-09-13T06:43:59.229 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:59.229 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:59.229 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:59.229 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:59.229 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606562+0000", 2024-09-13T06:43:59.229 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:59.229 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:59.229 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:59.229 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:59.229 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606562+0000", 2024-09-13T06:43:59.229 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:59.229 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:59.229 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:59.230 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:59.230 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606561+0000", 2024-09-13T06:43:59.230 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:59.230 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:59.230 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:59.230 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:59.230 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606565+0000", 2024-09-13T06:43:59.230 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.4379999999999999e-06 2024-09-13T06:43:59.230 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:59.230 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:59.230 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:59.230 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606569+0000", 2024-09-13T06:43:59.230 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.425e-06 2024-09-13T06:43:59.231 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:59.231 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:59.231 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:59.231 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606572+0000", 2024-09-13T06:43:59.231 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.05e-06 2024-09-13T06:43:59.231 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:59.231 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:59.231 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:59.231 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606621+0000", 2024-09-13T06:43:59.231 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.8723000000000001e-05 2024-09-13T06:43:59.231 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:59.231 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:59.231 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:43:59.231 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:37.606630+0000", 2024-09-13T06:43:59.232 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.8040000000000007e-06 2024-09-13T06:43:59.232 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:59.232 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:59.232 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:59.232 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.439648+0000", 2024-09-13T06:43:59.232 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.83301824800000002 2024-09-13T06:43:59.232 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:59.232 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:59.232 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:59.232 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:38.439782+0000", 2024-09-13T06:43:59.232 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00013466699999999999 2024-09-13T06:43:59.232 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:59.232 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:59.233 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:59.233 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:59.233 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:59.233 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25661 3.8 3:1180686c:::rbd_data.1121f2c5ee81.0000000000000009:13 [read 397312~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:43:59.233 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.436956+0000", 2024-09-13T06:43:59.233 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 242.78947489999999, 2024-09-13T06:43:59.233 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089036758999999993, 2024-09-13T06:43:59.233 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:59.233 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:59.233 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:59.233 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:59.233 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:59.233 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25661 2024-09-13T06:43:59.234 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:59.234 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:59.234 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:59.234 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:59.234 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436956+0000", 2024-09-13T06:43:59.234 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:59.234 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:59.234 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:59.234 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:59.234 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436956+0000", 2024-09-13T06:43:59.234 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:59.234 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:59.234 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:59.234 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:59.235 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436956+0000", 2024-09-13T06:43:59.235 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:59.235 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:59.235 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:59.235 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:59.235 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436958+0000", 2024-09-13T06:43:59.235 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1770000000000001e-06 2024-09-13T06:43:59.235 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:59.235 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:59.235 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:59.235 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436963+0000", 2024-09-13T06:43:59.235 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.6489999999999996e-06 2024-09-13T06:43:59.236 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:59.236 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:59.236 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:59.236 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436975+0000", 2024-09-13T06:43:59.236 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1783999999999999e-05 2024-09-13T06:43:59.236 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:59.236 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:59.236 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:59.236 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.525671+0000", 2024-09-13T06:43:59.236 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.088696292999999995 2024-09-13T06:43:59.236 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:59.236 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:59.236 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:59.236 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.525749+0000", 2024-09-13T06:43:59.237 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.7589000000000005e-05 2024-09-13T06:43:59.237 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:59.237 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:59.237 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:59.237 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.525993+0000", 2024-09-13T06:43:59.237 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00024381000000000001 2024-09-13T06:43:59.237 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:59.237 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:59.237 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:59.237 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:59.237 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:59.237 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25662 3.8 3:1180686c:::rbd_data.1121f2c5ee81.0000000000000009:13 [read 421888~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:43:59.237 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.436980+0000", 2024-09-13T06:43:59.238 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 242.78945058799999, 2024-09-13T06:43:59.238 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089367577000000004, 2024-09-13T06:43:59.238 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:59.238 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:59.238 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:59.238 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:59.238 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:59.238 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25662 2024-09-13T06:43:59.238 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:59.238 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:59.238 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:59.238 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:59.238 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436980+0000", 2024-09-13T06:43:59.238 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:59.239 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:59.239 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:59.239 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:59.239 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436980+0000", 2024-09-13T06:43:59.239 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:59.239 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:59.239 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:59.239 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:59.239 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436980+0000", 2024-09-13T06:43:59.239 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:59.239 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:59.239 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:59.239 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:59.239 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436982+0000", 2024-09-13T06:43:59.240 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3989999999999998e-06 2024-09-13T06:43:59.240 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:59.240 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:59.240 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:59.240 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436988+0000", 2024-09-13T06:43:59.240 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0039999999999996e-06 2024-09-13T06:43:59.240 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:59.240 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:59.240 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:59.240 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436993+0000", 2024-09-13T06:43:59.240 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6090000000000003e-06 2024-09-13T06:43:59.240 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:59.240 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:59.240 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:59.240 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.526035+0000", 2024-09-13T06:43:59.241 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089042248000000004 2024-09-13T06:43:59.241 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:59.241 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:59.241 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:59.241 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.526111+0000", 2024-09-13T06:43:59.241 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5643999999999996e-05 2024-09-13T06:43:59.241 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:59.241 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:59.241 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:59.241 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.526348+0000", 2024-09-13T06:43:59.241 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00023705800000000001 2024-09-13T06:43:59.241 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:59.241 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:59.242 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:59.242 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:59.242 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:59.242 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25663 3.8 3:1180686c:::rbd_data.1121f2c5ee81.0000000000000009:13 [read 466944~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:43:59.242 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.436998+0000", 2024-09-13T06:43:59.242 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 242.789432941, 2024-09-13T06:43:59.242 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089730867000000006, 2024-09-13T06:43:59.242 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:59.242 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:59.242 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:59.242 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:59.242 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:59.242 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25663 2024-09-13T06:43:59.243 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:59.243 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:59.243 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:59.243 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:59.243 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436998+0000", 2024-09-13T06:43:59.243 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:59.243 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:59.243 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:59.243 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:59.243 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436998+0000", 2024-09-13T06:43:59.243 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:59.243 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:59.243 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:59.243 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:59.244 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.436998+0000", 2024-09-13T06:43:59.244 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:59.244 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:59.244 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:59.244 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:59.244 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437000+0000", 2024-09-13T06:43:59.244 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0940000000000002e-06 2024-09-13T06:43:59.244 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:59.244 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:59.244 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:59.244 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437005+0000", 2024-09-13T06:43:59.244 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.604e-06 2024-09-13T06:43:59.244 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:59.245 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:59.245 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:59.245 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437032+0000", 2024-09-13T06:43:59.245 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6407e-05 2024-09-13T06:43:59.245 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:59.245 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:59.245 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:59.245 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.526363+0000", 2024-09-13T06:43:59.245 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089331456000000004 2024-09-13T06:43:59.245 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:59.245 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:59.245 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:59.245 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.526404+0000", 2024-09-13T06:43:59.246 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.0887999999999999e-05 2024-09-13T06:43:59.246 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:59.246 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:59.246 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:59.246 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.526729+0000", 2024-09-13T06:43:59.246 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00032486 2024-09-13T06:43:59.246 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:59.246 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:59.246 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:59.246 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:59.246 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:59.246 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25664 3.8 3:1180686c:::rbd_data.1121f2c5ee81.0000000000000009:13 [read 491520~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:43:59.246 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.437040+0000", 2024-09-13T06:43:59.247 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 242.789391026, 2024-09-13T06:43:59.247 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.090016650000000004, 2024-09-13T06:43:59.247 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:59.247 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:59.247 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:59.247 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:59.247 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:59.247 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25664 2024-09-13T06:43:59.247 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:59.247 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:59.247 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:59.247 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:59.247 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437040+0000", 2024-09-13T06:43:59.248 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:59.248 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:59.248 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:59.248 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:59.248 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437040+0000", 2024-09-13T06:43:59.248 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:59.248 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:59.248 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:59.248 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:59.248 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437039+0000", 2024-09-13T06:43:59.248 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:59.248 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:59.248 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:59.249 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:59.249 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437047+0000", 2024-09-13T06:43:59.249 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4839999999999998e-06 2024-09-13T06:43:59.249 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:59.249 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:59.249 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:59.249 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437054+0000", 2024-09-13T06:43:59.249 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.8299999999999998e-06 2024-09-13T06:43:59.249 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:59.249 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:59.249 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:59.249 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.437060+0000", 2024-09-13T06:43:59.249 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.1510000000000001e-06 2024-09-13T06:43:59.249 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:59.250 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:59.250 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:59.250 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.526772+0000", 2024-09-13T06:43:59.250 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089711737999999999 2024-09-13T06:43:59.250 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:59.250 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:59.250 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:59.250 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.526848+0000", 2024-09-13T06:43:59.250 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5870000000000004e-05 2024-09-13T06:43:59.250 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:59.250 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:59.250 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:59.250 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.527057+0000", 2024-09-13T06:43:59.251 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000209106 2024-09-13T06:43:59.251 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:59.251 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:59.251 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:59.251 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:59.251 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:59.251 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25740 3.18 3:1c662b96:::rbd_data.1121f2c5ee81.0000000000000010:13 [read 200704~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:43:59.251 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443352+0000", 2024-09-13T06:43:59.251 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 242.783079351, 2024-09-13T06:43:59.251 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089068222000000002, 2024-09-13T06:43:59.251 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:59.251 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:59.252 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:59.252 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:59.252 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:59.252 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25740 2024-09-13T06:43:59.252 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:59.252 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:59.252 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:59.252 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:59.252 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443352+0000", 2024-09-13T06:43:59.252 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:59.252 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:59.252 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:59.252 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:59.252 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443352+0000", 2024-09-13T06:43:59.253 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:59.253 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:59.253 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:59.253 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:59.253 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443351+0000", 2024-09-13T06:43:59.253 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:59.253 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:59.253 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:59.253 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:59.253 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443354+0000", 2024-09-13T06:43:59.253 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.841e-06 2024-09-13T06:43:59.253 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:59.253 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:59.253 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:59.254 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443361+0000", 2024-09-13T06:43:59.254 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.0010000000000004e-06 2024-09-13T06:43:59.254 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:59.254 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:59.254 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:59.254 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443366+0000", 2024-09-13T06:43:59.254 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.7119999999999999e-06 2024-09-13T06:43:59.254 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:59.254 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:59.254 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:59.254 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532117+0000", 2024-09-13T06:43:59.254 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.088751327000000005 2024-09-13T06:43:59.254 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:59.255 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:59.255 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:59.255 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532193+0000", 2024-09-13T06:43:59.255 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5839000000000004e-05 2024-09-13T06:43:59.255 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:59.255 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:59.255 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:59.255 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532420+0000", 2024-09-13T06:43:59.255 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00022691000000000001 2024-09-13T06:43:59.255 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:59.255 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:59.255 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:59.255 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:59.256 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:59.256 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25741 3.18 3:1c662b96:::rbd_data.1121f2c5ee81.0000000000000010:13 [read 225280~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:43:59.256 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443378+0000", 2024-09-13T06:43:59.256 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 242.78305258399999, 2024-09-13T06:43:59.256 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089324107, 2024-09-13T06:43:59.256 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:59.256 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:59.256 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:59.256 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:59.256 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:59.256 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25741 2024-09-13T06:43:59.256 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:59.257 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:59.257 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:59.257 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:59.257 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443378+0000", 2024-09-13T06:43:59.257 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:59.257 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:59.257 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:59.257 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:59.257 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443378+0000", 2024-09-13T06:43:59.257 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:59.257 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:59.257 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:59.257 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:59.257 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443378+0000", 2024-09-13T06:43:59.258 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:59.258 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:59.258 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:59.258 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:59.258 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443380+0000", 2024-09-13T06:43:59.258 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3549999999999999e-06 2024-09-13T06:43:59.258 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:59.258 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:59.258 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:59.258 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443388+0000", 2024-09-13T06:43:59.258 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.7449999999999995e-06 2024-09-13T06:43:59.259 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:59.259 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:59.259 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:59.259 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443393+0000", 2024-09-13T06:43:59.259 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.4e-06 2024-09-13T06:43:59.259 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:59.259 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:59.259 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:59.259 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532454+0000", 2024-09-13T06:43:59.259 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089060941000000005 2024-09-13T06:43:59.259 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:59.259 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:59.259 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:59.260 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532512+0000", 2024-09-13T06:43:59.260 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7763000000000002e-05 2024-09-13T06:43:59.260 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:59.260 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:59.260 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:59.260 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532703+0000", 2024-09-13T06:43:59.260 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000190328 2024-09-13T06:43:59.260 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:59.260 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:59.260 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:59.260 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:59.260 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:59.260 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25742 3.18 3:1c662b96:::rbd_data.1121f2c5ee81.0000000000000010:13 [read 270336~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:43:59.261 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443398+0000", 2024-09-13T06:43:59.261 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 242.78303287200001, 2024-09-13T06:43:59.261 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089621836999999996, 2024-09-13T06:43:59.261 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:59.261 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:59.261 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:59.261 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:59.261 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:59.261 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25742 2024-09-13T06:43:59.261 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:59.261 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:59.261 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:59.261 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:59.261 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443398+0000", 2024-09-13T06:43:59.262 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:59.262 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:59.262 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:59.262 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:59.262 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443398+0000", 2024-09-13T06:43:59.262 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:59.262 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:59.262 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:59.262 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:59.262 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443398+0000", 2024-09-13T06:43:59.262 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:59.262 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:59.262 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:59.262 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:59.262 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443400+0000", 2024-09-13T06:43:59.263 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.1849999999999998e-06 2024-09-13T06:43:59.263 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:59.263 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:59.263 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:59.263 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443407+0000", 2024-09-13T06:43:59.263 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3669999999999999e-06 2024-09-13T06:43:59.263 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:59.263 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:59.263 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:59.263 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443420+0000", 2024-09-13T06:43:59.263 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2645e-05 2024-09-13T06:43:59.263 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:59.263 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:59.263 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:59.264 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532742+0000", 2024-09-13T06:43:59.264 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089322200000000004 2024-09-13T06:43:59.264 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:59.264 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:59.264 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:59.264 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.532818+0000", 2024-09-13T06:43:59.264 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.6019000000000005e-05 2024-09-13T06:43:59.264 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:59.264 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:59.264 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:59.264 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533020+0000", 2024-09-13T06:43:59.264 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000201721 2024-09-13T06:43:59.264 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:59.265 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:59.265 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:59.265 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:59.265 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:59.265 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25743 3.18 3:1c662b96:::rbd_data.1121f2c5ee81.0000000000000010:13 [read 294912~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:43:59.265 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443425+0000", 2024-09-13T06:43:59.265 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 242.78300586399999, 2024-09-13T06:43:59.265 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089864075000000002, 2024-09-13T06:43:59.265 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:59.265 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:59.265 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:59.265 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:59.265 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:59.265 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25743 2024-09-13T06:43:59.266 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:59.266 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:59.266 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:59.266 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:59.266 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443425+0000", 2024-09-13T06:43:59.266 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:59.266 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:59.266 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:59.266 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:59.266 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443425+0000", 2024-09-13T06:43:59.266 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:59.266 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:59.267 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:59.267 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:59.267 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443425+0000", 2024-09-13T06:43:59.267 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:59.267 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:59.267 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:59.267 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:59.267 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443432+0000", 2024-09-13T06:43:59.267 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3420000000000002e-06 2024-09-13T06:43:59.267 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:59.267 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:59.267 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:59.267 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443440+0000", 2024-09-13T06:43:59.268 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5689999999999999e-06 2024-09-13T06:43:59.268 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:59.268 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:59.268 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:59.268 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443445+0000", 2024-09-13T06:43:59.268 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.9590000000000003e-06 2024-09-13T06:43:59.268 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:59.268 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:59.268 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:59.268 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533063+0000", 2024-09-13T06:43:59.268 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089617988999999995 2024-09-13T06:43:59.268 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:59.268 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:59.268 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:59.269 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533122+0000", 2024-09-13T06:43:59.269 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9052999999999999e-05 2024-09-13T06:43:59.269 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:59.269 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:59.269 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:59.269 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533289+0000", 2024-09-13T06:43:59.269 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00016752800000000001 2024-09-13T06:43:59.269 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:59.269 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:59.269 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:59.269 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:59.269 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:59.270 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25744 3.18 3.69d46638 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:43:59.270 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443449+0000", 2024-09-13T06:43:59.270 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 242.78298171700001, 2024-09-13T06:43:59.270 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089869148999999995, 2024-09-13T06:43:59.270 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:59.270 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:43:59.270 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:59.270 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:59.270 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:59.270 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25744 2024-09-13T06:43:59.270 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:59.270 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:59.270 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:59.270 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:59.271 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443449+0000", 2024-09-13T06:43:59.271 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:59.271 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:59.271 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:59.271 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:59.271 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443449+0000", 2024-09-13T06:43:59.271 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:59.271 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:59.271 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:59.271 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:59.271 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443449+0000", 2024-09-13T06:43:59.271 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:59.272 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:59.272 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:59.272 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:59.272 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443451+0000", 2024-09-13T06:43:59.272 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.244e-06 2024-09-13T06:43:59.272 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:59.272 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:59.272 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:59.272 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443457+0000", 2024-09-13T06:43:59.272 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.66e-06 2024-09-13T06:43:59.272 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:59.272 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:59.272 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:59.273 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443461+0000", 2024-09-13T06:43:59.273 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5449999999999997e-06 2024-09-13T06:43:59.273 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:59.273 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:59.273 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:59.273 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533311+0000", 2024-09-13T06:43:59.273 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089849729000000003 2024-09-13T06:43:59.273 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:59.273 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:59.273 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:59.273 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533318+0000", 2024-09-13T06:43:59.273 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.328e-06 2024-09-13T06:43:59.273 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:59.274 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:59.274 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:59.274 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:59.274 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:59.274 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25745 3.18 3.69d46638 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:43:59.274 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443466+0000", 2024-09-13T06:43:59.274 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 242.78296465899999, 2024-09-13T06:43:59.274 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089886743000000005, 2024-09-13T06:43:59.274 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:59.274 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:43:59.274 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:59.274 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:59.274 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:59.275 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25745 2024-09-13T06:43:59.275 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:59.275 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:59.275 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:59.275 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:59.275 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443466+0000", 2024-09-13T06:43:59.275 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:59.275 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:59.275 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:59.275 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:59.275 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443466+0000", 2024-09-13T06:43:59.275 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:59.275 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:59.275 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:59.275 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:59.276 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443466+0000", 2024-09-13T06:43:59.276 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:59.276 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:59.276 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:59.276 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:59.276 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443474+0000", 2024-09-13T06:43:59.276 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.1289999999999996e-06 2024-09-13T06:43:59.276 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:59.276 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:59.276 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:59.276 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443484+0000", 2024-09-13T06:43:59.276 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0654e-05 2024-09-13T06:43:59.276 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:59.276 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:59.277 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:59.277 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443490+0000", 2024-09-13T06:43:59.277 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8030000000000002e-06 2024-09-13T06:43:59.277 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:59.277 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:59.277 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:59.277 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533348+0000", 2024-09-13T06:43:59.277 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089857267000000005 2024-09-13T06:43:59.277 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:59.277 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:59.277 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:59.277 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533353+0000", 2024-09-13T06:43:59.277 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.5520000000000004e-06 2024-09-13T06:43:59.277 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:59.278 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:59.278 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:59.278 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:59.278 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:59.278 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25746 3.18 3.69d46638 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:43:59.278 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443495+0000", 2024-09-13T06:43:59.278 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 242.782935546, 2024-09-13T06:43:59.278 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089903725000000004, 2024-09-13T06:43:59.278 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:59.278 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:43:59.278 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:59.278 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:59.278 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:59.278 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25746 2024-09-13T06:43:59.279 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:59.279 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:59.279 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:59.279 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:59.279 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443495+0000", 2024-09-13T06:43:59.279 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:59.279 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:59.279 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:59.279 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:59.279 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443495+0000", 2024-09-13T06:43:59.279 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:59.279 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:59.279 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:59.279 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:59.279 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443495+0000", 2024-09-13T06:43:59.280 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:59.280 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:59.280 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:59.280 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:59.280 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443498+0000", 2024-09-13T06:43:59.280 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.7690000000000001e-06 2024-09-13T06:43:59.280 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:59.280 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:59.280 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:59.280 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443504+0000", 2024-09-13T06:43:59.280 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.9710000000000001e-06 2024-09-13T06:43:59.280 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:59.280 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:59.280 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:59.280 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443508+0000", 2024-09-13T06:43:59.281 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.4159999999999997e-06 2024-09-13T06:43:59.281 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:59.281 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:59.281 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:59.281 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533391+0000", 2024-09-13T06:43:59.281 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089882607000000003 2024-09-13T06:43:59.281 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:59.281 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:59.281 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:59.281 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533399+0000", 2024-09-13T06:43:59.281 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.4349999999999997e-06 2024-09-13T06:43:59.281 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:59.281 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:59.281 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:59.281 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:59.282 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:59.282 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25747 3.8 3.63996268 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:43:59.282 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443512+0000", 2024-09-13T06:43:59.282 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 242.78291881499999, 2024-09-13T06:43:59.282 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089880075000000004, 2024-09-13T06:43:59.282 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:59.282 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:43:59.282 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:59.282 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:59.282 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:59.282 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25747 2024-09-13T06:43:59.282 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:59.282 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:59.282 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:59.282 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:59.283 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443512+0000", 2024-09-13T06:43:59.283 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:59.283 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:59.283 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:59.283 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:59.283 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443512+0000", 2024-09-13T06:43:59.283 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:59.283 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:59.283 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:59.283 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:59.283 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443512+0000", 2024-09-13T06:43:59.283 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:59.283 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:59.283 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:59.284 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:59.284 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443514+0000", 2024-09-13T06:43:59.284 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0980000000000001e-06 2024-09-13T06:43:59.284 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:59.284 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:59.284 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:59.284 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443520+0000", 2024-09-13T06:43:59.284 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7069999999999997e-06 2024-09-13T06:43:59.284 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:59.284 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:59.284 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:59.284 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443524+0000", 2024-09-13T06:43:59.284 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5390000000000001e-06 2024-09-13T06:43:59.284 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:59.285 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:59.285 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:59.285 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533384+0000", 2024-09-13T06:43:59.285 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089859684999999995 2024-09-13T06:43:59.285 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:59.285 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:59.285 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:59.285 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533392+0000", 2024-09-13T06:43:59.285 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.3440000000000001e-06 2024-09-13T06:43:59.285 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:59.285 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:59.285 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:59.285 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:59.286 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:59.286 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25748 3.8 3.63996268 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:43:59.286 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443528+0000", 2024-09-13T06:43:59.286 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 242.78290268800001, 2024-09-13T06:43:59.286 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089890715999999996, 2024-09-13T06:43:59.286 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:59.286 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:43:59.286 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:59.286 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:59.286 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:59.286 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25748 2024-09-13T06:43:59.286 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:59.286 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:59.286 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:59.287 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:59.287 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443528+0000", 2024-09-13T06:43:59.287 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:59.287 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:59.287 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:59.287 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:59.287 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443528+0000", 2024-09-13T06:43:59.287 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:59.287 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:59.287 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:59.287 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:59.287 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443528+0000", 2024-09-13T06:43:59.287 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:59.288 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:59.288 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:59.288 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:59.288 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443530+0000", 2024-09-13T06:43:59.288 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0650000000000001e-06 2024-09-13T06:43:59.288 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:59.288 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:59.288 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:59.288 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443536+0000", 2024-09-13T06:43:59.288 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7259999999999999e-06 2024-09-13T06:43:59.288 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:59.288 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:59.288 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:59.289 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443540+0000", 2024-09-13T06:43:59.289 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.5009999999999998e-06 2024-09-13T06:43:59.289 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:59.289 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:59.289 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:59.289 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533412+0000", 2024-09-13T06:43:59.289 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089871873000000005 2024-09-13T06:43:59.289 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:59.289 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:59.289 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:59.289 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533419+0000", 2024-09-13T06:43:59.289 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.883e-06 2024-09-13T06:43:59.289 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:59.289 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:59.290 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:59.290 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:59.290 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:59.290 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25749 3.8 3.63996268 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:43:59.290 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443545+0000", 2024-09-13T06:43:59.290 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 242.78288649199999, 2024-09-13T06:43:59.290 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089897988999999998, 2024-09-13T06:43:59.290 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:59.290 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:43:59.290 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:59.290 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:59.290 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:59.290 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25749 2024-09-13T06:43:59.290 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:59.291 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:59.291 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:59.291 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:59.291 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443545+0000", 2024-09-13T06:43:59.291 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:59.291 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:59.291 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:59.291 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:59.291 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443545+0000", 2024-09-13T06:43:59.291 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:59.291 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:59.291 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:59.291 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:59.291 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443544+0000", 2024-09-13T06:43:59.292 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:59.292 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:59.292 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:59.292 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:59.292 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443553+0000", 2024-09-13T06:43:59.292 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.4770000000000003e-06 2024-09-13T06:43:59.292 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:59.292 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:59.292 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:59.292 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443564+0000", 2024-09-13T06:43:59.292 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0986e-05 2024-09-13T06:43:59.292 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:59.292 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:59.292 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:59.293 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443569+0000", 2024-09-13T06:43:59.293 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2530000000000004e-06 2024-09-13T06:43:59.293 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:59.293 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:59.293 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:59.293 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533438+0000", 2024-09-13T06:43:59.293 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089868641999999999 2024-09-13T06:43:59.293 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:59.293 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:59.293 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:59.293 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533442+0000", 2024-09-13T06:43:59.293 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.989e-06 2024-09-13T06:43:59.293 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:59.293 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:59.294 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:59.294 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:59.294 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:59.294 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25750 3.8 3.63996268 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:43:59.294 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443574+0000", 2024-09-13T06:43:59.294 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 242.782857006, 2024-09-13T06:43:59.294 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089895143999999996, 2024-09-13T06:43:59.294 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:59.294 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:43:59.294 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:59.294 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:59.294 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:59.294 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25750 2024-09-13T06:43:59.294 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:59.295 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:59.295 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:59.295 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:59.295 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443574+0000", 2024-09-13T06:43:59.295 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:59.295 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:59.295 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:59.295 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:59.295 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443574+0000", 2024-09-13T06:43:59.295 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:59.295 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:59.295 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:59.295 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:59.295 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443574+0000", 2024-09-13T06:43:59.296 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:59.296 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:59.296 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:59.296 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:59.296 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443576+0000", 2024-09-13T06:43:59.296 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6910000000000002e-06 2024-09-13T06:43:59.296 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:59.296 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:59.296 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:59.296 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443583+0000", 2024-09-13T06:43:59.296 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.331e-06 2024-09-13T06:43:59.296 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:59.296 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:59.297 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:59.297 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443587+0000", 2024-09-13T06:43:59.297 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6129999999999997e-06 2024-09-13T06:43:59.297 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:59.297 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:59.297 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:59.297 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533464+0000", 2024-09-13T06:43:59.297 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089876605999999998 2024-09-13T06:43:59.297 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:59.297 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:59.297 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:59.298 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533469+0000", 2024-09-13T06:43:59.298 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.3909999999999997e-06 2024-09-13T06:43:59.298 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:59.298 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:59.298 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:59.298 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:59.298 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:59.298 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25751 3.8 3.63996268 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:43:59.298 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443592+0000", 2024-09-13T06:43:59.298 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 242.782839309, 2024-09-13T06:43:59.298 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089913650999999997, 2024-09-13T06:43:59.298 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:59.298 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:43:59.298 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:59.298 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:59.298 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:59.299 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25751 2024-09-13T06:43:59.299 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:59.299 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:59.299 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:59.299 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:59.299 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443592+0000", 2024-09-13T06:43:59.299 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:59.299 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:59.299 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:59.299 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:59.299 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443592+0000", 2024-09-13T06:43:59.299 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:59.299 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:59.299 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:59.299 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:59.300 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443591+0000", 2024-09-13T06:43:59.300 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:59.300 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:59.300 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:59.300 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:59.300 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443594+0000", 2024-09-13T06:43:59.300 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3649999999999998e-06 2024-09-13T06:43:59.300 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:59.300 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:59.300 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:59.300 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443599+0000", 2024-09-13T06:43:59.300 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.699e-06 2024-09-13T06:43:59.300 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:59.301 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:59.301 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:59.301 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443611+0000", 2024-09-13T06:43:59.301 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1503e-05 2024-09-13T06:43:59.301 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:59.301 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:59.301 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:59.301 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533497+0000", 2024-09-13T06:43:59.301 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089886453000000005 2024-09-13T06:43:59.301 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:59.301 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:59.301 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:59.301 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533505+0000", 2024-09-13T06:43:59.301 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.9910000000000002e-06 2024-09-13T06:43:59.302 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:59.302 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:59.302 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:59.302 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:59.302 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:59.302 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:25752 3.8 3.63996268 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-13T06:43:59.302 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:39:56.443615+0000", 2024-09-13T06:43:59.302 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 242.78281552799999, 2024-09-13T06:43:59.302 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089905868999999999, 2024-09-13T06:43:59.302 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:59.302 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:43:59.302 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:59.302 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:59.302 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:59.302 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 25752 2024-09-13T06:43:59.303 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:59.303 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:59.303 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:59.303 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:59.303 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443615+0000", 2024-09-13T06:43:59.303 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:59.303 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:59.303 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:59.303 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:59.303 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443615+0000", 2024-09-13T06:43:59.303 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:59.303 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:59.303 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:59.303 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:59.304 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443615+0000", 2024-09-13T06:43:59.304 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:59.304 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:59.304 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:59.304 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:59.304 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443617+0000", 2024-09-13T06:43:59.304 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3539999999999998e-06 2024-09-13T06:43:59.304 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:59.304 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:59.304 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:59.304 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443624+0000", 2024-09-13T06:43:59.304 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.3600000000000001e-06 2024-09-13T06:43:59.304 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:59.305 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:59.305 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:59.305 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.443628+0000", 2024-09-13T06:43:59.305 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.2350000000000001e-06 2024-09-13T06:43:59.305 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:59.305 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:59.305 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:59.305 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533517+0000", 2024-09-13T06:43:59.305 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.089889029999999995 2024-09-13T06:43:59.305 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:59.305 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:59.305 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:59.306 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:39:56.533521+0000", 2024-09-13T06:43:59.306 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.2529999999999998e-06 2024-09-13T06:43:59.306 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:59.306 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:59.306 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:59.306 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:59.306 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:59.306 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:64356 3.c 3:32785be9:::rbd_header.11218ba71f0d:head [watch reconnect cookie 140361410387072 gen 2] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e95)", 2024-09-13T06:43:59.306 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:48.473318+0000", 2024-09-13T06:43:59.306 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 190.75311313500001, 2024-09-13T06:43:59.306 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1458904379999999, 2024-09-13T06:43:59.306 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:59.306 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:43:59.306 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:59.306 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:59.307 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:59.307 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 64356 2024-09-13T06:43:59.307 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:59.307 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:59.307 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:59.307 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:59.307 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:48.473318+0000", 2024-09-13T06:43:59.307 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:59.307 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:59.307 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:59.307 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:59.307 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:48.473318+0000", 2024-09-13T06:43:59.307 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:59.308 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:59.308 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:59.308 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:59.308 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:48.473315+0000", 2024-09-13T06:43:59.308 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999971 2024-09-13T06:43:59.308 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:59.308 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:59.308 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:59.308 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:48.473329+0000", 2024-09-13T06:43:59.308 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.433e-05 2024-09-13T06:43:59.308 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:59.308 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:59.308 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:59.309 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:48.473363+0000", 2024-09-13T06:43:59.309 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.3592e-05 2024-09-13T06:43:59.309 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:59.309 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:59.309 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:59.309 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:48.473386+0000", 2024-09-13T06:43:59.309 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.2708999999999999e-05 2024-09-13T06:43:59.309 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:59.309 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:59.309 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:59.309 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:48.473804+0000", 2024-09-13T06:43:59.309 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00041789399999999998 2024-09-13T06:43:59.309 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:59.310 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:59.310 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:43:59.310 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:48.473830+0000", 2024-09-13T06:43:59.310 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6869e-05 2024-09-13T06:43:59.310 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:59.310 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:59.310 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:59.310 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:49.614332+0000", 2024-09-13T06:43:59.310 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.140501107 2024-09-13T06:43:59.310 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:59.310 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:59.310 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for rw locks", 2024-09-13T06:43:59.310 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:49.614496+0000", 2024-09-13T06:43:59.310 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00016451200000000001 2024-09-13T06:43:59.311 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:59.311 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:59.311 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:59.311 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:49.617131+0000", 2024-09-13T06:43:59.311 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.002634843 2024-09-13T06:43:59.311 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:59.311 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:59.311 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:43:59.311 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:49.617204+0000", 2024-09-13T06:43:59.311 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.2991000000000006e-05 2024-09-13T06:43:59.311 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:59.311 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:59.311 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:59.311 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:49.619208+0000", 2024-09-13T06:43:59.312 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.002004381 2024-09-13T06:43:59.312 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:59.312 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:59.312 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:59.312 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:59.312 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:59.312 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:170155 3.7 3:e17728eb:::image_client.0-clone36.rbd:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e191)", 2024-09-13T06:43:59.312 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:42:31.436412+0000", 2024-09-13T06:43:59.312 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 87.790019311999998, 2024-09-13T06:43:59.312 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.97843703800000004, 2024-09-13T06:43:59.312 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:43:59.312 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "reached pg", 2024-09-13T06:43:59.312 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:43:59.312 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:43:59.313 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:59.313 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 170155 2024-09-13T06:43:59.313 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:59.313 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:43:59.313 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:59.313 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:43:59.313 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:31.436412+0000", 2024-09-13T06:43:59.313 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:59.313 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:59.313 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:59.313 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:43:59.313 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:31.436412+0000", 2024-09-13T06:43:59.313 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:43:59.314 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:59.314 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:59.314 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:43:59.314 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:31.436410+0000", 2024-09-13T06:43:59.314 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999986 2024-09-13T06:43:59.314 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:59.314 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:59.314 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:43:59.314 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:31.436417+0000", 2024-09-13T06:43:59.314 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.6939999999999998e-06 2024-09-13T06:43:59.314 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:59.314 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:59.314 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:43:59.314 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:31.436430+0000", 2024-09-13T06:43:59.315 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3016999999999999e-05 2024-09-13T06:43:59.315 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:59.315 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:59.315 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:43:59.315 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:31.436437+0000", 2024-09-13T06:43:59.315 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.1069999999999999e-06 2024-09-13T06:43:59.315 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:59.315 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:59.315 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:59.315 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:31.436515+0000", 2024-09-13T06:43:59.315 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.7756000000000006e-05 2024-09-13T06:43:59.315 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:59.315 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:59.315 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:43:59.316 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:31.436523+0000", 2024-09-13T06:43:59.316 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.4970000000000001e-06 2024-09-13T06:43:59.316 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:59.316 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:59.316 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:43:59.316 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:32.414565+0000", 2024-09-13T06:43:59.316 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.97804144199999998 2024-09-13T06:43:59.316 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:43:59.316 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:43:59.316 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:43:59.316 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:32.414849+0000", 2024-09-13T06:43:59.316 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00028388600000000001 2024-09-13T06:43:59.316 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:59.316 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:59.317 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:59.317 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:43:59.317 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:43:59.317 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:43:59.318 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-13T06:43:59.319 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:43:59.319+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:43:59.419 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:43:59.419+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:43:59.452 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:43:59.452 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [], 2024-09-13T06:43:59.452 INFO:teuthology.orchestra.run.smithi139.stdout: "num_ops": 0 2024-09-13T06:43:59.452 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:43:59.466 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-13T06:43:59.521 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:43:59.519+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:43:59.587 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:43:59.588 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [], 2024-09-13T06:43:59.588 INFO:teuthology.orchestra.run.smithi139.stdout: "complaint_time": 30, 2024-09-13T06:43:59.588 INFO:teuthology.orchestra.run.smithi139.stdout: "num_blocked_ops": 0 2024-09-13T06:43:59.588 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:43:59.603 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-13T06:43:59.609 INFO:teuthology.orchestra.run.smithi081.stderr:nodeep-scrub is unset 2024-09-13T06:43:59.621 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:43:59.619+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:43:59.723 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:43:59.723+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:43:59.729 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:43:59.730 INFO:teuthology.orchestra.run.smithi139.stdout: "size": 20, 2024-09-13T06:43:59.730 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 600, 2024-09-13T06:43:59.730 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [ 2024-09-13T06:43:59.730 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:59.730 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:160483 3.a 3:57f62123:::rbd_header.112138ed422:head [watch reconnect cookie 140361344088384 gen 3] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e177)", 2024-09-13T06:43:59.730 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:42:17.439011+0000", 2024-09-13T06:43:59.730 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 102.289512587, 2024-09-13T06:43:59.730 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.155518861, 2024-09-13T06:43:59.730 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:59.730 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:59.730 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:59.730 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:59.731 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:59.731 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 160483 2024-09-13T06:43:59.731 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:59.731 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:59.731 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:59.731 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:59.731 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:17.439011+0000", 2024-09-13T06:43:59.731 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:59.731 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:59.731 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:59.731 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:59.731 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:17.439011+0000", 2024-09-13T06:43:59.731 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:59.732 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:59.732 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:59.732 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:59.732 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:17.439009+0000", 2024-09-13T06:43:59.732 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999976 2024-09-13T06:43:59.732 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:59.732 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:59.732 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:59.732 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:17.439024+0000", 2024-09-13T06:43:59.732 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.464e-05 2024-09-13T06:43:59.732 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:59.732 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:59.733 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:59.733 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:17.439058+0000", 2024-09-13T06:43:59.733 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.4712999999999998e-05 2024-09-13T06:43:59.733 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:59.733 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:59.733 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:59.733 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:17.439085+0000", 2024-09-13T06:43:59.733 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.6216000000000001e-05 2024-09-13T06:43:59.733 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:59.733 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:59.733 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:59.733 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:17.439182+0000", 2024-09-13T06:43:59.733 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.7020000000000003e-05 2024-09-13T06:43:59.733 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:59.734 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:59.734 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:43:59.734 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:17.439204+0000", 2024-09-13T06:43:59.734 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.2276000000000002e-05 2024-09-13T06:43:59.734 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:59.734 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:59.734 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:59.734 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:18.588627+0000", 2024-09-13T06:43:59.734 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1494235829999999 2024-09-13T06:43:59.734 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:59.734 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:59.734 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for rw locks", 2024-09-13T06:43:59.734 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:18.589031+0000", 2024-09-13T06:43:59.735 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0004035 2024-09-13T06:43:59.735 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:59.735 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:59.735 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:59.735 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:18.590604+0000", 2024-09-13T06:43:59.735 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.001573234 2024-09-13T06:43:59.735 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:59.735 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:59.735 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:59.735 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:18.590791+0000", 2024-09-13T06:43:59.735 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000186701 2024-09-13T06:43:59.735 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:59.735 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:59.736 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:59.736 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:18.594530+0000", 2024-09-13T06:43:59.736 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0037394250000000002 2024-09-13T06:43:59.736 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:59.736 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:59.736 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:59.736 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:59.736 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:59.736 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:208355 3.14 3:2d339b7f:::rbd_data.1121cb4a09ed.0000000000000003:snapdir [list-snaps] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e219)", 2024-09-13T06:43:59.736 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:43:03.420412+0000", 2024-09-13T06:43:59.736 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 56.308112451, 2024-09-13T06:43:59.736 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.705233864, 2024-09-13T06:43:59.736 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:59.736 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:59.737 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:59.737 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:59.737 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:59.737 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 208355 2024-09-13T06:43:59.737 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:59.737 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:59.737 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:59.737 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:59.737 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420412+0000", 2024-09-13T06:43:59.737 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:59.737 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:59.737 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:59.738 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:59.738 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420412+0000", 2024-09-13T06:43:59.738 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:59.738 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:59.738 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:59.738 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:59.738 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420409+0000", 2024-09-13T06:43:59.738 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999981 2024-09-13T06:43:59.738 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:59.738 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:59.738 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:59.738 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420420+0000", 2024-09-13T06:43:59.738 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0716e-05 2024-09-13T06:43:59.738 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:59.738 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:59.739 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:59.739 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420440+0000", 2024-09-13T06:43:59.739 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.9850000000000001e-05 2024-09-13T06:43:59.739 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:59.739 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:59.739 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:59.739 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420456+0000", 2024-09-13T06:43:59.739 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5667000000000001e-05 2024-09-13T06:43:59.739 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:59.739 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:59.739 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:59.739 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420724+0000", 2024-09-13T06:43:59.739 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00026873400000000002 2024-09-13T06:43:59.739 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:59.740 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:59.740 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:43:59.740 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420740+0000", 2024-09-13T06:43:59.740 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5486999999999999e-05 2024-09-13T06:43:59.740 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:59.740 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:59.740 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:59.740 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.125004+0000", 2024-09-13T06:43:59.740 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7042643119999998 2024-09-13T06:43:59.740 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:59.740 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:59.740 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:59.740 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.125293+0000", 2024-09-13T06:43:59.740 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000288664 2024-09-13T06:43:59.741 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:59.741 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:59.741 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:59.741 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.125645+0000", 2024-09-13T06:43:59.741 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00035247700000000002 2024-09-13T06:43:59.741 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:59.741 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:59.741 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:59.741 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:59.741 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:59.741 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:208362 3.14 3:2d339b7f:::rbd_data.1121cb4a09ed.0000000000000003:snapdir [list-snaps] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e219)", 2024-09-13T06:43:59.741 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:43:03.420469+0000", 2024-09-13T06:43:59.741 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 56.308054974999997, 2024-09-13T06:43:59.742 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.706123917, 2024-09-13T06:43:59.742 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:59.742 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:59.742 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:59.742 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:59.742 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:59.742 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 208362 2024-09-13T06:43:59.742 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:59.742 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:59.742 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:59.742 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:59.742 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420469+0000", 2024-09-13T06:43:59.742 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:59.742 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:59.743 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:59.743 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:59.743 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420469+0000", 2024-09-13T06:43:59.743 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:59.743 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:59.743 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:59.743 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:59.743 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420468+0000", 2024-09-13T06:43:59.743 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:59.743 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:59.743 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:59.743 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:59.743 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420473+0000", 2024-09-13T06:43:59.743 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.7099999999999998e-06 2024-09-13T06:43:59.744 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:59.744 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:59.744 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:59.744 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420483+0000", 2024-09-13T06:43:59.744 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.7960000000000007e-06 2024-09-13T06:43:59.744 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:59.744 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:59.744 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:59.744 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420491+0000", 2024-09-13T06:43:59.744 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.8169999999999999e-06 2024-09-13T06:43:59.744 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:59.744 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:59.744 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:59.744 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420829+0000", 2024-09-13T06:43:59.745 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000338494 2024-09-13T06:43:59.745 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:59.745 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:59.745 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:43:59.745 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420857+0000", 2024-09-13T06:43:59.745 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.8140000000000002e-05 2024-09-13T06:43:59.745 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:59.745 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:59.745 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:59.745 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.126086+0000", 2024-09-13T06:43:59.745 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7052288369999999 2024-09-13T06:43:59.745 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:59.745 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:59.746 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:59.746 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.126269+0000", 2024-09-13T06:43:59.746 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000183301 2024-09-13T06:43:59.746 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:59.746 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:59.746 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:59.746 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.126593+0000", 2024-09-13T06:43:59.746 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00032352800000000001 2024-09-13T06:43:59.746 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:59.746 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:59.746 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:59.746 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:59.746 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:59.746 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:208369 3.14 3:2d339b7f:::rbd_data.1121cb4a09ed.0000000000000003:snapdir [list-snaps] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e219)", 2024-09-13T06:43:59.747 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:43:03.420498+0000", 2024-09-13T06:43:59.747 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 56.308025931000003, 2024-09-13T06:43:59.747 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.706613895, 2024-09-13T06:43:59.747 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:59.747 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:59.747 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:59.747 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:59.747 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:59.747 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 208369 2024-09-13T06:43:59.747 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:59.747 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:59.747 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:59.748 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:59.748 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420498+0000", 2024-09-13T06:43:59.748 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:59.748 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:59.748 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:59.748 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:59.748 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420498+0000", 2024-09-13T06:43:59.748 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:59.748 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:59.748 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:59.748 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:59.748 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420497+0000", 2024-09-13T06:43:59.748 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:59.749 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:59.749 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:59.749 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:59.749 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420501+0000", 2024-09-13T06:43:59.749 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.737e-06 2024-09-13T06:43:59.749 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:59.749 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:59.749 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:59.749 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420522+0000", 2024-09-13T06:43:59.749 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.1152999999999999e-05 2024-09-13T06:43:59.749 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:59.749 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:59.749 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:59.750 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420533+0000", 2024-09-13T06:43:59.750 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0366999999999999e-05 2024-09-13T06:43:59.750 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:59.750 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:59.750 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:59.750 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420968+0000", 2024-09-13T06:43:59.750 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00043495900000000001 2024-09-13T06:43:59.750 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:59.750 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:59.750 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:43:59.750 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420977+0000", 2024-09-13T06:43:59.750 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.8039999999999996e-06 2024-09-13T06:43:59.750 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:59.751 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:59.751 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:59.751 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.126670+0000", 2024-09-13T06:43:59.751 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7056928760000001 2024-09-13T06:43:59.751 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:59.751 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:59.751 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:59.751 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.126833+0000", 2024-09-13T06:43:59.751 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00016253200000000001 2024-09-13T06:43:59.751 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:59.751 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:59.751 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:59.751 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.127112+0000", 2024-09-13T06:43:59.751 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000279141 2024-09-13T06:43:59.752 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:59.752 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:59.752 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:59.752 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:59.752 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:59.752 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:208376 3.14 3:2d339b7f:::rbd_data.1121cb4a09ed.0000000000000003:snapdir [list-snaps] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e219)", 2024-09-13T06:43:59.752 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:43:03.420541+0000", 2024-09-13T06:43:59.752 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 56.307982674999998, 2024-09-13T06:43:59.752 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7070606820000001, 2024-09-13T06:43:59.752 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:59.752 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:59.752 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:59.752 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:59.753 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:59.753 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 208376 2024-09-13T06:43:59.753 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:59.753 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:59.753 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:59.753 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:59.753 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420541+0000", 2024-09-13T06:43:59.753 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:59.753 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:59.753 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:59.753 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:59.753 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420541+0000", 2024-09-13T06:43:59.753 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:59.754 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:59.754 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:59.754 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:59.754 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420541+0000", 2024-09-13T06:43:59.754 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:59.754 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:59.754 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:59.754 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:59.754 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420544+0000", 2024-09-13T06:43:59.754 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.5530000000000001e-06 2024-09-13T06:43:59.754 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:59.754 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:59.754 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:59.755 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420557+0000", 2024-09-13T06:43:59.755 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2663000000000001e-05 2024-09-13T06:43:59.755 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:59.755 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:59.755 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:59.755 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420572+0000", 2024-09-13T06:43:59.755 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5463000000000001e-05 2024-09-13T06:43:59.755 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:59.755 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:59.755 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:59.755 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.421070+0000", 2024-09-13T06:43:59.755 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00049723599999999997 2024-09-13T06:43:59.755 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:59.755 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:59.756 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:43:59.756 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.421092+0000", 2024-09-13T06:43:59.756 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.2354e-05 2024-09-13T06:43:59.756 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:59.756 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:59.756 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:59.756 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.127184+0000", 2024-09-13T06:43:59.756 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7060917330000001 2024-09-13T06:43:59.756 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:59.756 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:59.756 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:59.756 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.127340+0000", 2024-09-13T06:43:59.756 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00015640200000000001 2024-09-13T06:43:59.757 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:59.757 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:59.757 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:59.757 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.127602+0000", 2024-09-13T06:43:59.757 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00026192799999999998 2024-09-13T06:43:59.757 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:59.757 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:59.757 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:59.757 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:59.757 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:59.757 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:208383 3.14 3:2d339b7f:::rbd_data.1121cb4a09ed.0000000000000003:snapdir [list-snaps] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e219)", 2024-09-13T06:43:59.757 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:43:03.420585+0000", 2024-09-13T06:43:59.757 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 56.307938821999997, 2024-09-13T06:43:59.758 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.707457405, 2024-09-13T06:43:59.758 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:59.758 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:59.758 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:59.758 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:59.758 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:59.758 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 208383 2024-09-13T06:43:59.758 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:59.758 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:59.758 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:59.758 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:59.758 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420585+0000", 2024-09-13T06:43:59.758 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:59.758 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:59.759 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:59.759 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:59.759 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420585+0000", 2024-09-13T06:43:59.759 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:59.759 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:59.759 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:59.759 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:59.759 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420584+0000", 2024-09-13T06:43:59.759 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:43:59.759 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:59.759 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:59.759 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:59.759 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420614+0000", 2024-09-13T06:43:59.760 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.9886000000000002e-05 2024-09-13T06:43:59.760 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:59.760 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:59.760 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:59.760 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420640+0000", 2024-09-13T06:43:59.760 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.5663000000000001e-05 2024-09-13T06:43:59.760 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:59.760 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:59.760 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:59.760 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420669+0000", 2024-09-13T06:43:59.760 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.9289999999999999e-05 2024-09-13T06:43:59.760 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:59.760 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:59.761 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:59.761 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.421168+0000", 2024-09-13T06:43:59.761 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00049857600000000003 2024-09-13T06:43:59.761 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:59.761 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:59.761 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:43:59.761 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.421177+0000", 2024-09-13T06:43:59.761 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.533e-06 2024-09-13T06:43:59.761 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:59.761 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:59.761 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:59.761 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.127648+0000", 2024-09-13T06:43:59.761 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7064713569999999 2024-09-13T06:43:59.761 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:59.762 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:59.762 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:59.762 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.127794+0000", 2024-09-13T06:43:59.762 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00014589200000000001 2024-09-13T06:43:59.762 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:59.762 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:59.762 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:59.762 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.128043+0000", 2024-09-13T06:43:59.762 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00024821799999999997 2024-09-13T06:43:59.762 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:59.762 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:59.762 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:59.762 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:59.762 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:59.762 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:208390 3.14 3:2d339b7f:::rbd_data.1121cb4a09ed.0000000000000003:snapdir [list-snaps] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e219)", 2024-09-13T06:43:59.763 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:43:03.420713+0000", 2024-09-13T06:43:59.763 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 56.307810863, 2024-09-13T06:43:59.763 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7077568059999999, 2024-09-13T06:43:59.763 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:59.763 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:59.763 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:59.763 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:59.763 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:59.763 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 208390 2024-09-13T06:43:59.763 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:59.763 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:59.763 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:59.763 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:59.763 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420713+0000", 2024-09-13T06:43:59.764 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:59.764 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:59.764 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:59.764 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:59.764 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420713+0000", 2024-09-13T06:43:59.764 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:59.764 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:59.764 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:59.764 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:59.764 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420712+0000", 2024-09-13T06:43:59.764 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:43:59.764 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:59.764 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:59.764 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:59.765 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420719+0000", 2024-09-13T06:43:59.765 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.883e-06 2024-09-13T06:43:59.765 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:59.765 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:59.765 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:59.765 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420737+0000", 2024-09-13T06:43:59.765 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.8082999999999999e-05 2024-09-13T06:43:59.765 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:59.765 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:59.765 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:59.765 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420757+0000", 2024-09-13T06:43:59.765 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.0256999999999999e-05 2024-09-13T06:43:59.765 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:59.765 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:59.766 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:59.766 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.421258+0000", 2024-09-13T06:43:59.766 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00050028500000000005 2024-09-13T06:43:59.766 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:59.766 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:59.766 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:43:59.766 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.421282+0000", 2024-09-13T06:43:59.766 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.4236999999999999e-05 2024-09-13T06:43:59.766 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:59.766 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:59.766 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:59.766 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.128087+0000", 2024-09-13T06:43:59.766 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.706805551 2024-09-13T06:43:59.766 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:59.767 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:59.767 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:59.767 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.128231+0000", 2024-09-13T06:43:59.767 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00014348200000000001 2024-09-13T06:43:59.767 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:59.767 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:59.767 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:59.767 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.128470+0000", 2024-09-13T06:43:59.767 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000239058 2024-09-13T06:43:59.767 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:59.767 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:59.767 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:59.767 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:59.768 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:59.768 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:208397 3.14 3:2d339b7f:::rbd_data.1121cb4a09ed.0000000000000003:snapdir [list-snaps] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e219)", 2024-09-13T06:43:59.768 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:43:03.420772+0000", 2024-09-13T06:43:59.768 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 56.307751484000001, 2024-09-13T06:43:59.768 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7081308659999999, 2024-09-13T06:43:59.768 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:59.768 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:59.768 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:59.768 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:59.768 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:59.768 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 208397 2024-09-13T06:43:59.768 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:59.768 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:59.769 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:59.769 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:59.769 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420772+0000", 2024-09-13T06:43:59.769 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:59.769 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:59.769 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:59.769 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:59.769 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420772+0000", 2024-09-13T06:43:59.769 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:59.769 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:59.769 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:59.769 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:59.769 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420772+0000", 2024-09-13T06:43:59.770 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:43:59.770 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:59.770 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:59.770 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:59.770 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420777+0000", 2024-09-13T06:43:59.770 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.8329999999999999e-06 2024-09-13T06:43:59.770 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:59.770 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:59.770 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:59.770 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420795+0000", 2024-09-13T06:43:59.770 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7677e-05 2024-09-13T06:43:59.770 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:59.771 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:59.771 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:59.771 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420811+0000", 2024-09-13T06:43:59.771 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5673000000000001e-05 2024-09-13T06:43:59.771 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:59.771 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:59.771 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:59.771 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.421352+0000", 2024-09-13T06:43:59.771 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00054091199999999995 2024-09-13T06:43:59.771 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:59.771 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:59.772 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:43:59.772 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.421364+0000", 2024-09-13T06:43:59.772 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.182e-05 2024-09-13T06:43:59.772 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:59.772 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:59.772 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:59.772 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.128512+0000", 2024-09-13T06:43:59.772 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.707148584 2024-09-13T06:43:59.772 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:59.772 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:59.772 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:59.772 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.128653+0000", 2024-09-13T06:43:59.772 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00014127599999999999 2024-09-13T06:43:59.773 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:59.773 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:59.773 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:59.773 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.128903+0000", 2024-09-13T06:43:59.773 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000249941 2024-09-13T06:43:59.773 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:59.773 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:59.773 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:59.773 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:59.773 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:59.773 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:208404 3.14 3:2d339b7f:::rbd_data.1121cb4a09ed.0000000000000003:snapdir [list-snaps] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e219)", 2024-09-13T06:43:59.773 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:43:03.420837+0000", 2024-09-13T06:43:59.773 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 56.307686848000003, 2024-09-13T06:43:59.774 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.70849154, 2024-09-13T06:43:59.774 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:59.774 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:59.774 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:59.774 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:59.774 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:59.774 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 208404 2024-09-13T06:43:59.774 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:59.774 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:59.774 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:59.774 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:59.774 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420837+0000", 2024-09-13T06:43:59.774 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:59.775 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:59.775 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:59.775 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:59.775 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420837+0000", 2024-09-13T06:43:59.775 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:59.775 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:59.775 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:59.775 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:59.775 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420836+0000", 2024-09-13T06:43:59.775 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999986 2024-09-13T06:43:59.775 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:59.775 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:59.775 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:59.776 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420842+0000", 2024-09-13T06:43:59.776 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.4400000000000002e-06 2024-09-13T06:43:59.776 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:59.776 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:59.776 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:59.776 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420860+0000", 2024-09-13T06:43:59.776 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7487e-05 2024-09-13T06:43:59.776 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:59.776 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:59.776 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:59.776 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420916+0000", 2024-09-13T06:43:59.776 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.6276999999999997e-05 2024-09-13T06:43:59.777 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:59.777 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:59.777 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:59.777 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.421450+0000", 2024-09-13T06:43:59.777 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00053433500000000004 2024-09-13T06:43:59.777 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:59.777 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:59.777 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:43:59.777 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.421474+0000", 2024-09-13T06:43:59.777 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.3799e-05 2024-09-13T06:43:59.777 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:59.777 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:59.777 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:59.778 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.128945+0000", 2024-09-13T06:43:59.778 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.707470912 2024-09-13T06:43:59.778 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:59.778 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:59.778 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:59.778 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.129087+0000", 2024-09-13T06:43:59.778 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00014170900000000001 2024-09-13T06:43:59.778 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:59.778 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:59.778 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:59.778 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.129329+0000", 2024-09-13T06:43:59.778 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000241831 2024-09-13T06:43:59.778 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:59.779 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:59.779 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:59.779 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:59.779 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:59.779 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:208411 3.14 3:2d339b7f:::rbd_data.1121cb4a09ed.0000000000000003:snapdir [list-snaps] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e219)", 2024-09-13T06:43:59.779 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:43:03.420964+0000", 2024-09-13T06:43:59.779 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 56.307559615999999, 2024-09-13T06:43:59.779 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.708812754, 2024-09-13T06:43:59.779 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:59.779 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:59.779 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:59.779 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:59.779 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:59.779 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 208411 2024-09-13T06:43:59.780 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:59.780 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:59.780 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:59.780 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:59.780 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420964+0000", 2024-09-13T06:43:59.780 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:59.780 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:59.780 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:59.780 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:59.780 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420964+0000", 2024-09-13T06:43:59.780 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:59.780 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:59.780 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:59.781 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:59.781 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420963+0000", 2024-09-13T06:43:59.781 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:43:59.781 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:59.781 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:59.781 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:59.781 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420969+0000", 2024-09-13T06:43:59.781 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.7540000000000003e-06 2024-09-13T06:43:59.781 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:59.781 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:59.781 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:59.781 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420979+0000", 2024-09-13T06:43:59.781 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0067e-05 2024-09-13T06:43:59.782 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:59.782 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:59.782 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:59.782 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420987+0000", 2024-09-13T06:43:59.782 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.6990000000000003e-06 2024-09-13T06:43:59.782 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:59.782 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:59.782 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:59.782 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.421563+0000", 2024-09-13T06:43:59.782 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00057654899999999999 2024-09-13T06:43:59.782 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:59.782 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:59.782 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:43:59.783 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.421573+0000", 2024-09-13T06:43:59.783 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.9669999999999996e-06 2024-09-13T06:43:59.783 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:59.783 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:59.783 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:59.783 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.129372+0000", 2024-09-13T06:43:59.783 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.707798602 2024-09-13T06:43:59.783 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:59.783 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:59.783 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:59.783 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.129514+0000", 2024-09-13T06:43:59.783 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00014191200000000001 2024-09-13T06:43:59.783 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:59.783 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:59.783 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:59.784 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.129777+0000", 2024-09-13T06:43:59.784 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00026320100000000002 2024-09-13T06:43:59.784 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:59.784 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:59.784 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:59.784 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:59.784 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:59.784 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:208418 3.14 3:2d339b7f:::rbd_data.1121cb4a09ed.0000000000000003:snapdir [list-snaps] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e219)", 2024-09-13T06:43:59.784 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:43:03.421005+0000", 2024-09-13T06:43:59.784 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 56.307518532000003, 2024-09-13T06:43:59.784 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7096508159999999, 2024-09-13T06:43:59.784 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:59.784 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:59.785 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:59.785 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:59.785 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:59.785 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 208418 2024-09-13T06:43:59.785 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:59.785 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:59.785 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:59.785 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:59.785 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.421005+0000", 2024-09-13T06:43:59.785 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:59.785 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:59.785 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:59.785 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:59.786 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.421005+0000", 2024-09-13T06:43:59.786 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:59.786 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:59.786 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:59.786 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:59.786 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.421005+0000", 2024-09-13T06:43:59.786 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:43:59.786 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:59.786 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:59.786 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:59.786 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.421008+0000", 2024-09-13T06:43:59.786 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.2550000000000002e-06 2024-09-13T06:43:59.786 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:59.786 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:59.787 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:59.787 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.421015+0000", 2024-09-13T06:43:59.787 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.0600000000000002e-06 2024-09-13T06:43:59.787 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:59.787 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:59.787 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:59.787 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.421021+0000", 2024-09-13T06:43:59.787 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.8139999999999997e-06 2024-09-13T06:43:59.787 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:59.787 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:59.787 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:59.787 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.421638+0000", 2024-09-13T06:43:59.787 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00061702600000000001 2024-09-13T06:43:59.787 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:59.787 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:59.788 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:43:59.788 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.421659+0000", 2024-09-13T06:43:59.788 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.0894e-05 2024-09-13T06:43:59.788 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:59.788 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:59.788 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:59.788 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.129858+0000", 2024-09-13T06:43:59.788 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.708198632 2024-09-13T06:43:59.788 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:59.788 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:59.788 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:59.788 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.130158+0000", 2024-09-13T06:43:59.789 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00030000099999999999 2024-09-13T06:43:59.789 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:59.789 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:59.789 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:59.789 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.130656+0000", 2024-09-13T06:43:59.789 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00049864199999999999 2024-09-13T06:43:59.789 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:59.789 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:59.789 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:59.789 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:59.789 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:59.789 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:209008 3.3 3:c6ff3074:::rbd_data.1121cb4a09ed.0000000000000001:82 [read 397312~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e220)", 2024-09-13T06:43:59.789 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:43:05.165956+0000", 2024-09-13T06:43:59.790 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 54.562568222000003, 2024-09-13T06:43:59.790 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.120605692, 2024-09-13T06:43:59.790 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:59.790 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:59.790 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:59.790 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:59.790 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:59.790 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 209008 2024-09-13T06:43:59.790 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:59.790 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:59.790 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:59.790 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:59.790 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.165956+0000", 2024-09-13T06:43:59.791 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:59.791 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:59.791 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:59.791 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:59.791 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.165956+0000", 2024-09-13T06:43:59.791 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:59.791 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:59.791 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:59.791 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:59.791 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.165955+0000", 2024-09-13T06:43:59.791 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:43:59.791 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:59.791 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:59.791 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:59.792 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.165960+0000", 2024-09-13T06:43:59.792 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.6200000000000004e-06 2024-09-13T06:43:59.792 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:59.792 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:59.792 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:59.792 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.165998+0000", 2024-09-13T06:43:59.792 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.7703000000000001e-05 2024-09-13T06:43:59.792 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:59.792 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:59.792 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:59.792 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.166012+0000", 2024-09-13T06:43:59.792 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3682999999999999e-05 2024-09-13T06:43:59.793 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:59.793 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:59.793 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:59.793 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.286043+0000", 2024-09-13T06:43:59.793 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.120030867 2024-09-13T06:43:59.793 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:59.793 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:59.793 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:59.793 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.286196+0000", 2024-09-13T06:43:59.793 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000153759 2024-09-13T06:43:59.793 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:59.794 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:59.794 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:59.794 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.286561+0000", 2024-09-13T06:43:59.794 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00036504700000000002 2024-09-13T06:43:59.794 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:59.794 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:59.794 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:59.794 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:59.794 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:59.794 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:209009 3.3 3:c6ff3074:::rbd_data.1121cb4a09ed.0000000000000001:82 [read 409600~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e220)", 2024-09-13T06:43:59.794 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:43:05.166111+0000", 2024-09-13T06:43:59.794 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 54.562412577000003, 2024-09-13T06:43:59.794 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.121025172, 2024-09-13T06:43:59.794 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:59.794 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:59.795 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:59.795 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:59.795 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:59.795 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 209009 2024-09-13T06:43:59.795 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:59.795 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:59.795 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:59.795 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:59.795 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.166111+0000", 2024-09-13T06:43:59.795 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:59.795 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:59.795 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:59.795 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:59.796 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.166111+0000", 2024-09-13T06:43:59.796 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:59.796 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:59.796 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:59.796 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:59.796 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.166023+0000", 2024-09-13T06:43:59.796 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999113 2024-09-13T06:43:59.796 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:59.796 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:59.796 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:59.796 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.166118+0000", 2024-09-13T06:43:59.796 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.5818999999999999e-05 2024-09-13T06:43:59.796 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:59.796 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:59.796 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:59.797 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.166145+0000", 2024-09-13T06:43:59.797 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.6679999999999999e-05 2024-09-13T06:43:59.797 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:59.797 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:59.797 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:59.797 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.166162+0000", 2024-09-13T06:43:59.797 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6413e-05 2024-09-13T06:43:59.797 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:59.797 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:59.797 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:59.797 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.286636+0000", 2024-09-13T06:43:59.797 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.120474003 2024-09-13T06:43:59.797 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:59.797 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:59.798 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:59.798 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.286799+0000", 2024-09-13T06:43:59.798 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00016363900000000001 2024-09-13T06:43:59.798 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:59.798 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:59.798 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:59.798 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.287137+0000", 2024-09-13T06:43:59.798 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00033736699999999998 2024-09-13T06:43:59.798 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:59.798 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:59.798 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:59.798 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:59.798 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:59.798 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:209010 3.3 3:c6ff3074:::rbd_data.1121cb4a09ed.0000000000000001:82 [read 421888~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e220)", 2024-09-13T06:43:59.798 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:43:05.167018+0000", 2024-09-13T06:43:59.799 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 54.561506397999999, 2024-09-13T06:43:59.799 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.120709894, 2024-09-13T06:43:59.799 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:59.799 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:59.799 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:59.799 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:59.799 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:59.799 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 209010 2024-09-13T06:43:59.799 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:59.799 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:59.799 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:59.799 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:59.799 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.167018+0000", 2024-09-13T06:43:59.799 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:59.800 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:59.800 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:59.800 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:59.800 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.167018+0000", 2024-09-13T06:43:59.800 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:59.800 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:59.800 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:59.800 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:59.800 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.166214+0000", 2024-09-13T06:43:59.800 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9991961 2024-09-13T06:43:59.800 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:59.800 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:59.800 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:59.801 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.167039+0000", 2024-09-13T06:43:59.801 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00082531599999999998 2024-09-13T06:43:59.801 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:59.801 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:59.801 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:59.801 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.167083+0000", 2024-09-13T06:43:59.801 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.4079999999999998e-05 2024-09-13T06:43:59.801 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:59.801 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:59.801 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:59.801 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.167113+0000", 2024-09-13T06:43:59.801 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.025e-05 2024-09-13T06:43:59.801 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:59.802 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:59.802 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:59.802 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.287229+0000", 2024-09-13T06:43:59.802 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.12011563 2024-09-13T06:43:59.802 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:59.802 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:59.802 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:59.802 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.287369+0000", 2024-09-13T06:43:59.802 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00014040499999999999 2024-09-13T06:43:59.802 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:59.802 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:59.802 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:59.802 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.287727+0000", 2024-09-13T06:43:59.802 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000358043 2024-09-13T06:43:59.803 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:59.803 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:59.803 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:59.803 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:59.803 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:59.803 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:209011 3.3 3:c6ff3074:::rbd_data.1121cb4a09ed.0000000000000001:82 [read 434176~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e220)", 2024-09-13T06:43:59.803 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:43:05.167765+0000", 2024-09-13T06:43:59.803 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 54.560758903999997, 2024-09-13T06:43:59.803 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.12054767199999999, 2024-09-13T06:43:59.803 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:59.803 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:59.803 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:59.803 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:59.803 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:59.803 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 209011 2024-09-13T06:43:59.804 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:59.804 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:59.804 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:59.804 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:59.804 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.167765+0000", 2024-09-13T06:43:59.804 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:59.804 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:59.804 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:59.804 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:59.804 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.167765+0000", 2024-09-13T06:43:59.804 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:59.804 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:59.804 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:59.804 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:59.804 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.167131+0000", 2024-09-13T06:43:59.805 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9993658 2024-09-13T06:43:59.805 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:59.805 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:59.805 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:59.805 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.167772+0000", 2024-09-13T06:43:59.805 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00064152399999999998 2024-09-13T06:43:59.805 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:59.805 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:59.805 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:59.805 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.167791+0000", 2024-09-13T06:43:59.805 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.8944e-05 2024-09-13T06:43:59.805 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:59.805 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:59.805 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:59.806 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.167805+0000", 2024-09-13T06:43:59.806 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.395e-05 2024-09-13T06:43:59.806 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:59.806 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:59.806 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:59.806 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.287803+0000", 2024-09-13T06:43:59.806 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.11999747099999999 2024-09-13T06:43:59.806 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:59.806 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:59.806 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:59.806 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.287964+0000", 2024-09-13T06:43:59.806 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00016155100000000001 2024-09-13T06:43:59.806 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:59.806 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:59.807 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:59.807 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.288313+0000", 2024-09-13T06:43:59.807 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00034865699999999999 2024-09-13T06:43:59.807 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:59.807 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:59.807 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:59.807 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:59.807 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:59.807 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:209013 3.3 3:c6ff3074:::rbd_data.1121cb4a09ed.0000000000000001:82 [read 458752~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e220)", 2024-09-13T06:43:59.807 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:43:05.168880+0000", 2024-09-13T06:43:59.807 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 54.559643819999998, 2024-09-13T06:43:59.807 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.120462023, 2024-09-13T06:43:59.807 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:59.807 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:59.808 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:59.808 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:59.808 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:59.808 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 209013 2024-09-13T06:43:59.808 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:59.808 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:59.808 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:59.808 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:59.808 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.168880+0000", 2024-09-13T06:43:59.808 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:59.808 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:59.808 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:59.808 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:59.809 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.168880+0000", 2024-09-13T06:43:59.809 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:59.809 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:59.809 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:59.809 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:59.809 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.168879+0000", 2024-09-13T06:43:59.809 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999986 2024-09-13T06:43:59.809 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:59.809 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:59.809 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:59.809 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.168888+0000", 2024-09-13T06:43:59.809 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.9930000000000001e-06 2024-09-13T06:43:59.809 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:59.809 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:59.810 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:59.810 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.168908+0000", 2024-09-13T06:43:59.810 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.0276999999999999e-05 2024-09-13T06:43:59.810 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:59.810 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:59.810 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:59.810 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.168923+0000", 2024-09-13T06:43:59.810 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5543e-05 2024-09-13T06:43:59.810 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:59.810 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:59.810 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:59.810 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.288875+0000", 2024-09-13T06:43:59.810 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.119951748 2024-09-13T06:43:59.810 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:59.811 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:59.811 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:59.811 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.289007+0000", 2024-09-13T06:43:59.811 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00013142899999999999 2024-09-13T06:43:59.811 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:59.811 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:59.811 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:59.811 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.289342+0000", 2024-09-13T06:43:59.811 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00033566999999999999 2024-09-13T06:43:59.811 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:59.811 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:59.811 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:59.811 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:59.811 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:59.812 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:209014 3.3 3:c6ff3074:::rbd_data.1121cb4a09ed.0000000000000001:82 [read 471040~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e220)", 2024-09-13T06:43:59.812 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:43:05.169105+0000", 2024-09-13T06:43:59.812 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 54.559419362, 2024-09-13T06:43:59.812 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.12087680000000001, 2024-09-13T06:43:59.812 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:59.812 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:59.812 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:59.812 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:59.812 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:59.812 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 209014 2024-09-13T06:43:59.812 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:59.812 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:59.812 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:59.813 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:59.813 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.169105+0000", 2024-09-13T06:43:59.813 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:59.813 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:59.813 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:59.813 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:59.813 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.169105+0000", 2024-09-13T06:43:59.813 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:59.813 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:59.813 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:59.813 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:59.813 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.168936+0000", 2024-09-13T06:43:59.813 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9998312 2024-09-13T06:43:59.813 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:59.814 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:59.814 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:59.814 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.169115+0000", 2024-09-13T06:43:59.814 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00017854500000000001 2024-09-13T06:43:59.814 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:59.814 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:59.814 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:59.814 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.169140+0000", 2024-09-13T06:43:59.814 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.5853000000000001e-05 2024-09-13T06:43:59.814 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:59.814 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:59.814 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:59.814 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.169160+0000", 2024-09-13T06:43:59.815 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.9415999999999998e-05 2024-09-13T06:43:59.815 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:59.815 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:59.815 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:59.815 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.289414+0000", 2024-09-13T06:43:59.815 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.120253785 2024-09-13T06:43:59.815 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:59.815 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:59.815 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:59.815 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.289579+0000", 2024-09-13T06:43:59.815 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00016506299999999999 2024-09-13T06:43:59.815 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:59.815 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:59.815 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:59.816 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.289981+0000", 2024-09-13T06:43:59.816 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000402743 2024-09-13T06:43:59.816 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:59.816 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:59.816 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:59.816 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:59.816 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:59.816 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:209015 3.3 3:c6ff3074:::rbd_data.1121cb4a09ed.0000000000000001:82 [read 483328~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e220)", 2024-09-13T06:43:59.816 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:43:05.169496+0000", 2024-09-13T06:43:59.816 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 54.559028312000002, 2024-09-13T06:43:59.816 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.12105229200000001, 2024-09-13T06:43:59.816 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:59.816 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:59.817 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:59.817 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:59.817 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:59.817 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 209015 2024-09-13T06:43:59.817 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:59.817 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:59.817 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:59.817 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:59.817 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.169496+0000", 2024-09-13T06:43:59.817 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:59.817 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:59.817 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:59.817 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:59.818 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.169496+0000", 2024-09-13T06:43:59.818 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:59.818 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:59.818 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:59.818 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:59.818 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.169177+0000", 2024-09-13T06:43:59.818 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999681 2024-09-13T06:43:59.818 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:59.818 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:59.818 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:59.818 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.169509+0000", 2024-09-13T06:43:59.818 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00033226099999999998 2024-09-13T06:43:59.818 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:59.819 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:59.819 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:59.819 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.169544+0000", 2024-09-13T06:43:59.819 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.5573e-05 2024-09-13T06:43:59.819 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:59.819 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:59.819 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:59.819 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.169560+0000", 2024-09-13T06:43:59.819 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5636000000000001e-05 2024-09-13T06:43:59.819 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:59.819 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:59.819 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:59.819 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.290055+0000", 2024-09-13T06:43:59.819 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.12049523400000001 2024-09-13T06:43:59.820 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:59.820 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:59.820 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:59.820 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.290201+0000", 2024-09-13T06:43:59.820 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000145742 2024-09-13T06:43:59.820 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:59.820 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:59.820 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:59.820 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.290548+0000", 2024-09-13T06:43:59.820 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00034698699999999999 2024-09-13T06:43:59.820 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:59.820 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:59.821 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:59.821 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:59.821 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:59.821 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:209016 3.3 3:c6ff3074:::rbd_data.1121cb4a09ed.0000000000000001:82 [read 495616~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e220)", 2024-09-13T06:43:59.821 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:43:05.169893+0000", 2024-09-13T06:43:59.821 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 54.558630798999999, 2024-09-13T06:43:59.821 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.121278814, 2024-09-13T06:43:59.821 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:59.821 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:59.821 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:59.821 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:59.821 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:59.821 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 209016 2024-09-13T06:43:59.821 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:59.822 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:59.822 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:59.822 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:59.822 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.169893+0000", 2024-09-13T06:43:59.822 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:59.822 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:59.822 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:59.822 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:59.822 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.169893+0000", 2024-09-13T06:43:59.822 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:59.822 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:59.822 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:59.822 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:59.823 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.169572+0000", 2024-09-13T06:43:59.823 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9996786 2024-09-13T06:43:59.823 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:59.823 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:59.823 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:59.823 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.169903+0000", 2024-09-13T06:43:59.823 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00033101400000000003 2024-09-13T06:43:59.823 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:59.823 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:59.823 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:59.823 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.169933+0000", 2024-09-13T06:43:59.823 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.9913e-05 2024-09-13T06:43:59.823 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:59.824 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:59.824 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:59.824 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.169949+0000", 2024-09-13T06:43:59.824 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6313000000000001e-05 2024-09-13T06:43:59.824 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:59.824 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:59.824 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:59.824 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.290622+0000", 2024-09-13T06:43:59.824 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.120672795 2024-09-13T06:43:59.824 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:59.824 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:59.824 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:59.824 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.290788+0000", 2024-09-13T06:43:59.825 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00016597899999999999 2024-09-13T06:43:59.825 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:59.825 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:59.825 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:59.825 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.291172+0000", 2024-09-13T06:43:59.825 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00038422700000000001 2024-09-13T06:43:59.825 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:59.825 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:59.825 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:59.825 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:59.825 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:59.825 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:242330 3.1a 3:5cea7035:::rbd_info:head [call rbd.metadata_list in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e251)", 2024-09-13T06:43:59.825 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:43:36.447499+0000", 2024-09-13T06:43:59.825 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 23.281025020000001, 2024-09-13T06:43:59.826 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.97783059900000002, 2024-09-13T06:43:59.826 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:43:59.826 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:43:59.826 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:43:59.826 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:43:59.826 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:43:59.826 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 242330 2024-09-13T06:43:59.826 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:59.826 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:43:59.826 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:59.826 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:43:59.826 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:36.447499+0000", 2024-09-13T06:43:59.826 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:59.826 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:59.827 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:59.827 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:43:59.827 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:36.447499+0000", 2024-09-13T06:43:59.827 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:43:59.827 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:59.827 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:59.827 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:43:59.827 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:36.447497+0000", 2024-09-13T06:43:59.827 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999976 2024-09-13T06:43:59.827 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:59.827 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:59.827 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:43:59.827 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:36.447510+0000", 2024-09-13T06:43:59.828 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3298999999999999e-05 2024-09-13T06:43:59.828 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:59.828 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:59.828 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:43:59.828 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:36.447542+0000", 2024-09-13T06:43:59.828 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.163e-05 2024-09-13T06:43:59.828 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:59.828 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:59.828 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:43:59.828 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:36.447556+0000", 2024-09-13T06:43:59.828 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.4416999999999999e-05 2024-09-13T06:43:59.828 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:59.828 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:59.829 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:59.829 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:36.447667+0000", 2024-09-13T06:43:59.829 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000110886 2024-09-13T06:43:59.829 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:59.829 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:59.829 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:43:59.829 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:36.447688+0000", 2024-09-13T06:43:59.829 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.0656e-05 2024-09-13T06:43:59.829 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:59.829 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:59.829 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:43:59.829 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:37.424923+0000", 2024-09-13T06:43:59.829 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.97723487399999998 2024-09-13T06:43:59.830 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:59.830 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:59.830 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:43:59.830 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:37.425107+0000", 2024-09-13T06:43:59.830 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00018405900000000001 2024-09-13T06:43:59.830 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:43:59.830 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:43:59.830 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:43:59.830 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:37.425330+0000", 2024-09-13T06:43:59.830 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00022296800000000001 2024-09-13T06:43:59.830 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:59.830 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:59.830 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:59.830 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:43:59.830 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:43:59.831 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:43:59.832 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-13T06:43:59.833 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:43:59.831+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:43:59.933 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:43:59.931+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:43:59.957 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:43:59.958 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [], 2024-09-13T06:43:59.958 INFO:teuthology.orchestra.run.smithi139.stdout: "num_ops": 0 2024-09-13T06:43:59.958 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:43:59.972 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-13T06:44:00.034 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:44:00.031+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:44:00.094 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:44:00.094 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [], 2024-09-13T06:44:00.094 INFO:teuthology.orchestra.run.smithi139.stdout: "complaint_time": 30, 2024-09-13T06:44:00.094 INFO:teuthology.orchestra.run.smithi139.stdout: "num_blocked_ops": 0 2024-09-13T06:44:00.094 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:44:00.108 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-13T06:44:00.155 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:44:00.156+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:44:00.230 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:44:00.230 INFO:teuthology.orchestra.run.smithi139.stdout: "size": 20, 2024-09-13T06:44:00.230 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 600, 2024-09-13T06:44:00.230 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [ 2024-09-13T06:44:00.230 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:00.230 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43299 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 432128~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:44:00.230 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589881+0000", 2024-09-13T06:44:00.230 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 218.63867841000001, 2024-09-13T06:44:00.230 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.079693849999999997, 2024-09-13T06:44:00.231 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:44:00.231 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:44:00.231 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:44:00.231 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:44:00.231 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:44:00.231 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43299 2024-09-13T06:44:00.231 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:00.231 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:44:00.231 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:00.231 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:44:00.231 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589881+0000", 2024-09-13T06:44:00.231 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:44:00.231 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:00.231 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:00.232 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:44:00.232 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589881+0000", 2024-09-13T06:44:00.232 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:44:00.232 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:00.232 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:00.232 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:44:00.232 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589880+0000", 2024-09-13T06:44:00.232 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:44:00.232 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:00.232 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:00.232 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:44:00.232 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589884+0000", 2024-09-13T06:44:00.232 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.053e-06 2024-09-13T06:44:00.233 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:00.233 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:00.233 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:44:00.233 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589893+0000", 2024-09-13T06:44:00.233 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.2129999999999997e-06 2024-09-13T06:44:00.233 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:00.233 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:00.233 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:44:00.233 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589901+0000", 2024-09-13T06:44:00.233 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.6399999999999997e-06 2024-09-13T06:44:00.233 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:00.233 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:00.234 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:44:00.234 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.669213+0000", 2024-09-13T06:44:00.234 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.079312074999999996 2024-09-13T06:44:00.234 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:00.234 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:00.234 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:44:00.234 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.669281+0000", 2024-09-13T06:44:00.234 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.8322000000000001e-05 2024-09-13T06:44:00.234 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:00.234 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:00.234 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:44:00.234 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.669575+0000", 2024-09-13T06:44:00.234 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00029349699999999999 2024-09-13T06:44:00.235 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:44:00.235 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:44:00.235 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:44:00.235 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:00.235 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:00.235 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43300 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 446464~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:44:00.235 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589909+0000", 2024-09-13T06:44:00.235 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 218.63865051499999, 2024-09-13T06:44:00.235 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.080339496999999996, 2024-09-13T06:44:00.235 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:44:00.235 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:44:00.235 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:44:00.235 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:44:00.236 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:44:00.236 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43300 2024-09-13T06:44:00.236 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:00.236 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:44:00.236 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:00.236 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:44:00.236 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589909+0000", 2024-09-13T06:44:00.236 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:44:00.236 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:00.236 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:00.236 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:44:00.236 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589909+0000", 2024-09-13T06:44:00.236 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:44:00.237 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:00.237 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:00.237 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:44:00.237 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589908+0000", 2024-09-13T06:44:00.237 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:44:00.237 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:00.237 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:00.237 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:44:00.237 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589912+0000", 2024-09-13T06:44:00.237 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.9430000000000002e-06 2024-09-13T06:44:00.237 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:00.237 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:00.237 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:44:00.238 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589920+0000", 2024-09-13T06:44:00.238 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.3860000000000007e-06 2024-09-13T06:44:00.238 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:00.238 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:00.238 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:44:00.238 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589928+0000", 2024-09-13T06:44:00.238 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.3329999999999999e-06 2024-09-13T06:44:00.238 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:00.238 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:00.238 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:44:00.238 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.669651+0000", 2024-09-13T06:44:00.238 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.079723204000000006 2024-09-13T06:44:00.238 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:00.239 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:00.239 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:44:00.239 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.669840+0000", 2024-09-13T06:44:00.239 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000189397 2024-09-13T06:44:00.239 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:00.239 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:00.239 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:44:00.239 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.670248+0000", 2024-09-13T06:44:00.239 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00040811100000000001 2024-09-13T06:44:00.239 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:44:00.239 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:44:00.239 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:44:00.239 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:00.240 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:00.240 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43301 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 460800~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:44:00.240 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589934+0000", 2024-09-13T06:44:00.240 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 218.63862584099999, 2024-09-13T06:44:00.240 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.080747474999999999, 2024-09-13T06:44:00.240 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:44:00.240 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:44:00.240 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:44:00.240 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:44:00.240 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:44:00.240 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43301 2024-09-13T06:44:00.240 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:00.240 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:44:00.241 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:00.241 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:44:00.241 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589934+0000", 2024-09-13T06:44:00.241 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:44:00.241 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:00.241 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:00.241 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:44:00.241 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589934+0000", 2024-09-13T06:44:00.241 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:44:00.241 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:00.241 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:00.241 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:44:00.241 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589933+0000", 2024-09-13T06:44:00.242 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:44:00.242 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:00.242 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:00.242 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:44:00.242 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589936+0000", 2024-09-13T06:44:00.242 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.4599999999999999e-06 2024-09-13T06:44:00.242 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:00.242 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:00.242 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:44:00.242 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589945+0000", 2024-09-13T06:44:00.242 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.2430000000000005e-06 2024-09-13T06:44:00.242 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:00.242 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:00.243 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:44:00.243 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589952+0000", 2024-09-13T06:44:00.243 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.3289999999999996e-06 2024-09-13T06:44:00.243 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:00.243 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:00.243 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:44:00.243 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.670280+0000", 2024-09-13T06:44:00.243 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.080328514000000004 2024-09-13T06:44:00.243 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:00.243 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:00.243 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:44:00.243 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.670376+0000", 2024-09-13T06:44:00.244 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.5752000000000001e-05 2024-09-13T06:44:00.244 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:00.244 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:00.244 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:44:00.244 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.670681+0000", 2024-09-13T06:44:00.244 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00030479699999999999 2024-09-13T06:44:00.244 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:44:00.244 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:44:00.244 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:44:00.244 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:00.244 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:00.244 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43302 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 475136~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:44:00.244 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589958+0000", 2024-09-13T06:44:00.244 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 218.638601779, 2024-09-13T06:44:00.245 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.081402394000000003, 2024-09-13T06:44:00.245 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:44:00.245 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:44:00.245 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:44:00.245 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:44:00.245 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:44:00.245 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43302 2024-09-13T06:44:00.245 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:00.245 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:44:00.245 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:00.245 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:44:00.245 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589958+0000", 2024-09-13T06:44:00.245 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:44:00.246 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:00.246 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:00.246 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:44:00.246 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589958+0000", 2024-09-13T06:44:00.246 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:44:00.246 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:00.246 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:00.246 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:44:00.246 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589957+0000", 2024-09-13T06:44:00.246 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:44:00.246 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:00.246 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:00.246 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:44:00.246 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589960+0000", 2024-09-13T06:44:00.246 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.4939999999999999e-06 2024-09-13T06:44:00.247 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:00.247 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:00.247 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:44:00.247 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589969+0000", 2024-09-13T06:44:00.247 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.3520000000000007e-06 2024-09-13T06:44:00.247 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:00.247 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:00.247 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:44:00.247 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589976+0000", 2024-09-13T06:44:00.247 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.3030000000000002e-06 2024-09-13T06:44:00.247 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:00.247 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:00.247 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:44:00.247 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.670765+0000", 2024-09-13T06:44:00.248 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.080789154000000002 2024-09-13T06:44:00.248 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:00.248 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:00.248 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:44:00.248 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.670960+0000", 2024-09-13T06:44:00.248 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00019464300000000001 2024-09-13T06:44:00.248 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:00.248 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:00.248 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:44:00.248 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.671360+0000", 2024-09-13T06:44:00.248 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00040005200000000002 2024-09-13T06:44:00.248 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:44:00.248 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:44:00.249 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:44:00.249 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:00.249 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:00.249 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43303 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 489472~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:44:00.249 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589985+0000", 2024-09-13T06:44:00.249 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 218.638574831, 2024-09-13T06:44:00.249 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.082024333000000005, 2024-09-13T06:44:00.249 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:44:00.249 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:44:00.249 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:44:00.249 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:44:00.249 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:44:00.250 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43303 2024-09-13T06:44:00.250 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:00.250 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:44:00.250 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:00.250 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:44:00.250 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589985+0000", 2024-09-13T06:44:00.250 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:44:00.250 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:00.250 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:00.250 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:44:00.250 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589985+0000", 2024-09-13T06:44:00.250 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:44:00.250 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:00.250 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:00.251 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:44:00.251 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589984+0000", 2024-09-13T06:44:00.251 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:44:00.251 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:00.251 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:00.251 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:44:00.251 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589987+0000", 2024-09-13T06:44:00.251 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.726e-06 2024-09-13T06:44:00.251 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:00.251 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:00.251 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:44:00.251 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589996+0000", 2024-09-13T06:44:00.251 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.5459999999999992e-06 2024-09-13T06:44:00.251 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:00.251 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:00.252 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:44:00.252 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590003+0000", 2024-09-13T06:44:00.252 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.4229999999999999e-06 2024-09-13T06:44:00.252 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:00.252 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:00.252 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:44:00.252 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.671426+0000", 2024-09-13T06:44:00.252 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.081422704999999998 2024-09-13T06:44:00.252 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:00.252 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:00.252 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:44:00.252 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.671615+0000", 2024-09-13T06:44:00.252 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000188875 2024-09-13T06:44:00.252 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:00.252 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:00.253 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:44:00.253 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.672009+0000", 2024-09-13T06:44:00.253 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000394015 2024-09-13T06:44:00.253 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:44:00.253 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:44:00.253 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:44:00.253 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:00.253 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:00.253 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43304 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 503808~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:44:00.253 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.590039+0000", 2024-09-13T06:44:00.253 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 218.63852028599999, 2024-09-13T06:44:00.253 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.082573880000000002, 2024-09-13T06:44:00.253 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:44:00.254 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:44:00.254 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:44:00.254 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:44:00.254 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:44:00.254 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43304 2024-09-13T06:44:00.254 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:00.254 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:44:00.254 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:00.254 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:44:00.254 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590039+0000", 2024-09-13T06:44:00.254 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:44:00.254 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:00.254 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:00.254 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:44:00.255 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590039+0000", 2024-09-13T06:44:00.255 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:44:00.255 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:00.255 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:00.255 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:44:00.255 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590038+0000", 2024-09-13T06:44:00.255 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:44:00.255 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:00.255 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:00.255 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:44:00.255 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590042+0000", 2024-09-13T06:44:00.255 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.9500000000000003e-06 2024-09-13T06:44:00.255 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:00.255 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:00.255 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:44:00.256 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590052+0000", 2024-09-13T06:44:00.256 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.3919999999999992e-06 2024-09-13T06:44:00.256 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:00.256 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:00.256 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:44:00.256 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590059+0000", 2024-09-13T06:44:00.256 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.7970000000000001e-06 2024-09-13T06:44:00.256 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:00.256 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:00.256 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:44:00.256 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.672078+0000", 2024-09-13T06:44:00.256 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.082018778000000001 2024-09-13T06:44:00.256 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:00.256 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:00.257 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:44:00.257 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.672266+0000", 2024-09-13T06:44:00.257 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00018807399999999999 2024-09-13T06:44:00.257 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:00.257 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:00.257 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:44:00.257 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.672613+0000", 2024-09-13T06:44:00.257 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00034677599999999997 2024-09-13T06:44:00.257 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:44:00.257 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:44:00.257 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:44:00.257 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:00.257 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:00.257 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43305 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 518144~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:44:00.258 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.590136+0000", 2024-09-13T06:44:00.258 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 218.638423098, 2024-09-13T06:44:00.258 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.082988206999999994, 2024-09-13T06:44:00.258 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:44:00.258 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:44:00.258 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:44:00.258 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:44:00.258 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:44:00.258 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43305 2024-09-13T06:44:00.258 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:00.258 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:44:00.258 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:00.258 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:44:00.258 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590136+0000", 2024-09-13T06:44:00.259 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:44:00.259 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:00.259 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:00.259 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:44:00.259 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590136+0000", 2024-09-13T06:44:00.259 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:44:00.259 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:00.259 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:00.259 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:44:00.259 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590135+0000", 2024-09-13T06:44:00.259 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:44:00.259 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:00.259 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:00.260 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:44:00.260 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590139+0000", 2024-09-13T06:44:00.260 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.9489999999999998e-06 2024-09-13T06:44:00.260 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:00.260 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:00.260 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:44:00.260 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590148+0000", 2024-09-13T06:44:00.260 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.9830000000000002e-06 2024-09-13T06:44:00.260 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:00.260 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:00.260 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:44:00.260 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590156+0000", 2024-09-13T06:44:00.260 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5229999999999998e-06 2024-09-13T06:44:00.261 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:00.261 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:00.261 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:44:00.261 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.672709+0000", 2024-09-13T06:44:00.261 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.082552886000000006 2024-09-13T06:44:00.261 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:00.261 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:00.261 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:44:00.261 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.672816+0000", 2024-09-13T06:44:00.261 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000107736 2024-09-13T06:44:00.261 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:00.261 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:00.261 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:44:00.261 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.673124+0000", 2024-09-13T06:44:00.262 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00030804900000000002 2024-09-13T06:44:00.262 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:44:00.262 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:44:00.262 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:44:00.262 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:00.262 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:00.262 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:66818 3.17 3.50afe697 (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e100)", 2024-09-13T06:44:00.262 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:53.498942+0000", 2024-09-13T06:44:00.262 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 186.729616913, 2024-09-13T06:44:00.262 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.011231284, 2024-09-13T06:44:00.262 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:44:00.262 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:44:00.262 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:44:00.263 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:44:00.263 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:44:00.263 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 66818 2024-09-13T06:44:00.263 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:00.263 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:44:00.263 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:00.263 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:44:00.263 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:53.498942+0000", 2024-09-13T06:44:00.263 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:44:00.263 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:00.263 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:00.263 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:44:00.263 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:53.498942+0000", 2024-09-13T06:44:00.264 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:44:00.264 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:00.264 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:00.264 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:44:00.264 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:53.498939+0000", 2024-09-13T06:44:00.264 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999967 2024-09-13T06:44:00.264 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:00.264 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:00.264 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:44:00.264 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:53.498954+0000", 2024-09-13T06:44:00.264 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5028000000000001e-05 2024-09-13T06:44:00.264 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:00.264 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:00.265 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:44:00.265 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:53.498986+0000", 2024-09-13T06:44:00.265 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.1993999999999999e-05 2024-09-13T06:44:00.265 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:00.265 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:00.265 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:44:00.265 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:53.499001+0000", 2024-09-13T06:44:00.265 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5166e-05 2024-09-13T06:44:00.265 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:00.265 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:00.265 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:44:00.265 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:53.505097+0000", 2024-09-13T06:44:00.265 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0060955610000000002 2024-09-13T06:44:00.266 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:00.266 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:00.266 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:44:00.266 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:53.505108+0000", 2024-09-13T06:44:00.266 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.084e-05 2024-09-13T06:44:00.266 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:00.266 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:00.266 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:44:00.266 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:54.510158+0000", 2024-09-13T06:44:00.266 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0050497549999999 2024-09-13T06:44:00.266 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:00.266 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:00.266 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:44:00.266 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:54.510174+0000", 2024-09-13T06:44:00.266 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6164e-05 2024-09-13T06:44:00.267 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:44:00.267 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:44:00.267 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:44:00.267 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:00.267 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:00.267 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:69764 3.2 3:47f10058:::rbd_data.11214956a993.0000000000000004:head [write-same] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e117)", 2024-09-13T06:44:00.267 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:41:11.371147+0000", 2024-09-13T06:44:00.267 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 168.857412603, 2024-09-13T06:44:00.267 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.03470167, 2024-09-13T06:44:00.267 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:44:00.267 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:44:00.267 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:44:00.267 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:44:00.267 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:44:00.268 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 69764 2024-09-13T06:44:00.268 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:00.268 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:44:00.268 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:00.268 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:44:00.268 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:11.371147+0000", 2024-09-13T06:44:00.268 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:44:00.268 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:00.268 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:00.268 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:44:00.268 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:11.371147+0000", 2024-09-13T06:44:00.268 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:44:00.268 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:00.268 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:00.269 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:44:00.269 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:11.371144+0000", 2024-09-13T06:44:00.269 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999967 2024-09-13T06:44:00.269 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:00.269 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:00.269 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:44:00.269 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:11.371161+0000", 2024-09-13T06:44:00.269 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7669e-05 2024-09-13T06:44:00.269 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:00.269 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:00.269 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:44:00.269 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:11.371198+0000", 2024-09-13T06:44:00.269 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.7014000000000002e-05 2024-09-13T06:44:00.269 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:00.270 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:00.270 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:44:00.270 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:11.371216+0000", 2024-09-13T06:44:00.270 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7425e-05 2024-09-13T06:44:00.270 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:00.270 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:00.270 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:44:00.270 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:11.371365+0000", 2024-09-13T06:44:00.270 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000149245 2024-09-13T06:44:00.270 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:00.270 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:00.270 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op must wait for map", 2024-09-13T06:44:00.270 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:11.371385+0000", 2024-09-13T06:44:00.270 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.0018999999999999e-05 2024-09-13T06:44:00.271 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:00.271 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:00.271 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:44:00.271 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:11.378406+0000", 2024-09-13T06:44:00.271 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0070207179999999996 2024-09-13T06:44:00.271 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:00.271 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:00.271 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:44:00.271 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:11.378429+0000", 2024-09-13T06:44:00.271 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.3453999999999999e-05 2024-09-13T06:44:00.271 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:00.271 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:00.271 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:44:00.271 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:12.405667+0000", 2024-09-13T06:44:00.271 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0272381690000001 2024-09-13T06:44:00.272 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:00.272 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:00.272 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:44:00.272 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:12.405848+0000", 2024-09-13T06:44:00.272 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00018112 2024-09-13T06:44:00.272 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:44:00.272 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:44:00.272 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:44:00.272 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:00.272 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:00.272 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:70346 3.16 3:69d35907:::rbd_object_map.11214956a993:head [read 0~36] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e122)", 2024-09-13T06:44:00.272 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:41:16.390917+0000", 2024-09-13T06:44:00.272 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 163.83764255099999, 2024-09-13T06:44:00.273 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.99327479799999996, 2024-09-13T06:44:00.273 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:44:00.273 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:44:00.273 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:44:00.273 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:44:00.273 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:44:00.273 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 70346 2024-09-13T06:44:00.273 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:00.273 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:44:00.273 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:00.273 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:44:00.273 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:16.390917+0000", 2024-09-13T06:44:00.273 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:44:00.273 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:00.274 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:00.274 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:44:00.274 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:16.390917+0000", 2024-09-13T06:44:00.274 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:44:00.274 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:00.274 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:00.274 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:44:00.274 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:16.390916+0000", 2024-09-13T06:44:00.274 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999986 2024-09-13T06:44:00.274 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:00.274 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:00.274 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:44:00.274 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:16.390922+0000", 2024-09-13T06:44:00.275 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.0480000000000004e-06 2024-09-13T06:44:00.275 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:00.275 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:00.275 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:44:00.275 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:16.390933+0000", 2024-09-13T06:44:00.275 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1387e-05 2024-09-13T06:44:00.275 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:00.275 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:00.275 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:44:00.275 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:16.390939+0000", 2024-09-13T06:44:00.275 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.8039999999999998e-06 2024-09-13T06:44:00.275 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:00.275 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:00.276 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:44:00.276 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:16.390983+0000", 2024-09-13T06:44:00.276 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.4663000000000003e-05 2024-09-13T06:44:00.276 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:00.276 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:00.276 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:44:00.276 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:16.390991+0000", 2024-09-13T06:44:00.276 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.8059999999999995e-06 2024-09-13T06:44:00.276 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:00.277 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:00.277 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:44:00.277 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:17.383624+0000", 2024-09-13T06:44:00.277 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.99263277299999997 2024-09-13T06:44:00.277 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:00.277 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:00.277 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:44:00.277 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:17.383891+0000", 2024-09-13T06:44:00.277 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00026717599999999999 2024-09-13T06:44:00.277 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:00.277 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:00.277 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:44:00.278 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:17.384192+0000", 2024-09-13T06:44:00.278 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00030047400000000001 2024-09-13T06:44:00.278 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:44:00.278 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:44:00.278 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:44:00.278 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:00.278 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:00.278 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:181624 3.1d 3:be5d0ef9:::rbd_data.11218aab7a9c.0000000000000000:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e203)", 2024-09-13T06:44:00.278 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:42:45.701744+0000", 2024-09-13T06:44:00.278 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 74.526815631000005, 2024-09-13T06:44:00.278 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.69964504800000005, 2024-09-13T06:44:00.278 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:44:00.278 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:44:00.279 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:44:00.279 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:44:00.279 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:44:00.279 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 181624 2024-09-13T06:44:00.279 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:00.279 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:44:00.279 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:00.279 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:44:00.279 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.701744+0000", 2024-09-13T06:44:00.279 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:44:00.279 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:00.279 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:00.279 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:44:00.280 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.701744+0000", 2024-09-13T06:44:00.280 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:44:00.280 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:00.280 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:00.280 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:44:00.280 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.701741+0000", 2024-09-13T06:44:00.280 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999976 2024-09-13T06:44:00.280 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:00.280 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:00.280 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:44:00.280 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.701754+0000", 2024-09-13T06:44:00.280 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2632999999999999e-05 2024-09-13T06:44:00.281 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:00.281 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:00.281 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:44:00.281 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.701789+0000", 2024-09-13T06:44:00.281 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.4993999999999997e-05 2024-09-13T06:44:00.281 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:00.281 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:00.281 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:44:00.281 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.701806+0000", 2024-09-13T06:44:00.281 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7016000000000001e-05 2024-09-13T06:44:00.281 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:00.281 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:00.281 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:44:00.282 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.701905+0000", 2024-09-13T06:44:00.282 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.8895999999999996e-05 2024-09-13T06:44:00.282 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:00.282 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:00.282 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:44:00.282 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.701920+0000", 2024-09-13T06:44:00.282 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5013e-05 2024-09-13T06:44:00.282 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:00.282 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:00.282 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:44:00.282 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.400672+0000", 2024-09-13T06:44:00.282 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.69875254499999995 2024-09-13T06:44:00.282 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:00.283 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:00.283 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:44:00.283 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.401034+0000", 2024-09-13T06:44:00.283 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00036181700000000001 2024-09-13T06:44:00.283 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:00.283 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:00.283 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:44:00.283 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.401389+0000", 2024-09-13T06:44:00.283 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00035464399999999999 2024-09-13T06:44:00.283 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:44:00.283 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:44:00.283 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:44:00.283 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:00.284 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:00.284 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:181638 3.1d 3:be5d0ef9:::rbd_data.11218aab7a9c.0000000000000000:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e203)", 2024-09-13T06:44:00.284 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:42:45.707356+0000", 2024-09-13T06:44:00.284 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 74.521202892000005, 2024-09-13T06:44:00.284 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.694720479, 2024-09-13T06:44:00.284 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:44:00.284 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:44:00.284 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:44:00.284 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:44:00.284 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:44:00.284 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 181638 2024-09-13T06:44:00.284 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:00.284 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:44:00.284 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:00.285 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:44:00.285 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707356+0000", 2024-09-13T06:44:00.285 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:44:00.285 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:00.285 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:00.285 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:44:00.285 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707356+0000", 2024-09-13T06:44:00.285 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:44:00.285 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:00.285 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:00.285 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:44:00.285 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707355+0000", 2024-09-13T06:44:00.285 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999981 2024-09-13T06:44:00.286 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:00.286 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:00.286 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:44:00.286 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707375+0000", 2024-09-13T06:44:00.286 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.0698000000000001e-05 2024-09-13T06:44:00.286 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:00.286 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:00.286 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:44:00.286 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707396+0000", 2024-09-13T06:44:00.286 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.1041000000000001e-05 2024-09-13T06:44:00.286 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:00.286 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:00.286 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:44:00.286 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707408+0000", 2024-09-13T06:44:00.286 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1583000000000001e-05 2024-09-13T06:44:00.287 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:00.287 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:00.287 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:44:00.287 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707513+0000", 2024-09-13T06:44:00.287 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000104981 2024-09-13T06:44:00.287 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:00.287 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:00.287 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:44:00.287 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707541+0000", 2024-09-13T06:44:00.287 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.8572999999999999e-05 2024-09-13T06:44:00.287 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:00.287 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:00.287 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:44:00.288 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.401666+0000", 2024-09-13T06:44:00.288 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.694124988 2024-09-13T06:44:00.288 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:00.288 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:00.288 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:44:00.288 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.401880+0000", 2024-09-13T06:44:00.288 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00021322100000000001 2024-09-13T06:44:00.288 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:00.288 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:00.288 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:44:00.288 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.402077+0000", 2024-09-13T06:44:00.288 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000197321 2024-09-13T06:44:00.288 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:44:00.289 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:44:00.289 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:44:00.289 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:00.289 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:00.289 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:181652 3.1d 3:be5d0ef9:::rbd_data.11218aab7a9c.0000000000000000:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e203)", 2024-09-13T06:44:00.289 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:42:45.707423+0000", 2024-09-13T06:44:00.289 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 74.521136361000003, 2024-09-13T06:44:00.289 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.69480806699999997, 2024-09-13T06:44:00.289 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:44:00.289 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:44:00.289 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:44:00.289 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:44:00.289 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:44:00.289 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 181652 2024-09-13T06:44:00.290 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:00.290 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:44:00.290 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:00.290 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:44:00.290 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707423+0000", 2024-09-13T06:44:00.290 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:44:00.290 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:00.290 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:00.290 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:44:00.290 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707423+0000", 2024-09-13T06:44:00.290 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:44:00.290 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:00.290 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:00.290 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:44:00.291 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707423+0000", 2024-09-13T06:44:00.291 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:44:00.291 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:00.291 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:00.291 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:44:00.291 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707427+0000", 2024-09-13T06:44:00.291 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.2010000000000001e-06 2024-09-13T06:44:00.291 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:00.291 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:00.291 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:44:00.291 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707442+0000", 2024-09-13T06:44:00.291 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.4993e-05 2024-09-13T06:44:00.291 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:00.291 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:00.292 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:44:00.292 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707447+0000", 2024-09-13T06:44:00.292 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.2170000000000002e-06 2024-09-13T06:44:00.292 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:00.292 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:00.292 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:44:00.292 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707656+0000", 2024-09-13T06:44:00.292 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00020908600000000001 2024-09-13T06:44:00.292 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:00.292 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:00.292 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:44:00.292 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707684+0000", 2024-09-13T06:44:00.292 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.7766000000000001e-05 2024-09-13T06:44:00.292 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:00.293 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:00.293 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:44:00.293 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.402101+0000", 2024-09-13T06:44:00.293 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.69441698100000004 2024-09-13T06:44:00.293 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:00.293 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:00.293 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:44:00.293 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.402156+0000", 2024-09-13T06:44:00.293 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.4725000000000002e-05 2024-09-13T06:44:00.293 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:00.293 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:00.293 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:44:00.293 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.402231+0000", 2024-09-13T06:44:00.293 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5587999999999995e-05 2024-09-13T06:44:00.294 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:44:00.294 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:44:00.294 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:44:00.294 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:00.294 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:00.294 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:181666 3.1d 3:be5d0ef9:::rbd_data.11218aab7a9c.0000000000000000:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e203)", 2024-09-13T06:44:00.294 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:42:45.707478+0000", 2024-09-13T06:44:00.294 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 74.521081175000006, 2024-09-13T06:44:00.294 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.69543359900000001, 2024-09-13T06:44:00.294 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:44:00.294 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:44:00.294 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:44:00.295 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:44:00.295 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:44:00.295 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 181666 2024-09-13T06:44:00.295 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:00.295 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:44:00.295 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:00.295 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:44:00.295 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707478+0000", 2024-09-13T06:44:00.295 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:44:00.295 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:00.295 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:00.295 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:44:00.295 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707478+0000", 2024-09-13T06:44:00.295 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:44:00.296 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:00.296 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:00.296 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:44:00.296 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707478+0000", 2024-09-13T06:44:00.296 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:44:00.296 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:00.296 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:00.296 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:44:00.296 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707481+0000", 2024-09-13T06:44:00.296 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.3589999999999999e-06 2024-09-13T06:44:00.296 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:00.296 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:00.296 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:44:00.296 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707492+0000", 2024-09-13T06:44:00.297 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0725e-05 2024-09-13T06:44:00.297 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:00.297 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:00.297 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:44:00.297 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707500+0000", 2024-09-13T06:44:00.297 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.1089999999999998e-06 2024-09-13T06:44:00.297 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:00.297 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:00.297 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:44:00.297 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707773+0000", 2024-09-13T06:44:00.297 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000273291 2024-09-13T06:44:00.297 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:00.297 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:00.298 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:44:00.298 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707784+0000", 2024-09-13T06:44:00.298 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0441999999999999e-05 2024-09-13T06:44:00.298 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:00.298 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:00.298 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:44:00.298 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.402290+0000", 2024-09-13T06:44:00.298 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.69450651500000005 2024-09-13T06:44:00.298 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:00.298 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:00.298 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:44:00.298 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.402489+0000", 2024-09-13T06:44:00.298 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000198999 2024-09-13T06:44:00.299 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:00.299 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:00.299 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:44:00.299 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.402912+0000", 2024-09-13T06:44:00.299 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00042257299999999998 2024-09-13T06:44:00.299 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:44:00.299 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:44:00.299 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:44:00.299 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:00.299 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:00.299 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:181680 3.1d 3:be5d0ef9:::rbd_data.11218aab7a9c.0000000000000000:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e203)", 2024-09-13T06:44:00.299 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:42:45.707517+0000", 2024-09-13T06:44:00.299 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 74.521042139000002, 2024-09-13T06:44:00.299 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.69532440799999995, 2024-09-13T06:44:00.299 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:44:00.300 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:44:00.300 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:44:00.300 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:44:00.300 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:44:00.300 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 181680 2024-09-13T06:44:00.300 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:00.300 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:44:00.300 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:00.300 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:44:00.300 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707517+0000", 2024-09-13T06:44:00.300 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:44:00.300 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:00.301 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:00.301 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:44:00.301 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707517+0000", 2024-09-13T06:44:00.301 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:44:00.301 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:00.301 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:00.301 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:44:00.301 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707517+0000", 2024-09-13T06:44:00.301 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:44:00.301 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:00.301 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:00.301 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:44:00.301 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707519+0000", 2024-09-13T06:44:00.302 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.2800000000000002e-06 2024-09-13T06:44:00.302 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:00.302 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:00.302 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:44:00.302 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707527+0000", 2024-09-13T06:44:00.302 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.2660000000000001e-06 2024-09-13T06:44:00.302 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:00.302 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:00.302 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:44:00.302 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707535+0000", 2024-09-13T06:44:00.302 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.1760000000000004e-06 2024-09-13T06:44:00.302 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:00.302 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:00.303 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:44:00.303 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707838+0000", 2024-09-13T06:44:00.303 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00030318000000000001 2024-09-13T06:44:00.303 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:00.303 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:00.303 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:44:00.303 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707850+0000", 2024-09-13T06:44:00.303 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1787000000000001e-05 2024-09-13T06:44:00.303 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:00.303 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:00.303 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:44:00.303 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.402702+0000", 2024-09-13T06:44:00.304 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.69485264599999996 2024-09-13T06:44:00.304 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:00.304 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:00.304 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:44:00.304 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.402783+0000", 2024-09-13T06:44:00.304 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.1114999999999998e-05 2024-09-13T06:44:00.304 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:00.304 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:00.304 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:44:00.304 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.402842+0000", 2024-09-13T06:44:00.304 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.8322999999999997e-05 2024-09-13T06:44:00.304 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:44:00.304 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:44:00.305 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:44:00.305 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:00.305 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:00.305 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:181694 3.1d 3:be5d0ef9:::rbd_data.11218aab7a9c.0000000000000000:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e203)", 2024-09-13T06:44:00.305 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:42:45.707544+0000", 2024-09-13T06:44:00.305 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 74.521015446999996, 2024-09-13T06:44:00.305 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.69580726699999995, 2024-09-13T06:44:00.305 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:44:00.305 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:44:00.305 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:44:00.305 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:44:00.305 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:44:00.306 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 181694 2024-09-13T06:44:00.306 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:00.306 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:44:00.306 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:00.306 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:44:00.306 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707544+0000", 2024-09-13T06:44:00.306 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:44:00.306 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:00.306 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:00.306 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:44:00.306 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707544+0000", 2024-09-13T06:44:00.306 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:44:00.307 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:00.307 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:00.307 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:44:00.307 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707543+0000", 2024-09-13T06:44:00.307 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:44:00.307 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:00.307 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:00.307 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:44:00.307 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707561+0000", 2024-09-13T06:44:00.307 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7804000000000001e-05 2024-09-13T06:44:00.307 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:00.307 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:00.307 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:44:00.308 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707575+0000", 2024-09-13T06:44:00.308 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3884e-05 2024-09-13T06:44:00.308 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:00.308 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:00.308 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:44:00.308 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707583+0000", 2024-09-13T06:44:00.308 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5730000000000002e-06 2024-09-13T06:44:00.308 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:00.308 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:00.308 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:44:00.308 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707899+0000", 2024-09-13T06:44:00.308 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00031663999999999998 2024-09-13T06:44:00.309 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:00.309 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:00.309 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:44:00.309 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707908+0000", 2024-09-13T06:44:00.309 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.1430000000000004e-06 2024-09-13T06:44:00.309 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:00.309 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:00.309 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:44:00.309 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.402973+0000", 2024-09-13T06:44:00.309 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.69506426099999996 2024-09-13T06:44:00.309 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:00.309 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:00.310 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:44:00.310 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.403155+0000", 2024-09-13T06:44:00.310 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00018245199999999999 2024-09-13T06:44:00.310 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:00.310 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:00.310 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:44:00.310 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.403351+0000", 2024-09-13T06:44:00.310 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000196028 2024-09-13T06:44:00.310 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:44:00.310 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:44:00.310 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:44:00.310 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:00.310 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:00.310 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:181708 3.1d 3:be5d0ef9:::rbd_data.11218aab7a9c.0000000000000000:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e203)", 2024-09-13T06:44:00.311 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:42:45.707622+0000", 2024-09-13T06:44:00.311 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 74.520937403000005, 2024-09-13T06:44:00.311 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.69603707699999995, 2024-09-13T06:44:00.311 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:44:00.311 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:44:00.311 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:44:00.311 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:44:00.311 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:44:00.311 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 181708 2024-09-13T06:44:00.311 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:00.311 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:44:00.311 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:00.311 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:44:00.312 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707622+0000", 2024-09-13T06:44:00.312 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:44:00.312 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:00.312 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:00.312 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:44:00.312 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707622+0000", 2024-09-13T06:44:00.312 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:44:00.312 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:00.312 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:00.312 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:44:00.312 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707621+0000", 2024-09-13T06:44:00.312 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:44:00.312 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:00.313 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:00.313 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:44:00.313 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707624+0000", 2024-09-13T06:44:00.313 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.8210000000000002e-06 2024-09-13T06:44:00.313 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:00.313 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:00.313 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:44:00.313 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707631+0000", 2024-09-13T06:44:00.313 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.8460000000000002e-06 2024-09-13T06:44:00.313 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:00.313 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:00.313 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:44:00.313 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707635+0000", 2024-09-13T06:44:00.314 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.4610000000000001e-06 2024-09-13T06:44:00.314 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:00.314 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:00.314 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:44:00.314 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707955+0000", 2024-09-13T06:44:00.314 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00031982000000000001 2024-09-13T06:44:00.314 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:00.314 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:00.314 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:44:00.314 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707966+0000", 2024-09-13T06:44:00.314 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0822000000000001e-05 2024-09-13T06:44:00.314 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:00.314 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:00.315 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:44:00.315 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.403541+0000", 2024-09-13T06:44:00.315 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.69557444300000004 2024-09-13T06:44:00.315 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:00.315 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:00.315 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:44:00.315 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.403598+0000", 2024-09-13T06:44:00.315 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.7147e-05 2024-09-13T06:44:00.315 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:00.315 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:00.315 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:44:00.315 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.403659+0000", 2024-09-13T06:44:00.315 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.1373999999999999e-05 2024-09-13T06:44:00.316 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:44:00.316 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:44:00.316 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:44:00.316 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:00.316 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:00.316 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:181722 3.1d 3:be5d0ef9:::rbd_data.11218aab7a9c.0000000000000000:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e203)", 2024-09-13T06:44:00.316 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:42:45.707640+0000", 2024-09-13T06:44:00.316 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 74.520918952000002, 2024-09-13T06:44:00.316 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.69620305800000004, 2024-09-13T06:44:00.316 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:44:00.316 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:44:00.316 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:44:00.316 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:44:00.317 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:44:00.317 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 181722 2024-09-13T06:44:00.317 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:00.317 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:44:00.317 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:00.317 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:44:00.317 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707640+0000", 2024-09-13T06:44:00.317 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:44:00.317 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:00.317 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:00.317 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:44:00.317 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707640+0000", 2024-09-13T06:44:00.317 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:44:00.318 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:00.318 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:00.318 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:44:00.318 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707640+0000", 2024-09-13T06:44:00.318 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:44:00.318 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:00.318 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:00.318 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:44:00.318 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707643+0000", 2024-09-13T06:44:00.318 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.213e-06 2024-09-13T06:44:00.318 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:00.318 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:00.318 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:44:00.319 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707651+0000", 2024-09-13T06:44:00.319 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.2290000000000003e-06 2024-09-13T06:44:00.319 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:00.319 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:00.319 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:44:00.319 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707656+0000", 2024-09-13T06:44:00.319 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.9320000000000004e-06 2024-09-13T06:44:00.319 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:00.319 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:00.319 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:44:00.319 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.708012+0000", 2024-09-13T06:44:00.319 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00035600600000000002 2024-09-13T06:44:00.319 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:00.319 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:00.320 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:44:00.320 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.708024+0000", 2024-09-13T06:44:00.320 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1336e-05 2024-09-13T06:44:00.320 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:00.320 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:00.320 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:44:00.320 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.403696+0000", 2024-09-13T06:44:00.320 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.69567234499999997 2024-09-13T06:44:00.320 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:00.320 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:00.320 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:44:00.320 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.403757+0000", 2024-09-13T06:44:00.320 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.0715999999999999e-05 2024-09-13T06:44:00.321 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:00.321 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:00.321 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:44:00.321 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.403843+0000", 2024-09-13T06:44:00.321 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6679000000000001e-05 2024-09-13T06:44:00.321 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:44:00.321 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:44:00.321 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:44:00.321 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:00.321 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:00.321 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:181736 3.1d 3:be5d0ef9:::rbd_data.11218aab7a9c.0000000000000000:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e203)", 2024-09-13T06:44:00.321 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:42:45.707661+0000", 2024-09-13T06:44:00.321 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 74.520898584999998, 2024-09-13T06:44:00.322 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.69667210700000004, 2024-09-13T06:44:00.322 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:44:00.322 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:44:00.322 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:44:00.322 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:44:00.322 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:44:00.322 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 181736 2024-09-13T06:44:00.322 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:00.322 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:44:00.322 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:00.322 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:44:00.322 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707661+0000", 2024-09-13T06:44:00.322 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:44:00.323 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:00.323 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:00.323 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:44:00.323 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707661+0000", 2024-09-13T06:44:00.323 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:44:00.323 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:00.323 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:00.323 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:44:00.323 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707660+0000", 2024-09-13T06:44:00.323 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:44:00.323 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:00.323 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:00.323 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:44:00.324 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707664+0000", 2024-09-13T06:44:00.324 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.393e-06 2024-09-13T06:44:00.324 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:00.324 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:00.324 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:44:00.324 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707673+0000", 2024-09-13T06:44:00.324 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.5100000000000004e-06 2024-09-13T06:44:00.324 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:00.324 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:00.324 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:44:00.324 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707680+0000", 2024-09-13T06:44:00.324 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.8680000000000001e-06 2024-09-13T06:44:00.324 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:00.324 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:00.325 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:44:00.325 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.708068+0000", 2024-09-13T06:44:00.325 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00038784699999999997 2024-09-13T06:44:00.325 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:00.325 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:00.325 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:44:00.325 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.708078+0000", 2024-09-13T06:44:00.325 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.842e-06 2024-09-13T06:44:00.325 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:00.325 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:00.325 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:44:00.325 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.403924+0000", 2024-09-13T06:44:00.326 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.69584657699999997 2024-09-13T06:44:00.326 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:00.326 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:00.326 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:44:00.326 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.404135+0000", 2024-09-13T06:44:00.326 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000210662 2024-09-13T06:44:00.326 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:00.326 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:00.326 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:44:00.326 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.404333+0000", 2024-09-13T06:44:00.326 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00019787900000000001 2024-09-13T06:44:00.326 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:44:00.326 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:44:00.326 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:44:00.326 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:00.327 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:00.327 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:181750 3.1d 3.9f70ba7d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e203)", 2024-09-13T06:44:00.327 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:42:45.707687+0000", 2024-09-13T06:44:00.327 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 74.520872722000007, 2024-09-13T06:44:00.327 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.69667232199999996, 2024-09-13T06:44:00.327 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:44:00.327 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:44:00.327 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:44:00.327 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:44:00.327 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:44:00.327 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 181750 2024-09-13T06:44:00.327 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:00.327 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:44:00.327 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:00.327 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:44:00.328 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707687+0000", 2024-09-13T06:44:00.328 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:44:00.328 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:00.328 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:00.328 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:44:00.328 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707687+0000", 2024-09-13T06:44:00.328 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:44:00.328 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:00.328 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:00.328 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:44:00.328 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707686+0000", 2024-09-13T06:44:00.328 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:44:00.328 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:00.329 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:00.329 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:44:00.329 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707689+0000", 2024-09-13T06:44:00.329 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.824e-06 2024-09-13T06:44:00.329 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:00.329 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:00.329 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:44:00.329 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707693+0000", 2024-09-13T06:44:00.329 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.5900000000000001e-06 2024-09-13T06:44:00.329 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:00.329 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:00.329 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:44:00.329 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707697+0000", 2024-09-13T06:44:00.330 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.6899999999999998e-06 2024-09-13T06:44:00.330 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:00.330 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:00.330 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:44:00.330 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.708109+0000", 2024-09-13T06:44:00.330 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00041220200000000002 2024-09-13T06:44:00.330 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:00.330 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:00.330 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:44:00.330 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.708118+0000", 2024-09-13T06:44:00.330 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6000000000000007e-06 2024-09-13T06:44:00.330 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:00.330 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:00.330 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:44:00.331 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.404353+0000", 2024-09-13T06:44:00.331 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.69623486400000001 2024-09-13T06:44:00.331 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:00.331 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:00.331 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:44:00.331 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.404359+0000", 2024-09-13T06:44:00.331 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.2480000000000001e-06 2024-09-13T06:44:00.331 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:44:00.331 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:44:00.331 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:44:00.331 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:44:00.331 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:44:00.331 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:44:00.333 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-13T06:44:00.333 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-13T06:44:00.332+0000 7fa8bb18e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 36790) UID: 0 2024-09-13T06:44:00.433 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:44:00.431+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:44:00.479 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-13T06:44:00.502 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:44:00.502 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [ 2024-09-13T06:44:00.502 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:00.503 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:245459 3.9 3.e90fa089 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e273)", 2024-09-13T06:44:00.503 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:43:58.619442+0000", 2024-09-13T06:44:00.503 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 1.885018487, 2024-09-13T06:44:00.503 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.8850636000000001, 2024-09-13T06:44:00.503 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:44:00.503 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "waiting for peered", 2024-09-13T06:44:00.503 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:44:00.503 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:44:00.503 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:44:00.503 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 245459 2024-09-13T06:44:00.503 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:00.503 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:44:00.503 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:00.504 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:44:00.504 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:58.619442+0000", 2024-09-13T06:44:00.504 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:44:00.504 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:00.504 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:00.504 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:44:00.504 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:58.619442+0000", 2024-09-13T06:44:00.504 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:44:00.504 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:00.504 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:00.504 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:44:00.504 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:58.619439+0000", 2024-09-13T06:44:00.504 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999976 2024-09-13T06:44:00.504 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:00.505 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:00.505 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:44:00.505 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:58.619453+0000", 2024-09-13T06:44:00.505 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3492999999999999e-05 2024-09-13T06:44:00.505 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:00.505 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:00.505 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:44:00.505 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:58.619480+0000", 2024-09-13T06:44:00.505 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.7492999999999999e-05 2024-09-13T06:44:00.505 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:00.505 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:00.505 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:44:00.505 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:58.619504+0000", 2024-09-13T06:44:00.505 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.3730000000000001e-05 2024-09-13T06:44:00.506 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:00.506 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:00.506 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:44:00.506 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:58.619611+0000", 2024-09-13T06:44:00.506 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00010764600000000001 2024-09-13T06:44:00.506 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:00.506 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:00.506 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:44:00.506 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:58.619634+0000", 2024-09-13T06:44:00.506 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.2172999999999999e-05 2024-09-13T06:44:00.506 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:00.506 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:00.506 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:44:00.507 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:59.601397+0000", 2024-09-13T06:44:00.507 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.98176298299999998 2024-09-13T06:44:00.507 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:00.507 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:00.507 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:44:00.507 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:59.601433+0000", 2024-09-13T06:44:00.507 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.6755999999999998e-05 2024-09-13T06:44:00.507 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:44:00.507 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:44:00.507 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:44:00.507 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:44:00.507 INFO:teuthology.orchestra.run.smithi139.stdout: ], 2024-09-13T06:44:00.507 INFO:teuthology.orchestra.run.smithi139.stdout: "num_ops": 1 2024-09-13T06:44:00.507 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:44:00.517 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-13T06:44:00.563 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:44:00.564+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:44:00.637 INFO:teuthology.orchestra.run.smithi081.stdout:osd.0: {} 2024-09-13T06:44:00.637 INFO:teuthology.orchestra.run.smithi081.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-13T06:44:00.637 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:44:00.636+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:44:00.652 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:44:00.652 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [], 2024-09-13T06:44:00.652 INFO:teuthology.orchestra.run.smithi139.stdout: "complaint_time": 30, 2024-09-13T06:44:00.652 INFO:teuthology.orchestra.run.smithi139.stdout: "num_blocked_ops": 0 2024-09-13T06:44:00.652 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:44:00.654 INFO:teuthology.orchestra.run.smithi081.stdout:osd.1: {} 2024-09-13T06:44:00.654 INFO:teuthology.orchestra.run.smithi081.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-13T06:44:00.671 INFO:teuthology.orchestra.run.smithi081.stdout:osd.2: {} 2024-09-13T06:44:00.672 INFO:teuthology.orchestra.run.smithi081.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-13T06:44:00.673 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-13T06:44:00.693 INFO:teuthology.orchestra.run.smithi081.stdout:osd.3: {} 2024-09-13T06:44:00.693 INFO:teuthology.orchestra.run.smithi081.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-13T06:44:00.714 INFO:teuthology.orchestra.run.smithi081.stdout:osd.4: {} 2024-09-13T06:44:00.714 INFO:teuthology.orchestra.run.smithi081.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-13T06:44:00.734 INFO:teuthology.orchestra.run.smithi081.stdout:osd.5: {} 2024-09-13T06:44:00.735 INFO:teuthology.orchestra.run.smithi081.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-13T06:44:00.735 INFO:teuthology.orchestra.run.smithi081.stderr:Error ENXIO: problem getting command descriptions from osd.6 2024-09-13T06:44:00.758 INFO:teuthology.orchestra.run.smithi081.stdout:osd.7: {} 2024-09-13T06:44:00.758 INFO:teuthology.orchestra.run.smithi081.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-13T06:44:00.759 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-13T06:44:00.760+0000 7fa8bb18e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 36790) UID: 0 2024-09-13T06:44:00.761 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-13T06:44:00.762 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-13T06:44:00.839 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:44:00.840+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:44:00.870 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:44:00.870 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:44:00.891 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-13T06:44:00.940 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:44:00.939+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:44:01.021 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:44:01.021 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:44:01.036 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-13T06:44:01.041 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:44:01.040+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:44:01.142 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-13T06:44:01.140+0000 7fa8bb18e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 36790) UID: 0 2024-09-13T06:44:01.209 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:44:01.209 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:44:01.223 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-13T06:44:01.274 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:44:01.275+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:44:01.344 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:44:01.344+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:44:01.352 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:44:01.352 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:44:01.367 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-13T06:44:01.458 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:44:01.459+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:44:01.538 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:44:01.538 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:44:01.546 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:44:01.543+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:44:01.552 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-13T06:44:01.634 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-13T06:44:01.647 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:44:01.644+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:44:01.718 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:44:01.719 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:44:01.734 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-13T06:44:01.748 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-13T06:44:01.748+0000 7fa8bb18e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 36790) UID: 0 2024-09-13T06:44:01.848 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:44:01.847+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:44:01.851 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:44:01.851 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:44:01.865 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-13T06:44:01.950 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:44:01.951+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:44:02.027 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:44:02.027 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:44:02.041 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-13T06:44:02.050 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:44:02.048+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:44:02.151 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:44:02.151+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:44:02.204 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:44:02.204 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:44:02.218 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-13T06:44:02.252 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:44:02.252+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:44:02.354 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:44:02.351+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:44:02.380 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:44:02.380 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:44:02.395 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-13T06:44:02.434 INFO:teuthology.orchestra.run.smithi081.stderr:noscrub is set 2024-09-13T06:44:02.463 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:44:02.463+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:44:02.554 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:44:02.555+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:44:02.556 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:44:02.557 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:44:02.574 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-13T06:44:02.662 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:44:02.663+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:44:02.736 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:44:02.737 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:44:02.751 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-13T06:44:02.763 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-13T06:44:02.795 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:44:02.795+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:44:02.857 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:44:02.855+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:44:02.919 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:44:02.919 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:44:02.936 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-13T06:44:02.941 INFO:teuthology.orchestra.run.smithi081.stdout:osd.0: {} 2024-09-13T06:44:02.941 INFO:teuthology.orchestra.run.smithi081.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-13T06:44:02.957 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:44:02.955+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:44:02.958 INFO:teuthology.orchestra.run.smithi081.stdout:osd.1: {} 2024-09-13T06:44:02.958 INFO:teuthology.orchestra.run.smithi081.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-13T06:44:02.974 INFO:teuthology.orchestra.run.smithi081.stdout:osd.2: {} 2024-09-13T06:44:02.974 INFO:teuthology.orchestra.run.smithi081.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-13T06:44:02.992 INFO:teuthology.orchestra.run.smithi081.stdout:osd.3: {} 2024-09-13T06:44:02.993 INFO:teuthology.orchestra.run.smithi081.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-13T06:44:03.009 INFO:teuthology.orchestra.run.smithi081.stdout:osd.4: {} 2024-09-13T06:44:03.009 INFO:teuthology.orchestra.run.smithi081.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-13T06:44:03.027 INFO:teuthology.orchestra.run.smithi081.stdout:osd.5: {} 2024-09-13T06:44:03.027 INFO:teuthology.orchestra.run.smithi081.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-13T06:44:03.027 INFO:teuthology.orchestra.run.smithi081.stderr:Error ENXIO: problem getting command descriptions from osd.6 2024-09-13T06:44:03.047 INFO:teuthology.orchestra.run.smithi081.stdout:osd.7: {} 2024-09-13T06:44:03.048 INFO:teuthology.orchestra.run.smithi081.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-13T06:44:03.051 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-13T06:44:03.051 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-13T06:44:03.058 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:44:03.056+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:44:03.068 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:44:03.068 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [], 2024-09-13T06:44:03.069 INFO:teuthology.orchestra.run.smithi139.stdout: "num_ops": 0 2024-09-13T06:44:03.069 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:44:03.083 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-13T06:44:03.159 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:44:03.159+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:44:03.250 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:44:03.250 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [], 2024-09-13T06:44:03.250 INFO:teuthology.orchestra.run.smithi139.stdout: "complaint_time": 30, 2024-09-13T06:44:03.250 INFO:teuthology.orchestra.run.smithi139.stdout: "num_blocked_ops": 0 2024-09-13T06:44:03.250 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:44:03.260 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:44:03.260+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:44:03.264 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-13T06:44:03.361 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-13T06:44:03.360+0000 7fa8bb18e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 36790) UID: 0 2024-09-13T06:44:03.436 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:44:03.436 INFO:teuthology.orchestra.run.smithi139.stdout: "size": 20, 2024-09-13T06:44:03.437 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 600, 2024-09-13T06:44:03.437 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [ 2024-09-13T06:44:03.437 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:03.437 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:160483 3.a 3:57f62123:::rbd_header.112138ed422:head [watch reconnect cookie 140361344088384 gen 3] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e177)", 2024-09-13T06:44:03.437 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:42:17.439011+0000", 2024-09-13T06:44:03.438 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 105.99699126100001, 2024-09-13T06:44:03.438 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.155518861, 2024-09-13T06:44:03.438 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:44:03.438 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:44:03.438 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:44:03.439 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:44:03.439 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:44:03.439 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 160483 2024-09-13T06:44:03.439 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:03.439 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:44:03.439 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:03.439 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:44:03.439 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:17.439011+0000", 2024-09-13T06:44:03.440 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:44:03.440 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:03.440 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:03.440 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:44:03.440 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:17.439011+0000", 2024-09-13T06:44:03.440 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:44:03.440 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:03.440 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:03.440 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:44:03.440 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:17.439009+0000", 2024-09-13T06:44:03.440 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999976 2024-09-13T06:44:03.440 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:03.441 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:03.441 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:44:03.441 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:17.439024+0000", 2024-09-13T06:44:03.441 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.464e-05 2024-09-13T06:44:03.441 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:03.441 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:03.441 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:44:03.441 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:17.439058+0000", 2024-09-13T06:44:03.441 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.4712999999999998e-05 2024-09-13T06:44:03.441 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:03.441 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:03.441 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:44:03.442 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:17.439085+0000", 2024-09-13T06:44:03.442 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.6216000000000001e-05 2024-09-13T06:44:03.442 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:03.442 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:03.442 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:44:03.442 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:17.439182+0000", 2024-09-13T06:44:03.442 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.7020000000000003e-05 2024-09-13T06:44:03.442 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:03.442 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:03.442 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:44:03.442 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:17.439204+0000", 2024-09-13T06:44:03.442 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.2276000000000002e-05 2024-09-13T06:44:03.442 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:03.442 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:03.443 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:44:03.443 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:18.588627+0000", 2024-09-13T06:44:03.443 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1494235829999999 2024-09-13T06:44:03.443 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:03.443 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:03.443 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for rw locks", 2024-09-13T06:44:03.443 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:18.589031+0000", 2024-09-13T06:44:03.443 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0004035 2024-09-13T06:44:03.443 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:03.443 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:03.444 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:44:03.444 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:18.590604+0000", 2024-09-13T06:44:03.444 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.001573234 2024-09-13T06:44:03.444 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:03.444 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:03.444 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:44:03.444 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:18.590791+0000", 2024-09-13T06:44:03.444 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000186701 2024-09-13T06:44:03.444 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:03.444 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:03.444 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:44:03.444 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:18.594530+0000", 2024-09-13T06:44:03.445 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0037394250000000002 2024-09-13T06:44:03.445 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:44:03.445 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:44:03.445 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:44:03.445 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:03.445 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:03.445 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:208355 3.14 3:2d339b7f:::rbd_data.1121cb4a09ed.0000000000000003:snapdir [list-snaps] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e219)", 2024-09-13T06:44:03.445 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:43:03.420412+0000", 2024-09-13T06:44:03.445 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 60.015591125, 2024-09-13T06:44:03.446 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.705233864, 2024-09-13T06:44:03.446 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:44:03.446 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:44:03.446 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:44:03.446 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:44:03.446 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:44:03.446 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 208355 2024-09-13T06:44:03.447 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:03.447 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:44:03.447 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:03.447 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:44:03.447 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420412+0000", 2024-09-13T06:44:03.447 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:44:03.448 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:03.448 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:03.448 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:44:03.448 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420412+0000", 2024-09-13T06:44:03.448 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:44:03.448 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:03.448 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:03.448 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:44:03.448 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420409+0000", 2024-09-13T06:44:03.448 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999981 2024-09-13T06:44:03.448 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:03.448 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:03.448 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:44:03.449 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420420+0000", 2024-09-13T06:44:03.449 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0716e-05 2024-09-13T06:44:03.449 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:03.449 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:03.449 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:44:03.449 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420440+0000", 2024-09-13T06:44:03.449 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.9850000000000001e-05 2024-09-13T06:44:03.449 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:03.449 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:03.449 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:44:03.449 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420456+0000", 2024-09-13T06:44:03.449 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5667000000000001e-05 2024-09-13T06:44:03.450 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:03.450 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:03.450 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:44:03.450 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420724+0000", 2024-09-13T06:44:03.450 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00026873400000000002 2024-09-13T06:44:03.450 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:03.450 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:03.450 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:44:03.450 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420740+0000", 2024-09-13T06:44:03.450 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5486999999999999e-05 2024-09-13T06:44:03.450 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:03.451 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:03.451 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:44:03.451 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.125004+0000", 2024-09-13T06:44:03.451 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7042643119999998 2024-09-13T06:44:03.451 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:03.451 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:03.451 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:44:03.451 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.125293+0000", 2024-09-13T06:44:03.451 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000288664 2024-09-13T06:44:03.451 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:03.451 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:03.451 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:44:03.451 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.125645+0000", 2024-09-13T06:44:03.451 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00035247700000000002 2024-09-13T06:44:03.451 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:44:03.452 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:44:03.452 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:44:03.452 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:03.452 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:03.452 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:208362 3.14 3:2d339b7f:::rbd_data.1121cb4a09ed.0000000000000003:snapdir [list-snaps] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e219)", 2024-09-13T06:44:03.452 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:43:03.420469+0000", 2024-09-13T06:44:03.452 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 60.015533648999998, 2024-09-13T06:44:03.452 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.706123917, 2024-09-13T06:44:03.452 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:44:03.452 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:44:03.452 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:44:03.452 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:44:03.453 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:44:03.453 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 208362 2024-09-13T06:44:03.453 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:03.453 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:44:03.453 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:03.453 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:44:03.453 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420469+0000", 2024-09-13T06:44:03.453 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:44:03.453 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:03.453 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:03.453 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:44:03.453 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420469+0000", 2024-09-13T06:44:03.453 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:44:03.454 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:03.454 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:03.454 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:44:03.454 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420468+0000", 2024-09-13T06:44:03.454 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:44:03.454 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:03.454 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:03.454 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:44:03.454 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420473+0000", 2024-09-13T06:44:03.454 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.7099999999999998e-06 2024-09-13T06:44:03.455 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:03.455 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:03.455 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:44:03.455 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420483+0000", 2024-09-13T06:44:03.455 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.7960000000000007e-06 2024-09-13T06:44:03.455 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:03.455 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:03.455 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:44:03.455 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420491+0000", 2024-09-13T06:44:03.455 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.8169999999999999e-06 2024-09-13T06:44:03.455 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:03.455 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:03.455 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:44:03.456 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420829+0000", 2024-09-13T06:44:03.456 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000338494 2024-09-13T06:44:03.456 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:03.456 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:03.456 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:44:03.456 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420857+0000", 2024-09-13T06:44:03.456 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.8140000000000002e-05 2024-09-13T06:44:03.456 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:03.456 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:03.456 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:44:03.456 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.126086+0000", 2024-09-13T06:44:03.456 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7052288369999999 2024-09-13T06:44:03.456 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:03.457 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:03.457 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:44:03.457 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.126269+0000", 2024-09-13T06:44:03.457 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000183301 2024-09-13T06:44:03.457 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:03.457 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:03.457 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:44:03.457 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.126593+0000", 2024-09-13T06:44:03.457 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00032352800000000001 2024-09-13T06:44:03.457 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:44:03.457 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:44:03.457 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:44:03.457 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:03.458 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:03.458 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:208369 3.14 3:2d339b7f:::rbd_data.1121cb4a09ed.0000000000000003:snapdir [list-snaps] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e219)", 2024-09-13T06:44:03.458 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:43:03.420498+0000", 2024-09-13T06:44:03.458 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 60.015504604999997, 2024-09-13T06:44:03.458 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.706613895, 2024-09-13T06:44:03.458 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:44:03.458 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:44:03.458 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:44:03.458 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:44:03.458 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:44:03.458 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 208369 2024-09-13T06:44:03.458 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:03.459 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:44:03.459 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:03.459 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:44:03.459 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420498+0000", 2024-09-13T06:44:03.459 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:44:03.459 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:03.459 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:03.459 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:44:03.459 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420498+0000", 2024-09-13T06:44:03.459 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:44:03.459 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:03.460 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:03.460 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:44:03.460 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420497+0000", 2024-09-13T06:44:03.460 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:44:03.460 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:03.460 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:03.460 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:44:03.460 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420501+0000", 2024-09-13T06:44:03.460 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.737e-06 2024-09-13T06:44:03.460 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:03.460 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:03.460 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:44:03.461 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420522+0000", 2024-09-13T06:44:03.461 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.1152999999999999e-05 2024-09-13T06:44:03.461 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:03.461 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:03.461 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:44:03.461 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420533+0000", 2024-09-13T06:44:03.461 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0366999999999999e-05 2024-09-13T06:44:03.461 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:03.461 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:03.461 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:44:03.461 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420968+0000", 2024-09-13T06:44:03.462 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00043495900000000001 2024-09-13T06:44:03.462 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:03.462 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:03.462 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:44:03.462 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420977+0000", 2024-09-13T06:44:03.462 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.8039999999999996e-06 2024-09-13T06:44:03.462 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:03.462 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:03.462 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:44:03.462 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.126670+0000", 2024-09-13T06:44:03.462 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7056928760000001 2024-09-13T06:44:03.462 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:03.462 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:03.463 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:44:03.463 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.126833+0000", 2024-09-13T06:44:03.463 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00016253200000000001 2024-09-13T06:44:03.463 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:03.463 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:03.463 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:44:03.463 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.127112+0000", 2024-09-13T06:44:03.463 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000279141 2024-09-13T06:44:03.463 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:44:03.463 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:44:03.463 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:44:03.463 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:03.464 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:03.464 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:208376 3.14 3:2d339b7f:::rbd_data.1121cb4a09ed.0000000000000003:snapdir [list-snaps] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e219)", 2024-09-13T06:44:03.464 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:43:03.420541+0000", 2024-09-13T06:44:03.464 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 60.015461348999999, 2024-09-13T06:44:03.464 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7070606820000001, 2024-09-13T06:44:03.464 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:44:03.464 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:44:03.464 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:44:03.464 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:44:03.464 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:44:03.464 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 208376 2024-09-13T06:44:03.465 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:03.465 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:44:03.465 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:03.465 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:44:03.465 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420541+0000", 2024-09-13T06:44:03.465 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:44:03.465 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:03.465 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:03.465 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:44:03.465 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420541+0000", 2024-09-13T06:44:03.465 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:44:03.466 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:03.466 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:03.466 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:44:03.466 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420541+0000", 2024-09-13T06:44:03.466 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:44:03.466 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:03.466 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:03.466 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:44:03.466 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420544+0000", 2024-09-13T06:44:03.466 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.5530000000000001e-06 2024-09-13T06:44:03.466 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:03.467 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:03.467 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:44:03.467 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420557+0000", 2024-09-13T06:44:03.467 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2663000000000001e-05 2024-09-13T06:44:03.467 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:03.467 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:03.467 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:44:03.467 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420572+0000", 2024-09-13T06:44:03.467 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5463000000000001e-05 2024-09-13T06:44:03.467 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:03.467 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:03.467 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:44:03.467 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.421070+0000", 2024-09-13T06:44:03.467 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00049723599999999997 2024-09-13T06:44:03.468 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:03.468 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:03.468 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:44:03.468 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.421092+0000", 2024-09-13T06:44:03.468 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.2354e-05 2024-09-13T06:44:03.468 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:03.468 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:03.468 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:44:03.468 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.127184+0000", 2024-09-13T06:44:03.468 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7060917330000001 2024-09-13T06:44:03.468 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:03.468 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:03.468 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:44:03.469 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.127340+0000", 2024-09-13T06:44:03.469 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00015640200000000001 2024-09-13T06:44:03.469 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:03.469 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:03.469 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:44:03.469 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.127602+0000", 2024-09-13T06:44:03.469 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00026192799999999998 2024-09-13T06:44:03.469 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:44:03.469 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:44:03.469 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:44:03.469 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:03.469 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:03.469 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:208383 3.14 3:2d339b7f:::rbd_data.1121cb4a09ed.0000000000000003:snapdir [list-snaps] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e219)", 2024-09-13T06:44:03.470 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:43:03.420585+0000", 2024-09-13T06:44:03.470 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 60.015417495999998, 2024-09-13T06:44:03.470 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.707457405, 2024-09-13T06:44:03.470 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:44:03.470 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:44:03.470 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:44:03.470 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:44:03.471 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:44:03.471 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 208383 2024-09-13T06:44:03.471 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:03.471 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:44:03.471 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:03.471 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:44:03.472 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420585+0000", 2024-09-13T06:44:03.472 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:44:03.472 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:03.472 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:03.472 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:44:03.472 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420585+0000", 2024-09-13T06:44:03.473 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:44:03.473 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:03.473 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:03.473 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:44:03.473 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420584+0000", 2024-09-13T06:44:03.473 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:44:03.474 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:03.474 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:03.474 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:44:03.474 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420614+0000", 2024-09-13T06:44:03.474 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.9886000000000002e-05 2024-09-13T06:44:03.474 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:03.475 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:03.475 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:44:03.475 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420640+0000", 2024-09-13T06:44:03.475 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.5663000000000001e-05 2024-09-13T06:44:03.475 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:03.475 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:03.476 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:44:03.476 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420669+0000", 2024-09-13T06:44:03.476 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.9289999999999999e-05 2024-09-13T06:44:03.476 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:03.476 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:03.477 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:44:03.477 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.421168+0000", 2024-09-13T06:44:03.477 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00049857600000000003 2024-09-13T06:44:03.477 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:03.478 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:03.478 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:44:03.478 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.421177+0000", 2024-09-13T06:44:03.478 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.533e-06 2024-09-13T06:44:03.478 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:03.479 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:03.479 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:44:03.479 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.127648+0000", 2024-09-13T06:44:03.479 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7064713569999999 2024-09-13T06:44:03.479 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:03.480 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:03.480 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:44:03.480 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.127794+0000", 2024-09-13T06:44:03.480 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00014589200000000001 2024-09-13T06:44:03.480 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:03.481 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:03.481 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:44:03.481 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.128043+0000", 2024-09-13T06:44:03.481 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00024821799999999997 2024-09-13T06:44:03.481 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:44:03.482 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:44:03.482 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:44:03.482 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:03.482 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:03.482 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:208390 3.14 3:2d339b7f:::rbd_data.1121cb4a09ed.0000000000000003:snapdir [list-snaps] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e219)", 2024-09-13T06:44:03.483 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:43:03.420713+0000", 2024-09-13T06:44:03.483 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 60.015289537000001, 2024-09-13T06:44:03.483 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7077568059999999, 2024-09-13T06:44:03.483 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:44:03.483 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:44:03.484 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:44:03.484 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:44:03.484 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:44:03.484 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 208390 2024-09-13T06:44:03.484 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:03.485 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:44:03.485 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:03.485 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:44:03.485 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420713+0000", 2024-09-13T06:44:03.486 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:44:03.486 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:03.486 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:03.486 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:44:03.486 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420713+0000", 2024-09-13T06:44:03.487 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:44:03.487 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:03.487 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:03.487 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:44:03.487 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420712+0000", 2024-09-13T06:44:03.488 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:44:03.488 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:03.488 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:03.488 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:44:03.488 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420719+0000", 2024-09-13T06:44:03.489 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.883e-06 2024-09-13T06:44:03.489 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:03.489 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:03.489 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:44:03.489 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420737+0000", 2024-09-13T06:44:03.489 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.8082999999999999e-05 2024-09-13T06:44:03.490 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:03.490 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:03.490 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:44:03.490 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420757+0000", 2024-09-13T06:44:03.491 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.0256999999999999e-05 2024-09-13T06:44:03.491 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:03.491 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:03.491 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:44:03.491 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.421258+0000", 2024-09-13T06:44:03.492 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00050028500000000005 2024-09-13T06:44:03.492 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:03.492 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:03.492 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:44:03.492 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.421282+0000", 2024-09-13T06:44:03.493 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.4236999999999999e-05 2024-09-13T06:44:03.493 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:03.493 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:03.493 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:44:03.494 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.128087+0000", 2024-09-13T06:44:03.494 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.706805551 2024-09-13T06:44:03.494 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:03.494 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:03.495 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:44:03.495 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.128231+0000", 2024-09-13T06:44:03.495 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00014348200000000001 2024-09-13T06:44:03.495 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:03.495 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:03.495 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:44:03.496 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.128470+0000", 2024-09-13T06:44:03.496 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000239058 2024-09-13T06:44:03.496 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:44:03.496 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:44:03.496 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:44:03.497 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:03.497 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:03.497 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:208397 3.14 3:2d339b7f:::rbd_data.1121cb4a09ed.0000000000000003:snapdir [list-snaps] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e219)", 2024-09-13T06:44:03.497 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:43:03.420772+0000", 2024-09-13T06:44:03.497 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 60.015230158000001, 2024-09-13T06:44:03.498 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7081308659999999, 2024-09-13T06:44:03.498 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:44:03.498 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:44:03.498 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:44:03.498 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:44:03.498 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:44:03.499 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 208397 2024-09-13T06:44:03.499 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:03.499 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:44:03.499 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:03.499 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:44:03.499 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420772+0000", 2024-09-13T06:44:03.500 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:44:03.500 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:03.500 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:03.500 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:44:03.500 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420772+0000", 2024-09-13T06:44:03.501 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:44:03.501 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:03.501 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:03.501 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:44:03.501 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420772+0000", 2024-09-13T06:44:03.502 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:44:03.502 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:03.502 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:03.502 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:44:03.502 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420777+0000", 2024-09-13T06:44:03.502 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.8329999999999999e-06 2024-09-13T06:44:03.503 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:03.503 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:03.503 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:44:03.503 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420795+0000", 2024-09-13T06:44:03.503 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7677e-05 2024-09-13T06:44:03.504 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:03.504 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:03.504 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:44:03.504 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420811+0000", 2024-09-13T06:44:03.504 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5673000000000001e-05 2024-09-13T06:44:03.504 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:03.505 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:03.505 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:44:03.505 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.421352+0000", 2024-09-13T06:44:03.505 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00054091199999999995 2024-09-13T06:44:03.505 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:03.506 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:03.506 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:44:03.506 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.421364+0000", 2024-09-13T06:44:03.506 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.182e-05 2024-09-13T06:44:03.506 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:03.507 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:03.507 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:44:03.507 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.128512+0000", 2024-09-13T06:44:03.507 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.707148584 2024-09-13T06:44:03.507 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:03.507 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:03.508 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:44:03.508 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.128653+0000", 2024-09-13T06:44:03.508 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00014127599999999999 2024-09-13T06:44:03.508 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:03.508 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:03.508 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:44:03.509 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.128903+0000", 2024-09-13T06:44:03.509 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000249941 2024-09-13T06:44:03.509 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:44:03.509 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:44:03.509 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:44:03.510 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:03.510 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:03.510 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:208404 3.14 3:2d339b7f:::rbd_data.1121cb4a09ed.0000000000000003:snapdir [list-snaps] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e219)", 2024-09-13T06:44:03.510 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:43:03.420837+0000", 2024-09-13T06:44:03.510 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 60.015165521999997, 2024-09-13T06:44:03.510 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.70849154, 2024-09-13T06:44:03.511 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:44:03.511 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:44:03.511 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:44:03.511 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:44:03.511 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:44:03.511 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 208404 2024-09-13T06:44:03.512 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:03.512 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:44:03.512 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:03.512 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:44:03.512 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420837+0000", 2024-09-13T06:44:03.513 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:44:03.513 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:03.513 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:03.513 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:44:03.513 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420837+0000", 2024-09-13T06:44:03.514 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:44:03.514 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:03.514 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:03.514 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:44:03.514 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420836+0000", 2024-09-13T06:44:03.514 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999986 2024-09-13T06:44:03.515 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:03.515 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:03.515 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:44:03.515 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420842+0000", 2024-09-13T06:44:03.515 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.4400000000000002e-06 2024-09-13T06:44:03.516 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:03.516 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:03.516 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:44:03.516 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420860+0000", 2024-09-13T06:44:03.516 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7487e-05 2024-09-13T06:44:03.517 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:03.517 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:03.517 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:44:03.517 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420916+0000", 2024-09-13T06:44:03.517 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.6276999999999997e-05 2024-09-13T06:44:03.517 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:03.518 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:03.518 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:44:03.518 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.421450+0000", 2024-09-13T06:44:03.518 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00053433500000000004 2024-09-13T06:44:03.518 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:03.518 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:03.519 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:44:03.519 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.421474+0000", 2024-09-13T06:44:03.519 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.3799e-05 2024-09-13T06:44:03.519 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:03.519 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:03.520 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:44:03.520 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.128945+0000", 2024-09-13T06:44:03.520 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.707470912 2024-09-13T06:44:03.520 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:03.520 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:03.521 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:44:03.521 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.129087+0000", 2024-09-13T06:44:03.521 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00014170900000000001 2024-09-13T06:44:03.521 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:03.521 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:03.521 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:44:03.521 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.129329+0000", 2024-09-13T06:44:03.521 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000241831 2024-09-13T06:44:03.521 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:44:03.521 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:44:03.521 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:44:03.522 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:03.522 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:03.522 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:208411 3.14 3:2d339b7f:::rbd_data.1121cb4a09ed.0000000000000003:snapdir [list-snaps] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e219)", 2024-09-13T06:44:03.522 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:43:03.420964+0000", 2024-09-13T06:44:03.522 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 60.01503829, 2024-09-13T06:44:03.522 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.708812754, 2024-09-13T06:44:03.522 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:44:03.522 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:44:03.522 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:44:03.522 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:44:03.522 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:44:03.522 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 208411 2024-09-13T06:44:03.522 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:03.523 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:44:03.523 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:03.523 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:44:03.523 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420964+0000", 2024-09-13T06:44:03.523 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:44:03.523 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:03.523 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:03.523 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:44:03.523 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420964+0000", 2024-09-13T06:44:03.523 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:44:03.523 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:03.523 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:03.523 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:44:03.524 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420963+0000", 2024-09-13T06:44:03.524 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:44:03.524 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:03.524 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:03.524 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:44:03.524 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420969+0000", 2024-09-13T06:44:03.524 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.7540000000000003e-06 2024-09-13T06:44:03.524 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:03.524 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:03.524 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:44:03.524 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420979+0000", 2024-09-13T06:44:03.524 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0067e-05 2024-09-13T06:44:03.524 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:03.525 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:03.525 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:44:03.525 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.420987+0000", 2024-09-13T06:44:03.525 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.6990000000000003e-06 2024-09-13T06:44:03.525 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:03.525 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:03.525 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:44:03.525 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.421563+0000", 2024-09-13T06:44:03.525 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00057654899999999999 2024-09-13T06:44:03.525 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:03.525 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:03.526 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:44:03.526 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.421573+0000", 2024-09-13T06:44:03.526 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.9669999999999996e-06 2024-09-13T06:44:03.526 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:03.526 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:03.526 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:44:03.526 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.129372+0000", 2024-09-13T06:44:03.526 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.707798602 2024-09-13T06:44:03.526 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:03.526 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:03.527 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:44:03.527 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.129514+0000", 2024-09-13T06:44:03.527 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00014191200000000001 2024-09-13T06:44:03.527 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:03.527 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:03.527 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:44:03.527 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.129777+0000", 2024-09-13T06:44:03.527 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00026320100000000002 2024-09-13T06:44:03.527 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:44:03.527 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:44:03.527 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:44:03.527 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:03.527 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:03.528 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:208418 3.14 3:2d339b7f:::rbd_data.1121cb4a09ed.0000000000000003:snapdir [list-snaps] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e219)", 2024-09-13T06:44:03.528 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:43:03.421005+0000", 2024-09-13T06:44:03.528 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 60.014997205999997, 2024-09-13T06:44:03.528 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7096508159999999, 2024-09-13T06:44:03.528 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:44:03.528 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:44:03.528 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:44:03.528 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:44:03.528 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:44:03.528 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 208418 2024-09-13T06:44:03.528 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:03.528 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:44:03.528 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:03.529 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:44:03.529 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.421005+0000", 2024-09-13T06:44:03.529 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:44:03.529 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:03.529 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:03.529 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:44:03.529 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.421005+0000", 2024-09-13T06:44:03.529 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:44:03.529 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:03.529 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:03.529 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:44:03.529 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.421005+0000", 2024-09-13T06:44:03.529 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:44:03.530 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:03.530 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:03.530 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:44:03.530 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.421008+0000", 2024-09-13T06:44:03.530 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.2550000000000002e-06 2024-09-13T06:44:03.530 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:03.530 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:03.530 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:44:03.530 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.421015+0000", 2024-09-13T06:44:03.530 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.0600000000000002e-06 2024-09-13T06:44:03.530 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:03.530 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:03.530 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:44:03.530 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.421021+0000", 2024-09-13T06:44:03.530 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.8139999999999997e-06 2024-09-13T06:44:03.531 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:03.531 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:03.531 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:44:03.531 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.421638+0000", 2024-09-13T06:44:03.531 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00061702600000000001 2024-09-13T06:44:03.531 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:03.531 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:03.531 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:44:03.531 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:03.421659+0000", 2024-09-13T06:44:03.531 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.0894e-05 2024-09-13T06:44:03.531 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:03.531 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:03.531 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:44:03.532 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.129858+0000", 2024-09-13T06:44:03.532 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.708198632 2024-09-13T06:44:03.532 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:03.532 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:03.532 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:44:03.532 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.130158+0000", 2024-09-13T06:44:03.532 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00030000099999999999 2024-09-13T06:44:03.532 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:03.532 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:03.532 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:44:03.532 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.130656+0000", 2024-09-13T06:44:03.532 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00049864199999999999 2024-09-13T06:44:03.533 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:44:03.533 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:44:03.533 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:44:03.533 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:03.533 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:03.533 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:209008 3.3 3:c6ff3074:::rbd_data.1121cb4a09ed.0000000000000001:82 [read 397312~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e220)", 2024-09-13T06:44:03.533 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:43:05.165956+0000", 2024-09-13T06:44:03.533 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 58.270046895999997, 2024-09-13T06:44:03.533 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.120605692, 2024-09-13T06:44:03.533 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:44:03.533 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:44:03.533 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:44:03.533 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:44:03.533 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:44:03.534 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 209008 2024-09-13T06:44:03.534 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:03.534 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:44:03.534 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:03.534 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:44:03.534 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.165956+0000", 2024-09-13T06:44:03.534 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:44:03.534 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:03.534 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:03.534 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:44:03.534 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.165956+0000", 2024-09-13T06:44:03.534 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:44:03.534 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:03.535 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:03.535 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:44:03.535 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.165955+0000", 2024-09-13T06:44:03.535 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:44:03.535 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:03.535 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:03.535 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:44:03.535 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.165960+0000", 2024-09-13T06:44:03.535 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.6200000000000004e-06 2024-09-13T06:44:03.535 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:03.535 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:03.535 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:44:03.536 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.165998+0000", 2024-09-13T06:44:03.536 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.7703000000000001e-05 2024-09-13T06:44:03.536 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:03.536 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:03.536 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:44:03.536 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.166012+0000", 2024-09-13T06:44:03.536 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3682999999999999e-05 2024-09-13T06:44:03.536 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:03.536 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:03.536 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:44:03.537 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.286043+0000", 2024-09-13T06:44:03.537 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.120030867 2024-09-13T06:44:03.537 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:03.537 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:03.537 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:44:03.537 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.286196+0000", 2024-09-13T06:44:03.537 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000153759 2024-09-13T06:44:03.537 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:03.537 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:03.537 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:44:03.537 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.286561+0000", 2024-09-13T06:44:03.537 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00036504700000000002 2024-09-13T06:44:03.537 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:44:03.537 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:44:03.538 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:44:03.538 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:03.538 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:03.538 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:209009 3.3 3:c6ff3074:::rbd_data.1121cb4a09ed.0000000000000001:82 [read 409600~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e220)", 2024-09-13T06:44:03.538 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:43:05.166111+0000", 2024-09-13T06:44:03.538 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 58.269891250999997, 2024-09-13T06:44:03.538 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.121025172, 2024-09-13T06:44:03.538 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:44:03.538 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:44:03.538 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:44:03.538 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:44:03.538 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:44:03.538 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 209009 2024-09-13T06:44:03.538 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:03.539 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:44:03.539 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:03.539 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:44:03.539 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.166111+0000", 2024-09-13T06:44:03.539 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:44:03.539 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:03.539 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:03.539 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:44:03.539 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.166111+0000", 2024-09-13T06:44:03.539 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:44:03.539 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:03.539 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:03.539 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:44:03.539 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.166023+0000", 2024-09-13T06:44:03.540 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999113 2024-09-13T06:44:03.540 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:03.540 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:03.540 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:44:03.540 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.166118+0000", 2024-09-13T06:44:03.540 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.5818999999999999e-05 2024-09-13T06:44:03.540 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:03.540 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:03.540 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:44:03.540 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.166145+0000", 2024-09-13T06:44:03.540 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.6679999999999999e-05 2024-09-13T06:44:03.540 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:03.540 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:03.540 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:44:03.541 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.166162+0000", 2024-09-13T06:44:03.541 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6413e-05 2024-09-13T06:44:03.541 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:03.541 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:03.541 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:44:03.541 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.286636+0000", 2024-09-13T06:44:03.541 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.120474003 2024-09-13T06:44:03.541 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:03.541 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:03.541 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:44:03.541 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.286799+0000", 2024-09-13T06:44:03.541 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00016363900000000001 2024-09-13T06:44:03.541 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:03.542 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:03.542 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:44:03.542 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.287137+0000", 2024-09-13T06:44:03.542 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00033736699999999998 2024-09-13T06:44:03.542 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:44:03.542 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:44:03.542 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:44:03.542 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:03.542 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:03.542 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:209010 3.3 3:c6ff3074:::rbd_data.1121cb4a09ed.0000000000000001:82 [read 421888~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e220)", 2024-09-13T06:44:03.542 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:43:05.167018+0000", 2024-09-13T06:44:03.542 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 58.268985072, 2024-09-13T06:44:03.542 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.120709894, 2024-09-13T06:44:03.543 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:44:03.543 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:44:03.543 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:44:03.543 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:44:03.543 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:44:03.543 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 209010 2024-09-13T06:44:03.543 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:03.543 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:44:03.543 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:03.543 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:44:03.543 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.167018+0000", 2024-09-13T06:44:03.543 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:44:03.543 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:03.543 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:03.544 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:44:03.544 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.167018+0000", 2024-09-13T06:44:03.544 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:44:03.544 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:03.544 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:03.544 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:44:03.544 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.166214+0000", 2024-09-13T06:44:03.544 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9991961 2024-09-13T06:44:03.544 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:03.544 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:03.544 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:44:03.544 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.167039+0000", 2024-09-13T06:44:03.544 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00082531599999999998 2024-09-13T06:44:03.545 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:03.545 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:03.545 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:44:03.545 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.167083+0000", 2024-09-13T06:44:03.545 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.4079999999999998e-05 2024-09-13T06:44:03.545 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:03.545 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:03.545 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:44:03.545 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.167113+0000", 2024-09-13T06:44:03.545 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.025e-05 2024-09-13T06:44:03.545 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:03.545 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:03.545 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:44:03.545 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.287229+0000", 2024-09-13T06:44:03.546 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.12011563 2024-09-13T06:44:03.546 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:03.546 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:03.546 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:44:03.546 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.287369+0000", 2024-09-13T06:44:03.546 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00014040499999999999 2024-09-13T06:44:03.546 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:03.546 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:03.546 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:44:03.546 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.287727+0000", 2024-09-13T06:44:03.546 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000358043 2024-09-13T06:44:03.546 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:44:03.546 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:44:03.547 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:44:03.547 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:03.547 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:03.547 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:209011 3.3 3:c6ff3074:::rbd_data.1121cb4a09ed.0000000000000001:82 [read 434176~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e220)", 2024-09-13T06:44:03.547 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:43:05.167765+0000", 2024-09-13T06:44:03.547 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 58.268237577999997, 2024-09-13T06:44:03.547 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.12054767199999999, 2024-09-13T06:44:03.547 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:44:03.547 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:44:03.547 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:44:03.547 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:44:03.547 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:44:03.547 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 209011 2024-09-13T06:44:03.548 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:03.548 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:44:03.548 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:03.548 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:44:03.548 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.167765+0000", 2024-09-13T06:44:03.548 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:44:03.548 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:03.548 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:03.548 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:44:03.548 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.167765+0000", 2024-09-13T06:44:03.548 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:44:03.548 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:03.548 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:03.549 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:44:03.549 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.167131+0000", 2024-09-13T06:44:03.549 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9993658 2024-09-13T06:44:03.549 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:03.549 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:03.549 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:44:03.549 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.167772+0000", 2024-09-13T06:44:03.549 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00064152399999999998 2024-09-13T06:44:03.549 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:03.549 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:03.549 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:44:03.549 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.167791+0000", 2024-09-13T06:44:03.549 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.8944e-05 2024-09-13T06:44:03.550 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:03.550 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:03.550 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:44:03.550 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.167805+0000", 2024-09-13T06:44:03.550 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.395e-05 2024-09-13T06:44:03.550 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:03.550 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:03.550 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:44:03.550 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.287803+0000", 2024-09-13T06:44:03.550 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.11999747099999999 2024-09-13T06:44:03.550 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:03.550 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:03.551 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:44:03.551 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.287964+0000", 2024-09-13T06:44:03.551 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00016155100000000001 2024-09-13T06:44:03.551 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:03.551 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:03.551 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:44:03.551 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.288313+0000", 2024-09-13T06:44:03.551 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00034865699999999999 2024-09-13T06:44:03.551 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:44:03.551 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:44:03.551 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:44:03.551 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:03.551 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:03.551 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:209013 3.3 3:c6ff3074:::rbd_data.1121cb4a09ed.0000000000000001:82 [read 458752~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e220)", 2024-09-13T06:44:03.552 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:43:05.168880+0000", 2024-09-13T06:44:03.552 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 58.267122493999999, 2024-09-13T06:44:03.552 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.120462023, 2024-09-13T06:44:03.552 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:44:03.552 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:44:03.552 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:44:03.552 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:44:03.552 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:44:03.552 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 209013 2024-09-13T06:44:03.552 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:03.552 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:44:03.553 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:03.553 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:44:03.553 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.168880+0000", 2024-09-13T06:44:03.553 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:44:03.553 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:03.553 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:03.553 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:44:03.553 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.168880+0000", 2024-09-13T06:44:03.553 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:44:03.553 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:03.553 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:03.554 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:44:03.554 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.168879+0000", 2024-09-13T06:44:03.554 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999986 2024-09-13T06:44:03.554 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:03.554 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:03.554 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:44:03.554 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.168888+0000", 2024-09-13T06:44:03.554 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.9930000000000001e-06 2024-09-13T06:44:03.554 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:03.554 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:03.554 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:44:03.554 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.168908+0000", 2024-09-13T06:44:03.555 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.0276999999999999e-05 2024-09-13T06:44:03.555 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:03.555 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:03.555 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:44:03.555 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.168923+0000", 2024-09-13T06:44:03.555 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5543e-05 2024-09-13T06:44:03.555 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:03.555 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:03.555 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:44:03.555 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.288875+0000", 2024-09-13T06:44:03.555 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.119951748 2024-09-13T06:44:03.555 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:03.555 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:03.556 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:44:03.556 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.289007+0000", 2024-09-13T06:44:03.556 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00013142899999999999 2024-09-13T06:44:03.556 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:03.556 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:03.556 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:44:03.556 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.289342+0000", 2024-09-13T06:44:03.556 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00033566999999999999 2024-09-13T06:44:03.556 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:44:03.556 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:44:03.556 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:44:03.556 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:03.556 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:03.557 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:209014 3.3 3:c6ff3074:::rbd_data.1121cb4a09ed.0000000000000001:82 [read 471040~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e220)", 2024-09-13T06:44:03.557 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:43:05.169105+0000", 2024-09-13T06:44:03.557 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 58.266898036000001, 2024-09-13T06:44:03.557 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.12087680000000001, 2024-09-13T06:44:03.557 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:44:03.557 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:44:03.557 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:44:03.557 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:44:03.557 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:44:03.557 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 209014 2024-09-13T06:44:03.557 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:03.557 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:44:03.557 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:03.558 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:44:03.558 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.169105+0000", 2024-09-13T06:44:03.558 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:44:03.558 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:03.558 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:03.558 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:44:03.558 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.169105+0000", 2024-09-13T06:44:03.558 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:44:03.558 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:03.558 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:03.558 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:44:03.558 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.168936+0000", 2024-09-13T06:44:03.558 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9998312 2024-09-13T06:44:03.558 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:03.559 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:03.559 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:44:03.559 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.169115+0000", 2024-09-13T06:44:03.559 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00017854500000000001 2024-09-13T06:44:03.559 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:03.559 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:03.559 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:44:03.559 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.169140+0000", 2024-09-13T06:44:03.559 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.5853000000000001e-05 2024-09-13T06:44:03.559 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:03.559 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:03.559 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:44:03.559 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.169160+0000", 2024-09-13T06:44:03.559 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.9415999999999998e-05 2024-09-13T06:44:03.560 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:03.560 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:03.560 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:44:03.560 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.289414+0000", 2024-09-13T06:44:03.560 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.120253785 2024-09-13T06:44:03.560 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:03.560 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:03.560 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:44:03.560 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.289579+0000", 2024-09-13T06:44:03.560 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00016506299999999999 2024-09-13T06:44:03.560 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:03.560 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:03.560 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:44:03.561 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.289981+0000", 2024-09-13T06:44:03.561 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000402743 2024-09-13T06:44:03.561 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:44:03.561 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:44:03.561 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:44:03.561 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:03.561 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:03.561 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:209015 3.3 3:c6ff3074:::rbd_data.1121cb4a09ed.0000000000000001:82 [read 483328~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e220)", 2024-09-13T06:44:03.561 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:43:05.169496+0000", 2024-09-13T06:44:03.561 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 58.266506986000003, 2024-09-13T06:44:03.561 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.12105229200000001, 2024-09-13T06:44:03.561 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:44:03.562 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:44:03.562 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:44:03.562 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:44:03.562 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:44:03.562 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 209015 2024-09-13T06:44:03.562 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:03.562 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:44:03.562 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:03.562 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:44:03.562 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.169496+0000", 2024-09-13T06:44:03.562 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:44:03.562 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:03.562 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:03.563 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:44:03.563 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.169496+0000", 2024-09-13T06:44:03.563 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:44:03.563 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:03.563 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:03.563 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:44:03.563 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.169177+0000", 2024-09-13T06:44:03.563 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999681 2024-09-13T06:44:03.563 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:03.563 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:03.563 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:44:03.563 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.169509+0000", 2024-09-13T06:44:03.563 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00033226099999999998 2024-09-13T06:44:03.563 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:03.564 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:03.564 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:44:03.564 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.169544+0000", 2024-09-13T06:44:03.564 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.5573e-05 2024-09-13T06:44:03.564 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:03.564 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:03.564 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:44:03.564 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.169560+0000", 2024-09-13T06:44:03.564 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5636000000000001e-05 2024-09-13T06:44:03.564 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:03.564 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:03.564 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:44:03.564 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.290055+0000", 2024-09-13T06:44:03.564 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.12049523400000001 2024-09-13T06:44:03.565 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:03.565 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:03.565 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:44:03.565 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.290201+0000", 2024-09-13T06:44:03.565 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000145742 2024-09-13T06:44:03.565 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:03.565 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:03.565 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:44:03.565 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.290548+0000", 2024-09-13T06:44:03.565 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00034698699999999999 2024-09-13T06:44:03.565 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:44:03.565 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:44:03.565 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:44:03.566 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:03.566 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:03.566 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:209016 3.3 3:c6ff3074:::rbd_data.1121cb4a09ed.0000000000000001:82 [read 495616~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e220)", 2024-09-13T06:44:03.566 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:43:05.169893+0000", 2024-09-13T06:44:03.566 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 58.266109473, 2024-09-13T06:44:03.566 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.121278814, 2024-09-13T06:44:03.566 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:44:03.566 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:44:03.566 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:44:03.566 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:44:03.566 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:44:03.566 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 209016 2024-09-13T06:44:03.566 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:03.567 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:44:03.567 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:03.567 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:44:03.567 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.169893+0000", 2024-09-13T06:44:03.567 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:44:03.567 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:03.567 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:03.567 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:44:03.567 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.169893+0000", 2024-09-13T06:44:03.567 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:44:03.567 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:03.567 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:03.567 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:44:03.568 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.169572+0000", 2024-09-13T06:44:03.568 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9996786 2024-09-13T06:44:03.568 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:03.568 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:03.568 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:44:03.568 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.169903+0000", 2024-09-13T06:44:03.568 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00033101400000000003 2024-09-13T06:44:03.568 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:03.568 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:03.568 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:44:03.568 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.169933+0000", 2024-09-13T06:44:03.568 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.9913e-05 2024-09-13T06:44:03.568 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:03.568 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:03.569 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:44:03.569 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.169949+0000", 2024-09-13T06:44:03.569 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6313000000000001e-05 2024-09-13T06:44:03.569 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:03.569 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:03.569 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:44:03.569 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.290622+0000", 2024-09-13T06:44:03.569 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.120672795 2024-09-13T06:44:03.569 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:03.569 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:03.569 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:44:03.569 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.290788+0000", 2024-09-13T06:44:03.569 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00016597899999999999 2024-09-13T06:44:03.570 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:03.570 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:03.570 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:44:03.570 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:05.291172+0000", 2024-09-13T06:44:03.570 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00038422700000000001 2024-09-13T06:44:03.570 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:44:03.570 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:44:03.570 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:44:03.570 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:03.570 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:03.570 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:242330 3.1a 3:5cea7035:::rbd_info:head [call rbd.metadata_list in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e251)", 2024-09-13T06:44:03.570 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:43:36.447499+0000", 2024-09-13T06:44:03.570 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 26.988503693999998, 2024-09-13T06:44:03.570 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.97783059900000002, 2024-09-13T06:44:03.571 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:44:03.571 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:44:03.571 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:44:03.571 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:44:03.571 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:44:03.571 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 242330 2024-09-13T06:44:03.571 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:03.571 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:44:03.571 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:03.571 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:44:03.571 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:36.447499+0000", 2024-09-13T06:44:03.571 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:44:03.571 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:03.571 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:03.572 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:44:03.572 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:36.447499+0000", 2024-09-13T06:44:03.572 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:44:03.572 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:03.572 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:03.572 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:44:03.572 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:36.447497+0000", 2024-09-13T06:44:03.572 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999976 2024-09-13T06:44:03.572 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:03.572 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:03.572 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:44:03.572 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:36.447510+0000", 2024-09-13T06:44:03.572 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3298999999999999e-05 2024-09-13T06:44:03.573 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:03.573 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:03.573 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:44:03.573 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:36.447542+0000", 2024-09-13T06:44:03.573 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.163e-05 2024-09-13T06:44:03.573 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:03.573 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:03.573 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:44:03.573 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:36.447556+0000", 2024-09-13T06:44:03.573 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.4416999999999999e-05 2024-09-13T06:44:03.573 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:03.573 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:03.573 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:44:03.573 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:36.447667+0000", 2024-09-13T06:44:03.574 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000110886 2024-09-13T06:44:03.574 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:03.574 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:03.574 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:44:03.574 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:36.447688+0000", 2024-09-13T06:44:03.574 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.0656e-05 2024-09-13T06:44:03.574 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:03.574 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:03.574 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:44:03.574 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:37.424923+0000", 2024-09-13T06:44:03.574 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.97723487399999998 2024-09-13T06:44:03.574 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:03.574 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:03.574 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:44:03.574 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:37.425107+0000", 2024-09-13T06:44:03.575 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00018405900000000001 2024-09-13T06:44:03.575 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:03.575 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:03.575 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:44:03.575 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:37.425330+0000", 2024-09-13T06:44:03.575 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00022296800000000001 2024-09-13T06:44:03.575 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:44:03.575 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:44:03.575 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:44:03.575 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:44:03.575 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:44:03.575 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:44:03.577 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-13T06:44:03.577 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:44:03.576+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:44:03.627 INFO:tasks.thrashosds.thrasher:in_osds: [0, 7, 5, 3, 4] out_osds: [6, 1, 2] dead_osds: [6] live_osds: [0, 1, 2, 3, 4, 5, 7] 2024-09-13T06:44:03.627 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-13T06:44:03.627 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap 2024-09-13T06:44:03.628 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-09-13T06:44:03.678 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:44:03.675+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:44:03.749 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:44:03.749 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [], 2024-09-13T06:44:03.749 INFO:teuthology.orchestra.run.smithi139.stdout: "num_ops": 0 2024-09-13T06:44:03.749 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:44:03.763 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-13T06:44:03.778 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:44:03.779+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:44:03.879 INFO:tasks.ceph.osd.5.smithi139.stderr:2024-09-13T06:44:03.880+0000 7f2181cea640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26382) UID: 0 2024-09-13T06:44:03.887 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:44:03.887 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [], 2024-09-13T06:44:03.887 INFO:teuthology.orchestra.run.smithi139.stdout: "complaint_time": 30, 2024-09-13T06:44:03.887 INFO:teuthology.orchestra.run.smithi139.stdout: "num_blocked_ops": 0 2024-09-13T06:44:03.887 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:44:03.901 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-13T06:44:03.935 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T06:44:03.935 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:44:03.935 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 278, 2024-09-13T06:44:03.935 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "e5612297-d004-4957-927e-afa37f30d6cf", 2024-09-13T06:44:03.935 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-09-13T06:38:56.670231+0000", 2024-09-13T06:44:03.935 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-09-13T06:44:03.425399+0000", 2024-09-13T06:44:03.935 INFO:teuthology.orchestra.run.smithi081.stdout: "last_up_change": "2024-09-13T06:42:51.723548+0000", 2024-09-13T06:44:03.935 INFO:teuthology.orchestra.run.smithi081.stdout: "last_in_change": "2024-09-13T06:43:58.590847+0000", 2024-09-13T06:44:03.935 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": "noscrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-13T06:44:03.935 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_num": 5801984, 2024-09-13T06:44:03.936 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_set": [ 2024-09-13T06:44:03.936 INFO:teuthology.orchestra.run.smithi081.stdout: "noscrub", 2024-09-13T06:44:03.936 INFO:teuthology.orchestra.run.smithi081.stdout: "pglog_hardlimit", 2024-09-13T06:44:03.936 INFO:teuthology.orchestra.run.smithi081.stdout: "purged_snapdirs", 2024-09-13T06:44:03.936 INFO:teuthology.orchestra.run.smithi081.stdout: "recovery_deletes", 2024-09-13T06:44:03.936 INFO:teuthology.orchestra.run.smithi081.stdout: "sortbitwise" 2024-09-13T06:44:03.936 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-13T06:44:03.936 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_version": 5, 2024-09-13T06:44:03.936 INFO:teuthology.orchestra.run.smithi081.stdout: "full_ratio": 0.94999998807907104, 2024-09-13T06:44:03.936 INFO:teuthology.orchestra.run.smithi081.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-09-13T06:44:03.936 INFO:teuthology.orchestra.run.smithi081.stdout: "nearfull_ratio": 0.85000002384185791, 2024-09-13T06:44:03.936 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_snapshot": "", 2024-09-13T06:44:03.936 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_max": 3, 2024-09-13T06:44:03.936 INFO:teuthology.orchestra.run.smithi081.stdout: "max_osd": 8, 2024-09-13T06:44:03.937 INFO:teuthology.orchestra.run.smithi081.stdout: "require_min_compat_client": "luminous", 2024-09-13T06:44:03.937 INFO:teuthology.orchestra.run.smithi081.stdout: "min_compat_client": "luminous", 2024-09-13T06:44:03.937 INFO:teuthology.orchestra.run.smithi081.stdout: "require_osd_release": "reef", 2024-09-13T06:44:03.937 INFO:teuthology.orchestra.run.smithi081.stdout: "allow_crimson": false, 2024-09-13T06:44:03.937 INFO:teuthology.orchestra.run.smithi081.stdout: "pools": [ 2024-09-13T06:44:03.937 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:03.937 INFO:teuthology.orchestra.run.smithi081.stdout: "pool": 1, 2024-09-13T06:44:03.937 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_name": ".mgr", 2024-09-13T06:44:03.937 INFO:teuthology.orchestra.run.smithi081.stdout: "create_time": "2024-09-13T06:39:09.600726+0000", 2024-09-13T06:44:03.937 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-13T06:44:03.937 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_names": "hashpspool", 2024-09-13T06:44:03.937 INFO:teuthology.orchestra.run.smithi081.stdout: "type": 1, 2024-09-13T06:44:03.937 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 2, 2024-09-13T06:44:03.937 INFO:teuthology.orchestra.run.smithi081.stdout: "min_size": 1, 2024-09-13T06:44:03.937 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_rule": 0, 2024-09-13T06:44:03.938 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_count": 0, 2024-09-13T06:44:03.938 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_target": 0, 2024-09-13T06:44:03.938 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_barrier": 0, 2024-09-13T06:44:03.938 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-13T06:44:03.938 INFO:teuthology.orchestra.run.smithi081.stdout: "object_hash": 2, 2024-09-13T06:44:03.938 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_mode": "off", 2024-09-13T06:44:03.938 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num": 1, 2024-09-13T06:44:03.938 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num": 1, 2024-09-13T06:44:03.938 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num_target": 1, 2024-09-13T06:44:03.938 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_target": 1, 2024-09-13T06:44:03.938 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_pending": 1, 2024-09-13T06:44:03.938 INFO:teuthology.orchestra.run.smithi081.stdout: "last_pg_merge_meta": { 2024-09-13T06:44:03.938 INFO:teuthology.orchestra.run.smithi081.stdout: "source_pgid": "0.0", 2024-09-13T06:44:03.938 INFO:teuthology.orchestra.run.smithi081.stdout: "ready_epoch": 0, 2024-09-13T06:44:03.939 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_started": 0, 2024-09-13T06:44:03.939 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_clean": 0, 2024-09-13T06:44:03.939 INFO:teuthology.orchestra.run.smithi081.stdout: "source_version": "0'0", 2024-09-13T06:44:03.939 INFO:teuthology.orchestra.run.smithi081.stdout: "target_version": "0'0" 2024-09-13T06:44:03.939 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:03.939 INFO:teuthology.orchestra.run.smithi081.stdout: "last_change": "16", 2024-09-13T06:44:03.939 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend": "0", 2024-09-13T06:44:03.939 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-13T06:44:03.939 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_preluminous": "0", 2024-09-13T06:44:03.939 INFO:teuthology.orchestra.run.smithi081.stdout: "auid": 0, 2024-09-13T06:44:03.939 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_mode": "selfmanaged", 2024-09-13T06:44:03.939 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_seq": 0, 2024-09-13T06:44:03.939 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_epoch": 0, 2024-09-13T06:44:03.939 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_snaps": [], 2024-09-13T06:44:03.939 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps": "[]", 2024-09-13T06:44:03.940 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_bytes": 0, 2024-09-13T06:44:03.940 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_objects": 0, 2024-09-13T06:44:03.940 INFO:teuthology.orchestra.run.smithi081.stdout: "tiers": [], 2024-09-13T06:44:03.940 INFO:teuthology.orchestra.run.smithi081.stdout: "tier_of": -1, 2024-09-13T06:44:03.940 INFO:teuthology.orchestra.run.smithi081.stdout: "read_tier": -1, 2024-09-13T06:44:03.940 INFO:teuthology.orchestra.run.smithi081.stdout: "write_tier": -1, 2024-09-13T06:44:03.940 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_mode": "none", 2024-09-13T06:44:03.940 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_bytes": 0, 2024-09-13T06:44:03.940 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_objects": 0, 2024-09-13T06:44:03.940 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-13T06:44:03.940 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-13T06:44:03.940 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-13T06:44:03.940 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_flush_age": 0, 2024-09-13T06:44:03.940 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_evict_age": 0, 2024-09-13T06:44:03.940 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profile": "", 2024-09-13T06:44:03.941 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_params": { 2024-09-13T06:44:03.941 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "none" 2024-09-13T06:44:03.941 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:03.941 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_period": 0, 2024-09-13T06:44:03.941 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_count": 0, 2024-09-13T06:44:03.941 INFO:teuthology.orchestra.run.smithi081.stdout: "use_gmt_hitset": true, 2024-09-13T06:44:03.941 INFO:teuthology.orchestra.run.smithi081.stdout: "min_read_recency_for_promote": 0, 2024-09-13T06:44:03.941 INFO:teuthology.orchestra.run.smithi081.stdout: "min_write_recency_for_promote": 0, 2024-09-13T06:44:03.941 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_grade_decay_rate": 0, 2024-09-13T06:44:03.941 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_search_last_n": 0, 2024-09-13T06:44:03.941 INFO:teuthology.orchestra.run.smithi081.stdout: "grade_table": [], 2024-09-13T06:44:03.941 INFO:teuthology.orchestra.run.smithi081.stdout: "stripe_width": 0, 2024-09-13T06:44:03.941 INFO:teuthology.orchestra.run.smithi081.stdout: "expected_num_objects": 0, 2024-09-13T06:44:03.941 INFO:teuthology.orchestra.run.smithi081.stdout: "fast_read": false, 2024-09-13T06:44:03.942 INFO:teuthology.orchestra.run.smithi081.stdout: "options": { 2024-09-13T06:44:03.942 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_max": 32, 2024-09-13T06:44:03.942 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_min": 1 2024-09-13T06:44:03.942 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:03.942 INFO:teuthology.orchestra.run.smithi081.stdout: "application_metadata": { 2024-09-13T06:44:03.942 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": {} 2024-09-13T06:44:03.942 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:03.942 INFO:teuthology.orchestra.run.smithi081.stdout: "read_balance": { 2024-09-13T06:44:03.942 INFO:teuthology.orchestra.run.smithi081.stdout: "score_acting": 6.059999942779541, 2024-09-13T06:44:03.942 INFO:teuthology.orchestra.run.smithi081.stdout: "score_stable": 6.059999942779541, 2024-09-13T06:44:03.942 INFO:teuthology.orchestra.run.smithi081.stdout: "optimal_score": 0.33000001311302185, 2024-09-13T06:44:03.942 INFO:teuthology.orchestra.run.smithi081.stdout: "raw_score_acting": 2, 2024-09-13T06:44:03.942 INFO:teuthology.orchestra.run.smithi081.stdout: "raw_score_stable": 2, 2024-09-13T06:44:03.942 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity_weighted": 0.64948463439941406, 2024-09-13T06:44:03.943 INFO:teuthology.orchestra.run.smithi081.stdout: "average_primary_affinity": 0.87000000476837158, 2024-09-13T06:44:03.943 INFO:teuthology.orchestra.run.smithi081.stdout: "average_primary_affinity_weighted": 0.64999997615814209 2024-09-13T06:44:03.943 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:44:03.943 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:03.943 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:03.943 INFO:teuthology.orchestra.run.smithi081.stdout: "pool": 2, 2024-09-13T06:44:03.943 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_name": "rbd", 2024-09-13T06:44:03.943 INFO:teuthology.orchestra.run.smithi081.stdout: "create_time": "2024-09-13T06:39:15.802118+0000", 2024-09-13T06:44:03.943 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 8193, 2024-09-13T06:44:03.943 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-13T06:44:03.943 INFO:teuthology.orchestra.run.smithi081.stdout: "type": 1, 2024-09-13T06:44:03.943 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 2, 2024-09-13T06:44:03.943 INFO:teuthology.orchestra.run.smithi081.stdout: "min_size": 1, 2024-09-13T06:44:03.944 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_rule": 0, 2024-09-13T06:44:03.944 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_count": 0, 2024-09-13T06:44:03.944 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_target": 0, 2024-09-13T06:44:03.944 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_barrier": 0, 2024-09-13T06:44:03.944 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-13T06:44:03.944 INFO:teuthology.orchestra.run.smithi081.stdout: "object_hash": 2, 2024-09-13T06:44:03.944 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_mode": "off", 2024-09-13T06:44:03.944 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num": 8, 2024-09-13T06:44:03.944 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num": 8, 2024-09-13T06:44:03.944 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num_target": 8, 2024-09-13T06:44:03.944 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_target": 8, 2024-09-13T06:44:03.944 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_pending": 8, 2024-09-13T06:44:03.944 INFO:teuthology.orchestra.run.smithi081.stdout: "last_pg_merge_meta": { 2024-09-13T06:44:03.944 INFO:teuthology.orchestra.run.smithi081.stdout: "source_pgid": "0.0", 2024-09-13T06:44:03.944 INFO:teuthology.orchestra.run.smithi081.stdout: "ready_epoch": 0, 2024-09-13T06:44:03.945 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_started": 0, 2024-09-13T06:44:03.945 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_clean": 0, 2024-09-13T06:44:03.945 INFO:teuthology.orchestra.run.smithi081.stdout: "source_version": "0'0", 2024-09-13T06:44:03.945 INFO:teuthology.orchestra.run.smithi081.stdout: "target_version": "0'0" 2024-09-13T06:44:03.945 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:03.945 INFO:teuthology.orchestra.run.smithi081.stdout: "last_change": "20", 2024-09-13T06:44:03.945 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend": "0", 2024-09-13T06:44:03.945 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-13T06:44:03.945 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_preluminous": "0", 2024-09-13T06:44:03.945 INFO:teuthology.orchestra.run.smithi081.stdout: "auid": 0, 2024-09-13T06:44:03.945 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_mode": "selfmanaged", 2024-09-13T06:44:03.945 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_seq": 3, 2024-09-13T06:44:03.945 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_epoch": 20, 2024-09-13T06:44:03.945 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_snaps": [], 2024-09-13T06:44:03.945 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps": "[]", 2024-09-13T06:44:03.946 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_bytes": 0, 2024-09-13T06:44:03.946 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_objects": 0, 2024-09-13T06:44:03.946 INFO:teuthology.orchestra.run.smithi081.stdout: "tiers": [], 2024-09-13T06:44:03.946 INFO:teuthology.orchestra.run.smithi081.stdout: "tier_of": -1, 2024-09-13T06:44:03.946 INFO:teuthology.orchestra.run.smithi081.stdout: "read_tier": -1, 2024-09-13T06:44:03.946 INFO:teuthology.orchestra.run.smithi081.stdout: "write_tier": -1, 2024-09-13T06:44:03.946 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_mode": "none", 2024-09-13T06:44:03.946 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_bytes": 0, 2024-09-13T06:44:03.946 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_objects": 0, 2024-09-13T06:44:03.946 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-13T06:44:03.946 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-13T06:44:03.946 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-13T06:44:03.946 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_flush_age": 0, 2024-09-13T06:44:03.947 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_evict_age": 0, 2024-09-13T06:44:03.947 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profile": "", 2024-09-13T06:44:03.947 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_params": { 2024-09-13T06:44:03.947 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "none" 2024-09-13T06:44:03.947 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:03.947 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_period": 0, 2024-09-13T06:44:03.947 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_count": 0, 2024-09-13T06:44:03.947 INFO:teuthology.orchestra.run.smithi081.stdout: "use_gmt_hitset": true, 2024-09-13T06:44:03.947 INFO:teuthology.orchestra.run.smithi081.stdout: "min_read_recency_for_promote": 0, 2024-09-13T06:44:03.947 INFO:teuthology.orchestra.run.smithi081.stdout: "min_write_recency_for_promote": 0, 2024-09-13T06:44:03.947 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_grade_decay_rate": 0, 2024-09-13T06:44:03.947 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_search_last_n": 0, 2024-09-13T06:44:03.947 INFO:teuthology.orchestra.run.smithi081.stdout: "grade_table": [], 2024-09-13T06:44:03.947 INFO:teuthology.orchestra.run.smithi081.stdout: "stripe_width": 0, 2024-09-13T06:44:03.948 INFO:teuthology.orchestra.run.smithi081.stdout: "expected_num_objects": 0, 2024-09-13T06:44:03.948 INFO:teuthology.orchestra.run.smithi081.stdout: "fast_read": false, 2024-09-13T06:44:03.948 INFO:teuthology.orchestra.run.smithi081.stdout: "options": {}, 2024-09-13T06:44:03.948 INFO:teuthology.orchestra.run.smithi081.stdout: "application_metadata": { 2024-09-13T06:44:03.948 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd": {} 2024-09-13T06:44:03.948 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:03.948 INFO:teuthology.orchestra.run.smithi081.stdout: "read_balance": { 2024-09-13T06:44:03.948 INFO:teuthology.orchestra.run.smithi081.stdout: "error_message": "pool 2 has some PGs where all OSDs are with primary_affinity 0 (at least pg 2.2), read balance score may not be reliable", 2024-09-13T06:44:03.948 INFO:teuthology.orchestra.run.smithi081.stdout: "score_acting": 0, 2024-09-13T06:44:03.948 INFO:teuthology.orchestra.run.smithi081.stdout: "score_stable": 0 2024-09-13T06:44:03.948 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:44:03.948 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:03.948 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:03.948 INFO:teuthology.orchestra.run.smithi081.stdout: "pool": 3, 2024-09-13T06:44:03.949 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_name": "pool_client.0", 2024-09-13T06:44:03.949 INFO:teuthology.orchestra.run.smithi081.stdout: "create_time": "2024-09-13T06:39:25.648942+0000", 2024-09-13T06:44:03.949 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 8193, 2024-09-13T06:44:03.949 INFO:teuthology.orchestra.run.smithi081.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-13T06:44:03.949 INFO:teuthology.orchestra.run.smithi081.stdout: "type": 1, 2024-09-13T06:44:03.949 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 2, 2024-09-13T06:44:03.949 INFO:teuthology.orchestra.run.smithi081.stdout: "min_size": 1, 2024-09-13T06:44:03.949 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_rule": 0, 2024-09-13T06:44:03.949 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_count": 0, 2024-09-13T06:44:03.949 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_target": 0, 2024-09-13T06:44:03.949 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_barrier": 0, 2024-09-13T06:44:03.949 INFO:teuthology.orchestra.run.smithi081.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-13T06:44:03.949 INFO:teuthology.orchestra.run.smithi081.stdout: "object_hash": 2, 2024-09-13T06:44:03.949 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscale_mode": "off", 2024-09-13T06:44:03.950 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num": 32, 2024-09-13T06:44:03.950 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num": 32, 2024-09-13T06:44:03.950 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_placement_num_target": 32, 2024-09-13T06:44:03.950 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_target": 32, 2024-09-13T06:44:03.950 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num_pending": 32, 2024-09-13T06:44:03.950 INFO:teuthology.orchestra.run.smithi081.stdout: "last_pg_merge_meta": { 2024-09-13T06:44:03.950 INFO:teuthology.orchestra.run.smithi081.stdout: "source_pgid": "0.0", 2024-09-13T06:44:03.950 INFO:teuthology.orchestra.run.smithi081.stdout: "ready_epoch": 0, 2024-09-13T06:44:03.950 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_started": 0, 2024-09-13T06:44:03.950 INFO:teuthology.orchestra.run.smithi081.stdout: "last_epoch_clean": 0, 2024-09-13T06:44:03.950 INFO:teuthology.orchestra.run.smithi081.stdout: "source_version": "0'0", 2024-09-13T06:44:03.950 INFO:teuthology.orchestra.run.smithi081.stdout: "target_version": "0'0" 2024-09-13T06:44:03.950 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:03.950 INFO:teuthology.orchestra.run.smithi081.stdout: "last_change": "276", 2024-09-13T06:44:03.950 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend": "0", 2024-09-13T06:44:03.951 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-13T06:44:03.951 INFO:teuthology.orchestra.run.smithi081.stdout: "last_force_op_resend_preluminous": "0", 2024-09-13T06:44:03.951 INFO:teuthology.orchestra.run.smithi081.stdout: "auid": 0, 2024-09-13T06:44:03.951 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_mode": "selfmanaged", 2024-09-13T06:44:03.951 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_seq": 173, 2024-09-13T06:44:03.951 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_epoch": 276, 2024-09-13T06:44:03.951 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_snaps": [], 2024-09-13T06:44:03.951 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps": "[]", 2024-09-13T06:44:03.951 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_bytes": 0, 2024-09-13T06:44:03.951 INFO:teuthology.orchestra.run.smithi081.stdout: "quota_max_objects": 0, 2024-09-13T06:44:03.951 INFO:teuthology.orchestra.run.smithi081.stdout: "tiers": [], 2024-09-13T06:44:03.951 INFO:teuthology.orchestra.run.smithi081.stdout: "tier_of": -1, 2024-09-13T06:44:03.951 INFO:teuthology.orchestra.run.smithi081.stdout: "read_tier": -1, 2024-09-13T06:44:03.952 INFO:teuthology.orchestra.run.smithi081.stdout: "write_tier": -1, 2024-09-13T06:44:03.952 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_mode": "none", 2024-09-13T06:44:03.952 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_bytes": 0, 2024-09-13T06:44:03.952 INFO:teuthology.orchestra.run.smithi081.stdout: "target_max_objects": 0, 2024-09-13T06:44:03.952 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-13T06:44:03.952 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-13T06:44:03.952 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-13T06:44:03.952 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_flush_age": 0, 2024-09-13T06:44:03.952 INFO:teuthology.orchestra.run.smithi081.stdout: "cache_min_evict_age": 0, 2024-09-13T06:44:03.952 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profile": "", 2024-09-13T06:44:03.952 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_params": { 2024-09-13T06:44:03.952 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "none" 2024-09-13T06:44:03.952 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:03.953 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_period": 0, 2024-09-13T06:44:03.953 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_count": 0, 2024-09-13T06:44:03.953 INFO:teuthology.orchestra.run.smithi081.stdout: "use_gmt_hitset": true, 2024-09-13T06:44:03.953 INFO:teuthology.orchestra.run.smithi081.stdout: "min_read_recency_for_promote": 0, 2024-09-13T06:44:03.953 INFO:teuthology.orchestra.run.smithi081.stdout: "min_write_recency_for_promote": 0, 2024-09-13T06:44:03.953 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_grade_decay_rate": 0, 2024-09-13T06:44:03.953 INFO:teuthology.orchestra.run.smithi081.stdout: "hit_set_search_last_n": 0, 2024-09-13T06:44:03.953 INFO:teuthology.orchestra.run.smithi081.stdout: "grade_table": [], 2024-09-13T06:44:03.953 INFO:teuthology.orchestra.run.smithi081.stdout: "stripe_width": 0, 2024-09-13T06:44:03.953 INFO:teuthology.orchestra.run.smithi081.stdout: "expected_num_objects": 0, 2024-09-13T06:44:03.953 INFO:teuthology.orchestra.run.smithi081.stdout: "fast_read": false, 2024-09-13T06:44:03.953 INFO:teuthology.orchestra.run.smithi081.stdout: "options": {}, 2024-09-13T06:44:03.954 INFO:teuthology.orchestra.run.smithi081.stdout: "application_metadata": { 2024-09-13T06:44:03.954 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd": {} 2024-09-13T06:44:03.954 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:03.954 INFO:teuthology.orchestra.run.smithi081.stdout: "read_balance": { 2024-09-13T06:44:03.954 INFO:teuthology.orchestra.run.smithi081.stdout: "error_message": "pool 3 has some PGs where all OSDs are with primary_affinity 0 (at least pg 3.0), read balance score may not be reliable", 2024-09-13T06:44:03.954 INFO:teuthology.orchestra.run.smithi081.stdout: "score_acting": 0, 2024-09-13T06:44:03.954 INFO:teuthology.orchestra.run.smithi081.stdout: "score_stable": 0 2024-09-13T06:44:03.954 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:44:03.954 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:44:03.954 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-13T06:44:03.954 INFO:teuthology.orchestra.run.smithi081.stdout: "osds": [ 2024-09-13T06:44:03.954 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:03.955 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 0, 2024-09-13T06:44:03.955 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "54b0a3e4-58ad-4f95-86dc-29a11c9a1964", 2024-09-13T06:44:03.955 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2024-09-13T06:44:03.955 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2024-09-13T06:44:03.955 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2024-09-13T06:44:03.955 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 0, 2024-09-13T06:44:03.955 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2024-09-13T06:44:03.955 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2024-09-13T06:44:03.955 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2024-09-13T06:44:03.955 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 276, 2024-09-13T06:44:03.955 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2024-09-13T06:44:03.955 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2024-09-13T06:44:03.955 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-13T06:44:03.955 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:44:03.955 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:03.956 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:44:03.956 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6808", 2024-09-13T06:44:03.956 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 1904727940 2024-09-13T06:44:03.956 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:03.956 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:03.956 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:44:03.956 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6809", 2024-09-13T06:44:03.956 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 1904727940 2024-09-13T06:44:03.956 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:44:03.956 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:44:03.956 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:03.956 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2024-09-13T06:44:03.956 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:44:03.956 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:03.957 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:44:03.957 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6810", 2024-09-13T06:44:03.957 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 1904727940 2024-09-13T06:44:03.957 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:03.957 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:03.957 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:44:03.957 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6811", 2024-09-13T06:44:03.957 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 1904727940 2024-09-13T06:44:03.957 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:44:03.957 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:44:03.957 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:03.957 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2024-09-13T06:44:03.957 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:44:03.958 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:03.958 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:44:03.958 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6814", 2024-09-13T06:44:03.958 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 1904727940 2024-09-13T06:44:03.958 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:03.958 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:03.958 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:44:03.958 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6815", 2024-09-13T06:44:03.958 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 1904727940 2024-09-13T06:44:03.958 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:44:03.958 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:44:03.958 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:03.958 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2024-09-13T06:44:03.958 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:44:03.958 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:03.959 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:44:03.959 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6812", 2024-09-13T06:44:03.959 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 1904727940 2024-09-13T06:44:03.959 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:03.959 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:03.959 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:44:03.959 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6813", 2024-09-13T06:44:03.959 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 1904727940 2024-09-13T06:44:03.959 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:44:03.959 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:44:03.959 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:03.959 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6809/1904727940", 2024-09-13T06:44:03.959 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.81:6811/1904727940", 2024-09-13T06:44:03.960 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.81:6815/1904727940", 2024-09-13T06:44:03.960 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.81:6813/1904727940", 2024-09-13T06:44:03.960 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2024-09-13T06:44:03.960 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2024-09-13T06:44:03.960 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2024-09-13T06:44:03.960 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:44:03.960 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:03.960 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:03.960 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 1, 2024-09-13T06:44:03.960 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "a6dba5b9-c833-465e-a8a5-1741528b24c0", 2024-09-13T06:44:03.960 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2024-09-13T06:44:03.960 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 0, 2024-09-13T06:44:03.960 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-13T06:44:03.961 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2024-09-13T06:44:03.961 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2024-09-13T06:44:03.961 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2024-09-13T06:44:03.961 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2024-09-13T06:44:03.961 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 221, 2024-09-13T06:44:03.961 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2024-09-13T06:44:03.961 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2024-09-13T06:44:03.961 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-13T06:44:03.961 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:44:03.961 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:03.961 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:44:03.961 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6817", 2024-09-13T06:44:03.961 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 738205570 2024-09-13T06:44:03.961 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:03.962 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:03.962 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:44:03.962 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6819", 2024-09-13T06:44:03.962 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 738205570 2024-09-13T06:44:03.962 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:44:03.962 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:44:03.962 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:03.962 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2024-09-13T06:44:03.962 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:44:03.962 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:03.962 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:44:03.962 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6822", 2024-09-13T06:44:03.962 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 738205570 2024-09-13T06:44:03.962 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:03.963 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:03.963 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:44:03.963 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6824", 2024-09-13T06:44:03.963 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 738205570 2024-09-13T06:44:03.963 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:44:03.963 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:44:03.963 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:03.963 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2024-09-13T06:44:03.963 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:44:03.963 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:03.963 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:44:03.963 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6830", 2024-09-13T06:44:03.963 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 738205570 2024-09-13T06:44:03.963 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:03.964 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:03.964 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:44:03.964 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6831", 2024-09-13T06:44:03.964 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 738205570 2024-09-13T06:44:03.964 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:44:03.964 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:44:03.964 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:03.964 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2024-09-13T06:44:03.964 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:44:03.964 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:03.964 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:44:03.964 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6826", 2024-09-13T06:44:03.964 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 738205570 2024-09-13T06:44:03.964 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:03.965 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:03.965 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:44:03.965 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6829", 2024-09-13T06:44:03.965 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 738205570 2024-09-13T06:44:03.965 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:44:03.965 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:44:03.965 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:03.965 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6819/738205570", 2024-09-13T06:44:03.965 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.81:6824/738205570", 2024-09-13T06:44:03.965 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.81:6831/738205570", 2024-09-13T06:44:03.965 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.81:6829/738205570", 2024-09-13T06:44:03.965 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2024-09-13T06:44:03.965 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2024-09-13T06:44:03.965 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2024-09-13T06:44:03.966 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:44:03.966 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:03.966 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:03.966 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 2, 2024-09-13T06:44:03.966 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "6c45097e-44a2-454f-80a4-0fe879ccd52f", 2024-09-13T06:44:03.966 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2024-09-13T06:44:03.966 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 0, 2024-09-13T06:44:03.966 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-13T06:44:03.966 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2024-09-13T06:44:03.966 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2024-09-13T06:44:03.966 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2024-09-13T06:44:03.966 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2024-09-13T06:44:03.966 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 276, 2024-09-13T06:44:03.966 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2024-09-13T06:44:03.967 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2024-09-13T06:44:03.967 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-13T06:44:03.967 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:44:03.967 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:03.967 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:44:03.967 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6816", 2024-09-13T06:44:03.967 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 3558674335 2024-09-13T06:44:03.967 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:03.967 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:03.967 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:44:03.967 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6818", 2024-09-13T06:44:03.967 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 3558674335 2024-09-13T06:44:03.967 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:44:03.968 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:44:03.968 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:03.968 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2024-09-13T06:44:03.968 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:44:03.968 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:03.968 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:44:03.968 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6820", 2024-09-13T06:44:03.968 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 3558674335 2024-09-13T06:44:03.968 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:03.968 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:03.968 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:44:03.968 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6821", 2024-09-13T06:44:03.968 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 3558674335 2024-09-13T06:44:03.969 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:44:03.969 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:44:03.969 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:03.969 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2024-09-13T06:44:03.969 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:44:03.969 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:03.969 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:44:03.969 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6827", 2024-09-13T06:44:03.969 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 3558674335 2024-09-13T06:44:03.969 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:03.969 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:03.969 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:44:03.969 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6828", 2024-09-13T06:44:03.970 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 3558674335 2024-09-13T06:44:03.970 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:44:03.970 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:44:03.970 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:03.970 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2024-09-13T06:44:03.970 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:44:03.970 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:03.970 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:44:03.970 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6823", 2024-09-13T06:44:03.970 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 3558674335 2024-09-13T06:44:03.970 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:03.970 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:03.970 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:44:03.970 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6825", 2024-09-13T06:44:03.971 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 3558674335 2024-09-13T06:44:03.971 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:44:03.971 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:44:03.971 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:03.971 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6818/3558674335", 2024-09-13T06:44:03.971 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.81:6821/3558674335", 2024-09-13T06:44:03.971 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.81:6828/3558674335", 2024-09-13T06:44:03.971 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.81:6825/3558674335", 2024-09-13T06:44:03.971 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2024-09-13T06:44:03.971 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2024-09-13T06:44:03.971 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2024-09-13T06:44:03.971 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:44:03.971 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:03.972 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:03.972 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 3, 2024-09-13T06:44:03.972 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "31952760-06f3-4618-a5c4-f5c4fed3aadb", 2024-09-13T06:44:03.972 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2024-09-13T06:44:03.972 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2024-09-13T06:44:03.972 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2024-09-13T06:44:03.972 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2024-09-13T06:44:03.972 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2024-09-13T06:44:03.972 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2024-09-13T06:44:03.972 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2024-09-13T06:44:03.972 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 276, 2024-09-13T06:44:03.972 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2024-09-13T06:44:03.973 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2024-09-13T06:44:03.973 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-13T06:44:03.973 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:44:03.973 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:03.973 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:44:03.973 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6800", 2024-09-13T06:44:03.973 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 1886327229 2024-09-13T06:44:03.973 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:03.973 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:03.973 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:44:03.973 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6801", 2024-09-13T06:44:03.973 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 1886327229 2024-09-13T06:44:03.973 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:44:03.974 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:44:03.974 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:03.974 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2024-09-13T06:44:03.974 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:44:03.974 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:03.974 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:44:03.974 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6802", 2024-09-13T06:44:03.974 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 1886327229 2024-09-13T06:44:03.974 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:03.974 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:03.974 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:44:03.974 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6803", 2024-09-13T06:44:03.974 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 1886327229 2024-09-13T06:44:03.975 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:44:03.975 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:44:03.975 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:03.975 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2024-09-13T06:44:03.975 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:44:03.975 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:03.975 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:44:03.975 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6806", 2024-09-13T06:44:03.975 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 1886327229 2024-09-13T06:44:03.975 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:03.975 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:03.975 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:44:03.975 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6807", 2024-09-13T06:44:03.976 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 1886327229 2024-09-13T06:44:03.976 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:44:03.976 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:44:03.976 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:03.976 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2024-09-13T06:44:03.976 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:44:03.976 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:03.976 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:44:03.976 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6804", 2024-09-13T06:44:03.976 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 1886327229 2024-09-13T06:44:03.976 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:03.976 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:03.977 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:44:03.977 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6805", 2024-09-13T06:44:03.977 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 1886327229 2024-09-13T06:44:03.977 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:44:03.977 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:44:03.977 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:03.977 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6801/1886327229", 2024-09-13T06:44:03.977 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.81:6803/1886327229", 2024-09-13T06:44:03.977 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.81:6807/1886327229", 2024-09-13T06:44:03.977 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.81:6805/1886327229", 2024-09-13T06:44:03.977 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2024-09-13T06:44:03.977 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2024-09-13T06:44:03.977 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2024-09-13T06:44:03.978 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:44:03.978 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:03.978 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:03.978 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 4, 2024-09-13T06:44:03.978 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "c9bd2751-c836-43dc-b844-e13678cb2fd9", 2024-09-13T06:44:03.978 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2024-09-13T06:44:03.978 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2024-09-13T06:44:03.978 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0.58685302734375, 2024-09-13T06:44:03.978 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 0.649200439453125, 2024-09-13T06:44:03.978 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2024-09-13T06:44:03.978 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2024-09-13T06:44:03.978 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2024-09-13T06:44:03.979 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 277, 2024-09-13T06:44:03.979 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2024-09-13T06:44:03.979 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2024-09-13T06:44:03.979 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-13T06:44:03.979 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:44:03.979 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:03.979 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:44:03.979 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6817", 2024-09-13T06:44:03.979 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2184515621 2024-09-13T06:44:03.979 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:03.979 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:03.979 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:44:03.979 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6819", 2024-09-13T06:44:03.980 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2184515621 2024-09-13T06:44:03.980 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:44:03.980 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:44:03.980 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:03.980 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2024-09-13T06:44:03.980 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:44:03.980 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:03.980 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:44:03.980 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6820", 2024-09-13T06:44:03.980 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2184515621 2024-09-13T06:44:03.980 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:03.980 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:03.980 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:44:03.981 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6822", 2024-09-13T06:44:03.981 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2184515621 2024-09-13T06:44:03.981 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:44:03.981 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:44:03.981 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:03.981 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2024-09-13T06:44:03.981 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:44:03.981 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:03.981 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:44:03.981 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6827", 2024-09-13T06:44:03.981 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2184515621 2024-09-13T06:44:03.981 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:03.981 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:03.981 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:44:03.982 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6829", 2024-09-13T06:44:03.982 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2184515621 2024-09-13T06:44:03.982 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:44:03.982 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:44:03.982 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:03.982 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2024-09-13T06:44:03.982 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:44:03.982 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:03.982 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:44:03.982 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6824", 2024-09-13T06:44:03.982 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2184515621 2024-09-13T06:44:03.982 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:03.982 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:03.982 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:44:03.983 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6826", 2024-09-13T06:44:03.983 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2184515621 2024-09-13T06:44:03.983 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:44:03.983 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:44:03.983 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:03.983 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.139:6819/2184515621", 2024-09-13T06:44:03.983 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.139:6822/2184515621", 2024-09-13T06:44:03.983 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.139:6829/2184515621", 2024-09-13T06:44:03.983 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.139:6826/2184515621", 2024-09-13T06:44:03.983 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2024-09-13T06:44:03.983 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2024-09-13T06:44:03.983 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2024-09-13T06:44:03.983 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:44:03.983 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:03.984 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:03.984 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 5, 2024-09-13T06:44:03.984 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "2971b93a-6c9f-4b77-b526-4eac788fabf9", 2024-09-13T06:44:03.984 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2024-09-13T06:44:03.984 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2024-09-13T06:44:03.984 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2024-09-13T06:44:03.984 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 0, 2024-09-13T06:44:03.984 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2024-09-13T06:44:03.984 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2024-09-13T06:44:03.984 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2024-09-13T06:44:03.984 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 276, 2024-09-13T06:44:03.984 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 0, 2024-09-13T06:44:03.984 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2024-09-13T06:44:03.985 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-13T06:44:03.985 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:44:03.985 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:03.985 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:44:03.985 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6816", 2024-09-13T06:44:03.985 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 3982901834 2024-09-13T06:44:03.985 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:03.985 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:03.985 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:44:03.985 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6818", 2024-09-13T06:44:03.985 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 3982901834 2024-09-13T06:44:03.985 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:44:03.986 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:44:03.986 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:03.986 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2024-09-13T06:44:03.986 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:44:03.986 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:03.986 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:44:03.986 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6821", 2024-09-13T06:44:03.986 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 3982901834 2024-09-13T06:44:03.986 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:03.986 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:03.986 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:44:03.986 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6823", 2024-09-13T06:44:03.986 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 3982901834 2024-09-13T06:44:03.986 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:44:03.987 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:44:03.987 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:03.987 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2024-09-13T06:44:03.987 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:44:03.987 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:03.987 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:44:03.987 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6830", 2024-09-13T06:44:03.987 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 3982901834 2024-09-13T06:44:03.987 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:03.987 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:03.987 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:44:03.987 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6831", 2024-09-13T06:44:03.987 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 3982901834 2024-09-13T06:44:03.988 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:44:03.988 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:44:03.988 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:03.988 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2024-09-13T06:44:03.988 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:44:03.988 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:03.988 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:44:03.988 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6825", 2024-09-13T06:44:03.988 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 3982901834 2024-09-13T06:44:03.988 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:03.988 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:03.988 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:44:03.988 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6828", 2024-09-13T06:44:03.989 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 3982901834 2024-09-13T06:44:03.989 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:44:03.989 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:44:03.989 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:03.989 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.139:6818/3982901834", 2024-09-13T06:44:03.989 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.139:6823/3982901834", 2024-09-13T06:44:03.989 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.139:6831/3982901834", 2024-09-13T06:44:03.989 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.139:6828/3982901834", 2024-09-13T06:44:03.989 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2024-09-13T06:44:03.989 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2024-09-13T06:44:03.989 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2024-09-13T06:44:03.989 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:44:03.989 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:03.990 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:03.990 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 6, 2024-09-13T06:44:03.990 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "e1f786ce-579e-48cc-b212-83f881b94184", 2024-09-13T06:44:03.990 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 0, 2024-09-13T06:44:03.990 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 0, 2024-09-13T06:44:03.990 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-13T06:44:03.990 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 0.5466766357421875, 2024-09-13T06:44:03.990 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 0, 2024-09-13T06:44:03.990 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 0, 2024-09-13T06:44:03.990 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 13, 2024-09-13T06:44:03.990 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 170, 2024-09-13T06:44:03.990 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 209, 2024-09-13T06:44:03.990 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2024-09-13T06:44:03.990 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-13T06:44:03.990 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:44:03.991 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:03.991 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:44:03.991 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6800", 2024-09-13T06:44:03.991 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2283932666 2024-09-13T06:44:03.991 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:03.991 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:03.991 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:44:03.991 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6801", 2024-09-13T06:44:03.991 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2283932666 2024-09-13T06:44:03.991 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:44:03.991 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:44:03.991 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:03.991 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2024-09-13T06:44:03.992 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:44:03.992 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:03.992 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:44:03.992 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6802", 2024-09-13T06:44:03.992 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2283932666 2024-09-13T06:44:03.992 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:03.992 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:03.992 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:44:03.992 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6803", 2024-09-13T06:44:03.992 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2283932666 2024-09-13T06:44:03.992 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:44:03.992 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:44:03.992 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:03.993 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2024-09-13T06:44:03.993 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:44:03.993 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:03.993 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:44:03.993 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6806", 2024-09-13T06:44:03.993 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2283932666 2024-09-13T06:44:03.993 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:03.993 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:03.993 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:44:03.993 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6807", 2024-09-13T06:44:03.993 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2283932666 2024-09-13T06:44:03.993 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:44:03.993 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:44:03.993 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:03.994 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2024-09-13T06:44:03.994 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:44:03.994 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:03.994 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:44:03.994 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6804", 2024-09-13T06:44:03.994 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2283932666 2024-09-13T06:44:03.994 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:03.994 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:03.994 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:44:03.994 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6805", 2024-09-13T06:44:03.994 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2283932666 2024-09-13T06:44:03.994 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:44:03.994 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:44:03.995 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:03.995 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.139:6801/2283932666", 2024-09-13T06:44:03.995 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.139:6803/2283932666", 2024-09-13T06:44:03.995 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.139:6807/2283932666", 2024-09-13T06:44:03.995 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.139:6805/2283932666", 2024-09-13T06:44:03.995 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2024-09-13T06:44:03.995 INFO:teuthology.orchestra.run.smithi081.stdout: "exists" 2024-09-13T06:44:03.995 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:44:03.995 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:03.995 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:03.995 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 7, 2024-09-13T06:44:03.995 INFO:teuthology.orchestra.run.smithi081.stdout: "uuid": "a287ddf6-84eb-4225-b267-25eee1657625", 2024-09-13T06:44:03.995 INFO:teuthology.orchestra.run.smithi081.stdout: "up": 1, 2024-09-13T06:44:03.996 INFO:teuthology.orchestra.run.smithi081.stdout: "in": 1, 2024-09-13T06:44:03.996 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 1, 2024-09-13T06:44:03.996 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_affinity": 1, 2024-09-13T06:44:03.996 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_begin": 13, 2024-09-13T06:44:03.996 INFO:teuthology.orchestra.run.smithi081.stdout: "last_clean_end": 121, 2024-09-13T06:44:03.996 INFO:teuthology.orchestra.run.smithi081.stdout: "up_from": 187, 2024-09-13T06:44:03.996 INFO:teuthology.orchestra.run.smithi081.stdout: "up_thru": 276, 2024-09-13T06:44:03.996 INFO:teuthology.orchestra.run.smithi081.stdout: "down_at": 122, 2024-09-13T06:44:03.996 INFO:teuthology.orchestra.run.smithi081.stdout: "lost_at": 0, 2024-09-13T06:44:03.996 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-13T06:44:03.996 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:44:03.996 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:03.997 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:44:03.997 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6808", 2024-09-13T06:44:03.997 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 105054579 2024-09-13T06:44:03.997 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:03.997 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:03.997 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:44:03.997 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6809", 2024-09-13T06:44:03.997 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 105054579 2024-09-13T06:44:03.997 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:44:03.997 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:44:03.997 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:03.997 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addrs": { 2024-09-13T06:44:03.997 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:44:03.997 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:03.998 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:44:03.998 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6810", 2024-09-13T06:44:03.998 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 105054579 2024-09-13T06:44:03.998 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:03.998 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:03.998 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:44:03.998 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6811", 2024-09-13T06:44:03.998 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 105054579 2024-09-13T06:44:03.998 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:44:03.998 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:44:03.998 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:03.998 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addrs": { 2024-09-13T06:44:03.998 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:44:03.999 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:03.999 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:44:03.999 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6814", 2024-09-13T06:44:03.999 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 105054579 2024-09-13T06:44:03.999 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:03.999 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:03.999 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:44:03.999 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6815", 2024-09-13T06:44:03.999 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 105054579 2024-09-13T06:44:03.999 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:44:03.999 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:44:03.999 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:03.999 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addrs": { 2024-09-13T06:44:04.000 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-13T06:44:04.000 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:04.000 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-13T06:44:04.000 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6812", 2024-09-13T06:44:04.000 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 105054579 2024-09-13T06:44:04.000 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:04.000 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:04.000 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T06:44:04.000 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.139:6813", 2024-09-13T06:44:04.000 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 105054579 2024-09-13T06:44:04.000 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:44:04.000 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:44:04.000 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:04.001 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.139:6809/105054579", 2024-09-13T06:44:04.001 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_addr": "172.21.15.139:6811/105054579", 2024-09-13T06:44:04.001 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_back_addr": "172.21.15.139:6815/105054579", 2024-09-13T06:44:04.001 INFO:teuthology.orchestra.run.smithi081.stdout: "heartbeat_front_addr": "172.21.15.139:6813/105054579", 2024-09-13T06:44:04.001 INFO:teuthology.orchestra.run.smithi081.stdout: "state": [ 2024-09-13T06:44:04.001 INFO:teuthology.orchestra.run.smithi081.stdout: "exists", 2024-09-13T06:44:04.001 INFO:teuthology.orchestra.run.smithi081.stdout: "up" 2024-09-13T06:44:04.001 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:44:04.001 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:44:04.001 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-13T06:44:04.001 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_xinfo": [ 2024-09-13T06:44:04.001 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:04.001 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 0, 2024-09-13T06:44:04.002 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2024-09-13T06:44:04.002 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2024-09-13T06:44:04.002 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2024-09-13T06:44:04.002 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138322906710015, 2024-09-13T06:44:04.002 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2024-09-13T06:44:04.002 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2024-09-13T06:39:05.476871+0000", 2024-09-13T06:44:04.002 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2024-09-13T06:44:04.002 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:04.002 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:04.002 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 1, 2024-09-13T06:44:04.002 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2024-09-13T06:44:04.002 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2024-09-13T06:44:04.002 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2024-09-13T06:44:04.002 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138322906710015, 2024-09-13T06:44:04.003 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 65536, 2024-09-13T06:44:04.003 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2024-09-13T06:39:05.455183+0000", 2024-09-13T06:44:04.003 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2024-09-13T06:44:04.003 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:04.003 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:04.003 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 2, 2024-09-13T06:44:04.003 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2024-09-13T06:44:04.003 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2024-09-13T06:44:04.003 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2024-09-13T06:44:04.003 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138322906710015, 2024-09-13T06:44:04.003 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 65536, 2024-09-13T06:44:04.003 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2024-09-13T06:39:05.504853+0000", 2024-09-13T06:44:04.003 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2024-09-13T06:44:04.003 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:04.004 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:04.004 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 3, 2024-09-13T06:44:04.004 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2024-09-13T06:44:04.004 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2024-09-13T06:44:04.004 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2024-09-13T06:44:04.004 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138322906710015, 2024-09-13T06:44:04.004 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2024-09-13T06:44:04.004 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2024-09-13T06:39:05.372429+0000", 2024-09-13T06:44:04.004 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2024-09-13T06:44:04.004 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:04.004 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:04.004 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 4, 2024-09-13T06:44:04.004 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2024-09-13T06:44:04.005 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2024-09-13T06:44:04.005 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2024-09-13T06:44:04.005 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138322906710015, 2024-09-13T06:44:04.005 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2024-09-13T06:44:04.005 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2024-09-13T06:39:05.421023+0000", 2024-09-13T06:44:04.005 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2024-09-13T06:44:04.005 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:04.005 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:04.005 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 5, 2024-09-13T06:44:04.005 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2024-09-13T06:44:04.005 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2024-09-13T06:44:04.005 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2024-09-13T06:44:04.005 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138322906710015, 2024-09-13T06:44:04.005 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2024-09-13T06:44:04.006 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2024-09-13T06:39:05.477489+0000", 2024-09-13T06:44:04.006 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 0 2024-09-13T06:44:04.006 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:04.006 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:04.006 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 6, 2024-09-13T06:44:04.006 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2024-09-13T06:44:04.006 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2024-09-13T06:44:04.006 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2024-09-13T06:44:04.006 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138322906710015, 2024-09-13T06:44:04.006 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 65536, 2024-09-13T06:44:04.006 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2024-09-13T06:39:05.314700+0000", 2024-09-13T06:44:04.006 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 209 2024-09-13T06:44:04.006 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:04.006 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:04.007 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": 7, 2024-09-13T06:44:04.007 INFO:teuthology.orchestra.run.smithi081.stdout: "down_stamp": "0.000000", 2024-09-13T06:44:04.007 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_probability": 0, 2024-09-13T06:44:04.007 INFO:teuthology.orchestra.run.smithi081.stdout: "laggy_interval": 0, 2024-09-13T06:44:04.007 INFO:teuthology.orchestra.run.smithi081.stdout: "features": 4540138322906710015, 2024-09-13T06:44:04.007 INFO:teuthology.orchestra.run.smithi081.stdout: "old_weight": 0, 2024-09-13T06:44:04.007 INFO:teuthology.orchestra.run.smithi081.stdout: "last_purged_snaps_scrub": "2024-09-13T06:39:05.462229+0000", 2024-09-13T06:44:04.007 INFO:teuthology.orchestra.run.smithi081.stdout: "dead_epoch": 122 2024-09-13T06:44:04.007 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:44:04.007 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-13T06:44:04.007 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_upmap": [ 2024-09-13T06:44:04.007 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:04.007 INFO:teuthology.orchestra.run.smithi081.stdout: "pgid": "3.9", 2024-09-13T06:44:04.008 INFO:teuthology.orchestra.run.smithi081.stdout: "osds": [ 2024-09-13T06:44:04.008 INFO:teuthology.orchestra.run.smithi081.stdout: 2, 2024-09-13T06:44:04.008 INFO:teuthology.orchestra.run.smithi081.stdout: 6 2024-09-13T06:44:04.008 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:44:04.008 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:04.008 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:04.008 INFO:teuthology.orchestra.run.smithi081.stdout: "pgid": "3.1a", 2024-09-13T06:44:04.008 INFO:teuthology.orchestra.run.smithi081.stdout: "osds": [ 2024-09-13T06:44:04.008 INFO:teuthology.orchestra.run.smithi081.stdout: 5, 2024-09-13T06:44:04.008 INFO:teuthology.orchestra.run.smithi081.stdout: 2 2024-09-13T06:44:04.008 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:44:04.008 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:44:04.008 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-13T06:44:04.009 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_upmap_items": [], 2024-09-13T06:44:04.009 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_upmap_primaries": [], 2024-09-13T06:44:04.009 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_temp": [], 2024-09-13T06:44:04.009 INFO:teuthology.orchestra.run.smithi081.stdout: "primary_temp": [], 2024-09-13T06:44:04.009 INFO:teuthology.orchestra.run.smithi081.stdout: "blocklist": {}, 2024-09-13T06:44:04.012 INFO:teuthology.orchestra.run.smithi081.stdout: "range_blocklist": {}, 2024-09-13T06:44:04.012 INFO:teuthology.orchestra.run.smithi081.stdout: "erasure_code_profiles": { 2024-09-13T06:44:04.012 INFO:teuthology.orchestra.run.smithi081.stdout: "default": { 2024-09-13T06:44:04.012 INFO:teuthology.orchestra.run.smithi081.stdout: "crush-failure-domain": "osd", 2024-09-13T06:44:04.012 INFO:teuthology.orchestra.run.smithi081.stdout: "k": "2", 2024-09-13T06:44:04.013 INFO:teuthology.orchestra.run.smithi081.stdout: "m": "1", 2024-09-13T06:44:04.013 INFO:teuthology.orchestra.run.smithi081.stdout: "plugin": "jerasure", 2024-09-13T06:44:04.013 INFO:teuthology.orchestra.run.smithi081.stdout: "technique": "reed_sol_van" 2024-09-13T06:44:04.013 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:44:04.013 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:04.013 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_snaps_queue": [ 2024-09-13T06:44:04.013 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:04.013 INFO:teuthology.orchestra.run.smithi081.stdout: "pool": 3, 2024-09-13T06:44:04.013 INFO:teuthology.orchestra.run.smithi081.stdout: "snaps": [ 2024-09-13T06:44:04.013 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:04.013 INFO:teuthology.orchestra.run.smithi081.stdout: "begin": 10, 2024-09-13T06:44:04.013 INFO:teuthology.orchestra.run.smithi081.stdout: "length": 1 2024-09-13T06:44:04.013 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:04.013 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:04.014 INFO:teuthology.orchestra.run.smithi081.stdout: "begin": 13, 2024-09-13T06:44:04.014 INFO:teuthology.orchestra.run.smithi081.stdout: "length": 1 2024-09-13T06:44:04.014 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:04.014 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:04.014 INFO:teuthology.orchestra.run.smithi081.stdout: "begin": 16, 2024-09-13T06:44:04.014 INFO:teuthology.orchestra.run.smithi081.stdout: "length": 1 2024-09-13T06:44:04.014 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:04.014 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:04.014 INFO:teuthology.orchestra.run.smithi081.stdout: "begin": 19, 2024-09-13T06:44:04.014 INFO:teuthology.orchestra.run.smithi081.stdout: "length": 1 2024-09-13T06:44:04.014 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:04.014 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:04.014 INFO:teuthology.orchestra.run.smithi081.stdout: "begin": 22, 2024-09-13T06:44:04.014 INFO:teuthology.orchestra.run.smithi081.stdout: "length": 1 2024-09-13T06:44:04.015 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:44:04.015 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:44:04.015 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:44:04.015 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-13T06:44:04.015 INFO:teuthology.orchestra.run.smithi081.stdout: "new_removed_snaps": [], 2024-09-13T06:44:04.015 INFO:teuthology.orchestra.run.smithi081.stdout: "new_purged_snaps": [], 2024-09-13T06:44:04.015 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_node_flags": {}, 2024-09-13T06:44:04.015 INFO:teuthology.orchestra.run.smithi081.stdout: "device_class_flags": {}, 2024-09-13T06:44:04.015 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": { 2024-09-13T06:44:04.015 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode_enabled": false, 2024-09-13T06:44:04.015 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_bucket_count": 0, 2024-09-13T06:44:04.015 INFO:teuthology.orchestra.run.smithi081.stdout: "degraded_stretch_mode": 0, 2024-09-13T06:44:04.015 INFO:teuthology.orchestra.run.smithi081.stdout: "recovering_stretch_mode": 0, 2024-09-13T06:44:04.015 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode_bucket": 0 2024-09-13T06:44:04.016 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:44:04.016 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:44:04.017 INFO:tasks.thrashosds.thrasher:j is {'epoch': 278, 'fsid': 'e5612297-d004-4957-927e-afa37f30d6cf', 'created': '2024-09-13T06:38:56.670231+0000', 'modified': '2024-09-13T06:44:03.425399+0000', 'last_up_change': '2024-09-13T06:42:51.723548+0000', 'last_in_change': '2024-09-13T06:43:58.590847+0000', 'flags': 'noscrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5801984, 'flags_set': ['noscrub', 'pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 5, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 3, 'max_osd': 8, 'require_min_compat_client': 'luminous', 'min_compat_client': 'luminous', 'require_osd_release': 'reef', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T06:39:09.600726+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 6.059999942779541, 'score_stable': 6.059999942779541, 'optimal_score': 0.33000001311302185, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 0.6494846343994141, 'average_primary_affinity': 0.8700000047683716, 'average_primary_affinity_weighted': 0.6499999761581421}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-09-13T06:39:15.802118+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 3, 'snap_epoch': 20, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'error_message': 'pool 2 has some PGs where all OSDs are with primary_affinity 0 (at least pg 2.2), read balance score may not be reliable', 'score_acting': 0, 'score_stable': 0}}, {'pool': 3, 'pool_name': 'pool_client.0', 'create_time': '2024-09-13T06:39:25.648942+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '276', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 173, 'snap_epoch': 276, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'error_message': 'pool 3 has some PGs where all OSDs are with primary_affinity 0 (at least pg 3.0), read balance score may not be reliable', 'score_acting': 0, 'score_stable': 0}}], 'osds': [{'osd': 0, 'uuid': '54b0a3e4-58ad-4f95-86dc-29a11c9a1964', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 0, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 276, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6808', 'nonce': 1904727940}, {'type': 'v1', 'addr': '172.21.15.81:6809', 'nonce': 1904727940}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6810', 'nonce': 1904727940}, {'type': 'v1', 'addr': '172.21.15.81:6811', 'nonce': 1904727940}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6814', 'nonce': 1904727940}, {'type': 'v1', 'addr': '172.21.15.81:6815', 'nonce': 1904727940}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6812', 'nonce': 1904727940}, {'type': 'v1', 'addr': '172.21.15.81:6813', 'nonce': 1904727940}]}, 'public_addr': '172.21.15.81:6809/1904727940', 'cluster_addr': '172.21.15.81:6811/1904727940', 'heartbeat_back_addr': '172.21.15.81:6815/1904727940', 'heartbeat_front_addr': '172.21.15.81:6813/1904727940', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': 'a6dba5b9-c833-465e-a8a5-1741528b24c0', 'up': 1, 'in': 0, 'weight': 0, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 221, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6817', 'nonce': 738205570}, {'type': 'v1', 'addr': '172.21.15.81:6819', 'nonce': 738205570}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6822', 'nonce': 738205570}, {'type': 'v1', 'addr': '172.21.15.81:6824', 'nonce': 738205570}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6830', 'nonce': 738205570}, {'type': 'v1', 'addr': '172.21.15.81:6831', 'nonce': 738205570}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6826', 'nonce': 738205570}, {'type': 'v1', 'addr': '172.21.15.81:6829', 'nonce': 738205570}]}, 'public_addr': '172.21.15.81:6819/738205570', 'cluster_addr': '172.21.15.81:6824/738205570', 'heartbeat_back_addr': '172.21.15.81:6831/738205570', 'heartbeat_front_addr': '172.21.15.81:6829/738205570', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': '6c45097e-44a2-454f-80a4-0fe879ccd52f', 'up': 1, 'in': 0, 'weight': 0, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 276, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6816', 'nonce': 3558674335}, {'type': 'v1', 'addr': '172.21.15.81:6818', 'nonce': 3558674335}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6820', 'nonce': 3558674335}, {'type': 'v1', 'addr': '172.21.15.81:6821', 'nonce': 3558674335}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6827', 'nonce': 3558674335}, {'type': 'v1', 'addr': '172.21.15.81:6828', 'nonce': 3558674335}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6823', 'nonce': 3558674335}, {'type': 'v1', 'addr': '172.21.15.81:6825', 'nonce': 3558674335}]}, 'public_addr': '172.21.15.81:6818/3558674335', 'cluster_addr': '172.21.15.81:6821/3558674335', 'heartbeat_back_addr': '172.21.15.81:6828/3558674335', 'heartbeat_front_addr': '172.21.15.81:6825/3558674335', 'state': ['exists', 'up']}, {'osd': 3, 'uuid': '31952760-06f3-4618-a5c4-f5c4fed3aadb', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 276, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6800', 'nonce': 1886327229}, {'type': 'v1', 'addr': '172.21.15.81:6801', 'nonce': 1886327229}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6802', 'nonce': 1886327229}, {'type': 'v1', 'addr': '172.21.15.81:6803', 'nonce': 1886327229}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6806', 'nonce': 1886327229}, {'type': 'v1', 'addr': '172.21.15.81:6807', 'nonce': 1886327229}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6804', 'nonce': 1886327229}, {'type': 'v1', 'addr': '172.21.15.81:6805', 'nonce': 1886327229}]}, 'public_addr': '172.21.15.81:6801/1886327229', 'cluster_addr': '172.21.15.81:6803/1886327229', 'heartbeat_back_addr': '172.21.15.81:6807/1886327229', 'heartbeat_front_addr': '172.21.15.81:6805/1886327229', 'state': ['exists', 'up']}, {'osd': 4, 'uuid': 'c9bd2751-c836-43dc-b844-e13678cb2fd9', 'up': 1, 'in': 1, 'weight': 0.58685302734375, 'primary_affinity': 0.649200439453125, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 277, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.139:6817', 'nonce': 2184515621}, {'type': 'v1', 'addr': '172.21.15.139:6819', 'nonce': 2184515621}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.139:6820', 'nonce': 2184515621}, {'type': 'v1', 'addr': '172.21.15.139:6822', 'nonce': 2184515621}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.139:6827', 'nonce': 2184515621}, {'type': 'v1', 'addr': '172.21.15.139:6829', 'nonce': 2184515621}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.139:6824', 'nonce': 2184515621}, {'type': 'v1', 'addr': '172.21.15.139:6826', 'nonce': 2184515621}]}, 'public_addr': '172.21.15.139:6819/2184515621', 'cluster_addr': '172.21.15.139:6822/2184515621', 'heartbeat_back_addr': '172.21.15.139:6829/2184515621', 'heartbeat_front_addr': '172.21.15.139:6826/2184515621', 'state': ['exists', 'up']}, {'osd': 5, 'uuid': '2971b93a-6c9f-4b77-b526-4eac788fabf9', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 0, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 276, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.139:6816', 'nonce': 3982901834}, {'type': 'v1', 'addr': '172.21.15.139:6818', 'nonce': 3982901834}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.139:6821', 'nonce': 3982901834}, {'type': 'v1', 'addr': '172.21.15.139:6823', 'nonce': 3982901834}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.139:6830', 'nonce': 3982901834}, {'type': 'v1', 'addr': '172.21.15.139:6831', 'nonce': 3982901834}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.139:6825', 'nonce': 3982901834}, {'type': 'v1', 'addr': '172.21.15.139:6828', 'nonce': 3982901834}]}, 'public_addr': '172.21.15.139:6818/3982901834', 'cluster_addr': '172.21.15.139:6823/3982901834', 'heartbeat_back_addr': '172.21.15.139:6831/3982901834', 'heartbeat_front_addr': '172.21.15.139:6828/3982901834', 'state': ['exists', 'up']}, {'osd': 6, 'uuid': 'e1f786ce-579e-48cc-b212-83f881b94184', 'up': 0, 'in': 0, 'weight': 0, 'primary_affinity': 0.5466766357421875, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 170, 'down_at': 209, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.139:6800', 'nonce': 2283932666}, {'type': 'v1', 'addr': '172.21.15.139:6801', 'nonce': 2283932666}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.139:6802', 'nonce': 2283932666}, {'type': 'v1', 'addr': '172.21.15.139:6803', 'nonce': 2283932666}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.139:6806', 'nonce': 2283932666}, {'type': 'v1', 'addr': '172.21.15.139:6807', 'nonce': 2283932666}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.139:6804', 'nonce': 2283932666}, {'type': 'v1', 'addr': '172.21.15.139:6805', 'nonce': 2283932666}]}, 'public_addr': '172.21.15.139:6801/2283932666', 'cluster_addr': '172.21.15.139:6803/2283932666', 'heartbeat_back_addr': '172.21.15.139:6807/2283932666', 'heartbeat_front_addr': '172.21.15.139:6805/2283932666', 'state': ['exists']}, {'osd': 7, 'uuid': 'a287ddf6-84eb-4225-b267-25eee1657625', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 13, 'last_clean_end': 121, 'up_from': 187, 'up_thru': 276, 'down_at': 122, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.139:6808', 'nonce': 105054579}, {'type': 'v1', 'addr': '172.21.15.139:6809', 'nonce': 105054579}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.139:6810', 'nonce': 105054579}, {'type': 'v1', 'addr': '172.21.15.139:6811', 'nonce': 105054579}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.139:6814', 'nonce': 105054579}, {'type': 'v1', 'addr': '172.21.15.139:6815', 'nonce': 105054579}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.139:6812', 'nonce': 105054579}, {'type': 'v1', 'addr': '172.21.15.139:6813', 'nonce': 105054579}]}, 'public_addr': '172.21.15.139:6809/105054579', 'cluster_addr': '172.21.15.139:6811/105054579', 'heartbeat_back_addr': '172.21.15.139:6815/105054579', 'heartbeat_front_addr': '172.21.15.139:6813/105054579', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-13T06:39:05.476871+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 65536, 'last_purged_snaps_scrub': '2024-09-13T06:39:05.455183+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 65536, 'last_purged_snaps_scrub': '2024-09-13T06:39:05.504853+0000', 'dead_epoch': 0}, {'osd': 3, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-13T06:39:05.372429+0000', 'dead_epoch': 0}, {'osd': 4, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-13T06:39:05.421023+0000', 'dead_epoch': 0}, {'osd': 5, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-13T06:39:05.477489+0000', 'dead_epoch': 0}, {'osd': 6, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 65536, 'last_purged_snaps_scrub': '2024-09-13T06:39:05.314700+0000', 'dead_epoch': 209}, {'osd': 7, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-13T06:39:05.462229+0000', 'dead_epoch': 122}], 'pg_upmap': [{'pgid': '3.9', 'osds': [2, 6]}, {'pgid': '3.1a', 'osds': [5, 2]}], 'pg_upmap_items': [], 'pg_upmap_primaries': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [{'pool': 3, 'snaps': [{'begin': 10, 'length': 1}, {'begin': 13, 'length': 1}, {'begin': 16, 'length': 1}, {'begin': 19, 'length': 1}, {'begin': 22, 'length': 1}]}], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-09-13T06:44:04.018 INFO:tasks.thrashosds.thrasher:Clearing pg_upmap on 3.1a 2024-09-13T06:44:04.018 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd rm-pg-upmap 3.1a 2024-09-13T06:44:04.018 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-13T06:44:04.016+0000 7fa8bb18e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 36790) UID: 0 2024-09-13T06:44:04.118 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:44:04.119+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:44:04.149 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:44:04.149 INFO:teuthology.orchestra.run.smithi139.stdout: "size": 20, 2024-09-13T06:44:04.149 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 600, 2024-09-13T06:44:04.149 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [ 2024-09-13T06:44:04.149 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.149 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43299 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 432128~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:44:04.149 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589881+0000", 2024-09-13T06:44:04.150 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 222.55802754499999, 2024-09-13T06:44:04.150 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.079693849999999997, 2024-09-13T06:44:04.150 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:44:04.150 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:44:04.150 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:44:04.150 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:44:04.150 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:44:04.150 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43299 2024-09-13T06:44:04.150 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.150 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:44:04.150 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.150 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:44:04.150 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589881+0000", 2024-09-13T06:44:04.151 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:44:04.151 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.151 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.151 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:44:04.151 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589881+0000", 2024-09-13T06:44:04.151 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:44:04.151 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.151 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.151 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:44:04.151 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589880+0000", 2024-09-13T06:44:04.151 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:44:04.151 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.151 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.152 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:44:04.152 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589884+0000", 2024-09-13T06:44:04.152 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.053e-06 2024-09-13T06:44:04.152 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.152 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.152 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:44:04.152 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589893+0000", 2024-09-13T06:44:04.152 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.2129999999999997e-06 2024-09-13T06:44:04.152 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.152 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.152 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:44:04.152 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589901+0000", 2024-09-13T06:44:04.152 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.6399999999999997e-06 2024-09-13T06:44:04.153 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.153 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.153 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:44:04.153 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.669213+0000", 2024-09-13T06:44:04.153 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.079312074999999996 2024-09-13T06:44:04.153 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.153 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.153 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:44:04.153 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.669281+0000", 2024-09-13T06:44:04.153 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.8322000000000001e-05 2024-09-13T06:44:04.153 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.153 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.154 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:44:04.154 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.669575+0000", 2024-09-13T06:44:04.154 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00029349699999999999 2024-09-13T06:44:04.154 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:44:04.154 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:44:04.154 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:44:04.154 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.154 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.154 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43300 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 446464~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:44:04.154 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589909+0000", 2024-09-13T06:44:04.154 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 222.55799965, 2024-09-13T06:44:04.154 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.080339496999999996, 2024-09-13T06:44:04.154 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:44:04.154 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:44:04.155 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:44:04.155 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:44:04.155 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:44:04.155 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43300 2024-09-13T06:44:04.155 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.155 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:44:04.155 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.155 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:44:04.155 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589909+0000", 2024-09-13T06:44:04.155 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:44:04.155 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.155 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.155 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:44:04.155 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589909+0000", 2024-09-13T06:44:04.156 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:44:04.156 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.156 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.156 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:44:04.156 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589908+0000", 2024-09-13T06:44:04.156 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:44:04.156 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.156 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.156 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:44:04.156 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589912+0000", 2024-09-13T06:44:04.156 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.9430000000000002e-06 2024-09-13T06:44:04.157 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.157 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.157 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:44:04.157 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589920+0000", 2024-09-13T06:44:04.157 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.3860000000000007e-06 2024-09-13T06:44:04.157 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.157 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.157 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:44:04.157 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589928+0000", 2024-09-13T06:44:04.157 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.3329999999999999e-06 2024-09-13T06:44:04.157 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.157 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.157 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:44:04.157 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.669651+0000", 2024-09-13T06:44:04.158 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.079723204000000006 2024-09-13T06:44:04.158 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.158 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.158 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:44:04.158 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.669840+0000", 2024-09-13T06:44:04.158 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000189397 2024-09-13T06:44:04.158 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.158 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.158 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:44:04.158 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.670248+0000", 2024-09-13T06:44:04.158 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00040811100000000001 2024-09-13T06:44:04.158 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:44:04.158 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:44:04.159 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:44:04.159 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.159 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.159 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43301 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 460800~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:44:04.159 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589934+0000", 2024-09-13T06:44:04.159 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 222.557974976, 2024-09-13T06:44:04.159 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.080747474999999999, 2024-09-13T06:44:04.159 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:44:04.159 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:44:04.159 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:44:04.159 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:44:04.159 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:44:04.160 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43301 2024-09-13T06:44:04.160 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.160 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:44:04.160 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.160 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:44:04.160 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589934+0000", 2024-09-13T06:44:04.160 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:44:04.160 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.160 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.160 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:44:04.160 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589934+0000", 2024-09-13T06:44:04.160 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:44:04.160 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.161 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.161 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:44:04.161 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589933+0000", 2024-09-13T06:44:04.161 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:44:04.161 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.161 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.161 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:44:04.161 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589936+0000", 2024-09-13T06:44:04.161 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.4599999999999999e-06 2024-09-13T06:44:04.161 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.161 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.161 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:44:04.162 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589945+0000", 2024-09-13T06:44:04.162 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.2430000000000005e-06 2024-09-13T06:44:04.162 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.162 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.162 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:44:04.162 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589952+0000", 2024-09-13T06:44:04.162 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.3289999999999996e-06 2024-09-13T06:44:04.162 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.162 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.162 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:44:04.162 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.670280+0000", 2024-09-13T06:44:04.162 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.080328514000000004 2024-09-13T06:44:04.162 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.162 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.163 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:44:04.163 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.670376+0000", 2024-09-13T06:44:04.163 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.5752000000000001e-05 2024-09-13T06:44:04.163 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.163 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.163 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:44:04.163 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.670681+0000", 2024-09-13T06:44:04.163 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00030479699999999999 2024-09-13T06:44:04.163 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:44:04.163 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:44:04.163 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:44:04.163 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.163 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.163 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43302 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 475136~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:44:04.164 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589958+0000", 2024-09-13T06:44:04.164 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 222.557950914, 2024-09-13T06:44:04.164 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.081402394000000003, 2024-09-13T06:44:04.164 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:44:04.164 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:44:04.164 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:44:04.164 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:44:04.164 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:44:04.164 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43302 2024-09-13T06:44:04.164 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.164 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:44:04.164 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.164 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:44:04.165 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589958+0000", 2024-09-13T06:44:04.165 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:44:04.165 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.165 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.165 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:44:04.165 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589958+0000", 2024-09-13T06:44:04.165 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:44:04.165 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.165 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.165 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:44:04.165 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589957+0000", 2024-09-13T06:44:04.165 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:44:04.165 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.166 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.166 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:44:04.166 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589960+0000", 2024-09-13T06:44:04.166 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.4939999999999999e-06 2024-09-13T06:44:04.166 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.166 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.166 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:44:04.166 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589969+0000", 2024-09-13T06:44:04.166 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.3520000000000007e-06 2024-09-13T06:44:04.166 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.166 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.166 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:44:04.166 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589976+0000", 2024-09-13T06:44:04.167 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.3030000000000002e-06 2024-09-13T06:44:04.167 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.167 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.167 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:44:04.167 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.670765+0000", 2024-09-13T06:44:04.167 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.080789154000000002 2024-09-13T06:44:04.167 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.167 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.167 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:44:04.167 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.670960+0000", 2024-09-13T06:44:04.167 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00019464300000000001 2024-09-13T06:44:04.167 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.167 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.167 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:44:04.168 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.671360+0000", 2024-09-13T06:44:04.168 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00040005200000000002 2024-09-13T06:44:04.168 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:44:04.168 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:44:04.168 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:44:04.168 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.168 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.168 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43303 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 489472~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:44:04.168 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.589985+0000", 2024-09-13T06:44:04.168 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 222.557923966, 2024-09-13T06:44:04.168 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.082024333000000005, 2024-09-13T06:44:04.168 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:44:04.168 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:44:04.169 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:44:04.169 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:44:04.169 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:44:04.169 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43303 2024-09-13T06:44:04.169 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.169 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:44:04.169 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.169 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:44:04.169 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589985+0000", 2024-09-13T06:44:04.169 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:44:04.169 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.169 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.169 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:44:04.169 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589985+0000", 2024-09-13T06:44:04.170 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:44:04.170 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.170 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.170 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:44:04.170 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589984+0000", 2024-09-13T06:44:04.170 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:44:04.170 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.170 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.170 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:44:04.170 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589987+0000", 2024-09-13T06:44:04.170 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.726e-06 2024-09-13T06:44:04.170 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.170 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.170 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:44:04.171 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.589996+0000", 2024-09-13T06:44:04.171 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.5459999999999992e-06 2024-09-13T06:44:04.171 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.171 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.171 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:44:04.171 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590003+0000", 2024-09-13T06:44:04.171 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.4229999999999999e-06 2024-09-13T06:44:04.171 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.171 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.171 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:44:04.171 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.671426+0000", 2024-09-13T06:44:04.171 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.081422704999999998 2024-09-13T06:44:04.171 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.171 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.172 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:44:04.172 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.671615+0000", 2024-09-13T06:44:04.172 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000188875 2024-09-13T06:44:04.172 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.172 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.172 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:44:04.172 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.672009+0000", 2024-09-13T06:44:04.172 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000394015 2024-09-13T06:44:04.172 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:44:04.172 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:44:04.172 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:44:04.172 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.172 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.172 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43304 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 503808~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:44:04.172 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.590039+0000", 2024-09-13T06:44:04.173 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 222.55786942099999, 2024-09-13T06:44:04.173 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.082573880000000002, 2024-09-13T06:44:04.173 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:44:04.173 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:44:04.173 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:44:04.173 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:44:04.173 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:44:04.173 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43304 2024-09-13T06:44:04.173 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.173 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:44:04.173 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.173 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:44:04.173 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590039+0000", 2024-09-13T06:44:04.174 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:44:04.174 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.174 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.174 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:44:04.174 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590039+0000", 2024-09-13T06:44:04.174 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:44:04.174 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.174 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.174 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:44:04.174 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590038+0000", 2024-09-13T06:44:04.174 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:44:04.174 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.174 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.174 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:44:04.175 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590042+0000", 2024-09-13T06:44:04.175 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.9500000000000003e-06 2024-09-13T06:44:04.175 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.175 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.175 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:44:04.175 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590052+0000", 2024-09-13T06:44:04.175 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.3919999999999992e-06 2024-09-13T06:44:04.175 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.175 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.175 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:44:04.175 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590059+0000", 2024-09-13T06:44:04.175 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.7970000000000001e-06 2024-09-13T06:44:04.176 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.176 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.176 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:44:04.176 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.672078+0000", 2024-09-13T06:44:04.176 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.082018778000000001 2024-09-13T06:44:04.176 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.176 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.176 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:44:04.176 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.672266+0000", 2024-09-13T06:44:04.176 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00018807399999999999 2024-09-13T06:44:04.176 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.176 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.176 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:44:04.177 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.672613+0000", 2024-09-13T06:44:04.177 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00034677599999999997 2024-09-13T06:44:04.177 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:44:04.177 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:44:04.177 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:44:04.177 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.177 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.177 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:43305 3.d 3:b6e8da65:::rbd_data.1121f5f2e1c0.0000000000000004:1f [read 518144~2048 [fadvise_nocache]] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:44:04.177 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:21.590136+0000", 2024-09-13T06:44:04.177 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 222.55777223300001, 2024-09-13T06:44:04.177 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.082988206999999994, 2024-09-13T06:44:04.177 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:44:04.177 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:44:04.178 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:44:04.178 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:44:04.178 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:44:04.178 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 43305 2024-09-13T06:44:04.178 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.178 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:44:04.178 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.178 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:44:04.178 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590136+0000", 2024-09-13T06:44:04.178 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:44:04.179 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.179 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.179 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:44:04.179 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590136+0000", 2024-09-13T06:44:04.179 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:44:04.179 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.179 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.179 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:44:04.179 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590135+0000", 2024-09-13T06:44:04.179 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.999999 2024-09-13T06:44:04.179 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.179 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.179 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:44:04.179 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590139+0000", 2024-09-13T06:44:04.180 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.9489999999999998e-06 2024-09-13T06:44:04.180 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.180 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.180 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:44:04.180 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590148+0000", 2024-09-13T06:44:04.180 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.9830000000000002e-06 2024-09-13T06:44:04.180 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.180 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.180 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:44:04.180 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.590156+0000", 2024-09-13T06:44:04.180 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5229999999999998e-06 2024-09-13T06:44:04.180 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.180 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.180 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:44:04.181 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.672709+0000", 2024-09-13T06:44:04.181 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.082552886000000006 2024-09-13T06:44:04.181 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.181 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.181 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:44:04.181 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.672816+0000", 2024-09-13T06:44:04.181 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000107736 2024-09-13T06:44:04.181 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.181 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.181 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:44:04.181 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:21.673124+0000", 2024-09-13T06:44:04.181 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00030804900000000002 2024-09-13T06:44:04.181 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:44:04.182 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:44:04.182 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:44:04.182 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.182 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.182 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:66818 3.17 3.50afe697 (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e100)", 2024-09-13T06:44:04.182 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:40:53.498942+0000", 2024-09-13T06:44:04.182 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 190.64896604800001, 2024-09-13T06:44:04.182 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.011231284, 2024-09-13T06:44:04.182 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:44:04.182 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:44:04.182 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:44:04.182 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:44:04.182 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:44:04.182 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 66818 2024-09-13T06:44:04.182 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.183 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:44:04.183 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.183 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:44:04.183 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:53.498942+0000", 2024-09-13T06:44:04.183 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:44:04.183 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.183 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.183 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:44:04.183 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:53.498942+0000", 2024-09-13T06:44:04.183 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:44:04.183 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.183 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.183 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:44:04.183 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:53.498939+0000", 2024-09-13T06:44:04.184 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999967 2024-09-13T06:44:04.184 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.184 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.184 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:44:04.184 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:53.498954+0000", 2024-09-13T06:44:04.184 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5028000000000001e-05 2024-09-13T06:44:04.184 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.184 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.184 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:44:04.184 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:53.498986+0000", 2024-09-13T06:44:04.184 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.1993999999999999e-05 2024-09-13T06:44:04.184 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.184 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.184 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:44:04.184 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:53.499001+0000", 2024-09-13T06:44:04.185 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5166e-05 2024-09-13T06:44:04.185 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.185 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.185 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:44:04.185 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:53.505097+0000", 2024-09-13T06:44:04.185 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0060955610000000002 2024-09-13T06:44:04.185 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.185 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.185 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:44:04.185 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:53.505108+0000", 2024-09-13T06:44:04.185 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.084e-05 2024-09-13T06:44:04.185 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.185 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.185 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:44:04.186 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:54.510158+0000", 2024-09-13T06:44:04.186 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0050497549999999 2024-09-13T06:44:04.186 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.186 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.186 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:44:04.186 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:40:54.510174+0000", 2024-09-13T06:44:04.186 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6164e-05 2024-09-13T06:44:04.186 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:44:04.186 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:44:04.186 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:44:04.186 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.186 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.186 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:69764 3.2 3:47f10058:::rbd_data.11214956a993.0000000000000004:head [write-same] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e117)", 2024-09-13T06:44:04.186 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:41:11.371147+0000", 2024-09-13T06:44:04.186 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 172.776761738, 2024-09-13T06:44:04.187 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.03470167, 2024-09-13T06:44:04.187 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:44:04.187 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:44:04.187 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:44:04.187 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:44:04.187 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:44:04.187 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 69764 2024-09-13T06:44:04.187 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.187 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:44:04.187 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.187 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:44:04.187 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:11.371147+0000", 2024-09-13T06:44:04.187 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:44:04.187 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.187 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.188 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:44:04.188 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:11.371147+0000", 2024-09-13T06:44:04.188 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:44:04.188 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.188 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.188 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:44:04.188 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:11.371144+0000", 2024-09-13T06:44:04.188 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999967 2024-09-13T06:44:04.188 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.188 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.188 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:44:04.188 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:11.371161+0000", 2024-09-13T06:44:04.188 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7669e-05 2024-09-13T06:44:04.188 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.189 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.189 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:44:04.189 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:11.371198+0000", 2024-09-13T06:44:04.189 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.7014000000000002e-05 2024-09-13T06:44:04.189 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.189 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.189 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:44:04.189 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:11.371216+0000", 2024-09-13T06:44:04.189 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7425e-05 2024-09-13T06:44:04.189 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.189 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.189 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:44:04.189 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:11.371365+0000", 2024-09-13T06:44:04.189 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000149245 2024-09-13T06:44:04.190 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.190 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.190 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op must wait for map", 2024-09-13T06:44:04.190 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:11.371385+0000", 2024-09-13T06:44:04.190 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.0018999999999999e-05 2024-09-13T06:44:04.190 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.190 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.190 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:44:04.190 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:11.378406+0000", 2024-09-13T06:44:04.190 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0070207179999999996 2024-09-13T06:44:04.190 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.190 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.190 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:44:04.190 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:11.378429+0000", 2024-09-13T06:44:04.190 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.3453999999999999e-05 2024-09-13T06:44:04.191 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.191 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.191 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:44:04.191 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:12.405667+0000", 2024-09-13T06:44:04.191 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0272381690000001 2024-09-13T06:44:04.191 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.191 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.191 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:44:04.191 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:12.405848+0000", 2024-09-13T06:44:04.191 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00018112 2024-09-13T06:44:04.191 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:44:04.191 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:44:04.191 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:44:04.191 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.192 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.192 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:70346 3.16 3:69d35907:::rbd_object_map.11214956a993:head [read 0~36] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e122)", 2024-09-13T06:44:04.192 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:41:16.390917+0000", 2024-09-13T06:44:04.192 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 167.75699168599999, 2024-09-13T06:44:04.192 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.99327479799999996, 2024-09-13T06:44:04.192 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:44:04.192 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:44:04.192 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:44:04.192 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:44:04.192 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:44:04.192 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 70346 2024-09-13T06:44:04.192 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.192 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:44:04.192 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.193 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:44:04.193 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:16.390917+0000", 2024-09-13T06:44:04.193 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:44:04.193 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.193 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.193 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:44:04.193 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:16.390917+0000", 2024-09-13T06:44:04.193 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:44:04.193 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.193 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.193 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:44:04.193 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:16.390916+0000", 2024-09-13T06:44:04.193 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999986 2024-09-13T06:44:04.193 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.194 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.194 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:44:04.194 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:16.390922+0000", 2024-09-13T06:44:04.194 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.0480000000000004e-06 2024-09-13T06:44:04.194 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.194 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.194 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:44:04.194 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:16.390933+0000", 2024-09-13T06:44:04.194 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1387e-05 2024-09-13T06:44:04.194 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.194 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.194 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:44:04.194 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:16.390939+0000", 2024-09-13T06:44:04.194 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.8039999999999998e-06 2024-09-13T06:44:04.195 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.195 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.195 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:44:04.195 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:16.390983+0000", 2024-09-13T06:44:04.195 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.4663000000000003e-05 2024-09-13T06:44:04.195 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.195 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.195 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:44:04.195 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:16.390991+0000", 2024-09-13T06:44:04.195 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.8059999999999995e-06 2024-09-13T06:44:04.195 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.195 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.195 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:44:04.195 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:17.383624+0000", 2024-09-13T06:44:04.196 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.99263277299999997 2024-09-13T06:44:04.196 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.196 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.196 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:44:04.196 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:17.383891+0000", 2024-09-13T06:44:04.196 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00026717599999999999 2024-09-13T06:44:04.196 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.196 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.196 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:44:04.196 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:41:17.384192+0000", 2024-09-13T06:44:04.196 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00030047400000000001 2024-09-13T06:44:04.196 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:44:04.196 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:44:04.197 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:44:04.197 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.197 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.197 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:181624 3.1d 3:be5d0ef9:::rbd_data.11218aab7a9c.0000000000000000:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e203)", 2024-09-13T06:44:04.197 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:42:45.701744+0000", 2024-09-13T06:44:04.197 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 78.446164765999995, 2024-09-13T06:44:04.197 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.69964504800000005, 2024-09-13T06:44:04.197 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:44:04.197 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:44:04.197 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:44:04.197 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:44:04.197 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:44:04.197 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 181624 2024-09-13T06:44:04.197 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.198 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:44:04.198 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.198 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:44:04.198 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.701744+0000", 2024-09-13T06:44:04.198 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:44:04.198 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.198 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.198 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:44:04.198 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.701744+0000", 2024-09-13T06:44:04.198 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:44:04.198 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.198 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.199 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:44:04.199 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.701741+0000", 2024-09-13T06:44:04.199 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999976 2024-09-13T06:44:04.199 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.199 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.199 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:44:04.199 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.701754+0000", 2024-09-13T06:44:04.199 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.2632999999999999e-05 2024-09-13T06:44:04.199 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.199 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.199 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:44:04.199 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.701789+0000", 2024-09-13T06:44:04.199 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.4993999999999997e-05 2024-09-13T06:44:04.199 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.199 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.200 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:44:04.200 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.701806+0000", 2024-09-13T06:44:04.200 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7016000000000001e-05 2024-09-13T06:44:04.200 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.200 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.200 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:44:04.200 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.701905+0000", 2024-09-13T06:44:04.200 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.8895999999999996e-05 2024-09-13T06:44:04.200 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.200 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.200 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:44:04.200 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.701920+0000", 2024-09-13T06:44:04.200 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5013e-05 2024-09-13T06:44:04.200 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.201 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.201 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:44:04.201 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.400672+0000", 2024-09-13T06:44:04.201 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.69875254499999995 2024-09-13T06:44:04.201 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.201 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.201 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:44:04.201 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.401034+0000", 2024-09-13T06:44:04.201 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00036181700000000001 2024-09-13T06:44:04.201 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.201 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.201 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:44:04.201 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.401389+0000", 2024-09-13T06:44:04.202 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00035464399999999999 2024-09-13T06:44:04.202 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:44:04.202 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:44:04.202 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:44:04.202 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.202 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.202 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:181638 3.1d 3:be5d0ef9:::rbd_data.11218aab7a9c.0000000000000000:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e203)", 2024-09-13T06:44:04.202 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:42:45.707356+0000", 2024-09-13T06:44:04.202 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 78.440552026999995, 2024-09-13T06:44:04.202 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.694720479, 2024-09-13T06:44:04.202 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:44:04.202 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:44:04.202 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:44:04.202 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:44:04.203 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:44:04.203 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 181638 2024-09-13T06:44:04.203 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.203 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:44:04.203 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.203 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:44:04.203 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707356+0000", 2024-09-13T06:44:04.203 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:44:04.203 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.203 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.203 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:44:04.203 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707356+0000", 2024-09-13T06:44:04.203 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:44:04.203 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.204 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.204 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:44:04.204 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707355+0000", 2024-09-13T06:44:04.204 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999981 2024-09-13T06:44:04.204 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.204 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.204 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:44:04.204 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707375+0000", 2024-09-13T06:44:04.204 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.0698000000000001e-05 2024-09-13T06:44:04.204 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.204 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.204 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:44:04.204 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707396+0000", 2024-09-13T06:44:04.204 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.1041000000000001e-05 2024-09-13T06:44:04.204 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.205 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.205 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:44:04.205 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707408+0000", 2024-09-13T06:44:04.205 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1583000000000001e-05 2024-09-13T06:44:04.205 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.205 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.205 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:44:04.205 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707513+0000", 2024-09-13T06:44:04.205 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000104981 2024-09-13T06:44:04.205 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.205 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.205 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:44:04.205 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707541+0000", 2024-09-13T06:44:04.205 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.8572999999999999e-05 2024-09-13T06:44:04.206 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.206 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.206 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:44:04.206 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.401666+0000", 2024-09-13T06:44:04.206 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.694124988 2024-09-13T06:44:04.206 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.206 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.206 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:44:04.206 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.401880+0000", 2024-09-13T06:44:04.206 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00021322100000000001 2024-09-13T06:44:04.206 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.206 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.206 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:44:04.206 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.402077+0000", 2024-09-13T06:44:04.207 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000197321 2024-09-13T06:44:04.207 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:44:04.207 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:44:04.207 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:44:04.207 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.207 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.207 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:181652 3.1d 3:be5d0ef9:::rbd_data.11218aab7a9c.0000000000000000:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e203)", 2024-09-13T06:44:04.207 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:42:45.707423+0000", 2024-09-13T06:44:04.207 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 78.440485495999994, 2024-09-13T06:44:04.207 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.69480806699999997, 2024-09-13T06:44:04.207 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:44:04.207 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:44:04.207 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:44:04.207 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:44:04.207 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:44:04.208 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 181652 2024-09-13T06:44:04.208 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.208 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:44:04.208 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.208 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:44:04.208 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707423+0000", 2024-09-13T06:44:04.208 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:44:04.208 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.208 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.208 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:44:04.208 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707423+0000", 2024-09-13T06:44:04.208 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:44:04.208 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.208 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.208 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:44:04.209 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707423+0000", 2024-09-13T06:44:04.209 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:44:04.209 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.209 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.209 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:44:04.209 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707427+0000", 2024-09-13T06:44:04.209 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.2010000000000001e-06 2024-09-13T06:44:04.209 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.209 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.209 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:44:04.209 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707442+0000", 2024-09-13T06:44:04.209 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.4993e-05 2024-09-13T06:44:04.209 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.209 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.210 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:44:04.210 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707447+0000", 2024-09-13T06:44:04.210 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.2170000000000002e-06 2024-09-13T06:44:04.210 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.210 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.210 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:44:04.210 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707656+0000", 2024-09-13T06:44:04.210 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00020908600000000001 2024-09-13T06:44:04.210 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.210 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.210 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:44:04.210 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707684+0000", 2024-09-13T06:44:04.210 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.7766000000000001e-05 2024-09-13T06:44:04.210 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.211 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.211 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:44:04.211 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.402101+0000", 2024-09-13T06:44:04.211 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.69441698100000004 2024-09-13T06:44:04.211 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.211 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.211 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:44:04.211 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.402156+0000", 2024-09-13T06:44:04.211 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.4725000000000002e-05 2024-09-13T06:44:04.211 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.211 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.211 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:44:04.211 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.402231+0000", 2024-09-13T06:44:04.211 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5587999999999995e-05 2024-09-13T06:44:04.211 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:44:04.211 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:44:04.212 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:44:04.212 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.212 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.212 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:181666 3.1d 3:be5d0ef9:::rbd_data.11218aab7a9c.0000000000000000:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e203)", 2024-09-13T06:44:04.212 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:42:45.707478+0000", 2024-09-13T06:44:04.212 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 78.440430309999996, 2024-09-13T06:44:04.212 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.69543359900000001, 2024-09-13T06:44:04.212 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:44:04.212 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:44:04.212 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:44:04.212 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:44:04.213 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:44:04.213 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 181666 2024-09-13T06:44:04.213 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.213 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:44:04.213 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.213 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:44:04.213 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707478+0000", 2024-09-13T06:44:04.213 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:44:04.213 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.213 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.213 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:44:04.213 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707478+0000", 2024-09-13T06:44:04.213 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:44:04.214 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.214 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.214 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:44:04.214 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707478+0000", 2024-09-13T06:44:04.214 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:44:04.214 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.214 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.214 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:44:04.214 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707481+0000", 2024-09-13T06:44:04.214 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.3589999999999999e-06 2024-09-13T06:44:04.214 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.214 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.214 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:44:04.214 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707492+0000", 2024-09-13T06:44:04.214 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0725e-05 2024-09-13T06:44:04.214 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.215 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.215 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:44:04.215 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707500+0000", 2024-09-13T06:44:04.215 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.1089999999999998e-06 2024-09-13T06:44:04.215 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.215 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.215 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:44:04.215 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707773+0000", 2024-09-13T06:44:04.215 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000273291 2024-09-13T06:44:04.215 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.215 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.215 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:44:04.215 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707784+0000", 2024-09-13T06:44:04.215 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0441999999999999e-05 2024-09-13T06:44:04.215 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.216 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.216 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:44:04.216 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.402290+0000", 2024-09-13T06:44:04.216 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.69450651500000005 2024-09-13T06:44:04.216 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.216 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.216 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:44:04.216 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.402489+0000", 2024-09-13T06:44:04.216 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000198999 2024-09-13T06:44:04.216 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.216 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.216 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:44:04.216 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.402912+0000", 2024-09-13T06:44:04.216 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00042257299999999998 2024-09-13T06:44:04.217 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:44:04.217 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:44:04.217 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:44:04.217 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.217 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.217 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:181680 3.1d 3:be5d0ef9:::rbd_data.11218aab7a9c.0000000000000000:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e203)", 2024-09-13T06:44:04.217 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:42:45.707517+0000", 2024-09-13T06:44:04.217 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 78.440391274000007, 2024-09-13T06:44:04.217 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.69532440799999995, 2024-09-13T06:44:04.217 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:44:04.217 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:44:04.217 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:44:04.217 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:44:04.217 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:44:04.220 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 181680 2024-09-13T06:44:04.220 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.220 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:44:04.220 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.220 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:44:04.220 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707517+0000", 2024-09-13T06:44:04.221 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:44:04.221 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.221 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.221 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:44:04.221 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707517+0000", 2024-09-13T06:44:04.221 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:44:04.221 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.221 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.221 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:44:04.221 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707517+0000", 2024-09-13T06:44:04.221 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:44:04.221 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.221 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.221 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:44:04.222 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707519+0000", 2024-09-13T06:44:04.222 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.2800000000000002e-06 2024-09-13T06:44:04.222 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.222 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.222 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:44:04.222 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707527+0000", 2024-09-13T06:44:04.222 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.2660000000000001e-06 2024-09-13T06:44:04.222 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.222 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.222 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:44:04.222 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707535+0000", 2024-09-13T06:44:04.222 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.1760000000000004e-06 2024-09-13T06:44:04.222 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.223 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.223 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:44:04.223 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707838+0000", 2024-09-13T06:44:04.223 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00030318000000000001 2024-09-13T06:44:04.223 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.223 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.223 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:44:04.223 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707850+0000", 2024-09-13T06:44:04.223 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1787000000000001e-05 2024-09-13T06:44:04.223 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.223 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.223 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:44:04.223 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.402702+0000", 2024-09-13T06:44:04.223 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.69485264599999996 2024-09-13T06:44:04.224 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.224 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.224 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:44:04.224 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.402783+0000", 2024-09-13T06:44:04.224 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.1114999999999998e-05 2024-09-13T06:44:04.224 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.224 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.224 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:44:04.224 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.402842+0000", 2024-09-13T06:44:04.224 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.8322999999999997e-05 2024-09-13T06:44:04.224 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:44:04.224 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:44:04.224 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:44:04.224 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.225 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.225 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:181694 3.1d 3:be5d0ef9:::rbd_data.11218aab7a9c.0000000000000000:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e203)", 2024-09-13T06:44:04.225 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:42:45.707544+0000", 2024-09-13T06:44:04.225 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 78.440364582000001, 2024-09-13T06:44:04.225 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.69580726699999995, 2024-09-13T06:44:04.225 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:44:04.225 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:44:04.225 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:44:04.225 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:44:04.225 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:44:04.225 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 181694 2024-09-13T06:44:04.225 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.225 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:44:04.225 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.226 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:44:04.226 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707544+0000", 2024-09-13T06:44:04.226 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:44:04.226 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.226 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.226 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:44:04.226 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707544+0000", 2024-09-13T06:44:04.226 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:44:04.226 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.226 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.226 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:44:04.226 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707543+0000", 2024-09-13T06:44:04.226 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:44:04.227 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.227 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.227 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:44:04.227 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707561+0000", 2024-09-13T06:44:04.227 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.7804000000000001e-05 2024-09-13T06:44:04.227 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.227 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.227 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:44:04.227 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707575+0000", 2024-09-13T06:44:04.227 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3884e-05 2024-09-13T06:44:04.227 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.227 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.227 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:44:04.228 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707583+0000", 2024-09-13T06:44:04.228 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.5730000000000002e-06 2024-09-13T06:44:04.228 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.228 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.228 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:44:04.228 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707899+0000", 2024-09-13T06:44:04.228 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00031663999999999998 2024-09-13T06:44:04.228 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.228 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.228 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:44:04.228 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707908+0000", 2024-09-13T06:44:04.228 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.1430000000000004e-06 2024-09-13T06:44:04.228 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.229 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.229 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:44:04.229 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.402973+0000", 2024-09-13T06:44:04.229 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.69506426099999996 2024-09-13T06:44:04.229 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.229 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.229 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:44:04.229 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.403155+0000", 2024-09-13T06:44:04.229 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00018245199999999999 2024-09-13T06:44:04.229 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.229 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.229 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:44:04.229 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.403351+0000", 2024-09-13T06:44:04.229 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000196028 2024-09-13T06:44:04.230 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:44:04.230 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:44:04.230 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:44:04.230 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.230 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.230 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:181708 3.1d 3:be5d0ef9:::rbd_data.11218aab7a9c.0000000000000000:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e203)", 2024-09-13T06:44:04.230 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:42:45.707622+0000", 2024-09-13T06:44:04.230 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 78.440286537999995, 2024-09-13T06:44:04.230 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.69603707699999995, 2024-09-13T06:44:04.230 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:44:04.230 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:44:04.230 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:44:04.230 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:44:04.231 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:44:04.231 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 181708 2024-09-13T06:44:04.231 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.231 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:44:04.231 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.231 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:44:04.231 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707622+0000", 2024-09-13T06:44:04.231 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:44:04.231 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.231 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.231 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:44:04.231 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707622+0000", 2024-09-13T06:44:04.231 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:44:04.232 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.232 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.232 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:44:04.232 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707621+0000", 2024-09-13T06:44:04.232 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:44:04.232 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.232 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.232 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:44:04.232 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707624+0000", 2024-09-13T06:44:04.232 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.8210000000000002e-06 2024-09-13T06:44:04.232 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.232 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.233 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:44:04.233 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707631+0000", 2024-09-13T06:44:04.233 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.8460000000000002e-06 2024-09-13T06:44:04.233 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.233 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.233 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:44:04.233 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707635+0000", 2024-09-13T06:44:04.233 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.4610000000000001e-06 2024-09-13T06:44:04.233 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.233 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.233 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:44:04.233 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707955+0000", 2024-09-13T06:44:04.233 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00031982000000000001 2024-09-13T06:44:04.233 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.234 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.234 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:44:04.234 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707966+0000", 2024-09-13T06:44:04.234 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.0822000000000001e-05 2024-09-13T06:44:04.234 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.234 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.234 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:44:04.234 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.403541+0000", 2024-09-13T06:44:04.234 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.69557444300000004 2024-09-13T06:44:04.234 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.234 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.234 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:44:04.234 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.403598+0000", 2024-09-13T06:44:04.234 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.7147e-05 2024-09-13T06:44:04.235 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.235 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.235 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:44:04.235 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.403659+0000", 2024-09-13T06:44:04.235 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.1373999999999999e-05 2024-09-13T06:44:04.235 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:44:04.235 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:44:04.235 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:44:04.235 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.235 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.235 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:181722 3.1d 3:be5d0ef9:::rbd_data.11218aab7a9c.0000000000000000:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e203)", 2024-09-13T06:44:04.235 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:42:45.707640+0000", 2024-09-13T06:44:04.235 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 78.440268087000007, 2024-09-13T06:44:04.235 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.69620305800000004, 2024-09-13T06:44:04.236 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:44:04.236 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:44:04.236 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:44:04.236 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:44:04.236 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:44:04.236 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 181722 2024-09-13T06:44:04.236 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.236 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:44:04.236 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.236 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:44:04.236 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707640+0000", 2024-09-13T06:44:04.236 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:44:04.236 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.237 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.237 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:44:04.237 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707640+0000", 2024-09-13T06:44:04.237 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:44:04.237 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.237 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.237 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:44:04.237 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707640+0000", 2024-09-13T06:44:04.237 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:44:04.237 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.237 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.237 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:44:04.237 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707643+0000", 2024-09-13T06:44:04.238 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.213e-06 2024-09-13T06:44:04.238 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.238 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.238 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:44:04.238 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707651+0000", 2024-09-13T06:44:04.238 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.2290000000000003e-06 2024-09-13T06:44:04.238 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.238 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.238 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:44:04.238 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707656+0000", 2024-09-13T06:44:04.238 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.9320000000000004e-06 2024-09-13T06:44:04.238 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.238 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.239 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:44:04.239 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.708012+0000", 2024-09-13T06:44:04.239 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00035600600000000002 2024-09-13T06:44:04.239 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.239 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.239 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:44:04.239 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.708024+0000", 2024-09-13T06:44:04.239 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.1336e-05 2024-09-13T06:44:04.239 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.239 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.239 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:44:04.239 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.403696+0000", 2024-09-13T06:44:04.239 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.69567234499999997 2024-09-13T06:44:04.239 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.240 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.240 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:44:04.240 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.403757+0000", 2024-09-13T06:44:04.240 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.0715999999999999e-05 2024-09-13T06:44:04.240 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.240 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.240 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:44:04.240 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.403843+0000", 2024-09-13T06:44:04.240 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6679000000000001e-05 2024-09-13T06:44:04.240 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:44:04.240 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:44:04.240 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:44:04.240 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.240 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.241 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:181736 3.1d 3:be5d0ef9:::rbd_data.11218aab7a9c.0000000000000000:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e203)", 2024-09-13T06:44:04.241 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:42:45.707661+0000", 2024-09-13T06:44:04.241 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 78.440247720000002, 2024-09-13T06:44:04.241 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.69667210700000004, 2024-09-13T06:44:04.241 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:44:04.241 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:44:04.241 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:44:04.241 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:44:04.241 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:44:04.241 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 181736 2024-09-13T06:44:04.241 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.241 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:44:04.241 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.241 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:44:04.242 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707661+0000", 2024-09-13T06:44:04.242 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:44:04.242 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.242 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.242 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:44:04.242 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707661+0000", 2024-09-13T06:44:04.242 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:44:04.242 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.242 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.242 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:44:04.243 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707660+0000", 2024-09-13T06:44:04.243 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:44:04.243 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.243 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.243 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:44:04.243 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707664+0000", 2024-09-13T06:44:04.243 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.393e-06 2024-09-13T06:44:04.243 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.243 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.243 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:44:04.243 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707673+0000", 2024-09-13T06:44:04.243 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.5100000000000004e-06 2024-09-13T06:44:04.243 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.244 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.244 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:44:04.244 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707680+0000", 2024-09-13T06:44:04.244 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.8680000000000001e-06 2024-09-13T06:44:04.244 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.244 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.244 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:44:04.244 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.708068+0000", 2024-09-13T06:44:04.244 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00038784699999999997 2024-09-13T06:44:04.244 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.244 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.244 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:44:04.244 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.708078+0000", 2024-09-13T06:44:04.245 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.842e-06 2024-09-13T06:44:04.245 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.245 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.245 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:44:04.245 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.403924+0000", 2024-09-13T06:44:04.245 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.69584657699999997 2024-09-13T06:44:04.245 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.245 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.245 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:44:04.245 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.404135+0000", 2024-09-13T06:44:04.245 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000210662 2024-09-13T06:44:04.245 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.245 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.246 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:44:04.246 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.404333+0000", 2024-09-13T06:44:04.246 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00019787900000000001 2024-09-13T06:44:04.246 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:44:04.246 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:44:04.246 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:44:04.246 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.246 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.246 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:181750 3.1d 3.9f70ba7d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e203)", 2024-09-13T06:44:04.246 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:42:45.707687+0000", 2024-09-13T06:44:04.246 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 78.440221856999997, 2024-09-13T06:44:04.246 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.69667232199999996, 2024-09-13T06:44:04.246 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:44:04.247 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "reached pg", 2024-09-13T06:44:04.247 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:44:04.247 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:44:04.247 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:44:04.247 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 181750 2024-09-13T06:44:04.247 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.247 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:44:04.247 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.247 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:44:04.247 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707687+0000", 2024-09-13T06:44:04.247 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:44:04.247 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.247 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.248 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:44:04.248 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707687+0000", 2024-09-13T06:44:04.248 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:44:04.248 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.248 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.248 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:44:04.248 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707686+0000", 2024-09-13T06:44:04.248 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:44:04.248 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.248 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.248 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:44:04.248 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707689+0000", 2024-09-13T06:44:04.248 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.824e-06 2024-09-13T06:44:04.248 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.249 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.249 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:44:04.249 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707693+0000", 2024-09-13T06:44:04.249 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.5900000000000001e-06 2024-09-13T06:44:04.249 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.249 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.249 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:44:04.249 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.707697+0000", 2024-09-13T06:44:04.249 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.6899999999999998e-06 2024-09-13T06:44:04.249 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.249 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.249 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:44:04.249 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.708109+0000", 2024-09-13T06:44:04.250 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00041220200000000002 2024-09-13T06:44:04.250 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.250 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.250 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:44:04.250 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:45.708118+0000", 2024-09-13T06:44:04.250 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.6000000000000007e-06 2024-09-13T06:44:04.250 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.250 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.250 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:44:04.250 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.404353+0000", 2024-09-13T06:44:04.250 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.69623486400000001 2024-09-13T06:44:04.250 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.250 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.250 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:44:04.251 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:46.404359+0000", 2024-09-13T06:44:04.251 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.2480000000000001e-06 2024-09-13T06:44:04.251 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:44:04.251 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:44:04.251 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:44:04.251 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:44:04.251 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:44:04.251 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:44:04.253 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-13T06:44:04.253 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:44:04.251+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:44:04.354 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:44:04.351+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:44:04.380 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:44:04.380 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [], 2024-09-13T06:44:04.380 INFO:teuthology.orchestra.run.smithi139.stdout: "num_ops": 0 2024-09-13T06:44:04.380 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:44:04.396 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-13T06:44:04.442 INFO:teuthology.orchestra.run.smithi081.stderr:clear 3.1a pg_upmap mapping 2024-09-13T06:44:04.455 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T06:44:04.455+0000 7f27c1bee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26338) UID: 0 2024-09-13T06:44:04.464 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-13T06:44:04.522 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:44:04.523 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [], 2024-09-13T06:44:04.523 INFO:teuthology.orchestra.run.smithi139.stdout: "complaint_time": 30, 2024-09-13T06:44:04.523 INFO:teuthology.orchestra.run.smithi139.stdout: "num_blocked_ops": 0 2024-09-13T06:44:04.523 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:44:04.537 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-13T06:44:04.555 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T06:44:04.555+0000 7f12aad9c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26340) UID: 0 2024-09-13T06:44:04.656 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:44:04.656+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:44:04.665 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:44:04.665 INFO:teuthology.orchestra.run.smithi139.stdout: "size": 20, 2024-09-13T06:44:04.665 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 600, 2024-09-13T06:44:04.665 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [ 2024-09-13T06:44:04.665 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.666 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:176089 3.11 3:8b97f15f:::rbd_data.1121a23b99f7.0000000000000000:head [write 0~4194304 [fadvise_sequential+fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e196)", 2024-09-13T06:44:04.666 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:42:36.707298+0000", 2024-09-13T06:44:04.666 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 87.958023760000003, 2024-09-13T06:44:04.666 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.053333426000000003, 2024-09-13T06:44:04.666 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:44:04.666 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:44:04.666 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:44:04.666 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:44:04.666 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:44:04.666 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 176089 2024-09-13T06:44:04.666 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.666 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:44:04.666 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.666 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:44:04.666 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.707298+0000", 2024-09-13T06:44:04.667 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:44:04.667 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.667 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.667 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:44:04.667 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.707298+0000", 2024-09-13T06:44:04.667 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:44:04.667 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.667 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.667 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:44:04.667 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.707296+0000", 2024-09-13T06:44:04.667 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999976 2024-09-13T06:44:04.667 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.667 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.667 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:44:04.667 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.717511+0000", 2024-09-13T06:44:04.668 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.010215218999999999 2024-09-13T06:44:04.668 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.668 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.668 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:44:04.668 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.717555+0000", 2024-09-13T06:44:04.668 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.4159000000000002e-05 2024-09-13T06:44:04.668 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.668 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.668 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:44:04.668 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.717569+0000", 2024-09-13T06:44:04.668 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3543999999999999e-05 2024-09-13T06:44:04.668 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.669 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.669 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:44:04.669 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.717677+0000", 2024-09-13T06:44:04.669 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00010798699999999999 2024-09-13T06:44:04.669 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.669 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.669 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:44:04.669 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.717896+0000", 2024-09-13T06:44:04.669 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000219466 2024-09-13T06:44:04.669 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.669 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.669 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 4", 2024-09-13T06:44:04.669 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.718090+0000", 2024-09-13T06:44:04.669 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00019322799999999999 2024-09-13T06:44:04.670 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.670 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.670 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:44:04.670 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.751403+0000", 2024-09-13T06:44:04.670 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.033313493 2024-09-13T06:44:04.670 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.670 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.670 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-13T06:44:04.670 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.760523+0000", 2024-09-13T06:44:04.670 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0091197150000000005 2024-09-13T06:44:04.670 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.670 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.670 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-13T06:44:04.670 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.760581+0000", 2024-09-13T06:44:04.671 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.8007999999999998e-05 2024-09-13T06:44:04.671 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.671 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.671 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:44:04.671 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.760632+0000", 2024-09-13T06:44:04.671 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.1085999999999998e-05 2024-09-13T06:44:04.671 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:44:04.671 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:44:04.671 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:44:04.671 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.671 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.671 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:176090 3.e 3:77f86bf9:::rbd_data.1121a23b99f7.0000000000000001:head [write 0~4194304 [fadvise_sequential+fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e196)", 2024-09-13T06:44:04.671 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:42:36.717590+0000", 2024-09-13T06:44:04.671 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 87.947732278000004, 2024-09-13T06:44:04.672 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.049445965000000001, 2024-09-13T06:44:04.672 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:44:04.672 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:44:04.672 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:44:04.672 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:44:04.672 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:44:04.672 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 176090 2024-09-13T06:44:04.672 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.672 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:44:04.672 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.672 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:44:04.672 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.717590+0000", 2024-09-13T06:44:04.672 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:44:04.672 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.672 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.673 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:44:04.673 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.717590+0000", 2024-09-13T06:44:04.673 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:44:04.673 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.673 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.673 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:44:04.673 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.717588+0000", 2024-09-13T06:44:04.673 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999981 2024-09-13T06:44:04.673 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.673 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.673 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:44:04.673 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.723934+0000", 2024-09-13T06:44:04.673 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0063462589999999999 2024-09-13T06:44:04.673 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.674 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.674 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:44:04.674 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.723960+0000", 2024-09-13T06:44:04.674 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.6251e-05 2024-09-13T06:44:04.674 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.674 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.674 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:44:04.674 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.723976+0000", 2024-09-13T06:44:04.674 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5277e-05 2024-09-13T06:44:04.674 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.674 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.674 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:44:04.674 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.724154+0000", 2024-09-13T06:44:04.674 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00017814400000000001 2024-09-13T06:44:04.674 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.675 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.675 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:44:04.675 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.724534+0000", 2024-09-13T06:44:04.675 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00038054799999999998 2024-09-13T06:44:04.675 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.675 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.675 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 1", 2024-09-13T06:44:04.675 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.724926+0000", 2024-09-13T06:44:04.675 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00039199100000000001 2024-09-13T06:44:04.675 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.675 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.675 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:44:04.675 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.744509+0000", 2024-09-13T06:44:04.676 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.019582977000000001 2024-09-13T06:44:04.676 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.676 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.676 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-13T06:44:04.676 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.766937+0000", 2024-09-13T06:44:04.676 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.022427765999999998 2024-09-13T06:44:04.676 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.676 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.676 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-13T06:44:04.676 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.766987+0000", 2024-09-13T06:44:04.676 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.9898000000000002e-05 2024-09-13T06:44:04.676 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.676 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.676 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:44:04.677 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.767036+0000", 2024-09-13T06:44:04.677 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.8782000000000002e-05 2024-09-13T06:44:04.677 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:44:04.677 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:44:04.677 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:44:04.677 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.677 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.677 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:176094 3.f 3:f5ca80c1:::rbd_data.1121a23b99f7.0000000000000004:head [write 0~4194304 [fadvise_sequential+fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e196)", 2024-09-13T06:44:04.677 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:42:36.724239+0000", 2024-09-13T06:44:04.677 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 87.941083178, 2024-09-13T06:44:04.677 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.043501235999999999, 2024-09-13T06:44:04.677 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:44:04.677 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:44:04.677 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:44:04.678 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:44:04.678 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:44:04.678 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 176094 2024-09-13T06:44:04.678 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.678 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:44:04.678 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.678 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:44:04.678 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.724239+0000", 2024-09-13T06:44:04.678 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:44:04.678 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.678 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.678 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:44:04.679 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.724239+0000", 2024-09-13T06:44:04.679 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:44:04.679 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.679 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.679 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:44:04.679 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.724237+0000", 2024-09-13T06:44:04.679 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999981 2024-09-13T06:44:04.679 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.679 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.679 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:44:04.679 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.733673+0000", 2024-09-13T06:44:04.680 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0094352700000000008 2024-09-13T06:44:04.680 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.680 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.680 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:44:04.680 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.733703+0000", 2024-09-13T06:44:04.680 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.0102000000000001e-05 2024-09-13T06:44:04.680 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.680 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.680 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:44:04.680 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.733718+0000", 2024-09-13T06:44:04.680 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5199e-05 2024-09-13T06:44:04.681 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.681 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.681 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:44:04.681 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.733780+0000", 2024-09-13T06:44:04.681 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.1691000000000003e-05 2024-09-13T06:44:04.681 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.681 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.681 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:44:04.681 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.733928+0000", 2024-09-13T06:44:04.681 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000147987 2024-09-13T06:44:04.681 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.681 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.681 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 4", 2024-09-13T06:44:04.682 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.734036+0000", 2024-09-13T06:44:04.682 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000108925 2024-09-13T06:44:04.682 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.682 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.682 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:44:04.682 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.763741+0000", 2024-09-13T06:44:04.682 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.029704151000000002 2024-09-13T06:44:04.682 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.682 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.682 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-13T06:44:04.682 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.767615+0000", 2024-09-13T06:44:04.682 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0038739120000000002 2024-09-13T06:44:04.682 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.683 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.683 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-13T06:44:04.683 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.767693+0000", 2024-09-13T06:44:04.683 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.8573999999999997e-05 2024-09-13T06:44:04.683 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.683 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.683 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:44:04.683 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:36.767740+0000", 2024-09-13T06:44:04.683 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.7154000000000003e-05 2024-09-13T06:44:04.683 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:44:04.683 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:44:04.683 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:44:04.684 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.684 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.684 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:205233 3.15 3:a97b2891:::rbd_data.11213650bb32.000000000000002e:head [set-alloc-hint object_size 4194304 write_size 4194304,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e209)", 2024-09-13T06:44:04.684 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:42:52.282586+0000", 2024-09-13T06:44:04.684 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 72.382736334000001, 2024-09-13T06:44:04.684 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.056996628000000001, 2024-09-13T06:44:04.684 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:44:04.684 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:44:04.684 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:44:04.684 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:44:04.684 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:44:04.684 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 205233 2024-09-13T06:44:04.684 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.685 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:44:04.685 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.685 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:44:04.685 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:52.282586+0000", 2024-09-13T06:44:04.685 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:44:04.685 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.685 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.685 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:44:04.685 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:52.282586+0000", 2024-09-13T06:44:04.685 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:44:04.685 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.685 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.685 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:44:04.685 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:52.282583+0000", 2024-09-13T06:44:04.686 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999976 2024-09-13T06:44:04.686 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.686 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.686 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:44:04.686 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:52.282599+0000", 2024-09-13T06:44:04.686 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.5065999999999999e-05 2024-09-13T06:44:04.686 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.686 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.686 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:44:04.686 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:52.282632+0000", 2024-09-13T06:44:04.686 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.3386999999999997e-05 2024-09-13T06:44:04.686 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.686 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.686 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:44:04.687 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:52.282654+0000", 2024-09-13T06:44:04.687 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.177e-05 2024-09-13T06:44:04.687 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.687 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.687 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:44:04.687 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:52.282753+0000", 2024-09-13T06:44:04.687 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.9685000000000005e-05 2024-09-13T06:44:04.687 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.687 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.687 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:44:04.687 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:52.283000+0000", 2024-09-13T06:44:04.687 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000246278 2024-09-13T06:44:04.687 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.687 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.688 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 3", 2024-09-13T06:44:04.688 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:52.292656+0000", 2024-09-13T06:44:04.688 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0096565980000000006 2024-09-13T06:44:04.688 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.688 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.688 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:44:04.688 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:52.339352+0000", 2024-09-13T06:44:04.688 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.046695309999999997 2024-09-13T06:44:04.688 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.688 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.688 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-13T06:44:04.688 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:52.339373+0000", 2024-09-13T06:44:04.688 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.1002999999999999e-05 2024-09-13T06:44:04.688 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.689 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.689 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-13T06:44:04.689 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:52.339464+0000", 2024-09-13T06:44:04.689 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.1131999999999994e-05 2024-09-13T06:44:04.689 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.689 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.689 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:44:04.689 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:42:52.339582+0000", 2024-09-13T06:44:04.689 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000118799 2024-09-13T06:44:04.689 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:44:04.689 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:44:04.689 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:44:04.689 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.689 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.690 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:237446 3.15 3:abdd9d42:::rbd_data.1121cb4a09ed.0000000000000008:82 [read 81920~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e224)", 2024-09-13T06:44:04.690 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:43:08.800348+0000", 2024-09-13T06:44:04.690 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 55.864974525999997, 2024-09-13T06:44:04.690 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.032454446999999997, 2024-09-13T06:44:04.690 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:44:04.690 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:44:04.690 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:44:04.690 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:44:04.690 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:44:04.690 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 237446 2024-09-13T06:44:04.690 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.690 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:44:04.690 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.690 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:44:04.690 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800348+0000", 2024-09-13T06:44:04.691 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:44:04.691 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.691 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.691 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:44:04.691 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800348+0000", 2024-09-13T06:44:04.691 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:44:04.691 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.691 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.691 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:44:04.691 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800347+0000", 2024-09-13T06:44:04.691 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:44:04.691 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.691 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.691 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:44:04.691 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800349+0000", 2024-09-13T06:44:04.692 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.452e-06 2024-09-13T06:44:04.692 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.692 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.692 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:44:04.692 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800354+0000", 2024-09-13T06:44:04.692 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.0350000000000001e-06 2024-09-13T06:44:04.692 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.692 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.692 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:44:04.692 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800357+0000", 2024-09-13T06:44:04.692 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.179e-06 2024-09-13T06:44:04.692 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.692 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.692 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:44:04.693 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.832707+0000", 2024-09-13T06:44:04.693 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.032350071000000001 2024-09-13T06:44:04.693 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.693 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.693 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:44:04.693 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.832748+0000", 2024-09-13T06:44:04.693 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0587000000000003e-05 2024-09-13T06:44:04.693 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.693 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.693 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:44:04.693 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.832802+0000", 2024-09-13T06:44:04.693 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.4429999999999999e-05 2024-09-13T06:44:04.693 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:44:04.694 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:44:04.694 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:44:04.694 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.694 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.694 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:237447 3.15 3:abdd9d42:::rbd_data.1121cb4a09ed.0000000000000008:82 [read 94208~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e224)", 2024-09-13T06:44:04.694 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:43:08.800360+0000", 2024-09-13T06:44:04.694 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 55.864962614, 2024-09-13T06:44:04.694 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.032679798000000003, 2024-09-13T06:44:04.694 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:44:04.694 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:44:04.694 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:44:04.694 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:44:04.694 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:44:04.694 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 237447 2024-09-13T06:44:04.694 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.695 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:44:04.695 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.695 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:44:04.695 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800360+0000", 2024-09-13T06:44:04.695 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:44:04.695 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.695 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.695 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:44:04.695 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800360+0000", 2024-09-13T06:44:04.695 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:44:04.695 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.695 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.695 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:44:04.695 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800359+0000", 2024-09-13T06:44:04.695 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:44:04.695 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.696 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.696 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:44:04.696 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800361+0000", 2024-09-13T06:44:04.696 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.463e-06 2024-09-13T06:44:04.696 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.696 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.696 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:44:04.696 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800364+0000", 2024-09-13T06:44:04.696 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.6279999999999998e-06 2024-09-13T06:44:04.696 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.696 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.696 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:44:04.696 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800367+0000", 2024-09-13T06:44:04.697 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.7259999999999998e-06 2024-09-13T06:44:04.697 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.697 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.697 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:44:04.697 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.832841+0000", 2024-09-13T06:44:04.697 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.032474115999999997 2024-09-13T06:44:04.697 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.697 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.697 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:44:04.697 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.832929+0000", 2024-09-13T06:44:04.697 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.7886000000000005e-05 2024-09-13T06:44:04.697 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.697 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.698 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:44:04.698 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.833039+0000", 2024-09-13T06:44:04.698 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00011024200000000001 2024-09-13T06:44:04.698 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:44:04.698 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:44:04.698 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:44:04.698 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.698 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.698 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:237448 3.15 3:abdd9d42:::rbd_data.1121cb4a09ed.0000000000000008:82 [read 106496~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e224)", 2024-09-13T06:44:04.698 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:43:08.800371+0000", 2024-09-13T06:44:04.698 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 55.864951474999998, 2024-09-13T06:44:04.698 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.032794221999999998, 2024-09-13T06:44:04.698 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:44:04.698 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:44:04.698 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:44:04.699 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:44:04.699 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:44:04.699 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 237448 2024-09-13T06:44:04.699 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.699 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:44:04.699 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.699 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:44:04.699 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800371+0000", 2024-09-13T06:44:04.699 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:44:04.699 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.699 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.699 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:44:04.699 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800371+0000", 2024-09-13T06:44:04.699 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:44:04.699 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.700 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.700 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:44:04.700 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800370+0000", 2024-09-13T06:44:04.700 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967296 2024-09-13T06:44:04.700 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.700 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.700 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:44:04.700 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800372+0000", 2024-09-13T06:44:04.700 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3510000000000001e-06 2024-09-13T06:44:04.700 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.700 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.700 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:44:04.700 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800376+0000", 2024-09-13T06:44:04.700 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.693e-06 2024-09-13T06:44:04.700 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.701 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.701 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:44:04.701 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800378+0000", 2024-09-13T06:44:04.701 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.8870000000000001e-06 2024-09-13T06:44:04.701 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.701 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.701 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:44:04.701 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.833069+0000", 2024-09-13T06:44:04.701 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.032690708999999998 2024-09-13T06:44:04.701 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.701 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.701 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:44:04.701 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.833110+0000", 2024-09-13T06:44:04.701 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.1356999999999997e-05 2024-09-13T06:44:04.702 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.702 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.702 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:44:04.702 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.833165+0000", 2024-09-13T06:44:04.702 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.4456999999999997e-05 2024-09-13T06:44:04.702 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:44:04.702 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:44:04.702 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:44:04.702 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.702 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.702 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:237449 3.15 3:abdd9d42:::rbd_data.1121cb4a09ed.0000000000000008:82 [read 118784~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e224)", 2024-09-13T06:44:04.702 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:43:08.800381+0000", 2024-09-13T06:44:04.702 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 55.864941332999997, 2024-09-13T06:44:04.702 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.033007068000000001, 2024-09-13T06:44:04.702 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:44:04.702 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:44:04.703 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:44:04.703 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:44:04.703 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:44:04.703 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 237449 2024-09-13T06:44:04.703 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.703 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:44:04.703 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.703 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:44:04.703 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800381+0000", 2024-09-13T06:44:04.703 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:44:04.703 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.703 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.703 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:44:04.703 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800381+0000", 2024-09-13T06:44:04.704 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:44:04.704 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.704 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.704 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:44:04.704 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800381+0000", 2024-09-13T06:44:04.704 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967296 2024-09-13T06:44:04.704 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.704 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.704 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:44:04.704 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800382+0000", 2024-09-13T06:44:04.704 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.395e-06 2024-09-13T06:44:04.704 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.704 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.704 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:44:04.704 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800386+0000", 2024-09-13T06:44:04.705 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.574e-06 2024-09-13T06:44:04.705 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.705 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.705 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:44:04.705 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800388+0000", 2024-09-13T06:44:04.705 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.8729999999999999e-06 2024-09-13T06:44:04.705 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.705 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.705 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:44:04.705 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.833204+0000", 2024-09-13T06:44:04.705 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.032815986999999998 2024-09-13T06:44:04.705 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.705 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.706 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:44:04.706 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.833289+0000", 2024-09-13T06:44:04.706 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.4085999999999994e-05 2024-09-13T06:44:04.706 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.706 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.706 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:44:04.706 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.833388+0000", 2024-09-13T06:44:04.706 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.9380000000000001e-05 2024-09-13T06:44:04.706 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:44:04.706 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:44:04.706 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:44:04.706 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.706 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.706 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:237450 3.15 3:abdd9d42:::rbd_data.1121cb4a09ed.0000000000000008:82 [read 131072~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e224)", 2024-09-13T06:44:04.707 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:43:08.800392+0000", 2024-09-13T06:44:04.707 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 55.864930004999998, 2024-09-13T06:44:04.707 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.033110507999999997, 2024-09-13T06:44:04.707 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:44:04.707 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:44:04.707 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:44:04.707 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:44:04.707 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:44:04.707 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 237450 2024-09-13T06:44:04.707 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.707 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:44:04.707 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.707 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:44:04.707 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800392+0000", 2024-09-13T06:44:04.708 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:44:04.708 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.708 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.708 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:44:04.708 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800392+0000", 2024-09-13T06:44:04.708 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:44:04.708 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.708 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.708 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:44:04.708 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800392+0000", 2024-09-13T06:44:04.708 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967296 2024-09-13T06:44:04.708 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.708 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.708 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:44:04.709 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800393+0000", 2024-09-13T06:44:04.709 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.375e-06 2024-09-13T06:44:04.709 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.709 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.709 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:44:04.709 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800397+0000", 2024-09-13T06:44:04.709 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.6109999999999998e-06 2024-09-13T06:44:04.709 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.709 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.709 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:44:04.709 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800400+0000", 2024-09-13T06:44:04.709 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.7580000000000001e-06 2024-09-13T06:44:04.709 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.710 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.710 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:44:04.710 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.833414+0000", 2024-09-13T06:44:04.710 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.033014767 2024-09-13T06:44:04.710 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.710 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.710 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:44:04.710 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.833453+0000", 2024-09-13T06:44:04.710 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.8711000000000003e-05 2024-09-13T06:44:04.710 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.710 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.710 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:44:04.710 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.833503+0000", 2024-09-13T06:44:04.711 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.9523e-05 2024-09-13T06:44:04.711 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:44:04.711 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:44:04.711 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:44:04.711 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.711 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.711 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:237451 3.15 3:abdd9d42:::rbd_data.1121cb4a09ed.0000000000000008:82 [read 143360~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e224)", 2024-09-13T06:44:04.711 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:43:08.800402+0000", 2024-09-13T06:44:04.711 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 55.864920187000003, 2024-09-13T06:44:04.711 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.033337717000000003, 2024-09-13T06:44:04.711 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:44:04.711 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:44:04.711 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:44:04.712 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:44:04.712 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:44:04.712 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 237451 2024-09-13T06:44:04.712 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.712 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:44:04.712 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.712 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:44:04.712 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800402+0000", 2024-09-13T06:44:04.712 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:44:04.712 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.712 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.712 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:44:04.712 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800402+0000", 2024-09-13T06:44:04.713 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:44:04.713 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.713 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.713 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:44:04.713 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800402+0000", 2024-09-13T06:44:04.713 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967296 2024-09-13T06:44:04.713 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.713 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.713 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:44:04.713 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800403+0000", 2024-09-13T06:44:04.713 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.37e-06 2024-09-13T06:44:04.713 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.713 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.713 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:44:04.714 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800407+0000", 2024-09-13T06:44:04.714 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.6820000000000001e-06 2024-09-13T06:44:04.714 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.714 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.714 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:44:04.714 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800410+0000", 2024-09-13T06:44:04.714 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.7810000000000001e-06 2024-09-13T06:44:04.714 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.714 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.714 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:44:04.714 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.833550+0000", 2024-09-13T06:44:04.714 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.033140192999999998 2024-09-13T06:44:04.714 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.715 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.715 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:44:04.715 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.833634+0000", 2024-09-13T06:44:04.715 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.4097000000000005e-05 2024-09-13T06:44:04.715 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.715 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.715 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:44:04.715 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.833740+0000", 2024-09-13T06:44:04.715 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00010582300000000001 2024-09-13T06:44:04.715 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:44:04.715 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:44:04.715 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:44:04.715 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.716 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.716 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:237452 3.15 3:abdd9d42:::rbd_data.1121cb4a09ed.0000000000000008:82 [read 155648~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e224)", 2024-09-13T06:44:04.716 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:43:08.800412+0000", 2024-09-13T06:44:04.716 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 55.864910231000003, 2024-09-13T06:44:04.716 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.033496535000000001, 2024-09-13T06:44:04.716 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:44:04.716 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:44:04.716 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:44:04.716 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:44:04.716 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:44:04.716 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 237452 2024-09-13T06:44:04.716 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.716 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:44:04.716 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.717 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:44:04.717 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800412+0000", 2024-09-13T06:44:04.717 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:44:04.717 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.717 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.717 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:44:04.717 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800412+0000", 2024-09-13T06:44:04.717 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:44:04.717 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.717 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.717 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:44:04.717 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800412+0000", 2024-09-13T06:44:04.717 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967296 2024-09-13T06:44:04.717 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.718 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.718 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:44:04.718 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800413+0000", 2024-09-13T06:44:04.718 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.342e-06 2024-09-13T06:44:04.718 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.718 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.718 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:44:04.718 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800417+0000", 2024-09-13T06:44:04.718 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.6480000000000001e-06 2024-09-13T06:44:04.718 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.718 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.718 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:44:04.718 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800419+0000", 2024-09-13T06:44:04.718 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.7920000000000001e-06 2024-09-13T06:44:04.718 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.718 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.719 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:44:04.719 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.833768+0000", 2024-09-13T06:44:04.719 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.033348587999999998 2024-09-13T06:44:04.719 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.719 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.719 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:44:04.719 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.833836+0000", 2024-09-13T06:44:04.719 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 6.8090999999999996e-05 2024-09-13T06:44:04.719 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.719 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.719 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:44:04.719 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.833908+0000", 2024-09-13T06:44:04.719 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.2311999999999995e-05 2024-09-13T06:44:04.719 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:44:04.720 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:44:04.720 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:44:04.720 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.720 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.720 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:237453 3.15 3:abdd9d42:::rbd_data.1121cb4a09ed.0000000000000008:82 [read 167936~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e224)", 2024-09-13T06:44:04.720 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:43:08.800422+0000", 2024-09-13T06:44:04.720 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 55.864900159999998, 2024-09-13T06:44:04.720 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.033735223000000002, 2024-09-13T06:44:04.720 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:44:04.720 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:44:04.720 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:44:04.720 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:44:04.720 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:44:04.720 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 237453 2024-09-13T06:44:04.720 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.721 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:44:04.721 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.721 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:44:04.721 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800422+0000", 2024-09-13T06:44:04.721 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:44:04.721 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.721 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.721 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:44:04.721 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800422+0000", 2024-09-13T06:44:04.721 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:44:04.721 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.721 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.721 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:44:04.721 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800422+0000", 2024-09-13T06:44:04.722 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967296 2024-09-13T06:44:04.722 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.722 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.722 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:44:04.722 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800423+0000", 2024-09-13T06:44:04.722 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3489999999999999e-06 2024-09-13T06:44:04.722 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.722 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.722 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:44:04.722 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800427+0000", 2024-09-13T06:44:04.722 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.6610000000000002e-06 2024-09-13T06:44:04.722 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.722 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.722 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:44:04.723 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800430+0000", 2024-09-13T06:44:04.723 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.9869999999999999e-06 2024-09-13T06:44:04.723 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.723 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.723 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:44:04.723 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.833958+0000", 2024-09-13T06:44:04.723 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.033528020999999998 2024-09-13T06:44:04.723 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.723 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.723 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:44:04.723 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.834047+0000", 2024-09-13T06:44:04.723 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.9492000000000003e-05 2024-09-13T06:44:04.723 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.723 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.724 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:44:04.724 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.834157+0000", 2024-09-13T06:44:04.724 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000109948 2024-09-13T06:44:04.724 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:44:04.724 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:44:04.724 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:44:04.724 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.724 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.724 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:237454 3.15 3:abdd9d42:::rbd_data.1121cb4a09ed.0000000000000008:82 [read 180224~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e224)", 2024-09-13T06:44:04.724 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:43:08.800432+0000", 2024-09-13T06:44:04.724 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 55.864889953000002, 2024-09-13T06:44:04.724 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.033853883000000001, 2024-09-13T06:44:04.724 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:44:04.725 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:44:04.725 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:44:04.725 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:44:04.725 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:44:04.725 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 237454 2024-09-13T06:44:04.725 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.725 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:44:04.725 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.725 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:44:04.725 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800432+0000", 2024-09-13T06:44:04.725 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:44:04.725 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.725 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.726 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:44:04.726 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800432+0000", 2024-09-13T06:44:04.726 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:44:04.726 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.726 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.726 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:44:04.726 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800432+0000", 2024-09-13T06:44:04.726 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:44:04.726 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.726 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.726 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:44:04.726 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800433+0000", 2024-09-13T06:44:04.726 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3379999999999999e-06 2024-09-13T06:44:04.726 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.727 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.727 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:44:04.727 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800437+0000", 2024-09-13T06:44:04.727 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.1679999999999997e-06 2024-09-13T06:44:04.727 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.727 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.727 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:44:04.727 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800440+0000", 2024-09-13T06:44:04.727 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.8830000000000002e-06 2024-09-13T06:44:04.727 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.727 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.727 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:44:04.727 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.834187+0000", 2024-09-13T06:44:04.728 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.033746532000000003 2024-09-13T06:44:04.728 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.728 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.728 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:44:04.728 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.834228+0000", 2024-09-13T06:44:04.728 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.087e-05 2024-09-13T06:44:04.728 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.728 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.728 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:44:04.728 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.834286+0000", 2024-09-13T06:44:04.728 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.8331000000000001e-05 2024-09-13T06:44:04.728 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:44:04.728 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:44:04.729 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:44:04.729 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.729 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.729 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:237455 3.15 3:abdd9d42:::rbd_data.1121cb4a09ed.0000000000000008:82 [read 192512~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e224)", 2024-09-13T06:44:04.729 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:43:08.800443+0000", 2024-09-13T06:44:04.729 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 55.864879479999999, 2024-09-13T06:44:04.729 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.034083294, 2024-09-13T06:44:04.729 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:44:04.729 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:44:04.729 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:44:04.729 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:44:04.729 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:44:04.729 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 237455 2024-09-13T06:44:04.729 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.730 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:44:04.730 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.730 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:44:04.730 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800443+0000", 2024-09-13T06:44:04.730 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:44:04.730 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.730 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.730 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:44:04.730 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800443+0000", 2024-09-13T06:44:04.730 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:44:04.730 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.730 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.730 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:44:04.730 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800442+0000", 2024-09-13T06:44:04.731 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967296 2024-09-13T06:44:04.731 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.731 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.731 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:44:04.731 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800444+0000", 2024-09-13T06:44:04.731 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.443e-06 2024-09-13T06:44:04.731 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.731 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.731 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:44:04.731 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800448+0000", 2024-09-13T06:44:04.732 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.6770000000000001e-06 2024-09-13T06:44:04.732 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.732 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.732 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:44:04.732 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800451+0000", 2024-09-13T06:44:04.732 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.0920000000000002e-06 2024-09-13T06:44:04.732 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.732 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.732 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:44:04.732 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.834323+0000", 2024-09-13T06:44:04.732 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.033872145999999999 2024-09-13T06:44:04.732 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.732 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.733 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:44:04.733 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.834420+0000", 2024-09-13T06:44:04.733 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 9.6898999999999995e-05 2024-09-13T06:44:04.733 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.733 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.733 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:44:04.733 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.834526+0000", 2024-09-13T06:44:04.733 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.000106272 2024-09-13T06:44:04.733 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:44:04.733 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:44:04.733 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:44:04.733 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.733 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.734 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:237456 3.15 3:abdd9d42:::rbd_data.1121cb4a09ed.0000000000000008:82 [read 204800~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e224)", 2024-09-13T06:44:04.734 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:43:08.800453+0000", 2024-09-13T06:44:04.734 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 55.864869269000003, 2024-09-13T06:44:04.734 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.034198615000000002, 2024-09-13T06:44:04.734 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:44:04.734 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:44:04.734 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:44:04.734 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:44:04.734 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:44:04.734 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 237456 2024-09-13T06:44:04.734 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.734 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:44:04.734 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.734 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:44:04.735 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800453+0000", 2024-09-13T06:44:04.735 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:44:04.735 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.735 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.735 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:44:04.735 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800453+0000", 2024-09-13T06:44:04.735 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:44:04.735 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.735 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.735 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:44:04.735 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800453+0000", 2024-09-13T06:44:04.735 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967296 2024-09-13T06:44:04.735 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.735 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.736 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:44:04.736 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800454+0000", 2024-09-13T06:44:04.736 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.361e-06 2024-09-13T06:44:04.736 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.736 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.736 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:44:04.736 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800458+0000", 2024-09-13T06:44:04.736 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.7189999999999999e-06 2024-09-13T06:44:04.736 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.736 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.736 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:44:04.736 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800461+0000", 2024-09-13T06:44:04.736 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.7599999999999998e-06 2024-09-13T06:44:04.736 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.737 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.737 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:44:04.737 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.834555+0000", 2024-09-13T06:44:04.737 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.034094192000000002 2024-09-13T06:44:04.737 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.737 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.737 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:44:04.737 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.834597+0000", 2024-09-13T06:44:04.737 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.2157000000000003e-05 2024-09-13T06:44:04.737 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.737 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.737 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:44:04.737 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.834652+0000", 2024-09-13T06:44:04.737 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.4660999999999997e-05 2024-09-13T06:44:04.738 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:44:04.738 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:44:04.738 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:44:04.738 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.738 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.738 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:237457 3.15 3:abdd9d42:::rbd_data.1121cb4a09ed.0000000000000008:82 [read 217088~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e224)", 2024-09-13T06:44:04.738 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:43:08.800463+0000", 2024-09-13T06:44:04.738 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 55.864859322000001, 2024-09-13T06:44:04.738 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.034419130999999999, 2024-09-13T06:44:04.738 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:44:04.738 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:44:04.738 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:44:04.738 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:44:04.738 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:44:04.738 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 237457 2024-09-13T06:44:04.738 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.739 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:44:04.739 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.739 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:44:04.739 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800463+0000", 2024-09-13T06:44:04.739 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:44:04.739 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.739 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.739 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:44:04.739 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800463+0000", 2024-09-13T06:44:04.739 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:44:04.739 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.739 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.739 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:44:04.739 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800463+0000", 2024-09-13T06:44:04.739 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967296 2024-09-13T06:44:04.740 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.740 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.740 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:44:04.740 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800466+0000", 2024-09-13T06:44:04.740 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.8240000000000001e-06 2024-09-13T06:44:04.740 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.740 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.740 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:44:04.740 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800470+0000", 2024-09-13T06:44:04.740 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.7579999999999998e-06 2024-09-13T06:44:04.740 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.740 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.740 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:44:04.740 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800473+0000", 2024-09-13T06:44:04.741 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.875e-06 2024-09-13T06:44:04.741 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.741 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.741 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:44:04.741 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.834688+0000", 2024-09-13T06:44:04.741 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.034215039000000003 2024-09-13T06:44:04.741 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.741 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.741 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:44:04.741 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.834772+0000", 2024-09-13T06:44:04.741 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.3870999999999997e-05 2024-09-13T06:44:04.741 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.741 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.741 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:44:04.742 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.834882+0000", 2024-09-13T06:44:04.742 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00011 2024-09-13T06:44:04.742 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:44:04.742 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:44:04.742 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:44:04.742 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.742 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.742 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:237458 3.15 3:abdd9d42:::rbd_data.1121cb4a09ed.0000000000000008:82 [read 229376~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e224)", 2024-09-13T06:44:04.742 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:43:08.800476+0000", 2024-09-13T06:44:04.742 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 55.864846573999998, 2024-09-13T06:44:04.742 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.034538358999999998, 2024-09-13T06:44:04.742 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:44:04.742 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:44:04.742 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:44:04.743 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:44:04.743 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:44:04.743 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 237458 2024-09-13T06:44:04.743 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.743 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:44:04.743 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.743 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:44:04.743 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800476+0000", 2024-09-13T06:44:04.743 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:44:04.743 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.743 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.743 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:44:04.743 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800476+0000", 2024-09-13T06:44:04.744 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:44:04.744 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.744 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.744 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:44:04.744 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800475+0000", 2024-09-13T06:44:04.744 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:44:04.744 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.744 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.744 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:44:04.744 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800477+0000", 2024-09-13T06:44:04.744 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.367e-06 2024-09-13T06:44:04.744 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.744 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.745 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:44:04.745 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800480+0000", 2024-09-13T06:44:04.745 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.7179999999999998e-06 2024-09-13T06:44:04.745 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.745 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.745 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:44:04.745 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800483+0000", 2024-09-13T06:44:04.745 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.807e-06 2024-09-13T06:44:04.745 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.745 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.745 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:44:04.745 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.834922+0000", 2024-09-13T06:44:04.745 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.034438261999999997 2024-09-13T06:44:04.745 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.746 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.746 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:44:04.746 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.834962+0000", 2024-09-13T06:44:04.746 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0287999999999998e-05 2024-09-13T06:44:04.746 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.746 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.746 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:44:04.746 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.835014+0000", 2024-09-13T06:44:04.746 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.2172999999999997e-05 2024-09-13T06:44:04.746 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:44:04.746 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:44:04.746 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:44:04.746 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.747 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.747 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:237459 3.15 3:abdd9d42:::rbd_data.1121cb4a09ed.0000000000000008:82 [read 241664~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e224)", 2024-09-13T06:44:04.747 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:43:08.800486+0000", 2024-09-13T06:44:04.747 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 55.864836433000001, 2024-09-13T06:44:04.747 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.034771370000000003, 2024-09-13T06:44:04.747 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:44:04.747 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:44:04.747 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:44:04.747 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:44:04.747 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:44:04.747 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 237459 2024-09-13T06:44:04.747 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.747 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:44:04.748 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.748 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:44:04.748 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800486+0000", 2024-09-13T06:44:04.748 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:44:04.748 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.748 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.748 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:44:04.748 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800486+0000", 2024-09-13T06:44:04.748 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:44:04.748 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.748 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.748 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:44:04.748 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800485+0000", 2024-09-13T06:44:04.749 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:44:04.749 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.749 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.749 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:44:04.749 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800487+0000", 2024-09-13T06:44:04.749 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.297e-06 2024-09-13T06:44:04.749 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.749 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.749 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:44:04.749 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800491+0000", 2024-09-13T06:44:04.749 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.4569999999999998e-06 2024-09-13T06:44:04.749 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.749 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.750 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:44:04.750 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800494+0000", 2024-09-13T06:44:04.750 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.8710000000000001e-06 2024-09-13T06:44:04.750 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.750 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.750 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:44:04.750 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.835058+0000", 2024-09-13T06:44:04.750 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.034564117999999998 2024-09-13T06:44:04.750 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.750 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.750 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:44:04.750 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.835142+0000", 2024-09-13T06:44:04.750 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 8.352e-05 2024-09-13T06:44:04.750 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.751 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.751 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:44:04.751 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.835257+0000", 2024-09-13T06:44:04.751 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00011537 2024-09-13T06:44:04.751 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:44:04.751 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:44:04.751 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:44:04.751 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.751 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.751 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:237460 3.15 3:abdd9d42:::rbd_data.1121cb4a09ed.0000000000000008:82 [read 253952~4096 [fadvise_nocache]] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e224)", 2024-09-13T06:44:04.751 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:43:08.800511+0000", 2024-09-13T06:44:04.751 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 55.864810763000001, 2024-09-13T06:44:04.751 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.034864764999999999, 2024-09-13T06:44:04.752 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:44:04.752 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "started", 2024-09-13T06:44:04.752 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:44:04.752 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:44:04.752 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:44:04.752 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 237460 2024-09-13T06:44:04.752 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.752 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:44:04.752 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.752 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:44:04.752 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800511+0000", 2024-09-13T06:44:04.752 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:44:04.752 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.752 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.753 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:44:04.753 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800511+0000", 2024-09-13T06:44:04.753 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:44:04.753 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.753 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.753 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:44:04.753 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800511+0000", 2024-09-13T06:44:04.753 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999995 2024-09-13T06:44:04.753 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.753 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.753 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:44:04.753 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800513+0000", 2024-09-13T06:44:04.753 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.6020000000000001e-06 2024-09-13T06:44:04.753 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.754 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.754 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:44:04.754 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800517+0000", 2024-09-13T06:44:04.754 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.0559999999999998e-06 2024-09-13T06:44:04.754 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.754 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.754 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:44:04.754 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.800521+0000", 2024-09-13T06:44:04.754 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.4050000000000002e-06 2024-09-13T06:44:04.754 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.754 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.754 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:44:04.754 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.835278+0000", 2024-09-13T06:44:04.754 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.034757154999999998 2024-09-13T06:44:04.755 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.755 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.755 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:44:04.755 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.835319+0000", 2024-09-13T06:44:04.755 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4.1121000000000002e-05 2024-09-13T06:44:04.755 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.755 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.755 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:44:04.755 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:08.835376+0000", 2024-09-13T06:44:04.755 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 5.6820000000000001e-05 2024-09-13T06:44:04.755 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:44:04.755 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:44:04.755 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:44:04.756 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.756 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.756 INFO:teuthology.orchestra.run.smithi139.stdout: "description": "osd_op(client.4385.0:245459 3.9 3:9105f097:::rbd_object_map.11217e777cf4:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e273)", 2024-09-13T06:44:04.756 INFO:teuthology.orchestra.run.smithi139.stdout: "initiated_at": "2024-09-13T06:43:58.619442+0000", 2024-09-13T06:44:04.756 INFO:teuthology.orchestra.run.smithi139.stdout: "age": 6.045880607, 2024-09-13T06:44:04.756 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.0362669169999998, 2024-09-13T06:44:04.756 INFO:teuthology.orchestra.run.smithi139.stdout: "type_data": { 2024-09-13T06:44:04.756 INFO:teuthology.orchestra.run.smithi139.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-13T06:44:04.756 INFO:teuthology.orchestra.run.smithi139.stdout: "client_info": { 2024-09-13T06:44:04.756 INFO:teuthology.orchestra.run.smithi139.stdout: "client": "client.4385", 2024-09-13T06:44:04.756 INFO:teuthology.orchestra.run.smithi139.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:44:04.756 INFO:teuthology.orchestra.run.smithi139.stdout: "tid": 245459 2024-09-13T06:44:04.756 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.757 INFO:teuthology.orchestra.run.smithi139.stdout: "events": [ 2024-09-13T06:44:04.757 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.757 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "initiated", 2024-09-13T06:44:04.757 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:58.619442+0000", 2024-09-13T06:44:04.757 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:44:04.757 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.757 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.757 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "throttled", 2024-09-13T06:44:04.757 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:58.619442+0000", 2024-09-13T06:44:04.757 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0 2024-09-13T06:44:04.757 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.757 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.757 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "header_read", 2024-09-13T06:44:04.758 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:58.619439+0000", 2024-09-13T06:44:04.758 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 4294967295.9999976 2024-09-13T06:44:04.758 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.758 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.758 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "all_read", 2024-09-13T06:44:04.758 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:58.619453+0000", 2024-09-13T06:44:04.758 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.3492999999999999e-05 2024-09-13T06:44:04.758 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.758 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.758 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "dispatched", 2024-09-13T06:44:04.758 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:58.619480+0000", 2024-09-13T06:44:04.758 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.7492999999999999e-05 2024-09-13T06:44:04.759 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.759 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.759 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "queued_for_pg", 2024-09-13T06:44:04.759 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:58.619504+0000", 2024-09-13T06:44:04.759 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.3730000000000001e-05 2024-09-13T06:44:04.759 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.759 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.759 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:44:04.759 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:58.619611+0000", 2024-09-13T06:44:04.759 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00010764600000000001 2024-09-13T06:44:04.759 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.759 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.759 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:44:04.759 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:58.619634+0000", 2024-09-13T06:44:04.760 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 2.2172999999999999e-05 2024-09-13T06:44:04.760 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.760 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.760 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:44:04.760 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:59.601397+0000", 2024-09-13T06:44:04.760 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.98176298299999998 2024-09-13T06:44:04.760 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.760 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.760 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for peered", 2024-09-13T06:44:04.760 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:43:59.601433+0000", 2024-09-13T06:44:04.760 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 3.6755999999999998e-05 2024-09-13T06:44:04.760 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.760 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.760 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "reached_pg", 2024-09-13T06:44:04.761 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:44:00.652554+0000", 2024-09-13T06:44:04.761 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 1.051121108 2024-09-13T06:44:04.761 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.761 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.761 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "started", 2024-09-13T06:44:04.761 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:44:00.652853+0000", 2024-09-13T06:44:04.761 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00029899800000000003 2024-09-13T06:44:04.761 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.761 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.761 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "waiting for subops from 5", 2024-09-13T06:44:04.761 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:44:00.653236+0000", 2024-09-13T06:44:04.761 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00038218699999999998 2024-09-13T06:44:04.761 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.761 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.761 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "op_commit", 2024-09-13T06:44:04.762 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:44:00.655044+0000", 2024-09-13T06:44:04.762 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.0018086809999999999 2024-09-13T06:44:04.762 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.762 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.762 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "sub_op_commit_rec", 2024-09-13T06:44:04.762 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:44:00.655459+0000", 2024-09-13T06:44:04.762 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00041510400000000002 2024-09-13T06:44:04.762 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.762 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.762 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "commit_sent", 2024-09-13T06:44:04.762 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:44:00.655529+0000", 2024-09-13T06:44:04.762 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 7.0085000000000004e-05 2024-09-13T06:44:04.762 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-13T06:44:04.762 INFO:teuthology.orchestra.run.smithi139.stdout: { 2024-09-13T06:44:04.762 INFO:teuthology.orchestra.run.smithi139.stdout: "event": "done", 2024-09-13T06:44:04.763 INFO:teuthology.orchestra.run.smithi139.stdout: "time": "2024-09-13T06:44:00.655708+0000", 2024-09-13T06:44:04.763 INFO:teuthology.orchestra.run.smithi139.stdout: "duration": 0.00017903600000000001 2024-09-13T06:44:04.763 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:44:04.763 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:44:04.763 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:44:04.763 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-13T06:44:04.763 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-13T06:44:04.763 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:44:04.764 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-13T06:44:04.765 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-13T06:44:04.764+0000 7fa8bb18e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 36790) UID: 0 2024-09-13T06:44:04.866 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-13T06:44:04.864+0000 7fa8bb18e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 36790) UID: 0 2024-09-13T06:44:04.886 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:44:04.886 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-13T06:44:04.886 INFO:teuthology.orchestra.run.smithi081.stdout: "num_ops": 0 2024-09-13T06:44:04.886 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:44:04.900 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-13T06:44:04.966 INFO:tasks.ceph.osd.7.smithi139.stderr:2024-09-13T06:44:04.964+0000 7fa8bb18e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 36790) UID: 0 2024-09-13T06:44:05.020 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:44:05.021 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [], 2024-09-13T06:44:05.021 INFO:teuthology.orchestra.run.smithi081.stdout: "complaint_time": 30, 2024-09-13T06:44:05.021 INFO:teuthology.orchestra.run.smithi081.stdout: "num_blocked_ops": 0 2024-09-13T06:44:05.021 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:44:05.037 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-13T06:44:05.052 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-13T06:44:05.082 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T06:44:05.083+0000 7f460efbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26336) UID: 0 2024-09-13T06:44:05.154 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:44:05.154 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 20, 2024-09-13T06:44:05.155 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 600, 2024-09-13T06:44:05.155 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [ 2024-09-13T06:44:05.155 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:05.155 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:37801 3.1 3:82e31015:::rbd_object_map.1121d8143c6e.0000000000000019:head [call] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e55)", 2024-09-13T06:44:05.155 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:05.646191+0000", 2024-09-13T06:44:05.155 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 239.50893976200001, 2024-09-13T06:44:05.155 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.72659507800000001, 2024-09-13T06:44:05.155 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:44:05.155 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:44:05.155 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:44:05.155 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:44:05.155 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:44:05.155 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 37801 2024-09-13T06:44:05.155 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:05.156 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:44:05.156 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:05.156 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:44:05.156 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:05.646191+0000", 2024-09-13T06:44:05.156 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:44:05.156 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:05.156 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:05.156 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:44:05.156 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:05.646191+0000", 2024-09-13T06:44:05.156 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:44:05.156 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:05.156 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:05.156 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:44:05.157 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:05.646188+0000", 2024-09-13T06:44:05.157 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999971 2024-09-13T06:44:05.157 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:05.157 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:05.157 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:44:05.157 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:05.646206+0000", 2024-09-13T06:44:05.157 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8182999999999999e-05 2024-09-13T06:44:05.157 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:05.157 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:05.157 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:44:05.157 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:05.646237+0000", 2024-09-13T06:44:05.157 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.1071000000000001e-05 2024-09-13T06:44:05.158 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:05.158 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:05.158 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:44:05.158 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:05.646251+0000", 2024-09-13T06:44:05.158 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3679000000000001e-05 2024-09-13T06:44:05.158 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:05.158 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:05.158 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:44:05.158 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:05.646321+0000", 2024-09-13T06:44:05.158 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.9831000000000003e-05 2024-09-13T06:44:05.158 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:05.158 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:05.158 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:44:05.158 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:05.646331+0000", 2024-09-13T06:44:05.159 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0242e-05 2024-09-13T06:44:05.159 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:05.159 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:05.159 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:44:05.159 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.371959+0000", 2024-09-13T06:44:05.159 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.72562817199999996 2024-09-13T06:44:05.159 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:05.159 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:05.159 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:44:05.159 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.372389+0000", 2024-09-13T06:44:05.159 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00042977400000000001 2024-09-13T06:44:05.159 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:05.159 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:05.160 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:44:05.160 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:06.372786+0000", 2024-09-13T06:44:05.160 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00039706099999999999 2024-09-13T06:44:05.160 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:44:05.160 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:44:05.160 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:44:05.160 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:05.160 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:05.160 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43182 3.17 3:ec5ebce4:::rbd_data.1121f5f2e1c0.0000000000000001:1f [read 333824~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:44:05.160 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.652985+0000", 2024-09-13T06:44:05.160 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 223.502145149, 2024-09-13T06:44:05.160 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123926616, 2024-09-13T06:44:05.160 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:44:05.161 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:44:05.161 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:44:05.161 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:44:05.161 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:44:05.161 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43182 2024-09-13T06:44:05.161 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:05.161 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:44:05.161 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:05.161 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:44:05.161 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.652985+0000", 2024-09-13T06:44:05.161 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:44:05.161 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:05.161 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:05.161 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:44:05.162 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.652985+0000", 2024-09-13T06:44:05.162 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:44:05.162 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:05.162 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:05.162 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:44:05.162 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.652985+0000", 2024-09-13T06:44:05.162 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:44:05.162 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:05.162 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:05.162 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:44:05.162 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.652987+0000", 2024-09-13T06:44:05.162 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.0899999999999999e-06 2024-09-13T06:44:05.162 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:05.162 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:05.163 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:44:05.163 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.652994+0000", 2024-09-13T06:44:05.163 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.3100000000000003e-06 2024-09-13T06:44:05.163 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:05.163 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:05.163 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:44:05.163 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.653000+0000", 2024-09-13T06:44:05.163 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.2020000000000003e-06 2024-09-13T06:44:05.163 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:05.163 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:05.163 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:44:05.163 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.776635+0000", 2024-09-13T06:44:05.163 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.12363529400000001 2024-09-13T06:44:05.164 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:05.164 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:05.164 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:44:05.164 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.776676+0000", 2024-09-13T06:44:05.164 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.0745999999999999e-05 2024-09-13T06:44:05.164 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:05.164 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:05.164 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:44:05.164 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.776912+0000", 2024-09-13T06:44:05.164 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00023631300000000001 2024-09-13T06:44:05.164 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:44:05.164 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:44:05.164 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:44:05.164 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:05.165 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:05.165 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43194 3.17 3:ec5ebce4:::rbd_data.1121f5f2e1c0.0000000000000001:1f [read 495616~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:44:05.165 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.656645+0000", 2024-09-13T06:44:05.165 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 223.498484956, 2024-09-13T06:44:05.165 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.124088483, 2024-09-13T06:44:05.165 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:44:05.165 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:44:05.165 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:44:05.165 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:44:05.165 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:44:05.165 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43194 2024-09-13T06:44:05.165 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:05.165 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:44:05.166 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:05.166 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:44:05.166 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656645+0000", 2024-09-13T06:44:05.166 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:44:05.166 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:05.166 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:05.166 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:44:05.166 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656645+0000", 2024-09-13T06:44:05.166 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:44:05.166 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:05.166 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:05.166 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:44:05.166 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656645+0000", 2024-09-13T06:44:05.167 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:44:05.167 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:05.167 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:05.167 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:44:05.167 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656647+0000", 2024-09-13T06:44:05.167 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.9180000000000001e-06 2024-09-13T06:44:05.167 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:05.167 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:05.167 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:44:05.167 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656653+0000", 2024-09-13T06:44:05.167 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.7860000000000002e-06 2024-09-13T06:44:05.167 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:05.167 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:05.167 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:44:05.168 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.656658+0000", 2024-09-13T06:44:05.168 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.6949999999999999e-06 2024-09-13T06:44:05.168 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:05.168 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:05.168 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:44:05.168 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.780406+0000", 2024-09-13T06:44:05.168 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123748657 2024-09-13T06:44:05.168 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:05.168 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:05.168 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:44:05.168 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.780446+0000", 2024-09-13T06:44:05.168 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.9360999999999998e-05 2024-09-13T06:44:05.168 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:05.169 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:05.169 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:44:05.169 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.780734+0000", 2024-09-13T06:44:05.169 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00028838399999999998 2024-09-13T06:44:05.169 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:44:05.169 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:44:05.169 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:44:05.169 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:05.169 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:05.169 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43241 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 120832~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:44:05.169 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.660682+0000", 2024-09-13T06:44:05.169 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 223.49444801800001, 2024-09-13T06:44:05.169 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123958204, 2024-09-13T06:44:05.169 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:44:05.170 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:44:05.170 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:44:05.170 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:44:05.170 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:44:05.170 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43241 2024-09-13T06:44:05.170 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:05.170 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:44:05.170 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:05.170 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:44:05.170 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660682+0000", 2024-09-13T06:44:05.170 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:44:05.170 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:05.170 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:05.170 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:44:05.171 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660682+0000", 2024-09-13T06:44:05.171 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:44:05.171 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:05.171 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:05.171 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:44:05.171 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660682+0000", 2024-09-13T06:44:05.171 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:44:05.171 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:05.171 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:05.171 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:44:05.171 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660683+0000", 2024-09-13T06:44:05.171 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.308e-06 2024-09-13T06:44:05.171 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:05.171 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:05.171 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:44:05.172 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660686+0000", 2024-09-13T06:44:05.172 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.977e-06 2024-09-13T06:44:05.172 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:05.172 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:05.172 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:44:05.172 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660689+0000", 2024-09-13T06:44:05.172 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5830000000000001e-06 2024-09-13T06:44:05.172 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:05.172 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:05.172 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:44:05.172 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.784366+0000", 2024-09-13T06:44:05.172 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.12367713599999999 2024-09-13T06:44:05.172 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:05.172 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:05.173 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:44:05.173 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.784451+0000", 2024-09-13T06:44:05.173 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.4629999999999994e-05 2024-09-13T06:44:05.173 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:05.173 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:05.173 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:44:05.173 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.784641+0000", 2024-09-13T06:44:05.173 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00018984899999999999 2024-09-13T06:44:05.173 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:44:05.173 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:44:05.173 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:44:05.173 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:05.174 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:05.174 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43242 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 139264~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:44:05.174 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.660691+0000", 2024-09-13T06:44:05.174 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 223.49443904, 2024-09-13T06:44:05.174 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.124536443, 2024-09-13T06:44:05.174 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:44:05.174 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:44:05.174 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:44:05.174 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:44:05.174 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:44:05.174 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43242 2024-09-13T06:44:05.174 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:05.174 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:44:05.174 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:05.175 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:44:05.175 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660691+0000", 2024-09-13T06:44:05.175 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:44:05.175 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:05.175 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:05.175 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:44:05.175 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660691+0000", 2024-09-13T06:44:05.175 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:44:05.175 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:05.175 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:05.175 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:44:05.175 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660691+0000", 2024-09-13T06:44:05.175 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:44:05.175 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:05.175 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:05.176 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:44:05.176 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660696+0000", 2024-09-13T06:44:05.176 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.0560000000000004e-06 2024-09-13T06:44:05.176 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:05.176 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:05.176 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:44:05.176 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660699+0000", 2024-09-13T06:44:05.176 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.2009999999999999e-06 2024-09-13T06:44:05.176 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:05.176 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:05.176 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:44:05.176 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660702+0000", 2024-09-13T06:44:05.176 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.633e-06 2024-09-13T06:44:05.176 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:05.176 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:05.177 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:44:05.177 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.784912+0000", 2024-09-13T06:44:05.177 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.124209497 2024-09-13T06:44:05.177 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:05.177 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:05.177 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:44:05.177 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.784995+0000", 2024-09-13T06:44:05.177 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.3891e-05 2024-09-13T06:44:05.177 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:05.177 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:05.177 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:44:05.177 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.785228+0000", 2024-09-13T06:44:05.177 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00023237400000000001 2024-09-13T06:44:05.178 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:44:05.178 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:44:05.178 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:44:05.178 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:05.178 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:05.178 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43243 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 153600~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:44:05.178 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.660705+0000", 2024-09-13T06:44:05.178 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 223.494425707, 2024-09-13T06:44:05.178 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.124825835, 2024-09-13T06:44:05.178 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:44:05.178 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:44:05.178 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:44:05.178 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:44:05.178 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:44:05.178 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43243 2024-09-13T06:44:05.179 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:05.179 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:44:05.179 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:05.179 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:44:05.179 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660705+0000", 2024-09-13T06:44:05.179 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:44:05.179 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:05.179 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:05.179 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:44:05.179 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660705+0000", 2024-09-13T06:44:05.179 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:44:05.179 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:05.179 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:05.179 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:44:05.180 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660705+0000", 2024-09-13T06:44:05.180 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:44:05.180 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:05.180 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:05.180 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:44:05.180 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660706+0000", 2024-09-13T06:44:05.180 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4339999999999999e-06 2024-09-13T06:44:05.180 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:05.180 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:05.180 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:44:05.180 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660709+0000", 2024-09-13T06:44:05.180 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9000000000000002e-06 2024-09-13T06:44:05.180 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:05.181 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:05.181 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:44:05.181 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660712+0000", 2024-09-13T06:44:05.181 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.0589999999999998e-06 2024-09-13T06:44:05.181 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:05.181 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:05.181 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:44:05.181 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.785318+0000", 2024-09-13T06:44:05.181 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.124606299 2024-09-13T06:44:05.181 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:05.181 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:05.181 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:44:05.182 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.785361+0000", 2024-09-13T06:44:05.182 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.3214999999999999e-05 2024-09-13T06:44:05.182 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:05.182 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:05.182 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:44:05.182 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.785531+0000", 2024-09-13T06:44:05.182 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00016914400000000001 2024-09-13T06:44:05.182 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:44:05.182 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:44:05.182 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:44:05.182 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:05.182 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:05.182 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43244 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 167936~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:44:05.182 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.660714+0000", 2024-09-13T06:44:05.183 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 223.49441629399999, 2024-09-13T06:44:05.183 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.125073248, 2024-09-13T06:44:05.183 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:44:05.183 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:44:05.183 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:44:05.183 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:44:05.183 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:44:05.183 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43244 2024-09-13T06:44:05.183 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:05.183 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:44:05.183 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:05.183 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:44:05.183 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660714+0000", 2024-09-13T06:44:05.184 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:44:05.184 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:05.184 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:05.184 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:44:05.184 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660714+0000", 2024-09-13T06:44:05.184 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:44:05.184 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:05.184 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:05.184 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:44:05.184 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660714+0000", 2024-09-13T06:44:05.184 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967296 2024-09-13T06:44:05.184 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:05.184 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:05.184 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:44:05.185 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660715+0000", 2024-09-13T06:44:05.185 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2330000000000001e-06 2024-09-13T06:44:05.185 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:05.185 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:05.185 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:44:05.185 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660718+0000", 2024-09-13T06:44:05.185 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9569999999999998e-06 2024-09-13T06:44:05.185 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:05.185 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:05.185 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:44:05.185 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.660721+0000", 2024-09-13T06:44:05.185 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.678e-06 2024-09-13T06:44:05.185 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:05.186 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:05.186 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:44:05.186 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.785557+0000", 2024-09-13T06:44:05.186 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.12483633199999999 2024-09-13T06:44:05.186 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:05.186 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:05.186 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:44:05.186 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.785618+0000", 2024-09-13T06:44:05.186 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.0686000000000001e-05 2024-09-13T06:44:05.186 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:05.186 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:05.186 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:44:05.186 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.785787+0000", 2024-09-13T06:44:05.186 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00016957699999999999 2024-09-13T06:44:05.187 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:44:05.187 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:44:05.187 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:44:05.187 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:05.187 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:05.187 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43256 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 344064~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:44:05.187 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.664763+0000", 2024-09-13T06:44:05.187 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 223.490367784, 2024-09-13T06:44:05.187 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.12418359399999999, 2024-09-13T06:44:05.187 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:44:05.187 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:44:05.187 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:44:05.187 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:44:05.187 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:44:05.188 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43256 2024-09-13T06:44:05.188 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:05.188 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:44:05.188 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:05.188 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:44:05.188 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664763+0000", 2024-09-13T06:44:05.188 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:44:05.188 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:05.188 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:05.188 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:44:05.188 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664763+0000", 2024-09-13T06:44:05.188 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:44:05.188 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:05.188 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:05.189 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:44:05.189 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664762+0000", 2024-09-13T06:44:05.189 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:44:05.189 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:05.189 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:05.189 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:44:05.189 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664765+0000", 2024-09-13T06:44:05.189 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.3290000000000001e-06 2024-09-13T06:44:05.189 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:05.189 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:05.189 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:44:05.189 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664771+0000", 2024-09-13T06:44:05.189 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.1319999999999999e-06 2024-09-13T06:44:05.189 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:05.189 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:05.190 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:44:05.190 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.664776+0000", 2024-09-13T06:44:05.190 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.8840000000000002e-06 2024-09-13T06:44:05.190 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:05.190 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:05.190 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:44:05.190 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.788598+0000", 2024-09-13T06:44:05.190 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123821979 2024-09-13T06:44:05.190 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:05.190 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:05.190 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:44:05.190 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.788680+0000", 2024-09-13T06:44:05.190 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.2367999999999995e-05 2024-09-13T06:44:05.190 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:05.191 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:05.191 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:44:05.191 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.788946+0000", 2024-09-13T06:44:05.191 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00026629799999999999 2024-09-13T06:44:05.191 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:44:05.191 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:44:05.191 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:44:05.191 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:05.191 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:05.191 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43267 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 505856~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:44:05.191 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.669461+0000", 2024-09-13T06:44:05.191 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 223.48566923000001, 2024-09-13T06:44:05.191 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.123933711, 2024-09-13T06:44:05.192 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:44:05.192 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:44:05.192 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:44:05.192 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:44:05.192 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:44:05.192 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43267 2024-09-13T06:44:05.192 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:05.192 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:44:05.192 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:05.192 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:44:05.192 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669461+0000", 2024-09-13T06:44:05.192 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:44:05.192 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:05.192 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:05.193 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:44:05.193 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669461+0000", 2024-09-13T06:44:05.193 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:44:05.193 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:05.193 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:05.193 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:44:05.193 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669461+0000", 2024-09-13T06:44:05.193 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:44:05.193 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:05.193 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:05.193 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:44:05.193 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669463+0000", 2024-09-13T06:44:05.193 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5629999999999999e-06 2024-09-13T06:44:05.193 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:05.194 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:05.194 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:44:05.194 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669473+0000", 2024-09-13T06:44:05.194 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.9520000000000006e-06 2024-09-13T06:44:05.194 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:05.194 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:05.194 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:44:05.194 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669479+0000", 2024-09-13T06:44:05.194 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 5.8540000000000002e-06 2024-09-13T06:44:05.194 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:05.194 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:05.194 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:44:05.194 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.793137+0000", 2024-09-13T06:44:05.195 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.12365825699999999 2024-09-13T06:44:05.195 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:05.195 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:05.195 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:44:05.195 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.793181+0000", 2024-09-13T06:44:05.195 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.3773999999999998e-05 2024-09-13T06:44:05.195 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:05.195 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:05.195 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:44:05.195 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.793395+0000", 2024-09-13T06:44:05.195 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00021372399999999999 2024-09-13T06:44:05.195 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:44:05.195 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:44:05.195 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:44:05.195 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:05.196 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:05.196 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:43268 3.1f 3:fc9928ed:::rbd_data.1121f5f2e1c0.0000000000000003:1f [read 520192~2048 [fadvise_nocache]] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e68)", 2024-09-13T06:44:05.196 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:40:21.669484+0000", 2024-09-13T06:44:05.196 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 223.48564644499999, 2024-09-13T06:44:05.196 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.12441057899999999, 2024-09-13T06:44:05.196 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:44:05.196 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:44:05.196 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:44:05.196 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:44:05.196 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:44:05.196 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 43268 2024-09-13T06:44:05.196 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:05.197 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:44:05.197 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:05.197 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:44:05.197 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669484+0000", 2024-09-13T06:44:05.197 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:44:05.197 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:05.197 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:05.197 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:44:05.197 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669484+0000", 2024-09-13T06:44:05.197 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:44:05.197 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:05.197 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:05.197 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:44:05.197 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669484+0000", 2024-09-13T06:44:05.198 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:44:05.198 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:05.198 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:05.198 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:44:05.198 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669486+0000", 2024-09-13T06:44:05.198 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.6120000000000001e-06 2024-09-13T06:44:05.198 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:05.198 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:05.198 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:44:05.198 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669494+0000", 2024-09-13T06:44:05.198 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4819999999999997e-06 2024-09-13T06:44:05.198 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:05.198 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:05.199 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:44:05.199 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.669497+0000", 2024-09-13T06:44:05.199 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.9790000000000002e-06 2024-09-13T06:44:05.199 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:05.199 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:05.199 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:44:05.199 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.793559+0000", 2024-09-13T06:44:05.199 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.124062436 2024-09-13T06:44:05.199 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:05.199 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:05.199 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:44:05.199 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.793603+0000", 2024-09-13T06:44:05.199 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.3764999999999999e-05 2024-09-13T06:44:05.199 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:05.200 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:05.200 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:44:05.200 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:40:21.793895+0000", 2024-09-13T06:44:05.200 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00029168299999999999 2024-09-13T06:44:05.200 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:44:05.200 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:44:05.200 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:44:05.200 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:05.200 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:05.200 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:181627 3.1b 3:dbd5e871:::rbd_data.11218aab7a9c.0000000000000003:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e203)", 2024-09-13T06:44:05.200 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:42:45.704561+0000", 2024-09-13T06:44:05.200 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 79.450569580999996, 2024-09-13T06:44:05.200 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.70481779099999997, 2024-09-13T06:44:05.201 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:44:05.201 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:44:05.201 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:44:05.201 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:44:05.201 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:44:05.201 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 181627 2024-09-13T06:44:05.201 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:05.201 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:44:05.201 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:05.201 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:44:05.201 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.704561+0000", 2024-09-13T06:44:05.201 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:44:05.201 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:05.202 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:05.202 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:44:05.202 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.704561+0000", 2024-09-13T06:44:05.202 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:44:05.202 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:05.202 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:05.202 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:44:05.202 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.704558+0000", 2024-09-13T06:44:05.202 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999976 2024-09-13T06:44:05.202 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:05.202 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:05.202 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:44:05.202 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.704570+0000", 2024-09-13T06:44:05.202 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2123000000000001e-05 2024-09-13T06:44:05.203 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:05.203 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:05.203 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:44:05.203 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.704596+0000", 2024-09-13T06:44:05.203 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.5134e-05 2024-09-13T06:44:05.203 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:05.203 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:05.203 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:44:05.203 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.704609+0000", 2024-09-13T06:44:05.203 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3745e-05 2024-09-13T06:44:05.203 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:05.203 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:05.203 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:44:05.204 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.704797+0000", 2024-09-13T06:44:05.204 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00018797799999999999 2024-09-13T06:44:05.204 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:05.204 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:05.204 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:44:05.204 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.704816+0000", 2024-09-13T06:44:05.204 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.8218000000000001e-05 2024-09-13T06:44:05.204 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:05.204 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:05.204 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:44:05.204 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:46.408816+0000", 2024-09-13T06:44:05.204 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.70399995500000001 2024-09-13T06:44:05.204 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:05.205 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:05.205 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:44:05.205 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:46.409111+0000", 2024-09-13T06:44:05.205 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000295202 2024-09-13T06:44:05.205 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:05.205 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:05.205 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:44:05.205 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:46.409379+0000", 2024-09-13T06:44:05.205 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00026792599999999998 2024-09-13T06:44:05.205 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:44:05.206 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:44:05.206 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:44:05.206 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:05.206 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:05.206 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:181641 3.1b 3:dbd5e871:::rbd_data.11218aab7a9c.0000000000000003:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e203)", 2024-09-13T06:44:05.206 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:42:45.704674+0000", 2024-09-13T06:44:05.206 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 79.450456574, 2024-09-13T06:44:05.206 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.70579465600000002, 2024-09-13T06:44:05.206 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:44:05.206 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:44:05.206 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:44:05.206 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:44:05.206 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:44:05.207 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 181641 2024-09-13T06:44:05.207 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:05.207 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:44:05.207 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:05.207 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:44:05.207 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.704674+0000", 2024-09-13T06:44:05.207 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:44:05.207 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:05.207 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:05.207 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:44:05.207 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.704674+0000", 2024-09-13T06:44:05.207 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:44:05.207 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:05.207 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:05.208 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:44:05.208 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.704673+0000", 2024-09-13T06:44:05.208 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:44:05.208 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:05.208 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:05.208 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:44:05.208 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.704677+0000", 2024-09-13T06:44:05.208 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.6389999999999998e-06 2024-09-13T06:44:05.208 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:05.208 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:05.208 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:44:05.208 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.704691+0000", 2024-09-13T06:44:05.209 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.3859999999999999e-05 2024-09-13T06:44:05.209 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:05.209 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:05.209 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:44:05.209 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.704699+0000", 2024-09-13T06:44:05.209 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.2339999999999994e-06 2024-09-13T06:44:05.209 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:05.209 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:05.209 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:44:05.209 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.704854+0000", 2024-09-13T06:44:05.209 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00015513899999999999 2024-09-13T06:44:05.209 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:05.209 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:05.209 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:44:05.209 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.704866+0000", 2024-09-13T06:44:05.210 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1855000000000001e-05 2024-09-13T06:44:05.210 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:05.210 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:05.210 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:44:05.210 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:46.410079+0000", 2024-09-13T06:44:05.210 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.705212477 2024-09-13T06:44:05.210 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:05.210 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:05.210 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:44:05.210 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:46.410279+0000", 2024-09-13T06:44:05.210 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000200614 2024-09-13T06:44:05.210 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:05.210 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:05.210 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:44:05.210 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:46.410469+0000", 2024-09-13T06:44:05.211 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00018939400000000001 2024-09-13T06:44:05.211 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:44:05.211 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:44:05.211 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:44:05.211 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:05.211 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:05.211 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:181655 3.1b 3:dbd5e871:::rbd_data.11218aab7a9c.0000000000000003:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e203)", 2024-09-13T06:44:05.211 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:42:45.704730+0000", 2024-09-13T06:44:05.211 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 79.450400165999994, 2024-09-13T06:44:05.211 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.70617977499999995, 2024-09-13T06:44:05.211 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:44:05.211 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:44:05.211 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:44:05.211 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:44:05.212 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:44:05.212 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 181655 2024-09-13T06:44:05.212 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:05.212 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:44:05.212 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:05.212 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:44:05.212 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.704730+0000", 2024-09-13T06:44:05.212 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:44:05.212 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:05.212 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:05.212 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:44:05.212 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.704730+0000", 2024-09-13T06:44:05.212 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:44:05.212 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:05.213 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:05.213 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:44:05.213 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.704730+0000", 2024-09-13T06:44:05.213 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:44:05.213 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:05.213 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:05.213 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:44:05.213 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.704733+0000", 2024-09-13T06:44:05.213 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.0000000000000001e-06 2024-09-13T06:44:05.213 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:05.213 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:05.213 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:44:05.213 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.704741+0000", 2024-09-13T06:44:05.214 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.0770000000000008e-06 2024-09-13T06:44:05.214 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:05.214 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:05.214 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:44:05.214 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.704747+0000", 2024-09-13T06:44:05.214 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.2110000000000003e-06 2024-09-13T06:44:05.214 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:05.214 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:05.214 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:44:05.214 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.706676+0000", 2024-09-13T06:44:05.214 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0019289820000000001 2024-09-13T06:44:05.214 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:05.214 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:05.214 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:44:05.214 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.706687+0000", 2024-09-13T06:44:05.215 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1382999999999999e-05 2024-09-13T06:44:05.215 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:05.215 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:05.215 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:44:05.215 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:46.410540+0000", 2024-09-13T06:44:05.215 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.70385235199999996 2024-09-13T06:44:05.215 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:05.215 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:05.215 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:44:05.215 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:46.410723+0000", 2024-09-13T06:44:05.215 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000182998 2024-09-13T06:44:05.215 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:05.215 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:05.215 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:44:05.215 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:46.410910+0000", 2024-09-13T06:44:05.216 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00018720299999999999 2024-09-13T06:44:05.216 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:44:05.216 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:44:05.216 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:44:05.216 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:05.216 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:05.216 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:181669 3.1b 3:dbd5e871:::rbd_data.11218aab7a9c.0000000000000003:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e203)", 2024-09-13T06:44:05.216 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:42:45.705356+0000", 2024-09-13T06:44:05.216 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 79.449774157999997, 2024-09-13T06:44:05.216 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.70583958999999996, 2024-09-13T06:44:05.216 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:44:05.216 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:44:05.216 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:44:05.216 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:44:05.216 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:44:05.217 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 181669 2024-09-13T06:44:05.217 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:05.217 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:44:05.217 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:05.217 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:44:05.217 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.705356+0000", 2024-09-13T06:44:05.217 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:44:05.217 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:05.217 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:05.217 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:44:05.217 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.705356+0000", 2024-09-13T06:44:05.217 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:44:05.217 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:05.217 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:05.217 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:44:05.218 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.705356+0000", 2024-09-13T06:44:05.218 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:44:05.218 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:05.218 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:05.218 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:44:05.218 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.705360+0000", 2024-09-13T06:44:05.218 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.0069999999999999e-06 2024-09-13T06:44:05.218 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:05.218 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:05.218 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:44:05.218 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.705368+0000", 2024-09-13T06:44:05.218 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.3639999999999999e-06 2024-09-13T06:44:05.218 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:05.218 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:05.218 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:44:05.219 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.705375+0000", 2024-09-13T06:44:05.219 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.8839999999999997e-06 2024-09-13T06:44:05.219 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:05.219 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:05.219 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:44:05.219 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.706716+0000", 2024-09-13T06:44:05.219 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0013414589999999999 2024-09-13T06:44:05.219 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:05.219 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:05.219 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:44:05.219 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.706726+0000", 2024-09-13T06:44:05.219 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.5079999999999994e-06 2024-09-13T06:44:05.219 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:05.219 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:05.219 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:44:05.220 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:46.410966+0000", 2024-09-13T06:44:05.220 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.70424025800000001 2024-09-13T06:44:05.220 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:05.220 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:05.220 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:44:05.220 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:46.411099+0000", 2024-09-13T06:44:05.220 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000132395 2024-09-13T06:44:05.220 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:05.220 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:05.220 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:44:05.220 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:46.411196+0000", 2024-09-13T06:44:05.220 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.7344999999999997e-05 2024-09-13T06:44:05.220 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:44:05.220 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:44:05.220 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:44:05.221 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:05.221 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:05.221 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:181683 3.1b 3:dbd5e871:::rbd_data.11218aab7a9c.0000000000000003:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e203)", 2024-09-13T06:44:05.221 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:42:45.705404+0000", 2024-09-13T06:44:05.221 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 79.449726651999995, 2024-09-13T06:44:05.221 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.70639211899999999, 2024-09-13T06:44:05.221 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:44:05.221 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:44:05.221 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:44:05.221 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:44:05.221 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:44:05.221 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 181683 2024-09-13T06:44:05.221 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:05.221 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:44:05.222 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:05.222 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:44:05.222 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.705404+0000", 2024-09-13T06:44:05.222 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:44:05.222 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:05.222 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:05.222 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:44:05.222 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.705404+0000", 2024-09-13T06:44:05.222 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:44:05.222 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:05.222 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:05.222 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:44:05.222 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.705403+0000", 2024-09-13T06:44:05.222 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:44:05.223 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:05.223 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:05.223 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:44:05.223 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.705406+0000", 2024-09-13T06:44:05.223 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.1499999999999999e-06 2024-09-13T06:44:05.223 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:05.223 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:05.223 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:44:05.223 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.705414+0000", 2024-09-13T06:44:05.223 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4259999999999997e-06 2024-09-13T06:44:05.223 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:05.223 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:05.223 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:44:05.223 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.705420+0000", 2024-09-13T06:44:05.224 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.4339999999999997e-06 2024-09-13T06:44:05.224 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:05.224 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:05.224 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:44:05.224 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.706753+0000", 2024-09-13T06:44:05.224 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0013326939999999999 2024-09-13T06:44:05.224 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:05.224 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:05.224 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:44:05.224 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.706762+0000", 2024-09-13T06:44:05.224 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.2439999999999999e-06 2024-09-13T06:44:05.224 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:05.224 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:05.225 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:44:05.225 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:46.411391+0000", 2024-09-13T06:44:05.225 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.70462912099999997 2024-09-13T06:44:05.225 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:05.225 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:05.225 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:44:05.225 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:46.411584+0000", 2024-09-13T06:44:05.225 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00019283399999999999 2024-09-13T06:44:05.225 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:05.225 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:05.225 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:44:05.225 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:46.411796+0000", 2024-09-13T06:44:05.225 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00021175299999999999 2024-09-13T06:44:05.226 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:44:05.226 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:44:05.226 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:44:05.226 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:05.226 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:05.226 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:181697 3.1b 3:dbd5e871:::rbd_data.11218aab7a9c.0000000000000003:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e203)", 2024-09-13T06:44:05.226 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:42:45.705447+0000", 2024-09-13T06:44:05.226 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 79.449683002, 2024-09-13T06:44:05.226 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.70668603500000005, 2024-09-13T06:44:05.226 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:44:05.226 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:44:05.226 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:44:05.227 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:44:05.227 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:44:05.227 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 181697 2024-09-13T06:44:05.227 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:05.227 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:44:05.227 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:05.227 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:44:05.227 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.705447+0000", 2024-09-13T06:44:05.227 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:44:05.227 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:05.227 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:05.227 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:44:05.227 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.705447+0000", 2024-09-13T06:44:05.227 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:44:05.228 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:05.228 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:05.228 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:44:05.228 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.705447+0000", 2024-09-13T06:44:05.228 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:44:05.228 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:05.228 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:05.228 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:44:05.228 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.705450+0000", 2024-09-13T06:44:05.228 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 2.8830000000000002e-06 2024-09-13T06:44:05.228 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:05.228 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:05.228 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:44:05.229 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.705457+0000", 2024-09-13T06:44:05.229 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.097e-06 2024-09-13T06:44:05.229 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:05.229 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:05.229 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:44:05.229 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.705463+0000", 2024-09-13T06:44:05.229 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.2439999999999998e-06 2024-09-13T06:44:05.229 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:05.229 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:05.229 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:44:05.229 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.706790+0000", 2024-09-13T06:44:05.229 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.001326823 2024-09-13T06:44:05.229 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:05.229 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:05.230 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:44:05.230 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.706799+0000", 2024-09-13T06:44:05.230 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.3249999999999997e-06 2024-09-13T06:44:05.230 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:05.230 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:05.230 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:44:05.230 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:46.411884+0000", 2024-09-13T06:44:05.230 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.70508501599999995 2024-09-13T06:44:05.230 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:05.230 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:05.230 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:44:05.230 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:46.412010+0000", 2024-09-13T06:44:05.230 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000125635 2024-09-13T06:44:05.231 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:05.231 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:05.231 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:44:05.231 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:46.412133+0000", 2024-09-13T06:44:05.231 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000123492 2024-09-13T06:44:05.231 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:44:05.231 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:44:05.231 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:44:05.231 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:05.231 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:05.231 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:181711 3.1b 3:dbd5e871:::rbd_data.11218aab7a9c.0000000000000003:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e203)", 2024-09-13T06:44:05.231 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:42:45.705496+0000", 2024-09-13T06:44:05.231 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 79.449634438999993, 2024-09-13T06:44:05.231 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.70714611199999999, 2024-09-13T06:44:05.232 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:44:05.232 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:44:05.232 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:44:05.232 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:44:05.232 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:44:05.232 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 181711 2024-09-13T06:44:05.232 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:05.232 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:44:05.232 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:05.232 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:44:05.232 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.705496+0000", 2024-09-13T06:44:05.232 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:44:05.232 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:05.233 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:05.233 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:44:05.233 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.705496+0000", 2024-09-13T06:44:05.233 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:44:05.233 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:05.233 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:05.233 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:44:05.233 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.705495+0000", 2024-09-13T06:44:05.233 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:44:05.233 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:05.234 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:05.234 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:44:05.234 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.705499+0000", 2024-09-13T06:44:05.234 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.1109999999999999e-06 2024-09-13T06:44:05.234 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:05.234 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:05.234 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:44:05.234 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.705506+0000", 2024-09-13T06:44:05.234 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.8830000000000006e-06 2024-09-13T06:44:05.234 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:05.234 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:05.234 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:44:05.234 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.705513+0000", 2024-09-13T06:44:05.234 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.2500000000000003e-06 2024-09-13T06:44:05.235 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:05.235 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:05.235 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:44:05.235 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.706828+0000", 2024-09-13T06:44:05.235 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0013155840000000001 2024-09-13T06:44:05.235 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:05.235 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:05.235 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:44:05.235 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.706837+0000", 2024-09-13T06:44:05.235 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.0489999999999993e-06 2024-09-13T06:44:05.235 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:05.235 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:05.235 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:44:05.235 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:46.412223+0000", 2024-09-13T06:44:05.236 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.70538530799999999 2024-09-13T06:44:05.236 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:05.236 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:05.236 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:44:05.236 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:46.412418+0000", 2024-09-13T06:44:05.236 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.000195331 2024-09-13T06:44:05.236 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:05.236 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:05.236 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:44:05.236 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:46.412642+0000", 2024-09-13T06:44:05.236 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00022410099999999999 2024-09-13T06:44:05.236 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:44:05.236 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:44:05.236 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:44:05.237 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:05.237 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:05.237 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:181725 3.1b 3:dbd5e871:::rbd_data.11218aab7a9c.0000000000000003:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e203)", 2024-09-13T06:44:05.237 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:42:45.706863+0000", 2024-09-13T06:44:05.237 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 79.448267395000002, 2024-09-13T06:44:05.237 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.70631271699999998, 2024-09-13T06:44:05.237 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:44:05.237 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:44:05.237 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:44:05.237 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:44:05.237 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:44:05.237 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 181725 2024-09-13T06:44:05.237 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:05.240 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:44:05.240 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:05.240 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:44:05.240 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.706863+0000", 2024-09-13T06:44:05.240 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:44:05.240 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:05.240 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:05.240 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:44:05.240 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.706863+0000", 2024-09-13T06:44:05.240 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:44:05.240 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:05.241 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:05.241 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:44:05.241 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.706862+0000", 2024-09-13T06:44:05.241 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.999999 2024-09-13T06:44:05.241 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:05.241 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:05.241 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:44:05.241 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.706869+0000", 2024-09-13T06:44:05.241 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.0899999999999999e-06 2024-09-13T06:44:05.241 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:05.241 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:05.241 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:44:05.241 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.706881+0000", 2024-09-13T06:44:05.241 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.1727e-05 2024-09-13T06:44:05.242 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:05.242 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:05.242 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:44:05.242 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.706891+0000", 2024-09-13T06:44:05.242 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 9.9399999999999997e-06 2024-09-13T06:44:05.242 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:05.242 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:05.242 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:44:05.242 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.706952+0000", 2024-09-13T06:44:05.242 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.1106999999999996e-05 2024-09-13T06:44:05.242 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:05.242 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:05.242 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:44:05.243 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.706966+0000", 2024-09-13T06:44:05.243 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.4173e-05 2024-09-13T06:44:05.243 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:05.243 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:05.243 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:44:05.243 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:46.412754+0000", 2024-09-13T06:44:05.243 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.70578759999999996 2024-09-13T06:44:05.243 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:05.243 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:05.243 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:44:05.243 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:46.412967+0000", 2024-09-13T06:44:05.243 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00021290999999999999 2024-09-13T06:44:05.243 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:05.243 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:05.244 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:44:05.244 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:46.413176+0000", 2024-09-13T06:44:05.244 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00020922099999999999 2024-09-13T06:44:05.244 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:44:05.244 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:44:05.244 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:44:05.244 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:05.244 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:05.244 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:181739 3.1b 3:dbd5e871:::rbd_data.11218aab7a9c.0000000000000003:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e203)", 2024-09-13T06:44:05.244 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:42:45.706937+0000", 2024-09-13T06:44:05.244 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 79.448193184000004, 2024-09-13T06:44:05.244 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.70679418800000005, 2024-09-13T06:44:05.244 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:44:05.245 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:44:05.245 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:44:05.245 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:44:05.245 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:44:05.245 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 181739 2024-09-13T06:44:05.245 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:05.245 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:44:05.245 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:05.245 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:44:05.245 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.706937+0000", 2024-09-13T06:44:05.245 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:44:05.245 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:05.245 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:05.245 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:44:05.246 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.706937+0000", 2024-09-13T06:44:05.246 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:44:05.246 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:05.246 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:05.246 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:44:05.246 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.706937+0000", 2024-09-13T06:44:05.246 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:44:05.246 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:05.246 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:05.246 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:44:05.246 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.706940+0000", 2024-09-13T06:44:05.246 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.4290000000000001e-06 2024-09-13T06:44:05.246 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:05.247 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:05.247 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:44:05.247 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.706949+0000", 2024-09-13T06:44:05.247 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 8.7730000000000005e-06 2024-09-13T06:44:05.247 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:05.247 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:05.247 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:44:05.247 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.706956+0000", 2024-09-13T06:44:05.247 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.4240000000000004e-06 2024-09-13T06:44:05.247 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:05.247 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:05.247 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:44:05.247 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.706999+0000", 2024-09-13T06:44:05.247 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.2410999999999998e-05 2024-09-13T06:44:05.248 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:05.248 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:05.248 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:44:05.248 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.707011+0000", 2024-09-13T06:44:05.248 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.2140999999999999e-05 2024-09-13T06:44:05.248 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:05.248 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:05.248 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:44:05.248 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:46.413278+0000", 2024-09-13T06:44:05.248 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.70626747199999995 2024-09-13T06:44:05.248 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:05.248 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:05.248 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:44:05.248 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:46.413471+0000", 2024-09-13T06:44:05.249 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00019234699999999999 2024-09-13T06:44:05.249 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:05.249 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:05.249 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:44:05.249 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:46.413731+0000", 2024-09-13T06:44:05.249 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00026069 2024-09-13T06:44:05.249 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:44:05.249 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:44:05.249 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:44:05.249 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:05.249 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:05.249 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "osd_op(client.4385.0:181753 3.1b 3:dbd5e871:::rbd_data.11218aab7a9c.0000000000000003:snapdir [list-snaps] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e203)", 2024-09-13T06:44:05.249 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-13T06:42:45.706987+0000", 2024-09-13T06:44:05.250 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 79.448143100999999, 2024-09-13T06:44:05.250 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.70721309200000004, 2024-09-13T06:44:05.250 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-13T06:44:05.250 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "started", 2024-09-13T06:44:05.250 INFO:teuthology.orchestra.run.smithi081.stdout: "client_info": { 2024-09-13T06:44:05.250 INFO:teuthology.orchestra.run.smithi081.stdout: "client": "client.4385", 2024-09-13T06:44:05.250 INFO:teuthology.orchestra.run.smithi081.stdout: "client_addr": "172.21.15.81:0/1366589695", 2024-09-13T06:44:05.250 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 181753 2024-09-13T06:44:05.250 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:05.250 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-13T06:44:05.250 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:05.250 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated", 2024-09-13T06:44:05.250 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.706987+0000", 2024-09-13T06:44:05.250 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:44:05.250 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:05.251 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:05.251 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled", 2024-09-13T06:44:05.251 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.706987+0000", 2024-09-13T06:44:05.251 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0 2024-09-13T06:44:05.251 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:05.251 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:05.251 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read", 2024-09-13T06:44:05.251 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.706987+0000", 2024-09-13T06:44:05.251 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4294967295.9999995 2024-09-13T06:44:05.251 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:05.251 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:05.251 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read", 2024-09-13T06:44:05.251 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.706990+0000", 2024-09-13T06:44:05.252 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 3.0759999999999999e-06 2024-09-13T06:44:05.252 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:05.252 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:05.252 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched", 2024-09-13T06:44:05.252 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.706997+0000", 2024-09-13T06:44:05.252 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 7.5809999999999999e-06 2024-09-13T06:44:05.252 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:05.252 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:05.252 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "queued_for_pg", 2024-09-13T06:44:05.252 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.707004+0000", 2024-09-13T06:44:05.252 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 6.7839999999999998e-06 2024-09-13T06:44:05.252 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:05.252 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:05.252 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:44:05.253 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.707046+0000", 2024-09-13T06:44:05.253 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 4.1474999999999998e-05 2024-09-13T06:44:05.253 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:05.253 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:05.253 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "waiting for peered", 2024-09-13T06:44:05.253 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:45.707056+0000", 2024-09-13T06:44:05.253 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0825000000000001e-05 2024-09-13T06:44:05.253 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:05.253 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:05.253 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "reached_pg", 2024-09-13T06:44:05.253 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:46.413797+0000", 2024-09-13T06:44:05.253 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.70674101099999997 2024-09-13T06:44:05.253 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:05.253 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:05.253 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "started", 2024-09-13T06:44:05.254 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:46.413998+0000", 2024-09-13T06:44:05.254 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00020058700000000001 2024-09-13T06:44:05.254 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T06:44:05.254 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T06:44:05.254 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done", 2024-09-13T06:44:05.254 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-13T06:42:46.414200+0000", 2024-09-13T06:44:05.254 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.00020238400000000001 2024-09-13T06:44:05.254 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:44:05.254 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:44:05.254 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:44:05.254 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T06:44:05.254 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T06:44:05.254 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:44:05.256 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-13T06:44:05.256 INFO:teuthology.orchestra.run.smithi081.stdout:osd.0: {} 2024-09-13T06:44:05.257 INFO:teuthology.orchestra.run.smithi081.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-13T06:44:05.257 INFO:teuthology.orchestra.run.smithi081.stdout:osd.1: {} 2024-09-13T06:44:05.257 INFO:teuthology.orchestra.run.smithi081.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-13T06:44:05.258 INFO:teuthology.orchestra.run.smithi081.stdout:osd.2: {} 2024-09-13T06:44:05.258 INFO:teuthology.orchestra.run.smithi081.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-13T06:44:05.258 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:44:05.256+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:44:05.268 INFO:teuthology.orchestra.run.smithi081.stdout:osd.3: {} 2024-09-13T06:44:05.268 INFO:teuthology.orchestra.run.smithi081.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-13T06:44:05.288 INFO:teuthology.orchestra.run.smithi081.stdout:osd.4: {} 2024-09-13T06:44:05.288 INFO:teuthology.orchestra.run.smithi081.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-13T06:44:05.309 INFO:teuthology.orchestra.run.smithi081.stdout:osd.5: {} 2024-09-13T06:44:05.309 INFO:teuthology.orchestra.run.smithi081.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-13T06:44:05.309 INFO:teuthology.orchestra.run.smithi081.stderr:Error ENXIO: problem getting command descriptions from osd.6 2024-09-13T06:44:05.329 INFO:teuthology.orchestra.run.smithi081.stdout:osd.7: {} 2024-09-13T06:44:05.330 INFO:teuthology.orchestra.run.smithi081.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-13T06:44:05.332 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-13T06:44:05.333 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-13T06:44:05.356 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:44:05.356+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:44:05.373 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:44:05.373 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:44:05.386 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-13T06:44:05.439 INFO:teuthology.orchestra.run.smithi081.stderr:nodeep-scrub is set 2024-09-13T06:44:05.457 INFO:tasks.ceph.osd.4.smithi139.stderr:2024-09-13T06:44:05.456+0000 7f77dc9d2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26379) UID: 0 2024-09-13T06:44:05.549 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:44:05.549 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:44:05.558 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T06:44:05.559+0000 7f1eda83e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26334) UID: 0 2024-09-13T06:44:05.562 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-13T06:44:05.584 INFO:teuthology.orchestra.run.smithi081.stdout:All operations completed A-OK! 2024-09-13T06:44:05.618 DEBUG:teuthology.parallel:result is None 2024-09-13T06:44:05.619 DEBUG:teuthology.run_tasks:Unwinding manager rbd_fsx 2024-09-13T06:44:05.628 DEBUG:teuthology.run_tasks:Unwinding manager thrashosds 2024-09-13T06:44:05.668 INFO:tasks.thrashosds:joining thrashosds 2024-09-13T06:44:05.698 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:44:05.698 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:44:05.711 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-13T06:44:05.828 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:44:05.828 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:44:05.842 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-13T06:44:05.960 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:44:05.961 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:44:05.975 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-13T06:44:06.089 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:44:06.090 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:44:06.102 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-13T06:44:06.208 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:44:06.209 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:44:06.222 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-13T06:44:06.330 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:44:06.330 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:44:06.343 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-13T06:44:06.472 INFO:teuthology.orchestra.run.smithi081.stdout:ERROR: (22) Invalid argument 2024-09-13T06:44:06.472 INFO:teuthology.orchestra.run.smithi081.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:44:06.485 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-13T06:44:06.616 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:44:06.617 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:44:06.631 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-13T06:44:06.752 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:44:06.752 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:44:06.766 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-13T06:44:06.889 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:44:06.889 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:44:06.903 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-13T06:44:07.020 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:44:07.020 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:44:07.034 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-13T06:44:07.157 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:44:07.157 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:44:07.172 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-13T06:44:07.293 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:44:07.293 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:44:07.307 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-13T06:44:07.433 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:44:07.433 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:44:07.447 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-13T06:44:07.463 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-13T06:44:07.565 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:44:07.565 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:44:07.579 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-13T06:44:07.705 INFO:teuthology.orchestra.run.smithi139.stdout:ERROR: (22) Invalid argument 2024-09-13T06:44:07.705 INFO:teuthology.orchestra.run.smithi139.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-13T06:44:08.641 INFO:teuthology.orchestra.run.smithi081.stderr:noscrub is unset 2024-09-13T06:44:08.663 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-13T06:44:09.466 INFO:tasks.thrashosds.thrasher:reviving osd 2024-09-13T06:44:09.466 INFO:tasks.thrashosds.thrasher:Reviving osd 6 2024-09-13T06:44:09.467 INFO:tasks.ceph.osd.6:Restarting daemon 2024-09-13T06:44:09.467 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-09-13T06:44:09.470 INFO:tasks.ceph.osd.6:Started 2024-09-13T06:44:09.470 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-13T06:44:09.597 INFO:teuthology.orchestra.run.smithi139.stderr:no valid command found; 10 closest matches: 2024-09-13T06:44:09.597 INFO:teuthology.orchestra.run.smithi139.stderr:0 2024-09-13T06:44:09.597 INFO:teuthology.orchestra.run.smithi139.stderr:1 2024-09-13T06:44:09.597 INFO:teuthology.orchestra.run.smithi139.stderr:2 2024-09-13T06:44:09.597 INFO:teuthology.orchestra.run.smithi139.stderr:abort 2024-09-13T06:44:09.597 INFO:teuthology.orchestra.run.smithi139.stderr:assert 2024-09-13T06:44:09.598 INFO:teuthology.orchestra.run.smithi139.stderr:config diff 2024-09-13T06:44:09.598 INFO:teuthology.orchestra.run.smithi139.stderr:config diff get 2024-09-13T06:44:09.598 INFO:teuthology.orchestra.run.smithi139.stderr:config get 2024-09-13T06:44:09.598 INFO:teuthology.orchestra.run.smithi139.stderr:config help [] 2024-09-13T06:44:09.598 INFO:teuthology.orchestra.run.smithi139.stderr:config set ... 2024-09-13T06:44:09.598 INFO:teuthology.orchestra.run.smithi139.stderr:admin_socket: invalid command 2024-09-13T06:44:09.599 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-13T06:44:09.600 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-6, ['dump_ops_in_flight'] 2024-09-13T06:44:09.655 INFO:teuthology.orchestra.run.smithi081.stderr:nodeep-scrub is unset 2024-09-13T06:44:10.077 INFO:tasks.ceph.osd.6.smithi139.stderr:2024-09-13T06:44:10.076+0000 7f4bed5677c0 -1 Falling back to public interface 2024-09-13T06:44:13.754 INFO:tasks.ceph.osd.6.smithi139.stderr:2024-09-13T06:44:13.752+0000 7f4bed5677c0 -1 osd.6 207 log_to_monitors true 2024-09-13T06:44:14.601 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-13T06:44:14.710 INFO:tasks.ceph.osd.6.smithi139.stderr:2024-09-13T06:44:14.708+0000 7f4be132e640 -1 osd.6 247 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T06:44:14.739 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-13T06:44:14.739 INFO:teuthology.orchestra.run.smithi139.stdout: "ops": [], 2024-09-13T06:44:14.739 INFO:teuthology.orchestra.run.smithi139.stdout: "num_ops": 0 2024-09-13T06:44:14.739 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-13T06:44:14.754 INFO:tasks.thrashosds.thrasher:inning osd 2024-09-13T06:44:14.754 INFO:tasks.thrashosds.thrasher:Adding osd 6 2024-09-13T06:44:14.754 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd in 6 2024-09-13T06:44:15.066 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-13T06:44:15.062+0000 7fcdeb9fe640 -1 mon.a@0(leader).osd e285 definitely_dead 0 2024-09-13T06:44:15.681 INFO:teuthology.orchestra.run.smithi081.stderr:marked in osd.6. 2024-09-13T06:44:15.708 INFO:tasks.thrashosds.thrasher:Added osd 6 2024-09-13T06:44:15.708 INFO:tasks.thrashosds.thrasher:inning osd 2024-09-13T06:44:15.708 INFO:tasks.thrashosds.thrasher:Adding osd 2 2024-09-13T06:44:15.709 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd in 2 2024-09-13T06:44:16.002 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-13T06:44:16.002+0000 7fcdeb9fe640 -1 mon.a@0(leader).osd e286 definitely_dead 0 2024-09-13T06:44:16.432 INFO:teuthology.orchestra.run.smithi081.stderr:marked in osd.2. 2024-09-13T06:44:16.461 INFO:tasks.thrashosds.thrasher:Added osd 2 2024-09-13T06:44:16.462 INFO:tasks.thrashosds.thrasher:inning osd 2024-09-13T06:44:16.462 INFO:tasks.thrashosds.thrasher:Adding osd 1 2024-09-13T06:44:16.462 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd in 1 2024-09-13T06:44:16.766 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-13T06:44:16.762+0000 7fcdeb9fe640 -1 mon.a@0(leader).osd e287 definitely_dead 0 2024-09-13T06:44:17.442 INFO:teuthology.orchestra.run.smithi081.stderr:marked in osd.1. 2024-09-13T06:44:17.467 INFO:tasks.thrashosds.thrasher:Added osd 1 2024-09-13T06:44:17.467 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=600 2024-09-13T06:44:17.599 INFO:teuthology.orchestra.run.smithi081.stdout:mon.a: {} 2024-09-13T06:44:17.600 INFO:teuthology.orchestra.run.smithi081.stderr:mon.a: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-13T06:44:17.613 INFO:teuthology.orchestra.run.smithi081.stdout:mon.b: {} 2024-09-13T06:44:17.614 INFO:teuthology.orchestra.run.smithi081.stderr:mon.b: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-13T06:44:17.623 INFO:teuthology.orchestra.run.smithi081.stdout:mon.c: {} 2024-09-13T06:44:17.623 INFO:teuthology.orchestra.run.smithi081.stderr:mon.c: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-13T06:44:17.640 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-09-13T06:44:18.458 INFO:teuthology.orchestra.run.smithi081.stderr:reweighted osd.0 to 1 (10000) 2024-09-13T06:44:18.499 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 0 1 2024-09-13T06:44:19.454 INFO:teuthology.orchestra.run.smithi081.stderr:set osd.0 primary-affinity to 1 (8655362) 2024-09-13T06:44:19.492 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-09-13T06:44:20.455 INFO:teuthology.orchestra.run.smithi081.stderr:reweighted osd.1 to 1 (10000) 2024-09-13T06:44:20.489 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 1 1 2024-09-13T06:44:21.436 INFO:teuthology.orchestra.run.smithi081.stderr:set osd.1 primary-affinity to 1 (8655362) 2024-09-13T06:44:21.463 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-09-13T06:44:22.445 INFO:teuthology.orchestra.run.smithi081.stderr:reweighted osd.2 to 1 (10000) 2024-09-13T06:44:22.473 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 2 1 2024-09-13T06:44:23.712 INFO:teuthology.orchestra.run.smithi081.stderr:set osd.2 primary-affinity to 1 (8655362) 2024-09-13T06:44:23.737 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 3 1 2024-09-13T06:44:24.713 INFO:teuthology.orchestra.run.smithi081.stderr:reweighted osd.3 to 1 (10000) 2024-09-13T06:44:24.739 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 3 1 2024-09-13T06:44:25.723 INFO:teuthology.orchestra.run.smithi081.stderr:set osd.3 primary-affinity to 1 (8655362) 2024-09-13T06:44:25.747 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 4 1 2024-09-13T06:44:26.737 INFO:teuthology.orchestra.run.smithi081.stderr:reweighted osd.4 to 1 (10000) 2024-09-13T06:44:26.762 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 4 1 2024-09-13T06:44:27.753 INFO:teuthology.orchestra.run.smithi081.stderr:set osd.4 primary-affinity to 1 (8655362) 2024-09-13T06:44:27.777 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 5 1 2024-09-13T06:44:28.763 INFO:teuthology.orchestra.run.smithi081.stderr:reweighted osd.5 to 1 (10000) 2024-09-13T06:44:28.789 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 5 1 2024-09-13T06:44:29.769 INFO:teuthology.orchestra.run.smithi081.stderr:set osd.5 primary-affinity to 1 (8655362) 2024-09-13T06:44:29.797 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 7 1 2024-09-13T06:44:30.787 INFO:teuthology.orchestra.run.smithi081.stderr:reweighted osd.7 to 1 (10000) 2024-09-13T06:44:30.812 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 7 1 2024-09-13T06:44:31.791 INFO:teuthology.orchestra.run.smithi081.stderr:set osd.7 primary-affinity to 1 (8655362) 2024-09-13T06:44:31.817 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 6 1 2024-09-13T06:44:32.806 INFO:teuthology.orchestra.run.smithi081.stderr:reweighted osd.6 to 1 (10000) 2024-09-13T06:44:32.832 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 6 1 2024-09-13T06:44:33.828 INFO:teuthology.orchestra.run.smithi081.stderr:set osd.6 primary-affinity to 1 (8655362) 2024-09-13T06:44:33.852 INFO:tasks.thrashosds.thrasher:joining the do_sighup greenlet 2024-09-13T06:44:33.852 INFO:tasks.thrashosds.thrasher:joining the do_optrack_toggle greenlet 2024-09-13T06:44:33.852 INFO:tasks.thrashosds.thrasher:joining the do_dump_ops greenlet 2024-09-13T06:44:33.852 INFO:tasks.thrashosds.thrasher:joining the do_noscrub_toggle greenlet 2024-09-13T06:44:33.852 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-13T06:44:33.852 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T06:44:34.149 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T06:44:34.150 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":304,"fsid":"e5612297-d004-4957-927e-afa37f30d6cf","created":"2024-09-13T06:38:56.670231+0000","modified":"2024-09-13T06:44:33.812427+0000","last_up_change":"2024-09-13T06:44:15.668516+0000","last_in_change":"2024-09-13T06:44:17.424862+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T06:39:09.600726+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-13T06:39:15.802118+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":20,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"pool_client.0","create_time":"2024-09-13T06:39:25.648942+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"280","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":175,"snap_epoch":280,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"54b0a3e4-58ad-4f95-86dc-29a11c9a1964","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":300,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":1904727940},{"type":"v1","addr":"172.21.15.81:6809","nonce":1904727940}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":1904727940},{"type":"v1","addr":"172.21.15.81:6811","nonce":1904727940}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":1904727940},{"type":"v1","addr":"172.21.15.81:6815","nonce":1904727940}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":1904727940},{"type":"v1","addr":"172.21.15.81:6813","nonce":1904727940}]},"public_addr":"172.21.15.81:6809/1904727940","cluster_addr":"172.21.15.81:6811/1904727940","heartbeat_back_addr":"172.21.15.81:6815/1904727940","heartbeat_front_addr":"172.21.15.81:6813/1904727940","state":["exists","up"]},{"osd":1,"uuid":"a6dba5b9-c833-465e-a8a5-1741528b24c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":292,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":738205570},{"type":"v1","addr":"172.21.15.81:6819","nonce":738205570}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":738205570},{"type":"v1","addr":"172.21.15.81:6824","nonce":738205570}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":738205570},{"type":"v1","addr":"172.21.15.81:6831","nonce":738205570}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":738205570},{"type":"v1","addr":"172.21.15.81:6829","nonce":738205570}]},"public_addr":"172.21.15.81:6819/738205570","cluster_addr":"172.21.15.81:6824/738205570","heartbeat_back_addr":"172.21.15.81:6831/738205570","heartbeat_front_addr":"172.21.15.81:6829/738205570","state":["exists","up"]},{"osd":2,"uuid":"6c45097e-44a2-454f-80a4-0fe879ccd52f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":290,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":3558674335},{"type":"v1","addr":"172.21.15.81:6818","nonce":3558674335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":3558674335},{"type":"v1","addr":"172.21.15.81:6821","nonce":3558674335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6827","nonce":3558674335},{"type":"v1","addr":"172.21.15.81:6828","nonce":3558674335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6823","nonce":3558674335},{"type":"v1","addr":"172.21.15.81:6825","nonce":3558674335}]},"public_addr":"172.21.15.81:6818/3558674335","cluster_addr":"172.21.15.81:6821/3558674335","heartbeat_back_addr":"172.21.15.81:6828/3558674335","heartbeat_front_addr":"172.21.15.81:6825/3558674335","state":["exists","up"]},{"osd":3,"uuid":"31952760-06f3-4618-a5c4-f5c4fed3aadb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":292,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":1886327229},{"type":"v1","addr":"172.21.15.81:6801","nonce":1886327229}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":1886327229},{"type":"v1","addr":"172.21.15.81:6803","nonce":1886327229}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":1886327229},{"type":"v1","addr":"172.21.15.81:6807","nonce":1886327229}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":1886327229},{"type":"v1","addr":"172.21.15.81:6805","nonce":1886327229}]},"public_addr":"172.21.15.81:6801/1886327229","cluster_addr":"172.21.15.81:6803/1886327229","heartbeat_back_addr":"172.21.15.81:6807/1886327229","heartbeat_front_addr":"172.21.15.81:6805/1886327229","state":["exists","up"]},{"osd":4,"uuid":"c9bd2751-c836-43dc-b844-e13678cb2fd9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":298,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6817","nonce":2184515621},{"type":"v1","addr":"172.21.15.139:6819","nonce":2184515621}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6820","nonce":2184515621},{"type":"v1","addr":"172.21.15.139:6822","nonce":2184515621}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6827","nonce":2184515621},{"type":"v1","addr":"172.21.15.139:6829","nonce":2184515621}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6824","nonce":2184515621},{"type":"v1","addr":"172.21.15.139:6826","nonce":2184515621}]},"public_addr":"172.21.15.139:6819/2184515621","cluster_addr":"172.21.15.139:6822/2184515621","heartbeat_back_addr":"172.21.15.139:6829/2184515621","heartbeat_front_addr":"172.21.15.139:6826/2184515621","state":["exists","up"]},{"osd":5,"uuid":"2971b93a-6c9f-4b77-b526-4eac788fabf9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":300,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6816","nonce":3982901834},{"type":"v1","addr":"172.21.15.139:6818","nonce":3982901834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6821","nonce":3982901834},{"type":"v1","addr":"172.21.15.139:6823","nonce":3982901834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6830","nonce":3982901834},{"type":"v1","addr":"172.21.15.139:6831","nonce":3982901834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6825","nonce":3982901834},{"type":"v1","addr":"172.21.15.139:6828","nonce":3982901834}]},"public_addr":"172.21.15.139:6818/3982901834","cluster_addr":"172.21.15.139:6823/3982901834","heartbeat_back_addr":"172.21.15.139:6831/3982901834","heartbeat_front_addr":"172.21.15.139:6828/3982901834","state":["exists","up"]},{"osd":6,"uuid":"e1f786ce-579e-48cc-b212-83f881b94184","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":13,"last_clean_end":207,"up_from":286,"up_thru":289,"down_at":209,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6800","nonce":4159560454},{"type":"v1","addr":"172.21.15.139:6801","nonce":4159560454}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6802","nonce":4159560454},{"type":"v1","addr":"172.21.15.139:6803","nonce":4159560454}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6806","nonce":4159560454},{"type":"v1","addr":"172.21.15.139:6807","nonce":4159560454}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6804","nonce":4159560454},{"type":"v1","addr":"172.21.15.139:6805","nonce":4159560454}]},"public_addr":"172.21.15.139:6801/4159560454","cluster_addr":"172.21.15.139:6803/4159560454","heartbeat_back_addr":"172.21.15.139:6807/4159560454","heartbeat_front_addr":"172.21.15.139:6805/4159560454","state":["exists","up"]},{"osd":7,"uuid":"a287ddf6-84eb-4225-b267-25eee1657625","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":13,"last_clean_end":121,"up_from":187,"up_thru":300,"down_at":122,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6808","nonce":105054579},{"type":"v1","addr":"172.21.15.139:6809","nonce":105054579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6810","nonce":105054579},{"type":"v1","addr":"172.21.15.139:6811","nonce":105054579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6814","nonce":105054579},{"type":"v1","addr":"172.21.15.139:6815","nonce":105054579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6812","nonce":105054579},{"type":"v1","addr":"172.21.15.139:6813","nonce":105054579}]},"public_addr":"172.21.15.139:6809/105054579","cluster_addr":"172.21.15.139:6811/105054579","heartbeat_back_addr":"172.21.15.139:6815/105054579","heartbeat_front_addr":"172.21.15.139:6813/105054579","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T06:39:05.476871+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T06:39:05.455183+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T06:39:05.504853+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T06:39:05.372429+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T06:39:05.421023+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T06:39:05.477489+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T06:39:05.314700+0000","dead_epoch":209},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T06:39:05.462229+0000","dead_epoch":122}],"pg_upmap":[{"pgid":"3.9","osds":[2,6]}],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T06:44:34.168 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-13T06:44:34.169 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T06:44:34.454 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T06:44:34.454 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":304,"fsid":"e5612297-d004-4957-927e-afa37f30d6cf","created":"2024-09-13T06:38:56.670231+0000","modified":"2024-09-13T06:44:33.812427+0000","last_up_change":"2024-09-13T06:44:15.668516+0000","last_in_change":"2024-09-13T06:44:17.424862+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T06:39:09.600726+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-13T06:39:15.802118+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":20,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"pool_client.0","create_time":"2024-09-13T06:39:25.648942+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"280","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":175,"snap_epoch":280,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"54b0a3e4-58ad-4f95-86dc-29a11c9a1964","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":300,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":1904727940},{"type":"v1","addr":"172.21.15.81:6809","nonce":1904727940}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":1904727940},{"type":"v1","addr":"172.21.15.81:6811","nonce":1904727940}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":1904727940},{"type":"v1","addr":"172.21.15.81:6815","nonce":1904727940}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":1904727940},{"type":"v1","addr":"172.21.15.81:6813","nonce":1904727940}]},"public_addr":"172.21.15.81:6809/1904727940","cluster_addr":"172.21.15.81:6811/1904727940","heartbeat_back_addr":"172.21.15.81:6815/1904727940","heartbeat_front_addr":"172.21.15.81:6813/1904727940","state":["exists","up"]},{"osd":1,"uuid":"a6dba5b9-c833-465e-a8a5-1741528b24c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":292,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":738205570},{"type":"v1","addr":"172.21.15.81:6819","nonce":738205570}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":738205570},{"type":"v1","addr":"172.21.15.81:6824","nonce":738205570}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":738205570},{"type":"v1","addr":"172.21.15.81:6831","nonce":738205570}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":738205570},{"type":"v1","addr":"172.21.15.81:6829","nonce":738205570}]},"public_addr":"172.21.15.81:6819/738205570","cluster_addr":"172.21.15.81:6824/738205570","heartbeat_back_addr":"172.21.15.81:6831/738205570","heartbeat_front_addr":"172.21.15.81:6829/738205570","state":["exists","up"]},{"osd":2,"uuid":"6c45097e-44a2-454f-80a4-0fe879ccd52f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":290,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":3558674335},{"type":"v1","addr":"172.21.15.81:6818","nonce":3558674335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":3558674335},{"type":"v1","addr":"172.21.15.81:6821","nonce":3558674335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6827","nonce":3558674335},{"type":"v1","addr":"172.21.15.81:6828","nonce":3558674335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6823","nonce":3558674335},{"type":"v1","addr":"172.21.15.81:6825","nonce":3558674335}]},"public_addr":"172.21.15.81:6818/3558674335","cluster_addr":"172.21.15.81:6821/3558674335","heartbeat_back_addr":"172.21.15.81:6828/3558674335","heartbeat_front_addr":"172.21.15.81:6825/3558674335","state":["exists","up"]},{"osd":3,"uuid":"31952760-06f3-4618-a5c4-f5c4fed3aadb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":292,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":1886327229},{"type":"v1","addr":"172.21.15.81:6801","nonce":1886327229}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":1886327229},{"type":"v1","addr":"172.21.15.81:6803","nonce":1886327229}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":1886327229},{"type":"v1","addr":"172.21.15.81:6807","nonce":1886327229}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":1886327229},{"type":"v1","addr":"172.21.15.81:6805","nonce":1886327229}]},"public_addr":"172.21.15.81:6801/1886327229","cluster_addr":"172.21.15.81:6803/1886327229","heartbeat_back_addr":"172.21.15.81:6807/1886327229","heartbeat_front_addr":"172.21.15.81:6805/1886327229","state":["exists","up"]},{"osd":4,"uuid":"c9bd2751-c836-43dc-b844-e13678cb2fd9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":298,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6817","nonce":2184515621},{"type":"v1","addr":"172.21.15.139:6819","nonce":2184515621}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6820","nonce":2184515621},{"type":"v1","addr":"172.21.15.139:6822","nonce":2184515621}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6827","nonce":2184515621},{"type":"v1","addr":"172.21.15.139:6829","nonce":2184515621}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6824","nonce":2184515621},{"type":"v1","addr":"172.21.15.139:6826","nonce":2184515621}]},"public_addr":"172.21.15.139:6819/2184515621","cluster_addr":"172.21.15.139:6822/2184515621","heartbeat_back_addr":"172.21.15.139:6829/2184515621","heartbeat_front_addr":"172.21.15.139:6826/2184515621","state":["exists","up"]},{"osd":5,"uuid":"2971b93a-6c9f-4b77-b526-4eac788fabf9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":300,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6816","nonce":3982901834},{"type":"v1","addr":"172.21.15.139:6818","nonce":3982901834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6821","nonce":3982901834},{"type":"v1","addr":"172.21.15.139:6823","nonce":3982901834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6830","nonce":3982901834},{"type":"v1","addr":"172.21.15.139:6831","nonce":3982901834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6825","nonce":3982901834},{"type":"v1","addr":"172.21.15.139:6828","nonce":3982901834}]},"public_addr":"172.21.15.139:6818/3982901834","cluster_addr":"172.21.15.139:6823/3982901834","heartbeat_back_addr":"172.21.15.139:6831/3982901834","heartbeat_front_addr":"172.21.15.139:6828/3982901834","state":["exists","up"]},{"osd":6,"uuid":"e1f786ce-579e-48cc-b212-83f881b94184","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":13,"last_clean_end":207,"up_from":286,"up_thru":289,"down_at":209,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6800","nonce":4159560454},{"type":"v1","addr":"172.21.15.139:6801","nonce":4159560454}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6802","nonce":4159560454},{"type":"v1","addr":"172.21.15.139:6803","nonce":4159560454}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6806","nonce":4159560454},{"type":"v1","addr":"172.21.15.139:6807","nonce":4159560454}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6804","nonce":4159560454},{"type":"v1","addr":"172.21.15.139:6805","nonce":4159560454}]},"public_addr":"172.21.15.139:6801/4159560454","cluster_addr":"172.21.15.139:6803/4159560454","heartbeat_back_addr":"172.21.15.139:6807/4159560454","heartbeat_front_addr":"172.21.15.139:6805/4159560454","state":["exists","up"]},{"osd":7,"uuid":"a287ddf6-84eb-4225-b267-25eee1657625","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":13,"last_clean_end":121,"up_from":187,"up_thru":300,"down_at":122,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6808","nonce":105054579},{"type":"v1","addr":"172.21.15.139:6809","nonce":105054579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6810","nonce":105054579},{"type":"v1","addr":"172.21.15.139:6811","nonce":105054579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6814","nonce":105054579},{"type":"v1","addr":"172.21.15.139:6815","nonce":105054579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6812","nonce":105054579},{"type":"v1","addr":"172.21.15.139:6813","nonce":105054579}]},"public_addr":"172.21.15.139:6809/105054579","cluster_addr":"172.21.15.139:6811/105054579","heartbeat_back_addr":"172.21.15.139:6815/105054579","heartbeat_front_addr":"172.21.15.139:6813/105054579","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T06:39:05.476871+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T06:39:05.455183+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T06:39:05.504853+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T06:39:05.372429+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T06:39:05.421023+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T06:39:05.477489+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T06:39:05.314700+0000","dead_epoch":209},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T06:39:05.462229+0000","dead_epoch":122}],"pg_upmap":[{"pgid":"3.9","osds":[2,6]}],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T06:44:34.473 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-13T06:44:34.474 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-13T06:44:34.474 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-13T06:44:34.475 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-09-13T06:44:34.475 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-09-13T06:44:34.476 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-09-13T06:44:34.476 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-09-13T06:44:34.476 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-09-13T06:44:34.728 INFO:teuthology.orchestra.run.smithi081.stdout:55834574919 2024-09-13T06:44:34.729 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-13T06:44:34.730 INFO:teuthology.orchestra.run.smithi081.stdout:55834574916 2024-09-13T06:44:34.731 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-13T06:44:34.734 INFO:teuthology.orchestra.run.smithi081.stdout:55834574915 2024-09-13T06:44:34.735 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-13T06:44:34.740 INFO:teuthology.orchestra.run.smithi081.stdout:803158884379 2024-09-13T06:44:34.741 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-13T06:44:34.745 INFO:teuthology.orchestra.run.smithi081.stdout:55834574916 2024-09-13T06:44:34.745 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-13T06:44:34.749 INFO:teuthology.orchestra.run.smithi081.stdout:55834574916 2024-09-13T06:44:34.749 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-13T06:44:34.750 INFO:teuthology.orchestra.run.smithi081.stdout:55834574916 2024-09-13T06:44:34.751 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-13T06:44:34.759 INFO:teuthology.orchestra.run.smithi081.stdout:1228360646661 2024-09-13T06:44:34.760 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-13T06:44:35.230 INFO:teuthology.orchestra.run.smithi081.stdout:55834574918 2024-09-13T06:44:35.252 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574919 got 55834574918 for osd.3 2024-09-13T06:44:35.260 INFO:teuthology.orchestra.run.smithi081.stdout:803158884378 2024-09-13T06:44:35.268 INFO:teuthology.orchestra.run.smithi081.stdout:55834574915 2024-09-13T06:44:35.271 INFO:teuthology.orchestra.run.smithi081.stdout:55834574915 2024-09-13T06:44:35.280 INFO:teuthology.orchestra.run.smithi081.stdout:55834574914 2024-09-13T06:44:35.287 INFO:tasks.ceph.ceph_manager.ceph:need seq 803158884379 got 803158884378 for osd.7 2024-09-13T06:44:35.297 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574916 got 55834574915 for osd.2 2024-09-13T06:44:35.298 INFO:teuthology.orchestra.run.smithi081.stdout:55834574915 2024-09-13T06:44:35.304 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574916 got 55834574915 for osd.4 2024-09-13T06:44:35.306 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574915 got 55834574914 for osd.0 2024-09-13T06:44:35.316 INFO:teuthology.orchestra.run.smithi081.stdout:55834574915 2024-09-13T06:44:35.316 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574916 got 55834574915 for osd.5 2024-09-13T06:44:35.319 INFO:teuthology.orchestra.run.smithi081.stdout:1228360646660 2024-09-13T06:44:35.336 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574916 got 55834574915 for osd.1 2024-09-13T06:44:35.338 INFO:tasks.ceph.ceph_manager.ceph:need seq 1228360646661 got 1228360646660 for osd.6 2024-09-13T06:44:36.253 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-13T06:44:36.288 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-13T06:44:36.298 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-13T06:44:36.305 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-13T06:44:36.306 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-13T06:44:36.317 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-13T06:44:36.337 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-13T06:44:36.339 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-13T06:44:36.768 INFO:teuthology.orchestra.run.smithi081.stdout:55834574920 2024-09-13T06:44:36.791 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574919 got 55834574920 for osd.3 2024-09-13T06:44:36.792 DEBUG:teuthology.parallel:result is None 2024-09-13T06:44:36.798 INFO:teuthology.orchestra.run.smithi081.stdout:803158884379 2024-09-13T06:44:36.810 INFO:teuthology.orchestra.run.smithi081.stdout:55834574917 2024-09-13T06:44:36.825 INFO:tasks.ceph.ceph_manager.ceph:need seq 803158884379 got 803158884379 for osd.7 2024-09-13T06:44:36.825 DEBUG:teuthology.parallel:result is None 2024-09-13T06:44:36.838 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574916 got 55834574917 for osd.2 2024-09-13T06:44:36.838 DEBUG:teuthology.parallel:result is None 2024-09-13T06:44:36.843 INFO:teuthology.orchestra.run.smithi081.stdout:55834574916 2024-09-13T06:44:36.847 INFO:teuthology.orchestra.run.smithi081.stdout:1228360646661 2024-09-13T06:44:36.852 INFO:teuthology.orchestra.run.smithi081.stdout:55834574917 2024-09-13T06:44:36.860 INFO:teuthology.orchestra.run.smithi081.stdout:55834574917 2024-09-13T06:44:36.870 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574915 got 55834574916 for osd.0 2024-09-13T06:44:36.871 DEBUG:teuthology.parallel:result is None 2024-09-13T06:44:36.871 INFO:tasks.ceph.ceph_manager.ceph:need seq 1228360646661 got 1228360646661 for osd.6 2024-09-13T06:44:36.871 DEBUG:teuthology.parallel:result is None 2024-09-13T06:44:36.875 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574916 got 55834574917 for osd.4 2024-09-13T06:44:36.875 DEBUG:teuthology.parallel:result is None 2024-09-13T06:44:36.887 INFO:teuthology.orchestra.run.smithi081.stdout:55834574917 2024-09-13T06:44:36.888 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574916 got 55834574917 for osd.5 2024-09-13T06:44:36.888 DEBUG:teuthology.parallel:result is None 2024-09-13T06:44:36.903 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574916 got 55834574917 for osd.1 2024-09-13T06:44:36.903 DEBUG:teuthology.parallel:result is None 2024-09-13T06:44:36.903 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-09-13T06:44:36.903 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T06:44:37.218 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T06:44:37.219 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-09-13T06:44:37.234 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":461,"stamp":"2024-09-13T06:44:35.609022+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590406,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":237398,"num_read_kb":1402962,"num_write":33483,"num_write_kb":1011328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9257,"num_bytes_recovered":444809309,"num_keys_recovered":867,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":24606,"ondisk_log_size":24606,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":486484,"kb_used_data":29976,"kb_used_omap":26,"kb_used_meta":456357,"kb_avail":754488236,"statfs":{"total":773094113280,"available":772595953664,"internally_reserved":0,"allocated":30695424,"data_stored":15965436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":27392,"internal_metadata":467309824},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":-22,"num_bytes_recovered":-19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.001384"},"pg_stats":[{"pgid":"3.1f","version":"280'781","reported_seq":6286,"reported_epoch":302,"state":"active+clean","last_fresh":"2024-09-13T06:44:31.794290+0000","last_change":"2024-09-13T06:44:05.445184+0000","last_active":"2024-09-13T06:44:31.794290+0000","last_peered":"2024-09-13T06:44:31.794290+0000","last_clean":"2024-09-13T06:44:31.794290+0000","last_became_active":"2024-09-13T06:40:57.385213+0000","last_became_peered":"2024-09-13T06:40:57.385213+0000","last_unstale":"2024-09-13T06:44:31.794290+0000","last_undegraded":"2024-09-13T06:44:31.794290+0000","last_fullsized":"2024-09-13T06:44:31.794290+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":781,"log_dups_size":0,"ondisk_log_size":781,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:46:17.100560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00056495999999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6518,"num_read_kb":34199,"num_write":1043,"num_write_kb":37100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":72,"num_bytes_recovered":6114482,"num_keys_recovered":44,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"271'1110","reported_seq":7421,"reported_epoch":303,"state":"active+clean","last_fresh":"2024-09-13T06:44:32.807368+0000","last_change":"2024-09-13T06:44:20.462945+0000","last_active":"2024-09-13T06:44:32.807368+0000","last_peered":"2024-09-13T06:44:32.807368+0000","last_clean":"2024-09-13T06:44:32.807368+0000","last_became_active":"2024-09-13T06:44:20.460702+0000","last_became_peered":"2024-09-13T06:44:20.460702+0000","last_unstale":"2024-09-13T06:44:32.807368+0000","last_undegraded":"2024-09-13T06:44:32.807368+0000","last_fullsized":"2024-09-13T06:44:32.807368+0000","mapping_epoch":290,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":291,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":1110,"log_dups_size":0,"ondisk_log_size":1110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:02:22.560348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013343369999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8806,"num_read_kb":55237,"num_write":1632,"num_write_kb":29160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":491,"num_bytes_recovered":16489974,"num_keys_recovered":55,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"279'1047","reported_seq":5655,"reported_epoch":302,"state":"active+clean","last_fresh":"2024-09-13T06:44:31.833302+0000","last_change":"2024-09-13T06:44:30.808653+0000","last_active":"2024-09-13T06:44:31.833302+0000","last_peered":"2024-09-13T06:44:31.833302+0000","last_clean":"2024-09-13T06:44:31.833302+0000","last_became_active":"2024-09-13T06:44:30.803142+0000","last_became_peered":"2024-09-13T06:44:30.803142+0000","last_unstale":"2024-09-13T06:44:31.833302+0000","last_undegraded":"2024-09-13T06:44:31.833302+0000","last_fullsized":"2024-09-13T06:44:31.833302+0000","mapping_epoch":300,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":301,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":1047,"log_dups_size":0,"ondisk_log_size":1047,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:25:53.597990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00088262599999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6265,"num_read_kb":28067,"num_write":1605,"num_write_kb":33265,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":206,"num_bytes_recovered":8442088,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1c","version":"280'843","reported_seq":8394,"reported_epoch":302,"state":"active+clean","last_fresh":"2024-09-13T06:44:31.833265+0000","last_change":"2024-09-13T06:44:30.807782+0000","last_active":"2024-09-13T06:44:31.833265+0000","last_peered":"2024-09-13T06:44:31.833265+0000","last_clean":"2024-09-13T06:44:31.833265+0000","last_became_active":"2024-09-13T06:44:30.801783+0000","last_became_peered":"2024-09-13T06:44:30.801783+0000","last_unstale":"2024-09-13T06:44:31.833265+0000","last_undegraded":"2024-09-13T06:44:31.833265+0000","last_fullsized":"2024-09-13T06:44:31.833265+0000","mapping_epoch":300,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":301,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":843,"log_dups_size":0,"ondisk_log_size":843,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:54:20.743708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001581236,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9390,"num_read_kb":69964,"num_write":963,"num_write_kb":31840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":350,"num_bytes_recovered":42380134,"num_keys_recovered":286,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"277'852","reported_seq":5169,"reported_epoch":302,"state":"active+clean","last_fresh":"2024-09-13T06:44:31.794146+0000","last_change":"2024-09-13T06:44:05.444712+0000","last_active":"2024-09-13T06:44:31.794146+0000","last_peered":"2024-09-13T06:44:31.794146+0000","last_clean":"2024-09-13T06:44:31.794146+0000","last_became_active":"2024-09-13T06:43:31.415608+0000","last_became_peered":"2024-09-13T06:43:31.415608+0000","last_unstale":"2024-09-13T06:44:31.794146+0000","last_undegraded":"2024-09-13T06:44:31.794146+0000","last_fullsized":"2024-09-13T06:44:31.794146+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":852,"log_dups_size":0,"ondisk_log_size":852,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:39:01.416782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060857399999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5714,"num_read_kb":37037,"num_write":1079,"num_write_kb":33376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":295,"num_bytes_recovered":25415745,"num_keys_recovered":55,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"277'497","reported_seq":7756,"reported_epoch":303,"state":"active+clean","last_fresh":"2024-09-13T06:44:33.194019+0000","last_change":"2024-09-13T06:44:20.469801+0000","last_active":"2024-09-13T06:44:33.194019+0000","last_peered":"2024-09-13T06:44:33.194019+0000","last_clean":"2024-09-13T06:44:33.194019+0000","last_became_active":"2024-09-13T06:44:20.462185+0000","last_became_peered":"2024-09-13T06:44:20.462185+0000","last_unstale":"2024-09-13T06:44:33.194019+0000","last_undegraded":"2024-09-13T06:44:33.194019+0000","last_fullsized":"2024-09-13T06:44:33.194019+0000","mapping_epoch":290,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":291,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":497,"log_dups_size":0,"ondisk_log_size":497,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:55:41.801680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00078923399999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6439,"num_read_kb":42977,"num_write":667,"num_write_kb":32420,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":728,"num_bytes_recovered":12986751,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"275'680","reported_seq":8569,"reported_epoch":303,"state":"active+clean","last_fresh":"2024-09-13T06:44:33.193202+0000","last_change":"2024-09-13T06:44:21.446173+0000","last_active":"2024-09-13T06:44:33.193202+0000","last_peered":"2024-09-13T06:44:33.193202+0000","last_clean":"2024-09-13T06:44:33.193202+0000","last_became_active":"2024-09-13T06:44:21.442872+0000","last_became_peered":"2024-09-13T06:44:21.442872+0000","last_unstale":"2024-09-13T06:44:33.193202+0000","last_undegraded":"2024-09-13T06:44:33.193202+0000","last_fullsized":"2024-09-13T06:44:33.193202+0000","mapping_epoch":291,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":292,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":680,"log_dups_size":0,"ondisk_log_size":680,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:11:12.949824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00079955100000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8400,"num_read_kb":35906,"num_write":738,"num_write_kb":28560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":398,"num_bytes_recovered":17539742,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"272'684","reported_seq":7045,"reported_epoch":303,"state":"active+clean","last_fresh":"2024-09-13T06:44:32.807518+0000","last_change":"2024-09-13T06:44:05.439754+0000","last_active":"2024-09-13T06:44:32.807518+0000","last_peered":"2024-09-13T06:44:32.807518+0000","last_clean":"2024-09-13T06:44:32.807518+0000","last_became_active":"2024-09-13T06:41:14.395301+0000","last_became_peered":"2024-09-13T06:41:14.395301+0000","last_unstale":"2024-09-13T06:44:32.807518+0000","last_undegraded":"2024-09-13T06:44:32.807518+0000","last_fullsized":"2024-09-13T06:44:32.807518+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":684,"log_dups_size":0,"ondisk_log_size":684,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:10:49.528345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00092758900000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6571,"num_read_kb":55194,"num_write":838,"num_write_kb":38872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":117,"num_bytes_recovered":13142180,"num_keys_recovered":22,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"275'1525","reported_seq":5959,"reported_epoch":302,"state":"active+clean","last_fresh":"2024-09-13T06:44:31.794327+0000","last_change":"2024-09-13T06:44:05.444913+0000","last_active":"2024-09-13T06:44:31.794327+0000","last_peered":"2024-09-13T06:44:31.794327+0000","last_clean":"2024-09-13T06:44:31.794327+0000","last_became_active":"2024-09-13T06:43:22.521039+0000","last_became_peered":"2024-09-13T06:43:22.521039+0000","last_unstale":"2024-09-13T06:44:31.794327+0000","last_undegraded":"2024-09-13T06:44:31.794327+0000","last_fullsized":"2024-09-13T06:44:31.794327+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":1525,"log_dups_size":0,"ondisk_log_size":1525,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:58:28.305131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00029931499999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9655,"num_read_kb":41824,"num_write":2232,"num_write_kb":32733,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":112,"num_bytes_recovered":14950263,"num_keys_recovered":22,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"275'715","reported_seq":5275,"reported_epoch":302,"state":"active+clean","last_fresh":"2024-09-13T06:44:31.833554+0000","last_change":"2024-09-13T06:44:30.806149+0000","last_active":"2024-09-13T06:44:31.833554+0000","last_peered":"2024-09-13T06:44:31.833554+0000","last_clean":"2024-09-13T06:44:31.833554+0000","last_became_active":"2024-09-13T06:44:30.798028+0000","last_became_peered":"2024-09-13T06:44:30.798028+0000","last_unstale":"2024-09-13T06:44:31.833554+0000","last_undegraded":"2024-09-13T06:44:31.833554+0000","last_fullsized":"2024-09-13T06:44:31.833554+0000","mapping_epoch":300,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":301,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":715,"log_dups_size":0,"ondisk_log_size":715,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:09:18.289368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0024960030000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5101,"num_read_kb":28279,"num_write":1028,"num_write_kb":23183,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":197,"num_bytes_recovered":7394092,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"277'365","reported_seq":6172,"reported_epoch":302,"state":"active+clean","last_fresh":"2024-09-13T06:44:31.864740+0000","last_change":"2024-09-13T06:44:05.457231+0000","last_active":"2024-09-13T06:44:31.864740+0000","last_peered":"2024-09-13T06:44:31.864740+0000","last_clean":"2024-09-13T06:44:31.864740+0000","last_became_active":"2024-09-13T06:42:33.408009+0000","last_became_peered":"2024-09-13T06:42:33.408009+0000","last_unstale":"2024-09-13T06:44:31.864740+0000","last_undegraded":"2024-09-13T06:44:31.864740+0000","last_fullsized":"2024-09-13T06:44:31.864740+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":365,"log_dups_size":0,"ondisk_log_size":365,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:09:11.995853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0024654690000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5036,"num_read_kb":48021,"num_write":472,"num_write_kb":27276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":157,"num_bytes_recovered":13242563,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"280'579","reported_seq":9959,"reported_epoch":303,"state":"active+clean","last_fresh":"2024-09-13T06:44:33.194074+0000","last_change":"2024-09-13T06:44:05.443324+0000","last_active":"2024-09-13T06:44:33.194074+0000","last_peered":"2024-09-13T06:44:33.194074+0000","last_clean":"2024-09-13T06:44:33.194074+0000","last_became_active":"2024-09-13T06:44:03.438897+0000","last_became_peered":"2024-09-13T06:44:03.438897+0000","last_unstale":"2024-09-13T06:44:33.194074+0000","last_undegraded":"2024-09-13T06:44:33.194074+0000","last_fullsized":"2024-09-13T06:44:33.194074+0000","mapping_epoch":277,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":278,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":579,"log_dups_size":0,"ondisk_log_size":579,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:24:55.053861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012901029999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8875,"num_read_kb":61758,"num_write":769,"num_write_kb":30278,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":506,"num_bytes_recovered":26184965,"num_keys_recovered":33,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":26,"reported_epoch":303,"state":"active+clean","last_fresh":"2024-09-13T06:44:33.194881+0000","last_change":"2024-09-13T06:44:16.450557+0000","last_active":"2024-09-13T06:44:33.194881+0000","last_peered":"2024-09-13T06:44:33.194881+0000","last_clean":"2024-09-13T06:44:33.194881+0000","last_became_active":"2024-09-13T06:44:16.449558+0000","last_became_peered":"2024-09-13T06:44:16.449558+0000","last_unstale":"2024-09-13T06:44:33.194881+0000","last_undegraded":"2024-09-13T06:44:33.194881+0000","last_fullsized":"2024-09-13T06:44:33.194881+0000","mapping_epoch":286,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":287,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_clean_scrub_stamp":"2024-09-13T06:39:16.508974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:01:20.779972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00080324699999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"280'643","reported_seq":10759,"reported_epoch":302,"state":"active+clean","last_fresh":"2024-09-13T06:44:31.794269+0000","last_change":"2024-09-13T06:44:22.454207+0000","last_active":"2024-09-13T06:44:31.794269+0000","last_peered":"2024-09-13T06:44:31.794269+0000","last_clean":"2024-09-13T06:44:31.794269+0000","last_became_active":"2024-09-13T06:44:22.449195+0000","last_became_peered":"2024-09-13T06:44:22.449195+0000","last_unstale":"2024-09-13T06:44:31.794269+0000","last_undegraded":"2024-09-13T06:44:31.794269+0000","last_fullsized":"2024-09-13T06:44:31.794269+0000","mapping_epoch":292,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":293,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":643,"log_dups_size":0,"ondisk_log_size":643,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:28:58.479641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00080400600000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9397,"num_read_kb":51433,"num_write":883,"num_write_kb":40908,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":358,"num_bytes_recovered":1257624,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":23,"reported_epoch":303,"state":"active+clean","last_fresh":"2024-09-13T06:44:33.193409+0000","last_change":"2024-09-13T06:44:18.458951+0000","last_active":"2024-09-13T06:44:33.193409+0000","last_peered":"2024-09-13T06:44:33.193409+0000","last_clean":"2024-09-13T06:44:33.193409+0000","last_became_active":"2024-09-13T06:44:18.458454+0000","last_became_peered":"2024-09-13T06:44:18.458454+0000","last_unstale":"2024-09-13T06:44:33.193409+0000","last_undegraded":"2024-09-13T06:44:33.193409+0000","last_fullsized":"2024-09-13T06:44:33.193409+0000","mapping_epoch":288,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":289,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_clean_scrub_stamp":"2024-09-13T06:39:16.508974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:06:07.380573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00097079800000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"277'694","reported_seq":7059,"reported_epoch":303,"state":"active+clean","last_fresh":"2024-09-13T06:44:32.807955+0000","last_change":"2024-09-13T06:44:05.440674+0000","last_active":"2024-09-13T06:44:32.807955+0000","last_peered":"2024-09-13T06:44:32.807955+0000","last_clean":"2024-09-13T06:44:32.807955+0000","last_became_active":"2024-09-13T06:42:32.413006+0000","last_became_peered":"2024-09-13T06:42:32.413006+0000","last_unstale":"2024-09-13T06:44:32.807955+0000","last_undegraded":"2024-09-13T06:44:32.807955+0000","last_fullsized":"2024-09-13T06:44:32.807955+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":694,"log_dups_size":0,"ondisk_log_size":694,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:38:01.774494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001338379,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6521,"num_read_kb":33119,"num_write":812,"num_write_kb":30039,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":213,"num_bytes_recovered":15100645,"num_keys_recovered":11,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":179,"reported_epoch":302,"state":"active+clean","last_fresh":"2024-09-13T06:44:31.864791+0000","last_change":"2024-09-13T06:42:28.563276+0000","last_active":"2024-09-13T06:44:31.864791+0000","last_peered":"2024-09-13T06:44:31.864791+0000","last_clean":"2024-09-13T06:44:31.864791+0000","last_became_active":"2024-09-13T06:42:28.562827+0000","last_became_peered":"2024-09-13T06:42:28.562827+0000","last_unstale":"2024-09-13T06:44:31.864791+0000","last_undegraded":"2024-09-13T06:44:31.864791+0000","last_fullsized":"2024-09-13T06:44:31.864791+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_clean_scrub_stamp":"2024-09-13T06:39:16.508974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:10:47.285603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"277'961","reported_seq":6890,"reported_epoch":303,"state":"active+clean","last_fresh":"2024-09-13T06:44:33.193159+0000","last_change":"2024-09-13T06:44:22.455582+0000","last_active":"2024-09-13T06:44:33.193159+0000","last_peered":"2024-09-13T06:44:33.193159+0000","last_clean":"2024-09-13T06:44:33.193159+0000","last_became_active":"2024-09-13T06:44:22.450933+0000","last_became_peered":"2024-09-13T06:44:22.450933+0000","last_unstale":"2024-09-13T06:44:33.193159+0000","last_undegraded":"2024-09-13T06:44:33.193159+0000","last_fullsized":"2024-09-13T06:44:33.193159+0000","mapping_epoch":292,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":293,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":961,"log_dups_size":0,"ondisk_log_size":961,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:30:26.327840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0031147280000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7705,"num_read_kb":38648,"num_write":1332,"num_write_kb":32653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":354,"num_bytes_recovered":6765835,"num_keys_recovered":11,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":23,"reported_epoch":303,"state":"active+clean","last_fresh":"2024-09-13T06:44:33.193244+0000","last_change":"2024-09-13T06:44:18.468145+0000","last_active":"2024-09-13T06:44:33.193244+0000","last_peered":"2024-09-13T06:44:33.193244+0000","last_clean":"2024-09-13T06:44:33.193244+0000","last_became_active":"2024-09-13T06:44:18.467833+0000","last_became_peered":"2024-09-13T06:44:18.467833+0000","last_unstale":"2024-09-13T06:44:33.193244+0000","last_undegraded":"2024-09-13T06:44:33.193244+0000","last_fullsized":"2024-09-13T06:44:33.193244+0000","mapping_epoch":288,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":289,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_clean_scrub_stamp":"2024-09-13T06:39:16.508974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:33:56.156376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"277'640","reported_seq":7754,"reported_epoch":302,"state":"active+clean","last_fresh":"2024-09-13T06:44:31.833497+0000","last_change":"2024-09-13T06:44:30.803125+0000","last_active":"2024-09-13T06:44:31.833497+0000","last_peered":"2024-09-13T06:44:31.833497+0000","last_clean":"2024-09-13T06:44:31.833497+0000","last_became_active":"2024-09-13T06:44:30.797769+0000","last_became_peered":"2024-09-13T06:44:30.797769+0000","last_unstale":"2024-09-13T06:44:31.833497+0000","last_undegraded":"2024-09-13T06:44:31.833497+0000","last_fullsized":"2024-09-13T06:44:31.833497+0000","mapping_epoch":300,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":301,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":640,"log_dups_size":0,"ondisk_log_size":640,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:49:47.340041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0046689339999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7611,"num_read_kb":41345,"num_write":1018,"num_write_kb":26620,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":158,"num_bytes_recovered":4212424,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"280'991","reported_seq":21073,"reported_epoch":303,"state":"active+clean","last_fresh":"2024-09-13T06:44:33.193970+0000","last_change":"2024-09-13T06:44:28.773729+0000","last_active":"2024-09-13T06:44:33.193970+0000","last_peered":"2024-09-13T06:44:33.193970+0000","last_clean":"2024-09-13T06:44:33.193970+0000","last_became_active":"2024-09-13T06:44:28.768976+0000","last_became_peered":"2024-09-13T06:44:28.768976+0000","last_unstale":"2024-09-13T06:44:33.193970+0000","last_undegraded":"2024-09-13T06:44:33.193970+0000","last_fullsized":"2024-09-13T06:44:33.193970+0000","mapping_epoch":298,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":299,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":991,"log_dups_size":0,"ondisk_log_size":991,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:30:21.817297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0017436419999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20994,"num_read_kb":92583,"num_write":1315,"num_write_kb":30385,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":207,"num_bytes_recovered":9898606,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"20'2","reported_seq":124,"reported_epoch":302,"state":"active+clean","last_fresh":"2024-09-13T06:44:31.833267+0000","last_change":"2024-09-13T06:44:30.794941+0000","last_active":"2024-09-13T06:44:31.833267+0000","last_peered":"2024-09-13T06:44:31.833267+0000","last_clean":"2024-09-13T06:44:31.833267+0000","last_became_active":"2024-09-13T06:44:30.794134+0000","last_became_peered":"2024-09-13T06:44:30.794134+0000","last_unstale":"2024-09-13T06:44:31.833267+0000","last_undegraded":"2024-09-13T06:44:31.833267+0000","last_fullsized":"2024-09-13T06:44:31.833267+0000","mapping_epoch":300,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":301,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_clean_scrub_stamp":"2024-09-13T06:39:16.508974+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:36:10.351897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":57,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"278'857","reported_seq":10771,"reported_epoch":303,"state":"active+clean","last_fresh":"2024-09-13T06:44:33.193137+0000","last_change":"2024-09-13T06:44:21.445836+0000","last_active":"2024-09-13T06:44:33.193137+0000","last_peered":"2024-09-13T06:44:33.193137+0000","last_clean":"2024-09-13T06:44:33.193137+0000","last_became_active":"2024-09-13T06:44:21.442847+0000","last_became_peered":"2024-09-13T06:44:21.442847+0000","last_unstale":"2024-09-13T06:44:33.193137+0000","last_undegraded":"2024-09-13T06:44:33.193137+0000","last_fullsized":"2024-09-13T06:44:33.193137+0000","mapping_epoch":291,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":292,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":857,"log_dups_size":0,"ondisk_log_size":857,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:42:10.542267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00053211199999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11278,"num_read_kb":63107,"num_write":1190,"num_write_kb":36968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":351,"num_bytes_recovered":9847094,"num_keys_recovered":11,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":25,"reported_epoch":303,"state":"active+clean","last_fresh":"2024-09-13T06:44:33.193124+0000","last_change":"2024-09-13T06:44:17.443833+0000","last_active":"2024-09-13T06:44:33.193124+0000","last_peered":"2024-09-13T06:44:33.193124+0000","last_clean":"2024-09-13T06:44:33.193124+0000","last_became_active":"2024-09-13T06:44:17.443358+0000","last_became_peered":"2024-09-13T06:44:17.443358+0000","last_unstale":"2024-09-13T06:44:33.193124+0000","last_undegraded":"2024-09-13T06:44:33.193124+0000","last_fullsized":"2024-09-13T06:44:33.193124+0000","mapping_epoch":287,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":288,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_clean_scrub_stamp":"2024-09-13T06:39:16.508974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:30:37.013428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00033592499999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"277'1115","reported_seq":6257,"reported_epoch":302,"state":"active+clean","last_fresh":"2024-09-13T06:44:31.793979+0000","last_change":"2024-09-13T06:44:30.799789+0000","last_active":"2024-09-13T06:44:31.793979+0000","last_peered":"2024-09-13T06:44:31.793979+0000","last_clean":"2024-09-13T06:44:31.793979+0000","last_became_active":"2024-09-13T06:44:30.798508+0000","last_became_peered":"2024-09-13T06:44:30.798508+0000","last_unstale":"2024-09-13T06:44:31.793979+0000","last_undegraded":"2024-09-13T06:44:31.793979+0000","last_fullsized":"2024-09-13T06:44:31.793979+0000","mapping_epoch":300,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":301,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":1115,"log_dups_size":0,"ondisk_log_size":1115,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:04:47.174299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0032283849999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7964,"num_read_kb":36198,"num_write":1645,"num_write_kb":33105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":243,"num_bytes_recovered":7863454,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":196,"reported_epoch":302,"state":"active+clean","last_fresh":"2024-09-13T06:44:31.864279+0000","last_change":"2024-09-13T06:44:18.457601+0000","last_active":"2024-09-13T06:44:31.864279+0000","last_peered":"2024-09-13T06:44:31.864279+0000","last_clean":"2024-09-13T06:44:31.864279+0000","last_became_active":"2024-09-13T06:44:18.456828+0000","last_became_peered":"2024-09-13T06:44:18.456828+0000","last_unstale":"2024-09-13T06:44:31.864279+0000","last_undegraded":"2024-09-13T06:44:31.864279+0000","last_fullsized":"2024-09-13T06:44:31.864279+0000","mapping_epoch":288,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":289,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_clean_scrub_stamp":"2024-09-13T06:39:16.508974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:17:09.082426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"279'349","reported_seq":3762,"reported_epoch":303,"state":"active+clean","last_fresh":"2024-09-13T06:44:32.807410+0000","last_change":"2024-09-13T06:44:05.440371+0000","last_active":"2024-09-13T06:44:32.807410+0000","last_peered":"2024-09-13T06:44:32.807410+0000","last_clean":"2024-09-13T06:44:32.807410+0000","last_became_active":"2024-09-13T06:41:15.399301+0000","last_became_peered":"2024-09-13T06:41:15.399301+0000","last_unstale":"2024-09-13T06:44:32.807410+0000","last_undegraded":"2024-09-13T06:44:32.807410+0000","last_fullsized":"2024-09-13T06:44:32.807410+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":349,"log_dups_size":0,"ondisk_log_size":349,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:53:18.137873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001343293,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2523,"num_read_kb":19829,"num_write":427,"num_write_kb":20943,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":169,"num_bytes_recovered":5233325,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"18'1","reported_seq":55,"reported_epoch":302,"state":"active+clean","last_fresh":"2024-09-13T06:44:31.833265+0000","last_change":"2024-09-13T06:44:30.798045+0000","last_active":"2024-09-13T06:44:31.833265+0000","last_peered":"2024-09-13T06:44:31.833265+0000","last_clean":"2024-09-13T06:44:31.833265+0000","last_became_active":"2024-09-13T06:44:30.796877+0000","last_became_peered":"2024-09-13T06:44:30.796877+0000","last_unstale":"2024-09-13T06:44:31.833265+0000","last_undegraded":"2024-09-13T06:44:31.833265+0000","last_fullsized":"2024-09-13T06:44:31.833265+0000","mapping_epoch":300,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":301,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_clean_scrub_stamp":"2024-09-13T06:39:16.508974+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:33:04.298167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":396,"reported_epoch":302,"state":"active+clean","last_fresh":"2024-09-13T06:44:31.864055+0000","last_change":"2024-09-13T06:42:28.563168+0000","last_active":"2024-09-13T06:44:31.864055+0000","last_peered":"2024-09-13T06:44:31.864055+0000","last_clean":"2024-09-13T06:44:31.864055+0000","last_became_active":"2024-09-13T06:42:28.562642+0000","last_became_peered":"2024-09-13T06:42:28.562642+0000","last_unstale":"2024-09-13T06:44:31.864055+0000","last_undegraded":"2024-09-13T06:44:31.864055+0000","last_fullsized":"2024-09-13T06:44:31.864055+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:10.110558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:10.110558+0000","last_clean_scrub_stamp":"2024-09-13T06:39:10.110558+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:05:54.866043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"277'651","reported_seq":10850,"reported_epoch":303,"state":"active+clean","last_fresh":"2024-09-13T06:44:32.807285+0000","last_change":"2024-09-13T06:44:22.452634+0000","last_active":"2024-09-13T06:44:32.807285+0000","last_peered":"2024-09-13T06:44:32.807285+0000","last_clean":"2024-09-13T06:44:32.807285+0000","last_became_active":"2024-09-13T06:44:22.448736+0000","last_became_peered":"2024-09-13T06:44:22.448736+0000","last_unstale":"2024-09-13T06:44:32.807285+0000","last_undegraded":"2024-09-13T06:44:32.807285+0000","last_fullsized":"2024-09-13T06:44:32.807285+0000","mapping_epoch":292,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":293,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":651,"log_dups_size":0,"ondisk_log_size":651,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:58:40.103969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00083432600000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9552,"num_read_kb":46146,"num_write":828,"num_write_kb":32512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":446,"num_bytes_recovered":11977587,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"277'774","reported_seq":10943,"reported_epoch":303,"state":"active+clean","last_fresh":"2024-09-13T06:44:33.192916+0000","last_change":"2024-09-13T06:44:20.466493+0000","last_active":"2024-09-13T06:44:33.192916+0000","last_peered":"2024-09-13T06:44:33.192916+0000","last_clean":"2024-09-13T06:44:33.192916+0000","last_became_active":"2024-09-13T06:44:20.462849+0000","last_became_peered":"2024-09-13T06:44:20.462849+0000","last_unstale":"2024-09-13T06:44:33.192916+0000","last_undegraded":"2024-09-13T06:44:33.192916+0000","last_fullsized":"2024-09-13T06:44:33.192916+0000","mapping_epoch":290,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":291,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":774,"log_dups_size":0,"ondisk_log_size":774,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:40:44.119462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0024338839999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10729,"num_read_kb":51645,"num_write":931,"num_write_kb":34617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":445,"num_bytes_recovered":16579571,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"278'758","reported_seq":8274,"reported_epoch":304,"state":"peering","last_fresh":"2024-09-13T06:44:33.832643+0000","last_change":"2024-09-13T06:44:33.832643+0000","last_active":"2024-09-13T06:44:15.688154+0000","last_peered":"2024-09-13T06:44:14.671646+0000","last_clean":"2024-09-13T06:44:14.671646+0000","last_became_active":"2024-09-13T06:43:37.418917+0000","last_became_peered":"2024-09-13T06:43:37.418917+0000","last_unstale":"2024-09-13T06:44:33.832643+0000","last_undegraded":"2024-09-13T06:44:33.832643+0000","last_fullsized":"2024-09-13T06:44:33.832643+0000","mapping_epoch":304,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":290,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":758,"log_dups_size":0,"ondisk_log_size":758,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:44:55.089545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00085210600000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8422,"num_read_kb":47219,"num_write":883,"num_write_kb":28077,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":515,"num_bytes_recovered":28581300,"num_keys_recovered":111,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"271'845","reported_seq":5601,"reported_epoch":303,"state":"active+clean","last_fresh":"2024-09-13T06:44:32.807674+0000","last_change":"2024-09-13T06:44:05.439827+0000","last_active":"2024-09-13T06:44:32.807674+0000","last_peered":"2024-09-13T06:44:32.807674+0000","last_clean":"2024-09-13T06:44:32.807674+0000","last_became_active":"2024-09-13T06:41:15.399204+0000","last_became_peered":"2024-09-13T06:41:15.399204+0000","last_unstale":"2024-09-13T06:44:32.807674+0000","last_undegraded":"2024-09-13T06:44:32.807674+0000","last_fullsized":"2024-09-13T06:44:32.807674+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":845,"log_dups_size":0,"ondisk_log_size":845,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:27:03.298272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00094468700000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6686,"num_read_kb":57840,"num_write":1181,"num_write_kb":24665,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":117,"num_bytes_recovered":13256568,"num_keys_recovered":44,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"279'569","reported_seq":6602,"reported_epoch":302,"state":"active+clean","last_fresh":"2024-09-13T06:44:31.833489+0000","last_change":"2024-09-13T06:44:30.802655+0000","last_active":"2024-09-13T06:44:31.833489+0000","last_peered":"2024-09-13T06:44:31.833489+0000","last_clean":"2024-09-13T06:44:31.833489+0000","last_became_active":"2024-09-13T06:44:30.794873+0000","last_became_peered":"2024-09-13T06:44:30.794873+0000","last_unstale":"2024-09-13T06:44:31.833489+0000","last_undegraded":"2024-09-13T06:44:31.833489+0000","last_fullsized":"2024-09-13T06:44:31.833489+0000","mapping_epoch":300,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":301,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":569,"log_dups_size":0,"ondisk_log_size":569,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:26:59.771063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0027493119999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6187,"num_read_kb":31727,"num_write":657,"num_write_kb":25682,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":184,"num_bytes_recovered":16410936,"num_keys_recovered":88,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"277'881","reported_seq":2922,"reported_epoch":302,"state":"active+clean","last_fresh":"2024-09-13T06:44:31.864902+0000","last_change":"2024-09-13T06:44:05.458093+0000","last_active":"2024-09-13T06:44:31.864902+0000","last_peered":"2024-09-13T06:44:31.864902+0000","last_clean":"2024-09-13T06:44:31.864902+0000","last_became_active":"2024-09-13T06:42:32.411927+0000","last_became_peered":"2024-09-13T06:42:32.411927+0000","last_unstale":"2024-09-13T06:44:31.864902+0000","last_undegraded":"2024-09-13T06:44:31.864902+0000","last_fullsized":"2024-09-13T06:44:31.864902+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":881,"log_dups_size":0,"ondisk_log_size":881,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:40:44.787780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.003013108,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4846,"num_read_kb":26164,"num_write":1518,"num_write_kb":30083,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":140,"num_bytes_recovered":11278110,"num_keys_recovered":11,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.e","version":"277'556","reported_seq":4101,"reported_epoch":302,"state":"active+clean","last_fresh":"2024-09-13T06:44:31.864598+0000","last_change":"2024-09-13T06:44:30.808041+0000","last_active":"2024-09-13T06:44:31.864598+0000","last_peered":"2024-09-13T06:44:31.864598+0000","last_clean":"2024-09-13T06:44:31.864598+0000","last_became_active":"2024-09-13T06:44:30.801655+0000","last_became_peered":"2024-09-13T06:44:30.801655+0000","last_unstale":"2024-09-13T06:44:31.864598+0000","last_undegraded":"2024-09-13T06:44:31.864598+0000","last_fullsized":"2024-09-13T06:44:31.864598+0000","mapping_epoch":300,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":301,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":556,"log_dups_size":0,"ondisk_log_size":556,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:43:53.489080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0025767619999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3868,"num_read_kb":43567,"num_write":654,"num_write_kb":29232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":503,"num_bytes_recovered":12695191,"num_keys_recovered":11,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"277'665","reported_seq":4753,"reported_epoch":302,"state":"active+clean","last_fresh":"2024-09-13T06:44:31.864487+0000","last_change":"2024-09-13T06:44:05.458214+0000","last_active":"2024-09-13T06:44:31.864487+0000","last_peered":"2024-09-13T06:44:31.864487+0000","last_clean":"2024-09-13T06:44:31.864487+0000","last_became_active":"2024-09-13T06:42:33.412054+0000","last_became_peered":"2024-09-13T06:42:33.412054+0000","last_unstale":"2024-09-13T06:44:31.864487+0000","last_undegraded":"2024-09-13T06:44:31.864487+0000","last_fullsized":"2024-09-13T06:44:31.864487+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":665,"log_dups_size":0,"ondisk_log_size":665,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:07:06.963404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00285659,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4677,"num_read_kb":45287,"num_write":982,"num_write_kb":45285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":394,"num_bytes_recovered":42768786,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.10","version":"280'832","reported_seq":5034,"reported_epoch":303,"state":"active+clean","last_fresh":"2024-09-13T06:44:33.194832+0000","last_change":"2024-09-13T06:44:19.467239+0000","last_active":"2024-09-13T06:44:33.194832+0000","last_peered":"2024-09-13T06:44:33.194832+0000","last_clean":"2024-09-13T06:44:33.194832+0000","last_became_active":"2024-09-13T06:44:19.459617+0000","last_became_peered":"2024-09-13T06:44:19.459617+0000","last_unstale":"2024-09-13T06:44:33.194832+0000","last_undegraded":"2024-09-13T06:44:33.194832+0000","last_fullsized":"2024-09-13T06:44:33.194832+0000","mapping_epoch":289,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":290,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":832,"log_dups_size":0,"ondisk_log_size":832,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:43:55.736868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0018779840000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5715,"num_read_kb":29614,"num_write":1142,"num_write_kb":36190,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":275,"num_bytes_recovered":6622441,"num_keys_recovered":20,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.11","version":"279'502","reported_seq":6278,"reported_epoch":302,"state":"active+clean","last_fresh":"2024-09-13T06:44:31.864123+0000","last_change":"2024-09-13T06:44:05.455675+0000","last_active":"2024-09-13T06:44:31.864123+0000","last_peered":"2024-09-13T06:44:31.864123+0000","last_clean":"2024-09-13T06:44:31.864123+0000","last_became_active":"2024-09-13T06:42:33.411668+0000","last_became_peered":"2024-09-13T06:42:33.411668+0000","last_unstale":"2024-09-13T06:44:31.864123+0000","last_undegraded":"2024-09-13T06:44:31.864123+0000","last_fullsized":"2024-09-13T06:44:31.864123+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":502,"log_dups_size":0,"ondisk_log_size":502,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:43:01.814094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001270492,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5341,"num_read_kb":34087,"num_write":659,"num_write_kb":25712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":245,"num_bytes_recovered":7089272,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"280'921","reported_seq":5046,"reported_epoch":302,"state":"active+clean","last_fresh":"2024-09-13T06:44:31.794105+0000","last_change":"2024-09-13T06:44:20.470378+0000","last_active":"2024-09-13T06:44:31.794105+0000","last_peered":"2024-09-13T06:44:31.794105+0000","last_clean":"2024-09-13T06:44:31.794105+0000","last_became_active":"2024-09-13T06:44:20.466713+0000","last_became_peered":"2024-09-13T06:44:20.466713+0000","last_unstale":"2024-09-13T06:44:31.794105+0000","last_undegraded":"2024-09-13T06:44:31.794105+0000","last_fullsized":"2024-09-13T06:44:31.794105+0000","mapping_epoch":290,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":291,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":921,"log_dups_size":0,"ondisk_log_size":921,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:00:14.406068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0017683250000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6025,"num_read_kb":38947,"num_write":1315,"num_write_kb":35656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":107,"num_bytes_recovered":3682200,"num_keys_recovered":21,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"279'604","reported_seq":4545,"reported_epoch":302,"state":"active+clean","last_fresh":"2024-09-13T06:44:31.864508+0000","last_change":"2024-09-13T06:44:05.454984+0000","last_active":"2024-09-13T06:44:31.864508+0000","last_peered":"2024-09-13T06:44:31.864508+0000","last_clean":"2024-09-13T06:44:31.864508+0000","last_became_active":"2024-09-13T06:42:31.402800+0000","last_became_peered":"2024-09-13T06:42:31.402800+0000","last_unstale":"2024-09-13T06:44:31.864508+0000","last_undegraded":"2024-09-13T06:44:31.864508+0000","last_fullsized":"2024-09-13T06:44:31.864508+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":604,"log_dups_size":0,"ondisk_log_size":604,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:59:41.167052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010470779999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4471,"num_read_kb":35894,"num_write":884,"num_write_kb":31515,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":196,"num_bytes_recovered":8224568,"num_keys_recovered":11,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":19,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":237282,"num_read_kb":1402862,"num_write":33322,"num_write_kb":1008910,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9249,"num_bytes_recovered":443628516,"num_keys_recovered":867,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14648,"internal_metadata":0},"log_size":24486,"ondisk_log_size":24486,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":57,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":3}],"osd_stats":[{"osd":7,"up_from":187,"seq":803158884379,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37024,"kb_used_data":4172,"kb_used_omap":9,"kb_used_meta":32822,"kb_avail":94334816,"statfs":{"total":96636764160,"available":96598851584,"internally_reserved":0,"allocated":4272128,"data_stored":2435239,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9685,"internal_metadata":33610283},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 06:44:33 2024","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":0.71199999999999997,"15min":0.69799999999999995},"min":{"1min":0.56699999999999995,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.871},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.751,"15min":0.73999999999999999},"min":{"1min":0.54600000000000004,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.6910000000000001,"5min":1.6910000000000001,"15min":1.6910000000000001},"last":0.55100000000000005}]},{"osd":1,"last update":"Fri Sep 13 06:44:33 2024","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.75700000000000001,"15min":0.751},"min":{"1min":0.57399999999999995,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.359,"5min":1.359,"15min":1.359},"last":0.91300000000000003},{"interface":"front","average":{"1min":0.82399999999999995,"5min":0.71599999999999997,"15min":0.69799999999999995},"min":{"1min":0.496,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.1259999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":1.079}]},{"osd":2,"last update":"Fri Sep 13 06:44:33 2024","interfaces":[{"interface":"back","average":{"1min":0.80700000000000005,"5min":0.75900000000000001,"15min":0.751},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.2030000000000001,"5min":1.212,"15min":1.212},"last":1.1259999999999999},{"interface":"front","average":{"1min":0.92200000000000004,"5min":0.81499999999999995,"15min":0.79700000000000004},"min":{"1min":0.58999999999999997,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.4319999999999999,"5min":1.4319999999999999,"15min":1.4319999999999999},"last":1.022}]},{"osd":3,"last update":"Fri Sep 13 06:44:33 2024","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.79600000000000004,"15min":0.79200000000000004},"min":{"1min":0.60299999999999998,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.177,"5min":1.177,"15min":1.177},"last":1.177},{"interface":"front","average":{"1min":0.88600000000000001,"5min":0.84299999999999997,"15min":0.83599999999999997},"min":{"1min":0.48099999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.7350000000000001,"5min":1.7350000000000001,"15min":1.7350000000000001},"last":0.97499999999999998}]},{"osd":4,"last update":"Fri Sep 13 06:44:33 2024","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.82299999999999995,"15min":0.82499999999999996},"min":{"1min":0.45500000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.405,"5min":1.405,"15min":1.405},"last":0.69399999999999995},{"interface":"front","average":{"1min":1.0049999999999999,"5min":0.82299999999999995,"15min":0.79300000000000004},"min":{"1min":0.39800000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.6240000000000001,"5min":1.6240000000000001,"15min":1.6240000000000001},"last":1.2170000000000001}]},{"osd":5,"last update":"Fri Sep 13 06:44:33 2024","interfaces":[{"interface":"back","average":{"1min":0.96599999999999997,"5min":0.88800000000000001,"15min":0.875},"min":{"1min":0.504,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.593,"5min":1.593,"15min":1.593},"last":0.83099999999999996},{"interface":"front","average":{"1min":0.92300000000000004,"5min":0.84099999999999997,"15min":0.82699999999999996},"min":{"1min":0.53800000000000003,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.3400000000000001,"5min":1.3400000000000001,"15min":1.3400000000000001},"last":1.3400000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.25}]}]},{"osd":6,"up_from":286,"seq":1228360646661,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35500,"kb_used_data":3608,"kb_used_omap":7,"kb_used_meta":31864,"kb_avail":94336340,"statfs":{"total":96636764160,"available":96600412160,"internally_reserved":0,"allocated":3694592,"data_stored":1851285,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8145,"internal_metadata":32628783},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89900000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.256}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2310000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84599999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.751}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97699999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.026}]}]},{"osd":5,"up_from":13,"seq":55834574917,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":79004,"kb_used_data":3596,"kb_used_omap":1,"kb_used_meta":75390,"kb_avail":94292836,"statfs":{"total":96636764160,"available":96555864064,"internally_reserved":0,"allocated":3682304,"data_stored":1844890,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":77199814},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 06:44:19 2024","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.71399999999999997,"15min":0.76500000000000001},"min":{"1min":0.40999999999999998,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":1.093,"5min":1.6679999999999999,"15min":1.6679999999999999},"last":0.94599999999999995},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.76900000000000002,"15min":0.79900000000000004},"min":{"1min":0.41299999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.1220000000000001,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":0.98799999999999999}]},{"osd":1,"last update":"Fri Sep 13 06:44:19 2024","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.73999999999999999,"15min":0.751},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":1.103,"5min":1.341,"15min":1.341},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.70099999999999996,"15min":0.74099999999999999},"min":{"1min":0.40899999999999997,"5min":0.317,"15min":0.317},"max":{"1min":1.0089999999999999,"5min":1.722,"15min":1.722},"last":0.63800000000000001}]},{"osd":2,"last update":"Fri Sep 13 06:44:19 2024","interfaces":[{"interface":"back","average":{"1min":0.876,"5min":0.81999999999999995,"15min":0.86399999999999999},"min":{"1min":0.47699999999999998,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.143,"5min":1.833,"15min":1.833},"last":0.91000000000000003},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.79200000000000004},"min":{"1min":0.47999999999999998,"5min":0.435,"15min":0.435},"max":{"1min":1.0169999999999999,"5min":1.4279999999999999,"15min":1.4279999999999999},"last":1.1459999999999999}]},{"osd":3,"last update":"Fri Sep 13 06:44:19 2024","interfaces":[{"interface":"back","average":{"1min":0.85699999999999998,"5min":0.81399999999999995,"15min":0.78000000000000003},"min":{"1min":0.45400000000000001,"5min":0.434,"15min":0.434},"max":{"1min":1.1659999999999999,"5min":1.885,"15min":1.885},"last":0.82399999999999995},{"interface":"front","average":{"1min":0.85899999999999999,"5min":0.86299999999999999,"15min":0.86499999999999999},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.2410000000000001,"5min":1.907,"15min":1.907},"last":1.099}]},{"osd":4,"last update":"Fri Sep 13 06:44:19 2024","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.83499999999999996,"15min":0.80500000000000005},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":1.159,"5min":6.3179999999999996,"15min":6.3179999999999996},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.78000000000000003,"5min":1.0529999999999999,"15min":0.91000000000000003},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":1.2370000000000001,"5min":15.553000000000001,"15min":15.553000000000001},"last":0.85599999999999998}]},{"osd":6,"last update":"Fri Sep 13 06:42:12 2024","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.86299999999999999,"15min":0.877},"min":{"1min":0.40000000000000002,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.9610000000000001,"5min":1.9610000000000001,"15min":1.9610000000000001},"last":1.04},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.86099999999999999,"15min":0.87},"min":{"1min":0.39000000000000001,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.206,"5min":1.968,"15min":1.968},"last":1.1890000000000001}]},{"osd":7,"last update":"Fri Sep 13 06:44:31 2024","interfaces":[{"interface":"back","average":{"1min":0.96399999999999997,"5min":0.84399999999999997,"15min":0.82399999999999995},"min":{"1min":0.39000000000000001,"5min":0.373,"15min":0.373},"max":{"1min":1.2050000000000001,"5min":1.375,"15min":1.375},"last":1.0700000000000001},{"interface":"front","average":{"1min":0.997,"5min":0.89800000000000002,"15min":0.88200000000000001},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":1.7050000000000001,"5min":1.7050000000000001,"15min":1.7050000000000001},"last":1.2909999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574917,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60968,"kb_used_data":3612,"kb_used_omap":1,"kb_used_meta":57342,"kb_avail":94310872,"statfs":{"total":96636764160,"available":96574332928,"internally_reserved":0,"allocated":3698688,"data_stored":1851304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":58718662},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 06:44:15 2024","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.79300000000000004,"15min":0.98999999999999999},"min":{"1min":0.41499999999999998,"5min":0.245,"15min":0.245},"max":{"1min":1.0720000000000001,"5min":5.8230000000000004,"15min":5.8230000000000004},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.71999999999999997,"15min":0.752},"min":{"1min":0.505,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.97299999999999998,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":1.018}]},{"osd":1,"last update":"Fri Sep 13 06:44:15 2024","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.79300000000000004,"15min":0.75},"min":{"1min":0.45100000000000001,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.86899999999999999,"5min":10.156000000000001,"15min":10.156000000000001},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.747,"5min":0.77500000000000002,"15min":0.83599999999999997},"min":{"1min":0.496,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.0349999999999999,"5min":1.286,"15min":1.286},"last":0.93100000000000005}]},{"osd":2,"last update":"Fri Sep 13 06:44:15 2024","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.751,"15min":0.82299999999999995},"min":{"1min":0.52800000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":1.0109999999999999,"5min":1.6000000000000001,"15min":1.6000000000000001},"last":1.0409999999999999},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.81299999999999994},"min":{"1min":0.65500000000000003,"5min":0.374,"15min":0.374},"max":{"1min":1.167,"5min":1.3540000000000001,"15min":1.3540000000000001},"last":0.79100000000000004}]},{"osd":3,"last update":"Fri Sep 13 06:44:15 2024","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.84699999999999998,"15min":0.90200000000000002},"min":{"1min":0.57499999999999996,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.6950000000000001,"5min":1.6950000000000001,"15min":1.6950000000000001},"last":1.101},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.95299999999999996,"15min":0.92500000000000004},"min":{"1min":0.48499999999999999,"5min":0.374,"15min":0.374},"max":{"1min":1.8069999999999999,"5min":10.195,"15min":10.195},"last":0.98999999999999999}]},{"osd":5,"last update":"Fri Sep 13 06:44:15 2024","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.81499999999999995,"15min":0.85699999999999998},"min":{"1min":0.443,"5min":0.249,"15min":0.249},"max":{"1min":1.075,"5min":2.9790000000000001,"15min":2.9790000000000001},"last":0.85199999999999998},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.84399999999999997,"15min":0.91400000000000003},"min":{"1min":0.39700000000000002,"5min":0.372,"15min":0.372},"max":{"1min":1.0580000000000001,"5min":1.8779999999999999,"15min":1.8779999999999999},"last":0.872}]},{"osd":6,"last update":"Fri Sep 13 06:42:14 2024","interfaces":[{"interface":"back","average":{"1min":0.90100000000000002,"5min":0.92100000000000004,"15min":0.82899999999999996},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":1.6100000000000001,"5min":10.016999999999999,"15min":10.016999999999999},"last":0.96699999999999997},{"interface":"front","average":{"1min":0.86699999999999999,"5min":0.93300000000000005,"15min":0.95999999999999996},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.2030000000000001,"5min":2.0750000000000002,"15min":2.0750000000000002},"last":0.82399999999999995}]},{"osd":7,"last update":"Fri Sep 13 06:44:33 2024","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.1539999999999999,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.90500000000000003},{"interface":"front","average":{"1min":0.90400000000000003,"5min":0.89200000000000002,"15min":0.89000000000000001},"min":{"1min":0.505,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.2529999999999999,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":1.073}]}]},{"osd":3,"up_from":13,"seq":55834574920,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":74920,"kb_used_data":3608,"kb_used_omap":1,"kb_used_meta":71294,"kb_avail":94296920,"statfs":{"total":96636764160,"available":96560046080,"internally_reserved":0,"allocated":3694592,"data_stored":1851285,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":73005512},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 06:44:15 2024","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.56100000000000005,"15min":0.56899999999999995},"min":{"1min":0.24199999999999999,"5min":0.191,"15min":0.191},"max":{"1min":1.51,"5min":1.51,"15min":1.51},"last":1.0780000000000001},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.60599999999999998,"15min":0.65400000000000003},"min":{"1min":0.307,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.88900000000000001,"5min":1.2789999999999999,"15min":1.2789999999999999},"last":0.73299999999999998}]},{"osd":1,"last update":"Fri Sep 13 06:44:15 2024","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.54900000000000004,"15min":0.58599999999999997},"min":{"1min":0.29499999999999998,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.85399999999999998,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.59999999999999998,"15min":0.66800000000000004},"min":{"1min":0.27700000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":1.607,"5min":1.607,"15min":1.607},"last":0.77000000000000002}]},{"osd":2,"last update":"Fri Sep 13 06:44:15 2024","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.629,"15min":0.65200000000000002},"min":{"1min":0.30199999999999999,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":1.5660000000000001,"5min":1.5660000000000001,"15min":1.5660000000000001},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.59799999999999998,"15min":0.627},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":1.135,"5min":1.409,"15min":1.409},"last":0.86299999999999999}]},{"osd":4,"last update":"Fri Sep 13 06:44:15 2024","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.82599999999999996,"15min":0.89400000000000002},"min":{"1min":0.42899999999999999,"5min":0.377,"15min":0.377},"max":{"1min":1.651,"5min":1.7929999999999999,"15min":1.7929999999999999},"last":1.1919999999999999},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.76300000000000001,"15min":0.78300000000000003},"min":{"1min":0.44700000000000001,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.96499999999999997,"5min":1.3240000000000001,"15min":1.3240000000000001},"last":1.1559999999999999}]},{"osd":5,"last update":"Fri Sep 13 06:44:15 2024","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":0.81200000000000006,"15min":0.84999999999999998},"min":{"1min":0.48799999999999999,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.3029999999999999,"5min":1.3799999999999999,"15min":1.3799999999999999},"last":1.2529999999999999},{"interface":"front","average":{"1min":0.83099999999999996,"5min":0.82499999999999996,"15min":0.85999999999999999},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.4610000000000001,"5min":1.4610000000000001,"15min":1.4610000000000001},"last":0.95999999999999996}]},{"osd":6,"last update":"Fri Sep 13 06:42:11 2024","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.88500000000000001,"15min":0.91100000000000003},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.135,"5min":1.532,"15min":1.532},"last":1.357},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.95299999999999996,"15min":0.98999999999999999},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.2250000000000001,"5min":1.825,"15min":1.825},"last":0.99099999999999999}]},{"osd":7,"last update":"Fri Sep 13 06:43:31 2024","interfaces":[{"interface":"back","average":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.3799999999999999,"5min":1.3799999999999999,"15min":1.3799999999999999},"last":1.3009999999999999},{"interface":"front","average":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":2.0459999999999998,"5min":2.0459999999999998,"15min":2.0459999999999998},"last":1.4219999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574917,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60964,"kb_used_data":3608,"kb_used_omap":1,"kb_used_meta":57342,"kb_avail":94310876,"statfs":{"total":96636764160,"available":96574337024,"internally_reserved":0,"allocated":3694592,"data_stored":1851285,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":58718662},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 06:44:20 2024","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.66800000000000004,"15min":0.56200000000000006},"min":{"1min":0.19400000000000001,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.84199999999999997,"5min":8.6449999999999996,"15min":8.6449999999999996},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.65200000000000002,"15min":0.61099999999999999},"min":{"1min":0.30299999999999999,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":1.4410000000000001,"5min":4.0380000000000003,"15min":4.0380000000000003},"last":0.67800000000000005}]},{"osd":1,"last update":"Fri Sep 13 06:44:20 2024","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.64000000000000001,"15min":0.62},"min":{"1min":0.25,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":1.0329999999999999,"5min":3.4649999999999999,"15min":3.4649999999999999},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.66600000000000004,"15min":0.60299999999999998},"min":{"1min":0.34300000000000003,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":1.5049999999999999,"5min":3.8159999999999998,"15min":3.8159999999999998},"last":0.97799999999999998}]},{"osd":3,"last update":"Fri Sep 13 06:44:20 2024","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.65000000000000002,"15min":0.58599999999999997},"min":{"1min":0.36399999999999999,"5min":0.249,"15min":0.249},"max":{"1min":1.044,"5min":3.407,"15min":3.407},"last":0.755},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.73599999999999999,"15min":0.68600000000000005},"min":{"1min":0.312,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.238,"5min":3.2639999999999998,"15min":3.2639999999999998},"last":0.63900000000000001}]},{"osd":4,"last update":"Fri Sep 13 06:44:20 2024","interfaces":[{"interface":"back","average":{"1min":0.83299999999999996,"5min":0.878,"15min":0.88500000000000001},"min":{"1min":0.45600000000000002,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.3759999999999999,"5min":3.1179999999999999,"15min":3.1179999999999999},"last":0.83699999999999997},{"interface":"front","average":{"1min":0.81399999999999995,"5min":1.0620000000000001,"15min":0.94099999999999995},"min":{"1min":0.46800000000000003,"5min":0.439,"15min":0.439},"max":{"1min":1.359,"5min":21.081,"15min":21.081},"last":0.873}]},{"osd":5,"last update":"Fri Sep 13 06:44:20 2024","interfaces":[{"interface":"back","average":{"1min":0.82999999999999996,"5min":0.84799999999999998,"15min":0.84299999999999997},"min":{"1min":0.60099999999999998,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":1.143,"5min":2.2389999999999999,"15min":2.2389999999999999},"last":0.91200000000000003},{"interface":"front","average":{"1min":1.133,"5min":0.96099999999999997,"15min":0.88900000000000001},"min":{"1min":0.54400000000000004,"5min":0.377,"15min":0.377},"max":{"1min":4.9039999999999999,"5min":4.9039999999999999,"15min":4.9039999999999999},"last":0.93799999999999994}]},{"osd":6,"last update":"Fri Sep 13 06:42:15 2024","interfaces":[{"interface":"back","average":{"1min":0.86799999999999999,"5min":0.94199999999999995,"15min":0.92600000000000005},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.274,"5min":3.923,"15min":3.923},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.97799999999999998,"5min":0.90500000000000003,"15min":0.879},"min":{"1min":0.60899999999999999,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":2.2080000000000002,"5min":2.2120000000000002,"15min":2.2120000000000002},"last":1.1060000000000001}]},{"osd":7,"last update":"Fri Sep 13 06:44:33 2024","interfaces":[{"interface":"back","average":{"1min":0.95799999999999996,"5min":0.86499999999999999,"15min":0.84899999999999998},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":1.641,"5min":1.641,"15min":1.641},"last":1.032},{"interface":"front","average":{"1min":1.05,"5min":0.88600000000000001,"15min":0.85799999999999998},"min":{"1min":0.71499999999999997,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":2.0630000000000002,"5min":2.0630000000000002,"15min":2.0630000000000002},"last":1.157}]}]},{"osd":1,"up_from":13,"seq":55834574917,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52768,"kb_used_data":3600,"kb_used_omap":1,"kb_used_meta":49150,"kb_avail":94319072,"statfs":{"total":96636764160,"available":96582729728,"internally_reserved":0,"allocated":3686400,"data_stored":1844909,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":50330054},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 06:44:21 2024","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.55300000000000005,"15min":0.57299999999999995},"min":{"1min":0.246,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":1.1879999999999999,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.64200000000000002,"15min":0.65900000000000003},"min":{"1min":0.26200000000000001,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.99199999999999999,"5min":1.8160000000000001,"15min":1.8160000000000001},"last":0.77600000000000002}]},{"osd":2,"last update":"Fri Sep 13 06:44:21 2024","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.60699999999999998,"15min":0.63400000000000001},"min":{"1min":0.26800000000000002,"5min":0.22,"15min":0.22},"max":{"1min":0.92200000000000004,"5min":2.617,"15min":2.617},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.65300000000000002,"15min":0.65400000000000003},"min":{"1min":0.28499999999999998,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":1.331,"5min":2.5249999999999999,"15min":2.5249999999999999},"last":0.84299999999999997}]},{"osd":3,"last update":"Fri Sep 13 06:44:21 2024","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.70499999999999996,"15min":0.72599999999999998},"min":{"1min":0.33900000000000002,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":1.2769999999999999,"5min":1.3640000000000001,"15min":1.3640000000000001},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.66700000000000004,"15min":0.69099999999999995},"min":{"1min":0.30399999999999999,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":1.028,"5min":1.752,"15min":1.752},"last":0.68200000000000005}]},{"osd":4,"last update":"Fri Sep 13 06:44:21 2024","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.79800000000000004,"15min":0.81999999999999995},"min":{"1min":0.60899999999999999,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":1.109,"5min":2.7389999999999999,"15min":2.7389999999999999},"last":0.878},{"interface":"front","average":{"1min":0.94499999999999995,"5min":0.85499999999999998,"15min":0.90600000000000003},"min":{"1min":0.40000000000000002,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.4159999999999999,"5min":1.4359999999999999,"15min":1.4359999999999999},"last":1.046}]},{"osd":5,"last update":"Fri Sep 13 06:44:21 2024","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.84499999999999997,"15min":0.90600000000000003},"min":{"1min":0.58099999999999996,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.1399999999999999,"5min":1.7849999999999999,"15min":1.7849999999999999},"last":1.0129999999999999},{"interface":"front","average":{"1min":0.89600000000000002,"5min":0.86599999999999999,"15min":0.879},"min":{"1min":0.495,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":1.202,"5min":2.036,"15min":2.036},"last":0.93700000000000006}]},{"osd":6,"last update":"Fri Sep 13 06:42:18 2024","interfaces":[{"interface":"back","average":{"1min":0.87,"5min":0.92200000000000004,"15min":0.94399999999999995},"min":{"1min":0.57699999999999996,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.526,"5min":1.8149999999999999,"15min":1.8149999999999999},"last":0.89600000000000002},{"interface":"front","average":{"1min":0.88900000000000001,"5min":0.91200000000000003,"15min":0.91900000000000004},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":2.7810000000000001,"5min":2.7810000000000001,"15min":2.7810000000000001},"last":1.0840000000000001}]},{"osd":7,"last update":"Fri Sep 13 06:44:33 2024","interfaces":[{"interface":"back","average":{"1min":0.91900000000000004,"5min":0.90600000000000003,"15min":0.90400000000000003},"min":{"1min":0.621,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":1.3220000000000001,"5min":1.605,"15min":1.605},"last":0.81399999999999995},{"interface":"front","average":{"1min":1.054,"5min":0.93899999999999995,"15min":0.92000000000000004},"min":{"1min":0.61099999999999999,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.5009999999999999,"5min":1.5009999999999999,"15min":1.5009999999999999},"last":0.97199999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574916,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":85336,"kb_used_data":4172,"kb_used_omap":1,"kb_used_meta":81150,"kb_avail":94286504,"statfs":{"total":96636764160,"available":96549380096,"internally_reserved":0,"allocated":4272128,"data_stored":2435239,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":83098054},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 06:44:11 2024","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.54900000000000004,"15min":0.53000000000000003},"min":{"1min":0.23999999999999999,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":1.048,"5min":1.2270000000000001,"15min":1.2270000000000001},"last":0.751},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.56000000000000005,"15min":0.54000000000000004},"min":{"1min":0.28799999999999998,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":1.137,"5min":1.222,"15min":1.222},"last":0.60299999999999998}]},{"osd":2,"last update":"Fri Sep 13 06:44:11 2024","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.60399999999999998,"15min":0.55600000000000005},"min":{"1min":0.27300000000000002,"5min":0.217,"15min":0.217},"max":{"1min":1.2549999999999999,"5min":1.839,"15min":1.839},"last":0.83999999999999997},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.61299999999999999,"15min":0.57499999999999996},"min":{"1min":0.35399999999999998,"5min":0.245,"15min":0.245},"max":{"1min":1.419,"5min":1.419,"15min":1.419},"last":0.79700000000000004}]},{"osd":3,"last update":"Fri Sep 13 06:44:11 2024","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.59999999999999998,"15min":0.55800000000000005},"min":{"1min":0.371,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":1.2250000000000001,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.74299999999999999,"15min":0.69899999999999995},"min":{"1min":0.36699999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":1.175,"5min":4.9630000000000001,"15min":4.9630000000000001},"last":1.004}]},{"osd":4,"last update":"Fri Sep 13 06:44:11 2024","interfaces":[{"interface":"back","average":{"1min":0.89400000000000002,"5min":0.80400000000000005,"15min":0.79400000000000004},"min":{"1min":0.57899999999999996,"5min":0.311,"15min":0.311},"max":{"1min":1.6259999999999999,"5min":1.6259999999999999,"15min":1.6259999999999999},"last":0.89000000000000001},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.77400000000000002,"15min":0.79600000000000004},"min":{"1min":0.58999999999999997,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.1799999999999999,"5min":1.6319999999999999,"15min":1.6319999999999999},"last":0.92300000000000004}]},{"osd":5,"last update":"Fri Sep 13 06:44:11 2024","interfaces":[{"interface":"back","average":{"1min":0.89900000000000002,"5min":0.85799999999999998,"15min":0.85199999999999998},"min":{"1min":0.52800000000000002,"5min":0.378,"15min":0.378},"max":{"1min":1.575,"5min":1.575,"15min":1.575},"last":1.0600000000000001},{"interface":"front","average":{"1min":0.89100000000000001,"5min":0.85699999999999998,"15min":0.87},"min":{"1min":0.60199999999999998,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.327,"5min":1.5740000000000001,"15min":1.5740000000000001},"last":1.075}]},{"osd":6,"last update":"Fri Sep 13 06:42:11 2024","interfaces":[{"interface":"back","average":{"1min":0.89800000000000002,"5min":0.91200000000000003,"15min":0.93100000000000005},"min":{"1min":0.55300000000000005,"5min":0.499,"15min":0.499},"max":{"1min":1.571,"5min":2.4969999999999999,"15min":2.4969999999999999},"last":1.1479999999999999},{"interface":"front","average":{"1min":0.878,"5min":0.89600000000000002,"15min":0.90600000000000003},"min":{"1min":0.51800000000000002,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.208,"5min":2.0419999999999998,"15min":2.0419999999999998},"last":0.96899999999999997}]},{"osd":7,"last update":"Fri Sep 13 06:44:31 2024","interfaces":[{"interface":"back","average":{"1min":0.97799999999999998,"5min":1.0529999999999999,"15min":1.0649999999999999},"min":{"1min":0.57799999999999996,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.381,"5min":1.9419999999999999,"15min":1.9419999999999999},"last":1.1040000000000001},{"interface":"front","average":{"1min":0.97899999999999998,"5min":0.96999999999999997,"15min":0.96799999999999997},"min":{"1min":0.64100000000000001,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.4750000000000001,"5min":1.901,"15min":1.901},"last":1.032}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6552,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8096,"internal_metadata":0}]}} 2024-09-13T06:44:37.238 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T06:44:37.521 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T06:44:37.522 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-09-13T06:44:37.538 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":461,"stamp":"2024-09-13T06:44:35.609022+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590406,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":237398,"num_read_kb":1402962,"num_write":33483,"num_write_kb":1011328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9257,"num_bytes_recovered":444809309,"num_keys_recovered":867,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":24606,"ondisk_log_size":24606,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":486484,"kb_used_data":29976,"kb_used_omap":26,"kb_used_meta":456357,"kb_avail":754488236,"statfs":{"total":773094113280,"available":772595953664,"internally_reserved":0,"allocated":30695424,"data_stored":15965436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":27392,"internal_metadata":467309824},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":-22,"num_bytes_recovered":-19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.001384"},"pg_stats":[{"pgid":"3.1f","version":"280'781","reported_seq":6286,"reported_epoch":302,"state":"active+clean","last_fresh":"2024-09-13T06:44:31.794290+0000","last_change":"2024-09-13T06:44:05.445184+0000","last_active":"2024-09-13T06:44:31.794290+0000","last_peered":"2024-09-13T06:44:31.794290+0000","last_clean":"2024-09-13T06:44:31.794290+0000","last_became_active":"2024-09-13T06:40:57.385213+0000","last_became_peered":"2024-09-13T06:40:57.385213+0000","last_unstale":"2024-09-13T06:44:31.794290+0000","last_undegraded":"2024-09-13T06:44:31.794290+0000","last_fullsized":"2024-09-13T06:44:31.794290+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":781,"log_dups_size":0,"ondisk_log_size":781,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:46:17.100560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00056495999999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6518,"num_read_kb":34199,"num_write":1043,"num_write_kb":37100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":72,"num_bytes_recovered":6114482,"num_keys_recovered":44,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"271'1110","reported_seq":7421,"reported_epoch":303,"state":"active+clean","last_fresh":"2024-09-13T06:44:32.807368+0000","last_change":"2024-09-13T06:44:20.462945+0000","last_active":"2024-09-13T06:44:32.807368+0000","last_peered":"2024-09-13T06:44:32.807368+0000","last_clean":"2024-09-13T06:44:32.807368+0000","last_became_active":"2024-09-13T06:44:20.460702+0000","last_became_peered":"2024-09-13T06:44:20.460702+0000","last_unstale":"2024-09-13T06:44:32.807368+0000","last_undegraded":"2024-09-13T06:44:32.807368+0000","last_fullsized":"2024-09-13T06:44:32.807368+0000","mapping_epoch":290,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":291,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":1110,"log_dups_size":0,"ondisk_log_size":1110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:02:22.560348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013343369999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8806,"num_read_kb":55237,"num_write":1632,"num_write_kb":29160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":491,"num_bytes_recovered":16489974,"num_keys_recovered":55,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"279'1047","reported_seq":5655,"reported_epoch":302,"state":"active+clean","last_fresh":"2024-09-13T06:44:31.833302+0000","last_change":"2024-09-13T06:44:30.808653+0000","last_active":"2024-09-13T06:44:31.833302+0000","last_peered":"2024-09-13T06:44:31.833302+0000","last_clean":"2024-09-13T06:44:31.833302+0000","last_became_active":"2024-09-13T06:44:30.803142+0000","last_became_peered":"2024-09-13T06:44:30.803142+0000","last_unstale":"2024-09-13T06:44:31.833302+0000","last_undegraded":"2024-09-13T06:44:31.833302+0000","last_fullsized":"2024-09-13T06:44:31.833302+0000","mapping_epoch":300,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":301,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":1047,"log_dups_size":0,"ondisk_log_size":1047,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:25:53.597990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00088262599999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6265,"num_read_kb":28067,"num_write":1605,"num_write_kb":33265,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":206,"num_bytes_recovered":8442088,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1c","version":"280'843","reported_seq":8394,"reported_epoch":302,"state":"active+clean","last_fresh":"2024-09-13T06:44:31.833265+0000","last_change":"2024-09-13T06:44:30.807782+0000","last_active":"2024-09-13T06:44:31.833265+0000","last_peered":"2024-09-13T06:44:31.833265+0000","last_clean":"2024-09-13T06:44:31.833265+0000","last_became_active":"2024-09-13T06:44:30.801783+0000","last_became_peered":"2024-09-13T06:44:30.801783+0000","last_unstale":"2024-09-13T06:44:31.833265+0000","last_undegraded":"2024-09-13T06:44:31.833265+0000","last_fullsized":"2024-09-13T06:44:31.833265+0000","mapping_epoch":300,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":301,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":843,"log_dups_size":0,"ondisk_log_size":843,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:54:20.743708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001581236,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9390,"num_read_kb":69964,"num_write":963,"num_write_kb":31840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":350,"num_bytes_recovered":42380134,"num_keys_recovered":286,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"277'852","reported_seq":5169,"reported_epoch":302,"state":"active+clean","last_fresh":"2024-09-13T06:44:31.794146+0000","last_change":"2024-09-13T06:44:05.444712+0000","last_active":"2024-09-13T06:44:31.794146+0000","last_peered":"2024-09-13T06:44:31.794146+0000","last_clean":"2024-09-13T06:44:31.794146+0000","last_became_active":"2024-09-13T06:43:31.415608+0000","last_became_peered":"2024-09-13T06:43:31.415608+0000","last_unstale":"2024-09-13T06:44:31.794146+0000","last_undegraded":"2024-09-13T06:44:31.794146+0000","last_fullsized":"2024-09-13T06:44:31.794146+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":852,"log_dups_size":0,"ondisk_log_size":852,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:39:01.416782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060857399999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5714,"num_read_kb":37037,"num_write":1079,"num_write_kb":33376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":295,"num_bytes_recovered":25415745,"num_keys_recovered":55,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"277'497","reported_seq":7756,"reported_epoch":303,"state":"active+clean","last_fresh":"2024-09-13T06:44:33.194019+0000","last_change":"2024-09-13T06:44:20.469801+0000","last_active":"2024-09-13T06:44:33.194019+0000","last_peered":"2024-09-13T06:44:33.194019+0000","last_clean":"2024-09-13T06:44:33.194019+0000","last_became_active":"2024-09-13T06:44:20.462185+0000","last_became_peered":"2024-09-13T06:44:20.462185+0000","last_unstale":"2024-09-13T06:44:33.194019+0000","last_undegraded":"2024-09-13T06:44:33.194019+0000","last_fullsized":"2024-09-13T06:44:33.194019+0000","mapping_epoch":290,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":291,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":497,"log_dups_size":0,"ondisk_log_size":497,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:55:41.801680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00078923399999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6439,"num_read_kb":42977,"num_write":667,"num_write_kb":32420,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":728,"num_bytes_recovered":12986751,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"275'680","reported_seq":8569,"reported_epoch":303,"state":"active+clean","last_fresh":"2024-09-13T06:44:33.193202+0000","last_change":"2024-09-13T06:44:21.446173+0000","last_active":"2024-09-13T06:44:33.193202+0000","last_peered":"2024-09-13T06:44:33.193202+0000","last_clean":"2024-09-13T06:44:33.193202+0000","last_became_active":"2024-09-13T06:44:21.442872+0000","last_became_peered":"2024-09-13T06:44:21.442872+0000","last_unstale":"2024-09-13T06:44:33.193202+0000","last_undegraded":"2024-09-13T06:44:33.193202+0000","last_fullsized":"2024-09-13T06:44:33.193202+0000","mapping_epoch":291,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":292,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":680,"log_dups_size":0,"ondisk_log_size":680,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:11:12.949824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00079955100000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8400,"num_read_kb":35906,"num_write":738,"num_write_kb":28560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":398,"num_bytes_recovered":17539742,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"272'684","reported_seq":7045,"reported_epoch":303,"state":"active+clean","last_fresh":"2024-09-13T06:44:32.807518+0000","last_change":"2024-09-13T06:44:05.439754+0000","last_active":"2024-09-13T06:44:32.807518+0000","last_peered":"2024-09-13T06:44:32.807518+0000","last_clean":"2024-09-13T06:44:32.807518+0000","last_became_active":"2024-09-13T06:41:14.395301+0000","last_became_peered":"2024-09-13T06:41:14.395301+0000","last_unstale":"2024-09-13T06:44:32.807518+0000","last_undegraded":"2024-09-13T06:44:32.807518+0000","last_fullsized":"2024-09-13T06:44:32.807518+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":684,"log_dups_size":0,"ondisk_log_size":684,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:10:49.528345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00092758900000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6571,"num_read_kb":55194,"num_write":838,"num_write_kb":38872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":117,"num_bytes_recovered":13142180,"num_keys_recovered":22,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"275'1525","reported_seq":5959,"reported_epoch":302,"state":"active+clean","last_fresh":"2024-09-13T06:44:31.794327+0000","last_change":"2024-09-13T06:44:05.444913+0000","last_active":"2024-09-13T06:44:31.794327+0000","last_peered":"2024-09-13T06:44:31.794327+0000","last_clean":"2024-09-13T06:44:31.794327+0000","last_became_active":"2024-09-13T06:43:22.521039+0000","last_became_peered":"2024-09-13T06:43:22.521039+0000","last_unstale":"2024-09-13T06:44:31.794327+0000","last_undegraded":"2024-09-13T06:44:31.794327+0000","last_fullsized":"2024-09-13T06:44:31.794327+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":1525,"log_dups_size":0,"ondisk_log_size":1525,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:58:28.305131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00029931499999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9655,"num_read_kb":41824,"num_write":2232,"num_write_kb":32733,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":112,"num_bytes_recovered":14950263,"num_keys_recovered":22,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"275'715","reported_seq":5275,"reported_epoch":302,"state":"active+clean","last_fresh":"2024-09-13T06:44:31.833554+0000","last_change":"2024-09-13T06:44:30.806149+0000","last_active":"2024-09-13T06:44:31.833554+0000","last_peered":"2024-09-13T06:44:31.833554+0000","last_clean":"2024-09-13T06:44:31.833554+0000","last_became_active":"2024-09-13T06:44:30.798028+0000","last_became_peered":"2024-09-13T06:44:30.798028+0000","last_unstale":"2024-09-13T06:44:31.833554+0000","last_undegraded":"2024-09-13T06:44:31.833554+0000","last_fullsized":"2024-09-13T06:44:31.833554+0000","mapping_epoch":300,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":301,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":715,"log_dups_size":0,"ondisk_log_size":715,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:09:18.289368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0024960030000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5101,"num_read_kb":28279,"num_write":1028,"num_write_kb":23183,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":197,"num_bytes_recovered":7394092,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"277'365","reported_seq":6172,"reported_epoch":302,"state":"active+clean","last_fresh":"2024-09-13T06:44:31.864740+0000","last_change":"2024-09-13T06:44:05.457231+0000","last_active":"2024-09-13T06:44:31.864740+0000","last_peered":"2024-09-13T06:44:31.864740+0000","last_clean":"2024-09-13T06:44:31.864740+0000","last_became_active":"2024-09-13T06:42:33.408009+0000","last_became_peered":"2024-09-13T06:42:33.408009+0000","last_unstale":"2024-09-13T06:44:31.864740+0000","last_undegraded":"2024-09-13T06:44:31.864740+0000","last_fullsized":"2024-09-13T06:44:31.864740+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":365,"log_dups_size":0,"ondisk_log_size":365,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:09:11.995853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0024654690000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5036,"num_read_kb":48021,"num_write":472,"num_write_kb":27276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":157,"num_bytes_recovered":13242563,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"280'579","reported_seq":9959,"reported_epoch":303,"state":"active+clean","last_fresh":"2024-09-13T06:44:33.194074+0000","last_change":"2024-09-13T06:44:05.443324+0000","last_active":"2024-09-13T06:44:33.194074+0000","last_peered":"2024-09-13T06:44:33.194074+0000","last_clean":"2024-09-13T06:44:33.194074+0000","last_became_active":"2024-09-13T06:44:03.438897+0000","last_became_peered":"2024-09-13T06:44:03.438897+0000","last_unstale":"2024-09-13T06:44:33.194074+0000","last_undegraded":"2024-09-13T06:44:33.194074+0000","last_fullsized":"2024-09-13T06:44:33.194074+0000","mapping_epoch":277,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":278,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":579,"log_dups_size":0,"ondisk_log_size":579,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:24:55.053861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012901029999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8875,"num_read_kb":61758,"num_write":769,"num_write_kb":30278,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":506,"num_bytes_recovered":26184965,"num_keys_recovered":33,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":26,"reported_epoch":303,"state":"active+clean","last_fresh":"2024-09-13T06:44:33.194881+0000","last_change":"2024-09-13T06:44:16.450557+0000","last_active":"2024-09-13T06:44:33.194881+0000","last_peered":"2024-09-13T06:44:33.194881+0000","last_clean":"2024-09-13T06:44:33.194881+0000","last_became_active":"2024-09-13T06:44:16.449558+0000","last_became_peered":"2024-09-13T06:44:16.449558+0000","last_unstale":"2024-09-13T06:44:33.194881+0000","last_undegraded":"2024-09-13T06:44:33.194881+0000","last_fullsized":"2024-09-13T06:44:33.194881+0000","mapping_epoch":286,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":287,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_clean_scrub_stamp":"2024-09-13T06:39:16.508974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:01:20.779972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00080324699999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"280'643","reported_seq":10759,"reported_epoch":302,"state":"active+clean","last_fresh":"2024-09-13T06:44:31.794269+0000","last_change":"2024-09-13T06:44:22.454207+0000","last_active":"2024-09-13T06:44:31.794269+0000","last_peered":"2024-09-13T06:44:31.794269+0000","last_clean":"2024-09-13T06:44:31.794269+0000","last_became_active":"2024-09-13T06:44:22.449195+0000","last_became_peered":"2024-09-13T06:44:22.449195+0000","last_unstale":"2024-09-13T06:44:31.794269+0000","last_undegraded":"2024-09-13T06:44:31.794269+0000","last_fullsized":"2024-09-13T06:44:31.794269+0000","mapping_epoch":292,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":293,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":643,"log_dups_size":0,"ondisk_log_size":643,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:28:58.479641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00080400600000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9397,"num_read_kb":51433,"num_write":883,"num_write_kb":40908,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":358,"num_bytes_recovered":1257624,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":23,"reported_epoch":303,"state":"active+clean","last_fresh":"2024-09-13T06:44:33.193409+0000","last_change":"2024-09-13T06:44:18.458951+0000","last_active":"2024-09-13T06:44:33.193409+0000","last_peered":"2024-09-13T06:44:33.193409+0000","last_clean":"2024-09-13T06:44:33.193409+0000","last_became_active":"2024-09-13T06:44:18.458454+0000","last_became_peered":"2024-09-13T06:44:18.458454+0000","last_unstale":"2024-09-13T06:44:33.193409+0000","last_undegraded":"2024-09-13T06:44:33.193409+0000","last_fullsized":"2024-09-13T06:44:33.193409+0000","mapping_epoch":288,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":289,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_clean_scrub_stamp":"2024-09-13T06:39:16.508974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:06:07.380573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00097079800000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"277'694","reported_seq":7059,"reported_epoch":303,"state":"active+clean","last_fresh":"2024-09-13T06:44:32.807955+0000","last_change":"2024-09-13T06:44:05.440674+0000","last_active":"2024-09-13T06:44:32.807955+0000","last_peered":"2024-09-13T06:44:32.807955+0000","last_clean":"2024-09-13T06:44:32.807955+0000","last_became_active":"2024-09-13T06:42:32.413006+0000","last_became_peered":"2024-09-13T06:42:32.413006+0000","last_unstale":"2024-09-13T06:44:32.807955+0000","last_undegraded":"2024-09-13T06:44:32.807955+0000","last_fullsized":"2024-09-13T06:44:32.807955+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":694,"log_dups_size":0,"ondisk_log_size":694,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:38:01.774494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001338379,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6521,"num_read_kb":33119,"num_write":812,"num_write_kb":30039,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":213,"num_bytes_recovered":15100645,"num_keys_recovered":11,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":179,"reported_epoch":302,"state":"active+clean","last_fresh":"2024-09-13T06:44:31.864791+0000","last_change":"2024-09-13T06:42:28.563276+0000","last_active":"2024-09-13T06:44:31.864791+0000","last_peered":"2024-09-13T06:44:31.864791+0000","last_clean":"2024-09-13T06:44:31.864791+0000","last_became_active":"2024-09-13T06:42:28.562827+0000","last_became_peered":"2024-09-13T06:42:28.562827+0000","last_unstale":"2024-09-13T06:44:31.864791+0000","last_undegraded":"2024-09-13T06:44:31.864791+0000","last_fullsized":"2024-09-13T06:44:31.864791+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_clean_scrub_stamp":"2024-09-13T06:39:16.508974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:10:47.285603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"277'961","reported_seq":6890,"reported_epoch":303,"state":"active+clean","last_fresh":"2024-09-13T06:44:33.193159+0000","last_change":"2024-09-13T06:44:22.455582+0000","last_active":"2024-09-13T06:44:33.193159+0000","last_peered":"2024-09-13T06:44:33.193159+0000","last_clean":"2024-09-13T06:44:33.193159+0000","last_became_active":"2024-09-13T06:44:22.450933+0000","last_became_peered":"2024-09-13T06:44:22.450933+0000","last_unstale":"2024-09-13T06:44:33.193159+0000","last_undegraded":"2024-09-13T06:44:33.193159+0000","last_fullsized":"2024-09-13T06:44:33.193159+0000","mapping_epoch":292,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":293,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":961,"log_dups_size":0,"ondisk_log_size":961,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:30:26.327840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0031147280000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7705,"num_read_kb":38648,"num_write":1332,"num_write_kb":32653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":354,"num_bytes_recovered":6765835,"num_keys_recovered":11,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":23,"reported_epoch":303,"state":"active+clean","last_fresh":"2024-09-13T06:44:33.193244+0000","last_change":"2024-09-13T06:44:18.468145+0000","last_active":"2024-09-13T06:44:33.193244+0000","last_peered":"2024-09-13T06:44:33.193244+0000","last_clean":"2024-09-13T06:44:33.193244+0000","last_became_active":"2024-09-13T06:44:18.467833+0000","last_became_peered":"2024-09-13T06:44:18.467833+0000","last_unstale":"2024-09-13T06:44:33.193244+0000","last_undegraded":"2024-09-13T06:44:33.193244+0000","last_fullsized":"2024-09-13T06:44:33.193244+0000","mapping_epoch":288,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":289,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_clean_scrub_stamp":"2024-09-13T06:39:16.508974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:33:56.156376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"277'640","reported_seq":7754,"reported_epoch":302,"state":"active+clean","last_fresh":"2024-09-13T06:44:31.833497+0000","last_change":"2024-09-13T06:44:30.803125+0000","last_active":"2024-09-13T06:44:31.833497+0000","last_peered":"2024-09-13T06:44:31.833497+0000","last_clean":"2024-09-13T06:44:31.833497+0000","last_became_active":"2024-09-13T06:44:30.797769+0000","last_became_peered":"2024-09-13T06:44:30.797769+0000","last_unstale":"2024-09-13T06:44:31.833497+0000","last_undegraded":"2024-09-13T06:44:31.833497+0000","last_fullsized":"2024-09-13T06:44:31.833497+0000","mapping_epoch":300,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":301,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":640,"log_dups_size":0,"ondisk_log_size":640,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:49:47.340041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0046689339999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7611,"num_read_kb":41345,"num_write":1018,"num_write_kb":26620,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":158,"num_bytes_recovered":4212424,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"280'991","reported_seq":21073,"reported_epoch":303,"state":"active+clean","last_fresh":"2024-09-13T06:44:33.193970+0000","last_change":"2024-09-13T06:44:28.773729+0000","last_active":"2024-09-13T06:44:33.193970+0000","last_peered":"2024-09-13T06:44:33.193970+0000","last_clean":"2024-09-13T06:44:33.193970+0000","last_became_active":"2024-09-13T06:44:28.768976+0000","last_became_peered":"2024-09-13T06:44:28.768976+0000","last_unstale":"2024-09-13T06:44:33.193970+0000","last_undegraded":"2024-09-13T06:44:33.193970+0000","last_fullsized":"2024-09-13T06:44:33.193970+0000","mapping_epoch":298,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":299,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":991,"log_dups_size":0,"ondisk_log_size":991,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:30:21.817297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0017436419999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20994,"num_read_kb":92583,"num_write":1315,"num_write_kb":30385,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":207,"num_bytes_recovered":9898606,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"20'2","reported_seq":124,"reported_epoch":302,"state":"active+clean","last_fresh":"2024-09-13T06:44:31.833267+0000","last_change":"2024-09-13T06:44:30.794941+0000","last_active":"2024-09-13T06:44:31.833267+0000","last_peered":"2024-09-13T06:44:31.833267+0000","last_clean":"2024-09-13T06:44:31.833267+0000","last_became_active":"2024-09-13T06:44:30.794134+0000","last_became_peered":"2024-09-13T06:44:30.794134+0000","last_unstale":"2024-09-13T06:44:31.833267+0000","last_undegraded":"2024-09-13T06:44:31.833267+0000","last_fullsized":"2024-09-13T06:44:31.833267+0000","mapping_epoch":300,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":301,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_clean_scrub_stamp":"2024-09-13T06:39:16.508974+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:36:10.351897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":57,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"278'857","reported_seq":10771,"reported_epoch":303,"state":"active+clean","last_fresh":"2024-09-13T06:44:33.193137+0000","last_change":"2024-09-13T06:44:21.445836+0000","last_active":"2024-09-13T06:44:33.193137+0000","last_peered":"2024-09-13T06:44:33.193137+0000","last_clean":"2024-09-13T06:44:33.193137+0000","last_became_active":"2024-09-13T06:44:21.442847+0000","last_became_peered":"2024-09-13T06:44:21.442847+0000","last_unstale":"2024-09-13T06:44:33.193137+0000","last_undegraded":"2024-09-13T06:44:33.193137+0000","last_fullsized":"2024-09-13T06:44:33.193137+0000","mapping_epoch":291,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":292,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":857,"log_dups_size":0,"ondisk_log_size":857,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:42:10.542267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00053211199999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11278,"num_read_kb":63107,"num_write":1190,"num_write_kb":36968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":351,"num_bytes_recovered":9847094,"num_keys_recovered":11,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":25,"reported_epoch":303,"state":"active+clean","last_fresh":"2024-09-13T06:44:33.193124+0000","last_change":"2024-09-13T06:44:17.443833+0000","last_active":"2024-09-13T06:44:33.193124+0000","last_peered":"2024-09-13T06:44:33.193124+0000","last_clean":"2024-09-13T06:44:33.193124+0000","last_became_active":"2024-09-13T06:44:17.443358+0000","last_became_peered":"2024-09-13T06:44:17.443358+0000","last_unstale":"2024-09-13T06:44:33.193124+0000","last_undegraded":"2024-09-13T06:44:33.193124+0000","last_fullsized":"2024-09-13T06:44:33.193124+0000","mapping_epoch":287,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":288,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_clean_scrub_stamp":"2024-09-13T06:39:16.508974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:30:37.013428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00033592499999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"277'1115","reported_seq":6257,"reported_epoch":302,"state":"active+clean","last_fresh":"2024-09-13T06:44:31.793979+0000","last_change":"2024-09-13T06:44:30.799789+0000","last_active":"2024-09-13T06:44:31.793979+0000","last_peered":"2024-09-13T06:44:31.793979+0000","last_clean":"2024-09-13T06:44:31.793979+0000","last_became_active":"2024-09-13T06:44:30.798508+0000","last_became_peered":"2024-09-13T06:44:30.798508+0000","last_unstale":"2024-09-13T06:44:31.793979+0000","last_undegraded":"2024-09-13T06:44:31.793979+0000","last_fullsized":"2024-09-13T06:44:31.793979+0000","mapping_epoch":300,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":301,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":1115,"log_dups_size":0,"ondisk_log_size":1115,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:04:47.174299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0032283849999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7964,"num_read_kb":36198,"num_write":1645,"num_write_kb":33105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":243,"num_bytes_recovered":7863454,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":196,"reported_epoch":302,"state":"active+clean","last_fresh":"2024-09-13T06:44:31.864279+0000","last_change":"2024-09-13T06:44:18.457601+0000","last_active":"2024-09-13T06:44:31.864279+0000","last_peered":"2024-09-13T06:44:31.864279+0000","last_clean":"2024-09-13T06:44:31.864279+0000","last_became_active":"2024-09-13T06:44:18.456828+0000","last_became_peered":"2024-09-13T06:44:18.456828+0000","last_unstale":"2024-09-13T06:44:31.864279+0000","last_undegraded":"2024-09-13T06:44:31.864279+0000","last_fullsized":"2024-09-13T06:44:31.864279+0000","mapping_epoch":288,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":289,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_clean_scrub_stamp":"2024-09-13T06:39:16.508974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:17:09.082426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"279'349","reported_seq":3762,"reported_epoch":303,"state":"active+clean","last_fresh":"2024-09-13T06:44:32.807410+0000","last_change":"2024-09-13T06:44:05.440371+0000","last_active":"2024-09-13T06:44:32.807410+0000","last_peered":"2024-09-13T06:44:32.807410+0000","last_clean":"2024-09-13T06:44:32.807410+0000","last_became_active":"2024-09-13T06:41:15.399301+0000","last_became_peered":"2024-09-13T06:41:15.399301+0000","last_unstale":"2024-09-13T06:44:32.807410+0000","last_undegraded":"2024-09-13T06:44:32.807410+0000","last_fullsized":"2024-09-13T06:44:32.807410+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":349,"log_dups_size":0,"ondisk_log_size":349,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:53:18.137873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001343293,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2523,"num_read_kb":19829,"num_write":427,"num_write_kb":20943,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":169,"num_bytes_recovered":5233325,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"18'1","reported_seq":55,"reported_epoch":302,"state":"active+clean","last_fresh":"2024-09-13T06:44:31.833265+0000","last_change":"2024-09-13T06:44:30.798045+0000","last_active":"2024-09-13T06:44:31.833265+0000","last_peered":"2024-09-13T06:44:31.833265+0000","last_clean":"2024-09-13T06:44:31.833265+0000","last_became_active":"2024-09-13T06:44:30.796877+0000","last_became_peered":"2024-09-13T06:44:30.796877+0000","last_unstale":"2024-09-13T06:44:31.833265+0000","last_undegraded":"2024-09-13T06:44:31.833265+0000","last_fullsized":"2024-09-13T06:44:31.833265+0000","mapping_epoch":300,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":301,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_clean_scrub_stamp":"2024-09-13T06:39:16.508974+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:33:04.298167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":396,"reported_epoch":302,"state":"active+clean","last_fresh":"2024-09-13T06:44:31.864055+0000","last_change":"2024-09-13T06:42:28.563168+0000","last_active":"2024-09-13T06:44:31.864055+0000","last_peered":"2024-09-13T06:44:31.864055+0000","last_clean":"2024-09-13T06:44:31.864055+0000","last_became_active":"2024-09-13T06:42:28.562642+0000","last_became_peered":"2024-09-13T06:42:28.562642+0000","last_unstale":"2024-09-13T06:44:31.864055+0000","last_undegraded":"2024-09-13T06:44:31.864055+0000","last_fullsized":"2024-09-13T06:44:31.864055+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:10.110558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:10.110558+0000","last_clean_scrub_stamp":"2024-09-13T06:39:10.110558+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:05:54.866043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"277'651","reported_seq":10850,"reported_epoch":303,"state":"active+clean","last_fresh":"2024-09-13T06:44:32.807285+0000","last_change":"2024-09-13T06:44:22.452634+0000","last_active":"2024-09-13T06:44:32.807285+0000","last_peered":"2024-09-13T06:44:32.807285+0000","last_clean":"2024-09-13T06:44:32.807285+0000","last_became_active":"2024-09-13T06:44:22.448736+0000","last_became_peered":"2024-09-13T06:44:22.448736+0000","last_unstale":"2024-09-13T06:44:32.807285+0000","last_undegraded":"2024-09-13T06:44:32.807285+0000","last_fullsized":"2024-09-13T06:44:32.807285+0000","mapping_epoch":292,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":293,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":651,"log_dups_size":0,"ondisk_log_size":651,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:58:40.103969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00083432600000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9552,"num_read_kb":46146,"num_write":828,"num_write_kb":32512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":446,"num_bytes_recovered":11977587,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"277'774","reported_seq":10943,"reported_epoch":303,"state":"active+clean","last_fresh":"2024-09-13T06:44:33.192916+0000","last_change":"2024-09-13T06:44:20.466493+0000","last_active":"2024-09-13T06:44:33.192916+0000","last_peered":"2024-09-13T06:44:33.192916+0000","last_clean":"2024-09-13T06:44:33.192916+0000","last_became_active":"2024-09-13T06:44:20.462849+0000","last_became_peered":"2024-09-13T06:44:20.462849+0000","last_unstale":"2024-09-13T06:44:33.192916+0000","last_undegraded":"2024-09-13T06:44:33.192916+0000","last_fullsized":"2024-09-13T06:44:33.192916+0000","mapping_epoch":290,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":291,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":774,"log_dups_size":0,"ondisk_log_size":774,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:40:44.119462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0024338839999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10729,"num_read_kb":51645,"num_write":931,"num_write_kb":34617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":445,"num_bytes_recovered":16579571,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"278'758","reported_seq":8274,"reported_epoch":304,"state":"peering","last_fresh":"2024-09-13T06:44:33.832643+0000","last_change":"2024-09-13T06:44:33.832643+0000","last_active":"2024-09-13T06:44:15.688154+0000","last_peered":"2024-09-13T06:44:14.671646+0000","last_clean":"2024-09-13T06:44:14.671646+0000","last_became_active":"2024-09-13T06:43:37.418917+0000","last_became_peered":"2024-09-13T06:43:37.418917+0000","last_unstale":"2024-09-13T06:44:33.832643+0000","last_undegraded":"2024-09-13T06:44:33.832643+0000","last_fullsized":"2024-09-13T06:44:33.832643+0000","mapping_epoch":304,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":290,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":758,"log_dups_size":0,"ondisk_log_size":758,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:44:55.089545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00085210600000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8422,"num_read_kb":47219,"num_write":883,"num_write_kb":28077,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":515,"num_bytes_recovered":28581300,"num_keys_recovered":111,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"271'845","reported_seq":5601,"reported_epoch":303,"state":"active+clean","last_fresh":"2024-09-13T06:44:32.807674+0000","last_change":"2024-09-13T06:44:05.439827+0000","last_active":"2024-09-13T06:44:32.807674+0000","last_peered":"2024-09-13T06:44:32.807674+0000","last_clean":"2024-09-13T06:44:32.807674+0000","last_became_active":"2024-09-13T06:41:15.399204+0000","last_became_peered":"2024-09-13T06:41:15.399204+0000","last_unstale":"2024-09-13T06:44:32.807674+0000","last_undegraded":"2024-09-13T06:44:32.807674+0000","last_fullsized":"2024-09-13T06:44:32.807674+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":845,"log_dups_size":0,"ondisk_log_size":845,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:27:03.298272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00094468700000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6686,"num_read_kb":57840,"num_write":1181,"num_write_kb":24665,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":117,"num_bytes_recovered":13256568,"num_keys_recovered":44,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"279'569","reported_seq":6602,"reported_epoch":302,"state":"active+clean","last_fresh":"2024-09-13T06:44:31.833489+0000","last_change":"2024-09-13T06:44:30.802655+0000","last_active":"2024-09-13T06:44:31.833489+0000","last_peered":"2024-09-13T06:44:31.833489+0000","last_clean":"2024-09-13T06:44:31.833489+0000","last_became_active":"2024-09-13T06:44:30.794873+0000","last_became_peered":"2024-09-13T06:44:30.794873+0000","last_unstale":"2024-09-13T06:44:31.833489+0000","last_undegraded":"2024-09-13T06:44:31.833489+0000","last_fullsized":"2024-09-13T06:44:31.833489+0000","mapping_epoch":300,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":301,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":569,"log_dups_size":0,"ondisk_log_size":569,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:26:59.771063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0027493119999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6187,"num_read_kb":31727,"num_write":657,"num_write_kb":25682,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":184,"num_bytes_recovered":16410936,"num_keys_recovered":88,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"277'881","reported_seq":2922,"reported_epoch":302,"state":"active+clean","last_fresh":"2024-09-13T06:44:31.864902+0000","last_change":"2024-09-13T06:44:05.458093+0000","last_active":"2024-09-13T06:44:31.864902+0000","last_peered":"2024-09-13T06:44:31.864902+0000","last_clean":"2024-09-13T06:44:31.864902+0000","last_became_active":"2024-09-13T06:42:32.411927+0000","last_became_peered":"2024-09-13T06:42:32.411927+0000","last_unstale":"2024-09-13T06:44:31.864902+0000","last_undegraded":"2024-09-13T06:44:31.864902+0000","last_fullsized":"2024-09-13T06:44:31.864902+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":881,"log_dups_size":0,"ondisk_log_size":881,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:40:44.787780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.003013108,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4846,"num_read_kb":26164,"num_write":1518,"num_write_kb":30083,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":140,"num_bytes_recovered":11278110,"num_keys_recovered":11,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.e","version":"277'556","reported_seq":4101,"reported_epoch":302,"state":"active+clean","last_fresh":"2024-09-13T06:44:31.864598+0000","last_change":"2024-09-13T06:44:30.808041+0000","last_active":"2024-09-13T06:44:31.864598+0000","last_peered":"2024-09-13T06:44:31.864598+0000","last_clean":"2024-09-13T06:44:31.864598+0000","last_became_active":"2024-09-13T06:44:30.801655+0000","last_became_peered":"2024-09-13T06:44:30.801655+0000","last_unstale":"2024-09-13T06:44:31.864598+0000","last_undegraded":"2024-09-13T06:44:31.864598+0000","last_fullsized":"2024-09-13T06:44:31.864598+0000","mapping_epoch":300,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":301,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":556,"log_dups_size":0,"ondisk_log_size":556,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:43:53.489080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0025767619999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3868,"num_read_kb":43567,"num_write":654,"num_write_kb":29232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":503,"num_bytes_recovered":12695191,"num_keys_recovered":11,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"277'665","reported_seq":4753,"reported_epoch":302,"state":"active+clean","last_fresh":"2024-09-13T06:44:31.864487+0000","last_change":"2024-09-13T06:44:05.458214+0000","last_active":"2024-09-13T06:44:31.864487+0000","last_peered":"2024-09-13T06:44:31.864487+0000","last_clean":"2024-09-13T06:44:31.864487+0000","last_became_active":"2024-09-13T06:42:33.412054+0000","last_became_peered":"2024-09-13T06:42:33.412054+0000","last_unstale":"2024-09-13T06:44:31.864487+0000","last_undegraded":"2024-09-13T06:44:31.864487+0000","last_fullsized":"2024-09-13T06:44:31.864487+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":665,"log_dups_size":0,"ondisk_log_size":665,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:07:06.963404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00285659,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4677,"num_read_kb":45287,"num_write":982,"num_write_kb":45285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":394,"num_bytes_recovered":42768786,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.10","version":"280'832","reported_seq":5034,"reported_epoch":303,"state":"active+clean","last_fresh":"2024-09-13T06:44:33.194832+0000","last_change":"2024-09-13T06:44:19.467239+0000","last_active":"2024-09-13T06:44:33.194832+0000","last_peered":"2024-09-13T06:44:33.194832+0000","last_clean":"2024-09-13T06:44:33.194832+0000","last_became_active":"2024-09-13T06:44:19.459617+0000","last_became_peered":"2024-09-13T06:44:19.459617+0000","last_unstale":"2024-09-13T06:44:33.194832+0000","last_undegraded":"2024-09-13T06:44:33.194832+0000","last_fullsized":"2024-09-13T06:44:33.194832+0000","mapping_epoch":289,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":290,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":832,"log_dups_size":0,"ondisk_log_size":832,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:43:55.736868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0018779840000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5715,"num_read_kb":29614,"num_write":1142,"num_write_kb":36190,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":275,"num_bytes_recovered":6622441,"num_keys_recovered":20,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.11","version":"279'502","reported_seq":6278,"reported_epoch":302,"state":"active+clean","last_fresh":"2024-09-13T06:44:31.864123+0000","last_change":"2024-09-13T06:44:05.455675+0000","last_active":"2024-09-13T06:44:31.864123+0000","last_peered":"2024-09-13T06:44:31.864123+0000","last_clean":"2024-09-13T06:44:31.864123+0000","last_became_active":"2024-09-13T06:42:33.411668+0000","last_became_peered":"2024-09-13T06:42:33.411668+0000","last_unstale":"2024-09-13T06:44:31.864123+0000","last_undegraded":"2024-09-13T06:44:31.864123+0000","last_fullsized":"2024-09-13T06:44:31.864123+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":502,"log_dups_size":0,"ondisk_log_size":502,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:43:01.814094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001270492,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5341,"num_read_kb":34087,"num_write":659,"num_write_kb":25712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":245,"num_bytes_recovered":7089272,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"280'921","reported_seq":5046,"reported_epoch":302,"state":"active+clean","last_fresh":"2024-09-13T06:44:31.794105+0000","last_change":"2024-09-13T06:44:20.470378+0000","last_active":"2024-09-13T06:44:31.794105+0000","last_peered":"2024-09-13T06:44:31.794105+0000","last_clean":"2024-09-13T06:44:31.794105+0000","last_became_active":"2024-09-13T06:44:20.466713+0000","last_became_peered":"2024-09-13T06:44:20.466713+0000","last_unstale":"2024-09-13T06:44:31.794105+0000","last_undegraded":"2024-09-13T06:44:31.794105+0000","last_fullsized":"2024-09-13T06:44:31.794105+0000","mapping_epoch":290,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":291,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":921,"log_dups_size":0,"ondisk_log_size":921,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:00:14.406068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0017683250000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6025,"num_read_kb":38947,"num_write":1315,"num_write_kb":35656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":107,"num_bytes_recovered":3682200,"num_keys_recovered":21,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"279'604","reported_seq":4545,"reported_epoch":302,"state":"active+clean","last_fresh":"2024-09-13T06:44:31.864508+0000","last_change":"2024-09-13T06:44:05.454984+0000","last_active":"2024-09-13T06:44:31.864508+0000","last_peered":"2024-09-13T06:44:31.864508+0000","last_clean":"2024-09-13T06:44:31.864508+0000","last_became_active":"2024-09-13T06:42:31.402800+0000","last_became_peered":"2024-09-13T06:42:31.402800+0000","last_unstale":"2024-09-13T06:44:31.864508+0000","last_undegraded":"2024-09-13T06:44:31.864508+0000","last_fullsized":"2024-09-13T06:44:31.864508+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":604,"log_dups_size":0,"ondisk_log_size":604,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:59:41.167052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010470779999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4471,"num_read_kb":35894,"num_write":884,"num_write_kb":31515,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":196,"num_bytes_recovered":8224568,"num_keys_recovered":11,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":19,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":237282,"num_read_kb":1402862,"num_write":33322,"num_write_kb":1008910,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9249,"num_bytes_recovered":443628516,"num_keys_recovered":867,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14648,"internal_metadata":0},"log_size":24486,"ondisk_log_size":24486,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":57,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":3}],"osd_stats":[{"osd":7,"up_from":187,"seq":803158884379,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37024,"kb_used_data":4172,"kb_used_omap":9,"kb_used_meta":32822,"kb_avail":94334816,"statfs":{"total":96636764160,"available":96598851584,"internally_reserved":0,"allocated":4272128,"data_stored":2435239,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9685,"internal_metadata":33610283},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 06:44:33 2024","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":0.71199999999999997,"15min":0.69799999999999995},"min":{"1min":0.56699999999999995,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.871},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.751,"15min":0.73999999999999999},"min":{"1min":0.54600000000000004,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.6910000000000001,"5min":1.6910000000000001,"15min":1.6910000000000001},"last":0.55100000000000005}]},{"osd":1,"last update":"Fri Sep 13 06:44:33 2024","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.75700000000000001,"15min":0.751},"min":{"1min":0.57399999999999995,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.359,"5min":1.359,"15min":1.359},"last":0.91300000000000003},{"interface":"front","average":{"1min":0.82399999999999995,"5min":0.71599999999999997,"15min":0.69799999999999995},"min":{"1min":0.496,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.1259999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":1.079}]},{"osd":2,"last update":"Fri Sep 13 06:44:33 2024","interfaces":[{"interface":"back","average":{"1min":0.80700000000000005,"5min":0.75900000000000001,"15min":0.751},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.2030000000000001,"5min":1.212,"15min":1.212},"last":1.1259999999999999},{"interface":"front","average":{"1min":0.92200000000000004,"5min":0.81499999999999995,"15min":0.79700000000000004},"min":{"1min":0.58999999999999997,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.4319999999999999,"5min":1.4319999999999999,"15min":1.4319999999999999},"last":1.022}]},{"osd":3,"last update":"Fri Sep 13 06:44:33 2024","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.79600000000000004,"15min":0.79200000000000004},"min":{"1min":0.60299999999999998,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.177,"5min":1.177,"15min":1.177},"last":1.177},{"interface":"front","average":{"1min":0.88600000000000001,"5min":0.84299999999999997,"15min":0.83599999999999997},"min":{"1min":0.48099999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.7350000000000001,"5min":1.7350000000000001,"15min":1.7350000000000001},"last":0.97499999999999998}]},{"osd":4,"last update":"Fri Sep 13 06:44:33 2024","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.82299999999999995,"15min":0.82499999999999996},"min":{"1min":0.45500000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.405,"5min":1.405,"15min":1.405},"last":0.69399999999999995},{"interface":"front","average":{"1min":1.0049999999999999,"5min":0.82299999999999995,"15min":0.79300000000000004},"min":{"1min":0.39800000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.6240000000000001,"5min":1.6240000000000001,"15min":1.6240000000000001},"last":1.2170000000000001}]},{"osd":5,"last update":"Fri Sep 13 06:44:33 2024","interfaces":[{"interface":"back","average":{"1min":0.96599999999999997,"5min":0.88800000000000001,"15min":0.875},"min":{"1min":0.504,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.593,"5min":1.593,"15min":1.593},"last":0.83099999999999996},{"interface":"front","average":{"1min":0.92300000000000004,"5min":0.84099999999999997,"15min":0.82699999999999996},"min":{"1min":0.53800000000000003,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.3400000000000001,"5min":1.3400000000000001,"15min":1.3400000000000001},"last":1.3400000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.25}]}]},{"osd":6,"up_from":286,"seq":1228360646661,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35500,"kb_used_data":3608,"kb_used_omap":7,"kb_used_meta":31864,"kb_avail":94336340,"statfs":{"total":96636764160,"available":96600412160,"internally_reserved":0,"allocated":3694592,"data_stored":1851285,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8145,"internal_metadata":32628783},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89900000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.256}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2310000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84599999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.751}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97699999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.026}]}]},{"osd":5,"up_from":13,"seq":55834574917,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":79004,"kb_used_data":3596,"kb_used_omap":1,"kb_used_meta":75390,"kb_avail":94292836,"statfs":{"total":96636764160,"available":96555864064,"internally_reserved":0,"allocated":3682304,"data_stored":1844890,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":77199814},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 06:44:19 2024","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.71399999999999997,"15min":0.76500000000000001},"min":{"1min":0.40999999999999998,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":1.093,"5min":1.6679999999999999,"15min":1.6679999999999999},"last":0.94599999999999995},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.76900000000000002,"15min":0.79900000000000004},"min":{"1min":0.41299999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.1220000000000001,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":0.98799999999999999}]},{"osd":1,"last update":"Fri Sep 13 06:44:19 2024","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.73999999999999999,"15min":0.751},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":1.103,"5min":1.341,"15min":1.341},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.70099999999999996,"15min":0.74099999999999999},"min":{"1min":0.40899999999999997,"5min":0.317,"15min":0.317},"max":{"1min":1.0089999999999999,"5min":1.722,"15min":1.722},"last":0.63800000000000001}]},{"osd":2,"last update":"Fri Sep 13 06:44:19 2024","interfaces":[{"interface":"back","average":{"1min":0.876,"5min":0.81999999999999995,"15min":0.86399999999999999},"min":{"1min":0.47699999999999998,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.143,"5min":1.833,"15min":1.833},"last":0.91000000000000003},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.79200000000000004},"min":{"1min":0.47999999999999998,"5min":0.435,"15min":0.435},"max":{"1min":1.0169999999999999,"5min":1.4279999999999999,"15min":1.4279999999999999},"last":1.1459999999999999}]},{"osd":3,"last update":"Fri Sep 13 06:44:19 2024","interfaces":[{"interface":"back","average":{"1min":0.85699999999999998,"5min":0.81399999999999995,"15min":0.78000000000000003},"min":{"1min":0.45400000000000001,"5min":0.434,"15min":0.434},"max":{"1min":1.1659999999999999,"5min":1.885,"15min":1.885},"last":0.82399999999999995},{"interface":"front","average":{"1min":0.85899999999999999,"5min":0.86299999999999999,"15min":0.86499999999999999},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.2410000000000001,"5min":1.907,"15min":1.907},"last":1.099}]},{"osd":4,"last update":"Fri Sep 13 06:44:19 2024","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.83499999999999996,"15min":0.80500000000000005},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":1.159,"5min":6.3179999999999996,"15min":6.3179999999999996},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.78000000000000003,"5min":1.0529999999999999,"15min":0.91000000000000003},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":1.2370000000000001,"5min":15.553000000000001,"15min":15.553000000000001},"last":0.85599999999999998}]},{"osd":6,"last update":"Fri Sep 13 06:42:12 2024","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.86299999999999999,"15min":0.877},"min":{"1min":0.40000000000000002,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.9610000000000001,"5min":1.9610000000000001,"15min":1.9610000000000001},"last":1.04},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.86099999999999999,"15min":0.87},"min":{"1min":0.39000000000000001,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.206,"5min":1.968,"15min":1.968},"last":1.1890000000000001}]},{"osd":7,"last update":"Fri Sep 13 06:44:31 2024","interfaces":[{"interface":"back","average":{"1min":0.96399999999999997,"5min":0.84399999999999997,"15min":0.82399999999999995},"min":{"1min":0.39000000000000001,"5min":0.373,"15min":0.373},"max":{"1min":1.2050000000000001,"5min":1.375,"15min":1.375},"last":1.0700000000000001},{"interface":"front","average":{"1min":0.997,"5min":0.89800000000000002,"15min":0.88200000000000001},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":1.7050000000000001,"5min":1.7050000000000001,"15min":1.7050000000000001},"last":1.2909999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574917,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60968,"kb_used_data":3612,"kb_used_omap":1,"kb_used_meta":57342,"kb_avail":94310872,"statfs":{"total":96636764160,"available":96574332928,"internally_reserved":0,"allocated":3698688,"data_stored":1851304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":58718662},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 06:44:15 2024","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.79300000000000004,"15min":0.98999999999999999},"min":{"1min":0.41499999999999998,"5min":0.245,"15min":0.245},"max":{"1min":1.0720000000000001,"5min":5.8230000000000004,"15min":5.8230000000000004},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.71999999999999997,"15min":0.752},"min":{"1min":0.505,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.97299999999999998,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":1.018}]},{"osd":1,"last update":"Fri Sep 13 06:44:15 2024","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.79300000000000004,"15min":0.75},"min":{"1min":0.45100000000000001,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.86899999999999999,"5min":10.156000000000001,"15min":10.156000000000001},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.747,"5min":0.77500000000000002,"15min":0.83599999999999997},"min":{"1min":0.496,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.0349999999999999,"5min":1.286,"15min":1.286},"last":0.93100000000000005}]},{"osd":2,"last update":"Fri Sep 13 06:44:15 2024","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.751,"15min":0.82299999999999995},"min":{"1min":0.52800000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":1.0109999999999999,"5min":1.6000000000000001,"15min":1.6000000000000001},"last":1.0409999999999999},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.81299999999999994},"min":{"1min":0.65500000000000003,"5min":0.374,"15min":0.374},"max":{"1min":1.167,"5min":1.3540000000000001,"15min":1.3540000000000001},"last":0.79100000000000004}]},{"osd":3,"last update":"Fri Sep 13 06:44:15 2024","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.84699999999999998,"15min":0.90200000000000002},"min":{"1min":0.57499999999999996,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.6950000000000001,"5min":1.6950000000000001,"15min":1.6950000000000001},"last":1.101},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.95299999999999996,"15min":0.92500000000000004},"min":{"1min":0.48499999999999999,"5min":0.374,"15min":0.374},"max":{"1min":1.8069999999999999,"5min":10.195,"15min":10.195},"last":0.98999999999999999}]},{"osd":5,"last update":"Fri Sep 13 06:44:15 2024","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.81499999999999995,"15min":0.85699999999999998},"min":{"1min":0.443,"5min":0.249,"15min":0.249},"max":{"1min":1.075,"5min":2.9790000000000001,"15min":2.9790000000000001},"last":0.85199999999999998},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.84399999999999997,"15min":0.91400000000000003},"min":{"1min":0.39700000000000002,"5min":0.372,"15min":0.372},"max":{"1min":1.0580000000000001,"5min":1.8779999999999999,"15min":1.8779999999999999},"last":0.872}]},{"osd":6,"last update":"Fri Sep 13 06:42:14 2024","interfaces":[{"interface":"back","average":{"1min":0.90100000000000002,"5min":0.92100000000000004,"15min":0.82899999999999996},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":1.6100000000000001,"5min":10.016999999999999,"15min":10.016999999999999},"last":0.96699999999999997},{"interface":"front","average":{"1min":0.86699999999999999,"5min":0.93300000000000005,"15min":0.95999999999999996},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.2030000000000001,"5min":2.0750000000000002,"15min":2.0750000000000002},"last":0.82399999999999995}]},{"osd":7,"last update":"Fri Sep 13 06:44:33 2024","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.1539999999999999,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.90500000000000003},{"interface":"front","average":{"1min":0.90400000000000003,"5min":0.89200000000000002,"15min":0.89000000000000001},"min":{"1min":0.505,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.2529999999999999,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":1.073}]}]},{"osd":3,"up_from":13,"seq":55834574920,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":74920,"kb_used_data":3608,"kb_used_omap":1,"kb_used_meta":71294,"kb_avail":94296920,"statfs":{"total":96636764160,"available":96560046080,"internally_reserved":0,"allocated":3694592,"data_stored":1851285,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":73005512},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 06:44:15 2024","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.56100000000000005,"15min":0.56899999999999995},"min":{"1min":0.24199999999999999,"5min":0.191,"15min":0.191},"max":{"1min":1.51,"5min":1.51,"15min":1.51},"last":1.0780000000000001},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.60599999999999998,"15min":0.65400000000000003},"min":{"1min":0.307,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.88900000000000001,"5min":1.2789999999999999,"15min":1.2789999999999999},"last":0.73299999999999998}]},{"osd":1,"last update":"Fri Sep 13 06:44:15 2024","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.54900000000000004,"15min":0.58599999999999997},"min":{"1min":0.29499999999999998,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.85399999999999998,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.59999999999999998,"15min":0.66800000000000004},"min":{"1min":0.27700000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":1.607,"5min":1.607,"15min":1.607},"last":0.77000000000000002}]},{"osd":2,"last update":"Fri Sep 13 06:44:15 2024","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.629,"15min":0.65200000000000002},"min":{"1min":0.30199999999999999,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":1.5660000000000001,"5min":1.5660000000000001,"15min":1.5660000000000001},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.59799999999999998,"15min":0.627},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":1.135,"5min":1.409,"15min":1.409},"last":0.86299999999999999}]},{"osd":4,"last update":"Fri Sep 13 06:44:15 2024","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.82599999999999996,"15min":0.89400000000000002},"min":{"1min":0.42899999999999999,"5min":0.377,"15min":0.377},"max":{"1min":1.651,"5min":1.7929999999999999,"15min":1.7929999999999999},"last":1.1919999999999999},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.76300000000000001,"15min":0.78300000000000003},"min":{"1min":0.44700000000000001,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.96499999999999997,"5min":1.3240000000000001,"15min":1.3240000000000001},"last":1.1559999999999999}]},{"osd":5,"last update":"Fri Sep 13 06:44:15 2024","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":0.81200000000000006,"15min":0.84999999999999998},"min":{"1min":0.48799999999999999,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.3029999999999999,"5min":1.3799999999999999,"15min":1.3799999999999999},"last":1.2529999999999999},{"interface":"front","average":{"1min":0.83099999999999996,"5min":0.82499999999999996,"15min":0.85999999999999999},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.4610000000000001,"5min":1.4610000000000001,"15min":1.4610000000000001},"last":0.95999999999999996}]},{"osd":6,"last update":"Fri Sep 13 06:42:11 2024","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.88500000000000001,"15min":0.91100000000000003},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.135,"5min":1.532,"15min":1.532},"last":1.357},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.95299999999999996,"15min":0.98999999999999999},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.2250000000000001,"5min":1.825,"15min":1.825},"last":0.99099999999999999}]},{"osd":7,"last update":"Fri Sep 13 06:43:31 2024","interfaces":[{"interface":"back","average":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.3799999999999999,"5min":1.3799999999999999,"15min":1.3799999999999999},"last":1.3009999999999999},{"interface":"front","average":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":2.0459999999999998,"5min":2.0459999999999998,"15min":2.0459999999999998},"last":1.4219999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574917,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60964,"kb_used_data":3608,"kb_used_omap":1,"kb_used_meta":57342,"kb_avail":94310876,"statfs":{"total":96636764160,"available":96574337024,"internally_reserved":0,"allocated":3694592,"data_stored":1851285,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":58718662},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 06:44:20 2024","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.66800000000000004,"15min":0.56200000000000006},"min":{"1min":0.19400000000000001,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.84199999999999997,"5min":8.6449999999999996,"15min":8.6449999999999996},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.65200000000000002,"15min":0.61099999999999999},"min":{"1min":0.30299999999999999,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":1.4410000000000001,"5min":4.0380000000000003,"15min":4.0380000000000003},"last":0.67800000000000005}]},{"osd":1,"last update":"Fri Sep 13 06:44:20 2024","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.64000000000000001,"15min":0.62},"min":{"1min":0.25,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":1.0329999999999999,"5min":3.4649999999999999,"15min":3.4649999999999999},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.66600000000000004,"15min":0.60299999999999998},"min":{"1min":0.34300000000000003,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":1.5049999999999999,"5min":3.8159999999999998,"15min":3.8159999999999998},"last":0.97799999999999998}]},{"osd":3,"last update":"Fri Sep 13 06:44:20 2024","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.65000000000000002,"15min":0.58599999999999997},"min":{"1min":0.36399999999999999,"5min":0.249,"15min":0.249},"max":{"1min":1.044,"5min":3.407,"15min":3.407},"last":0.755},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.73599999999999999,"15min":0.68600000000000005},"min":{"1min":0.312,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.238,"5min":3.2639999999999998,"15min":3.2639999999999998},"last":0.63900000000000001}]},{"osd":4,"last update":"Fri Sep 13 06:44:20 2024","interfaces":[{"interface":"back","average":{"1min":0.83299999999999996,"5min":0.878,"15min":0.88500000000000001},"min":{"1min":0.45600000000000002,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.3759999999999999,"5min":3.1179999999999999,"15min":3.1179999999999999},"last":0.83699999999999997},{"interface":"front","average":{"1min":0.81399999999999995,"5min":1.0620000000000001,"15min":0.94099999999999995},"min":{"1min":0.46800000000000003,"5min":0.439,"15min":0.439},"max":{"1min":1.359,"5min":21.081,"15min":21.081},"last":0.873}]},{"osd":5,"last update":"Fri Sep 13 06:44:20 2024","interfaces":[{"interface":"back","average":{"1min":0.82999999999999996,"5min":0.84799999999999998,"15min":0.84299999999999997},"min":{"1min":0.60099999999999998,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":1.143,"5min":2.2389999999999999,"15min":2.2389999999999999},"last":0.91200000000000003},{"interface":"front","average":{"1min":1.133,"5min":0.96099999999999997,"15min":0.88900000000000001},"min":{"1min":0.54400000000000004,"5min":0.377,"15min":0.377},"max":{"1min":4.9039999999999999,"5min":4.9039999999999999,"15min":4.9039999999999999},"last":0.93799999999999994}]},{"osd":6,"last update":"Fri Sep 13 06:42:15 2024","interfaces":[{"interface":"back","average":{"1min":0.86799999999999999,"5min":0.94199999999999995,"15min":0.92600000000000005},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.274,"5min":3.923,"15min":3.923},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.97799999999999998,"5min":0.90500000000000003,"15min":0.879},"min":{"1min":0.60899999999999999,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":2.2080000000000002,"5min":2.2120000000000002,"15min":2.2120000000000002},"last":1.1060000000000001}]},{"osd":7,"last update":"Fri Sep 13 06:44:33 2024","interfaces":[{"interface":"back","average":{"1min":0.95799999999999996,"5min":0.86499999999999999,"15min":0.84899999999999998},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":1.641,"5min":1.641,"15min":1.641},"last":1.032},{"interface":"front","average":{"1min":1.05,"5min":0.88600000000000001,"15min":0.85799999999999998},"min":{"1min":0.71499999999999997,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":2.0630000000000002,"5min":2.0630000000000002,"15min":2.0630000000000002},"last":1.157}]}]},{"osd":1,"up_from":13,"seq":55834574917,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52768,"kb_used_data":3600,"kb_used_omap":1,"kb_used_meta":49150,"kb_avail":94319072,"statfs":{"total":96636764160,"available":96582729728,"internally_reserved":0,"allocated":3686400,"data_stored":1844909,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":50330054},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 06:44:21 2024","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.55300000000000005,"15min":0.57299999999999995},"min":{"1min":0.246,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":1.1879999999999999,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.64200000000000002,"15min":0.65900000000000003},"min":{"1min":0.26200000000000001,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.99199999999999999,"5min":1.8160000000000001,"15min":1.8160000000000001},"last":0.77600000000000002}]},{"osd":2,"last update":"Fri Sep 13 06:44:21 2024","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.60699999999999998,"15min":0.63400000000000001},"min":{"1min":0.26800000000000002,"5min":0.22,"15min":0.22},"max":{"1min":0.92200000000000004,"5min":2.617,"15min":2.617},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.65300000000000002,"15min":0.65400000000000003},"min":{"1min":0.28499999999999998,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":1.331,"5min":2.5249999999999999,"15min":2.5249999999999999},"last":0.84299999999999997}]},{"osd":3,"last update":"Fri Sep 13 06:44:21 2024","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.70499999999999996,"15min":0.72599999999999998},"min":{"1min":0.33900000000000002,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":1.2769999999999999,"5min":1.3640000000000001,"15min":1.3640000000000001},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.66700000000000004,"15min":0.69099999999999995},"min":{"1min":0.30399999999999999,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":1.028,"5min":1.752,"15min":1.752},"last":0.68200000000000005}]},{"osd":4,"last update":"Fri Sep 13 06:44:21 2024","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.79800000000000004,"15min":0.81999999999999995},"min":{"1min":0.60899999999999999,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":1.109,"5min":2.7389999999999999,"15min":2.7389999999999999},"last":0.878},{"interface":"front","average":{"1min":0.94499999999999995,"5min":0.85499999999999998,"15min":0.90600000000000003},"min":{"1min":0.40000000000000002,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.4159999999999999,"5min":1.4359999999999999,"15min":1.4359999999999999},"last":1.046}]},{"osd":5,"last update":"Fri Sep 13 06:44:21 2024","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.84499999999999997,"15min":0.90600000000000003},"min":{"1min":0.58099999999999996,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.1399999999999999,"5min":1.7849999999999999,"15min":1.7849999999999999},"last":1.0129999999999999},{"interface":"front","average":{"1min":0.89600000000000002,"5min":0.86599999999999999,"15min":0.879},"min":{"1min":0.495,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":1.202,"5min":2.036,"15min":2.036},"last":0.93700000000000006}]},{"osd":6,"last update":"Fri Sep 13 06:42:18 2024","interfaces":[{"interface":"back","average":{"1min":0.87,"5min":0.92200000000000004,"15min":0.94399999999999995},"min":{"1min":0.57699999999999996,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.526,"5min":1.8149999999999999,"15min":1.8149999999999999},"last":0.89600000000000002},{"interface":"front","average":{"1min":0.88900000000000001,"5min":0.91200000000000003,"15min":0.91900000000000004},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":2.7810000000000001,"5min":2.7810000000000001,"15min":2.7810000000000001},"last":1.0840000000000001}]},{"osd":7,"last update":"Fri Sep 13 06:44:33 2024","interfaces":[{"interface":"back","average":{"1min":0.91900000000000004,"5min":0.90600000000000003,"15min":0.90400000000000003},"min":{"1min":0.621,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":1.3220000000000001,"5min":1.605,"15min":1.605},"last":0.81399999999999995},{"interface":"front","average":{"1min":1.054,"5min":0.93899999999999995,"15min":0.92000000000000004},"min":{"1min":0.61099999999999999,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.5009999999999999,"5min":1.5009999999999999,"15min":1.5009999999999999},"last":0.97199999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574916,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":85336,"kb_used_data":4172,"kb_used_omap":1,"kb_used_meta":81150,"kb_avail":94286504,"statfs":{"total":96636764160,"available":96549380096,"internally_reserved":0,"allocated":4272128,"data_stored":2435239,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":83098054},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 06:44:11 2024","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.54900000000000004,"15min":0.53000000000000003},"min":{"1min":0.23999999999999999,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":1.048,"5min":1.2270000000000001,"15min":1.2270000000000001},"last":0.751},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.56000000000000005,"15min":0.54000000000000004},"min":{"1min":0.28799999999999998,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":1.137,"5min":1.222,"15min":1.222},"last":0.60299999999999998}]},{"osd":2,"last update":"Fri Sep 13 06:44:11 2024","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.60399999999999998,"15min":0.55600000000000005},"min":{"1min":0.27300000000000002,"5min":0.217,"15min":0.217},"max":{"1min":1.2549999999999999,"5min":1.839,"15min":1.839},"last":0.83999999999999997},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.61299999999999999,"15min":0.57499999999999996},"min":{"1min":0.35399999999999998,"5min":0.245,"15min":0.245},"max":{"1min":1.419,"5min":1.419,"15min":1.419},"last":0.79700000000000004}]},{"osd":3,"last update":"Fri Sep 13 06:44:11 2024","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.59999999999999998,"15min":0.55800000000000005},"min":{"1min":0.371,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":1.2250000000000001,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.74299999999999999,"15min":0.69899999999999995},"min":{"1min":0.36699999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":1.175,"5min":4.9630000000000001,"15min":4.9630000000000001},"last":1.004}]},{"osd":4,"last update":"Fri Sep 13 06:44:11 2024","interfaces":[{"interface":"back","average":{"1min":0.89400000000000002,"5min":0.80400000000000005,"15min":0.79400000000000004},"min":{"1min":0.57899999999999996,"5min":0.311,"15min":0.311},"max":{"1min":1.6259999999999999,"5min":1.6259999999999999,"15min":1.6259999999999999},"last":0.89000000000000001},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.77400000000000002,"15min":0.79600000000000004},"min":{"1min":0.58999999999999997,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.1799999999999999,"5min":1.6319999999999999,"15min":1.6319999999999999},"last":0.92300000000000004}]},{"osd":5,"last update":"Fri Sep 13 06:44:11 2024","interfaces":[{"interface":"back","average":{"1min":0.89900000000000002,"5min":0.85799999999999998,"15min":0.85199999999999998},"min":{"1min":0.52800000000000002,"5min":0.378,"15min":0.378},"max":{"1min":1.575,"5min":1.575,"15min":1.575},"last":1.0600000000000001},{"interface":"front","average":{"1min":0.89100000000000001,"5min":0.85699999999999998,"15min":0.87},"min":{"1min":0.60199999999999998,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.327,"5min":1.5740000000000001,"15min":1.5740000000000001},"last":1.075}]},{"osd":6,"last update":"Fri Sep 13 06:42:11 2024","interfaces":[{"interface":"back","average":{"1min":0.89800000000000002,"5min":0.91200000000000003,"15min":0.93100000000000005},"min":{"1min":0.55300000000000005,"5min":0.499,"15min":0.499},"max":{"1min":1.571,"5min":2.4969999999999999,"15min":2.4969999999999999},"last":1.1479999999999999},{"interface":"front","average":{"1min":0.878,"5min":0.89600000000000002,"15min":0.90600000000000003},"min":{"1min":0.51800000000000002,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.208,"5min":2.0419999999999998,"15min":2.0419999999999998},"last":0.96899999999999997}]},{"osd":7,"last update":"Fri Sep 13 06:44:31 2024","interfaces":[{"interface":"back","average":{"1min":0.97799999999999998,"5min":1.0529999999999999,"15min":1.0649999999999999},"min":{"1min":0.57799999999999996,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.381,"5min":1.9419999999999999,"15min":1.9419999999999999},"last":1.1040000000000001},{"interface":"front","average":{"1min":0.97899999999999998,"5min":0.96999999999999997,"15min":0.96799999999999997},"min":{"1min":0.64100000000000001,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.4750000000000001,"5min":1.901,"15min":1.901},"last":1.032}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6552,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8096,"internal_metadata":0}]}} 2024-09-13T06:44:37.541 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-13T06:44:37.867 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T06:44:37.867 INFO:teuthology.orchestra.run.smithi081.stdout:{"fsid":"e5612297-d004-4957-927e-afa37f30d6cf","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":341,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":305,"num_osds":8,"num_up_osds":8,"osd_up_since":1726209855,"num_in_osds":8,"osd_in_since":1726209857,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":41}],"num_pgs":41,"num_pools":3,"num_objects":7,"data_bytes":590406,"bytes_used":498180096,"bytes_avail":772595933184,"bytes_total":773094113280},"fsmap":{"epoch":1,"by_rank":[],"up:standby":0},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":5,"modified":"2024-09-13T06:44:31.607686+0000","services":{"osd":{"daemons":{"summary":"","6":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-13T06:44:37.885 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-13T06:44:37.885 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T06:44:38.166 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T06:44:38.167 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-09-13T06:44:38.182 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":462,"stamp":"2024-09-13T06:44:37.609583+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590406,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":237398,"num_read_kb":1402962,"num_write":33483,"num_write_kb":1011328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9257,"num_bytes_recovered":444809309,"num_keys_recovered":867,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":24606,"ondisk_log_size":24606,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":486504,"kb_used_data":30012,"kb_used_omap":26,"kb_used_meta":456357,"kb_avail":754488216,"statfs":{"total":773094113280,"available":772595933184,"internally_reserved":0,"allocated":30732288,"data_stored":15982962,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":27392,"internal_metadata":467309824},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":-152,"num_bytes_recovered":-19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.818452"},"pg_stats":[{"pgid":"3.1f","version":"280'781","reported_seq":6286,"reported_epoch":302,"state":"active+clean","last_fresh":"2024-09-13T06:44:31.794290+0000","last_change":"2024-09-13T06:44:05.445184+0000","last_active":"2024-09-13T06:44:31.794290+0000","last_peered":"2024-09-13T06:44:31.794290+0000","last_clean":"2024-09-13T06:44:31.794290+0000","last_became_active":"2024-09-13T06:40:57.385213+0000","last_became_peered":"2024-09-13T06:40:57.385213+0000","last_unstale":"2024-09-13T06:44:31.794290+0000","last_undegraded":"2024-09-13T06:44:31.794290+0000","last_fullsized":"2024-09-13T06:44:31.794290+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":781,"log_dups_size":0,"ondisk_log_size":781,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:46:17.100560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00056495999999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6518,"num_read_kb":34199,"num_write":1043,"num_write_kb":37100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":72,"num_bytes_recovered":6114482,"num_keys_recovered":44,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"271'1110","reported_seq":7421,"reported_epoch":303,"state":"active+clean","last_fresh":"2024-09-13T06:44:32.807368+0000","last_change":"2024-09-13T06:44:20.462945+0000","last_active":"2024-09-13T06:44:32.807368+0000","last_peered":"2024-09-13T06:44:32.807368+0000","last_clean":"2024-09-13T06:44:32.807368+0000","last_became_active":"2024-09-13T06:44:20.460702+0000","last_became_peered":"2024-09-13T06:44:20.460702+0000","last_unstale":"2024-09-13T06:44:32.807368+0000","last_undegraded":"2024-09-13T06:44:32.807368+0000","last_fullsized":"2024-09-13T06:44:32.807368+0000","mapping_epoch":290,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":291,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":1110,"log_dups_size":0,"ondisk_log_size":1110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:02:22.560348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013343369999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8806,"num_read_kb":55237,"num_write":1632,"num_write_kb":29160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":491,"num_bytes_recovered":16489974,"num_keys_recovered":55,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"279'1047","reported_seq":5655,"reported_epoch":302,"state":"active+clean","last_fresh":"2024-09-13T06:44:31.833302+0000","last_change":"2024-09-13T06:44:30.808653+0000","last_active":"2024-09-13T06:44:31.833302+0000","last_peered":"2024-09-13T06:44:31.833302+0000","last_clean":"2024-09-13T06:44:31.833302+0000","last_became_active":"2024-09-13T06:44:30.803142+0000","last_became_peered":"2024-09-13T06:44:30.803142+0000","last_unstale":"2024-09-13T06:44:31.833302+0000","last_undegraded":"2024-09-13T06:44:31.833302+0000","last_fullsized":"2024-09-13T06:44:31.833302+0000","mapping_epoch":300,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":301,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":1047,"log_dups_size":0,"ondisk_log_size":1047,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:25:53.597990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00088262599999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6265,"num_read_kb":28067,"num_write":1605,"num_write_kb":33265,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":206,"num_bytes_recovered":8442088,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1c","version":"280'843","reported_seq":8394,"reported_epoch":302,"state":"active+clean","last_fresh":"2024-09-13T06:44:31.833265+0000","last_change":"2024-09-13T06:44:30.807782+0000","last_active":"2024-09-13T06:44:31.833265+0000","last_peered":"2024-09-13T06:44:31.833265+0000","last_clean":"2024-09-13T06:44:31.833265+0000","last_became_active":"2024-09-13T06:44:30.801783+0000","last_became_peered":"2024-09-13T06:44:30.801783+0000","last_unstale":"2024-09-13T06:44:31.833265+0000","last_undegraded":"2024-09-13T06:44:31.833265+0000","last_fullsized":"2024-09-13T06:44:31.833265+0000","mapping_epoch":300,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":301,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":843,"log_dups_size":0,"ondisk_log_size":843,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:54:20.743708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001581236,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9390,"num_read_kb":69964,"num_write":963,"num_write_kb":31840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":350,"num_bytes_recovered":42380134,"num_keys_recovered":286,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"277'852","reported_seq":5169,"reported_epoch":302,"state":"active+clean","last_fresh":"2024-09-13T06:44:31.794146+0000","last_change":"2024-09-13T06:44:05.444712+0000","last_active":"2024-09-13T06:44:31.794146+0000","last_peered":"2024-09-13T06:44:31.794146+0000","last_clean":"2024-09-13T06:44:31.794146+0000","last_became_active":"2024-09-13T06:43:31.415608+0000","last_became_peered":"2024-09-13T06:43:31.415608+0000","last_unstale":"2024-09-13T06:44:31.794146+0000","last_undegraded":"2024-09-13T06:44:31.794146+0000","last_fullsized":"2024-09-13T06:44:31.794146+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":852,"log_dups_size":0,"ondisk_log_size":852,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:39:01.416782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060857399999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5714,"num_read_kb":37037,"num_write":1079,"num_write_kb":33376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":295,"num_bytes_recovered":25415745,"num_keys_recovered":55,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"277'497","reported_seq":7756,"reported_epoch":303,"state":"active+clean","last_fresh":"2024-09-13T06:44:33.194019+0000","last_change":"2024-09-13T06:44:20.469801+0000","last_active":"2024-09-13T06:44:33.194019+0000","last_peered":"2024-09-13T06:44:33.194019+0000","last_clean":"2024-09-13T06:44:33.194019+0000","last_became_active":"2024-09-13T06:44:20.462185+0000","last_became_peered":"2024-09-13T06:44:20.462185+0000","last_unstale":"2024-09-13T06:44:33.194019+0000","last_undegraded":"2024-09-13T06:44:33.194019+0000","last_fullsized":"2024-09-13T06:44:33.194019+0000","mapping_epoch":290,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":291,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":497,"log_dups_size":0,"ondisk_log_size":497,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:55:41.801680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00078923399999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6439,"num_read_kb":42977,"num_write":667,"num_write_kb":32420,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":728,"num_bytes_recovered":12986751,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"275'680","reported_seq":8569,"reported_epoch":303,"state":"active+clean","last_fresh":"2024-09-13T06:44:33.193202+0000","last_change":"2024-09-13T06:44:21.446173+0000","last_active":"2024-09-13T06:44:33.193202+0000","last_peered":"2024-09-13T06:44:33.193202+0000","last_clean":"2024-09-13T06:44:33.193202+0000","last_became_active":"2024-09-13T06:44:21.442872+0000","last_became_peered":"2024-09-13T06:44:21.442872+0000","last_unstale":"2024-09-13T06:44:33.193202+0000","last_undegraded":"2024-09-13T06:44:33.193202+0000","last_fullsized":"2024-09-13T06:44:33.193202+0000","mapping_epoch":291,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":292,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":680,"log_dups_size":0,"ondisk_log_size":680,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:11:12.949824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00079955100000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8400,"num_read_kb":35906,"num_write":738,"num_write_kb":28560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":398,"num_bytes_recovered":17539742,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"272'684","reported_seq":7045,"reported_epoch":303,"state":"active+clean","last_fresh":"2024-09-13T06:44:32.807518+0000","last_change":"2024-09-13T06:44:05.439754+0000","last_active":"2024-09-13T06:44:32.807518+0000","last_peered":"2024-09-13T06:44:32.807518+0000","last_clean":"2024-09-13T06:44:32.807518+0000","last_became_active":"2024-09-13T06:41:14.395301+0000","last_became_peered":"2024-09-13T06:41:14.395301+0000","last_unstale":"2024-09-13T06:44:32.807518+0000","last_undegraded":"2024-09-13T06:44:32.807518+0000","last_fullsized":"2024-09-13T06:44:32.807518+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":684,"log_dups_size":0,"ondisk_log_size":684,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:10:49.528345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00092758900000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6571,"num_read_kb":55194,"num_write":838,"num_write_kb":38872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":117,"num_bytes_recovered":13142180,"num_keys_recovered":22,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"275'1525","reported_seq":5959,"reported_epoch":302,"state":"active+clean","last_fresh":"2024-09-13T06:44:31.794327+0000","last_change":"2024-09-13T06:44:05.444913+0000","last_active":"2024-09-13T06:44:31.794327+0000","last_peered":"2024-09-13T06:44:31.794327+0000","last_clean":"2024-09-13T06:44:31.794327+0000","last_became_active":"2024-09-13T06:43:22.521039+0000","last_became_peered":"2024-09-13T06:43:22.521039+0000","last_unstale":"2024-09-13T06:44:31.794327+0000","last_undegraded":"2024-09-13T06:44:31.794327+0000","last_fullsized":"2024-09-13T06:44:31.794327+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":1525,"log_dups_size":0,"ondisk_log_size":1525,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:58:28.305131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00029931499999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9655,"num_read_kb":41824,"num_write":2232,"num_write_kb":32733,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":112,"num_bytes_recovered":14950263,"num_keys_recovered":22,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"275'715","reported_seq":5275,"reported_epoch":302,"state":"active+clean","last_fresh":"2024-09-13T06:44:31.833554+0000","last_change":"2024-09-13T06:44:30.806149+0000","last_active":"2024-09-13T06:44:31.833554+0000","last_peered":"2024-09-13T06:44:31.833554+0000","last_clean":"2024-09-13T06:44:31.833554+0000","last_became_active":"2024-09-13T06:44:30.798028+0000","last_became_peered":"2024-09-13T06:44:30.798028+0000","last_unstale":"2024-09-13T06:44:31.833554+0000","last_undegraded":"2024-09-13T06:44:31.833554+0000","last_fullsized":"2024-09-13T06:44:31.833554+0000","mapping_epoch":300,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":301,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":715,"log_dups_size":0,"ondisk_log_size":715,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:09:18.289368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0024960030000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5101,"num_read_kb":28279,"num_write":1028,"num_write_kb":23183,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":197,"num_bytes_recovered":7394092,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"277'365","reported_seq":6173,"reported_epoch":303,"state":"active+clean","last_fresh":"2024-09-13T06:44:32.805429+0000","last_change":"2024-09-13T06:44:05.457231+0000","last_active":"2024-09-13T06:44:32.805429+0000","last_peered":"2024-09-13T06:44:32.805429+0000","last_clean":"2024-09-13T06:44:32.805429+0000","last_became_active":"2024-09-13T06:42:33.408009+0000","last_became_peered":"2024-09-13T06:42:33.408009+0000","last_unstale":"2024-09-13T06:44:32.805429+0000","last_undegraded":"2024-09-13T06:44:32.805429+0000","last_fullsized":"2024-09-13T06:44:32.805429+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":365,"log_dups_size":0,"ondisk_log_size":365,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:09:11.995853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0024654690000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5036,"num_read_kb":48021,"num_write":472,"num_write_kb":27276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":157,"num_bytes_recovered":13242563,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"280'579","reported_seq":9959,"reported_epoch":303,"state":"active+clean","last_fresh":"2024-09-13T06:44:33.194074+0000","last_change":"2024-09-13T06:44:05.443324+0000","last_active":"2024-09-13T06:44:33.194074+0000","last_peered":"2024-09-13T06:44:33.194074+0000","last_clean":"2024-09-13T06:44:33.194074+0000","last_became_active":"2024-09-13T06:44:03.438897+0000","last_became_peered":"2024-09-13T06:44:03.438897+0000","last_unstale":"2024-09-13T06:44:33.194074+0000","last_undegraded":"2024-09-13T06:44:33.194074+0000","last_fullsized":"2024-09-13T06:44:33.194074+0000","mapping_epoch":277,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":278,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":579,"log_dups_size":0,"ondisk_log_size":579,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:24:55.053861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012901029999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8875,"num_read_kb":61758,"num_write":769,"num_write_kb":30278,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":506,"num_bytes_recovered":26184965,"num_keys_recovered":33,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":27,"reported_epoch":304,"state":"active+clean","last_fresh":"2024-09-13T06:44:33.832029+0000","last_change":"2024-09-13T06:44:16.450557+0000","last_active":"2024-09-13T06:44:33.832029+0000","last_peered":"2024-09-13T06:44:33.832029+0000","last_clean":"2024-09-13T06:44:33.832029+0000","last_became_active":"2024-09-13T06:44:16.449558+0000","last_became_peered":"2024-09-13T06:44:16.449558+0000","last_unstale":"2024-09-13T06:44:33.832029+0000","last_undegraded":"2024-09-13T06:44:33.832029+0000","last_fullsized":"2024-09-13T06:44:33.832029+0000","mapping_epoch":286,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":287,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_clean_scrub_stamp":"2024-09-13T06:39:16.508974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:01:20.779972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00080324699999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"280'643","reported_seq":10759,"reported_epoch":302,"state":"active+clean","last_fresh":"2024-09-13T06:44:31.794269+0000","last_change":"2024-09-13T06:44:22.454207+0000","last_active":"2024-09-13T06:44:31.794269+0000","last_peered":"2024-09-13T06:44:31.794269+0000","last_clean":"2024-09-13T06:44:31.794269+0000","last_became_active":"2024-09-13T06:44:22.449195+0000","last_became_peered":"2024-09-13T06:44:22.449195+0000","last_unstale":"2024-09-13T06:44:31.794269+0000","last_undegraded":"2024-09-13T06:44:31.794269+0000","last_fullsized":"2024-09-13T06:44:31.794269+0000","mapping_epoch":292,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":293,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":643,"log_dups_size":0,"ondisk_log_size":643,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:28:58.479641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00080400600000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9397,"num_read_kb":51433,"num_write":883,"num_write_kb":40908,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":358,"num_bytes_recovered":1257624,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":23,"reported_epoch":303,"state":"active+clean","last_fresh":"2024-09-13T06:44:33.193409+0000","last_change":"2024-09-13T06:44:18.458951+0000","last_active":"2024-09-13T06:44:33.193409+0000","last_peered":"2024-09-13T06:44:33.193409+0000","last_clean":"2024-09-13T06:44:33.193409+0000","last_became_active":"2024-09-13T06:44:18.458454+0000","last_became_peered":"2024-09-13T06:44:18.458454+0000","last_unstale":"2024-09-13T06:44:33.193409+0000","last_undegraded":"2024-09-13T06:44:33.193409+0000","last_fullsized":"2024-09-13T06:44:33.193409+0000","mapping_epoch":288,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":289,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_clean_scrub_stamp":"2024-09-13T06:39:16.508974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:06:07.380573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00097079800000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"277'694","reported_seq":7059,"reported_epoch":303,"state":"active+clean","last_fresh":"2024-09-13T06:44:32.807955+0000","last_change":"2024-09-13T06:44:05.440674+0000","last_active":"2024-09-13T06:44:32.807955+0000","last_peered":"2024-09-13T06:44:32.807955+0000","last_clean":"2024-09-13T06:44:32.807955+0000","last_became_active":"2024-09-13T06:42:32.413006+0000","last_became_peered":"2024-09-13T06:42:32.413006+0000","last_unstale":"2024-09-13T06:44:32.807955+0000","last_undegraded":"2024-09-13T06:44:32.807955+0000","last_fullsized":"2024-09-13T06:44:32.807955+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":694,"log_dups_size":0,"ondisk_log_size":694,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:38:01.774494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001338379,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6521,"num_read_kb":33119,"num_write":812,"num_write_kb":30039,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":213,"num_bytes_recovered":15100645,"num_keys_recovered":11,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":181,"reported_epoch":305,"state":"active+clean","last_fresh":"2024-09-13T06:44:34.866142+0000","last_change":"2024-09-13T06:42:28.563276+0000","last_active":"2024-09-13T06:44:34.866142+0000","last_peered":"2024-09-13T06:44:34.866142+0000","last_clean":"2024-09-13T06:44:34.866142+0000","last_became_active":"2024-09-13T06:42:28.562827+0000","last_became_peered":"2024-09-13T06:42:28.562827+0000","last_unstale":"2024-09-13T06:44:34.866142+0000","last_undegraded":"2024-09-13T06:44:34.866142+0000","last_fullsized":"2024-09-13T06:44:34.866142+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_clean_scrub_stamp":"2024-09-13T06:39:16.508974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:10:47.285603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"277'961","reported_seq":6890,"reported_epoch":303,"state":"active+clean","last_fresh":"2024-09-13T06:44:33.193159+0000","last_change":"2024-09-13T06:44:22.455582+0000","last_active":"2024-09-13T06:44:33.193159+0000","last_peered":"2024-09-13T06:44:33.193159+0000","last_clean":"2024-09-13T06:44:33.193159+0000","last_became_active":"2024-09-13T06:44:22.450933+0000","last_became_peered":"2024-09-13T06:44:22.450933+0000","last_unstale":"2024-09-13T06:44:33.193159+0000","last_undegraded":"2024-09-13T06:44:33.193159+0000","last_fullsized":"2024-09-13T06:44:33.193159+0000","mapping_epoch":292,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":293,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":961,"log_dups_size":0,"ondisk_log_size":961,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:30:26.327840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0031147280000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7705,"num_read_kb":38648,"num_write":1332,"num_write_kb":32653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":354,"num_bytes_recovered":6765835,"num_keys_recovered":11,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":23,"reported_epoch":303,"state":"active+clean","last_fresh":"2024-09-13T06:44:33.193244+0000","last_change":"2024-09-13T06:44:18.468145+0000","last_active":"2024-09-13T06:44:33.193244+0000","last_peered":"2024-09-13T06:44:33.193244+0000","last_clean":"2024-09-13T06:44:33.193244+0000","last_became_active":"2024-09-13T06:44:18.467833+0000","last_became_peered":"2024-09-13T06:44:18.467833+0000","last_unstale":"2024-09-13T06:44:33.193244+0000","last_undegraded":"2024-09-13T06:44:33.193244+0000","last_fullsized":"2024-09-13T06:44:33.193244+0000","mapping_epoch":288,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":289,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_clean_scrub_stamp":"2024-09-13T06:39:16.508974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:33:56.156376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"277'640","reported_seq":7754,"reported_epoch":302,"state":"active+clean","last_fresh":"2024-09-13T06:44:31.833497+0000","last_change":"2024-09-13T06:44:30.803125+0000","last_active":"2024-09-13T06:44:31.833497+0000","last_peered":"2024-09-13T06:44:31.833497+0000","last_clean":"2024-09-13T06:44:31.833497+0000","last_became_active":"2024-09-13T06:44:30.797769+0000","last_became_peered":"2024-09-13T06:44:30.797769+0000","last_unstale":"2024-09-13T06:44:31.833497+0000","last_undegraded":"2024-09-13T06:44:31.833497+0000","last_fullsized":"2024-09-13T06:44:31.833497+0000","mapping_epoch":300,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":301,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":640,"log_dups_size":0,"ondisk_log_size":640,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:49:47.340041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0046689339999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7611,"num_read_kb":41345,"num_write":1018,"num_write_kb":26620,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":158,"num_bytes_recovered":4212424,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"280'991","reported_seq":21073,"reported_epoch":303,"state":"active+clean","last_fresh":"2024-09-13T06:44:33.193970+0000","last_change":"2024-09-13T06:44:28.773729+0000","last_active":"2024-09-13T06:44:33.193970+0000","last_peered":"2024-09-13T06:44:33.193970+0000","last_clean":"2024-09-13T06:44:33.193970+0000","last_became_active":"2024-09-13T06:44:28.768976+0000","last_became_peered":"2024-09-13T06:44:28.768976+0000","last_unstale":"2024-09-13T06:44:33.193970+0000","last_undegraded":"2024-09-13T06:44:33.193970+0000","last_fullsized":"2024-09-13T06:44:33.193970+0000","mapping_epoch":298,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":299,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":991,"log_dups_size":0,"ondisk_log_size":991,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:30:21.817297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0017436419999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20994,"num_read_kb":92583,"num_write":1315,"num_write_kb":30385,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":207,"num_bytes_recovered":9898606,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"20'2","reported_seq":124,"reported_epoch":302,"state":"active+clean","last_fresh":"2024-09-13T06:44:31.833267+0000","last_change":"2024-09-13T06:44:30.794941+0000","last_active":"2024-09-13T06:44:31.833267+0000","last_peered":"2024-09-13T06:44:31.833267+0000","last_clean":"2024-09-13T06:44:31.833267+0000","last_became_active":"2024-09-13T06:44:30.794134+0000","last_became_peered":"2024-09-13T06:44:30.794134+0000","last_unstale":"2024-09-13T06:44:31.833267+0000","last_undegraded":"2024-09-13T06:44:31.833267+0000","last_fullsized":"2024-09-13T06:44:31.833267+0000","mapping_epoch":300,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":301,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_clean_scrub_stamp":"2024-09-13T06:39:16.508974+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:36:10.351897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":57,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"278'857","reported_seq":10771,"reported_epoch":303,"state":"active+clean","last_fresh":"2024-09-13T06:44:33.193137+0000","last_change":"2024-09-13T06:44:21.445836+0000","last_active":"2024-09-13T06:44:33.193137+0000","last_peered":"2024-09-13T06:44:33.193137+0000","last_clean":"2024-09-13T06:44:33.193137+0000","last_became_active":"2024-09-13T06:44:21.442847+0000","last_became_peered":"2024-09-13T06:44:21.442847+0000","last_unstale":"2024-09-13T06:44:33.193137+0000","last_undegraded":"2024-09-13T06:44:33.193137+0000","last_fullsized":"2024-09-13T06:44:33.193137+0000","mapping_epoch":291,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":292,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":857,"log_dups_size":0,"ondisk_log_size":857,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:42:10.542267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00053211199999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11278,"num_read_kb":63107,"num_write":1190,"num_write_kb":36968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":351,"num_bytes_recovered":9847094,"num_keys_recovered":11,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":25,"reported_epoch":303,"state":"active+clean","last_fresh":"2024-09-13T06:44:33.193124+0000","last_change":"2024-09-13T06:44:17.443833+0000","last_active":"2024-09-13T06:44:33.193124+0000","last_peered":"2024-09-13T06:44:33.193124+0000","last_clean":"2024-09-13T06:44:33.193124+0000","last_became_active":"2024-09-13T06:44:17.443358+0000","last_became_peered":"2024-09-13T06:44:17.443358+0000","last_unstale":"2024-09-13T06:44:33.193124+0000","last_undegraded":"2024-09-13T06:44:33.193124+0000","last_fullsized":"2024-09-13T06:44:33.193124+0000","mapping_epoch":287,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":288,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_clean_scrub_stamp":"2024-09-13T06:39:16.508974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:30:37.013428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00033592499999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"277'1115","reported_seq":6257,"reported_epoch":302,"state":"active+clean","last_fresh":"2024-09-13T06:44:31.793979+0000","last_change":"2024-09-13T06:44:30.799789+0000","last_active":"2024-09-13T06:44:31.793979+0000","last_peered":"2024-09-13T06:44:31.793979+0000","last_clean":"2024-09-13T06:44:31.793979+0000","last_became_active":"2024-09-13T06:44:30.798508+0000","last_became_peered":"2024-09-13T06:44:30.798508+0000","last_unstale":"2024-09-13T06:44:31.793979+0000","last_undegraded":"2024-09-13T06:44:31.793979+0000","last_fullsized":"2024-09-13T06:44:31.793979+0000","mapping_epoch":300,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":301,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":1115,"log_dups_size":0,"ondisk_log_size":1115,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:04:47.174299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0032283849999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7964,"num_read_kb":36198,"num_write":1645,"num_write_kb":33105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":243,"num_bytes_recovered":7863454,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":197,"reported_epoch":303,"state":"active+clean","last_fresh":"2024-09-13T06:44:32.805107+0000","last_change":"2024-09-13T06:44:18.457601+0000","last_active":"2024-09-13T06:44:32.805107+0000","last_peered":"2024-09-13T06:44:32.805107+0000","last_clean":"2024-09-13T06:44:32.805107+0000","last_became_active":"2024-09-13T06:44:18.456828+0000","last_became_peered":"2024-09-13T06:44:18.456828+0000","last_unstale":"2024-09-13T06:44:32.805107+0000","last_undegraded":"2024-09-13T06:44:32.805107+0000","last_fullsized":"2024-09-13T06:44:32.805107+0000","mapping_epoch":288,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":289,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_clean_scrub_stamp":"2024-09-13T06:39:16.508974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:17:09.082426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"279'349","reported_seq":3762,"reported_epoch":303,"state":"active+clean","last_fresh":"2024-09-13T06:44:32.807410+0000","last_change":"2024-09-13T06:44:05.440371+0000","last_active":"2024-09-13T06:44:32.807410+0000","last_peered":"2024-09-13T06:44:32.807410+0000","last_clean":"2024-09-13T06:44:32.807410+0000","last_became_active":"2024-09-13T06:41:15.399301+0000","last_became_peered":"2024-09-13T06:41:15.399301+0000","last_unstale":"2024-09-13T06:44:32.807410+0000","last_undegraded":"2024-09-13T06:44:32.807410+0000","last_fullsized":"2024-09-13T06:44:32.807410+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":349,"log_dups_size":0,"ondisk_log_size":349,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:53:18.137873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001343293,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2523,"num_read_kb":19829,"num_write":427,"num_write_kb":20943,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":169,"num_bytes_recovered":5233325,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"18'1","reported_seq":55,"reported_epoch":302,"state":"active+clean","last_fresh":"2024-09-13T06:44:31.833265+0000","last_change":"2024-09-13T06:44:30.798045+0000","last_active":"2024-09-13T06:44:31.833265+0000","last_peered":"2024-09-13T06:44:31.833265+0000","last_clean":"2024-09-13T06:44:31.833265+0000","last_became_active":"2024-09-13T06:44:30.796877+0000","last_became_peered":"2024-09-13T06:44:30.796877+0000","last_unstale":"2024-09-13T06:44:31.833265+0000","last_undegraded":"2024-09-13T06:44:31.833265+0000","last_fullsized":"2024-09-13T06:44:31.833265+0000","mapping_epoch":300,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":301,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_clean_scrub_stamp":"2024-09-13T06:39:16.508974+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:33:04.298167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":397,"reported_epoch":303,"state":"active+clean","last_fresh":"2024-09-13T06:44:32.805140+0000","last_change":"2024-09-13T06:42:28.563168+0000","last_active":"2024-09-13T06:44:32.805140+0000","last_peered":"2024-09-13T06:44:32.805140+0000","last_clean":"2024-09-13T06:44:32.805140+0000","last_became_active":"2024-09-13T06:42:28.562642+0000","last_became_peered":"2024-09-13T06:42:28.562642+0000","last_unstale":"2024-09-13T06:44:32.805140+0000","last_undegraded":"2024-09-13T06:44:32.805140+0000","last_fullsized":"2024-09-13T06:44:32.805140+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:10.110558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:10.110558+0000","last_clean_scrub_stamp":"2024-09-13T06:39:10.110558+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:05:54.866043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"277'651","reported_seq":10850,"reported_epoch":303,"state":"active+clean","last_fresh":"2024-09-13T06:44:32.807285+0000","last_change":"2024-09-13T06:44:22.452634+0000","last_active":"2024-09-13T06:44:32.807285+0000","last_peered":"2024-09-13T06:44:32.807285+0000","last_clean":"2024-09-13T06:44:32.807285+0000","last_became_active":"2024-09-13T06:44:22.448736+0000","last_became_peered":"2024-09-13T06:44:22.448736+0000","last_unstale":"2024-09-13T06:44:32.807285+0000","last_undegraded":"2024-09-13T06:44:32.807285+0000","last_fullsized":"2024-09-13T06:44:32.807285+0000","mapping_epoch":292,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":293,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":651,"log_dups_size":0,"ondisk_log_size":651,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:58:40.103969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00083432600000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9552,"num_read_kb":46146,"num_write":828,"num_write_kb":32512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":446,"num_bytes_recovered":11977587,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"277'774","reported_seq":10943,"reported_epoch":303,"state":"active+clean","last_fresh":"2024-09-13T06:44:33.192916+0000","last_change":"2024-09-13T06:44:20.466493+0000","last_active":"2024-09-13T06:44:33.192916+0000","last_peered":"2024-09-13T06:44:33.192916+0000","last_clean":"2024-09-13T06:44:33.192916+0000","last_became_active":"2024-09-13T06:44:20.462849+0000","last_became_peered":"2024-09-13T06:44:20.462849+0000","last_unstale":"2024-09-13T06:44:33.192916+0000","last_undegraded":"2024-09-13T06:44:33.192916+0000","last_fullsized":"2024-09-13T06:44:33.192916+0000","mapping_epoch":290,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":291,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":774,"log_dups_size":0,"ondisk_log_size":774,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:40:44.119462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0024338839999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10729,"num_read_kb":51645,"num_write":931,"num_write_kb":34617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":445,"num_bytes_recovered":16579571,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"278'758","reported_seq":8282,"reported_epoch":305,"state":"active+clean","last_fresh":"2024-09-13T06:44:34.842308+0000","last_change":"2024-09-13T06:44:34.842308+0000","last_active":"2024-09-13T06:44:34.842308+0000","last_peered":"2024-09-13T06:44:34.842308+0000","last_clean":"2024-09-13T06:44:34.842308+0000","last_became_active":"2024-09-13T06:44:34.836417+0000","last_became_peered":"2024-09-13T06:44:34.836417+0000","last_unstale":"2024-09-13T06:44:34.842308+0000","last_undegraded":"2024-09-13T06:44:34.842308+0000","last_fullsized":"2024-09-13T06:44:34.842308+0000","mapping_epoch":304,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":305,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":758,"log_dups_size":0,"ondisk_log_size":758,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:44:55.089545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00085210600000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8422,"num_read_kb":47219,"num_write":883,"num_write_kb":28077,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":515,"num_bytes_recovered":28581300,"num_keys_recovered":111,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"271'845","reported_seq":5601,"reported_epoch":303,"state":"active+clean","last_fresh":"2024-09-13T06:44:32.807674+0000","last_change":"2024-09-13T06:44:05.439827+0000","last_active":"2024-09-13T06:44:32.807674+0000","last_peered":"2024-09-13T06:44:32.807674+0000","last_clean":"2024-09-13T06:44:32.807674+0000","last_became_active":"2024-09-13T06:41:15.399204+0000","last_became_peered":"2024-09-13T06:41:15.399204+0000","last_unstale":"2024-09-13T06:44:32.807674+0000","last_undegraded":"2024-09-13T06:44:32.807674+0000","last_fullsized":"2024-09-13T06:44:32.807674+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":845,"log_dups_size":0,"ondisk_log_size":845,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:27:03.298272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00094468700000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6686,"num_read_kb":57840,"num_write":1181,"num_write_kb":24665,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":117,"num_bytes_recovered":13256568,"num_keys_recovered":44,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"279'569","reported_seq":6602,"reported_epoch":302,"state":"active+clean","last_fresh":"2024-09-13T06:44:31.833489+0000","last_change":"2024-09-13T06:44:30.802655+0000","last_active":"2024-09-13T06:44:31.833489+0000","last_peered":"2024-09-13T06:44:31.833489+0000","last_clean":"2024-09-13T06:44:31.833489+0000","last_became_active":"2024-09-13T06:44:30.794873+0000","last_became_peered":"2024-09-13T06:44:30.794873+0000","last_unstale":"2024-09-13T06:44:31.833489+0000","last_undegraded":"2024-09-13T06:44:31.833489+0000","last_fullsized":"2024-09-13T06:44:31.833489+0000","mapping_epoch":300,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":301,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":569,"log_dups_size":0,"ondisk_log_size":569,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:26:59.771063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0027493119999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6187,"num_read_kb":31727,"num_write":657,"num_write_kb":25682,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":184,"num_bytes_recovered":16410936,"num_keys_recovered":88,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"277'881","reported_seq":2923,"reported_epoch":303,"state":"active+clean","last_fresh":"2024-09-13T06:44:32.805567+0000","last_change":"2024-09-13T06:44:05.458093+0000","last_active":"2024-09-13T06:44:32.805567+0000","last_peered":"2024-09-13T06:44:32.805567+0000","last_clean":"2024-09-13T06:44:32.805567+0000","last_became_active":"2024-09-13T06:42:32.411927+0000","last_became_peered":"2024-09-13T06:42:32.411927+0000","last_unstale":"2024-09-13T06:44:32.805567+0000","last_undegraded":"2024-09-13T06:44:32.805567+0000","last_fullsized":"2024-09-13T06:44:32.805567+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":881,"log_dups_size":0,"ondisk_log_size":881,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:40:44.787780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.003013108,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4846,"num_read_kb":26164,"num_write":1518,"num_write_kb":30083,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":140,"num_bytes_recovered":11278110,"num_keys_recovered":11,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.e","version":"277'556","reported_seq":4102,"reported_epoch":303,"state":"active+clean","last_fresh":"2024-09-13T06:44:32.805528+0000","last_change":"2024-09-13T06:44:30.808041+0000","last_active":"2024-09-13T06:44:32.805528+0000","last_peered":"2024-09-13T06:44:32.805528+0000","last_clean":"2024-09-13T06:44:32.805528+0000","last_became_active":"2024-09-13T06:44:30.801655+0000","last_became_peered":"2024-09-13T06:44:30.801655+0000","last_unstale":"2024-09-13T06:44:32.805528+0000","last_undegraded":"2024-09-13T06:44:32.805528+0000","last_fullsized":"2024-09-13T06:44:32.805528+0000","mapping_epoch":300,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":301,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":556,"log_dups_size":0,"ondisk_log_size":556,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:43:53.489080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0025767619999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3868,"num_read_kb":43567,"num_write":654,"num_write_kb":29232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":503,"num_bytes_recovered":12695191,"num_keys_recovered":11,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"277'665","reported_seq":4754,"reported_epoch":303,"state":"active+clean","last_fresh":"2024-09-13T06:44:32.805508+0000","last_change":"2024-09-13T06:44:05.458214+0000","last_active":"2024-09-13T06:44:32.805508+0000","last_peered":"2024-09-13T06:44:32.805508+0000","last_clean":"2024-09-13T06:44:32.805508+0000","last_became_active":"2024-09-13T06:42:33.412054+0000","last_became_peered":"2024-09-13T06:42:33.412054+0000","last_unstale":"2024-09-13T06:44:32.805508+0000","last_undegraded":"2024-09-13T06:44:32.805508+0000","last_fullsized":"2024-09-13T06:44:32.805508+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":665,"log_dups_size":0,"ondisk_log_size":665,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:07:06.963404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00285659,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4677,"num_read_kb":45287,"num_write":982,"num_write_kb":45285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":394,"num_bytes_recovered":42768786,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.10","version":"280'832","reported_seq":5035,"reported_epoch":304,"state":"active+clean","last_fresh":"2024-09-13T06:44:33.831977+0000","last_change":"2024-09-13T06:44:19.467239+0000","last_active":"2024-09-13T06:44:33.831977+0000","last_peered":"2024-09-13T06:44:33.831977+0000","last_clean":"2024-09-13T06:44:33.831977+0000","last_became_active":"2024-09-13T06:44:19.459617+0000","last_became_peered":"2024-09-13T06:44:19.459617+0000","last_unstale":"2024-09-13T06:44:33.831977+0000","last_undegraded":"2024-09-13T06:44:33.831977+0000","last_fullsized":"2024-09-13T06:44:33.831977+0000","mapping_epoch":289,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":290,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":832,"log_dups_size":0,"ondisk_log_size":832,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:43:55.736868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0018779840000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5715,"num_read_kb":29614,"num_write":1142,"num_write_kb":36190,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":275,"num_bytes_recovered":6622441,"num_keys_recovered":20,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.11","version":"279'502","reported_seq":6279,"reported_epoch":303,"state":"active+clean","last_fresh":"2024-09-13T06:44:32.805097+0000","last_change":"2024-09-13T06:44:05.455675+0000","last_active":"2024-09-13T06:44:32.805097+0000","last_peered":"2024-09-13T06:44:32.805097+0000","last_clean":"2024-09-13T06:44:32.805097+0000","last_became_active":"2024-09-13T06:42:33.411668+0000","last_became_peered":"2024-09-13T06:42:33.411668+0000","last_unstale":"2024-09-13T06:44:32.805097+0000","last_undegraded":"2024-09-13T06:44:32.805097+0000","last_fullsized":"2024-09-13T06:44:32.805097+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":502,"log_dups_size":0,"ondisk_log_size":502,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:43:01.814094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001270492,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5341,"num_read_kb":34087,"num_write":659,"num_write_kb":25712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":245,"num_bytes_recovered":7089272,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"280'921","reported_seq":5046,"reported_epoch":302,"state":"active+clean","last_fresh":"2024-09-13T06:44:31.794105+0000","last_change":"2024-09-13T06:44:20.470378+0000","last_active":"2024-09-13T06:44:31.794105+0000","last_peered":"2024-09-13T06:44:31.794105+0000","last_clean":"2024-09-13T06:44:31.794105+0000","last_became_active":"2024-09-13T06:44:20.466713+0000","last_became_peered":"2024-09-13T06:44:20.466713+0000","last_unstale":"2024-09-13T06:44:31.794105+0000","last_undegraded":"2024-09-13T06:44:31.794105+0000","last_fullsized":"2024-09-13T06:44:31.794105+0000","mapping_epoch":290,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":291,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":921,"log_dups_size":0,"ondisk_log_size":921,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:00:14.406068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0017683250000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6025,"num_read_kb":38947,"num_write":1315,"num_write_kb":35656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":107,"num_bytes_recovered":3682200,"num_keys_recovered":21,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"279'604","reported_seq":4546,"reported_epoch":303,"state":"active+clean","last_fresh":"2024-09-13T06:44:32.805143+0000","last_change":"2024-09-13T06:44:05.454984+0000","last_active":"2024-09-13T06:44:32.805143+0000","last_peered":"2024-09-13T06:44:32.805143+0000","last_clean":"2024-09-13T06:44:32.805143+0000","last_became_active":"2024-09-13T06:42:31.402800+0000","last_became_peered":"2024-09-13T06:42:31.402800+0000","last_unstale":"2024-09-13T06:44:32.805143+0000","last_undegraded":"2024-09-13T06:44:32.805143+0000","last_fullsized":"2024-09-13T06:44:32.805143+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":604,"log_dups_size":0,"ondisk_log_size":604,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:59:41.167052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010470779999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4471,"num_read_kb":35894,"num_write":884,"num_write_kb":31515,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":196,"num_bytes_recovered":8224568,"num_keys_recovered":11,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":19,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":237282,"num_read_kb":1402862,"num_write":33322,"num_write_kb":1008910,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9249,"num_bytes_recovered":443628516,"num_keys_recovered":867,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14648,"internal_metadata":0},"log_size":24486,"ondisk_log_size":24486,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":57,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":3}],"osd_stats":[{"osd":7,"up_from":187,"seq":803158884380,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37040,"kb_used_data":4196,"kb_used_omap":9,"kb_used_meta":32822,"kb_avail":94334800,"statfs":{"total":96636764160,"available":96598835200,"internally_reserved":0,"allocated":4296704,"data_stored":2446923,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9685,"internal_metadata":33610283},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 06:44:33 2024","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":0.71199999999999997,"15min":0.69799999999999995},"min":{"1min":0.56699999999999995,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.83599999999999997},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.751,"15min":0.73999999999999999},"min":{"1min":0.54600000000000004,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.6910000000000001,"5min":1.6910000000000001,"15min":1.6910000000000001},"last":0.90100000000000002}]},{"osd":1,"last update":"Fri Sep 13 06:44:33 2024","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.75700000000000001,"15min":0.751},"min":{"1min":0.57399999999999995,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.359,"5min":1.359,"15min":1.359},"last":0.86699999999999999},{"interface":"front","average":{"1min":0.82399999999999995,"5min":0.71599999999999997,"15min":0.69799999999999995},"min":{"1min":0.496,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.1259999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.93899999999999995}]},{"osd":2,"last update":"Fri Sep 13 06:44:33 2024","interfaces":[{"interface":"back","average":{"1min":0.80700000000000005,"5min":0.75900000000000001,"15min":0.751},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.2030000000000001,"5min":1.212,"15min":1.212},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.92200000000000004,"5min":0.81499999999999995,"15min":0.79700000000000004},"min":{"1min":0.58999999999999997,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.4319999999999999,"5min":1.4319999999999999,"15min":1.4319999999999999},"last":0.97699999999999998}]},{"osd":3,"last update":"Fri Sep 13 06:44:33 2024","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.79600000000000004,"15min":0.79200000000000004},"min":{"1min":0.60299999999999998,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.177,"5min":1.177,"15min":1.177},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.88600000000000001,"5min":0.84299999999999997,"15min":0.83599999999999997},"min":{"1min":0.48099999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.7350000000000001,"5min":1.7350000000000001,"15min":1.7350000000000001},"last":1.008}]},{"osd":4,"last update":"Fri Sep 13 06:44:33 2024","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.82299999999999995,"15min":0.82499999999999996},"min":{"1min":0.45500000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.405,"5min":1.405,"15min":1.405},"last":0.628},{"interface":"front","average":{"1min":1.0049999999999999,"5min":0.82299999999999995,"15min":0.79300000000000004},"min":{"1min":0.39800000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.6240000000000001,"5min":1.6240000000000001,"15min":1.6240000000000001},"last":1.137}]},{"osd":5,"last update":"Fri Sep 13 06:44:33 2024","interfaces":[{"interface":"back","average":{"1min":0.96599999999999997,"5min":0.88800000000000001,"15min":0.875},"min":{"1min":0.504,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.593,"5min":1.593,"15min":1.593},"last":1.036},{"interface":"front","average":{"1min":0.92300000000000004,"5min":0.84099999999999997,"15min":0.82699999999999996},"min":{"1min":0.53800000000000003,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.3400000000000001,"5min":1.3400000000000001,"15min":1.3400000000000001},"last":1.0620000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1619999999999999}]}]},{"osd":6,"up_from":286,"seq":1228360646662,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35504,"kb_used_data":3620,"kb_used_omap":7,"kb_used_meta":31864,"kb_avail":94336336,"statfs":{"total":96636764160,"available":96600408064,"internally_reserved":0,"allocated":3706880,"data_stored":1857127,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8145,"internal_metadata":32628783},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.877}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77700000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.046}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83399999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2090000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3360000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.254}]}]},{"osd":5,"up_from":13,"seq":55834574917,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":79004,"kb_used_data":3596,"kb_used_omap":1,"kb_used_meta":75390,"kb_avail":94292836,"statfs":{"total":96636764160,"available":96555864064,"internally_reserved":0,"allocated":3682304,"data_stored":1844890,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":77199814},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 06:44:19 2024","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.71399999999999997,"15min":0.76500000000000001},"min":{"1min":0.40999999999999998,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":1.093,"5min":1.6679999999999999,"15min":1.6679999999999999},"last":0.94599999999999995},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.76900000000000002,"15min":0.79900000000000004},"min":{"1min":0.41299999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.1220000000000001,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":0.98799999999999999}]},{"osd":1,"last update":"Fri Sep 13 06:44:19 2024","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.73999999999999999,"15min":0.751},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":1.103,"5min":1.341,"15min":1.341},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.70099999999999996,"15min":0.74099999999999999},"min":{"1min":0.40899999999999997,"5min":0.317,"15min":0.317},"max":{"1min":1.0089999999999999,"5min":1.722,"15min":1.722},"last":0.63800000000000001}]},{"osd":2,"last update":"Fri Sep 13 06:44:19 2024","interfaces":[{"interface":"back","average":{"1min":0.876,"5min":0.81999999999999995,"15min":0.86399999999999999},"min":{"1min":0.47699999999999998,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.143,"5min":1.833,"15min":1.833},"last":0.91000000000000003},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.79200000000000004},"min":{"1min":0.47999999999999998,"5min":0.435,"15min":0.435},"max":{"1min":1.0169999999999999,"5min":1.4279999999999999,"15min":1.4279999999999999},"last":1.1459999999999999}]},{"osd":3,"last update":"Fri Sep 13 06:44:19 2024","interfaces":[{"interface":"back","average":{"1min":0.85699999999999998,"5min":0.81399999999999995,"15min":0.78000000000000003},"min":{"1min":0.45400000000000001,"5min":0.434,"15min":0.434},"max":{"1min":1.1659999999999999,"5min":1.885,"15min":1.885},"last":0.82399999999999995},{"interface":"front","average":{"1min":0.85899999999999999,"5min":0.86299999999999999,"15min":0.86499999999999999},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.2410000000000001,"5min":1.907,"15min":1.907},"last":1.099}]},{"osd":4,"last update":"Fri Sep 13 06:44:19 2024","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.83499999999999996,"15min":0.80500000000000005},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":1.159,"5min":6.3179999999999996,"15min":6.3179999999999996},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.78000000000000003,"5min":1.0529999999999999,"15min":0.91000000000000003},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":1.2370000000000001,"5min":15.553000000000001,"15min":15.553000000000001},"last":0.85599999999999998}]},{"osd":6,"last update":"Fri Sep 13 06:42:12 2024","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.86299999999999999,"15min":0.877},"min":{"1min":0.40000000000000002,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.9610000000000001,"5min":1.9610000000000001,"15min":1.9610000000000001},"last":1.04},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.86099999999999999,"15min":0.87},"min":{"1min":0.39000000000000001,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.206,"5min":1.968,"15min":1.968},"last":1.1890000000000001}]},{"osd":7,"last update":"Fri Sep 13 06:44:31 2024","interfaces":[{"interface":"back","average":{"1min":0.96399999999999997,"5min":0.84399999999999997,"15min":0.82399999999999995},"min":{"1min":0.39000000000000001,"5min":0.373,"15min":0.373},"max":{"1min":1.2050000000000001,"5min":1.375,"15min":1.375},"last":1.0700000000000001},{"interface":"front","average":{"1min":0.997,"5min":0.89800000000000002,"15min":0.88200000000000001},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":1.7050000000000001,"5min":1.7050000000000001,"15min":1.7050000000000001},"last":1.2909999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574917,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60968,"kb_used_data":3612,"kb_used_omap":1,"kb_used_meta":57342,"kb_avail":94310872,"statfs":{"total":96636764160,"available":96574332928,"internally_reserved":0,"allocated":3698688,"data_stored":1851304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":58718662},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 06:44:15 2024","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.79300000000000004,"15min":0.98999999999999999},"min":{"1min":0.41499999999999998,"5min":0.245,"15min":0.245},"max":{"1min":1.0720000000000001,"5min":5.8230000000000004,"15min":5.8230000000000004},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.71999999999999997,"15min":0.752},"min":{"1min":0.505,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.97299999999999998,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":1.018}]},{"osd":1,"last update":"Fri Sep 13 06:44:15 2024","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.79300000000000004,"15min":0.75},"min":{"1min":0.45100000000000001,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.86899999999999999,"5min":10.156000000000001,"15min":10.156000000000001},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.747,"5min":0.77500000000000002,"15min":0.83599999999999997},"min":{"1min":0.496,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.0349999999999999,"5min":1.286,"15min":1.286},"last":0.93100000000000005}]},{"osd":2,"last update":"Fri Sep 13 06:44:15 2024","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.751,"15min":0.82299999999999995},"min":{"1min":0.52800000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":1.0109999999999999,"5min":1.6000000000000001,"15min":1.6000000000000001},"last":1.0409999999999999},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.81299999999999994},"min":{"1min":0.65500000000000003,"5min":0.374,"15min":0.374},"max":{"1min":1.167,"5min":1.3540000000000001,"15min":1.3540000000000001},"last":0.79100000000000004}]},{"osd":3,"last update":"Fri Sep 13 06:44:15 2024","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.84699999999999998,"15min":0.90200000000000002},"min":{"1min":0.57499999999999996,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.6950000000000001,"5min":1.6950000000000001,"15min":1.6950000000000001},"last":1.101},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.95299999999999996,"15min":0.92500000000000004},"min":{"1min":0.48499999999999999,"5min":0.374,"15min":0.374},"max":{"1min":1.8069999999999999,"5min":10.195,"15min":10.195},"last":0.98999999999999999}]},{"osd":5,"last update":"Fri Sep 13 06:44:15 2024","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.81499999999999995,"15min":0.85699999999999998},"min":{"1min":0.443,"5min":0.249,"15min":0.249},"max":{"1min":1.075,"5min":2.9790000000000001,"15min":2.9790000000000001},"last":0.85199999999999998},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.84399999999999997,"15min":0.91400000000000003},"min":{"1min":0.39700000000000002,"5min":0.372,"15min":0.372},"max":{"1min":1.0580000000000001,"5min":1.8779999999999999,"15min":1.8779999999999999},"last":0.872}]},{"osd":6,"last update":"Fri Sep 13 06:42:14 2024","interfaces":[{"interface":"back","average":{"1min":0.90100000000000002,"5min":0.92100000000000004,"15min":0.82899999999999996},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":1.6100000000000001,"5min":10.016999999999999,"15min":10.016999999999999},"last":0.96699999999999997},{"interface":"front","average":{"1min":0.86699999999999999,"5min":0.93300000000000005,"15min":0.95999999999999996},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.2030000000000001,"5min":2.0750000000000002,"15min":2.0750000000000002},"last":0.82399999999999995}]},{"osd":7,"last update":"Fri Sep 13 06:44:33 2024","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.1539999999999999,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.90500000000000003},{"interface":"front","average":{"1min":0.90400000000000003,"5min":0.89200000000000002,"15min":0.89000000000000001},"min":{"1min":0.505,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.2529999999999999,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":1.073}]}]},{"osd":3,"up_from":13,"seq":55834574920,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":74920,"kb_used_data":3608,"kb_used_omap":1,"kb_used_meta":71294,"kb_avail":94296920,"statfs":{"total":96636764160,"available":96560046080,"internally_reserved":0,"allocated":3694592,"data_stored":1851285,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":73005512},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 06:44:15 2024","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.56100000000000005,"15min":0.56899999999999995},"min":{"1min":0.24199999999999999,"5min":0.191,"15min":0.191},"max":{"1min":1.51,"5min":1.51,"15min":1.51},"last":1.0780000000000001},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.60599999999999998,"15min":0.65400000000000003},"min":{"1min":0.307,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.88900000000000001,"5min":1.2789999999999999,"15min":1.2789999999999999},"last":0.73299999999999998}]},{"osd":1,"last update":"Fri Sep 13 06:44:15 2024","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.54900000000000004,"15min":0.58599999999999997},"min":{"1min":0.29499999999999998,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.85399999999999998,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.59999999999999998,"15min":0.66800000000000004},"min":{"1min":0.27700000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":1.607,"5min":1.607,"15min":1.607},"last":0.77000000000000002}]},{"osd":2,"last update":"Fri Sep 13 06:44:15 2024","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.629,"15min":0.65200000000000002},"min":{"1min":0.30199999999999999,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":1.5660000000000001,"5min":1.5660000000000001,"15min":1.5660000000000001},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.59799999999999998,"15min":0.627},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":1.135,"5min":1.409,"15min":1.409},"last":0.86299999999999999}]},{"osd":4,"last update":"Fri Sep 13 06:44:15 2024","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.82599999999999996,"15min":0.89400000000000002},"min":{"1min":0.42899999999999999,"5min":0.377,"15min":0.377},"max":{"1min":1.651,"5min":1.7929999999999999,"15min":1.7929999999999999},"last":1.1919999999999999},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.76300000000000001,"15min":0.78300000000000003},"min":{"1min":0.44700000000000001,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.96499999999999997,"5min":1.3240000000000001,"15min":1.3240000000000001},"last":1.1559999999999999}]},{"osd":5,"last update":"Fri Sep 13 06:44:15 2024","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":0.81200000000000006,"15min":0.84999999999999998},"min":{"1min":0.48799999999999999,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.3029999999999999,"5min":1.3799999999999999,"15min":1.3799999999999999},"last":1.2529999999999999},{"interface":"front","average":{"1min":0.83099999999999996,"5min":0.82499999999999996,"15min":0.85999999999999999},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.4610000000000001,"5min":1.4610000000000001,"15min":1.4610000000000001},"last":0.95999999999999996}]},{"osd":6,"last update":"Fri Sep 13 06:42:11 2024","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.88500000000000001,"15min":0.91100000000000003},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.135,"5min":1.532,"15min":1.532},"last":1.357},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.95299999999999996,"15min":0.98999999999999999},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.2250000000000001,"5min":1.825,"15min":1.825},"last":0.99099999999999999}]},{"osd":7,"last update":"Fri Sep 13 06:43:31 2024","interfaces":[{"interface":"back","average":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.3799999999999999,"5min":1.3799999999999999,"15min":1.3799999999999999},"last":1.3009999999999999},{"interface":"front","average":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":2.0459999999999998,"5min":2.0459999999999998,"15min":2.0459999999999998},"last":1.4219999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574917,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60964,"kb_used_data":3608,"kb_used_omap":1,"kb_used_meta":57342,"kb_avail":94310876,"statfs":{"total":96636764160,"available":96574337024,"internally_reserved":0,"allocated":3694592,"data_stored":1851285,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":58718662},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 06:44:20 2024","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.66800000000000004,"15min":0.56200000000000006},"min":{"1min":0.19400000000000001,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.84199999999999997,"5min":8.6449999999999996,"15min":8.6449999999999996},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.65200000000000002,"15min":0.61099999999999999},"min":{"1min":0.30299999999999999,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":1.4410000000000001,"5min":4.0380000000000003,"15min":4.0380000000000003},"last":0.67800000000000005}]},{"osd":1,"last update":"Fri Sep 13 06:44:20 2024","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.64000000000000001,"15min":0.62},"min":{"1min":0.25,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":1.0329999999999999,"5min":3.4649999999999999,"15min":3.4649999999999999},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.66600000000000004,"15min":0.60299999999999998},"min":{"1min":0.34300000000000003,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":1.5049999999999999,"5min":3.8159999999999998,"15min":3.8159999999999998},"last":0.97799999999999998}]},{"osd":3,"last update":"Fri Sep 13 06:44:20 2024","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.65000000000000002,"15min":0.58599999999999997},"min":{"1min":0.36399999999999999,"5min":0.249,"15min":0.249},"max":{"1min":1.044,"5min":3.407,"15min":3.407},"last":0.755},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.73599999999999999,"15min":0.68600000000000005},"min":{"1min":0.312,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.238,"5min":3.2639999999999998,"15min":3.2639999999999998},"last":0.63900000000000001}]},{"osd":4,"last update":"Fri Sep 13 06:44:20 2024","interfaces":[{"interface":"back","average":{"1min":0.83299999999999996,"5min":0.878,"15min":0.88500000000000001},"min":{"1min":0.45600000000000002,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.3759999999999999,"5min":3.1179999999999999,"15min":3.1179999999999999},"last":0.83699999999999997},{"interface":"front","average":{"1min":0.81399999999999995,"5min":1.0620000000000001,"15min":0.94099999999999995},"min":{"1min":0.46800000000000003,"5min":0.439,"15min":0.439},"max":{"1min":1.359,"5min":21.081,"15min":21.081},"last":0.873}]},{"osd":5,"last update":"Fri Sep 13 06:44:20 2024","interfaces":[{"interface":"back","average":{"1min":0.82999999999999996,"5min":0.84799999999999998,"15min":0.84299999999999997},"min":{"1min":0.60099999999999998,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":1.143,"5min":2.2389999999999999,"15min":2.2389999999999999},"last":0.91200000000000003},{"interface":"front","average":{"1min":1.133,"5min":0.96099999999999997,"15min":0.88900000000000001},"min":{"1min":0.54400000000000004,"5min":0.377,"15min":0.377},"max":{"1min":4.9039999999999999,"5min":4.9039999999999999,"15min":4.9039999999999999},"last":0.93799999999999994}]},{"osd":6,"last update":"Fri Sep 13 06:42:15 2024","interfaces":[{"interface":"back","average":{"1min":0.86799999999999999,"5min":0.94199999999999995,"15min":0.92600000000000005},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.274,"5min":3.923,"15min":3.923},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.97799999999999998,"5min":0.90500000000000003,"15min":0.879},"min":{"1min":0.60899999999999999,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":2.2080000000000002,"5min":2.2120000000000002,"15min":2.2120000000000002},"last":1.1060000000000001}]},{"osd":7,"last update":"Fri Sep 13 06:44:33 2024","interfaces":[{"interface":"back","average":{"1min":0.95799999999999996,"5min":0.86499999999999999,"15min":0.84899999999999998},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":1.641,"5min":1.641,"15min":1.641},"last":1.032},{"interface":"front","average":{"1min":1.05,"5min":0.88600000000000001,"15min":0.85799999999999998},"min":{"1min":0.71499999999999997,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":2.0630000000000002,"5min":2.0630000000000002,"15min":2.0630000000000002},"last":1.157}]}]},{"osd":1,"up_from":13,"seq":55834574917,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52768,"kb_used_data":3600,"kb_used_omap":1,"kb_used_meta":49150,"kb_avail":94319072,"statfs":{"total":96636764160,"available":96582729728,"internally_reserved":0,"allocated":3686400,"data_stored":1844909,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":50330054},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 06:44:21 2024","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.55300000000000005,"15min":0.57299999999999995},"min":{"1min":0.246,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":1.1879999999999999,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.64200000000000002,"15min":0.65900000000000003},"min":{"1min":0.26200000000000001,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.99199999999999999,"5min":1.8160000000000001,"15min":1.8160000000000001},"last":0.77600000000000002}]},{"osd":2,"last update":"Fri Sep 13 06:44:21 2024","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.60699999999999998,"15min":0.63400000000000001},"min":{"1min":0.26800000000000002,"5min":0.22,"15min":0.22},"max":{"1min":0.92200000000000004,"5min":2.617,"15min":2.617},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.65300000000000002,"15min":0.65400000000000003},"min":{"1min":0.28499999999999998,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":1.331,"5min":2.5249999999999999,"15min":2.5249999999999999},"last":0.84299999999999997}]},{"osd":3,"last update":"Fri Sep 13 06:44:21 2024","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.70499999999999996,"15min":0.72599999999999998},"min":{"1min":0.33900000000000002,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":1.2769999999999999,"5min":1.3640000000000001,"15min":1.3640000000000001},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.66700000000000004,"15min":0.69099999999999995},"min":{"1min":0.30399999999999999,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":1.028,"5min":1.752,"15min":1.752},"last":0.68200000000000005}]},{"osd":4,"last update":"Fri Sep 13 06:44:21 2024","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.79800000000000004,"15min":0.81999999999999995},"min":{"1min":0.60899999999999999,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":1.109,"5min":2.7389999999999999,"15min":2.7389999999999999},"last":0.878},{"interface":"front","average":{"1min":0.94499999999999995,"5min":0.85499999999999998,"15min":0.90600000000000003},"min":{"1min":0.40000000000000002,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.4159999999999999,"5min":1.4359999999999999,"15min":1.4359999999999999},"last":1.046}]},{"osd":5,"last update":"Fri Sep 13 06:44:21 2024","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.84499999999999997,"15min":0.90600000000000003},"min":{"1min":0.58099999999999996,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.1399999999999999,"5min":1.7849999999999999,"15min":1.7849999999999999},"last":1.0129999999999999},{"interface":"front","average":{"1min":0.89600000000000002,"5min":0.86599999999999999,"15min":0.879},"min":{"1min":0.495,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":1.202,"5min":2.036,"15min":2.036},"last":0.93700000000000006}]},{"osd":6,"last update":"Fri Sep 13 06:42:18 2024","interfaces":[{"interface":"back","average":{"1min":0.87,"5min":0.92200000000000004,"15min":0.94399999999999995},"min":{"1min":0.57699999999999996,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.526,"5min":1.8149999999999999,"15min":1.8149999999999999},"last":0.89600000000000002},{"interface":"front","average":{"1min":0.88900000000000001,"5min":0.91200000000000003,"15min":0.91900000000000004},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":2.7810000000000001,"5min":2.7810000000000001,"15min":2.7810000000000001},"last":1.0840000000000001}]},{"osd":7,"last update":"Fri Sep 13 06:44:33 2024","interfaces":[{"interface":"back","average":{"1min":0.91900000000000004,"5min":0.90600000000000003,"15min":0.90400000000000003},"min":{"1min":0.621,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":1.3220000000000001,"5min":1.605,"15min":1.605},"last":0.81399999999999995},{"interface":"front","average":{"1min":1.054,"5min":0.93899999999999995,"15min":0.92000000000000004},"min":{"1min":0.61099999999999999,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.5009999999999999,"5min":1.5009999999999999,"15min":1.5009999999999999},"last":0.97199999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574916,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":85336,"kb_used_data":4172,"kb_used_omap":1,"kb_used_meta":81150,"kb_avail":94286504,"statfs":{"total":96636764160,"available":96549380096,"internally_reserved":0,"allocated":4272128,"data_stored":2435239,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":83098054},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 06:44:11 2024","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.54900000000000004,"15min":0.53000000000000003},"min":{"1min":0.23999999999999999,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":1.048,"5min":1.2270000000000001,"15min":1.2270000000000001},"last":0.751},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.56000000000000005,"15min":0.54000000000000004},"min":{"1min":0.28799999999999998,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":1.137,"5min":1.222,"15min":1.222},"last":0.60299999999999998}]},{"osd":2,"last update":"Fri Sep 13 06:44:11 2024","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.60399999999999998,"15min":0.55600000000000005},"min":{"1min":0.27300000000000002,"5min":0.217,"15min":0.217},"max":{"1min":1.2549999999999999,"5min":1.839,"15min":1.839},"last":0.83999999999999997},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.61299999999999999,"15min":0.57499999999999996},"min":{"1min":0.35399999999999998,"5min":0.245,"15min":0.245},"max":{"1min":1.419,"5min":1.419,"15min":1.419},"last":0.79700000000000004}]},{"osd":3,"last update":"Fri Sep 13 06:44:11 2024","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.59999999999999998,"15min":0.55800000000000005},"min":{"1min":0.371,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":1.2250000000000001,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.74299999999999999,"15min":0.69899999999999995},"min":{"1min":0.36699999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":1.175,"5min":4.9630000000000001,"15min":4.9630000000000001},"last":1.004}]},{"osd":4,"last update":"Fri Sep 13 06:44:11 2024","interfaces":[{"interface":"back","average":{"1min":0.89400000000000002,"5min":0.80400000000000005,"15min":0.79400000000000004},"min":{"1min":0.57899999999999996,"5min":0.311,"15min":0.311},"max":{"1min":1.6259999999999999,"5min":1.6259999999999999,"15min":1.6259999999999999},"last":0.89000000000000001},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.77400000000000002,"15min":0.79600000000000004},"min":{"1min":0.58999999999999997,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.1799999999999999,"5min":1.6319999999999999,"15min":1.6319999999999999},"last":0.92300000000000004}]},{"osd":5,"last update":"Fri Sep 13 06:44:11 2024","interfaces":[{"interface":"back","average":{"1min":0.89900000000000002,"5min":0.85799999999999998,"15min":0.85199999999999998},"min":{"1min":0.52800000000000002,"5min":0.378,"15min":0.378},"max":{"1min":1.575,"5min":1.575,"15min":1.575},"last":1.0600000000000001},{"interface":"front","average":{"1min":0.89100000000000001,"5min":0.85699999999999998,"15min":0.87},"min":{"1min":0.60199999999999998,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.327,"5min":1.5740000000000001,"15min":1.5740000000000001},"last":1.075}]},{"osd":6,"last update":"Fri Sep 13 06:42:11 2024","interfaces":[{"interface":"back","average":{"1min":0.89800000000000002,"5min":0.91200000000000003,"15min":0.93100000000000005},"min":{"1min":0.55300000000000005,"5min":0.499,"15min":0.499},"max":{"1min":1.571,"5min":2.4969999999999999,"15min":2.4969999999999999},"last":1.1479999999999999},{"interface":"front","average":{"1min":0.878,"5min":0.89600000000000002,"15min":0.90600000000000003},"min":{"1min":0.51800000000000002,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.208,"5min":2.0419999999999998,"15min":2.0419999999999998},"last":0.96899999999999997}]},{"osd":7,"last update":"Fri Sep 13 06:44:31 2024","interfaces":[{"interface":"back","average":{"1min":0.97799999999999998,"5min":1.0529999999999999,"15min":1.0649999999999999},"min":{"1min":0.57799999999999996,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.381,"5min":1.9419999999999999,"15min":1.9419999999999999},"last":1.1040000000000001},{"interface":"front","average":{"1min":0.97899999999999998,"5min":0.96999999999999997,"15min":0.96799999999999997},"min":{"1min":0.64100000000000001,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.4750000000000001,"5min":1.901,"15min":1.901},"last":1.032}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6552,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8096,"internal_metadata":0}]}} 2024-09-13T06:44:41.186 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T06:44:41.495 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T06:44:41.496 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-09-13T06:44:41.512 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":463,"stamp":"2024-09-13T06:44:39.609999+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590406,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":237398,"num_read_kb":1402962,"num_write":33483,"num_write_kb":1011328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9257,"num_bytes_recovered":444809309,"num_keys_recovered":867,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":24606,"ondisk_log_size":24606,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":486504,"kb_used_data":30012,"kb_used_omap":26,"kb_used_meta":456357,"kb_avail":754488216,"statfs":{"total":773094113280,"available":772595933184,"internally_reserved":0,"allocated":30732288,"data_stored":15982962,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":27392,"internal_metadata":467309824},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":-152,"num_bytes_recovered":-19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.803668"},"pg_stats":[{"pgid":"3.1f","version":"280'781","reported_seq":6286,"reported_epoch":302,"state":"active+clean","last_fresh":"2024-09-13T06:44:31.794290+0000","last_change":"2024-09-13T06:44:05.445184+0000","last_active":"2024-09-13T06:44:31.794290+0000","last_peered":"2024-09-13T06:44:31.794290+0000","last_clean":"2024-09-13T06:44:31.794290+0000","last_became_active":"2024-09-13T06:40:57.385213+0000","last_became_peered":"2024-09-13T06:40:57.385213+0000","last_unstale":"2024-09-13T06:44:31.794290+0000","last_undegraded":"2024-09-13T06:44:31.794290+0000","last_fullsized":"2024-09-13T06:44:31.794290+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":781,"log_dups_size":0,"ondisk_log_size":781,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:46:17.100560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00056495999999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6518,"num_read_kb":34199,"num_write":1043,"num_write_kb":37100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":72,"num_bytes_recovered":6114482,"num_keys_recovered":44,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"271'1110","reported_seq":7421,"reported_epoch":303,"state":"active+clean","last_fresh":"2024-09-13T06:44:32.807368+0000","last_change":"2024-09-13T06:44:20.462945+0000","last_active":"2024-09-13T06:44:32.807368+0000","last_peered":"2024-09-13T06:44:32.807368+0000","last_clean":"2024-09-13T06:44:32.807368+0000","last_became_active":"2024-09-13T06:44:20.460702+0000","last_became_peered":"2024-09-13T06:44:20.460702+0000","last_unstale":"2024-09-13T06:44:32.807368+0000","last_undegraded":"2024-09-13T06:44:32.807368+0000","last_fullsized":"2024-09-13T06:44:32.807368+0000","mapping_epoch":290,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":291,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":1110,"log_dups_size":0,"ondisk_log_size":1110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:02:22.560348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013343369999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8806,"num_read_kb":55237,"num_write":1632,"num_write_kb":29160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":491,"num_bytes_recovered":16489974,"num_keys_recovered":55,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"279'1047","reported_seq":5655,"reported_epoch":302,"state":"active+clean","last_fresh":"2024-09-13T06:44:31.833302+0000","last_change":"2024-09-13T06:44:30.808653+0000","last_active":"2024-09-13T06:44:31.833302+0000","last_peered":"2024-09-13T06:44:31.833302+0000","last_clean":"2024-09-13T06:44:31.833302+0000","last_became_active":"2024-09-13T06:44:30.803142+0000","last_became_peered":"2024-09-13T06:44:30.803142+0000","last_unstale":"2024-09-13T06:44:31.833302+0000","last_undegraded":"2024-09-13T06:44:31.833302+0000","last_fullsized":"2024-09-13T06:44:31.833302+0000","mapping_epoch":300,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":301,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":1047,"log_dups_size":0,"ondisk_log_size":1047,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:25:53.597990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00088262599999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6265,"num_read_kb":28067,"num_write":1605,"num_write_kb":33265,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":206,"num_bytes_recovered":8442088,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1c","version":"280'843","reported_seq":8394,"reported_epoch":302,"state":"active+clean","last_fresh":"2024-09-13T06:44:31.833265+0000","last_change":"2024-09-13T06:44:30.807782+0000","last_active":"2024-09-13T06:44:31.833265+0000","last_peered":"2024-09-13T06:44:31.833265+0000","last_clean":"2024-09-13T06:44:31.833265+0000","last_became_active":"2024-09-13T06:44:30.801783+0000","last_became_peered":"2024-09-13T06:44:30.801783+0000","last_unstale":"2024-09-13T06:44:31.833265+0000","last_undegraded":"2024-09-13T06:44:31.833265+0000","last_fullsized":"2024-09-13T06:44:31.833265+0000","mapping_epoch":300,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":301,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":843,"log_dups_size":0,"ondisk_log_size":843,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:54:20.743708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001581236,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9390,"num_read_kb":69964,"num_write":963,"num_write_kb":31840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":350,"num_bytes_recovered":42380134,"num_keys_recovered":286,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"277'852","reported_seq":5169,"reported_epoch":302,"state":"active+clean","last_fresh":"2024-09-13T06:44:31.794146+0000","last_change":"2024-09-13T06:44:05.444712+0000","last_active":"2024-09-13T06:44:31.794146+0000","last_peered":"2024-09-13T06:44:31.794146+0000","last_clean":"2024-09-13T06:44:31.794146+0000","last_became_active":"2024-09-13T06:43:31.415608+0000","last_became_peered":"2024-09-13T06:43:31.415608+0000","last_unstale":"2024-09-13T06:44:31.794146+0000","last_undegraded":"2024-09-13T06:44:31.794146+0000","last_fullsized":"2024-09-13T06:44:31.794146+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":852,"log_dups_size":0,"ondisk_log_size":852,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:39:01.416782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060857399999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5714,"num_read_kb":37037,"num_write":1079,"num_write_kb":33376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":295,"num_bytes_recovered":25415745,"num_keys_recovered":55,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"277'497","reported_seq":7756,"reported_epoch":303,"state":"active+clean","last_fresh":"2024-09-13T06:44:33.194019+0000","last_change":"2024-09-13T06:44:20.469801+0000","last_active":"2024-09-13T06:44:33.194019+0000","last_peered":"2024-09-13T06:44:33.194019+0000","last_clean":"2024-09-13T06:44:33.194019+0000","last_became_active":"2024-09-13T06:44:20.462185+0000","last_became_peered":"2024-09-13T06:44:20.462185+0000","last_unstale":"2024-09-13T06:44:33.194019+0000","last_undegraded":"2024-09-13T06:44:33.194019+0000","last_fullsized":"2024-09-13T06:44:33.194019+0000","mapping_epoch":290,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":291,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":497,"log_dups_size":0,"ondisk_log_size":497,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:55:41.801680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00078923399999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6439,"num_read_kb":42977,"num_write":667,"num_write_kb":32420,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":728,"num_bytes_recovered":12986751,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"275'680","reported_seq":8569,"reported_epoch":303,"state":"active+clean","last_fresh":"2024-09-13T06:44:33.193202+0000","last_change":"2024-09-13T06:44:21.446173+0000","last_active":"2024-09-13T06:44:33.193202+0000","last_peered":"2024-09-13T06:44:33.193202+0000","last_clean":"2024-09-13T06:44:33.193202+0000","last_became_active":"2024-09-13T06:44:21.442872+0000","last_became_peered":"2024-09-13T06:44:21.442872+0000","last_unstale":"2024-09-13T06:44:33.193202+0000","last_undegraded":"2024-09-13T06:44:33.193202+0000","last_fullsized":"2024-09-13T06:44:33.193202+0000","mapping_epoch":291,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":292,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":680,"log_dups_size":0,"ondisk_log_size":680,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:11:12.949824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00079955100000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8400,"num_read_kb":35906,"num_write":738,"num_write_kb":28560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":398,"num_bytes_recovered":17539742,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"272'684","reported_seq":7045,"reported_epoch":303,"state":"active+clean","last_fresh":"2024-09-13T06:44:32.807518+0000","last_change":"2024-09-13T06:44:05.439754+0000","last_active":"2024-09-13T06:44:32.807518+0000","last_peered":"2024-09-13T06:44:32.807518+0000","last_clean":"2024-09-13T06:44:32.807518+0000","last_became_active":"2024-09-13T06:41:14.395301+0000","last_became_peered":"2024-09-13T06:41:14.395301+0000","last_unstale":"2024-09-13T06:44:32.807518+0000","last_undegraded":"2024-09-13T06:44:32.807518+0000","last_fullsized":"2024-09-13T06:44:32.807518+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":684,"log_dups_size":0,"ondisk_log_size":684,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:10:49.528345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00092758900000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6571,"num_read_kb":55194,"num_write":838,"num_write_kb":38872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":117,"num_bytes_recovered":13142180,"num_keys_recovered":22,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"275'1525","reported_seq":5959,"reported_epoch":302,"state":"active+clean","last_fresh":"2024-09-13T06:44:31.794327+0000","last_change":"2024-09-13T06:44:05.444913+0000","last_active":"2024-09-13T06:44:31.794327+0000","last_peered":"2024-09-13T06:44:31.794327+0000","last_clean":"2024-09-13T06:44:31.794327+0000","last_became_active":"2024-09-13T06:43:22.521039+0000","last_became_peered":"2024-09-13T06:43:22.521039+0000","last_unstale":"2024-09-13T06:44:31.794327+0000","last_undegraded":"2024-09-13T06:44:31.794327+0000","last_fullsized":"2024-09-13T06:44:31.794327+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":1525,"log_dups_size":0,"ondisk_log_size":1525,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:58:28.305131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00029931499999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9655,"num_read_kb":41824,"num_write":2232,"num_write_kb":32733,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":112,"num_bytes_recovered":14950263,"num_keys_recovered":22,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"275'715","reported_seq":5275,"reported_epoch":302,"state":"active+clean","last_fresh":"2024-09-13T06:44:31.833554+0000","last_change":"2024-09-13T06:44:30.806149+0000","last_active":"2024-09-13T06:44:31.833554+0000","last_peered":"2024-09-13T06:44:31.833554+0000","last_clean":"2024-09-13T06:44:31.833554+0000","last_became_active":"2024-09-13T06:44:30.798028+0000","last_became_peered":"2024-09-13T06:44:30.798028+0000","last_unstale":"2024-09-13T06:44:31.833554+0000","last_undegraded":"2024-09-13T06:44:31.833554+0000","last_fullsized":"2024-09-13T06:44:31.833554+0000","mapping_epoch":300,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":301,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":715,"log_dups_size":0,"ondisk_log_size":715,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:09:18.289368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0024960030000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5101,"num_read_kb":28279,"num_write":1028,"num_write_kb":23183,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":197,"num_bytes_recovered":7394092,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"277'365","reported_seq":6173,"reported_epoch":303,"state":"active+clean","last_fresh":"2024-09-13T06:44:32.805429+0000","last_change":"2024-09-13T06:44:05.457231+0000","last_active":"2024-09-13T06:44:32.805429+0000","last_peered":"2024-09-13T06:44:32.805429+0000","last_clean":"2024-09-13T06:44:32.805429+0000","last_became_active":"2024-09-13T06:42:33.408009+0000","last_became_peered":"2024-09-13T06:42:33.408009+0000","last_unstale":"2024-09-13T06:44:32.805429+0000","last_undegraded":"2024-09-13T06:44:32.805429+0000","last_fullsized":"2024-09-13T06:44:32.805429+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":365,"log_dups_size":0,"ondisk_log_size":365,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:09:11.995853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0024654690000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5036,"num_read_kb":48021,"num_write":472,"num_write_kb":27276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":157,"num_bytes_recovered":13242563,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"280'579","reported_seq":9959,"reported_epoch":303,"state":"active+clean","last_fresh":"2024-09-13T06:44:33.194074+0000","last_change":"2024-09-13T06:44:05.443324+0000","last_active":"2024-09-13T06:44:33.194074+0000","last_peered":"2024-09-13T06:44:33.194074+0000","last_clean":"2024-09-13T06:44:33.194074+0000","last_became_active":"2024-09-13T06:44:03.438897+0000","last_became_peered":"2024-09-13T06:44:03.438897+0000","last_unstale":"2024-09-13T06:44:33.194074+0000","last_undegraded":"2024-09-13T06:44:33.194074+0000","last_fullsized":"2024-09-13T06:44:33.194074+0000","mapping_epoch":277,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":278,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":579,"log_dups_size":0,"ondisk_log_size":579,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:24:55.053861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012901029999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8875,"num_read_kb":61758,"num_write":769,"num_write_kb":30278,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":506,"num_bytes_recovered":26184965,"num_keys_recovered":33,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":27,"reported_epoch":304,"state":"active+clean","last_fresh":"2024-09-13T06:44:33.832029+0000","last_change":"2024-09-13T06:44:16.450557+0000","last_active":"2024-09-13T06:44:33.832029+0000","last_peered":"2024-09-13T06:44:33.832029+0000","last_clean":"2024-09-13T06:44:33.832029+0000","last_became_active":"2024-09-13T06:44:16.449558+0000","last_became_peered":"2024-09-13T06:44:16.449558+0000","last_unstale":"2024-09-13T06:44:33.832029+0000","last_undegraded":"2024-09-13T06:44:33.832029+0000","last_fullsized":"2024-09-13T06:44:33.832029+0000","mapping_epoch":286,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":287,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_clean_scrub_stamp":"2024-09-13T06:39:16.508974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:01:20.779972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00080324699999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"280'643","reported_seq":10759,"reported_epoch":302,"state":"active+clean","last_fresh":"2024-09-13T06:44:31.794269+0000","last_change":"2024-09-13T06:44:22.454207+0000","last_active":"2024-09-13T06:44:31.794269+0000","last_peered":"2024-09-13T06:44:31.794269+0000","last_clean":"2024-09-13T06:44:31.794269+0000","last_became_active":"2024-09-13T06:44:22.449195+0000","last_became_peered":"2024-09-13T06:44:22.449195+0000","last_unstale":"2024-09-13T06:44:31.794269+0000","last_undegraded":"2024-09-13T06:44:31.794269+0000","last_fullsized":"2024-09-13T06:44:31.794269+0000","mapping_epoch":292,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":293,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":643,"log_dups_size":0,"ondisk_log_size":643,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:28:58.479641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00080400600000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9397,"num_read_kb":51433,"num_write":883,"num_write_kb":40908,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":358,"num_bytes_recovered":1257624,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":23,"reported_epoch":303,"state":"active+clean","last_fresh":"2024-09-13T06:44:33.193409+0000","last_change":"2024-09-13T06:44:18.458951+0000","last_active":"2024-09-13T06:44:33.193409+0000","last_peered":"2024-09-13T06:44:33.193409+0000","last_clean":"2024-09-13T06:44:33.193409+0000","last_became_active":"2024-09-13T06:44:18.458454+0000","last_became_peered":"2024-09-13T06:44:18.458454+0000","last_unstale":"2024-09-13T06:44:33.193409+0000","last_undegraded":"2024-09-13T06:44:33.193409+0000","last_fullsized":"2024-09-13T06:44:33.193409+0000","mapping_epoch":288,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":289,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_clean_scrub_stamp":"2024-09-13T06:39:16.508974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:06:07.380573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00097079800000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"277'694","reported_seq":7059,"reported_epoch":303,"state":"active+clean","last_fresh":"2024-09-13T06:44:32.807955+0000","last_change":"2024-09-13T06:44:05.440674+0000","last_active":"2024-09-13T06:44:32.807955+0000","last_peered":"2024-09-13T06:44:32.807955+0000","last_clean":"2024-09-13T06:44:32.807955+0000","last_became_active":"2024-09-13T06:42:32.413006+0000","last_became_peered":"2024-09-13T06:42:32.413006+0000","last_unstale":"2024-09-13T06:44:32.807955+0000","last_undegraded":"2024-09-13T06:44:32.807955+0000","last_fullsized":"2024-09-13T06:44:32.807955+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":694,"log_dups_size":0,"ondisk_log_size":694,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:38:01.774494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001338379,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6521,"num_read_kb":33119,"num_write":812,"num_write_kb":30039,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":213,"num_bytes_recovered":15100645,"num_keys_recovered":11,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":181,"reported_epoch":305,"state":"active+clean","last_fresh":"2024-09-13T06:44:34.866142+0000","last_change":"2024-09-13T06:42:28.563276+0000","last_active":"2024-09-13T06:44:34.866142+0000","last_peered":"2024-09-13T06:44:34.866142+0000","last_clean":"2024-09-13T06:44:34.866142+0000","last_became_active":"2024-09-13T06:42:28.562827+0000","last_became_peered":"2024-09-13T06:42:28.562827+0000","last_unstale":"2024-09-13T06:44:34.866142+0000","last_undegraded":"2024-09-13T06:44:34.866142+0000","last_fullsized":"2024-09-13T06:44:34.866142+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_clean_scrub_stamp":"2024-09-13T06:39:16.508974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:10:47.285603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"277'961","reported_seq":6890,"reported_epoch":303,"state":"active+clean","last_fresh":"2024-09-13T06:44:33.193159+0000","last_change":"2024-09-13T06:44:22.455582+0000","last_active":"2024-09-13T06:44:33.193159+0000","last_peered":"2024-09-13T06:44:33.193159+0000","last_clean":"2024-09-13T06:44:33.193159+0000","last_became_active":"2024-09-13T06:44:22.450933+0000","last_became_peered":"2024-09-13T06:44:22.450933+0000","last_unstale":"2024-09-13T06:44:33.193159+0000","last_undegraded":"2024-09-13T06:44:33.193159+0000","last_fullsized":"2024-09-13T06:44:33.193159+0000","mapping_epoch":292,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":293,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":961,"log_dups_size":0,"ondisk_log_size":961,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:30:26.327840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0031147280000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7705,"num_read_kb":38648,"num_write":1332,"num_write_kb":32653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":354,"num_bytes_recovered":6765835,"num_keys_recovered":11,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":23,"reported_epoch":303,"state":"active+clean","last_fresh":"2024-09-13T06:44:33.193244+0000","last_change":"2024-09-13T06:44:18.468145+0000","last_active":"2024-09-13T06:44:33.193244+0000","last_peered":"2024-09-13T06:44:33.193244+0000","last_clean":"2024-09-13T06:44:33.193244+0000","last_became_active":"2024-09-13T06:44:18.467833+0000","last_became_peered":"2024-09-13T06:44:18.467833+0000","last_unstale":"2024-09-13T06:44:33.193244+0000","last_undegraded":"2024-09-13T06:44:33.193244+0000","last_fullsized":"2024-09-13T06:44:33.193244+0000","mapping_epoch":288,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":289,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_clean_scrub_stamp":"2024-09-13T06:39:16.508974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:33:56.156376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"277'640","reported_seq":7754,"reported_epoch":302,"state":"active+clean","last_fresh":"2024-09-13T06:44:31.833497+0000","last_change":"2024-09-13T06:44:30.803125+0000","last_active":"2024-09-13T06:44:31.833497+0000","last_peered":"2024-09-13T06:44:31.833497+0000","last_clean":"2024-09-13T06:44:31.833497+0000","last_became_active":"2024-09-13T06:44:30.797769+0000","last_became_peered":"2024-09-13T06:44:30.797769+0000","last_unstale":"2024-09-13T06:44:31.833497+0000","last_undegraded":"2024-09-13T06:44:31.833497+0000","last_fullsized":"2024-09-13T06:44:31.833497+0000","mapping_epoch":300,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":301,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":640,"log_dups_size":0,"ondisk_log_size":640,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:49:47.340041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0046689339999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7611,"num_read_kb":41345,"num_write":1018,"num_write_kb":26620,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":158,"num_bytes_recovered":4212424,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"280'991","reported_seq":21073,"reported_epoch":303,"state":"active+clean","last_fresh":"2024-09-13T06:44:33.193970+0000","last_change":"2024-09-13T06:44:28.773729+0000","last_active":"2024-09-13T06:44:33.193970+0000","last_peered":"2024-09-13T06:44:33.193970+0000","last_clean":"2024-09-13T06:44:33.193970+0000","last_became_active":"2024-09-13T06:44:28.768976+0000","last_became_peered":"2024-09-13T06:44:28.768976+0000","last_unstale":"2024-09-13T06:44:33.193970+0000","last_undegraded":"2024-09-13T06:44:33.193970+0000","last_fullsized":"2024-09-13T06:44:33.193970+0000","mapping_epoch":298,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":299,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":991,"log_dups_size":0,"ondisk_log_size":991,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:30:21.817297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0017436419999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20994,"num_read_kb":92583,"num_write":1315,"num_write_kb":30385,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":207,"num_bytes_recovered":9898606,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"20'2","reported_seq":124,"reported_epoch":302,"state":"active+clean","last_fresh":"2024-09-13T06:44:31.833267+0000","last_change":"2024-09-13T06:44:30.794941+0000","last_active":"2024-09-13T06:44:31.833267+0000","last_peered":"2024-09-13T06:44:31.833267+0000","last_clean":"2024-09-13T06:44:31.833267+0000","last_became_active":"2024-09-13T06:44:30.794134+0000","last_became_peered":"2024-09-13T06:44:30.794134+0000","last_unstale":"2024-09-13T06:44:31.833267+0000","last_undegraded":"2024-09-13T06:44:31.833267+0000","last_fullsized":"2024-09-13T06:44:31.833267+0000","mapping_epoch":300,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":301,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_clean_scrub_stamp":"2024-09-13T06:39:16.508974+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:36:10.351897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":57,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"278'857","reported_seq":10771,"reported_epoch":303,"state":"active+clean","last_fresh":"2024-09-13T06:44:33.193137+0000","last_change":"2024-09-13T06:44:21.445836+0000","last_active":"2024-09-13T06:44:33.193137+0000","last_peered":"2024-09-13T06:44:33.193137+0000","last_clean":"2024-09-13T06:44:33.193137+0000","last_became_active":"2024-09-13T06:44:21.442847+0000","last_became_peered":"2024-09-13T06:44:21.442847+0000","last_unstale":"2024-09-13T06:44:33.193137+0000","last_undegraded":"2024-09-13T06:44:33.193137+0000","last_fullsized":"2024-09-13T06:44:33.193137+0000","mapping_epoch":291,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":292,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":857,"log_dups_size":0,"ondisk_log_size":857,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:42:10.542267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00053211199999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11278,"num_read_kb":63107,"num_write":1190,"num_write_kb":36968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":351,"num_bytes_recovered":9847094,"num_keys_recovered":11,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":25,"reported_epoch":303,"state":"active+clean","last_fresh":"2024-09-13T06:44:33.193124+0000","last_change":"2024-09-13T06:44:17.443833+0000","last_active":"2024-09-13T06:44:33.193124+0000","last_peered":"2024-09-13T06:44:33.193124+0000","last_clean":"2024-09-13T06:44:33.193124+0000","last_became_active":"2024-09-13T06:44:17.443358+0000","last_became_peered":"2024-09-13T06:44:17.443358+0000","last_unstale":"2024-09-13T06:44:33.193124+0000","last_undegraded":"2024-09-13T06:44:33.193124+0000","last_fullsized":"2024-09-13T06:44:33.193124+0000","mapping_epoch":287,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":288,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_clean_scrub_stamp":"2024-09-13T06:39:16.508974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:30:37.013428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00033592499999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"277'1115","reported_seq":6257,"reported_epoch":302,"state":"active+clean","last_fresh":"2024-09-13T06:44:31.793979+0000","last_change":"2024-09-13T06:44:30.799789+0000","last_active":"2024-09-13T06:44:31.793979+0000","last_peered":"2024-09-13T06:44:31.793979+0000","last_clean":"2024-09-13T06:44:31.793979+0000","last_became_active":"2024-09-13T06:44:30.798508+0000","last_became_peered":"2024-09-13T06:44:30.798508+0000","last_unstale":"2024-09-13T06:44:31.793979+0000","last_undegraded":"2024-09-13T06:44:31.793979+0000","last_fullsized":"2024-09-13T06:44:31.793979+0000","mapping_epoch":300,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":301,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":1115,"log_dups_size":0,"ondisk_log_size":1115,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:04:47.174299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0032283849999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7964,"num_read_kb":36198,"num_write":1645,"num_write_kb":33105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":243,"num_bytes_recovered":7863454,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":197,"reported_epoch":303,"state":"active+clean","last_fresh":"2024-09-13T06:44:32.805107+0000","last_change":"2024-09-13T06:44:18.457601+0000","last_active":"2024-09-13T06:44:32.805107+0000","last_peered":"2024-09-13T06:44:32.805107+0000","last_clean":"2024-09-13T06:44:32.805107+0000","last_became_active":"2024-09-13T06:44:18.456828+0000","last_became_peered":"2024-09-13T06:44:18.456828+0000","last_unstale":"2024-09-13T06:44:32.805107+0000","last_undegraded":"2024-09-13T06:44:32.805107+0000","last_fullsized":"2024-09-13T06:44:32.805107+0000","mapping_epoch":288,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":289,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_clean_scrub_stamp":"2024-09-13T06:39:16.508974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:17:09.082426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"279'349","reported_seq":3762,"reported_epoch":303,"state":"active+clean","last_fresh":"2024-09-13T06:44:32.807410+0000","last_change":"2024-09-13T06:44:05.440371+0000","last_active":"2024-09-13T06:44:32.807410+0000","last_peered":"2024-09-13T06:44:32.807410+0000","last_clean":"2024-09-13T06:44:32.807410+0000","last_became_active":"2024-09-13T06:41:15.399301+0000","last_became_peered":"2024-09-13T06:41:15.399301+0000","last_unstale":"2024-09-13T06:44:32.807410+0000","last_undegraded":"2024-09-13T06:44:32.807410+0000","last_fullsized":"2024-09-13T06:44:32.807410+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":349,"log_dups_size":0,"ondisk_log_size":349,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:53:18.137873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001343293,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2523,"num_read_kb":19829,"num_write":427,"num_write_kb":20943,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":169,"num_bytes_recovered":5233325,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"18'1","reported_seq":55,"reported_epoch":302,"state":"active+clean","last_fresh":"2024-09-13T06:44:31.833265+0000","last_change":"2024-09-13T06:44:30.798045+0000","last_active":"2024-09-13T06:44:31.833265+0000","last_peered":"2024-09-13T06:44:31.833265+0000","last_clean":"2024-09-13T06:44:31.833265+0000","last_became_active":"2024-09-13T06:44:30.796877+0000","last_became_peered":"2024-09-13T06:44:30.796877+0000","last_unstale":"2024-09-13T06:44:31.833265+0000","last_undegraded":"2024-09-13T06:44:31.833265+0000","last_fullsized":"2024-09-13T06:44:31.833265+0000","mapping_epoch":300,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":301,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_clean_scrub_stamp":"2024-09-13T06:39:16.508974+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:33:04.298167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":397,"reported_epoch":303,"state":"active+clean","last_fresh":"2024-09-13T06:44:32.805140+0000","last_change":"2024-09-13T06:42:28.563168+0000","last_active":"2024-09-13T06:44:32.805140+0000","last_peered":"2024-09-13T06:44:32.805140+0000","last_clean":"2024-09-13T06:44:32.805140+0000","last_became_active":"2024-09-13T06:42:28.562642+0000","last_became_peered":"2024-09-13T06:42:28.562642+0000","last_unstale":"2024-09-13T06:44:32.805140+0000","last_undegraded":"2024-09-13T06:44:32.805140+0000","last_fullsized":"2024-09-13T06:44:32.805140+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:10.110558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:10.110558+0000","last_clean_scrub_stamp":"2024-09-13T06:39:10.110558+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:05:54.866043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"277'651","reported_seq":10850,"reported_epoch":303,"state":"active+clean","last_fresh":"2024-09-13T06:44:32.807285+0000","last_change":"2024-09-13T06:44:22.452634+0000","last_active":"2024-09-13T06:44:32.807285+0000","last_peered":"2024-09-13T06:44:32.807285+0000","last_clean":"2024-09-13T06:44:32.807285+0000","last_became_active":"2024-09-13T06:44:22.448736+0000","last_became_peered":"2024-09-13T06:44:22.448736+0000","last_unstale":"2024-09-13T06:44:32.807285+0000","last_undegraded":"2024-09-13T06:44:32.807285+0000","last_fullsized":"2024-09-13T06:44:32.807285+0000","mapping_epoch":292,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":293,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":651,"log_dups_size":0,"ondisk_log_size":651,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:58:40.103969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00083432600000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9552,"num_read_kb":46146,"num_write":828,"num_write_kb":32512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":446,"num_bytes_recovered":11977587,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"277'774","reported_seq":10943,"reported_epoch":303,"state":"active+clean","last_fresh":"2024-09-13T06:44:33.192916+0000","last_change":"2024-09-13T06:44:20.466493+0000","last_active":"2024-09-13T06:44:33.192916+0000","last_peered":"2024-09-13T06:44:33.192916+0000","last_clean":"2024-09-13T06:44:33.192916+0000","last_became_active":"2024-09-13T06:44:20.462849+0000","last_became_peered":"2024-09-13T06:44:20.462849+0000","last_unstale":"2024-09-13T06:44:33.192916+0000","last_undegraded":"2024-09-13T06:44:33.192916+0000","last_fullsized":"2024-09-13T06:44:33.192916+0000","mapping_epoch":290,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":291,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":774,"log_dups_size":0,"ondisk_log_size":774,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:40:44.119462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0024338839999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10729,"num_read_kb":51645,"num_write":931,"num_write_kb":34617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":445,"num_bytes_recovered":16579571,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"278'758","reported_seq":8282,"reported_epoch":305,"state":"active+clean","last_fresh":"2024-09-13T06:44:34.842308+0000","last_change":"2024-09-13T06:44:34.842308+0000","last_active":"2024-09-13T06:44:34.842308+0000","last_peered":"2024-09-13T06:44:34.842308+0000","last_clean":"2024-09-13T06:44:34.842308+0000","last_became_active":"2024-09-13T06:44:34.836417+0000","last_became_peered":"2024-09-13T06:44:34.836417+0000","last_unstale":"2024-09-13T06:44:34.842308+0000","last_undegraded":"2024-09-13T06:44:34.842308+0000","last_fullsized":"2024-09-13T06:44:34.842308+0000","mapping_epoch":304,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":305,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":758,"log_dups_size":0,"ondisk_log_size":758,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:44:55.089545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00085210600000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8422,"num_read_kb":47219,"num_write":883,"num_write_kb":28077,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":515,"num_bytes_recovered":28581300,"num_keys_recovered":111,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"271'845","reported_seq":5601,"reported_epoch":303,"state":"active+clean","last_fresh":"2024-09-13T06:44:32.807674+0000","last_change":"2024-09-13T06:44:05.439827+0000","last_active":"2024-09-13T06:44:32.807674+0000","last_peered":"2024-09-13T06:44:32.807674+0000","last_clean":"2024-09-13T06:44:32.807674+0000","last_became_active":"2024-09-13T06:41:15.399204+0000","last_became_peered":"2024-09-13T06:41:15.399204+0000","last_unstale":"2024-09-13T06:44:32.807674+0000","last_undegraded":"2024-09-13T06:44:32.807674+0000","last_fullsized":"2024-09-13T06:44:32.807674+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":845,"log_dups_size":0,"ondisk_log_size":845,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:27:03.298272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00094468700000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6686,"num_read_kb":57840,"num_write":1181,"num_write_kb":24665,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":117,"num_bytes_recovered":13256568,"num_keys_recovered":44,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"279'569","reported_seq":6602,"reported_epoch":302,"state":"active+clean","last_fresh":"2024-09-13T06:44:31.833489+0000","last_change":"2024-09-13T06:44:30.802655+0000","last_active":"2024-09-13T06:44:31.833489+0000","last_peered":"2024-09-13T06:44:31.833489+0000","last_clean":"2024-09-13T06:44:31.833489+0000","last_became_active":"2024-09-13T06:44:30.794873+0000","last_became_peered":"2024-09-13T06:44:30.794873+0000","last_unstale":"2024-09-13T06:44:31.833489+0000","last_undegraded":"2024-09-13T06:44:31.833489+0000","last_fullsized":"2024-09-13T06:44:31.833489+0000","mapping_epoch":300,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":301,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":569,"log_dups_size":0,"ondisk_log_size":569,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:26:59.771063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0027493119999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6187,"num_read_kb":31727,"num_write":657,"num_write_kb":25682,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":184,"num_bytes_recovered":16410936,"num_keys_recovered":88,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"277'881","reported_seq":2923,"reported_epoch":303,"state":"active+clean","last_fresh":"2024-09-13T06:44:32.805567+0000","last_change":"2024-09-13T06:44:05.458093+0000","last_active":"2024-09-13T06:44:32.805567+0000","last_peered":"2024-09-13T06:44:32.805567+0000","last_clean":"2024-09-13T06:44:32.805567+0000","last_became_active":"2024-09-13T06:42:32.411927+0000","last_became_peered":"2024-09-13T06:42:32.411927+0000","last_unstale":"2024-09-13T06:44:32.805567+0000","last_undegraded":"2024-09-13T06:44:32.805567+0000","last_fullsized":"2024-09-13T06:44:32.805567+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":881,"log_dups_size":0,"ondisk_log_size":881,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:40:44.787780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.003013108,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4846,"num_read_kb":26164,"num_write":1518,"num_write_kb":30083,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":140,"num_bytes_recovered":11278110,"num_keys_recovered":11,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.e","version":"277'556","reported_seq":4102,"reported_epoch":303,"state":"active+clean","last_fresh":"2024-09-13T06:44:32.805528+0000","last_change":"2024-09-13T06:44:30.808041+0000","last_active":"2024-09-13T06:44:32.805528+0000","last_peered":"2024-09-13T06:44:32.805528+0000","last_clean":"2024-09-13T06:44:32.805528+0000","last_became_active":"2024-09-13T06:44:30.801655+0000","last_became_peered":"2024-09-13T06:44:30.801655+0000","last_unstale":"2024-09-13T06:44:32.805528+0000","last_undegraded":"2024-09-13T06:44:32.805528+0000","last_fullsized":"2024-09-13T06:44:32.805528+0000","mapping_epoch":300,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":301,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":556,"log_dups_size":0,"ondisk_log_size":556,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:43:53.489080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0025767619999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3868,"num_read_kb":43567,"num_write":654,"num_write_kb":29232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":503,"num_bytes_recovered":12695191,"num_keys_recovered":11,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"277'665","reported_seq":4754,"reported_epoch":303,"state":"active+clean","last_fresh":"2024-09-13T06:44:32.805508+0000","last_change":"2024-09-13T06:44:05.458214+0000","last_active":"2024-09-13T06:44:32.805508+0000","last_peered":"2024-09-13T06:44:32.805508+0000","last_clean":"2024-09-13T06:44:32.805508+0000","last_became_active":"2024-09-13T06:42:33.412054+0000","last_became_peered":"2024-09-13T06:42:33.412054+0000","last_unstale":"2024-09-13T06:44:32.805508+0000","last_undegraded":"2024-09-13T06:44:32.805508+0000","last_fullsized":"2024-09-13T06:44:32.805508+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":665,"log_dups_size":0,"ondisk_log_size":665,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:07:06.963404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00285659,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4677,"num_read_kb":45287,"num_write":982,"num_write_kb":45285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":394,"num_bytes_recovered":42768786,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.10","version":"280'832","reported_seq":5035,"reported_epoch":304,"state":"active+clean","last_fresh":"2024-09-13T06:44:33.831977+0000","last_change":"2024-09-13T06:44:19.467239+0000","last_active":"2024-09-13T06:44:33.831977+0000","last_peered":"2024-09-13T06:44:33.831977+0000","last_clean":"2024-09-13T06:44:33.831977+0000","last_became_active":"2024-09-13T06:44:19.459617+0000","last_became_peered":"2024-09-13T06:44:19.459617+0000","last_unstale":"2024-09-13T06:44:33.831977+0000","last_undegraded":"2024-09-13T06:44:33.831977+0000","last_fullsized":"2024-09-13T06:44:33.831977+0000","mapping_epoch":289,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":290,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":832,"log_dups_size":0,"ondisk_log_size":832,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:43:55.736868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0018779840000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5715,"num_read_kb":29614,"num_write":1142,"num_write_kb":36190,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":275,"num_bytes_recovered":6622441,"num_keys_recovered":20,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.11","version":"279'502","reported_seq":6279,"reported_epoch":303,"state":"active+clean","last_fresh":"2024-09-13T06:44:32.805097+0000","last_change":"2024-09-13T06:44:05.455675+0000","last_active":"2024-09-13T06:44:32.805097+0000","last_peered":"2024-09-13T06:44:32.805097+0000","last_clean":"2024-09-13T06:44:32.805097+0000","last_became_active":"2024-09-13T06:42:33.411668+0000","last_became_peered":"2024-09-13T06:42:33.411668+0000","last_unstale":"2024-09-13T06:44:32.805097+0000","last_undegraded":"2024-09-13T06:44:32.805097+0000","last_fullsized":"2024-09-13T06:44:32.805097+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":502,"log_dups_size":0,"ondisk_log_size":502,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:43:01.814094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001270492,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5341,"num_read_kb":34087,"num_write":659,"num_write_kb":25712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":245,"num_bytes_recovered":7089272,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"280'921","reported_seq":5046,"reported_epoch":302,"state":"active+clean","last_fresh":"2024-09-13T06:44:31.794105+0000","last_change":"2024-09-13T06:44:20.470378+0000","last_active":"2024-09-13T06:44:31.794105+0000","last_peered":"2024-09-13T06:44:31.794105+0000","last_clean":"2024-09-13T06:44:31.794105+0000","last_became_active":"2024-09-13T06:44:20.466713+0000","last_became_peered":"2024-09-13T06:44:20.466713+0000","last_unstale":"2024-09-13T06:44:31.794105+0000","last_undegraded":"2024-09-13T06:44:31.794105+0000","last_fullsized":"2024-09-13T06:44:31.794105+0000","mapping_epoch":290,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":291,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":921,"log_dups_size":0,"ondisk_log_size":921,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:00:14.406068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0017683250000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6025,"num_read_kb":38947,"num_write":1315,"num_write_kb":35656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":107,"num_bytes_recovered":3682200,"num_keys_recovered":21,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"279'604","reported_seq":4546,"reported_epoch":303,"state":"active+clean","last_fresh":"2024-09-13T06:44:32.805143+0000","last_change":"2024-09-13T06:44:05.454984+0000","last_active":"2024-09-13T06:44:32.805143+0000","last_peered":"2024-09-13T06:44:32.805143+0000","last_clean":"2024-09-13T06:44:32.805143+0000","last_became_active":"2024-09-13T06:42:31.402800+0000","last_became_peered":"2024-09-13T06:42:31.402800+0000","last_unstale":"2024-09-13T06:44:32.805143+0000","last_undegraded":"2024-09-13T06:44:32.805143+0000","last_fullsized":"2024-09-13T06:44:32.805143+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":604,"log_dups_size":0,"ondisk_log_size":604,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:59:41.167052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010470779999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4471,"num_read_kb":35894,"num_write":884,"num_write_kb":31515,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":196,"num_bytes_recovered":8224568,"num_keys_recovered":11,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":19,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":237282,"num_read_kb":1402862,"num_write":33322,"num_write_kb":1008910,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9249,"num_bytes_recovered":443628516,"num_keys_recovered":867,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14648,"internal_metadata":0},"log_size":24486,"ondisk_log_size":24486,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":57,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":3}],"osd_stats":[{"osd":7,"up_from":187,"seq":803158884380,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37040,"kb_used_data":4196,"kb_used_omap":9,"kb_used_meta":32822,"kb_avail":94334800,"statfs":{"total":96636764160,"available":96598835200,"internally_reserved":0,"allocated":4296704,"data_stored":2446923,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9685,"internal_metadata":33610283},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 06:44:33 2024","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":0.71199999999999997,"15min":0.69799999999999995},"min":{"1min":0.56699999999999995,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.83599999999999997},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.751,"15min":0.73999999999999999},"min":{"1min":0.54600000000000004,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.6910000000000001,"5min":1.6910000000000001,"15min":1.6910000000000001},"last":0.90100000000000002}]},{"osd":1,"last update":"Fri Sep 13 06:44:33 2024","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.75700000000000001,"15min":0.751},"min":{"1min":0.57399999999999995,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.359,"5min":1.359,"15min":1.359},"last":0.86699999999999999},{"interface":"front","average":{"1min":0.82399999999999995,"5min":0.71599999999999997,"15min":0.69799999999999995},"min":{"1min":0.496,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.1259999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.93899999999999995}]},{"osd":2,"last update":"Fri Sep 13 06:44:33 2024","interfaces":[{"interface":"back","average":{"1min":0.80700000000000005,"5min":0.75900000000000001,"15min":0.751},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.2030000000000001,"5min":1.212,"15min":1.212},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.92200000000000004,"5min":0.81499999999999995,"15min":0.79700000000000004},"min":{"1min":0.58999999999999997,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.4319999999999999,"5min":1.4319999999999999,"15min":1.4319999999999999},"last":0.97699999999999998}]},{"osd":3,"last update":"Fri Sep 13 06:44:33 2024","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.79600000000000004,"15min":0.79200000000000004},"min":{"1min":0.60299999999999998,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.177,"5min":1.177,"15min":1.177},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.88600000000000001,"5min":0.84299999999999997,"15min":0.83599999999999997},"min":{"1min":0.48099999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.7350000000000001,"5min":1.7350000000000001,"15min":1.7350000000000001},"last":1.008}]},{"osd":4,"last update":"Fri Sep 13 06:44:33 2024","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.82299999999999995,"15min":0.82499999999999996},"min":{"1min":0.45500000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.405,"5min":1.405,"15min":1.405},"last":0.628},{"interface":"front","average":{"1min":1.0049999999999999,"5min":0.82299999999999995,"15min":0.79300000000000004},"min":{"1min":0.39800000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.6240000000000001,"5min":1.6240000000000001,"15min":1.6240000000000001},"last":1.137}]},{"osd":5,"last update":"Fri Sep 13 06:44:33 2024","interfaces":[{"interface":"back","average":{"1min":0.96599999999999997,"5min":0.88800000000000001,"15min":0.875},"min":{"1min":0.504,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.593,"5min":1.593,"15min":1.593},"last":1.036},{"interface":"front","average":{"1min":0.92300000000000004,"5min":0.84099999999999997,"15min":0.82699999999999996},"min":{"1min":0.53800000000000003,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.3400000000000001,"5min":1.3400000000000001,"15min":1.3400000000000001},"last":1.0620000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1619999999999999}]}]},{"osd":6,"up_from":286,"seq":1228360646662,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35504,"kb_used_data":3620,"kb_used_omap":7,"kb_used_meta":31864,"kb_avail":94336336,"statfs":{"total":96636764160,"available":96600408064,"internally_reserved":0,"allocated":3706880,"data_stored":1857127,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8145,"internal_metadata":32628783},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.877}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77700000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.046}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83399999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2090000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3360000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.254}]}]},{"osd":5,"up_from":13,"seq":55834574917,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":79004,"kb_used_data":3596,"kb_used_omap":1,"kb_used_meta":75390,"kb_avail":94292836,"statfs":{"total":96636764160,"available":96555864064,"internally_reserved":0,"allocated":3682304,"data_stored":1844890,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":77199814},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 06:44:19 2024","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.71399999999999997,"15min":0.76500000000000001},"min":{"1min":0.40999999999999998,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":1.093,"5min":1.6679999999999999,"15min":1.6679999999999999},"last":0.94599999999999995},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.76900000000000002,"15min":0.79900000000000004},"min":{"1min":0.41299999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.1220000000000001,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":0.98799999999999999}]},{"osd":1,"last update":"Fri Sep 13 06:44:19 2024","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.73999999999999999,"15min":0.751},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":1.103,"5min":1.341,"15min":1.341},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.70099999999999996,"15min":0.74099999999999999},"min":{"1min":0.40899999999999997,"5min":0.317,"15min":0.317},"max":{"1min":1.0089999999999999,"5min":1.722,"15min":1.722},"last":0.63800000000000001}]},{"osd":2,"last update":"Fri Sep 13 06:44:19 2024","interfaces":[{"interface":"back","average":{"1min":0.876,"5min":0.81999999999999995,"15min":0.86399999999999999},"min":{"1min":0.47699999999999998,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.143,"5min":1.833,"15min":1.833},"last":0.91000000000000003},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.79200000000000004},"min":{"1min":0.47999999999999998,"5min":0.435,"15min":0.435},"max":{"1min":1.0169999999999999,"5min":1.4279999999999999,"15min":1.4279999999999999},"last":1.1459999999999999}]},{"osd":3,"last update":"Fri Sep 13 06:44:19 2024","interfaces":[{"interface":"back","average":{"1min":0.85699999999999998,"5min":0.81399999999999995,"15min":0.78000000000000003},"min":{"1min":0.45400000000000001,"5min":0.434,"15min":0.434},"max":{"1min":1.1659999999999999,"5min":1.885,"15min":1.885},"last":0.82399999999999995},{"interface":"front","average":{"1min":0.85899999999999999,"5min":0.86299999999999999,"15min":0.86499999999999999},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.2410000000000001,"5min":1.907,"15min":1.907},"last":1.099}]},{"osd":4,"last update":"Fri Sep 13 06:44:19 2024","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.83499999999999996,"15min":0.80500000000000005},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":1.159,"5min":6.3179999999999996,"15min":6.3179999999999996},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.78000000000000003,"5min":1.0529999999999999,"15min":0.91000000000000003},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":1.2370000000000001,"5min":15.553000000000001,"15min":15.553000000000001},"last":0.85599999999999998}]},{"osd":6,"last update":"Fri Sep 13 06:42:12 2024","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.86299999999999999,"15min":0.877},"min":{"1min":0.40000000000000002,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.9610000000000001,"5min":1.9610000000000001,"15min":1.9610000000000001},"last":1.04},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.86099999999999999,"15min":0.87},"min":{"1min":0.39000000000000001,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.206,"5min":1.968,"15min":1.968},"last":1.1890000000000001}]},{"osd":7,"last update":"Fri Sep 13 06:44:31 2024","interfaces":[{"interface":"back","average":{"1min":0.96399999999999997,"5min":0.84399999999999997,"15min":0.82399999999999995},"min":{"1min":0.39000000000000001,"5min":0.373,"15min":0.373},"max":{"1min":1.2050000000000001,"5min":1.375,"15min":1.375},"last":1.0700000000000001},{"interface":"front","average":{"1min":0.997,"5min":0.89800000000000002,"15min":0.88200000000000001},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":1.7050000000000001,"5min":1.7050000000000001,"15min":1.7050000000000001},"last":1.2909999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574917,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60968,"kb_used_data":3612,"kb_used_omap":1,"kb_used_meta":57342,"kb_avail":94310872,"statfs":{"total":96636764160,"available":96574332928,"internally_reserved":0,"allocated":3698688,"data_stored":1851304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":58718662},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 06:44:15 2024","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.79300000000000004,"15min":0.98999999999999999},"min":{"1min":0.41499999999999998,"5min":0.245,"15min":0.245},"max":{"1min":1.0720000000000001,"5min":5.8230000000000004,"15min":5.8230000000000004},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.71999999999999997,"15min":0.752},"min":{"1min":0.505,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.97299999999999998,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":1.018}]},{"osd":1,"last update":"Fri Sep 13 06:44:15 2024","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.79300000000000004,"15min":0.75},"min":{"1min":0.45100000000000001,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.86899999999999999,"5min":10.156000000000001,"15min":10.156000000000001},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.747,"5min":0.77500000000000002,"15min":0.83599999999999997},"min":{"1min":0.496,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.0349999999999999,"5min":1.286,"15min":1.286},"last":0.93100000000000005}]},{"osd":2,"last update":"Fri Sep 13 06:44:15 2024","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.751,"15min":0.82299999999999995},"min":{"1min":0.52800000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":1.0109999999999999,"5min":1.6000000000000001,"15min":1.6000000000000001},"last":1.0409999999999999},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.81299999999999994},"min":{"1min":0.65500000000000003,"5min":0.374,"15min":0.374},"max":{"1min":1.167,"5min":1.3540000000000001,"15min":1.3540000000000001},"last":0.79100000000000004}]},{"osd":3,"last update":"Fri Sep 13 06:44:15 2024","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.84699999999999998,"15min":0.90200000000000002},"min":{"1min":0.57499999999999996,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.6950000000000001,"5min":1.6950000000000001,"15min":1.6950000000000001},"last":1.101},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.95299999999999996,"15min":0.92500000000000004},"min":{"1min":0.48499999999999999,"5min":0.374,"15min":0.374},"max":{"1min":1.8069999999999999,"5min":10.195,"15min":10.195},"last":0.98999999999999999}]},{"osd":5,"last update":"Fri Sep 13 06:44:15 2024","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.81499999999999995,"15min":0.85699999999999998},"min":{"1min":0.443,"5min":0.249,"15min":0.249},"max":{"1min":1.075,"5min":2.9790000000000001,"15min":2.9790000000000001},"last":0.85199999999999998},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.84399999999999997,"15min":0.91400000000000003},"min":{"1min":0.39700000000000002,"5min":0.372,"15min":0.372},"max":{"1min":1.0580000000000001,"5min":1.8779999999999999,"15min":1.8779999999999999},"last":0.872}]},{"osd":6,"last update":"Fri Sep 13 06:42:14 2024","interfaces":[{"interface":"back","average":{"1min":0.90100000000000002,"5min":0.92100000000000004,"15min":0.82899999999999996},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":1.6100000000000001,"5min":10.016999999999999,"15min":10.016999999999999},"last":0.96699999999999997},{"interface":"front","average":{"1min":0.86699999999999999,"5min":0.93300000000000005,"15min":0.95999999999999996},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.2030000000000001,"5min":2.0750000000000002,"15min":2.0750000000000002},"last":0.82399999999999995}]},{"osd":7,"last update":"Fri Sep 13 06:44:33 2024","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.1539999999999999,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.90500000000000003},{"interface":"front","average":{"1min":0.90400000000000003,"5min":0.89200000000000002,"15min":0.89000000000000001},"min":{"1min":0.505,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.2529999999999999,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":1.073}]}]},{"osd":3,"up_from":13,"seq":55834574920,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":74920,"kb_used_data":3608,"kb_used_omap":1,"kb_used_meta":71294,"kb_avail":94296920,"statfs":{"total":96636764160,"available":96560046080,"internally_reserved":0,"allocated":3694592,"data_stored":1851285,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":73005512},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 06:44:15 2024","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.56100000000000005,"15min":0.56899999999999995},"min":{"1min":0.24199999999999999,"5min":0.191,"15min":0.191},"max":{"1min":1.51,"5min":1.51,"15min":1.51},"last":1.0780000000000001},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.60599999999999998,"15min":0.65400000000000003},"min":{"1min":0.307,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.88900000000000001,"5min":1.2789999999999999,"15min":1.2789999999999999},"last":0.73299999999999998}]},{"osd":1,"last update":"Fri Sep 13 06:44:15 2024","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.54900000000000004,"15min":0.58599999999999997},"min":{"1min":0.29499999999999998,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.85399999999999998,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.59999999999999998,"15min":0.66800000000000004},"min":{"1min":0.27700000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":1.607,"5min":1.607,"15min":1.607},"last":0.77000000000000002}]},{"osd":2,"last update":"Fri Sep 13 06:44:15 2024","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.629,"15min":0.65200000000000002},"min":{"1min":0.30199999999999999,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":1.5660000000000001,"5min":1.5660000000000001,"15min":1.5660000000000001},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.59799999999999998,"15min":0.627},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":1.135,"5min":1.409,"15min":1.409},"last":0.86299999999999999}]},{"osd":4,"last update":"Fri Sep 13 06:44:15 2024","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.82599999999999996,"15min":0.89400000000000002},"min":{"1min":0.42899999999999999,"5min":0.377,"15min":0.377},"max":{"1min":1.651,"5min":1.7929999999999999,"15min":1.7929999999999999},"last":1.1919999999999999},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.76300000000000001,"15min":0.78300000000000003},"min":{"1min":0.44700000000000001,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.96499999999999997,"5min":1.3240000000000001,"15min":1.3240000000000001},"last":1.1559999999999999}]},{"osd":5,"last update":"Fri Sep 13 06:44:15 2024","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":0.81200000000000006,"15min":0.84999999999999998},"min":{"1min":0.48799999999999999,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.3029999999999999,"5min":1.3799999999999999,"15min":1.3799999999999999},"last":1.2529999999999999},{"interface":"front","average":{"1min":0.83099999999999996,"5min":0.82499999999999996,"15min":0.85999999999999999},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.4610000000000001,"5min":1.4610000000000001,"15min":1.4610000000000001},"last":0.95999999999999996}]},{"osd":6,"last update":"Fri Sep 13 06:42:11 2024","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.88500000000000001,"15min":0.91100000000000003},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.135,"5min":1.532,"15min":1.532},"last":1.357},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.95299999999999996,"15min":0.98999999999999999},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.2250000000000001,"5min":1.825,"15min":1.825},"last":0.99099999999999999}]},{"osd":7,"last update":"Fri Sep 13 06:43:31 2024","interfaces":[{"interface":"back","average":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.3799999999999999,"5min":1.3799999999999999,"15min":1.3799999999999999},"last":1.3009999999999999},{"interface":"front","average":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":2.0459999999999998,"5min":2.0459999999999998,"15min":2.0459999999999998},"last":1.4219999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574917,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60964,"kb_used_data":3608,"kb_used_omap":1,"kb_used_meta":57342,"kb_avail":94310876,"statfs":{"total":96636764160,"available":96574337024,"internally_reserved":0,"allocated":3694592,"data_stored":1851285,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":58718662},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 06:44:20 2024","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.66800000000000004,"15min":0.56200000000000006},"min":{"1min":0.19400000000000001,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.84199999999999997,"5min":8.6449999999999996,"15min":8.6449999999999996},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.65200000000000002,"15min":0.61099999999999999},"min":{"1min":0.30299999999999999,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":1.4410000000000001,"5min":4.0380000000000003,"15min":4.0380000000000003},"last":0.67800000000000005}]},{"osd":1,"last update":"Fri Sep 13 06:44:20 2024","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.64000000000000001,"15min":0.62},"min":{"1min":0.25,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":1.0329999999999999,"5min":3.4649999999999999,"15min":3.4649999999999999},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.66600000000000004,"15min":0.60299999999999998},"min":{"1min":0.34300000000000003,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":1.5049999999999999,"5min":3.8159999999999998,"15min":3.8159999999999998},"last":0.97799999999999998}]},{"osd":3,"last update":"Fri Sep 13 06:44:20 2024","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.65000000000000002,"15min":0.58599999999999997},"min":{"1min":0.36399999999999999,"5min":0.249,"15min":0.249},"max":{"1min":1.044,"5min":3.407,"15min":3.407},"last":0.755},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.73599999999999999,"15min":0.68600000000000005},"min":{"1min":0.312,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.238,"5min":3.2639999999999998,"15min":3.2639999999999998},"last":0.63900000000000001}]},{"osd":4,"last update":"Fri Sep 13 06:44:20 2024","interfaces":[{"interface":"back","average":{"1min":0.83299999999999996,"5min":0.878,"15min":0.88500000000000001},"min":{"1min":0.45600000000000002,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.3759999999999999,"5min":3.1179999999999999,"15min":3.1179999999999999},"last":0.83699999999999997},{"interface":"front","average":{"1min":0.81399999999999995,"5min":1.0620000000000001,"15min":0.94099999999999995},"min":{"1min":0.46800000000000003,"5min":0.439,"15min":0.439},"max":{"1min":1.359,"5min":21.081,"15min":21.081},"last":0.873}]},{"osd":5,"last update":"Fri Sep 13 06:44:20 2024","interfaces":[{"interface":"back","average":{"1min":0.82999999999999996,"5min":0.84799999999999998,"15min":0.84299999999999997},"min":{"1min":0.60099999999999998,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":1.143,"5min":2.2389999999999999,"15min":2.2389999999999999},"last":0.91200000000000003},{"interface":"front","average":{"1min":1.133,"5min":0.96099999999999997,"15min":0.88900000000000001},"min":{"1min":0.54400000000000004,"5min":0.377,"15min":0.377},"max":{"1min":4.9039999999999999,"5min":4.9039999999999999,"15min":4.9039999999999999},"last":0.93799999999999994}]},{"osd":6,"last update":"Fri Sep 13 06:42:15 2024","interfaces":[{"interface":"back","average":{"1min":0.86799999999999999,"5min":0.94199999999999995,"15min":0.92600000000000005},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.274,"5min":3.923,"15min":3.923},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.97799999999999998,"5min":0.90500000000000003,"15min":0.879},"min":{"1min":0.60899999999999999,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":2.2080000000000002,"5min":2.2120000000000002,"15min":2.2120000000000002},"last":1.1060000000000001}]},{"osd":7,"last update":"Fri Sep 13 06:44:33 2024","interfaces":[{"interface":"back","average":{"1min":0.95799999999999996,"5min":0.86499999999999999,"15min":0.84899999999999998},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":1.641,"5min":1.641,"15min":1.641},"last":1.032},{"interface":"front","average":{"1min":1.05,"5min":0.88600000000000001,"15min":0.85799999999999998},"min":{"1min":0.71499999999999997,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":2.0630000000000002,"5min":2.0630000000000002,"15min":2.0630000000000002},"last":1.157}]}]},{"osd":1,"up_from":13,"seq":55834574917,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52768,"kb_used_data":3600,"kb_used_omap":1,"kb_used_meta":49150,"kb_avail":94319072,"statfs":{"total":96636764160,"available":96582729728,"internally_reserved":0,"allocated":3686400,"data_stored":1844909,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":50330054},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 06:44:21 2024","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.55300000000000005,"15min":0.57299999999999995},"min":{"1min":0.246,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":1.1879999999999999,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.64200000000000002,"15min":0.65900000000000003},"min":{"1min":0.26200000000000001,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.99199999999999999,"5min":1.8160000000000001,"15min":1.8160000000000001},"last":0.77600000000000002}]},{"osd":2,"last update":"Fri Sep 13 06:44:21 2024","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.60699999999999998,"15min":0.63400000000000001},"min":{"1min":0.26800000000000002,"5min":0.22,"15min":0.22},"max":{"1min":0.92200000000000004,"5min":2.617,"15min":2.617},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.65300000000000002,"15min":0.65400000000000003},"min":{"1min":0.28499999999999998,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":1.331,"5min":2.5249999999999999,"15min":2.5249999999999999},"last":0.84299999999999997}]},{"osd":3,"last update":"Fri Sep 13 06:44:21 2024","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.70499999999999996,"15min":0.72599999999999998},"min":{"1min":0.33900000000000002,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":1.2769999999999999,"5min":1.3640000000000001,"15min":1.3640000000000001},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.66700000000000004,"15min":0.69099999999999995},"min":{"1min":0.30399999999999999,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":1.028,"5min":1.752,"15min":1.752},"last":0.68200000000000005}]},{"osd":4,"last update":"Fri Sep 13 06:44:21 2024","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.79800000000000004,"15min":0.81999999999999995},"min":{"1min":0.60899999999999999,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":1.109,"5min":2.7389999999999999,"15min":2.7389999999999999},"last":0.878},{"interface":"front","average":{"1min":0.94499999999999995,"5min":0.85499999999999998,"15min":0.90600000000000003},"min":{"1min":0.40000000000000002,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.4159999999999999,"5min":1.4359999999999999,"15min":1.4359999999999999},"last":1.046}]},{"osd":5,"last update":"Fri Sep 13 06:44:21 2024","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.84499999999999997,"15min":0.90600000000000003},"min":{"1min":0.58099999999999996,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.1399999999999999,"5min":1.7849999999999999,"15min":1.7849999999999999},"last":1.0129999999999999},{"interface":"front","average":{"1min":0.89600000000000002,"5min":0.86599999999999999,"15min":0.879},"min":{"1min":0.495,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":1.202,"5min":2.036,"15min":2.036},"last":0.93700000000000006}]},{"osd":6,"last update":"Fri Sep 13 06:42:18 2024","interfaces":[{"interface":"back","average":{"1min":0.87,"5min":0.92200000000000004,"15min":0.94399999999999995},"min":{"1min":0.57699999999999996,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.526,"5min":1.8149999999999999,"15min":1.8149999999999999},"last":0.89600000000000002},{"interface":"front","average":{"1min":0.88900000000000001,"5min":0.91200000000000003,"15min":0.91900000000000004},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":2.7810000000000001,"5min":2.7810000000000001,"15min":2.7810000000000001},"last":1.0840000000000001}]},{"osd":7,"last update":"Fri Sep 13 06:44:33 2024","interfaces":[{"interface":"back","average":{"1min":0.91900000000000004,"5min":0.90600000000000003,"15min":0.90400000000000003},"min":{"1min":0.621,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":1.3220000000000001,"5min":1.605,"15min":1.605},"last":0.81399999999999995},{"interface":"front","average":{"1min":1.054,"5min":0.93899999999999995,"15min":0.92000000000000004},"min":{"1min":0.61099999999999999,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.5009999999999999,"5min":1.5009999999999999,"15min":1.5009999999999999},"last":0.97199999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574916,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":85336,"kb_used_data":4172,"kb_used_omap":1,"kb_used_meta":81150,"kb_avail":94286504,"statfs":{"total":96636764160,"available":96549380096,"internally_reserved":0,"allocated":4272128,"data_stored":2435239,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":83098054},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 06:44:11 2024","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.54900000000000004,"15min":0.53000000000000003},"min":{"1min":0.23999999999999999,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":1.048,"5min":1.2270000000000001,"15min":1.2270000000000001},"last":0.751},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.56000000000000005,"15min":0.54000000000000004},"min":{"1min":0.28799999999999998,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":1.137,"5min":1.222,"15min":1.222},"last":0.60299999999999998}]},{"osd":2,"last update":"Fri Sep 13 06:44:11 2024","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.60399999999999998,"15min":0.55600000000000005},"min":{"1min":0.27300000000000002,"5min":0.217,"15min":0.217},"max":{"1min":1.2549999999999999,"5min":1.839,"15min":1.839},"last":0.83999999999999997},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.61299999999999999,"15min":0.57499999999999996},"min":{"1min":0.35399999999999998,"5min":0.245,"15min":0.245},"max":{"1min":1.419,"5min":1.419,"15min":1.419},"last":0.79700000000000004}]},{"osd":3,"last update":"Fri Sep 13 06:44:11 2024","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.59999999999999998,"15min":0.55800000000000005},"min":{"1min":0.371,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":1.2250000000000001,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.74299999999999999,"15min":0.69899999999999995},"min":{"1min":0.36699999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":1.175,"5min":4.9630000000000001,"15min":4.9630000000000001},"last":1.004}]},{"osd":4,"last update":"Fri Sep 13 06:44:11 2024","interfaces":[{"interface":"back","average":{"1min":0.89400000000000002,"5min":0.80400000000000005,"15min":0.79400000000000004},"min":{"1min":0.57899999999999996,"5min":0.311,"15min":0.311},"max":{"1min":1.6259999999999999,"5min":1.6259999999999999,"15min":1.6259999999999999},"last":0.89000000000000001},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.77400000000000002,"15min":0.79600000000000004},"min":{"1min":0.58999999999999997,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.1799999999999999,"5min":1.6319999999999999,"15min":1.6319999999999999},"last":0.92300000000000004}]},{"osd":5,"last update":"Fri Sep 13 06:44:11 2024","interfaces":[{"interface":"back","average":{"1min":0.89900000000000002,"5min":0.85799999999999998,"15min":0.85199999999999998},"min":{"1min":0.52800000000000002,"5min":0.378,"15min":0.378},"max":{"1min":1.575,"5min":1.575,"15min":1.575},"last":1.0600000000000001},{"interface":"front","average":{"1min":0.89100000000000001,"5min":0.85699999999999998,"15min":0.87},"min":{"1min":0.60199999999999998,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.327,"5min":1.5740000000000001,"15min":1.5740000000000001},"last":1.075}]},{"osd":6,"last update":"Fri Sep 13 06:42:11 2024","interfaces":[{"interface":"back","average":{"1min":0.89800000000000002,"5min":0.91200000000000003,"15min":0.93100000000000005},"min":{"1min":0.55300000000000005,"5min":0.499,"15min":0.499},"max":{"1min":1.571,"5min":2.4969999999999999,"15min":2.4969999999999999},"last":1.1479999999999999},{"interface":"front","average":{"1min":0.878,"5min":0.89600000000000002,"15min":0.90600000000000003},"min":{"1min":0.51800000000000002,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.208,"5min":2.0419999999999998,"15min":2.0419999999999998},"last":0.96899999999999997}]},{"osd":7,"last update":"Fri Sep 13 06:44:31 2024","interfaces":[{"interface":"back","average":{"1min":0.97799999999999998,"5min":1.0529999999999999,"15min":1.0649999999999999},"min":{"1min":0.57799999999999996,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.381,"5min":1.9419999999999999,"15min":1.9419999999999999},"last":1.1040000000000001},{"interface":"front","average":{"1min":0.97899999999999998,"5min":0.96999999999999997,"15min":0.96799999999999997},"min":{"1min":0.64100000000000001,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.4750000000000001,"5min":1.901,"15min":1.901},"last":1.032}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6552,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8096,"internal_metadata":0}]}} 2024-09-13T06:44:41.515 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-09-13T06:44:41.515 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr_debug_aggressive_pg_num_changes 2024-09-13T06:44:41.827 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-09-13T06:44:41.843 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-13T06:44:41.844 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T06:44:42.136 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T06:44:42.137 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-09-13T06:44:42.155 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":464,"stamp":"2024-09-13T06:44:41.610509+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590406,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":237398,"num_read_kb":1402962,"num_write":33483,"num_write_kb":1011328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9257,"num_bytes_recovered":444809309,"num_keys_recovered":867,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":24606,"ondisk_log_size":24606,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":486624,"kb_used_data":30120,"kb_used_omap":26,"kb_used_meta":456357,"kb_avail":754488096,"statfs":{"total":773094113280,"available":772595810304,"internally_reserved":0,"allocated":30842880,"data_stored":16035540,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":27392,"internal_metadata":467309824},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":-152,"num_bytes_recovered":-19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002227"},"pg_stats":[{"pgid":"3.1f","version":"280'781","reported_seq":6287,"reported_epoch":303,"state":"active+clean","last_fresh":"2024-09-13T06:44:32.809403+0000","last_change":"2024-09-13T06:44:05.445184+0000","last_active":"2024-09-13T06:44:32.809403+0000","last_peered":"2024-09-13T06:44:32.809403+0000","last_clean":"2024-09-13T06:44:32.809403+0000","last_became_active":"2024-09-13T06:40:57.385213+0000","last_became_peered":"2024-09-13T06:40:57.385213+0000","last_unstale":"2024-09-13T06:44:32.809403+0000","last_undegraded":"2024-09-13T06:44:32.809403+0000","last_fullsized":"2024-09-13T06:44:32.809403+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":781,"log_dups_size":0,"ondisk_log_size":781,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:46:17.100560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00056495999999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6518,"num_read_kb":34199,"num_write":1043,"num_write_kb":37100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":72,"num_bytes_recovered":6114482,"num_keys_recovered":44,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"271'1110","reported_seq":7422,"reported_epoch":304,"state":"active+clean","last_fresh":"2024-09-13T06:44:33.827798+0000","last_change":"2024-09-13T06:44:20.462945+0000","last_active":"2024-09-13T06:44:33.827798+0000","last_peered":"2024-09-13T06:44:33.827798+0000","last_clean":"2024-09-13T06:44:33.827798+0000","last_became_active":"2024-09-13T06:44:20.460702+0000","last_became_peered":"2024-09-13T06:44:20.460702+0000","last_unstale":"2024-09-13T06:44:33.827798+0000","last_undegraded":"2024-09-13T06:44:33.827798+0000","last_fullsized":"2024-09-13T06:44:33.827798+0000","mapping_epoch":290,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":291,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":1110,"log_dups_size":0,"ondisk_log_size":1110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:02:22.560348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013343369999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8806,"num_read_kb":55237,"num_write":1632,"num_write_kb":29160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":491,"num_bytes_recovered":16489974,"num_keys_recovered":55,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"279'1047","reported_seq":5656,"reported_epoch":303,"state":"active+clean","last_fresh":"2024-09-13T06:44:32.834174+0000","last_change":"2024-09-13T06:44:30.808653+0000","last_active":"2024-09-13T06:44:32.834174+0000","last_peered":"2024-09-13T06:44:32.834174+0000","last_clean":"2024-09-13T06:44:32.834174+0000","last_became_active":"2024-09-13T06:44:30.803142+0000","last_became_peered":"2024-09-13T06:44:30.803142+0000","last_unstale":"2024-09-13T06:44:32.834174+0000","last_undegraded":"2024-09-13T06:44:32.834174+0000","last_fullsized":"2024-09-13T06:44:32.834174+0000","mapping_epoch":300,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":301,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":1047,"log_dups_size":0,"ondisk_log_size":1047,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:25:53.597990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00088262599999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6265,"num_read_kb":28067,"num_write":1605,"num_write_kb":33265,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":206,"num_bytes_recovered":8442088,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1c","version":"280'843","reported_seq":8395,"reported_epoch":303,"state":"active+clean","last_fresh":"2024-09-13T06:44:32.834069+0000","last_change":"2024-09-13T06:44:30.807782+0000","last_active":"2024-09-13T06:44:32.834069+0000","last_peered":"2024-09-13T06:44:32.834069+0000","last_clean":"2024-09-13T06:44:32.834069+0000","last_became_active":"2024-09-13T06:44:30.801783+0000","last_became_peered":"2024-09-13T06:44:30.801783+0000","last_unstale":"2024-09-13T06:44:32.834069+0000","last_undegraded":"2024-09-13T06:44:32.834069+0000","last_fullsized":"2024-09-13T06:44:32.834069+0000","mapping_epoch":300,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":301,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":843,"log_dups_size":0,"ondisk_log_size":843,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:54:20.743708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001581236,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9390,"num_read_kb":69964,"num_write":963,"num_write_kb":31840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":350,"num_bytes_recovered":42380134,"num_keys_recovered":286,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"277'852","reported_seq":5171,"reported_epoch":305,"state":"active+clean","last_fresh":"2024-09-13T06:44:34.833406+0000","last_change":"2024-09-13T06:44:05.444712+0000","last_active":"2024-09-13T06:44:34.833406+0000","last_peered":"2024-09-13T06:44:34.833406+0000","last_clean":"2024-09-13T06:44:34.833406+0000","last_became_active":"2024-09-13T06:43:31.415608+0000","last_became_peered":"2024-09-13T06:43:31.415608+0000","last_unstale":"2024-09-13T06:44:34.833406+0000","last_undegraded":"2024-09-13T06:44:34.833406+0000","last_fullsized":"2024-09-13T06:44:34.833406+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":852,"log_dups_size":0,"ondisk_log_size":852,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:39:01.416782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060857399999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5714,"num_read_kb":37037,"num_write":1079,"num_write_kb":33376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":295,"num_bytes_recovered":25415745,"num_keys_recovered":55,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"277'497","reported_seq":7757,"reported_epoch":304,"state":"active+clean","last_fresh":"2024-09-13T06:44:33.828415+0000","last_change":"2024-09-13T06:44:20.469801+0000","last_active":"2024-09-13T06:44:33.828415+0000","last_peered":"2024-09-13T06:44:33.828415+0000","last_clean":"2024-09-13T06:44:33.828415+0000","last_became_active":"2024-09-13T06:44:20.462185+0000","last_became_peered":"2024-09-13T06:44:20.462185+0000","last_unstale":"2024-09-13T06:44:33.828415+0000","last_undegraded":"2024-09-13T06:44:33.828415+0000","last_fullsized":"2024-09-13T06:44:33.828415+0000","mapping_epoch":290,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":291,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":497,"log_dups_size":0,"ondisk_log_size":497,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:55:41.801680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00078923399999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6439,"num_read_kb":42977,"num_write":667,"num_write_kb":32420,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":728,"num_bytes_recovered":12986751,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"275'680","reported_seq":8570,"reported_epoch":304,"state":"active+clean","last_fresh":"2024-09-13T06:44:34.541517+0000","last_change":"2024-09-13T06:44:21.446173+0000","last_active":"2024-09-13T06:44:34.541517+0000","last_peered":"2024-09-13T06:44:34.541517+0000","last_clean":"2024-09-13T06:44:34.541517+0000","last_became_active":"2024-09-13T06:44:21.442872+0000","last_became_peered":"2024-09-13T06:44:21.442872+0000","last_unstale":"2024-09-13T06:44:34.541517+0000","last_undegraded":"2024-09-13T06:44:34.541517+0000","last_fullsized":"2024-09-13T06:44:34.541517+0000","mapping_epoch":291,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":292,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":680,"log_dups_size":0,"ondisk_log_size":680,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:11:12.949824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00079955100000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8400,"num_read_kb":35906,"num_write":738,"num_write_kb":28560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":398,"num_bytes_recovered":17539742,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"272'684","reported_seq":7046,"reported_epoch":304,"state":"active+clean","last_fresh":"2024-09-13T06:44:33.827366+0000","last_change":"2024-09-13T06:44:05.439754+0000","last_active":"2024-09-13T06:44:33.827366+0000","last_peered":"2024-09-13T06:44:33.827366+0000","last_clean":"2024-09-13T06:44:33.827366+0000","last_became_active":"2024-09-13T06:41:14.395301+0000","last_became_peered":"2024-09-13T06:41:14.395301+0000","last_unstale":"2024-09-13T06:44:33.827366+0000","last_undegraded":"2024-09-13T06:44:33.827366+0000","last_fullsized":"2024-09-13T06:44:33.827366+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":684,"log_dups_size":0,"ondisk_log_size":684,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:10:49.528345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00092758900000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6571,"num_read_kb":55194,"num_write":838,"num_write_kb":38872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":117,"num_bytes_recovered":13142180,"num_keys_recovered":22,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"275'1525","reported_seq":5960,"reported_epoch":303,"state":"active+clean","last_fresh":"2024-09-13T06:44:32.809471+0000","last_change":"2024-09-13T06:44:05.444913+0000","last_active":"2024-09-13T06:44:32.809471+0000","last_peered":"2024-09-13T06:44:32.809471+0000","last_clean":"2024-09-13T06:44:32.809471+0000","last_became_active":"2024-09-13T06:43:22.521039+0000","last_became_peered":"2024-09-13T06:43:22.521039+0000","last_unstale":"2024-09-13T06:44:32.809471+0000","last_undegraded":"2024-09-13T06:44:32.809471+0000","last_fullsized":"2024-09-13T06:44:32.809471+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":1525,"log_dups_size":0,"ondisk_log_size":1525,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:58:28.305131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00029931499999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9655,"num_read_kb":41824,"num_write":2232,"num_write_kb":32733,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":112,"num_bytes_recovered":14950263,"num_keys_recovered":22,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"275'715","reported_seq":5276,"reported_epoch":303,"state":"active+clean","last_fresh":"2024-09-13T06:44:32.834246+0000","last_change":"2024-09-13T06:44:30.806149+0000","last_active":"2024-09-13T06:44:32.834246+0000","last_peered":"2024-09-13T06:44:32.834246+0000","last_clean":"2024-09-13T06:44:32.834246+0000","last_became_active":"2024-09-13T06:44:30.798028+0000","last_became_peered":"2024-09-13T06:44:30.798028+0000","last_unstale":"2024-09-13T06:44:32.834246+0000","last_undegraded":"2024-09-13T06:44:32.834246+0000","last_fullsized":"2024-09-13T06:44:32.834246+0000","mapping_epoch":300,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":301,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":715,"log_dups_size":0,"ondisk_log_size":715,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:09:18.289368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0024960030000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5101,"num_read_kb":28279,"num_write":1028,"num_write_kb":23183,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":197,"num_bytes_recovered":7394092,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"277'365","reported_seq":6173,"reported_epoch":303,"state":"active+clean","last_fresh":"2024-09-13T06:44:32.805429+0000","last_change":"2024-09-13T06:44:05.457231+0000","last_active":"2024-09-13T06:44:32.805429+0000","last_peered":"2024-09-13T06:44:32.805429+0000","last_clean":"2024-09-13T06:44:32.805429+0000","last_became_active":"2024-09-13T06:42:33.408009+0000","last_became_peered":"2024-09-13T06:42:33.408009+0000","last_unstale":"2024-09-13T06:44:32.805429+0000","last_undegraded":"2024-09-13T06:44:32.805429+0000","last_fullsized":"2024-09-13T06:44:32.805429+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":365,"log_dups_size":0,"ondisk_log_size":365,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:09:11.995853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0024654690000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5036,"num_read_kb":48021,"num_write":472,"num_write_kb":27276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":157,"num_bytes_recovered":13242563,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"280'579","reported_seq":9960,"reported_epoch":304,"state":"active+clean","last_fresh":"2024-09-13T06:44:33.828571+0000","last_change":"2024-09-13T06:44:05.443324+0000","last_active":"2024-09-13T06:44:33.828571+0000","last_peered":"2024-09-13T06:44:33.828571+0000","last_clean":"2024-09-13T06:44:33.828571+0000","last_became_active":"2024-09-13T06:44:03.438897+0000","last_became_peered":"2024-09-13T06:44:03.438897+0000","last_unstale":"2024-09-13T06:44:33.828571+0000","last_undegraded":"2024-09-13T06:44:33.828571+0000","last_fullsized":"2024-09-13T06:44:33.828571+0000","mapping_epoch":277,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":278,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":579,"log_dups_size":0,"ondisk_log_size":579,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:24:55.053861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012901029999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8875,"num_read_kb":61758,"num_write":769,"num_write_kb":30278,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":506,"num_bytes_recovered":26184965,"num_keys_recovered":33,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":27,"reported_epoch":304,"state":"active+clean","last_fresh":"2024-09-13T06:44:33.832029+0000","last_change":"2024-09-13T06:44:16.450557+0000","last_active":"2024-09-13T06:44:33.832029+0000","last_peered":"2024-09-13T06:44:33.832029+0000","last_clean":"2024-09-13T06:44:33.832029+0000","last_became_active":"2024-09-13T06:44:16.449558+0000","last_became_peered":"2024-09-13T06:44:16.449558+0000","last_unstale":"2024-09-13T06:44:33.832029+0000","last_undegraded":"2024-09-13T06:44:33.832029+0000","last_fullsized":"2024-09-13T06:44:33.832029+0000","mapping_epoch":286,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":287,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_clean_scrub_stamp":"2024-09-13T06:39:16.508974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:01:20.779972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00080324699999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"280'643","reported_seq":10760,"reported_epoch":303,"state":"active+clean","last_fresh":"2024-09-13T06:44:32.809700+0000","last_change":"2024-09-13T06:44:22.454207+0000","last_active":"2024-09-13T06:44:32.809700+0000","last_peered":"2024-09-13T06:44:32.809700+0000","last_clean":"2024-09-13T06:44:32.809700+0000","last_became_active":"2024-09-13T06:44:22.449195+0000","last_became_peered":"2024-09-13T06:44:22.449195+0000","last_unstale":"2024-09-13T06:44:32.809700+0000","last_undegraded":"2024-09-13T06:44:32.809700+0000","last_fullsized":"2024-09-13T06:44:32.809700+0000","mapping_epoch":292,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":293,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":643,"log_dups_size":0,"ondisk_log_size":643,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:28:58.479641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00080400600000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9397,"num_read_kb":51433,"num_write":883,"num_write_kb":40908,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":358,"num_bytes_recovered":1257624,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":24,"reported_epoch":304,"state":"active+clean","last_fresh":"2024-09-13T06:44:34.541380+0000","last_change":"2024-09-13T06:44:18.458951+0000","last_active":"2024-09-13T06:44:34.541380+0000","last_peered":"2024-09-13T06:44:34.541380+0000","last_clean":"2024-09-13T06:44:34.541380+0000","last_became_active":"2024-09-13T06:44:18.458454+0000","last_became_peered":"2024-09-13T06:44:18.458454+0000","last_unstale":"2024-09-13T06:44:34.541380+0000","last_undegraded":"2024-09-13T06:44:34.541380+0000","last_fullsized":"2024-09-13T06:44:34.541380+0000","mapping_epoch":288,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":289,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_clean_scrub_stamp":"2024-09-13T06:39:16.508974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:06:07.380573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00097079800000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"277'694","reported_seq":7060,"reported_epoch":304,"state":"active+clean","last_fresh":"2024-09-13T06:44:33.827435+0000","last_change":"2024-09-13T06:44:05.440674+0000","last_active":"2024-09-13T06:44:33.827435+0000","last_peered":"2024-09-13T06:44:33.827435+0000","last_clean":"2024-09-13T06:44:33.827435+0000","last_became_active":"2024-09-13T06:42:32.413006+0000","last_became_peered":"2024-09-13T06:42:32.413006+0000","last_unstale":"2024-09-13T06:44:33.827435+0000","last_undegraded":"2024-09-13T06:44:33.827435+0000","last_fullsized":"2024-09-13T06:44:33.827435+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":694,"log_dups_size":0,"ondisk_log_size":694,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:38:01.774494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001338379,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6521,"num_read_kb":33119,"num_write":812,"num_write_kb":30039,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":213,"num_bytes_recovered":15100645,"num_keys_recovered":11,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":181,"reported_epoch":305,"state":"active+clean","last_fresh":"2024-09-13T06:44:34.866142+0000","last_change":"2024-09-13T06:42:28.563276+0000","last_active":"2024-09-13T06:44:34.866142+0000","last_peered":"2024-09-13T06:44:34.866142+0000","last_clean":"2024-09-13T06:44:34.866142+0000","last_became_active":"2024-09-13T06:42:28.562827+0000","last_became_peered":"2024-09-13T06:42:28.562827+0000","last_unstale":"2024-09-13T06:44:34.866142+0000","last_undegraded":"2024-09-13T06:44:34.866142+0000","last_fullsized":"2024-09-13T06:44:34.866142+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_clean_scrub_stamp":"2024-09-13T06:39:16.508974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:10:47.285603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"277'961","reported_seq":6891,"reported_epoch":304,"state":"active+clean","last_fresh":"2024-09-13T06:44:34.541518+0000","last_change":"2024-09-13T06:44:22.455582+0000","last_active":"2024-09-13T06:44:34.541518+0000","last_peered":"2024-09-13T06:44:34.541518+0000","last_clean":"2024-09-13T06:44:34.541518+0000","last_became_active":"2024-09-13T06:44:22.450933+0000","last_became_peered":"2024-09-13T06:44:22.450933+0000","last_unstale":"2024-09-13T06:44:34.541518+0000","last_undegraded":"2024-09-13T06:44:34.541518+0000","last_fullsized":"2024-09-13T06:44:34.541518+0000","mapping_epoch":292,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":293,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":961,"log_dups_size":0,"ondisk_log_size":961,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:30:26.327840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0031147280000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7705,"num_read_kb":38648,"num_write":1332,"num_write_kb":32653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":354,"num_bytes_recovered":6765835,"num_keys_recovered":11,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":24,"reported_epoch":304,"state":"active+clean","last_fresh":"2024-09-13T06:44:34.541611+0000","last_change":"2024-09-13T06:44:18.468145+0000","last_active":"2024-09-13T06:44:34.541611+0000","last_peered":"2024-09-13T06:44:34.541611+0000","last_clean":"2024-09-13T06:44:34.541611+0000","last_became_active":"2024-09-13T06:44:18.467833+0000","last_became_peered":"2024-09-13T06:44:18.467833+0000","last_unstale":"2024-09-13T06:44:34.541611+0000","last_undegraded":"2024-09-13T06:44:34.541611+0000","last_fullsized":"2024-09-13T06:44:34.541611+0000","mapping_epoch":288,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":289,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_clean_scrub_stamp":"2024-09-13T06:39:16.508974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:33:56.156376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"277'640","reported_seq":7755,"reported_epoch":303,"state":"active+clean","last_fresh":"2024-09-13T06:44:32.834288+0000","last_change":"2024-09-13T06:44:30.803125+0000","last_active":"2024-09-13T06:44:32.834288+0000","last_peered":"2024-09-13T06:44:32.834288+0000","last_clean":"2024-09-13T06:44:32.834288+0000","last_became_active":"2024-09-13T06:44:30.797769+0000","last_became_peered":"2024-09-13T06:44:30.797769+0000","last_unstale":"2024-09-13T06:44:32.834288+0000","last_undegraded":"2024-09-13T06:44:32.834288+0000","last_fullsized":"2024-09-13T06:44:32.834288+0000","mapping_epoch":300,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":301,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":640,"log_dups_size":0,"ondisk_log_size":640,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:49:47.340041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0046689339999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7611,"num_read_kb":41345,"num_write":1018,"num_write_kb":26620,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":158,"num_bytes_recovered":4212424,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"280'991","reported_seq":21074,"reported_epoch":304,"state":"active+clean","last_fresh":"2024-09-13T06:44:33.828568+0000","last_change":"2024-09-13T06:44:28.773729+0000","last_active":"2024-09-13T06:44:33.828568+0000","last_peered":"2024-09-13T06:44:33.828568+0000","last_clean":"2024-09-13T06:44:33.828568+0000","last_became_active":"2024-09-13T06:44:28.768976+0000","last_became_peered":"2024-09-13T06:44:28.768976+0000","last_unstale":"2024-09-13T06:44:33.828568+0000","last_undegraded":"2024-09-13T06:44:33.828568+0000","last_fullsized":"2024-09-13T06:44:33.828568+0000","mapping_epoch":298,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":299,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":991,"log_dups_size":0,"ondisk_log_size":991,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:30:21.817297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0017436419999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20994,"num_read_kb":92583,"num_write":1315,"num_write_kb":30385,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":207,"num_bytes_recovered":9898606,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"20'2","reported_seq":125,"reported_epoch":303,"state":"active+clean","last_fresh":"2024-09-13T06:44:32.834084+0000","last_change":"2024-09-13T06:44:30.794941+0000","last_active":"2024-09-13T06:44:32.834084+0000","last_peered":"2024-09-13T06:44:32.834084+0000","last_clean":"2024-09-13T06:44:32.834084+0000","last_became_active":"2024-09-13T06:44:30.794134+0000","last_became_peered":"2024-09-13T06:44:30.794134+0000","last_unstale":"2024-09-13T06:44:32.834084+0000","last_undegraded":"2024-09-13T06:44:32.834084+0000","last_fullsized":"2024-09-13T06:44:32.834084+0000","mapping_epoch":300,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":301,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_clean_scrub_stamp":"2024-09-13T06:39:16.508974+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:36:10.351897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":57,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"278'857","reported_seq":10772,"reported_epoch":304,"state":"active+clean","last_fresh":"2024-09-13T06:44:34.541417+0000","last_change":"2024-09-13T06:44:21.445836+0000","last_active":"2024-09-13T06:44:34.541417+0000","last_peered":"2024-09-13T06:44:34.541417+0000","last_clean":"2024-09-13T06:44:34.541417+0000","last_became_active":"2024-09-13T06:44:21.442847+0000","last_became_peered":"2024-09-13T06:44:21.442847+0000","last_unstale":"2024-09-13T06:44:34.541417+0000","last_undegraded":"2024-09-13T06:44:34.541417+0000","last_fullsized":"2024-09-13T06:44:34.541417+0000","mapping_epoch":291,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":292,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":857,"log_dups_size":0,"ondisk_log_size":857,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:42:10.542267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00053211199999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11278,"num_read_kb":63107,"num_write":1190,"num_write_kb":36968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":351,"num_bytes_recovered":9847094,"num_keys_recovered":11,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":26,"reported_epoch":304,"state":"active+clean","last_fresh":"2024-09-13T06:44:33.827890+0000","last_change":"2024-09-13T06:44:17.443833+0000","last_active":"2024-09-13T06:44:33.827890+0000","last_peered":"2024-09-13T06:44:33.827890+0000","last_clean":"2024-09-13T06:44:33.827890+0000","last_became_active":"2024-09-13T06:44:17.443358+0000","last_became_peered":"2024-09-13T06:44:17.443358+0000","last_unstale":"2024-09-13T06:44:33.827890+0000","last_undegraded":"2024-09-13T06:44:33.827890+0000","last_fullsized":"2024-09-13T06:44:33.827890+0000","mapping_epoch":287,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":288,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_clean_scrub_stamp":"2024-09-13T06:39:16.508974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:30:37.013428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00033592499999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"277'1115","reported_seq":6258,"reported_epoch":303,"state":"active+clean","last_fresh":"2024-09-13T06:44:32.809218+0000","last_change":"2024-09-13T06:44:30.799789+0000","last_active":"2024-09-13T06:44:32.809218+0000","last_peered":"2024-09-13T06:44:32.809218+0000","last_clean":"2024-09-13T06:44:32.809218+0000","last_became_active":"2024-09-13T06:44:30.798508+0000","last_became_peered":"2024-09-13T06:44:30.798508+0000","last_unstale":"2024-09-13T06:44:32.809218+0000","last_undegraded":"2024-09-13T06:44:32.809218+0000","last_fullsized":"2024-09-13T06:44:32.809218+0000","mapping_epoch":300,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":301,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":1115,"log_dups_size":0,"ondisk_log_size":1115,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:04:47.174299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0032283849999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7964,"num_read_kb":36198,"num_write":1645,"num_write_kb":33105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":243,"num_bytes_recovered":7863454,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":197,"reported_epoch":303,"state":"active+clean","last_fresh":"2024-09-13T06:44:32.805107+0000","last_change":"2024-09-13T06:44:18.457601+0000","last_active":"2024-09-13T06:44:32.805107+0000","last_peered":"2024-09-13T06:44:32.805107+0000","last_clean":"2024-09-13T06:44:32.805107+0000","last_became_active":"2024-09-13T06:44:18.456828+0000","last_became_peered":"2024-09-13T06:44:18.456828+0000","last_unstale":"2024-09-13T06:44:32.805107+0000","last_undegraded":"2024-09-13T06:44:32.805107+0000","last_fullsized":"2024-09-13T06:44:32.805107+0000","mapping_epoch":288,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":289,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_clean_scrub_stamp":"2024-09-13T06:39:16.508974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:17:09.082426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"279'349","reported_seq":3763,"reported_epoch":304,"state":"active+clean","last_fresh":"2024-09-13T06:44:33.827275+0000","last_change":"2024-09-13T06:44:05.440371+0000","last_active":"2024-09-13T06:44:33.827275+0000","last_peered":"2024-09-13T06:44:33.827275+0000","last_clean":"2024-09-13T06:44:33.827275+0000","last_became_active":"2024-09-13T06:41:15.399301+0000","last_became_peered":"2024-09-13T06:41:15.399301+0000","last_unstale":"2024-09-13T06:44:33.827275+0000","last_undegraded":"2024-09-13T06:44:33.827275+0000","last_fullsized":"2024-09-13T06:44:33.827275+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":349,"log_dups_size":0,"ondisk_log_size":349,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:53:18.137873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001343293,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2523,"num_read_kb":19829,"num_write":427,"num_write_kb":20943,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":169,"num_bytes_recovered":5233325,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"18'1","reported_seq":56,"reported_epoch":303,"state":"active+clean","last_fresh":"2024-09-13T06:44:32.834077+0000","last_change":"2024-09-13T06:44:30.798045+0000","last_active":"2024-09-13T06:44:32.834077+0000","last_peered":"2024-09-13T06:44:32.834077+0000","last_clean":"2024-09-13T06:44:32.834077+0000","last_became_active":"2024-09-13T06:44:30.796877+0000","last_became_peered":"2024-09-13T06:44:30.796877+0000","last_unstale":"2024-09-13T06:44:32.834077+0000","last_undegraded":"2024-09-13T06:44:32.834077+0000","last_fullsized":"2024-09-13T06:44:32.834077+0000","mapping_epoch":300,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":301,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_clean_scrub_stamp":"2024-09-13T06:39:16.508974+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:33:04.298167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":397,"reported_epoch":303,"state":"active+clean","last_fresh":"2024-09-13T06:44:32.805140+0000","last_change":"2024-09-13T06:42:28.563168+0000","last_active":"2024-09-13T06:44:32.805140+0000","last_peered":"2024-09-13T06:44:32.805140+0000","last_clean":"2024-09-13T06:44:32.805140+0000","last_became_active":"2024-09-13T06:42:28.562642+0000","last_became_peered":"2024-09-13T06:42:28.562642+0000","last_unstale":"2024-09-13T06:44:32.805140+0000","last_undegraded":"2024-09-13T06:44:32.805140+0000","last_fullsized":"2024-09-13T06:44:32.805140+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:10.110558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:10.110558+0000","last_clean_scrub_stamp":"2024-09-13T06:39:10.110558+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:05:54.866043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"277'651","reported_seq":10851,"reported_epoch":304,"state":"active+clean","last_fresh":"2024-09-13T06:44:33.827115+0000","last_change":"2024-09-13T06:44:22.452634+0000","last_active":"2024-09-13T06:44:33.827115+0000","last_peered":"2024-09-13T06:44:33.827115+0000","last_clean":"2024-09-13T06:44:33.827115+0000","last_became_active":"2024-09-13T06:44:22.448736+0000","last_became_peered":"2024-09-13T06:44:22.448736+0000","last_unstale":"2024-09-13T06:44:33.827115+0000","last_undegraded":"2024-09-13T06:44:33.827115+0000","last_fullsized":"2024-09-13T06:44:33.827115+0000","mapping_epoch":292,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":293,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":651,"log_dups_size":0,"ondisk_log_size":651,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:58:40.103969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00083432600000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9552,"num_read_kb":46146,"num_write":828,"num_write_kb":32512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":446,"num_bytes_recovered":11977587,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"277'774","reported_seq":10944,"reported_epoch":304,"state":"active+clean","last_fresh":"2024-09-13T06:44:33.827759+0000","last_change":"2024-09-13T06:44:20.466493+0000","last_active":"2024-09-13T06:44:33.827759+0000","last_peered":"2024-09-13T06:44:33.827759+0000","last_clean":"2024-09-13T06:44:33.827759+0000","last_became_active":"2024-09-13T06:44:20.462849+0000","last_became_peered":"2024-09-13T06:44:20.462849+0000","last_unstale":"2024-09-13T06:44:33.827759+0000","last_undegraded":"2024-09-13T06:44:33.827759+0000","last_fullsized":"2024-09-13T06:44:33.827759+0000","mapping_epoch":290,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":291,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":774,"log_dups_size":0,"ondisk_log_size":774,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:40:44.119462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0024338839999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10729,"num_read_kb":51645,"num_write":931,"num_write_kb":34617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":445,"num_bytes_recovered":16579571,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"278'758","reported_seq":8282,"reported_epoch":305,"state":"active+clean","last_fresh":"2024-09-13T06:44:34.842308+0000","last_change":"2024-09-13T06:44:34.842308+0000","last_active":"2024-09-13T06:44:34.842308+0000","last_peered":"2024-09-13T06:44:34.842308+0000","last_clean":"2024-09-13T06:44:34.842308+0000","last_became_active":"2024-09-13T06:44:34.836417+0000","last_became_peered":"2024-09-13T06:44:34.836417+0000","last_unstale":"2024-09-13T06:44:34.842308+0000","last_undegraded":"2024-09-13T06:44:34.842308+0000","last_fullsized":"2024-09-13T06:44:34.842308+0000","mapping_epoch":304,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":305,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":758,"log_dups_size":0,"ondisk_log_size":758,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:44:55.089545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00085210600000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8422,"num_read_kb":47219,"num_write":883,"num_write_kb":28077,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":515,"num_bytes_recovered":28581300,"num_keys_recovered":111,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"271'845","reported_seq":5602,"reported_epoch":304,"state":"active+clean","last_fresh":"2024-09-13T06:44:33.827387+0000","last_change":"2024-09-13T06:44:05.439827+0000","last_active":"2024-09-13T06:44:33.827387+0000","last_peered":"2024-09-13T06:44:33.827387+0000","last_clean":"2024-09-13T06:44:33.827387+0000","last_became_active":"2024-09-13T06:41:15.399204+0000","last_became_peered":"2024-09-13T06:41:15.399204+0000","last_unstale":"2024-09-13T06:44:33.827387+0000","last_undegraded":"2024-09-13T06:44:33.827387+0000","last_fullsized":"2024-09-13T06:44:33.827387+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":845,"log_dups_size":0,"ondisk_log_size":845,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:27:03.298272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00094468700000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6686,"num_read_kb":57840,"num_write":1181,"num_write_kb":24665,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":117,"num_bytes_recovered":13256568,"num_keys_recovered":44,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"279'569","reported_seq":6603,"reported_epoch":303,"state":"active+clean","last_fresh":"2024-09-13T06:44:32.834414+0000","last_change":"2024-09-13T06:44:30.802655+0000","last_active":"2024-09-13T06:44:32.834414+0000","last_peered":"2024-09-13T06:44:32.834414+0000","last_clean":"2024-09-13T06:44:32.834414+0000","last_became_active":"2024-09-13T06:44:30.794873+0000","last_became_peered":"2024-09-13T06:44:30.794873+0000","last_unstale":"2024-09-13T06:44:32.834414+0000","last_undegraded":"2024-09-13T06:44:32.834414+0000","last_fullsized":"2024-09-13T06:44:32.834414+0000","mapping_epoch":300,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":301,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":569,"log_dups_size":0,"ondisk_log_size":569,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:26:59.771063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0027493119999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6187,"num_read_kb":31727,"num_write":657,"num_write_kb":25682,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":184,"num_bytes_recovered":16410936,"num_keys_recovered":88,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"277'881","reported_seq":2923,"reported_epoch":303,"state":"active+clean","last_fresh":"2024-09-13T06:44:32.805567+0000","last_change":"2024-09-13T06:44:05.458093+0000","last_active":"2024-09-13T06:44:32.805567+0000","last_peered":"2024-09-13T06:44:32.805567+0000","last_clean":"2024-09-13T06:44:32.805567+0000","last_became_active":"2024-09-13T06:42:32.411927+0000","last_became_peered":"2024-09-13T06:42:32.411927+0000","last_unstale":"2024-09-13T06:44:32.805567+0000","last_undegraded":"2024-09-13T06:44:32.805567+0000","last_fullsized":"2024-09-13T06:44:32.805567+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":881,"log_dups_size":0,"ondisk_log_size":881,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:40:44.787780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.003013108,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4846,"num_read_kb":26164,"num_write":1518,"num_write_kb":30083,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":140,"num_bytes_recovered":11278110,"num_keys_recovered":11,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.e","version":"277'556","reported_seq":4102,"reported_epoch":303,"state":"active+clean","last_fresh":"2024-09-13T06:44:32.805528+0000","last_change":"2024-09-13T06:44:30.808041+0000","last_active":"2024-09-13T06:44:32.805528+0000","last_peered":"2024-09-13T06:44:32.805528+0000","last_clean":"2024-09-13T06:44:32.805528+0000","last_became_active":"2024-09-13T06:44:30.801655+0000","last_became_peered":"2024-09-13T06:44:30.801655+0000","last_unstale":"2024-09-13T06:44:32.805528+0000","last_undegraded":"2024-09-13T06:44:32.805528+0000","last_fullsized":"2024-09-13T06:44:32.805528+0000","mapping_epoch":300,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":301,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":556,"log_dups_size":0,"ondisk_log_size":556,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:43:53.489080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0025767619999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3868,"num_read_kb":43567,"num_write":654,"num_write_kb":29232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":503,"num_bytes_recovered":12695191,"num_keys_recovered":11,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"277'665","reported_seq":4754,"reported_epoch":303,"state":"active+clean","last_fresh":"2024-09-13T06:44:32.805508+0000","last_change":"2024-09-13T06:44:05.458214+0000","last_active":"2024-09-13T06:44:32.805508+0000","last_peered":"2024-09-13T06:44:32.805508+0000","last_clean":"2024-09-13T06:44:32.805508+0000","last_became_active":"2024-09-13T06:42:33.412054+0000","last_became_peered":"2024-09-13T06:42:33.412054+0000","last_unstale":"2024-09-13T06:44:32.805508+0000","last_undegraded":"2024-09-13T06:44:32.805508+0000","last_fullsized":"2024-09-13T06:44:32.805508+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":665,"log_dups_size":0,"ondisk_log_size":665,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:07:06.963404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00285659,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4677,"num_read_kb":45287,"num_write":982,"num_write_kb":45285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":394,"num_bytes_recovered":42768786,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.10","version":"280'832","reported_seq":5035,"reported_epoch":304,"state":"active+clean","last_fresh":"2024-09-13T06:44:33.831977+0000","last_change":"2024-09-13T06:44:19.467239+0000","last_active":"2024-09-13T06:44:33.831977+0000","last_peered":"2024-09-13T06:44:33.831977+0000","last_clean":"2024-09-13T06:44:33.831977+0000","last_became_active":"2024-09-13T06:44:19.459617+0000","last_became_peered":"2024-09-13T06:44:19.459617+0000","last_unstale":"2024-09-13T06:44:33.831977+0000","last_undegraded":"2024-09-13T06:44:33.831977+0000","last_fullsized":"2024-09-13T06:44:33.831977+0000","mapping_epoch":289,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":290,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":832,"log_dups_size":0,"ondisk_log_size":832,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:43:55.736868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0018779840000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5715,"num_read_kb":29614,"num_write":1142,"num_write_kb":36190,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":275,"num_bytes_recovered":6622441,"num_keys_recovered":20,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.11","version":"279'502","reported_seq":6279,"reported_epoch":303,"state":"active+clean","last_fresh":"2024-09-13T06:44:32.805097+0000","last_change":"2024-09-13T06:44:05.455675+0000","last_active":"2024-09-13T06:44:32.805097+0000","last_peered":"2024-09-13T06:44:32.805097+0000","last_clean":"2024-09-13T06:44:32.805097+0000","last_became_active":"2024-09-13T06:42:33.411668+0000","last_became_peered":"2024-09-13T06:42:33.411668+0000","last_unstale":"2024-09-13T06:44:32.805097+0000","last_undegraded":"2024-09-13T06:44:32.805097+0000","last_fullsized":"2024-09-13T06:44:32.805097+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":502,"log_dups_size":0,"ondisk_log_size":502,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:43:01.814094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001270492,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5341,"num_read_kb":34087,"num_write":659,"num_write_kb":25712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":245,"num_bytes_recovered":7089272,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"280'921","reported_seq":5047,"reported_epoch":303,"state":"active+clean","last_fresh":"2024-09-13T06:44:32.809379+0000","last_change":"2024-09-13T06:44:20.470378+0000","last_active":"2024-09-13T06:44:32.809379+0000","last_peered":"2024-09-13T06:44:32.809379+0000","last_clean":"2024-09-13T06:44:32.809379+0000","last_became_active":"2024-09-13T06:44:20.466713+0000","last_became_peered":"2024-09-13T06:44:20.466713+0000","last_unstale":"2024-09-13T06:44:32.809379+0000","last_undegraded":"2024-09-13T06:44:32.809379+0000","last_fullsized":"2024-09-13T06:44:32.809379+0000","mapping_epoch":290,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":291,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":921,"log_dups_size":0,"ondisk_log_size":921,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:00:14.406068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0017683250000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6025,"num_read_kb":38947,"num_write":1315,"num_write_kb":35656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":107,"num_bytes_recovered":3682200,"num_keys_recovered":21,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"279'604","reported_seq":4546,"reported_epoch":303,"state":"active+clean","last_fresh":"2024-09-13T06:44:32.805143+0000","last_change":"2024-09-13T06:44:05.454984+0000","last_active":"2024-09-13T06:44:32.805143+0000","last_peered":"2024-09-13T06:44:32.805143+0000","last_clean":"2024-09-13T06:44:32.805143+0000","last_became_active":"2024-09-13T06:42:31.402800+0000","last_became_peered":"2024-09-13T06:42:31.402800+0000","last_unstale":"2024-09-13T06:44:32.805143+0000","last_undegraded":"2024-09-13T06:44:32.805143+0000","last_fullsized":"2024-09-13T06:44:32.805143+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":604,"log_dups_size":0,"ondisk_log_size":604,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:59:41.167052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010470779999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4471,"num_read_kb":35894,"num_write":884,"num_write_kb":31515,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":196,"num_bytes_recovered":8224568,"num_keys_recovered":11,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":19,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":237282,"num_read_kb":1402862,"num_write":33322,"num_write_kb":1008910,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9249,"num_bytes_recovered":443628516,"num_keys_recovered":867,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14648,"internal_metadata":0},"log_size":24486,"ondisk_log_size":24486,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":57,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":3}],"osd_stats":[{"osd":7,"up_from":187,"seq":803158884380,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37040,"kb_used_data":4196,"kb_used_omap":9,"kb_used_meta":32822,"kb_avail":94334800,"statfs":{"total":96636764160,"available":96598835200,"internally_reserved":0,"allocated":4296704,"data_stored":2446923,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9685,"internal_metadata":33610283},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 06:44:33 2024","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":0.71199999999999997,"15min":0.69799999999999995},"min":{"1min":0.56699999999999995,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.83599999999999997},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.751,"15min":0.73999999999999999},"min":{"1min":0.54600000000000004,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.6910000000000001,"5min":1.6910000000000001,"15min":1.6910000000000001},"last":0.90100000000000002}]},{"osd":1,"last update":"Fri Sep 13 06:44:33 2024","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.75700000000000001,"15min":0.751},"min":{"1min":0.57399999999999995,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.359,"5min":1.359,"15min":1.359},"last":0.86699999999999999},{"interface":"front","average":{"1min":0.82399999999999995,"5min":0.71599999999999997,"15min":0.69799999999999995},"min":{"1min":0.496,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.1259999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.93899999999999995}]},{"osd":2,"last update":"Fri Sep 13 06:44:33 2024","interfaces":[{"interface":"back","average":{"1min":0.80700000000000005,"5min":0.75900000000000001,"15min":0.751},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.2030000000000001,"5min":1.212,"15min":1.212},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.92200000000000004,"5min":0.81499999999999995,"15min":0.79700000000000004},"min":{"1min":0.58999999999999997,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.4319999999999999,"5min":1.4319999999999999,"15min":1.4319999999999999},"last":0.97699999999999998}]},{"osd":3,"last update":"Fri Sep 13 06:44:33 2024","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.79600000000000004,"15min":0.79200000000000004},"min":{"1min":0.60299999999999998,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.177,"5min":1.177,"15min":1.177},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.88600000000000001,"5min":0.84299999999999997,"15min":0.83599999999999997},"min":{"1min":0.48099999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.7350000000000001,"5min":1.7350000000000001,"15min":1.7350000000000001},"last":1.008}]},{"osd":4,"last update":"Fri Sep 13 06:44:33 2024","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.82299999999999995,"15min":0.82499999999999996},"min":{"1min":0.45500000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.405,"5min":1.405,"15min":1.405},"last":0.628},{"interface":"front","average":{"1min":1.0049999999999999,"5min":0.82299999999999995,"15min":0.79300000000000004},"min":{"1min":0.39800000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.6240000000000001,"5min":1.6240000000000001,"15min":1.6240000000000001},"last":1.137}]},{"osd":5,"last update":"Fri Sep 13 06:44:33 2024","interfaces":[{"interface":"back","average":{"1min":0.96599999999999997,"5min":0.88800000000000001,"15min":0.875},"min":{"1min":0.504,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.593,"5min":1.593,"15min":1.593},"last":1.036},{"interface":"front","average":{"1min":0.92300000000000004,"5min":0.84099999999999997,"15min":0.82699999999999996},"min":{"1min":0.53800000000000003,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.3400000000000001,"5min":1.3400000000000001,"15min":1.3400000000000001},"last":1.0620000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1619999999999999}]}]},{"osd":6,"up_from":286,"seq":1228360646663,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35504,"kb_used_data":3620,"kb_used_omap":7,"kb_used_meta":31864,"kb_avail":94336336,"statfs":{"total":96636764160,"available":96600408064,"internally_reserved":0,"allocated":3706880,"data_stored":1857127,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8145,"internal_metadata":32628783},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72399999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.26}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1879999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68700000000000006}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94699999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90900000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.21}]}]},{"osd":5,"up_from":13,"seq":55834574918,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":79024,"kb_used_data":3620,"kb_used_omap":1,"kb_used_meta":75390,"kb_avail":94292816,"statfs":{"total":96636764160,"available":96555843584,"internally_reserved":0,"allocated":3706880,"data_stored":1856574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":77199814},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 06:44:19 2024","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.71399999999999997,"15min":0.76500000000000001},"min":{"1min":0.40999999999999998,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":1.093,"5min":1.6679999999999999,"15min":1.6679999999999999},"last":1.0740000000000001},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.76900000000000002,"15min":0.79900000000000004},"min":{"1min":0.41299999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.1220000000000001,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":0.76100000000000001}]},{"osd":1,"last update":"Fri Sep 13 06:44:19 2024","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.73999999999999999,"15min":0.751},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":1.103,"5min":1.341,"15min":1.341},"last":1.03},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.70099999999999996,"15min":0.74099999999999999},"min":{"1min":0.40899999999999997,"5min":0.317,"15min":0.317},"max":{"1min":1.0089999999999999,"5min":1.722,"15min":1.722},"last":0.70899999999999996}]},{"osd":2,"last update":"Fri Sep 13 06:44:19 2024","interfaces":[{"interface":"back","average":{"1min":0.876,"5min":0.81999999999999995,"15min":0.86399999999999999},"min":{"1min":0.47699999999999998,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.143,"5min":1.833,"15min":1.833},"last":0.879},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.79200000000000004},"min":{"1min":0.47999999999999998,"5min":0.435,"15min":0.435},"max":{"1min":1.0169999999999999,"5min":1.4279999999999999,"15min":1.4279999999999999},"last":0.80100000000000005}]},{"osd":3,"last update":"Fri Sep 13 06:44:19 2024","interfaces":[{"interface":"back","average":{"1min":0.85699999999999998,"5min":0.81399999999999995,"15min":0.78000000000000003},"min":{"1min":0.45400000000000001,"5min":0.434,"15min":0.434},"max":{"1min":1.1659999999999999,"5min":1.885,"15min":1.885},"last":1.109},{"interface":"front","average":{"1min":0.85899999999999999,"5min":0.86299999999999999,"15min":0.86499999999999999},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.2410000000000001,"5min":1.907,"15min":1.907},"last":0.84699999999999998}]},{"osd":4,"last update":"Fri Sep 13 06:44:19 2024","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.83499999999999996,"15min":0.80500000000000005},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":1.159,"5min":6.3179999999999996,"15min":6.3179999999999996},"last":1.2270000000000001},{"interface":"front","average":{"1min":0.78000000000000003,"5min":1.0529999999999999,"15min":0.91000000000000003},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":1.2370000000000001,"5min":15.553000000000001,"15min":15.553000000000001},"last":1.145}]},{"osd":6,"last update":"Fri Sep 13 06:42:12 2024","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.86299999999999999,"15min":0.877},"min":{"1min":0.40000000000000002,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.9610000000000001,"5min":1.9610000000000001,"15min":1.9610000000000001},"last":0.95899999999999996},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.86099999999999999,"15min":0.87},"min":{"1min":0.39000000000000001,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.206,"5min":1.968,"15min":1.968},"last":0.93100000000000005}]},{"osd":7,"last update":"Fri Sep 13 06:44:31 2024","interfaces":[{"interface":"back","average":{"1min":0.96399999999999997,"5min":0.84399999999999997,"15min":0.82399999999999995},"min":{"1min":0.39000000000000001,"5min":0.373,"15min":0.373},"max":{"1min":1.2050000000000001,"5min":1.375,"15min":1.375},"last":0.998},{"interface":"front","average":{"1min":0.997,"5min":0.89800000000000002,"15min":0.88200000000000001},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":1.7050000000000001,"5min":1.7050000000000001,"15min":1.7050000000000001},"last":1.1739999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574918,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60984,"kb_used_data":3624,"kb_used_omap":1,"kb_used_meta":57342,"kb_avail":94310856,"statfs":{"total":96636764160,"available":96574316544,"internally_reserved":0,"allocated":3710976,"data_stored":1857146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":58718662},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 06:44:15 2024","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.79300000000000004,"15min":0.98999999999999999},"min":{"1min":0.41499999999999998,"5min":0.245,"15min":0.245},"max":{"1min":1.0720000000000001,"5min":5.8230000000000004,"15min":5.8230000000000004},"last":1.0609999999999999},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.71999999999999997,"15min":0.752},"min":{"1min":0.505,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.97299999999999998,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":1.0289999999999999}]},{"osd":1,"last update":"Fri Sep 13 06:44:15 2024","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.79300000000000004,"15min":0.75},"min":{"1min":0.45100000000000001,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.86899999999999999,"5min":10.156000000000001,"15min":10.156000000000001},"last":1.1990000000000001},{"interface":"front","average":{"1min":0.747,"5min":0.77500000000000002,"15min":0.83599999999999997},"min":{"1min":0.496,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.0349999999999999,"5min":1.286,"15min":1.286},"last":0.85299999999999998}]},{"osd":2,"last update":"Fri Sep 13 06:44:15 2024","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.751,"15min":0.82299999999999995},"min":{"1min":0.52800000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":1.0109999999999999,"5min":1.6000000000000001,"15min":1.6000000000000001},"last":0.98699999999999999},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.81299999999999994},"min":{"1min":0.65500000000000003,"5min":0.374,"15min":0.374},"max":{"1min":1.167,"5min":1.3540000000000001,"15min":1.3540000000000001},"last":0.93500000000000005}]},{"osd":3,"last update":"Fri Sep 13 06:44:15 2024","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.84699999999999998,"15min":0.90200000000000002},"min":{"1min":0.57499999999999996,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.6950000000000001,"5min":1.6950000000000001,"15min":1.6950000000000001},"last":1.1659999999999999},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.95299999999999996,"15min":0.92500000000000004},"min":{"1min":0.48499999999999999,"5min":0.374,"15min":0.374},"max":{"1min":1.8069999999999999,"5min":10.195,"15min":10.195},"last":0.96299999999999997}]},{"osd":5,"last update":"Fri Sep 13 06:44:15 2024","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.81499999999999995,"15min":0.85699999999999998},"min":{"1min":0.443,"5min":0.249,"15min":0.249},"max":{"1min":1.075,"5min":2.9790000000000001,"15min":2.9790000000000001},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.84399999999999997,"15min":0.91400000000000003},"min":{"1min":0.39700000000000002,"5min":0.372,"15min":0.372},"max":{"1min":1.0580000000000001,"5min":1.8779999999999999,"15min":1.8779999999999999},"last":0.89000000000000001}]},{"osd":6,"last update":"Fri Sep 13 06:42:14 2024","interfaces":[{"interface":"back","average":{"1min":0.90100000000000002,"5min":0.92100000000000004,"15min":0.82899999999999996},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":1.6100000000000001,"5min":10.016999999999999,"15min":10.016999999999999},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.86699999999999999,"5min":0.93300000000000005,"15min":0.95999999999999996},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.2030000000000001,"5min":2.0750000000000002,"15min":2.0750000000000002},"last":1.0920000000000001}]},{"osd":7,"last update":"Fri Sep 13 06:44:33 2024","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.1539999999999999,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.80300000000000005},{"interface":"front","average":{"1min":0.90400000000000003,"5min":0.89200000000000002,"15min":0.89000000000000001},"min":{"1min":0.505,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.2529999999999999,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":1.129}]}]},{"osd":3,"up_from":13,"seq":55834574921,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":74936,"kb_used_data":3620,"kb_used_omap":1,"kb_used_meta":71294,"kb_avail":94296904,"statfs":{"total":96636764160,"available":96560029696,"internally_reserved":0,"allocated":3706880,"data_stored":1857127,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":73005512},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 06:44:15 2024","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.56100000000000005,"15min":0.56899999999999995},"min":{"1min":0.24199999999999999,"5min":0.191,"15min":0.191},"max":{"1min":1.51,"5min":1.51,"15min":1.51},"last":0.26000000000000001},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.60599999999999998,"15min":0.65400000000000003},"min":{"1min":0.307,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.88900000000000001,"5min":1.2789999999999999,"15min":1.2789999999999999},"last":0.33600000000000002}]},{"osd":1,"last update":"Fri Sep 13 06:44:15 2024","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.54900000000000004,"15min":0.58599999999999997},"min":{"1min":0.29499999999999998,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.85399999999999998,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.28899999999999998},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.59999999999999998,"15min":0.66800000000000004},"min":{"1min":0.27700000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":1.607,"5min":1.607,"15min":1.607},"last":0.34899999999999998}]},{"osd":2,"last update":"Fri Sep 13 06:44:15 2024","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.629,"15min":0.65200000000000002},"min":{"1min":0.30199999999999999,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":1.5660000000000001,"5min":1.5660000000000001,"15min":1.5660000000000001},"last":0.378},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.59799999999999998,"15min":0.627},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":1.135,"5min":1.409,"15min":1.409},"last":0.315}]},{"osd":4,"last update":"Fri Sep 13 06:44:15 2024","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.82599999999999996,"15min":0.89400000000000002},"min":{"1min":0.42899999999999999,"5min":0.377,"15min":0.377},"max":{"1min":1.651,"5min":1.7929999999999999,"15min":1.7929999999999999},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.76300000000000001,"15min":0.78300000000000003},"min":{"1min":0.44700000000000001,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.96499999999999997,"5min":1.3240000000000001,"15min":1.3240000000000001},"last":0.60199999999999998}]},{"osd":5,"last update":"Fri Sep 13 06:44:15 2024","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":0.81200000000000006,"15min":0.84999999999999998},"min":{"1min":0.48799999999999999,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.3029999999999999,"5min":1.3799999999999999,"15min":1.3799999999999999},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.83099999999999996,"5min":0.82499999999999996,"15min":0.85999999999999999},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.4610000000000001,"5min":1.4610000000000001,"15min":1.4610000000000001},"last":0.66000000000000003}]},{"osd":6,"last update":"Fri Sep 13 06:42:11 2024","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.88500000000000001,"15min":0.91100000000000003},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.135,"5min":1.532,"15min":1.532},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.95299999999999996,"15min":0.98999999999999999},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.2250000000000001,"5min":1.825,"15min":1.825},"last":0.61899999999999999}]},{"osd":7,"last update":"Fri Sep 13 06:44:35 2024","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.89300000000000002,"15min":0.89800000000000002},"min":{"1min":0.57199999999999995,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.3009999999999999,"5min":1.3799999999999999,"15min":1.3799999999999999},"last":0.752},{"interface":"front","average":{"1min":0.93000000000000005,"5min":0.95799999999999996,"15min":0.96199999999999997},"min":{"1min":0.58799999999999997,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.4219999999999999,"5min":2.0459999999999998,"15min":2.0459999999999998},"last":0.52300000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574918,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60980,"kb_used_data":3620,"kb_used_omap":1,"kb_used_meta":57342,"kb_avail":94310860,"statfs":{"total":96636764160,"available":96574320640,"internally_reserved":0,"allocated":3706880,"data_stored":1857127,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":58718662},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 06:44:20 2024","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.66800000000000004,"15min":0.56200000000000006},"min":{"1min":0.19400000000000001,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.84199999999999997,"5min":8.6449999999999996,"15min":8.6449999999999996},"last":0.29299999999999998},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.65200000000000002,"15min":0.61099999999999999},"min":{"1min":0.30299999999999999,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":1.4410000000000001,"5min":4.0380000000000003,"15min":4.0380000000000003},"last":0.45300000000000001}]},{"osd":1,"last update":"Fri Sep 13 06:44:20 2024","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.64000000000000001,"15min":0.62},"min":{"1min":0.25,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":1.0329999999999999,"5min":3.4649999999999999,"15min":3.4649999999999999},"last":0.32700000000000001},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.66600000000000004,"15min":0.60299999999999998},"min":{"1min":0.34300000000000003,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":1.5049999999999999,"5min":3.8159999999999998,"15min":3.8159999999999998},"last":0.35699999999999998}]},{"osd":3,"last update":"Fri Sep 13 06:44:20 2024","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.65000000000000002,"15min":0.58599999999999997},"min":{"1min":0.36399999999999999,"5min":0.249,"15min":0.249},"max":{"1min":1.044,"5min":3.407,"15min":3.407},"last":0.39600000000000002},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.73599999999999999,"15min":0.68600000000000005},"min":{"1min":0.312,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.238,"5min":3.2639999999999998,"15min":3.2639999999999998},"last":0.38200000000000001}]},{"osd":4,"last update":"Fri Sep 13 06:44:20 2024","interfaces":[{"interface":"back","average":{"1min":0.83299999999999996,"5min":0.878,"15min":0.88500000000000001},"min":{"1min":0.45600000000000002,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.3759999999999999,"5min":3.1179999999999999,"15min":3.1179999999999999},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.81399999999999995,"5min":1.0620000000000001,"15min":0.94099999999999995},"min":{"1min":0.46800000000000003,"5min":0.439,"15min":0.439},"max":{"1min":1.359,"5min":21.081,"15min":21.081},"last":0.81899999999999995}]},{"osd":5,"last update":"Fri Sep 13 06:44:20 2024","interfaces":[{"interface":"back","average":{"1min":0.82999999999999996,"5min":0.84799999999999998,"15min":0.84299999999999997},"min":{"1min":0.60099999999999998,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":1.143,"5min":2.2389999999999999,"15min":2.2389999999999999},"last":0.77300000000000002},{"interface":"front","average":{"1min":1.133,"5min":0.96099999999999997,"15min":0.88900000000000001},"min":{"1min":0.54400000000000004,"5min":0.377,"15min":0.377},"max":{"1min":4.9039999999999999,"5min":4.9039999999999999,"15min":4.9039999999999999},"last":0.80800000000000005}]},{"osd":6,"last update":"Fri Sep 13 06:42:15 2024","interfaces":[{"interface":"back","average":{"1min":0.86799999999999999,"5min":0.94199999999999995,"15min":0.92600000000000005},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.274,"5min":3.923,"15min":3.923},"last":0.749},{"interface":"front","average":{"1min":0.97799999999999998,"5min":0.90500000000000003,"15min":0.879},"min":{"1min":0.60899999999999999,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":2.2080000000000002,"5min":2.2120000000000002,"15min":2.2120000000000002},"last":0.64600000000000002}]},{"osd":7,"last update":"Fri Sep 13 06:44:33 2024","interfaces":[{"interface":"back","average":{"1min":0.95799999999999996,"5min":0.86499999999999999,"15min":0.84899999999999998},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":1.641,"5min":1.641,"15min":1.641},"last":0.85899999999999999},{"interface":"front","average":{"1min":1.05,"5min":0.88600000000000001,"15min":0.85799999999999998},"min":{"1min":0.71499999999999997,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":2.0630000000000002,"5min":2.0630000000000002,"15min":2.0630000000000002},"last":0.72099999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574918,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52792,"kb_used_data":3624,"kb_used_omap":1,"kb_used_meta":49150,"kb_avail":94319048,"statfs":{"total":96636764160,"available":96582705152,"internally_reserved":0,"allocated":3710976,"data_stored":1856593,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":50330054},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 06:44:21 2024","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.55300000000000005,"15min":0.57299999999999995},"min":{"1min":0.246,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":1.1879999999999999,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.64200000000000002,"15min":0.65900000000000003},"min":{"1min":0.26200000000000001,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.99199999999999999,"5min":1.8160000000000001,"15min":1.8160000000000001},"last":0.751}]},{"osd":2,"last update":"Fri Sep 13 06:44:21 2024","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.60699999999999998,"15min":0.63400000000000001},"min":{"1min":0.26800000000000002,"5min":0.22,"15min":0.22},"max":{"1min":0.92200000000000004,"5min":2.617,"15min":2.617},"last":1.0109999999999999},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.65300000000000002,"15min":0.65400000000000003},"min":{"1min":0.28499999999999998,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":1.331,"5min":2.5249999999999999,"15min":2.5249999999999999},"last":0.70299999999999996}]},{"osd":3,"last update":"Fri Sep 13 06:44:21 2024","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.70499999999999996,"15min":0.72599999999999998},"min":{"1min":0.33900000000000002,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":1.2769999999999999,"5min":1.3640000000000001,"15min":1.3640000000000001},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.66700000000000004,"15min":0.69099999999999995},"min":{"1min":0.30399999999999999,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":1.028,"5min":1.752,"15min":1.752},"last":0.66300000000000003}]},{"osd":4,"last update":"Fri Sep 13 06:44:21 2024","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.79800000000000004,"15min":0.81999999999999995},"min":{"1min":0.60899999999999999,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":1.109,"5min":2.7389999999999999,"15min":2.7389999999999999},"last":1.224},{"interface":"front","average":{"1min":0.94499999999999995,"5min":0.85499999999999998,"15min":0.90600000000000003},"min":{"1min":0.40000000000000002,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.4159999999999999,"5min":1.4359999999999999,"15min":1.4359999999999999},"last":0.87}]},{"osd":5,"last update":"Fri Sep 13 06:44:21 2024","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.84499999999999997,"15min":0.90600000000000003},"min":{"1min":0.58099999999999996,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.1399999999999999,"5min":1.7849999999999999,"15min":1.7849999999999999},"last":1.0640000000000001},{"interface":"front","average":{"1min":0.89600000000000002,"5min":0.86599999999999999,"15min":0.879},"min":{"1min":0.495,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":1.202,"5min":2.036,"15min":2.036},"last":1.1830000000000001}]},{"osd":6,"last update":"Fri Sep 13 06:42:18 2024","interfaces":[{"interface":"back","average":{"1min":0.87,"5min":0.92200000000000004,"15min":0.94399999999999995},"min":{"1min":0.57699999999999996,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.526,"5min":1.8149999999999999,"15min":1.8149999999999999},"last":1.101},{"interface":"front","average":{"1min":0.88900000000000001,"5min":0.91200000000000003,"15min":0.91900000000000004},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":2.7810000000000001,"5min":2.7810000000000001,"15min":2.7810000000000001},"last":0.95299999999999996}]},{"osd":7,"last update":"Fri Sep 13 06:44:33 2024","interfaces":[{"interface":"back","average":{"1min":0.91900000000000004,"5min":0.90600000000000003,"15min":0.90400000000000003},"min":{"1min":0.621,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":1.3220000000000001,"5min":1.605,"15min":1.605},"last":1.1479999999999999},{"interface":"front","average":{"1min":1.054,"5min":0.93899999999999995,"15min":0.92000000000000004},"min":{"1min":0.61099999999999999,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.5009999999999999,"5min":1.5009999999999999,"15min":1.5009999999999999},"last":0.98099999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574917,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":85364,"kb_used_data":4196,"kb_used_omap":1,"kb_used_meta":81150,"kb_avail":94286476,"statfs":{"total":96636764160,"available":96549351424,"internally_reserved":0,"allocated":4296704,"data_stored":2446923,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":83098054},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 06:44:11 2024","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.54900000000000004,"15min":0.53000000000000003},"min":{"1min":0.23999999999999999,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":1.048,"5min":1.2270000000000001,"15min":1.2270000000000001},"last":0.23200000000000001},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.56000000000000005,"15min":0.54000000000000004},"min":{"1min":0.28799999999999998,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":1.137,"5min":1.222,"15min":1.222},"last":0.38400000000000001}]},{"osd":2,"last update":"Fri Sep 13 06:44:11 2024","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.60399999999999998,"15min":0.55600000000000005},"min":{"1min":0.27300000000000002,"5min":0.217,"15min":0.217},"max":{"1min":1.2549999999999999,"5min":1.839,"15min":1.839},"last":0.28199999999999997},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.61299999999999999,"15min":0.57499999999999996},"min":{"1min":0.35399999999999998,"5min":0.245,"15min":0.245},"max":{"1min":1.419,"5min":1.419,"15min":1.419},"last":0.36299999999999999}]},{"osd":3,"last update":"Fri Sep 13 06:44:11 2024","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.59999999999999998,"15min":0.55800000000000005},"min":{"1min":0.371,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":1.2250000000000001,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.34200000000000003},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.74299999999999999,"15min":0.69899999999999995},"min":{"1min":0.36699999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":1.175,"5min":4.9630000000000001,"15min":4.9630000000000001},"last":0.31}]},{"osd":4,"last update":"Fri Sep 13 06:44:11 2024","interfaces":[{"interface":"back","average":{"1min":0.89400000000000002,"5min":0.80400000000000005,"15min":0.79400000000000004},"min":{"1min":0.57899999999999996,"5min":0.311,"15min":0.311},"max":{"1min":1.6259999999999999,"5min":1.6259999999999999,"15min":1.6259999999999999},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.77400000000000002,"15min":0.79600000000000004},"min":{"1min":0.58999999999999997,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.1799999999999999,"5min":1.6319999999999999,"15min":1.6319999999999999},"last":0.51100000000000001}]},{"osd":5,"last update":"Fri Sep 13 06:44:11 2024","interfaces":[{"interface":"back","average":{"1min":0.89900000000000002,"5min":0.85799999999999998,"15min":0.85199999999999998},"min":{"1min":0.52800000000000002,"5min":0.378,"15min":0.378},"max":{"1min":1.575,"5min":1.575,"15min":1.575},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.89100000000000001,"5min":0.85699999999999998,"15min":0.87},"min":{"1min":0.60199999999999998,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.327,"5min":1.5740000000000001,"15min":1.5740000000000001},"last":0.748}]},{"osd":6,"last update":"Fri Sep 13 06:42:11 2024","interfaces":[{"interface":"back","average":{"1min":0.89800000000000002,"5min":0.91200000000000003,"15min":0.93100000000000005},"min":{"1min":0.55300000000000005,"5min":0.499,"15min":0.499},"max":{"1min":1.571,"5min":2.4969999999999999,"15min":2.4969999999999999},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.878,"5min":0.89600000000000002,"15min":0.90600000000000003},"min":{"1min":0.51800000000000002,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.208,"5min":2.0419999999999998,"15min":2.0419999999999998},"last":0.82599999999999996}]},{"osd":7,"last update":"Fri Sep 13 06:44:31 2024","interfaces":[{"interface":"back","average":{"1min":0.97799999999999998,"5min":1.0529999999999999,"15min":1.0649999999999999},"min":{"1min":0.57799999999999996,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.381,"5min":1.9419999999999999,"15min":1.9419999999999999},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.97899999999999998,"5min":0.96999999999999997,"15min":0.96799999999999997},"min":{"1min":0.64100000000000001,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.4750000000000001,"5min":1.901,"15min":1.901},"last":0.77400000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6552,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8096,"internal_metadata":0}]}} 2024-09-13T06:44:42.158 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T06:44:42.448 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T06:44:42.449 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-09-13T06:44:42.466 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":464,"stamp":"2024-09-13T06:44:41.610509+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590406,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":237398,"num_read_kb":1402962,"num_write":33483,"num_write_kb":1011328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9257,"num_bytes_recovered":444809309,"num_keys_recovered":867,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":24606,"ondisk_log_size":24606,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":486624,"kb_used_data":30120,"kb_used_omap":26,"kb_used_meta":456357,"kb_avail":754488096,"statfs":{"total":773094113280,"available":772595810304,"internally_reserved":0,"allocated":30842880,"data_stored":16035540,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":27392,"internal_metadata":467309824},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":-152,"num_bytes_recovered":-19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002227"},"pg_stats":[{"pgid":"3.1f","version":"280'781","reported_seq":6287,"reported_epoch":303,"state":"active+clean","last_fresh":"2024-09-13T06:44:32.809403+0000","last_change":"2024-09-13T06:44:05.445184+0000","last_active":"2024-09-13T06:44:32.809403+0000","last_peered":"2024-09-13T06:44:32.809403+0000","last_clean":"2024-09-13T06:44:32.809403+0000","last_became_active":"2024-09-13T06:40:57.385213+0000","last_became_peered":"2024-09-13T06:40:57.385213+0000","last_unstale":"2024-09-13T06:44:32.809403+0000","last_undegraded":"2024-09-13T06:44:32.809403+0000","last_fullsized":"2024-09-13T06:44:32.809403+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":781,"log_dups_size":0,"ondisk_log_size":781,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:46:17.100560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00056495999999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6518,"num_read_kb":34199,"num_write":1043,"num_write_kb":37100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":72,"num_bytes_recovered":6114482,"num_keys_recovered":44,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"271'1110","reported_seq":7422,"reported_epoch":304,"state":"active+clean","last_fresh":"2024-09-13T06:44:33.827798+0000","last_change":"2024-09-13T06:44:20.462945+0000","last_active":"2024-09-13T06:44:33.827798+0000","last_peered":"2024-09-13T06:44:33.827798+0000","last_clean":"2024-09-13T06:44:33.827798+0000","last_became_active":"2024-09-13T06:44:20.460702+0000","last_became_peered":"2024-09-13T06:44:20.460702+0000","last_unstale":"2024-09-13T06:44:33.827798+0000","last_undegraded":"2024-09-13T06:44:33.827798+0000","last_fullsized":"2024-09-13T06:44:33.827798+0000","mapping_epoch":290,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":291,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":1110,"log_dups_size":0,"ondisk_log_size":1110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:02:22.560348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013343369999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8806,"num_read_kb":55237,"num_write":1632,"num_write_kb":29160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":491,"num_bytes_recovered":16489974,"num_keys_recovered":55,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"279'1047","reported_seq":5656,"reported_epoch":303,"state":"active+clean","last_fresh":"2024-09-13T06:44:32.834174+0000","last_change":"2024-09-13T06:44:30.808653+0000","last_active":"2024-09-13T06:44:32.834174+0000","last_peered":"2024-09-13T06:44:32.834174+0000","last_clean":"2024-09-13T06:44:32.834174+0000","last_became_active":"2024-09-13T06:44:30.803142+0000","last_became_peered":"2024-09-13T06:44:30.803142+0000","last_unstale":"2024-09-13T06:44:32.834174+0000","last_undegraded":"2024-09-13T06:44:32.834174+0000","last_fullsized":"2024-09-13T06:44:32.834174+0000","mapping_epoch":300,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":301,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":1047,"log_dups_size":0,"ondisk_log_size":1047,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:25:53.597990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00088262599999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6265,"num_read_kb":28067,"num_write":1605,"num_write_kb":33265,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":206,"num_bytes_recovered":8442088,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1c","version":"280'843","reported_seq":8395,"reported_epoch":303,"state":"active+clean","last_fresh":"2024-09-13T06:44:32.834069+0000","last_change":"2024-09-13T06:44:30.807782+0000","last_active":"2024-09-13T06:44:32.834069+0000","last_peered":"2024-09-13T06:44:32.834069+0000","last_clean":"2024-09-13T06:44:32.834069+0000","last_became_active":"2024-09-13T06:44:30.801783+0000","last_became_peered":"2024-09-13T06:44:30.801783+0000","last_unstale":"2024-09-13T06:44:32.834069+0000","last_undegraded":"2024-09-13T06:44:32.834069+0000","last_fullsized":"2024-09-13T06:44:32.834069+0000","mapping_epoch":300,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":301,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":843,"log_dups_size":0,"ondisk_log_size":843,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:54:20.743708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001581236,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9390,"num_read_kb":69964,"num_write":963,"num_write_kb":31840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":350,"num_bytes_recovered":42380134,"num_keys_recovered":286,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"277'852","reported_seq":5171,"reported_epoch":305,"state":"active+clean","last_fresh":"2024-09-13T06:44:34.833406+0000","last_change":"2024-09-13T06:44:05.444712+0000","last_active":"2024-09-13T06:44:34.833406+0000","last_peered":"2024-09-13T06:44:34.833406+0000","last_clean":"2024-09-13T06:44:34.833406+0000","last_became_active":"2024-09-13T06:43:31.415608+0000","last_became_peered":"2024-09-13T06:43:31.415608+0000","last_unstale":"2024-09-13T06:44:34.833406+0000","last_undegraded":"2024-09-13T06:44:34.833406+0000","last_fullsized":"2024-09-13T06:44:34.833406+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":852,"log_dups_size":0,"ondisk_log_size":852,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:39:01.416782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060857399999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5714,"num_read_kb":37037,"num_write":1079,"num_write_kb":33376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":295,"num_bytes_recovered":25415745,"num_keys_recovered":55,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"277'497","reported_seq":7757,"reported_epoch":304,"state":"active+clean","last_fresh":"2024-09-13T06:44:33.828415+0000","last_change":"2024-09-13T06:44:20.469801+0000","last_active":"2024-09-13T06:44:33.828415+0000","last_peered":"2024-09-13T06:44:33.828415+0000","last_clean":"2024-09-13T06:44:33.828415+0000","last_became_active":"2024-09-13T06:44:20.462185+0000","last_became_peered":"2024-09-13T06:44:20.462185+0000","last_unstale":"2024-09-13T06:44:33.828415+0000","last_undegraded":"2024-09-13T06:44:33.828415+0000","last_fullsized":"2024-09-13T06:44:33.828415+0000","mapping_epoch":290,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":291,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":497,"log_dups_size":0,"ondisk_log_size":497,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:55:41.801680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00078923399999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6439,"num_read_kb":42977,"num_write":667,"num_write_kb":32420,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":728,"num_bytes_recovered":12986751,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"275'680","reported_seq":8570,"reported_epoch":304,"state":"active+clean","last_fresh":"2024-09-13T06:44:34.541517+0000","last_change":"2024-09-13T06:44:21.446173+0000","last_active":"2024-09-13T06:44:34.541517+0000","last_peered":"2024-09-13T06:44:34.541517+0000","last_clean":"2024-09-13T06:44:34.541517+0000","last_became_active":"2024-09-13T06:44:21.442872+0000","last_became_peered":"2024-09-13T06:44:21.442872+0000","last_unstale":"2024-09-13T06:44:34.541517+0000","last_undegraded":"2024-09-13T06:44:34.541517+0000","last_fullsized":"2024-09-13T06:44:34.541517+0000","mapping_epoch":291,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":292,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":680,"log_dups_size":0,"ondisk_log_size":680,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:11:12.949824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00079955100000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8400,"num_read_kb":35906,"num_write":738,"num_write_kb":28560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":398,"num_bytes_recovered":17539742,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"272'684","reported_seq":7046,"reported_epoch":304,"state":"active+clean","last_fresh":"2024-09-13T06:44:33.827366+0000","last_change":"2024-09-13T06:44:05.439754+0000","last_active":"2024-09-13T06:44:33.827366+0000","last_peered":"2024-09-13T06:44:33.827366+0000","last_clean":"2024-09-13T06:44:33.827366+0000","last_became_active":"2024-09-13T06:41:14.395301+0000","last_became_peered":"2024-09-13T06:41:14.395301+0000","last_unstale":"2024-09-13T06:44:33.827366+0000","last_undegraded":"2024-09-13T06:44:33.827366+0000","last_fullsized":"2024-09-13T06:44:33.827366+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":684,"log_dups_size":0,"ondisk_log_size":684,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:10:49.528345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00092758900000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6571,"num_read_kb":55194,"num_write":838,"num_write_kb":38872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":117,"num_bytes_recovered":13142180,"num_keys_recovered":22,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"275'1525","reported_seq":5960,"reported_epoch":303,"state":"active+clean","last_fresh":"2024-09-13T06:44:32.809471+0000","last_change":"2024-09-13T06:44:05.444913+0000","last_active":"2024-09-13T06:44:32.809471+0000","last_peered":"2024-09-13T06:44:32.809471+0000","last_clean":"2024-09-13T06:44:32.809471+0000","last_became_active":"2024-09-13T06:43:22.521039+0000","last_became_peered":"2024-09-13T06:43:22.521039+0000","last_unstale":"2024-09-13T06:44:32.809471+0000","last_undegraded":"2024-09-13T06:44:32.809471+0000","last_fullsized":"2024-09-13T06:44:32.809471+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":1525,"log_dups_size":0,"ondisk_log_size":1525,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:58:28.305131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00029931499999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9655,"num_read_kb":41824,"num_write":2232,"num_write_kb":32733,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":112,"num_bytes_recovered":14950263,"num_keys_recovered":22,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"275'715","reported_seq":5276,"reported_epoch":303,"state":"active+clean","last_fresh":"2024-09-13T06:44:32.834246+0000","last_change":"2024-09-13T06:44:30.806149+0000","last_active":"2024-09-13T06:44:32.834246+0000","last_peered":"2024-09-13T06:44:32.834246+0000","last_clean":"2024-09-13T06:44:32.834246+0000","last_became_active":"2024-09-13T06:44:30.798028+0000","last_became_peered":"2024-09-13T06:44:30.798028+0000","last_unstale":"2024-09-13T06:44:32.834246+0000","last_undegraded":"2024-09-13T06:44:32.834246+0000","last_fullsized":"2024-09-13T06:44:32.834246+0000","mapping_epoch":300,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":301,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":715,"log_dups_size":0,"ondisk_log_size":715,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:09:18.289368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0024960030000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5101,"num_read_kb":28279,"num_write":1028,"num_write_kb":23183,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":197,"num_bytes_recovered":7394092,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"277'365","reported_seq":6173,"reported_epoch":303,"state":"active+clean","last_fresh":"2024-09-13T06:44:32.805429+0000","last_change":"2024-09-13T06:44:05.457231+0000","last_active":"2024-09-13T06:44:32.805429+0000","last_peered":"2024-09-13T06:44:32.805429+0000","last_clean":"2024-09-13T06:44:32.805429+0000","last_became_active":"2024-09-13T06:42:33.408009+0000","last_became_peered":"2024-09-13T06:42:33.408009+0000","last_unstale":"2024-09-13T06:44:32.805429+0000","last_undegraded":"2024-09-13T06:44:32.805429+0000","last_fullsized":"2024-09-13T06:44:32.805429+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":365,"log_dups_size":0,"ondisk_log_size":365,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:09:11.995853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0024654690000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5036,"num_read_kb":48021,"num_write":472,"num_write_kb":27276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":157,"num_bytes_recovered":13242563,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"280'579","reported_seq":9960,"reported_epoch":304,"state":"active+clean","last_fresh":"2024-09-13T06:44:33.828571+0000","last_change":"2024-09-13T06:44:05.443324+0000","last_active":"2024-09-13T06:44:33.828571+0000","last_peered":"2024-09-13T06:44:33.828571+0000","last_clean":"2024-09-13T06:44:33.828571+0000","last_became_active":"2024-09-13T06:44:03.438897+0000","last_became_peered":"2024-09-13T06:44:03.438897+0000","last_unstale":"2024-09-13T06:44:33.828571+0000","last_undegraded":"2024-09-13T06:44:33.828571+0000","last_fullsized":"2024-09-13T06:44:33.828571+0000","mapping_epoch":277,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":278,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":579,"log_dups_size":0,"ondisk_log_size":579,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:24:55.053861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012901029999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8875,"num_read_kb":61758,"num_write":769,"num_write_kb":30278,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":506,"num_bytes_recovered":26184965,"num_keys_recovered":33,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":27,"reported_epoch":304,"state":"active+clean","last_fresh":"2024-09-13T06:44:33.832029+0000","last_change":"2024-09-13T06:44:16.450557+0000","last_active":"2024-09-13T06:44:33.832029+0000","last_peered":"2024-09-13T06:44:33.832029+0000","last_clean":"2024-09-13T06:44:33.832029+0000","last_became_active":"2024-09-13T06:44:16.449558+0000","last_became_peered":"2024-09-13T06:44:16.449558+0000","last_unstale":"2024-09-13T06:44:33.832029+0000","last_undegraded":"2024-09-13T06:44:33.832029+0000","last_fullsized":"2024-09-13T06:44:33.832029+0000","mapping_epoch":286,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":287,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_clean_scrub_stamp":"2024-09-13T06:39:16.508974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:01:20.779972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00080324699999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"280'643","reported_seq":10760,"reported_epoch":303,"state":"active+clean","last_fresh":"2024-09-13T06:44:32.809700+0000","last_change":"2024-09-13T06:44:22.454207+0000","last_active":"2024-09-13T06:44:32.809700+0000","last_peered":"2024-09-13T06:44:32.809700+0000","last_clean":"2024-09-13T06:44:32.809700+0000","last_became_active":"2024-09-13T06:44:22.449195+0000","last_became_peered":"2024-09-13T06:44:22.449195+0000","last_unstale":"2024-09-13T06:44:32.809700+0000","last_undegraded":"2024-09-13T06:44:32.809700+0000","last_fullsized":"2024-09-13T06:44:32.809700+0000","mapping_epoch":292,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":293,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":643,"log_dups_size":0,"ondisk_log_size":643,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:28:58.479641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00080400600000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9397,"num_read_kb":51433,"num_write":883,"num_write_kb":40908,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":358,"num_bytes_recovered":1257624,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":24,"reported_epoch":304,"state":"active+clean","last_fresh":"2024-09-13T06:44:34.541380+0000","last_change":"2024-09-13T06:44:18.458951+0000","last_active":"2024-09-13T06:44:34.541380+0000","last_peered":"2024-09-13T06:44:34.541380+0000","last_clean":"2024-09-13T06:44:34.541380+0000","last_became_active":"2024-09-13T06:44:18.458454+0000","last_became_peered":"2024-09-13T06:44:18.458454+0000","last_unstale":"2024-09-13T06:44:34.541380+0000","last_undegraded":"2024-09-13T06:44:34.541380+0000","last_fullsized":"2024-09-13T06:44:34.541380+0000","mapping_epoch":288,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":289,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_clean_scrub_stamp":"2024-09-13T06:39:16.508974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:06:07.380573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00097079800000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"277'694","reported_seq":7060,"reported_epoch":304,"state":"active+clean","last_fresh":"2024-09-13T06:44:33.827435+0000","last_change":"2024-09-13T06:44:05.440674+0000","last_active":"2024-09-13T06:44:33.827435+0000","last_peered":"2024-09-13T06:44:33.827435+0000","last_clean":"2024-09-13T06:44:33.827435+0000","last_became_active":"2024-09-13T06:42:32.413006+0000","last_became_peered":"2024-09-13T06:42:32.413006+0000","last_unstale":"2024-09-13T06:44:33.827435+0000","last_undegraded":"2024-09-13T06:44:33.827435+0000","last_fullsized":"2024-09-13T06:44:33.827435+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":694,"log_dups_size":0,"ondisk_log_size":694,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:38:01.774494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001338379,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6521,"num_read_kb":33119,"num_write":812,"num_write_kb":30039,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":213,"num_bytes_recovered":15100645,"num_keys_recovered":11,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":181,"reported_epoch":305,"state":"active+clean","last_fresh":"2024-09-13T06:44:34.866142+0000","last_change":"2024-09-13T06:42:28.563276+0000","last_active":"2024-09-13T06:44:34.866142+0000","last_peered":"2024-09-13T06:44:34.866142+0000","last_clean":"2024-09-13T06:44:34.866142+0000","last_became_active":"2024-09-13T06:42:28.562827+0000","last_became_peered":"2024-09-13T06:42:28.562827+0000","last_unstale":"2024-09-13T06:44:34.866142+0000","last_undegraded":"2024-09-13T06:44:34.866142+0000","last_fullsized":"2024-09-13T06:44:34.866142+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_clean_scrub_stamp":"2024-09-13T06:39:16.508974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:10:47.285603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"277'961","reported_seq":6891,"reported_epoch":304,"state":"active+clean","last_fresh":"2024-09-13T06:44:34.541518+0000","last_change":"2024-09-13T06:44:22.455582+0000","last_active":"2024-09-13T06:44:34.541518+0000","last_peered":"2024-09-13T06:44:34.541518+0000","last_clean":"2024-09-13T06:44:34.541518+0000","last_became_active":"2024-09-13T06:44:22.450933+0000","last_became_peered":"2024-09-13T06:44:22.450933+0000","last_unstale":"2024-09-13T06:44:34.541518+0000","last_undegraded":"2024-09-13T06:44:34.541518+0000","last_fullsized":"2024-09-13T06:44:34.541518+0000","mapping_epoch":292,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":293,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":961,"log_dups_size":0,"ondisk_log_size":961,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:30:26.327840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0031147280000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7705,"num_read_kb":38648,"num_write":1332,"num_write_kb":32653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":354,"num_bytes_recovered":6765835,"num_keys_recovered":11,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":24,"reported_epoch":304,"state":"active+clean","last_fresh":"2024-09-13T06:44:34.541611+0000","last_change":"2024-09-13T06:44:18.468145+0000","last_active":"2024-09-13T06:44:34.541611+0000","last_peered":"2024-09-13T06:44:34.541611+0000","last_clean":"2024-09-13T06:44:34.541611+0000","last_became_active":"2024-09-13T06:44:18.467833+0000","last_became_peered":"2024-09-13T06:44:18.467833+0000","last_unstale":"2024-09-13T06:44:34.541611+0000","last_undegraded":"2024-09-13T06:44:34.541611+0000","last_fullsized":"2024-09-13T06:44:34.541611+0000","mapping_epoch":288,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":289,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_clean_scrub_stamp":"2024-09-13T06:39:16.508974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:33:56.156376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"277'640","reported_seq":7755,"reported_epoch":303,"state":"active+clean","last_fresh":"2024-09-13T06:44:32.834288+0000","last_change":"2024-09-13T06:44:30.803125+0000","last_active":"2024-09-13T06:44:32.834288+0000","last_peered":"2024-09-13T06:44:32.834288+0000","last_clean":"2024-09-13T06:44:32.834288+0000","last_became_active":"2024-09-13T06:44:30.797769+0000","last_became_peered":"2024-09-13T06:44:30.797769+0000","last_unstale":"2024-09-13T06:44:32.834288+0000","last_undegraded":"2024-09-13T06:44:32.834288+0000","last_fullsized":"2024-09-13T06:44:32.834288+0000","mapping_epoch":300,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":301,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":640,"log_dups_size":0,"ondisk_log_size":640,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:49:47.340041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0046689339999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7611,"num_read_kb":41345,"num_write":1018,"num_write_kb":26620,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":158,"num_bytes_recovered":4212424,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"280'991","reported_seq":21074,"reported_epoch":304,"state":"active+clean","last_fresh":"2024-09-13T06:44:33.828568+0000","last_change":"2024-09-13T06:44:28.773729+0000","last_active":"2024-09-13T06:44:33.828568+0000","last_peered":"2024-09-13T06:44:33.828568+0000","last_clean":"2024-09-13T06:44:33.828568+0000","last_became_active":"2024-09-13T06:44:28.768976+0000","last_became_peered":"2024-09-13T06:44:28.768976+0000","last_unstale":"2024-09-13T06:44:33.828568+0000","last_undegraded":"2024-09-13T06:44:33.828568+0000","last_fullsized":"2024-09-13T06:44:33.828568+0000","mapping_epoch":298,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":299,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":991,"log_dups_size":0,"ondisk_log_size":991,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:30:21.817297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0017436419999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20994,"num_read_kb":92583,"num_write":1315,"num_write_kb":30385,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":207,"num_bytes_recovered":9898606,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"20'2","reported_seq":125,"reported_epoch":303,"state":"active+clean","last_fresh":"2024-09-13T06:44:32.834084+0000","last_change":"2024-09-13T06:44:30.794941+0000","last_active":"2024-09-13T06:44:32.834084+0000","last_peered":"2024-09-13T06:44:32.834084+0000","last_clean":"2024-09-13T06:44:32.834084+0000","last_became_active":"2024-09-13T06:44:30.794134+0000","last_became_peered":"2024-09-13T06:44:30.794134+0000","last_unstale":"2024-09-13T06:44:32.834084+0000","last_undegraded":"2024-09-13T06:44:32.834084+0000","last_fullsized":"2024-09-13T06:44:32.834084+0000","mapping_epoch":300,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":301,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_clean_scrub_stamp":"2024-09-13T06:39:16.508974+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:36:10.351897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":57,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"278'857","reported_seq":10772,"reported_epoch":304,"state":"active+clean","last_fresh":"2024-09-13T06:44:34.541417+0000","last_change":"2024-09-13T06:44:21.445836+0000","last_active":"2024-09-13T06:44:34.541417+0000","last_peered":"2024-09-13T06:44:34.541417+0000","last_clean":"2024-09-13T06:44:34.541417+0000","last_became_active":"2024-09-13T06:44:21.442847+0000","last_became_peered":"2024-09-13T06:44:21.442847+0000","last_unstale":"2024-09-13T06:44:34.541417+0000","last_undegraded":"2024-09-13T06:44:34.541417+0000","last_fullsized":"2024-09-13T06:44:34.541417+0000","mapping_epoch":291,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":292,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":857,"log_dups_size":0,"ondisk_log_size":857,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:42:10.542267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00053211199999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11278,"num_read_kb":63107,"num_write":1190,"num_write_kb":36968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":351,"num_bytes_recovered":9847094,"num_keys_recovered":11,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":26,"reported_epoch":304,"state":"active+clean","last_fresh":"2024-09-13T06:44:33.827890+0000","last_change":"2024-09-13T06:44:17.443833+0000","last_active":"2024-09-13T06:44:33.827890+0000","last_peered":"2024-09-13T06:44:33.827890+0000","last_clean":"2024-09-13T06:44:33.827890+0000","last_became_active":"2024-09-13T06:44:17.443358+0000","last_became_peered":"2024-09-13T06:44:17.443358+0000","last_unstale":"2024-09-13T06:44:33.827890+0000","last_undegraded":"2024-09-13T06:44:33.827890+0000","last_fullsized":"2024-09-13T06:44:33.827890+0000","mapping_epoch":287,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":288,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_clean_scrub_stamp":"2024-09-13T06:39:16.508974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:30:37.013428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00033592499999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"277'1115","reported_seq":6258,"reported_epoch":303,"state":"active+clean","last_fresh":"2024-09-13T06:44:32.809218+0000","last_change":"2024-09-13T06:44:30.799789+0000","last_active":"2024-09-13T06:44:32.809218+0000","last_peered":"2024-09-13T06:44:32.809218+0000","last_clean":"2024-09-13T06:44:32.809218+0000","last_became_active":"2024-09-13T06:44:30.798508+0000","last_became_peered":"2024-09-13T06:44:30.798508+0000","last_unstale":"2024-09-13T06:44:32.809218+0000","last_undegraded":"2024-09-13T06:44:32.809218+0000","last_fullsized":"2024-09-13T06:44:32.809218+0000","mapping_epoch":300,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":301,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":1115,"log_dups_size":0,"ondisk_log_size":1115,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:04:47.174299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0032283849999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7964,"num_read_kb":36198,"num_write":1645,"num_write_kb":33105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":243,"num_bytes_recovered":7863454,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":197,"reported_epoch":303,"state":"active+clean","last_fresh":"2024-09-13T06:44:32.805107+0000","last_change":"2024-09-13T06:44:18.457601+0000","last_active":"2024-09-13T06:44:32.805107+0000","last_peered":"2024-09-13T06:44:32.805107+0000","last_clean":"2024-09-13T06:44:32.805107+0000","last_became_active":"2024-09-13T06:44:18.456828+0000","last_became_peered":"2024-09-13T06:44:18.456828+0000","last_unstale":"2024-09-13T06:44:32.805107+0000","last_undegraded":"2024-09-13T06:44:32.805107+0000","last_fullsized":"2024-09-13T06:44:32.805107+0000","mapping_epoch":288,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":289,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_clean_scrub_stamp":"2024-09-13T06:39:16.508974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:17:09.082426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"279'349","reported_seq":3763,"reported_epoch":304,"state":"active+clean","last_fresh":"2024-09-13T06:44:33.827275+0000","last_change":"2024-09-13T06:44:05.440371+0000","last_active":"2024-09-13T06:44:33.827275+0000","last_peered":"2024-09-13T06:44:33.827275+0000","last_clean":"2024-09-13T06:44:33.827275+0000","last_became_active":"2024-09-13T06:41:15.399301+0000","last_became_peered":"2024-09-13T06:41:15.399301+0000","last_unstale":"2024-09-13T06:44:33.827275+0000","last_undegraded":"2024-09-13T06:44:33.827275+0000","last_fullsized":"2024-09-13T06:44:33.827275+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":349,"log_dups_size":0,"ondisk_log_size":349,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:53:18.137873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001343293,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2523,"num_read_kb":19829,"num_write":427,"num_write_kb":20943,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":169,"num_bytes_recovered":5233325,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"18'1","reported_seq":56,"reported_epoch":303,"state":"active+clean","last_fresh":"2024-09-13T06:44:32.834077+0000","last_change":"2024-09-13T06:44:30.798045+0000","last_active":"2024-09-13T06:44:32.834077+0000","last_peered":"2024-09-13T06:44:32.834077+0000","last_clean":"2024-09-13T06:44:32.834077+0000","last_became_active":"2024-09-13T06:44:30.796877+0000","last_became_peered":"2024-09-13T06:44:30.796877+0000","last_unstale":"2024-09-13T06:44:32.834077+0000","last_undegraded":"2024-09-13T06:44:32.834077+0000","last_fullsized":"2024-09-13T06:44:32.834077+0000","mapping_epoch":300,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":301,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_clean_scrub_stamp":"2024-09-13T06:39:16.508974+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:33:04.298167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":397,"reported_epoch":303,"state":"active+clean","last_fresh":"2024-09-13T06:44:32.805140+0000","last_change":"2024-09-13T06:42:28.563168+0000","last_active":"2024-09-13T06:44:32.805140+0000","last_peered":"2024-09-13T06:44:32.805140+0000","last_clean":"2024-09-13T06:44:32.805140+0000","last_became_active":"2024-09-13T06:42:28.562642+0000","last_became_peered":"2024-09-13T06:42:28.562642+0000","last_unstale":"2024-09-13T06:44:32.805140+0000","last_undegraded":"2024-09-13T06:44:32.805140+0000","last_fullsized":"2024-09-13T06:44:32.805140+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:10.110558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:10.110558+0000","last_clean_scrub_stamp":"2024-09-13T06:39:10.110558+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:05:54.866043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"277'651","reported_seq":10851,"reported_epoch":304,"state":"active+clean","last_fresh":"2024-09-13T06:44:33.827115+0000","last_change":"2024-09-13T06:44:22.452634+0000","last_active":"2024-09-13T06:44:33.827115+0000","last_peered":"2024-09-13T06:44:33.827115+0000","last_clean":"2024-09-13T06:44:33.827115+0000","last_became_active":"2024-09-13T06:44:22.448736+0000","last_became_peered":"2024-09-13T06:44:22.448736+0000","last_unstale":"2024-09-13T06:44:33.827115+0000","last_undegraded":"2024-09-13T06:44:33.827115+0000","last_fullsized":"2024-09-13T06:44:33.827115+0000","mapping_epoch":292,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":293,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":651,"log_dups_size":0,"ondisk_log_size":651,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:58:40.103969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00083432600000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9552,"num_read_kb":46146,"num_write":828,"num_write_kb":32512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":446,"num_bytes_recovered":11977587,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"277'774","reported_seq":10944,"reported_epoch":304,"state":"active+clean","last_fresh":"2024-09-13T06:44:33.827759+0000","last_change":"2024-09-13T06:44:20.466493+0000","last_active":"2024-09-13T06:44:33.827759+0000","last_peered":"2024-09-13T06:44:33.827759+0000","last_clean":"2024-09-13T06:44:33.827759+0000","last_became_active":"2024-09-13T06:44:20.462849+0000","last_became_peered":"2024-09-13T06:44:20.462849+0000","last_unstale":"2024-09-13T06:44:33.827759+0000","last_undegraded":"2024-09-13T06:44:33.827759+0000","last_fullsized":"2024-09-13T06:44:33.827759+0000","mapping_epoch":290,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":291,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":774,"log_dups_size":0,"ondisk_log_size":774,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:40:44.119462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0024338839999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10729,"num_read_kb":51645,"num_write":931,"num_write_kb":34617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":445,"num_bytes_recovered":16579571,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"278'758","reported_seq":8282,"reported_epoch":305,"state":"active+clean","last_fresh":"2024-09-13T06:44:34.842308+0000","last_change":"2024-09-13T06:44:34.842308+0000","last_active":"2024-09-13T06:44:34.842308+0000","last_peered":"2024-09-13T06:44:34.842308+0000","last_clean":"2024-09-13T06:44:34.842308+0000","last_became_active":"2024-09-13T06:44:34.836417+0000","last_became_peered":"2024-09-13T06:44:34.836417+0000","last_unstale":"2024-09-13T06:44:34.842308+0000","last_undegraded":"2024-09-13T06:44:34.842308+0000","last_fullsized":"2024-09-13T06:44:34.842308+0000","mapping_epoch":304,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":305,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":758,"log_dups_size":0,"ondisk_log_size":758,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:44:55.089545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00085210600000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8422,"num_read_kb":47219,"num_write":883,"num_write_kb":28077,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":515,"num_bytes_recovered":28581300,"num_keys_recovered":111,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"271'845","reported_seq":5602,"reported_epoch":304,"state":"active+clean","last_fresh":"2024-09-13T06:44:33.827387+0000","last_change":"2024-09-13T06:44:05.439827+0000","last_active":"2024-09-13T06:44:33.827387+0000","last_peered":"2024-09-13T06:44:33.827387+0000","last_clean":"2024-09-13T06:44:33.827387+0000","last_became_active":"2024-09-13T06:41:15.399204+0000","last_became_peered":"2024-09-13T06:41:15.399204+0000","last_unstale":"2024-09-13T06:44:33.827387+0000","last_undegraded":"2024-09-13T06:44:33.827387+0000","last_fullsized":"2024-09-13T06:44:33.827387+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":845,"log_dups_size":0,"ondisk_log_size":845,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:27:03.298272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00094468700000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6686,"num_read_kb":57840,"num_write":1181,"num_write_kb":24665,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":117,"num_bytes_recovered":13256568,"num_keys_recovered":44,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"279'569","reported_seq":6603,"reported_epoch":303,"state":"active+clean","last_fresh":"2024-09-13T06:44:32.834414+0000","last_change":"2024-09-13T06:44:30.802655+0000","last_active":"2024-09-13T06:44:32.834414+0000","last_peered":"2024-09-13T06:44:32.834414+0000","last_clean":"2024-09-13T06:44:32.834414+0000","last_became_active":"2024-09-13T06:44:30.794873+0000","last_became_peered":"2024-09-13T06:44:30.794873+0000","last_unstale":"2024-09-13T06:44:32.834414+0000","last_undegraded":"2024-09-13T06:44:32.834414+0000","last_fullsized":"2024-09-13T06:44:32.834414+0000","mapping_epoch":300,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":301,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":569,"log_dups_size":0,"ondisk_log_size":569,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:26:59.771063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0027493119999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6187,"num_read_kb":31727,"num_write":657,"num_write_kb":25682,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":184,"num_bytes_recovered":16410936,"num_keys_recovered":88,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"277'881","reported_seq":2923,"reported_epoch":303,"state":"active+clean","last_fresh":"2024-09-13T06:44:32.805567+0000","last_change":"2024-09-13T06:44:05.458093+0000","last_active":"2024-09-13T06:44:32.805567+0000","last_peered":"2024-09-13T06:44:32.805567+0000","last_clean":"2024-09-13T06:44:32.805567+0000","last_became_active":"2024-09-13T06:42:32.411927+0000","last_became_peered":"2024-09-13T06:42:32.411927+0000","last_unstale":"2024-09-13T06:44:32.805567+0000","last_undegraded":"2024-09-13T06:44:32.805567+0000","last_fullsized":"2024-09-13T06:44:32.805567+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":881,"log_dups_size":0,"ondisk_log_size":881,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:40:44.787780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.003013108,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4846,"num_read_kb":26164,"num_write":1518,"num_write_kb":30083,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":140,"num_bytes_recovered":11278110,"num_keys_recovered":11,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.e","version":"277'556","reported_seq":4102,"reported_epoch":303,"state":"active+clean","last_fresh":"2024-09-13T06:44:32.805528+0000","last_change":"2024-09-13T06:44:30.808041+0000","last_active":"2024-09-13T06:44:32.805528+0000","last_peered":"2024-09-13T06:44:32.805528+0000","last_clean":"2024-09-13T06:44:32.805528+0000","last_became_active":"2024-09-13T06:44:30.801655+0000","last_became_peered":"2024-09-13T06:44:30.801655+0000","last_unstale":"2024-09-13T06:44:32.805528+0000","last_undegraded":"2024-09-13T06:44:32.805528+0000","last_fullsized":"2024-09-13T06:44:32.805528+0000","mapping_epoch":300,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":301,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":556,"log_dups_size":0,"ondisk_log_size":556,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:43:53.489080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0025767619999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3868,"num_read_kb":43567,"num_write":654,"num_write_kb":29232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":503,"num_bytes_recovered":12695191,"num_keys_recovered":11,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"277'665","reported_seq":4754,"reported_epoch":303,"state":"active+clean","last_fresh":"2024-09-13T06:44:32.805508+0000","last_change":"2024-09-13T06:44:05.458214+0000","last_active":"2024-09-13T06:44:32.805508+0000","last_peered":"2024-09-13T06:44:32.805508+0000","last_clean":"2024-09-13T06:44:32.805508+0000","last_became_active":"2024-09-13T06:42:33.412054+0000","last_became_peered":"2024-09-13T06:42:33.412054+0000","last_unstale":"2024-09-13T06:44:32.805508+0000","last_undegraded":"2024-09-13T06:44:32.805508+0000","last_fullsized":"2024-09-13T06:44:32.805508+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":665,"log_dups_size":0,"ondisk_log_size":665,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:07:06.963404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00285659,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4677,"num_read_kb":45287,"num_write":982,"num_write_kb":45285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":394,"num_bytes_recovered":42768786,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.10","version":"280'832","reported_seq":5035,"reported_epoch":304,"state":"active+clean","last_fresh":"2024-09-13T06:44:33.831977+0000","last_change":"2024-09-13T06:44:19.467239+0000","last_active":"2024-09-13T06:44:33.831977+0000","last_peered":"2024-09-13T06:44:33.831977+0000","last_clean":"2024-09-13T06:44:33.831977+0000","last_became_active":"2024-09-13T06:44:19.459617+0000","last_became_peered":"2024-09-13T06:44:19.459617+0000","last_unstale":"2024-09-13T06:44:33.831977+0000","last_undegraded":"2024-09-13T06:44:33.831977+0000","last_fullsized":"2024-09-13T06:44:33.831977+0000","mapping_epoch":289,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":290,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":832,"log_dups_size":0,"ondisk_log_size":832,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:43:55.736868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0018779840000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5715,"num_read_kb":29614,"num_write":1142,"num_write_kb":36190,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":275,"num_bytes_recovered":6622441,"num_keys_recovered":20,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.11","version":"279'502","reported_seq":6279,"reported_epoch":303,"state":"active+clean","last_fresh":"2024-09-13T06:44:32.805097+0000","last_change":"2024-09-13T06:44:05.455675+0000","last_active":"2024-09-13T06:44:32.805097+0000","last_peered":"2024-09-13T06:44:32.805097+0000","last_clean":"2024-09-13T06:44:32.805097+0000","last_became_active":"2024-09-13T06:42:33.411668+0000","last_became_peered":"2024-09-13T06:42:33.411668+0000","last_unstale":"2024-09-13T06:44:32.805097+0000","last_undegraded":"2024-09-13T06:44:32.805097+0000","last_fullsized":"2024-09-13T06:44:32.805097+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":502,"log_dups_size":0,"ondisk_log_size":502,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:43:01.814094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001270492,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5341,"num_read_kb":34087,"num_write":659,"num_write_kb":25712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":245,"num_bytes_recovered":7089272,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"280'921","reported_seq":5047,"reported_epoch":303,"state":"active+clean","last_fresh":"2024-09-13T06:44:32.809379+0000","last_change":"2024-09-13T06:44:20.470378+0000","last_active":"2024-09-13T06:44:32.809379+0000","last_peered":"2024-09-13T06:44:32.809379+0000","last_clean":"2024-09-13T06:44:32.809379+0000","last_became_active":"2024-09-13T06:44:20.466713+0000","last_became_peered":"2024-09-13T06:44:20.466713+0000","last_unstale":"2024-09-13T06:44:32.809379+0000","last_undegraded":"2024-09-13T06:44:32.809379+0000","last_fullsized":"2024-09-13T06:44:32.809379+0000","mapping_epoch":290,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":291,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":921,"log_dups_size":0,"ondisk_log_size":921,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:00:14.406068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0017683250000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6025,"num_read_kb":38947,"num_write":1315,"num_write_kb":35656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":107,"num_bytes_recovered":3682200,"num_keys_recovered":21,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"279'604","reported_seq":4546,"reported_epoch":303,"state":"active+clean","last_fresh":"2024-09-13T06:44:32.805143+0000","last_change":"2024-09-13T06:44:05.454984+0000","last_active":"2024-09-13T06:44:32.805143+0000","last_peered":"2024-09-13T06:44:32.805143+0000","last_clean":"2024-09-13T06:44:32.805143+0000","last_became_active":"2024-09-13T06:42:31.402800+0000","last_became_peered":"2024-09-13T06:42:31.402800+0000","last_unstale":"2024-09-13T06:44:32.805143+0000","last_undegraded":"2024-09-13T06:44:32.805143+0000","last_fullsized":"2024-09-13T06:44:32.805143+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":604,"log_dups_size":0,"ondisk_log_size":604,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:59:41.167052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010470779999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4471,"num_read_kb":35894,"num_write":884,"num_write_kb":31515,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":196,"num_bytes_recovered":8224568,"num_keys_recovered":11,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":19,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":237282,"num_read_kb":1402862,"num_write":33322,"num_write_kb":1008910,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9249,"num_bytes_recovered":443628516,"num_keys_recovered":867,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14648,"internal_metadata":0},"log_size":24486,"ondisk_log_size":24486,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":57,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":3}],"osd_stats":[{"osd":7,"up_from":187,"seq":803158884380,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37040,"kb_used_data":4196,"kb_used_omap":9,"kb_used_meta":32822,"kb_avail":94334800,"statfs":{"total":96636764160,"available":96598835200,"internally_reserved":0,"allocated":4296704,"data_stored":2446923,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9685,"internal_metadata":33610283},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 06:44:33 2024","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":0.71199999999999997,"15min":0.69799999999999995},"min":{"1min":0.56699999999999995,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.83599999999999997},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.751,"15min":0.73999999999999999},"min":{"1min":0.54600000000000004,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.6910000000000001,"5min":1.6910000000000001,"15min":1.6910000000000001},"last":0.90100000000000002}]},{"osd":1,"last update":"Fri Sep 13 06:44:33 2024","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.75700000000000001,"15min":0.751},"min":{"1min":0.57399999999999995,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.359,"5min":1.359,"15min":1.359},"last":0.86699999999999999},{"interface":"front","average":{"1min":0.82399999999999995,"5min":0.71599999999999997,"15min":0.69799999999999995},"min":{"1min":0.496,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.1259999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.93899999999999995}]},{"osd":2,"last update":"Fri Sep 13 06:44:33 2024","interfaces":[{"interface":"back","average":{"1min":0.80700000000000005,"5min":0.75900000000000001,"15min":0.751},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.2030000000000001,"5min":1.212,"15min":1.212},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.92200000000000004,"5min":0.81499999999999995,"15min":0.79700000000000004},"min":{"1min":0.58999999999999997,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.4319999999999999,"5min":1.4319999999999999,"15min":1.4319999999999999},"last":0.97699999999999998}]},{"osd":3,"last update":"Fri Sep 13 06:44:33 2024","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.79600000000000004,"15min":0.79200000000000004},"min":{"1min":0.60299999999999998,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.177,"5min":1.177,"15min":1.177},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.88600000000000001,"5min":0.84299999999999997,"15min":0.83599999999999997},"min":{"1min":0.48099999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.7350000000000001,"5min":1.7350000000000001,"15min":1.7350000000000001},"last":1.008}]},{"osd":4,"last update":"Fri Sep 13 06:44:33 2024","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.82299999999999995,"15min":0.82499999999999996},"min":{"1min":0.45500000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.405,"5min":1.405,"15min":1.405},"last":0.628},{"interface":"front","average":{"1min":1.0049999999999999,"5min":0.82299999999999995,"15min":0.79300000000000004},"min":{"1min":0.39800000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.6240000000000001,"5min":1.6240000000000001,"15min":1.6240000000000001},"last":1.137}]},{"osd":5,"last update":"Fri Sep 13 06:44:33 2024","interfaces":[{"interface":"back","average":{"1min":0.96599999999999997,"5min":0.88800000000000001,"15min":0.875},"min":{"1min":0.504,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.593,"5min":1.593,"15min":1.593},"last":1.036},{"interface":"front","average":{"1min":0.92300000000000004,"5min":0.84099999999999997,"15min":0.82699999999999996},"min":{"1min":0.53800000000000003,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.3400000000000001,"5min":1.3400000000000001,"15min":1.3400000000000001},"last":1.0620000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1619999999999999}]}]},{"osd":6,"up_from":286,"seq":1228360646663,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35504,"kb_used_data":3620,"kb_used_omap":7,"kb_used_meta":31864,"kb_avail":94336336,"statfs":{"total":96636764160,"available":96600408064,"internally_reserved":0,"allocated":3706880,"data_stored":1857127,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8145,"internal_metadata":32628783},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72399999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.26}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1879999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68700000000000006}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94699999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90900000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.21}]}]},{"osd":5,"up_from":13,"seq":55834574918,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":79024,"kb_used_data":3620,"kb_used_omap":1,"kb_used_meta":75390,"kb_avail":94292816,"statfs":{"total":96636764160,"available":96555843584,"internally_reserved":0,"allocated":3706880,"data_stored":1856574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":77199814},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 06:44:19 2024","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.71399999999999997,"15min":0.76500000000000001},"min":{"1min":0.40999999999999998,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":1.093,"5min":1.6679999999999999,"15min":1.6679999999999999},"last":1.0740000000000001},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.76900000000000002,"15min":0.79900000000000004},"min":{"1min":0.41299999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.1220000000000001,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":0.76100000000000001}]},{"osd":1,"last update":"Fri Sep 13 06:44:19 2024","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.73999999999999999,"15min":0.751},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":1.103,"5min":1.341,"15min":1.341},"last":1.03},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.70099999999999996,"15min":0.74099999999999999},"min":{"1min":0.40899999999999997,"5min":0.317,"15min":0.317},"max":{"1min":1.0089999999999999,"5min":1.722,"15min":1.722},"last":0.70899999999999996}]},{"osd":2,"last update":"Fri Sep 13 06:44:19 2024","interfaces":[{"interface":"back","average":{"1min":0.876,"5min":0.81999999999999995,"15min":0.86399999999999999},"min":{"1min":0.47699999999999998,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.143,"5min":1.833,"15min":1.833},"last":0.879},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.79200000000000004},"min":{"1min":0.47999999999999998,"5min":0.435,"15min":0.435},"max":{"1min":1.0169999999999999,"5min":1.4279999999999999,"15min":1.4279999999999999},"last":0.80100000000000005}]},{"osd":3,"last update":"Fri Sep 13 06:44:19 2024","interfaces":[{"interface":"back","average":{"1min":0.85699999999999998,"5min":0.81399999999999995,"15min":0.78000000000000003},"min":{"1min":0.45400000000000001,"5min":0.434,"15min":0.434},"max":{"1min":1.1659999999999999,"5min":1.885,"15min":1.885},"last":1.109},{"interface":"front","average":{"1min":0.85899999999999999,"5min":0.86299999999999999,"15min":0.86499999999999999},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.2410000000000001,"5min":1.907,"15min":1.907},"last":0.84699999999999998}]},{"osd":4,"last update":"Fri Sep 13 06:44:19 2024","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.83499999999999996,"15min":0.80500000000000005},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":1.159,"5min":6.3179999999999996,"15min":6.3179999999999996},"last":1.2270000000000001},{"interface":"front","average":{"1min":0.78000000000000003,"5min":1.0529999999999999,"15min":0.91000000000000003},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":1.2370000000000001,"5min":15.553000000000001,"15min":15.553000000000001},"last":1.145}]},{"osd":6,"last update":"Fri Sep 13 06:42:12 2024","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.86299999999999999,"15min":0.877},"min":{"1min":0.40000000000000002,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.9610000000000001,"5min":1.9610000000000001,"15min":1.9610000000000001},"last":0.95899999999999996},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.86099999999999999,"15min":0.87},"min":{"1min":0.39000000000000001,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.206,"5min":1.968,"15min":1.968},"last":0.93100000000000005}]},{"osd":7,"last update":"Fri Sep 13 06:44:31 2024","interfaces":[{"interface":"back","average":{"1min":0.96399999999999997,"5min":0.84399999999999997,"15min":0.82399999999999995},"min":{"1min":0.39000000000000001,"5min":0.373,"15min":0.373},"max":{"1min":1.2050000000000001,"5min":1.375,"15min":1.375},"last":0.998},{"interface":"front","average":{"1min":0.997,"5min":0.89800000000000002,"15min":0.88200000000000001},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":1.7050000000000001,"5min":1.7050000000000001,"15min":1.7050000000000001},"last":1.1739999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574918,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60984,"kb_used_data":3624,"kb_used_omap":1,"kb_used_meta":57342,"kb_avail":94310856,"statfs":{"total":96636764160,"available":96574316544,"internally_reserved":0,"allocated":3710976,"data_stored":1857146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":58718662},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 06:44:15 2024","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.79300000000000004,"15min":0.98999999999999999},"min":{"1min":0.41499999999999998,"5min":0.245,"15min":0.245},"max":{"1min":1.0720000000000001,"5min":5.8230000000000004,"15min":5.8230000000000004},"last":1.0609999999999999},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.71999999999999997,"15min":0.752},"min":{"1min":0.505,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.97299999999999998,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":1.0289999999999999}]},{"osd":1,"last update":"Fri Sep 13 06:44:15 2024","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.79300000000000004,"15min":0.75},"min":{"1min":0.45100000000000001,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.86899999999999999,"5min":10.156000000000001,"15min":10.156000000000001},"last":1.1990000000000001},{"interface":"front","average":{"1min":0.747,"5min":0.77500000000000002,"15min":0.83599999999999997},"min":{"1min":0.496,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.0349999999999999,"5min":1.286,"15min":1.286},"last":0.85299999999999998}]},{"osd":2,"last update":"Fri Sep 13 06:44:15 2024","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.751,"15min":0.82299999999999995},"min":{"1min":0.52800000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":1.0109999999999999,"5min":1.6000000000000001,"15min":1.6000000000000001},"last":0.98699999999999999},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.81299999999999994},"min":{"1min":0.65500000000000003,"5min":0.374,"15min":0.374},"max":{"1min":1.167,"5min":1.3540000000000001,"15min":1.3540000000000001},"last":0.93500000000000005}]},{"osd":3,"last update":"Fri Sep 13 06:44:15 2024","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.84699999999999998,"15min":0.90200000000000002},"min":{"1min":0.57499999999999996,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.6950000000000001,"5min":1.6950000000000001,"15min":1.6950000000000001},"last":1.1659999999999999},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.95299999999999996,"15min":0.92500000000000004},"min":{"1min":0.48499999999999999,"5min":0.374,"15min":0.374},"max":{"1min":1.8069999999999999,"5min":10.195,"15min":10.195},"last":0.96299999999999997}]},{"osd":5,"last update":"Fri Sep 13 06:44:15 2024","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.81499999999999995,"15min":0.85699999999999998},"min":{"1min":0.443,"5min":0.249,"15min":0.249},"max":{"1min":1.075,"5min":2.9790000000000001,"15min":2.9790000000000001},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.84399999999999997,"15min":0.91400000000000003},"min":{"1min":0.39700000000000002,"5min":0.372,"15min":0.372},"max":{"1min":1.0580000000000001,"5min":1.8779999999999999,"15min":1.8779999999999999},"last":0.89000000000000001}]},{"osd":6,"last update":"Fri Sep 13 06:42:14 2024","interfaces":[{"interface":"back","average":{"1min":0.90100000000000002,"5min":0.92100000000000004,"15min":0.82899999999999996},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":1.6100000000000001,"5min":10.016999999999999,"15min":10.016999999999999},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.86699999999999999,"5min":0.93300000000000005,"15min":0.95999999999999996},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.2030000000000001,"5min":2.0750000000000002,"15min":2.0750000000000002},"last":1.0920000000000001}]},{"osd":7,"last update":"Fri Sep 13 06:44:33 2024","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.1539999999999999,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.80300000000000005},{"interface":"front","average":{"1min":0.90400000000000003,"5min":0.89200000000000002,"15min":0.89000000000000001},"min":{"1min":0.505,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.2529999999999999,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":1.129}]}]},{"osd":3,"up_from":13,"seq":55834574921,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":74936,"kb_used_data":3620,"kb_used_omap":1,"kb_used_meta":71294,"kb_avail":94296904,"statfs":{"total":96636764160,"available":96560029696,"internally_reserved":0,"allocated":3706880,"data_stored":1857127,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":73005512},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 06:44:15 2024","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.56100000000000005,"15min":0.56899999999999995},"min":{"1min":0.24199999999999999,"5min":0.191,"15min":0.191},"max":{"1min":1.51,"5min":1.51,"15min":1.51},"last":0.26000000000000001},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.60599999999999998,"15min":0.65400000000000003},"min":{"1min":0.307,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.88900000000000001,"5min":1.2789999999999999,"15min":1.2789999999999999},"last":0.33600000000000002}]},{"osd":1,"last update":"Fri Sep 13 06:44:15 2024","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.54900000000000004,"15min":0.58599999999999997},"min":{"1min":0.29499999999999998,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.85399999999999998,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.28899999999999998},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.59999999999999998,"15min":0.66800000000000004},"min":{"1min":0.27700000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":1.607,"5min":1.607,"15min":1.607},"last":0.34899999999999998}]},{"osd":2,"last update":"Fri Sep 13 06:44:15 2024","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.629,"15min":0.65200000000000002},"min":{"1min":0.30199999999999999,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":1.5660000000000001,"5min":1.5660000000000001,"15min":1.5660000000000001},"last":0.378},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.59799999999999998,"15min":0.627},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":1.135,"5min":1.409,"15min":1.409},"last":0.315}]},{"osd":4,"last update":"Fri Sep 13 06:44:15 2024","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.82599999999999996,"15min":0.89400000000000002},"min":{"1min":0.42899999999999999,"5min":0.377,"15min":0.377},"max":{"1min":1.651,"5min":1.7929999999999999,"15min":1.7929999999999999},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.76300000000000001,"15min":0.78300000000000003},"min":{"1min":0.44700000000000001,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.96499999999999997,"5min":1.3240000000000001,"15min":1.3240000000000001},"last":0.60199999999999998}]},{"osd":5,"last update":"Fri Sep 13 06:44:15 2024","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":0.81200000000000006,"15min":0.84999999999999998},"min":{"1min":0.48799999999999999,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.3029999999999999,"5min":1.3799999999999999,"15min":1.3799999999999999},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.83099999999999996,"5min":0.82499999999999996,"15min":0.85999999999999999},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.4610000000000001,"5min":1.4610000000000001,"15min":1.4610000000000001},"last":0.66000000000000003}]},{"osd":6,"last update":"Fri Sep 13 06:42:11 2024","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.88500000000000001,"15min":0.91100000000000003},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.135,"5min":1.532,"15min":1.532},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.95299999999999996,"15min":0.98999999999999999},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.2250000000000001,"5min":1.825,"15min":1.825},"last":0.61899999999999999}]},{"osd":7,"last update":"Fri Sep 13 06:44:35 2024","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.89300000000000002,"15min":0.89800000000000002},"min":{"1min":0.57199999999999995,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.3009999999999999,"5min":1.3799999999999999,"15min":1.3799999999999999},"last":0.752},{"interface":"front","average":{"1min":0.93000000000000005,"5min":0.95799999999999996,"15min":0.96199999999999997},"min":{"1min":0.58799999999999997,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.4219999999999999,"5min":2.0459999999999998,"15min":2.0459999999999998},"last":0.52300000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574918,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60980,"kb_used_data":3620,"kb_used_omap":1,"kb_used_meta":57342,"kb_avail":94310860,"statfs":{"total":96636764160,"available":96574320640,"internally_reserved":0,"allocated":3706880,"data_stored":1857127,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":58718662},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 06:44:20 2024","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.66800000000000004,"15min":0.56200000000000006},"min":{"1min":0.19400000000000001,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.84199999999999997,"5min":8.6449999999999996,"15min":8.6449999999999996},"last":0.29299999999999998},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.65200000000000002,"15min":0.61099999999999999},"min":{"1min":0.30299999999999999,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":1.4410000000000001,"5min":4.0380000000000003,"15min":4.0380000000000003},"last":0.45300000000000001}]},{"osd":1,"last update":"Fri Sep 13 06:44:20 2024","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.64000000000000001,"15min":0.62},"min":{"1min":0.25,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":1.0329999999999999,"5min":3.4649999999999999,"15min":3.4649999999999999},"last":0.32700000000000001},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.66600000000000004,"15min":0.60299999999999998},"min":{"1min":0.34300000000000003,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":1.5049999999999999,"5min":3.8159999999999998,"15min":3.8159999999999998},"last":0.35699999999999998}]},{"osd":3,"last update":"Fri Sep 13 06:44:20 2024","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.65000000000000002,"15min":0.58599999999999997},"min":{"1min":0.36399999999999999,"5min":0.249,"15min":0.249},"max":{"1min":1.044,"5min":3.407,"15min":3.407},"last":0.39600000000000002},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.73599999999999999,"15min":0.68600000000000005},"min":{"1min":0.312,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.238,"5min":3.2639999999999998,"15min":3.2639999999999998},"last":0.38200000000000001}]},{"osd":4,"last update":"Fri Sep 13 06:44:20 2024","interfaces":[{"interface":"back","average":{"1min":0.83299999999999996,"5min":0.878,"15min":0.88500000000000001},"min":{"1min":0.45600000000000002,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.3759999999999999,"5min":3.1179999999999999,"15min":3.1179999999999999},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.81399999999999995,"5min":1.0620000000000001,"15min":0.94099999999999995},"min":{"1min":0.46800000000000003,"5min":0.439,"15min":0.439},"max":{"1min":1.359,"5min":21.081,"15min":21.081},"last":0.81899999999999995}]},{"osd":5,"last update":"Fri Sep 13 06:44:20 2024","interfaces":[{"interface":"back","average":{"1min":0.82999999999999996,"5min":0.84799999999999998,"15min":0.84299999999999997},"min":{"1min":0.60099999999999998,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":1.143,"5min":2.2389999999999999,"15min":2.2389999999999999},"last":0.77300000000000002},{"interface":"front","average":{"1min":1.133,"5min":0.96099999999999997,"15min":0.88900000000000001},"min":{"1min":0.54400000000000004,"5min":0.377,"15min":0.377},"max":{"1min":4.9039999999999999,"5min":4.9039999999999999,"15min":4.9039999999999999},"last":0.80800000000000005}]},{"osd":6,"last update":"Fri Sep 13 06:42:15 2024","interfaces":[{"interface":"back","average":{"1min":0.86799999999999999,"5min":0.94199999999999995,"15min":0.92600000000000005},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.274,"5min":3.923,"15min":3.923},"last":0.749},{"interface":"front","average":{"1min":0.97799999999999998,"5min":0.90500000000000003,"15min":0.879},"min":{"1min":0.60899999999999999,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":2.2080000000000002,"5min":2.2120000000000002,"15min":2.2120000000000002},"last":0.64600000000000002}]},{"osd":7,"last update":"Fri Sep 13 06:44:33 2024","interfaces":[{"interface":"back","average":{"1min":0.95799999999999996,"5min":0.86499999999999999,"15min":0.84899999999999998},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":1.641,"5min":1.641,"15min":1.641},"last":0.85899999999999999},{"interface":"front","average":{"1min":1.05,"5min":0.88600000000000001,"15min":0.85799999999999998},"min":{"1min":0.71499999999999997,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":2.0630000000000002,"5min":2.0630000000000002,"15min":2.0630000000000002},"last":0.72099999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574918,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52792,"kb_used_data":3624,"kb_used_omap":1,"kb_used_meta":49150,"kb_avail":94319048,"statfs":{"total":96636764160,"available":96582705152,"internally_reserved":0,"allocated":3710976,"data_stored":1856593,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":50330054},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 06:44:21 2024","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.55300000000000005,"15min":0.57299999999999995},"min":{"1min":0.246,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":1.1879999999999999,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.64200000000000002,"15min":0.65900000000000003},"min":{"1min":0.26200000000000001,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.99199999999999999,"5min":1.8160000000000001,"15min":1.8160000000000001},"last":0.751}]},{"osd":2,"last update":"Fri Sep 13 06:44:21 2024","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.60699999999999998,"15min":0.63400000000000001},"min":{"1min":0.26800000000000002,"5min":0.22,"15min":0.22},"max":{"1min":0.92200000000000004,"5min":2.617,"15min":2.617},"last":1.0109999999999999},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.65300000000000002,"15min":0.65400000000000003},"min":{"1min":0.28499999999999998,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":1.331,"5min":2.5249999999999999,"15min":2.5249999999999999},"last":0.70299999999999996}]},{"osd":3,"last update":"Fri Sep 13 06:44:21 2024","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.70499999999999996,"15min":0.72599999999999998},"min":{"1min":0.33900000000000002,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":1.2769999999999999,"5min":1.3640000000000001,"15min":1.3640000000000001},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.66700000000000004,"15min":0.69099999999999995},"min":{"1min":0.30399999999999999,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":1.028,"5min":1.752,"15min":1.752},"last":0.66300000000000003}]},{"osd":4,"last update":"Fri Sep 13 06:44:21 2024","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.79800000000000004,"15min":0.81999999999999995},"min":{"1min":0.60899999999999999,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":1.109,"5min":2.7389999999999999,"15min":2.7389999999999999},"last":1.224},{"interface":"front","average":{"1min":0.94499999999999995,"5min":0.85499999999999998,"15min":0.90600000000000003},"min":{"1min":0.40000000000000002,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.4159999999999999,"5min":1.4359999999999999,"15min":1.4359999999999999},"last":0.87}]},{"osd":5,"last update":"Fri Sep 13 06:44:21 2024","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.84499999999999997,"15min":0.90600000000000003},"min":{"1min":0.58099999999999996,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.1399999999999999,"5min":1.7849999999999999,"15min":1.7849999999999999},"last":1.0640000000000001},{"interface":"front","average":{"1min":0.89600000000000002,"5min":0.86599999999999999,"15min":0.879},"min":{"1min":0.495,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":1.202,"5min":2.036,"15min":2.036},"last":1.1830000000000001}]},{"osd":6,"last update":"Fri Sep 13 06:42:18 2024","interfaces":[{"interface":"back","average":{"1min":0.87,"5min":0.92200000000000004,"15min":0.94399999999999995},"min":{"1min":0.57699999999999996,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.526,"5min":1.8149999999999999,"15min":1.8149999999999999},"last":1.101},{"interface":"front","average":{"1min":0.88900000000000001,"5min":0.91200000000000003,"15min":0.91900000000000004},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":2.7810000000000001,"5min":2.7810000000000001,"15min":2.7810000000000001},"last":0.95299999999999996}]},{"osd":7,"last update":"Fri Sep 13 06:44:33 2024","interfaces":[{"interface":"back","average":{"1min":0.91900000000000004,"5min":0.90600000000000003,"15min":0.90400000000000003},"min":{"1min":0.621,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":1.3220000000000001,"5min":1.605,"15min":1.605},"last":1.1479999999999999},{"interface":"front","average":{"1min":1.054,"5min":0.93899999999999995,"15min":0.92000000000000004},"min":{"1min":0.61099999999999999,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.5009999999999999,"5min":1.5009999999999999,"15min":1.5009999999999999},"last":0.98099999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574917,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":85364,"kb_used_data":4196,"kb_used_omap":1,"kb_used_meta":81150,"kb_avail":94286476,"statfs":{"total":96636764160,"available":96549351424,"internally_reserved":0,"allocated":4296704,"data_stored":2446923,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":83098054},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 06:44:11 2024","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.54900000000000004,"15min":0.53000000000000003},"min":{"1min":0.23999999999999999,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":1.048,"5min":1.2270000000000001,"15min":1.2270000000000001},"last":0.23200000000000001},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.56000000000000005,"15min":0.54000000000000004},"min":{"1min":0.28799999999999998,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":1.137,"5min":1.222,"15min":1.222},"last":0.38400000000000001}]},{"osd":2,"last update":"Fri Sep 13 06:44:11 2024","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.60399999999999998,"15min":0.55600000000000005},"min":{"1min":0.27300000000000002,"5min":0.217,"15min":0.217},"max":{"1min":1.2549999999999999,"5min":1.839,"15min":1.839},"last":0.28199999999999997},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.61299999999999999,"15min":0.57499999999999996},"min":{"1min":0.35399999999999998,"5min":0.245,"15min":0.245},"max":{"1min":1.419,"5min":1.419,"15min":1.419},"last":0.36299999999999999}]},{"osd":3,"last update":"Fri Sep 13 06:44:11 2024","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.59999999999999998,"15min":0.55800000000000005},"min":{"1min":0.371,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":1.2250000000000001,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.34200000000000003},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.74299999999999999,"15min":0.69899999999999995},"min":{"1min":0.36699999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":1.175,"5min":4.9630000000000001,"15min":4.9630000000000001},"last":0.31}]},{"osd":4,"last update":"Fri Sep 13 06:44:11 2024","interfaces":[{"interface":"back","average":{"1min":0.89400000000000002,"5min":0.80400000000000005,"15min":0.79400000000000004},"min":{"1min":0.57899999999999996,"5min":0.311,"15min":0.311},"max":{"1min":1.6259999999999999,"5min":1.6259999999999999,"15min":1.6259999999999999},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.77400000000000002,"15min":0.79600000000000004},"min":{"1min":0.58999999999999997,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.1799999999999999,"5min":1.6319999999999999,"15min":1.6319999999999999},"last":0.51100000000000001}]},{"osd":5,"last update":"Fri Sep 13 06:44:11 2024","interfaces":[{"interface":"back","average":{"1min":0.89900000000000002,"5min":0.85799999999999998,"15min":0.85199999999999998},"min":{"1min":0.52800000000000002,"5min":0.378,"15min":0.378},"max":{"1min":1.575,"5min":1.575,"15min":1.575},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.89100000000000001,"5min":0.85699999999999998,"15min":0.87},"min":{"1min":0.60199999999999998,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.327,"5min":1.5740000000000001,"15min":1.5740000000000001},"last":0.748}]},{"osd":6,"last update":"Fri Sep 13 06:42:11 2024","interfaces":[{"interface":"back","average":{"1min":0.89800000000000002,"5min":0.91200000000000003,"15min":0.93100000000000005},"min":{"1min":0.55300000000000005,"5min":0.499,"15min":0.499},"max":{"1min":1.571,"5min":2.4969999999999999,"15min":2.4969999999999999},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.878,"5min":0.89600000000000002,"15min":0.90600000000000003},"min":{"1min":0.51800000000000002,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.208,"5min":2.0419999999999998,"15min":2.0419999999999998},"last":0.82599999999999996}]},{"osd":7,"last update":"Fri Sep 13 06:44:31 2024","interfaces":[{"interface":"back","average":{"1min":0.97799999999999998,"5min":1.0529999999999999,"15min":1.0649999999999999},"min":{"1min":0.57799999999999996,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.381,"5min":1.9419999999999999,"15min":1.9419999999999999},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.97899999999999998,"5min":0.96999999999999997,"15min":0.96799999999999997},"min":{"1min":0.64100000000000001,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.4750000000000001,"5min":1.901,"15min":1.901},"last":0.77400000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6552,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8096,"internal_metadata":0}]}} 2024-09-13T06:44:42.469 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-13T06:44:42.469 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T06:44:42.763 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T06:44:42.763 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-09-13T06:44:42.780 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":464,"stamp":"2024-09-13T06:44:41.610509+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590406,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":237398,"num_read_kb":1402962,"num_write":33483,"num_write_kb":1011328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9257,"num_bytes_recovered":444809309,"num_keys_recovered":867,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":24606,"ondisk_log_size":24606,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":486624,"kb_used_data":30120,"kb_used_omap":26,"kb_used_meta":456357,"kb_avail":754488096,"statfs":{"total":773094113280,"available":772595810304,"internally_reserved":0,"allocated":30842880,"data_stored":16035540,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":27392,"internal_metadata":467309824},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":-152,"num_bytes_recovered":-19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002227"},"pg_stats":[{"pgid":"3.1f","version":"280'781","reported_seq":6287,"reported_epoch":303,"state":"active+clean","last_fresh":"2024-09-13T06:44:32.809403+0000","last_change":"2024-09-13T06:44:05.445184+0000","last_active":"2024-09-13T06:44:32.809403+0000","last_peered":"2024-09-13T06:44:32.809403+0000","last_clean":"2024-09-13T06:44:32.809403+0000","last_became_active":"2024-09-13T06:40:57.385213+0000","last_became_peered":"2024-09-13T06:40:57.385213+0000","last_unstale":"2024-09-13T06:44:32.809403+0000","last_undegraded":"2024-09-13T06:44:32.809403+0000","last_fullsized":"2024-09-13T06:44:32.809403+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":781,"log_dups_size":0,"ondisk_log_size":781,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:46:17.100560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00056495999999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6518,"num_read_kb":34199,"num_write":1043,"num_write_kb":37100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":72,"num_bytes_recovered":6114482,"num_keys_recovered":44,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"271'1110","reported_seq":7422,"reported_epoch":304,"state":"active+clean","last_fresh":"2024-09-13T06:44:33.827798+0000","last_change":"2024-09-13T06:44:20.462945+0000","last_active":"2024-09-13T06:44:33.827798+0000","last_peered":"2024-09-13T06:44:33.827798+0000","last_clean":"2024-09-13T06:44:33.827798+0000","last_became_active":"2024-09-13T06:44:20.460702+0000","last_became_peered":"2024-09-13T06:44:20.460702+0000","last_unstale":"2024-09-13T06:44:33.827798+0000","last_undegraded":"2024-09-13T06:44:33.827798+0000","last_fullsized":"2024-09-13T06:44:33.827798+0000","mapping_epoch":290,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":291,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":1110,"log_dups_size":0,"ondisk_log_size":1110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:02:22.560348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013343369999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8806,"num_read_kb":55237,"num_write":1632,"num_write_kb":29160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":491,"num_bytes_recovered":16489974,"num_keys_recovered":55,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"279'1047","reported_seq":5656,"reported_epoch":303,"state":"active+clean","last_fresh":"2024-09-13T06:44:32.834174+0000","last_change":"2024-09-13T06:44:30.808653+0000","last_active":"2024-09-13T06:44:32.834174+0000","last_peered":"2024-09-13T06:44:32.834174+0000","last_clean":"2024-09-13T06:44:32.834174+0000","last_became_active":"2024-09-13T06:44:30.803142+0000","last_became_peered":"2024-09-13T06:44:30.803142+0000","last_unstale":"2024-09-13T06:44:32.834174+0000","last_undegraded":"2024-09-13T06:44:32.834174+0000","last_fullsized":"2024-09-13T06:44:32.834174+0000","mapping_epoch":300,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":301,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":1047,"log_dups_size":0,"ondisk_log_size":1047,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:25:53.597990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00088262599999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6265,"num_read_kb":28067,"num_write":1605,"num_write_kb":33265,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":206,"num_bytes_recovered":8442088,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1c","version":"280'843","reported_seq":8395,"reported_epoch":303,"state":"active+clean","last_fresh":"2024-09-13T06:44:32.834069+0000","last_change":"2024-09-13T06:44:30.807782+0000","last_active":"2024-09-13T06:44:32.834069+0000","last_peered":"2024-09-13T06:44:32.834069+0000","last_clean":"2024-09-13T06:44:32.834069+0000","last_became_active":"2024-09-13T06:44:30.801783+0000","last_became_peered":"2024-09-13T06:44:30.801783+0000","last_unstale":"2024-09-13T06:44:32.834069+0000","last_undegraded":"2024-09-13T06:44:32.834069+0000","last_fullsized":"2024-09-13T06:44:32.834069+0000","mapping_epoch":300,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":301,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":843,"log_dups_size":0,"ondisk_log_size":843,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:54:20.743708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001581236,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9390,"num_read_kb":69964,"num_write":963,"num_write_kb":31840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":350,"num_bytes_recovered":42380134,"num_keys_recovered":286,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"277'852","reported_seq":5171,"reported_epoch":305,"state":"active+clean","last_fresh":"2024-09-13T06:44:34.833406+0000","last_change":"2024-09-13T06:44:05.444712+0000","last_active":"2024-09-13T06:44:34.833406+0000","last_peered":"2024-09-13T06:44:34.833406+0000","last_clean":"2024-09-13T06:44:34.833406+0000","last_became_active":"2024-09-13T06:43:31.415608+0000","last_became_peered":"2024-09-13T06:43:31.415608+0000","last_unstale":"2024-09-13T06:44:34.833406+0000","last_undegraded":"2024-09-13T06:44:34.833406+0000","last_fullsized":"2024-09-13T06:44:34.833406+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":852,"log_dups_size":0,"ondisk_log_size":852,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:39:01.416782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060857399999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5714,"num_read_kb":37037,"num_write":1079,"num_write_kb":33376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":295,"num_bytes_recovered":25415745,"num_keys_recovered":55,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"277'497","reported_seq":7757,"reported_epoch":304,"state":"active+clean","last_fresh":"2024-09-13T06:44:33.828415+0000","last_change":"2024-09-13T06:44:20.469801+0000","last_active":"2024-09-13T06:44:33.828415+0000","last_peered":"2024-09-13T06:44:33.828415+0000","last_clean":"2024-09-13T06:44:33.828415+0000","last_became_active":"2024-09-13T06:44:20.462185+0000","last_became_peered":"2024-09-13T06:44:20.462185+0000","last_unstale":"2024-09-13T06:44:33.828415+0000","last_undegraded":"2024-09-13T06:44:33.828415+0000","last_fullsized":"2024-09-13T06:44:33.828415+0000","mapping_epoch":290,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":291,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":497,"log_dups_size":0,"ondisk_log_size":497,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:55:41.801680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00078923399999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6439,"num_read_kb":42977,"num_write":667,"num_write_kb":32420,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":728,"num_bytes_recovered":12986751,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"275'680","reported_seq":8570,"reported_epoch":304,"state":"active+clean","last_fresh":"2024-09-13T06:44:34.541517+0000","last_change":"2024-09-13T06:44:21.446173+0000","last_active":"2024-09-13T06:44:34.541517+0000","last_peered":"2024-09-13T06:44:34.541517+0000","last_clean":"2024-09-13T06:44:34.541517+0000","last_became_active":"2024-09-13T06:44:21.442872+0000","last_became_peered":"2024-09-13T06:44:21.442872+0000","last_unstale":"2024-09-13T06:44:34.541517+0000","last_undegraded":"2024-09-13T06:44:34.541517+0000","last_fullsized":"2024-09-13T06:44:34.541517+0000","mapping_epoch":291,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":292,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":680,"log_dups_size":0,"ondisk_log_size":680,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:11:12.949824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00079955100000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8400,"num_read_kb":35906,"num_write":738,"num_write_kb":28560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":398,"num_bytes_recovered":17539742,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"272'684","reported_seq":7046,"reported_epoch":304,"state":"active+clean","last_fresh":"2024-09-13T06:44:33.827366+0000","last_change":"2024-09-13T06:44:05.439754+0000","last_active":"2024-09-13T06:44:33.827366+0000","last_peered":"2024-09-13T06:44:33.827366+0000","last_clean":"2024-09-13T06:44:33.827366+0000","last_became_active":"2024-09-13T06:41:14.395301+0000","last_became_peered":"2024-09-13T06:41:14.395301+0000","last_unstale":"2024-09-13T06:44:33.827366+0000","last_undegraded":"2024-09-13T06:44:33.827366+0000","last_fullsized":"2024-09-13T06:44:33.827366+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":684,"log_dups_size":0,"ondisk_log_size":684,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:10:49.528345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00092758900000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6571,"num_read_kb":55194,"num_write":838,"num_write_kb":38872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":117,"num_bytes_recovered":13142180,"num_keys_recovered":22,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"275'1525","reported_seq":5960,"reported_epoch":303,"state":"active+clean","last_fresh":"2024-09-13T06:44:32.809471+0000","last_change":"2024-09-13T06:44:05.444913+0000","last_active":"2024-09-13T06:44:32.809471+0000","last_peered":"2024-09-13T06:44:32.809471+0000","last_clean":"2024-09-13T06:44:32.809471+0000","last_became_active":"2024-09-13T06:43:22.521039+0000","last_became_peered":"2024-09-13T06:43:22.521039+0000","last_unstale":"2024-09-13T06:44:32.809471+0000","last_undegraded":"2024-09-13T06:44:32.809471+0000","last_fullsized":"2024-09-13T06:44:32.809471+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":1525,"log_dups_size":0,"ondisk_log_size":1525,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:58:28.305131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00029931499999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9655,"num_read_kb":41824,"num_write":2232,"num_write_kb":32733,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":112,"num_bytes_recovered":14950263,"num_keys_recovered":22,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"275'715","reported_seq":5276,"reported_epoch":303,"state":"active+clean","last_fresh":"2024-09-13T06:44:32.834246+0000","last_change":"2024-09-13T06:44:30.806149+0000","last_active":"2024-09-13T06:44:32.834246+0000","last_peered":"2024-09-13T06:44:32.834246+0000","last_clean":"2024-09-13T06:44:32.834246+0000","last_became_active":"2024-09-13T06:44:30.798028+0000","last_became_peered":"2024-09-13T06:44:30.798028+0000","last_unstale":"2024-09-13T06:44:32.834246+0000","last_undegraded":"2024-09-13T06:44:32.834246+0000","last_fullsized":"2024-09-13T06:44:32.834246+0000","mapping_epoch":300,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":301,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":715,"log_dups_size":0,"ondisk_log_size":715,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:09:18.289368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0024960030000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5101,"num_read_kb":28279,"num_write":1028,"num_write_kb":23183,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":197,"num_bytes_recovered":7394092,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"277'365","reported_seq":6173,"reported_epoch":303,"state":"active+clean","last_fresh":"2024-09-13T06:44:32.805429+0000","last_change":"2024-09-13T06:44:05.457231+0000","last_active":"2024-09-13T06:44:32.805429+0000","last_peered":"2024-09-13T06:44:32.805429+0000","last_clean":"2024-09-13T06:44:32.805429+0000","last_became_active":"2024-09-13T06:42:33.408009+0000","last_became_peered":"2024-09-13T06:42:33.408009+0000","last_unstale":"2024-09-13T06:44:32.805429+0000","last_undegraded":"2024-09-13T06:44:32.805429+0000","last_fullsized":"2024-09-13T06:44:32.805429+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":365,"log_dups_size":0,"ondisk_log_size":365,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:09:11.995853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0024654690000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5036,"num_read_kb":48021,"num_write":472,"num_write_kb":27276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":157,"num_bytes_recovered":13242563,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"280'579","reported_seq":9960,"reported_epoch":304,"state":"active+clean","last_fresh":"2024-09-13T06:44:33.828571+0000","last_change":"2024-09-13T06:44:05.443324+0000","last_active":"2024-09-13T06:44:33.828571+0000","last_peered":"2024-09-13T06:44:33.828571+0000","last_clean":"2024-09-13T06:44:33.828571+0000","last_became_active":"2024-09-13T06:44:03.438897+0000","last_became_peered":"2024-09-13T06:44:03.438897+0000","last_unstale":"2024-09-13T06:44:33.828571+0000","last_undegraded":"2024-09-13T06:44:33.828571+0000","last_fullsized":"2024-09-13T06:44:33.828571+0000","mapping_epoch":277,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":278,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":579,"log_dups_size":0,"ondisk_log_size":579,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:24:55.053861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012901029999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8875,"num_read_kb":61758,"num_write":769,"num_write_kb":30278,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":506,"num_bytes_recovered":26184965,"num_keys_recovered":33,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":27,"reported_epoch":304,"state":"active+clean","last_fresh":"2024-09-13T06:44:33.832029+0000","last_change":"2024-09-13T06:44:16.450557+0000","last_active":"2024-09-13T06:44:33.832029+0000","last_peered":"2024-09-13T06:44:33.832029+0000","last_clean":"2024-09-13T06:44:33.832029+0000","last_became_active":"2024-09-13T06:44:16.449558+0000","last_became_peered":"2024-09-13T06:44:16.449558+0000","last_unstale":"2024-09-13T06:44:33.832029+0000","last_undegraded":"2024-09-13T06:44:33.832029+0000","last_fullsized":"2024-09-13T06:44:33.832029+0000","mapping_epoch":286,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":287,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_clean_scrub_stamp":"2024-09-13T06:39:16.508974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:01:20.779972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00080324699999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"280'643","reported_seq":10760,"reported_epoch":303,"state":"active+clean","last_fresh":"2024-09-13T06:44:32.809700+0000","last_change":"2024-09-13T06:44:22.454207+0000","last_active":"2024-09-13T06:44:32.809700+0000","last_peered":"2024-09-13T06:44:32.809700+0000","last_clean":"2024-09-13T06:44:32.809700+0000","last_became_active":"2024-09-13T06:44:22.449195+0000","last_became_peered":"2024-09-13T06:44:22.449195+0000","last_unstale":"2024-09-13T06:44:32.809700+0000","last_undegraded":"2024-09-13T06:44:32.809700+0000","last_fullsized":"2024-09-13T06:44:32.809700+0000","mapping_epoch":292,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":293,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":643,"log_dups_size":0,"ondisk_log_size":643,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:28:58.479641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00080400600000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9397,"num_read_kb":51433,"num_write":883,"num_write_kb":40908,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":358,"num_bytes_recovered":1257624,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":24,"reported_epoch":304,"state":"active+clean","last_fresh":"2024-09-13T06:44:34.541380+0000","last_change":"2024-09-13T06:44:18.458951+0000","last_active":"2024-09-13T06:44:34.541380+0000","last_peered":"2024-09-13T06:44:34.541380+0000","last_clean":"2024-09-13T06:44:34.541380+0000","last_became_active":"2024-09-13T06:44:18.458454+0000","last_became_peered":"2024-09-13T06:44:18.458454+0000","last_unstale":"2024-09-13T06:44:34.541380+0000","last_undegraded":"2024-09-13T06:44:34.541380+0000","last_fullsized":"2024-09-13T06:44:34.541380+0000","mapping_epoch":288,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":289,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_clean_scrub_stamp":"2024-09-13T06:39:16.508974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:06:07.380573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00097079800000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"277'694","reported_seq":7060,"reported_epoch":304,"state":"active+clean","last_fresh":"2024-09-13T06:44:33.827435+0000","last_change":"2024-09-13T06:44:05.440674+0000","last_active":"2024-09-13T06:44:33.827435+0000","last_peered":"2024-09-13T06:44:33.827435+0000","last_clean":"2024-09-13T06:44:33.827435+0000","last_became_active":"2024-09-13T06:42:32.413006+0000","last_became_peered":"2024-09-13T06:42:32.413006+0000","last_unstale":"2024-09-13T06:44:33.827435+0000","last_undegraded":"2024-09-13T06:44:33.827435+0000","last_fullsized":"2024-09-13T06:44:33.827435+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":694,"log_dups_size":0,"ondisk_log_size":694,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:38:01.774494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001338379,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6521,"num_read_kb":33119,"num_write":812,"num_write_kb":30039,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":213,"num_bytes_recovered":15100645,"num_keys_recovered":11,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":181,"reported_epoch":305,"state":"active+clean","last_fresh":"2024-09-13T06:44:34.866142+0000","last_change":"2024-09-13T06:42:28.563276+0000","last_active":"2024-09-13T06:44:34.866142+0000","last_peered":"2024-09-13T06:44:34.866142+0000","last_clean":"2024-09-13T06:44:34.866142+0000","last_became_active":"2024-09-13T06:42:28.562827+0000","last_became_peered":"2024-09-13T06:42:28.562827+0000","last_unstale":"2024-09-13T06:44:34.866142+0000","last_undegraded":"2024-09-13T06:44:34.866142+0000","last_fullsized":"2024-09-13T06:44:34.866142+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_clean_scrub_stamp":"2024-09-13T06:39:16.508974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:10:47.285603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"277'961","reported_seq":6891,"reported_epoch":304,"state":"active+clean","last_fresh":"2024-09-13T06:44:34.541518+0000","last_change":"2024-09-13T06:44:22.455582+0000","last_active":"2024-09-13T06:44:34.541518+0000","last_peered":"2024-09-13T06:44:34.541518+0000","last_clean":"2024-09-13T06:44:34.541518+0000","last_became_active":"2024-09-13T06:44:22.450933+0000","last_became_peered":"2024-09-13T06:44:22.450933+0000","last_unstale":"2024-09-13T06:44:34.541518+0000","last_undegraded":"2024-09-13T06:44:34.541518+0000","last_fullsized":"2024-09-13T06:44:34.541518+0000","mapping_epoch":292,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":293,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":961,"log_dups_size":0,"ondisk_log_size":961,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:30:26.327840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0031147280000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7705,"num_read_kb":38648,"num_write":1332,"num_write_kb":32653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":354,"num_bytes_recovered":6765835,"num_keys_recovered":11,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":24,"reported_epoch":304,"state":"active+clean","last_fresh":"2024-09-13T06:44:34.541611+0000","last_change":"2024-09-13T06:44:18.468145+0000","last_active":"2024-09-13T06:44:34.541611+0000","last_peered":"2024-09-13T06:44:34.541611+0000","last_clean":"2024-09-13T06:44:34.541611+0000","last_became_active":"2024-09-13T06:44:18.467833+0000","last_became_peered":"2024-09-13T06:44:18.467833+0000","last_unstale":"2024-09-13T06:44:34.541611+0000","last_undegraded":"2024-09-13T06:44:34.541611+0000","last_fullsized":"2024-09-13T06:44:34.541611+0000","mapping_epoch":288,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":289,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_clean_scrub_stamp":"2024-09-13T06:39:16.508974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:33:56.156376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"277'640","reported_seq":7755,"reported_epoch":303,"state":"active+clean","last_fresh":"2024-09-13T06:44:32.834288+0000","last_change":"2024-09-13T06:44:30.803125+0000","last_active":"2024-09-13T06:44:32.834288+0000","last_peered":"2024-09-13T06:44:32.834288+0000","last_clean":"2024-09-13T06:44:32.834288+0000","last_became_active":"2024-09-13T06:44:30.797769+0000","last_became_peered":"2024-09-13T06:44:30.797769+0000","last_unstale":"2024-09-13T06:44:32.834288+0000","last_undegraded":"2024-09-13T06:44:32.834288+0000","last_fullsized":"2024-09-13T06:44:32.834288+0000","mapping_epoch":300,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":301,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":640,"log_dups_size":0,"ondisk_log_size":640,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:49:47.340041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0046689339999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7611,"num_read_kb":41345,"num_write":1018,"num_write_kb":26620,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":158,"num_bytes_recovered":4212424,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"280'991","reported_seq":21074,"reported_epoch":304,"state":"active+clean","last_fresh":"2024-09-13T06:44:33.828568+0000","last_change":"2024-09-13T06:44:28.773729+0000","last_active":"2024-09-13T06:44:33.828568+0000","last_peered":"2024-09-13T06:44:33.828568+0000","last_clean":"2024-09-13T06:44:33.828568+0000","last_became_active":"2024-09-13T06:44:28.768976+0000","last_became_peered":"2024-09-13T06:44:28.768976+0000","last_unstale":"2024-09-13T06:44:33.828568+0000","last_undegraded":"2024-09-13T06:44:33.828568+0000","last_fullsized":"2024-09-13T06:44:33.828568+0000","mapping_epoch":298,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":299,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":991,"log_dups_size":0,"ondisk_log_size":991,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:30:21.817297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0017436419999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20994,"num_read_kb":92583,"num_write":1315,"num_write_kb":30385,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":207,"num_bytes_recovered":9898606,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"20'2","reported_seq":125,"reported_epoch":303,"state":"active+clean","last_fresh":"2024-09-13T06:44:32.834084+0000","last_change":"2024-09-13T06:44:30.794941+0000","last_active":"2024-09-13T06:44:32.834084+0000","last_peered":"2024-09-13T06:44:32.834084+0000","last_clean":"2024-09-13T06:44:32.834084+0000","last_became_active":"2024-09-13T06:44:30.794134+0000","last_became_peered":"2024-09-13T06:44:30.794134+0000","last_unstale":"2024-09-13T06:44:32.834084+0000","last_undegraded":"2024-09-13T06:44:32.834084+0000","last_fullsized":"2024-09-13T06:44:32.834084+0000","mapping_epoch":300,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":301,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_clean_scrub_stamp":"2024-09-13T06:39:16.508974+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:36:10.351897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":57,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"278'857","reported_seq":10772,"reported_epoch":304,"state":"active+clean","last_fresh":"2024-09-13T06:44:34.541417+0000","last_change":"2024-09-13T06:44:21.445836+0000","last_active":"2024-09-13T06:44:34.541417+0000","last_peered":"2024-09-13T06:44:34.541417+0000","last_clean":"2024-09-13T06:44:34.541417+0000","last_became_active":"2024-09-13T06:44:21.442847+0000","last_became_peered":"2024-09-13T06:44:21.442847+0000","last_unstale":"2024-09-13T06:44:34.541417+0000","last_undegraded":"2024-09-13T06:44:34.541417+0000","last_fullsized":"2024-09-13T06:44:34.541417+0000","mapping_epoch":291,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":292,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":857,"log_dups_size":0,"ondisk_log_size":857,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:42:10.542267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00053211199999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11278,"num_read_kb":63107,"num_write":1190,"num_write_kb":36968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":351,"num_bytes_recovered":9847094,"num_keys_recovered":11,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":26,"reported_epoch":304,"state":"active+clean","last_fresh":"2024-09-13T06:44:33.827890+0000","last_change":"2024-09-13T06:44:17.443833+0000","last_active":"2024-09-13T06:44:33.827890+0000","last_peered":"2024-09-13T06:44:33.827890+0000","last_clean":"2024-09-13T06:44:33.827890+0000","last_became_active":"2024-09-13T06:44:17.443358+0000","last_became_peered":"2024-09-13T06:44:17.443358+0000","last_unstale":"2024-09-13T06:44:33.827890+0000","last_undegraded":"2024-09-13T06:44:33.827890+0000","last_fullsized":"2024-09-13T06:44:33.827890+0000","mapping_epoch":287,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":288,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_clean_scrub_stamp":"2024-09-13T06:39:16.508974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:30:37.013428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00033592499999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"277'1115","reported_seq":6258,"reported_epoch":303,"state":"active+clean","last_fresh":"2024-09-13T06:44:32.809218+0000","last_change":"2024-09-13T06:44:30.799789+0000","last_active":"2024-09-13T06:44:32.809218+0000","last_peered":"2024-09-13T06:44:32.809218+0000","last_clean":"2024-09-13T06:44:32.809218+0000","last_became_active":"2024-09-13T06:44:30.798508+0000","last_became_peered":"2024-09-13T06:44:30.798508+0000","last_unstale":"2024-09-13T06:44:32.809218+0000","last_undegraded":"2024-09-13T06:44:32.809218+0000","last_fullsized":"2024-09-13T06:44:32.809218+0000","mapping_epoch":300,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":301,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":1115,"log_dups_size":0,"ondisk_log_size":1115,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:04:47.174299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0032283849999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7964,"num_read_kb":36198,"num_write":1645,"num_write_kb":33105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":243,"num_bytes_recovered":7863454,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":197,"reported_epoch":303,"state":"active+clean","last_fresh":"2024-09-13T06:44:32.805107+0000","last_change":"2024-09-13T06:44:18.457601+0000","last_active":"2024-09-13T06:44:32.805107+0000","last_peered":"2024-09-13T06:44:32.805107+0000","last_clean":"2024-09-13T06:44:32.805107+0000","last_became_active":"2024-09-13T06:44:18.456828+0000","last_became_peered":"2024-09-13T06:44:18.456828+0000","last_unstale":"2024-09-13T06:44:32.805107+0000","last_undegraded":"2024-09-13T06:44:32.805107+0000","last_fullsized":"2024-09-13T06:44:32.805107+0000","mapping_epoch":288,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":289,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_clean_scrub_stamp":"2024-09-13T06:39:16.508974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:17:09.082426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"279'349","reported_seq":3763,"reported_epoch":304,"state":"active+clean","last_fresh":"2024-09-13T06:44:33.827275+0000","last_change":"2024-09-13T06:44:05.440371+0000","last_active":"2024-09-13T06:44:33.827275+0000","last_peered":"2024-09-13T06:44:33.827275+0000","last_clean":"2024-09-13T06:44:33.827275+0000","last_became_active":"2024-09-13T06:41:15.399301+0000","last_became_peered":"2024-09-13T06:41:15.399301+0000","last_unstale":"2024-09-13T06:44:33.827275+0000","last_undegraded":"2024-09-13T06:44:33.827275+0000","last_fullsized":"2024-09-13T06:44:33.827275+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":349,"log_dups_size":0,"ondisk_log_size":349,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:53:18.137873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001343293,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2523,"num_read_kb":19829,"num_write":427,"num_write_kb":20943,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":169,"num_bytes_recovered":5233325,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"18'1","reported_seq":56,"reported_epoch":303,"state":"active+clean","last_fresh":"2024-09-13T06:44:32.834077+0000","last_change":"2024-09-13T06:44:30.798045+0000","last_active":"2024-09-13T06:44:32.834077+0000","last_peered":"2024-09-13T06:44:32.834077+0000","last_clean":"2024-09-13T06:44:32.834077+0000","last_became_active":"2024-09-13T06:44:30.796877+0000","last_became_peered":"2024-09-13T06:44:30.796877+0000","last_unstale":"2024-09-13T06:44:32.834077+0000","last_undegraded":"2024-09-13T06:44:32.834077+0000","last_fullsized":"2024-09-13T06:44:32.834077+0000","mapping_epoch":300,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":301,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_clean_scrub_stamp":"2024-09-13T06:39:16.508974+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:33:04.298167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":397,"reported_epoch":303,"state":"active+clean","last_fresh":"2024-09-13T06:44:32.805140+0000","last_change":"2024-09-13T06:42:28.563168+0000","last_active":"2024-09-13T06:44:32.805140+0000","last_peered":"2024-09-13T06:44:32.805140+0000","last_clean":"2024-09-13T06:44:32.805140+0000","last_became_active":"2024-09-13T06:42:28.562642+0000","last_became_peered":"2024-09-13T06:42:28.562642+0000","last_unstale":"2024-09-13T06:44:32.805140+0000","last_undegraded":"2024-09-13T06:44:32.805140+0000","last_fullsized":"2024-09-13T06:44:32.805140+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:10.110558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:10.110558+0000","last_clean_scrub_stamp":"2024-09-13T06:39:10.110558+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:05:54.866043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"277'651","reported_seq":10851,"reported_epoch":304,"state":"active+clean","last_fresh":"2024-09-13T06:44:33.827115+0000","last_change":"2024-09-13T06:44:22.452634+0000","last_active":"2024-09-13T06:44:33.827115+0000","last_peered":"2024-09-13T06:44:33.827115+0000","last_clean":"2024-09-13T06:44:33.827115+0000","last_became_active":"2024-09-13T06:44:22.448736+0000","last_became_peered":"2024-09-13T06:44:22.448736+0000","last_unstale":"2024-09-13T06:44:33.827115+0000","last_undegraded":"2024-09-13T06:44:33.827115+0000","last_fullsized":"2024-09-13T06:44:33.827115+0000","mapping_epoch":292,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":293,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":651,"log_dups_size":0,"ondisk_log_size":651,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:58:40.103969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00083432600000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9552,"num_read_kb":46146,"num_write":828,"num_write_kb":32512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":446,"num_bytes_recovered":11977587,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"277'774","reported_seq":10944,"reported_epoch":304,"state":"active+clean","last_fresh":"2024-09-13T06:44:33.827759+0000","last_change":"2024-09-13T06:44:20.466493+0000","last_active":"2024-09-13T06:44:33.827759+0000","last_peered":"2024-09-13T06:44:33.827759+0000","last_clean":"2024-09-13T06:44:33.827759+0000","last_became_active":"2024-09-13T06:44:20.462849+0000","last_became_peered":"2024-09-13T06:44:20.462849+0000","last_unstale":"2024-09-13T06:44:33.827759+0000","last_undegraded":"2024-09-13T06:44:33.827759+0000","last_fullsized":"2024-09-13T06:44:33.827759+0000","mapping_epoch":290,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":291,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":774,"log_dups_size":0,"ondisk_log_size":774,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:40:44.119462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0024338839999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10729,"num_read_kb":51645,"num_write":931,"num_write_kb":34617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":445,"num_bytes_recovered":16579571,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"278'758","reported_seq":8282,"reported_epoch":305,"state":"active+clean","last_fresh":"2024-09-13T06:44:34.842308+0000","last_change":"2024-09-13T06:44:34.842308+0000","last_active":"2024-09-13T06:44:34.842308+0000","last_peered":"2024-09-13T06:44:34.842308+0000","last_clean":"2024-09-13T06:44:34.842308+0000","last_became_active":"2024-09-13T06:44:34.836417+0000","last_became_peered":"2024-09-13T06:44:34.836417+0000","last_unstale":"2024-09-13T06:44:34.842308+0000","last_undegraded":"2024-09-13T06:44:34.842308+0000","last_fullsized":"2024-09-13T06:44:34.842308+0000","mapping_epoch":304,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":305,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":758,"log_dups_size":0,"ondisk_log_size":758,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:44:55.089545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00085210600000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8422,"num_read_kb":47219,"num_write":883,"num_write_kb":28077,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":515,"num_bytes_recovered":28581300,"num_keys_recovered":111,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"271'845","reported_seq":5602,"reported_epoch":304,"state":"active+clean","last_fresh":"2024-09-13T06:44:33.827387+0000","last_change":"2024-09-13T06:44:05.439827+0000","last_active":"2024-09-13T06:44:33.827387+0000","last_peered":"2024-09-13T06:44:33.827387+0000","last_clean":"2024-09-13T06:44:33.827387+0000","last_became_active":"2024-09-13T06:41:15.399204+0000","last_became_peered":"2024-09-13T06:41:15.399204+0000","last_unstale":"2024-09-13T06:44:33.827387+0000","last_undegraded":"2024-09-13T06:44:33.827387+0000","last_fullsized":"2024-09-13T06:44:33.827387+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":845,"log_dups_size":0,"ondisk_log_size":845,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:27:03.298272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00094468700000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6686,"num_read_kb":57840,"num_write":1181,"num_write_kb":24665,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":117,"num_bytes_recovered":13256568,"num_keys_recovered":44,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"279'569","reported_seq":6603,"reported_epoch":303,"state":"active+clean","last_fresh":"2024-09-13T06:44:32.834414+0000","last_change":"2024-09-13T06:44:30.802655+0000","last_active":"2024-09-13T06:44:32.834414+0000","last_peered":"2024-09-13T06:44:32.834414+0000","last_clean":"2024-09-13T06:44:32.834414+0000","last_became_active":"2024-09-13T06:44:30.794873+0000","last_became_peered":"2024-09-13T06:44:30.794873+0000","last_unstale":"2024-09-13T06:44:32.834414+0000","last_undegraded":"2024-09-13T06:44:32.834414+0000","last_fullsized":"2024-09-13T06:44:32.834414+0000","mapping_epoch":300,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":301,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":569,"log_dups_size":0,"ondisk_log_size":569,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:26:59.771063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0027493119999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6187,"num_read_kb":31727,"num_write":657,"num_write_kb":25682,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":184,"num_bytes_recovered":16410936,"num_keys_recovered":88,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"277'881","reported_seq":2923,"reported_epoch":303,"state":"active+clean","last_fresh":"2024-09-13T06:44:32.805567+0000","last_change":"2024-09-13T06:44:05.458093+0000","last_active":"2024-09-13T06:44:32.805567+0000","last_peered":"2024-09-13T06:44:32.805567+0000","last_clean":"2024-09-13T06:44:32.805567+0000","last_became_active":"2024-09-13T06:42:32.411927+0000","last_became_peered":"2024-09-13T06:42:32.411927+0000","last_unstale":"2024-09-13T06:44:32.805567+0000","last_undegraded":"2024-09-13T06:44:32.805567+0000","last_fullsized":"2024-09-13T06:44:32.805567+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":881,"log_dups_size":0,"ondisk_log_size":881,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:40:44.787780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.003013108,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4846,"num_read_kb":26164,"num_write":1518,"num_write_kb":30083,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":140,"num_bytes_recovered":11278110,"num_keys_recovered":11,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.e","version":"277'556","reported_seq":4102,"reported_epoch":303,"state":"active+clean","last_fresh":"2024-09-13T06:44:32.805528+0000","last_change":"2024-09-13T06:44:30.808041+0000","last_active":"2024-09-13T06:44:32.805528+0000","last_peered":"2024-09-13T06:44:32.805528+0000","last_clean":"2024-09-13T06:44:32.805528+0000","last_became_active":"2024-09-13T06:44:30.801655+0000","last_became_peered":"2024-09-13T06:44:30.801655+0000","last_unstale":"2024-09-13T06:44:32.805528+0000","last_undegraded":"2024-09-13T06:44:32.805528+0000","last_fullsized":"2024-09-13T06:44:32.805528+0000","mapping_epoch":300,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":301,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":556,"log_dups_size":0,"ondisk_log_size":556,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:43:53.489080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0025767619999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3868,"num_read_kb":43567,"num_write":654,"num_write_kb":29232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":503,"num_bytes_recovered":12695191,"num_keys_recovered":11,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"277'665","reported_seq":4754,"reported_epoch":303,"state":"active+clean","last_fresh":"2024-09-13T06:44:32.805508+0000","last_change":"2024-09-13T06:44:05.458214+0000","last_active":"2024-09-13T06:44:32.805508+0000","last_peered":"2024-09-13T06:44:32.805508+0000","last_clean":"2024-09-13T06:44:32.805508+0000","last_became_active":"2024-09-13T06:42:33.412054+0000","last_became_peered":"2024-09-13T06:42:33.412054+0000","last_unstale":"2024-09-13T06:44:32.805508+0000","last_undegraded":"2024-09-13T06:44:32.805508+0000","last_fullsized":"2024-09-13T06:44:32.805508+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":665,"log_dups_size":0,"ondisk_log_size":665,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:07:06.963404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00285659,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4677,"num_read_kb":45287,"num_write":982,"num_write_kb":45285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":394,"num_bytes_recovered":42768786,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.10","version":"280'832","reported_seq":5035,"reported_epoch":304,"state":"active+clean","last_fresh":"2024-09-13T06:44:33.831977+0000","last_change":"2024-09-13T06:44:19.467239+0000","last_active":"2024-09-13T06:44:33.831977+0000","last_peered":"2024-09-13T06:44:33.831977+0000","last_clean":"2024-09-13T06:44:33.831977+0000","last_became_active":"2024-09-13T06:44:19.459617+0000","last_became_peered":"2024-09-13T06:44:19.459617+0000","last_unstale":"2024-09-13T06:44:33.831977+0000","last_undegraded":"2024-09-13T06:44:33.831977+0000","last_fullsized":"2024-09-13T06:44:33.831977+0000","mapping_epoch":289,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":290,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":832,"log_dups_size":0,"ondisk_log_size":832,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:43:55.736868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0018779840000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5715,"num_read_kb":29614,"num_write":1142,"num_write_kb":36190,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":275,"num_bytes_recovered":6622441,"num_keys_recovered":20,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.11","version":"279'502","reported_seq":6279,"reported_epoch":303,"state":"active+clean","last_fresh":"2024-09-13T06:44:32.805097+0000","last_change":"2024-09-13T06:44:05.455675+0000","last_active":"2024-09-13T06:44:32.805097+0000","last_peered":"2024-09-13T06:44:32.805097+0000","last_clean":"2024-09-13T06:44:32.805097+0000","last_became_active":"2024-09-13T06:42:33.411668+0000","last_became_peered":"2024-09-13T06:42:33.411668+0000","last_unstale":"2024-09-13T06:44:32.805097+0000","last_undegraded":"2024-09-13T06:44:32.805097+0000","last_fullsized":"2024-09-13T06:44:32.805097+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":502,"log_dups_size":0,"ondisk_log_size":502,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:43:01.814094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001270492,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5341,"num_read_kb":34087,"num_write":659,"num_write_kb":25712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":245,"num_bytes_recovered":7089272,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"280'921","reported_seq":5047,"reported_epoch":303,"state":"active+clean","last_fresh":"2024-09-13T06:44:32.809379+0000","last_change":"2024-09-13T06:44:20.470378+0000","last_active":"2024-09-13T06:44:32.809379+0000","last_peered":"2024-09-13T06:44:32.809379+0000","last_clean":"2024-09-13T06:44:32.809379+0000","last_became_active":"2024-09-13T06:44:20.466713+0000","last_became_peered":"2024-09-13T06:44:20.466713+0000","last_unstale":"2024-09-13T06:44:32.809379+0000","last_undegraded":"2024-09-13T06:44:32.809379+0000","last_fullsized":"2024-09-13T06:44:32.809379+0000","mapping_epoch":290,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":291,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":921,"log_dups_size":0,"ondisk_log_size":921,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:00:14.406068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0017683250000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6025,"num_read_kb":38947,"num_write":1315,"num_write_kb":35656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":107,"num_bytes_recovered":3682200,"num_keys_recovered":21,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"279'604","reported_seq":4546,"reported_epoch":303,"state":"active+clean","last_fresh":"2024-09-13T06:44:32.805143+0000","last_change":"2024-09-13T06:44:05.454984+0000","last_active":"2024-09-13T06:44:32.805143+0000","last_peered":"2024-09-13T06:44:32.805143+0000","last_clean":"2024-09-13T06:44:32.805143+0000","last_became_active":"2024-09-13T06:42:31.402800+0000","last_became_peered":"2024-09-13T06:42:31.402800+0000","last_unstale":"2024-09-13T06:44:32.805143+0000","last_undegraded":"2024-09-13T06:44:32.805143+0000","last_fullsized":"2024-09-13T06:44:32.805143+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":604,"log_dups_size":0,"ondisk_log_size":604,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:59:41.167052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010470779999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4471,"num_read_kb":35894,"num_write":884,"num_write_kb":31515,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":196,"num_bytes_recovered":8224568,"num_keys_recovered":11,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":19,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":237282,"num_read_kb":1402862,"num_write":33322,"num_write_kb":1008910,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9249,"num_bytes_recovered":443628516,"num_keys_recovered":867,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14648,"internal_metadata":0},"log_size":24486,"ondisk_log_size":24486,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":57,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":3}],"osd_stats":[{"osd":7,"up_from":187,"seq":803158884380,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37040,"kb_used_data":4196,"kb_used_omap":9,"kb_used_meta":32822,"kb_avail":94334800,"statfs":{"total":96636764160,"available":96598835200,"internally_reserved":0,"allocated":4296704,"data_stored":2446923,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9685,"internal_metadata":33610283},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 06:44:33 2024","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":0.71199999999999997,"15min":0.69799999999999995},"min":{"1min":0.56699999999999995,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.83599999999999997},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.751,"15min":0.73999999999999999},"min":{"1min":0.54600000000000004,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.6910000000000001,"5min":1.6910000000000001,"15min":1.6910000000000001},"last":0.90100000000000002}]},{"osd":1,"last update":"Fri Sep 13 06:44:33 2024","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.75700000000000001,"15min":0.751},"min":{"1min":0.57399999999999995,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.359,"5min":1.359,"15min":1.359},"last":0.86699999999999999},{"interface":"front","average":{"1min":0.82399999999999995,"5min":0.71599999999999997,"15min":0.69799999999999995},"min":{"1min":0.496,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.1259999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.93899999999999995}]},{"osd":2,"last update":"Fri Sep 13 06:44:33 2024","interfaces":[{"interface":"back","average":{"1min":0.80700000000000005,"5min":0.75900000000000001,"15min":0.751},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.2030000000000001,"5min":1.212,"15min":1.212},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.92200000000000004,"5min":0.81499999999999995,"15min":0.79700000000000004},"min":{"1min":0.58999999999999997,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.4319999999999999,"5min":1.4319999999999999,"15min":1.4319999999999999},"last":0.97699999999999998}]},{"osd":3,"last update":"Fri Sep 13 06:44:33 2024","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.79600000000000004,"15min":0.79200000000000004},"min":{"1min":0.60299999999999998,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.177,"5min":1.177,"15min":1.177},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.88600000000000001,"5min":0.84299999999999997,"15min":0.83599999999999997},"min":{"1min":0.48099999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.7350000000000001,"5min":1.7350000000000001,"15min":1.7350000000000001},"last":1.008}]},{"osd":4,"last update":"Fri Sep 13 06:44:33 2024","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.82299999999999995,"15min":0.82499999999999996},"min":{"1min":0.45500000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.405,"5min":1.405,"15min":1.405},"last":0.628},{"interface":"front","average":{"1min":1.0049999999999999,"5min":0.82299999999999995,"15min":0.79300000000000004},"min":{"1min":0.39800000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.6240000000000001,"5min":1.6240000000000001,"15min":1.6240000000000001},"last":1.137}]},{"osd":5,"last update":"Fri Sep 13 06:44:33 2024","interfaces":[{"interface":"back","average":{"1min":0.96599999999999997,"5min":0.88800000000000001,"15min":0.875},"min":{"1min":0.504,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.593,"5min":1.593,"15min":1.593},"last":1.036},{"interface":"front","average":{"1min":0.92300000000000004,"5min":0.84099999999999997,"15min":0.82699999999999996},"min":{"1min":0.53800000000000003,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.3400000000000001,"5min":1.3400000000000001,"15min":1.3400000000000001},"last":1.0620000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1619999999999999}]}]},{"osd":6,"up_from":286,"seq":1228360646663,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35504,"kb_used_data":3620,"kb_used_omap":7,"kb_used_meta":31864,"kb_avail":94336336,"statfs":{"total":96636764160,"available":96600408064,"internally_reserved":0,"allocated":3706880,"data_stored":1857127,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8145,"internal_metadata":32628783},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72399999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.26}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1879999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68700000000000006}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94699999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90900000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.21}]}]},{"osd":5,"up_from":13,"seq":55834574918,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":79024,"kb_used_data":3620,"kb_used_omap":1,"kb_used_meta":75390,"kb_avail":94292816,"statfs":{"total":96636764160,"available":96555843584,"internally_reserved":0,"allocated":3706880,"data_stored":1856574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":77199814},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 06:44:19 2024","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.71399999999999997,"15min":0.76500000000000001},"min":{"1min":0.40999999999999998,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":1.093,"5min":1.6679999999999999,"15min":1.6679999999999999},"last":1.0740000000000001},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.76900000000000002,"15min":0.79900000000000004},"min":{"1min":0.41299999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.1220000000000001,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":0.76100000000000001}]},{"osd":1,"last update":"Fri Sep 13 06:44:19 2024","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.73999999999999999,"15min":0.751},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":1.103,"5min":1.341,"15min":1.341},"last":1.03},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.70099999999999996,"15min":0.74099999999999999},"min":{"1min":0.40899999999999997,"5min":0.317,"15min":0.317},"max":{"1min":1.0089999999999999,"5min":1.722,"15min":1.722},"last":0.70899999999999996}]},{"osd":2,"last update":"Fri Sep 13 06:44:19 2024","interfaces":[{"interface":"back","average":{"1min":0.876,"5min":0.81999999999999995,"15min":0.86399999999999999},"min":{"1min":0.47699999999999998,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.143,"5min":1.833,"15min":1.833},"last":0.879},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.79200000000000004},"min":{"1min":0.47999999999999998,"5min":0.435,"15min":0.435},"max":{"1min":1.0169999999999999,"5min":1.4279999999999999,"15min":1.4279999999999999},"last":0.80100000000000005}]},{"osd":3,"last update":"Fri Sep 13 06:44:19 2024","interfaces":[{"interface":"back","average":{"1min":0.85699999999999998,"5min":0.81399999999999995,"15min":0.78000000000000003},"min":{"1min":0.45400000000000001,"5min":0.434,"15min":0.434},"max":{"1min":1.1659999999999999,"5min":1.885,"15min":1.885},"last":1.109},{"interface":"front","average":{"1min":0.85899999999999999,"5min":0.86299999999999999,"15min":0.86499999999999999},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.2410000000000001,"5min":1.907,"15min":1.907},"last":0.84699999999999998}]},{"osd":4,"last update":"Fri Sep 13 06:44:19 2024","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.83499999999999996,"15min":0.80500000000000005},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":1.159,"5min":6.3179999999999996,"15min":6.3179999999999996},"last":1.2270000000000001},{"interface":"front","average":{"1min":0.78000000000000003,"5min":1.0529999999999999,"15min":0.91000000000000003},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":1.2370000000000001,"5min":15.553000000000001,"15min":15.553000000000001},"last":1.145}]},{"osd":6,"last update":"Fri Sep 13 06:42:12 2024","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.86299999999999999,"15min":0.877},"min":{"1min":0.40000000000000002,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.9610000000000001,"5min":1.9610000000000001,"15min":1.9610000000000001},"last":0.95899999999999996},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.86099999999999999,"15min":0.87},"min":{"1min":0.39000000000000001,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.206,"5min":1.968,"15min":1.968},"last":0.93100000000000005}]},{"osd":7,"last update":"Fri Sep 13 06:44:31 2024","interfaces":[{"interface":"back","average":{"1min":0.96399999999999997,"5min":0.84399999999999997,"15min":0.82399999999999995},"min":{"1min":0.39000000000000001,"5min":0.373,"15min":0.373},"max":{"1min":1.2050000000000001,"5min":1.375,"15min":1.375},"last":0.998},{"interface":"front","average":{"1min":0.997,"5min":0.89800000000000002,"15min":0.88200000000000001},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":1.7050000000000001,"5min":1.7050000000000001,"15min":1.7050000000000001},"last":1.1739999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574918,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60984,"kb_used_data":3624,"kb_used_omap":1,"kb_used_meta":57342,"kb_avail":94310856,"statfs":{"total":96636764160,"available":96574316544,"internally_reserved":0,"allocated":3710976,"data_stored":1857146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":58718662},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 06:44:15 2024","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.79300000000000004,"15min":0.98999999999999999},"min":{"1min":0.41499999999999998,"5min":0.245,"15min":0.245},"max":{"1min":1.0720000000000001,"5min":5.8230000000000004,"15min":5.8230000000000004},"last":1.0609999999999999},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.71999999999999997,"15min":0.752},"min":{"1min":0.505,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.97299999999999998,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":1.0289999999999999}]},{"osd":1,"last update":"Fri Sep 13 06:44:15 2024","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.79300000000000004,"15min":0.75},"min":{"1min":0.45100000000000001,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.86899999999999999,"5min":10.156000000000001,"15min":10.156000000000001},"last":1.1990000000000001},{"interface":"front","average":{"1min":0.747,"5min":0.77500000000000002,"15min":0.83599999999999997},"min":{"1min":0.496,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.0349999999999999,"5min":1.286,"15min":1.286},"last":0.85299999999999998}]},{"osd":2,"last update":"Fri Sep 13 06:44:15 2024","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.751,"15min":0.82299999999999995},"min":{"1min":0.52800000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":1.0109999999999999,"5min":1.6000000000000001,"15min":1.6000000000000001},"last":0.98699999999999999},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.81299999999999994},"min":{"1min":0.65500000000000003,"5min":0.374,"15min":0.374},"max":{"1min":1.167,"5min":1.3540000000000001,"15min":1.3540000000000001},"last":0.93500000000000005}]},{"osd":3,"last update":"Fri Sep 13 06:44:15 2024","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.84699999999999998,"15min":0.90200000000000002},"min":{"1min":0.57499999999999996,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.6950000000000001,"5min":1.6950000000000001,"15min":1.6950000000000001},"last":1.1659999999999999},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.95299999999999996,"15min":0.92500000000000004},"min":{"1min":0.48499999999999999,"5min":0.374,"15min":0.374},"max":{"1min":1.8069999999999999,"5min":10.195,"15min":10.195},"last":0.96299999999999997}]},{"osd":5,"last update":"Fri Sep 13 06:44:15 2024","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.81499999999999995,"15min":0.85699999999999998},"min":{"1min":0.443,"5min":0.249,"15min":0.249},"max":{"1min":1.075,"5min":2.9790000000000001,"15min":2.9790000000000001},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.84399999999999997,"15min":0.91400000000000003},"min":{"1min":0.39700000000000002,"5min":0.372,"15min":0.372},"max":{"1min":1.0580000000000001,"5min":1.8779999999999999,"15min":1.8779999999999999},"last":0.89000000000000001}]},{"osd":6,"last update":"Fri Sep 13 06:42:14 2024","interfaces":[{"interface":"back","average":{"1min":0.90100000000000002,"5min":0.92100000000000004,"15min":0.82899999999999996},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":1.6100000000000001,"5min":10.016999999999999,"15min":10.016999999999999},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.86699999999999999,"5min":0.93300000000000005,"15min":0.95999999999999996},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.2030000000000001,"5min":2.0750000000000002,"15min":2.0750000000000002},"last":1.0920000000000001}]},{"osd":7,"last update":"Fri Sep 13 06:44:33 2024","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.1539999999999999,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.80300000000000005},{"interface":"front","average":{"1min":0.90400000000000003,"5min":0.89200000000000002,"15min":0.89000000000000001},"min":{"1min":0.505,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.2529999999999999,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":1.129}]}]},{"osd":3,"up_from":13,"seq":55834574921,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":74936,"kb_used_data":3620,"kb_used_omap":1,"kb_used_meta":71294,"kb_avail":94296904,"statfs":{"total":96636764160,"available":96560029696,"internally_reserved":0,"allocated":3706880,"data_stored":1857127,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":73005512},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 06:44:15 2024","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.56100000000000005,"15min":0.56899999999999995},"min":{"1min":0.24199999999999999,"5min":0.191,"15min":0.191},"max":{"1min":1.51,"5min":1.51,"15min":1.51},"last":0.26000000000000001},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.60599999999999998,"15min":0.65400000000000003},"min":{"1min":0.307,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.88900000000000001,"5min":1.2789999999999999,"15min":1.2789999999999999},"last":0.33600000000000002}]},{"osd":1,"last update":"Fri Sep 13 06:44:15 2024","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.54900000000000004,"15min":0.58599999999999997},"min":{"1min":0.29499999999999998,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.85399999999999998,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.28899999999999998},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.59999999999999998,"15min":0.66800000000000004},"min":{"1min":0.27700000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":1.607,"5min":1.607,"15min":1.607},"last":0.34899999999999998}]},{"osd":2,"last update":"Fri Sep 13 06:44:15 2024","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.629,"15min":0.65200000000000002},"min":{"1min":0.30199999999999999,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":1.5660000000000001,"5min":1.5660000000000001,"15min":1.5660000000000001},"last":0.378},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.59799999999999998,"15min":0.627},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":1.135,"5min":1.409,"15min":1.409},"last":0.315}]},{"osd":4,"last update":"Fri Sep 13 06:44:15 2024","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.82599999999999996,"15min":0.89400000000000002},"min":{"1min":0.42899999999999999,"5min":0.377,"15min":0.377},"max":{"1min":1.651,"5min":1.7929999999999999,"15min":1.7929999999999999},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.76300000000000001,"15min":0.78300000000000003},"min":{"1min":0.44700000000000001,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.96499999999999997,"5min":1.3240000000000001,"15min":1.3240000000000001},"last":0.60199999999999998}]},{"osd":5,"last update":"Fri Sep 13 06:44:15 2024","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":0.81200000000000006,"15min":0.84999999999999998},"min":{"1min":0.48799999999999999,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.3029999999999999,"5min":1.3799999999999999,"15min":1.3799999999999999},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.83099999999999996,"5min":0.82499999999999996,"15min":0.85999999999999999},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.4610000000000001,"5min":1.4610000000000001,"15min":1.4610000000000001},"last":0.66000000000000003}]},{"osd":6,"last update":"Fri Sep 13 06:42:11 2024","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.88500000000000001,"15min":0.91100000000000003},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.135,"5min":1.532,"15min":1.532},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.95299999999999996,"15min":0.98999999999999999},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.2250000000000001,"5min":1.825,"15min":1.825},"last":0.61899999999999999}]},{"osd":7,"last update":"Fri Sep 13 06:44:35 2024","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.89300000000000002,"15min":0.89800000000000002},"min":{"1min":0.57199999999999995,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.3009999999999999,"5min":1.3799999999999999,"15min":1.3799999999999999},"last":0.752},{"interface":"front","average":{"1min":0.93000000000000005,"5min":0.95799999999999996,"15min":0.96199999999999997},"min":{"1min":0.58799999999999997,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.4219999999999999,"5min":2.0459999999999998,"15min":2.0459999999999998},"last":0.52300000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574918,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60980,"kb_used_data":3620,"kb_used_omap":1,"kb_used_meta":57342,"kb_avail":94310860,"statfs":{"total":96636764160,"available":96574320640,"internally_reserved":0,"allocated":3706880,"data_stored":1857127,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":58718662},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 06:44:20 2024","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.66800000000000004,"15min":0.56200000000000006},"min":{"1min":0.19400000000000001,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.84199999999999997,"5min":8.6449999999999996,"15min":8.6449999999999996},"last":0.29299999999999998},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.65200000000000002,"15min":0.61099999999999999},"min":{"1min":0.30299999999999999,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":1.4410000000000001,"5min":4.0380000000000003,"15min":4.0380000000000003},"last":0.45300000000000001}]},{"osd":1,"last update":"Fri Sep 13 06:44:20 2024","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.64000000000000001,"15min":0.62},"min":{"1min":0.25,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":1.0329999999999999,"5min":3.4649999999999999,"15min":3.4649999999999999},"last":0.32700000000000001},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.66600000000000004,"15min":0.60299999999999998},"min":{"1min":0.34300000000000003,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":1.5049999999999999,"5min":3.8159999999999998,"15min":3.8159999999999998},"last":0.35699999999999998}]},{"osd":3,"last update":"Fri Sep 13 06:44:20 2024","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.65000000000000002,"15min":0.58599999999999997},"min":{"1min":0.36399999999999999,"5min":0.249,"15min":0.249},"max":{"1min":1.044,"5min":3.407,"15min":3.407},"last":0.39600000000000002},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.73599999999999999,"15min":0.68600000000000005},"min":{"1min":0.312,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.238,"5min":3.2639999999999998,"15min":3.2639999999999998},"last":0.38200000000000001}]},{"osd":4,"last update":"Fri Sep 13 06:44:20 2024","interfaces":[{"interface":"back","average":{"1min":0.83299999999999996,"5min":0.878,"15min":0.88500000000000001},"min":{"1min":0.45600000000000002,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.3759999999999999,"5min":3.1179999999999999,"15min":3.1179999999999999},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.81399999999999995,"5min":1.0620000000000001,"15min":0.94099999999999995},"min":{"1min":0.46800000000000003,"5min":0.439,"15min":0.439},"max":{"1min":1.359,"5min":21.081,"15min":21.081},"last":0.81899999999999995}]},{"osd":5,"last update":"Fri Sep 13 06:44:20 2024","interfaces":[{"interface":"back","average":{"1min":0.82999999999999996,"5min":0.84799999999999998,"15min":0.84299999999999997},"min":{"1min":0.60099999999999998,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":1.143,"5min":2.2389999999999999,"15min":2.2389999999999999},"last":0.77300000000000002},{"interface":"front","average":{"1min":1.133,"5min":0.96099999999999997,"15min":0.88900000000000001},"min":{"1min":0.54400000000000004,"5min":0.377,"15min":0.377},"max":{"1min":4.9039999999999999,"5min":4.9039999999999999,"15min":4.9039999999999999},"last":0.80800000000000005}]},{"osd":6,"last update":"Fri Sep 13 06:42:15 2024","interfaces":[{"interface":"back","average":{"1min":0.86799999999999999,"5min":0.94199999999999995,"15min":0.92600000000000005},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.274,"5min":3.923,"15min":3.923},"last":0.749},{"interface":"front","average":{"1min":0.97799999999999998,"5min":0.90500000000000003,"15min":0.879},"min":{"1min":0.60899999999999999,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":2.2080000000000002,"5min":2.2120000000000002,"15min":2.2120000000000002},"last":0.64600000000000002}]},{"osd":7,"last update":"Fri Sep 13 06:44:33 2024","interfaces":[{"interface":"back","average":{"1min":0.95799999999999996,"5min":0.86499999999999999,"15min":0.84899999999999998},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":1.641,"5min":1.641,"15min":1.641},"last":0.85899999999999999},{"interface":"front","average":{"1min":1.05,"5min":0.88600000000000001,"15min":0.85799999999999998},"min":{"1min":0.71499999999999997,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":2.0630000000000002,"5min":2.0630000000000002,"15min":2.0630000000000002},"last":0.72099999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574918,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52792,"kb_used_data":3624,"kb_used_omap":1,"kb_used_meta":49150,"kb_avail":94319048,"statfs":{"total":96636764160,"available":96582705152,"internally_reserved":0,"allocated":3710976,"data_stored":1856593,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":50330054},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 06:44:21 2024","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.55300000000000005,"15min":0.57299999999999995},"min":{"1min":0.246,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":1.1879999999999999,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.64200000000000002,"15min":0.65900000000000003},"min":{"1min":0.26200000000000001,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.99199999999999999,"5min":1.8160000000000001,"15min":1.8160000000000001},"last":0.751}]},{"osd":2,"last update":"Fri Sep 13 06:44:21 2024","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.60699999999999998,"15min":0.63400000000000001},"min":{"1min":0.26800000000000002,"5min":0.22,"15min":0.22},"max":{"1min":0.92200000000000004,"5min":2.617,"15min":2.617},"last":1.0109999999999999},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.65300000000000002,"15min":0.65400000000000003},"min":{"1min":0.28499999999999998,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":1.331,"5min":2.5249999999999999,"15min":2.5249999999999999},"last":0.70299999999999996}]},{"osd":3,"last update":"Fri Sep 13 06:44:21 2024","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.70499999999999996,"15min":0.72599999999999998},"min":{"1min":0.33900000000000002,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":1.2769999999999999,"5min":1.3640000000000001,"15min":1.3640000000000001},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.66700000000000004,"15min":0.69099999999999995},"min":{"1min":0.30399999999999999,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":1.028,"5min":1.752,"15min":1.752},"last":0.66300000000000003}]},{"osd":4,"last update":"Fri Sep 13 06:44:21 2024","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.79800000000000004,"15min":0.81999999999999995},"min":{"1min":0.60899999999999999,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":1.109,"5min":2.7389999999999999,"15min":2.7389999999999999},"last":1.224},{"interface":"front","average":{"1min":0.94499999999999995,"5min":0.85499999999999998,"15min":0.90600000000000003},"min":{"1min":0.40000000000000002,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.4159999999999999,"5min":1.4359999999999999,"15min":1.4359999999999999},"last":0.87}]},{"osd":5,"last update":"Fri Sep 13 06:44:21 2024","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.84499999999999997,"15min":0.90600000000000003},"min":{"1min":0.58099999999999996,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.1399999999999999,"5min":1.7849999999999999,"15min":1.7849999999999999},"last":1.0640000000000001},{"interface":"front","average":{"1min":0.89600000000000002,"5min":0.86599999999999999,"15min":0.879},"min":{"1min":0.495,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":1.202,"5min":2.036,"15min":2.036},"last":1.1830000000000001}]},{"osd":6,"last update":"Fri Sep 13 06:42:18 2024","interfaces":[{"interface":"back","average":{"1min":0.87,"5min":0.92200000000000004,"15min":0.94399999999999995},"min":{"1min":0.57699999999999996,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.526,"5min":1.8149999999999999,"15min":1.8149999999999999},"last":1.101},{"interface":"front","average":{"1min":0.88900000000000001,"5min":0.91200000000000003,"15min":0.91900000000000004},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":2.7810000000000001,"5min":2.7810000000000001,"15min":2.7810000000000001},"last":0.95299999999999996}]},{"osd":7,"last update":"Fri Sep 13 06:44:33 2024","interfaces":[{"interface":"back","average":{"1min":0.91900000000000004,"5min":0.90600000000000003,"15min":0.90400000000000003},"min":{"1min":0.621,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":1.3220000000000001,"5min":1.605,"15min":1.605},"last":1.1479999999999999},{"interface":"front","average":{"1min":1.054,"5min":0.93899999999999995,"15min":0.92000000000000004},"min":{"1min":0.61099999999999999,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.5009999999999999,"5min":1.5009999999999999,"15min":1.5009999999999999},"last":0.98099999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574917,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":85364,"kb_used_data":4196,"kb_used_omap":1,"kb_used_meta":81150,"kb_avail":94286476,"statfs":{"total":96636764160,"available":96549351424,"internally_reserved":0,"allocated":4296704,"data_stored":2446923,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":83098054},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 06:44:11 2024","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.54900000000000004,"15min":0.53000000000000003},"min":{"1min":0.23999999999999999,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":1.048,"5min":1.2270000000000001,"15min":1.2270000000000001},"last":0.23200000000000001},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.56000000000000005,"15min":0.54000000000000004},"min":{"1min":0.28799999999999998,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":1.137,"5min":1.222,"15min":1.222},"last":0.38400000000000001}]},{"osd":2,"last update":"Fri Sep 13 06:44:11 2024","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.60399999999999998,"15min":0.55600000000000005},"min":{"1min":0.27300000000000002,"5min":0.217,"15min":0.217},"max":{"1min":1.2549999999999999,"5min":1.839,"15min":1.839},"last":0.28199999999999997},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.61299999999999999,"15min":0.57499999999999996},"min":{"1min":0.35399999999999998,"5min":0.245,"15min":0.245},"max":{"1min":1.419,"5min":1.419,"15min":1.419},"last":0.36299999999999999}]},{"osd":3,"last update":"Fri Sep 13 06:44:11 2024","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.59999999999999998,"15min":0.55800000000000005},"min":{"1min":0.371,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":1.2250000000000001,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.34200000000000003},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.74299999999999999,"15min":0.69899999999999995},"min":{"1min":0.36699999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":1.175,"5min":4.9630000000000001,"15min":4.9630000000000001},"last":0.31}]},{"osd":4,"last update":"Fri Sep 13 06:44:11 2024","interfaces":[{"interface":"back","average":{"1min":0.89400000000000002,"5min":0.80400000000000005,"15min":0.79400000000000004},"min":{"1min":0.57899999999999996,"5min":0.311,"15min":0.311},"max":{"1min":1.6259999999999999,"5min":1.6259999999999999,"15min":1.6259999999999999},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.77400000000000002,"15min":0.79600000000000004},"min":{"1min":0.58999999999999997,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.1799999999999999,"5min":1.6319999999999999,"15min":1.6319999999999999},"last":0.51100000000000001}]},{"osd":5,"last update":"Fri Sep 13 06:44:11 2024","interfaces":[{"interface":"back","average":{"1min":0.89900000000000002,"5min":0.85799999999999998,"15min":0.85199999999999998},"min":{"1min":0.52800000000000002,"5min":0.378,"15min":0.378},"max":{"1min":1.575,"5min":1.575,"15min":1.575},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.89100000000000001,"5min":0.85699999999999998,"15min":0.87},"min":{"1min":0.60199999999999998,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.327,"5min":1.5740000000000001,"15min":1.5740000000000001},"last":0.748}]},{"osd":6,"last update":"Fri Sep 13 06:42:11 2024","interfaces":[{"interface":"back","average":{"1min":0.89800000000000002,"5min":0.91200000000000003,"15min":0.93100000000000005},"min":{"1min":0.55300000000000005,"5min":0.499,"15min":0.499},"max":{"1min":1.571,"5min":2.4969999999999999,"15min":2.4969999999999999},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.878,"5min":0.89600000000000002,"15min":0.90600000000000003},"min":{"1min":0.51800000000000002,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.208,"5min":2.0419999999999998,"15min":2.0419999999999998},"last":0.82599999999999996}]},{"osd":7,"last update":"Fri Sep 13 06:44:31 2024","interfaces":[{"interface":"back","average":{"1min":0.97799999999999998,"5min":1.0529999999999999,"15min":1.0649999999999999},"min":{"1min":0.57799999999999996,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.381,"5min":1.9419999999999999,"15min":1.9419999999999999},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.97899999999999998,"5min":0.96999999999999997,"15min":0.96799999999999997},"min":{"1min":0.64100000000000001,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.4750000000000001,"5min":1.901,"15min":1.901},"last":0.77400000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6552,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8096,"internal_metadata":0}]}} 2024-09-13T06:44:42.783 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T06:44:43.059 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T06:44:43.059 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":305,"fsid":"e5612297-d004-4957-927e-afa37f30d6cf","created":"2024-09-13T06:38:56.670231+0000","modified":"2024-09-13T06:44:34.823076+0000","last_up_change":"2024-09-13T06:44:15.668516+0000","last_in_change":"2024-09-13T06:44:17.424862+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T06:39:09.600726+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-13T06:39:15.802118+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":20,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"pool_client.0","create_time":"2024-09-13T06:39:25.648942+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"280","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":175,"snap_epoch":280,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"54b0a3e4-58ad-4f95-86dc-29a11c9a1964","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":300,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":1904727940},{"type":"v1","addr":"172.21.15.81:6809","nonce":1904727940}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":1904727940},{"type":"v1","addr":"172.21.15.81:6811","nonce":1904727940}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":1904727940},{"type":"v1","addr":"172.21.15.81:6815","nonce":1904727940}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":1904727940},{"type":"v1","addr":"172.21.15.81:6813","nonce":1904727940}]},"public_addr":"172.21.15.81:6809/1904727940","cluster_addr":"172.21.15.81:6811/1904727940","heartbeat_back_addr":"172.21.15.81:6815/1904727940","heartbeat_front_addr":"172.21.15.81:6813/1904727940","state":["exists","up"]},{"osd":1,"uuid":"a6dba5b9-c833-465e-a8a5-1741528b24c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":292,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6817","nonce":738205570},{"type":"v1","addr":"172.21.15.81:6819","nonce":738205570}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":738205570},{"type":"v1","addr":"172.21.15.81:6824","nonce":738205570}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":738205570},{"type":"v1","addr":"172.21.15.81:6831","nonce":738205570}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":738205570},{"type":"v1","addr":"172.21.15.81:6829","nonce":738205570}]},"public_addr":"172.21.15.81:6819/738205570","cluster_addr":"172.21.15.81:6824/738205570","heartbeat_back_addr":"172.21.15.81:6831/738205570","heartbeat_front_addr":"172.21.15.81:6829/738205570","state":["exists","up"]},{"osd":2,"uuid":"6c45097e-44a2-454f-80a4-0fe879ccd52f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":290,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":3558674335},{"type":"v1","addr":"172.21.15.81:6818","nonce":3558674335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":3558674335},{"type":"v1","addr":"172.21.15.81:6821","nonce":3558674335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6827","nonce":3558674335},{"type":"v1","addr":"172.21.15.81:6828","nonce":3558674335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6823","nonce":3558674335},{"type":"v1","addr":"172.21.15.81:6825","nonce":3558674335}]},"public_addr":"172.21.15.81:6818/3558674335","cluster_addr":"172.21.15.81:6821/3558674335","heartbeat_back_addr":"172.21.15.81:6828/3558674335","heartbeat_front_addr":"172.21.15.81:6825/3558674335","state":["exists","up"]},{"osd":3,"uuid":"31952760-06f3-4618-a5c4-f5c4fed3aadb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":292,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":1886327229},{"type":"v1","addr":"172.21.15.81:6801","nonce":1886327229}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":1886327229},{"type":"v1","addr":"172.21.15.81:6803","nonce":1886327229}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":1886327229},{"type":"v1","addr":"172.21.15.81:6807","nonce":1886327229}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":1886327229},{"type":"v1","addr":"172.21.15.81:6805","nonce":1886327229}]},"public_addr":"172.21.15.81:6801/1886327229","cluster_addr":"172.21.15.81:6803/1886327229","heartbeat_back_addr":"172.21.15.81:6807/1886327229","heartbeat_front_addr":"172.21.15.81:6805/1886327229","state":["exists","up"]},{"osd":4,"uuid":"c9bd2751-c836-43dc-b844-e13678cb2fd9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":298,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6817","nonce":2184515621},{"type":"v1","addr":"172.21.15.139:6819","nonce":2184515621}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6820","nonce":2184515621},{"type":"v1","addr":"172.21.15.139:6822","nonce":2184515621}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6827","nonce":2184515621},{"type":"v1","addr":"172.21.15.139:6829","nonce":2184515621}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6824","nonce":2184515621},{"type":"v1","addr":"172.21.15.139:6826","nonce":2184515621}]},"public_addr":"172.21.15.139:6819/2184515621","cluster_addr":"172.21.15.139:6822/2184515621","heartbeat_back_addr":"172.21.15.139:6829/2184515621","heartbeat_front_addr":"172.21.15.139:6826/2184515621","state":["exists","up"]},{"osd":5,"uuid":"2971b93a-6c9f-4b77-b526-4eac788fabf9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":300,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6816","nonce":3982901834},{"type":"v1","addr":"172.21.15.139:6818","nonce":3982901834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6821","nonce":3982901834},{"type":"v1","addr":"172.21.15.139:6823","nonce":3982901834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6830","nonce":3982901834},{"type":"v1","addr":"172.21.15.139:6831","nonce":3982901834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6825","nonce":3982901834},{"type":"v1","addr":"172.21.15.139:6828","nonce":3982901834}]},"public_addr":"172.21.15.139:6818/3982901834","cluster_addr":"172.21.15.139:6823/3982901834","heartbeat_back_addr":"172.21.15.139:6831/3982901834","heartbeat_front_addr":"172.21.15.139:6828/3982901834","state":["exists","up"]},{"osd":6,"uuid":"e1f786ce-579e-48cc-b212-83f881b94184","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":13,"last_clean_end":207,"up_from":286,"up_thru":304,"down_at":209,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6800","nonce":4159560454},{"type":"v1","addr":"172.21.15.139:6801","nonce":4159560454}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6802","nonce":4159560454},{"type":"v1","addr":"172.21.15.139:6803","nonce":4159560454}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6806","nonce":4159560454},{"type":"v1","addr":"172.21.15.139:6807","nonce":4159560454}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6804","nonce":4159560454},{"type":"v1","addr":"172.21.15.139:6805","nonce":4159560454}]},"public_addr":"172.21.15.139:6801/4159560454","cluster_addr":"172.21.15.139:6803/4159560454","heartbeat_back_addr":"172.21.15.139:6807/4159560454","heartbeat_front_addr":"172.21.15.139:6805/4159560454","state":["exists","up"]},{"osd":7,"uuid":"a287ddf6-84eb-4225-b267-25eee1657625","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":13,"last_clean_end":121,"up_from":187,"up_thru":300,"down_at":122,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6808","nonce":105054579},{"type":"v1","addr":"172.21.15.139:6809","nonce":105054579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6810","nonce":105054579},{"type":"v1","addr":"172.21.15.139:6811","nonce":105054579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6814","nonce":105054579},{"type":"v1","addr":"172.21.15.139:6815","nonce":105054579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6812","nonce":105054579},{"type":"v1","addr":"172.21.15.139:6813","nonce":105054579}]},"public_addr":"172.21.15.139:6809/105054579","cluster_addr":"172.21.15.139:6811/105054579","heartbeat_back_addr":"172.21.15.139:6815/105054579","heartbeat_front_addr":"172.21.15.139:6813/105054579","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T06:39:05.476871+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T06:39:05.455183+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T06:39:05.504853+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T06:39:05.372429+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T06:39:05.421023+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T06:39:05.477489+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T06:39:05.314700+0000","dead_epoch":209},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T06:39:05.462229+0000","dead_epoch":122}],"pg_upmap":[{"pgid":"3.9","osds":[2,6]}],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T06:44:44.078 INFO:tasks.ceph:Scrubbing osd.0 2024-09-13T06:44:44.078 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-09-13T06:44:44.238 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:44:44.239 INFO:teuthology.orchestra.run.smithi081.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-13T06:44:44.239 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:44:44.255 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-09-13T06:44:44.530 INFO:teuthology.orchestra.run.smithi081.stderr:instructed osd(s) 0 to deep-scrub 2024-09-13T06:44:44.549 INFO:tasks.ceph:Scrubbing osd.1 2024-09-13T06:44:44.549 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-09-13T06:44:44.700 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:44:44.700 INFO:teuthology.orchestra.run.smithi081.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-13T06:44:44.700 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:44:44.715 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-09-13T06:44:45.000 INFO:teuthology.orchestra.run.smithi081.stderr:instructed osd(s) 1 to deep-scrub 2024-09-13T06:44:45.019 INFO:tasks.ceph:Scrubbing osd.2 2024-09-13T06:44:45.019 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-09-13T06:44:45.163 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:44:45.163 INFO:teuthology.orchestra.run.smithi081.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-13T06:44:45.163 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:44:45.179 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-09-13T06:44:45.446 INFO:teuthology.orchestra.run.smithi081.stderr:instructed osd(s) 2 to deep-scrub 2024-09-13T06:44:45.464 INFO:tasks.ceph:Scrubbing osd.3 2024-09-13T06:44:45.465 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-09-13T06:44:45.605 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:44:45.605 INFO:teuthology.orchestra.run.smithi081.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-13T06:44:45.605 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:44:45.621 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-09-13T06:44:45.890 INFO:teuthology.orchestra.run.smithi081.stderr:instructed osd(s) 3 to deep-scrub 2024-09-13T06:44:45.907 INFO:tasks.ceph:Scrubbing osd.4 2024-09-13T06:44:45.907 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-09-13T06:44:46.044 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:44:46.044 INFO:teuthology.orchestra.run.smithi081.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-13T06:44:46.044 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:44:46.058 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-09-13T06:44:46.328 INFO:teuthology.orchestra.run.smithi081.stderr:instructed osd(s) 4 to deep-scrub 2024-09-13T06:44:46.345 INFO:tasks.ceph:Scrubbing osd.5 2024-09-13T06:44:46.346 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-09-13T06:44:46.494 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:44:46.494 INFO:teuthology.orchestra.run.smithi081.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-13T06:44:46.494 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:44:46.509 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-09-13T06:44:46.795 INFO:teuthology.orchestra.run.smithi081.stderr:instructed osd(s) 5 to deep-scrub 2024-09-13T06:44:46.813 INFO:tasks.ceph:Scrubbing osd.6 2024-09-13T06:44:46.813 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-09-13T06:44:46.950 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:44:46.950 INFO:teuthology.orchestra.run.smithi081.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) osd_delete_sleep = '' osd_delete_sleep_hdd = '' osd_delete_sleep_hybrid = '' osd_delete_sleep_ssd = '' osd_max_backfills = '' osd_pg_delete_cost = '' (not observed, change may require restart) osd_recovery_max_active = '' osd_recovery_max_active_hdd = '' osd_recovery_max_active_ssd = '' osd_recovery_sleep = '' osd_recovery_sleep_hdd = '' osd_recovery_sleep_hybrid = '' osd_recovery_sleep_ssd = '' osd_scrub_sleep = '' osd_snap_trim_sleep = '' osd_snap_trim_sleep_hdd = '' osd_snap_trim_sleep_hybrid = '' osd_snap_trim_sleep_ssd = '' " 2024-09-13T06:44:46.950 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:44:46.964 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-09-13T06:44:47.230 INFO:teuthology.orchestra.run.smithi081.stderr:instructed osd(s) 6 to deep-scrub 2024-09-13T06:44:47.248 INFO:tasks.ceph:Scrubbing osd.7 2024-09-13T06:44:47.248 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-09-13T06:44:47.389 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T06:44:47.390 INFO:teuthology.orchestra.run.smithi081.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-13T06:44:47.390 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T06:44:47.406 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-09-13T06:44:47.697 INFO:teuthology.orchestra.run.smithi081.stderr:instructed osd(s) 7 to deep-scrub 2024-09-13T06:44:47.716 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T06:44:47.993 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T06:44:47.994 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-09-13T06:44:48.009 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":467,"stamp":"2024-09-13T06:44:47.612115+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590406,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":237398,"num_read_kb":1402962,"num_write":33483,"num_write_kb":1011328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9257,"num_bytes_recovered":444809309,"num_keys_recovered":867,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":24606,"ondisk_log_size":24606,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":486624,"kb_used_data":30120,"kb_used_omap":26,"kb_used_meta":456357,"kb_avail":754488096,"statfs":{"total":773094113280,"available":772595810304,"internally_reserved":0,"allocated":30842880,"data_stored":16035540,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":27392,"internal_metadata":467309824},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003093"},"pg_stats":[{"pgid":"3.1f","version":"280'781","reported_seq":6288,"reported_epoch":305,"state":"active+clean","last_fresh":"2024-09-13T06:44:34.833232+0000","last_change":"2024-09-13T06:44:05.445184+0000","last_active":"2024-09-13T06:44:34.833232+0000","last_peered":"2024-09-13T06:44:34.833232+0000","last_clean":"2024-09-13T06:44:34.833232+0000","last_became_active":"2024-09-13T06:40:57.385213+0000","last_became_peered":"2024-09-13T06:40:57.385213+0000","last_unstale":"2024-09-13T06:44:34.833232+0000","last_undegraded":"2024-09-13T06:44:34.833232+0000","last_fullsized":"2024-09-13T06:44:34.833232+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":781,"log_dups_size":0,"ondisk_log_size":781,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00056495999999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6518,"num_read_kb":34199,"num_write":1043,"num_write_kb":37100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":72,"num_bytes_recovered":6114482,"num_keys_recovered":44,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"271'1110","reported_seq":7422,"reported_epoch":304,"state":"active+clean","last_fresh":"2024-09-13T06:44:33.827798+0000","last_change":"2024-09-13T06:44:20.462945+0000","last_active":"2024-09-13T06:44:33.827798+0000","last_peered":"2024-09-13T06:44:33.827798+0000","last_clean":"2024-09-13T06:44:33.827798+0000","last_became_active":"2024-09-13T06:44:20.460702+0000","last_became_peered":"2024-09-13T06:44:20.460702+0000","last_unstale":"2024-09-13T06:44:33.827798+0000","last_undegraded":"2024-09-13T06:44:33.827798+0000","last_fullsized":"2024-09-13T06:44:33.827798+0000","mapping_epoch":290,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":291,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":1110,"log_dups_size":0,"ondisk_log_size":1110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:02:22.560348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013343369999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8806,"num_read_kb":55237,"num_write":1632,"num_write_kb":29160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":491,"num_bytes_recovered":16489974,"num_keys_recovered":55,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"279'1047","reported_seq":5656,"reported_epoch":303,"state":"active+clean","last_fresh":"2024-09-13T06:44:32.834174+0000","last_change":"2024-09-13T06:44:30.808653+0000","last_active":"2024-09-13T06:44:32.834174+0000","last_peered":"2024-09-13T06:44:32.834174+0000","last_clean":"2024-09-13T06:44:32.834174+0000","last_became_active":"2024-09-13T06:44:30.803142+0000","last_became_peered":"2024-09-13T06:44:30.803142+0000","last_unstale":"2024-09-13T06:44:32.834174+0000","last_undegraded":"2024-09-13T06:44:32.834174+0000","last_fullsized":"2024-09-13T06:44:32.834174+0000","mapping_epoch":300,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":301,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":1047,"log_dups_size":0,"ondisk_log_size":1047,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:25:53.597990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00088262599999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6265,"num_read_kb":28067,"num_write":1605,"num_write_kb":33265,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":206,"num_bytes_recovered":8442088,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1c","version":"280'843","reported_seq":8395,"reported_epoch":303,"state":"active+clean","last_fresh":"2024-09-13T06:44:32.834069+0000","last_change":"2024-09-13T06:44:30.807782+0000","last_active":"2024-09-13T06:44:32.834069+0000","last_peered":"2024-09-13T06:44:32.834069+0000","last_clean":"2024-09-13T06:44:32.834069+0000","last_became_active":"2024-09-13T06:44:30.801783+0000","last_became_peered":"2024-09-13T06:44:30.801783+0000","last_unstale":"2024-09-13T06:44:32.834069+0000","last_undegraded":"2024-09-13T06:44:32.834069+0000","last_fullsized":"2024-09-13T06:44:32.834069+0000","mapping_epoch":300,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":301,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":843,"log_dups_size":0,"ondisk_log_size":843,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:54:20.743708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001581236,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9390,"num_read_kb":69964,"num_write":963,"num_write_kb":31840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":350,"num_bytes_recovered":42380134,"num_keys_recovered":286,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"277'852","reported_seq":5172,"reported_epoch":305,"state":"active+clean","last_fresh":"2024-09-13T06:44:39.782727+0000","last_change":"2024-09-13T06:44:05.444712+0000","last_active":"2024-09-13T06:44:39.782727+0000","last_peered":"2024-09-13T06:44:39.782727+0000","last_clean":"2024-09-13T06:44:39.782727+0000","last_became_active":"2024-09-13T06:43:31.415608+0000","last_became_peered":"2024-09-13T06:43:31.415608+0000","last_unstale":"2024-09-13T06:44:39.782727+0000","last_undegraded":"2024-09-13T06:44:39.782727+0000","last_fullsized":"2024-09-13T06:44:39.782727+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":852,"log_dups_size":0,"ondisk_log_size":852,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060857399999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5714,"num_read_kb":37037,"num_write":1079,"num_write_kb":33376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":295,"num_bytes_recovered":25415745,"num_keys_recovered":55,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"277'497","reported_seq":7757,"reported_epoch":304,"state":"active+clean","last_fresh":"2024-09-13T06:44:33.828415+0000","last_change":"2024-09-13T06:44:20.469801+0000","last_active":"2024-09-13T06:44:33.828415+0000","last_peered":"2024-09-13T06:44:33.828415+0000","last_clean":"2024-09-13T06:44:33.828415+0000","last_became_active":"2024-09-13T06:44:20.462185+0000","last_became_peered":"2024-09-13T06:44:20.462185+0000","last_unstale":"2024-09-13T06:44:33.828415+0000","last_undegraded":"2024-09-13T06:44:33.828415+0000","last_fullsized":"2024-09-13T06:44:33.828415+0000","mapping_epoch":290,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":291,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":497,"log_dups_size":0,"ondisk_log_size":497,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:55:41.801680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00078923399999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6439,"num_read_kb":42977,"num_write":667,"num_write_kb":32420,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":728,"num_bytes_recovered":12986751,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"275'680","reported_seq":8570,"reported_epoch":304,"state":"active+clean","last_fresh":"2024-09-13T06:44:34.541517+0000","last_change":"2024-09-13T06:44:21.446173+0000","last_active":"2024-09-13T06:44:34.541517+0000","last_peered":"2024-09-13T06:44:34.541517+0000","last_clean":"2024-09-13T06:44:34.541517+0000","last_became_active":"2024-09-13T06:44:21.442872+0000","last_became_peered":"2024-09-13T06:44:21.442872+0000","last_unstale":"2024-09-13T06:44:34.541517+0000","last_undegraded":"2024-09-13T06:44:34.541517+0000","last_fullsized":"2024-09-13T06:44:34.541517+0000","mapping_epoch":291,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":292,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":680,"log_dups_size":0,"ondisk_log_size":680,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:11:12.949824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00079955100000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8400,"num_read_kb":35906,"num_write":738,"num_write_kb":28560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":398,"num_bytes_recovered":17539742,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"272'684","reported_seq":7046,"reported_epoch":304,"state":"active+clean","last_fresh":"2024-09-13T06:44:33.827366+0000","last_change":"2024-09-13T06:44:05.439754+0000","last_active":"2024-09-13T06:44:33.827366+0000","last_peered":"2024-09-13T06:44:33.827366+0000","last_clean":"2024-09-13T06:44:33.827366+0000","last_became_active":"2024-09-13T06:41:14.395301+0000","last_became_peered":"2024-09-13T06:41:14.395301+0000","last_unstale":"2024-09-13T06:44:33.827366+0000","last_undegraded":"2024-09-13T06:44:33.827366+0000","last_fullsized":"2024-09-13T06:44:33.827366+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":684,"log_dups_size":0,"ondisk_log_size":684,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:10:49.528345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00092758900000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6571,"num_read_kb":55194,"num_write":838,"num_write_kb":38872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":117,"num_bytes_recovered":13142180,"num_keys_recovered":22,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"275'1525","reported_seq":5961,"reported_epoch":305,"state":"active+clean","last_fresh":"2024-09-13T06:44:34.833632+0000","last_change":"2024-09-13T06:44:05.444913+0000","last_active":"2024-09-13T06:44:34.833632+0000","last_peered":"2024-09-13T06:44:34.833632+0000","last_clean":"2024-09-13T06:44:34.833632+0000","last_became_active":"2024-09-13T06:43:22.521039+0000","last_became_peered":"2024-09-13T06:43:22.521039+0000","last_unstale":"2024-09-13T06:44:34.833632+0000","last_undegraded":"2024-09-13T06:44:34.833632+0000","last_fullsized":"2024-09-13T06:44:34.833632+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":1525,"log_dups_size":0,"ondisk_log_size":1525,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00029931499999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9655,"num_read_kb":41824,"num_write":2232,"num_write_kb":32733,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":112,"num_bytes_recovered":14950263,"num_keys_recovered":22,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"275'715","reported_seq":5276,"reported_epoch":303,"state":"active+clean","last_fresh":"2024-09-13T06:44:32.834246+0000","last_change":"2024-09-13T06:44:30.806149+0000","last_active":"2024-09-13T06:44:32.834246+0000","last_peered":"2024-09-13T06:44:32.834246+0000","last_clean":"2024-09-13T06:44:32.834246+0000","last_became_active":"2024-09-13T06:44:30.798028+0000","last_became_peered":"2024-09-13T06:44:30.798028+0000","last_unstale":"2024-09-13T06:44:32.834246+0000","last_undegraded":"2024-09-13T06:44:32.834246+0000","last_fullsized":"2024-09-13T06:44:32.834246+0000","mapping_epoch":300,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":301,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":715,"log_dups_size":0,"ondisk_log_size":715,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:09:18.289368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0024960030000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5101,"num_read_kb":28279,"num_write":1028,"num_write_kb":23183,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":197,"num_bytes_recovered":7394092,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"277'365","reported_seq":6173,"reported_epoch":303,"state":"active+clean","last_fresh":"2024-09-13T06:44:32.805429+0000","last_change":"2024-09-13T06:44:05.457231+0000","last_active":"2024-09-13T06:44:32.805429+0000","last_peered":"2024-09-13T06:44:32.805429+0000","last_clean":"2024-09-13T06:44:32.805429+0000","last_became_active":"2024-09-13T06:42:33.408009+0000","last_became_peered":"2024-09-13T06:42:33.408009+0000","last_unstale":"2024-09-13T06:44:32.805429+0000","last_undegraded":"2024-09-13T06:44:32.805429+0000","last_fullsized":"2024-09-13T06:44:32.805429+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":365,"log_dups_size":0,"ondisk_log_size":365,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:09:11.995853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0024654690000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5036,"num_read_kb":48021,"num_write":472,"num_write_kb":27276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":157,"num_bytes_recovered":13242563,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"280'579","reported_seq":9960,"reported_epoch":304,"state":"active+clean","last_fresh":"2024-09-13T06:44:33.828571+0000","last_change":"2024-09-13T06:44:05.443324+0000","last_active":"2024-09-13T06:44:33.828571+0000","last_peered":"2024-09-13T06:44:33.828571+0000","last_clean":"2024-09-13T06:44:33.828571+0000","last_became_active":"2024-09-13T06:44:03.438897+0000","last_became_peered":"2024-09-13T06:44:03.438897+0000","last_unstale":"2024-09-13T06:44:33.828571+0000","last_undegraded":"2024-09-13T06:44:33.828571+0000","last_fullsized":"2024-09-13T06:44:33.828571+0000","mapping_epoch":277,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":278,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":579,"log_dups_size":0,"ondisk_log_size":579,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:24:55.053861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012901029999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8875,"num_read_kb":61758,"num_write":769,"num_write_kb":30278,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":506,"num_bytes_recovered":26184965,"num_keys_recovered":33,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":27,"reported_epoch":304,"state":"active+clean","last_fresh":"2024-09-13T06:44:33.832029+0000","last_change":"2024-09-13T06:44:16.450557+0000","last_active":"2024-09-13T06:44:33.832029+0000","last_peered":"2024-09-13T06:44:33.832029+0000","last_clean":"2024-09-13T06:44:33.832029+0000","last_became_active":"2024-09-13T06:44:16.449558+0000","last_became_peered":"2024-09-13T06:44:16.449558+0000","last_unstale":"2024-09-13T06:44:33.832029+0000","last_undegraded":"2024-09-13T06:44:33.832029+0000","last_fullsized":"2024-09-13T06:44:33.832029+0000","mapping_epoch":286,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":287,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_clean_scrub_stamp":"2024-09-13T06:39:16.508974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:01:20.779972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00080324699999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"280'643","reported_seq":10761,"reported_epoch":305,"state":"active+clean","last_fresh":"2024-09-13T06:44:34.833216+0000","last_change":"2024-09-13T06:44:22.454207+0000","last_active":"2024-09-13T06:44:34.833216+0000","last_peered":"2024-09-13T06:44:34.833216+0000","last_clean":"2024-09-13T06:44:34.833216+0000","last_became_active":"2024-09-13T06:44:22.449195+0000","last_became_peered":"2024-09-13T06:44:22.449195+0000","last_unstale":"2024-09-13T06:44:34.833216+0000","last_undegraded":"2024-09-13T06:44:34.833216+0000","last_fullsized":"2024-09-13T06:44:34.833216+0000","mapping_epoch":292,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":293,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":643,"log_dups_size":0,"ondisk_log_size":643,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00080400600000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9397,"num_read_kb":51433,"num_write":883,"num_write_kb":40908,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":358,"num_bytes_recovered":1257624,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":24,"reported_epoch":304,"state":"active+clean","last_fresh":"2024-09-13T06:44:34.541380+0000","last_change":"2024-09-13T06:44:18.458951+0000","last_active":"2024-09-13T06:44:34.541380+0000","last_peered":"2024-09-13T06:44:34.541380+0000","last_clean":"2024-09-13T06:44:34.541380+0000","last_became_active":"2024-09-13T06:44:18.458454+0000","last_became_peered":"2024-09-13T06:44:18.458454+0000","last_unstale":"2024-09-13T06:44:34.541380+0000","last_undegraded":"2024-09-13T06:44:34.541380+0000","last_fullsized":"2024-09-13T06:44:34.541380+0000","mapping_epoch":288,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":289,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_clean_scrub_stamp":"2024-09-13T06:39:16.508974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:06:07.380573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00097079800000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"277'694","reported_seq":7060,"reported_epoch":304,"state":"active+clean","last_fresh":"2024-09-13T06:44:33.827435+0000","last_change":"2024-09-13T06:44:05.440674+0000","last_active":"2024-09-13T06:44:33.827435+0000","last_peered":"2024-09-13T06:44:33.827435+0000","last_clean":"2024-09-13T06:44:33.827435+0000","last_became_active":"2024-09-13T06:42:32.413006+0000","last_became_peered":"2024-09-13T06:42:32.413006+0000","last_unstale":"2024-09-13T06:44:33.827435+0000","last_undegraded":"2024-09-13T06:44:33.827435+0000","last_fullsized":"2024-09-13T06:44:33.827435+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":694,"log_dups_size":0,"ondisk_log_size":694,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:38:01.774494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001338379,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6521,"num_read_kb":33119,"num_write":812,"num_write_kb":30039,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":213,"num_bytes_recovered":15100645,"num_keys_recovered":11,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":181,"reported_epoch":305,"state":"active+clean","last_fresh":"2024-09-13T06:44:34.866142+0000","last_change":"2024-09-13T06:42:28.563276+0000","last_active":"2024-09-13T06:44:34.866142+0000","last_peered":"2024-09-13T06:44:34.866142+0000","last_clean":"2024-09-13T06:44:34.866142+0000","last_became_active":"2024-09-13T06:42:28.562827+0000","last_became_peered":"2024-09-13T06:42:28.562827+0000","last_unstale":"2024-09-13T06:44:34.866142+0000","last_undegraded":"2024-09-13T06:44:34.866142+0000","last_fullsized":"2024-09-13T06:44:34.866142+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_clean_scrub_stamp":"2024-09-13T06:39:16.508974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:10:47.285603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"277'961","reported_seq":6891,"reported_epoch":304,"state":"active+clean","last_fresh":"2024-09-13T06:44:34.541518+0000","last_change":"2024-09-13T06:44:22.455582+0000","last_active":"2024-09-13T06:44:34.541518+0000","last_peered":"2024-09-13T06:44:34.541518+0000","last_clean":"2024-09-13T06:44:34.541518+0000","last_became_active":"2024-09-13T06:44:22.450933+0000","last_became_peered":"2024-09-13T06:44:22.450933+0000","last_unstale":"2024-09-13T06:44:34.541518+0000","last_undegraded":"2024-09-13T06:44:34.541518+0000","last_fullsized":"2024-09-13T06:44:34.541518+0000","mapping_epoch":292,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":293,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":961,"log_dups_size":0,"ondisk_log_size":961,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:30:26.327840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0031147280000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7705,"num_read_kb":38648,"num_write":1332,"num_write_kb":32653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":354,"num_bytes_recovered":6765835,"num_keys_recovered":11,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":24,"reported_epoch":304,"state":"active+clean","last_fresh":"2024-09-13T06:44:34.541611+0000","last_change":"2024-09-13T06:44:18.468145+0000","last_active":"2024-09-13T06:44:34.541611+0000","last_peered":"2024-09-13T06:44:34.541611+0000","last_clean":"2024-09-13T06:44:34.541611+0000","last_became_active":"2024-09-13T06:44:18.467833+0000","last_became_peered":"2024-09-13T06:44:18.467833+0000","last_unstale":"2024-09-13T06:44:34.541611+0000","last_undegraded":"2024-09-13T06:44:34.541611+0000","last_fullsized":"2024-09-13T06:44:34.541611+0000","mapping_epoch":288,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":289,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_clean_scrub_stamp":"2024-09-13T06:39:16.508974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:33:56.156376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"277'640","reported_seq":7755,"reported_epoch":303,"state":"active+clean","last_fresh":"2024-09-13T06:44:32.834288+0000","last_change":"2024-09-13T06:44:30.803125+0000","last_active":"2024-09-13T06:44:32.834288+0000","last_peered":"2024-09-13T06:44:32.834288+0000","last_clean":"2024-09-13T06:44:32.834288+0000","last_became_active":"2024-09-13T06:44:30.797769+0000","last_became_peered":"2024-09-13T06:44:30.797769+0000","last_unstale":"2024-09-13T06:44:32.834288+0000","last_undegraded":"2024-09-13T06:44:32.834288+0000","last_fullsized":"2024-09-13T06:44:32.834288+0000","mapping_epoch":300,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":301,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":640,"log_dups_size":0,"ondisk_log_size":640,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:49:47.340041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0046689339999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7611,"num_read_kb":41345,"num_write":1018,"num_write_kb":26620,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":158,"num_bytes_recovered":4212424,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"280'991","reported_seq":21074,"reported_epoch":304,"state":"active+clean","last_fresh":"2024-09-13T06:44:33.828568+0000","last_change":"2024-09-13T06:44:28.773729+0000","last_active":"2024-09-13T06:44:33.828568+0000","last_peered":"2024-09-13T06:44:33.828568+0000","last_clean":"2024-09-13T06:44:33.828568+0000","last_became_active":"2024-09-13T06:44:28.768976+0000","last_became_peered":"2024-09-13T06:44:28.768976+0000","last_unstale":"2024-09-13T06:44:33.828568+0000","last_undegraded":"2024-09-13T06:44:33.828568+0000","last_fullsized":"2024-09-13T06:44:33.828568+0000","mapping_epoch":298,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":299,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":991,"log_dups_size":0,"ondisk_log_size":991,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:30:21.817297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0017436419999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20994,"num_read_kb":92583,"num_write":1315,"num_write_kb":30385,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":207,"num_bytes_recovered":9898606,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"20'2","reported_seq":125,"reported_epoch":303,"state":"active+clean","last_fresh":"2024-09-13T06:44:32.834084+0000","last_change":"2024-09-13T06:44:30.794941+0000","last_active":"2024-09-13T06:44:32.834084+0000","last_peered":"2024-09-13T06:44:32.834084+0000","last_clean":"2024-09-13T06:44:32.834084+0000","last_became_active":"2024-09-13T06:44:30.794134+0000","last_became_peered":"2024-09-13T06:44:30.794134+0000","last_unstale":"2024-09-13T06:44:32.834084+0000","last_undegraded":"2024-09-13T06:44:32.834084+0000","last_fullsized":"2024-09-13T06:44:32.834084+0000","mapping_epoch":300,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":301,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_clean_scrub_stamp":"2024-09-13T06:39:16.508974+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:36:10.351897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":57,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"278'857","reported_seq":10772,"reported_epoch":304,"state":"active+clean","last_fresh":"2024-09-13T06:44:34.541417+0000","last_change":"2024-09-13T06:44:21.445836+0000","last_active":"2024-09-13T06:44:34.541417+0000","last_peered":"2024-09-13T06:44:34.541417+0000","last_clean":"2024-09-13T06:44:34.541417+0000","last_became_active":"2024-09-13T06:44:21.442847+0000","last_became_peered":"2024-09-13T06:44:21.442847+0000","last_unstale":"2024-09-13T06:44:34.541417+0000","last_undegraded":"2024-09-13T06:44:34.541417+0000","last_fullsized":"2024-09-13T06:44:34.541417+0000","mapping_epoch":291,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":292,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":857,"log_dups_size":0,"ondisk_log_size":857,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:42:10.542267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00053211199999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11278,"num_read_kb":63107,"num_write":1190,"num_write_kb":36968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":351,"num_bytes_recovered":9847094,"num_keys_recovered":11,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":26,"reported_epoch":304,"state":"active+clean","last_fresh":"2024-09-13T06:44:33.827890+0000","last_change":"2024-09-13T06:44:17.443833+0000","last_active":"2024-09-13T06:44:33.827890+0000","last_peered":"2024-09-13T06:44:33.827890+0000","last_clean":"2024-09-13T06:44:33.827890+0000","last_became_active":"2024-09-13T06:44:17.443358+0000","last_became_peered":"2024-09-13T06:44:17.443358+0000","last_unstale":"2024-09-13T06:44:33.827890+0000","last_undegraded":"2024-09-13T06:44:33.827890+0000","last_fullsized":"2024-09-13T06:44:33.827890+0000","mapping_epoch":287,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":288,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_clean_scrub_stamp":"2024-09-13T06:39:16.508974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:30:37.013428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00033592499999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"277'1115","reported_seq":6259,"reported_epoch":305,"state":"active+clean","last_fresh":"2024-09-13T06:44:34.833204+0000","last_change":"2024-09-13T06:44:30.799789+0000","last_active":"2024-09-13T06:44:34.833204+0000","last_peered":"2024-09-13T06:44:34.833204+0000","last_clean":"2024-09-13T06:44:34.833204+0000","last_became_active":"2024-09-13T06:44:30.798508+0000","last_became_peered":"2024-09-13T06:44:30.798508+0000","last_unstale":"2024-09-13T06:44:34.833204+0000","last_undegraded":"2024-09-13T06:44:34.833204+0000","last_fullsized":"2024-09-13T06:44:34.833204+0000","mapping_epoch":300,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":301,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":1115,"log_dups_size":0,"ondisk_log_size":1115,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0032283849999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7964,"num_read_kb":36198,"num_write":1645,"num_write_kb":33105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":243,"num_bytes_recovered":7863454,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":197,"reported_epoch":303,"state":"active+clean","last_fresh":"2024-09-13T06:44:32.805107+0000","last_change":"2024-09-13T06:44:18.457601+0000","last_active":"2024-09-13T06:44:32.805107+0000","last_peered":"2024-09-13T06:44:32.805107+0000","last_clean":"2024-09-13T06:44:32.805107+0000","last_became_active":"2024-09-13T06:44:18.456828+0000","last_became_peered":"2024-09-13T06:44:18.456828+0000","last_unstale":"2024-09-13T06:44:32.805107+0000","last_undegraded":"2024-09-13T06:44:32.805107+0000","last_fullsized":"2024-09-13T06:44:32.805107+0000","mapping_epoch":288,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":289,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_clean_scrub_stamp":"2024-09-13T06:39:16.508974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:17:09.082426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"279'349","reported_seq":3763,"reported_epoch":304,"state":"active+clean","last_fresh":"2024-09-13T06:44:33.827275+0000","last_change":"2024-09-13T06:44:05.440371+0000","last_active":"2024-09-13T06:44:33.827275+0000","last_peered":"2024-09-13T06:44:33.827275+0000","last_clean":"2024-09-13T06:44:33.827275+0000","last_became_active":"2024-09-13T06:41:15.399301+0000","last_became_peered":"2024-09-13T06:41:15.399301+0000","last_unstale":"2024-09-13T06:44:33.827275+0000","last_undegraded":"2024-09-13T06:44:33.827275+0000","last_fullsized":"2024-09-13T06:44:33.827275+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":349,"log_dups_size":0,"ondisk_log_size":349,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:53:18.137873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001343293,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2523,"num_read_kb":19829,"num_write":427,"num_write_kb":20943,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":169,"num_bytes_recovered":5233325,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"18'1","reported_seq":56,"reported_epoch":303,"state":"active+clean","last_fresh":"2024-09-13T06:44:32.834077+0000","last_change":"2024-09-13T06:44:30.798045+0000","last_active":"2024-09-13T06:44:32.834077+0000","last_peered":"2024-09-13T06:44:32.834077+0000","last_clean":"2024-09-13T06:44:32.834077+0000","last_became_active":"2024-09-13T06:44:30.796877+0000","last_became_peered":"2024-09-13T06:44:30.796877+0000","last_unstale":"2024-09-13T06:44:32.834077+0000","last_undegraded":"2024-09-13T06:44:32.834077+0000","last_fullsized":"2024-09-13T06:44:32.834077+0000","mapping_epoch":300,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":301,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_clean_scrub_stamp":"2024-09-13T06:39:16.508974+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:33:04.298167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":397,"reported_epoch":303,"state":"active+clean","last_fresh":"2024-09-13T06:44:32.805140+0000","last_change":"2024-09-13T06:42:28.563168+0000","last_active":"2024-09-13T06:44:32.805140+0000","last_peered":"2024-09-13T06:44:32.805140+0000","last_clean":"2024-09-13T06:44:32.805140+0000","last_became_active":"2024-09-13T06:42:28.562642+0000","last_became_peered":"2024-09-13T06:42:28.562642+0000","last_unstale":"2024-09-13T06:44:32.805140+0000","last_undegraded":"2024-09-13T06:44:32.805140+0000","last_fullsized":"2024-09-13T06:44:32.805140+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:10.110558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:10.110558+0000","last_clean_scrub_stamp":"2024-09-13T06:39:10.110558+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:05:54.866043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"277'651","reported_seq":10851,"reported_epoch":304,"state":"active+clean","last_fresh":"2024-09-13T06:44:33.827115+0000","last_change":"2024-09-13T06:44:22.452634+0000","last_active":"2024-09-13T06:44:33.827115+0000","last_peered":"2024-09-13T06:44:33.827115+0000","last_clean":"2024-09-13T06:44:33.827115+0000","last_became_active":"2024-09-13T06:44:22.448736+0000","last_became_peered":"2024-09-13T06:44:22.448736+0000","last_unstale":"2024-09-13T06:44:33.827115+0000","last_undegraded":"2024-09-13T06:44:33.827115+0000","last_fullsized":"2024-09-13T06:44:33.827115+0000","mapping_epoch":292,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":293,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":651,"log_dups_size":0,"ondisk_log_size":651,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:58:40.103969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00083432600000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9552,"num_read_kb":46146,"num_write":828,"num_write_kb":32512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":446,"num_bytes_recovered":11977587,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"277'774","reported_seq":10944,"reported_epoch":304,"state":"active+clean","last_fresh":"2024-09-13T06:44:33.827759+0000","last_change":"2024-09-13T06:44:20.466493+0000","last_active":"2024-09-13T06:44:33.827759+0000","last_peered":"2024-09-13T06:44:33.827759+0000","last_clean":"2024-09-13T06:44:33.827759+0000","last_became_active":"2024-09-13T06:44:20.462849+0000","last_became_peered":"2024-09-13T06:44:20.462849+0000","last_unstale":"2024-09-13T06:44:33.827759+0000","last_undegraded":"2024-09-13T06:44:33.827759+0000","last_fullsized":"2024-09-13T06:44:33.827759+0000","mapping_epoch":290,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":291,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":774,"log_dups_size":0,"ondisk_log_size":774,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:40:44.119462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0024338839999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10729,"num_read_kb":51645,"num_write":931,"num_write_kb":34617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":445,"num_bytes_recovered":16579571,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"278'758","reported_seq":8282,"reported_epoch":305,"state":"active+clean","last_fresh":"2024-09-13T06:44:34.842308+0000","last_change":"2024-09-13T06:44:34.842308+0000","last_active":"2024-09-13T06:44:34.842308+0000","last_peered":"2024-09-13T06:44:34.842308+0000","last_clean":"2024-09-13T06:44:34.842308+0000","last_became_active":"2024-09-13T06:44:34.836417+0000","last_became_peered":"2024-09-13T06:44:34.836417+0000","last_unstale":"2024-09-13T06:44:34.842308+0000","last_undegraded":"2024-09-13T06:44:34.842308+0000","last_fullsized":"2024-09-13T06:44:34.842308+0000","mapping_epoch":304,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":305,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":758,"log_dups_size":0,"ondisk_log_size":758,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:44:55.089545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00085210600000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8422,"num_read_kb":47219,"num_write":883,"num_write_kb":28077,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":515,"num_bytes_recovered":28581300,"num_keys_recovered":111,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"271'845","reported_seq":5602,"reported_epoch":304,"state":"active+clean","last_fresh":"2024-09-13T06:44:33.827387+0000","last_change":"2024-09-13T06:44:05.439827+0000","last_active":"2024-09-13T06:44:33.827387+0000","last_peered":"2024-09-13T06:44:33.827387+0000","last_clean":"2024-09-13T06:44:33.827387+0000","last_became_active":"2024-09-13T06:41:15.399204+0000","last_became_peered":"2024-09-13T06:41:15.399204+0000","last_unstale":"2024-09-13T06:44:33.827387+0000","last_undegraded":"2024-09-13T06:44:33.827387+0000","last_fullsized":"2024-09-13T06:44:33.827387+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":845,"log_dups_size":0,"ondisk_log_size":845,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:27:03.298272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00094468700000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6686,"num_read_kb":57840,"num_write":1181,"num_write_kb":24665,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":117,"num_bytes_recovered":13256568,"num_keys_recovered":44,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"279'569","reported_seq":6603,"reported_epoch":303,"state":"active+clean","last_fresh":"2024-09-13T06:44:32.834414+0000","last_change":"2024-09-13T06:44:30.802655+0000","last_active":"2024-09-13T06:44:32.834414+0000","last_peered":"2024-09-13T06:44:32.834414+0000","last_clean":"2024-09-13T06:44:32.834414+0000","last_became_active":"2024-09-13T06:44:30.794873+0000","last_became_peered":"2024-09-13T06:44:30.794873+0000","last_unstale":"2024-09-13T06:44:32.834414+0000","last_undegraded":"2024-09-13T06:44:32.834414+0000","last_fullsized":"2024-09-13T06:44:32.834414+0000","mapping_epoch":300,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":301,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":569,"log_dups_size":0,"ondisk_log_size":569,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:26:59.771063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0027493119999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6187,"num_read_kb":31727,"num_write":657,"num_write_kb":25682,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":184,"num_bytes_recovered":16410936,"num_keys_recovered":88,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"277'881","reported_seq":2924,"reported_epoch":305,"state":"active+clean","last_fresh":"2024-09-13T06:44:34.866729+0000","last_change":"2024-09-13T06:44:05.458093+0000","last_active":"2024-09-13T06:44:34.866729+0000","last_peered":"2024-09-13T06:44:34.866729+0000","last_clean":"2024-09-13T06:44:34.866729+0000","last_became_active":"2024-09-13T06:42:32.411927+0000","last_became_peered":"2024-09-13T06:42:32.411927+0000","last_unstale":"2024-09-13T06:44:34.866729+0000","last_undegraded":"2024-09-13T06:44:34.866729+0000","last_fullsized":"2024-09-13T06:44:34.866729+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":881,"log_dups_size":0,"ondisk_log_size":881,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:40:44.787780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.003013108,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4846,"num_read_kb":26164,"num_write":1518,"num_write_kb":30083,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":140,"num_bytes_recovered":11278110,"num_keys_recovered":11,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.e","version":"277'556","reported_seq":4103,"reported_epoch":305,"state":"active+clean","last_fresh":"2024-09-13T06:44:34.866984+0000","last_change":"2024-09-13T06:44:30.808041+0000","last_active":"2024-09-13T06:44:34.866984+0000","last_peered":"2024-09-13T06:44:34.866984+0000","last_clean":"2024-09-13T06:44:34.866984+0000","last_became_active":"2024-09-13T06:44:30.801655+0000","last_became_peered":"2024-09-13T06:44:30.801655+0000","last_unstale":"2024-09-13T06:44:34.866984+0000","last_undegraded":"2024-09-13T06:44:34.866984+0000","last_fullsized":"2024-09-13T06:44:34.866984+0000","mapping_epoch":300,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":301,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":556,"log_dups_size":0,"ondisk_log_size":556,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:43:53.489080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0025767619999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3868,"num_read_kb":43567,"num_write":654,"num_write_kb":29232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":503,"num_bytes_recovered":12695191,"num_keys_recovered":11,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"277'665","reported_seq":4754,"reported_epoch":303,"state":"active+clean","last_fresh":"2024-09-13T06:44:32.805508+0000","last_change":"2024-09-13T06:44:05.458214+0000","last_active":"2024-09-13T06:44:32.805508+0000","last_peered":"2024-09-13T06:44:32.805508+0000","last_clean":"2024-09-13T06:44:32.805508+0000","last_became_active":"2024-09-13T06:42:33.412054+0000","last_became_peered":"2024-09-13T06:42:33.412054+0000","last_unstale":"2024-09-13T06:44:32.805508+0000","last_undegraded":"2024-09-13T06:44:32.805508+0000","last_fullsized":"2024-09-13T06:44:32.805508+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":665,"log_dups_size":0,"ondisk_log_size":665,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:07:06.963404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00285659,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4677,"num_read_kb":45287,"num_write":982,"num_write_kb":45285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":394,"num_bytes_recovered":42768786,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.10","version":"280'832","reported_seq":5035,"reported_epoch":304,"state":"active+clean","last_fresh":"2024-09-13T06:44:33.831977+0000","last_change":"2024-09-13T06:44:19.467239+0000","last_active":"2024-09-13T06:44:33.831977+0000","last_peered":"2024-09-13T06:44:33.831977+0000","last_clean":"2024-09-13T06:44:33.831977+0000","last_became_active":"2024-09-13T06:44:19.459617+0000","last_became_peered":"2024-09-13T06:44:19.459617+0000","last_unstale":"2024-09-13T06:44:33.831977+0000","last_undegraded":"2024-09-13T06:44:33.831977+0000","last_fullsized":"2024-09-13T06:44:33.831977+0000","mapping_epoch":289,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":290,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":832,"log_dups_size":0,"ondisk_log_size":832,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:43:55.736868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0018779840000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5715,"num_read_kb":29614,"num_write":1142,"num_write_kb":36190,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":275,"num_bytes_recovered":6622441,"num_keys_recovered":20,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.11","version":"279'502","reported_seq":6279,"reported_epoch":303,"state":"active+clean","last_fresh":"2024-09-13T06:44:32.805097+0000","last_change":"2024-09-13T06:44:05.455675+0000","last_active":"2024-09-13T06:44:32.805097+0000","last_peered":"2024-09-13T06:44:32.805097+0000","last_clean":"2024-09-13T06:44:32.805097+0000","last_became_active":"2024-09-13T06:42:33.411668+0000","last_became_peered":"2024-09-13T06:42:33.411668+0000","last_unstale":"2024-09-13T06:44:32.805097+0000","last_undegraded":"2024-09-13T06:44:32.805097+0000","last_fullsized":"2024-09-13T06:44:32.805097+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":502,"log_dups_size":0,"ondisk_log_size":502,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:43:01.814094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001270492,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5341,"num_read_kb":34087,"num_write":659,"num_write_kb":25712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":245,"num_bytes_recovered":7089272,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"280'921","reported_seq":5048,"reported_epoch":305,"state":"active+clean","last_fresh":"2024-09-13T06:44:34.833109+0000","last_change":"2024-09-13T06:44:20.470378+0000","last_active":"2024-09-13T06:44:34.833109+0000","last_peered":"2024-09-13T06:44:34.833109+0000","last_clean":"2024-09-13T06:44:34.833109+0000","last_became_active":"2024-09-13T06:44:20.466713+0000","last_became_peered":"2024-09-13T06:44:20.466713+0000","last_unstale":"2024-09-13T06:44:34.833109+0000","last_undegraded":"2024-09-13T06:44:34.833109+0000","last_fullsized":"2024-09-13T06:44:34.833109+0000","mapping_epoch":290,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":291,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":921,"log_dups_size":0,"ondisk_log_size":921,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0017683250000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6025,"num_read_kb":38947,"num_write":1315,"num_write_kb":35656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":107,"num_bytes_recovered":3682200,"num_keys_recovered":21,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"279'604","reported_seq":4546,"reported_epoch":303,"state":"active+clean","last_fresh":"2024-09-13T06:44:32.805143+0000","last_change":"2024-09-13T06:44:05.454984+0000","last_active":"2024-09-13T06:44:32.805143+0000","last_peered":"2024-09-13T06:44:32.805143+0000","last_clean":"2024-09-13T06:44:32.805143+0000","last_became_active":"2024-09-13T06:42:31.402800+0000","last_became_peered":"2024-09-13T06:42:31.402800+0000","last_unstale":"2024-09-13T06:44:32.805143+0000","last_undegraded":"2024-09-13T06:44:32.805143+0000","last_fullsized":"2024-09-13T06:44:32.805143+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":604,"log_dups_size":0,"ondisk_log_size":604,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:59:41.167052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010470779999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4471,"num_read_kb":35894,"num_write":884,"num_write_kb":31515,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":196,"num_bytes_recovered":8224568,"num_keys_recovered":11,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":19,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":237282,"num_read_kb":1402862,"num_write":33322,"num_write_kb":1008910,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9249,"num_bytes_recovered":443628516,"num_keys_recovered":867,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14648,"internal_metadata":0},"log_size":24486,"ondisk_log_size":24486,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":57,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":3}],"osd_stats":[{"osd":7,"up_from":187,"seq":803158884382,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37040,"kb_used_data":4196,"kb_used_omap":9,"kb_used_meta":32822,"kb_avail":94334800,"statfs":{"total":96636764160,"available":96598835200,"internally_reserved":0,"allocated":4296704,"data_stored":2446923,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9685,"internal_metadata":33610283},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 06:44:33 2024","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":0.71199999999999997,"15min":0.69799999999999995},"min":{"1min":0.56699999999999995,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.754},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.751,"15min":0.73999999999999999},"min":{"1min":0.54600000000000004,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.6910000000000001,"5min":1.6910000000000001,"15min":1.6910000000000001},"last":0.47399999999999998}]},{"osd":1,"last update":"Fri Sep 13 06:44:33 2024","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.75700000000000001,"15min":0.751},"min":{"1min":0.57399999999999995,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.359,"5min":1.359,"15min":1.359},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.82399999999999995,"5min":0.71599999999999997,"15min":0.69799999999999995},"min":{"1min":0.496,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.1259999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.53500000000000003}]},{"osd":2,"last update":"Fri Sep 13 06:44:33 2024","interfaces":[{"interface":"back","average":{"1min":0.80700000000000005,"5min":0.75900000000000001,"15min":0.751},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.2030000000000001,"5min":1.212,"15min":1.212},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.92200000000000004,"5min":0.81499999999999995,"15min":0.79700000000000004},"min":{"1min":0.58999999999999997,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.4319999999999999,"5min":1.4319999999999999,"15min":1.4319999999999999},"last":0.99399999999999999}]},{"osd":3,"last update":"Fri Sep 13 06:44:33 2024","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.79600000000000004,"15min":0.79200000000000004},"min":{"1min":0.60299999999999998,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.177,"5min":1.177,"15min":1.177},"last":0.85899999999999999},{"interface":"front","average":{"1min":0.88600000000000001,"5min":0.84299999999999997,"15min":0.83599999999999997},"min":{"1min":0.48099999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.7350000000000001,"5min":1.7350000000000001,"15min":1.7350000000000001},"last":0.81499999999999995}]},{"osd":4,"last update":"Fri Sep 13 06:44:33 2024","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.82299999999999995,"15min":0.82499999999999996},"min":{"1min":0.45500000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.405,"5min":1.405,"15min":1.405},"last":0.89400000000000002},{"interface":"front","average":{"1min":1.0049999999999999,"5min":0.82299999999999995,"15min":0.79300000000000004},"min":{"1min":0.39800000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.6240000000000001,"5min":1.6240000000000001,"15min":1.6240000000000001},"last":1.0329999999999999}]},{"osd":5,"last update":"Fri Sep 13 06:44:33 2024","interfaces":[{"interface":"back","average":{"1min":0.96599999999999997,"5min":0.88800000000000001,"15min":0.875},"min":{"1min":0.504,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.593,"5min":1.593,"15min":1.593},"last":1.0980000000000001},{"interface":"front","average":{"1min":0.92300000000000004,"5min":0.84099999999999997,"15min":0.82699999999999996},"min":{"1min":0.53800000000000003,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.3400000000000001,"5min":1.3400000000000001,"15min":1.3400000000000001},"last":0.93999999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0669999999999999}]}]},{"osd":6,"up_from":286,"seq":1228360646664,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35504,"kb_used_data":3620,"kb_used_omap":7,"kb_used_meta":31864,"kb_avail":94336336,"statfs":{"total":96636764160,"available":96600408064,"internally_reserved":0,"allocated":3706880,"data_stored":1857127,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8145,"internal_metadata":32628783},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90800000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.749}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66300000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94199999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0309999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.135}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.081}]}]},{"osd":5,"up_from":13,"seq":55834574919,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":79024,"kb_used_data":3620,"kb_used_omap":1,"kb_used_meta":75390,"kb_avail":94292816,"statfs":{"total":96636764160,"available":96555843584,"internally_reserved":0,"allocated":3706880,"data_stored":1856574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":77199814},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 06:44:19 2024","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.71399999999999997,"15min":0.76500000000000001},"min":{"1min":0.40999999999999998,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":1.093,"5min":1.6679999999999999,"15min":1.6679999999999999},"last":1.044},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.76900000000000002,"15min":0.79900000000000004},"min":{"1min":0.41299999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.1220000000000001,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":0.872}]},{"osd":1,"last update":"Fri Sep 13 06:44:19 2024","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.73999999999999999,"15min":0.751},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":1.103,"5min":1.341,"15min":1.341},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.70099999999999996,"15min":0.74099999999999999},"min":{"1min":0.40899999999999997,"5min":0.317,"15min":0.317},"max":{"1min":1.0089999999999999,"5min":1.722,"15min":1.722},"last":0.79500000000000004}]},{"osd":2,"last update":"Fri Sep 13 06:44:19 2024","interfaces":[{"interface":"back","average":{"1min":0.876,"5min":0.81999999999999995,"15min":0.86399999999999999},"min":{"1min":0.47699999999999998,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.143,"5min":1.833,"15min":1.833},"last":0.90400000000000003},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.79200000000000004},"min":{"1min":0.47999999999999998,"5min":0.435,"15min":0.435},"max":{"1min":1.0169999999999999,"5min":1.4279999999999999,"15min":1.4279999999999999},"last":0.83299999999999996}]},{"osd":3,"last update":"Fri Sep 13 06:44:19 2024","interfaces":[{"interface":"back","average":{"1min":0.85699999999999998,"5min":0.81399999999999995,"15min":0.78000000000000003},"min":{"1min":0.45400000000000001,"5min":0.434,"15min":0.434},"max":{"1min":1.1659999999999999,"5min":1.885,"15min":1.885},"last":1.0109999999999999},{"interface":"front","average":{"1min":0.85899999999999999,"5min":0.86299999999999999,"15min":0.86499999999999999},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.2410000000000001,"5min":1.907,"15min":1.907},"last":1.161}]},{"osd":4,"last update":"Fri Sep 13 06:44:19 2024","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.83499999999999996,"15min":0.80500000000000005},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":1.159,"5min":6.3179999999999996,"15min":6.3179999999999996},"last":0.746},{"interface":"front","average":{"1min":0.78000000000000003,"5min":1.0529999999999999,"15min":0.91000000000000003},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":1.2370000000000001,"5min":15.553000000000001,"15min":15.553000000000001},"last":0.96799999999999997}]},{"osd":6,"last update":"Fri Sep 13 06:42:12 2024","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.86299999999999999,"15min":0.877},"min":{"1min":0.40000000000000002,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.9610000000000001,"5min":1.9610000000000001,"15min":1.9610000000000001},"last":1.1919999999999999},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.86099999999999999,"15min":0.87},"min":{"1min":0.39000000000000001,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.206,"5min":1.968,"15min":1.968},"last":1.111}]},{"osd":7,"last update":"Fri Sep 13 06:44:31 2024","interfaces":[{"interface":"back","average":{"1min":0.96399999999999997,"5min":0.84399999999999997,"15min":0.82399999999999995},"min":{"1min":0.39000000000000001,"5min":0.373,"15min":0.373},"max":{"1min":1.2050000000000001,"5min":1.375,"15min":1.375},"last":1.089},{"interface":"front","average":{"1min":0.997,"5min":0.89800000000000002,"15min":0.88200000000000001},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":1.7050000000000001,"5min":1.7050000000000001,"15min":1.7050000000000001},"last":1.2769999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574919,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60984,"kb_used_data":3624,"kb_used_omap":1,"kb_used_meta":57342,"kb_avail":94310856,"statfs":{"total":96636764160,"available":96574316544,"internally_reserved":0,"allocated":3710976,"data_stored":1857146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":58718662},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 06:44:15 2024","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.79300000000000004,"15min":0.98999999999999999},"min":{"1min":0.41499999999999998,"5min":0.245,"15min":0.245},"max":{"1min":1.0720000000000001,"5min":5.8230000000000004,"15min":5.8230000000000004},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.71999999999999997,"15min":0.752},"min":{"1min":0.505,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.97299999999999998,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":0.54200000000000004}]},{"osd":1,"last update":"Fri Sep 13 06:44:15 2024","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.79300000000000004,"15min":0.75},"min":{"1min":0.45100000000000001,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.86899999999999999,"5min":10.156000000000001,"15min":10.156000000000001},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.747,"5min":0.77500000000000002,"15min":0.83599999999999997},"min":{"1min":0.496,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.0349999999999999,"5min":1.286,"15min":1.286},"last":0.70499999999999996}]},{"osd":2,"last update":"Fri Sep 13 06:44:15 2024","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.751,"15min":0.82299999999999995},"min":{"1min":0.52800000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":1.0109999999999999,"5min":1.6000000000000001,"15min":1.6000000000000001},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.81299999999999994},"min":{"1min":0.65500000000000003,"5min":0.374,"15min":0.374},"max":{"1min":1.167,"5min":1.3540000000000001,"15min":1.3540000000000001},"last":0.78500000000000003}]},{"osd":3,"last update":"Fri Sep 13 06:44:15 2024","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.84699999999999998,"15min":0.90200000000000002},"min":{"1min":0.57499999999999996,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.6950000000000001,"5min":1.6950000000000001,"15min":1.6950000000000001},"last":0.82099999999999995},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.95299999999999996,"15min":0.92500000000000004},"min":{"1min":0.48499999999999999,"5min":0.374,"15min":0.374},"max":{"1min":1.8069999999999999,"5min":10.195,"15min":10.195},"last":0.754}]},{"osd":5,"last update":"Fri Sep 13 06:44:15 2024","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.81499999999999995,"15min":0.85699999999999998},"min":{"1min":0.443,"5min":0.249,"15min":0.249},"max":{"1min":1.075,"5min":2.9790000000000001,"15min":2.9790000000000001},"last":0.85899999999999999},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.84399999999999997,"15min":0.91400000000000003},"min":{"1min":0.39700000000000002,"5min":0.372,"15min":0.372},"max":{"1min":1.0580000000000001,"5min":1.8779999999999999,"15min":1.8779999999999999},"last":0.999}]},{"osd":6,"last update":"Fri Sep 13 06:42:14 2024","interfaces":[{"interface":"back","average":{"1min":0.90100000000000002,"5min":0.92100000000000004,"15min":0.82899999999999996},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":1.6100000000000001,"5min":10.016999999999999,"15min":10.016999999999999},"last":0.90000000000000002},{"interface":"front","average":{"1min":0.86699999999999999,"5min":0.93300000000000005,"15min":0.95999999999999996},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.2030000000000001,"5min":2.0750000000000002,"15min":2.0750000000000002},"last":0.95199999999999996}]},{"osd":7,"last update":"Fri Sep 13 06:44:33 2024","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.1539999999999999,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":1.0609999999999999},{"interface":"front","average":{"1min":0.90400000000000003,"5min":0.89200000000000002,"15min":0.89000000000000001},"min":{"1min":0.505,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.2529999999999999,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":0.92100000000000004}]}]},{"osd":3,"up_from":13,"seq":55834574922,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":74936,"kb_used_data":3620,"kb_used_omap":1,"kb_used_meta":71294,"kb_avail":94296904,"statfs":{"total":96636764160,"available":96560029696,"internally_reserved":0,"allocated":3706880,"data_stored":1857127,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":73005512},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 06:44:15 2024","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.56100000000000005,"15min":0.56899999999999995},"min":{"1min":0.24199999999999999,"5min":0.191,"15min":0.191},"max":{"1min":1.51,"5min":1.51,"15min":1.51},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.60599999999999998,"15min":0.65400000000000003},"min":{"1min":0.307,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.88900000000000001,"5min":1.2789999999999999,"15min":1.2789999999999999},"last":0.38600000000000001}]},{"osd":1,"last update":"Fri Sep 13 06:44:15 2024","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.54900000000000004,"15min":0.58599999999999997},"min":{"1min":0.29499999999999998,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.85399999999999998,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.33300000000000002},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.59999999999999998,"15min":0.66800000000000004},"min":{"1min":0.27700000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":1.607,"5min":1.607,"15min":1.607},"last":0.41699999999999998}]},{"osd":2,"last update":"Fri Sep 13 06:44:15 2024","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.629,"15min":0.65200000000000002},"min":{"1min":0.30199999999999999,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":1.5660000000000001,"5min":1.5660000000000001,"15min":1.5660000000000001},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.59799999999999998,"15min":0.627},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":1.135,"5min":1.409,"15min":1.409},"last":0.39800000000000002}]},{"osd":4,"last update":"Fri Sep 13 06:44:15 2024","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.82599999999999996,"15min":0.89400000000000002},"min":{"1min":0.42899999999999999,"5min":0.377,"15min":0.377},"max":{"1min":1.651,"5min":1.7929999999999999,"15min":1.7929999999999999},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.76300000000000001,"15min":0.78300000000000003},"min":{"1min":0.44700000000000001,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.96499999999999997,"5min":1.3240000000000001,"15min":1.3240000000000001},"last":0.73599999999999999}]},{"osd":5,"last update":"Fri Sep 13 06:44:15 2024","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":0.81200000000000006,"15min":0.84999999999999998},"min":{"1min":0.48799999999999999,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.3029999999999999,"5min":1.3799999999999999,"15min":1.3799999999999999},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.83099999999999996,"5min":0.82499999999999996,"15min":0.85999999999999999},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.4610000000000001,"5min":1.4610000000000001,"15min":1.4610000000000001},"last":0.71999999999999997}]},{"osd":6,"last update":"Fri Sep 13 06:42:11 2024","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.88500000000000001,"15min":0.91100000000000003},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.135,"5min":1.532,"15min":1.532},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.95299999999999996,"15min":0.98999999999999999},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.2250000000000001,"5min":1.825,"15min":1.825},"last":0.78800000000000003}]},{"osd":7,"last update":"Fri Sep 13 06:44:35 2024","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.89300000000000002,"15min":0.89800000000000002},"min":{"1min":0.57199999999999995,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.3009999999999999,"5min":1.3799999999999999,"15min":1.3799999999999999},"last":0.91600000000000004},{"interface":"front","average":{"1min":0.93000000000000005,"5min":0.95799999999999996,"15min":0.96199999999999997},"min":{"1min":0.58799999999999997,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.4219999999999999,"5min":2.0459999999999998,"15min":2.0459999999999998},"last":0.879}]}]},{"osd":2,"up_from":13,"seq":55834574919,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60980,"kb_used_data":3620,"kb_used_omap":1,"kb_used_meta":57342,"kb_avail":94310860,"statfs":{"total":96636764160,"available":96574320640,"internally_reserved":0,"allocated":3706880,"data_stored":1857127,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":58718662},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 06:44:20 2024","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.66800000000000004,"15min":0.56200000000000006},"min":{"1min":0.19400000000000001,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.84199999999999997,"5min":8.6449999999999996,"15min":8.6449999999999996},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.65200000000000002,"15min":0.61099999999999999},"min":{"1min":0.30299999999999999,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":1.4410000000000001,"5min":4.0380000000000003,"15min":4.0380000000000003},"last":0.34499999999999997}]},{"osd":1,"last update":"Fri Sep 13 06:44:20 2024","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.64000000000000001,"15min":0.62},"min":{"1min":0.25,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":1.0329999999999999,"5min":3.4649999999999999,"15min":3.4649999999999999},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.66600000000000004,"15min":0.60299999999999998},"min":{"1min":0.34300000000000003,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":1.5049999999999999,"5min":3.8159999999999998,"15min":3.8159999999999998},"last":0.439}]},{"osd":3,"last update":"Fri Sep 13 06:44:20 2024","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.65000000000000002,"15min":0.58599999999999997},"min":{"1min":0.36399999999999999,"5min":0.249,"15min":0.249},"max":{"1min":1.044,"5min":3.407,"15min":3.407},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.73599999999999999,"15min":0.68600000000000005},"min":{"1min":0.312,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.238,"5min":3.2639999999999998,"15min":3.2639999999999998},"last":0.76900000000000002}]},{"osd":4,"last update":"Fri Sep 13 06:44:20 2024","interfaces":[{"interface":"back","average":{"1min":0.83299999999999996,"5min":0.878,"15min":0.88500000000000001},"min":{"1min":0.45600000000000002,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.3759999999999999,"5min":3.1179999999999999,"15min":3.1179999999999999},"last":0.86299999999999999},{"interface":"front","average":{"1min":0.81399999999999995,"5min":1.0620000000000001,"15min":0.94099999999999995},"min":{"1min":0.46800000000000003,"5min":0.439,"15min":0.439},"max":{"1min":1.359,"5min":21.081,"15min":21.081},"last":0.53600000000000003}]},{"osd":5,"last update":"Fri Sep 13 06:44:20 2024","interfaces":[{"interface":"back","average":{"1min":0.82999999999999996,"5min":0.84799999999999998,"15min":0.84299999999999997},"min":{"1min":0.60099999999999998,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":1.143,"5min":2.2389999999999999,"15min":2.2389999999999999},"last":0.89800000000000002},{"interface":"front","average":{"1min":1.133,"5min":0.96099999999999997,"15min":0.88900000000000001},"min":{"1min":0.54400000000000004,"5min":0.377,"15min":0.377},"max":{"1min":4.9039999999999999,"5min":4.9039999999999999,"15min":4.9039999999999999},"last":0.93799999999999994}]},{"osd":6,"last update":"Fri Sep 13 06:42:15 2024","interfaces":[{"interface":"back","average":{"1min":0.86799999999999999,"5min":0.94199999999999995,"15min":0.92600000000000005},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.274,"5min":3.923,"15min":3.923},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.97799999999999998,"5min":0.90500000000000003,"15min":0.879},"min":{"1min":0.60899999999999999,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":2.2080000000000002,"5min":2.2120000000000002,"15min":2.2120000000000002},"last":0.96999999999999997}]},{"osd":7,"last update":"Fri Sep 13 06:44:33 2024","interfaces":[{"interface":"back","average":{"1min":0.95799999999999996,"5min":0.86499999999999999,"15min":0.84899999999999998},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":1.641,"5min":1.641,"15min":1.641},"last":0.69299999999999995},{"interface":"front","average":{"1min":1.05,"5min":0.88600000000000001,"15min":0.85799999999999998},"min":{"1min":0.71499999999999997,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":2.0630000000000002,"5min":2.0630000000000002,"15min":2.0630000000000002},"last":0.82999999999999996}]}]},{"osd":1,"up_from":13,"seq":55834574919,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52792,"kb_used_data":3624,"kb_used_omap":1,"kb_used_meta":49150,"kb_avail":94319048,"statfs":{"total":96636764160,"available":96582705152,"internally_reserved":0,"allocated":3710976,"data_stored":1856593,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":50330054},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 06:44:21 2024","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.55300000000000005,"15min":0.57299999999999995},"min":{"1min":0.246,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":1.1879999999999999,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.64200000000000002,"15min":0.65900000000000003},"min":{"1min":0.26200000000000001,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.99199999999999999,"5min":1.8160000000000001,"15min":1.8160000000000001},"last":0.69099999999999995}]},{"osd":2,"last update":"Fri Sep 13 06:44:21 2024","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.60699999999999998,"15min":0.63400000000000001},"min":{"1min":0.26800000000000002,"5min":0.22,"15min":0.22},"max":{"1min":0.92200000000000004,"5min":2.617,"15min":2.617},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.65300000000000002,"15min":0.65400000000000003},"min":{"1min":0.28499999999999998,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":1.331,"5min":2.5249999999999999,"15min":2.5249999999999999},"last":0.55800000000000005}]},{"osd":3,"last update":"Fri Sep 13 06:44:21 2024","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.70499999999999996,"15min":0.72599999999999998},"min":{"1min":0.33900000000000002,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":1.2769999999999999,"5min":1.3640000000000001,"15min":1.3640000000000001},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.66700000000000004,"15min":0.69099999999999995},"min":{"1min":0.30399999999999999,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":1.028,"5min":1.752,"15min":1.752},"last":0.61199999999999999}]},{"osd":4,"last update":"Fri Sep 13 06:44:21 2024","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.79800000000000004,"15min":0.81999999999999995},"min":{"1min":0.60899999999999999,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":1.109,"5min":2.7389999999999999,"15min":2.7389999999999999},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.94499999999999995,"5min":0.85499999999999998,"15min":0.90600000000000003},"min":{"1min":0.40000000000000002,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.4159999999999999,"5min":1.4359999999999999,"15min":1.4359999999999999},"last":0.78900000000000003}]},{"osd":5,"last update":"Fri Sep 13 06:44:21 2024","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.84499999999999997,"15min":0.90600000000000003},"min":{"1min":0.58099999999999996,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.1399999999999999,"5min":1.7849999999999999,"15min":1.7849999999999999},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.89600000000000002,"5min":0.86599999999999999,"15min":0.879},"min":{"1min":0.495,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":1.202,"5min":2.036,"15min":2.036},"last":0.85099999999999998}]},{"osd":6,"last update":"Fri Sep 13 06:42:18 2024","interfaces":[{"interface":"back","average":{"1min":0.87,"5min":0.92200000000000004,"15min":0.94399999999999995},"min":{"1min":0.57699999999999996,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.526,"5min":1.8149999999999999,"15min":1.8149999999999999},"last":0.83799999999999997},{"interface":"front","average":{"1min":0.88900000000000001,"5min":0.91200000000000003,"15min":0.91900000000000004},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":2.7810000000000001,"5min":2.7810000000000001,"15min":2.7810000000000001},"last":0.80900000000000005}]},{"osd":7,"last update":"Fri Sep 13 06:44:33 2024","interfaces":[{"interface":"back","average":{"1min":0.91900000000000004,"5min":0.90600000000000003,"15min":0.90400000000000003},"min":{"1min":0.621,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":1.3220000000000001,"5min":1.605,"15min":1.605},"last":0.76600000000000001},{"interface":"front","average":{"1min":1.054,"5min":0.93899999999999995,"15min":0.92000000000000004},"min":{"1min":0.61099999999999999,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.5009999999999999,"5min":1.5009999999999999,"15min":1.5009999999999999},"last":0.752}]}]},{"osd":0,"up_from":13,"seq":55834574918,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":85364,"kb_used_data":4196,"kb_used_omap":1,"kb_used_meta":81150,"kb_avail":94286476,"statfs":{"total":96636764160,"available":96549351424,"internally_reserved":0,"allocated":4296704,"data_stored":2446923,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":83098054},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 06:44:11 2024","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.54900000000000004,"15min":0.53000000000000003},"min":{"1min":0.23999999999999999,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":1.048,"5min":1.2270000000000001,"15min":1.2270000000000001},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.56000000000000005,"15min":0.54000000000000004},"min":{"1min":0.28799999999999998,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":1.137,"5min":1.222,"15min":1.222},"last":0.63500000000000001}]},{"osd":2,"last update":"Fri Sep 13 06:44:11 2024","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.60399999999999998,"15min":0.55600000000000005},"min":{"1min":0.27300000000000002,"5min":0.217,"15min":0.217},"max":{"1min":1.2549999999999999,"5min":1.839,"15min":1.839},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.61299999999999999,"15min":0.57499999999999996},"min":{"1min":0.35399999999999998,"5min":0.245,"15min":0.245},"max":{"1min":1.419,"5min":1.419,"15min":1.419},"last":0.501}]},{"osd":3,"last update":"Fri Sep 13 06:44:11 2024","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.59999999999999998,"15min":0.55800000000000005},"min":{"1min":0.371,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":1.2250000000000001,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.74299999999999999,"15min":0.69899999999999995},"min":{"1min":0.36699999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":1.175,"5min":4.9630000000000001,"15min":4.9630000000000001},"last":0.47099999999999997}]},{"osd":4,"last update":"Fri Sep 13 06:44:11 2024","interfaces":[{"interface":"back","average":{"1min":0.89400000000000002,"5min":0.80400000000000005,"15min":0.79400000000000004},"min":{"1min":0.57899999999999996,"5min":0.311,"15min":0.311},"max":{"1min":1.6259999999999999,"5min":1.6259999999999999,"15min":1.6259999999999999},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.77400000000000002,"15min":0.79600000000000004},"min":{"1min":0.58999999999999997,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.1799999999999999,"5min":1.6319999999999999,"15min":1.6319999999999999},"last":0.80100000000000005}]},{"osd":5,"last update":"Fri Sep 13 06:44:11 2024","interfaces":[{"interface":"back","average":{"1min":0.89900000000000002,"5min":0.85799999999999998,"15min":0.85199999999999998},"min":{"1min":0.52800000000000002,"5min":0.378,"15min":0.378},"max":{"1min":1.575,"5min":1.575,"15min":1.575},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.89100000000000001,"5min":0.85699999999999998,"15min":0.87},"min":{"1min":0.60199999999999998,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.327,"5min":1.5740000000000001,"15min":1.5740000000000001},"last":0.748}]},{"osd":6,"last update":"Fri Sep 13 06:42:11 2024","interfaces":[{"interface":"back","average":{"1min":0.89800000000000002,"5min":0.91200000000000003,"15min":0.93100000000000005},"min":{"1min":0.55300000000000005,"5min":0.499,"15min":0.499},"max":{"1min":1.571,"5min":2.4969999999999999,"15min":2.4969999999999999},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.878,"5min":0.89600000000000002,"15min":0.90600000000000003},"min":{"1min":0.51800000000000002,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.208,"5min":2.0419999999999998,"15min":2.0419999999999998},"last":0.78800000000000003}]},{"osd":7,"last update":"Fri Sep 13 06:44:31 2024","interfaces":[{"interface":"back","average":{"1min":0.97799999999999998,"5min":1.0529999999999999,"15min":1.0649999999999999},"min":{"1min":0.57799999999999996,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.381,"5min":1.9419999999999999,"15min":1.9419999999999999},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.97899999999999998,"5min":0.96999999999999997,"15min":0.96799999999999997},"min":{"1min":0.64100000000000001,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.4750000000000001,"5min":1.901,"15min":1.901},"last":0.82199999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6552,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8096,"internal_metadata":0}]}} 2024-09-13T06:44:48.016 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-09-13T06:39:26.336261+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=39, tm_sec=26, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=44, tm_sec=43, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:44:48.016 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-09-13T06:39:26.336261+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=39, tm_sec=26, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=44, tm_sec=43, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:44:48.016 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-09-13T06:39:26.336261+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=39, tm_sec=26, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=44, tm_sec=43, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:44:48.016 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-09-13T06:39:26.336261+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=39, tm_sec=26, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=44, tm_sec=43, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:44:48.016 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-09-13T06:39:26.336261+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=39, tm_sec=26, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=44, tm_sec=43, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:44:48.016 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-09-13T06:39:26.336261+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=39, tm_sec=26, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=44, tm_sec=43, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:44:48.016 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-09-13T06:39:26.336261+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=39, tm_sec=26, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=44, tm_sec=43, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:44:48.017 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-09-13T06:39:26.336261+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=39, tm_sec=26, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=44, tm_sec=43, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:44:48.017 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-09-13T06:39:26.336261+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=39, tm_sec=26, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=44, tm_sec=43, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:44:48.017 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-09-13T06:39:26.336261+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=39, tm_sec=26, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=44, tm_sec=43, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:44:48.017 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-09-13T06:39:26.336261+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=39, tm_sec=26, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=44, tm_sec=43, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:44:48.017 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-09-13T06:39:26.336261+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=39, tm_sec=26, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=44, tm_sec=43, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:44:48.017 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-09-13T06:39:16.508974+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=39, tm_sec=16, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=44, tm_sec=43, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:44:48.018 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-09-13T06:39:26.336261+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=39, tm_sec=26, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=44, tm_sec=43, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:44:48.018 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-09-13T06:39:16.508974+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=39, tm_sec=16, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=44, tm_sec=43, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:44:48.018 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-09-13T06:39:26.336261+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=39, tm_sec=26, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=44, tm_sec=43, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:44:48.018 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-09-13T06:39:16.508974+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=39, tm_sec=16, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=44, tm_sec=43, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:44:48.018 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-09-13T06:39:26.336261+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=39, tm_sec=26, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=44, tm_sec=43, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:44:48.018 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-09-13T06:39:16.508974+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=39, tm_sec=16, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=44, tm_sec=43, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:44:48.018 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-09-13T06:39:26.336261+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=39, tm_sec=26, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=44, tm_sec=43, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:44:48.018 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-09-13T06:39:26.336261+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=39, tm_sec=26, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=44, tm_sec=43, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:44:48.019 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-09-13T06:39:16.508974+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=39, tm_sec=16, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=44, tm_sec=43, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:44:48.019 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-09-13T06:39:26.336261+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=39, tm_sec=26, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=44, tm_sec=43, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:44:48.019 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-09-13T06:39:16.508974+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=39, tm_sec=16, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=44, tm_sec=43, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:44:48.019 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-09-13T06:39:26.336261+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=39, tm_sec=26, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=44, tm_sec=43, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:44:48.019 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-09-13T06:39:16.508974+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=39, tm_sec=16, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=44, tm_sec=43, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:44:48.019 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-09-13T06:39:26.336261+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=39, tm_sec=26, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=44, tm_sec=43, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:44:48.020 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-09-13T06:39:16.508974+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=39, tm_sec=16, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=44, tm_sec=43, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:44:48.020 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-13T06:39:10.110558+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=39, tm_sec=10, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=44, tm_sec=43, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:44:48.020 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-09-13T06:39:26.336261+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=39, tm_sec=26, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=44, tm_sec=43, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:44:48.020 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-09-13T06:39:26.336261+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=39, tm_sec=26, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=44, tm_sec=43, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:44:48.021 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-09-13T06:39:26.336261+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=39, tm_sec=26, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=44, tm_sec=43, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:44:48.021 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-09-13T06:39:26.336261+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=39, tm_sec=26, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=44, tm_sec=43, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:44:48.021 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-09-13T06:39:26.336261+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=39, tm_sec=26, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=44, tm_sec=43, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:44:48.021 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-09-13T06:39:26.336261+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=39, tm_sec=26, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=44, tm_sec=43, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:44:48.022 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-09-13T06:39:26.336261+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=39, tm_sec=26, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=44, tm_sec=43, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:44:48.022 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-09-13T06:39:26.336261+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=39, tm_sec=26, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=44, tm_sec=43, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:44:48.022 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-09-13T06:39:26.336261+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=39, tm_sec=26, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=44, tm_sec=43, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:44:48.022 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-09-13T06:39:26.336261+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=39, tm_sec=26, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=44, tm_sec=43, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:44:48.022 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-09-13T06:39:26.336261+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=39, tm_sec=26, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=44, tm_sec=43, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:44:48.023 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-09-13T06:39:26.336261+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=39, tm_sec=26, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=44, tm_sec=43, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:44:48.023 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-13T06:45:08.024 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T06:45:08.328 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T06:45:08.329 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-09-13T06:45:08.344 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":477,"stamp":"2024-09-13T06:45:07.618518+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590406,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":237398,"num_read_kb":1402962,"num_write":33483,"num_write_kb":1011328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9257,"num_bytes_recovered":444809309,"num_keys_recovered":867,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":24610,"ondisk_log_size":24610,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":486568,"kb_used_data":30120,"kb_used_omap":26,"kb_used_meta":456357,"kb_avail":754488152,"statfs":{"total":773094113280,"available":772595867648,"internally_reserved":0,"allocated":30842880,"data_stored":16035540,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":27392,"internal_metadata":467309824},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003892"},"pg_stats":[{"pgid":"3.1f","version":"280'781","reported_seq":6299,"reported_epoch":305,"state":"active+clean","last_fresh":"2024-09-13T06:44:46.378439+0000","last_change":"2024-09-13T06:44:46.378523+0000","last_active":"2024-09-13T06:44:46.378439+0000","last_peered":"2024-09-13T06:44:46.378439+0000","last_clean":"2024-09-13T06:44:46.378439+0000","last_became_active":"2024-09-13T06:40:57.385213+0000","last_became_peered":"2024-09-13T06:40:57.385213+0000","last_unstale":"2024-09-13T06:44:46.378439+0000","last_undegraded":"2024-09-13T06:44:46.378439+0000","last_fullsized":"2024-09-13T06:44:46.378439+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"280'781","last_scrub_stamp":"2024-09-13T06:44:46.378420+0000","last_deep_scrub":"280'781","last_deep_scrub_stamp":"2024-09-13T06:44:46.378420+0000","last_clean_scrub_stamp":"2024-09-13T06:44:46.378420+0000","objects_scrubbed":0,"log_size":781,"log_dups_size":0,"ondisk_log_size":781,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:36:51.432129+0000","scrub_duration":0.002758277,"objects_trimmed":0,"snaptrim_duration":0.00056495999999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6518,"num_read_kb":34199,"num_write":1043,"num_write_kb":37100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":72,"num_bytes_recovered":6114482,"num_keys_recovered":44,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"271'1110","reported_seq":7434,"reported_epoch":305,"state":"active+clean","last_fresh":"2024-09-13T06:44:54.010683+0000","last_change":"2024-09-13T06:44:54.010916+0000","last_active":"2024-09-13T06:44:54.010683+0000","last_peered":"2024-09-13T06:44:54.010683+0000","last_clean":"2024-09-13T06:44:54.010683+0000","last_became_active":"2024-09-13T06:44:20.460702+0000","last_became_peered":"2024-09-13T06:44:20.460702+0000","last_unstale":"2024-09-13T06:44:54.010683+0000","last_undegraded":"2024-09-13T06:44:54.010683+0000","last_fullsized":"2024-09-13T06:44:54.010683+0000","mapping_epoch":290,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":291,"parent":"0.0","parent_split_bits":0,"last_scrub":"271'1110","last_scrub_stamp":"2024-09-13T06:44:54.010626+0000","last_deep_scrub":"271'1110","last_deep_scrub_stamp":"2024-09-13T06:44:54.010626+0000","last_clean_scrub_stamp":"2024-09-13T06:44:54.010626+0000","objects_scrubbed":0,"log_size":1110,"log_dups_size":0,"ondisk_log_size":1110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:16:23.356449+0000","scrub_duration":0.0038375079999999999,"objects_trimmed":0,"snaptrim_duration":0.0013343369999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8806,"num_read_kb":55237,"num_write":1632,"num_write_kb":29160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":491,"num_bytes_recovered":16489974,"num_keys_recovered":55,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"279'1047","reported_seq":5668,"reported_epoch":305,"state":"active+clean","last_fresh":"2024-09-13T06:44:50.225863+0000","last_change":"2024-09-13T06:44:50.226163+0000","last_active":"2024-09-13T06:44:50.225863+0000","last_peered":"2024-09-13T06:44:50.225863+0000","last_clean":"2024-09-13T06:44:50.225863+0000","last_became_active":"2024-09-13T06:44:30.803142+0000","last_became_peered":"2024-09-13T06:44:30.803142+0000","last_unstale":"2024-09-13T06:44:50.225863+0000","last_undegraded":"2024-09-13T06:44:50.225863+0000","last_fullsized":"2024-09-13T06:44:50.225863+0000","mapping_epoch":300,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":301,"parent":"0.0","parent_split_bits":0,"last_scrub":"279'1047","last_scrub_stamp":"2024-09-13T06:44:50.225808+0000","last_deep_scrub":"279'1047","last_deep_scrub_stamp":"2024-09-13T06:44:50.225808+0000","last_clean_scrub_stamp":"2024-09-13T06:44:50.225808+0000","objects_scrubbed":0,"log_size":1047,"log_dups_size":0,"ondisk_log_size":1047,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:21:28.074287+0000","scrub_duration":0.0042489160000000002,"objects_trimmed":0,"snaptrim_duration":0.00088262599999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6265,"num_read_kb":28067,"num_write":1605,"num_write_kb":33265,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":206,"num_bytes_recovered":8442088,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1c","version":"280'843","reported_seq":8396,"reported_epoch":305,"state":"active+clean","last_fresh":"2024-09-13T06:44:34.866562+0000","last_change":"2024-09-13T06:44:30.807782+0000","last_active":"2024-09-13T06:44:34.866562+0000","last_peered":"2024-09-13T06:44:34.866562+0000","last_clean":"2024-09-13T06:44:34.866562+0000","last_became_active":"2024-09-13T06:44:30.801783+0000","last_became_peered":"2024-09-13T06:44:30.801783+0000","last_unstale":"2024-09-13T06:44:34.866562+0000","last_undegraded":"2024-09-13T06:44:34.866562+0000","last_fullsized":"2024-09-13T06:44:34.866562+0000","mapping_epoch":300,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":301,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":843,"log_dups_size":0,"ondisk_log_size":843,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001581236,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9390,"num_read_kb":69964,"num_write":963,"num_write_kb":31840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":350,"num_bytes_recovered":42380134,"num_keys_recovered":286,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"277'852","reported_seq":5183,"reported_epoch":305,"state":"active+clean","last_fresh":"2024-09-13T06:44:54.343402+0000","last_change":"2024-09-13T06:44:54.343728+0000","last_active":"2024-09-13T06:44:54.343402+0000","last_peered":"2024-09-13T06:44:54.343402+0000","last_clean":"2024-09-13T06:44:54.343402+0000","last_became_active":"2024-09-13T06:43:31.415608+0000","last_became_peered":"2024-09-13T06:43:31.415608+0000","last_unstale":"2024-09-13T06:44:54.343402+0000","last_undegraded":"2024-09-13T06:44:54.343402+0000","last_fullsized":"2024-09-13T06:44:54.343402+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"277'852","last_scrub_stamp":"2024-09-13T06:44:54.343349+0000","last_deep_scrub":"277'852","last_deep_scrub_stamp":"2024-09-13T06:44:54.343349+0000","last_clean_scrub_stamp":"2024-09-13T06:44:54.343349+0000","objects_scrubbed":0,"log_size":852,"log_dups_size":0,"ondisk_log_size":852,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:43:36.373684+0000","scrub_duration":0.0039275239999999999,"objects_trimmed":0,"snaptrim_duration":0.00060857399999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5714,"num_read_kb":37037,"num_write":1079,"num_write_kb":33376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":295,"num_bytes_recovered":25415745,"num_keys_recovered":55,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"305'498","reported_seq":7770,"reported_epoch":305,"state":"active+clean","last_fresh":"2024-09-13T06:44:47.710656+0000","last_change":"2024-09-13T06:44:47.710917+0000","last_active":"2024-09-13T06:44:47.710656+0000","last_peered":"2024-09-13T06:44:47.710656+0000","last_clean":"2024-09-13T06:44:47.710656+0000","last_became_active":"2024-09-13T06:44:20.462185+0000","last_became_peered":"2024-09-13T06:44:20.462185+0000","last_unstale":"2024-09-13T06:44:47.710656+0000","last_undegraded":"2024-09-13T06:44:47.710656+0000","last_fullsized":"2024-09-13T06:44:47.710656+0000","mapping_epoch":290,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":291,"parent":"0.0","parent_split_bits":0,"last_scrub":"305'498","last_scrub_stamp":"2024-09-13T06:44:47.710602+0000","last_deep_scrub":"305'498","last_deep_scrub_stamp":"2024-09-13T06:44:47.710602+0000","last_clean_scrub_stamp":"2024-09-13T06:44:47.710602+0000","objects_scrubbed":1,"log_size":498,"log_dups_size":0,"ondisk_log_size":498,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:43:44.349737+0000","scrub_duration":0.0053964130000000001,"objects_trimmed":0,"snaptrim_duration":0.00078923399999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6439,"num_read_kb":42977,"num_write":667,"num_write_kb":32420,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":728,"num_bytes_recovered":12986751,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"275'680","reported_seq":8582,"reported_epoch":305,"state":"active+clean","last_fresh":"2024-09-13T06:45:00.297053+0000","last_change":"2024-09-13T06:45:00.297277+0000","last_active":"2024-09-13T06:45:00.297053+0000","last_peered":"2024-09-13T06:45:00.297053+0000","last_clean":"2024-09-13T06:45:00.297053+0000","last_became_active":"2024-09-13T06:44:21.442872+0000","last_became_peered":"2024-09-13T06:44:21.442872+0000","last_unstale":"2024-09-13T06:45:00.297053+0000","last_undegraded":"2024-09-13T06:45:00.297053+0000","last_fullsized":"2024-09-13T06:45:00.297053+0000","mapping_epoch":291,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":292,"parent":"0.0","parent_split_bits":0,"last_scrub":"275'680","last_scrub_stamp":"2024-09-13T06:45:00.296999+0000","last_deep_scrub":"275'680","last_deep_scrub_stamp":"2024-09-13T06:45:00.296999+0000","last_clean_scrub_stamp":"2024-09-13T06:45:00.296999+0000","objects_scrubbed":0,"log_size":680,"log_dups_size":0,"ondisk_log_size":680,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:39:13.675929+0000","scrub_duration":0.0033395040000000001,"objects_trimmed":0,"snaptrim_duration":0.00079955100000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8400,"num_read_kb":35906,"num_write":738,"num_write_kb":28560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":398,"num_bytes_recovered":17539742,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"272'684","reported_seq":7058,"reported_epoch":305,"state":"active+clean","last_fresh":"2024-09-13T06:44:51.086838+0000","last_change":"2024-09-13T06:44:51.087089+0000","last_active":"2024-09-13T06:44:51.086838+0000","last_peered":"2024-09-13T06:44:51.086838+0000","last_clean":"2024-09-13T06:44:51.086838+0000","last_became_active":"2024-09-13T06:41:14.395301+0000","last_became_peered":"2024-09-13T06:41:14.395301+0000","last_unstale":"2024-09-13T06:44:51.086838+0000","last_undegraded":"2024-09-13T06:44:51.086838+0000","last_fullsized":"2024-09-13T06:44:51.086838+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"272'684","last_scrub_stamp":"2024-09-13T06:44:51.086786+0000","last_deep_scrub":"272'684","last_deep_scrub_stamp":"2024-09-13T06:44:51.086786+0000","last_clean_scrub_stamp":"2024-09-13T06:44:51.086786+0000","objects_scrubbed":0,"log_size":684,"log_dups_size":0,"ondisk_log_size":684,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:32:39.273971+0000","scrub_duration":0.0040833859999999996,"objects_trimmed":0,"snaptrim_duration":0.00092758900000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6571,"num_read_kb":55194,"num_write":838,"num_write_kb":38872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":117,"num_bytes_recovered":13142180,"num_keys_recovered":22,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"275'1525","reported_seq":5972,"reported_epoch":305,"state":"active+clean","last_fresh":"2024-09-13T06:44:53.358765+0000","last_change":"2024-09-13T06:44:53.359002+0000","last_active":"2024-09-13T06:44:53.358765+0000","last_peered":"2024-09-13T06:44:53.358765+0000","last_clean":"2024-09-13T06:44:53.358765+0000","last_became_active":"2024-09-13T06:43:22.521039+0000","last_became_peered":"2024-09-13T06:43:22.521039+0000","last_unstale":"2024-09-13T06:44:53.358765+0000","last_undegraded":"2024-09-13T06:44:53.358765+0000","last_fullsized":"2024-09-13T06:44:53.358765+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"275'1525","last_scrub_stamp":"2024-09-13T06:44:53.358711+0000","last_deep_scrub":"275'1525","last_deep_scrub_stamp":"2024-09-13T06:44:53.358711+0000","last_clean_scrub_stamp":"2024-09-13T06:44:53.358711+0000","objects_scrubbed":0,"log_size":1525,"log_dups_size":0,"ondisk_log_size":1525,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:51:26.451347+0000","scrub_duration":0.0041147739999999999,"objects_trimmed":0,"snaptrim_duration":0.00029931499999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9655,"num_read_kb":41824,"num_write":2232,"num_write_kb":32733,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":112,"num_bytes_recovered":14950263,"num_keys_recovered":22,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"275'715","reported_seq":5277,"reported_epoch":305,"state":"active+clean","last_fresh":"2024-09-13T06:44:34.866285+0000","last_change":"2024-09-13T06:44:30.806149+0000","last_active":"2024-09-13T06:44:34.866285+0000","last_peered":"2024-09-13T06:44:34.866285+0000","last_clean":"2024-09-13T06:44:34.866285+0000","last_became_active":"2024-09-13T06:44:30.798028+0000","last_became_peered":"2024-09-13T06:44:30.798028+0000","last_unstale":"2024-09-13T06:44:34.866285+0000","last_undegraded":"2024-09-13T06:44:34.866285+0000","last_fullsized":"2024-09-13T06:44:34.866285+0000","mapping_epoch":300,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":301,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":715,"log_dups_size":0,"ondisk_log_size":715,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0024960030000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5101,"num_read_kb":28279,"num_write":1028,"num_write_kb":23183,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":197,"num_bytes_recovered":7394092,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"277'365","reported_seq":6175,"reported_epoch":305,"state":"active+clean","last_fresh":"2024-09-13T06:44:47.700628+0000","last_change":"2024-09-13T06:44:05.457231+0000","last_active":"2024-09-13T06:44:47.700628+0000","last_peered":"2024-09-13T06:44:47.700628+0000","last_clean":"2024-09-13T06:44:47.700628+0000","last_became_active":"2024-09-13T06:42:33.408009+0000","last_became_peered":"2024-09-13T06:42:33.408009+0000","last_unstale":"2024-09-13T06:44:47.700628+0000","last_undegraded":"2024-09-13T06:44:47.700628+0000","last_fullsized":"2024-09-13T06:44:47.700628+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":365,"log_dups_size":0,"ondisk_log_size":365,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0024654690000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5036,"num_read_kb":48021,"num_write":472,"num_write_kb":27276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":157,"num_bytes_recovered":13242563,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"280'579","reported_seq":9972,"reported_epoch":305,"state":"active+clean","last_fresh":"2024-09-13T06:44:52.694031+0000","last_change":"2024-09-13T06:44:52.694333+0000","last_active":"2024-09-13T06:44:52.694031+0000","last_peered":"2024-09-13T06:44:52.694031+0000","last_clean":"2024-09-13T06:44:52.694031+0000","last_became_active":"2024-09-13T06:44:03.438897+0000","last_became_peered":"2024-09-13T06:44:03.438897+0000","last_unstale":"2024-09-13T06:44:52.694031+0000","last_undegraded":"2024-09-13T06:44:52.694031+0000","last_fullsized":"2024-09-13T06:44:52.694031+0000","mapping_epoch":277,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":278,"parent":"0.0","parent_split_bits":0,"last_scrub":"280'579","last_scrub_stamp":"2024-09-13T06:44:52.693977+0000","last_deep_scrub":"280'579","last_deep_scrub_stamp":"2024-09-13T06:44:52.693977+0000","last_clean_scrub_stamp":"2024-09-13T06:44:52.693977+0000","objects_scrubbed":0,"log_size":579,"log_dups_size":0,"ondisk_log_size":579,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:13:33.654445+0000","scrub_duration":0.0038818189999999999,"objects_trimmed":0,"snaptrim_duration":0.0012901029999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8875,"num_read_kb":61758,"num_write":769,"num_write_kb":30278,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":506,"num_bytes_recovered":26184965,"num_keys_recovered":33,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":39,"reported_epoch":305,"state":"active+clean","last_fresh":"2024-09-13T06:44:51.064312+0000","last_change":"2024-09-13T06:44:51.064528+0000","last_active":"2024-09-13T06:44:51.064312+0000","last_peered":"2024-09-13T06:44:51.064312+0000","last_clean":"2024-09-13T06:44:51.064312+0000","last_became_active":"2024-09-13T06:44:16.449558+0000","last_became_peered":"2024-09-13T06:44:16.449558+0000","last_unstale":"2024-09-13T06:44:51.064312+0000","last_undegraded":"2024-09-13T06:44:51.064312+0000","last_fullsized":"2024-09-13T06:44:51.064312+0000","mapping_epoch":286,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":287,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:44:51.064263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:44:51.064263+0000","last_clean_scrub_stamp":"2024-09-13T06:44:51.064263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:19:23.848694+0000","scrub_duration":0.0030511409999999998,"objects_trimmed":0,"snaptrim_duration":0.00080324699999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"280'643","reported_seq":10772,"reported_epoch":305,"state":"active+clean","last_fresh":"2024-09-13T06:44:56.339062+0000","last_change":"2024-09-13T06:44:56.339345+0000","last_active":"2024-09-13T06:44:56.339062+0000","last_peered":"2024-09-13T06:44:56.339062+0000","last_clean":"2024-09-13T06:44:56.339062+0000","last_became_active":"2024-09-13T06:44:22.449195+0000","last_became_peered":"2024-09-13T06:44:22.449195+0000","last_unstale":"2024-09-13T06:44:56.339062+0000","last_undegraded":"2024-09-13T06:44:56.339062+0000","last_fullsized":"2024-09-13T06:44:56.339062+0000","mapping_epoch":292,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":293,"parent":"0.0","parent_split_bits":0,"last_scrub":"280'643","last_scrub_stamp":"2024-09-13T06:44:56.339007+0000","last_deep_scrub":"280'643","last_deep_scrub_stamp":"2024-09-13T06:44:56.339007+0000","last_clean_scrub_stamp":"2024-09-13T06:44:56.339007+0000","objects_scrubbed":0,"log_size":643,"log_dups_size":0,"ondisk_log_size":643,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:49:08.541338+0000","scrub_duration":0.0041333009999999998,"objects_trimmed":0,"snaptrim_duration":0.00080400600000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9397,"num_read_kb":51433,"num_write":883,"num_write_kb":40908,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":358,"num_bytes_recovered":1257624,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":36,"reported_epoch":305,"state":"active+clean","last_fresh":"2024-09-13T06:44:49.375451+0000","last_change":"2024-09-13T06:44:49.375674+0000","last_active":"2024-09-13T06:44:49.375451+0000","last_peered":"2024-09-13T06:44:49.375451+0000","last_clean":"2024-09-13T06:44:49.375451+0000","last_became_active":"2024-09-13T06:44:18.458454+0000","last_became_peered":"2024-09-13T06:44:18.458454+0000","last_unstale":"2024-09-13T06:44:49.375451+0000","last_undegraded":"2024-09-13T06:44:49.375451+0000","last_fullsized":"2024-09-13T06:44:49.375451+0000","mapping_epoch":288,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":289,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:44:49.375404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:44:49.375404+0000","last_clean_scrub_stamp":"2024-09-13T06:44:49.375404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:43:00.584483+0000","scrub_duration":0.0037092570000000001,"objects_trimmed":0,"snaptrim_duration":0.00097079800000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"277'694","reported_seq":7072,"reported_epoch":305,"state":"active+clean","last_fresh":"2024-09-13T06:45:01.132229+0000","last_change":"2024-09-13T06:45:01.132564+0000","last_active":"2024-09-13T06:45:01.132229+0000","last_peered":"2024-09-13T06:45:01.132229+0000","last_clean":"2024-09-13T06:45:01.132229+0000","last_became_active":"2024-09-13T06:42:32.413006+0000","last_became_peered":"2024-09-13T06:42:32.413006+0000","last_unstale":"2024-09-13T06:45:01.132229+0000","last_undegraded":"2024-09-13T06:45:01.132229+0000","last_fullsized":"2024-09-13T06:45:01.132229+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"277'694","last_scrub_stamp":"2024-09-13T06:45:01.132175+0000","last_deep_scrub":"277'694","last_deep_scrub_stamp":"2024-09-13T06:45:01.132175+0000","last_clean_scrub_stamp":"2024-09-13T06:45:01.132175+0000","objects_scrubbed":0,"log_size":694,"log_dups_size":0,"ondisk_log_size":694,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:56:06.782004+0000","scrub_duration":0.0035896259999999998,"objects_trimmed":0,"snaptrim_duration":0.001338379,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6521,"num_read_kb":33119,"num_write":812,"num_write_kb":30039,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":213,"num_bytes_recovered":15100645,"num_keys_recovered":11,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":193,"reported_epoch":305,"state":"active+clean","last_fresh":"2024-09-13T06:45:02.749503+0000","last_change":"2024-09-13T06:45:02.749797+0000","last_active":"2024-09-13T06:45:02.749503+0000","last_peered":"2024-09-13T06:45:02.749503+0000","last_clean":"2024-09-13T06:45:02.749503+0000","last_became_active":"2024-09-13T06:42:28.562827+0000","last_became_peered":"2024-09-13T06:42:28.562827+0000","last_unstale":"2024-09-13T06:45:02.749503+0000","last_undegraded":"2024-09-13T06:45:02.749503+0000","last_fullsized":"2024-09-13T06:45:02.749503+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:45:02.749451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:45:02.749451+0000","last_clean_scrub_stamp":"2024-09-13T06:45:02.749451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:09:21.603602+0000","scrub_duration":0.003504198,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"277'961","reported_seq":6903,"reported_epoch":305,"state":"active+clean","last_fresh":"2024-09-13T06:45:01.305601+0000","last_change":"2024-09-13T06:45:01.305820+0000","last_active":"2024-09-13T06:45:01.305601+0000","last_peered":"2024-09-13T06:45:01.305601+0000","last_clean":"2024-09-13T06:45:01.305601+0000","last_became_active":"2024-09-13T06:44:22.450933+0000","last_became_peered":"2024-09-13T06:44:22.450933+0000","last_unstale":"2024-09-13T06:45:01.305601+0000","last_undegraded":"2024-09-13T06:45:01.305601+0000","last_fullsized":"2024-09-13T06:45:01.305601+0000","mapping_epoch":292,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":293,"parent":"0.0","parent_split_bits":0,"last_scrub":"277'961","last_scrub_stamp":"2024-09-13T06:45:01.305551+0000","last_deep_scrub":"277'961","last_deep_scrub_stamp":"2024-09-13T06:45:01.305551+0000","last_clean_scrub_stamp":"2024-09-13T06:45:01.305551+0000","objects_scrubbed":0,"log_size":961,"log_dups_size":0,"ondisk_log_size":961,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:42:15.554591+0000","scrub_duration":0.0037257969999999999,"objects_trimmed":0,"snaptrim_duration":0.0031147280000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7705,"num_read_kb":38648,"num_write":1332,"num_write_kb":32653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":354,"num_bytes_recovered":6765835,"num_keys_recovered":11,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":36,"reported_epoch":305,"state":"active+clean","last_fresh":"2024-09-13T06:44:45.496398+0000","last_change":"2024-09-13T06:44:45.496541+0000","last_active":"2024-09-13T06:44:45.496398+0000","last_peered":"2024-09-13T06:44:45.496398+0000","last_clean":"2024-09-13T06:44:45.496398+0000","last_became_active":"2024-09-13T06:44:18.467833+0000","last_became_peered":"2024-09-13T06:44:18.467833+0000","last_unstale":"2024-09-13T06:44:45.496398+0000","last_undegraded":"2024-09-13T06:44:45.496398+0000","last_fullsized":"2024-09-13T06:44:45.496398+0000","mapping_epoch":288,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":289,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:44:45.496366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:44:45.496366+0000","last_clean_scrub_stamp":"2024-09-13T06:44:45.496366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:36:11.510118+0000","scrub_duration":0.0016611639999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"277'640","reported_seq":7756,"reported_epoch":305,"state":"active+clean","last_fresh":"2024-09-13T06:44:34.866505+0000","last_change":"2024-09-13T06:44:30.803125+0000","last_active":"2024-09-13T06:44:34.866505+0000","last_peered":"2024-09-13T06:44:34.866505+0000","last_clean":"2024-09-13T06:44:34.866505+0000","last_became_active":"2024-09-13T06:44:30.797769+0000","last_became_peered":"2024-09-13T06:44:30.797769+0000","last_unstale":"2024-09-13T06:44:34.866505+0000","last_undegraded":"2024-09-13T06:44:34.866505+0000","last_fullsized":"2024-09-13T06:44:34.866505+0000","mapping_epoch":300,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":301,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":640,"log_dups_size":0,"ondisk_log_size":640,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0046689339999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7611,"num_read_kb":41345,"num_write":1018,"num_write_kb":26620,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":158,"num_bytes_recovered":4212424,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"305'992","reported_seq":21087,"reported_epoch":305,"state":"active+clean","last_fresh":"2024-09-13T06:44:54.706382+0000","last_change":"2024-09-13T06:44:54.706632+0000","last_active":"2024-09-13T06:44:54.706382+0000","last_peered":"2024-09-13T06:44:54.706382+0000","last_clean":"2024-09-13T06:44:54.706382+0000","last_became_active":"2024-09-13T06:44:28.768976+0000","last_became_peered":"2024-09-13T06:44:28.768976+0000","last_unstale":"2024-09-13T06:44:54.706382+0000","last_undegraded":"2024-09-13T06:44:54.706382+0000","last_fullsized":"2024-09-13T06:44:54.706382+0000","mapping_epoch":298,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":299,"parent":"0.0","parent_split_bits":0,"last_scrub":"305'992","last_scrub_stamp":"2024-09-13T06:44:54.706326+0000","last_deep_scrub":"305'992","last_deep_scrub_stamp":"2024-09-13T06:44:54.706326+0000","last_clean_scrub_stamp":"2024-09-13T06:44:54.706326+0000","objects_scrubbed":1,"log_size":992,"log_dups_size":0,"ondisk_log_size":992,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:19:39.648227+0000","scrub_duration":0.0074843890000000001,"objects_trimmed":0,"snaptrim_duration":0.0017436419999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20994,"num_read_kb":92583,"num_write":1315,"num_write_kb":30385,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":207,"num_bytes_recovered":9898606,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"20'2","reported_seq":126,"reported_epoch":305,"state":"active+clean","last_fresh":"2024-09-13T06:44:34.867035+0000","last_change":"2024-09-13T06:44:30.794941+0000","last_active":"2024-09-13T06:44:34.867035+0000","last_peered":"2024-09-13T06:44:34.867035+0000","last_clean":"2024-09-13T06:44:34.867035+0000","last_became_active":"2024-09-13T06:44:30.794134+0000","last_became_peered":"2024-09-13T06:44:30.794134+0000","last_unstale":"2024-09-13T06:44:34.867035+0000","last_undegraded":"2024-09-13T06:44:34.867035+0000","last_fullsized":"2024-09-13T06:44:34.867035+0000","mapping_epoch":300,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":301,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_clean_scrub_stamp":"2024-09-13T06:39:16.508974+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":57,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"278'857","reported_seq":10784,"reported_epoch":305,"state":"active+clean","last_fresh":"2024-09-13T06:44:59.325085+0000","last_change":"2024-09-13T06:44:59.325329+0000","last_active":"2024-09-13T06:44:59.325085+0000","last_peered":"2024-09-13T06:44:59.325085+0000","last_clean":"2024-09-13T06:44:59.325085+0000","last_became_active":"2024-09-13T06:44:21.442847+0000","last_became_peered":"2024-09-13T06:44:21.442847+0000","last_unstale":"2024-09-13T06:44:59.325085+0000","last_undegraded":"2024-09-13T06:44:59.325085+0000","last_fullsized":"2024-09-13T06:44:59.325085+0000","mapping_epoch":291,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":292,"parent":"0.0","parent_split_bits":0,"last_scrub":"278'857","last_scrub_stamp":"2024-09-13T06:44:59.325032+0000","last_deep_scrub":"278'857","last_deep_scrub_stamp":"2024-09-13T06:44:59.325032+0000","last_clean_scrub_stamp":"2024-09-13T06:44:59.325032+0000","objects_scrubbed":0,"log_size":857,"log_dups_size":0,"ondisk_log_size":857,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:25:42.057889+0000","scrub_duration":0.0037999230000000002,"objects_trimmed":0,"snaptrim_duration":0.00053211199999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11278,"num_read_kb":63107,"num_write":1190,"num_write_kb":36968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":351,"num_bytes_recovered":9847094,"num_keys_recovered":11,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":38,"reported_epoch":305,"state":"active+clean","last_fresh":"2024-09-13T06:44:49.759291+0000","last_change":"2024-09-13T06:44:49.759572+0000","last_active":"2024-09-13T06:44:49.759291+0000","last_peered":"2024-09-13T06:44:49.759291+0000","last_clean":"2024-09-13T06:44:49.759291+0000","last_became_active":"2024-09-13T06:44:17.443358+0000","last_became_peered":"2024-09-13T06:44:17.443358+0000","last_unstale":"2024-09-13T06:44:49.759291+0000","last_undegraded":"2024-09-13T06:44:49.759291+0000","last_fullsized":"2024-09-13T06:44:49.759291+0000","mapping_epoch":287,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":288,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:44:49.759238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:44:49.759238+0000","last_clean_scrub_stamp":"2024-09-13T06:44:49.759238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:01:14.724152+0000","scrub_duration":0.0032066769999999998,"objects_trimmed":0,"snaptrim_duration":0.00033592499999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"277'1115","reported_seq":6270,"reported_epoch":305,"state":"active+clean","last_fresh":"2024-09-13T06:44:57.361972+0000","last_change":"2024-09-13T06:44:57.362244+0000","last_active":"2024-09-13T06:44:57.361972+0000","last_peered":"2024-09-13T06:44:57.361972+0000","last_clean":"2024-09-13T06:44:57.361972+0000","last_became_active":"2024-09-13T06:44:30.798508+0000","last_became_peered":"2024-09-13T06:44:30.798508+0000","last_unstale":"2024-09-13T06:44:57.361972+0000","last_undegraded":"2024-09-13T06:44:57.361972+0000","last_fullsized":"2024-09-13T06:44:57.361972+0000","mapping_epoch":300,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":301,"parent":"0.0","parent_split_bits":0,"last_scrub":"277'1115","last_scrub_stamp":"2024-09-13T06:44:57.361917+0000","last_deep_scrub":"277'1115","last_deep_scrub_stamp":"2024-09-13T06:44:57.361917+0000","last_clean_scrub_stamp":"2024-09-13T06:44:57.361917+0000","objects_scrubbed":0,"log_size":1115,"log_dups_size":0,"ondisk_log_size":1115,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:16:22.708238+0000","scrub_duration":0.0035611200000000001,"objects_trimmed":0,"snaptrim_duration":0.0032283849999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7964,"num_read_kb":36198,"num_write":1645,"num_write_kb":33105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":243,"num_bytes_recovered":7863454,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":209,"reported_epoch":305,"state":"active+clean","last_fresh":"2024-09-13T06:45:05.771302+0000","last_change":"2024-09-13T06:45:05.771512+0000","last_active":"2024-09-13T06:45:05.771302+0000","last_peered":"2024-09-13T06:45:05.771302+0000","last_clean":"2024-09-13T06:45:05.771302+0000","last_became_active":"2024-09-13T06:44:18.456828+0000","last_became_peered":"2024-09-13T06:44:18.456828+0000","last_unstale":"2024-09-13T06:45:05.771302+0000","last_undegraded":"2024-09-13T06:45:05.771302+0000","last_fullsized":"2024-09-13T06:45:05.771302+0000","mapping_epoch":288,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":289,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:45:05.771253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:45:05.771253+0000","last_clean_scrub_stamp":"2024-09-13T06:45:05.771253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:09:48.503953+0000","scrub_duration":0.0033023660000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"279'349","reported_seq":3775,"reported_epoch":305,"state":"active+clean","last_fresh":"2024-09-13T06:44:56.046300+0000","last_change":"2024-09-13T06:44:56.046531+0000","last_active":"2024-09-13T06:44:56.046300+0000","last_peered":"2024-09-13T06:44:56.046300+0000","last_clean":"2024-09-13T06:44:56.046300+0000","last_became_active":"2024-09-13T06:41:15.399301+0000","last_became_peered":"2024-09-13T06:41:15.399301+0000","last_unstale":"2024-09-13T06:44:56.046300+0000","last_undegraded":"2024-09-13T06:44:56.046300+0000","last_fullsized":"2024-09-13T06:44:56.046300+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"279'349","last_scrub_stamp":"2024-09-13T06:44:56.046245+0000","last_deep_scrub":"279'349","last_deep_scrub_stamp":"2024-09-13T06:44:56.046245+0000","last_clean_scrub_stamp":"2024-09-13T06:44:56.046245+0000","objects_scrubbed":0,"log_size":349,"log_dups_size":0,"ondisk_log_size":349,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:52:24.133674+0000","scrub_duration":0.003821592,"objects_trimmed":0,"snaptrim_duration":0.001343293,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2523,"num_read_kb":19829,"num_write":427,"num_write_kb":20943,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":169,"num_bytes_recovered":5233325,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"18'1","reported_seq":57,"reported_epoch":305,"state":"active+clean","last_fresh":"2024-09-13T06:44:34.865824+0000","last_change":"2024-09-13T06:44:30.798045+0000","last_active":"2024-09-13T06:44:34.865824+0000","last_peered":"2024-09-13T06:44:34.865824+0000","last_clean":"2024-09-13T06:44:34.865824+0000","last_became_active":"2024-09-13T06:44:30.796877+0000","last_became_peered":"2024-09-13T06:44:30.796877+0000","last_unstale":"2024-09-13T06:44:34.865824+0000","last_undegraded":"2024-09-13T06:44:34.865824+0000","last_fullsized":"2024-09-13T06:44:34.865824+0000","mapping_epoch":300,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":301,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:16.508974+0000","last_clean_scrub_stamp":"2024-09-13T06:39:16.508974+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"305'119","reported_seq":411,"reported_epoch":305,"state":"active+clean","last_fresh":"2024-09-13T06:44:48.725331+0000","last_change":"2024-09-13T06:44:48.725596+0000","last_active":"2024-09-13T06:44:48.725331+0000","last_peered":"2024-09-13T06:44:48.725331+0000","last_clean":"2024-09-13T06:44:48.725331+0000","last_became_active":"2024-09-13T06:42:28.562642+0000","last_became_peered":"2024-09-13T06:42:28.562642+0000","last_unstale":"2024-09-13T06:44:48.725331+0000","last_undegraded":"2024-09-13T06:44:48.725331+0000","last_fullsized":"2024-09-13T06:44:48.725331+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"305'119","last_scrub_stamp":"2024-09-13T06:44:48.725274+0000","last_deep_scrub":"305'119","last_deep_scrub_stamp":"2024-09-13T06:44:48.725274+0000","last_clean_scrub_stamp":"2024-09-13T06:44:48.725274+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:06:03.567948+0000","scrub_duration":0.0090167430000000007,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"277'651","reported_seq":10863,"reported_epoch":305,"state":"active+clean","last_fresh":"2024-09-13T06:44:53.006080+0000","last_change":"2024-09-13T06:44:53.006305+0000","last_active":"2024-09-13T06:44:53.006080+0000","last_peered":"2024-09-13T06:44:53.006080+0000","last_clean":"2024-09-13T06:44:53.006080+0000","last_became_active":"2024-09-13T06:44:22.448736+0000","last_became_peered":"2024-09-13T06:44:22.448736+0000","last_unstale":"2024-09-13T06:44:53.006080+0000","last_undegraded":"2024-09-13T06:44:53.006080+0000","last_fullsized":"2024-09-13T06:44:53.006080+0000","mapping_epoch":292,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":293,"parent":"0.0","parent_split_bits":0,"last_scrub":"277'651","last_scrub_stamp":"2024-09-13T06:44:53.006028+0000","last_deep_scrub":"277'651","last_deep_scrub_stamp":"2024-09-13T06:44:53.006028+0000","last_clean_scrub_stamp":"2024-09-13T06:44:53.006028+0000","objects_scrubbed":0,"log_size":651,"log_dups_size":0,"ondisk_log_size":651,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:04:46.989212+0000","scrub_duration":0.0038846829999999999,"objects_trimmed":0,"snaptrim_duration":0.00083432600000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9552,"num_read_kb":46146,"num_write":828,"num_write_kb":32512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":446,"num_bytes_recovered":11977587,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"277'774","reported_seq":10956,"reported_epoch":305,"state":"active+clean","last_fresh":"2024-09-13T06:44:56.784127+0000","last_change":"2024-09-13T06:44:56.784408+0000","last_active":"2024-09-13T06:44:56.784127+0000","last_peered":"2024-09-13T06:44:56.784127+0000","last_clean":"2024-09-13T06:44:56.784127+0000","last_became_active":"2024-09-13T06:44:20.462849+0000","last_became_peered":"2024-09-13T06:44:20.462849+0000","last_unstale":"2024-09-13T06:44:56.784127+0000","last_undegraded":"2024-09-13T06:44:56.784127+0000","last_fullsized":"2024-09-13T06:44:56.784127+0000","mapping_epoch":290,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":291,"parent":"0.0","parent_split_bits":0,"last_scrub":"277'774","last_scrub_stamp":"2024-09-13T06:44:56.784076+0000","last_deep_scrub":"277'774","last_deep_scrub_stamp":"2024-09-13T06:44:56.784076+0000","last_clean_scrub_stamp":"2024-09-13T06:44:56.784076+0000","objects_scrubbed":0,"log_size":774,"log_dups_size":0,"ondisk_log_size":774,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:00:46.165167+0000","scrub_duration":0.0040360980000000001,"objects_trimmed":0,"snaptrim_duration":0.0024338839999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10729,"num_read_kb":51645,"num_write":931,"num_write_kb":34617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":445,"num_bytes_recovered":16579571,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"278'758","reported_seq":8294,"reported_epoch":305,"state":"active+clean","last_fresh":"2024-09-13T06:44:55.069007+0000","last_change":"2024-09-13T06:44:55.069219+0000","last_active":"2024-09-13T06:44:55.069007+0000","last_peered":"2024-09-13T06:44:55.069007+0000","last_clean":"2024-09-13T06:44:55.069007+0000","last_became_active":"2024-09-13T06:44:34.836417+0000","last_became_peered":"2024-09-13T06:44:34.836417+0000","last_unstale":"2024-09-13T06:44:55.069007+0000","last_undegraded":"2024-09-13T06:44:55.069007+0000","last_fullsized":"2024-09-13T06:44:55.069007+0000","mapping_epoch":304,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":305,"parent":"0.0","parent_split_bits":0,"last_scrub":"278'758","last_scrub_stamp":"2024-09-13T06:44:55.068956+0000","last_deep_scrub":"278'758","last_deep_scrub_stamp":"2024-09-13T06:44:55.068956+0000","last_clean_scrub_stamp":"2024-09-13T06:44:55.068956+0000","objects_scrubbed":0,"log_size":758,"log_dups_size":0,"ondisk_log_size":758,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:57:19.230829+0000","scrub_duration":0.0036149659999999998,"objects_trimmed":0,"snaptrim_duration":0.00085210600000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8422,"num_read_kb":47219,"num_write":883,"num_write_kb":28077,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":515,"num_bytes_recovered":28581300,"num_keys_recovered":111,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"271'845","reported_seq":5614,"reported_epoch":305,"state":"active+clean","last_fresh":"2024-09-13T06:45:03.188090+0000","last_change":"2024-09-13T06:45:03.188314+0000","last_active":"2024-09-13T06:45:03.188090+0000","last_peered":"2024-09-13T06:45:03.188090+0000","last_clean":"2024-09-13T06:45:03.188090+0000","last_became_active":"2024-09-13T06:41:15.399204+0000","last_became_peered":"2024-09-13T06:41:15.399204+0000","last_unstale":"2024-09-13T06:45:03.188090+0000","last_undegraded":"2024-09-13T06:45:03.188090+0000","last_fullsized":"2024-09-13T06:45:03.188090+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"271'845","last_scrub_stamp":"2024-09-13T06:45:03.188033+0000","last_deep_scrub":"271'845","last_deep_scrub_stamp":"2024-09-13T06:45:03.188033+0000","last_clean_scrub_stamp":"2024-09-13T06:45:03.188033+0000","objects_scrubbed":0,"log_size":845,"log_dups_size":0,"ondisk_log_size":845,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:47:23.126968+0000","scrub_duration":0.0035194789999999998,"objects_trimmed":0,"snaptrim_duration":0.00094468700000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6686,"num_read_kb":57840,"num_write":1181,"num_write_kb":24665,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":117,"num_bytes_recovered":13256568,"num_keys_recovered":44,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"279'569","reported_seq":6615,"reported_epoch":305,"state":"active+clean","last_fresh":"2024-09-13T06:44:59.229775+0000","last_change":"2024-09-13T06:44:59.230029+0000","last_active":"2024-09-13T06:44:59.229775+0000","last_peered":"2024-09-13T06:44:59.229775+0000","last_clean":"2024-09-13T06:44:59.229775+0000","last_became_active":"2024-09-13T06:44:30.794873+0000","last_became_peered":"2024-09-13T06:44:30.794873+0000","last_unstale":"2024-09-13T06:44:59.229775+0000","last_undegraded":"2024-09-13T06:44:59.229775+0000","last_fullsized":"2024-09-13T06:44:59.229775+0000","mapping_epoch":300,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":301,"parent":"0.0","parent_split_bits":0,"last_scrub":"279'569","last_scrub_stamp":"2024-09-13T06:44:59.229718+0000","last_deep_scrub":"279'569","last_deep_scrub_stamp":"2024-09-13T06:44:59.229718+0000","last_clean_scrub_stamp":"2024-09-13T06:44:59.229718+0000","objects_scrubbed":0,"log_size":569,"log_dups_size":0,"ondisk_log_size":569,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:49:38.735223+0000","scrub_duration":0.0039679950000000002,"objects_trimmed":0,"snaptrim_duration":0.0027493119999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6187,"num_read_kb":31727,"num_write":657,"num_write_kb":25682,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":184,"num_bytes_recovered":16410936,"num_keys_recovered":88,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"277'881","reported_seq":2925,"reported_epoch":305,"state":"active+clean","last_fresh":"2024-09-13T06:44:46.627589+0000","last_change":"2024-09-13T06:44:05.458093+0000","last_active":"2024-09-13T06:44:46.627589+0000","last_peered":"2024-09-13T06:44:46.627589+0000","last_clean":"2024-09-13T06:44:46.627589+0000","last_became_active":"2024-09-13T06:42:32.411927+0000","last_became_peered":"2024-09-13T06:42:32.411927+0000","last_unstale":"2024-09-13T06:44:46.627589+0000","last_undegraded":"2024-09-13T06:44:46.627589+0000","last_fullsized":"2024-09-13T06:44:46.627589+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":881,"log_dups_size":0,"ondisk_log_size":881,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.003013108,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4846,"num_read_kb":26164,"num_write":1518,"num_write_kb":30083,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":140,"num_bytes_recovered":11278110,"num_keys_recovered":11,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.e","version":"277'556","reported_seq":4104,"reported_epoch":305,"state":"active+clean","last_fresh":"2024-09-13T06:44:46.627653+0000","last_change":"2024-09-13T06:44:30.808041+0000","last_active":"2024-09-13T06:44:46.627653+0000","last_peered":"2024-09-13T06:44:46.627653+0000","last_clean":"2024-09-13T06:44:46.627653+0000","last_became_active":"2024-09-13T06:44:30.801655+0000","last_became_peered":"2024-09-13T06:44:30.801655+0000","last_unstale":"2024-09-13T06:44:46.627653+0000","last_undegraded":"2024-09-13T06:44:46.627653+0000","last_fullsized":"2024-09-13T06:44:46.627653+0000","mapping_epoch":300,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":301,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":556,"log_dups_size":0,"ondisk_log_size":556,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0025767619999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3868,"num_read_kb":43567,"num_write":654,"num_write_kb":29232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":503,"num_bytes_recovered":12695191,"num_keys_recovered":11,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"277'665","reported_seq":4756,"reported_epoch":305,"state":"active+clean","last_fresh":"2024-09-13T06:44:47.700516+0000","last_change":"2024-09-13T06:44:05.458214+0000","last_active":"2024-09-13T06:44:47.700516+0000","last_peered":"2024-09-13T06:44:47.700516+0000","last_clean":"2024-09-13T06:44:47.700516+0000","last_became_active":"2024-09-13T06:42:33.412054+0000","last_became_peered":"2024-09-13T06:42:33.412054+0000","last_unstale":"2024-09-13T06:44:47.700516+0000","last_undegraded":"2024-09-13T06:44:47.700516+0000","last_fullsized":"2024-09-13T06:44:47.700516+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":665,"log_dups_size":0,"ondisk_log_size":665,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00285659,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4677,"num_read_kb":45287,"num_write":982,"num_write_kb":45285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":394,"num_bytes_recovered":42768786,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.10","version":"280'832","reported_seq":5047,"reported_epoch":305,"state":"active+clean","last_fresh":"2024-09-13T06:44:54.076963+0000","last_change":"2024-09-13T06:44:54.077211+0000","last_active":"2024-09-13T06:44:54.076963+0000","last_peered":"2024-09-13T06:44:54.076963+0000","last_clean":"2024-09-13T06:44:54.076963+0000","last_became_active":"2024-09-13T06:44:19.459617+0000","last_became_peered":"2024-09-13T06:44:19.459617+0000","last_unstale":"2024-09-13T06:44:54.076963+0000","last_undegraded":"2024-09-13T06:44:54.076963+0000","last_fullsized":"2024-09-13T06:44:54.076963+0000","mapping_epoch":289,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":290,"parent":"0.0","parent_split_bits":0,"last_scrub":"280'832","last_scrub_stamp":"2024-09-13T06:44:54.076908+0000","last_deep_scrub":"280'832","last_deep_scrub_stamp":"2024-09-13T06:44:54.076908+0000","last_clean_scrub_stamp":"2024-09-13T06:44:54.076908+0000","objects_scrubbed":0,"log_size":832,"log_dups_size":0,"ondisk_log_size":832,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:11:04.455152+0000","scrub_duration":0.0036414469999999999,"objects_trimmed":0,"snaptrim_duration":0.0018779840000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5715,"num_read_kb":29614,"num_write":1142,"num_write_kb":36190,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":275,"num_bytes_recovered":6622441,"num_keys_recovered":20,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.11","version":"279'502","reported_seq":6281,"reported_epoch":305,"state":"active+clean","last_fresh":"2024-09-13T06:44:47.700652+0000","last_change":"2024-09-13T06:44:05.455675+0000","last_active":"2024-09-13T06:44:47.700652+0000","last_peered":"2024-09-13T06:44:47.700652+0000","last_clean":"2024-09-13T06:44:47.700652+0000","last_became_active":"2024-09-13T06:42:33.411668+0000","last_became_peered":"2024-09-13T06:42:33.411668+0000","last_unstale":"2024-09-13T06:44:47.700652+0000","last_undegraded":"2024-09-13T06:44:47.700652+0000","last_fullsized":"2024-09-13T06:44:47.700652+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":502,"log_dups_size":0,"ondisk_log_size":502,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001270492,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5341,"num_read_kb":34087,"num_write":659,"num_write_kb":25712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":245,"num_bytes_recovered":7089272,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"280'921","reported_seq":5059,"reported_epoch":305,"state":"active+clean","last_fresh":"2024-09-13T06:44:58.336531+0000","last_change":"2024-09-13T06:44:58.336745+0000","last_active":"2024-09-13T06:44:58.336531+0000","last_peered":"2024-09-13T06:44:58.336531+0000","last_clean":"2024-09-13T06:44:58.336531+0000","last_became_active":"2024-09-13T06:44:20.466713+0000","last_became_peered":"2024-09-13T06:44:20.466713+0000","last_unstale":"2024-09-13T06:44:58.336531+0000","last_undegraded":"2024-09-13T06:44:58.336531+0000","last_fullsized":"2024-09-13T06:44:58.336531+0000","mapping_epoch":290,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":291,"parent":"0.0","parent_split_bits":0,"last_scrub":"280'921","last_scrub_stamp":"2024-09-13T06:44:58.336451+0000","last_deep_scrub":"280'921","last_deep_scrub_stamp":"2024-09-13T06:44:58.336451+0000","last_clean_scrub_stamp":"2024-09-13T06:44:58.336451+0000","objects_scrubbed":0,"log_size":921,"log_dups_size":0,"ondisk_log_size":921,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:33:27.820931+0000","scrub_duration":0.0041990819999999998,"objects_trimmed":0,"snaptrim_duration":0.0017683250000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6025,"num_read_kb":38947,"num_write":1315,"num_write_kb":35656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":107,"num_bytes_recovered":3682200,"num_keys_recovered":21,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"279'604","reported_seq":4548,"reported_epoch":305,"state":"active+clean","last_fresh":"2024-09-13T06:44:47.700653+0000","last_change":"2024-09-13T06:44:05.454984+0000","last_active":"2024-09-13T06:44:47.700653+0000","last_peered":"2024-09-13T06:44:47.700653+0000","last_clean":"2024-09-13T06:44:47.700653+0000","last_became_active":"2024-09-13T06:42:31.402800+0000","last_became_peered":"2024-09-13T06:42:31.402800+0000","last_unstale":"2024-09-13T06:44:47.700653+0000","last_undegraded":"2024-09-13T06:44:47.700653+0000","last_fullsized":"2024-09-13T06:44:47.700653+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":604,"log_dups_size":0,"ondisk_log_size":604,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010470779999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4471,"num_read_kb":35894,"num_write":884,"num_write_kb":31515,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":196,"num_bytes_recovered":8224568,"num_keys_recovered":11,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":19,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":237282,"num_read_kb":1402862,"num_write":33322,"num_write_kb":1008910,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9249,"num_bytes_recovered":443628516,"num_keys_recovered":867,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14648,"internal_metadata":0},"log_size":24488,"ondisk_log_size":24488,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":57,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":3}],"osd_stats":[{"osd":7,"up_from":187,"seq":803158884386,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37036,"kb_used_data":4196,"kb_used_omap":9,"kb_used_meta":32822,"kb_avail":94334804,"statfs":{"total":96636764160,"available":96598839296,"internally_reserved":0,"allocated":4296704,"data_stored":2446923,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9685,"internal_metadata":33610283},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 06:44:33 2024","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":0.71199999999999997,"15min":0.69799999999999995},"min":{"1min":0.56699999999999995,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.85499999999999998},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.751,"15min":0.73999999999999999},"min":{"1min":0.54600000000000004,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.6910000000000001,"5min":1.6910000000000001,"15min":1.6910000000000001},"last":0.82699999999999996}]},{"osd":1,"last update":"Fri Sep 13 06:44:33 2024","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.75700000000000001,"15min":0.751},"min":{"1min":0.57399999999999995,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.359,"5min":1.359,"15min":1.359},"last":1.008},{"interface":"front","average":{"1min":0.82399999999999995,"5min":0.71599999999999997,"15min":0.69799999999999995},"min":{"1min":0.496,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.1259999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.97999999999999998}]},{"osd":2,"last update":"Fri Sep 13 06:44:33 2024","interfaces":[{"interface":"back","average":{"1min":0.80700000000000005,"5min":0.75900000000000001,"15min":0.751},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.2030000000000001,"5min":1.212,"15min":1.212},"last":1.1499999999999999},{"interface":"front","average":{"1min":0.92200000000000004,"5min":0.81499999999999995,"15min":0.79700000000000004},"min":{"1min":0.58999999999999997,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.4319999999999999,"5min":1.4319999999999999,"15min":1.4319999999999999},"last":0.88400000000000001}]},{"osd":3,"last update":"Fri Sep 13 06:44:33 2024","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.79600000000000004,"15min":0.79200000000000004},"min":{"1min":0.60299999999999998,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.177,"5min":1.177,"15min":1.177},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.88600000000000001,"5min":0.84299999999999997,"15min":0.83599999999999997},"min":{"1min":0.48099999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.7350000000000001,"5min":1.7350000000000001,"15min":1.7350000000000001},"last":1.107}]},{"osd":4,"last update":"Fri Sep 13 06:44:33 2024","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.82299999999999995,"15min":0.82499999999999996},"min":{"1min":0.45500000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.405,"5min":1.405,"15min":1.405},"last":0.55800000000000005},{"interface":"front","average":{"1min":1.0049999999999999,"5min":0.82299999999999995,"15min":0.79300000000000004},"min":{"1min":0.39800000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.6240000000000001,"5min":1.6240000000000001,"15min":1.6240000000000001},"last":0.93999999999999995}]},{"osd":5,"last update":"Fri Sep 13 06:44:33 2024","interfaces":[{"interface":"back","average":{"1min":0.96599999999999997,"5min":0.88800000000000001,"15min":0.875},"min":{"1min":0.504,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.593,"5min":1.593,"15min":1.593},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.92300000000000004,"5min":0.84099999999999997,"15min":0.82699999999999996},"min":{"1min":0.53800000000000003,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.3400000000000001,"5min":1.3400000000000001,"15min":1.3400000000000001},"last":0.91800000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0780000000000001}]}]},{"osd":6,"up_from":286,"seq":1228360646668,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35500,"kb_used_data":3620,"kb_used_omap":7,"kb_used_meta":31864,"kb_avail":94336340,"statfs":{"total":96636764160,"available":96600412160,"internally_reserved":0,"allocated":3706880,"data_stored":1857127,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8145,"internal_metadata":32628783},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69499999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0649999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.129}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88200000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95199999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73799999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574923,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":79020,"kb_used_data":3620,"kb_used_omap":1,"kb_used_meta":75390,"kb_avail":94292820,"statfs":{"total":96636764160,"available":96555847680,"internally_reserved":0,"allocated":3706880,"data_stored":1856574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":77199814},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 06:44:19 2024","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.71399999999999997,"15min":0.76500000000000001},"min":{"1min":0.40999999999999998,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":1.093,"5min":1.6679999999999999,"15min":1.6679999999999999},"last":1.0289999999999999},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.76900000000000002,"15min":0.79900000000000004},"min":{"1min":0.41299999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.1220000000000001,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":0.88600000000000001}]},{"osd":1,"last update":"Fri Sep 13 06:44:19 2024","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.73999999999999999,"15min":0.751},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":1.103,"5min":1.341,"15min":1.341},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.70099999999999996,"15min":0.74099999999999999},"min":{"1min":0.40899999999999997,"5min":0.317,"15min":0.317},"max":{"1min":1.0089999999999999,"5min":1.722,"15min":1.722},"last":0.748}]},{"osd":2,"last update":"Fri Sep 13 06:44:19 2024","interfaces":[{"interface":"back","average":{"1min":0.876,"5min":0.81999999999999995,"15min":0.86399999999999999},"min":{"1min":0.47699999999999998,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.143,"5min":1.833,"15min":1.833},"last":0.94299999999999995},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.79200000000000004},"min":{"1min":0.47999999999999998,"5min":0.435,"15min":0.435},"max":{"1min":1.0169999999999999,"5min":1.4279999999999999,"15min":1.4279999999999999},"last":0.83099999999999996}]},{"osd":3,"last update":"Fri Sep 13 06:44:19 2024","interfaces":[{"interface":"back","average":{"1min":0.85699999999999998,"5min":0.81399999999999995,"15min":0.78000000000000003},"min":{"1min":0.45400000000000001,"5min":0.434,"15min":0.434},"max":{"1min":1.1659999999999999,"5min":1.885,"15min":1.885},"last":1.006},{"interface":"front","average":{"1min":0.85899999999999999,"5min":0.86299999999999999,"15min":0.86499999999999999},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.2410000000000001,"5min":1.907,"15min":1.907},"last":0.97999999999999998}]},{"osd":4,"last update":"Fri Sep 13 06:44:19 2024","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.83499999999999996,"15min":0.80500000000000005},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":1.159,"5min":6.3179999999999996,"15min":6.3179999999999996},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.78000000000000003,"5min":1.0529999999999999,"15min":0.91000000000000003},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":1.2370000000000001,"5min":15.553000000000001,"15min":15.553000000000001},"last":0.64300000000000002}]},{"osd":6,"last update":"Fri Sep 13 06:42:12 2024","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.86299999999999999,"15min":0.877},"min":{"1min":0.40000000000000002,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.9610000000000001,"5min":1.9610000000000001,"15min":1.9610000000000001},"last":0.90800000000000003},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.86099999999999999,"15min":0.87},"min":{"1min":0.39000000000000001,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.206,"5min":1.968,"15min":1.968},"last":0.79700000000000004}]},{"osd":7,"last update":"Fri Sep 13 06:44:31 2024","interfaces":[{"interface":"back","average":{"1min":0.96399999999999997,"5min":0.84399999999999997,"15min":0.82399999999999995},"min":{"1min":0.39000000000000001,"5min":0.373,"15min":0.373},"max":{"1min":1.2050000000000001,"5min":1.375,"15min":1.375},"last":0.85799999999999998},{"interface":"front","average":{"1min":0.997,"5min":0.89800000000000002,"15min":0.88200000000000001},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":1.7050000000000001,"5min":1.7050000000000001,"15min":1.7050000000000001},"last":1.083}]}]},{"osd":4,"up_from":13,"seq":55834574923,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60976,"kb_used_data":3624,"kb_used_omap":1,"kb_used_meta":57342,"kb_avail":94310864,"statfs":{"total":96636764160,"available":96574324736,"internally_reserved":0,"allocated":3710976,"data_stored":1857146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":58718662},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 06:44:15 2024","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.79300000000000004,"15min":0.98999999999999999},"min":{"1min":0.41499999999999998,"5min":0.245,"15min":0.245},"max":{"1min":1.0720000000000001,"5min":5.8230000000000004,"15min":5.8230000000000004},"last":0.98399999999999999},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.71999999999999997,"15min":0.752},"min":{"1min":0.505,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.97299999999999998,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":1.2150000000000001}]},{"osd":1,"last update":"Fri Sep 13 06:44:15 2024","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.79300000000000004,"15min":0.75},"min":{"1min":0.45100000000000001,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.86899999999999999,"5min":10.156000000000001,"15min":10.156000000000001},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.747,"5min":0.77500000000000002,"15min":0.83599999999999997},"min":{"1min":0.496,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.0349999999999999,"5min":1.286,"15min":1.286},"last":1.575}]},{"osd":2,"last update":"Fri Sep 13 06:44:15 2024","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.751,"15min":0.82299999999999995},"min":{"1min":0.52800000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":1.0109999999999999,"5min":1.6000000000000001,"15min":1.6000000000000001},"last":0.878},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.81299999999999994},"min":{"1min":0.65500000000000003,"5min":0.374,"15min":0.374},"max":{"1min":1.167,"5min":1.3540000000000001,"15min":1.3540000000000001},"last":0.80400000000000005}]},{"osd":3,"last update":"Fri Sep 13 06:44:15 2024","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.84699999999999998,"15min":0.90200000000000002},"min":{"1min":0.57499999999999996,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.6950000000000001,"5min":1.6950000000000001,"15min":1.6950000000000001},"last":1.264},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.95299999999999996,"15min":0.92500000000000004},"min":{"1min":0.48499999999999999,"5min":0.374,"15min":0.374},"max":{"1min":1.8069999999999999,"5min":10.195,"15min":10.195},"last":0.92700000000000005}]},{"osd":5,"last update":"Fri Sep 13 06:44:15 2024","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.81499999999999995,"15min":0.85699999999999998},"min":{"1min":0.443,"5min":0.249,"15min":0.249},"max":{"1min":1.075,"5min":2.9790000000000001,"15min":2.9790000000000001},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.84399999999999997,"15min":0.91400000000000003},"min":{"1min":0.39700000000000002,"5min":0.372,"15min":0.372},"max":{"1min":1.0580000000000001,"5min":1.8779999999999999,"15min":1.8779999999999999},"last":1.0349999999999999}]},{"osd":6,"last update":"Fri Sep 13 06:42:14 2024","interfaces":[{"interface":"back","average":{"1min":0.90100000000000002,"5min":0.92100000000000004,"15min":0.82899999999999996},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":1.6100000000000001,"5min":10.016999999999999,"15min":10.016999999999999},"last":1.373},{"interface":"front","average":{"1min":0.86699999999999999,"5min":0.93300000000000005,"15min":0.95999999999999996},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.2030000000000001,"5min":2.0750000000000002,"15min":2.0750000000000002},"last":0.71699999999999997}]},{"osd":7,"last update":"Fri Sep 13 06:44:33 2024","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.1539999999999999,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.82599999999999996},{"interface":"front","average":{"1min":0.90400000000000003,"5min":0.89200000000000002,"15min":0.89000000000000001},"min":{"1min":0.505,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.2529999999999999,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":0.94199999999999995}]}]},{"osd":3,"up_from":13,"seq":55834574926,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":74924,"kb_used_data":3620,"kb_used_omap":1,"kb_used_meta":71294,"kb_avail":94296916,"statfs":{"total":96636764160,"available":96560041984,"internally_reserved":0,"allocated":3706880,"data_stored":1857127,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":73005512},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 06:44:15 2024","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.56100000000000005,"15min":0.56899999999999995},"min":{"1min":0.24199999999999999,"5min":0.191,"15min":0.191},"max":{"1min":1.51,"5min":1.51,"15min":1.51},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.60599999999999998,"15min":0.65400000000000003},"min":{"1min":0.307,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.88900000000000001,"5min":1.2789999999999999,"15min":1.2789999999999999},"last":0.85399999999999998}]},{"osd":1,"last update":"Fri Sep 13 06:44:15 2024","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.54900000000000004,"15min":0.58599999999999997},"min":{"1min":0.29499999999999998,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.85399999999999998,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.59999999999999998,"15min":0.66800000000000004},"min":{"1min":0.27700000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":1.607,"5min":1.607,"15min":1.607},"last":0.51400000000000001}]},{"osd":2,"last update":"Fri Sep 13 06:44:15 2024","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.629,"15min":0.65200000000000002},"min":{"1min":0.30199999999999999,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":1.5660000000000001,"5min":1.5660000000000001,"15min":1.5660000000000001},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.59799999999999998,"15min":0.627},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":1.135,"5min":1.409,"15min":1.409},"last":0.73299999999999998}]},{"osd":4,"last update":"Fri Sep 13 06:44:15 2024","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.82599999999999996,"15min":0.89400000000000002},"min":{"1min":0.42899999999999999,"5min":0.377,"15min":0.377},"max":{"1min":1.651,"5min":1.7929999999999999,"15min":1.7929999999999999},"last":0.90300000000000002},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.76300000000000001,"15min":0.78300000000000003},"min":{"1min":0.44700000000000001,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.96499999999999997,"5min":1.3240000000000001,"15min":1.3240000000000001},"last":1.05}]},{"osd":5,"last update":"Fri Sep 13 06:44:15 2024","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":0.81200000000000006,"15min":0.84999999999999998},"min":{"1min":0.48799999999999999,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.3029999999999999,"5min":1.3799999999999999,"15min":1.3799999999999999},"last":0.95799999999999996},{"interface":"front","average":{"1min":0.83099999999999996,"5min":0.82499999999999996,"15min":0.85999999999999999},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.4610000000000001,"5min":1.4610000000000001,"15min":1.4610000000000001},"last":1.1539999999999999}]},{"osd":6,"last update":"Fri Sep 13 06:42:11 2024","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.88500000000000001,"15min":0.91100000000000003},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.135,"5min":1.532,"15min":1.532},"last":1.0269999999999999},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.95299999999999996,"15min":0.98999999999999999},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.2250000000000001,"5min":1.825,"15min":1.825},"last":1.173}]},{"osd":7,"last update":"Fri Sep 13 06:44:35 2024","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.89300000000000002,"15min":0.89800000000000002},"min":{"1min":0.57199999999999995,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.3009999999999999,"5min":1.3799999999999999,"15min":1.3799999999999999},"last":1.087},{"interface":"front","average":{"1min":0.93000000000000005,"5min":0.95799999999999996,"15min":0.96199999999999997},"min":{"1min":0.58799999999999997,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.4219999999999999,"5min":2.0459999999999998,"15min":2.0459999999999998},"last":1.133}]}]},{"osd":2,"up_from":13,"seq":55834574923,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60972,"kb_used_data":3620,"kb_used_omap":1,"kb_used_meta":57342,"kb_avail":94310868,"statfs":{"total":96636764160,"available":96574328832,"internally_reserved":0,"allocated":3706880,"data_stored":1857127,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":58718662},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 06:44:20 2024","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.66800000000000004,"15min":0.56200000000000006},"min":{"1min":0.19400000000000001,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.84199999999999997,"5min":8.6449999999999996,"15min":8.6449999999999996},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.65200000000000002,"15min":0.61099999999999999},"min":{"1min":0.30299999999999999,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":1.4410000000000001,"5min":4.0380000000000003,"15min":4.0380000000000003},"last":0.60299999999999998}]},{"osd":1,"last update":"Fri Sep 13 06:44:20 2024","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.64000000000000001,"15min":0.62},"min":{"1min":0.25,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":1.0329999999999999,"5min":3.4649999999999999,"15min":3.4649999999999999},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.66600000000000004,"15min":0.60299999999999998},"min":{"1min":0.34300000000000003,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":1.5049999999999999,"5min":3.8159999999999998,"15min":3.8159999999999998},"last":0.78000000000000003}]},{"osd":3,"last update":"Fri Sep 13 06:44:20 2024","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.65000000000000002,"15min":0.58599999999999997},"min":{"1min":0.36399999999999999,"5min":0.249,"15min":0.249},"max":{"1min":1.044,"5min":3.407,"15min":3.407},"last":0.91300000000000003},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.73599999999999999,"15min":0.68600000000000005},"min":{"1min":0.312,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.238,"5min":3.2639999999999998,"15min":3.2639999999999998},"last":0.83699999999999997}]},{"osd":4,"last update":"Fri Sep 13 06:44:20 2024","interfaces":[{"interface":"back","average":{"1min":0.83299999999999996,"5min":0.878,"15min":0.88500000000000001},"min":{"1min":0.45600000000000002,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.3759999999999999,"5min":3.1179999999999999,"15min":3.1179999999999999},"last":1.1779999999999999},{"interface":"front","average":{"1min":0.81399999999999995,"5min":1.0620000000000001,"15min":0.94099999999999995},"min":{"1min":0.46800000000000003,"5min":0.439,"15min":0.439},"max":{"1min":1.359,"5min":21.081,"15min":21.081},"last":1.117}]},{"osd":5,"last update":"Fri Sep 13 06:44:20 2024","interfaces":[{"interface":"back","average":{"1min":0.82999999999999996,"5min":0.84799999999999998,"15min":0.84299999999999997},"min":{"1min":0.60099999999999998,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":1.143,"5min":2.2389999999999999,"15min":2.2389999999999999},"last":1.1419999999999999},{"interface":"front","average":{"1min":1.133,"5min":0.96099999999999997,"15min":0.88900000000000001},"min":{"1min":0.54400000000000004,"5min":0.377,"15min":0.377},"max":{"1min":4.9039999999999999,"5min":4.9039999999999999,"15min":4.9039999999999999},"last":1.0900000000000001}]},{"osd":6,"last update":"Fri Sep 13 06:42:15 2024","interfaces":[{"interface":"back","average":{"1min":0.86799999999999999,"5min":0.94199999999999995,"15min":0.92600000000000005},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.274,"5min":3.923,"15min":3.923},"last":1.0589999999999999},{"interface":"front","average":{"1min":0.97799999999999998,"5min":0.90500000000000003,"15min":0.879},"min":{"1min":0.60899999999999999,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":2.2080000000000002,"5min":2.2120000000000002,"15min":2.2120000000000002},"last":0.97099999999999997}]},{"osd":7,"last update":"Fri Sep 13 06:44:33 2024","interfaces":[{"interface":"back","average":{"1min":0.95799999999999996,"5min":0.86499999999999999,"15min":0.84899999999999998},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":1.641,"5min":1.641,"15min":1.641},"last":0.88800000000000001},{"interface":"front","average":{"1min":1.05,"5min":0.88600000000000001,"15min":0.85799999999999998},"min":{"1min":0.71499999999999997,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":2.0630000000000002,"5min":2.0630000000000002,"15min":2.0630000000000002},"last":1.222}]}]},{"osd":1,"up_from":13,"seq":55834574923,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52784,"kb_used_data":3624,"kb_used_omap":1,"kb_used_meta":49150,"kb_avail":94319056,"statfs":{"total":96636764160,"available":96582713344,"internally_reserved":0,"allocated":3710976,"data_stored":1856593,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":50330054},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 06:44:21 2024","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.55300000000000005,"15min":0.57299999999999995},"min":{"1min":0.246,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":1.1879999999999999,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.64200000000000002,"15min":0.65900000000000003},"min":{"1min":0.26200000000000001,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.99199999999999999,"5min":1.8160000000000001,"15min":1.8160000000000001},"last":0.82599999999999996}]},{"osd":2,"last update":"Fri Sep 13 06:44:21 2024","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.60699999999999998,"15min":0.63400000000000001},"min":{"1min":0.26800000000000002,"5min":0.22,"15min":0.22},"max":{"1min":0.92200000000000004,"5min":2.617,"15min":2.617},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.65300000000000002,"15min":0.65400000000000003},"min":{"1min":0.28499999999999998,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":1.331,"5min":2.5249999999999999,"15min":2.5249999999999999},"last":0.76400000000000001}]},{"osd":3,"last update":"Fri Sep 13 06:44:21 2024","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.70499999999999996,"15min":0.72599999999999998},"min":{"1min":0.33900000000000002,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":1.2769999999999999,"5min":1.3640000000000001,"15min":1.3640000000000001},"last":1.0129999999999999},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.66700000000000004,"15min":0.69099999999999995},"min":{"1min":0.30399999999999999,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":1.028,"5min":1.752,"15min":1.752},"last":0.73299999999999998}]},{"osd":4,"last update":"Fri Sep 13 06:44:21 2024","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.79800000000000004,"15min":0.81999999999999995},"min":{"1min":0.60899999999999999,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":1.109,"5min":2.7389999999999999,"15min":2.7389999999999999},"last":0.95899999999999996},{"interface":"front","average":{"1min":0.94499999999999995,"5min":0.85499999999999998,"15min":0.90600000000000003},"min":{"1min":0.40000000000000002,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.4159999999999999,"5min":1.4359999999999999,"15min":1.4359999999999999},"last":0.92600000000000005}]},{"osd":5,"last update":"Fri Sep 13 06:44:21 2024","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.84499999999999997,"15min":0.90600000000000003},"min":{"1min":0.58099999999999996,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.1399999999999999,"5min":1.7849999999999999,"15min":1.7849999999999999},"last":1.153},{"interface":"front","average":{"1min":0.89600000000000002,"5min":0.86599999999999999,"15min":0.879},"min":{"1min":0.495,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":1.202,"5min":2.036,"15min":2.036},"last":1.085}]},{"osd":6,"last update":"Fri Sep 13 06:42:18 2024","interfaces":[{"interface":"back","average":{"1min":0.87,"5min":0.92200000000000004,"15min":0.94399999999999995},"min":{"1min":0.57699999999999996,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.526,"5min":1.8149999999999999,"15min":1.8149999999999999},"last":1.1080000000000001},{"interface":"front","average":{"1min":0.88900000000000001,"5min":0.91200000000000003,"15min":0.91900000000000004},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":2.7810000000000001,"5min":2.7810000000000001,"15min":2.7810000000000001},"last":0.98599999999999999}]},{"osd":7,"last update":"Fri Sep 13 06:44:33 2024","interfaces":[{"interface":"back","average":{"1min":0.91900000000000004,"5min":0.90600000000000003,"15min":0.90400000000000003},"min":{"1min":0.621,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":1.3220000000000001,"5min":1.605,"15min":1.605},"last":1.036},{"interface":"front","average":{"1min":1.054,"5min":0.93899999999999995,"15min":0.92000000000000004},"min":{"1min":0.61099999999999999,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.5009999999999999,"5min":1.5009999999999999,"15min":1.5009999999999999},"last":1.0600000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574922,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":85356,"kb_used_data":4196,"kb_used_omap":1,"kb_used_meta":81150,"kb_avail":94286484,"statfs":{"total":96636764160,"available":96549359616,"internally_reserved":0,"allocated":4296704,"data_stored":2446923,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":83098054},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 06:44:11 2024","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.54900000000000004,"15min":0.53000000000000003},"min":{"1min":0.23999999999999999,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":1.048,"5min":1.2270000000000001,"15min":1.2270000000000001},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.56000000000000005,"15min":0.54000000000000004},"min":{"1min":0.28799999999999998,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":1.137,"5min":1.222,"15min":1.222},"last":0.58599999999999997}]},{"osd":2,"last update":"Fri Sep 13 06:44:11 2024","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.60399999999999998,"15min":0.55600000000000005},"min":{"1min":0.27300000000000002,"5min":0.217,"15min":0.217},"max":{"1min":1.2549999999999999,"5min":1.839,"15min":1.839},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.61299999999999999,"15min":0.57499999999999996},"min":{"1min":0.35399999999999998,"5min":0.245,"15min":0.245},"max":{"1min":1.419,"5min":1.419,"15min":1.419},"last":0.81999999999999995}]},{"osd":3,"last update":"Fri Sep 13 06:44:11 2024","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.59999999999999998,"15min":0.55800000000000005},"min":{"1min":0.371,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":1.2250000000000001,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.84699999999999998},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.74299999999999999,"15min":0.69899999999999995},"min":{"1min":0.36699999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":1.175,"5min":4.9630000000000001,"15min":4.9630000000000001},"last":0.97899999999999998}]},{"osd":4,"last update":"Fri Sep 13 06:44:11 2024","interfaces":[{"interface":"back","average":{"1min":0.89400000000000002,"5min":0.80400000000000005,"15min":0.79400000000000004},"min":{"1min":0.57899999999999996,"5min":0.311,"15min":0.311},"max":{"1min":1.6259999999999999,"5min":1.6259999999999999,"15min":1.6259999999999999},"last":0.90900000000000003},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.77400000000000002,"15min":0.79600000000000004},"min":{"1min":0.58999999999999997,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.1799999999999999,"5min":1.6319999999999999,"15min":1.6319999999999999},"last":0.93700000000000006}]},{"osd":5,"last update":"Fri Sep 13 06:44:11 2024","interfaces":[{"interface":"back","average":{"1min":0.89900000000000002,"5min":0.85799999999999998,"15min":0.85199999999999998},"min":{"1min":0.52800000000000002,"5min":0.378,"15min":0.378},"max":{"1min":1.575,"5min":1.575,"15min":1.575},"last":0.88700000000000001},{"interface":"front","average":{"1min":0.89100000000000001,"5min":0.85699999999999998,"15min":0.87},"min":{"1min":0.60199999999999998,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.327,"5min":1.5740000000000001,"15min":1.5740000000000001},"last":1.135}]},{"osd":6,"last update":"Fri Sep 13 06:42:11 2024","interfaces":[{"interface":"back","average":{"1min":0.89800000000000002,"5min":0.91200000000000003,"15min":0.93100000000000005},"min":{"1min":0.55300000000000005,"5min":0.499,"15min":0.499},"max":{"1min":1.571,"5min":2.4969999999999999,"15min":2.4969999999999999},"last":1.115},{"interface":"front","average":{"1min":0.878,"5min":0.89600000000000002,"15min":0.90600000000000003},"min":{"1min":0.51800000000000002,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.208,"5min":2.0419999999999998,"15min":2.0419999999999998},"last":1.212}]},{"osd":7,"last update":"Fri Sep 13 06:44:31 2024","interfaces":[{"interface":"back","average":{"1min":0.97799999999999998,"5min":1.0529999999999999,"15min":1.0649999999999999},"min":{"1min":0.57799999999999996,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.381,"5min":1.9419999999999999,"15min":1.9419999999999999},"last":1.0680000000000001},{"interface":"front","average":{"1min":0.97899999999999998,"5min":0.96999999999999997,"15min":0.96799999999999997},"min":{"1min":0.64100000000000001,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.4750000000000001,"5min":1.901,"15min":1.901},"last":1.284}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6552,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8096,"internal_metadata":0}]}} 2024-09-13T06:45:08.348 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-09-13T06:39:26.336261+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=39, tm_sec=26, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=44, tm_sec=43, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:45:08.348 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-09-13T06:39:26.336261+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=39, tm_sec=26, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=44, tm_sec=43, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:45:08.348 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-09-13T06:39:26.336261+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=39, tm_sec=26, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=44, tm_sec=43, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:45:08.349 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-09-13T06:39:26.336261+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=39, tm_sec=26, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=44, tm_sec=43, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:45:08.349 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-09-13T06:39:16.508974+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=39, tm_sec=16, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=44, tm_sec=43, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:45:08.349 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-09-13T06:39:16.508974+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=39, tm_sec=16, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=44, tm_sec=43, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:45:08.349 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-09-13T06:39:26.336261+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=39, tm_sec=26, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=44, tm_sec=43, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:45:08.349 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-09-13T06:39:26.336261+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=39, tm_sec=26, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=44, tm_sec=43, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:45:08.349 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-09-13T06:39:26.336261+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=39, tm_sec=26, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=44, tm_sec=43, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:45:08.350 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-09-13T06:39:26.336261+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=39, tm_sec=26, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=44, tm_sec=43, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:45:08.350 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-09-13T06:39:26.336261+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=39, tm_sec=26, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=44, tm_sec=43, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:45:08.350 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-13T06:45:28.351 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T06:45:28.669 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T06:45:28.671 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-09-13T06:45:28.689 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":487,"stamp":"2024-09-13T06:45:27.624736+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590406,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":237398,"num_read_kb":1402962,"num_write":33483,"num_write_kb":1011328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9257,"num_bytes_recovered":444809309,"num_keys_recovered":867,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":24613,"ondisk_log_size":24613,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":486568,"kb_used_data":30120,"kb_used_omap":26,"kb_used_meta":456357,"kb_avail":754488152,"statfs":{"total":773094113280,"available":772595867648,"internally_reserved":0,"allocated":30842880,"data_stored":16035540,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":27392,"internal_metadata":467309824},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003838"},"pg_stats":[{"pgid":"3.1f","version":"280'781","reported_seq":6299,"reported_epoch":305,"state":"active+clean","last_fresh":"2024-09-13T06:44:46.378439+0000","last_change":"2024-09-13T06:44:46.378523+0000","last_active":"2024-09-13T06:44:46.378439+0000","last_peered":"2024-09-13T06:44:46.378439+0000","last_clean":"2024-09-13T06:44:46.378439+0000","last_became_active":"2024-09-13T06:40:57.385213+0000","last_became_peered":"2024-09-13T06:40:57.385213+0000","last_unstale":"2024-09-13T06:44:46.378439+0000","last_undegraded":"2024-09-13T06:44:46.378439+0000","last_fullsized":"2024-09-13T06:44:46.378439+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"280'781","last_scrub_stamp":"2024-09-13T06:44:46.378420+0000","last_deep_scrub":"280'781","last_deep_scrub_stamp":"2024-09-13T06:44:46.378420+0000","last_clean_scrub_stamp":"2024-09-13T06:44:46.378420+0000","objects_scrubbed":0,"log_size":781,"log_dups_size":0,"ondisk_log_size":781,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:36:51.432129+0000","scrub_duration":0.002758277,"objects_trimmed":0,"snaptrim_duration":0.00056495999999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6518,"num_read_kb":34199,"num_write":1043,"num_write_kb":37100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":72,"num_bytes_recovered":6114482,"num_keys_recovered":44,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"271'1110","reported_seq":7435,"reported_epoch":305,"state":"active+clean","last_fresh":"2024-09-13T06:44:54.010916+0000","last_change":"2024-09-13T06:44:54.010916+0000","last_active":"2024-09-13T06:44:54.010916+0000","last_peered":"2024-09-13T06:44:54.010916+0000","last_clean":"2024-09-13T06:44:54.010916+0000","last_became_active":"2024-09-13T06:44:20.460702+0000","last_became_peered":"2024-09-13T06:44:20.460702+0000","last_unstale":"2024-09-13T06:44:54.010916+0000","last_undegraded":"2024-09-13T06:44:54.010916+0000","last_fullsized":"2024-09-13T06:44:54.010916+0000","mapping_epoch":290,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":291,"parent":"0.0","parent_split_bits":0,"last_scrub":"271'1110","last_scrub_stamp":"2024-09-13T06:44:54.010626+0000","last_deep_scrub":"271'1110","last_deep_scrub_stamp":"2024-09-13T06:44:54.010626+0000","last_clean_scrub_stamp":"2024-09-13T06:44:54.010626+0000","objects_scrubbed":0,"log_size":1110,"log_dups_size":0,"ondisk_log_size":1110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:16:23.356449+0000","scrub_duration":0.0038375079999999999,"objects_trimmed":0,"snaptrim_duration":0.0013343369999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8806,"num_read_kb":55237,"num_write":1632,"num_write_kb":29160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":491,"num_bytes_recovered":16489974,"num_keys_recovered":55,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"279'1047","reported_seq":5669,"reported_epoch":305,"state":"active+clean","last_fresh":"2024-09-13T06:44:50.226163+0000","last_change":"2024-09-13T06:44:50.226163+0000","last_active":"2024-09-13T06:44:50.226163+0000","last_peered":"2024-09-13T06:44:50.226163+0000","last_clean":"2024-09-13T06:44:50.226163+0000","last_became_active":"2024-09-13T06:44:30.803142+0000","last_became_peered":"2024-09-13T06:44:30.803142+0000","last_unstale":"2024-09-13T06:44:50.226163+0000","last_undegraded":"2024-09-13T06:44:50.226163+0000","last_fullsized":"2024-09-13T06:44:50.226163+0000","mapping_epoch":300,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":301,"parent":"0.0","parent_split_bits":0,"last_scrub":"279'1047","last_scrub_stamp":"2024-09-13T06:44:50.225808+0000","last_deep_scrub":"279'1047","last_deep_scrub_stamp":"2024-09-13T06:44:50.225808+0000","last_clean_scrub_stamp":"2024-09-13T06:44:50.225808+0000","objects_scrubbed":0,"log_size":1047,"log_dups_size":0,"ondisk_log_size":1047,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:21:28.074287+0000","scrub_duration":0.0042489160000000002,"objects_trimmed":0,"snaptrim_duration":0.00088262599999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6265,"num_read_kb":28067,"num_write":1605,"num_write_kb":33265,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":206,"num_bytes_recovered":8442088,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1c","version":"305'844","reported_seq":8408,"reported_epoch":305,"state":"active+clean","last_fresh":"2024-09-13T06:45:11.243606+0000","last_change":"2024-09-13T06:45:11.243886+0000","last_active":"2024-09-13T06:45:11.243606+0000","last_peered":"2024-09-13T06:45:11.243606+0000","last_clean":"2024-09-13T06:45:11.243606+0000","last_became_active":"2024-09-13T06:44:30.801783+0000","last_became_peered":"2024-09-13T06:44:30.801783+0000","last_unstale":"2024-09-13T06:45:11.243606+0000","last_undegraded":"2024-09-13T06:45:11.243606+0000","last_fullsized":"2024-09-13T06:45:11.243606+0000","mapping_epoch":300,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":301,"parent":"0.0","parent_split_bits":0,"last_scrub":"305'844","last_scrub_stamp":"2024-09-13T06:45:11.243552+0000","last_deep_scrub":"305'844","last_deep_scrub_stamp":"2024-09-13T06:45:11.243552+0000","last_clean_scrub_stamp":"2024-09-13T06:45:11.243552+0000","objects_scrubbed":1,"log_size":844,"log_dups_size":0,"ondisk_log_size":844,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:52:33.081334+0000","scrub_duration":0.0066046960000000002,"objects_trimmed":0,"snaptrim_duration":0.001581236,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9390,"num_read_kb":69964,"num_write":963,"num_write_kb":31840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":350,"num_bytes_recovered":42380134,"num_keys_recovered":286,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"277'852","reported_seq":5183,"reported_epoch":305,"state":"active+clean","last_fresh":"2024-09-13T06:44:54.343402+0000","last_change":"2024-09-13T06:44:54.343728+0000","last_active":"2024-09-13T06:44:54.343402+0000","last_peered":"2024-09-13T06:44:54.343402+0000","last_clean":"2024-09-13T06:44:54.343402+0000","last_became_active":"2024-09-13T06:43:31.415608+0000","last_became_peered":"2024-09-13T06:43:31.415608+0000","last_unstale":"2024-09-13T06:44:54.343402+0000","last_undegraded":"2024-09-13T06:44:54.343402+0000","last_fullsized":"2024-09-13T06:44:54.343402+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"277'852","last_scrub_stamp":"2024-09-13T06:44:54.343349+0000","last_deep_scrub":"277'852","last_deep_scrub_stamp":"2024-09-13T06:44:54.343349+0000","last_clean_scrub_stamp":"2024-09-13T06:44:54.343349+0000","objects_scrubbed":0,"log_size":852,"log_dups_size":0,"ondisk_log_size":852,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:43:36.373684+0000","scrub_duration":0.0039275239999999999,"objects_trimmed":0,"snaptrim_duration":0.00060857399999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5714,"num_read_kb":37037,"num_write":1079,"num_write_kb":33376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":295,"num_bytes_recovered":25415745,"num_keys_recovered":55,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"305'498","reported_seq":7770,"reported_epoch":305,"state":"active+clean","last_fresh":"2024-09-13T06:44:47.710656+0000","last_change":"2024-09-13T06:44:47.710917+0000","last_active":"2024-09-13T06:44:47.710656+0000","last_peered":"2024-09-13T06:44:47.710656+0000","last_clean":"2024-09-13T06:44:47.710656+0000","last_became_active":"2024-09-13T06:44:20.462185+0000","last_became_peered":"2024-09-13T06:44:20.462185+0000","last_unstale":"2024-09-13T06:44:47.710656+0000","last_undegraded":"2024-09-13T06:44:47.710656+0000","last_fullsized":"2024-09-13T06:44:47.710656+0000","mapping_epoch":290,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":291,"parent":"0.0","parent_split_bits":0,"last_scrub":"305'498","last_scrub_stamp":"2024-09-13T06:44:47.710602+0000","last_deep_scrub":"305'498","last_deep_scrub_stamp":"2024-09-13T06:44:47.710602+0000","last_clean_scrub_stamp":"2024-09-13T06:44:47.710602+0000","objects_scrubbed":1,"log_size":498,"log_dups_size":0,"ondisk_log_size":498,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:43:44.349737+0000","scrub_duration":0.0053964130000000001,"objects_trimmed":0,"snaptrim_duration":0.00078923399999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6439,"num_read_kb":42977,"num_write":667,"num_write_kb":32420,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":728,"num_bytes_recovered":12986751,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"275'680","reported_seq":8582,"reported_epoch":305,"state":"active+clean","last_fresh":"2024-09-13T06:45:00.297053+0000","last_change":"2024-09-13T06:45:00.297277+0000","last_active":"2024-09-13T06:45:00.297053+0000","last_peered":"2024-09-13T06:45:00.297053+0000","last_clean":"2024-09-13T06:45:00.297053+0000","last_became_active":"2024-09-13T06:44:21.442872+0000","last_became_peered":"2024-09-13T06:44:21.442872+0000","last_unstale":"2024-09-13T06:45:00.297053+0000","last_undegraded":"2024-09-13T06:45:00.297053+0000","last_fullsized":"2024-09-13T06:45:00.297053+0000","mapping_epoch":291,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":292,"parent":"0.0","parent_split_bits":0,"last_scrub":"275'680","last_scrub_stamp":"2024-09-13T06:45:00.296999+0000","last_deep_scrub":"275'680","last_deep_scrub_stamp":"2024-09-13T06:45:00.296999+0000","last_clean_scrub_stamp":"2024-09-13T06:45:00.296999+0000","objects_scrubbed":0,"log_size":680,"log_dups_size":0,"ondisk_log_size":680,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:39:13.675929+0000","scrub_duration":0.0033395040000000001,"objects_trimmed":0,"snaptrim_duration":0.00079955100000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8400,"num_read_kb":35906,"num_write":738,"num_write_kb":28560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":398,"num_bytes_recovered":17539742,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"272'684","reported_seq":7058,"reported_epoch":305,"state":"active+clean","last_fresh":"2024-09-13T06:44:51.086838+0000","last_change":"2024-09-13T06:44:51.087089+0000","last_active":"2024-09-13T06:44:51.086838+0000","last_peered":"2024-09-13T06:44:51.086838+0000","last_clean":"2024-09-13T06:44:51.086838+0000","last_became_active":"2024-09-13T06:41:14.395301+0000","last_became_peered":"2024-09-13T06:41:14.395301+0000","last_unstale":"2024-09-13T06:44:51.086838+0000","last_undegraded":"2024-09-13T06:44:51.086838+0000","last_fullsized":"2024-09-13T06:44:51.086838+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"272'684","last_scrub_stamp":"2024-09-13T06:44:51.086786+0000","last_deep_scrub":"272'684","last_deep_scrub_stamp":"2024-09-13T06:44:51.086786+0000","last_clean_scrub_stamp":"2024-09-13T06:44:51.086786+0000","objects_scrubbed":0,"log_size":684,"log_dups_size":0,"ondisk_log_size":684,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:32:39.273971+0000","scrub_duration":0.0040833859999999996,"objects_trimmed":0,"snaptrim_duration":0.00092758900000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6571,"num_read_kb":55194,"num_write":838,"num_write_kb":38872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":117,"num_bytes_recovered":13142180,"num_keys_recovered":22,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"275'1525","reported_seq":5972,"reported_epoch":305,"state":"active+clean","last_fresh":"2024-09-13T06:44:53.358765+0000","last_change":"2024-09-13T06:44:53.359002+0000","last_active":"2024-09-13T06:44:53.358765+0000","last_peered":"2024-09-13T06:44:53.358765+0000","last_clean":"2024-09-13T06:44:53.358765+0000","last_became_active":"2024-09-13T06:43:22.521039+0000","last_became_peered":"2024-09-13T06:43:22.521039+0000","last_unstale":"2024-09-13T06:44:53.358765+0000","last_undegraded":"2024-09-13T06:44:53.358765+0000","last_fullsized":"2024-09-13T06:44:53.358765+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"275'1525","last_scrub_stamp":"2024-09-13T06:44:53.358711+0000","last_deep_scrub":"275'1525","last_deep_scrub_stamp":"2024-09-13T06:44:53.358711+0000","last_clean_scrub_stamp":"2024-09-13T06:44:53.358711+0000","objects_scrubbed":0,"log_size":1525,"log_dups_size":0,"ondisk_log_size":1525,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:51:26.451347+0000","scrub_duration":0.0041147739999999999,"objects_trimmed":0,"snaptrim_duration":0.00029931499999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9655,"num_read_kb":41824,"num_write":2232,"num_write_kb":32733,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":112,"num_bytes_recovered":14950263,"num_keys_recovered":22,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"275'715","reported_seq":5277,"reported_epoch":305,"state":"active+clean","last_fresh":"2024-09-13T06:44:34.866285+0000","last_change":"2024-09-13T06:44:30.806149+0000","last_active":"2024-09-13T06:44:34.866285+0000","last_peered":"2024-09-13T06:44:34.866285+0000","last_clean":"2024-09-13T06:44:34.866285+0000","last_became_active":"2024-09-13T06:44:30.798028+0000","last_became_peered":"2024-09-13T06:44:30.798028+0000","last_unstale":"2024-09-13T06:44:34.866285+0000","last_undegraded":"2024-09-13T06:44:34.866285+0000","last_fullsized":"2024-09-13T06:44:34.866285+0000","mapping_epoch":300,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":301,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":715,"log_dups_size":0,"ondisk_log_size":715,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0024960030000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5101,"num_read_kb":28279,"num_write":1028,"num_write_kb":23183,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":197,"num_bytes_recovered":7394092,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"277'365","reported_seq":6175,"reported_epoch":305,"state":"active+clean","last_fresh":"2024-09-13T06:44:47.700628+0000","last_change":"2024-09-13T06:44:05.457231+0000","last_active":"2024-09-13T06:44:47.700628+0000","last_peered":"2024-09-13T06:44:47.700628+0000","last_clean":"2024-09-13T06:44:47.700628+0000","last_became_active":"2024-09-13T06:42:33.408009+0000","last_became_peered":"2024-09-13T06:42:33.408009+0000","last_unstale":"2024-09-13T06:44:47.700628+0000","last_undegraded":"2024-09-13T06:44:47.700628+0000","last_fullsized":"2024-09-13T06:44:47.700628+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":365,"log_dups_size":0,"ondisk_log_size":365,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0024654690000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5036,"num_read_kb":48021,"num_write":472,"num_write_kb":27276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":157,"num_bytes_recovered":13242563,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"280'579","reported_seq":9972,"reported_epoch":305,"state":"active+clean","last_fresh":"2024-09-13T06:44:52.694031+0000","last_change":"2024-09-13T06:44:52.694333+0000","last_active":"2024-09-13T06:44:52.694031+0000","last_peered":"2024-09-13T06:44:52.694031+0000","last_clean":"2024-09-13T06:44:52.694031+0000","last_became_active":"2024-09-13T06:44:03.438897+0000","last_became_peered":"2024-09-13T06:44:03.438897+0000","last_unstale":"2024-09-13T06:44:52.694031+0000","last_undegraded":"2024-09-13T06:44:52.694031+0000","last_fullsized":"2024-09-13T06:44:52.694031+0000","mapping_epoch":277,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":278,"parent":"0.0","parent_split_bits":0,"last_scrub":"280'579","last_scrub_stamp":"2024-09-13T06:44:52.693977+0000","last_deep_scrub":"280'579","last_deep_scrub_stamp":"2024-09-13T06:44:52.693977+0000","last_clean_scrub_stamp":"2024-09-13T06:44:52.693977+0000","objects_scrubbed":0,"log_size":579,"log_dups_size":0,"ondisk_log_size":579,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:13:33.654445+0000","scrub_duration":0.0038818189999999999,"objects_trimmed":0,"snaptrim_duration":0.0012901029999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8875,"num_read_kb":61758,"num_write":769,"num_write_kb":30278,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":506,"num_bytes_recovered":26184965,"num_keys_recovered":33,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":39,"reported_epoch":305,"state":"active+clean","last_fresh":"2024-09-13T06:44:51.064312+0000","last_change":"2024-09-13T06:44:51.064528+0000","last_active":"2024-09-13T06:44:51.064312+0000","last_peered":"2024-09-13T06:44:51.064312+0000","last_clean":"2024-09-13T06:44:51.064312+0000","last_became_active":"2024-09-13T06:44:16.449558+0000","last_became_peered":"2024-09-13T06:44:16.449558+0000","last_unstale":"2024-09-13T06:44:51.064312+0000","last_undegraded":"2024-09-13T06:44:51.064312+0000","last_fullsized":"2024-09-13T06:44:51.064312+0000","mapping_epoch":286,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":287,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:44:51.064263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:44:51.064263+0000","last_clean_scrub_stamp":"2024-09-13T06:44:51.064263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:19:23.848694+0000","scrub_duration":0.0030511409999999998,"objects_trimmed":0,"snaptrim_duration":0.00080324699999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"280'643","reported_seq":10772,"reported_epoch":305,"state":"active+clean","last_fresh":"2024-09-13T06:44:56.339062+0000","last_change":"2024-09-13T06:44:56.339345+0000","last_active":"2024-09-13T06:44:56.339062+0000","last_peered":"2024-09-13T06:44:56.339062+0000","last_clean":"2024-09-13T06:44:56.339062+0000","last_became_active":"2024-09-13T06:44:22.449195+0000","last_became_peered":"2024-09-13T06:44:22.449195+0000","last_unstale":"2024-09-13T06:44:56.339062+0000","last_undegraded":"2024-09-13T06:44:56.339062+0000","last_fullsized":"2024-09-13T06:44:56.339062+0000","mapping_epoch":292,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":293,"parent":"0.0","parent_split_bits":0,"last_scrub":"280'643","last_scrub_stamp":"2024-09-13T06:44:56.339007+0000","last_deep_scrub":"280'643","last_deep_scrub_stamp":"2024-09-13T06:44:56.339007+0000","last_clean_scrub_stamp":"2024-09-13T06:44:56.339007+0000","objects_scrubbed":0,"log_size":643,"log_dups_size":0,"ondisk_log_size":643,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:49:08.541338+0000","scrub_duration":0.0041333009999999998,"objects_trimmed":0,"snaptrim_duration":0.00080400600000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9397,"num_read_kb":51433,"num_write":883,"num_write_kb":40908,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":358,"num_bytes_recovered":1257624,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":36,"reported_epoch":305,"state":"active+clean","last_fresh":"2024-09-13T06:44:49.375451+0000","last_change":"2024-09-13T06:44:49.375674+0000","last_active":"2024-09-13T06:44:49.375451+0000","last_peered":"2024-09-13T06:44:49.375451+0000","last_clean":"2024-09-13T06:44:49.375451+0000","last_became_active":"2024-09-13T06:44:18.458454+0000","last_became_peered":"2024-09-13T06:44:18.458454+0000","last_unstale":"2024-09-13T06:44:49.375451+0000","last_undegraded":"2024-09-13T06:44:49.375451+0000","last_fullsized":"2024-09-13T06:44:49.375451+0000","mapping_epoch":288,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":289,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:44:49.375404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:44:49.375404+0000","last_clean_scrub_stamp":"2024-09-13T06:44:49.375404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:43:00.584483+0000","scrub_duration":0.0037092570000000001,"objects_trimmed":0,"snaptrim_duration":0.00097079800000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"277'694","reported_seq":7072,"reported_epoch":305,"state":"active+clean","last_fresh":"2024-09-13T06:45:01.132229+0000","last_change":"2024-09-13T06:45:01.132564+0000","last_active":"2024-09-13T06:45:01.132229+0000","last_peered":"2024-09-13T06:45:01.132229+0000","last_clean":"2024-09-13T06:45:01.132229+0000","last_became_active":"2024-09-13T06:42:32.413006+0000","last_became_peered":"2024-09-13T06:42:32.413006+0000","last_unstale":"2024-09-13T06:45:01.132229+0000","last_undegraded":"2024-09-13T06:45:01.132229+0000","last_fullsized":"2024-09-13T06:45:01.132229+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"277'694","last_scrub_stamp":"2024-09-13T06:45:01.132175+0000","last_deep_scrub":"277'694","last_deep_scrub_stamp":"2024-09-13T06:45:01.132175+0000","last_clean_scrub_stamp":"2024-09-13T06:45:01.132175+0000","objects_scrubbed":0,"log_size":694,"log_dups_size":0,"ondisk_log_size":694,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:56:06.782004+0000","scrub_duration":0.0035896259999999998,"objects_trimmed":0,"snaptrim_duration":0.001338379,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6521,"num_read_kb":33119,"num_write":812,"num_write_kb":30039,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":213,"num_bytes_recovered":15100645,"num_keys_recovered":11,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":193,"reported_epoch":305,"state":"active+clean","last_fresh":"2024-09-13T06:45:02.749503+0000","last_change":"2024-09-13T06:45:02.749797+0000","last_active":"2024-09-13T06:45:02.749503+0000","last_peered":"2024-09-13T06:45:02.749503+0000","last_clean":"2024-09-13T06:45:02.749503+0000","last_became_active":"2024-09-13T06:42:28.562827+0000","last_became_peered":"2024-09-13T06:42:28.562827+0000","last_unstale":"2024-09-13T06:45:02.749503+0000","last_undegraded":"2024-09-13T06:45:02.749503+0000","last_fullsized":"2024-09-13T06:45:02.749503+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:45:02.749451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:45:02.749451+0000","last_clean_scrub_stamp":"2024-09-13T06:45:02.749451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:09:21.603602+0000","scrub_duration":0.003504198,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"277'961","reported_seq":6903,"reported_epoch":305,"state":"active+clean","last_fresh":"2024-09-13T06:45:01.305601+0000","last_change":"2024-09-13T06:45:01.305820+0000","last_active":"2024-09-13T06:45:01.305601+0000","last_peered":"2024-09-13T06:45:01.305601+0000","last_clean":"2024-09-13T06:45:01.305601+0000","last_became_active":"2024-09-13T06:44:22.450933+0000","last_became_peered":"2024-09-13T06:44:22.450933+0000","last_unstale":"2024-09-13T06:45:01.305601+0000","last_undegraded":"2024-09-13T06:45:01.305601+0000","last_fullsized":"2024-09-13T06:45:01.305601+0000","mapping_epoch":292,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":293,"parent":"0.0","parent_split_bits":0,"last_scrub":"277'961","last_scrub_stamp":"2024-09-13T06:45:01.305551+0000","last_deep_scrub":"277'961","last_deep_scrub_stamp":"2024-09-13T06:45:01.305551+0000","last_clean_scrub_stamp":"2024-09-13T06:45:01.305551+0000","objects_scrubbed":0,"log_size":961,"log_dups_size":0,"ondisk_log_size":961,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:42:15.554591+0000","scrub_duration":0.0037257969999999999,"objects_trimmed":0,"snaptrim_duration":0.0031147280000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7705,"num_read_kb":38648,"num_write":1332,"num_write_kb":32653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":354,"num_bytes_recovered":6765835,"num_keys_recovered":11,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":36,"reported_epoch":305,"state":"active+clean","last_fresh":"2024-09-13T06:44:45.496398+0000","last_change":"2024-09-13T06:44:45.496541+0000","last_active":"2024-09-13T06:44:45.496398+0000","last_peered":"2024-09-13T06:44:45.496398+0000","last_clean":"2024-09-13T06:44:45.496398+0000","last_became_active":"2024-09-13T06:44:18.467833+0000","last_became_peered":"2024-09-13T06:44:18.467833+0000","last_unstale":"2024-09-13T06:44:45.496398+0000","last_undegraded":"2024-09-13T06:44:45.496398+0000","last_fullsized":"2024-09-13T06:44:45.496398+0000","mapping_epoch":288,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":289,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:44:45.496366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:44:45.496366+0000","last_clean_scrub_stamp":"2024-09-13T06:44:45.496366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:36:11.510118+0000","scrub_duration":0.0016611639999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"277'640","reported_seq":7767,"reported_epoch":305,"state":"active+clean","last_fresh":"2024-09-13T06:45:09.281827+0000","last_change":"2024-09-13T06:45:09.282063+0000","last_active":"2024-09-13T06:45:09.281827+0000","last_peered":"2024-09-13T06:45:09.281827+0000","last_clean":"2024-09-13T06:45:09.281827+0000","last_became_active":"2024-09-13T06:44:30.797769+0000","last_became_peered":"2024-09-13T06:44:30.797769+0000","last_unstale":"2024-09-13T06:45:09.281827+0000","last_undegraded":"2024-09-13T06:45:09.281827+0000","last_fullsized":"2024-09-13T06:45:09.281827+0000","mapping_epoch":300,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":301,"parent":"0.0","parent_split_bits":0,"last_scrub":"277'640","last_scrub_stamp":"2024-09-13T06:45:09.281771+0000","last_deep_scrub":"277'640","last_deep_scrub_stamp":"2024-09-13T06:45:09.281771+0000","last_clean_scrub_stamp":"2024-09-13T06:45:09.281771+0000","objects_scrubbed":0,"log_size":640,"log_dups_size":0,"ondisk_log_size":640,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:50:16.723750+0000","scrub_duration":0.0042953720000000004,"objects_trimmed":0,"snaptrim_duration":0.0046689339999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7611,"num_read_kb":41345,"num_write":1018,"num_write_kb":26620,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":158,"num_bytes_recovered":4212424,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"305'992","reported_seq":21087,"reported_epoch":305,"state":"active+clean","last_fresh":"2024-09-13T06:44:54.706382+0000","last_change":"2024-09-13T06:44:54.706632+0000","last_active":"2024-09-13T06:44:54.706382+0000","last_peered":"2024-09-13T06:44:54.706382+0000","last_clean":"2024-09-13T06:44:54.706382+0000","last_became_active":"2024-09-13T06:44:28.768976+0000","last_became_peered":"2024-09-13T06:44:28.768976+0000","last_unstale":"2024-09-13T06:44:54.706382+0000","last_undegraded":"2024-09-13T06:44:54.706382+0000","last_fullsized":"2024-09-13T06:44:54.706382+0000","mapping_epoch":298,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":299,"parent":"0.0","parent_split_bits":0,"last_scrub":"305'992","last_scrub_stamp":"2024-09-13T06:44:54.706326+0000","last_deep_scrub":"305'992","last_deep_scrub_stamp":"2024-09-13T06:44:54.706326+0000","last_clean_scrub_stamp":"2024-09-13T06:44:54.706326+0000","objects_scrubbed":1,"log_size":992,"log_dups_size":0,"ondisk_log_size":992,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:19:39.648227+0000","scrub_duration":0.0074843890000000001,"objects_trimmed":0,"snaptrim_duration":0.0017436419999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20994,"num_read_kb":92583,"num_write":1315,"num_write_kb":30385,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":207,"num_bytes_recovered":9898606,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"305'3","reported_seq":138,"reported_epoch":305,"state":"active+clean","last_fresh":"2024-09-13T06:45:21.211827+0000","last_change":"2024-09-13T06:45:21.212104+0000","last_active":"2024-09-13T06:45:21.211827+0000","last_peered":"2024-09-13T06:45:21.211827+0000","last_clean":"2024-09-13T06:45:21.211827+0000","last_became_active":"2024-09-13T06:44:30.794134+0000","last_became_peered":"2024-09-13T06:44:30.794134+0000","last_unstale":"2024-09-13T06:45:21.211827+0000","last_undegraded":"2024-09-13T06:45:21.211827+0000","last_fullsized":"2024-09-13T06:45:21.211827+0000","mapping_epoch":300,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":301,"parent":"0.0","parent_split_bits":0,"last_scrub":"305'3","last_scrub_stamp":"2024-09-13T06:45:21.211769+0000","last_deep_scrub":"305'3","last_deep_scrub_stamp":"2024-09-13T06:45:21.211769+0000","last_clean_scrub_stamp":"2024-09-13T06:45:21.211769+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:57:30.544001+0000","scrub_duration":0.0068074579999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":57,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"278'857","reported_seq":10784,"reported_epoch":305,"state":"active+clean","last_fresh":"2024-09-13T06:44:59.325085+0000","last_change":"2024-09-13T06:44:59.325329+0000","last_active":"2024-09-13T06:44:59.325085+0000","last_peered":"2024-09-13T06:44:59.325085+0000","last_clean":"2024-09-13T06:44:59.325085+0000","last_became_active":"2024-09-13T06:44:21.442847+0000","last_became_peered":"2024-09-13T06:44:21.442847+0000","last_unstale":"2024-09-13T06:44:59.325085+0000","last_undegraded":"2024-09-13T06:44:59.325085+0000","last_fullsized":"2024-09-13T06:44:59.325085+0000","mapping_epoch":291,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":292,"parent":"0.0","parent_split_bits":0,"last_scrub":"278'857","last_scrub_stamp":"2024-09-13T06:44:59.325032+0000","last_deep_scrub":"278'857","last_deep_scrub_stamp":"2024-09-13T06:44:59.325032+0000","last_clean_scrub_stamp":"2024-09-13T06:44:59.325032+0000","objects_scrubbed":0,"log_size":857,"log_dups_size":0,"ondisk_log_size":857,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:25:42.057889+0000","scrub_duration":0.0037999230000000002,"objects_trimmed":0,"snaptrim_duration":0.00053211199999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11278,"num_read_kb":63107,"num_write":1190,"num_write_kb":36968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":351,"num_bytes_recovered":9847094,"num_keys_recovered":11,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":38,"reported_epoch":305,"state":"active+clean","last_fresh":"2024-09-13T06:44:49.759291+0000","last_change":"2024-09-13T06:44:49.759572+0000","last_active":"2024-09-13T06:44:49.759291+0000","last_peered":"2024-09-13T06:44:49.759291+0000","last_clean":"2024-09-13T06:44:49.759291+0000","last_became_active":"2024-09-13T06:44:17.443358+0000","last_became_peered":"2024-09-13T06:44:17.443358+0000","last_unstale":"2024-09-13T06:44:49.759291+0000","last_undegraded":"2024-09-13T06:44:49.759291+0000","last_fullsized":"2024-09-13T06:44:49.759291+0000","mapping_epoch":287,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":288,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:44:49.759238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:44:49.759238+0000","last_clean_scrub_stamp":"2024-09-13T06:44:49.759238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:01:14.724152+0000","scrub_duration":0.0032066769999999998,"objects_trimmed":0,"snaptrim_duration":0.00033592499999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"277'1115","reported_seq":6270,"reported_epoch":305,"state":"active+clean","last_fresh":"2024-09-13T06:44:57.361972+0000","last_change":"2024-09-13T06:44:57.362244+0000","last_active":"2024-09-13T06:44:57.361972+0000","last_peered":"2024-09-13T06:44:57.361972+0000","last_clean":"2024-09-13T06:44:57.361972+0000","last_became_active":"2024-09-13T06:44:30.798508+0000","last_became_peered":"2024-09-13T06:44:30.798508+0000","last_unstale":"2024-09-13T06:44:57.361972+0000","last_undegraded":"2024-09-13T06:44:57.361972+0000","last_fullsized":"2024-09-13T06:44:57.361972+0000","mapping_epoch":300,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":301,"parent":"0.0","parent_split_bits":0,"last_scrub":"277'1115","last_scrub_stamp":"2024-09-13T06:44:57.361917+0000","last_deep_scrub":"277'1115","last_deep_scrub_stamp":"2024-09-13T06:44:57.361917+0000","last_clean_scrub_stamp":"2024-09-13T06:44:57.361917+0000","objects_scrubbed":0,"log_size":1115,"log_dups_size":0,"ondisk_log_size":1115,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:16:22.708238+0000","scrub_duration":0.0035611200000000001,"objects_trimmed":0,"snaptrim_duration":0.0032283849999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7964,"num_read_kb":36198,"num_write":1645,"num_write_kb":33105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":243,"num_bytes_recovered":7863454,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":209,"reported_epoch":305,"state":"active+clean","last_fresh":"2024-09-13T06:45:05.771302+0000","last_change":"2024-09-13T06:45:05.771512+0000","last_active":"2024-09-13T06:45:05.771302+0000","last_peered":"2024-09-13T06:45:05.771302+0000","last_clean":"2024-09-13T06:45:05.771302+0000","last_became_active":"2024-09-13T06:44:18.456828+0000","last_became_peered":"2024-09-13T06:44:18.456828+0000","last_unstale":"2024-09-13T06:45:05.771302+0000","last_undegraded":"2024-09-13T06:45:05.771302+0000","last_fullsized":"2024-09-13T06:45:05.771302+0000","mapping_epoch":288,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":289,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:45:05.771253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:45:05.771253+0000","last_clean_scrub_stamp":"2024-09-13T06:45:05.771253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:09:48.503953+0000","scrub_duration":0.0033023660000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"279'349","reported_seq":3776,"reported_epoch":305,"state":"active+clean","last_fresh":"2024-09-13T06:44:56.046531+0000","last_change":"2024-09-13T06:44:56.046531+0000","last_active":"2024-09-13T06:44:56.046531+0000","last_peered":"2024-09-13T06:44:56.046531+0000","last_clean":"2024-09-13T06:44:56.046531+0000","last_became_active":"2024-09-13T06:41:15.399301+0000","last_became_peered":"2024-09-13T06:41:15.399301+0000","last_unstale":"2024-09-13T06:44:56.046531+0000","last_undegraded":"2024-09-13T06:44:56.046531+0000","last_fullsized":"2024-09-13T06:44:56.046531+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"279'349","last_scrub_stamp":"2024-09-13T06:44:56.046245+0000","last_deep_scrub":"279'349","last_deep_scrub_stamp":"2024-09-13T06:44:56.046245+0000","last_clean_scrub_stamp":"2024-09-13T06:44:56.046245+0000","objects_scrubbed":0,"log_size":349,"log_dups_size":0,"ondisk_log_size":349,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:52:24.133674+0000","scrub_duration":0.003821592,"objects_trimmed":0,"snaptrim_duration":0.001343293,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2523,"num_read_kb":19829,"num_write":427,"num_write_kb":20943,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":169,"num_bytes_recovered":5233325,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"305'2","reported_seq":69,"reported_epoch":305,"state":"active+clean","last_fresh":"2024-09-13T06:45:19.263140+0000","last_change":"2024-09-13T06:45:19.263361+0000","last_active":"2024-09-13T06:45:19.263140+0000","last_peered":"2024-09-13T06:45:19.263140+0000","last_clean":"2024-09-13T06:45:19.263140+0000","last_became_active":"2024-09-13T06:44:30.796877+0000","last_became_peered":"2024-09-13T06:44:30.796877+0000","last_unstale":"2024-09-13T06:45:19.263140+0000","last_undegraded":"2024-09-13T06:45:19.263140+0000","last_fullsized":"2024-09-13T06:45:19.263140+0000","mapping_epoch":300,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":301,"parent":"0.0","parent_split_bits":0,"last_scrub":"305'2","last_scrub_stamp":"2024-09-13T06:45:19.263083+0000","last_deep_scrub":"305'2","last_deep_scrub_stamp":"2024-09-13T06:45:19.263083+0000","last_clean_scrub_stamp":"2024-09-13T06:45:19.263083+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:26:41.281859+0000","scrub_duration":0.0067202219999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"305'119","reported_seq":411,"reported_epoch":305,"state":"active+clean","last_fresh":"2024-09-13T06:44:48.725331+0000","last_change":"2024-09-13T06:44:48.725596+0000","last_active":"2024-09-13T06:44:48.725331+0000","last_peered":"2024-09-13T06:44:48.725331+0000","last_clean":"2024-09-13T06:44:48.725331+0000","last_became_active":"2024-09-13T06:42:28.562642+0000","last_became_peered":"2024-09-13T06:42:28.562642+0000","last_unstale":"2024-09-13T06:44:48.725331+0000","last_undegraded":"2024-09-13T06:44:48.725331+0000","last_fullsized":"2024-09-13T06:44:48.725331+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"305'119","last_scrub_stamp":"2024-09-13T06:44:48.725274+0000","last_deep_scrub":"305'119","last_deep_scrub_stamp":"2024-09-13T06:44:48.725274+0000","last_clean_scrub_stamp":"2024-09-13T06:44:48.725274+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:06:03.567948+0000","scrub_duration":0.0090167430000000007,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"277'651","reported_seq":10863,"reported_epoch":305,"state":"active+clean","last_fresh":"2024-09-13T06:44:53.006080+0000","last_change":"2024-09-13T06:44:53.006305+0000","last_active":"2024-09-13T06:44:53.006080+0000","last_peered":"2024-09-13T06:44:53.006080+0000","last_clean":"2024-09-13T06:44:53.006080+0000","last_became_active":"2024-09-13T06:44:22.448736+0000","last_became_peered":"2024-09-13T06:44:22.448736+0000","last_unstale":"2024-09-13T06:44:53.006080+0000","last_undegraded":"2024-09-13T06:44:53.006080+0000","last_fullsized":"2024-09-13T06:44:53.006080+0000","mapping_epoch":292,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":293,"parent":"0.0","parent_split_bits":0,"last_scrub":"277'651","last_scrub_stamp":"2024-09-13T06:44:53.006028+0000","last_deep_scrub":"277'651","last_deep_scrub_stamp":"2024-09-13T06:44:53.006028+0000","last_clean_scrub_stamp":"2024-09-13T06:44:53.006028+0000","objects_scrubbed":0,"log_size":651,"log_dups_size":0,"ondisk_log_size":651,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:04:46.989212+0000","scrub_duration":0.0038846829999999999,"objects_trimmed":0,"snaptrim_duration":0.00083432600000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9552,"num_read_kb":46146,"num_write":828,"num_write_kb":32512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":446,"num_bytes_recovered":11977587,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"277'774","reported_seq":10956,"reported_epoch":305,"state":"active+clean","last_fresh":"2024-09-13T06:44:56.784127+0000","last_change":"2024-09-13T06:44:56.784408+0000","last_active":"2024-09-13T06:44:56.784127+0000","last_peered":"2024-09-13T06:44:56.784127+0000","last_clean":"2024-09-13T06:44:56.784127+0000","last_became_active":"2024-09-13T06:44:20.462849+0000","last_became_peered":"2024-09-13T06:44:20.462849+0000","last_unstale":"2024-09-13T06:44:56.784127+0000","last_undegraded":"2024-09-13T06:44:56.784127+0000","last_fullsized":"2024-09-13T06:44:56.784127+0000","mapping_epoch":290,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":291,"parent":"0.0","parent_split_bits":0,"last_scrub":"277'774","last_scrub_stamp":"2024-09-13T06:44:56.784076+0000","last_deep_scrub":"277'774","last_deep_scrub_stamp":"2024-09-13T06:44:56.784076+0000","last_clean_scrub_stamp":"2024-09-13T06:44:56.784076+0000","objects_scrubbed":0,"log_size":774,"log_dups_size":0,"ondisk_log_size":774,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:00:46.165167+0000","scrub_duration":0.0040360980000000001,"objects_trimmed":0,"snaptrim_duration":0.0024338839999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10729,"num_read_kb":51645,"num_write":931,"num_write_kb":34617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":445,"num_bytes_recovered":16579571,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"278'758","reported_seq":8294,"reported_epoch":305,"state":"active+clean","last_fresh":"2024-09-13T06:44:55.069007+0000","last_change":"2024-09-13T06:44:55.069219+0000","last_active":"2024-09-13T06:44:55.069007+0000","last_peered":"2024-09-13T06:44:55.069007+0000","last_clean":"2024-09-13T06:44:55.069007+0000","last_became_active":"2024-09-13T06:44:34.836417+0000","last_became_peered":"2024-09-13T06:44:34.836417+0000","last_unstale":"2024-09-13T06:44:55.069007+0000","last_undegraded":"2024-09-13T06:44:55.069007+0000","last_fullsized":"2024-09-13T06:44:55.069007+0000","mapping_epoch":304,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":305,"parent":"0.0","parent_split_bits":0,"last_scrub":"278'758","last_scrub_stamp":"2024-09-13T06:44:55.068956+0000","last_deep_scrub":"278'758","last_deep_scrub_stamp":"2024-09-13T06:44:55.068956+0000","last_clean_scrub_stamp":"2024-09-13T06:44:55.068956+0000","objects_scrubbed":0,"log_size":758,"log_dups_size":0,"ondisk_log_size":758,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:57:19.230829+0000","scrub_duration":0.0036149659999999998,"objects_trimmed":0,"snaptrim_duration":0.00085210600000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8422,"num_read_kb":47219,"num_write":883,"num_write_kb":28077,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":515,"num_bytes_recovered":28581300,"num_keys_recovered":111,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"271'845","reported_seq":5614,"reported_epoch":305,"state":"active+clean","last_fresh":"2024-09-13T06:45:03.188090+0000","last_change":"2024-09-13T06:45:03.188314+0000","last_active":"2024-09-13T06:45:03.188090+0000","last_peered":"2024-09-13T06:45:03.188090+0000","last_clean":"2024-09-13T06:45:03.188090+0000","last_became_active":"2024-09-13T06:41:15.399204+0000","last_became_peered":"2024-09-13T06:41:15.399204+0000","last_unstale":"2024-09-13T06:45:03.188090+0000","last_undegraded":"2024-09-13T06:45:03.188090+0000","last_fullsized":"2024-09-13T06:45:03.188090+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"271'845","last_scrub_stamp":"2024-09-13T06:45:03.188033+0000","last_deep_scrub":"271'845","last_deep_scrub_stamp":"2024-09-13T06:45:03.188033+0000","last_clean_scrub_stamp":"2024-09-13T06:45:03.188033+0000","objects_scrubbed":0,"log_size":845,"log_dups_size":0,"ondisk_log_size":845,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:47:23.126968+0000","scrub_duration":0.0035194789999999998,"objects_trimmed":0,"snaptrim_duration":0.00094468700000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6686,"num_read_kb":57840,"num_write":1181,"num_write_kb":24665,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":117,"num_bytes_recovered":13256568,"num_keys_recovered":44,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"279'569","reported_seq":6615,"reported_epoch":305,"state":"active+clean","last_fresh":"2024-09-13T06:44:59.229775+0000","last_change":"2024-09-13T06:44:59.230029+0000","last_active":"2024-09-13T06:44:59.229775+0000","last_peered":"2024-09-13T06:44:59.229775+0000","last_clean":"2024-09-13T06:44:59.229775+0000","last_became_active":"2024-09-13T06:44:30.794873+0000","last_became_peered":"2024-09-13T06:44:30.794873+0000","last_unstale":"2024-09-13T06:44:59.229775+0000","last_undegraded":"2024-09-13T06:44:59.229775+0000","last_fullsized":"2024-09-13T06:44:59.229775+0000","mapping_epoch":300,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":301,"parent":"0.0","parent_split_bits":0,"last_scrub":"279'569","last_scrub_stamp":"2024-09-13T06:44:59.229718+0000","last_deep_scrub":"279'569","last_deep_scrub_stamp":"2024-09-13T06:44:59.229718+0000","last_clean_scrub_stamp":"2024-09-13T06:44:59.229718+0000","objects_scrubbed":0,"log_size":569,"log_dups_size":0,"ondisk_log_size":569,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:49:38.735223+0000","scrub_duration":0.0039679950000000002,"objects_trimmed":0,"snaptrim_duration":0.0027493119999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6187,"num_read_kb":31727,"num_write":657,"num_write_kb":25682,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":184,"num_bytes_recovered":16410936,"num_keys_recovered":88,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"277'881","reported_seq":2936,"reported_epoch":305,"state":"active+clean","last_fresh":"2024-09-13T06:45:23.904714+0000","last_change":"2024-09-13T06:45:23.904933+0000","last_active":"2024-09-13T06:45:23.904714+0000","last_peered":"2024-09-13T06:45:23.904714+0000","last_clean":"2024-09-13T06:45:23.904714+0000","last_became_active":"2024-09-13T06:42:32.411927+0000","last_became_peered":"2024-09-13T06:42:32.411927+0000","last_unstale":"2024-09-13T06:45:23.904714+0000","last_undegraded":"2024-09-13T06:45:23.904714+0000","last_fullsized":"2024-09-13T06:45:23.904714+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"277'881","last_scrub_stamp":"2024-09-13T06:45:23.904660+0000","last_deep_scrub":"277'881","last_deep_scrub_stamp":"2024-09-13T06:45:23.904660+0000","last_clean_scrub_stamp":"2024-09-13T06:45:23.904660+0000","objects_scrubbed":0,"log_size":881,"log_dups_size":0,"ondisk_log_size":881,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:30:41.894311+0000","scrub_duration":0.0041225259999999996,"objects_trimmed":0,"snaptrim_duration":0.003013108,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4846,"num_read_kb":26164,"num_write":1518,"num_write_kb":30083,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":140,"num_bytes_recovered":11278110,"num_keys_recovered":11,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.e","version":"277'556","reported_seq":4115,"reported_epoch":305,"state":"active+clean","last_fresh":"2024-09-13T06:45:21.861468+0000","last_change":"2024-09-13T06:45:21.861737+0000","last_active":"2024-09-13T06:45:21.861468+0000","last_peered":"2024-09-13T06:45:21.861468+0000","last_clean":"2024-09-13T06:45:21.861468+0000","last_became_active":"2024-09-13T06:44:30.801655+0000","last_became_peered":"2024-09-13T06:44:30.801655+0000","last_unstale":"2024-09-13T06:45:21.861468+0000","last_undegraded":"2024-09-13T06:45:21.861468+0000","last_fullsized":"2024-09-13T06:45:21.861468+0000","mapping_epoch":300,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":301,"parent":"0.0","parent_split_bits":0,"last_scrub":"277'556","last_scrub_stamp":"2024-09-13T06:45:21.861415+0000","last_deep_scrub":"277'556","last_deep_scrub_stamp":"2024-09-13T06:45:21.861415+0000","last_clean_scrub_stamp":"2024-09-13T06:45:21.861415+0000","objects_scrubbed":0,"log_size":556,"log_dups_size":0,"ondisk_log_size":556,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:31:16.495405+0000","scrub_duration":0.0033968929999999998,"objects_trimmed":0,"snaptrim_duration":0.0025767619999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3868,"num_read_kb":43567,"num_write":654,"num_write_kb":29232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":503,"num_bytes_recovered":12695191,"num_keys_recovered":11,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"277'665","reported_seq":4756,"reported_epoch":305,"state":"active+clean","last_fresh":"2024-09-13T06:44:47.700516+0000","last_change":"2024-09-13T06:44:05.458214+0000","last_active":"2024-09-13T06:44:47.700516+0000","last_peered":"2024-09-13T06:44:47.700516+0000","last_clean":"2024-09-13T06:44:47.700516+0000","last_became_active":"2024-09-13T06:42:33.412054+0000","last_became_peered":"2024-09-13T06:42:33.412054+0000","last_unstale":"2024-09-13T06:44:47.700516+0000","last_undegraded":"2024-09-13T06:44:47.700516+0000","last_fullsized":"2024-09-13T06:44:47.700516+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:39:26.336261+0000","last_clean_scrub_stamp":"2024-09-13T06:39:26.336261+0000","objects_scrubbed":0,"log_size":665,"log_dups_size":0,"ondisk_log_size":665,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00285659,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4677,"num_read_kb":45287,"num_write":982,"num_write_kb":45285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":394,"num_bytes_recovered":42768786,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.10","version":"280'832","reported_seq":5047,"reported_epoch":305,"state":"active+clean","last_fresh":"2024-09-13T06:44:54.076963+0000","last_change":"2024-09-13T06:44:54.077211+0000","last_active":"2024-09-13T06:44:54.076963+0000","last_peered":"2024-09-13T06:44:54.076963+0000","last_clean":"2024-09-13T06:44:54.076963+0000","last_became_active":"2024-09-13T06:44:19.459617+0000","last_became_peered":"2024-09-13T06:44:19.459617+0000","last_unstale":"2024-09-13T06:44:54.076963+0000","last_undegraded":"2024-09-13T06:44:54.076963+0000","last_fullsized":"2024-09-13T06:44:54.076963+0000","mapping_epoch":289,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":290,"parent":"0.0","parent_split_bits":0,"last_scrub":"280'832","last_scrub_stamp":"2024-09-13T06:44:54.076908+0000","last_deep_scrub":"280'832","last_deep_scrub_stamp":"2024-09-13T06:44:54.076908+0000","last_clean_scrub_stamp":"2024-09-13T06:44:54.076908+0000","objects_scrubbed":0,"log_size":832,"log_dups_size":0,"ondisk_log_size":832,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:11:04.455152+0000","scrub_duration":0.0036414469999999999,"objects_trimmed":0,"snaptrim_duration":0.0018779840000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5715,"num_read_kb":29614,"num_write":1142,"num_write_kb":36190,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":275,"num_bytes_recovered":6622441,"num_keys_recovered":20,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.11","version":"279'502","reported_seq":6292,"reported_epoch":305,"state":"active+clean","last_fresh":"2024-09-13T06:45:24.915682+0000","last_change":"2024-09-13T06:45:24.915898+0000","last_active":"2024-09-13T06:45:24.915682+0000","last_peered":"2024-09-13T06:45:24.915682+0000","last_clean":"2024-09-13T06:45:24.915682+0000","last_became_active":"2024-09-13T06:42:33.411668+0000","last_became_peered":"2024-09-13T06:42:33.411668+0000","last_unstale":"2024-09-13T06:45:24.915682+0000","last_undegraded":"2024-09-13T06:45:24.915682+0000","last_fullsized":"2024-09-13T06:45:24.915682+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"279'502","last_scrub_stamp":"2024-09-13T06:45:24.915625+0000","last_deep_scrub":"279'502","last_deep_scrub_stamp":"2024-09-13T06:45:24.915625+0000","last_clean_scrub_stamp":"2024-09-13T06:45:24.915625+0000","objects_scrubbed":0,"log_size":502,"log_dups_size":0,"ondisk_log_size":502,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:47:10.617534+0000","scrub_duration":0.003740176,"objects_trimmed":0,"snaptrim_duration":0.001270492,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5341,"num_read_kb":34087,"num_write":659,"num_write_kb":25712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":245,"num_bytes_recovered":7089272,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"280'921","reported_seq":5059,"reported_epoch":305,"state":"active+clean","last_fresh":"2024-09-13T06:44:58.336531+0000","last_change":"2024-09-13T06:44:58.336745+0000","last_active":"2024-09-13T06:44:58.336531+0000","last_peered":"2024-09-13T06:44:58.336531+0000","last_clean":"2024-09-13T06:44:58.336531+0000","last_became_active":"2024-09-13T06:44:20.466713+0000","last_became_peered":"2024-09-13T06:44:20.466713+0000","last_unstale":"2024-09-13T06:44:58.336531+0000","last_undegraded":"2024-09-13T06:44:58.336531+0000","last_fullsized":"2024-09-13T06:44:58.336531+0000","mapping_epoch":290,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":291,"parent":"0.0","parent_split_bits":0,"last_scrub":"280'921","last_scrub_stamp":"2024-09-13T06:44:58.336451+0000","last_deep_scrub":"280'921","last_deep_scrub_stamp":"2024-09-13T06:44:58.336451+0000","last_clean_scrub_stamp":"2024-09-13T06:44:58.336451+0000","objects_scrubbed":0,"log_size":921,"log_dups_size":0,"ondisk_log_size":921,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:33:27.820931+0000","scrub_duration":0.0041990819999999998,"objects_trimmed":0,"snaptrim_duration":0.0017683250000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6025,"num_read_kb":38947,"num_write":1315,"num_write_kb":35656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":107,"num_bytes_recovered":3682200,"num_keys_recovered":21,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"279'604","reported_seq":4559,"reported_epoch":305,"state":"active+clean","last_fresh":"2024-09-13T06:45:06.749656+0000","last_change":"2024-09-13T06:45:06.749896+0000","last_active":"2024-09-13T06:45:06.749656+0000","last_peered":"2024-09-13T06:45:06.749656+0000","last_clean":"2024-09-13T06:45:06.749656+0000","last_became_active":"2024-09-13T06:42:31.402800+0000","last_became_peered":"2024-09-13T06:42:31.402800+0000","last_unstale":"2024-09-13T06:45:06.749656+0000","last_undegraded":"2024-09-13T06:45:06.749656+0000","last_fullsized":"2024-09-13T06:45:06.749656+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"279'604","last_scrub_stamp":"2024-09-13T06:45:06.749600+0000","last_deep_scrub":"279'604","last_deep_scrub_stamp":"2024-09-13T06:45:06.749600+0000","last_clean_scrub_stamp":"2024-09-13T06:45:06.749600+0000","objects_scrubbed":0,"log_size":604,"log_dups_size":0,"ondisk_log_size":604,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:57:10.059560+0000","scrub_duration":0.0039280310000000002,"objects_trimmed":0,"snaptrim_duration":0.0010470779999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4471,"num_read_kb":35894,"num_write":884,"num_write_kb":31515,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":196,"num_bytes_recovered":8224568,"num_keys_recovered":11,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":19,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":237282,"num_read_kb":1402862,"num_write":33322,"num_write_kb":1008910,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9249,"num_bytes_recovered":443628516,"num_keys_recovered":867,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14648,"internal_metadata":0},"log_size":24489,"ondisk_log_size":24489,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":57,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":3}],"osd_stats":[{"osd":7,"up_from":187,"seq":803158884390,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37036,"kb_used_data":4196,"kb_used_omap":9,"kb_used_meta":32822,"kb_avail":94334804,"statfs":{"total":96636764160,"available":96598839296,"internally_reserved":0,"allocated":4296704,"data_stored":2446923,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9685,"internal_metadata":33610283},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 06:44:33 2024","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":0.71199999999999997,"15min":0.69799999999999995},"min":{"1min":0.56699999999999995,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.751,"15min":0.73999999999999999},"min":{"1min":0.54600000000000004,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.6910000000000001,"5min":1.6910000000000001,"15min":1.6910000000000001},"last":1.0629999999999999}]},{"osd":1,"last update":"Fri Sep 13 06:44:33 2024","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.75700000000000001,"15min":0.751},"min":{"1min":0.57399999999999995,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.359,"5min":1.359,"15min":1.359},"last":0.88700000000000001},{"interface":"front","average":{"1min":0.82399999999999995,"5min":0.71599999999999997,"15min":0.69799999999999995},"min":{"1min":0.496,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.1259999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":1.036}]},{"osd":2,"last update":"Fri Sep 13 06:44:33 2024","interfaces":[{"interface":"back","average":{"1min":0.80700000000000005,"5min":0.75900000000000001,"15min":0.751},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.2030000000000001,"5min":1.212,"15min":1.212},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.92200000000000004,"5min":0.81499999999999995,"15min":0.79700000000000004},"min":{"1min":0.58999999999999997,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.4319999999999999,"5min":1.4319999999999999,"15min":1.4319999999999999},"last":0.75600000000000001}]},{"osd":3,"last update":"Fri Sep 13 06:44:33 2024","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.79600000000000004,"15min":0.79200000000000004},"min":{"1min":0.60299999999999998,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.177,"5min":1.177,"15min":1.177},"last":0.94499999999999995},{"interface":"front","average":{"1min":0.88600000000000001,"5min":0.84299999999999997,"15min":0.83599999999999997},"min":{"1min":0.48099999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.7350000000000001,"5min":1.7350000000000001,"15min":1.7350000000000001},"last":0.91100000000000003}]},{"osd":4,"last update":"Fri Sep 13 06:44:33 2024","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.82299999999999995,"15min":0.82499999999999996},"min":{"1min":0.45500000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.405,"5min":1.405,"15min":1.405},"last":0.81299999999999994},{"interface":"front","average":{"1min":1.0049999999999999,"5min":0.82299999999999995,"15min":0.79300000000000004},"min":{"1min":0.39800000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.6240000000000001,"5min":1.6240000000000001,"15min":1.6240000000000001},"last":1.153}]},{"osd":5,"last update":"Fri Sep 13 06:44:33 2024","interfaces":[{"interface":"back","average":{"1min":0.96599999999999997,"5min":0.88800000000000001,"15min":0.875},"min":{"1min":0.504,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.593,"5min":1.593,"15min":1.593},"last":1.012},{"interface":"front","average":{"1min":0.92300000000000004,"5min":0.84099999999999997,"15min":0.82699999999999996},"min":{"1min":0.53800000000000003,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.3400000000000001,"5min":1.3400000000000001,"15min":1.3400000000000001},"last":1.1160000000000001}]},{"osd":6,"last update":"Fri Sep 13 06:45:18 2024","interfaces":[{"interface":"back","average":{"1min":1.075,"5min":1.075,"15min":1.075},"min":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":1.9239999999999999,"5min":1.9239999999999999,"15min":1.9239999999999999},"last":0.85299999999999998},{"interface":"front","average":{"1min":1.028,"5min":1.028,"15min":1.028},"min":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"max":{"1min":1.3600000000000001,"5min":1.3600000000000001,"15min":1.3600000000000001},"last":0.97899999999999998}]}]},{"osd":6,"up_from":286,"seq":1228360646672,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35500,"kb_used_data":3620,"kb_used_omap":7,"kb_used_meta":31864,"kb_avail":94336340,"statfs":{"total":96636764160,"available":96600412160,"internally_reserved":0,"allocated":3706880,"data_stored":1857127,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8145,"internal_metadata":32628783},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 06:45:19 2024","interfaces":[{"interface":"back","average":{"1min":0.879,"5min":0.879,"15min":0.879},"min":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":1.2769999999999999,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"min":{"1min":0.629,"5min":0.629,"15min":0.629},"max":{"1min":1.1539999999999999,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.86399999999999999}]},{"osd":1,"last update":"Fri Sep 13 06:45:19 2024","interfaces":[{"interface":"back","average":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"min":{"1min":0.749,"5min":0.749,"15min":0.749},"max":{"1min":1.26,"5min":1.26,"15min":1.26},"last":1.0169999999999999},{"interface":"front","average":{"1min":0.999,"5min":0.999,"15min":0.999},"min":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.216,"5min":1.216,"15min":1.216},"last":1.181}]},{"osd":2,"last update":"Fri Sep 13 06:45:19 2024","interfaces":[{"interface":"back","average":{"1min":1.004,"5min":1.004,"15min":1.004},"min":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":1.2669999999999999,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":1.0680000000000001},{"interface":"front","average":{"1min":1.004,"5min":1.004,"15min":1.004},"min":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.385,"5min":1.385,"15min":1.385},"last":1.133}]},{"osd":3,"last update":"Fri Sep 13 06:45:19 2024","interfaces":[{"interface":"back","average":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"min":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.3200000000000001,"5min":1.3200000000000001,"15min":1.3200000000000001},"last":1.048},{"interface":"front","average":{"1min":1.069,"5min":1.069,"15min":1.069},"min":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"max":{"1min":1.3600000000000001,"5min":1.3600000000000001,"15min":1.3600000000000001},"last":1.155}]},{"osd":4,"last update":"Fri Sep 13 06:45:19 2024","interfaces":[{"interface":"back","average":{"1min":0.88,"5min":0.88,"15min":0.88},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.2090000000000001,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":0.81200000000000006},{"interface":"front","average":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"min":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"max":{"1min":1.2769999999999999,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":0.97199999999999998}]},{"osd":5,"last update":"Fri Sep 13 06:45:19 2024","interfaces":[{"interface":"back","average":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.3360000000000001,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":1.105},{"interface":"front","average":{"1min":1.139,"5min":1.139,"15min":1.139},"min":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"max":{"1min":1.397,"5min":1.397,"15min":1.397},"last":1.2450000000000001}]},{"osd":7,"last update":"Fri Sep 13 06:45:19 2024","interfaces":[{"interface":"back","average":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":1.0740000000000001},"min":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"max":{"1min":1.48,"5min":1.48,"15min":1.48},"last":1.2210000000000001},{"interface":"front","average":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"min":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"max":{"1min":1.5249999999999999,"5min":1.5249999999999999,"15min":1.5249999999999999},"last":1.2030000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574927,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":79020,"kb_used_data":3620,"kb_used_omap":1,"kb_used_meta":75390,"kb_avail":94292820,"statfs":{"total":96636764160,"available":96555847680,"internally_reserved":0,"allocated":3706880,"data_stored":1856574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":77199814},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 06:44:19 2024","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.71399999999999997,"15min":0.76500000000000001},"min":{"1min":0.40999999999999998,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":1.093,"5min":1.6679999999999999,"15min":1.6679999999999999},"last":1},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.76900000000000002,"15min":0.79900000000000004},"min":{"1min":0.41299999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.1220000000000001,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":0.94799999999999995}]},{"osd":1,"last update":"Fri Sep 13 06:44:19 2024","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.73999999999999999,"15min":0.751},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":1.103,"5min":1.341,"15min":1.341},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.70099999999999996,"15min":0.74099999999999999},"min":{"1min":0.40899999999999997,"5min":0.317,"15min":0.317},"max":{"1min":1.0089999999999999,"5min":1.722,"15min":1.722},"last":1.075}]},{"osd":2,"last update":"Fri Sep 13 06:44:19 2024","interfaces":[{"interface":"back","average":{"1min":0.876,"5min":0.81999999999999995,"15min":0.86399999999999999},"min":{"1min":0.47699999999999998,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.143,"5min":1.833,"15min":1.833},"last":0.873},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.79200000000000004},"min":{"1min":0.47999999999999998,"5min":0.435,"15min":0.435},"max":{"1min":1.0169999999999999,"5min":1.4279999999999999,"15min":1.4279999999999999},"last":0.89800000000000002}]},{"osd":3,"last update":"Fri Sep 13 06:44:19 2024","interfaces":[{"interface":"back","average":{"1min":0.85699999999999998,"5min":0.81399999999999995,"15min":0.78000000000000003},"min":{"1min":0.45400000000000001,"5min":0.434,"15min":0.434},"max":{"1min":1.1659999999999999,"5min":1.885,"15min":1.885},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.85899999999999999,"5min":0.86299999999999999,"15min":0.86499999999999999},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.2410000000000001,"5min":1.907,"15min":1.907},"last":1.022}]},{"osd":4,"last update":"Fri Sep 13 06:44:19 2024","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.83499999999999996,"15min":0.80500000000000005},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":1.159,"5min":6.3179999999999996,"15min":6.3179999999999996},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.78000000000000003,"5min":1.0529999999999999,"15min":0.91000000000000003},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":1.2370000000000001,"5min":15.553000000000001,"15min":15.553000000000001},"last":0.70999999999999996}]},{"osd":6,"last update":"Fri Sep 13 06:45:18 2024","interfaces":[{"interface":"back","average":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"min":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.4870000000000001,"5min":1.4870000000000001,"15min":1.4870000000000001},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"min":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"max":{"1min":1.2689999999999999,"5min":1.2689999999999999,"15min":1.2689999999999999},"last":0.81899999999999995}]},{"osd":7,"last update":"Fri Sep 13 06:44:31 2024","interfaces":[{"interface":"back","average":{"1min":0.96399999999999997,"5min":0.84399999999999997,"15min":0.82399999999999995},"min":{"1min":0.39000000000000001,"5min":0.373,"15min":0.373},"max":{"1min":1.2050000000000001,"5min":1.375,"15min":1.375},"last":0.97399999999999998},{"interface":"front","average":{"1min":0.997,"5min":0.89800000000000002,"15min":0.88200000000000001},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":1.7050000000000001,"5min":1.7050000000000001,"15min":1.7050000000000001},"last":1.052}]}]},{"osd":4,"up_from":13,"seq":55834574927,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60976,"kb_used_data":3624,"kb_used_omap":1,"kb_used_meta":57342,"kb_avail":94310864,"statfs":{"total":96636764160,"available":96574324736,"internally_reserved":0,"allocated":3710976,"data_stored":1857146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":58718662},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 06:45:16 2024","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.73199999999999998,"15min":0.96999999999999997},"min":{"1min":0.55000000000000004,"5min":0.245,"15min":0.245},"max":{"1min":1.216,"5min":1.3959999999999999,"15min":5.8230000000000004},"last":0.95499999999999996},{"interface":"front","average":{"1min":0.86299999999999999,"5min":0.73899999999999999,"15min":0.75800000000000001},"min":{"1min":0.54200000000000004,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":1.2150000000000001,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.72599999999999998}]},{"osd":1,"last update":"Fri Sep 13 06:45:16 2024","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.80900000000000005,"15min":0.755},"min":{"1min":0.57599999999999996,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.1990000000000001,"5min":10.156000000000001,"15min":10.156000000000001},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.92700000000000005,"5min":0.78700000000000003,"15min":0.83999999999999997},"min":{"1min":0.64800000000000002,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.575,"5min":1.575,"15min":1.575},"last":0.88600000000000001}]},{"osd":2,"last update":"Fri Sep 13 06:45:16 2024","interfaces":[{"interface":"back","average":{"1min":0.88100000000000001,"5min":0.755,"15min":0.82399999999999995},"min":{"1min":0.55300000000000005,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":1.1040000000000001,"5min":1.6000000000000001,"15min":1.6000000000000001},"last":0.80800000000000005},{"interface":"front","average":{"1min":0.90100000000000002,"5min":0.80900000000000005,"15min":0.81899999999999995},"min":{"1min":0.69399999999999995,"5min":0.374,"15min":0.374},"max":{"1min":1.159,"5min":1.331,"15min":1.3540000000000001},"last":1.0960000000000001}]},{"osd":3,"last update":"Fri Sep 13 06:45:16 2024","interfaces":[{"interface":"back","average":{"1min":0.93899999999999995,"5min":0.84899999999999998,"15min":0.90300000000000002},"min":{"1min":0.63600000000000001,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.3919999999999999,"5min":1.6950000000000001,"15min":1.6950000000000001},"last":1.2010000000000001},{"interface":"front","average":{"1min":0.94299999999999995,"5min":0.95899999999999996,"15min":0.92700000000000005},"min":{"1min":0.59299999999999997,"5min":0.41299999999999998,"15min":0.374},"max":{"1min":1.1539999999999999,"5min":10.195,"15min":10.195},"last":0.92500000000000004}]},{"osd":5,"last update":"Fri Sep 13 06:45:16 2024","interfaces":[{"interface":"back","average":{"1min":0.90800000000000003,"5min":0.82099999999999995,"15min":0.85899999999999999},"min":{"1min":0.65100000000000002,"5min":0.249,"15min":0.249},"max":{"1min":1.1779999999999999,"5min":1.913,"15min":2.9790000000000001},"last":1.0269999999999999},{"interface":"front","average":{"1min":0.93899999999999995,"5min":0.84199999999999997,"15min":0.91300000000000003},"min":{"1min":0.61899999999999999,"5min":0.372,"15min":0.372},"max":{"1min":1.298,"5min":1.6990000000000001,"15min":1.8779999999999999},"last":1.1379999999999999}]},{"osd":6,"last update":"Fri Sep 13 06:45:16 2024","interfaces":[{"interface":"back","average":{"1min":1.022,"5min":1.022,"15min":1.022},"min":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"max":{"1min":1.373,"5min":1.373,"15min":1.373},"last":1.0680000000000001},{"interface":"front","average":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"min":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"max":{"1min":1.298,"5min":1.298,"15min":1.298},"last":0.84499999999999997}]},{"osd":7,"last update":"Fri Sep 13 06:44:33 2024","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.1539999999999999,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":1.1599999999999999},{"interface":"front","average":{"1min":0.90400000000000003,"5min":0.89200000000000002,"15min":0.89000000000000001},"min":{"1min":0.505,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.2529999999999999,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":0.997}]}]},{"osd":3,"up_from":13,"seq":55834574930,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":74924,"kb_used_data":3620,"kb_used_omap":1,"kb_used_meta":71294,"kb_avail":94296916,"statfs":{"total":96636764160,"available":96560041984,"internally_reserved":0,"allocated":3706880,"data_stored":1857127,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":73005512},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 06:45:16 2024","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.56100000000000005,"15min":0.56899999999999995},"min":{"1min":0.26000000000000001,"5min":0.24199999999999999,"15min":0.191},"max":{"1min":1.0780000000000001,"5min":1.51,"15min":1.51},"last":1.0389999999999999},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.60299999999999998,"15min":0.65300000000000002},"min":{"1min":0.33600000000000002,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":1.0349999999999999,"5min":1.0509999999999999,"15min":1.2789999999999999},"last":0.71999999999999997}]},{"osd":1,"last update":"Fri Sep 13 06:45:16 2024","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.55600000000000005,"15min":0.58799999999999997},"min":{"1min":0.28899999999999998,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.92900000000000005,"5min":0.94499999999999995,"15min":0.97099999999999997},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.58699999999999997,"15min":0.66300000000000003},"min":{"1min":0.34899999999999998,"5min":0.27700000000000002,"15min":0.27200000000000002},"max":{"1min":0.98899999999999999,"5min":1.607,"15min":1.607},"last":0.80000000000000004}]},{"osd":2,"last update":"Fri Sep 13 06:45:16 2024","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.63300000000000001,"15min":0.65300000000000002},"min":{"1min":0.36699999999999999,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":1.048,"5min":1.5660000000000001,"15min":1.5660000000000001},"last":1.111},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.59199999999999997,"15min":0.625},"min":{"1min":0.315,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.88400000000000001,"5min":1.409,"15min":1.409},"last":0.66200000000000003}]},{"osd":4,"last update":"Fri Sep 13 06:45:16 2024","interfaces":[{"interface":"back","average":{"1min":0.88200000000000001,"5min":0.81699999999999995,"15min":0.89100000000000001},"min":{"1min":0.64900000000000002,"5min":0.377,"15min":0.377},"max":{"1min":1.1919999999999999,"5min":1.651,"15min":1.7929999999999999},"last":1.242},{"interface":"front","average":{"1min":0.877,"5min":0.78000000000000003,"15min":0.78800000000000003},"min":{"1min":0.60199999999999998,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.1559999999999999,"5min":1.173,"15min":1.3240000000000001},"last":0.76200000000000001}]},{"osd":5,"last update":"Fri Sep 13 06:45:16 2024","interfaces":[{"interface":"back","average":{"1min":0.90600000000000003,"5min":0.81899999999999995,"15min":0.85299999999999998},"min":{"1min":0.63300000000000001,"5min":0.47899999999999998,"15min":0.46700000000000003},"max":{"1min":1.2529999999999999,"5min":1.3500000000000001,"15min":1.3799999999999999},"last":1.069},{"interface":"front","average":{"1min":0.91600000000000004,"5min":0.83299999999999996,"15min":0.86299999999999999},"min":{"1min":0.66000000000000003,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.1539999999999999,"5min":1.4610000000000001,"15min":1.4610000000000001},"last":1.0149999999999999}]},{"osd":6,"last update":"Fri Sep 13 06:45:16 2024","interfaces":[{"interface":"back","average":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"min":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.357,"5min":1.357,"15min":1.357},"last":1.1739999999999999},{"interface":"front","average":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.173,"5min":1.173,"15min":1.173},"last":0.98699999999999999}]},{"osd":7,"last update":"Fri Sep 13 06:44:35 2024","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.89300000000000002,"15min":0.89800000000000002},"min":{"1min":0.57199999999999995,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.3009999999999999,"5min":1.3799999999999999,"15min":1.3799999999999999},"last":0.95599999999999996},{"interface":"front","average":{"1min":0.93000000000000005,"5min":0.95799999999999996,"15min":0.96199999999999997},"min":{"1min":0.58799999999999997,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.4219999999999999,"5min":2.0459999999999998,"15min":2.0459999999999998},"last":1.3100000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574927,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60972,"kb_used_data":3620,"kb_used_omap":1,"kb_used_meta":57342,"kb_avail":94310868,"statfs":{"total":96636764160,"available":96574328832,"internally_reserved":0,"allocated":3706880,"data_stored":1857127,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":58718662},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 06:45:23 2024","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.69599999999999995,"15min":0.57199999999999995},"min":{"1min":0.29299999999999998,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":1.0409999999999999,"5min":8.6449999999999996,"15min":8.6449999999999996},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.67800000000000005,"15min":0.62},"min":{"1min":0.34499999999999997,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":1.371,"5min":4.0380000000000003,"15min":4.0380000000000003},"last":0.67600000000000005}]},{"osd":1,"last update":"Fri Sep 13 06:45:23 2024","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.65400000000000003,"15min":0.624},"min":{"1min":0.32700000000000001,"5min":0.249,"15min":0.23300000000000001},"max":{"1min":0.85399999999999998,"5min":3.4649999999999999,"15min":3.4649999999999999},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.69799999999999995,"15min":0.61399999999999999},"min":{"1min":0.35699999999999998,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":1.0620000000000001,"5min":3.8159999999999998,"15min":3.8159999999999998},"last":0.76800000000000002}]},{"osd":3,"last update":"Fri Sep 13 06:45:23 2024","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.70099999999999996,"15min":0.60299999999999998},"min":{"1min":0.39600000000000002,"5min":0.29399999999999998,"15min":0.249},"max":{"1min":1.0940000000000001,"5min":3.407,"15min":3.407},"last":0.92300000000000004},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.76800000000000002,"15min":0.69699999999999995},"min":{"1min":0.38200000000000001,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.294,"5min":3.2639999999999998,"15min":3.2639999999999998},"last":0.82699999999999996}]},{"osd":4,"last update":"Fri Sep 13 06:45:23 2024","interfaces":[{"interface":"back","average":{"1min":0.97899999999999998,"5min":0.89600000000000002,"15min":0.89100000000000001},"min":{"1min":0.68400000000000005,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.288,"5min":3.1179999999999999,"15min":3.1179999999999999},"last":0.85499999999999998},{"interface":"front","average":{"1min":0.97799999999999998,"5min":1.081,"15min":0.94699999999999995},"min":{"1min":0.53600000000000003,"5min":0.439,"15min":0.439},"max":{"1min":1.2330000000000001,"5min":21.081,"15min":21.081},"last":0.97199999999999998}]},{"osd":5,"last update":"Fri Sep 13 06:45:23 2024","interfaces":[{"interface":"back","average":{"1min":0.98999999999999999,"5min":0.878,"15min":0.85299999999999998},"min":{"1min":0.77300000000000002,"5min":0.46100000000000002,"15min":0.33800000000000002},"max":{"1min":1.3540000000000001,"5min":2.2389999999999999,"15min":2.2389999999999999},"last":0.89100000000000001},{"interface":"front","average":{"1min":1.099,"5min":1.01,"15min":0.90600000000000003},"min":{"1min":0.80800000000000005,"5min":0.377,"15min":0.377},"max":{"1min":1.4139999999999999,"5min":4.9039999999999999,"15min":4.9039999999999999},"last":1.0109999999999999}]},{"osd":6,"last update":"Fri Sep 13 06:45:19 2024","interfaces":[{"interface":"back","average":{"1min":0.998,"5min":0.998,"15min":0.998},"min":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":1.5660000000000001,"5min":1.5660000000000001,"15min":1.5660000000000001},"last":0.94899999999999995},{"interface":"front","average":{"1min":1.056,"5min":1.056,"15min":1.056},"min":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.6439999999999999,"5min":1.6439999999999999,"15min":1.6439999999999999},"last":1.0680000000000001}]},{"osd":7,"last update":"Fri Sep 13 06:44:33 2024","interfaces":[{"interface":"back","average":{"1min":0.95799999999999996,"5min":0.86499999999999999,"15min":0.84899999999999998},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":1.641,"5min":1.641,"15min":1.641},"last":1.21},{"interface":"front","average":{"1min":1.05,"5min":0.88600000000000001,"15min":0.85799999999999998},"min":{"1min":0.71499999999999997,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":2.0630000000000002,"5min":2.0630000000000002,"15min":2.0630000000000002},"last":1.0409999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574927,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52784,"kb_used_data":3624,"kb_used_omap":1,"kb_used_meta":49150,"kb_avail":94319056,"statfs":{"total":96636764160,"available":96582713344,"internally_reserved":0,"allocated":3710976,"data_stored":1856593,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":50330054},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 06:45:22 2024","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.57599999999999996,"15min":0.57999999999999996},"min":{"1min":0.42199999999999999,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.94699999999999995,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.65700000000000003,"15min":0.66400000000000003},"min":{"1min":0.372,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.997,"5min":1.8160000000000001,"15min":1.8160000000000001},"last":0.77800000000000002}]},{"osd":2,"last update":"Fri Sep 13 06:45:22 2024","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.59899999999999998,"15min":0.63100000000000001},"min":{"1min":0.28599999999999998,"5min":0.22,"15min":0.22},"max":{"1min":1.0109999999999999,"5min":2.617,"15min":2.617},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.66500000000000004,"15min":0.65800000000000003},"min":{"1min":0.35099999999999998,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.95099999999999996,"5min":2.5249999999999999,"15min":2.5249999999999999},"last":0.82099999999999995}]},{"osd":3,"last update":"Fri Sep 13 06:45:22 2024","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.71999999999999997,"15min":0.73099999999999998},"min":{"1min":0.39300000000000002,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":1.1299999999999999,"5min":1.3600000000000001,"15min":1.3640000000000001},"last":1.028},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.65600000000000003,"15min":0.68799999999999994},"min":{"1min":0.308,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.83599999999999997,"5min":1.752,"15min":1.752},"last":0.69199999999999995}]},{"osd":4,"last update":"Fri Sep 13 06:45:22 2024","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.80100000000000005,"15min":0.82099999999999995},"min":{"1min":0.53800000000000003,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":1.224,"5min":2.7389999999999999,"15min":2.7389999999999999},"last":1.1819999999999999},{"interface":"front","average":{"1min":0.93400000000000005,"5min":0.85499999999999998,"15min":0.90600000000000003},"min":{"1min":0.52000000000000002,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.238,"5min":1.4159999999999999,"15min":1.4359999999999999},"last":0.96699999999999997}]},{"osd":5,"last update":"Fri Sep 13 06:45:22 2024","interfaces":[{"interface":"back","average":{"1min":0.98699999999999999,"5min":0.85499999999999998,"15min":0.90900000000000003},"min":{"1min":0.73699999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.2729999999999999,"5min":1.607,"15min":1.7849999999999999},"last":1.0589999999999999},{"interface":"front","average":{"1min":1.0189999999999999,"5min":0.89200000000000002,"15min":0.88800000000000001},"min":{"1min":0.68100000000000005,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":1.266,"5min":1.6759999999999999,"15min":2.036},"last":1.125}]},{"osd":6,"last update":"Fri Sep 13 06:45:18 2024","interfaces":[{"interface":"back","average":{"1min":1.01,"5min":1.01,"15min":1.01},"min":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"max":{"1min":1.353,"5min":1.353,"15min":1.353},"last":1.093},{"interface":"front","average":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"min":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":1.2110000000000001,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.93899999999999995}]},{"osd":7,"last update":"Fri Sep 13 06:44:33 2024","interfaces":[{"interface":"back","average":{"1min":0.91900000000000004,"5min":0.90600000000000003,"15min":0.90400000000000003},"min":{"1min":0.621,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":1.3220000000000001,"5min":1.605,"15min":1.605},"last":0.998},{"interface":"front","average":{"1min":1.054,"5min":0.93899999999999995,"15min":0.92000000000000004},"min":{"1min":0.61099999999999999,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.5009999999999999,"5min":1.5009999999999999,"15min":1.5009999999999999},"last":1.2210000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574926,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":85356,"kb_used_data":4196,"kb_used_omap":1,"kb_used_meta":81150,"kb_avail":94286484,"statfs":{"total":96636764160,"available":96549359616,"internally_reserved":0,"allocated":4296704,"data_stored":2446923,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":83098054},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 06:45:20 2024","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.55700000000000005,"15min":0.53300000000000003},"min":{"1min":0.23200000000000001,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":0.90800000000000003,"5min":1.103,"15min":1.2270000000000001},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.57399999999999995,"15min":0.54500000000000004},"min":{"1min":0.26300000000000001,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.90500000000000003,"5min":1.137,"15min":1.222},"last":0.80600000000000005}]},{"osd":2,"last update":"Fri Sep 13 06:45:14 2024","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.63,"15min":0.56399999999999995},"min":{"1min":0.28199999999999997,"5min":0.217,"15min":0.217},"max":{"1min":0.90300000000000002,"5min":1.839,"15min":1.839},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.629,"15min":0.58099999999999996},"min":{"1min":0.315,"5min":0.25900000000000001,"15min":0.245},"max":{"1min":0.97099999999999997,"5min":1.419,"15min":1.419},"last":0.56399999999999995}]},{"osd":3,"last update":"Fri Sep 13 06:45:14 2024","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.627,"15min":0.56699999999999995},"min":{"1min":0.34200000000000003,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.98599999999999999,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.629},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.77100000000000002,"15min":0.70799999999999996},"min":{"1min":0.31,"5min":0.26100000000000001,"15min":0.24099999999999999},"max":{"1min":1.1080000000000001,"5min":4.9630000000000001,"15min":4.9630000000000001},"last":0.85199999999999998}]},{"osd":4,"last update":"Fri Sep 13 06:45:14 2024","interfaces":[{"interface":"back","average":{"1min":0.85499999999999998,"5min":0.81699999999999995,"15min":0.79800000000000004},"min":{"1min":0.44700000000000001,"5min":0.311,"15min":0.311},"max":{"1min":1.3109999999999999,"5min":1.6259999999999999,"15min":1.6259999999999999},"last":0.88300000000000001},{"interface":"front","average":{"1min":0.84099999999999997,"5min":0.78100000000000003,"15min":0.79900000000000004},"min":{"1min":0.51100000000000001,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.117,"5min":1.181,"15min":1.6319999999999999},"last":0.90400000000000003}]},{"osd":5,"last update":"Fri Sep 13 06:45:14 2024","interfaces":[{"interface":"back","average":{"1min":0.95699999999999996,"5min":0.879,"15min":0.85899999999999999},"min":{"1min":0.46999999999999997,"5min":0.42299999999999999,"15min":0.378},"max":{"1min":1.323,"5min":1.575,"15min":1.575},"last":0.93999999999999995},{"interface":"front","average":{"1min":0.94399999999999995,"5min":0.87,"15min":0.874},"min":{"1min":0.64400000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.369,"5min":1.4319999999999999,"15min":1.5740000000000001},"last":1.024}]},{"osd":6,"last update":"Fri Sep 13 06:45:20 2024","interfaces":[{"interface":"back","average":{"1min":1.004,"5min":1.004,"15min":1.004},"min":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"max":{"1min":1.397,"5min":1.397,"15min":1.397},"last":1},{"interface":"front","average":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"min":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"max":{"1min":1.4159999999999999,"5min":1.4159999999999999,"15min":1.4159999999999999},"last":1.101}]},{"osd":7,"last update":"Fri Sep 13 06:44:31 2024","interfaces":[{"interface":"back","average":{"1min":0.97799999999999998,"5min":1.0529999999999999,"15min":1.0649999999999999},"min":{"1min":0.57799999999999996,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.381,"5min":1.9419999999999999,"15min":1.9419999999999999},"last":1.0660000000000001},{"interface":"front","average":{"1min":0.97899999999999998,"5min":0.96999999999999997,"15min":0.96799999999999997},"min":{"1min":0.64100000000000001,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.4750000000000001,"5min":1.901,"15min":1.901},"last":1.1659999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6552,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8096,"internal_metadata":0}]}} 2024-09-13T06:45:28.693 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-09-13T06:39:26.336261+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=39, tm_sec=26, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=44, tm_sec=43, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:45:28.693 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-09-13T06:39:26.336261+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=39, tm_sec=26, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=44, tm_sec=43, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:45:28.694 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-09-13T06:39:26.336261+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=39, tm_sec=26, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=6, tm_min=44, tm_sec=43, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T06:45:28.694 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-13T06:45:48.695 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T06:45:49.004 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T06:45:49.005 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-09-13T06:45:49.021 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":497,"stamp":"2024-09-13T06:45:47.630881+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590406,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":237398,"num_read_kb":1402962,"num_write":33483,"num_write_kb":1011328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9257,"num_bytes_recovered":444809309,"num_keys_recovered":867,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":24613,"ondisk_log_size":24613,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":486568,"kb_used_data":30120,"kb_used_omap":26,"kb_used_meta":456357,"kb_avail":754488152,"statfs":{"total":773094113280,"available":772595867648,"internally_reserved":0,"allocated":30842880,"data_stored":16035540,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":27392,"internal_metadata":467309824},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003735"},"pg_stats":[{"pgid":"3.1f","version":"280'781","reported_seq":6300,"reported_epoch":305,"state":"active+clean","last_fresh":"2024-09-13T06:44:46.378523+0000","last_change":"2024-09-13T06:44:46.378523+0000","last_active":"2024-09-13T06:44:46.378523+0000","last_peered":"2024-09-13T06:44:46.378523+0000","last_clean":"2024-09-13T06:44:46.378523+0000","last_became_active":"2024-09-13T06:40:57.385213+0000","last_became_peered":"2024-09-13T06:40:57.385213+0000","last_unstale":"2024-09-13T06:44:46.378523+0000","last_undegraded":"2024-09-13T06:44:46.378523+0000","last_fullsized":"2024-09-13T06:44:46.378523+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"280'781","last_scrub_stamp":"2024-09-13T06:44:46.378420+0000","last_deep_scrub":"280'781","last_deep_scrub_stamp":"2024-09-13T06:44:46.378420+0000","last_clean_scrub_stamp":"2024-09-13T06:44:46.378420+0000","objects_scrubbed":0,"log_size":781,"log_dups_size":0,"ondisk_log_size":781,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:36:51.432129+0000","scrub_duration":0.002758277,"objects_trimmed":0,"snaptrim_duration":0.00056495999999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6518,"num_read_kb":34199,"num_write":1043,"num_write_kb":37100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":72,"num_bytes_recovered":6114482,"num_keys_recovered":44,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"271'1110","reported_seq":7435,"reported_epoch":305,"state":"active+clean","last_fresh":"2024-09-13T06:44:54.010916+0000","last_change":"2024-09-13T06:44:54.010916+0000","last_active":"2024-09-13T06:44:54.010916+0000","last_peered":"2024-09-13T06:44:54.010916+0000","last_clean":"2024-09-13T06:44:54.010916+0000","last_became_active":"2024-09-13T06:44:20.460702+0000","last_became_peered":"2024-09-13T06:44:20.460702+0000","last_unstale":"2024-09-13T06:44:54.010916+0000","last_undegraded":"2024-09-13T06:44:54.010916+0000","last_fullsized":"2024-09-13T06:44:54.010916+0000","mapping_epoch":290,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":291,"parent":"0.0","parent_split_bits":0,"last_scrub":"271'1110","last_scrub_stamp":"2024-09-13T06:44:54.010626+0000","last_deep_scrub":"271'1110","last_deep_scrub_stamp":"2024-09-13T06:44:54.010626+0000","last_clean_scrub_stamp":"2024-09-13T06:44:54.010626+0000","objects_scrubbed":0,"log_size":1110,"log_dups_size":0,"ondisk_log_size":1110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:16:23.356449+0000","scrub_duration":0.0038375079999999999,"objects_trimmed":0,"snaptrim_duration":0.0013343369999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8806,"num_read_kb":55237,"num_write":1632,"num_write_kb":29160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":491,"num_bytes_recovered":16489974,"num_keys_recovered":55,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"279'1047","reported_seq":5669,"reported_epoch":305,"state":"active+clean","last_fresh":"2024-09-13T06:44:50.226163+0000","last_change":"2024-09-13T06:44:50.226163+0000","last_active":"2024-09-13T06:44:50.226163+0000","last_peered":"2024-09-13T06:44:50.226163+0000","last_clean":"2024-09-13T06:44:50.226163+0000","last_became_active":"2024-09-13T06:44:30.803142+0000","last_became_peered":"2024-09-13T06:44:30.803142+0000","last_unstale":"2024-09-13T06:44:50.226163+0000","last_undegraded":"2024-09-13T06:44:50.226163+0000","last_fullsized":"2024-09-13T06:44:50.226163+0000","mapping_epoch":300,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":301,"parent":"0.0","parent_split_bits":0,"last_scrub":"279'1047","last_scrub_stamp":"2024-09-13T06:44:50.225808+0000","last_deep_scrub":"279'1047","last_deep_scrub_stamp":"2024-09-13T06:44:50.225808+0000","last_clean_scrub_stamp":"2024-09-13T06:44:50.225808+0000","objects_scrubbed":0,"log_size":1047,"log_dups_size":0,"ondisk_log_size":1047,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:21:28.074287+0000","scrub_duration":0.0042489160000000002,"objects_trimmed":0,"snaptrim_duration":0.00088262599999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6265,"num_read_kb":28067,"num_write":1605,"num_write_kb":33265,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":206,"num_bytes_recovered":8442088,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1c","version":"305'844","reported_seq":8408,"reported_epoch":305,"state":"active+clean","last_fresh":"2024-09-13T06:45:11.243606+0000","last_change":"2024-09-13T06:45:11.243886+0000","last_active":"2024-09-13T06:45:11.243606+0000","last_peered":"2024-09-13T06:45:11.243606+0000","last_clean":"2024-09-13T06:45:11.243606+0000","last_became_active":"2024-09-13T06:44:30.801783+0000","last_became_peered":"2024-09-13T06:44:30.801783+0000","last_unstale":"2024-09-13T06:45:11.243606+0000","last_undegraded":"2024-09-13T06:45:11.243606+0000","last_fullsized":"2024-09-13T06:45:11.243606+0000","mapping_epoch":300,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":301,"parent":"0.0","parent_split_bits":0,"last_scrub":"305'844","last_scrub_stamp":"2024-09-13T06:45:11.243552+0000","last_deep_scrub":"305'844","last_deep_scrub_stamp":"2024-09-13T06:45:11.243552+0000","last_clean_scrub_stamp":"2024-09-13T06:45:11.243552+0000","objects_scrubbed":1,"log_size":844,"log_dups_size":0,"ondisk_log_size":844,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:52:33.081334+0000","scrub_duration":0.0066046960000000002,"objects_trimmed":0,"snaptrim_duration":0.001581236,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9390,"num_read_kb":69964,"num_write":963,"num_write_kb":31840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":350,"num_bytes_recovered":42380134,"num_keys_recovered":286,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"277'852","reported_seq":5183,"reported_epoch":305,"state":"active+clean","last_fresh":"2024-09-13T06:44:54.343402+0000","last_change":"2024-09-13T06:44:54.343728+0000","last_active":"2024-09-13T06:44:54.343402+0000","last_peered":"2024-09-13T06:44:54.343402+0000","last_clean":"2024-09-13T06:44:54.343402+0000","last_became_active":"2024-09-13T06:43:31.415608+0000","last_became_peered":"2024-09-13T06:43:31.415608+0000","last_unstale":"2024-09-13T06:44:54.343402+0000","last_undegraded":"2024-09-13T06:44:54.343402+0000","last_fullsized":"2024-09-13T06:44:54.343402+0000","mapping_epoch":245,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":246,"parent":"0.0","parent_split_bits":0,"last_scrub":"277'852","last_scrub_stamp":"2024-09-13T06:44:54.343349+0000","last_deep_scrub":"277'852","last_deep_scrub_stamp":"2024-09-13T06:44:54.343349+0000","last_clean_scrub_stamp":"2024-09-13T06:44:54.343349+0000","objects_scrubbed":0,"log_size":852,"log_dups_size":0,"ondisk_log_size":852,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:43:36.373684+0000","scrub_duration":0.0039275239999999999,"objects_trimmed":0,"snaptrim_duration":0.00060857399999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5714,"num_read_kb":37037,"num_write":1079,"num_write_kb":33376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":295,"num_bytes_recovered":25415745,"num_keys_recovered":55,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"305'498","reported_seq":7770,"reported_epoch":305,"state":"active+clean","last_fresh":"2024-09-13T06:44:47.710656+0000","last_change":"2024-09-13T06:44:47.710917+0000","last_active":"2024-09-13T06:44:47.710656+0000","last_peered":"2024-09-13T06:44:47.710656+0000","last_clean":"2024-09-13T06:44:47.710656+0000","last_became_active":"2024-09-13T06:44:20.462185+0000","last_became_peered":"2024-09-13T06:44:20.462185+0000","last_unstale":"2024-09-13T06:44:47.710656+0000","last_undegraded":"2024-09-13T06:44:47.710656+0000","last_fullsized":"2024-09-13T06:44:47.710656+0000","mapping_epoch":290,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":291,"parent":"0.0","parent_split_bits":0,"last_scrub":"305'498","last_scrub_stamp":"2024-09-13T06:44:47.710602+0000","last_deep_scrub":"305'498","last_deep_scrub_stamp":"2024-09-13T06:44:47.710602+0000","last_clean_scrub_stamp":"2024-09-13T06:44:47.710602+0000","objects_scrubbed":1,"log_size":498,"log_dups_size":0,"ondisk_log_size":498,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:43:44.349737+0000","scrub_duration":0.0053964130000000001,"objects_trimmed":0,"snaptrim_duration":0.00078923399999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6439,"num_read_kb":42977,"num_write":667,"num_write_kb":32420,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":728,"num_bytes_recovered":12986751,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"275'680","reported_seq":8582,"reported_epoch":305,"state":"active+clean","last_fresh":"2024-09-13T06:45:00.297053+0000","last_change":"2024-09-13T06:45:00.297277+0000","last_active":"2024-09-13T06:45:00.297053+0000","last_peered":"2024-09-13T06:45:00.297053+0000","last_clean":"2024-09-13T06:45:00.297053+0000","last_became_active":"2024-09-13T06:44:21.442872+0000","last_became_peered":"2024-09-13T06:44:21.442872+0000","last_unstale":"2024-09-13T06:45:00.297053+0000","last_undegraded":"2024-09-13T06:45:00.297053+0000","last_fullsized":"2024-09-13T06:45:00.297053+0000","mapping_epoch":291,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":292,"parent":"0.0","parent_split_bits":0,"last_scrub":"275'680","last_scrub_stamp":"2024-09-13T06:45:00.296999+0000","last_deep_scrub":"275'680","last_deep_scrub_stamp":"2024-09-13T06:45:00.296999+0000","last_clean_scrub_stamp":"2024-09-13T06:45:00.296999+0000","objects_scrubbed":0,"log_size":680,"log_dups_size":0,"ondisk_log_size":680,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:39:13.675929+0000","scrub_duration":0.0033395040000000001,"objects_trimmed":0,"snaptrim_duration":0.00079955100000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8400,"num_read_kb":35906,"num_write":738,"num_write_kb":28560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":398,"num_bytes_recovered":17539742,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"272'684","reported_seq":7058,"reported_epoch":305,"state":"active+clean","last_fresh":"2024-09-13T06:44:51.086838+0000","last_change":"2024-09-13T06:44:51.087089+0000","last_active":"2024-09-13T06:44:51.086838+0000","last_peered":"2024-09-13T06:44:51.086838+0000","last_clean":"2024-09-13T06:44:51.086838+0000","last_became_active":"2024-09-13T06:41:14.395301+0000","last_became_peered":"2024-09-13T06:41:14.395301+0000","last_unstale":"2024-09-13T06:44:51.086838+0000","last_undegraded":"2024-09-13T06:44:51.086838+0000","last_fullsized":"2024-09-13T06:44:51.086838+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"272'684","last_scrub_stamp":"2024-09-13T06:44:51.086786+0000","last_deep_scrub":"272'684","last_deep_scrub_stamp":"2024-09-13T06:44:51.086786+0000","last_clean_scrub_stamp":"2024-09-13T06:44:51.086786+0000","objects_scrubbed":0,"log_size":684,"log_dups_size":0,"ondisk_log_size":684,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:32:39.273971+0000","scrub_duration":0.0040833859999999996,"objects_trimmed":0,"snaptrim_duration":0.00092758900000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6571,"num_read_kb":55194,"num_write":838,"num_write_kb":38872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":117,"num_bytes_recovered":13142180,"num_keys_recovered":22,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"275'1525","reported_seq":5972,"reported_epoch":305,"state":"active+clean","last_fresh":"2024-09-13T06:44:53.358765+0000","last_change":"2024-09-13T06:44:53.359002+0000","last_active":"2024-09-13T06:44:53.358765+0000","last_peered":"2024-09-13T06:44:53.358765+0000","last_clean":"2024-09-13T06:44:53.358765+0000","last_became_active":"2024-09-13T06:43:22.521039+0000","last_became_peered":"2024-09-13T06:43:22.521039+0000","last_unstale":"2024-09-13T06:44:53.358765+0000","last_undegraded":"2024-09-13T06:44:53.358765+0000","last_fullsized":"2024-09-13T06:44:53.358765+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"275'1525","last_scrub_stamp":"2024-09-13T06:44:53.358711+0000","last_deep_scrub":"275'1525","last_deep_scrub_stamp":"2024-09-13T06:44:53.358711+0000","last_clean_scrub_stamp":"2024-09-13T06:44:53.358711+0000","objects_scrubbed":0,"log_size":1525,"log_dups_size":0,"ondisk_log_size":1525,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:51:26.451347+0000","scrub_duration":0.0041147739999999999,"objects_trimmed":0,"snaptrim_duration":0.00029931499999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9655,"num_read_kb":41824,"num_write":2232,"num_write_kb":32733,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":112,"num_bytes_recovered":14950263,"num_keys_recovered":22,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"275'715","reported_seq":5288,"reported_epoch":305,"state":"active+clean","last_fresh":"2024-09-13T06:45:25.233316+0000","last_change":"2024-09-13T06:45:25.233592+0000","last_active":"2024-09-13T06:45:25.233316+0000","last_peered":"2024-09-13T06:45:25.233316+0000","last_clean":"2024-09-13T06:45:25.233316+0000","last_became_active":"2024-09-13T06:44:30.798028+0000","last_became_peered":"2024-09-13T06:44:30.798028+0000","last_unstale":"2024-09-13T06:45:25.233316+0000","last_undegraded":"2024-09-13T06:45:25.233316+0000","last_fullsized":"2024-09-13T06:45:25.233316+0000","mapping_epoch":300,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":301,"parent":"0.0","parent_split_bits":0,"last_scrub":"275'715","last_scrub_stamp":"2024-09-13T06:45:25.233260+0000","last_deep_scrub":"275'715","last_deep_scrub_stamp":"2024-09-13T06:45:25.233260+0000","last_clean_scrub_stamp":"2024-09-13T06:45:25.233260+0000","objects_scrubbed":0,"log_size":715,"log_dups_size":0,"ondisk_log_size":715,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:33:01.175881+0000","scrub_duration":0.003482125,"objects_trimmed":0,"snaptrim_duration":0.0024960030000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5101,"num_read_kb":28279,"num_write":1028,"num_write_kb":23183,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":197,"num_bytes_recovered":7394092,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"277'365","reported_seq":6186,"reported_epoch":305,"state":"active+clean","last_fresh":"2024-09-13T06:45:28.958180+0000","last_change":"2024-09-13T06:45:28.958438+0000","last_active":"2024-09-13T06:45:28.958180+0000","last_peered":"2024-09-13T06:45:28.958180+0000","last_clean":"2024-09-13T06:45:28.958180+0000","last_became_active":"2024-09-13T06:42:33.408009+0000","last_became_peered":"2024-09-13T06:42:33.408009+0000","last_unstale":"2024-09-13T06:45:28.958180+0000","last_undegraded":"2024-09-13T06:45:28.958180+0000","last_fullsized":"2024-09-13T06:45:28.958180+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"277'365","last_scrub_stamp":"2024-09-13T06:45:28.958126+0000","last_deep_scrub":"277'365","last_deep_scrub_stamp":"2024-09-13T06:45:28.958126+0000","last_clean_scrub_stamp":"2024-09-13T06:45:28.958126+0000","objects_scrubbed":0,"log_size":365,"log_dups_size":0,"ondisk_log_size":365,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:45:52.659036+0000","scrub_duration":0.0038946879999999999,"objects_trimmed":0,"snaptrim_duration":0.0024654690000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5036,"num_read_kb":48021,"num_write":472,"num_write_kb":27276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":157,"num_bytes_recovered":13242563,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"280'579","reported_seq":9972,"reported_epoch":305,"state":"active+clean","last_fresh":"2024-09-13T06:44:52.694031+0000","last_change":"2024-09-13T06:44:52.694333+0000","last_active":"2024-09-13T06:44:52.694031+0000","last_peered":"2024-09-13T06:44:52.694031+0000","last_clean":"2024-09-13T06:44:52.694031+0000","last_became_active":"2024-09-13T06:44:03.438897+0000","last_became_peered":"2024-09-13T06:44:03.438897+0000","last_unstale":"2024-09-13T06:44:52.694031+0000","last_undegraded":"2024-09-13T06:44:52.694031+0000","last_fullsized":"2024-09-13T06:44:52.694031+0000","mapping_epoch":277,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":278,"parent":"0.0","parent_split_bits":0,"last_scrub":"280'579","last_scrub_stamp":"2024-09-13T06:44:52.693977+0000","last_deep_scrub":"280'579","last_deep_scrub_stamp":"2024-09-13T06:44:52.693977+0000","last_clean_scrub_stamp":"2024-09-13T06:44:52.693977+0000","objects_scrubbed":0,"log_size":579,"log_dups_size":0,"ondisk_log_size":579,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T09:13:33.654445+0000","scrub_duration":0.0038818189999999999,"objects_trimmed":0,"snaptrim_duration":0.0012901029999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8875,"num_read_kb":61758,"num_write":769,"num_write_kb":30278,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":506,"num_bytes_recovered":26184965,"num_keys_recovered":33,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":39,"reported_epoch":305,"state":"active+clean","last_fresh":"2024-09-13T06:44:51.064312+0000","last_change":"2024-09-13T06:44:51.064528+0000","last_active":"2024-09-13T06:44:51.064312+0000","last_peered":"2024-09-13T06:44:51.064312+0000","last_clean":"2024-09-13T06:44:51.064312+0000","last_became_active":"2024-09-13T06:44:16.449558+0000","last_became_peered":"2024-09-13T06:44:16.449558+0000","last_unstale":"2024-09-13T06:44:51.064312+0000","last_undegraded":"2024-09-13T06:44:51.064312+0000","last_fullsized":"2024-09-13T06:44:51.064312+0000","mapping_epoch":286,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":287,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:44:51.064263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:44:51.064263+0000","last_clean_scrub_stamp":"2024-09-13T06:44:51.064263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:19:23.848694+0000","scrub_duration":0.0030511409999999998,"objects_trimmed":0,"snaptrim_duration":0.00080324699999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"280'643","reported_seq":10773,"reported_epoch":305,"state":"active+clean","last_fresh":"2024-09-13T06:44:56.339345+0000","last_change":"2024-09-13T06:44:56.339345+0000","last_active":"2024-09-13T06:44:56.339345+0000","last_peered":"2024-09-13T06:44:56.339345+0000","last_clean":"2024-09-13T06:44:56.339345+0000","last_became_active":"2024-09-13T06:44:22.449195+0000","last_became_peered":"2024-09-13T06:44:22.449195+0000","last_unstale":"2024-09-13T06:44:56.339345+0000","last_undegraded":"2024-09-13T06:44:56.339345+0000","last_fullsized":"2024-09-13T06:44:56.339345+0000","mapping_epoch":292,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":293,"parent":"0.0","parent_split_bits":0,"last_scrub":"280'643","last_scrub_stamp":"2024-09-13T06:44:56.339007+0000","last_deep_scrub":"280'643","last_deep_scrub_stamp":"2024-09-13T06:44:56.339007+0000","last_clean_scrub_stamp":"2024-09-13T06:44:56.339007+0000","objects_scrubbed":0,"log_size":643,"log_dups_size":0,"ondisk_log_size":643,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:49:08.541338+0000","scrub_duration":0.0041333009999999998,"objects_trimmed":0,"snaptrim_duration":0.00080400600000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9397,"num_read_kb":51433,"num_write":883,"num_write_kb":40908,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":358,"num_bytes_recovered":1257624,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":36,"reported_epoch":305,"state":"active+clean","last_fresh":"2024-09-13T06:44:49.375451+0000","last_change":"2024-09-13T06:44:49.375674+0000","last_active":"2024-09-13T06:44:49.375451+0000","last_peered":"2024-09-13T06:44:49.375451+0000","last_clean":"2024-09-13T06:44:49.375451+0000","last_became_active":"2024-09-13T06:44:18.458454+0000","last_became_peered":"2024-09-13T06:44:18.458454+0000","last_unstale":"2024-09-13T06:44:49.375451+0000","last_undegraded":"2024-09-13T06:44:49.375451+0000","last_fullsized":"2024-09-13T06:44:49.375451+0000","mapping_epoch":288,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":289,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:44:49.375404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:44:49.375404+0000","last_clean_scrub_stamp":"2024-09-13T06:44:49.375404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:43:00.584483+0000","scrub_duration":0.0037092570000000001,"objects_trimmed":0,"snaptrim_duration":0.00097079800000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"277'694","reported_seq":7073,"reported_epoch":305,"state":"active+clean","last_fresh":"2024-09-13T06:45:01.132564+0000","last_change":"2024-09-13T06:45:01.132564+0000","last_active":"2024-09-13T06:45:01.132564+0000","last_peered":"2024-09-13T06:45:01.132564+0000","last_clean":"2024-09-13T06:45:01.132564+0000","last_became_active":"2024-09-13T06:42:32.413006+0000","last_became_peered":"2024-09-13T06:42:32.413006+0000","last_unstale":"2024-09-13T06:45:01.132564+0000","last_undegraded":"2024-09-13T06:45:01.132564+0000","last_fullsized":"2024-09-13T06:45:01.132564+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"277'694","last_scrub_stamp":"2024-09-13T06:45:01.132175+0000","last_deep_scrub":"277'694","last_deep_scrub_stamp":"2024-09-13T06:45:01.132175+0000","last_clean_scrub_stamp":"2024-09-13T06:45:01.132175+0000","objects_scrubbed":0,"log_size":694,"log_dups_size":0,"ondisk_log_size":694,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:56:06.782004+0000","scrub_duration":0.0035896259999999998,"objects_trimmed":0,"snaptrim_duration":0.001338379,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6521,"num_read_kb":33119,"num_write":812,"num_write_kb":30039,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":213,"num_bytes_recovered":15100645,"num_keys_recovered":11,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":193,"reported_epoch":305,"state":"active+clean","last_fresh":"2024-09-13T06:45:02.749503+0000","last_change":"2024-09-13T06:45:02.749797+0000","last_active":"2024-09-13T06:45:02.749503+0000","last_peered":"2024-09-13T06:45:02.749503+0000","last_clean":"2024-09-13T06:45:02.749503+0000","last_became_active":"2024-09-13T06:42:28.562827+0000","last_became_peered":"2024-09-13T06:42:28.562827+0000","last_unstale":"2024-09-13T06:45:02.749503+0000","last_undegraded":"2024-09-13T06:45:02.749503+0000","last_fullsized":"2024-09-13T06:45:02.749503+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:45:02.749451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:45:02.749451+0000","last_clean_scrub_stamp":"2024-09-13T06:45:02.749451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:09:21.603602+0000","scrub_duration":0.003504198,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"277'961","reported_seq":6903,"reported_epoch":305,"state":"active+clean","last_fresh":"2024-09-13T06:45:01.305601+0000","last_change":"2024-09-13T06:45:01.305820+0000","last_active":"2024-09-13T06:45:01.305601+0000","last_peered":"2024-09-13T06:45:01.305601+0000","last_clean":"2024-09-13T06:45:01.305601+0000","last_became_active":"2024-09-13T06:44:22.450933+0000","last_became_peered":"2024-09-13T06:44:22.450933+0000","last_unstale":"2024-09-13T06:45:01.305601+0000","last_undegraded":"2024-09-13T06:45:01.305601+0000","last_fullsized":"2024-09-13T06:45:01.305601+0000","mapping_epoch":292,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":293,"parent":"0.0","parent_split_bits":0,"last_scrub":"277'961","last_scrub_stamp":"2024-09-13T06:45:01.305551+0000","last_deep_scrub":"277'961","last_deep_scrub_stamp":"2024-09-13T06:45:01.305551+0000","last_clean_scrub_stamp":"2024-09-13T06:45:01.305551+0000","objects_scrubbed":0,"log_size":961,"log_dups_size":0,"ondisk_log_size":961,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:42:15.554591+0000","scrub_duration":0.0037257969999999999,"objects_trimmed":0,"snaptrim_duration":0.0031147280000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7705,"num_read_kb":38648,"num_write":1332,"num_write_kb":32653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":354,"num_bytes_recovered":6765835,"num_keys_recovered":11,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":36,"reported_epoch":305,"state":"active+clean","last_fresh":"2024-09-13T06:44:45.496398+0000","last_change":"2024-09-13T06:44:45.496541+0000","last_active":"2024-09-13T06:44:45.496398+0000","last_peered":"2024-09-13T06:44:45.496398+0000","last_clean":"2024-09-13T06:44:45.496398+0000","last_became_active":"2024-09-13T06:44:18.467833+0000","last_became_peered":"2024-09-13T06:44:18.467833+0000","last_unstale":"2024-09-13T06:44:45.496398+0000","last_undegraded":"2024-09-13T06:44:45.496398+0000","last_fullsized":"2024-09-13T06:44:45.496398+0000","mapping_epoch":288,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":289,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:44:45.496366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:44:45.496366+0000","last_clean_scrub_stamp":"2024-09-13T06:44:45.496366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:36:11.510118+0000","scrub_duration":0.0016611639999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"277'640","reported_seq":7767,"reported_epoch":305,"state":"active+clean","last_fresh":"2024-09-13T06:45:09.281827+0000","last_change":"2024-09-13T06:45:09.282063+0000","last_active":"2024-09-13T06:45:09.281827+0000","last_peered":"2024-09-13T06:45:09.281827+0000","last_clean":"2024-09-13T06:45:09.281827+0000","last_became_active":"2024-09-13T06:44:30.797769+0000","last_became_peered":"2024-09-13T06:44:30.797769+0000","last_unstale":"2024-09-13T06:45:09.281827+0000","last_undegraded":"2024-09-13T06:45:09.281827+0000","last_fullsized":"2024-09-13T06:45:09.281827+0000","mapping_epoch":300,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":301,"parent":"0.0","parent_split_bits":0,"last_scrub":"277'640","last_scrub_stamp":"2024-09-13T06:45:09.281771+0000","last_deep_scrub":"277'640","last_deep_scrub_stamp":"2024-09-13T06:45:09.281771+0000","last_clean_scrub_stamp":"2024-09-13T06:45:09.281771+0000","objects_scrubbed":0,"log_size":640,"log_dups_size":0,"ondisk_log_size":640,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:50:16.723750+0000","scrub_duration":0.0042953720000000004,"objects_trimmed":0,"snaptrim_duration":0.0046689339999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7611,"num_read_kb":41345,"num_write":1018,"num_write_kb":26620,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":158,"num_bytes_recovered":4212424,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"305'992","reported_seq":21087,"reported_epoch":305,"state":"active+clean","last_fresh":"2024-09-13T06:44:54.706382+0000","last_change":"2024-09-13T06:44:54.706632+0000","last_active":"2024-09-13T06:44:54.706382+0000","last_peered":"2024-09-13T06:44:54.706382+0000","last_clean":"2024-09-13T06:44:54.706382+0000","last_became_active":"2024-09-13T06:44:28.768976+0000","last_became_peered":"2024-09-13T06:44:28.768976+0000","last_unstale":"2024-09-13T06:44:54.706382+0000","last_undegraded":"2024-09-13T06:44:54.706382+0000","last_fullsized":"2024-09-13T06:44:54.706382+0000","mapping_epoch":298,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":299,"parent":"0.0","parent_split_bits":0,"last_scrub":"305'992","last_scrub_stamp":"2024-09-13T06:44:54.706326+0000","last_deep_scrub":"305'992","last_deep_scrub_stamp":"2024-09-13T06:44:54.706326+0000","last_clean_scrub_stamp":"2024-09-13T06:44:54.706326+0000","objects_scrubbed":1,"log_size":992,"log_dups_size":0,"ondisk_log_size":992,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:19:39.648227+0000","scrub_duration":0.0074843890000000001,"objects_trimmed":0,"snaptrim_duration":0.0017436419999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20994,"num_read_kb":92583,"num_write":1315,"num_write_kb":30385,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":207,"num_bytes_recovered":9898606,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"305'3","reported_seq":139,"reported_epoch":305,"state":"active+clean","last_fresh":"2024-09-13T06:45:21.212104+0000","last_change":"2024-09-13T06:45:21.212104+0000","last_active":"2024-09-13T06:45:21.212104+0000","last_peered":"2024-09-13T06:45:21.212104+0000","last_clean":"2024-09-13T06:45:21.212104+0000","last_became_active":"2024-09-13T06:44:30.794134+0000","last_became_peered":"2024-09-13T06:44:30.794134+0000","last_unstale":"2024-09-13T06:45:21.212104+0000","last_undegraded":"2024-09-13T06:45:21.212104+0000","last_fullsized":"2024-09-13T06:45:21.212104+0000","mapping_epoch":300,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":301,"parent":"0.0","parent_split_bits":0,"last_scrub":"305'3","last_scrub_stamp":"2024-09-13T06:45:21.211769+0000","last_deep_scrub":"305'3","last_deep_scrub_stamp":"2024-09-13T06:45:21.211769+0000","last_clean_scrub_stamp":"2024-09-13T06:45:21.211769+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:57:30.544001+0000","scrub_duration":0.0068074579999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":57,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"278'857","reported_seq":10784,"reported_epoch":305,"state":"active+clean","last_fresh":"2024-09-13T06:44:59.325085+0000","last_change":"2024-09-13T06:44:59.325329+0000","last_active":"2024-09-13T06:44:59.325085+0000","last_peered":"2024-09-13T06:44:59.325085+0000","last_clean":"2024-09-13T06:44:59.325085+0000","last_became_active":"2024-09-13T06:44:21.442847+0000","last_became_peered":"2024-09-13T06:44:21.442847+0000","last_unstale":"2024-09-13T06:44:59.325085+0000","last_undegraded":"2024-09-13T06:44:59.325085+0000","last_fullsized":"2024-09-13T06:44:59.325085+0000","mapping_epoch":291,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":292,"parent":"0.0","parent_split_bits":0,"last_scrub":"278'857","last_scrub_stamp":"2024-09-13T06:44:59.325032+0000","last_deep_scrub":"278'857","last_deep_scrub_stamp":"2024-09-13T06:44:59.325032+0000","last_clean_scrub_stamp":"2024-09-13T06:44:59.325032+0000","objects_scrubbed":0,"log_size":857,"log_dups_size":0,"ondisk_log_size":857,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:25:42.057889+0000","scrub_duration":0.0037999230000000002,"objects_trimmed":0,"snaptrim_duration":0.00053211199999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11278,"num_read_kb":63107,"num_write":1190,"num_write_kb":36968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":351,"num_bytes_recovered":9847094,"num_keys_recovered":11,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":38,"reported_epoch":305,"state":"active+clean","last_fresh":"2024-09-13T06:44:49.759291+0000","last_change":"2024-09-13T06:44:49.759572+0000","last_active":"2024-09-13T06:44:49.759291+0000","last_peered":"2024-09-13T06:44:49.759291+0000","last_clean":"2024-09-13T06:44:49.759291+0000","last_became_active":"2024-09-13T06:44:17.443358+0000","last_became_peered":"2024-09-13T06:44:17.443358+0000","last_unstale":"2024-09-13T06:44:49.759291+0000","last_undegraded":"2024-09-13T06:44:49.759291+0000","last_fullsized":"2024-09-13T06:44:49.759291+0000","mapping_epoch":287,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":288,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:44:49.759238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:44:49.759238+0000","last_clean_scrub_stamp":"2024-09-13T06:44:49.759238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T08:01:14.724152+0000","scrub_duration":0.0032066769999999998,"objects_trimmed":0,"snaptrim_duration":0.00033592499999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"277'1115","reported_seq":6270,"reported_epoch":305,"state":"active+clean","last_fresh":"2024-09-13T06:44:57.361972+0000","last_change":"2024-09-13T06:44:57.362244+0000","last_active":"2024-09-13T06:44:57.361972+0000","last_peered":"2024-09-13T06:44:57.361972+0000","last_clean":"2024-09-13T06:44:57.361972+0000","last_became_active":"2024-09-13T06:44:30.798508+0000","last_became_peered":"2024-09-13T06:44:30.798508+0000","last_unstale":"2024-09-13T06:44:57.361972+0000","last_undegraded":"2024-09-13T06:44:57.361972+0000","last_fullsized":"2024-09-13T06:44:57.361972+0000","mapping_epoch":300,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":301,"parent":"0.0","parent_split_bits":0,"last_scrub":"277'1115","last_scrub_stamp":"2024-09-13T06:44:57.361917+0000","last_deep_scrub":"277'1115","last_deep_scrub_stamp":"2024-09-13T06:44:57.361917+0000","last_clean_scrub_stamp":"2024-09-13T06:44:57.361917+0000","objects_scrubbed":0,"log_size":1115,"log_dups_size":0,"ondisk_log_size":1115,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:16:22.708238+0000","scrub_duration":0.0035611200000000001,"objects_trimmed":0,"snaptrim_duration":0.0032283849999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7964,"num_read_kb":36198,"num_write":1645,"num_write_kb":33105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":243,"num_bytes_recovered":7863454,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":209,"reported_epoch":305,"state":"active+clean","last_fresh":"2024-09-13T06:45:05.771302+0000","last_change":"2024-09-13T06:45:05.771512+0000","last_active":"2024-09-13T06:45:05.771302+0000","last_peered":"2024-09-13T06:45:05.771302+0000","last_clean":"2024-09-13T06:45:05.771302+0000","last_became_active":"2024-09-13T06:44:18.456828+0000","last_became_peered":"2024-09-13T06:44:18.456828+0000","last_unstale":"2024-09-13T06:45:05.771302+0000","last_undegraded":"2024-09-13T06:45:05.771302+0000","last_fullsized":"2024-09-13T06:45:05.771302+0000","mapping_epoch":288,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":289,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T06:45:05.771253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T06:45:05.771253+0000","last_clean_scrub_stamp":"2024-09-13T06:45:05.771253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T10:09:48.503953+0000","scrub_duration":0.0033023660000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"279'349","reported_seq":3776,"reported_epoch":305,"state":"active+clean","last_fresh":"2024-09-13T06:44:56.046531+0000","last_change":"2024-09-13T06:44:56.046531+0000","last_active":"2024-09-13T06:44:56.046531+0000","last_peered":"2024-09-13T06:44:56.046531+0000","last_clean":"2024-09-13T06:44:56.046531+0000","last_became_active":"2024-09-13T06:41:15.399301+0000","last_became_peered":"2024-09-13T06:41:15.399301+0000","last_unstale":"2024-09-13T06:44:56.046531+0000","last_undegraded":"2024-09-13T06:44:56.046531+0000","last_fullsized":"2024-09-13T06:44:56.046531+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"279'349","last_scrub_stamp":"2024-09-13T06:44:56.046245+0000","last_deep_scrub":"279'349","last_deep_scrub_stamp":"2024-09-13T06:44:56.046245+0000","last_clean_scrub_stamp":"2024-09-13T06:44:56.046245+0000","objects_scrubbed":0,"log_size":349,"log_dups_size":0,"ondisk_log_size":349,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:52:24.133674+0000","scrub_duration":0.003821592,"objects_trimmed":0,"snaptrim_duration":0.001343293,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2523,"num_read_kb":19829,"num_write":427,"num_write_kb":20943,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":169,"num_bytes_recovered":5233325,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"305'2","reported_seq":69,"reported_epoch":305,"state":"active+clean","last_fresh":"2024-09-13T06:45:19.263140+0000","last_change":"2024-09-13T06:45:19.263361+0000","last_active":"2024-09-13T06:45:19.263140+0000","last_peered":"2024-09-13T06:45:19.263140+0000","last_clean":"2024-09-13T06:45:19.263140+0000","last_became_active":"2024-09-13T06:44:30.796877+0000","last_became_peered":"2024-09-13T06:44:30.796877+0000","last_unstale":"2024-09-13T06:45:19.263140+0000","last_undegraded":"2024-09-13T06:45:19.263140+0000","last_fullsized":"2024-09-13T06:45:19.263140+0000","mapping_epoch":300,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":301,"parent":"0.0","parent_split_bits":0,"last_scrub":"305'2","last_scrub_stamp":"2024-09-13T06:45:19.263083+0000","last_deep_scrub":"305'2","last_deep_scrub_stamp":"2024-09-13T06:45:19.263083+0000","last_clean_scrub_stamp":"2024-09-13T06:45:19.263083+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T13:26:41.281859+0000","scrub_duration":0.0067202219999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"305'119","reported_seq":411,"reported_epoch":305,"state":"active+clean","last_fresh":"2024-09-13T06:44:48.725331+0000","last_change":"2024-09-13T06:44:48.725596+0000","last_active":"2024-09-13T06:44:48.725331+0000","last_peered":"2024-09-13T06:44:48.725331+0000","last_clean":"2024-09-13T06:44:48.725331+0000","last_became_active":"2024-09-13T06:42:28.562642+0000","last_became_peered":"2024-09-13T06:42:28.562642+0000","last_unstale":"2024-09-13T06:44:48.725331+0000","last_undegraded":"2024-09-13T06:44:48.725331+0000","last_fullsized":"2024-09-13T06:44:48.725331+0000","mapping_epoch":187,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"305'119","last_scrub_stamp":"2024-09-13T06:44:48.725274+0000","last_deep_scrub":"305'119","last_deep_scrub_stamp":"2024-09-13T06:44:48.725274+0000","last_clean_scrub_stamp":"2024-09-13T06:44:48.725274+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:06:03.567948+0000","scrub_duration":0.0090167430000000007,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"277'651","reported_seq":10864,"reported_epoch":305,"state":"active+clean","last_fresh":"2024-09-13T06:44:53.006305+0000","last_change":"2024-09-13T06:44:53.006305+0000","last_active":"2024-09-13T06:44:53.006305+0000","last_peered":"2024-09-13T06:44:53.006305+0000","last_clean":"2024-09-13T06:44:53.006305+0000","last_became_active":"2024-09-13T06:44:22.448736+0000","last_became_peered":"2024-09-13T06:44:22.448736+0000","last_unstale":"2024-09-13T06:44:53.006305+0000","last_undegraded":"2024-09-13T06:44:53.006305+0000","last_fullsized":"2024-09-13T06:44:53.006305+0000","mapping_epoch":292,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":293,"parent":"0.0","parent_split_bits":0,"last_scrub":"277'651","last_scrub_stamp":"2024-09-13T06:44:53.006028+0000","last_deep_scrub":"277'651","last_deep_scrub_stamp":"2024-09-13T06:44:53.006028+0000","last_clean_scrub_stamp":"2024-09-13T06:44:53.006028+0000","objects_scrubbed":0,"log_size":651,"log_dups_size":0,"ondisk_log_size":651,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:04:46.989212+0000","scrub_duration":0.0038846829999999999,"objects_trimmed":0,"snaptrim_duration":0.00083432600000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9552,"num_read_kb":46146,"num_write":828,"num_write_kb":32512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":446,"num_bytes_recovered":11977587,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"277'774","reported_seq":10956,"reported_epoch":305,"state":"active+clean","last_fresh":"2024-09-13T06:44:56.784127+0000","last_change":"2024-09-13T06:44:56.784408+0000","last_active":"2024-09-13T06:44:56.784127+0000","last_peered":"2024-09-13T06:44:56.784127+0000","last_clean":"2024-09-13T06:44:56.784127+0000","last_became_active":"2024-09-13T06:44:20.462849+0000","last_became_peered":"2024-09-13T06:44:20.462849+0000","last_unstale":"2024-09-13T06:44:56.784127+0000","last_undegraded":"2024-09-13T06:44:56.784127+0000","last_fullsized":"2024-09-13T06:44:56.784127+0000","mapping_epoch":290,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":291,"parent":"0.0","parent_split_bits":0,"last_scrub":"277'774","last_scrub_stamp":"2024-09-13T06:44:56.784076+0000","last_deep_scrub":"277'774","last_deep_scrub_stamp":"2024-09-13T06:44:56.784076+0000","last_clean_scrub_stamp":"2024-09-13T06:44:56.784076+0000","objects_scrubbed":0,"log_size":774,"log_dups_size":0,"ondisk_log_size":774,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:00:46.165167+0000","scrub_duration":0.0040360980000000001,"objects_trimmed":0,"snaptrim_duration":0.0024338839999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10729,"num_read_kb":51645,"num_write":931,"num_write_kb":34617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":445,"num_bytes_recovered":16579571,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"278'758","reported_seq":8294,"reported_epoch":305,"state":"active+clean","last_fresh":"2024-09-13T06:44:55.069007+0000","last_change":"2024-09-13T06:44:55.069219+0000","last_active":"2024-09-13T06:44:55.069007+0000","last_peered":"2024-09-13T06:44:55.069007+0000","last_clean":"2024-09-13T06:44:55.069007+0000","last_became_active":"2024-09-13T06:44:34.836417+0000","last_became_peered":"2024-09-13T06:44:34.836417+0000","last_unstale":"2024-09-13T06:44:55.069007+0000","last_undegraded":"2024-09-13T06:44:55.069007+0000","last_fullsized":"2024-09-13T06:44:55.069007+0000","mapping_epoch":304,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":305,"parent":"0.0","parent_split_bits":0,"last_scrub":"278'758","last_scrub_stamp":"2024-09-13T06:44:55.068956+0000","last_deep_scrub":"278'758","last_deep_scrub_stamp":"2024-09-13T06:44:55.068956+0000","last_clean_scrub_stamp":"2024-09-13T06:44:55.068956+0000","objects_scrubbed":0,"log_size":758,"log_dups_size":0,"ondisk_log_size":758,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:57:19.230829+0000","scrub_duration":0.0036149659999999998,"objects_trimmed":0,"snaptrim_duration":0.00085210600000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8422,"num_read_kb":47219,"num_write":883,"num_write_kb":28077,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":515,"num_bytes_recovered":28581300,"num_keys_recovered":111,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"271'845","reported_seq":5615,"reported_epoch":305,"state":"active+clean","last_fresh":"2024-09-13T06:45:03.188314+0000","last_change":"2024-09-13T06:45:03.188314+0000","last_active":"2024-09-13T06:45:03.188314+0000","last_peered":"2024-09-13T06:45:03.188314+0000","last_clean":"2024-09-13T06:45:03.188314+0000","last_became_active":"2024-09-13T06:41:15.399204+0000","last_became_peered":"2024-09-13T06:41:15.399204+0000","last_unstale":"2024-09-13T06:45:03.188314+0000","last_undegraded":"2024-09-13T06:45:03.188314+0000","last_fullsized":"2024-09-13T06:45:03.188314+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"271'845","last_scrub_stamp":"2024-09-13T06:45:03.188033+0000","last_deep_scrub":"271'845","last_deep_scrub_stamp":"2024-09-13T06:45:03.188033+0000","last_clean_scrub_stamp":"2024-09-13T06:45:03.188033+0000","objects_scrubbed":0,"log_size":845,"log_dups_size":0,"ondisk_log_size":845,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:47:23.126968+0000","scrub_duration":0.0035194789999999998,"objects_trimmed":0,"snaptrim_duration":0.00094468700000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6686,"num_read_kb":57840,"num_write":1181,"num_write_kb":24665,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":117,"num_bytes_recovered":13256568,"num_keys_recovered":44,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"279'569","reported_seq":6615,"reported_epoch":305,"state":"active+clean","last_fresh":"2024-09-13T06:44:59.229775+0000","last_change":"2024-09-13T06:44:59.230029+0000","last_active":"2024-09-13T06:44:59.229775+0000","last_peered":"2024-09-13T06:44:59.229775+0000","last_clean":"2024-09-13T06:44:59.229775+0000","last_became_active":"2024-09-13T06:44:30.794873+0000","last_became_peered":"2024-09-13T06:44:30.794873+0000","last_unstale":"2024-09-13T06:44:59.229775+0000","last_undegraded":"2024-09-13T06:44:59.229775+0000","last_fullsized":"2024-09-13T06:44:59.229775+0000","mapping_epoch":300,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":301,"parent":"0.0","parent_split_bits":0,"last_scrub":"279'569","last_scrub_stamp":"2024-09-13T06:44:59.229718+0000","last_deep_scrub":"279'569","last_deep_scrub_stamp":"2024-09-13T06:44:59.229718+0000","last_clean_scrub_stamp":"2024-09-13T06:44:59.229718+0000","objects_scrubbed":0,"log_size":569,"log_dups_size":0,"ondisk_log_size":569,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:49:38.735223+0000","scrub_duration":0.0039679950000000002,"objects_trimmed":0,"snaptrim_duration":0.0027493119999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6187,"num_read_kb":31727,"num_write":657,"num_write_kb":25682,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":184,"num_bytes_recovered":16410936,"num_keys_recovered":88,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"277'881","reported_seq":2936,"reported_epoch":305,"state":"active+clean","last_fresh":"2024-09-13T06:45:23.904714+0000","last_change":"2024-09-13T06:45:23.904933+0000","last_active":"2024-09-13T06:45:23.904714+0000","last_peered":"2024-09-13T06:45:23.904714+0000","last_clean":"2024-09-13T06:45:23.904714+0000","last_became_active":"2024-09-13T06:42:32.411927+0000","last_became_peered":"2024-09-13T06:42:32.411927+0000","last_unstale":"2024-09-13T06:45:23.904714+0000","last_undegraded":"2024-09-13T06:45:23.904714+0000","last_fullsized":"2024-09-13T06:45:23.904714+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"277'881","last_scrub_stamp":"2024-09-13T06:45:23.904660+0000","last_deep_scrub":"277'881","last_deep_scrub_stamp":"2024-09-13T06:45:23.904660+0000","last_clean_scrub_stamp":"2024-09-13T06:45:23.904660+0000","objects_scrubbed":0,"log_size":881,"log_dups_size":0,"ondisk_log_size":881,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:30:41.894311+0000","scrub_duration":0.0041225259999999996,"objects_trimmed":0,"snaptrim_duration":0.003013108,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4846,"num_read_kb":26164,"num_write":1518,"num_write_kb":30083,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":140,"num_bytes_recovered":11278110,"num_keys_recovered":11,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.e","version":"277'556","reported_seq":4115,"reported_epoch":305,"state":"active+clean","last_fresh":"2024-09-13T06:45:21.861468+0000","last_change":"2024-09-13T06:45:21.861737+0000","last_active":"2024-09-13T06:45:21.861468+0000","last_peered":"2024-09-13T06:45:21.861468+0000","last_clean":"2024-09-13T06:45:21.861468+0000","last_became_active":"2024-09-13T06:44:30.801655+0000","last_became_peered":"2024-09-13T06:44:30.801655+0000","last_unstale":"2024-09-13T06:45:21.861468+0000","last_undegraded":"2024-09-13T06:45:21.861468+0000","last_fullsized":"2024-09-13T06:45:21.861468+0000","mapping_epoch":300,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":301,"parent":"0.0","parent_split_bits":0,"last_scrub":"277'556","last_scrub_stamp":"2024-09-13T06:45:21.861415+0000","last_deep_scrub":"277'556","last_deep_scrub_stamp":"2024-09-13T06:45:21.861415+0000","last_clean_scrub_stamp":"2024-09-13T06:45:21.861415+0000","objects_scrubbed":0,"log_size":556,"log_dups_size":0,"ondisk_log_size":556,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:31:16.495405+0000","scrub_duration":0.0033968929999999998,"objects_trimmed":0,"snaptrim_duration":0.0025767619999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3868,"num_read_kb":43567,"num_write":654,"num_write_kb":29232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":503,"num_bytes_recovered":12695191,"num_keys_recovered":11,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"277'665","reported_seq":4767,"reported_epoch":305,"state":"active+clean","last_fresh":"2024-09-13T06:45:30.989775+0000","last_change":"2024-09-13T06:45:30.990081+0000","last_active":"2024-09-13T06:45:30.989775+0000","last_peered":"2024-09-13T06:45:30.989775+0000","last_clean":"2024-09-13T06:45:30.989775+0000","last_became_active":"2024-09-13T06:42:33.412054+0000","last_became_peered":"2024-09-13T06:42:33.412054+0000","last_unstale":"2024-09-13T06:45:30.989775+0000","last_undegraded":"2024-09-13T06:45:30.989775+0000","last_fullsized":"2024-09-13T06:45:30.989775+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"277'665","last_scrub_stamp":"2024-09-13T06:45:30.989717+0000","last_deep_scrub":"277'665","last_deep_scrub_stamp":"2024-09-13T06:45:30.989717+0000","last_clean_scrub_stamp":"2024-09-13T06:45:30.989717+0000","objects_scrubbed":0,"log_size":665,"log_dups_size":0,"ondisk_log_size":665,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:06:40.185428+0000","scrub_duration":0.0037453619999999999,"objects_trimmed":0,"snaptrim_duration":0.00285659,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4677,"num_read_kb":45287,"num_write":982,"num_write_kb":45285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":394,"num_bytes_recovered":42768786,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.10","version":"280'832","reported_seq":5047,"reported_epoch":305,"state":"active+clean","last_fresh":"2024-09-13T06:44:54.076963+0000","last_change":"2024-09-13T06:44:54.077211+0000","last_active":"2024-09-13T06:44:54.076963+0000","last_peered":"2024-09-13T06:44:54.076963+0000","last_clean":"2024-09-13T06:44:54.076963+0000","last_became_active":"2024-09-13T06:44:19.459617+0000","last_became_peered":"2024-09-13T06:44:19.459617+0000","last_unstale":"2024-09-13T06:44:54.076963+0000","last_undegraded":"2024-09-13T06:44:54.076963+0000","last_fullsized":"2024-09-13T06:44:54.076963+0000","mapping_epoch":289,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":290,"parent":"0.0","parent_split_bits":0,"last_scrub":"280'832","last_scrub_stamp":"2024-09-13T06:44:54.076908+0000","last_deep_scrub":"280'832","last_deep_scrub_stamp":"2024-09-13T06:44:54.076908+0000","last_clean_scrub_stamp":"2024-09-13T06:44:54.076908+0000","objects_scrubbed":0,"log_size":832,"log_dups_size":0,"ondisk_log_size":832,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:11:04.455152+0000","scrub_duration":0.0036414469999999999,"objects_trimmed":0,"snaptrim_duration":0.0018779840000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5715,"num_read_kb":29614,"num_write":1142,"num_write_kb":36190,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":275,"num_bytes_recovered":6622441,"num_keys_recovered":20,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.11","version":"279'502","reported_seq":6292,"reported_epoch":305,"state":"active+clean","last_fresh":"2024-09-13T06:45:24.915682+0000","last_change":"2024-09-13T06:45:24.915898+0000","last_active":"2024-09-13T06:45:24.915682+0000","last_peered":"2024-09-13T06:45:24.915682+0000","last_clean":"2024-09-13T06:45:24.915682+0000","last_became_active":"2024-09-13T06:42:33.411668+0000","last_became_peered":"2024-09-13T06:42:33.411668+0000","last_unstale":"2024-09-13T06:45:24.915682+0000","last_undegraded":"2024-09-13T06:45:24.915682+0000","last_fullsized":"2024-09-13T06:45:24.915682+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"279'502","last_scrub_stamp":"2024-09-13T06:45:24.915625+0000","last_deep_scrub":"279'502","last_deep_scrub_stamp":"2024-09-13T06:45:24.915625+0000","last_clean_scrub_stamp":"2024-09-13T06:45:24.915625+0000","objects_scrubbed":0,"log_size":502,"log_dups_size":0,"ondisk_log_size":502,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:47:10.617534+0000","scrub_duration":0.003740176,"objects_trimmed":0,"snaptrim_duration":0.001270492,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5341,"num_read_kb":34087,"num_write":659,"num_write_kb":25712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":245,"num_bytes_recovered":7089272,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"280'921","reported_seq":5059,"reported_epoch":305,"state":"active+clean","last_fresh":"2024-09-13T06:44:58.336531+0000","last_change":"2024-09-13T06:44:58.336745+0000","last_active":"2024-09-13T06:44:58.336531+0000","last_peered":"2024-09-13T06:44:58.336531+0000","last_clean":"2024-09-13T06:44:58.336531+0000","last_became_active":"2024-09-13T06:44:20.466713+0000","last_became_peered":"2024-09-13T06:44:20.466713+0000","last_unstale":"2024-09-13T06:44:58.336531+0000","last_undegraded":"2024-09-13T06:44:58.336531+0000","last_fullsized":"2024-09-13T06:44:58.336531+0000","mapping_epoch":290,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":291,"parent":"0.0","parent_split_bits":0,"last_scrub":"280'921","last_scrub_stamp":"2024-09-13T06:44:58.336451+0000","last_deep_scrub":"280'921","last_deep_scrub_stamp":"2024-09-13T06:44:58.336451+0000","last_clean_scrub_stamp":"2024-09-13T06:44:58.336451+0000","objects_scrubbed":0,"log_size":921,"log_dups_size":0,"ondisk_log_size":921,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T14:33:27.820931+0000","scrub_duration":0.0041990819999999998,"objects_trimmed":0,"snaptrim_duration":0.0017683250000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6025,"num_read_kb":38947,"num_write":1315,"num_write_kb":35656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":107,"num_bytes_recovered":3682200,"num_keys_recovered":21,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"279'604","reported_seq":4559,"reported_epoch":305,"state":"active+clean","last_fresh":"2024-09-13T06:45:06.749656+0000","last_change":"2024-09-13T06:45:06.749896+0000","last_active":"2024-09-13T06:45:06.749656+0000","last_peered":"2024-09-13T06:45:06.749656+0000","last_clean":"2024-09-13T06:45:06.749656+0000","last_became_active":"2024-09-13T06:42:31.402800+0000","last_became_peered":"2024-09-13T06:42:31.402800+0000","last_unstale":"2024-09-13T06:45:06.749656+0000","last_undegraded":"2024-09-13T06:45:06.749656+0000","last_fullsized":"2024-09-13T06:45:06.749656+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"279'604","last_scrub_stamp":"2024-09-13T06:45:06.749600+0000","last_deep_scrub":"279'604","last_deep_scrub_stamp":"2024-09-13T06:45:06.749600+0000","last_clean_scrub_stamp":"2024-09-13T06:45:06.749600+0000","objects_scrubbed":0,"log_size":604,"log_dups_size":0,"ondisk_log_size":604,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T11:57:10.059560+0000","scrub_duration":0.0039280310000000002,"objects_trimmed":0,"snaptrim_duration":0.0010470779999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4471,"num_read_kb":35894,"num_write":884,"num_write_kb":31515,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":196,"num_bytes_recovered":8224568,"num_keys_recovered":11,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":19,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":237282,"num_read_kb":1402862,"num_write":33322,"num_write_kb":1008910,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9249,"num_bytes_recovered":443628516,"num_keys_recovered":867,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14648,"internal_metadata":0},"log_size":24489,"ondisk_log_size":24489,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":57,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":3}],"osd_stats":[{"osd":7,"up_from":187,"seq":803158884394,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37036,"kb_used_data":4196,"kb_used_omap":9,"kb_used_meta":32822,"kb_avail":94334804,"statfs":{"total":96636764160,"available":96598839296,"internally_reserved":0,"allocated":4296704,"data_stored":2446923,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9685,"internal_metadata":33610283},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 06:45:33 2024","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":0.72899999999999998,"15min":0.70399999999999996},"min":{"1min":0.57399999999999995,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.97999999999999998,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":1.0589999999999999},{"interface":"front","average":{"1min":0.88800000000000001,"5min":0.78200000000000003,"15min":0.75},"min":{"1min":0.46200000000000002,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.1559999999999999,"5min":1.6910000000000001,"15min":1.6910000000000001},"last":0.94599999999999995}]},{"osd":1,"last update":"Fri Sep 13 06:45:33 2024","interfaces":[{"interface":"back","average":{"1min":0.84099999999999997,"5min":0.77600000000000002,"15min":0.75800000000000001},"min":{"1min":0.53700000000000003,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.292,"5min":1.359,"15min":1.359},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.90200000000000002,"5min":0.75900000000000001,"15min":0.71299999999999997},"min":{"1min":0.53500000000000003,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.1419999999999999,"5min":1.1419999999999999,"15min":1.1419999999999999},"last":1.1180000000000001}]},{"osd":2,"last update":"Fri Sep 13 06:45:33 2024","interfaces":[{"interface":"back","average":{"1min":0.874,"5min":0.78500000000000003,"15min":0.76000000000000001},"min":{"1min":0.66200000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.165,"5min":1.212,"15min":1.212},"last":1.0229999999999999},{"interface":"front","average":{"1min":0.89500000000000002,"5min":0.83599999999999997,"15min":0.80400000000000005},"min":{"1min":0.623,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.1659999999999999,"5min":1.4319999999999999,"15min":1.4319999999999999},"last":0.83399999999999996}]},{"osd":3,"last update":"Fri Sep 13 06:45:33 2024","interfaces":[{"interface":"back","average":{"1min":0.90600000000000003,"5min":0.81899999999999995,"15min":0.80000000000000004},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.1299999999999999,"5min":1.177,"15min":1.177},"last":0.97099999999999997},{"interface":"front","average":{"1min":0.99299999999999999,"5min":0.875,"15min":0.84699999999999998},"min":{"1min":0.78500000000000003,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.1699999999999999,"5min":1.7350000000000001,"15min":1.7350000000000001},"last":1.1930000000000001}]},{"osd":4,"last update":"Fri Sep 13 06:45:33 2024","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.81999999999999995,"15min":0.82399999999999995},"min":{"1min":0.55800000000000005,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.0589999999999999,"5min":1.405,"15min":1.405},"last":1.0800000000000001},{"interface":"front","average":{"1min":1.0960000000000001,"5min":0.88700000000000001,"15min":0.81399999999999995},"min":{"1min":0.93999999999999995,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.3260000000000001,"5min":1.6240000000000001,"15min":1.6240000000000001},"last":1.234}]},{"osd":5,"last update":"Fri Sep 13 06:45:33 2024","interfaces":[{"interface":"back","average":{"1min":0.86899999999999999,"5min":0.88800000000000001,"15min":0.875},"min":{"1min":0.60999999999999999,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.181,"5min":1.593,"15min":1.593},"last":0.91000000000000003},{"interface":"front","average":{"1min":0.93799999999999994,"5min":0.86399999999999999,"15min":0.83499999999999996},"min":{"1min":0.59899999999999998,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.2010000000000001,"5min":1.3400000000000001,"15min":1.3400000000000001},"last":1.1719999999999999}]},{"osd":6,"last update":"Fri Sep 13 06:45:18 2024","interfaces":[{"interface":"back","average":{"1min":1.075,"5min":1.075,"15min":1.075},"min":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":1.9239999999999999,"5min":1.9239999999999999,"15min":1.9239999999999999},"last":1.216},{"interface":"front","average":{"1min":1.028,"5min":1.028,"15min":1.028},"min":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"max":{"1min":1.3600000000000001,"5min":1.3600000000000001,"15min":1.3600000000000001},"last":1.145}]}]},{"osd":6,"up_from":286,"seq":1228360646676,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35500,"kb_used_data":3620,"kb_used_omap":7,"kb_used_meta":31864,"kb_avail":94336340,"statfs":{"total":96636764160,"available":96600412160,"internally_reserved":0,"allocated":3706880,"data_stored":1857127,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8145,"internal_metadata":32628783},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 06:45:19 2024","interfaces":[{"interface":"back","average":{"1min":0.879,"5min":0.879,"15min":0.879},"min":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":1.2769999999999999,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":1.0529999999999999},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"min":{"1min":0.629,"5min":0.629,"15min":0.629},"max":{"1min":1.1539999999999999,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.92100000000000004}]},{"osd":1,"last update":"Fri Sep 13 06:45:19 2024","interfaces":[{"interface":"back","average":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"min":{"1min":0.749,"5min":0.749,"15min":0.749},"max":{"1min":1.26,"5min":1.26,"15min":1.26},"last":0.99299999999999999},{"interface":"front","average":{"1min":0.999,"5min":0.999,"15min":0.999},"min":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.216,"5min":1.216,"15min":1.216},"last":0.95499999999999996}]},{"osd":2,"last update":"Fri Sep 13 06:45:19 2024","interfaces":[{"interface":"back","average":{"1min":1.004,"5min":1.004,"15min":1.004},"min":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":1.2669999999999999,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":1.111},{"interface":"front","average":{"1min":1.004,"5min":1.004,"15min":1.004},"min":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.385,"5min":1.385,"15min":1.385},"last":0.79200000000000004}]},{"osd":3,"last update":"Fri Sep 13 06:45:19 2024","interfaces":[{"interface":"back","average":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"min":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.3200000000000001,"5min":1.3200000000000001,"15min":1.3200000000000001},"last":1.0269999999999999},{"interface":"front","average":{"1min":1.069,"5min":1.069,"15min":1.069},"min":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"max":{"1min":1.3600000000000001,"5min":1.3600000000000001,"15min":1.3600000000000001},"last":1.135}]},{"osd":4,"last update":"Fri Sep 13 06:45:19 2024","interfaces":[{"interface":"back","average":{"1min":0.88,"5min":0.88,"15min":0.88},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.2090000000000001,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":0.74399999999999999},{"interface":"front","average":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"min":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"max":{"1min":1.2769999999999999,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":1.0860000000000001}]},{"osd":5,"last update":"Fri Sep 13 06:45:19 2024","interfaces":[{"interface":"back","average":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.3360000000000001,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":0.67800000000000005},{"interface":"front","average":{"1min":1.139,"5min":1.139,"15min":1.139},"min":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"max":{"1min":1.397,"5min":1.397,"15min":1.397},"last":0.82199999999999995}]},{"osd":7,"last update":"Fri Sep 13 06:45:19 2024","interfaces":[{"interface":"back","average":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":1.0740000000000001},"min":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"max":{"1min":1.48,"5min":1.48,"15min":1.48},"last":0.71399999999999997},{"interface":"front","average":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"min":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"max":{"1min":1.5249999999999999,"5min":1.5249999999999999,"15min":1.5249999999999999},"last":0.86199999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574931,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":79020,"kb_used_data":3620,"kb_used_omap":1,"kb_used_meta":75390,"kb_avail":94292820,"statfs":{"total":96636764160,"available":96555847680,"internally_reserved":0,"allocated":3706880,"data_stored":1856574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":77199814},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 06:45:24 2024","interfaces":[{"interface":"back","average":{"1min":0.95499999999999996,"5min":0.747,"15min":0.77600000000000002},"min":{"1min":0.53000000000000003,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":1.4370000000000001,"5min":1.4370000000000001,"15min":1.6679999999999999},"last":0.85499999999999998},{"interface":"front","average":{"1min":0.94299999999999995,"5min":0.79500000000000004,"15min":0.80700000000000005},"min":{"1min":0.57399999999999995,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.173,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":0.96299999999999997}]},{"osd":1,"last update":"Fri Sep 13 06:45:24 2024","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.752,"15min":0.755},"min":{"1min":0.57799999999999996,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":1.0780000000000001,"5min":1.341,"15min":1.341},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.70299999999999996,"15min":0.74099999999999999},"min":{"1min":0.49399999999999999,"5min":0.317,"15min":0.317},"max":{"1min":1.075,"5min":1.722,"15min":1.722},"last":0.998}]},{"osd":2,"last update":"Fri Sep 13 06:45:24 2024","interfaces":[{"interface":"back","average":{"1min":0.90400000000000003,"5min":0.82299999999999995,"15min":0.86499999999999999},"min":{"1min":0.66100000000000003,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.167,"5min":1.833,"15min":1.833},"last":1.097},{"interface":"front","average":{"1min":0.86299999999999999,"5min":0.78700000000000003,"15min":0.79600000000000004},"min":{"1min":0.57099999999999995,"5min":0.44,"15min":0.435},"max":{"1min":1.2629999999999999,"5min":1.2629999999999999,"15min":1.4279999999999999},"last":0.89600000000000002}]},{"osd":3,"last update":"Fri Sep 13 06:45:24 2024","interfaces":[{"interface":"back","average":{"1min":0.97599999999999998,"5min":0.85599999999999998,"15min":0.79400000000000004},"min":{"1min":0.78400000000000003,"5min":0.434,"15min":0.434},"max":{"1min":1.2270000000000001,"5min":1.885,"15min":1.885},"last":1.1479999999999999},{"interface":"front","average":{"1min":1.024,"5min":0.89400000000000002,"15min":0.876},"min":{"1min":0.77600000000000002,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.212,"5min":1.907,"15min":1.907},"last":1.224}]},{"osd":4,"last update":"Fri Sep 13 06:45:24 2024","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.84099999999999997,"15min":0.80700000000000005},"min":{"1min":0.55500000000000005,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":1.5680000000000001,"5min":6.3179999999999996,"15min":6.3179999999999996},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.92900000000000005,"5min":1.071,"15min":0.91600000000000004},"min":{"1min":0.623,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":1.22,"5min":15.553000000000001,"15min":15.553000000000001},"last":1.1799999999999999}]},{"osd":6,"last update":"Fri Sep 13 06:45:18 2024","interfaces":[{"interface":"back","average":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"min":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.4870000000000001,"5min":1.4870000000000001,"15min":1.4870000000000001},"last":0.93700000000000006},{"interface":"front","average":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"min":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"max":{"1min":1.2689999999999999,"5min":1.2689999999999999,"15min":1.2689999999999999},"last":1.123}]},{"osd":7,"last update":"Fri Sep 13 06:45:34 2024","interfaces":[{"interface":"back","average":{"1min":0.97499999999999998,"5min":0.876,"15min":0.83399999999999996},"min":{"1min":0.67100000000000004,"5min":0.373,"15min":0.373},"max":{"1min":1.2270000000000001,"5min":1.375,"15min":1.375},"last":1.204},{"interface":"front","average":{"1min":1.1259999999999999,"5min":0.94899999999999995,"15min":0.89900000000000002},"min":{"1min":0.93400000000000005,"5min":0.44,"15min":0.44},"max":{"1min":1.2909999999999999,"5min":1.7050000000000001,"15min":1.7050000000000001},"last":1.0760000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574931,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60976,"kb_used_data":3624,"kb_used_omap":1,"kb_used_meta":57342,"kb_avail":94310864,"statfs":{"total":96636764160,"available":96574324736,"internally_reserved":0,"allocated":3710976,"data_stored":1857146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":58718662},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 06:45:16 2024","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.73199999999999998,"15min":0.96999999999999997},"min":{"1min":0.55000000000000004,"5min":0.245,"15min":0.245},"max":{"1min":1.216,"5min":1.3959999999999999,"15min":5.8230000000000004},"last":0.96799999999999997},{"interface":"front","average":{"1min":0.86299999999999999,"5min":0.73899999999999999,"15min":0.75800000000000001},"min":{"1min":0.54200000000000004,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":1.2150000000000001,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.76000000000000001}]},{"osd":1,"last update":"Fri Sep 13 06:45:16 2024","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.80900000000000005,"15min":0.755},"min":{"1min":0.57599999999999996,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.1990000000000001,"5min":10.156000000000001,"15min":10.156000000000001},"last":1.113},{"interface":"front","average":{"1min":0.92700000000000005,"5min":0.78700000000000003,"15min":0.83999999999999997},"min":{"1min":0.64800000000000002,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.575,"5min":1.575,"15min":1.575},"last":1.0620000000000001}]},{"osd":2,"last update":"Fri Sep 13 06:45:16 2024","interfaces":[{"interface":"back","average":{"1min":0.88100000000000001,"5min":0.755,"15min":0.82399999999999995},"min":{"1min":0.55300000000000005,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":1.1040000000000001,"5min":1.6000000000000001,"15min":1.6000000000000001},"last":0.89900000000000002},{"interface":"front","average":{"1min":0.90100000000000002,"5min":0.80900000000000005,"15min":0.81899999999999995},"min":{"1min":0.69399999999999995,"5min":0.374,"15min":0.374},"max":{"1min":1.159,"5min":1.331,"15min":1.3540000000000001},"last":1.006}]},{"osd":3,"last update":"Fri Sep 13 06:45:16 2024","interfaces":[{"interface":"back","average":{"1min":0.93899999999999995,"5min":0.84899999999999998,"15min":0.90300000000000002},"min":{"1min":0.63600000000000001,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.3919999999999999,"5min":1.6950000000000001,"15min":1.6950000000000001},"last":1.075},{"interface":"front","average":{"1min":0.94299999999999995,"5min":0.95899999999999996,"15min":0.92700000000000005},"min":{"1min":0.59299999999999997,"5min":0.41299999999999998,"15min":0.374},"max":{"1min":1.1539999999999999,"5min":10.195,"15min":10.195},"last":0.94199999999999995}]},{"osd":5,"last update":"Fri Sep 13 06:45:16 2024","interfaces":[{"interface":"back","average":{"1min":0.90800000000000003,"5min":0.82099999999999995,"15min":0.85899999999999999},"min":{"1min":0.65100000000000002,"5min":0.249,"15min":0.249},"max":{"1min":1.1779999999999999,"5min":1.913,"15min":2.9790000000000001},"last":0.85199999999999998},{"interface":"front","average":{"1min":0.93899999999999995,"5min":0.84199999999999997,"15min":0.91300000000000003},"min":{"1min":0.61899999999999999,"5min":0.372,"15min":0.372},"max":{"1min":1.298,"5min":1.6990000000000001,"15min":1.8779999999999999},"last":0.81499999999999995}]},{"osd":6,"last update":"Fri Sep 13 06:45:16 2024","interfaces":[{"interface":"back","average":{"1min":1.022,"5min":1.022,"15min":1.022},"min":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"max":{"1min":1.373,"5min":1.373,"15min":1.373},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"min":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"max":{"1min":1.298,"5min":1.298,"15min":1.298},"last":1.034}]},{"osd":7,"last update":"Fri Sep 13 06:45:38 2024","interfaces":[{"interface":"back","average":{"1min":1.036,"5min":0.85299999999999998,"15min":0.82299999999999995},"min":{"1min":0.76500000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.246,"5min":1.246,"15min":1.246},"last":0.92000000000000004},{"interface":"front","average":{"1min":1.1080000000000001,"5min":0.93600000000000005,"15min":0.90500000000000003},"min":{"1min":0.88200000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.343,"5min":1.343,"15min":1.343},"last":1.161}]}]},{"osd":3,"up_from":13,"seq":55834574934,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":74924,"kb_used_data":3620,"kb_used_omap":1,"kb_used_meta":71294,"kb_avail":94296916,"statfs":{"total":96636764160,"available":96560041984,"internally_reserved":0,"allocated":3706880,"data_stored":1857127,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":73005512},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 06:45:16 2024","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.56100000000000005,"15min":0.56899999999999995},"min":{"1min":0.26000000000000001,"5min":0.24199999999999999,"15min":0.191},"max":{"1min":1.0780000000000001,"5min":1.51,"15min":1.51},"last":0.82799999999999996},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.60299999999999998,"15min":0.65300000000000002},"min":{"1min":0.33600000000000002,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":1.0349999999999999,"5min":1.0509999999999999,"15min":1.2789999999999999},"last":0.71999999999999997}]},{"osd":1,"last update":"Fri Sep 13 06:45:16 2024","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.55600000000000005,"15min":0.58799999999999997},"min":{"1min":0.28899999999999998,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.92900000000000005,"5min":0.94499999999999995,"15min":0.97099999999999997},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.58699999999999997,"15min":0.66300000000000003},"min":{"1min":0.34899999999999998,"5min":0.27700000000000002,"15min":0.27200000000000002},"max":{"1min":0.98899999999999999,"5min":1.607,"15min":1.607},"last":0.58999999999999997}]},{"osd":2,"last update":"Fri Sep 13 06:45:16 2024","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.63300000000000001,"15min":0.65300000000000002},"min":{"1min":0.36699999999999999,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":1.048,"5min":1.5660000000000001,"15min":1.5660000000000001},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.59199999999999997,"15min":0.625},"min":{"1min":0.315,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.88400000000000001,"5min":1.409,"15min":1.409},"last":0.98899999999999999}]},{"osd":4,"last update":"Fri Sep 13 06:45:16 2024","interfaces":[{"interface":"back","average":{"1min":0.88200000000000001,"5min":0.81699999999999995,"15min":0.89100000000000001},"min":{"1min":0.64900000000000002,"5min":0.377,"15min":0.377},"max":{"1min":1.1919999999999999,"5min":1.651,"15min":1.7929999999999999},"last":1.0229999999999999},{"interface":"front","average":{"1min":0.877,"5min":0.78000000000000003,"15min":0.78800000000000003},"min":{"1min":0.60199999999999998,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.1559999999999999,"5min":1.173,"15min":1.3240000000000001},"last":0.90100000000000002}]},{"osd":5,"last update":"Fri Sep 13 06:45:16 2024","interfaces":[{"interface":"back","average":{"1min":0.90600000000000003,"5min":0.81899999999999995,"15min":0.85299999999999998},"min":{"1min":0.63300000000000001,"5min":0.47899999999999998,"15min":0.46700000000000003},"max":{"1min":1.2529999999999999,"5min":1.3500000000000001,"15min":1.3799999999999999},"last":1.1200000000000001},{"interface":"front","average":{"1min":0.91600000000000004,"5min":0.83299999999999996,"15min":0.86299999999999999},"min":{"1min":0.66000000000000003,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.1539999999999999,"5min":1.4610000000000001,"15min":1.4610000000000001},"last":1.077}]},{"osd":6,"last update":"Fri Sep 13 06:45:16 2024","interfaces":[{"interface":"back","average":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"min":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.357,"5min":1.357,"15min":1.357},"last":1.0940000000000001},{"interface":"front","average":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.173,"5min":1.173,"15min":1.173},"last":1.0580000000000001}]},{"osd":7,"last update":"Fri Sep 13 06:45:40 2024","interfaces":[{"interface":"back","average":{"1min":0.96299999999999997,"5min":0.90500000000000003,"15min":0.90200000000000002},"min":{"1min":0.752,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.135,"5min":1.3799999999999999,"15min":1.3799999999999999},"last":0.93100000000000005},{"interface":"front","average":{"1min":1.0720000000000001,"5min":0.97899999999999998,"15min":0.96899999999999997},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.3100000000000001,"5min":2.0459999999999998,"15min":2.0459999999999998},"last":1.145}]}]},{"osd":2,"up_from":13,"seq":55834574931,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60972,"kb_used_data":3620,"kb_used_omap":1,"kb_used_meta":57342,"kb_avail":94310868,"statfs":{"total":96636764160,"available":96574328832,"internally_reserved":0,"allocated":3706880,"data_stored":1857127,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":58718662},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 06:45:23 2024","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.69599999999999995,"15min":0.57199999999999995},"min":{"1min":0.29299999999999998,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":1.0409999999999999,"5min":8.6449999999999996,"15min":8.6449999999999996},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.67800000000000005,"15min":0.62},"min":{"1min":0.34499999999999997,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":1.371,"5min":4.0380000000000003,"15min":4.0380000000000003},"last":0.55800000000000005}]},{"osd":1,"last update":"Fri Sep 13 06:45:23 2024","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.65400000000000003,"15min":0.624},"min":{"1min":0.32700000000000001,"5min":0.249,"15min":0.23300000000000001},"max":{"1min":0.85399999999999998,"5min":3.4649999999999999,"15min":3.4649999999999999},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.69799999999999995,"15min":0.61399999999999999},"min":{"1min":0.35699999999999998,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":1.0620000000000001,"5min":3.8159999999999998,"15min":3.8159999999999998},"last":0.69799999999999995}]},{"osd":3,"last update":"Fri Sep 13 06:45:23 2024","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.70099999999999996,"15min":0.60299999999999998},"min":{"1min":0.39600000000000002,"5min":0.29399999999999998,"15min":0.249},"max":{"1min":1.0940000000000001,"5min":3.407,"15min":3.407},"last":1.032},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.76800000000000002,"15min":0.69699999999999995},"min":{"1min":0.38200000000000001,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.294,"5min":3.2639999999999998,"15min":3.2639999999999998},"last":0.85299999999999998}]},{"osd":4,"last update":"Fri Sep 13 06:45:23 2024","interfaces":[{"interface":"back","average":{"1min":0.97899999999999998,"5min":0.89600000000000002,"15min":0.89100000000000001},"min":{"1min":0.68400000000000005,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.288,"5min":3.1179999999999999,"15min":3.1179999999999999},"last":1.155},{"interface":"front","average":{"1min":0.97799999999999998,"5min":1.081,"15min":0.94699999999999995},"min":{"1min":0.53600000000000003,"5min":0.439,"15min":0.439},"max":{"1min":1.2330000000000001,"5min":21.081,"15min":21.081},"last":0.82299999999999995}]},{"osd":5,"last update":"Fri Sep 13 06:45:23 2024","interfaces":[{"interface":"back","average":{"1min":0.98999999999999999,"5min":0.878,"15min":0.85299999999999998},"min":{"1min":0.77300000000000002,"5min":0.46100000000000002,"15min":0.33800000000000002},"max":{"1min":1.3540000000000001,"5min":2.2389999999999999,"15min":2.2389999999999999},"last":1.2210000000000001},{"interface":"front","average":{"1min":1.099,"5min":1.01,"15min":0.90600000000000003},"min":{"1min":0.80800000000000005,"5min":0.377,"15min":0.377},"max":{"1min":1.4139999999999999,"5min":4.9039999999999999,"15min":4.9039999999999999},"last":1.272}]},{"osd":6,"last update":"Fri Sep 13 06:45:19 2024","interfaces":[{"interface":"back","average":{"1min":0.998,"5min":0.998,"15min":0.998},"min":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":1.5660000000000001,"5min":1.5660000000000001,"15min":1.5660000000000001},"last":1.099},{"interface":"front","average":{"1min":1.056,"5min":1.056,"15min":1.056},"min":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.6439999999999999,"5min":1.6439999999999999,"15min":1.6439999999999999},"last":1.335}]},{"osd":7,"last update":"Fri Sep 13 06:45:36 2024","interfaces":[{"interface":"back","average":{"1min":1.0309999999999999,"5min":0.90300000000000002,"15min":0.86199999999999999},"min":{"1min":0.69299999999999995,"5min":0.503,"15min":0.503},"max":{"1min":1.3220000000000001,"5min":1.641,"15min":1.641},"last":0.97099999999999997},{"interface":"front","average":{"1min":1.0649999999999999,"5min":0.93000000000000005,"15min":0.873},"min":{"1min":0.72099999999999997,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.5569999999999999,"5min":2.0630000000000002,"15min":2.0630000000000002},"last":1.2989999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574931,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52784,"kb_used_data":3624,"kb_used_omap":1,"kb_used_meta":49150,"kb_avail":94319056,"statfs":{"total":96636764160,"available":96582713344,"internally_reserved":0,"allocated":3710976,"data_stored":1856593,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":50330054},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 06:45:22 2024","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.57599999999999996,"15min":0.57999999999999996},"min":{"1min":0.42199999999999999,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.94699999999999995,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":0.91600000000000004},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.65700000000000003,"15min":0.66400000000000003},"min":{"1min":0.372,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.997,"5min":1.8160000000000001,"15min":1.8160000000000001},"last":0.82099999999999995}]},{"osd":2,"last update":"Fri Sep 13 06:45:22 2024","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.59899999999999998,"15min":0.63100000000000001},"min":{"1min":0.28599999999999998,"5min":0.22,"15min":0.22},"max":{"1min":1.0109999999999999,"5min":2.617,"15min":2.617},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.66500000000000004,"15min":0.65800000000000003},"min":{"1min":0.35099999999999998,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.95099999999999996,"5min":2.5249999999999999,"15min":2.5249999999999999},"last":0.65700000000000003}]},{"osd":3,"last update":"Fri Sep 13 06:45:22 2024","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.71999999999999997,"15min":0.73099999999999998},"min":{"1min":0.39300000000000002,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":1.1299999999999999,"5min":1.3600000000000001,"15min":1.3640000000000001},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.65600000000000003,"15min":0.68799999999999994},"min":{"1min":0.308,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.83599999999999997,"5min":1.752,"15min":1.752},"last":0.72499999999999998}]},{"osd":4,"last update":"Fri Sep 13 06:45:22 2024","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.80100000000000005,"15min":0.82099999999999995},"min":{"1min":0.53800000000000003,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":1.224,"5min":2.7389999999999999,"15min":2.7389999999999999},"last":1.117},{"interface":"front","average":{"1min":0.93400000000000005,"5min":0.85499999999999998,"15min":0.90600000000000003},"min":{"1min":0.52000000000000002,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.238,"5min":1.4159999999999999,"15min":1.4359999999999999},"last":0.999}]},{"osd":5,"last update":"Fri Sep 13 06:45:22 2024","interfaces":[{"interface":"back","average":{"1min":0.98699999999999999,"5min":0.85499999999999998,"15min":0.90900000000000003},"min":{"1min":0.73699999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.2729999999999999,"5min":1.607,"15min":1.7849999999999999},"last":0.97599999999999998},{"interface":"front","average":{"1min":1.0189999999999999,"5min":0.89200000000000002,"15min":0.88800000000000001},"min":{"1min":0.68100000000000005,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":1.266,"5min":1.6759999999999999,"15min":2.036},"last":1.069}]},{"osd":6,"last update":"Fri Sep 13 06:45:18 2024","interfaces":[{"interface":"back","average":{"1min":1.01,"5min":1.01,"15min":1.01},"min":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"max":{"1min":1.353,"5min":1.353,"15min":1.353},"last":1.1950000000000001},{"interface":"front","average":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"min":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":1.2110000000000001,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.874}]},{"osd":7,"last update":"Fri Sep 13 06:45:36 2024","interfaces":[{"interface":"back","average":{"1min":0.97199999999999998,"5min":0.92000000000000004,"15min":0.90800000000000003},"min":{"1min":0.56399999999999995,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":1.1539999999999999,"5min":1.605,"15min":1.605},"last":1.0349999999999999},{"interface":"front","average":{"1min":1.0620000000000001,"5min":0.96899999999999997,"15min":0.93000000000000005},"min":{"1min":0.64800000000000002,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.4319999999999999,"5min":1.5009999999999999,"15min":1.5009999999999999},"last":1.2490000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574930,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":85356,"kb_used_data":4196,"kb_used_omap":1,"kb_used_meta":81150,"kb_avail":94286484,"statfs":{"total":96636764160,"available":96549359616,"internally_reserved":0,"allocated":4296704,"data_stored":2446923,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":83098054},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 06:45:20 2024","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.55700000000000005,"15min":0.53300000000000003},"min":{"1min":0.23200000000000001,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":0.90800000000000003,"5min":1.103,"15min":1.2270000000000001},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.57399999999999995,"15min":0.54500000000000004},"min":{"1min":0.26300000000000001,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.90500000000000003,"5min":1.137,"15min":1.222},"last":0.72899999999999998}]},{"osd":2,"last update":"Fri Sep 13 06:45:14 2024","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.63,"15min":0.56399999999999995},"min":{"1min":0.28199999999999997,"5min":0.217,"15min":0.217},"max":{"1min":0.90300000000000002,"5min":1.839,"15min":1.839},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.629,"15min":0.58099999999999996},"min":{"1min":0.315,"5min":0.25900000000000001,"15min":0.245},"max":{"1min":0.97099999999999997,"5min":1.419,"15min":1.419},"last":0.66800000000000004}]},{"osd":3,"last update":"Fri Sep 13 06:45:14 2024","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.627,"15min":0.56699999999999995},"min":{"1min":0.34200000000000003,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.98599999999999999,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.82699999999999996},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.77100000000000002,"15min":0.70799999999999996},"min":{"1min":0.31,"5min":0.26100000000000001,"15min":0.24099999999999999},"max":{"1min":1.1080000000000001,"5min":4.9630000000000001,"15min":4.9630000000000001},"last":0.79400000000000004}]},{"osd":4,"last update":"Fri Sep 13 06:45:14 2024","interfaces":[{"interface":"back","average":{"1min":0.85499999999999998,"5min":0.81699999999999995,"15min":0.79800000000000004},"min":{"1min":0.44700000000000001,"5min":0.311,"15min":0.311},"max":{"1min":1.3109999999999999,"5min":1.6259999999999999,"15min":1.6259999999999999},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.84099999999999997,"5min":0.78100000000000003,"15min":0.79900000000000004},"min":{"1min":0.51100000000000001,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.117,"5min":1.181,"15min":1.6319999999999999},"last":0.91700000000000004}]},{"osd":5,"last update":"Fri Sep 13 06:45:14 2024","interfaces":[{"interface":"back","average":{"1min":0.95699999999999996,"5min":0.879,"15min":0.85899999999999999},"min":{"1min":0.46999999999999997,"5min":0.42299999999999999,"15min":0.378},"max":{"1min":1.323,"5min":1.575,"15min":1.575},"last":0.85699999999999998},{"interface":"front","average":{"1min":0.94399999999999995,"5min":0.87,"15min":0.874},"min":{"1min":0.64400000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.369,"5min":1.4319999999999999,"15min":1.5740000000000001},"last":0.97999999999999998}]},{"osd":6,"last update":"Fri Sep 13 06:45:20 2024","interfaces":[{"interface":"back","average":{"1min":1.004,"5min":1.004,"15min":1.004},"min":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"max":{"1min":1.397,"5min":1.397,"15min":1.397},"last":0.89400000000000002},{"interface":"front","average":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"min":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"max":{"1min":1.4159999999999999,"5min":1.4159999999999999,"15min":1.4159999999999999},"last":1.032}]},{"osd":7,"last update":"Fri Sep 13 06:45:33 2024","interfaces":[{"interface":"back","average":{"1min":1.0549999999999999,"5min":1.0489999999999999,"15min":1.0640000000000001},"min":{"1min":0.54200000000000004,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.448,"5min":1.9419999999999999,"15min":1.9419999999999999},"last":0.95199999999999996},{"interface":"front","average":{"1min":1.0880000000000001,"5min":0.99399999999999999,"15min":0.97599999999999998},"min":{"1min":0.61899999999999999,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.4770000000000001,"5min":1.901,"15min":1.901},"last":1.0760000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6552,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8096,"internal_metadata":0}]}} 2024-09-13T06:45:49.025 DEBUG:teuthology.orchestra.run.smithi081:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-09-13T06:45:49.321 INFO:teuthology.misc:Shutting down mds daemons... 2024-09-13T06:45:49.321 INFO:teuthology.misc:Shutting down osd daemons... 2024-09-13T06:45:49.321 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-09-13T06:45:49.321 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T06:45:52.951 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~0s 2024-09-13T06:45:55.423 INFO:tasks.ceph.osd.0:Stopped 2024-09-13T06:45:55.424 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-09-13T06:45:55.424 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T06:45:55.511 INFO:tasks.ceph.osd.1:Stopped 2024-09-13T06:45:55.511 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-09-13T06:45:55.511 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T06:45:55.598 INFO:tasks.ceph.osd.2:Stopped 2024-09-13T06:45:55.599 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-09-13T06:45:55.599 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T06:45:55.689 INFO:tasks.ceph.osd.3:Stopped 2024-09-13T06:45:55.690 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-09-13T06:45:55.690 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T06:45:55.763 INFO:tasks.ceph.osd.4:Stopped 2024-09-13T06:45:55.763 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-09-13T06:45:55.763 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T06:45:55.864 INFO:tasks.ceph.osd.5:Stopped 2024-09-13T06:45:55.865 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-09-13T06:45:55.865 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T06:45:55.942 INFO:tasks.ceph.osd.6:Stopped 2024-09-13T06:45:55.942 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-09-13T06:45:55.942 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T06:45:58.455 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~0s 2024-09-13T06:45:58.455 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 has been restored 2024-09-13T06:46:02.044 INFO:tasks.ceph.osd.7:Stopped 2024-09-13T06:46:02.044 INFO:teuthology.misc:Shutting down mgr daemons... 2024-09-13T06:46:02.045 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-09-13T06:46:02.045 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T06:46:02.075 INFO:tasks.ceph.mgr.y:Stopped 2024-09-13T06:46:02.075 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-09-13T06:46:02.075 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T06:46:02.109 INFO:tasks.ceph.mgr.x:Stopped 2024-09-13T06:46:02.110 INFO:teuthology.misc:Shutting down mon daemons... 2024-09-13T06:46:02.110 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-09-13T06:46:02.110 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T06:46:02.137 INFO:tasks.ceph.mon.a:Stopped 2024-09-13T06:46:02.137 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-09-13T06:46:02.138 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T06:46:02.202 INFO:tasks.ceph.mon.c:Stopped 2024-09-13T06:46:02.202 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-09-13T06:46:02.202 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T06:46:02.227 INFO:tasks.ceph.mon.b:Stopped 2024-09-13T06:46:02.227 INFO:tasks.ceph:Checking cluster log for badness... 2024-09-13T06:46:02.227 DEBUG:teuthology.orchestra.run.smithi081:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(OSD_SLOW_PING_TIME' | egrep -v 'but it is still running' | egrep -v 'objects unfound and apparently lost' | egrep -v 'overall HEALTH_' | egrep -v '\(OSDMAP_FLAGS\)' | egrep -v '\(OSD_' | egrep -v '\(PG_' | egrep -v '\(POOL_' | egrep -v '\(CACHE_POOL_' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v '\(OBJECT_' | egrep -v '\(SLOW_OPS\)' | egrep -v '\(REQUEST_SLOW\)' | egrep -v '\(TOO_FEW_PGS\)' | egrep -v 'slow request' | egrep -v 'timeout on replica' | egrep -v 'late reservation from' | head -n 1 2024-09-13T06:46:02.262 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi081.front.sepia.ceph.com 2024-09-13T06:46:02.262 DEBUG:teuthology.orchestra.run.smithi081:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-09-13T06:46:02.477 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi081.front.sepia.ceph.com 2024-09-13T06:46:02.477 DEBUG:teuthology.orchestra.run.smithi081:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-09-13T06:46:02.701 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi081.front.sepia.ceph.com 2024-09-13T06:46:02.701 DEBUG:teuthology.orchestra.run.smithi081:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-09-13T06:46:02.886 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi081.front.sepia.ceph.com 2024-09-13T06:46:02.887 DEBUG:teuthology.orchestra.run.smithi081:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-09-13T06:46:03.065 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi139.front.sepia.ceph.com 2024-09-13T06:46:03.065 DEBUG:teuthology.orchestra.run.smithi139:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-09-13T06:46:03.269 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi139.front.sepia.ceph.com 2024-09-13T06:46:03.270 DEBUG:teuthology.orchestra.run.smithi139:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-09-13T06:46:03.420 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi139.front.sepia.ceph.com 2024-09-13T06:46:03.420 DEBUG:teuthology.orchestra.run.smithi139:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-09-13T06:46:03.456 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 has been restored 2024-09-13T06:46:03.543 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi139.front.sepia.ceph.com 2024-09-13T06:46:03.543 DEBUG:teuthology.orchestra.run.smithi139:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-09-13T06:46:03.717 INFO:tasks.ceph:Archiving mon data... 2024-09-13T06:46:03.719 DEBUG:teuthology.misc:Transferring archived files from smithi081:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/teuthology-2024-09-10_22:16:02-rbd-reef-distro-default-smithi/7900868/data/mon.a.tgz 2024-09-13T06:46:03.719 DEBUG:teuthology.orchestra.run.smithi081:> mktemp 2024-09-13T06:46:03.725 INFO:teuthology.orchestra.run.smithi081.stdout:/tmp/tmp.zIY7vvPebH 2024-09-13T06:46:03.725 DEBUG:teuthology.orchestra.run.smithi081:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.zIY7vvPebH 2024-09-13T06:46:03.885 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod 0666 /tmp/tmp.zIY7vvPebH 2024-09-13T06:46:03.946 DEBUG:teuthology.orchestra.remote:smithi081:/tmp/tmp.zIY7vvPebH is 446KB 2024-09-13T06:46:04.008 DEBUG:teuthology.orchestra.run.smithi081:> rm -fr /tmp/tmp.zIY7vvPebH 2024-09-13T06:46:04.013 DEBUG:teuthology.misc:Transferring archived files from smithi081:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/teuthology-2024-09-10_22:16:02-rbd-reef-distro-default-smithi/7900868/data/mon.c.tgz 2024-09-13T06:46:04.013 DEBUG:teuthology.orchestra.run.smithi081:> mktemp 2024-09-13T06:46:04.062 INFO:teuthology.orchestra.run.smithi081.stdout:/tmp/tmp.5xCJF4cK4P 2024-09-13T06:46:04.062 DEBUG:teuthology.orchestra.run.smithi081:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.5xCJF4cK4P 2024-09-13T06:46:04.216 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod 0666 /tmp/tmp.5xCJF4cK4P 2024-09-13T06:46:04.282 DEBUG:teuthology.orchestra.remote:smithi081:/tmp/tmp.5xCJF4cK4P is 450KB 2024-09-13T06:46:04.344 DEBUG:teuthology.orchestra.run.smithi081:> rm -fr /tmp/tmp.5xCJF4cK4P 2024-09-13T06:46:04.349 DEBUG:teuthology.misc:Transferring archived files from smithi139:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/teuthology-2024-09-10_22:16:02-rbd-reef-distro-default-smithi/7900868/data/mon.b.tgz 2024-09-13T06:46:04.349 DEBUG:teuthology.orchestra.run.smithi139:> mktemp 2024-09-13T06:46:04.355 INFO:teuthology.orchestra.run.smithi139.stdout:/tmp/tmp.VemZRP6NHP 2024-09-13T06:46:04.355 DEBUG:teuthology.orchestra.run.smithi139:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.VemZRP6NHP 2024-09-13T06:46:04.514 DEBUG:teuthology.orchestra.run.smithi139:> sudo chmod 0666 /tmp/tmp.VemZRP6NHP 2024-09-13T06:46:04.578 DEBUG:teuthology.orchestra.remote:smithi139:/tmp/tmp.VemZRP6NHP is 450KB 2024-09-13T06:46:04.644 DEBUG:teuthology.orchestra.run.smithi139:> rm -fr /tmp/tmp.VemZRP6NHP 2024-09-13T06:46:04.649 INFO:tasks.ceph:Cleaning ceph cluster... 2024-09-13T06:46:04.650 DEBUG:teuthology.orchestra.run.smithi081:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-13T06:46:04.652 DEBUG:teuthology.orchestra.run.smithi139:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-13T06:46:04.707 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2024-09-13T06:46:04.707 DEBUG:teuthology.orchestra.run.smithi081:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2024-09-13T06:46:04.709 DEBUG:teuthology.orchestra.run.smithi139:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2024-09-13T06:46:04.730 INFO:teuthology.orchestra.run.smithi081.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2024-09-13T06:46:04.773 INFO:teuthology.orchestra.run.smithi139.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2024-09-13T06:46:04.778 INFO:tasks.ceph:Archiving crash dumps... 2024-09-13T06:46:04.779 DEBUG:teuthology.misc:Transferring archived files from smithi081:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-09-10_22:16:02-rbd-reef-distro-default-smithi/7900868/remote/smithi081/crash 2024-09-13T06:46:04.780 DEBUG:teuthology.orchestra.run.smithi081:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-13T06:46:04.793 DEBUG:teuthology.misc:Transferring archived files from smithi139:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-09-10_22:16:02-rbd-reef-distro-default-smithi/7900868/remote/smithi139/crash 2024-09-13T06:46:04.793 DEBUG:teuthology.orchestra.run.smithi139:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-13T06:46:04.831 INFO:tasks.ceph:Compressing logs... 2024-09-13T06:46:04.831 DEBUG:teuthology.orchestra.run.smithi081:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-13T06:46:04.839 DEBUG:teuthology.orchestra.run.smithi139:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-13T06:46:24.584 INFO:tasks.ceph:Archiving logs... 2024-09-13T06:46:24.585 DEBUG:teuthology.misc:Transferring archived files from smithi081:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-10_22:16:02-rbd-reef-distro-default-smithi/7900868/remote/smithi081/log 2024-09-13T06:46:24.586 DEBUG:teuthology.orchestra.run.smithi081:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-13T06:46:26.607 DEBUG:teuthology.misc:Transferring archived files from smithi139:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-10_22:16:02-rbd-reef-distro-default-smithi/7900868/remote/smithi139/log 2024-09-13T06:46:26.608 DEBUG:teuthology.orchestra.run.smithi139:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-13T06:46:27.869 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-13T06:46:27.878 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-13T06:46:27.878 DEBUG:teuthology.orchestra.run.smithi081:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-13T06:46:27.881 DEBUG:teuthology.orchestra.run.smithi139:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-13T06:46:27.975 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-13T06:46:27.984 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-13T06:46:27.984 DEBUG:teuthology.orchestra.run.smithi081:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-13T06:46:27.987 DEBUG:teuthology.orchestra.run.smithi139:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-13T06:46:27.997 INFO:teuthology.orchestra.run.smithi081.stdout: remote refid st t when poll reach delay offset jitter 2024-09-13T06:46:27.998 INFO:teuthology.orchestra.run.smithi081.stdout:============================================================================== 2024-09-13T06:46:27.998 INFO:teuthology.orchestra.run.smithi081.stdout:+hv01.front.sepi 67.205.162.81 3 u 56 64 377 0.078 -1.939 1.773 2024-09-13T06:46:27.998 INFO:teuthology.orchestra.run.smithi081.stdout:+hv02.front.sepi 63.231.80.2 3 u 63 64 377 0.095 +1.577 1.967 2024-09-13T06:46:27.998 INFO:teuthology.orchestra.run.smithi081.stdout:*hv03.front.sepi 74.6.168.72 3 u 62 64 377 0.056 -1.472 1.920 2024-09-13T06:46:27.998 INFO:teuthology.orchestra.run.smithi081.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-13T06:46:28.001 INFO:teuthology.orchestra.run.smithi139.stdout: remote refid st t when poll reach delay offset jitter 2024-09-13T06:46:28.001 INFO:teuthology.orchestra.run.smithi139.stdout:============================================================================== 2024-09-13T06:46:28.001 INFO:teuthology.orchestra.run.smithi139.stdout:*hv01.front.sepi 67.205.162.81 3 u 59 64 377 0.081 -0.563 3.038 2024-09-13T06:46:28.001 INFO:teuthology.orchestra.run.smithi139.stdout:+hv02.front.sepi 63.231.80.2 3 u 64 64 377 0.066 +0.587 1.888 2024-09-13T06:46:28.001 INFO:teuthology.orchestra.run.smithi139.stdout:+hv03.front.sepi 74.6.168.72 3 u 64 64 377 0.061 -1.836 2.007 2024-09-13T06:46:28.001 INFO:teuthology.orchestra.run.smithi139.stdout: hv04.front.sepi .INIT. 16 u - 128 0 0.000 +0.000 0.000 2024-09-13T06:46:28.002 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-13T06:46:28.011 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-13T06:46:28.012 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-13T06:46:28.031 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-13T06:46:28.048 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-13T06:46:28.065 INFO:teuthology.task.internal:Duration was 1045.374175 seconds 2024-09-13T06:46:28.066 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-13T06:46:28.081 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-13T06:46:28.082 DEBUG:teuthology.orchestra.run.smithi081:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-13T06:46:28.084 DEBUG:teuthology.orchestra.run.smithi139:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-13T06:46:28.123 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-13T06:46:28.123 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi081.front.sepia.ceph.com 2024-09-13T06:46:28.123 DEBUG:teuthology.orchestra.run.smithi081:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-13T06:46:28.178 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi139.front.sepia.ceph.com 2024-09-13T06:46:28.179 DEBUG:teuthology.orchestra.run.smithi139:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-13T06:46:28.189 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-13T06:46:28.189 DEBUG:teuthology.orchestra.run.smithi081:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-13T06:46:28.223 DEBUG:teuthology.orchestra.run.smithi139:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-13T06:46:28.264 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-13T06:46:28.264 DEBUG:teuthology.orchestra.run.smithi081:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-13T06:46:28.299 DEBUG:teuthology.orchestra.run.smithi139:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-13T06:46:28.392 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-13T06:46:28.402 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-13T06:46:28.402 DEBUG:teuthology.orchestra.run.smithi081:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-13T06:46:28.414 DEBUG:teuthology.orchestra.run.smithi139:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-13T06:46:28.426 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-13T06:46:28.435 DEBUG:teuthology.orchestra.run.smithi081:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-13T06:46:28.459 DEBUG:teuthology.orchestra.run.smithi139:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-13T06:46:28.466 INFO:teuthology.orchestra.run.smithi081.stdout:kernel.core_pattern = core 2024-09-13T06:46:28.479 INFO:teuthology.orchestra.run.smithi139.stdout:kernel.core_pattern = core 2024-09-13T06:46:28.578 DEBUG:teuthology.orchestra.run.smithi081:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-13T06:46:28.583 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T06:46:28.583 DEBUG:teuthology.orchestra.run.smithi139:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-13T06:46:28.625 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T06:46:28.626 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-13T06:46:28.636 INFO:teuthology.task.internal:Transferring archived files... 2024-09-13T06:46:28.636 DEBUG:teuthology.misc:Transferring archived files from smithi081:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-10_22:16:02-rbd-reef-distro-default-smithi/7900868/remote/smithi081 2024-09-13T06:46:28.637 DEBUG:teuthology.orchestra.run.smithi081:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-13T06:46:28.664 DEBUG:teuthology.misc:Transferring archived files from smithi139:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-10_22:16:02-rbd-reef-distro-default-smithi/7900868/remote/smithi139 2024-09-13T06:46:28.665 DEBUG:teuthology.orchestra.run.smithi139:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-13T06:46:28.690 INFO:teuthology.task.internal:Removing archive directory... 2024-09-13T06:46:28.690 DEBUG:teuthology.orchestra.run.smithi081:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-13T06:46:28.703 DEBUG:teuthology.orchestra.run.smithi139:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-13T06:46:28.738 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-13T06:46:28.749 INFO:teuthology.task.internal:Not uploading archives. 2024-09-13T06:46:28.750 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-13T06:46:28.774 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-13T06:46:28.774 DEBUG:teuthology.orchestra.run.smithi081:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-13T06:46:28.777 DEBUG:teuthology.orchestra.run.smithi139:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-13T06:46:28.780 INFO:teuthology.orchestra.run.smithi081.stdout: 658620 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 13 06:46 /home/ubuntu/cephtest 2024-09-13T06:46:28.787 INFO:teuthology.orchestra.run.smithi139.stdout: 658623 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 13 06:46 /home/ubuntu/cephtest 2024-09-13T06:46:28.789 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-13T06:46:28.799 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-13T06:46:28.835 INFO:teuthology.run:Summary data: description: rbd/thrash/{base/install clusters/{fixed-2 openstack} conf/{disable-pool-app} msgr-failures/few objectstore/bluestore-low-osd-mem-target supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/rbd_fsx_deep_copy} duration: 1045.374175310135 flavor: default owner: scheduled_teuthology@teuthology success: true 2024-09-13T06:46:28.835 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-13T06:46:28.918 INFO:teuthology.run:pass